2023-08-31T17:16:31.032 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-31T17:16:31.033 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686 --name pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} --verbose -- /home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686/orig.config.yaml 2023-08-31T17:16:31.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T17:16:31.162 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686 branch: wip-batrick-testing-20230831.124848-pacific description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: pdonnell@redhat.com first_in_suite: false job_id: '7385686' kernel: client: branch: testing kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-batrick-testing-20230831.124848-pacific ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: b8d3759ea1ec9111c6e7f552353860ccc6501ad8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b8d3759ea1ec9111c6e7f552353860ccc6501ad8 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20230831.124848-pacific sha1: b8d3759ea1ec9111c6e7f552353860ccc6501ad8 owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 998 sha1: b8d3759ea1ec9111c6e7f552353860ccc6501ad8 sleep_before_teardown: 0 subset: 1/512 suite: fs suite_branch: wip-batrick-testing-20230831.124848-pacific suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_b8d3759ea1ec9111c6e7f552353860ccc6501ad8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: b8d3759ea1ec9111c6e7f552353860ccc6501ad8 targets: smithi072.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCl7wbiq/MApWp63+vfnCy/JoQxhjHxP5MfrC/43lYiDNXYYhWVA82bohfjm4tjCiXWA0pmVQIXfUJylsmkobkagX4nnWzxHo4e0dAaYiInPF8SXIE/1qP+33VEq/FhVOqdtRGJd1s6yFwe7+1rYiABDEsQWSTRgDHSjl0nthddygDo2oj99fK8gf8238+SDhcgqo2xpnQtM+ZMZQOimdkOGC3toUbiFoCJ8X8melp3bfzFrox0m+v+JRDOYbpqlFqZ0RqH0WH2p+iM1w8XxM831v5jsNSWaJVzRnADzGdvd3LNcwBpU8dx7nbj+Zmt6UQ7DnCk8P5a1wluM9cf291KtrbMaDHMw4nWv9f47puqg7+5jOPK2JN7Eb6ffmZndPBkenrSdlQ2n2XD8hoql/7VhbbMSnvwQVqhmTXOQHEgQPDAMkAXfPXNIkSK+WhgPYashLGPqp4nIPROEnD8af6Nh9bhTYFIZ5OhRBnZYZreMviwlGv5WYXNeS/lP28AN4U= smithi146.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/LknFDYQtG86kLAEdfA2CAfYyLpnYltWNFVnnisZIRpWhAijA0KNpttVUhLn9qau+VWIu2MGSQrX0QYo4Wr/hb/9O3rptnO1NDRyX8nZKmalsQnUkfBfjbxiEWT2o9HaT718+pemLljc4je97ZgC4MUiEPwVj+JJ9gEs0eX6WNG6UQtaS/FbE+DSyH2W5cxp6g+LMHr3rkgsqrusJqSK9YTVoea/nHG7I9s2OVMaQV6HrAtdzmWlaobu78kbSPR2Gnyg4Ym4ERWZmToVxfQoL3pvxNx2lrzGEGD3cjrjKqR8iOiQElRbI6IkAkV1E27nQKtROXTe2wnaI2P3Vu3xaVYwpNTpvQFQFWEiRAZ/edpabZ3B4/TXKoX+ZnA+E/L7uJ4tNkLOst5pjKNdZkca6fq4k5YSXU75mINX0J9cpNPI2L7wV17S+u5rPrO6Bv0jpvaM1R+QEt7ZVYBa+QZMOrajruJ/OwO9AG/qAh33t8xejKgOQpR3FfvT2C6vRbRU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: f9a8556d5e989d27b6626a0b75ef595991f83d20 timestamp: 2023-08-31_15:31:51 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1394 2023-08-31T17:16:31.162 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_b8d3759ea1ec9111c6e7f552353860ccc6501ad8/qa; will attempt to use it 2023-08-31T17:16:31.163 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_b8d3759ea1ec9111c6e7f552353860ccc6501ad8/qa/tasks 2023-08-31T17:16:31.164 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-31T17:16:31.165 INFO:teuthology.task.internal:Checking packages... 2023-08-31T17:16:31.189 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b8d3759ea1ec9111c6e7f552353860ccc6501ad8' 2023-08-31T17:16:31.189 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-31T17:16:31.190 INFO:teuthology.packaging:ref: None 2023-08-31T17:16:31.190 INFO:teuthology.packaging:tag: None 2023-08-31T17:16:31.190 INFO:teuthology.packaging:branch: wip-batrick-testing-20230831.124848-pacific 2023-08-31T17:16:31.191 INFO:teuthology.packaging:sha1: b8d3759ea1ec9111c6e7f552353860ccc6501ad8 2023-08-31T17:16:31.191 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20230831.124848-pacific 2023-08-31T17:16:31.412 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-21.gb8d3759e 2023-08-31T17:16:31.413 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-31T17:16:31.419 INFO:teuthology.task.internal:no buildpackages task found 2023-08-31T17:16:31.419 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-31T17:16:31.429 INFO:teuthology.task.internal:Saving configuration 2023-08-31T17:16:31.447 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-31T17:16:31.454 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T17:16:31.482 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 17:10:57.332589', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMtbVyh7ZzYGvddLffjL/ECBHMm45loA9BBc+b09pL9O2Kvj6K1QMCRxOBYcaIleM1cVeeGCHYfyyUlXmz0HlL0='} 2023-08-31T17:16:31.508 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 17:10:57.330574', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFCylVRTPSkQddy51s7ibgseRfpNqaM/d9BRDuKiF3ZR+86LcW6S+c4rRgbHAMpdssoFj6aAtFAWs/KBMCf0AP8='} 2023-08-31T17:16:31.509 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-31T17:16:31.523 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-31T17:16:31.524 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-31T17:16:31.524 INFO:teuthology.run_tasks:Running task console_log... 2023-08-31T17:16:31.610 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbb9fd0baf0>, signals=[15]) 2023-08-31T17:16:31.612 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-31T17:16:31.618 INFO:teuthology.task.internal:Opening connections... 2023-08-31T17:16:31.619 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T17:16:31.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T17:16:31.697 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2023-08-31T17:16:31.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T17:16:31.768 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-31T17:16:31.775 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-08-31T17:16:31.797 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-08-31T17:16:31.798 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-08-31T17:16:31.858 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-08-31T17:16:31.858 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8" 2023-08-31T17:16:31.859 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-08-31T17:16:31.859 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-08-31T17:16:31.859 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8" 2023-08-31T17:16:31.859 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-08-31T17:16:31.859 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-31T17:16:31.860 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-08-31T17:16:31.860 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-31T17:16:31.860 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-08-31T17:16:31.860 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T17:16:31.860 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T17:16:31.861 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-31T17:16:31.861 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-08-31T17:16:31.885 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-08-31T17:16:31.908 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-08-31T17:16:31.909 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-08-31T17:16:31.969 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2023-08-31T17:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8" 2023-08-31T17:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2023-08-31T17:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2023-08-31T17:16:31.970 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8" 2023-08-31T17:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2023-08-31T17:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-31T17:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-08-31T17:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-31T17:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2023-08-31T17:16:31.971 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T17:16:31.972 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T17:16:31.972 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-31T17:16:31.972 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-08-31T17:16:31.992 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-31T17:16:32.003 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-31T17:16:32.058 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-31T17:16:32.059 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2023-08-31T17:16:32.062 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2023-08-31T17:16:32.082 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-31T17:16:32.088 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-31T17:16:32.088 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2023-08-31T17:16:32.122 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2023-08-31T17:16:32.152 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-31T17:16:32.209 INFO:teuthology.run_tasks:Running task kernel... 2023-08-31T17:16:32.232 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-08-31T17:16:32.233 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-08-31T17:16:32.233 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-08-31T17:16:32.233 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-31T17:16:32.234 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-31T17:16:32.253 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T17:16:32.255 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-08-31T17:16:32.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T17:16:32.259 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-08-31T17:16:32.465 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1931c6efd6a83fb6675c4150c7cc812ef143433f 2023-08-31T17:16:32.465 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1931c6efd6a83fb6675c4150c7cc812ef143433f"... 2023-08-31T17:16:32.465 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-08-31T17:16:32.468 DEBUG:teuthology.task.kernel:sha1 for client.1 is 1931c6efd6a83fb6675c4150c7cc812ef143433f 2023-08-31T17:16:32.468 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "1931c6efd6a83fb6675c4150c7cc812ef143433f"... 2023-08-31T17:16:32.468 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2023-08-31T17:16:32.490 INFO:teuthology.orchestra.run.smithi072.stdout:4.18.0-489.el8.x86_64 2023-08-31T17:16:32.490 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 1931c6efd6a83fb6675c4150c7cc812ef143433f 2023-08-31T17:16:32.491 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-31T17:16:32.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum upgrade -y linux-firmware 2023-08-31T17:16:32.492 INFO:teuthology.orchestra.run.smithi146.stdout:4.18.0-489.el8.x86_64 2023-08-31T17:16:32.493 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 1931c6efd6a83fb6675c4150c7cc812ef143433f 2023-08-31T17:16:32.493 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-31T17:16:32.493 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum upgrade -y linux-firmware 2023-08-31T17:16:36.237 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - AppStream 30 MB/s | 33 MB 00:01 2023-08-31T17:16:38.261 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - AppStream 26 MB/s | 33 MB 00:01 2023-08-31T17:16:48.004 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 47 MB 00:03 2023-08-31T17:16:54.915 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras 110 kB/s | 18 kB 00:00 2023-08-31T17:16:55.649 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.8 kB 00:00 2023-08-31T17:16:55.960 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-08-31T17:16:57.106 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-08-31T17:17:00.873 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 586 kB/s | 24 kB 00:00 2023-08-31T17:17:04.699 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-08-31T17:17:04.699 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-08-31T17:17:04.700 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repo Size 2023-08-31T17:17:04.700 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-08-31T17:17:04.700 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2023-08-31T17:17:04.700 INFO:teuthology.orchestra.run.smithi072.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-08-31T17:17:04.700 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T17:17:04.701 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-08-31T17:17:04.701 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-08-31T17:17:04.701 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 1 Package 2023-08-31T17:17:04.701 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T17:17:04.701 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 286 M 2023-08-31T17:17:04.702 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-08-31T17:17:05.012 INFO:teuthology.orchestra.run.smithi072.stdout:[MIRROR] linux-firmware-20230824-118.git0e048b06.el8.noarch.rpm: Status code: 503 for http://mirror.dal.nexril.net/centos/8-stream/BaseOS/x86_64/os/Packages/linux-firmware-20230824-118.git0e048b06.el8.noarch.rpm (IP: 161.129.154.250) 2023-08-31T17:17:29.509 INFO:teuthology.orchestra.run.smithi072.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 12 MB/s | 286 MB 00:24 2023-08-31T17:17:29.509 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-08-31T17:17:29.510 INFO:teuthology.orchestra.run.smithi072.stdout:Total 12 MB/s | 286 MB 00:24 2023-08-31T17:17:31.212 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-08-31T17:17:31.305 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-08-31T17:17:31.306 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-08-31T17:17:33.084 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-08-31T17:17:33.113 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-08-31T17:17:52.785 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-08-31T17:17:53.128 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-08-31T17:17:53.404 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-31T17:17:53.636 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-31T17:17:53.636 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-08-31T17:17:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-31T17:17:54.368 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T17:17:54.369 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2023-08-31T17:17:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-08-31T17:17:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T17:17:54.369 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-08-31T17:17:54.560 INFO:teuthology.task.kernel:Downloading kernel 1931c6efd6a83fb6675c4150c7cc812ef143433f on client.0... 2023-08-31T17:17:54.561 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1931c6efd6a83fb6675c4150c7cc812ef143433f 2023-08-31T17:17:54.775 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/1931c6efd6a83fb6675c4150c7cc812ef143433f/centos/8/flavors/default/x86_64/ 2023-08-31T17:17:54.776 DEBUG:teuthology.orchestra.run.smithi072:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_g1931c6efd6a8-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/1931c6efd6a83fb6675c4150c7cc812ef143433f/centos/8/flavors/default/x86_64/ --input-file=- 2023-08-31T17:17:54.778 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi072.front.sepia.ceph.com to complete... 2023-08-31T17:18:08.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31 17:18:08 URL:https://4.chacra.ceph.com/r/kernel/testing/1931c6efd6a83fb6675c4150c7cc812ef143433f/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_g1931c6efd6a8-1.x86_64.rpm [380759600/380759600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-31T17:18:08.017 INFO:teuthology.orchestra.run.smithi072.stderr:FINISHED --2023-08-31 17:18:08-- 2023-08-31T17:18:08.017 INFO:teuthology.orchestra.run.smithi072.stderr:Total wall clock time: 13s 2023-08-31T17:18:08.018 INFO:teuthology.orchestra.run.smithi072.stderr:Downloaded: 1 files, 363M in 13s (28.4 MB/s) 2023-08-31T17:18:08.019 INFO:teuthology.task.kernel:Installing kernel 1931c6efd6a83fb6675c4150c7cc812ef143433f on client.0... 2023-08-31T17:18:08.020 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-31T17:18:09.679 INFO:teuthology.orchestra.run.smithi072.stdout:Verifying... ######################################## 2023-08-31T17:18:09.722 INFO:teuthology.orchestra.run.smithi072.stdout:Preparing... ######################################## 2023-08-31T17:18:09.831 INFO:teuthology.orchestra.run.smithi072.stdout:Updating / installing... 2023-08-31T17:18:47.909 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-6.5.0_rc7_g1931c6efd6a8-1 ######################################## 2023-08-31T17:19:25.663 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-31T17:19:25.664 DEBUG:teuthology.orchestra.run.smithi072:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-31T17:19:25.722 INFO:teuthology.orchestra.run.smithi072.stdout:/boot/System.map-6.5.0-rc7-g1931c6efd6a8 2023-08-31T17:19:25.722 INFO:teuthology.orchestra.run.smithi072.stdout:/boot/config-6.5.0-rc7-g1931c6efd6a8 2023-08-31T17:19:25.723 INFO:teuthology.orchestra.run.smithi072.stdout:/boot/vmlinuz-6.5.0-rc7-g1931c6efd6a8 2023-08-31T17:19:25.723 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8 2023-08-31T17:19:25.723 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel 2023-08-31T17:19:25.723 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch 2023-08-31T17:19:25.723 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86 2023-08-31T17:19:25.724 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto 2023-08-31T17:19:25.724 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-31T17:19:25.724 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-31T17:19:25.724 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-31T17:19:25.724 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-31T17:19:25.725 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-31T17:19:25.725 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-31T17:19:25.725 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-31T17:19:25.725 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-31T17:19:25.725 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-31T17:19:25.726 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-31T17:19:25.726 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-31T17:19:25.726 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-31T17:19:25.726 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-31T17:19:25.727 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-31T17:19:25.727 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-31T17:19:25.727 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-31T17:19:25.727 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-31T17:19:25.727 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-31T17:19:25.728 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-31T17:19:25.728 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-31T17:19:25.728 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kernel 2023-08-31T17:19:25.728 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kernel/cpu 2023-08-31T17:19:25.728 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kernel/cpu/mce 2023-08-31T17:19:25.728 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-31T17:19:25.729 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kvm 2023-08-31T17:19:25.729 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-31T17:19:25.729 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-31T17:19:25.729 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kvm/kvm.ko 2023-08-31T17:19:25.729 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto 2023-08-31T17:19:25.730 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/ansi_cprng.ko 2023-08-31T17:19:25.730 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/anubis.ko 2023-08-31T17:19:25.730 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/arc4.ko 2023-08-31T17:19:25.730 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/async_tx 2023-08-31T17:19:25.730 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/async_tx/async_memcpy.ko 2023-08-31T17:19:25.731 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/async_tx/async_pq.ko 2023-08-31T17:19:25.731 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-31T17:19:25.731 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/async_tx/async_tx.ko 2023-08-31T17:19:25.731 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/async_tx/async_xor.ko 2023-08-31T17:19:25.731 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/async_tx/raid6test.ko 2023-08-31T17:19:25.732 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/authenc.ko 2023-08-31T17:19:25.732 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/authencesn.ko 2023-08-31T17:19:25.732 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/blake2b_generic.ko 2023-08-31T17:19:25.732 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/blowfish_common.ko 2023-08-31T17:19:25.732 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/blowfish_generic.ko 2023-08-31T17:19:25.733 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/camellia_generic.ko 2023-08-31T17:19:25.733 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/cast5_generic.ko 2023-08-31T17:19:25.733 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/cast6_generic.ko 2023-08-31T17:19:25.733 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/cast_common.ko 2023-08-31T17:19:25.733 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/ccm.ko 2023-08-31T17:19:25.733 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/cmac.ko 2023-08-31T17:19:25.734 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/crc32_generic.ko 2023-08-31T17:19:25.734 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/crypto_engine.ko 2023-08-31T17:19:25.734 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/crypto_user.ko 2023-08-31T17:19:25.734 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/cts.ko 2023-08-31T17:19:25.734 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/des_generic.ko 2023-08-31T17:19:25.735 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/dh_generic.ko 2023-08-31T17:19:25.735 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/echainiv.ko 2023-08-31T17:19:25.735 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/essiv.ko 2023-08-31T17:19:25.735 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/fcrypt.ko 2023-08-31T17:19:25.735 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/khazad.ko 2023-08-31T17:19:25.736 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/lz4.ko 2023-08-31T17:19:25.736 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/lz4hc.ko 2023-08-31T17:19:25.736 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/md4.ko 2023-08-31T17:19:25.736 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/michael_mic.ko 2023-08-31T17:19:25.736 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/pcbc.ko 2023-08-31T17:19:25.737 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/pcrypt.ko 2023-08-31T17:19:25.737 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/rmd160.ko 2023-08-31T17:19:25.737 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/seed.ko 2023-08-31T17:19:25.737 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/serpent_generic.ko 2023-08-31T17:19:25.737 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/tcrypt.ko 2023-08-31T17:19:25.737 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/tea.ko 2023-08-31T17:19:25.738 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/twofish_common.ko 2023-08-31T17:19:25.738 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/twofish_generic.ko 2023-08-31T17:19:25.738 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/vmac.ko 2023-08-31T17:19:25.738 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/wp512.ko 2023-08-31T17:19:25.738 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/xcbc.ko 2023-08-31T17:19:25.739 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/xor.ko 2023-08-31T17:19:25.739 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/xxhash_generic.ko 2023-08-31T17:19:25.739 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers 2023-08-31T17:19:25.739 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi 2023-08-31T17:19:25.739 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-31T17:19:25.740 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/acpi_pad.ko 2023-08-31T17:19:25.740 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/custom_method.ko 2023-08-31T17:19:25.740 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/ec_sys.ko 2023-08-31T17:19:25.740 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/platform_profile.ko 2023-08-31T17:19:25.740 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/sbs.ko 2023-08-31T17:19:25.741 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/sbshc.ko 2023-08-31T17:19:25.741 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/video.ko 2023-08-31T17:19:25.741 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata 2023-08-31T17:19:25.741 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/acard-ahci.ko 2023-08-31T17:19:25.741 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/ahci_platform.ko 2023-08-31T17:19:25.741 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/ata_generic.ko 2023-08-31T17:19:25.742 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/libahci_platform.ko 2023-08-31T17:19:25.742 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_acpi.ko 2023-08-31T17:19:25.742 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_ali.ko 2023-08-31T17:19:25.742 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_amd.ko 2023-08-31T17:19:25.742 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_artop.ko 2023-08-31T17:19:25.743 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_atiixp.ko 2023-08-31T17:19:25.743 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_atp867x.ko 2023-08-31T17:19:25.743 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_cmd640.ko 2023-08-31T17:19:25.743 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_cmd64x.ko 2023-08-31T17:19:25.743 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_cypress.ko 2023-08-31T17:19:25.743 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_efar.ko 2023-08-31T17:19:25.744 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_hpt366.ko 2023-08-31T17:19:25.744 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_hpt37x.ko 2023-08-31T17:19:25.744 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-31T17:19:25.744 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-31T17:19:25.744 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_it8213.ko 2023-08-31T17:19:25.745 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_it821x.ko 2023-08-31T17:19:25.745 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_jmicron.ko 2023-08-31T17:19:25.745 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_marvell.ko 2023-08-31T17:19:25.745 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_mpiix.ko 2023-08-31T17:19:25.745 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_netcell.ko 2023-08-31T17:19:25.746 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_ninja32.ko 2023-08-31T17:19:25.746 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_ns87410.ko 2023-08-31T17:19:25.746 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_ns87415.ko 2023-08-31T17:19:25.746 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_oldpiix.ko 2023-08-31T17:19:25.746 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_opti.ko 2023-08-31T17:19:25.747 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_optidma.ko 2023-08-31T17:19:25.747 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_pcmcia.ko 2023-08-31T17:19:25.747 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-31T17:19:25.747 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-31T17:19:25.747 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_piccolo.ko 2023-08-31T17:19:25.747 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_rdc.ko 2023-08-31T17:19:25.748 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_sch.ko 2023-08-31T17:19:25.748 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_serverworks.ko 2023-08-31T17:19:25.748 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_sil680.ko 2023-08-31T17:19:25.748 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_sis.ko 2023-08-31T17:19:25.748 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_sl82c105.ko 2023-08-31T17:19:25.748 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_triflex.ko 2023-08-31T17:19:25.749 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_via.ko 2023-08-31T17:19:25.749 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pdc_adma.ko 2023-08-31T17:19:25.749 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_inic162x.ko 2023-08-31T17:19:25.749 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_mv.ko 2023-08-31T17:19:25.749 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_nv.ko 2023-08-31T17:19:25.749 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_promise.ko 2023-08-31T17:19:25.750 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_qstor.ko 2023-08-31T17:19:25.750 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_sil.ko 2023-08-31T17:19:25.750 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_sil24.ko 2023-08-31T17:19:25.750 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_sis.ko 2023-08-31T17:19:25.750 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_svw.ko 2023-08-31T17:19:25.751 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_sx4.ko 2023-08-31T17:19:25.751 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_uli.ko 2023-08-31T17:19:25.751 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_via.ko 2023-08-31T17:19:25.751 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_vsc.ko 2023-08-31T17:19:25.751 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/auxdisplay 2023-08-31T17:19:25.752 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/auxdisplay/ks0108.ko 2023-08-31T17:19:25.752 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/base 2023-08-31T17:19:25.752 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/base/regmap 2023-08-31T17:19:25.752 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-31T17:19:25.752 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-31T17:19:25.752 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/bcma 2023-08-31T17:19:25.753 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/bcma/bcma.ko 2023-08-31T17:19:25.753 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block 2023-08-31T17:19:25.753 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/aoe 2023-08-31T17:19:25.753 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/aoe/aoe.ko 2023-08-31T17:19:25.753 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/brd.ko 2023-08-31T17:19:25.753 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/drbd 2023-08-31T17:19:25.754 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/drbd/drbd.ko 2023-08-31T17:19:25.754 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/floppy.ko 2023-08-31T17:19:25.754 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/loop.ko 2023-08-31T17:19:25.754 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/mtip32xx 2023-08-31T17:19:25.754 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-31T17:19:25.755 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/nbd.ko 2023-08-31T17:19:25.755 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/null_blk 2023-08-31T17:19:25.755 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/null_blk/null_blk.ko 2023-08-31T17:19:25.755 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/pktcdvd.ko 2023-08-31T17:19:25.755 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/rbd.ko 2023-08-31T17:19:25.755 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/virtio_blk.ko 2023-08-31T17:19:25.756 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/xen-blkback 2023-08-31T17:19:25.756 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-31T17:19:25.756 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/xen-blkfront.ko 2023-08-31T17:19:25.756 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/zram 2023-08-31T17:19:25.756 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/zram/zram.ko 2023-08-31T17:19:25.757 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char 2023-08-31T17:19:25.757 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/hangcheck-timer.ko 2023-08-31T17:19:25.757 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/hw_random 2023-08-31T17:19:25.757 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-31T17:19:25.757 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-31T17:19:25.757 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-31T17:19:25.758 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/hw_random/via-rng.ko 2023-08-31T17:19:25.758 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-31T17:19:25.758 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ipmi 2023-08-31T17:19:25.758 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-31T17:19:25.758 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-31T17:19:25.759 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-31T17:19:25.759 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-31T17:19:25.759 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-31T17:19:25.759 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-31T17:19:25.759 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/lp.ko 2023-08-31T17:19:25.759 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/mwave 2023-08-31T17:19:25.760 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/mwave/mwave.ko 2023-08-31T17:19:25.760 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ppdev.ko 2023-08-31T17:19:25.760 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tlclk.ko 2023-08-31T17:19:25.760 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tpm 2023-08-31T17:19:25.760 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tpm/tpm.ko 2023-08-31T17:19:25.760 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-31T17:19:25.761 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-31T17:19:25.761 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-31T17:19:25.761 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-31T17:19:25.761 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-31T17:19:25.761 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/uv_mmtimer.ko 2023-08-31T17:19:25.762 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/virtio_console.ko 2023-08-31T17:19:25.762 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/cpufreq 2023-08-31T17:19:25.762 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-31T17:19:25.762 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-31T17:19:25.762 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-31T17:19:25.762 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-31T17:19:25.763 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-31T17:19:25.763 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-31T17:19:25.763 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto 2023-08-31T17:19:25.763 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/ccp 2023-08-31T17:19:25.763 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-31T17:19:25.764 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/ccp/ccp.ko 2023-08-31T17:19:25.764 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/intel 2023-08-31T17:19:25.764 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/intel/qat 2023-08-31T17:19:25.764 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/intel/qat/qat_common 2023-08-31T17:19:25.764 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-31T17:19:25.764 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-31T17:19:25.765 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-31T17:19:25.765 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/padlock-aes.ko 2023-08-31T17:19:25.765 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/padlock-sha.ko 2023-08-31T17:19:25.765 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/virtio 2023-08-31T17:19:25.765 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-31T17:19:25.765 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/dca 2023-08-31T17:19:25.766 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/dca/dca.ko 2023-08-31T17:19:25.766 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/devfreq 2023-08-31T17:19:25.766 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-31T17:19:25.766 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/dma 2023-08-31T17:19:25.767 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/dma/dw 2023-08-31T17:19:25.767 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-31T17:19:25.767 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/dma/ioat 2023-08-31T17:19:25.767 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-31T17:19:25.767 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac 2023-08-31T17:19:25.767 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/amd64_edac.ko 2023-08-31T17:19:25.768 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/e752x_edac.ko 2023-08-31T17:19:25.768 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/edac_mce_amd.ko 2023-08-31T17:19:25.768 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/i3000_edac.ko 2023-08-31T17:19:25.768 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/i3200_edac.ko 2023-08-31T17:19:25.768 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/i5100_edac.ko 2023-08-31T17:19:25.768 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/i5400_edac.ko 2023-08-31T17:19:25.769 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/i7300_edac.ko 2023-08-31T17:19:25.769 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/i7core_edac.ko 2023-08-31T17:19:25.769 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/i82975x_edac.ko 2023-08-31T17:19:25.769 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/ie31200_edac.ko 2023-08-31T17:19:25.770 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/sb_edac.ko 2023-08-31T17:19:25.770 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/x38_edac.ko 2023-08-31T17:19:25.770 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/firmware 2023-08-31T17:19:25.770 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/firmware/edd.ko 2023-08-31T17:19:25.770 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-31T17:19:25.771 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/gpio 2023-08-31T17:19:25.771 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/gpio/gpio-ich.ko 2023-08-31T17:19:25.771 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-31T17:19:25.771 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid 2023-08-31T17:19:25.771 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-appleir.ko 2023-08-31T17:19:25.772 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-aureal.ko 2023-08-31T17:19:25.772 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-axff.ko 2023-08-31T17:19:25.772 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-dr.ko 2023-08-31T17:19:25.772 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-elecom.ko 2023-08-31T17:19:25.772 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-elo.ko 2023-08-31T17:19:25.773 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-emsff.ko 2023-08-31T17:19:25.773 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-gaff.ko 2023-08-31T17:19:25.773 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-gt683r.ko 2023-08-31T17:19:25.773 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-gyration.ko 2023-08-31T17:19:25.773 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-31T17:19:25.774 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-31T17:19:25.774 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-holtekff.ko 2023-08-31T17:19:25.774 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-hyperv.ko 2023-08-31T17:19:25.774 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-icade.ko 2023-08-31T17:19:25.774 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-keytouch.ko 2023-08-31T17:19:25.775 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-kye.ko 2023-08-31T17:19:25.775 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-lcpower.ko 2023-08-31T17:19:25.775 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-led.ko 2023-08-31T17:19:25.775 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-lenovo.ko 2023-08-31T17:19:25.775 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-31T17:19:25.776 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-31T17:19:25.776 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-multitouch.ko 2023-08-31T17:19:25.776 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-ortek.ko 2023-08-31T17:19:25.776 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-penmount.ko 2023-08-31T17:19:25.776 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-petalynx.ko 2023-08-31T17:19:25.777 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-picolcd.ko 2023-08-31T17:19:25.777 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-pl.ko 2023-08-31T17:19:25.777 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-plantronics.ko 2023-08-31T17:19:25.777 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-primax.ko 2023-08-31T17:19:25.777 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-rmi.ko 2023-08-31T17:19:25.778 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-31T17:19:25.778 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-common.ko 2023-08-31T17:19:25.778 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-31T17:19:25.778 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-31T17:19:25.779 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-31T17:19:25.779 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-31T17:19:25.779 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-31T17:19:25.779 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-31T17:19:25.779 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-31T17:19:25.780 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-31T17:19:25.780 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-31T17:19:25.780 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat.ko 2023-08-31T17:19:25.780 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-saitek.ko 2023-08-31T17:19:25.781 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-samsung.ko 2023-08-31T17:19:25.781 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-31T17:19:25.781 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-sjoy.ko 2023-08-31T17:19:25.781 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-sony.ko 2023-08-31T17:19:25.782 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-speedlink.ko 2023-08-31T17:19:25.782 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-steelseries.ko 2023-08-31T17:19:25.782 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-sunplus.ko 2023-08-31T17:19:25.782 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-31T17:19:25.782 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-tivo.ko 2023-08-31T17:19:25.783 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-tmff.ko 2023-08-31T17:19:25.783 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-topseed.ko 2023-08-31T17:19:25.783 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-twinhan.ko 2023-08-31T17:19:25.783 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-uclogic.ko 2023-08-31T17:19:25.783 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-waltop.ko 2023-08-31T17:19:25.783 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-wiimote.ko 2023-08-31T17:19:25.784 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-xinmo.ko 2023-08-31T17:19:25.784 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-zpff.ko 2023-08-31T17:19:25.784 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-zydacron.ko 2023-08-31T17:19:25.784 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/uhid.ko 2023-08-31T17:19:25.785 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/wacom.ko 2023-08-31T17:19:25.785 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hv 2023-08-31T17:19:25.785 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hv/hv_balloon.ko 2023-08-31T17:19:25.785 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hv/hv_utils.ko 2023-08-31T17:19:25.785 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hv/hv_vmbus.ko 2023-08-31T17:19:25.786 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon 2023-08-31T17:19:25.786 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/abituguru.ko 2023-08-31T17:19:25.786 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/abituguru3.ko 2023-08-31T17:19:25.786 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-31T17:19:25.786 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ad7414.ko 2023-08-31T17:19:25.787 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ad7418.ko 2023-08-31T17:19:25.787 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adc128d818.ko 2023-08-31T17:19:25.787 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adm1025.ko 2023-08-31T17:19:25.787 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adm1026.ko 2023-08-31T17:19:25.787 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adm1029.ko 2023-08-31T17:19:25.788 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adm1031.ko 2023-08-31T17:19:25.788 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adm9240.ko 2023-08-31T17:19:25.788 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ads7828.ko 2023-08-31T17:19:25.788 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adt7410.ko 2023-08-31T17:19:25.788 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adt7411.ko 2023-08-31T17:19:25.789 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adt7462.ko 2023-08-31T17:19:25.789 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adt7470.ko 2023-08-31T17:19:25.789 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adt7475.ko 2023-08-31T17:19:25.789 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adt7x10.ko 2023-08-31T17:19:25.789 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/amc6821.ko 2023-08-31T17:19:25.790 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/applesmc.ko 2023-08-31T17:19:25.790 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/asb100.ko 2023-08-31T17:19:25.790 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/asc7621.ko 2023-08-31T17:19:25.790 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-31T17:19:25.790 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/atxp1.ko 2023-08-31T17:19:25.791 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/coretemp.ko 2023-08-31T17:19:25.791 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-31T17:19:25.791 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/dme1737.ko 2023-08-31T17:19:25.791 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ds1621.ko 2023-08-31T17:19:25.792 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ds620.ko 2023-08-31T17:19:25.792 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/emc1403.ko 2023-08-31T17:19:25.792 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/emc6w201.ko 2023-08-31T17:19:25.792 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/f71805f.ko 2023-08-31T17:19:25.792 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/f71882fg.ko 2023-08-31T17:19:25.793 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/f75375s.ko 2023-08-31T17:19:25.793 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/fam15h_power.ko 2023-08-31T17:19:25.793 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/fschmd.ko 2023-08-31T17:19:25.793 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/g760a.ko 2023-08-31T17:19:25.793 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/g762.ko 2023-08-31T17:19:25.794 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/gl518sm.ko 2023-08-31T17:19:25.794 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/gl520sm.ko 2023-08-31T17:19:25.794 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-31T17:19:25.794 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/i5500_temp.ko 2023-08-31T17:19:25.794 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/i5k_amb.ko 2023-08-31T17:19:25.795 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ibmaem.ko 2023-08-31T17:19:25.795 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ibmpex.ko 2023-08-31T17:19:25.795 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ina209.ko 2023-08-31T17:19:25.795 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ina2xx.ko 2023-08-31T17:19:25.795 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/it87.ko 2023-08-31T17:19:25.796 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/k10temp.ko 2023-08-31T17:19:25.796 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/k8temp.ko 2023-08-31T17:19:25.796 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lineage-pem.ko 2023-08-31T17:19:25.796 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm63.ko 2023-08-31T17:19:25.797 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm73.ko 2023-08-31T17:19:25.797 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm75.ko 2023-08-31T17:19:25.797 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm77.ko 2023-08-31T17:19:25.797 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm78.ko 2023-08-31T17:19:25.797 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm80.ko 2023-08-31T17:19:25.798 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm83.ko 2023-08-31T17:19:25.798 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm85.ko 2023-08-31T17:19:25.798 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm87.ko 2023-08-31T17:19:25.798 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm90.ko 2023-08-31T17:19:25.798 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm92.ko 2023-08-31T17:19:25.799 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm93.ko 2023-08-31T17:19:25.799 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm95234.ko 2023-08-31T17:19:25.799 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm95241.ko 2023-08-31T17:19:25.799 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm95245.ko 2023-08-31T17:19:25.799 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ltc2945.ko 2023-08-31T17:19:25.799 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ltc4151.ko 2023-08-31T17:19:25.800 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ltc4215.ko 2023-08-31T17:19:25.800 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ltc4222.ko 2023-08-31T17:19:25.800 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ltc4245.ko 2023-08-31T17:19:25.800 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ltc4260.ko 2023-08-31T17:19:25.800 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ltc4261.ko 2023-08-31T17:19:25.801 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/max16065.ko 2023-08-31T17:19:25.801 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/max1619.ko 2023-08-31T17:19:25.801 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/max1668.ko 2023-08-31T17:19:25.801 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/max197.ko 2023-08-31T17:19:25.801 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/max6639.ko 2023-08-31T17:19:25.801 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/max6650.ko 2023-08-31T17:19:25.802 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/max6697.ko 2023-08-31T17:19:25.802 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/mcp3021.ko 2023-08-31T17:19:25.802 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/nct6683.ko 2023-08-31T17:19:25.802 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/nct6775-core.ko 2023-08-31T17:19:25.802 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/nct6775.ko 2023-08-31T17:19:25.803 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/nct7802.ko 2023-08-31T17:19:25.803 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pc87360.ko 2023-08-31T17:19:25.803 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pc87427.ko 2023-08-31T17:19:25.803 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pcf8591.ko 2023-08-31T17:19:25.803 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus 2023-08-31T17:19:25.803 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-31T17:19:25.804 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-31T17:19:25.804 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-31T17:19:25.804 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-31T17:19:25.804 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-31T17:19:25.804 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-31T17:19:25.805 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-31T17:19:25.805 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-31T17:19:25.805 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-31T17:19:25.805 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-31T17:19:25.805 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-31T17:19:25.805 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-31T17:19:25.806 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/powr1220.ko 2023-08-31T17:19:25.806 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/sch5627.ko 2023-08-31T17:19:25.806 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/sch5636.ko 2023-08-31T17:19:25.806 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-31T17:19:25.807 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/sht15.ko 2023-08-31T17:19:25.807 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/sht21.ko 2023-08-31T17:19:25.807 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/shtc1.ko 2023-08-31T17:19:25.807 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/sis5595.ko 2023-08-31T17:19:25.807 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/smsc47b397.ko 2023-08-31T17:19:25.808 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/smsc47m1.ko 2023-08-31T17:19:25.808 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/smsc47m192.ko 2023-08-31T17:19:25.808 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/thmc50.ko 2023-08-31T17:19:25.808 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/tmp102.ko 2023-08-31T17:19:25.808 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/tmp103.ko 2023-08-31T17:19:25.808 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/tmp401.ko 2023-08-31T17:19:25.809 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/tmp421.ko 2023-08-31T17:19:25.809 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/via-cputemp.ko 2023-08-31T17:19:25.809 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/via686a.ko 2023-08-31T17:19:25.809 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/vt1211.ko 2023-08-31T17:19:25.809 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/vt8231.ko 2023-08-31T17:19:25.809 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83627ehf.ko 2023-08-31T17:19:25.810 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83627hf.ko 2023-08-31T17:19:25.810 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83781d.ko 2023-08-31T17:19:25.810 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83791d.ko 2023-08-31T17:19:25.810 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83792d.ko 2023-08-31T17:19:25.810 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83793.ko 2023-08-31T17:19:25.811 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83795.ko 2023-08-31T17:19:25.811 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83l785ts.ko 2023-08-31T17:19:25.811 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83l786ng.ko 2023-08-31T17:19:25.811 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c 2023-08-31T17:19:25.811 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/algos 2023-08-31T17:19:25.812 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-31T17:19:25.812 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-31T17:19:25.812 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses 2023-08-31T17:19:25.812 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-31T17:19:25.812 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-31T17:19:25.813 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-31T17:19:25.813 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-31T17:19:25.813 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-31T17:19:25.813 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-31T17:19:25.813 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-31T17:19:25.814 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-31T17:19:25.814 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-31T17:19:25.814 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-31T17:19:25.814 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-31T17:19:25.814 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-31T17:19:25.814 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-31T17:19:25.815 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-31T17:19:25.815 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-31T17:19:25.815 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-31T17:19:25.815 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-31T17:19:25.815 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-31T17:19:25.816 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-31T17:19:25.816 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-31T17:19:25.816 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-31T17:19:25.816 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-31T17:19:25.816 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-31T17:19:25.817 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/i2c-dev.ko 2023-08-31T17:19:25.817 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/i2c-mux.ko 2023-08-31T17:19:25.817 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-31T17:19:25.817 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/i2c-smbus.ko 2023-08-31T17:19:25.817 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/i2c-stub.ko 2023-08-31T17:19:25.817 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband 2023-08-31T17:19:25.818 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core 2023-08-31T17:19:25.818 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-31T17:19:25.818 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core/ib_core.ko 2023-08-31T17:19:25.818 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-31T17:19:25.818 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-31T17:19:25.819 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-31T17:19:25.819 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-31T17:19:25.819 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-31T17:19:25.819 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw 2023-08-31T17:19:25.819 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/cxgb4 2023-08-31T17:19:25.820 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-31T17:19:25.820 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/mlx4 2023-08-31T17:19:25.820 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-31T17:19:25.820 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/mlx5 2023-08-31T17:19:25.820 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-31T17:19:25.820 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/mthca 2023-08-31T17:19:25.821 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-31T17:19:25.821 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp 2023-08-31T17:19:25.821 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/ipoib 2023-08-31T17:19:25.821 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-31T17:19:25.821 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/iser 2023-08-31T17:19:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-31T17:19:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/isert 2023-08-31T17:19:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-31T17:19:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/srp 2023-08-31T17:19:25.822 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-31T17:19:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/srpt 2023-08-31T17:19:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-31T17:19:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input 2023-08-31T17:19:25.823 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/gameport 2023-08-31T17:19:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-31T17:19:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-31T17:19:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/gameport/gameport.ko 2023-08-31T17:19:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/gameport/lightning.ko 2023-08-31T17:19:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/gameport/ns558.ko 2023-08-31T17:19:25.825 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/joydev.ko 2023-08-31T17:19:25.825 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/keyboard 2023-08-31T17:19:25.825 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-31T17:19:25.825 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse 2023-08-31T17:19:25.825 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/appletouch.ko 2023-08-31T17:19:25.826 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/bcm5974.ko 2023-08-31T17:19:25.826 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/cyapatp.ko 2023-08-31T17:19:25.826 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-31T17:19:25.826 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/sermouse.ko 2023-08-31T17:19:25.826 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-31T17:19:25.826 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-31T17:19:25.827 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-31T17:19:25.827 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/rmi4 2023-08-31T17:19:25.827 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-31T17:19:25.827 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/serio 2023-08-31T17:19:25.827 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/serio/altera_ps2.ko 2023-08-31T17:19:25.828 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/serio/arc_ps2.ko 2023-08-31T17:19:25.828 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-31T17:19:25.828 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/serio/serio_raw.ko 2023-08-31T17:19:25.828 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/sparse-keymap.ko 2023-08-31T17:19:25.829 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/iommu 2023-08-31T17:19:25.829 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/iommu/amd 2023-08-31T17:19:25.829 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-31T17:19:25.829 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds 2023-08-31T17:19:25.829 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/leds-blinkm.ko 2023-08-31T17:19:25.830 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/leds-lm3530.ko 2023-08-31T17:19:25.830 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/leds-lp3944.ko 2023-08-31T17:19:25.830 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/leds-ss4200.ko 2023-08-31T17:19:25.830 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger 2023-08-31T17:19:25.830 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-31T17:19:25.831 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-31T17:19:25.831 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-31T17:19:25.831 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-31T17:19:25.831 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-31T17:19:25.832 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-31T17:19:25.832 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-31T17:19:25.832 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-31T17:19:25.832 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md 2023-08-31T17:19:25.832 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/bcache 2023-08-31T17:19:25.833 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/bcache/bcache.ko 2023-08-31T17:19:25.833 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-bio-prison.ko 2023-08-31T17:19:25.833 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-cache-smq.ko 2023-08-31T17:19:25.833 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-cache.ko 2023-08-31T17:19:25.833 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-crypt.ko 2023-08-31T17:19:25.834 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-delay.ko 2023-08-31T17:19:25.834 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-flakey.ko 2023-08-31T17:19:25.834 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-log-userspace.ko 2023-08-31T17:19:25.834 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-multipath.ko 2023-08-31T17:19:25.835 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-queue-length.ko 2023-08-31T17:19:25.835 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-raid.ko 2023-08-31T17:19:25.835 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-round-robin.ko 2023-08-31T17:19:25.836 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-service-time.ko 2023-08-31T17:19:25.836 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-switch.ko 2023-08-31T17:19:25.836 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-thin-pool.ko 2023-08-31T17:19:25.836 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-verity.ko 2023-08-31T17:19:25.836 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/faulty.ko 2023-08-31T17:19:25.837 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/linear.ko 2023-08-31T17:19:25.837 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/multipath.ko 2023-08-31T17:19:25.837 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/persistent-data 2023-08-31T17:19:25.837 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-31T17:19:25.837 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/raid0.ko 2023-08-31T17:19:25.838 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/raid1.ko 2023-08-31T17:19:25.838 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/raid10.ko 2023-08-31T17:19:25.838 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/raid456.ko 2023-08-31T17:19:25.838 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message 2023-08-31T17:19:25.838 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion 2023-08-31T17:19:25.839 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion/mptbase.ko 2023-08-31T17:19:25.839 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion/mptctl.ko 2023-08-31T17:19:25.839 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion/mptfc.ko 2023-08-31T17:19:25.839 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion/mptlan.ko 2023-08-31T17:19:25.839 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion/mptsas.ko 2023-08-31T17:19:25.839 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion/mptscsih.ko 2023-08-31T17:19:25.840 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion/mptspi.ko 2023-08-31T17:19:25.840 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd 2023-08-31T17:19:25.840 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd/lpc_ich.ko 2023-08-31T17:19:25.840 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd/lpc_sch.ko 2023-08-31T17:19:25.840 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd/mfd-core.ko 2023-08-31T17:19:25.841 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd/sm501.ko 2023-08-31T17:19:25.841 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd/viperboard.ko 2023-08-31T17:19:25.841 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd/vx855.ko 2023-08-31T17:19:25.841 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd/wl1273-core.ko 2023-08-31T17:19:25.841 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc 2023-08-31T17:19:25.842 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/altera-stapl 2023-08-31T17:19:25.842 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-31T17:19:25.842 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/apds9802als.ko 2023-08-31T17:19:25.842 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/apds990x.ko 2023-08-31T17:19:25.842 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/bh1770glc.ko 2023-08-31T17:19:25.842 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/cb710 2023-08-31T17:19:25.843 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/cb710/cb710.ko 2023-08-31T17:19:25.843 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/eeprom 2023-08-31T17:19:25.843 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/eeprom/at24.ko 2023-08-31T17:19:25.843 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-31T17:19:25.843 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-31T17:19:25.844 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/eeprom/max6875.ko 2023-08-31T17:19:25.844 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/enclosure.ko 2023-08-31T17:19:25.844 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/hpilo.ko 2023-08-31T17:19:25.844 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/isl29003.ko 2023-08-31T17:19:25.844 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/isl29020.ko 2023-08-31T17:19:25.845 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/lis3lv02d 2023-08-31T17:19:25.845 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-31T17:19:25.845 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-31T17:19:25.845 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/mei 2023-08-31T17:19:25.845 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/mei/mei-me.ko 2023-08-31T17:19:25.846 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/mei/mei-txe.ko 2023-08-31T17:19:25.846 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/mei/mei.ko 2023-08-31T17:19:25.846 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/sgi-gru 2023-08-31T17:19:25.846 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-31T17:19:25.846 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/sgi-xp 2023-08-31T17:19:25.847 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-31T17:19:25.847 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-31T17:19:25.847 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-31T17:19:25.847 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/tifm_7xx1.ko 2023-08-31T17:19:25.847 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/tifm_core.ko 2023-08-31T17:19:25.847 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/tsl2550.ko 2023-08-31T17:19:25.848 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/vmw_balloon.ko 2023-08-31T17:19:25.848 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/vmw_vmci 2023-08-31T17:19:25.848 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-31T17:19:25.848 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net 2023-08-31T17:19:25.848 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/bonding 2023-08-31T17:19:25.849 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/bonding/bonding.ko 2023-08-31T17:19:25.849 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dsa 2023-08-31T17:19:25.849 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dsa/b53 2023-08-31T17:19:25.849 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-31T17:19:25.849 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-31T17:19:25.849 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-31T17:19:25.850 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dsa/mv88e6xxx 2023-08-31T17:19:25.850 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-31T17:19:25.850 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dummy.ko 2023-08-31T17:19:25.850 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/eql.ko 2023-08-31T17:19:25.850 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet 2023-08-31T17:19:25.851 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/3com 2023-08-31T17:19:25.851 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-31T17:19:25.851 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-31T17:19:25.851 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-31T17:19:25.851 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-31T17:19:25.852 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/8390 2023-08-31T17:19:25.852 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-31T17:19:25.852 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-31T17:19:25.852 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-31T17:19:25.852 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-31T17:19:25.852 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/adaptec 2023-08-31T17:19:25.853 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-31T17:19:25.853 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/agere 2023-08-31T17:19:25.853 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-31T17:19:25.853 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/alteon 2023-08-31T17:19:25.853 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-31T17:19:25.853 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/altera 2023-08-31T17:19:25.854 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-31T17:19:25.854 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/amd 2023-08-31T17:19:25.854 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-31T17:19:25.854 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-31T17:19:25.854 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-31T17:19:25.854 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros 2023-08-31T17:19:25.855 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/alx 2023-08-31T17:19:25.855 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-31T17:19:25.855 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-31T17:19:25.855 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-31T17:19:25.855 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-31T17:19:25.856 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-31T17:19:25.856 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/atlx 2023-08-31T17:19:25.856 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-31T17:19:25.856 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-31T17:19:25.856 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom 2023-08-31T17:19:25.857 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-31T17:19:25.857 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-31T17:19:25.857 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-31T17:19:25.857 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-31T17:19:25.857 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-31T17:19:25.858 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/genet 2023-08-31T17:19:25.858 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-31T17:19:25.858 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-31T17:19:25.858 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/brocade 2023-08-31T17:19:25.858 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/brocade/bna 2023-08-31T17:19:25.859 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-31T17:19:25.859 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio 2023-08-31T17:19:25.859 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-31T17:19:25.859 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-31T17:19:25.859 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-31T17:19:25.859 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-31T17:19:25.860 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-31T17:19:25.860 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-31T17:19:25.860 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-31T17:19:25.860 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-31T17:19:25.860 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-31T17:19:25.861 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-31T17:19:25.861 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/cisco 2023-08-31T17:19:25.861 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/cisco/enic 2023-08-31T17:19:25.861 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-31T17:19:25.861 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec 2023-08-31T17:19:25.861 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec/tulip 2023-08-31T17:19:25.862 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-31T17:19:25.862 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-31T17:19:25.862 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-31T17:19:25.862 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-31T17:19:25.862 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-31T17:19:25.863 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-31T17:19:25.863 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dlink 2023-08-31T17:19:25.863 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-31T17:19:25.863 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-31T17:19:25.863 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dnet.ko 2023-08-31T17:19:25.863 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/emulex 2023-08-31T17:19:25.864 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/emulex/benet 2023-08-31T17:19:25.864 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-31T17:19:25.864 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/ethoc.ko 2023-08-31T17:19:25.864 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/fealnx.ko 2023-08-31T17:19:25.864 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel 2023-08-31T17:19:25.865 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-31T17:19:25.865 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/e1000 2023-08-31T17:19:25.865 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-31T17:19:25.865 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/e1000e 2023-08-31T17:19:25.865 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-31T17:19:25.866 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/fm10k 2023-08-31T17:19:25.866 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-31T17:19:25.866 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/i40e 2023-08-31T17:19:25.866 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-31T17:19:25.866 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/iavf 2023-08-31T17:19:25.867 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-31T17:19:25.867 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/igb 2023-08-31T17:19:25.867 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-31T17:19:25.867 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/igbvf 2023-08-31T17:19:25.868 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-31T17:19:25.868 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-31T17:19:25.868 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-31T17:19:25.868 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-31T17:19:25.868 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-31T17:19:25.869 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/jme.ko 2023-08-31T17:19:25.869 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/marvell 2023-08-31T17:19:25.869 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-31T17:19:25.869 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-31T17:19:25.869 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-31T17:19:25.869 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/mellanox 2023-08-31T17:19:25.870 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-31T17:19:25.870 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-31T17:19:25.870 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-31T17:19:25.870 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-31T17:19:25.870 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-31T17:19:25.871 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-31T17:19:25.871 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/micrel 2023-08-31T17:19:25.871 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-31T17:19:25.871 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/myricom 2023-08-31T17:19:25.871 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-31T17:19:25.872 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-31T17:19:25.872 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/natsemi 2023-08-31T17:19:25.872 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-31T17:19:25.872 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-31T17:19:25.872 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/neterion 2023-08-31T17:19:25.872 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-31T17:19:25.873 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/nvidia 2023-08-31T17:19:25.873 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-31T17:19:25.873 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/packetengines 2023-08-31T17:19:25.873 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-31T17:19:25.874 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-31T17:19:25.874 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/qlogic 2023-08-31T17:19:25.874 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-31T17:19:25.874 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-31T17:19:25.874 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-31T17:19:25.875 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-31T17:19:25.875 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-31T17:19:25.875 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/rdc 2023-08-31T17:19:25.875 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-31T17:19:25.876 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/realtek 2023-08-31T17:19:25.876 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-31T17:19:25.876 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-31T17:19:25.876 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-31T17:19:25.876 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-31T17:19:25.877 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/rocker 2023-08-31T17:19:25.877 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-31T17:19:25.877 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sfc 2023-08-31T17:19:25.877 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-31T17:19:25.877 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/silan 2023-08-31T17:19:25.878 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-31T17:19:25.878 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sis 2023-08-31T17:19:25.878 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-31T17:19:25.878 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-31T17:19:25.878 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/smsc 2023-08-31T17:19:25.879 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-31T17:19:25.879 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-31T17:19:25.879 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-31T17:19:25.879 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-31T17:19:25.879 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/stmicro 2023-08-31T17:19:25.880 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-31T17:19:25.880 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-31T17:19:25.880 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-31T17:19:25.880 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sun 2023-08-31T17:19:25.881 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-31T17:19:25.881 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-31T17:19:25.881 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-31T17:19:25.881 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-31T17:19:25.881 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/tehuti 2023-08-31T17:19:25.882 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-31T17:19:25.882 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/ti 2023-08-31T17:19:25.882 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-31T17:19:25.882 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/via 2023-08-31T17:19:25.882 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-31T17:19:25.883 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-31T17:19:25.883 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/wiznet 2023-08-31T17:19:25.883 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-31T17:19:25.883 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-31T17:19:25.884 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/xircom 2023-08-31T17:19:25.884 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-31T17:19:25.884 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/geneve.ko 2023-08-31T17:19:25.884 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/hyperv 2023-08-31T17:19:25.884 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-31T17:19:25.885 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ieee802154 2023-08-31T17:19:25.885 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-31T17:19:25.885 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ifb.ko 2023-08-31T17:19:25.885 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ipvlan 2023-08-31T17:19:25.885 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-31T17:19:25.886 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/macvlan.ko 2023-08-31T17:19:25.886 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/macvtap.ko 2023-08-31T17:19:25.886 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/mdio 2023-08-31T17:19:25.886 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/mdio.ko 2023-08-31T17:19:25.886 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-31T17:19:25.887 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-31T17:19:25.887 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-31T17:19:25.887 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/mii.ko 2023-08-31T17:19:25.887 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/net_failover.ko 2023-08-31T17:19:25.887 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/netconsole.ko 2023-08-31T17:19:25.888 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/nlmon.ko 2023-08-31T17:19:25.888 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/pcs 2023-08-31T17:19:25.888 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-31T17:19:25.888 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-31T17:19:25.889 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy 2023-08-31T17:19:25.889 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/amd.ko 2023-08-31T17:19:25.889 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-31T17:19:25.889 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-31T17:19:25.889 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-31T17:19:25.890 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/bcm87xx.ko 2023-08-31T17:19:25.890 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/broadcom.ko 2023-08-31T17:19:25.890 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/cicada.ko 2023-08-31T17:19:25.890 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/davicom.ko 2023-08-31T17:19:25.890 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/dp83640.ko 2023-08-31T17:19:25.891 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/et1011c.ko 2023-08-31T17:19:25.891 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/icplus.ko 2023-08-31T17:19:25.891 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/lxt.ko 2023-08-31T17:19:25.891 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/marvell.ko 2023-08-31T17:19:25.891 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/micrel.ko 2023-08-31T17:19:25.892 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/national.ko 2023-08-31T17:19:25.892 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/phylink.ko 2023-08-31T17:19:25.892 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/qsemi.ko 2023-08-31T17:19:25.892 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/realtek.ko 2023-08-31T17:19:25.892 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/smsc.ko 2023-08-31T17:19:25.893 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/ste10Xp.ko 2023-08-31T17:19:25.893 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/vitesse.ko 2023-08-31T17:19:25.893 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp 2023-08-31T17:19:25.893 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-31T17:19:25.893 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/ppp_async.ko 2023-08-31T17:19:25.893 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-31T17:19:25.894 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-31T17:19:25.894 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-31T17:19:25.894 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-31T17:19:25.894 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/pppoe.ko 2023-08-31T17:19:25.894 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/pppox.ko 2023-08-31T17:19:25.895 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/pptp.ko 2023-08-31T17:19:25.895 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/slip 2023-08-31T17:19:25.895 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/slip/slhc.ko 2023-08-31T17:19:25.895 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/slip/slip.ko 2023-08-31T17:19:25.895 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/sungem_phy.ko 2023-08-31T17:19:25.895 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/tap.ko 2023-08-31T17:19:25.896 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/team 2023-08-31T17:19:25.896 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/team/team.ko 2023-08-31T17:19:25.896 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-31T17:19:25.896 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-31T17:19:25.896 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-31T17:19:25.897 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/team/team_mode_random.ko 2023-08-31T17:19:25.897 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-31T17:19:25.897 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/tun.ko 2023-08-31T17:19:25.897 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/veth.ko 2023-08-31T17:19:25.897 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/virtio_net.ko 2023-08-31T17:19:25.898 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/vmxnet3 2023-08-31T17:19:25.898 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-31T17:19:25.898 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/vxlan 2023-08-31T17:19:25.898 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/vxlan/vxlan.ko 2023-08-31T17:19:25.898 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/xen-netback 2023-08-31T17:19:25.898 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-31T17:19:25.899 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/xen-netfront.ko 2023-08-31T17:19:25.899 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ntb 2023-08-31T17:19:25.899 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ntb/ntb.ko 2023-08-31T17:19:25.899 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/nvme 2023-08-31T17:19:25.899 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/nvme/host 2023-08-31T17:19:25.900 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/nvme/host/nvme-core.ko 2023-08-31T17:19:25.900 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/nvme/host/nvme.ko 2023-08-31T17:19:25.900 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/parport 2023-08-31T17:19:25.900 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/parport/parport.ko 2023-08-31T17:19:25.900 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/parport/parport_cs.ko 2023-08-31T17:19:25.901 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/parport/parport_pc.ko 2023-08-31T17:19:25.901 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/parport/parport_serial.ko 2023-08-31T17:19:25.901 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pci 2023-08-31T17:19:25.901 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pci/hotplug 2023-08-31T17:19:25.901 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-31T17:19:25.902 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pci/pcie 2023-08-31T17:19:25.902 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-31T17:19:25.902 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pci/xen-pcifront.ko 2023-08-31T17:19:25.902 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pcmcia 2023-08-31T17:19:25.902 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pcmcia/i82092.ko 2023-08-31T17:19:25.903 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pcmcia/pd6729.ko 2023-08-31T17:19:25.903 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-31T17:19:25.903 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pinctrl 2023-08-31T17:19:25.903 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pinctrl/intel 2023-08-31T17:19:25.903 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-31T17:19:25.903 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform 2023-08-31T17:19:25.904 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86 2023-08-31T17:19:25.904 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-31T17:19:25.904 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/acerhdf.ko 2023-08-31T17:19:25.904 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-31T17:19:25.904 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-31T17:19:25.905 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-31T17:19:25.905 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-31T17:19:25.905 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-31T17:19:25.905 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-31T17:19:25.905 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-31T17:19:25.905 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-31T17:19:25.906 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-31T17:19:25.906 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/hdaps.ko 2023-08-31T17:19:25.906 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/intel 2023-08-31T17:19:25.906 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-31T17:19:25.906 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/intel_ips.ko 2023-08-31T17:19:25.907 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-31T17:19:25.907 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-31T17:19:25.907 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-31T17:19:25.907 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-31T17:19:25.907 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-31T17:19:25.908 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-31T17:19:25.908 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-31T17:19:25.908 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-31T17:19:25.908 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-31T17:19:25.908 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/wmi.ko 2023-08-31T17:19:25.909 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/powercap 2023-08-31T17:19:25.909 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-31T17:19:25.909 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-31T17:19:25.909 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pps 2023-08-31T17:19:25.909 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pps/clients 2023-08-31T17:19:25.909 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-31T17:19:25.910 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-31T17:19:25.910 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pps/clients/pps_parport.ko 2023-08-31T17:19:25.910 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pps/pps_core.ko 2023-08-31T17:19:25.910 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ptp 2023-08-31T17:19:25.910 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ptp/ptp.ko 2023-08-31T17:19:25.911 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ptp/ptp_kvm.ko 2023-08-31T17:19:25.911 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc 2023-08-31T17:19:25.911 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-31T17:19:25.911 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-31T17:19:25.911 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-31T17:19:25.911 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-31T17:19:25.912 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-31T17:19:25.912 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-31T17:19:25.912 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-31T17:19:25.912 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-31T17:19:25.912 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-31T17:19:25.912 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-31T17:19:25.913 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-31T17:19:25.913 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-em3027.ko 2023-08-31T17:19:25.913 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-31T17:19:25.913 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-31T17:19:25.913 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-31T17:19:25.914 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-31T17:19:25.914 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-31T17:19:25.914 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-31T17:19:25.914 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-max6900.ko 2023-08-31T17:19:25.914 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-31T17:19:25.914 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-31T17:19:25.915 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-31T17:19:25.915 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-31T17:19:25.915 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-31T17:19:25.915 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-31T17:19:25.915 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-31T17:19:25.916 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-31T17:19:25.916 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-31T17:19:25.916 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-31T17:19:25.916 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-31T17:19:25.916 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-31T17:19:25.916 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-x1205.ko 2023-08-31T17:19:25.917 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi 2023-08-31T17:19:25.917 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/3w-9xxx.ko 2023-08-31T17:19:25.917 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/3w-sas.ko 2023-08-31T17:19:25.917 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/3w-xxxx.ko 2023-08-31T17:19:25.917 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/BusLogic.ko 2023-08-31T17:19:25.917 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/a100u2w.ko 2023-08-31T17:19:25.918 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/aacraid 2023-08-31T17:19:25.918 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-31T17:19:25.918 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/advansys.ko 2023-08-31T17:19:25.918 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/aic7xxx 2023-08-31T17:19:25.918 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-31T17:19:25.919 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-31T17:19:25.919 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/am53c974.ko 2023-08-31T17:19:25.919 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/arcmsr 2023-08-31T17:19:25.919 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-31T17:19:25.919 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/atp870u.ko 2023-08-31T17:19:25.920 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/be2iscsi 2023-08-31T17:19:25.920 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-31T17:19:25.920 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/bfa 2023-08-31T17:19:25.920 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/bfa/bfa.ko 2023-08-31T17:19:25.920 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/bnx2fc 2023-08-31T17:19:25.921 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-31T17:19:25.921 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/bnx2i 2023-08-31T17:19:25.921 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-31T17:19:25.921 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/ch.ko 2023-08-31T17:19:25.921 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/csiostor 2023-08-31T17:19:25.921 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-31T17:19:25.922 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/cxgbi 2023-08-31T17:19:25.922 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-31T17:19:25.922 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-31T17:19:25.922 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-31T17:19:25.922 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-31T17:19:25.922 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-31T17:19:25.923 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/dc395x.ko 2023-08-31T17:19:25.923 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/device_handler 2023-08-31T17:19:25.923 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-31T17:19:25.923 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-31T17:19:25.923 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-31T17:19:25.924 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-31T17:19:25.924 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/dmx3191d.ko 2023-08-31T17:19:25.924 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/esas2r 2023-08-31T17:19:25.924 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-31T17:19:25.924 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/esp_scsi.ko 2023-08-31T17:19:25.924 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/fcoe 2023-08-31T17:19:25.925 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-31T17:19:25.925 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-31T17:19:25.925 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/fnic 2023-08-31T17:19:25.925 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/fnic/fnic.ko 2023-08-31T17:19:25.925 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/hpsa.ko 2023-08-31T17:19:25.926 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/hptiop.ko 2023-08-31T17:19:25.926 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/hv_storvsc.ko 2023-08-31T17:19:25.926 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/initio.ko 2023-08-31T17:19:25.926 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/ipr.ko 2023-08-31T17:19:25.926 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/ips.ko 2023-08-31T17:19:25.926 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/isci 2023-08-31T17:19:25.927 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/isci/isci.ko 2023-08-31T17:19:25.927 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-31T17:19:25.927 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-31T17:19:25.927 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/libfc 2023-08-31T17:19:25.927 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/libfc/libfc.ko 2023-08-31T17:19:25.928 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/libiscsi.ko 2023-08-31T17:19:25.928 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-31T17:19:25.928 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/libsas 2023-08-31T17:19:25.928 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/libsas/libsas.ko 2023-08-31T17:19:25.928 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/lpfc 2023-08-31T17:19:25.929 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-31T17:19:25.929 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/megaraid 2023-08-31T17:19:25.929 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/megaraid.ko 2023-08-31T17:19:25.929 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-31T17:19:25.929 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-31T17:19:25.929 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-31T17:19:25.930 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/mpt3sas 2023-08-31T17:19:25.930 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-31T17:19:25.930 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/mvsas 2023-08-31T17:19:25.930 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-31T17:19:25.930 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/mvumi.ko 2023-08-31T17:19:25.931 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/pm8001 2023-08-31T17:19:25.931 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-31T17:19:25.931 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/pmcraid.ko 2023-08-31T17:19:25.931 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/qla1280.ko 2023-08-31T17:19:25.931 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/qla2xxx 2023-08-31T17:19:25.931 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-31T17:19:25.932 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-31T17:19:25.932 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/qla4xxx 2023-08-31T17:19:25.932 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-31T17:19:25.932 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/raid_class.ko 2023-08-31T17:19:25.932 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/scsi_debug.ko 2023-08-31T17:19:25.932 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-31T17:19:25.933 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-31T17:19:25.933 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-31T17:19:25.933 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-31T17:19:25.933 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-31T17:19:25.933 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/ses.ko 2023-08-31T17:19:25.933 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/st.ko 2023-08-31T17:19:25.934 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/stex.ko 2023-08-31T17:19:25.934 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/sym53c8xx_2 2023-08-31T17:19:25.934 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-31T17:19:25.934 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/virtio_scsi.ko 2023-08-31T17:19:25.934 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-31T17:19:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/wd719x.ko 2023-08-31T17:19:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ssb 2023-08-31T17:19:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ssb/ssb.ko 2023-08-31T17:19:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target 2023-08-31T17:19:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/iscsi 2023-08-31T17:19:25.935 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-31T17:19:25.936 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/loopback 2023-08-31T17:19:25.936 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-31T17:19:25.936 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/target_core_file.ko 2023-08-31T17:19:25.936 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/target_core_iblock.ko 2023-08-31T17:19:25.936 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/target_core_mod.ko 2023-08-31T17:19:25.936 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/target_core_pscsi.ko 2023-08-31T17:19:25.937 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/target_core_user.ko 2023-08-31T17:19:25.937 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/tcm_fc 2023-08-31T17:19:25.937 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-31T17:19:25.937 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal 2023-08-31T17:19:25.937 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel 2023-08-31T17:19:25.937 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal 2023-08-31T17:19:25.938 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-31T17:19:25.938 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-31T17:19:25.938 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-31T17:19:25.938 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-31T17:19:25.938 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-31T17:19:25.939 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-31T17:19:25.939 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-31T17:19:25.939 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-31T17:19:25.939 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-31T17:19:25.940 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-31T17:19:25.940 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-31T17:19:25.940 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-31T17:19:25.940 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-31T17:19:25.941 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-31T17:19:25.941 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-31T17:19:25.941 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty 2023-08-31T17:19:25.941 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/ipwireless 2023-08-31T17:19:25.941 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-31T17:19:25.942 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/n_gsm.ko 2023-08-31T17:19:25.942 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/n_hdlc.ko 2023-08-31T17:19:25.942 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/nozomi.ko 2023-08-31T17:19:25.942 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/serial 2023-08-31T17:19:25.942 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/serial/8250 2023-08-31T17:19:25.943 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-31T17:19:25.943 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/serial/arc_uart.ko 2023-08-31T17:19:25.943 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/serial/jsm 2023-08-31T17:19:25.943 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-31T17:19:25.943 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/synclink_gt.ko 2023-08-31T17:19:25.943 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ufs 2023-08-31T17:19:25.944 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ufs/core 2023-08-31T17:19:25.944 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-31T17:19:25.944 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ufs/host 2023-08-31T17:19:25.944 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-31T17:19:25.944 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/uio 2023-08-31T17:19:25.944 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/uio/uio.ko 2023-08-31T17:19:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/uio/uio_aec.ko 2023-08-31T17:19:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/uio/uio_cif.ko 2023-08-31T17:19:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/uio/uio_pci_generic.ko 2023-08-31T17:19:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/uio/uio_sercos3.ko 2023-08-31T17:19:25.945 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb 2023-08-31T17:19:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/class 2023-08-31T17:19:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/class/cdc-acm.ko 2023-08-31T17:19:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-31T17:19:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/class/usblp.ko 2023-08-31T17:19:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/class/usbtmc.ko 2023-08-31T17:19:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/host 2023-08-31T17:19:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-31T17:19:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/image 2023-08-31T17:19:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/image/mdc800.ko 2023-08-31T17:19:25.947 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/image/microtek.ko 2023-08-31T17:19:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc 2023-08-31T17:19:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/adutux.ko 2023-08-31T17:19:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/appledisplay.ko 2023-08-31T17:19:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/emi26.ko 2023-08-31T17:19:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/emi62.ko 2023-08-31T17:19:25.948 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/ezusb.ko 2023-08-31T17:19:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/idmouse.ko 2023-08-31T17:19:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/iowarrior.ko 2023-08-31T17:19:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-31T17:19:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/ldusb.ko 2023-08-31T17:19:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/legousbtower.ko 2023-08-31T17:19:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/sisusbvga 2023-08-31T17:19:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-31T17:19:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-31T17:19:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/usb3503.ko 2023-08-31T17:19:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/usblcd.ko 2023-08-31T17:19:25.951 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-31T17:19:25.951 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/uss720.ko 2023-08-31T17:19:25.951 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/yurex.ko 2023-08-31T17:19:25.951 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/phy 2023-08-31T17:19:25.951 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/phy/phy-generic.ko 2023-08-31T17:19:25.951 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial 2023-08-31T17:19:25.952 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/aircable.ko 2023-08-31T17:19:25.952 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ark3116.ko 2023-08-31T17:19:25.952 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-31T17:19:25.952 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ch341.ko 2023-08-31T17:19:25.952 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/cp210x.ko 2023-08-31T17:19:25.952 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/cyberjack.ko 2023-08-31T17:19:25.953 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-31T17:19:25.953 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-31T17:19:25.953 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/empeg.ko 2023-08-31T17:19:25.953 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-31T17:19:25.953 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-31T17:19:25.953 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-31T17:19:25.954 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/io_ti.ko 2023-08-31T17:19:25.954 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ipaq.ko 2023-08-31T17:19:25.954 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ipw.ko 2023-08-31T17:19:25.954 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ir-usb.ko 2023-08-31T17:19:25.954 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-31T17:19:25.955 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/keyspan.ko 2023-08-31T17:19:25.955 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-31T17:19:25.955 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-31T17:19:25.955 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-31T17:19:25.955 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/mct_u232.ko 2023-08-31T17:19:25.956 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/mos7720.ko 2023-08-31T17:19:25.956 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/mos7840.ko 2023-08-31T17:19:25.956 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/navman.ko 2023-08-31T17:19:25.956 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/omninet.ko 2023-08-31T17:19:25.956 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/opticon.ko 2023-08-31T17:19:25.957 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/option.ko 2023-08-31T17:19:25.957 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/oti6858.ko 2023-08-31T17:19:25.957 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/pl2303.ko 2023-08-31T17:19:25.957 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/qcaux.ko 2023-08-31T17:19:25.957 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/qcserial.ko 2023-08-31T17:19:25.957 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/quatech2.ko 2023-08-31T17:19:25.958 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/safe_serial.ko 2023-08-31T17:19:25.958 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/sierra.ko 2023-08-31T17:19:25.958 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-31T17:19:25.958 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ssu100.ko 2023-08-31T17:19:25.958 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/symbolserial.ko 2023-08-31T17:19:25.959 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-31T17:19:25.959 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-31T17:19:25.959 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/usb_debug.ko 2023-08-31T17:19:25.959 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-31T17:19:25.960 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/visor.ko 2023-08-31T17:19:25.960 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/whiteheat.ko 2023-08-31T17:19:25.960 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-31T17:19:25.960 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage 2023-08-31T17:19:25.960 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/uas.ko 2023-08-31T17:19:25.961 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-31T17:19:25.961 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-31T17:19:25.961 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-31T17:19:25.961 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-31T17:19:25.961 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-31T17:19:25.961 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-31T17:19:25.962 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-31T17:19:25.962 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-karma.ko 2023-08-31T17:19:25.962 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-31T17:19:25.962 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-31T17:19:25.962 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-31T17:19:25.962 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-31T17:19:25.963 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-31T17:19:25.963 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/usb-storage.ko 2023-08-31T17:19:25.963 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/usbip 2023-08-31T17:19:25.963 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-31T17:19:25.963 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-31T17:19:25.963 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-31T17:19:25.964 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vfio 2023-08-31T17:19:25.964 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vfio/pci 2023-08-31T17:19:25.964 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-31T17:19:25.964 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-31T17:19:25.964 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vfio/vfio.ko 2023-08-31T17:19:25.964 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-31T17:19:25.965 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vhost 2023-08-31T17:19:25.965 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vhost/vhost.ko 2023-08-31T17:19:25.965 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-31T17:19:25.965 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vhost/vhost_net.ko 2023-08-31T17:19:25.965 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vhost/vhost_scsi.ko 2023-08-31T17:19:25.966 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/video 2023-08-31T17:19:25.966 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/video/backlight 2023-08-31T17:19:25.966 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/video/backlight/apple_bl.ko 2023-08-31T17:19:25.966 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/video/backlight/lcd.ko 2023-08-31T17:19:25.966 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-31T17:19:25.967 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio 2023-08-31T17:19:25.967 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio/virtio.ko 2023-08-31T17:19:25.967 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio/virtio_balloon.ko 2023-08-31T17:19:25.967 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio/virtio_mmio.ko 2023-08-31T17:19:25.967 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio/virtio_pci.ko 2023-08-31T17:19:25.967 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-31T17:19:25.968 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-31T17:19:25.968 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio/virtio_ring.ko 2023-08-31T17:19:25.968 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1 2023-08-31T17:19:25.968 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/masters 2023-08-31T17:19:25.968 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/masters/ds2482.ko 2023-08-31T17:19:25.969 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/masters/ds2490.ko 2023-08-31T17:19:25.969 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves 2023-08-31T17:19:25.969 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-31T17:19:25.969 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-31T17:19:25.969 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-31T17:19:25.970 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-31T17:19:25.970 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-31T17:19:25.970 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-31T17:19:25.970 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-31T17:19:25.970 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-31T17:19:25.971 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-31T17:19:25.971 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-31T17:19:25.971 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-31T17:19:25.971 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/wire.ko 2023-08-31T17:19:25.972 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog 2023-08-31T17:19:25.972 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-31T17:19:25.972 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-31T17:19:25.972 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-31T17:19:25.972 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/hpwdt.ko 2023-08-31T17:19:25.972 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/i6300esb.ko 2023-08-31T17:19:25.973 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-31T17:19:25.973 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-31T17:19:25.973 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/ib700wdt.ko 2023-08-31T17:19:25.973 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/ibmasr.ko 2023-08-31T17:19:25.973 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-31T17:19:25.974 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-31T17:19:25.974 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/it87_wdt.ko 2023-08-31T17:19:25.974 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/machzwd.ko 2023-08-31T17:19:25.974 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/nv_tco.ko 2023-08-31T17:19:25.974 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-31T17:19:25.975 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-31T17:19:25.975 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-31T17:19:25.975 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-31T17:19:25.975 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/softdog.ko 2023-08-31T17:19:25.975 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-31T17:19:25.976 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/via_wdt.ko 2023-08-31T17:19:25.976 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-31T17:19:25.976 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-31T17:19:25.976 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-31T17:19:25.976 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/wdt_pci.ko 2023-08-31T17:19:25.977 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/xen_wdt.ko 2023-08-31T17:19:25.977 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen 2023-08-31T17:19:25.977 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-31T17:19:25.977 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xen-evtchn.ko 2023-08-31T17:19:25.977 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xen-gntalloc.ko 2023-08-31T17:19:25.978 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xen-gntdev.ko 2023-08-31T17:19:25.978 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xen-pciback 2023-08-31T17:19:25.978 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-31T17:19:25.978 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xen-privcmd.ko 2023-08-31T17:19:25.978 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xenfs 2023-08-31T17:19:25.979 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-31T17:19:25.979 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs 2023-08-31T17:19:25.979 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/9p 2023-08-31T17:19:25.979 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/9p/9p.ko 2023-08-31T17:19:25.979 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/affs 2023-08-31T17:19:25.979 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/affs/affs.ko 2023-08-31T17:19:25.980 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/befs 2023-08-31T17:19:25.980 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/befs/befs.ko 2023-08-31T17:19:25.980 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/binfmt_misc.ko 2023-08-31T17:19:25.980 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/btrfs 2023-08-31T17:19:25.980 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/btrfs/btrfs.ko 2023-08-31T17:19:25.980 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/cachefiles 2023-08-31T17:19:25.981 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/cachefiles/cachefiles.ko 2023-08-31T17:19:25.981 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ceph 2023-08-31T17:19:25.981 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ceph/ceph.ko 2023-08-31T17:19:25.981 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/coda 2023-08-31T17:19:25.981 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/coda/coda.ko 2023-08-31T17:19:25.981 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/cramfs 2023-08-31T17:19:25.982 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/cramfs/cramfs.ko 2023-08-31T17:19:25.982 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/dlm 2023-08-31T17:19:25.982 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/dlm/dlm.ko 2023-08-31T17:19:25.982 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ecryptfs 2023-08-31T17:19:25.982 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-31T17:19:25.983 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/f2fs 2023-08-31T17:19:25.983 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/f2fs/f2fs.ko 2023-08-31T17:19:25.983 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fat 2023-08-31T17:19:25.983 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fat/fat.ko 2023-08-31T17:19:25.983 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fat/msdos.ko 2023-08-31T17:19:25.983 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fat/vfat.ko 2023-08-31T17:19:25.984 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fscache 2023-08-31T17:19:25.984 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fscache/fscache.ko 2023-08-31T17:19:25.984 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fuse 2023-08-31T17:19:25.984 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fuse/cuse.ko 2023-08-31T17:19:25.984 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fuse/fuse.ko 2023-08-31T17:19:25.984 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/gfs2 2023-08-31T17:19:25.985 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/gfs2/gfs2.ko 2023-08-31T17:19:25.985 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/hfs 2023-08-31T17:19:25.985 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/hfs/hfs.ko 2023-08-31T17:19:25.985 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/hfsplus 2023-08-31T17:19:25.985 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/hfsplus/hfsplus.ko 2023-08-31T17:19:25.985 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/isofs 2023-08-31T17:19:25.986 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/isofs/isofs.ko 2023-08-31T17:19:25.986 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/jfs 2023-08-31T17:19:25.986 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/jfs/jfs.ko 2023-08-31T17:19:25.986 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/lockd 2023-08-31T17:19:25.986 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/lockd/lockd.ko 2023-08-31T17:19:25.986 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/minix 2023-08-31T17:19:25.987 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/minix/minix.ko 2023-08-31T17:19:25.987 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/netfs 2023-08-31T17:19:25.987 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/netfs/netfs.ko 2023-08-31T17:19:25.987 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs 2023-08-31T17:19:25.987 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/blocklayout 2023-08-31T17:19:25.988 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-31T17:19:25.988 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/filelayout 2023-08-31T17:19:25.988 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-31T17:19:25.988 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/flexfilelayout 2023-08-31T17:19:25.988 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-31T17:19:25.988 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/nfs.ko 2023-08-31T17:19:25.989 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/nfsv3.ko 2023-08-31T17:19:25.989 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/nfsv4.ko 2023-08-31T17:19:25.989 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs_common 2023-08-31T17:19:25.989 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs_common/grace.ko 2023-08-31T17:19:25.989 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs_common/nfs_acl.ko 2023-08-31T17:19:25.989 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfsd 2023-08-31T17:19:25.990 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfsd/nfsd.ko 2023-08-31T17:19:25.990 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nilfs2 2023-08-31T17:19:25.990 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nilfs2/nilfs2.ko 2023-08-31T17:19:25.990 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls 2023-08-31T17:19:25.990 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-celtic.ko 2023-08-31T17:19:25.991 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-centeuro.ko 2023-08-31T17:19:25.991 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-croatian.ko 2023-08-31T17:19:25.991 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-cyrillic.ko 2023-08-31T17:19:25.991 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-gaelic.ko 2023-08-31T17:19:25.991 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-greek.ko 2023-08-31T17:19:25.992 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-iceland.ko 2023-08-31T17:19:25.992 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-inuit.ko 2023-08-31T17:19:25.992 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-roman.ko 2023-08-31T17:19:25.992 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-romanian.ko 2023-08-31T17:19:25.992 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-turkish.ko 2023-08-31T17:19:25.992 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp1250.ko 2023-08-31T17:19:25.993 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp1251.ko 2023-08-31T17:19:25.993 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp1255.ko 2023-08-31T17:19:25.993 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp737.ko 2023-08-31T17:19:25.993 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp775.ko 2023-08-31T17:19:25.993 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp850.ko 2023-08-31T17:19:25.994 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp852.ko 2023-08-31T17:19:25.994 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp855.ko 2023-08-31T17:19:25.994 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp857.ko 2023-08-31T17:19:25.994 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp860.ko 2023-08-31T17:19:25.994 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp861.ko 2023-08-31T17:19:25.994 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp862.ko 2023-08-31T17:19:25.995 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp863.ko 2023-08-31T17:19:25.995 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp864.ko 2023-08-31T17:19:25.995 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp865.ko 2023-08-31T17:19:25.995 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp866.ko 2023-08-31T17:19:25.995 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp869.ko 2023-08-31T17:19:25.996 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp874.ko 2023-08-31T17:19:25.996 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp932.ko 2023-08-31T17:19:25.996 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp936.ko 2023-08-31T17:19:25.996 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp949.ko 2023-08-31T17:19:25.997 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp950.ko 2023-08-31T17:19:25.997 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_euc-jp.ko 2023-08-31T17:19:25.997 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-1.ko 2023-08-31T17:19:25.997 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-13.ko 2023-08-31T17:19:25.997 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-14.ko 2023-08-31T17:19:25.998 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-15.ko 2023-08-31T17:19:25.998 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-2.ko 2023-08-31T17:19:25.998 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-3.ko 2023-08-31T17:19:25.998 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-4.ko 2023-08-31T17:19:25.998 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-5.ko 2023-08-31T17:19:25.998 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-6.ko 2023-08-31T17:19:25.999 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-7.ko 2023-08-31T17:19:25.999 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-9.ko 2023-08-31T17:19:25.999 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_koi8-r.ko 2023-08-31T17:19:25.999 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_koi8-ru.ko 2023-08-31T17:19:25.999 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_koi8-u.ko 2023-08-31T17:19:26.000 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_utf8.ko 2023-08-31T17:19:26.000 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2 2023-08-31T17:19:26.000 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/cluster 2023-08-31T17:19:26.000 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-31T17:19:26.000 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/dlm 2023-08-31T17:19:26.001 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-31T17:19:26.001 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/dlmfs 2023-08-31T17:19:26.001 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-31T17:19:26.001 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/ocfs2.ko 2023-08-31T17:19:26.001 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-31T17:19:26.002 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-31T17:19:26.002 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-31T17:19:26.002 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/overlayfs 2023-08-31T17:19:26.002 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/overlayfs/overlay.ko 2023-08-31T17:19:26.003 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/pstore 2023-08-31T17:19:26.003 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/pstore/ramoops.ko 2023-08-31T17:19:26.003 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/reiserfs 2023-08-31T17:19:26.003 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/reiserfs/reiserfs.ko 2023-08-31T17:19:26.003 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/romfs 2023-08-31T17:19:26.004 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/romfs/romfs.ko 2023-08-31T17:19:26.004 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/smb 2023-08-31T17:19:26.004 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/smb/client 2023-08-31T17:19:26.004 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/smb/client/cifs.ko 2023-08-31T17:19:26.004 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/smb/common 2023-08-31T17:19:26.005 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/smb/common/cifs_arc4.ko 2023-08-31T17:19:26.005 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/smb/common/cifs_md4.ko 2023-08-31T17:19:26.005 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/squashfs 2023-08-31T17:19:26.005 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/squashfs/squashfs.ko 2023-08-31T17:19:26.005 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/sysv 2023-08-31T17:19:26.005 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/sysv/sysv.ko 2023-08-31T17:19:26.006 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/udf 2023-08-31T17:19:26.006 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/udf/udf.ko 2023-08-31T17:19:26.006 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ufs 2023-08-31T17:19:26.006 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ufs/ufs.ko 2023-08-31T17:19:26.006 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/xfs 2023-08-31T17:19:26.006 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/xfs/xfs.ko 2023-08-31T17:19:26.007 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/kernel 2023-08-31T17:19:26.007 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/kernel/rcu 2023-08-31T17:19:26.007 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/kernel/rcu/rcutorture.ko 2023-08-31T17:19:26.007 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/kernel/torture.ko 2023-08-31T17:19:26.008 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/kernel/trace 2023-08-31T17:19:26.008 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-31T17:19:26.008 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib 2023-08-31T17:19:26.008 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/asn1_encoder.ko 2023-08-31T17:19:26.008 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/crc-itu-t.ko 2023-08-31T17:19:26.009 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/crc8.ko 2023-08-31T17:19:26.009 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/crypto 2023-08-31T17:19:26.009 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/crypto/libarc4.ko 2023-08-31T17:19:26.009 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/crypto/libdes.ko 2023-08-31T17:19:26.009 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/libcrc32c.ko 2023-08-31T17:19:26.010 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/lru_cache.ko 2023-08-31T17:19:26.010 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/lz4 2023-08-31T17:19:26.010 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/lz4/lz4_compress.ko 2023-08-31T17:19:26.010 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/lz4/lz4hc_compress.ko 2023-08-31T17:19:26.010 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/math 2023-08-31T17:19:26.011 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/math/cordic.ko 2023-08-31T17:19:26.011 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/raid6 2023-08-31T17:19:26.011 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/raid6/raid6_pq.ko 2023-08-31T17:19:26.011 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/reed_solomon 2023-08-31T17:19:26.011 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-31T17:19:26.012 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/ts_bm.ko 2023-08-31T17:19:26.012 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/ts_fsm.ko 2023-08-31T17:19:26.012 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/ts_kmp.ko 2023-08-31T17:19:26.012 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/zstd 2023-08-31T17:19:26.012 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/zstd/zstd_compress.ko 2023-08-31T17:19:26.013 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/mm 2023-08-31T17:19:26.013 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/mm/hwpoison-inject.ko 2023-08-31T17:19:26.013 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net 2023-08-31T17:19:26.013 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan 2023-08-31T17:19:26.014 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/6lowpan.ko 2023-08-31T17:19:26.014 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/nhc_dest.ko 2023-08-31T17:19:26.014 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/nhc_fragment.ko 2023-08-31T17:19:26.014 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/nhc_hop.ko 2023-08-31T17:19:26.014 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-31T17:19:26.015 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/nhc_mobility.ko 2023-08-31T17:19:26.015 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/nhc_routing.ko 2023-08-31T17:19:26.015 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/nhc_udp.ko 2023-08-31T17:19:26.015 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/802 2023-08-31T17:19:26.015 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/802/garp.ko 2023-08-31T17:19:26.015 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/802/mrp.ko 2023-08-31T17:19:26.016 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/802/p8022.ko 2023-08-31T17:19:26.016 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/802/psnap.ko 2023-08-31T17:19:26.016 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/802/stp.ko 2023-08-31T17:19:26.016 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/8021q 2023-08-31T17:19:26.017 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/8021q/8021q.ko 2023-08-31T17:19:26.017 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/9p 2023-08-31T17:19:26.017 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/9p/9pnet.ko 2023-08-31T17:19:26.017 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/9p/9pnet_fd.ko 2023-08-31T17:19:26.017 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/9p/9pnet_rdma.ko 2023-08-31T17:19:26.017 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/9p/9pnet_virtio.ko 2023-08-31T17:19:26.018 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/batman-adv 2023-08-31T17:19:26.018 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/batman-adv/batman-adv.ko 2023-08-31T17:19:26.018 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge 2023-08-31T17:19:26.018 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/br_netfilter.ko 2023-08-31T17:19:26.018 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/bridge.ko 2023-08-31T17:19:26.019 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter 2023-08-31T17:19:26.019 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-31T17:19:26.019 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-31T17:19:26.019 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-31T17:19:26.019 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-31T17:19:26.020 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-31T17:19:26.020 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-31T17:19:26.020 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-31T17:19:26.020 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-31T17:19:26.020 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-31T17:19:26.021 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-31T17:19:26.021 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-31T17:19:26.021 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-31T17:19:26.021 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-31T17:19:26.021 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-31T17:19:26.021 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-31T17:19:26.022 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-31T17:19:26.022 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-31T17:19:26.022 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-31T17:19:26.022 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-31T17:19:26.022 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-31T17:19:26.023 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebtables.ko 2023-08-31T17:19:26.023 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-31T17:19:26.023 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-31T17:19:26.023 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-31T17:19:26.023 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ceph 2023-08-31T17:19:26.024 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ceph/libceph.ko 2023-08-31T17:19:26.024 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/core 2023-08-31T17:19:26.024 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/core/failover.ko 2023-08-31T17:19:26.024 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/core/pktgen.ko 2023-08-31T17:19:26.024 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dccp 2023-08-31T17:19:26.025 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dccp/dccp.ko 2023-08-31T17:19:26.025 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dccp/dccp_diag.ko 2023-08-31T17:19:26.025 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dccp/dccp_ipv4.ko 2023-08-31T17:19:26.025 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dccp/dccp_ipv6.ko 2023-08-31T17:19:26.025 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dns_resolver 2023-08-31T17:19:26.025 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dns_resolver/dns_resolver.ko 2023-08-31T17:19:26.026 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dsa 2023-08-31T17:19:26.026 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dsa/dsa_core.ko 2023-08-31T17:19:26.026 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dsa/tag_brcm.ko 2023-08-31T17:19:26.026 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dsa/tag_dsa.ko 2023-08-31T17:19:26.026 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dsa/tag_none.ko 2023-08-31T17:19:26.027 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dsa/tag_trailer.ko 2023-08-31T17:19:26.027 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ieee802154 2023-08-31T17:19:26.027 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ieee802154/6lowpan 2023-08-31T17:19:26.027 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-31T17:19:26.027 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ieee802154/ieee802154.ko 2023-08-31T17:19:26.028 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-31T17:19:26.028 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4 2023-08-31T17:19:26.028 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/ah4.ko 2023-08-31T17:19:26.028 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/esp4.ko 2023-08-31T17:19:26.028 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/fou.ko 2023-08-31T17:19:26.029 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/gre.ko 2023-08-31T17:19:26.029 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/inet_diag.ko 2023-08-31T17:19:26.029 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/ip_gre.ko 2023-08-31T17:19:26.029 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/ip_tunnel.ko 2023-08-31T17:19:26.029 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/ip_vti.ko 2023-08-31T17:19:26.030 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/ipcomp.ko 2023-08-31T17:19:26.030 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/ipip.ko 2023-08-31T17:19:26.030 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter 2023-08-31T17:19:26.030 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-31T17:19:26.030 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-31T17:19:26.030 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-31T17:19:26.031 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-31T17:19:26.031 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-31T17:19:26.031 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-31T17:19:26.031 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-31T17:19:26.031 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-31T17:19:26.032 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-31T17:19:26.032 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-31T17:19:26.032 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-31T17:19:26.032 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-31T17:19:26.032 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-31T17:19:26.033 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-31T17:19:26.033 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-31T17:19:26.033 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-31T17:19:26.033 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-31T17:19:26.033 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-31T17:19:26.033 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-31T17:19:26.034 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-31T17:19:26.034 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-31T17:19:26.034 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_bic.ko 2023-08-31T17:19:26.034 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_dctcp.ko 2023-08-31T17:19:26.034 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_diag.ko 2023-08-31T17:19:26.035 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_highspeed.ko 2023-08-31T17:19:26.035 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_htcp.ko 2023-08-31T17:19:26.035 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_hybla.ko 2023-08-31T17:19:26.035 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_illinois.ko 2023-08-31T17:19:26.035 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_lp.ko 2023-08-31T17:19:26.035 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_scalable.ko 2023-08-31T17:19:26.036 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_vegas.ko 2023-08-31T17:19:26.036 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_veno.ko 2023-08-31T17:19:26.036 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_westwood.ko 2023-08-31T17:19:26.036 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_yeah.ko 2023-08-31T17:19:26.036 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tunnel4.ko 2023-08-31T17:19:26.037 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/udp_diag.ko 2023-08-31T17:19:26.037 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/udp_tunnel.ko 2023-08-31T17:19:26.037 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-31T17:19:26.037 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6 2023-08-31T17:19:26.037 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/ah6.ko 2023-08-31T17:19:26.037 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/esp6.ko 2023-08-31T17:19:26.038 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/fou6.ko 2023-08-31T17:19:26.038 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/ip6_tunnel.ko 2023-08-31T17:19:26.038 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-31T17:19:26.038 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/ip6_vti.ko 2023-08-31T17:19:26.038 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/ipcomp6.ko 2023-08-31T17:19:26.039 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter 2023-08-31T17:19:26.039 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-31T17:19:26.039 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-31T17:19:26.039 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-31T17:19:26.039 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-31T17:19:26.040 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-31T17:19:26.040 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-31T17:19:26.040 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-31T17:19:26.040 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-31T17:19:26.040 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-31T17:19:26.040 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-31T17:19:26.041 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-31T17:19:26.041 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-31T17:19:26.041 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-31T17:19:26.041 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-31T17:19:26.041 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-31T17:19:26.041 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-31T17:19:26.042 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-31T17:19:26.042 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-31T17:19:26.042 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-31T17:19:26.042 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-31T17:19:26.042 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-31T17:19:26.042 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-31T17:19:26.043 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-31T17:19:26.043 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-31T17:19:26.043 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/sit.ko 2023-08-31T17:19:26.043 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/tunnel6.ko 2023-08-31T17:19:26.044 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-31T17:19:26.044 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/key 2023-08-31T17:19:26.044 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/key/af_key.ko 2023-08-31T17:19:26.044 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp 2023-08-31T17:19:26.044 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp/l2tp_core.ko 2023-08-31T17:19:26.044 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-31T17:19:26.045 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp/l2tp_eth.ko 2023-08-31T17:19:26.045 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp/l2tp_ip.ko 2023-08-31T17:19:26.045 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp/l2tp_ip6.ko 2023-08-31T17:19:26.045 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp/l2tp_netlink.ko 2023-08-31T17:19:26.045 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp/l2tp_ppp.ko 2023-08-31T17:19:26.046 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/llc 2023-08-31T17:19:26.046 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/llc/llc.ko 2023-08-31T17:19:26.046 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/mac802154 2023-08-31T17:19:26.046 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/mac802154/mac802154.ko 2023-08-31T17:19:26.046 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/mpls 2023-08-31T17:19:26.046 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/mpls/mpls_gso.ko 2023-08-31T17:19:26.047 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter 2023-08-31T17:19:26.047 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset 2023-08-31T17:19:26.047 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set.ko 2023-08-31T17:19:26.047 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-31T17:19:26.047 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-31T17:19:26.048 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-31T17:19:26.048 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-31T17:19:26.048 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-31T17:19:26.048 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-31T17:19:26.048 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-31T17:19:26.048 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-31T17:19:26.049 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-31T17:19:26.049 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-31T17:19:26.049 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-31T17:19:26.049 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-31T17:19:26.049 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-31T17:19:26.050 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-31T17:19:26.050 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-31T17:19:26.050 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs 2023-08-31T17:19:26.050 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-31T17:19:26.050 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-31T17:19:26.050 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-31T17:19:26.051 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-31T17:19:26.051 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-31T17:19:26.051 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-31T17:19:26.051 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-31T17:19:26.051 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-31T17:19:26.052 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-31T17:19:26.052 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-31T17:19:26.052 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-31T17:19:26.052 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-31T17:19:26.052 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-31T17:19:26.053 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-31T17:19:26.053 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conncount.ko 2023-08-31T17:19:26.053 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack.ko 2023-08-31T17:19:26.053 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-31T17:19:26.053 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-31T17:19:26.053 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-31T17:19:26.054 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-31T17:19:26.054 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-31T17:19:26.054 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-31T17:19:26.054 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-31T17:19:26.054 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-31T17:19:26.055 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-31T17:19:26.055 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-31T17:19:26.055 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-31T17:19:26.055 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-31T17:19:26.055 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-31T17:19:26.055 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_flow_table.ko 2023-08-31T17:19:26.056 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-31T17:19:26.056 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_log_syslog.ko 2023-08-31T17:19:26.056 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_nat.ko 2023-08-31T17:19:26.056 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-31T17:19:26.056 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-31T17:19:26.057 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_nat_irc.ko 2023-08-31T17:19:26.057 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_nat_sip.ko 2023-08-31T17:19:26.057 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-31T17:19:26.057 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-31T17:19:26.057 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_tables.ko 2023-08-31T17:19:26.057 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nfnetlink.ko 2023-08-31T17:19:26.058 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-31T17:19:26.058 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nfnetlink_log.ko 2023-08-31T17:19:26.058 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-31T17:19:26.058 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-31T17:19:26.059 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_chain_nat.ko 2023-08-31T17:19:26.059 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_compat.ko 2023-08-31T17:19:26.059 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_ct.ko 2023-08-31T17:19:26.059 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-31T17:19:26.059 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_fib.ko 2023-08-31T17:19:26.060 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-31T17:19:26.060 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_hash.ko 2023-08-31T17:19:26.060 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_limit.ko 2023-08-31T17:19:26.060 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_log.ko 2023-08-31T17:19:26.060 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_masq.ko 2023-08-31T17:19:26.061 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_nat.ko 2023-08-31T17:19:26.061 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_numgen.ko 2023-08-31T17:19:26.061 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_queue.ko 2023-08-31T17:19:26.061 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_quota.ko 2023-08-31T17:19:26.061 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_redir.ko 2023-08-31T17:19:26.062 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_reject.ko 2023-08-31T17:19:26.062 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_reject_inet.ko 2023-08-31T17:19:26.062 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_socket.ko 2023-08-31T17:19:26.062 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_tunnel.ko 2023-08-31T17:19:26.062 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_AUDIT.ko 2023-08-31T17:19:26.062 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-31T17:19:26.063 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-31T17:19:26.063 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-31T17:19:26.063 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_CT.ko 2023-08-31T17:19:26.063 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_DSCP.ko 2023-08-31T17:19:26.063 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_HL.ko 2023-08-31T17:19:26.063 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_HMARK.ko 2023-08-31T17:19:26.064 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-31T17:19:26.064 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_LED.ko 2023-08-31T17:19:26.064 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_LOG.ko 2023-08-31T17:19:26.064 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-31T17:19:26.064 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_NETMAP.ko 2023-08-31T17:19:26.064 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_NFLOG.ko 2023-08-31T17:19:26.065 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-31T17:19:26.065 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_RATEEST.ko 2023-08-31T17:19:26.065 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-31T17:19:26.065 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_SECMARK.ko 2023-08-31T17:19:26.065 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-31T17:19:26.065 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-31T17:19:26.066 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_TEE.ko 2023-08-31T17:19:26.066 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_TPROXY.ko 2023-08-31T17:19:26.066 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_TRACE.ko 2023-08-31T17:19:26.066 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_addrtype.ko 2023-08-31T17:19:26.066 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_bpf.ko 2023-08-31T17:19:26.067 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_cgroup.ko 2023-08-31T17:19:26.067 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_cluster.ko 2023-08-31T17:19:26.067 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_comment.ko 2023-08-31T17:19:26.067 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_connbytes.ko 2023-08-31T17:19:26.067 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_connlabel.ko 2023-08-31T17:19:26.068 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_connlimit.ko 2023-08-31T17:19:26.068 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_connmark.ko 2023-08-31T17:19:26.068 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_conntrack.ko 2023-08-31T17:19:26.068 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_cpu.ko 2023-08-31T17:19:26.068 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_dccp.ko 2023-08-31T17:19:26.068 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_devgroup.ko 2023-08-31T17:19:26.069 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_dscp.ko 2023-08-31T17:19:26.069 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_ecn.ko 2023-08-31T17:19:26.069 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_esp.ko 2023-08-31T17:19:26.069 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_hashlimit.ko 2023-08-31T17:19:26.069 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_helper.ko 2023-08-31T17:19:26.069 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_hl.ko 2023-08-31T17:19:26.070 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_ipcomp.ko 2023-08-31T17:19:26.070 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_iprange.ko 2023-08-31T17:19:26.070 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_ipvs.ko 2023-08-31T17:19:26.070 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_l2tp.ko 2023-08-31T17:19:26.070 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_length.ko 2023-08-31T17:19:26.071 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_limit.ko 2023-08-31T17:19:26.071 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_mac.ko 2023-08-31T17:19:26.071 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_mark.ko 2023-08-31T17:19:26.071 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_multiport.ko 2023-08-31T17:19:26.071 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_nat.ko 2023-08-31T17:19:26.071 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_nfacct.ko 2023-08-31T17:19:26.071 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_osf.ko 2023-08-31T17:19:26.072 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_owner.ko 2023-08-31T17:19:26.072 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_physdev.ko 2023-08-31T17:19:26.072 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_pkttype.ko 2023-08-31T17:19:26.072 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_policy.ko 2023-08-31T17:19:26.072 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_quota.ko 2023-08-31T17:19:26.072 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_rateest.ko 2023-08-31T17:19:26.073 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_realm.ko 2023-08-31T17:19:26.073 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_recent.ko 2023-08-31T17:19:26.073 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_sctp.ko 2023-08-31T17:19:26.073 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_set.ko 2023-08-31T17:19:26.074 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_socket.ko 2023-08-31T17:19:26.074 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_state.ko 2023-08-31T17:19:26.074 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_statistic.ko 2023-08-31T17:19:26.074 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_string.ko 2023-08-31T17:19:26.074 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_tcpmss.ko 2023-08-31T17:19:26.074 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_time.ko 2023-08-31T17:19:26.075 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_u32.ko 2023-08-31T17:19:26.075 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netlink 2023-08-31T17:19:26.075 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netlink/netlink_diag.ko 2023-08-31T17:19:26.075 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/nsh 2023-08-31T17:19:26.075 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/nsh/nsh.ko 2023-08-31T17:19:26.076 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/openvswitch 2023-08-31T17:19:26.076 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/openvswitch/openvswitch.ko 2023-08-31T17:19:26.076 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/openvswitch/vport-geneve.ko 2023-08-31T17:19:26.076 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/openvswitch/vport-gre.ko 2023-08-31T17:19:26.076 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/openvswitch/vport-vxlan.ko 2023-08-31T17:19:26.076 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/packet 2023-08-31T17:19:26.077 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/packet/af_packet_diag.ko 2023-08-31T17:19:26.077 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/rds 2023-08-31T17:19:26.077 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/rds/rds.ko 2023-08-31T17:19:26.077 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/rds/rds_rdma.ko 2023-08-31T17:19:26.077 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/rds/rds_tcp.ko 2023-08-31T17:19:26.078 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched 2023-08-31T17:19:26.078 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_csum.ko 2023-08-31T17:19:26.078 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_gact.ko 2023-08-31T17:19:26.078 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_ipt.ko 2023-08-31T17:19:26.078 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_mirred.ko 2023-08-31T17:19:26.079 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_nat.ko 2023-08-31T17:19:26.079 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_pedit.ko 2023-08-31T17:19:26.079 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_police.ko 2023-08-31T17:19:26.079 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_simple.ko 2023-08-31T17:19:26.079 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_skbedit.ko 2023-08-31T17:19:26.079 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_vlan.ko 2023-08-31T17:19:26.079 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/cls_basic.ko 2023-08-31T17:19:26.080 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/cls_bpf.ko 2023-08-31T17:19:26.080 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/cls_flow.ko 2023-08-31T17:19:26.080 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/cls_fw.ko 2023-08-31T17:19:26.080 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/cls_route.ko 2023-08-31T17:19:26.080 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/cls_u32.ko 2023-08-31T17:19:26.080 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/em_cmp.ko 2023-08-31T17:19:26.081 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/em_ipset.ko 2023-08-31T17:19:26.081 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/em_meta.ko 2023-08-31T17:19:26.081 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/em_nbyte.ko 2023-08-31T17:19:26.081 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/em_text.ko 2023-08-31T17:19:26.081 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/em_u32.ko 2023-08-31T17:19:26.081 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_choke.ko 2023-08-31T17:19:26.082 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_codel.ko 2023-08-31T17:19:26.082 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_drr.ko 2023-08-31T17:19:26.082 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_fq.ko 2023-08-31T17:19:26.082 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_gred.ko 2023-08-31T17:19:26.082 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_hfsc.ko 2023-08-31T17:19:26.083 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_hhf.ko 2023-08-31T17:19:26.083 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_htb.ko 2023-08-31T17:19:26.083 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_ingress.ko 2023-08-31T17:19:26.083 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_mqprio.ko 2023-08-31T17:19:26.083 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_mqprio_lib.ko 2023-08-31T17:19:26.083 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_multiq.ko 2023-08-31T17:19:26.084 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_netem.ko 2023-08-31T17:19:26.084 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_pie.ko 2023-08-31T17:19:26.084 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_plug.ko 2023-08-31T17:19:26.084 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_prio.ko 2023-08-31T17:19:26.084 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_qfq.ko 2023-08-31T17:19:26.084 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_red.ko 2023-08-31T17:19:26.085 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_sfb.ko 2023-08-31T17:19:26.085 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_sfq.ko 2023-08-31T17:19:26.085 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_tbf.ko 2023-08-31T17:19:26.085 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_teql.ko 2023-08-31T17:19:26.085 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sctp 2023-08-31T17:19:26.086 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sctp/sctp.ko 2023-08-31T17:19:26.086 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sctp/sctp_diag.ko 2023-08-31T17:19:26.086 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sunrpc 2023-08-31T17:19:26.086 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sunrpc/auth_gss 2023-08-31T17:19:26.086 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-31T17:19:26.086 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-31T17:19:26.087 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sunrpc/sunrpc.ko 2023-08-31T17:19:26.087 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sunrpc/xprtrdma 2023-08-31T17:19:26.087 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-31T17:19:26.087 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/tipc 2023-08-31T17:19:26.087 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/tipc/diag.ko 2023-08-31T17:19:26.087 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/tipc/tipc.ko 2023-08-31T17:19:26.088 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/unix 2023-08-31T17:19:26.088 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/unix/unix_diag.ko 2023-08-31T17:19:26.088 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/vmw_vsock 2023-08-31T17:19:26.088 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-31T17:19:26.088 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-31T17:19:26.088 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/vmw_vsock/vsock.ko 2023-08-31T17:19:26.089 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-31T17:19:26.089 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-31T17:19:26.089 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/xfrm 2023-08-31T17:19:26.089 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-31T17:19:26.089 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/security 2023-08-31T17:19:26.089 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/security/keys 2023-08-31T17:19:26.090 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/security/keys/encrypted-keys 2023-08-31T17:19:26.090 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-31T17:19:26.090 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/security/keys/trusted-keys 2023-08-31T17:19:26.090 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/security/keys/trusted-keys/trusted.ko 2023-08-31T17:19:26.090 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/virt 2023-08-31T17:19:26.091 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/virt/lib 2023-08-31T17:19:26.091 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/virt/lib/irqbypass.ko 2023-08-31T17:19:26.091 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.alias 2023-08-31T17:19:26.091 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.alias.bin 2023-08-31T17:19:26.091 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.builtin 2023-08-31T17:19:26.091 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.builtin.bin 2023-08-31T17:19:26.092 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.builtin.modinfo 2023-08-31T17:19:26.092 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.dep 2023-08-31T17:19:26.092 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.dep.bin 2023-08-31T17:19:26.092 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.devname 2023-08-31T17:19:26.092 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.order 2023-08-31T17:19:26.093 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.softdep 2023-08-31T17:19:26.093 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.symbols 2023-08-31T17:19:26.093 INFO:teuthology.orchestra.run.smithi072.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.symbols.bin 2023-08-31T17:19:26.094 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-g1931c6efd6a8 2023-08-31T17:19:26.094 DEBUG:teuthology.orchestra.run.smithi072:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-31T17:19:26.121 INFO:teuthology.orchestra.run.smithi072.stdout:postinstall scriptlet (using /bin/sh): 2023-08-31T17:19:26.121 INFO:teuthology.orchestra.run.smithi072.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-g1931c6efd6a8 -a -r /boot/System.map-6.5.0-rc7-g1931c6efd6a8 ]; then 2023-08-31T17:19:26.122 INFO:teuthology.orchestra.run.smithi072.stdout:cp /boot/vmlinuz-6.5.0-rc7-g1931c6efd6a8 /boot/.vmlinuz-6.5.0-rc7-g1931c6efd6a8-rpm 2023-08-31T17:19:26.122 INFO:teuthology.orchestra.run.smithi072.stdout:cp /boot/System.map-6.5.0-rc7-g1931c6efd6a8 /boot/.System.map-6.5.0-rc7-g1931c6efd6a8-rpm 2023-08-31T17:19:26.122 INFO:teuthology.orchestra.run.smithi072.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-g1931c6efd6a8 /boot/System.map-6.5.0-rc7-g1931c6efd6a8 2023-08-31T17:19:26.122 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/installkernel 6.5.0-rc7-g1931c6efd6a8 /boot/.vmlinuz-6.5.0-rc7-g1931c6efd6a8-rpm /boot/.System.map-6.5.0-rc7-g1931c6efd6a8-rpm 2023-08-31T17:19:26.122 INFO:teuthology.orchestra.run.smithi072.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-g1931c6efd6a8-rpm /boot/.System.map-6.5.0-rc7-g1931c6efd6a8-rpm 2023-08-31T17:19:26.123 INFO:teuthology.orchestra.run.smithi072.stdout:fi 2023-08-31T17:19:26.123 INFO:teuthology.orchestra.run.smithi072.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-31T17:19:26.123 INFO:teuthology.orchestra.run.smithi072.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-31T17:19:26.123 INFO:teuthology.orchestra.run.smithi072.stdout:new-kernel-pkg --remove 6.5.0-rc7-g1931c6efd6a8 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-g1931c6efd6a8.img 2023-08-31T17:19:26.123 INFO:teuthology.orchestra.run.smithi072.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-31T17:19:26.123 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-install remove 6.5.0-rc7-g1931c6efd6a8 2023-08-31T17:19:26.124 INFO:teuthology.orchestra.run.smithi072.stdout:fi 2023-08-31T17:19:26.124 INFO:teuthology.orchestra.run.smithi072.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-31T17:19:26.124 INFO:teuthology.orchestra.run.smithi072.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-31T17:19:26.124 INFO:teuthology.orchestra.run.smithi072.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-g1931c6efd6a8 2023-08-31T17:19:26.124 INFO:teuthology.orchestra.run.smithi072.stdout:fi 2023-08-31T17:19:26.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -qi grub2-tools 2023-08-31T17:19:26.203 INFO:teuthology.orchestra.run.smithi072.stdout:Name : grub2-tools 2023-08-31T17:19:26.203 INFO:teuthology.orchestra.run.smithi072.stdout:Epoch : 1 2023-08-31T17:19:26.204 INFO:teuthology.orchestra.run.smithi072.stdout:Version : 2.02 2023-08-31T17:19:26.204 INFO:teuthology.orchestra.run.smithi072.stdout:Release : 129.el8 2023-08-31T17:19:26.204 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: x86_64 2023-08-31T17:19:26.204 INFO:teuthology.orchestra.run.smithi072.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-08-31T17:19:26.205 INFO:teuthology.orchestra.run.smithi072.stdout:Group : System Environment/Base 2023-08-31T17:19:26.205 INFO:teuthology.orchestra.run.smithi072.stdout:Size : 9265586 2023-08-31T17:19:26.205 INFO:teuthology.orchestra.run.smithi072.stdout:License : GPLv3+ 2023-08-31T17:19:26.205 INFO:teuthology.orchestra.run.smithi072.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-08-31T17:19:26.205 INFO:teuthology.orchestra.run.smithi072.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-08-31T17:19:26.206 INFO:teuthology.orchestra.run.smithi072.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-08-31T17:19:26.206 INFO:teuthology.orchestra.run.smithi072.stdout:Build Host : kbuilder.bsys.centos.org 2023-08-31T17:19:26.206 INFO:teuthology.orchestra.run.smithi072.stdout:Relocations : (not relocatable) 2023-08-31T17:19:26.206 INFO:teuthology.orchestra.run.smithi072.stdout:Packager : CentOS BuildSystem 2023-08-31T17:19:26.206 INFO:teuthology.orchestra.run.smithi072.stdout:Vendor : CentOS 2023-08-31T17:19:26.207 INFO:teuthology.orchestra.run.smithi072.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-31T17:19:26.207 INFO:teuthology.orchestra.run.smithi072.stdout:Summary : Support tools for GRUB. 2023-08-31T17:19:26.208 INFO:teuthology.orchestra.run.smithi072.stdout:Description : 2023-08-31T17:19:26.209 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T17:19:26.209 INFO:teuthology.orchestra.run.smithi072.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-31T17:19:26.209 INFO:teuthology.orchestra.run.smithi072.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-31T17:19:26.209 INFO:teuthology.orchestra.run.smithi072.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-31T17:19:26.210 INFO:teuthology.orchestra.run.smithi072.stdout:hardware devices. 2023-08-31T17:19:26.210 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T17:19:26.210 INFO:teuthology.orchestra.run.smithi072.stdout:This subpackage provides tools for support of all platforms. 2023-08-31T17:19:26.211 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-31T17:19:26.211 INFO:teuthology.task.kernel:Updating grub on smithi072 to boot 6.5.0-rc7-g1931c6efd6a8 2023-08-31T17:19:26.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-31T17:19:27.033 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2023-08-31T17:19:29.678 INFO:teuthology.orchestra.run.smithi072.stderr:done 2023-08-31T17:19:29.680 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-08-31T17:19:29.726 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.Lf8A5DfLyX 2023-08-31T17:19:29.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Lf8A5DfLyX 2023-08-31T17:19:29.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.Lf8A5DfLyX 2023-08-31T17:19:29.936 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.Lf8A5DfLyX is 6KB 2023-08-31T17:19:29.984 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.Lf8A5DfLyX 2023-08-31T17:19:30.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo /bin/ls /boot/loader/entries || true 2023-08-31T17:19:30.067 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-08-31T17:19:30.067 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-08-31T17:19:30.067 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-08-31T17:19:30.068 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-g1931c6efd6a8.conf 2023-08-31T17:19:30.069 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-g1931c6efd6a8 2023-08-31T17:19:30.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2023-08-31T17:20:00.248 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-08-31T17:20:00.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-08-31T17:20:00.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T17:20:18.590 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-08-31T17:20:27.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-08-31T17:20:27.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T17:20:30.651 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-08-31T17:20:42.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-08-31T17:20:42.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T17:21:17.161 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-08-31T17:21:17.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-08-31T17:21:17.650 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-g1931c6efd6a8"... 2023-08-31T17:21:17.650 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-08-31T17:21:17.695 INFO:teuthology.orchestra.run.smithi072.stdout:6.5.0-rc7-g1931c6efd6a8 2023-08-31T17:21:17.695 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-g1931c6efd6a8 vs 6.5.0-rc7-g1931c6efd6a8 2023-08-31T17:21:17.696 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-31T17:21:17.696 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-31T17:21:18.697 DEBUG:teuthology.parallel:result is None 2023-08-31T17:23:27.675 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - BaseOS 117 kB/s | 47 MB 06:45 2023-08-31T17:23:34.791 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - Extras 42 kB/s | 18 kB 00:00 2023-08-31T17:23:35.416 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - Extras common packages 15 kB/s | 6.8 kB 00:00 2023-08-31T17:23:35.718 INFO:teuthology.orchestra.run.smithi146.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-08-31T17:23:36.536 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-08-31T17:23:40.277 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 392 kB/s | 24 kB 00:00 2023-08-31T17:23:44.035 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2023-08-31T17:23:44.036 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2023-08-31T17:23:44.036 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repo Size 2023-08-31T17:23:44.037 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2023-08-31T17:23:44.037 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2023-08-31T17:23:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-08-31T17:23:44.037 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T17:23:44.038 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2023-08-31T17:23:44.038 INFO:teuthology.orchestra.run.smithi146.stdout:================================================================================ 2023-08-31T17:23:44.038 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 1 Package 2023-08-31T17:23:44.038 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T17:23:44.039 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 286 M 2023-08-31T17:23:44.039 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2023-08-31T18:24:00.759 INFO:teuthology.orchestra.run.smithi146.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 81 kB/s | 286 MB 60:16 2023-08-31T18:24:00.788 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2023-08-31T18:24:00.788 INFO:teuthology.orchestra.run.smithi146.stdout:Total 81 kB/s | 286 MB 60:16 2023-08-31T18:24:02.454 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2023-08-31T18:24:02.616 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2023-08-31T18:24:02.616 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2023-08-31T18:24:04.444 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2023-08-31T18:24:04.478 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2023-08-31T18:24:23.306 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2023-08-31T18:24:23.649 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-08-31T18:24:23.860 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-31T18:24:24.099 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-31T18:24:24.099 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-08-31T18:24:24.848 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-31T18:24:24.848 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:24:24.849 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2023-08-31T18:24:24.849 INFO:teuthology.orchestra.run.smithi146.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-08-31T18:24:24.849 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:24:24.849 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2023-08-31T18:24:25.029 INFO:teuthology.task.kernel:Downloading kernel 1931c6efd6a83fb6675c4150c7cc812ef143433f on client.1... 2023-08-31T18:24:25.030 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1931c6efd6a83fb6675c4150c7cc812ef143433f 2023-08-31T18:24:25.268 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/1931c6efd6a83fb6675c4150c7cc812ef143433f/centos/8/flavors/default/x86_64/ 2023-08-31T18:24:25.268 DEBUG:teuthology.orchestra.run.smithi146:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_g1931c6efd6a8-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/1931c6efd6a83fb6675c4150c7cc812ef143433f/centos/8/flavors/default/x86_64/ --input-file=- 2023-08-31T18:24:25.271 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi146.front.sepia.ceph.com to complete... 2023-08-31T18:24:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31 18:24:44 URL:https://4.chacra.ceph.com/r/kernel/testing/1931c6efd6a83fb6675c4150c7cc812ef143433f/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_g1931c6efd6a8-1.x86_64.rpm [380759600/380759600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-31T18:24:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:FINISHED --2023-08-31 18:24:44-- 2023-08-31T18:24:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:Total wall clock time: 20s 2023-08-31T18:24:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:Downloaded: 1 files, 363M in 19s (18.8 MB/s) 2023-08-31T18:24:44.877 INFO:teuthology.task.kernel:Installing kernel 1931c6efd6a83fb6675c4150c7cc812ef143433f on client.1... 2023-08-31T18:24:44.877 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-31T18:24:46.541 INFO:teuthology.orchestra.run.smithi146.stdout:Verifying... ######################################## 2023-08-31T18:24:46.586 INFO:teuthology.orchestra.run.smithi146.stdout:Preparing... ######################################## 2023-08-31T18:24:46.695 INFO:teuthology.orchestra.run.smithi146.stdout:Updating / installing... 2023-08-31T18:25:24.672 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-6.5.0_rc7_g1931c6efd6a8-1 ######################################## 2023-08-31T18:25:47.508 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-31T18:25:47.509 DEBUG:teuthology.orchestra.run.smithi146:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-31T18:25:47.538 INFO:teuthology.orchestra.run.smithi146.stdout:/boot/System.map-6.5.0-rc7-g1931c6efd6a8 2023-08-31T18:25:47.538 INFO:teuthology.orchestra.run.smithi146.stdout:/boot/config-6.5.0-rc7-g1931c6efd6a8 2023-08-31T18:25:47.539 INFO:teuthology.orchestra.run.smithi146.stdout:/boot/vmlinuz-6.5.0-rc7-g1931c6efd6a8 2023-08-31T18:25:47.539 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8 2023-08-31T18:25:47.539 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel 2023-08-31T18:25:47.539 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch 2023-08-31T18:25:47.539 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86 2023-08-31T18:25:47.540 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto 2023-08-31T18:25:47.540 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-31T18:25:47.540 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-31T18:25:47.540 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-31T18:25:47.540 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-31T18:25:47.541 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-31T18:25:47.541 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-31T18:25:47.541 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-31T18:25:47.541 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-31T18:25:47.541 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-31T18:25:47.542 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-31T18:25:47.542 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-31T18:25:47.542 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-31T18:25:47.542 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-31T18:25:47.542 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-31T18:25:47.543 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-31T18:25:47.543 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-31T18:25:47.543 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-31T18:25:47.543 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-31T18:25:47.543 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-31T18:25:47.543 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-31T18:25:47.544 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kernel 2023-08-31T18:25:47.544 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kernel/cpu 2023-08-31T18:25:47.544 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kernel/cpu/mce 2023-08-31T18:25:47.544 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-31T18:25:47.544 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kvm 2023-08-31T18:25:47.545 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-31T18:25:47.545 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-31T18:25:47.545 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/arch/x86/kvm/kvm.ko 2023-08-31T18:25:47.545 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto 2023-08-31T18:25:47.545 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/ansi_cprng.ko 2023-08-31T18:25:47.546 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/anubis.ko 2023-08-31T18:25:47.546 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/arc4.ko 2023-08-31T18:25:47.546 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/async_tx 2023-08-31T18:25:47.546 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/async_tx/async_memcpy.ko 2023-08-31T18:25:47.547 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/async_tx/async_pq.ko 2023-08-31T18:25:47.547 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-31T18:25:47.547 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/async_tx/async_tx.ko 2023-08-31T18:25:47.547 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/async_tx/async_xor.ko 2023-08-31T18:25:47.548 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/async_tx/raid6test.ko 2023-08-31T18:25:47.548 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/authenc.ko 2023-08-31T18:25:47.548 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/authencesn.ko 2023-08-31T18:25:47.548 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/blake2b_generic.ko 2023-08-31T18:25:47.548 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/blowfish_common.ko 2023-08-31T18:25:47.549 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/blowfish_generic.ko 2023-08-31T18:25:47.549 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/camellia_generic.ko 2023-08-31T18:25:47.549 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/cast5_generic.ko 2023-08-31T18:25:47.550 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/cast6_generic.ko 2023-08-31T18:25:47.550 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/cast_common.ko 2023-08-31T18:25:47.550 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/ccm.ko 2023-08-31T18:25:47.551 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/cmac.ko 2023-08-31T18:25:47.551 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/crc32_generic.ko 2023-08-31T18:25:47.552 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/crypto_engine.ko 2023-08-31T18:25:47.552 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/crypto_user.ko 2023-08-31T18:25:47.552 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/cts.ko 2023-08-31T18:25:47.553 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/des_generic.ko 2023-08-31T18:25:47.553 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/dh_generic.ko 2023-08-31T18:25:47.553 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/echainiv.ko 2023-08-31T18:25:47.553 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/essiv.ko 2023-08-31T18:25:47.554 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/fcrypt.ko 2023-08-31T18:25:47.555 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/khazad.ko 2023-08-31T18:25:47.555 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/lz4.ko 2023-08-31T18:25:47.555 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/lz4hc.ko 2023-08-31T18:25:47.555 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/md4.ko 2023-08-31T18:25:47.556 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/michael_mic.ko 2023-08-31T18:25:47.556 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/pcbc.ko 2023-08-31T18:25:47.556 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/pcrypt.ko 2023-08-31T18:25:47.557 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/rmd160.ko 2023-08-31T18:25:47.557 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/seed.ko 2023-08-31T18:25:47.557 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/serpent_generic.ko 2023-08-31T18:25:47.558 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/tcrypt.ko 2023-08-31T18:25:47.558 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/tea.ko 2023-08-31T18:25:47.558 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/twofish_common.ko 2023-08-31T18:25:47.559 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/twofish_generic.ko 2023-08-31T18:25:47.559 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/vmac.ko 2023-08-31T18:25:47.560 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/wp512.ko 2023-08-31T18:25:47.560 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/xcbc.ko 2023-08-31T18:25:47.560 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/xor.ko 2023-08-31T18:25:47.560 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/crypto/xxhash_generic.ko 2023-08-31T18:25:47.561 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers 2023-08-31T18:25:47.561 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi 2023-08-31T18:25:47.561 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-31T18:25:47.562 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/acpi_pad.ko 2023-08-31T18:25:47.562 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/custom_method.ko 2023-08-31T18:25:47.562 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/ec_sys.ko 2023-08-31T18:25:47.563 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/platform_profile.ko 2023-08-31T18:25:47.563 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/sbs.ko 2023-08-31T18:25:47.563 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/sbshc.ko 2023-08-31T18:25:47.564 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/acpi/video.ko 2023-08-31T18:25:47.564 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata 2023-08-31T18:25:47.564 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/acard-ahci.ko 2023-08-31T18:25:47.564 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/ahci_platform.ko 2023-08-31T18:25:47.565 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/ata_generic.ko 2023-08-31T18:25:47.565 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/libahci_platform.ko 2023-08-31T18:25:47.565 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_acpi.ko 2023-08-31T18:25:47.565 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_ali.ko 2023-08-31T18:25:47.566 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_amd.ko 2023-08-31T18:25:47.569 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_artop.ko 2023-08-31T18:25:47.569 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_atiixp.ko 2023-08-31T18:25:47.570 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_atp867x.ko 2023-08-31T18:25:47.570 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_cmd640.ko 2023-08-31T18:25:47.570 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_cmd64x.ko 2023-08-31T18:25:47.571 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_cypress.ko 2023-08-31T18:25:47.571 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_efar.ko 2023-08-31T18:25:47.571 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_hpt366.ko 2023-08-31T18:25:47.572 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_hpt37x.ko 2023-08-31T18:25:47.572 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-31T18:25:47.572 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-31T18:25:47.572 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_it8213.ko 2023-08-31T18:25:47.573 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_it821x.ko 2023-08-31T18:25:47.573 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_jmicron.ko 2023-08-31T18:25:47.573 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_marvell.ko 2023-08-31T18:25:47.574 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_mpiix.ko 2023-08-31T18:25:47.574 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_netcell.ko 2023-08-31T18:25:47.574 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_ninja32.ko 2023-08-31T18:25:47.575 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_ns87410.ko 2023-08-31T18:25:47.575 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_ns87415.ko 2023-08-31T18:25:47.575 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_oldpiix.ko 2023-08-31T18:25:47.576 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_opti.ko 2023-08-31T18:25:47.576 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_optidma.ko 2023-08-31T18:25:47.576 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_pcmcia.ko 2023-08-31T18:25:47.576 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-31T18:25:47.577 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-31T18:25:47.577 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_piccolo.ko 2023-08-31T18:25:47.577 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_rdc.ko 2023-08-31T18:25:47.578 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_sch.ko 2023-08-31T18:25:47.578 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_serverworks.ko 2023-08-31T18:25:47.578 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_sil680.ko 2023-08-31T18:25:47.579 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_sis.ko 2023-08-31T18:25:47.580 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_sl82c105.ko 2023-08-31T18:25:47.580 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_triflex.ko 2023-08-31T18:25:47.580 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pata_via.ko 2023-08-31T18:25:47.581 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/pdc_adma.ko 2023-08-31T18:25:47.581 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_inic162x.ko 2023-08-31T18:25:47.581 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_mv.ko 2023-08-31T18:25:47.581 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_nv.ko 2023-08-31T18:25:47.582 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_promise.ko 2023-08-31T18:25:47.582 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_qstor.ko 2023-08-31T18:25:47.582 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_sil.ko 2023-08-31T18:25:47.582 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_sil24.ko 2023-08-31T18:25:47.582 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_sis.ko 2023-08-31T18:25:47.583 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_svw.ko 2023-08-31T18:25:47.583 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_sx4.ko 2023-08-31T18:25:47.583 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_uli.ko 2023-08-31T18:25:47.583 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_via.ko 2023-08-31T18:25:47.583 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ata/sata_vsc.ko 2023-08-31T18:25:47.584 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/auxdisplay 2023-08-31T18:25:47.584 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/auxdisplay/ks0108.ko 2023-08-31T18:25:47.584 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/base 2023-08-31T18:25:47.584 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/base/regmap 2023-08-31T18:25:47.584 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-31T18:25:47.585 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-31T18:25:47.585 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/bcma 2023-08-31T18:25:47.585 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/bcma/bcma.ko 2023-08-31T18:25:47.585 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block 2023-08-31T18:25:47.586 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/aoe 2023-08-31T18:25:47.586 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/aoe/aoe.ko 2023-08-31T18:25:47.586 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/brd.ko 2023-08-31T18:25:47.608 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/drbd 2023-08-31T18:25:47.609 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/drbd/drbd.ko 2023-08-31T18:25:47.609 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/floppy.ko 2023-08-31T18:25:47.609 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/loop.ko 2023-08-31T18:25:47.609 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/mtip32xx 2023-08-31T18:25:47.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-31T18:25:47.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/nbd.ko 2023-08-31T18:25:47.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/null_blk 2023-08-31T18:25:47.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/null_blk/null_blk.ko 2023-08-31T18:25:47.610 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/pktcdvd.ko 2023-08-31T18:25:47.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/rbd.ko 2023-08-31T18:25:47.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/virtio_blk.ko 2023-08-31T18:25:47.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/xen-blkback 2023-08-31T18:25:47.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-31T18:25:47.611 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/xen-blkfront.ko 2023-08-31T18:25:47.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/zram 2023-08-31T18:25:47.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/block/zram/zram.ko 2023-08-31T18:25:47.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char 2023-08-31T18:25:47.612 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/hangcheck-timer.ko 2023-08-31T18:25:47.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/hw_random 2023-08-31T18:25:47.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-31T18:25:47.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-31T18:25:47.613 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-31T18:25:47.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/hw_random/via-rng.ko 2023-08-31T18:25:47.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-31T18:25:47.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ipmi 2023-08-31T18:25:47.614 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-31T18:25:47.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-31T18:25:47.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-31T18:25:47.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-31T18:25:47.615 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-31T18:25:47.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-31T18:25:47.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/lp.ko 2023-08-31T18:25:47.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/mwave 2023-08-31T18:25:47.616 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/mwave/mwave.ko 2023-08-31T18:25:47.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/ppdev.ko 2023-08-31T18:25:47.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tlclk.ko 2023-08-31T18:25:47.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tpm 2023-08-31T18:25:47.617 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tpm/tpm.ko 2023-08-31T18:25:47.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-31T18:25:47.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-31T18:25:47.618 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-31T18:25:47.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-31T18:25:47.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-31T18:25:47.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/uv_mmtimer.ko 2023-08-31T18:25:47.619 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/char/virtio_console.ko 2023-08-31T18:25:47.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/cpufreq 2023-08-31T18:25:47.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-31T18:25:47.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-31T18:25:47.620 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-31T18:25:47.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-31T18:25:47.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-31T18:25:47.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-31T18:25:47.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto 2023-08-31T18:25:47.621 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/ccp 2023-08-31T18:25:47.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-31T18:25:47.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/ccp/ccp.ko 2023-08-31T18:25:47.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/intel 2023-08-31T18:25:47.622 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/intel/qat 2023-08-31T18:25:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/intel/qat/qat_common 2023-08-31T18:25:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-31T18:25:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-31T18:25:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-31T18:25:47.623 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/padlock-aes.ko 2023-08-31T18:25:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/padlock-sha.ko 2023-08-31T18:25:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/virtio 2023-08-31T18:25:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-31T18:25:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/dca 2023-08-31T18:25:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/dca/dca.ko 2023-08-31T18:25:47.624 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/devfreq 2023-08-31T18:25:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-31T18:25:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/dma 2023-08-31T18:25:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/dma/dw 2023-08-31T18:25:47.625 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-31T18:25:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/dma/ioat 2023-08-31T18:25:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-31T18:25:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac 2023-08-31T18:25:47.626 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/amd64_edac.ko 2023-08-31T18:25:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/e752x_edac.ko 2023-08-31T18:25:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/edac_mce_amd.ko 2023-08-31T18:25:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/i3000_edac.ko 2023-08-31T18:25:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/i3200_edac.ko 2023-08-31T18:25:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/i5100_edac.ko 2023-08-31T18:25:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/i5400_edac.ko 2023-08-31T18:25:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/i7300_edac.ko 2023-08-31T18:25:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/i7core_edac.ko 2023-08-31T18:25:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/i82975x_edac.ko 2023-08-31T18:25:47.628 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/ie31200_edac.ko 2023-08-31T18:25:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/sb_edac.ko 2023-08-31T18:25:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/edac/x38_edac.ko 2023-08-31T18:25:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/firmware 2023-08-31T18:25:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/firmware/edd.ko 2023-08-31T18:25:47.629 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-31T18:25:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/gpio 2023-08-31T18:25:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/gpio/gpio-ich.ko 2023-08-31T18:25:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-31T18:25:47.630 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid 2023-08-31T18:25:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-appleir.ko 2023-08-31T18:25:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-aureal.ko 2023-08-31T18:25:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-axff.ko 2023-08-31T18:25:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-dr.ko 2023-08-31T18:25:47.631 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-elecom.ko 2023-08-31T18:25:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-elo.ko 2023-08-31T18:25:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-emsff.ko 2023-08-31T18:25:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-gaff.ko 2023-08-31T18:25:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-gt683r.ko 2023-08-31T18:25:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-gyration.ko 2023-08-31T18:25:47.632 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-31T18:25:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-31T18:25:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-holtekff.ko 2023-08-31T18:25:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-hyperv.ko 2023-08-31T18:25:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-icade.ko 2023-08-31T18:25:47.633 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-keytouch.ko 2023-08-31T18:25:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-kye.ko 2023-08-31T18:25:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-lcpower.ko 2023-08-31T18:25:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-led.ko 2023-08-31T18:25:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-lenovo.ko 2023-08-31T18:25:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-31T18:25:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-31T18:25:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-multitouch.ko 2023-08-31T18:25:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-ortek.ko 2023-08-31T18:25:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-penmount.ko 2023-08-31T18:25:47.635 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-petalynx.ko 2023-08-31T18:25:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-picolcd.ko 2023-08-31T18:25:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-pl.ko 2023-08-31T18:25:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-plantronics.ko 2023-08-31T18:25:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-primax.ko 2023-08-31T18:25:47.636 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-rmi.ko 2023-08-31T18:25:47.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-31T18:25:47.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-common.ko 2023-08-31T18:25:47.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-31T18:25:47.637 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-31T18:25:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-31T18:25:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-31T18:25:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-31T18:25:47.638 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-31T18:25:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-31T18:25:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-31T18:25:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-31T18:25:47.639 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-roccat.ko 2023-08-31T18:25:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-saitek.ko 2023-08-31T18:25:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-samsung.ko 2023-08-31T18:25:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-31T18:25:47.640 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-sjoy.ko 2023-08-31T18:25:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-sony.ko 2023-08-31T18:25:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-speedlink.ko 2023-08-31T18:25:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-steelseries.ko 2023-08-31T18:25:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-sunplus.ko 2023-08-31T18:25:47.641 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-31T18:25:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-tivo.ko 2023-08-31T18:25:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-tmff.ko 2023-08-31T18:25:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-topseed.ko 2023-08-31T18:25:47.642 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-twinhan.ko 2023-08-31T18:25:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-uclogic.ko 2023-08-31T18:25:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-waltop.ko 2023-08-31T18:25:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-wiimote.ko 2023-08-31T18:25:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-xinmo.ko 2023-08-31T18:25:47.643 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-zpff.ko 2023-08-31T18:25:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/hid-zydacron.ko 2023-08-31T18:25:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/uhid.ko 2023-08-31T18:25:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hid/wacom.ko 2023-08-31T18:25:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hv 2023-08-31T18:25:47.644 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hv/hv_balloon.ko 2023-08-31T18:25:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hv/hv_utils.ko 2023-08-31T18:25:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hv/hv_vmbus.ko 2023-08-31T18:25:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon 2023-08-31T18:25:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/abituguru.ko 2023-08-31T18:25:47.645 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/abituguru3.ko 2023-08-31T18:25:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-31T18:25:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ad7414.ko 2023-08-31T18:25:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ad7418.ko 2023-08-31T18:25:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adc128d818.ko 2023-08-31T18:25:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adm1025.ko 2023-08-31T18:25:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adm1026.ko 2023-08-31T18:25:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adm1029.ko 2023-08-31T18:25:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adm1031.ko 2023-08-31T18:25:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adm9240.ko 2023-08-31T18:25:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ads7828.ko 2023-08-31T18:25:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adt7410.ko 2023-08-31T18:25:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adt7411.ko 2023-08-31T18:25:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adt7462.ko 2023-08-31T18:25:47.648 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adt7470.ko 2023-08-31T18:25:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adt7475.ko 2023-08-31T18:25:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/adt7x10.ko 2023-08-31T18:25:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/amc6821.ko 2023-08-31T18:25:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/applesmc.ko 2023-08-31T18:25:47.649 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/asb100.ko 2023-08-31T18:25:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/asc7621.ko 2023-08-31T18:25:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-31T18:25:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/atxp1.ko 2023-08-31T18:25:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/coretemp.ko 2023-08-31T18:25:47.650 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-31T18:25:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/dme1737.ko 2023-08-31T18:25:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ds1621.ko 2023-08-31T18:25:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ds620.ko 2023-08-31T18:25:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/emc1403.ko 2023-08-31T18:25:47.651 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/emc6w201.ko 2023-08-31T18:25:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/f71805f.ko 2023-08-31T18:25:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/f71882fg.ko 2023-08-31T18:25:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/f75375s.ko 2023-08-31T18:25:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/fam15h_power.ko 2023-08-31T18:25:47.652 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/fschmd.ko 2023-08-31T18:25:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/g760a.ko 2023-08-31T18:25:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/g762.ko 2023-08-31T18:25:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/gl518sm.ko 2023-08-31T18:25:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/gl520sm.ko 2023-08-31T18:25:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-31T18:25:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/i5500_temp.ko 2023-08-31T18:25:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/i5k_amb.ko 2023-08-31T18:25:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ibmaem.ko 2023-08-31T18:25:47.654 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ibmpex.ko 2023-08-31T18:25:47.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ina209.ko 2023-08-31T18:25:47.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ina2xx.ko 2023-08-31T18:25:47.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/it87.ko 2023-08-31T18:25:47.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/k10temp.ko 2023-08-31T18:25:47.655 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/k8temp.ko 2023-08-31T18:25:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lineage-pem.ko 2023-08-31T18:25:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm63.ko 2023-08-31T18:25:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm73.ko 2023-08-31T18:25:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm75.ko 2023-08-31T18:25:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm77.ko 2023-08-31T18:25:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm78.ko 2023-08-31T18:25:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm80.ko 2023-08-31T18:25:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm83.ko 2023-08-31T18:25:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm85.ko 2023-08-31T18:25:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm87.ko 2023-08-31T18:25:47.657 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm90.ko 2023-08-31T18:25:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm92.ko 2023-08-31T18:25:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm93.ko 2023-08-31T18:25:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm95234.ko 2023-08-31T18:25:47.658 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm95241.ko 2023-08-31T18:25:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/lm95245.ko 2023-08-31T18:25:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ltc2945.ko 2023-08-31T18:25:47.659 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ltc4151.ko 2023-08-31T18:25:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ltc4215.ko 2023-08-31T18:25:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ltc4222.ko 2023-08-31T18:25:47.660 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ltc4245.ko 2023-08-31T18:25:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ltc4260.ko 2023-08-31T18:25:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/ltc4261.ko 2023-08-31T18:25:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/max16065.ko 2023-08-31T18:25:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/max1619.ko 2023-08-31T18:25:47.661 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/max1668.ko 2023-08-31T18:25:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/max197.ko 2023-08-31T18:25:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/max6639.ko 2023-08-31T18:25:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/max6650.ko 2023-08-31T18:25:47.662 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/max6697.ko 2023-08-31T18:25:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/mcp3021.ko 2023-08-31T18:25:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/nct6683.ko 2023-08-31T18:25:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/nct6775-core.ko 2023-08-31T18:25:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/nct6775.ko 2023-08-31T18:25:47.663 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/nct7802.ko 2023-08-31T18:25:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pc87360.ko 2023-08-31T18:25:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pc87427.ko 2023-08-31T18:25:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pcf8591.ko 2023-08-31T18:25:47.664 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus 2023-08-31T18:25:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-31T18:25:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-31T18:25:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-31T18:25:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-31T18:25:47.665 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-31T18:25:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-31T18:25:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-31T18:25:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-31T18:25:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-31T18:25:47.666 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-31T18:25:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-31T18:25:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-31T18:25:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/powr1220.ko 2023-08-31T18:25:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/sch5627.ko 2023-08-31T18:25:47.667 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/sch5636.ko 2023-08-31T18:25:47.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-31T18:25:47.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/sht15.ko 2023-08-31T18:25:47.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/sht21.ko 2023-08-31T18:25:47.668 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/shtc1.ko 2023-08-31T18:25:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/sis5595.ko 2023-08-31T18:25:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/smsc47b397.ko 2023-08-31T18:25:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/smsc47m1.ko 2023-08-31T18:25:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/smsc47m192.ko 2023-08-31T18:25:47.669 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/thmc50.ko 2023-08-31T18:25:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/tmp102.ko 2023-08-31T18:25:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/tmp103.ko 2023-08-31T18:25:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/tmp401.ko 2023-08-31T18:25:47.670 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/tmp421.ko 2023-08-31T18:25:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/via-cputemp.ko 2023-08-31T18:25:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/via686a.ko 2023-08-31T18:25:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/vt1211.ko 2023-08-31T18:25:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/vt8231.ko 2023-08-31T18:25:47.671 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83627ehf.ko 2023-08-31T18:25:47.672 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83627hf.ko 2023-08-31T18:25:47.672 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83781d.ko 2023-08-31T18:25:47.672 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83791d.ko 2023-08-31T18:25:47.672 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83792d.ko 2023-08-31T18:25:47.672 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83793.ko 2023-08-31T18:25:47.673 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83795.ko 2023-08-31T18:25:47.673 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83l785ts.ko 2023-08-31T18:25:47.673 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/hwmon/w83l786ng.ko 2023-08-31T18:25:47.673 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c 2023-08-31T18:25:47.673 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/algos 2023-08-31T18:25:47.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-31T18:25:47.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-31T18:25:47.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses 2023-08-31T18:25:47.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-31T18:25:47.674 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-31T18:25:47.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-31T18:25:47.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-31T18:25:47.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-31T18:25:47.675 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-31T18:25:47.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-31T18:25:47.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-31T18:25:47.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-31T18:25:47.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-31T18:25:47.676 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-31T18:25:47.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-31T18:25:47.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-31T18:25:47.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-31T18:25:47.677 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-31T18:25:47.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-31T18:25:47.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-31T18:25:47.678 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-31T18:25:47.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-31T18:25:47.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-31T18:25:47.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-31T18:25:47.679 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-31T18:25:47.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-31T18:25:47.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/i2c-dev.ko 2023-08-31T18:25:47.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/i2c-mux.ko 2023-08-31T18:25:47.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-31T18:25:47.680 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/i2c-smbus.ko 2023-08-31T18:25:47.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/i2c/i2c-stub.ko 2023-08-31T18:25:47.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband 2023-08-31T18:25:47.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core 2023-08-31T18:25:47.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-31T18:25:47.681 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core/ib_core.ko 2023-08-31T18:25:47.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-31T18:25:47.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-31T18:25:47.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-31T18:25:47.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-31T18:25:47.682 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-31T18:25:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw 2023-08-31T18:25:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/cxgb4 2023-08-31T18:25:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-31T18:25:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/mlx4 2023-08-31T18:25:47.683 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-31T18:25:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/mlx5 2023-08-31T18:25:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-31T18:25:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/mthca 2023-08-31T18:25:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-31T18:25:47.684 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp 2023-08-31T18:25:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/ipoib 2023-08-31T18:25:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-31T18:25:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/iser 2023-08-31T18:25:47.685 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-31T18:25:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/isert 2023-08-31T18:25:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-31T18:25:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/srp 2023-08-31T18:25:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-31T18:25:47.686 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/srpt 2023-08-31T18:25:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-31T18:25:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input 2023-08-31T18:25:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/gameport 2023-08-31T18:25:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-31T18:25:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-31T18:25:47.687 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/gameport/gameport.ko 2023-08-31T18:25:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/gameport/lightning.ko 2023-08-31T18:25:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/gameport/ns558.ko 2023-08-31T18:25:47.688 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/joydev.ko 2023-08-31T18:25:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/keyboard 2023-08-31T18:25:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-31T18:25:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse 2023-08-31T18:25:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/appletouch.ko 2023-08-31T18:25:47.689 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/bcm5974.ko 2023-08-31T18:25:47.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/cyapatp.ko 2023-08-31T18:25:47.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-31T18:25:47.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/sermouse.ko 2023-08-31T18:25:47.690 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-31T18:25:47.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-31T18:25:47.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-31T18:25:47.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/rmi4 2023-08-31T18:25:47.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-31T18:25:47.691 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/serio 2023-08-31T18:25:47.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/serio/altera_ps2.ko 2023-08-31T18:25:47.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/serio/arc_ps2.ko 2023-08-31T18:25:47.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-31T18:25:47.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/serio/serio_raw.ko 2023-08-31T18:25:47.692 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/input/sparse-keymap.ko 2023-08-31T18:25:47.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/iommu 2023-08-31T18:25:47.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/iommu/amd 2023-08-31T18:25:47.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-31T18:25:47.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds 2023-08-31T18:25:47.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/leds-blinkm.ko 2023-08-31T18:25:47.693 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/leds-lm3530.ko 2023-08-31T18:25:47.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/leds-lp3944.ko 2023-08-31T18:25:47.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/leds-ss4200.ko 2023-08-31T18:25:47.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger 2023-08-31T18:25:47.694 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-31T18:25:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-31T18:25:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-31T18:25:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-31T18:25:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-31T18:25:47.695 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-31T18:25:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-31T18:25:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-31T18:25:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md 2023-08-31T18:25:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/bcache 2023-08-31T18:25:47.696 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/bcache/bcache.ko 2023-08-31T18:25:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-bio-prison.ko 2023-08-31T18:25:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-cache-smq.ko 2023-08-31T18:25:47.697 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-cache.ko 2023-08-31T18:25:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-crypt.ko 2023-08-31T18:25:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-delay.ko 2023-08-31T18:25:47.698 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-flakey.ko 2023-08-31T18:25:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-log-userspace.ko 2023-08-31T18:25:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-multipath.ko 2023-08-31T18:25:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-queue-length.ko 2023-08-31T18:25:47.699 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-raid.ko 2023-08-31T18:25:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-round-robin.ko 2023-08-31T18:25:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-service-time.ko 2023-08-31T18:25:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-switch.ko 2023-08-31T18:25:47.700 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-thin-pool.ko 2023-08-31T18:25:47.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/dm-verity.ko 2023-08-31T18:25:47.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/faulty.ko 2023-08-31T18:25:47.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/linear.ko 2023-08-31T18:25:47.701 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/multipath.ko 2023-08-31T18:25:47.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/persistent-data 2023-08-31T18:25:47.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-31T18:25:47.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/raid0.ko 2023-08-31T18:25:47.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/raid1.ko 2023-08-31T18:25:47.702 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/raid10.ko 2023-08-31T18:25:47.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/md/raid456.ko 2023-08-31T18:25:47.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message 2023-08-31T18:25:47.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion 2023-08-31T18:25:47.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion/mptbase.ko 2023-08-31T18:25:47.703 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion/mptctl.ko 2023-08-31T18:25:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion/mptfc.ko 2023-08-31T18:25:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion/mptlan.ko 2023-08-31T18:25:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion/mptsas.ko 2023-08-31T18:25:47.704 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion/mptscsih.ko 2023-08-31T18:25:47.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/message/fusion/mptspi.ko 2023-08-31T18:25:47.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd 2023-08-31T18:25:47.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd/lpc_ich.ko 2023-08-31T18:25:47.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd/lpc_sch.ko 2023-08-31T18:25:47.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd/mfd-core.ko 2023-08-31T18:25:47.705 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd/sm501.ko 2023-08-31T18:25:47.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd/viperboard.ko 2023-08-31T18:25:47.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd/vx855.ko 2023-08-31T18:25:47.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/mfd/wl1273-core.ko 2023-08-31T18:25:47.706 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc 2023-08-31T18:25:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/altera-stapl 2023-08-31T18:25:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-31T18:25:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/apds9802als.ko 2023-08-31T18:25:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/apds990x.ko 2023-08-31T18:25:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/bh1770glc.ko 2023-08-31T18:25:47.707 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/cb710 2023-08-31T18:25:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/cb710/cb710.ko 2023-08-31T18:25:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/eeprom 2023-08-31T18:25:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/eeprom/at24.ko 2023-08-31T18:25:47.708 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-31T18:25:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-31T18:25:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/eeprom/max6875.ko 2023-08-31T18:25:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/enclosure.ko 2023-08-31T18:25:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/hpilo.ko 2023-08-31T18:25:47.709 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/isl29003.ko 2023-08-31T18:25:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/isl29020.ko 2023-08-31T18:25:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/lis3lv02d 2023-08-31T18:25:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-31T18:25:47.710 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-31T18:25:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/mei 2023-08-31T18:25:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/mei/mei-me.ko 2023-08-31T18:25:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/mei/mei-txe.ko 2023-08-31T18:25:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/mei/mei.ko 2023-08-31T18:25:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/sgi-gru 2023-08-31T18:25:47.711 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-31T18:25:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/sgi-xp 2023-08-31T18:25:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-31T18:25:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-31T18:25:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-31T18:25:47.712 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/tifm_7xx1.ko 2023-08-31T18:25:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/tifm_core.ko 2023-08-31T18:25:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/tsl2550.ko 2023-08-31T18:25:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/vmw_balloon.ko 2023-08-31T18:25:47.713 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/vmw_vmci 2023-08-31T18:25:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-31T18:25:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net 2023-08-31T18:25:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/bonding 2023-08-31T18:25:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/bonding/bonding.ko 2023-08-31T18:25:47.714 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dsa 2023-08-31T18:25:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dsa/b53 2023-08-31T18:25:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-31T18:25:47.715 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-31T18:25:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-31T18:25:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dsa/mv88e6xxx 2023-08-31T18:25:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-31T18:25:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/dummy.ko 2023-08-31T18:25:47.716 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/eql.ko 2023-08-31T18:25:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet 2023-08-31T18:25:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/3com 2023-08-31T18:25:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-31T18:25:47.717 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-31T18:25:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-31T18:25:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-31T18:25:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/8390 2023-08-31T18:25:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-31T18:25:47.718 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-31T18:25:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-31T18:25:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-31T18:25:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/adaptec 2023-08-31T18:25:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-31T18:25:47.719 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/agere 2023-08-31T18:25:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-31T18:25:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/alteon 2023-08-31T18:25:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-31T18:25:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/altera 2023-08-31T18:25:47.720 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-31T18:25:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/amd 2023-08-31T18:25:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-31T18:25:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-31T18:25:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-31T18:25:47.721 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros 2023-08-31T18:25:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/alx 2023-08-31T18:25:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-31T18:25:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-31T18:25:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-31T18:25:47.722 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-31T18:25:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-31T18:25:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/atlx 2023-08-31T18:25:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-31T18:25:47.723 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-31T18:25:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom 2023-08-31T18:25:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-31T18:25:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-31T18:25:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-31T18:25:47.724 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-31T18:25:47.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-31T18:25:47.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/genet 2023-08-31T18:25:47.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-31T18:25:47.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-31T18:25:47.725 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/brocade 2023-08-31T18:25:47.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/brocade/bna 2023-08-31T18:25:47.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-31T18:25:47.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio 2023-08-31T18:25:47.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-31T18:25:47.726 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-31T18:25:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-31T18:25:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-31T18:25:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-31T18:25:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-31T18:25:47.727 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-31T18:25:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-31T18:25:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-31T18:25:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-31T18:25:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/cisco 2023-08-31T18:25:47.728 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/cisco/enic 2023-08-31T18:25:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-31T18:25:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec 2023-08-31T18:25:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec/tulip 2023-08-31T18:25:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-31T18:25:47.729 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-31T18:25:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-31T18:25:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-31T18:25:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-31T18:25:47.730 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-31T18:25:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dlink 2023-08-31T18:25:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-31T18:25:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-31T18:25:47.731 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/dnet.ko 2023-08-31T18:25:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/emulex 2023-08-31T18:25:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/emulex/benet 2023-08-31T18:25:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-31T18:25:47.732 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/ethoc.ko 2023-08-31T18:25:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/fealnx.ko 2023-08-31T18:25:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel 2023-08-31T18:25:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-31T18:25:47.733 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/e1000 2023-08-31T18:25:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-31T18:25:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/e1000e 2023-08-31T18:25:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-31T18:25:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/fm10k 2023-08-31T18:25:47.734 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-31T18:25:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/i40e 2023-08-31T18:25:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-31T18:25:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/iavf 2023-08-31T18:25:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-31T18:25:47.735 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/igb 2023-08-31T18:25:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-31T18:25:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/igbvf 2023-08-31T18:25:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-31T18:25:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-31T18:25:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-31T18:25:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-31T18:25:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-31T18:25:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/jme.ko 2023-08-31T18:25:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/marvell 2023-08-31T18:25:47.737 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-31T18:25:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-31T18:25:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-31T18:25:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/mellanox 2023-08-31T18:25:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-31T18:25:47.738 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-31T18:25:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-31T18:25:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-31T18:25:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-31T18:25:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-31T18:25:47.739 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/micrel 2023-08-31T18:25:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-31T18:25:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/myricom 2023-08-31T18:25:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-31T18:25:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-31T18:25:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/natsemi 2023-08-31T18:25:47.740 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-31T18:25:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-31T18:25:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/neterion 2023-08-31T18:25:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-31T18:25:47.741 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/nvidia 2023-08-31T18:25:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-31T18:25:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/packetengines 2023-08-31T18:25:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-31T18:25:47.742 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-31T18:25:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/qlogic 2023-08-31T18:25:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-31T18:25:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-31T18:25:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-31T18:25:47.743 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-31T18:25:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-31T18:25:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/rdc 2023-08-31T18:25:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-31T18:25:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/realtek 2023-08-31T18:25:47.744 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-31T18:25:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-31T18:25:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-31T18:25:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-31T18:25:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/rocker 2023-08-31T18:25:47.745 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-31T18:25:47.746 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sfc 2023-08-31T18:25:47.746 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-31T18:25:47.746 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/silan 2023-08-31T18:25:47.746 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-31T18:25:47.746 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sis 2023-08-31T18:25:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-31T18:25:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-31T18:25:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/smsc 2023-08-31T18:25:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-31T18:25:47.747 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-31T18:25:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-31T18:25:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-31T18:25:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/stmicro 2023-08-31T18:25:47.748 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-31T18:25:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-31T18:25:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-31T18:25:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sun 2023-08-31T18:25:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-31T18:25:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-31T18:25:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-31T18:25:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-31T18:25:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/tehuti 2023-08-31T18:25:47.750 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-31T18:25:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/ti 2023-08-31T18:25:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-31T18:25:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/via 2023-08-31T18:25:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-31T18:25:47.751 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-31T18:25:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/wiznet 2023-08-31T18:25:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-31T18:25:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-31T18:25:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/xircom 2023-08-31T18:25:47.752 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-31T18:25:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/geneve.ko 2023-08-31T18:25:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/hyperv 2023-08-31T18:25:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-31T18:25:47.753 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ieee802154 2023-08-31T18:25:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-31T18:25:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ifb.ko 2023-08-31T18:25:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ipvlan 2023-08-31T18:25:47.754 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-31T18:25:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/macvlan.ko 2023-08-31T18:25:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/macvtap.ko 2023-08-31T18:25:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/mdio 2023-08-31T18:25:47.755 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/mdio.ko 2023-08-31T18:25:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-31T18:25:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-31T18:25:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-31T18:25:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/mii.ko 2023-08-31T18:25:47.756 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/net_failover.ko 2023-08-31T18:25:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/netconsole.ko 2023-08-31T18:25:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/nlmon.ko 2023-08-31T18:25:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/pcs 2023-08-31T18:25:47.757 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-31T18:25:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-31T18:25:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy 2023-08-31T18:25:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/amd.ko 2023-08-31T18:25:47.758 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-31T18:25:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-31T18:25:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-31T18:25:47.759 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/bcm87xx.ko 2023-08-31T18:25:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/broadcom.ko 2023-08-31T18:25:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/cicada.ko 2023-08-31T18:25:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/davicom.ko 2023-08-31T18:25:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/dp83640.ko 2023-08-31T18:25:47.760 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/et1011c.ko 2023-08-31T18:25:47.761 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/icplus.ko 2023-08-31T18:25:47.761 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/lxt.ko 2023-08-31T18:25:47.761 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/marvell.ko 2023-08-31T18:25:47.761 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/micrel.ko 2023-08-31T18:25:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/national.ko 2023-08-31T18:25:47.762 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/phylink.ko 2023-08-31T18:25:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/qsemi.ko 2023-08-31T18:25:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/realtek.ko 2023-08-31T18:25:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/smsc.ko 2023-08-31T18:25:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/ste10Xp.ko 2023-08-31T18:25:47.763 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/phy/vitesse.ko 2023-08-31T18:25:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp 2023-08-31T18:25:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-31T18:25:47.764 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/ppp_async.ko 2023-08-31T18:25:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-31T18:25:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-31T18:25:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-31T18:25:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-31T18:25:47.765 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/pppoe.ko 2023-08-31T18:25:47.766 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/pppox.ko 2023-08-31T18:25:47.766 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/ppp/pptp.ko 2023-08-31T18:25:47.766 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/slip 2023-08-31T18:25:47.766 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/slip/slhc.ko 2023-08-31T18:25:47.766 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/slip/slip.ko 2023-08-31T18:25:47.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/sungem_phy.ko 2023-08-31T18:25:47.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/tap.ko 2023-08-31T18:25:47.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/team 2023-08-31T18:25:47.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/team/team.ko 2023-08-31T18:25:47.767 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-31T18:25:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-31T18:25:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-31T18:25:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/team/team_mode_random.ko 2023-08-31T18:25:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-31T18:25:47.768 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/tun.ko 2023-08-31T18:25:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/veth.ko 2023-08-31T18:25:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/virtio_net.ko 2023-08-31T18:25:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/vmxnet3 2023-08-31T18:25:47.769 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-31T18:25:47.770 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/vxlan 2023-08-31T18:25:47.770 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/vxlan/vxlan.ko 2023-08-31T18:25:47.770 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/xen-netback 2023-08-31T18:25:47.774 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-31T18:25:47.774 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/net/xen-netfront.ko 2023-08-31T18:25:47.774 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ntb 2023-08-31T18:25:47.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ntb/ntb.ko 2023-08-31T18:25:47.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/nvme 2023-08-31T18:25:47.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/nvme/host 2023-08-31T18:25:47.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/nvme/host/nvme-core.ko 2023-08-31T18:25:47.775 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/nvme/host/nvme.ko 2023-08-31T18:25:47.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/parport 2023-08-31T18:25:47.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/parport/parport.ko 2023-08-31T18:25:47.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/parport/parport_cs.ko 2023-08-31T18:25:47.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/parport/parport_pc.ko 2023-08-31T18:25:47.776 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/parport/parport_serial.ko 2023-08-31T18:25:47.777 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pci 2023-08-31T18:25:47.777 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pci/hotplug 2023-08-31T18:25:47.777 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-31T18:25:47.777 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pci/pcie 2023-08-31T18:25:47.777 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-31T18:25:47.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pci/xen-pcifront.ko 2023-08-31T18:25:47.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pcmcia 2023-08-31T18:25:47.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pcmcia/i82092.ko 2023-08-31T18:25:47.778 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pcmcia/pd6729.ko 2023-08-31T18:25:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-31T18:25:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pinctrl 2023-08-31T18:25:47.779 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pinctrl/intel 2023-08-31T18:25:47.780 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-31T18:25:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform 2023-08-31T18:25:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86 2023-08-31T18:25:47.781 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-31T18:25:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/acerhdf.ko 2023-08-31T18:25:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-31T18:25:47.782 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-31T18:25:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-31T18:25:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-31T18:25:47.783 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-31T18:25:47.784 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-31T18:25:47.784 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-31T18:25:47.784 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-31T18:25:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-31T18:25:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/hdaps.ko 2023-08-31T18:25:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/intel 2023-08-31T18:25:47.785 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-31T18:25:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/intel_ips.ko 2023-08-31T18:25:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-31T18:25:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-31T18:25:47.786 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-31T18:25:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-31T18:25:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-31T18:25:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-31T18:25:47.787 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-31T18:25:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-31T18:25:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-31T18:25:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/platform/x86/wmi.ko 2023-08-31T18:25:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/powercap 2023-08-31T18:25:47.788 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-31T18:25:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-31T18:25:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pps 2023-08-31T18:25:47.789 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pps/clients 2023-08-31T18:25:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-31T18:25:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-31T18:25:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pps/clients/pps_parport.ko 2023-08-31T18:25:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/pps/pps_core.ko 2023-08-31T18:25:47.790 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ptp 2023-08-31T18:25:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ptp/ptp.ko 2023-08-31T18:25:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ptp/ptp_kvm.ko 2023-08-31T18:25:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc 2023-08-31T18:25:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-31T18:25:47.791 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-31T18:25:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-31T18:25:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-31T18:25:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-31T18:25:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-31T18:25:47.792 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-31T18:25:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-31T18:25:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-31T18:25:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-31T18:25:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-31T18:25:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-em3027.ko 2023-08-31T18:25:47.793 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-31T18:25:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-31T18:25:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-31T18:25:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-31T18:25:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-31T18:25:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-31T18:25:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-max6900.ko 2023-08-31T18:25:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-31T18:25:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-31T18:25:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-31T18:25:47.795 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-31T18:25:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-31T18:25:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-31T18:25:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-31T18:25:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-31T18:25:47.796 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-31T18:25:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-31T18:25:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-31T18:25:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-31T18:25:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/rtc/rtc-x1205.ko 2023-08-31T18:25:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi 2023-08-31T18:25:47.797 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/3w-9xxx.ko 2023-08-31T18:25:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/3w-sas.ko 2023-08-31T18:25:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/3w-xxxx.ko 2023-08-31T18:25:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/BusLogic.ko 2023-08-31T18:25:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/a100u2w.ko 2023-08-31T18:25:47.798 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/aacraid 2023-08-31T18:25:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-31T18:25:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/advansys.ko 2023-08-31T18:25:47.799 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/aic7xxx 2023-08-31T18:25:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-31T18:25:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-31T18:25:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/am53c974.ko 2023-08-31T18:25:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/arcmsr 2023-08-31T18:25:47.800 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-31T18:25:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/atp870u.ko 2023-08-31T18:25:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/be2iscsi 2023-08-31T18:25:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-31T18:25:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/bfa 2023-08-31T18:25:47.801 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/bfa/bfa.ko 2023-08-31T18:25:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/bnx2fc 2023-08-31T18:25:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-31T18:25:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/bnx2i 2023-08-31T18:25:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-31T18:25:47.802 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/ch.ko 2023-08-31T18:25:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/csiostor 2023-08-31T18:25:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-31T18:25:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/cxgbi 2023-08-31T18:25:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-31T18:25:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-31T18:25:47.803 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-31T18:25:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-31T18:25:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-31T18:25:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/dc395x.ko 2023-08-31T18:25:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/device_handler 2023-08-31T18:25:47.804 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-31T18:25:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-31T18:25:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-31T18:25:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-31T18:25:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/dmx3191d.ko 2023-08-31T18:25:47.805 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/esas2r 2023-08-31T18:25:47.806 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-31T18:25:47.806 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/esp_scsi.ko 2023-08-31T18:25:47.806 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/fcoe 2023-08-31T18:25:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-31T18:25:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-31T18:25:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/fnic 2023-08-31T18:25:47.807 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/fnic/fnic.ko 2023-08-31T18:25:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/hpsa.ko 2023-08-31T18:25:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/hptiop.ko 2023-08-31T18:25:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/hv_storvsc.ko 2023-08-31T18:25:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/initio.ko 2023-08-31T18:25:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/ipr.ko 2023-08-31T18:25:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/ips.ko 2023-08-31T18:25:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/isci 2023-08-31T18:25:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/isci/isci.ko 2023-08-31T18:25:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-31T18:25:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-31T18:25:47.809 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/libfc 2023-08-31T18:25:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/libfc/libfc.ko 2023-08-31T18:25:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/libiscsi.ko 2023-08-31T18:25:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-31T18:25:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/libsas 2023-08-31T18:25:47.810 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/libsas/libsas.ko 2023-08-31T18:25:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/lpfc 2023-08-31T18:25:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-31T18:25:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/megaraid 2023-08-31T18:25:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/megaraid.ko 2023-08-31T18:25:47.811 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-31T18:25:47.812 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-31T18:25:47.812 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-31T18:25:47.812 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/mpt3sas 2023-08-31T18:25:47.812 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-31T18:25:47.812 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/mvsas 2023-08-31T18:25:47.813 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-31T18:25:47.813 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/mvumi.ko 2023-08-31T18:25:47.813 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/pm8001 2023-08-31T18:25:47.813 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-31T18:25:47.813 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/pmcraid.ko 2023-08-31T18:25:47.813 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/qla1280.ko 2023-08-31T18:25:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/qla2xxx 2023-08-31T18:25:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-31T18:25:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-31T18:25:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/qla4xxx 2023-08-31T18:25:47.814 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-31T18:25:47.815 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/raid_class.ko 2023-08-31T18:25:47.815 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/scsi_debug.ko 2023-08-31T18:25:47.815 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-31T18:25:47.815 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-31T18:25:47.815 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-31T18:25:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-31T18:25:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-31T18:25:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/ses.ko 2023-08-31T18:25:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/st.ko 2023-08-31T18:25:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/stex.ko 2023-08-31T18:25:47.816 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/sym53c8xx_2 2023-08-31T18:25:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-31T18:25:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/virtio_scsi.ko 2023-08-31T18:25:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-31T18:25:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/scsi/wd719x.ko 2023-08-31T18:25:47.817 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ssb 2023-08-31T18:25:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ssb/ssb.ko 2023-08-31T18:25:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target 2023-08-31T18:25:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/iscsi 2023-08-31T18:25:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-31T18:25:47.818 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/loopback 2023-08-31T18:25:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-31T18:25:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/target_core_file.ko 2023-08-31T18:25:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/target_core_iblock.ko 2023-08-31T18:25:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/target_core_mod.ko 2023-08-31T18:25:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/target_core_pscsi.ko 2023-08-31T18:25:47.819 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/target_core_user.ko 2023-08-31T18:25:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/tcm_fc 2023-08-31T18:25:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-31T18:25:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal 2023-08-31T18:25:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel 2023-08-31T18:25:47.820 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal 2023-08-31T18:25:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-31T18:25:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-31T18:25:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-31T18:25:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-31T18:25:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-31T18:25:47.821 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-31T18:25:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-31T18:25:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-31T18:25:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-31T18:25:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-31T18:25:47.822 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-31T18:25:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-31T18:25:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-31T18:25:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-31T18:25:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-31T18:25:47.823 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty 2023-08-31T18:25:47.824 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/ipwireless 2023-08-31T18:25:47.824 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-31T18:25:47.824 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/n_gsm.ko 2023-08-31T18:25:47.824 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/n_hdlc.ko 2023-08-31T18:25:47.824 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/nozomi.ko 2023-08-31T18:25:47.824 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/serial 2023-08-31T18:25:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/serial/8250 2023-08-31T18:25:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-31T18:25:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/serial/arc_uart.ko 2023-08-31T18:25:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/serial/jsm 2023-08-31T18:25:47.825 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-31T18:25:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/tty/synclink_gt.ko 2023-08-31T18:25:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ufs 2023-08-31T18:25:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ufs/core 2023-08-31T18:25:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-31T18:25:47.826 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ufs/host 2023-08-31T18:25:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-31T18:25:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/uio 2023-08-31T18:25:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/uio/uio.ko 2023-08-31T18:25:47.827 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/uio/uio_aec.ko 2023-08-31T18:25:47.828 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/uio/uio_cif.ko 2023-08-31T18:25:47.828 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/uio/uio_pci_generic.ko 2023-08-31T18:25:47.828 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/uio/uio_sercos3.ko 2023-08-31T18:25:47.828 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb 2023-08-31T18:25:47.829 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/class 2023-08-31T18:25:47.829 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/class/cdc-acm.ko 2023-08-31T18:25:47.829 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-31T18:25:47.829 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/class/usblp.ko 2023-08-31T18:25:47.830 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/class/usbtmc.ko 2023-08-31T18:25:47.830 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/host 2023-08-31T18:25:47.830 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-31T18:25:47.830 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/image 2023-08-31T18:25:47.830 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/image/mdc800.ko 2023-08-31T18:25:47.831 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/image/microtek.ko 2023-08-31T18:25:47.831 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc 2023-08-31T18:25:47.831 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/adutux.ko 2023-08-31T18:25:47.831 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/appledisplay.ko 2023-08-31T18:25:47.831 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/emi26.ko 2023-08-31T18:25:47.831 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/emi62.ko 2023-08-31T18:25:47.832 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/ezusb.ko 2023-08-31T18:25:47.832 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/idmouse.ko 2023-08-31T18:25:47.832 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/iowarrior.ko 2023-08-31T18:25:47.832 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-31T18:25:47.832 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/ldusb.ko 2023-08-31T18:25:47.833 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/legousbtower.ko 2023-08-31T18:25:47.833 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/sisusbvga 2023-08-31T18:25:47.833 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-31T18:25:47.833 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-31T18:25:47.833 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/usb3503.ko 2023-08-31T18:25:47.833 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/usblcd.ko 2023-08-31T18:25:47.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-31T18:25:47.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/uss720.ko 2023-08-31T18:25:47.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/misc/yurex.ko 2023-08-31T18:25:47.834 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/phy 2023-08-31T18:25:47.835 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/phy/phy-generic.ko 2023-08-31T18:25:47.835 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial 2023-08-31T18:25:47.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/aircable.ko 2023-08-31T18:25:47.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ark3116.ko 2023-08-31T18:25:47.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-31T18:25:47.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ch341.ko 2023-08-31T18:25:47.836 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/cp210x.ko 2023-08-31T18:25:47.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/cyberjack.ko 2023-08-31T18:25:47.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-31T18:25:47.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-31T18:25:47.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/empeg.ko 2023-08-31T18:25:47.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-31T18:25:47.837 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-31T18:25:47.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-31T18:25:47.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/io_ti.ko 2023-08-31T18:25:47.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ipaq.ko 2023-08-31T18:25:47.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ipw.ko 2023-08-31T18:25:47.838 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ir-usb.ko 2023-08-31T18:25:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-31T18:25:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/keyspan.ko 2023-08-31T18:25:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-31T18:25:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-31T18:25:47.839 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-31T18:25:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/mct_u232.ko 2023-08-31T18:25:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/mos7720.ko 2023-08-31T18:25:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/mos7840.ko 2023-08-31T18:25:47.840 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/navman.ko 2023-08-31T18:25:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/omninet.ko 2023-08-31T18:25:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/opticon.ko 2023-08-31T18:25:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/option.ko 2023-08-31T18:25:47.841 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/oti6858.ko 2023-08-31T18:25:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/pl2303.ko 2023-08-31T18:25:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/qcaux.ko 2023-08-31T18:25:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/qcserial.ko 2023-08-31T18:25:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/quatech2.ko 2023-08-31T18:25:47.842 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/safe_serial.ko 2023-08-31T18:25:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/sierra.ko 2023-08-31T18:25:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-31T18:25:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ssu100.ko 2023-08-31T18:25:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/symbolserial.ko 2023-08-31T18:25:47.843 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-31T18:25:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-31T18:25:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/usb_debug.ko 2023-08-31T18:25:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-31T18:25:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/visor.ko 2023-08-31T18:25:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/whiteheat.ko 2023-08-31T18:25:47.844 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-31T18:25:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage 2023-08-31T18:25:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/uas.ko 2023-08-31T18:25:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-31T18:25:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-31T18:25:47.845 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-31T18:25:47.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-31T18:25:47.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-31T18:25:47.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-31T18:25:47.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-31T18:25:47.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-karma.ko 2023-08-31T18:25:47.846 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-31T18:25:47.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-31T18:25:47.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-31T18:25:47.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-31T18:25:47.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-31T18:25:47.847 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/storage/usb-storage.ko 2023-08-31T18:25:47.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/usbip 2023-08-31T18:25:47.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-31T18:25:47.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-31T18:25:47.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-31T18:25:47.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vfio 2023-08-31T18:25:47.848 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vfio/pci 2023-08-31T18:25:47.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-31T18:25:47.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-31T18:25:47.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vfio/vfio.ko 2023-08-31T18:25:47.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-31T18:25:47.849 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vhost 2023-08-31T18:25:47.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vhost/vhost.ko 2023-08-31T18:25:47.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-31T18:25:47.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vhost/vhost_net.ko 2023-08-31T18:25:47.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/vhost/vhost_scsi.ko 2023-08-31T18:25:47.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/video 2023-08-31T18:25:47.850 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/video/backlight 2023-08-31T18:25:47.851 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/video/backlight/apple_bl.ko 2023-08-31T18:25:47.851 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/video/backlight/lcd.ko 2023-08-31T18:25:47.852 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-31T18:25:47.852 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio 2023-08-31T18:25:47.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio/virtio.ko 2023-08-31T18:25:47.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio/virtio_balloon.ko 2023-08-31T18:25:47.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio/virtio_mmio.ko 2023-08-31T18:25:47.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio/virtio_pci.ko 2023-08-31T18:25:47.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-31T18:25:47.853 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-31T18:25:47.854 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/virtio/virtio_ring.ko 2023-08-31T18:25:47.854 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1 2023-08-31T18:25:47.854 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/masters 2023-08-31T18:25:47.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/masters/ds2482.ko 2023-08-31T18:25:47.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/masters/ds2490.ko 2023-08-31T18:25:47.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves 2023-08-31T18:25:47.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-31T18:25:47.855 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-31T18:25:47.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-31T18:25:47.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-31T18:25:47.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-31T18:25:47.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-31T18:25:47.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-31T18:25:47.856 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-31T18:25:47.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-31T18:25:47.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-31T18:25:47.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-31T18:25:47.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/w1/wire.ko 2023-08-31T18:25:47.857 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog 2023-08-31T18:25:47.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-31T18:25:47.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-31T18:25:47.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-31T18:25:47.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/hpwdt.ko 2023-08-31T18:25:47.858 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/i6300esb.ko 2023-08-31T18:25:47.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-31T18:25:47.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-31T18:25:47.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/ib700wdt.ko 2023-08-31T18:25:47.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/ibmasr.ko 2023-08-31T18:25:47.859 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-31T18:25:47.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-31T18:25:47.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/it87_wdt.ko 2023-08-31T18:25:47.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/machzwd.ko 2023-08-31T18:25:47.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/nv_tco.ko 2023-08-31T18:25:47.860 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-31T18:25:47.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-31T18:25:47.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-31T18:25:47.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-31T18:25:47.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/softdog.ko 2023-08-31T18:25:47.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-31T18:25:47.861 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/via_wdt.ko 2023-08-31T18:25:47.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-31T18:25:47.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-31T18:25:47.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-31T18:25:47.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/wdt_pci.ko 2023-08-31T18:25:47.862 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/watchdog/xen_wdt.ko 2023-08-31T18:25:47.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen 2023-08-31T18:25:47.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-31T18:25:47.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xen-evtchn.ko 2023-08-31T18:25:47.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xen-gntalloc.ko 2023-08-31T18:25:47.863 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xen-gntdev.ko 2023-08-31T18:25:47.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xen-pciback 2023-08-31T18:25:47.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-31T18:25:47.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xen-privcmd.ko 2023-08-31T18:25:47.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xenfs 2023-08-31T18:25:47.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-31T18:25:47.864 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs 2023-08-31T18:25:47.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/9p 2023-08-31T18:25:47.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/9p/9p.ko 2023-08-31T18:25:47.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/affs 2023-08-31T18:25:47.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/affs/affs.ko 2023-08-31T18:25:47.865 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/befs 2023-08-31T18:25:47.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/befs/befs.ko 2023-08-31T18:25:47.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/binfmt_misc.ko 2023-08-31T18:25:47.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/btrfs 2023-08-31T18:25:47.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/btrfs/btrfs.ko 2023-08-31T18:25:47.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/cachefiles 2023-08-31T18:25:47.866 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/cachefiles/cachefiles.ko 2023-08-31T18:25:47.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ceph 2023-08-31T18:25:47.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ceph/ceph.ko 2023-08-31T18:25:47.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/coda 2023-08-31T18:25:47.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/coda/coda.ko 2023-08-31T18:25:47.867 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/cramfs 2023-08-31T18:25:47.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/cramfs/cramfs.ko 2023-08-31T18:25:47.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/dlm 2023-08-31T18:25:47.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/dlm/dlm.ko 2023-08-31T18:25:47.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ecryptfs 2023-08-31T18:25:47.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-31T18:25:47.868 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/f2fs 2023-08-31T18:25:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/f2fs/f2fs.ko 2023-08-31T18:25:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fat 2023-08-31T18:25:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fat/fat.ko 2023-08-31T18:25:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fat/msdos.ko 2023-08-31T18:25:47.869 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fat/vfat.ko 2023-08-31T18:25:47.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fscache 2023-08-31T18:25:47.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fscache/fscache.ko 2023-08-31T18:25:47.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fuse 2023-08-31T18:25:47.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fuse/cuse.ko 2023-08-31T18:25:47.870 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/fuse/fuse.ko 2023-08-31T18:25:47.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/gfs2 2023-08-31T18:25:47.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/gfs2/gfs2.ko 2023-08-31T18:25:47.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/hfs 2023-08-31T18:25:47.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/hfs/hfs.ko 2023-08-31T18:25:47.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/hfsplus 2023-08-31T18:25:47.871 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/hfsplus/hfsplus.ko 2023-08-31T18:25:47.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/isofs 2023-08-31T18:25:47.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/isofs/isofs.ko 2023-08-31T18:25:47.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/jfs 2023-08-31T18:25:47.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/jfs/jfs.ko 2023-08-31T18:25:47.872 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/lockd 2023-08-31T18:25:47.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/lockd/lockd.ko 2023-08-31T18:25:47.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/minix 2023-08-31T18:25:47.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/minix/minix.ko 2023-08-31T18:25:47.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/netfs 2023-08-31T18:25:47.873 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/netfs/netfs.ko 2023-08-31T18:25:47.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs 2023-08-31T18:25:47.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/blocklayout 2023-08-31T18:25:47.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-31T18:25:47.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/filelayout 2023-08-31T18:25:47.874 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-31T18:25:47.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/flexfilelayout 2023-08-31T18:25:47.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-31T18:25:47.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/nfs.ko 2023-08-31T18:25:47.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/nfsv3.ko 2023-08-31T18:25:47.875 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs/nfsv4.ko 2023-08-31T18:25:47.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs_common 2023-08-31T18:25:47.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs_common/grace.ko 2023-08-31T18:25:47.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfs_common/nfs_acl.ko 2023-08-31T18:25:47.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfsd 2023-08-31T18:25:47.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nfsd/nfsd.ko 2023-08-31T18:25:47.876 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nilfs2 2023-08-31T18:25:47.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nilfs2/nilfs2.ko 2023-08-31T18:25:47.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls 2023-08-31T18:25:47.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-celtic.ko 2023-08-31T18:25:47.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-centeuro.ko 2023-08-31T18:25:47.877 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-croatian.ko 2023-08-31T18:25:47.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-cyrillic.ko 2023-08-31T18:25:47.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-gaelic.ko 2023-08-31T18:25:47.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-greek.ko 2023-08-31T18:25:47.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-iceland.ko 2023-08-31T18:25:47.878 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-inuit.ko 2023-08-31T18:25:47.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-roman.ko 2023-08-31T18:25:47.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-romanian.ko 2023-08-31T18:25:47.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/mac-turkish.ko 2023-08-31T18:25:47.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp1250.ko 2023-08-31T18:25:47.879 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp1251.ko 2023-08-31T18:25:47.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp1255.ko 2023-08-31T18:25:47.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp737.ko 2023-08-31T18:25:47.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp775.ko 2023-08-31T18:25:47.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp850.ko 2023-08-31T18:25:47.880 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp852.ko 2023-08-31T18:25:47.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp855.ko 2023-08-31T18:25:47.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp857.ko 2023-08-31T18:25:47.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp860.ko 2023-08-31T18:25:47.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp861.ko 2023-08-31T18:25:47.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp862.ko 2023-08-31T18:25:47.881 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp863.ko 2023-08-31T18:25:47.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp864.ko 2023-08-31T18:25:47.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp865.ko 2023-08-31T18:25:47.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp866.ko 2023-08-31T18:25:47.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp869.ko 2023-08-31T18:25:47.882 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp874.ko 2023-08-31T18:25:47.884 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp932.ko 2023-08-31T18:25:47.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp936.ko 2023-08-31T18:25:47.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp949.ko 2023-08-31T18:25:47.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_cp950.ko 2023-08-31T18:25:47.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_euc-jp.ko 2023-08-31T18:25:47.885 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-1.ko 2023-08-31T18:25:47.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-13.ko 2023-08-31T18:25:47.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-14.ko 2023-08-31T18:25:47.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-15.ko 2023-08-31T18:25:47.886 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-2.ko 2023-08-31T18:25:47.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-3.ko 2023-08-31T18:25:47.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-4.ko 2023-08-31T18:25:47.887 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-5.ko 2023-08-31T18:25:47.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-6.ko 2023-08-31T18:25:47.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-7.ko 2023-08-31T18:25:47.888 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_iso8859-9.ko 2023-08-31T18:25:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_koi8-r.ko 2023-08-31T18:25:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_koi8-ru.ko 2023-08-31T18:25:47.889 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_koi8-u.ko 2023-08-31T18:25:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/nls/nls_utf8.ko 2023-08-31T18:25:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2 2023-08-31T18:25:47.890 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/cluster 2023-08-31T18:25:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-31T18:25:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/dlm 2023-08-31T18:25:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-31T18:25:47.891 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/dlmfs 2023-08-31T18:25:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-31T18:25:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/ocfs2.ko 2023-08-31T18:25:47.892 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-31T18:25:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-31T18:25:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-31T18:25:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/overlayfs 2023-08-31T18:25:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/overlayfs/overlay.ko 2023-08-31T18:25:47.893 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/pstore 2023-08-31T18:25:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/pstore/ramoops.ko 2023-08-31T18:25:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/reiserfs 2023-08-31T18:25:47.894 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/reiserfs/reiserfs.ko 2023-08-31T18:25:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/romfs 2023-08-31T18:25:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/romfs/romfs.ko 2023-08-31T18:25:47.895 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/smb 2023-08-31T18:25:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/smb/client 2023-08-31T18:25:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/smb/client/cifs.ko 2023-08-31T18:25:47.896 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/smb/common 2023-08-31T18:25:47.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/smb/common/cifs_arc4.ko 2023-08-31T18:25:47.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/smb/common/cifs_md4.ko 2023-08-31T18:25:47.897 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/squashfs 2023-08-31T18:25:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/squashfs/squashfs.ko 2023-08-31T18:25:47.898 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/sysv 2023-08-31T18:25:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/sysv/sysv.ko 2023-08-31T18:25:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/udf 2023-08-31T18:25:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/udf/udf.ko 2023-08-31T18:25:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ufs 2023-08-31T18:25:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/ufs/ufs.ko 2023-08-31T18:25:47.900 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/xfs 2023-08-31T18:25:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/fs/xfs/xfs.ko 2023-08-31T18:25:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/kernel 2023-08-31T18:25:47.901 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/kernel/rcu 2023-08-31T18:25:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/kernel/rcu/rcutorture.ko 2023-08-31T18:25:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/kernel/torture.ko 2023-08-31T18:25:47.902 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/kernel/trace 2023-08-31T18:25:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-31T18:25:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib 2023-08-31T18:25:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/asn1_encoder.ko 2023-08-31T18:25:47.903 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/crc-itu-t.ko 2023-08-31T18:25:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/crc8.ko 2023-08-31T18:25:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/crypto 2023-08-31T18:25:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/crypto/libarc4.ko 2023-08-31T18:25:47.904 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/crypto/libdes.ko 2023-08-31T18:25:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/libcrc32c.ko 2023-08-31T18:25:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/lru_cache.ko 2023-08-31T18:25:47.905 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/lz4 2023-08-31T18:25:47.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/lz4/lz4_compress.ko 2023-08-31T18:25:47.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/lz4/lz4hc_compress.ko 2023-08-31T18:25:47.906 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/math 2023-08-31T18:25:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/math/cordic.ko 2023-08-31T18:25:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/raid6 2023-08-31T18:25:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/raid6/raid6_pq.ko 2023-08-31T18:25:47.907 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/reed_solomon 2023-08-31T18:25:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-31T18:25:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/ts_bm.ko 2023-08-31T18:25:47.908 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/ts_fsm.ko 2023-08-31T18:25:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/ts_kmp.ko 2023-08-31T18:25:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/zstd 2023-08-31T18:25:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/lib/zstd/zstd_compress.ko 2023-08-31T18:25:47.909 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/mm 2023-08-31T18:25:47.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/mm/hwpoison-inject.ko 2023-08-31T18:25:47.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net 2023-08-31T18:25:47.910 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan 2023-08-31T18:25:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/6lowpan.ko 2023-08-31T18:25:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/nhc_dest.ko 2023-08-31T18:25:47.911 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/nhc_fragment.ko 2023-08-31T18:25:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/nhc_hop.ko 2023-08-31T18:25:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-31T18:25:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/nhc_mobility.ko 2023-08-31T18:25:47.912 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/nhc_routing.ko 2023-08-31T18:25:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/6lowpan/nhc_udp.ko 2023-08-31T18:25:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/802 2023-08-31T18:25:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/802/garp.ko 2023-08-31T18:25:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/802/mrp.ko 2023-08-31T18:25:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/802/p8022.ko 2023-08-31T18:25:47.913 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/802/psnap.ko 2023-08-31T18:25:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/802/stp.ko 2023-08-31T18:25:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/8021q 2023-08-31T18:25:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/8021q/8021q.ko 2023-08-31T18:25:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/9p 2023-08-31T18:25:47.914 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/9p/9pnet.ko 2023-08-31T18:25:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/9p/9pnet_fd.ko 2023-08-31T18:25:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/9p/9pnet_rdma.ko 2023-08-31T18:25:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/9p/9pnet_virtio.ko 2023-08-31T18:25:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/batman-adv 2023-08-31T18:25:47.915 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/batman-adv/batman-adv.ko 2023-08-31T18:25:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge 2023-08-31T18:25:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/br_netfilter.ko 2023-08-31T18:25:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/bridge.ko 2023-08-31T18:25:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter 2023-08-31T18:25:47.916 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-31T18:25:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-31T18:25:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-31T18:25:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-31T18:25:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-31T18:25:47.917 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-31T18:25:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-31T18:25:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-31T18:25:47.918 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-31T18:25:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-31T18:25:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-31T18:25:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-31T18:25:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-31T18:25:47.919 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-31T18:25:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-31T18:25:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-31T18:25:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-31T18:25:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-31T18:25:47.920 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-31T18:25:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-31T18:25:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/ebtables.ko 2023-08-31T18:25:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-31T18:25:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-31T18:25:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-31T18:25:47.921 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ceph 2023-08-31T18:25:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ceph/libceph.ko 2023-08-31T18:25:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/core 2023-08-31T18:25:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/core/failover.ko 2023-08-31T18:25:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/core/pktgen.ko 2023-08-31T18:25:47.922 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dccp 2023-08-31T18:25:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dccp/dccp.ko 2023-08-31T18:25:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dccp/dccp_diag.ko 2023-08-31T18:25:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dccp/dccp_ipv4.ko 2023-08-31T18:25:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dccp/dccp_ipv6.ko 2023-08-31T18:25:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dns_resolver 2023-08-31T18:25:47.923 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dns_resolver/dns_resolver.ko 2023-08-31T18:25:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dsa 2023-08-31T18:25:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dsa/dsa_core.ko 2023-08-31T18:25:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dsa/tag_brcm.ko 2023-08-31T18:25:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dsa/tag_dsa.ko 2023-08-31T18:25:47.924 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dsa/tag_none.ko 2023-08-31T18:25:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/dsa/tag_trailer.ko 2023-08-31T18:25:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ieee802154 2023-08-31T18:25:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ieee802154/6lowpan 2023-08-31T18:25:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-31T18:25:47.925 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ieee802154/ieee802154.ko 2023-08-31T18:25:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-31T18:25:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4 2023-08-31T18:25:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/ah4.ko 2023-08-31T18:25:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/esp4.ko 2023-08-31T18:25:47.926 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/fou.ko 2023-08-31T18:25:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/gre.ko 2023-08-31T18:25:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/inet_diag.ko 2023-08-31T18:25:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/ip_gre.ko 2023-08-31T18:25:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/ip_tunnel.ko 2023-08-31T18:25:47.927 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/ip_vti.ko 2023-08-31T18:25:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/ipcomp.ko 2023-08-31T18:25:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/ipip.ko 2023-08-31T18:25:47.928 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter 2023-08-31T18:25:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-31T18:25:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-31T18:25:47.929 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-31T18:25:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-31T18:25:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-31T18:25:47.930 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-31T18:25:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-31T18:25:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-31T18:25:47.931 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-31T18:25:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-31T18:25:47.932 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-31T18:25:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-31T18:25:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-31T18:25:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-31T18:25:47.933 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-31T18:25:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-31T18:25:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-31T18:25:47.934 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-31T18:25:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-31T18:25:47.935 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-31T18:25:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-31T18:25:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_bic.ko 2023-08-31T18:25:47.936 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_dctcp.ko 2023-08-31T18:25:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_diag.ko 2023-08-31T18:25:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_highspeed.ko 2023-08-31T18:25:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_htcp.ko 2023-08-31T18:25:47.937 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_hybla.ko 2023-08-31T18:25:47.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_illinois.ko 2023-08-31T18:25:47.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_lp.ko 2023-08-31T18:25:47.938 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_scalable.ko 2023-08-31T18:25:47.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_vegas.ko 2023-08-31T18:25:47.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_veno.ko 2023-08-31T18:25:47.939 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_westwood.ko 2023-08-31T18:25:47.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tcp_yeah.ko 2023-08-31T18:25:47.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/tunnel4.ko 2023-08-31T18:25:47.940 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/udp_diag.ko 2023-08-31T18:25:47.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/udp_tunnel.ko 2023-08-31T18:25:47.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-31T18:25:47.941 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6 2023-08-31T18:25:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/ah6.ko 2023-08-31T18:25:47.942 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/esp6.ko 2023-08-31T18:25:47.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/fou6.ko 2023-08-31T18:25:47.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/ip6_tunnel.ko 2023-08-31T18:25:47.943 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-31T18:25:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/ip6_vti.ko 2023-08-31T18:25:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/ipcomp6.ko 2023-08-31T18:25:47.944 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter 2023-08-31T18:25:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-31T18:25:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-31T18:25:47.945 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-31T18:25:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-31T18:25:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-31T18:25:47.946 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-31T18:25:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-31T18:25:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-31T18:25:47.947 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-31T18:25:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-31T18:25:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-31T18:25:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-31T18:25:47.948 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-31T18:25:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-31T18:25:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-31T18:25:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-31T18:25:47.949 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-31T18:25:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-31T18:25:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-31T18:25:47.950 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-31T18:25:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-31T18:25:47.951 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-31T18:25:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-31T18:25:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-31T18:25:47.952 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/sit.ko 2023-08-31T18:25:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/tunnel6.ko 2023-08-31T18:25:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-31T18:25:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/key 2023-08-31T18:25:47.953 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/key/af_key.ko 2023-08-31T18:25:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp 2023-08-31T18:25:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp/l2tp_core.ko 2023-08-31T18:25:47.954 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-31T18:25:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp/l2tp_eth.ko 2023-08-31T18:25:47.955 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp/l2tp_ip.ko 2023-08-31T18:25:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp/l2tp_ip6.ko 2023-08-31T18:25:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp/l2tp_netlink.ko 2023-08-31T18:25:47.956 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/l2tp/l2tp_ppp.ko 2023-08-31T18:25:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/llc 2023-08-31T18:25:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/llc/llc.ko 2023-08-31T18:25:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/mac802154 2023-08-31T18:25:47.957 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/mac802154/mac802154.ko 2023-08-31T18:25:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/mpls 2023-08-31T18:25:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/mpls/mpls_gso.ko 2023-08-31T18:25:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter 2023-08-31T18:25:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset 2023-08-31T18:25:47.958 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set.ko 2023-08-31T18:25:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-31T18:25:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-31T18:25:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-31T18:25:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-31T18:25:47.959 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-31T18:25:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-31T18:25:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-31T18:25:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-31T18:25:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-31T18:25:47.960 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-31T18:25:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-31T18:25:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-31T18:25:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-31T18:25:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-31T18:25:47.961 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-31T18:25:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs 2023-08-31T18:25:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-31T18:25:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-31T18:25:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-31T18:25:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-31T18:25:47.962 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-31T18:25:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-31T18:25:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-31T18:25:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-31T18:25:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-31T18:25:47.963 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-31T18:25:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-31T18:25:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-31T18:25:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-31T18:25:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-31T18:25:47.964 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conncount.ko 2023-08-31T18:25:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack.ko 2023-08-31T18:25:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-31T18:25:47.965 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-31T18:25:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-31T18:25:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-31T18:25:47.966 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-31T18:25:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-31T18:25:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-31T18:25:47.967 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-31T18:25:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-31T18:25:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-31T18:25:47.968 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-31T18:25:47.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-31T18:25:47.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-31T18:25:47.969 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_flow_table.ko 2023-08-31T18:25:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-31T18:25:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_log_syslog.ko 2023-08-31T18:25:47.970 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_nat.ko 2023-08-31T18:25:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-31T18:25:47.971 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-31T18:25:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_nat_irc.ko 2023-08-31T18:25:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_nat_sip.ko 2023-08-31T18:25:47.972 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-31T18:25:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-31T18:25:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nf_tables.ko 2023-08-31T18:25:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nfnetlink.ko 2023-08-31T18:25:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-31T18:25:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nfnetlink_log.ko 2023-08-31T18:25:47.974 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-31T18:25:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-31T18:25:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_chain_nat.ko 2023-08-31T18:25:47.975 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_compat.ko 2023-08-31T18:25:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_ct.ko 2023-08-31T18:25:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-31T18:25:47.977 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_fib.ko 2023-08-31T18:25:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-31T18:25:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_hash.ko 2023-08-31T18:25:47.978 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_limit.ko 2023-08-31T18:25:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_log.ko 2023-08-31T18:25:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_masq.ko 2023-08-31T18:25:47.979 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_nat.ko 2023-08-31T18:25:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_numgen.ko 2023-08-31T18:25:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_queue.ko 2023-08-31T18:25:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_quota.ko 2023-08-31T18:25:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_redir.ko 2023-08-31T18:25:47.980 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_reject.ko 2023-08-31T18:25:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_reject_inet.ko 2023-08-31T18:25:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_socket.ko 2023-08-31T18:25:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/nft_tunnel.ko 2023-08-31T18:25:47.981 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_AUDIT.ko 2023-08-31T18:25:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-31T18:25:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-31T18:25:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-31T18:25:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_CT.ko 2023-08-31T18:25:47.982 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_DSCP.ko 2023-08-31T18:25:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_HL.ko 2023-08-31T18:25:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_HMARK.ko 2023-08-31T18:25:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-31T18:25:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_LED.ko 2023-08-31T18:25:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_LOG.ko 2023-08-31T18:25:47.983 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-31T18:25:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_NETMAP.ko 2023-08-31T18:25:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_NFLOG.ko 2023-08-31T18:25:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-31T18:25:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_RATEEST.ko 2023-08-31T18:25:47.984 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-31T18:25:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_SECMARK.ko 2023-08-31T18:25:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-31T18:25:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-31T18:25:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_TEE.ko 2023-08-31T18:25:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_TPROXY.ko 2023-08-31T18:25:47.985 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_TRACE.ko 2023-08-31T18:25:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_addrtype.ko 2023-08-31T18:25:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_bpf.ko 2023-08-31T18:25:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_cgroup.ko 2023-08-31T18:25:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_cluster.ko 2023-08-31T18:25:47.986 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_comment.ko 2023-08-31T18:25:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_connbytes.ko 2023-08-31T18:25:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_connlabel.ko 2023-08-31T18:25:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_connlimit.ko 2023-08-31T18:25:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_connmark.ko 2023-08-31T18:25:47.987 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_conntrack.ko 2023-08-31T18:25:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_cpu.ko 2023-08-31T18:25:47.988 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_dccp.ko 2023-08-31T18:25:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_devgroup.ko 2023-08-31T18:25:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_dscp.ko 2023-08-31T18:25:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_ecn.ko 2023-08-31T18:25:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_esp.ko 2023-08-31T18:25:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_hashlimit.ko 2023-08-31T18:25:47.989 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_helper.ko 2023-08-31T18:25:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_hl.ko 2023-08-31T18:25:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_ipcomp.ko 2023-08-31T18:25:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_iprange.ko 2023-08-31T18:25:47.990 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_ipvs.ko 2023-08-31T18:25:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_l2tp.ko 2023-08-31T18:25:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_length.ko 2023-08-31T18:25:47.991 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_limit.ko 2023-08-31T18:25:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_mac.ko 2023-08-31T18:25:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_mark.ko 2023-08-31T18:25:47.992 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_multiport.ko 2023-08-31T18:25:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_nat.ko 2023-08-31T18:25:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_nfacct.ko 2023-08-31T18:25:47.993 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_osf.ko 2023-08-31T18:25:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_owner.ko 2023-08-31T18:25:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_physdev.ko 2023-08-31T18:25:47.994 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_pkttype.ko 2023-08-31T18:25:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_policy.ko 2023-08-31T18:25:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_quota.ko 2023-08-31T18:25:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_rateest.ko 2023-08-31T18:25:47.995 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_realm.ko 2023-08-31T18:25:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_recent.ko 2023-08-31T18:25:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_sctp.ko 2023-08-31T18:25:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_set.ko 2023-08-31T18:25:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_socket.ko 2023-08-31T18:25:47.996 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_state.ko 2023-08-31T18:25:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_statistic.ko 2023-08-31T18:25:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_string.ko 2023-08-31T18:25:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_tcpmss.ko 2023-08-31T18:25:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_time.ko 2023-08-31T18:25:47.997 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netfilter/xt_u32.ko 2023-08-31T18:25:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netlink 2023-08-31T18:25:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/netlink/netlink_diag.ko 2023-08-31T18:25:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/nsh 2023-08-31T18:25:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/nsh/nsh.ko 2023-08-31T18:25:47.998 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/openvswitch 2023-08-31T18:25:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/openvswitch/openvswitch.ko 2023-08-31T18:25:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/openvswitch/vport-geneve.ko 2023-08-31T18:25:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/openvswitch/vport-gre.ko 2023-08-31T18:25:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/openvswitch/vport-vxlan.ko 2023-08-31T18:25:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/packet 2023-08-31T18:25:47.999 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/packet/af_packet_diag.ko 2023-08-31T18:25:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/rds 2023-08-31T18:25:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/rds/rds.ko 2023-08-31T18:25:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/rds/rds_rdma.ko 2023-08-31T18:25:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/rds/rds_tcp.ko 2023-08-31T18:25:48.000 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched 2023-08-31T18:25:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_csum.ko 2023-08-31T18:25:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_gact.ko 2023-08-31T18:25:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_ipt.ko 2023-08-31T18:25:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_mirred.ko 2023-08-31T18:25:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_nat.ko 2023-08-31T18:25:48.001 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_pedit.ko 2023-08-31T18:25:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_police.ko 2023-08-31T18:25:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_simple.ko 2023-08-31T18:25:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_skbedit.ko 2023-08-31T18:25:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/act_vlan.ko 2023-08-31T18:25:48.002 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/cls_basic.ko 2023-08-31T18:25:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/cls_bpf.ko 2023-08-31T18:25:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/cls_flow.ko 2023-08-31T18:25:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/cls_fw.ko 2023-08-31T18:25:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/cls_route.ko 2023-08-31T18:25:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/cls_u32.ko 2023-08-31T18:25:48.003 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/em_cmp.ko 2023-08-31T18:25:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/em_ipset.ko 2023-08-31T18:25:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/em_meta.ko 2023-08-31T18:25:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/em_nbyte.ko 2023-08-31T18:25:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/em_text.ko 2023-08-31T18:25:48.004 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/em_u32.ko 2023-08-31T18:25:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_choke.ko 2023-08-31T18:25:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_codel.ko 2023-08-31T18:25:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_drr.ko 2023-08-31T18:25:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_fq.ko 2023-08-31T18:25:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_gred.ko 2023-08-31T18:25:48.005 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_hfsc.ko 2023-08-31T18:25:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_hhf.ko 2023-08-31T18:25:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_htb.ko 2023-08-31T18:25:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_ingress.ko 2023-08-31T18:25:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_mqprio.ko 2023-08-31T18:25:48.006 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_mqprio_lib.ko 2023-08-31T18:25:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_multiq.ko 2023-08-31T18:25:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_netem.ko 2023-08-31T18:25:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_pie.ko 2023-08-31T18:25:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_plug.ko 2023-08-31T18:25:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_prio.ko 2023-08-31T18:25:48.007 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_qfq.ko 2023-08-31T18:25:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_red.ko 2023-08-31T18:25:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_sfb.ko 2023-08-31T18:25:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_sfq.ko 2023-08-31T18:25:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_tbf.ko 2023-08-31T18:25:48.008 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sched/sch_teql.ko 2023-08-31T18:25:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sctp 2023-08-31T18:25:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sctp/sctp.ko 2023-08-31T18:25:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sctp/sctp_diag.ko 2023-08-31T18:25:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sunrpc 2023-08-31T18:25:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sunrpc/auth_gss 2023-08-31T18:25:48.009 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-31T18:25:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-31T18:25:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sunrpc/sunrpc.ko 2023-08-31T18:25:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sunrpc/xprtrdma 2023-08-31T18:25:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-31T18:25:48.010 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/tipc 2023-08-31T18:25:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/tipc/diag.ko 2023-08-31T18:25:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/tipc/tipc.ko 2023-08-31T18:25:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/unix 2023-08-31T18:25:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/unix/unix_diag.ko 2023-08-31T18:25:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/vmw_vsock 2023-08-31T18:25:48.011 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-31T18:25:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-31T18:25:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/vmw_vsock/vsock.ko 2023-08-31T18:25:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-31T18:25:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-31T18:25:48.012 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/xfrm 2023-08-31T18:25:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-31T18:25:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/security 2023-08-31T18:25:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/security/keys 2023-08-31T18:25:48.013 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/security/keys/encrypted-keys 2023-08-31T18:25:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-31T18:25:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/security/keys/trusted-keys 2023-08-31T18:25:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/security/keys/trusted-keys/trusted.ko 2023-08-31T18:25:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/virt 2023-08-31T18:25:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/virt/lib 2023-08-31T18:25:48.014 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/kernel/virt/lib/irqbypass.ko 2023-08-31T18:25:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.alias 2023-08-31T18:25:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.alias.bin 2023-08-31T18:25:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.builtin 2023-08-31T18:25:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.builtin.bin 2023-08-31T18:25:48.015 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.builtin.modinfo 2023-08-31T18:25:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.dep 2023-08-31T18:25:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.dep.bin 2023-08-31T18:25:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.devname 2023-08-31T18:25:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.order 2023-08-31T18:25:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.softdep 2023-08-31T18:25:48.016 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.symbols 2023-08-31T18:25:48.017 INFO:teuthology.orchestra.run.smithi146.stdout:/lib/modules/6.5.0-rc7-g1931c6efd6a8/modules.symbols.bin 2023-08-31T18:25:48.017 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-g1931c6efd6a8 2023-08-31T18:25:48.018 DEBUG:teuthology.orchestra.run.smithi146:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-31T18:25:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:postinstall scriptlet (using /bin/sh): 2023-08-31T18:25:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-g1931c6efd6a8 -a -r /boot/System.map-6.5.0-rc7-g1931c6efd6a8 ]; then 2023-08-31T18:25:48.048 INFO:teuthology.orchestra.run.smithi146.stdout:cp /boot/vmlinuz-6.5.0-rc7-g1931c6efd6a8 /boot/.vmlinuz-6.5.0-rc7-g1931c6efd6a8-rpm 2023-08-31T18:25:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:cp /boot/System.map-6.5.0-rc7-g1931c6efd6a8 /boot/.System.map-6.5.0-rc7-g1931c6efd6a8-rpm 2023-08-31T18:25:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-g1931c6efd6a8 /boot/System.map-6.5.0-rc7-g1931c6efd6a8 2023-08-31T18:25:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:/sbin/installkernel 6.5.0-rc7-g1931c6efd6a8 /boot/.vmlinuz-6.5.0-rc7-g1931c6efd6a8-rpm /boot/.System.map-6.5.0-rc7-g1931c6efd6a8-rpm 2023-08-31T18:25:48.049 INFO:teuthology.orchestra.run.smithi146.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-g1931c6efd6a8-rpm /boot/.System.map-6.5.0-rc7-g1931c6efd6a8-rpm 2023-08-31T18:25:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2023-08-31T18:25:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-31T18:25:48.050 INFO:teuthology.orchestra.run.smithi146.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-31T18:25:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:new-kernel-pkg --remove 6.5.0-rc7-g1931c6efd6a8 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-g1931c6efd6a8.img 2023-08-31T18:25:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-31T18:25:48.051 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-install remove 6.5.0-rc7-g1931c6efd6a8 2023-08-31T18:25:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2023-08-31T18:25:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-31T18:25:48.052 INFO:teuthology.orchestra.run.smithi146.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-31T18:25:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-g1931c6efd6a8 2023-08-31T18:25:48.053 INFO:teuthology.orchestra.run.smithi146.stdout:fi 2023-08-31T18:25:48.054 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -qi grub2-tools 2023-08-31T18:25:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:Name : grub2-tools 2023-08-31T18:25:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:Epoch : 1 2023-08-31T18:25:48.136 INFO:teuthology.orchestra.run.smithi146.stdout:Version : 2.02 2023-08-31T18:25:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:Release : 129.el8 2023-08-31T18:25:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: x86_64 2023-08-31T18:25:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-08-31T18:25:48.137 INFO:teuthology.orchestra.run.smithi146.stdout:Group : System Environment/Base 2023-08-31T18:25:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:Size : 9265586 2023-08-31T18:25:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:License : GPLv3+ 2023-08-31T18:25:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-08-31T18:25:48.138 INFO:teuthology.orchestra.run.smithi146.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-08-31T18:25:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-08-31T18:25:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:Build Host : kbuilder.bsys.centos.org 2023-08-31T18:25:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:Relocations : (not relocatable) 2023-08-31T18:25:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:Packager : CentOS BuildSystem 2023-08-31T18:25:48.139 INFO:teuthology.orchestra.run.smithi146.stdout:Vendor : CentOS 2023-08-31T18:25:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-31T18:25:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:Summary : Support tools for GRUB. 2023-08-31T18:25:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:Description : 2023-08-31T18:25:48.140 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:25:48.140 INFO:teuthology.orchestra.run.smithi146.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-31T18:25:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-31T18:25:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-31T18:25:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:hardware devices. 2023-08-31T18:25:48.141 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:25:48.141 INFO:teuthology.orchestra.run.smithi146.stdout:This subpackage provides tools for support of all platforms. 2023-08-31T18:25:48.142 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-31T18:25:48.143 INFO:teuthology.task.kernel:Updating grub on smithi146 to boot 6.5.0-rc7-g1931c6efd6a8 2023-08-31T18:25:48.143 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-31T18:25:52.821 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2023-08-31T18:25:54.570 INFO:teuthology.orchestra.run.smithi146.stderr:done 2023-08-31T18:25:54.572 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-08-31T18:25:54.623 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.Hvqc8Hof8z 2023-08-31T18:25:54.623 DEBUG:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Hvqc8Hof8z 2023-08-31T18:25:54.660 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.Hvqc8Hof8z 2023-08-31T18:25:54.808 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.Hvqc8Hof8z is 6KB 2023-08-31T18:25:54.856 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.Hvqc8Hof8z 2023-08-31T18:25:54.874 DEBUG:teuthology.orchestra.run.smithi146:> sudo /bin/ls /boot/loader/entries || true 2023-08-31T18:25:54.952 INFO:teuthology.orchestra.run.smithi146.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-08-31T18:25:54.953 INFO:teuthology.orchestra.run.smithi146.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-08-31T18:25:54.953 INFO:teuthology.orchestra.run.smithi146.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-08-31T18:25:54.953 INFO:teuthology.orchestra.run.smithi146.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-g1931c6efd6a8.conf 2023-08-31T18:25:54.954 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc7-g1931c6efd6a8 2023-08-31T18:25:55.095 DEBUG:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2023-08-31T18:26:25.098 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-08-31T18:26:25.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-08-31T18:26:25.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:26:59.610 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-31T18:27:08.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-08-31T18:27:08.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:27:27.002 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-08-31T18:27:39.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-08-31T18:27:39.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:27:39.366 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-08-31T18:27:39.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-08-31T18:27:39.931 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc7-g1931c6efd6a8"... 2023-08-31T18:27:39.931 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2023-08-31T18:27:39.976 INFO:teuthology.orchestra.run.smithi146.stdout:6.5.0-rc7-g1931c6efd6a8 2023-08-31T18:27:39.977 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-g1931c6efd6a8 vs 6.5.0-rc7-g1931c6efd6a8 2023-08-31T18:27:39.977 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-31T18:27:39.977 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-31T18:27:40.978 DEBUG:teuthology.parallel:result is None 2023-08-31T18:27:40.979 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-31T18:27:40.993 INFO:teuthology.task.internal:Creating test directory... 2023-08-31T18:27:40.993 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-31T18:27:41.000 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-31T18:27:41.048 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-31T18:27:41.054 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-31T18:27:41.067 INFO:teuthology.task.internal:Creating archive directory... 2023-08-31T18:27:41.068 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-31T18:27:41.073 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-31T18:27:41.238 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-31T18:27:41.245 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-31T18:27:41.246 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-31T18:27:41.251 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-31T18:27:41.355 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T18:27:41.394 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T18:27:41.413 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T18:27:41.424 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T18:27:41.427 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-31T18:27:41.442 INFO:teuthology.task.internal:Configuring sudo... 2023-08-31T18:27:41.443 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-31T18:27:41.447 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-31T18:27:41.518 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-31T18:27:41.528 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-31T18:27:41.529 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-31T18:27:41.533 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-31T18:27:41.578 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T18:27:41.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T18:27:41.770 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T18:27:41.844 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T18:27:41.917 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:27:41.917 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-31T18:27:42.004 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T18:27:42.080 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T18:27:42.152 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T18:27:42.226 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T18:27:42.295 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:27:42.296 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-31T18:27:42.365 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2023-08-31T18:27:42.370 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2023-08-31T18:27:42.490 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-31T18:27:42.529 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-31T18:27:42.941 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-31T18:27:42.955 INFO:teuthology.task.internal:Starting timer... 2023-08-31T18:27:42.955 INFO:teuthology.run_tasks:Running task pcp... 2023-08-31T18:27:42.986 INFO:teuthology.run_tasks:Running task selinux... 2023-08-31T18:27:42.999 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-08-31T18:27:43.000 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2023-08-31T18:27:43.168 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2023-08-31T18:27:43.172 DEBUG:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2023-08-31T18:27:43.311 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: 2023-08-31T18:27:43.314 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-31T18:27:43.314 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2023-08-31T18:27:43.371 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2023-08-31T18:27:43.372 DEBUG:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2023-08-31T18:27:43.428 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2023-08-31T18:27:43.428 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi072.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi146.front.sepia.ceph.com': 'permissive'} 2023-08-31T18:27:43.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-31T18:27:43.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T18:27:43.510 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-31T18:27:43.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T18:27:43.582 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-31T18:27:43.582 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2023-08-31T18:27:43.657 DEBUG:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2023-08-31T18:27:43.731 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-31T18:27:43.744 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-08-31T18:27:43.745 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-31T18:27:43.764 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-31T18:27:43.765 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi072.front.sepia.ceph.com,smithi146.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-31T18:41:23.572 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi146.front.sepia.ceph.com')] 2023-08-31T18:41:23.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-08-31T18:41:23.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:41:23.660 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-08-31T18:41:23.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-08-31T18:41:23.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-08-31T18:41:23.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T18:41:23.860 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-08-31T18:41:23.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-08-31T18:41:23.932 INFO:teuthology.run_tasks:Running task clock... 2023-08-31T18:41:23.943 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-31T18:41:23.944 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-31T18:41:23.944 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-31T18:41:23.949 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-31T18:41:23.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-31T18:41:24.020 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-31T18:41:24.048 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-31T18:41:24.053 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-31T18:41:24.081 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-31T18:41:24.145 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2023-08-31T18:41:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: ntpd: command not found 2023-08-31T18:41:24.173 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2023-08-31T18:41:24.195 INFO:teuthology.orchestra.run.smithi146.stdout:506 Cannot talk to daemon 2023-08-31T18:41:24.205 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-31T18:41:24.227 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-31T18:41:24.237 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-31T18:41:24.260 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-31T18:41:24.322 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2023-08-31T18:41:24.329 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-31T18:41:24.330 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-08-31T18:41:24.330 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T18:41:24.330 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T18:41:24.330 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T18:41:24.331 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T18:41:24.351 INFO:teuthology.orchestra.run.smithi146.stderr:bash: ntpq: command not found 2023-08-31T18:41:24.358 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-31T18:41:24.358 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2023-08-31T18:41:24.358 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T18:41:24.359 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T18:41:24.359 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T18:41:24.359 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T18:41:24.360 INFO:teuthology.run_tasks:Running task install... 2023-08-31T18:41:24.374 DEBUG:teuthology.task.install:project ceph 2023-08-31T18:41:24.375 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b8d3759ea1ec9111c6e7f552353860ccc6501ad8'}} 2023-08-31T18:41:24.375 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'b8d3759ea1ec9111c6e7f552353860ccc6501ad8'} 2023-08-31T18:41:24.375 INFO:teuthology.task.install:Using flavor: default 2023-08-31T18:41:24.382 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-31T18:41:24.382 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-31T18:41:24.383 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b8d3759ea1ec9111c6e7f552353860ccc6501ad8', 'tag': None, 'wait_for_package': False} 2023-08-31T18:41:24.384 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b8d3759ea1ec9111c6e7f552353860ccc6501ad8 2023-08-31T18:41:24.386 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b8d3759ea1ec9111c6e7f552353860ccc6501ad8', 'tag': None, 'wait_for_package': False} 2023-08-31T18:41:24.386 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b8d3759ea1ec9111c6e7f552353860ccc6501ad8 2023-08-31T18:41:24.530 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230831.124848-pacific/b8d3759ea1ec9111c6e7f552353860ccc6501ad8/centos/8/flavors/default/ 2023-08-31T18:41:24.531 INFO:teuthology.task.install.rpm:Package version is 16.2.14-21.gb8d3759e 2023-08-31T18:41:24.542 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230831.124848-pacific/b8d3759ea1ec9111c6e7f552353860ccc6501ad8/centos/8/flavors/default/ 2023-08-31T18:41:24.542 INFO:teuthology.task.install.rpm:Package version is 16.2.14-21.gb8d3759e 2023-08-31T18:41:24.651 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230831.124848-pacific/b8d3759ea1ec9111c6e7f552353860ccc6501ad8/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230831.124848-pacific/b8d3759ea1ec9111c6e7f552353860ccc6501ad8/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230831.124848-pacific/b8d3759ea1ec9111c6e7f552353860ccc6501ad8/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-31T18:41:24.651 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:41:24.652 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-31T18:41:24.701 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230831.124848-pacific/b8d3759ea1ec9111c6e7f552353860ccc6501ad8/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230831.124848-pacific/b8d3759ea1ec9111c6e7f552353860ccc6501ad8/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20230831.124848-pacific/b8d3759ea1ec9111c6e7f552353860ccc6501ad8/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-31T18:41:24.702 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:41:24.702 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-31T18:41:24.722 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-08-31T18:41:24.723 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b8d3759ea1ec9111c6e7f552353860ccc6501ad8/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-31T18:41:24.773 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-08-31T18:41:24.773 DEBUG:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b8d3759ea1ec9111c6e7f552353860ccc6501ad8/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-31T18:41:24.833 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-31T18:41:24.885 DEBUG:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-31T18:41:24.928 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-31T18:41:24.981 DEBUG:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-31T18:41:24.997 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2023-08-31T18:41:25.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2023-08-31T18:41:25.051 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2023-08-31T18:41:25.054 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum clean all 2023-08-31T18:41:25.356 INFO:teuthology.orchestra.run.smithi072.stdout:76 files removed 2023-08-31T18:41:25.391 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-08-31T18:41:25.410 INFO:teuthology.orchestra.run.smithi146.stdout:76 files removed 2023-08-31T18:41:25.449 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-08-31T18:41:26.266 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 277 kB/s | 76 kB 00:00 2023-08-31T18:41:26.278 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 218 kB/s | 76 kB 00:00 2023-08-31T18:41:26.626 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 48 kB/s | 15 kB 00:00 2023-08-31T18:41:26.647 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 46 kB/s | 15 kB 00:00 2023-08-31T18:41:26.915 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 6.0 kB/s | 1.4 kB 00:00 2023-08-31T18:41:26.943 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 5.0 kB/s | 1.4 kB 00:00 2023-08-31T18:42:18.684 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - AppStream 659 kB/s | 33 MB 00:51 2023-08-31T18:42:56.690 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - AppStream 380 kB/s | 33 MB 01:29 2023-08-31T18:43:05.606 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 47 MB 00:02 2023-08-31T18:43:13.347 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - Extras 35 kB/s | 18 kB 00:00 2023-08-31T18:43:14.106 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.8 kB 00:00 2023-08-31T18:43:15.424 INFO:teuthology.orchestra.run.smithi146.stdout:CentOS Stream 8 - PowerTools 5.6 MB/s | 6.5 MB 00:01 2023-08-31T18:43:17.034 INFO:teuthology.orchestra.run.smithi146.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-08-31T18:43:19.026 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 16 MB 00:01 2023-08-31T18:43:23.643 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 167 kB/s | 24 kB 00:00 2023-08-31T18:43:28.034 INFO:teuthology.orchestra.run.smithi146.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T18:43:28.087 INFO:teuthology.orchestra.run.smithi146.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T18:43:28.088 INFO:teuthology.orchestra.run.smithi146.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-08-31T18:43:28.088 INFO:teuthology.orchestra.run.smithi146.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-08-31T18:43:28.088 INFO:teuthology.orchestra.run.smithi146.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-08-31T18:43:28.088 INFO:teuthology.orchestra.run.smithi146.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-08-31T18:43:28.089 INFO:teuthology.orchestra.run.smithi146.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-31T18:43:28.089 INFO:teuthology.orchestra.run.smithi146.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-31T18:43:28.089 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-31T18:43:28.089 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-31T18:43:28.266 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2023-08-31T18:43:28.279 INFO:teuthology.orchestra.run.smithi146.stdout:==================================================================================================== 2023-08-31T18:43:28.280 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2023-08-31T18:43:28.280 INFO:teuthology.orchestra.run.smithi146.stdout:==================================================================================================== 2023-08-31T18:43:28.280 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2023-08-31T18:43:28.280 INFO:teuthology.orchestra.run.smithi146.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-08-31T18:43:28.280 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 6.4 k 2023-08-31T18:43:28.281 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 6.1 M 2023-08-31T18:43:28.281 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 910 k 2023-08-31T18:43:28.281 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 161 k 2023-08-31T18:43:28.281 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 1.6 M 2023-08-31T18:43:28.282 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 116 k 2023-08-31T18:43:28.283 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 3.1 M 2023-08-31T18:43:28.283 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 8.6 M 2023-08-31T18:43:28.283 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 27 k 2023-08-31T18:43:28.283 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 12 M 2023-08-31T18:43:28.283 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 52 M 2023-08-31T18:43:28.284 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 84 k 2023-08-31T18:43:28.284 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 256 k 2023-08-31T18:43:28.284 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 19 k 2023-08-31T18:43:28.285 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-08-31T18:43:28.285 INFO:teuthology.orchestra.run.smithi146.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-08-31T18:43:28.285 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-08-31T18:43:28.285 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 25 k 2023-08-31T18:43:28.285 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 824 k 2023-08-31T18:43:28.286 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 131 k 2023-08-31T18:43:28.286 INFO:teuthology.orchestra.run.smithi146.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-08-31T18:43:28.286 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-08-31T18:43:28.287 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-08-31T18:43:28.288 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 215 k 2023-08-31T18:43:28.288 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 390 k 2023-08-31T18:43:28.288 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 369 k 2023-08-31T18:43:28.289 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 114 k 2023-08-31T18:43:28.289 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 88 k 2023-08-31T18:43:28.289 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 3.7 M 2023-08-31T18:43:28.289 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 173 k 2023-08-31T18:43:28.289 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-08-31T18:43:28.290 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2023-08-31T18:43:28.290 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-08-31T18:43:28.290 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-08-31T18:43:28.290 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-08-31T18:43:28.290 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-08-31T18:43:28.291 INFO:teuthology.orchestra.run.smithi146.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-08-31T18:43:28.291 INFO:teuthology.orchestra.run.smithi146.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-08-31T18:43:28.291 INFO:teuthology.orchestra.run.smithi146.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-08-31T18:43:28.291 INFO:teuthology.orchestra.run.smithi146.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-08-31T18:43:28.291 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 3.7 M 2023-08-31T18:43:28.292 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 4.2 M 2023-08-31T18:43:28.292 INFO:teuthology.orchestra.run.smithi146.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-08-31T18:43:28.292 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-08-31T18:43:28.292 INFO:teuthology.orchestra.run.smithi146.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-08-31T18:43:28.293 INFO:teuthology.orchestra.run.smithi146.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-08-31T18:43:28.293 INFO:teuthology.orchestra.run.smithi146.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-08-31T18:43:28.293 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-08-31T18:43:28.294 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2023-08-31T18:43:28.295 INFO:teuthology.orchestra.run.smithi146.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-08-31T18:43:28.295 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 24 M 2023-08-31T18:43:28.295 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 24 k 2023-08-31T18:43:28.296 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 2.4 M 2023-08-31T18:43:28.296 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 244 k 2023-08-31T18:43:28.296 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 5.0 M 2023-08-31T18:43:28.296 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 18 M 2023-08-31T18:43:28.297 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 15 k 2023-08-31T18:43:28.297 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 26 k 2023-08-31T18:43:28.297 INFO:teuthology.orchestra.run.smithi146.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-08-31T18:43:28.297 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-31T18:43:28.298 INFO:teuthology.orchestra.run.smithi146.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-08-31T18:43:28.298 INFO:teuthology.orchestra.run.smithi146.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-08-31T18:43:28.298 INFO:teuthology.orchestra.run.smithi146.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-08-31T18:43:28.298 INFO:teuthology.orchestra.run.smithi146.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-08-31T18:43:28.298 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 174 k 2023-08-31T18:43:28.299 INFO:teuthology.orchestra.run.smithi146.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-08-31T18:43:28.300 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-08-31T18:43:28.300 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-31T18:43:28.300 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-08-31T18:43:28.301 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-08-31T18:43:28.301 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 493 k 2023-08-31T18:43:28.301 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-08-31T18:43:28.301 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 3.8 M 2023-08-31T18:43:28.302 INFO:teuthology.orchestra.run.smithi146.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-08-31T18:43:28.302 INFO:teuthology.orchestra.run.smithi146.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-08-31T18:43:28.302 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-31T18:43:28.302 INFO:teuthology.orchestra.run.smithi146.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-08-31T18:43:28.303 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-08-31T18:43:28.303 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-08-31T18:43:28.303 INFO:teuthology.orchestra.run.smithi146.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-08-31T18:43:28.304 INFO:teuthology.orchestra.run.smithi146.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-08-31T18:43:28.304 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-08-31T18:43:28.304 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-08-31T18:43:28.304 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-08-31T18:43:28.305 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-08-31T18:43:28.305 INFO:teuthology.orchestra.run.smithi146.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-08-31T18:43:28.305 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-08-31T18:43:28.306 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-31T18:43:28.306 INFO:teuthology.orchestra.run.smithi146.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-31T18:43:28.306 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-31T18:43:28.306 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 45 k 2023-08-31T18:43:28.307 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 99 k 2023-08-31T18:43:28.307 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-31T18:43:28.307 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-08-31T18:43:28.307 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-31T18:43:28.307 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-31T18:43:28.308 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-08-31T18:43:28.308 INFO:teuthology.orchestra.run.smithi146.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-08-31T18:43:28.308 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-31T18:43:28.308 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-31T18:43:28.308 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-31T18:43:28.309 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-08-31T18:43:28.309 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-08-31T18:43:28.309 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-08-31T18:43:28.309 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-08-31T18:43:28.310 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-31T18:43:28.310 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-31T18:43:28.311 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-08-31T18:43:28.311 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-08-31T18:43:28.311 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-31T18:43:28.311 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-08-31T18:43:28.311 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-08-31T18:43:28.312 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-08-31T18:43:28.312 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-31T18:43:28.312 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-31T18:43:28.312 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-08-31T18:43:28.312 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-08-31T18:43:28.313 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-08-31T18:43:28.313 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-08-31T18:43:28.313 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-08-31T18:43:28.313 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-08-31T18:43:28.313 INFO:teuthology.orchestra.run.smithi146.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-08-31T18:43:28.314 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-31T18:43:28.314 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-08-31T18:43:28.314 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-31T18:43:28.314 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-31T18:43:28.314 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-08-31T18:43:28.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-31T18:43:28.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-31T18:43:28.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-31T18:43:28.315 INFO:teuthology.orchestra.run.smithi146.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-31T18:43:28.316 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-31T18:43:28.316 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-31T18:43:28.316 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-31T18:43:28.316 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-31T18:43:28.316 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-08-31T18:43:28.317 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-31T18:43:28.317 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-08-31T18:43:28.317 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-08-31T18:43:28.317 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-08-31T18:43:28.317 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:43:28.318 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2023-08-31T18:43:28.319 INFO:teuthology.orchestra.run.smithi146.stdout:==================================================================================================== 2023-08-31T18:43:28.319 INFO:teuthology.orchestra.run.smithi146.stdout:Install 123 Packages 2023-08-31T18:43:28.319 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 16 Packages 2023-08-31T18:43:28.319 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:43:28.320 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 209 M 2023-08-31T18:43:28.320 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2023-08-31T18:43:29.044 INFO:teuthology.orchestra.run.smithi146.stdout:(1/139): ceph-16.2.14-21.gb8d3759e.el8.x86_64.r 52 kB/s | 6.4 kB 00:00 2023-08-31T18:43:29.219 INFO:teuthology.orchestra.run.smithi146.stdout:(2/139): ceph-fuse-16.2.14-21.gb8d3759e.el8.x86 5.1 MB/s | 910 kB 00:00 2023-08-31T18:43:29.286 INFO:teuthology.orchestra.run.smithi146.stdout:(3/139): ceph-immutable-object-cache-16.2.14-21 2.4 MB/s | 161 kB 00:00 2023-08-31T18:43:29.553 INFO:teuthology.orchestra.run.smithi146.stdout:(4/139): ceph-mds-16.2.14-21.gb8d3759e.el8.x86_ 9.2 MB/s | 2.4 MB 00:00 2023-08-31T18:43:29.761 INFO:teuthology.orchestra.run.smithi146.stdout:(5/139): ceph-mgr-16.2.14-21.gb8d3759e.el8.x86_ 7.7 MB/s | 1.6 MB 00:00 2023-08-31T18:43:30.145 INFO:teuthology.orchestra.run.smithi146.stdout:(6/139): ceph-mon-16.2.14-21.gb8d3759e.el8.x86_ 13 MB/s | 5.0 MB 00:00 2023-08-31T18:43:30.229 INFO:teuthology.orchestra.run.smithi146.stdout:(7/139): ceph-base-16.2.14-21.gb8d3759e.el8.x86 4.6 MB/s | 6.1 MB 00:01 2023-08-31T18:43:31.720 INFO:teuthology.orchestra.run.smithi146.stdout:(8/139): ceph-common-16.2.14-21.gb8d3759e.el8.x 8.6 MB/s | 24 MB 00:02 2023-08-31T18:43:31.879 INFO:teuthology.orchestra.run.smithi146.stdout:(9/139): ceph-radosgw-16.2.14-21.gb8d3759e.el8. 7.0 MB/s | 12 MB 00:01 2023-08-31T18:43:31.954 INFO:teuthology.orchestra.run.smithi146.stdout:(10/139): ceph-selinux-16.2.14-21.gb8d3759e.el8 110 kB/s | 26 kB 00:00 2023-08-31T18:43:32.213 INFO:teuthology.orchestra.run.smithi146.stdout:(11/139): ceph-osd-16.2.14-21.gb8d3759e.el8.x86 8.9 MB/s | 18 MB 00:02 2023-08-31T18:43:32.238 INFO:teuthology.orchestra.run.smithi146.stdout:(12/139): cephfs-mirror-16.2.14-21.gb8d3759e.el 903 kB/s | 256 kB 00:00 2023-08-31T18:43:32.280 INFO:teuthology.orchestra.run.smithi146.stdout:(13/139): libcephfs-devel-16.2.14-21.gb8d3759e. 383 kB/s | 25 kB 00:00 2023-08-31T18:43:32.347 INFO:teuthology.orchestra.run.smithi146.stdout:(14/139): libcephsqlite-16.2.14-21.gb8d3759e.el 2.6 MB/s | 174 kB 00:00 2023-08-31T18:43:32.381 INFO:teuthology.orchestra.run.smithi146.stdout:(15/139): libcephfs2-16.2.14-21.gb8d3759e.el8.x 5.7 MB/s | 824 kB 00:00 2023-08-31T18:43:32.406 INFO:teuthology.orchestra.run.smithi146.stdout:(16/139): librados-devel-16.2.14-21.gb8d3759e.e 2.2 MB/s | 131 kB 00:00 2023-08-31T18:43:32.465 INFO:teuthology.orchestra.run.smithi146.stdout:(17/139): libradosstriper1-16.2.14-21.gb8d3759e 5.8 MB/s | 493 kB 00:00 2023-08-31T18:43:32.598 INFO:teuthology.orchestra.run.smithi146.stdout:(18/139): python3-ceph-argparse-16.2.14-21.gb8d 338 kB/s | 45 kB 00:00 2023-08-31T18:43:32.691 INFO:teuthology.orchestra.run.smithi146.stdout:(19/139): python3-ceph-common-16.2.14-21.gb8d37 1.0 MB/s | 99 kB 00:00 2023-08-31T18:43:32.782 INFO:teuthology.orchestra.run.smithi146.stdout:(20/139): librgw2-16.2.14-21.gb8d3759e.el8.x86_ 10 MB/s | 3.8 MB 00:00 2023-08-31T18:43:32.799 INFO:teuthology.orchestra.run.smithi146.stdout:(21/139): python3-cephfs-16.2.14-21.gb8d3759e.e 1.9 MB/s | 215 kB 00:00 2023-08-31T18:43:32.849 INFO:teuthology.orchestra.run.smithi146.stdout:(22/139): python3-rados-16.2.14-21.gb8d3759e.el 5.7 MB/s | 390 kB 00:00 2023-08-31T18:43:32.883 INFO:teuthology.orchestra.run.smithi146.stdout:(23/139): python3-rbd-16.2.14-21.gb8d3759e.el8. 4.3 MB/s | 369 kB 00:00 2023-08-31T18:43:32.908 INFO:teuthology.orchestra.run.smithi146.stdout:(24/139): python3-rgw-16.2.14-21.gb8d3759e.el8. 1.9 MB/s | 114 kB 00:00 2023-08-31T18:43:32.950 INFO:teuthology.orchestra.run.smithi146.stdout:(25/139): rbd-fuse-16.2.14-21.gb8d3759e.el8.x86 1.3 MB/s | 88 kB 00:00 2023-08-31T18:43:33.042 INFO:teuthology.orchestra.run.smithi146.stdout:(26/139): rbd-nbd-16.2.14-21.gb8d3759e.el8.x86_ 1.8 MB/s | 173 kB 00:00 2023-08-31T18:43:33.134 INFO:teuthology.orchestra.run.smithi146.stdout:(27/139): ceph-grafana-dashboards-16.2.14-21.gb 266 kB/s | 24 kB 00:00 2023-08-31T18:43:33.226 INFO:teuthology.orchestra.run.smithi146.stdout:(28/139): ceph-mgr-cephadm-16.2.14-21.gb8d3759e 1.2 MB/s | 116 kB 00:00 2023-08-31T18:43:33.285 INFO:teuthology.orchestra.run.smithi146.stdout:(29/139): rbd-mirror-16.2.14-21.gb8d3759e.el8.x 9.8 MB/s | 3.7 MB 00:00 2023-08-31T18:43:33.568 INFO:teuthology.orchestra.run.smithi146.stdout:(30/139): ceph-mgr-dashboard-16.2.14-21.gb8d375 9.2 MB/s | 3.1 MB 00:00 2023-08-31T18:43:33.652 INFO:teuthology.orchestra.run.smithi146.stdout:(31/139): ceph-mgr-modules-core-16.2.14-21.gb8d 2.9 MB/s | 244 kB 00:00 2023-08-31T18:43:33.736 INFO:teuthology.orchestra.run.smithi146.stdout:(32/139): ceph-mgr-rook-16.2.14-21.gb8d3759e.el 328 kB/s | 27 kB 00:00 2023-08-31T18:43:33.861 INFO:teuthology.orchestra.run.smithi146.stdout:(33/139): ceph-prometheus-alerts-16.2.14-21.gb8 119 kB/s | 15 kB 00:00 2023-08-31T18:43:33.953 INFO:teuthology.orchestra.run.smithi146.stdout:(34/139): cephadm-16.2.14-21.gb8d3759e.el8.noar 919 kB/s | 84 kB 00:00 2023-08-31T18:43:34.036 INFO:teuthology.orchestra.run.smithi146.stdout:(35/139): cephfs-top-16.2.14-21.gb8d3759e.el8.n 223 kB/s | 19 kB 00:00 2023-08-31T18:43:34.220 INFO:teuthology.orchestra.run.smithi146.stdout:(36/139): ceph-mgr-diskprediction-local-16.2.14 9.2 MB/s | 8.6 MB 00:00 2023-08-31T18:43:35.537 INFO:teuthology.orchestra.run.smithi146.stdout:(37/139): ceph-test-16.2.14-21.gb8d3759e.el8.x8 14 MB/s | 52 MB 00:03 2023-08-31T18:43:44.628 INFO:teuthology.orchestra.run.smithi146.stdout:(38/139): automake-1.16.1-8.el8.noarch.rpm 70 kB/s | 740 kB 00:10 2023-08-31T18:43:44.897 INFO:teuthology.orchestra.run.smithi146.stdout:(39/139): jq-1.6-7.el8.x86_64.rpm 754 kB/s | 202 kB 00:00 2023-08-31T18:43:45.182 INFO:teuthology.orchestra.run.smithi146.stdout:(40/139): librdkafka-0.11.4-3.el8.x86_64.rpm 1.2 MB/s | 354 kB 00:00 2023-08-31T18:43:45.205 INFO:teuthology.orchestra.run.smithi146.stdout:(41/139): bison-3.0.4-10.el8.x86_64.rpm 63 kB/s | 688 kB 00:10 2023-08-31T18:43:45.239 INFO:teuthology.orchestra.run.smithi146.stdout:(42/139): flex-2.6.1-9.el8.x86_64.rpm 33 kB/s | 320 kB 00:09 2023-08-31T18:43:45.439 INFO:teuthology.orchestra.run.smithi146.stdout:(43/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.1 MB/s | 259 kB 00:00 2023-08-31T18:43:45.473 INFO:teuthology.orchestra.run.smithi146.stdout:(44/139): oniguruma-6.8.2-2.el8.x86_64.rpm 802 kB/s | 187 kB 00:00 2023-08-31T18:43:45.540 INFO:teuthology.orchestra.run.smithi146.stdout:(45/139): libtool-2.4.6-25.el8.x86_64.rpm 1.9 MB/s | 709 kB 00:00 2023-08-31T18:43:46.525 INFO:teuthology.orchestra.run.smithi146.stdout:(46/139): python3-babel-2.5.1-7.el8.noarch.rpm 4.9 MB/s | 4.8 MB 00:00 2023-08-31T18:43:46.598 INFO:teuthology.orchestra.run.smithi146.stdout:(47/139): openblas-0.3.15-4.el8.x86_64.rpm 4.1 MB/s | 4.7 MB 00:01 2023-08-31T18:43:46.724 INFO:teuthology.orchestra.run.smithi146.stdout:(48/139): python3-jsonpatch-1.21-2.el8.noarch.r 212 kB/s | 27 kB 00:00 2023-08-31T18:43:46.866 INFO:teuthology.orchestra.run.smithi146.stdout:(49/139): python3-jsonpointer-1.10-11.el8.noarc 141 kB/s | 20 kB 00:00 2023-08-31T18:43:46.958 INFO:teuthology.orchestra.run.smithi146.stdout:(50/139): python3-jinja2-2.10.1-3.el8.noarch.rp 1.2 MB/s | 538 kB 00:00 2023-08-31T18:43:46.983 INFO:teuthology.orchestra.run.smithi146.stdout:(51/139): python3-mako-1.0.6-14.el8.noarch.rpm 1.3 MB/s | 157 kB 00:00 2023-08-31T18:43:47.050 INFO:teuthology.orchestra.run.smithi146.stdout:(52/139): openblas-threads-0.3.15-4.el8.x86_64. 3.1 MB/s | 4.9 MB 00:01 2023-08-31T18:43:47.075 INFO:teuthology.orchestra.run.smithi146.stdout:(53/139): python3-markupsafe-0.23-19.el8.x86_64 331 kB/s | 39 kB 00:00 2023-08-31T18:43:47.175 INFO:teuthology.orchestra.run.smithi146.stdout:(54/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.8 MB/s | 225 kB 00:00 2023-08-31T18:43:47.209 INFO:teuthology.orchestra.run.smithi146.stdout:(55/139): python3-prettytable-0.7.2-14.el8.noar 329 kB/s | 44 kB 00:00 2023-08-31T18:43:47.334 INFO:teuthology.orchestra.run.smithi146.stdout:(56/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 652 kB/s | 103 kB 00:00 2023-08-31T18:43:47.360 INFO:teuthology.orchestra.run.smithi146.stdout:(57/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 841 kB/s | 126 kB 00:00 2023-08-31T18:43:47.427 INFO:teuthology.orchestra.run.smithi146.stdout:(58/139): python3-numpy-1.14.3-10.el8.x86_64.rp 8.4 MB/s | 3.7 MB 00:00 2023-08-31T18:43:47.452 INFO:teuthology.orchestra.run.smithi146.stdout:(59/139): python3-pyasn1-modules-0.3.7-6.el8.no 941 kB/s | 110 kB 00:00 2023-08-31T18:43:47.485 INFO:teuthology.orchestra.run.smithi146.stdout:(60/139): python3-pytz-2017.2-11.el8.noarch.rpm 454 kB/s | 57 kB 00:00 2023-08-31T18:43:47.627 INFO:teuthology.orchestra.run.smithi146.stdout:(61/139): socat-1.7.4.1-1.el8.x86_64.rpm 2.2 MB/s | 323 kB 00:00 2023-08-31T18:43:47.736 INFO:teuthology.orchestra.run.smithi146.stdout:(62/139): python3-werkzeug-0.12.2-4.el8.noarch. 1.6 MB/s | 457 kB 00:00 2023-08-31T18:43:47.794 INFO:teuthology.orchestra.run.smithi146.stdout:(63/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 423 kB/s | 71 kB 00:00 2023-08-31T18:43:48.095 INFO:teuthology.orchestra.run.smithi146.stdout:(64/139): elfutils-libelf-devel-0.189-3.el8.x86 172 kB/s | 62 kB 00:00 2023-08-31T18:43:48.328 INFO:teuthology.orchestra.run.smithi146.stdout:(65/139): fuse-2.9.7-17.el8.x86_64.rpm 155 kB/s | 83 kB 00:00 2023-08-31T18:43:48.354 INFO:teuthology.orchestra.run.smithi146.stdout:(66/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 186 kB/s | 48 kB 00:00 2023-08-31T18:43:48.419 INFO:teuthology.orchestra.run.smithi146.stdout:[MIRROR] libaio-devel-0.3.112-1.el8.x86_64.rpm: Status code: 503 for http://mirror.dal.nexril.net/centos/8-stream/BaseOS/x86_64/os/Packages/libaio-devel-0.3.112-1.el8.x86_64.rpm (IP: 161.129.154.250) 2023-08-31T18:43:48.545 INFO:teuthology.orchestra.run.smithi146.stdout:(67/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 97 kB/s | 19 kB 00:00 2023-08-31T18:43:48.646 INFO:teuthology.orchestra.run.smithi146.stdout:(68/139): libcom_err-devel-1.45.6-5.el8.x86_64. 386 kB/s | 39 kB 00:00 2023-08-31T18:43:48.838 INFO:teuthology.orchestra.run.smithi146.stdout:(69/139): python3-scipy-1.0.0-21.module_el8.5.0 9.7 MB/s | 14 MB 00:01 2023-08-31T18:43:48.897 INFO:teuthology.orchestra.run.smithi146.stdout:(70/139): libgfortran-8.5.0-20.el8.x86_64.rpm 2.5 MB/s | 645 kB 00:00 2023-08-31T18:43:48.955 INFO:teuthology.orchestra.run.smithi146.stdout:(71/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 809 kB/s | 47 kB 00:00 2023-08-31T18:43:49.014 INFO:teuthology.orchestra.run.smithi146.stdout:(72/139): libselinux-devel-2.9-8.el8.x86_64.rpm 3.4 MB/s | 200 kB 00:00 2023-08-31T18:43:49.072 INFO:teuthology.orchestra.run.smithi146.stdout:(73/139): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-08-31T18:43:49.098 INFO:teuthology.orchestra.run.smithi146.stdout:(74/139): libquadmath-8.5.0-20.el8.x86_64.rpm 665 kB/s | 172 kB 00:00 2023-08-31T18:43:49.131 INFO:teuthology.orchestra.run.smithi146.stdout:(75/139): libuuid-devel-2.32.1-43.el8.x86_64.rp 1.7 MB/s | 100 kB 00:00 2023-08-31T18:43:49.156 INFO:teuthology.orchestra.run.smithi146.stdout:(76/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 308 kB/s | 18 kB 00:00 2023-08-31T18:43:49.190 INFO:teuthology.orchestra.run.smithi146.stdout:(77/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 748 kB/s | 44 kB 00:00 2023-08-31T18:43:49.291 INFO:teuthology.orchestra.run.smithi146.stdout:(78/139): pcre2-devel-10.32-3.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2023-08-31T18:43:49.374 INFO:teuthology.orchestra.run.smithi146.stdout:(79/139): openssl-devel-1.1.1k-9.el8.x86_64.rpm 15 MB/s | 3.2 MB 00:00 2023-08-31T18:43:49.401 INFO:teuthology.orchestra.run.smithi146.stdout:(80/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.1 MB/s | 229 kB 00:00 2023-08-31T18:43:49.433 INFO:teuthology.orchestra.run.smithi146.stdout:(81/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-08-31T18:43:49.458 INFO:teuthology.orchestra.run.smithi146.stdout:(82/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.2 MB/s | 249 kB 00:00 2023-08-31T18:43:49.501 INFO:teuthology.orchestra.run.smithi146.stdout:(83/139): python3-cryptography-3.2.1-6.el8.x86_ 9.3 MB/s | 641 kB 00:00 2023-08-31T18:43:49.517 INFO:teuthology.orchestra.run.smithi146.stdout:(84/139): python3-jwt-1.6.1-2.el8.noarch.rpm 727 kB/s | 43 kB 00:00 2023-08-31T18:43:49.559 INFO:teuthology.orchestra.run.smithi146.stdout:(85/139): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-08-31T18:43:49.585 INFO:teuthology.orchestra.run.smithi146.stdout:(86/139): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2023-08-31T18:43:49.610 INFO:teuthology.orchestra.run.smithi146.stdout:(87/139): python3-requests-oauthlib-1.0.0-1.el8 850 kB/s | 43 kB 00:00 2023-08-31T18:43:49.644 INFO:teuthology.orchestra.run.smithi146.stdout:(88/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.2 MB/s | 74 kB 00:00 2023-08-31T18:43:49.669 INFO:teuthology.orchestra.run.smithi146.stdout:(89/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 991 kB/s | 58 kB 00:00 2023-08-31T18:43:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:(90/139): gperftools-libs-2.7-9.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2023-08-31T18:43:49.869 INFO:teuthology.orchestra.run.smithi146.stdout:(91/139): leveldb-1.22-1.el8.x86_64.rpm 904 kB/s | 181 kB 00:00 2023-08-31T18:43:49.903 INFO:teuthology.orchestra.run.smithi146.stdout:(92/139): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-08-31T18:43:49.928 INFO:teuthology.orchestra.run.smithi146.stdout:(93/139): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-08-31T18:43:49.962 INFO:teuthology.orchestra.run.smithi146.stdout:(94/139): python3-apipkg-1.5-6.el8.noarch.rpm 362 kB/s | 21 kB 00:00 2023-08-31T18:43:49.987 INFO:teuthology.orchestra.run.smithi146.stdout:(95/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 743 kB/s | 44 kB 00:00 2023-08-31T18:43:50.013 INFO:teuthology.orchestra.run.smithi146.stdout:(96/139): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2023-08-31T18:43:50.038 INFO:teuthology.orchestra.run.smithi146.stdout:(97/139): python3-cachetools-3.1.1-4.el8.noarch 656 kB/s | 33 kB 00:00 2023-08-31T18:43:50.064 INFO:teuthology.orchestra.run.smithi146.stdout:(98/139): python3-certifi-2018.10.15-7.el8.noar 324 kB/s | 16 kB 00:00 2023-08-31T18:43:50.097 INFO:teuthology.orchestra.run.smithi146.stdout:(99/139): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2023-08-31T18:43:50.122 INFO:teuthology.orchestra.run.smithi146.stdout:(100/139): python3-cherrypy-18.4.0-1.el8.noarch 6.4 MB/s | 384 kB 00:00 2023-08-31T18:43:50.181 INFO:teuthology.orchestra.run.smithi146.stdout:(101/139): python3-google-auth-1.1.1-10.el8.noa 1.4 MB/s | 81 kB 00:00 2023-08-31T18:43:50.215 INFO:teuthology.orchestra.run.smithi146.stdout:(102/139): python3-execnet-1.7.1-1.el8.noarch.r 3.0 MB/s | 355 kB 00:00 2023-08-31T18:43:50.240 INFO:teuthology.orchestra.run.smithi146.stdout:(103/139): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2023-08-31T18:43:50.265 INFO:teuthology.orchestra.run.smithi146.stdout:(104/139): python3-jaraco-functools-2.0-4.el8.n 352 kB/s | 18 kB 00:00 2023-08-31T18:43:50.349 INFO:teuthology.orchestra.run.smithi146.stdout:(105/139): python3-logutils-0.3.5-11.el8.noarch 585 kB/s | 49 kB 00:00 2023-08-31T18:43:50.391 INFO:teuthology.orchestra.run.smithi146.stdout:(106/139): python3-kubernetes-11.0.0-6.el8.noar 7.8 MB/s | 1.2 MB 00:00 2023-08-31T18:43:50.417 INFO:teuthology.orchestra.run.smithi146.stdout:(107/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 269 kB/s | 561 kB 00:02 2023-08-31T18:43:50.442 INFO:teuthology.orchestra.run.smithi146.stdout:(108/139): python3-more-itertools-7.2.0-3.el8.n 637 kB/s | 59 kB 00:00 2023-08-31T18:43:50.467 INFO:teuthology.orchestra.run.smithi146.stdout:(109/139): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-08-31T18:43:50.500 INFO:teuthology.orchestra.run.smithi146.stdout:(110/139): python3-remoto-1.2.1-1.el8.noarch.rp 843 kB/s | 49 kB 00:00 2023-08-31T18:43:50.526 INFO:teuthology.orchestra.run.smithi146.stdout:(111/139): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-08-31T18:43:50.551 INFO:teuthology.orchestra.run.smithi146.stdout:(112/139): python3-repoze-lru-0.7-6.el8.noarch. 401 kB/s | 34 kB 00:00 2023-08-31T18:43:50.576 INFO:teuthology.orchestra.run.smithi146.stdout:(113/139): python3-routes-2.4.1-12.el8.noarch.r 2.5 MB/s | 196 kB 00:00 2023-08-31T18:43:50.601 INFO:teuthology.orchestra.run.smithi146.stdout:(114/139): python3-simplegeneric-0.8.1-17.el8.n 372 kB/s | 19 kB 00:00 2023-08-31T18:43:50.635 INFO:teuthology.orchestra.run.smithi146.stdout:(115/139): python3-rsa-4.9-2.el8.noarch.rpm 590 kB/s | 64 kB 00:00 2023-08-31T18:43:50.660 INFO:teuthology.orchestra.run.smithi146.stdout:(116/139): python3-singledispatch-3.4.0.3-18.el 286 kB/s | 24 kB 00:00 2023-08-31T18:43:50.685 INFO:teuthology.orchestra.run.smithi146.stdout:(117/139): python3-tempora-1.14.1-5.el8.noarch. 350 kB/s | 29 kB 00:00 2023-08-31T18:43:50.711 INFO:teuthology.orchestra.run.smithi146.stdout:(118/139): python3-trustme-0.6.0-4.el8.noarch.r 365 kB/s | 27 kB 00:00 2023-08-31T18:43:50.736 INFO:teuthology.orchestra.run.smithi146.stdout:(119/139): python3-waitress-1.4.3-1.el8.noarch. 3.3 MB/s | 255 kB 00:00 2023-08-31T18:43:50.761 INFO:teuthology.orchestra.run.smithi146.stdout:(120/139): python3-webob-1.8.5-1.el8.1.noarch.r 3.3 MB/s | 251 kB 00:00 2023-08-31T18:43:50.787 INFO:teuthology.orchestra.run.smithi146.stdout:(121/139): python3-websocket-client-0.56.0-5.el 813 kB/s | 61 kB 00:00 2023-08-31T18:43:50.811 INFO:teuthology.orchestra.run.smithi146.stdout:(122/139): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2023-08-31T18:43:50.838 INFO:teuthology.orchestra.run.smithi146.stdout:(123/139): python3-zc-lockfile-2.0-2.el8.noarch 304 kB/s | 23 kB 00:00 2023-08-31T18:43:50.954 INFO:teuthology.orchestra.run.smithi146.stdout:(124/139): NetworkManager-initscripts-updown-1. 1.2 MB/s | 143 kB 00:00 2023-08-31T18:43:51.013 INFO:teuthology.orchestra.run.smithi146.stdout:(125/139): elfutils-debuginfod-client-0.189-3.e 1.3 MB/s | 76 kB 00:00 2023-08-31T18:43:51.105 INFO:teuthology.orchestra.run.smithi146.stdout:(126/139): elfutils-libelf-0.189-3.el8.x86_64.r 2.5 MB/s | 232 kB 00:00 2023-08-31T18:43:51.180 INFO:teuthology.orchestra.run.smithi146.stdout:(127/139): librados2-16.2.14-21.gb8d3759e.el8.x 9.5 MB/s | 3.7 MB 00:00 2023-08-31T18:43:51.222 INFO:teuthology.orchestra.run.smithi146.stdout:(128/139): elfutils-libs-0.189-3.el8.x86_64.rpm 2.5 MB/s | 303 kB 00:00 2023-08-31T18:43:51.281 INFO:teuthology.orchestra.run.smithi146.stdout:(129/139): libblkid-2.32.1-43.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-08-31T18:43:51.348 INFO:teuthology.orchestra.run.smithi146.stdout:(130/139): librbd1-16.2.14-21.gb8d3759e.el8.x86 7.8 MB/s | 4.2 MB 00:00 2023-08-31T18:43:51.373 INFO:teuthology.orchestra.run.smithi146.stdout:(131/139): libfdisk-2.32.1-43.el8.x86_64.rpm 2.7 MB/s | 254 kB 00:00 2023-08-31T18:43:51.431 INFO:teuthology.orchestra.run.smithi146.stdout:(132/139): libsmartcols-2.32.1-43.el8.x86_64.rp 3.0 MB/s | 179 kB 00:00 2023-08-31T18:43:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:(133/139): iproute-6.2.0-2.el8.x86_64.rpm 2.9 MB/s | 880 kB 00:00 2023-08-31T18:43:51.499 INFO:teuthology.orchestra.run.smithi146.stdout:(134/139): libuuid-2.32.1-43.el8.x86_64.rpm 1.4 MB/s | 99 kB 00:00 2023-08-31T18:43:51.557 INFO:teuthology.orchestra.run.smithi146.stdout:(135/139): util-linux-user-2.32.1-43.el8.x86_64 1.7 MB/s | 103 kB 00:00 2023-08-31T18:43:51.591 INFO:teuthology.orchestra.run.smithi146.stdout:(136/139): libmount-2.32.1-43.el8.x86_64.rpm 975 kB/s | 236 kB 00:00 2023-08-31T18:43:51.633 INFO:teuthology.orchestra.run.smithi146.stdout:(137/139): util-linux-2.32.1-43.el8.x86_64.rpm 16 MB/s | 2.5 MB 00:00 2023-08-31T18:43:51.658 INFO:teuthology.orchestra.run.smithi146.stdout:(138/139): xfsdump-3.1.8-6.el8.x86_64.rpm 3.3 MB/s | 334 kB 00:00 2023-08-31T18:43:51.725 INFO:teuthology.orchestra.run.smithi146.stdout:(139/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 8.1 MB/s | 1.1 MB 00:00 2023-08-31T18:43:51.727 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2023-08-31T18:43:51.728 INFO:teuthology.orchestra.run.smithi146.stdout:Total 8.9 MB/s | 209 MB 00:23 2023-08-31T18:43:53.442 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2023-08-31T18:43:53.852 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2023-08-31T18:43:53.852 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2023-08-31T18:43:55.418 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2023-08-31T18:43:55.421 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2023-08-31T18:44:00.543 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2023-08-31T18:44:00.603 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/1 2023-08-31T18:44:00.746 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 1/155 2023-08-31T18:44:00.845 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/155 2023-08-31T18:44:01.004 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 2/155 2023-08-31T18:44:01.104 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 2/155 2023-08-31T18:44:01.298 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-08-31T18:44:01.540 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/155 2023-08-31T18:44:01.751 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/155 2023-08-31T18:44:01.964 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-08-31T18:44:02.162 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-08-31T18:44:02.578 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-08-31T18:44:02.970 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:16.2.14-21.gb8d3759e.el8.x86_64 8/155 2023-08-31T18:44:03.433 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:16.2.14-21.gb8d3759e.el8.x86_64 8/155 2023-08-31T18:44:03.612 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:16.2.14-21.gb8d3759e.el8.x86_64 9/155 2023-08-31T18:44:03.758 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:16.2.14-21.gb8d3759e.el8.x86_64 9/155 2023-08-31T18:44:03.937 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs2-2:16.2.14-21.gb8d3759e.el8.x86_64 10/155 2023-08-31T18:44:04.053 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:16.2.14-21.gb8d3759e.el8.x86_64 10/155 2023-08-31T18:44:04.280 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rados-2:16.2.14-21.gb8d3759e.el8.x86_64 11/155 2023-08-31T18:44:04.445 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-08-31T18:44:04.850 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-08-31T18:44:05.012 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librgw2-2:16.2.14-21.gb8d3759e.el8.x86_64 13/155 2023-08-31T18:44:05.228 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:16.2.14-21.gb8d3759e.el8.x86_64 13/155 2023-08-31T18:44:05.444 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - BaseOS 475 kB/s | 47 MB 01:40 2023-08-31T18:44:05.465 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-08-31T18:44:05.541 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-08-31T18:44:05.780 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-08-31T18:44:05.961 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-08-31T18:44:06.120 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephsqlite-2:16.2.14-21.gb8d3759e.el8.x86_64 17/155 2023-08-31T18:44:06.241 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:16.2.14-21.gb8d3759e.el8.x86_64 17/155 2023-08-31T18:44:06.378 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libradosstriper1-2:16.2.14-21.gb8d3759e.el8.x86_ 18/155 2023-08-31T18:44:06.526 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:16.2.14-21.gb8d3759e.el8.x86_ 18/155 2023-08-31T18:44:06.713 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-08-31T18:44:06.867 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-08-31T18:44:07.020 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-08-31T18:44:07.185 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-08-31T18:44:07.328 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-08-31T18:44:07.993 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-08-31T18:44:08.187 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-08-31T18:44:08.871 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-08-31T18:44:09.036 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-08-31T18:44:09.887 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-08-31T18:44:10.257 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-08-31T18:44:10.454 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-08-31T18:44:10.618 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/155 2023-08-31T18:44:10.857 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-08-31T18:44:11.059 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-common-2:16.2.14-21.gb8d3759e.el8.x 29/155 2023-08-31T18:44:11.202 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-argparse-2:16.2.14-21.gb8d3759e.el8 30/155 2023-08-31T18:44:11.454 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cephfs-2:16.2.14-21.gb8d3759e.el8.x86_64 31/155 2023-08-31T18:44:12.564 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-08-31T18:44:12.903 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-08-31T18:44:13.047 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras 42 kB/s | 18 kB 00:00 2023-08-31T18:44:13.190 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-08-31T18:44:13.402 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-08-31T18:44:13.806 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.8 kB 00:00 2023-08-31T18:44:15.025 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - PowerTools 6.1 MB/s | 6.5 MB 00:01 2023-08-31T18:44:15.511 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-08-31T18:44:15.823 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-08-31T18:44:16.019 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-08-31T18:44:16.197 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-08-31T18:44:16.423 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rgw-2:16.2.14-21.gb8d3759e.el8.x86_64 39/155 2023-08-31T18:44:16.553 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-08-31T18:44:16.624 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rbd-2:16.2.14-21.gb8d3759e.el8.x86_64 40/155 2023-08-31T18:44:16.854 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librados-devel-2:16.2.14-21.gb8d3759e.el8.x86_64 41/155 2023-08-31T18:44:17.036 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 42/155 2023-08-31T18:44:17.220 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 43/155 2023-08-31T18:44:17.460 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/155 2023-08-31T18:44:17.549 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/155 2023-08-31T18:44:17.743 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/155 2023-08-31T18:44:17.833 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/155 2023-08-31T18:44:17.999 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 46/155 2023-08-31T18:44:18.177 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-08-31T18:44:18.756 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-08-31T18:44:19.019 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/155 2023-08-31T18:44:19.049 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/155 2023-08-31T18:44:19.206 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 6.3 MB/s | 16 MB 00:02 2023-08-31T18:44:19.235 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-08-31T18:44:19.486 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-08-31T18:44:19.693 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-08-31T18:44:19.848 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-08-31T18:44:20.014 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-08-31T18:44:20.208 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-08-31T18:44:20.408 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-08-31T18:44:20.597 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/155 2023-08-31T18:44:20.741 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/155 2023-08-31T18:44:20.908 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/155 2023-08-31T18:44:21.075 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 59/155 2023-08-31T18:44:21.253 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-portend-2.6-1.el8.noarch 60/155 2023-08-31T18:44:21.431 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 61/155 2023-08-31T18:44:21.630 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 62/155 2023-08-31T18:44:21.868 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 63/155 2023-08-31T18:44:22.070 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 64/155 2023-08-31T18:44:22.402 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 65/155 2023-08-31T18:44:22.659 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 66/155 2023-08-31T18:44:22.904 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 67/155 2023-08-31T18:44:23.130 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 68/155 2023-08-31T18:44:23.327 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 69/155 2023-08-31T18:44:23.522 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 70/155 2023-08-31T18:44:23.632 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 357 kB/s | 24 kB 00:00 2023-08-31T18:44:23.745 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 71/155 2023-08-31T18:44:23.979 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/155 2023-08-31T18:44:24.364 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/155 2023-08-31T18:44:24.616 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/155 2023-08-31T18:44:24.808 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/155 2023-08-31T18:44:25.084 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/155 2023-08-31T18:44:25.321 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/155 2023-08-31T18:44:26.621 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/155 2023-08-31T18:44:26.852 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/155 2023-08-31T18:44:27.100 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 80/155 2023-08-31T18:44:27.385 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/155 2023-08-31T18:44:27.670 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/155 2023-08-31T18:44:27.938 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/155 2023-08-31T18:44:28.151 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T18:44:28.151 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T18:44:28.155 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 84/155 2023-08-31T18:44:28.165 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-08-31T18:44:28.165 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-08-31T18:44:28.166 INFO:teuthology.orchestra.run.smithi072.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-08-31T18:44:28.167 INFO:teuthology.orchestra.run.smithi072.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-08-31T18:44:28.168 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-31T18:44:28.170 INFO:teuthology.orchestra.run.smithi072.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-31T18:44:28.173 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-31T18:44:28.174 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-31T18:44:28.383 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-08-31T18:44:28.396 INFO:teuthology.orchestra.run.smithi072.stdout:==================================================================================================== 2023-08-31T18:44:28.396 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2023-08-31T18:44:28.396 INFO:teuthology.orchestra.run.smithi072.stdout:==================================================================================================== 2023-08-31T18:44:28.397 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2023-08-31T18:44:28.397 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-08-31T18:44:28.397 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 6.4 k 2023-08-31T18:44:28.397 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 6.1 M 2023-08-31T18:44:28.397 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 910 k 2023-08-31T18:44:28.398 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 161 k 2023-08-31T18:44:28.398 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 1.6 M 2023-08-31T18:44:28.398 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 116 k 2023-08-31T18:44:28.398 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 3.1 M 2023-08-31T18:44:28.398 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 8.6 M 2023-08-31T18:44:28.399 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 27 k 2023-08-31T18:44:28.399 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 12 M 2023-08-31T18:44:28.399 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 52 M 2023-08-31T18:44:28.399 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 84 k 2023-08-31T18:44:28.399 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 256 k 2023-08-31T18:44:28.400 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 19 k 2023-08-31T18:44:28.400 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-08-31T18:44:28.400 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-08-31T18:44:28.400 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-08-31T18:44:28.400 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 25 k 2023-08-31T18:44:28.401 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 824 k 2023-08-31T18:44:28.401 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 131 k 2023-08-31T18:44:28.401 INFO:teuthology.orchestra.run.smithi072.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-08-31T18:44:28.401 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-08-31T18:44:28.401 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-08-31T18:44:28.402 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 215 k 2023-08-31T18:44:28.402 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 390 k 2023-08-31T18:44:28.402 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 369 k 2023-08-31T18:44:28.402 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 114 k 2023-08-31T18:44:28.402 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 88 k 2023-08-31T18:44:28.403 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 3.7 M 2023-08-31T18:44:28.403 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 173 k 2023-08-31T18:44:28.403 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-08-31T18:44:28.403 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2023-08-31T18:44:28.403 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-08-31T18:44:28.404 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-08-31T18:44:28.404 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-08-31T18:44:28.404 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-08-31T18:44:28.404 INFO:teuthology.orchestra.run.smithi072.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-08-31T18:44:28.404 INFO:teuthology.orchestra.run.smithi072.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-08-31T18:44:28.405 INFO:teuthology.orchestra.run.smithi072.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-08-31T18:44:28.405 INFO:teuthology.orchestra.run.smithi072.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-08-31T18:44:28.405 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 3.7 M 2023-08-31T18:44:28.405 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 4.2 M 2023-08-31T18:44:28.405 INFO:teuthology.orchestra.run.smithi072.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-08-31T18:44:28.406 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-08-31T18:44:28.406 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-08-31T18:44:28.406 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-08-31T18:44:28.406 INFO:teuthology.orchestra.run.smithi072.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-08-31T18:44:28.406 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-08-31T18:44:28.407 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2023-08-31T18:44:28.407 INFO:teuthology.orchestra.run.smithi072.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-08-31T18:44:28.407 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 24 M 2023-08-31T18:44:28.407 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 24 k 2023-08-31T18:44:28.407 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 2.4 M 2023-08-31T18:44:28.408 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 244 k 2023-08-31T18:44:28.408 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 5.0 M 2023-08-31T18:44:28.408 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 18 M 2023-08-31T18:44:28.408 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:16.2.14-21.gb8d3759e.el8 ceph-noarch 15 k 2023-08-31T18:44:28.408 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 26 k 2023-08-31T18:44:28.409 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-08-31T18:44:28.409 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-31T18:44:28.409 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-08-31T18:44:28.409 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-08-31T18:44:28.409 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-08-31T18:44:28.409 INFO:teuthology.orchestra.run.smithi072.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-08-31T18:44:28.410 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 174 k 2023-08-31T18:44:28.410 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-08-31T18:44:28.410 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-08-31T18:44:28.410 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-31T18:44:28.410 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-08-31T18:44:28.411 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-08-31T18:44:28.411 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 493 k 2023-08-31T18:44:28.411 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-08-31T18:44:28.411 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 3.8 M 2023-08-31T18:44:28.411 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-08-31T18:44:28.412 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-08-31T18:44:28.412 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-31T18:44:28.412 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-08-31T18:44:28.412 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-08-31T18:44:28.412 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-08-31T18:44:28.413 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-08-31T18:44:28.413 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-08-31T18:44:28.413 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-08-31T18:44:28.413 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-08-31T18:44:28.413 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-08-31T18:44:28.413 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-08-31T18:44:28.414 INFO:teuthology.orchestra.run.smithi072.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-08-31T18:44:28.414 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-08-31T18:44:28.414 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-31T18:44:28.414 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-31T18:44:28.414 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-31T18:44:28.415 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 45 k 2023-08-31T18:44:28.415 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:16.2.14-21.gb8d3759e.el8 ceph 99 k 2023-08-31T18:44:28.415 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-31T18:44:28.415 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-08-31T18:44:28.415 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-31T18:44:28.415 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-31T18:44:28.416 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-08-31T18:44:28.416 INFO:teuthology.orchestra.run.smithi072.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-08-31T18:44:28.416 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-31T18:44:28.416 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-31T18:44:28.416 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-31T18:44:28.417 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-08-31T18:44:28.417 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-08-31T18:44:28.417 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-08-31T18:44:28.417 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-08-31T18:44:28.417 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-31T18:44:28.418 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-31T18:44:28.418 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-08-31T18:44:28.418 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-08-31T18:44:28.418 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-31T18:44:28.418 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-08-31T18:44:28.419 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-08-31T18:44:28.419 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-08-31T18:44:28.419 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-31T18:44:28.419 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-31T18:44:28.419 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-08-31T18:44:28.420 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-08-31T18:44:28.420 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-08-31T18:44:28.420 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-08-31T18:44:28.420 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-08-31T18:44:28.420 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-08-31T18:44:28.420 INFO:teuthology.orchestra.run.smithi072.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-08-31T18:44:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-31T18:44:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-08-31T18:44:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-31T18:44:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-31T18:44:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-08-31T18:44:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-31T18:44:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-31T18:44:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-31T18:44:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-31T18:44:28.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-31T18:44:28.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-31T18:44:28.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-31T18:44:28.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-31T18:44:28.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-08-31T18:44:28.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-31T18:44:28.424 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-08-31T18:44:28.424 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-08-31T18:44:28.424 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-08-31T18:44:28.424 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:44:28.425 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-08-31T18:44:28.425 INFO:teuthology.orchestra.run.smithi072.stdout:==================================================================================================== 2023-08-31T18:44:28.425 INFO:teuthology.orchestra.run.smithi072.stdout:Install 123 Packages 2023-08-31T18:44:28.425 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 16 Packages 2023-08-31T18:44:28.425 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:44:28.426 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 209 M 2023-08-31T18:44:28.426 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-08-31T18:44:28.505 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 85/155 2023-08-31T18:44:28.714 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 86/155 2023-08-31T18:44:28.869 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 87/155 2023-08-31T18:44:28.886 INFO:teuthology.orchestra.run.smithi072.stdout:(1/139): ceph-16.2.14-21.gb8d3759e.el8.x86_64.r 35 kB/s | 6.4 kB 00:00 2023-08-31T18:44:29.054 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 88/155 2023-08-31T18:44:29.367 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 89/155 2023-08-31T18:44:29.619 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 90/155 2023-08-31T18:44:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 91/155 2023-08-31T18:44:29.976 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 92/155 2023-08-31T18:44:30.186 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 93/155 2023-08-31T18:44:30.196 INFO:teuthology.orchestra.run.smithi072.stdout:(2/139): ceph-common-16.2.14-21.gb8d3759e.el8.x 16 MB/s | 24 MB 00:01 2023-08-31T18:44:30.238 INFO:teuthology.orchestra.run.smithi072.stdout:(3/139): ceph-fuse-16.2.14-21.gb8d3759e.el8.x86 673 kB/s | 910 kB 00:01 2023-08-31T18:44:30.264 INFO:teuthology.orchestra.run.smithi072.stdout:(4/139): ceph-immutable-object-cache-16.2.14-21 2.3 MB/s | 161 kB 00:00 2023-08-31T18:44:30.389 INFO:teuthology.orchestra.run.smithi072.stdout:(5/139): ceph-mgr-16.2.14-21.gb8d3759e.el8.x86_ 13 MB/s | 1.6 MB 00:00 2023-08-31T18:44:30.400 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-2.9.7-17.el8.x86_64 94/155 2023-08-31T18:44:30.662 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 95/155 2023-08-31T18:44:30.723 INFO:teuthology.orchestra.run.smithi072.stdout:(6/139): ceph-mon-16.2.14-21.gb8d3759e.el8.x86_ 15 MB/s | 5.0 MB 00:00 2023-08-31T18:44:30.851 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 96/155 2023-08-31T18:44:31.016 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 97/155 2023-08-31T18:44:31.582 INFO:teuthology.orchestra.run.smithi072.stdout:(7/139): ceph-base-16.2.14-21.gb8d3759e.el8.x86 2.1 MB/s | 6.1 MB 00:02 2023-08-31T18:44:31.975 INFO:teuthology.orchestra.run.smithi072.stdout:(8/139): ceph-osd-16.2.14-21.gb8d3759e.el8.x86_ 15 MB/s | 18 MB 00:01 2023-08-31T18:44:32.042 INFO:teuthology.orchestra.run.smithi072.stdout:(9/139): ceph-mds-16.2.14-21.gb8d3759e.el8.x86_ 1.4 MB/s | 2.4 MB 00:01 2023-08-31T18:44:32.067 INFO:teuthology.orchestra.run.smithi072.stdout:(10/139): ceph-selinux-16.2.14-21.gb8d3759e.el8 278 kB/s | 26 kB 00:00 2023-08-31T18:44:32.118 INFO:teuthology.orchestra.run.smithi072.stdout:(11/139): cephfs-mirror-16.2.14-21.gb8d3759e.el 5.0 MB/s | 256 kB 00:00 2023-08-31T18:44:32.168 INFO:teuthology.orchestra.run.smithi072.stdout:(12/139): libcephfs-devel-16.2.14-21.gb8d3759e. 511 kB/s | 25 kB 00:00 2023-08-31T18:44:32.252 INFO:teuthology.orchestra.run.smithi072.stdout:(13/139): libcephfs2-16.2.14-21.gb8d3759e.el8.x 9.7 MB/s | 824 kB 00:00 2023-08-31T18:44:32.311 INFO:teuthology.orchestra.run.smithi072.stdout:(14/139): libcephsqlite-16.2.14-21.gb8d3759e.el 2.9 MB/s | 174 kB 00:00 2023-08-31T18:44:32.370 INFO:teuthology.orchestra.run.smithi072.stdout:(15/139): librados-devel-16.2.14-21.gb8d3759e.e 2.2 MB/s | 131 kB 00:00 2023-08-31T18:44:32.445 INFO:teuthology.orchestra.run.smithi072.stdout:(16/139): libradosstriper1-16.2.14-21.gb8d3759e 6.5 MB/s | 493 kB 00:00 2023-08-31T18:44:32.739 INFO:teuthology.orchestra.run.smithi072.stdout:(17/139): librgw2-16.2.14-21.gb8d3759e.el8.x86_ 13 MB/s | 3.8 MB 00:00 2023-08-31T18:44:32.790 INFO:teuthology.orchestra.run.smithi072.stdout:(18/139): python3-ceph-argparse-16.2.14-21.gb8d 900 kB/s | 45 kB 00:00 2023-08-31T18:44:32.849 INFO:teuthology.orchestra.run.smithi072.stdout:(19/139): python3-ceph-common-16.2.14-21.gb8d37 1.6 MB/s | 99 kB 00:00 2023-08-31T18:44:32.916 INFO:teuthology.orchestra.run.smithi072.stdout:(20/139): python3-cephfs-16.2.14-21.gb8d3759e.e 3.2 MB/s | 215 kB 00:00 2023-08-31T18:44:32.983 INFO:teuthology.orchestra.run.smithi072.stdout:(21/139): python3-rados-16.2.14-21.gb8d3759e.el 5.7 MB/s | 390 kB 00:00 2023-08-31T18:44:33.042 INFO:teuthology.orchestra.run.smithi072.stdout:(22/139): python3-rbd-16.2.14-21.gb8d3759e.el8. 6.2 MB/s | 369 kB 00:00 2023-08-31T18:44:33.101 INFO:teuthology.orchestra.run.smithi072.stdout:(23/139): python3-rgw-16.2.14-21.gb8d3759e.el8. 1.9 MB/s | 114 kB 00:00 2023-08-31T18:44:33.168 INFO:teuthology.orchestra.run.smithi072.stdout:(24/139): rbd-fuse-16.2.14-21.gb8d3759e.el8.x86 1.3 MB/s | 88 kB 00:00 2023-08-31T18:44:33.469 INFO:teuthology.orchestra.run.smithi072.stdout:(25/139): rbd-mirror-16.2.14-21.gb8d3759e.el8.x 12 MB/s | 3.7 MB 00:00 2023-08-31T18:44:33.536 INFO:teuthology.orchestra.run.smithi072.stdout:(26/139): rbd-nbd-16.2.14-21.gb8d3759e.el8.x86_ 2.5 MB/s | 173 kB 00:00 2023-08-31T18:44:33.586 INFO:teuthology.orchestra.run.smithi072.stdout:(27/139): ceph-grafana-dashboards-16.2.14-21.gb 488 kB/s | 24 kB 00:00 2023-08-31T18:44:33.653 INFO:teuthology.orchestra.run.smithi072.stdout:(28/139): ceph-mgr-cephadm-16.2.14-21.gb8d3759e 1.7 MB/s | 116 kB 00:00 2023-08-31T18:44:33.746 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:16.2.14-21.gb8d3759e.el8.x86_64 98/155 2023-08-31T18:44:33.904 INFO:teuthology.orchestra.run.smithi072.stdout:(29/139): ceph-mgr-dashboard-16.2.14-21.gb8d375 12 MB/s | 3.1 MB 00:00 2023-08-31T18:44:34.075 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-common-2:16.2.14-21.gb8d3759e.el8.x86_64 98/155 2023-08-31T18:44:34.479 INFO:teuthology.orchestra.run.smithi072.stdout:(30/139): ceph-radosgw-16.2.14-21.gb8d3759e.el8 4.0 MB/s | 12 MB 00:02 2023-08-31T18:44:34.665 INFO:teuthology.orchestra.run.smithi072.stdout:(31/139): ceph-mgr-diskprediction-local-16.2.14 11 MB/s | 8.6 MB 00:00 2023-08-31T18:44:34.782 INFO:teuthology.orchestra.run.smithi072.stdout:(32/139): ceph-mgr-modules-core-16.2.14-21.gb8d 809 kB/s | 244 kB 00:00 2023-08-31T18:44:34.808 INFO:teuthology.orchestra.run.smithi072.stdout:(33/139): ceph-mgr-rook-16.2.14-21.gb8d3759e.el 193 kB/s | 27 kB 00:00 2023-08-31T18:44:34.841 INFO:teuthology.orchestra.run.smithi072.stdout:(34/139): ceph-prometheus-alerts-16.2.14-21.gb8 251 kB/s | 15 kB 00:00 2023-08-31T18:44:34.867 INFO:teuthology.orchestra.run.smithi072.stdout:(35/139): cephadm-16.2.14-21.gb8d3759e.el8.noar 1.4 MB/s | 84 kB 00:00 2023-08-31T18:44:34.873 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:16.2.14-21.gb8d3759e.el8.x86_64 98/155 2023-08-31T18:44:34.901 INFO:teuthology.orchestra.run.smithi072.stdout:(36/139): cephfs-top-16.2.14-21.gb8d3759e.el8.n 315 kB/s | 19 kB 00:00 2023-08-31T18:44:35.184 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-base-2:16.2.14-21.gb8d3759e.el8.x86_64 99/155 2023-08-31T18:44:35.387 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:16.2.14-21.gb8d3759e.el8.x86_64 99/155 2023-08-31T18:44:35.532 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-selinux-2:16.2.14-21.gb8d3759e.el8.x86_64 100/155 2023-08-31T18:44:36.852 INFO:teuthology.orchestra.run.smithi072.stdout:(37/139): ceph-test-16.2.14-21.gb8d3759e.el8.x8 11 MB/s | 52 MB 00:04 2023-08-31T18:44:48.277 INFO:teuthology.orchestra.run.smithi072.stdout:(38/139): automake-1.16.1-8.el8.noarch.rpm 55 kB/s | 740 kB 00:13 2023-08-31T18:44:48.486 INFO:teuthology.orchestra.run.smithi072.stdout:(39/139): jq-1.6-7.el8.x86_64.rpm 971 kB/s | 202 kB 00:00 2023-08-31T18:44:48.778 INFO:teuthology.orchestra.run.smithi072.stdout:(40/139): librdkafka-0.11.4-3.el8.x86_64.rpm 1.2 MB/s | 354 kB 00:00 2023-08-31T18:44:49.203 INFO:teuthology.orchestra.run.smithi072.stdout:(41/139): libtool-2.4.6-25.el8.x86_64.rpm 1.6 MB/s | 709 kB 00:00 2023-08-31T18:44:49.387 INFO:teuthology.orchestra.run.smithi072.stdout:(42/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.4 MB/s | 259 kB 00:00 2023-08-31T18:44:49.538 INFO:teuthology.orchestra.run.smithi072.stdout:(43/139): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-08-31T18:44:50.807 INFO:teuthology.orchestra.run.smithi072.stdout:(44/139): openblas-0.3.15-4.el8.x86_64.rpm 3.7 MB/s | 4.7 MB 00:01 2023-08-31T18:44:51.482 INFO:teuthology.orchestra.run.smithi072.stdout:(45/139): openblas-threads-0.3.15-4.el8.x86_64. 7.2 MB/s | 4.9 MB 00:00 2023-08-31T18:44:52.066 INFO:teuthology.orchestra.run.smithi072.stdout:(46/139): python3-babel-2.5.1-7.el8.noarch.rpm 8.2 MB/s | 4.8 MB 00:00 2023-08-31T18:44:52.266 INFO:teuthology.orchestra.run.smithi072.stdout:(47/139): python3-jinja2-2.10.1-3.el8.noarch.rp 2.6 MB/s | 538 kB 00:00 2023-08-31T18:44:53.184 INFO:teuthology.orchestra.run.smithi072.stdout:(48/139): python3-jsonpatch-1.21-2.el8.noarch.r 29 kB/s | 27 kB 00:00 2023-08-31T18:44:53.426 INFO:teuthology.orchestra.run.smithi072.stdout:(49/139): python3-jsonpointer-1.10-11.el8.noarc 82 kB/s | 20 kB 00:00 2023-08-31T18:44:54.118 INFO:teuthology.orchestra.run.smithi072.stdout:(50/139): python3-mako-1.0.6-14.el8.noarch.rpm 227 kB/s | 157 kB 00:00 2023-08-31T18:44:54.336 INFO:teuthology.orchestra.run.smithi072.stdout:(51/139): python3-markupsafe-0.23-19.el8.x86_64 179 kB/s | 39 kB 00:00 2023-08-31T18:44:55.533 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:16.2.14-21.gb8d3759e.el8.x86_64 100/155 2023-08-31T18:44:55.533 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /sys 2023-08-31T18:44:55.533 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /proc 2023-08-31T18:44:55.533 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /dev 2023-08-31T18:44:55.534 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /run 2023-08-31T18:44:55.534 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /mnt 2023-08-31T18:44:55.534 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /var/tmp 2023-08-31T18:44:55.534 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /home 2023-08-31T18:44:55.535 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /tmp 2023-08-31T18:44:55.535 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /dev 2023-08-31T18:44:55.535 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:44:55.963 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mds-2:16.2.14-21.gb8d3759e.el8.x86_64 101/155 2023-08-31T18:44:56.452 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:16.2.14-21.gb8d3759e.el8.x86_64 101/155 2023-08-31T18:44:56.477 INFO:teuthology.orchestra.run.smithi072.stdout:(52/139): python3-numpy-1.14.3-10.el8.x86_64.rp 1.7 MB/s | 3.7 MB 00:02 2023-08-31T18:44:56.620 INFO:teuthology.orchestra.run.smithi072.stdout:(53/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.6 MB/s | 225 kB 00:00 2023-08-31T18:44:56.679 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mon-2:16.2.14-21.gb8d3759e.el8.x86_64 102/155 2023-08-31T18:44:56.762 INFO:teuthology.orchestra.run.smithi072.stdout:(54/139): python3-prettytable-0.7.2-14.el8.noar 309 kB/s | 44 kB 00:00 2023-08-31T18:44:56.937 INFO:teuthology.orchestra.run.smithi072.stdout:(55/139): bison-3.0.4-10.el8.x86_64.rpm 31 kB/s | 688 kB 00:22 2023-08-31T18:44:56.963 INFO:teuthology.orchestra.run.smithi072.stdout:(56/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 516 kB/s | 103 kB 00:00 2023-08-31T18:44:57.088 INFO:teuthology.orchestra.run.smithi072.stdout:(57/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 838 kB/s | 126 kB 00:00 2023-08-31T18:44:57.115 INFO:teuthology.orchestra.run.smithi072.stdout:(58/139): python3-pyasn1-modules-0.3.7-6.el8.no 722 kB/s | 110 kB 00:00 2023-08-31T18:44:57.242 INFO:teuthology.orchestra.run.smithi072.stdout:(59/139): python3-pytz-2017.2-11.el8.noarch.rpm 374 kB/s | 57 kB 00:00 2023-08-31T18:44:57.533 INFO:teuthology.orchestra.run.smithi072.stdout:(60/139): python3-werkzeug-0.12.2-4.el8.noarch. 1.5 MB/s | 457 kB 00:00 2023-08-31T18:44:57.851 INFO:teuthology.orchestra.run.smithi072.stdout:(61/139): socat-1.7.4.1-1.el8.x86_64.rpm 1.0 MB/s | 323 kB 00:00 2023-08-31T18:44:58.001 INFO:teuthology.orchestra.run.smithi072.stdout:(62/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 471 kB/s | 71 kB 00:00 2023-08-31T18:44:58.305 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:16.2.14-21.gb8d3759e.el8.x86_64 102/155 2023-08-31T18:44:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:(63/139): elfutils-libelf-devel-0.189-3.el8.x86 172 kB/s | 62 kB 00:00 2023-08-31T18:44:58.521 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-osd-2:16.2.14-21.gb8d3759e.el8.x86_64 103/155 2023-08-31T18:44:58.583 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:16.2.14-21.gb8d3759e.el8.x86_64 103/155 2023-08-31T18:44:58.779 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-08-31T18:44:58.902 INFO:teuthology.orchestra.run.smithi072.stdout:(64/139): python3-scipy-1.0.0-21.module_el8.5.0 7.7 MB/s | 14 MB 00:01 2023-08-31T18:44:58.928 INFO:teuthology.orchestra.run.smithi072.stdout:(65/139): fuse-2.9.7-17.el8.x86_64.rpm 146 kB/s | 83 kB 00:00 2023-08-31T18:44:58.992 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-08-31T18:44:59.153 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-08-31T18:44:59.178 INFO:teuthology.orchestra.run.smithi072.stdout:(66/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 174 kB/s | 48 kB 00:00 2023-08-31T18:44:59.244 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-08-31T18:44:59.312 INFO:teuthology.orchestra.run.smithi072.stdout:(67/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 140 kB/s | 19 kB 00:00 2023-08-31T18:44:59.529 INFO:teuthology.orchestra.run.smithi072.stdout:(68/139): libcom_err-devel-1.45.6-5.el8.x86_64. 179 kB/s | 39 kB 00:00 2023-08-31T18:44:59.550 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-08-31T18:44:59.778 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : automake-1.16.1-8.el8.noarch 108/155 2023-08-31T18:45:00.376 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephadm-2:16.2.14-21.gb8d3759e.el8.noarch 109/155 2023-08-31T18:45:00.472 INFO:teuthology.orchestra.run.smithi072.stdout:(69/139): flex-2.6.1-9.el8.x86_64.rpm 14 kB/s | 320 kB 00:23 2023-08-31T18:45:00.574 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephadm-2:16.2.14-21.gb8d3759e.el8.noarch 109/155 2023-08-31T18:45:00.606 INFO:teuthology.orchestra.run.smithi072.stdout:[MIRROR] libquadmath-8.5.0-20.el8.x86_64.rpm: Status code: 503 for http://mirror.dal.nexril.net/centos/8-stream/BaseOS/x86_64/os/Packages/libquadmath-8.5.0-20.el8.x86_64.rpm (IP: 161.129.154.250) 2023-08-31T18:45:00.711 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-21.gb8d3759e.el 110/155 2023-08-31T18:45:00.806 INFO:teuthology.orchestra.run.smithi072.stdout:(70/139): libquadmath-8.5.0-20.el8.x86_64.rpm 516 kB/s | 172 kB 00:00 2023-08-31T18:45:00.856 INFO:teuthology.orchestra.run.smithi072.stdout:(71/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 940 kB/s | 47 kB 00:00 2023-08-31T18:45:00.919 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-21.gb8d3759e.e 111/155 2023-08-31T18:45:00.950 INFO:teuthology.orchestra.run.smithi072.stdout:(72/139): libselinux-devel-2.9-8.el8.x86_64.rpm 2.1 MB/s | 200 kB 00:00 2023-08-31T18:45:01.009 INFO:teuthology.orchestra.run.smithi072.stdout:(73/139): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-08-31T18:45:01.068 INFO:teuthology.orchestra.run.smithi072.stdout:(74/139): libuuid-devel-2.32.1-43.el8.x86_64.rp 1.7 MB/s | 100 kB 00:00 2023-08-31T18:45:01.127 INFO:teuthology.orchestra.run.smithi072.stdout:(75/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 309 kB/s | 18 kB 00:00 2023-08-31T18:45:01.145 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-21.gb8d3759e.el8.noar 112/155 2023-08-31T18:45:01.286 INFO:teuthology.orchestra.run.smithi072.stdout:(76/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 276 kB/s | 44 kB 00:00 2023-08-31T18:45:01.553 INFO:teuthology.orchestra.run.smithi072.stdout:(77/139): openssl-devel-1.1.1k-9.el8.x86_64.rpm 12 MB/s | 3.2 MB 00:00 2023-08-31T18:45:01.628 INFO:teuthology.orchestra.run.smithi072.stdout:(78/139): pcre2-devel-10.32-3.el8.x86_64.rpm 7.9 MB/s | 605 kB 00:00 2023-08-31T18:45:01.697 INFO:teuthology.orchestra.run.smithi072.stdout:(79/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.4 MB/s | 229 kB 00:00 2023-08-31T18:45:01.729 INFO:teuthology.orchestra.run.smithi072.stdout:(80/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 200 kB/s | 561 kB 00:02 2023-08-31T18:45:01.755 INFO:teuthology.orchestra.run.smithi072.stdout:(81/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-08-31T18:45:01.831 INFO:teuthology.orchestra.run.smithi072.stdout:(82/139): python3-cryptography-3.2.1-6.el8.x86_ 8.3 MB/s | 641 kB 00:00 2023-08-31T18:45:01.881 INFO:teuthology.orchestra.run.smithi072.stdout:(83/139): python3-jwt-1.6.1-2.el8.noarch.rpm 853 kB/s | 43 kB 00:00 2023-08-31T18:45:01.999 INFO:teuthology.orchestra.run.smithi072.stdout:(84/139): python3-oauthlib-2.1.0-1.el8.noarch.r 1.3 MB/s | 155 kB 00:00 2023-08-31T18:45:02.033 INFO:teuthology.orchestra.run.smithi072.stdout:(85/139): libgfortran-8.5.0-20.el8.x86_64.rpm 258 kB/s | 645 kB 00:02 2023-08-31T18:45:02.068 INFO:teuthology.orchestra.run.smithi072.stdout:(86/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 736 kB/s | 249 kB 00:00 2023-08-31T18:45:02.093 INFO:teuthology.orchestra.run.smithi072.stdout:(87/139): python3-pycparser-2.14-14.el8.noarch. 1.1 MB/s | 109 kB 00:00 2023-08-31T18:45:02.127 INFO:teuthology.orchestra.run.smithi072.stdout:(88/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.2 MB/s | 74 kB 00:00 2023-08-31T18:45:02.153 INFO:teuthology.orchestra.run.smithi072.stdout:(89/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 979 kB/s | 58 kB 00:00 2023-08-31T18:45:02.187 INFO:teuthology.orchestra.run.smithi072.stdout:(90/139): python3-requests-oauthlib-1.0.0-1.el8 277 kB/s | 43 kB 00:00 2023-08-31T18:45:02.278 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-21.gb8d3759e.el8.noar 112/155 2023-08-31T18:45:02.279 INFO:teuthology.orchestra.run.smithi072.stdout:(91/139): liboath-2.6.2-3.el8.x86_64.rpm 643 kB/s | 59 kB 00:00 2023-08-31T18:45:02.305 INFO:teuthology.orchestra.run.smithi072.stdout:(92/139): gperftools-libs-2.7-9.el8.x86_64.rpm 1.7 MB/s | 306 kB 00:00 2023-08-31T18:45:02.338 INFO:teuthology.orchestra.run.smithi072.stdout:(93/139): leveldb-1.22-1.el8.x86_64.rpm 980 kB/s | 181 kB 00:00 2023-08-31T18:45:02.364 INFO:teuthology.orchestra.run.smithi072.stdout:(94/139): python3-apipkg-1.5-6.el8.noarch.rpm 361 kB/s | 21 kB 00:00 2023-08-31T18:45:02.390 INFO:teuthology.orchestra.run.smithi072.stdout:(95/139): libunwind-1.3.1-3.el8.x86_64.rpm 684 kB/s | 75 kB 00:00 2023-08-31T18:45:02.415 INFO:teuthology.orchestra.run.smithi072.stdout:(96/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 572 kB/s | 44 kB 00:00 2023-08-31T18:45:02.441 INFO:teuthology.orchestra.run.smithi072.stdout:(97/139): python3-cachetools-3.1.1-4.el8.noarch 652 kB/s | 33 kB 00:00 2023-08-31T18:45:02.458 INFO:teuthology.orchestra.run.smithi072.stdout:(98/139): python3-certifi-2018.10.15-7.el8.noar 382 kB/s | 16 kB 00:00 2023-08-31T18:45:02.492 INFO:teuthology.orchestra.run.smithi072.stdout:(99/139): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-08-31T18:45:02.526 INFO:teuthology.orchestra.run.smithi072.stdout:(100/139): python3-cheroot-8.5.2-1.el8.noarch.r 2.0 MB/s | 173 kB 00:00 2023-08-31T18:45:02.561 INFO:teuthology.orchestra.run.smithi072.stdout:(101/139): python3-cherrypy-18.4.0-1.el8.noarch 3.7 MB/s | 384 kB 00:00 2023-08-31T18:45:02.562 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-21.gb8d3759e.el8.no 113/155 2023-08-31T18:45:02.595 INFO:teuthology.orchestra.run.smithi072.stdout:(102/139): python3-google-auth-1.1.1-10.el8.noa 1.2 MB/s | 81 kB 00:00 2023-08-31T18:45:02.696 INFO:teuthology.orchestra.run.smithi072.stdout:(103/139): python3-jaraco-6.2-6.el8.noarch.rpm 83 kB/s | 11 kB 00:00 2023-08-31T18:45:02.721 INFO:teuthology.orchestra.run.smithi072.stdout:(104/139): python3-jaraco-functools-2.0-4.el8.n 140 kB/s | 18 kB 00:00 2023-08-31T18:45:02.755 INFO:teuthology.orchestra.run.smithi072.stdout:(105/139): python3-execnet-1.7.1-1.el8.noarch.r 1.3 MB/s | 355 kB 00:00 2023-08-31T18:45:02.781 INFO:teuthology.orchestra.run.smithi072.stdout:(106/139): python3-logutils-0.3.5-11.el8.noarch 825 kB/s | 49 kB 00:00 2023-08-31T18:45:02.806 INFO:teuthology.orchestra.run.smithi072.stdout:(107/139): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2023-08-31T18:45:02.848 INFO:teuthology.orchestra.run.smithi072.stdout:(108/139): python3-portend-2.6-1.el8.noarch.rpm 376 kB/s | 16 kB 00:00 2023-08-31T18:45:02.890 INFO:teuthology.orchestra.run.smithi072.stdout:(109/139): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2023-08-31T18:45:02.916 INFO:teuthology.orchestra.run.smithi072.stdout:(110/139): python3-remoto-1.2.1-1.el8.noarch.rp 725 kB/s | 49 kB 00:00 2023-08-31T18:45:02.942 INFO:teuthology.orchestra.run.smithi072.stdout:(111/139): python3-repoze-lru-0.7-6.el8.noarch. 662 kB/s | 34 kB 00:00 2023-08-31T18:45:02.984 INFO:teuthology.orchestra.run.smithi072.stdout:(112/139): python3-kubernetes-11.0.0-6.el8.noar 4.1 MB/s | 1.2 MB 00:00 2023-08-31T18:45:03.009 INFO:teuthology.orchestra.run.smithi072.stdout:(113/139): python3-rsa-4.9-2.el8.noarch.rpm 959 kB/s | 64 kB 00:00 2023-08-31T18:45:03.035 INFO:teuthology.orchestra.run.smithi072.stdout:(114/139): python3-routes-2.4.1-12.el8.noarch.r 1.6 MB/s | 196 kB 00:00 2023-08-31T18:45:03.060 INFO:teuthology.orchestra.run.smithi072.stdout:(115/139): python3-simplegeneric-0.8.1-17.el8.n 245 kB/s | 19 kB 00:00 2023-08-31T18:45:03.088 INFO:teuthology.orchestra.run.smithi072.stdout:(116/139): python3-singledispatch-3.4.0.3-18.el 307 kB/s | 24 kB 00:00 2023-08-31T18:45:03.105 INFO:teuthology.orchestra.run.smithi072.stdout:(117/139): python3-tempora-1.14.1-5.el8.noarch. 420 kB/s | 29 kB 00:00 2023-08-31T18:45:03.122 INFO:teuthology.orchestra.run.smithi072.stdout:(118/139): python3-trustme-0.6.0-4.el8.noarch.r 451 kB/s | 27 kB 00:00 2023-08-31T18:45:03.164 INFO:teuthology.orchestra.run.smithi072.stdout:(119/139): python3-websocket-client-0.56.0-5.el 1.4 MB/s | 61 kB 00:00 2023-08-31T18:45:03.198 INFO:teuthology.orchestra.run.smithi072.stdout:(120/139): python3-waitress-1.4.3-1.el8.noarch. 2.3 MB/s | 255 kB 00:00 2023-08-31T18:45:03.224 INFO:teuthology.orchestra.run.smithi072.stdout:(121/139): python3-webob-1.8.5-1.el8.1.noarch.r 2.1 MB/s | 251 kB 00:00 2023-08-31T18:45:03.257 INFO:teuthology.orchestra.run.smithi072.stdout:(122/139): python3-webtest-2.0.33-1.el8.noarch. 921 kB/s | 85 kB 00:00 2023-08-31T18:45:03.274 INFO:teuthology.orchestra.run.smithi072.stdout:(123/139): python3-zc-lockfile-2.0-2.el8.noarch 302 kB/s | 23 kB 00:00 2023-08-31T18:45:03.442 INFO:teuthology.orchestra.run.smithi072.stdout:(124/139): NetworkManager-initscripts-updown-1. 886 kB/s | 143 kB 00:00 2023-08-31T18:45:03.501 INFO:teuthology.orchestra.run.smithi072.stdout:(125/139): elfutils-debuginfod-client-0.189-3.e 1.3 MB/s | 76 kB 00:00 2023-08-31T18:45:03.593 INFO:teuthology.orchestra.run.smithi072.stdout:(126/139): elfutils-libelf-0.189-3.el8.x86_64.r 2.5 MB/s | 232 kB 00:00 2023-08-31T18:45:03.685 INFO:teuthology.orchestra.run.smithi072.stdout:(127/139): librados2-16.2.14-21.gb8d3759e.el8.x 8.1 MB/s | 3.7 MB 00:00 2023-08-31T18:45:03.711 INFO:teuthology.orchestra.run.smithi072.stdout:(128/139): elfutils-libs-0.189-3.el8.x86_64.rpm 2.5 MB/s | 303 kB 00:00 2023-08-31T18:45:03.742 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-21.gb8d3759e.el8.no 113/155 2023-08-31T18:45:03.778 INFO:teuthology.orchestra.run.smithi072.stdout:(129/139): libblkid-2.32.1-43.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-08-31T18:45:03.846 INFO:teuthology.orchestra.run.smithi072.stdout:(130/139): libfdisk-2.32.1-43.el8.x86_64.rpm 3.7 MB/s | 254 kB 00:00 2023-08-31T18:45:03.906 INFO:teuthology.orchestra.run.smithi072.stdout:(131/139): libmount-2.32.1-43.el8.x86_64.rpm 3.8 MB/s | 236 kB 00:00 2023-08-31T18:45:03.936 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-21.gb8d3 114/155 2023-08-31T18:45:03.949 INFO:teuthology.orchestra.run.smithi072.stdout:(132/139): iproute-6.2.0-2.el8.x86_64.rpm 3.3 MB/s | 880 kB 00:00 2023-08-31T18:45:03.974 INFO:teuthology.orchestra.run.smithi072.stdout:(133/139): libsmartcols-2.32.1-43.el8.x86_64.rp 2.6 MB/s | 179 kB 00:00 2023-08-31T18:45:04.067 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-21.gb8d3 114/155 2023-08-31T18:45:04.091 INFO:teuthology.orchestra.run.smithi072.stdout:(134/139): libuuid-2.32.1-43.el8.x86_64.rpm 695 kB/s | 99 kB 00:00 2023-08-31T18:45:04.150 INFO:teuthology.orchestra.run.smithi072.stdout:(135/139): util-linux-user-2.32.1-43.el8.x86_64 1.7 MB/s | 103 kB 00:00 2023-08-31T18:45:04.251 INFO:teuthology.orchestra.run.smithi072.stdout:(136/139): util-linux-2.32.1-43.el8.x86_64.rpm 9.0 MB/s | 2.5 MB 00:00 2023-08-31T18:45:04.285 INFO:teuthology.orchestra.run.smithi072.stdout:(137/139): xfsdump-3.1.8-6.el8.x86_64.rpm 2.4 MB/s | 334 kB 00:00 2023-08-31T18:45:04.360 INFO:teuthology.orchestra.run.smithi072.stdout:(138/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 9.9 MB/s | 1.1 MB 00:00 2023-08-31T18:45:04.457 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-21.gb8d3759e.el8 115/155 2023-08-31T18:45:04.594 INFO:teuthology.orchestra.run.smithi072.stdout:(139/139): librbd1-16.2.14-21.gb8d3759e.el8.x86 3.2 MB/s | 4.2 MB 00:01 2023-08-31T18:45:04.597 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-08-31T18:45:04.597 INFO:teuthology.orchestra.run.smithi072.stdout:Total 5.8 MB/s | 209 MB 00:36 2023-08-31T18:45:04.662 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-2:16.2.14-21.gb8d3759e.el8.x86_64 116/155 2023-08-31T18:45:04.717 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:16.2.14-21.gb8d3759e.el8.x86_64 116/155 2023-08-31T18:45:04.902 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-rook-2:16.2.14-21.gb8d3759e.el8.noarch 117/155 2023-08-31T18:45:04.931 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-21.gb8d3759e.el8.noarch 117/155 2023-08-31T18:45:05.123 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-2:16.2.14-21.gb8d3759e.el8.x86_64 118/155 2023-08-31T18:45:05.277 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-08-31T18:45:06.281 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-08-31T18:45:06.687 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-08-31T18:45:06.688 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-08-31T18:45:08.220 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-08-31T18:45:08.223 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-08-31T18:45:10.196 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-08-31T18:45:11.440 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-test-2:16.2.14-21.gb8d3759e.el8.x86_64 120/155 2023-08-31T18:45:11.678 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-radosgw-2:16.2.14-21.gb8d3759e.el8.x86_64 121/155 2023-08-31T18:45:11.801 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-21.gb8d3759e.el8.x86_64 121/155 2023-08-31T18:45:11.977 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-21.gb8d375 122/155 2023-08-31T18:45:12.047 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-21.gb8d375 122/155 2023-08-31T18:45:12.227 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 123/155 2023-08-31T18:45:12.625 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephfs-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 123/155 2023-08-31T18:45:12.793 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 124/155 2023-08-31T18:45:12.920 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 124/155 2023-08-31T18:45:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-08-31T18:45:13.977 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/1 2023-08-31T18:45:14.123 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 1/155 2023-08-31T18:45:14.159 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-fuse-2:16.2.14-21.gb8d3759e.el8.x86_64 125/155 2023-08-31T18:45:14.217 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/155 2023-08-31T18:45:14.390 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 2/155 2023-08-31T18:45:14.473 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-08-31T18:45:14.491 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 2/155 2023-08-31T18:45:14.703 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/155 2023-08-31T18:45:14.759 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-08-31T18:45:14.924 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 128/155 2023-08-31T18:45:15.012 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/155 2023-08-31T18:45:15.106 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-08-31T18:45:15.220 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/155 2023-08-31T18:45:15.347 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs-devel-2:16.2.14-21.gb8d3759e.el8.x86_6 130/155 2023-08-31T18:45:15.539 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-08-31T18:45:15.574 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-08-31T18:45:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-08-31T18:45:15.827 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-top-2:16.2.14-21.gb8d3759e.el8.noarch 132/155 2023-08-31T18:45:16.035 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-fuse-2:16.2.14-21.gb8d3759e.el8.x86_64 133/155 2023-08-31T18:45:16.165 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-08-31T18:45:16.377 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-nbd-2:16.2.14-21.gb8d3759e.el8.x86_64 134/155 2023-08-31T18:45:16.390 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:16.2.14-21.gb8d3759e.el8.x86_64 8/155 2023-08-31T18:45:16.611 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 135/155 2023-08-31T18:45:16.776 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-08-31T18:45:16.804 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-08-31T18:45:16.853 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:16.2.14-21.gb8d3759e.el8.x86_64 8/155 2023-08-31T18:45:16.988 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-08-31T18:45:17.065 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:16.2.14-21.gb8d3759e.el8.x86_64 9/155 2023-08-31T18:45:17.200 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-08-31T18:45:17.208 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:16.2.14-21.gb8d3759e.el8.x86_64 9/155 2023-08-31T18:45:17.321 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-08-31T18:45:17.373 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:16.2.14-21.gb8d3759e.el8.x86_64 10/155 2023-08-31T18:45:17.538 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:16.2.14-21.gb8d3759e.el8.x86_64 10/155 2023-08-31T18:45:17.559 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-08-31T18:45:17.585 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-08-31T18:45:17.769 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-08-31T18:45:17.782 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:16.2.14-21.gb8d3759e.el8.x86_64 11/155 2023-08-31T18:45:17.937 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-08-31T18:45:17.956 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-08-31T18:45:18.097 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-08-31T18:45:18.098 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-08-31T18:45:18.363 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-08-31T18:45:18.364 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-08-31T18:45:18.376 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-08-31T18:45:18.573 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:16.2.14-21.gb8d3759e.el8.x86_64 13/155 2023-08-31T18:45:18.628 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-08-31T18:45:18.645 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-08-31T18:45:18.782 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-08-31T18:45:18.782 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-08-31T18:45:18.831 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:16.2.14-21.gb8d3759e.el8.x86_64 13/155 2023-08-31T18:45:19.051 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-08-31T18:45:19.173 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-08-31T18:45:19.233 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-08-31T18:45:19.250 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-08-31T18:45:19.421 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-08-31T18:45:19.506 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-08-31T18:45:19.636 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-08-31T18:45:19.636 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-08-31T18:45:19.772 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-08-31T18:45:19.870 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-08-31T18:45:19.871 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-08-31T18:45:19.973 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:16.2.14-21.gb8d3759e.el8.x86_64 17/155 2023-08-31T18:45:20.095 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-08-31T18:45:20.095 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-08-31T18:45:20.104 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:16.2.14-21.gb8d3759e.el8.x86_64 17/155 2023-08-31T18:45:20.348 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:16.2.14-21.gb8d3759e.el8.x86_ 18/155 2023-08-31T18:45:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-08-31T18:45:20.354 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-08-31T18:45:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:16.2.14-21.gb8d3759e.el8.x86_ 18/155 2023-08-31T18:45:20.578 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-08-31T18:45:20.579 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-08-31T18:45:20.740 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-08-31T18:45:20.795 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-08-31T18:45:20.987 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-08-31T18:45:21.002 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-08-31T18:45:21.156 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-08-31T18:45:21.206 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-08-31T18:45:21.207 INFO:teuthology.orchestra.run.smithi146.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-31T18:45:21.207 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:45:21.318 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-08-31T18:45:21.472 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-08-31T18:45:21.940 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:16.2.14-21.gb8d3759e.el8.x86_64 1/155 2023-08-31T18:45:21.940 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:16.2.14-21.gb8d3759e.el8.x86_64 2/155 2023-08-31T18:45:21.940 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:16.2.14-21.gb8d3759e.el8.x86_64 3/155 2023-08-31T18:45:21.941 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:16.2.14-21.gb8d3759e.el8.x86_64 4/155 2023-08-31T18:45:21.941 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-21.gb8d375 5/155 2023-08-31T18:45:21.941 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:16.2.14-21.gb8d3759e.el8.x86_64 6/155 2023-08-31T18:45:21.941 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:16.2.14-21.gb8d3759e.el8.x86_64 7/155 2023-08-31T18:45:21.942 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:16.2.14-21.gb8d3759e.el8.x86_64 8/155 2023-08-31T18:45:21.942 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:16.2.14-21.gb8d3759e.el8.x86_64 9/155 2023-08-31T18:45:21.942 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:16.2.14-21.gb8d3759e.el8.x86_64 10/155 2023-08-31T18:45:21.942 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:16.2.14-21.gb8d3759e.el8.x86_64 11/155 2023-08-31T18:45:21.943 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:16.2.14-21.gb8d3759e.el8.x86_64 12/155 2023-08-31T18:45:21.943 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 13/155 2023-08-31T18:45:21.943 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:16.2.14-21.gb8d3759e.el8.x86_6 14/155 2023-08-31T18:45:21.943 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:16.2.14-21.gb8d3759e.el8.x86_64 15/155 2023-08-31T18:45:21.943 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:16.2.14-21.gb8d3759e.el8.x86_64 16/155 2023-08-31T18:45:21.944 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:16.2.14-21.gb8d3759e.el8.x86_64 17/155 2023-08-31T18:45:21.944 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:16.2.14-21.gb8d3759e.el8.x86_ 18/155 2023-08-31T18:45:21.944 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:16.2.14-21.gb8d3759e.el8.x86_64 19/155 2023-08-31T18:45:21.944 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:16.2.14-21.gb8d3759e.el8 20/155 2023-08-31T18:45:21.944 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:16.2.14-21.gb8d3759e.el8.x 21/155 2023-08-31T18:45:21.945 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:16.2.14-21.gb8d3759e.el8.x86_64 22/155 2023-08-31T18:45:21.945 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:16.2.14-21.gb8d3759e.el8.x86_64 23/155 2023-08-31T18:45:21.945 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:16.2.14-21.gb8d3759e.el8.x86_64 24/155 2023-08-31T18:45:21.945 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:16.2.14-21.gb8d3759e.el8.x86_64 25/155 2023-08-31T18:45:21.945 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:16.2.14-21.gb8d3759e.el8.x86_64 26/155 2023-08-31T18:45:21.946 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 27/155 2023-08-31T18:45:21.946 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:16.2.14-21.gb8d3759e.el8.x86_64 28/155 2023-08-31T18:45:21.946 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-21.gb8d3759e.e 29/155 2023-08-31T18:45:21.946 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-21.gb8d3759e.el8.noar 30/155 2023-08-31T18:45:21.947 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-21.gb8d3759e.el8.no 31/155 2023-08-31T18:45:21.947 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-21.gb8d3 32/155 2023-08-31T18:45:21.947 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-21.gb8d3759e.el8 33/155 2023-08-31T18:45:21.947 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:16.2.14-21.gb8d3759e.el8.noarch 34/155 2023-08-31T18:45:21.947 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-21.gb8d3759e.el 35/155 2023-08-31T18:45:21.947 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephadm-2:16.2.14-21.gb8d3759e.el8.noarch 36/155 2023-08-31T18:45:21.948 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-top-2:16.2.14-21.gb8d3759e.el8.noarch 37/155 2023-08-31T18:45:21.948 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : automake-1.16.1-8.el8.noarch 38/155 2023-08-31T18:45:21.948 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : bison-3.0.4-10.el8.x86_64 39/155 2023-08-31T18:45:21.948 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flex-2.6.1-9.el8.x86_64 40/155 2023-08-31T18:45:21.948 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : jq-1.6-7.el8.x86_64 41/155 2023-08-31T18:45:21.949 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 42/155 2023-08-31T18:45:21.949 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 43/155 2023-08-31T18:45:21.949 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 44/155 2023-08-31T18:45:21.949 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 45/155 2023-08-31T18:45:21.949 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 46/155 2023-08-31T18:45:21.950 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 47/155 2023-08-31T18:45:21.950 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 48/155 2023-08-31T18:45:21.950 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 49/155 2023-08-31T18:45:21.950 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 50/155 2023-08-31T18:45:21.950 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 51/155 2023-08-31T18:45:21.951 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 52/155 2023-08-31T18:45:21.951 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 53/155 2023-08-31T18:45:21.951 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 54/155 2023-08-31T18:45:21.951 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 55/155 2023-08-31T18:45:21.951 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 56/155 2023-08-31T18:45:21.952 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 57/155 2023-08-31T18:45:21.952 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 58/155 2023-08-31T18:45:21.952 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 59/155 2023-08-31T18:45:21.952 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 60/155 2023-08-31T18:45:21.952 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 61/155 2023-08-31T18:45:21.953 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 62/155 2023-08-31T18:45:21.953 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 63/155 2023-08-31T18:45:21.953 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 64/155 2023-08-31T18:45:21.953 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 65/155 2023-08-31T18:45:21.953 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 66/155 2023-08-31T18:45:21.954 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 67/155 2023-08-31T18:45:21.954 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 68/155 2023-08-31T18:45:21.954 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 69/155 2023-08-31T18:45:21.954 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 70/155 2023-08-31T18:45:21.955 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 71/155 2023-08-31T18:45:21.955 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 72/155 2023-08-31T18:45:21.955 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 73/155 2023-08-31T18:45:21.955 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 74/155 2023-08-31T18:45:21.955 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/155 2023-08-31T18:45:21.956 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 76/155 2023-08-31T18:45:21.956 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 77/155 2023-08-31T18:45:21.956 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/155 2023-08-31T18:45:21.956 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 79/155 2023-08-31T18:45:21.957 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 80/155 2023-08-31T18:45:21.957 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 81/155 2023-08-31T18:45:21.957 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 82/155 2023-08-31T18:45:21.957 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 83/155 2023-08-31T18:45:21.957 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 84/155 2023-08-31T18:45:21.958 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 85/155 2023-08-31T18:45:21.958 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 86/155 2023-08-31T18:45:21.958 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 87/155 2023-08-31T18:45:21.958 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 88/155 2023-08-31T18:45:21.959 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 89/155 2023-08-31T18:45:21.959 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 90/155 2023-08-31T18:45:21.959 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/155 2023-08-31T18:45:21.959 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : leveldb-1.22-1.el8.x86_64 92/155 2023-08-31T18:45:21.959 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-08-31T18:45:21.960 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-08-31T18:45:21.960 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 95/155 2023-08-31T18:45:21.960 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-08-31T18:45:21.960 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-08-31T18:45:21.960 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-08-31T18:45:21.961 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-08-31T18:45:21.961 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-08-31T18:45:21.961 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-08-31T18:45:21.961 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 102/155 2023-08-31T18:45:21.961 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 103/155 2023-08-31T18:45:21.962 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 104/155 2023-08-31T18:45:21.962 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 105/155 2023-08-31T18:45:21.962 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 106/155 2023-08-31T18:45:21.962 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 107/155 2023-08-31T18:45:21.962 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 108/155 2023-08-31T18:45:21.963 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-08-31T18:45:21.963 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-08-31T18:45:21.963 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 111/155 2023-08-31T18:45:21.963 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 112/155 2023-08-31T18:45:21.963 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 113/155 2023-08-31T18:45:21.964 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 114/155 2023-08-31T18:45:21.964 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 115/155 2023-08-31T18:45:21.964 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 116/155 2023-08-31T18:45:21.964 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 117/155 2023-08-31T18:45:21.964 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 118/155 2023-08-31T18:45:21.965 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 119/155 2023-08-31T18:45:21.965 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 120/155 2023-08-31T18:45:21.965 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 121/155 2023-08-31T18:45:21.965 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 122/155 2023-08-31T18:45:21.965 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 123/155 2023-08-31T18:45:21.966 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:16.2.14-21.gb8d3759e.el8.x86_64 124/155 2023-08-31T18:45:21.966 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-08-31T18:45:21.966 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:16.2.14-21.gb8d3759e.el8.x86_64 126/155 2023-08-31T18:45:21.966 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-08-31T18:45:21.967 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 128/155 2023-08-31T18:45:21.967 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-08-31T18:45:21.967 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 130/155 2023-08-31T18:45:21.967 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-08-31T18:45:21.967 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 132/155 2023-08-31T18:45:21.968 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-08-31T18:45:21.968 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 134/155 2023-08-31T18:45:21.968 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-08-31T18:45:21.968 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 136/155 2023-08-31T18:45:21.968 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-08-31T18:45:21.968 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 138/155 2023-08-31T18:45:21.969 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-08-31T18:45:21.969 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 140/155 2023-08-31T18:45:21.969 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-08-31T18:45:21.970 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/155 2023-08-31T18:45:21.970 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-08-31T18:45:21.970 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/155 2023-08-31T18:45:21.970 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-08-31T18:45:21.971 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/155 2023-08-31T18:45:21.971 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-08-31T18:45:21.971 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/155 2023-08-31T18:45:21.971 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-08-31T18:45:21.972 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/155 2023-08-31T18:45:21.972 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-08-31T18:45:21.972 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-08-31T18:45:21.972 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-08-31T18:45:21.972 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-08-31T18:45:22.153 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-08-31T18:45:22.456 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-08-31T18:45:23.153 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-08-31T18:45:23.330 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-08-31T18:45:23.999 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-08-31T18:45:23.999 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:45:24.000 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2023-08-31T18:45:24.000 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-08-31T18:45:24.000 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-08-31T18:45:24.000 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-08-31T18:45:24.000 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-08-31T18:45:24.001 INFO:teuthology.orchestra.run.smithi146.stdout: iproute-6.2.0-2.el8.x86_64 2023-08-31T18:45:24.001 INFO:teuthology.orchestra.run.smithi146.stdout: libblkid-2.32.1-43.el8.x86_64 2023-08-31T18:45:24.001 INFO:teuthology.orchestra.run.smithi146.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-08-31T18:45:24.001 INFO:teuthology.orchestra.run.smithi146.stdout: libmount-2.32.1-43.el8.x86_64 2023-08-31T18:45:24.001 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.002 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.002 INFO:teuthology.orchestra.run.smithi146.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-08-31T18:45:24.002 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-2.32.1-43.el8.x86_64 2023-08-31T18:45:24.002 INFO:teuthology.orchestra.run.smithi146.stdout: util-linux-2.32.1-43.el8.x86_64 2023-08-31T18:45:24.002 INFO:teuthology.orchestra.run.smithi146.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-08-31T18:45:24.003 INFO:teuthology.orchestra.run.smithi146.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-08-31T18:45:24.003 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-08-31T18:45:24.003 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2023-08-31T18:45:24.003 INFO:teuthology.orchestra.run.smithi146.stdout: automake-1.16.1-8.el8.noarch 2023-08-31T18:45:24.003 INFO:teuthology.orchestra.run.smithi146.stdout: bison-3.0.4-10.el8.x86_64 2023-08-31T18:45:24.003 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.004 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.004 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.004 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.004 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:45:24.004 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.005 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.005 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.005 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:45:24.005 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:45:24.005 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:45:24.006 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:45:24.006 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:45:24.006 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.006 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.006 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:45:24.007 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.007 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.007 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.007 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:45:24.007 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.007 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:45:24.008 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-08-31T18:45:24.008 INFO:teuthology.orchestra.run.smithi146.stdout: flex-2.6.1-9.el8.x86_64 2023-08-31T18:45:24.008 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-2.9.7-17.el8.x86_64 2023-08-31T18:45:24.008 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-31T18:45:24.008 INFO:teuthology.orchestra.run.smithi146.stdout: jq-1.6-7.el8.x86_64 2023-08-31T18:45:24.009 INFO:teuthology.orchestra.run.smithi146.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-31T18:45:24.009 INFO:teuthology.orchestra.run.smithi146.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-08-31T18:45:24.009 INFO:teuthology.orchestra.run.smithi146.stdout: leveldb-1.22-1.el8.x86_64 2023-08-31T18:45:24.009 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-31T18:45:24.009 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.009 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.010 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.010 INFO:teuthology.orchestra.run.smithi146.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-08-31T18:45:24.010 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-08-31T18:45:24.010 INFO:teuthology.orchestra.run.smithi146.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-31T18:45:24.011 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-08-31T18:45:24.011 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-08-31T18:45:24.011 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.011 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.011 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-31T18:45:24.011 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.012 INFO:teuthology.orchestra.run.smithi146.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-08-31T18:45:24.012 INFO:teuthology.orchestra.run.smithi146.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-31T18:45:24.012 INFO:teuthology.orchestra.run.smithi146.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-31T18:45:24.012 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-31T18:45:24.012 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-08-31T18:45:24.013 INFO:teuthology.orchestra.run.smithi146.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-08-31T18:45:24.013 INFO:teuthology.orchestra.run.smithi146.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-08-31T18:45:24.013 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-31T18:45:24.013 INFO:teuthology.orchestra.run.smithi146.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-31T18:45:24.013 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-0.3.15-4.el8.x86_64 2023-08-31T18:45:24.013 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-08-31T18:45:24.014 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-08-31T18:45:24.014 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-08-31T18:45:24.014 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-08-31T18:45:24.014 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-08-31T18:45:24.015 INFO:teuthology.orchestra.run.smithi146.stdout: python3-apipkg-1.5-6.el8.noarch 2023-08-31T18:45:24.015 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-31T18:45:24.015 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-31T18:45:24.015 INFO:teuthology.orchestra.run.smithi146.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-31T18:45:24.015 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-31T18:45:24.016 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.016 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.016 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.016 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-31T18:45:24.016 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-08-31T18:45:24.017 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-31T18:45:24.017 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-31T18:45:24.017 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-08-31T18:45:24.017 INFO:teuthology.orchestra.run.smithi146.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-08-31T18:45:24.017 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-31T18:45:24.017 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-31T18:45:24.018 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-31T18:45:24.018 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-31T18:45:24.018 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-31T18:45:24.018 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-31T18:45:24.018 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-31T18:45:24.019 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-31T18:45:24.019 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-31T18:45:24.019 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako-1.0.6-14.el8.noarch 2023-08-31T18:45:24.019 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-31T18:45:24.019 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-31T18:45:24.019 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-31T18:45:24.020 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-31T18:45:24.020 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-31T18:45:24.020 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-31T18:45:24.020 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend-2.6-1.el8.noarch 2023-08-31T18:45:24.020 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-31T18:45:24.021 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-31T18:45:24.021 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-31T18:45:24.021 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-31T18:45:24.021 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-31T18:45:24.021 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz-2017.2-11.el8.noarch 2023-08-31T18:45:24.021 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.022 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.022 INFO:teuthology.orchestra.run.smithi146.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-08-31T18:45:24.022 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-31T18:45:24.022 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-31T18:45:24.022 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.023 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-31T18:45:24.023 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-31T18:45:24.023 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-08-31T18:45:24.023 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-31T18:45:24.023 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-31T18:45:24.024 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-31T18:45:24.024 INFO:teuthology.orchestra.run.smithi146.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-31T18:45:24.024 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-31T18:45:24.024 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-31T18:45:24.024 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-31T18:45:24.025 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-31T18:45:24.025 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-31T18:45:24.025 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-31T18:45:24.025 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.025 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.025 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:45:24.026 INFO:teuthology.orchestra.run.smithi146.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-31T18:45:24.026 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-08-31T18:45:24.026 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-31T18:45:24.027 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-08-31T18:45:24.027 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:45:24.027 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2023-08-31T18:45:24.178 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-08-31T18:45:24.339 DEBUG:teuthology.parallel:result is None 2023-08-31T18:45:24.681 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-08-31T18:45:24.922 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-08-31T18:45:25.116 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/155 2023-08-31T18:45:25.426 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-08-31T18:45:25.645 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:16.2.14-21.gb8d3759e.el8.x 29/155 2023-08-31T18:45:25.787 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:16.2.14-21.gb8d3759e.el8 30/155 2023-08-31T18:45:26.139 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:16.2.14-21.gb8d3759e.el8.x86_64 31/155 2023-08-31T18:45:27.252 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-08-31T18:45:27.718 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-08-31T18:45:28.041 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-08-31T18:45:28.338 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-08-31T18:45:30.447 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-08-31T18:45:30.792 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-08-31T18:45:31.078 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-08-31T18:45:31.258 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-08-31T18:45:31.513 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:16.2.14-21.gb8d3759e.el8.x86_64 39/155 2023-08-31T18:45:31.810 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:16.2.14-21.gb8d3759e.el8.x86_64 40/155 2023-08-31T18:45:32.071 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:16.2.14-21.gb8d3759e.el8.x86_64 41/155 2023-08-31T18:45:32.252 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 42/155 2023-08-31T18:45:32.571 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 43/155 2023-08-31T18:45:32.804 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/155 2023-08-31T18:45:32.903 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/155 2023-08-31T18:45:33.188 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/155 2023-08-31T18:45:33.279 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/155 2023-08-31T18:45:33.430 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 46/155 2023-08-31T18:45:33.629 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-08-31T18:45:34.344 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-08-31T18:45:34.747 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/155 2023-08-31T18:45:34.775 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/155 2023-08-31T18:45:34.979 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-08-31T18:45:35.254 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-08-31T18:45:35.487 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-08-31T18:45:35.643 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-08-31T18:45:35.809 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-08-31T18:45:36.094 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-08-31T18:45:36.310 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-08-31T18:45:36.550 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/155 2023-08-31T18:45:36.787 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/155 2023-08-31T18:45:36.944 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/155 2023-08-31T18:45:37.111 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 59/155 2023-08-31T18:45:37.307 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-2.6-1.el8.noarch 60/155 2023-08-31T18:45:37.600 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 61/155 2023-08-31T18:45:37.833 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 62/155 2023-08-31T18:45:38.095 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 63/155 2023-08-31T18:45:38.371 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 64/155 2023-08-31T18:45:38.738 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 65/155 2023-08-31T18:45:39.078 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 66/155 2023-08-31T18:45:39.330 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 67/155 2023-08-31T18:45:39.648 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 68/155 2023-08-31T18:45:39.831 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 69/155 2023-08-31T18:45:40.058 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 70/155 2023-08-31T18:45:40.389 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 71/155 2023-08-31T18:45:40.646 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/155 2023-08-31T18:45:41.072 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/155 2023-08-31T18:45:41.352 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/155 2023-08-31T18:45:41.551 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/155 2023-08-31T18:45:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/155 2023-08-31T18:45:42.130 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/155 2023-08-31T18:45:43.495 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/155 2023-08-31T18:45:43.839 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/155 2023-08-31T18:45:44.108 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 80/155 2023-08-31T18:45:44.428 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/155 2023-08-31T18:45:44.733 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/155 2023-08-31T18:45:45.016 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/155 2023-08-31T18:45:45.309 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 84/155 2023-08-31T18:45:45.636 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 85/155 2023-08-31T18:45:45.942 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 86/155 2023-08-31T18:45:46.122 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 87/155 2023-08-31T18:45:46.315 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 88/155 2023-08-31T18:45:47.737 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 89/155 2023-08-31T18:45:47.984 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 90/155 2023-08-31T18:45:48.152 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 91/155 2023-08-31T18:45:48.443 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 92/155 2023-08-31T18:45:48.665 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 93/155 2023-08-31T18:45:48.899 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.7-17.el8.x86_64 94/155 2023-08-31T18:45:49.276 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 95/155 2023-08-31T18:45:49.505 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 96/155 2023-08-31T18:45:49.770 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 97/155 2023-08-31T18:45:52.654 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:16.2.14-21.gb8d3759e.el8.x86_64 98/155 2023-08-31T18:45:53.361 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:16.2.14-21.gb8d3759e.el8.x86_64 98/155 2023-08-31T18:45:54.214 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:16.2.14-21.gb8d3759e.el8.x86_64 98/155 2023-08-31T18:45:54.642 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:16.2.14-21.gb8d3759e.el8.x86_64 99/155 2023-08-31T18:45:54.836 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:16.2.14-21.gb8d3759e.el8.x86_64 99/155 2023-08-31T18:45:54.993 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:16.2.14-21.gb8d3759e.el8.x86_64 100/155 2023-08-31T18:46:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:16.2.14-21.gb8d3759e.el8.x86_64 100/155 2023-08-31T18:46:16.294 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2023-08-31T18:46:16.295 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2023-08-31T18:46:16.295 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-08-31T18:46:16.295 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /run 2023-08-31T18:46:16.295 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2023-08-31T18:46:16.295 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2023-08-31T18:46:16.296 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2023-08-31T18:46:16.296 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2023-08-31T18:46:16.296 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-08-31T18:46:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:16.734 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:16.2.14-21.gb8d3759e.el8.x86_64 101/155 2023-08-31T18:46:17.218 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:16.2.14-21.gb8d3759e.el8.x86_64 101/155 2023-08-31T18:46:17.432 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:16.2.14-21.gb8d3759e.el8.x86_64 102/155 2023-08-31T18:46:19.053 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:16.2.14-21.gb8d3759e.el8.x86_64 102/155 2023-08-31T18:46:19.299 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:16.2.14-21.gb8d3759e.el8.x86_64 103/155 2023-08-31T18:46:19.360 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:16.2.14-21.gb8d3759e.el8.x86_64 103/155 2023-08-31T18:46:19.591 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-08-31T18:46:19.812 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-08-31T18:46:19.974 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-08-31T18:46:20.085 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-08-31T18:46:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-08-31T18:46:20.674 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : automake-1.16.1-8.el8.noarch 108/155 2023-08-31T18:46:21.311 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:16.2.14-21.gb8d3759e.el8.noarch 109/155 2023-08-31T18:46:21.517 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:16.2.14-21.gb8d3759e.el8.noarch 109/155 2023-08-31T18:46:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-21.gb8d3759e.el 110/155 2023-08-31T18:46:21.820 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-21.gb8d3759e.e 111/155 2023-08-31T18:46:22.031 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-21.gb8d3759e.el8.noar 112/155 2023-08-31T18:46:23.113 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-21.gb8d3759e.el8.noar 112/155 2023-08-31T18:46:23.405 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-21.gb8d3759e.el8.no 113/155 2023-08-31T18:46:24.577 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-21.gb8d3759e.el8.no 113/155 2023-08-31T18:46:24.773 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-21.gb8d3 114/155 2023-08-31T18:46:24.896 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-21.gb8d3 114/155 2023-08-31T18:46:25.307 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-21.gb8d3759e.el8 115/155 2023-08-31T18:46:25.530 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:16.2.14-21.gb8d3759e.el8.x86_64 116/155 2023-08-31T18:46:25.583 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:16.2.14-21.gb8d3759e.el8.x86_64 116/155 2023-08-31T18:46:25.748 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:16.2.14-21.gb8d3759e.el8.noarch 117/155 2023-08-31T18:46:25.775 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-21.gb8d3759e.el8.noarch 117/155 2023-08-31T18:46:25.988 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:16.2.14-21.gb8d3759e.el8.x86_64 118/155 2023-08-31T18:46:26.164 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-08-31T18:46:31.039 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-08-31T18:46:32.329 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:16.2.14-21.gb8d3759e.el8.x86_64 120/155 2023-08-31T18:46:32.588 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:16.2.14-21.gb8d3759e.el8.x86_64 121/155 2023-08-31T18:46:32.710 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-21.gb8d3759e.el8.x86_64 121/155 2023-08-31T18:46:32.897 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-21.gb8d375 122/155 2023-08-31T18:46:32.966 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-21.gb8d375 122/155 2023-08-31T18:46:33.172 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 123/155 2023-08-31T18:46:33.567 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephfs-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 123/155 2023-08-31T18:46:33.780 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 124/155 2023-08-31T18:46:33.906 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 124/155 2023-08-31T18:46:35.151 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:16.2.14-21.gb8d3759e.el8.x86_64 125/155 2023-08-31T18:46:35.502 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-08-31T18:46:35.739 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/155 2023-08-31T18:46:35.986 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 128/155 2023-08-31T18:46:36.159 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-08-31T18:46:36.412 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:16.2.14-21.gb8d3759e.el8.x86_6 130/155 2023-08-31T18:46:36.653 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-08-31T18:46:36.889 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-top-2:16.2.14-21.gb8d3759e.el8.noarch 132/155 2023-08-31T18:46:37.106 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:16.2.14-21.gb8d3759e.el8.x86_64 133/155 2023-08-31T18:46:37.469 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:16.2.14-21.gb8d3759e.el8.x86_64 134/155 2023-08-31T18:46:37.732 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 135/155 2023-08-31T18:46:37.880 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-08-31T18:46:37.910 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-08-31T18:46:38.106 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-08-31T18:46:38.337 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-08-31T18:46:38.448 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-08-31T18:46:38.705 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-08-31T18:46:38.731 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-08-31T18:46:38.941 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-08-31T18:46:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-08-31T18:46:39.339 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-08-31T18:46:39.339 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-08-31T18:46:39.634 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-08-31T18:46:39.635 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-08-31T18:46:39.883 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-08-31T18:46:39.899 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-08-31T18:46:40.010 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-08-31T18:46:40.011 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-08-31T18:46:40.302 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-08-31T18:46:40.519 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-08-31T18:46:40.728 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-08-31T18:46:40.981 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-08-31T18:46:40.982 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-08-31T18:46:41.249 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-08-31T18:46:41.250 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-08-31T18:46:41.483 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-08-31T18:46:41.484 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-08-31T18:46:41.725 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-08-31T18:46:41.725 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-08-31T18:46:41.957 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-08-31T18:46:41.958 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-08-31T18:46:42.183 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-08-31T18:46:42.397 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-08-31T18:46:42.598 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-08-31T18:46:42.599 INFO:teuthology.orchestra.run.smithi072.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-31T18:46:42.599 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:43.302 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:16.2.14-21.gb8d3759e.el8.x86_64 1/155 2023-08-31T18:46:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:16.2.14-21.gb8d3759e.el8.x86_64 2/155 2023-08-31T18:46:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:16.2.14-21.gb8d3759e.el8.x86_64 3/155 2023-08-31T18:46:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:16.2.14-21.gb8d3759e.el8.x86_64 4/155 2023-08-31T18:46:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-21.gb8d375 5/155 2023-08-31T18:46:43.303 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:16.2.14-21.gb8d3759e.el8.x86_64 6/155 2023-08-31T18:46:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:16.2.14-21.gb8d3759e.el8.x86_64 7/155 2023-08-31T18:46:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:16.2.14-21.gb8d3759e.el8.x86_64 8/155 2023-08-31T18:46:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:16.2.14-21.gb8d3759e.el8.x86_64 9/155 2023-08-31T18:46:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:16.2.14-21.gb8d3759e.el8.x86_64 10/155 2023-08-31T18:46:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:16.2.14-21.gb8d3759e.el8.x86_64 11/155 2023-08-31T18:46:43.304 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:16.2.14-21.gb8d3759e.el8.x86_64 12/155 2023-08-31T18:46:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 13/155 2023-08-31T18:46:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:16.2.14-21.gb8d3759e.el8.x86_6 14/155 2023-08-31T18:46:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:16.2.14-21.gb8d3759e.el8.x86_64 15/155 2023-08-31T18:46:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:16.2.14-21.gb8d3759e.el8.x86_64 16/155 2023-08-31T18:46:43.305 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:16.2.14-21.gb8d3759e.el8.x86_64 17/155 2023-08-31T18:46:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:16.2.14-21.gb8d3759e.el8.x86_ 18/155 2023-08-31T18:46:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:16.2.14-21.gb8d3759e.el8.x86_64 19/155 2023-08-31T18:46:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:16.2.14-21.gb8d3759e.el8 20/155 2023-08-31T18:46:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:16.2.14-21.gb8d3759e.el8.x 21/155 2023-08-31T18:46:43.306 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:16.2.14-21.gb8d3759e.el8.x86_64 22/155 2023-08-31T18:46:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:16.2.14-21.gb8d3759e.el8.x86_64 23/155 2023-08-31T18:46:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:16.2.14-21.gb8d3759e.el8.x86_64 24/155 2023-08-31T18:46:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:16.2.14-21.gb8d3759e.el8.x86_64 25/155 2023-08-31T18:46:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:16.2.14-21.gb8d3759e.el8.x86_64 26/155 2023-08-31T18:46:43.307 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 27/155 2023-08-31T18:46:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:16.2.14-21.gb8d3759e.el8.x86_64 28/155 2023-08-31T18:46:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-21.gb8d3759e.e 29/155 2023-08-31T18:46:43.308 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-21.gb8d3759e.el8.noar 30/155 2023-08-31T18:46:43.318 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-21.gb8d3759e.el8.no 31/155 2023-08-31T18:46:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-21.gb8d3 32/155 2023-08-31T18:46:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-21.gb8d3759e.el8 33/155 2023-08-31T18:46:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:16.2.14-21.gb8d3759e.el8.noarch 34/155 2023-08-31T18:46:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-21.gb8d3759e.el 35/155 2023-08-31T18:46:43.319 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:16.2.14-21.gb8d3759e.el8.noarch 36/155 2023-08-31T18:46:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-top-2:16.2.14-21.gb8d3759e.el8.noarch 37/155 2023-08-31T18:46:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : automake-1.16.1-8.el8.noarch 38/155 2023-08-31T18:46:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.0.4-10.el8.x86_64 39/155 2023-08-31T18:46:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.1-9.el8.x86_64 40/155 2023-08-31T18:46:43.320 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.6-7.el8.x86_64 41/155 2023-08-31T18:46:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 42/155 2023-08-31T18:46:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 43/155 2023-08-31T18:46:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 44/155 2023-08-31T18:46:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 45/155 2023-08-31T18:46:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 46/155 2023-08-31T18:46:43.321 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 47/155 2023-08-31T18:46:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 48/155 2023-08-31T18:46:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 49/155 2023-08-31T18:46:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 50/155 2023-08-31T18:46:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 51/155 2023-08-31T18:46:43.322 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 52/155 2023-08-31T18:46:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 53/155 2023-08-31T18:46:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 54/155 2023-08-31T18:46:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 55/155 2023-08-31T18:46:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 56/155 2023-08-31T18:46:43.323 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 57/155 2023-08-31T18:46:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 58/155 2023-08-31T18:46:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 59/155 2023-08-31T18:46:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 60/155 2023-08-31T18:46:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 61/155 2023-08-31T18:46:43.324 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 62/155 2023-08-31T18:46:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 63/155 2023-08-31T18:46:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 64/155 2023-08-31T18:46:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 65/155 2023-08-31T18:46:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 66/155 2023-08-31T18:46:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 67/155 2023-08-31T18:46:43.325 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 68/155 2023-08-31T18:46:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 69/155 2023-08-31T18:46:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 70/155 2023-08-31T18:46:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 71/155 2023-08-31T18:46:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 72/155 2023-08-31T18:46:43.326 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 73/155 2023-08-31T18:46:43.327 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 74/155 2023-08-31T18:46:43.327 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/155 2023-08-31T18:46:43.327 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 76/155 2023-08-31T18:46:43.327 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 77/155 2023-08-31T18:46:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/155 2023-08-31T18:46:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 79/155 2023-08-31T18:46:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 80/155 2023-08-31T18:46:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 81/155 2023-08-31T18:46:43.328 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 82/155 2023-08-31T18:46:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 83/155 2023-08-31T18:46:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 84/155 2023-08-31T18:46:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 85/155 2023-08-31T18:46:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 86/155 2023-08-31T18:46:43.329 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 87/155 2023-08-31T18:46:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 88/155 2023-08-31T18:46:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 89/155 2023-08-31T18:46:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 90/155 2023-08-31T18:46:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/155 2023-08-31T18:46:43.330 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : leveldb-1.22-1.el8.x86_64 92/155 2023-08-31T18:46:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-08-31T18:46:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-08-31T18:46:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 95/155 2023-08-31T18:46:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-08-31T18:46:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-08-31T18:46:43.331 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-08-31T18:46:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-08-31T18:46:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-08-31T18:46:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-08-31T18:46:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 102/155 2023-08-31T18:46:43.332 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 103/155 2023-08-31T18:46:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 104/155 2023-08-31T18:46:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 105/155 2023-08-31T18:46:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 106/155 2023-08-31T18:46:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 107/155 2023-08-31T18:46:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 108/155 2023-08-31T18:46:43.333 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-08-31T18:46:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-08-31T18:46:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 111/155 2023-08-31T18:46:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 112/155 2023-08-31T18:46:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 113/155 2023-08-31T18:46:43.334 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 114/155 2023-08-31T18:46:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 115/155 2023-08-31T18:46:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 116/155 2023-08-31T18:46:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 117/155 2023-08-31T18:46:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 118/155 2023-08-31T18:46:43.335 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 119/155 2023-08-31T18:46:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 120/155 2023-08-31T18:46:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 121/155 2023-08-31T18:46:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 122/155 2023-08-31T18:46:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 123/155 2023-08-31T18:46:43.336 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:16.2.14-21.gb8d3759e.el8.x86_64 124/155 2023-08-31T18:46:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-08-31T18:46:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:16.2.14-21.gb8d3759e.el8.x86_64 126/155 2023-08-31T18:46:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-08-31T18:46:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 128/155 2023-08-31T18:46:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-08-31T18:46:43.337 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 130/155 2023-08-31T18:46:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-08-31T18:46:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 132/155 2023-08-31T18:46:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-08-31T18:46:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 134/155 2023-08-31T18:46:43.338 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-08-31T18:46:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 136/155 2023-08-31T18:46:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-08-31T18:46:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 138/155 2023-08-31T18:46:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-08-31T18:46:43.339 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 140/155 2023-08-31T18:46:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-08-31T18:46:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/155 2023-08-31T18:46:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-08-31T18:46:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/155 2023-08-31T18:46:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-08-31T18:46:43.340 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/155 2023-08-31T18:46:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-08-31T18:46:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/155 2023-08-31T18:46:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-08-31T18:46:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/155 2023-08-31T18:46:43.341 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-08-31T18:46:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-08-31T18:46:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-08-31T18:46:43.342 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-08-31T18:46:45.356 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-08-31T18:46:45.356 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:45.357 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2023-08-31T18:46:45.357 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-08-31T18:46:45.357 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-08-31T18:46:45.357 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-08-31T18:46:45.357 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-08-31T18:46:45.358 INFO:teuthology.orchestra.run.smithi072.stdout: iproute-6.2.0-2.el8.x86_64 2023-08-31T18:46:45.358 INFO:teuthology.orchestra.run.smithi072.stdout: libblkid-2.32.1-43.el8.x86_64 2023-08-31T18:46:45.358 INFO:teuthology.orchestra.run.smithi072.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-08-31T18:46:45.358 INFO:teuthology.orchestra.run.smithi072.stdout: libmount-2.32.1-43.el8.x86_64 2023-08-31T18:46:45.358 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.359 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.359 INFO:teuthology.orchestra.run.smithi072.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-08-31T18:46:45.359 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-2.32.1-43.el8.x86_64 2023-08-31T18:46:45.359 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-2.32.1-43.el8.x86_64 2023-08-31T18:46:45.359 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-08-31T18:46:45.360 INFO:teuthology.orchestra.run.smithi072.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-08-31T18:46:45.360 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-08-31T18:46:45.360 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2023-08-31T18:46:45.360 INFO:teuthology.orchestra.run.smithi072.stdout: automake-1.16.1-8.el8.noarch 2023-08-31T18:46:45.360 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.0.4-10.el8.x86_64 2023-08-31T18:46:45.361 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.361 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.361 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.361 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.361 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:46:45.362 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.362 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.362 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.362 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:46:45.362 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:46:45.363 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:46:45.363 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:46:45.363 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:46:45.363 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.363 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.363 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:46:45.364 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.364 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.364 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.364 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:46:45.364 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.365 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top-2:16.2.14-21.gb8d3759e.el8.noarch 2023-08-31T18:46:45.365 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-08-31T18:46:45.365 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.1-9.el8.x86_64 2023-08-31T18:46:45.365 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.7-17.el8.x86_64 2023-08-31T18:46:45.365 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-31T18:46:45.366 INFO:teuthology.orchestra.run.smithi072.stdout: jq-1.6-7.el8.x86_64 2023-08-31T18:46:45.366 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-31T18:46:45.366 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-08-31T18:46:45.366 INFO:teuthology.orchestra.run.smithi072.stdout: leveldb-1.22-1.el8.x86_64 2023-08-31T18:46:45.366 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-31T18:46:45.366 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.367 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.367 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.367 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-08-31T18:46:45.367 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-08-31T18:46:45.367 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-31T18:46:45.368 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-08-31T18:46:45.368 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-08-31T18:46:45.368 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.368 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.368 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-31T18:46:45.369 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.369 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-08-31T18:46:45.369 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-31T18:46:45.369 INFO:teuthology.orchestra.run.smithi072.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-31T18:46:45.369 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-31T18:46:45.369 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-08-31T18:46:45.370 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-08-31T18:46:45.370 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-08-31T18:46:45.370 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-31T18:46:45.370 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-31T18:46:45.370 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.15-4.el8.x86_64 2023-08-31T18:46:45.371 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-08-31T18:46:45.371 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-08-31T18:46:45.371 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-08-31T18:46:45.371 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-08-31T18:46:45.371 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-08-31T18:46:45.371 INFO:teuthology.orchestra.run.smithi072.stdout: python3-apipkg-1.5-6.el8.noarch 2023-08-31T18:46:45.372 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-31T18:46:45.372 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-31T18:46:45.372 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-31T18:46:45.372 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-31T18:46:45.372 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.373 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.373 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.373 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-31T18:46:45.373 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-08-31T18:46:45.373 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-31T18:46:45.374 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-31T18:46:45.374 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-08-31T18:46:45.374 INFO:teuthology.orchestra.run.smithi072.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-08-31T18:46:45.374 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-31T18:46:45.374 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-31T18:46:45.375 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-31T18:46:45.375 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-31T18:46:45.375 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-31T18:46:45.375 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-31T18:46:45.376 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-31T18:46:45.376 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-31T18:46:45.376 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-31T18:46:45.376 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.0.6-14.el8.noarch 2023-08-31T18:46:45.376 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-31T18:46:45.377 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-31T18:46:45.377 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-31T18:46:45.377 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-31T18:46:45.377 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-31T18:46:45.377 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-31T18:46:45.378 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-2.6-1.el8.noarch 2023-08-31T18:46:45.378 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-31T18:46:45.378 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-31T18:46:45.378 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-31T18:46:45.378 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-31T18:46:45.378 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-31T18:46:45.379 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2017.2-11.el8.noarch 2023-08-31T18:46:45.379 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.379 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.379 INFO:teuthology.orchestra.run.smithi072.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-08-31T18:46:45.379 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-31T18:46:45.380 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-31T18:46:45.380 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.380 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-31T18:46:45.380 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-31T18:46:45.380 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-08-31T18:46:45.381 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-31T18:46:45.381 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-31T18:46:45.381 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-31T18:46:45.381 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-31T18:46:45.381 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-31T18:46:45.381 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-31T18:46:45.382 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-31T18:46:45.382 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-31T18:46:45.382 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-31T18:46:45.382 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-31T18:46:45.382 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.383 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.383 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:16.2.14-21.gb8d3759e.el8.x86_64 2023-08-31T18:46:45.383 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-31T18:46:45.383 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-08-31T18:46:45.383 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-31T18:46:45.384 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-08-31T18:46:45.384 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:45.384 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-08-31T18:46:45.661 DEBUG:teuthology.parallel:result is None 2023-08-31T18:46:45.662 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b8d3759ea1ec9111c6e7f552353860ccc6501ad8 2023-08-31T18:46:45.806 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-31T18:46:45.863 INFO:teuthology.orchestra.run.smithi072.stdout:16.2.14-21.gb8d3759e.el8 2023-08-31T18:46:45.864 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-21.gb8d3759e.el8 2023-08-31T18:46:45.865 INFO:teuthology.task.install:The correct ceph version 16.2.14-21.gb8d3759e is installed. 2023-08-31T18:46:45.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b8d3759ea1ec9111c6e7f552353860ccc6501ad8 2023-08-31T18:46:46.086 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-31T18:46:46.150 INFO:teuthology.orchestra.run.smithi146.stdout:16.2.14-21.gb8d3759e.el8 2023-08-31T18:46:46.150 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-21.gb8d3759e.el8 2023-08-31T18:46:46.150 INFO:teuthology.task.install:The correct ceph version 16.2.14-21.gb8d3759e is installed. 2023-08-31T18:46:46.151 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-31T18:46:46.151 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:46:46.152 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-31T18:46:46.227 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:46:46.227 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-31T18:46:46.303 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-31T18:46:46.304 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:46:46.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2023-08-31T18:46:46.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-31T18:46:46.486 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:46:46.486 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2023-08-31T18:46:46.557 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-31T18:46:46.666 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-31T18:46:46.667 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:46:46.667 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-31T18:46:46.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-31T18:46:46.849 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:46:46.850 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-31T18:46:46.919 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-31T18:46:47.028 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-31T18:46:47.028 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:46:47.029 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2023-08-31T18:46:47.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-31T18:46:47.210 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:46:47.211 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2023-08-31T18:46:47.280 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-31T18:46:47.390 INFO:teuthology.run_tasks:Running task ceph... 2023-08-31T18:46:47.457 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-31T18:46:47.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2023-08-31T18:46:47.464 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2023-08-31T18:46:47.533 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-31T18:46:47.533 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-31T18:46:47.538 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-31T18:46:47.607 INFO:tasks.ceph:Creating extra log directories... 2023-08-31T18:46:47.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-31T18:46:47.614 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-31T18:46:47.712 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-31T18:46:47.712 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-31T18:46:47.712 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-31T18:46:47.713 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:46:47.713 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-31T18:46:47.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-31T18:46:47.977 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-31T18:46:48.049 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:46:48.049 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-31T18:46:48.095 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-31T18:46:48.295 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-31T18:46:48.370 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-31T18:46:48.370 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-31T18:46:48.371 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686', 'branch': 'wip-batrick-testing-20230831.124848-pacific', 'description': 'fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7385686', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20230831.124848-pacific'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'b8d3759ea1ec9111c6e7f552353860ccc6501ad8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b8d3759ea1ec9111c6e7f552353860ccc6501ad8'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20230831.124848-pacific', 'sha1': 'b8d3759ea1ec9111c6e7f552353860ccc6501ad8'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 998, 'sha1': 'b8d3759ea1ec9111c6e7f552353860ccc6501ad8', 'sleep_before_teardown': 0, 'subset': '1/512', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20230831.124848-pacific', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_b8d3759ea1ec9111c6e7f552353860ccc6501ad8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b8d3759ea1ec9111c6e7f552353860ccc6501ad8', 'targets': {'smithi072.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCl7wbiq/MApWp63+vfnCy/JoQxhjHxP5MfrC/43lYiDNXYYhWVA82bohfjm4tjCiXWA0pmVQIXfUJylsmkobkagX4nnWzxHo4e0dAaYiInPF8SXIE/1qP+33VEq/FhVOqdtRGJd1s6yFwe7+1rYiABDEsQWSTRgDHSjl0nthddygDo2oj99fK8gf8238+SDhcgqo2xpnQtM+ZMZQOimdkOGC3toUbiFoCJ8X8melp3bfzFrox0m+v+JRDOYbpqlFqZ0RqH0WH2p+iM1w8XxM831v5jsNSWaJVzRnADzGdvd3LNcwBpU8dx7nbj+Zmt6UQ7DnCk8P5a1wluM9cf291KtrbMaDHMw4nWv9f47puqg7+5jOPK2JN7Eb6ffmZndPBkenrSdlQ2n2XD8hoql/7VhbbMSnvwQVqhmTXOQHEgQPDAMkAXfPXNIkSK+WhgPYashLGPqp4nIPROEnD8af6Nh9bhTYFIZ5OhRBnZYZreMviwlGv5WYXNeS/lP28AN4U=', 'smithi146.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/LknFDYQtG86kLAEdfA2CAfYyLpnYltWNFVnnisZIRpWhAijA0KNpttVUhLn9qau+VWIu2MGSQrX0QYo4Wr/hb/9O3rptnO1NDRyX8nZKmalsQnUkfBfjbxiEWT2o9HaT718+pemLljc4je97ZgC4MUiEPwVj+JJ9gEs0eX6WNG6UQtaS/FbE+DSyH2W5cxp6g+LMHr3rkgsqrusJqSK9YTVoea/nHG7I9s2OVMaQV6HrAtdzmWlaobu78kbSPR2Gnyg4Ym4ERWZmToVxfQoL3pvxNx2lrzGEGD3cjrjKqR8iOiQElRbI6IkAkV1E27nQKtROXTe2wnaI2P3Vu3xaVYwpNTpvQFQFWEiRAZ/edpabZ3B4/TXKoX+ZnA+E/L7uJ4tNkLOst5pjKNdZkca6fq4k5YSXU75mINX0J9cpNPI2L7wV17S+u5rPrO6Bv0jpvaM1R+QEt7ZVYBa+QZMOrajruJ/OwO9AG/qAh33t8xejKgOQpR3FfvT2C6vRbRU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'b8d3759ea1ec9111c6e7f552353860ccc6501ad8'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f9a8556d5e989d27b6626a0b75ef595991f83d20', 'timestamp': '2023-08-31_15:31:51', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1394'} 2023-08-31T18:46:48.372 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-31T18:46:48.377 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-31T18:46:48.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2023-08-31T18:46:48.463 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2023-08-31T18:46:48.533 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:46:48.534 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2023-08-31T18:46:48.580 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-31T18:46:48.581 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2023-08-31T18:46:48.668 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-31T18:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T18:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 446 Links: 1 2023-08-31T18:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T18:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T18:46:48.669 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-08-31 18:46:42.808048717 +0000 2023-08-31T18:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-08-31 18:39:42.530719314 +0000 2023-08-31T18:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-08-31 18:39:42.530719314 +0000 2023-08-31T18:46:48.670 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-08-31 18:39:42.502719877 +0000 2023-08-31T18:46:48.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-31T18:46:48.741 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-08-31T18:46:48.742 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-08-31T18:46:48.742 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000276248 s, 1.9 MB/s 2023-08-31T18:46:48.745 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-31T18:46:48.795 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2023-08-31T18:46:48.841 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-31T18:46:48.842 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T18:46:48.842 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-08-31T18:46:48.842 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T18:46:48.842 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T18:46:48.843 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-08-31 18:46:42.808048717 +0000 2023-08-31T18:46:48.843 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-08-31 18:39:43.368702482 +0000 2023-08-31T18:46:48.843 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-08-31 18:39:43.368702482 +0000 2023-08-31T18:46:48.843 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-08-31 18:39:43.338703084 +0000 2023-08-31T18:46:48.844 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-31T18:46:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-08-31T18:46:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-08-31T18:46:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000260805 s, 2.0 MB/s 2023-08-31T18:46:48.917 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-31T18:46:48.966 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2023-08-31T18:46:49.014 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-31T18:46:49.014 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T18:46:49.014 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-08-31T18:46:49.014 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T18:46:49.015 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T18:46:49.015 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-08-31 18:46:42.808048717 +0000 2023-08-31T18:46:49.015 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-08-31 18:39:44.202685730 +0000 2023-08-31T18:46:49.015 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-08-31 18:39:44.202685730 +0000 2023-08-31T18:46:49.015 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-08-31 18:39:44.176686252 +0000 2023-08-31T18:46:49.016 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-31T18:46:49.084 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-08-31T18:46:49.084 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-08-31T18:46:49.084 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000277353 s, 1.8 MB/s 2023-08-31T18:46:49.086 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-31T18:46:49.136 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2023-08-31T18:46:49.184 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-31T18:46:49.184 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T18:46:49.185 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-08-31T18:46:49.185 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T18:46:49.185 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T18:46:49.185 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-08-31 18:46:42.808048717 +0000 2023-08-31T18:46:49.185 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-08-31 18:39:45.060668496 +0000 2023-08-31T18:46:49.186 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-08-31 18:39:45.060668496 +0000 2023-08-31T18:46:49.186 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2023-08-31 18:39:45.032669058 +0000 2023-08-31T18:46:49.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-31T18:46:49.254 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-08-31T18:46:49.254 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-08-31T18:46:49.255 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000300156 s, 1.7 MB/s 2023-08-31T18:46:49.257 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-31T18:46:49.306 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T18:46:49.306 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:46:49.306 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2023-08-31T18:46:49.356 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-31T18:46:49.356 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2023-08-31T18:46:49.404 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-31T18:46:49.405 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T18:46:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-08-31T18:46:49.405 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T18:46:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T18:46:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-08-31 18:45:21.429653744 +0000 2023-08-31T18:46:49.406 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-08-31 18:39:31.011578566 +0000 2023-08-31T18:46:49.407 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-08-31 18:39:31.011578566 +0000 2023-08-31T18:46:49.407 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2023-08-31 18:39:30.982578992 +0000 2023-08-31T18:46:49.408 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-31T18:46:49.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-08-31T18:46:49.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-08-31T18:46:49.476 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000288374 s, 1.8 MB/s 2023-08-31T18:46:49.478 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-31T18:46:49.526 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2023-08-31T18:46:49.572 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-31T18:46:49.572 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T18:46:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-08-31T18:46:49.573 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T18:46:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T18:46:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-08-31 18:45:21.429653744 +0000 2023-08-31T18:46:49.574 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-08-31 18:39:31.862566062 +0000 2023-08-31T18:46:49.575 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-08-31 18:39:31.862566062 +0000 2023-08-31T18:46:49.575 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2023-08-31 18:39:31.833566488 +0000 2023-08-31T18:46:49.576 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-31T18:46:49.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-08-31T18:46:49.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-08-31T18:46:49.681 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000289235 s, 1.8 MB/s 2023-08-31T18:46:49.682 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-31T18:46:49.731 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2023-08-31T18:46:49.817 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-31T18:46:49.817 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T18:46:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-08-31T18:46:49.817 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T18:46:49.818 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T18:46:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-08-31 18:45:21.429653744 +0000 2023-08-31T18:46:49.822 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-08-31 18:39:32.690553895 +0000 2023-08-31T18:46:49.823 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-08-31 18:39:32.690553895 +0000 2023-08-31T18:46:49.823 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2023-08-31 18:39:32.664554277 +0000 2023-08-31T18:46:49.823 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-31T18:46:49.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-08-31T18:46:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-08-31T18:46:49.924 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.00031316 s, 1.6 MB/s 2023-08-31T18:46:49.926 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-31T18:46:49.975 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2023-08-31T18:46:50.022 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-31T18:46:50.074 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T18:46:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-08-31T18:46:50.074 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T18:46:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T18:46:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-08-31 18:45:21.429653744 +0000 2023-08-31T18:46:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-08-31 18:39:33.520541699 +0000 2023-08-31T18:46:50.075 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-08-31 18:39:33.520541699 +0000 2023-08-31T18:46:50.076 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: 2023-08-31 18:39:33.497542037 +0000 2023-08-31T18:46:50.076 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-31T18:46:50.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-08-31T18:46:50.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-08-31T18:46:50.143 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000515539 s, 993 kB/s 2023-08-31T18:46:50.145 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-31T18:46:50.194 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T18:46:50.195 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-31T18:46:50.195 INFO:tasks.ceph:Generating config... 2023-08-31T18:46:50.198 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-31T18:46:50.198 INFO:tasks.ceph:[client] debug client = 20 2023-08-31T18:46:50.199 INFO:tasks.ceph:[client] debug ms = 1 2023-08-31T18:46:50.199 INFO:tasks.ceph:[client] pid file = 2023-08-31T18:46:50.200 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-31T18:46:50.200 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-31T18:46:50.201 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-08-31T18:46:50.201 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-31T18:46:50.202 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-31T18:46:50.202 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-31T18:46:50.203 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-31T18:46:50.203 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-31T18:46:50.204 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-31T18:46:50.204 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-31T18:46:50.205 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-31T18:46:50.205 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-31T18:46:50.206 INFO:tasks.ceph:[mgr] debug client = 20 2023-08-31T18:46:50.206 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-08-31T18:46:50.207 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-31T18:46:50.207 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-31T18:46:50.208 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-31T18:46:50.208 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-31T18:46:50.209 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-31T18:46:50.209 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-31T18:46:50.210 INFO:tasks.ceph:[osd] bdev async discard = True 2023-08-31T18:46:50.210 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-08-31T18:46:50.211 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-08-31T18:46:50.211 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-31T18:46:50.212 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-31T18:46:50.212 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-08-31T18:46:50.212 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-08-31T18:46:50.213 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-31T18:46:50.213 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-31T18:46:50.214 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-08-31T18:46:50.214 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-31T18:46:50.215 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-31T18:46:50.215 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-31T18:46:50.216 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-31T18:46:50.216 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-31T18:46:50.217 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-31T18:46:50.217 INFO:tasks.ceph:Setting up mon.a... 2023-08-31T18:46:50.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-31T18:46:51.514 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.keyring 2023-08-31T18:46:51.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-31T18:46:51.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-31T18:46:51.687 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.72'), ('mon.b', '172.21.15.146'), ('mon.c', '[v2:172.21.15.146:3301,v1:172.21.15.146:6790]')] 2023-08-31T18:46:51.688 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.72,172.21.15.146,[v2:172.21.15.146:3301,v1:172.21.15.146:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-31T18:46:51.689 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:46:51.691 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-31T18:46:51.737 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.72 --add b 172.21.15.146 --addv c '[v2:172.21.15.146:3301,v1:172.21.15.146:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-31T18:46:51.861 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-31T18:46:51.862 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: generated fsid acadb8ca-1685-49e1-a73f-5e9d14d95be9 2023-08-31T18:46:51.862 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 0 2023-08-31T18:46:51.862 INFO:teuthology.orchestra.run.smithi072.stdout:fsid acadb8ca-1685-49e1-a73f-5e9d14d95be9 2023-08-31T18:46:51.863 INFO:teuthology.orchestra.run.smithi072.stdout:last_changed 2023-08-31T18:46:51.862528+0000 2023-08-31T18:46:51.863 INFO:teuthology.orchestra.run.smithi072.stdout:created 2023-08-31T18:46:51.862528+0000 2023-08-31T18:46:51.863 INFO:teuthology.orchestra.run.smithi072.stdout:min_mon_release 0 (unknown) 2023-08-31T18:46:51.863 INFO:teuthology.orchestra.run.smithi072.stdout:election_strategy: 1 2023-08-31T18:46:51.864 INFO:teuthology.orchestra.run.smithi072.stdout:0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2023-08-31T18:46:51.864 INFO:teuthology.orchestra.run.smithi072.stdout:1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2023-08-31T18:46:51.864 INFO:teuthology.orchestra.run.smithi072.stdout:2: [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] mon.c 2023-08-31T18:46:51.864 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-31T18:46:51.866 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-31T18:46:51.912 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID acadb8ca-1685-49e1-a73f-5e9d14d95be9... 2023-08-31T18:46:51.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-31T18:46:51.957 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-31T18:46:52.074 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2023-08-31T18:46:52.074 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2023-08-31T18:46:52.075 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-31T18:46:52.075 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2023-08-31T18:46:52.075 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.075 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2023-08-31T18:46:52.075 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.075 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2023-08-31T18:46:52.076 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.076 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2023-08-31T18:46:52.076 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2023-08-31T18:46:52.076 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.076 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2023-08-31T18:46:52.077 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2023-08-31T18:46:52.077 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.077 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-31T18:46:52.077 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2023-08-31T18:46:52.077 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.078 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2023-08-31T18:46:52.078 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-31T18:46:52.078 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.078 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2023-08-31T18:46:52.078 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.079 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2023-08-31T18:46:52.079 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2023-08-31T18:46:52.079 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2023-08-31T18:46:52.079 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2023-08-31T18:46:52.079 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2023-08-31T18:46:52.080 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2023-08-31T18:46:52.080 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2023-08-31T18:46:52.080 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-31T18:46:52.080 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-31T18:46:52.080 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2023-08-31T18:46:52.080 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.081 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-31T18:46:52.081 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.081 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2023-08-31T18:46:52.082 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.082 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2023-08-31T18:46:52.082 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.082 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2023-08-31T18:46:52.082 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2023-08-31T18:46:52.082 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2023-08-31T18:46:52.083 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.72,172.21.15.146,[v2:172.21.15.146:3301,v1:172.21.15.146:6790]" 2023-08-31T18:46:52.083 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on skipped message = False 2023-08-31T18:46:52.083 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = acadb8ca-1685-49e1-a73f-5e9d14d95be9 2023-08-31T18:46:52.083 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.083 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2023-08-31T18:46:52.084 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2023-08-31T18:46:52.084 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.084 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2023-08-31T18:46:52.084 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2023-08-31T18:46:52.084 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.085 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2023-08-31T18:46:52.085 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2023-08-31T18:46:52.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.085 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2023-08-31T18:46:52.085 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2023-08-31T18:46:52.086 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2023-08-31T18:46:52.086 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.086 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2023-08-31T18:46:52.086 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2023-08-31T18:46:52.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.089 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2023-08-31T18:46:52.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.090 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2023-08-31T18:46:52.090 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.090 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2023-08-31T18:46:52.090 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.090 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2023-08-31T18:46:52.091 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2023-08-31T18:46:52.091 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.091 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2023-08-31T18:46:52.092 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2023-08-31T18:46:52.092 INFO:teuthology.orchestra.run.smithi072.stdout: bdev async discard = True 2023-08-31T18:46:52.092 INFO:teuthology.orchestra.run.smithi072.stdout: bdev enable discard = True 2023-08-31T18:46:52.092 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore allocator = bitmap 2023-08-31T18:46:52.092 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2023-08-31T18:46:52.092 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2023-08-31T18:46:52.093 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 1/20 2023-08-31T18:46:52.093 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 1/20 2023-08-31T18:46:52.093 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-08-31T18:46:52.093 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2023-08-31T18:46:52.093 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 4/10 2023-08-31T18:46:52.094 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2023-08-31T18:46:52.094 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2023-08-31T18:46:52.094 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2023-08-31T18:46:52.094 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2023-08-31T18:46:52.094 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2023-08-31T18:46:52.095 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-08-31T18:46:52.095 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.095 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2023-08-31T18:46:52.095 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-08-31T18:46:52.095 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2023-08-31T18:46:52.096 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-08-31T18:46:52.096 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-08-31T18:46:52.096 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-08-31T18:46:52.096 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-08-31T18:46:52.096 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2023-08-31T18:46:52.096 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2023-08-31T18:46:52.097 INFO:teuthology.orchestra.run.smithi072.stdout: debug finisher = 20 2023-08-31T18:46:52.097 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.097 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2023-08-31T18:46:52.097 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-08-31T18:46:52.097 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-08-31T18:46:52.098 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2023-08-31T18:46:52.098 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-08-31T18:46:52.098 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2023-08-31T18:46:52.098 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2023-08-31T18:46:52.099 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-08-31T18:46:52.099 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2023-08-31T18:46:52.099 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2023-08-31T18:46:52.099 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-08-31T18:46:52.099 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.099 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-31T18:46:52.100 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2023-08-31T18:46:52.100 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2023-08-31T18:46:52.100 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.100 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2023-08-31T18:46:52.100 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-31T18:46:52.101 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-31T18:46:52.101 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2023-08-31T18:46:52.101 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:46:52.101 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2023-08-31T18:46:52.102 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2023-08-31T18:46:52.102 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2023-08-31T18:46:52.102 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2023-08-31T18:46:52.102 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-31T18:46:52.102 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-31T18:46:52.103 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2023-08-31T18:46:52.103 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2023-08-31T18:46:52.103 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-08-31T18:46:52.103 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = "" 2023-08-31T18:46:52.103 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-08-31T18:46:52.104 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-08-31T18:46:52.104 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2023-08-31T18:46:52.104 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2023-08-31T18:46:52.104 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2023-08-31T18:46:52.104 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-08-31T18:46:52.104 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-08-31T18:46:52.105 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-08-31T18:46:52.105 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-08-31T18:46:52.105 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2023-08-31T18:46:52.105 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2023-08-31T18:46:52.105 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-08-31T18:46:52.105 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2023-08-31T18:46:52.106 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2023-08-31T18:46:52.106 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2023-08-31T18:46:52.106 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2023-08-31T18:46:52.106 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-08-31T18:46:52.106 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-08-31T18:46:52.107 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-08-31T18:46:52.107 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2023-08-31T18:46:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2023-08-31T18:46:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-31T18:46:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2023-08-31T18:46:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2023-08-31T18:46:52.108 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2023-08-31T18:46:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2023-08-31T18:46:52.109 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2023-08-31T18:46:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2023-08-31T18:46:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2023-08-31T18:46:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.110 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-31T18:46:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2023-08-31T18:46:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2023-08-31T18:46:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-31T18:46:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.111 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2023-08-31T18:46:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2023-08-31T18:46:52.112 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2023-08-31T18:46:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2023-08-31T18:46:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2023-08-31T18:46:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2023-08-31T18:46:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2023-08-31T18:46:52.113 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2023-08-31T18:46:52.114 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-31T18:46:52.114 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-31T18:46:52.114 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2023-08-31T18:46:52.114 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.114 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-31T18:46:52.114 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2023-08-31T18:46:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2023-08-31T18:46:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.115 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2023-08-31T18:46:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2023-08-31T18:46:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2023-08-31T18:46:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.72,172.21.15.146,[v2:172.21.15.146:3301,v1:172.21.15.146:6790]" 2023-08-31T18:46:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on skipped message = False 2023-08-31T18:46:52.116 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = acadb8ca-1685-49e1-a73f-5e9d14d95be9 2023-08-31T18:46:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.117 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2023-08-31T18:46:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2023-08-31T18:46:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2023-08-31T18:46:52.117 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2023-08-31T18:46:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2023-08-31T18:46:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2023-08-31T18:46:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.118 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2023-08-31T18:46:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2023-08-31T18:46:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2023-08-31T18:46:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2023-08-31T18:46:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2023-08-31T18:46:52.119 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2023-08-31T18:46:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2023-08-31T18:46:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.120 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2023-08-31T18:46:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2023-08-31T18:46:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2023-08-31T18:46:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2023-08-31T18:46:52.121 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2023-08-31T18:46:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2023-08-31T18:46:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2023-08-31T18:46:52.122 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2023-08-31T18:46:52.123 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2023-08-31T18:46:52.123 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2023-08-31T18:46:52.123 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2023-08-31T18:46:52.123 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2023-08-31T18:46:52.123 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-08-31T18:46:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2023-08-31T18:46:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2023-08-31T18:46:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2023-08-31T18:46:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2023-08-31T18:46:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2023-08-31T18:46:52.124 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2023-08-31T18:46:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2023-08-31T18:46:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-08-31T18:46:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.125 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2023-08-31T18:46:52.125 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-08-31T18:46:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2023-08-31T18:46:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-08-31T18:46:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-08-31T18:46:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-08-31T18:46:52.126 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-08-31T18:46:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2023-08-31T18:46:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2023-08-31T18:46:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: debug finisher = 20 2023-08-31T18:46:52.127 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.127 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2023-08-31T18:46:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-08-31T18:46:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-08-31T18:46:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2023-08-31T18:46:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-08-31T18:46:52.128 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2023-08-31T18:46:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2023-08-31T18:46:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-08-31T18:46:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2023-08-31T18:46:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2023-08-31T18:46:52.129 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-08-31T18:46:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-31T18:46:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2023-08-31T18:46:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2023-08-31T18:46:52.130 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2023-08-31T18:46:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-31T18:46:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-31T18:46:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2023-08-31T18:46:52.131 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-08-31T18:46:52.132 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2023-08-31T18:46:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2023-08-31T18:46:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2023-08-31T18:46:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2023-08-31T18:46:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-31T18:46:52.132 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-31T18:46:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2023-08-31T18:46:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2023-08-31T18:46:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-08-31T18:46:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2023-08-31T18:46:52.133 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-08-31T18:46:52.134 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-08-31T18:46:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2023-08-31T18:46:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2023-08-31T18:46:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2023-08-31T18:46:52.134 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-08-31T18:46:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2023-08-31T18:46:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-08-31T18:46:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2023-08-31T18:46:52.135 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2023-08-31T18:46:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2023-08-31T18:46:52.135 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-08-31T18:46:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2023-08-31T18:46:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = True 2023-08-31T18:46:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2023-08-31T18:46:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = True 2023-08-31T18:46:52.136 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-08-31T18:46:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-08-31T18:46:52.137 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-08-31T18:46:52.138 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-31T18:46:52.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-31T18:46:52.244 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-31T18:46:52.245 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:46:52.245 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-31T18:46:52.289 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:46:52.289 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-31T18:46:52.375 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T18:46:52.375 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:46:52.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-31T18:46:52.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-31T18:46:52.508 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:46:52.509 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-31T18:46:52.593 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2023-08-31T18:46:52.594 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:46:52.594 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-31T18:46:52.594 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-31T18:46:52.689 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:46:52.689 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-31T18:46:52.774 INFO:tasks.ceph:Setting up mon nodes... 2023-08-31T18:46:52.774 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-31T18:46:52.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-31T18:46:52.891 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-31T18:46:52.896 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-31T18:46:53.088 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-31T18:46:53.093 INFO:tasks.ceph:Setting up mds nodes... 2023-08-31T18:46:53.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-31T18:46:53.211 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-31T18:46:53.216 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-31T18:46:53.285 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-31T18:46:53.399 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-31T18:46:53.404 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-31T18:46:53.473 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-31T18:46:53.591 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-31T18:46:53.597 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-31T18:46:53.667 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-31T18:46:53.785 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-31T18:46:53.789 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-31T18:46:53.859 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-31T18:46:53.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-31T18:46:53.950 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-31T18:46:53.979 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-31T18:46:54.068 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-31T18:46:54.098 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-31T18:46:54.188 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-31T18:46:54.218 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-31T18:46:54.309 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-31T18:46:54.338 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-31T18:46:54.339 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-31T18:46:54.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-31T18:46:54.408 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T18:46:54.409 INFO:tasks.ceph:role: osd.0 2023-08-31T18:46:54.409 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T18:46:54.409 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-31T18:46:54.485 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T18:46:54.485 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T18:46:54.486 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T18:46:54.486 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T18:46:54.486 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T18:46:54.486 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-08-31T18:46:54.486 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T18:46:54.487 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T18:46:54.487 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T18:46:54.487 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T18:46:54.918 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-08-31T18:46:54.921 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-08-31T18:46:54.922 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-31T18:46:55.135 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-31T18:46:55.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-31T18:46:55.282 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T18:46:55.283 INFO:tasks.ceph:role: osd.1 2023-08-31T18:46:55.283 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T18:46:55.283 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-31T18:46:55.359 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T18:46:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T18:46:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T18:46:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T18:46:55.360 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T18:46:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-08-31T18:46:55.360 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T18:46:55.361 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T18:46:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T18:46:55.361 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T18:46:55.768 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-08-31T18:46:55.773 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-08-31T18:46:55.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-31T18:46:55.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-31T18:46:55.997 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-31T18:46:56.066 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T18:46:56.067 INFO:tasks.ceph:role: osd.2 2023-08-31T18:46:56.067 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T18:46:56.068 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-31T18:46:56.144 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T18:46:56.145 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T18:46:56.145 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T18:46:56.145 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T18:46:56.145 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T18:46:56.146 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-08-31T18:46:56.146 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T18:46:56.146 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T18:46:56.146 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T18:46:56.147 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T18:46:56.587 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-08-31T18:46:56.590 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-08-31T18:46:56.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-31T18:46:56.792 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-31T18:46:56.872 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-31T18:46:56.941 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T18:46:56.941 INFO:tasks.ceph:role: osd.3 2023-08-31T18:46:56.941 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T18:46:56.942 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-31T18:46:57.017 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T18:46:57.018 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T18:46:57.018 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T18:46:57.018 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T18:46:57.018 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T18:46:57.019 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-08-31T18:46:57.019 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T18:46:57.019 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T18:46:57.019 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T18:46:57.019 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T18:46:57.451 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-08-31T18:46:57.455 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-08-31T18:46:57.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-31T18:46:57.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-31T18:46:57.657 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T18:46:58.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:46:58.272+0000 7f33cecb8200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-31T18:46:58.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:46:58.272+0000 7f33cecb8200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-31T18:46:58.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:46:58.272+0000 7f33cecb8200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-31T18:46:58.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:46:58.272+0000 7f33cecb8200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-31T18:46:58.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:46:58.272+0000 7f33cecb8200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-31T18:46:58.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:46:58.275+0000 7f33cecb8200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-31T18:47:01.400 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-31T18:47:01.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T18:47:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:01.570+0000 7fd05238c200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-31T18:47:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:01.571+0000 7fd05238c200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-31T18:47:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:01.571+0000 7fd05238c200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-31T18:47:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:01.571+0000 7fd05238c200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-31T18:47:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:01.571+0000 7fd05238c200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-31T18:47:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:01.572+0000 7fd05238c200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-31T18:47:05.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-31T18:47:05.285 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T18:47:05.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:05.385+0000 7fc434486200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-31T18:47:05.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:05.385+0000 7fc434486200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-31T18:47:05.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:05.385+0000 7fc434486200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-31T18:47:05.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:05.385+0000 7fc434486200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-31T18:47:05.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:05.385+0000 7fc434486200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-31T18:47:05.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:05.387+0000 7fc434486200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-31T18:47:08.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-31T18:47:08.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T18:47:08.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:08.686+0000 7f61fd2eb200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-31T18:47:08.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:08.686+0000 7f61fd2eb200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-31T18:47:08.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:08.686+0000 7f61fd2eb200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-31T18:47:08.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:08.686+0000 7f61fd2eb200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-31T18:47:08.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:08.686+0000 7f61fd2eb200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-31T18:47:08.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:08.688+0000 7f61fd2eb200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-31T18:47:11.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-31T18:47:11.882 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-31T18:47:11.962 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T18:47:11.962 INFO:tasks.ceph:role: osd.4 2023-08-31T18:47:11.962 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2023-08-31T18:47:11.963 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-31T18:47:12.042 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T18:47:12.042 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T18:47:12.042 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T18:47:12.043 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T18:47:12.043 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T18:47:12.043 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-08-31T18:47:12.043 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T18:47:12.043 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T18:47:12.044 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T18:47:12.044 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T18:47:12.481 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-08-31T18:47:12.485 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-08-31T18:47:12.485 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-31T18:47:12.674 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-31T18:47:12.752 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-31T18:47:12.823 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T18:47:12.823 INFO:tasks.ceph:role: osd.5 2023-08-31T18:47:12.823 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com 2023-08-31T18:47:12.824 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-31T18:47:12.901 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T18:47:12.902 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T18:47:12.902 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T18:47:12.902 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T18:47:12.902 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T18:47:12.903 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-08-31T18:47:12.903 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T18:47:12.903 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T18:47:12.903 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T18:47:12.903 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T18:47:13.310 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-08-31T18:47:13.314 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-08-31T18:47:13.314 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-31T18:47:13.453 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-31T18:47:13.530 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-31T18:47:13.600 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T18:47:13.600 INFO:tasks.ceph:role: osd.6 2023-08-31T18:47:13.601 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com 2023-08-31T18:47:13.601 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-31T18:47:13.678 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T18:47:13.678 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T18:47:13.678 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T18:47:13.678 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T18:47:13.679 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T18:47:13.679 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-08-31T18:47:13.679 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T18:47:13.679 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T18:47:13.679 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T18:47:13.680 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T18:47:14.131 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-08-31T18:47:14.135 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-08-31T18:47:14.135 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-31T18:47:14.318 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-31T18:47:14.395 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-31T18:47:14.465 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T18:47:14.465 INFO:tasks.ceph:role: osd.7 2023-08-31T18:47:14.465 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com 2023-08-31T18:47:14.466 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-31T18:47:14.542 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T18:47:14.542 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T18:47:14.542 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T18:47:14.543 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T18:47:14.543 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T18:47:14.543 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-08-31T18:47:14.543 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T18:47:14.543 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T18:47:14.544 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T18:47:14.544 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T18:47:14.981 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-08-31T18:47:14.985 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-08-31T18:47:14.985 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-31T18:47:15.109 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-31T18:47:15.185 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T18:47:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:15.320+0000 7fe731575200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-31T18:47:15.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:15.320+0000 7fe731575200 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-31T18:47:15.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:15.320+0000 7fe731575200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-31T18:47:15.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:15.321+0000 7fe731575200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-31T18:47:15.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:15.321+0000 7fe731575200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-31T18:47:15.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:15.322+0000 7fe731575200 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-31T18:47:18.374 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:47:18.379 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:47:18.466 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-31T18:47:18.536 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T18:47:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:18.675+0000 7ff7900bb200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-31T18:47:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:18.675+0000 7ff7900bb200 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-31T18:47:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:18.675+0000 7ff7900bb200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-31T18:47:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:18.675+0000 7ff7900bb200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-31T18:47:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:18.675+0000 7ff7900bb200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-31T18:47:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:18.676+0000 7ff7900bb200 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-31T18:47:21.814 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-31T18:47:21.886 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T18:47:21.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:21.985+0000 7fa2ffd2a200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-31T18:47:21.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:21.985+0000 7fa2ffd2a200 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-31T18:47:21.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:21.985+0000 7fa2ffd2a200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-31T18:47:21.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:21.985+0000 7fa2ffd2a200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-31T18:47:21.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:21.985+0000 7fa2ffd2a200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-31T18:47:21.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:21.987+0000 7fa2ffd2a200 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-31T18:47:25.106 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-31T18:47:25.177 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T18:47:25.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:25.277+0000 7f766d278200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-31T18:47:25.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:25.277+0000 7f766d278200 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-31T18:47:25.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:25.277+0000 7f766d278200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-31T18:47:25.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:25.277+0000 7f766d278200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-31T18:47:25.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:25.277+0000 7f766d278200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-31T18:47:25.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:25.279+0000 7f766d278200 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-31T18:47:28.412 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-31T18:47:28.488 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-31T18:47:28.489 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:47:28.489 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-31T18:47:28.564 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:47:28.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-31T18:47:28.634 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:47:28.635 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-31T18:47:28.743 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:47:28.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-31T18:47:28.851 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:47:28.851 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-31T18:47:28.958 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:47:28.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-31T18:47:29.065 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:47:29.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-31T18:47:29.173 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:47:29.174 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-31T18:47:29.250 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:47:29.251 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-31T18:47:29.322 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:47:29.322 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-31T18:47:29.431 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:47:29.432 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-31T18:47:29.541 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:47:29.541 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-31T18:47:29.650 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:47:29.650 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-31T18:47:29.759 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:47:29.759 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-31T18:47:29.867 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:47:29.868 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-31T18:47:29.915 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:47:29.915 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-31T18:47:30.001 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:47:30.001 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-31T18:47:30.046 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:47:30.047 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-31T18:47:30.132 INFO:tasks.ceph:Adding keys to all mons... 2023-08-31T18:47:30.133 DEBUG:teuthology.orchestra.run.smithi072:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-31T18:47:30.137 DEBUG:teuthology.orchestra.run.smithi146:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-31T18:47:30.198 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.y] 2023-08-31T18:47:30.198 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAc4PBkSWszNRAAdBxrfMEuBRgePfaiPx6kpQ== 2023-08-31T18:47:30.199 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-08-31T18:47:30.199 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAd4PBkPeqvDBAAA2eEr6xr7iF5PPNT9eehSg== 2023-08-31T18:47:30.199 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-08-31T18:47:30.199 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAd4PBkcpLfFxAASIB//h8whjuh6s3YKBVffQ== 2023-08-31T18:47:30.199 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.0] 2023-08-31T18:47:30.200 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAi4PBkvfRJEBAAYQqPldOXrJxXAXnmZhXaBQ== 2023-08-31T18:47:30.200 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.1] 2023-08-31T18:47:30.200 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAl4PBkYysSIhAA4nCmskcGV+i4vpH2k/gDBg== 2023-08-31T18:47:30.200 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.2] 2023-08-31T18:47:30.200 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAp4PBkyDgJFxAAPynEKk15yN7+OxQxpzL0UQ== 2023-08-31T18:47:30.201 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.3] 2023-08-31T18:47:30.201 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAs4PBkZMD2KBAAoJrO4YjJ4/8MjcPAtgEn1g== 2023-08-31T18:47:30.201 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.x] 2023-08-31T18:47:30.201 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAd4PBkiGBUBRAAwWTFqrz+ELBSwb0Z2T9yhQ== 2023-08-31T18:47:30.201 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-08-31T18:47:30.201 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAd4PBkctxUIxAAufSVXMwPzPA7Gq1s4ukXiQ== 2023-08-31T18:47:30.202 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-08-31T18:47:30.202 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAd4PBkC1bbLhAAg/0wct2P0+cyWbZyI2bP/g== 2023-08-31T18:47:30.202 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.4] 2023-08-31T18:47:30.202 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAz4PBkSgAoExAAJ95kdHV47jDTXSj/WSCiLw== 2023-08-31T18:47:30.202 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.5] 2023-08-31T18:47:30.203 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQA24PBkUxpLKBAAAu8d6iKME6wW+Q/6hhFIRQ== 2023-08-31T18:47:30.203 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.6] 2023-08-31T18:47:30.203 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQA54PBkURHJOhAA3HaPfENVQ4hLIjc/esF0bQ== 2023-08-31T18:47:30.203 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.7] 2023-08-31T18:47:30.203 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQA94PBkfoqTEBAAQHENgrp5tv1X47Br/dUksQ== 2023-08-31T18:47:30.204 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2023-08-31T18:47:30.204 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAd4PBkucWuOBAABLowlGxpCR3GgoOCRmC0FQ== 2023-08-31T18:47:30.204 INFO:teuthology.orchestra.run.smithi072.stdout:[client.2] 2023-08-31T18:47:30.204 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAe4PBkYeIoBBAAjoIzJJ9McIx3rLBSaorTKA== 2023-08-31T18:47:30.204 INFO:teuthology.orchestra.run.smithi072.stdout:[client.1] 2023-08-31T18:47:30.205 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAe4PBkVGBPCxAAO4M9u24/yH0xwtV6oSz+JQ== 2023-08-31T18:47:30.205 INFO:teuthology.orchestra.run.smithi072.stdout:[client.3] 2023-08-31T18:47:30.205 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAe4PBkX/V9EhAAqWuBMMhikN/JUQp3v5/ABQ== 2023-08-31T18:47:30.239 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.y] 2023-08-31T18:47:30.240 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAc4PBkSWszNRAAdBxrfMEuBRgePfaiPx6kpQ== 2023-08-31T18:47:30.240 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-08-31T18:47:30.240 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAd4PBkPeqvDBAAA2eEr6xr7iF5PPNT9eehSg== 2023-08-31T18:47:30.240 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2023-08-31T18:47:30.240 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAd4PBkcpLfFxAASIB//h8whjuh6s3YKBVffQ== 2023-08-31T18:47:30.241 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.0] 2023-08-31T18:47:30.241 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAi4PBkvfRJEBAAYQqPldOXrJxXAXnmZhXaBQ== 2023-08-31T18:47:30.241 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.1] 2023-08-31T18:47:30.241 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAl4PBkYysSIhAA4nCmskcGV+i4vpH2k/gDBg== 2023-08-31T18:47:30.241 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.2] 2023-08-31T18:47:30.242 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAp4PBkyDgJFxAAPynEKk15yN7+OxQxpzL0UQ== 2023-08-31T18:47:30.242 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.3] 2023-08-31T18:47:30.242 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAs4PBkZMD2KBAAoJrO4YjJ4/8MjcPAtgEn1g== 2023-08-31T18:47:30.242 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.x] 2023-08-31T18:47:30.242 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAd4PBkiGBUBRAAwWTFqrz+ELBSwb0Z2T9yhQ== 2023-08-31T18:47:30.243 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-08-31T18:47:30.243 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAd4PBkctxUIxAAufSVXMwPzPA7Gq1s4ukXiQ== 2023-08-31T18:47:30.243 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2023-08-31T18:47:30.243 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAd4PBkC1bbLhAAg/0wct2P0+cyWbZyI2bP/g== 2023-08-31T18:47:30.243 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.4] 2023-08-31T18:47:30.244 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAz4PBkSgAoExAAJ95kdHV47jDTXSj/WSCiLw== 2023-08-31T18:47:30.244 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.5] 2023-08-31T18:47:30.244 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQA24PBkUxpLKBAAAu8d6iKME6wW+Q/6hhFIRQ== 2023-08-31T18:47:30.244 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.6] 2023-08-31T18:47:30.244 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQA54PBkURHJOhAA3HaPfENVQ4hLIjc/esF0bQ== 2023-08-31T18:47:30.244 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.7] 2023-08-31T18:47:30.245 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQA94PBkfoqTEBAAQHENgrp5tv1X47Br/dUksQ== 2023-08-31T18:47:30.245 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2023-08-31T18:47:30.245 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAd4PBkucWuOBAABLowlGxpCR3GgoOCRmC0FQ== 2023-08-31T18:47:30.245 INFO:teuthology.orchestra.run.smithi146.stdout:[client.2] 2023-08-31T18:47:30.245 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAe4PBkYeIoBBAAjoIzJJ9McIx3rLBSaorTKA== 2023-08-31T18:47:30.246 INFO:teuthology.orchestra.run.smithi146.stdout:[client.1] 2023-08-31T18:47:30.246 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAe4PBkVGBPCxAAO4M9u24/yH0xwtV6oSz+JQ== 2023-08-31T18:47:30.246 INFO:teuthology.orchestra.run.smithi146.stdout:[client.3] 2023-08-31T18:47:30.247 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQAe4PBkX/V9EhAAqWuBMMhikN/JUQp3v5/ABQ== 2023-08-31T18:47:30.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T18:47:30.252 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T18:47:30.390 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T18:47:30.395 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T18:47:30.499 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T18:47:30.503 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T18:47:30.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:30.612 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:30.713 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:30.718 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:30.819 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:30.824 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:30.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:30.930 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:31.032 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T18:47:31.036 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T18:47:31.138 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T18:47:31.143 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T18:47:31.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T18:47:31.252 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T18:47:31.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:31.363 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:31.466 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:31.473 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:31.575 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:31.581 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:31.683 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:31.688 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T18:47:31.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T18:47:31.797 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T18:47:31.903 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T18:47:31.907 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T18:47:32.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T18:47:32.018 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T18:47:32.123 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T18:47:32.129 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T18:47:32.233 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-31T18:47:32.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-31T18:47:32.303 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-31T18:47:32.418 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-31T18:47:32.490 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-31T18:47:32.560 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-31T18:47:32.675 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-31T18:47:32.745 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-31T18:47:32.816 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-31T18:47:32.931 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-31T18:47:33.001 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-31T18:47:33.005 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-31T18:47:33.050 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-31T18:47:33.051 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-31T18:47:33.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-31T18:47:33.091 INFO:tasks.ceph.mon.a:Started 2023-08-31T18:47:33.092 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-31T18:47:33.092 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-31T18:47:33.097 INFO:tasks.ceph.mon.b:Started 2023-08-31T18:47:33.097 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-31T18:47:33.097 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-31T18:47:33.101 INFO:tasks.ceph.mon.c:Started 2023-08-31T18:47:33.102 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-31T18:47:33.102 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-31T18:47:33.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-31T18:47:33.106 INFO:tasks.ceph.mgr.y:Started 2023-08-31T18:47:33.107 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-31T18:47:33.107 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-31T18:47:33.112 INFO:tasks.ceph.mgr.x:Started 2023-08-31T18:47:33.112 INFO:tasks.ceph:Setting crush tunables to default 2023-08-31T18:47:33.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd crush tunables default 2023-08-31T18:47:33.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.301+0000 7f3a77fff700 1 Processor -- start 2023-08-31T18:47:33.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.301+0000 7f3a77fff700 1 -- start start 2023-08-31T18:47:33.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.303+0000 7f3a77fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70154210 0x7f3a700630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:33.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.303+0000 7f3a77fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3a700635a0 0x7f3a700c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:33.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.303+0000 7f3a77fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a70063a00 con 0x7f3a70153e30 2023-08-31T18:47:33.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.303+0000 7f3a77fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a70154690 con 0x7f3a700635a0 2023-08-31T18:47:33.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.303+0000 7f3a77fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700bfd40 con 0x7f3a70154210 2023-08-31T18:47:33.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.303+0000 7f3a75d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3a70153e30 0x7f3a700c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:42304/0 (socket says 172.21.15.72:42304) 2023-08-31T18:47:33.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.303+0000 7f3a7659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3a700635a0 0x7f3a700c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:33.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.303+0000 7f3a75d9b700 1 -- 172.21.15.72:0/150965076 learned_addr learned my addr 172.21.15.72:0/150965076 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:47:33.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.303+0000 7f3a7559a700 1 --2- 172.21.15.72:0/150965076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70154210 0x7f3a700630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:33.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.303+0000 7f3a7659c700 1 -- 172.21.15.72:0/150965076 >> v2:172.21.15.146:3300/0 conn(0x7f3a700635a0 msgr2=0x7f3a700c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-08-31T18:47:33.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.303+0000 7f3a7659c700 1 -- 172.21.15.72:0/150965076 >> v2:172.21.15.146:3300/0 conn(0x7f3a700635a0 msgr2=0x7f3a700c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-31T18:47:33.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.303+0000 7f3a7659c700 1 --2- 172.21.15.72:0/150965076 >> v2:172.21.15.146:3300/0 conn(0x7f3a700635a0 0x7f3a700c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-31T18:47:33.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.303+0000 7f3a7559a700 1 -- 172.21.15.72:0/150965076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70154210 msgr2=0x7f3a700630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-31T18:47:33.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.303+0000 7f3a7659c700 1 --2- 172.21.15.72:0/150965076 >> v2:172.21.15.146:3300/0 conn(0x7f3a700635a0 0x7f3a700c0ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T18:47:33.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.303+0000 7f3a7559a700 1 -- 172.21.15.72:0/150965076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70154210 msgr2=0x7f3a700630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-31T18:47:33.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.304+0000 7f3a7559a700 1 --2- 172.21.15.72:0/150965076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70154210 0x7f3a700630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-31T18:47:33.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.304+0000 7f3a7559a700 1 --2- 172.21.15.72:0/150965076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70154210 0x7f3a700630b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T18:47:33.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.491+0000 7f3a74d99700 1 -- 172.21.15.72:0/150965076 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15171972 0 0) 0x7f3a70063a00 con 0x7f3a70153e30 2023-08-31T18:47:33.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.491+0000 7f3a74d99700 1 -- 172.21.15.72:0/150965076 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a5c0033f0 con 0x7f3a70153e30 2023-08-31T18:47:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.497+0000 7f3a74d99700 1 -- 172.21.15.72:0/150965076 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3613950260 0 0) 0x7f3a5c0033f0 con 0x7f3a70153e30 2023-08-31T18:47:33.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.497+0000 7f3a74d99700 1 -- 172.21.15.72:0/150965076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70154210 msgr2=0x7f3a700630b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-31T18:47:33.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.497+0000 7f3a74d99700 1 --2- 172.21.15.72:0/150965076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70154210 0x7f3a700630b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:33.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.497+0000 7f3a74d99700 1 -- 172.21.15.72:0/150965076 >> v2:172.21.15.146:3300/0 conn(0x7f3a700635a0 msgr2=0x7f3a700c0ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-31T18:47:33.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.497+0000 7f3a74d99700 1 --2- 172.21.15.72:0/150965076 >> v2:172.21.15.146:3300/0 conn(0x7f3a700635a0 0x7f3a700c0ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:33.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.497+0000 7f3a74d99700 1 -- 172.21.15.72:0/150965076 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a700c6730 con 0x7f3a70153e30 2023-08-31T18:47:33.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.497+0000 7f3a74d99700 1 -- 172.21.15.72:0/150965076 <== mon.1 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f3a6c001470 con 0x7f3a70153e30 2023-08-31T18:47:33.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.497+0000 7f3a74d99700 1 -- 172.21.15.72:0/150965076 >> v1:172.21.15.146:6789/0 conn(0x7f3a70153e30 legacy=0x7f3a700c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:33.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.497+0000 7f3a74d99700 1 --2- 172.21.15.72:0/150965076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a5c003960 0x7f3a5c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.497+0000 7f3a74d99700 1 --2- 172.21.15.72:0/150965076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70154210 0x7f3a5c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.497+0000 7f3a74d99700 1 --2- 172.21.15.72:0/150965076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5c004b80 0x7f3a5c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.497+0000 7f3a74d99700 1 -- 172.21.15.72:0/150965076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a70154690 con 0x7f3a5c004b80 2023-08-31T18:47:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.497+0000 7f3a74d99700 1 -- 172.21.15.72:0/150965076 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700bfd40 con 0x7f3a5c003960 2023-08-31T18:47:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.497+0000 7f3a74d99700 1 -- 172.21.15.72:0/150965076 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c00baa0 con 0x7f3a70154210 2023-08-31T18:47:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.498+0000 7f3a75d9b700 1 --2- 172.21.15.72:0/150965076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a5c003960 0x7f3a5c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.498+0000 7f3a7659c700 1 --2- 172.21.15.72:0/150965076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5c004b80 0x7f3a5c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.498+0000 7f3a7559a700 1 --2- 172.21.15.72:0/150965076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70154210 0x7f3a5c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.498+0000 7f3a7659c700 1 -- 172.21.15.72:0/150965076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70154210 msgr2=0x7f3a5c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.498+0000 7f3a7659c700 1 --2- 172.21.15.72:0/150965076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70154210 0x7f3a5c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.498+0000 7f3a7659c700 1 -- 172.21.15.72:0/150965076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a5c003960 msgr2=0x7f3a5c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.498+0000 7f3a7659c700 1 --2- 172.21.15.72:0/150965076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a5c003960 0x7f3a5c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:33.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.498+0000 7f3a7659c700 1 -- 172.21.15.72:0/150965076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c0033f0 con 0x7f3a5c004b80 2023-08-31T18:47:33.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.499+0000 7f3a7659c700 1 --2- 172.21.15.72:0/150965076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5c004b80 0x7f3a5c005000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3a68007440 tx=0x7f3a68009720).ready entity=mon.0 client_cookie=92b69304d604707b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.500+0000 7f3a74d99700 1 -- 172.21.15.72:0/150965076 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68009a30 con 0x7f3a5c004b80 2023-08-31T18:47:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.500+0000 7f3a74d99700 1 -- 172.21.15.72:0/150965076 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a68007cf0 con 0x7f3a5c004b80 2023-08-31T18:47:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.500+0000 7f3a74d99700 1 -- 172.21.15.72:0/150965076 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a68015620 con 0x7f3a5c004b80 2023-08-31T18:47:33.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.500+0000 7f3a77fff700 1 -- 172.21.15.72:0/150965076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5c004b80 msgr2=0x7f3a5c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:33.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.500+0000 7f3a77fff700 1 --2- 172.21.15.72:0/150965076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5c004b80 0x7f3a5c005000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3a68007440 tx=0x7f3a68009720).stop 2023-08-31T18:47:33.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.500+0000 7f3a7659c700 1 -- 172.21.15.72:0/150965076 reap_dead start 2023-08-31T18:47:33.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.500+0000 7f3a77fff700 1 -- 172.21.15.72:0/150965076 shutdown_connections 2023-08-31T18:47:33.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.500+0000 7f3a77fff700 1 -- 172.21.15.72:0/150965076 >> 172.21.15.72:0/150965076 conn(0x7f3a7005eb20 msgr2=0x7f3a700cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:33.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.501+0000 7f3a77fff700 1 -- 172.21.15.72:0/150965076 shutdown_connections 2023-08-31T18:47:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.501+0000 7f3a77fff700 1 -- 172.21.15.72:0/150965076 wait complete. 2023-08-31T18:47:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.502+0000 7f3a77fff700 1 Processor -- start 2023-08-31T18:47:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.502+0000 7f3a77fff700 1 -- start start 2023-08-31T18:47:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.503+0000 7f3a77fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5c004b80 0x7f3a700b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:33.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.503+0000 7f3a77fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a700c2370 0x7f3a700c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.503+0000 7f3a77fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70167740 0x7f3a70167bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.503+0000 7f3a77fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700c2ce0 con 0x7f3a5c004b80 2023-08-31T18:47:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.503+0000 7f3a77fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a701680b0 con 0x7f3a700c2370 2023-08-31T18:47:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.503+0000 7f3a77fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a70168500 con 0x7f3a70167740 2023-08-31T18:47:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.504+0000 7f3a7559a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a700c2370 0x7f3a700c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.504+0000 7f3a75d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5c004b80 0x7f3a700b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.504+0000 7f3a7559a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a700c2370 0x7f3a700c27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:40572/0 (socket says 172.21.15.72:40572) 2023-08-31T18:47:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.504+0000 7f3a7559a700 1 -- 172.21.15.72:0/671524940 learned_addr learned my addr 172.21.15.72:0/671524940 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.504+0000 7f3a7659c700 1 --2- 172.21.15.72:0/671524940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70167740 0x7f3a70167bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.504+0000 7f3a75d9b700 1 -- 172.21.15.72:0/671524940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70167740 msgr2=0x7f3a70167bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.504+0000 7f3a75d9b700 1 --2- 172.21.15.72:0/671524940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70167740 0x7f3a70167bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.504+0000 7f3a75d9b700 1 -- 172.21.15.72:0/671524940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a700c2370 msgr2=0x7f3a700c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.504+0000 7f3a75d9b700 1 --2- 172.21.15.72:0/671524940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a700c2370 0x7f3a700c27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.504+0000 7f3a75d9b700 1 -- 172.21.15.72:0/671524940 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a700c2ee0 con 0x7f3a5c004b80 2023-08-31T18:47:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.504+0000 7f3a75d9b700 1 --2- 172.21.15.72:0/671524940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5c004b80 0x7f3a700b0390 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f3a6c007720 tx=0x7f3a6c001dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.505+0000 7f3a65ffb700 1 -- 172.21.15.72:0/671524940 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c0114c0 con 0x7f3a5c004b80 2023-08-31T18:47:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.505+0000 7f3a65ffb700 1 -- 172.21.15.72:0/671524940 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c011620 con 0x7f3a5c004b80 2023-08-31T18:47:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.505+0000 7f3a65ffb700 1 -- 172.21.15.72:0/671524940 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c0119a0 con 0x7f3a5c004b80 2023-08-31T18:47:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.505+0000 7f3a77fff700 1 -- 172.21.15.72:0/671524940 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a700c31c0 con 0x7f3a5c004b80 2023-08-31T18:47:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.505+0000 7f3a77fff700 1 -- 172.21.15.72:0/671524940 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a700c3780 con 0x7f3a5c004b80 2023-08-31T18:47:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.505+0000 7f3a65ffb700 1 -- 172.21.15.72:0/671524940 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f3a6c01c360 con 0x7f3a5c004b80 2023-08-31T18:47:33.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.506+0000 7f3a65ffb700 1 -- 172.21.15.72:0/671524940 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f3a6c01c980 con 0x7f3a5c004b80 2023-08-31T18:47:33.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.506+0000 7f3a77fff700 1 -- 172.21.15.72:0/671524940 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a700c3dd0 con 0x7f3a5c004b80 2023-08-31T18:47:33.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.509+0000 7f3a65ffb700 1 -- 172.21.15.72:0/671524940 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f3a6c022060 con 0x7f3a5c004b80 2023-08-31T18:47:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.584+0000 7f3a77fff700 1 -- 172.21.15.72:0/671524940 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3a700bffe0 con 0x7f3a5c004b80 2023-08-31T18:47:33.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.587+0000 7f3a65ffb700 1 -- 172.21.15.72:0/671524940 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3a6c019070 con 0x7f3a5c004b80 2023-08-31T18:47:33.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.588+0000 7f3a77fff700 1 -- 172.21.15.72:0/671524940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5c004b80 msgr2=0x7f3a700b0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:33.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.588+0000 7f3a77fff700 1 --2- 172.21.15.72:0/671524940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5c004b80 0x7f3a700b0390 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f3a6c007720 tx=0x7f3a6c001dc0).stop 2023-08-31T18:47:33.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.589+0000 7f3a77fff700 1 -- 172.21.15.72:0/671524940 shutdown_connections 2023-08-31T18:47:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.589+0000 7f3a77fff700 1 --2- 172.21.15.72:0/671524940 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a70167740 0x7f3a70167bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.589+0000 7f3a77fff700 1 --2- 172.21.15.72:0/671524940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a5c004b80 0x7f3a700b0390 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.589+0000 7f3a77fff700 1 --2- 172.21.15.72:0/671524940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a700c2370 0x7f3a700c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.589+0000 7f3a77fff700 1 -- 172.21.15.72:0/671524940 >> 172.21.15.72:0/671524940 conn(0x7f3a7005eb20 msgr2=0x7f3a700c09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.589+0000 7f3a77fff700 1 -- 172.21.15.72:0/671524940 shutdown_connections 2023-08-31T18:47:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:33.589+0000 7f3a77fff700 1 -- 172.21.15.72:0/671524940 wait complete. 2023-08-31T18:47:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:adjusted tunables profile to default 2023-08-31T18:47:33.604 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-31T18:47:33.605 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:47:33.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-31T18:47:33.667 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:33.668+0000 7fda3690f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T18:47:33.674 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:47:33.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-31T18:47:33.679 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:33.679+0000 7fde7d226680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T18:47:33.762 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:33.763+0000 7fda3690f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T18:47:33.767 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:33.767+0000 7fde7d226680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T18:47:33.785 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:47:33.785 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-31T18:47:33.895 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-08-31T18:47:33.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-31T18:47:34.004 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:47:34.005 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-31T18:47:34.082 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:47:34.082 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-31T18:47:34.152 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:47:34.152 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-31T18:47:34.262 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-08-31T18:47:34.262 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-31T18:47:34.276 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:34.277+0000 7fda3690f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T18:47:34.285 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:34.285+0000 7fde7d226680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T18:47:34.356 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 4012ab96-960c-462d-8153-cf60cd005a55 0 2023-08-31T18:47:34.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.582+0000 7f35a67ff700 1 Processor -- start 2023-08-31T18:47:34.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.583+0000 7f35a67ff700 1 -- start start 2023-08-31T18:47:34.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.584+0000 7f35a67ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35a00637c0 0x7f35a015f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:34.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.584+0000 7f35a67ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a00bfd40 con 0x7f35a0154210 2023-08-31T18:47:34.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.584+0000 7f35a67ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a00c6730 con 0x7f35a0153e30 2023-08-31T18:47:34.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.584+0000 7f35a67ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a01546c0 con 0x7f35a00637c0 2023-08-31T18:47:34.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.584+0000 7f359ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f35a0153e30 0x7f35a00c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43026/0 (socket says 172.21.15.146:43026) 2023-08-31T18:47:34.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.584+0000 7f359ffff700 1 -- 172.21.15.146:0/702469329 learned_addr learned my addr 172.21.15.146:0/702469329 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-08-31T18:47:34.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.585+0000 7f35a4d9c700 1 --2- 172.21.15.146:0/702469329 >> v2:172.21.15.72:3300/0 conn(0x7f35a00637c0 0x7f35a015f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:34.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.585+0000 7f359effd700 1 -- 172.21.15.146:0/702469329 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440983875 0 0) 0x7f35a00c6730 con 0x7f35a0153e30 2023-08-31T18:47:34.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.585+0000 7f359effd700 1 -- 172.21.15.146:0/702469329 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35880033f0 con 0x7f35a0153e30 2023-08-31T18:47:34.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.585+0000 7f359effd700 1 -- 172.21.15.146:0/702469329 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033663402 0 0) 0x7f35a00bfd40 con 0x7f35a0154210 2023-08-31T18:47:34.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.585+0000 7f359effd700 1 -- 172.21.15.146:0/702469329 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35a00c6730 con 0x7f35a0154210 2023-08-31T18:47:34.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.585+0000 7f35a4d9c700 1 -- 172.21.15.146:0/702469329 >> v1:172.21.15.146:6789/0 conn(0x7f35a0153e30 legacy=0x7f35a00c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:34.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.585+0000 7f35a4d9c700 1 -- 172.21.15.146:0/702469329 >> v1:172.21.15.72:6789/0 conn(0x7f35a0154210 legacy=0x7f35a00630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:34.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.585+0000 7f35a4d9c700 1 -- 172.21.15.146:0/702469329 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00bffe0 con 0x7f35a00637c0 2023-08-31T18:47:34.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.585+0000 7f35a4d9c700 1 --2- 172.21.15.146:0/702469329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a00637c0 0x7f35a015f0b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f3598009e60 tx=0x7f3598009780).ready entity=mon.0 client_cookie=9f977646a350f4c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:34.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.585+0000 7f359effd700 1 -- 172.21.15.146:0/702469329 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800e070 con 0x7f35a00637c0 2023-08-31T18:47:34.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.586+0000 7f359effd700 1 -- 172.21.15.146:0/702469329 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359800bab0 con 0x7f35a00637c0 2023-08-31T18:47:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.586+0000 7f359effd700 1 -- 172.21.15.146:0/702469329 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800be30 con 0x7f35a00637c0 2023-08-31T18:47:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.586+0000 7f35a67ff700 1 -- 172.21.15.146:0/702469329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a00637c0 msgr2=0x7f35a015f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.586+0000 7f35a67ff700 1 --2- 172.21.15.146:0/702469329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a00637c0 0x7f35a015f0b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f3598009e60 tx=0x7f3598009780).stop 2023-08-31T18:47:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.586+0000 7f35a67ff700 1 -- 172.21.15.146:0/702469329 shutdown_connections 2023-08-31T18:47:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.586+0000 7f35a67ff700 1 --2- 172.21.15.146:0/702469329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a00637c0 0x7f35a015f0b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:34.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.586+0000 7f35a67ff700 1 -- 172.21.15.146:0/702469329 >> 172.21.15.146:0/702469329 conn(0x7f35a005eb20 msgr2=0x7f35a00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:34.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.586+0000 7f35a67ff700 1 -- 172.21.15.146:0/702469329 shutdown_connections 2023-08-31T18:47:34.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.586+0000 7f35a67ff700 1 -- 172.21.15.146:0/702469329 wait complete. 2023-08-31T18:47:34.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.588+0000 7f35a67ff700 1 Processor -- start 2023-08-31T18:47:34.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.588+0000 7f35a67ff700 1 -- start start 2023-08-31T18:47:34.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.589+0000 7f35a67ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a00637c0 0x7f35a0153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:34.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.589+0000 7f35a67ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a0153e30 0x7f35a014ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:34.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.589+0000 7f35a67ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35a0154210 0x7f35a0159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:34.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.589+0000 7f35a67ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0150340 con 0x7f35a0153e30 2023-08-31T18:47:34.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.589+0000 7f35a67ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0159ab0 con 0x7f35a00637c0 2023-08-31T18:47:34.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.589+0000 7f35a67ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0150590 con 0x7f35a0154210 2023-08-31T18:47:34.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.589+0000 7f359ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a00637c0 0x7f35a0153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.589+0000 7f359ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a00637c0 0x7f35a0153360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49168/0 (socket says 172.21.15.146:49168) 2023-08-31T18:47:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.589+0000 7f359ffff700 1 -- 172.21.15.146:0/820202481 learned_addr learned my addr 172.21.15.146:0/820202481 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-08-31T18:47:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.589+0000 7f35a4d9c700 1 --2- 172.21.15.146:0/820202481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35a0154210 0x7f35a0159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.589+0000 7f359f7fe700 1 --2- 172.21.15.146:0/820202481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a0153e30 0x7f35a014ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:34.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.589+0000 7f359ffff700 1 -- 172.21.15.146:0/820202481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35a0154210 msgr2=0x7f35a0159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:34.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.589+0000 7f359ffff700 1 --2- 172.21.15.146:0/820202481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35a0154210 0x7f35a0159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:34.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.589+0000 7f359ffff700 1 -- 172.21.15.146:0/820202481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a0153e30 msgr2=0x7f35a014ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:34.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.590+0000 7f359ffff700 1 --2- 172.21.15.146:0/820202481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a0153e30 0x7f35a014ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:34.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.590+0000 7f359ffff700 1 -- 172.21.15.146:0/820202481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598009a20 con 0x7f35a00637c0 2023-08-31T18:47:34.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.590+0000 7f359ffff700 1 --2- 172.21.15.146:0/820202481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a00637c0 0x7f35a0153360 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f359000c560 tx=0x7f3590007d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:34.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.590+0000 7f3587fff700 1 -- 172.21.15.146:0/820202481 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359000ce70 con 0x7f35a00637c0 2023-08-31T18:47:34.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.590+0000 7f3587fff700 1 -- 172.21.15.146:0/820202481 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35900072e0 con 0x7f35a00637c0 2023-08-31T18:47:34.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.590+0000 7f3587fff700 1 -- 172.21.15.146:0/820202481 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590007660 con 0x7f35a00637c0 2023-08-31T18:47:34.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.590+0000 7f35a67ff700 1 -- 172.21.15.146:0/820202481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a0150870 con 0x7f35a00637c0 2023-08-31T18:47:34.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.590+0000 7f35a67ff700 1 -- 172.21.15.146:0/820202481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a014cef0 con 0x7f35a00637c0 2023-08-31T18:47:34.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.590+0000 7f3587fff700 1 -- 172.21.15.146:0/820202481 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f3590005c10 con 0x7f35a00637c0 2023-08-31T18:47:34.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.590+0000 7f3587fff700 1 -- 172.21.15.146:0/820202481 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f3590013d40 con 0x7f35a00637c0 2023-08-31T18:47:34.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.591+0000 7f35a67ff700 1 -- 172.21.15.146:0/820202481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a0150d90 con 0x7f35a00637c0 2023-08-31T18:47:34.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.594+0000 7f3587fff700 1 -- 172.21.15.146:0/820202481 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f35a0150d90 con 0x7f35a00637c0 2023-08-31T18:47:34.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.676+0000 7f35a67ff700 1 -- 172.21.15.146:0/820202481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4012ab96-960c-462d-8153-cf60cd005a55", "id": 0} v 0) v1 -- 0x7f35a00c02c0 con 0x7f35a00637c0 2023-08-31T18:47:34.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.684+0000 7f3587fff700 1 -- 172.21.15.146:0/820202481 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4012ab96-960c-462d-8153-cf60cd005a55", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3590018020 con 0x7f35a00637c0 2023-08-31T18:47:34.685 INFO:teuthology.orchestra.run.smithi146.stdout:0 2023-08-31T18:47:34.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.686+0000 7f35a67ff700 1 -- 172.21.15.146:0/820202481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a00637c0 msgr2=0x7f35a0153360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:34.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.686+0000 7f35a67ff700 1 --2- 172.21.15.146:0/820202481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a00637c0 0x7f35a0153360 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f359000c560 tx=0x7f3590007d20).stop 2023-08-31T18:47:34.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.686+0000 7f35a67ff700 1 -- 172.21.15.146:0/820202481 shutdown_connections 2023-08-31T18:47:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.686+0000 7f35a67ff700 1 --2- 172.21.15.146:0/820202481 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35a0154210 0x7f35a0159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.686+0000 7f35a67ff700 1 --2- 172.21.15.146:0/820202481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a00637c0 0x7f35a0153360 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.686+0000 7f35a67ff700 1 --2- 172.21.15.146:0/820202481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a0153e30 0x7f35a014ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.686+0000 7f35a67ff700 1 -- 172.21.15.146:0/820202481 >> 172.21.15.146:0/820202481 conn(0x7f35a005eb20 msgr2=0x7f35a00c16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.686+0000 7f35a67ff700 1 -- 172.21.15.146:0/820202481 shutdown_connections 2023-08-31T18:47:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.686+0000 7f35a67ff700 1 -- 172.21.15.146:0/820202481 wait complete. 2023-08-31T18:47:34.702 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 74e4e488-1a88-4f4f-9b83-0c3ea61475d1 1 2023-08-31T18:47:34.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.886+0000 7fa3a5fff700 1 Processor -- start 2023-08-31T18:47:34.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.886+0000 7fa3a5fff700 1 -- start start 2023-08-31T18:47:34.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.887+0000 7fa3a5fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa3a0154030 0x7fa3a0154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:34.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.887+0000 7fa3a5fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a00c06b0 0x7fa3a00c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:34.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.887+0000 7fa3a5fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a00c6ed0 con 0x7fa3a00aa140 2023-08-31T18:47:34.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.887+0000 7fa3a5fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a00c66e0 con 0x7fa3a0154030 2023-08-31T18:47:34.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.887+0000 7fa3a5fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00c68c0 con 0x7fa3a00c06b0 2023-08-31T18:47:34.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.887+0000 7fa39effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a00c06b0 0x7fa3a00c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:34.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.887+0000 7fa39effd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a00c06b0 0x7fa3a00c7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46330/0 (socket says 172.21.15.146:46330) 2023-08-31T18:47:34.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.888+0000 7fa39effd700 1 -- 172.21.15.146:0/1592454627 learned_addr learned my addr 172.21.15.146:0/1592454627 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-08-31T18:47:34.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.888+0000 7fa39f7fe700 1 --2- 172.21.15.146:0/1592454627 >> v2:172.21.15.72:3300/0 conn(0x7fa3a0154030 0x7fa3a0154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:34.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.888+0000 7fa39effd700 1 -- 172.21.15.146:0/1592454627 >> v2:172.21.15.72:3300/0 conn(0x7fa3a0154030 msgr2=0x7fa3a0154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:34.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.888+0000 7fa39effd700 1 --2- 172.21.15.146:0/1592454627 >> v2:172.21.15.72:3300/0 conn(0x7fa3a0154030 0x7fa3a0154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:34.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.888+0000 7fa39effd700 1 -- 172.21.15.146:0/1592454627 >> v1:172.21.15.72:6789/0 conn(0x7fa3a00aa140 legacy=0x7fa3a0063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:34.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.888+0000 7fa39e7fc700 1 -- 172.21.15.146:0/1592454627 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404700713 0 0) 0x7fa3a00c6ed0 con 0x7fa3a00aa140 2023-08-31T18:47:34.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.888+0000 7fa39effd700 1 -- 172.21.15.146:0/1592454627 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a00c0f30 con 0x7fa3a00c06b0 2023-08-31T18:47:34.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.888+0000 7fa39effd700 1 --2- 172.21.15.146:0/1592454627 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a00c06b0 0x7fa3a00c7360 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fa394006fd0 tx=0x7fa3940090f0).ready entity=mon.2 client_cookie=78653a479a1732e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.888+0000 7fa39e7fc700 1 -- 172.21.15.146:0/1592454627 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39400b580 con 0x7fa3a00c06b0 2023-08-31T18:47:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.888+0000 7fa39e7fc700 1 -- 172.21.15.146:0/1592454627 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39400b6e0 con 0x7fa3a00c06b0 2023-08-31T18:47:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.888+0000 7fa39e7fc700 1 -- 172.21.15.146:0/1592454627 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39400ba60 con 0x7fa3a00c06b0 2023-08-31T18:47:34.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.889+0000 7fa3a5fff700 1 -- 172.21.15.146:0/1592454627 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a00c06b0 msgr2=0x7fa3a00c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:34.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.889+0000 7fa3a5fff700 1 --2- 172.21.15.146:0/1592454627 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a00c06b0 0x7fa3a00c7360 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fa394006fd0 tx=0x7fa3940090f0).stop 2023-08-31T18:47:34.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.889+0000 7fa3a5fff700 1 -- 172.21.15.146:0/1592454627 shutdown_connections 2023-08-31T18:47:34.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.889+0000 7fa3a5fff700 1 --2- 172.21.15.146:0/1592454627 >> v2:172.21.15.72:3300/0 conn(0x7fa3a0154030 0x7fa3a0154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:34.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.889+0000 7fa3a5fff700 1 --2- 172.21.15.146:0/1592454627 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a00c06b0 0x7fa3a00c7360 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:34.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.889+0000 7fa3a5fff700 1 -- 172.21.15.146:0/1592454627 >> 172.21.15.146:0/1592454627 conn(0x7fa3a005eb60 msgr2=0x7fa3a00cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:34.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.889+0000 7fa3a5fff700 1 -- 172.21.15.146:0/1592454627 shutdown_connections 2023-08-31T18:47:34.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.889+0000 7fa3a5fff700 1 -- 172.21.15.146:0/1592454627 wait complete. 2023-08-31T18:47:34.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.891+0000 7fa3a5fff700 1 Processor -- start 2023-08-31T18:47:34.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.891+0000 7fa3a5fff700 1 -- start start 2023-08-31T18:47:34.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.892+0000 7fa3a5fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a00aa140 0x7fa3a014e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:34.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.892+0000 7fa3a5fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a00c06b0 0x7fa3a0151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:34.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.892+0000 7fa3a5fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3a0154030 0x7fa3a0151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:34.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.892+0000 7fa3a5fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a0152210 con 0x7fa3a0154030 2023-08-31T18:47:34.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.892+0000 7fa3a5fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00aeb10 con 0x7fa3a00c06b0 2023-08-31T18:47:34.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.892+0000 7fa3a5fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00adf00 con 0x7fa3a00aa140 2023-08-31T18:47:34.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.892+0000 7fa39f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a00aa140 0x7fa3a014e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:34.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.892+0000 7fa39effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a00c06b0 0x7fa3a0151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:34.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.892+0000 7fa39f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a00aa140 0x7fa3a014e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46344/0 (socket says 172.21.15.146:46344) 2023-08-31T18:47:34.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.892+0000 7fa39effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a00c06b0 0x7fa3a0151830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49170/0 (socket says 172.21.15.146:49170) 2023-08-31T18:47:34.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.892+0000 7fa39f7fe700 1 -- 172.21.15.146:0/1573492780 learned_addr learned my addr 172.21.15.146:0/1573492780 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-08-31T18:47:34.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.892+0000 7fa39ffff700 1 --2- 172.21.15.146:0/1573492780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3a0154030 0x7fa3a0151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:34.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.893+0000 7fa39effd700 1 -- 172.21.15.146:0/1573492780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a00aa140 msgr2=0x7fa3a014e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:34.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.893+0000 7fa39effd700 1 --2- 172.21.15.146:0/1573492780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a00aa140 0x7fa3a014e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:34.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.893+0000 7fa39effd700 1 -- 172.21.15.146:0/1573492780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3a0154030 msgr2=0x7fa3a0151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:34.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.893+0000 7fa39effd700 1 --2- 172.21.15.146:0/1573492780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3a0154030 0x7fa3a0151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:34.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.893+0000 7fa39effd700 1 -- 172.21.15.146:0/1573492780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa394009370 con 0x7fa3a00c06b0 2023-08-31T18:47:34.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.893+0000 7fa39f7fe700 1 --2- 172.21.15.146:0/1573492780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a00aa140 0x7fa3a014e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:47:34.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.893+0000 7fa39effd700 1 --2- 172.21.15.146:0/1573492780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a00c06b0 0x7fa3a0151830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fa394014000 tx=0x7fa394017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:34.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.893+0000 7fa3877fe700 1 -- 172.21.15.146:0/1573492780 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394000bc0 con 0x7fa3a00c06b0 2023-08-31T18:47:34.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.893+0000 7fa3877fe700 1 -- 172.21.15.146:0/1573492780 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39400b850 con 0x7fa3a00c06b0 2023-08-31T18:47:34.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.893+0000 7fa3a5fff700 1 -- 172.21.15.146:0/1573492780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a00ae1e0 con 0x7fa3a00c06b0 2023-08-31T18:47:34.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.893+0000 7fa3877fe700 1 -- 172.21.15.146:0/1573492780 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39401c670 con 0x7fa3a00c06b0 2023-08-31T18:47:34.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.893+0000 7fa3a5fff700 1 -- 172.21.15.146:0/1573492780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a00ae7a0 con 0x7fa3a00c06b0 2023-08-31T18:47:34.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.893+0000 7fa3877fe700 1 -- 172.21.15.146:0/1573492780 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fa39401cd00 con 0x7fa3a00c06b0 2023-08-31T18:47:34.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.893+0000 7fa3877fe700 1 -- 172.21.15.146:0/1573492780 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fa394025490 con 0x7fa3a00c06b0 2023-08-31T18:47:34.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.894+0000 7fa3a5fff700 1 -- 172.21.15.146:0/1573492780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a006c6b0 con 0x7fa3a00c06b0 2023-08-31T18:47:34.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.897+0000 7fa3877fe700 1 -- 172.21.15.146:0/1573492780 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa394044e50 con 0x7fa3a00c06b0 2023-08-31T18:47:34.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.978+0000 7fa3a5fff700 1 -- 172.21.15.146:0/1573492780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "74e4e488-1a88-4f4f-9b83-0c3ea61475d1", "id": 1} v 0) v1 -- 0x7fa3a006aac0 con 0x7fa3a00c06b0 2023-08-31T18:47:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.986+0000 7fa3877fe700 1 -- 172.21.15.146:0/1573492780 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "74e4e488-1a88-4f4f-9b83-0c3ea61475d1", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa394033070 con 0x7fa3a00c06b0 2023-08-31T18:47:34.986 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-08-31T18:47:34.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.988+0000 7fa3a5fff700 1 -- 172.21.15.146:0/1573492780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a00c06b0 msgr2=0x7fa3a0151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.988+0000 7fa3a5fff700 1 --2- 172.21.15.146:0/1573492780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a00c06b0 0x7fa3a0151830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fa394014000 tx=0x7fa394017000).stop 2023-08-31T18:47:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.988+0000 7fa3a5fff700 1 -- 172.21.15.146:0/1573492780 shutdown_connections 2023-08-31T18:47:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.988+0000 7fa3a5fff700 1 --2- 172.21.15.146:0/1573492780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3a0154030 0x7fa3a0151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.988+0000 7fa3a5fff700 1 --2- 172.21.15.146:0/1573492780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa3a00aa140 0x7fa3a014e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.988+0000 7fa3a5fff700 1 --2- 172.21.15.146:0/1573492780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3a00c06b0 0x7fa3a0151830 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:34.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.988+0000 7fa3a5fff700 1 -- 172.21.15.146:0/1573492780 >> 172.21.15.146:0/1573492780 conn(0x7fa3a005eb60 msgr2=0x7fa3a01532b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:34.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.988+0000 7fa3a5fff700 1 -- 172.21.15.146:0/1573492780 shutdown_connections 2023-08-31T18:47:34.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:34.988+0000 7fa3a5fff700 1 -- 172.21.15.146:0/1573492780 wait complete. 2023-08-31T18:47:35.012 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new bb0b0fb5-f185-4015-a8f6-240575cc8200 2 2023-08-31T18:47:35.158 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:35.156+0000 7fda3690f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T18:47:35.197 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:35.197+0000 7fde7d226680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T18:47:35.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.229+0000 7f2b5ffff700 1 Processor -- start 2023-08-31T18:47:35.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.229+0000 7f2b5ffff700 1 -- start start 2023-08-31T18:47:35.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.231+0000 7f2b5ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b58154410 0x7f2b580c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:35.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.231+0000 7f2b5ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b580c7360 0x7f2b58063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:35.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.231+0000 7f2b5ffff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b580c6ed0 con 0x7f2b58154030 2023-08-31T18:47:35.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.231+0000 7f2b5ffff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b580c66e0 con 0x7f2b58154410 2023-08-31T18:47:35.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.231+0000 7f2b5ffff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b580c68c0 con 0x7f2b580c7360 2023-08-31T18:47:35.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.231+0000 7f2b5d59a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b58154410 0x7f2b580c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:35.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.231+0000 7f2b5e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b580c7360 0x7f2b58063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:35.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.231+0000 7f2b5d59a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b58154410 0x7f2b580c06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49182/0 (socket says 172.21.15.146:49182) 2023-08-31T18:47:35.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.231+0000 7f2b5d59a700 1 -- 172.21.15.146:0/2953675485 learned_addr learned my addr 172.21.15.146:0/2953675485 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-08-31T18:47:35.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.232+0000 7f2b5d59a700 1 -- 172.21.15.146:0/2953675485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b580c7360 msgr2=0x7f2b58063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:35.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.232+0000 7f2b5d59a700 1 --2- 172.21.15.146:0/2953675485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b580c7360 0x7f2b58063120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.232+0000 7f2b5d59a700 1 -- 172.21.15.146:0/2953675485 >> v1:172.21.15.72:6789/0 conn(0x7f2b58154030 legacy=0x7f2b580aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:35.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.232+0000 7f2b5d59a700 1 -- 172.21.15.146:0/2953675485 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b580c0f30 con 0x7f2b58154410 2023-08-31T18:47:35.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.232+0000 7f2b5cd99700 1 -- 172.21.15.146:0/2953675485 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293909987 0 0) 0x7f2b580c6ed0 con 0x7f2b58154030 2023-08-31T18:47:35.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.232+0000 7f2b5e59c700 1 --2- 172.21.15.146:0/2953675485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b580c7360 0x7f2b58063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:47:35.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.232+0000 7f2b5d59a700 1 --2- 172.21.15.146:0/2953675485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b58154410 0x7f2b580c06b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f2b48006fd0 tx=0x7f2b480090f0).ready entity=mon.1 client_cookie=522fe11b42097f5a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:35.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.232+0000 7f2b5cd99700 1 -- 172.21.15.146:0/2953675485 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800b580 con 0x7f2b58154410 2023-08-31T18:47:35.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.232+0000 7f2b5cd99700 1 -- 172.21.15.146:0/2953675485 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4800b6e0 con 0x7f2b58154410 2023-08-31T18:47:35.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.232+0000 7f2b5cd99700 1 -- 172.21.15.146:0/2953675485 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800ba60 con 0x7f2b58154410 2023-08-31T18:47:35.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.233+0000 7f2b5ffff700 1 -- 172.21.15.146:0/2953675485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b58154410 msgr2=0x7f2b580c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:35.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.233+0000 7f2b5ffff700 1 --2- 172.21.15.146:0/2953675485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b58154410 0x7f2b580c06b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f2b48006fd0 tx=0x7f2b480090f0).stop 2023-08-31T18:47:35.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.233+0000 7f2b5ffff700 1 -- 172.21.15.146:0/2953675485 shutdown_connections 2023-08-31T18:47:35.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.233+0000 7f2b5ffff700 1 --2- 172.21.15.146:0/2953675485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b580c7360 0x7f2b58063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.233+0000 7f2b5ffff700 1 --2- 172.21.15.146:0/2953675485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b58154410 0x7f2b580c06b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.233+0000 7f2b5ffff700 1 -- 172.21.15.146:0/2953675485 >> 172.21.15.146:0/2953675485 conn(0x7f2b5805eb60 msgr2=0x7f2b580cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:35.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.233+0000 7f2b5ffff700 1 -- 172.21.15.146:0/2953675485 shutdown_connections 2023-08-31T18:47:35.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.233+0000 7f2b5ffff700 1 -- 172.21.15.146:0/2953675485 wait complete. 2023-08-31T18:47:35.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.235+0000 7f2b5ffff700 1 Processor -- start 2023-08-31T18:47:35.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.235+0000 7f2b5ffff700 1 -- start start 2023-08-31T18:47:35.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.236+0000 7f2b5ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b580c7360 0x7f2b581640f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:35.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.236+0000 7f2b5ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b58154030 0x7f2b5814e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:35.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.236+0000 7f2b5ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b58154410 0x7f2b580c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:35.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.236+0000 7f2b5ffff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b580c3540 con 0x7f2b58154410 2023-08-31T18:47:35.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.236+0000 7f2b5ffff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5814e720 con 0x7f2b580c7360 2023-08-31T18:47:35.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.236+0000 7f2b5ffff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b580c3260 con 0x7f2b58154030 2023-08-31T18:47:35.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.237+0000 7f2b5d59a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b58154030 0x7f2b5814e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:35.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.237+0000 7f2b5dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b580c7360 0x7f2b581640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:35.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.237+0000 7f2b5d59a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b58154030 0x7f2b5814e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46362/0 (socket says 172.21.15.146:46362) 2023-08-31T18:47:35.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.237+0000 7f2b5d59a700 1 -- 172.21.15.146:0/459043491 learned_addr learned my addr 172.21.15.146:0/459043491 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-08-31T18:47:35.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.237+0000 7f2b5e59c700 1 --2- 172.21.15.146:0/459043491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b58154410 0x7f2b580c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:35.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.237+0000 7f2b5d59a700 1 -- 172.21.15.146:0/459043491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b580c7360 msgr2=0x7f2b581640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:35.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.237+0000 7f2b5d59a700 1 --2- 172.21.15.146:0/459043491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b580c7360 0x7f2b581640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.237+0000 7f2b5d59a700 1 -- 172.21.15.146:0/459043491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b58154410 msgr2=0x7f2b580c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:35.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.237+0000 7f2b5d59a700 1 --2- 172.21.15.146:0/459043491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b58154410 0x7f2b580c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.237+0000 7f2b5d59a700 1 -- 172.21.15.146:0/459043491 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b50009a20 con 0x7f2b58154030 2023-08-31T18:47:35.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.237+0000 7f2b5d59a700 1 --2- 172.21.15.146:0/459043491 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b58154030 0x7f2b5814e230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2b48009130 tx=0x7f2b48017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:35.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.238+0000 7f2b4dffb700 1 -- 172.21.15.146:0/459043491 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800b850 con 0x7f2b58154030 2023-08-31T18:47:35.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.238+0000 7f2b4dffb700 1 -- 172.21.15.146:0/459043491 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4800b9b0 con 0x7f2b58154030 2023-08-31T18:47:35.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.238+0000 7f2b5ffff700 1 -- 172.21.15.146:0/459043491 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b48009370 con 0x7f2b58154030 2023-08-31T18:47:35.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.238+0000 7f2b4dffb700 1 -- 172.21.15.146:0/459043491 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4801c670 con 0x7f2b58154030 2023-08-31T18:47:35.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.238+0000 7f2b5ffff700 1 -- 172.21.15.146:0/459043491 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b580ae200 con 0x7f2b58154030 2023-08-31T18:47:35.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.238+0000 7f2b4dffb700 1 -- 172.21.15.146:0/459043491 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f2b4801cc80 con 0x7f2b58154030 2023-08-31T18:47:35.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.238+0000 7f2b4dffb700 1 -- 172.21.15.146:0/459043491 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f2b48025a90 con 0x7f2b58154030 2023-08-31T18:47:35.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.239+0000 7f2b5ffff700 1 -- 172.21.15.146:0/459043491 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b580add80 con 0x7f2b58154030 2023-08-31T18:47:35.248 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:35.241+0000 7fda3690f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T18:47:35.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.244+0000 7f2b4dffb700 1 -- 172.21.15.146:0/459043491 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f2b580add80 con 0x7f2b58154030 2023-08-31T18:47:35.288 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:35.288+0000 7fde7d226680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T18:47:35.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.327+0000 7f2b5ffff700 1 -- 172.21.15.146:0/459043491 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bb0b0fb5-f185-4015-a8f6-240575cc8200", "id": 2} v 0) v1 -- 0x7f2b580c0c50 con 0x7f2b58154030 2023-08-31T18:47:35.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.335+0000 7f2b4dffb700 1 -- 172.21.15.146:0/459043491 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bb0b0fb5-f185-4015-a8f6-240575cc8200", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2b48020030 con 0x7f2b58154030 2023-08-31T18:47:35.336 INFO:teuthology.orchestra.run.smithi146.stdout:2 2023-08-31T18:47:35.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.336+0000 7f2b5ffff700 1 -- 172.21.15.146:0/459043491 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b58154030 msgr2=0x7f2b5814e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:35.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.336+0000 7f2b5ffff700 1 --2- 172.21.15.146:0/459043491 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b58154030 0x7f2b5814e230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f2b48009130 tx=0x7f2b48017000).stop 2023-08-31T18:47:35.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.337+0000 7f2b5ffff700 1 -- 172.21.15.146:0/459043491 shutdown_connections 2023-08-31T18:47:35.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.337+0000 7f2b5ffff700 1 --2- 172.21.15.146:0/459043491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b58154410 0x7f2b580c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.337+0000 7f2b5ffff700 1 --2- 172.21.15.146:0/459043491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b580c7360 0x7f2b581640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.337+0000 7f2b5ffff700 1 --2- 172.21.15.146:0/459043491 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b58154030 0x7f2b5814e230 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.337+0000 7f2b5ffff700 1 -- 172.21.15.146:0/459043491 >> 172.21.15.146:0/459043491 conn(0x7f2b5805eb60 msgr2=0x7f2b58151990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:35.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.337+0000 7f2b5ffff700 1 -- 172.21.15.146:0/459043491 shutdown_connections 2023-08-31T18:47:35.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.337+0000 7f2b5ffff700 1 -- 172.21.15.146:0/459043491 wait complete. 2023-08-31T18:47:35.353 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 4dc9e815-0401-4f87-8fe9-f72ba6cff7a9 3 2023-08-31T18:47:35.471 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:35.470+0000 7fda3690f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T18:47:35.535 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:35.535+0000 7fde7d226680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T18:47:35.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.541+0000 7f48bd1ff700 1 Processor -- start 2023-08-31T18:47:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.542+0000 7f48bd1ff700 1 -- start start 2023-08-31T18:47:35.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.544+0000 7f48bd1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f48b8154210 0x7f48b80630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:35.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.544+0000 7f48bd1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48b80635a0 0x7f48b80c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:35.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.544+0000 7f48bd1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b8063a00 con 0x7f48b8153e30 2023-08-31T18:47:35.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.544+0000 7f48bd1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b81546c0 con 0x7f48b8154210 2023-08-31T18:47:35.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.544+0000 7f48bd1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b80bfd40 con 0x7f48b80635a0 2023-08-31T18:47:35.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.544+0000 7f48b6d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f48b8153e30 0x7f48b80c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.146:56850/0 (socket says 172.21.15.146:56850) 2023-08-31T18:47:35.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.544+0000 7f48b6d9d700 1 -- 172.21.15.146:0/730461892 learned_addr learned my addr 172.21.15.146:0/730461892 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-08-31T18:47:35.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.544+0000 7f48b759e700 1 --2- 172.21.15.146:0/730461892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48b80635a0 0x7f48b80c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:35.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.544+0000 7f48b659c700 1 --2- 172.21.15.146:0/730461892 >> v2:172.21.15.72:3300/0 conn(0x7f48b8154210 0x7f48b80630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:35.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.545+0000 7f48b5d9b700 1 -- 172.21.15.146:0/730461892 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132882237 0 0) 0x7f48b8063a00 con 0x7f48b8153e30 2023-08-31T18:47:35.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.545+0000 7f48b5d9b700 1 -- 172.21.15.146:0/730461892 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a00033f0 con 0x7f48b8153e30 2023-08-31T18:47:35.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.545+0000 7f48b759e700 1 -- 172.21.15.146:0/730461892 >> v2:172.21.15.72:3300/0 conn(0x7f48b8154210 msgr2=0x7f48b80630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:35.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.545+0000 7f48b759e700 1 --2- 172.21.15.146:0/730461892 >> v2:172.21.15.72:3300/0 conn(0x7f48b8154210 0x7f48b80630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.545+0000 7f48b759e700 1 -- 172.21.15.146:0/730461892 >> v1:172.21.15.72:6789/0 conn(0x7f48b8153e30 legacy=0x7f48b80c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:35.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.545+0000 7f48b759e700 1 -- 172.21.15.146:0/730461892 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b80c6730 con 0x7f48b80635a0 2023-08-31T18:47:35.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.545+0000 7f48b659c700 1 --2- 172.21.15.146:0/730461892 >> v2:172.21.15.72:3300/0 conn(0x7f48b8154210 0x7f48b80630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:47:35.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.545+0000 7f48b759e700 1 --2- 172.21.15.146:0/730461892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48b80635a0 0x7f48b80c0ac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f48b0009e60 tx=0x7f48b0009780).ready entity=mon.2 client_cookie=909be3679270124b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:35.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.545+0000 7f48b5d9b700 1 -- 172.21.15.146:0/730461892 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b000e070 con 0x7f48b80635a0 2023-08-31T18:47:35.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.545+0000 7f48b5d9b700 1 -- 172.21.15.146:0/730461892 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b000bab0 con 0x7f48b80635a0 2023-08-31T18:47:35.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.545+0000 7f48b5d9b700 1 -- 172.21.15.146:0/730461892 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b000be30 con 0x7f48b80635a0 2023-08-31T18:47:35.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.546+0000 7f48bd1ff700 1 -- 172.21.15.146:0/730461892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48b80635a0 msgr2=0x7f48b80c0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:35.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.546+0000 7f48bd1ff700 1 --2- 172.21.15.146:0/730461892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48b80635a0 0x7f48b80c0ac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f48b0009e60 tx=0x7f48b0009780).stop 2023-08-31T18:47:35.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.546+0000 7f48bd1ff700 1 -- 172.21.15.146:0/730461892 shutdown_connections 2023-08-31T18:47:35.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.546+0000 7f48bd1ff700 1 --2- 172.21.15.146:0/730461892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48b80635a0 0x7f48b80c0ac0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.546+0000 7f48bd1ff700 1 --2- 172.21.15.146:0/730461892 >> v2:172.21.15.72:3300/0 conn(0x7f48b8154210 0x7f48b80630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.546+0000 7f48bd1ff700 1 -- 172.21.15.146:0/730461892 >> 172.21.15.146:0/730461892 conn(0x7f48b805eb20 msgr2=0x7f48b80cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:35.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.546+0000 7f48bd1ff700 1 -- 172.21.15.146:0/730461892 shutdown_connections 2023-08-31T18:47:35.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.546+0000 7f48bd1ff700 1 -- 172.21.15.146:0/730461892 wait complete. 2023-08-31T18:47:35.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.548+0000 7f48bd1ff700 1 Processor -- start 2023-08-31T18:47:35.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.548+0000 7f48bd1ff700 1 -- start start 2023-08-31T18:47:35.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48bd1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48b80635a0 0x7f48b814f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:35.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48bd1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48b8153e30 0x7f48b8159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:35.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48bd1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b8154210 0x7f48b8152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:35.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48bd1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8150ba0 con 0x7f48b80635a0 2023-08-31T18:47:35.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48bd1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b814ff90 con 0x7f48b8154210 2023-08-31T18:47:35.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48bd1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b8150270 con 0x7f48b8153e30 2023-08-31T18:47:35.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48b6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48b80635a0 0x7f48b814f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:35.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48b659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48b8153e30 0x7f48b8159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:35.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48b659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48b8153e30 0x7f48b8159140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46370/0 (socket says 172.21.15.146:46370) 2023-08-31T18:47:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48b6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48b80635a0 0x7f48b814f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.146:43190/0 (socket says 172.21.15.146:43190) 2023-08-31T18:47:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48b659c700 1 -- 172.21.15.146:0/3746592156 learned_addr learned my addr 172.21.15.146:0/3746592156 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-08-31T18:47:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48b759e700 1 --2- 172.21.15.146:0/3746592156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b8154210 0x7f48b8152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:35.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48b659c700 1 -- 172.21.15.146:0/3746592156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b8154210 msgr2=0x7f48b8152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:35.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48b659c700 1 --2- 172.21.15.146:0/3746592156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b8154210 0x7f48b8152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48b659c700 1 -- 172.21.15.146:0/3746592156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48b80635a0 msgr2=0x7f48b814f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:35.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48b659c700 1 --2- 172.21.15.146:0/3746592156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48b80635a0 0x7f48b814f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48b659c700 1 -- 172.21.15.146:0/3746592156 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac0092a0 con 0x7f48b8153e30 2023-08-31T18:47:35.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.550+0000 7f48b759e700 1 --2- 172.21.15.146:0/3746592156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b8154210 0x7f48b8152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:47:35.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.551+0000 7f48b659c700 1 --2- 172.21.15.146:0/3746592156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48b8153e30 0x7f48b8159140 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f48ac00e980 tx=0x7f48ac009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:35.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.551+0000 7f489effd700 1 -- 172.21.15.146:0/3746592156 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00c6a0 con 0x7f48b8153e30 2023-08-31T18:47:35.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.551+0000 7f489effd700 1 -- 172.21.15.146:0/3746592156 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac00c800 con 0x7f48b8153e30 2023-08-31T18:47:35.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.551+0000 7f489effd700 1 -- 172.21.15.146:0/3746592156 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac00cb80 con 0x7f48b8153e30 2023-08-31T18:47:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.551+0000 7f48bd1ff700 1 -- 172.21.15.146:0/3746592156 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b0009a20 con 0x7f48b8153e30 2023-08-31T18:47:35.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.551+0000 7f48bd1ff700 1 -- 172.21.15.146:0/3746592156 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b8150830 con 0x7f48b8153e30 2023-08-31T18:47:35.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.551+0000 7f489effd700 1 -- 172.21.15.146:0/3746592156 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f48ac01b660 con 0x7f48b8153e30 2023-08-31T18:47:35.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.551+0000 7f489effd700 1 -- 172.21.15.146:0/3746592156 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f48ac0123f0 con 0x7f48b8153e30 2023-08-31T18:47:35.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.552+0000 7f48bd1ff700 1 -- 172.21.15.146:0/3746592156 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b8150d10 con 0x7f48b8153e30 2023-08-31T18:47:35.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.555+0000 7f489effd700 1 -- 172.21.15.146:0/3746592156 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f48ac03ae50 con 0x7f48b8153e30 2023-08-31T18:47:35.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.638+0000 7f48bd1ff700 1 -- 172.21.15.146:0/3746592156 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4dc9e815-0401-4f87-8fe9-f72ba6cff7a9", "id": 3} v 0) v1 -- 0x7f48b806c6b0 con 0x7f48b8153e30 2023-08-31T18:47:35.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.644+0000 7f489effd700 1 -- 172.21.15.146:0/3746592156 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4dc9e815-0401-4f87-8fe9-f72ba6cff7a9", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f48ac029030 con 0x7f48b8153e30 2023-08-31T18:47:35.644 INFO:teuthology.orchestra.run.smithi146.stdout:3 2023-08-31T18:47:35.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.645+0000 7f48bd1ff700 1 -- 172.21.15.146:0/3746592156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48b8153e30 msgr2=0x7f48b8159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:35.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.645+0000 7f48bd1ff700 1 --2- 172.21.15.146:0/3746592156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48b8153e30 0x7f48b8159140 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f48ac00e980 tx=0x7f48ac009060).stop 2023-08-31T18:47:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.645+0000 7f48bd1ff700 1 -- 172.21.15.146:0/3746592156 shutdown_connections 2023-08-31T18:47:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.645+0000 7f48bd1ff700 1 --2- 172.21.15.146:0/3746592156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b8154210 0x7f48b8152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.645+0000 7f48bd1ff700 1 --2- 172.21.15.146:0/3746592156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48b80635a0 0x7f48b814f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.645+0000 7f48bd1ff700 1 --2- 172.21.15.146:0/3746592156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48b8153e30 0x7f48b8159140 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.645+0000 7f48bd1ff700 1 -- 172.21.15.146:0/3746592156 >> 172.21.15.146:0/3746592156 conn(0x7f48b805eb20 msgr2=0x7f48b80ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:35.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.645+0000 7f48bd1ff700 1 -- 172.21.15.146:0/3746592156 shutdown_connections 2023-08-31T18:47:35.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.645+0000 7f48bd1ff700 1 -- 172.21.15.146:0/3746592156 wait complete. 2023-08-31T18:47:35.661 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new ad5e37e5-b3ee-4cf4-bea1-e6515c979e25 4 2023-08-31T18:47:35.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.847+0000 7fa6807ff700 1 Processor -- start 2023-08-31T18:47:35.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.848+0000 7fa6807ff700 1 -- start start 2023-08-31T18:47:35.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.849+0000 7fa6807ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa678154030 0x7fa678154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:35.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.849+0000 7fa6807ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa6780c06b0 0x7fa6780c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.849+0000 7fa6807ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6780c6ed0 con 0x7fa6780aa140 2023-08-31T18:47:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.849+0000 7fa6807ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6780c66e0 con 0x7fa678154030 2023-08-31T18:47:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.849+0000 7fa6807ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6780c68c0 con 0x7fa6780c06b0 2023-08-31T18:47:35.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.849+0000 7fa67dd9a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa6780c06b0 0x7fa6780c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:35.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.849+0000 7fa67dd9a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa6780c06b0 0x7fa6780c7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49224/0 (socket says 172.21.15.146:49224) 2023-08-31T18:47:35.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.849+0000 7fa67dd9a700 1 -- 172.21.15.146:0/41416980 learned_addr learned my addr 172.21.15.146:0/41416980 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-08-31T18:47:35.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.849+0000 7fa67e59b700 1 --2- 172.21.15.146:0/41416980 >> v2:172.21.15.72:3300/0 conn(0x7fa678154030 0x7fa678154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:35.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.850+0000 7fa67dd9a700 1 -- 172.21.15.146:0/41416980 >> v2:172.21.15.72:3300/0 conn(0x7fa678154030 msgr2=0x7fa678154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:35.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.850+0000 7fa67dd9a700 1 --2- 172.21.15.146:0/41416980 >> v2:172.21.15.72:3300/0 conn(0x7fa678154030 0x7fa678154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.850+0000 7fa67dd9a700 1 -- 172.21.15.146:0/41416980 >> v1:172.21.15.72:6789/0 conn(0x7fa6780aa140 legacy=0x7fa678063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:35.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.850+0000 7fa67dd9a700 1 -- 172.21.15.146:0/41416980 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6780c0f30 con 0x7fa6780c06b0 2023-08-31T18:47:35.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.850+0000 7fa67dd9a700 1 --2- 172.21.15.146:0/41416980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6780c06b0 0x7fa6780c7360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fa6780cb6d0 tx=0x7fa6680090f0).ready entity=mon.1 client_cookie=cabe6f0d0de32136 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:35.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.850+0000 7fa67d599700 1 -- 172.21.15.146:0/41416980 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66800b520 con 0x7fa6780c06b0 2023-08-31T18:47:35.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.850+0000 7fa67d599700 1 -- 172.21.15.146:0/41416980 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66800b680 con 0x7fa6780c06b0 2023-08-31T18:47:35.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.850+0000 7fa67d599700 1 -- 172.21.15.146:0/41416980 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66800ba00 con 0x7fa6780c06b0 2023-08-31T18:47:35.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.851+0000 7fa6807ff700 1 -- 172.21.15.146:0/41416980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6780c06b0 msgr2=0x7fa6780c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:35.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.851+0000 7fa6807ff700 1 --2- 172.21.15.146:0/41416980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6780c06b0 0x7fa6780c7360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fa6780cb6d0 tx=0x7fa6680090f0).stop 2023-08-31T18:47:35.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.851+0000 7fa6807ff700 1 -- 172.21.15.146:0/41416980 shutdown_connections 2023-08-31T18:47:35.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.851+0000 7fa6807ff700 1 --2- 172.21.15.146:0/41416980 >> v2:172.21.15.72:3300/0 conn(0x7fa678154030 0x7fa678154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.851+0000 7fa6807ff700 1 --2- 172.21.15.146:0/41416980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6780c06b0 0x7fa6780c7360 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.851+0000 7fa6807ff700 1 -- 172.21.15.146:0/41416980 >> 172.21.15.146:0/41416980 conn(0x7fa67805eb60 msgr2=0x7fa6780cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:35.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.851+0000 7fa6807ff700 1 -- 172.21.15.146:0/41416980 shutdown_connections 2023-08-31T18:47:35.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.851+0000 7fa6807ff700 1 -- 172.21.15.146:0/41416980 wait complete. 2023-08-31T18:47:35.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.852+0000 7fa6807ff700 1 Processor -- start 2023-08-31T18:47:35.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.853+0000 7fa6807ff700 1 -- start start 2023-08-31T18:47:35.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.853+0000 7fa6807ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6780aa140 0x7fa67814d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:35.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.853+0000 7fa6807ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6780c06b0 0x7fa6780b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:35.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.853+0000 7fa6807ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa678154030 0x7fa678152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:35.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa6807ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa678164650 con 0x7fa6780c06b0 2023-08-31T18:47:35.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa6807ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa678164930 con 0x7fa678154030 2023-08-31T18:47:35.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa6807ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa678164c10 con 0x7fa6780aa140 2023-08-31T18:47:35.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa67e59b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6780aa140 0x7fa67814d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:35.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa67ed9c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa678154030 0x7fa678152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:35.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa67dd9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6780c06b0 0x7fa6780b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:35.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa67e59b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6780aa140 0x7fa67814d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46386/0 (socket says 172.21.15.146:46386) 2023-08-31T18:47:35.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa67e59b700 1 -- 172.21.15.146:0/194521183 learned_addr learned my addr 172.21.15.146:0/194521183 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-08-31T18:47:35.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa67ed9c700 1 -- 172.21.15.146:0/194521183 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6780aa140 msgr2=0x7fa67814d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:35.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa67ed9c700 1 --2- 172.21.15.146:0/194521183 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6780aa140 0x7fa67814d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa67ed9c700 1 -- 172.21.15.146:0/194521183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6780c06b0 msgr2=0x7fa6780b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:35.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa67ed9c700 1 --2- 172.21.15.146:0/194521183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6780c06b0 0x7fa6780b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa67ed9c700 1 -- 172.21.15.146:0/194521183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa668009370 con 0x7fa678154030 2023-08-31T18:47:35.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa67e59b700 1 --2- 172.21.15.146:0/194521183 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6780aa140 0x7fa67814d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:47:35.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa67dd9a700 1 --2- 172.21.15.146:0/194521183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6780c06b0 0x7fa6780b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:47:35.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.854+0000 7fa67ed9c700 1 --2- 172.21.15.146:0/194521183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa678154030 0x7fa678152130 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fa6700013d0 tx=0x7fa670001530).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:35.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.855+0000 7fa66e7fc700 1 -- 172.21.15.146:0/194521183 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67000e4a0 con 0x7fa678154030 2023-08-31T18:47:35.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.855+0000 7fa66e7fc700 1 -- 172.21.15.146:0/194521183 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67000e600 con 0x7fa678154030 2023-08-31T18:47:35.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.855+0000 7fa6807ff700 1 -- 172.21.15.146:0/194521183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa678164ef0 con 0x7fa678154030 2023-08-31T18:47:35.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.855+0000 7fa66e7fc700 1 -- 172.21.15.146:0/194521183 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67000e980 con 0x7fa678154030 2023-08-31T18:47:35.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.855+0000 7fa6807ff700 1 -- 172.21.15.146:0/194521183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67814d850 con 0x7fa678154030 2023-08-31T18:47:35.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.855+0000 7fa66e7fc700 1 -- 172.21.15.146:0/194521183 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fa6700123f0 con 0x7fa678154030 2023-08-31T18:47:35.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.856+0000 7fa66e7fc700 1 -- 172.21.15.146:0/194521183 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7fa6700113a0 con 0x7fa678154030 2023-08-31T18:47:35.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.856+0000 7fa6807ff700 1 -- 172.21.15.146:0/194521183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67814da40 con 0x7fa678154030 2023-08-31T18:47:35.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.859+0000 7fa66e7fc700 1 -- 172.21.15.146:0/194521183 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa670020060 con 0x7fa678154030 2023-08-31T18:47:35.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.942+0000 7fa6807ff700 1 -- 172.21.15.146:0/194521183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ad5e37e5-b3ee-4cf4-bea1-e6515c979e25", "id": 4} v 0) v1 -- 0x7fa6780c0c50 con 0x7fa678154030 2023-08-31T18:47:35.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.948+0000 7fa66e7fc700 1 -- 172.21.15.146:0/194521183 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad5e37e5-b3ee-4cf4-bea1-e6515c979e25", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa6700126a0 con 0x7fa678154030 2023-08-31T18:47:35.948 INFO:teuthology.orchestra.run.smithi146.stdout:4 2023-08-31T18:47:35.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.949+0000 7fa6807ff700 1 -- 172.21.15.146:0/194521183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa678154030 msgr2=0x7fa678152130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:35.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.949+0000 7fa6807ff700 1 --2- 172.21.15.146:0/194521183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa678154030 0x7fa678152130 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fa6700013d0 tx=0x7fa670001530).stop 2023-08-31T18:47:35.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.949+0000 7fa6807ff700 1 -- 172.21.15.146:0/194521183 shutdown_connections 2023-08-31T18:47:35.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.949+0000 7fa6807ff700 1 --2- 172.21.15.146:0/194521183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa678154030 0x7fa678152130 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.949+0000 7fa6807ff700 1 --2- 172.21.15.146:0/194521183 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6780aa140 0x7fa67814d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.949+0000 7fa6807ff700 1 --2- 172.21.15.146:0/194521183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6780c06b0 0x7fa6780b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:35.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.949+0000 7fa6807ff700 1 -- 172.21.15.146:0/194521183 >> 172.21.15.146:0/194521183 conn(0x7fa67805eb60 msgr2=0x7fa6780ad440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:35.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.949+0000 7fa6807ff700 1 -- 172.21.15.146:0/194521183 shutdown_connections 2023-08-31T18:47:35.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:35.949+0000 7fa6807ff700 1 -- 172.21.15.146:0/194521183 wait complete. 2023-08-31T18:47:35.965 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new b6d6e926-5670-4b55-a29e-fd323238eea2 5 2023-08-31T18:47:35.998 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:35.997+0000 7fda3690f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T18:47:36.105 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:36.105+0000 7fde7d226680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T18:47:36.119 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:36.119+0000 7fda3690f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T18:47:36.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.150+0000 7f21701ff700 1 Processor -- start 2023-08-31T18:47:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.150+0000 7f21701ff700 1 -- start start 2023-08-31T18:47:36.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.151+0000 7f21701ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21680637c0 0x7f216815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:36.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.151+0000 7f21701ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21680bfd40 con 0x7f2168153e30 2023-08-31T18:47:36.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.151+0000 7f21701ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21680c6730 con 0x7f2168154210 2023-08-31T18:47:36.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.151+0000 7f21701ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21681546c0 con 0x7f21680637c0 2023-08-31T18:47:36.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.152+0000 7f216d79a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2168154210 0x7f21680630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43032/0 (socket says 172.21.15.146:43032) 2023-08-31T18:47:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.152+0000 7f216d79a700 1 -- 172.21.15.146:0/72255207 learned_addr learned my addr 172.21.15.146:0/72255207 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-08-31T18:47:36.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.152+0000 7f216e79c700 1 --2- 172.21.15.146:0/72255207 >> v2:172.21.15.72:3300/0 conn(0x7f21680637c0 0x7f216815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:36.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.152+0000 7f216cf99700 1 -- 172.21.15.146:0/72255207 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071950457 0 0) 0x7f21680c6730 con 0x7f2168154210 2023-08-31T18:47:36.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.152+0000 7f216cf99700 1 -- 172.21.15.146:0/72255207 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21540033f0 con 0x7f2168154210 2023-08-31T18:47:36.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.152+0000 7f216e79c700 1 -- 172.21.15.146:0/72255207 >> v1:172.21.15.146:6789/0 conn(0x7f2168154210 legacy=0x7f21680630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:36.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.152+0000 7f216e79c700 1 -- 172.21.15.146:0/72255207 >> v1:172.21.15.72:6789/0 conn(0x7f2168153e30 legacy=0x7f21680c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:36.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.152+0000 7f216cf99700 1 -- 172.21.15.146:0/72255207 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058122644 0 0) 0x7f21680bfd40 con 0x7f2168153e30 2023-08-31T18:47:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.152+0000 7f216e79c700 1 -- 172.21.15.146:0/72255207 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21680bffe0 con 0x7f21680637c0 2023-08-31T18:47:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.153+0000 7f216e79c700 1 --2- 172.21.15.146:0/72255207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21680637c0 0x7f216815f0b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f2160009e60 tx=0x7f2160009780).ready entity=mon.0 client_cookie=5f57b2fceff29c87 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.153+0000 7f216cf99700 1 -- 172.21.15.146:0/72255207 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216000e070 con 0x7f21680637c0 2023-08-31T18:47:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.153+0000 7f216cf99700 1 -- 172.21.15.146:0/72255207 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216000bb60 con 0x7f21680637c0 2023-08-31T18:47:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.153+0000 7f216cf99700 1 -- 172.21.15.146:0/72255207 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216000bee0 con 0x7f21680637c0 2023-08-31T18:47:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.153+0000 7f21701ff700 1 -- 172.21.15.146:0/72255207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21680637c0 msgr2=0x7f216815f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.153+0000 7f21701ff700 1 --2- 172.21.15.146:0/72255207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21680637c0 0x7f216815f0b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f2160009e60 tx=0x7f2160009780).stop 2023-08-31T18:47:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.153+0000 7f21701ff700 1 -- 172.21.15.146:0/72255207 shutdown_connections 2023-08-31T18:47:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.153+0000 7f21701ff700 1 --2- 172.21.15.146:0/72255207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21680637c0 0x7f216815f0b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.154+0000 7f21701ff700 1 -- 172.21.15.146:0/72255207 >> 172.21.15.146:0/72255207 conn(0x7f216805eb20 msgr2=0x7f21680cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:36.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.154+0000 7f21701ff700 1 -- 172.21.15.146:0/72255207 shutdown_connections 2023-08-31T18:47:36.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.154+0000 7f21701ff700 1 -- 172.21.15.146:0/72255207 wait complete. 2023-08-31T18:47:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.155+0000 7f21701ff700 1 Processor -- start 2023-08-31T18:47:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.155+0000 7f21701ff700 1 -- start start 2023-08-31T18:47:36.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.156+0000 7f21701ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21680637c0 0x7f21680c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.156+0000 7f21701ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2168153e30 0x7f21680aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.156+0000 7f21701ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2168154210 0x7f2168157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.156+0000 7f21701ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21680b0350 con 0x7f21680637c0 2023-08-31T18:47:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.156+0000 7f21701ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21680af740 con 0x7f2168153e30 2023-08-31T18:47:36.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.156+0000 7f21701ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21680afa20 con 0x7f2168154210 2023-08-31T18:47:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.156+0000 7f216d79a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2168153e30 0x7f21680aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.156+0000 7f216e79c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2168154210 0x7f2168157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.156+0000 7f216df9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21680637c0 0x7f21680c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.156+0000 7f216df9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21680637c0 0x7f21680c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.146:43230/0 (socket says 172.21.15.146:43230) 2023-08-31T18:47:36.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.156+0000 7f216d79a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2168153e30 0x7f21680aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49230/0 (socket says 172.21.15.146:49230) 2023-08-31T18:47:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.156+0000 7f216df9b700 1 -- 172.21.15.146:0/2598237254 learned_addr learned my addr 172.21.15.146:0/2598237254 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-08-31T18:47:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.157+0000 7f216df9b700 1 -- 172.21.15.146:0/2598237254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2168154210 msgr2=0x7f2168157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.157+0000 7f216df9b700 1 --2- 172.21.15.146:0/2598237254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2168154210 0x7f2168157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.157+0000 7f216df9b700 1 -- 172.21.15.146:0/2598237254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2168153e30 msgr2=0x7f21680aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.157+0000 7f216df9b700 1 --2- 172.21.15.146:0/2598237254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2168153e30 0x7f21680aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.157+0000 7f216df9b700 1 -- 172.21.15.146:0/2598237254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160009a20 con 0x7f21680637c0 2023-08-31T18:47:36.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.157+0000 7f216d79a700 1 --2- 172.21.15.146:0/2598237254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2168153e30 0x7f21680aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:47:36.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.157+0000 7f216df9b700 1 --2- 172.21.15.146:0/2598237254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21680637c0 0x7f21680c4610 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f2164001eb0 tx=0x7f2164007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:36.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.157+0000 7f215dffb700 1 -- 172.21.15.146:0/2598237254 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216400ce60 con 0x7f21680637c0 2023-08-31T18:47:36.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.157+0000 7f215dffb700 1 -- 172.21.15.146:0/2598237254 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216400f470 con 0x7f21680637c0 2023-08-31T18:47:36.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.157+0000 7f21701ff700 1 -- 172.21.15.146:0/2598237254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21680afd00 con 0x7f21680637c0 2023-08-31T18:47:36.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.157+0000 7f215dffb700 1 -- 172.21.15.146:0/2598237254 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216400f810 con 0x7f21680637c0 2023-08-31T18:47:36.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.157+0000 7f21701ff700 1 -- 172.21.15.146:0/2598237254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216815a100 con 0x7f21680637c0 2023-08-31T18:47:36.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.158+0000 7f215dffb700 1 -- 172.21.15.146:0/2598237254 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f216401c440 con 0x7f21680637c0 2023-08-31T18:47:36.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.158+0000 7f215dffb700 1 -- 172.21.15.146:0/2598237254 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f216400fde0 con 0x7f21680637c0 2023-08-31T18:47:36.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.158+0000 7f21701ff700 1 -- 172.21.15.146:0/2598237254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21680b01a0 con 0x7f21680637c0 2023-08-31T18:47:36.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.161+0000 7f215dffb700 1 -- 172.21.15.146:0/2598237254 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f2164017070 con 0x7f21680637c0 2023-08-31T18:47:36.235 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:36.235+0000 7fde7d226680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T18:47:36.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.245+0000 7f21701ff700 1 -- 172.21.15.146:0/2598237254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b6d6e926-5670-4b55-a29e-fd323238eea2", "id": 5} v 0) v1 -- 0x7f21680b0630 con 0x7f21680637c0 2023-08-31T18:47:36.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.252+0000 7f215dffb700 1 -- 172.21.15.146:0/2598237254 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b6d6e926-5670-4b55-a29e-fd323238eea2", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f216401c6f0 con 0x7f21680637c0 2023-08-31T18:47:36.253 INFO:teuthology.orchestra.run.smithi146.stdout:5 2023-08-31T18:47:36.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.254+0000 7f21701ff700 1 -- 172.21.15.146:0/2598237254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21680637c0 msgr2=0x7f21680c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:36.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.254+0000 7f21701ff700 1 --2- 172.21.15.146:0/2598237254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21680637c0 0x7f21680c4610 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f2164001eb0 tx=0x7f2164007c70).stop 2023-08-31T18:47:36.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.254+0000 7f21701ff700 1 -- 172.21.15.146:0/2598237254 shutdown_connections 2023-08-31T18:47:36.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.254+0000 7f21701ff700 1 --2- 172.21.15.146:0/2598237254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2168154210 0x7f2168157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.254+0000 7f21701ff700 1 --2- 172.21.15.146:0/2598237254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21680637c0 0x7f21680c4610 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.254+0000 7f21701ff700 1 --2- 172.21.15.146:0/2598237254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2168153e30 0x7f21680aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.254+0000 7f21701ff700 1 -- 172.21.15.146:0/2598237254 >> 172.21.15.146:0/2598237254 conn(0x7f216805eb20 msgr2=0x7f2168152ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:36.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.254+0000 7f21701ff700 1 -- 172.21.15.146:0/2598237254 shutdown_connections 2023-08-31T18:47:36.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.254+0000 7f21701ff700 1 -- 172.21.15.146:0/2598237254 wait complete. 2023-08-31T18:47:36.270 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new a02b3abf-114e-4270-9871-df7ddd7a83c7 6 2023-08-31T18:47:36.303 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:36.302+0000 7fda3690f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T18:47:36.398 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:36.398+0000 7fda3690f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T18:47:36.430 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:36.430+0000 7fde7d226680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T18:47:36.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.459+0000 7f1db7bff700 1 Processor -- start 2023-08-31T18:47:36.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.460+0000 7f1db7bff700 1 -- start start 2023-08-31T18:47:36.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.461+0000 7f1db7bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1db0153e30 0x7f1db0154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:36.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.461+0000 7f1db7bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1db00c5cb0 0x7f1db00c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:36.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.461+0000 7f1db7bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db00bfd40 con 0x7f1db00630b0 2023-08-31T18:47:36.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.461+0000 7f1db7bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db00c6730 con 0x7f1db00c5cb0 2023-08-31T18:47:36.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.461+0000 7f1db7bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00bffe0 con 0x7f1db0153e30 2023-08-31T18:47:36.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.461+0000 7f1db599b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1db0153e30 0x7f1db0154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:36.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.461+0000 7f1db619c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1db00630b0 0x7f1db0157d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43038/0 (socket says 172.21.15.146:43038) 2023-08-31T18:47:36.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.461+0000 7f1db619c700 1 -- 172.21.15.146:0/3794374476 learned_addr learned my addr 172.21.15.146:0/3794374476 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-08-31T18:47:36.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.461+0000 7f1db519a700 1 --2- 172.21.15.146:0/3794374476 >> v2:172.21.15.72:3300/0 conn(0x7f1db00c5cb0 0x7f1db00c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:36.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.462+0000 7f1db599b700 1 -- 172.21.15.146:0/3794374476 >> v2:172.21.15.72:3300/0 conn(0x7f1db00c5cb0 msgr2=0x7f1db00c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:36.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.462+0000 7f1db599b700 1 --2- 172.21.15.146:0/3794374476 >> v2:172.21.15.72:3300/0 conn(0x7f1db00c5cb0 0x7f1db00c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.462+0000 7f1db4999700 1 -- 172.21.15.146:0/3794374476 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449469065 0 0) 0x7f1db00bfd40 con 0x7f1db00630b0 2023-08-31T18:47:36.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.462+0000 7f1db599b700 1 -- 172.21.15.146:0/3794374476 >> v1:172.21.15.146:6789/0 conn(0x7f1db00630b0 legacy=0x7f1db0157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:36.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.462+0000 7f1db599b700 1 -- 172.21.15.146:0/3794374476 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db00c02c0 con 0x7f1db0153e30 2023-08-31T18:47:36.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.462+0000 7f1db599b700 1 --2- 172.21.15.146:0/3794374476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1db0153e30 0x7f1db0154210 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f1dac009760 tx=0x7f1dac009060).ready entity=mon.2 client_cookie=765bd293334f217 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:36.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.462+0000 7f1db4999700 1 -- 172.21.15.146:0/3794374476 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac0090d0 con 0x7f1db0153e30 2023-08-31T18:47:36.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.462+0000 7f1db4999700 1 -- 172.21.15.146:0/3794374476 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac00f510 con 0x7f1db0153e30 2023-08-31T18:47:36.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.462+0000 7f1db4999700 1 -- 172.21.15.146:0/3794374476 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00f890 con 0x7f1db0153e30 2023-08-31T18:47:36.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.463+0000 7f1db7bff700 1 -- 172.21.15.146:0/3794374476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1db0153e30 msgr2=0x7f1db0154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:36.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.463+0000 7f1db7bff700 1 --2- 172.21.15.146:0/3794374476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1db0153e30 0x7f1db0154210 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f1dac009760 tx=0x7f1dac009060).stop 2023-08-31T18:47:36.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.463+0000 7f1db7bff700 1 -- 172.21.15.146:0/3794374476 shutdown_connections 2023-08-31T18:47:36.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.463+0000 7f1db7bff700 1 --2- 172.21.15.146:0/3794374476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1db0153e30 0x7f1db0154210 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.463+0000 7f1db7bff700 1 --2- 172.21.15.146:0/3794374476 >> v2:172.21.15.72:3300/0 conn(0x7f1db00c5cb0 0x7f1db00c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.463+0000 7f1db7bff700 1 -- 172.21.15.146:0/3794374476 >> 172.21.15.146:0/3794374476 conn(0x7f1db005eb20 msgr2=0x7f1db00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:36.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.463+0000 7f1db7bff700 1 -- 172.21.15.146:0/3794374476 shutdown_connections 2023-08-31T18:47:36.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.463+0000 7f1db7bff700 1 -- 172.21.15.146:0/3794374476 wait complete. 2023-08-31T18:47:36.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.465+0000 7f1db7bff700 1 Processor -- start 2023-08-31T18:47:36.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.465+0000 7f1db7bff700 1 -- start start 2023-08-31T18:47:36.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db7bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db00630b0 0x7f1db014f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:36.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db7bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1db00c5cb0 0x7f1db00c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:36.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db7bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1db0153e30 0x7f1db0151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:36.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db7bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0150580 con 0x7f1db00630b0 2023-08-31T18:47:36.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db7bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db014f720 con 0x7f1db0153e30 2023-08-31T18:47:36.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db7bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00c2fd0 con 0x7f1db00c5cb0 2023-08-31T18:47:36.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db599b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db00630b0 0x7f1db014f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:36.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db519a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1db00c5cb0 0x7f1db00c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:36.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db619c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1db0153e30 0x7f1db0151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:36.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db599b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db00630b0 0x7f1db014f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.146:43250/0 (socket says 172.21.15.146:43250) 2023-08-31T18:47:36.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db599b700 1 -- 172.21.15.146:0/429012269 learned_addr learned my addr 172.21.15.146:0/429012269 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-08-31T18:47:36.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db599b700 1 -- 172.21.15.146:0/429012269 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1db00c5cb0 msgr2=0x7f1db00c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:36.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db599b700 1 --2- 172.21.15.146:0/429012269 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1db00c5cb0 0x7f1db00c4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db599b700 1 -- 172.21.15.146:0/429012269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1db0153e30 msgr2=0x7f1db0151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:36.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db599b700 1 --2- 172.21.15.146:0/429012269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1db0153e30 0x7f1db0151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db599b700 1 -- 172.21.15.146:0/429012269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac0092a0 con 0x7f1db00630b0 2023-08-31T18:47:36.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.466+0000 7f1db519a700 1 --2- 172.21.15.146:0/429012269 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1db00c5cb0 0x7f1db00c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:47:36.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.467+0000 7f1db599b700 1 --2- 172.21.15.146:0/429012269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db00630b0 0x7f1db014f230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f1dac009e00 tx=0x7f1dac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:36.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.467+0000 7f1da5ffb700 1 -- 172.21.15.146:0/429012269 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00f890 con 0x7f1db00630b0 2023-08-31T18:47:36.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.467+0000 7f1da5ffb700 1 -- 172.21.15.146:0/429012269 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac00fc50 con 0x7f1db00630b0 2023-08-31T18:47:36.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.467+0000 7f1da5ffb700 1 -- 172.21.15.146:0/429012269 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac01c420 con 0x7f1db00630b0 2023-08-31T18:47:36.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.467+0000 7f1db7bff700 1 -- 172.21.15.146:0/429012269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db00c32b0 con 0x7f1db00630b0 2023-08-31T18:47:36.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.467+0000 7f1db7bff700 1 -- 172.21.15.146:0/429012269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db00c3870 con 0x7f1db00630b0 2023-08-31T18:47:36.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.467+0000 7f1da5ffb700 1 -- 172.21.15.146:0/429012269 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f1dac01ca30 con 0x7f1db00630b0 2023-08-31T18:47:36.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.467+0000 7f1da5ffb700 1 -- 172.21.15.146:0/429012269 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f1dac01cce0 con 0x7f1db00630b0 2023-08-31T18:47:36.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.469+0000 7f1db7bff700 1 -- 172.21.15.146:0/429012269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db00c3ec0 con 0x7f1db00630b0 2023-08-31T18:47:36.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.471+0000 7f1da5ffb700 1 -- 172.21.15.146:0/429012269 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f1dac029060 con 0x7f1db00630b0 2023-08-31T18:47:36.485 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:36.485+0000 7fda3690f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T18:47:36.533 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:36.533+0000 7fde7d226680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T18:47:36.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.555+0000 7f1db7bff700 1 -- 172.21.15.146:0/429012269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a02b3abf-114e-4270-9871-df7ddd7a83c7", "id": 6} v 0) v1 -- 0x7f1db0062970 con 0x7f1db00630b0 2023-08-31T18:47:36.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.563+0000 7f1da5ffb700 1 -- 172.21.15.146:0/429012269 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a02b3abf-114e-4270-9871-df7ddd7a83c7", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1dac0320b0 con 0x7f1db00630b0 2023-08-31T18:47:36.563 INFO:teuthology.orchestra.run.smithi146.stdout:6 2023-08-31T18:47:36.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.564+0000 7f1db7bff700 1 -- 172.21.15.146:0/429012269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db00630b0 msgr2=0x7f1db014f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:36.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.564+0000 7f1db7bff700 1 --2- 172.21.15.146:0/429012269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db00630b0 0x7f1db014f230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f1dac009e00 tx=0x7f1dac017000).stop 2023-08-31T18:47:36.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.564+0000 7f1db7bff700 1 -- 172.21.15.146:0/429012269 shutdown_connections 2023-08-31T18:47:36.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.564+0000 7f1db7bff700 1 --2- 172.21.15.146:0/429012269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1db0153e30 0x7f1db0151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.564+0000 7f1db7bff700 1 --2- 172.21.15.146:0/429012269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db00630b0 0x7f1db014f230 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.564+0000 7f1db7bff700 1 --2- 172.21.15.146:0/429012269 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1db00c5cb0 0x7f1db00c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.564+0000 7f1db7bff700 1 -- 172.21.15.146:0/429012269 >> 172.21.15.146:0/429012269 conn(0x7f1db005eb20 msgr2=0x7f1db00ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:36.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.564+0000 7f1db7bff700 1 -- 172.21.15.146:0/429012269 shutdown_connections 2023-08-31T18:47:36.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.564+0000 7f1db7bff700 1 -- 172.21.15.146:0/429012269 wait complete. 2023-08-31T18:47:36.581 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd new 9d50c917-8daa-4801-aae0-8abed146e18c 7 2023-08-31T18:47:36.633 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:36.632+0000 7fde7d226680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T18:47:36.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.777+0000 7fb921f9d700 1 Processor -- start 2023-08-31T18:47:36.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.777+0000 7fb921f9d700 1 -- start start 2023-08-31T18:47:36.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.778+0000 7fb921f9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb91c0a9c90 0x7fb91c0aa070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:36.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.778+0000 7fb921f9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb91c154460 0x7fb91c0c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:36.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.778+0000 7fb921f9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb91c0c01f0 0x7fb91c0c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:36.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.778+0000 7fb921f9d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91c1548e0 con 0x7fb91c154460 2023-08-31T18:47:36.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.778+0000 7fb921f9d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91c157b90 con 0x7fb91c0c01f0 2023-08-31T18:47:36.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.778+0000 7fb921f9d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c0c5d40 con 0x7fb91c0a9c90 2023-08-31T18:47:36.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.779+0000 7fb920f9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb91c0a9c90 0x7fb91c0aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:36.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.779+0000 7fb92179c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb91c0c01f0 0x7fb91c0c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:36.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.779+0000 7fb920f9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb91c0a9c90 0x7fb91c0aa070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46434/0 (socket says 172.21.15.146:46434) 2023-08-31T18:47:36.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.779+0000 7fb920f9b700 1 -- 172.21.15.146:0/145957306 learned_addr learned my addr 172.21.15.146:0/145957306 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-08-31T18:47:36.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.779+0000 7fb91bfff700 1 --2- 172.21.15.146:0/145957306 >> v2:172.21.15.72:3300/0 conn(0x7fb91c154460 0x7fb91c0c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.779+0000 7fb920f9b700 1 -- 172.21.15.146:0/145957306 >> v2:172.21.15.146:3300/0 conn(0x7fb91c0c01f0 msgr2=0x7fb91c0c0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.779+0000 7fb920f9b700 1 --2- 172.21.15.146:0/145957306 >> v2:172.21.15.146:3300/0 conn(0x7fb91c0c01f0 0x7fb91c0c0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.779+0000 7fb920f9b700 1 -- 172.21.15.146:0/145957306 >> v2:172.21.15.72:3300/0 conn(0x7fb91c154460 msgr2=0x7fb91c0c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.779+0000 7fb920f9b700 1 --2- 172.21.15.146:0/145957306 >> v2:172.21.15.72:3300/0 conn(0x7fb91c154460 0x7fb91c0c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.779+0000 7fb920f9b700 1 -- 172.21.15.146:0/145957306 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c154ae0 con 0x7fb91c0a9c90 2023-08-31T18:47:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.779+0000 7fb92179c700 1 --2- 172.21.15.146:0/145957306 >> v2:172.21.15.146:3300/0 conn(0x7fb91c0c01f0 0x7fb91c0c0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:47:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.779+0000 7fb920f9b700 1 --2- 172.21.15.146:0/145957306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb91c0a9c90 0x7fb91c0aa070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fb91c0ad8d0 tx=0x7fb9100090f0).ready entity=mon.2 client_cookie=c81d640be2b46d3a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.780+0000 7fb91b7fe700 1 -- 172.21.15.146:0/145957306 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91000f510 con 0x7fb91c0a9c90 2023-08-31T18:47:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.780+0000 7fb91b7fe700 1 -- 172.21.15.146:0/145957306 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91000f670 con 0x7fb91c0a9c90 2023-08-31T18:47:36.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.780+0000 7fb91b7fe700 1 -- 172.21.15.146:0/145957306 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91000fa10 con 0x7fb91c0a9c90 2023-08-31T18:47:36.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.780+0000 7fb921f9d700 1 -- 172.21.15.146:0/145957306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb91c0a9c90 msgr2=0x7fb91c0aa070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:36.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.780+0000 7fb921f9d700 1 --2- 172.21.15.146:0/145957306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb91c0a9c90 0x7fb91c0aa070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fb91c0ad8d0 tx=0x7fb9100090f0).stop 2023-08-31T18:47:36.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.780+0000 7fb921f9d700 1 -- 172.21.15.146:0/145957306 shutdown_connections 2023-08-31T18:47:36.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.780+0000 7fb921f9d700 1 --2- 172.21.15.146:0/145957306 >> v2:172.21.15.146:3300/0 conn(0x7fb91c0c01f0 0x7fb91c0c0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.780+0000 7fb921f9d700 1 --2- 172.21.15.146:0/145957306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb91c0a9c90 0x7fb91c0aa070 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.780+0000 7fb921f9d700 1 --2- 172.21.15.146:0/145957306 >> v2:172.21.15.72:3300/0 conn(0x7fb91c154460 0x7fb91c0c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.780+0000 7fb921f9d700 1 -- 172.21.15.146:0/145957306 >> 172.21.15.146:0/145957306 conn(0x7fb91c062e60 msgr2=0x7fb91c063270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:36.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.780+0000 7fb921f9d700 1 -- 172.21.15.146:0/145957306 shutdown_connections 2023-08-31T18:47:36.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.780+0000 7fb921f9d700 1 -- 172.21.15.146:0/145957306 wait complete. 2023-08-31T18:47:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.782+0000 7fb921f9d700 1 Processor -- start 2023-08-31T18:47:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.782+0000 7fb921f9d700 1 -- start start 2023-08-31T18:47:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.783+0000 7fb921f9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb91c0a9c90 0x7fb91c14f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.783+0000 7fb921f9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb91c0c01f0 0x7fb91c0aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.783+0000 7fb921f9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb91c154460 0x7fb91c0c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.783+0000 7fb921f9d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c0c47b0 con 0x7fb91c0c01f0 2023-08-31T18:47:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.783+0000 7fb921f9d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c0ab8d0 con 0x7fb91c154460 2023-08-31T18:47:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.783+0000 7fb921f9d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c14fc70 con 0x7fb91c0a9c90 2023-08-31T18:47:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.783+0000 7fb920f9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb91c0a9c90 0x7fb91c14f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.783+0000 7fb92179c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb91c154460 0x7fb91c0c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.783+0000 7fb92179c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb91c154460 0x7fb91c0c2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49254/0 (socket says 172.21.15.146:49254) 2023-08-31T18:47:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.783+0000 7fb920f9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb91c0a9c90 0x7fb91c14f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:46442/0 (socket says 172.21.15.146:46442) 2023-08-31T18:47:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.783+0000 7fb92179c700 1 -- 172.21.15.146:0/1488672438 learned_addr learned my addr 172.21.15.146:0/1488672438 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-08-31T18:47:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.783+0000 7fb91bfff700 1 --2- 172.21.15.146:0/1488672438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb91c0c01f0 0x7fb91c0aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.784+0000 7fb92179c700 1 -- 172.21.15.146:0/1488672438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb91c0a9c90 msgr2=0x7fb91c14f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.784+0000 7fb92179c700 1 --2- 172.21.15.146:0/1488672438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb91c0a9c90 0x7fb91c14f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.784+0000 7fb92179c700 1 -- 172.21.15.146:0/1488672438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb91c0c01f0 msgr2=0x7fb91c0aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.784+0000 7fb92179c700 1 --2- 172.21.15.146:0/1488672438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb91c0c01f0 0x7fb91c0aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.784+0000 7fb92179c700 1 -- 172.21.15.146:0/1488672438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb914009a20 con 0x7fb91c154460 2023-08-31T18:47:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.784+0000 7fb92179c700 1 --2- 172.21.15.146:0/1488672438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb91c154460 0x7fb91c0c2650 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb91400c0f0 tx=0x7fb91400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.784+0000 7fb918ff9700 1 -- 172.21.15.146:0/1488672438 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91400cc30 con 0x7fb91c154460 2023-08-31T18:47:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.784+0000 7fb918ff9700 1 -- 172.21.15.146:0/1488672438 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91400f040 con 0x7fb91c154460 2023-08-31T18:47:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.784+0000 7fb921f9d700 1 -- 172.21.15.146:0/1488672438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb910009370 con 0x7fb91c154460 2023-08-31T18:47:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.784+0000 7fb918ff9700 1 -- 172.21.15.146:0/1488672438 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914013400 con 0x7fb91c154460 2023-08-31T18:47:36.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.784+0000 7fb921f9d700 1 -- 172.21.15.146:0/1488672438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91c0aafa0 con 0x7fb91c154460 2023-08-31T18:47:36.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.784+0000 7fb918ff9700 1 -- 172.21.15.146:0/1488672438 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fb914013a50 con 0x7fb91c154460 2023-08-31T18:47:36.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.785+0000 7fb918ff9700 1 -- 172.21.15.146:0/1488672438 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7fb914013d00 con 0x7fb91c154460 2023-08-31T18:47:36.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.785+0000 7fb921f9d700 1 -- 172.21.15.146:0/1488672438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91c0aba80 con 0x7fb91c154460 2023-08-31T18:47:36.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.789+0000 7fb918ff9700 1 -- 172.21.15.146:0/1488672438 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fb91c0aba80 con 0x7fb91c154460 2023-08-31T18:47:36.799 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:36.799+0000 7fda3690f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T18:47:36.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.872+0000 7fb921f9d700 1 -- 172.21.15.146:0/1488672438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9d50c917-8daa-4801-aae0-8abed146e18c", "id": 7} v 0) v1 -- 0x7fb91c0bfd10 con 0x7fb91c154460 2023-08-31T18:47:36.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.880+0000 7fb918ff9700 1 -- 172.21.15.146:0/1488672438 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d50c917-8daa-4801-aae0-8abed146e18c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb91401d640 con 0x7fb91c154460 2023-08-31T18:47:36.881 INFO:teuthology.orchestra.run.smithi146.stdout:7 2023-08-31T18:47:36.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.882+0000 7fb921f9d700 1 -- 172.21.15.146:0/1488672438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb91c154460 msgr2=0x7fb91c0c2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:36.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.882+0000 7fb921f9d700 1 --2- 172.21.15.146:0/1488672438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb91c154460 0x7fb91c0c2650 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb91400c0f0 tx=0x7fb91400b040).stop 2023-08-31T18:47:36.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.882+0000 7fb921f9d700 1 -- 172.21.15.146:0/1488672438 shutdown_connections 2023-08-31T18:47:36.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.882+0000 7fb921f9d700 1 --2- 172.21.15.146:0/1488672438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb91c154460 0x7fb91c0c2650 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.882+0000 7fb921f9d700 1 --2- 172.21.15.146:0/1488672438 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb91c0a9c90 0x7fb91c14f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.882+0000 7fb921f9d700 1 --2- 172.21.15.146:0/1488672438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb91c0c01f0 0x7fb91c0aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:36.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.882+0000 7fb921f9d700 1 -- 172.21.15.146:0/1488672438 >> 172.21.15.146:0/1488672438 conn(0x7fb91c062e60 msgr2=0x7fb91c1520e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:36.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.882+0000 7fb921f9d700 1 -- 172.21.15.146:0/1488672438 shutdown_connections 2023-08-31T18:47:36.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:47:36.882+0000 7fb921f9d700 1 -- 172.21.15.146:0/1488672438 wait complete. 2023-08-31T18:47:36.899 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-31T18:47:36.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-31T18:47:36.904 INFO:tasks.ceph.osd.0:Started 2023-08-31T18:47:36.904 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-31T18:47:36.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-31T18:47:36.909 INFO:tasks.ceph.osd.1:Started 2023-08-31T18:47:36.909 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-31T18:47:36.910 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-31T18:47:36.914 INFO:tasks.ceph.osd.2:Started 2023-08-31T18:47:36.915 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-31T18:47:36.915 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-31T18:47:36.920 INFO:tasks.ceph.osd.3:Started 2023-08-31T18:47:36.920 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-31T18:47:36.920 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-31T18:47:36.943 INFO:tasks.ceph.osd.4:Started 2023-08-31T18:47:36.943 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-31T18:47:36.944 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-31T18:47:36.948 INFO:tasks.ceph.osd.5:Started 2023-08-31T18:47:36.948 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-31T18:47:36.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-31T18:47:36.954 INFO:tasks.ceph.osd.6:Started 2023-08-31T18:47:36.954 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-31T18:47:36.955 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-31T18:47:36.959 INFO:tasks.ceph.osd.7:Started 2023-08-31T18:47:36.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:47:36.970 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:36.970+0000 7fde7d226680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T18:47:37.078 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:37.078+0000 7fda3690f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T18:47:37.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.189+0000 7fd079bff700 1 Processor -- start 2023-08-31T18:47:37.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.189+0000 7fd079bff700 1 -- start start 2023-08-31T18:47:37.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.191+0000 7fd079bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd0740cb9b0 0x7fd0741583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:37.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.191+0000 7fd079bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0741588d0 0x7fd074154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:37.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.191+0000 7fd079bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0740c6120 con 0x7fd074154060 2023-08-31T18:47:37.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.191+0000 7fd079bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0740c1380 con 0x7fd0741588d0 2023-08-31T18:47:37.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.191+0000 7fd079bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0740c5e10 con 0x7fd0740cb9b0 2023-08-31T18:47:37.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.191+0000 7fd073fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0741588d0 0x7fd074154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:37.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.191+0000 7fd0737fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd074154060 0x7fd074157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52054/0 (socket says 172.21.15.72:52054) 2023-08-31T18:47:37.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.191+0000 7fd0737fe700 1 -- 172.21.15.72:0/4208691749 learned_addr learned my addr 172.21.15.72:0/4208691749 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:47:37.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.191+0000 7fd072ffd700 1 --2- 172.21.15.72:0/4208691749 >> v2:172.21.15.146:3300/0 conn(0x7fd0740cb9b0 0x7fd0741583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:37.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.192+0000 7fd0727fc700 1 -- 172.21.15.72:0/4208691749 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584096481 0 0) 0x7fd0740c6120 con 0x7fd074154060 2023-08-31T18:47:37.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.192+0000 7fd0727fc700 1 -- 172.21.15.72:0/4208691749 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd05c0033f0 con 0x7fd074154060 2023-08-31T18:47:37.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.192+0000 7fd072ffd700 1 -- 172.21.15.72:0/4208691749 >> v2:172.21.15.72:3300/0 conn(0x7fd0741588d0 msgr2=0x7fd074154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:37.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.192+0000 7fd072ffd700 1 --2- 172.21.15.72:0/4208691749 >> v2:172.21.15.72:3300/0 conn(0x7fd0741588d0 0x7fd074154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.192+0000 7fd072ffd700 1 -- 172.21.15.72:0/4208691749 >> v1:172.21.15.72:6789/0 conn(0x7fd074154060 legacy=0x7fd074157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.192+0000 7fd072ffd700 1 -- 172.21.15.72:0/4208691749 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0740c0ae0 con 0x7fd0740cb9b0 2023-08-31T18:47:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.192+0000 7fd072ffd700 1 --2- 172.21.15.72:0/4208691749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0740cb9b0 0x7fd0741583e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fd074083190 tx=0x7fd068009060).ready entity=mon.1 client_cookie=3fa880fa20b63c82 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.192+0000 7fd0727fc700 1 -- 172.21.15.72:0/4208691749 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06800d4a0 con 0x7fd0740cb9b0 2023-08-31T18:47:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.192+0000 7fd0727fc700 1 -- 172.21.15.72:0/4208691749 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06800d600 con 0x7fd0740cb9b0 2023-08-31T18:47:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.192+0000 7fd0727fc700 1 -- 172.21.15.72:0/4208691749 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06800d980 con 0x7fd0740cb9b0 2023-08-31T18:47:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.193+0000 7fd079bff700 1 -- 172.21.15.72:0/4208691749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0740cb9b0 msgr2=0x7fd0741583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.193+0000 7fd079bff700 1 --2- 172.21.15.72:0/4208691749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0740cb9b0 0x7fd0741583e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fd074083190 tx=0x7fd068009060).stop 2023-08-31T18:47:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.193+0000 7fd079bff700 1 -- 172.21.15.72:0/4208691749 shutdown_connections 2023-08-31T18:47:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.193+0000 7fd079bff700 1 --2- 172.21.15.72:0/4208691749 >> v2:172.21.15.72:3300/0 conn(0x7fd0741588d0 0x7fd074154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.193+0000 7fd079bff700 1 --2- 172.21.15.72:0/4208691749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0740cb9b0 0x7fd0741583e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.193+0000 7fd079bff700 1 -- 172.21.15.72:0/4208691749 >> 172.21.15.72:0/4208691749 conn(0x7fd07405e870 msgr2=0x7fd0740cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.193+0000 7fd079bff700 1 -- 172.21.15.72:0/4208691749 shutdown_connections 2023-08-31T18:47:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.193+0000 7fd079bff700 1 -- 172.21.15.72:0/4208691749 wait complete. 2023-08-31T18:47:37.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.195+0000 7fd079bff700 1 Processor -- start 2023-08-31T18:47:37.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.195+0000 7fd079bff700 1 -- start start 2023-08-31T18:47:37.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.196+0000 7fd079bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0740cb9b0 0x7fd074163520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:37.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd079bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd074154060 0x7fd0740c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:37.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd079bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0741588d0 0x7fd074159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:37.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd079bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd074159130 con 0x7fd074154060 2023-08-31T18:47:37.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd079bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd074151190 con 0x7fd0740cb9b0 2023-08-31T18:47:37.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd079bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0741513e0 con 0x7fd0741588d0 2023-08-31T18:47:37.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd072ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd074154060 0x7fd0740c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:37.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd072ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd074154060 0x7fd0740c28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55204/0 (socket says 172.21.15.72:55204) 2023-08-31T18:47:37.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd072ffd700 1 -- 172.21.15.72:0/3722632104 learned_addr learned my addr 172.21.15.72:0/3722632104 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:37.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd0737fe700 1 --2- 172.21.15.72:0/3722632104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0740cb9b0 0x7fd074163520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:37.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd073fff700 1 --2- 172.21.15.72:0/3722632104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0741588d0 0x7fd074159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:37.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd072ffd700 1 -- 172.21.15.72:0/3722632104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0741588d0 msgr2=0x7fd074159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:37.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd072ffd700 1 --2- 172.21.15.72:0/3722632104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0741588d0 0x7fd074159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:37.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd072ffd700 1 -- 172.21.15.72:0/3722632104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0740cb9b0 msgr2=0x7fd074163520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:37.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd072ffd700 1 --2- 172.21.15.72:0/3722632104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0740cb9b0 0x7fd074163520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:37.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd072ffd700 1 -- 172.21.15.72:0/3722632104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0680092a0 con 0x7fd074154060 2023-08-31T18:47:37.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.197+0000 7fd072ffd700 1 --2- 172.21.15.72:0/3722632104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd074154060 0x7fd0740c28b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd068009d20 tx=0x7fd068016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:37.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.198+0000 7fd05b7fe700 1 -- 172.21.15.72:0/3722632104 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06800dd30 con 0x7fd074154060 2023-08-31T18:47:37.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.198+0000 7fd05b7fe700 1 -- 172.21.15.72:0/3722632104 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06800de90 con 0x7fd074154060 2023-08-31T18:47:37.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.198+0000 7fd05b7fe700 1 -- 172.21.15.72:0/3722632104 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06800d9c0 con 0x7fd074154060 2023-08-31T18:47:37.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.198+0000 7fd079bff700 1 -- 172.21.15.72:0/3722632104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0741516c0 con 0x7fd074154060 2023-08-31T18:47:37.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.198+0000 7fd079bff700 1 -- 172.21.15.72:0/3722632104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd074151c80 con 0x7fd074154060 2023-08-31T18:47:37.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.198+0000 7fd05b7fe700 1 -- 172.21.15.72:0/3722632104 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fd06801d640 con 0x7fd074154060 2023-08-31T18:47:37.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.198+0000 7fd05b7fe700 1 -- 172.21.15.72:0/3722632104 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7fd068027b60 con 0x7fd074154060 2023-08-31T18:47:37.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.199+0000 7fd079bff700 1 -- 172.21.15.72:0/3722632104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07406c6b0 con 0x7fd074154060 2023-08-31T18:47:37.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.201+0000 7fd05b7fe700 1 -- 172.21.15.72:0/3722632104 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fd068016070 con 0x7fd074154060 2023-08-31T18:47:37.252 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:37.251+0000 7fde7d226680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T18:47:37.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.271+0000 7fd079bff700 1 -- 172.21.15.72:0/3722632104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0740c0dc0 con 0x7fd074154060 2023-08-31T18:47:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.272+0000 7fd05b7fe700 1 -- 172.21.15.72:0/3722632104 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7fd068027e40 con 0x7fd074154060 2023-08-31T18:47:37.273 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:47:37.273 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":10,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:36.874120+0000","last_up_change":"0.000000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:47:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.273+0000 7fd079bff700 1 -- 172.21.15.72:0/3722632104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd074154060 msgr2=0x7fd0740c28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.273+0000 7fd079bff700 1 --2- 172.21.15.72:0/3722632104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd074154060 0x7fd0740c28b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd068009d20 tx=0x7fd068016000).stop 2023-08-31T18:47:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.273+0000 7fd079bff700 1 -- 172.21.15.72:0/3722632104 shutdown_connections 2023-08-31T18:47:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.273+0000 7fd079bff700 1 --2- 172.21.15.72:0/3722632104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0741588d0 0x7fd074159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:37.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.273+0000 7fd079bff700 1 --2- 172.21.15.72:0/3722632104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0740cb9b0 0x7fd074163520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:37.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.273+0000 7fd079bff700 1 --2- 172.21.15.72:0/3722632104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd074154060 0x7fd0740c28b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:37.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.273+0000 7fd079bff700 1 -- 172.21.15.72:0/3722632104 >> 172.21.15.72:0/3722632104 conn(0x7fd07405e870 msgr2=0x7fd074063090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:37.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.273+0000 7fd079bff700 1 -- 172.21.15.72:0/3722632104 shutdown_connections 2023-08-31T18:47:37.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:37.273+0000 7fd079bff700 1 -- 172.21.15.72:0/3722632104 wait complete. 2023-08-31T18:47:37.290 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-31T18:47:37.291 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-31T18:47:37.602 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-08-31T18:47:37.602+0000 7feb63466200 -1 Falling back to public interface 2023-08-31T18:47:37.639 INFO:tasks.ceph.osd.5.smithi146.stderr:2023-08-31T18:47:37.639+0000 7f2751804200 -1 Falling back to public interface 2023-08-31T18:47:37.639 INFO:tasks.ceph.osd.7.smithi146.stderr:2023-08-31T18:47:37.639+0000 7f8802406200 -1 Falling back to public interface 2023-08-31T18:47:37.643 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-08-31T18:47:37.643+0000 7fb0a5140200 -1 Falling back to public interface 2023-08-31T18:47:37.643 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-08-31T18:47:37.643+0000 7f57f4cca200 -1 Falling back to public interface 2023-08-31T18:47:37.648 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-08-31T18:47:37.648+0000 7f1cd77ad200 -1 Falling back to public interface 2023-08-31T18:47:37.665 INFO:tasks.ceph.osd.4.smithi146.stderr:2023-08-31T18:47:37.665+0000 7f6e11bf1200 -1 Falling back to public interface 2023-08-31T18:47:37.665 INFO:tasks.ceph.osd.6.smithi146.stderr:2023-08-31T18:47:37.665+0000 7facb2ebc200 -1 Falling back to public interface 2023-08-31T18:47:37.923 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:37.922+0000 7fda3690f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T18:47:38.011 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:38.011+0000 7fda3690f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T18:47:38.092 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:38.092+0000 7fde7d226680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T18:47:38.097 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-31T18:47:38.107 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:38.107+0000 7fda3690f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T18:47:38.178 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:38.178+0000 7fde7d226680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T18:47:38.266 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.266+0000 7fd4365ff700 1 Processor -- start 2023-08-31T18:47:38.267 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.266+0000 7fd4365ff700 1 -- start start 2023-08-31T18:47:38.269 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.268+0000 7fd4365ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd4301583f0 0x7fd43015ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:38.269 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.268+0000 7fd4365ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd430063be0 con 0x7fd4300c4740 2023-08-31T18:47:38.269 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.268+0000 7fd4365ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd430063010 con 0x7fd4300c6c30 2023-08-31T18:47:38.269 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.268+0000 7fd4365ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4300bca10 con 0x7fd4301583f0 2023-08-31T18:47:38.270 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.268+0000 7fd42f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd4300c4740 0x7fd430157ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52058/0 (socket says 172.21.15.72:52058) 2023-08-31T18:47:38.270 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.268+0000 7fd42f7fe700 1 -- 172.21.15.72:0/2534643083 learned_addr learned my addr 172.21.15.72:0/2534643083 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:47:38.270 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.268+0000 7fd434b9c700 1 --2- 172.21.15.72:0/2534643083 >> v2:172.21.15.146:3300/0 conn(0x7fd4301583f0 0x7fd43015ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:38.270 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.269+0000 7fd42effd700 1 -- 172.21.15.72:0/2534643083 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048104008 0 0) 0x7fd430063be0 con 0x7fd4300c4740 2023-08-31T18:47:38.270 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.269+0000 7fd42effd700 1 -- 172.21.15.72:0/2534643083 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4180033f0 con 0x7fd4300c4740 2023-08-31T18:47:38.271 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.269+0000 7fd434b9c700 1 -- 172.21.15.72:0/2534643083 >> v1:172.21.15.146:6789/0 conn(0x7fd4300c6c30 legacy=0x7fd4300bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:38.271 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.269+0000 7fd42effd700 1 -- 172.21.15.72:0/2534643083 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941930713 0 0) 0x7fd430063010 con 0x7fd4300c6c30 2023-08-31T18:47:38.271 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.269+0000 7fd434b9c700 1 -- 172.21.15.72:0/2534643083 >> v1:172.21.15.72:6789/0 conn(0x7fd4300c4740 legacy=0x7fd430157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:38.271 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.269+0000 7fd434b9c700 1 -- 172.21.15.72:0/2534643083 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4300632b0 con 0x7fd4301583f0 2023-08-31T18:47:38.271 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.269+0000 7fd434b9c700 1 --2- 172.21.15.72:0/2534643083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4301583f0 0x7fd43015ee70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fd428009e60 tx=0x7fd428009780).ready entity=mon.1 client_cookie=76e21d50925e6cf5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:38.275 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.269+0000 7fd42effd700 1 -- 172.21.15.72:0/2534643083 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42800e070 con 0x7fd4301583f0 2023-08-31T18:47:38.275 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.269+0000 7fd42effd700 1 -- 172.21.15.72:0/2534643083 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42800bb60 con 0x7fd4301583f0 2023-08-31T18:47:38.275 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.269+0000 7fd42effd700 1 -- 172.21.15.72:0/2534643083 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42800bee0 con 0x7fd4301583f0 2023-08-31T18:47:38.275 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.270+0000 7fd4365ff700 1 -- 172.21.15.72:0/2534643083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4301583f0 msgr2=0x7fd43015ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:38.275 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.270+0000 7fd4365ff700 1 --2- 172.21.15.72:0/2534643083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4301583f0 0x7fd43015ee70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fd428009e60 tx=0x7fd428009780).stop 2023-08-31T18:47:38.276 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.270+0000 7fd4365ff700 1 -- 172.21.15.72:0/2534643083 shutdown_connections 2023-08-31T18:47:38.276 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.270+0000 7fd4365ff700 1 --2- 172.21.15.72:0/2534643083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4301583f0 0x7fd43015ee70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:38.276 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.270+0000 7fd4365ff700 1 -- 172.21.15.72:0/2534643083 >> 172.21.15.72:0/2534643083 conn(0x7fd4300c7e70 msgr2=0x7fd4300c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:38.276 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.270+0000 7fd4365ff700 1 -- 172.21.15.72:0/2534643083 shutdown_connections 2023-08-31T18:47:38.276 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.270+0000 7fd4365ff700 1 -- 172.21.15.72:0/2534643083 wait complete. 2023-08-31T18:47:38.277 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.271+0000 7fd4365ff700 1 Processor -- start 2023-08-31T18:47:38.277 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.272+0000 7fd4365ff700 1 -- start start 2023-08-31T18:47:38.277 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.272+0000 7fd4365ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4300c4740 0x7fd430151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:38.277 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.272+0000 7fd4365ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4300c6c30 0x7fd4300a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:38.278 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.272+0000 7fd4365ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4301583f0 0x7fd4300a64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:38.278 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.272+0000 7fd4365ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300a69d0 con 0x7fd4300c6c30 2023-08-31T18:47:38.278 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.273+0000 7fd4365ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd430137ef0 con 0x7fd4301583f0 2023-08-31T18:47:38.278 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.273+0000 7fd4365ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300a8650 con 0x7fd4300c4740 2023-08-31T18:47:38.278 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.273+0000 7fd42f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4300c6c30 0x7fd4300a5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:38.279 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.273+0000 7fd42f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4300c6c30 0x7fd4300a5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55220/0 (socket says 172.21.15.72:55220) 2023-08-31T18:47:38.279 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.273+0000 7fd42f7fe700 1 -- 172.21.15.72:0/4012394325 learned_addr learned my addr 172.21.15.72:0/4012394325 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:38.279 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.273+0000 7fd434b9c700 1 --2- 172.21.15.72:0/4012394325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4301583f0 0x7fd4300a64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:38.279 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.273+0000 7fd42ffff700 1 --2- 172.21.15.72:0/4012394325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4300c4740 0x7fd430151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:38.279 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.273+0000 7fd42f7fe700 1 -- 172.21.15.72:0/4012394325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4300c4740 msgr2=0x7fd430151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:38.280 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.273+0000 7fd42f7fe700 1 --2- 172.21.15.72:0/4012394325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4300c4740 0x7fd430151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:38.280 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.273+0000 7fd42f7fe700 1 -- 172.21.15.72:0/4012394325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4301583f0 msgr2=0x7fd4300a64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:38.280 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.273+0000 7fd42f7fe700 1 --2- 172.21.15.72:0/4012394325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4301583f0 0x7fd4300a64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:38.280 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.273+0000 7fd42f7fe700 1 -- 172.21.15.72:0/4012394325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd428009a20 con 0x7fd4300c6c30 2023-08-31T18:47:38.280 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.273+0000 7fd434b9c700 1 --2- 172.21.15.72:0/4012394325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4301583f0 0x7fd4300a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:47:38.281 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.273+0000 7fd42f7fe700 1 --2- 172.21.15.72:0/4012394325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4300c6c30 0x7fd4300a5ff0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fd42400c410 tx=0x7fd424007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:38.281 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.274+0000 7fd417fff700 1 -- 172.21.15.72:0/4012394325 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4240070d0 con 0x7fd4300c6c30 2023-08-31T18:47:38.281 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.274+0000 7fd417fff700 1 -- 172.21.15.72:0/4012394325 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd424007230 con 0x7fd4300c6c30 2023-08-31T18:47:38.281 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.274+0000 7fd4365ff700 1 -- 172.21.15.72:0/4012394325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4300a8930 con 0x7fd4300c6c30 2023-08-31T18:47:38.281 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.274+0000 7fd417fff700 1 -- 172.21.15.72:0/4012394325 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4240075d0 con 0x7fd4300c6c30 2023-08-31T18:47:38.282 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.274+0000 7fd4365ff700 1 -- 172.21.15.72:0/4012394325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4300a8ef0 con 0x7fd4300c6c30 2023-08-31T18:47:38.282 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.274+0000 7fd417fff700 1 -- 172.21.15.72:0/4012394325 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fd424005c10 con 0x7fd4300c6c30 2023-08-31T18:47:38.282 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.274+0000 7fd417fff700 1 -- 172.21.15.72:0/4012394325 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7fd424013450 con 0x7fd4300c6c30 2023-08-31T18:47:38.283 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:38.279+0000 7fde7d226680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T18:47:38.283 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.275+0000 7fd4365ff700 1 -- 172.21.15.72:0/4012394325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43006c6b0 con 0x7fd4300c6c30 2023-08-31T18:47:38.283 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.277+0000 7fd417fff700 1 -- 172.21.15.72:0/4012394325 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fd424013860 con 0x7fd4300c6c30 2023-08-31T18:47:38.302 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:38.302+0000 7fda3690f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T18:47:38.347 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.347+0000 7fd4365ff700 1 -- 172.21.15.72:0/4012394325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd430069480 con 0x7fd4300c6c30 2023-08-31T18:47:38.348 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.348+0000 7fd417fff700 1 -- 172.21.15.72:0/4012394325 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7fd424013a00 con 0x7fd4300c6c30 2023-08-31T18:47:38.348 INFO:teuthology.misc.health.smithi072.stdout: 2023-08-31T18:47:38.348 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":10,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:36.874120+0000","last_up_change":"0.000000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:47:38.349 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.349+0000 7fd4365ff700 1 -- 172.21.15.72:0/4012394325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4300c6c30 msgr2=0x7fd4300a5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:38.350 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.349+0000 7fd4365ff700 1 --2- 172.21.15.72:0/4012394325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4300c6c30 0x7fd4300a5ff0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fd42400c410 tx=0x7fd424007c70).stop 2023-08-31T18:47:38.350 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.349+0000 7fd4365ff700 1 -- 172.21.15.72:0/4012394325 shutdown_connections 2023-08-31T18:47:38.350 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.349+0000 7fd4365ff700 1 --2- 172.21.15.72:0/4012394325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4301583f0 0x7fd4300a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:38.350 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.349+0000 7fd4365ff700 1 --2- 172.21.15.72:0/4012394325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4300c4740 0x7fd430151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:38.351 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.349+0000 7fd4365ff700 1 --2- 172.21.15.72:0/4012394325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4300c6c30 0x7fd4300a5ff0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:38.351 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.349+0000 7fd4365ff700 1 -- 172.21.15.72:0/4012394325 >> 172.21.15.72:0/4012394325 conn(0x7fd4300c7e70 msgr2=0x7fd4300689d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:38.351 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.349+0000 7fd4365ff700 1 -- 172.21.15.72:0/4012394325 shutdown_connections 2023-08-31T18:47:38.351 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:38.349+0000 7fd4365ff700 1 -- 172.21.15.72:0/4012394325 wait complete. 2023-08-31T18:47:38.363 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-31T18:47:38.395 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:38.395+0000 7fda3690f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T18:47:38.466 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:38.466+0000 7fde7d226680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T18:47:38.538 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:38.538+0000 7fda3690f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T18:47:38.560 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:38.560+0000 7fde7d226680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T18:47:38.666 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:38.666+0000 7fda3690f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T18:47:38.703 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:38.703+0000 7fde7d226680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T18:47:38.839 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:38.838+0000 7fde7d226680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T18:47:39.056 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:39.056+0000 7fda3690f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T18:47:39.144 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:39.143+0000 7fda3690f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T18:47:39.227 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:39.227+0000 7fde7d226680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T18:47:39.319 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:47:39.319+0000 7fde7d226680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T18:47:40.164 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:40.164+0000 7fd9e65fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-31T18:47:40.164 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:47:40.164+0000 7fd9e65fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-31T18:47:41.367 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-08-31T18:47:41.367+0000 7feb63466200 -1 osd.0 0 log_to_monitors {default=true} 2023-08-31T18:47:41.390 INFO:tasks.ceph.osd.5.smithi146.stderr:2023-08-31T18:47:41.390+0000 7f2751804200 -1 osd.5 0 log_to_monitors {default=true} 2023-08-31T18:47:41.415 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-08-31T18:47:41.415+0000 7f57f4cca200 -1 osd.1 0 log_to_monitors {default=true} 2023-08-31T18:47:41.459 INFO:tasks.ceph.osd.7.smithi146.stderr:2023-08-31T18:47:41.459+0000 7f8802406200 -1 osd.7 0 log_to_monitors {default=true} 2023-08-31T18:47:41.472 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-08-31T18:47:41.472+0000 7fb0a5140200 -1 osd.3 0 log_to_monitors {default=true} 2023-08-31T18:47:41.474 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-08-31T18:47:41.474+0000 7f1cd77ad200 -1 osd.2 0 log_to_monitors {default=true} 2023-08-31T18:47:41.499 INFO:tasks.ceph.osd.6.smithi146.stderr:2023-08-31T18:47:41.499+0000 7facb2ebc200 -1 osd.6 0 log_to_monitors {default=true} 2023-08-31T18:47:41.501 INFO:tasks.ceph.osd.4.smithi146.stderr:2023-08-31T18:47:41.502+0000 7f6e11bf1200 -1 osd.4 0 log_to_monitors {default=true} 2023-08-31T18:47:43.270 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-08-31T18:47:43.269+0000 7f57e83f6700 -1 osd.1 0 waiting for initial osdmap 2023-08-31T18:47:43.270 INFO:tasks.ceph.osd.5.smithi146.stderr:2023-08-31T18:47:43.269+0000 7f2744df6700 -1 osd.5 0 waiting for initial osdmap 2023-08-31T18:47:43.271 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-08-31T18:47:43.270+0000 7feb56bf6700 -1 osd.0 0 waiting for initial osdmap 2023-08-31T18:47:43.271 INFO:tasks.ceph.osd.6.smithi146.stderr:2023-08-31T18:47:43.270+0000 7faca65f6700 -1 osd.6 0 waiting for initial osdmap 2023-08-31T18:47:43.271 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-08-31T18:47:43.270+0000 7f1ccadf6700 -1 osd.2 0 waiting for initial osdmap 2023-08-31T18:47:43.272 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-08-31T18:47:43.271+0000 7fb0987f6700 -1 osd.3 0 waiting for initial osdmap 2023-08-31T18:47:43.272 INFO:tasks.ceph.osd.4.smithi146.stderr:2023-08-31T18:47:43.271+0000 7f6e051f6700 -1 osd.4 0 waiting for initial osdmap 2023-08-31T18:47:43.272 INFO:tasks.ceph.osd.7.smithi146.stderr:2023-08-31T18:47:43.271+0000 7f87f59f6700 -1 osd.7 0 waiting for initial osdmap 2023-08-31T18:47:43.279 INFO:tasks.ceph.osd.5.smithi146.stderr:2023-08-31T18:47:43.279+0000 7f27411fa700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T18:47:43.280 INFO:tasks.ceph.osd.7.smithi146.stderr:2023-08-31T18:47:43.280+0000 7f87f1dfa700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T18:47:43.281 INFO:tasks.ceph.osd.4.smithi146.stderr:2023-08-31T18:47:43.280+0000 7f6e015fa700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T18:47:43.282 INFO:tasks.ceph.osd.6.smithi146.stderr:2023-08-31T18:47:43.280+0000 7faca29fa700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T18:47:43.284 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-08-31T18:47:43.284+0000 7f57e47fa700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T18:47:43.285 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-08-31T18:47:43.284+0000 7f1cc71fa700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T18:47:43.285 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-08-31T18:47:43.284+0000 7fb094bfa700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T18:47:43.287 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-08-31T18:47:43.287+0000 7feb52ffa700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T18:47:45.170 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-31T18:47:45.350 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.350+0000 7f94b3dff700 1 Processor -- start 2023-08-31T18:47:45.353 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.350+0000 7f94b3dff700 1 -- start start 2023-08-31T18:47:45.355 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.351+0000 7f94b3dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94ac0aa290 0x7f94ac156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:45.356 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.351+0000 7f94b3dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f94ac1574b0 0x7f94ac0c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:45.356 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.351+0000 7f94b3dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac0bfd00 con 0x7f94ac0a9eb0 2023-08-31T18:47:45.356 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.351+0000 7f94b3dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac0c05a0 con 0x7f94ac0aa290 2023-08-31T18:47:45.356 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.351+0000 7f94b3dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac0aaea0 con 0x7f94ac1574b0 2023-08-31T18:47:45.356 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.352+0000 7f94b139a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94ac0aa290 0x7f94ac156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:45.357 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.352+0000 7f94b139a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94ac0aa290 0x7f94ac156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60222/0 (socket says 172.21.15.72:60222) 2023-08-31T18:47:45.357 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.352+0000 7f94b139a700 1 -- 172.21.15.72:0/3386000056 learned_addr learned my addr 172.21.15.72:0/3386000056 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:45.357 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.352+0000 7f94b1b9b700 1 --1- 172.21.15.72:0/3386000056 >> v1:172.21.15.72:6789/0 conn(0x7f94ac0a9eb0 0x7f94ac0c5bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37684/0 (socket says 172.21.15.72:37684) 2023-08-31T18:47:45.357 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.352+0000 7f94b139a700 1 -- 172.21.15.72:0/3386000056 >> v2:172.21.15.146:3300/0 conn(0x7f94ac1574b0 msgr2=0x7f94ac0c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:45.357 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.352+0000 7f94b239c700 1 --2- 172.21.15.72:0/3386000056 >> v2:172.21.15.146:3300/0 conn(0x7f94ac1574b0 0x7f94ac0c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:45.358 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.352+0000 7f94b139a700 1 --2- 172.21.15.72:0/3386000056 >> v2:172.21.15.146:3300/0 conn(0x7f94ac1574b0 0x7f94ac0c0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:45.358 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.352+0000 7f94b0b99700 1 -- 172.21.15.72:0/3386000056 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551958034 0 0) 0x7f94ac0bfd00 con 0x7f94ac0a9eb0 2023-08-31T18:47:45.358 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.352+0000 7f94b139a700 1 -- 172.21.15.72:0/3386000056 >> v1:172.21.15.72:6789/0 conn(0x7f94ac0a9eb0 legacy=0x7f94ac0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:45.358 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.352+0000 7f94b139a700 1 -- 172.21.15.72:0/3386000056 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac0c6670 con 0x7f94ac0aa290 2023-08-31T18:47:45.359 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.352+0000 7f94b239c700 1 --2- 172.21.15.72:0/3386000056 >> v2:172.21.15.146:3300/0 conn(0x7f94ac1574b0 0x7f94ac0c0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:47:45.359 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.352+0000 7f94b139a700 1 --2- 172.21.15.72:0/3386000056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94ac0aa290 0x7f94ac156fc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f94ac0c69d0 tx=0x7f949c0090f0).ready entity=mon.0 client_cookie=e4017240a5e5c428 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:45.359 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.352+0000 7f94b0b99700 1 -- 172.21.15.72:0/3386000056 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c00b600 con 0x7f94ac0aa290 2023-08-31T18:47:45.359 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.352+0000 7f94b0b99700 1 -- 172.21.15.72:0/3386000056 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c00b760 con 0x7f94ac0aa290 2023-08-31T18:47:45.359 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.352+0000 7f94b0b99700 1 -- 172.21.15.72:0/3386000056 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c00bae0 con 0x7f94ac0aa290 2023-08-31T18:47:45.360 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.353+0000 7f94b3dff700 1 -- 172.21.15.72:0/3386000056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94ac0aa290 msgr2=0x7f94ac156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:45.360 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.353+0000 7f94b3dff700 1 --2- 172.21.15.72:0/3386000056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94ac0aa290 0x7f94ac156fc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f94ac0c69d0 tx=0x7f949c0090f0).stop 2023-08-31T18:47:45.360 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.353+0000 7f94b3dff700 1 -- 172.21.15.72:0/3386000056 shutdown_connections 2023-08-31T18:47:45.360 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.353+0000 7f94b3dff700 1 --2- 172.21.15.72:0/3386000056 >> v2:172.21.15.146:3300/0 conn(0x7f94ac1574b0 0x7f94ac0c0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:45.360 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.353+0000 7f94b3dff700 1 --2- 172.21.15.72:0/3386000056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94ac0aa290 0x7f94ac156fc0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:45.361 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.353+0000 7f94b3dff700 1 -- 172.21.15.72:0/3386000056 >> 172.21.15.72:0/3386000056 conn(0x7f94ac0c82e0 msgr2=0x7f94ac05e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:45.361 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.353+0000 7f94b3dff700 1 -- 172.21.15.72:0/3386000056 shutdown_connections 2023-08-31T18:47:45.361 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.353+0000 7f94b3dff700 1 -- 172.21.15.72:0/3386000056 wait complete. 2023-08-31T18:47:45.361 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.355+0000 7f94b3dff700 1 Processor -- start 2023-08-31T18:47:45.361 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.355+0000 7f94b3dff700 1 -- start start 2023-08-31T18:47:45.364 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b3dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94ac0a9eb0 0x7f94ac1652f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:45.364 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b3dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94ac0aa290 0x7f94ac1449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:45.364 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b3dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94ac1574b0 0x7f94ac155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:45.364 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b3dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac153e60 con 0x7f94ac0aa290 2023-08-31T18:47:45.364 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b3dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac152f70 con 0x7f94ac1574b0 2023-08-31T18:47:45.365 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b3dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac153250 con 0x7f94ac0a9eb0 2023-08-31T18:47:45.365 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94ac0aa290 0x7f94ac1449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:45.365 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94ac0aa290 0x7f94ac1449d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60224/0 (socket says 172.21.15.72:60224) 2023-08-31T18:47:45.365 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b139a700 1 -- 172.21.15.72:0/4293817500 learned_addr learned my addr 172.21.15.72:0/4293817500 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:45.365 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b1b9b700 1 --2- 172.21.15.72:0/4293817500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94ac0a9eb0 0x7f94ac1652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:45.366 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b239c700 1 --2- 172.21.15.72:0/4293817500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94ac1574b0 0x7f94ac155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:45.366 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b139a700 1 -- 172.21.15.72:0/4293817500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94ac0a9eb0 msgr2=0x7f94ac1652f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:45.366 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b139a700 1 --2- 172.21.15.72:0/4293817500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94ac0a9eb0 0x7f94ac1652f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:45.366 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b139a700 1 -- 172.21.15.72:0/4293817500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94ac1574b0 msgr2=0x7f94ac155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:45.367 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b139a700 1 --2- 172.21.15.72:0/4293817500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94ac1574b0 0x7f94ac155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:45.367 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b139a700 1 -- 172.21.15.72:0/4293817500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c009370 con 0x7f94ac0aa290 2023-08-31T18:47:45.367 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.357+0000 7f94b139a700 1 --2- 172.21.15.72:0/4293817500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94ac0aa290 0x7f94ac1449d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f94ac083960 tx=0x7f949c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:45.367 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.358+0000 7f94a1ffb700 1 -- 172.21.15.72:0/4293817500 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c00bae0 con 0x7f94ac0aa290 2023-08-31T18:47:45.367 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.358+0000 7f94a1ffb700 1 -- 172.21.15.72:0/4293817500 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c000c90 con 0x7f94ac0aa290 2023-08-31T18:47:45.368 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.358+0000 7f94b3dff700 1 -- 172.21.15.72:0/4293817500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ac153530 con 0x7f94ac0aa290 2023-08-31T18:47:45.368 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.358+0000 7f94a1ffb700 1 -- 172.21.15.72:0/4293817500 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c01c650 con 0x7f94ac0aa290 2023-08-31T18:47:45.368 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.358+0000 7f94b3dff700 1 -- 172.21.15.72:0/4293817500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ac153af0 con 0x7f94ac0aa290 2023-08-31T18:47:45.368 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.359+0000 7f94b3dff700 1 -- 172.21.15.72:0/4293817500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ac06c6b0 con 0x7f94ac0aa290 2023-08-31T18:47:45.368 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.360+0000 7f94a1ffb700 1 -- 172.21.15.72:0/4293817500 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f949c01ca40 con 0x7f94ac0aa290 2023-08-31T18:47:45.368 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.361+0000 7f94a1ffb700 1 --2- 172.21.15.72:0/4293817500 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f949005ee10 0x7f94900612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:45.369 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.361+0000 7f94a1ffb700 1 -- 172.21.15.72:0/4293817500 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7f949c07b7b0 con 0x7f94ac0aa290 2023-08-31T18:47:45.369 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.361+0000 7f94b1b9b700 1 --2- 172.21.15.72:0/4293817500 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f949005ee10 0x7f94900612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:45.369 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.362+0000 7f94b1b9b700 1 --2- 172.21.15.72:0/4293817500 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f949005ee10 0x7f94900612d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f94a80011e0 tx=0x7f94a8007180).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:45.370 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.366+0000 7f94a1ffb700 1 -- 172.21.15.72:0/4293817500 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f949c04d030 con 0x7f94ac0aa290 2023-08-31T18:47:45.536 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.536+0000 7f94b3dff700 1 -- 172.21.15.72:0/4293817500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94ac153fa0 con 0x7f94ac0aa290 2023-08-31T18:47:45.537 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.537+0000 7f94a1ffb700 1 -- 172.21.15.72:0/4293817500 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+12276 (secure 0 0 0) 0x7f949c02a070 con 0x7f94ac0aa290 2023-08-31T18:47:45.538 INFO:teuthology.misc.health.smithi072.stdout: 2023-08-31T18:47:45.538 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":14,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:45.278876+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:47:45.540 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.539+0000 7f94b3dff700 1 -- 172.21.15.72:0/4293817500 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f949005ee10 msgr2=0x7f94900612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:45.540 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.539+0000 7f94b3dff700 1 --2- 172.21.15.72:0/4293817500 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f949005ee10 0x7f94900612d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f94a80011e0 tx=0x7f94a8007180).stop 2023-08-31T18:47:45.540 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.539+0000 7f94b3dff700 1 -- 172.21.15.72:0/4293817500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94ac0aa290 msgr2=0x7f94ac1449d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:45.540 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.539+0000 7f94b3dff700 1 --2- 172.21.15.72:0/4293817500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94ac0aa290 0x7f94ac1449d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f94ac083960 tx=0x7f949c017000).stop 2023-08-31T18:47:45.540 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.539+0000 7f94b3dff700 1 -- 172.21.15.72:0/4293817500 shutdown_connections 2023-08-31T18:47:45.541 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.539+0000 7f94b3dff700 1 --2- 172.21.15.72:0/4293817500 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f949005ee10 0x7f94900612d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:45.541 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.539+0000 7f94b3dff700 1 --2- 172.21.15.72:0/4293817500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94ac1574b0 0x7f94ac155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:45.541 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.539+0000 7f94b3dff700 1 --2- 172.21.15.72:0/4293817500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94ac0a9eb0 0x7f94ac1652f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:45.542 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.539+0000 7f94b3dff700 1 --2- 172.21.15.72:0/4293817500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94ac0aa290 0x7f94ac1449d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:45.542 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.539+0000 7f94b3dff700 1 -- 172.21.15.72:0/4293817500 >> 172.21.15.72:0/4293817500 conn(0x7f94ac0c82e0 msgr2=0x7f94ac0ab280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:45.542 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.539+0000 7f94b3dff700 1 -- 172.21.15.72:0/4293817500 shutdown_connections 2023-08-31T18:47:45.542 INFO:teuthology.misc.health.smithi072.stderr:2023-08-31T18:47:45.540+0000 7f94b3dff700 1 -- 172.21.15.72:0/4293817500 wait complete. 2023-08-31T18:47:45.558 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-31T18:47:45.559 INFO:tasks.ceph:Creating RBD pool 2023-08-31T18:47:45.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-31T18:47:45.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.739+0000 7f668a9ff700 1 Processor -- start 2023-08-31T18:47:45.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.740+0000 7f668a9ff700 1 -- start start 2023-08-31T18:47:45.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.741+0000 7f668a9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6684153e30 0x7f6684154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:45.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.741+0000 7f668a9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f66840637c0 0x7f66840c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:45.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.741+0000 7f668a9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66840bfd40 con 0x7f66840c5cb0 2023-08-31T18:47:45.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.741+0000 7f668a9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66840c6730 con 0x7f6684153e30 2023-08-31T18:47:45.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.741+0000 7f668a9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66840bffe0 con 0x7f66840637c0 2023-08-31T18:47:45.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.741+0000 7f6683fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6684153e30 0x7f6684154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:45.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.741+0000 7f6683fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6684153e30 0x7f6684154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60232/0 (socket says 172.21.15.72:60232) 2023-08-31T18:47:45.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.741+0000 7f6683fff700 1 -- 172.21.15.72:0/1035170373 learned_addr learned my addr 172.21.15.72:0/1035170373 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:45.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.742+0000 7f6688f9c700 1 --2- 172.21.15.72:0/1035170373 >> v2:172.21.15.146:3300/0 conn(0x7f66840637c0 0x7f66840c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:45.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.742+0000 7f6683fff700 1 -- 172.21.15.72:0/1035170373 >> v2:172.21.15.146:3300/0 conn(0x7f66840637c0 msgr2=0x7f66840c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:45.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.742+0000 7f6683fff700 1 --2- 172.21.15.72:0/1035170373 >> v2:172.21.15.146:3300/0 conn(0x7f66840637c0 0x7f66840c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:45.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.742+0000 7f6683fff700 1 -- 172.21.15.72:0/1035170373 >> v1:172.21.15.146:6789/0 conn(0x7f66840c5cb0 legacy=0x7f66840630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:45.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.742+0000 7f6683fff700 1 -- 172.21.15.72:0/1035170373 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66840c02c0 con 0x7f6684153e30 2023-08-31T18:47:45.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.742+0000 7f6683fff700 1 --2- 172.21.15.72:0/1035170373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6684153e30 0x7f6684154210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6684084380 tx=0x7f66740090f0).ready entity=mon.0 client_cookie=5cf615f0cc5e109e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:45.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.742+0000 7f6682ffd700 1 -- 172.21.15.72:0/1035170373 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667400b600 con 0x7f6684153e30 2023-08-31T18:47:45.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.742+0000 7f6682ffd700 1 -- 172.21.15.72:0/1035170373 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667400b760 con 0x7f6684153e30 2023-08-31T18:47:45.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.742+0000 7f6682ffd700 1 -- 172.21.15.72:0/1035170373 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667400bae0 con 0x7f6684153e30 2023-08-31T18:47:45.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.743+0000 7f668a9ff700 1 -- 172.21.15.72:0/1035170373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6684153e30 msgr2=0x7f6684154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:45.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.743+0000 7f668a9ff700 1 --2- 172.21.15.72:0/1035170373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6684153e30 0x7f6684154210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6684084380 tx=0x7f66740090f0).stop 2023-08-31T18:47:45.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.743+0000 7f668a9ff700 1 -- 172.21.15.72:0/1035170373 shutdown_connections 2023-08-31T18:47:45.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.743+0000 7f668a9ff700 1 --2- 172.21.15.72:0/1035170373 >> v2:172.21.15.146:3300/0 conn(0x7f66840637c0 0x7f66840c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:45.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.743+0000 7f668a9ff700 1 --2- 172.21.15.72:0/1035170373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6684153e30 0x7f6684154210 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:45.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.743+0000 7f668a9ff700 1 -- 172.21.15.72:0/1035170373 >> 172.21.15.72:0/1035170373 conn(0x7f668405eb20 msgr2=0x7f66840cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:45.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.743+0000 7f668a9ff700 1 -- 172.21.15.72:0/1035170373 shutdown_connections 2023-08-31T18:47:45.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.743+0000 7f668a9ff700 1 -- 172.21.15.72:0/1035170373 wait complete. 2023-08-31T18:47:45.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.744+0000 7f668a9ff700 1 Processor -- start 2023-08-31T18:47:45.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.745+0000 7f668a9ff700 1 -- start start 2023-08-31T18:47:45.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.745+0000 7f668a9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66840637c0 0x7f66840c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:45.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.745+0000 7f668a9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66840c5cb0 0x7f66840c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:45.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f668a9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6684153e30 0x7f668414f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:45.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f668a9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6684165050 con 0x7f66840637c0 2023-08-31T18:47:45.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f668a9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6684164470 con 0x7f66840c5cb0 2023-08-31T18:47:45.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f668a9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6684164720 con 0x7f6684153e30 2023-08-31T18:47:45.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f6683fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66840637c0 0x7f66840c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:45.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f6683fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66840637c0 0x7f66840c3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60240/0 (socket says 172.21.15.72:60240) 2023-08-31T18:47:45.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f6683fff700 1 -- 172.21.15.72:0/3615902468 learned_addr learned my addr 172.21.15.72:0/3615902468 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:45.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f6688f9c700 1 --2- 172.21.15.72:0/3615902468 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6684153e30 0x7f668414f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:45.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f6683fff700 1 -- 172.21.15.72:0/3615902468 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6684153e30 msgr2=0x7f668414f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:45.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f66837fe700 1 --2- 172.21.15.72:0/3615902468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66840c5cb0 0x7f66840c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:45.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f6683fff700 1 --2- 172.21.15.72:0/3615902468 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6684153e30 0x7f668414f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:45.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f6683fff700 1 -- 172.21.15.72:0/3615902468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66840c5cb0 msgr2=0x7f66840c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:45.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f6683fff700 1 --2- 172.21.15.72:0/3615902468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66840c5cb0 0x7f66840c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:45.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f6683fff700 1 -- 172.21.15.72:0/3615902468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6674009370 con 0x7f66840637c0 2023-08-31T18:47:45.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f66837fe700 1 --2- 172.21.15.72:0/3615902468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66840c5cb0 0x7f66840c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:47:45.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f6683fff700 1 --2- 172.21.15.72:0/3615902468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66840637c0 0x7f66840c3ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f66840aaee0 tx=0x7f6674017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:45.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.746+0000 7f666bfff700 1 -- 172.21.15.72:0/3615902468 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667400b8d0 con 0x7f66840637c0 2023-08-31T18:47:45.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.747+0000 7f666bfff700 1 -- 172.21.15.72:0/3615902468 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667400ba30 con 0x7f66840637c0 2023-08-31T18:47:45.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.747+0000 7f666bfff700 1 -- 172.21.15.72:0/3615902468 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667401b620 con 0x7f66840637c0 2023-08-31T18:47:45.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.747+0000 7f668a9ff700 1 -- 172.21.15.72:0/3615902468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6684164a00 con 0x7f66840637c0 2023-08-31T18:47:45.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.747+0000 7f668a9ff700 1 -- 172.21.15.72:0/3615902468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66840c43e0 con 0x7f66840637c0 2023-08-31T18:47:45.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.748+0000 7f668a9ff700 1 -- 172.21.15.72:0/3615902468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668406c6b0 con 0x7f66840637c0 2023-08-31T18:47:45.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.748+0000 7f666bfff700 1 -- 172.21.15.72:0/3615902468 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f667401ba10 con 0x7f66840637c0 2023-08-31T18:47:45.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.749+0000 7f666bfff700 1 --2- 172.21.15.72:0/3615902468 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f667005ee10 0x7f66700612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:45.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.749+0000 7f666bfff700 1 -- 172.21.15.72:0/3615902468 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7f667407aea0 con 0x7f66840637c0 2023-08-31T18:47:45.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.749+0000 7f66837fe700 1 --2- 172.21.15.72:0/3615902468 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f667005ee10 0x7f66700612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:45.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.750+0000 7f66837fe700 1 --2- 172.21.15.72:0/3615902468 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f667005ee10 0x7f66700612d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f6684063680 tx=0x7f6678009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:45.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.754+0000 7f666bfff700 1 -- 172.21.15.72:0/3615902468 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f667404c720 con 0x7f66840637c0 2023-08-31T18:47:45.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:45.926+0000 7f668a9ff700 1 -- 172.21.15.72:0/3615902468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f6684062970 con 0x7f66840637c0 2023-08-31T18:47:46.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.288+0000 7f666bfff700 1 -- 172.21.15.72:0/3615902468 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f667404fd40 con 0x7f66840637c0 2023-08-31T18:47:46.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.290+0000 7f668a9ff700 1 -- 172.21.15.72:0/3615902468 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f667005ee10 msgr2=0x7f66700612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:46.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.290+0000 7f668a9ff700 1 --2- 172.21.15.72:0/3615902468 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f667005ee10 0x7f66700612d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f6684063680 tx=0x7f6678009040).stop 2023-08-31T18:47:46.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.290+0000 7f668a9ff700 1 -- 172.21.15.72:0/3615902468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66840637c0 msgr2=0x7f66840c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:46.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.290+0000 7f668a9ff700 1 --2- 172.21.15.72:0/3615902468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66840637c0 0x7f66840c3ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f66840aaee0 tx=0x7f6674017000).stop 2023-08-31T18:47:46.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.290+0000 7f668a9ff700 1 -- 172.21.15.72:0/3615902468 shutdown_connections 2023-08-31T18:47:46.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.290+0000 7f668a9ff700 1 --2- 172.21.15.72:0/3615902468 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6684153e30 0x7f668414f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:46.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.290+0000 7f668a9ff700 1 --2- 172.21.15.72:0/3615902468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66840637c0 0x7f66840c3ef0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:46.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.290+0000 7f668a9ff700 1 --2- 172.21.15.72:0/3615902468 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f667005ee10 0x7f66700612d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:46.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.290+0000 7f668a9ff700 1 --2- 172.21.15.72:0/3615902468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66840c5cb0 0x7f66840c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:46.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.290+0000 7f668a9ff700 1 -- 172.21.15.72:0/3615902468 >> 172.21.15.72:0/3615902468 conn(0x7f668405eb20 msgr2=0x7f66840acab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:46.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.290+0000 7f668a9ff700 1 -- 172.21.15.72:0/3615902468 shutdown_connections 2023-08-31T18:47:46.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.290+0000 7f668a9ff700 1 -- 172.21.15.72:0/3615902468 wait complete. 2023-08-31T18:47:46.293 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'rbd' created 2023-08-31T18:47:46.309 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-31T18:47:46.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.494+0000 7f4599fff700 1 Processor -- start 2023-08-31T18:47:46.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.494+0000 7f4599fff700 1 -- start start 2023-08-31T18:47:46.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.495+0000 7f4599fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4594154120 0x7f45940a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.495+0000 7f4599fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4594154500 0x7f45940646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.495+0000 7f4599fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45940aa620 con 0x7f4594064b90 2023-08-31T18:47:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.495+0000 7f4599fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45940aa3a0 con 0x7f4594154120 2023-08-31T18:47:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.495+0000 7f4599fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4594064ff0 con 0x7f4594154500 2023-08-31T18:47:46.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.496+0000 7f4592ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4594154500 0x7f45940646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:46.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.496+0000 7f45937fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4594154120 0x7f45940a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.496+0000 7f4592ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4594154500 0x7f45940646a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:49966/0 (socket says 172.21.15.72:49966) 2023-08-31T18:47:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.496+0000 7f4593fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4594064b90 0x7f45940c0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:41704/0 (socket says 172.21.15.72:41704) 2023-08-31T18:47:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.496+0000 7f4592ffd700 1 -- 172.21.15.72:0/230471229 learned_addr learned my addr 172.21.15.72:0/230471229 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.496+0000 7f45927fc700 1 -- 172.21.15.72:0/230471229 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340658531 0 0) 0x7f45940aa620 con 0x7f4594064b90 2023-08-31T18:47:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.496+0000 7f45927fc700 1 -- 172.21.15.72:0/230471229 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f457c0033f0 con 0x7f4594064b90 2023-08-31T18:47:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.496+0000 7f45937fe700 1 -- 172.21.15.72:0/230471229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4594154500 msgr2=0x7f45940646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.496+0000 7f45937fe700 1 --2- 172.21.15.72:0/230471229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4594154500 0x7f45940646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.496+0000 7f45937fe700 1 -- 172.21.15.72:0/230471229 >> v1:172.21.15.146:6789/0 conn(0x7f4594064b90 legacy=0x7f45940c0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.496+0000 7f45937fe700 1 -- 172.21.15.72:0/230471229 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45940c5450 con 0x7f4594154120 2023-08-31T18:47:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.496+0000 7f4592ffd700 1 --2- 172.21.15.72:0/230471229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4594154500 0x7f45940646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:47:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.496+0000 7f45937fe700 1 --2- 172.21.15.72:0/230471229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4594154120 0x7f45940a9eb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f4584009760 tx=0x7f4584009060).ready entity=mon.1 client_cookie=3f728f43766db864 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.497+0000 7f45927fc700 1 -- 172.21.15.72:0/230471229 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458400d4a0 con 0x7f4594154120 2023-08-31T18:47:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.497+0000 7f45927fc700 1 -- 172.21.15.72:0/230471229 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458400d600 con 0x7f4594154120 2023-08-31T18:47:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.497+0000 7f45927fc700 1 -- 172.21.15.72:0/230471229 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458400d980 con 0x7f4594154120 2023-08-31T18:47:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.497+0000 7f4599fff700 1 -- 172.21.15.72:0/230471229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4594154120 msgr2=0x7f45940a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.497+0000 7f4599fff700 1 --2- 172.21.15.72:0/230471229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4594154120 0x7f45940a9eb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f4584009760 tx=0x7f4584009060).stop 2023-08-31T18:47:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.497+0000 7f4599fff700 1 -- 172.21.15.72:0/230471229 shutdown_connections 2023-08-31T18:47:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.497+0000 7f4599fff700 1 --2- 172.21.15.72:0/230471229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4594154120 0x7f45940a9eb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.497+0000 7f4599fff700 1 --2- 172.21.15.72:0/230471229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4594154500 0x7f45940646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.497+0000 7f4599fff700 1 -- 172.21.15.72:0/230471229 >> 172.21.15.72:0/230471229 conn(0x7f45940cb7e0 msgr2=0x7f45940c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.497+0000 7f4599fff700 1 -- 172.21.15.72:0/230471229 shutdown_connections 2023-08-31T18:47:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.497+0000 7f4599fff700 1 -- 172.21.15.72:0/230471229 wait complete. 2023-08-31T18:47:46.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.499+0000 7f4599fff700 1 Processor -- start 2023-08-31T18:47:46.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.499+0000 7f4599fff700 1 -- start start 2023-08-31T18:47:46.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.500+0000 7f4599fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4594064b90 0x7f45940b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:46.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.500+0000 7f4599fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4594154120 0x7f4594164300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:46.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.500+0000 7f4599fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4594154500 0x7f45941647f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:46.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.500+0000 7f4599fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45940af530 con 0x7f4594154120 2023-08-31T18:47:46.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.500+0000 7f4599fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45940c2fa0 con 0x7f4594064b90 2023-08-31T18:47:46.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.500+0000 7f4599fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45940aec90 con 0x7f4594154500 2023-08-31T18:47:46.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.500+0000 7f4592ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4594154120 0x7f4594164300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:46.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.500+0000 7f4592ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4594154120 0x7f4594164300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60248/0 (socket says 172.21.15.72:60248) 2023-08-31T18:47:46.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.500+0000 7f4592ffd700 1 -- 172.21.15.72:0/3675629484 learned_addr learned my addr 172.21.15.72:0/3675629484 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:46.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.500+0000 7f45937fe700 1 --2- 172.21.15.72:0/3675629484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4594064b90 0x7f45940b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:46.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.500+0000 7f4593fff700 1 --2- 172.21.15.72:0/3675629484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4594154500 0x7f45941647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:46.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.501+0000 7f4592ffd700 1 -- 172.21.15.72:0/3675629484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4594154500 msgr2=0x7f45941647f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:46.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.501+0000 7f4592ffd700 1 --2- 172.21.15.72:0/3675629484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4594154500 0x7f45941647f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:46.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.501+0000 7f4592ffd700 1 -- 172.21.15.72:0/3675629484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4594064b90 msgr2=0x7f45940b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:46.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.501+0000 7f4592ffd700 1 --2- 172.21.15.72:0/3675629484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4594064b90 0x7f45940b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:46.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.501+0000 7f4592ffd700 1 -- 172.21.15.72:0/3675629484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4588009370 con 0x7f4594154120 2023-08-31T18:47:46.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.501+0000 7f4593fff700 1 --2- 172.21.15.72:0/3675629484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4594154500 0x7f45941647f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:47:46.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.501+0000 7f4592ffd700 1 --2- 172.21.15.72:0/3675629484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4594154120 0x7f4594164300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f458800ea80 tx=0x7f45880090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:46.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.501+0000 7f457b7fe700 1 -- 172.21.15.72:0/3675629484 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45880095d0 con 0x7f4594154120 2023-08-31T18:47:46.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.501+0000 7f457b7fe700 1 -- 172.21.15.72:0/3675629484 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458800c7f0 con 0x7f4594154120 2023-08-31T18:47:46.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.501+0000 7f4599fff700 1 -- 172.21.15.72:0/3675629484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45840092a0 con 0x7f4594154120 2023-08-31T18:47:46.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.501+0000 7f457b7fe700 1 -- 172.21.15.72:0/3675629484 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458800cb70 con 0x7f4594154120 2023-08-31T18:47:46.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.501+0000 7f4599fff700 1 -- 172.21.15.72:0/3675629484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45940af250 con 0x7f4594154120 2023-08-31T18:47:46.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.502+0000 7f4599fff700 1 -- 172.21.15.72:0/3675629484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459406a7e0 con 0x7f4594154120 2023-08-31T18:47:46.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.503+0000 7f457b7fe700 1 -- 172.21.15.72:0/3675629484 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f458801b400 con 0x7f4594154120 2023-08-31T18:47:46.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.504+0000 7f457b7fe700 1 --2- 172.21.15.72:0/3675629484 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f458005ee10 0x7f45800612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:46.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.504+0000 7f457b7fe700 1 -- 172.21.15.72:0/3675629484 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5258+0+0 (secure 0 0 0) 0x7f4588079fd0 con 0x7f4594154120 2023-08-31T18:47:46.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.504+0000 7f45937fe700 1 --2- 172.21.15.72:0/3675629484 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f458005ee10 0x7f45800612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:46.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.505+0000 7f45937fe700 1 --2- 172.21.15.72:0/3675629484 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f458005ee10 0x7f45800612d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f459414c3e0 tx=0x7f4584016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:46.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.509+0000 7f457b7fe700 1 -- 172.21.15.72:0/3675629484 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f458804b740 con 0x7f4594154120 2023-08-31T18:47:46.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:46.680+0000 7f4599fff700 1 -- 172.21.15.72:0/3675629484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f45940c3130 con 0x7f4594154120 2023-08-31T18:47:47.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.290+0000 7f457b7fe700 1 -- 172.21.15.72:0/3675629484 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4588016070 con 0x7f4594154120 2023-08-31T18:47:47.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.292+0000 7f4599fff700 1 -- 172.21.15.72:0/3675629484 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f458005ee10 msgr2=0x7f45800612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:47.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.292+0000 7f4599fff700 1 --2- 172.21.15.72:0/3675629484 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f458005ee10 0x7f45800612d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f459414c3e0 tx=0x7f4584016000).stop 2023-08-31T18:47:47.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.292+0000 7f4599fff700 1 -- 172.21.15.72:0/3675629484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4594154120 msgr2=0x7f4594164300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:47.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.292+0000 7f4599fff700 1 --2- 172.21.15.72:0/3675629484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4594154120 0x7f4594164300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f458800ea80 tx=0x7f45880090f0).stop 2023-08-31T18:47:47.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.292+0000 7f4599fff700 1 -- 172.21.15.72:0/3675629484 shutdown_connections 2023-08-31T18:47:47.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.292+0000 7f4599fff700 1 --2- 172.21.15.72:0/3675629484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4594154500 0x7f45941647f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.292+0000 7f4599fff700 1 --2- 172.21.15.72:0/3675629484 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f458005ee10 0x7f45800612d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.292+0000 7f4599fff700 1 --2- 172.21.15.72:0/3675629484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4594064b90 0x7f45940b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.292+0000 7f4599fff700 1 --2- 172.21.15.72:0/3675629484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4594154120 0x7f4594164300 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.292+0000 7f4599fff700 1 -- 172.21.15.72:0/3675629484 >> 172.21.15.72:0/3675629484 conn(0x7f45940cb7e0 msgr2=0x7f45940c0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:47.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.292+0000 7f4599fff700 1 -- 172.21.15.72:0/3675629484 shutdown_connections 2023-08-31T18:47:47.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.292+0000 7f4599fff700 1 -- 172.21.15.72:0/3675629484 wait complete. 2023-08-31T18:47:47.296 INFO:teuthology.orchestra.run.smithi072.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-31T18:47:47.314 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-31T18:47:47.314 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T18:47:47.315 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T18:47:47.319 INFO:tasks.ceph.mds.a:Started 2023-08-31T18:47:47.320 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T18:47:47.320 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T18:47:47.325 INFO:tasks.ceph.mds.c:Started 2023-08-31T18:47:47.325 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T18:47:47.325 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T18:47:47.330 INFO:tasks.ceph.mds.b:Started 2023-08-31T18:47:47.331 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T18:47:47.331 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T18:47:47.336 INFO:tasks.ceph.mds.d:Started 2023-08-31T18:47:47.337 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-31T18:47:47.337 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:47:47.462 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T18:47:47.469 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-31T18:47:47.478 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-08-31T18:47:47.482 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-08-31T18:47:47.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.538+0000 7f0e77dff700 1 Processor -- start 2023-08-31T18:47:47.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.538+0000 7f0e77dff700 1 -- start start 2023-08-31T18:47:47.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.540+0000 7f0e77dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e70154060 0x7f0e70157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:47.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.540+0000 7f0e77dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0e701588d0 0x7f0e70154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:47.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.540+0000 7f0e77dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e700c6120 con 0x7f0e700cb9b0 2023-08-31T18:47:47.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.540+0000 7f0e77dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e700c1380 con 0x7f0e701588d0 2023-08-31T18:47:47.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.540+0000 7f0e77dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700c5e10 con 0x7f0e70154060 2023-08-31T18:47:47.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.540+0000 7f0e7539a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0e700cb9b0 0x7f0e701581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37710/0 (socket says 172.21.15.72:37710) 2023-08-31T18:47:47.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.541+0000 7f0e7539a700 1 -- 172.21.15.72:0/637404406 learned_addr learned my addr 172.21.15.72:0/637404406 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:47:47.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.541+0000 7f0e75b9b700 1 --2- 172.21.15.72:0/637404406 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e70154060 0x7f0e70157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:47.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.541+0000 7f0e7639c700 1 --2- 172.21.15.72:0/637404406 >> v2:172.21.15.146:3300/0 conn(0x7f0e701588d0 0x7f0e70154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:47.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.541+0000 7f0e74b99700 1 -- 172.21.15.72:0/637404406 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135405515 0 0) 0x7f0e700c6120 con 0x7f0e700cb9b0 2023-08-31T18:47:47.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.541+0000 7f0e74b99700 1 -- 172.21.15.72:0/637404406 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e5c0033f0 con 0x7f0e700cb9b0 2023-08-31T18:47:47.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.541+0000 7f0e7639c700 1 -- 172.21.15.72:0/637404406 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e70154060 msgr2=0x7f0e70157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:47.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.541+0000 7f0e7639c700 1 --2- 172.21.15.72:0/637404406 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e70154060 0x7f0e70157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.541+0000 7f0e7639c700 1 -- 172.21.15.72:0/637404406 >> v1:172.21.15.72:6789/0 conn(0x7f0e700cb9b0 legacy=0x7f0e701581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:47.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.541+0000 7f0e7639c700 1 -- 172.21.15.72:0/637404406 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e700c0ae0 con 0x7f0e701588d0 2023-08-31T18:47:47.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.541+0000 7f0e75b9b700 1 --2- 172.21.15.72:0/637404406 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e70154060 0x7f0e70157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:47:47.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.541+0000 7f0e7639c700 1 --2- 172.21.15.72:0/637404406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e701588d0 0x7f0e70154440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0e68009e60 tx=0x7f0e68009780).ready entity=mon.1 client_cookie=81fd3a3ba8019894 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:47.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.541+0000 7f0e74b99700 1 -- 172.21.15.72:0/637404406 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6800e070 con 0x7f0e701588d0 2023-08-31T18:47:47.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.541+0000 7f0e74b99700 1 -- 172.21.15.72:0/637404406 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6800bab0 con 0x7f0e701588d0 2023-08-31T18:47:47.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.541+0000 7f0e74b99700 1 -- 172.21.15.72:0/637404406 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6800be30 con 0x7f0e701588d0 2023-08-31T18:47:47.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.542+0000 7f0e77dff700 1 -- 172.21.15.72:0/637404406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e701588d0 msgr2=0x7f0e70154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:47.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.542+0000 7f0e77dff700 1 --2- 172.21.15.72:0/637404406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e701588d0 0x7f0e70154440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0e68009e60 tx=0x7f0e68009780).stop 2023-08-31T18:47:47.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.542+0000 7f0e77dff700 1 -- 172.21.15.72:0/637404406 shutdown_connections 2023-08-31T18:47:47.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.542+0000 7f0e77dff700 1 --2- 172.21.15.72:0/637404406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e701588d0 0x7f0e70154440 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.542+0000 7f0e77dff700 1 --2- 172.21.15.72:0/637404406 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e70154060 0x7f0e70157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.542+0000 7f0e77dff700 1 -- 172.21.15.72:0/637404406 >> 172.21.15.72:0/637404406 conn(0x7f0e7005e870 msgr2=0x7f0e700cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:47.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.542+0000 7f0e77dff700 1 -- 172.21.15.72:0/637404406 shutdown_connections 2023-08-31T18:47:47.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.542+0000 7f0e77dff700 1 -- 172.21.15.72:0/637404406 wait complete. 2023-08-31T18:47:47.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.544+0000 7f0e77dff700 1 Processor -- start 2023-08-31T18:47:47.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.544+0000 7f0e77dff700 1 -- start start 2023-08-31T18:47:47.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e77dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e700cb9b0 0x7f0e7014f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:47.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e77dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e70154060 0x7f0e701523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:47.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e77dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e701588d0 0x7f0e700a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:47.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e77dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e70151f40 con 0x7f0e70154060 2023-08-31T18:47:47.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e77dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7014fa50 con 0x7f0e701588d0 2023-08-31T18:47:47.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e77dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700c2a20 con 0x7f0e700cb9b0 2023-08-31T18:47:47.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e7539a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e70154060 0x7f0e701523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:47.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e7539a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e70154060 0x7f0e701523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60278/0 (socket says 172.21.15.72:60278) 2023-08-31T18:47:47.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e7539a700 1 -- 172.21.15.72:0/1591918006 learned_addr learned my addr 172.21.15.72:0/1591918006 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:47.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e75b9b700 1 --2- 172.21.15.72:0/1591918006 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e700cb9b0 0x7f0e7014f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:47.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e7639c700 1 --2- 172.21.15.72:0/1591918006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e701588d0 0x7f0e700a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:47.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e7539a700 1 -- 172.21.15.72:0/1591918006 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e700cb9b0 msgr2=0x7f0e7014f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:47.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e7539a700 1 --2- 172.21.15.72:0/1591918006 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e700cb9b0 0x7f0e7014f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e7539a700 1 -- 172.21.15.72:0/1591918006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e701588d0 msgr2=0x7f0e700a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:47.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e7539a700 1 --2- 172.21.15.72:0/1591918006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e701588d0 0x7f0e700a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.546+0000 7f0e7539a700 1 -- 172.21.15.72:0/1591918006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c009250 con 0x7f0e70154060 2023-08-31T18:47:47.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.547+0000 7f0e7539a700 1 --2- 172.21.15.72:0/1591918006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e70154060 0x7f0e701523d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0e6000c410 tx=0x7f0e60007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:47.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.547+0000 7f0e65ffb700 1 -- 172.21.15.72:0/1591918006 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600070d0 con 0x7f0e70154060 2023-08-31T18:47:47.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.547+0000 7f0e65ffb700 1 -- 172.21.15.72:0/1591918006 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e60007230 con 0x7f0e70154060 2023-08-31T18:47:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.547+0000 7f0e65ffb700 1 -- 172.21.15.72:0/1591918006 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600075d0 con 0x7f0e70154060 2023-08-31T18:47:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.547+0000 7f0e77dff700 1 -- 172.21.15.72:0/1591918006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e68009a20 con 0x7f0e70154060 2023-08-31T18:47:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.547+0000 7f0e77dff700 1 -- 172.21.15.72:0/1591918006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e701518f0 con 0x7f0e70154060 2023-08-31T18:47:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.548+0000 7f0e77dff700 1 -- 172.21.15.72:0/1591918006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e701520b0 con 0x7f0e70154060 2023-08-31T18:47:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.549+0000 7f0e65ffb700 1 -- 172.21.15.72:0/1591918006 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f0e600059b0 con 0x7f0e70154060 2023-08-31T18:47:47.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.549+0000 7f0e65ffb700 1 --2- 172.21.15.72:0/1591918006 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0e5405ee10 0x7f0e540612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:47.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.550+0000 7f0e65ffb700 1 -- 172.21.15.72:0/1591918006 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f0e600790f0 con 0x7f0e70154060 2023-08-31T18:47:47.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.550+0000 7f0e75b9b700 1 --2- 172.21.15.72:0/1591918006 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0e5405ee10 0x7f0e540612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:47.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.550+0000 7f0e75b9b700 1 --2- 172.21.15.72:0/1591918006 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0e5405ee10 0x7f0e540612d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f0e700c4120 tx=0x7f0e6c006f40).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:47.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.554+0000 7f0e65ffb700 1 -- 172.21.15.72:0/1591918006 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0e6004a790 con 0x7f0e70154060 2023-08-31T18:47:47.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.723+0000 7f0e77dff700 1 -- 172.21.15.72:0/1591918006 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e7006c6b0 con 0x7f0e70154060 2023-08-31T18:47:47.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.724+0000 7f0e65ffb700 1 -- 172.21.15.72:0/1591918006 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13818 (secure 0 0 0) 0x7f0e60018030 con 0x7f0e70154060 2023-08-31T18:47:47.725 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:47:47.725 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":16,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:47.286286+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:47:47.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.726+0000 7f0e77dff700 1 -- 172.21.15.72:0/1591918006 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0e5405ee10 msgr2=0x7f0e540612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:47.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.726+0000 7f0e77dff700 1 --2- 172.21.15.72:0/1591918006 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0e5405ee10 0x7f0e540612d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f0e700c4120 tx=0x7f0e6c006f40).stop 2023-08-31T18:47:47.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.726+0000 7f0e77dff700 1 -- 172.21.15.72:0/1591918006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e70154060 msgr2=0x7f0e701523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:47.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.726+0000 7f0e77dff700 1 --2- 172.21.15.72:0/1591918006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e70154060 0x7f0e701523d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0e6000c410 tx=0x7f0e60007c30).stop 2023-08-31T18:47:47.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.726+0000 7f0e77dff700 1 -- 172.21.15.72:0/1591918006 shutdown_connections 2023-08-31T18:47:47.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.726+0000 7f0e77dff700 1 --2- 172.21.15.72:0/1591918006 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0e5405ee10 0x7f0e540612d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.726+0000 7f0e77dff700 1 --2- 172.21.15.72:0/1591918006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e701588d0 0x7f0e700a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.726+0000 7f0e77dff700 1 --2- 172.21.15.72:0/1591918006 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e700cb9b0 0x7f0e7014f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.726+0000 7f0e77dff700 1 --2- 172.21.15.72:0/1591918006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e70154060 0x7f0e701523d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.726+0000 7f0e77dff700 1 -- 172.21.15.72:0/1591918006 >> 172.21.15.72:0/1591918006 conn(0x7f0e7005e870 msgr2=0x7f0e70063090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.726+0000 7f0e77dff700 1 -- 172.21.15.72:0/1591918006 shutdown_connections 2023-08-31T18:47:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.726+0000 7f0e77dff700 1 -- 172.21.15.72:0/1591918006 wait complete. 2023-08-31T18:47:47.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-31T18:47:47.745 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T18:47:47.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.934+0000 7f1be0bff700 1 Processor -- start 2023-08-31T18:47:47.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.935+0000 7f1be0bff700 1 -- start start 2023-08-31T18:47:47.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.936+0000 7f1be0bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bdc153e30 0x7f1bdc154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:47.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.936+0000 7f1be0bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bdc0bfd40 con 0x7f1bdc0637c0 2023-08-31T18:47:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.936+0000 7f1be0bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bdc0c6730 con 0x7f1bdc0c5cb0 2023-08-31T18:47:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.936+0000 7f1be0bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc0bffe0 con 0x7f1bdc153e30 2023-08-31T18:47:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.936+0000 7f1bdad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1bdc0637c0 0x7f1bdc0c0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37720/0 (socket says 172.21.15.72:37720) 2023-08-31T18:47:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.936+0000 7f1bdad9d700 1 -- 172.21.15.72:0/586097762 learned_addr learned my addr 172.21.15.72:0/586097762 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:47:47.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.937+0000 7f1bda59c700 1 --2- 172.21.15.72:0/586097762 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bdc153e30 0x7f1bdc154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:47.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.937+0000 7f1bd959a700 1 -- 172.21.15.72:0/586097762 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185335507 0 0) 0x7f1bdc0bfd40 con 0x7f1bdc0637c0 2023-08-31T18:47:47.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.937+0000 7f1bd959a700 1 -- 172.21.15.72:0/586097762 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc40033f0 con 0x7f1bdc0637c0 2023-08-31T18:47:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.937+0000 7f1bd959a700 1 -- 172.21.15.72:0/586097762 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033370220 0 0) 0x7f1bdc0c6730 con 0x7f1bdc0c5cb0 2023-08-31T18:47:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.937+0000 7f1bd959a700 1 -- 172.21.15.72:0/586097762 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bdc0bfd40 con 0x7f1bdc0c5cb0 2023-08-31T18:47:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.937+0000 7f1bda59c700 1 -- 172.21.15.72:0/586097762 >> v1:172.21.15.146:6789/0 conn(0x7f1bdc0c5cb0 legacy=0x7f1bdc0630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.937+0000 7f1bd959a700 1 -- 172.21.15.72:0/586097762 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2839958451 0 0) 0x7f1bc40033f0 con 0x7f1bdc0637c0 2023-08-31T18:47:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.937+0000 7f1bda59c700 1 -- 172.21.15.72:0/586097762 >> v1:172.21.15.72:6789/0 conn(0x7f1bdc0637c0 legacy=0x7f1bdc0c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.937+0000 7f1bda59c700 1 -- 172.21.15.72:0/586097762 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc0c02c0 con 0x7f1bdc153e30 2023-08-31T18:47:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.937+0000 7f1bda59c700 1 --2- 172.21.15.72:0/586097762 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bdc153e30 0x7f1bdc154210 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f1bcc009790 tx=0x7f1bcc009060).ready entity=mon.2 client_cookie=a79371b8e3d4cd8 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.937+0000 7f1bd959a700 1 -- 172.21.15.72:0/586097762 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd40017f0 con 0x7f1bdc153e30 2023-08-31T18:47:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.938+0000 7f1bd959a700 1 -- 172.21.15.72:0/586097762 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc011400 con 0x7f1bdc153e30 2023-08-31T18:47:47.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.938+0000 7f1bd959a700 1 -- 172.21.15.72:0/586097762 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc011780 con 0x7f1bdc153e30 2023-08-31T18:47:47.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.938+0000 7f1be0bff700 1 -- 172.21.15.72:0/586097762 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bdc153e30 msgr2=0x7f1bdc154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:47.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.938+0000 7f1be0bff700 1 --2- 172.21.15.72:0/586097762 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bdc153e30 0x7f1bdc154210 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f1bcc009790 tx=0x7f1bcc009060).stop 2023-08-31T18:47:47.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.938+0000 7f1be0bff700 1 -- 172.21.15.72:0/586097762 shutdown_connections 2023-08-31T18:47:47.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.938+0000 7f1be0bff700 1 --2- 172.21.15.72:0/586097762 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bdc153e30 0x7f1bdc154210 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.938+0000 7f1be0bff700 1 -- 172.21.15.72:0/586097762 >> 172.21.15.72:0/586097762 conn(0x7f1bdc05eb20 msgr2=0x7f1bdc0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:47.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.938+0000 7f1be0bff700 1 -- 172.21.15.72:0/586097762 shutdown_connections 2023-08-31T18:47:47.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.938+0000 7f1be0bff700 1 -- 172.21.15.72:0/586097762 wait complete. 2023-08-31T18:47:47.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.940+0000 7f1be0bff700 1 Processor -- start 2023-08-31T18:47:47.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.940+0000 7f1be0bff700 1 -- start start 2023-08-31T18:47:47.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1be0bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bdc0637c0 0x7f1bdc153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:47.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1be0bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bdc0c5cb0 0x7f1bdc142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:47.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1be0bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bdc153e30 0x7f1bdc167da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:47.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1be0bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc148e80 con 0x7f1bdc0c5cb0 2023-08-31T18:47:47.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1be0bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc150920 con 0x7f1bdc153e30 2023-08-31T18:47:47.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1be0bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc150b70 con 0x7f1bdc0637c0 2023-08-31T18:47:47.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1bd9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bdc0c5cb0 0x7f1bdc142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:47.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1bd9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bdc0c5cb0 0x7f1bdc142390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60292/0 (socket says 172.21.15.72:60292) 2023-08-31T18:47:47.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1bd9d9b700 1 -- 172.21.15.72:0/1536145292 learned_addr learned my addr 172.21.15.72:0/1536145292 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1bdad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bdc153e30 0x7f1bdc167da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1bda59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bdc0637c0 0x7f1bdc153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1bd9d9b700 1 -- 172.21.15.72:0/1536145292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bdc0637c0 msgr2=0x7f1bdc153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1bd9d9b700 1 --2- 172.21.15.72:0/1536145292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bdc0637c0 0x7f1bdc153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1bd9d9b700 1 -- 172.21.15.72:0/1536145292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bdc153e30 msgr2=0x7f1bdc167da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1bd9d9b700 1 --2- 172.21.15.72:0/1536145292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bdc153e30 0x7f1bdc167da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:47.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1bd9d9b700 1 -- 172.21.15.72:0/1536145292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc0092a0 con 0x7f1bdc0c5cb0 2023-08-31T18:47:47.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.941+0000 7f1bd9d9b700 1 --2- 172.21.15.72:0/1536145292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bdc0c5cb0 0x7f1bdc142390 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1bd000c490 tx=0x7f1bd0007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:47.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.942+0000 7f1bca7fc700 1 -- 172.21.15.72:0/1536145292 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd000ce40 con 0x7f1bdc0c5cb0 2023-08-31T18:47:47.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.942+0000 7f1bca7fc700 1 -- 172.21.15.72:0/1536145292 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd000f470 con 0x7f1bdc0c5cb0 2023-08-31T18:47:47.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.942+0000 7f1bca7fc700 1 -- 172.21.15.72:0/1536145292 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd000f830 con 0x7f1bdc0c5cb0 2023-08-31T18:47:47.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.942+0000 7f1be0bff700 1 -- 172.21.15.72:0/1536145292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bdc150e50 con 0x7f1bdc0c5cb0 2023-08-31T18:47:47.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.942+0000 7f1be0bff700 1 -- 172.21.15.72:0/1536145292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bdc151490 con 0x7f1bdc0c5cb0 2023-08-31T18:47:47.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.943+0000 7f1be0bff700 1 -- 172.21.15.72:0/1536145292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bdc06c6b0 con 0x7f1bdc0c5cb0 2023-08-31T18:47:47.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.944+0000 7f1bca7fc700 1 -- 172.21.15.72:0/1536145292 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f1bd000fbe0 con 0x7f1bdc0c5cb0 2023-08-31T18:47:47.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.944+0000 7f1bca7fc700 1 --2- 172.21.15.72:0/1536145292 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1bbc05ee10 0x7f1bbc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:47.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.944+0000 7f1bca7fc700 1 -- 172.21.15.72:0/1536145292 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1bd0079080 con 0x7f1bdc0c5cb0 2023-08-31T18:47:47.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.945+0000 7f1bda59c700 1 --2- 172.21.15.72:0/1536145292 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1bbc05ee10 0x7f1bbc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:47.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.945+0000 7f1bda59c700 1 --2- 172.21.15.72:0/1536145292 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1bbc05ee10 0x7f1bbc0612d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1bcc0096e0 tx=0x7f1bcc016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:47.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:47.948+0000 7f1bca7fc700 1 -- 172.21.15.72:0/1536145292 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1bd004a780 con 0x7f1bdc0c5cb0 2023-08-31T18:47:48.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.116+0000 7f1be0bff700 1 -- 172.21.15.72:0/1536145292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1bdc062970 con 0x7f1bdc0c5cb0 2023-08-31T18:47:48.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.117+0000 7f1bca7fc700 1 -- 172.21.15.72:0/1536145292 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v16) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1bd0007d80 con 0x7f1bdc0c5cb0 2023-08-31T18:47:48.118 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T18:47:48.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.119+0000 7f1be0bff700 1 -- 172.21.15.72:0/1536145292 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1bbc05ee10 msgr2=0x7f1bbc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:48.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.119+0000 7f1be0bff700 1 --2- 172.21.15.72:0/1536145292 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1bbc05ee10 0x7f1bbc0612d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1bcc0096e0 tx=0x7f1bcc016000).stop 2023-08-31T18:47:48.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.119+0000 7f1be0bff700 1 -- 172.21.15.72:0/1536145292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bdc0c5cb0 msgr2=0x7f1bdc142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:48.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.119+0000 7f1be0bff700 1 --2- 172.21.15.72:0/1536145292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bdc0c5cb0 0x7f1bdc142390 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1bd000c490 tx=0x7f1bd0007c60).stop 2023-08-31T18:47:48.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.119+0000 7f1be0bff700 1 -- 172.21.15.72:0/1536145292 shutdown_connections 2023-08-31T18:47:48.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.119+0000 7f1be0bff700 1 --2- 172.21.15.72:0/1536145292 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1bbc05ee10 0x7f1bbc0612d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.119+0000 7f1be0bff700 1 --2- 172.21.15.72:0/1536145292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bdc153e30 0x7f1bdc167da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.119+0000 7f1be0bff700 1 --2- 172.21.15.72:0/1536145292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bdc0637c0 0x7f1bdc153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.119+0000 7f1be0bff700 1 --2- 172.21.15.72:0/1536145292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bdc0c5cb0 0x7f1bdc142390 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.119+0000 7f1be0bff700 1 -- 172.21.15.72:0/1536145292 >> 172.21.15.72:0/1536145292 conn(0x7f1bdc05eb20 msgr2=0x7f1bdc0afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:48.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.119+0000 7f1be0bff700 1 -- 172.21.15.72:0/1536145292 shutdown_connections 2023-08-31T18:47:48.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.119+0000 7f1be0bff700 1 -- 172.21.15.72:0/1536145292 wait complete. 2023-08-31T18:47:48.137 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T18:47:48.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.328+0000 7f5344bff700 1 Processor -- start 2023-08-31T18:47:48.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.328+0000 7f5344bff700 1 -- start start 2023-08-31T18:47:48.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.329+0000 7f5344bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5340153e30 0x7f5340154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:48.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.329+0000 7f5344bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f53400637c0 0x7f53400c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:48.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.329+0000 7f5344bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53400bfd40 con 0x7f53400c5cb0 2023-08-31T18:47:48.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.329+0000 7f5344bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53400c6730 con 0x7f53400637c0 2023-08-31T18:47:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.329+0000 7f5344bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53400bffe0 con 0x7f5340153e30 2023-08-31T18:47:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.330+0000 7f533ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f53400637c0 0x7f53400c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.330+0000 7f533dd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f53400c5cb0 0x7f53400630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37728/0 (socket says 172.21.15.72:37728) 2023-08-31T18:47:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.330+0000 7f533ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f53400637c0 0x7f53400c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60308/0 (socket says 172.21.15.72:60308) 2023-08-31T18:47:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.330+0000 7f533dd9b700 1 -- 172.21.15.72:0/2819393773 learned_addr learned my addr 172.21.15.72:0/2819393773 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:47:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.330+0000 7f533e59c700 1 --2- 172.21.15.72:0/2819393773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5340153e30 0x7f5340154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.330+0000 7f533ed9d700 1 -- 172.21.15.72:0/2819393773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5340153e30 msgr2=0x7f5340154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.330+0000 7f533ed9d700 1 --2- 172.21.15.72:0/2819393773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5340153e30 0x7f5340154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.330+0000 7f533ed9d700 1 -- 172.21.15.72:0/2819393773 >> v1:172.21.15.72:6789/0 conn(0x7f53400c5cb0 legacy=0x7f53400630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.330+0000 7f533ed9d700 1 -- 172.21.15.72:0/2819393773 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53400c02c0 con 0x7f53400637c0 2023-08-31T18:47:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.330+0000 7f533d59a700 1 -- 172.21.15.72:0/2819393773 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730905709 0 0) 0x7f53400bfd40 con 0x7f53400c5cb0 2023-08-31T18:47:48.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.330+0000 7f533ed9d700 1 --2- 172.21.15.72:0/2819393773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400637c0 0x7f53400c6130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5338009e60 tx=0x7f5338009780).ready entity=mon.0 client_cookie=f4588645ee506f02 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:48.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.330+0000 7f533d59a700 1 -- 172.21.15.72:0/2819393773 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533800e070 con 0x7f53400637c0 2023-08-31T18:47:48.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.331+0000 7f533d59a700 1 -- 172.21.15.72:0/2819393773 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533800bb60 con 0x7f53400637c0 2023-08-31T18:47:48.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.331+0000 7f533d59a700 1 -- 172.21.15.72:0/2819393773 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338012410 con 0x7f53400637c0 2023-08-31T18:47:48.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.331+0000 7f5344bff700 1 -- 172.21.15.72:0/2819393773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400637c0 msgr2=0x7f53400c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:48.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.331+0000 7f5344bff700 1 --2- 172.21.15.72:0/2819393773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400637c0 0x7f53400c6130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5338009e60 tx=0x7f5338009780).stop 2023-08-31T18:47:48.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.331+0000 7f5344bff700 1 -- 172.21.15.72:0/2819393773 shutdown_connections 2023-08-31T18:47:48.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.331+0000 7f5344bff700 1 --2- 172.21.15.72:0/2819393773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400637c0 0x7f53400c6130 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.331+0000 7f5344bff700 1 --2- 172.21.15.72:0/2819393773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5340153e30 0x7f5340154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.331+0000 7f5344bff700 1 -- 172.21.15.72:0/2819393773 >> 172.21.15.72:0/2819393773 conn(0x7f534005eb20 msgr2=0x7f53400cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:48.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.331+0000 7f5344bff700 1 -- 172.21.15.72:0/2819393773 shutdown_connections 2023-08-31T18:47:48.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.331+0000 7f5344bff700 1 -- 172.21.15.72:0/2819393773 wait complete. 2023-08-31T18:47:48.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.333+0000 7f5344bff700 1 Processor -- start 2023-08-31T18:47:48.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.333+0000 7f5344bff700 1 -- start start 2023-08-31T18:47:48.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f5344bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400637c0 0x7f53400afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:48.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f5344bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53400c5cb0 0x7f53400b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:48.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f5344bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5340153e30 0x7f5340167b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:48.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f5344bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5340155d30 con 0x7f53400637c0 2023-08-31T18:47:48.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f5344bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53400b0740 con 0x7f5340153e30 2023-08-31T18:47:48.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f5344bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53400b0a20 con 0x7f53400c5cb0 2023-08-31T18:47:48.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f533e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400637c0 0x7f53400afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:48.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f533e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400637c0 0x7f53400afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60314/0 (socket says 172.21.15.72:60314) 2023-08-31T18:47:48.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f533e59c700 1 -- 172.21.15.72:0/472261912 learned_addr learned my addr 172.21.15.72:0/472261912 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:48.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f533dd9b700 1 --2- 172.21.15.72:0/472261912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53400c5cb0 0x7f53400b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:48.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f533ed9d700 1 --2- 172.21.15.72:0/472261912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5340153e30 0x7f5340167b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:48.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f533e59c700 1 -- 172.21.15.72:0/472261912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53400c5cb0 msgr2=0x7f53400b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f533e59c700 1 --2- 172.21.15.72:0/472261912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53400c5cb0 0x7f53400b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f533e59c700 1 -- 172.21.15.72:0/472261912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5340153e30 msgr2=0x7f5340167b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f533e59c700 1 --2- 172.21.15.72:0/472261912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5340153e30 0x7f5340167b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f533e59c700 1 -- 172.21.15.72:0/472261912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5338009a20 con 0x7f53400637c0 2023-08-31T18:47:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.335+0000 7f533e59c700 1 --2- 172.21.15.72:0/472261912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400637c0 0x7f53400afc90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f533000e930 tx=0x7f5330009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.336+0000 7f532e7fc700 1 -- 172.21.15.72:0/472261912 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330012600 con 0x7f53400637c0 2023-08-31T18:47:48.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.336+0000 7f532e7fc700 1 -- 172.21.15.72:0/472261912 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5330012760 con 0x7f53400637c0 2023-08-31T18:47:48.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.336+0000 7f5344bff700 1 -- 172.21.15.72:0/472261912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53401559c0 con 0x7f53400637c0 2023-08-31T18:47:48.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.336+0000 7f532e7fc700 1 -- 172.21.15.72:0/472261912 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330012ae0 con 0x7f53400637c0 2023-08-31T18:47:48.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.336+0000 7f5344bff700 1 -- 172.21.15.72:0/472261912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5340161db0 con 0x7f53400637c0 2023-08-31T18:47:48.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.337+0000 7f5344bff700 1 -- 172.21.15.72:0/472261912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5340156010 con 0x7f53400637c0 2023-08-31T18:47:48.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.337+0000 7f532e7fc700 1 -- 172.21.15.72:0/472261912 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f533001b400 con 0x7f53400637c0 2023-08-31T18:47:48.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.338+0000 7f532e7fc700 1 --2- 172.21.15.72:0/472261912 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f532005ee10 0x7f53200612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:48.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.338+0000 7f532e7fc700 1 -- 172.21.15.72:0/472261912 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5330079fe0 con 0x7f53400637c0 2023-08-31T18:47:48.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.339+0000 7f533dd9b700 1 --2- 172.21.15.72:0/472261912 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f532005ee10 0x7f53200612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:48.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.339+0000 7f533dd9b700 1 --2- 172.21.15.72:0/472261912 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f532005ee10 0x7f53200612d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f53400b0670 tx=0x7f5334007bb0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:48.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.343+0000 7f532e7fc700 1 -- 172.21.15.72:0/472261912 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f533004b6c0 con 0x7f53400637c0 2023-08-31T18:47:48.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:47:48.508 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:47:48.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.516+0000 7f5344bff700 1 -- 172.21.15.72:0/472261912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5340162030 con 0x7f53400637c0 2023-08-31T18:47:48.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.517+0000 7f532e7fc700 1 -- 172.21.15.72:0/472261912 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5340162030 con 0x7f53400637c0 2023-08-31T18:47:48.517 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T18:47:48.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.519+0000 7f5344bff700 1 -- 172.21.15.72:0/472261912 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f532005ee10 msgr2=0x7f53200612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:48.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.519+0000 7f5344bff700 1 --2- 172.21.15.72:0/472261912 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f532005ee10 0x7f53200612d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f53400b0670 tx=0x7f5334007bb0).stop 2023-08-31T18:47:48.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.519+0000 7f5344bff700 1 -- 172.21.15.72:0/472261912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400637c0 msgr2=0x7f53400afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:48.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.519+0000 7f5344bff700 1 --2- 172.21.15.72:0/472261912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400637c0 0x7f53400afc90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f533000e930 tx=0x7f5330009060).stop 2023-08-31T18:47:48.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.519+0000 7f5344bff700 1 -- 172.21.15.72:0/472261912 shutdown_connections 2023-08-31T18:47:48.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.519+0000 7f5344bff700 1 --2- 172.21.15.72:0/472261912 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f532005ee10 0x7f53200612d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.519+0000 7f5344bff700 1 --2- 172.21.15.72:0/472261912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5340153e30 0x7f5340167b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.519+0000 7f5344bff700 1 --2- 172.21.15.72:0/472261912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400637c0 0x7f53400afc90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.519+0000 7f5344bff700 1 --2- 172.21.15.72:0/472261912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f53400c5cb0 0x7f53400b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.519+0000 7f5344bff700 1 -- 172.21.15.72:0/472261912 >> 172.21.15.72:0/472261912 conn(0x7f534005eb20 msgr2=0x7f53400c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:48.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.519+0000 7f5344bff700 1 -- 172.21.15.72:0/472261912 shutdown_connections 2023-08-31T18:47:48.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.519+0000 7f5344bff700 1 -- 172.21.15.72:0/472261912 wait complete. 2023-08-31T18:47:48.537 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T18:47:48.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.764+0000 7f8f987ff700 1 Processor -- start 2023-08-31T18:47:48.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.764+0000 7f8f987ff700 1 -- start start 2023-08-31T18:47:48.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.765+0000 7f8f987ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f90152090 0x7f8f90155460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:48.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.765+0000 7f8f987ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f90062d60 0x7f8f90069390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:48.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.765+0000 7f8f987ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f90065940 con 0x7f8f900c25d0 2023-08-31T18:47:48.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.765+0000 7f8f987ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f90155950 con 0x7f8f90062d60 2023-08-31T18:47:48.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.765+0000 7f8f987ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f90152470 con 0x7f8f90152090 2023-08-31T18:47:48.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.766+0000 7f8f96d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f90062d60 0x7f8f90069390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.766+0000 7f8f96d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f90062d60 0x7f8f90069390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60326/0 (socket says 172.21.15.72:60326) 2023-08-31T18:47:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.766+0000 7f8f96d9c700 1 -- 172.21.15.72:0/1082606922 learned_addr learned my addr 172.21.15.72:0/1082606922 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.766+0000 7f8f9659b700 1 --2- 172.21.15.72:0/1082606922 >> v2:172.21.15.146:3300/0 conn(0x7f8f90152090 0x7f8f90155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.766+0000 7f8f96d9c700 1 -- 172.21.15.72:0/1082606922 >> v2:172.21.15.146:3300/0 conn(0x7f8f90152090 msgr2=0x7f8f90155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:48.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.766+0000 7f8f96d9c700 1 --2- 172.21.15.72:0/1082606922 >> v2:172.21.15.146:3300/0 conn(0x7f8f90152090 0x7f8f90155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.766+0000 7f8f96d9c700 1 -- 172.21.15.72:0/1082606922 >> v1:172.21.15.146:6789/0 conn(0x7f8f900c25d0 legacy=0x7f8f90062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:48.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.766+0000 7f8f96d9c700 1 -- 172.21.15.72:0/1082606922 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f900a6e40 con 0x7f8f90062d60 2023-08-31T18:47:48.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.766+0000 7f8f96d9c700 1 --2- 172.21.15.72:0/1082606922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f90062d60 0x7f8f90069390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f8f900648f0 tx=0x7f8f88009840).ready entity=mon.0 client_cookie=6a7015779f641077 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:48.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.766+0000 7f8f95599700 1 -- 172.21.15.72:0/1082606922 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8800e070 con 0x7f8f90062d60 2023-08-31T18:47:48.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.767+0000 7f8f95599700 1 -- 172.21.15.72:0/1082606922 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8800ba20 con 0x7f8f90062d60 2023-08-31T18:47:48.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.767+0000 7f8f95599700 1 -- 172.21.15.72:0/1082606922 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8800bda0 con 0x7f8f90062d60 2023-08-31T18:47:48.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.767+0000 7f8f987ff700 1 -- 172.21.15.72:0/1082606922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f90062d60 msgr2=0x7f8f90069390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:48.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.767+0000 7f8f987ff700 1 --2- 172.21.15.72:0/1082606922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f90062d60 0x7f8f90069390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f8f900648f0 tx=0x7f8f88009840).stop 2023-08-31T18:47:48.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.767+0000 7f8f987ff700 1 -- 172.21.15.72:0/1082606922 shutdown_connections 2023-08-31T18:47:48.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.767+0000 7f8f987ff700 1 --2- 172.21.15.72:0/1082606922 >> v2:172.21.15.146:3300/0 conn(0x7f8f90152090 0x7f8f90155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.767+0000 7f8f987ff700 1 --2- 172.21.15.72:0/1082606922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f90062d60 0x7f8f90069390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.767+0000 7f8f987ff700 1 -- 172.21.15.72:0/1082606922 >> 172.21.15.72:0/1082606922 conn(0x7f8f900c7c30 msgr2=0x7f8f900c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:48.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.767+0000 7f8f987ff700 1 -- 172.21.15.72:0/1082606922 shutdown_connections 2023-08-31T18:47:48.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.767+0000 7f8f987ff700 1 -- 172.21.15.72:0/1082606922 wait complete. 2023-08-31T18:47:48.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.769+0000 7f8f987ff700 1 Processor -- start 2023-08-31T18:47:48.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.769+0000 7f8f987ff700 1 -- start start 2023-08-31T18:47:48.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f987ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f90062d60 0x7f8f9014ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:48.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f987ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f900c25d0 0x7f8f900abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:48.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f987ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f90152090 0x7f8f900ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:48.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f987ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900c0190 con 0x7f8f90152090 2023-08-31T18:47:48.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f987ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900ad470 con 0x7f8f90062d60 2023-08-31T18:47:48.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f987ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f900c1990 con 0x7f8f900c25d0 2023-08-31T18:47:48.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f96d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f90152090 0x7f8f900ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:48.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f96d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f90152090 0x7f8f900ac1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60342/0 (socket says 172.21.15.72:60342) 2023-08-31T18:47:48.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f96d9c700 1 -- 172.21.15.72:0/661286037 learned_addr learned my addr 172.21.15.72:0/661286037 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:48.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f9659b700 1 --2- 172.21.15.72:0/661286037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f90062d60 0x7f8f9014ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:48.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f95d9a700 1 --2- 172.21.15.72:0/661286037 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f900c25d0 0x7f8f900abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:48.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f96d9c700 1 -- 172.21.15.72:0/661286037 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f900c25d0 msgr2=0x7f8f900abcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:48.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f96d9c700 1 --2- 172.21.15.72:0/661286037 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f900c25d0 0x7f8f900abcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f96d9c700 1 -- 172.21.15.72:0/661286037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f90062d60 msgr2=0x7f8f9014ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:48.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f96d9c700 1 --2- 172.21.15.72:0/661286037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f90062d60 0x7f8f9014ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.770+0000 7f8f96d9c700 1 -- 172.21.15.72:0/661286037 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f88009ae0 con 0x7f8f90152090 2023-08-31T18:47:48.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.771+0000 7f8f96d9c700 1 --2- 172.21.15.72:0/661286037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f90152090 0x7f8f900ac1e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8f90069010 tx=0x7f8f88009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:48.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.771+0000 7f8f867fc700 1 -- 172.21.15.72:0/661286037 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f880092e0 con 0x7f8f90152090 2023-08-31T18:47:48.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.771+0000 7f8f867fc700 1 -- 172.21.15.72:0/661286037 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8801e470 con 0x7f8f90152090 2023-08-31T18:47:48.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.771+0000 7f8f867fc700 1 -- 172.21.15.72:0/661286037 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8801e830 con 0x7f8f90152090 2023-08-31T18:47:48.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.771+0000 7f8f987ff700 1 -- 172.21.15.72:0/661286037 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f900ac860 con 0x7f8f90152090 2023-08-31T18:47:48.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.771+0000 7f8f987ff700 1 -- 172.21.15.72:0/661286037 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f900ace20 con 0x7f8f90152090 2023-08-31T18:47:48.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.772+0000 7f8f987ff700 1 -- 172.21.15.72:0/661286037 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f900ad5e0 con 0x7f8f90152090 2023-08-31T18:47:48.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.773+0000 7f8f867fc700 1 -- 172.21.15.72:0/661286037 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8f88003040 con 0x7f8f90152090 2023-08-31T18:47:48.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.773+0000 7f8f867fc700 1 --2- 172.21.15.72:0/661286037 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8f7405ede0 0x7f8f740612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:48.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.774+0000 7f8f867fc700 1 -- 172.21.15.72:0/661286037 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f8f8807ae20 con 0x7f8f90152090 2023-08-31T18:47:48.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.774+0000 7f8f9659b700 1 --2- 172.21.15.72:0/661286037 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8f7405ede0 0x7f8f740612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:48.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.774+0000 7f8f9659b700 1 --2- 172.21.15.72:0/661286037 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8f7405ede0 0x7f8f740612a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8f900c1cd0 tx=0x7f8f8c009060).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:48.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.778+0000 7f8f867fc700 1 -- 172.21.15.72:0/661286037 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8f8804c690 con 0x7f8f90152090 2023-08-31T18:47:48.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.985+0000 7f8f987ff700 1 -- 172.21.15.72:0/661286037 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f9006c6b0 con 0x7f8f90152090 2023-08-31T18:47:48.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.985+0000 7f8f867fc700 1 -- 172.21.15.72:0/661286037 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f8f88023030 con 0x7f8f90152090 2023-08-31T18:47:48.986 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:47:48.986 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/111391994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":111391994},{"type":"v1","addr":"172.21.15.72:6837","nonce":111391994}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/4001102603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4001102603},{"type":"v1","addr":"172.21.15.146:6833","nonce":4001102603}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/522602179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":522602179},{"type":"v1","addr":"172.21.15.72:6835","nonce":522602179}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3888852190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3888852190},{"type":"v1","addr":"172.21.15.146:6835","nonce":3888852190}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-08-31T18:47:48.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.987+0000 7f8f987ff700 1 -- 172.21.15.72:0/661286037 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8f7405ede0 msgr2=0x7f8f740612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:48.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.987+0000 7f8f987ff700 1 --2- 172.21.15.72:0/661286037 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8f7405ede0 0x7f8f740612a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8f900c1cd0 tx=0x7f8f8c009060).stop 2023-08-31T18:47:48.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.987+0000 7f8f987ff700 1 -- 172.21.15.72:0/661286037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f90152090 msgr2=0x7f8f900ac1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.987+0000 7f8f987ff700 1 --2- 172.21.15.72:0/661286037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f90152090 0x7f8f900ac1e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8f90069010 tx=0x7f8f88009840).stop 2023-08-31T18:47:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.987+0000 7f8f987ff700 1 -- 172.21.15.72:0/661286037 shutdown_connections 2023-08-31T18:47:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.987+0000 7f8f987ff700 1 --2- 172.21.15.72:0/661286037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f90152090 0x7f8f900ac1e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.987+0000 7f8f987ff700 1 --2- 172.21.15.72:0/661286037 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8f7405ede0 0x7f8f740612a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.987+0000 7f8f987ff700 1 --2- 172.21.15.72:0/661286037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f90062d60 0x7f8f9014ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.987+0000 7f8f987ff700 1 --2- 172.21.15.72:0/661286037 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8f900c25d0 0x7f8f900abcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.987+0000 7f8f987ff700 1 -- 172.21.15.72:0/661286037 >> 172.21.15.72:0/661286037 conn(0x7f8f900c7c30 msgr2=0x7f8f900c2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.988+0000 7f8f987ff700 1 -- 172.21.15.72:0/661286037 shutdown_connections 2023-08-31T18:47:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:48.988+0000 7f8f987ff700 1 -- 172.21.15.72:0/661286037 wait complete. 2023-08-31T18:47:48.991 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 3 2023-08-31T18:47:49.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:47:49.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.193+0000 7f5ed27ff700 1 Processor -- start 2023-08-31T18:47:49.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.193+0000 7f5ed27ff700 1 -- start start 2023-08-31T18:47:49.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.194+0000 7f5ed27ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ecc0cb9b0 0x7f5ecc1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.194+0000 7f5ed27ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ecc1588d0 0x7f5ecc154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.194+0000 7f5ed27ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc0c6120 con 0x7f5ecc154060 2023-08-31T18:47:49.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.194+0000 7f5ed27ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc0c1380 con 0x7f5ecc1588d0 2023-08-31T18:47:49.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.194+0000 7f5ed27ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0c5e10 con 0x7f5ecc0cb9b0 2023-08-31T18:47:49.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.195+0000 7f5ecbfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5ecc154060 0x7f5ecc157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37740/0 (socket says 172.21.15.72:37740) 2023-08-31T18:47:49.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.195+0000 7f5ed0d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ecc1588d0 0x7f5ecc154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.195+0000 7f5ecbfff700 1 -- 172.21.15.72:0/893594838 learned_addr learned my addr 172.21.15.72:0/893594838 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:47:49.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.195+0000 7f5ecb7fe700 1 --2- 172.21.15.72:0/893594838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ecc0cb9b0 0x7f5ecc1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.195+0000 7f5ed0d9c700 1 -- 172.21.15.72:0/893594838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ecc0cb9b0 msgr2=0x7f5ecc1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:49.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.195+0000 7f5ed0d9c700 1 --2- 172.21.15.72:0/893594838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ecc0cb9b0 0x7f5ecc1583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.195+0000 7f5ed0d9c700 1 -- 172.21.15.72:0/893594838 >> v1:172.21.15.72:6789/0 conn(0x7f5ecc154060 legacy=0x7f5ecc157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:49.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.195+0000 7f5ed0d9c700 1 -- 172.21.15.72:0/893594838 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc0c0ae0 con 0x7f5ecc1588d0 2023-08-31T18:47:49.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.195+0000 7f5ecaffd700 1 -- 172.21.15.72:0/893594838 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373404157 0 0) 0x7f5ecc0c6120 con 0x7f5ecc154060 2023-08-31T18:47:49.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.195+0000 7f5ed0d9c700 1 --2- 172.21.15.72:0/893594838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ecc1588d0 0x7f5ecc154440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5ec4009e60 tx=0x7f5ec4009780).ready entity=mon.0 client_cookie=b7bd19e5e0ecf825 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:49.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.195+0000 7f5ecaffd700 1 -- 172.21.15.72:0/893594838 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec400e070 con 0x7f5ecc1588d0 2023-08-31T18:47:49.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.195+0000 7f5ecaffd700 1 -- 172.21.15.72:0/893594838 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec400bb60 con 0x7f5ecc1588d0 2023-08-31T18:47:49.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.196+0000 7f5ecaffd700 1 -- 172.21.15.72:0/893594838 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4012410 con 0x7f5ecc1588d0 2023-08-31T18:47:49.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.196+0000 7f5ed27ff700 1 -- 172.21.15.72:0/893594838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ecc1588d0 msgr2=0x7f5ecc154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:49.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.196+0000 7f5ed27ff700 1 --2- 172.21.15.72:0/893594838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ecc1588d0 0x7f5ecc154440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5ec4009e60 tx=0x7f5ec4009780).stop 2023-08-31T18:47:49.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.196+0000 7f5ed27ff700 1 -- 172.21.15.72:0/893594838 shutdown_connections 2023-08-31T18:47:49.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.196+0000 7f5ed27ff700 1 --2- 172.21.15.72:0/893594838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ecc1588d0 0x7f5ecc154440 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.196+0000 7f5ed27ff700 1 --2- 172.21.15.72:0/893594838 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ecc0cb9b0 0x7f5ecc1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.196+0000 7f5ed27ff700 1 -- 172.21.15.72:0/893594838 >> 172.21.15.72:0/893594838 conn(0x7f5ecc05e870 msgr2=0x7f5ecc0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:49.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.196+0000 7f5ed27ff700 1 -- 172.21.15.72:0/893594838 shutdown_connections 2023-08-31T18:47:49.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.196+0000 7f5ed27ff700 1 -- 172.21.15.72:0/893594838 wait complete. 2023-08-31T18:47:49.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.198+0000 7f5ed27ff700 1 Processor -- start 2023-08-31T18:47:49.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.198+0000 7f5ed27ff700 1 -- start start 2023-08-31T18:47:49.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ed27ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ecc0cb9b0 0x7f5ecc158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ed27ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ecc154060 0x7f5ecc0c2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ed27ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ecc1588d0 0x7f5ecc0c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ed27ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc1527b0 con 0x7f5ecc154060 2023-08-31T18:47:49.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ed27ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc1512b0 con 0x7f5ecc1588d0 2023-08-31T18:47:49.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ed27ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc151590 con 0x7f5ecc0cb9b0 2023-08-31T18:47:49.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ecb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ecc154060 0x7f5ecc0c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ecb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ecc154060 0x7f5ecc0c2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60370/0 (socket says 172.21.15.72:60370) 2023-08-31T18:47:49.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ecb7fe700 1 -- 172.21.15.72:0/4225384275 learned_addr learned my addr 172.21.15.72:0/4225384275 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:49.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ecbfff700 1 --2- 172.21.15.72:0/4225384275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ecc0cb9b0 0x7f5ecc158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ed0d9c700 1 --2- 172.21.15.72:0/4225384275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ecc1588d0 0x7f5ecc0c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ecb7fe700 1 -- 172.21.15.72:0/4225384275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ecc0cb9b0 msgr2=0x7f5ecc158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:49.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ecb7fe700 1 --2- 172.21.15.72:0/4225384275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ecc0cb9b0 0x7f5ecc158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ecb7fe700 1 -- 172.21.15.72:0/4225384275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ecc1588d0 msgr2=0x7f5ecc0c2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:49.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ecb7fe700 1 --2- 172.21.15.72:0/4225384275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ecc1588d0 0x7f5ecc0c2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ecb7fe700 1 -- 172.21.15.72:0/4225384275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4009a20 con 0x7f5ecc154060 2023-08-31T18:47:49.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.199+0000 7f5ecb7fe700 1 --2- 172.21.15.72:0/4225384275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ecc154060 0x7f5ecc0c2910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f5ec000e900 tx=0x7f5ec0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:49.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.200+0000 7f5eb3fff700 1 -- 172.21.15.72:0/4225384275 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0012600 con 0x7f5ecc154060 2023-08-31T18:47:49.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.200+0000 7f5eb3fff700 1 -- 172.21.15.72:0/4225384275 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec0012760 con 0x7f5ecc154060 2023-08-31T18:47:49.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.200+0000 7f5ed27ff700 1 -- 172.21.15.72:0/4225384275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc0c1e30 con 0x7f5ecc154060 2023-08-31T18:47:49.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.200+0000 7f5eb3fff700 1 -- 172.21.15.72:0/4225384275 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0012ae0 con 0x7f5ecc154060 2023-08-31T18:47:49.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.200+0000 7f5ed27ff700 1 -- 172.21.15.72:0/4225384275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc0c23f0 con 0x7f5ecc154060 2023-08-31T18:47:49.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.201+0000 7f5ed27ff700 1 -- 172.21.15.72:0/4225384275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ecc06acb0 con 0x7f5ecc154060 2023-08-31T18:47:49.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.202+0000 7f5eb3fff700 1 -- 172.21.15.72:0/4225384275 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f5ec001b400 con 0x7f5ecc154060 2023-08-31T18:47:49.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.202+0000 7f5eb3fff700 1 --2- 172.21.15.72:0/4225384275 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5eb805ee10 0x7f5eb80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.202+0000 7f5eb3fff700 1 -- 172.21.15.72:0/4225384275 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5ec0079e70 con 0x7f5ecc154060 2023-08-31T18:47:49.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.203+0000 7f5ecbfff700 1 --2- 172.21.15.72:0/4225384275 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5eb805ee10 0x7f5eb80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.203+0000 7f5ecbfff700 1 --2- 172.21.15.72:0/4225384275 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5eb805ee10 0x7f5eb80612d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5ebc001360 tx=0x7f5ebc009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:49.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.206+0000 7f5eb3fff700 1 -- 172.21.15.72:0/4225384275 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5ecc06acb0 con 0x7f5ecc154060 2023-08-31T18:47:49.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.378+0000 7f5ed27ff700 1 -- 172.21.15.72:0/4225384275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ecc06acb0 con 0x7f5ecc154060 2023-08-31T18:47:49.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.379+0000 7f5eb3fff700 1 -- 172.21.15.72:0/4225384275 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13805 (secure 0 0 0) 0x7f5ecc06acb0 con 0x7f5ecc154060 2023-08-31T18:47:49.379 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:47:49.379 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:48.288046+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:47:49.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.381+0000 7f5ed27ff700 1 -- 172.21.15.72:0/4225384275 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5eb805ee10 msgr2=0x7f5eb80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.381+0000 7f5ed27ff700 1 --2- 172.21.15.72:0/4225384275 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5eb805ee10 0x7f5eb80612d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5ebc001360 tx=0x7f5ebc009040).stop 2023-08-31T18:47:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.381+0000 7f5ed27ff700 1 -- 172.21.15.72:0/4225384275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ecc154060 msgr2=0x7f5ecc0c2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.381+0000 7f5ed27ff700 1 --2- 172.21.15.72:0/4225384275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ecc154060 0x7f5ecc0c2910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f5ec000e900 tx=0x7f5ec0009060).stop 2023-08-31T18:47:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.381+0000 7f5ed27ff700 1 -- 172.21.15.72:0/4225384275 shutdown_connections 2023-08-31T18:47:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.381+0000 7f5ed27ff700 1 --2- 172.21.15.72:0/4225384275 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5eb805ee10 0x7f5eb80612d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.381+0000 7f5ed27ff700 1 --2- 172.21.15.72:0/4225384275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ecc1588d0 0x7f5ecc0c2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.381+0000 7f5ed27ff700 1 --2- 172.21.15.72:0/4225384275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ecc0cb9b0 0x7f5ecc158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.381+0000 7f5ed27ff700 1 --2- 172.21.15.72:0/4225384275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ecc154060 0x7f5ecc0c2910 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.381+0000 7f5ed27ff700 1 -- 172.21.15.72:0/4225384275 >> 172.21.15.72:0/4225384275 conn(0x7f5ecc05e870 msgr2=0x7f5ecc0a7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.381+0000 7f5ed27ff700 1 -- 172.21.15.72:0/4225384275 shutdown_connections 2023-08-31T18:47:49.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.381+0000 7f5ed27ff700 1 -- 172.21.15.72:0/4225384275 wait complete. 2023-08-31T18:47:49.399 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-31T18:47:49.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T18:47:49.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.590+0000 7f84913ff700 1 Processor -- start 2023-08-31T18:47:49.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.590+0000 7f84913ff700 1 -- start start 2023-08-31T18:47:49.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.591+0000 7f84913ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f848c14ecd0 0x7f848c1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.591+0000 7f84913ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f848c0c2320 0x7f848c0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.591+0000 7f84913ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848c0c2cc0 con 0x7f848c0c1100 2023-08-31T18:47:49.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.591+0000 7f84913ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c152720 con 0x7f848c14ecd0 2023-08-31T18:47:49.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.591+0000 7f84913ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c06a6b0 con 0x7f848c0c2320 2023-08-31T18:47:49.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.592+0000 7f848affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f848c14ecd0 0x7f848c1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.592+0000 7f848affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f848c14ecd0 0x7f848c1556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60374/0 (socket says 172.21.15.72:60374) 2023-08-31T18:47:49.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.592+0000 7f848affd700 1 -- 172.21.15.72:0/564428991 learned_addr learned my addr 172.21.15.72:0/564428991 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:49.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.592+0000 7f848a7fc700 1 --2- 172.21.15.72:0/564428991 >> v2:172.21.15.146:3300/0 conn(0x7f848c0c2320 0x7f848c0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.592+0000 7f848affd700 1 -- 172.21.15.72:0/564428991 >> v2:172.21.15.146:3300/0 conn(0x7f848c0c2320 msgr2=0x7f848c0c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:49.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.592+0000 7f848affd700 1 --2- 172.21.15.72:0/564428991 >> v2:172.21.15.146:3300/0 conn(0x7f848c0c2320 0x7f848c0c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.592+0000 7f848affd700 1 -- 172.21.15.72:0/564428991 >> v1:172.21.15.146:6789/0 conn(0x7f848c0c1100 legacy=0x7f848c0c1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:49.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.592+0000 7f848affd700 1 -- 172.21.15.72:0/564428991 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c155bc0 con 0x7f848c14ecd0 2023-08-31T18:47:49.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.592+0000 7f848affd700 1 --2- 172.21.15.72:0/564428991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f848c14ecd0 0x7f848c1556d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f848c13b090 tx=0x7f847c0090f0).ready entity=mon.0 client_cookie=6ce760a1e158586 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:49.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.592+0000 7f8489ffb700 1 -- 172.21.15.72:0/564428991 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847c00b5a0 con 0x7f848c14ecd0 2023-08-31T18:47:49.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.592+0000 7f8489ffb700 1 -- 172.21.15.72:0/564428991 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847c00b700 con 0x7f848c14ecd0 2023-08-31T18:47:49.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.592+0000 7f8489ffb700 1 -- 172.21.15.72:0/564428991 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847c00ba80 con 0x7f848c14ecd0 2023-08-31T18:47:49.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.593+0000 7f84913ff700 1 -- 172.21.15.72:0/564428991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f848c14ecd0 msgr2=0x7f848c1556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:49.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.593+0000 7f84913ff700 1 --2- 172.21.15.72:0/564428991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f848c14ecd0 0x7f848c1556d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f848c13b090 tx=0x7f847c0090f0).stop 2023-08-31T18:47:49.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.593+0000 7f84913ff700 1 -- 172.21.15.72:0/564428991 shutdown_connections 2023-08-31T18:47:49.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.593+0000 7f84913ff700 1 --2- 172.21.15.72:0/564428991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f848c14ecd0 0x7f848c1556d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.593+0000 7f84913ff700 1 --2- 172.21.15.72:0/564428991 >> v2:172.21.15.146:3300/0 conn(0x7f848c0c2320 0x7f848c0c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.593+0000 7f84913ff700 1 -- 172.21.15.72:0/564428991 >> 172.21.15.72:0/564428991 conn(0x7f848c0630c0 msgr2=0x7f848c0c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:49.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.593+0000 7f84913ff700 1 -- 172.21.15.72:0/564428991 shutdown_connections 2023-08-31T18:47:49.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.593+0000 7f84913ff700 1 -- 172.21.15.72:0/564428991 wait complete. 2023-08-31T18:47:49.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.595+0000 7f84913ff700 1 Processor -- start 2023-08-31T18:47:49.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.595+0000 7f84913ff700 1 -- start start 2023-08-31T18:47:49.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f84913ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f848c0c1100 0x7f848c14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f84913ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c0c2320 0x7f848c1660c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f84913ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f848c14ecd0 0x7f848c0bcb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f84913ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c0ac400 con 0x7f848c14ecd0 2023-08-31T18:47:49.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f84913ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c1665b0 con 0x7f848c0c2320 2023-08-31T18:47:49.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f84913ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c0ac890 con 0x7f848c0c1100 2023-08-31T18:47:49.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f848b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f848c14ecd0 0x7f848c0bcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f848b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f848c14ecd0 0x7f848c0bcb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60376/0 (socket says 172.21.15.72:60376) 2023-08-31T18:47:49.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f848b7fe700 1 -- 172.21.15.72:0/2103797282 learned_addr learned my addr 172.21.15.72:0/2103797282 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:49.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f848affd700 1 --2- 172.21.15.72:0/2103797282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f848c0c1100 0x7f848c14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f848a7fc700 1 --2- 172.21.15.72:0/2103797282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c0c2320 0x7f848c1660c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f848b7fe700 1 -- 172.21.15.72:0/2103797282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f848c0c1100 msgr2=0x7f848c14e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:49.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f848b7fe700 1 --2- 172.21.15.72:0/2103797282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f848c0c1100 0x7f848c14e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f848b7fe700 1 -- 172.21.15.72:0/2103797282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c0c2320 msgr2=0x7f848c1660c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:49.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f848b7fe700 1 --2- 172.21.15.72:0/2103797282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c0c2320 0x7f848c1660c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f848b7fe700 1 -- 172.21.15.72:0/2103797282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847c009370 con 0x7f848c14ecd0 2023-08-31T18:47:49.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f848a7fc700 1 --2- 172.21.15.72:0/2103797282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c0c2320 0x7f848c1660c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:47:49.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.596+0000 7f848b7fe700 1 --2- 172.21.15.72:0/2103797282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f848c14ecd0 0x7f848c0bcb80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f848400c810 tx=0x7f8484002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:49.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.597+0000 7f8472ffd700 1 -- 172.21.15.72:0/2103797282 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484010510 con 0x7f848c14ecd0 2023-08-31T18:47:49.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.597+0000 7f8472ffd700 1 -- 172.21.15.72:0/2103797282 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84840106b0 con 0x7f848c14ecd0 2023-08-31T18:47:49.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.597+0000 7f8472ffd700 1 -- 172.21.15.72:0/2103797282 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484010a70 con 0x7f848c14ecd0 2023-08-31T18:47:49.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.597+0000 7f84913ff700 1 -- 172.21.15.72:0/2103797282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848c0ab7f0 con 0x7f848c14ecd0 2023-08-31T18:47:49.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.597+0000 7f84913ff700 1 -- 172.21.15.72:0/2103797282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848c0abdb0 con 0x7f848c14ecd0 2023-08-31T18:47:49.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.598+0000 7f84913ff700 1 -- 172.21.15.72:0/2103797282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848c0ac590 con 0x7f848c14ecd0 2023-08-31T18:47:49.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.599+0000 7f8472ffd700 1 -- 172.21.15.72:0/2103797282 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8484012440 con 0x7f848c14ecd0 2023-08-31T18:47:49.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.599+0000 7f8472ffd700 1 --2- 172.21.15.72:0/2103797282 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f847805ede0 0x7f84780612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.600+0000 7f8472ffd700 1 -- 172.21.15.72:0/2103797282 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f84840794e0 con 0x7f848c14ecd0 2023-08-31T18:47:49.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.600+0000 7f848affd700 1 --2- 172.21.15.72:0/2103797282 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f847805ede0 0x7f84780612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.600+0000 7f848affd700 1 --2- 172.21.15.72:0/2103797282 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f847805ede0 0x7f84780612a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f847c009130 tx=0x7f847c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:49.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.603+0000 7f8472ffd700 1 -- 172.21.15.72:0/2103797282 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f84840488f0 con 0x7f848c14ecd0 2023-08-31T18:47:49.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.772+0000 7f84913ff700 1 -- 172.21.15.72:0/2103797282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f848c151b10 con 0x7f848c14ecd0 2023-08-31T18:47:49.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.772+0000 7f8472ffd700 1 -- 172.21.15.72:0/2103797282 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f848404ac30 con 0x7f848c14ecd0 2023-08-31T18:47:49.773 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T18:47:49.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.774+0000 7f84913ff700 1 -- 172.21.15.72:0/2103797282 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f847805ede0 msgr2=0x7f84780612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:49.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.774+0000 7f84913ff700 1 --2- 172.21.15.72:0/2103797282 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f847805ede0 0x7f84780612a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f847c009130 tx=0x7f847c015000).stop 2023-08-31T18:47:49.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.774+0000 7f84913ff700 1 -- 172.21.15.72:0/2103797282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f848c14ecd0 msgr2=0x7f848c0bcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:49.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.774+0000 7f84913ff700 1 --2- 172.21.15.72:0/2103797282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f848c14ecd0 0x7f848c0bcb80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f848400c810 tx=0x7f8484002560).stop 2023-08-31T18:47:49.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.774+0000 7f84913ff700 1 -- 172.21.15.72:0/2103797282 shutdown_connections 2023-08-31T18:47:49.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.774+0000 7f84913ff700 1 --2- 172.21.15.72:0/2103797282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f848c14ecd0 0x7f848c0bcb80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.774+0000 7f84913ff700 1 --2- 172.21.15.72:0/2103797282 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f848c0c1100 0x7f848c14e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.774+0000 7f84913ff700 1 --2- 172.21.15.72:0/2103797282 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f847805ede0 0x7f84780612a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.774+0000 7f84913ff700 1 --2- 172.21.15.72:0/2103797282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c0c2320 0x7f848c1660c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.774+0000 7f84913ff700 1 -- 172.21.15.72:0/2103797282 >> 172.21.15.72:0/2103797282 conn(0x7f848c0630c0 msgr2=0x7f848c0bc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:49.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.774+0000 7f84913ff700 1 -- 172.21.15.72:0/2103797282 shutdown_connections 2023-08-31T18:47:49.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.774+0000 7f84913ff700 1 -- 172.21.15.72:0/2103797282 wait complete. 2023-08-31T18:47:49.791 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T18:47:49.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.982+0000 7fdd143ff700 1 Processor -- start 2023-08-31T18:47:49.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.983+0000 7fdd143ff700 1 -- start start 2023-08-31T18:47:49.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.984+0000 7fdd143ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdd0c154210 0x7fdd0c0630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.984+0000 7fdd143ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0c063a30 con 0x7fdd0c153e30 2023-08-31T18:47:49.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.984+0000 7fdd143ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0c0bfd40 con 0x7fdd0c0635a0 2023-08-31T18:47:49.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.984+0000 7fdd143ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0c1546c0 con 0x7fdd0c154210 2023-08-31T18:47:49.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.984+0000 7fdd1219b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdd0c153e30 0x7fdd0c0c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37754/0 (socket says 172.21.15.72:37754) 2023-08-31T18:47:49.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.984+0000 7fdd1219b700 1 -- 172.21.15.72:0/481824107 learned_addr learned my addr 172.21.15.72:0/481824107 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:47:49.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.984+0000 7fdd1199a700 1 --2- 172.21.15.72:0/481824107 >> v2:172.21.15.146:3300/0 conn(0x7fdd0c154210 0x7fdd0c0630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.984+0000 7fdd11199700 1 -- 172.21.15.72:0/481824107 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660354340 0 0) 0x7fdd0c063a30 con 0x7fdd0c153e30 2023-08-31T18:47:49.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.984+0000 7fdd11199700 1 -- 172.21.15.72:0/481824107 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcf80033f0 con 0x7fdd0c153e30 2023-08-31T18:47:49.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd11199700 1 -- 172.21.15.72:0/481824107 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3839464593 0 0) 0x7fdcf80033f0 con 0x7fdd0c153e30 2023-08-31T18:47:49.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd11199700 1 -- 172.21.15.72:0/481824107 >> v2:172.21.15.146:3300/0 conn(0x7fdd0c154210 msgr2=0x7fdd0c0630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:49.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd11199700 1 --2- 172.21.15.72:0/481824107 >> v2:172.21.15.146:3300/0 conn(0x7fdd0c154210 0x7fdd0c0630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd11199700 1 -- 172.21.15.72:0/481824107 >> v1:172.21.15.146:6789/0 conn(0x7fdd0c0635a0 legacy=0x7fdd0c0c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:49.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd11199700 1 -- 172.21.15.72:0/481824107 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c0c6730 con 0x7fdd0c153e30 2023-08-31T18:47:49.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd11199700 1 -- 172.21.15.72:0/481824107 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fdd08001470 con 0x7fdd0c153e30 2023-08-31T18:47:49.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd11199700 1 -- 172.21.15.72:0/481824107 >> v1:172.21.15.72:6789/0 conn(0x7fdd0c153e30 legacy=0x7fdd0c0c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:49.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd11199700 1 --2- 172.21.15.72:0/481824107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcf80038e0 0x7fdcf8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd11199700 1 --2- 172.21.15.72:0/481824107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcf8004690 0x7fdcf8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd11199700 1 --2- 172.21.15.72:0/481824107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf8005000 0x7fdcf800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd11199700 1 -- 172.21.15.72:0/481824107 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf800bf60 con 0x7fdcf8004690 2023-08-31T18:47:49.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd11199700 1 -- 172.21.15.72:0/481824107 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf800c0a0 con 0x7fdcf8005000 2023-08-31T18:47:49.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd11199700 1 -- 172.21.15.72:0/481824107 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf800c230 con 0x7fdcf80038e0 2023-08-31T18:47:49.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd1199a700 1 --2- 172.21.15.72:0/481824107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcf8004690 0x7fdcf8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd1219b700 1 --2- 172.21.15.72:0/481824107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcf80038e0 0x7fdcf8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.985+0000 7fdd1299c700 1 --2- 172.21.15.72:0/481824107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf8005000 0x7fdcf800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:49.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.986+0000 7fdd1199a700 1 -- 172.21.15.72:0/481824107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcf80038e0 msgr2=0x7fdcf8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:49.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.986+0000 7fdd1199a700 1 --2- 172.21.15.72:0/481824107 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdcf80038e0 0x7fdcf8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.986+0000 7fdd1199a700 1 -- 172.21.15.72:0/481824107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf8005000 msgr2=0x7fdcf800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:49.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.986+0000 7fdd1199a700 1 --2- 172.21.15.72:0/481824107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf8005000 0x7fdcf800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.986+0000 7fdd1199a700 1 -- 172.21.15.72:0/481824107 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf80033f0 con 0x7fdcf8004690 2023-08-31T18:47:49.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.986+0000 7fdd1299c700 1 -- 172.21.15.72:0/481824107 reap_dead start 2023-08-31T18:47:49.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.986+0000 7fdd1199a700 1 --2- 172.21.15.72:0/481824107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcf8004690 0x7fdcf8004b10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fdcfc009a80 tx=0x7fdcfc009060).ready entity=mon.0 client_cookie=1e6fa97870000734 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:49.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.986+0000 7fdd11199700 1 -- 172.21.15.72:0/481824107 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc009430 con 0x7fdcf8004690 2023-08-31T18:47:49.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.986+0000 7fdd11199700 1 -- 172.21.15.72:0/481824107 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc00e640 con 0x7fdcf8004690 2023-08-31T18:47:49.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.986+0000 7fdd11199700 1 -- 172.21.15.72:0/481824107 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc00e9c0 con 0x7fdcf8004690 2023-08-31T18:47:49.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.986+0000 7fdd143ff700 1 -- 172.21.15.72:0/481824107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcf8004690 msgr2=0x7fdcf8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:49.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.986+0000 7fdd143ff700 1 --2- 172.21.15.72:0/481824107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcf8004690 0x7fdcf8004b10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fdcfc009a80 tx=0x7fdcfc009060).stop 2023-08-31T18:47:49.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.987+0000 7fdd143ff700 1 -- 172.21.15.72:0/481824107 shutdown_connections 2023-08-31T18:47:49.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.987+0000 7fdd143ff700 1 --2- 172.21.15.72:0/481824107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcf8004690 0x7fdcf8004b10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:49.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.987+0000 7fdd143ff700 1 -- 172.21.15.72:0/481824107 >> 172.21.15.72:0/481824107 conn(0x7fdd0c05eb20 msgr2=0x7fdd0c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:49.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.987+0000 7fdd143ff700 1 -- 172.21.15.72:0/481824107 shutdown_connections 2023-08-31T18:47:49.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.987+0000 7fdd143ff700 1 -- 172.21.15.72:0/481824107 wait complete. 2023-08-31T18:47:49.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.989+0000 7fdd143ff700 1 Processor -- start 2023-08-31T18:47:49.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.989+0000 7fdd143ff700 1 -- start start 2023-08-31T18:47:49.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.990+0000 7fdd143ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf8004690 0x7fdd0c0aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.990+0000 7fdd143ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd0c0b07e0 0x7fdd0c142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.990+0000 7fdd143ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd0c142880 0x7fdd0c145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:49.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.990+0000 7fdd143ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c1642a0 con 0x7fdd0c142880 2023-08-31T18:47:49.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.990+0000 7fdd143ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0b0c60 con 0x7fdcf8004690 2023-08-31T18:47:49.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.990+0000 7fdd143ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0af530 con 0x7fdd0c0b07e0 2023-08-31T18:47:50.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.990+0000 7fdd1299c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd0c142880 0x7fdd0c145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:50.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.990+0000 7fdd1299c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd0c142880 0x7fdd0c145140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60398/0 (socket says 172.21.15.72:60398) 2023-08-31T18:47:50.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.990+0000 7fdd1299c700 1 -- 172.21.15.72:0/1837094619 learned_addr learned my addr 172.21.15.72:0/1837094619 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:50.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.990+0000 7fdd1219b700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf8004690 0x7fdd0c0aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:50.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.991+0000 7fdd1199a700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd0c0b07e0 0x7fdd0c142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:50.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.991+0000 7fdd1299c700 1 -- 172.21.15.72:0/1837094619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd0c0b07e0 msgr2=0x7fdd0c142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:50.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.991+0000 7fdd1299c700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd0c0b07e0 0x7fdd0c142390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.991+0000 7fdd1299c700 1 -- 172.21.15.72:0/1837094619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf8004690 msgr2=0x7fdd0c0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:50.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.991+0000 7fdd1299c700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf8004690 0x7fdd0c0aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.991+0000 7fdd1299c700 1 -- 172.21.15.72:0/1837094619 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c0af810 con 0x7fdd0c142880 2023-08-31T18:47:50.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.991+0000 7fdd1199a700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd0c0b07e0 0x7fdd0c142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:47:50.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.991+0000 7fdd1219b700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf8004690 0x7fdd0c0aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:47:50.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.991+0000 7fdd1299c700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd0c142880 0x7fdd0c145140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fdd0c0658b0 tx=0x7fdd04007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:50.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.991+0000 7fdd027fc700 1 -- 172.21.15.72:0/1837094619 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04006c30 con 0x7fdd0c142880 2023-08-31T18:47:50.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.991+0000 7fdd027fc700 1 -- 172.21.15.72:0/1837094619 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd04006d90 con 0x7fdd0c142880 2023-08-31T18:47:50.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.991+0000 7fdd143ff700 1 -- 172.21.15.72:0/1837094619 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0c0afaf0 con 0x7fdd0c142880 2023-08-31T18:47:50.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.991+0000 7fdd027fc700 1 -- 172.21.15.72:0/1837094619 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040072a0 con 0x7fdd0c142880 2023-08-31T18:47:50.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.991+0000 7fdd143ff700 1 -- 172.21.15.72:0/1837094619 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0c0b00b0 con 0x7fdd0c142880 2023-08-31T18:47:50.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.992+0000 7fdd143ff700 1 -- 172.21.15.72:0/1837094619 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0c0b0240 con 0x7fdd0c142880 2023-08-31T18:47:50.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.993+0000 7fdd027fc700 1 -- 172.21.15.72:0/1837094619 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fdd04007650 con 0x7fdd0c142880 2023-08-31T18:47:50.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.994+0000 7fdd027fc700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdcf005ee10 0x7fdcf00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:50.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.994+0000 7fdd027fc700 1 -- 172.21.15.72:0/1837094619 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdd04079410 con 0x7fdd0c142880 2023-08-31T18:47:50.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.994+0000 7fdd1219b700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdcf005ee10 0x7fdcf00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:50.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.994+0000 7fdd1219b700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdcf005ee10 0x7fdcf00612d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fdd0c061c20 tx=0x7fdd08009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:50.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:49.997+0000 7fdd027fc700 1 -- 172.21.15.72:0/1837094619 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdd040498f0 con 0x7fdd0c142880 2023-08-31T18:47:50.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.167+0000 7fdd143ff700 1 -- 172.21.15.72:0/1837094619 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdd0c0bffe0 con 0x7fdd0c142880 2023-08-31T18:47:50.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.167+0000 7fdd027fc700 1 -- 172.21.15.72:0/1837094619 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdd0404ab10 con 0x7fdd0c142880 2023-08-31T18:47:50.168 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T18:47:50.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.169+0000 7fdd143ff700 1 -- 172.21.15.72:0/1837094619 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdcf005ee10 msgr2=0x7fdcf00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:50.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.169+0000 7fdd143ff700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdcf005ee10 0x7fdcf00612d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fdd0c061c20 tx=0x7fdd08009040).stop 2023-08-31T18:47:50.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.169+0000 7fdd143ff700 1 -- 172.21.15.72:0/1837094619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd0c142880 msgr2=0x7fdd0c145140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:50.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.169+0000 7fdd143ff700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd0c142880 0x7fdd0c145140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fdd0c0658b0 tx=0x7fdd04007f30).stop 2023-08-31T18:47:50.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.169+0000 7fdd143ff700 1 -- 172.21.15.72:0/1837094619 shutdown_connections 2023-08-31T18:47:50.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.169+0000 7fdd143ff700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd0c142880 0x7fdd0c145140 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.169+0000 7fdd143ff700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdcf005ee10 0x7fdcf00612d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.169+0000 7fdd143ff700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcf8004690 0x7fdd0c0aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.169+0000 7fdd143ff700 1 --2- 172.21.15.72:0/1837094619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd0c0b07e0 0x7fdd0c142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.169+0000 7fdd143ff700 1 -- 172.21.15.72:0/1837094619 >> 172.21.15.72:0/1837094619 conn(0x7fdd0c05eb20 msgr2=0x7fdd0c0c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:50.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.170+0000 7fdd143ff700 1 -- 172.21.15.72:0/1837094619 shutdown_connections 2023-08-31T18:47:50.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.170+0000 7fdd143ff700 1 -- 172.21.15.72:0/1837094619 wait complete. 2023-08-31T18:47:50.187 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T18:47:50.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.376+0000 7f09df1ff700 1 Processor -- start 2023-08-31T18:47:50.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.376+0000 7f09df1ff700 1 -- start start 2023-08-31T18:47:50.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.377+0000 7f09df1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09d80cb9b0 0x7f09d81583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:50.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.377+0000 7f09df1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09d81588d0 0x7f09d8154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:50.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.377+0000 7f09df1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d80c6120 con 0x7f09d8154060 2023-08-31T18:47:50.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.377+0000 7f09df1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d80c1380 con 0x7f09d80cb9b0 2023-08-31T18:47:50.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.377+0000 7f09df1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d80c5e10 con 0x7f09d81588d0 2023-08-31T18:47:50.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.378+0000 7f09dcf9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f09d8154060 0x7f09d8157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37770/0 (socket says 172.21.15.72:37770) 2023-08-31T18:47:50.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.378+0000 7f09dcf9b700 1 -- 172.21.15.72:0/1666351377 learned_addr learned my addr 172.21.15.72:0/1666351377 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:47:50.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.378+0000 7f09d7fff700 1 --2- 172.21.15.72:0/1666351377 >> v2:172.21.15.146:3300/0 conn(0x7f09d80cb9b0 0x7f09d81583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:50.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.378+0000 7f09dd79c700 1 --2- 172.21.15.72:0/1666351377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09d81588d0 0x7f09d8154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:50.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.378+0000 7f09d77fe700 1 -- 172.21.15.72:0/1666351377 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882205675 0 0) 0x7f09d80c6120 con 0x7f09d8154060 2023-08-31T18:47:50.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.378+0000 7f09d77fe700 1 -- 172.21.15.72:0/1666351377 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09c80033f0 con 0x7f09d8154060 2023-08-31T18:47:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.378+0000 7f09dd79c700 1 -- 172.21.15.72:0/1666351377 >> v2:172.21.15.146:3300/0 conn(0x7f09d80cb9b0 msgr2=0x7f09d81583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.378+0000 7f09dd79c700 1 --2- 172.21.15.72:0/1666351377 >> v2:172.21.15.146:3300/0 conn(0x7f09d80cb9b0 0x7f09d81583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.378+0000 7f09dd79c700 1 -- 172.21.15.72:0/1666351377 >> v1:172.21.15.72:6789/0 conn(0x7f09d8154060 legacy=0x7f09d8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.378+0000 7f09dd79c700 1 -- 172.21.15.72:0/1666351377 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d80c0ae0 con 0x7f09d81588d0 2023-08-31T18:47:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.378+0000 7f09dd79c700 1 --2- 172.21.15.72:0/1666351377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09d81588d0 0x7f09d8154440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f09d0009e60 tx=0x7f09d0009780).ready entity=mon.2 client_cookie=1b50675f0a23dc21 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:50.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.379+0000 7f09d77fe700 1 -- 172.21.15.72:0/1666351377 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d000e070 con 0x7f09d81588d0 2023-08-31T18:47:50.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.379+0000 7f09d77fe700 1 -- 172.21.15.72:0/1666351377 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d000bab0 con 0x7f09d81588d0 2023-08-31T18:47:50.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.379+0000 7f09d77fe700 1 -- 172.21.15.72:0/1666351377 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d000be30 con 0x7f09d81588d0 2023-08-31T18:47:50.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.379+0000 7f09df1ff700 1 -- 172.21.15.72:0/1666351377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09d81588d0 msgr2=0x7f09d8154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:50.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.379+0000 7f09df1ff700 1 --2- 172.21.15.72:0/1666351377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09d81588d0 0x7f09d8154440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f09d0009e60 tx=0x7f09d0009780).stop 2023-08-31T18:47:50.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.379+0000 7f09df1ff700 1 -- 172.21.15.72:0/1666351377 shutdown_connections 2023-08-31T18:47:50.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.379+0000 7f09df1ff700 1 --2- 172.21.15.72:0/1666351377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09d81588d0 0x7f09d8154440 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.379+0000 7f09df1ff700 1 --2- 172.21.15.72:0/1666351377 >> v2:172.21.15.146:3300/0 conn(0x7f09d80cb9b0 0x7f09d81583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.379+0000 7f09df1ff700 1 -- 172.21.15.72:0/1666351377 >> 172.21.15.72:0/1666351377 conn(0x7f09d805e870 msgr2=0x7f09d80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.379+0000 7f09df1ff700 1 -- 172.21.15.72:0/1666351377 shutdown_connections 2023-08-31T18:47:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.379+0000 7f09df1ff700 1 -- 172.21.15.72:0/1666351377 wait complete. 2023-08-31T18:47:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.381+0000 7f09df1ff700 1 Processor -- start 2023-08-31T18:47:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.381+0000 7f09df1ff700 1 -- start start 2023-08-31T18:47:50.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.382+0000 7f09df1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09d80cb9b0 0x7f09d81467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:50.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.382+0000 7f09df1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09d8154060 0x7f09d80c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:50.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.382+0000 7f09df1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09d81588d0 0x7f09d80c3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:50.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.382+0000 7f09df1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d80aa840 con 0x7f09d80cb9b0 2023-08-31T18:47:50.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.382+0000 7f09df1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d80ae910 con 0x7f09d8154060 2023-08-31T18:47:50.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.382+0000 7f09df1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d80adfe0 con 0x7f09d81588d0 2023-08-31T18:47:50.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.382+0000 7f09dcf9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09d80cb9b0 0x7f09d81467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:50.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.382+0000 7f09dcf9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09d80cb9b0 0x7f09d81467d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60404/0 (socket says 172.21.15.72:60404) 2023-08-31T18:47:50.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.382+0000 7f09dcf9b700 1 -- 172.21.15.72:0/2856573454 learned_addr learned my addr 172.21.15.72:0/2856573454 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:50.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.382+0000 7f09dcf9b700 1 -- 172.21.15.72:0/2856573454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09d81588d0 msgr2=0x7f09d80c3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:50.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.382+0000 7f09dcf9b700 1 --2- 172.21.15.72:0/2856573454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09d81588d0 0x7f09d80c3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:47:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.382+0000 7f09dcf9b700 1 -- 172.21.15.72:0/2856573454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09d8154060 msgr2=0x7f09d80c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.382+0000 7f09dcf9b700 1 --2- 172.21.15.72:0/2856573454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09d8154060 0x7f09d80c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:47:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.382+0000 7f09dcf9b700 1 -- 172.21.15.72:0/2856573454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d0009a20 con 0x7f09d80cb9b0 2023-08-31T18:47:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.383+0000 7f09dcf9b700 1 --2- 172.21.15.72:0/2856573454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09d80cb9b0 0x7f09d81467d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f09cc00c4b0 tx=0x7f09cc007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.383+0000 7f09d4ff9700 1 -- 172.21.15.72:0/2856573454 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0072e0 con 0x7f09d80cb9b0 2023-08-31T18:47:50.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.383+0000 7f09d4ff9700 1 -- 172.21.15.72:0/2856573454 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc007440 con 0x7f09d80cb9b0 2023-08-31T18:47:50.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.383+0000 7f09df1ff700 1 -- 172.21.15.72:0/2856573454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d80ae2c0 con 0x7f09d80cb9b0 2023-08-31T18:47:50.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.383+0000 7f09d4ff9700 1 -- 172.21.15.72:0/2856573454 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc005880 con 0x7f09d80cb9b0 2023-08-31T18:47:50.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.383+0000 7f09df1ff700 1 -- 172.21.15.72:0/2856573454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d80c4170 con 0x7f09d80cb9b0 2023-08-31T18:47:50.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.384+0000 7f09df1ff700 1 -- 172.21.15.72:0/2856573454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d806c6b0 con 0x7f09d80cb9b0 2023-08-31T18:47:50.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.385+0000 7f09d4ff9700 1 -- 172.21.15.72:0/2856573454 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f09cc005c30 con 0x7f09d80cb9b0 2023-08-31T18:47:50.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.386+0000 7f09d4ff9700 1 --2- 172.21.15.72:0/2856573454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f09bc05ee10 0x7f09bc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.386+0000 7f09d4ff9700 1 -- 172.21.15.72:0/2856573454 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f09cc0794a0 con 0x7f09d80cb9b0 2023-08-31T18:47:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.386+0000 7f09d7fff700 1 --2- 172.21.15.72:0/2856573454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f09bc05ee10 0x7f09bc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.386+0000 7f09d7fff700 1 --2- 172.21.15.72:0/2856573454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f09bc05ee10 0x7f09bc0612d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f09d8152a70 tx=0x7f09c4009060).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.389+0000 7f09d4ff9700 1 -- 172.21.15.72:0/2856573454 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f09cc04aba0 con 0x7f09d80cb9b0 2023-08-31T18:47:50.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.563+0000 7f09df1ff700 1 -- 172.21.15.72:0/2856573454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f09d80c0dc0 con 0x7f09d80cb9b0 2023-08-31T18:47:50.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.564+0000 7f09d4ff9700 1 -- 172.21.15.72:0/2856573454 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+143 (secure 0 0 0) 0x7f09cc018020 con 0x7f09d80cb9b0 2023-08-31T18:47:50.564 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:47:50.565 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T18:47:50.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:47:50.565 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-08-31T18:47:50.565 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "device_health_metrics" 2023-08-31T18:47:50.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:47:50.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:47:50.566 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-08-31T18:47:50.566 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-08-31T18:47:50.566 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:47:50.566 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T18:47:50.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.565+0000 7f09df1ff700 1 -- 172.21.15.72:0/2856573454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f09bc05ee10 msgr2=0x7f09bc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:50.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.565+0000 7f09df1ff700 1 --2- 172.21.15.72:0/2856573454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f09bc05ee10 0x7f09bc0612d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f09d8152a70 tx=0x7f09c4009060).stop 2023-08-31T18:47:50.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.566+0000 7f09df1ff700 1 -- 172.21.15.72:0/2856573454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09d80cb9b0 msgr2=0x7f09d81467d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:50.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.566+0000 7f09df1ff700 1 --2- 172.21.15.72:0/2856573454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09d80cb9b0 0x7f09d81467d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f09cc00c4b0 tx=0x7f09cc007b00).stop 2023-08-31T18:47:50.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.566+0000 7f09df1ff700 1 -- 172.21.15.72:0/2856573454 shutdown_connections 2023-08-31T18:47:50.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.566+0000 7f09df1ff700 1 --2- 172.21.15.72:0/2856573454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f09d81588d0 0x7f09d80c3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:47:50.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.566+0000 7f09df1ff700 1 --2- 172.21.15.72:0/2856573454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09d80cb9b0 0x7f09d81467d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.566+0000 7f09df1ff700 1 --2- 172.21.15.72:0/2856573454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f09bc05ee10 0x7f09bc0612d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.566+0000 7f09df1ff700 1 --2- 172.21.15.72:0/2856573454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09d8154060 0x7f09d80c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:47:50.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.566+0000 7f09df1ff700 1 -- 172.21.15.72:0/2856573454 >> 172.21.15.72:0/2856573454 conn(0x7f09d805e870 msgr2=0x7f09d8063090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:50.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.566+0000 7f09df1ff700 1 -- 172.21.15.72:0/2856573454 shutdown_connections 2023-08-31T18:47:50.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.566+0000 7f09df1ff700 1 -- 172.21.15.72:0/2856573454 wait complete. 2023-08-31T18:47:50.583 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T18:47:50.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-31T18:47:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.774+0000 7fe7befff700 1 Processor -- start 2023-08-31T18:47:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.774+0000 7fe7befff700 1 -- start start 2023-08-31T18:47:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.776+0000 7fe7befff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7b8154120 0x7fe7b80a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.776+0000 7fe7befff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7b8154500 0x7fe7b80646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.776+0000 7fe7befff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b80aa620 con 0x7fe7b8064b90 2023-08-31T18:47:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.776+0000 7fe7befff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b80aa3a0 con 0x7fe7b8154120 2023-08-31T18:47:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.776+0000 7fe7befff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b8064ff0 con 0x7fe7b8154500 2023-08-31T18:47:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.776+0000 7fe7bcd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7b8154120 0x7fe7b80a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.776+0000 7fe7bcd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7b8154120 0x7fe7b80a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60408/0 (socket says 172.21.15.72:60408) 2023-08-31T18:47:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.776+0000 7fe7bcd9b700 1 -- 172.21.15.72:0/1190075361 learned_addr learned my addr 172.21.15.72:0/1190075361 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.776+0000 7fe7bd59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe7b8064b90 0x7fe7b80c0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37780/0 (socket says 172.21.15.72:37780) 2023-08-31T18:47:50.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.776+0000 7fe7b7fff700 1 --2- 172.21.15.72:0/1190075361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7b8154500 0x7fe7b80646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:50.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.776+0000 7fe7b77fe700 1 -- 172.21.15.72:0/1190075361 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255392735 0 0) 0x7fe7b80aa620 con 0x7fe7b8064b90 2023-08-31T18:47:50.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.776+0000 7fe7b77fe700 1 -- 172.21.15.72:0/1190075361 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7a80033f0 con 0x7fe7b8064b90 2023-08-31T18:47:50.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.776+0000 7fe7bcd9b700 1 -- 172.21.15.72:0/1190075361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7b8154500 msgr2=0x7fe7b80646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:50.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.776+0000 7fe7bcd9b700 1 --2- 172.21.15.72:0/1190075361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7b8154500 0x7fe7b80646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.777+0000 7fe7bcd9b700 1 -- 172.21.15.72:0/1190075361 >> v1:172.21.15.72:6789/0 conn(0x7fe7b8064b90 legacy=0x7fe7b80c0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:50.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.777+0000 7fe7bcd9b700 1 -- 172.21.15.72:0/1190075361 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b80c5450 con 0x7fe7b8154120 2023-08-31T18:47:50.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.777+0000 7fe7bcd9b700 1 --2- 172.21.15.72:0/1190075361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7b8154120 0x7fe7b80a9eb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe7ac006fd0 tx=0x7fe7ac0090f0).ready entity=mon.0 client_cookie=628c9a136f7defd2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:50.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.777+0000 7fe7b77fe700 1 -- 172.21.15.72:0/1190075361 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00f510 con 0x7fe7b8154120 2023-08-31T18:47:50.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.777+0000 7fe7b77fe700 1 -- 172.21.15.72:0/1190075361 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac00f670 con 0x7fe7b8154120 2023-08-31T18:47:50.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.777+0000 7fe7b77fe700 1 -- 172.21.15.72:0/1190075361 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00f9f0 con 0x7fe7b8154120 2023-08-31T18:47:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.777+0000 7fe7befff700 1 -- 172.21.15.72:0/1190075361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7b8154120 msgr2=0x7fe7b80a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.777+0000 7fe7befff700 1 --2- 172.21.15.72:0/1190075361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7b8154120 0x7fe7b80a9eb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe7ac006fd0 tx=0x7fe7ac0090f0).stop 2023-08-31T18:47:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.777+0000 7fe7befff700 1 -- 172.21.15.72:0/1190075361 shutdown_connections 2023-08-31T18:47:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.777+0000 7fe7befff700 1 --2- 172.21.15.72:0/1190075361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7b8154120 0x7fe7b80a9eb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.778+0000 7fe7befff700 1 --2- 172.21.15.72:0/1190075361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7b8154500 0x7fe7b80646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.778+0000 7fe7befff700 1 -- 172.21.15.72:0/1190075361 >> 172.21.15.72:0/1190075361 conn(0x7fe7b80cb7e0 msgr2=0x7fe7b80c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.778+0000 7fe7befff700 1 -- 172.21.15.72:0/1190075361 shutdown_connections 2023-08-31T18:47:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.778+0000 7fe7befff700 1 -- 172.21.15.72:0/1190075361 wait complete. 2023-08-31T18:47:50.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.780+0000 7fe7befff700 1 Processor -- start 2023-08-31T18:47:50.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.780+0000 7fe7befff700 1 -- start start 2023-08-31T18:47:50.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.781+0000 7fe7befff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7b8064b90 0x7fe7b8141a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:50.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.781+0000 7fe7befff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7b8154120 0x7fe7b80ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:50.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.781+0000 7fe7befff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b8154500 0x7fe7b80afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:50.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.781+0000 7fe7befff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b80af140 con 0x7fe7b8154120 2023-08-31T18:47:50.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.781+0000 7fe7befff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b80af420 con 0x7fe7b8154500 2023-08-31T18:47:50.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.781+0000 7fe7befff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b80c1eb0 con 0x7fe7b8064b90 2023-08-31T18:47:50.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.781+0000 7fe7b7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7b8154120 0x7fe7b80ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:50.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.781+0000 7fe7b7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7b8154120 0x7fe7b80ae6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60418/0 (socket says 172.21.15.72:60418) 2023-08-31T18:47:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.781+0000 7fe7b7fff700 1 -- 172.21.15.72:0/2305462932 learned_addr learned my addr 172.21.15.72:0/2305462932 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.782+0000 7fe7bcd9b700 1 --2- 172.21.15.72:0/2305462932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7b8064b90 0x7fe7b8141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.782+0000 7fe7bd59c700 1 --2- 172.21.15.72:0/2305462932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b8154500 0x7fe7b80afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.782+0000 7fe7b7fff700 1 -- 172.21.15.72:0/2305462932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7b8064b90 msgr2=0x7fe7b8141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.782+0000 7fe7b7fff700 1 --2- 172.21.15.72:0/2305462932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7b8064b90 0x7fe7b8141a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.782+0000 7fe7b7fff700 1 -- 172.21.15.72:0/2305462932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b8154500 msgr2=0x7fe7b80afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:50.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.782+0000 7fe7b7fff700 1 --2- 172.21.15.72:0/2305462932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b8154500 0x7fe7b80afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:50.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.782+0000 7fe7b7fff700 1 -- 172.21.15.72:0/2305462932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac009370 con 0x7fe7b8154120 2023-08-31T18:47:50.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.782+0000 7fe7b7fff700 1 --2- 172.21.15.72:0/2305462932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7b8154120 0x7fe7b80ae6f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe7a400e8d0 tx=0x7fe7a4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:50.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.782+0000 7fe7b4ff9700 1 -- 172.21.15.72:0/2305462932 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a400c640 con 0x7fe7b8154120 2023-08-31T18:47:50.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.782+0000 7fe7b4ff9700 1 -- 172.21.15.72:0/2305462932 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a400c7a0 con 0x7fe7b8154120 2023-08-31T18:47:50.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.782+0000 7fe7befff700 1 -- 172.21.15.72:0/2305462932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b80c2190 con 0x7fe7b8154120 2023-08-31T18:47:50.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.782+0000 7fe7b4ff9700 1 -- 172.21.15.72:0/2305462932 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a400cb20 con 0x7fe7b8154120 2023-08-31T18:47:50.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.782+0000 7fe7befff700 1 -- 172.21.15.72:0/2305462932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b80c4580 con 0x7fe7b8154120 2023-08-31T18:47:50.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.783+0000 7fe7befff700 1 -- 172.21.15.72:0/2305462932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b806a7e0 con 0x7fe7b8154120 2023-08-31T18:47:50.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.784+0000 7fe7b4ff9700 1 -- 172.21.15.72:0/2305462932 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fe7a401b400 con 0x7fe7b8154120 2023-08-31T18:47:50.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.785+0000 7fe7b4ff9700 1 --2- 172.21.15.72:0/2305462932 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe79c05ee10 0x7fe79c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:50.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.785+0000 7fe7b4ff9700 1 -- 172.21.15.72:0/2305462932 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe7a4079ee0 con 0x7fe7b8154120 2023-08-31T18:47:50.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.785+0000 7fe7bcd9b700 1 --2- 172.21.15.72:0/2305462932 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe79c05ee10 0x7fe79c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:50.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.786+0000 7fe7bcd9b700 1 --2- 172.21.15.72:0/2305462932 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe79c05ee10 0x7fe79c0612d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe7ac009130 tx=0x7fe7ac017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:50.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.789+0000 7fe7b4ff9700 1 -- 172.21.15.72:0/2305462932 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe7a404b640 con 0x7fe7b8154120 2023-08-31T18:47:50.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:50.960+0000 7fe7befff700 1 -- 172.21.15.72:0/2305462932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fe7b80b0e60 con 0x7fe7b8154120 2023-08-31T18:47:51.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.496+0000 7fe7b4ff9700 1 -- 172.21.15.72:0/2305462932 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 152+0+0 (secure 0 0 0) 0x7fe7a404ec60 con 0x7fe7b8154120 2023-08-31T18:47:51.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.505+0000 7fe7befff700 1 -- 172.21.15.72:0/2305462932 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe79c05ee10 msgr2=0x7fe79c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:51.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.505+0000 7fe7befff700 1 --2- 172.21.15.72:0/2305462932 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe79c05ee10 0x7fe79c0612d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe7ac009130 tx=0x7fe7ac017000).stop 2023-08-31T18:47:51.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.505+0000 7fe7befff700 1 -- 172.21.15.72:0/2305462932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7b8154120 msgr2=0x7fe7b80ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:51.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.505+0000 7fe7befff700 1 --2- 172.21.15.72:0/2305462932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7b8154120 0x7fe7b80ae6f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fe7a400e8d0 tx=0x7fe7a4009060).stop 2023-08-31T18:47:51.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.506+0000 7fe7befff700 1 -- 172.21.15.72:0/2305462932 shutdown_connections 2023-08-31T18:47:51.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.506+0000 7fe7befff700 1 --2- 172.21.15.72:0/2305462932 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe79c05ee10 0x7fe79c0612d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:51.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.506+0000 7fe7befff700 1 --2- 172.21.15.72:0/2305462932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b8154500 0x7fe7b80afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:51.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.506+0000 7fe7befff700 1 --2- 172.21.15.72:0/2305462932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7b8064b90 0x7fe7b8141a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:51.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.506+0000 7fe7befff700 1 --2- 172.21.15.72:0/2305462932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7b8154120 0x7fe7b80ae6f0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0x7fe7a400e8d0 tx=0x7fe7a4009060).stop 2023-08-31T18:47:51.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.506+0000 7fe7befff700 1 -- 172.21.15.72:0/2305462932 >> 172.21.15.72:0/2305462932 conn(0x7fe7b80cb7e0 msgr2=0x7fe7b8152a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:51.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.510+0000 7fe7befff700 1 -- 172.21.15.72:0/2305462932 shutdown_connections 2023-08-31T18:47:51.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.510+0000 7fe7befff700 1 -- 172.21.15.72:0/2305462932 wait complete. 2023-08-31T18:47:51.511 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-08-31T18:47:51.529 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T18:47:51.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.722+0000 7fb5753ff700 1 Processor -- start 2023-08-31T18:47:51.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.723+0000 7fb5753ff700 1 -- start start 2023-08-31T18:47:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.724+0000 7fb5753ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb570153e30 0x7fb570154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.724+0000 7fb5753ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb5700637c0 0x7fb5700c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.724+0000 7fb5753ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5700bfd40 con 0x7fb5700c5cb0 2023-08-31T18:47:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.724+0000 7fb5753ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5700c6730 con 0x7fb5700637c0 2023-08-31T18:47:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.724+0000 7fb5753ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700bffe0 con 0x7fb570153e30 2023-08-31T18:47:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.724+0000 7fb56e7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb5700c5cb0 0x7fb5700630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37796/0 (socket says 172.21.15.72:37796) 2023-08-31T18:47:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.724+0000 7fb56e7fc700 1 -- 172.21.15.72:0/549659548 learned_addr learned my addr 172.21.15.72:0/549659548 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:47:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.724+0000 7fb56effd700 1 --2- 172.21.15.72:0/549659548 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb570153e30 0x7fb570154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.724+0000 7fb56f7fe700 1 --2- 172.21.15.72:0/549659548 >> v2:172.21.15.146:3300/0 conn(0x7fb5700637c0 0x7fb5700c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.724+0000 7fb56dffb700 1 -- 172.21.15.72:0/549659548 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890097276 0 0) 0x7fb5700bfd40 con 0x7fb5700c5cb0 2023-08-31T18:47:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.725+0000 7fb56dffb700 1 -- 172.21.15.72:0/549659548 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5580033f0 con 0x7fb5700c5cb0 2023-08-31T18:47:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.725+0000 7fb56f7fe700 1 -- 172.21.15.72:0/549659548 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb570153e30 msgr2=0x7fb570154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.725+0000 7fb56f7fe700 1 --2- 172.21.15.72:0/549659548 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb570153e30 0x7fb570154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.725+0000 7fb56f7fe700 1 -- 172.21.15.72:0/549659548 >> v1:172.21.15.72:6789/0 conn(0x7fb5700c5cb0 legacy=0x7fb5700630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:51.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.725+0000 7fb56f7fe700 1 -- 172.21.15.72:0/549659548 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700c02c0 con 0x7fb5700637c0 2023-08-31T18:47:51.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.725+0000 7fb56f7fe700 1 --2- 172.21.15.72:0/549659548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5700637c0 0x7fb5700c6130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb568009e60 tx=0x7fb568009780).ready entity=mon.1 client_cookie=77f0e03f6e631421 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:51.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.725+0000 7fb56dffb700 1 -- 172.21.15.72:0/549659548 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56800e070 con 0x7fb5700637c0 2023-08-31T18:47:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.725+0000 7fb56dffb700 1 -- 172.21.15.72:0/549659548 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56800bab0 con 0x7fb5700637c0 2023-08-31T18:47:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.725+0000 7fb56dffb700 1 -- 172.21.15.72:0/549659548 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56800be30 con 0x7fb5700637c0 2023-08-31T18:47:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.726+0000 7fb5753ff700 1 -- 172.21.15.72:0/549659548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5700637c0 msgr2=0x7fb5700c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.726+0000 7fb5753ff700 1 --2- 172.21.15.72:0/549659548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5700637c0 0x7fb5700c6130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb568009e60 tx=0x7fb568009780).stop 2023-08-31T18:47:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.726+0000 7fb5753ff700 1 -- 172.21.15.72:0/549659548 shutdown_connections 2023-08-31T18:47:51.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.726+0000 7fb5753ff700 1 --2- 172.21.15.72:0/549659548 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5700637c0 0x7fb5700c6130 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:51.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.726+0000 7fb5753ff700 1 --2- 172.21.15.72:0/549659548 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb570153e30 0x7fb570154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:51.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.726+0000 7fb5753ff700 1 -- 172.21.15.72:0/549659548 >> 172.21.15.72:0/549659548 conn(0x7fb57005eb20 msgr2=0x7fb5700cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:51.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.726+0000 7fb5753ff700 1 -- 172.21.15.72:0/549659548 shutdown_connections 2023-08-31T18:47:51.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.726+0000 7fb5753ff700 1 -- 172.21.15.72:0/549659548 wait complete. 2023-08-31T18:47:51.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.727+0000 7fb5753ff700 1 Processor -- start 2023-08-31T18:47:51.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.727+0000 7fb5753ff700 1 -- start start 2023-08-31T18:47:51.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.728+0000 7fb5753ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5700637c0 0x7fb570166ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:51.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.728+0000 7fb5753ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5700c5cb0 0x7fb5700af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:51.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.728+0000 7fb5753ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb570153e30 0x7fb5700af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:51.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.728+0000 7fb5753ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700b0ac0 con 0x7fb5700c5cb0 2023-08-31T18:47:51.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.728+0000 7fb5753ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700afeb0 con 0x7fb5700637c0 2023-08-31T18:47:51.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.728+0000 7fb5753ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700b0190 con 0x7fb570153e30 2023-08-31T18:47:51.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.729+0000 7fb56e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5700c5cb0 0x7fb5700af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:51.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.729+0000 7fb56e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5700c5cb0 0x7fb5700af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60430/0 (socket says 172.21.15.72:60430) 2023-08-31T18:47:51.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.729+0000 7fb56e7fc700 1 -- 172.21.15.72:0/2332359920 learned_addr learned my addr 172.21.15.72:0/2332359920 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.729+0000 7fb56effd700 1 --2- 172.21.15.72:0/2332359920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5700637c0 0x7fb570166ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.729+0000 7fb56f7fe700 1 --2- 172.21.15.72:0/2332359920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb570153e30 0x7fb5700af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.729+0000 7fb56e7fc700 1 -- 172.21.15.72:0/2332359920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb570153e30 msgr2=0x7fb5700af630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.729+0000 7fb56e7fc700 1 --2- 172.21.15.72:0/2332359920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb570153e30 0x7fb5700af630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.729+0000 7fb56e7fc700 1 -- 172.21.15.72:0/2332359920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5700637c0 msgr2=0x7fb570166ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.729+0000 7fb56e7fc700 1 --2- 172.21.15.72:0/2332359920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5700637c0 0x7fb570166ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.729+0000 7fb56e7fc700 1 -- 172.21.15.72:0/2332359920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb568009a20 con 0x7fb5700c5cb0 2023-08-31T18:47:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.729+0000 7fb56e7fc700 1 --2- 172.21.15.72:0/2332359920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5700c5cb0 0x7fb5700af140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fb56400c4c0 tx=0x7fb564007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.729+0000 7fb556ffd700 1 -- 172.21.15.72:0/2332359920 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56400ce70 con 0x7fb5700c5cb0 2023-08-31T18:47:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.729+0000 7fb556ffd700 1 -- 172.21.15.72:0/2332359920 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5640072e0 con 0x7fb5700c5cb0 2023-08-31T18:47:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.729+0000 7fb556ffd700 1 -- 172.21.15.72:0/2332359920 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5640057a0 con 0x7fb5700c5cb0 2023-08-31T18:47:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.729+0000 7fb5753ff700 1 -- 172.21.15.72:0/2332359920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5700b0470 con 0x7fb5700c5cb0 2023-08-31T18:47:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.730+0000 7fb5753ff700 1 -- 172.21.15.72:0/2332359920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5701673d0 con 0x7fb5700c5cb0 2023-08-31T18:47:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.731+0000 7fb5753ff700 1 -- 172.21.15.72:0/2332359920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5700b0c30 con 0x7fb5700c5cb0 2023-08-31T18:47:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.731+0000 7fb556ffd700 1 -- 172.21.15.72:0/2332359920 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb564005bd0 con 0x7fb5700c5cb0 2023-08-31T18:47:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.733+0000 7fb556ffd700 1 --2- 172.21.15.72:0/2332359920 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb55c05ee10 0x7fb55c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:51.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.733+0000 7fb556ffd700 1 -- 172.21.15.72:0/2332359920 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5639+0+0 (secure 0 0 0) 0x7fb564079330 con 0x7fb5700c5cb0 2023-08-31T18:47:51.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.733+0000 7fb56effd700 1 --2- 172.21.15.72:0/2332359920 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb55c05ee10 0x7fb55c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:51.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.733+0000 7fb56effd700 1 --2- 172.21.15.72:0/2332359920 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb55c05ee10 0x7fb55c0612d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb560009c30 tx=0x7fb560009060).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:51.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.737+0000 7fb556ffd700 1 -- 172.21.15.72:0/2332359920 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb56404a980 con 0x7fb5700c5cb0 2023-08-31T18:47:51.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:51.907+0000 7fb5753ff700 1 -- 172.21.15.72:0/2332359920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb57006c6b0 con 0x7fb5700c5cb0 2023-08-31T18:47:52.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.503+0000 7fb556ffd700 1 -- 172.21.15.72:0/2332359920 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb56404dfa0 con 0x7fb5700c5cb0 2023-08-31T18:47:52.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.508+0000 7fb5753ff700 1 -- 172.21.15.72:0/2332359920 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb55c05ee10 msgr2=0x7fb55c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:52.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.508+0000 7fb5753ff700 1 --2- 172.21.15.72:0/2332359920 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb55c05ee10 0x7fb55c0612d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb560009c30 tx=0x7fb560009060).stop 2023-08-31T18:47:52.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.508+0000 7fb5753ff700 1 -- 172.21.15.72:0/2332359920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5700c5cb0 msgr2=0x7fb5700af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:52.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.508+0000 7fb5753ff700 1 --2- 172.21.15.72:0/2332359920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5700c5cb0 0x7fb5700af140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fb56400c4c0 tx=0x7fb564007c50).stop 2023-08-31T18:47:52.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.509+0000 7fb5753ff700 1 -- 172.21.15.72:0/2332359920 shutdown_connections 2023-08-31T18:47:52.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.509+0000 7fb5753ff700 1 --2- 172.21.15.72:0/2332359920 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb570153e30 0x7fb5700af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:52.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.509+0000 7fb5753ff700 1 --2- 172.21.15.72:0/2332359920 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb55c05ee10 0x7fb55c0612d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:52.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.509+0000 7fb5753ff700 1 --2- 172.21.15.72:0/2332359920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5700637c0 0x7fb570166ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:52.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.509+0000 7fb5753ff700 1 --2- 172.21.15.72:0/2332359920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5700c5cb0 0x7fb5700af140 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:52.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.509+0000 7fb5753ff700 1 -- 172.21.15.72:0/2332359920 >> 172.21.15.72:0/2332359920 conn(0x7fb57005eb20 msgr2=0x7fb57006b480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:52.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.511+0000 7fb5753ff700 1 -- 172.21.15.72:0/2332359920 shutdown_connections 2023-08-31T18:47:52.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.512+0000 7fb5753ff700 1 -- 172.21.15.72:0/2332359920 wait complete. 2023-08-31T18:47:52.529 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-08-31T18:47:52.550 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T18:47:52.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.741+0000 7f50093ff700 1 Processor -- start 2023-08-31T18:47:52.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.741+0000 7f50093ff700 1 -- start start 2023-08-31T18:47:52.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.742+0000 7f50093ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5004154030 0x7f5004154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:52.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.742+0000 7f50093ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f50040c7360 0x7f5004063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:52.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.742+0000 7f50093ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50040c6ed0 con 0x7f50040c06b0 2023-08-31T18:47:52.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.742+0000 7f50093ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50040c66e0 con 0x7f5004154030 2023-08-31T18:47:52.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.742+0000 7f50093ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50040c68c0 con 0x7f50040c7360 2023-08-31T18:47:52.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.742+0000 7f5002ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5004154030 0x7f5004154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:52.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.742+0000 7f5002ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5004154030 0x7f5004154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60446/0 (socket says 172.21.15.72:60446) 2023-08-31T18:47:52.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.743+0000 7f5002ffd700 1 -- 172.21.15.72:0/3960888521 learned_addr learned my addr 172.21.15.72:0/3960888521 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:52.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.743+0000 7f50037fe700 1 --2- 172.21.15.72:0/3960888521 >> v2:172.21.15.146:3300/0 conn(0x7f50040c7360 0x7f5004063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:52.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.743+0000 7f5002ffd700 1 -- 172.21.15.72:0/3960888521 >> v2:172.21.15.146:3300/0 conn(0x7f50040c7360 msgr2=0x7f5004063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:52.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.743+0000 7f5002ffd700 1 --2- 172.21.15.72:0/3960888521 >> v2:172.21.15.146:3300/0 conn(0x7f50040c7360 0x7f5004063120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:52.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.743+0000 7f5002ffd700 1 -- 172.21.15.72:0/3960888521 >> v1:172.21.15.146:6789/0 conn(0x7f50040c06b0 legacy=0x7f50040aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:52.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.743+0000 7f5002ffd700 1 -- 172.21.15.72:0/3960888521 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50040c0f30 con 0x7f5004154030 2023-08-31T18:47:52.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.743+0000 7f5002ffd700 1 --2- 172.21.15.72:0/3960888521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5004154030 0x7f5004154410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f50040aad30 tx=0x7f4ff40090f0).ready entity=mon.0 client_cookie=c64f88c905ffc102 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:52.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.743+0000 7f5001ffb700 1 -- 172.21.15.72:0/3960888521 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff400b520 con 0x7f5004154030 2023-08-31T18:47:52.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.743+0000 7f5001ffb700 1 -- 172.21.15.72:0/3960888521 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff400b680 con 0x7f5004154030 2023-08-31T18:47:52.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.743+0000 7f5001ffb700 1 -- 172.21.15.72:0/3960888521 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff400ba20 con 0x7f5004154030 2023-08-31T18:47:52.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.744+0000 7f50093ff700 1 -- 172.21.15.72:0/3960888521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5004154030 msgr2=0x7f5004154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:52.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.744+0000 7f50093ff700 1 --2- 172.21.15.72:0/3960888521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5004154030 0x7f5004154410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f50040aad30 tx=0x7f4ff40090f0).stop 2023-08-31T18:47:52.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.744+0000 7f50093ff700 1 -- 172.21.15.72:0/3960888521 shutdown_connections 2023-08-31T18:47:52.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.744+0000 7f50093ff700 1 --2- 172.21.15.72:0/3960888521 >> v2:172.21.15.146:3300/0 conn(0x7f50040c7360 0x7f5004063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:52.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.744+0000 7f50093ff700 1 --2- 172.21.15.72:0/3960888521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5004154030 0x7f5004154410 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:52.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.744+0000 7f50093ff700 1 -- 172.21.15.72:0/3960888521 >> 172.21.15.72:0/3960888521 conn(0x7f500405eb60 msgr2=0x7f50040cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:52.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.744+0000 7f50093ff700 1 -- 172.21.15.72:0/3960888521 shutdown_connections 2023-08-31T18:47:52.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.744+0000 7f50093ff700 1 -- 172.21.15.72:0/3960888521 wait complete. 2023-08-31T18:47:52.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.746+0000 7f50093ff700 1 Processor -- start 2023-08-31T18:47:52.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.746+0000 7f50093ff700 1 -- start start 2023-08-31T18:47:52.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.747+0000 7f50093ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50040c06b0 0x7f50041685f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:52.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.747+0000 7f50093ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50040c7360 0x7f500415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:52.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.747+0000 7f50093ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5004154030 0x7f5004150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:52.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.747+0000 7f50093ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500415a1d0 con 0x7f5004154030 2023-08-31T18:47:52.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.747+0000 7f50093ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5004168ae0 con 0x7f50040c06b0 2023-08-31T18:47:52.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.747+0000 7f50093ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50041595c0 con 0x7f50040c7360 2023-08-31T18:47:52.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.748+0000 7f50037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5004154030 0x7f5004150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:52.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.748+0000 7f5002ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50040c06b0 0x7f50041685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:52.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.748+0000 7f50037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5004154030 0x7f5004150220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60450/0 (socket says 172.21.15.72:60450) 2023-08-31T18:47:52.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.748+0000 7f50037fe700 1 -- 172.21.15.72:0/46277780 learned_addr learned my addr 172.21.15.72:0/46277780 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:52.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.748+0000 7f50027fc700 1 --2- 172.21.15.72:0/46277780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50040c7360 0x7f500415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:52.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.748+0000 7f50037fe700 1 -- 172.21.15.72:0/46277780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50040c7360 msgr2=0x7f500415a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:52.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.748+0000 7f50037fe700 1 --2- 172.21.15.72:0/46277780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50040c7360 0x7f500415a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:52.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.748+0000 7f50037fe700 1 -- 172.21.15.72:0/46277780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50040c06b0 msgr2=0x7f50041685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.748+0000 7f50037fe700 1 --2- 172.21.15.72:0/46277780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50040c06b0 0x7f50041685f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.748+0000 7f50037fe700 1 -- 172.21.15.72:0/46277780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff4009370 con 0x7f5004154030 2023-08-31T18:47:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.748+0000 7f50037fe700 1 --2- 172.21.15.72:0/46277780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5004154030 0x7f5004150220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f4ffc009e90 tx=0x7f4ffc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.748+0000 7f4feaffd700 1 -- 172.21.15.72:0/46277780 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00caa0 con 0x7f5004154030 2023-08-31T18:47:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.748+0000 7f4feaffd700 1 -- 172.21.15.72:0/46277780 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc00f040 con 0x7f5004154030 2023-08-31T18:47:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.748+0000 7f50093ff700 1 -- 172.21.15.72:0/46277780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50041598a0 con 0x7f5004154030 2023-08-31T18:47:52.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.748+0000 7f4feaffd700 1 -- 172.21.15.72:0/46277780 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc00ce10 con 0x7f5004154030 2023-08-31T18:47:52.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.749+0000 7f50093ff700 1 -- 172.21.15.72:0/46277780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5004159e60 con 0x7f5004154030 2023-08-31T18:47:52.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.750+0000 7f50093ff700 1 -- 172.21.15.72:0/46277780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500415a380 con 0x7f5004154030 2023-08-31T18:47:52.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.751+0000 7f4feaffd700 1 -- 172.21.15.72:0/46277780 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f4ffc013610 con 0x7f5004154030 2023-08-31T18:47:52.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.751+0000 7f4feaffd700 1 --2- 172.21.15.72:0/46277780 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ff005ee10 0x7f4ff00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:52.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.752+0000 7f4feaffd700 1 -- 172.21.15.72:0/46277780 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f4ffc07a5e0 con 0x7f5004154030 2023-08-31T18:47:52.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.752+0000 7f5002ffd700 1 --2- 172.21.15.72:0/46277780 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ff005ee10 0x7f4ff00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:52.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.752+0000 7f5002ffd700 1 --2- 172.21.15.72:0/46277780 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ff005ee10 0x7f4ff00612d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f4ff400b2e0 tx=0x7f4ff4017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:52.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.756+0000 7f4feaffd700 1 -- 172.21.15.72:0/46277780 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f500415a380 con 0x7f5004154030 2023-08-31T18:47:52.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.968+0000 7f50093ff700 1 -- 172.21.15.72:0/46277780 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f500406c6b0 con 0x7f5004154030 2023-08-31T18:47:52.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.975+0000 7f4feaffd700 1 -- 172.21.15.72:0/46277780 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4ffc04f4e0 con 0x7f5004154030 2023-08-31T18:47:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.986+0000 7f50093ff700 1 -- 172.21.15.72:0/46277780 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ff005ee10 msgr2=0x7f4ff00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.986+0000 7f50093ff700 1 --2- 172.21.15.72:0/46277780 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ff005ee10 0x7f4ff00612d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f4ff400b2e0 tx=0x7f4ff4017000).stop 2023-08-31T18:47:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.986+0000 7f50093ff700 1 -- 172.21.15.72:0/46277780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5004154030 msgr2=0x7f5004150220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.986+0000 7f50093ff700 1 --2- 172.21.15.72:0/46277780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5004154030 0x7f5004150220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f4ffc009e90 tx=0x7f4ffc00b040).stop 2023-08-31T18:47:52.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.988+0000 7f50093ff700 1 -- 172.21.15.72:0/46277780 shutdown_connections 2023-08-31T18:47:52.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.988+0000 7f50093ff700 1 --2- 172.21.15.72:0/46277780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5004154030 0x7f5004150220 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:52.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.988+0000 7f50093ff700 1 --2- 172.21.15.72:0/46277780 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ff005ee10 0x7f4ff00612d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:52.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.988+0000 7f50093ff700 1 --2- 172.21.15.72:0/46277780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50040c06b0 0x7f50041685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:52.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.988+0000 7f50093ff700 1 --2- 172.21.15.72:0/46277780 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50040c7360 0x7f500415a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:52.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.988+0000 7f50093ff700 1 -- 172.21.15.72:0/46277780 >> 172.21.15.72:0/46277780 conn(0x7f500405eb60 msgr2=0x7f50041531e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:52.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.990+0000 7f50093ff700 1 -- 172.21.15.72:0/46277780 shutdown_connections 2023-08-31T18:47:52.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:52.990+0000 7f50093ff700 1 -- 172.21.15.72:0/46277780 wait complete. 2023-08-31T18:47:52.998 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 3 and data pool 4 2023-08-31T18:47:53.018 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:47:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.206+0000 7f5acadff700 1 Processor -- start 2023-08-31T18:47:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.206+0000 7f5acadff700 1 -- start start 2023-08-31T18:47:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.207+0000 7f5acadff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ac41505b0 0x7f5ac40c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.207+0000 7f5acadff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5ac41510a0 0x7f5ac40c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.207+0000 7f5acadff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac40641e0 con 0x7f5ac40c2b10 2023-08-31T18:47:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.207+0000 7f5acadff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac40c2720 con 0x7f5ac41505b0 2023-08-31T18:47:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.207+0000 7f5acadff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac4068b90 con 0x7f5ac41510a0 2023-08-31T18:47:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.207+0000 7f5ac8b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ac41505b0 0x7f5ac40c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.208+0000 7f5ac8b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ac41505b0 0x7f5ac40c1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52572/0 (socket says 172.21.15.72:52572) 2023-08-31T18:47:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.208+0000 7f5ac8b9b700 1 -- 172.21.15.72:0/3927213423 learned_addr learned my addr 172.21.15.72:0/3927213423 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.208+0000 7f5ac939c700 1 --2- 172.21.15.72:0/3927213423 >> v2:172.21.15.146:3300/0 conn(0x7f5ac41510a0 0x7f5ac40c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.208+0000 7f5ac8b9b700 1 -- 172.21.15.72:0/3927213423 >> v2:172.21.15.146:3300/0 conn(0x7f5ac41510a0 msgr2=0x7f5ac40c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.208+0000 7f5ac8b9b700 1 --2- 172.21.15.72:0/3927213423 >> v2:172.21.15.146:3300/0 conn(0x7f5ac41510a0 0x7f5ac40c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.208+0000 7f5ac8b9b700 1 -- 172.21.15.72:0/3927213423 >> v1:172.21.15.146:6789/0 conn(0x7f5ac40c2b10 legacy=0x7f5ac4150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.208+0000 7f5ac8b9b700 1 -- 172.21.15.72:0/3927213423 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac4151580 con 0x7f5ac41505b0 2023-08-31T18:47:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.208+0000 7f5ac939c700 1 --2- 172.21.15.72:0/3927213423 >> v2:172.21.15.146:3300/0 conn(0x7f5ac41510a0 0x7f5ac40c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:47:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.208+0000 7f5ac8b9b700 1 --2- 172.21.15.72:0/3927213423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac41505b0 0x7f5ac40c1d40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5ac4063c30 tx=0x7f5ab80090f0).ready entity=mon.0 client_cookie=af5ab9149cf1be7c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.208+0000 7f5ac37fe700 1 -- 172.21.15.72:0/3927213423 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab800b5a0 con 0x7f5ac41505b0 2023-08-31T18:47:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.208+0000 7f5ac37fe700 1 -- 172.21.15.72:0/3927213423 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab800b700 con 0x7f5ac41505b0 2023-08-31T18:47:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.208+0000 7f5ac37fe700 1 -- 172.21.15.72:0/3927213423 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab800ba80 con 0x7f5ac41505b0 2023-08-31T18:47:53.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.209+0000 7f5acadff700 1 -- 172.21.15.72:0/3927213423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac41505b0 msgr2=0x7f5ac40c1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.209+0000 7f5acadff700 1 --2- 172.21.15.72:0/3927213423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac41505b0 0x7f5ac40c1d40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5ac4063c30 tx=0x7f5ab80090f0).stop 2023-08-31T18:47:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.209+0000 7f5acadff700 1 -- 172.21.15.72:0/3927213423 shutdown_connections 2023-08-31T18:47:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.209+0000 7f5acadff700 1 --2- 172.21.15.72:0/3927213423 >> v2:172.21.15.146:3300/0 conn(0x7f5ac41510a0 0x7f5ac40c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.209+0000 7f5acadff700 1 --2- 172.21.15.72:0/3927213423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac41505b0 0x7f5ac40c1d40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.209+0000 7f5acadff700 1 -- 172.21.15.72:0/3927213423 >> 172.21.15.72:0/3927213423 conn(0x7f5ac40c6b10 msgr2=0x7f5ac40c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.209+0000 7f5acadff700 1 -- 172.21.15.72:0/3927213423 shutdown_connections 2023-08-31T18:47:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.209+0000 7f5acadff700 1 -- 172.21.15.72:0/3927213423 wait complete. 2023-08-31T18:47:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.210+0000 7f5acadff700 1 Processor -- start 2023-08-31T18:47:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.211+0000 7f5acadff700 1 -- start start 2023-08-31T18:47:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.211+0000 7f5acadff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac40c2b10 0x7f5ac40ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.211+0000 7f5acadff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ac41505b0 0x7f5ac40c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.211+0000 7f5acadff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ac41510a0 0x7f5ac40c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.211+0000 7f5acadff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40c6550 con 0x7f5ac40c2b10 2023-08-31T18:47:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.211+0000 7f5acadff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40a8f70 con 0x7f5ac41505b0 2023-08-31T18:47:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5acadff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40a9bd0 con 0x7f5ac41510a0 2023-08-31T18:47:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5ac8b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac40c2b10 0x7f5ac40ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5ac8b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac40c2b10 0x7f5ac40ac480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52580/0 (socket says 172.21.15.72:52580) 2023-08-31T18:47:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5ac8b9b700 1 -- 172.21.15.72:0/1031854054 learned_addr learned my addr 172.21.15.72:0/1031854054 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5ac3fff700 1 --2- 172.21.15.72:0/1031854054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ac41505b0 0x7f5ac40c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5ac939c700 1 --2- 172.21.15.72:0/1031854054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ac41510a0 0x7f5ac40c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5ac8b9b700 1 -- 172.21.15.72:0/1031854054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ac41510a0 msgr2=0x7f5ac40c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5ac8b9b700 1 --2- 172.21.15.72:0/1031854054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ac41510a0 0x7f5ac40c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5ac8b9b700 1 -- 172.21.15.72:0/1031854054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ac41505b0 msgr2=0x7f5ac40c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5ac8b9b700 1 --2- 172.21.15.72:0/1031854054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ac41505b0 0x7f5ac40c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5ac8b9b700 1 -- 172.21.15.72:0/1031854054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab8009370 con 0x7f5ac40c2b10 2023-08-31T18:47:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5ac8b9b700 1 --2- 172.21.15.72:0/1031854054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac40c2b10 0x7f5ac40ac480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5ab8009130 tx=0x7f5ab8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5ac0ff9700 1 -- 172.21.15.72:0/1031854054 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab800ba80 con 0x7f5ac40c2b10 2023-08-31T18:47:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5ac0ff9700 1 -- 172.21.15.72:0/1031854054 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab8000d10 con 0x7f5ac40c2b10 2023-08-31T18:47:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5ac0ff9700 1 -- 172.21.15.72:0/1031854054 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab801c670 con 0x7f5ac40c2b10 2023-08-31T18:47:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.212+0000 7f5acadff700 1 -- 172.21.15.72:0/1031854054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac40a9eb0 con 0x7f5ac40c2b10 2023-08-31T18:47:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.213+0000 7f5acadff700 1 -- 172.21.15.72:0/1031854054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac40aa470 con 0x7f5ac40c2b10 2023-08-31T18:47:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.214+0000 7f5acadff700 1 -- 172.21.15.72:0/1031854054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac406c6b0 con 0x7f5ac40c2b10 2023-08-31T18:47:53.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.214+0000 7f5ac0ff9700 1 -- 172.21.15.72:0/1031854054 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f5ab801c9e0 con 0x7f5ac40c2b10 2023-08-31T18:47:53.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.216+0000 7f5ac0ff9700 1 --2- 172.21.15.72:0/1031854054 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5aa805ee10 0x7f5aa80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:53.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.216+0000 7f5ac0ff9700 1 -- 172.21.15.72:0/1031854054 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5ab807bc80 con 0x7f5ac40c2b10 2023-08-31T18:47:53.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.216+0000 7f5ac3fff700 1 --2- 172.21.15.72:0/1031854054 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5aa805ee10 0x7f5aa80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:53.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.217+0000 7f5ac3fff700 1 --2- 172.21.15.72:0/1031854054 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5aa805ee10 0x7f5aa80612d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5ac414b000 tx=0x7f5ab0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:53.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.220+0000 7f5ac0ff9700 1 -- 172.21.15.72:0/1031854054 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5ab804d030 con 0x7f5ac40c2b10 2023-08-31T18:47:53.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.393+0000 7f5acadff700 1 -- 172.21.15.72:0/1031854054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ac40c2880 con 0x7f5ac40c2b10 2023-08-31T18:47:53.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.394+0000 7f5ac0ff9700 1 -- 172.21.15.72:0/1031854054 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17037 (secure 0 0 0) 0x7f5ab802a070 con 0x7f5ac40c2b10 2023-08-31T18:47:53.395 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:47:53.395 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:52.969791+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:47:51.003304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-31T18:47:51.950765+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:47:53.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.396+0000 7f5acadff700 1 -- 172.21.15.72:0/1031854054 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5aa805ee10 msgr2=0x7f5aa80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:53.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.396+0000 7f5acadff700 1 --2- 172.21.15.72:0/1031854054 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5aa805ee10 0x7f5aa80612d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5ac414b000 tx=0x7f5ab0009040).stop 2023-08-31T18:47:53.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.396+0000 7f5acadff700 1 -- 172.21.15.72:0/1031854054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac40c2b10 msgr2=0x7f5ac40ac480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:53.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.396+0000 7f5acadff700 1 --2- 172.21.15.72:0/1031854054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac40c2b10 0x7f5ac40ac480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5ab8009130 tx=0x7f5ab8015000).stop 2023-08-31T18:47:53.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.396+0000 7f5acadff700 1 -- 172.21.15.72:0/1031854054 shutdown_connections 2023-08-31T18:47:53.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.396+0000 7f5acadff700 1 --2- 172.21.15.72:0/1031854054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5ac41510a0 0x7f5ac40c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.396+0000 7f5acadff700 1 --2- 172.21.15.72:0/1031854054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac40c2b10 0x7f5ac40ac480 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.396+0000 7f5acadff700 1 --2- 172.21.15.72:0/1031854054 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5aa805ee10 0x7f5aa80612d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.396+0000 7f5acadff700 1 --2- 172.21.15.72:0/1031854054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ac41505b0 0x7f5ac40c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.396+0000 7f5acadff700 1 -- 172.21.15.72:0/1031854054 >> 172.21.15.72:0/1031854054 conn(0x7f5ac40c6b10 msgr2=0x7f5ac40656d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:53.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.397+0000 7f5acadff700 1 -- 172.21.15.72:0/1031854054 shutdown_connections 2023-08-31T18:47:53.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.397+0000 7f5acadff700 1 -- 172.21.15.72:0/1031854054 wait complete. 2023-08-31T18:47:53.414 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:47:53.485 INFO:tasks.ceph.mds.d.smithi146.stderr:2023-08-31T18:47:53.485+0000 7fe69cff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T18:47:53.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.604+0000 7eff269ff700 1 Processor -- start 2023-08-31T18:47:53.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.604+0000 7eff269ff700 1 -- start start 2023-08-31T18:47:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff269ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7eff20154060 0x7eff20157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff269ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff200cb9b0 0x7eff201581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff269ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff201586b0 0x7eff200c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff269ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff200c1380 con 0x7eff201586b0 2023-08-31T18:47:53.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff269ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff20158b60 con 0x7eff20154060 2023-08-31T18:47:53.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff269ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff200c6120 con 0x7eff200cb9b0 2023-08-31T18:47:53.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff24f9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff201586b0 0x7eff200c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:53.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff24f9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff201586b0 0x7eff200c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52586/0 (socket says 172.21.15.72:52586) 2023-08-31T18:47:53.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff24f9c700 1 -- 172.21.15.72:0/2548691389 learned_addr learned my addr 172.21.15.72:0/2548691389 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:53.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff1ffff700 1 --2- 172.21.15.72:0/2548691389 >> v2:172.21.15.146:3300/0 conn(0x7eff20154060 0x7eff20157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:53.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff1f7fe700 1 --2- 172.21.15.72:0/2548691389 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff200cb9b0 0x7eff201581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:53.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff24f9c700 1 -- 172.21.15.72:0/2548691389 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff200cb9b0 msgr2=0x7eff201581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:53.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff24f9c700 1 --2- 172.21.15.72:0/2548691389 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff200cb9b0 0x7eff201581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff24f9c700 1 -- 172.21.15.72:0/2548691389 >> v2:172.21.15.146:3300/0 conn(0x7eff20154060 msgr2=0x7eff20157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:53.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff24f9c700 1 --2- 172.21.15.72:0/2548691389 >> v2:172.21.15.146:3300/0 conn(0x7eff20154060 0x7eff20157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.606+0000 7eff24f9c700 1 -- 172.21.15.72:0/2548691389 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff200c5e10 con 0x7eff201586b0 2023-08-31T18:47:53.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.607+0000 7eff24f9c700 1 --2- 172.21.15.72:0/2548691389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff201586b0 0x7eff200c65b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7eff201557e0 tx=0x7eff18009840).ready entity=mon.0 client_cookie=3d1a0b837d6c607c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:53.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.607+0000 7eff1effd700 1 -- 172.21.15.72:0/2548691389 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1800e070 con 0x7eff201586b0 2023-08-31T18:47:53.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.607+0000 7eff1effd700 1 -- 172.21.15.72:0/2548691389 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1800b930 con 0x7eff201586b0 2023-08-31T18:47:53.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.607+0000 7eff1effd700 1 -- 172.21.15.72:0/2548691389 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1800bcb0 con 0x7eff201586b0 2023-08-31T18:47:53.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.607+0000 7eff269ff700 1 -- 172.21.15.72:0/2548691389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff201586b0 msgr2=0x7eff200c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:53.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.607+0000 7eff269ff700 1 --2- 172.21.15.72:0/2548691389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff201586b0 0x7eff200c65b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7eff201557e0 tx=0x7eff18009840).stop 2023-08-31T18:47:53.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.607+0000 7eff269ff700 1 -- 172.21.15.72:0/2548691389 shutdown_connections 2023-08-31T18:47:53.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.607+0000 7eff269ff700 1 --2- 172.21.15.72:0/2548691389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff201586b0 0x7eff200c65b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.607+0000 7eff269ff700 1 --2- 172.21.15.72:0/2548691389 >> v2:172.21.15.146:3300/0 conn(0x7eff20154060 0x7eff20157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.607+0000 7eff269ff700 1 --2- 172.21.15.72:0/2548691389 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff200cb9b0 0x7eff201581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.607+0000 7eff269ff700 1 -- 172.21.15.72:0/2548691389 >> 172.21.15.72:0/2548691389 conn(0x7eff2005e870 msgr2=0x7eff200cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:53.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.608+0000 7eff269ff700 1 -- 172.21.15.72:0/2548691389 shutdown_connections 2023-08-31T18:47:53.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.608+0000 7eff269ff700 1 -- 172.21.15.72:0/2548691389 wait complete. 2023-08-31T18:47:53.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.609+0000 7eff269ff700 1 Processor -- start 2023-08-31T18:47:53.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.609+0000 7eff269ff700 1 -- start start 2023-08-31T18:47:53.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.610+0000 7eff269ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff200cb9b0 0x7eff200abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:53.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.610+0000 7eff269ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff20154060 0x7eff20157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:53.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.610+0000 7eff269ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff201586b0 0x7eff20152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:53.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.610+0000 7eff269ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff200ab960 con 0x7eff201586b0 2023-08-31T18:47:53.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.610+0000 7eff269ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff200aad90 con 0x7eff20154060 2023-08-31T18:47:53.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.610+0000 7eff269ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff200ab030 con 0x7eff200cb9b0 2023-08-31T18:47:53.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.610+0000 7eff24f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff201586b0 0x7eff20152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:53.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.610+0000 7eff24f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff201586b0 0x7eff20152200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52592/0 (socket says 172.21.15.72:52592) 2023-08-31T18:47:53.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.610+0000 7eff24f9c700 1 -- 172.21.15.72:0/3543006830 learned_addr learned my addr 172.21.15.72:0/3543006830 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:53.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.611+0000 7eff1f7fe700 1 --2- 172.21.15.72:0/3543006830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff20154060 0x7eff20157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:53.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.611+0000 7eff1ffff700 1 --2- 172.21.15.72:0/3543006830 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff200cb9b0 0x7eff200abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:53.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.611+0000 7eff24f9c700 1 -- 172.21.15.72:0/3543006830 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff200cb9b0 msgr2=0x7eff200abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:53.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.611+0000 7eff24f9c700 1 --2- 172.21.15.72:0/3543006830 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff200cb9b0 0x7eff200abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.611+0000 7eff24f9c700 1 -- 172.21.15.72:0/3543006830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff20154060 msgr2=0x7eff20157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:53.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.611+0000 7eff24f9c700 1 --2- 172.21.15.72:0/3543006830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff20154060 0x7eff20157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.611+0000 7eff24f9c700 1 -- 172.21.15.72:0/3543006830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff18009ae0 con 0x7eff201586b0 2023-08-31T18:47:53.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.611+0000 7eff1ffff700 1 --2- 172.21.15.72:0/3543006830 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff200cb9b0 0x7eff200abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:47:53.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.611+0000 7eff24f9c700 1 --2- 172.21.15.72:0/3543006830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff201586b0 0x7eff20152200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7eff20083570 tx=0x7eff18009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:53.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.611+0000 7eff07fff700 1 -- 172.21.15.72:0/3543006830 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180092e0 con 0x7eff201586b0 2023-08-31T18:47:53.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.611+0000 7eff07fff700 1 -- 172.21.15.72:0/3543006830 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff18013dd0 con 0x7eff201586b0 2023-08-31T18:47:53.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.611+0000 7eff07fff700 1 -- 172.21.15.72:0/3543006830 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1801d6b0 con 0x7eff201586b0 2023-08-31T18:47:53.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.611+0000 7eff269ff700 1 -- 172.21.15.72:0/3543006830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff200ab310 con 0x7eff201586b0 2023-08-31T18:47:53.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.611+0000 7eff269ff700 1 -- 172.21.15.72:0/3543006830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff20157c30 con 0x7eff201586b0 2023-08-31T18:47:53.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.612+0000 7eff269ff700 1 -- 172.21.15.72:0/3543006830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff200c6ba0 con 0x7eff201586b0 2023-08-31T18:47:53.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.613+0000 7eff07fff700 1 -- 172.21.15.72:0/3543006830 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7eff18003040 con 0x7eff201586b0 2023-08-31T18:47:53.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.614+0000 7eff07fff700 1 --2- 172.21.15.72:0/3543006830 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7eff0c05ee10 0x7eff0c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:53.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.614+0000 7eff07fff700 1 -- 172.21.15.72:0/3543006830 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6121+0+0 (secure 0 0 0) 0x7eff1807b1f0 con 0x7eff201586b0 2023-08-31T18:47:53.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.615+0000 7eff1ffff700 1 --2- 172.21.15.72:0/3543006830 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7eff0c05ee10 0x7eff0c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:53.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.615+0000 7eff1ffff700 1 --2- 172.21.15.72:0/3543006830 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7eff0c05ee10 0x7eff0c0612d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7eff10009200 tx=0x7eff10008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:53.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.619+0000 7eff07fff700 1 -- 172.21.15.72:0/3543006830 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7eff1804c5a0 con 0x7eff201586b0 2023-08-31T18:47:53.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.788+0000 7eff269ff700 1 -- 172.21.15.72:0/3543006830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff2006c6b0 con 0x7eff201586b0 2023-08-31T18:47:53.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.789+0000 7eff07fff700 1 -- 172.21.15.72:0/3543006830 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17037 (secure 0 0 0) 0x7eff18022020 con 0x7eff201586b0 2023-08-31T18:47:53.790 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:47:53.790 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:52.969791+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:47:51.003304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-31T18:47:51.950765+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:47:53.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.791+0000 7eff269ff700 1 -- 172.21.15.72:0/3543006830 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7eff0c05ee10 msgr2=0x7eff0c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:53.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.791+0000 7eff269ff700 1 --2- 172.21.15.72:0/3543006830 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7eff0c05ee10 0x7eff0c0612d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7eff10009200 tx=0x7eff10008040).stop 2023-08-31T18:47:53.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.791+0000 7eff269ff700 1 -- 172.21.15.72:0/3543006830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff201586b0 msgr2=0x7eff20152200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:53.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.791+0000 7eff269ff700 1 --2- 172.21.15.72:0/3543006830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff201586b0 0x7eff20152200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7eff20083570 tx=0x7eff18009840).stop 2023-08-31T18:47:53.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.791+0000 7eff269ff700 1 -- 172.21.15.72:0/3543006830 shutdown_connections 2023-08-31T18:47:53.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.791+0000 7eff269ff700 1 --2- 172.21.15.72:0/3543006830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff201586b0 0x7eff20152200 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.791+0000 7eff269ff700 1 --2- 172.21.15.72:0/3543006830 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff200cb9b0 0x7eff200abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.791+0000 7eff269ff700 1 --2- 172.21.15.72:0/3543006830 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7eff0c05ee10 0x7eff0c0612d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.791+0000 7eff269ff700 1 --2- 172.21.15.72:0/3543006830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff20154060 0x7eff20157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:53.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.791+0000 7eff269ff700 1 -- 172.21.15.72:0/3543006830 >> 172.21.15.72:0/3543006830 conn(0x7eff2005e870 msgr2=0x7eff20063550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:53.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.791+0000 7eff269ff700 1 -- 172.21.15.72:0/3543006830 shutdown_connections 2023-08-31T18:47:53.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:53.791+0000 7eff269ff700 1 -- 172.21.15.72:0/3543006830 wait complete. 2023-08-31T18:47:53.809 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T18:47:54.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.000+0000 7f4eaa3ff700 1 Processor -- start 2023-08-31T18:47:54.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.000+0000 7f4eaa3ff700 1 -- start start 2023-08-31T18:47:54.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.002+0000 7f4eaa3ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ea4153e30 0x7f4ea4154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:54.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.002+0000 7f4eaa3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4ea40637c0 0x7f4ea40c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:54.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.002+0000 7f4eaa3ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea40bfd40 con 0x7f4ea40c5cb0 2023-08-31T18:47:54.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.002+0000 7f4eaa3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea40c6730 con 0x7f4ea40637c0 2023-08-31T18:47:54.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.002+0000 7f4eaa3ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea40bffe0 con 0x7f4ea4153e30 2023-08-31T18:47:54.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.002+0000 7f4ea899c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4ea40637c0 0x7f4ea40c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:54.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.002+0000 7f4ea899c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4ea40637c0 0x7f4ea40c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52596/0 (socket says 172.21.15.72:52596) 2023-08-31T18:47:54.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.002+0000 7f4ea899c700 1 -- 172.21.15.72:0/1589424184 learned_addr learned my addr 172.21.15.72:0/1589424184 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:54.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.002+0000 7f4ea3fff700 1 --2- 172.21.15.72:0/1589424184 >> v2:172.21.15.146:3300/0 conn(0x7f4ea4153e30 0x7f4ea4154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:54.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.002+0000 7f4ea899c700 1 -- 172.21.15.72:0/1589424184 >> v2:172.21.15.146:3300/0 conn(0x7f4ea4153e30 msgr2=0x7f4ea4154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:54.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.002+0000 7f4ea899c700 1 --2- 172.21.15.72:0/1589424184 >> v2:172.21.15.146:3300/0 conn(0x7f4ea4153e30 0x7f4ea4154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:54.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.002+0000 7f4ea899c700 1 -- 172.21.15.72:0/1589424184 >> v1:172.21.15.146:6789/0 conn(0x7f4ea40c5cb0 legacy=0x7f4ea40630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:54.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.002+0000 7f4ea899c700 1 -- 172.21.15.72:0/1589424184 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea40c02c0 con 0x7f4ea40637c0 2023-08-31T18:47:54.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.002+0000 7f4ea3fff700 1 --2- 172.21.15.72:0/1589424184 >> v2:172.21.15.146:3300/0 conn(0x7f4ea4153e30 0x7f4ea4154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:47:54.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.002+0000 7f4ea899c700 1 --2- 172.21.15.72:0/1589424184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea40637c0 0x7f4ea40c6160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f4ea406aa50 tx=0x7f4e9c009840).ready entity=mon.0 client_cookie=a0c5f358c4c1532f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:54.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.003+0000 7f4ea2ffd700 1 -- 172.21.15.72:0/1589424184 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c00e070 con 0x7f4ea40637c0 2023-08-31T18:47:54.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.003+0000 7f4ea2ffd700 1 -- 172.21.15.72:0/1589424184 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c00ba10 con 0x7f4ea40637c0 2023-08-31T18:47:54.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.003+0000 7f4ea2ffd700 1 -- 172.21.15.72:0/1589424184 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c00bd90 con 0x7f4ea40637c0 2023-08-31T18:47:54.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.003+0000 7f4eaa3ff700 1 -- 172.21.15.72:0/1589424184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea40637c0 msgr2=0x7f4ea40c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:54.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.003+0000 7f4eaa3ff700 1 --2- 172.21.15.72:0/1589424184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea40637c0 0x7f4ea40c6160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f4ea406aa50 tx=0x7f4e9c009840).stop 2023-08-31T18:47:54.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.003+0000 7f4eaa3ff700 1 -- 172.21.15.72:0/1589424184 shutdown_connections 2023-08-31T18:47:54.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.003+0000 7f4eaa3ff700 1 --2- 172.21.15.72:0/1589424184 >> v2:172.21.15.146:3300/0 conn(0x7f4ea4153e30 0x7f4ea4154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:54.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.003+0000 7f4eaa3ff700 1 --2- 172.21.15.72:0/1589424184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea40637c0 0x7f4ea40c6160 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:54.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.003+0000 7f4eaa3ff700 1 -- 172.21.15.72:0/1589424184 >> 172.21.15.72:0/1589424184 conn(0x7f4ea405eb20 msgr2=0x7f4ea40cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:54.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.003+0000 7f4eaa3ff700 1 -- 172.21.15.72:0/1589424184 shutdown_connections 2023-08-31T18:47:54.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.003+0000 7f4eaa3ff700 1 -- 172.21.15.72:0/1589424184 wait complete. 2023-08-31T18:47:54.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.005+0000 7f4eaa3ff700 1 Processor -- start 2023-08-31T18:47:54.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.006+0000 7f4eaa3ff700 1 -- start start 2023-08-31T18:47:54.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4eaa3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea40637c0 0x7f4ea4155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:54.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4eaa3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ea40c5cb0 0x7f4ea4155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:54.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4eaa3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea4153e30 0x7f4ea414fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:54.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4eaa3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea4156eb0 con 0x7f4ea4153e30 2023-08-31T18:47:54.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4eaa3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea41557f0 con 0x7f4ea40637c0 2023-08-31T18:47:54.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4eaa3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea41562a0 con 0x7f4ea40c5cb0 2023-08-31T18:47:54.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4ea899c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea4153e30 0x7f4ea414fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:54.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4ea899c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea4153e30 0x7f4ea414fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52606/0 (socket says 172.21.15.72:52606) 2023-08-31T18:47:54.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4ea899c700 1 -- 172.21.15.72:0/2838582428 learned_addr learned my addr 172.21.15.72:0/2838582428 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:54.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4ea3fff700 1 --2- 172.21.15.72:0/2838582428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea40637c0 0x7f4ea4155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:54.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4ea899c700 1 -- 172.21.15.72:0/2838582428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ea40c5cb0 msgr2=0x7f4ea4155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:54.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4ea899c700 1 --2- 172.21.15.72:0/2838582428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ea40c5cb0 0x7f4ea4155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:47:54.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4ea899c700 1 -- 172.21.15.72:0/2838582428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea40637c0 msgr2=0x7f4ea4155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:54.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4ea899c700 1 --2- 172.21.15.72:0/2838582428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea40637c0 0x7f4ea4155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:54.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4ea899c700 1 -- 172.21.15.72:0/2838582428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c009ae0 con 0x7f4ea4153e30 2023-08-31T18:47:54.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.007+0000 7f4ea3fff700 1 --2- 172.21.15.72:0/2838582428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea40637c0 0x7f4ea4155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:47:54.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.008+0000 7f4ea899c700 1 --2- 172.21.15.72:0/2838582428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea4153e30 0x7f4ea414fc20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f4e9c010000 tx=0x7f4e9c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:54.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.008+0000 7f4e8bfff700 1 -- 172.21.15.72:0/2838582428 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c01d410 con 0x7f4ea4153e30 2023-08-31T18:47:54.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.008+0000 7f4e8bfff700 1 -- 172.21.15.72:0/2838582428 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c01d570 con 0x7f4ea4153e30 2023-08-31T18:47:54.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.008+0000 7f4e8bfff700 1 -- 172.21.15.72:0/2838582428 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c01d910 con 0x7f4ea4153e30 2023-08-31T18:47:54.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.008+0000 7f4eaa3ff700 1 -- 172.21.15.72:0/2838582428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea4156580 con 0x7f4ea4153e30 2023-08-31T18:47:54.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.008+0000 7f4eaa3ff700 1 -- 172.21.15.72:0/2838582428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea4156b40 con 0x7f4ea4153e30 2023-08-31T18:47:54.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.009+0000 7f4e89ffb700 1 -- 172.21.15.72:0/2838582428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea4157020 con 0x7f4ea4153e30 2023-08-31T18:47:54.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.010+0000 7f4e8bfff700 1 -- 172.21.15.72:0/2838582428 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f4e9c01dd40 con 0x7f4ea4153e30 2023-08-31T18:47:54.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.011+0000 7f4e8bfff700 1 --2- 172.21.15.72:0/2838582428 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4e9005ede0 0x7f4e900612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:54.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.011+0000 7f4e8bfff700 1 -- 172.21.15.72:0/2838582428 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4e9c07bba0 con 0x7f4ea4153e30 2023-08-31T18:47:54.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.011+0000 7f4ea3fff700 1 --2- 172.21.15.72:0/2838582428 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4e9005ede0 0x7f4e900612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:54.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.011+0000 7f4ea3fff700 1 --2- 172.21.15.72:0/2838582428 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4e9005ede0 0x7f4e900612a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4e94006fd0 tx=0x7f4e94008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:54.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.015+0000 7f4e8bfff700 1 -- 172.21.15.72:0/2838582428 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4e9c04d010 con 0x7f4ea4153e30 2023-08-31T18:47:54.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.229+0000 7f4e89ffb700 1 -- 172.21.15.72:0/2838582428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4ea4165210 con 0x7f4ea4153e30 2023-08-31T18:47:54.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.980+0000 7f4e8bfff700 1 -- 172.21.15.72:0/2838582428 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4e9c050630 con 0x7f4ea4153e30 2023-08-31T18:47:54.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.983+0000 7f4e89ffb700 1 -- 172.21.15.72:0/2838582428 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4e9005ede0 msgr2=0x7f4e900612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:54.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.983+0000 7f4e89ffb700 1 --2- 172.21.15.72:0/2838582428 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4e9005ede0 0x7f4e900612a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4e94006fd0 tx=0x7f4e94008040).stop 2023-08-31T18:47:54.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.983+0000 7f4e89ffb700 1 -- 172.21.15.72:0/2838582428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea4153e30 msgr2=0x7f4ea414fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:54.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.983+0000 7f4e89ffb700 1 --2- 172.21.15.72:0/2838582428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea4153e30 0x7f4ea414fc20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f4e9c010000 tx=0x7f4e9c009840).stop 2023-08-31T18:47:54.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.983+0000 7f4e89ffb700 1 -- 172.21.15.72:0/2838582428 shutdown_connections 2023-08-31T18:47:54.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.983+0000 7f4e89ffb700 1 --2- 172.21.15.72:0/2838582428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ea4153e30 0x7f4ea414fc20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:54.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.983+0000 7f4e89ffb700 1 --2- 172.21.15.72:0/2838582428 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4e9005ede0 0x7f4e900612a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:54.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.983+0000 7f4e89ffb700 1 --2- 172.21.15.72:0/2838582428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ea40637c0 0x7f4ea4155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:54.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.983+0000 7f4e89ffb700 1 --2- 172.21.15.72:0/2838582428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ea40c5cb0 0x7f4ea4155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:47:54.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.983+0000 7f4e89ffb700 1 -- 172.21.15.72:0/2838582428 >> 172.21.15.72:0/2838582428 conn(0x7f4ea405eb20 msgr2=0x7f4ea40c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:54.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.983+0000 7f4e89ffb700 1 -- 172.21.15.72:0/2838582428 shutdown_connections 2023-08-31T18:47:54.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:54.983+0000 7f4e89ffb700 1 -- 172.21.15.72:0/2838582428 wait complete. 2023-08-31T18:47:55.001 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-31T18:47:55.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T18:47:55.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.194+0000 7fc682dff700 1 Processor -- start 2023-08-31T18:47:55.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.194+0000 7fc682dff700 1 -- start start 2023-08-31T18:47:55.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.196+0000 7fc682dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc67c154210 0x7fc67c0630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:55.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.196+0000 7fc682dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67c0635a0 0x7fc67c0c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:55.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.196+0000 7fc682dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67c063a00 con 0x7fc67c153e30 2023-08-31T18:47:55.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.196+0000 7fc682dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67c1546c0 con 0x7fc67c154210 2023-08-31T18:47:55.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.196+0000 7fc682dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c0bfd40 con 0x7fc67c0635a0 2023-08-31T18:47:55.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.196+0000 7fc67bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc67c154210 0x7fc67c0630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:55.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.196+0000 7fc67bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc67c154210 0x7fc67c0630b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52608/0 (socket says 172.21.15.72:52608) 2023-08-31T18:47:55.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.196+0000 7fc67bfff700 1 -- 172.21.15.72:0/2128992350 learned_addr learned my addr 172.21.15.72:0/2128992350 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:55.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.196+0000 7fc68139c700 1 --2- 172.21.15.72:0/2128992350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67c0635a0 0x7fc67c0c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:55.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.196+0000 7fc67bfff700 1 -- 172.21.15.72:0/2128992350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67c0635a0 msgr2=0x7fc67c0c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:55.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.196+0000 7fc67bfff700 1 --2- 172.21.15.72:0/2128992350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67c0635a0 0x7fc67c0c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:55.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.196+0000 7fc67bfff700 1 -- 172.21.15.72:0/2128992350 >> v1:172.21.15.146:6789/0 conn(0x7fc67c153e30 legacy=0x7fc67c0c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:55.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.196+0000 7fc67bfff700 1 -- 172.21.15.72:0/2128992350 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c0c6730 con 0x7fc67c154210 2023-08-31T18:47:55.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.196+0000 7fc67bfff700 1 --2- 172.21.15.72:0/2128992350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc67c154210 0x7fc67c0630b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fc668006fd0 tx=0x7fc6680090f0).ready entity=mon.0 client_cookie=81eca229a565f74 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:55.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.197+0000 7fc67b7fe700 1 -- 172.21.15.72:0/2128992350 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66800b600 con 0x7fc67c154210 2023-08-31T18:47:55.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.197+0000 7fc67b7fe700 1 -- 172.21.15.72:0/2128992350 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66800b760 con 0x7fc67c154210 2023-08-31T18:47:55.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.197+0000 7fc67b7fe700 1 -- 172.21.15.72:0/2128992350 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66800bb00 con 0x7fc67c154210 2023-08-31T18:47:55.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.197+0000 7fc682dff700 1 -- 172.21.15.72:0/2128992350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc67c154210 msgr2=0x7fc67c0630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:55.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.197+0000 7fc682dff700 1 --2- 172.21.15.72:0/2128992350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc67c154210 0x7fc67c0630b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fc668006fd0 tx=0x7fc6680090f0).stop 2023-08-31T18:47:55.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.197+0000 7fc682dff700 1 -- 172.21.15.72:0/2128992350 shutdown_connections 2023-08-31T18:47:55.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.197+0000 7fc682dff700 1 --2- 172.21.15.72:0/2128992350 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67c0635a0 0x7fc67c0c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:55.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.197+0000 7fc682dff700 1 --2- 172.21.15.72:0/2128992350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc67c154210 0x7fc67c0630b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:55.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.197+0000 7fc682dff700 1 -- 172.21.15.72:0/2128992350 >> 172.21.15.72:0/2128992350 conn(0x7fc67c05eb20 msgr2=0x7fc67c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:55.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.197+0000 7fc682dff700 1 -- 172.21.15.72:0/2128992350 shutdown_connections 2023-08-31T18:47:55.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.197+0000 7fc682dff700 1 -- 172.21.15.72:0/2128992350 wait complete. 2023-08-31T18:47:55.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.199+0000 7fc682dff700 1 Processor -- start 2023-08-31T18:47:55.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.199+0000 7fc682dff700 1 -- start start 2023-08-31T18:47:55.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.200+0000 7fc682dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67c0635a0 0x7fc67c1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:55.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.200+0000 7fc682dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc67c153e30 0x7fc67c167a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:55.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.200+0000 7fc682dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc67c154210 0x7fc67c167f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:55.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.200+0000 7fc682dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c168420 con 0x7fc67c154210 2023-08-31T18:47:55.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.200+0000 7fc682dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c1426c0 con 0x7fc67c153e30 2023-08-31T18:47:55.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.200+0000 7fc682dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c0b0b90 con 0x7fc67c0635a0 2023-08-31T18:47:55.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.200+0000 7fc68139c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc67c154210 0x7fc67c167f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:55.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.200+0000 7fc68139c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc67c154210 0x7fc67c167f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52610/0 (socket says 172.21.15.72:52610) 2023-08-31T18:47:55.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.200+0000 7fc68139c700 1 -- 172.21.15.72:0/1977193478 learned_addr learned my addr 172.21.15.72:0/1977193478 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:55.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.200+0000 7fc67bfff700 1 --2- 172.21.15.72:0/1977193478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc67c153e30 0x7fc67c167a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:55.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.200+0000 7fc68139c700 1 -- 172.21.15.72:0/1977193478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67c0635a0 msgr2=0x7fc67c1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:55.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.200+0000 7fc68139c700 1 --2- 172.21.15.72:0/1977193478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67c0635a0 0x7fc67c1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:47:55.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.200+0000 7fc68139c700 1 -- 172.21.15.72:0/1977193478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc67c153e30 msgr2=0x7fc67c167a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:55.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.200+0000 7fc68139c700 1 --2- 172.21.15.72:0/1977193478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc67c153e30 0x7fc67c167a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:55.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.201+0000 7fc68139c700 1 -- 172.21.15.72:0/1977193478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc668009370 con 0x7fc67c154210 2023-08-31T18:47:55.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.201+0000 7fc67bfff700 1 --2- 172.21.15.72:0/1977193478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc67c153e30 0x7fc67c167a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:47:55.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.201+0000 7fc68139c700 1 --2- 172.21.15.72:0/1977193478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc67c154210 0x7fc67c167f30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc674009fa0 tx=0x7fc674009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:55.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.201+0000 7fc678ff9700 1 -- 172.21.15.72:0/1977193478 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67400ec60 con 0x7fc67c154210 2023-08-31T18:47:55.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.201+0000 7fc678ff9700 1 -- 172.21.15.72:0/1977193478 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67400edc0 con 0x7fc67c154210 2023-08-31T18:47:55.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.201+0000 7fc682dff700 1 -- 172.21.15.72:0/1977193478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67c1656e0 con 0x7fc67c154210 2023-08-31T18:47:55.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.201+0000 7fc678ff9700 1 -- 172.21.15.72:0/1977193478 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674014610 con 0x7fc67c154210 2023-08-31T18:47:55.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.201+0000 7fc682dff700 1 -- 172.21.15.72:0/1977193478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc67c165a30 con 0x7fc67c154210 2023-08-31T18:47:55.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.202+0000 7fc682dff700 1 -- 172.21.15.72:0/1977193478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67c06c6b0 con 0x7fc67c154210 2023-08-31T18:47:55.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.203+0000 7fc678ff9700 1 -- 172.21.15.72:0/1977193478 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc67401d3b0 con 0x7fc67c154210 2023-08-31T18:47:55.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.204+0000 7fc678ff9700 1 --2- 172.21.15.72:0/1977193478 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc66005ee10 0x7fc6600612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:55.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.204+0000 7fc678ff9700 1 -- 172.21.15.72:0/1977193478 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc67407a3f0 con 0x7fc67c154210 2023-08-31T18:47:55.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.204+0000 7fc680b9b700 1 --2- 172.21.15.72:0/1977193478 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc66005ee10 0x7fc6600612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:55.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.205+0000 7fc680b9b700 1 --2- 172.21.15.72:0/1977193478 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc66005ee10 0x7fc6600612d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc670002560 tx=0x7fc6700079c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:55.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.208+0000 7fc678ff9700 1 -- 172.21.15.72:0/1977193478 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc67404b740 con 0x7fc67c154210 2023-08-31T18:47:55.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.422+0000 7fc682dff700 1 -- 172.21.15.72:0/1977193478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc67c0c0050 con 0x7fc67c154210 2023-08-31T18:47:55.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.986+0000 7fc678ff9700 1 -- 172.21.15.72:0/1977193478 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc67404ed60 con 0x7fc67c154210 2023-08-31T18:47:55.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.989+0000 7fc682dff700 1 -- 172.21.15.72:0/1977193478 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc66005ee10 msgr2=0x7fc6600612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:55.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.989+0000 7fc682dff700 1 --2- 172.21.15.72:0/1977193478 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc66005ee10 0x7fc6600612d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc670002560 tx=0x7fc6700079c0).stop 2023-08-31T18:47:55.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.989+0000 7fc682dff700 1 -- 172.21.15.72:0/1977193478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc67c154210 msgr2=0x7fc67c167f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:55.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.989+0000 7fc682dff700 1 --2- 172.21.15.72:0/1977193478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc67c154210 0x7fc67c167f30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc674009fa0 tx=0x7fc674009900).stop 2023-08-31T18:47:55.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.989+0000 7fc682dff700 1 -- 172.21.15.72:0/1977193478 shutdown_connections 2023-08-31T18:47:55.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.989+0000 7fc682dff700 1 --2- 172.21.15.72:0/1977193478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc67c154210 0x7fc67c167f30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:55.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.989+0000 7fc682dff700 1 --2- 172.21.15.72:0/1977193478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc67c0635a0 0x7fc67c1421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:47:55.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.989+0000 7fc682dff700 1 --2- 172.21.15.72:0/1977193478 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc66005ee10 0x7fc6600612d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:55.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.989+0000 7fc682dff700 1 --2- 172.21.15.72:0/1977193478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc67c153e30 0x7fc67c167a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:55.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.989+0000 7fc682dff700 1 -- 172.21.15.72:0/1977193478 >> 172.21.15.72:0/1977193478 conn(0x7fc67c05eb20 msgr2=0x7fc67c0c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:55.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.989+0000 7fc682dff700 1 -- 172.21.15.72:0/1977193478 shutdown_connections 2023-08-31T18:47:55.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:55.989+0000 7fc682dff700 1 -- 172.21.15.72:0/1977193478 wait complete. 2023-08-31T18:47:56.007 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T18:47:56.007 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T18:47:56.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.195+0000 7fb4e79ff700 1 Processor -- start 2023-08-31T18:47:56.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.195+0000 7fb4e79ff700 1 -- start start 2023-08-31T18:47:56.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.196+0000 7fb4e79ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb4e01505b0 0x7fb4e00c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:56.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.196+0000 7fb4e79ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e01510a0 0x7fb4e00c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:56.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.196+0000 7fb4e79ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e00641e0 con 0x7fb4e00c2b10 2023-08-31T18:47:56.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.196+0000 7fb4e79ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e00c2720 con 0x7fb4e01505b0 2023-08-31T18:47:56.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.196+0000 7fb4e79ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e0068b90 con 0x7fb4e01510a0 2023-08-31T18:47:56.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.196+0000 7fb4e579b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb4e01505b0 0x7fb4e00c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.197+0000 7fb4e579b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb4e01505b0 0x7fb4e00c1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52622/0 (socket says 172.21.15.72:52622) 2023-08-31T18:47:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.197+0000 7fb4e579b700 1 -- 172.21.15.72:0/791260486 learned_addr learned my addr 172.21.15.72:0/791260486 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.197+0000 7fb4e4f9a700 1 --1- 172.21.15.72:0/791260486 >> v1:172.21.15.72:6789/0 conn(0x7fb4e00c2b10 0x7fb4e0150990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44370/0 (socket says 172.21.15.72:44370) 2023-08-31T18:47:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.197+0000 7fb4e5f9c700 1 --2- 172.21.15.72:0/791260486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e01510a0 0x7fb4e00c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.197+0000 7fb4e579b700 1 -- 172.21.15.72:0/791260486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e01510a0 msgr2=0x7fb4e00c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.197+0000 7fb4e579b700 1 --2- 172.21.15.72:0/791260486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e01510a0 0x7fb4e00c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.197+0000 7fb4e579b700 1 -- 172.21.15.72:0/791260486 >> v1:172.21.15.72:6789/0 conn(0x7fb4e00c2b10 legacy=0x7fb4e0150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.197+0000 7fb4e579b700 1 -- 172.21.15.72:0/791260486 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0151580 con 0x7fb4e01505b0 2023-08-31T18:47:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.197+0000 7fb4e5f9c700 1 --2- 172.21.15.72:0/791260486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e01510a0 0x7fb4e00c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:47:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.197+0000 7fb4d7fff700 1 -- 172.21.15.72:0/791260486 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395262209 0 0) 0x7fb4e00641e0 con 0x7fb4e00c2b10 2023-08-31T18:47:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.197+0000 7fb4e579b700 1 --2- 172.21.15.72:0/791260486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e01505b0 0x7fb4e00c1d40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb4dc006fd0 tx=0x7fb4dc0090f0).ready entity=mon.0 client_cookie=a22a1b9eec50cad8 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:56.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.197+0000 7fb4d7fff700 1 -- 172.21.15.72:0/791260486 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00b600 con 0x7fb4e01505b0 2023-08-31T18:47:56.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.197+0000 7fb4d7fff700 1 -- 172.21.15.72:0/791260486 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc00b760 con 0x7fb4e01505b0 2023-08-31T18:47:56.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.197+0000 7fb4d7fff700 1 -- 172.21.15.72:0/791260486 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00bae0 con 0x7fb4e01505b0 2023-08-31T18:47:56.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.198+0000 7fb4e79ff700 1 -- 172.21.15.72:0/791260486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e01505b0 msgr2=0x7fb4e00c1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:56.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.198+0000 7fb4e79ff700 1 --2- 172.21.15.72:0/791260486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e01505b0 0x7fb4e00c1d40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb4dc006fd0 tx=0x7fb4dc0090f0).stop 2023-08-31T18:47:56.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.198+0000 7fb4e79ff700 1 -- 172.21.15.72:0/791260486 shutdown_connections 2023-08-31T18:47:56.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.198+0000 7fb4e79ff700 1 --2- 172.21.15.72:0/791260486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e01505b0 0x7fb4e00c1d40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.198+0000 7fb4e79ff700 1 --2- 172.21.15.72:0/791260486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e01510a0 0x7fb4e00c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.198+0000 7fb4e79ff700 1 -- 172.21.15.72:0/791260486 >> 172.21.15.72:0/791260486 conn(0x7fb4e00c6b10 msgr2=0x7fb4e00c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:56.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.198+0000 7fb4e79ff700 1 -- 172.21.15.72:0/791260486 shutdown_connections 2023-08-31T18:47:56.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.198+0000 7fb4e79ff700 1 -- 172.21.15.72:0/791260486 wait complete. 2023-08-31T18:47:56.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.199+0000 7fb4e79ff700 1 Processor -- start 2023-08-31T18:47:56.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.200+0000 7fb4e79ff700 1 -- start start 2023-08-31T18:47:56.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e79ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e00c2b10 0x7fb4e01531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:56.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e79ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e01505b0 0x7fb4e00be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:56.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e79ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e01510a0 0x7fb4e013c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:56.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e79ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e00beee0 con 0x7fb4e01510a0 2023-08-31T18:47:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e79ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e013cdf0 con 0x7fb4e00c2b10 2023-08-31T18:47:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e79ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e0154470 con 0x7fb4e01505b0 2023-08-31T18:47:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e5f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e01510a0 0x7fb4e013c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e5f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e01510a0 0x7fb4e013c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52624/0 (socket says 172.21.15.72:52624) 2023-08-31T18:47:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e5f9c700 1 -- 172.21.15.72:0/1425458161 learned_addr learned my addr 172.21.15.72:0/1425458161 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e579b700 1 --2- 172.21.15.72:0/1425458161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e00c2b10 0x7fb4e01531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e4f9a700 1 --2- 172.21.15.72:0/1425458161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e01505b0 0x7fb4e00be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e5f9c700 1 -- 172.21.15.72:0/1425458161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e01505b0 msgr2=0x7fb4e00be9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e5f9c700 1 --2- 172.21.15.72:0/1425458161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e01505b0 0x7fb4e00be9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e5f9c700 1 -- 172.21.15.72:0/1425458161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e00c2b10 msgr2=0x7fb4e01531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e5f9c700 1 --2- 172.21.15.72:0/1425458161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e00c2b10 0x7fb4e01531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e5f9c700 1 -- 172.21.15.72:0/1425458161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc009370 con 0x7fb4e01510a0 2023-08-31T18:47:56.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e4f9a700 1 --2- 172.21.15.72:0/1425458161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e01505b0 0x7fb4e00be9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:47:56.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.201+0000 7fb4e5f9c700 1 --2- 172.21.15.72:0/1425458161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e01510a0 0x7fb4e013c900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb4d800cf20 tx=0x7fb4d8007830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:56.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.202+0000 7fb4d57fa700 1 -- 172.21.15.72:0/1425458161 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d800adf0 con 0x7fb4e01510a0 2023-08-31T18:47:56.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.202+0000 7fb4d57fa700 1 -- 172.21.15.72:0/1425458161 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d8016400 con 0x7fb4e01510a0 2023-08-31T18:47:56.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.202+0000 7fb4e79ff700 1 -- 172.21.15.72:0/1425458161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e0149390 con 0x7fb4e01510a0 2023-08-31T18:47:56.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.202+0000 7fb4d57fa700 1 -- 172.21.15.72:0/1425458161 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8016780 con 0x7fb4e01510a0 2023-08-31T18:47:56.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.202+0000 7fb4e79ff700 1 -- 172.21.15.72:0/1425458161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e0153e20 con 0x7fb4e01510a0 2023-08-31T18:47:56.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.203+0000 7fb4e79ff700 1 -- 172.21.15.72:0/1425458161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e006c6b0 con 0x7fb4e01510a0 2023-08-31T18:47:56.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.204+0000 7fb4d57fa700 1 -- 172.21.15.72:0/1425458161 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb4d80203f0 con 0x7fb4e01510a0 2023-08-31T18:47:56.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.205+0000 7fb4d57fa700 1 --2- 172.21.15.72:0/1425458161 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4c405ee10 0x7fb4c40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:56.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.205+0000 7fb4d57fa700 1 -- 172.21.15.72:0/1425458161 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb4d807a880 con 0x7fb4e01510a0 2023-08-31T18:47:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.205+0000 7fb4e579b700 1 --2- 172.21.15.72:0/1425458161 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4c405ee10 0x7fb4c40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.206+0000 7fb4e579b700 1 --2- 172.21.15.72:0/1425458161 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4c405ee10 0x7fb4c40612d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb4dc009130 tx=0x7fb4dc017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.209+0000 7fb4d57fa700 1 -- 172.21.15.72:0/1425458161 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb4d804bc90 con 0x7fb4e01510a0 2023-08-31T18:47:56.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.420+0000 7fb4e79ff700 1 -- 172.21.15.72:0/1425458161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4e013cf40 con 0x7fb4e01510a0 2023-08-31T18:47:56.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.421+0000 7fb4d57fa700 1 -- 172.21.15.72:0/1425458161 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4483 (secure 0 0 0) 0x7fb4d804f2b0 con 0x7fb4e01510a0 2023-08-31T18:47:56.422 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:47:56.422 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/111391994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":111391994},{"type":"v1","addr":"172.21.15.72:6837","nonce":111391994}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/4001102603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4001102603},{"type":"v1","addr":"172.21.15.146:6833","nonce":4001102603}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/522602179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":522602179},{"type":"v1","addr":"172.21.15.72:6835","nonce":522602179}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T18:47:52.970136+0000","modified":"2023-08-31T18:47:55.979886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3888852190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3888852190},{"type":"v1","addr":"172.21.15.146:6835","nonce":3888852190}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-31T18:47:56.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.424+0000 7fb4e79ff700 1 -- 172.21.15.72:0/1425458161 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4c405ee10 msgr2=0x7fb4c40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:56.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.424+0000 7fb4e79ff700 1 --2- 172.21.15.72:0/1425458161 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4c405ee10 0x7fb4c40612d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb4dc009130 tx=0x7fb4dc017000).stop 2023-08-31T18:47:56.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.424+0000 7fb4e79ff700 1 -- 172.21.15.72:0/1425458161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e01510a0 msgr2=0x7fb4e013c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.424+0000 7fb4e79ff700 1 --2- 172.21.15.72:0/1425458161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e01510a0 0x7fb4e013c900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb4d800cf20 tx=0x7fb4d8007830).stop 2023-08-31T18:47:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.424+0000 7fb4e79ff700 1 -- 172.21.15.72:0/1425458161 shutdown_connections 2023-08-31T18:47:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.424+0000 7fb4e79ff700 1 --2- 172.21.15.72:0/1425458161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e01510a0 0x7fb4e013c900 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.424+0000 7fb4e79ff700 1 --2- 172.21.15.72:0/1425458161 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4c405ee10 0x7fb4c40612d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.424+0000 7fb4e79ff700 1 --2- 172.21.15.72:0/1425458161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e00c2b10 0x7fb4e01531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.424+0000 7fb4e79ff700 1 --2- 172.21.15.72:0/1425458161 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e01505b0 0x7fb4e00be9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.424+0000 7fb4e79ff700 1 -- 172.21.15.72:0/1425458161 >> 172.21.15.72:0/1425458161 conn(0x7fb4e00c6b10 msgr2=0x7fb4e00c4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:56.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.424+0000 7fb4e79ff700 1 -- 172.21.15.72:0/1425458161 shutdown_connections 2023-08-31T18:47:56.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.424+0000 7fb4e79ff700 1 -- 172.21.15.72:0/1425458161 wait complete. 2023-08-31T18:47:56.427 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-08-31T18:47:56.441 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:47:56.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.628+0000 7fea3e7ff700 1 Processor -- start 2023-08-31T18:47:56.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.628+0000 7fea3e7ff700 1 -- start start 2023-08-31T18:47:56.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.629+0000 7fea3e7ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fea38154060 0x7fea38157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:56.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.630+0000 7fea3e7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea381588d0 0x7fea38154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:56.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.630+0000 7fea3e7ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea380c6120 con 0x7fea380cb9b0 2023-08-31T18:47:56.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.630+0000 7fea3e7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea380c1380 con 0x7fea381588d0 2023-08-31T18:47:56.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.630+0000 7fea3e7ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea380c5e10 con 0x7fea38154060 2023-08-31T18:47:56.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.630+0000 7fea3cd9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea381588d0 0x7fea38154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:56.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.630+0000 7fea37fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fea38154060 0x7fea38157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:56.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.630+0000 7fea37fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fea38154060 0x7fea38157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:48988/0 (socket says 172.21.15.72:48988) 2023-08-31T18:47:56.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.630+0000 7fea3cd9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea381588d0 0x7fea38154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52636/0 (socket says 172.21.15.72:52636) 2023-08-31T18:47:56.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.630+0000 7fea37fff700 1 -- 172.21.15.72:0/822924090 learned_addr learned my addr 172.21.15.72:0/822924090 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:56.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.630+0000 7fea3cd9c700 1 -- 172.21.15.72:0/822924090 >> v2:172.21.15.146:3300/0 conn(0x7fea38154060 msgr2=0x7fea38157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:56.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.630+0000 7fea3cd9c700 1 --2- 172.21.15.72:0/822924090 >> v2:172.21.15.146:3300/0 conn(0x7fea38154060 0x7fea38157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.630+0000 7fea3cd9c700 1 -- 172.21.15.72:0/822924090 >> v1:172.21.15.146:6789/0 conn(0x7fea380cb9b0 legacy=0x7fea381581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:56.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.630+0000 7fea3cd9c700 1 -- 172.21.15.72:0/822924090 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea380c0ae0 con 0x7fea381588d0 2023-08-31T18:47:56.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.631+0000 7fea3cd9c700 1 --2- 172.21.15.72:0/822924090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea381588d0 0x7fea38154440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fea381557e0 tx=0x7fea30009780).ready entity=mon.0 client_cookie=ad10d36ca3106193 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:56.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.631+0000 7fea36ffd700 1 -- 172.21.15.72:0/822924090 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3000e070 con 0x7fea381588d0 2023-08-31T18:47:56.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.631+0000 7fea36ffd700 1 -- 172.21.15.72:0/822924090 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3000bb60 con 0x7fea381588d0 2023-08-31T18:47:56.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.631+0000 7fea36ffd700 1 -- 172.21.15.72:0/822924090 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30012410 con 0x7fea381588d0 2023-08-31T18:47:56.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.631+0000 7fea3e7ff700 1 -- 172.21.15.72:0/822924090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea381588d0 msgr2=0x7fea38154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:56.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.631+0000 7fea3e7ff700 1 --2- 172.21.15.72:0/822924090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea381588d0 0x7fea38154440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fea381557e0 tx=0x7fea30009780).stop 2023-08-31T18:47:56.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.631+0000 7fea3e7ff700 1 -- 172.21.15.72:0/822924090 shutdown_connections 2023-08-31T18:47:56.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.631+0000 7fea3e7ff700 1 --2- 172.21.15.72:0/822924090 >> v2:172.21.15.146:3300/0 conn(0x7fea38154060 0x7fea38157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.631+0000 7fea3e7ff700 1 --2- 172.21.15.72:0/822924090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea381588d0 0x7fea38154440 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.631+0000 7fea3e7ff700 1 -- 172.21.15.72:0/822924090 >> 172.21.15.72:0/822924090 conn(0x7fea3805e870 msgr2=0x7fea380cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:56.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.631+0000 7fea3e7ff700 1 -- 172.21.15.72:0/822924090 shutdown_connections 2023-08-31T18:47:56.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.631+0000 7fea3e7ff700 1 -- 172.21.15.72:0/822924090 wait complete. 2023-08-31T18:47:56.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.633+0000 7fea3e7ff700 1 Processor -- start 2023-08-31T18:47:56.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.633+0000 7fea3e7ff700 1 -- start start 2023-08-31T18:47:56.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.634+0000 7fea3e7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea380cb9b0 0x7fea381525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:56.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.634+0000 7fea3e7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea38154060 0x7fea381561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:56.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.634+0000 7fea3e7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea381588d0 0x7fea38167520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:56.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.634+0000 7fea3e7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea38157760 con 0x7fea381588d0 2023-08-31T18:47:56.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.634+0000 7fea3e7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea38156b50 con 0x7fea38154060 2023-08-31T18:47:56.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.634+0000 7fea3e7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea38156e30 con 0x7fea380cb9b0 2023-08-31T18:47:56.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.634+0000 7fea3cd9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea381588d0 0x7fea38167520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:56.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.634+0000 7fea3cd9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea381588d0 0x7fea38167520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52646/0 (socket says 172.21.15.72:52646) 2023-08-31T18:47:56.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.634+0000 7fea3cd9c700 1 -- 172.21.15.72:0/3654052823 learned_addr learned my addr 172.21.15.72:0/3654052823 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:56.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.634+0000 7fea377fe700 1 --2- 172.21.15.72:0/3654052823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea38154060 0x7fea381561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:56.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.634+0000 7fea37fff700 1 --2- 172.21.15.72:0/3654052823 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea380cb9b0 0x7fea381525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:56.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.635+0000 7fea3cd9c700 1 -- 172.21.15.72:0/3654052823 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea380cb9b0 msgr2=0x7fea381525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:56.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.635+0000 7fea3cd9c700 1 --2- 172.21.15.72:0/3654052823 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea380cb9b0 0x7fea381525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.635+0000 7fea3cd9c700 1 -- 172.21.15.72:0/3654052823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea38154060 msgr2=0x7fea381561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:56.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.635+0000 7fea3cd9c700 1 --2- 172.21.15.72:0/3654052823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea38154060 0x7fea381561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.635+0000 7fea3cd9c700 1 -- 172.21.15.72:0/3654052823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea30009a20 con 0x7fea381588d0 2023-08-31T18:47:56.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.635+0000 7fea3cd9c700 1 --2- 172.21.15.72:0/3654052823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea381588d0 0x7fea38167520 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fea30011000 tx=0x7fea30009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:56.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.635+0000 7fea1ffff700 1 -- 172.21.15.72:0/3654052823 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3001d630 con 0x7fea381588d0 2023-08-31T18:47:56.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.635+0000 7fea1ffff700 1 -- 172.21.15.72:0/3654052823 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3001d790 con 0x7fea381588d0 2023-08-31T18:47:56.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.635+0000 7fea3e7ff700 1 -- 172.21.15.72:0/3654052823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea38157110 con 0x7fea381588d0 2023-08-31T18:47:56.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.635+0000 7fea1ffff700 1 -- 172.21.15.72:0/3654052823 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3001db30 con 0x7fea381588d0 2023-08-31T18:47:56.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.635+0000 7fea3e7ff700 1 -- 172.21.15.72:0/3654052823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea38152ae0 con 0x7fea381588d0 2023-08-31T18:47:56.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.636+0000 7fea3e7ff700 1 -- 172.21.15.72:0/3654052823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3806c6b0 con 0x7fea381588d0 2023-08-31T18:47:56.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.637+0000 7fea1ffff700 1 -- 172.21.15.72:0/3654052823 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fea30026410 con 0x7fea381588d0 2023-08-31T18:47:56.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.638+0000 7fea1ffff700 1 --2- 172.21.15.72:0/3654052823 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fea2405ee10 0x7fea240612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:56.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.638+0000 7fea1ffff700 1 -- 172.21.15.72:0/3654052823 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fea3007bbc0 con 0x7fea381588d0 2023-08-31T18:47:56.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.638+0000 7fea37fff700 1 --2- 172.21.15.72:0/3654052823 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fea2405ee10 0x7fea240612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:56.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.638+0000 7fea37fff700 1 --2- 172.21.15.72:0/3654052823 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fea2405ee10 0x7fea240612d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fea28009c20 tx=0x7fea28009060).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:56.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.642+0000 7fea1ffff700 1 -- 172.21.15.72:0/3654052823 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fea3004cf10 con 0x7fea381588d0 2023-08-31T18:47:56.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.810+0000 7fea3e7ff700 1 -- 172.21.15.72:0/3654052823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea38167e30 con 0x7fea381588d0 2023-08-31T18:47:56.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.811+0000 7fea1ffff700 1 -- 172.21.15.72:0/3654052823 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17024 (secure 0 0 0) 0x7fea30050530 con 0x7fea381588d0 2023-08-31T18:47:56.812 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:47:56.812 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:53.972412+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:47:51.003304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-31T18:47:51.950765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:47:56.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.813+0000 7fea3e7ff700 1 -- 172.21.15.72:0/3654052823 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fea2405ee10 msgr2=0x7fea240612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:56.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.813+0000 7fea3e7ff700 1 --2- 172.21.15.72:0/3654052823 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fea2405ee10 0x7fea240612d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fea28009c20 tx=0x7fea28009060).stop 2023-08-31T18:47:56.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.813+0000 7fea3e7ff700 1 -- 172.21.15.72:0/3654052823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea381588d0 msgr2=0x7fea38167520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:56.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.813+0000 7fea3e7ff700 1 --2- 172.21.15.72:0/3654052823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea381588d0 0x7fea38167520 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fea30011000 tx=0x7fea30009780).stop 2023-08-31T18:47:56.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.813+0000 7fea3e7ff700 1 -- 172.21.15.72:0/3654052823 shutdown_connections 2023-08-31T18:47:56.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.813+0000 7fea3e7ff700 1 --2- 172.21.15.72:0/3654052823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea381588d0 0x7fea38167520 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.813+0000 7fea3e7ff700 1 --2- 172.21.15.72:0/3654052823 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fea380cb9b0 0x7fea381525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.813+0000 7fea3e7ff700 1 --2- 172.21.15.72:0/3654052823 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fea2405ee10 0x7fea240612d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.813+0000 7fea3e7ff700 1 --2- 172.21.15.72:0/3654052823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea38154060 0x7fea381561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:56.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.813+0000 7fea3e7ff700 1 -- 172.21.15.72:0/3654052823 >> 172.21.15.72:0/3654052823 conn(0x7fea3805e870 msgr2=0x7fea38064770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:56.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.814+0000 7fea3e7ff700 1 -- 172.21.15.72:0/3654052823 shutdown_connections 2023-08-31T18:47:56.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:56.814+0000 7fea3e7ff700 1 -- 172.21.15.72:0/3654052823 wait complete. 2023-08-31T18:47:56.831 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T18:47:56.833 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T18:47:57.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.021+0000 7f1028fff700 1 Processor -- start 2023-08-31T18:47:57.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.022+0000 7f1028fff700 1 -- start start 2023-08-31T18:47:57.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.023+0000 7f1028fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1024154060 0x7f1024157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.023+0000 7f1028fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f10240cb9b0 0x7f10241581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.023+0000 7f1028fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10241586b0 0x7f10240c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.023+0000 7f1028fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10240c1380 con 0x7f10241586b0 2023-08-31T18:47:57.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.023+0000 7f1028fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1024158b40 con 0x7f10240cb9b0 2023-08-31T18:47:57.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.023+0000 7f1028fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10240c6120 con 0x7f1024154060 2023-08-31T18:47:57.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.023+0000 7f1022d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10241586b0 0x7f10240c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.023+0000 7f1022d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10241586b0 0x7f10240c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52656/0 (socket says 172.21.15.72:52656) 2023-08-31T18:47:57.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.023+0000 7f1022d9d700 1 -- 172.21.15.72:0/3284127750 learned_addr learned my addr 172.21.15.72:0/3284127750 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:57.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.023+0000 7f1021d9b700 1 --2- 172.21.15.72:0/3284127750 >> v2:172.21.15.146:3300/0 conn(0x7f10240cb9b0 0x7f10241581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.023+0000 7f102259c700 1 --2- 172.21.15.72:0/3284127750 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1024154060 0x7f1024157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.024+0000 7f1022d9d700 1 -- 172.21.15.72:0/3284127750 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1024154060 msgr2=0x7f1024157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:57.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.024+0000 7f1022d9d700 1 --2- 172.21.15.72:0/3284127750 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1024154060 0x7f1024157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.024+0000 7f1022d9d700 1 -- 172.21.15.72:0/3284127750 >> v2:172.21.15.146:3300/0 conn(0x7f10240cb9b0 msgr2=0x7f10241581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:57.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.024+0000 7f1022d9d700 1 --2- 172.21.15.72:0/3284127750 >> v2:172.21.15.146:3300/0 conn(0x7f10240cb9b0 0x7f10241581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.024+0000 7f1022d9d700 1 -- 172.21.15.72:0/3284127750 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10240c5e10 con 0x7f10241586b0 2023-08-31T18:47:57.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.024+0000 7f1022d9d700 1 --2- 172.21.15.72:0/3284127750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10241586b0 0x7f10240c65b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f10240c8840 tx=0x7f101c009840).ready entity=mon.0 client_cookie=8e3b1b105bf1a1b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:57.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.024+0000 7f102159a700 1 -- 172.21.15.72:0/3284127750 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c00e070 con 0x7f10241586b0 2023-08-31T18:47:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.024+0000 7f102159a700 1 -- 172.21.15.72:0/3284127750 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c00ba50 con 0x7f10241586b0 2023-08-31T18:47:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.024+0000 7f102159a700 1 -- 172.21.15.72:0/3284127750 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c00bdd0 con 0x7f10241586b0 2023-08-31T18:47:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.024+0000 7f1028fff700 1 -- 172.21.15.72:0/3284127750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10241586b0 msgr2=0x7f10240c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.024+0000 7f1028fff700 1 --2- 172.21.15.72:0/3284127750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10241586b0 0x7f10240c65b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f10240c8840 tx=0x7f101c009840).stop 2023-08-31T18:47:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.025+0000 7f1028fff700 1 -- 172.21.15.72:0/3284127750 shutdown_connections 2023-08-31T18:47:57.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.025+0000 7f1028fff700 1 --2- 172.21.15.72:0/3284127750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10241586b0 0x7f10240c65b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.025+0000 7f1028fff700 1 --2- 172.21.15.72:0/3284127750 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1024154060 0x7f1024157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.025+0000 7f1028fff700 1 --2- 172.21.15.72:0/3284127750 >> v2:172.21.15.146:3300/0 conn(0x7f10240cb9b0 0x7f10241581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.025+0000 7f1028fff700 1 -- 172.21.15.72:0/3284127750 >> 172.21.15.72:0/3284127750 conn(0x7f102405e870 msgr2=0x7f10240cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:57.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.025+0000 7f1028fff700 1 -- 172.21.15.72:0/3284127750 shutdown_connections 2023-08-31T18:47:57.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.025+0000 7f1028fff700 1 -- 172.21.15.72:0/3284127750 wait complete. 2023-08-31T18:47:57.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.026+0000 7f1028fff700 1 Processor -- start 2023-08-31T18:47:57.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.026+0000 7f1028fff700 1 -- start start 2023-08-31T18:47:57.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.027+0000 7f1028fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f10240cb9b0 0x7f1024164500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.027+0000 7f1028fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1024154060 0x7f1024166fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.027+0000 7f1028fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10241586b0 0x7f10241674b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.027+0000 7f1028fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1024157660 con 0x7f10241586b0 2023-08-31T18:47:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.027+0000 7f1028fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1024156190 con 0x7f1024154060 2023-08-31T18:47:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.027+0000 7f1028fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1024167a80 con 0x7f10240cb9b0 2023-08-31T18:47:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.027+0000 7f1022d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10241586b0 0x7f10241674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.027+0000 7f1022d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10241586b0 0x7f10241674b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52672/0 (socket says 172.21.15.72:52672) 2023-08-31T18:47:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.027+0000 7f1022d9d700 1 -- 172.21.15.72:0/862394144 learned_addr learned my addr 172.21.15.72:0/862394144 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.028+0000 7f1021d9b700 1 --2- 172.21.15.72:0/862394144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1024154060 0x7f1024166fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.028+0000 7f102259c700 1 --2- 172.21.15.72:0/862394144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f10240cb9b0 0x7f1024164500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.028+0000 7f1022d9d700 1 -- 172.21.15.72:0/862394144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f10240cb9b0 msgr2=0x7f1024164500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.028+0000 7f1022d9d700 1 --2- 172.21.15.72:0/862394144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f10240cb9b0 0x7f1024164500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.028+0000 7f1022d9d700 1 -- 172.21.15.72:0/862394144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1024154060 msgr2=0x7f1024166fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.028+0000 7f1022d9d700 1 --2- 172.21.15.72:0/862394144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1024154060 0x7f1024166fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.028+0000 7f1022d9d700 1 -- 172.21.15.72:0/862394144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c009ae0 con 0x7f10241586b0 2023-08-31T18:47:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.028+0000 7f1022d9d700 1 --2- 172.21.15.72:0/862394144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10241586b0 0x7f10241674b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f101c009fd0 tx=0x7f101c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.028+0000 7f10127fc700 1 -- 172.21.15.72:0/862394144 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c013e60 con 0x7f10241586b0 2023-08-31T18:47:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.028+0000 7f10127fc700 1 -- 172.21.15.72:0/862394144 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c007610 con 0x7f10241586b0 2023-08-31T18:47:57.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.028+0000 7f1028fff700 1 -- 172.21.15.72:0/862394144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1024167d60 con 0x7f10241586b0 2023-08-31T18:47:57.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.028+0000 7f10127fc700 1 -- 172.21.15.72:0/862394144 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c0079d0 con 0x7f10241586b0 2023-08-31T18:47:57.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.028+0000 7f1028fff700 1 -- 172.21.15.72:0/862394144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1024163fe0 con 0x7f10241586b0 2023-08-31T18:47:57.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.030+0000 7f1028fff700 1 -- 172.21.15.72:0/862394144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10241641d0 con 0x7f10241586b0 2023-08-31T18:47:57.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.030+0000 7f10127fc700 1 -- 172.21.15.72:0/862394144 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f101c003040 con 0x7f10241586b0 2023-08-31T18:47:57.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.031+0000 7f10127fc700 1 --2- 172.21.15.72:0/862394144 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f100405ee10 0x7f10040612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.031+0000 7f10127fc700 1 -- 172.21.15.72:0/862394144 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f101c07b9c0 con 0x7f10241586b0 2023-08-31T18:47:57.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.031+0000 7f102259c700 1 --2- 172.21.15.72:0/862394144 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f100405ee10 0x7f10040612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.032+0000 7f102259c700 1 --2- 172.21.15.72:0/862394144 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f100405ee10 0x7f10040612d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1014006fd0 tx=0x7f1014008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:57.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.035+0000 7f10127fc700 1 -- 172.21.15.72:0/862394144 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f101c04cd70 con 0x7f10241586b0 2023-08-31T18:47:57.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.202+0000 7f1028fff700 1 -- 172.21.15.72:0/862394144 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f102406c6b0 con 0x7f100405ee10 2023-08-31T18:47:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.214+0000 7f10127fc700 1 -- 172.21.15.72:0/862394144 <== mgr.4101 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336458 (secure 0 0 0) 0x7f102406c6b0 con 0x7f100405ee10 2023-08-31T18:47:57.218 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:47:57.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.218+0000 7f1028fff700 1 -- 172.21.15.72:0/862394144 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f100405ee10 msgr2=0x7f10040612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.218+0000 7f1028fff700 1 --2- 172.21.15.72:0/862394144 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f100405ee10 0x7f10040612d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f1014006fd0 tx=0x7f1014008040).stop 2023-08-31T18:47:57.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.218+0000 7f1028fff700 1 -- 172.21.15.72:0/862394144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10241586b0 msgr2=0x7f10241674b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.218+0000 7f1028fff700 1 --2- 172.21.15.72:0/862394144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10241586b0 0x7f10241674b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f101c009fd0 tx=0x7f101c009840).stop 2023-08-31T18:47:57.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.218+0000 7f1028fff700 1 -- 172.21.15.72:0/862394144 shutdown_connections 2023-08-31T18:47:57.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.218+0000 7f1028fff700 1 --2- 172.21.15.72:0/862394144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10241586b0 0x7f10241674b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.218+0000 7f1028fff700 1 --2- 172.21.15.72:0/862394144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f10240cb9b0 0x7f1024164500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.218+0000 7f1028fff700 1 --2- 172.21.15.72:0/862394144 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f100405ee10 0x7f10040612d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.218+0000 7f1028fff700 1 --2- 172.21.15.72:0/862394144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1024154060 0x7f1024166fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.218+0000 7f1028fff700 1 -- 172.21.15.72:0/862394144 >> 172.21.15.72:0/862394144 conn(0x7f102405e870 msgr2=0x7f10240648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:57.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.219+0000 7f1028fff700 1 -- 172.21.15.72:0/862394144 shutdown_connections 2023-08-31T18:47:57.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.219+0000 7f1028fff700 1 -- 172.21.15.72:0/862394144 wait complete. 2023-08-31T18:47:57.224 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T18:47:57.236 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-08-31T18:47:57.157912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378528,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596192,"statfs":{"total":773094113280,"available":770658500608,"internally_reserved":0,"allocated":1802240,"data_stored":646476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999933+0000","last_change":"2023-08-31T18:47:52.992922+0000","last_active":"2023-08-31T18:47:52.999933+0000","last_peered":"2023-08-31T18:47:52.999933+0000","last_clean":"2023-08-31T18:47:52.999933+0000","last_became_active":"2023-08-31T18:47:52.992608+0000","last_became_peered":"2023-08-31T18:47:52.992608+0000","last_unstale":"2023-08-31T18:47:52.999933+0000","last_undegraded":"2023-08-31T18:47:52.999933+0000","last_fullsized":"2023-08-31T18:47:52.999933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.996800+0000","last_change":"2023-08-31T18:47:52.521541+0000","last_active":"2023-08-31T18:47:52.996800+0000","last_peered":"2023-08-31T18:47:52.996800+0000","last_clean":"2023-08-31T18:47:52.996800+0000","last_became_active":"2023-08-31T18:47:52.521217+0000","last_became_peered":"2023-08-31T18:47:52.521217+0000","last_unstale":"2023-08-31T18:47:52.996800+0000","last_undegraded":"2023-08-31T18:47:52.996800+0000","last_fullsized":"2023-08-31T18:47:52.996800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000193+0000","last_change":"2023-08-31T18:47:52.996417+0000","last_active":"2023-08-31T18:47:53.000193+0000","last_peered":"2023-08-31T18:47:53.000193+0000","last_clean":"2023-08-31T18:47:53.000193+0000","last_became_active":"2023-08-31T18:47:52.995862+0000","last_became_peered":"2023-08-31T18:47:52.995862+0000","last_unstale":"2023-08-31T18:47:53.000193+0000","last_undegraded":"2023-08-31T18:47:53.000193+0000","last_fullsized":"2023-08-31T18:47:53.000193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980914+0000","last_change":"2023-08-31T18:47:52.518722+0000","last_active":"2023-08-31T18:47:52.980914+0000","last_peered":"2023-08-31T18:47:52.980914+0000","last_clean":"2023-08-31T18:47:52.980914+0000","last_became_active":"2023-08-31T18:47:52.518419+0000","last_became_peered":"2023-08-31T18:47:52.518419+0000","last_unstale":"2023-08-31T18:47:52.980914+0000","last_undegraded":"2023-08-31T18:47:52.980914+0000","last_fullsized":"2023-08-31T18:47:52.980914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009855+0000","last_change":"2023-08-31T18:47:53.001560+0000","last_active":"2023-08-31T18:47:53.009855+0000","last_peered":"2023-08-31T18:47:53.009855+0000","last_clean":"2023-08-31T18:47:53.009855+0000","last_became_active":"2023-08-31T18:47:53.001270+0000","last_became_peered":"2023-08-31T18:47:53.001270+0000","last_unstale":"2023-08-31T18:47:53.009855+0000","last_undegraded":"2023-08-31T18:47:53.009855+0000","last_fullsized":"2023-08-31T18:47:53.009855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979087+0000","last_change":"2023-08-31T18:47:52.525069+0000","last_active":"2023-08-31T18:47:52.979087+0000","last_peered":"2023-08-31T18:47:52.979087+0000","last_clean":"2023-08-31T18:47:52.979087+0000","last_became_active":"2023-08-31T18:47:52.524768+0000","last_became_peered":"2023-08-31T18:47:52.524768+0000","last_unstale":"2023-08-31T18:47:52.979087+0000","last_undegraded":"2023-08-31T18:47:52.979087+0000","last_fullsized":"2023-08-31T18:47:52.979087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999959+0000","last_change":"2023-08-31T18:47:52.992909+0000","last_active":"2023-08-31T18:47:52.999959+0000","last_peered":"2023-08-31T18:47:52.999959+0000","last_clean":"2023-08-31T18:47:52.999959+0000","last_became_active":"2023-08-31T18:47:52.992649+0000","last_became_peered":"2023-08-31T18:47:52.992649+0000","last_unstale":"2023-08-31T18:47:52.999959+0000","last_undegraded":"2023-08-31T18:47:52.999959+0000","last_fullsized":"2023-08-31T18:47:52.999959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.987323+0000","last_change":"2023-08-31T18:47:52.535019+0000","last_active":"2023-08-31T18:47:52.987323+0000","last_peered":"2023-08-31T18:47:52.987323+0000","last_clean":"2023-08-31T18:47:52.987323+0000","last_became_active":"2023-08-31T18:47:52.534783+0000","last_became_peered":"2023-08-31T18:47:52.534783+0000","last_unstale":"2023-08-31T18:47:52.987323+0000","last_undegraded":"2023-08-31T18:47:52.987323+0000","last_fullsized":"2023-08-31T18:47:52.987323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000964+0000","last_change":"2023-08-31T18:47:52.998713+0000","last_active":"2023-08-31T18:47:53.000964+0000","last_peered":"2023-08-31T18:47:53.000964+0000","last_clean":"2023-08-31T18:47:53.000964+0000","last_became_active":"2023-08-31T18:47:52.998411+0000","last_became_peered":"2023-08-31T18:47:52.998411+0000","last_unstale":"2023-08-31T18:47:53.000964+0000","last_undegraded":"2023-08-31T18:47:53.000964+0000","last_fullsized":"2023-08-31T18:47:53.000964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.983910+0000","last_change":"2023-08-31T18:47:52.530799+0000","last_active":"2023-08-31T18:47:52.983910+0000","last_peered":"2023-08-31T18:47:52.983910+0000","last_clean":"2023-08-31T18:47:52.983910+0000","last_became_active":"2023-08-31T18:47:52.530384+0000","last_became_peered":"2023-08-31T18:47:52.530384+0000","last_unstale":"2023-08-31T18:47:52.983910+0000","last_undegraded":"2023-08-31T18:47:52.983910+0000","last_fullsized":"2023-08-31T18:47:52.983910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003882+0000","last_change":"2023-08-31T18:47:52.992664+0000","last_active":"2023-08-31T18:47:53.003882+0000","last_peered":"2023-08-31T18:47:53.003882+0000","last_clean":"2023-08-31T18:47:53.003882+0000","last_became_active":"2023-08-31T18:47:52.992340+0000","last_became_peered":"2023-08-31T18:47:52.992340+0000","last_unstale":"2023-08-31T18:47:53.003882+0000","last_undegraded":"2023-08-31T18:47:53.003882+0000","last_fullsized":"2023-08-31T18:47:53.003882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.008581+0000","last_change":"2023-08-31T18:47:52.518423+0000","last_active":"2023-08-31T18:47:53.008581+0000","last_peered":"2023-08-31T18:47:53.008581+0000","last_clean":"2023-08-31T18:47:53.008581+0000","last_became_active":"2023-08-31T18:47:52.518154+0000","last_became_peered":"2023-08-31T18:47:52.518154+0000","last_unstale":"2023-08-31T18:47:53.008581+0000","last_undegraded":"2023-08-31T18:47:53.008581+0000","last_fullsized":"2023-08-31T18:47:53.008581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013444+0000","last_change":"2023-08-31T18:47:53.010969+0000","last_active":"2023-08-31T18:47:53.013444+0000","last_peered":"2023-08-31T18:47:53.013444+0000","last_clean":"2023-08-31T18:47:53.013444+0000","last_became_active":"2023-08-31T18:47:53.010624+0000","last_became_peered":"2023-08-31T18:47:53.010624+0000","last_unstale":"2023-08-31T18:47:53.013444+0000","last_undegraded":"2023-08-31T18:47:53.013444+0000","last_fullsized":"2023-08-31T18:47:53.013444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.012371+0000","last_change":"2023-08-31T18:47:52.528781+0000","last_active":"2023-08-31T18:47:53.012371+0000","last_peered":"2023-08-31T18:47:53.012371+0000","last_clean":"2023-08-31T18:47:53.012371+0000","last_became_active":"2023-08-31T18:47:52.528511+0000","last_became_peered":"2023-08-31T18:47:52.528511+0000","last_unstale":"2023-08-31T18:47:53.012371+0000","last_undegraded":"2023-08-31T18:47:53.012371+0000","last_fullsized":"2023-08-31T18:47:53.012371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999774+0000","last_change":"2023-08-31T18:47:52.992861+0000","last_active":"2023-08-31T18:47:52.999774+0000","last_peered":"2023-08-31T18:47:52.999774+0000","last_clean":"2023-08-31T18:47:52.999774+0000","last_became_active":"2023-08-31T18:47:52.992558+0000","last_became_peered":"2023-08-31T18:47:52.992558+0000","last_unstale":"2023-08-31T18:47:52.999774+0000","last_undegraded":"2023-08-31T18:47:52.999774+0000","last_fullsized":"2023-08-31T18:47:52.999774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000569+0000","last_change":"2023-08-31T18:47:52.531835+0000","last_active":"2023-08-31T18:47:53.000569+0000","last_peered":"2023-08-31T18:47:53.000569+0000","last_clean":"2023-08-31T18:47:53.000569+0000","last_became_active":"2023-08-31T18:47:52.531561+0000","last_became_peered":"2023-08-31T18:47:52.531561+0000","last_unstale":"2023-08-31T18:47:53.000569+0000","last_undegraded":"2023-08-31T18:47:53.000569+0000","last_fullsized":"2023-08-31T18:47:53.000569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.011345+0000","last_change":"2023-08-31T18:47:53.006651+0000","last_active":"2023-08-31T18:47:53.011345+0000","last_peered":"2023-08-31T18:47:53.011345+0000","last_clean":"2023-08-31T18:47:53.011345+0000","last_became_active":"2023-08-31T18:47:53.006149+0000","last_became_peered":"2023-08-31T18:47:53.006149+0000","last_unstale":"2023-08-31T18:47:53.011345+0000","last_undegraded":"2023-08-31T18:47:53.011345+0000","last_fullsized":"2023-08-31T18:47:53.011345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984191+0000","last_change":"2023-08-31T18:47:52.526672+0000","last_active":"2023-08-31T18:47:52.984191+0000","last_peered":"2023-08-31T18:47:52.984191+0000","last_clean":"2023-08-31T18:47:52.984191+0000","last_became_active":"2023-08-31T18:47:52.526370+0000","last_became_peered":"2023-08-31T18:47:52.526370+0000","last_unstale":"2023-08-31T18:47:52.984191+0000","last_undegraded":"2023-08-31T18:47:52.984191+0000","last_fullsized":"2023-08-31T18:47:52.984191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000173+0000","last_change":"2023-08-31T18:47:52.996230+0000","last_active":"2023-08-31T18:47:53.000173+0000","last_peered":"2023-08-31T18:47:53.000173+0000","last_clean":"2023-08-31T18:47:53.000173+0000","last_became_active":"2023-08-31T18:47:52.995080+0000","last_became_peered":"2023-08-31T18:47:52.995080+0000","last_unstale":"2023-08-31T18:47:53.000173+0000","last_undegraded":"2023-08-31T18:47:53.000173+0000","last_fullsized":"2023-08-31T18:47:53.000173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993377+0000","last_change":"2023-08-31T18:47:52.523040+0000","last_active":"2023-08-31T18:47:52.993377+0000","last_peered":"2023-08-31T18:47:52.993377+0000","last_clean":"2023-08-31T18:47:52.993377+0000","last_became_active":"2023-08-31T18:47:52.522587+0000","last_became_peered":"2023-08-31T18:47:52.522587+0000","last_unstale":"2023-08-31T18:47:52.993377+0000","last_undegraded":"2023-08-31T18:47:52.993377+0000","last_fullsized":"2023-08-31T18:47:52.993377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.004847+0000","last_change":"2023-08-31T18:47:53.002154+0000","last_active":"2023-08-31T18:47:53.004847+0000","last_peered":"2023-08-31T18:47:53.004847+0000","last_clean":"2023-08-31T18:47:53.004847+0000","last_became_active":"2023-08-31T18:47:53.001849+0000","last_became_peered":"2023-08-31T18:47:53.001849+0000","last_unstale":"2023-08-31T18:47:53.004847+0000","last_undegraded":"2023-08-31T18:47:53.004847+0000","last_fullsized":"2023-08-31T18:47:53.004847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.995745+0000","last_change":"2023-08-31T18:47:52.526655+0000","last_active":"2023-08-31T18:47:52.995745+0000","last_peered":"2023-08-31T18:47:52.995745+0000","last_clean":"2023-08-31T18:47:52.995745+0000","last_became_active":"2023-08-31T18:47:52.525963+0000","last_became_peered":"2023-08-31T18:47:52.525963+0000","last_unstale":"2023-08-31T18:47:52.995745+0000","last_undegraded":"2023-08-31T18:47:52.995745+0000","last_fullsized":"2023-08-31T18:47:52.995745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009266+0000","last_change":"2023-08-31T18:47:52.997454+0000","last_active":"2023-08-31T18:47:53.009266+0000","last_peered":"2023-08-31T18:47:53.009266+0000","last_clean":"2023-08-31T18:47:53.009266+0000","last_became_active":"2023-08-31T18:47:52.997016+0000","last_became_peered":"2023-08-31T18:47:52.997016+0000","last_unstale":"2023-08-31T18:47:53.009266+0000","last_undegraded":"2023-08-31T18:47:53.009266+0000","last_fullsized":"2023-08-31T18:47:53.009266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013124+0000","last_change":"2023-08-31T18:47:52.523613+0000","last_active":"2023-08-31T18:47:53.013124+0000","last_peered":"2023-08-31T18:47:53.013124+0000","last_clean":"2023-08-31T18:47:53.013124+0000","last_became_active":"2023-08-31T18:47:52.522576+0000","last_became_peered":"2023-08-31T18:47:52.522576+0000","last_unstale":"2023-08-31T18:47:53.013124+0000","last_undegraded":"2023-08-31T18:47:53.013124+0000","last_fullsized":"2023-08-31T18:47:53.013124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010365+0000","last_change":"2023-08-31T18:47:53.005565+0000","last_active":"2023-08-31T18:47:53.010365+0000","last_peered":"2023-08-31T18:47:53.010365+0000","last_clean":"2023-08-31T18:47:53.010365+0000","last_became_active":"2023-08-31T18:47:53.005190+0000","last_became_peered":"2023-08-31T18:47:53.005190+0000","last_unstale":"2023-08-31T18:47:53.010365+0000","last_undegraded":"2023-08-31T18:47:53.010365+0000","last_fullsized":"2023-08-31T18:47:53.010365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.012195+0000","last_change":"2023-08-31T18:47:52.533431+0000","last_active":"2023-08-31T18:47:53.012195+0000","last_peered":"2023-08-31T18:47:53.012195+0000","last_clean":"2023-08-31T18:47:53.012195+0000","last_became_active":"2023-08-31T18:47:52.532932+0000","last_became_peered":"2023-08-31T18:47:52.532932+0000","last_unstale":"2023-08-31T18:47:53.012195+0000","last_undegraded":"2023-08-31T18:47:53.012195+0000","last_fullsized":"2023-08-31T18:47:53.012195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009811+0000","last_change":"2023-08-31T18:47:53.001374+0000","last_active":"2023-08-31T18:47:53.009811+0000","last_peered":"2023-08-31T18:47:53.009811+0000","last_clean":"2023-08-31T18:47:53.009811+0000","last_became_active":"2023-08-31T18:47:52.997729+0000","last_became_peered":"2023-08-31T18:47:52.997729+0000","last_unstale":"2023-08-31T18:47:53.009811+0000","last_undegraded":"2023-08-31T18:47:53.009811+0000","last_fullsized":"2023-08-31T18:47:53.009811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.988324+0000","last_change":"2023-08-31T18:47:52.534072+0000","last_active":"2023-08-31T18:47:52.988324+0000","last_peered":"2023-08-31T18:47:52.988324+0000","last_clean":"2023-08-31T18:47:52.988324+0000","last_became_active":"2023-08-31T18:47:52.533779+0000","last_became_peered":"2023-08-31T18:47:52.533779+0000","last_unstale":"2023-08-31T18:47:52.988324+0000","last_undegraded":"2023-08-31T18:47:52.988324+0000","last_fullsized":"2023-08-31T18:47:52.988324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.994371+0000","last_change":"2023-08-31T18:47:52.990541+0000","last_active":"2023-08-31T18:47:52.994371+0000","last_peered":"2023-08-31T18:47:52.994371+0000","last_clean":"2023-08-31T18:47:52.994371+0000","last_became_active":"2023-08-31T18:47:52.990287+0000","last_became_peered":"2023-08-31T18:47:52.990287+0000","last_unstale":"2023-08-31T18:47:52.994371+0000","last_undegraded":"2023-08-31T18:47:52.994371+0000","last_fullsized":"2023-08-31T18:47:52.994371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981085+0000","last_change":"2023-08-31T18:47:52.532002+0000","last_active":"2023-08-31T18:47:52.981085+0000","last_peered":"2023-08-31T18:47:52.981085+0000","last_clean":"2023-08-31T18:47:52.981085+0000","last_became_active":"2023-08-31T18:47:52.530907+0000","last_became_peered":"2023-08-31T18:47:52.530907+0000","last_unstale":"2023-08-31T18:47:52.981085+0000","last_undegraded":"2023-08-31T18:47:52.981085+0000","last_fullsized":"2023-08-31T18:47:52.981085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010346+0000","last_change":"2023-08-31T18:47:53.006764+0000","last_active":"2023-08-31T18:47:53.010346+0000","last_peered":"2023-08-31T18:47:53.010346+0000","last_clean":"2023-08-31T18:47:53.010346+0000","last_became_active":"2023-08-31T18:47:53.006455+0000","last_became_peered":"2023-08-31T18:47:53.006455+0000","last_unstale":"2023-08-31T18:47:53.010346+0000","last_undegraded":"2023-08-31T18:47:53.010346+0000","last_fullsized":"2023-08-31T18:47:53.010346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999985+0000","last_change":"2023-08-31T18:47:52.526280+0000","last_active":"2023-08-31T18:47:52.999985+0000","last_peered":"2023-08-31T18:47:52.999985+0000","last_clean":"2023-08-31T18:47:52.999985+0000","last_became_active":"2023-08-31T18:47:52.524905+0000","last_became_peered":"2023-08-31T18:47:52.524905+0000","last_unstale":"2023-08-31T18:47:52.999985+0000","last_undegraded":"2023-08-31T18:47:52.999985+0000","last_fullsized":"2023-08-31T18:47:52.999985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009365+0000","last_change":"2023-08-31T18:47:53.004475+0000","last_active":"2023-08-31T18:47:53.009365+0000","last_peered":"2023-08-31T18:47:53.009365+0000","last_clean":"2023-08-31T18:47:53.009365+0000","last_became_active":"2023-08-31T18:47:53.004127+0000","last_became_peered":"2023-08-31T18:47:53.004127+0000","last_unstale":"2023-08-31T18:47:53.009365+0000","last_undegraded":"2023-08-31T18:47:53.009365+0000","last_fullsized":"2023-08-31T18:47:53.009365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981133+0000","last_change":"2023-08-31T18:47:52.519012+0000","last_active":"2023-08-31T18:47:52.981133+0000","last_peered":"2023-08-31T18:47:52.981133+0000","last_clean":"2023-08-31T18:47:52.981133+0000","last_became_active":"2023-08-31T18:47:52.518704+0000","last_became_peered":"2023-08-31T18:47:52.518704+0000","last_unstale":"2023-08-31T18:47:52.981133+0000","last_undegraded":"2023-08-31T18:47:52.981133+0000","last_fullsized":"2023-08-31T18:47:52.981133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.014052+0000","last_change":"2023-08-31T18:47:53.011342+0000","last_active":"2023-08-31T18:47:53.014052+0000","last_peered":"2023-08-31T18:47:53.014052+0000","last_clean":"2023-08-31T18:47:53.014052+0000","last_became_active":"2023-08-31T18:47:53.010851+0000","last_became_peered":"2023-08-31T18:47:53.010851+0000","last_unstale":"2023-08-31T18:47:53.014052+0000","last_undegraded":"2023-08-31T18:47:53.014052+0000","last_fullsized":"2023-08-31T18:47:53.014052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.996543+0000","last_change":"2023-08-31T18:47:52.528000+0000","last_active":"2023-08-31T18:47:52.996543+0000","last_peered":"2023-08-31T18:47:52.996543+0000","last_clean":"2023-08-31T18:47:52.996543+0000","last_became_active":"2023-08-31T18:47:52.527687+0000","last_became_peered":"2023-08-31T18:47:52.527687+0000","last_unstale":"2023-08-31T18:47:52.996543+0000","last_undegraded":"2023-08-31T18:47:52.996543+0000","last_fullsized":"2023-08-31T18:47:52.996543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.004012+0000","last_change":"2023-08-31T18:47:53.001422+0000","last_active":"2023-08-31T18:47:53.004012+0000","last_peered":"2023-08-31T18:47:53.004012+0000","last_clean":"2023-08-31T18:47:53.004012+0000","last_became_active":"2023-08-31T18:47:53.001068+0000","last_became_peered":"2023-08-31T18:47:53.001068+0000","last_unstale":"2023-08-31T18:47:53.004012+0000","last_undegraded":"2023-08-31T18:47:53.004012+0000","last_fullsized":"2023-08-31T18:47:53.004012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978870+0000","last_change":"2023-08-31T18:47:52.528548+0000","last_active":"2023-08-31T18:47:52.978870+0000","last_peered":"2023-08-31T18:47:52.978870+0000","last_clean":"2023-08-31T18:47:52.978870+0000","last_became_active":"2023-08-31T18:47:52.528233+0000","last_became_peered":"2023-08-31T18:47:52.528233+0000","last_unstale":"2023-08-31T18:47:52.978870+0000","last_undegraded":"2023-08-31T18:47:52.978870+0000","last_fullsized":"2023-08-31T18:47:52.978870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982414+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T18:47:52.982414+0000","last_peered":"2023-08-31T18:47:52.982414+0000","last_clean":"2023-08-31T18:47:52.982414+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T18:47:52.982414+0000","last_undegraded":"2023-08-31T18:47:52.982414+0000","last_fullsized":"2023-08-31T18:47:52.982414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.983371+0000","last_change":"2023-08-31T18:47:52.531147+0000","last_active":"2023-08-31T18:47:52.983371+0000","last_peered":"2023-08-31T18:47:52.983371+0000","last_clean":"2023-08-31T18:47:52.983371+0000","last_became_active":"2023-08-31T18:47:52.530795+0000","last_became_peered":"2023-08-31T18:47:52.530795+0000","last_unstale":"2023-08-31T18:47:52.983371+0000","last_undegraded":"2023-08-31T18:47:52.983371+0000","last_fullsized":"2023-08-31T18:47:52.983371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003902+0000","last_change":"2023-08-31T18:47:52.996878+0000","last_active":"2023-08-31T18:47:53.003902+0000","last_peered":"2023-08-31T18:47:53.003902+0000","last_clean":"2023-08-31T18:47:53.003902+0000","last_became_active":"2023-08-31T18:47:52.996585+0000","last_became_peered":"2023-08-31T18:47:52.996585+0000","last_unstale":"2023-08-31T18:47:53.003902+0000","last_undegraded":"2023-08-31T18:47:53.003902+0000","last_fullsized":"2023-08-31T18:47:53.003902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982257+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T18:47:52.982257+0000","last_peered":"2023-08-31T18:47:52.982257+0000","last_clean":"2023-08-31T18:47:52.982257+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T18:47:52.982257+0000","last_undegraded":"2023-08-31T18:47:52.982257+0000","last_fullsized":"2023-08-31T18:47:52.982257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997186+0000","last_change":"2023-08-31T18:47:52.528056+0000","last_active":"2023-08-31T18:47:52.997186+0000","last_peered":"2023-08-31T18:47:52.997186+0000","last_clean":"2023-08-31T18:47:52.997186+0000","last_became_active":"2023-08-31T18:47:52.527756+0000","last_became_peered":"2023-08-31T18:47:52.527756+0000","last_unstale":"2023-08-31T18:47:52.997186+0000","last_undegraded":"2023-08-31T18:47:52.997186+0000","last_fullsized":"2023-08-31T18:47:52.997186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.998135+0000","last_change":"2023-08-31T18:47:52.990235+0000","last_active":"2023-08-31T18:47:52.998135+0000","last_peered":"2023-08-31T18:47:52.998135+0000","last_clean":"2023-08-31T18:47:52.998135+0000","last_became_active":"2023-08-31T18:47:52.989630+0000","last_became_peered":"2023-08-31T18:47:52.989630+0000","last_unstale":"2023-08-31T18:47:52.998135+0000","last_undegraded":"2023-08-31T18:47:52.998135+0000","last_fullsized":"2023-08-31T18:47:52.998135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003993+0000","last_change":"2023-08-31T18:47:52.997214+0000","last_active":"2023-08-31T18:47:53.003993+0000","last_peered":"2023-08-31T18:47:53.003993+0000","last_clean":"2023-08-31T18:47:53.003993+0000","last_became_active":"2023-08-31T18:47:52.996959+0000","last_became_peered":"2023-08-31T18:47:52.996959+0000","last_unstale":"2023-08-31T18:47:53.003993+0000","last_undegraded":"2023-08-31T18:47:53.003993+0000","last_fullsized":"2023-08-31T18:47:53.003993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979854+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T18:47:52.979854+0000","last_peered":"2023-08-31T18:47:52.979854+0000","last_clean":"2023-08-31T18:47:52.979854+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T18:47:52.979854+0000","last_undegraded":"2023-08-31T18:47:52.979854+0000","last_fullsized":"2023-08-31T18:47:52.979854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981140+0000","last_change":"2023-08-31T18:47:52.531329+0000","last_active":"2023-08-31T18:47:52.981140+0000","last_peered":"2023-08-31T18:47:52.981140+0000","last_clean":"2023-08-31T18:47:52.981140+0000","last_became_active":"2023-08-31T18:47:52.531098+0000","last_became_peered":"2023-08-31T18:47:52.531098+0000","last_unstale":"2023-08-31T18:47:52.981140+0000","last_undegraded":"2023-08-31T18:47:52.981140+0000","last_fullsized":"2023-08-31T18:47:52.981140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009822+0000","last_change":"2023-08-31T18:47:53.001676+0000","last_active":"2023-08-31T18:47:53.009822+0000","last_peered":"2023-08-31T18:47:53.009822+0000","last_clean":"2023-08-31T18:47:53.009822+0000","last_became_active":"2023-08-31T18:47:52.999806+0000","last_became_peered":"2023-08-31T18:47:52.999806+0000","last_unstale":"2023-08-31T18:47:53.009822+0000","last_undegraded":"2023-08-31T18:47:53.009822+0000","last_fullsized":"2023-08-31T18:47:53.009822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982159+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T18:47:52.982159+0000","last_peered":"2023-08-31T18:47:52.982159+0000","last_clean":"2023-08-31T18:47:52.982159+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T18:47:52.982159+0000","last_undegraded":"2023-08-31T18:47:52.982159+0000","last_fullsized":"2023-08-31T18:47:52.982159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993155+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T18:47:52.993155+0000","last_peered":"2023-08-31T18:47:52.993155+0000","last_clean":"2023-08-31T18:47:52.993155+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T18:47:52.993155+0000","last_undegraded":"2023-08-31T18:47:52.993155+0000","last_fullsized":"2023-08-31T18:47:52.993155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978881+0000","last_change":"2023-08-31T18:47:52.536563+0000","last_active":"2023-08-31T18:47:52.978881+0000","last_peered":"2023-08-31T18:47:52.978881+0000","last_clean":"2023-08-31T18:47:52.978881+0000","last_became_active":"2023-08-31T18:47:52.536326+0000","last_became_peered":"2023-08-31T18:47:52.536326+0000","last_unstale":"2023-08-31T18:47:52.978881+0000","last_undegraded":"2023-08-31T18:47:52.978881+0000","last_fullsized":"2023-08-31T18:47:52.978881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.994407+0000","last_change":"2023-08-31T18:47:52.990146+0000","last_active":"2023-08-31T18:47:52.994407+0000","last_peered":"2023-08-31T18:47:52.994407+0000","last_clean":"2023-08-31T18:47:52.994407+0000","last_became_active":"2023-08-31T18:47:52.989854+0000","last_became_peered":"2023-08-31T18:47:52.989854+0000","last_unstale":"2023-08-31T18:47:52.994407+0000","last_undegraded":"2023-08-31T18:47:52.994407+0000","last_fullsized":"2023-08-31T18:47:52.994407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993495+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T18:47:52.993495+0000","last_peered":"2023-08-31T18:47:52.993495+0000","last_clean":"2023-08-31T18:47:52.993495+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T18:47:52.993495+0000","last_undegraded":"2023-08-31T18:47:52.993495+0000","last_fullsized":"2023-08-31T18:47:52.993495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.983178+0000","last_change":"2023-08-31T18:47:52.521251+0000","last_active":"2023-08-31T18:47:52.983178+0000","last_peered":"2023-08-31T18:47:52.983178+0000","last_clean":"2023-08-31T18:47:52.983178+0000","last_became_active":"2023-08-31T18:47:52.520981+0000","last_became_peered":"2023-08-31T18:47:52.520981+0000","last_unstale":"2023-08-31T18:47:52.983178+0000","last_undegraded":"2023-08-31T18:47:52.983178+0000","last_fullsized":"2023-08-31T18:47:52.983178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.988216+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T18:47:52.988216+0000","last_peered":"2023-08-31T18:47:52.988216+0000","last_clean":"2023-08-31T18:47:52.988216+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T18:47:52.988216+0000","last_undegraded":"2023-08-31T18:47:52.988216+0000","last_fullsized":"2023-08-31T18:47:52.988216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982531+0000","last_change":"2023-08-31T18:47:52.531178+0000","last_active":"2023-08-31T18:47:52.982531+0000","last_peered":"2023-08-31T18:47:52.982531+0000","last_clean":"2023-08-31T18:47:52.982531+0000","last_became_active":"2023-08-31T18:47:52.530913+0000","last_became_peered":"2023-08-31T18:47:52.530913+0000","last_unstale":"2023-08-31T18:47:52.982531+0000","last_undegraded":"2023-08-31T18:47:52.982531+0000","last_fullsized":"2023-08-31T18:47:52.982531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.005141+0000","last_change":"2023-08-31T18:47:53.003355+0000","last_active":"2023-08-31T18:47:53.005141+0000","last_peered":"2023-08-31T18:47:53.005141+0000","last_clean":"2023-08-31T18:47:53.005141+0000","last_became_active":"2023-08-31T18:47:53.003045+0000","last_became_peered":"2023-08-31T18:47:53.003045+0000","last_unstale":"2023-08-31T18:47:53.005141+0000","last_undegraded":"2023-08-31T18:47:53.005141+0000","last_fullsized":"2023-08-31T18:47:53.005141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002389+0000","last_change":"2023-08-31T18:47:52.529487+0000","last_active":"2023-08-31T18:47:53.002389+0000","last_peered":"2023-08-31T18:47:53.002389+0000","last_clean":"2023-08-31T18:47:53.002389+0000","last_became_active":"2023-08-31T18:47:52.529159+0000","last_became_peered":"2023-08-31T18:47:52.529159+0000","last_unstale":"2023-08-31T18:47:53.002389+0000","last_undegraded":"2023-08-31T18:47:53.002389+0000","last_fullsized":"2023-08-31T18:47:53.002389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982262+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T18:47:52.982262+0000","last_peered":"2023-08-31T18:47:52.982262+0000","last_clean":"2023-08-31T18:47:52.982262+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T18:47:52.982262+0000","last_undegraded":"2023-08-31T18:47:52.982262+0000","last_fullsized":"2023-08-31T18:47:52.982262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002206+0000","last_change":"2023-08-31T18:47:52.997271+0000","last_active":"2023-08-31T18:47:53.002206+0000","last_peered":"2023-08-31T18:47:53.002206+0000","last_clean":"2023-08-31T18:47:53.002206+0000","last_became_active":"2023-08-31T18:47:52.996372+0000","last_became_peered":"2023-08-31T18:47:52.996372+0000","last_unstale":"2023-08-31T18:47:53.002206+0000","last_undegraded":"2023-08-31T18:47:53.002206+0000","last_fullsized":"2023-08-31T18:47:53.002206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979289+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T18:47:52.979289+0000","last_peered":"2023-08-31T18:47:52.979289+0000","last_clean":"2023-08-31T18:47:52.979289+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T18:47:52.979289+0000","last_undegraded":"2023-08-31T18:47:52.979289+0000","last_fullsized":"2023-08-31T18:47:52.979289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.985153+0000","last_change":"2023-08-31T18:47:52.525869+0000","last_active":"2023-08-31T18:47:52.985153+0000","last_peered":"2023-08-31T18:47:52.985153+0000","last_clean":"2023-08-31T18:47:52.985153+0000","last_became_active":"2023-08-31T18:47:52.525594+0000","last_became_peered":"2023-08-31T18:47:52.525594+0000","last_unstale":"2023-08-31T18:47:52.985153+0000","last_undegraded":"2023-08-31T18:47:52.985153+0000","last_fullsized":"2023-08-31T18:47:52.985153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009323+0000","last_change":"2023-08-31T18:47:53.003708+0000","last_active":"2023-08-31T18:47:53.009323+0000","last_peered":"2023-08-31T18:47:53.009323+0000","last_clean":"2023-08-31T18:47:53.009323+0000","last_became_active":"2023-08-31T18:47:53.001875+0000","last_became_peered":"2023-08-31T18:47:53.001875+0000","last_unstale":"2023-08-31T18:47:53.009323+0000","last_undegraded":"2023-08-31T18:47:53.009323+0000","last_fullsized":"2023-08-31T18:47:53.009323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000518+0000","last_change":"2023-08-31T18:47:52.990509+0000","last_active":"2023-08-31T18:47:53.000518+0000","last_peered":"2023-08-31T18:47:53.000518+0000","last_clean":"2023-08-31T18:47:53.000518+0000","last_became_active":"2023-08-31T18:47:52.990124+0000","last_became_peered":"2023-08-31T18:47:52.990124+0000","last_unstale":"2023-08-31T18:47:53.000518+0000","last_undegraded":"2023-08-31T18:47:53.000518+0000","last_fullsized":"2023-08-31T18:47:53.000518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984947+0000","last_change":"2023-08-31T18:47:52.530755+0000","last_active":"2023-08-31T18:47:52.984947+0000","last_peered":"2023-08-31T18:47:52.984947+0000","last_clean":"2023-08-31T18:47:52.984947+0000","last_became_active":"2023-08-31T18:47:52.530495+0000","last_became_peered":"2023-08-31T18:47:52.530495+0000","last_unstale":"2023-08-31T18:47:52.984947+0000","last_undegraded":"2023-08-31T18:47:52.984947+0000","last_fullsized":"2023-08-31T18:47:52.984947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010816+0000","last_change":"2023-08-31T18:47:53.008012+0000","last_active":"2023-08-31T18:47:53.010816+0000","last_peered":"2023-08-31T18:47:53.010816+0000","last_clean":"2023-08-31T18:47:53.010816+0000","last_became_active":"2023-08-31T18:47:53.007721+0000","last_became_peered":"2023-08-31T18:47:53.007721+0000","last_unstale":"2023-08-31T18:47:53.010816+0000","last_undegraded":"2023-08-31T18:47:53.010816+0000","last_fullsized":"2023-08-31T18:47:53.010816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981199+0000","last_change":"2023-08-31T18:47:52.536133+0000","last_active":"2023-08-31T18:47:52.981199+0000","last_peered":"2023-08-31T18:47:52.981199+0000","last_clean":"2023-08-31T18:47:52.981199+0000","last_became_active":"2023-08-31T18:47:52.535677+0000","last_became_peered":"2023-08-31T18:47:52.535677+0000","last_unstale":"2023-08-31T18:47:52.981199+0000","last_undegraded":"2023-08-31T18:47:52.981199+0000","last_fullsized":"2023-08-31T18:47:52.981199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010314+0000","last_change":"2023-08-31T18:47:53.007441+0000","last_active":"2023-08-31T18:47:53.010314+0000","last_peered":"2023-08-31T18:47:53.010314+0000","last_clean":"2023-08-31T18:47:53.010314+0000","last_became_active":"2023-08-31T18:47:53.007151+0000","last_became_peered":"2023-08-31T18:47:53.007151+0000","last_unstale":"2023-08-31T18:47:53.010314+0000","last_undegraded":"2023-08-31T18:47:53.010314+0000","last_fullsized":"2023-08-31T18:47:53.010314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997915+0000","last_change":"2023-08-31T18:47:52.534374+0000","last_active":"2023-08-31T18:47:52.997915+0000","last_peered":"2023-08-31T18:47:52.997915+0000","last_clean":"2023-08-31T18:47:52.997915+0000","last_became_active":"2023-08-31T18:47:52.534039+0000","last_became_peered":"2023-08-31T18:47:52.534039+0000","last_unstale":"2023-08-31T18:47:52.997915+0000","last_undegraded":"2023-08-31T18:47:52.997915+0000","last_fullsized":"2023-08-31T18:47:52.997915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999154+0000","last_change":"2023-08-31T18:47:52.988662+0000","last_active":"2023-08-31T18:47:52.999154+0000","last_peered":"2023-08-31T18:47:52.999154+0000","last_clean":"2023-08-31T18:47:52.999154+0000","last_became_active":"2023-08-31T18:47:52.988023+0000","last_became_peered":"2023-08-31T18:47:52.988023+0000","last_unstale":"2023-08-31T18:47:52.999154+0000","last_undegraded":"2023-08-31T18:47:52.999154+0000","last_fullsized":"2023-08-31T18:47:52.999154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997630+0000","last_change":"2023-08-31T18:47:52.529298+0000","last_active":"2023-08-31T18:47:52.997630+0000","last_peered":"2023-08-31T18:47:52.997630+0000","last_clean":"2023-08-31T18:47:52.997630+0000","last_became_active":"2023-08-31T18:47:52.529019+0000","last_became_peered":"2023-08-31T18:47:52.529019+0000","last_unstale":"2023-08-31T18:47:52.997630+0000","last_undegraded":"2023-08-31T18:47:52.997630+0000","last_fullsized":"2023-08-31T18:47:52.997630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013482+0000","last_change":"2023-08-31T18:47:53.011094+0000","last_active":"2023-08-31T18:47:53.013482+0000","last_peered":"2023-08-31T18:47:53.013482+0000","last_clean":"2023-08-31T18:47:53.013482+0000","last_became_active":"2023-08-31T18:47:53.010736+0000","last_became_peered":"2023-08-31T18:47:53.010736+0000","last_unstale":"2023-08-31T18:47:53.013482+0000","last_undegraded":"2023-08-31T18:47:53.013482+0000","last_fullsized":"2023-08-31T18:47:53.013482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.995373+0000","last_change":"2023-08-31T18:47:52.535396+0000","last_active":"2023-08-31T18:47:52.995373+0000","last_peered":"2023-08-31T18:47:52.995373+0000","last_clean":"2023-08-31T18:47:52.995373+0000","last_became_active":"2023-08-31T18:47:52.535096+0000","last_became_peered":"2023-08-31T18:47:52.535096+0000","last_unstale":"2023-08-31T18:47:52.995373+0000","last_undegraded":"2023-08-31T18:47:52.995373+0000","last_fullsized":"2023-08-31T18:47:52.995373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.011507+0000","last_change":"2023-08-31T18:47:53.010796+0000","last_active":"2023-08-31T18:47:53.011507+0000","last_peered":"2023-08-31T18:47:53.011507+0000","last_clean":"2023-08-31T18:47:53.011507+0000","last_became_active":"2023-08-31T18:47:53.010536+0000","last_became_peered":"2023-08-31T18:47:53.010536+0000","last_unstale":"2023-08-31T18:47:53.011507+0000","last_undegraded":"2023-08-31T18:47:53.011507+0000","last_fullsized":"2023-08-31T18:47:53.011507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979264+0000","last_change":"2023-08-31T18:47:52.526866+0000","last_active":"2023-08-31T18:47:52.979264+0000","last_peered":"2023-08-31T18:47:52.979264+0000","last_clean":"2023-08-31T18:47:52.979264+0000","last_became_active":"2023-08-31T18:47:52.526378+0000","last_became_peered":"2023-08-31T18:47:52.526378+0000","last_unstale":"2023-08-31T18:47:52.979264+0000","last_undegraded":"2023-08-31T18:47:52.979264+0000","last_fullsized":"2023-08-31T18:47:52.979264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.991664+0000","last_change":"2023-08-31T18:47:52.988166+0000","last_active":"2023-08-31T18:47:52.991664+0000","last_peered":"2023-08-31T18:47:52.991664+0000","last_clean":"2023-08-31T18:47:52.991664+0000","last_became_active":"2023-08-31T18:47:52.987862+0000","last_became_peered":"2023-08-31T18:47:52.987862+0000","last_unstale":"2023-08-31T18:47:52.991664+0000","last_undegraded":"2023-08-31T18:47:52.991664+0000","last_fullsized":"2023-08-31T18:47:52.991664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979954+0000","last_change":"2023-08-31T18:47:52.536528+0000","last_active":"2023-08-31T18:47:52.979954+0000","last_peered":"2023-08-31T18:47:52.979954+0000","last_clean":"2023-08-31T18:47:52.979954+0000","last_became_active":"2023-08-31T18:47:52.536263+0000","last_became_peered":"2023-08-31T18:47:52.536263+0000","last_unstale":"2023-08-31T18:47:52.979954+0000","last_undegraded":"2023-08-31T18:47:52.979954+0000","last_fullsized":"2023-08-31T18:47:52.979954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010523+0000","last_change":"2023-08-31T18:47:53.006199+0000","last_active":"2023-08-31T18:47:53.010523+0000","last_peered":"2023-08-31T18:47:53.010523+0000","last_clean":"2023-08-31T18:47:53.010523+0000","last_became_active":"2023-08-31T18:47:53.005772+0000","last_became_peered":"2023-08-31T18:47:53.005772+0000","last_unstale":"2023-08-31T18:47:53.010523+0000","last_undegraded":"2023-08-31T18:47:53.010523+0000","last_fullsized":"2023-08-31T18:47:53.010523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981987+0000","last_change":"2023-08-31T18:47:52.531200+0000","last_active":"2023-08-31T18:47:52.981987+0000","last_peered":"2023-08-31T18:47:52.981987+0000","last_clean":"2023-08-31T18:47:52.981987+0000","last_became_active":"2023-08-31T18:47:52.530888+0000","last_became_peered":"2023-08-31T18:47:52.530888+0000","last_unstale":"2023-08-31T18:47:52.981987+0000","last_undegraded":"2023-08-31T18:47:52.981987+0000","last_fullsized":"2023-08-31T18:47:52.981987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003936+0000","last_change":"2023-08-31T18:47:52.992639+0000","last_active":"2023-08-31T18:47:53.003936+0000","last_peered":"2023-08-31T18:47:53.003936+0000","last_clean":"2023-08-31T18:47:53.003936+0000","last_became_active":"2023-08-31T18:47:52.992365+0000","last_became_peered":"2023-08-31T18:47:52.992365+0000","last_unstale":"2023-08-31T18:47:53.003936+0000","last_undegraded":"2023-08-31T18:47:53.003936+0000","last_fullsized":"2023-08-31T18:47:53.003936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984775+0000","last_change":"2023-08-31T18:47:52.523604+0000","last_active":"2023-08-31T18:47:52.984775+0000","last_peered":"2023-08-31T18:47:52.984775+0000","last_clean":"2023-08-31T18:47:52.984775+0000","last_became_active":"2023-08-31T18:47:52.523314+0000","last_became_peered":"2023-08-31T18:47:52.523314+0000","last_unstale":"2023-08-31T18:47:52.984775+0000","last_undegraded":"2023-08-31T18:47:52.984775+0000","last_fullsized":"2023-08-31T18:47:52.984775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003706+0000","last_change":"2023-08-31T18:47:53.000736+0000","last_active":"2023-08-31T18:47:53.003706+0000","last_peered":"2023-08-31T18:47:53.003706+0000","last_clean":"2023-08-31T18:47:53.003706+0000","last_became_active":"2023-08-31T18:47:53.000299+0000","last_became_peered":"2023-08-31T18:47:53.000299+0000","last_unstale":"2023-08-31T18:47:53.003706+0000","last_undegraded":"2023-08-31T18:47:53.003706+0000","last_fullsized":"2023-08-31T18:47:53.003706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980656+0000","last_change":"2023-08-31T18:47:52.532777+0000","last_active":"2023-08-31T18:47:52.980656+0000","last_peered":"2023-08-31T18:47:52.980656+0000","last_clean":"2023-08-31T18:47:52.980656+0000","last_became_active":"2023-08-31T18:47:52.532315+0000","last_became_peered":"2023-08-31T18:47:52.532315+0000","last_unstale":"2023-08-31T18:47:52.980656+0000","last_undegraded":"2023-08-31T18:47:52.980656+0000","last_fullsized":"2023-08-31T18:47:52.980656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013496+0000","last_change":"2023-08-31T18:47:53.011112+0000","last_active":"2023-08-31T18:47:53.013496+0000","last_peered":"2023-08-31T18:47:53.013496+0000","last_clean":"2023-08-31T18:47:53.013496+0000","last_became_active":"2023-08-31T18:47:53.010727+0000","last_became_peered":"2023-08-31T18:47:53.010727+0000","last_unstale":"2023-08-31T18:47:53.013496+0000","last_undegraded":"2023-08-31T18:47:53.013496+0000","last_fullsized":"2023-08-31T18:47:53.013496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982317+0000","last_change":"2023-08-31T18:47:52.518395+0000","last_active":"2023-08-31T18:47:52.982317+0000","last_peered":"2023-08-31T18:47:52.982317+0000","last_clean":"2023-08-31T18:47:52.982317+0000","last_became_active":"2023-08-31T18:47:52.518052+0000","last_became_peered":"2023-08-31T18:47:52.518052+0000","last_unstale":"2023-08-31T18:47:52.982317+0000","last_undegraded":"2023-08-31T18:47:52.982317+0000","last_fullsized":"2023-08-31T18:47:52.982317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999877+0000","last_change":"2023-08-31T18:47:52.993488+0000","last_active":"2023-08-31T18:47:52.999877+0000","last_peered":"2023-08-31T18:47:52.999877+0000","last_clean":"2023-08-31T18:47:52.999877+0000","last_became_active":"2023-08-31T18:47:52.993212+0000","last_became_peered":"2023-08-31T18:47:52.993212+0000","last_unstale":"2023-08-31T18:47:52.999877+0000","last_undegraded":"2023-08-31T18:47:52.999877+0000","last_fullsized":"2023-08-31T18:47:52.999877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979140+0000","last_change":"2023-08-31T18:47:52.525508+0000","last_active":"2023-08-31T18:47:52.979140+0000","last_peered":"2023-08-31T18:47:52.979140+0000","last_clean":"2023-08-31T18:47:52.979140+0000","last_became_active":"2023-08-31T18:47:52.525174+0000","last_became_peered":"2023-08-31T18:47:52.525174+0000","last_unstale":"2023-08-31T18:47:52.979140+0000","last_undegraded":"2023-08-31T18:47:52.979140+0000","last_fullsized":"2023-08-31T18:47:52.979140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.995366+0000","last_change":"2023-08-31T18:47:52.992245+0000","last_active":"2023-08-31T18:47:52.995366+0000","last_peered":"2023-08-31T18:47:52.995366+0000","last_clean":"2023-08-31T18:47:52.995366+0000","last_became_active":"2023-08-31T18:47:52.991850+0000","last_became_peered":"2023-08-31T18:47:52.991850+0000","last_unstale":"2023-08-31T18:47:52.995366+0000","last_undegraded":"2023-08-31T18:47:52.995366+0000","last_fullsized":"2023-08-31T18:47:52.995366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978676+0000","last_change":"2023-08-31T18:47:52.532525+0000","last_active":"2023-08-31T18:47:52.978676+0000","last_peered":"2023-08-31T18:47:52.978676+0000","last_clean":"2023-08-31T18:47:52.978676+0000","last_became_active":"2023-08-31T18:47:52.532286+0000","last_became_peered":"2023-08-31T18:47:52.532286+0000","last_unstale":"2023-08-31T18:47:52.978676+0000","last_undegraded":"2023-08-31T18:47:52.978676+0000","last_fullsized":"2023-08-31T18:47:52.978676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003173+0000","last_change":"2023-08-31T18:47:52.998570+0000","last_active":"2023-08-31T18:47:53.003173+0000","last_peered":"2023-08-31T18:47:53.003173+0000","last_clean":"2023-08-31T18:47:53.003173+0000","last_became_active":"2023-08-31T18:47:52.997982+0000","last_became_peered":"2023-08-31T18:47:52.997982+0000","last_unstale":"2023-08-31T18:47:53.003173+0000","last_undegraded":"2023-08-31T18:47:53.003173+0000","last_fullsized":"2023-08-31T18:47:53.003173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981657+0000","last_change":"2023-08-31T18:47:52.532565+0000","last_active":"2023-08-31T18:47:52.981657+0000","last_peered":"2023-08-31T18:47:52.981657+0000","last_clean":"2023-08-31T18:47:52.981657+0000","last_became_active":"2023-08-31T18:47:52.530954+0000","last_became_peered":"2023-08-31T18:47:52.530954+0000","last_unstale":"2023-08-31T18:47:52.981657+0000","last_undegraded":"2023-08-31T18:47:52.981657+0000","last_fullsized":"2023-08-31T18:47:52.981657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009277+0000","last_change":"2023-08-31T18:47:53.003156+0000","last_active":"2023-08-31T18:47:53.009277+0000","last_peered":"2023-08-31T18:47:53.009277+0000","last_clean":"2023-08-31T18:47:53.009277+0000","last_became_active":"2023-08-31T18:47:53.002838+0000","last_became_peered":"2023-08-31T18:47:53.002838+0000","last_unstale":"2023-08-31T18:47:53.009277+0000","last_undegraded":"2023-08-31T18:47:53.009277+0000","last_fullsized":"2023-08-31T18:47:53.009277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980428+0000","last_change":"2023-08-31T18:47:52.533155+0000","last_active":"2023-08-31T18:47:52.980428+0000","last_peered":"2023-08-31T18:47:52.980428+0000","last_clean":"2023-08-31T18:47:52.980428+0000","last_became_active":"2023-08-31T18:47:52.532852+0000","last_became_peered":"2023-08-31T18:47:52.532852+0000","last_unstale":"2023-08-31T18:47:52.980428+0000","last_undegraded":"2023-08-31T18:47:52.980428+0000","last_fullsized":"2023-08-31T18:47:52.980428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002837+0000","last_change":"2023-08-31T18:47:52.991952+0000","last_active":"2023-08-31T18:47:53.002837+0000","last_peered":"2023-08-31T18:47:53.002837+0000","last_clean":"2023-08-31T18:47:53.002837+0000","last_became_active":"2023-08-31T18:47:52.991706+0000","last_became_peered":"2023-08-31T18:47:52.991706+0000","last_unstale":"2023-08-31T18:47:53.002837+0000","last_undegraded":"2023-08-31T18:47:53.002837+0000","last_fullsized":"2023-08-31T18:47:53.002837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982376+0000","last_change":"2023-08-31T18:47:52.530999+0000","last_active":"2023-08-31T18:47:52.982376+0000","last_peered":"2023-08-31T18:47:52.982376+0000","last_clean":"2023-08-31T18:47:52.982376+0000","last_became_active":"2023-08-31T18:47:52.530492+0000","last_became_peered":"2023-08-31T18:47:52.530492+0000","last_unstale":"2023-08-31T18:47:52.982376+0000","last_undegraded":"2023-08-31T18:47:52.982376+0000","last_fullsized":"2023-08-31T18:47:52.982376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013431+0000","last_change":"2023-08-31T18:47:53.010887+0000","last_active":"2023-08-31T18:47:53.013431+0000","last_peered":"2023-08-31T18:47:53.013431+0000","last_clean":"2023-08-31T18:47:53.013431+0000","last_became_active":"2023-08-31T18:47:53.010563+0000","last_became_peered":"2023-08-31T18:47:53.010563+0000","last_unstale":"2023-08-31T18:47:53.013431+0000","last_undegraded":"2023-08-31T18:47:53.013431+0000","last_fullsized":"2023-08-31T18:47:53.013431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003063+0000","last_change":"2023-08-31T18:47:52.524520+0000","last_active":"2023-08-31T18:47:53.003063+0000","last_peered":"2023-08-31T18:47:53.003063+0000","last_clean":"2023-08-31T18:47:53.003063+0000","last_became_active":"2023-08-31T18:47:52.524248+0000","last_became_peered":"2023-08-31T18:47:52.524248+0000","last_unstale":"2023-08-31T18:47:53.003063+0000","last_undegraded":"2023-08-31T18:47:53.003063+0000","last_fullsized":"2023-08-31T18:47:53.003063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009527+0000","last_change":"2023-08-31T18:47:53.004250+0000","last_active":"2023-08-31T18:47:53.009527+0000","last_peered":"2023-08-31T18:47:53.009527+0000","last_clean":"2023-08-31T18:47:53.009527+0000","last_became_active":"2023-08-31T18:47:53.003889+0000","last_became_peered":"2023-08-31T18:47:53.003889+0000","last_unstale":"2023-08-31T18:47:53.009527+0000","last_undegraded":"2023-08-31T18:47:53.009527+0000","last_fullsized":"2023-08-31T18:47:53.009527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979331+0000","last_change":"2023-08-31T18:47:52.522809+0000","last_active":"2023-08-31T18:47:52.979331+0000","last_peered":"2023-08-31T18:47:52.979331+0000","last_clean":"2023-08-31T18:47:52.979331+0000","last_became_active":"2023-08-31T18:47:52.522517+0000","last_became_peered":"2023-08-31T18:47:52.522517+0000","last_unstale":"2023-08-31T18:47:52.979331+0000","last_undegraded":"2023-08-31T18:47:52.979331+0000","last_fullsized":"2023-08-31T18:47:52.979331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.994341+0000","last_change":"2023-08-31T18:47:52.990434+0000","last_active":"2023-08-31T18:47:52.994341+0000","last_peered":"2023-08-31T18:47:52.994341+0000","last_clean":"2023-08-31T18:47:52.994341+0000","last_became_active":"2023-08-31T18:47:52.989943+0000","last_became_peered":"2023-08-31T18:47:52.989943+0000","last_unstale":"2023-08-31T18:47:52.994341+0000","last_undegraded":"2023-08-31T18:47:52.994341+0000","last_fullsized":"2023-08-31T18:47:52.994341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.008488+0000","last_change":"2023-08-31T18:47:52.526791+0000","last_active":"2023-08-31T18:47:53.008488+0000","last_peered":"2023-08-31T18:47:53.008488+0000","last_clean":"2023-08-31T18:47:53.008488+0000","last_became_active":"2023-08-31T18:47:52.526453+0000","last_became_peered":"2023-08-31T18:47:52.526453+0000","last_unstale":"2023-08-31T18:47:53.008488+0000","last_undegraded":"2023-08-31T18:47:53.008488+0000","last_fullsized":"2023-08-31T18:47:53.008488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999173+0000","last_change":"2023-08-31T18:47:52.988877+0000","last_active":"2023-08-31T18:47:52.999173+0000","last_peered":"2023-08-31T18:47:52.999173+0000","last_clean":"2023-08-31T18:47:52.999173+0000","last_became_active":"2023-08-31T18:47:52.988408+0000","last_became_peered":"2023-08-31T18:47:52.988408+0000","last_unstale":"2023-08-31T18:47:52.999173+0000","last_undegraded":"2023-08-31T18:47:52.999173+0000","last_fullsized":"2023-08-31T18:47:52.999173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980246+0000","last_change":"2023-08-31T18:47:52.530145+0000","last_active":"2023-08-31T18:47:52.980246+0000","last_peered":"2023-08-31T18:47:52.980246+0000","last_clean":"2023-08-31T18:47:52.980246+0000","last_became_active":"2023-08-31T18:47:52.529794+0000","last_became_peered":"2023-08-31T18:47:52.529794+0000","last_unstale":"2023-08-31T18:47:52.980246+0000","last_undegraded":"2023-08-31T18:47:52.980246+0000","last_fullsized":"2023-08-31T18:47:52.980246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010719+0000","last_change":"2023-08-31T18:47:53.008088+0000","last_active":"2023-08-31T18:47:53.010719+0000","last_peered":"2023-08-31T18:47:53.010719+0000","last_clean":"2023-08-31T18:47:53.010719+0000","last_became_active":"2023-08-31T18:47:53.007777+0000","last_became_peered":"2023-08-31T18:47:53.007777+0000","last_unstale":"2023-08-31T18:47:53.010719+0000","last_undegraded":"2023-08-31T18:47:53.010719+0000","last_fullsized":"2023-08-31T18:47:53.010719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982119+0000","last_change":"2023-08-31T18:47:52.533768+0000","last_active":"2023-08-31T18:47:52.982119+0000","last_peered":"2023-08-31T18:47:52.982119+0000","last_clean":"2023-08-31T18:47:52.982119+0000","last_became_active":"2023-08-31T18:47:52.533361+0000","last_became_peered":"2023-08-31T18:47:52.533361+0000","last_unstale":"2023-08-31T18:47:52.982119+0000","last_undegraded":"2023-08-31T18:47:52.982119+0000","last_fullsized":"2023-08-31T18:47:52.982119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003194+0000","last_change":"2023-08-31T18:47:52.998770+0000","last_active":"2023-08-31T18:47:53.003194+0000","last_peered":"2023-08-31T18:47:53.003194+0000","last_clean":"2023-08-31T18:47:53.003194+0000","last_became_active":"2023-08-31T18:47:52.998321+0000","last_became_peered":"2023-08-31T18:47:52.998321+0000","last_unstale":"2023-08-31T18:47:53.003194+0000","last_undegraded":"2023-08-31T18:47:53.003194+0000","last_fullsized":"2023-08-31T18:47:53.003194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997292+0000","last_change":"2023-08-31T18:47:52.532924+0000","last_active":"2023-08-31T18:47:52.997292+0000","last_peered":"2023-08-31T18:47:52.997292+0000","last_clean":"2023-08-31T18:47:52.997292+0000","last_became_active":"2023-08-31T18:47:52.531625+0000","last_became_peered":"2023-08-31T18:47:52.531625+0000","last_unstale":"2023-08-31T18:47:52.997292+0000","last_undegraded":"2023-08-31T18:47:52.997292+0000","last_fullsized":"2023-08-31T18:47:52.997292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009212+0000","last_change":"2023-08-31T18:47:52.997006+0000","last_active":"2023-08-31T18:47:53.009212+0000","last_peered":"2023-08-31T18:47:53.009212+0000","last_clean":"2023-08-31T18:47:53.009212+0000","last_became_active":"2023-08-31T18:47:52.996663+0000","last_became_peered":"2023-08-31T18:47:52.996663+0000","last_unstale":"2023-08-31T18:47:53.009212+0000","last_undegraded":"2023-08-31T18:47:53.009212+0000","last_fullsized":"2023-08-31T18:47:53.009212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981008+0000","last_change":"2023-08-31T18:47:52.516464+0000","last_active":"2023-08-31T18:47:52.981008+0000","last_peered":"2023-08-31T18:47:52.981008+0000","last_clean":"2023-08-31T18:47:52.981008+0000","last_became_active":"2023-08-31T18:47:52.516164+0000","last_became_peered":"2023-08-31T18:47:52.516164+0000","last_unstale":"2023-08-31T18:47:52.981008+0000","last_undegraded":"2023-08-31T18:47:52.981008+0000","last_fullsized":"2023-08-31T18:47:52.981008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010930+0000","last_change":"2023-08-31T18:47:53.005504+0000","last_active":"2023-08-31T18:47:53.010930+0000","last_peered":"2023-08-31T18:47:53.010930+0000","last_clean":"2023-08-31T18:47:53.010930+0000","last_became_active":"2023-08-31T18:47:53.005202+0000","last_became_peered":"2023-08-31T18:47:53.005202+0000","last_unstale":"2023-08-31T18:47:53.010930+0000","last_undegraded":"2023-08-31T18:47:53.010930+0000","last_fullsized":"2023-08-31T18:47:53.010930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984216+0000","last_change":"2023-08-31T18:47:52.524392+0000","last_active":"2023-08-31T18:47:52.984216+0000","last_peered":"2023-08-31T18:47:52.984216+0000","last_clean":"2023-08-31T18:47:52.984216+0000","last_became_active":"2023-08-31T18:47:52.524124+0000","last_became_peered":"2023-08-31T18:47:52.524124+0000","last_unstale":"2023-08-31T18:47:52.984216+0000","last_undegraded":"2023-08-31T18:47:52.984216+0000","last_fullsized":"2023-08-31T18:47:52.984216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.007216+0000","last_change":"2023-08-31T18:47:53.004792+0000","last_active":"2023-08-31T18:47:53.007216+0000","last_peered":"2023-08-31T18:47:53.007216+0000","last_clean":"2023-08-31T18:47:53.007216+0000","last_became_active":"2023-08-31T18:47:53.004470+0000","last_became_peered":"2023-08-31T18:47:53.004470+0000","last_unstale":"2023-08-31T18:47:53.007216+0000","last_undegraded":"2023-08-31T18:47:53.007216+0000","last_fullsized":"2023-08-31T18:47:53.007216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000085+0000","last_change":"2023-08-31T18:47:52.531667+0000","last_active":"2023-08-31T18:47:53.000085+0000","last_peered":"2023-08-31T18:47:53.000085+0000","last_clean":"2023-08-31T18:47:53.000085+0000","last_became_active":"2023-08-31T18:47:52.529811+0000","last_became_peered":"2023-08-31T18:47:52.529811+0000","last_unstale":"2023-08-31T18:47:53.000085+0000","last_undegraded":"2023-08-31T18:47:53.000085+0000","last_fullsized":"2023-08-31T18:47:53.000085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.007141+0000","last_change":"2023-08-31T18:47:53.004157+0000","last_active":"2023-08-31T18:47:53.007141+0000","last_peered":"2023-08-31T18:47:53.007141+0000","last_clean":"2023-08-31T18:47:53.007141+0000","last_became_active":"2023-08-31T18:47:53.003874+0000","last_became_peered":"2023-08-31T18:47:53.003874+0000","last_unstale":"2023-08-31T18:47:53.007141+0000","last_undegraded":"2023-08-31T18:47:53.007141+0000","last_fullsized":"2023-08-31T18:47:53.007141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.016407+0000","last_change":"2023-08-31T18:47:52.528085+0000","last_active":"2023-08-31T18:47:53.016407+0000","last_peered":"2023-08-31T18:47:53.016407+0000","last_clean":"2023-08-31T18:47:53.016407+0000","last_became_active":"2023-08-31T18:47:52.527709+0000","last_became_peered":"2023-08-31T18:47:52.527709+0000","last_unstale":"2023-08-31T18:47:53.016407+0000","last_undegraded":"2023-08-31T18:47:53.016407+0000","last_fullsized":"2023-08-31T18:47:53.016407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009270+0000","last_change":"2023-08-31T18:47:52.995956+0000","last_active":"2023-08-31T18:47:53.009270+0000","last_peered":"2023-08-31T18:47:53.009270+0000","last_clean":"2023-08-31T18:47:53.009270+0000","last_became_active":"2023-08-31T18:47:52.995594+0000","last_became_peered":"2023-08-31T18:47:52.995594+0000","last_unstale":"2023-08-31T18:47:53.009270+0000","last_undegraded":"2023-08-31T18:47:53.009270+0000","last_fullsized":"2023-08-31T18:47:53.009270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981652+0000","last_change":"2023-08-31T18:47:52.531991+0000","last_active":"2023-08-31T18:47:52.981652+0000","last_peered":"2023-08-31T18:47:52.981652+0000","last_clean":"2023-08-31T18:47:52.981652+0000","last_became_active":"2023-08-31T18:47:52.531640+0000","last_became_peered":"2023-08-31T18:47:52.531640+0000","last_unstale":"2023-08-31T18:47:52.981652+0000","last_undegraded":"2023-08-31T18:47:52.981652+0000","last_fullsized":"2023-08-31T18:47:52.981652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009562+0000","last_change":"2023-08-31T18:47:53.004890+0000","last_active":"2023-08-31T18:47:53.009562+0000","last_peered":"2023-08-31T18:47:53.009562+0000","last_clean":"2023-08-31T18:47:53.009562+0000","last_became_active":"2023-08-31T18:47:53.004583+0000","last_became_peered":"2023-08-31T18:47:53.004583+0000","last_unstale":"2023-08-31T18:47:53.009562+0000","last_undegraded":"2023-08-31T18:47:53.009562+0000","last_fullsized":"2023-08-31T18:47:53.009562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979377+0000","last_change":"2023-08-31T18:47:52.532169+0000","last_active":"2023-08-31T18:47:52.979377+0000","last_peered":"2023-08-31T18:47:52.979377+0000","last_clean":"2023-08-31T18:47:52.979377+0000","last_became_active":"2023-08-31T18:47:52.531828+0000","last_became_peered":"2023-08-31T18:47:52.531828+0000","last_unstale":"2023-08-31T18:47:52.979377+0000","last_undegraded":"2023-08-31T18:47:52.979377+0000","last_fullsized":"2023-08-31T18:47:52.979377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010270+0000","last_change":"2023-08-31T18:47:53.006485+0000","last_active":"2023-08-31T18:47:53.010270+0000","last_peered":"2023-08-31T18:47:53.010270+0000","last_clean":"2023-08-31T18:47:53.010270+0000","last_became_active":"2023-08-31T18:47:53.005959+0000","last_became_peered":"2023-08-31T18:47:53.005959+0000","last_unstale":"2023-08-31T18:47:53.010270+0000","last_undegraded":"2023-08-31T18:47:53.010270+0000","last_fullsized":"2023-08-31T18:47:53.010270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993529+0000","last_change":"2023-08-31T18:47:52.535478+0000","last_active":"2023-08-31T18:47:52.993529+0000","last_peered":"2023-08-31T18:47:52.993529+0000","last_clean":"2023-08-31T18:47:52.993529+0000","last_became_active":"2023-08-31T18:47:52.535070+0000","last_became_peered":"2023-08-31T18:47:52.535070+0000","last_unstale":"2023-08-31T18:47:52.993529+0000","last_undegraded":"2023-08-31T18:47:52.993529+0000","last_fullsized":"2023-08-31T18:47:52.993529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000738+0000","last_change":"2023-08-31T18:47:52.995080+0000","last_active":"2023-08-31T18:47:53.000738+0000","last_peered":"2023-08-31T18:47:53.000738+0000","last_clean":"2023-08-31T18:47:53.000738+0000","last_became_active":"2023-08-31T18:47:52.994681+0000","last_became_peered":"2023-08-31T18:47:52.994681+0000","last_unstale":"2023-08-31T18:47:53.000738+0000","last_undegraded":"2023-08-31T18:47:53.000738+0000","last_fullsized":"2023-08-31T18:47:53.000738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978985+0000","last_change":"2023-08-31T18:47:52.537767+0000","last_active":"2023-08-31T18:47:52.978985+0000","last_peered":"2023-08-31T18:47:52.978985+0000","last_clean":"2023-08-31T18:47:52.978985+0000","last_became_active":"2023-08-31T18:47:52.537385+0000","last_became_peered":"2023-08-31T18:47:52.537385+0000","last_unstale":"2023-08-31T18:47:52.978985+0000","last_undegraded":"2023-08-31T18:47:52.978985+0000","last_fullsized":"2023-08-31T18:47:52.978985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009241+0000","last_change":"2023-08-31T18:47:52.997396+0000","last_active":"2023-08-31T18:47:53.009241+0000","last_peered":"2023-08-31T18:47:53.009241+0000","last_clean":"2023-08-31T18:47:53.009241+0000","last_became_active":"2023-08-31T18:47:52.997047+0000","last_became_peered":"2023-08-31T18:47:52.997047+0000","last_unstale":"2023-08-31T18:47:53.009241+0000","last_undegraded":"2023-08-31T18:47:53.009241+0000","last_fullsized":"2023-08-31T18:47:53.009241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.992987+0000","last_change":"2023-08-31T18:47:52.527537+0000","last_active":"2023-08-31T18:47:52.992987+0000","last_peered":"2023-08-31T18:47:52.992987+0000","last_clean":"2023-08-31T18:47:52.992987+0000","last_became_active":"2023-08-31T18:47:52.527270+0000","last_became_peered":"2023-08-31T18:47:52.527270+0000","last_unstale":"2023-08-31T18:47:52.992987+0000","last_undegraded":"2023-08-31T18:47:52.992987+0000","last_fullsized":"2023-08-31T18:47:52.992987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010969+0000","last_change":"2023-08-31T18:47:53.006192+0000","last_active":"2023-08-31T18:47:53.010969+0000","last_peered":"2023-08-31T18:47:53.010969+0000","last_clean":"2023-08-31T18:47:53.010969+0000","last_became_active":"2023-08-31T18:47:53.005781+0000","last_became_peered":"2023-08-31T18:47:53.005781+0000","last_unstale":"2023-08-31T18:47:53.010969+0000","last_undegraded":"2023-08-31T18:47:53.010969+0000","last_fullsized":"2023-08-31T18:47:53.010969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.992451+0000","last_change":"2023-08-31T18:47:52.530561+0000","last_active":"2023-08-31T18:47:52.992451+0000","last_peered":"2023-08-31T18:47:52.992451+0000","last_clean":"2023-08-31T18:47:52.992451+0000","last_became_active":"2023-08-31T18:47:52.530210+0000","last_became_peered":"2023-08-31T18:47:52.530210+0000","last_unstale":"2023-08-31T18:47:52.992451+0000","last_undegraded":"2023-08-31T18:47:52.992451+0000","last_fullsized":"2023-08-31T18:47:52.992451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993847+0000","last_change":"2023-08-31T18:47:52.991129+0000","last_active":"2023-08-31T18:47:52.993847+0000","last_peered":"2023-08-31T18:47:52.993847+0000","last_clean":"2023-08-31T18:47:52.993847+0000","last_became_active":"2023-08-31T18:47:52.990398+0000","last_became_peered":"2023-08-31T18:47:52.990398+0000","last_unstale":"2023-08-31T18:47:52.993847+0000","last_undegraded":"2023-08-31T18:47:52.993847+0000","last_fullsized":"2023-08-31T18:47:52.993847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.006602+0000","last_change":"2023-08-31T18:47:52.527848+0000","last_active":"2023-08-31T18:47:53.006602+0000","last_peered":"2023-08-31T18:47:53.006602+0000","last_clean":"2023-08-31T18:47:53.006602+0000","last_became_active":"2023-08-31T18:47:52.527606+0000","last_became_peered":"2023-08-31T18:47:52.527606+0000","last_unstale":"2023-08-31T18:47:53.006602+0000","last_undegraded":"2023-08-31T18:47:53.006602+0000","last_fullsized":"2023-08-31T18:47:53.006602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003221+0000","last_change":"2023-08-31T18:47:52.996941+0000","last_active":"2023-08-31T18:47:53.003221+0000","last_peered":"2023-08-31T18:47:53.003221+0000","last_clean":"2023-08-31T18:47:53.003221+0000","last_became_active":"2023-08-31T18:47:52.996629+0000","last_became_peered":"2023-08-31T18:47:52.996629+0000","last_unstale":"2023-08-31T18:47:53.003221+0000","last_undegraded":"2023-08-31T18:47:53.003221+0000","last_fullsized":"2023-08-31T18:47:53.003221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002885+0000","last_change":"2023-08-31T18:47:52.532525+0000","last_active":"2023-08-31T18:47:53.002885+0000","last_peered":"2023-08-31T18:47:53.002885+0000","last_clean":"2023-08-31T18:47:53.002885+0000","last_became_active":"2023-08-31T18:47:52.532148+0000","last_became_peered":"2023-08-31T18:47:52.532148+0000","last_unstale":"2023-08-31T18:47:53.002885+0000","last_undegraded":"2023-08-31T18:47:53.002885+0000","last_fullsized":"2023-08-31T18:47:53.002885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009117+0000","last_change":"2023-08-31T18:47:52.999302+0000","last_active":"2023-08-31T18:47:53.009117+0000","last_peered":"2023-08-31T18:47:53.009117+0000","last_clean":"2023-08-31T18:47:53.009117+0000","last_became_active":"2023-08-31T18:47:52.998999+0000","last_became_peered":"2023-08-31T18:47:52.998999+0000","last_unstale":"2023-08-31T18:47:53.009117+0000","last_undegraded":"2023-08-31T18:47:53.009117+0000","last_fullsized":"2023-08-31T18:47:53.009117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984593+0000","last_change":"2023-08-31T18:47:52.533151+0000","last_active":"2023-08-31T18:47:52.984593+0000","last_peered":"2023-08-31T18:47:52.984593+0000","last_clean":"2023-08-31T18:47:52.984593+0000","last_became_active":"2023-08-31T18:47:52.532807+0000","last_became_peered":"2023-08-31T18:47:52.532807+0000","last_unstale":"2023-08-31T18:47:52.984593+0000","last_undegraded":"2023-08-31T18:47:52.984593+0000","last_fullsized":"2023-08-31T18:47:52.984593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.007112+0000","last_change":"2023-08-31T18:47:53.001543+0000","last_active":"2023-08-31T18:47:53.007112+0000","last_peered":"2023-08-31T18:47:53.007112+0000","last_clean":"2023-08-31T18:47:53.007112+0000","last_became_active":"2023-08-31T18:47:53.001281+0000","last_became_peered":"2023-08-31T18:47:53.001281+0000","last_unstale":"2023-08-31T18:47:53.007112+0000","last_undegraded":"2023-08-31T18:47:53.007112+0000","last_fullsized":"2023-08-31T18:47:53.007112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982462+0000","last_change":"2023-08-31T18:47:52.527162+0000","last_active":"2023-08-31T18:47:52.982462+0000","last_peered":"2023-08-31T18:47:52.982462+0000","last_clean":"2023-08-31T18:47:52.982462+0000","last_became_active":"2023-08-31T18:47:52.526459+0000","last_became_peered":"2023-08-31T18:47:52.526459+0000","last_unstale":"2023-08-31T18:47:52.982462+0000","last_undegraded":"2023-08-31T18:47:52.982462+0000","last_fullsized":"2023-08-31T18:47:52.982462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009967+0000","last_change":"2023-08-31T18:47:52.999739+0000","last_active":"2023-08-31T18:47:53.009967+0000","last_peered":"2023-08-31T18:47:53.009967+0000","last_clean":"2023-08-31T18:47:53.009967+0000","last_became_active":"2023-08-31T18:47:52.999429+0000","last_became_peered":"2023-08-31T18:47:52.999429+0000","last_unstale":"2023-08-31T18:47:53.009967+0000","last_undegraded":"2023-08-31T18:47:53.009967+0000","last_fullsized":"2023-08-31T18:47:53.009967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013109+0000","last_change":"2023-08-31T18:47:52.524499+0000","last_active":"2023-08-31T18:47:53.013109+0000","last_peered":"2023-08-31T18:47:53.013109+0000","last_clean":"2023-08-31T18:47:53.013109+0000","last_became_active":"2023-08-31T18:47:52.524170+0000","last_became_peered":"2023-08-31T18:47:52.524170+0000","last_unstale":"2023-08-31T18:47:53.013109+0000","last_undegraded":"2023-08-31T18:47:53.013109+0000","last_fullsized":"2023-08-31T18:47:53.013109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":81647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":81679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":80303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":80323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":81825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.6289999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.8399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.7840000000000007}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.133}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.6780000000000008}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.4760000000000009}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.1769999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T18:47:57.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T18:47:57.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.463+0000 7fbe56dff700 1 Processor -- start 2023-08-31T18:47:57.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.463+0000 7fbe56dff700 1 -- start start 2023-08-31T18:47:57.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.464+0000 7fbe56dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe500a4a00 0x7fbe500a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.464+0000 7fbe56dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe500bda40 0x7fbe50064ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.464+0000 7fbe56dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe500bcb50 con 0x7fbe50065190 2023-08-31T18:47:57.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.464+0000 7fbe56dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe500bbf40 con 0x7fbe500bda40 2023-08-31T18:47:57.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.464+0000 7fbe56dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500bc220 con 0x7fbe500a4a00 2023-08-31T18:47:57.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.465+0000 7fbe54b9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe500a4a00 0x7fbe500a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.465+0000 7fbe4ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe500bda40 0x7fbe50064ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.465+0000 7fbe54b9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe500a4a00 0x7fbe500a4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:34824/0 (socket says 172.21.15.72:34824) 2023-08-31T18:47:57.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.465+0000 7fbe4ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbe500bda40 0x7fbe50064ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:49034/0 (socket says 172.21.15.72:49034) 2023-08-31T18:47:57.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.465+0000 7fbe54b9b700 1 -- 172.21.15.72:0/3744731904 learned_addr learned my addr 172.21.15.72:0/3744731904 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:57.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.465+0000 7fbe4ffff700 1 -- 172.21.15.72:0/3744731904 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe500a4a00 msgr2=0x7fbe500a4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:57.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.465+0000 7fbe4ffff700 1 --2- 172.21.15.72:0/3744731904 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe500a4a00 0x7fbe500a4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.465+0000 7fbe4ffff700 1 -- 172.21.15.72:0/3744731904 >> v1:172.21.15.146:6789/0 conn(0x7fbe50065190 legacy=0x7fbe500c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.465+0000 7fbe4ffff700 1 -- 172.21.15.72:0/3744731904 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe500bc500 con 0x7fbe500bda40 2023-08-31T18:47:57.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.465+0000 7fbe4f7fe700 1 -- 172.21.15.72:0/3744731904 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2811889844 0 0) 0x7fbe500bcb50 con 0x7fbe50065190 2023-08-31T18:47:57.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.465+0000 7fbe4ffff700 1 --2- 172.21.15.72:0/3744731904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe500bda40 0x7fbe50064ca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fbe3c009760 tx=0x7fbe3c009060).ready entity=mon.1 client_cookie=a2f39df9c446534 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:57.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.465+0000 7fbe4f7fe700 1 -- 172.21.15.72:0/3744731904 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c0090d0 con 0x7fbe500bda40 2023-08-31T18:47:57.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.466+0000 7fbe4f7fe700 1 -- 172.21.15.72:0/3744731904 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c00f510 con 0x7fbe500bda40 2023-08-31T18:47:57.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.466+0000 7fbe4f7fe700 1 -- 172.21.15.72:0/3744731904 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00f890 con 0x7fbe500bda40 2023-08-31T18:47:57.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.466+0000 7fbe56dff700 1 -- 172.21.15.72:0/3744731904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe500bda40 msgr2=0x7fbe50064ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.466+0000 7fbe56dff700 1 --2- 172.21.15.72:0/3744731904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe500bda40 0x7fbe50064ca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fbe3c009760 tx=0x7fbe3c009060).stop 2023-08-31T18:47:57.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.466+0000 7fbe56dff700 1 -- 172.21.15.72:0/3744731904 shutdown_connections 2023-08-31T18:47:57.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.466+0000 7fbe56dff700 1 --2- 172.21.15.72:0/3744731904 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe500a4a00 0x7fbe500a4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.466+0000 7fbe56dff700 1 --2- 172.21.15.72:0/3744731904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe500bda40 0x7fbe50064ca0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.466+0000 7fbe56dff700 1 -- 172.21.15.72:0/3744731904 >> 172.21.15.72:0/3744731904 conn(0x7fbe50063120 msgr2=0x7fbe500c6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:57.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.466+0000 7fbe56dff700 1 -- 172.21.15.72:0/3744731904 shutdown_connections 2023-08-31T18:47:57.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.466+0000 7fbe56dff700 1 -- 172.21.15.72:0/3744731904 wait complete. 2023-08-31T18:47:57.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.468+0000 7fbe56dff700 1 Processor -- start 2023-08-31T18:47:57.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.468+0000 7fbe56dff700 1 -- start start 2023-08-31T18:47:57.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe56dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe500a4a00 0x7fbe50167510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe56dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe500bda40 0x7fbe500abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe56dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe501645d0 0x7fbe50069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe56dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500ac300 con 0x7fbe501645d0 2023-08-31T18:47:57.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe56dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe500abb60 con 0x7fbe500bda40 2023-08-31T18:47:57.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe56dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50164ad0 con 0x7fbe500a4a00 2023-08-31T18:47:57.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe5539c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe501645d0 0x7fbe50069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe5539c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe501645d0 0x7fbe50069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52688/0 (socket says 172.21.15.72:52688) 2023-08-31T18:47:57.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe5539c700 1 -- 172.21.15.72:0/1036918646 learned_addr learned my addr 172.21.15.72:0/1036918646 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:57.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe54b9b700 1 --2- 172.21.15.72:0/1036918646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe500a4a00 0x7fbe50167510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe4ffff700 1 --2- 172.21.15.72:0/1036918646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe500bda40 0x7fbe500abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe5539c700 1 -- 172.21.15.72:0/1036918646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe500a4a00 msgr2=0x7fbe50167510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe5539c700 1 --2- 172.21.15.72:0/1036918646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe500a4a00 0x7fbe50167510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe5539c700 1 -- 172.21.15.72:0/1036918646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe500bda40 msgr2=0x7fbe500abe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe5539c700 1 --2- 172.21.15.72:0/1036918646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe500bda40 0x7fbe500abe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.469+0000 7fbe5539c700 1 -- 172.21.15.72:0/1036918646 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c0092a0 con 0x7fbe501645d0 2023-08-31T18:47:57.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.470+0000 7fbe5539c700 1 --2- 172.21.15.72:0/1036918646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe501645d0 0x7fbe50069f10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fbe4800c7e0 tx=0x7fbe48007ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:57.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.470+0000 7fbe4cff9700 1 -- 172.21.15.72:0/1036918646 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800e4a0 con 0x7fbe501645d0 2023-08-31T18:47:57.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.470+0000 7fbe4cff9700 1 -- 172.21.15.72:0/1036918646 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4800e620 con 0x7fbe501645d0 2023-08-31T18:47:57.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.470+0000 7fbe56dff700 1 -- 172.21.15.72:0/1036918646 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe50164db0 con 0x7fbe501645d0 2023-08-31T18:47:57.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.470+0000 7fbe4cff9700 1 -- 172.21.15.72:0/1036918646 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800e9e0 con 0x7fbe501645d0 2023-08-31T18:47:57.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.470+0000 7fbe56dff700 1 -- 172.21.15.72:0/1036918646 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe50165370 con 0x7fbe501645d0 2023-08-31T18:47:57.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.471+0000 7fbe56dff700 1 -- 172.21.15.72:0/1036918646 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe50165590 con 0x7fbe501645d0 2023-08-31T18:47:57.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.472+0000 7fbe4cff9700 1 -- 172.21.15.72:0/1036918646 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fbe48012400 con 0x7fbe501645d0 2023-08-31T18:47:57.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.473+0000 7fbe4cff9700 1 --2- 172.21.15.72:0/1036918646 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbe3405ee10 0x7fbe340612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.473+0000 7fbe4cff9700 1 -- 172.21.15.72:0/1036918646 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbe48079600 con 0x7fbe501645d0 2023-08-31T18:47:57.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.473+0000 7fbe54b9b700 1 --2- 172.21.15.72:0/1036918646 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbe3405ee10 0x7fbe340612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.474+0000 7fbe54b9b700 1 --2- 172.21.15.72:0/1036918646 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbe3405ee10 0x7fbe340612d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fbe500c7520 tx=0x7fbe440090f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:57.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.477+0000 7fbe4cff9700 1 -- 172.21.15.72:0/1036918646 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbe480478f0 con 0x7fbe501645d0 2023-08-31T18:47:57.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.641+0000 7fbe56dff700 1 -- 172.21.15.72:0/1036918646 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe500bc7e0 con 0x7fbe3405ee10 2023-08-31T18:47:57.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.650+0000 7fbe4cff9700 1 -- 172.21.15.72:0/1036918646 <== mgr.4101 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336458 (secure 0 0 0) 0x7fbe500bc7e0 con 0x7fbe3405ee10 2023-08-31T18:47:57.654 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:47:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.655+0000 7fbe56dff700 1 -- 172.21.15.72:0/1036918646 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbe3405ee10 msgr2=0x7fbe340612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.655+0000 7fbe56dff700 1 --2- 172.21.15.72:0/1036918646 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbe3405ee10 0x7fbe340612d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fbe500c7520 tx=0x7fbe440090f0).stop 2023-08-31T18:47:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.655+0000 7fbe56dff700 1 -- 172.21.15.72:0/1036918646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe501645d0 msgr2=0x7fbe50069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.655+0000 7fbe56dff700 1 --2- 172.21.15.72:0/1036918646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe501645d0 0x7fbe50069f10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fbe4800c7e0 tx=0x7fbe48007ee0).stop 2023-08-31T18:47:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.655+0000 7fbe56dff700 1 -- 172.21.15.72:0/1036918646 shutdown_connections 2023-08-31T18:47:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.655+0000 7fbe56dff700 1 --2- 172.21.15.72:0/1036918646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe501645d0 0x7fbe50069f10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.655+0000 7fbe56dff700 1 --2- 172.21.15.72:0/1036918646 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbe500a4a00 0x7fbe50167510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.655+0000 7fbe56dff700 1 --2- 172.21.15.72:0/1036918646 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbe3405ee10 0x7fbe340612d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.655+0000 7fbe56dff700 1 --2- 172.21.15.72:0/1036918646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbe500bda40 0x7fbe500abe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.655+0000 7fbe56dff700 1 -- 172.21.15.72:0/1036918646 >> 172.21.15.72:0/1036918646 conn(0x7fbe50063120 msgr2=0x7fbe50155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.655+0000 7fbe56dff700 1 -- 172.21.15.72:0/1036918646 shutdown_connections 2023-08-31T18:47:57.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.655+0000 7fbe56dff700 1 -- 172.21.15.72:0/1036918646 wait complete. 2023-08-31T18:47:57.660 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T18:47:57.672 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-08-31T18:47:57.157912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378528,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596192,"statfs":{"total":773094113280,"available":770658500608,"internally_reserved":0,"allocated":1802240,"data_stored":646476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999933+0000","last_change":"2023-08-31T18:47:52.992922+0000","last_active":"2023-08-31T18:47:52.999933+0000","last_peered":"2023-08-31T18:47:52.999933+0000","last_clean":"2023-08-31T18:47:52.999933+0000","last_became_active":"2023-08-31T18:47:52.992608+0000","last_became_peered":"2023-08-31T18:47:52.992608+0000","last_unstale":"2023-08-31T18:47:52.999933+0000","last_undegraded":"2023-08-31T18:47:52.999933+0000","last_fullsized":"2023-08-31T18:47:52.999933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.996800+0000","last_change":"2023-08-31T18:47:52.521541+0000","last_active":"2023-08-31T18:47:52.996800+0000","last_peered":"2023-08-31T18:47:52.996800+0000","last_clean":"2023-08-31T18:47:52.996800+0000","last_became_active":"2023-08-31T18:47:52.521217+0000","last_became_peered":"2023-08-31T18:47:52.521217+0000","last_unstale":"2023-08-31T18:47:52.996800+0000","last_undegraded":"2023-08-31T18:47:52.996800+0000","last_fullsized":"2023-08-31T18:47:52.996800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000193+0000","last_change":"2023-08-31T18:47:52.996417+0000","last_active":"2023-08-31T18:47:53.000193+0000","last_peered":"2023-08-31T18:47:53.000193+0000","last_clean":"2023-08-31T18:47:53.000193+0000","last_became_active":"2023-08-31T18:47:52.995862+0000","last_became_peered":"2023-08-31T18:47:52.995862+0000","last_unstale":"2023-08-31T18:47:53.000193+0000","last_undegraded":"2023-08-31T18:47:53.000193+0000","last_fullsized":"2023-08-31T18:47:53.000193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980914+0000","last_change":"2023-08-31T18:47:52.518722+0000","last_active":"2023-08-31T18:47:52.980914+0000","last_peered":"2023-08-31T18:47:52.980914+0000","last_clean":"2023-08-31T18:47:52.980914+0000","last_became_active":"2023-08-31T18:47:52.518419+0000","last_became_peered":"2023-08-31T18:47:52.518419+0000","last_unstale":"2023-08-31T18:47:52.980914+0000","last_undegraded":"2023-08-31T18:47:52.980914+0000","last_fullsized":"2023-08-31T18:47:52.980914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009855+0000","last_change":"2023-08-31T18:47:53.001560+0000","last_active":"2023-08-31T18:47:53.009855+0000","last_peered":"2023-08-31T18:47:53.009855+0000","last_clean":"2023-08-31T18:47:53.009855+0000","last_became_active":"2023-08-31T18:47:53.001270+0000","last_became_peered":"2023-08-31T18:47:53.001270+0000","last_unstale":"2023-08-31T18:47:53.009855+0000","last_undegraded":"2023-08-31T18:47:53.009855+0000","last_fullsized":"2023-08-31T18:47:53.009855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979087+0000","last_change":"2023-08-31T18:47:52.525069+0000","last_active":"2023-08-31T18:47:52.979087+0000","last_peered":"2023-08-31T18:47:52.979087+0000","last_clean":"2023-08-31T18:47:52.979087+0000","last_became_active":"2023-08-31T18:47:52.524768+0000","last_became_peered":"2023-08-31T18:47:52.524768+0000","last_unstale":"2023-08-31T18:47:52.979087+0000","last_undegraded":"2023-08-31T18:47:52.979087+0000","last_fullsized":"2023-08-31T18:47:52.979087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999959+0000","last_change":"2023-08-31T18:47:52.992909+0000","last_active":"2023-08-31T18:47:52.999959+0000","last_peered":"2023-08-31T18:47:52.999959+0000","last_clean":"2023-08-31T18:47:52.999959+0000","last_became_active":"2023-08-31T18:47:52.992649+0000","last_became_peered":"2023-08-31T18:47:52.992649+0000","last_unstale":"2023-08-31T18:47:52.999959+0000","last_undegraded":"2023-08-31T18:47:52.999959+0000","last_fullsized":"2023-08-31T18:47:52.999959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.987323+0000","last_change":"2023-08-31T18:47:52.535019+0000","last_active":"2023-08-31T18:47:52.987323+0000","last_peered":"2023-08-31T18:47:52.987323+0000","last_clean":"2023-08-31T18:47:52.987323+0000","last_became_active":"2023-08-31T18:47:52.534783+0000","last_became_peered":"2023-08-31T18:47:52.534783+0000","last_unstale":"2023-08-31T18:47:52.987323+0000","last_undegraded":"2023-08-31T18:47:52.987323+0000","last_fullsized":"2023-08-31T18:47:52.987323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000964+0000","last_change":"2023-08-31T18:47:52.998713+0000","last_active":"2023-08-31T18:47:53.000964+0000","last_peered":"2023-08-31T18:47:53.000964+0000","last_clean":"2023-08-31T18:47:53.000964+0000","last_became_active":"2023-08-31T18:47:52.998411+0000","last_became_peered":"2023-08-31T18:47:52.998411+0000","last_unstale":"2023-08-31T18:47:53.000964+0000","last_undegraded":"2023-08-31T18:47:53.000964+0000","last_fullsized":"2023-08-31T18:47:53.000964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.983910+0000","last_change":"2023-08-31T18:47:52.530799+0000","last_active":"2023-08-31T18:47:52.983910+0000","last_peered":"2023-08-31T18:47:52.983910+0000","last_clean":"2023-08-31T18:47:52.983910+0000","last_became_active":"2023-08-31T18:47:52.530384+0000","last_became_peered":"2023-08-31T18:47:52.530384+0000","last_unstale":"2023-08-31T18:47:52.983910+0000","last_undegraded":"2023-08-31T18:47:52.983910+0000","last_fullsized":"2023-08-31T18:47:52.983910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003882+0000","last_change":"2023-08-31T18:47:52.992664+0000","last_active":"2023-08-31T18:47:53.003882+0000","last_peered":"2023-08-31T18:47:53.003882+0000","last_clean":"2023-08-31T18:47:53.003882+0000","last_became_active":"2023-08-31T18:47:52.992340+0000","last_became_peered":"2023-08-31T18:47:52.992340+0000","last_unstale":"2023-08-31T18:47:53.003882+0000","last_undegraded":"2023-08-31T18:47:53.003882+0000","last_fullsized":"2023-08-31T18:47:53.003882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.008581+0000","last_change":"2023-08-31T18:47:52.518423+0000","last_active":"2023-08-31T18:47:53.008581+0000","last_peered":"2023-08-31T18:47:53.008581+0000","last_clean":"2023-08-31T18:47:53.008581+0000","last_became_active":"2023-08-31T18:47:52.518154+0000","last_became_peered":"2023-08-31T18:47:52.518154+0000","last_unstale":"2023-08-31T18:47:53.008581+0000","last_undegraded":"2023-08-31T18:47:53.008581+0000","last_fullsized":"2023-08-31T18:47:53.008581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013444+0000","last_change":"2023-08-31T18:47:53.010969+0000","last_active":"2023-08-31T18:47:53.013444+0000","last_peered":"2023-08-31T18:47:53.013444+0000","last_clean":"2023-08-31T18:47:53.013444+0000","last_became_active":"2023-08-31T18:47:53.010624+0000","last_became_peered":"2023-08-31T18:47:53.010624+0000","last_unstale":"2023-08-31T18:47:53.013444+0000","last_undegraded":"2023-08-31T18:47:53.013444+0000","last_fullsized":"2023-08-31T18:47:53.013444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.012371+0000","last_change":"2023-08-31T18:47:52.528781+0000","last_active":"2023-08-31T18:47:53.012371+0000","last_peered":"2023-08-31T18:47:53.012371+0000","last_clean":"2023-08-31T18:47:53.012371+0000","last_became_active":"2023-08-31T18:47:52.528511+0000","last_became_peered":"2023-08-31T18:47:52.528511+0000","last_unstale":"2023-08-31T18:47:53.012371+0000","last_undegraded":"2023-08-31T18:47:53.012371+0000","last_fullsized":"2023-08-31T18:47:53.012371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999774+0000","last_change":"2023-08-31T18:47:52.992861+0000","last_active":"2023-08-31T18:47:52.999774+0000","last_peered":"2023-08-31T18:47:52.999774+0000","last_clean":"2023-08-31T18:47:52.999774+0000","last_became_active":"2023-08-31T18:47:52.992558+0000","last_became_peered":"2023-08-31T18:47:52.992558+0000","last_unstale":"2023-08-31T18:47:52.999774+0000","last_undegraded":"2023-08-31T18:47:52.999774+0000","last_fullsized":"2023-08-31T18:47:52.999774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000569+0000","last_change":"2023-08-31T18:47:52.531835+0000","last_active":"2023-08-31T18:47:53.000569+0000","last_peered":"2023-08-31T18:47:53.000569+0000","last_clean":"2023-08-31T18:47:53.000569+0000","last_became_active":"2023-08-31T18:47:52.531561+0000","last_became_peered":"2023-08-31T18:47:52.531561+0000","last_unstale":"2023-08-31T18:47:53.000569+0000","last_undegraded":"2023-08-31T18:47:53.000569+0000","last_fullsized":"2023-08-31T18:47:53.000569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.011345+0000","last_change":"2023-08-31T18:47:53.006651+0000","last_active":"2023-08-31T18:47:53.011345+0000","last_peered":"2023-08-31T18:47:53.011345+0000","last_clean":"2023-08-31T18:47:53.011345+0000","last_became_active":"2023-08-31T18:47:53.006149+0000","last_became_peered":"2023-08-31T18:47:53.006149+0000","last_unstale":"2023-08-31T18:47:53.011345+0000","last_undegraded":"2023-08-31T18:47:53.011345+0000","last_fullsized":"2023-08-31T18:47:53.011345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984191+0000","last_change":"2023-08-31T18:47:52.526672+0000","last_active":"2023-08-31T18:47:52.984191+0000","last_peered":"2023-08-31T18:47:52.984191+0000","last_clean":"2023-08-31T18:47:52.984191+0000","last_became_active":"2023-08-31T18:47:52.526370+0000","last_became_peered":"2023-08-31T18:47:52.526370+0000","last_unstale":"2023-08-31T18:47:52.984191+0000","last_undegraded":"2023-08-31T18:47:52.984191+0000","last_fullsized":"2023-08-31T18:47:52.984191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000173+0000","last_change":"2023-08-31T18:47:52.996230+0000","last_active":"2023-08-31T18:47:53.000173+0000","last_peered":"2023-08-31T18:47:53.000173+0000","last_clean":"2023-08-31T18:47:53.000173+0000","last_became_active":"2023-08-31T18:47:52.995080+0000","last_became_peered":"2023-08-31T18:47:52.995080+0000","last_unstale":"2023-08-31T18:47:53.000173+0000","last_undegraded":"2023-08-31T18:47:53.000173+0000","last_fullsized":"2023-08-31T18:47:53.000173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993377+0000","last_change":"2023-08-31T18:47:52.523040+0000","last_active":"2023-08-31T18:47:52.993377+0000","last_peered":"2023-08-31T18:47:52.993377+0000","last_clean":"2023-08-31T18:47:52.993377+0000","last_became_active":"2023-08-31T18:47:52.522587+0000","last_became_peered":"2023-08-31T18:47:52.522587+0000","last_unstale":"2023-08-31T18:47:52.993377+0000","last_undegraded":"2023-08-31T18:47:52.993377+0000","last_fullsized":"2023-08-31T18:47:52.993377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.004847+0000","last_change":"2023-08-31T18:47:53.002154+0000","last_active":"2023-08-31T18:47:53.004847+0000","last_peered":"2023-08-31T18:47:53.004847+0000","last_clean":"2023-08-31T18:47:53.004847+0000","last_became_active":"2023-08-31T18:47:53.001849+0000","last_became_peered":"2023-08-31T18:47:53.001849+0000","last_unstale":"2023-08-31T18:47:53.004847+0000","last_undegraded":"2023-08-31T18:47:53.004847+0000","last_fullsized":"2023-08-31T18:47:53.004847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.995745+0000","last_change":"2023-08-31T18:47:52.526655+0000","last_active":"2023-08-31T18:47:52.995745+0000","last_peered":"2023-08-31T18:47:52.995745+0000","last_clean":"2023-08-31T18:47:52.995745+0000","last_became_active":"2023-08-31T18:47:52.525963+0000","last_became_peered":"2023-08-31T18:47:52.525963+0000","last_unstale":"2023-08-31T18:47:52.995745+0000","last_undegraded":"2023-08-31T18:47:52.995745+0000","last_fullsized":"2023-08-31T18:47:52.995745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009266+0000","last_change":"2023-08-31T18:47:52.997454+0000","last_active":"2023-08-31T18:47:53.009266+0000","last_peered":"2023-08-31T18:47:53.009266+0000","last_clean":"2023-08-31T18:47:53.009266+0000","last_became_active":"2023-08-31T18:47:52.997016+0000","last_became_peered":"2023-08-31T18:47:52.997016+0000","last_unstale":"2023-08-31T18:47:53.009266+0000","last_undegraded":"2023-08-31T18:47:53.009266+0000","last_fullsized":"2023-08-31T18:47:53.009266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013124+0000","last_change":"2023-08-31T18:47:52.523613+0000","last_active":"2023-08-31T18:47:53.013124+0000","last_peered":"2023-08-31T18:47:53.013124+0000","last_clean":"2023-08-31T18:47:53.013124+0000","last_became_active":"2023-08-31T18:47:52.522576+0000","last_became_peered":"2023-08-31T18:47:52.522576+0000","last_unstale":"2023-08-31T18:47:53.013124+0000","last_undegraded":"2023-08-31T18:47:53.013124+0000","last_fullsized":"2023-08-31T18:47:53.013124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010365+0000","last_change":"2023-08-31T18:47:53.005565+0000","last_active":"2023-08-31T18:47:53.010365+0000","last_peered":"2023-08-31T18:47:53.010365+0000","last_clean":"2023-08-31T18:47:53.010365+0000","last_became_active":"2023-08-31T18:47:53.005190+0000","last_became_peered":"2023-08-31T18:47:53.005190+0000","last_unstale":"2023-08-31T18:47:53.010365+0000","last_undegraded":"2023-08-31T18:47:53.010365+0000","last_fullsized":"2023-08-31T18:47:53.010365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.012195+0000","last_change":"2023-08-31T18:47:52.533431+0000","last_active":"2023-08-31T18:47:53.012195+0000","last_peered":"2023-08-31T18:47:53.012195+0000","last_clean":"2023-08-31T18:47:53.012195+0000","last_became_active":"2023-08-31T18:47:52.532932+0000","last_became_peered":"2023-08-31T18:47:52.532932+0000","last_unstale":"2023-08-31T18:47:53.012195+0000","last_undegraded":"2023-08-31T18:47:53.012195+0000","last_fullsized":"2023-08-31T18:47:53.012195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009811+0000","last_change":"2023-08-31T18:47:53.001374+0000","last_active":"2023-08-31T18:47:53.009811+0000","last_peered":"2023-08-31T18:47:53.009811+0000","last_clean":"2023-08-31T18:47:53.009811+0000","last_became_active":"2023-08-31T18:47:52.997729+0000","last_became_peered":"2023-08-31T18:47:52.997729+0000","last_unstale":"2023-08-31T18:47:53.009811+0000","last_undegraded":"2023-08-31T18:47:53.009811+0000","last_fullsized":"2023-08-31T18:47:53.009811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.988324+0000","last_change":"2023-08-31T18:47:52.534072+0000","last_active":"2023-08-31T18:47:52.988324+0000","last_peered":"2023-08-31T18:47:52.988324+0000","last_clean":"2023-08-31T18:47:52.988324+0000","last_became_active":"2023-08-31T18:47:52.533779+0000","last_became_peered":"2023-08-31T18:47:52.533779+0000","last_unstale":"2023-08-31T18:47:52.988324+0000","last_undegraded":"2023-08-31T18:47:52.988324+0000","last_fullsized":"2023-08-31T18:47:52.988324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.994371+0000","last_change":"2023-08-31T18:47:52.990541+0000","last_active":"2023-08-31T18:47:52.994371+0000","last_peered":"2023-08-31T18:47:52.994371+0000","last_clean":"2023-08-31T18:47:52.994371+0000","last_became_active":"2023-08-31T18:47:52.990287+0000","last_became_peered":"2023-08-31T18:47:52.990287+0000","last_unstale":"2023-08-31T18:47:52.994371+0000","last_undegraded":"2023-08-31T18:47:52.994371+0000","last_fullsized":"2023-08-31T18:47:52.994371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981085+0000","last_change":"2023-08-31T18:47:52.532002+0000","last_active":"2023-08-31T18:47:52.981085+0000","last_peered":"2023-08-31T18:47:52.981085+0000","last_clean":"2023-08-31T18:47:52.981085+0000","last_became_active":"2023-08-31T18:47:52.530907+0000","last_became_peered":"2023-08-31T18:47:52.530907+0000","last_unstale":"2023-08-31T18:47:52.981085+0000","last_undegraded":"2023-08-31T18:47:52.981085+0000","last_fullsized":"2023-08-31T18:47:52.981085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010346+0000","last_change":"2023-08-31T18:47:53.006764+0000","last_active":"2023-08-31T18:47:53.010346+0000","last_peered":"2023-08-31T18:47:53.010346+0000","last_clean":"2023-08-31T18:47:53.010346+0000","last_became_active":"2023-08-31T18:47:53.006455+0000","last_became_peered":"2023-08-31T18:47:53.006455+0000","last_unstale":"2023-08-31T18:47:53.010346+0000","last_undegraded":"2023-08-31T18:47:53.010346+0000","last_fullsized":"2023-08-31T18:47:53.010346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999985+0000","last_change":"2023-08-31T18:47:52.526280+0000","last_active":"2023-08-31T18:47:52.999985+0000","last_peered":"2023-08-31T18:47:52.999985+0000","last_clean":"2023-08-31T18:47:52.999985+0000","last_became_active":"2023-08-31T18:47:52.524905+0000","last_became_peered":"2023-08-31T18:47:52.524905+0000","last_unstale":"2023-08-31T18:47:52.999985+0000","last_undegraded":"2023-08-31T18:47:52.999985+0000","last_fullsized":"2023-08-31T18:47:52.999985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009365+0000","last_change":"2023-08-31T18:47:53.004475+0000","last_active":"2023-08-31T18:47:53.009365+0000","last_peered":"2023-08-31T18:47:53.009365+0000","last_clean":"2023-08-31T18:47:53.009365+0000","last_became_active":"2023-08-31T18:47:53.004127+0000","last_became_peered":"2023-08-31T18:47:53.004127+0000","last_unstale":"2023-08-31T18:47:53.009365+0000","last_undegraded":"2023-08-31T18:47:53.009365+0000","last_fullsized":"2023-08-31T18:47:53.009365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981133+0000","last_change":"2023-08-31T18:47:52.519012+0000","last_active":"2023-08-31T18:47:52.981133+0000","last_peered":"2023-08-31T18:47:52.981133+0000","last_clean":"2023-08-31T18:47:52.981133+0000","last_became_active":"2023-08-31T18:47:52.518704+0000","last_became_peered":"2023-08-31T18:47:52.518704+0000","last_unstale":"2023-08-31T18:47:52.981133+0000","last_undegraded":"2023-08-31T18:47:52.981133+0000","last_fullsized":"2023-08-31T18:47:52.981133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.014052+0000","last_change":"2023-08-31T18:47:53.011342+0000","last_active":"2023-08-31T18:47:53.014052+0000","last_peered":"2023-08-31T18:47:53.014052+0000","last_clean":"2023-08-31T18:47:53.014052+0000","last_became_active":"2023-08-31T18:47:53.010851+0000","last_became_peered":"2023-08-31T18:47:53.010851+0000","last_unstale":"2023-08-31T18:47:53.014052+0000","last_undegraded":"2023-08-31T18:47:53.014052+0000","last_fullsized":"2023-08-31T18:47:53.014052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.996543+0000","last_change":"2023-08-31T18:47:52.528000+0000","last_active":"2023-08-31T18:47:52.996543+0000","last_peered":"2023-08-31T18:47:52.996543+0000","last_clean":"2023-08-31T18:47:52.996543+0000","last_became_active":"2023-08-31T18:47:52.527687+0000","last_became_peered":"2023-08-31T18:47:52.527687+0000","last_unstale":"2023-08-31T18:47:52.996543+0000","last_undegraded":"2023-08-31T18:47:52.996543+0000","last_fullsized":"2023-08-31T18:47:52.996543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.004012+0000","last_change":"2023-08-31T18:47:53.001422+0000","last_active":"2023-08-31T18:47:53.004012+0000","last_peered":"2023-08-31T18:47:53.004012+0000","last_clean":"2023-08-31T18:47:53.004012+0000","last_became_active":"2023-08-31T18:47:53.001068+0000","last_became_peered":"2023-08-31T18:47:53.001068+0000","last_unstale":"2023-08-31T18:47:53.004012+0000","last_undegraded":"2023-08-31T18:47:53.004012+0000","last_fullsized":"2023-08-31T18:47:53.004012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978870+0000","last_change":"2023-08-31T18:47:52.528548+0000","last_active":"2023-08-31T18:47:52.978870+0000","last_peered":"2023-08-31T18:47:52.978870+0000","last_clean":"2023-08-31T18:47:52.978870+0000","last_became_active":"2023-08-31T18:47:52.528233+0000","last_became_peered":"2023-08-31T18:47:52.528233+0000","last_unstale":"2023-08-31T18:47:52.978870+0000","last_undegraded":"2023-08-31T18:47:52.978870+0000","last_fullsized":"2023-08-31T18:47:52.978870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982414+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T18:47:52.982414+0000","last_peered":"2023-08-31T18:47:52.982414+0000","last_clean":"2023-08-31T18:47:52.982414+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T18:47:52.982414+0000","last_undegraded":"2023-08-31T18:47:52.982414+0000","last_fullsized":"2023-08-31T18:47:52.982414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.983371+0000","last_change":"2023-08-31T18:47:52.531147+0000","last_active":"2023-08-31T18:47:52.983371+0000","last_peered":"2023-08-31T18:47:52.983371+0000","last_clean":"2023-08-31T18:47:52.983371+0000","last_became_active":"2023-08-31T18:47:52.530795+0000","last_became_peered":"2023-08-31T18:47:52.530795+0000","last_unstale":"2023-08-31T18:47:52.983371+0000","last_undegraded":"2023-08-31T18:47:52.983371+0000","last_fullsized":"2023-08-31T18:47:52.983371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003902+0000","last_change":"2023-08-31T18:47:52.996878+0000","last_active":"2023-08-31T18:47:53.003902+0000","last_peered":"2023-08-31T18:47:53.003902+0000","last_clean":"2023-08-31T18:47:53.003902+0000","last_became_active":"2023-08-31T18:47:52.996585+0000","last_became_peered":"2023-08-31T18:47:52.996585+0000","last_unstale":"2023-08-31T18:47:53.003902+0000","last_undegraded":"2023-08-31T18:47:53.003902+0000","last_fullsized":"2023-08-31T18:47:53.003902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982257+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T18:47:52.982257+0000","last_peered":"2023-08-31T18:47:52.982257+0000","last_clean":"2023-08-31T18:47:52.982257+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T18:47:52.982257+0000","last_undegraded":"2023-08-31T18:47:52.982257+0000","last_fullsized":"2023-08-31T18:47:52.982257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997186+0000","last_change":"2023-08-31T18:47:52.528056+0000","last_active":"2023-08-31T18:47:52.997186+0000","last_peered":"2023-08-31T18:47:52.997186+0000","last_clean":"2023-08-31T18:47:52.997186+0000","last_became_active":"2023-08-31T18:47:52.527756+0000","last_became_peered":"2023-08-31T18:47:52.527756+0000","last_unstale":"2023-08-31T18:47:52.997186+0000","last_undegraded":"2023-08-31T18:47:52.997186+0000","last_fullsized":"2023-08-31T18:47:52.997186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.998135+0000","last_change":"2023-08-31T18:47:52.990235+0000","last_active":"2023-08-31T18:47:52.998135+0000","last_peered":"2023-08-31T18:47:52.998135+0000","last_clean":"2023-08-31T18:47:52.998135+0000","last_became_active":"2023-08-31T18:47:52.989630+0000","last_became_peered":"2023-08-31T18:47:52.989630+0000","last_unstale":"2023-08-31T18:47:52.998135+0000","last_undegraded":"2023-08-31T18:47:52.998135+0000","last_fullsized":"2023-08-31T18:47:52.998135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003993+0000","last_change":"2023-08-31T18:47:52.997214+0000","last_active":"2023-08-31T18:47:53.003993+0000","last_peered":"2023-08-31T18:47:53.003993+0000","last_clean":"2023-08-31T18:47:53.003993+0000","last_became_active":"2023-08-31T18:47:52.996959+0000","last_became_peered":"2023-08-31T18:47:52.996959+0000","last_unstale":"2023-08-31T18:47:53.003993+0000","last_undegraded":"2023-08-31T18:47:53.003993+0000","last_fullsized":"2023-08-31T18:47:53.003993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979854+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T18:47:52.979854+0000","last_peered":"2023-08-31T18:47:52.979854+0000","last_clean":"2023-08-31T18:47:52.979854+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T18:47:52.979854+0000","last_undegraded":"2023-08-31T18:47:52.979854+0000","last_fullsized":"2023-08-31T18:47:52.979854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981140+0000","last_change":"2023-08-31T18:47:52.531329+0000","last_active":"2023-08-31T18:47:52.981140+0000","last_peered":"2023-08-31T18:47:52.981140+0000","last_clean":"2023-08-31T18:47:52.981140+0000","last_became_active":"2023-08-31T18:47:52.531098+0000","last_became_peered":"2023-08-31T18:47:52.531098+0000","last_unstale":"2023-08-31T18:47:52.981140+0000","last_undegraded":"2023-08-31T18:47:52.981140+0000","last_fullsized":"2023-08-31T18:47:52.981140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009822+0000","last_change":"2023-08-31T18:47:53.001676+0000","last_active":"2023-08-31T18:47:53.009822+0000","last_peered":"2023-08-31T18:47:53.009822+0000","last_clean":"2023-08-31T18:47:53.009822+0000","last_became_active":"2023-08-31T18:47:52.999806+0000","last_became_peered":"2023-08-31T18:47:52.999806+0000","last_unstale":"2023-08-31T18:47:53.009822+0000","last_undegraded":"2023-08-31T18:47:53.009822+0000","last_fullsized":"2023-08-31T18:47:53.009822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982159+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T18:47:52.982159+0000","last_peered":"2023-08-31T18:47:52.982159+0000","last_clean":"2023-08-31T18:47:52.982159+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T18:47:52.982159+0000","last_undegraded":"2023-08-31T18:47:52.982159+0000","last_fullsized":"2023-08-31T18:47:52.982159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993155+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T18:47:52.993155+0000","last_peered":"2023-08-31T18:47:52.993155+0000","last_clean":"2023-08-31T18:47:52.993155+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T18:47:52.993155+0000","last_undegraded":"2023-08-31T18:47:52.993155+0000","last_fullsized":"2023-08-31T18:47:52.993155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978881+0000","last_change":"2023-08-31T18:47:52.536563+0000","last_active":"2023-08-31T18:47:52.978881+0000","last_peered":"2023-08-31T18:47:52.978881+0000","last_clean":"2023-08-31T18:47:52.978881+0000","last_became_active":"2023-08-31T18:47:52.536326+0000","last_became_peered":"2023-08-31T18:47:52.536326+0000","last_unstale":"2023-08-31T18:47:52.978881+0000","last_undegraded":"2023-08-31T18:47:52.978881+0000","last_fullsized":"2023-08-31T18:47:52.978881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.994407+0000","last_change":"2023-08-31T18:47:52.990146+0000","last_active":"2023-08-31T18:47:52.994407+0000","last_peered":"2023-08-31T18:47:52.994407+0000","last_clean":"2023-08-31T18:47:52.994407+0000","last_became_active":"2023-08-31T18:47:52.989854+0000","last_became_peered":"2023-08-31T18:47:52.989854+0000","last_unstale":"2023-08-31T18:47:52.994407+0000","last_undegraded":"2023-08-31T18:47:52.994407+0000","last_fullsized":"2023-08-31T18:47:52.994407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993495+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T18:47:52.993495+0000","last_peered":"2023-08-31T18:47:52.993495+0000","last_clean":"2023-08-31T18:47:52.993495+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T18:47:52.993495+0000","last_undegraded":"2023-08-31T18:47:52.993495+0000","last_fullsized":"2023-08-31T18:47:52.993495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.983178+0000","last_change":"2023-08-31T18:47:52.521251+0000","last_active":"2023-08-31T18:47:52.983178+0000","last_peered":"2023-08-31T18:47:52.983178+0000","last_clean":"2023-08-31T18:47:52.983178+0000","last_became_active":"2023-08-31T18:47:52.520981+0000","last_became_peered":"2023-08-31T18:47:52.520981+0000","last_unstale":"2023-08-31T18:47:52.983178+0000","last_undegraded":"2023-08-31T18:47:52.983178+0000","last_fullsized":"2023-08-31T18:47:52.983178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.988216+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T18:47:52.988216+0000","last_peered":"2023-08-31T18:47:52.988216+0000","last_clean":"2023-08-31T18:47:52.988216+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T18:47:52.988216+0000","last_undegraded":"2023-08-31T18:47:52.988216+0000","last_fullsized":"2023-08-31T18:47:52.988216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982531+0000","last_change":"2023-08-31T18:47:52.531178+0000","last_active":"2023-08-31T18:47:52.982531+0000","last_peered":"2023-08-31T18:47:52.982531+0000","last_clean":"2023-08-31T18:47:52.982531+0000","last_became_active":"2023-08-31T18:47:52.530913+0000","last_became_peered":"2023-08-31T18:47:52.530913+0000","last_unstale":"2023-08-31T18:47:52.982531+0000","last_undegraded":"2023-08-31T18:47:52.982531+0000","last_fullsized":"2023-08-31T18:47:52.982531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.005141+0000","last_change":"2023-08-31T18:47:53.003355+0000","last_active":"2023-08-31T18:47:53.005141+0000","last_peered":"2023-08-31T18:47:53.005141+0000","last_clean":"2023-08-31T18:47:53.005141+0000","last_became_active":"2023-08-31T18:47:53.003045+0000","last_became_peered":"2023-08-31T18:47:53.003045+0000","last_unstale":"2023-08-31T18:47:53.005141+0000","last_undegraded":"2023-08-31T18:47:53.005141+0000","last_fullsized":"2023-08-31T18:47:53.005141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002389+0000","last_change":"2023-08-31T18:47:52.529487+0000","last_active":"2023-08-31T18:47:53.002389+0000","last_peered":"2023-08-31T18:47:53.002389+0000","last_clean":"2023-08-31T18:47:53.002389+0000","last_became_active":"2023-08-31T18:47:52.529159+0000","last_became_peered":"2023-08-31T18:47:52.529159+0000","last_unstale":"2023-08-31T18:47:53.002389+0000","last_undegraded":"2023-08-31T18:47:53.002389+0000","last_fullsized":"2023-08-31T18:47:53.002389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982262+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T18:47:52.982262+0000","last_peered":"2023-08-31T18:47:52.982262+0000","last_clean":"2023-08-31T18:47:52.982262+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T18:47:52.982262+0000","last_undegraded":"2023-08-31T18:47:52.982262+0000","last_fullsized":"2023-08-31T18:47:52.982262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002206+0000","last_change":"2023-08-31T18:47:52.997271+0000","last_active":"2023-08-31T18:47:53.002206+0000","last_peered":"2023-08-31T18:47:53.002206+0000","last_clean":"2023-08-31T18:47:53.002206+0000","last_became_active":"2023-08-31T18:47:52.996372+0000","last_became_peered":"2023-08-31T18:47:52.996372+0000","last_unstale":"2023-08-31T18:47:53.002206+0000","last_undegraded":"2023-08-31T18:47:53.002206+0000","last_fullsized":"2023-08-31T18:47:53.002206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979289+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T18:47:52.979289+0000","last_peered":"2023-08-31T18:47:52.979289+0000","last_clean":"2023-08-31T18:47:52.979289+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T18:47:52.979289+0000","last_undegraded":"2023-08-31T18:47:52.979289+0000","last_fullsized":"2023-08-31T18:47:52.979289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.985153+0000","last_change":"2023-08-31T18:47:52.525869+0000","last_active":"2023-08-31T18:47:52.985153+0000","last_peered":"2023-08-31T18:47:52.985153+0000","last_clean":"2023-08-31T18:47:52.985153+0000","last_became_active":"2023-08-31T18:47:52.525594+0000","last_became_peered":"2023-08-31T18:47:52.525594+0000","last_unstale":"2023-08-31T18:47:52.985153+0000","last_undegraded":"2023-08-31T18:47:52.985153+0000","last_fullsized":"2023-08-31T18:47:52.985153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009323+0000","last_change":"2023-08-31T18:47:53.003708+0000","last_active":"2023-08-31T18:47:53.009323+0000","last_peered":"2023-08-31T18:47:53.009323+0000","last_clean":"2023-08-31T18:47:53.009323+0000","last_became_active":"2023-08-31T18:47:53.001875+0000","last_became_peered":"2023-08-31T18:47:53.001875+0000","last_unstale":"2023-08-31T18:47:53.009323+0000","last_undegraded":"2023-08-31T18:47:53.009323+0000","last_fullsized":"2023-08-31T18:47:53.009323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000518+0000","last_change":"2023-08-31T18:47:52.990509+0000","last_active":"2023-08-31T18:47:53.000518+0000","last_peered":"2023-08-31T18:47:53.000518+0000","last_clean":"2023-08-31T18:47:53.000518+0000","last_became_active":"2023-08-31T18:47:52.990124+0000","last_became_peered":"2023-08-31T18:47:52.990124+0000","last_unstale":"2023-08-31T18:47:53.000518+0000","last_undegraded":"2023-08-31T18:47:53.000518+0000","last_fullsized":"2023-08-31T18:47:53.000518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984947+0000","last_change":"2023-08-31T18:47:52.530755+0000","last_active":"2023-08-31T18:47:52.984947+0000","last_peered":"2023-08-31T18:47:52.984947+0000","last_clean":"2023-08-31T18:47:52.984947+0000","last_became_active":"2023-08-31T18:47:52.530495+0000","last_became_peered":"2023-08-31T18:47:52.530495+0000","last_unstale":"2023-08-31T18:47:52.984947+0000","last_undegraded":"2023-08-31T18:47:52.984947+0000","last_fullsized":"2023-08-31T18:47:52.984947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010816+0000","last_change":"2023-08-31T18:47:53.008012+0000","last_active":"2023-08-31T18:47:53.010816+0000","last_peered":"2023-08-31T18:47:53.010816+0000","last_clean":"2023-08-31T18:47:53.010816+0000","last_became_active":"2023-08-31T18:47:53.007721+0000","last_became_peered":"2023-08-31T18:47:53.007721+0000","last_unstale":"2023-08-31T18:47:53.010816+0000","last_undegraded":"2023-08-31T18:47:53.010816+0000","last_fullsized":"2023-08-31T18:47:53.010816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981199+0000","last_change":"2023-08-31T18:47:52.536133+0000","last_active":"2023-08-31T18:47:52.981199+0000","last_peered":"2023-08-31T18:47:52.981199+0000","last_clean":"2023-08-31T18:47:52.981199+0000","last_became_active":"2023-08-31T18:47:52.535677+0000","last_became_peered":"2023-08-31T18:47:52.535677+0000","last_unstale":"2023-08-31T18:47:52.981199+0000","last_undegraded":"2023-08-31T18:47:52.981199+0000","last_fullsized":"2023-08-31T18:47:52.981199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010314+0000","last_change":"2023-08-31T18:47:53.007441+0000","last_active":"2023-08-31T18:47:53.010314+0000","last_peered":"2023-08-31T18:47:53.010314+0000","last_clean":"2023-08-31T18:47:53.010314+0000","last_became_active":"2023-08-31T18:47:53.007151+0000","last_became_peered":"2023-08-31T18:47:53.007151+0000","last_unstale":"2023-08-31T18:47:53.010314+0000","last_undegraded":"2023-08-31T18:47:53.010314+0000","last_fullsized":"2023-08-31T18:47:53.010314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997915+0000","last_change":"2023-08-31T18:47:52.534374+0000","last_active":"2023-08-31T18:47:52.997915+0000","last_peered":"2023-08-31T18:47:52.997915+0000","last_clean":"2023-08-31T18:47:52.997915+0000","last_became_active":"2023-08-31T18:47:52.534039+0000","last_became_peered":"2023-08-31T18:47:52.534039+0000","last_unstale":"2023-08-31T18:47:52.997915+0000","last_undegraded":"2023-08-31T18:47:52.997915+0000","last_fullsized":"2023-08-31T18:47:52.997915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999154+0000","last_change":"2023-08-31T18:47:52.988662+0000","last_active":"2023-08-31T18:47:52.999154+0000","last_peered":"2023-08-31T18:47:52.999154+0000","last_clean":"2023-08-31T18:47:52.999154+0000","last_became_active":"2023-08-31T18:47:52.988023+0000","last_became_peered":"2023-08-31T18:47:52.988023+0000","last_unstale":"2023-08-31T18:47:52.999154+0000","last_undegraded":"2023-08-31T18:47:52.999154+0000","last_fullsized":"2023-08-31T18:47:52.999154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997630+0000","last_change":"2023-08-31T18:47:52.529298+0000","last_active":"2023-08-31T18:47:52.997630+0000","last_peered":"2023-08-31T18:47:52.997630+0000","last_clean":"2023-08-31T18:47:52.997630+0000","last_became_active":"2023-08-31T18:47:52.529019+0000","last_became_peered":"2023-08-31T18:47:52.529019+0000","last_unstale":"2023-08-31T18:47:52.997630+0000","last_undegraded":"2023-08-31T18:47:52.997630+0000","last_fullsized":"2023-08-31T18:47:52.997630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013482+0000","last_change":"2023-08-31T18:47:53.011094+0000","last_active":"2023-08-31T18:47:53.013482+0000","last_peered":"2023-08-31T18:47:53.013482+0000","last_clean":"2023-08-31T18:47:53.013482+0000","last_became_active":"2023-08-31T18:47:53.010736+0000","last_became_peered":"2023-08-31T18:47:53.010736+0000","last_unstale":"2023-08-31T18:47:53.013482+0000","last_undegraded":"2023-08-31T18:47:53.013482+0000","last_fullsized":"2023-08-31T18:47:53.013482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.995373+0000","last_change":"2023-08-31T18:47:52.535396+0000","last_active":"2023-08-31T18:47:52.995373+0000","last_peered":"2023-08-31T18:47:52.995373+0000","last_clean":"2023-08-31T18:47:52.995373+0000","last_became_active":"2023-08-31T18:47:52.535096+0000","last_became_peered":"2023-08-31T18:47:52.535096+0000","last_unstale":"2023-08-31T18:47:52.995373+0000","last_undegraded":"2023-08-31T18:47:52.995373+0000","last_fullsized":"2023-08-31T18:47:52.995373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.011507+0000","last_change":"2023-08-31T18:47:53.010796+0000","last_active":"2023-08-31T18:47:53.011507+0000","last_peered":"2023-08-31T18:47:53.011507+0000","last_clean":"2023-08-31T18:47:53.011507+0000","last_became_active":"2023-08-31T18:47:53.010536+0000","last_became_peered":"2023-08-31T18:47:53.010536+0000","last_unstale":"2023-08-31T18:47:53.011507+0000","last_undegraded":"2023-08-31T18:47:53.011507+0000","last_fullsized":"2023-08-31T18:47:53.011507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979264+0000","last_change":"2023-08-31T18:47:52.526866+0000","last_active":"2023-08-31T18:47:52.979264+0000","last_peered":"2023-08-31T18:47:52.979264+0000","last_clean":"2023-08-31T18:47:52.979264+0000","last_became_active":"2023-08-31T18:47:52.526378+0000","last_became_peered":"2023-08-31T18:47:52.526378+0000","last_unstale":"2023-08-31T18:47:52.979264+0000","last_undegraded":"2023-08-31T18:47:52.979264+0000","last_fullsized":"2023-08-31T18:47:52.979264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.991664+0000","last_change":"2023-08-31T18:47:52.988166+0000","last_active":"2023-08-31T18:47:52.991664+0000","last_peered":"2023-08-31T18:47:52.991664+0000","last_clean":"2023-08-31T18:47:52.991664+0000","last_became_active":"2023-08-31T18:47:52.987862+0000","last_became_peered":"2023-08-31T18:47:52.987862+0000","last_unstale":"2023-08-31T18:47:52.991664+0000","last_undegraded":"2023-08-31T18:47:52.991664+0000","last_fullsized":"2023-08-31T18:47:52.991664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979954+0000","last_change":"2023-08-31T18:47:52.536528+0000","last_active":"2023-08-31T18:47:52.979954+0000","last_peered":"2023-08-31T18:47:52.979954+0000","last_clean":"2023-08-31T18:47:52.979954+0000","last_became_active":"2023-08-31T18:47:52.536263+0000","last_became_peered":"2023-08-31T18:47:52.536263+0000","last_unstale":"2023-08-31T18:47:52.979954+0000","last_undegraded":"2023-08-31T18:47:52.979954+0000","last_fullsized":"2023-08-31T18:47:52.979954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010523+0000","last_change":"2023-08-31T18:47:53.006199+0000","last_active":"2023-08-31T18:47:53.010523+0000","last_peered":"2023-08-31T18:47:53.010523+0000","last_clean":"2023-08-31T18:47:53.010523+0000","last_became_active":"2023-08-31T18:47:53.005772+0000","last_became_peered":"2023-08-31T18:47:53.005772+0000","last_unstale":"2023-08-31T18:47:53.010523+0000","last_undegraded":"2023-08-31T18:47:53.010523+0000","last_fullsized":"2023-08-31T18:47:53.010523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981987+0000","last_change":"2023-08-31T18:47:52.531200+0000","last_active":"2023-08-31T18:47:52.981987+0000","last_peered":"2023-08-31T18:47:52.981987+0000","last_clean":"2023-08-31T18:47:52.981987+0000","last_became_active":"2023-08-31T18:47:52.530888+0000","last_became_peered":"2023-08-31T18:47:52.530888+0000","last_unstale":"2023-08-31T18:47:52.981987+0000","last_undegraded":"2023-08-31T18:47:52.981987+0000","last_fullsized":"2023-08-31T18:47:52.981987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003936+0000","last_change":"2023-08-31T18:47:52.992639+0000","last_active":"2023-08-31T18:47:53.003936+0000","last_peered":"2023-08-31T18:47:53.003936+0000","last_clean":"2023-08-31T18:47:53.003936+0000","last_became_active":"2023-08-31T18:47:52.992365+0000","last_became_peered":"2023-08-31T18:47:52.992365+0000","last_unstale":"2023-08-31T18:47:53.003936+0000","last_undegraded":"2023-08-31T18:47:53.003936+0000","last_fullsized":"2023-08-31T18:47:53.003936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984775+0000","last_change":"2023-08-31T18:47:52.523604+0000","last_active":"2023-08-31T18:47:52.984775+0000","last_peered":"2023-08-31T18:47:52.984775+0000","last_clean":"2023-08-31T18:47:52.984775+0000","last_became_active":"2023-08-31T18:47:52.523314+0000","last_became_peered":"2023-08-31T18:47:52.523314+0000","last_unstale":"2023-08-31T18:47:52.984775+0000","last_undegraded":"2023-08-31T18:47:52.984775+0000","last_fullsized":"2023-08-31T18:47:52.984775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003706+0000","last_change":"2023-08-31T18:47:53.000736+0000","last_active":"2023-08-31T18:47:53.003706+0000","last_peered":"2023-08-31T18:47:53.003706+0000","last_clean":"2023-08-31T18:47:53.003706+0000","last_became_active":"2023-08-31T18:47:53.000299+0000","last_became_peered":"2023-08-31T18:47:53.000299+0000","last_unstale":"2023-08-31T18:47:53.003706+0000","last_undegraded":"2023-08-31T18:47:53.003706+0000","last_fullsized":"2023-08-31T18:47:53.003706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980656+0000","last_change":"2023-08-31T18:47:52.532777+0000","last_active":"2023-08-31T18:47:52.980656+0000","last_peered":"2023-08-31T18:47:52.980656+0000","last_clean":"2023-08-31T18:47:52.980656+0000","last_became_active":"2023-08-31T18:47:52.532315+0000","last_became_peered":"2023-08-31T18:47:52.532315+0000","last_unstale":"2023-08-31T18:47:52.980656+0000","last_undegraded":"2023-08-31T18:47:52.980656+0000","last_fullsized":"2023-08-31T18:47:52.980656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013496+0000","last_change":"2023-08-31T18:47:53.011112+0000","last_active":"2023-08-31T18:47:53.013496+0000","last_peered":"2023-08-31T18:47:53.013496+0000","last_clean":"2023-08-31T18:47:53.013496+0000","last_became_active":"2023-08-31T18:47:53.010727+0000","last_became_peered":"2023-08-31T18:47:53.010727+0000","last_unstale":"2023-08-31T18:47:53.013496+0000","last_undegraded":"2023-08-31T18:47:53.013496+0000","last_fullsized":"2023-08-31T18:47:53.013496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982317+0000","last_change":"2023-08-31T18:47:52.518395+0000","last_active":"2023-08-31T18:47:52.982317+0000","last_peered":"2023-08-31T18:47:52.982317+0000","last_clean":"2023-08-31T18:47:52.982317+0000","last_became_active":"2023-08-31T18:47:52.518052+0000","last_became_peered":"2023-08-31T18:47:52.518052+0000","last_unstale":"2023-08-31T18:47:52.982317+0000","last_undegraded":"2023-08-31T18:47:52.982317+0000","last_fullsized":"2023-08-31T18:47:52.982317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999877+0000","last_change":"2023-08-31T18:47:52.993488+0000","last_active":"2023-08-31T18:47:52.999877+0000","last_peered":"2023-08-31T18:47:52.999877+0000","last_clean":"2023-08-31T18:47:52.999877+0000","last_became_active":"2023-08-31T18:47:52.993212+0000","last_became_peered":"2023-08-31T18:47:52.993212+0000","last_unstale":"2023-08-31T18:47:52.999877+0000","last_undegraded":"2023-08-31T18:47:52.999877+0000","last_fullsized":"2023-08-31T18:47:52.999877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979140+0000","last_change":"2023-08-31T18:47:52.525508+0000","last_active":"2023-08-31T18:47:52.979140+0000","last_peered":"2023-08-31T18:47:52.979140+0000","last_clean":"2023-08-31T18:47:52.979140+0000","last_became_active":"2023-08-31T18:47:52.525174+0000","last_became_peered":"2023-08-31T18:47:52.525174+0000","last_unstale":"2023-08-31T18:47:52.979140+0000","last_undegraded":"2023-08-31T18:47:52.979140+0000","last_fullsized":"2023-08-31T18:47:52.979140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.995366+0000","last_change":"2023-08-31T18:47:52.992245+0000","last_active":"2023-08-31T18:47:52.995366+0000","last_peered":"2023-08-31T18:47:52.995366+0000","last_clean":"2023-08-31T18:47:52.995366+0000","last_became_active":"2023-08-31T18:47:52.991850+0000","last_became_peered":"2023-08-31T18:47:52.991850+0000","last_unstale":"2023-08-31T18:47:52.995366+0000","last_undegraded":"2023-08-31T18:47:52.995366+0000","last_fullsized":"2023-08-31T18:47:52.995366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978676+0000","last_change":"2023-08-31T18:47:52.532525+0000","last_active":"2023-08-31T18:47:52.978676+0000","last_peered":"2023-08-31T18:47:52.978676+0000","last_clean":"2023-08-31T18:47:52.978676+0000","last_became_active":"2023-08-31T18:47:52.532286+0000","last_became_peered":"2023-08-31T18:47:52.532286+0000","last_unstale":"2023-08-31T18:47:52.978676+0000","last_undegraded":"2023-08-31T18:47:52.978676+0000","last_fullsized":"2023-08-31T18:47:52.978676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003173+0000","last_change":"2023-08-31T18:47:52.998570+0000","last_active":"2023-08-31T18:47:53.003173+0000","last_peered":"2023-08-31T18:47:53.003173+0000","last_clean":"2023-08-31T18:47:53.003173+0000","last_became_active":"2023-08-31T18:47:52.997982+0000","last_became_peered":"2023-08-31T18:47:52.997982+0000","last_unstale":"2023-08-31T18:47:53.003173+0000","last_undegraded":"2023-08-31T18:47:53.003173+0000","last_fullsized":"2023-08-31T18:47:53.003173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981657+0000","last_change":"2023-08-31T18:47:52.532565+0000","last_active":"2023-08-31T18:47:52.981657+0000","last_peered":"2023-08-31T18:47:52.981657+0000","last_clean":"2023-08-31T18:47:52.981657+0000","last_became_active":"2023-08-31T18:47:52.530954+0000","last_became_peered":"2023-08-31T18:47:52.530954+0000","last_unstale":"2023-08-31T18:47:52.981657+0000","last_undegraded":"2023-08-31T18:47:52.981657+0000","last_fullsized":"2023-08-31T18:47:52.981657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009277+0000","last_change":"2023-08-31T18:47:53.003156+0000","last_active":"2023-08-31T18:47:53.009277+0000","last_peered":"2023-08-31T18:47:53.009277+0000","last_clean":"2023-08-31T18:47:53.009277+0000","last_became_active":"2023-08-31T18:47:53.002838+0000","last_became_peered":"2023-08-31T18:47:53.002838+0000","last_unstale":"2023-08-31T18:47:53.009277+0000","last_undegraded":"2023-08-31T18:47:53.009277+0000","last_fullsized":"2023-08-31T18:47:53.009277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980428+0000","last_change":"2023-08-31T18:47:52.533155+0000","last_active":"2023-08-31T18:47:52.980428+0000","last_peered":"2023-08-31T18:47:52.980428+0000","last_clean":"2023-08-31T18:47:52.980428+0000","last_became_active":"2023-08-31T18:47:52.532852+0000","last_became_peered":"2023-08-31T18:47:52.532852+0000","last_unstale":"2023-08-31T18:47:52.980428+0000","last_undegraded":"2023-08-31T18:47:52.980428+0000","last_fullsized":"2023-08-31T18:47:52.980428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002837+0000","last_change":"2023-08-31T18:47:52.991952+0000","last_active":"2023-08-31T18:47:53.002837+0000","last_peered":"2023-08-31T18:47:53.002837+0000","last_clean":"2023-08-31T18:47:53.002837+0000","last_became_active":"2023-08-31T18:47:52.991706+0000","last_became_peered":"2023-08-31T18:47:52.991706+0000","last_unstale":"2023-08-31T18:47:53.002837+0000","last_undegraded":"2023-08-31T18:47:53.002837+0000","last_fullsized":"2023-08-31T18:47:53.002837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982376+0000","last_change":"2023-08-31T18:47:52.530999+0000","last_active":"2023-08-31T18:47:52.982376+0000","last_peered":"2023-08-31T18:47:52.982376+0000","last_clean":"2023-08-31T18:47:52.982376+0000","last_became_active":"2023-08-31T18:47:52.530492+0000","last_became_peered":"2023-08-31T18:47:52.530492+0000","last_unstale":"2023-08-31T18:47:52.982376+0000","last_undegraded":"2023-08-31T18:47:52.982376+0000","last_fullsized":"2023-08-31T18:47:52.982376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013431+0000","last_change":"2023-08-31T18:47:53.010887+0000","last_active":"2023-08-31T18:47:53.013431+0000","last_peered":"2023-08-31T18:47:53.013431+0000","last_clean":"2023-08-31T18:47:53.013431+0000","last_became_active":"2023-08-31T18:47:53.010563+0000","last_became_peered":"2023-08-31T18:47:53.010563+0000","last_unstale":"2023-08-31T18:47:53.013431+0000","last_undegraded":"2023-08-31T18:47:53.013431+0000","last_fullsized":"2023-08-31T18:47:53.013431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003063+0000","last_change":"2023-08-31T18:47:52.524520+0000","last_active":"2023-08-31T18:47:53.003063+0000","last_peered":"2023-08-31T18:47:53.003063+0000","last_clean":"2023-08-31T18:47:53.003063+0000","last_became_active":"2023-08-31T18:47:52.524248+0000","last_became_peered":"2023-08-31T18:47:52.524248+0000","last_unstale":"2023-08-31T18:47:53.003063+0000","last_undegraded":"2023-08-31T18:47:53.003063+0000","last_fullsized":"2023-08-31T18:47:53.003063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009527+0000","last_change":"2023-08-31T18:47:53.004250+0000","last_active":"2023-08-31T18:47:53.009527+0000","last_peered":"2023-08-31T18:47:53.009527+0000","last_clean":"2023-08-31T18:47:53.009527+0000","last_became_active":"2023-08-31T18:47:53.003889+0000","last_became_peered":"2023-08-31T18:47:53.003889+0000","last_unstale":"2023-08-31T18:47:53.009527+0000","last_undegraded":"2023-08-31T18:47:53.009527+0000","last_fullsized":"2023-08-31T18:47:53.009527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979331+0000","last_change":"2023-08-31T18:47:52.522809+0000","last_active":"2023-08-31T18:47:52.979331+0000","last_peered":"2023-08-31T18:47:52.979331+0000","last_clean":"2023-08-31T18:47:52.979331+0000","last_became_active":"2023-08-31T18:47:52.522517+0000","last_became_peered":"2023-08-31T18:47:52.522517+0000","last_unstale":"2023-08-31T18:47:52.979331+0000","last_undegraded":"2023-08-31T18:47:52.979331+0000","last_fullsized":"2023-08-31T18:47:52.979331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.994341+0000","last_change":"2023-08-31T18:47:52.990434+0000","last_active":"2023-08-31T18:47:52.994341+0000","last_peered":"2023-08-31T18:47:52.994341+0000","last_clean":"2023-08-31T18:47:52.994341+0000","last_became_active":"2023-08-31T18:47:52.989943+0000","last_became_peered":"2023-08-31T18:47:52.989943+0000","last_unstale":"2023-08-31T18:47:52.994341+0000","last_undegraded":"2023-08-31T18:47:52.994341+0000","last_fullsized":"2023-08-31T18:47:52.994341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.008488+0000","last_change":"2023-08-31T18:47:52.526791+0000","last_active":"2023-08-31T18:47:53.008488+0000","last_peered":"2023-08-31T18:47:53.008488+0000","last_clean":"2023-08-31T18:47:53.008488+0000","last_became_active":"2023-08-31T18:47:52.526453+0000","last_became_peered":"2023-08-31T18:47:52.526453+0000","last_unstale":"2023-08-31T18:47:53.008488+0000","last_undegraded":"2023-08-31T18:47:53.008488+0000","last_fullsized":"2023-08-31T18:47:53.008488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999173+0000","last_change":"2023-08-31T18:47:52.988877+0000","last_active":"2023-08-31T18:47:52.999173+0000","last_peered":"2023-08-31T18:47:52.999173+0000","last_clean":"2023-08-31T18:47:52.999173+0000","last_became_active":"2023-08-31T18:47:52.988408+0000","last_became_peered":"2023-08-31T18:47:52.988408+0000","last_unstale":"2023-08-31T18:47:52.999173+0000","last_undegraded":"2023-08-31T18:47:52.999173+0000","last_fullsized":"2023-08-31T18:47:52.999173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980246+0000","last_change":"2023-08-31T18:47:52.530145+0000","last_active":"2023-08-31T18:47:52.980246+0000","last_peered":"2023-08-31T18:47:52.980246+0000","last_clean":"2023-08-31T18:47:52.980246+0000","last_became_active":"2023-08-31T18:47:52.529794+0000","last_became_peered":"2023-08-31T18:47:52.529794+0000","last_unstale":"2023-08-31T18:47:52.980246+0000","last_undegraded":"2023-08-31T18:47:52.980246+0000","last_fullsized":"2023-08-31T18:47:52.980246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010719+0000","last_change":"2023-08-31T18:47:53.008088+0000","last_active":"2023-08-31T18:47:53.010719+0000","last_peered":"2023-08-31T18:47:53.010719+0000","last_clean":"2023-08-31T18:47:53.010719+0000","last_became_active":"2023-08-31T18:47:53.007777+0000","last_became_peered":"2023-08-31T18:47:53.007777+0000","last_unstale":"2023-08-31T18:47:53.010719+0000","last_undegraded":"2023-08-31T18:47:53.010719+0000","last_fullsized":"2023-08-31T18:47:53.010719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982119+0000","last_change":"2023-08-31T18:47:52.533768+0000","last_active":"2023-08-31T18:47:52.982119+0000","last_peered":"2023-08-31T18:47:52.982119+0000","last_clean":"2023-08-31T18:47:52.982119+0000","last_became_active":"2023-08-31T18:47:52.533361+0000","last_became_peered":"2023-08-31T18:47:52.533361+0000","last_unstale":"2023-08-31T18:47:52.982119+0000","last_undegraded":"2023-08-31T18:47:52.982119+0000","last_fullsized":"2023-08-31T18:47:52.982119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003194+0000","last_change":"2023-08-31T18:47:52.998770+0000","last_active":"2023-08-31T18:47:53.003194+0000","last_peered":"2023-08-31T18:47:53.003194+0000","last_clean":"2023-08-31T18:47:53.003194+0000","last_became_active":"2023-08-31T18:47:52.998321+0000","last_became_peered":"2023-08-31T18:47:52.998321+0000","last_unstale":"2023-08-31T18:47:53.003194+0000","last_undegraded":"2023-08-31T18:47:53.003194+0000","last_fullsized":"2023-08-31T18:47:53.003194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997292+0000","last_change":"2023-08-31T18:47:52.532924+0000","last_active":"2023-08-31T18:47:52.997292+0000","last_peered":"2023-08-31T18:47:52.997292+0000","last_clean":"2023-08-31T18:47:52.997292+0000","last_became_active":"2023-08-31T18:47:52.531625+0000","last_became_peered":"2023-08-31T18:47:52.531625+0000","last_unstale":"2023-08-31T18:47:52.997292+0000","last_undegraded":"2023-08-31T18:47:52.997292+0000","last_fullsized":"2023-08-31T18:47:52.997292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009212+0000","last_change":"2023-08-31T18:47:52.997006+0000","last_active":"2023-08-31T18:47:53.009212+0000","last_peered":"2023-08-31T18:47:53.009212+0000","last_clean":"2023-08-31T18:47:53.009212+0000","last_became_active":"2023-08-31T18:47:52.996663+0000","last_became_peered":"2023-08-31T18:47:52.996663+0000","last_unstale":"2023-08-31T18:47:53.009212+0000","last_undegraded":"2023-08-31T18:47:53.009212+0000","last_fullsized":"2023-08-31T18:47:53.009212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981008+0000","last_change":"2023-08-31T18:47:52.516464+0000","last_active":"2023-08-31T18:47:52.981008+0000","last_peered":"2023-08-31T18:47:52.981008+0000","last_clean":"2023-08-31T18:47:52.981008+0000","last_became_active":"2023-08-31T18:47:52.516164+0000","last_became_peered":"2023-08-31T18:47:52.516164+0000","last_unstale":"2023-08-31T18:47:52.981008+0000","last_undegraded":"2023-08-31T18:47:52.981008+0000","last_fullsized":"2023-08-31T18:47:52.981008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010930+0000","last_change":"2023-08-31T18:47:53.005504+0000","last_active":"2023-08-31T18:47:53.010930+0000","last_peered":"2023-08-31T18:47:53.010930+0000","last_clean":"2023-08-31T18:47:53.010930+0000","last_became_active":"2023-08-31T18:47:53.005202+0000","last_became_peered":"2023-08-31T18:47:53.005202+0000","last_unstale":"2023-08-31T18:47:53.010930+0000","last_undegraded":"2023-08-31T18:47:53.010930+0000","last_fullsized":"2023-08-31T18:47:53.010930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984216+0000","last_change":"2023-08-31T18:47:52.524392+0000","last_active":"2023-08-31T18:47:52.984216+0000","last_peered":"2023-08-31T18:47:52.984216+0000","last_clean":"2023-08-31T18:47:52.984216+0000","last_became_active":"2023-08-31T18:47:52.524124+0000","last_became_peered":"2023-08-31T18:47:52.524124+0000","last_unstale":"2023-08-31T18:47:52.984216+0000","last_undegraded":"2023-08-31T18:47:52.984216+0000","last_fullsized":"2023-08-31T18:47:52.984216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.007216+0000","last_change":"2023-08-31T18:47:53.004792+0000","last_active":"2023-08-31T18:47:53.007216+0000","last_peered":"2023-08-31T18:47:53.007216+0000","last_clean":"2023-08-31T18:47:53.007216+0000","last_became_active":"2023-08-31T18:47:53.004470+0000","last_became_peered":"2023-08-31T18:47:53.004470+0000","last_unstale":"2023-08-31T18:47:53.007216+0000","last_undegraded":"2023-08-31T18:47:53.007216+0000","last_fullsized":"2023-08-31T18:47:53.007216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000085+0000","last_change":"2023-08-31T18:47:52.531667+0000","last_active":"2023-08-31T18:47:53.000085+0000","last_peered":"2023-08-31T18:47:53.000085+0000","last_clean":"2023-08-31T18:47:53.000085+0000","last_became_active":"2023-08-31T18:47:52.529811+0000","last_became_peered":"2023-08-31T18:47:52.529811+0000","last_unstale":"2023-08-31T18:47:53.000085+0000","last_undegraded":"2023-08-31T18:47:53.000085+0000","last_fullsized":"2023-08-31T18:47:53.000085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.007141+0000","last_change":"2023-08-31T18:47:53.004157+0000","last_active":"2023-08-31T18:47:53.007141+0000","last_peered":"2023-08-31T18:47:53.007141+0000","last_clean":"2023-08-31T18:47:53.007141+0000","last_became_active":"2023-08-31T18:47:53.003874+0000","last_became_peered":"2023-08-31T18:47:53.003874+0000","last_unstale":"2023-08-31T18:47:53.007141+0000","last_undegraded":"2023-08-31T18:47:53.007141+0000","last_fullsized":"2023-08-31T18:47:53.007141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.016407+0000","last_change":"2023-08-31T18:47:52.528085+0000","last_active":"2023-08-31T18:47:53.016407+0000","last_peered":"2023-08-31T18:47:53.016407+0000","last_clean":"2023-08-31T18:47:53.016407+0000","last_became_active":"2023-08-31T18:47:52.527709+0000","last_became_peered":"2023-08-31T18:47:52.527709+0000","last_unstale":"2023-08-31T18:47:53.016407+0000","last_undegraded":"2023-08-31T18:47:53.016407+0000","last_fullsized":"2023-08-31T18:47:53.016407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009270+0000","last_change":"2023-08-31T18:47:52.995956+0000","last_active":"2023-08-31T18:47:53.009270+0000","last_peered":"2023-08-31T18:47:53.009270+0000","last_clean":"2023-08-31T18:47:53.009270+0000","last_became_active":"2023-08-31T18:47:52.995594+0000","last_became_peered":"2023-08-31T18:47:52.995594+0000","last_unstale":"2023-08-31T18:47:53.009270+0000","last_undegraded":"2023-08-31T18:47:53.009270+0000","last_fullsized":"2023-08-31T18:47:53.009270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981652+0000","last_change":"2023-08-31T18:47:52.531991+0000","last_active":"2023-08-31T18:47:52.981652+0000","last_peered":"2023-08-31T18:47:52.981652+0000","last_clean":"2023-08-31T18:47:52.981652+0000","last_became_active":"2023-08-31T18:47:52.531640+0000","last_became_peered":"2023-08-31T18:47:52.531640+0000","last_unstale":"2023-08-31T18:47:52.981652+0000","last_undegraded":"2023-08-31T18:47:52.981652+0000","last_fullsized":"2023-08-31T18:47:52.981652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009562+0000","last_change":"2023-08-31T18:47:53.004890+0000","last_active":"2023-08-31T18:47:53.009562+0000","last_peered":"2023-08-31T18:47:53.009562+0000","last_clean":"2023-08-31T18:47:53.009562+0000","last_became_active":"2023-08-31T18:47:53.004583+0000","last_became_peered":"2023-08-31T18:47:53.004583+0000","last_unstale":"2023-08-31T18:47:53.009562+0000","last_undegraded":"2023-08-31T18:47:53.009562+0000","last_fullsized":"2023-08-31T18:47:53.009562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979377+0000","last_change":"2023-08-31T18:47:52.532169+0000","last_active":"2023-08-31T18:47:52.979377+0000","last_peered":"2023-08-31T18:47:52.979377+0000","last_clean":"2023-08-31T18:47:52.979377+0000","last_became_active":"2023-08-31T18:47:52.531828+0000","last_became_peered":"2023-08-31T18:47:52.531828+0000","last_unstale":"2023-08-31T18:47:52.979377+0000","last_undegraded":"2023-08-31T18:47:52.979377+0000","last_fullsized":"2023-08-31T18:47:52.979377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010270+0000","last_change":"2023-08-31T18:47:53.006485+0000","last_active":"2023-08-31T18:47:53.010270+0000","last_peered":"2023-08-31T18:47:53.010270+0000","last_clean":"2023-08-31T18:47:53.010270+0000","last_became_active":"2023-08-31T18:47:53.005959+0000","last_became_peered":"2023-08-31T18:47:53.005959+0000","last_unstale":"2023-08-31T18:47:53.010270+0000","last_undegraded":"2023-08-31T18:47:53.010270+0000","last_fullsized":"2023-08-31T18:47:53.010270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993529+0000","last_change":"2023-08-31T18:47:52.535478+0000","last_active":"2023-08-31T18:47:52.993529+0000","last_peered":"2023-08-31T18:47:52.993529+0000","last_clean":"2023-08-31T18:47:52.993529+0000","last_became_active":"2023-08-31T18:47:52.535070+0000","last_became_peered":"2023-08-31T18:47:52.535070+0000","last_unstale":"2023-08-31T18:47:52.993529+0000","last_undegraded":"2023-08-31T18:47:52.993529+0000","last_fullsized":"2023-08-31T18:47:52.993529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000738+0000","last_change":"2023-08-31T18:47:52.995080+0000","last_active":"2023-08-31T18:47:53.000738+0000","last_peered":"2023-08-31T18:47:53.000738+0000","last_clean":"2023-08-31T18:47:53.000738+0000","last_became_active":"2023-08-31T18:47:52.994681+0000","last_became_peered":"2023-08-31T18:47:52.994681+0000","last_unstale":"2023-08-31T18:47:53.000738+0000","last_undegraded":"2023-08-31T18:47:53.000738+0000","last_fullsized":"2023-08-31T18:47:53.000738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978985+0000","last_change":"2023-08-31T18:47:52.537767+0000","last_active":"2023-08-31T18:47:52.978985+0000","last_peered":"2023-08-31T18:47:52.978985+0000","last_clean":"2023-08-31T18:47:52.978985+0000","last_became_active":"2023-08-31T18:47:52.537385+0000","last_became_peered":"2023-08-31T18:47:52.537385+0000","last_unstale":"2023-08-31T18:47:52.978985+0000","last_undegraded":"2023-08-31T18:47:52.978985+0000","last_fullsized":"2023-08-31T18:47:52.978985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009241+0000","last_change":"2023-08-31T18:47:52.997396+0000","last_active":"2023-08-31T18:47:53.009241+0000","last_peered":"2023-08-31T18:47:53.009241+0000","last_clean":"2023-08-31T18:47:53.009241+0000","last_became_active":"2023-08-31T18:47:52.997047+0000","last_became_peered":"2023-08-31T18:47:52.997047+0000","last_unstale":"2023-08-31T18:47:53.009241+0000","last_undegraded":"2023-08-31T18:47:53.009241+0000","last_fullsized":"2023-08-31T18:47:53.009241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.992987+0000","last_change":"2023-08-31T18:47:52.527537+0000","last_active":"2023-08-31T18:47:52.992987+0000","last_peered":"2023-08-31T18:47:52.992987+0000","last_clean":"2023-08-31T18:47:52.992987+0000","last_became_active":"2023-08-31T18:47:52.527270+0000","last_became_peered":"2023-08-31T18:47:52.527270+0000","last_unstale":"2023-08-31T18:47:52.992987+0000","last_undegraded":"2023-08-31T18:47:52.992987+0000","last_fullsized":"2023-08-31T18:47:52.992987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010969+0000","last_change":"2023-08-31T18:47:53.006192+0000","last_active":"2023-08-31T18:47:53.010969+0000","last_peered":"2023-08-31T18:47:53.010969+0000","last_clean":"2023-08-31T18:47:53.010969+0000","last_became_active":"2023-08-31T18:47:53.005781+0000","last_became_peered":"2023-08-31T18:47:53.005781+0000","last_unstale":"2023-08-31T18:47:53.010969+0000","last_undegraded":"2023-08-31T18:47:53.010969+0000","last_fullsized":"2023-08-31T18:47:53.010969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.992451+0000","last_change":"2023-08-31T18:47:52.530561+0000","last_active":"2023-08-31T18:47:52.992451+0000","last_peered":"2023-08-31T18:47:52.992451+0000","last_clean":"2023-08-31T18:47:52.992451+0000","last_became_active":"2023-08-31T18:47:52.530210+0000","last_became_peered":"2023-08-31T18:47:52.530210+0000","last_unstale":"2023-08-31T18:47:52.992451+0000","last_undegraded":"2023-08-31T18:47:52.992451+0000","last_fullsized":"2023-08-31T18:47:52.992451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993847+0000","last_change":"2023-08-31T18:47:52.991129+0000","last_active":"2023-08-31T18:47:52.993847+0000","last_peered":"2023-08-31T18:47:52.993847+0000","last_clean":"2023-08-31T18:47:52.993847+0000","last_became_active":"2023-08-31T18:47:52.990398+0000","last_became_peered":"2023-08-31T18:47:52.990398+0000","last_unstale":"2023-08-31T18:47:52.993847+0000","last_undegraded":"2023-08-31T18:47:52.993847+0000","last_fullsized":"2023-08-31T18:47:52.993847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.006602+0000","last_change":"2023-08-31T18:47:52.527848+0000","last_active":"2023-08-31T18:47:53.006602+0000","last_peered":"2023-08-31T18:47:53.006602+0000","last_clean":"2023-08-31T18:47:53.006602+0000","last_became_active":"2023-08-31T18:47:52.527606+0000","last_became_peered":"2023-08-31T18:47:52.527606+0000","last_unstale":"2023-08-31T18:47:53.006602+0000","last_undegraded":"2023-08-31T18:47:53.006602+0000","last_fullsized":"2023-08-31T18:47:53.006602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003221+0000","last_change":"2023-08-31T18:47:52.996941+0000","last_active":"2023-08-31T18:47:53.003221+0000","last_peered":"2023-08-31T18:47:53.003221+0000","last_clean":"2023-08-31T18:47:53.003221+0000","last_became_active":"2023-08-31T18:47:52.996629+0000","last_became_peered":"2023-08-31T18:47:52.996629+0000","last_unstale":"2023-08-31T18:47:53.003221+0000","last_undegraded":"2023-08-31T18:47:53.003221+0000","last_fullsized":"2023-08-31T18:47:53.003221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002885+0000","last_change":"2023-08-31T18:47:52.532525+0000","last_active":"2023-08-31T18:47:53.002885+0000","last_peered":"2023-08-31T18:47:53.002885+0000","last_clean":"2023-08-31T18:47:53.002885+0000","last_became_active":"2023-08-31T18:47:52.532148+0000","last_became_peered":"2023-08-31T18:47:52.532148+0000","last_unstale":"2023-08-31T18:47:53.002885+0000","last_undegraded":"2023-08-31T18:47:53.002885+0000","last_fullsized":"2023-08-31T18:47:53.002885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009117+0000","last_change":"2023-08-31T18:47:52.999302+0000","last_active":"2023-08-31T18:47:53.009117+0000","last_peered":"2023-08-31T18:47:53.009117+0000","last_clean":"2023-08-31T18:47:53.009117+0000","last_became_active":"2023-08-31T18:47:52.998999+0000","last_became_peered":"2023-08-31T18:47:52.998999+0000","last_unstale":"2023-08-31T18:47:53.009117+0000","last_undegraded":"2023-08-31T18:47:53.009117+0000","last_fullsized":"2023-08-31T18:47:53.009117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984593+0000","last_change":"2023-08-31T18:47:52.533151+0000","last_active":"2023-08-31T18:47:52.984593+0000","last_peered":"2023-08-31T18:47:52.984593+0000","last_clean":"2023-08-31T18:47:52.984593+0000","last_became_active":"2023-08-31T18:47:52.532807+0000","last_became_peered":"2023-08-31T18:47:52.532807+0000","last_unstale":"2023-08-31T18:47:52.984593+0000","last_undegraded":"2023-08-31T18:47:52.984593+0000","last_fullsized":"2023-08-31T18:47:52.984593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.007112+0000","last_change":"2023-08-31T18:47:53.001543+0000","last_active":"2023-08-31T18:47:53.007112+0000","last_peered":"2023-08-31T18:47:53.007112+0000","last_clean":"2023-08-31T18:47:53.007112+0000","last_became_active":"2023-08-31T18:47:53.001281+0000","last_became_peered":"2023-08-31T18:47:53.001281+0000","last_unstale":"2023-08-31T18:47:53.007112+0000","last_undegraded":"2023-08-31T18:47:53.007112+0000","last_fullsized":"2023-08-31T18:47:53.007112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982462+0000","last_change":"2023-08-31T18:47:52.527162+0000","last_active":"2023-08-31T18:47:52.982462+0000","last_peered":"2023-08-31T18:47:52.982462+0000","last_clean":"2023-08-31T18:47:52.982462+0000","last_became_active":"2023-08-31T18:47:52.526459+0000","last_became_peered":"2023-08-31T18:47:52.526459+0000","last_unstale":"2023-08-31T18:47:52.982462+0000","last_undegraded":"2023-08-31T18:47:52.982462+0000","last_fullsized":"2023-08-31T18:47:52.982462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009967+0000","last_change":"2023-08-31T18:47:52.999739+0000","last_active":"2023-08-31T18:47:53.009967+0000","last_peered":"2023-08-31T18:47:53.009967+0000","last_clean":"2023-08-31T18:47:53.009967+0000","last_became_active":"2023-08-31T18:47:52.999429+0000","last_became_peered":"2023-08-31T18:47:52.999429+0000","last_unstale":"2023-08-31T18:47:53.009967+0000","last_undegraded":"2023-08-31T18:47:53.009967+0000","last_fullsized":"2023-08-31T18:47:53.009967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013109+0000","last_change":"2023-08-31T18:47:52.524499+0000","last_active":"2023-08-31T18:47:53.013109+0000","last_peered":"2023-08-31T18:47:53.013109+0000","last_clean":"2023-08-31T18:47:53.013109+0000","last_became_active":"2023-08-31T18:47:52.524170+0000","last_became_peered":"2023-08-31T18:47:52.524170+0000","last_unstale":"2023-08-31T18:47:53.013109+0000","last_undegraded":"2023-08-31T18:47:53.013109+0000","last_fullsized":"2023-08-31T18:47:53.013109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":81647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":81679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":80303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":80323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":81825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.6289999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.8399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.7840000000000007}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.133}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.6780000000000008}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.4760000000000009}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.1769999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T18:47:57.679 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T18:47:57.680 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-31T18:47:57.680 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-31T18:47:57.680 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-31T18:47:57.681 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-31T18:47:57.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.900+0000 7f29a29ff700 1 Processor -- start 2023-08-31T18:47:57.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.901+0000 7f29a29ff700 1 -- start start 2023-08-31T18:47:57.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.902+0000 7f29a29ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f299c0c4520 0x7f299c15ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.902+0000 7f29a29ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299c0c5950 con 0x7f299c1541a0 2023-08-31T18:47:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.902+0000 7f29a29ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299c0c5c30 con 0x7f299c0c5300 2023-08-31T18:47:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.902+0000 7f29a29ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299c0c5f10 con 0x7f299c0c4520 2023-08-31T18:47:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.902+0000 7f299bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f299c1541a0 0x7f299c0bf460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44376/0 (socket says 172.21.15.72:44376) 2023-08-31T18:47:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.902+0000 7f299bfff700 1 -- 172.21.15.72:0/989913828 learned_addr learned my addr 172.21.15.72:0/989913828 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:47:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.902+0000 7f29a0f9c700 1 --2- 172.21.15.72:0/989913828 >> v2:172.21.15.72:3300/0 conn(0x7f299c0c4520 0x7f299c15ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.902+0000 7f299affd700 1 -- 172.21.15.72:0/989913828 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2630840352 0 0) 0x7f299c0c5950 con 0x7f299c1541a0 2023-08-31T18:47:57.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.903+0000 7f299affd700 1 -- 172.21.15.72:0/989913828 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29840033f0 con 0x7f299c1541a0 2023-08-31T18:47:57.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.903+0000 7f29a0f9c700 1 -- 172.21.15.72:0/989913828 >> v1:172.21.15.146:6789/0 conn(0x7f299c0c5300 legacy=0x7f299c0c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.903+0000 7f29a0f9c700 1 -- 172.21.15.72:0/989913828 >> v1:172.21.15.72:6789/0 conn(0x7f299c1541a0 legacy=0x7f299c0bf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.903+0000 7f29a0f9c700 1 -- 172.21.15.72:0/989913828 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c0a5a30 con 0x7f299c0c4520 2023-08-31T18:47:57.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.903+0000 7f29a0f9c700 1 --2- 172.21.15.72:0/989913828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299c0c4520 0x7f299c15ede0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2994009e60 tx=0x7f2994009780).ready entity=mon.0 client_cookie=c8827b173ab7b7cf server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:57.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.903+0000 7f299affd700 1 -- 172.21.15.72:0/989913828 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299400e070 con 0x7f299c0c4520 2023-08-31T18:47:57.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.903+0000 7f299affd700 1 -- 172.21.15.72:0/989913828 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299400bb60 con 0x7f299c0c4520 2023-08-31T18:47:57.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.903+0000 7f299affd700 1 -- 172.21.15.72:0/989913828 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994012410 con 0x7f299c0c4520 2023-08-31T18:47:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.903+0000 7f29a29ff700 1 -- 172.21.15.72:0/989913828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299c0c4520 msgr2=0x7f299c15ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.903+0000 7f29a29ff700 1 --2- 172.21.15.72:0/989913828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299c0c4520 0x7f299c15ede0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2994009e60 tx=0x7f2994009780).stop 2023-08-31T18:47:57.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.904+0000 7f29a29ff700 1 -- 172.21.15.72:0/989913828 shutdown_connections 2023-08-31T18:47:57.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.904+0000 7f29a29ff700 1 --2- 172.21.15.72:0/989913828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299c0c4520 0x7f299c15ede0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.904+0000 7f29a29ff700 1 -- 172.21.15.72:0/989913828 >> 172.21.15.72:0/989913828 conn(0x7f299c082f60 msgr2=0x7f299c05e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:57.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.904+0000 7f29a29ff700 1 -- 172.21.15.72:0/989913828 shutdown_connections 2023-08-31T18:47:57.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.904+0000 7f29a29ff700 1 -- 172.21.15.72:0/989913828 wait complete. 2023-08-31T18:47:57.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.905+0000 7f29a29ff700 1 Processor -- start 2023-08-31T18:47:57.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.905+0000 7f29a29ff700 1 -- start start 2023-08-31T18:47:57.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.906+0000 7f29a29ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f299c0c4520 0x7f299c0abb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.906+0000 7f29a29ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299c0c5300 0x7f299c064170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.906+0000 7f29a29ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c1541a0 0x7f299c0ab100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.906+0000 7f29a29ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c064660 con 0x7f299c0c5300 2023-08-31T18:47:57.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.906+0000 7f29a29ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c065080 con 0x7f299c0c4520 2023-08-31T18:47:57.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.906+0000 7f29a29ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0ad890 con 0x7f299c1541a0 2023-08-31T18:47:57.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.906+0000 7f299b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299c0c5300 0x7f299c064170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.906+0000 7f299b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299c0c5300 0x7f299c064170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52708/0 (socket says 172.21.15.72:52708) 2023-08-31T18:47:57.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.906+0000 7f299b7fe700 1 -- 172.21.15.72:0/944996023 learned_addr learned my addr 172.21.15.72:0/944996023 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:57.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.907+0000 7f299bfff700 1 --2- 172.21.15.72:0/944996023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f299c0c4520 0x7f299c0abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.907+0000 7f29a0f9c700 1 --2- 172.21.15.72:0/944996023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c1541a0 0x7f299c0ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.907+0000 7f299b7fe700 1 -- 172.21.15.72:0/944996023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c1541a0 msgr2=0x7f299c0ab100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.907+0000 7f299b7fe700 1 --2- 172.21.15.72:0/944996023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c1541a0 0x7f299c0ab100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.907+0000 7f299b7fe700 1 -- 172.21.15.72:0/944996023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f299c0c4520 msgr2=0x7f299c0abb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:57.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.907+0000 7f299b7fe700 1 --2- 172.21.15.72:0/944996023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f299c0c4520 0x7f299c0abb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:57.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.907+0000 7f299b7fe700 1 -- 172.21.15.72:0/944996023 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2994009a20 con 0x7f299c0c5300 2023-08-31T18:47:57.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.907+0000 7f29a0f9c700 1 --2- 172.21.15.72:0/944996023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c1541a0 0x7f299c0ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:47:57.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.907+0000 7f299b7fe700 1 --2- 172.21.15.72:0/944996023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299c0c5300 0x7f299c064170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f299000c4c0 tx=0x7f2990007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:57.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.907+0000 7f2983fff700 1 -- 172.21.15.72:0/944996023 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990007020 con 0x7f299c0c5300 2023-08-31T18:47:57.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.907+0000 7f2983fff700 1 -- 172.21.15.72:0/944996023 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2990001e90 con 0x7f299c0c5300 2023-08-31T18:47:57.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.907+0000 7f29a29ff700 1 -- 172.21.15.72:0/944996023 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c065320 con 0x7f299c0c5300 2023-08-31T18:47:57.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.907+0000 7f2983fff700 1 -- 172.21.15.72:0/944996023 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29900073b0 con 0x7f299c0c5300 2023-08-31T18:47:57.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.907+0000 7f29a29ff700 1 -- 172.21.15.72:0/944996023 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c0ac170 con 0x7f299c0c5300 2023-08-31T18:47:57.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.909+0000 7f29a29ff700 1 -- 172.21.15.72:0/944996023 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c0ada50 con 0x7f299c0c5300 2023-08-31T18:47:57.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.909+0000 7f2983fff700 1 -- 172.21.15.72:0/944996023 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f29900068b0 con 0x7f299c0c5300 2023-08-31T18:47:57.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.910+0000 7f2983fff700 1 --2- 172.21.15.72:0/944996023 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f298805ee10 0x7f29880612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:57.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.910+0000 7f2983fff700 1 -- 172.21.15.72:0/944996023 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2990079770 con 0x7f299c0c5300 2023-08-31T18:47:57.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.910+0000 7f299bfff700 1 --2- 172.21.15.72:0/944996023 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f298805ee10 0x7f29880612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:57.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.911+0000 7f299bfff700 1 --2- 172.21.15.72:0/944996023 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f298805ee10 0x7f29880612d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f298c005750 tx=0x7f298c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:57.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:57.914+0000 7f2983fff700 1 -- 172.21.15.72:0/944996023 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f299004abe0 con 0x7f299c0c5300 2023-08-31T18:47:58.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.136+0000 7f29a29ff700 1 -- 172.21.15.72:0/944996023 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f299c06c6b0 con 0x7f299c0c5300 2023-08-31T18:47:58.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.139+0000 7f2983fff700 1 -- 172.21.15.72:0/944996023 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+148559 (secure 0 0 0) 0x7f299004e200 con 0x7f299c0c5300 2023-08-31T18:47:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:47:58.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.142+0000 7f29a29ff700 1 -- 172.21.15.72:0/944996023 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f298805ee10 msgr2=0x7f29880612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.142+0000 7f29a29ff700 1 --2- 172.21.15.72:0/944996023 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f298805ee10 0x7f29880612d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f298c005750 tx=0x7f298c009040).stop 2023-08-31T18:47:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.142+0000 7f29a29ff700 1 -- 172.21.15.72:0/944996023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299c0c5300 msgr2=0x7f299c064170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.142+0000 7f29a29ff700 1 --2- 172.21.15.72:0/944996023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299c0c5300 0x7f299c064170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f299000c4c0 tx=0x7f2990007e00).stop 2023-08-31T18:47:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.142+0000 7f29a29ff700 1 -- 172.21.15.72:0/944996023 shutdown_connections 2023-08-31T18:47:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.142+0000 7f29a29ff700 1 --2- 172.21.15.72:0/944996023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f299c1541a0 0x7f299c0ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.142+0000 7f29a29ff700 1 --2- 172.21.15.72:0/944996023 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f298805ee10 0x7f29880612d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.142+0000 7f29a29ff700 1 --2- 172.21.15.72:0/944996023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f299c0c4520 0x7f299c0abb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.142+0000 7f29a29ff700 1 --2- 172.21.15.72:0/944996023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299c0c5300 0x7f299c064170 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.142+0000 7f29a29ff700 1 -- 172.21.15.72:0/944996023 >> 172.21.15.72:0/944996023 conn(0x7f299c082f60 msgr2=0x7f299c153460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:58.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.142+0000 7f29a29ff700 1 -- 172.21.15.72:0/944996023 shutdown_connections 2023-08-31T18:47:58.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.142+0000 7f29a29ff700 1 -- 172.21.15.72:0/944996023 wait complete. 2023-08-31T18:47:58.159 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":4,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":143463},{"type":"v1","addr":"172.21.15.72:6833","nonce":143463}]},"active_addr":"172.21.15.72:6833/143463","active_change":"2023-08-31T18:47:39.146423+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1955814246}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":3497520169}]}]} 2023-08-31T18:47:58.163 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-31T18:47:58.163 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-31T18:47:58.163 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:47:58.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.352+0000 7f4f853ff700 1 Processor -- start 2023-08-31T18:47:58.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.352+0000 7f4f853ff700 1 -- start start 2023-08-31T18:47:58.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.354+0000 7f4f853ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f800cb9b0 0x7f4f801583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:58.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.354+0000 7f4f853ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f800c6120 con 0x7f4f80154060 2023-08-31T18:47:58.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.354+0000 7f4f853ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f800c5e10 con 0x7f4f801588d0 2023-08-31T18:47:58.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.354+0000 7f4f853ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f800c1380 con 0x7f4f800cb9b0 2023-08-31T18:47:58.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.354+0000 7f4f7effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4f80154060 0x7f4f80157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44392/0 (socket says 172.21.15.72:44392) 2023-08-31T18:47:58.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.354+0000 7f4f7effd700 1 -- 172.21.15.72:0/2318403856 learned_addr learned my addr 172.21.15.72:0/2318403856 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:47:58.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.354+0000 7f4f7e7fc700 1 --2- 172.21.15.72:0/2318403856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f800cb9b0 0x7f4f801583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:58.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.354+0000 7f4f7dffb700 1 -- 172.21.15.72:0/2318403856 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204736196 0 0) 0x7f4f800c6120 con 0x7f4f80154060 2023-08-31T18:47:58.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.354+0000 7f4f7dffb700 1 -- 172.21.15.72:0/2318403856 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f680033f0 con 0x7f4f80154060 2023-08-31T18:47:58.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7dffb700 1 -- 172.21.15.72:0/2318403856 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2167894481 0 0) 0x7f4f680033f0 con 0x7f4f80154060 2023-08-31T18:47:58.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7dffb700 1 -- 172.21.15.72:0/2318403856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f800cb9b0 msgr2=0x7f4f801583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:58.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7dffb700 1 --2- 172.21.15.72:0/2318403856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f800cb9b0 0x7f4f801583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7dffb700 1 -- 172.21.15.72:0/2318403856 >> v1:172.21.15.146:6789/0 conn(0x7f4f801588d0 legacy=0x7f4f80154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:58.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7dffb700 1 -- 172.21.15.72:0/2318403856 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f800c0ae0 con 0x7f4f80154060 2023-08-31T18:47:58.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7dffb700 1 -- 172.21.15.72:0/2318403856 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f4f700015f0 con 0x7f4f80154060 2023-08-31T18:47:58.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7dffb700 1 -- 172.21.15.72:0/2318403856 >> v1:172.21.15.72:6789/0 conn(0x7f4f80154060 legacy=0x7f4f80157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:58.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7dffb700 1 --2- 172.21.15.72:0/2318403856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f68003910 0x7f4f68003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:58.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7dffb700 1 --2- 172.21.15.72:0/2318403856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f800cb9b0 0x7f4f68004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:58.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7dffb700 1 --2- 172.21.15.72:0/2318403856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f68004b80 0x7f4f68005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:58.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7dffb700 1 -- 172.21.15.72:0/2318403856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f800c1380 con 0x7f4f68003910 2023-08-31T18:47:58.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7dffb700 1 -- 172.21.15.72:0/2318403856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6800b910 con 0x7f4f68004b80 2023-08-31T18:47:58.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7dffb700 1 -- 172.21.15.72:0/2318403856 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6800bad0 con 0x7f4f800cb9b0 2023-08-31T18:47:58.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7effd700 1 --2- 172.21.15.72:0/2318403856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f68003910 0x7f4f68003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:58.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7e7fc700 1 --2- 172.21.15.72:0/2318403856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f800cb9b0 0x7f4f68004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:58.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7f7fe700 1 --2- 172.21.15.72:0/2318403856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f68004b80 0x7f4f68005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:58.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7effd700 1 -- 172.21.15.72:0/2318403856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f800cb9b0 msgr2=0x7f4f68004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:58.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7effd700 1 --2- 172.21.15.72:0/2318403856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f800cb9b0 0x7f4f68004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7effd700 1 -- 172.21.15.72:0/2318403856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f68004b80 msgr2=0x7f4f68005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:58.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7effd700 1 --2- 172.21.15.72:0/2318403856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f68004b80 0x7f4f68005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.355+0000 7f4f7effd700 1 -- 172.21.15.72:0/2318403856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f680033f0 con 0x7f4f68003910 2023-08-31T18:47:58.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.356+0000 7f4f7effd700 1 --2- 172.21.15.72:0/2318403856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f68003910 0x7f4f68003d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f4f7000c160 tx=0x7f4f700077a0).ready entity=mon.0 client_cookie=efe4098f08d2b88a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:58.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.356+0000 7f4f7dffb700 1 -- 172.21.15.72:0/2318403856 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f700079d0 con 0x7f4f68003910 2023-08-31T18:47:58.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.356+0000 7f4f7dffb700 1 -- 172.21.15.72:0/2318403856 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7000ca90 con 0x7f4f68003910 2023-08-31T18:47:58.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.356+0000 7f4f7dffb700 1 -- 172.21.15.72:0/2318403856 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7000ce50 con 0x7f4f68003910 2023-08-31T18:47:58.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.356+0000 7f4f853ff700 1 -- 172.21.15.72:0/2318403856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f68003910 msgr2=0x7f4f68003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:58.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.356+0000 7f4f853ff700 1 --2- 172.21.15.72:0/2318403856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f68003910 0x7f4f68003d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f4f7000c160 tx=0x7f4f700077a0).stop 2023-08-31T18:47:58.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.356+0000 7f4f7f7fe700 1 -- 172.21.15.72:0/2318403856 reap_dead start 2023-08-31T18:47:58.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.356+0000 7f4f853ff700 1 -- 172.21.15.72:0/2318403856 shutdown_connections 2023-08-31T18:47:58.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.356+0000 7f4f853ff700 1 -- 172.21.15.72:0/2318403856 >> 172.21.15.72:0/2318403856 conn(0x7f4f8005e870 msgr2=0x7f4f800cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:58.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.356+0000 7f4f853ff700 1 -- 172.21.15.72:0/2318403856 shutdown_connections 2023-08-31T18:47:58.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.356+0000 7f4f853ff700 1 -- 172.21.15.72:0/2318403856 wait complete. 2023-08-31T18:47:58.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.358+0000 7f4f853ff700 1 Processor -- start 2023-08-31T18:47:58.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.358+0000 7f4f853ff700 1 -- start start 2023-08-31T18:47:58.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f853ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f68003910 0x7f4f80064910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:58.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f853ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f80156070 0x7f4f8015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:58.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f853ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f8015a510 0x7f4f80150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:58.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f853ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f80157380 con 0x7f4f80156070 2023-08-31T18:47:58.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f853ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f801564f0 con 0x7f4f8015a510 2023-08-31T18:47:58.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f853ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f80156770 con 0x7f4f68003910 2023-08-31T18:47:58.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f7e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f80156070 0x7f4f8015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f7e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f80156070 0x7f4f8015a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52734/0 (socket says 172.21.15.72:52734) 2023-08-31T18:47:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f7e7fc700 1 -- 172.21.15.72:0/2222719012 learned_addr learned my addr 172.21.15.72:0/2222719012 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f7f7fe700 1 --2- 172.21.15.72:0/2222719012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f8015a510 0x7f4f80150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f7effd700 1 --2- 172.21.15.72:0/2222719012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f68003910 0x7f4f80064910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f7e7fc700 1 -- 172.21.15.72:0/2222719012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f68003910 msgr2=0x7f4f80064910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:58.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f7e7fc700 1 --2- 172.21.15.72:0/2222719012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f68003910 0x7f4f80064910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f7e7fc700 1 -- 172.21.15.72:0/2222719012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f8015a510 msgr2=0x7f4f80150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:58.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f7e7fc700 1 --2- 172.21.15.72:0/2222719012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f8015a510 0x7f4f80150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.359+0000 7f4f7e7fc700 1 -- 172.21.15.72:0/2222719012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80156a50 con 0x7f4f80156070 2023-08-31T18:47:58.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.360+0000 7f4f7e7fc700 1 --2- 172.21.15.72:0/2222719012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f80156070 0x7f4f8015a020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f4f740119f0 tx=0x7f4f74009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:58.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.360+0000 7f4f66ffd700 1 -- 172.21.15.72:0/2222719012 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7400f790 con 0x7f4f80156070 2023-08-31T18:47:58.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.360+0000 7f4f66ffd700 1 -- 172.21.15.72:0/2222719012 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7400f8f0 con 0x7f4f80156070 2023-08-31T18:47:58.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.360+0000 7f4f853ff700 1 -- 172.21.15.72:0/2222719012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f80156d30 con 0x7f4f80156070 2023-08-31T18:47:58.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.360+0000 7f4f66ffd700 1 -- 172.21.15.72:0/2222719012 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7400fc70 con 0x7f4f80156070 2023-08-31T18:47:58.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.360+0000 7f4f853ff700 1 -- 172.21.15.72:0/2222719012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f800aa850 con 0x7f4f80156070 2023-08-31T18:47:58.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.361+0000 7f4f853ff700 1 -- 172.21.15.72:0/2222719012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8006c6b0 con 0x7f4f80156070 2023-08-31T18:47:58.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.362+0000 7f4f66ffd700 1 -- 172.21.15.72:0/2222719012 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f4f74014650 con 0x7f4f80156070 2023-08-31T18:47:58.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.362+0000 7f4f66ffd700 1 --2- 172.21.15.72:0/2222719012 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f6c05ee10 0x7f4f6c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:58.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.363+0000 7f4f66ffd700 1 -- 172.21.15.72:0/2222719012 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4f7407a890 con 0x7f4f80156070 2023-08-31T18:47:58.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.363+0000 7f4f7effd700 1 --2- 172.21.15.72:0/2222719012 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f6c05ee10 0x7f4f6c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:58.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.363+0000 7f4f7effd700 1 --2- 172.21.15.72:0/2222719012 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f6c05ee10 0x7f4f6c0612d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4f70000ef0 tx=0x7f4f70015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:58.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.367+0000 7f4f66ffd700 1 -- 172.21.15.72:0/2222719012 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4f7404bcc0 con 0x7f4f80156070 2023-08-31T18:47:58.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.538+0000 7f4f853ff700 1 -- 172.21.15.72:0/2222719012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f800c0dc0 con 0x7f4f80156070 2023-08-31T18:47:58.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.539+0000 7f4f66ffd700 1 -- 172.21.15.72:0/2222719012 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17024 (secure 0 0 0) 0x7f4f7404f2e0 con 0x7f4f80156070 2023-08-31T18:47:58.540 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:47:58.540 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:53.972412+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:47:51.003304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-31T18:47:51.950765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:47:58.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.541+0000 7f4f853ff700 1 -- 172.21.15.72:0/2222719012 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f6c05ee10 msgr2=0x7f4f6c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:58.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.541+0000 7f4f853ff700 1 --2- 172.21.15.72:0/2222719012 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f6c05ee10 0x7f4f6c0612d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4f70000ef0 tx=0x7f4f70015000).stop 2023-08-31T18:47:58.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.541+0000 7f4f853ff700 1 -- 172.21.15.72:0/2222719012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f80156070 msgr2=0x7f4f8015a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:58.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.541+0000 7f4f853ff700 1 --2- 172.21.15.72:0/2222719012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f80156070 0x7f4f8015a020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f4f740119f0 tx=0x7f4f74009060).stop 2023-08-31T18:47:58.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.541+0000 7f4f853ff700 1 -- 172.21.15.72:0/2222719012 shutdown_connections 2023-08-31T18:47:58.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.541+0000 7f4f853ff700 1 --2- 172.21.15.72:0/2222719012 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f6c05ee10 0x7f4f6c0612d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.541+0000 7f4f853ff700 1 --2- 172.21.15.72:0/2222719012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f8015a510 0x7f4f80150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.541+0000 7f4f853ff700 1 --2- 172.21.15.72:0/2222719012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f68003910 0x7f4f80064910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.541+0000 7f4f853ff700 1 --2- 172.21.15.72:0/2222719012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f80156070 0x7f4f8015a020 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.542+0000 7f4f853ff700 1 -- 172.21.15.72:0/2222719012 >> 172.21.15.72:0/2222719012 conn(0x7f4f8005e870 msgr2=0x7f4f80153720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:58.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.542+0000 7f4f853ff700 1 -- 172.21.15.72:0/2222719012 shutdown_connections 2023-08-31T18:47:58.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.542+0000 7f4f853ff700 1 -- 172.21.15.72:0/2222719012 wait complete. 2023-08-31T18:47:58.559 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-31T18:47:58.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:47:58.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.747+0000 7fa7a3bff700 1 Processor -- start 2023-08-31T18:47:58.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.747+0000 7fa7a3bff700 1 -- start start 2023-08-31T18:47:58.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.748+0000 7fa7a3bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa79c154060 0x7fa79c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:58.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.748+0000 7fa7a3bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa79c0cb9b0 0x7fa79c1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:58.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.748+0000 7fa7a3bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79c0c6120 con 0x7fa79c1586b0 2023-08-31T18:47:58.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.748+0000 7fa7a3bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c0c1380 con 0x7fa79c154060 2023-08-31T18:47:58.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.748+0000 7fa7a3bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c0c5e10 con 0x7fa79c0cb9b0 2023-08-31T18:47:58.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.749+0000 7fa7a199b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa79c154060 0x7fa79c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:58.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.749+0000 7fa7a199b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa79c154060 0x7fa79c157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52746/0 (socket says 172.21.15.72:52746) 2023-08-31T18:47:58.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.749+0000 7fa7a219c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa79c1586b0 0x7fa79c0c65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44398/0 (socket says 172.21.15.72:44398) 2023-08-31T18:47:58.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.749+0000 7fa7a199b700 1 -- 172.21.15.72:0/3435438556 learned_addr learned my addr 172.21.15.72:0/3435438556 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:58.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.749+0000 7fa7a119a700 1 --2- 172.21.15.72:0/3435438556 >> v2:172.21.15.146:3300/0 conn(0x7fa79c0cb9b0 0x7fa79c1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:58.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.749+0000 7fa7a199b700 1 -- 172.21.15.72:0/3435438556 >> v2:172.21.15.146:3300/0 conn(0x7fa79c0cb9b0 msgr2=0x7fa79c1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:58.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.749+0000 7fa7a199b700 1 --2- 172.21.15.72:0/3435438556 >> v2:172.21.15.146:3300/0 conn(0x7fa79c0cb9b0 0x7fa79c1581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.749+0000 7fa7a199b700 1 -- 172.21.15.72:0/3435438556 >> v1:172.21.15.72:6789/0 conn(0x7fa79c1586b0 legacy=0x7fa79c0c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:58.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.749+0000 7fa7a199b700 1 -- 172.21.15.72:0/3435438556 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c158b00 con 0x7fa79c154060 2023-08-31T18:47:58.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.749+0000 7fa7a0999700 1 -- 172.21.15.72:0/3435438556 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903845277 0 0) 0x7fa79c0c6120 con 0x7fa79c1586b0 2023-08-31T18:47:58.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.749+0000 7fa7a199b700 1 --2- 172.21.15.72:0/3435438556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa79c154060 0x7fa79c157cd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fa79c083190 tx=0x7fa798009060).ready entity=mon.0 client_cookie=b96ed9925363a73f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:58.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.750+0000 7fa7a0999700 1 -- 172.21.15.72:0/3435438556 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798005880 con 0x7fa79c154060 2023-08-31T18:47:58.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.750+0000 7fa7a0999700 1 -- 172.21.15.72:0/3435438556 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7980059e0 con 0x7fa79c154060 2023-08-31T18:47:58.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.750+0000 7fa7a0999700 1 -- 172.21.15.72:0/3435438556 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798005d60 con 0x7fa79c154060 2023-08-31T18:47:58.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.750+0000 7fa7a3bff700 1 -- 172.21.15.72:0/3435438556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa79c154060 msgr2=0x7fa79c157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:58.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.750+0000 7fa7a3bff700 1 --2- 172.21.15.72:0/3435438556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa79c154060 0x7fa79c157cd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fa79c083190 tx=0x7fa798009060).stop 2023-08-31T18:47:58.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.750+0000 7fa7a3bff700 1 -- 172.21.15.72:0/3435438556 shutdown_connections 2023-08-31T18:47:58.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.750+0000 7fa7a3bff700 1 --2- 172.21.15.72:0/3435438556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa79c154060 0x7fa79c157cd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.750+0000 7fa7a3bff700 1 --2- 172.21.15.72:0/3435438556 >> v2:172.21.15.146:3300/0 conn(0x7fa79c0cb9b0 0x7fa79c1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.750+0000 7fa7a3bff700 1 -- 172.21.15.72:0/3435438556 >> 172.21.15.72:0/3435438556 conn(0x7fa79c05e870 msgr2=0x7fa79c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:58.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.750+0000 7fa7a3bff700 1 -- 172.21.15.72:0/3435438556 shutdown_connections 2023-08-31T18:47:58.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.750+0000 7fa7a3bff700 1 -- 172.21.15.72:0/3435438556 wait complete. 2023-08-31T18:47:58.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.752+0000 7fa7a3bff700 1 Processor -- start 2023-08-31T18:47:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.752+0000 7fa7a3bff700 1 -- start start 2023-08-31T18:47:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a3bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa79c0cb9b0 0x7fa79c155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a3bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa79c154060 0x7fa79c14c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a3bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa79c1586b0 0x7fa79c152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a3bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c151950 con 0x7fa79c1586b0 2023-08-31T18:47:58.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a3bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c155d50 con 0x7fa79c154060 2023-08-31T18:47:58.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a3bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c1572b0 con 0x7fa79c0cb9b0 2023-08-31T18:47:58.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a219c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa79c1586b0 0x7fa79c152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:58.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a219c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa79c1586b0 0x7fa79c152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52756/0 (socket says 172.21.15.72:52756) 2023-08-31T18:47:58.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a219c700 1 -- 172.21.15.72:0/3550949840 learned_addr learned my addr 172.21.15.72:0/3550949840 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:58.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a199b700 1 --2- 172.21.15.72:0/3550949840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa79c0cb9b0 0x7fa79c155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:58.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a119a700 1 --2- 172.21.15.72:0/3550949840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa79c154060 0x7fa79c14c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:58.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a219c700 1 -- 172.21.15.72:0/3550949840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa79c0cb9b0 msgr2=0x7fa79c155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:58.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a219c700 1 --2- 172.21.15.72:0/3550949840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa79c0cb9b0 0x7fa79c155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a219c700 1 -- 172.21.15.72:0/3550949840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa79c154060 msgr2=0x7fa79c14c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:58.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a219c700 1 --2- 172.21.15.72:0/3550949840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa79c154060 0x7fa79c14c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.753+0000 7fa7a219c700 1 -- 172.21.15.72:0/3550949840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa798009300 con 0x7fa79c1586b0 2023-08-31T18:47:58.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.754+0000 7fa7a219c700 1 --2- 172.21.15.72:0/3550949840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa79c1586b0 0x7fa79c152a20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fa79400c730 tx=0x7fa794001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:58.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.754+0000 7fa791ffb700 1 -- 172.21.15.72:0/3550949840 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794005c70 con 0x7fa79c1586b0 2023-08-31T18:47:58.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.754+0000 7fa791ffb700 1 -- 172.21.15.72:0/3550949840 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa794005dd0 con 0x7fa79c1586b0 2023-08-31T18:47:58.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.754+0000 7fa791ffb700 1 -- 172.21.15.72:0/3550949840 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794007300 con 0x7fa79c1586b0 2023-08-31T18:47:58.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.754+0000 7fa7a3bff700 1 -- 172.21.15.72:0/3550949840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79c151390 con 0x7fa79c1586b0 2023-08-31T18:47:58.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.754+0000 7fa7a3bff700 1 -- 172.21.15.72:0/3550949840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c15a990 con 0x7fa79c1586b0 2023-08-31T18:47:58.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.755+0000 7fa7a3bff700 1 -- 172.21.15.72:0/3550949840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79c06c6b0 con 0x7fa79c1586b0 2023-08-31T18:47:58.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.756+0000 7fa791ffb700 1 -- 172.21.15.72:0/3550949840 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fa7940076b0 con 0x7fa79c1586b0 2023-08-31T18:47:58.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.756+0000 7fa791ffb700 1 --2- 172.21.15.72:0/3550949840 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa78005ee10 0x7fa7800612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:58.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.756+0000 7fa791ffb700 1 -- 172.21.15.72:0/3550949840 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa794079820 con 0x7fa79c1586b0 2023-08-31T18:47:58.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.757+0000 7fa7a199b700 1 --2- 172.21.15.72:0/3550949840 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa78005ee10 0x7fa7800612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:58.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.757+0000 7fa7a199b700 1 --2- 172.21.15.72:0/3550949840 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa78005ee10 0x7fa7800612d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa798009fd0 tx=0x7fa798016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:58.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.760+0000 7fa791ffb700 1 -- 172.21.15.72:0/3550949840 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa79404abd0 con 0x7fa79c1586b0 2023-08-31T18:47:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.930+0000 7fa7a3bff700 1 -- 172.21.15.72:0/3550949840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa79c0c0ae0 con 0x7fa79c1586b0 2023-08-31T18:47:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.931+0000 7fa791ffb700 1 -- 172.21.15.72:0/3550949840 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17024 (secure 0 0 0) 0x7fa79404e1f0 con 0x7fa79c1586b0 2023-08-31T18:47:58.931 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:47:58.932 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:53.972412+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:47:51.003304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-31T18:47:51.950765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:47:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.933+0000 7fa7a3bff700 1 -- 172.21.15.72:0/3550949840 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa78005ee10 msgr2=0x7fa7800612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.933+0000 7fa7a3bff700 1 --2- 172.21.15.72:0/3550949840 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa78005ee10 0x7fa7800612d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa798009fd0 tx=0x7fa798016000).stop 2023-08-31T18:47:58.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.933+0000 7fa7a3bff700 1 -- 172.21.15.72:0/3550949840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa79c1586b0 msgr2=0x7fa79c152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:58.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.933+0000 7fa7a3bff700 1 --2- 172.21.15.72:0/3550949840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa79c1586b0 0x7fa79c152a20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fa79400c730 tx=0x7fa794001520).stop 2023-08-31T18:47:58.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.933+0000 7fa7a3bff700 1 -- 172.21.15.72:0/3550949840 shutdown_connections 2023-08-31T18:47:58.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.933+0000 7fa7a3bff700 1 --2- 172.21.15.72:0/3550949840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa79c1586b0 0x7fa79c152a20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.933+0000 7fa7a3bff700 1 --2- 172.21.15.72:0/3550949840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa79c0cb9b0 0x7fa79c155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.933+0000 7fa7a3bff700 1 --2- 172.21.15.72:0/3550949840 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa78005ee10 0x7fa7800612d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.933+0000 7fa7a3bff700 1 --2- 172.21.15.72:0/3550949840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa79c154060 0x7fa79c14c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.933+0000 7fa7a3bff700 1 -- 172.21.15.72:0/3550949840 >> 172.21.15.72:0/3550949840 conn(0x7fa79c05e870 msgr2=0x7fa79c0c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.933+0000 7fa7a3bff700 1 -- 172.21.15.72:0/3550949840 shutdown_connections 2023-08-31T18:47:58.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:58.933+0000 7fa7a3bff700 1 -- 172.21.15.72:0/3550949840 wait complete. 2023-08-31T18:47:58.950 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-31T18:47:59.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.138+0000 7fdf317ff700 1 Processor -- start 2023-08-31T18:47:59.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.138+0000 7fdf317ff700 1 -- start start 2023-08-31T18:47:59.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.139+0000 7fdf317ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf2c067b30 0x7fdf2c067f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.139+0000 7fdf317ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c0a81b0 con 0x7fdf2c151f20 2023-08-31T18:47:59.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.139+0000 7fdf317ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c068750 con 0x7fdf2c0c5090 2023-08-31T18:47:59.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.139+0000 7fdf317ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2c0a7e80 con 0x7fdf2c067b30 2023-08-31T18:47:59.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf2b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdf2c151f20 0x7fdf2c157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44410/0 (socket says 172.21.15.72:44410) 2023-08-31T18:47:59.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf2b7fe700 1 -- 172.21.15.72:0/2097876217 learned_addr learned my addr 172.21.15.72:0/2097876217 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:47:59.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf2affd700 1 --2- 172.21.15.72:0/2097876217 >> v2:172.21.15.146:3300/0 conn(0x7fdf2c067b30 0x7fdf2c067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf29ffb700 1 -- 172.21.15.72:0/2097876217 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992362661 0 0) 0x7fdf2c0a81b0 con 0x7fdf2c151f20 2023-08-31T18:47:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf29ffb700 1 -- 172.21.15.72:0/2097876217 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf140033f0 con 0x7fdf2c151f20 2023-08-31T18:47:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf29ffb700 1 -- 172.21.15.72:0/2097876217 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1218834358 0 0) 0x7fdf140033f0 con 0x7fdf2c151f20 2023-08-31T18:47:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf29ffb700 1 -- 172.21.15.72:0/2097876217 >> v2:172.21.15.146:3300/0 conn(0x7fdf2c067b30 msgr2=0x7fdf2c067f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf29ffb700 1 --2- 172.21.15.72:0/2097876217 >> v2:172.21.15.146:3300/0 conn(0x7fdf2c067b30 0x7fdf2c067f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf29ffb700 1 -- 172.21.15.72:0/2097876217 >> v1:172.21.15.146:6789/0 conn(0x7fdf2c0c5090 legacy=0x7fdf2c151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf29ffb700 1 -- 172.21.15.72:0/2097876217 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c0bdb80 con 0x7fdf2c151f20 2023-08-31T18:47:59.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf29ffb700 1 -- 172.21.15.72:0/2097876217 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fdf240017f0 con 0x7fdf2c151f20 2023-08-31T18:47:59.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf29ffb700 1 -- 172.21.15.72:0/2097876217 >> v1:172.21.15.72:6789/0 conn(0x7fdf2c151f20 legacy=0x7fdf2c157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf29ffb700 1 --2- 172.21.15.72:0/2097876217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf140038e0 0x7fdf14003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf29ffb700 1 --2- 172.21.15.72:0/2097876217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf14004690 0x7fdf14004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf29ffb700 1 --2- 172.21.15.72:0/2097876217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf14005000 0x7fdf1400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf29ffb700 1 -- 172.21.15.72:0/2097876217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0a7e80 con 0x7fdf140038e0 2023-08-31T18:47:59.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf29ffb700 1 -- 172.21.15.72:0/2097876217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1400beb0 con 0x7fdf14005000 2023-08-31T18:47:59.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.140+0000 7fdf29ffb700 1 -- 172.21.15.72:0/2097876217 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1400c070 con 0x7fdf14004690 2023-08-31T18:47:59.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.141+0000 7fdf2affd700 1 --2- 172.21.15.72:0/2097876217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf140038e0 0x7fdf14003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.141+0000 7fdf2b7fe700 1 --2- 172.21.15.72:0/2097876217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf14005000 0x7fdf1400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.141+0000 7fdf2a7fc700 1 --2- 172.21.15.72:0/2097876217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf14004690 0x7fdf14004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.141+0000 7fdf2affd700 1 -- 172.21.15.72:0/2097876217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf14004690 msgr2=0x7fdf14004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:59.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.141+0000 7fdf2affd700 1 --2- 172.21.15.72:0/2097876217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf14004690 0x7fdf14004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.141+0000 7fdf2affd700 1 -- 172.21.15.72:0/2097876217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf14005000 msgr2=0x7fdf1400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:59.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.141+0000 7fdf2affd700 1 --2- 172.21.15.72:0/2097876217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf14005000 0x7fdf1400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.141+0000 7fdf2affd700 1 -- 172.21.15.72:0/2097876217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf140033f0 con 0x7fdf140038e0 2023-08-31T18:47:59.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.141+0000 7fdf2b7fe700 1 -- 172.21.15.72:0/2097876217 reap_dead start 2023-08-31T18:47:59.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.141+0000 7fdf2a7fc700 1 --2- 172.21.15.72:0/2097876217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf14004690 0x7fdf14004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:47:59.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.141+0000 7fdf2affd700 1 --2- 172.21.15.72:0/2097876217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf140038e0 0x7fdf14003cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fdf1c006fd0 tx=0x7fdf1c006f40).ready entity=mon.0 client_cookie=684359d91a73b6eb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.141+0000 7fdf29ffb700 1 -- 172.21.15.72:0/2097876217 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c009430 con 0x7fdf140038e0 2023-08-31T18:47:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.141+0000 7fdf29ffb700 1 -- 172.21.15.72:0/2097876217 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c00e640 con 0x7fdf140038e0 2023-08-31T18:47:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.141+0000 7fdf29ffb700 1 -- 172.21.15.72:0/2097876217 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00e9c0 con 0x7fdf140038e0 2023-08-31T18:47:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.142+0000 7fdf317ff700 1 -- 172.21.15.72:0/2097876217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf140038e0 msgr2=0x7fdf14003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.142+0000 7fdf317ff700 1 --2- 172.21.15.72:0/2097876217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf140038e0 0x7fdf14003cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fdf1c006fd0 tx=0x7fdf1c006f40).stop 2023-08-31T18:47:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.142+0000 7fdf317ff700 1 -- 172.21.15.72:0/2097876217 shutdown_connections 2023-08-31T18:47:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.142+0000 7fdf317ff700 1 --2- 172.21.15.72:0/2097876217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf140038e0 0x7fdf14003cc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.142+0000 7fdf317ff700 1 -- 172.21.15.72:0/2097876217 >> 172.21.15.72:0/2097876217 conn(0x7fdf2c0c8c20 msgr2=0x7fdf2c0c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.142+0000 7fdf317ff700 1 -- 172.21.15.72:0/2097876217 shutdown_connections 2023-08-31T18:47:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.142+0000 7fdf317ff700 1 -- 172.21.15.72:0/2097876217 wait complete. 2023-08-31T18:47:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.143+0000 7fdf317ff700 1 Processor -- start 2023-08-31T18:47:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.144+0000 7fdf317ff700 1 -- start start 2023-08-31T18:47:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.144+0000 7fdf317ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf140038e0 0x7fdf2c147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf317ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf2c14de40 0x7fdf2c14d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf317ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2c14d890 0x7fdf2c153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf317ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c148120 con 0x7fdf2c14de40 2023-08-31T18:47:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf317ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c14b8f0 con 0x7fdf2c14d890 2023-08-31T18:47:59.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf317ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0adff0 con 0x7fdf140038e0 2023-08-31T18:47:59.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf2a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf2c14de40 0x7fdf2c14d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf2a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf2c14de40 0x7fdf2c14d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52768/0 (socket says 172.21.15.72:52768) 2023-08-31T18:47:59.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf2a7fc700 1 -- 172.21.15.72:0/677593843 learned_addr learned my addr 172.21.15.72:0/677593843 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:59.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf2affd700 1 --2- 172.21.15.72:0/677593843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf140038e0 0x7fdf2c147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf2b7fe700 1 --2- 172.21.15.72:0/677593843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2c14d890 0x7fdf2c153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf2a7fc700 1 -- 172.21.15.72:0/677593843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf140038e0 msgr2=0x7fdf2c147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf2a7fc700 1 --2- 172.21.15.72:0/677593843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf140038e0 0x7fdf2c147c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf2a7fc700 1 -- 172.21.15.72:0/677593843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2c14d890 msgr2=0x7fdf2c153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf2a7fc700 1 --2- 172.21.15.72:0/677593843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf2c14d890 0x7fdf2c153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf2a7fc700 1 -- 172.21.15.72:0/677593843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c0ae2d0 con 0x7fdf2c14de40 2023-08-31T18:47:59.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.145+0000 7fdf2a7fc700 1 --2- 172.21.15.72:0/677593843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf2c14de40 0x7fdf2c14d3a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fdf2000e470 tx=0x7fdf20009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.146+0000 7fdf12ffd700 1 -- 172.21.15.72:0/677593843 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20014430 con 0x7fdf2c14de40 2023-08-31T18:47:59.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.146+0000 7fdf12ffd700 1 -- 172.21.15.72:0/677593843 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf20014590 con 0x7fdf2c14de40 2023-08-31T18:47:59.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.146+0000 7fdf12ffd700 1 -- 172.21.15.72:0/677593843 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20014910 con 0x7fdf2c14de40 2023-08-31T18:47:59.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.146+0000 7fdf317ff700 1 -- 172.21.15.72:0/677593843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2c0ae5b0 con 0x7fdf2c14de40 2023-08-31T18:47:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.146+0000 7fdf317ff700 1 -- 172.21.15.72:0/677593843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c0adc10 con 0x7fdf2c14de40 2023-08-31T18:47:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.147+0000 7fdf317ff700 1 -- 172.21.15.72:0/677593843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf2c06c6b0 con 0x7fdf2c14de40 2023-08-31T18:47:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.148+0000 7fdf12ffd700 1 -- 172.21.15.72:0/677593843 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fdf20014c80 con 0x7fdf2c14de40 2023-08-31T18:47:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.148+0000 7fdf12ffd700 1 --2- 172.21.15.72:0/677593843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf1805ee10 0x7fdf180612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.148+0000 7fdf12ffd700 1 -- 172.21.15.72:0/677593843 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdf20079d10 con 0x7fdf2c14de40 2023-08-31T18:47:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.149+0000 7fdf2affd700 1 --2- 172.21.15.72:0/677593843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf1805ee10 0x7fdf180612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.149+0000 7fdf12ffd700 1 --2- 172.21.15.72:0/677593843 >> [v2:172.21.15.72:6800/143801,v1:172.21.15.72:6801/143801] conn(0x7fdf180681b0 0x7fdf1806a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.149+0000 7fdf12ffd700 1 -- 172.21.15.72:0/677593843 --> [v2:172.21.15.72:6800/143801,v1:172.21.15.72:6801/143801] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf1806ac90 con 0x7fdf180681b0 2023-08-31T18:47:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.149+0000 7fdf12ffd700 1 -- 172.21.15.72:0/677593843 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf2007c270 con 0x7fdf2c14de40 2023-08-31T18:47:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.149+0000 7fdf2b7fe700 1 --2- 172.21.15.72:0/677593843 >> [v2:172.21.15.72:6800/143801,v1:172.21.15.72:6801/143801] conn(0x7fdf180681b0 0x7fdf1806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.149+0000 7fdf2affd700 1 --2- 172.21.15.72:0/677593843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf1805ee10 0x7fdf180612d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fdf1c006fa0 tx=0x7fdf1c01a000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.149+0000 7fdf2b7fe700 1 --2- 172.21.15.72:0/677593843 >> [v2:172.21.15.72:6800/143801,v1:172.21.15.72:6801/143801] conn(0x7fdf180681b0 0x7fdf1806a610 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.150+0000 7fdf12ffd700 1 -- 172.21.15.72:0/677593843 <== osd.0 v2:172.21.15.72:6800/143801 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fdf1806ac90 con 0x7fdf180681b0 2023-08-31T18:47:59.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.165+0000 7fdf317ff700 1 -- 172.21.15.72:0/677593843 --> [v2:172.21.15.72:6800/143801,v1:172.21.15.72:6801/143801] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdf2c0bde60 con 0x7fdf180681b0 2023-08-31T18:47:59.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.165+0000 7fdf12ffd700 1 -- 172.21.15.72:0/677593843 <== osd.0 v2:172.21.15.72:6800/143801 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdf2c0bde60 con 0x7fdf180681b0 2023-08-31T18:47:59.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.166+0000 7fdf317ff700 1 -- 172.21.15.72:0/677593843 >> [v2:172.21.15.72:6800/143801,v1:172.21.15.72:6801/143801] conn(0x7fdf180681b0 msgr2=0x7fdf1806a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.166+0000 7fdf317ff700 1 --2- 172.21.15.72:0/677593843 >> [v2:172.21.15.72:6800/143801,v1:172.21.15.72:6801/143801] conn(0x7fdf180681b0 0x7fdf1806a610 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.166+0000 7fdf317ff700 1 -- 172.21.15.72:0/677593843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf1805ee10 msgr2=0x7fdf180612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.166+0000 7fdf317ff700 1 --2- 172.21.15.72:0/677593843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf1805ee10 0x7fdf180612d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fdf1c006fa0 tx=0x7fdf1c01a000).stop 2023-08-31T18:47:59.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.166+0000 7fdf317ff700 1 -- 172.21.15.72:0/677593843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf2c14de40 msgr2=0x7fdf2c14d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.166+0000 7fdf317ff700 1 --2- 172.21.15.72:0/677593843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf2c14de40 0x7fdf2c14d3a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fdf2000e470 tx=0x7fdf20009040).stop 2023-08-31T18:47:59.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.166+0000 7fdf2b7fe700 1 -- 172.21.15.72:0/677593843 reap_dead start 2023-08-31T18:47:59.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.166+0000 7fdf317ff700 1 -- 172.21.15.72:0/677593843 shutdown_connections 2023-08-31T18:47:59.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.166+0000 7fdf317ff700 1 -- 172.21.15.72:0/677593843 >> 172.21.15.72:0/677593843 conn(0x7fdf2c0c8c20 msgr2=0x7fdf2c154820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:59.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.166+0000 7fdf317ff700 1 -- 172.21.15.72:0/677593843 shutdown_connections 2023-08-31T18:47:59.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.166+0000 7fdf317ff700 1 -- 172.21.15.72:0/677593843 wait complete. 2023-08-31T18:47:59.182 INFO:teuthology.orchestra.run.smithi072.stdout:55834574852 2023-08-31T18:47:59.183 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-31T18:47:59.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.371+0000 7fe124bff700 1 Processor -- start 2023-08-31T18:47:59.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.371+0000 7fe124bff700 1 -- start start 2023-08-31T18:47:59.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.372+0000 7fe124bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1200c8ee0 0x7fe120154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.372+0000 7fe124bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1200c9450 con 0x7fe1200ca4f0 2023-08-31T18:47:59.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.372+0000 7fe124bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1200c9730 con 0x7fe120153ca0 2023-08-31T18:47:59.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.372+0000 7fe124bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1200c9a10 con 0x7fe1200c8ee0 2023-08-31T18:47:59.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.372+0000 7fe11ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe1200ca4f0 0x7fe120063100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44412/0 (socket says 172.21.15.72:44412) 2023-08-31T18:47:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.372+0000 7fe11ed9d700 1 -- 172.21.15.72:0/3634966368 learned_addr learned my addr 172.21.15.72:0/3634966368 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:47:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11dd9b700 1 --2- 172.21.15.72:0/3634966368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1200c8ee0 0x7fe120154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11d59a700 1 -- 172.21.15.72:0/3634966368 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157546114 0 0) 0x7fe1200c9450 con 0x7fe1200ca4f0 2023-08-31T18:47:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11d59a700 1 -- 172.21.15.72:0/3634966368 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1080033f0 con 0x7fe1200ca4f0 2023-08-31T18:47:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11d59a700 1 -- 172.21.15.72:0/3634966368 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2424696751 0 0) 0x7fe1080033f0 con 0x7fe1200ca4f0 2023-08-31T18:47:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11d59a700 1 -- 172.21.15.72:0/3634966368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1200c8ee0 msgr2=0x7fe120154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11d59a700 1 --2- 172.21.15.72:0/3634966368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1200c8ee0 0x7fe120154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11d59a700 1 -- 172.21.15.72:0/3634966368 >> v1:172.21.15.146:6789/0 conn(0x7fe120153ca0 legacy=0x7fe120158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11d59a700 1 -- 172.21.15.72:0/3634966368 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1200c9cf0 con 0x7fe1200ca4f0 2023-08-31T18:47:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11d59a700 1 -- 172.21.15.72:0/3634966368 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fe1180017f0 con 0x7fe1200ca4f0 2023-08-31T18:47:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11d59a700 1 -- 172.21.15.72:0/3634966368 >> v1:172.21.15.72:6789/0 conn(0x7fe1200ca4f0 legacy=0x7fe120063100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11d59a700 1 --2- 172.21.15.72:0/3634966368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1200c8ee0 0x7fe108003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11d59a700 1 --2- 172.21.15.72:0/3634966368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe108003e00 0x7fe108004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11d59a700 1 --2- 172.21.15.72:0/3634966368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe108004b80 0x7fe108005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11d59a700 1 -- 172.21.15.72:0/3634966368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1200c9a10 con 0x7fe108003e00 2023-08-31T18:47:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11d59a700 1 -- 172.21.15.72:0/3634966368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10800b8e0 con 0x7fe108004b80 2023-08-31T18:47:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11d59a700 1 -- 172.21.15.72:0/3634966368 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10800baa0 con 0x7fe1200c8ee0 2023-08-31T18:47:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.373+0000 7fe11dd9b700 1 --2- 172.21.15.72:0/3634966368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe108003e00 0x7fe108004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.374+0000 7fe11ed9d700 1 --2- 172.21.15.72:0/3634966368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe108004b80 0x7fe108005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.374+0000 7fe11e59c700 1 --2- 172.21.15.72:0/3634966368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1200c8ee0 0x7fe108003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.374+0000 7fe11dd9b700 1 -- 172.21.15.72:0/3634966368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1200c8ee0 msgr2=0x7fe108003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.374+0000 7fe11dd9b700 1 --2- 172.21.15.72:0/3634966368 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1200c8ee0 0x7fe108003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.374+0000 7fe11dd9b700 1 -- 172.21.15.72:0/3634966368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe108004b80 msgr2=0x7fe108005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:47:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.374+0000 7fe11dd9b700 1 --2- 172.21.15.72:0/3634966368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe108004b80 0x7fe108005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.374+0000 7fe11dd9b700 1 -- 172.21.15.72:0/3634966368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1080033f0 con 0x7fe108003e00 2023-08-31T18:47:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.374+0000 7fe11dd9b700 1 --2- 172.21.15.72:0/3634966368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe108003e00 0x7fe108004690 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fe114009a80 tx=0x7fe114009060).ready entity=mon.0 client_cookie=8972fc839276a10b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.374+0000 7fe11d59a700 1 -- 172.21.15.72:0/3634966368 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe114009430 con 0x7fe108003e00 2023-08-31T18:47:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.374+0000 7fe11d59a700 1 -- 172.21.15.72:0/3634966368 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11400e640 con 0x7fe108003e00 2023-08-31T18:47:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.374+0000 7fe11d59a700 1 -- 172.21.15.72:0/3634966368 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11400e9c0 con 0x7fe108003e00 2023-08-31T18:47:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.375+0000 7fe124bff700 1 -- 172.21.15.72:0/3634966368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe108003e00 msgr2=0x7fe108004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.375+0000 7fe124bff700 1 --2- 172.21.15.72:0/3634966368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe108003e00 0x7fe108004690 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fe114009a80 tx=0x7fe114009060).stop 2023-08-31T18:47:59.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.375+0000 7fe11ed9d700 1 -- 172.21.15.72:0/3634966368 reap_dead start 2023-08-31T18:47:59.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.375+0000 7fe124bff700 1 -- 172.21.15.72:0/3634966368 shutdown_connections 2023-08-31T18:47:59.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.375+0000 7fe124bff700 1 -- 172.21.15.72:0/3634966368 >> 172.21.15.72:0/3634966368 conn(0x7fe1200cadb0 msgr2=0x7fe1200cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:59.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.375+0000 7fe124bff700 1 -- 172.21.15.72:0/3634966368 shutdown_connections 2023-08-31T18:47:59.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.375+0000 7fe124bff700 1 -- 172.21.15.72:0/3634966368 wait complete. 2023-08-31T18:47:59.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.376+0000 7fe124bff700 1 Processor -- start 2023-08-31T18:47:59.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.377+0000 7fe124bff700 1 -- start start 2023-08-31T18:47:59.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.377+0000 7fe124bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe108003e00 0x7fe120159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.377+0000 7fe124bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe12015a310 0x7fe1200c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.377+0000 7fe124bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1200c34e0 0x7fe1200ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.377+0000 7fe124bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1200c4630 con 0x7fe108003e00 2023-08-31T18:47:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.377+0000 7fe124bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1200c4350 con 0x7fe1200c34e0 2023-08-31T18:47:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.377+0000 7fe124bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1200c3a20 con 0x7fe12015a310 2023-08-31T18:47:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe11e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe108003e00 0x7fe120159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe11e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe108003e00 0x7fe120159e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52788/0 (socket says 172.21.15.72:52788) 2023-08-31T18:47:59.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe11e59c700 1 -- 172.21.15.72:0/3470134165 learned_addr learned my addr 172.21.15.72:0/3470134165 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:59.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe11dd9b700 1 --2- 172.21.15.72:0/3470134165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe12015a310 0x7fe1200c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe11ed9d700 1 --2- 172.21.15.72:0/3470134165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1200c34e0 0x7fe1200ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe11e59c700 1 -- 172.21.15.72:0/3470134165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe12015a310 msgr2=0x7fe1200c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe11e59c700 1 --2- 172.21.15.72:0/3470134165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe12015a310 0x7fe1200c2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe11e59c700 1 -- 172.21.15.72:0/3470134165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1200c34e0 msgr2=0x7fe1200ae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe11e59c700 1 --2- 172.21.15.72:0/3470134165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1200c34e0 0x7fe1200ae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe11e59c700 1 -- 172.21.15.72:0/3470134165 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1200c3d00 con 0x7fe108003e00 2023-08-31T18:47:59.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe11dd9b700 1 --2- 172.21.15.72:0/3470134165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe12015a310 0x7fe1200c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:47:59.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe11e59c700 1 --2- 172.21.15.72:0/3470134165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe108003e00 0x7fe120159e20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe1100029d0 tx=0x7fe110007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe10e7fc700 1 -- 172.21.15.72:0/3470134165 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11000f8d0 con 0x7fe108003e00 2023-08-31T18:47:59.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe10e7fc700 1 -- 172.21.15.72:0/3470134165 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11000fa30 con 0x7fe108003e00 2023-08-31T18:47:59.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe124bff700 1 -- 172.21.15.72:0/3470134165 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1200c3fe0 con 0x7fe108003e00 2023-08-31T18:47:59.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.378+0000 7fe10e7fc700 1 -- 172.21.15.72:0/3470134165 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11000fdb0 con 0x7fe108003e00 2023-08-31T18:47:59.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.379+0000 7fe124bff700 1 -- 172.21.15.72:0/3470134165 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1200aeaa0 con 0x7fe108003e00 2023-08-31T18:47:59.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.379+0000 7fe124bff700 1 -- 172.21.15.72:0/3470134165 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1200ca980 con 0x7fe108003e00 2023-08-31T18:47:59.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.380+0000 7fe10e7fc700 1 -- 172.21.15.72:0/3470134165 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fe110014660 con 0x7fe108003e00 2023-08-31T18:47:59.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.381+0000 7fe10e7fc700 1 --2- 172.21.15.72:0/3470134165 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe10005ee10 0x7fe1000612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.381+0000 7fe10e7fc700 1 -- 172.21.15.72:0/3470134165 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe110079d00 con 0x7fe108003e00 2023-08-31T18:47:59.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.381+0000 7fe11dd9b700 1 --2- 172.21.15.72:0/3470134165 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe10005ee10 0x7fe1000612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.381+0000 7fe10e7fc700 1 --2- 172.21.15.72:0/3470134165 >> [v2:172.21.15.72:6808/143815,v1:172.21.15.72:6810/143815] conn(0x7fe1000681b0 0x7fe10006a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.381+0000 7fe10e7fc700 1 -- 172.21.15.72:0/3470134165 --> [v2:172.21.15.72:6808/143815,v1:172.21.15.72:6810/143815] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe10006ac90 con 0x7fe1000681b0 2023-08-31T18:47:59.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.381+0000 7fe10e7fc700 1 -- 172.21.15.72:0/3470134165 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe11007c260 con 0x7fe108003e00 2023-08-31T18:47:59.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.382+0000 7fe11ed9d700 1 --2- 172.21.15.72:0/3470134165 >> [v2:172.21.15.72:6808/143815,v1:172.21.15.72:6810/143815] conn(0x7fe1000681b0 0x7fe10006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.382+0000 7fe11dd9b700 1 --2- 172.21.15.72:0/3470134165 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe10005ee10 0x7fe1000612d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe1200640d0 tx=0x7fe11401a000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.382+0000 7fe11ed9d700 1 --2- 172.21.15.72:0/3470134165 >> [v2:172.21.15.72:6808/143815,v1:172.21.15.72:6810/143815] conn(0x7fe1000681b0 0x7fe10006a610 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.383+0000 7fe10e7fc700 1 -- 172.21.15.72:0/3470134165 <== osd.1 v2:172.21.15.72:6808/143815 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fe10006ac90 con 0x7fe1000681b0 2023-08-31T18:47:59.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.397+0000 7fe124bff700 1 -- 172.21.15.72:0/3470134165 --> [v2:172.21.15.72:6808/143815,v1:172.21.15.72:6810/143815] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe120164010 con 0x7fe1000681b0 2023-08-31T18:47:59.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.398+0000 7fe10e7fc700 1 -- 172.21.15.72:0/3470134165 <== osd.1 v2:172.21.15.72:6808/143815 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe120164010 con 0x7fe1000681b0 2023-08-31T18:47:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.398+0000 7fe124bff700 1 -- 172.21.15.72:0/3470134165 >> [v2:172.21.15.72:6808/143815,v1:172.21.15.72:6810/143815] conn(0x7fe1000681b0 msgr2=0x7fe10006a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.398+0000 7fe124bff700 1 --2- 172.21.15.72:0/3470134165 >> [v2:172.21.15.72:6808/143815,v1:172.21.15.72:6810/143815] conn(0x7fe1000681b0 0x7fe10006a610 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.398+0000 7fe124bff700 1 -- 172.21.15.72:0/3470134165 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe10005ee10 msgr2=0x7fe1000612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.398+0000 7fe124bff700 1 --2- 172.21.15.72:0/3470134165 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe10005ee10 0x7fe1000612d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe1200640d0 tx=0x7fe11401a000).stop 2023-08-31T18:47:59.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.398+0000 7fe124bff700 1 -- 172.21.15.72:0/3470134165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe108003e00 msgr2=0x7fe120159e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.398+0000 7fe124bff700 1 --2- 172.21.15.72:0/3470134165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe108003e00 0x7fe120159e20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe1100029d0 tx=0x7fe110007b90).stop 2023-08-31T18:47:59.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.398+0000 7fe11ed9d700 1 -- 172.21.15.72:0/3470134165 reap_dead start 2023-08-31T18:47:59.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.398+0000 7fe124bff700 1 -- 172.21.15.72:0/3470134165 shutdown_connections 2023-08-31T18:47:59.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.398+0000 7fe124bff700 1 -- 172.21.15.72:0/3470134165 >> 172.21.15.72:0/3470134165 conn(0x7fe1200cadb0 msgr2=0x7fe1200c13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:59.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.398+0000 7fe124bff700 1 -- 172.21.15.72:0/3470134165 shutdown_connections 2023-08-31T18:47:59.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.399+0000 7fe124bff700 1 -- 172.21.15.72:0/3470134165 wait complete. 2023-08-31T18:47:59.415 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2023-08-31T18:47:59.415 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-31T18:47:59.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.604+0000 7f7ef05ff700 1 Processor -- start 2023-08-31T18:47:59.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.604+0000 7f7ef05ff700 1 -- start start 2023-08-31T18:47:59.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.606+0000 7f7ef05ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ee80c8ee0 0x7f7ee8154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.606+0000 7f7ef05ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee80c9450 con 0x7f7ee8153ca0 2023-08-31T18:47:59.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.606+0000 7f7ef05ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee80c9730 con 0x7f7ee80ca4f0 2023-08-31T18:47:59.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.606+0000 7f7ef05ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee80c9a10 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.606+0000 7f7eedb9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ee80c8ee0 0x7f7ee8154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.606+0000 7f7eedb9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ee80c8ee0 0x7f7ee8154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52804/0 (socket says 172.21.15.72:52804) 2023-08-31T18:47:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.606+0000 7f7eedb9a700 1 -- 172.21.15.72:0/1131180552 learned_addr learned my addr 172.21.15.72:0/1131180552 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.606+0000 7f7eee39b700 1 --1- 172.21.15.72:0/1131180552 >> v1:172.21.15.72:6789/0 conn(0x7f7ee8153ca0 0x7f7ee8158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44428/0 (socket says 172.21.15.72:44428) 2023-08-31T18:47:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.606+0000 7f7eedb9a700 1 -- 172.21.15.72:0/1131180552 >> v1:172.21.15.146:6789/0 conn(0x7f7ee80ca4f0 legacy=0x7f7ee8063100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.606+0000 7f7eedb9a700 1 -- 172.21.15.72:0/1131180552 >> v1:172.21.15.72:6789/0 conn(0x7f7ee8153ca0 legacy=0x7f7ee8158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.606+0000 7f7eed399700 1 -- 172.21.15.72:0/1131180552 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283367681 0 0) 0x7f7ee80c9450 con 0x7f7ee8153ca0 2023-08-31T18:47:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.606+0000 7f7eedb9a700 1 -- 172.21.15.72:0/1131180552 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee80c9cf0 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.607+0000 7f7eedb9a700 1 --2- 172.21.15.72:0/1131180552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee80c8ee0 0x7f7ee8154080 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7ed8006fd0 tx=0x7f7ed80090f0).ready entity=mon.0 client_cookie=bea36962ba2cf05b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.607+0000 7f7eed399700 1 -- 172.21.15.72:0/1131180552 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800b600 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.607+0000 7f7eed399700 1 -- 172.21.15.72:0/1131180552 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed800b760 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.607+0000 7f7eed399700 1 -- 172.21.15.72:0/1131180552 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800bae0 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.607+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1131180552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee80c8ee0 msgr2=0x7f7ee8154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.607+0000 7f7ef05ff700 1 --2- 172.21.15.72:0/1131180552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee80c8ee0 0x7f7ee8154080 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7ed8006fd0 tx=0x7f7ed80090f0).stop 2023-08-31T18:47:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.607+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1131180552 shutdown_connections 2023-08-31T18:47:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.607+0000 7f7ef05ff700 1 --2- 172.21.15.72:0/1131180552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee80c8ee0 0x7f7ee8154080 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.607+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1131180552 >> 172.21.15.72:0/1131180552 conn(0x7f7ee80cadb0 msgr2=0x7f7ee80cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.607+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1131180552 shutdown_connections 2023-08-31T18:47:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.607+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1131180552 wait complete. 2023-08-31T18:47:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.609+0000 7f7ef05ff700 1 Processor -- start 2023-08-31T18:47:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.609+0000 7f7ef05ff700 1 -- start start 2023-08-31T18:47:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.610+0000 7f7ef05ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee80c8ee0 0x7f7ee80b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.610+0000 7f7ef05ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ee80ca4f0 0x7f7ee80c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.610+0000 7f7ef05ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee8153ca0 0x7f7ee80c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.610+0000 7f7ef05ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8165830 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.610+0000 7f7ef05ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80c81d0 con 0x7f7ee8153ca0 2023-08-31T18:47:59.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.610+0000 7f7ef05ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee81661e0 con 0x7f7ee80ca4f0 2023-08-31T18:47:59.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.610+0000 7f7eee39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee80c8ee0 0x7f7ee80b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.610+0000 7f7eee39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee80c8ee0 0x7f7ee80b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52812/0 (socket says 172.21.15.72:52812) 2023-08-31T18:47:59.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.610+0000 7f7eee39b700 1 -- 172.21.15.72:0/1088364497 learned_addr learned my addr 172.21.15.72:0/1088364497 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:59.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.610+0000 7f7eedb9a700 1 --2- 172.21.15.72:0/1088364497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ee80ca4f0 0x7f7ee80c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.610+0000 7f7eeeb9c700 1 --2- 172.21.15.72:0/1088364497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee8153ca0 0x7f7ee80c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.610+0000 7f7eee39b700 1 -- 172.21.15.72:0/1088364497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ee80ca4f0 msgr2=0x7f7ee80c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.610+0000 7f7eee39b700 1 --2- 172.21.15.72:0/1088364497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ee80ca4f0 0x7f7ee80c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.611+0000 7f7eee39b700 1 -- 172.21.15.72:0/1088364497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee8153ca0 msgr2=0x7f7ee80c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.611+0000 7f7eee39b700 1 --2- 172.21.15.72:0/1088364497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee8153ca0 0x7f7ee80c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.611+0000 7f7eee39b700 1 -- 172.21.15.72:0/1088364497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed8009370 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.611+0000 7f7eee39b700 1 --2- 172.21.15.72:0/1088364497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee80c8ee0 0x7f7ee80b06d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f7ee400c490 tx=0x7f7ee4007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.611+0000 7f7ede7fc700 1 -- 172.21.15.72:0/1088364497 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee40072e0 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.611+0000 7f7ede7fc700 1 -- 172.21.15.72:0/1088364497 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee4007440 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.611+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1088364497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee8165550 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.611+0000 7f7ede7fc700 1 -- 172.21.15.72:0/1088364497 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4005930 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.611+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1088364497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee8165e70 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.612+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1088364497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ee81659f0 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.613+0000 7f7ede7fc700 1 -- 172.21.15.72:0/1088364497 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f7ee4005d20 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.614+0000 7f7ede7fc700 1 --2- 172.21.15.72:0/1088364497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ecc05ee10 0x7f7ecc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.614+0000 7f7ede7fc700 1 -- 172.21.15.72:0/1088364497 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7ee4079610 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.614+0000 7f7eedb9a700 1 --2- 172.21.15.72:0/1088364497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ecc05ee10 0x7f7ecc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.614+0000 7f7ede7fc700 1 --2- 172.21.15.72:0/1088364497 >> [v2:172.21.15.72:6821/143814,v1:172.21.15.72:6823/143814] conn(0x7f7ecc0681b0 0x7f7ecc06a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.614+0000 7f7ede7fc700 1 -- 172.21.15.72:0/1088364497 --> [v2:172.21.15.72:6821/143814,v1:172.21.15.72:6823/143814] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ecc06ac90 con 0x7f7ecc0681b0 2023-08-31T18:47:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.614+0000 7f7ede7fc700 1 -- 172.21.15.72:0/1088364497 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ee407bb70 con 0x7f7ee80c8ee0 2023-08-31T18:47:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.614+0000 7f7eeeb9c700 1 --2- 172.21.15.72:0/1088364497 >> [v2:172.21.15.72:6821/143814,v1:172.21.15.72:6823/143814] conn(0x7f7ecc0681b0 0x7f7ecc06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.614+0000 7f7eedb9a700 1 --2- 172.21.15.72:0/1088364497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ecc05ee10 0x7f7ecc0612d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f7ed8009130 tx=0x7f7ed8017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.615+0000 7f7eeeb9c700 1 --2- 172.21.15.72:0/1088364497 >> [v2:172.21.15.72:6821/143814,v1:172.21.15.72:6823/143814] conn(0x7f7ecc0681b0 0x7f7ecc06a610 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.615+0000 7f7ede7fc700 1 -- 172.21.15.72:0/1088364497 <== osd.2 v2:172.21.15.72:6821/143814 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f7ecc06ac90 con 0x7f7ecc0681b0 2023-08-31T18:47:59.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.630+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1088364497 --> [v2:172.21.15.72:6821/143814,v1:172.21.15.72:6823/143814] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ee8166320 con 0x7f7ecc0681b0 2023-08-31T18:47:59.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.630+0000 7f7ede7fc700 1 -- 172.21.15.72:0/1088364497 <== osd.2 v2:172.21.15.72:6821/143814 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ee0003e80 con 0x7f7ecc0681b0 2023-08-31T18:47:59.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.630+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1088364497 >> [v2:172.21.15.72:6821/143814,v1:172.21.15.72:6823/143814] conn(0x7f7ecc0681b0 msgr2=0x7f7ecc06a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.630+0000 7f7ef05ff700 1 --2- 172.21.15.72:0/1088364497 >> [v2:172.21.15.72:6821/143814,v1:172.21.15.72:6823/143814] conn(0x7f7ecc0681b0 0x7f7ecc06a610 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.630+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1088364497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ecc05ee10 msgr2=0x7f7ecc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.630+0000 7f7ef05ff700 1 --2- 172.21.15.72:0/1088364497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ecc05ee10 0x7f7ecc0612d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f7ed8009130 tx=0x7f7ed8017000).stop 2023-08-31T18:47:59.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.630+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1088364497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee80c8ee0 msgr2=0x7f7ee80b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.630+0000 7f7ef05ff700 1 --2- 172.21.15.72:0/1088364497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee80c8ee0 0x7f7ee80b06d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f7ee400c490 tx=0x7f7ee4007de0).stop 2023-08-31T18:47:59.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.630+0000 7f7eeeb9c700 1 -- 172.21.15.72:0/1088364497 reap_dead start 2023-08-31T18:47:59.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.631+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1088364497 shutdown_connections 2023-08-31T18:47:59.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.631+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1088364497 >> 172.21.15.72:0/1088364497 conn(0x7f7ee80cadb0 msgr2=0x7f7ee80ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:59.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.631+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1088364497 shutdown_connections 2023-08-31T18:47:59.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.631+0000 7f7ef05ff700 1 -- 172.21.15.72:0/1088364497 wait complete. 2023-08-31T18:47:59.646 INFO:teuthology.orchestra.run.smithi072.stdout:55834574852 2023-08-31T18:47:59.647 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-31T18:47:59.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.834+0000 7f15b69ff700 1 Processor -- start 2023-08-31T18:47:59.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.835+0000 7f15b69ff700 1 -- start start 2023-08-31T18:47:59.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.836+0000 7f15b69ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15b0153ca0 0x7f15b0154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.836+0000 7f15b69ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b00c9450 con 0x7f15b00ca4f0 2023-08-31T18:47:59.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.836+0000 7f15b69ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b00c9730 con 0x7f15b00c8ee0 2023-08-31T18:47:59.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.836+0000 7f15b69ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b00c9a10 con 0x7f15b0153ca0 2023-08-31T18:47:59.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.837+0000 7f15b4f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f15b00ca4f0 0x7f15b0063100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44430/0 (socket says 172.21.15.72:44430) 2023-08-31T18:47:59.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.837+0000 7f15b4f9c700 1 -- 172.21.15.72:0/1589723497 learned_addr learned my addr 172.21.15.72:0/1589723497 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:47:59.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.837+0000 7f15affff700 1 --2- 172.21.15.72:0/1589723497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15b0153ca0 0x7f15b0154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.837+0000 7f15aeffd700 1 -- 172.21.15.72:0/1589723497 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034289963 0 0) 0x7f15b00c9450 con 0x7f15b00ca4f0 2023-08-31T18:47:59.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.837+0000 7f15aeffd700 1 -- 172.21.15.72:0/1589723497 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15980033f0 con 0x7f15b00ca4f0 2023-08-31T18:47:59.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.837+0000 7f15aeffd700 1 -- 172.21.15.72:0/1589723497 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140545683 0 0) 0x7f15b00c9730 con 0x7f15b00c8ee0 2023-08-31T18:47:59.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.837+0000 7f15aeffd700 1 -- 172.21.15.72:0/1589723497 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15b00c9450 con 0x7f15b00c8ee0 2023-08-31T18:47:59.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.837+0000 7f15affff700 1 -- 172.21.15.72:0/1589723497 >> v1:172.21.15.146:6789/0 conn(0x7f15b00c8ee0 legacy=0x7f15b0158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.837+0000 7f15affff700 1 -- 172.21.15.72:0/1589723497 >> v1:172.21.15.72:6789/0 conn(0x7f15b00ca4f0 legacy=0x7f15b0063100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.837+0000 7f15affff700 1 -- 172.21.15.72:0/1589723497 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b00c9cf0 con 0x7f15b0153ca0 2023-08-31T18:47:59.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.837+0000 7f15affff700 1 --2- 172.21.15.72:0/1589723497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15b0153ca0 0x7f15b0154080 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f15a0009790 tx=0x7f15a0009060).ready entity=mon.2 client_cookie=e3e732ec2fe73820 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.838+0000 7f15aeffd700 1 -- 172.21.15.72:0/1589723497 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a000f510 con 0x7f15b0153ca0 2023-08-31T18:47:59.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.838+0000 7f15aeffd700 1 -- 172.21.15.72:0/1589723497 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a000f670 con 0x7f15b0153ca0 2023-08-31T18:47:59.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.838+0000 7f15aeffd700 1 -- 172.21.15.72:0/1589723497 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a000f9f0 con 0x7f15b0153ca0 2023-08-31T18:47:59.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.838+0000 7f15b69ff700 1 -- 172.21.15.72:0/1589723497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15b0153ca0 msgr2=0x7f15b0154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.838+0000 7f15b69ff700 1 --2- 172.21.15.72:0/1589723497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15b0153ca0 0x7f15b0154080 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f15a0009790 tx=0x7f15a0009060).stop 2023-08-31T18:47:59.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.838+0000 7f15b69ff700 1 -- 172.21.15.72:0/1589723497 shutdown_connections 2023-08-31T18:47:59.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.838+0000 7f15b69ff700 1 --2- 172.21.15.72:0/1589723497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15b0153ca0 0x7f15b0154080 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.838+0000 7f15b69ff700 1 -- 172.21.15.72:0/1589723497 >> 172.21.15.72:0/1589723497 conn(0x7f15b00cadb0 msgr2=0x7f15b00cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:59.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.838+0000 7f15b69ff700 1 -- 172.21.15.72:0/1589723497 shutdown_connections 2023-08-31T18:47:59.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.838+0000 7f15b69ff700 1 -- 172.21.15.72:0/1589723497 wait complete. 2023-08-31T18:47:59.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.840+0000 7f15b69ff700 1 Processor -- start 2023-08-31T18:47:59.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.840+0000 7f15b69ff700 1 -- start start 2023-08-31T18:47:59.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.841+0000 7f15b69ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15b00c8ee0 0x7f15b01545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.841+0000 7f15b69ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15b00ca4f0 0x7f15b0156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.841+0000 7f15b69ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15b0153ca0 0x7f15b0156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.841+0000 7f15b69ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b014de90 con 0x7f15b00ca4f0 2023-08-31T18:47:59.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.841+0000 7f15b69ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b00c3dc0 con 0x7f15b00c8ee0 2023-08-31T18:47:59.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.841+0000 7f15b69ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b00c31b0 con 0x7f15b0153ca0 2023-08-31T18:47:59.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.841+0000 7f15af7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15b00ca4f0 0x7f15b0156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.841+0000 7f15af7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15b00ca4f0 0x7f15b0156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52828/0 (socket says 172.21.15.72:52828) 2023-08-31T18:47:59.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.841+0000 7f15af7fe700 1 -- 172.21.15.72:0/3474774587 learned_addr learned my addr 172.21.15.72:0/3474774587 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:47:59.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.841+0000 7f15af7fe700 1 -- 172.21.15.72:0/3474774587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15b0153ca0 msgr2=0x7f15b0156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.841+0000 7f15b4f9c700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15b0153ca0 0x7f15b0156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.841+0000 7f15affff700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15b00c8ee0 0x7f15b01545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.842+0000 7f15af7fe700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15b0153ca0 0x7f15b0156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.842+0000 7f15af7fe700 1 -- 172.21.15.72:0/3474774587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15b00c8ee0 msgr2=0x7f15b01545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.842+0000 7f15af7fe700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15b00c8ee0 0x7f15b01545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.842+0000 7f15af7fe700 1 -- 172.21.15.72:0/3474774587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a00092a0 con 0x7f15b00ca4f0 2023-08-31T18:47:59.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.842+0000 7f15affff700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15b00c8ee0 0x7f15b01545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:47:59.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.842+0000 7f15b4f9c700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15b0153ca0 0x7f15b0156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:47:59.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.842+0000 7f15af7fe700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15b00ca4f0 0x7f15b0156220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f15a400c490 tx=0x7f15a4007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.842+0000 7f1597fff700 1 -- 172.21.15.72:0/3474774587 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a400f470 con 0x7f15b00ca4f0 2023-08-31T18:47:59.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.842+0000 7f1597fff700 1 -- 172.21.15.72:0/3474774587 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a400f5d0 con 0x7f15b00ca4f0 2023-08-31T18:47:59.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.842+0000 7f1597fff700 1 -- 172.21.15.72:0/3474774587 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a400f990 con 0x7f15b00ca4f0 2023-08-31T18:47:59.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.842+0000 7f15b69ff700 1 -- 172.21.15.72:0/3474774587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b00c3490 con 0x7f15b00ca4f0 2023-08-31T18:47:59.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.842+0000 7f15b69ff700 1 -- 172.21.15.72:0/3474774587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b00c3a50 con 0x7f15b00ca4f0 2023-08-31T18:47:59.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.843+0000 7f15b69ff700 1 -- 172.21.15.72:0/3474774587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15b006c6b0 con 0x7f15b00ca4f0 2023-08-31T18:47:59.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.844+0000 7f1597fff700 1 -- 172.21.15.72:0/3474774587 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f15a400fd40 con 0x7f15b00ca4f0 2023-08-31T18:47:59.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.844+0000 7f1597fff700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f159c05ee10 0x7f159c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.845+0000 7f1597fff700 1 -- 172.21.15.72:0/3474774587 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f15a4079500 con 0x7f15b00ca4f0 2023-08-31T18:47:59.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.845+0000 7f15affff700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f159c05ee10 0x7f159c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.845+0000 7f1597fff700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.72:6809/143821,v1:172.21.15.72:6812/143821] conn(0x7f159c0681b0 0x7f159c06a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:47:59.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.845+0000 7f1597fff700 1 -- 172.21.15.72:0/3474774587 --> [v2:172.21.15.72:6809/143821,v1:172.21.15.72:6812/143821] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f159c06ac90 con 0x7f159c0681b0 2023-08-31T18:47:59.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.845+0000 7f1597fff700 1 -- 172.21.15.72:0/3474774587 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15a407ba60 con 0x7f15b00ca4f0 2023-08-31T18:47:59.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.845+0000 7f15b4f9c700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.72:6809/143821,v1:172.21.15.72:6812/143821] conn(0x7f159c0681b0 0x7f159c06a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:47:59.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.845+0000 7f15affff700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f159c05ee10 0x7f159c0612d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f15a00096e0 tx=0x7f15a0017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.845+0000 7f15b4f9c700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.72:6809/143821,v1:172.21.15.72:6812/143821] conn(0x7f159c0681b0 0x7f159c06a610 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:47:59.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.846+0000 7f1597fff700 1 -- 172.21.15.72:0/3474774587 <== osd.3 v2:172.21.15.72:6809/143821 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f159c06ac90 con 0x7f159c0681b0 2023-08-31T18:47:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.861+0000 7f15b69ff700 1 -- 172.21.15.72:0/3474774587 --> [v2:172.21.15.72:6809/143821,v1:172.21.15.72:6812/143821] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f15b00c9fd0 con 0x7f159c0681b0 2023-08-31T18:47:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.861+0000 7f1597fff700 1 -- 172.21.15.72:0/3474774587 <== osd.3 v2:172.21.15.72:6809/143821 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f15b00c9fd0 con 0x7f159c0681b0 2023-08-31T18:47:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.862+0000 7f15b69ff700 1 -- 172.21.15.72:0/3474774587 >> [v2:172.21.15.72:6809/143821,v1:172.21.15.72:6812/143821] conn(0x7f159c0681b0 msgr2=0x7f159c06a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.862+0000 7f15b69ff700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.72:6809/143821,v1:172.21.15.72:6812/143821] conn(0x7f159c0681b0 0x7f159c06a610 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:47:59.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.862+0000 7f15b69ff700 1 -- 172.21.15.72:0/3474774587 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f159c05ee10 msgr2=0x7f159c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.862+0000 7f15b69ff700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f159c05ee10 0x7f159c0612d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f15a00096e0 tx=0x7f15a0017000).stop 2023-08-31T18:47:59.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.862+0000 7f15b69ff700 1 -- 172.21.15.72:0/3474774587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15b00ca4f0 msgr2=0x7f15b0156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:47:59.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.862+0000 7f15b69ff700 1 --2- 172.21.15.72:0/3474774587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15b00ca4f0 0x7f15b0156220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f15a400c490 tx=0x7f15a4007c60).stop 2023-08-31T18:47:59.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.862+0000 7f15b4f9c700 1 -- 172.21.15.72:0/3474774587 reap_dead start 2023-08-31T18:47:59.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.862+0000 7f15b69ff700 1 -- 172.21.15.72:0/3474774587 shutdown_connections 2023-08-31T18:47:59.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.862+0000 7f15b69ff700 1 -- 172.21.15.72:0/3474774587 >> 172.21.15.72:0/3474774587 conn(0x7f15b00cadb0 msgr2=0x7f15b00bfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:47:59.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.862+0000 7f15b69ff700 1 -- 172.21.15.72:0/3474774587 shutdown_connections 2023-08-31T18:47:59.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:47:59.862+0000 7f15b69ff700 1 -- 172.21.15.72:0/3474774587 wait complete. 2023-08-31T18:47:59.878 INFO:teuthology.orchestra.run.smithi072.stdout:55834574852 2023-08-31T18:47:59.879 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-31T18:48:00.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.069+0000 7fe6bb3ff700 1 Processor -- start 2023-08-31T18:48:00.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.069+0000 7fe6bb3ff700 1 -- start start 2023-08-31T18:48:00.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.070+0000 7fe6bb3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6b40c8ee0 0x7fe6b4154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.070+0000 7fe6bb3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b40ca4f0 0x7fe6b4063100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.070+0000 7fe6bb3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b40c9450 con 0x7fe6b4153ca0 2023-08-31T18:48:00.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.070+0000 7fe6bb3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b40c9730 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.070+0000 7fe6bb3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40c9a10 con 0x7fe6b40ca4f0 2023-08-31T18:48:00.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.070+0000 7fe6b899a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6b40c8ee0 0x7fe6b4154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.070+0000 7fe6b919b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe6b4153ca0 0x7fe6b4158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44444/0 (socket says 172.21.15.72:44444) 2023-08-31T18:48:00.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.070+0000 7fe6b919b700 1 -- 172.21.15.72:0/1135346573 learned_addr learned my addr 172.21.15.72:0/1135346573 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:00.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.071+0000 7fe6b999c700 1 --2- 172.21.15.72:0/1135346573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b40ca4f0 0x7fe6b4063100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.071+0000 7fe6b899a700 1 -- 172.21.15.72:0/1135346573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b40ca4f0 msgr2=0x7fe6b4063100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:00.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.071+0000 7fe6b899a700 1 --2- 172.21.15.72:0/1135346573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b40ca4f0 0x7fe6b4063100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.071+0000 7fe6b899a700 1 -- 172.21.15.72:0/1135346573 >> v1:172.21.15.72:6789/0 conn(0x7fe6b4153ca0 legacy=0x7fe6b4158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.071+0000 7fe6b899a700 1 -- 172.21.15.72:0/1135346573 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b40c9cf0 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.071+0000 7fe6abfff700 1 -- 172.21.15.72:0/1135346573 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761510043 0 0) 0x7fe6b40c9450 con 0x7fe6b4153ca0 2023-08-31T18:48:00.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.071+0000 7fe6b899a700 1 --2- 172.21.15.72:0/1135346573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b40c8ee0 0x7fe6b4154080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fe6a4009760 tx=0x7fe6a4009060).ready entity=mon.0 client_cookie=d5690d27721c6f50 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.071+0000 7fe6abfff700 1 -- 172.21.15.72:0/1135346573 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a400b580 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.071+0000 7fe6abfff700 1 -- 172.21.15.72:0/1135346573 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a400b6e0 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.071+0000 7fe6abfff700 1 -- 172.21.15.72:0/1135346573 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a400ba60 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.072+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1135346573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b40c8ee0 msgr2=0x7fe6b4154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.072+0000 7fe6bb3ff700 1 --2- 172.21.15.72:0/1135346573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b40c8ee0 0x7fe6b4154080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fe6a4009760 tx=0x7fe6a4009060).stop 2023-08-31T18:48:00.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.072+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1135346573 shutdown_connections 2023-08-31T18:48:00.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.072+0000 7fe6bb3ff700 1 --2- 172.21.15.72:0/1135346573 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b40ca4f0 0x7fe6b4063100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.072+0000 7fe6bb3ff700 1 --2- 172.21.15.72:0/1135346573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b40c8ee0 0x7fe6b4154080 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.072+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1135346573 >> 172.21.15.72:0/1135346573 conn(0x7fe6b40cadb0 msgr2=0x7fe6b40cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:00.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.072+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1135346573 shutdown_connections 2023-08-31T18:48:00.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.072+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1135346573 wait complete. 2023-08-31T18:48:00.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.073+0000 7fe6bb3ff700 1 Processor -- start 2023-08-31T18:48:00.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.073+0000 7fe6bb3ff700 1 -- start start 2023-08-31T18:48:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.074+0000 7fe6bb3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b40c8ee0 0x7fe6b40add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.074+0000 7fe6bb3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b40ca4f0 0x7fe6b414e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.074+0000 7fe6bb3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b4153ca0 0x7fe6b40afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.074+0000 7fe6bb3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b41655e0 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.074+0000 7fe6bb3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b4164a60 con 0x7fe6b40ca4f0 2023-08-31T18:48:00.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.074+0000 7fe6bb3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b4164d40 con 0x7fe6b4153ca0 2023-08-31T18:48:00.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.075+0000 7fe6b919b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b40c8ee0 0x7fe6b40add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.075+0000 7fe6b919b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b40c8ee0 0x7fe6b40add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52846/0 (socket says 172.21.15.72:52846) 2023-08-31T18:48:00.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.075+0000 7fe6b919b700 1 -- 172.21.15.72:0/1204866929 learned_addr learned my addr 172.21.15.72:0/1204866929 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.075+0000 7fe6b899a700 1 --2- 172.21.15.72:0/1204866929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b40ca4f0 0x7fe6b414e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.075+0000 7fe6b999c700 1 --2- 172.21.15.72:0/1204866929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b4153ca0 0x7fe6b40afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.075+0000 7fe6b919b700 1 -- 172.21.15.72:0/1204866929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b4153ca0 msgr2=0x7fe6b40afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.075+0000 7fe6b919b700 1 --2- 172.21.15.72:0/1204866929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6b4153ca0 0x7fe6b40afe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.075+0000 7fe6b919b700 1 -- 172.21.15.72:0/1204866929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b40ca4f0 msgr2=0x7fe6b414e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.075+0000 7fe6b919b700 1 --2- 172.21.15.72:0/1204866929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b40ca4f0 0x7fe6b414e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.075+0000 7fe6b919b700 1 -- 172.21.15.72:0/1204866929 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a40092a0 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.075+0000 7fe6b919b700 1 --2- 172.21.15.72:0/1204866929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b40c8ee0 0x7fe6b40add60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fe6b0001eb0 tx=0x7fe6b0007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.075+0000 7fe6a97fa700 1 -- 172.21.15.72:0/1204866929 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b000ce90 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.075+0000 7fe6a97fa700 1 -- 172.21.15.72:0/1204866929 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b00072e0 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.076+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1204866929 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b4165020 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.076+0000 7fe6a97fa700 1 -- 172.21.15.72:0/1204866929 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0007680 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.076+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1204866929 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b414edb0 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.076+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1204866929 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe6b406c6b0 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.077+0000 7fe6a97fa700 1 -- 172.21.15.72:0/1204866929 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fe6b00059b0 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.078+0000 7fe6a97fa700 1 --2- 172.21.15.72:0/1204866929 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe69805ee10 0x7fe6980612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.078+0000 7fe6a97fa700 1 -- 172.21.15.72:0/1204866929 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe6b0079710 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.079+0000 7fe6b899a700 1 --2- 172.21.15.72:0/1204866929 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe69805ee10 0x7fe6980612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.079+0000 7fe6a97fa700 1 --2- 172.21.15.72:0/1204866929 >> [v2:172.21.15.146:6817/143461,v1:172.21.15.146:6820/143461] conn(0x7fe698068040 0x7fe69806a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.079+0000 7fe6a97fa700 1 -- 172.21.15.72:0/1204866929 --> [v2:172.21.15.146:6817/143461,v1:172.21.15.146:6820/143461] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe69806ab20 con 0x7fe698068040 2023-08-31T18:48:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.079+0000 7fe6a97fa700 1 -- 172.21.15.72:0/1204866929 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6b007bc70 con 0x7fe6b40c8ee0 2023-08-31T18:48:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.079+0000 7fe6b899a700 1 --2- 172.21.15.72:0/1204866929 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe69805ee10 0x7fe6980612d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe6a400b340 tx=0x7fe6a4017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.079+0000 7fe6b999c700 1 --2- 172.21.15.72:0/1204866929 >> [v2:172.21.15.146:6817/143461,v1:172.21.15.146:6820/143461] conn(0x7fe698068040 0x7fe69806a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.080+0000 7fe6b999c700 1 --2- 172.21.15.72:0/1204866929 >> [v2:172.21.15.146:6817/143461,v1:172.21.15.146:6820/143461] conn(0x7fe698068040 0x7fe69806a4a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.081+0000 7fe6a97fa700 1 -- 172.21.15.72:0/1204866929 <== osd.4 v2:172.21.15.146:6817/143461 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fe69806ab20 con 0x7fe698068040 2023-08-31T18:48:00.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.095+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1204866929 --> [v2:172.21.15.146:6817/143461,v1:172.21.15.146:6820/143461] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe6b40c9fd0 con 0x7fe698068040 2023-08-31T18:48:00.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.096+0000 7fe6a97fa700 1 -- 172.21.15.72:0/1204866929 <== osd.4 v2:172.21.15.146:6817/143461 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe6b40c9fd0 con 0x7fe698068040 2023-08-31T18:48:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.096+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1204866929 >> [v2:172.21.15.146:6817/143461,v1:172.21.15.146:6820/143461] conn(0x7fe698068040 msgr2=0x7fe69806a4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.096+0000 7fe6bb3ff700 1 --2- 172.21.15.72:0/1204866929 >> [v2:172.21.15.146:6817/143461,v1:172.21.15.146:6820/143461] conn(0x7fe698068040 0x7fe69806a4a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.097+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1204866929 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe69805ee10 msgr2=0x7fe6980612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.097+0000 7fe6bb3ff700 1 --2- 172.21.15.72:0/1204866929 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe69805ee10 0x7fe6980612d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe6a400b340 tx=0x7fe6a4017000).stop 2023-08-31T18:48:00.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.097+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1204866929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b40c8ee0 msgr2=0x7fe6b40add60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.097+0000 7fe6bb3ff700 1 --2- 172.21.15.72:0/1204866929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b40c8ee0 0x7fe6b40add60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fe6b0001eb0 tx=0x7fe6b0007e90).stop 2023-08-31T18:48:00.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.097+0000 7fe6b999c700 1 -- 172.21.15.72:0/1204866929 reap_dead start 2023-08-31T18:48:00.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.097+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1204866929 shutdown_connections 2023-08-31T18:48:00.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.097+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1204866929 >> 172.21.15.72:0/1204866929 conn(0x7fe6b40cadb0 msgr2=0x7fe6b40ad110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:00.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.097+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1204866929 shutdown_connections 2023-08-31T18:48:00.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.097+0000 7fe6bb3ff700 1 -- 172.21.15.72:0/1204866929 wait complete. 2023-08-31T18:48:00.113 INFO:teuthology.orchestra.run.smithi072.stdout:55834574852 2023-08-31T18:48:00.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-31T18:48:00.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.302+0000 7f38c35ff700 1 Processor -- start 2023-08-31T18:48:00.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.302+0000 7f38c35ff700 1 -- start start 2023-08-31T18:48:00.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.304+0000 7f38c35ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f38bc0c8ee0 0x7f38bc154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.304+0000 7f38c35ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38bc0ca4f0 0x7f38bc063100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.304+0000 7f38c35ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38bc0c9450 con 0x7f38bc153ca0 2023-08-31T18:48:00.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.304+0000 7f38c35ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38bc0c9730 con 0x7f38bc0c8ee0 2023-08-31T18:48:00.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.304+0000 7f38c35ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc0c9a10 con 0x7f38bc0ca4f0 2023-08-31T18:48:00.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.304+0000 7f38c0b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f38bc0c8ee0 0x7f38bc154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.304+0000 7f38c0b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f38bc0c8ee0 0x7f38bc154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52860/0 (socket says 172.21.15.72:52860) 2023-08-31T18:48:00.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.304+0000 7f38c0b9a700 1 -- 172.21.15.72:0/2675891449 learned_addr learned my addr 172.21.15.72:0/2675891449 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:00.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.304+0000 7f38c1b9c700 1 --2- 172.21.15.72:0/2675891449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38bc0ca4f0 0x7f38bc063100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.304+0000 7f38c0b9a700 1 -- 172.21.15.72:0/2675891449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38bc0ca4f0 msgr2=0x7f38bc063100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:00.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.304+0000 7f38c0b9a700 1 --2- 172.21.15.72:0/2675891449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38bc0ca4f0 0x7f38bc063100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.304+0000 7f38c0b9a700 1 -- 172.21.15.72:0/2675891449 >> v1:172.21.15.146:6789/0 conn(0x7f38bc153ca0 legacy=0x7f38bc158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.304+0000 7f38c0b9a700 1 -- 172.21.15.72:0/2675891449 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc0c9cf0 con 0x7f38bc0c8ee0 2023-08-31T18:48:00.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.304+0000 7f38c0b9a700 1 --2- 172.21.15.72:0/2675891449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38bc0c8ee0 0x7f38bc154080 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f38ac006fd0 tx=0x7f38ac0090f0).ready entity=mon.0 client_cookie=5bb85c6f5a992b69 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.305+0000 7f38b3fff700 1 -- 172.21.15.72:0/2675891449 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac00b580 con 0x7f38bc0c8ee0 2023-08-31T18:48:00.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.305+0000 7f38b3fff700 1 -- 172.21.15.72:0/2675891449 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ac00b6e0 con 0x7f38bc0c8ee0 2023-08-31T18:48:00.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.305+0000 7f38b3fff700 1 -- 172.21.15.72:0/2675891449 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac00ba60 con 0x7f38bc0c8ee0 2023-08-31T18:48:00.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.305+0000 7f38c35ff700 1 -- 172.21.15.72:0/2675891449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38bc0c8ee0 msgr2=0x7f38bc154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.305+0000 7f38c35ff700 1 --2- 172.21.15.72:0/2675891449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38bc0c8ee0 0x7f38bc154080 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f38ac006fd0 tx=0x7f38ac0090f0).stop 2023-08-31T18:48:00.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.305+0000 7f38c35ff700 1 -- 172.21.15.72:0/2675891449 shutdown_connections 2023-08-31T18:48:00.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.305+0000 7f38c35ff700 1 --2- 172.21.15.72:0/2675891449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38bc0ca4f0 0x7f38bc063100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.305+0000 7f38c35ff700 1 --2- 172.21.15.72:0/2675891449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38bc0c8ee0 0x7f38bc154080 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.305+0000 7f38c35ff700 1 -- 172.21.15.72:0/2675891449 >> 172.21.15.72:0/2675891449 conn(0x7f38bc0cadb0 msgr2=0x7f38bc0cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:00.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.305+0000 7f38c35ff700 1 -- 172.21.15.72:0/2675891449 shutdown_connections 2023-08-31T18:48:00.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.305+0000 7f38c35ff700 1 -- 172.21.15.72:0/2675891449 wait complete. 2023-08-31T18:48:00.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.307+0000 7f38c35ff700 1 Processor -- start 2023-08-31T18:48:00.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.307+0000 7f38c35ff700 1 -- start start 2023-08-31T18:48:00.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.308+0000 7f38c35ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38bc0c8ee0 0x7f38bc0c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.308+0000 7f38c35ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38bc0ca4f0 0x7f38bc0add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.308+0000 7f38c35ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38bc153ca0 0x7f38bc14e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.308+0000 7f38c35ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc0c4cb0 con 0x7f38bc153ca0 2023-08-31T18:48:00.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.308+0000 7f38c35ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc0ae250 con 0x7f38bc0ca4f0 2023-08-31T18:48:00.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.308+0000 7f38c35ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc0af070 con 0x7f38bc0c8ee0 2023-08-31T18:48:00.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.308+0000 7f38c1b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38bc153ca0 0x7f38bc14e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.308+0000 7f38c1b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38bc153ca0 0x7f38bc14e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52862/0 (socket says 172.21.15.72:52862) 2023-08-31T18:48:00.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.308+0000 7f38c1b9c700 1 -- 172.21.15.72:0/410903974 learned_addr learned my addr 172.21.15.72:0/410903974 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:00.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.309+0000 7f38c1b9c700 1 -- 172.21.15.72:0/410903974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38bc0c8ee0 msgr2=0x7f38bc0c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.309+0000 7f38c0b9a700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38bc0ca4f0 0x7f38bc0add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.309+0000 7f38c139b700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38bc0c8ee0 0x7f38bc0c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.309+0000 7f38c1b9c700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38bc0c8ee0 0x7f38bc0c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.309+0000 7f38c1b9c700 1 -- 172.21.15.72:0/410903974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38bc0ca4f0 msgr2=0x7f38bc0add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.309+0000 7f38c1b9c700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38bc0ca4f0 0x7f38bc0add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.309+0000 7f38c1b9c700 1 -- 172.21.15.72:0/410903974 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac009370 con 0x7f38bc153ca0 2023-08-31T18:48:00.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.309+0000 7f38c0b9a700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38bc0ca4f0 0x7f38bc0add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:00.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.309+0000 7f38c139b700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f38bc0c8ee0 0x7f38bc0c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:00.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.309+0000 7f38c1b9c700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38bc153ca0 0x7f38bc14e6b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f38b4009e90 tx=0x7f38b400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.309+0000 7f38b17fa700 1 -- 172.21.15.72:0/410903974 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b400cc20 con 0x7f38bc153ca0 2023-08-31T18:48:00.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.309+0000 7f38b17fa700 1 -- 172.21.15.72:0/410903974 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b400f040 con 0x7f38bc153ca0 2023-08-31T18:48:00.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.309+0000 7f38b17fa700 1 -- 172.21.15.72:0/410903974 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4013400 con 0x7f38bc153ca0 2023-08-31T18:48:00.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.309+0000 7f38c35ff700 1 -- 172.21.15.72:0/410903974 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38bc0ae460 con 0x7f38bc153ca0 2023-08-31T18:48:00.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.309+0000 7f38c35ff700 1 -- 172.21.15.72:0/410903974 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38bc0aea20 con 0x7f38bc153ca0 2023-08-31T18:48:00.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.310+0000 7f38c35ff700 1 -- 172.21.15.72:0/410903974 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38bc06c6b0 con 0x7f38bc153ca0 2023-08-31T18:48:00.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.311+0000 7f38b17fa700 1 -- 172.21.15.72:0/410903974 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f38b40137b0 con 0x7f38bc153ca0 2023-08-31T18:48:00.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.312+0000 7f38b17fa700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f38a005ee10 0x7f38a00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.312+0000 7f38b17fa700 1 -- 172.21.15.72:0/410903974 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f38b407a6f0 con 0x7f38bc153ca0 2023-08-31T18:48:00.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.312+0000 7f38c139b700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f38a005ee10 0x7f38a00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.312+0000 7f38b17fa700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.146:6800/143459,v1:172.21.15.146:6801/143459] conn(0x7f38a00681b0 0x7f38a006a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.312+0000 7f38b17fa700 1 -- 172.21.15.72:0/410903974 --> [v2:172.21.15.146:6800/143459,v1:172.21.15.146:6801/143459] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f38a006ac90 con 0x7f38a00681b0 2023-08-31T18:48:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.312+0000 7f38b17fa700 1 -- 172.21.15.72:0/410903974 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38b407cd10 con 0x7f38bc153ca0 2023-08-31T18:48:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.313+0000 7f38c139b700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f38a005ee10 0x7f38a00612d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f38bc151200 tx=0x7f38b8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.313+0000 7f38c0b9a700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.146:6800/143459,v1:172.21.15.146:6801/143459] conn(0x7f38a00681b0 0x7f38a006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.313+0000 7f38c0b9a700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.146:6800/143459,v1:172.21.15.146:6801/143459] conn(0x7f38a00681b0 0x7f38a006a610 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.314+0000 7f38b17fa700 1 -- 172.21.15.72:0/410903974 <== osd.5 v2:172.21.15.146:6800/143459 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f38a006ac90 con 0x7f38a00681b0 2023-08-31T18:48:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.329+0000 7f38c35ff700 1 -- 172.21.15.72:0/410903974 --> [v2:172.21.15.146:6800/143459,v1:172.21.15.146:6801/143459] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f38bc0c9fd0 con 0x7f38a00681b0 2023-08-31T18:48:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.329+0000 7f38b17fa700 1 -- 172.21.15.72:0/410903974 <== osd.5 v2:172.21.15.146:6800/143459 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f38bc0c9fd0 con 0x7f38a00681b0 2023-08-31T18:48:00.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.330+0000 7f38c35ff700 1 -- 172.21.15.72:0/410903974 >> [v2:172.21.15.146:6800/143459,v1:172.21.15.146:6801/143459] conn(0x7f38a00681b0 msgr2=0x7f38a006a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.330+0000 7f38c35ff700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.146:6800/143459,v1:172.21.15.146:6801/143459] conn(0x7f38a00681b0 0x7f38a006a610 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.330+0000 7f38c35ff700 1 -- 172.21.15.72:0/410903974 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f38a005ee10 msgr2=0x7f38a00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.330+0000 7f38c35ff700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f38a005ee10 0x7f38a00612d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f38bc151200 tx=0x7f38b8009040).stop 2023-08-31T18:48:00.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.330+0000 7f38c35ff700 1 -- 172.21.15.72:0/410903974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38bc153ca0 msgr2=0x7f38bc14e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.330+0000 7f38c35ff700 1 --2- 172.21.15.72:0/410903974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38bc153ca0 0x7f38bc14e6b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f38b4009e90 tx=0x7f38b400b040).stop 2023-08-31T18:48:00.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.330+0000 7f38c1b9c700 1 -- 172.21.15.72:0/410903974 reap_dead start 2023-08-31T18:48:00.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.330+0000 7f38c35ff700 1 -- 172.21.15.72:0/410903974 shutdown_connections 2023-08-31T18:48:00.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.330+0000 7f38c35ff700 1 -- 172.21.15.72:0/410903974 >> 172.21.15.72:0/410903974 conn(0x7f38bc0cadb0 msgr2=0x7f38bc0ad1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:00.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.330+0000 7f38c35ff700 1 -- 172.21.15.72:0/410903974 shutdown_connections 2023-08-31T18:48:00.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.330+0000 7f38c35ff700 1 -- 172.21.15.72:0/410903974 wait complete. 2023-08-31T18:48:00.346 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2023-08-31T18:48:00.347 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-31T18:48:00.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.537+0000 7f31249ff700 1 Processor -- start 2023-08-31T18:48:00.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.537+0000 7f31249ff700 1 -- start start 2023-08-31T18:48:00.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.538+0000 7f31249ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31200ad1b0 0x7f31200ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.538+0000 7f31249ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3120157c10 0x7f3120155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.538+0000 7f31249ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31200c6130 con 0x7f31200630b0 2023-08-31T18:48:00.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.538+0000 7f31249ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31200c0350 con 0x7f3120157c10 2023-08-31T18:48:00.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.538+0000 7f31249ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31201580b0 con 0x7f31200ad1b0 2023-08-31T18:48:00.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.538+0000 7f311dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3120157c10 0x7f3120155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.538+0000 7f311dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3120157c10 0x7f3120155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52878/0 (socket says 172.21.15.72:52878) 2023-08-31T18:48:00.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.539+0000 7f311dd9b700 1 -- 172.21.15.72:0/2729442045 learned_addr learned my addr 172.21.15.72:0/2729442045 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:00.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.539+0000 7f311e59c700 1 --2- 172.21.15.72:0/2729442045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31200ad1b0 0x7f31200ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.539+0000 7f311dd9b700 1 -- 172.21.15.72:0/2729442045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31200ad1b0 msgr2=0x7f31200ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:00.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.539+0000 7f311dd9b700 1 --2- 172.21.15.72:0/2729442045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31200ad1b0 0x7f31200ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.539+0000 7f311dd9b700 1 -- 172.21.15.72:0/2729442045 >> v1:172.21.15.146:6789/0 conn(0x7f31200630b0 legacy=0x7f31200a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.539+0000 7f311dd9b700 1 -- 172.21.15.72:0/2729442045 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3120155560 con 0x7f3120157c10 2023-08-31T18:48:00.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.539+0000 7f311dd9b700 1 --2- 172.21.15.72:0/2729442045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120157c10 0x7f3120155070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f3114006fd0 tx=0x7f31140090f0).ready entity=mon.0 client_cookie=c1479e048493518c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.539+0000 7f311d59a700 1 -- 172.21.15.72:0/2729442045 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311400b600 con 0x7f3120157c10 2023-08-31T18:48:00.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.539+0000 7f311d59a700 1 -- 172.21.15.72:0/2729442045 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311400b760 con 0x7f3120157c10 2023-08-31T18:48:00.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.539+0000 7f311d59a700 1 -- 172.21.15.72:0/2729442045 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311400bae0 con 0x7f3120157c10 2023-08-31T18:48:00.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.540+0000 7f31249ff700 1 -- 172.21.15.72:0/2729442045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120157c10 msgr2=0x7f3120155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.540+0000 7f31249ff700 1 --2- 172.21.15.72:0/2729442045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120157c10 0x7f3120155070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f3114006fd0 tx=0x7f31140090f0).stop 2023-08-31T18:48:00.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.540+0000 7f31249ff700 1 -- 172.21.15.72:0/2729442045 shutdown_connections 2023-08-31T18:48:00.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.540+0000 7f31249ff700 1 --2- 172.21.15.72:0/2729442045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31200ad1b0 0x7f31200ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.540+0000 7f31249ff700 1 --2- 172.21.15.72:0/2729442045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3120157c10 0x7f3120155070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.540+0000 7f31249ff700 1 -- 172.21.15.72:0/2729442045 >> 172.21.15.72:0/2729442045 conn(0x7f312005eb60 msgr2=0x7f31200cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.540+0000 7f31249ff700 1 -- 172.21.15.72:0/2729442045 shutdown_connections 2023-08-31T18:48:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.540+0000 7f31249ff700 1 -- 172.21.15.72:0/2729442045 wait complete. 2023-08-31T18:48:00.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.541+0000 7f31249ff700 1 Processor -- start 2023-08-31T18:48:00.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.542+0000 7f31249ff700 1 -- start start 2023-08-31T18:48:00.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.542+0000 7f31249ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31200630b0 0x7f3120163410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.542+0000 7f31249ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31200ad1b0 0x7f3120159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.542+0000 7f31249ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3120157c10 0x7f31200ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.542+0000 7f31249ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3120163900 con 0x7f31200630b0 2023-08-31T18:48:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.542+0000 7f31249ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31200acd80 con 0x7f3120157c10 2023-08-31T18:48:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.543+0000 7f31249ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3120159f40 con 0x7f31200ad1b0 2023-08-31T18:48:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.543+0000 7f311e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31200630b0 0x7f3120163410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.543+0000 7f311e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31200630b0 0x7f3120163410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52882/0 (socket says 172.21.15.72:52882) 2023-08-31T18:48:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.543+0000 7f311e59c700 1 -- 172.21.15.72:0/3824749834 learned_addr learned my addr 172.21.15.72:0/3824749834 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.543+0000 7f311dd9b700 1 --2- 172.21.15.72:0/3824749834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31200ad1b0 0x7f3120159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.543+0000 7f311ed9d700 1 --2- 172.21.15.72:0/3824749834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3120157c10 0x7f31200ab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.543+0000 7f311e59c700 1 -- 172.21.15.72:0/3824749834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31200ad1b0 msgr2=0x7f3120159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.543+0000 7f311e59c700 1 --2- 172.21.15.72:0/3824749834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31200ad1b0 0x7f3120159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.543+0000 7f311e59c700 1 -- 172.21.15.72:0/3824749834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3120157c10 msgr2=0x7f31200ab9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.543+0000 7f311e59c700 1 --2- 172.21.15.72:0/3824749834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3120157c10 0x7f31200ab9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.543+0000 7f311e59c700 1 -- 172.21.15.72:0/3824749834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3114009370 con 0x7f31200630b0 2023-08-31T18:48:00.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.543+0000 7f311ed9d700 1 --2- 172.21.15.72:0/3824749834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3120157c10 0x7f31200ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:00.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.543+0000 7f311e59c700 1 --2- 172.21.15.72:0/3824749834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31200630b0 0x7f3120163410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f311000d890 tx=0x7f3110008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.543+0000 7f310e7fc700 1 -- 172.21.15.72:0/3824749834 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31100125f0 con 0x7f31200630b0 2023-08-31T18:48:00.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.544+0000 7f310e7fc700 1 -- 172.21.15.72:0/3824749834 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3110012750 con 0x7f31200630b0 2023-08-31T18:48:00.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.544+0000 7f31249ff700 1 -- 172.21.15.72:0/3824749834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31200abec0 con 0x7f31200630b0 2023-08-31T18:48:00.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.544+0000 7f310e7fc700 1 -- 172.21.15.72:0/3824749834 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3110012ad0 con 0x7f31200630b0 2023-08-31T18:48:00.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.544+0000 7f31249ff700 1 -- 172.21.15.72:0/3824749834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31200ac450 con 0x7f31200630b0 2023-08-31T18:48:00.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.544+0000 7f31249ff700 1 -- 172.21.15.72:0/3824749834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f312006c6b0 con 0x7f31200630b0 2023-08-31T18:48:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.545+0000 7f310e7fc700 1 -- 172.21.15.72:0/3824749834 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3110013480 con 0x7f31200630b0 2023-08-31T18:48:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.546+0000 7f310e7fc700 1 --2- 172.21.15.72:0/3824749834 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f310005ee10 0x7f31000612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.546+0000 7f310e7fc700 1 -- 172.21.15.72:0/3824749834 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3110079fd0 con 0x7f31200630b0 2023-08-31T18:48:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.546+0000 7f311dd9b700 1 --2- 172.21.15.72:0/3824749834 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f310005ee10 0x7f31000612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.546+0000 7f310e7fc700 1 --2- 172.21.15.72:0/3824749834 >> [v2:172.21.15.146:6816/143472,v1:172.21.15.146:6818/143472] conn(0x7f31000681b0 0x7f310006a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.546+0000 7f310e7fc700 1 -- 172.21.15.72:0/3824749834 --> [v2:172.21.15.146:6816/143472,v1:172.21.15.146:6818/143472] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f310006ac90 con 0x7f31000681b0 2023-08-31T18:48:00.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.546+0000 7f310e7fc700 1 -- 172.21.15.72:0/3824749834 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f311007c530 con 0x7f31200630b0 2023-08-31T18:48:00.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.547+0000 7f311dd9b700 1 --2- 172.21.15.72:0/3824749834 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f310005ee10 0x7f31000612d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3114006fd0 tx=0x7f3114017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.547+0000 7f311ed9d700 1 --2- 172.21.15.72:0/3824749834 >> [v2:172.21.15.146:6816/143472,v1:172.21.15.146:6818/143472] conn(0x7f31000681b0 0x7f310006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.547+0000 7f311ed9d700 1 --2- 172.21.15.72:0/3824749834 >> [v2:172.21.15.146:6816/143472,v1:172.21.15.146:6818/143472] conn(0x7f31000681b0 0x7f310006a610 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.548+0000 7f310e7fc700 1 -- 172.21.15.72:0/3824749834 <== osd.6 v2:172.21.15.146:6816/143472 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f310006ac90 con 0x7f31000681b0 2023-08-31T18:48:00.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.563+0000 7f31249ff700 1 -- 172.21.15.72:0/3824749834 --> [v2:172.21.15.146:6816/143472,v1:172.21.15.146:6818/143472] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f31200ac900 con 0x7f31000681b0 2023-08-31T18:48:00.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.564+0000 7f310e7fc700 1 -- 172.21.15.72:0/3824749834 <== osd.6 v2:172.21.15.146:6816/143472 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f31200ac900 con 0x7f31000681b0 2023-08-31T18:48:00.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.564+0000 7f31249ff700 1 -- 172.21.15.72:0/3824749834 >> [v2:172.21.15.146:6816/143472,v1:172.21.15.146:6818/143472] conn(0x7f31000681b0 msgr2=0x7f310006a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.564+0000 7f31249ff700 1 --2- 172.21.15.72:0/3824749834 >> [v2:172.21.15.146:6816/143472,v1:172.21.15.146:6818/143472] conn(0x7f31000681b0 0x7f310006a610 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.565+0000 7f31249ff700 1 -- 172.21.15.72:0/3824749834 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f310005ee10 msgr2=0x7f31000612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.565+0000 7f31249ff700 1 --2- 172.21.15.72:0/3824749834 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f310005ee10 0x7f31000612d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3114006fd0 tx=0x7f3114017000).stop 2023-08-31T18:48:00.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.565+0000 7f31249ff700 1 -- 172.21.15.72:0/3824749834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31200630b0 msgr2=0x7f3120163410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.565+0000 7f31249ff700 1 --2- 172.21.15.72:0/3824749834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31200630b0 0x7f3120163410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f311000d890 tx=0x7f3110008040).stop 2023-08-31T18:48:00.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.565+0000 7f311ed9d700 1 -- 172.21.15.72:0/3824749834 reap_dead start 2023-08-31T18:48:00.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.565+0000 7f31249ff700 1 -- 172.21.15.72:0/3824749834 shutdown_connections 2023-08-31T18:48:00.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.565+0000 7f31249ff700 1 -- 172.21.15.72:0/3824749834 >> 172.21.15.72:0/3824749834 conn(0x7f312005eb60 msgr2=0x7f3120153b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:00.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.565+0000 7f31249ff700 1 -- 172.21.15.72:0/3824749834 shutdown_connections 2023-08-31T18:48:00.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.565+0000 7f31249ff700 1 -- 172.21.15.72:0/3824749834 wait complete. 2023-08-31T18:48:00.581 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2023-08-31T18:48:00.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-31T18:48:00.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.768+0000 7f3428bff700 1 Processor -- start 2023-08-31T18:48:00.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.768+0000 7f3428bff700 1 -- start start 2023-08-31T18:48:00.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.769+0000 7f3428bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3424157c10 0x7f34240ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.769+0000 7f3428bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34240c6130 con 0x7f34240ad1b0 2023-08-31T18:48:00.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.769+0000 7f3428bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34241580b0 con 0x7f34240637c0 2023-08-31T18:48:00.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.769+0000 7f3428bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34240c0350 con 0x7f3424157c10 2023-08-31T18:48:00.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.769+0000 7f342259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f34240ad1b0 0x7f34240630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44456/0 (socket says 172.21.15.72:44456) 2023-08-31T18:48:00.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.769+0000 7f342259c700 1 -- 172.21.15.72:0/153343391 learned_addr learned my addr 172.21.15.72:0/153343391 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:00.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f3421d9b700 1 --2- 172.21.15.72:0/153343391 >> v2:172.21.15.146:3300/0 conn(0x7f3424157c10 0x7f34240ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342159a700 1 -- 172.21.15.72:0/153343391 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689860806 0 0) 0x7f34240c6130 con 0x7f34240ad1b0 2023-08-31T18:48:00.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342159a700 1 -- 172.21.15.72:0/153343391 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f340c0033f0 con 0x7f34240ad1b0 2023-08-31T18:48:00.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342159a700 1 -- 172.21.15.72:0/153343391 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4171564463 0 0) 0x7f340c0033f0 con 0x7f34240ad1b0 2023-08-31T18:48:00.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342159a700 1 -- 172.21.15.72:0/153343391 >> v2:172.21.15.146:3300/0 conn(0x7f3424157c10 msgr2=0x7f34240ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:00.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342159a700 1 --2- 172.21.15.72:0/153343391 >> v2:172.21.15.146:3300/0 conn(0x7f3424157c10 0x7f34240ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342159a700 1 -- 172.21.15.72:0/153343391 >> v1:172.21.15.146:6789/0 conn(0x7f34240637c0 legacy=0x7f34240a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342159a700 1 -- 172.21.15.72:0/153343391 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3424158350 con 0x7f34240ad1b0 2023-08-31T18:48:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342159a700 1 -- 172.21.15.72:0/153343391 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f3414001470 con 0x7f34240ad1b0 2023-08-31T18:48:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342159a700 1 -- 172.21.15.72:0/153343391 >> v1:172.21.15.72:6789/0 conn(0x7f34240ad1b0 legacy=0x7f34240630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342159a700 1 --2- 172.21.15.72:0/153343391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f340c0038e0 0x7f340c003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342159a700 1 --2- 172.21.15.72:0/153343391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340c004690 0x7f340c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342159a700 1 --2- 172.21.15.72:0/153343391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f340c005000 0x7f340c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342159a700 1 -- 172.21.15.72:0/153343391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34240c0350 con 0x7f340c0038e0 2023-08-31T18:48:00.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342159a700 1 -- 172.21.15.72:0/153343391 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c00beb0 con 0x7f340c005000 2023-08-31T18:48:00.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342159a700 1 -- 172.21.15.72:0/153343391 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340c00c070 con 0x7f340c004690 2023-08-31T18:48:00.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f3421d9b700 1 --2- 172.21.15.72:0/153343391 >> v2:172.21.15.146:3300/0 conn(0x7f3424157c10 0x7f34240ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:00.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.770+0000 7f342259c700 1 --2- 172.21.15.72:0/153343391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f340c0038e0 0x7f340c003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.771+0000 7f3422d9d700 1 --2- 172.21.15.72:0/153343391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f340c005000 0x7f340c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.771+0000 7f3421d9b700 1 --2- 172.21.15.72:0/153343391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340c004690 0x7f340c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.771+0000 7f342259c700 1 -- 172.21.15.72:0/153343391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340c004690 msgr2=0x7f340c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:00.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.771+0000 7f342259c700 1 --2- 172.21.15.72:0/153343391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f340c004690 0x7f340c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.771+0000 7f342259c700 1 -- 172.21.15.72:0/153343391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f340c005000 msgr2=0x7f340c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:00.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.771+0000 7f342259c700 1 --2- 172.21.15.72:0/153343391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f340c005000 0x7f340c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.771+0000 7f342259c700 1 -- 172.21.15.72:0/153343391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c0033f0 con 0x7f340c0038e0 2023-08-31T18:48:00.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.771+0000 7f3422d9d700 1 -- 172.21.15.72:0/153343391 reap_dead start 2023-08-31T18:48:00.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.771+0000 7f342259c700 1 --2- 172.21.15.72:0/153343391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f340c0038e0 0x7f340c003cc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f341400c1e0 tx=0x7f3424158240).ready entity=mon.0 client_cookie=c5034d1c236cf8ab server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.771+0000 7f342159a700 1 -- 172.21.15.72:0/153343391 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414007a60 con 0x7f340c0038e0 2023-08-31T18:48:00.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.771+0000 7f342159a700 1 -- 172.21.15.72:0/153343391 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341400cab0 con 0x7f340c0038e0 2023-08-31T18:48:00.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.771+0000 7f342159a700 1 -- 172.21.15.72:0/153343391 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400ce70 con 0x7f340c0038e0 2023-08-31T18:48:00.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.772+0000 7f3428bff700 1 -- 172.21.15.72:0/153343391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f340c0038e0 msgr2=0x7f340c003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.772+0000 7f3428bff700 1 --2- 172.21.15.72:0/153343391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f340c0038e0 0x7f340c003cc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f341400c1e0 tx=0x7f3424158240).stop 2023-08-31T18:48:00.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.772+0000 7f3428bff700 1 -- 172.21.15.72:0/153343391 shutdown_connections 2023-08-31T18:48:00.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.772+0000 7f3428bff700 1 --2- 172.21.15.72:0/153343391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f340c0038e0 0x7f340c003cc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.772+0000 7f3428bff700 1 -- 172.21.15.72:0/153343391 >> 172.21.15.72:0/153343391 conn(0x7f342405eb60 msgr2=0x7f34240cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:00.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.772+0000 7f3428bff700 1 -- 172.21.15.72:0/153343391 shutdown_connections 2023-08-31T18:48:00.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.772+0000 7f3428bff700 1 -- 172.21.15.72:0/153343391 wait complete. 2023-08-31T18:48:00.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.773+0000 7f3428bff700 1 Processor -- start 2023-08-31T18:48:00.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.773+0000 7f3428bff700 1 -- start start 2023-08-31T18:48:00.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.774+0000 7f3428bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f340c0038e0 0x7f3424156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.774+0000 7f3428bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3424150330 0x7f34241633c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.774+0000 7f3428bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34241638b0 0x7f3424155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.774+0000 7f3428bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3424153a80 con 0x7f34241638b0 2023-08-31T18:48:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.774+0000 7f3428bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3424151740 con 0x7f340c0038e0 2023-08-31T18:48:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.774+0000 7f3428bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3424150b30 con 0x7f3424150330 2023-08-31T18:48:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.774+0000 7f3422d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34241638b0 0x7f3424155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f3422d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34241638b0 0x7f3424155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52906/0 (socket says 172.21.15.72:52906) 2023-08-31T18:48:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f3422d9d700 1 -- 172.21.15.72:0/3976760287 learned_addr learned my addr 172.21.15.72:0/3976760287 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f3421d9b700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3424150330 0x7f34241633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f342259c700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f340c0038e0 0x7f3424156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f3422d9d700 1 -- 172.21.15.72:0/3976760287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3424150330 msgr2=0x7f34241633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f3422d9d700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3424150330 0x7f34241633c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f3422d9d700 1 -- 172.21.15.72:0/3976760287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f340c0038e0 msgr2=0x7f3424156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f3422d9d700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f340c0038e0 0x7f3424156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f3422d9d700 1 -- 172.21.15.72:0/3976760287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3424150e10 con 0x7f34241638b0 2023-08-31T18:48:00.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f3421d9b700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3424150330 0x7f34241633c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:00.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f342259c700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f340c0038e0 0x7f3424156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:00.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f3422d9d700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34241638b0 0x7f3424155d20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f3424065700 tx=0x7f341c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f34127fc700 1 -- 172.21.15.72:0/3976760287 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c006c30 con 0x7f34241638b0 2023-08-31T18:48:00.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f34127fc700 1 -- 172.21.15.72:0/3976760287 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c006d90 con 0x7f34241638b0 2023-08-31T18:48:00.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f3428bff700 1 -- 172.21.15.72:0/3976760287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34241510f0 con 0x7f34241638b0 2023-08-31T18:48:00.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f34127fc700 1 -- 172.21.15.72:0/3976760287 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c0032e0 con 0x7f34241638b0 2023-08-31T18:48:00.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.775+0000 7f3428bff700 1 -- 172.21.15.72:0/3976760287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34241507b0 con 0x7f34241638b0 2023-08-31T18:48:00.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.776+0000 7f3428bff700 1 -- 172.21.15.72:0/3976760287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f342406c6b0 con 0x7f34241638b0 2023-08-31T18:48:00.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.777+0000 7f34127fc700 1 -- 172.21.15.72:0/3976760287 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f341c0015e0 con 0x7f34241638b0 2023-08-31T18:48:00.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.778+0000 7f34127fc700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f340405ee10 0x7f34040612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.778+0000 7f34127fc700 1 -- 172.21.15.72:0/3976760287 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f341c079940 con 0x7f34241638b0 2023-08-31T18:48:00.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.778+0000 7f342259c700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f340405ee10 0x7f34040612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.778+0000 7f34127fc700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.146:6802/143460,v1:172.21.15.146:6804/143460] conn(0x7f34040681b0 0x7f340406a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:00.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.778+0000 7f34127fc700 1 -- 172.21.15.72:0/3976760287 --> [v2:172.21.15.146:6802/143460,v1:172.21.15.146:6804/143460] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f340406ac90 con 0x7f34040681b0 2023-08-31T18:48:00.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.778+0000 7f34127fc700 1 -- 172.21.15.72:0/3976760287 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f341c07e220 con 0x7f34241638b0 2023-08-31T18:48:00.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.778+0000 7f342259c700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f340405ee10 0x7f34040612d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f34140010e0 tx=0x7f3414015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.779+0000 7f3421d9b700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.146:6802/143460,v1:172.21.15.146:6804/143460] conn(0x7f34040681b0 0x7f340406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:00.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.779+0000 7f3421d9b700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.146:6802/143460,v1:172.21.15.146:6804/143460] conn(0x7f34040681b0 0x7f340406a610 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:00.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.780+0000 7f34127fc700 1 -- 172.21.15.72:0/3976760287 <== osd.7 v2:172.21.15.146:6802/143460 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f340406ac90 con 0x7f34040681b0 2023-08-31T18:48:00.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.795+0000 7f3428bff700 1 -- 172.21.15.72:0/3976760287 --> [v2:172.21.15.146:6802/143460,v1:172.21.15.146:6804/143460] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f34241518b0 con 0x7f34040681b0 2023-08-31T18:48:00.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.795+0000 7f34127fc700 1 -- 172.21.15.72:0/3976760287 <== osd.7 v2:172.21.15.146:6802/143460 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f34241518b0 con 0x7f34040681b0 2023-08-31T18:48:00.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.796+0000 7f3428bff700 1 -- 172.21.15.72:0/3976760287 >> [v2:172.21.15.146:6802/143460,v1:172.21.15.146:6804/143460] conn(0x7f34040681b0 msgr2=0x7f340406a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.796+0000 7f3428bff700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.146:6802/143460,v1:172.21.15.146:6804/143460] conn(0x7f34040681b0 0x7f340406a610 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:00.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.796+0000 7f3428bff700 1 -- 172.21.15.72:0/3976760287 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f340405ee10 msgr2=0x7f34040612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.796+0000 7f3428bff700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f340405ee10 0x7f34040612d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f34140010e0 tx=0x7f3414015000).stop 2023-08-31T18:48:00.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.796+0000 7f3428bff700 1 -- 172.21.15.72:0/3976760287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34241638b0 msgr2=0x7f3424155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:00.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.796+0000 7f3428bff700 1 --2- 172.21.15.72:0/3976760287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34241638b0 0x7f3424155d20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f3424065700 tx=0x7f341c009040).stop 2023-08-31T18:48:00.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.796+0000 7f3422d9d700 1 -- 172.21.15.72:0/3976760287 reap_dead start 2023-08-31T18:48:00.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.796+0000 7f3428bff700 1 -- 172.21.15.72:0/3976760287 shutdown_connections 2023-08-31T18:48:00.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.796+0000 7f3428bff700 1 -- 172.21.15.72:0/3976760287 >> 172.21.15.72:0/3976760287 conn(0x7f342405eb60 msgr2=0x7f34240ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:00.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.796+0000 7f3428bff700 1 -- 172.21.15.72:0/3976760287 shutdown_connections 2023-08-31T18:48:00.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:00.796+0000 7f3428bff700 1 -- 172.21.15.72:0/3976760287 wait complete. 2023-08-31T18:48:00.812 INFO:teuthology.orchestra.run.smithi072.stdout:55834574854 2023-08-31T18:48:00.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-31T18:48:01.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.002+0000 7ff53999d700 1 Processor -- start 2023-08-31T18:48:01.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.002+0000 7ff53999d700 1 -- start start 2023-08-31T18:48:01.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.004+0000 7ff53999d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff5340c5f20 0x7ff5340c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:01.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.004+0000 7ff53999d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5340c6870 0x7ff5340c9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:01.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.004+0000 7ff53999d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5340c7500 con 0x7ff534154160 2023-08-31T18:48:01.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.004+0000 7ff53999d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5340c9000 con 0x7ff5340c5f20 2023-08-31T18:48:01.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.004+0000 7ff53999d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340c6ce0 con 0x7ff5340c6870 2023-08-31T18:48:01.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.004+0000 7ff533fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff5340c5f20 0x7ff5340c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:01.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.004+0000 7ff533fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff5340c5f20 0x7ff5340c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:49196/0 (socket says 172.21.15.72:49196) 2023-08-31T18:48:01.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.004+0000 7ff533fff700 1 -- 172.21.15.72:0/2691051446 learned_addr learned my addr 172.21.15.72:0/2691051446 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:01.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.004+0000 7ff53919c700 1 --2- 172.21.15.72:0/2691051446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5340c6870 0x7ff5340c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.005+0000 7ff533fff700 1 -- 172.21.15.72:0/2691051446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5340c6870 msgr2=0x7ff5340c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.005+0000 7ff533fff700 1 --2- 172.21.15.72:0/2691051446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5340c6870 0x7ff5340c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.005+0000 7ff533fff700 1 -- 172.21.15.72:0/2691051446 >> v1:172.21.15.146:6789/0 conn(0x7ff534154160 legacy=0x7ff5340c0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.005+0000 7ff533fff700 1 -- 172.21.15.72:0/2691051446 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5340c6f40 con 0x7ff5340c5f20 2023-08-31T18:48:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.005+0000 7ff5337fe700 1 -- 172.21.15.72:0/2691051446 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290813684 0 0) 0x7ff5340c7500 con 0x7ff534154160 2023-08-31T18:48:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.005+0000 7ff533fff700 1 --2- 172.21.15.72:0/2691051446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5340c5f20 0x7ff5340c6380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7ff520006fd0 tx=0x7ff5200090f0).ready entity=mon.1 client_cookie=aaf3b770a1545490 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.005+0000 7ff5337fe700 1 -- 172.21.15.72:0/2691051446 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52000b580 con 0x7ff5340c5f20 2023-08-31T18:48:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.005+0000 7ff5337fe700 1 -- 172.21.15.72:0/2691051446 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52000b6e0 con 0x7ff5340c5f20 2023-08-31T18:48:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.005+0000 7ff5337fe700 1 -- 172.21.15.72:0/2691051446 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52000ba60 con 0x7ff5340c5f20 2023-08-31T18:48:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.006+0000 7ff53999d700 1 -- 172.21.15.72:0/2691051446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5340c5f20 msgr2=0x7ff5340c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.006+0000 7ff53999d700 1 --2- 172.21.15.72:0/2691051446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5340c5f20 0x7ff5340c6380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7ff520006fd0 tx=0x7ff5200090f0).stop 2023-08-31T18:48:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.006+0000 7ff53999d700 1 -- 172.21.15.72:0/2691051446 shutdown_connections 2023-08-31T18:48:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.006+0000 7ff53999d700 1 --2- 172.21.15.72:0/2691051446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5340c6870 0x7ff5340c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.006+0000 7ff53999d700 1 --2- 172.21.15.72:0/2691051446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5340c5f20 0x7ff5340c6380 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.006+0000 7ff53999d700 1 -- 172.21.15.72:0/2691051446 >> 172.21.15.72:0/2691051446 conn(0x7ff53405e870 msgr2=0x7ff5340cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.006+0000 7ff53999d700 1 -- 172.21.15.72:0/2691051446 shutdown_connections 2023-08-31T18:48:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.006+0000 7ff53999d700 1 -- 172.21.15.72:0/2691051446 wait complete. 2023-08-31T18:48:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.007+0000 7ff53999d700 1 Processor -- start 2023-08-31T18:48:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.008+0000 7ff53999d700 1 -- start start 2023-08-31T18:48:01.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.008+0000 7ff53999d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5340c5f20 0x7ff5340af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:01.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.008+0000 7ff53999d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5340c6870 0x7ff5340b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:01.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.008+0000 7ff53999d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff534154160 0x7ff534096750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:01.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.008+0000 7ff53999d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff534150210 con 0x7ff5340c6870 2023-08-31T18:48:01.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.008+0000 7ff53999d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340b0d50 con 0x7ff534154160 2023-08-31T18:48:01.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.008+0000 7ff53999d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340ae7c0 con 0x7ff5340c5f20 2023-08-31T18:48:01.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.009+0000 7ff533fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5340c6870 0x7ff5340b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:01.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.009+0000 7ff533fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5340c6870 0x7ff5340b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52918/0 (socket says 172.21.15.72:52918) 2023-08-31T18:48:01.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.009+0000 7ff533fff700 1 -- 172.21.15.72:0/2492588470 learned_addr learned my addr 172.21.15.72:0/2492588470 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:01.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.009+0000 7ff53899b700 1 --2- 172.21.15.72:0/2492588470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5340c5f20 0x7ff5340af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:01.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.009+0000 7ff53919c700 1 --2- 172.21.15.72:0/2492588470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff534154160 0x7ff534096750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:01.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.009+0000 7ff533fff700 1 -- 172.21.15.72:0/2492588470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5340c5f20 msgr2=0x7ff5340af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:01.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.009+0000 7ff533fff700 1 --2- 172.21.15.72:0/2492588470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5340c5f20 0x7ff5340af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:01.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.009+0000 7ff533fff700 1 -- 172.21.15.72:0/2492588470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff534154160 msgr2=0x7ff534096750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:01.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.009+0000 7ff533fff700 1 --2- 172.21.15.72:0/2492588470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff534154160 0x7ff534096750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:01.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.009+0000 7ff533fff700 1 -- 172.21.15.72:0/2492588470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff520009370 con 0x7ff5340c6870 2023-08-31T18:48:01.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.009+0000 7ff533fff700 1 --2- 172.21.15.72:0/2492588470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5340c6870 0x7ff5340b0860 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff520009130 tx=0x7ff520017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:01.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.010+0000 7ff530ff9700 1 -- 172.21.15.72:0/2492588470 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff520000bc0 con 0x7ff5340c6870 2023-08-31T18:48:01.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.010+0000 7ff530ff9700 1 -- 172.21.15.72:0/2492588470 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52000b850 con 0x7ff5340c6870 2023-08-31T18:48:01.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.010+0000 7ff530ff9700 1 -- 172.21.15.72:0/2492588470 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff520000d20 con 0x7ff5340c6870 2023-08-31T18:48:01.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.010+0000 7ff53999d700 1 -- 172.21.15.72:0/2492588470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53414ff30 con 0x7ff5340c6870 2023-08-31T18:48:01.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.010+0000 7ff53999d700 1 -- 172.21.15.72:0/2492588470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5340aed40 con 0x7ff5340c6870 2023-08-31T18:48:01.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.011+0000 7ff53999d700 1 -- 172.21.15.72:0/2492588470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5340ae5f0 con 0x7ff5340c6870 2023-08-31T18:48:01.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.011+0000 7ff530ff9700 1 -- 172.21.15.72:0/2492588470 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff52001cad0 con 0x7ff5340c6870 2023-08-31T18:48:01.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.012+0000 7ff530ff9700 1 --2- 172.21.15.72:0/2492588470 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff51805ede0 0x7ff5180612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:01.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.012+0000 7ff530ff9700 1 -- 172.21.15.72:0/2492588470 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff52007bbb0 con 0x7ff5340c6870 2023-08-31T18:48:01.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.013+0000 7ff53899b700 1 --2- 172.21.15.72:0/2492588470 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff51805ede0 0x7ff5180612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:01.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.013+0000 7ff53899b700 1 --2- 172.21.15.72:0/2492588470 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff51805ede0 0x7ff5180612a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff5280038c0 tx=0x7ff528007d40).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:01.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.016+0000 7ff530ff9700 1 -- 172.21.15.72:0/2492588470 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff52004cf60 con 0x7ff5340c6870 2023-08-31T18:48:01.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.187+0000 7ff53999d700 1 -- 172.21.15.72:0/2492588470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff5340ca9d0 con 0x7ff5340c6870 2023-08-31T18:48:01.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.188+0000 7ff530ff9700 1 -- 172.21.15.72:0/2492588470 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff520050580 con 0x7ff5340c6870 2023-08-31T18:48:01.189 INFO:teuthology.orchestra.run.smithi072.stdout:55834574851 2023-08-31T18:48:01.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.190+0000 7ff53999d700 1 -- 172.21.15.72:0/2492588470 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff51805ede0 msgr2=0x7ff5180612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:01.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.190+0000 7ff53999d700 1 --2- 172.21.15.72:0/2492588470 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff51805ede0 0x7ff5180612a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff5280038c0 tx=0x7ff528007d40).stop 2023-08-31T18:48:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.190+0000 7ff53999d700 1 -- 172.21.15.72:0/2492588470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5340c6870 msgr2=0x7ff5340b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.190+0000 7ff53999d700 1 --2- 172.21.15.72:0/2492588470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5340c6870 0x7ff5340b0860 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff520009130 tx=0x7ff520017000).stop 2023-08-31T18:48:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.190+0000 7ff53999d700 1 -- 172.21.15.72:0/2492588470 shutdown_connections 2023-08-31T18:48:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.190+0000 7ff53999d700 1 --2- 172.21.15.72:0/2492588470 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff51805ede0 0x7ff5180612a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:01.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.190+0000 7ff53999d700 1 --2- 172.21.15.72:0/2492588470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff534154160 0x7ff534096750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:01.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.190+0000 7ff53999d700 1 --2- 172.21.15.72:0/2492588470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5340c5f20 0x7ff5340af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:01.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.190+0000 7ff53999d700 1 --2- 172.21.15.72:0/2492588470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5340c6870 0x7ff5340b0860 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:01.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.190+0000 7ff53999d700 1 -- 172.21.15.72:0/2492588470 >> 172.21.15.72:0/2492588470 conn(0x7ff53405e870 msgr2=0x7ff534152370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:01.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.190+0000 7ff53999d700 1 -- 172.21.15.72:0/2492588470 shutdown_connections 2023-08-31T18:48:01.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:01.190+0000 7ff53999d700 1 -- 172.21.15.72:0/2492588470 wait complete. 2023-08-31T18:48:01.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2023-08-31T18:48:02.209 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-31T18:48:02.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.407+0000 7f12311ff700 1 Processor -- start 2023-08-31T18:48:02.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.408+0000 7f12311ff700 1 -- start start 2023-08-31T18:48:02.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.409+0000 7f12311ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f122c153ca0 0x7f122c154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:02.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.409+0000 7f12311ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f122c0ca4f0 0x7f122c063100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:02.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.409+0000 7f12311ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122c0c9450 con 0x7f122c0c8ee0 2023-08-31T18:48:02.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.409+0000 7f12311ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122c0c9730 con 0x7f122c0ca4f0 2023-08-31T18:48:02.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.409+0000 7f12311ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122c0c9a10 con 0x7f122c153ca0 2023-08-31T18:48:02.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.409+0000 7f122b59e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f122c0ca4f0 0x7f122c063100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:02.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.409+0000 7f122a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f122c0c8ee0 0x7f122c158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44468/0 (socket says 172.21.15.72:44468) 2023-08-31T18:48:02.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.409+0000 7f122b59e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f122c0ca4f0 0x7f122c063100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52934/0 (socket says 172.21.15.72:52934) 2023-08-31T18:48:02.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.409+0000 7f122a59c700 1 -- 172.21.15.72:0/1963577856 learned_addr learned my addr 172.21.15.72:0/1963577856 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:02.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.410+0000 7f122ad9d700 1 --2- 172.21.15.72:0/1963577856 >> v2:172.21.15.146:3300/0 conn(0x7f122c153ca0 0x7f122c154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:02.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.410+0000 7f1229d9b700 1 -- 172.21.15.72:0/1963577856 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834183268 0 0) 0x7f122c0c9450 con 0x7f122c0c8ee0 2023-08-31T18:48:02.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.410+0000 7f1229d9b700 1 -- 172.21.15.72:0/1963577856 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12140033f0 con 0x7f122c0c8ee0 2023-08-31T18:48:02.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.410+0000 7f122b59e700 1 -- 172.21.15.72:0/1963577856 >> v2:172.21.15.146:3300/0 conn(0x7f122c153ca0 msgr2=0x7f122c154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:02.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.410+0000 7f122b59e700 1 --2- 172.21.15.72:0/1963577856 >> v2:172.21.15.146:3300/0 conn(0x7f122c153ca0 0x7f122c154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.410+0000 7f122b59e700 1 -- 172.21.15.72:0/1963577856 >> v1:172.21.15.72:6789/0 conn(0x7f122c0c8ee0 legacy=0x7f122c158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:02.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.410+0000 7f122b59e700 1 -- 172.21.15.72:0/1963577856 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c0c9cf0 con 0x7f122c0ca4f0 2023-08-31T18:48:02.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.410+0000 7f122ad9d700 1 --2- 172.21.15.72:0/1963577856 >> v2:172.21.15.146:3300/0 conn(0x7f122c153ca0 0x7f122c154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:02.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.410+0000 7f122b59e700 1 --2- 172.21.15.72:0/1963577856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c0ca4f0 0x7f122c063100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f122c0c88c0 tx=0x7f1224009780).ready entity=mon.0 client_cookie=3d2c9976016c8028 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:02.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.410+0000 7f1229d9b700 1 -- 172.21.15.72:0/1963577856 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122400e070 con 0x7f122c0ca4f0 2023-08-31T18:48:02.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.410+0000 7f1229d9b700 1 -- 172.21.15.72:0/1963577856 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122400bb60 con 0x7f122c0ca4f0 2023-08-31T18:48:02.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.410+0000 7f1229d9b700 1 -- 172.21.15.72:0/1963577856 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224012410 con 0x7f122c0ca4f0 2023-08-31T18:48:02.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.411+0000 7f12311ff700 1 -- 172.21.15.72:0/1963577856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c0ca4f0 msgr2=0x7f122c063100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:02.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.411+0000 7f12311ff700 1 --2- 172.21.15.72:0/1963577856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c0ca4f0 0x7f122c063100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f122c0c88c0 tx=0x7f1224009780).stop 2023-08-31T18:48:02.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.411+0000 7f12311ff700 1 -- 172.21.15.72:0/1963577856 shutdown_connections 2023-08-31T18:48:02.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.411+0000 7f12311ff700 1 --2- 172.21.15.72:0/1963577856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c0ca4f0 0x7f122c063100 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.411+0000 7f12311ff700 1 --2- 172.21.15.72:0/1963577856 >> v2:172.21.15.146:3300/0 conn(0x7f122c153ca0 0x7f122c154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.411+0000 7f12311ff700 1 -- 172.21.15.72:0/1963577856 >> 172.21.15.72:0/1963577856 conn(0x7f122c0cadb0 msgr2=0x7f122c0cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:02.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.411+0000 7f12311ff700 1 -- 172.21.15.72:0/1963577856 shutdown_connections 2023-08-31T18:48:02.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.411+0000 7f12311ff700 1 -- 172.21.15.72:0/1963577856 wait complete. 2023-08-31T18:48:02.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.412+0000 7f12311ff700 1 Processor -- start 2023-08-31T18:48:02.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.412+0000 7f12311ff700 1 -- start start 2023-08-31T18:48:02.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.413+0000 7f12311ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c0c8ee0 0x7f122c152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:02.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.413+0000 7f12311ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f122c0ca4f0 0x7f122c1502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:02.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.413+0000 7f12311ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c153ca0 0x7f122c1507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:02.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.413+0000 7f12311ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c150cd0 con 0x7f122c153ca0 2023-08-31T18:48:02.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.413+0000 7f12311ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c0c4720 con 0x7f122c0c8ee0 2023-08-31T18:48:02.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.413+0000 7f12311ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122c0c3b10 con 0x7f122c0ca4f0 2023-08-31T18:48:02.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.414+0000 7f122b59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c153ca0 0x7f122c1507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:02.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.414+0000 7f122b59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c153ca0 0x7f122c1507e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52936/0 (socket says 172.21.15.72:52936) 2023-08-31T18:48:02.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.414+0000 7f122b59e700 1 -- 172.21.15.72:0/4207861176 learned_addr learned my addr 172.21.15.72:0/4207861176 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:02.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.414+0000 7f122ad9d700 1 --2- 172.21.15.72:0/4207861176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c0c8ee0 0x7f122c152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:02.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.414+0000 7f122b59e700 1 -- 172.21.15.72:0/4207861176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f122c0ca4f0 msgr2=0x7f122c1502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.414+0000 7f122b59e700 1 --2- 172.21.15.72:0/4207861176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f122c0ca4f0 0x7f122c1502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.414+0000 7f122b59e700 1 -- 172.21.15.72:0/4207861176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c0c8ee0 msgr2=0x7f122c152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.414+0000 7f122b59e700 1 --2- 172.21.15.72:0/4207861176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c0c8ee0 0x7f122c152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.414+0000 7f122b59e700 1 -- 172.21.15.72:0/4207861176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1224009a20 con 0x7f122c153ca0 2023-08-31T18:48:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.414+0000 7f122ad9d700 1 --2- 172.21.15.72:0/4207861176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c0c8ee0 0x7f122c152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.414+0000 7f122b59e700 1 --2- 172.21.15.72:0/4207861176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c153ca0 0x7f122c1507e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f122400b6c0 tx=0x7f1224009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.414+0000 7f1212ffd700 1 -- 172.21.15.72:0/4207861176 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122401d630 con 0x7f122c153ca0 2023-08-31T18:48:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.414+0000 7f1212ffd700 1 -- 172.21.15.72:0/4207861176 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122401d790 con 0x7f122c153ca0 2023-08-31T18:48:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.414+0000 7f12311ff700 1 -- 172.21.15.72:0/4207861176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f122c0c3df0 con 0x7f122c153ca0 2023-08-31T18:48:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.414+0000 7f1212ffd700 1 -- 172.21.15.72:0/4207861176 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122401db50 con 0x7f122c153ca0 2023-08-31T18:48:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.415+0000 7f12311ff700 1 -- 172.21.15.72:0/4207861176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122c0c43b0 con 0x7f122c153ca0 2023-08-31T18:48:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.416+0000 7f12311ff700 1 -- 172.21.15.72:0/4207861176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122c06c6b0 con 0x7f122c153ca0 2023-08-31T18:48:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.416+0000 7f1212ffd700 1 -- 172.21.15.72:0/4207861176 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f1224026410 con 0x7f122c153ca0 2023-08-31T18:48:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.417+0000 7f1212ffd700 1 --2- 172.21.15.72:0/4207861176 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f121805ee10 0x7f12180612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.417+0000 7f1212ffd700 1 -- 172.21.15.72:0/4207861176 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f122407bc90 con 0x7f122c153ca0 2023-08-31T18:48:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.417+0000 7f122ad9d700 1 --2- 172.21.15.72:0/4207861176 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f121805ee10 0x7f12180612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.418+0000 7f122ad9d700 1 --2- 172.21.15.72:0/4207861176 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f121805ee10 0x7f12180612d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f121c006d80 tx=0x7f121c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.421+0000 7f1212ffd700 1 -- 172.21.15.72:0/4207861176 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f122404cfe0 con 0x7f122c153ca0 2023-08-31T18:48:02.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.592+0000 7f12311ff700 1 -- 172.21.15.72:0/4207861176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f122c0c9fd0 con 0x7f122c153ca0 2023-08-31T18:48:02.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.592+0000 7f1212ffd700 1 -- 172.21.15.72:0/4207861176 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1224050600 con 0x7f122c153ca0 2023-08-31T18:48:02.593 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2023-08-31T18:48:02.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.594+0000 7f12311ff700 1 -- 172.21.15.72:0/4207861176 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f121805ee10 msgr2=0x7f12180612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:02.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.594+0000 7f12311ff700 1 --2- 172.21.15.72:0/4207861176 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f121805ee10 0x7f12180612d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f121c006d80 tx=0x7f121c008040).stop 2023-08-31T18:48:02.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.594+0000 7f12311ff700 1 -- 172.21.15.72:0/4207861176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c153ca0 msgr2=0x7f122c1507e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:02.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.594+0000 7f12311ff700 1 --2- 172.21.15.72:0/4207861176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c153ca0 0x7f122c1507e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f122400b6c0 tx=0x7f1224009780).stop 2023-08-31T18:48:02.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.594+0000 7f12311ff700 1 -- 172.21.15.72:0/4207861176 shutdown_connections 2023-08-31T18:48:02.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.594+0000 7f12311ff700 1 --2- 172.21.15.72:0/4207861176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f122c153ca0 0x7f122c1507e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.594+0000 7f12311ff700 1 --2- 172.21.15.72:0/4207861176 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f121805ee10 0x7f12180612d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.594+0000 7f12311ff700 1 --2- 172.21.15.72:0/4207861176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f122c0c8ee0 0x7f122c152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.594+0000 7f12311ff700 1 --2- 172.21.15.72:0/4207861176 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f122c0ca4f0 0x7f122c1502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:02.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.594+0000 7f12311ff700 1 -- 172.21.15.72:0/4207861176 >> 172.21.15.72:0/4207861176 conn(0x7f122c0cadb0 msgr2=0x7f122c0bfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:02.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.594+0000 7f12311ff700 1 -- 172.21.15.72:0/4207861176 shutdown_connections 2023-08-31T18:48:02.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.594+0000 7f12311ff700 1 -- 172.21.15.72:0/4207861176 wait complete. 2023-08-31T18:48:02.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.0 2023-08-31T18:48:02.612 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-31T18:48:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.799+0000 7ff3cc9ff700 1 Processor -- start 2023-08-31T18:48:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.800+0000 7ff3cc9ff700 1 -- start start 2023-08-31T18:48:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.801+0000 7ff3cc9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c80c8ee0 0x7ff3c8154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.801+0000 7ff3cc9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3c80ca4f0 0x7ff3c8063100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.801+0000 7ff3cc9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c80c9450 con 0x7ff3c8153ca0 2023-08-31T18:48:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.801+0000 7ff3cc9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c80c9730 con 0x7ff3c80ca4f0 2023-08-31T18:48:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.801+0000 7ff3cc9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80c9a10 con 0x7ff3c80c8ee0 2023-08-31T18:48:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.801+0000 7ff3c659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff3c8153ca0 0x7ff3c8158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44470/0 (socket says 172.21.15.72:44470) 2023-08-31T18:48:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.801+0000 7ff3c659c700 1 -- 172.21.15.72:0/3999189524 learned_addr learned my addr 172.21.15.72:0/3999189524 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.801+0000 7ff3c6d9d700 1 --2- 172.21.15.72:0/3999189524 >> v2:172.21.15.72:3300/0 conn(0x7ff3c80ca4f0 0x7ff3c8063100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.801+0000 7ff3c5d9b700 1 --2- 172.21.15.72:0/3999189524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c80c8ee0 0x7ff3c8154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:02.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.802+0000 7ff3c559a700 1 -- 172.21.15.72:0/3999189524 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994506599 0 0) 0x7ff3c80c9450 con 0x7ff3c8153ca0 2023-08-31T18:48:02.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.802+0000 7ff3c559a700 1 -- 172.21.15.72:0/3999189524 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3b00033f0 con 0x7ff3c8153ca0 2023-08-31T18:48:02.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.802+0000 7ff3c6d9d700 1 -- 172.21.15.72:0/3999189524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c80c8ee0 msgr2=0x7ff3c8154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.802+0000 7ff3c6d9d700 1 --2- 172.21.15.72:0/3999189524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c80c8ee0 0x7ff3c8154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.802+0000 7ff3c6d9d700 1 -- 172.21.15.72:0/3999189524 >> v1:172.21.15.72:6789/0 conn(0x7ff3c8153ca0 legacy=0x7ff3c8158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.802+0000 7ff3c6d9d700 1 -- 172.21.15.72:0/3999189524 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c80c9cf0 con 0x7ff3c80ca4f0 2023-08-31T18:48:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.802+0000 7ff3c6d9d700 1 --2- 172.21.15.72:0/3999189524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c80ca4f0 0x7ff3c8063100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ff3c0009e60 tx=0x7ff3c0009780).ready entity=mon.0 client_cookie=47d26d3170b53514 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.802+0000 7ff3c559a700 1 -- 172.21.15.72:0/3999189524 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c000e070 con 0x7ff3c80ca4f0 2023-08-31T18:48:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.802+0000 7ff3c559a700 1 -- 172.21.15.72:0/3999189524 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c000bab0 con 0x7ff3c80ca4f0 2023-08-31T18:48:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.802+0000 7ff3c559a700 1 -- 172.21.15.72:0/3999189524 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c000be30 con 0x7ff3c80ca4f0 2023-08-31T18:48:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.803+0000 7ff3cc9ff700 1 -- 172.21.15.72:0/3999189524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c80ca4f0 msgr2=0x7ff3c8063100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.803+0000 7ff3cc9ff700 1 --2- 172.21.15.72:0/3999189524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c80ca4f0 0x7ff3c8063100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ff3c0009e60 tx=0x7ff3c0009780).stop 2023-08-31T18:48:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.803+0000 7ff3cc9ff700 1 -- 172.21.15.72:0/3999189524 shutdown_connections 2023-08-31T18:48:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.803+0000 7ff3cc9ff700 1 --2- 172.21.15.72:0/3999189524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c80ca4f0 0x7ff3c8063100 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.803+0000 7ff3cc9ff700 1 --2- 172.21.15.72:0/3999189524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c80c8ee0 0x7ff3c8154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.803+0000 7ff3cc9ff700 1 -- 172.21.15.72:0/3999189524 >> 172.21.15.72:0/3999189524 conn(0x7ff3c80cadb0 msgr2=0x7ff3c80cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.803+0000 7ff3cc9ff700 1 -- 172.21.15.72:0/3999189524 shutdown_connections 2023-08-31T18:48:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.803+0000 7ff3cc9ff700 1 -- 172.21.15.72:0/3999189524 wait complete. 2023-08-31T18:48:02.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.804+0000 7ff3cc9ff700 1 Processor -- start 2023-08-31T18:48:02.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.804+0000 7ff3cc9ff700 1 -- start start 2023-08-31T18:48:02.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.805+0000 7ff3cc9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c80c8ee0 0x7ff3c80c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:02.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.805+0000 7ff3cc9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c80ca4f0 0x7ff3c814e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:02.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.805+0000 7ff3cc9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c8153ca0 0x7ff3c80aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:02.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.805+0000 7ff3cc9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80c2340 con 0x7ff3c8153ca0 2023-08-31T18:48:02.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.805+0000 7ff3cc9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80c25c0 con 0x7ff3c80c8ee0 2023-08-31T18:48:02.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.805+0000 7ff3cc9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c80c28a0 con 0x7ff3c80ca4f0 2023-08-31T18:48:02.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.806+0000 7ff3c6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c8153ca0 0x7ff3c80aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:02.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.806+0000 7ff3c6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c8153ca0 0x7ff3c80aabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52960/0 (socket says 172.21.15.72:52960) 2023-08-31T18:48:02.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.806+0000 7ff3c6d9d700 1 -- 172.21.15.72:0/3198382751 learned_addr learned my addr 172.21.15.72:0/3198382751 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:02.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.806+0000 7ff3c659c700 1 --2- 172.21.15.72:0/3198382751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c80c8ee0 0x7ff3c80c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:02.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.806+0000 7ff3c5d9b700 1 --2- 172.21.15.72:0/3198382751 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c80ca4f0 0x7ff3c814e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:02.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.806+0000 7ff3c6d9d700 1 -- 172.21.15.72:0/3198382751 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c80ca4f0 msgr2=0x7ff3c814e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:02.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.806+0000 7ff3c6d9d700 1 --2- 172.21.15.72:0/3198382751 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c80ca4f0 0x7ff3c814e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.806+0000 7ff3c6d9d700 1 -- 172.21.15.72:0/3198382751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c80c8ee0 msgr2=0x7ff3c80c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:02.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.806+0000 7ff3c6d9d700 1 --2- 172.21.15.72:0/3198382751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c80c8ee0 0x7ff3c80c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.806+0000 7ff3c6d9d700 1 -- 172.21.15.72:0/3198382751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c0009a20 con 0x7ff3c8153ca0 2023-08-31T18:48:02.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.806+0000 7ff3c6d9d700 1 --2- 172.21.15.72:0/3198382751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c8153ca0 0x7ff3c80aabe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7ff3c000b610 tx=0x7ff3c0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:02.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.806+0000 7ff3b67fc700 1 -- 172.21.15.72:0/3198382751 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0013e70 con 0x7ff3c8153ca0 2023-08-31T18:48:02.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.807+0000 7ff3b67fc700 1 -- 172.21.15.72:0/3198382751 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c001d630 con 0x7ff3c8153ca0 2023-08-31T18:48:02.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.807+0000 7ff3cc9ff700 1 -- 172.21.15.72:0/3198382751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c80c2b80 con 0x7ff3c8153ca0 2023-08-31T18:48:02.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.807+0000 7ff3b67fc700 1 -- 172.21.15.72:0/3198382751 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c001d9f0 con 0x7ff3c8153ca0 2023-08-31T18:48:02.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.807+0000 7ff3cc9ff700 1 -- 172.21.15.72:0/3198382751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c80c3140 con 0x7ff3c8153ca0 2023-08-31T18:48:02.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.808+0000 7ff3cc9ff700 1 -- 172.21.15.72:0/3198382751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c806c6b0 con 0x7ff3c8153ca0 2023-08-31T18:48:02.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.808+0000 7ff3b67fc700 1 -- 172.21.15.72:0/3198382751 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff3c0003040 con 0x7ff3c8153ca0 2023-08-31T18:48:02.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.809+0000 7ff3b67fc700 1 --2- 172.21.15.72:0/3198382751 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3a805ee10 0x7ff3a80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:02.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.809+0000 7ff3b67fc700 1 -- 172.21.15.72:0/3198382751 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff3c007bbd0 con 0x7ff3c8153ca0 2023-08-31T18:48:02.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.809+0000 7ff3c659c700 1 --2- 172.21.15.72:0/3198382751 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3a805ee10 0x7ff3a80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:02.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.810+0000 7ff3c659c700 1 --2- 172.21.15.72:0/3198382751 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3a805ee10 0x7ff3a80612d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ff3b8007fd0 tx=0x7ff3b8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:02.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.813+0000 7ff3b67fc700 1 -- 172.21.15.72:0/3198382751 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3c004cf60 con 0x7ff3c8153ca0 2023-08-31T18:48:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.982+0000 7ff3cc9ff700 1 -- 172.21.15.72:0/3198382751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff3c80aef50 con 0x7ff3c8153ca0 2023-08-31T18:48:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.983+0000 7ff3b67fc700 1 -- 172.21.15.72:0/3198382751 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff3c0050580 con 0x7ff3c8153ca0 2023-08-31T18:48:02.983 INFO:teuthology.orchestra.run.smithi072.stdout:55834574854 2023-08-31T18:48:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.985+0000 7ff3cc9ff700 1 -- 172.21.15.72:0/3198382751 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3a805ee10 msgr2=0x7ff3a80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.985+0000 7ff3cc9ff700 1 --2- 172.21.15.72:0/3198382751 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3a805ee10 0x7ff3a80612d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ff3b8007fd0 tx=0x7ff3b8009040).stop 2023-08-31T18:48:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.985+0000 7ff3cc9ff700 1 -- 172.21.15.72:0/3198382751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c8153ca0 msgr2=0x7ff3c80aabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.985+0000 7ff3cc9ff700 1 --2- 172.21.15.72:0/3198382751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c8153ca0 0x7ff3c80aabe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7ff3c000b610 tx=0x7ff3c0009780).stop 2023-08-31T18:48:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.985+0000 7ff3cc9ff700 1 -- 172.21.15.72:0/3198382751 shutdown_connections 2023-08-31T18:48:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.985+0000 7ff3cc9ff700 1 --2- 172.21.15.72:0/3198382751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c8153ca0 0x7ff3c80aabe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.985+0000 7ff3cc9ff700 1 --2- 172.21.15.72:0/3198382751 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3a805ee10 0x7ff3a80612d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.985+0000 7ff3cc9ff700 1 --2- 172.21.15.72:0/3198382751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c80c8ee0 0x7ff3c80c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.985+0000 7ff3cc9ff700 1 --2- 172.21.15.72:0/3198382751 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c80ca4f0 0x7ff3c814e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.985+0000 7ff3cc9ff700 1 -- 172.21.15.72:0/3198382751 >> 172.21.15.72:0/3198382751 conn(0x7ff3c80cadb0 msgr2=0x7ff3c8150180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.985+0000 7ff3cc9ff700 1 -- 172.21.15.72:0/3198382751 shutdown_connections 2023-08-31T18:48:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:02.985+0000 7ff3cc9ff700 1 -- 172.21.15.72:0/3198382751 wait complete. 2023-08-31T18:48:03.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.1 2023-08-31T18:48:03.003 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-31T18:48:03.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.192+0000 7f87405ff700 1 Processor -- start 2023-08-31T18:48:03.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.192+0000 7f87405ff700 1 -- start start 2023-08-31T18:48:03.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.193+0000 7f87405ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8738153ca0 0x7f8738154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.193+0000 7f87405ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380c8ee0 0x7f8738158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.193+0000 7f87405ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87380ca4f0 0x7f8738063100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.193+0000 7f87405ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87380c9450 con 0x7f87380ca4f0 2023-08-31T18:48:03.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.193+0000 7f87405ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87380c9730 con 0x7f8738153ca0 2023-08-31T18:48:03.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.193+0000 7f87405ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87380c9a10 con 0x7f87380c8ee0 2023-08-31T18:48:03.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.194+0000 7f873eb9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87380ca4f0 0x7f8738063100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.194+0000 7f873eb9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87380ca4f0 0x7f8738063100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51294/0 (socket says 172.21.15.72:51294) 2023-08-31T18:48:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.194+0000 7f873eb9c700 1 -- 172.21.15.72:0/3062952787 learned_addr learned my addr 172.21.15.72:0/3062952787 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.194+0000 7f873db9a700 1 --2- 172.21.15.72:0/3062952787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380c8ee0 0x7f8738158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.194+0000 7f873e39b700 1 --2- 172.21.15.72:0/3062952787 >> v2:172.21.15.146:3300/0 conn(0x7f8738153ca0 0x7f8738154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.194+0000 7f873eb9c700 1 -- 172.21.15.72:0/3062952787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380c8ee0 msgr2=0x7f8738158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.194+0000 7f873eb9c700 1 --2- 172.21.15.72:0/3062952787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380c8ee0 0x7f8738158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.194+0000 7f873eb9c700 1 -- 172.21.15.72:0/3062952787 >> v2:172.21.15.146:3300/0 conn(0x7f8738153ca0 msgr2=0x7f8738154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.194+0000 7f873eb9c700 1 --2- 172.21.15.72:0/3062952787 >> v2:172.21.15.146:3300/0 conn(0x7f8738153ca0 0x7f8738154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.194+0000 7f873eb9c700 1 -- 172.21.15.72:0/3062952787 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87380c9cf0 con 0x7f87380ca4f0 2023-08-31T18:48:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.194+0000 7f873eb9c700 1 --2- 172.21.15.72:0/3062952787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87380ca4f0 0x7f8738063100 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f87380c88c0 tx=0x7f8730009840).ready entity=mon.0 client_cookie=723e02a14147249d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:03.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.194+0000 7f873d399700 1 -- 172.21.15.72:0/3062952787 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873000e070 con 0x7f87380ca4f0 2023-08-31T18:48:03.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.195+0000 7f873d399700 1 -- 172.21.15.72:0/3062952787 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873000b970 con 0x7f87380ca4f0 2023-08-31T18:48:03.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.195+0000 7f873d399700 1 -- 172.21.15.72:0/3062952787 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873000bcf0 con 0x7f87380ca4f0 2023-08-31T18:48:03.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.195+0000 7f87405ff700 1 -- 172.21.15.72:0/3062952787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87380ca4f0 msgr2=0x7f8738063100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.195+0000 7f87405ff700 1 --2- 172.21.15.72:0/3062952787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87380ca4f0 0x7f8738063100 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f87380c88c0 tx=0x7f8730009840).stop 2023-08-31T18:48:03.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.195+0000 7f87405ff700 1 -- 172.21.15.72:0/3062952787 shutdown_connections 2023-08-31T18:48:03.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.195+0000 7f87405ff700 1 --2- 172.21.15.72:0/3062952787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87380ca4f0 0x7f8738063100 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.195+0000 7f87405ff700 1 --2- 172.21.15.72:0/3062952787 >> v2:172.21.15.146:3300/0 conn(0x7f8738153ca0 0x7f8738154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.195+0000 7f87405ff700 1 --2- 172.21.15.72:0/3062952787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380c8ee0 0x7f8738158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.195+0000 7f87405ff700 1 -- 172.21.15.72:0/3062952787 >> 172.21.15.72:0/3062952787 conn(0x7f87380cadb0 msgr2=0x7f87380cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:03.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.195+0000 7f87405ff700 1 -- 172.21.15.72:0/3062952787 shutdown_connections 2023-08-31T18:48:03.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.195+0000 7f87405ff700 1 -- 172.21.15.72:0/3062952787 wait complete. 2023-08-31T18:48:03.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.197+0000 7f87405ff700 1 Processor -- start 2023-08-31T18:48:03.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.197+0000 7f87405ff700 1 -- start start 2023-08-31T18:48:03.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f87405ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87380c8ee0 0x7f8738150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f87405ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380ca4f0 0x7f87381418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f87405ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8738153ca0 0x7f873814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f87405ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87380b0090 con 0x7f8738153ca0 2023-08-31T18:48:03.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f87405ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8738141da0 con 0x7f87380c8ee0 2023-08-31T18:48:03.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f87405ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87380af4c0 con 0x7f87380ca4f0 2023-08-31T18:48:03.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f873eb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8738153ca0 0x7f873814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f873eb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8738153ca0 0x7f873814ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51302/0 (socket says 172.21.15.72:51302) 2023-08-31T18:48:03.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f873eb9c700 1 -- 172.21.15.72:0/2707305876 learned_addr learned my addr 172.21.15.72:0/2707305876 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:03.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f873db9a700 1 --2- 172.21.15.72:0/2707305876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380ca4f0 0x7f87381418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f873e39b700 1 --2- 172.21.15.72:0/2707305876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87380c8ee0 0x7f8738150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f873eb9c700 1 -- 172.21.15.72:0/2707305876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380ca4f0 msgr2=0x7f87381418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f873eb9c700 1 --2- 172.21.15.72:0/2707305876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380ca4f0 0x7f87381418b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f873eb9c700 1 -- 172.21.15.72:0/2707305876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87380c8ee0 msgr2=0x7f8738150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f873eb9c700 1 --2- 172.21.15.72:0/2707305876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87380c8ee0 0x7f8738150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.198+0000 7f873eb9c700 1 -- 172.21.15.72:0/2707305876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8730009ae0 con 0x7f8738153ca0 2023-08-31T18:48:03.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.199+0000 7f873eb9c700 1 --2- 172.21.15.72:0/2707305876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8738153ca0 0x7f873814ebe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f873000b610 tx=0x7f8730009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:03.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.199+0000 7f872e7fc700 1 -- 172.21.15.72:0/2707305876 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873000bee0 con 0x7f8738153ca0 2023-08-31T18:48:03.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.199+0000 7f872e7fc700 1 -- 172.21.15.72:0/2707305876 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8730013e60 con 0x7f8738153ca0 2023-08-31T18:48:03.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.199+0000 7f87405ff700 1 -- 172.21.15.72:0/2707305876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873814f0d0 con 0x7f8738153ca0 2023-08-31T18:48:03.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.199+0000 7f872e7fc700 1 -- 172.21.15.72:0/2707305876 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873001e6c0 con 0x7f8738153ca0 2023-08-31T18:48:03.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.199+0000 7f87405ff700 1 -- 172.21.15.72:0/2707305876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87380afa40 con 0x7f8738153ca0 2023-08-31T18:48:03.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.200+0000 7f87405ff700 1 -- 172.21.15.72:0/2707305876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87380b0200 con 0x7f8738153ca0 2023-08-31T18:48:03.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.201+0000 7f872e7fc700 1 -- 172.21.15.72:0/2707305876 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8730003040 con 0x7f8738153ca0 2023-08-31T18:48:03.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.201+0000 7f872e7fc700 1 --2- 172.21.15.72:0/2707305876 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f871c05ee10 0x7f871c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.202+0000 7f872e7fc700 1 -- 172.21.15.72:0/2707305876 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f873007b210 con 0x7f8738153ca0 2023-08-31T18:48:03.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.202+0000 7f873e39b700 1 --2- 172.21.15.72:0/2707305876 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f871c05ee10 0x7f871c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.202+0000 7f873e39b700 1 --2- 172.21.15.72:0/2707305876 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f871c05ee10 0x7f871c0612d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8734009b90 tx=0x7f8734009060).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:03.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.205+0000 7f872e7fc700 1 -- 172.21.15.72:0/2707305876 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f873004c670 con 0x7f8738153ca0 2023-08-31T18:48:03.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.379+0000 7f87405ff700 1 -- 172.21.15.72:0/2707305876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f873806c6b0 con 0x7f8738153ca0 2023-08-31T18:48:03.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.380+0000 7f872e7fc700 1 -- 172.21.15.72:0/2707305876 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8730023070 con 0x7f8738153ca0 2023-08-31T18:48:03.380 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2023-08-31T18:48:03.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.381+0000 7f87405ff700 1 -- 172.21.15.72:0/2707305876 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f871c05ee10 msgr2=0x7f871c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.381+0000 7f87405ff700 1 --2- 172.21.15.72:0/2707305876 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f871c05ee10 0x7f871c0612d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8734009b90 tx=0x7f8734009060).stop 2023-08-31T18:48:03.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.381+0000 7f87405ff700 1 -- 172.21.15.72:0/2707305876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8738153ca0 msgr2=0x7f873814ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.382+0000 7f87405ff700 1 --2- 172.21.15.72:0/2707305876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8738153ca0 0x7f873814ebe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f873000b610 tx=0x7f8730009840).stop 2023-08-31T18:48:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.382+0000 7f87405ff700 1 -- 172.21.15.72:0/2707305876 shutdown_connections 2023-08-31T18:48:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.382+0000 7f87405ff700 1 --2- 172.21.15.72:0/2707305876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8738153ca0 0x7f873814ebe0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.382+0000 7f87405ff700 1 --2- 172.21.15.72:0/2707305876 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f871c05ee10 0x7f871c0612d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.382+0000 7f87405ff700 1 --2- 172.21.15.72:0/2707305876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87380c8ee0 0x7f8738150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.382+0000 7f87405ff700 1 --2- 172.21.15.72:0/2707305876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87380ca4f0 0x7f87381418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.382+0000 7f87405ff700 1 -- 172.21.15.72:0/2707305876 >> 172.21.15.72:0/2707305876 conn(0x7f87380cadb0 msgr2=0x7f87380aabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:03.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.382+0000 7f87405ff700 1 -- 172.21.15.72:0/2707305876 shutdown_connections 2023-08-31T18:48:03.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.382+0000 7f87405ff700 1 -- 172.21.15.72:0/2707305876 wait complete. 2023-08-31T18:48:03.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.2 2023-08-31T18:48:03.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-31T18:48:03.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.587+0000 7f9a64fff700 1 Processor -- start 2023-08-31T18:48:03.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.587+0000 7f9a64fff700 1 -- start start 2023-08-31T18:48:03.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.588+0000 7f9a64fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a60151f20 0x7f9a60067f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.588+0000 7f9a64fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a600a81b0 con 0x7f9a60067b30 2023-08-31T18:48:03.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.588+0000 7f9a64fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a60068750 con 0x7f9a600c5090 2023-08-31T18:48:03.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.588+0000 7f9a64fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a600a7e80 con 0x7f9a60151f20 2023-08-31T18:48:03.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5e59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9a60067b30 0x7f9a60151810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36856/0 (socket says 172.21.15.72:36856) 2023-08-31T18:48:03.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5e59c700 1 -- 172.21.15.72:0/400037847 learned_addr learned my addr 172.21.15.72:0/400037847 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:03.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5dd9b700 1 --2- 172.21.15.72:0/400037847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a60151f20 0x7f9a60067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529790444 0 0) 0x7f9a600a81b0 con 0x7f9a60067b30 2023-08-31T18:48:03.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a480033f0 con 0x7f9a60067b30 2023-08-31T18:48:03.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342568604 0 0) 0x7f9a60068750 con 0x7f9a600c5090 2023-08-31T18:48:03.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a600a81b0 con 0x7f9a600c5090 2023-08-31T18:48:03.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1682715729 0 0) 0x7f9a480033f0 con 0x7f9a60067b30 2023-08-31T18:48:03.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a60151f20 msgr2=0x7f9a60067f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5d59a700 1 --2- 172.21.15.72:0/400037847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a60151f20 0x7f9a60067f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 >> v1:172.21.15.146:6789/0 conn(0x7f9a600c5090 legacy=0x7f9a60157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a600bdb80 con 0x7f9a60067b30 2023-08-31T18:48:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f9a500015f0 con 0x7f9a60067b30 2023-08-31T18:48:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 >> v1:172.21.15.72:6789/0 conn(0x7f9a60067b30 legacy=0x7f9a60151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5d59a700 1 --2- 172.21.15.72:0/400037847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a48003aa0 0x7f9a48003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.589+0000 7f9a5d59a700 1 --2- 172.21.15.72:0/400037847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a60151f20 0x7f9a48004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5d59a700 1 --2- 172.21.15.72:0/400037847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a48004b80 0x7f9a48005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a600a7e80 con 0x7f9a48003aa0 2023-08-31T18:48:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4800b910 con 0x7f9a48004b80 2023-08-31T18:48:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4800bad0 con 0x7f9a60151f20 2023-08-31T18:48:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5e59c700 1 --2- 172.21.15.72:0/400037847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a48003aa0 0x7f9a48003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5dd9b700 1 --2- 172.21.15.72:0/400037847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a60151f20 0x7f9a48004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5ed9d700 1 --2- 172.21.15.72:0/400037847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a48004b80 0x7f9a48005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5e59c700 1 -- 172.21.15.72:0/400037847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a60151f20 msgr2=0x7f9a48004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5e59c700 1 --2- 172.21.15.72:0/400037847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a60151f20 0x7f9a48004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5e59c700 1 -- 172.21.15.72:0/400037847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a48004b80 msgr2=0x7f9a48005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5e59c700 1 --2- 172.21.15.72:0/400037847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a48004b80 0x7f9a48005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5e59c700 1 -- 172.21.15.72:0/400037847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a480033f0 con 0x7f9a48003aa0 2023-08-31T18:48:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5e59c700 1 --2- 172.21.15.72:0/400037847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a48003aa0 0x7f9a48003ea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f9a5000c110 tx=0x7f9a600a8120).ready entity=mon.0 client_cookie=42b2c810c40f9148 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a500079a0 con 0x7f9a48003aa0 2023-08-31T18:48:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a500070d0 con 0x7f9a48003aa0 2023-08-31T18:48:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.590+0000 7f9a5d59a700 1 -- 172.21.15.72:0/400037847 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50007470 con 0x7f9a48003aa0 2023-08-31T18:48:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.591+0000 7f9a64fff700 1 -- 172.21.15.72:0/400037847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a48003aa0 msgr2=0x7f9a48003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.591+0000 7f9a64fff700 1 --2- 172.21.15.72:0/400037847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a48003aa0 0x7f9a48003ea0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f9a5000c110 tx=0x7f9a600a8120).stop 2023-08-31T18:48:03.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.591+0000 7f9a5ed9d700 1 -- 172.21.15.72:0/400037847 reap_dead start 2023-08-31T18:48:03.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.591+0000 7f9a64fff700 1 -- 172.21.15.72:0/400037847 shutdown_connections 2023-08-31T18:48:03.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.591+0000 7f9a64fff700 1 -- 172.21.15.72:0/400037847 >> 172.21.15.72:0/400037847 conn(0x7f9a600c8c20 msgr2=0x7f9a600c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:03.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.591+0000 7f9a64fff700 1 -- 172.21.15.72:0/400037847 shutdown_connections 2023-08-31T18:48:03.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.591+0000 7f9a64fff700 1 -- 172.21.15.72:0/400037847 wait complete. 2023-08-31T18:48:03.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.593+0000 7f9a64fff700 1 Processor -- start 2023-08-31T18:48:03.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.593+0000 7f9a64fff700 1 -- start start 2023-08-31T18:48:03.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a64fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a48003aa0 0x7f9a6014c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a64fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a6014c950 0x7f9a601641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a64fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a601646c0 0x7f9a60153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a64fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a60157420 con 0x7f9a48003aa0 2023-08-31T18:48:03.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a64fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a601570f0 con 0x7f9a601646c0 2023-08-31T18:48:03.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a64fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a60164b60 con 0x7f9a6014c950 2023-08-31T18:48:03.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a5e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a48003aa0 0x7f9a6014c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a5e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a48003aa0 0x7f9a6014c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51324/0 (socket says 172.21.15.72:51324) 2023-08-31T18:48:03.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a5e59c700 1 -- 172.21.15.72:0/3686347205 learned_addr learned my addr 172.21.15.72:0/3686347205 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:03.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a5dd9b700 1 --2- 172.21.15.72:0/3686347205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a6014c950 0x7f9a601641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a5ed9d700 1 --2- 172.21.15.72:0/3686347205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a601646c0 0x7f9a60153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a5e59c700 1 -- 172.21.15.72:0/3686347205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a6014c950 msgr2=0x7f9a601641d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a5e59c700 1 --2- 172.21.15.72:0/3686347205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a6014c950 0x7f9a601641d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a5e59c700 1 -- 172.21.15.72:0/3686347205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a601646c0 msgr2=0x7f9a60153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a5e59c700 1 --2- 172.21.15.72:0/3686347205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a601646c0 0x7f9a60153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a5e59c700 1 -- 172.21.15.72:0/3686347205 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a60164e40 con 0x7f9a48003aa0 2023-08-31T18:48:03.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.594+0000 7f9a5e59c700 1 --2- 172.21.15.72:0/3686347205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a48003aa0 0x7f9a6014c180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f9a4800b8e0 tx=0x7f9a50015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:03.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.595+0000 7f9a4e7fc700 1 -- 172.21.15.72:0/3686347205 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50005670 con 0x7f9a48003aa0 2023-08-31T18:48:03.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.595+0000 7f9a4e7fc700 1 -- 172.21.15.72:0/3686347205 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a500057d0 con 0x7f9a48003aa0 2023-08-31T18:48:03.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.595+0000 7f9a4e7fc700 1 -- 172.21.15.72:0/3686347205 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a50005b70 con 0x7f9a48003aa0 2023-08-31T18:48:03.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.595+0000 7f9a64fff700 1 -- 172.21.15.72:0/3686347205 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a60165120 con 0x7f9a48003aa0 2023-08-31T18:48:03.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.595+0000 7f9a64fff700 1 -- 172.21.15.72:0/3686347205 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a601653a0 con 0x7f9a48003aa0 2023-08-31T18:48:03.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.596+0000 7f9a64fff700 1 -- 172.21.15.72:0/3686347205 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6006c6b0 con 0x7f9a48003aa0 2023-08-31T18:48:03.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.596+0000 7f9a4e7fc700 1 -- 172.21.15.72:0/3686347205 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9a50013450 con 0x7f9a48003aa0 2023-08-31T18:48:03.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.597+0000 7f9a4e7fc700 1 --2- 172.21.15.72:0/3686347205 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9a4005ee10 0x7f9a400612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.597+0000 7f9a4e7fc700 1 -- 172.21.15.72:0/3686347205 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9a5007ac80 con 0x7f9a48003aa0 2023-08-31T18:48:03.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.598+0000 7f9a5dd9b700 1 --2- 172.21.15.72:0/3686347205 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9a4005ee10 0x7f9a400612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.598+0000 7f9a5dd9b700 1 --2- 172.21.15.72:0/3686347205 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9a4005ee10 0x7f9a400612d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f9a60154360 tx=0x7f9a54008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:03.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.602+0000 7f9a4e7fc700 1 -- 172.21.15.72:0/3686347205 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9a5004c080 con 0x7f9a48003aa0 2023-08-31T18:48:03.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.773+0000 7f9a64fff700 1 -- 172.21.15.72:0/3686347205 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9a600bde60 con 0x7f9a48003aa0 2023-08-31T18:48:03.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.773+0000 7f9a4e7fc700 1 -- 172.21.15.72:0/3686347205 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a50024030 con 0x7f9a48003aa0 2023-08-31T18:48:03.777 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2023-08-31T18:48:03.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.775+0000 7f9a64fff700 1 -- 172.21.15.72:0/3686347205 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9a4005ee10 msgr2=0x7f9a400612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.775+0000 7f9a64fff700 1 --2- 172.21.15.72:0/3686347205 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9a4005ee10 0x7f9a400612d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f9a60154360 tx=0x7f9a54008040).stop 2023-08-31T18:48:03.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.775+0000 7f9a64fff700 1 -- 172.21.15.72:0/3686347205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a48003aa0 msgr2=0x7f9a6014c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.775+0000 7f9a64fff700 1 --2- 172.21.15.72:0/3686347205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a48003aa0 0x7f9a6014c180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f9a4800b8e0 tx=0x7f9a50015000).stop 2023-08-31T18:48:03.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.775+0000 7f9a64fff700 1 -- 172.21.15.72:0/3686347205 shutdown_connections 2023-08-31T18:48:03.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.775+0000 7f9a64fff700 1 --2- 172.21.15.72:0/3686347205 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9a4005ee10 0x7f9a400612d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.775+0000 7f9a64fff700 1 --2- 172.21.15.72:0/3686347205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a601646c0 0x7f9a60153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.775+0000 7f9a64fff700 1 --2- 172.21.15.72:0/3686347205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a48003aa0 0x7f9a6014c180 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.775+0000 7f9a64fff700 1 --2- 172.21.15.72:0/3686347205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9a6014c950 0x7f9a601641d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.775+0000 7f9a64fff700 1 -- 172.21.15.72:0/3686347205 >> 172.21.15.72:0/3686347205 conn(0x7f9a600c8c20 msgr2=0x7f9a60064d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:03.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.775+0000 7f9a64fff700 1 -- 172.21.15.72:0/3686347205 shutdown_connections 2023-08-31T18:48:03.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.776+0000 7f9a64fff700 1 -- 172.21.15.72:0/3686347205 wait complete. 2023-08-31T18:48:03.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.3 2023-08-31T18:48:03.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-31T18:48:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.981+0000 7f0458bff700 1 Processor -- start 2023-08-31T18:48:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.981+0000 7f0458bff700 1 -- start start 2023-08-31T18:48:03.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.982+0000 7f0458bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f04541378e0 0x7f0454152230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.982+0000 7f0458bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045406a390 con 0x7f0454065720 2023-08-31T18:48:03.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.982+0000 7f0458bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0454137cc0 con 0x7f04540bd3c0 2023-08-31T18:48:03.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.982+0000 7f0458bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0454069780 con 0x7f04541378e0 2023-08-31T18:48:03.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.982+0000 7f045259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f04541378e0 0x7f0454152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.983+0000 7f045259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f04541378e0 0x7f0454152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51334/0 (socket says 172.21.15.72:51334) 2023-08-31T18:48:03.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.983+0000 7f045259c700 1 -- 172.21.15.72:0/1333016970 learned_addr learned my addr 172.21.15.72:0/1333016970 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:03.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.983+0000 7f0451d9b700 1 --1- 172.21.15.72:0/1333016970 >> v1:172.21.15.72:6789/0 conn(0x7f0454065720 0x7f04540bccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36860/0 (socket says 172.21.15.72:36860) 2023-08-31T18:48:03.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.983+0000 7f045259c700 1 -- 172.21.15.72:0/1333016970 >> v1:172.21.15.146:6789/0 conn(0x7f04540bd3c0 legacy=0x7f04540c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.983+0000 7f045259c700 1 -- 172.21.15.72:0/1333016970 >> v1:172.21.15.72:6789/0 conn(0x7f0454065720 legacy=0x7f04540bccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.983+0000 7f045259c700 1 -- 172.21.15.72:0/1333016970 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0454069a60 con 0x7f04541378e0 2023-08-31T18:48:03.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.983+0000 7f045159a700 1 -- 172.21.15.72:0/1333016970 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813142602 0 0) 0x7f045406a390 con 0x7f0454065720 2023-08-31T18:48:03.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.983+0000 7f045259c700 1 --2- 172.21.15.72:0/1333016970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04541378e0 0x7f0454152230 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f0444006fd0 tx=0x7f04440090f0).ready entity=mon.0 client_cookie=d51cdacdde5214a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:03.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.983+0000 7f045159a700 1 -- 172.21.15.72:0/1333016970 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044400b600 con 0x7f04541378e0 2023-08-31T18:48:03.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.983+0000 7f045159a700 1 -- 172.21.15.72:0/1333016970 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044400b760 con 0x7f04541378e0 2023-08-31T18:48:03.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.983+0000 7f045159a700 1 -- 172.21.15.72:0/1333016970 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044400bae0 con 0x7f04541378e0 2023-08-31T18:48:03.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.984+0000 7f0458bff700 1 -- 172.21.15.72:0/1333016970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04541378e0 msgr2=0x7f0454152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.984+0000 7f0458bff700 1 --2- 172.21.15.72:0/1333016970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04541378e0 0x7f0454152230 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f0444006fd0 tx=0x7f04440090f0).stop 2023-08-31T18:48:03.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.984+0000 7f0458bff700 1 -- 172.21.15.72:0/1333016970 shutdown_connections 2023-08-31T18:48:03.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.984+0000 7f0458bff700 1 --2- 172.21.15.72:0/1333016970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04541378e0 0x7f0454152230 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:03.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.984+0000 7f0458bff700 1 -- 172.21.15.72:0/1333016970 >> 172.21.15.72:0/1333016970 conn(0x7f0454063120 msgr2=0x7f04540c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:03.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.984+0000 7f0458bff700 1 -- 172.21.15.72:0/1333016970 shutdown_connections 2023-08-31T18:48:03.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.984+0000 7f0458bff700 1 -- 172.21.15.72:0/1333016970 wait complete. 2023-08-31T18:48:03.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.986+0000 7f0458bff700 1 Processor -- start 2023-08-31T18:48:03.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.986+0000 7f0458bff700 1 -- start start 2023-08-31T18:48:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.986+0000 7f0458bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0454065720 0x7f0454123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f0458bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04540bd3c0 0x7f04540a5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f0458bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04541378e0 0x7f04540a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f0458bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04540a59e0 con 0x7f0454065720 2023-08-31T18:48:03.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f0458bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04540be980 con 0x7f04541378e0 2023-08-31T18:48:03.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f0458bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04540bdd70 con 0x7f04540bd3c0 2023-08-31T18:48:03.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f045259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0454065720 0x7f0454123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f045259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0454065720 0x7f0454123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51346/0 (socket says 172.21.15.72:51346) 2023-08-31T18:48:03.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f045259c700 1 -- 172.21.15.72:0/1710767934 learned_addr learned my addr 172.21.15.72:0/1710767934 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:03.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f045259c700 1 -- 172.21.15.72:0/1710767934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04540bd3c0 msgr2=0x7f04540a5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f045259c700 1 --2- 172.21.15.72:0/1710767934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04540bd3c0 0x7f04540a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:03.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f045259c700 1 -- 172.21.15.72:0/1710767934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04541378e0 msgr2=0x7f04540a54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:03.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f045259c700 1 --2- 172.21.15.72:0/1710767934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04541378e0 0x7f04540a54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:03.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f045259c700 1 -- 172.21.15.72:0/1710767934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0444009370 con 0x7f0454065720 2023-08-31T18:48:03.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f045259c700 1 --2- 172.21.15.72:0/1710767934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0454065720 0x7f0454123180 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f04540c6b00 tx=0x7f0444017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:03.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f04427fc700 1 -- 172.21.15.72:0/1710767934 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044400bae0 con 0x7f0454065720 2023-08-31T18:48:03.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f04427fc700 1 -- 172.21.15.72:0/1710767934 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0444000c90 con 0x7f0454065720 2023-08-31T18:48:03.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.987+0000 7f04427fc700 1 -- 172.21.15.72:0/1710767934 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044401b660 con 0x7f0454065720 2023-08-31T18:48:03.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.988+0000 7f0458bff700 1 -- 172.21.15.72:0/1710767934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04540be050 con 0x7f0454065720 2023-08-31T18:48:03.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.988+0000 7f0458bff700 1 -- 172.21.15.72:0/1710767934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04540be610 con 0x7f0454065720 2023-08-31T18:48:03.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.989+0000 7f0458bff700 1 -- 172.21.15.72:0/1710767934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045406c6b0 con 0x7f0454065720 2023-08-31T18:48:03.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.989+0000 7f04427fc700 1 -- 172.21.15.72:0/1710767934 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f044401b9d0 con 0x7f0454065720 2023-08-31T18:48:03.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.990+0000 7f04427fc700 1 --2- 172.21.15.72:0/1710767934 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f043405ee10 0x7f04340612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:03.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.991+0000 7f04427fc700 1 -- 172.21.15.72:0/1710767934 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f044407b980 con 0x7f0454065720 2023-08-31T18:48:03.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.991+0000 7f0451d9b700 1 --2- 172.21.15.72:0/1710767934 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f043405ee10 0x7f04340612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:03.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.991+0000 7f0451d9b700 1 --2- 172.21.15.72:0/1710767934 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f043405ee10 0x7f04340612d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f04480011e0 tx=0x7f0448007810).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:03.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:03.994+0000 7f04427fc700 1 -- 172.21.15.72:0/1710767934 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f044404cdf0 con 0x7f0454065720 2023-08-31T18:48:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.164+0000 7f0458bff700 1 -- 172.21.15.72:0/1710767934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0454063cb0 con 0x7f0454065720 2023-08-31T18:48:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.165+0000 7f04427fc700 1 -- 172.21.15.72:0/1710767934 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f044401f070 con 0x7f0454065720 2023-08-31T18:48:04.165 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2023-08-31T18:48:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.167+0000 7f0458bff700 1 -- 172.21.15.72:0/1710767934 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f043405ee10 msgr2=0x7f04340612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.167+0000 7f0458bff700 1 --2- 172.21.15.72:0/1710767934 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f043405ee10 0x7f04340612d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f04480011e0 tx=0x7f0448007810).stop 2023-08-31T18:48:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.167+0000 7f0458bff700 1 -- 172.21.15.72:0/1710767934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0454065720 msgr2=0x7f0454123180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.167+0000 7f0458bff700 1 --2- 172.21.15.72:0/1710767934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0454065720 0x7f0454123180 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f04540c6b00 tx=0x7f0444017000).stop 2023-08-31T18:48:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.167+0000 7f0458bff700 1 -- 172.21.15.72:0/1710767934 shutdown_connections 2023-08-31T18:48:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.167+0000 7f0458bff700 1 --2- 172.21.15.72:0/1710767934 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f043405ee10 0x7f04340612d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.167+0000 7f0458bff700 1 --2- 172.21.15.72:0/1710767934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04541378e0 0x7f04540a54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.167+0000 7f0458bff700 1 --2- 172.21.15.72:0/1710767934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0454065720 0x7f0454123180 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.167+0000 7f0458bff700 1 --2- 172.21.15.72:0/1710767934 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04540bd3c0 0x7f04540a5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.167+0000 7f0458bff700 1 -- 172.21.15.72:0/1710767934 >> 172.21.15.72:0/1710767934 conn(0x7f0454063120 msgr2=0x7f04540c4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.167+0000 7f0458bff700 1 -- 172.21.15.72:0/1710767934 shutdown_connections 2023-08-31T18:48:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.167+0000 7f0458bff700 1 -- 172.21.15.72:0/1710767934 wait complete. 2023-08-31T18:48:04.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.4 2023-08-31T18:48:04.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-31T18:48:04.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.375+0000 7f014c1ff700 1 Processor -- start 2023-08-31T18:48:04.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.375+0000 7f014c1ff700 1 -- start start 2023-08-31T18:48:04.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.376+0000 7f014c1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0144154080 0x7f0144063100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:04.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.376+0000 7f014c1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01440cac00 con 0x7f01440c8ee0 2023-08-31T18:48:04.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.376+0000 7f014c1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01440c9450 con 0x7f0144153ca0 2023-08-31T18:48:04.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.376+0000 7f014c1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01440c9730 con 0x7f0144154080 2023-08-31T18:48:04.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.376+0000 7f014979a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f01440c8ee0 0x7f01440ca4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36874/0 (socket says 172.21.15.72:36874) 2023-08-31T18:48:04.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.376+0000 7f014a79c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0144154080 0x7f0144063100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:04.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.376+0000 7f014979a700 1 -- 172.21.15.72:0/2717289682 learned_addr learned my addr 172.21.15.72:0/2717289682 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:04.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.377+0000 7f014a79c700 1 -- 172.21.15.72:0/2717289682 >> v1:172.21.15.146:6789/0 conn(0x7f0144153ca0 legacy=0x7f0144158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:04.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.377+0000 7f014a79c700 1 -- 172.21.15.72:0/2717289682 >> v1:172.21.15.72:6789/0 conn(0x7f01440c8ee0 legacy=0x7f01440ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.377+0000 7f0148f99700 1 -- 172.21.15.72:0/2717289682 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602627835 0 0) 0x7f01440cac00 con 0x7f01440c8ee0 2023-08-31T18:48:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.377+0000 7f014a79c700 1 -- 172.21.15.72:0/2717289682 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01440c9a10 con 0x7f0144154080 2023-08-31T18:48:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.377+0000 7f014a79c700 1 --2- 172.21.15.72:0/2717289682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0144154080 0x7f0144063100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f013c009e60 tx=0x7f013c009780).ready entity=mon.0 client_cookie=6841adfdbf06b6f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.377+0000 7f0148f99700 1 -- 172.21.15.72:0/2717289682 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c00e070 con 0x7f0144154080 2023-08-31T18:48:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.377+0000 7f0148f99700 1 -- 172.21.15.72:0/2717289682 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c00bbf0 con 0x7f0144154080 2023-08-31T18:48:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.377+0000 7f0148f99700 1 -- 172.21.15.72:0/2717289682 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c012410 con 0x7f0144154080 2023-08-31T18:48:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.378+0000 7f014c1ff700 1 -- 172.21.15.72:0/2717289682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0144154080 msgr2=0x7f0144063100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.378+0000 7f014c1ff700 1 --2- 172.21.15.72:0/2717289682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0144154080 0x7f0144063100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f013c009e60 tx=0x7f013c009780).stop 2023-08-31T18:48:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.378+0000 7f014c1ff700 1 -- 172.21.15.72:0/2717289682 shutdown_connections 2023-08-31T18:48:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.378+0000 7f014c1ff700 1 --2- 172.21.15.72:0/2717289682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0144154080 0x7f0144063100 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.378+0000 7f014c1ff700 1 -- 172.21.15.72:0/2717289682 >> 172.21.15.72:0/2717289682 conn(0x7f01440cadb0 msgr2=0x7f01440cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:04.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.378+0000 7f014c1ff700 1 -- 172.21.15.72:0/2717289682 shutdown_connections 2023-08-31T18:48:04.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.378+0000 7f014c1ff700 1 -- 172.21.15.72:0/2717289682 wait complete. 2023-08-31T18:48:04.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.379+0000 7f014c1ff700 1 Processor -- start 2023-08-31T18:48:04.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.380+0000 7f014c1ff700 1 -- start start 2023-08-31T18:48:04.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.380+0000 7f014c1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01440c8ee0 0x7f014414f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:04.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.380+0000 7f014c1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0144153ca0 0x7f01440c3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:04.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.380+0000 7f014c1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0144154080 0x7f01440c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.380+0000 7f014c1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01440c3be0 con 0x7f0144153ca0 2023-08-31T18:48:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.380+0000 7f014c1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01440c4a40 con 0x7f01440c8ee0 2023-08-31T18:48:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.380+0000 7f014c1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01440c2de0 con 0x7f0144154080 2023-08-31T18:48:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.381+0000 7f014979a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0144153ca0 0x7f01440c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.381+0000 7f014979a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0144153ca0 0x7f01440c3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51362/0 (socket says 172.21.15.72:51362) 2023-08-31T18:48:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.381+0000 7f014979a700 1 -- 172.21.15.72:0/2905955193 learned_addr learned my addr 172.21.15.72:0/2905955193 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:04.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.381+0000 7f014a79c700 1 --2- 172.21.15.72:0/2905955193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0144154080 0x7f01440c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:04.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.381+0000 7f0149f9b700 1 --2- 172.21.15.72:0/2905955193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01440c8ee0 0x7f014414f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:04.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.381+0000 7f014979a700 1 -- 172.21.15.72:0/2905955193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0144154080 msgr2=0x7f01440c04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.381+0000 7f014979a700 1 --2- 172.21.15.72:0/2905955193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0144154080 0x7f01440c04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.381+0000 7f014979a700 1 -- 172.21.15.72:0/2905955193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01440c8ee0 msgr2=0x7f014414f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.381+0000 7f014979a700 1 --2- 172.21.15.72:0/2905955193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01440c8ee0 0x7f014414f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.381+0000 7f014979a700 1 -- 172.21.15.72:0/2905955193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c009a20 con 0x7f0144153ca0 2023-08-31T18:48:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.381+0000 7f0149f9b700 1 --2- 172.21.15.72:0/2905955193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01440c8ee0 0x7f014414f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:04.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.381+0000 7f014979a700 1 --2- 172.21.15.72:0/2905955193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0144153ca0 0x7f01440c3250 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f013400c4e0 tx=0x7f0134007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:04.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.381+0000 7f0139ffb700 1 -- 172.21.15.72:0/2905955193 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01340072e0 con 0x7f0144153ca0 2023-08-31T18:48:04.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.381+0000 7f0139ffb700 1 -- 172.21.15.72:0/2905955193 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0134007440 con 0x7f0144153ca0 2023-08-31T18:48:04.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.382+0000 7f014c1ff700 1 -- 172.21.15.72:0/2905955193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01440c3e30 con 0x7f0144153ca0 2023-08-31T18:48:04.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.382+0000 7f0139ffb700 1 -- 172.21.15.72:0/2905955193 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01340057a0 con 0x7f0144153ca0 2023-08-31T18:48:04.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.382+0000 7f014c1ff700 1 -- 172.21.15.72:0/2905955193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01440c43f0 con 0x7f0144153ca0 2023-08-31T18:48:04.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.383+0000 7f014c1ff700 1 -- 172.21.15.72:0/2905955193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014406c6b0 con 0x7f0144153ca0 2023-08-31T18:48:04.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.383+0000 7f0139ffb700 1 -- 172.21.15.72:0/2905955193 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f0134005bd0 con 0x7f0144153ca0 2023-08-31T18:48:04.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.384+0000 7f0139ffb700 1 --2- 172.21.15.72:0/2905955193 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f012805ee10 0x7f01280612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:04.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.384+0000 7f0139ffb700 1 -- 172.21.15.72:0/2905955193 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0134079760 con 0x7f0144153ca0 2023-08-31T18:48:04.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.384+0000 7f0149f9b700 1 --2- 172.21.15.72:0/2905955193 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f012805ee10 0x7f01280612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:04.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.385+0000 7f0149f9b700 1 --2- 172.21.15.72:0/2905955193 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f012805ee10 0x7f01280612d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0140002780 tx=0x7f0140009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:04.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.388+0000 7f0139ffb700 1 -- 172.21.15.72:0/2905955193 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f013404ab10 con 0x7f0144153ca0 2023-08-31T18:48:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.559+0000 7f014c1ff700 1 -- 172.21.15.72:0/2905955193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f01440c8cc0 con 0x7f0144153ca0 2023-08-31T18:48:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.559+0000 7f0139ffb700 1 -- 172.21.15.72:0/2905955193 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0134018020 con 0x7f0144153ca0 2023-08-31T18:48:04.560 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2023-08-31T18:48:04.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.561+0000 7f014c1ff700 1 -- 172.21.15.72:0/2905955193 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f012805ee10 msgr2=0x7f01280612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:04.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.561+0000 7f014c1ff700 1 --2- 172.21.15.72:0/2905955193 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f012805ee10 0x7f01280612d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0140002780 tx=0x7f0140009040).stop 2023-08-31T18:48:04.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.561+0000 7f014c1ff700 1 -- 172.21.15.72:0/2905955193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0144153ca0 msgr2=0x7f01440c3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.561+0000 7f014c1ff700 1 --2- 172.21.15.72:0/2905955193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0144153ca0 0x7f01440c3250 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f013400c4e0 tx=0x7f0134007c70).stop 2023-08-31T18:48:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.561+0000 7f014c1ff700 1 -- 172.21.15.72:0/2905955193 shutdown_connections 2023-08-31T18:48:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.561+0000 7f014c1ff700 1 --2- 172.21.15.72:0/2905955193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0144154080 0x7f01440c04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.561+0000 7f014c1ff700 1 --2- 172.21.15.72:0/2905955193 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f012805ee10 0x7f01280612d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.561+0000 7f014c1ff700 1 --2- 172.21.15.72:0/2905955193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01440c8ee0 0x7f014414f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.561+0000 7f014c1ff700 1 --2- 172.21.15.72:0/2905955193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0144153ca0 0x7f01440c3250 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.561+0000 7f014c1ff700 1 -- 172.21.15.72:0/2905955193 >> 172.21.15.72:0/2905955193 conn(0x7f01440cadb0 msgr2=0x7f0144150130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.561+0000 7f014c1ff700 1 -- 172.21.15.72:0/2905955193 shutdown_connections 2023-08-31T18:48:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.561+0000 7f014c1ff700 1 -- 172.21.15.72:0/2905955193 wait complete. 2023-08-31T18:48:04.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-08-31T18:48:04.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-31T18:48:04.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.767+0000 7f5de05ff700 1 Processor -- start 2023-08-31T18:48:04.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.767+0000 7f5de05ff700 1 -- start start 2023-08-31T18:48:04.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.768+0000 7f5de05ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5dd8154080 0x7f5dd8063100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:04.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.768+0000 7f5de05ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd80cac00 con 0x7f5dd80c8ee0 2023-08-31T18:48:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.768+0000 7f5de05ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd80c9450 con 0x7f5dd8153ca0 2023-08-31T18:48:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.768+0000 7f5de05ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd80c9730 con 0x7f5dd8154080 2023-08-31T18:48:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.768+0000 7f5dddb9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5dd80c8ee0 0x7f5dd80ca4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36890/0 (socket says 172.21.15.72:36890) 2023-08-31T18:48:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.768+0000 7f5dddb9a700 1 -- 172.21.15.72:0/363566925 learned_addr learned my addr 172.21.15.72:0/363566925 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.768+0000 7f5ddeb9c700 1 --2- 172.21.15.72:0/363566925 >> v2:172.21.15.146:3300/0 conn(0x7f5dd8154080 0x7f5dd8063100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:04.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.769+0000 7f5ddd399700 1 -- 172.21.15.72:0/363566925 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841099095 0 0) 0x7f5dd80cac00 con 0x7f5dd80c8ee0 2023-08-31T18:48:04.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.769+0000 7f5ddd399700 1 -- 172.21.15.72:0/363566925 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dc40033f0 con 0x7f5dd80c8ee0 2023-08-31T18:48:04.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.769+0000 7f5ddeb9c700 1 -- 172.21.15.72:0/363566925 >> v1:172.21.15.146:6789/0 conn(0x7f5dd8153ca0 legacy=0x7f5dd8158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.769+0000 7f5ddd399700 1 -- 172.21.15.72:0/363566925 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3475517561 0 0) 0x7f5dc40033f0 con 0x7f5dd80c8ee0 2023-08-31T18:48:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.769+0000 7f5ddeb9c700 1 -- 172.21.15.72:0/363566925 >> v1:172.21.15.72:6789/0 conn(0x7f5dd80c8ee0 legacy=0x7f5dd80ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.769+0000 7f5ddeb9c700 1 -- 172.21.15.72:0/363566925 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd80c9a10 con 0x7f5dd8154080 2023-08-31T18:48:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.769+0000 7f5ddeb9c700 1 --2- 172.21.15.72:0/363566925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd8154080 0x7f5dd8063100 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5dd0009e60 tx=0x7f5dd0009780).ready entity=mon.1 client_cookie=b877e7da2e509f12 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.769+0000 7f5ddd399700 1 -- 172.21.15.72:0/363566925 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000e070 con 0x7f5dd8154080 2023-08-31T18:48:04.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.769+0000 7f5ddd399700 1 -- 172.21.15.72:0/363566925 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd000b850 con 0x7f5dd8154080 2023-08-31T18:48:04.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.769+0000 7f5ddd399700 1 -- 172.21.15.72:0/363566925 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8001470 con 0x7f5dd8154080 2023-08-31T18:48:04.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.770+0000 7f5de05ff700 1 -- 172.21.15.72:0/363566925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd8154080 msgr2=0x7f5dd8063100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:04.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.770+0000 7f5de05ff700 1 --2- 172.21.15.72:0/363566925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd8154080 0x7f5dd8063100 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5dd0009e60 tx=0x7f5dd0009780).stop 2023-08-31T18:48:04.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.770+0000 7f5de05ff700 1 -- 172.21.15.72:0/363566925 shutdown_connections 2023-08-31T18:48:04.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.770+0000 7f5de05ff700 1 --2- 172.21.15.72:0/363566925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd8154080 0x7f5dd8063100 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.770+0000 7f5de05ff700 1 -- 172.21.15.72:0/363566925 >> 172.21.15.72:0/363566925 conn(0x7f5dd80cadb0 msgr2=0x7f5dd80cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:04.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.770+0000 7f5de05ff700 1 -- 172.21.15.72:0/363566925 shutdown_connections 2023-08-31T18:48:04.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.770+0000 7f5de05ff700 1 -- 172.21.15.72:0/363566925 wait complete. 2023-08-31T18:48:04.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.771+0000 7f5de05ff700 1 Processor -- start 2023-08-31T18:48:04.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.772+0000 7f5de05ff700 1 -- start start 2023-08-31T18:48:04.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.772+0000 7f5de05ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd80c8ee0 0x7f5dd814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:04.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.772+0000 7f5de05ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8153ca0 0x7f5dd80b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:04.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.773+0000 7f5de05ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5dd8154080 0x7f5dd80abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:04.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.773+0000 7f5de05ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd814fc00 con 0x7f5dd8153ca0 2023-08-31T18:48:04.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.773+0000 7f5de05ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd80c3910 con 0x7f5dd80c8ee0 2023-08-31T18:48:04.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.773+0000 7f5de05ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd80c2fe0 con 0x7f5dd8154080 2023-08-31T18:48:04.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.773+0000 7f5dddb9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8153ca0 0x7f5dd80b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:04.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.773+0000 7f5dddb9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8153ca0 0x7f5dd80b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51364/0 (socket says 172.21.15.72:51364) 2023-08-31T18:48:04.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.773+0000 7f5dddb9a700 1 -- 172.21.15.72:0/2035877344 learned_addr learned my addr 172.21.15.72:0/2035877344 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:04.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.773+0000 7f5dde39b700 1 --2- 172.21.15.72:0/2035877344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd80c8ee0 0x7f5dd814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:04.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.773+0000 7f5ddeb9c700 1 --2- 172.21.15.72:0/2035877344 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5dd8154080 0x7f5dd80abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:04.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.773+0000 7f5dddb9a700 1 -- 172.21.15.72:0/2035877344 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5dd8154080 msgr2=0x7f5dd80abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:04.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.773+0000 7f5dddb9a700 1 --2- 172.21.15.72:0/2035877344 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5dd8154080 0x7f5dd80abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.773+0000 7f5dddb9a700 1 -- 172.21.15.72:0/2035877344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd80c8ee0 msgr2=0x7f5dd814ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:04.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.773+0000 7f5dddb9a700 1 --2- 172.21.15.72:0/2035877344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd80c8ee0 0x7f5dd814ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.773+0000 7f5dddb9a700 1 -- 172.21.15.72:0/2035877344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd0009a20 con 0x7f5dd8153ca0 2023-08-31T18:48:04.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.773+0000 7f5dddb9a700 1 --2- 172.21.15.72:0/2035877344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8153ca0 0x7f5dd80b0640 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f5dc800c760 tx=0x7f5dc8001a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:04.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.774+0000 7f5dce7fc700 1 -- 172.21.15.72:0/2035877344 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8007170 con 0x7f5dd8153ca0 2023-08-31T18:48:04.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.774+0000 7f5dce7fc700 1 -- 172.21.15.72:0/2035877344 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc8007310 con 0x7f5dd8153ca0 2023-08-31T18:48:04.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.774+0000 7f5de05ff700 1 -- 172.21.15.72:0/2035877344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd80c32c0 con 0x7f5dd8153ca0 2023-08-31T18:48:04.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.774+0000 7f5dce7fc700 1 -- 172.21.15.72:0/2035877344 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc80048c0 con 0x7f5dd8153ca0 2023-08-31T18:48:04.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.774+0000 7f5de05ff700 1 -- 172.21.15.72:0/2035877344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd814f0d0 con 0x7f5dd8153ca0 2023-08-31T18:48:04.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.775+0000 7f5de05ff700 1 -- 172.21.15.72:0/2035877344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd80c3a80 con 0x7f5dd8153ca0 2023-08-31T18:48:04.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.776+0000 7f5dce7fc700 1 -- 172.21.15.72:0/2035877344 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f5dc8004c30 con 0x7f5dd8153ca0 2023-08-31T18:48:04.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.776+0000 7f5dce7fc700 1 --2- 172.21.15.72:0/2035877344 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5dbc05ee10 0x7f5dbc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:04.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.776+0000 7f5dce7fc700 1 -- 172.21.15.72:0/2035877344 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5dc80797e0 con 0x7f5dd8153ca0 2023-08-31T18:48:04.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.776+0000 7f5dde39b700 1 --2- 172.21.15.72:0/2035877344 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5dbc05ee10 0x7f5dbc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:04.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.777+0000 7f5dde39b700 1 --2- 172.21.15.72:0/2035877344 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5dbc05ee10 0x7f5dbc0612d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5dd4003a00 tx=0x7f5dd4007c40).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:04.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.780+0000 7f5dce7fc700 1 -- 172.21.15.72:0/2035877344 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5dc804ac50 con 0x7f5dd8153ca0 2023-08-31T18:48:04.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.947+0000 7f5de05ff700 1 -- 172.21.15.72:0/2035877344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5dd806c6b0 con 0x7f5dd8153ca0 2023-08-31T18:48:04.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.948+0000 7f5dce7fc700 1 -- 172.21.15.72:0/2035877344 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5dc804e270 con 0x7f5dd8153ca0 2023-08-31T18:48:04.948 INFO:teuthology.orchestra.run.smithi072.stdout:55834574853 2023-08-31T18:48:04.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.950+0000 7f5de05ff700 1 -- 172.21.15.72:0/2035877344 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5dbc05ee10 msgr2=0x7f5dbc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:04.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.950+0000 7f5de05ff700 1 --2- 172.21.15.72:0/2035877344 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5dbc05ee10 0x7f5dbc0612d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5dd4003a00 tx=0x7f5dd4007c40).stop 2023-08-31T18:48:04.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.950+0000 7f5de05ff700 1 -- 172.21.15.72:0/2035877344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8153ca0 msgr2=0x7f5dd80b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:04.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.950+0000 7f5de05ff700 1 --2- 172.21.15.72:0/2035877344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8153ca0 0x7f5dd80b0640 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f5dc800c760 tx=0x7f5dc8001a50).stop 2023-08-31T18:48:04.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.950+0000 7f5de05ff700 1 -- 172.21.15.72:0/2035877344 shutdown_connections 2023-08-31T18:48:04.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.950+0000 7f5de05ff700 1 --2- 172.21.15.72:0/2035877344 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5dd8154080 0x7f5dd80abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.950+0000 7f5de05ff700 1 --2- 172.21.15.72:0/2035877344 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5dbc05ee10 0x7f5dbc0612d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.950+0000 7f5de05ff700 1 --2- 172.21.15.72:0/2035877344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd80c8ee0 0x7f5dd814ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.950+0000 7f5de05ff700 1 --2- 172.21.15.72:0/2035877344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dd8153ca0 0x7f5dd80b0640 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:04.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.950+0000 7f5de05ff700 1 -- 172.21.15.72:0/2035877344 >> 172.21.15.72:0/2035877344 conn(0x7f5dd80cadb0 msgr2=0x7f5dd80c1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:04.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.950+0000 7f5de05ff700 1 -- 172.21.15.72:0/2035877344 shutdown_connections 2023-08-31T18:48:04.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:04.950+0000 7f5de05ff700 1 -- 172.21.15.72:0/2035877344 wait complete. 2023-08-31T18:48:04.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2023-08-31T18:48:04.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-31T18:48:05.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.155+0000 7f03751ff700 1 Processor -- start 2023-08-31T18:48:05.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.155+0000 7f03751ff700 1 -- start start 2023-08-31T18:48:05.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.157+0000 7f03751ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03700c8ee0 0x7f0370154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:05.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.157+0000 7f03751ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03700c9450 con 0x7f03700ca4f0 2023-08-31T18:48:05.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.157+0000 7f03751ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03700c9730 con 0x7f0370153ca0 2023-08-31T18:48:05.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.157+0000 7f03751ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03700c9a10 con 0x7f03700c8ee0 2023-08-31T18:48:05.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.157+0000 7f036f59e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f03700ca4f0 0x7f0370063100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36896/0 (socket says 172.21.15.72:36896) 2023-08-31T18:48:05.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.157+0000 7f036f59e700 1 -- 172.21.15.72:0/4293573931 learned_addr learned my addr 172.21.15.72:0/4293573931 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:05.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.157+0000 7f036e59c700 1 --2- 172.21.15.72:0/4293573931 >> v2:172.21.15.146:3300/0 conn(0x7f03700c8ee0 0x7f0370154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:05.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.157+0000 7f036dd9b700 1 -- 172.21.15.72:0/4293573931 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269372530 0 0) 0x7f03700c9450 con 0x7f03700ca4f0 2023-08-31T18:48:05.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.157+0000 7f036dd9b700 1 -- 172.21.15.72:0/4293573931 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03580033f0 con 0x7f03700ca4f0 2023-08-31T18:48:05.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.157+0000 7f036dd9b700 1 -- 172.21.15.72:0/4293573931 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92387981 0 0) 0x7f03700c9730 con 0x7f0370153ca0 2023-08-31T18:48:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.157+0000 7f036dd9b700 1 -- 172.21.15.72:0/4293573931 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03700c9450 con 0x7f0370153ca0 2023-08-31T18:48:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.157+0000 7f036e59c700 1 -- 172.21.15.72:0/4293573931 >> v1:172.21.15.146:6789/0 conn(0x7f0370153ca0 legacy=0x7f0370158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.157+0000 7f036e59c700 1 -- 172.21.15.72:0/4293573931 >> v1:172.21.15.72:6789/0 conn(0x7f03700ca4f0 legacy=0x7f0370063100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.157+0000 7f036dd9b700 1 -- 172.21.15.72:0/4293573931 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1934803432 0 0) 0x7f03580033f0 con 0x7f03700ca4f0 2023-08-31T18:48:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.158+0000 7f036e59c700 1 -- 172.21.15.72:0/4293573931 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03700c9cf0 con 0x7f03700c8ee0 2023-08-31T18:48:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.158+0000 7f036e59c700 1 --2- 172.21.15.72:0/4293573931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03700c8ee0 0x7f0370154080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f0364009760 tx=0x7f0364009060).ready entity=mon.1 client_cookie=de5dbb5fbdfdbe55 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:05.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.158+0000 7f036dd9b700 1 -- 172.21.15.72:0/4293573931 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03680017f0 con 0x7f03700c8ee0 2023-08-31T18:48:05.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.158+0000 7f036dd9b700 1 -- 172.21.15.72:0/4293573931 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0364011400 con 0x7f03700c8ee0 2023-08-31T18:48:05.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.158+0000 7f036dd9b700 1 -- 172.21.15.72:0/4293573931 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0364011780 con 0x7f03700c8ee0 2023-08-31T18:48:05.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.158+0000 7f03751ff700 1 -- 172.21.15.72:0/4293573931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03700c8ee0 msgr2=0x7f0370154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.158+0000 7f03751ff700 1 --2- 172.21.15.72:0/4293573931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03700c8ee0 0x7f0370154080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f0364009760 tx=0x7f0364009060).stop 2023-08-31T18:48:05.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.159+0000 7f03751ff700 1 -- 172.21.15.72:0/4293573931 shutdown_connections 2023-08-31T18:48:05.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.159+0000 7f03751ff700 1 --2- 172.21.15.72:0/4293573931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03700c8ee0 0x7f0370154080 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.159+0000 7f03751ff700 1 -- 172.21.15.72:0/4293573931 >> 172.21.15.72:0/4293573931 conn(0x7f03700cadb0 msgr2=0x7f03700cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:05.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.159+0000 7f03751ff700 1 -- 172.21.15.72:0/4293573931 shutdown_connections 2023-08-31T18:48:05.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.159+0000 7f03751ff700 1 -- 172.21.15.72:0/4293573931 wait complete. 2023-08-31T18:48:05.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.160+0000 7f03751ff700 1 Processor -- start 2023-08-31T18:48:05.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.160+0000 7f03751ff700 1 -- start start 2023-08-31T18:48:05.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.161+0000 7f03751ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03700c8ee0 0x7f03700ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:05.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.161+0000 7f03751ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03700ca4f0 0x7f0370168260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:05.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.161+0000 7f03751ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0370153ca0 0x7f037014e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:05.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.161+0000 7f03751ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03701557c0 con 0x7f0370153ca0 2023-08-31T18:48:05.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.161+0000 7f03751ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0370168750 con 0x7f03700c8ee0 2023-08-31T18:48:05.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.161+0000 7f03751ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03700af490 con 0x7f03700ca4f0 2023-08-31T18:48:05.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.161+0000 7f036f59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0370153ca0 0x7f037014e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:05.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.161+0000 7f036f59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0370153ca0 0x7f037014e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51366/0 (socket says 172.21.15.72:51366) 2023-08-31T18:48:05.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.161+0000 7f036f59e700 1 -- 172.21.15.72:0/3079892052 learned_addr learned my addr 172.21.15.72:0/3079892052 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:05.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.162+0000 7f036e59c700 1 --2- 172.21.15.72:0/3079892052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03700ca4f0 0x7f0370168260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:05.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.162+0000 7f036ed9d700 1 --2- 172.21.15.72:0/3079892052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03700c8ee0 0x7f03700ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:05.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.162+0000 7f036f59e700 1 -- 172.21.15.72:0/3079892052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03700ca4f0 msgr2=0x7f0370168260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.162+0000 7f036f59e700 1 --2- 172.21.15.72:0/3079892052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03700ca4f0 0x7f0370168260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.162+0000 7f036f59e700 1 -- 172.21.15.72:0/3079892052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03700c8ee0 msgr2=0x7f03700ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.162+0000 7f036f59e700 1 --2- 172.21.15.72:0/3079892052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03700c8ee0 0x7f03700ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.162+0000 7f036f59e700 1 -- 172.21.15.72:0/3079892052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03640092a0 con 0x7f0370153ca0 2023-08-31T18:48:05.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.162+0000 7f036f59e700 1 --2- 172.21.15.72:0/3079892052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0370153ca0 0x7f037014e880 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f036800cb70 tx=0x7f0368001e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:05.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.162+0000 7f0356ffd700 1 -- 172.21.15.72:0/3079892052 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368004c40 con 0x7f0370153ca0 2023-08-31T18:48:05.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.162+0000 7f0356ffd700 1 -- 172.21.15.72:0/3079892052 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0368004da0 con 0x7f0370153ca0 2023-08-31T18:48:05.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.162+0000 7f03751ff700 1 -- 172.21.15.72:0/3079892052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03700ae6e0 con 0x7f0370153ca0 2023-08-31T18:48:05.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.162+0000 7f0356ffd700 1 -- 172.21.15.72:0/3079892052 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368007380 con 0x7f0370153ca0 2023-08-31T18:48:05.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.162+0000 7f03751ff700 1 -- 172.21.15.72:0/3079892052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03700aeca0 con 0x7f0370153ca0 2023-08-31T18:48:05.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.163+0000 7f03751ff700 1 -- 172.21.15.72:0/3079892052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037006c6b0 con 0x7f0370153ca0 2023-08-31T18:48:05.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.164+0000 7f0356ffd700 1 -- 172.21.15.72:0/3079892052 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f0368007770 con 0x7f0370153ca0 2023-08-31T18:48:05.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.165+0000 7f0356ffd700 1 --2- 172.21.15.72:0/3079892052 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f035c05ee40 0x7f035c061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:05.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.165+0000 7f0356ffd700 1 -- 172.21.15.72:0/3079892052 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f036807a3a0 con 0x7f0370153ca0 2023-08-31T18:48:05.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.165+0000 7f036ed9d700 1 --2- 172.21.15.72:0/3079892052 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f035c05ee40 0x7f035c061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:05.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.166+0000 7f036ed9d700 1 --2- 172.21.15.72:0/3079892052 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f035c05ee40 0x7f035c061300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f0360003660 tx=0x7f0360009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:05.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.169+0000 7f0356ffd700 1 -- 172.21.15.72:0/3079892052 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f036804b750 con 0x7f0370153ca0 2023-08-31T18:48:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.339+0000 7f03751ff700 1 -- 172.21.15.72:0/3079892052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f03700c9fd0 con 0x7f0370153ca0 2023-08-31T18:48:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.340+0000 7f0356ffd700 1 -- 172.21.15.72:0/3079892052 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f036804ed70 con 0x7f0370153ca0 2023-08-31T18:48:05.340 INFO:teuthology.orchestra.run.smithi072.stdout:55834574854 2023-08-31T18:48:05.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.342+0000 7f03751ff700 1 -- 172.21.15.72:0/3079892052 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f035c05ee40 msgr2=0x7f035c061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.342+0000 7f03751ff700 1 --2- 172.21.15.72:0/3079892052 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f035c05ee40 0x7f035c061300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f0360003660 tx=0x7f0360009040).stop 2023-08-31T18:48:05.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.342+0000 7f03751ff700 1 -- 172.21.15.72:0/3079892052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0370153ca0 msgr2=0x7f037014e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.342+0000 7f03751ff700 1 --2- 172.21.15.72:0/3079892052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0370153ca0 0x7f037014e880 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f036800cb70 tx=0x7f0368001e80).stop 2023-08-31T18:48:05.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.342+0000 7f03751ff700 1 -- 172.21.15.72:0/3079892052 shutdown_connections 2023-08-31T18:48:05.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.342+0000 7f03751ff700 1 --2- 172.21.15.72:0/3079892052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0370153ca0 0x7f037014e880 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.342+0000 7f03751ff700 1 --2- 172.21.15.72:0/3079892052 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f035c05ee40 0x7f035c061300 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.342+0000 7f03751ff700 1 --2- 172.21.15.72:0/3079892052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03700c8ee0 0x7f03700ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.342+0000 7f03751ff700 1 --2- 172.21.15.72:0/3079892052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03700ca4f0 0x7f0370168260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.342+0000 7f03751ff700 1 -- 172.21.15.72:0/3079892052 >> 172.21.15.72:0/3079892052 conn(0x7f03700cadb0 msgr2=0x7f03700c15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:05.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.342+0000 7f03751ff700 1 -- 172.21.15.72:0/3079892052 shutdown_connections 2023-08-31T18:48:05.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.342+0000 7f03751ff700 1 -- 172.21.15.72:0/3079892052 wait complete. 2023-08-31T18:48:05.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-08-31T18:48:05.359 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-31T18:48:05.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T18:48:05.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.548+0000 7f5bf39ff700 1 Processor -- start 2023-08-31T18:48:05.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.549+0000 7f5bf39ff700 1 -- start start 2023-08-31T18:48:05.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.550+0000 7f5bf39ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5bec154060 0x7f5bec157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:05.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.550+0000 7f5bf39ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bec0cb9b0 0x7f5bec1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:05.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.550+0000 7f5bf39ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec0c6120 con 0x7f5bec1586b0 2023-08-31T18:48:05.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.550+0000 7f5bf39ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec0c1380 con 0x7f5bec154060 2023-08-31T18:48:05.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.550+0000 7f5bf39ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec158b60 con 0x7f5bec0cb9b0 2023-08-31T18:48:05.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.550+0000 7f5bf0f9a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bec0cb9b0 0x7f5bec1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:05.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.550+0000 7f5bf179b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5bec154060 0x7f5bec157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:05.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.550+0000 7f5bf1f9c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5bec1586b0 0x7f5bec0c65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:49638/0 (socket says 172.21.15.72:49638) 2023-08-31T18:48:05.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.550+0000 7f5bf1f9c700 1 -- 172.21.15.72:0/2491790537 learned_addr learned my addr 172.21.15.72:0/2491790537 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:05.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.551+0000 7f5be3fff700 1 -- 172.21.15.72:0/2491790537 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223388802 0 0) 0x7f5bec0c6120 con 0x7f5bec1586b0 2023-08-31T18:48:05.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.551+0000 7f5be3fff700 1 -- 172.21.15.72:0/2491790537 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd80033f0 con 0x7f5bec1586b0 2023-08-31T18:48:05.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.551+0000 7f5bf179b700 1 -- 172.21.15.72:0/2491790537 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bec0cb9b0 msgr2=0x7f5bec1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:05.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.551+0000 7f5bf179b700 1 --2- 172.21.15.72:0/2491790537 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bec0cb9b0 0x7f5bec1581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.551+0000 7f5bf179b700 1 -- 172.21.15.72:0/2491790537 >> v1:172.21.15.146:6789/0 conn(0x7f5bec1586b0 legacy=0x7f5bec0c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.551+0000 7f5bf179b700 1 -- 172.21.15.72:0/2491790537 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0c5e10 con 0x7f5bec154060 2023-08-31T18:48:05.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.551+0000 7f5bf0f9a700 1 --2- 172.21.15.72:0/2491790537 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bec0cb9b0 0x7f5bec1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:05.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.551+0000 7f5bf179b700 1 --2- 172.21.15.72:0/2491790537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec154060 0x7f5bec157cd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5be8009760 tx=0x7f5be8006f40).ready entity=mon.1 client_cookie=21326c09e5dcbc98 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.551+0000 7f5be3fff700 1 -- 172.21.15.72:0/2491790537 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8005880 con 0x7f5bec154060 2023-08-31T18:48:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.551+0000 7f5be3fff700 1 -- 172.21.15.72:0/2491790537 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be80059e0 con 0x7f5bec154060 2023-08-31T18:48:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.551+0000 7f5be3fff700 1 -- 172.21.15.72:0/2491790537 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8005d60 con 0x7f5bec154060 2023-08-31T18:48:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.552+0000 7f5bf39ff700 1 -- 172.21.15.72:0/2491790537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec154060 msgr2=0x7f5bec157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.552+0000 7f5bf39ff700 1 --2- 172.21.15.72:0/2491790537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec154060 0x7f5bec157cd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5be8009760 tx=0x7f5be8006f40).stop 2023-08-31T18:48:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.552+0000 7f5bf39ff700 1 -- 172.21.15.72:0/2491790537 shutdown_connections 2023-08-31T18:48:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.552+0000 7f5bf39ff700 1 --2- 172.21.15.72:0/2491790537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec154060 0x7f5bec157cd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.552+0000 7f5bf39ff700 1 --2- 172.21.15.72:0/2491790537 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bec0cb9b0 0x7f5bec1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.552+0000 7f5bf39ff700 1 -- 172.21.15.72:0/2491790537 >> 172.21.15.72:0/2491790537 conn(0x7f5bec05e870 msgr2=0x7f5bec0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.552+0000 7f5bf39ff700 1 -- 172.21.15.72:0/2491790537 shutdown_connections 2023-08-31T18:48:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.552+0000 7f5bf39ff700 1 -- 172.21.15.72:0/2491790537 wait complete. 2023-08-31T18:48:05.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.553+0000 7f5bf39ff700 1 Processor -- start 2023-08-31T18:48:05.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.554+0000 7f5bf39ff700 1 -- start start 2023-08-31T18:48:05.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf39ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec0cb9b0 0x7f5bec0b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:05.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf39ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bec154060 0x7f5bec0aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:05.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf39ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bec1586b0 0x7f5bec0abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:05.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf39ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0ac3e0 con 0x7f5bec154060 2023-08-31T18:48:05.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf39ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0ae7b0 con 0x7f5bec0cb9b0 2023-08-31T18:48:05.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf39ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1526e0 con 0x7f5bec1586b0 2023-08-31T18:48:05.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf0f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bec154060 0x7f5bec0aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:05.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf0f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bec154060 0x7f5bec0aba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51372/0 (socket says 172.21.15.72:51372) 2023-08-31T18:48:05.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf0f9a700 1 -- 172.21.15.72:0/2712664009 learned_addr learned my addr 172.21.15.72:0/2712664009 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:05.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf179b700 1 --2- 172.21.15.72:0/2712664009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec0cb9b0 0x7f5bec0b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:05.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf1f9c700 1 --2- 172.21.15.72:0/2712664009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bec1586b0 0x7f5bec0abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:05.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf0f9a700 1 -- 172.21.15.72:0/2712664009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bec1586b0 msgr2=0x7f5bec0abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf0f9a700 1 --2- 172.21.15.72:0/2712664009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bec1586b0 0x7f5bec0abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf0f9a700 1 -- 172.21.15.72:0/2712664009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec0cb9b0 msgr2=0x7f5bec0b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf0f9a700 1 --2- 172.21.15.72:0/2712664009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec0cb9b0 0x7f5bec0b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf0f9a700 1 -- 172.21.15.72:0/2712664009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc0092a0 con 0x7f5bec154060 2023-08-31T18:48:05.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.555+0000 7f5bf0f9a700 1 --2- 172.21.15.72:0/2712664009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bec154060 0x7f5bec0aba00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f5bdc00ea20 tx=0x7f5bdc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:05.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.556+0000 7f5be17fa700 1 -- 172.21.15.72:0/2712664009 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00ee60 con 0x7f5bec154060 2023-08-31T18:48:05.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.556+0000 7f5be17fa700 1 -- 172.21.15.72:0/2712664009 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00c850 con 0x7f5bec154060 2023-08-31T18:48:05.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.556+0000 7f5be17fa700 1 -- 172.21.15.72:0/2712664009 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00cbd0 con 0x7f5bec154060 2023-08-31T18:48:05.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.556+0000 7f5bf39ff700 1 -- 172.21.15.72:0/2712664009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be8009250 con 0x7f5bec154060 2023-08-31T18:48:05.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.556+0000 7f5bf39ff700 1 -- 172.21.15.72:0/2712664009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec0a9110 con 0x7f5bec154060 2023-08-31T18:48:05.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.557+0000 7f5bf39ff700 1 -- 172.21.15.72:0/2712664009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec0ae940 con 0x7f5bec154060 2023-08-31T18:48:05.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.558+0000 7f5be17fa700 1 -- 172.21.15.72:0/2712664009 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f5bdc01b400 con 0x7f5bec154060 2023-08-31T18:48:05.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.559+0000 7f5be17fa700 1 --2- 172.21.15.72:0/2712664009 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5bd005ee10 0x7f5bd00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:05.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.559+0000 7f5be17fa700 1 -- 172.21.15.72:0/2712664009 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5bdc07a310 con 0x7f5bec154060 2023-08-31T18:48:05.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.559+0000 7f5bf179b700 1 --2- 172.21.15.72:0/2712664009 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5bd005ee10 0x7f5bd00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:05.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.559+0000 7f5bf179b700 1 --2- 172.21.15.72:0/2712664009 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5bd005ee10 0x7f5bd00612d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5be8005fd0 tx=0x7f5be8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:05.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.562+0000 7f5be17fa700 1 -- 172.21.15.72:0/2712664009 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5bdc04b720 con 0x7f5bec154060 2023-08-31T18:48:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.728+0000 7f5bf39ff700 1 -- 172.21.15.72:0/2712664009 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5bec0c0ae0 con 0x7f5bd005ee10 2023-08-31T18:48:05.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.738+0000 7f5be17fa700 1 -- 172.21.15.72:0/2712664009 <== mgr.4101 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336338 (secure 0 0 0) 0x7f5bec0c0ae0 con 0x7f5bd005ee10 2023-08-31T18:48:05.742 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:05.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.742+0000 7f5bf39ff700 1 -- 172.21.15.72:0/2712664009 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5bd005ee10 msgr2=0x7f5bd00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.742+0000 7f5bf39ff700 1 --2- 172.21.15.72:0/2712664009 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5bd005ee10 0x7f5bd00612d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5be8005fd0 tx=0x7f5be8015000).stop 2023-08-31T18:48:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.742+0000 7f5bf39ff700 1 -- 172.21.15.72:0/2712664009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bec154060 msgr2=0x7f5bec0aba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.742+0000 7f5bf39ff700 1 --2- 172.21.15.72:0/2712664009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bec154060 0x7f5bec0aba00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f5bdc00ea20 tx=0x7f5bdc009060).stop 2023-08-31T18:48:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.743+0000 7f5bf39ff700 1 -- 172.21.15.72:0/2712664009 shutdown_connections 2023-08-31T18:48:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.743+0000 7f5bf39ff700 1 --2- 172.21.15.72:0/2712664009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5bec1586b0 0x7f5bec0abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.743+0000 7f5bf39ff700 1 --2- 172.21.15.72:0/2712664009 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5bd005ee10 0x7f5bd00612d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.743+0000 7f5bf39ff700 1 --2- 172.21.15.72:0/2712664009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec0cb9b0 0x7f5bec0b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.743+0000 7f5bf39ff700 1 --2- 172.21.15.72:0/2712664009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bec154060 0x7f5bec0aba00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.743+0000 7f5bf39ff700 1 -- 172.21.15.72:0/2712664009 >> 172.21.15.72:0/2712664009 conn(0x7f5bec05e870 msgr2=0x7f5bec0bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.743+0000 7f5bf39ff700 1 -- 172.21.15.72:0/2712664009 shutdown_connections 2023-08-31T18:48:05.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.743+0000 7f5bf39ff700 1 -- 172.21.15.72:0/2712664009 wait complete. 2023-08-31T18:48:05.748 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T18:48:05.759 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-31T18:48:05.159519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378528,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596192,"statfs":{"total":773094113280,"available":770658500608,"internally_reserved":0,"allocated":1802240,"data_stored":646476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001606"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999933+0000","last_change":"2023-08-31T18:47:52.992922+0000","last_active":"2023-08-31T18:47:52.999933+0000","last_peered":"2023-08-31T18:47:52.999933+0000","last_clean":"2023-08-31T18:47:52.999933+0000","last_became_active":"2023-08-31T18:47:52.992608+0000","last_became_peered":"2023-08-31T18:47:52.992608+0000","last_unstale":"2023-08-31T18:47:52.999933+0000","last_undegraded":"2023-08-31T18:47:52.999933+0000","last_fullsized":"2023-08-31T18:47:52.999933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.996800+0000","last_change":"2023-08-31T18:47:52.521541+0000","last_active":"2023-08-31T18:47:52.996800+0000","last_peered":"2023-08-31T18:47:52.996800+0000","last_clean":"2023-08-31T18:47:52.996800+0000","last_became_active":"2023-08-31T18:47:52.521217+0000","last_became_peered":"2023-08-31T18:47:52.521217+0000","last_unstale":"2023-08-31T18:47:52.996800+0000","last_undegraded":"2023-08-31T18:47:52.996800+0000","last_fullsized":"2023-08-31T18:47:52.996800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000193+0000","last_change":"2023-08-31T18:47:52.996417+0000","last_active":"2023-08-31T18:47:53.000193+0000","last_peered":"2023-08-31T18:47:53.000193+0000","last_clean":"2023-08-31T18:47:53.000193+0000","last_became_active":"2023-08-31T18:47:52.995862+0000","last_became_peered":"2023-08-31T18:47:52.995862+0000","last_unstale":"2023-08-31T18:47:53.000193+0000","last_undegraded":"2023-08-31T18:47:53.000193+0000","last_fullsized":"2023-08-31T18:47:53.000193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980914+0000","last_change":"2023-08-31T18:47:52.518722+0000","last_active":"2023-08-31T18:47:52.980914+0000","last_peered":"2023-08-31T18:47:52.980914+0000","last_clean":"2023-08-31T18:47:52.980914+0000","last_became_active":"2023-08-31T18:47:52.518419+0000","last_became_peered":"2023-08-31T18:47:52.518419+0000","last_unstale":"2023-08-31T18:47:52.980914+0000","last_undegraded":"2023-08-31T18:47:52.980914+0000","last_fullsized":"2023-08-31T18:47:52.980914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009855+0000","last_change":"2023-08-31T18:47:53.001560+0000","last_active":"2023-08-31T18:47:53.009855+0000","last_peered":"2023-08-31T18:47:53.009855+0000","last_clean":"2023-08-31T18:47:53.009855+0000","last_became_active":"2023-08-31T18:47:53.001270+0000","last_became_peered":"2023-08-31T18:47:53.001270+0000","last_unstale":"2023-08-31T18:47:53.009855+0000","last_undegraded":"2023-08-31T18:47:53.009855+0000","last_fullsized":"2023-08-31T18:47:53.009855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979087+0000","last_change":"2023-08-31T18:47:52.525069+0000","last_active":"2023-08-31T18:47:52.979087+0000","last_peered":"2023-08-31T18:47:52.979087+0000","last_clean":"2023-08-31T18:47:52.979087+0000","last_became_active":"2023-08-31T18:47:52.524768+0000","last_became_peered":"2023-08-31T18:47:52.524768+0000","last_unstale":"2023-08-31T18:47:52.979087+0000","last_undegraded":"2023-08-31T18:47:52.979087+0000","last_fullsized":"2023-08-31T18:47:52.979087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999959+0000","last_change":"2023-08-31T18:47:52.992909+0000","last_active":"2023-08-31T18:47:52.999959+0000","last_peered":"2023-08-31T18:47:52.999959+0000","last_clean":"2023-08-31T18:47:52.999959+0000","last_became_active":"2023-08-31T18:47:52.992649+0000","last_became_peered":"2023-08-31T18:47:52.992649+0000","last_unstale":"2023-08-31T18:47:52.999959+0000","last_undegraded":"2023-08-31T18:47:52.999959+0000","last_fullsized":"2023-08-31T18:47:52.999959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.987323+0000","last_change":"2023-08-31T18:47:52.535019+0000","last_active":"2023-08-31T18:47:52.987323+0000","last_peered":"2023-08-31T18:47:52.987323+0000","last_clean":"2023-08-31T18:47:52.987323+0000","last_became_active":"2023-08-31T18:47:52.534783+0000","last_became_peered":"2023-08-31T18:47:52.534783+0000","last_unstale":"2023-08-31T18:47:52.987323+0000","last_undegraded":"2023-08-31T18:47:52.987323+0000","last_fullsized":"2023-08-31T18:47:52.987323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000964+0000","last_change":"2023-08-31T18:47:52.998713+0000","last_active":"2023-08-31T18:47:53.000964+0000","last_peered":"2023-08-31T18:47:53.000964+0000","last_clean":"2023-08-31T18:47:53.000964+0000","last_became_active":"2023-08-31T18:47:52.998411+0000","last_became_peered":"2023-08-31T18:47:52.998411+0000","last_unstale":"2023-08-31T18:47:53.000964+0000","last_undegraded":"2023-08-31T18:47:53.000964+0000","last_fullsized":"2023-08-31T18:47:53.000964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.983910+0000","last_change":"2023-08-31T18:47:52.530799+0000","last_active":"2023-08-31T18:47:52.983910+0000","last_peered":"2023-08-31T18:47:52.983910+0000","last_clean":"2023-08-31T18:47:52.983910+0000","last_became_active":"2023-08-31T18:47:52.530384+0000","last_became_peered":"2023-08-31T18:47:52.530384+0000","last_unstale":"2023-08-31T18:47:52.983910+0000","last_undegraded":"2023-08-31T18:47:52.983910+0000","last_fullsized":"2023-08-31T18:47:52.983910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003882+0000","last_change":"2023-08-31T18:47:52.992664+0000","last_active":"2023-08-31T18:47:53.003882+0000","last_peered":"2023-08-31T18:47:53.003882+0000","last_clean":"2023-08-31T18:47:53.003882+0000","last_became_active":"2023-08-31T18:47:52.992340+0000","last_became_peered":"2023-08-31T18:47:52.992340+0000","last_unstale":"2023-08-31T18:47:53.003882+0000","last_undegraded":"2023-08-31T18:47:53.003882+0000","last_fullsized":"2023-08-31T18:47:53.003882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.008581+0000","last_change":"2023-08-31T18:47:52.518423+0000","last_active":"2023-08-31T18:47:53.008581+0000","last_peered":"2023-08-31T18:47:53.008581+0000","last_clean":"2023-08-31T18:47:53.008581+0000","last_became_active":"2023-08-31T18:47:52.518154+0000","last_became_peered":"2023-08-31T18:47:52.518154+0000","last_unstale":"2023-08-31T18:47:53.008581+0000","last_undegraded":"2023-08-31T18:47:53.008581+0000","last_fullsized":"2023-08-31T18:47:53.008581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013444+0000","last_change":"2023-08-31T18:47:53.010969+0000","last_active":"2023-08-31T18:47:53.013444+0000","last_peered":"2023-08-31T18:47:53.013444+0000","last_clean":"2023-08-31T18:47:53.013444+0000","last_became_active":"2023-08-31T18:47:53.010624+0000","last_became_peered":"2023-08-31T18:47:53.010624+0000","last_unstale":"2023-08-31T18:47:53.013444+0000","last_undegraded":"2023-08-31T18:47:53.013444+0000","last_fullsized":"2023-08-31T18:47:53.013444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.012371+0000","last_change":"2023-08-31T18:47:52.528781+0000","last_active":"2023-08-31T18:47:53.012371+0000","last_peered":"2023-08-31T18:47:53.012371+0000","last_clean":"2023-08-31T18:47:53.012371+0000","last_became_active":"2023-08-31T18:47:52.528511+0000","last_became_peered":"2023-08-31T18:47:52.528511+0000","last_unstale":"2023-08-31T18:47:53.012371+0000","last_undegraded":"2023-08-31T18:47:53.012371+0000","last_fullsized":"2023-08-31T18:47:53.012371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999774+0000","last_change":"2023-08-31T18:47:52.992861+0000","last_active":"2023-08-31T18:47:52.999774+0000","last_peered":"2023-08-31T18:47:52.999774+0000","last_clean":"2023-08-31T18:47:52.999774+0000","last_became_active":"2023-08-31T18:47:52.992558+0000","last_became_peered":"2023-08-31T18:47:52.992558+0000","last_unstale":"2023-08-31T18:47:52.999774+0000","last_undegraded":"2023-08-31T18:47:52.999774+0000","last_fullsized":"2023-08-31T18:47:52.999774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000569+0000","last_change":"2023-08-31T18:47:52.531835+0000","last_active":"2023-08-31T18:47:53.000569+0000","last_peered":"2023-08-31T18:47:53.000569+0000","last_clean":"2023-08-31T18:47:53.000569+0000","last_became_active":"2023-08-31T18:47:52.531561+0000","last_became_peered":"2023-08-31T18:47:52.531561+0000","last_unstale":"2023-08-31T18:47:53.000569+0000","last_undegraded":"2023-08-31T18:47:53.000569+0000","last_fullsized":"2023-08-31T18:47:53.000569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.011345+0000","last_change":"2023-08-31T18:47:53.006651+0000","last_active":"2023-08-31T18:47:53.011345+0000","last_peered":"2023-08-31T18:47:53.011345+0000","last_clean":"2023-08-31T18:47:53.011345+0000","last_became_active":"2023-08-31T18:47:53.006149+0000","last_became_peered":"2023-08-31T18:47:53.006149+0000","last_unstale":"2023-08-31T18:47:53.011345+0000","last_undegraded":"2023-08-31T18:47:53.011345+0000","last_fullsized":"2023-08-31T18:47:53.011345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984191+0000","last_change":"2023-08-31T18:47:52.526672+0000","last_active":"2023-08-31T18:47:52.984191+0000","last_peered":"2023-08-31T18:47:52.984191+0000","last_clean":"2023-08-31T18:47:52.984191+0000","last_became_active":"2023-08-31T18:47:52.526370+0000","last_became_peered":"2023-08-31T18:47:52.526370+0000","last_unstale":"2023-08-31T18:47:52.984191+0000","last_undegraded":"2023-08-31T18:47:52.984191+0000","last_fullsized":"2023-08-31T18:47:52.984191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000173+0000","last_change":"2023-08-31T18:47:52.996230+0000","last_active":"2023-08-31T18:47:53.000173+0000","last_peered":"2023-08-31T18:47:53.000173+0000","last_clean":"2023-08-31T18:47:53.000173+0000","last_became_active":"2023-08-31T18:47:52.995080+0000","last_became_peered":"2023-08-31T18:47:52.995080+0000","last_unstale":"2023-08-31T18:47:53.000173+0000","last_undegraded":"2023-08-31T18:47:53.000173+0000","last_fullsized":"2023-08-31T18:47:53.000173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993377+0000","last_change":"2023-08-31T18:47:52.523040+0000","last_active":"2023-08-31T18:47:52.993377+0000","last_peered":"2023-08-31T18:47:52.993377+0000","last_clean":"2023-08-31T18:47:52.993377+0000","last_became_active":"2023-08-31T18:47:52.522587+0000","last_became_peered":"2023-08-31T18:47:52.522587+0000","last_unstale":"2023-08-31T18:47:52.993377+0000","last_undegraded":"2023-08-31T18:47:52.993377+0000","last_fullsized":"2023-08-31T18:47:52.993377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.004847+0000","last_change":"2023-08-31T18:47:53.002154+0000","last_active":"2023-08-31T18:47:53.004847+0000","last_peered":"2023-08-31T18:47:53.004847+0000","last_clean":"2023-08-31T18:47:53.004847+0000","last_became_active":"2023-08-31T18:47:53.001849+0000","last_became_peered":"2023-08-31T18:47:53.001849+0000","last_unstale":"2023-08-31T18:47:53.004847+0000","last_undegraded":"2023-08-31T18:47:53.004847+0000","last_fullsized":"2023-08-31T18:47:53.004847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.995745+0000","last_change":"2023-08-31T18:47:52.526655+0000","last_active":"2023-08-31T18:47:52.995745+0000","last_peered":"2023-08-31T18:47:52.995745+0000","last_clean":"2023-08-31T18:47:52.995745+0000","last_became_active":"2023-08-31T18:47:52.525963+0000","last_became_peered":"2023-08-31T18:47:52.525963+0000","last_unstale":"2023-08-31T18:47:52.995745+0000","last_undegraded":"2023-08-31T18:47:52.995745+0000","last_fullsized":"2023-08-31T18:47:52.995745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009266+0000","last_change":"2023-08-31T18:47:52.997454+0000","last_active":"2023-08-31T18:47:53.009266+0000","last_peered":"2023-08-31T18:47:53.009266+0000","last_clean":"2023-08-31T18:47:53.009266+0000","last_became_active":"2023-08-31T18:47:52.997016+0000","last_became_peered":"2023-08-31T18:47:52.997016+0000","last_unstale":"2023-08-31T18:47:53.009266+0000","last_undegraded":"2023-08-31T18:47:53.009266+0000","last_fullsized":"2023-08-31T18:47:53.009266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013124+0000","last_change":"2023-08-31T18:47:52.523613+0000","last_active":"2023-08-31T18:47:53.013124+0000","last_peered":"2023-08-31T18:47:53.013124+0000","last_clean":"2023-08-31T18:47:53.013124+0000","last_became_active":"2023-08-31T18:47:52.522576+0000","last_became_peered":"2023-08-31T18:47:52.522576+0000","last_unstale":"2023-08-31T18:47:53.013124+0000","last_undegraded":"2023-08-31T18:47:53.013124+0000","last_fullsized":"2023-08-31T18:47:53.013124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010365+0000","last_change":"2023-08-31T18:47:53.005565+0000","last_active":"2023-08-31T18:47:53.010365+0000","last_peered":"2023-08-31T18:47:53.010365+0000","last_clean":"2023-08-31T18:47:53.010365+0000","last_became_active":"2023-08-31T18:47:53.005190+0000","last_became_peered":"2023-08-31T18:47:53.005190+0000","last_unstale":"2023-08-31T18:47:53.010365+0000","last_undegraded":"2023-08-31T18:47:53.010365+0000","last_fullsized":"2023-08-31T18:47:53.010365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.012195+0000","last_change":"2023-08-31T18:47:52.533431+0000","last_active":"2023-08-31T18:47:53.012195+0000","last_peered":"2023-08-31T18:47:53.012195+0000","last_clean":"2023-08-31T18:47:53.012195+0000","last_became_active":"2023-08-31T18:47:52.532932+0000","last_became_peered":"2023-08-31T18:47:52.532932+0000","last_unstale":"2023-08-31T18:47:53.012195+0000","last_undegraded":"2023-08-31T18:47:53.012195+0000","last_fullsized":"2023-08-31T18:47:53.012195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009811+0000","last_change":"2023-08-31T18:47:53.001374+0000","last_active":"2023-08-31T18:47:53.009811+0000","last_peered":"2023-08-31T18:47:53.009811+0000","last_clean":"2023-08-31T18:47:53.009811+0000","last_became_active":"2023-08-31T18:47:52.997729+0000","last_became_peered":"2023-08-31T18:47:52.997729+0000","last_unstale":"2023-08-31T18:47:53.009811+0000","last_undegraded":"2023-08-31T18:47:53.009811+0000","last_fullsized":"2023-08-31T18:47:53.009811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.988324+0000","last_change":"2023-08-31T18:47:52.534072+0000","last_active":"2023-08-31T18:47:52.988324+0000","last_peered":"2023-08-31T18:47:52.988324+0000","last_clean":"2023-08-31T18:47:52.988324+0000","last_became_active":"2023-08-31T18:47:52.533779+0000","last_became_peered":"2023-08-31T18:47:52.533779+0000","last_unstale":"2023-08-31T18:47:52.988324+0000","last_undegraded":"2023-08-31T18:47:52.988324+0000","last_fullsized":"2023-08-31T18:47:52.988324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.994371+0000","last_change":"2023-08-31T18:47:52.990541+0000","last_active":"2023-08-31T18:47:52.994371+0000","last_peered":"2023-08-31T18:47:52.994371+0000","last_clean":"2023-08-31T18:47:52.994371+0000","last_became_active":"2023-08-31T18:47:52.990287+0000","last_became_peered":"2023-08-31T18:47:52.990287+0000","last_unstale":"2023-08-31T18:47:52.994371+0000","last_undegraded":"2023-08-31T18:47:52.994371+0000","last_fullsized":"2023-08-31T18:47:52.994371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981085+0000","last_change":"2023-08-31T18:47:52.532002+0000","last_active":"2023-08-31T18:47:52.981085+0000","last_peered":"2023-08-31T18:47:52.981085+0000","last_clean":"2023-08-31T18:47:52.981085+0000","last_became_active":"2023-08-31T18:47:52.530907+0000","last_became_peered":"2023-08-31T18:47:52.530907+0000","last_unstale":"2023-08-31T18:47:52.981085+0000","last_undegraded":"2023-08-31T18:47:52.981085+0000","last_fullsized":"2023-08-31T18:47:52.981085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010346+0000","last_change":"2023-08-31T18:47:53.006764+0000","last_active":"2023-08-31T18:47:53.010346+0000","last_peered":"2023-08-31T18:47:53.010346+0000","last_clean":"2023-08-31T18:47:53.010346+0000","last_became_active":"2023-08-31T18:47:53.006455+0000","last_became_peered":"2023-08-31T18:47:53.006455+0000","last_unstale":"2023-08-31T18:47:53.010346+0000","last_undegraded":"2023-08-31T18:47:53.010346+0000","last_fullsized":"2023-08-31T18:47:53.010346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999985+0000","last_change":"2023-08-31T18:47:52.526280+0000","last_active":"2023-08-31T18:47:52.999985+0000","last_peered":"2023-08-31T18:47:52.999985+0000","last_clean":"2023-08-31T18:47:52.999985+0000","last_became_active":"2023-08-31T18:47:52.524905+0000","last_became_peered":"2023-08-31T18:47:52.524905+0000","last_unstale":"2023-08-31T18:47:52.999985+0000","last_undegraded":"2023-08-31T18:47:52.999985+0000","last_fullsized":"2023-08-31T18:47:52.999985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009365+0000","last_change":"2023-08-31T18:47:53.004475+0000","last_active":"2023-08-31T18:47:53.009365+0000","last_peered":"2023-08-31T18:47:53.009365+0000","last_clean":"2023-08-31T18:47:53.009365+0000","last_became_active":"2023-08-31T18:47:53.004127+0000","last_became_peered":"2023-08-31T18:47:53.004127+0000","last_unstale":"2023-08-31T18:47:53.009365+0000","last_undegraded":"2023-08-31T18:47:53.009365+0000","last_fullsized":"2023-08-31T18:47:53.009365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981133+0000","last_change":"2023-08-31T18:47:52.519012+0000","last_active":"2023-08-31T18:47:52.981133+0000","last_peered":"2023-08-31T18:47:52.981133+0000","last_clean":"2023-08-31T18:47:52.981133+0000","last_became_active":"2023-08-31T18:47:52.518704+0000","last_became_peered":"2023-08-31T18:47:52.518704+0000","last_unstale":"2023-08-31T18:47:52.981133+0000","last_undegraded":"2023-08-31T18:47:52.981133+0000","last_fullsized":"2023-08-31T18:47:52.981133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.014052+0000","last_change":"2023-08-31T18:47:53.011342+0000","last_active":"2023-08-31T18:47:53.014052+0000","last_peered":"2023-08-31T18:47:53.014052+0000","last_clean":"2023-08-31T18:47:53.014052+0000","last_became_active":"2023-08-31T18:47:53.010851+0000","last_became_peered":"2023-08-31T18:47:53.010851+0000","last_unstale":"2023-08-31T18:47:53.014052+0000","last_undegraded":"2023-08-31T18:47:53.014052+0000","last_fullsized":"2023-08-31T18:47:53.014052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.996543+0000","last_change":"2023-08-31T18:47:52.528000+0000","last_active":"2023-08-31T18:47:52.996543+0000","last_peered":"2023-08-31T18:47:52.996543+0000","last_clean":"2023-08-31T18:47:52.996543+0000","last_became_active":"2023-08-31T18:47:52.527687+0000","last_became_peered":"2023-08-31T18:47:52.527687+0000","last_unstale":"2023-08-31T18:47:52.996543+0000","last_undegraded":"2023-08-31T18:47:52.996543+0000","last_fullsized":"2023-08-31T18:47:52.996543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.004012+0000","last_change":"2023-08-31T18:47:53.001422+0000","last_active":"2023-08-31T18:47:53.004012+0000","last_peered":"2023-08-31T18:47:53.004012+0000","last_clean":"2023-08-31T18:47:53.004012+0000","last_became_active":"2023-08-31T18:47:53.001068+0000","last_became_peered":"2023-08-31T18:47:53.001068+0000","last_unstale":"2023-08-31T18:47:53.004012+0000","last_undegraded":"2023-08-31T18:47:53.004012+0000","last_fullsized":"2023-08-31T18:47:53.004012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978870+0000","last_change":"2023-08-31T18:47:52.528548+0000","last_active":"2023-08-31T18:47:52.978870+0000","last_peered":"2023-08-31T18:47:52.978870+0000","last_clean":"2023-08-31T18:47:52.978870+0000","last_became_active":"2023-08-31T18:47:52.528233+0000","last_became_peered":"2023-08-31T18:47:52.528233+0000","last_unstale":"2023-08-31T18:47:52.978870+0000","last_undegraded":"2023-08-31T18:47:52.978870+0000","last_fullsized":"2023-08-31T18:47:52.978870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982414+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T18:47:52.982414+0000","last_peered":"2023-08-31T18:47:52.982414+0000","last_clean":"2023-08-31T18:47:52.982414+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T18:47:52.982414+0000","last_undegraded":"2023-08-31T18:47:52.982414+0000","last_fullsized":"2023-08-31T18:47:52.982414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.983371+0000","last_change":"2023-08-31T18:47:52.531147+0000","last_active":"2023-08-31T18:47:52.983371+0000","last_peered":"2023-08-31T18:47:52.983371+0000","last_clean":"2023-08-31T18:47:52.983371+0000","last_became_active":"2023-08-31T18:47:52.530795+0000","last_became_peered":"2023-08-31T18:47:52.530795+0000","last_unstale":"2023-08-31T18:47:52.983371+0000","last_undegraded":"2023-08-31T18:47:52.983371+0000","last_fullsized":"2023-08-31T18:47:52.983371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003902+0000","last_change":"2023-08-31T18:47:52.996878+0000","last_active":"2023-08-31T18:47:53.003902+0000","last_peered":"2023-08-31T18:47:53.003902+0000","last_clean":"2023-08-31T18:47:53.003902+0000","last_became_active":"2023-08-31T18:47:52.996585+0000","last_became_peered":"2023-08-31T18:47:52.996585+0000","last_unstale":"2023-08-31T18:47:53.003902+0000","last_undegraded":"2023-08-31T18:47:53.003902+0000","last_fullsized":"2023-08-31T18:47:53.003902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982257+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T18:47:52.982257+0000","last_peered":"2023-08-31T18:47:52.982257+0000","last_clean":"2023-08-31T18:47:52.982257+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T18:47:52.982257+0000","last_undegraded":"2023-08-31T18:47:52.982257+0000","last_fullsized":"2023-08-31T18:47:52.982257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997186+0000","last_change":"2023-08-31T18:47:52.528056+0000","last_active":"2023-08-31T18:47:52.997186+0000","last_peered":"2023-08-31T18:47:52.997186+0000","last_clean":"2023-08-31T18:47:52.997186+0000","last_became_active":"2023-08-31T18:47:52.527756+0000","last_became_peered":"2023-08-31T18:47:52.527756+0000","last_unstale":"2023-08-31T18:47:52.997186+0000","last_undegraded":"2023-08-31T18:47:52.997186+0000","last_fullsized":"2023-08-31T18:47:52.997186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.998135+0000","last_change":"2023-08-31T18:47:52.990235+0000","last_active":"2023-08-31T18:47:52.998135+0000","last_peered":"2023-08-31T18:47:52.998135+0000","last_clean":"2023-08-31T18:47:52.998135+0000","last_became_active":"2023-08-31T18:47:52.989630+0000","last_became_peered":"2023-08-31T18:47:52.989630+0000","last_unstale":"2023-08-31T18:47:52.998135+0000","last_undegraded":"2023-08-31T18:47:52.998135+0000","last_fullsized":"2023-08-31T18:47:52.998135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003993+0000","last_change":"2023-08-31T18:47:52.997214+0000","last_active":"2023-08-31T18:47:53.003993+0000","last_peered":"2023-08-31T18:47:53.003993+0000","last_clean":"2023-08-31T18:47:53.003993+0000","last_became_active":"2023-08-31T18:47:52.996959+0000","last_became_peered":"2023-08-31T18:47:52.996959+0000","last_unstale":"2023-08-31T18:47:53.003993+0000","last_undegraded":"2023-08-31T18:47:53.003993+0000","last_fullsized":"2023-08-31T18:47:53.003993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979854+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T18:47:52.979854+0000","last_peered":"2023-08-31T18:47:52.979854+0000","last_clean":"2023-08-31T18:47:52.979854+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T18:47:52.979854+0000","last_undegraded":"2023-08-31T18:47:52.979854+0000","last_fullsized":"2023-08-31T18:47:52.979854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981140+0000","last_change":"2023-08-31T18:47:52.531329+0000","last_active":"2023-08-31T18:47:52.981140+0000","last_peered":"2023-08-31T18:47:52.981140+0000","last_clean":"2023-08-31T18:47:52.981140+0000","last_became_active":"2023-08-31T18:47:52.531098+0000","last_became_peered":"2023-08-31T18:47:52.531098+0000","last_unstale":"2023-08-31T18:47:52.981140+0000","last_undegraded":"2023-08-31T18:47:52.981140+0000","last_fullsized":"2023-08-31T18:47:52.981140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009822+0000","last_change":"2023-08-31T18:47:53.001676+0000","last_active":"2023-08-31T18:47:53.009822+0000","last_peered":"2023-08-31T18:47:53.009822+0000","last_clean":"2023-08-31T18:47:53.009822+0000","last_became_active":"2023-08-31T18:47:52.999806+0000","last_became_peered":"2023-08-31T18:47:52.999806+0000","last_unstale":"2023-08-31T18:47:53.009822+0000","last_undegraded":"2023-08-31T18:47:53.009822+0000","last_fullsized":"2023-08-31T18:47:53.009822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982159+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T18:47:52.982159+0000","last_peered":"2023-08-31T18:47:52.982159+0000","last_clean":"2023-08-31T18:47:52.982159+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T18:47:52.982159+0000","last_undegraded":"2023-08-31T18:47:52.982159+0000","last_fullsized":"2023-08-31T18:47:52.982159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993155+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T18:47:52.993155+0000","last_peered":"2023-08-31T18:47:52.993155+0000","last_clean":"2023-08-31T18:47:52.993155+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T18:47:52.993155+0000","last_undegraded":"2023-08-31T18:47:52.993155+0000","last_fullsized":"2023-08-31T18:47:52.993155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978881+0000","last_change":"2023-08-31T18:47:52.536563+0000","last_active":"2023-08-31T18:47:52.978881+0000","last_peered":"2023-08-31T18:47:52.978881+0000","last_clean":"2023-08-31T18:47:52.978881+0000","last_became_active":"2023-08-31T18:47:52.536326+0000","last_became_peered":"2023-08-31T18:47:52.536326+0000","last_unstale":"2023-08-31T18:47:52.978881+0000","last_undegraded":"2023-08-31T18:47:52.978881+0000","last_fullsized":"2023-08-31T18:47:52.978881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.994407+0000","last_change":"2023-08-31T18:47:52.990146+0000","last_active":"2023-08-31T18:47:52.994407+0000","last_peered":"2023-08-31T18:47:52.994407+0000","last_clean":"2023-08-31T18:47:52.994407+0000","last_became_active":"2023-08-31T18:47:52.989854+0000","last_became_peered":"2023-08-31T18:47:52.989854+0000","last_unstale":"2023-08-31T18:47:52.994407+0000","last_undegraded":"2023-08-31T18:47:52.994407+0000","last_fullsized":"2023-08-31T18:47:52.994407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993495+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T18:47:52.993495+0000","last_peered":"2023-08-31T18:47:52.993495+0000","last_clean":"2023-08-31T18:47:52.993495+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T18:47:52.993495+0000","last_undegraded":"2023-08-31T18:47:52.993495+0000","last_fullsized":"2023-08-31T18:47:52.993495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.983178+0000","last_change":"2023-08-31T18:47:52.521251+0000","last_active":"2023-08-31T18:47:52.983178+0000","last_peered":"2023-08-31T18:47:52.983178+0000","last_clean":"2023-08-31T18:47:52.983178+0000","last_became_active":"2023-08-31T18:47:52.520981+0000","last_became_peered":"2023-08-31T18:47:52.520981+0000","last_unstale":"2023-08-31T18:47:52.983178+0000","last_undegraded":"2023-08-31T18:47:52.983178+0000","last_fullsized":"2023-08-31T18:47:52.983178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.988216+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T18:47:52.988216+0000","last_peered":"2023-08-31T18:47:52.988216+0000","last_clean":"2023-08-31T18:47:52.988216+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T18:47:52.988216+0000","last_undegraded":"2023-08-31T18:47:52.988216+0000","last_fullsized":"2023-08-31T18:47:52.988216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982531+0000","last_change":"2023-08-31T18:47:52.531178+0000","last_active":"2023-08-31T18:47:52.982531+0000","last_peered":"2023-08-31T18:47:52.982531+0000","last_clean":"2023-08-31T18:47:52.982531+0000","last_became_active":"2023-08-31T18:47:52.530913+0000","last_became_peered":"2023-08-31T18:47:52.530913+0000","last_unstale":"2023-08-31T18:47:52.982531+0000","last_undegraded":"2023-08-31T18:47:52.982531+0000","last_fullsized":"2023-08-31T18:47:52.982531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.005141+0000","last_change":"2023-08-31T18:47:53.003355+0000","last_active":"2023-08-31T18:47:53.005141+0000","last_peered":"2023-08-31T18:47:53.005141+0000","last_clean":"2023-08-31T18:47:53.005141+0000","last_became_active":"2023-08-31T18:47:53.003045+0000","last_became_peered":"2023-08-31T18:47:53.003045+0000","last_unstale":"2023-08-31T18:47:53.005141+0000","last_undegraded":"2023-08-31T18:47:53.005141+0000","last_fullsized":"2023-08-31T18:47:53.005141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002389+0000","last_change":"2023-08-31T18:47:52.529487+0000","last_active":"2023-08-31T18:47:53.002389+0000","last_peered":"2023-08-31T18:47:53.002389+0000","last_clean":"2023-08-31T18:47:53.002389+0000","last_became_active":"2023-08-31T18:47:52.529159+0000","last_became_peered":"2023-08-31T18:47:52.529159+0000","last_unstale":"2023-08-31T18:47:53.002389+0000","last_undegraded":"2023-08-31T18:47:53.002389+0000","last_fullsized":"2023-08-31T18:47:53.002389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982262+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T18:47:52.982262+0000","last_peered":"2023-08-31T18:47:52.982262+0000","last_clean":"2023-08-31T18:47:52.982262+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T18:47:52.982262+0000","last_undegraded":"2023-08-31T18:47:52.982262+0000","last_fullsized":"2023-08-31T18:47:52.982262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002206+0000","last_change":"2023-08-31T18:47:52.997271+0000","last_active":"2023-08-31T18:47:53.002206+0000","last_peered":"2023-08-31T18:47:53.002206+0000","last_clean":"2023-08-31T18:47:53.002206+0000","last_became_active":"2023-08-31T18:47:52.996372+0000","last_became_peered":"2023-08-31T18:47:52.996372+0000","last_unstale":"2023-08-31T18:47:53.002206+0000","last_undegraded":"2023-08-31T18:47:53.002206+0000","last_fullsized":"2023-08-31T18:47:53.002206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979289+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T18:47:52.979289+0000","last_peered":"2023-08-31T18:47:52.979289+0000","last_clean":"2023-08-31T18:47:52.979289+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T18:47:52.979289+0000","last_undegraded":"2023-08-31T18:47:52.979289+0000","last_fullsized":"2023-08-31T18:47:52.979289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.985153+0000","last_change":"2023-08-31T18:47:52.525869+0000","last_active":"2023-08-31T18:47:52.985153+0000","last_peered":"2023-08-31T18:47:52.985153+0000","last_clean":"2023-08-31T18:47:52.985153+0000","last_became_active":"2023-08-31T18:47:52.525594+0000","last_became_peered":"2023-08-31T18:47:52.525594+0000","last_unstale":"2023-08-31T18:47:52.985153+0000","last_undegraded":"2023-08-31T18:47:52.985153+0000","last_fullsized":"2023-08-31T18:47:52.985153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009323+0000","last_change":"2023-08-31T18:47:53.003708+0000","last_active":"2023-08-31T18:47:53.009323+0000","last_peered":"2023-08-31T18:47:53.009323+0000","last_clean":"2023-08-31T18:47:53.009323+0000","last_became_active":"2023-08-31T18:47:53.001875+0000","last_became_peered":"2023-08-31T18:47:53.001875+0000","last_unstale":"2023-08-31T18:47:53.009323+0000","last_undegraded":"2023-08-31T18:47:53.009323+0000","last_fullsized":"2023-08-31T18:47:53.009323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000518+0000","last_change":"2023-08-31T18:47:52.990509+0000","last_active":"2023-08-31T18:47:53.000518+0000","last_peered":"2023-08-31T18:47:53.000518+0000","last_clean":"2023-08-31T18:47:53.000518+0000","last_became_active":"2023-08-31T18:47:52.990124+0000","last_became_peered":"2023-08-31T18:47:52.990124+0000","last_unstale":"2023-08-31T18:47:53.000518+0000","last_undegraded":"2023-08-31T18:47:53.000518+0000","last_fullsized":"2023-08-31T18:47:53.000518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984947+0000","last_change":"2023-08-31T18:47:52.530755+0000","last_active":"2023-08-31T18:47:52.984947+0000","last_peered":"2023-08-31T18:47:52.984947+0000","last_clean":"2023-08-31T18:47:52.984947+0000","last_became_active":"2023-08-31T18:47:52.530495+0000","last_became_peered":"2023-08-31T18:47:52.530495+0000","last_unstale":"2023-08-31T18:47:52.984947+0000","last_undegraded":"2023-08-31T18:47:52.984947+0000","last_fullsized":"2023-08-31T18:47:52.984947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010816+0000","last_change":"2023-08-31T18:47:53.008012+0000","last_active":"2023-08-31T18:47:53.010816+0000","last_peered":"2023-08-31T18:47:53.010816+0000","last_clean":"2023-08-31T18:47:53.010816+0000","last_became_active":"2023-08-31T18:47:53.007721+0000","last_became_peered":"2023-08-31T18:47:53.007721+0000","last_unstale":"2023-08-31T18:47:53.010816+0000","last_undegraded":"2023-08-31T18:47:53.010816+0000","last_fullsized":"2023-08-31T18:47:53.010816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981199+0000","last_change":"2023-08-31T18:47:52.536133+0000","last_active":"2023-08-31T18:47:52.981199+0000","last_peered":"2023-08-31T18:47:52.981199+0000","last_clean":"2023-08-31T18:47:52.981199+0000","last_became_active":"2023-08-31T18:47:52.535677+0000","last_became_peered":"2023-08-31T18:47:52.535677+0000","last_unstale":"2023-08-31T18:47:52.981199+0000","last_undegraded":"2023-08-31T18:47:52.981199+0000","last_fullsized":"2023-08-31T18:47:52.981199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010314+0000","last_change":"2023-08-31T18:47:53.007441+0000","last_active":"2023-08-31T18:47:53.010314+0000","last_peered":"2023-08-31T18:47:53.010314+0000","last_clean":"2023-08-31T18:47:53.010314+0000","last_became_active":"2023-08-31T18:47:53.007151+0000","last_became_peered":"2023-08-31T18:47:53.007151+0000","last_unstale":"2023-08-31T18:47:53.010314+0000","last_undegraded":"2023-08-31T18:47:53.010314+0000","last_fullsized":"2023-08-31T18:47:53.010314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997915+0000","last_change":"2023-08-31T18:47:52.534374+0000","last_active":"2023-08-31T18:47:52.997915+0000","last_peered":"2023-08-31T18:47:52.997915+0000","last_clean":"2023-08-31T18:47:52.997915+0000","last_became_active":"2023-08-31T18:47:52.534039+0000","last_became_peered":"2023-08-31T18:47:52.534039+0000","last_unstale":"2023-08-31T18:47:52.997915+0000","last_undegraded":"2023-08-31T18:47:52.997915+0000","last_fullsized":"2023-08-31T18:47:52.997915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999154+0000","last_change":"2023-08-31T18:47:52.988662+0000","last_active":"2023-08-31T18:47:52.999154+0000","last_peered":"2023-08-31T18:47:52.999154+0000","last_clean":"2023-08-31T18:47:52.999154+0000","last_became_active":"2023-08-31T18:47:52.988023+0000","last_became_peered":"2023-08-31T18:47:52.988023+0000","last_unstale":"2023-08-31T18:47:52.999154+0000","last_undegraded":"2023-08-31T18:47:52.999154+0000","last_fullsized":"2023-08-31T18:47:52.999154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997630+0000","last_change":"2023-08-31T18:47:52.529298+0000","last_active":"2023-08-31T18:47:52.997630+0000","last_peered":"2023-08-31T18:47:52.997630+0000","last_clean":"2023-08-31T18:47:52.997630+0000","last_became_active":"2023-08-31T18:47:52.529019+0000","last_became_peered":"2023-08-31T18:47:52.529019+0000","last_unstale":"2023-08-31T18:47:52.997630+0000","last_undegraded":"2023-08-31T18:47:52.997630+0000","last_fullsized":"2023-08-31T18:47:52.997630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013482+0000","last_change":"2023-08-31T18:47:53.011094+0000","last_active":"2023-08-31T18:47:53.013482+0000","last_peered":"2023-08-31T18:47:53.013482+0000","last_clean":"2023-08-31T18:47:53.013482+0000","last_became_active":"2023-08-31T18:47:53.010736+0000","last_became_peered":"2023-08-31T18:47:53.010736+0000","last_unstale":"2023-08-31T18:47:53.013482+0000","last_undegraded":"2023-08-31T18:47:53.013482+0000","last_fullsized":"2023-08-31T18:47:53.013482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.995373+0000","last_change":"2023-08-31T18:47:52.535396+0000","last_active":"2023-08-31T18:47:52.995373+0000","last_peered":"2023-08-31T18:47:52.995373+0000","last_clean":"2023-08-31T18:47:52.995373+0000","last_became_active":"2023-08-31T18:47:52.535096+0000","last_became_peered":"2023-08-31T18:47:52.535096+0000","last_unstale":"2023-08-31T18:47:52.995373+0000","last_undegraded":"2023-08-31T18:47:52.995373+0000","last_fullsized":"2023-08-31T18:47:52.995373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.011507+0000","last_change":"2023-08-31T18:47:53.010796+0000","last_active":"2023-08-31T18:47:53.011507+0000","last_peered":"2023-08-31T18:47:53.011507+0000","last_clean":"2023-08-31T18:47:53.011507+0000","last_became_active":"2023-08-31T18:47:53.010536+0000","last_became_peered":"2023-08-31T18:47:53.010536+0000","last_unstale":"2023-08-31T18:47:53.011507+0000","last_undegraded":"2023-08-31T18:47:53.011507+0000","last_fullsized":"2023-08-31T18:47:53.011507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979264+0000","last_change":"2023-08-31T18:47:52.526866+0000","last_active":"2023-08-31T18:47:52.979264+0000","last_peered":"2023-08-31T18:47:52.979264+0000","last_clean":"2023-08-31T18:47:52.979264+0000","last_became_active":"2023-08-31T18:47:52.526378+0000","last_became_peered":"2023-08-31T18:47:52.526378+0000","last_unstale":"2023-08-31T18:47:52.979264+0000","last_undegraded":"2023-08-31T18:47:52.979264+0000","last_fullsized":"2023-08-31T18:47:52.979264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.991664+0000","last_change":"2023-08-31T18:47:52.988166+0000","last_active":"2023-08-31T18:47:52.991664+0000","last_peered":"2023-08-31T18:47:52.991664+0000","last_clean":"2023-08-31T18:47:52.991664+0000","last_became_active":"2023-08-31T18:47:52.987862+0000","last_became_peered":"2023-08-31T18:47:52.987862+0000","last_unstale":"2023-08-31T18:47:52.991664+0000","last_undegraded":"2023-08-31T18:47:52.991664+0000","last_fullsized":"2023-08-31T18:47:52.991664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979954+0000","last_change":"2023-08-31T18:47:52.536528+0000","last_active":"2023-08-31T18:47:52.979954+0000","last_peered":"2023-08-31T18:47:52.979954+0000","last_clean":"2023-08-31T18:47:52.979954+0000","last_became_active":"2023-08-31T18:47:52.536263+0000","last_became_peered":"2023-08-31T18:47:52.536263+0000","last_unstale":"2023-08-31T18:47:52.979954+0000","last_undegraded":"2023-08-31T18:47:52.979954+0000","last_fullsized":"2023-08-31T18:47:52.979954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010523+0000","last_change":"2023-08-31T18:47:53.006199+0000","last_active":"2023-08-31T18:47:53.010523+0000","last_peered":"2023-08-31T18:47:53.010523+0000","last_clean":"2023-08-31T18:47:53.010523+0000","last_became_active":"2023-08-31T18:47:53.005772+0000","last_became_peered":"2023-08-31T18:47:53.005772+0000","last_unstale":"2023-08-31T18:47:53.010523+0000","last_undegraded":"2023-08-31T18:47:53.010523+0000","last_fullsized":"2023-08-31T18:47:53.010523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981987+0000","last_change":"2023-08-31T18:47:52.531200+0000","last_active":"2023-08-31T18:47:52.981987+0000","last_peered":"2023-08-31T18:47:52.981987+0000","last_clean":"2023-08-31T18:47:52.981987+0000","last_became_active":"2023-08-31T18:47:52.530888+0000","last_became_peered":"2023-08-31T18:47:52.530888+0000","last_unstale":"2023-08-31T18:47:52.981987+0000","last_undegraded":"2023-08-31T18:47:52.981987+0000","last_fullsized":"2023-08-31T18:47:52.981987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003936+0000","last_change":"2023-08-31T18:47:52.992639+0000","last_active":"2023-08-31T18:47:53.003936+0000","last_peered":"2023-08-31T18:47:53.003936+0000","last_clean":"2023-08-31T18:47:53.003936+0000","last_became_active":"2023-08-31T18:47:52.992365+0000","last_became_peered":"2023-08-31T18:47:52.992365+0000","last_unstale":"2023-08-31T18:47:53.003936+0000","last_undegraded":"2023-08-31T18:47:53.003936+0000","last_fullsized":"2023-08-31T18:47:53.003936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984775+0000","last_change":"2023-08-31T18:47:52.523604+0000","last_active":"2023-08-31T18:47:52.984775+0000","last_peered":"2023-08-31T18:47:52.984775+0000","last_clean":"2023-08-31T18:47:52.984775+0000","last_became_active":"2023-08-31T18:47:52.523314+0000","last_became_peered":"2023-08-31T18:47:52.523314+0000","last_unstale":"2023-08-31T18:47:52.984775+0000","last_undegraded":"2023-08-31T18:47:52.984775+0000","last_fullsized":"2023-08-31T18:47:52.984775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003706+0000","last_change":"2023-08-31T18:47:53.000736+0000","last_active":"2023-08-31T18:47:53.003706+0000","last_peered":"2023-08-31T18:47:53.003706+0000","last_clean":"2023-08-31T18:47:53.003706+0000","last_became_active":"2023-08-31T18:47:53.000299+0000","last_became_peered":"2023-08-31T18:47:53.000299+0000","last_unstale":"2023-08-31T18:47:53.003706+0000","last_undegraded":"2023-08-31T18:47:53.003706+0000","last_fullsized":"2023-08-31T18:47:53.003706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980656+0000","last_change":"2023-08-31T18:47:52.532777+0000","last_active":"2023-08-31T18:47:52.980656+0000","last_peered":"2023-08-31T18:47:52.980656+0000","last_clean":"2023-08-31T18:47:52.980656+0000","last_became_active":"2023-08-31T18:47:52.532315+0000","last_became_peered":"2023-08-31T18:47:52.532315+0000","last_unstale":"2023-08-31T18:47:52.980656+0000","last_undegraded":"2023-08-31T18:47:52.980656+0000","last_fullsized":"2023-08-31T18:47:52.980656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013496+0000","last_change":"2023-08-31T18:47:53.011112+0000","last_active":"2023-08-31T18:47:53.013496+0000","last_peered":"2023-08-31T18:47:53.013496+0000","last_clean":"2023-08-31T18:47:53.013496+0000","last_became_active":"2023-08-31T18:47:53.010727+0000","last_became_peered":"2023-08-31T18:47:53.010727+0000","last_unstale":"2023-08-31T18:47:53.013496+0000","last_undegraded":"2023-08-31T18:47:53.013496+0000","last_fullsized":"2023-08-31T18:47:53.013496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982317+0000","last_change":"2023-08-31T18:47:52.518395+0000","last_active":"2023-08-31T18:47:52.982317+0000","last_peered":"2023-08-31T18:47:52.982317+0000","last_clean":"2023-08-31T18:47:52.982317+0000","last_became_active":"2023-08-31T18:47:52.518052+0000","last_became_peered":"2023-08-31T18:47:52.518052+0000","last_unstale":"2023-08-31T18:47:52.982317+0000","last_undegraded":"2023-08-31T18:47:52.982317+0000","last_fullsized":"2023-08-31T18:47:52.982317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999877+0000","last_change":"2023-08-31T18:47:52.993488+0000","last_active":"2023-08-31T18:47:52.999877+0000","last_peered":"2023-08-31T18:47:52.999877+0000","last_clean":"2023-08-31T18:47:52.999877+0000","last_became_active":"2023-08-31T18:47:52.993212+0000","last_became_peered":"2023-08-31T18:47:52.993212+0000","last_unstale":"2023-08-31T18:47:52.999877+0000","last_undegraded":"2023-08-31T18:47:52.999877+0000","last_fullsized":"2023-08-31T18:47:52.999877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.983225+0000","last_change":"2023-08-31T18:47:52.525508+0000","last_active":"2023-08-31T18:47:53.983225+0000","last_peered":"2023-08-31T18:47:53.983225+0000","last_clean":"2023-08-31T18:47:53.983225+0000","last_became_active":"2023-08-31T18:47:52.525174+0000","last_became_peered":"2023-08-31T18:47:52.525174+0000","last_unstale":"2023-08-31T18:47:53.983225+0000","last_undegraded":"2023-08-31T18:47:53.983225+0000","last_fullsized":"2023-08-31T18:47:53.983225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.995366+0000","last_change":"2023-08-31T18:47:52.992245+0000","last_active":"2023-08-31T18:47:52.995366+0000","last_peered":"2023-08-31T18:47:52.995366+0000","last_clean":"2023-08-31T18:47:52.995366+0000","last_became_active":"2023-08-31T18:47:52.991850+0000","last_became_peered":"2023-08-31T18:47:52.991850+0000","last_unstale":"2023-08-31T18:47:52.995366+0000","last_undegraded":"2023-08-31T18:47:52.995366+0000","last_fullsized":"2023-08-31T18:47:52.995366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978676+0000","last_change":"2023-08-31T18:47:52.532525+0000","last_active":"2023-08-31T18:47:52.978676+0000","last_peered":"2023-08-31T18:47:52.978676+0000","last_clean":"2023-08-31T18:47:52.978676+0000","last_became_active":"2023-08-31T18:47:52.532286+0000","last_became_peered":"2023-08-31T18:47:52.532286+0000","last_unstale":"2023-08-31T18:47:52.978676+0000","last_undegraded":"2023-08-31T18:47:52.978676+0000","last_fullsized":"2023-08-31T18:47:52.978676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003173+0000","last_change":"2023-08-31T18:47:52.998570+0000","last_active":"2023-08-31T18:47:53.003173+0000","last_peered":"2023-08-31T18:47:53.003173+0000","last_clean":"2023-08-31T18:47:53.003173+0000","last_became_active":"2023-08-31T18:47:52.997982+0000","last_became_peered":"2023-08-31T18:47:52.997982+0000","last_unstale":"2023-08-31T18:47:53.003173+0000","last_undegraded":"2023-08-31T18:47:53.003173+0000","last_fullsized":"2023-08-31T18:47:53.003173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981657+0000","last_change":"2023-08-31T18:47:52.532565+0000","last_active":"2023-08-31T18:47:52.981657+0000","last_peered":"2023-08-31T18:47:52.981657+0000","last_clean":"2023-08-31T18:47:52.981657+0000","last_became_active":"2023-08-31T18:47:52.530954+0000","last_became_peered":"2023-08-31T18:47:52.530954+0000","last_unstale":"2023-08-31T18:47:52.981657+0000","last_undegraded":"2023-08-31T18:47:52.981657+0000","last_fullsized":"2023-08-31T18:47:52.981657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009277+0000","last_change":"2023-08-31T18:47:53.003156+0000","last_active":"2023-08-31T18:47:53.009277+0000","last_peered":"2023-08-31T18:47:53.009277+0000","last_clean":"2023-08-31T18:47:53.009277+0000","last_became_active":"2023-08-31T18:47:53.002838+0000","last_became_peered":"2023-08-31T18:47:53.002838+0000","last_unstale":"2023-08-31T18:47:53.009277+0000","last_undegraded":"2023-08-31T18:47:53.009277+0000","last_fullsized":"2023-08-31T18:47:53.009277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980428+0000","last_change":"2023-08-31T18:47:52.533155+0000","last_active":"2023-08-31T18:47:52.980428+0000","last_peered":"2023-08-31T18:47:52.980428+0000","last_clean":"2023-08-31T18:47:52.980428+0000","last_became_active":"2023-08-31T18:47:52.532852+0000","last_became_peered":"2023-08-31T18:47:52.532852+0000","last_unstale":"2023-08-31T18:47:52.980428+0000","last_undegraded":"2023-08-31T18:47:52.980428+0000","last_fullsized":"2023-08-31T18:47:52.980428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002837+0000","last_change":"2023-08-31T18:47:52.991952+0000","last_active":"2023-08-31T18:47:53.002837+0000","last_peered":"2023-08-31T18:47:53.002837+0000","last_clean":"2023-08-31T18:47:53.002837+0000","last_became_active":"2023-08-31T18:47:52.991706+0000","last_became_peered":"2023-08-31T18:47:52.991706+0000","last_unstale":"2023-08-31T18:47:53.002837+0000","last_undegraded":"2023-08-31T18:47:53.002837+0000","last_fullsized":"2023-08-31T18:47:53.002837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982376+0000","last_change":"2023-08-31T18:47:52.530999+0000","last_active":"2023-08-31T18:47:52.982376+0000","last_peered":"2023-08-31T18:47:52.982376+0000","last_clean":"2023-08-31T18:47:52.982376+0000","last_became_active":"2023-08-31T18:47:52.530492+0000","last_became_peered":"2023-08-31T18:47:52.530492+0000","last_unstale":"2023-08-31T18:47:52.982376+0000","last_undegraded":"2023-08-31T18:47:52.982376+0000","last_fullsized":"2023-08-31T18:47:52.982376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013431+0000","last_change":"2023-08-31T18:47:53.010887+0000","last_active":"2023-08-31T18:47:53.013431+0000","last_peered":"2023-08-31T18:47:53.013431+0000","last_clean":"2023-08-31T18:47:53.013431+0000","last_became_active":"2023-08-31T18:47:53.010563+0000","last_became_peered":"2023-08-31T18:47:53.010563+0000","last_unstale":"2023-08-31T18:47:53.013431+0000","last_undegraded":"2023-08-31T18:47:53.013431+0000","last_fullsized":"2023-08-31T18:47:53.013431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003063+0000","last_change":"2023-08-31T18:47:52.524520+0000","last_active":"2023-08-31T18:47:53.003063+0000","last_peered":"2023-08-31T18:47:53.003063+0000","last_clean":"2023-08-31T18:47:53.003063+0000","last_became_active":"2023-08-31T18:47:52.524248+0000","last_became_peered":"2023-08-31T18:47:52.524248+0000","last_unstale":"2023-08-31T18:47:53.003063+0000","last_undegraded":"2023-08-31T18:47:53.003063+0000","last_fullsized":"2023-08-31T18:47:53.003063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009527+0000","last_change":"2023-08-31T18:47:53.004250+0000","last_active":"2023-08-31T18:47:53.009527+0000","last_peered":"2023-08-31T18:47:53.009527+0000","last_clean":"2023-08-31T18:47:53.009527+0000","last_became_active":"2023-08-31T18:47:53.003889+0000","last_became_peered":"2023-08-31T18:47:53.003889+0000","last_unstale":"2023-08-31T18:47:53.009527+0000","last_undegraded":"2023-08-31T18:47:53.009527+0000","last_fullsized":"2023-08-31T18:47:53.009527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979331+0000","last_change":"2023-08-31T18:47:52.522809+0000","last_active":"2023-08-31T18:47:52.979331+0000","last_peered":"2023-08-31T18:47:52.979331+0000","last_clean":"2023-08-31T18:47:52.979331+0000","last_became_active":"2023-08-31T18:47:52.522517+0000","last_became_peered":"2023-08-31T18:47:52.522517+0000","last_unstale":"2023-08-31T18:47:52.979331+0000","last_undegraded":"2023-08-31T18:47:52.979331+0000","last_fullsized":"2023-08-31T18:47:52.979331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.994341+0000","last_change":"2023-08-31T18:47:52.990434+0000","last_active":"2023-08-31T18:47:52.994341+0000","last_peered":"2023-08-31T18:47:52.994341+0000","last_clean":"2023-08-31T18:47:52.994341+0000","last_became_active":"2023-08-31T18:47:52.989943+0000","last_became_peered":"2023-08-31T18:47:52.989943+0000","last_unstale":"2023-08-31T18:47:52.994341+0000","last_undegraded":"2023-08-31T18:47:52.994341+0000","last_fullsized":"2023-08-31T18:47:52.994341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.008488+0000","last_change":"2023-08-31T18:47:52.526791+0000","last_active":"2023-08-31T18:47:53.008488+0000","last_peered":"2023-08-31T18:47:53.008488+0000","last_clean":"2023-08-31T18:47:53.008488+0000","last_became_active":"2023-08-31T18:47:52.526453+0000","last_became_peered":"2023-08-31T18:47:52.526453+0000","last_unstale":"2023-08-31T18:47:53.008488+0000","last_undegraded":"2023-08-31T18:47:53.008488+0000","last_fullsized":"2023-08-31T18:47:53.008488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999173+0000","last_change":"2023-08-31T18:47:52.988877+0000","last_active":"2023-08-31T18:47:52.999173+0000","last_peered":"2023-08-31T18:47:52.999173+0000","last_clean":"2023-08-31T18:47:52.999173+0000","last_became_active":"2023-08-31T18:47:52.988408+0000","last_became_peered":"2023-08-31T18:47:52.988408+0000","last_unstale":"2023-08-31T18:47:52.999173+0000","last_undegraded":"2023-08-31T18:47:52.999173+0000","last_fullsized":"2023-08-31T18:47:52.999173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980246+0000","last_change":"2023-08-31T18:47:52.530145+0000","last_active":"2023-08-31T18:47:52.980246+0000","last_peered":"2023-08-31T18:47:52.980246+0000","last_clean":"2023-08-31T18:47:52.980246+0000","last_became_active":"2023-08-31T18:47:52.529794+0000","last_became_peered":"2023-08-31T18:47:52.529794+0000","last_unstale":"2023-08-31T18:47:52.980246+0000","last_undegraded":"2023-08-31T18:47:52.980246+0000","last_fullsized":"2023-08-31T18:47:52.980246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010719+0000","last_change":"2023-08-31T18:47:53.008088+0000","last_active":"2023-08-31T18:47:53.010719+0000","last_peered":"2023-08-31T18:47:53.010719+0000","last_clean":"2023-08-31T18:47:53.010719+0000","last_became_active":"2023-08-31T18:47:53.007777+0000","last_became_peered":"2023-08-31T18:47:53.007777+0000","last_unstale":"2023-08-31T18:47:53.010719+0000","last_undegraded":"2023-08-31T18:47:53.010719+0000","last_fullsized":"2023-08-31T18:47:53.010719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982119+0000","last_change":"2023-08-31T18:47:52.533768+0000","last_active":"2023-08-31T18:47:52.982119+0000","last_peered":"2023-08-31T18:47:52.982119+0000","last_clean":"2023-08-31T18:47:52.982119+0000","last_became_active":"2023-08-31T18:47:52.533361+0000","last_became_peered":"2023-08-31T18:47:52.533361+0000","last_unstale":"2023-08-31T18:47:52.982119+0000","last_undegraded":"2023-08-31T18:47:52.982119+0000","last_fullsized":"2023-08-31T18:47:52.982119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003194+0000","last_change":"2023-08-31T18:47:52.998770+0000","last_active":"2023-08-31T18:47:53.003194+0000","last_peered":"2023-08-31T18:47:53.003194+0000","last_clean":"2023-08-31T18:47:53.003194+0000","last_became_active":"2023-08-31T18:47:52.998321+0000","last_became_peered":"2023-08-31T18:47:52.998321+0000","last_unstale":"2023-08-31T18:47:53.003194+0000","last_undegraded":"2023-08-31T18:47:53.003194+0000","last_fullsized":"2023-08-31T18:47:53.003194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997292+0000","last_change":"2023-08-31T18:47:52.532924+0000","last_active":"2023-08-31T18:47:52.997292+0000","last_peered":"2023-08-31T18:47:52.997292+0000","last_clean":"2023-08-31T18:47:52.997292+0000","last_became_active":"2023-08-31T18:47:52.531625+0000","last_became_peered":"2023-08-31T18:47:52.531625+0000","last_unstale":"2023-08-31T18:47:52.997292+0000","last_undegraded":"2023-08-31T18:47:52.997292+0000","last_fullsized":"2023-08-31T18:47:52.997292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009212+0000","last_change":"2023-08-31T18:47:52.997006+0000","last_active":"2023-08-31T18:47:53.009212+0000","last_peered":"2023-08-31T18:47:53.009212+0000","last_clean":"2023-08-31T18:47:53.009212+0000","last_became_active":"2023-08-31T18:47:52.996663+0000","last_became_peered":"2023-08-31T18:47:52.996663+0000","last_unstale":"2023-08-31T18:47:53.009212+0000","last_undegraded":"2023-08-31T18:47:53.009212+0000","last_fullsized":"2023-08-31T18:47:53.009212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981008+0000","last_change":"2023-08-31T18:47:52.516464+0000","last_active":"2023-08-31T18:47:52.981008+0000","last_peered":"2023-08-31T18:47:52.981008+0000","last_clean":"2023-08-31T18:47:52.981008+0000","last_became_active":"2023-08-31T18:47:52.516164+0000","last_became_peered":"2023-08-31T18:47:52.516164+0000","last_unstale":"2023-08-31T18:47:52.981008+0000","last_undegraded":"2023-08-31T18:47:52.981008+0000","last_fullsized":"2023-08-31T18:47:52.981008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010930+0000","last_change":"2023-08-31T18:47:53.005504+0000","last_active":"2023-08-31T18:47:53.010930+0000","last_peered":"2023-08-31T18:47:53.010930+0000","last_clean":"2023-08-31T18:47:53.010930+0000","last_became_active":"2023-08-31T18:47:53.005202+0000","last_became_peered":"2023-08-31T18:47:53.005202+0000","last_unstale":"2023-08-31T18:47:53.010930+0000","last_undegraded":"2023-08-31T18:47:53.010930+0000","last_fullsized":"2023-08-31T18:47:53.010930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984216+0000","last_change":"2023-08-31T18:47:52.524392+0000","last_active":"2023-08-31T18:47:52.984216+0000","last_peered":"2023-08-31T18:47:52.984216+0000","last_clean":"2023-08-31T18:47:52.984216+0000","last_became_active":"2023-08-31T18:47:52.524124+0000","last_became_peered":"2023-08-31T18:47:52.524124+0000","last_unstale":"2023-08-31T18:47:52.984216+0000","last_undegraded":"2023-08-31T18:47:52.984216+0000","last_fullsized":"2023-08-31T18:47:52.984216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.007216+0000","last_change":"2023-08-31T18:47:53.004792+0000","last_active":"2023-08-31T18:47:53.007216+0000","last_peered":"2023-08-31T18:47:53.007216+0000","last_clean":"2023-08-31T18:47:53.007216+0000","last_became_active":"2023-08-31T18:47:53.004470+0000","last_became_peered":"2023-08-31T18:47:53.004470+0000","last_unstale":"2023-08-31T18:47:53.007216+0000","last_undegraded":"2023-08-31T18:47:53.007216+0000","last_fullsized":"2023-08-31T18:47:53.007216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000085+0000","last_change":"2023-08-31T18:47:52.531667+0000","last_active":"2023-08-31T18:47:53.000085+0000","last_peered":"2023-08-31T18:47:53.000085+0000","last_clean":"2023-08-31T18:47:53.000085+0000","last_became_active":"2023-08-31T18:47:52.529811+0000","last_became_peered":"2023-08-31T18:47:52.529811+0000","last_unstale":"2023-08-31T18:47:53.000085+0000","last_undegraded":"2023-08-31T18:47:53.000085+0000","last_fullsized":"2023-08-31T18:47:53.000085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.007141+0000","last_change":"2023-08-31T18:47:53.004157+0000","last_active":"2023-08-31T18:47:53.007141+0000","last_peered":"2023-08-31T18:47:53.007141+0000","last_clean":"2023-08-31T18:47:53.007141+0000","last_became_active":"2023-08-31T18:47:53.003874+0000","last_became_peered":"2023-08-31T18:47:53.003874+0000","last_unstale":"2023-08-31T18:47:53.007141+0000","last_undegraded":"2023-08-31T18:47:53.007141+0000","last_fullsized":"2023-08-31T18:47:53.007141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.016407+0000","last_change":"2023-08-31T18:47:52.528085+0000","last_active":"2023-08-31T18:47:53.016407+0000","last_peered":"2023-08-31T18:47:53.016407+0000","last_clean":"2023-08-31T18:47:53.016407+0000","last_became_active":"2023-08-31T18:47:52.527709+0000","last_became_peered":"2023-08-31T18:47:52.527709+0000","last_unstale":"2023-08-31T18:47:53.016407+0000","last_undegraded":"2023-08-31T18:47:53.016407+0000","last_fullsized":"2023-08-31T18:47:53.016407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009270+0000","last_change":"2023-08-31T18:47:52.995956+0000","last_active":"2023-08-31T18:47:53.009270+0000","last_peered":"2023-08-31T18:47:53.009270+0000","last_clean":"2023-08-31T18:47:53.009270+0000","last_became_active":"2023-08-31T18:47:52.995594+0000","last_became_peered":"2023-08-31T18:47:52.995594+0000","last_unstale":"2023-08-31T18:47:53.009270+0000","last_undegraded":"2023-08-31T18:47:53.009270+0000","last_fullsized":"2023-08-31T18:47:53.009270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981652+0000","last_change":"2023-08-31T18:47:52.531991+0000","last_active":"2023-08-31T18:47:52.981652+0000","last_peered":"2023-08-31T18:47:52.981652+0000","last_clean":"2023-08-31T18:47:52.981652+0000","last_became_active":"2023-08-31T18:47:52.531640+0000","last_became_peered":"2023-08-31T18:47:52.531640+0000","last_unstale":"2023-08-31T18:47:52.981652+0000","last_undegraded":"2023-08-31T18:47:52.981652+0000","last_fullsized":"2023-08-31T18:47:52.981652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009562+0000","last_change":"2023-08-31T18:47:53.004890+0000","last_active":"2023-08-31T18:47:53.009562+0000","last_peered":"2023-08-31T18:47:53.009562+0000","last_clean":"2023-08-31T18:47:53.009562+0000","last_became_active":"2023-08-31T18:47:53.004583+0000","last_became_peered":"2023-08-31T18:47:53.004583+0000","last_unstale":"2023-08-31T18:47:53.009562+0000","last_undegraded":"2023-08-31T18:47:53.009562+0000","last_fullsized":"2023-08-31T18:47:53.009562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979377+0000","last_change":"2023-08-31T18:47:52.532169+0000","last_active":"2023-08-31T18:47:52.979377+0000","last_peered":"2023-08-31T18:47:52.979377+0000","last_clean":"2023-08-31T18:47:52.979377+0000","last_became_active":"2023-08-31T18:47:52.531828+0000","last_became_peered":"2023-08-31T18:47:52.531828+0000","last_unstale":"2023-08-31T18:47:52.979377+0000","last_undegraded":"2023-08-31T18:47:52.979377+0000","last_fullsized":"2023-08-31T18:47:52.979377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010270+0000","last_change":"2023-08-31T18:47:53.006485+0000","last_active":"2023-08-31T18:47:53.010270+0000","last_peered":"2023-08-31T18:47:53.010270+0000","last_clean":"2023-08-31T18:47:53.010270+0000","last_became_active":"2023-08-31T18:47:53.005959+0000","last_became_peered":"2023-08-31T18:47:53.005959+0000","last_unstale":"2023-08-31T18:47:53.010270+0000","last_undegraded":"2023-08-31T18:47:53.010270+0000","last_fullsized":"2023-08-31T18:47:53.010270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993529+0000","last_change":"2023-08-31T18:47:52.535478+0000","last_active":"2023-08-31T18:47:52.993529+0000","last_peered":"2023-08-31T18:47:52.993529+0000","last_clean":"2023-08-31T18:47:52.993529+0000","last_became_active":"2023-08-31T18:47:52.535070+0000","last_became_peered":"2023-08-31T18:47:52.535070+0000","last_unstale":"2023-08-31T18:47:52.993529+0000","last_undegraded":"2023-08-31T18:47:52.993529+0000","last_fullsized":"2023-08-31T18:47:52.993529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000738+0000","last_change":"2023-08-31T18:47:52.995080+0000","last_active":"2023-08-31T18:47:53.000738+0000","last_peered":"2023-08-31T18:47:53.000738+0000","last_clean":"2023-08-31T18:47:53.000738+0000","last_became_active":"2023-08-31T18:47:52.994681+0000","last_became_peered":"2023-08-31T18:47:52.994681+0000","last_unstale":"2023-08-31T18:47:53.000738+0000","last_undegraded":"2023-08-31T18:47:53.000738+0000","last_fullsized":"2023-08-31T18:47:53.000738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978985+0000","last_change":"2023-08-31T18:47:52.537767+0000","last_active":"2023-08-31T18:47:52.978985+0000","last_peered":"2023-08-31T18:47:52.978985+0000","last_clean":"2023-08-31T18:47:52.978985+0000","last_became_active":"2023-08-31T18:47:52.537385+0000","last_became_peered":"2023-08-31T18:47:52.537385+0000","last_unstale":"2023-08-31T18:47:52.978985+0000","last_undegraded":"2023-08-31T18:47:52.978985+0000","last_fullsized":"2023-08-31T18:47:52.978985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009241+0000","last_change":"2023-08-31T18:47:52.997396+0000","last_active":"2023-08-31T18:47:53.009241+0000","last_peered":"2023-08-31T18:47:53.009241+0000","last_clean":"2023-08-31T18:47:53.009241+0000","last_became_active":"2023-08-31T18:47:52.997047+0000","last_became_peered":"2023-08-31T18:47:52.997047+0000","last_unstale":"2023-08-31T18:47:53.009241+0000","last_undegraded":"2023-08-31T18:47:53.009241+0000","last_fullsized":"2023-08-31T18:47:53.009241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.992987+0000","last_change":"2023-08-31T18:47:52.527537+0000","last_active":"2023-08-31T18:47:52.992987+0000","last_peered":"2023-08-31T18:47:52.992987+0000","last_clean":"2023-08-31T18:47:52.992987+0000","last_became_active":"2023-08-31T18:47:52.527270+0000","last_became_peered":"2023-08-31T18:47:52.527270+0000","last_unstale":"2023-08-31T18:47:52.992987+0000","last_undegraded":"2023-08-31T18:47:52.992987+0000","last_fullsized":"2023-08-31T18:47:52.992987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010969+0000","last_change":"2023-08-31T18:47:53.006192+0000","last_active":"2023-08-31T18:47:53.010969+0000","last_peered":"2023-08-31T18:47:53.010969+0000","last_clean":"2023-08-31T18:47:53.010969+0000","last_became_active":"2023-08-31T18:47:53.005781+0000","last_became_peered":"2023-08-31T18:47:53.005781+0000","last_unstale":"2023-08-31T18:47:53.010969+0000","last_undegraded":"2023-08-31T18:47:53.010969+0000","last_fullsized":"2023-08-31T18:47:53.010969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.992451+0000","last_change":"2023-08-31T18:47:52.530561+0000","last_active":"2023-08-31T18:47:52.992451+0000","last_peered":"2023-08-31T18:47:52.992451+0000","last_clean":"2023-08-31T18:47:52.992451+0000","last_became_active":"2023-08-31T18:47:52.530210+0000","last_became_peered":"2023-08-31T18:47:52.530210+0000","last_unstale":"2023-08-31T18:47:52.992451+0000","last_undegraded":"2023-08-31T18:47:52.992451+0000","last_fullsized":"2023-08-31T18:47:52.992451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993847+0000","last_change":"2023-08-31T18:47:52.991129+0000","last_active":"2023-08-31T18:47:52.993847+0000","last_peered":"2023-08-31T18:47:52.993847+0000","last_clean":"2023-08-31T18:47:52.993847+0000","last_became_active":"2023-08-31T18:47:52.990398+0000","last_became_peered":"2023-08-31T18:47:52.990398+0000","last_unstale":"2023-08-31T18:47:52.993847+0000","last_undegraded":"2023-08-31T18:47:52.993847+0000","last_fullsized":"2023-08-31T18:47:52.993847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.006602+0000","last_change":"2023-08-31T18:47:52.527848+0000","last_active":"2023-08-31T18:47:53.006602+0000","last_peered":"2023-08-31T18:47:53.006602+0000","last_clean":"2023-08-31T18:47:53.006602+0000","last_became_active":"2023-08-31T18:47:52.527606+0000","last_became_peered":"2023-08-31T18:47:52.527606+0000","last_unstale":"2023-08-31T18:47:53.006602+0000","last_undegraded":"2023-08-31T18:47:53.006602+0000","last_fullsized":"2023-08-31T18:47:53.006602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003221+0000","last_change":"2023-08-31T18:47:52.996941+0000","last_active":"2023-08-31T18:47:53.003221+0000","last_peered":"2023-08-31T18:47:53.003221+0000","last_clean":"2023-08-31T18:47:53.003221+0000","last_became_active":"2023-08-31T18:47:52.996629+0000","last_became_peered":"2023-08-31T18:47:52.996629+0000","last_unstale":"2023-08-31T18:47:53.003221+0000","last_undegraded":"2023-08-31T18:47:53.003221+0000","last_fullsized":"2023-08-31T18:47:53.003221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002885+0000","last_change":"2023-08-31T18:47:52.532525+0000","last_active":"2023-08-31T18:47:53.002885+0000","last_peered":"2023-08-31T18:47:53.002885+0000","last_clean":"2023-08-31T18:47:53.002885+0000","last_became_active":"2023-08-31T18:47:52.532148+0000","last_became_peered":"2023-08-31T18:47:52.532148+0000","last_unstale":"2023-08-31T18:47:53.002885+0000","last_undegraded":"2023-08-31T18:47:53.002885+0000","last_fullsized":"2023-08-31T18:47:53.002885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009117+0000","last_change":"2023-08-31T18:47:52.999302+0000","last_active":"2023-08-31T18:47:53.009117+0000","last_peered":"2023-08-31T18:47:53.009117+0000","last_clean":"2023-08-31T18:47:53.009117+0000","last_became_active":"2023-08-31T18:47:52.998999+0000","last_became_peered":"2023-08-31T18:47:52.998999+0000","last_unstale":"2023-08-31T18:47:53.009117+0000","last_undegraded":"2023-08-31T18:47:53.009117+0000","last_fullsized":"2023-08-31T18:47:53.009117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984593+0000","last_change":"2023-08-31T18:47:52.533151+0000","last_active":"2023-08-31T18:47:52.984593+0000","last_peered":"2023-08-31T18:47:52.984593+0000","last_clean":"2023-08-31T18:47:52.984593+0000","last_became_active":"2023-08-31T18:47:52.532807+0000","last_became_peered":"2023-08-31T18:47:52.532807+0000","last_unstale":"2023-08-31T18:47:52.984593+0000","last_undegraded":"2023-08-31T18:47:52.984593+0000","last_fullsized":"2023-08-31T18:47:52.984593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.007112+0000","last_change":"2023-08-31T18:47:53.001543+0000","last_active":"2023-08-31T18:47:53.007112+0000","last_peered":"2023-08-31T18:47:53.007112+0000","last_clean":"2023-08-31T18:47:53.007112+0000","last_became_active":"2023-08-31T18:47:53.001281+0000","last_became_peered":"2023-08-31T18:47:53.001281+0000","last_unstale":"2023-08-31T18:47:53.007112+0000","last_undegraded":"2023-08-31T18:47:53.007112+0000","last_fullsized":"2023-08-31T18:47:53.007112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982462+0000","last_change":"2023-08-31T18:47:52.527162+0000","last_active":"2023-08-31T18:47:52.982462+0000","last_peered":"2023-08-31T18:47:52.982462+0000","last_clean":"2023-08-31T18:47:52.982462+0000","last_became_active":"2023-08-31T18:47:52.526459+0000","last_became_peered":"2023-08-31T18:47:52.526459+0000","last_unstale":"2023-08-31T18:47:52.982462+0000","last_undegraded":"2023-08-31T18:47:52.982462+0000","last_fullsized":"2023-08-31T18:47:52.982462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009967+0000","last_change":"2023-08-31T18:47:52.999739+0000","last_active":"2023-08-31T18:47:53.009967+0000","last_peered":"2023-08-31T18:47:53.009967+0000","last_clean":"2023-08-31T18:47:53.009967+0000","last_became_active":"2023-08-31T18:47:52.999429+0000","last_became_peered":"2023-08-31T18:47:52.999429+0000","last_unstale":"2023-08-31T18:47:53.009967+0000","last_undegraded":"2023-08-31T18:47:53.009967+0000","last_fullsized":"2023-08-31T18:47:53.009967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013109+0000","last_change":"2023-08-31T18:47:52.524499+0000","last_active":"2023-08-31T18:47:53.013109+0000","last_peered":"2023-08-31T18:47:53.013109+0000","last_clean":"2023-08-31T18:47:53.013109+0000","last_became_active":"2023-08-31T18:47:52.524170+0000","last_became_peered":"2023-08-31T18:47:52.524170+0000","last_unstale":"2023-08-31T18:47:53.013109+0000","last_undegraded":"2023-08-31T18:47:53.013109+0000","last_fullsized":"2023-08-31T18:47:53.013109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":81647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":81679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":80303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":80323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":81825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T18:48:05.767 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T18:48:05.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.987+0000 7fa78e7ff700 1 Processor -- start 2023-08-31T18:48:05.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.987+0000 7fa78e7ff700 1 -- start start 2023-08-31T18:48:05.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.988+0000 7fa78e7ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa78815ce50 0x7fa78815f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:05.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.988+0000 7fa78e7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7880c8c90 con 0x7fa7880cb940 2023-08-31T18:48:05.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.988+0000 7fa78e7ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa788158af0 con 0x7fa788154220 2023-08-31T18:48:05.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.988+0000 7fa78e7ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7880aa700 con 0x7fa78815ce50 2023-08-31T18:48:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.989+0000 7fa7877fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa7880cb940 0x7fa7881583e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36912/0 (socket says 172.21.15.72:36912) 2023-08-31T18:48:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.989+0000 7fa7877fe700 1 -- 172.21.15.72:0/2707961304 learned_addr learned my addr 172.21.15.72:0/2707961304 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.989+0000 7fa78cd9c700 1 --2- 172.21.15.72:0/2707961304 >> v2:172.21.15.146:3300/0 conn(0x7fa78815ce50 0x7fa78815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.989+0000 7fa786ffd700 1 -- 172.21.15.72:0/2707961304 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061263216 0 0) 0x7fa7880c8c90 con 0x7fa7880cb940 2023-08-31T18:48:05.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.989+0000 7fa786ffd700 1 -- 172.21.15.72:0/2707961304 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7700033f0 con 0x7fa7880cb940 2023-08-31T18:48:05.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.989+0000 7fa786ffd700 1 -- 172.21.15.72:0/2707961304 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946279871 0 0) 0x7fa788158af0 con 0x7fa788154220 2023-08-31T18:48:05.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.989+0000 7fa786ffd700 1 -- 172.21.15.72:0/2707961304 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7880c8c90 con 0x7fa788154220 2023-08-31T18:48:05.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.989+0000 7fa78cd9c700 1 -- 172.21.15.72:0/2707961304 >> v1:172.21.15.146:6789/0 conn(0x7fa788154220 legacy=0x7fa788157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.989+0000 7fa786ffd700 1 -- 172.21.15.72:0/2707961304 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3250400654 0 0) 0x7fa7700033f0 con 0x7fa7880cb940 2023-08-31T18:48:05.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.989+0000 7fa78cd9c700 1 -- 172.21.15.72:0/2707961304 >> v1:172.21.15.72:6789/0 conn(0x7fa7880cb940 legacy=0x7fa7881583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.989+0000 7fa78cd9c700 1 -- 172.21.15.72:0/2707961304 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa788155610 con 0x7fa78815ce50 2023-08-31T18:48:05.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.990+0000 7fa78cd9c700 1 --2- 172.21.15.72:0/2707961304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa78815ce50 0x7fa78815f240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fa780009e60 tx=0x7fa780009780).ready entity=mon.1 client_cookie=11820e481ce74c6c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:05.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.990+0000 7fa786ffd700 1 -- 172.21.15.72:0/2707961304 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78000e070 con 0x7fa78815ce50 2023-08-31T18:48:05.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.990+0000 7fa786ffd700 1 -- 172.21.15.72:0/2707961304 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78000b7a0 con 0x7fa78815ce50 2023-08-31T18:48:05.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.990+0000 7fa786ffd700 1 -- 172.21.15.72:0/2707961304 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c001470 con 0x7fa78815ce50 2023-08-31T18:48:05.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.990+0000 7fa78e7ff700 1 -- 172.21.15.72:0/2707961304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa78815ce50 msgr2=0x7fa78815f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:05.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.990+0000 7fa78e7ff700 1 --2- 172.21.15.72:0/2707961304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa78815ce50 0x7fa78815f240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fa780009e60 tx=0x7fa780009780).stop 2023-08-31T18:48:05.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.990+0000 7fa78e7ff700 1 -- 172.21.15.72:0/2707961304 shutdown_connections 2023-08-31T18:48:05.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.990+0000 7fa78e7ff700 1 --2- 172.21.15.72:0/2707961304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa78815ce50 0x7fa78815f240 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:05.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.990+0000 7fa78e7ff700 1 -- 172.21.15.72:0/2707961304 >> 172.21.15.72:0/2707961304 conn(0x7fa78805e870 msgr2=0x7fa7880cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:05.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.990+0000 7fa78e7ff700 1 -- 172.21.15.72:0/2707961304 shutdown_connections 2023-08-31T18:48:05.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.991+0000 7fa78e7ff700 1 -- 172.21.15.72:0/2707961304 wait complete. 2023-08-31T18:48:05.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.992+0000 7fa78e7ff700 1 Processor -- start 2023-08-31T18:48:05.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.992+0000 7fa78e7ff700 1 -- start start 2023-08-31T18:48:05.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.993+0000 7fa78e7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7880cb940 0x7fa7880ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:05.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.993+0000 7fa78e7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa788154220 0x7fa7880a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:05.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.993+0000 7fa78e7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78815ce50 0x7fa7880a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:05.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.993+0000 7fa78e7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880a8fa0 con 0x7fa788154220 2023-08-31T18:48:05.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.993+0000 7fa78e7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880ad7e0 con 0x7fa7880cb940 2023-08-31T18:48:05.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.993+0000 7fa78e7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa788151f90 con 0x7fa78815ce50 2023-08-31T18:48:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.993+0000 7fa7877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa788154220 0x7fa7880a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.993+0000 7fa7877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa788154220 0x7fa7880a85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51378/0 (socket says 172.21.15.72:51378) 2023-08-31T18:48:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.993+0000 7fa7877fe700 1 -- 172.21.15.72:0/2291301468 learned_addr learned my addr 172.21.15.72:0/2291301468 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.994+0000 7fa78cd9c700 1 --2- 172.21.15.72:0/2291301468 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78815ce50 0x7fa7880a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.994+0000 7fa787fff700 1 --2- 172.21.15.72:0/2291301468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7880cb940 0x7fa7880ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.994+0000 7fa7877fe700 1 -- 172.21.15.72:0/2291301468 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78815ce50 msgr2=0x7fa7880a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:06.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.994+0000 7fa7877fe700 1 --2- 172.21.15.72:0/2291301468 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78815ce50 0x7fa7880a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.994+0000 7fa7877fe700 1 -- 172.21.15.72:0/2291301468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7880cb940 msgr2=0x7fa7880ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:06.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.994+0000 7fa7877fe700 1 --2- 172.21.15.72:0/2291301468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7880cb940 0x7fa7880ad2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.994+0000 7fa7877fe700 1 -- 172.21.15.72:0/2291301468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa780009a20 con 0x7fa788154220 2023-08-31T18:48:06.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.994+0000 7fa78cd9c700 1 --2- 172.21.15.72:0/2291301468 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78815ce50 0x7fa7880a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:06.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.994+0000 7fa7877fe700 1 --2- 172.21.15.72:0/2291301468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa788154220 0x7fa7880a85c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fa77c00c760 tx=0x7fa77c001b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:06.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.994+0000 7fa76ffff700 1 -- 172.21.15.72:0/2291301468 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c007170 con 0x7fa788154220 2023-08-31T18:48:06.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.994+0000 7fa76ffff700 1 -- 172.21.15.72:0/2291301468 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c0072d0 con 0x7fa788154220 2023-08-31T18:48:06.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.994+0000 7fa76ffff700 1 -- 172.21.15.72:0/2291301468 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0048c0 con 0x7fa788154220 2023-08-31T18:48:06.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.994+0000 7fa78e7ff700 1 -- 172.21.15.72:0/2291301468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa788152270 con 0x7fa788154220 2023-08-31T18:48:06.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.994+0000 7fa78e7ff700 1 -- 172.21.15.72:0/2291301468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa788152830 con 0x7fa788154220 2023-08-31T18:48:06.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.995+0000 7fa78e7ff700 1 -- 172.21.15.72:0/2291301468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78806c6b0 con 0x7fa788154220 2023-08-31T18:48:06.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.996+0000 7fa76ffff700 1 -- 172.21.15.72:0/2291301468 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fa77c004cb0 con 0x7fa788154220 2023-08-31T18:48:06.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.997+0000 7fa76ffff700 1 --2- 172.21.15.72:0/2291301468 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa77405ee10 0x7fa7740612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:06.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.997+0000 7fa76ffff700 1 -- 172.21.15.72:0/2291301468 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa77c079a80 con 0x7fa788154220 2023-08-31T18:48:06.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.997+0000 7fa787fff700 1 --2- 172.21.15.72:0/2291301468 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa77405ee10 0x7fa7740612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:05.998+0000 7fa787fff700 1 --2- 172.21.15.72:0/2291301468 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa77405ee10 0x7fa7740612d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa788158830 tx=0x7fa778009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:06.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.001+0000 7fa76ffff700 1 -- 172.21.15.72:0/2291301468 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa77c04afa0 con 0x7fa788154220 2023-08-31T18:48:06.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.165+0000 7fa78e7ff700 1 -- 172.21.15.72:0/2291301468 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7880ca190 con 0x7fa77405ee10 2023-08-31T18:48:06.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.175+0000 7fa76ffff700 1 -- 172.21.15.72:0/2291301468 <== mgr.4101 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336338 (secure 0 0 0) 0x7fa7880ca190 con 0x7fa77405ee10 2023-08-31T18:48:06.179 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:06.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.179+0000 7fa78e7ff700 1 -- 172.21.15.72:0/2291301468 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa77405ee10 msgr2=0x7fa7740612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:06.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.179+0000 7fa78e7ff700 1 --2- 172.21.15.72:0/2291301468 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa77405ee10 0x7fa7740612d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa788158830 tx=0x7fa778009040).stop 2023-08-31T18:48:06.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.179+0000 7fa78e7ff700 1 -- 172.21.15.72:0/2291301468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa788154220 msgr2=0x7fa7880a85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:06.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.179+0000 7fa78e7ff700 1 --2- 172.21.15.72:0/2291301468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa788154220 0x7fa7880a85c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fa77c00c760 tx=0x7fa77c001b00).stop 2023-08-31T18:48:06.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.179+0000 7fa78e7ff700 1 -- 172.21.15.72:0/2291301468 shutdown_connections 2023-08-31T18:48:06.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.179+0000 7fa78e7ff700 1 --2- 172.21.15.72:0/2291301468 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78815ce50 0x7fa7880a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.179+0000 7fa78e7ff700 1 --2- 172.21.15.72:0/2291301468 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa77405ee10 0x7fa7740612d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.179+0000 7fa78e7ff700 1 --2- 172.21.15.72:0/2291301468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7880cb940 0x7fa7880ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.179+0000 7fa78e7ff700 1 --2- 172.21.15.72:0/2291301468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa788154220 0x7fa7880a85c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.179+0000 7fa78e7ff700 1 -- 172.21.15.72:0/2291301468 >> 172.21.15.72:0/2291301468 conn(0x7fa78805e870 msgr2=0x7fa7880642d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:06.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.179+0000 7fa78e7ff700 1 -- 172.21.15.72:0/2291301468 shutdown_connections 2023-08-31T18:48:06.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.179+0000 7fa78e7ff700 1 -- 172.21.15.72:0/2291301468 wait complete. 2023-08-31T18:48:06.185 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T18:48:06.197 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-31T18:48:05.159519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378528,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596192,"statfs":{"total":773094113280,"available":770658500608,"internally_reserved":0,"allocated":1802240,"data_stored":646476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001606"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999933+0000","last_change":"2023-08-31T18:47:52.992922+0000","last_active":"2023-08-31T18:47:52.999933+0000","last_peered":"2023-08-31T18:47:52.999933+0000","last_clean":"2023-08-31T18:47:52.999933+0000","last_became_active":"2023-08-31T18:47:52.992608+0000","last_became_peered":"2023-08-31T18:47:52.992608+0000","last_unstale":"2023-08-31T18:47:52.999933+0000","last_undegraded":"2023-08-31T18:47:52.999933+0000","last_fullsized":"2023-08-31T18:47:52.999933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.996800+0000","last_change":"2023-08-31T18:47:52.521541+0000","last_active":"2023-08-31T18:47:52.996800+0000","last_peered":"2023-08-31T18:47:52.996800+0000","last_clean":"2023-08-31T18:47:52.996800+0000","last_became_active":"2023-08-31T18:47:52.521217+0000","last_became_peered":"2023-08-31T18:47:52.521217+0000","last_unstale":"2023-08-31T18:47:52.996800+0000","last_undegraded":"2023-08-31T18:47:52.996800+0000","last_fullsized":"2023-08-31T18:47:52.996800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000193+0000","last_change":"2023-08-31T18:47:52.996417+0000","last_active":"2023-08-31T18:47:53.000193+0000","last_peered":"2023-08-31T18:47:53.000193+0000","last_clean":"2023-08-31T18:47:53.000193+0000","last_became_active":"2023-08-31T18:47:52.995862+0000","last_became_peered":"2023-08-31T18:47:52.995862+0000","last_unstale":"2023-08-31T18:47:53.000193+0000","last_undegraded":"2023-08-31T18:47:53.000193+0000","last_fullsized":"2023-08-31T18:47:53.000193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980914+0000","last_change":"2023-08-31T18:47:52.518722+0000","last_active":"2023-08-31T18:47:52.980914+0000","last_peered":"2023-08-31T18:47:52.980914+0000","last_clean":"2023-08-31T18:47:52.980914+0000","last_became_active":"2023-08-31T18:47:52.518419+0000","last_became_peered":"2023-08-31T18:47:52.518419+0000","last_unstale":"2023-08-31T18:47:52.980914+0000","last_undegraded":"2023-08-31T18:47:52.980914+0000","last_fullsized":"2023-08-31T18:47:52.980914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009855+0000","last_change":"2023-08-31T18:47:53.001560+0000","last_active":"2023-08-31T18:47:53.009855+0000","last_peered":"2023-08-31T18:47:53.009855+0000","last_clean":"2023-08-31T18:47:53.009855+0000","last_became_active":"2023-08-31T18:47:53.001270+0000","last_became_peered":"2023-08-31T18:47:53.001270+0000","last_unstale":"2023-08-31T18:47:53.009855+0000","last_undegraded":"2023-08-31T18:47:53.009855+0000","last_fullsized":"2023-08-31T18:47:53.009855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979087+0000","last_change":"2023-08-31T18:47:52.525069+0000","last_active":"2023-08-31T18:47:52.979087+0000","last_peered":"2023-08-31T18:47:52.979087+0000","last_clean":"2023-08-31T18:47:52.979087+0000","last_became_active":"2023-08-31T18:47:52.524768+0000","last_became_peered":"2023-08-31T18:47:52.524768+0000","last_unstale":"2023-08-31T18:47:52.979087+0000","last_undegraded":"2023-08-31T18:47:52.979087+0000","last_fullsized":"2023-08-31T18:47:52.979087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999959+0000","last_change":"2023-08-31T18:47:52.992909+0000","last_active":"2023-08-31T18:47:52.999959+0000","last_peered":"2023-08-31T18:47:52.999959+0000","last_clean":"2023-08-31T18:47:52.999959+0000","last_became_active":"2023-08-31T18:47:52.992649+0000","last_became_peered":"2023-08-31T18:47:52.992649+0000","last_unstale":"2023-08-31T18:47:52.999959+0000","last_undegraded":"2023-08-31T18:47:52.999959+0000","last_fullsized":"2023-08-31T18:47:52.999959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.987323+0000","last_change":"2023-08-31T18:47:52.535019+0000","last_active":"2023-08-31T18:47:52.987323+0000","last_peered":"2023-08-31T18:47:52.987323+0000","last_clean":"2023-08-31T18:47:52.987323+0000","last_became_active":"2023-08-31T18:47:52.534783+0000","last_became_peered":"2023-08-31T18:47:52.534783+0000","last_unstale":"2023-08-31T18:47:52.987323+0000","last_undegraded":"2023-08-31T18:47:52.987323+0000","last_fullsized":"2023-08-31T18:47:52.987323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000964+0000","last_change":"2023-08-31T18:47:52.998713+0000","last_active":"2023-08-31T18:47:53.000964+0000","last_peered":"2023-08-31T18:47:53.000964+0000","last_clean":"2023-08-31T18:47:53.000964+0000","last_became_active":"2023-08-31T18:47:52.998411+0000","last_became_peered":"2023-08-31T18:47:52.998411+0000","last_unstale":"2023-08-31T18:47:53.000964+0000","last_undegraded":"2023-08-31T18:47:53.000964+0000","last_fullsized":"2023-08-31T18:47:53.000964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.983910+0000","last_change":"2023-08-31T18:47:52.530799+0000","last_active":"2023-08-31T18:47:52.983910+0000","last_peered":"2023-08-31T18:47:52.983910+0000","last_clean":"2023-08-31T18:47:52.983910+0000","last_became_active":"2023-08-31T18:47:52.530384+0000","last_became_peered":"2023-08-31T18:47:52.530384+0000","last_unstale":"2023-08-31T18:47:52.983910+0000","last_undegraded":"2023-08-31T18:47:52.983910+0000","last_fullsized":"2023-08-31T18:47:52.983910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003882+0000","last_change":"2023-08-31T18:47:52.992664+0000","last_active":"2023-08-31T18:47:53.003882+0000","last_peered":"2023-08-31T18:47:53.003882+0000","last_clean":"2023-08-31T18:47:53.003882+0000","last_became_active":"2023-08-31T18:47:52.992340+0000","last_became_peered":"2023-08-31T18:47:52.992340+0000","last_unstale":"2023-08-31T18:47:53.003882+0000","last_undegraded":"2023-08-31T18:47:53.003882+0000","last_fullsized":"2023-08-31T18:47:53.003882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.008581+0000","last_change":"2023-08-31T18:47:52.518423+0000","last_active":"2023-08-31T18:47:53.008581+0000","last_peered":"2023-08-31T18:47:53.008581+0000","last_clean":"2023-08-31T18:47:53.008581+0000","last_became_active":"2023-08-31T18:47:52.518154+0000","last_became_peered":"2023-08-31T18:47:52.518154+0000","last_unstale":"2023-08-31T18:47:53.008581+0000","last_undegraded":"2023-08-31T18:47:53.008581+0000","last_fullsized":"2023-08-31T18:47:53.008581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013444+0000","last_change":"2023-08-31T18:47:53.010969+0000","last_active":"2023-08-31T18:47:53.013444+0000","last_peered":"2023-08-31T18:47:53.013444+0000","last_clean":"2023-08-31T18:47:53.013444+0000","last_became_active":"2023-08-31T18:47:53.010624+0000","last_became_peered":"2023-08-31T18:47:53.010624+0000","last_unstale":"2023-08-31T18:47:53.013444+0000","last_undegraded":"2023-08-31T18:47:53.013444+0000","last_fullsized":"2023-08-31T18:47:53.013444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.012371+0000","last_change":"2023-08-31T18:47:52.528781+0000","last_active":"2023-08-31T18:47:53.012371+0000","last_peered":"2023-08-31T18:47:53.012371+0000","last_clean":"2023-08-31T18:47:53.012371+0000","last_became_active":"2023-08-31T18:47:52.528511+0000","last_became_peered":"2023-08-31T18:47:52.528511+0000","last_unstale":"2023-08-31T18:47:53.012371+0000","last_undegraded":"2023-08-31T18:47:53.012371+0000","last_fullsized":"2023-08-31T18:47:53.012371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999774+0000","last_change":"2023-08-31T18:47:52.992861+0000","last_active":"2023-08-31T18:47:52.999774+0000","last_peered":"2023-08-31T18:47:52.999774+0000","last_clean":"2023-08-31T18:47:52.999774+0000","last_became_active":"2023-08-31T18:47:52.992558+0000","last_became_peered":"2023-08-31T18:47:52.992558+0000","last_unstale":"2023-08-31T18:47:52.999774+0000","last_undegraded":"2023-08-31T18:47:52.999774+0000","last_fullsized":"2023-08-31T18:47:52.999774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000569+0000","last_change":"2023-08-31T18:47:52.531835+0000","last_active":"2023-08-31T18:47:53.000569+0000","last_peered":"2023-08-31T18:47:53.000569+0000","last_clean":"2023-08-31T18:47:53.000569+0000","last_became_active":"2023-08-31T18:47:52.531561+0000","last_became_peered":"2023-08-31T18:47:52.531561+0000","last_unstale":"2023-08-31T18:47:53.000569+0000","last_undegraded":"2023-08-31T18:47:53.000569+0000","last_fullsized":"2023-08-31T18:47:53.000569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.011345+0000","last_change":"2023-08-31T18:47:53.006651+0000","last_active":"2023-08-31T18:47:53.011345+0000","last_peered":"2023-08-31T18:47:53.011345+0000","last_clean":"2023-08-31T18:47:53.011345+0000","last_became_active":"2023-08-31T18:47:53.006149+0000","last_became_peered":"2023-08-31T18:47:53.006149+0000","last_unstale":"2023-08-31T18:47:53.011345+0000","last_undegraded":"2023-08-31T18:47:53.011345+0000","last_fullsized":"2023-08-31T18:47:53.011345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984191+0000","last_change":"2023-08-31T18:47:52.526672+0000","last_active":"2023-08-31T18:47:52.984191+0000","last_peered":"2023-08-31T18:47:52.984191+0000","last_clean":"2023-08-31T18:47:52.984191+0000","last_became_active":"2023-08-31T18:47:52.526370+0000","last_became_peered":"2023-08-31T18:47:52.526370+0000","last_unstale":"2023-08-31T18:47:52.984191+0000","last_undegraded":"2023-08-31T18:47:52.984191+0000","last_fullsized":"2023-08-31T18:47:52.984191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000173+0000","last_change":"2023-08-31T18:47:52.996230+0000","last_active":"2023-08-31T18:47:53.000173+0000","last_peered":"2023-08-31T18:47:53.000173+0000","last_clean":"2023-08-31T18:47:53.000173+0000","last_became_active":"2023-08-31T18:47:52.995080+0000","last_became_peered":"2023-08-31T18:47:52.995080+0000","last_unstale":"2023-08-31T18:47:53.000173+0000","last_undegraded":"2023-08-31T18:47:53.000173+0000","last_fullsized":"2023-08-31T18:47:53.000173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993377+0000","last_change":"2023-08-31T18:47:52.523040+0000","last_active":"2023-08-31T18:47:52.993377+0000","last_peered":"2023-08-31T18:47:52.993377+0000","last_clean":"2023-08-31T18:47:52.993377+0000","last_became_active":"2023-08-31T18:47:52.522587+0000","last_became_peered":"2023-08-31T18:47:52.522587+0000","last_unstale":"2023-08-31T18:47:52.993377+0000","last_undegraded":"2023-08-31T18:47:52.993377+0000","last_fullsized":"2023-08-31T18:47:52.993377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.004847+0000","last_change":"2023-08-31T18:47:53.002154+0000","last_active":"2023-08-31T18:47:53.004847+0000","last_peered":"2023-08-31T18:47:53.004847+0000","last_clean":"2023-08-31T18:47:53.004847+0000","last_became_active":"2023-08-31T18:47:53.001849+0000","last_became_peered":"2023-08-31T18:47:53.001849+0000","last_unstale":"2023-08-31T18:47:53.004847+0000","last_undegraded":"2023-08-31T18:47:53.004847+0000","last_fullsized":"2023-08-31T18:47:53.004847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.995745+0000","last_change":"2023-08-31T18:47:52.526655+0000","last_active":"2023-08-31T18:47:52.995745+0000","last_peered":"2023-08-31T18:47:52.995745+0000","last_clean":"2023-08-31T18:47:52.995745+0000","last_became_active":"2023-08-31T18:47:52.525963+0000","last_became_peered":"2023-08-31T18:47:52.525963+0000","last_unstale":"2023-08-31T18:47:52.995745+0000","last_undegraded":"2023-08-31T18:47:52.995745+0000","last_fullsized":"2023-08-31T18:47:52.995745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009266+0000","last_change":"2023-08-31T18:47:52.997454+0000","last_active":"2023-08-31T18:47:53.009266+0000","last_peered":"2023-08-31T18:47:53.009266+0000","last_clean":"2023-08-31T18:47:53.009266+0000","last_became_active":"2023-08-31T18:47:52.997016+0000","last_became_peered":"2023-08-31T18:47:52.997016+0000","last_unstale":"2023-08-31T18:47:53.009266+0000","last_undegraded":"2023-08-31T18:47:53.009266+0000","last_fullsized":"2023-08-31T18:47:53.009266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013124+0000","last_change":"2023-08-31T18:47:52.523613+0000","last_active":"2023-08-31T18:47:53.013124+0000","last_peered":"2023-08-31T18:47:53.013124+0000","last_clean":"2023-08-31T18:47:53.013124+0000","last_became_active":"2023-08-31T18:47:52.522576+0000","last_became_peered":"2023-08-31T18:47:52.522576+0000","last_unstale":"2023-08-31T18:47:53.013124+0000","last_undegraded":"2023-08-31T18:47:53.013124+0000","last_fullsized":"2023-08-31T18:47:53.013124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010365+0000","last_change":"2023-08-31T18:47:53.005565+0000","last_active":"2023-08-31T18:47:53.010365+0000","last_peered":"2023-08-31T18:47:53.010365+0000","last_clean":"2023-08-31T18:47:53.010365+0000","last_became_active":"2023-08-31T18:47:53.005190+0000","last_became_peered":"2023-08-31T18:47:53.005190+0000","last_unstale":"2023-08-31T18:47:53.010365+0000","last_undegraded":"2023-08-31T18:47:53.010365+0000","last_fullsized":"2023-08-31T18:47:53.010365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.012195+0000","last_change":"2023-08-31T18:47:52.533431+0000","last_active":"2023-08-31T18:47:53.012195+0000","last_peered":"2023-08-31T18:47:53.012195+0000","last_clean":"2023-08-31T18:47:53.012195+0000","last_became_active":"2023-08-31T18:47:52.532932+0000","last_became_peered":"2023-08-31T18:47:52.532932+0000","last_unstale":"2023-08-31T18:47:53.012195+0000","last_undegraded":"2023-08-31T18:47:53.012195+0000","last_fullsized":"2023-08-31T18:47:53.012195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009811+0000","last_change":"2023-08-31T18:47:53.001374+0000","last_active":"2023-08-31T18:47:53.009811+0000","last_peered":"2023-08-31T18:47:53.009811+0000","last_clean":"2023-08-31T18:47:53.009811+0000","last_became_active":"2023-08-31T18:47:52.997729+0000","last_became_peered":"2023-08-31T18:47:52.997729+0000","last_unstale":"2023-08-31T18:47:53.009811+0000","last_undegraded":"2023-08-31T18:47:53.009811+0000","last_fullsized":"2023-08-31T18:47:53.009811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.988324+0000","last_change":"2023-08-31T18:47:52.534072+0000","last_active":"2023-08-31T18:47:52.988324+0000","last_peered":"2023-08-31T18:47:52.988324+0000","last_clean":"2023-08-31T18:47:52.988324+0000","last_became_active":"2023-08-31T18:47:52.533779+0000","last_became_peered":"2023-08-31T18:47:52.533779+0000","last_unstale":"2023-08-31T18:47:52.988324+0000","last_undegraded":"2023-08-31T18:47:52.988324+0000","last_fullsized":"2023-08-31T18:47:52.988324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.994371+0000","last_change":"2023-08-31T18:47:52.990541+0000","last_active":"2023-08-31T18:47:52.994371+0000","last_peered":"2023-08-31T18:47:52.994371+0000","last_clean":"2023-08-31T18:47:52.994371+0000","last_became_active":"2023-08-31T18:47:52.990287+0000","last_became_peered":"2023-08-31T18:47:52.990287+0000","last_unstale":"2023-08-31T18:47:52.994371+0000","last_undegraded":"2023-08-31T18:47:52.994371+0000","last_fullsized":"2023-08-31T18:47:52.994371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981085+0000","last_change":"2023-08-31T18:47:52.532002+0000","last_active":"2023-08-31T18:47:52.981085+0000","last_peered":"2023-08-31T18:47:52.981085+0000","last_clean":"2023-08-31T18:47:52.981085+0000","last_became_active":"2023-08-31T18:47:52.530907+0000","last_became_peered":"2023-08-31T18:47:52.530907+0000","last_unstale":"2023-08-31T18:47:52.981085+0000","last_undegraded":"2023-08-31T18:47:52.981085+0000","last_fullsized":"2023-08-31T18:47:52.981085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010346+0000","last_change":"2023-08-31T18:47:53.006764+0000","last_active":"2023-08-31T18:47:53.010346+0000","last_peered":"2023-08-31T18:47:53.010346+0000","last_clean":"2023-08-31T18:47:53.010346+0000","last_became_active":"2023-08-31T18:47:53.006455+0000","last_became_peered":"2023-08-31T18:47:53.006455+0000","last_unstale":"2023-08-31T18:47:53.010346+0000","last_undegraded":"2023-08-31T18:47:53.010346+0000","last_fullsized":"2023-08-31T18:47:53.010346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999985+0000","last_change":"2023-08-31T18:47:52.526280+0000","last_active":"2023-08-31T18:47:52.999985+0000","last_peered":"2023-08-31T18:47:52.999985+0000","last_clean":"2023-08-31T18:47:52.999985+0000","last_became_active":"2023-08-31T18:47:52.524905+0000","last_became_peered":"2023-08-31T18:47:52.524905+0000","last_unstale":"2023-08-31T18:47:52.999985+0000","last_undegraded":"2023-08-31T18:47:52.999985+0000","last_fullsized":"2023-08-31T18:47:52.999985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009365+0000","last_change":"2023-08-31T18:47:53.004475+0000","last_active":"2023-08-31T18:47:53.009365+0000","last_peered":"2023-08-31T18:47:53.009365+0000","last_clean":"2023-08-31T18:47:53.009365+0000","last_became_active":"2023-08-31T18:47:53.004127+0000","last_became_peered":"2023-08-31T18:47:53.004127+0000","last_unstale":"2023-08-31T18:47:53.009365+0000","last_undegraded":"2023-08-31T18:47:53.009365+0000","last_fullsized":"2023-08-31T18:47:53.009365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981133+0000","last_change":"2023-08-31T18:47:52.519012+0000","last_active":"2023-08-31T18:47:52.981133+0000","last_peered":"2023-08-31T18:47:52.981133+0000","last_clean":"2023-08-31T18:47:52.981133+0000","last_became_active":"2023-08-31T18:47:52.518704+0000","last_became_peered":"2023-08-31T18:47:52.518704+0000","last_unstale":"2023-08-31T18:47:52.981133+0000","last_undegraded":"2023-08-31T18:47:52.981133+0000","last_fullsized":"2023-08-31T18:47:52.981133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.014052+0000","last_change":"2023-08-31T18:47:53.011342+0000","last_active":"2023-08-31T18:47:53.014052+0000","last_peered":"2023-08-31T18:47:53.014052+0000","last_clean":"2023-08-31T18:47:53.014052+0000","last_became_active":"2023-08-31T18:47:53.010851+0000","last_became_peered":"2023-08-31T18:47:53.010851+0000","last_unstale":"2023-08-31T18:47:53.014052+0000","last_undegraded":"2023-08-31T18:47:53.014052+0000","last_fullsized":"2023-08-31T18:47:53.014052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.996543+0000","last_change":"2023-08-31T18:47:52.528000+0000","last_active":"2023-08-31T18:47:52.996543+0000","last_peered":"2023-08-31T18:47:52.996543+0000","last_clean":"2023-08-31T18:47:52.996543+0000","last_became_active":"2023-08-31T18:47:52.527687+0000","last_became_peered":"2023-08-31T18:47:52.527687+0000","last_unstale":"2023-08-31T18:47:52.996543+0000","last_undegraded":"2023-08-31T18:47:52.996543+0000","last_fullsized":"2023-08-31T18:47:52.996543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.004012+0000","last_change":"2023-08-31T18:47:53.001422+0000","last_active":"2023-08-31T18:47:53.004012+0000","last_peered":"2023-08-31T18:47:53.004012+0000","last_clean":"2023-08-31T18:47:53.004012+0000","last_became_active":"2023-08-31T18:47:53.001068+0000","last_became_peered":"2023-08-31T18:47:53.001068+0000","last_unstale":"2023-08-31T18:47:53.004012+0000","last_undegraded":"2023-08-31T18:47:53.004012+0000","last_fullsized":"2023-08-31T18:47:53.004012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978870+0000","last_change":"2023-08-31T18:47:52.528548+0000","last_active":"2023-08-31T18:47:52.978870+0000","last_peered":"2023-08-31T18:47:52.978870+0000","last_clean":"2023-08-31T18:47:52.978870+0000","last_became_active":"2023-08-31T18:47:52.528233+0000","last_became_peered":"2023-08-31T18:47:52.528233+0000","last_unstale":"2023-08-31T18:47:52.978870+0000","last_undegraded":"2023-08-31T18:47:52.978870+0000","last_fullsized":"2023-08-31T18:47:52.978870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982414+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T18:47:52.982414+0000","last_peered":"2023-08-31T18:47:52.982414+0000","last_clean":"2023-08-31T18:47:52.982414+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T18:47:52.982414+0000","last_undegraded":"2023-08-31T18:47:52.982414+0000","last_fullsized":"2023-08-31T18:47:52.982414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.983371+0000","last_change":"2023-08-31T18:47:52.531147+0000","last_active":"2023-08-31T18:47:52.983371+0000","last_peered":"2023-08-31T18:47:52.983371+0000","last_clean":"2023-08-31T18:47:52.983371+0000","last_became_active":"2023-08-31T18:47:52.530795+0000","last_became_peered":"2023-08-31T18:47:52.530795+0000","last_unstale":"2023-08-31T18:47:52.983371+0000","last_undegraded":"2023-08-31T18:47:52.983371+0000","last_fullsized":"2023-08-31T18:47:52.983371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003902+0000","last_change":"2023-08-31T18:47:52.996878+0000","last_active":"2023-08-31T18:47:53.003902+0000","last_peered":"2023-08-31T18:47:53.003902+0000","last_clean":"2023-08-31T18:47:53.003902+0000","last_became_active":"2023-08-31T18:47:52.996585+0000","last_became_peered":"2023-08-31T18:47:52.996585+0000","last_unstale":"2023-08-31T18:47:53.003902+0000","last_undegraded":"2023-08-31T18:47:53.003902+0000","last_fullsized":"2023-08-31T18:47:53.003902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982257+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T18:47:52.982257+0000","last_peered":"2023-08-31T18:47:52.982257+0000","last_clean":"2023-08-31T18:47:52.982257+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T18:47:52.982257+0000","last_undegraded":"2023-08-31T18:47:52.982257+0000","last_fullsized":"2023-08-31T18:47:52.982257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997186+0000","last_change":"2023-08-31T18:47:52.528056+0000","last_active":"2023-08-31T18:47:52.997186+0000","last_peered":"2023-08-31T18:47:52.997186+0000","last_clean":"2023-08-31T18:47:52.997186+0000","last_became_active":"2023-08-31T18:47:52.527756+0000","last_became_peered":"2023-08-31T18:47:52.527756+0000","last_unstale":"2023-08-31T18:47:52.997186+0000","last_undegraded":"2023-08-31T18:47:52.997186+0000","last_fullsized":"2023-08-31T18:47:52.997186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.998135+0000","last_change":"2023-08-31T18:47:52.990235+0000","last_active":"2023-08-31T18:47:52.998135+0000","last_peered":"2023-08-31T18:47:52.998135+0000","last_clean":"2023-08-31T18:47:52.998135+0000","last_became_active":"2023-08-31T18:47:52.989630+0000","last_became_peered":"2023-08-31T18:47:52.989630+0000","last_unstale":"2023-08-31T18:47:52.998135+0000","last_undegraded":"2023-08-31T18:47:52.998135+0000","last_fullsized":"2023-08-31T18:47:52.998135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003993+0000","last_change":"2023-08-31T18:47:52.997214+0000","last_active":"2023-08-31T18:47:53.003993+0000","last_peered":"2023-08-31T18:47:53.003993+0000","last_clean":"2023-08-31T18:47:53.003993+0000","last_became_active":"2023-08-31T18:47:52.996959+0000","last_became_peered":"2023-08-31T18:47:52.996959+0000","last_unstale":"2023-08-31T18:47:53.003993+0000","last_undegraded":"2023-08-31T18:47:53.003993+0000","last_fullsized":"2023-08-31T18:47:53.003993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979854+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T18:47:52.979854+0000","last_peered":"2023-08-31T18:47:52.979854+0000","last_clean":"2023-08-31T18:47:52.979854+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T18:47:52.979854+0000","last_undegraded":"2023-08-31T18:47:52.979854+0000","last_fullsized":"2023-08-31T18:47:52.979854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981140+0000","last_change":"2023-08-31T18:47:52.531329+0000","last_active":"2023-08-31T18:47:52.981140+0000","last_peered":"2023-08-31T18:47:52.981140+0000","last_clean":"2023-08-31T18:47:52.981140+0000","last_became_active":"2023-08-31T18:47:52.531098+0000","last_became_peered":"2023-08-31T18:47:52.531098+0000","last_unstale":"2023-08-31T18:47:52.981140+0000","last_undegraded":"2023-08-31T18:47:52.981140+0000","last_fullsized":"2023-08-31T18:47:52.981140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009822+0000","last_change":"2023-08-31T18:47:53.001676+0000","last_active":"2023-08-31T18:47:53.009822+0000","last_peered":"2023-08-31T18:47:53.009822+0000","last_clean":"2023-08-31T18:47:53.009822+0000","last_became_active":"2023-08-31T18:47:52.999806+0000","last_became_peered":"2023-08-31T18:47:52.999806+0000","last_unstale":"2023-08-31T18:47:53.009822+0000","last_undegraded":"2023-08-31T18:47:53.009822+0000","last_fullsized":"2023-08-31T18:47:53.009822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982159+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T18:47:52.982159+0000","last_peered":"2023-08-31T18:47:52.982159+0000","last_clean":"2023-08-31T18:47:52.982159+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T18:47:52.982159+0000","last_undegraded":"2023-08-31T18:47:52.982159+0000","last_fullsized":"2023-08-31T18:47:52.982159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993155+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T18:47:52.993155+0000","last_peered":"2023-08-31T18:47:52.993155+0000","last_clean":"2023-08-31T18:47:52.993155+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T18:47:52.993155+0000","last_undegraded":"2023-08-31T18:47:52.993155+0000","last_fullsized":"2023-08-31T18:47:52.993155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978881+0000","last_change":"2023-08-31T18:47:52.536563+0000","last_active":"2023-08-31T18:47:52.978881+0000","last_peered":"2023-08-31T18:47:52.978881+0000","last_clean":"2023-08-31T18:47:52.978881+0000","last_became_active":"2023-08-31T18:47:52.536326+0000","last_became_peered":"2023-08-31T18:47:52.536326+0000","last_unstale":"2023-08-31T18:47:52.978881+0000","last_undegraded":"2023-08-31T18:47:52.978881+0000","last_fullsized":"2023-08-31T18:47:52.978881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.994407+0000","last_change":"2023-08-31T18:47:52.990146+0000","last_active":"2023-08-31T18:47:52.994407+0000","last_peered":"2023-08-31T18:47:52.994407+0000","last_clean":"2023-08-31T18:47:52.994407+0000","last_became_active":"2023-08-31T18:47:52.989854+0000","last_became_peered":"2023-08-31T18:47:52.989854+0000","last_unstale":"2023-08-31T18:47:52.994407+0000","last_undegraded":"2023-08-31T18:47:52.994407+0000","last_fullsized":"2023-08-31T18:47:52.994407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993495+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T18:47:52.993495+0000","last_peered":"2023-08-31T18:47:52.993495+0000","last_clean":"2023-08-31T18:47:52.993495+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T18:47:52.993495+0000","last_undegraded":"2023-08-31T18:47:52.993495+0000","last_fullsized":"2023-08-31T18:47:52.993495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.983178+0000","last_change":"2023-08-31T18:47:52.521251+0000","last_active":"2023-08-31T18:47:52.983178+0000","last_peered":"2023-08-31T18:47:52.983178+0000","last_clean":"2023-08-31T18:47:52.983178+0000","last_became_active":"2023-08-31T18:47:52.520981+0000","last_became_peered":"2023-08-31T18:47:52.520981+0000","last_unstale":"2023-08-31T18:47:52.983178+0000","last_undegraded":"2023-08-31T18:47:52.983178+0000","last_fullsized":"2023-08-31T18:47:52.983178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.988216+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T18:47:52.988216+0000","last_peered":"2023-08-31T18:47:52.988216+0000","last_clean":"2023-08-31T18:47:52.988216+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T18:47:52.988216+0000","last_undegraded":"2023-08-31T18:47:52.988216+0000","last_fullsized":"2023-08-31T18:47:52.988216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982531+0000","last_change":"2023-08-31T18:47:52.531178+0000","last_active":"2023-08-31T18:47:52.982531+0000","last_peered":"2023-08-31T18:47:52.982531+0000","last_clean":"2023-08-31T18:47:52.982531+0000","last_became_active":"2023-08-31T18:47:52.530913+0000","last_became_peered":"2023-08-31T18:47:52.530913+0000","last_unstale":"2023-08-31T18:47:52.982531+0000","last_undegraded":"2023-08-31T18:47:52.982531+0000","last_fullsized":"2023-08-31T18:47:52.982531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.005141+0000","last_change":"2023-08-31T18:47:53.003355+0000","last_active":"2023-08-31T18:47:53.005141+0000","last_peered":"2023-08-31T18:47:53.005141+0000","last_clean":"2023-08-31T18:47:53.005141+0000","last_became_active":"2023-08-31T18:47:53.003045+0000","last_became_peered":"2023-08-31T18:47:53.003045+0000","last_unstale":"2023-08-31T18:47:53.005141+0000","last_undegraded":"2023-08-31T18:47:53.005141+0000","last_fullsized":"2023-08-31T18:47:53.005141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002389+0000","last_change":"2023-08-31T18:47:52.529487+0000","last_active":"2023-08-31T18:47:53.002389+0000","last_peered":"2023-08-31T18:47:53.002389+0000","last_clean":"2023-08-31T18:47:53.002389+0000","last_became_active":"2023-08-31T18:47:52.529159+0000","last_became_peered":"2023-08-31T18:47:52.529159+0000","last_unstale":"2023-08-31T18:47:53.002389+0000","last_undegraded":"2023-08-31T18:47:53.002389+0000","last_fullsized":"2023-08-31T18:47:53.002389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982262+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T18:47:52.982262+0000","last_peered":"2023-08-31T18:47:52.982262+0000","last_clean":"2023-08-31T18:47:52.982262+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T18:47:52.982262+0000","last_undegraded":"2023-08-31T18:47:52.982262+0000","last_fullsized":"2023-08-31T18:47:52.982262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002206+0000","last_change":"2023-08-31T18:47:52.997271+0000","last_active":"2023-08-31T18:47:53.002206+0000","last_peered":"2023-08-31T18:47:53.002206+0000","last_clean":"2023-08-31T18:47:53.002206+0000","last_became_active":"2023-08-31T18:47:52.996372+0000","last_became_peered":"2023-08-31T18:47:52.996372+0000","last_unstale":"2023-08-31T18:47:53.002206+0000","last_undegraded":"2023-08-31T18:47:53.002206+0000","last_fullsized":"2023-08-31T18:47:53.002206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979289+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T18:47:52.979289+0000","last_peered":"2023-08-31T18:47:52.979289+0000","last_clean":"2023-08-31T18:47:52.979289+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T18:47:52.979289+0000","last_undegraded":"2023-08-31T18:47:52.979289+0000","last_fullsized":"2023-08-31T18:47:52.979289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.985153+0000","last_change":"2023-08-31T18:47:52.525869+0000","last_active":"2023-08-31T18:47:52.985153+0000","last_peered":"2023-08-31T18:47:52.985153+0000","last_clean":"2023-08-31T18:47:52.985153+0000","last_became_active":"2023-08-31T18:47:52.525594+0000","last_became_peered":"2023-08-31T18:47:52.525594+0000","last_unstale":"2023-08-31T18:47:52.985153+0000","last_undegraded":"2023-08-31T18:47:52.985153+0000","last_fullsized":"2023-08-31T18:47:52.985153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009323+0000","last_change":"2023-08-31T18:47:53.003708+0000","last_active":"2023-08-31T18:47:53.009323+0000","last_peered":"2023-08-31T18:47:53.009323+0000","last_clean":"2023-08-31T18:47:53.009323+0000","last_became_active":"2023-08-31T18:47:53.001875+0000","last_became_peered":"2023-08-31T18:47:53.001875+0000","last_unstale":"2023-08-31T18:47:53.009323+0000","last_undegraded":"2023-08-31T18:47:53.009323+0000","last_fullsized":"2023-08-31T18:47:53.009323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000518+0000","last_change":"2023-08-31T18:47:52.990509+0000","last_active":"2023-08-31T18:47:53.000518+0000","last_peered":"2023-08-31T18:47:53.000518+0000","last_clean":"2023-08-31T18:47:53.000518+0000","last_became_active":"2023-08-31T18:47:52.990124+0000","last_became_peered":"2023-08-31T18:47:52.990124+0000","last_unstale":"2023-08-31T18:47:53.000518+0000","last_undegraded":"2023-08-31T18:47:53.000518+0000","last_fullsized":"2023-08-31T18:47:53.000518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984947+0000","last_change":"2023-08-31T18:47:52.530755+0000","last_active":"2023-08-31T18:47:52.984947+0000","last_peered":"2023-08-31T18:47:52.984947+0000","last_clean":"2023-08-31T18:47:52.984947+0000","last_became_active":"2023-08-31T18:47:52.530495+0000","last_became_peered":"2023-08-31T18:47:52.530495+0000","last_unstale":"2023-08-31T18:47:52.984947+0000","last_undegraded":"2023-08-31T18:47:52.984947+0000","last_fullsized":"2023-08-31T18:47:52.984947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010816+0000","last_change":"2023-08-31T18:47:53.008012+0000","last_active":"2023-08-31T18:47:53.010816+0000","last_peered":"2023-08-31T18:47:53.010816+0000","last_clean":"2023-08-31T18:47:53.010816+0000","last_became_active":"2023-08-31T18:47:53.007721+0000","last_became_peered":"2023-08-31T18:47:53.007721+0000","last_unstale":"2023-08-31T18:47:53.010816+0000","last_undegraded":"2023-08-31T18:47:53.010816+0000","last_fullsized":"2023-08-31T18:47:53.010816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981199+0000","last_change":"2023-08-31T18:47:52.536133+0000","last_active":"2023-08-31T18:47:52.981199+0000","last_peered":"2023-08-31T18:47:52.981199+0000","last_clean":"2023-08-31T18:47:52.981199+0000","last_became_active":"2023-08-31T18:47:52.535677+0000","last_became_peered":"2023-08-31T18:47:52.535677+0000","last_unstale":"2023-08-31T18:47:52.981199+0000","last_undegraded":"2023-08-31T18:47:52.981199+0000","last_fullsized":"2023-08-31T18:47:52.981199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010314+0000","last_change":"2023-08-31T18:47:53.007441+0000","last_active":"2023-08-31T18:47:53.010314+0000","last_peered":"2023-08-31T18:47:53.010314+0000","last_clean":"2023-08-31T18:47:53.010314+0000","last_became_active":"2023-08-31T18:47:53.007151+0000","last_became_peered":"2023-08-31T18:47:53.007151+0000","last_unstale":"2023-08-31T18:47:53.010314+0000","last_undegraded":"2023-08-31T18:47:53.010314+0000","last_fullsized":"2023-08-31T18:47:53.010314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997915+0000","last_change":"2023-08-31T18:47:52.534374+0000","last_active":"2023-08-31T18:47:52.997915+0000","last_peered":"2023-08-31T18:47:52.997915+0000","last_clean":"2023-08-31T18:47:52.997915+0000","last_became_active":"2023-08-31T18:47:52.534039+0000","last_became_peered":"2023-08-31T18:47:52.534039+0000","last_unstale":"2023-08-31T18:47:52.997915+0000","last_undegraded":"2023-08-31T18:47:52.997915+0000","last_fullsized":"2023-08-31T18:47:52.997915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999154+0000","last_change":"2023-08-31T18:47:52.988662+0000","last_active":"2023-08-31T18:47:52.999154+0000","last_peered":"2023-08-31T18:47:52.999154+0000","last_clean":"2023-08-31T18:47:52.999154+0000","last_became_active":"2023-08-31T18:47:52.988023+0000","last_became_peered":"2023-08-31T18:47:52.988023+0000","last_unstale":"2023-08-31T18:47:52.999154+0000","last_undegraded":"2023-08-31T18:47:52.999154+0000","last_fullsized":"2023-08-31T18:47:52.999154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997630+0000","last_change":"2023-08-31T18:47:52.529298+0000","last_active":"2023-08-31T18:47:52.997630+0000","last_peered":"2023-08-31T18:47:52.997630+0000","last_clean":"2023-08-31T18:47:52.997630+0000","last_became_active":"2023-08-31T18:47:52.529019+0000","last_became_peered":"2023-08-31T18:47:52.529019+0000","last_unstale":"2023-08-31T18:47:52.997630+0000","last_undegraded":"2023-08-31T18:47:52.997630+0000","last_fullsized":"2023-08-31T18:47:52.997630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013482+0000","last_change":"2023-08-31T18:47:53.011094+0000","last_active":"2023-08-31T18:47:53.013482+0000","last_peered":"2023-08-31T18:47:53.013482+0000","last_clean":"2023-08-31T18:47:53.013482+0000","last_became_active":"2023-08-31T18:47:53.010736+0000","last_became_peered":"2023-08-31T18:47:53.010736+0000","last_unstale":"2023-08-31T18:47:53.013482+0000","last_undegraded":"2023-08-31T18:47:53.013482+0000","last_fullsized":"2023-08-31T18:47:53.013482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.995373+0000","last_change":"2023-08-31T18:47:52.535396+0000","last_active":"2023-08-31T18:47:52.995373+0000","last_peered":"2023-08-31T18:47:52.995373+0000","last_clean":"2023-08-31T18:47:52.995373+0000","last_became_active":"2023-08-31T18:47:52.535096+0000","last_became_peered":"2023-08-31T18:47:52.535096+0000","last_unstale":"2023-08-31T18:47:52.995373+0000","last_undegraded":"2023-08-31T18:47:52.995373+0000","last_fullsized":"2023-08-31T18:47:52.995373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.011507+0000","last_change":"2023-08-31T18:47:53.010796+0000","last_active":"2023-08-31T18:47:53.011507+0000","last_peered":"2023-08-31T18:47:53.011507+0000","last_clean":"2023-08-31T18:47:53.011507+0000","last_became_active":"2023-08-31T18:47:53.010536+0000","last_became_peered":"2023-08-31T18:47:53.010536+0000","last_unstale":"2023-08-31T18:47:53.011507+0000","last_undegraded":"2023-08-31T18:47:53.011507+0000","last_fullsized":"2023-08-31T18:47:53.011507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979264+0000","last_change":"2023-08-31T18:47:52.526866+0000","last_active":"2023-08-31T18:47:52.979264+0000","last_peered":"2023-08-31T18:47:52.979264+0000","last_clean":"2023-08-31T18:47:52.979264+0000","last_became_active":"2023-08-31T18:47:52.526378+0000","last_became_peered":"2023-08-31T18:47:52.526378+0000","last_unstale":"2023-08-31T18:47:52.979264+0000","last_undegraded":"2023-08-31T18:47:52.979264+0000","last_fullsized":"2023-08-31T18:47:52.979264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.991664+0000","last_change":"2023-08-31T18:47:52.988166+0000","last_active":"2023-08-31T18:47:52.991664+0000","last_peered":"2023-08-31T18:47:52.991664+0000","last_clean":"2023-08-31T18:47:52.991664+0000","last_became_active":"2023-08-31T18:47:52.987862+0000","last_became_peered":"2023-08-31T18:47:52.987862+0000","last_unstale":"2023-08-31T18:47:52.991664+0000","last_undegraded":"2023-08-31T18:47:52.991664+0000","last_fullsized":"2023-08-31T18:47:52.991664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979954+0000","last_change":"2023-08-31T18:47:52.536528+0000","last_active":"2023-08-31T18:47:52.979954+0000","last_peered":"2023-08-31T18:47:52.979954+0000","last_clean":"2023-08-31T18:47:52.979954+0000","last_became_active":"2023-08-31T18:47:52.536263+0000","last_became_peered":"2023-08-31T18:47:52.536263+0000","last_unstale":"2023-08-31T18:47:52.979954+0000","last_undegraded":"2023-08-31T18:47:52.979954+0000","last_fullsized":"2023-08-31T18:47:52.979954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010523+0000","last_change":"2023-08-31T18:47:53.006199+0000","last_active":"2023-08-31T18:47:53.010523+0000","last_peered":"2023-08-31T18:47:53.010523+0000","last_clean":"2023-08-31T18:47:53.010523+0000","last_became_active":"2023-08-31T18:47:53.005772+0000","last_became_peered":"2023-08-31T18:47:53.005772+0000","last_unstale":"2023-08-31T18:47:53.010523+0000","last_undegraded":"2023-08-31T18:47:53.010523+0000","last_fullsized":"2023-08-31T18:47:53.010523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981987+0000","last_change":"2023-08-31T18:47:52.531200+0000","last_active":"2023-08-31T18:47:52.981987+0000","last_peered":"2023-08-31T18:47:52.981987+0000","last_clean":"2023-08-31T18:47:52.981987+0000","last_became_active":"2023-08-31T18:47:52.530888+0000","last_became_peered":"2023-08-31T18:47:52.530888+0000","last_unstale":"2023-08-31T18:47:52.981987+0000","last_undegraded":"2023-08-31T18:47:52.981987+0000","last_fullsized":"2023-08-31T18:47:52.981987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003936+0000","last_change":"2023-08-31T18:47:52.992639+0000","last_active":"2023-08-31T18:47:53.003936+0000","last_peered":"2023-08-31T18:47:53.003936+0000","last_clean":"2023-08-31T18:47:53.003936+0000","last_became_active":"2023-08-31T18:47:52.992365+0000","last_became_peered":"2023-08-31T18:47:52.992365+0000","last_unstale":"2023-08-31T18:47:53.003936+0000","last_undegraded":"2023-08-31T18:47:53.003936+0000","last_fullsized":"2023-08-31T18:47:53.003936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984775+0000","last_change":"2023-08-31T18:47:52.523604+0000","last_active":"2023-08-31T18:47:52.984775+0000","last_peered":"2023-08-31T18:47:52.984775+0000","last_clean":"2023-08-31T18:47:52.984775+0000","last_became_active":"2023-08-31T18:47:52.523314+0000","last_became_peered":"2023-08-31T18:47:52.523314+0000","last_unstale":"2023-08-31T18:47:52.984775+0000","last_undegraded":"2023-08-31T18:47:52.984775+0000","last_fullsized":"2023-08-31T18:47:52.984775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003706+0000","last_change":"2023-08-31T18:47:53.000736+0000","last_active":"2023-08-31T18:47:53.003706+0000","last_peered":"2023-08-31T18:47:53.003706+0000","last_clean":"2023-08-31T18:47:53.003706+0000","last_became_active":"2023-08-31T18:47:53.000299+0000","last_became_peered":"2023-08-31T18:47:53.000299+0000","last_unstale":"2023-08-31T18:47:53.003706+0000","last_undegraded":"2023-08-31T18:47:53.003706+0000","last_fullsized":"2023-08-31T18:47:53.003706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980656+0000","last_change":"2023-08-31T18:47:52.532777+0000","last_active":"2023-08-31T18:47:52.980656+0000","last_peered":"2023-08-31T18:47:52.980656+0000","last_clean":"2023-08-31T18:47:52.980656+0000","last_became_active":"2023-08-31T18:47:52.532315+0000","last_became_peered":"2023-08-31T18:47:52.532315+0000","last_unstale":"2023-08-31T18:47:52.980656+0000","last_undegraded":"2023-08-31T18:47:52.980656+0000","last_fullsized":"2023-08-31T18:47:52.980656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013496+0000","last_change":"2023-08-31T18:47:53.011112+0000","last_active":"2023-08-31T18:47:53.013496+0000","last_peered":"2023-08-31T18:47:53.013496+0000","last_clean":"2023-08-31T18:47:53.013496+0000","last_became_active":"2023-08-31T18:47:53.010727+0000","last_became_peered":"2023-08-31T18:47:53.010727+0000","last_unstale":"2023-08-31T18:47:53.013496+0000","last_undegraded":"2023-08-31T18:47:53.013496+0000","last_fullsized":"2023-08-31T18:47:53.013496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982317+0000","last_change":"2023-08-31T18:47:52.518395+0000","last_active":"2023-08-31T18:47:52.982317+0000","last_peered":"2023-08-31T18:47:52.982317+0000","last_clean":"2023-08-31T18:47:52.982317+0000","last_became_active":"2023-08-31T18:47:52.518052+0000","last_became_peered":"2023-08-31T18:47:52.518052+0000","last_unstale":"2023-08-31T18:47:52.982317+0000","last_undegraded":"2023-08-31T18:47:52.982317+0000","last_fullsized":"2023-08-31T18:47:52.982317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999877+0000","last_change":"2023-08-31T18:47:52.993488+0000","last_active":"2023-08-31T18:47:52.999877+0000","last_peered":"2023-08-31T18:47:52.999877+0000","last_clean":"2023-08-31T18:47:52.999877+0000","last_became_active":"2023-08-31T18:47:52.993212+0000","last_became_peered":"2023-08-31T18:47:52.993212+0000","last_unstale":"2023-08-31T18:47:52.999877+0000","last_undegraded":"2023-08-31T18:47:52.999877+0000","last_fullsized":"2023-08-31T18:47:52.999877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.983225+0000","last_change":"2023-08-31T18:47:52.525508+0000","last_active":"2023-08-31T18:47:53.983225+0000","last_peered":"2023-08-31T18:47:53.983225+0000","last_clean":"2023-08-31T18:47:53.983225+0000","last_became_active":"2023-08-31T18:47:52.525174+0000","last_became_peered":"2023-08-31T18:47:52.525174+0000","last_unstale":"2023-08-31T18:47:53.983225+0000","last_undegraded":"2023-08-31T18:47:53.983225+0000","last_fullsized":"2023-08-31T18:47:53.983225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.995366+0000","last_change":"2023-08-31T18:47:52.992245+0000","last_active":"2023-08-31T18:47:52.995366+0000","last_peered":"2023-08-31T18:47:52.995366+0000","last_clean":"2023-08-31T18:47:52.995366+0000","last_became_active":"2023-08-31T18:47:52.991850+0000","last_became_peered":"2023-08-31T18:47:52.991850+0000","last_unstale":"2023-08-31T18:47:52.995366+0000","last_undegraded":"2023-08-31T18:47:52.995366+0000","last_fullsized":"2023-08-31T18:47:52.995366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978676+0000","last_change":"2023-08-31T18:47:52.532525+0000","last_active":"2023-08-31T18:47:52.978676+0000","last_peered":"2023-08-31T18:47:52.978676+0000","last_clean":"2023-08-31T18:47:52.978676+0000","last_became_active":"2023-08-31T18:47:52.532286+0000","last_became_peered":"2023-08-31T18:47:52.532286+0000","last_unstale":"2023-08-31T18:47:52.978676+0000","last_undegraded":"2023-08-31T18:47:52.978676+0000","last_fullsized":"2023-08-31T18:47:52.978676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003173+0000","last_change":"2023-08-31T18:47:52.998570+0000","last_active":"2023-08-31T18:47:53.003173+0000","last_peered":"2023-08-31T18:47:53.003173+0000","last_clean":"2023-08-31T18:47:53.003173+0000","last_became_active":"2023-08-31T18:47:52.997982+0000","last_became_peered":"2023-08-31T18:47:52.997982+0000","last_unstale":"2023-08-31T18:47:53.003173+0000","last_undegraded":"2023-08-31T18:47:53.003173+0000","last_fullsized":"2023-08-31T18:47:53.003173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981657+0000","last_change":"2023-08-31T18:47:52.532565+0000","last_active":"2023-08-31T18:47:52.981657+0000","last_peered":"2023-08-31T18:47:52.981657+0000","last_clean":"2023-08-31T18:47:52.981657+0000","last_became_active":"2023-08-31T18:47:52.530954+0000","last_became_peered":"2023-08-31T18:47:52.530954+0000","last_unstale":"2023-08-31T18:47:52.981657+0000","last_undegraded":"2023-08-31T18:47:52.981657+0000","last_fullsized":"2023-08-31T18:47:52.981657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009277+0000","last_change":"2023-08-31T18:47:53.003156+0000","last_active":"2023-08-31T18:47:53.009277+0000","last_peered":"2023-08-31T18:47:53.009277+0000","last_clean":"2023-08-31T18:47:53.009277+0000","last_became_active":"2023-08-31T18:47:53.002838+0000","last_became_peered":"2023-08-31T18:47:53.002838+0000","last_unstale":"2023-08-31T18:47:53.009277+0000","last_undegraded":"2023-08-31T18:47:53.009277+0000","last_fullsized":"2023-08-31T18:47:53.009277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980428+0000","last_change":"2023-08-31T18:47:52.533155+0000","last_active":"2023-08-31T18:47:52.980428+0000","last_peered":"2023-08-31T18:47:52.980428+0000","last_clean":"2023-08-31T18:47:52.980428+0000","last_became_active":"2023-08-31T18:47:52.532852+0000","last_became_peered":"2023-08-31T18:47:52.532852+0000","last_unstale":"2023-08-31T18:47:52.980428+0000","last_undegraded":"2023-08-31T18:47:52.980428+0000","last_fullsized":"2023-08-31T18:47:52.980428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002837+0000","last_change":"2023-08-31T18:47:52.991952+0000","last_active":"2023-08-31T18:47:53.002837+0000","last_peered":"2023-08-31T18:47:53.002837+0000","last_clean":"2023-08-31T18:47:53.002837+0000","last_became_active":"2023-08-31T18:47:52.991706+0000","last_became_peered":"2023-08-31T18:47:52.991706+0000","last_unstale":"2023-08-31T18:47:53.002837+0000","last_undegraded":"2023-08-31T18:47:53.002837+0000","last_fullsized":"2023-08-31T18:47:53.002837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982376+0000","last_change":"2023-08-31T18:47:52.530999+0000","last_active":"2023-08-31T18:47:52.982376+0000","last_peered":"2023-08-31T18:47:52.982376+0000","last_clean":"2023-08-31T18:47:52.982376+0000","last_became_active":"2023-08-31T18:47:52.530492+0000","last_became_peered":"2023-08-31T18:47:52.530492+0000","last_unstale":"2023-08-31T18:47:52.982376+0000","last_undegraded":"2023-08-31T18:47:52.982376+0000","last_fullsized":"2023-08-31T18:47:52.982376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013431+0000","last_change":"2023-08-31T18:47:53.010887+0000","last_active":"2023-08-31T18:47:53.013431+0000","last_peered":"2023-08-31T18:47:53.013431+0000","last_clean":"2023-08-31T18:47:53.013431+0000","last_became_active":"2023-08-31T18:47:53.010563+0000","last_became_peered":"2023-08-31T18:47:53.010563+0000","last_unstale":"2023-08-31T18:47:53.013431+0000","last_undegraded":"2023-08-31T18:47:53.013431+0000","last_fullsized":"2023-08-31T18:47:53.013431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003063+0000","last_change":"2023-08-31T18:47:52.524520+0000","last_active":"2023-08-31T18:47:53.003063+0000","last_peered":"2023-08-31T18:47:53.003063+0000","last_clean":"2023-08-31T18:47:53.003063+0000","last_became_active":"2023-08-31T18:47:52.524248+0000","last_became_peered":"2023-08-31T18:47:52.524248+0000","last_unstale":"2023-08-31T18:47:53.003063+0000","last_undegraded":"2023-08-31T18:47:53.003063+0000","last_fullsized":"2023-08-31T18:47:53.003063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009527+0000","last_change":"2023-08-31T18:47:53.004250+0000","last_active":"2023-08-31T18:47:53.009527+0000","last_peered":"2023-08-31T18:47:53.009527+0000","last_clean":"2023-08-31T18:47:53.009527+0000","last_became_active":"2023-08-31T18:47:53.003889+0000","last_became_peered":"2023-08-31T18:47:53.003889+0000","last_unstale":"2023-08-31T18:47:53.009527+0000","last_undegraded":"2023-08-31T18:47:53.009527+0000","last_fullsized":"2023-08-31T18:47:53.009527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979331+0000","last_change":"2023-08-31T18:47:52.522809+0000","last_active":"2023-08-31T18:47:52.979331+0000","last_peered":"2023-08-31T18:47:52.979331+0000","last_clean":"2023-08-31T18:47:52.979331+0000","last_became_active":"2023-08-31T18:47:52.522517+0000","last_became_peered":"2023-08-31T18:47:52.522517+0000","last_unstale":"2023-08-31T18:47:52.979331+0000","last_undegraded":"2023-08-31T18:47:52.979331+0000","last_fullsized":"2023-08-31T18:47:52.979331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.994341+0000","last_change":"2023-08-31T18:47:52.990434+0000","last_active":"2023-08-31T18:47:52.994341+0000","last_peered":"2023-08-31T18:47:52.994341+0000","last_clean":"2023-08-31T18:47:52.994341+0000","last_became_active":"2023-08-31T18:47:52.989943+0000","last_became_peered":"2023-08-31T18:47:52.989943+0000","last_unstale":"2023-08-31T18:47:52.994341+0000","last_undegraded":"2023-08-31T18:47:52.994341+0000","last_fullsized":"2023-08-31T18:47:52.994341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.008488+0000","last_change":"2023-08-31T18:47:52.526791+0000","last_active":"2023-08-31T18:47:53.008488+0000","last_peered":"2023-08-31T18:47:53.008488+0000","last_clean":"2023-08-31T18:47:53.008488+0000","last_became_active":"2023-08-31T18:47:52.526453+0000","last_became_peered":"2023-08-31T18:47:52.526453+0000","last_unstale":"2023-08-31T18:47:53.008488+0000","last_undegraded":"2023-08-31T18:47:53.008488+0000","last_fullsized":"2023-08-31T18:47:53.008488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.999173+0000","last_change":"2023-08-31T18:47:52.988877+0000","last_active":"2023-08-31T18:47:52.999173+0000","last_peered":"2023-08-31T18:47:52.999173+0000","last_clean":"2023-08-31T18:47:52.999173+0000","last_became_active":"2023-08-31T18:47:52.988408+0000","last_became_peered":"2023-08-31T18:47:52.988408+0000","last_unstale":"2023-08-31T18:47:52.999173+0000","last_undegraded":"2023-08-31T18:47:52.999173+0000","last_fullsized":"2023-08-31T18:47:52.999173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.980246+0000","last_change":"2023-08-31T18:47:52.530145+0000","last_active":"2023-08-31T18:47:52.980246+0000","last_peered":"2023-08-31T18:47:52.980246+0000","last_clean":"2023-08-31T18:47:52.980246+0000","last_became_active":"2023-08-31T18:47:52.529794+0000","last_became_peered":"2023-08-31T18:47:52.529794+0000","last_unstale":"2023-08-31T18:47:52.980246+0000","last_undegraded":"2023-08-31T18:47:52.980246+0000","last_fullsized":"2023-08-31T18:47:52.980246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010719+0000","last_change":"2023-08-31T18:47:53.008088+0000","last_active":"2023-08-31T18:47:53.010719+0000","last_peered":"2023-08-31T18:47:53.010719+0000","last_clean":"2023-08-31T18:47:53.010719+0000","last_became_active":"2023-08-31T18:47:53.007777+0000","last_became_peered":"2023-08-31T18:47:53.007777+0000","last_unstale":"2023-08-31T18:47:53.010719+0000","last_undegraded":"2023-08-31T18:47:53.010719+0000","last_fullsized":"2023-08-31T18:47:53.010719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982119+0000","last_change":"2023-08-31T18:47:52.533768+0000","last_active":"2023-08-31T18:47:52.982119+0000","last_peered":"2023-08-31T18:47:52.982119+0000","last_clean":"2023-08-31T18:47:52.982119+0000","last_became_active":"2023-08-31T18:47:52.533361+0000","last_became_peered":"2023-08-31T18:47:52.533361+0000","last_unstale":"2023-08-31T18:47:52.982119+0000","last_undegraded":"2023-08-31T18:47:52.982119+0000","last_fullsized":"2023-08-31T18:47:52.982119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003194+0000","last_change":"2023-08-31T18:47:52.998770+0000","last_active":"2023-08-31T18:47:53.003194+0000","last_peered":"2023-08-31T18:47:53.003194+0000","last_clean":"2023-08-31T18:47:53.003194+0000","last_became_active":"2023-08-31T18:47:52.998321+0000","last_became_peered":"2023-08-31T18:47:52.998321+0000","last_unstale":"2023-08-31T18:47:53.003194+0000","last_undegraded":"2023-08-31T18:47:53.003194+0000","last_fullsized":"2023-08-31T18:47:53.003194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.997292+0000","last_change":"2023-08-31T18:47:52.532924+0000","last_active":"2023-08-31T18:47:52.997292+0000","last_peered":"2023-08-31T18:47:52.997292+0000","last_clean":"2023-08-31T18:47:52.997292+0000","last_became_active":"2023-08-31T18:47:52.531625+0000","last_became_peered":"2023-08-31T18:47:52.531625+0000","last_unstale":"2023-08-31T18:47:52.997292+0000","last_undegraded":"2023-08-31T18:47:52.997292+0000","last_fullsized":"2023-08-31T18:47:52.997292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009212+0000","last_change":"2023-08-31T18:47:52.997006+0000","last_active":"2023-08-31T18:47:53.009212+0000","last_peered":"2023-08-31T18:47:53.009212+0000","last_clean":"2023-08-31T18:47:53.009212+0000","last_became_active":"2023-08-31T18:47:52.996663+0000","last_became_peered":"2023-08-31T18:47:52.996663+0000","last_unstale":"2023-08-31T18:47:53.009212+0000","last_undegraded":"2023-08-31T18:47:53.009212+0000","last_fullsized":"2023-08-31T18:47:53.009212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981008+0000","last_change":"2023-08-31T18:47:52.516464+0000","last_active":"2023-08-31T18:47:52.981008+0000","last_peered":"2023-08-31T18:47:52.981008+0000","last_clean":"2023-08-31T18:47:52.981008+0000","last_became_active":"2023-08-31T18:47:52.516164+0000","last_became_peered":"2023-08-31T18:47:52.516164+0000","last_unstale":"2023-08-31T18:47:52.981008+0000","last_undegraded":"2023-08-31T18:47:52.981008+0000","last_fullsized":"2023-08-31T18:47:52.981008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010930+0000","last_change":"2023-08-31T18:47:53.005504+0000","last_active":"2023-08-31T18:47:53.010930+0000","last_peered":"2023-08-31T18:47:53.010930+0000","last_clean":"2023-08-31T18:47:53.010930+0000","last_became_active":"2023-08-31T18:47:53.005202+0000","last_became_peered":"2023-08-31T18:47:53.005202+0000","last_unstale":"2023-08-31T18:47:53.010930+0000","last_undegraded":"2023-08-31T18:47:53.010930+0000","last_fullsized":"2023-08-31T18:47:53.010930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984216+0000","last_change":"2023-08-31T18:47:52.524392+0000","last_active":"2023-08-31T18:47:52.984216+0000","last_peered":"2023-08-31T18:47:52.984216+0000","last_clean":"2023-08-31T18:47:52.984216+0000","last_became_active":"2023-08-31T18:47:52.524124+0000","last_became_peered":"2023-08-31T18:47:52.524124+0000","last_unstale":"2023-08-31T18:47:52.984216+0000","last_undegraded":"2023-08-31T18:47:52.984216+0000","last_fullsized":"2023-08-31T18:47:52.984216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.007216+0000","last_change":"2023-08-31T18:47:53.004792+0000","last_active":"2023-08-31T18:47:53.007216+0000","last_peered":"2023-08-31T18:47:53.007216+0000","last_clean":"2023-08-31T18:47:53.007216+0000","last_became_active":"2023-08-31T18:47:53.004470+0000","last_became_peered":"2023-08-31T18:47:53.004470+0000","last_unstale":"2023-08-31T18:47:53.007216+0000","last_undegraded":"2023-08-31T18:47:53.007216+0000","last_fullsized":"2023-08-31T18:47:53.007216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000085+0000","last_change":"2023-08-31T18:47:52.531667+0000","last_active":"2023-08-31T18:47:53.000085+0000","last_peered":"2023-08-31T18:47:53.000085+0000","last_clean":"2023-08-31T18:47:53.000085+0000","last_became_active":"2023-08-31T18:47:52.529811+0000","last_became_peered":"2023-08-31T18:47:52.529811+0000","last_unstale":"2023-08-31T18:47:53.000085+0000","last_undegraded":"2023-08-31T18:47:53.000085+0000","last_fullsized":"2023-08-31T18:47:53.000085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.007141+0000","last_change":"2023-08-31T18:47:53.004157+0000","last_active":"2023-08-31T18:47:53.007141+0000","last_peered":"2023-08-31T18:47:53.007141+0000","last_clean":"2023-08-31T18:47:53.007141+0000","last_became_active":"2023-08-31T18:47:53.003874+0000","last_became_peered":"2023-08-31T18:47:53.003874+0000","last_unstale":"2023-08-31T18:47:53.007141+0000","last_undegraded":"2023-08-31T18:47:53.007141+0000","last_fullsized":"2023-08-31T18:47:53.007141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.016407+0000","last_change":"2023-08-31T18:47:52.528085+0000","last_active":"2023-08-31T18:47:53.016407+0000","last_peered":"2023-08-31T18:47:53.016407+0000","last_clean":"2023-08-31T18:47:53.016407+0000","last_became_active":"2023-08-31T18:47:52.527709+0000","last_became_peered":"2023-08-31T18:47:52.527709+0000","last_unstale":"2023-08-31T18:47:53.016407+0000","last_undegraded":"2023-08-31T18:47:53.016407+0000","last_fullsized":"2023-08-31T18:47:53.016407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009270+0000","last_change":"2023-08-31T18:47:52.995956+0000","last_active":"2023-08-31T18:47:53.009270+0000","last_peered":"2023-08-31T18:47:53.009270+0000","last_clean":"2023-08-31T18:47:53.009270+0000","last_became_active":"2023-08-31T18:47:52.995594+0000","last_became_peered":"2023-08-31T18:47:52.995594+0000","last_unstale":"2023-08-31T18:47:53.009270+0000","last_undegraded":"2023-08-31T18:47:53.009270+0000","last_fullsized":"2023-08-31T18:47:53.009270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.981652+0000","last_change":"2023-08-31T18:47:52.531991+0000","last_active":"2023-08-31T18:47:52.981652+0000","last_peered":"2023-08-31T18:47:52.981652+0000","last_clean":"2023-08-31T18:47:52.981652+0000","last_became_active":"2023-08-31T18:47:52.531640+0000","last_became_peered":"2023-08-31T18:47:52.531640+0000","last_unstale":"2023-08-31T18:47:52.981652+0000","last_undegraded":"2023-08-31T18:47:52.981652+0000","last_fullsized":"2023-08-31T18:47:52.981652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009562+0000","last_change":"2023-08-31T18:47:53.004890+0000","last_active":"2023-08-31T18:47:53.009562+0000","last_peered":"2023-08-31T18:47:53.009562+0000","last_clean":"2023-08-31T18:47:53.009562+0000","last_became_active":"2023-08-31T18:47:53.004583+0000","last_became_peered":"2023-08-31T18:47:53.004583+0000","last_unstale":"2023-08-31T18:47:53.009562+0000","last_undegraded":"2023-08-31T18:47:53.009562+0000","last_fullsized":"2023-08-31T18:47:53.009562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.979377+0000","last_change":"2023-08-31T18:47:52.532169+0000","last_active":"2023-08-31T18:47:52.979377+0000","last_peered":"2023-08-31T18:47:52.979377+0000","last_clean":"2023-08-31T18:47:52.979377+0000","last_became_active":"2023-08-31T18:47:52.531828+0000","last_became_peered":"2023-08-31T18:47:52.531828+0000","last_unstale":"2023-08-31T18:47:52.979377+0000","last_undegraded":"2023-08-31T18:47:52.979377+0000","last_fullsized":"2023-08-31T18:47:52.979377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010270+0000","last_change":"2023-08-31T18:47:53.006485+0000","last_active":"2023-08-31T18:47:53.010270+0000","last_peered":"2023-08-31T18:47:53.010270+0000","last_clean":"2023-08-31T18:47:53.010270+0000","last_became_active":"2023-08-31T18:47:53.005959+0000","last_became_peered":"2023-08-31T18:47:53.005959+0000","last_unstale":"2023-08-31T18:47:53.010270+0000","last_undegraded":"2023-08-31T18:47:53.010270+0000","last_fullsized":"2023-08-31T18:47:53.010270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993529+0000","last_change":"2023-08-31T18:47:52.535478+0000","last_active":"2023-08-31T18:47:52.993529+0000","last_peered":"2023-08-31T18:47:52.993529+0000","last_clean":"2023-08-31T18:47:52.993529+0000","last_became_active":"2023-08-31T18:47:52.535070+0000","last_became_peered":"2023-08-31T18:47:52.535070+0000","last_unstale":"2023-08-31T18:47:52.993529+0000","last_undegraded":"2023-08-31T18:47:52.993529+0000","last_fullsized":"2023-08-31T18:47:52.993529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.000738+0000","last_change":"2023-08-31T18:47:52.995080+0000","last_active":"2023-08-31T18:47:53.000738+0000","last_peered":"2023-08-31T18:47:53.000738+0000","last_clean":"2023-08-31T18:47:53.000738+0000","last_became_active":"2023-08-31T18:47:52.994681+0000","last_became_peered":"2023-08-31T18:47:52.994681+0000","last_unstale":"2023-08-31T18:47:53.000738+0000","last_undegraded":"2023-08-31T18:47:53.000738+0000","last_fullsized":"2023-08-31T18:47:53.000738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.978985+0000","last_change":"2023-08-31T18:47:52.537767+0000","last_active":"2023-08-31T18:47:52.978985+0000","last_peered":"2023-08-31T18:47:52.978985+0000","last_clean":"2023-08-31T18:47:52.978985+0000","last_became_active":"2023-08-31T18:47:52.537385+0000","last_became_peered":"2023-08-31T18:47:52.537385+0000","last_unstale":"2023-08-31T18:47:52.978985+0000","last_undegraded":"2023-08-31T18:47:52.978985+0000","last_fullsized":"2023-08-31T18:47:52.978985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009241+0000","last_change":"2023-08-31T18:47:52.997396+0000","last_active":"2023-08-31T18:47:53.009241+0000","last_peered":"2023-08-31T18:47:53.009241+0000","last_clean":"2023-08-31T18:47:53.009241+0000","last_became_active":"2023-08-31T18:47:52.997047+0000","last_became_peered":"2023-08-31T18:47:52.997047+0000","last_unstale":"2023-08-31T18:47:53.009241+0000","last_undegraded":"2023-08-31T18:47:53.009241+0000","last_fullsized":"2023-08-31T18:47:53.009241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.992987+0000","last_change":"2023-08-31T18:47:52.527537+0000","last_active":"2023-08-31T18:47:52.992987+0000","last_peered":"2023-08-31T18:47:52.992987+0000","last_clean":"2023-08-31T18:47:52.992987+0000","last_became_active":"2023-08-31T18:47:52.527270+0000","last_became_peered":"2023-08-31T18:47:52.527270+0000","last_unstale":"2023-08-31T18:47:52.992987+0000","last_undegraded":"2023-08-31T18:47:52.992987+0000","last_fullsized":"2023-08-31T18:47:52.992987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.010969+0000","last_change":"2023-08-31T18:47:53.006192+0000","last_active":"2023-08-31T18:47:53.010969+0000","last_peered":"2023-08-31T18:47:53.010969+0000","last_clean":"2023-08-31T18:47:53.010969+0000","last_became_active":"2023-08-31T18:47:53.005781+0000","last_became_peered":"2023-08-31T18:47:53.005781+0000","last_unstale":"2023-08-31T18:47:53.010969+0000","last_undegraded":"2023-08-31T18:47:53.010969+0000","last_fullsized":"2023-08-31T18:47:53.010969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.992451+0000","last_change":"2023-08-31T18:47:52.530561+0000","last_active":"2023-08-31T18:47:52.992451+0000","last_peered":"2023-08-31T18:47:52.992451+0000","last_clean":"2023-08-31T18:47:52.992451+0000","last_became_active":"2023-08-31T18:47:52.530210+0000","last_became_peered":"2023-08-31T18:47:52.530210+0000","last_unstale":"2023-08-31T18:47:52.992451+0000","last_undegraded":"2023-08-31T18:47:52.992451+0000","last_fullsized":"2023-08-31T18:47:52.992451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.993847+0000","last_change":"2023-08-31T18:47:52.991129+0000","last_active":"2023-08-31T18:47:52.993847+0000","last_peered":"2023-08-31T18:47:52.993847+0000","last_clean":"2023-08-31T18:47:52.993847+0000","last_became_active":"2023-08-31T18:47:52.990398+0000","last_became_peered":"2023-08-31T18:47:52.990398+0000","last_unstale":"2023-08-31T18:47:52.993847+0000","last_undegraded":"2023-08-31T18:47:52.993847+0000","last_fullsized":"2023-08-31T18:47:52.993847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.006602+0000","last_change":"2023-08-31T18:47:52.527848+0000","last_active":"2023-08-31T18:47:53.006602+0000","last_peered":"2023-08-31T18:47:53.006602+0000","last_clean":"2023-08-31T18:47:53.006602+0000","last_became_active":"2023-08-31T18:47:52.527606+0000","last_became_peered":"2023-08-31T18:47:52.527606+0000","last_unstale":"2023-08-31T18:47:53.006602+0000","last_undegraded":"2023-08-31T18:47:53.006602+0000","last_fullsized":"2023-08-31T18:47:53.006602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.003221+0000","last_change":"2023-08-31T18:47:52.996941+0000","last_active":"2023-08-31T18:47:53.003221+0000","last_peered":"2023-08-31T18:47:53.003221+0000","last_clean":"2023-08-31T18:47:53.003221+0000","last_became_active":"2023-08-31T18:47:52.996629+0000","last_became_peered":"2023-08-31T18:47:52.996629+0000","last_unstale":"2023-08-31T18:47:53.003221+0000","last_undegraded":"2023-08-31T18:47:53.003221+0000","last_fullsized":"2023-08-31T18:47:53.003221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.002885+0000","last_change":"2023-08-31T18:47:52.532525+0000","last_active":"2023-08-31T18:47:53.002885+0000","last_peered":"2023-08-31T18:47:53.002885+0000","last_clean":"2023-08-31T18:47:53.002885+0000","last_became_active":"2023-08-31T18:47:52.532148+0000","last_became_peered":"2023-08-31T18:47:52.532148+0000","last_unstale":"2023-08-31T18:47:53.002885+0000","last_undegraded":"2023-08-31T18:47:53.002885+0000","last_fullsized":"2023-08-31T18:47:53.002885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009117+0000","last_change":"2023-08-31T18:47:52.999302+0000","last_active":"2023-08-31T18:47:53.009117+0000","last_peered":"2023-08-31T18:47:53.009117+0000","last_clean":"2023-08-31T18:47:53.009117+0000","last_became_active":"2023-08-31T18:47:52.998999+0000","last_became_peered":"2023-08-31T18:47:52.998999+0000","last_unstale":"2023-08-31T18:47:53.009117+0000","last_undegraded":"2023-08-31T18:47:53.009117+0000","last_fullsized":"2023-08-31T18:47:53.009117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.984593+0000","last_change":"2023-08-31T18:47:52.533151+0000","last_active":"2023-08-31T18:47:52.984593+0000","last_peered":"2023-08-31T18:47:52.984593+0000","last_clean":"2023-08-31T18:47:52.984593+0000","last_became_active":"2023-08-31T18:47:52.532807+0000","last_became_peered":"2023-08-31T18:47:52.532807+0000","last_unstale":"2023-08-31T18:47:52.984593+0000","last_undegraded":"2023-08-31T18:47:52.984593+0000","last_fullsized":"2023-08-31T18:47:52.984593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.007112+0000","last_change":"2023-08-31T18:47:53.001543+0000","last_active":"2023-08-31T18:47:53.007112+0000","last_peered":"2023-08-31T18:47:53.007112+0000","last_clean":"2023-08-31T18:47:53.007112+0000","last_became_active":"2023-08-31T18:47:53.001281+0000","last_became_peered":"2023-08-31T18:47:53.001281+0000","last_unstale":"2023-08-31T18:47:53.007112+0000","last_undegraded":"2023-08-31T18:47:53.007112+0000","last_fullsized":"2023-08-31T18:47:53.007112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:52.982462+0000","last_change":"2023-08-31T18:47:52.527162+0000","last_active":"2023-08-31T18:47:52.982462+0000","last_peered":"2023-08-31T18:47:52.982462+0000","last_clean":"2023-08-31T18:47:52.982462+0000","last_became_active":"2023-08-31T18:47:52.526459+0000","last_became_peered":"2023-08-31T18:47:52.526459+0000","last_unstale":"2023-08-31T18:47:52.982462+0000","last_undegraded":"2023-08-31T18:47:52.982462+0000","last_fullsized":"2023-08-31T18:47:52.982462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.009967+0000","last_change":"2023-08-31T18:47:52.999739+0000","last_active":"2023-08-31T18:47:53.009967+0000","last_peered":"2023-08-31T18:47:53.009967+0000","last_clean":"2023-08-31T18:47:53.009967+0000","last_became_active":"2023-08-31T18:47:52.999429+0000","last_became_peered":"2023-08-31T18:47:52.999429+0000","last_unstale":"2023-08-31T18:47:53.009967+0000","last_undegraded":"2023-08-31T18:47:53.009967+0000","last_fullsized":"2023-08-31T18:47:53.009967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:52.496637+0000","last_clean_scrub_stamp":"2023-08-31T18:47:52.496637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-31T18:47:53.013109+0000","last_change":"2023-08-31T18:47:52.524499+0000","last_active":"2023-08-31T18:47:53.013109+0000","last_peered":"2023-08-31T18:47:53.013109+0000","last_clean":"2023-08-31T18:47:53.013109+0000","last_became_active":"2023-08-31T18:47:52.524170+0000","last_became_peered":"2023-08-31T18:47:52.524170+0000","last_unstale":"2023-08-31T18:47:53.013109+0000","last_undegraded":"2023-08-31T18:47:53.013109+0000","last_fullsized":"2023-08-31T18:47:53.013109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:51.491133+0000","last_clean_scrub_stamp":"2023-08-31T18:47:51.491133+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":81647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":81679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":80303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":80323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":81825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T18:48:06.204 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-31T18:48:06.204 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-31T18:48:06.204 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-31T18:48:06.205 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-31T18:48:06.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.423+0000 7fcba35ff700 1 Processor -- start 2023-08-31T18:48:06.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.424+0000 7fcba35ff700 1 -- start start 2023-08-31T18:48:06.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.425+0000 7fcba35ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb9c1540c0 0x7fcb9c0a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:06.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.425+0000 7fcba35ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb9c0c0460 0x7fcb9c0c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:06.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.425+0000 7fcba35ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9c0c9730 con 0x7fcb9c0cba10 2023-08-31T18:48:06.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.425+0000 7fcba35ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9c05ef60 con 0x7fcb9c0c0460 2023-08-31T18:48:06.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.425+0000 7fcba35ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9c0c76c0 con 0x7fcb9c1540c0 2023-08-31T18:48:06.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.425+0000 7fcba1b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb9c0c0460 0x7fcb9c0c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.425+0000 7fcba0b9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcb9c0cba10 0x7fcb9c0bfd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36920/0 (socket says 172.21.15.72:36920) 2023-08-31T18:48:06.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.425+0000 7fcba1b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb9c0c0460 0x7fcb9c0c6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51384/0 (socket says 172.21.15.72:51384) 2023-08-31T18:48:06.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.425+0000 7fcba0b9a700 1 -- 172.21.15.72:0/382776439 learned_addr learned my addr 172.21.15.72:0/382776439 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:06.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.425+0000 7fcba139b700 1 --2- 172.21.15.72:0/382776439 >> v2:172.21.15.146:3300/0 conn(0x7fcb9c1540c0 0x7fcb9c0a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.426+0000 7fcba1b9c700 1 -- 172.21.15.72:0/382776439 >> v2:172.21.15.146:3300/0 conn(0x7fcb9c1540c0 msgr2=0x7fcb9c0a7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:06.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.426+0000 7fcba1b9c700 1 --2- 172.21.15.72:0/382776439 >> v2:172.21.15.146:3300/0 conn(0x7fcb9c1540c0 0x7fcb9c0a7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.426+0000 7fcba1b9c700 1 -- 172.21.15.72:0/382776439 >> v1:172.21.15.72:6789/0 conn(0x7fcb9c0cba10 legacy=0x7fcb9c0bfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:06.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.426+0000 7fcba1b9c700 1 -- 172.21.15.72:0/382776439 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c0c8e00 con 0x7fcb9c0c0460 2023-08-31T18:48:06.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.426+0000 7fcb93fff700 1 -- 172.21.15.72:0/382776439 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088585710 0 0) 0x7fcb9c0c9730 con 0x7fcb9c0cba10 2023-08-31T18:48:06.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.426+0000 7fcba1b9c700 1 --2- 172.21.15.72:0/382776439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9c0c0460 0x7fcb9c0c6de0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fcb9c083fb0 tx=0x7fcb94009780).ready entity=mon.0 client_cookie=ed870cb4448d8dcf server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:06.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.426+0000 7fcb93fff700 1 -- 172.21.15.72:0/382776439 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9400e070 con 0x7fcb9c0c0460 2023-08-31T18:48:06.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.426+0000 7fcb93fff700 1 -- 172.21.15.72:0/382776439 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9400bb60 con 0x7fcb9c0c0460 2023-08-31T18:48:06.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.426+0000 7fcb93fff700 1 -- 172.21.15.72:0/382776439 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94012410 con 0x7fcb9c0c0460 2023-08-31T18:48:06.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.427+0000 7fcba35ff700 1 -- 172.21.15.72:0/382776439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9c0c0460 msgr2=0x7fcb9c0c6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:06.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.427+0000 7fcba35ff700 1 --2- 172.21.15.72:0/382776439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9c0c0460 0x7fcb9c0c6de0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fcb9c083fb0 tx=0x7fcb94009780).stop 2023-08-31T18:48:06.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.427+0000 7fcba35ff700 1 -- 172.21.15.72:0/382776439 shutdown_connections 2023-08-31T18:48:06.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.427+0000 7fcba35ff700 1 --2- 172.21.15.72:0/382776439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9c0c0460 0x7fcb9c0c6de0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.427+0000 7fcba35ff700 1 --2- 172.21.15.72:0/382776439 >> v2:172.21.15.146:3300/0 conn(0x7fcb9c1540c0 0x7fcb9c0a7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.427+0000 7fcba35ff700 1 -- 172.21.15.72:0/382776439 >> 172.21.15.72:0/382776439 conn(0x7fcb9c05e870 msgr2=0x7fcb9c0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:06.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.427+0000 7fcba35ff700 1 -- 172.21.15.72:0/382776439 shutdown_connections 2023-08-31T18:48:06.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.427+0000 7fcba35ff700 1 -- 172.21.15.72:0/382776439 wait complete. 2023-08-31T18:48:06.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.428+0000 7fcba35ff700 1 Processor -- start 2023-08-31T18:48:06.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.428+0000 7fcba35ff700 1 -- start start 2023-08-31T18:48:06.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.429+0000 7fcba35ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9c0c0460 0x7fcb9c164650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:06.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.429+0000 7fcba35ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb9c0cba10 0x7fcb9c0ac620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:06.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.429+0000 7fcba35ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb9c1540c0 0x7fcb9c167160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:06.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.429+0000 7fcba35ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c164b40 con 0x7fcb9c0c0460 2023-08-31T18:48:06.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.429+0000 7fcba35ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c163b90 con 0x7fcb9c0cba10 2023-08-31T18:48:06.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.429+0000 7fcba35ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c167c20 con 0x7fcb9c1540c0 2023-08-31T18:48:06.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.429+0000 7fcba139b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9c0c0460 0x7fcb9c164650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.430+0000 7fcba139b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9c0c0460 0x7fcb9c164650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51390/0 (socket says 172.21.15.72:51390) 2023-08-31T18:48:06.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.430+0000 7fcba139b700 1 -- 172.21.15.72:0/1591791918 learned_addr learned my addr 172.21.15.72:0/1591791918 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:06.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.430+0000 7fcba0b9a700 1 --2- 172.21.15.72:0/1591791918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb9c0cba10 0x7fcb9c0ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.430+0000 7fcba1b9c700 1 --2- 172.21.15.72:0/1591791918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb9c1540c0 0x7fcb9c167160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.430+0000 7fcba139b700 1 -- 172.21.15.72:0/1591791918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb9c1540c0 msgr2=0x7fcb9c167160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:06.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.430+0000 7fcba139b700 1 --2- 172.21.15.72:0/1591791918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb9c1540c0 0x7fcb9c167160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.430+0000 7fcba139b700 1 -- 172.21.15.72:0/1591791918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb9c0cba10 msgr2=0x7fcb9c0ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:06.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.430+0000 7fcba139b700 1 --2- 172.21.15.72:0/1591791918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb9c0cba10 0x7fcb9c0ac620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.430+0000 7fcba139b700 1 -- 172.21.15.72:0/1591791918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb94009a20 con 0x7fcb9c0c0460 2023-08-31T18:48:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.430+0000 7fcba0b9a700 1 --2- 172.21.15.72:0/1591791918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb9c0cba10 0x7fcb9c0ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.430+0000 7fcba139b700 1 --2- 172.21.15.72:0/1591791918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9c0c0460 0x7fcb9c164650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fcb9800e8d0 tx=0x7fcb98006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.430+0000 7fcb917fa700 1 -- 172.21.15.72:0/1591791918 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9800c640 con 0x7fcb9c0c0460 2023-08-31T18:48:06.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.430+0000 7fcb917fa700 1 -- 172.21.15.72:0/1591791918 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9800c7a0 con 0x7fcb9c0c0460 2023-08-31T18:48:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.430+0000 7fcb917fa700 1 -- 172.21.15.72:0/1591791918 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9800cb20 con 0x7fcb9c0c0460 2023-08-31T18:48:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.430+0000 7fcba35ff700 1 -- 172.21.15.72:0/1591791918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9c167f00 con 0x7fcb9c0c0460 2023-08-31T18:48:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.431+0000 7fcba35ff700 1 -- 172.21.15.72:0/1591791918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9c164130 con 0x7fcb9c0c0460 2023-08-31T18:48:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.431+0000 7fcba35ff700 1 -- 172.21.15.72:0/1591791918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9c1644a0 con 0x7fcb9c0c0460 2023-08-31T18:48:06.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.432+0000 7fcb917fa700 1 -- 172.21.15.72:0/1591791918 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fcb9801b400 con 0x7fcb9c0c0460 2023-08-31T18:48:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.433+0000 7fcb917fa700 1 --2- 172.21.15.72:0/1591791918 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb8005ee10 0x7fcb800612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.433+0000 7fcb917fa700 1 -- 172.21.15.72:0/1591791918 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcb9807a350 con 0x7fcb9c0c0460 2023-08-31T18:48:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.433+0000 7fcba0b9a700 1 --2- 172.21.15.72:0/1591791918 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb8005ee10 0x7fcb800612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.434+0000 7fcba0b9a700 1 --2- 172.21.15.72:0/1591791918 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb8005ee10 0x7fcb800612d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fcb8c007fd0 tx=0x7fcb8c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:06.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.437+0000 7fcb917fa700 1 -- 172.21.15.72:0/1591791918 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcb9804b6a0 con 0x7fcb9c0c0460 2023-08-31T18:48:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.643+0000 7fcba35ff700 1 -- 172.21.15.72:0/1591791918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcb9c06acb0 con 0x7fcb9c0c0460 2023-08-31T18:48:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.644+0000 7fcb917fa700 1 -- 172.21.15.72:0/1591791918 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fcb9804ecc0 con 0x7fcb9c0c0460 2023-08-31T18:48:06.646 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.646+0000 7fcba35ff700 1 -- 172.21.15.72:0/1591791918 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb8005ee10 msgr2=0x7fcb800612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.646+0000 7fcba35ff700 1 --2- 172.21.15.72:0/1591791918 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb8005ee10 0x7fcb800612d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fcb8c007fd0 tx=0x7fcb8c009040).stop 2023-08-31T18:48:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.646+0000 7fcba35ff700 1 -- 172.21.15.72:0/1591791918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9c0c0460 msgr2=0x7fcb9c164650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.646+0000 7fcba35ff700 1 --2- 172.21.15.72:0/1591791918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9c0c0460 0x7fcb9c164650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fcb9800e8d0 tx=0x7fcb98006f40).stop 2023-08-31T18:48:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.646+0000 7fcba35ff700 1 -- 172.21.15.72:0/1591791918 shutdown_connections 2023-08-31T18:48:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.646+0000 7fcba35ff700 1 --2- 172.21.15.72:0/1591791918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb9c1540c0 0x7fcb9c167160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.646+0000 7fcba35ff700 1 --2- 172.21.15.72:0/1591791918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9c0c0460 0x7fcb9c164650 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.646+0000 7fcba35ff700 1 --2- 172.21.15.72:0/1591791918 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb8005ee10 0x7fcb800612d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.646+0000 7fcba35ff700 1 --2- 172.21.15.72:0/1591791918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb9c0cba10 0x7fcb9c0ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.646+0000 7fcba35ff700 1 -- 172.21.15.72:0/1591791918 >> 172.21.15.72:0/1591791918 conn(0x7fcb9c05e870 msgr2=0x7fcb9c0639e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:06.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.646+0000 7fcba35ff700 1 -- 172.21.15.72:0/1591791918 shutdown_connections 2023-08-31T18:48:06.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.646+0000 7fcba35ff700 1 -- 172.21.15.72:0/1591791918 wait complete. 2023-08-31T18:48:06.663 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-31T18:48:06.663 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-31T18:48:06.664 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:48:06.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.852+0000 7f7aebbff700 1 Processor -- start 2023-08-31T18:48:06.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.852+0000 7f7aebbff700 1 -- start start 2023-08-31T18:48:06.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.853+0000 7f7aebbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae415ce50 0x7f7ae415f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:06.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.853+0000 7f7aebbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae40c6120 con 0x7f7ae40cb9b0 2023-08-31T18:48:06.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.853+0000 7f7aebbff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae40c5e10 con 0x7f7ae4154060 2023-08-31T18:48:06.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.853+0000 7f7aebbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40c1380 con 0x7f7ae415ce50 2023-08-31T18:48:06.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.853+0000 7f7ae919a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7ae40cb9b0 0x7f7ae41583e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36932/0 (socket says 172.21.15.72:36932) 2023-08-31T18:48:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.853+0000 7f7ae919a700 1 -- 172.21.15.72:0/2392461518 learned_addr learned my addr 172.21.15.72:0/2392461518 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7aea19c700 1 --2- 172.21.15.72:0/2392461518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae415ce50 0x7f7ae415f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae8999700 1 -- 172.21.15.72:0/2392461518 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935524222 0 0) 0x7f7ae40c6120 con 0x7f7ae40cb9b0 2023-08-31T18:48:06.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae8999700 1 -- 172.21.15.72:0/2392461518 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ad00033f0 con 0x7f7ae40cb9b0 2023-08-31T18:48:06.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae8999700 1 -- 172.21.15.72:0/2392461518 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1424996621 0 0) 0x7f7ad00033f0 con 0x7f7ae40cb9b0 2023-08-31T18:48:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae8999700 1 -- 172.21.15.72:0/2392461518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae415ce50 msgr2=0x7f7ae415f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae8999700 1 --2- 172.21.15.72:0/2392461518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae415ce50 0x7f7ae415f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae8999700 1 -- 172.21.15.72:0/2392461518 >> v1:172.21.15.146:6789/0 conn(0x7f7ae4154060 legacy=0x7f7ae4157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae8999700 1 -- 172.21.15.72:0/2392461518 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4158af0 con 0x7f7ae40cb9b0 2023-08-31T18:48:06.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae8999700 1 -- 172.21.15.72:0/2392461518 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f7ad4001470 con 0x7f7ae40cb9b0 2023-08-31T18:48:06.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae8999700 1 -- 172.21.15.72:0/2392461518 >> v1:172.21.15.72:6789/0 conn(0x7f7ae40cb9b0 legacy=0x7f7ae41583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:06.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae8999700 1 --2- 172.21.15.72:0/2392461518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad0003910 0x7f7ad0003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:06.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae8999700 1 --2- 172.21.15.72:0/2392461518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ad0004690 0x7f7ad0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:06.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae8999700 1 --2- 172.21.15.72:0/2392461518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae415ce50 0x7f7ad0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:06.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae8999700 1 -- 172.21.15.72:0/2392461518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40c1380 con 0x7f7ad0003910 2023-08-31T18:48:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae8999700 1 -- 172.21.15.72:0/2392461518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad000b8e0 con 0x7f7ad0004690 2023-08-31T18:48:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae8999700 1 -- 172.21.15.72:0/2392461518 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad000ba50 con 0x7f7ae415ce50 2023-08-31T18:48:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.854+0000 7f7ae999b700 1 --2- 172.21.15.72:0/2392461518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad0003910 0x7f7ad0003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.855+0000 7f7ae919a700 1 --2- 172.21.15.72:0/2392461518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ad0004690 0x7f7ad0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.855+0000 7f7aea19c700 1 --2- 172.21.15.72:0/2392461518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae415ce50 0x7f7ad0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.855+0000 7f7ae999b700 1 -- 172.21.15.72:0/2392461518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae415ce50 msgr2=0x7f7ad0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.855+0000 7f7ae999b700 1 --2- 172.21.15.72:0/2392461518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae415ce50 0x7f7ad0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.855+0000 7f7ae999b700 1 -- 172.21.15.72:0/2392461518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ad0004690 msgr2=0x7f7ad0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.855+0000 7f7ae999b700 1 --2- 172.21.15.72:0/2392461518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ad0004690 0x7f7ad0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.855+0000 7f7ae999b700 1 -- 172.21.15.72:0/2392461518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad00033f0 con 0x7f7ad0003910 2023-08-31T18:48:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.855+0000 7f7ae919a700 1 --2- 172.21.15.72:0/2392461518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ad0004690 0x7f7ad0004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.855+0000 7f7aea19c700 1 --2- 172.21.15.72:0/2392461518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae415ce50 0x7f7ad0005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.855+0000 7f7ae999b700 1 --2- 172.21.15.72:0/2392461518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad0003910 0x7f7ad0003cf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f7ae00018a0 tx=0x7f7ae0007c00).ready entity=mon.0 client_cookie=4541871e8d16f7f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.855+0000 7f7ae8999700 1 -- 172.21.15.72:0/2392461518 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0013410 con 0x7f7ad0003910 2023-08-31T18:48:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.855+0000 7f7ae8999700 1 -- 172.21.15.72:0/2392461518 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae0013590 con 0x7f7ad0003910 2023-08-31T18:48:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.855+0000 7f7ae8999700 1 -- 172.21.15.72:0/2392461518 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0013950 con 0x7f7ad0003910 2023-08-31T18:48:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.856+0000 7f7aebbff700 1 -- 172.21.15.72:0/2392461518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad0003910 msgr2=0x7f7ad0003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.856+0000 7f7aebbff700 1 --2- 172.21.15.72:0/2392461518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad0003910 0x7f7ad0003cf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f7ae00018a0 tx=0x7f7ae0007c00).stop 2023-08-31T18:48:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.856+0000 7f7aea19c700 1 -- 172.21.15.72:0/2392461518 reap_dead start 2023-08-31T18:48:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.856+0000 7f7aebbff700 1 -- 172.21.15.72:0/2392461518 shutdown_connections 2023-08-31T18:48:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.856+0000 7f7aebbff700 1 -- 172.21.15.72:0/2392461518 >> 172.21.15.72:0/2392461518 conn(0x7f7ae405e870 msgr2=0x7f7ae40cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:06.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.856+0000 7f7aebbff700 1 -- 172.21.15.72:0/2392461518 shutdown_connections 2023-08-31T18:48:06.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.856+0000 7f7aebbff700 1 -- 172.21.15.72:0/2392461518 wait complete. 2023-08-31T18:48:06.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.857+0000 7f7aebbff700 1 Processor -- start 2023-08-31T18:48:06.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.857+0000 7f7aebbff700 1 -- start start 2023-08-31T18:48:06.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.858+0000 7f7aebbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad0003910 0x7f7ae4156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:06.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.858+0000 7f7aebbff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae4156bf0 0x7f7ae4152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:06.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.858+0000 7f7aebbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae4153270 0x7f7ae414a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:06.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.858+0000 7f7aebbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae4153d00 con 0x7f7ad0003910 2023-08-31T18:48:06.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.858+0000 7f7aebbff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40c7620 con 0x7f7ae4156bf0 2023-08-31T18:48:06.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.858+0000 7f7aebbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40c7900 con 0x7f7ae4153270 2023-08-31T18:48:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.858+0000 7f7ae999b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad0003910 0x7f7ae4156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.858+0000 7f7ae999b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad0003910 0x7f7ae4156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51408/0 (socket says 172.21.15.72:51408) 2023-08-31T18:48:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.858+0000 7f7ae999b700 1 -- 172.21.15.72:0/1222205492 learned_addr learned my addr 172.21.15.72:0/1222205492 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.859+0000 7f7ae919a700 1 --2- 172.21.15.72:0/1222205492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae4156bf0 0x7f7ae4152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.859+0000 7f7aea19c700 1 --2- 172.21.15.72:0/1222205492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae4153270 0x7f7ae414a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.859+0000 7f7ae999b700 1 -- 172.21.15.72:0/1222205492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae4153270 msgr2=0x7f7ae414a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.859+0000 7f7ae999b700 1 --2- 172.21.15.72:0/1222205492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae4153270 0x7f7ae414a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.859+0000 7f7ae999b700 1 -- 172.21.15.72:0/1222205492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae4156bf0 msgr2=0x7f7ae4152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.859+0000 7f7ae999b700 1 --2- 172.21.15.72:0/1222205492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae4156bf0 0x7f7ae4152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.859+0000 7f7ae999b700 1 -- 172.21.15.72:0/1222205492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae40c7be0 con 0x7f7ad0003910 2023-08-31T18:48:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.859+0000 7f7ae999b700 1 --2- 172.21.15.72:0/1222205492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad0003910 0x7f7ae4156700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f7ae0007fd0 tx=0x7f7ae0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:06.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.859+0000 7f7ad9ffb700 1 -- 172.21.15.72:0/1222205492 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0013410 con 0x7f7ad0003910 2023-08-31T18:48:06.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.859+0000 7f7ad9ffb700 1 -- 172.21.15.72:0/1222205492 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae0013910 con 0x7f7ad0003910 2023-08-31T18:48:06.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.859+0000 7f7aebbff700 1 -- 172.21.15.72:0/1222205492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae40c7ec0 con 0x7f7ad0003910 2023-08-31T18:48:06.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.859+0000 7f7ad9ffb700 1 -- 172.21.15.72:0/1222205492 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0007240 con 0x7f7ad0003910 2023-08-31T18:48:06.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.860+0000 7f7aebbff700 1 -- 172.21.15.72:0/1222205492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae40c73f0 con 0x7f7ad0003910 2023-08-31T18:48:06.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.861+0000 7f7aebbff700 1 -- 172.21.15.72:0/1222205492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae40c8230 con 0x7f7ad0003910 2023-08-31T18:48:06.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.861+0000 7f7ad9ffb700 1 -- 172.21.15.72:0/1222205492 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f7ae00066f0 con 0x7f7ad0003910 2023-08-31T18:48:06.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.862+0000 7f7ad9ffb700 1 --2- 172.21.15.72:0/1222205492 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ac805ee10 0x7f7ac80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:06.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.862+0000 7f7ad9ffb700 1 -- 172.21.15.72:0/1222205492 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7ae007b2b0 con 0x7f7ad0003910 2023-08-31T18:48:06.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.862+0000 7f7ae919a700 1 --2- 172.21.15.72:0/1222205492 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ac805ee10 0x7f7ac80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:06.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.863+0000 7f7ae919a700 1 --2- 172.21.15.72:0/1222205492 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ac805ee10 0x7f7ac80612d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7ad4001200 tx=0x7f7ad4007040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:06.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:06.866+0000 7f7ad9ffb700 1 -- 172.21.15.72:0/1222205492 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ae004c720 con 0x7f7ad0003910 2023-08-31T18:48:07.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.035+0000 7f7aebbff700 1 -- 172.21.15.72:0/1222205492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ae406c6b0 con 0x7f7ad0003910 2023-08-31T18:48:07.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.036+0000 7f7ad9ffb700 1 -- 172.21.15.72:0/1222205492 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17024 (secure 0 0 0) 0x7f7ae004fd40 con 0x7f7ad0003910 2023-08-31T18:48:07.037 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:07.037 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:53.972412+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:47:51.003304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-31T18:47:51.950765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:48:07.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.038+0000 7f7aebbff700 1 -- 172.21.15.72:0/1222205492 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ac805ee10 msgr2=0x7f7ac80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:07.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.038+0000 7f7aebbff700 1 --2- 172.21.15.72:0/1222205492 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ac805ee10 0x7f7ac80612d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7ad4001200 tx=0x7f7ad4007040).stop 2023-08-31T18:48:07.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.038+0000 7f7aebbff700 1 -- 172.21.15.72:0/1222205492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad0003910 msgr2=0x7f7ae4156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:07.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.038+0000 7f7aebbff700 1 --2- 172.21.15.72:0/1222205492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad0003910 0x7f7ae4156700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f7ae0007fd0 tx=0x7f7ae0016000).stop 2023-08-31T18:48:07.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.039+0000 7f7aebbff700 1 -- 172.21.15.72:0/1222205492 shutdown_connections 2023-08-31T18:48:07.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.039+0000 7f7aebbff700 1 --2- 172.21.15.72:0/1222205492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae4153270 0x7f7ae414a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.039+0000 7f7aebbff700 1 --2- 172.21.15.72:0/1222205492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad0003910 0x7f7ae4156700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.039+0000 7f7aebbff700 1 --2- 172.21.15.72:0/1222205492 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ac805ee10 0x7f7ac80612d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.039+0000 7f7aebbff700 1 --2- 172.21.15.72:0/1222205492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae4156bf0 0x7f7ae4152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.039+0000 7f7aebbff700 1 -- 172.21.15.72:0/1222205492 >> 172.21.15.72:0/1222205492 conn(0x7f7ae405e870 msgr2=0x7f7ae40c9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:07.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.039+0000 7f7aebbff700 1 -- 172.21.15.72:0/1222205492 shutdown_connections 2023-08-31T18:48:07.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.039+0000 7f7aebbff700 1 -- 172.21.15.72:0/1222205492 wait complete. 2023-08-31T18:48:07.056 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T18:47:51.003304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T18:47:51.950765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T18:48:07.057 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T18:48:07.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.247+0000 7fbba87ff700 1 Processor -- start 2023-08-31T18:48:07.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.247+0000 7fbba87ff700 1 -- start start 2023-08-31T18:48:07.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.249+0000 7fbba87ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbba0154210 0x7fbba00630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:07.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.249+0000 7fbba87ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbba00635a0 0x7fbba00c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:07.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.249+0000 7fbba87ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba0063a30 con 0x7fbba0153e30 2023-08-31T18:48:07.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.249+0000 7fbba87ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba01546c0 con 0x7fbba00635a0 2023-08-31T18:48:07.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.249+0000 7fbba87ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba00bfd40 con 0x7fbba0154210 2023-08-31T18:48:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.249+0000 7fbba6d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbba00635a0 0x7fbba00c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.249+0000 7fbba6d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbba00635a0 0x7fbba00c0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51416/0 (socket says 172.21.15.72:51416) 2023-08-31T18:48:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.249+0000 7fbba6d9c700 1 -- 172.21.15.72:0/690610715 learned_addr learned my addr 172.21.15.72:0/690610715 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:07.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.249+0000 7fbba659b700 1 --1- 172.21.15.72:0/690610715 >> v1:172.21.15.72:6789/0 conn(0x7fbba0153e30 0x7fbba00c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36940/0 (socket says 172.21.15.72:36940) 2023-08-31T18:48:07.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.249+0000 7fbba5d9a700 1 --2- 172.21.15.72:0/690610715 >> v2:172.21.15.146:3300/0 conn(0x7fbba0154210 0x7fbba00630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:07.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.249+0000 7fbba6d9c700 1 -- 172.21.15.72:0/690610715 >> v2:172.21.15.146:3300/0 conn(0x7fbba0154210 msgr2=0x7fbba00630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:07.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.249+0000 7fbba6d9c700 1 --2- 172.21.15.72:0/690610715 >> v2:172.21.15.146:3300/0 conn(0x7fbba0154210 0x7fbba00630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.249+0000 7fbba6d9c700 1 -- 172.21.15.72:0/690610715 >> v1:172.21.15.72:6789/0 conn(0x7fbba0153e30 legacy=0x7fbba00c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:07.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.249+0000 7fbba6d9c700 1 -- 172.21.15.72:0/690610715 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba00c6730 con 0x7fbba00635a0 2023-08-31T18:48:07.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.249+0000 7fbba5599700 1 -- 172.21.15.72:0/690610715 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738489840 0 0) 0x7fbba0063a30 con 0x7fbba0153e30 2023-08-31T18:48:07.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.250+0000 7fbba6d9c700 1 --2- 172.21.15.72:0/690610715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00635a0 0x7fbba00c0ac0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fbba0063d10 tx=0x7fbb98009840).ready entity=mon.0 client_cookie=12a2b8d5279ec156 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:07.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.250+0000 7fbba5599700 1 -- 172.21.15.72:0/690610715 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9800e070 con 0x7fbba00635a0 2023-08-31T18:48:07.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.250+0000 7fbba5599700 1 -- 172.21.15.72:0/690610715 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9800ba50 con 0x7fbba00635a0 2023-08-31T18:48:07.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.250+0000 7fbba5599700 1 -- 172.21.15.72:0/690610715 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9800bdd0 con 0x7fbba00635a0 2023-08-31T18:48:07.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.250+0000 7fbba87ff700 1 -- 172.21.15.72:0/690610715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00635a0 msgr2=0x7fbba00c0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:07.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.250+0000 7fbba87ff700 1 --2- 172.21.15.72:0/690610715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00635a0 0x7fbba00c0ac0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fbba0063d10 tx=0x7fbb98009840).stop 2023-08-31T18:48:07.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.250+0000 7fbba87ff700 1 -- 172.21.15.72:0/690610715 shutdown_connections 2023-08-31T18:48:07.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.250+0000 7fbba87ff700 1 --2- 172.21.15.72:0/690610715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00635a0 0x7fbba00c0ac0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.250+0000 7fbba87ff700 1 --2- 172.21.15.72:0/690610715 >> v2:172.21.15.146:3300/0 conn(0x7fbba0154210 0x7fbba00630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.250+0000 7fbba87ff700 1 -- 172.21.15.72:0/690610715 >> 172.21.15.72:0/690610715 conn(0x7fbba005eb20 msgr2=0x7fbba00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:07.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.251+0000 7fbba87ff700 1 -- 172.21.15.72:0/690610715 shutdown_connections 2023-08-31T18:48:07.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.251+0000 7fbba87ff700 1 -- 172.21.15.72:0/690610715 wait complete. 2023-08-31T18:48:07.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.252+0000 7fbba87ff700 1 Processor -- start 2023-08-31T18:48:07.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.252+0000 7fbba87ff700 1 -- start start 2023-08-31T18:48:07.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.253+0000 7fbba87ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00635a0 0x7fbba00a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:07.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.253+0000 7fbba87ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbba0153e30 0x7fbba0142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:07.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.253+0000 7fbba87ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbba0154210 0x7fbba00ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:07.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.253+0000 7fbba87ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00ae8b0 con 0x7fbba00635a0 2023-08-31T18:48:07.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.253+0000 7fbba87ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00aeb90 con 0x7fbba0153e30 2023-08-31T18:48:07.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.253+0000 7fbba87ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00aee70 con 0x7fbba0154210 2023-08-31T18:48:07.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.253+0000 7fbba659b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00635a0 0x7fbba00a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:07.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.253+0000 7fbba659b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00635a0 0x7fbba00a1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51424/0 (socket says 172.21.15.72:51424) 2023-08-31T18:48:07.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.253+0000 7fbba659b700 1 -- 172.21.15.72:0/564496247 learned_addr learned my addr 172.21.15.72:0/564496247 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:07.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.254+0000 7fbba5d9a700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbba0153e30 0x7fbba0142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:07.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.254+0000 7fbba6d9c700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbba0154210 0x7fbba00ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:07.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.254+0000 7fbba659b700 1 -- 172.21.15.72:0/564496247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbba0154210 msgr2=0x7fbba00ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:07.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.254+0000 7fbba659b700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbba0154210 0x7fbba00ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.254+0000 7fbba659b700 1 -- 172.21.15.72:0/564496247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbba0153e30 msgr2=0x7fbba0142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:07.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.254+0000 7fbba659b700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbba0153e30 0x7fbba0142160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.254+0000 7fbba659b700 1 -- 172.21.15.72:0/564496247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb98009ae0 con 0x7fbba00635a0 2023-08-31T18:48:07.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.254+0000 7fbba5d9a700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbba0153e30 0x7fbba0142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:07.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.254+0000 7fbba6d9c700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbba0154210 0x7fbba00ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:07.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.254+0000 7fbba659b700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00635a0 0x7fbba00a1a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fbb9c00c560 tx=0x7fbb9c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:07.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.254+0000 7fbb967fc700 1 -- 172.21.15.72:0/564496247 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0072e0 con 0x7fbba00635a0 2023-08-31T18:48:07.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.254+0000 7fbb967fc700 1 -- 172.21.15.72:0/564496247 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c007440 con 0x7fbba00635a0 2023-08-31T18:48:07.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.254+0000 7fbba87ff700 1 -- 172.21.15.72:0/564496247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba00af150 con 0x7fbba00635a0 2023-08-31T18:48:07.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.254+0000 7fbb967fc700 1 -- 172.21.15.72:0/564496247 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0058f0 con 0x7fbba00635a0 2023-08-31T18:48:07.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.254+0000 7fbba87ff700 1 -- 172.21.15.72:0/564496247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba00ae5c0 con 0x7fbba00635a0 2023-08-31T18:48:07.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.256+0000 7fbba87ff700 1 -- 172.21.15.72:0/564496247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba006c6b0 con 0x7fbba00635a0 2023-08-31T18:48:07.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.256+0000 7fbb967fc700 1 -- 172.21.15.72:0/564496247 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fbb9c005ce0 con 0x7fbba00635a0 2023-08-31T18:48:07.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.257+0000 7fbb967fc700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbb8405ee60 0x7fbb84061320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:07.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.257+0000 7fbb967fc700 1 -- 172.21.15.72:0/564496247 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbb9c079830 con 0x7fbba00635a0 2023-08-31T18:48:07.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.257+0000 7fbba5d9a700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbb8405ee60 0x7fbb84061320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:07.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.258+0000 7fbba5d9a700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbb8405ee60 0x7fbb84061320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fbb90006fd0 tx=0x7fbb90008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:07.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.261+0000 7fbb967fc700 1 -- 172.21.15.72:0/564496247 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbb9c04ac60 con 0x7fbba00635a0 2023-08-31T18:48:07.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.431+0000 7fbba87ff700 1 -- 172.21.15.72:0/564496247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbba00c93e0 con 0x7fbba00635a0 2023-08-31T18:48:07.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.431+0000 7fbb967fc700 1 -- 172.21.15.72:0/564496247 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbb9c018020 con 0x7fbba00635a0 2023-08-31T18:48:07.433 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T18:48:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.433+0000 7fbba87ff700 1 -- 172.21.15.72:0/564496247 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbb8405ee60 msgr2=0x7fbb84061320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.433+0000 7fbba87ff700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbb8405ee60 0x7fbb84061320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fbb90006fd0 tx=0x7fbb90008040).stop 2023-08-31T18:48:07.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.433+0000 7fbba87ff700 1 -- 172.21.15.72:0/564496247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00635a0 msgr2=0x7fbba00a1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.433+0000 7fbba87ff700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00635a0 0x7fbba00a1a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fbb9c00c560 tx=0x7fbb9c007c90).stop 2023-08-31T18:48:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.433+0000 7fbba87ff700 1 -- 172.21.15.72:0/564496247 shutdown_connections 2023-08-31T18:48:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.433+0000 7fbba87ff700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbba0154210 0x7fbba00ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.433+0000 7fbba87ff700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00635a0 0x7fbba00a1a70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.433+0000 7fbba87ff700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbb8405ee60 0x7fbb84061320 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.433+0000 7fbba87ff700 1 --2- 172.21.15.72:0/564496247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbba0153e30 0x7fbba0142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.433+0000 7fbba87ff700 1 -- 172.21.15.72:0/564496247 >> 172.21.15.72:0/564496247 conn(0x7fbba005eb20 msgr2=0x7fbba00ad270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.433+0000 7fbba87ff700 1 -- 172.21.15.72:0/564496247 shutdown_connections 2023-08-31T18:48:07.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.434+0000 7fbba87ff700 1 -- 172.21.15.72:0/564496247 wait complete. 2023-08-31T18:48:07.451 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T18:48:07.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.655+0000 7f92697ff700 1 Processor -- start 2023-08-31T18:48:07.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.655+0000 7f92697ff700 1 -- start start 2023-08-31T18:48:07.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.656+0000 7f92697ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9264153e30 0x7f9264154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:07.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.656+0000 7f92697ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92640637c0 0x7f92640c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:07.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.656+0000 7f92697ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92640bfd40 con 0x7f92640c5cb0 2023-08-31T18:48:07.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.656+0000 7f92697ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92640c6730 con 0x7f92640637c0 2023-08-31T18:48:07.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.656+0000 7f92697ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92640bffe0 con 0x7f9264153e30 2023-08-31T18:48:07.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.656+0000 7f92637fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92640637c0 0x7f92640c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:07.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.657+0000 7f92637fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92640637c0 0x7f92640c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51432/0 (socket says 172.21.15.72:51432) 2023-08-31T18:48:07.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.657+0000 7f92637fe700 1 -- 172.21.15.72:0/1399796592 learned_addr learned my addr 172.21.15.72:0/1399796592 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:07.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.657+0000 7f9262ffd700 1 --2- 172.21.15.72:0/1399796592 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9264153e30 0x7f9264154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:07.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.657+0000 7f92637fe700 1 -- 172.21.15.72:0/1399796592 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9264153e30 msgr2=0x7f9264154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:07.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.657+0000 7f92637fe700 1 --2- 172.21.15.72:0/1399796592 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9264153e30 0x7f9264154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.657+0000 7f92637fe700 1 -- 172.21.15.72:0/1399796592 >> v1:172.21.15.146:6789/0 conn(0x7f92640c5cb0 legacy=0x7f92640630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:07.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.657+0000 7f92637fe700 1 -- 172.21.15.72:0/1399796592 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92640c02c0 con 0x7f92640637c0 2023-08-31T18:48:07.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.657+0000 7f92637fe700 1 --2- 172.21.15.72:0/1399796592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92640637c0 0x7f92640c6130 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f925c009f20 tx=0x7f925c009840).ready entity=mon.0 client_cookie=348e42f5fd63f651 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:07.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.657+0000 7f9261ffb700 1 -- 172.21.15.72:0/1399796592 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00e070 con 0x7f92640637c0 2023-08-31T18:48:07.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.657+0000 7f9261ffb700 1 -- 172.21.15.72:0/1399796592 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c00ba80 con 0x7f92640637c0 2023-08-31T18:48:07.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.657+0000 7f9261ffb700 1 -- 172.21.15.72:0/1399796592 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00be00 con 0x7f92640637c0 2023-08-31T18:48:07.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.658+0000 7f92697ff700 1 -- 172.21.15.72:0/1399796592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92640637c0 msgr2=0x7f92640c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.658+0000 7f92697ff700 1 --2- 172.21.15.72:0/1399796592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92640637c0 0x7f92640c6130 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f925c009f20 tx=0x7f925c009840).stop 2023-08-31T18:48:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.658+0000 7f92697ff700 1 -- 172.21.15.72:0/1399796592 shutdown_connections 2023-08-31T18:48:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.658+0000 7f92697ff700 1 --2- 172.21.15.72:0/1399796592 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9264153e30 0x7f9264154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.658+0000 7f92697ff700 1 --2- 172.21.15.72:0/1399796592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92640637c0 0x7f92640c6130 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.658+0000 7f92697ff700 1 -- 172.21.15.72:0/1399796592 >> 172.21.15.72:0/1399796592 conn(0x7f926405eb20 msgr2=0x7f92640cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:07.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.658+0000 7f92697ff700 1 -- 172.21.15.72:0/1399796592 shutdown_connections 2023-08-31T18:48:07.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.658+0000 7f92697ff700 1 -- 172.21.15.72:0/1399796592 wait complete. 2023-08-31T18:48:07.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.659+0000 7f92697ff700 1 Processor -- start 2023-08-31T18:48:07.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.660+0000 7f92697ff700 1 -- start start 2023-08-31T18:48:07.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.660+0000 7f92697ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92640637c0 0x7f92640b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:07.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.660+0000 7f92697ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92640c5cb0 0x7f92640aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:07.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.660+0000 7f92697ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9264153e30 0x7f92640c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:07.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.660+0000 7f92697ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92641586c0 con 0x7f92640c5cb0 2023-08-31T18:48:07.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.660+0000 7f92697ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9264158960 con 0x7f92640637c0 2023-08-31T18:48:07.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.660+0000 7f92697ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9264158c40 con 0x7f9264153e30 2023-08-31T18:48:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.661+0000 7f92627fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92640c5cb0 0x7f92640aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.661+0000 7f9262ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92640637c0 0x7f92640b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.661+0000 7f92627fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92640c5cb0 0x7f92640aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51448/0 (socket says 172.21.15.72:51448) 2023-08-31T18:48:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.661+0000 7f92627fc700 1 -- 172.21.15.72:0/2994577533 learned_addr learned my addr 172.21.15.72:0/2994577533 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.661+0000 7f92637fe700 1 --2- 172.21.15.72:0/2994577533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9264153e30 0x7f92640c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:07.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.661+0000 7f92627fc700 1 -- 172.21.15.72:0/2994577533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9264153e30 msgr2=0x7f92640c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:07.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.661+0000 7f92627fc700 1 --2- 172.21.15.72:0/2994577533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9264153e30 0x7f92640c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.661+0000 7f92627fc700 1 -- 172.21.15.72:0/2994577533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92640637c0 msgr2=0x7f92640b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:07.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.661+0000 7f92627fc700 1 --2- 172.21.15.72:0/2994577533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92640637c0 0x7f92640b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.661+0000 7f92627fc700 1 -- 172.21.15.72:0/2994577533 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c009ae0 con 0x7f92640c5cb0 2023-08-31T18:48:07.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.661+0000 7f92627fc700 1 --2- 172.21.15.72:0/2994577533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92640c5cb0 0x7f92640aeb60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f925800c4c0 tx=0x7f9258007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:07.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.661+0000 7f924affd700 1 -- 172.21.15.72:0/2994577533 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925800ce10 con 0x7f92640c5cb0 2023-08-31T18:48:07.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.662+0000 7f924affd700 1 -- 172.21.15.72:0/2994577533 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9258007020 con 0x7f92640c5cb0 2023-08-31T18:48:07.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.662+0000 7f92697ff700 1 -- 172.21.15.72:0/2994577533 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92640c4030 con 0x7f92640c5cb0 2023-08-31T18:48:07.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.662+0000 7f924affd700 1 -- 172.21.15.72:0/2994577533 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92580073c0 con 0x7f92640c5cb0 2023-08-31T18:48:07.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.662+0000 7f92697ff700 1 -- 172.21.15.72:0/2994577533 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92640c3d20 con 0x7f92640c5cb0 2023-08-31T18:48:07.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.663+0000 7f92697ff700 1 -- 172.21.15.72:0/2994577533 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926406c6b0 con 0x7f92640c5cb0 2023-08-31T18:48:07.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.663+0000 7f924affd700 1 -- 172.21.15.72:0/2994577533 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f92580068b0 con 0x7f92640c5cb0 2023-08-31T18:48:07.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.664+0000 7f924affd700 1 --2- 172.21.15.72:0/2994577533 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f925005ee10 0x7f92500612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:07.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.664+0000 7f924affd700 1 -- 172.21.15.72:0/2994577533 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9258079160 con 0x7f92640c5cb0 2023-08-31T18:48:07.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.664+0000 7f9262ffd700 1 --2- 172.21.15.72:0/2994577533 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f925005ee10 0x7f92500612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:07.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.665+0000 7f9262ffd700 1 --2- 172.21.15.72:0/2994577533 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f925005ee10 0x7f92500612d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f925400bbc0 tx=0x7f9254008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:07.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.668+0000 7f924affd700 1 -- 172.21.15.72:0/2994577533 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f92580478f0 con 0x7f92640c5cb0 2023-08-31T18:48:07.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.836+0000 7f92697ff700 1 -- 172.21.15.72:0/2994577533 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9264062970 con 0x7f92640c5cb0 2023-08-31T18:48:07.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.836+0000 7f924affd700 1 -- 172.21.15.72:0/2994577533 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f925804a510 con 0x7f92640c5cb0 2023-08-31T18:48:07.837 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T18:48:07.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.838+0000 7f92697ff700 1 -- 172.21.15.72:0/2994577533 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f925005ee10 msgr2=0x7f92500612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:07.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.838+0000 7f92697ff700 1 --2- 172.21.15.72:0/2994577533 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f925005ee10 0x7f92500612d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f925400bbc0 tx=0x7f9254008040).stop 2023-08-31T18:48:07.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.838+0000 7f92697ff700 1 -- 172.21.15.72:0/2994577533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92640c5cb0 msgr2=0x7f92640aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:07.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.838+0000 7f92697ff700 1 --2- 172.21.15.72:0/2994577533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92640c5cb0 0x7f92640aeb60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f925800c4c0 tx=0x7f9258007dd0).stop 2023-08-31T18:48:07.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.839+0000 7f92697ff700 1 -- 172.21.15.72:0/2994577533 shutdown_connections 2023-08-31T18:48:07.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.839+0000 7f92697ff700 1 --2- 172.21.15.72:0/2994577533 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9264153e30 0x7f92640c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.839+0000 7f92697ff700 1 --2- 172.21.15.72:0/2994577533 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f925005ee10 0x7f92500612d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.839+0000 7f92697ff700 1 --2- 172.21.15.72:0/2994577533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92640637c0 0x7f92640b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.839+0000 7f92697ff700 1 --2- 172.21.15.72:0/2994577533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92640c5cb0 0x7f92640aeb60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:07.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.839+0000 7f92697ff700 1 -- 172.21.15.72:0/2994577533 >> 172.21.15.72:0/2994577533 conn(0x7f926405eb20 msgr2=0x7f92640acf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:07.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.839+0000 7f92697ff700 1 -- 172.21.15.72:0/2994577533 shutdown_connections 2023-08-31T18:48:07.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:07.839+0000 7f92697ff700 1 -- 172.21.15.72:0/2994577533 wait complete. 2023-08-31T18:48:07.857 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T18:48:08.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.049+0000 7f6a2a1ff700 1 Processor -- start 2023-08-31T18:48:08.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.049+0000 7f6a2a1ff700 1 -- start start 2023-08-31T18:48:08.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.050+0000 7f6a2a1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a24153e30 0x7f6a24154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.050+0000 7f6a2a1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6a240c5cb0 0x7f6a240c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.050+0000 7f6a2a1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a240630b0 0x7f6a24063540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.050+0000 7f6a2a1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a24063a30 con 0x7f6a24153e30 2023-08-31T18:48:08.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.050+0000 7f6a2a1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a240bfd40 con 0x7f6a240c5cb0 2023-08-31T18:48:08.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.050+0000 7f6a2a1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240c6730 con 0x7f6a240630b0 2023-08-31T18:48:08.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.051+0000 7f6a237fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a24153e30 0x7f6a24154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.051+0000 7f6a237fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a24153e30 0x7f6a24154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51460/0 (socket says 172.21.15.72:51460) 2023-08-31T18:48:08.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.051+0000 7f6a237fe700 1 -- 172.21.15.72:0/3231553749 learned_addr learned my addr 172.21.15.72:0/3231553749 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:08.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.051+0000 7f6a23fff700 1 --2- 172.21.15.72:0/3231553749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a240630b0 0x7f6a24063540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.051+0000 7f6a22ffd700 1 --2- 172.21.15.72:0/3231553749 >> v2:172.21.15.146:3300/0 conn(0x7f6a240c5cb0 0x7f6a240c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.051+0000 7f6a237fe700 1 -- 172.21.15.72:0/3231553749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a240630b0 msgr2=0x7f6a24063540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:08.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.051+0000 7f6a237fe700 1 --2- 172.21.15.72:0/3231553749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a240630b0 0x7f6a24063540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.051+0000 7f6a237fe700 1 -- 172.21.15.72:0/3231553749 >> v2:172.21.15.146:3300/0 conn(0x7f6a240c5cb0 msgr2=0x7f6a240c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:08.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.051+0000 7f6a237fe700 1 --2- 172.21.15.72:0/3231553749 >> v2:172.21.15.146:3300/0 conn(0x7f6a240c5cb0 0x7f6a240c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.051+0000 7f6a237fe700 1 -- 172.21.15.72:0/3231553749 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a240bffe0 con 0x7f6a24153e30 2023-08-31T18:48:08.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.051+0000 7f6a237fe700 1 --2- 172.21.15.72:0/3231553749 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a24153e30 0x7f6a24154210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f6a24063d10 tx=0x7f6a140090f0).ready entity=mon.0 client_cookie=78913503a81c2313 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:08.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.052+0000 7f6a227fc700 1 -- 172.21.15.72:0/3231553749 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1400f510 con 0x7f6a24153e30 2023-08-31T18:48:08.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.052+0000 7f6a227fc700 1 -- 172.21.15.72:0/3231553749 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1400f670 con 0x7f6a24153e30 2023-08-31T18:48:08.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.052+0000 7f6a227fc700 1 -- 172.21.15.72:0/3231553749 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1400fa10 con 0x7f6a24153e30 2023-08-31T18:48:08.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.052+0000 7f6a2a1ff700 1 -- 172.21.15.72:0/3231553749 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a24153e30 msgr2=0x7f6a24154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:08.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.052+0000 7f6a2a1ff700 1 --2- 172.21.15.72:0/3231553749 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a24153e30 0x7f6a24154210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f6a24063d10 tx=0x7f6a140090f0).stop 2023-08-31T18:48:08.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.052+0000 7f6a2a1ff700 1 -- 172.21.15.72:0/3231553749 shutdown_connections 2023-08-31T18:48:08.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.052+0000 7f6a2a1ff700 1 --2- 172.21.15.72:0/3231553749 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a240630b0 0x7f6a24063540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.052+0000 7f6a2a1ff700 1 --2- 172.21.15.72:0/3231553749 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a24153e30 0x7f6a24154210 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.052+0000 7f6a2a1ff700 1 --2- 172.21.15.72:0/3231553749 >> v2:172.21.15.146:3300/0 conn(0x7f6a240c5cb0 0x7f6a240c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.052+0000 7f6a2a1ff700 1 -- 172.21.15.72:0/3231553749 >> 172.21.15.72:0/3231553749 conn(0x7f6a2405eb20 msgr2=0x7f6a240cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:08.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.052+0000 7f6a2a1ff700 1 -- 172.21.15.72:0/3231553749 shutdown_connections 2023-08-31T18:48:08.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.052+0000 7f6a2a1ff700 1 -- 172.21.15.72:0/3231553749 wait complete. 2023-08-31T18:48:08.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.054+0000 7f6a2a1ff700 1 Processor -- start 2023-08-31T18:48:08.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.054+0000 7f6a2a1ff700 1 -- start start 2023-08-31T18:48:08.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a2a1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a240630b0 0x7f6a2413e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a2a1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a240c5cb0 0x7f6a24151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a2a1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a24153e30 0x7f6a24167800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a2a1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24154810 con 0x7f6a240c5cb0 2023-08-31T18:48:08.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a2a1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24168620 con 0x7f6a240630b0 2023-08-31T18:48:08.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a2a1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24154a60 con 0x7f6a24153e30 2023-08-31T18:48:08.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a22ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a240c5cb0 0x7f6a24151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a22ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a240c5cb0 0x7f6a24151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51462/0 (socket says 172.21.15.72:51462) 2023-08-31T18:48:08.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a22ffd700 1 -- 172.21.15.72:0/1414912460 learned_addr learned my addr 172.21.15.72:0/1414912460 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:08.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a237fe700 1 --2- 172.21.15.72:0/1414912460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a240630b0 0x7f6a2413e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a23fff700 1 --2- 172.21.15.72:0/1414912460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a24153e30 0x7f6a24167800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a22ffd700 1 -- 172.21.15.72:0/1414912460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a24153e30 msgr2=0x7f6a24167800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:08.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a22ffd700 1 --2- 172.21.15.72:0/1414912460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a24153e30 0x7f6a24167800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a22ffd700 1 -- 172.21.15.72:0/1414912460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a240630b0 msgr2=0x7f6a2413e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:08.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a22ffd700 1 --2- 172.21.15.72:0/1414912460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a240630b0 0x7f6a2413e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.055+0000 7f6a22ffd700 1 -- 172.21.15.72:0/1414912460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a14009370 con 0x7f6a240c5cb0 2023-08-31T18:48:08.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.056+0000 7f6a22ffd700 1 --2- 172.21.15.72:0/1414912460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a240c5cb0 0x7f6a24151e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f6a1800e930 tx=0x7f6a18009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:08.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.056+0000 7f6a0b7fe700 1 -- 172.21.15.72:0/1414912460 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1800eed0 con 0x7f6a240c5cb0 2023-08-31T18:48:08.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.056+0000 7f6a0b7fe700 1 -- 172.21.15.72:0/1414912460 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1800c850 con 0x7f6a240c5cb0 2023-08-31T18:48:08.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.056+0000 7f6a2a1ff700 1 -- 172.21.15.72:0/1414912460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a24154d40 con 0x7f6a240c5cb0 2023-08-31T18:48:08.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.056+0000 7f6a0b7fe700 1 -- 172.21.15.72:0/1414912460 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1800cbd0 con 0x7f6a240c5cb0 2023-08-31T18:48:08.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.056+0000 7f6a2a1ff700 1 -- 172.21.15.72:0/1414912460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a24155300 con 0x7f6a240c5cb0 2023-08-31T18:48:08.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.057+0000 7f6a2a1ff700 1 -- 172.21.15.72:0/1414912460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a24155950 con 0x7f6a240c5cb0 2023-08-31T18:48:08.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.058+0000 7f6a0b7fe700 1 -- 172.21.15.72:0/1414912460 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f6a1801b400 con 0x7f6a240c5cb0 2023-08-31T18:48:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.059+0000 7f6a0b7fe700 1 --2- 172.21.15.72:0/1414912460 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6a1005ee10 0x7f6a100612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.059+0000 7f6a0b7fe700 1 -- 172.21.15.72:0/1414912460 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6a1807a470 con 0x7f6a240c5cb0 2023-08-31T18:48:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.059+0000 7f6a237fe700 1 --2- 172.21.15.72:0/1414912460 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6a1005ee10 0x7f6a100612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.059+0000 7f6a237fe700 1 --2- 172.21.15.72:0/1414912460 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6a1005ee10 0x7f6a100612d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f6a24063d10 tx=0x7f6a14016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:08.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.063+0000 7f6a0b7fe700 1 -- 172.21.15.72:0/1414912460 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6a1804b870 con 0x7f6a240c5cb0 2023-08-31T18:48:08.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.229+0000 7f6a2a1ff700 1 -- 172.21.15.72:0/1414912460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a24062970 con 0x7f6a240c5cb0 2023-08-31T18:48:08.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.230+0000 7f6a0b7fe700 1 -- 172.21.15.72:0/1414912460 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a1804ee90 con 0x7f6a240c5cb0 2023-08-31T18:48:08.231 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T18:48:08.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.231+0000 7f6a2a1ff700 1 -- 172.21.15.72:0/1414912460 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6a1005ee10 msgr2=0x7f6a100612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:08.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.231+0000 7f6a2a1ff700 1 --2- 172.21.15.72:0/1414912460 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6a1005ee10 0x7f6a100612d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f6a24063d10 tx=0x7f6a14016000).stop 2023-08-31T18:48:08.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.232+0000 7f6a2a1ff700 1 -- 172.21.15.72:0/1414912460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a240c5cb0 msgr2=0x7f6a24151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:08.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.232+0000 7f6a2a1ff700 1 --2- 172.21.15.72:0/1414912460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a240c5cb0 0x7f6a24151e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f6a1800e930 tx=0x7f6a18009060).stop 2023-08-31T18:48:08.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.232+0000 7f6a2a1ff700 1 -- 172.21.15.72:0/1414912460 shutdown_connections 2023-08-31T18:48:08.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.232+0000 7f6a2a1ff700 1 --2- 172.21.15.72:0/1414912460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6a24153e30 0x7f6a24167800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.232+0000 7f6a2a1ff700 1 --2- 172.21.15.72:0/1414912460 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6a1005ee10 0x7f6a100612d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.232+0000 7f6a2a1ff700 1 --2- 172.21.15.72:0/1414912460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a240630b0 0x7f6a2413e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.232+0000 7f6a2a1ff700 1 --2- 172.21.15.72:0/1414912460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a240c5cb0 0x7f6a24151e20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.232+0000 7f6a2a1ff700 1 -- 172.21.15.72:0/1414912460 >> 172.21.15.72:0/1414912460 conn(0x7f6a2405eb20 msgr2=0x7f6a240ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:08.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.232+0000 7f6a2a1ff700 1 -- 172.21.15.72:0/1414912460 shutdown_connections 2023-08-31T18:48:08.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.232+0000 7f6a2a1ff700 1 -- 172.21.15.72:0/1414912460 wait complete. 2023-08-31T18:48:08.249 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T18:48:08.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.439+0000 7f9cf6dff700 1 Processor -- start 2023-08-31T18:48:08.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.439+0000 7f9cf6dff700 1 -- start start 2023-08-31T18:48:08.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.441+0000 7f9cf6dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cf0153e30 0x7f9cf0154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.441+0000 7f9cf6dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9cf00637c0 0x7f9cf00c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.441+0000 7f9cf6dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf00bfd40 con 0x7f9cf00c5cb0 2023-08-31T18:48:08.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.441+0000 7f9cf6dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf00c6730 con 0x7f9cf00637c0 2023-08-31T18:48:08.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.441+0000 7f9cf6dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf00bffe0 con 0x7f9cf0153e30 2023-08-31T18:48:08.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.441+0000 7f9cf539c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9cf00637c0 0x7f9cf00c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.441+0000 7f9cf4b9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cf0153e30 0x7f9cf0154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.441+0000 7f9cf539c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9cf00637c0 0x7f9cf00c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:60956/0 (socket says 172.21.15.72:60956) 2023-08-31T18:48:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.441+0000 7f9cf539c700 1 -- 172.21.15.72:0/3884681788 learned_addr learned my addr 172.21.15.72:0/3884681788 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.441+0000 7f9cf4b9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cf0153e30 0x7f9cf0154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:46406/0 (socket says 172.21.15.72:46406) 2023-08-31T18:48:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.442+0000 7f9cf539c700 1 -- 172.21.15.72:0/3884681788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cf0153e30 msgr2=0x7f9cf0154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.442+0000 7f9cf539c700 1 --2- 172.21.15.72:0/3884681788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cf0153e30 0x7f9cf0154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.442+0000 7f9cf539c700 1 -- 172.21.15.72:0/3884681788 >> v1:172.21.15.146:6789/0 conn(0x7f9cf00c5cb0 legacy=0x7f9cf00630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:08.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.442+0000 7f9cf539c700 1 -- 172.21.15.72:0/3884681788 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf00c02c0 con 0x7f9cf00637c0 2023-08-31T18:48:08.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.442+0000 7f9cf4b9b700 1 --2- 172.21.15.72:0/3884681788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cf0153e30 0x7f9cf0154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:08.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.442+0000 7f9cf539c700 1 --2- 172.21.15.72:0/3884681788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf00637c0 0x7f9cf00c6130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f9ce8009f20 tx=0x7f9ce8009840).ready entity=mon.1 client_cookie=e0fe3ab4218accf4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:08.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.442+0000 7f9cef7fe700 1 -- 172.21.15.72:0/3884681788 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce800e070 con 0x7f9cf00637c0 2023-08-31T18:48:08.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.442+0000 7f9cef7fe700 1 -- 172.21.15.72:0/3884681788 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce800b9d0 con 0x7f9cf00637c0 2023-08-31T18:48:08.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.442+0000 7f9cef7fe700 1 -- 172.21.15.72:0/3884681788 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce800bd50 con 0x7f9cf00637c0 2023-08-31T18:48:08.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.442+0000 7f9cf6dff700 1 -- 172.21.15.72:0/3884681788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf00637c0 msgr2=0x7f9cf00c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:08.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.442+0000 7f9cf6dff700 1 --2- 172.21.15.72:0/3884681788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf00637c0 0x7f9cf00c6130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f9ce8009f20 tx=0x7f9ce8009840).stop 2023-08-31T18:48:08.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.443+0000 7f9cf6dff700 1 -- 172.21.15.72:0/3884681788 shutdown_connections 2023-08-31T18:48:08.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.443+0000 7f9cf6dff700 1 --2- 172.21.15.72:0/3884681788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf00637c0 0x7f9cf00c6130 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.443+0000 7f9cf6dff700 1 --2- 172.21.15.72:0/3884681788 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cf0153e30 0x7f9cf0154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.443+0000 7f9cf6dff700 1 -- 172.21.15.72:0/3884681788 >> 172.21.15.72:0/3884681788 conn(0x7f9cf005eb20 msgr2=0x7f9cf00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:08.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.443+0000 7f9cf6dff700 1 -- 172.21.15.72:0/3884681788 shutdown_connections 2023-08-31T18:48:08.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.443+0000 7f9cf6dff700 1 -- 172.21.15.72:0/3884681788 wait complete. 2023-08-31T18:48:08.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.444+0000 7f9cf6dff700 1 Processor -- start 2023-08-31T18:48:08.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.444+0000 7f9cf6dff700 1 -- start start 2023-08-31T18:48:08.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.445+0000 7f9cf6dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf00637c0 0x7f9cf01416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.445+0000 7f9cf6dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf00c5cb0 0x7f9cf00b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.445+0000 7f9cf6dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cf0153e30 0x7f9cf00b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.445+0000 7f9cf6dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf00afca0 con 0x7f9cf00c5cb0 2023-08-31T18:48:08.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.445+0000 7f9cf6dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf0141bd0 con 0x7f9cf00637c0 2023-08-31T18:48:08.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.445+0000 7f9cf6dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf00aed60 con 0x7f9cf0153e30 2023-08-31T18:48:08.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.445+0000 7f9ceffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf00c5cb0 0x7f9cf00b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.445+0000 7f9ceffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf00c5cb0 0x7f9cf00b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51470/0 (socket says 172.21.15.72:51470) 2023-08-31T18:48:08.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.445+0000 7f9ceffff700 1 -- 172.21.15.72:0/2055641375 learned_addr learned my addr 172.21.15.72:0/2055641375 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:08.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.446+0000 7f9cf4b9b700 1 --2- 172.21.15.72:0/2055641375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf00637c0 0x7f9cf01416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.446+0000 7f9cf539c700 1 --2- 172.21.15.72:0/2055641375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cf0153e30 0x7f9cf00b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.446+0000 7f9ceffff700 1 -- 172.21.15.72:0/2055641375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cf0153e30 msgr2=0x7f9cf00b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:08.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.446+0000 7f9ceffff700 1 --2- 172.21.15.72:0/2055641375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cf0153e30 0x7f9cf00b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.446+0000 7f9ceffff700 1 -- 172.21.15.72:0/2055641375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf00637c0 msgr2=0x7f9cf01416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:08.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.446+0000 7f9ceffff700 1 --2- 172.21.15.72:0/2055641375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf00637c0 0x7f9cf01416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.446+0000 7f9ceffff700 1 -- 172.21.15.72:0/2055641375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce40092a0 con 0x7f9cf00c5cb0 2023-08-31T18:48:08.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.446+0000 7f9cf4b9b700 1 --2- 172.21.15.72:0/2055641375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf00637c0 0x7f9cf01416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:08.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.446+0000 7f9ceffff700 1 --2- 172.21.15.72:0/2055641375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf00c5cb0 0x7f9cf00b00c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f9cdc00c4c0 tx=0x7f9cdc007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:08.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.446+0000 7f9cecff9700 1 -- 172.21.15.72:0/2055641375 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc00ce10 con 0x7f9cf00c5cb0 2023-08-31T18:48:08.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.446+0000 7f9cecff9700 1 -- 172.21.15.72:0/2055641375 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc007020 con 0x7f9cf00c5cb0 2023-08-31T18:48:08.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.446+0000 7f9cf6dff700 1 -- 172.21.15.72:0/2055641375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce8009ae0 con 0x7f9cf00c5cb0 2023-08-31T18:48:08.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.446+0000 7f9cecff9700 1 -- 172.21.15.72:0/2055641375 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0073c0 con 0x7f9cf00c5cb0 2023-08-31T18:48:08.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.446+0000 7f9cf6dff700 1 -- 172.21.15.72:0/2055641375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf00af300 con 0x7f9cf00c5cb0 2023-08-31T18:48:08.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.448+0000 7f9cf6dff700 1 -- 172.21.15.72:0/2055641375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf00afde0 con 0x7f9cf00c5cb0 2023-08-31T18:48:08.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.448+0000 7f9cecff9700 1 -- 172.21.15.72:0/2055641375 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9cdc0068b0 con 0x7f9cf00c5cb0 2023-08-31T18:48:08.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.450+0000 7f9cecff9700 1 --2- 172.21.15.72:0/2055641375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cd405ee10 0x7f9cd40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.450+0000 7f9cecff9700 1 -- 172.21.15.72:0/2055641375 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9cdc0790a0 con 0x7f9cf00c5cb0 2023-08-31T18:48:08.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.450+0000 7f9cf4b9b700 1 --2- 172.21.15.72:0/2055641375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cd405ee10 0x7f9cd40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.451+0000 7f9cf4b9b700 1 --2- 172.21.15.72:0/2055641375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cd405ee10 0x7f9cd40612d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f9cf01500b0 tx=0x7f9ce4009060).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:08.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.454+0000 7f9cecff9700 1 -- 172.21.15.72:0/2055641375 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9cdc0478f0 con 0x7f9cf00c5cb0 2023-08-31T18:48:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.627+0000 7f9cf6dff700 1 -- 172.21.15.72:0/2055641375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9cf0062970 con 0x7f9cf00c5cb0 2023-08-31T18:48:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.627+0000 7f9cecff9700 1 -- 172.21.15.72:0/2055641375 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9cf00afde0 con 0x7f9cf00c5cb0 2023-08-31T18:48:08.628 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T18:48:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.629+0000 7f9cf6dff700 1 -- 172.21.15.72:0/2055641375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cd405ee10 msgr2=0x7f9cd40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.629+0000 7f9cf6dff700 1 --2- 172.21.15.72:0/2055641375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cd405ee10 0x7f9cd40612d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f9cf01500b0 tx=0x7f9ce4009060).stop 2023-08-31T18:48:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.629+0000 7f9cf6dff700 1 -- 172.21.15.72:0/2055641375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf00c5cb0 msgr2=0x7f9cf00b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.629+0000 7f9cf6dff700 1 --2- 172.21.15.72:0/2055641375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf00c5cb0 0x7f9cf00b00c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f9cdc00c4c0 tx=0x7f9cdc007dd0).stop 2023-08-31T18:48:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.629+0000 7f9cf6dff700 1 -- 172.21.15.72:0/2055641375 shutdown_connections 2023-08-31T18:48:08.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.629+0000 7f9cf6dff700 1 --2- 172.21.15.72:0/2055641375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cf0153e30 0x7f9cf00b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.629+0000 7f9cf6dff700 1 --2- 172.21.15.72:0/2055641375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cd405ee10 0x7f9cd40612d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.629+0000 7f9cf6dff700 1 --2- 172.21.15.72:0/2055641375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf00637c0 0x7f9cf01416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.629+0000 7f9cf6dff700 1 --2- 172.21.15.72:0/2055641375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf00c5cb0 0x7f9cf00b00c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.629+0000 7f9cf6dff700 1 -- 172.21.15.72:0/2055641375 >> 172.21.15.72:0/2055641375 conn(0x7f9cf005eb20 msgr2=0x7f9cf00c09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:08.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.629+0000 7f9cf6dff700 1 -- 172.21.15.72:0/2055641375 shutdown_connections 2023-08-31T18:48:08.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.629+0000 7f9cf6dff700 1 -- 172.21.15.72:0/2055641375 wait complete. 2023-08-31T18:48:08.646 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T18:48:08.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.833+0000 7fccb4dff700 1 Processor -- start 2023-08-31T18:48:08.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.833+0000 7fccb4dff700 1 -- start start 2023-08-31T18:48:08.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.834+0000 7fccb4dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fccb0154060 0x7fccb0157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.834+0000 7fccb4dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccb00cb9b0 0x7fccb01581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.834+0000 7fccb4dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb00c6120 con 0x7fccb01586b0 2023-08-31T18:48:08.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.834+0000 7fccb4dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb00c1380 con 0x7fccb0154060 2023-08-31T18:48:08.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.834+0000 7fccb4dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb0158b60 con 0x7fccb00cb9b0 2023-08-31T18:48:08.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.835+0000 7fccae59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fccb0154060 0x7fccb0157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.835+0000 7fccaed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fccb01586b0 0x7fccb00c65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36956/0 (socket says 172.21.15.72:36956) 2023-08-31T18:48:08.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.835+0000 7fccaed9d700 1 -- 172.21.15.72:0/177092416 learned_addr learned my addr 172.21.15.72:0/177092416 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:08.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.835+0000 7fccadd9b700 1 --2- 172.21.15.72:0/177092416 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccb00cb9b0 0x7fccb01581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.835+0000 7fccae59c700 1 -- 172.21.15.72:0/177092416 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccb00cb9b0 msgr2=0x7fccb01581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:08.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.835+0000 7fccae59c700 1 --2- 172.21.15.72:0/177092416 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccb00cb9b0 0x7fccb01581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.835+0000 7fccae59c700 1 -- 172.21.15.72:0/177092416 >> v1:172.21.15.72:6789/0 conn(0x7fccb01586b0 legacy=0x7fccb00c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:08.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.835+0000 7fccae59c700 1 -- 172.21.15.72:0/177092416 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb00c5e10 con 0x7fccb0154060 2023-08-31T18:48:08.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.835+0000 7fccad59a700 1 -- 172.21.15.72:0/177092416 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701207163 0 0) 0x7fccb00c6120 con 0x7fccb01586b0 2023-08-31T18:48:08.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.835+0000 7fccadd9b700 1 --2- 172.21.15.72:0/177092416 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccb00cb9b0 0x7fccb01581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:08.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.835+0000 7fccae59c700 1 --2- 172.21.15.72:0/177092416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccb0154060 0x7fccb0157cd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fcca0009760 tx=0x7fcca0006f40).ready entity=mon.0 client_cookie=7cf7b90ee353494 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:08.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.836+0000 7fccad59a700 1 -- 172.21.15.72:0/177092416 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca0005880 con 0x7fccb0154060 2023-08-31T18:48:08.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.836+0000 7fccad59a700 1 -- 172.21.15.72:0/177092416 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca00059e0 con 0x7fccb0154060 2023-08-31T18:48:08.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.836+0000 7fccad59a700 1 -- 172.21.15.72:0/177092416 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca0005d60 con 0x7fccb0154060 2023-08-31T18:48:08.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.836+0000 7fccb4dff700 1 -- 172.21.15.72:0/177092416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccb0154060 msgr2=0x7fccb0157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:08.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.836+0000 7fccb4dff700 1 --2- 172.21.15.72:0/177092416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccb0154060 0x7fccb0157cd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fcca0009760 tx=0x7fcca0006f40).stop 2023-08-31T18:48:08.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.836+0000 7fccb4dff700 1 -- 172.21.15.72:0/177092416 shutdown_connections 2023-08-31T18:48:08.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.836+0000 7fccb4dff700 1 --2- 172.21.15.72:0/177092416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccb0154060 0x7fccb0157cd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.836+0000 7fccb4dff700 1 --2- 172.21.15.72:0/177092416 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccb00cb9b0 0x7fccb01581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.836+0000 7fccb4dff700 1 -- 172.21.15.72:0/177092416 >> 172.21.15.72:0/177092416 conn(0x7fccb005e870 msgr2=0x7fccb00cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:08.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.836+0000 7fccb4dff700 1 -- 172.21.15.72:0/177092416 shutdown_connections 2023-08-31T18:48:08.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.836+0000 7fccb4dff700 1 -- 172.21.15.72:0/177092416 wait complete. 2023-08-31T18:48:08.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.838+0000 7fccb4dff700 1 Processor -- start 2023-08-31T18:48:08.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.838+0000 7fccb4dff700 1 -- start start 2023-08-31T18:48:08.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccb4dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb00cb9b0 0x7fccb014cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccb4dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccb0154060 0x7fccb00a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccb4dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccb01586b0 0x7fccb0155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccb4dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb00c32e0 con 0x7fccb0154060 2023-08-31T18:48:08.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccb4dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb01561a0 con 0x7fccb00cb9b0 2023-08-31T18:48:08.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccb4dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb0156480 con 0x7fccb01586b0 2023-08-31T18:48:08.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccadd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccb0154060 0x7fccb00a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccadd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccb0154060 0x7fccb00a7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51500/0 (socket says 172.21.15.72:51500) 2023-08-31T18:48:08.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccadd9b700 1 -- 172.21.15.72:0/1156991634 learned_addr learned my addr 172.21.15.72:0/1156991634 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:08.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccae59c700 1 --2- 172.21.15.72:0/1156991634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb00cb9b0 0x7fccb014cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccaed9d700 1 --2- 172.21.15.72:0/1156991634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccb01586b0 0x7fccb0155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccadd9b700 1 -- 172.21.15.72:0/1156991634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccb01586b0 msgr2=0x7fccb0155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:08.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccadd9b700 1 --2- 172.21.15.72:0/1156991634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccb01586b0 0x7fccb0155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccadd9b700 1 -- 172.21.15.72:0/1156991634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb00cb9b0 msgr2=0x7fccb014cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:08.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccadd9b700 1 --2- 172.21.15.72:0/1156991634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb00cb9b0 0x7fccb014cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:08.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.840+0000 7fccadd9b700 1 -- 172.21.15.72:0/1156991634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca0009250 con 0x7fccb0154060 2023-08-31T18:48:08.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.841+0000 7fccadd9b700 1 --2- 172.21.15.72:0/1156991634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccb0154060 0x7fccb00a7c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fcca400c880 tx=0x7fcca4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:08.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.841+0000 7fcc9e7fc700 1 -- 172.21.15.72:0/1156991634 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4010580 con 0x7fccb0154060 2023-08-31T18:48:08.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.841+0000 7fcc9e7fc700 1 -- 172.21.15.72:0/1156991634 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca40106e0 con 0x7fccb0154060 2023-08-31T18:48:08.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.841+0000 7fccb4dff700 1 -- 172.21.15.72:0/1156991634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb0156760 con 0x7fccb0154060 2023-08-31T18:48:08.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.841+0000 7fcc9e7fc700 1 -- 172.21.15.72:0/1156991634 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4010a60 con 0x7fccb0154060 2023-08-31T18:48:08.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.841+0000 7fccb4dff700 1 -- 172.21.15.72:0/1156991634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb00a8110 con 0x7fccb0154060 2023-08-31T18:48:08.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.842+0000 7fccb4dff700 1 -- 172.21.15.72:0/1156991634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb00c2dd0 con 0x7fccb0154060 2023-08-31T18:48:08.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.843+0000 7fcc9e7fc700 1 -- 172.21.15.72:0/1156991634 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fcca401b460 con 0x7fccb0154060 2023-08-31T18:48:08.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.843+0000 7fcc9e7fc700 1 --2- 172.21.15.72:0/1156991634 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcc9005ee10 0x7fcc900612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:08.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.844+0000 7fcc9e7fc700 1 -- 172.21.15.72:0/1156991634 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcca4079da0 con 0x7fccb0154060 2023-08-31T18:48:08.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.844+0000 7fccae59c700 1 --2- 172.21.15.72:0/1156991634 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcc9005ee10 0x7fcc900612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:08.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.844+0000 7fccae59c700 1 --2- 172.21.15.72:0/1156991634 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcc9005ee10 0x7fcc900612d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fcca0008000 tx=0x7fcca0016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:08.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:08.847+0000 7fcc9e7fc700 1 -- 172.21.15.72:0/1156991634 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fccb00c2dd0 con 0x7fccb0154060 2023-08-31T18:48:09.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.061+0000 7fccb4dff700 1 -- 172.21.15.72:0/1156991634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fccb00c2dd0 con 0x7fccb0154060 2023-08-31T18:48:09.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.062+0000 7fcc9e7fc700 1 -- 172.21.15.72:0/1156991634 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4483 (secure 0 0 0) 0x7fccb00c2dd0 con 0x7fccb0154060 2023-08-31T18:48:09.063 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:09.063 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/111391994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":111391994},{"type":"v1","addr":"172.21.15.72:6837","nonce":111391994}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/4001102603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4001102603},{"type":"v1","addr":"172.21.15.146:6833","nonce":4001102603}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/522602179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":522602179},{"type":"v1","addr":"172.21.15.72:6835","nonce":522602179}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T18:47:52.970136+0000","modified":"2023-08-31T18:47:55.979886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3888852190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3888852190},{"type":"v1","addr":"172.21.15.146:6835","nonce":3888852190}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-31T18:48:09.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.064+0000 7fccb4dff700 1 -- 172.21.15.72:0/1156991634 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcc9005ee10 msgr2=0x7fcc900612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:09.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.064+0000 7fccb4dff700 1 --2- 172.21.15.72:0/1156991634 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcc9005ee10 0x7fcc900612d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fcca0008000 tx=0x7fcca0016000).stop 2023-08-31T18:48:09.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.064+0000 7fccb4dff700 1 -- 172.21.15.72:0/1156991634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccb0154060 msgr2=0x7fccb00a7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:09.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.064+0000 7fccb4dff700 1 --2- 172.21.15.72:0/1156991634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccb0154060 0x7fccb00a7c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fcca400c880 tx=0x7fcca4008040).stop 2023-08-31T18:48:09.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.064+0000 7fccb4dff700 1 -- 172.21.15.72:0/1156991634 shutdown_connections 2023-08-31T18:48:09.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.064+0000 7fccb4dff700 1 --2- 172.21.15.72:0/1156991634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fccb01586b0 0x7fccb0155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.064+0000 7fccb4dff700 1 --2- 172.21.15.72:0/1156991634 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcc9005ee10 0x7fcc900612d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.064+0000 7fccb4dff700 1 --2- 172.21.15.72:0/1156991634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccb00cb9b0 0x7fccb014cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.064+0000 7fccb4dff700 1 --2- 172.21.15.72:0/1156991634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fccb0154060 0x7fccb00a7c20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.064+0000 7fccb4dff700 1 -- 172.21.15.72:0/1156991634 >> 172.21.15.72:0/1156991634 conn(0x7fccb005e870 msgr2=0x7fccb00c8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.064+0000 7fccb4dff700 1 -- 172.21.15.72:0/1156991634 shutdown_connections 2023-08-31T18:48:09.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.064+0000 7fccb4dff700 1 -- 172.21.15.72:0/1156991634 wait complete. 2023-08-31T18:48:09.067 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-08-31T18:48:09.082 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:48:09.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.270+0000 7f186a9ff700 1 Processor -- start 2023-08-31T18:48:09.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.270+0000 7f186a9ff700 1 -- start start 2023-08-31T18:48:09.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.272+0000 7f186a9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1864154060 0x7f1864157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:09.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.272+0000 7f186a9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18640cb9b0 0x7f18641581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:09.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.272+0000 7f186a9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18640c6120 con 0x7f18641586b0 2023-08-31T18:48:09.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.272+0000 7f186a9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18640c1380 con 0x7f1864154060 2023-08-31T18:48:09.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.272+0000 7f186a9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18640c5e10 con 0x7f18640cb9b0 2023-08-31T18:48:09.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.272+0000 7f1863fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1864154060 0x7f1864157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:09.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.272+0000 7f1863fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1864154060 0x7f1864157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51512/0 (socket says 172.21.15.72:51512) 2023-08-31T18:48:09.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.272+0000 7f1863fff700 1 -- 172.21.15.72:0/3004231835 learned_addr learned my addr 172.21.15.72:0/3004231835 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:09.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.272+0000 7f18637fe700 1 --2- 172.21.15.72:0/3004231835 >> v2:172.21.15.146:3300/0 conn(0x7f18640cb9b0 0x7f18641581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:09.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.272+0000 7f1863fff700 1 -- 172.21.15.72:0/3004231835 >> v2:172.21.15.146:3300/0 conn(0x7f18640cb9b0 msgr2=0x7f18641581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:09.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.272+0000 7f1863fff700 1 --2- 172.21.15.72:0/3004231835 >> v2:172.21.15.146:3300/0 conn(0x7f18640cb9b0 0x7f18641581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.272+0000 7f1863fff700 1 -- 172.21.15.72:0/3004231835 >> v1:172.21.15.146:6789/0 conn(0x7f18641586b0 legacy=0x7f18640c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:09.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.272+0000 7f1863fff700 1 -- 172.21.15.72:0/3004231835 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864158b00 con 0x7f1864154060 2023-08-31T18:48:09.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.273+0000 7f1863fff700 1 --2- 172.21.15.72:0/3004231835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1864154060 0x7f1864157cd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f1864083190 tx=0x7f18540090f0).ready entity=mon.0 client_cookie=47fed97338f204b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:09.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.274+0000 7f1862ffd700 1 -- 172.21.15.72:0/3004231835 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400b580 con 0x7f1864154060 2023-08-31T18:48:09.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.274+0000 7f1862ffd700 1 -- 172.21.15.72:0/3004231835 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185400b6e0 con 0x7f1864154060 2023-08-31T18:48:09.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.274+0000 7f1862ffd700 1 -- 172.21.15.72:0/3004231835 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400ba80 con 0x7f1864154060 2023-08-31T18:48:09.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.275+0000 7f186a9ff700 1 -- 172.21.15.72:0/3004231835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1864154060 msgr2=0x7f1864157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:09.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.275+0000 7f186a9ff700 1 --2- 172.21.15.72:0/3004231835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1864154060 0x7f1864157cd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f1864083190 tx=0x7f18540090f0).stop 2023-08-31T18:48:09.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.275+0000 7f186a9ff700 1 -- 172.21.15.72:0/3004231835 shutdown_connections 2023-08-31T18:48:09.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.275+0000 7f186a9ff700 1 --2- 172.21.15.72:0/3004231835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1864154060 0x7f1864157cd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.275+0000 7f186a9ff700 1 --2- 172.21.15.72:0/3004231835 >> v2:172.21.15.146:3300/0 conn(0x7f18640cb9b0 0x7f18641581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.275+0000 7f186a9ff700 1 -- 172.21.15.72:0/3004231835 >> 172.21.15.72:0/3004231835 conn(0x7f186405e870 msgr2=0x7f18640cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:09.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.275+0000 7f186a9ff700 1 -- 172.21.15.72:0/3004231835 shutdown_connections 2023-08-31T18:48:09.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.275+0000 7f186a9ff700 1 -- 172.21.15.72:0/3004231835 wait complete. 2023-08-31T18:48:09.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.277+0000 7f186a9ff700 1 Processor -- start 2023-08-31T18:48:09.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.277+0000 7f186a9ff700 1 -- start start 2023-08-31T18:48:09.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.278+0000 7f186a9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18640cb9b0 0x7f1864151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:09.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.278+0000 7f186a9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1864154060 0x7f18640aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:09.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.278+0000 7f186a9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18641586b0 0x7f18640ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:09.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.278+0000 7f186a9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18640ab730 con 0x7f18640cb9b0 2023-08-31T18:48:09.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.278+0000 7f186a9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18640ad080 con 0x7f18641586b0 2023-08-31T18:48:09.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.278+0000 7f186a9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18641554d0 con 0x7f1864154060 2023-08-31T18:48:09.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.278+0000 7f1863fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18640cb9b0 0x7f1864151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:09.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.278+0000 7f1863fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18640cb9b0 0x7f1864151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51516/0 (socket says 172.21.15.72:51516) 2023-08-31T18:48:09.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.278+0000 7f1863fff700 1 -- 172.21.15.72:0/739837424 learned_addr learned my addr 172.21.15.72:0/739837424 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:09.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.278+0000 7f18637fe700 1 --2- 172.21.15.72:0/739837424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1864154060 0x7f18640aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:09.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.278+0000 7f1868f9c700 1 --2- 172.21.15.72:0/739837424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18641586b0 0x7f18640ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:09.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.279+0000 7f1863fff700 1 -- 172.21.15.72:0/739837424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1864154060 msgr2=0x7f18640aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:09.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.279+0000 7f1863fff700 1 --2- 172.21.15.72:0/739837424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1864154060 0x7f18640aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.279+0000 7f1863fff700 1 -- 172.21.15.72:0/739837424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18641586b0 msgr2=0x7f18640ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:09.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.279+0000 7f1863fff700 1 --2- 172.21.15.72:0/739837424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18641586b0 0x7f18640ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.279+0000 7f1863fff700 1 -- 172.21.15.72:0/739837424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854009310 con 0x7f18640cb9b0 2023-08-31T18:48:09.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.279+0000 7f1863fff700 1 --2- 172.21.15.72:0/739837424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18640cb9b0 0x7f1864151420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f1854006fd0 tx=0x7f1854017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:09.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.279+0000 7f184bfff700 1 -- 172.21.15.72:0/739837424 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400bec0 con 0x7f18640cb9b0 2023-08-31T18:48:09.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.279+0000 7f184bfff700 1 -- 172.21.15.72:0/739837424 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185400b850 con 0x7f18640cb9b0 2023-08-31T18:48:09.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.279+0000 7f186a9ff700 1 -- 172.21.15.72:0/739837424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1864154ea0 con 0x7f18640cb9b0 2023-08-31T18:48:09.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.279+0000 7f184bfff700 1 -- 172.21.15.72:0/739837424 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185401c420 con 0x7f18640cb9b0 2023-08-31T18:48:09.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.279+0000 7f186a9ff700 1 -- 172.21.15.72:0/739837424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18640a96b0 con 0x7f18640cb9b0 2023-08-31T18:48:09.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.280+0000 7f186a9ff700 1 -- 172.21.15.72:0/739837424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186406c6b0 con 0x7f18640cb9b0 2023-08-31T18:48:09.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.281+0000 7f184bfff700 1 -- 172.21.15.72:0/739837424 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f185401c790 con 0x7f18640cb9b0 2023-08-31T18:48:09.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.282+0000 7f184bfff700 1 --2- 172.21.15.72:0/739837424 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f185005ee10 0x7f18500612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:09.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.282+0000 7f184bfff700 1 -- 172.21.15.72:0/739837424 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f185407bbb0 con 0x7f18640cb9b0 2023-08-31T18:48:09.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.282+0000 7f18637fe700 1 --2- 172.21.15.72:0/739837424 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f185005ee10 0x7f18500612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:09.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.282+0000 7f18637fe700 1 --2- 172.21.15.72:0/739837424 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f185005ee10 0x7f18500612d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f18640c5090 tx=0x7f1858008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:09.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.286+0000 7f184bfff700 1 -- 172.21.15.72:0/739837424 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f185404cf60 con 0x7f18640cb9b0 2023-08-31T18:48:09.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.457+0000 7f186a9ff700 1 -- 172.21.15.72:0/739837424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18640c0ae0 con 0x7f18640cb9b0 2023-08-31T18:48:09.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.458+0000 7f184bfff700 1 -- 172.21.15.72:0/739837424 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17024 (secure 0 0 0) 0x7f185402a070 con 0x7f18640cb9b0 2023-08-31T18:48:09.460 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:09.460 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:53.972412+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:47:51.003304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-31T18:47:51.950765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:48:09.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.460+0000 7f186a9ff700 1 -- 172.21.15.72:0/739837424 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f185005ee10 msgr2=0x7f18500612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:09.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.460+0000 7f186a9ff700 1 --2- 172.21.15.72:0/739837424 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f185005ee10 0x7f18500612d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f18640c5090 tx=0x7f1858008040).stop 2023-08-31T18:48:09.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.460+0000 7f186a9ff700 1 -- 172.21.15.72:0/739837424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18640cb9b0 msgr2=0x7f1864151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:09.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.460+0000 7f186a9ff700 1 --2- 172.21.15.72:0/739837424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18640cb9b0 0x7f1864151420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f1854006fd0 tx=0x7f1854017000).stop 2023-08-31T18:48:09.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.461+0000 7f186a9ff700 1 -- 172.21.15.72:0/739837424 shutdown_connections 2023-08-31T18:48:09.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.461+0000 7f186a9ff700 1 --2- 172.21.15.72:0/739837424 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f185005ee10 0x7f18500612d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.461+0000 7f186a9ff700 1 --2- 172.21.15.72:0/739837424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18641586b0 0x7f18640ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.461+0000 7f186a9ff700 1 --2- 172.21.15.72:0/739837424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18640cb9b0 0x7f1864151420 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.461+0000 7f186a9ff700 1 --2- 172.21.15.72:0/739837424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1864154060 0x7f18640aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.461+0000 7f186a9ff700 1 -- 172.21.15.72:0/739837424 >> 172.21.15.72:0/739837424 conn(0x7f186405e870 msgr2=0x7f18640c7030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:09.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.461+0000 7f186a9ff700 1 -- 172.21.15.72:0/739837424 shutdown_connections 2023-08-31T18:48:09.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.461+0000 7f186a9ff700 1 -- 172.21.15.72:0/739837424 wait complete. 2023-08-31T18:48:09.479 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T18:47:51.003304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T18:47:51.950765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T18:48:09.480 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T18:48:09.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.671+0000 7f759e5ff700 1 Processor -- start 2023-08-31T18:48:09.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.671+0000 7f759e5ff700 1 -- start start 2023-08-31T18:48:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.672+0000 7f759e5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7598153e30 0x7f7598154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.672+0000 7f759e5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75980637c0 0x7f75980c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.673+0000 7f759e5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75980bfd40 con 0x7f75980c5cb0 2023-08-31T18:48:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.673+0000 7f759e5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75980c6730 con 0x7f75980637c0 2023-08-31T18:48:09.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.673+0000 7f759e5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75980bffe0 con 0x7f7598153e30 2023-08-31T18:48:09.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.673+0000 7f759cb9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75980637c0 0x7f75980c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:09.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.673+0000 7f759cb9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75980637c0 0x7f75980c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51530/0 (socket says 172.21.15.72:51530) 2023-08-31T18:48:09.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.673+0000 7f759cb9c700 1 -- 172.21.15.72:0/1687925650 learned_addr learned my addr 172.21.15.72:0/1687925650 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.673+0000 7f7597fff700 1 --2- 172.21.15.72:0/1687925650 >> v2:172.21.15.146:3300/0 conn(0x7f7598153e30 0x7f7598154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.673+0000 7f759cb9c700 1 -- 172.21.15.72:0/1687925650 >> v2:172.21.15.146:3300/0 conn(0x7f7598153e30 msgr2=0x7f7598154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.673+0000 7f759cb9c700 1 --2- 172.21.15.72:0/1687925650 >> v2:172.21.15.146:3300/0 conn(0x7f7598153e30 0x7f7598154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.673+0000 7f759cb9c700 1 -- 172.21.15.72:0/1687925650 >> v1:172.21.15.146:6789/0 conn(0x7f75980c5cb0 legacy=0x7f75980630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.673+0000 7f759cb9c700 1 -- 172.21.15.72:0/1687925650 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75980c02c0 con 0x7f75980637c0 2023-08-31T18:48:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.673+0000 7f7597fff700 1 --2- 172.21.15.72:0/1687925650 >> v2:172.21.15.146:3300/0 conn(0x7f7598153e30 0x7f7598154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.673+0000 7f759cb9c700 1 --2- 172.21.15.72:0/1687925650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75980637c0 0x7f75980c6160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f759806aa50 tx=0x7f7590009840).ready entity=mon.0 client_cookie=a4b934dbe398501a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.674+0000 7f7596ffd700 1 -- 172.21.15.72:0/1687925650 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759000e070 con 0x7f75980637c0 2023-08-31T18:48:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.674+0000 7f7596ffd700 1 -- 172.21.15.72:0/1687925650 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759000ba10 con 0x7f75980637c0 2023-08-31T18:48:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.674+0000 7f7596ffd700 1 -- 172.21.15.72:0/1687925650 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759000bd90 con 0x7f75980637c0 2023-08-31T18:48:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.674+0000 7f759e5ff700 1 -- 172.21.15.72:0/1687925650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75980637c0 msgr2=0x7f75980c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.674+0000 7f759e5ff700 1 --2- 172.21.15.72:0/1687925650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75980637c0 0x7f75980c6160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f759806aa50 tx=0x7f7590009840).stop 2023-08-31T18:48:09.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.674+0000 7f759e5ff700 1 -- 172.21.15.72:0/1687925650 shutdown_connections 2023-08-31T18:48:09.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.674+0000 7f759e5ff700 1 --2- 172.21.15.72:0/1687925650 >> v2:172.21.15.146:3300/0 conn(0x7f7598153e30 0x7f7598154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.674+0000 7f759e5ff700 1 --2- 172.21.15.72:0/1687925650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75980637c0 0x7f75980c6160 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.674+0000 7f759e5ff700 1 -- 172.21.15.72:0/1687925650 >> 172.21.15.72:0/1687925650 conn(0x7f759805eb20 msgr2=0x7f75980cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:09.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.674+0000 7f759e5ff700 1 -- 172.21.15.72:0/1687925650 shutdown_connections 2023-08-31T18:48:09.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.674+0000 7f759e5ff700 1 -- 172.21.15.72:0/1687925650 wait complete. 2023-08-31T18:48:09.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.676+0000 7f759e5ff700 1 Processor -- start 2023-08-31T18:48:09.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.676+0000 7f759e5ff700 1 -- start start 2023-08-31T18:48:09.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f759e5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75980637c0 0x7f7598155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f759e5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75980c5cb0 0x7f7598155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f759e5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7598153e30 0x7f759814fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f759e5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7598156eb0 con 0x7f75980c5cb0 2023-08-31T18:48:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f759e5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75981557f0 con 0x7f7598153e30 2023-08-31T18:48:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f759e5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75981562a0 con 0x7f75980637c0 2023-08-31T18:48:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f75977fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75980c5cb0 0x7f7598155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f75977fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75980c5cb0 0x7f7598155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51538/0 (socket says 172.21.15.72:51538) 2023-08-31T18:48:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f75977fe700 1 -- 172.21.15.72:0/591483694 learned_addr learned my addr 172.21.15.72:0/591483694 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f759cb9c700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7598153e30 0x7f759814fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f7597fff700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75980637c0 0x7f7598155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f75977fe700 1 -- 172.21.15.72:0/591483694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75980637c0 msgr2=0x7f7598155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f75977fe700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75980637c0 0x7f7598155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f75977fe700 1 -- 172.21.15.72:0/591483694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7598153e30 msgr2=0x7f759814fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f75977fe700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7598153e30 0x7f759814fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f75977fe700 1 -- 172.21.15.72:0/591483694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7590009ae0 con 0x7f75980c5cb0 2023-08-31T18:48:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f759cb9c700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7598153e30 0x7f759814fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.677+0000 7f7597fff700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75980637c0 0x7f7598155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.678+0000 7f75977fe700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75980c5cb0 0x7f7598155300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f758c00c440 tx=0x7f758c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.678+0000 7f757ffff700 1 -- 172.21.15.72:0/591483694 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c00f470 con 0x7f75980c5cb0 2023-08-31T18:48:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.678+0000 7f757ffff700 1 -- 172.21.15.72:0/591483694 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c00f5f0 con 0x7f75980c5cb0 2023-08-31T18:48:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.678+0000 7f759e5ff700 1 -- 172.21.15.72:0/591483694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7598156580 con 0x7f75980c5cb0 2023-08-31T18:48:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.678+0000 7f757ffff700 1 -- 172.21.15.72:0/591483694 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c00f9b0 con 0x7f75980c5cb0 2023-08-31T18:48:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.678+0000 7f759e5ff700 1 -- 172.21.15.72:0/591483694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7598156b40 con 0x7f75980c5cb0 2023-08-31T18:48:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.679+0000 7f759e5ff700 1 -- 172.21.15.72:0/591483694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759806c6b0 con 0x7f75980c5cb0 2023-08-31T18:48:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.680+0000 7f757ffff700 1 -- 172.21.15.72:0/591483694 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f758c012400 con 0x7f75980c5cb0 2023-08-31T18:48:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.680+0000 7f757ffff700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f758405ede0 0x7f75840612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.681+0000 7f757ffff700 1 -- 172.21.15.72:0/591483694 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f758c0792c0 con 0x7f75980c5cb0 2023-08-31T18:48:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.681+0000 7f7597fff700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f758405ede0 0x7f75840612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.681+0000 7f7597fff700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f758405ede0 0x7f75840612a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7588006fd0 tx=0x7f7588008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.685+0000 7f757ffff700 1 -- 172.21.15.72:0/591483694 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f758c0488f0 con 0x7f75980c5cb0 2023-08-31T18:48:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.853+0000 7f759e5ff700 1 -- 172.21.15.72:0/591483694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7598062970 con 0x7f75980c5cb0 2023-08-31T18:48:09.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.854+0000 7f757ffff700 1 -- 172.21.15.72:0/591483694 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f758c04a780 con 0x7f75980c5cb0 2023-08-31T18:48:09.854 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T18:48:09.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.855+0000 7f759e5ff700 1 -- 172.21.15.72:0/591483694 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f758405ede0 msgr2=0x7f75840612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:09.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.855+0000 7f759e5ff700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f758405ede0 0x7f75840612a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7588006fd0 tx=0x7f7588008040).stop 2023-08-31T18:48:09.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.855+0000 7f759e5ff700 1 -- 172.21.15.72:0/591483694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75980c5cb0 msgr2=0x7f7598155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:09.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.855+0000 7f759e5ff700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75980c5cb0 0x7f7598155300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f758c00c440 tx=0x7f758c007de0).stop 2023-08-31T18:48:09.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.856+0000 7f759e5ff700 1 -- 172.21.15.72:0/591483694 shutdown_connections 2023-08-31T18:48:09.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.856+0000 7f759e5ff700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f758405ede0 0x7f75840612a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.856+0000 7f759e5ff700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7598153e30 0x7f759814fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.856+0000 7f759e5ff700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75980637c0 0x7f7598155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.856+0000 7f759e5ff700 1 --2- 172.21.15.72:0/591483694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75980c5cb0 0x7f7598155300 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:09.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.856+0000 7f759e5ff700 1 -- 172.21.15.72:0/591483694 >> 172.21.15.72:0/591483694 conn(0x7f759805eb20 msgr2=0x7f75980c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:09.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.856+0000 7f759e5ff700 1 -- 172.21.15.72:0/591483694 shutdown_connections 2023-08-31T18:48:09.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:09.856+0000 7f759e5ff700 1 -- 172.21.15.72:0/591483694 wait complete. 2023-08-31T18:48:09.873 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T18:48:10.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.062+0000 7f5d857ff700 1 Processor -- start 2023-08-31T18:48:10.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.062+0000 7f5d857ff700 1 -- start start 2023-08-31T18:48:10.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.063+0000 7f5d857ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5d80153e30 0x7f5d80154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.064+0000 7f5d857ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5d800c5cb0 0x7f5d800c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.064+0000 7f5d857ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d800bfd40 con 0x7f5d800630b0 2023-08-31T18:48:10.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.064+0000 7f5d857ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d800c6730 con 0x7f5d80153e30 2023-08-31T18:48:10.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.064+0000 7f5d857ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d800bffe0 con 0x7f5d800c5cb0 2023-08-31T18:48:10.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.064+0000 7f5d7effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5d80153e30 0x7f5d80154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.064+0000 7f5d7effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5d80153e30 0x7f5d80154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51542/0 (socket says 172.21.15.72:51542) 2023-08-31T18:48:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.064+0000 7f5d7effd700 1 -- 172.21.15.72:0/1299920968 learned_addr learned my addr 172.21.15.72:0/1299920968 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.064+0000 7f5d7e7fc700 1 --2- 172.21.15.72:0/1299920968 >> v2:172.21.15.146:3300/0 conn(0x7f5d800c5cb0 0x7f5d800c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.064+0000 7f5d7effd700 1 -- 172.21.15.72:0/1299920968 >> v2:172.21.15.146:3300/0 conn(0x7f5d800c5cb0 msgr2=0x7f5d800c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:10.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.064+0000 7f5d7effd700 1 --2- 172.21.15.72:0/1299920968 >> v2:172.21.15.146:3300/0 conn(0x7f5d800c5cb0 0x7f5d800c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.064+0000 7f5d7effd700 1 -- 172.21.15.72:0/1299920968 >> v1:172.21.15.146:6789/0 conn(0x7f5d800630b0 legacy=0x7f5d80157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:10.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.064+0000 7f5d7effd700 1 -- 172.21.15.72:0/1299920968 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d800c02c0 con 0x7f5d80153e30 2023-08-31T18:48:10.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.065+0000 7f5d7effd700 1 --2- 172.21.15.72:0/1299920968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d80153e30 0x7f5d80154210 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f5d80063d10 tx=0x7f5d700090f0).ready entity=mon.0 client_cookie=3ec1c6c14cb93c1b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:10.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.065+0000 7f5d7dffb700 1 -- 172.21.15.72:0/1299920968 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000b600 con 0x7f5d80153e30 2023-08-31T18:48:10.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.065+0000 7f5d7dffb700 1 -- 172.21.15.72:0/1299920968 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7000b760 con 0x7f5d80153e30 2023-08-31T18:48:10.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.065+0000 7f5d7dffb700 1 -- 172.21.15.72:0/1299920968 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000bb00 con 0x7f5d80153e30 2023-08-31T18:48:10.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.065+0000 7f5d857ff700 1 -- 172.21.15.72:0/1299920968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d80153e30 msgr2=0x7f5d80154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:10.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.065+0000 7f5d857ff700 1 --2- 172.21.15.72:0/1299920968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d80153e30 0x7f5d80154210 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f5d80063d10 tx=0x7f5d700090f0).stop 2023-08-31T18:48:10.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.065+0000 7f5d857ff700 1 -- 172.21.15.72:0/1299920968 shutdown_connections 2023-08-31T18:48:10.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.065+0000 7f5d857ff700 1 --2- 172.21.15.72:0/1299920968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d80153e30 0x7f5d80154210 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.065+0000 7f5d857ff700 1 --2- 172.21.15.72:0/1299920968 >> v2:172.21.15.146:3300/0 conn(0x7f5d800c5cb0 0x7f5d800c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.065+0000 7f5d857ff700 1 -- 172.21.15.72:0/1299920968 >> 172.21.15.72:0/1299920968 conn(0x7f5d8005eb20 msgr2=0x7f5d800cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:10.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.065+0000 7f5d857ff700 1 -- 172.21.15.72:0/1299920968 shutdown_connections 2023-08-31T18:48:10.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.066+0000 7f5d857ff700 1 -- 172.21.15.72:0/1299920968 wait complete. 2023-08-31T18:48:10.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.067+0000 7f5d857ff700 1 Processor -- start 2023-08-31T18:48:10.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.067+0000 7f5d857ff700 1 -- start start 2023-08-31T18:48:10.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.068+0000 7f5d857ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d800630b0 0x7f5d800a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.068+0000 7f5d857ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d800c5cb0 0x7f5d800aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.068+0000 7f5d857ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d80153e30 0x7f5d800ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.068+0000 7f5d857ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800ab930 con 0x7f5d800c5cb0 2023-08-31T18:48:10.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.068+0000 7f5d857ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800c2ef0 con 0x7f5d800630b0 2023-08-31T18:48:10.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.068+0000 7f5d857ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800c3190 con 0x7f5d80153e30 2023-08-31T18:48:10.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.068+0000 7f5d7e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d800c5cb0 0x7f5d800aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.068+0000 7f5d7e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d800c5cb0 0x7f5d800aaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51550/0 (socket says 172.21.15.72:51550) 2023-08-31T18:48:10.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.068+0000 7f5d7e7fc700 1 -- 172.21.15.72:0/2213734140 learned_addr learned my addr 172.21.15.72:0/2213734140 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:10.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.068+0000 7f5d7effd700 1 --2- 172.21.15.72:0/2213734140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d800630b0 0x7f5d800a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.069+0000 7f5d7f7fe700 1 --2- 172.21.15.72:0/2213734140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d80153e30 0x7f5d800ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.069+0000 7f5d7e7fc700 1 -- 172.21.15.72:0/2213734140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d80153e30 msgr2=0x7f5d800ab440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:10.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.069+0000 7f5d7e7fc700 1 --2- 172.21.15.72:0/2213734140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d80153e30 0x7f5d800ab440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.069+0000 7f5d7e7fc700 1 -- 172.21.15.72:0/2213734140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d800630b0 msgr2=0x7f5d800a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.069+0000 7f5d7e7fc700 1 --2- 172.21.15.72:0/2213734140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d800630b0 0x7f5d800a42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.069+0000 7f5d7e7fc700 1 -- 172.21.15.72:0/2213734140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d70009370 con 0x7f5d800c5cb0 2023-08-31T18:48:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.069+0000 7f5d7e7fc700 1 --2- 172.21.15.72:0/2213734140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d800c5cb0 0x7f5d800aaf50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f5d7400d890 tx=0x7f5d74008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.069+0000 7f5d66ffd700 1 -- 172.21.15.72:0/2213734140 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d740125f0 con 0x7f5d800c5cb0 2023-08-31T18:48:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.069+0000 7f5d66ffd700 1 -- 172.21.15.72:0/2213734140 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d74012750 con 0x7f5d800c5cb0 2023-08-31T18:48:10.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.069+0000 7f5d857ff700 1 -- 172.21.15.72:0/2213734140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d800c3470 con 0x7f5d800c5cb0 2023-08-31T18:48:10.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.069+0000 7f5d66ffd700 1 -- 172.21.15.72:0/2213734140 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d74012ad0 con 0x7f5d800c5cb0 2023-08-31T18:48:10.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.069+0000 7f5d857ff700 1 -- 172.21.15.72:0/2213734140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d80165130 con 0x7f5d800c5cb0 2023-08-31T18:48:10.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.070+0000 7f5d857ff700 1 -- 172.21.15.72:0/2213734140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8006c6b0 con 0x7f5d800c5cb0 2023-08-31T18:48:10.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.071+0000 7f5d66ffd700 1 -- 172.21.15.72:0/2213734140 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f5d74013480 con 0x7f5d800c5cb0 2023-08-31T18:48:10.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.072+0000 7f5d66ffd700 1 --2- 172.21.15.72:0/2213734140 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d6c05ede0 0x7f5d6c0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.072+0000 7f5d66ffd700 1 -- 172.21.15.72:0/2213734140 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5d74079bc0 con 0x7f5d800c5cb0 2023-08-31T18:48:10.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.072+0000 7f5d7effd700 1 --2- 172.21.15.72:0/2213734140 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d6c05ede0 0x7f5d6c0612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.072+0000 7f5d7effd700 1 --2- 172.21.15.72:0/2213734140 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d6c05ede0 0x7f5d6c0612a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5d800a5c60 tx=0x7f5d70017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:10.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.076+0000 7f5d66ffd700 1 -- 172.21.15.72:0/2213734140 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5d7404afd0 con 0x7f5d800c5cb0 2023-08-31T18:48:10.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.245+0000 7f5d857ff700 1 -- 172.21.15.72:0/2213734140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5d80064000 con 0x7f5d800c5cb0 2023-08-31T18:48:10.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.246+0000 7f5d66ffd700 1 -- 172.21.15.72:0/2213734140 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5d7404e5f0 con 0x7f5d800c5cb0 2023-08-31T18:48:10.246 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T18:48:10.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.248+0000 7f5d857ff700 1 -- 172.21.15.72:0/2213734140 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d6c05ede0 msgr2=0x7f5d6c0612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:10.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.248+0000 7f5d857ff700 1 --2- 172.21.15.72:0/2213734140 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d6c05ede0 0x7f5d6c0612a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5d800a5c60 tx=0x7f5d70017000).stop 2023-08-31T18:48:10.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.248+0000 7f5d857ff700 1 -- 172.21.15.72:0/2213734140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d800c5cb0 msgr2=0x7f5d800aaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:10.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.248+0000 7f5d857ff700 1 --2- 172.21.15.72:0/2213734140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d800c5cb0 0x7f5d800aaf50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f5d7400d890 tx=0x7f5d74008040).stop 2023-08-31T18:48:10.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.248+0000 7f5d857ff700 1 -- 172.21.15.72:0/2213734140 shutdown_connections 2023-08-31T18:48:10.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.248+0000 7f5d857ff700 1 --2- 172.21.15.72:0/2213734140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d80153e30 0x7f5d800ab440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.248+0000 7f5d857ff700 1 --2- 172.21.15.72:0/2213734140 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d6c05ede0 0x7f5d6c0612a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.248+0000 7f5d857ff700 1 --2- 172.21.15.72:0/2213734140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d800630b0 0x7f5d800a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.248+0000 7f5d857ff700 1 --2- 172.21.15.72:0/2213734140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d800c5cb0 0x7f5d800aaf50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.248+0000 7f5d857ff700 1 -- 172.21.15.72:0/2213734140 >> 172.21.15.72:0/2213734140 conn(0x7f5d8005eb20 msgr2=0x7f5d800aa290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:10.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.248+0000 7f5d857ff700 1 -- 172.21.15.72:0/2213734140 shutdown_connections 2023-08-31T18:48:10.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.248+0000 7f5d857ff700 1 -- 172.21.15.72:0/2213734140 wait complete. 2023-08-31T18:48:10.265 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T18:48:10.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.456+0000 7f7dc0bff700 1 Processor -- start 2023-08-31T18:48:10.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.456+0000 7f7dc0bff700 1 -- start start 2023-08-31T18:48:10.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.458+0000 7f7dc0bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7dbc153ed0 0x7f7dbc1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.458+0000 7f7dc0bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7dbc0bdb30 0x7f7dbc155200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.458+0000 7f7dc0bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dbc0a84b0 con 0x7f7dbc0663d0 2023-08-31T18:48:10.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.458+0000 7f7dc0bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dbc0c9410 con 0x7f7dbc0bdb30 2023-08-31T18:48:10.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.458+0000 7f7dc0bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0c5310 con 0x7f7dbc153ed0 2023-08-31T18:48:10.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.458+0000 7f7db9d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7dbc0bdb30 0x7f7dbc155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.458+0000 7f7db9d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7dbc0bdb30 0x7f7dbc155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51564/0 (socket says 172.21.15.72:51564) 2023-08-31T18:48:10.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.458+0000 7f7db9d9b700 1 -- 172.21.15.72:0/963973883 learned_addr learned my addr 172.21.15.72:0/963973883 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:10.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.458+0000 7f7dba59c700 1 --2- 172.21.15.72:0/963973883 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7dbc153ed0 0x7f7dbc1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.458+0000 7f7db9d9b700 1 -- 172.21.15.72:0/963973883 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7dbc153ed0 msgr2=0x7f7dbc1542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:10.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.458+0000 7f7db9d9b700 1 --2- 172.21.15.72:0/963973883 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7dbc153ed0 0x7f7dbc1542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.458+0000 7f7db9d9b700 1 -- 172.21.15.72:0/963973883 >> v1:172.21.15.146:6789/0 conn(0x7f7dbc0663d0 legacy=0x7f7dbc067900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:10.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.458+0000 7f7db9d9b700 1 -- 172.21.15.72:0/963973883 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc1556f0 con 0x7f7dbc0bdb30 2023-08-31T18:48:10.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.459+0000 7f7db9d9b700 1 --2- 172.21.15.72:0/963973883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dbc0bdb30 0x7f7dbc155200 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f7db0006fd0 tx=0x7f7db00090f0).ready entity=mon.0 client_cookie=4282e570b5402ed7 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:10.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.459+0000 7f7db959a700 1 -- 172.21.15.72:0/963973883 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db000b600 con 0x7f7dbc0bdb30 2023-08-31T18:48:10.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.459+0000 7f7db959a700 1 -- 172.21.15.72:0/963973883 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db000b760 con 0x7f7dbc0bdb30 2023-08-31T18:48:10.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.459+0000 7f7db959a700 1 -- 172.21.15.72:0/963973883 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db000bb00 con 0x7f7dbc0bdb30 2023-08-31T18:48:10.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.459+0000 7f7dc0bff700 1 -- 172.21.15.72:0/963973883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dbc0bdb30 msgr2=0x7f7dbc155200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:10.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.459+0000 7f7dc0bff700 1 --2- 172.21.15.72:0/963973883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dbc0bdb30 0x7f7dbc155200 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f7db0006fd0 tx=0x7f7db00090f0).stop 2023-08-31T18:48:10.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.459+0000 7f7dc0bff700 1 -- 172.21.15.72:0/963973883 shutdown_connections 2023-08-31T18:48:10.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.459+0000 7f7dc0bff700 1 --2- 172.21.15.72:0/963973883 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7dbc153ed0 0x7f7dbc1542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.459+0000 7f7dc0bff700 1 --2- 172.21.15.72:0/963973883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dbc0bdb30 0x7f7dbc155200 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.459+0000 7f7dc0bff700 1 -- 172.21.15.72:0/963973883 >> 172.21.15.72:0/963973883 conn(0x7f7dbc05eb60 msgr2=0x7f7dbc0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:10.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.460+0000 7f7dc0bff700 1 -- 172.21.15.72:0/963973883 shutdown_connections 2023-08-31T18:48:10.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.460+0000 7f7dc0bff700 1 -- 172.21.15.72:0/963973883 wait complete. 2023-08-31T18:48:10.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.461+0000 7f7dc0bff700 1 Processor -- start 2023-08-31T18:48:10.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.461+0000 7f7dc0bff700 1 -- start start 2023-08-31T18:48:10.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.462+0000 7f7dc0bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7dbc0663d0 0x7f7dbc14faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.462+0000 7f7dc0bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dbc153ed0 0x7f7dbc0a5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.462+0000 7f7dc0bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0a63c0 0x7f7dbc0a6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.462+0000 7f7dc0bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0a4840 con 0x7f7dbc153ed0 2023-08-31T18:48:10.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.462+0000 7f7dc0bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0a6e10 con 0x7f7dbc0a63c0 2023-08-31T18:48:10.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.462+0000 7f7dc0bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0a4a90 con 0x7f7dbc0663d0 2023-08-31T18:48:10.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.462+0000 7f7db9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dbc153ed0 0x7f7dbc0a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.462+0000 7f7db9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dbc153ed0 0x7f7dbc0a5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51574/0 (socket says 172.21.15.72:51574) 2023-08-31T18:48:10.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.462+0000 7f7db9d9b700 1 -- 172.21.15.72:0/4022962201 learned_addr learned my addr 172.21.15.72:0/4022962201 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:10.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.463+0000 7f7dba59c700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7dbc0663d0 0x7f7dbc14faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.463+0000 7f7db9d9b700 1 -- 172.21.15.72:0/4022962201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7dbc0663d0 msgr2=0x7f7dbc14faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:10.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.463+0000 7f7db9d9b700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7dbc0663d0 0x7f7dbc14faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.463+0000 7f7dbad9d700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0a63c0 0x7f7dbc0a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.463+0000 7f7db9d9b700 1 -- 172.21.15.72:0/4022962201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0a63c0 msgr2=0x7f7dbc0a6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:10.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.463+0000 7f7db9d9b700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0a63c0 0x7f7dbc0a6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.463+0000 7f7db9d9b700 1 -- 172.21.15.72:0/4022962201 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db0009370 con 0x7f7dbc153ed0 2023-08-31T18:48:10.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.463+0000 7f7dba59c700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7dbc0663d0 0x7f7dbc14faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:10.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.463+0000 7f7dbad9d700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0a63c0 0x7f7dbc0a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:10.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.463+0000 7f7db9d9b700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dbc153ed0 0x7f7dbc0a5570 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f7dbc0c3470 tx=0x7f7db0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:10.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.463+0000 7f7daa7fc700 1 -- 172.21.15.72:0/4022962201 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db000b8d0 con 0x7f7dbc153ed0 2023-08-31T18:48:10.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.463+0000 7f7daa7fc700 1 -- 172.21.15.72:0/4022962201 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db000ba30 con 0x7f7dbc153ed0 2023-08-31T18:48:10.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.463+0000 7f7daa7fc700 1 -- 172.21.15.72:0/4022962201 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db00246c0 con 0x7f7dbc153ed0 2023-08-31T18:48:10.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.463+0000 7f7dc0bff700 1 -- 172.21.15.72:0/4022962201 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dbc0a4d70 con 0x7f7dbc153ed0 2023-08-31T18:48:10.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.463+0000 7f7dc0bff700 1 -- 172.21.15.72:0/4022962201 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dbc0c87b0 con 0x7f7dbc153ed0 2023-08-31T18:48:10.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.464+0000 7f7dc0bff700 1 -- 172.21.15.72:0/4022962201 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dbc0c6350 con 0x7f7dbc153ed0 2023-08-31T18:48:10.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.465+0000 7f7daa7fc700 1 -- 172.21.15.72:0/4022962201 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f7db0021070 con 0x7f7dbc153ed0 2023-08-31T18:48:10.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.466+0000 7f7daa7fc700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7d9c05ee10 0x7f7d9c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.466+0000 7f7daa7fc700 1 -- 172.21.15.72:0/4022962201 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7db007b910 con 0x7f7dbc153ed0 2023-08-31T18:48:10.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.466+0000 7f7dba59c700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7d9c05ee10 0x7f7d9c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.467+0000 7f7dba59c700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7d9c05ee10 0x7f7d9c0612d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f7dac008900 tx=0x7f7dac008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:10.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.470+0000 7f7daa7fc700 1 -- 172.21.15.72:0/4022962201 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7db004cd40 con 0x7f7dbc153ed0 2023-08-31T18:48:10.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.638+0000 7f7dc0bff700 1 -- 172.21.15.72:0/4022962201 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7dbc0a5290 con 0x7f7dbc153ed0 2023-08-31T18:48:10.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.639+0000 7f7daa7fc700 1 -- 172.21.15.72:0/4022962201 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7db0029020 con 0x7f7dbc153ed0 2023-08-31T18:48:10.639 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T18:48:10.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.640+0000 7f7dc0bff700 1 -- 172.21.15.72:0/4022962201 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7d9c05ee10 msgr2=0x7f7d9c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:10.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.641+0000 7f7dc0bff700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7d9c05ee10 0x7f7d9c0612d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f7dac008900 tx=0x7f7dac008040).stop 2023-08-31T18:48:10.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.641+0000 7f7dc0bff700 1 -- 172.21.15.72:0/4022962201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dbc153ed0 msgr2=0x7f7dbc0a5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.641+0000 7f7dc0bff700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dbc153ed0 0x7f7dbc0a5570 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f7dbc0c3470 tx=0x7f7db0017000).stop 2023-08-31T18:48:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.641+0000 7f7dc0bff700 1 -- 172.21.15.72:0/4022962201 shutdown_connections 2023-08-31T18:48:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.641+0000 7f7dc0bff700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7d9c05ee10 0x7f7d9c0612d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.641+0000 7f7dc0bff700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7dbc0a63c0 0x7f7dbc0a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.641+0000 7f7dc0bff700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7dbc0663d0 0x7f7dbc14faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.641+0000 7f7dc0bff700 1 --2- 172.21.15.72:0/4022962201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dbc153ed0 0x7f7dbc0a5570 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.641+0000 7f7dc0bff700 1 -- 172.21.15.72:0/4022962201 >> 172.21.15.72:0/4022962201 conn(0x7f7dbc05eb60 msgr2=0x7f7dbc152b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.641+0000 7f7dc0bff700 1 -- 172.21.15.72:0/4022962201 shutdown_connections 2023-08-31T18:48:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.641+0000 7f7dc0bff700 1 -- 172.21.15.72:0/4022962201 wait complete. 2023-08-31T18:48:10.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T18:48:10.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.848+0000 7f4b16dff700 1 Processor -- start 2023-08-31T18:48:10.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.848+0000 7f4b16dff700 1 -- start start 2023-08-31T18:48:10.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.849+0000 7f4b16dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b10153e30 0x7f4b10154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.849+0000 7f4b16dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b100c5cb0 0x7f4b100c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.849+0000 7f4b16dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4b100630b0 0x7f4b10063530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.849+0000 7f4b16dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b10063a20 con 0x7f4b100c5cb0 2023-08-31T18:48:10.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.849+0000 7f4b16dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b100bfd40 con 0x7f4b100630b0 2023-08-31T18:48:10.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.849+0000 7f4b16dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100c6730 con 0x7f4b10153e30 2023-08-31T18:48:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.850+0000 7f4b0ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b100c5cb0 0x7f4b100c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.850+0000 7f4b0ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b100c5cb0 0x7f4b100c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51588/0 (socket says 172.21.15.72:51588) 2023-08-31T18:48:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.850+0000 7f4b0ffff700 1 -- 172.21.15.72:0/606487879 learned_addr learned my addr 172.21.15.72:0/606487879 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.850+0000 7f4b14b9b700 1 --2- 172.21.15.72:0/606487879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b10153e30 0x7f4b10154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.850+0000 7f4b1539c700 1 --2- 172.21.15.72:0/606487879 >> v2:172.21.15.146:3300/0 conn(0x7f4b100630b0 0x7f4b10063530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.850+0000 7f4b0ffff700 1 -- 172.21.15.72:0/606487879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b10153e30 msgr2=0x7f4b10154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:10.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.850+0000 7f4b0ffff700 1 --2- 172.21.15.72:0/606487879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b10153e30 0x7f4b10154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.850+0000 7f4b0ffff700 1 -- 172.21.15.72:0/606487879 >> v2:172.21.15.146:3300/0 conn(0x7f4b100630b0 msgr2=0x7f4b10063530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:10.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.850+0000 7f4b0ffff700 1 --2- 172.21.15.72:0/606487879 >> v2:172.21.15.146:3300/0 conn(0x7f4b100630b0 0x7f4b10063530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.850+0000 7f4b0ffff700 1 -- 172.21.15.72:0/606487879 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b100bffe0 con 0x7f4b100c5cb0 2023-08-31T18:48:10.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.850+0000 7f4b14b9b700 1 --2- 172.21.15.72:0/606487879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b10153e30 0x7f4b10154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:10.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.850+0000 7f4b0ffff700 1 --2- 172.21.15.72:0/606487879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b100c5cb0 0x7f4b100c6130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f4b10062910 tx=0x7f4afc0090f0).ready entity=mon.0 client_cookie=7dc0a7f1efa32b30 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:10.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.850+0000 7f4b0f7fe700 1 -- 172.21.15.72:0/606487879 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc00b600 con 0x7f4b100c5cb0 2023-08-31T18:48:10.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.851+0000 7f4b0f7fe700 1 -- 172.21.15.72:0/606487879 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc00b760 con 0x7f4b100c5cb0 2023-08-31T18:48:10.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.851+0000 7f4b0f7fe700 1 -- 172.21.15.72:0/606487879 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc00bb00 con 0x7f4b100c5cb0 2023-08-31T18:48:10.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.851+0000 7f4b16dff700 1 -- 172.21.15.72:0/606487879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b100c5cb0 msgr2=0x7f4b100c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:10.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.851+0000 7f4b16dff700 1 --2- 172.21.15.72:0/606487879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b100c5cb0 0x7f4b100c6130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f4b10062910 tx=0x7f4afc0090f0).stop 2023-08-31T18:48:10.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.851+0000 7f4b16dff700 1 -- 172.21.15.72:0/606487879 shutdown_connections 2023-08-31T18:48:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.851+0000 7f4b16dff700 1 --2- 172.21.15.72:0/606487879 >> v2:172.21.15.146:3300/0 conn(0x7f4b100630b0 0x7f4b10063530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.851+0000 7f4b16dff700 1 --2- 172.21.15.72:0/606487879 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b10153e30 0x7f4b10154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.851+0000 7f4b16dff700 1 --2- 172.21.15.72:0/606487879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b100c5cb0 0x7f4b100c6130 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.851+0000 7f4b16dff700 1 -- 172.21.15.72:0/606487879 >> 172.21.15.72:0/606487879 conn(0x7f4b1005eb20 msgr2=0x7f4b100cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.851+0000 7f4b16dff700 1 -- 172.21.15.72:0/606487879 shutdown_connections 2023-08-31T18:48:10.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.851+0000 7f4b16dff700 1 -- 172.21.15.72:0/606487879 wait complete. 2023-08-31T18:48:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.853+0000 7f4b16dff700 1 Processor -- start 2023-08-31T18:48:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.853+0000 7f4b16dff700 1 -- start start 2023-08-31T18:48:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b16dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b100630b0 0x7f4b100b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b16dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b100c5cb0 0x7f4b10157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b16dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b10153e30 0x7f4b100c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b16dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100b0e00 con 0x7f4b10153e30 2023-08-31T18:48:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b16dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100c3d40 con 0x7f4b100c5cb0 2023-08-31T18:48:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b16dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100c2e50 con 0x7f4b100630b0 2023-08-31T18:48:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b1539c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b10153e30 0x7f4b100c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b1539c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b10153e30 0x7f4b100c41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51590/0 (socket says 172.21.15.72:51590) 2023-08-31T18:48:10.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b1539c700 1 -- 172.21.15.72:0/1472197523 learned_addr learned my addr 172.21.15.72:0/1472197523 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:10.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b0ffff700 1 --2- 172.21.15.72:0/1472197523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b100c5cb0 0x7f4b10157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b14b9b700 1 --2- 172.21.15.72:0/1472197523 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b100630b0 0x7f4b100b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b1539c700 1 -- 172.21.15.72:0/1472197523 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b100630b0 msgr2=0x7f4b100b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:10.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b1539c700 1 --2- 172.21.15.72:0/1472197523 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b100630b0 0x7f4b100b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b1539c700 1 -- 172.21.15.72:0/1472197523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b100c5cb0 msgr2=0x7f4b10157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:10.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b1539c700 1 --2- 172.21.15.72:0/1472197523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b100c5cb0 0x7f4b10157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:10.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b1539c700 1 -- 172.21.15.72:0/1472197523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc009370 con 0x7f4b10153e30 2023-08-31T18:48:10.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b0ffff700 1 --2- 172.21.15.72:0/1472197523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b100c5cb0 0x7f4b10157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:10.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.854+0000 7f4b1539c700 1 --2- 172.21.15.72:0/1472197523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b10153e30 0x7f4b100c41d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f4b08007f20 tx=0x7f4b08009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:10.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.855+0000 7f4b0cff9700 1 -- 172.21.15.72:0/1472197523 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0800ebf0 con 0x7f4b10153e30 2023-08-31T18:48:10.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.855+0000 7f4b0cff9700 1 -- 172.21.15.72:0/1472197523 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0800ed50 con 0x7f4b10153e30 2023-08-31T18:48:10.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.855+0000 7f4b16dff700 1 -- 172.21.15.72:0/1472197523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b100c3130 con 0x7f4b10153e30 2023-08-31T18:48:10.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.855+0000 7f4b0cff9700 1 -- 172.21.15.72:0/1472197523 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08014610 con 0x7f4b10153e30 2023-08-31T18:48:10.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.855+0000 7f4b16dff700 1 -- 172.21.15.72:0/1472197523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b100c36f0 con 0x7f4b10153e30 2023-08-31T18:48:10.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.856+0000 7f4b16dff700 1 -- 172.21.15.72:0/1472197523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b100c3eb0 con 0x7f4b10153e30 2023-08-31T18:48:10.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.857+0000 7f4b0cff9700 1 -- 172.21.15.72:0/1472197523 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f4b08014980 con 0x7f4b10153e30 2023-08-31T18:48:10.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.857+0000 7f4b0cff9700 1 --2- 172.21.15.72:0/1472197523 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4af405ee10 0x7f4af40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:10.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.858+0000 7f4b0cff9700 1 -- 172.21.15.72:0/1472197523 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4b0807a2f0 con 0x7f4b10153e30 2023-08-31T18:48:10.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.858+0000 7f4b14b9b700 1 --2- 172.21.15.72:0/1472197523 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4af405ee10 0x7f4af40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:10.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.858+0000 7f4b14b9b700 1 --2- 172.21.15.72:0/1472197523 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4af405ee10 0x7f4af40612d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f4b1014f4c0 tx=0x7f4b04008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:10.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:10.861+0000 7f4b0cff9700 1 -- 172.21.15.72:0/1472197523 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4b0804b6a0 con 0x7f4b10153e30 2023-08-31T18:48:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.028+0000 7f4b16dff700 1 -- 172.21.15.72:0/1472197523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b10062970 con 0x7f4b10153e30 2023-08-31T18:48:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.028+0000 7f4b0cff9700 1 -- 172.21.15.72:0/1472197523 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b0804ecc0 con 0x7f4b10153e30 2023-08-31T18:48:11.029 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T18:48:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.030+0000 7f4b16dff700 1 -- 172.21.15.72:0/1472197523 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4af405ee10 msgr2=0x7f4af40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.030+0000 7f4b16dff700 1 --2- 172.21.15.72:0/1472197523 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4af405ee10 0x7f4af40612d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f4b1014f4c0 tx=0x7f4b04008040).stop 2023-08-31T18:48:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.030+0000 7f4b16dff700 1 -- 172.21.15.72:0/1472197523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b10153e30 msgr2=0x7f4b100c41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.030+0000 7f4b16dff700 1 --2- 172.21.15.72:0/1472197523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b10153e30 0x7f4b100c41d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f4b08007f20 tx=0x7f4b08009860).stop 2023-08-31T18:48:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.030+0000 7f4b16dff700 1 -- 172.21.15.72:0/1472197523 shutdown_connections 2023-08-31T18:48:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.030+0000 7f4b16dff700 1 --2- 172.21.15.72:0/1472197523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b10153e30 0x7f4b100c41d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.030+0000 7f4b16dff700 1 --2- 172.21.15.72:0/1472197523 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b100630b0 0x7f4b100b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.030+0000 7f4b16dff700 1 --2- 172.21.15.72:0/1472197523 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4af405ee10 0x7f4af40612d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.030+0000 7f4b16dff700 1 --2- 172.21.15.72:0/1472197523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b100c5cb0 0x7f4b10157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.030+0000 7f4b16dff700 1 -- 172.21.15.72:0/1472197523 >> 172.21.15.72:0/1472197523 conn(0x7f4b1005eb20 msgr2=0x7f4b100ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.030+0000 7f4b16dff700 1 -- 172.21.15.72:0/1472197523 shutdown_connections 2023-08-31T18:48:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.030+0000 7f4b16dff700 1 -- 172.21.15.72:0/1472197523 wait complete. 2023-08-31T18:48:11.048 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T18:48:11.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.236+0000 7fb4687ff700 1 Processor -- start 2023-08-31T18:48:11.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.237+0000 7fb4687ff700 1 -- start start 2023-08-31T18:48:11.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.238+0000 7fb4687ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb460154060 0x7fb460157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:11.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.238+0000 7fb4687ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb4600cb9b0 0x7fb4601581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.238+0000 7fb4687ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb460158b40 con 0x7fb4601586b0 2023-08-31T18:48:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.238+0000 7fb4687ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4600c1380 con 0x7fb4600cb9b0 2023-08-31T18:48:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.238+0000 7fb4687ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600c6120 con 0x7fb460154060 2023-08-31T18:48:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.238+0000 7fb46659b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb460154060 0x7fb460157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.238+0000 7fb465d9a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb4600cb9b0 0x7fb4601581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.238+0000 7fb46659b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb460154060 0x7fb460157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:46502/0 (socket says 172.21.15.72:46502) 2023-08-31T18:48:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.238+0000 7fb46659b700 1 -- 172.21.15.72:0/2614521959 learned_addr learned my addr 172.21.15.72:0/2614521959 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:11.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.239+0000 7fb465599700 1 -- 172.21.15.72:0/2614521959 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501710745 0 0) 0x7fb458001490 con 0x7fb4601586b0 2023-08-31T18:48:11.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.239+0000 7fb46659b700 1 -- 172.21.15.72:0/2614521959 >> v2:172.21.15.146:3300/0 conn(0x7fb4600cb9b0 msgr2=0x7fb4601581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:11.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.239+0000 7fb46659b700 1 --2- 172.21.15.72:0/2614521959 >> v2:172.21.15.146:3300/0 conn(0x7fb4600cb9b0 0x7fb4601581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.239+0000 7fb46659b700 1 -- 172.21.15.72:0/2614521959 >> v1:172.21.15.146:6789/0 conn(0x7fb4601586b0 legacy=0x7fb4600c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.239+0000 7fb46659b700 1 -- 172.21.15.72:0/2614521959 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4600c5e10 con 0x7fb460154060 2023-08-31T18:48:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.239+0000 7fb465d9a700 1 --2- 172.21.15.72:0/2614521959 >> v2:172.21.15.146:3300/0 conn(0x7fb4600cb9b0 0x7fb4601581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.239+0000 7fb46659b700 1 --2- 172.21.15.72:0/2614521959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb460154060 0x7fb460157cd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb45c009810 tx=0x7fb45c009060).ready entity=mon.2 client_cookie=581f58b68376693e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:11.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.239+0000 7fb465599700 1 -- 172.21.15.72:0/2614521959 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c005880 con 0x7fb460154060 2023-08-31T18:48:11.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.239+0000 7fb465599700 1 -- 172.21.15.72:0/2614521959 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c0059e0 con 0x7fb460154060 2023-08-31T18:48:11.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.239+0000 7fb465599700 1 -- 172.21.15.72:0/2614521959 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c005d60 con 0x7fb460154060 2023-08-31T18:48:11.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.240+0000 7fb4687ff700 1 -- 172.21.15.72:0/2614521959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb460154060 msgr2=0x7fb460157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:11.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.240+0000 7fb4687ff700 1 --2- 172.21.15.72:0/2614521959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb460154060 0x7fb460157cd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb45c009810 tx=0x7fb45c009060).stop 2023-08-31T18:48:11.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.240+0000 7fb4687ff700 1 -- 172.21.15.72:0/2614521959 shutdown_connections 2023-08-31T18:48:11.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.240+0000 7fb4687ff700 1 --2- 172.21.15.72:0/2614521959 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb460154060 0x7fb460157cd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.240+0000 7fb4687ff700 1 --2- 172.21.15.72:0/2614521959 >> v2:172.21.15.146:3300/0 conn(0x7fb4600cb9b0 0x7fb4601581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.240+0000 7fb4687ff700 1 -- 172.21.15.72:0/2614521959 >> 172.21.15.72:0/2614521959 conn(0x7fb46005e870 msgr2=0x7fb4600cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:11.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.240+0000 7fb4687ff700 1 -- 172.21.15.72:0/2614521959 shutdown_connections 2023-08-31T18:48:11.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.240+0000 7fb4687ff700 1 -- 172.21.15.72:0/2614521959 wait complete. 2023-08-31T18:48:11.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.242+0000 7fb4687ff700 1 Processor -- start 2023-08-31T18:48:11.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.242+0000 7fb4687ff700 1 -- start start 2023-08-31T18:48:11.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb4687ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4600cb9b0 0x7fb46013ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:11.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb4687ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb460154060 0x7fb460140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:11.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb4687ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4601586b0 0x7fb4600ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:11.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb4687ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600ae210 con 0x7fb460154060 2023-08-31T18:48:11.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb4687ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600ae460 con 0x7fb4601586b0 2023-08-31T18:48:11.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb4687ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600ae740 con 0x7fb4600cb9b0 2023-08-31T18:48:11.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb465d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb460154060 0x7fb460140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:11.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb465d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb460154060 0x7fb460140410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51604/0 (socket says 172.21.15.72:51604) 2023-08-31T18:48:11.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb465d9a700 1 -- 172.21.15.72:0/2038753307 learned_addr learned my addr 172.21.15.72:0/2038753307 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:11.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb46659b700 1 --2- 172.21.15.72:0/2038753307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4600cb9b0 0x7fb46013ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:11.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb466d9c700 1 --2- 172.21.15.72:0/2038753307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4601586b0 0x7fb4600ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:11.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb465d9a700 1 -- 172.21.15.72:0/2038753307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4600cb9b0 msgr2=0x7fb46013ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:11.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb465d9a700 1 --2- 172.21.15.72:0/2038753307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4600cb9b0 0x7fb46013ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb465d9a700 1 -- 172.21.15.72:0/2038753307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4601586b0 msgr2=0x7fb4600ac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:11.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb465d9a700 1 --2- 172.21.15.72:0/2038753307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4601586b0 0x7fb4600ac5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.243+0000 7fb465d9a700 1 -- 172.21.15.72:0/2038753307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4500092a0 con 0x7fb460154060 2023-08-31T18:48:11.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.244+0000 7fb465d9a700 1 --2- 172.21.15.72:0/2038753307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb460154060 0x7fb460140410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fb45000ea20 tx=0x7fb450009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:11.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.244+0000 7fb4567fc700 1 -- 172.21.15.72:0/2038753307 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45000ee60 con 0x7fb460154060 2023-08-31T18:48:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.244+0000 7fb4567fc700 1 -- 172.21.15.72:0/2038753307 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45000c850 con 0x7fb460154060 2023-08-31T18:48:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.244+0000 7fb4687ff700 1 -- 172.21.15.72:0/2038753307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c009300 con 0x7fb460154060 2023-08-31T18:48:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.244+0000 7fb4567fc700 1 -- 172.21.15.72:0/2038753307 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45000cbd0 con 0x7fb460154060 2023-08-31T18:48:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.244+0000 7fb4687ff700 1 -- 172.21.15.72:0/2038753307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb460153030 con 0x7fb460154060 2023-08-31T18:48:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.245+0000 7fb4687ff700 1 -- 172.21.15.72:0/2038753307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4600aeb30 con 0x7fb460154060 2023-08-31T18:48:11.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.246+0000 7fb4567fc700 1 -- 172.21.15.72:0/2038753307 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb45001b400 con 0x7fb460154060 2023-08-31T18:48:11.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.247+0000 7fb4567fc700 1 --2- 172.21.15.72:0/2038753307 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb44405ee10 0x7fb4440612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:11.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.247+0000 7fb4567fc700 1 -- 172.21.15.72:0/2038753307 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb45007a330 con 0x7fb460154060 2023-08-31T18:48:11.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.247+0000 7fb46659b700 1 --2- 172.21.15.72:0/2038753307 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb44405ee10 0x7fb4440612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:11.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.248+0000 7fb46659b700 1 --2- 172.21.15.72:0/2038753307 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb44405ee10 0x7fb4440612d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb45c00b340 tx=0x7fb45c016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:11.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.251+0000 7fb4567fc700 1 -- 172.21.15.72:0/2038753307 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb45004b7e0 con 0x7fb460154060 2023-08-31T18:48:11.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.466+0000 7fb4687ff700 1 -- 172.21.15.72:0/2038753307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb46006c6b0 con 0x7fb460154060 2023-08-31T18:48:11.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.466+0000 7fb4567fc700 1 -- 172.21.15.72:0/2038753307 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4483 (secure 0 0 0) 0x7fb45004ee00 con 0x7fb460154060 2023-08-31T18:48:11.467 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:11.467 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/111391994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":111391994},{"type":"v1","addr":"172.21.15.72:6837","nonce":111391994}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/4001102603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4001102603},{"type":"v1","addr":"172.21.15.146:6833","nonce":4001102603}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/522602179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":522602179},{"type":"v1","addr":"172.21.15.72:6835","nonce":522602179}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T18:47:52.970136+0000","modified":"2023-08-31T18:47:55.979886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3888852190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3888852190},{"type":"v1","addr":"172.21.15.146:6835","nonce":3888852190}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-31T18:48:11.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.468+0000 7fb4687ff700 1 -- 172.21.15.72:0/2038753307 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb44405ee10 msgr2=0x7fb4440612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:11.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.468+0000 7fb4687ff700 1 --2- 172.21.15.72:0/2038753307 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb44405ee10 0x7fb4440612d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb45c00b340 tx=0x7fb45c016000).stop 2023-08-31T18:48:11.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.468+0000 7fb4687ff700 1 -- 172.21.15.72:0/2038753307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb460154060 msgr2=0x7fb460140410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:11.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.468+0000 7fb4687ff700 1 --2- 172.21.15.72:0/2038753307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb460154060 0x7fb460140410 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fb45000ea20 tx=0x7fb450009060).stop 2023-08-31T18:48:11.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.468+0000 7fb4687ff700 1 -- 172.21.15.72:0/2038753307 shutdown_connections 2023-08-31T18:48:11.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.468+0000 7fb4687ff700 1 --2- 172.21.15.72:0/2038753307 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb44405ee10 0x7fb4440612d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.468+0000 7fb4687ff700 1 --2- 172.21.15.72:0/2038753307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4601586b0 0x7fb4600ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.468+0000 7fb4687ff700 1 --2- 172.21.15.72:0/2038753307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4600cb9b0 0x7fb46013ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.468+0000 7fb4687ff700 1 --2- 172.21.15.72:0/2038753307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb460154060 0x7fb460140410 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.468+0000 7fb4687ff700 1 -- 172.21.15.72:0/2038753307 >> 172.21.15.72:0/2038753307 conn(0x7fb46005e870 msgr2=0x7fb4601535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:11.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.468+0000 7fb4687ff700 1 -- 172.21.15.72:0/2038753307 shutdown_connections 2023-08-31T18:48:11.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.469+0000 7fb4687ff700 1 -- 172.21.15.72:0/2038753307 wait complete. 2023-08-31T18:48:11.471 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-08-31T18:48:11.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:48:11.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.674+0000 7fb688bff700 1 Processor -- start 2023-08-31T18:48:11.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.674+0000 7fb688bff700 1 -- start start 2023-08-31T18:48:11.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.676+0000 7fb688bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb684154060 0x7fb684157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:11.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.676+0000 7fb688bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6840cb9b0 0x7fb6841581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:11.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.676+0000 7fb688bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6841586b0 0x7fb6840c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:11.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.676+0000 7fb688bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6840c1380 con 0x7fb6841586b0 2023-08-31T18:48:11.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.676+0000 7fb688bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb684158b40 con 0x7fb6840cb9b0 2023-08-31T18:48:11.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.676+0000 7fb688bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840c6120 con 0x7fb684154060 2023-08-31T18:48:11.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.676+0000 7fb682d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6841586b0 0x7fb6840c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:11.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.676+0000 7fb682d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6841586b0 0x7fb6840c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51620/0 (socket says 172.21.15.72:51620) 2023-08-31T18:48:11.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.676+0000 7fb682d9d700 1 -- 172.21.15.72:0/1545166634 learned_addr learned my addr 172.21.15.72:0/1545166634 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:11.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.676+0000 7fb681d9b700 1 --2- 172.21.15.72:0/1545166634 >> v2:172.21.15.146:3300/0 conn(0x7fb6840cb9b0 0x7fb6841581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:11.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.676+0000 7fb68259c700 1 --2- 172.21.15.72:0/1545166634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb684154060 0x7fb684157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:11.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.677+0000 7fb682d9d700 1 -- 172.21.15.72:0/1545166634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb684154060 msgr2=0x7fb684157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:11.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.677+0000 7fb682d9d700 1 --2- 172.21.15.72:0/1545166634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb684154060 0x7fb684157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.677+0000 7fb682d9d700 1 -- 172.21.15.72:0/1545166634 >> v2:172.21.15.146:3300/0 conn(0x7fb6840cb9b0 msgr2=0x7fb6841581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:11.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.677+0000 7fb682d9d700 1 --2- 172.21.15.72:0/1545166634 >> v2:172.21.15.146:3300/0 conn(0x7fb6840cb9b0 0x7fb6841581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.677+0000 7fb682d9d700 1 -- 172.21.15.72:0/1545166634 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840c5e10 con 0x7fb6841586b0 2023-08-31T18:48:11.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.677+0000 7fb682d9d700 1 --2- 172.21.15.72:0/1545166634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6841586b0 0x7fb6840c65b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fb6840c8840 tx=0x7fb67c009840).ready entity=mon.0 client_cookie=b4adbb712127522 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:11.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.677+0000 7fb68159a700 1 -- 172.21.15.72:0/1545166634 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00e070 con 0x7fb6841586b0 2023-08-31T18:48:11.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.677+0000 7fb68159a700 1 -- 172.21.15.72:0/1545166634 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c00ba50 con 0x7fb6841586b0 2023-08-31T18:48:11.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.677+0000 7fb68159a700 1 -- 172.21.15.72:0/1545166634 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00bdd0 con 0x7fb6841586b0 2023-08-31T18:48:11.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.678+0000 7fb688bff700 1 -- 172.21.15.72:0/1545166634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6841586b0 msgr2=0x7fb6840c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:11.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.678+0000 7fb688bff700 1 --2- 172.21.15.72:0/1545166634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6841586b0 0x7fb6840c65b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fb6840c8840 tx=0x7fb67c009840).stop 2023-08-31T18:48:11.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.678+0000 7fb688bff700 1 -- 172.21.15.72:0/1545166634 shutdown_connections 2023-08-31T18:48:11.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.678+0000 7fb688bff700 1 --2- 172.21.15.72:0/1545166634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6841586b0 0x7fb6840c65b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.678+0000 7fb688bff700 1 --2- 172.21.15.72:0/1545166634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb684154060 0x7fb684157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.678+0000 7fb688bff700 1 --2- 172.21.15.72:0/1545166634 >> v2:172.21.15.146:3300/0 conn(0x7fb6840cb9b0 0x7fb6841581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.678+0000 7fb688bff700 1 -- 172.21.15.72:0/1545166634 >> 172.21.15.72:0/1545166634 conn(0x7fb68405e870 msgr2=0x7fb6840cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.678+0000 7fb688bff700 1 -- 172.21.15.72:0/1545166634 shutdown_connections 2023-08-31T18:48:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.678+0000 7fb688bff700 1 -- 172.21.15.72:0/1545166634 wait complete. 2023-08-31T18:48:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.680+0000 7fb688bff700 1 Processor -- start 2023-08-31T18:48:11.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.680+0000 7fb688bff700 1 -- start start 2023-08-31T18:48:11.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.681+0000 7fb688bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6840cb9b0 0x7fb6840acca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:11.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.681+0000 7fb688bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb684154060 0x7fb6840aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:11.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.681+0000 7fb688bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6841586b0 0x7fb6841400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:11.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.681+0000 7fb688bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb684155eb0 con 0x7fb6840cb9b0 2023-08-31T18:48:11.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.681+0000 7fb688bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840ad190 con 0x7fb684154060 2023-08-31T18:48:11.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.681+0000 7fb688bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6841558d0 con 0x7fb6841586b0 2023-08-31T18:48:11.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.681+0000 7fb68259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6840cb9b0 0x7fb6840acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:11.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.681+0000 7fb68259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6840cb9b0 0x7fb6840acca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51630/0 (socket says 172.21.15.72:51630) 2023-08-31T18:48:11.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.682+0000 7fb68259c700 1 -- 172.21.15.72:0/3329798764 learned_addr learned my addr 172.21.15.72:0/3329798764 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:11.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.682+0000 7fb682d9d700 1 --2- 172.21.15.72:0/3329798764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6841586b0 0x7fb6841400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:11.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.682+0000 7fb681d9b700 1 --2- 172.21.15.72:0/3329798764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb684154060 0x7fb6840aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:11.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.682+0000 7fb68259c700 1 -- 172.21.15.72:0/3329798764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6841586b0 msgr2=0x7fb6841400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:11.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.682+0000 7fb68259c700 1 --2- 172.21.15.72:0/3329798764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6841586b0 0x7fb6841400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.682+0000 7fb68259c700 1 -- 172.21.15.72:0/3329798764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb684154060 msgr2=0x7fb6840aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:11.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.682+0000 7fb68259c700 1 --2- 172.21.15.72:0/3329798764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb684154060 0x7fb6840aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.682+0000 7fb68259c700 1 -- 172.21.15.72:0/3329798764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c009ae0 con 0x7fb6840cb9b0 2023-08-31T18:48:11.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.682+0000 7fb68259c700 1 --2- 172.21.15.72:0/3329798764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6840cb9b0 0x7fb6840acca0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fb67400d8c0 tx=0x7fb674008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:11.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.682+0000 7fb6727fc700 1 -- 172.21.15.72:0/3329798764 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6740095b0 con 0x7fb6840cb9b0 2023-08-31T18:48:11.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.682+0000 7fb6727fc700 1 -- 172.21.15.72:0/3329798764 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb674009710 con 0x7fb6840cb9b0 2023-08-31T18:48:11.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.682+0000 7fb688bff700 1 -- 172.21.15.72:0/3329798764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6840aada0 con 0x7fb6840cb9b0 2023-08-31T18:48:11.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.682+0000 7fb6727fc700 1 -- 172.21.15.72:0/3329798764 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674009a90 con 0x7fb6840cb9b0 2023-08-31T18:48:11.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.682+0000 7fb688bff700 1 -- 172.21.15.72:0/3329798764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb684155b40 con 0x7fb6840cb9b0 2023-08-31T18:48:11.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.684+0000 7fb688bff700 1 -- 172.21.15.72:0/3329798764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68406c6b0 con 0x7fb6840cb9b0 2023-08-31T18:48:11.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.684+0000 7fb6727fc700 1 -- 172.21.15.72:0/3329798764 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb674013480 con 0x7fb6840cb9b0 2023-08-31T18:48:11.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.685+0000 7fb6727fc700 1 --2- 172.21.15.72:0/3329798764 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb66405ede0 0x7fb6640612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:11.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.685+0000 7fb6727fc700 1 -- 172.21.15.72:0/3329798764 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb67407a260 con 0x7fb6840cb9b0 2023-08-31T18:48:11.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.685+0000 7fb681d9b700 1 --2- 172.21.15.72:0/3329798764 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb66405ede0 0x7fb6640612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:11.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.686+0000 7fb681d9b700 1 --2- 172.21.15.72:0/3329798764 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb66405ede0 0x7fb6640612a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb684152ae0 tx=0x7fb678008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:11.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.689+0000 7fb6727fc700 1 -- 172.21.15.72:0/3329798764 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb67404b630 con 0x7fb6840cb9b0 2023-08-31T18:48:11.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.857+0000 7fb688bff700 1 -- 172.21.15.72:0/3329798764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6840c0ae0 con 0x7fb6840cb9b0 2023-08-31T18:48:11.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.858+0000 7fb6727fc700 1 -- 172.21.15.72:0/3329798764 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17024 (secure 0 0 0) 0x7fb67404ec50 con 0x7fb6840cb9b0 2023-08-31T18:48:11.860 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:11.860 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:53.972412+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:47:51.003304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-31T18:47:51.950765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:48:11.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.860+0000 7fb688bff700 1 -- 172.21.15.72:0/3329798764 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb66405ede0 msgr2=0x7fb6640612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:11.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.860+0000 7fb688bff700 1 --2- 172.21.15.72:0/3329798764 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb66405ede0 0x7fb6640612a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb684152ae0 tx=0x7fb678008040).stop 2023-08-31T18:48:11.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.860+0000 7fb688bff700 1 -- 172.21.15.72:0/3329798764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6840cb9b0 msgr2=0x7fb6840acca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:11.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.860+0000 7fb688bff700 1 --2- 172.21.15.72:0/3329798764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6840cb9b0 0x7fb6840acca0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fb67400d8c0 tx=0x7fb674008040).stop 2023-08-31T18:48:11.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.860+0000 7fb688bff700 1 -- 172.21.15.72:0/3329798764 shutdown_connections 2023-08-31T18:48:11.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.860+0000 7fb688bff700 1 --2- 172.21.15.72:0/3329798764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6841586b0 0x7fb6841400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.860+0000 7fb688bff700 1 --2- 172.21.15.72:0/3329798764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6840cb9b0 0x7fb6840acca0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.860+0000 7fb688bff700 1 --2- 172.21.15.72:0/3329798764 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb66405ede0 0x7fb6640612a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.860+0000 7fb688bff700 1 --2- 172.21.15.72:0/3329798764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb684154060 0x7fb6840aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:11.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.860+0000 7fb688bff700 1 -- 172.21.15.72:0/3329798764 >> 172.21.15.72:0/3329798764 conn(0x7fb68405e870 msgr2=0x7fb684064880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:11.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.860+0000 7fb688bff700 1 -- 172.21.15.72:0/3329798764 shutdown_connections 2023-08-31T18:48:11.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:11.861+0000 7fb688bff700 1 -- 172.21.15.72:0/3329798764 wait complete. 2023-08-31T18:48:11.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T18:48:12.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.065+0000 7ff124bff700 1 Processor -- start 2023-08-31T18:48:12.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.065+0000 7ff124bff700 1 -- start start 2023-08-31T18:48:12.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.066+0000 7ff124bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200cb9b0 0x7ff1201583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.066+0000 7ff124bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1200c6120 con 0x7ff1201588d0 2023-08-31T18:48:12.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.066+0000 7ff124bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1200c5e10 con 0x7ff120154060 2023-08-31T18:48:12.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.066+0000 7ff124bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1200c1380 con 0x7ff1200cb9b0 2023-08-31T18:48:12.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.067+0000 7ff11ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff1201588d0 0x7ff120154440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36960/0 (socket says 172.21.15.72:36960) 2023-08-31T18:48:12.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.067+0000 7ff11ed9d700 1 -- 172.21.15.72:0/1960530045 learned_addr learned my addr 172.21.15.72:0/1960530045 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.067+0000 7ff11dd9b700 1 --2- 172.21.15.72:0/1960530045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200cb9b0 0x7ff1201583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.067+0000 7ff11d59a700 1 -- 172.21.15.72:0/1960530045 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893975764 0 0) 0x7ff1200c6120 con 0x7ff1201588d0 2023-08-31T18:48:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.067+0000 7ff11d59a700 1 -- 172.21.15.72:0/1960530045 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1080033f0 con 0x7ff1201588d0 2023-08-31T18:48:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.067+0000 7ff11d59a700 1 -- 172.21.15.72:0/1960530045 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970876931 0 0) 0x7ff1200c5e10 con 0x7ff120154060 2023-08-31T18:48:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.067+0000 7ff11d59a700 1 -- 172.21.15.72:0/1960530045 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1200c6120 con 0x7ff120154060 2023-08-31T18:48:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.067+0000 7ff11dd9b700 1 -- 172.21.15.72:0/1960530045 >> v1:172.21.15.146:6789/0 conn(0x7ff120154060 legacy=0x7ff120157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.067+0000 7ff11dd9b700 1 -- 172.21.15.72:0/1960530045 >> v1:172.21.15.72:6789/0 conn(0x7ff1201588d0 legacy=0x7ff120154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.067+0000 7ff11d59a700 1 -- 172.21.15.72:0/1960530045 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3658002192 0 0) 0x7ff1080033f0 con 0x7ff1201588d0 2023-08-31T18:48:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.067+0000 7ff11dd9b700 1 -- 172.21.15.72:0/1960530045 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1200c0ae0 con 0x7ff1200cb9b0 2023-08-31T18:48:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.068+0000 7ff11dd9b700 1 --2- 172.21.15.72:0/1960530045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200cb9b0 0x7ff1201583e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff114009790 tx=0x7ff114009060).ready entity=mon.2 client_cookie=6a5f40c47daefba8 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.068+0000 7ff11d59a700 1 -- 172.21.15.72:0/1960530045 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1180017f0 con 0x7ff1200cb9b0 2023-08-31T18:48:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.068+0000 7ff11d59a700 1 -- 172.21.15.72:0/1960530045 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff114011400 con 0x7ff1200cb9b0 2023-08-31T18:48:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.068+0000 7ff11d59a700 1 -- 172.21.15.72:0/1960530045 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff114011780 con 0x7ff1200cb9b0 2023-08-31T18:48:12.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.068+0000 7ff124bff700 1 -- 172.21.15.72:0/1960530045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200cb9b0 msgr2=0x7ff1201583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.068+0000 7ff124bff700 1 --2- 172.21.15.72:0/1960530045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200cb9b0 0x7ff1201583e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff114009790 tx=0x7ff114009060).stop 2023-08-31T18:48:12.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.068+0000 7ff124bff700 1 -- 172.21.15.72:0/1960530045 shutdown_connections 2023-08-31T18:48:12.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.068+0000 7ff124bff700 1 --2- 172.21.15.72:0/1960530045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200cb9b0 0x7ff1201583e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.068+0000 7ff124bff700 1 -- 172.21.15.72:0/1960530045 >> 172.21.15.72:0/1960530045 conn(0x7ff12005e870 msgr2=0x7ff1200cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:12.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.069+0000 7ff124bff700 1 -- 172.21.15.72:0/1960530045 shutdown_connections 2023-08-31T18:48:12.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.069+0000 7ff124bff700 1 -- 172.21.15.72:0/1960530045 wait complete. 2023-08-31T18:48:12.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.070+0000 7ff124bff700 1 Processor -- start 2023-08-31T18:48:12.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.070+0000 7ff124bff700 1 -- start start 2023-08-31T18:48:12.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.071+0000 7ff124bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200cb9b0 0x7ff120152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.071+0000 7ff124bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff120154060 0x7ff120152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.071+0000 7ff124bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1201588d0 0x7ff120157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.071+0000 7ff124bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff120152830 con 0x7ff1201588d0 2023-08-31T18:48:12.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.071+0000 7ff124bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff120157980 con 0x7ff120154060 2023-08-31T18:48:12.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.071+0000 7ff124bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1200c2890 con 0x7ff1200cb9b0 2023-08-31T18:48:12.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.071+0000 7ff11ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1201588d0 0x7ff120157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.071+0000 7ff11ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1201588d0 0x7ff120157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51644/0 (socket says 172.21.15.72:51644) 2023-08-31T18:48:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.071+0000 7ff11ed9d700 1 -- 172.21.15.72:0/29226072 learned_addr learned my addr 172.21.15.72:0/29226072 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.071+0000 7ff11dd9b700 1 --2- 172.21.15.72:0/29226072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff120154060 0x7ff120152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.071+0000 7ff11e59c700 1 --2- 172.21.15.72:0/29226072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200cb9b0 0x7ff120152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.072+0000 7ff11ed9d700 1 -- 172.21.15.72:0/29226072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200cb9b0 msgr2=0x7ff120152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.072+0000 7ff11ed9d700 1 --2- 172.21.15.72:0/29226072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200cb9b0 0x7ff120152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.072+0000 7ff11ed9d700 1 -- 172.21.15.72:0/29226072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff120154060 msgr2=0x7ff120152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.072+0000 7ff11ed9d700 1 --2- 172.21.15.72:0/29226072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff120154060 0x7ff120152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.072+0000 7ff11ed9d700 1 -- 172.21.15.72:0/29226072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140092a0 con 0x7ff1201588d0 2023-08-31T18:48:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.072+0000 7ff11ed9d700 1 --2- 172.21.15.72:0/29226072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1201588d0 0x7ff120157210 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7ff11800cb70 tx=0x7ff118007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:12.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.072+0000 7ff10e7fc700 1 -- 172.21.15.72:0/29226072 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118007e50 con 0x7ff1201588d0 2023-08-31T18:48:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.072+0000 7ff10e7fc700 1 -- 172.21.15.72:0/29226072 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff118004c40 con 0x7ff1201588d0 2023-08-31T18:48:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.072+0000 7ff124bff700 1 -- 172.21.15.72:0/29226072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff120157700 con 0x7ff1201588d0 2023-08-31T18:48:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.072+0000 7ff10e7fc700 1 -- 172.21.15.72:0/29226072 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118007170 con 0x7ff1201588d0 2023-08-31T18:48:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.072+0000 7ff124bff700 1 -- 172.21.15.72:0/29226072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1200c2240 con 0x7ff1201588d0 2023-08-31T18:48:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.073+0000 7ff124bff700 1 -- 172.21.15.72:0/29226072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1200c2a00 con 0x7ff1201588d0 2023-08-31T18:48:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.074+0000 7ff10e7fc700 1 -- 172.21.15.72:0/29226072 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff118007520 con 0x7ff1201588d0 2023-08-31T18:48:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.075+0000 7ff10e7fc700 1 --2- 172.21.15.72:0/29226072 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff10005ee10 0x7ff1000612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.075+0000 7ff10e7fc700 1 -- 172.21.15.72:0/29226072 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff118079b90 con 0x7ff1201588d0 2023-08-31T18:48:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.075+0000 7ff11e59c700 1 --2- 172.21.15.72:0/29226072 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff10005ee10 0x7ff1000612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.076+0000 7ff11e59c700 1 --2- 172.21.15.72:0/29226072 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff10005ee10 0x7ff1000612d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7ff110003960 tx=0x7ff110007bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.079+0000 7ff10e7fc700 1 -- 172.21.15.72:0/29226072 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff11804af40 con 0x7ff1201588d0 2023-08-31T18:48:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.287+0000 7ff124bff700 1 -- 172.21.15.72:0/29226072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff12006c6b0 con 0x7ff1201588d0 2023-08-31T18:48:12.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.287+0000 7ff10e7fc700 1 -- 172.21.15.72:0/29226072 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4483 (secure 0 0 0) 0x7ff11804e560 con 0x7ff1201588d0 2023-08-31T18:48:12.288 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:12.289 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/111391994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":111391994},{"type":"v1","addr":"172.21.15.72:6837","nonce":111391994}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/4001102603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4001102603},{"type":"v1","addr":"172.21.15.146:6833","nonce":4001102603}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/522602179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":522602179},{"type":"v1","addr":"172.21.15.72:6835","nonce":522602179}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T18:47:52.970136+0000","modified":"2023-08-31T18:47:55.979886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3888852190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3888852190},{"type":"v1","addr":"172.21.15.146:6835","nonce":3888852190}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-31T18:48:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.289+0000 7ff124bff700 1 -- 172.21.15.72:0/29226072 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff10005ee10 msgr2=0x7ff1000612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.289+0000 7ff124bff700 1 --2- 172.21.15.72:0/29226072 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff10005ee10 0x7ff1000612d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7ff110003960 tx=0x7ff110007bc0).stop 2023-08-31T18:48:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.289+0000 7ff124bff700 1 -- 172.21.15.72:0/29226072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1201588d0 msgr2=0x7ff120157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.289+0000 7ff124bff700 1 --2- 172.21.15.72:0/29226072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1201588d0 0x7ff120157210 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7ff11800cb70 tx=0x7ff118007af0).stop 2023-08-31T18:48:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.289+0000 7ff124bff700 1 -- 172.21.15.72:0/29226072 shutdown_connections 2023-08-31T18:48:12.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.290+0000 7ff124bff700 1 --2- 172.21.15.72:0/29226072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1201588d0 0x7ff120157210 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.290+0000 7ff124bff700 1 --2- 172.21.15.72:0/29226072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1200cb9b0 0x7ff120152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.290+0000 7ff124bff700 1 --2- 172.21.15.72:0/29226072 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff10005ee10 0x7ff1000612d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.290+0000 7ff124bff700 1 --2- 172.21.15.72:0/29226072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff120154060 0x7ff120152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.290+0000 7ff124bff700 1 -- 172.21.15.72:0/29226072 >> 172.21.15.72:0/29226072 conn(0x7ff12005e870 msgr2=0x7ff120063e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:12.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.290+0000 7ff124bff700 1 -- 172.21.15.72:0/29226072 shutdown_connections 2023-08-31T18:48:12.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.290+0000 7ff124bff700 1 -- 172.21.15.72:0/29226072 wait complete. 2023-08-31T18:48:12.294 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-08-31T18:48:12.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T18:47:52.970136+0000', 'modified': '2023-08-31T18:47:55.979886+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4270': {'gid': 4270, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6835/3888852190', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 3888852190}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3888852190}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-31T18:48:12.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T18:48:12.711 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-31T18:48:12.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.901+0000 7f3fc17ff700 1 Processor -- start 2023-08-31T18:48:12.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.901+0000 7f3fc17ff700 1 -- start start 2023-08-31T18:48:12.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.902+0000 7f3fc17ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fbc0c8ee0 0x7f3fbc154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.902+0000 7f3fc17ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3fbc0ca4f0 0x7f3fbc063100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.902+0000 7f3fc17ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fbc0c9450 con 0x7f3fbc153ca0 2023-08-31T18:48:12.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.902+0000 7f3fc17ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fbc0c9730 con 0x7f3fbc0ca4f0 2023-08-31T18:48:12.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.902+0000 7f3fc17ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0c9a10 con 0x7f3fbc0c8ee0 2023-08-31T18:48:12.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.902+0000 7f3fbaffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3fbc153ca0 0x7f3fbc158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59084/0 (socket says 172.21.15.72:59084) 2023-08-31T18:48:12.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.902+0000 7f3fbaffd700 1 -- 172.21.15.72:0/2478953381 learned_addr learned my addr 172.21.15.72:0/2478953381 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:12.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.903+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/2478953381 >> v2:172.21.15.146:3300/0 conn(0x7f3fbc0ca4f0 0x7f3fbc063100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.903+0000 7f3fba7fc700 1 --2- 172.21.15.72:0/2478953381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fbc0c8ee0 0x7f3fbc154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.903+0000 7f3fb9ffb700 1 -- 172.21.15.72:0/2478953381 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240318834 0 0) 0x7f3fbc0c9450 con 0x7f3fbc153ca0 2023-08-31T18:48:12.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.903+0000 7f3fb9ffb700 1 -- 172.21.15.72:0/2478953381 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fa40033f0 con 0x7f3fbc153ca0 2023-08-31T18:48:12.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.903+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/2478953381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fbc0c8ee0 msgr2=0x7f3fbc154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:12.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.903+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/2478953381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fbc0c8ee0 0x7f3fbc154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.903+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/2478953381 >> v1:172.21.15.72:6789/0 conn(0x7f3fbc153ca0 legacy=0x7f3fbc158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.903+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/2478953381 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc0c9cf0 con 0x7f3fbc0ca4f0 2023-08-31T18:48:12.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.903+0000 7f3fba7fc700 1 --2- 172.21.15.72:0/2478953381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fbc0c8ee0 0x7f3fbc154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:12.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.903+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/2478953381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fbc0ca4f0 0x7f3fbc063100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3fb4009e60 tx=0x7f3fb4009780).ready entity=mon.1 client_cookie=9b690007a7608545 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:12.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.903+0000 7f3fb9ffb700 1 -- 172.21.15.72:0/2478953381 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb400e070 con 0x7f3fbc0ca4f0 2023-08-31T18:48:12.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.904+0000 7f3fb9ffb700 1 -- 172.21.15.72:0/2478953381 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb400bab0 con 0x7f3fbc0ca4f0 2023-08-31T18:48:12.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.904+0000 7f3fb9ffb700 1 -- 172.21.15.72:0/2478953381 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb400be30 con 0x7f3fbc0ca4f0 2023-08-31T18:48:12.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.904+0000 7f3fc17ff700 1 -- 172.21.15.72:0/2478953381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fbc0ca4f0 msgr2=0x7f3fbc063100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.904+0000 7f3fc17ff700 1 --2- 172.21.15.72:0/2478953381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fbc0ca4f0 0x7f3fbc063100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3fb4009e60 tx=0x7f3fb4009780).stop 2023-08-31T18:48:12.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.904+0000 7f3fc17ff700 1 -- 172.21.15.72:0/2478953381 shutdown_connections 2023-08-31T18:48:12.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.904+0000 7f3fc17ff700 1 --2- 172.21.15.72:0/2478953381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fbc0ca4f0 0x7f3fbc063100 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.904+0000 7f3fc17ff700 1 --2- 172.21.15.72:0/2478953381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fbc0c8ee0 0x7f3fbc154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.904+0000 7f3fc17ff700 1 -- 172.21.15.72:0/2478953381 >> 172.21.15.72:0/2478953381 conn(0x7f3fbc0cadb0 msgr2=0x7f3fbc0cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:12.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.904+0000 7f3fc17ff700 1 -- 172.21.15.72:0/2478953381 shutdown_connections 2023-08-31T18:48:12.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.904+0000 7f3fc17ff700 1 -- 172.21.15.72:0/2478953381 wait complete. 2023-08-31T18:48:12.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.906+0000 7f3fc17ff700 1 Processor -- start 2023-08-31T18:48:12.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.906+0000 7f3fc17ff700 1 -- start start 2023-08-31T18:48:12.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fc17ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fbc0c8ee0 0x7f3fbc150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fc17ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fbc0ca4f0 0x7f3fbc0aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fc17ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fbc153ca0 0x7f3fbc0ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fc17ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0ab5c0 con 0x7f3fbc153ca0 2023-08-31T18:48:12.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fc17ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc152ab0 con 0x7f3fbc0c8ee0 2023-08-31T18:48:12.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fc17ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc151f00 con 0x7f3fbc0ca4f0 2023-08-31T18:48:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fbb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fbc153ca0 0x7f3fbc0ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fbb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fbc153ca0 0x7f3fbc0ab0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39738/0 (socket says 172.21.15.72:39738) 2023-08-31T18:48:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/1911595454 learned_addr learned my addr 172.21.15.72:0/1911595454 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fba7fc700 1 --2- 172.21.15.72:0/1911595454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fbc0ca4f0 0x7f3fbc0aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fbaffd700 1 --2- 172.21.15.72:0/1911595454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fbc0c8ee0 0x7f3fbc150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/1911595454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fbc0ca4f0 msgr2=0x7f3fbc0aabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/1911595454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fbc0ca4f0 0x7f3fbc0aabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/1911595454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fbc0c8ee0 msgr2=0x7f3fbc150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/1911595454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fbc0c8ee0 0x7f3fbc150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/1911595454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb00092a0 con 0x7f3fbc153ca0 2023-08-31T18:48:12.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fbaffd700 1 --2- 172.21.15.72:0/1911595454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fbc0c8ee0 0x7f3fbc150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:12.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.907+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/1911595454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fbc153ca0 0x7f3fbc0ab0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f3fb4013cc0 tx=0x7f3fb4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:12.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.908+0000 7f3fa2ffd700 1 -- 172.21.15.72:0/1911595454 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb401d630 con 0x7f3fbc153ca0 2023-08-31T18:48:12.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.908+0000 7f3fa2ffd700 1 -- 172.21.15.72:0/1911595454 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb401d790 con 0x7f3fbc153ca0 2023-08-31T18:48:12.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.908+0000 7f3fa2ffd700 1 -- 172.21.15.72:0/1911595454 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb401db50 con 0x7f3fbc153ca0 2023-08-31T18:48:12.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.908+0000 7f3fc17ff700 1 -- 172.21.15.72:0/1911595454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb4009a20 con 0x7f3fbc153ca0 2023-08-31T18:48:12.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.908+0000 7f3fc17ff700 1 -- 172.21.15.72:0/1911595454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fbc152180 con 0x7f3fbc153ca0 2023-08-31T18:48:12.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.910+0000 7f3fa2ffd700 1 -- 172.21.15.72:0/1911595454 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3fb4003040 con 0x7f3fbc153ca0 2023-08-31T18:48:12.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.910+0000 7f3fa2ffd700 1 --2- 172.21.15.72:0/1911595454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3fa805ee10 0x7f3fa80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.911+0000 7f3fa2ffd700 1 -- 172.21.15.72:0/1911595454 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3fb407bc80 con 0x7f3fbc153ca0 2023-08-31T18:48:12.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.911+0000 7f3fbaffd700 1 --2- 172.21.15.72:0/1911595454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3fa805ee10 0x7f3fa80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.911+0000 7f3fbaffd700 1 --2- 172.21.15.72:0/1911595454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3fa805ee10 0x7f3fa80612d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3fac005750 tx=0x7f3fac009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:12.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.913+0000 7f3fd8afbb80 1 Processor -- start 2023-08-31T18:48:12.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.913+0000 7f3fd8afbb80 1 -- start start 2023-08-31T18:48:12.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fd8afbb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 0x555dc75db6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fd8afbb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc7623f60 0x555dc75d6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fd8afbb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc75d6af0 0x555dc75d6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fd8afbb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dc7517db0 con 0x555dc75d6af0 2023-08-31T18:48:12.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fd8afbb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dc752d030 con 0x555dc7623f60 2023-08-31T18:48:12.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fd8afbb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dc752d170 con 0x555dc75db2c0 2023-08-31T18:48:12.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fbb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc75d6af0 0x555dc75d6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fbb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc75d6af0 0x555dc75d6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39742/0 (socket says 172.21.15.72:39742) 2023-08-31T18:48:12.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/2453836401 learned_addr learned my addr 172.21.15.72:0/2453836401 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:12.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fba7fc700 1 --2- 172.21.15.72:0/2453836401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc7623f60 0x555dc75d6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fbaffd700 1 --2- 172.21.15.72:0/2453836401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 0x555dc75db6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/2453836401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 msgr2=0x555dc75db6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/2453836401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 0x555dc75db6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/2453836401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc7623f60 msgr2=0x555dc75d6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:12.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/2453836401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc7623f60 0x555dc75d6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/2453836401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dc74ffb00 con 0x555dc75d6af0 2023-08-31T18:48:12.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fbaffd700 1 --2- 172.21.15.72:0/2453836401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 0x555dc75db6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:12.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.914+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/2453836401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc75d6af0 0x555dc75d6f70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f3fb400b670 tx=0x7f3fb400e000).ready entity=mon.0 client_cookie=4e757c274c7f70ff server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:12.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.915+0000 7f3fa0ff9700 1 -- 172.21.15.72:0/2453836401 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4050c90 con 0x555dc75d6af0 2023-08-31T18:48:12.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.915+0000 7f3fa0ff9700 1 -- 172.21.15.72:0/2453836401 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb404f090 con 0x555dc75d6af0 2023-08-31T18:48:12.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.915+0000 7f3fa0ff9700 1 -- 172.21.15.72:0/2453836401 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4056250 con 0x555dc75d6af0 2023-08-31T18:48:12.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.915+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/2453836401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc75d6af0 msgr2=0x555dc75d6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.915+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/2453836401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc75d6af0 0x555dc75d6f70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f3fb400b670 tx=0x7f3fb400e000).stop 2023-08-31T18:48:12.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.915+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/2453836401 shutdown_connections 2023-08-31T18:48:12.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.915+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/2453836401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc75d6af0 0x555dc75d6f70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.915+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/2453836401 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 0x555dc75db6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.915+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/2453836401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc7623f60 0x555dc75d6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.915+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/2453836401 >> 172.21.15.72:0/2453836401 conn(0x555dc7445940 msgr2=0x555dc76243f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:12.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.915+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/2453836401 shutdown_connections 2023-08-31T18:48:12.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.915+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/2453836401 wait complete. 2023-08-31T18:48:12.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.916+0000 7f3fd8afbb80 1 -- start start 2023-08-31T18:48:12.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.916+0000 7f3fd8afbb80 1 Processor -- start 2023-08-31T18:48:12.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.917+0000 7f3fd8afbb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75d6af0 0x555dc7620d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.917+0000 7f3fd8afbb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 0x555dc7621210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.917+0000 7f3fd8afbb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc7623f60 0x555dc7609a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.917+0000 7f3fd8afbb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dc752d3f0 con 0x555dc7623f60 2023-08-31T18:48:12.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.917+0000 7f3fd8afbb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dc74f8920 con 0x555dc75d6af0 2023-08-31T18:48:12.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.917+0000 7f3fd8afbb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dc7609110 con 0x555dc75db2c0 2023-08-31T18:48:12.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.918+0000 7f3fd8afbb80 10 client.0 ll_register_callbacks cb 0x555dc74cdce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T18:48:12.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.918+0000 7f3fbb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc7623f60 0x555dc7609a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.918+0000 7f3fbb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc7623f60 0x555dc7609a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39754/0 (socket says 172.21.15.72:39754) 2023-08-31T18:48:12.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.918+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/648154814 learned_addr learned my addr 172.21.15.72:0/648154814 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:12.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.918+0000 7f3fbaffd700 1 --2- 172.21.15.72:0/648154814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75d6af0 0x555dc7620d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.918+0000 7f3fba7fc700 1 --2- 172.21.15.72:0/648154814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 0x555dc7621210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.918+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/648154814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 msgr2=0x555dc7621210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:12.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.918+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/648154814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 0x555dc7621210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.918+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/648154814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75d6af0 msgr2=0x555dc7620d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:12.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.918+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/648154814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75d6af0 0x555dc7620d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.918+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/648154814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fbc152180 con 0x555dc7623f60 2023-08-31T18:48:12.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.918+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/648154814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc7623f60 0x555dc7609a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f3fb404d1f0 tx=0x7f3fb4030000).ready entity=mon.0 client_cookie=1bab3e30a0536b33 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:12.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.918+0000 7f3f997fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T18:48:12.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.918+0000 7f3f997fa700 1 -- 172.21.15.72:0/648154814 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb400e040 con 0x555dc7623f60 2023-08-31T18:48:12.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.918+0000 7f3f997fa700 1 -- 172.21.15.72:0/648154814 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3fb4050c90 con 0x555dc7623f60 2023-08-31T18:48:12.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.919+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/648154814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555dc75d5aa0 con 0x555dc7623f60 2023-08-31T18:48:12.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.919+0000 7f3f997fa700 1 -- 172.21.15.72:0/648154814 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fb40503f0 con 0x555dc7623f60 2023-08-31T18:48:12.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.919+0000 7f3fd8afbb80 10 client.4665 fetch_fsmap learned FSMap version 7 2023-08-31T18:48:12.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.919+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/648154814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x555dc7525f70 con 0x555dc7623f60 2023-08-31T18:48:12.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.919+0000 7f3f997fa700 1 -- 172.21.15.72:0/648154814 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555dc75d5aa0 con 0x555dc7623f60 2023-08-31T18:48:12.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.919+0000 7f3f997fa700 1 -- 172.21.15.72:0/648154814 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3fb4024be0 con 0x555dc7623f60 2023-08-31T18:48:12.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.919+0000 7f3fd8afbb80 10 client.4665 fetch_fsmap finished waiting for FSMap version 7 2023-08-31T18:48:12.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.919+0000 7f3fd8afbb80 10 client.4665 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-31T18:48:12.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.919+0000 7f3fd8afbb80 20 client.4665 populate_metadata read hostname 'smithi072' 2023-08-31T18:48:12.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.919+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/648154814 >> [v2:172.21.15.146:6834/3888852190,v1:172.21.15.146:6835/3888852190] conn(0x555dc7608060 0x555dc7608440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.919+0000 7f3fd8afbb80 4 client.4665 mds_command: new command op to 4270 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T18:48:12.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.919+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/648154814 --> [v2:172.21.15.146:6834/3888852190,v1:172.21.15.146:6835/3888852190] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555dc7395ef0 con 0x555dc7608060 2023-08-31T18:48:12.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.920+0000 7f3fbaffd700 1 --2- 172.21.15.72:0/648154814 >> [v2:172.21.15.146:6834/3888852190,v1:172.21.15.146:6835/3888852190] conn(0x555dc7608060 0x555dc7608440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.920+0000 7f3f997fa700 10 client.4665 ms_handle_connect on v2:172.21.15.146:6834/3888852190 2023-08-31T18:48:12.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.920+0000 7f3fbaffd700 1 --2- 172.21.15.72:0/648154814 >> [v2:172.21.15.146:6834/3888852190,v1:172.21.15.146:6835/3888852190] conn(0x555dc7608060 0x555dc7608440 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c78f669590f584e7 server_cookie=4f2b4f978c40e019 in_seq=0 out_seq=0 2023-08-31T18:48:12.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.921+0000 7f3f997fa700 1 -- 172.21.15.72:0/648154814 <== mds.0 v2:172.21.15.146:6834/3888852190 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x555dc7395ef0 con 0x555dc7608060 2023-08-31T18:48:12.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.921+0000 7f3f997fa700 10 client.4665 handle_command_reply: tid=0 2023-08-31T18:48:12.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.921+0000 7f3fd8afbb80 1 client.4665 shutdown 2023-08-31T18:48:12.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.921+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/648154814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc7623f60 msgr2=0x555dc7609a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.921+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/648154814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc7623f60 0x555dc7609a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f3fb404d1f0 tx=0x7f3fb4030000).stop 2023-08-31T18:48:12.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.921+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/648154814 shutdown_connections 2023-08-31T18:48:12.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.921+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/648154814 >> [v2:172.21.15.146:6834/3888852190,v1:172.21.15.146:6835/3888852190] conn(0x555dc7608060 0x555dc7608440 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.921+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/648154814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc7623f60 0x555dc7609a50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.921+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/648154814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75d6af0 0x555dc7620d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.921+0000 7f3f997fa700 0 client.4665 ms_handle_reset on v2:172.21.15.146:6834/3888852190 2023-08-31T18:48:12.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.921+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/648154814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 0x555dc7621210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.921+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/648154814 >> 172.21.15.72:0/648154814 conn(0x555dc7445940 msgr2=0x555dc75d6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:12.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.921+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/648154814 shutdown_connections 2023-08-31T18:48:12.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.921+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/648154814 wait complete. 2023-08-31T18:48:12.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.922+0000 7f3fd8afbb80 20 client.4665 trim_cache size 0 max 16384 2023-08-31T18:48:12.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.938+0000 7f3fd8afbb80 1 Processor -- start 2023-08-31T18:48:12.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.938+0000 7f3fd8afbb80 1 -- start start 2023-08-31T18:48:12.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.939+0000 7f3fd8afbb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75d6af0 0x555dc7602fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.939+0000 7f3fd8afbb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 0x555dc75d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.939+0000 7f3fd8afbb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc7623f60 0x555dc75fbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.939+0000 7f3fd8afbb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dc75dbfe0 con 0x555dc7623f60 2023-08-31T18:48:12.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.939+0000 7f3fd8afbb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dc75d5000 con 0x555dc75d6af0 2023-08-31T18:48:12.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.939+0000 7f3fd8afbb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dc7622eb0 con 0x555dc75db2c0 2023-08-31T18:48:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.939+0000 7f3fbb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc7623f60 0x555dc75fbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.939+0000 7f3fbb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc7623f60 0x555dc75fbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39756/0 (socket says 172.21.15.72:39756) 2023-08-31T18:48:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.939+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/519396080 learned_addr learned my addr 172.21.15.72:0/519396080 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.939+0000 7f3fba7fc700 1 --2- 172.21.15.72:0/519396080 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 0x555dc75d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.939+0000 7f3fbaffd700 1 --2- 172.21.15.72:0/519396080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75d6af0 0x555dc7602fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.940+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/519396080 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 msgr2=0x555dc75d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:12.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.940+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/519396080 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 0x555dc75d1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.940+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/519396080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75d6af0 msgr2=0x555dc7602fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:12.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.940+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/519396080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75d6af0 0x555dc7602fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.940+0000 7f3fbb7fe700 1 -- 172.21.15.72:0/519396080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dc7521580 con 0x555dc7623f60 2023-08-31T18:48:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.940+0000 7f3fba7fc700 1 --2- 172.21.15.72:0/519396080 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 0x555dc75d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.940+0000 7f3fbaffd700 1 --2- 172.21.15.72:0/519396080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75d6af0 0x555dc7602fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.940+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/519396080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc7623f60 0x555dc75fbd70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f3fb40509f0 tx=0x7f3fb4032070).ready entity=mon.0 client_cookie=55f6ae9614a69822 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.940+0000 7f3fa17fa700 1 -- 172.21.15.72:0/519396080 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb40503f0 con 0x555dc7623f60 2023-08-31T18:48:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.940+0000 7f3fa17fa700 1 -- 172.21.15.72:0/519396080 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb4050c90 con 0x555dc7623f60 2023-08-31T18:48:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.940+0000 7f3fa17fa700 1 -- 172.21.15.72:0/519396080 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4024be0 con 0x555dc7623f60 2023-08-31T18:48:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.940+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/519396080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc7623f60 msgr2=0x555dc75fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.940+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/519396080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc7623f60 0x555dc75fbd70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f3fb40509f0 tx=0x7f3fb4032070).stop 2023-08-31T18:48:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.941+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/519396080 shutdown_connections 2023-08-31T18:48:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.941+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/519396080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc7623f60 0x555dc75fbd70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.941+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/519396080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75d6af0 0x555dc7602fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.941+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/519396080 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc75db2c0 0x555dc75d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.941+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/519396080 >> 172.21.15.72:0/519396080 conn(0x555dc7445940 msgr2=0x555dc75d6370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.941+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/519396080 shutdown_connections 2023-08-31T18:48:12.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.941+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/519396080 wait complete. 2023-08-31T18:48:12.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.941+0000 7f3fd8afbb80 1 -- start start 2023-08-31T18:48:12.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.942+0000 7f3fd8afbb80 1 Processor -- start 2023-08-31T18:48:12.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fd8afbb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc75d6af0 0x555dc7684c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fd8afbb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75db2c0 0x555dc7689250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fd8afbb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc7623f60 0x555dc7601be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fd8afbb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dc7608c70 con 0x555dc75d6af0 2023-08-31T18:48:12.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fd8afbb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dc7602860 con 0x555dc75db2c0 2023-08-31T18:48:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fd8afbb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x555dc7608a20 con 0x555dc7623f60 2023-08-31T18:48:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fd8afbb80 10 client.0 ll_register_callbacks cb 0x555dc74cdce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T18:48:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fbaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc75d6af0 0x555dc7684c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fbaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc75d6af0 0x555dc7684c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39758/0 (socket says 172.21.15.72:39758) 2023-08-31T18:48:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fbaffd700 1 -- 172.21.15.72:0/3954817314 learned_addr learned my addr 172.21.15.72:0/3954817314 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fbaffd700 1 -- 172.21.15.72:0/3954817314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc7623f60 msgr2=0x555dc7601be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/3954817314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc7623f60 0x555dc7601be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fba7fc700 1 --2- 172.21.15.72:0/3954817314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75db2c0 0x555dc7689250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fbaffd700 1 --2- 172.21.15.72:0/3954817314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc7623f60 0x555dc7601be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fbaffd700 1 -- 172.21.15.72:0/3954817314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75db2c0 msgr2=0x555dc7689250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fbaffd700 1 --2- 172.21.15.72:0/3954817314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75db2c0 0x555dc7689250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fbaffd700 1 -- 172.21.15.72:0/3954817314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555dc7525f70 con 0x555dc75d6af0 2023-08-31T18:48:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fbb7fe700 1 --2- 172.21.15.72:0/3954817314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc7623f60 0x555dc7601be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fba7fc700 1 --2- 172.21.15.72:0/3954817314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75db2c0 0x555dc7689250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fbaffd700 1 --2- 172.21.15.72:0/3954817314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc75d6af0 0x555dc7684c50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x555dc75fd350 tx=0x7f3fac007000).ready entity=mon.0 client_cookie=feb8c7ef2fbd3126 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:12.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3f997fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T18:48:12.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3f997fa700 1 -- 172.21.15.72:0/3954817314 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac028070 con 0x555dc75d6af0 2023-08-31T18:48:12.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3f997fa700 1 -- 172.21.15.72:0/3954817314 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3fac016a60 con 0x555dc75d6af0 2023-08-31T18:48:12.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.943+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/3954817314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3fb404f090 con 0x555dc75d6af0 2023-08-31T18:48:12.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.944+0000 7f3f997fa700 1 -- 172.21.15.72:0/3954817314 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fac01c040 con 0x555dc75d6af0 2023-08-31T18:48:12.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.944+0000 7f3fd8afbb80 10 client.4671 fetch_fsmap learned FSMap version 7 2023-08-31T18:48:12.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.944+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/3954817314 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x555dc75212d0 con 0x555dc75d6af0 2023-08-31T18:48:12.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.944+0000 7f3f997fa700 1 -- 172.21.15.72:0/3954817314 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb404f090 con 0x555dc75d6af0 2023-08-31T18:48:12.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.944+0000 7f3f997fa700 1 -- 172.21.15.72:0/3954817314 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3fac0234d0 con 0x555dc75d6af0 2023-08-31T18:48:12.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.944+0000 7f3fd8afbb80 10 client.4671 fetch_fsmap finished waiting for FSMap version 7 2023-08-31T18:48:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.944+0000 7f3fd8afbb80 10 client.4671 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-31T18:48:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.944+0000 7f3fd8afbb80 20 client.4671 populate_metadata read hostname 'smithi072' 2023-08-31T18:48:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.944+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/3954817314 >> [v2:172.21.15.146:6834/3888852190,v1:172.21.15.146:6835/3888852190] conn(0x555dc761fb10 0x555dc761fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.944+0000 7f3fd8afbb80 4 client.4671 mds_command: new command op to 4270 tid=0[{"prefix": "status"}] 2023-08-31T18:48:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.944+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/3954817314 --> [v2:172.21.15.146:6834/3888852190,v1:172.21.15.146:6835/3888852190] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555dc73cb040 con 0x555dc761fb10 2023-08-31T18:48:12.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.944+0000 7f3fba7fc700 1 --2- 172.21.15.72:0/3954817314 >> [v2:172.21.15.146:6834/3888852190,v1:172.21.15.146:6835/3888852190] conn(0x555dc761fb10 0x555dc761fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:12.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.945+0000 7f3f997fa700 10 client.4671 ms_handle_connect on v2:172.21.15.146:6834/3888852190 2023-08-31T18:48:12.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.945+0000 7f3fba7fc700 1 --2- 172.21.15.72:0/3954817314 >> [v2:172.21.15.146:6834/3888852190,v1:172.21.15.146:6835/3888852190] conn(0x555dc761fb10 0x555dc761fef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=affb0596526e62b5 server_cookie=27be31a45061f178 in_seq=0 out_seq=0 2023-08-31T18:48:12.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.945+0000 7f3f997fa700 1 -- 172.21.15.72:0/3954817314 <== mds.0 v2:172.21.15.146:6834/3888852190 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x555dc73cb040 con 0x555dc761fb10 2023-08-31T18:48:12.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.945+0000 7f3f997fa700 10 client.4671 handle_command_reply: tid=0 2023-08-31T18:48:12.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.945+0000 7f3fd8afbb80 1 client.4671 shutdown 2023-08-31T18:48:12.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/3954817314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc75d6af0 msgr2=0x555dc7684c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/3954817314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc75d6af0 0x555dc7684c50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x555dc75fd350 tx=0x7f3fac007000).stop 2023-08-31T18:48:12.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/3954817314 shutdown_connections 2023-08-31T18:48:12.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/3954817314 >> [v2:172.21.15.146:6834/3888852190,v1:172.21.15.146:6835/3888852190] conn(0x555dc761fb10 0x555dc761fef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/3954817314 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x555dc7623f60 0x555dc7601be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/3954817314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555dc75d6af0 0x555dc7684c50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3fd8afbb80 1 --2- 172.21.15.72:0/3954817314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555dc75db2c0 0x555dc7689250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/3954817314 >> 172.21.15.72:0/3954817314 conn(0x555dc7445940 msgr2=0x555dc7620ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:12.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3f997fa700 0 client.4671 ms_handle_reset on v2:172.21.15.146:6834/3888852190 2023-08-31T18:48:12.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/3954817314 shutdown_connections 2023-08-31T18:48:12.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3fd8afbb80 1 -- 172.21.15.72:0/3954817314 wait complete. 2023-08-31T18:48:12.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3fd8afbb80 20 client.4671 trim_cache size 0 max 16384 2023-08-31T18:48:12.972 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T18:48:12.972 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "acadb8ca-1685-49e1-a73f-5e9d14d95be9", 2023-08-31T18:48:12.972 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-08-31T18:48:12.973 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4270, 2023-08-31T18:48:12.973 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-08-31T18:48:12.973 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-08-31T18:48:12.973 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-08-31T18:48:12.973 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 19.973071100999999, 2023-08-31T18:48:12.974 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 7, 2023-08-31T18:48:12.974 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 21, 2023-08-31T18:48:12.974 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 21, 2023-08-31T18:48:12.974 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 25.459615495000001 2023-08-31T18:48:12.974 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T18:48:12.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3fc17ff700 1 -- 172.21.15.72:0/1911595454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3fa805ee10 msgr2=0x7f3fa80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3fc17ff700 1 --2- 172.21.15.72:0/1911595454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3fa805ee10 0x7f3fa80612d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3fac005750 tx=0x7f3fac009040).stop 2023-08-31T18:48:12.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3fc17ff700 1 -- 172.21.15.72:0/1911595454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fbc153ca0 msgr2=0x7f3fbc0ab0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:12.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.946+0000 7f3fc17ff700 1 --2- 172.21.15.72:0/1911595454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fbc153ca0 0x7f3fbc0ab0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f3fb4013cc0 tx=0x7f3fb4009780).stop 2023-08-31T18:48:12.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.947+0000 7f3fc17ff700 1 -- 172.21.15.72:0/1911595454 shutdown_connections 2023-08-31T18:48:12.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.947+0000 7f3fc17ff700 1 --2- 172.21.15.72:0/1911595454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fbc153ca0 0x7f3fbc0ab0d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.947+0000 7f3fc17ff700 1 --2- 172.21.15.72:0/1911595454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3fa805ee10 0x7f3fa80612d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.947+0000 7f3fc17ff700 1 --2- 172.21.15.72:0/1911595454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fbc0c8ee0 0x7f3fbc150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.947+0000 7f3fc17ff700 1 --2- 172.21.15.72:0/1911595454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fbc0ca4f0 0x7f3fbc0aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:12.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.947+0000 7f3fc17ff700 1 -- 172.21.15.72:0/1911595454 >> 172.21.15.72:0/1911595454 conn(0x7f3fbc0cadb0 msgr2=0x7f3fbc0ab800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:12.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.947+0000 7f3fc17ff700 1 -- 172.21.15.72:0/1911595454 shutdown_connections 2023-08-31T18:48:12.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:12.947+0000 7f3fc17ff700 1 -- 172.21.15.72:0/1911595454 wait complete. 2023-08-31T18:48:12.979 INFO:teuthology.run_tasks:Running task kclient... 2023-08-31T18:48:13.005 INFO:tasks.kclient:Mounting kernel clients... 2023-08-31T18:48:13.005 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-31T18:48:13.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:13.006 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T18:48:13.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:13.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-08-31T18:48:13.127 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2023-08-31T18:48:13.130 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T18:48:13.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:13.131 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T18:48:13.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:13.177 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-08-31T18:48:13.289 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2023-08-31T18:48:13.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T18:48:13.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:13.292 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-08-31T18:48:13.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:13.345 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-08-31T18:48:13.421 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2023-08-31T18:48:13.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T18:48:13.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:13.425 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-08-31T18:48:13.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:13.473 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-08-31T18:48:13.546 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2023-08-31T18:48:13.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T18:48:13.549 INFO:tasks.kclient:client.0 config is {} 2023-08-31T18:48:13.549 DEBUG:teuthology.orchestra.run.smithi072:> ceph fs ls 2023-08-31T18:48:13.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.707+0000 7fc3fb7ff700 1 Processor -- start 2023-08-31T18:48:13.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.707+0000 7fc3fb7ff700 1 -- start start 2023-08-31T18:48:13.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.708+0000 7fc3fb7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3f4157b00 0x7fc3f40c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:13.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.708+0000 7fc3fb7ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3f40a9d30 0x7fc3f40aa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:13.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.708+0000 7fc3fb7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f40bfd10 con 0x7fc3f4157720 2023-08-31T18:48:13.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.708+0000 7fc3fb7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f40c0b70 con 0x7fc3f4157b00 2023-08-31T18:48:13.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.708+0000 7fc3fb7ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f40aa670 con 0x7fc3f40a9d30 2023-08-31T18:48:13.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.709+0000 7fc3f8d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3f4157b00 0x7fc3f40c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:13.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.709+0000 7fc3f9d9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3f40a9d30 0x7fc3f40aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:13.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.709+0000 7fc3f8d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3f4157b00 0x7fc3f40c7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39766/0 (socket says 172.21.15.72:39766) 2023-08-31T18:48:13.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.709+0000 7fc3f8d9a700 1 -- 172.21.15.72:0/348177004 learned_addr learned my addr 172.21.15.72:0/348177004 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:13.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.709+0000 7fc3f959b700 1 --1- 172.21.15.72:0/348177004 >> v1:172.21.15.72:6789/0 conn(0x7fc3f4157720 0x7fc3f40c1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59100/0 (socket says 172.21.15.72:59100) 2023-08-31T18:48:13.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.709+0000 7fc3f8d9a700 1 -- 172.21.15.72:0/348177004 >> v2:172.21.15.146:3300/0 conn(0x7fc3f40a9d30 msgr2=0x7fc3f40aa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:13.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.709+0000 7fc3f8d9a700 1 --2- 172.21.15.72:0/348177004 >> v2:172.21.15.146:3300/0 conn(0x7fc3f40a9d30 0x7fc3f40aa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:13.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.709+0000 7fc3f8d9a700 1 -- 172.21.15.72:0/348177004 >> v1:172.21.15.72:6789/0 conn(0x7fc3f4157720 legacy=0x7fc3f40c1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:13.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.709+0000 7fc3ebfff700 1 -- 172.21.15.72:0/348177004 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019759408 0 0) 0x7fc3f40bfd10 con 0x7fc3f4157720 2023-08-31T18:48:13.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.709+0000 7fc3f8d9a700 1 -- 172.21.15.72:0/348177004 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f40bff60 con 0x7fc3f4157b00 2023-08-31T18:48:13.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.709+0000 7fc3f9d9c700 1 --2- 172.21.15.72:0/348177004 >> v2:172.21.15.146:3300/0 conn(0x7fc3f40a9d30 0x7fc3f40aa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:13.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.709+0000 7fc3f8d9a700 1 --2- 172.21.15.72:0/348177004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f4157b00 0x7fc3f40c7040 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc3f4065870 tx=0x7fc3e40090f0).ready entity=mon.0 client_cookie=f737150725b2ba63 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:13.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.710+0000 7fc3ebfff700 1 -- 172.21.15.72:0/348177004 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e400b520 con 0x7fc3f4157b00 2023-08-31T18:48:13.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.710+0000 7fc3ebfff700 1 -- 172.21.15.72:0/348177004 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e400b680 con 0x7fc3f4157b00 2023-08-31T18:48:13.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.710+0000 7fc3ebfff700 1 -- 172.21.15.72:0/348177004 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e400ba20 con 0x7fc3f4157b00 2023-08-31T18:48:13.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.710+0000 7fc3fb7ff700 1 -- 172.21.15.72:0/348177004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f4157b00 msgr2=0x7fc3f40c7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:13.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.710+0000 7fc3fb7ff700 1 --2- 172.21.15.72:0/348177004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f4157b00 0x7fc3f40c7040 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc3f4065870 tx=0x7fc3e40090f0).stop 2023-08-31T18:48:13.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.710+0000 7fc3fb7ff700 1 -- 172.21.15.72:0/348177004 shutdown_connections 2023-08-31T18:48:13.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.710+0000 7fc3fb7ff700 1 --2- 172.21.15.72:0/348177004 >> v2:172.21.15.146:3300/0 conn(0x7fc3f40a9d30 0x7fc3f40aa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:13.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.710+0000 7fc3fb7ff700 1 --2- 172.21.15.72:0/348177004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f4157b00 0x7fc3f40c7040 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:13.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.710+0000 7fc3fb7ff700 1 -- 172.21.15.72:0/348177004 >> 172.21.15.72:0/348177004 conn(0x7fc3f406a560 msgr2=0x7fc3f40cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:13.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.710+0000 7fc3fb7ff700 1 -- 172.21.15.72:0/348177004 shutdown_connections 2023-08-31T18:48:13.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.710+0000 7fc3fb7ff700 1 -- 172.21.15.72:0/348177004 wait complete. 2023-08-31T18:48:13.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.712+0000 7fc3fb7ff700 1 Processor -- start 2023-08-31T18:48:13.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.712+0000 7fc3fb7ff700 1 -- start start 2023-08-31T18:48:13.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3fb7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f40a9d30 0x7fc3f414ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:13.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3fb7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3f4157720 0x7fc3f4153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:13.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3fb7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3f4157b00 0x7fc3f4154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:13.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3fb7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40b0cd0 con 0x7fc3f40a9d30 2023-08-31T18:48:13.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3fb7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4155130 con 0x7fc3f4157b00 2023-08-31T18:48:13.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3fb7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40c8650 con 0x7fc3f4157720 2023-08-31T18:48:13.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3f959b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f40a9d30 0x7fc3f414ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:13.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3f959b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f40a9d30 0x7fc3f414ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39770/0 (socket says 172.21.15.72:39770) 2023-08-31T18:48:13.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3f959b700 1 -- 172.21.15.72:0/1524384542 learned_addr learned my addr 172.21.15.72:0/1524384542 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:13.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3f9d9c700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3f4157b00 0x7fc3f4154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:13.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3f8d9a700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3f4157720 0x7fc3f4153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:13.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3f959b700 1 -- 172.21.15.72:0/1524384542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3f4157720 msgr2=0x7fc3f4153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:13.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3f959b700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3f4157720 0x7fc3f4153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:13.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3f959b700 1 -- 172.21.15.72:0/1524384542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3f4157b00 msgr2=0x7fc3f4154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:13.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3f959b700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3f4157b00 0x7fc3f4154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:13.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3f959b700 1 -- 172.21.15.72:0/1524384542 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec009a20 con 0x7fc3f40a9d30 2023-08-31T18:48:13.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3f9d9c700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3f4157b00 0x7fc3f4154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:13.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3f8d9a700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3f4157720 0x7fc3f4153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:13.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.713+0000 7fc3f959b700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f40a9d30 0x7fc3f414ec40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fc3f000c4c0 tx=0x7fc3f0007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:13.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.714+0000 7fc3e97fa700 1 -- 172.21.15.72:0/1524384542 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f00072e0 con 0x7fc3f40a9d30 2023-08-31T18:48:13.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.714+0000 7fc3e97fa700 1 -- 172.21.15.72:0/1524384542 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f0007440 con 0x7fc3f40a9d30 2023-08-31T18:48:13.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.714+0000 7fc3e97fa700 1 -- 172.21.15.72:0/1524384542 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0005930 con 0x7fc3f40a9d30 2023-08-31T18:48:13.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.714+0000 7fc3fb7ff700 1 -- 172.21.15.72:0/1524384542 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e4009370 con 0x7fc3f40a9d30 2023-08-31T18:48:13.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.714+0000 7fc3fb7ff700 1 -- 172.21.15.72:0/1524384542 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f40b01f0 con 0x7fc3f40a9d30 2023-08-31T18:48:13.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.715+0000 7fc3fb7ff700 1 -- 172.21.15.72:0/1524384542 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f4083290 con 0x7fc3f40a9d30 2023-08-31T18:48:13.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.716+0000 7fc3e97fa700 1 -- 172.21.15.72:0/1524384542 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc3f0005d20 con 0x7fc3f40a9d30 2023-08-31T18:48:13.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.717+0000 7fc3e97fa700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc3d805ee10 0x7fc3d80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:13.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.717+0000 7fc3e97fa700 1 -- 172.21.15.72:0/1524384542 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc3f0079540 con 0x7fc3f40a9d30 2023-08-31T18:48:13.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.717+0000 7fc3f8d9a700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc3d805ee10 0x7fc3d80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:13.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.717+0000 7fc3f8d9a700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc3d805ee10 0x7fc3d80612d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc3e400b2e0 tx=0x7fc3e4017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:13.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.721+0000 7fc3e97fa700 1 -- 172.21.15.72:0/1524384542 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc3f004aa60 con 0x7fc3f40a9d30 2023-08-31T18:48:13.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.930+0000 7fc3fb7ff700 1 -- 172.21.15.72:0/1524384542 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc3f4047480 con 0x7fc3f40a9d30 2023-08-31T18:48:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.930+0000 7fc3e97fa700 1 -- 172.21.15.72:0/1524384542 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc3f004e080 con 0x7fc3f40a9d30 2023-08-31T18:48:13.931 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T18:48:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.932+0000 7fc3fb7ff700 1 -- 172.21.15.72:0/1524384542 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc3d805ee10 msgr2=0x7fc3d80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.932+0000 7fc3fb7ff700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc3d805ee10 0x7fc3d80612d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc3e400b2e0 tx=0x7fc3e4017000).stop 2023-08-31T18:48:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.932+0000 7fc3fb7ff700 1 -- 172.21.15.72:0/1524384542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f40a9d30 msgr2=0x7fc3f414ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:13.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.932+0000 7fc3fb7ff700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f40a9d30 0x7fc3f414ec40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fc3f000c4c0 tx=0x7fc3f0007de0).stop 2023-08-31T18:48:13.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.932+0000 7fc3fb7ff700 1 -- 172.21.15.72:0/1524384542 shutdown_connections 2023-08-31T18:48:13.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.932+0000 7fc3fb7ff700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc3d805ee10 0x7fc3d80612d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:13.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.932+0000 7fc3fb7ff700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3f4157b00 0x7fc3f4154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:13.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.932+0000 7fc3fb7ff700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f40a9d30 0x7fc3f414ec40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:13.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.932+0000 7fc3fb7ff700 1 --2- 172.21.15.72:0/1524384542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3f4157720 0x7fc3f4153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:13.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.932+0000 7fc3fb7ff700 1 -- 172.21.15.72:0/1524384542 >> 172.21.15.72:0/1524384542 conn(0x7fc3f406a560 msgr2=0x7fc3f4159100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:13.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.933+0000 7fc3fb7ff700 1 -- 172.21.15.72:0/1524384542 shutdown_connections 2023-08-31T18:48:13.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:13.933+0000 7fc3fb7ff700 1 -- 172.21.15.72:0/1524384542 wait complete. 2023-08-31T18:48:13.948 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T18:48:13.949 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T18:48:13.949 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-31T18:48:13.950 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T18:48:13.950 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T18:48:13.950 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T18:48:13.951 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T18:48:13.951 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T18:48:13.951 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T18:48:13.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:13.952 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-31T18:48:13.998 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T18:48:13.999 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T18:48:13.999 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T18:48:13.999 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:13.999 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-31T18:48:14.000 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:14.000 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T18:48:14.000 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:14.000 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-31T18:48:14.000 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T18:48:14.001 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:14.001 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-31T18:48:14.001 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T18:48:14.001 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:14.001 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T18:48:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T18:48:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 37982sec preferred_lft 37982sec 2023-08-31T18:48:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-31T18:48:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:14.003 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-31T18:48:14.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:14.004 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T18:48:14.004 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T18:48:14.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2023-08-31T18:48:14.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2023-08-31T18:48:14.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2023-08-31T18:48:14.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-31T18:48:14.006 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T18:48:14.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:14.539 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T18:48:14.648 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-31T18:48:14.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:14.651 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-31T18:48:14.729 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-31T18:48:14.729 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T18:48:14.730 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T18:48:14.730 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T18:48:14.730 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T18:48:14.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:14.731 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T18:48:14.731 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T18:48:14.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T18:48:14.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T18:48:14.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T18:48:14.732 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T18:48:15.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:15.663 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T18:48:15.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:15.711 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-08-31T18:48:15.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:15.759 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T18:48:15.759 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T18:48:15.759 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T18:48:15.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-31T18:48:15.760 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T18:48:15.939 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-31T18:48:15.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:15.940 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T18:48:15.940 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T18:48:15.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-31T18:48:15.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-31T18:48:15.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-31T18:48:15.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-31T18:48:15.942 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-31T18:48:15.942 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T18:48:16.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:16.214 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T18:48:16.214 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T18:48:16.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-08-31T18:48:16.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2023-08-31T18:48:16.215 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T18:48:16.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:16.388 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-31T18:48:16.434 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-31T18:48:16.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T18:48:16.574 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T18:48:16.574 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T18:48:17.252 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T18:48:17.253 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T18:48:17.257 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-31T18:48:17.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:17.258 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T18:48:17.330 INFO:tasks.kclient:client.2 config is {} 2023-08-31T18:48:17.330 DEBUG:teuthology.orchestra.run.smithi072:> ceph fs ls 2023-08-31T18:48:17.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.488+0000 7fb8d11ff700 1 Processor -- start 2023-08-31T18:48:17.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.488+0000 7fb8d11ff700 1 -- start start 2023-08-31T18:48:17.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.489+0000 7fb8d11ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8cc0ca510 0x7fb8cc0a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:17.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.489+0000 7fb8d11ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8cc0ca080 con 0x7fb8cc0a7fe0 2023-08-31T18:48:17.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.489+0000 7fb8d11ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8cc0c72d0 con 0x7fb8cc154460 2023-08-31T18:48:17.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.489+0000 7fb8d11ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0c9750 con 0x7fb8cc0ca510 2023-08-31T18:48:17.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.489+0000 7fb8cb59e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb8cc0a7fe0 0x7fb8cc0c5f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59106/0 (socket says 172.21.15.72:59106) 2023-08-31T18:48:17.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8cb59e700 1 -- 172.21.15.72:0/4238136069 learned_addr learned my addr 172.21.15.72:0/4238136069 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:17.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8ca59c700 1 --2- 172.21.15.72:0/4238136069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8cc0ca510 0x7fb8cc0a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:17.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882371682 0 0) 0x7fb8cc0ca080 con 0x7fb8cc0a7fe0 2023-08-31T18:48:17.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b40033f0 con 0x7fb8cc0a7fe0 2023-08-31T18:48:17.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134929848 0 0) 0x7fb8cc0c72d0 con 0x7fb8cc154460 2023-08-31T18:48:17.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8cc0ca080 con 0x7fb8cc154460 2023-08-31T18:48:17.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2420039172 0 0) 0x7fb8b40033f0 con 0x7fb8cc0a7fe0 2023-08-31T18:48:17.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8cc0ca510 msgr2=0x7fb8cc0a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:17.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 --2- 172.21.15.72:0/4238136069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8cc0ca510 0x7fb8cc0a7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:17.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 >> v1:172.21.15.146:6789/0 conn(0x7fb8cc154460 legacy=0x7fb8cc0c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:17.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc0c9a30 con 0x7fb8cc0a7fe0 2023-08-31T18:48:17.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fb8c40017f0 con 0x7fb8cc0a7fe0 2023-08-31T18:48:17.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8ca59c700 1 --2- 172.21.15.72:0/4238136069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8cc0ca510 0x7fb8cc0a7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:17.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 >> v1:172.21.15.72:6789/0 conn(0x7fb8cc0a7fe0 legacy=0x7fb8cc0c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:17.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 --2- 172.21.15.72:0/4238136069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8cc0ca510 0x7fb8b4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:17.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 --2- 172.21.15.72:0/4238136069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8b4003f90 0x7fb8b4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:17.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 --2- 172.21.15.72:0/4238136069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b4004b80 0x7fb8b4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:17.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0c9750 con 0x7fb8b4004b80 2023-08-31T18:48:17.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b400b940 con 0x7fb8b4003f90 2023-08-31T18:48:17.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.490+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b400bb00 con 0x7fb8cc0ca510 2023-08-31T18:48:17.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.491+0000 7fb8cb59e700 1 --2- 172.21.15.72:0/4238136069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b4004b80 0x7fb8b4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:17.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.491+0000 7fb8cad9d700 1 --2- 172.21.15.72:0/4238136069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8cc0ca510 0x7fb8b4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:17.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.491+0000 7fb8ca59c700 1 --2- 172.21.15.72:0/4238136069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8b4003f90 0x7fb8b4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:17.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.491+0000 7fb8cb59e700 1 -- 172.21.15.72:0/4238136069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8cc0ca510 msgr2=0x7fb8b4003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:17.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.491+0000 7fb8cb59e700 1 --2- 172.21.15.72:0/4238136069 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8cc0ca510 0x7fb8b4003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:17.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.491+0000 7fb8cb59e700 1 -- 172.21.15.72:0/4238136069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8b4003f90 msgr2=0x7fb8b4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:17.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.491+0000 7fb8cb59e700 1 --2- 172.21.15.72:0/4238136069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8b4003f90 0x7fb8b4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:17.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.491+0000 7fb8cb59e700 1 -- 172.21.15.72:0/4238136069 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c00092a0 con 0x7fb8b4004b80 2023-08-31T18:48:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.491+0000 7fb8cb59e700 1 --2- 172.21.15.72:0/4238136069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b4004b80 0x7fb8b4005000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fb8c400c5c0 tx=0x7fb8c4007f40).ready entity=mon.0 client_cookie=c316f4db23f230e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.491+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c400cdc0 con 0x7fb8b4004b80 2023-08-31T18:48:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.491+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c4005b20 con 0x7fb8b4004b80 2023-08-31T18:48:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.491+0000 7fb8c9d9b700 1 -- 172.21.15.72:0/4238136069 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4005ea0 con 0x7fb8b4004b80 2023-08-31T18:48:17.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.492+0000 7fb8d11ff700 1 -- 172.21.15.72:0/4238136069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b4004b80 msgr2=0x7fb8b4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:17.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.492+0000 7fb8d11ff700 1 --2- 172.21.15.72:0/4238136069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b4004b80 0x7fb8b4005000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fb8c400c5c0 tx=0x7fb8c4007f40).stop 2023-08-31T18:48:17.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.492+0000 7fb8cb59e700 1 -- 172.21.15.72:0/4238136069 reap_dead start 2023-08-31T18:48:17.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.492+0000 7fb8d11ff700 1 -- 172.21.15.72:0/4238136069 shutdown_connections 2023-08-31T18:48:17.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.492+0000 7fb8d11ff700 1 -- 172.21.15.72:0/4238136069 >> 172.21.15.72:0/4238136069 conn(0x7fb8cc06a560 msgr2=0x7fb8cc0cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:17.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.492+0000 7fb8d11ff700 1 -- 172.21.15.72:0/4238136069 shutdown_connections 2023-08-31T18:48:17.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.492+0000 7fb8d11ff700 1 -- 172.21.15.72:0/4238136069 wait complete. 2023-08-31T18:48:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.494+0000 7fb8d11ff700 1 Processor -- start 2023-08-31T18:48:17.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.494+0000 7fb8d11ff700 1 -- start start 2023-08-31T18:48:17.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.494+0000 7fb8d11ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b4004b80 0x7fb8cc0c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:17.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8d11ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8cc163d90 0x7fb8cc164f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:17.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8d11ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8cc0ac410 0x7fb8cc0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:17.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8d11ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0c44f0 con 0x7fb8b4004b80 2023-08-31T18:48:17.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8d11ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc164570 con 0x7fb8cc163d90 2023-08-31T18:48:17.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8d11ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc164850 con 0x7fb8cc0ac410 2023-08-31T18:48:17.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8cad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b4004b80 0x7fb8cc0c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:17.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8cad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b4004b80 0x7fb8cc0c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39786/0 (socket says 172.21.15.72:39786) 2023-08-31T18:48:17.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8cad9d700 1 -- 172.21.15.72:0/4081754997 learned_addr learned my addr 172.21.15.72:0/4081754997 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:17.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8ca59c700 1 --2- 172.21.15.72:0/4081754997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8cc163d90 0x7fb8cc164f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:17.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8cb59e700 1 --2- 172.21.15.72:0/4081754997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8cc0ac410 0x7fb8cc0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:17.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8cad9d700 1 -- 172.21.15.72:0/4081754997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8cc0ac410 msgr2=0x7fb8cc0ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:17.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8cad9d700 1 --2- 172.21.15.72:0/4081754997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8cc0ac410 0x7fb8cc0ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:17.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8cad9d700 1 -- 172.21.15.72:0/4081754997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8cc163d90 msgr2=0x7fb8cc164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:17.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8cad9d700 1 --2- 172.21.15.72:0/4081754997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8cc163d90 0x7fb8cc164f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:17.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8cad9d700 1 -- 172.21.15.72:0/4081754997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc164b30 con 0x7fb8b4004b80 2023-08-31T18:48:17.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8cb59e700 1 --2- 172.21.15.72:0/4081754997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8cc0ac410 0x7fb8cc0ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:17.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.495+0000 7fb8cad9d700 1 --2- 172.21.15.72:0/4081754997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b4004b80 0x7fb8cc0c4000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fb8bc002a10 tx=0x7fb8bc007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:17.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.496+0000 7fb8b2ffd700 1 -- 172.21.15.72:0/4081754997 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc007240 con 0x7fb8b4004b80 2023-08-31T18:48:17.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.496+0000 7fb8b2ffd700 1 -- 172.21.15.72:0/4081754997 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8bc0073a0 con 0x7fb8b4004b80 2023-08-31T18:48:17.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.496+0000 7fb8d11ff700 1 -- 172.21.15.72:0/4081754997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8cc0aa9f0 con 0x7fb8b4004b80 2023-08-31T18:48:17.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.496+0000 7fb8b2ffd700 1 -- 172.21.15.72:0/4081754997 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc0066f0 con 0x7fb8b4004b80 2023-08-31T18:48:17.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.496+0000 7fb8d11ff700 1 -- 172.21.15.72:0/4081754997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8cc165450 con 0x7fb8b4004b80 2023-08-31T18:48:17.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.497+0000 7fb8d11ff700 1 -- 172.21.15.72:0/4081754997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8cc164d70 con 0x7fb8b4004b80 2023-08-31T18:48:17.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.498+0000 7fb8b2ffd700 1 -- 172.21.15.72:0/4081754997 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb8bc006a60 con 0x7fb8b4004b80 2023-08-31T18:48:17.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.498+0000 7fb8b2ffd700 1 --2- 172.21.15.72:0/4081754997 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb8b805ee10 0x7fb8b80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:17.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.498+0000 7fb8b2ffd700 1 -- 172.21.15.72:0/4081754997 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb8bc079af0 con 0x7fb8b4004b80 2023-08-31T18:48:17.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.499+0000 7fb8ca59c700 1 --2- 172.21.15.72:0/4081754997 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb8b805ee10 0x7fb8b80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:17.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.499+0000 7fb8ca59c700 1 --2- 172.21.15.72:0/4081754997 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb8b805ee10 0x7fb8b80612d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb8cc0b0f30 tx=0x7fb8c0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:17.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.502+0000 7fb8b2ffd700 1 -- 172.21.15.72:0/4081754997 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb8cc164d70 con 0x7fb8b4004b80 2023-08-31T18:48:17.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.710+0000 7fb8d11ff700 1 -- 172.21.15.72:0/4081754997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb8cc0aa850 con 0x7fb8b4004b80 2023-08-31T18:48:17.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.710+0000 7fb8b2ffd700 1 -- 172.21.15.72:0/4081754997 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb8cc0aa850 con 0x7fb8b4004b80 2023-08-31T18:48:17.711 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T18:48:17.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.712+0000 7fb8d11ff700 1 -- 172.21.15.72:0/4081754997 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb8b805ee10 msgr2=0x7fb8b80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.712+0000 7fb8d11ff700 1 --2- 172.21.15.72:0/4081754997 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb8b805ee10 0x7fb8b80612d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb8cc0b0f30 tx=0x7fb8c0008040).stop 2023-08-31T18:48:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.712+0000 7fb8d11ff700 1 -- 172.21.15.72:0/4081754997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b4004b80 msgr2=0x7fb8cc0c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.712+0000 7fb8d11ff700 1 --2- 172.21.15.72:0/4081754997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b4004b80 0x7fb8cc0c4000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fb8bc002a10 tx=0x7fb8bc007c00).stop 2023-08-31T18:48:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.712+0000 7fb8d11ff700 1 -- 172.21.15.72:0/4081754997 shutdown_connections 2023-08-31T18:48:17.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.712+0000 7fb8d11ff700 1 --2- 172.21.15.72:0/4081754997 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8cc0ac410 0x7fb8cc0ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:17.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.712+0000 7fb8d11ff700 1 --2- 172.21.15.72:0/4081754997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b4004b80 0x7fb8cc0c4000 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:17.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.712+0000 7fb8d11ff700 1 --2- 172.21.15.72:0/4081754997 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb8b805ee10 0x7fb8b80612d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:17.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.712+0000 7fb8d11ff700 1 --2- 172.21.15.72:0/4081754997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8cc163d90 0x7fb8cc164f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:17.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.712+0000 7fb8d11ff700 1 -- 172.21.15.72:0/4081754997 >> 172.21.15.72:0/4081754997 conn(0x7fb8cc06a560 msgr2=0x7fb8cc0a9450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:17.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.712+0000 7fb8d11ff700 1 -- 172.21.15.72:0/4081754997 shutdown_connections 2023-08-31T18:48:17.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:17.712+0000 7fb8d11ff700 1 -- 172.21.15.72:0/4081754997 wait complete. 2023-08-31T18:48:17.727 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T18:48:17.727 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T18:48:17.727 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-31T18:48:17.728 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-31T18:48:17.728 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-31T18:48:17.728 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T18:48:17.728 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T18:48:17.729 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T18:48:17.729 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-31T18:48:17.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:17.730 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-31T18:48:17.776 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T18:48:17.777 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T18:48:17.777 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T18:48:17.777 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:17.777 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-31T18:48:17.777 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:17.778 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T18:48:17.778 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:17.778 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-31T18:48:17.778 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T18:48:17.778 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:17.779 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-31T18:48:17.779 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T18:48:17.779 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:17.779 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T18:48:17.780 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:17.780 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T18:48:17.780 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 37979sec preferred_lft 37979sec 2023-08-31T18:48:17.780 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-31T18:48:17.780 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:17.781 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T18:48:17.781 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e2:e1:71:f6:f6:fa brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:17.781 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T18:48:17.781 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:17.781 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::7c68:c9ff:fe82:9771/64 scope link 2023-08-31T18:48:17.782 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:17.782 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T18:48:17.782 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e2:e1:71:f6:f6:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T18:48:17.782 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e0e1:71ff:fef6:f6fa/64 scope link tentative 2023-08-31T18:48:17.783 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:17.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:17.784 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T18:48:17.851 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-31T18:48:17.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:17.854 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-31T18:48:17.902 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-31T18:48:17.903 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T18:48:17.903 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T18:48:17.903 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T18:48:17.904 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T18:48:17.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:17.905 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T18:48:17.905 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T18:48:17.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T18:48:17.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T18:48:17.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T18:48:17.907 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T18:48:18.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:18.076 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T18:48:18.121 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T18:48:18.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:18.123 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-08-31T18:48:18.208 INFO:teuthology.orchestra.run.smithi072.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-31T18:48:18.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:18.210 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T18:48:18.211 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T18:48:18.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T18:48:18.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-31T18:48:18.212 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T18:48:18.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:18.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-31T18:48:18.463 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T18:48:18.463 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T18:48:18.463 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T18:48:18.464 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:18.464 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-31T18:48:18.464 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:18.464 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T18:48:18.465 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:11:d3:1a:ba:24 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T18:48:18.465 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T18:48:18.465 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:18.465 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::3811:d3ff:fe1a:ba24/64 scope link 2023-08-31T18:48:18.465 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:18.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:18.467 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-31T18:48:18.538 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T18:48:18.539 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T18:48:18.539 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T18:48:18.539 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:18.540 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-31T18:48:18.540 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:18.540 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T18:48:18.540 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:11:d3:1a:ba:24 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T18:48:18.540 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T18:48:18.541 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:18.541 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::3811:d3ff:fe1a:ba24/64 scope link 2023-08-31T18:48:18.541 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:18.542 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-31T18:48:18.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:18.543 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T18:48:18.543 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T18:48:18.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-31T18:48:18.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-31T18:48:18.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-31T18:48:18.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-31T18:48:18.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-31T18:48:18.545 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T18:48:18.611 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:48:18.616 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:48:18.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:18.790 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T18:48:18.790 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T18:48:18.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.1 up 2023-08-31T18:48:18.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.1 master ceph-brx 2023-08-31T18:48:18.791 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T18:48:18.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:18.962 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p /home/ubuntu/cephtest/mnt.2 2023-08-31T18:48:19.009 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-31T18:48:19.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T18:48:19.146 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T18:48:19.147 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T18:48:19.175 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T18:48:19.175 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T18:48:19.180 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-31T18:48:19.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:19.181 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-31T18:48:19.249 INFO:tasks.kclient:client.1 config is {} 2023-08-31T18:48:19.250 DEBUG:teuthology.orchestra.run.smithi146:> ceph fs ls 2023-08-31T18:48:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.419+0000 7f34eb1ff700 1 Processor -- start 2023-08-31T18:48:19.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.420+0000 7f34eb1ff700 1 -- start start 2023-08-31T18:48:19.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.421+0000 7f34eb1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e4149060 0x7f34e40a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:19.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.421+0000 7f34eb1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f34e41530a0 0x7f34e40640d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.421+0000 7f34eb1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34e4067fb0 0x7f34e4068420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.421+0000 7f34eb1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e40bc4a0 con 0x7f34e4067fb0 2023-08-31T18:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.421+0000 7f34eb1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e4068910 con 0x7f34e41530a0 2023-08-31T18:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.421+0000 7f34eb1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e4153520 con 0x7f34e4149060 2023-08-31T18:48:19.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.421+0000 7f34e8f9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e4149060 0x7f34e40a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.421+0000 7f34e3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f34e41530a0 0x7f34e40640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.421+0000 7f34e8f9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e4149060 0x7f34e40a5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:45774/0 (socket says 172.21.15.146:45774) 2023-08-31T18:48:19.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.421+0000 7f34e8f9b700 1 -- 172.21.15.146:0/3776473826 learned_addr learned my addr 172.21.15.146:0/3776473826 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-08-31T18:48:19.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.421+0000 7f34e3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f34e41530a0 0x7f34e40640d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57972/0 (socket says 172.21.15.146:57972) 2023-08-31T18:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.421+0000 7f34e979c700 1 --2- 172.21.15.146:0/3776473826 >> v2:172.21.15.72:3300/0 conn(0x7f34e4067fb0 0x7f34e4068420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.422+0000 7f34e8f9b700 1 -- 172.21.15.146:0/3776473826 >> v2:172.21.15.146:3300/0 conn(0x7f34e41530a0 msgr2=0x7f34e40640d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.422+0000 7f34e8f9b700 1 --2- 172.21.15.146:0/3776473826 >> v2:172.21.15.146:3300/0 conn(0x7f34e41530a0 0x7f34e40640d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:19.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.422+0000 7f34e8f9b700 1 -- 172.21.15.146:0/3776473826 >> v2:172.21.15.72:3300/0 conn(0x7f34e4067fb0 msgr2=0x7f34e4068420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.422+0000 7f34e8f9b700 1 --2- 172.21.15.146:0/3776473826 >> v2:172.21.15.72:3300/0 conn(0x7f34e4067fb0 0x7f34e4068420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.422+0000 7f34e8f9b700 1 -- 172.21.15.146:0/3776473826 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e40a61b0 con 0x7f34e4149060 2023-08-31T18:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.422+0000 7f34e979c700 1 --2- 172.21.15.146:0/3776473826 >> v2:172.21.15.72:3300/0 conn(0x7f34e4067fb0 0x7f34e4068420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.422+0000 7f34e3fff700 1 --2- 172.21.15.146:0/3776473826 >> v2:172.21.15.146:3300/0 conn(0x7f34e41530a0 0x7f34e40640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:19.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.422+0000 7f34e8f9b700 1 --2- 172.21.15.146:0/3776473826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e4149060 0x7f34e40a5b20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f34e4063530 tx=0x7f34d80090f0).ready entity=mon.2 client_cookie=1bff07cf18b7ceda server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:19.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.422+0000 7f34e37fe700 1 -- 172.21.15.146:0/3776473826 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d800b520 con 0x7f34e4149060 2023-08-31T18:48:19.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.422+0000 7f34e37fe700 1 -- 172.21.15.146:0/3776473826 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d800b680 con 0x7f34e4149060 2023-08-31T18:48:19.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.422+0000 7f34e37fe700 1 -- 172.21.15.146:0/3776473826 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d800ba00 con 0x7f34e4149060 2023-08-31T18:48:19.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.423+0000 7f34eb1ff700 1 -- 172.21.15.146:0/3776473826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e4149060 msgr2=0x7f34e40a5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.423+0000 7f34eb1ff700 1 --2- 172.21.15.146:0/3776473826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e4149060 0x7f34e40a5b20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f34e4063530 tx=0x7f34d80090f0).stop 2023-08-31T18:48:19.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.423+0000 7f34eb1ff700 1 -- 172.21.15.146:0/3776473826 shutdown_connections 2023-08-31T18:48:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.423+0000 7f34eb1ff700 1 --2- 172.21.15.146:0/3776473826 >> v2:172.21.15.72:3300/0 conn(0x7f34e4067fb0 0x7f34e4068420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.423+0000 7f34eb1ff700 1 --2- 172.21.15.146:0/3776473826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e4149060 0x7f34e40a5b20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.423+0000 7f34eb1ff700 1 --2- 172.21.15.146:0/3776473826 >> v2:172.21.15.146:3300/0 conn(0x7f34e41530a0 0x7f34e40640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.423+0000 7f34eb1ff700 1 -- 172.21.15.146:0/3776473826 >> 172.21.15.146:0/3776473826 conn(0x7f34e4063120 msgr2=0x7f34e40c6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:19.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.423+0000 7f34eb1ff700 1 -- 172.21.15.146:0/3776473826 shutdown_connections 2023-08-31T18:48:19.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.423+0000 7f34eb1ff700 1 -- 172.21.15.146:0/3776473826 wait complete. 2023-08-31T18:48:19.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.424+0000 7f34eb1ff700 1 Processor -- start 2023-08-31T18:48:19.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.424+0000 7f34eb1ff700 1 -- start start 2023-08-31T18:48:19.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.425+0000 7f34eb1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34e4067fb0 0x7f34e4148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:19.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.425+0000 7f34eb1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4149060 0x7f34e414e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:19.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.425+0000 7f34eb1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e41530a0 0x7f34e414eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:19.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.425+0000 7f34eb1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e41542d0 con 0x7f34e4067fb0 2023-08-31T18:48:19.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.425+0000 7f34eb1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e4148a70 con 0x7f34e4149060 2023-08-31T18:48:19.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.425+0000 7f34eb1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e41536e0 con 0x7f34e41530a0 2023-08-31T18:48:19.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.426+0000 7f34e3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4149060 0x7f34e414e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:19.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.426+0000 7f34e979c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e41530a0 0x7f34e414eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:19.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.426+0000 7f34e3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4149060 0x7f34e414e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57982/0 (socket says 172.21.15.146:57982) 2023-08-31T18:48:19.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.426+0000 7f34e3fff700 1 -- 172.21.15.146:0/1694415887 learned_addr learned my addr 172.21.15.146:0/1694415887 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-08-31T18:48:19.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.426+0000 7f34e8f9b700 1 --2- 172.21.15.146:0/1694415887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34e4067fb0 0x7f34e4148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:19.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.426+0000 7f34e3fff700 1 -- 172.21.15.146:0/1694415887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e41530a0 msgr2=0x7f34e414eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.426+0000 7f34e3fff700 1 --2- 172.21.15.146:0/1694415887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e41530a0 0x7f34e414eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.426+0000 7f34e3fff700 1 -- 172.21.15.146:0/1694415887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34e4067fb0 msgr2=0x7f34e4148580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.426+0000 7f34e3fff700 1 --2- 172.21.15.146:0/1694415887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34e4067fb0 0x7f34e4148580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.426+0000 7f34e3fff700 1 -- 172.21.15.146:0/1694415887 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d00092a0 con 0x7f34e4149060 2023-08-31T18:48:19.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.426+0000 7f34e3fff700 1 --2- 172.21.15.146:0/1694415887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4149060 0x7f34e414e600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f34d000e9d0 tx=0x7f34d0009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.426+0000 7f34e0ff9700 1 -- 172.21.15.146:0/1694415887 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d000c6a0 con 0x7f34e4149060 2023-08-31T18:48:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.426+0000 7f34e0ff9700 1 -- 172.21.15.146:0/1694415887 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d000c800 con 0x7f34e4149060 2023-08-31T18:48:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.426+0000 7f34e0ff9700 1 -- 172.21.15.146:0/1694415887 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d000cb80 con 0x7f34e4149060 2023-08-31T18:48:19.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.426+0000 7f34eb1ff700 1 -- 172.21.15.146:0/1694415887 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d8009370 con 0x7f34e4149060 2023-08-31T18:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.427+0000 7f34eb1ff700 1 -- 172.21.15.146:0/1694415887 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e4153c80 con 0x7f34e4149060 2023-08-31T18:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.428+0000 7f34eb1ff700 1 -- 172.21.15.146:0/1694415887 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e4047480 con 0x7f34e4149060 2023-08-31T18:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.428+0000 7f34e0ff9700 1 -- 172.21.15.146:0/1694415887 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f34d001b400 con 0x7f34e4149060 2023-08-31T18:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.429+0000 7f34e0ff9700 1 --2- 172.21.15.146:0/1694415887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f34c805ede0 0x7f34c80612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:19.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.430+0000 7f34e0ff9700 1 -- 172.21.15.146:0/1694415887 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f34d007a380 con 0x7f34e4149060 2023-08-31T18:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.430+0000 7f34e8f9b700 1 --2- 172.21.15.146:0/1694415887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f34c805ede0 0x7f34c80612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.431+0000 7f34e8f9b700 1 --2- 172.21.15.146:0/1694415887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f34c805ede0 0x7f34c80612a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f34d8009130 tx=0x7f34d8017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:19.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.435+0000 7f34e0ff9700 1 -- 172.21.15.146:0/1694415887 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f34d004b6d0 con 0x7f34e4149060 2023-08-31T18:48:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.646+0000 7f34eb1ff700 1 -- 172.21.15.146:0/1694415887 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f34e40bbb70 con 0x7f34e4149060 2023-08-31T18:48:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.646+0000 7f34e0ff9700 1 -- 172.21.15.146:0/1694415887 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f34d0016020 con 0x7f34e4149060 2023-08-31T18:48:19.647 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T18:48:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.648+0000 7f34eb1ff700 1 -- 172.21.15.146:0/1694415887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f34c805ede0 msgr2=0x7f34c80612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.648+0000 7f34eb1ff700 1 --2- 172.21.15.146:0/1694415887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f34c805ede0 0x7f34c80612a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f34d8009130 tx=0x7f34d8017000).stop 2023-08-31T18:48:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.648+0000 7f34eb1ff700 1 -- 172.21.15.146:0/1694415887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4149060 msgr2=0x7f34e414e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.648+0000 7f34eb1ff700 1 --2- 172.21.15.146:0/1694415887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4149060 0x7f34e414e600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f34d000e9d0 tx=0x7f34d0009060).stop 2023-08-31T18:48:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.648+0000 7f34eb1ff700 1 -- 172.21.15.146:0/1694415887 shutdown_connections 2023-08-31T18:48:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.648+0000 7f34eb1ff700 1 --2- 172.21.15.146:0/1694415887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34e41530a0 0x7f34e414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:19.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.648+0000 7f34eb1ff700 1 --2- 172.21.15.146:0/1694415887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34e4067fb0 0x7f34e4148580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:19.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.648+0000 7f34eb1ff700 1 --2- 172.21.15.146:0/1694415887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f34c805ede0 0x7f34c80612a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:19.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.648+0000 7f34eb1ff700 1 --2- 172.21.15.146:0/1694415887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34e4149060 0x7f34e414e600 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:19.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.648+0000 7f34eb1ff700 1 -- 172.21.15.146:0/1694415887 >> 172.21.15.146:0/1694415887 conn(0x7f34e4063120 msgr2=0x7f34e40c6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.648+0000 7f34eb1ff700 1 -- 172.21.15.146:0/1694415887 shutdown_connections 2023-08-31T18:48:19.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:19.648+0000 7f34eb1ff700 1 -- 172.21.15.146:0/1694415887 wait complete. 2023-08-31T18:48:19.663 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T18:48:19.663 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T18:48:19.664 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-08-31T18:48:19.664 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-31T18:48:19.664 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-31T18:48:19.664 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T18:48:19.664 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T18:48:19.665 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T18:48:19.665 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-31T18:48:19.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:19.666 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-08-31T18:48:19.712 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T18:48:19.713 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T18:48:19.713 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T18:48:19.713 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:19.713 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-08-31T18:48:19.713 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:19.714 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T18:48:19.714 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:19.714 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-08-31T18:48:19.714 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T18:48:19.714 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:19.715 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-08-31T18:48:19.715 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T18:48:19.715 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:19.715 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T18:48:19.715 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:19.716 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T18:48:19.716 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 41959sec preferred_lft 41959sec 2023-08-31T18:48:19.716 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-08-31T18:48:19.716 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:19.717 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-31T18:48:19.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:19.718 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-08-31T18:48:19.718 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-08-31T18:48:19.718 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add name ceph-brx type bridge 2023-08-31T18:48:19.719 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr flush dev ceph-brx 2023-08-31T18:48:19.719 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set ceph-brx up 2023-08-31T18:48:19.719 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-31T18:48:19.720 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-08-31T18:48:20.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:20.456 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T18:48:20.562 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-08-31T18:48:20.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:20.565 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-08-31T18:48:20.640 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-08-31T18:48:20.641 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T18:48:20.641 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T18:48:20.641 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T18:48:20.641 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T18:48:20.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:20.643 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-08-31T18:48:20.643 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-08-31T18:48:20.645 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T18:48:20.645 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T18:48:20.646 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T18:48:20.646 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-08-31T18:48:21.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:21.332 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-08-31T18:48:21.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:21.380 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2023-08-31T18:48:21.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:21.427 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-08-31T18:48:21.428 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-08-31T18:48:21.428 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-31T18:48:21.428 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-31T18:48:21.429 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-08-31T18:48:21.611 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-31T18:48:21.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:21.612 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-08-31T18:48:21.612 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-08-31T18:48:21.612 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-31T18:48:21.613 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-31T18:48:21.613 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-31T18:48:21.613 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-31T18:48:21.614 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-31T18:48:21.614 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-08-31T18:48:21.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:21.877 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-08-31T18:48:21.877 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-08-31T18:48:21.877 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-08-31T18:48:21.878 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.0 master ceph-brx 2023-08-31T18:48:21.880 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-08-31T18:48:22.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:22.054 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-08-31T18:48:22.100 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-31T18:48:22.101 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T18:48:22.199 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T18:48:22.199 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T18:48:22.624 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T18:48:22.625 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T18:48:22.629 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-31T18:48:22.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:22.630 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-31T18:48:22.699 INFO:tasks.kclient:client.3 config is {} 2023-08-31T18:48:22.700 DEBUG:teuthology.orchestra.run.smithi146:> ceph fs ls 2023-08-31T18:48:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.859+0000 7fc0677ff700 1 Processor -- start 2023-08-31T18:48:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.860+0000 7fc0677ff700 1 -- start start 2023-08-31T18:48:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.861+0000 7fc0677ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0600a8200 0x7fc06015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.861+0000 7fc0677ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0600ca080 con 0x7fc0600ca510 2023-08-31T18:48:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.861+0000 7fc0677ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0600a8670 con 0x7fc060154460 2023-08-31T18:48:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.861+0000 7fc0677ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0600c72d0 con 0x7fc0600a8200 2023-08-31T18:48:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.861+0000 7fc065d9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0600a8200 0x7fc06015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.861+0000 7fc06559b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc060154460 0x7fc0600c1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:57294/0 (socket says 172.21.15.146:57294) 2023-08-31T18:48:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.861+0000 7fc06559b700 1 -- 172.21.15.146:0/730397998 learned_addr learned my addr 172.21.15.146:0/730397998 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-08-31T18:48:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.862+0000 7fc065d9c700 1 -- 172.21.15.146:0/730397998 >> v1:172.21.15.146:6789/0 conn(0x7fc060154460 legacy=0x7fc0600c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.862+0000 7fc065d9c700 1 -- 172.21.15.146:0/730397998 >> v1:172.21.15.72:6789/0 conn(0x7fc0600ca510 legacy=0x7fc0600a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.862+0000 7fc065d9c700 1 -- 172.21.15.146:0/730397998 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0600c9750 con 0x7fc0600a8200 2023-08-31T18:48:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.862+0000 7fc065d9c700 1 --2- 172.21.15.146:0/730397998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600a8200 0x7fc06015f0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fc058009e60 tx=0x7fc058009780).ready entity=mon.1 client_cookie=829a3fd7af440c4d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.862+0000 7fc057fff700 1 -- 172.21.15.146:0/730397998 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05800e070 con 0x7fc0600a8200 2023-08-31T18:48:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.862+0000 7fc057fff700 1 -- 172.21.15.146:0/730397998 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05800bbf0 con 0x7fc0600a8200 2023-08-31T18:48:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.862+0000 7fc057fff700 1 -- 172.21.15.146:0/730397998 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc058012410 con 0x7fc0600a8200 2023-08-31T18:48:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.862+0000 7fc0677ff700 1 -- 172.21.15.146:0/730397998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600a8200 msgr2=0x7fc06015f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.862+0000 7fc0677ff700 1 --2- 172.21.15.146:0/730397998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600a8200 0x7fc06015f0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fc058009e60 tx=0x7fc058009780).stop 2023-08-31T18:48:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.863+0000 7fc0677ff700 1 -- 172.21.15.146:0/730397998 shutdown_connections 2023-08-31T18:48:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.863+0000 7fc0677ff700 1 --2- 172.21.15.146:0/730397998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600a8200 0x7fc06015f0a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.863+0000 7fc0677ff700 1 -- 172.21.15.146:0/730397998 >> 172.21.15.146:0/730397998 conn(0x7fc06006a560 msgr2=0x7fc0600cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.863+0000 7fc0677ff700 1 -- 172.21.15.146:0/730397998 shutdown_connections 2023-08-31T18:48:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.863+0000 7fc0677ff700 1 -- 172.21.15.146:0/730397998 wait complete. 2023-08-31T18:48:22.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.864+0000 7fc0677ff700 1 Processor -- start 2023-08-31T18:48:22.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.864+0000 7fc0677ff700 1 -- start start 2023-08-31T18:48:22.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.865+0000 7fc0677ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0600a8200 0x7fc0600b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:22.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.865+0000 7fc0677ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600ca510 0x7fc0600c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:22.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.865+0000 7fc0677ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc060154460 0x7fc0600c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:22.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.865+0000 7fc0677ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc060153f30 con 0x7fc060154460 2023-08-31T18:48:22.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.865+0000 7fc0677ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0600c8410 con 0x7fc0600ca510 2023-08-31T18:48:22.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.865+0000 7fc0677ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0600c2c10 con 0x7fc0600a8200 2023-08-31T18:48:22.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.866+0000 7fc06559b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0600a8200 0x7fc0600b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:22.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.865+0000 7fc064d9a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600ca510 0x7fc0600c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:22.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.866+0000 7fc06559b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0600a8200 0x7fc0600b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.146:38328/0 (socket says 172.21.15.146:38328) 2023-08-31T18:48:22.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.866+0000 7fc064d9a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600ca510 0x7fc0600c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56042/0 (socket says 172.21.15.146:56042) 2023-08-31T18:48:22.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.866+0000 7fc06559b700 1 -- 172.21.15.146:0/1833504179 learned_addr learned my addr 172.21.15.146:0/1833504179 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-08-31T18:48:22.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.866+0000 7fc065d9c700 1 --2- 172.21.15.146:0/1833504179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc060154460 0x7fc0600c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:22.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.866+0000 7fc06559b700 1 -- 172.21.15.146:0/1833504179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600ca510 msgr2=0x7fc0600c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:22.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.866+0000 7fc06559b700 1 --2- 172.21.15.146:0/1833504179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600ca510 0x7fc0600c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:22.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.866+0000 7fc06559b700 1 -- 172.21.15.146:0/1833504179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc060154460 msgr2=0x7fc0600c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:22.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.866+0000 7fc06559b700 1 --2- 172.21.15.146:0/1833504179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc060154460 0x7fc0600c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:22.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.866+0000 7fc06559b700 1 -- 172.21.15.146:0/1833504179 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc058009a20 con 0x7fc0600a8200 2023-08-31T18:48:22.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.866+0000 7fc064d9a700 1 --2- 172.21.15.146:0/1833504179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600ca510 0x7fc0600c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:22.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.866+0000 7fc065d9c700 1 --2- 172.21.15.146:0/1833504179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc060154460 0x7fc0600c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:22.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.866+0000 7fc06559b700 1 --2- 172.21.15.146:0/1833504179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0600a8200 0x7fc0600b0120 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc05c00c4c0 tx=0x7fc05c007c60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:22.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.866+0000 7fc0557fa700 1 -- 172.21.15.146:0/1833504179 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c0072e0 con 0x7fc0600a8200 2023-08-31T18:48:22.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.867+0000 7fc0557fa700 1 -- 172.21.15.146:0/1833504179 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c001e90 con 0x7fc0600a8200 2023-08-31T18:48:22.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.867+0000 7fc0677ff700 1 -- 172.21.15.146:0/1833504179 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0600ae9b0 con 0x7fc0600a8200 2023-08-31T18:48:22.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.867+0000 7fc0557fa700 1 -- 172.21.15.146:0/1833504179 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c005670 con 0x7fc0600a8200 2023-08-31T18:48:22.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.867+0000 7fc0677ff700 1 -- 172.21.15.146:0/1833504179 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0600aeff0 con 0x7fc0600a8200 2023-08-31T18:48:22.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.868+0000 7fc0677ff700 1 -- 172.21.15.146:0/1833504179 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0600c29e0 con 0x7fc0600a8200 2023-08-31T18:48:22.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.868+0000 7fc0557fa700 1 -- 172.21.15.146:0/1833504179 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc05c005a60 con 0x7fc0600a8200 2023-08-31T18:48:22.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.869+0000 7fc0557fa700 1 --2- 172.21.15.146:0/1833504179 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04405ee10 0x7fc0440612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:22.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.870+0000 7fc0557fa700 1 -- 172.21.15.146:0/1833504179 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc05c079570 con 0x7fc0600a8200 2023-08-31T18:48:22.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.870+0000 7fc064d9a700 1 --2- 172.21.15.146:0/1833504179 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04405ee10 0x7fc0440612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:22.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.870+0000 7fc064d9a700 1 --2- 172.21.15.146:0/1833504179 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04405ee10 0x7fc0440612d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fc0600c1ef0 tx=0x7fc050008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:22.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:22.874+0000 7fc0557fa700 1 -- 172.21.15.146:0/1833504179 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc0600c29e0 con 0x7fc0600a8200 2023-08-31T18:48:23.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:23.082+0000 7fc0677ff700 1 -- 172.21.15.146:0/1833504179 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc0600c29e0 con 0x7fc0600a8200 2023-08-31T18:48:23.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:23.083+0000 7fc0557fa700 1 -- 172.21.15.146:0/1833504179 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc0600c29e0 con 0x7fc0600a8200 2023-08-31T18:48:23.083 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T18:48:23.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:23.085+0000 7fc0677ff700 1 -- 172.21.15.146:0/1833504179 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04405ee10 msgr2=0x7fc0440612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:23.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:23.085+0000 7fc0677ff700 1 --2- 172.21.15.146:0/1833504179 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04405ee10 0x7fc0440612d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fc0600c1ef0 tx=0x7fc050008040).stop 2023-08-31T18:48:23.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:23.085+0000 7fc0677ff700 1 -- 172.21.15.146:0/1833504179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0600a8200 msgr2=0x7fc0600b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:23.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:23.085+0000 7fc0677ff700 1 --2- 172.21.15.146:0/1833504179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0600a8200 0x7fc0600b0120 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc05c00c4c0 tx=0x7fc05c007c60).stop 2023-08-31T18:48:23.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:23.085+0000 7fc0677ff700 1 -- 172.21.15.146:0/1833504179 shutdown_connections 2023-08-31T18:48:23.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:23.085+0000 7fc0677ff700 1 --2- 172.21.15.146:0/1833504179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc060154460 0x7fc0600c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:23.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:23.085+0000 7fc0677ff700 1 --2- 172.21.15.146:0/1833504179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0600a8200 0x7fc0600b0120 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:23.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:23.085+0000 7fc0677ff700 1 --2- 172.21.15.146:0/1833504179 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04405ee10 0x7fc0440612d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:23.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:23.085+0000 7fc0677ff700 1 --2- 172.21.15.146:0/1833504179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600ca510 0x7fc0600c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:23.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:23.085+0000 7fc0677ff700 1 -- 172.21.15.146:0/1833504179 >> 172.21.15.146:0/1833504179 conn(0x7fc06006a560 msgr2=0x7fc060063440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:23.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:23.085+0000 7fc0677ff700 1 -- 172.21.15.146:0/1833504179 shutdown_connections 2023-08-31T18:48:23.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-08-31T18:48:23.085+0000 7fc0677ff700 1 -- 172.21.15.146:0/1833504179 wait complete. 2023-08-31T18:48:23.099 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T18:48:23.100 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T18:48:23.100 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-08-31T18:48:23.100 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-31T18:48:23.100 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-31T18:48:23.101 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T18:48:23.101 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T18:48:23.101 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T18:48:23.101 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-31T18:48:23.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:23.102 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-08-31T18:48:23.149 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T18:48:23.150 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T18:48:23.150 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T18:48:23.150 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:23.150 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-08-31T18:48:23.151 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:23.151 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T18:48:23.151 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:23.151 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-08-31T18:48:23.152 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T18:48:23.152 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:23.152 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-08-31T18:48:23.152 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T18:48:23.152 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:23.153 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T18:48:23.153 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:23.153 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T18:48:23.153 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 41956sec preferred_lft 41956sec 2023-08-31T18:48:23.153 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link 2023-08-31T18:48:23.154 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:23.154 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T18:48:23.154 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 82:99:e2:78:c5:55 brd ff:ff:ff:ff:ff:ff 2023-08-31T18:48:23.154 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T18:48:23.154 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:23.155 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3004:57ff:feb3:2267/64 scope link 2023-08-31T18:48:23.155 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:23.155 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T18:48:23.155 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 82:99:e2:78:c5:55 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-31T18:48:23.155 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::8099:e2ff:fe78:c555/64 scope link tentative 2023-08-31T18:48:23.156 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:23.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:23.156 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T18:48:23.223 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-08-31T18:48:23.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:23.227 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-08-31T18:48:23.276 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-08-31T18:48:23.276 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T18:48:23.276 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T18:48:23.276 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T18:48:23.277 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T18:48:23.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:23.278 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-08-31T18:48:23.278 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-08-31T18:48:23.279 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T18:48:23.279 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T18:48:23.279 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T18:48:23.280 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-08-31T18:48:23.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:23.451 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-08-31T18:48:23.499 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-31T18:48:23.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:23.500 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2023-08-31T18:48:23.545 INFO:teuthology.orchestra.run.smithi146.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-31T18:48:23.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:23.547 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-08-31T18:48:23.547 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-08-31T18:48:23.548 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-31T18:48:23.548 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-31T18:48:23.548 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-08-31T18:48:23.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:23.729 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-31T18:48:23.800 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T18:48:23.801 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T18:48:23.801 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T18:48:23.801 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:23.801 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-08-31T18:48:23.801 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:23.802 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T18:48:23.802 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether e2:97:e6:c2:b3:16 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T18:48:23.802 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T18:48:23.802 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:23.803 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::e097:e6ff:fec2:b316/64 scope link 2023-08-31T18:48:23.803 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:23.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:23.804 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-31T18:48:23.875 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T18:48:23.876 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T18:48:23.876 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T18:48:23.876 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:23.876 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-08-31T18:48:23.876 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:23.877 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T18:48:23.877 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether e2:97:e6:c2:b3:16 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T18:48:23.877 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T18:48:23.877 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:23.877 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::e097:e6ff:fec2:b316/64 scope link 2023-08-31T18:48:23.878 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:48:23.879 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-31T18:48:23.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:23.880 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-08-31T18:48:23.880 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-08-31T18:48:23.880 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-31T18:48:23.881 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-31T18:48:23.881 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-31T18:48:23.881 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-31T18:48:23.881 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-31T18:48:23.882 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-08-31T18:48:24.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:24.131 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-08-31T18:48:24.131 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-08-31T18:48:24.132 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.1 up 2023-08-31T18:48:24.132 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.1 master ceph-brx 2023-08-31T18:48:24.132 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-08-31T18:48:24.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:24.305 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p /home/ubuntu/cephtest/mnt.3 2023-08-31T18:48:24.352 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-31T18:48:24.353 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T18:48:24.451 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T18:48:24.451 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T18:48:24.477 INFO:teuthology.orchestra.run.smithi146.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T18:48:24.477 INFO:teuthology.orchestra.run.smithi146.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T18:48:24.481 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-31T18:48:24.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:24.482 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-31T18:48:24.555 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-31T18:48:24.573 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:48:24.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.773+0000 7f36acbff700 1 Processor -- start 2023-08-31T18:48:24.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.773+0000 7f36acbff700 1 -- start start 2023-08-31T18:48:24.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.774+0000 7f36acbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36a80c6c30 0x7f36a80bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.774+0000 7f36acbff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36a81583f0 0x7f36a80c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.774+0000 7f36acbff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a8063be0 con 0x7f36a80c4740 2023-08-31T18:48:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.774+0000 7f36acbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a8063010 con 0x7f36a80c6c30 2023-08-31T18:48:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.774+0000 7f36acbff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a80632b0 con 0x7f36a81583f0 2023-08-31T18:48:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.775+0000 7f36a659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36a80c6c30 0x7f36a80bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.775+0000 7f36a659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36a80c6c30 0x7f36a80bc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32892/0 (socket says 172.21.15.72:32892) 2023-08-31T18:48:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.775+0000 7f36a659c700 1 -- 172.21.15.72:0/1958429611 learned_addr learned my addr 172.21.15.72:0/1958429611 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.775+0000 7f36a6d9d700 1 --2- 172.21.15.72:0/1958429611 >> v2:172.21.15.146:3300/0 conn(0x7f36a81583f0 0x7f36a80c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.775+0000 7f36a659c700 1 -- 172.21.15.72:0/1958429611 >> v2:172.21.15.146:3300/0 conn(0x7f36a81583f0 msgr2=0x7f36a80c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:24.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.775+0000 7f36a659c700 1 --2- 172.21.15.72:0/1958429611 >> v2:172.21.15.146:3300/0 conn(0x7f36a81583f0 0x7f36a80c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.775+0000 7f36a659c700 1 -- 172.21.15.72:0/1958429611 >> v1:172.21.15.146:6789/0 conn(0x7f36a80c4740 legacy=0x7f36a8157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.775+0000 7f36a659c700 1 -- 172.21.15.72:0/1958429611 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a8063590 con 0x7f36a80c6c30 2023-08-31T18:48:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.775+0000 7f36a659c700 1 --2- 172.21.15.72:0/1958429611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a80c6c30 0x7f36a80bc300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f36a8158cc0 tx=0x7f36980090f0).ready entity=mon.0 client_cookie=8bd9f018f2e058d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.775+0000 7f36a559a700 1 -- 172.21.15.72:0/1958429611 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800b520 con 0x7f36a80c6c30 2023-08-31T18:48:24.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.776+0000 7f36a559a700 1 -- 172.21.15.72:0/1958429611 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369800b680 con 0x7f36a80c6c30 2023-08-31T18:48:24.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.776+0000 7f36a559a700 1 -- 172.21.15.72:0/1958429611 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800ba00 con 0x7f36a80c6c30 2023-08-31T18:48:24.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.776+0000 7f36acbff700 1 -- 172.21.15.72:0/1958429611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a80c6c30 msgr2=0x7f36a80bc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:24.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.776+0000 7f36acbff700 1 --2- 172.21.15.72:0/1958429611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a80c6c30 0x7f36a80bc300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f36a8158cc0 tx=0x7f36980090f0).stop 2023-08-31T18:48:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.776+0000 7f36acbff700 1 -- 172.21.15.72:0/1958429611 shutdown_connections 2023-08-31T18:48:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.776+0000 7f36acbff700 1 --2- 172.21.15.72:0/1958429611 >> v2:172.21.15.146:3300/0 conn(0x7f36a81583f0 0x7f36a80c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.776+0000 7f36acbff700 1 --2- 172.21.15.72:0/1958429611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a80c6c30 0x7f36a80bc300 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.776+0000 7f36acbff700 1 -- 172.21.15.72:0/1958429611 >> 172.21.15.72:0/1958429611 conn(0x7f36a80c7e70 msgr2=0x7f36a80c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.776+0000 7f36acbff700 1 -- 172.21.15.72:0/1958429611 shutdown_connections 2023-08-31T18:48:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.776+0000 7f36acbff700 1 -- 172.21.15.72:0/1958429611 wait complete. 2023-08-31T18:48:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.778+0000 7f36acbff700 1 Processor -- start 2023-08-31T18:48:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.778+0000 7f36acbff700 1 -- start start 2023-08-31T18:48:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36acbff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a80c4740 0x7f36a80a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36acbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a80c6c30 0x7f36a8150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:24.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36acbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a81583f0 0x7f36a8137a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:24.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36acbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80a9590 con 0x7f36a80c6c30 2023-08-31T18:48:24.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36acbff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80aa330 con 0x7f36a80c4740 2023-08-31T18:48:24.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36acbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80aa610 con 0x7f36a81583f0 2023-08-31T18:48:24.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36a5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a80c6c30 0x7f36a8150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:24.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36a5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a80c6c30 0x7f36a8150ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32904/0 (socket says 172.21.15.72:32904) 2023-08-31T18:48:24.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36a5d9b700 1 -- 172.21.15.72:0/1417114524 learned_addr learned my addr 172.21.15.72:0/1417114524 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:24.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36a659c700 1 --2- 172.21.15.72:0/1417114524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a80c4740 0x7f36a80a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:24.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36a5d9b700 1 -- 172.21.15.72:0/1417114524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a81583f0 msgr2=0x7f36a8137a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:24.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36a5d9b700 1 --2- 172.21.15.72:0/1417114524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a81583f0 0x7f36a8137a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:24.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36a5d9b700 1 -- 172.21.15.72:0/1417114524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a80c4740 msgr2=0x7f36a80a90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:24.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36a5d9b700 1 --2- 172.21.15.72:0/1417114524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a80c4740 0x7f36a80a90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:24.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36a5d9b700 1 -- 172.21.15.72:0/1417114524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3698009370 con 0x7f36a80c6c30 2023-08-31T18:48:24.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36a659c700 1 --2- 172.21.15.72:0/1417114524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a80c4740 0x7f36a80a90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:24.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.779+0000 7f36a5d9b700 1 --2- 172.21.15.72:0/1417114524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a80c6c30 0x7f36a8150ce0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f369c00c440 tx=0x7f369c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:24.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.780+0000 7f36967fc700 1 -- 172.21.15.72:0/1417114524 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c007020 con 0x7f36a80c6c30 2023-08-31T18:48:24.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.780+0000 7f36967fc700 1 -- 172.21.15.72:0/1417114524 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c007180 con 0x7f36a80c6c30 2023-08-31T18:48:24.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.780+0000 7f36967fc700 1 -- 172.21.15.72:0/1417114524 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c007520 con 0x7f36a80c6c30 2023-08-31T18:48:24.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.780+0000 7f36acbff700 1 -- 172.21.15.72:0/1417114524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a80aa8f0 con 0x7f36a80c6c30 2023-08-31T18:48:24.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.780+0000 7f36acbff700 1 -- 172.21.15.72:0/1417114524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a80aaeb0 con 0x7f36a80c6c30 2023-08-31T18:48:24.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.781+0000 7f36acbff700 1 -- 172.21.15.72:0/1417114524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a806c6b0 con 0x7f36a80c6c30 2023-08-31T18:48:24.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.782+0000 7f36967fc700 1 -- 172.21.15.72:0/1417114524 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f369c0068b0 con 0x7f36a80c6c30 2023-08-31T18:48:24.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.783+0000 7f36967fc700 1 --2- 172.21.15.72:0/1417114524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f368805ede0 0x7f36880612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:24.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.783+0000 7f36967fc700 1 -- 172.21.15.72:0/1417114524 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f369c079180 con 0x7f36a80c6c30 2023-08-31T18:48:24.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.783+0000 7f36a659c700 1 --2- 172.21.15.72:0/1417114524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f368805ede0 0x7f36880612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:24.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.784+0000 7f36a659c700 1 --2- 172.21.15.72:0/1417114524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f368805ede0 0x7f36880612a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f369800b2e0 tx=0x7f3698017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:24.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.788+0000 7f36967fc700 1 -- 172.21.15.72:0/1417114524 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f369c0478f0 con 0x7f36a80c6c30 2023-08-31T18:48:24.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.957+0000 7f36acbff700 1 -- 172.21.15.72:0/1417114524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36a80c4520 con 0x7f36a80c6c30 2023-08-31T18:48:24.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.958+0000 7f36967fc700 1 -- 172.21.15.72:0/1417114524 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17024 (secure 0 0 0) 0x7f369c04a5f0 con 0x7f36a80c6c30 2023-08-31T18:48:24.958 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:24.959 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:53.972412+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:47:51.003304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-31T18:47:51.950765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:48:24.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.960+0000 7f36acbff700 1 -- 172.21.15.72:0/1417114524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f368805ede0 msgr2=0x7f36880612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:24.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.960+0000 7f36acbff700 1 --2- 172.21.15.72:0/1417114524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f368805ede0 0x7f36880612a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f369800b2e0 tx=0x7f3698017000).stop 2023-08-31T18:48:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.960+0000 7f36acbff700 1 -- 172.21.15.72:0/1417114524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a80c6c30 msgr2=0x7f36a8150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.960+0000 7f36acbff700 1 --2- 172.21.15.72:0/1417114524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a80c6c30 0x7f36a8150ce0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f369c00c440 tx=0x7f369c007e00).stop 2023-08-31T18:48:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.960+0000 7f36acbff700 1 -- 172.21.15.72:0/1417114524 shutdown_connections 2023-08-31T18:48:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.960+0000 7f36acbff700 1 --2- 172.21.15.72:0/1417114524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36a81583f0 0x7f36a8137a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.960+0000 7f36acbff700 1 --2- 172.21.15.72:0/1417114524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f368805ede0 0x7f36880612a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.960+0000 7f36acbff700 1 --2- 172.21.15.72:0/1417114524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36a80c4740 0x7f36a80a90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.960+0000 7f36acbff700 1 --2- 172.21.15.72:0/1417114524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a80c6c30 0x7f36a8150ce0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.960+0000 7f36acbff700 1 -- 172.21.15.72:0/1417114524 >> 172.21.15.72:0/1417114524 conn(0x7f36a80c7e70 msgr2=0x7f36a8152270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.960+0000 7f36acbff700 1 -- 172.21.15.72:0/1417114524 shutdown_connections 2023-08-31T18:48:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:24.960+0000 7f36acbff700 1 -- 172.21.15.72:0/1417114524 wait complete. 2023-08-31T18:48:24.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T18:47:51.003304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T18:47:51.950765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T18:48:24.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T18:48:25.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.170+0000 7f96a47ff700 1 Processor -- start 2023-08-31T18:48:25.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.170+0000 7f96a47ff700 1 -- start start 2023-08-31T18:48:25.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.172+0000 7f96a47ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f969c14ecd0 0x7f969c1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.172+0000 7f96a47ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f969c0c2320 0x7f969c0c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.172+0000 7f96a47ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969c152720 con 0x7f969c0c1100 2023-08-31T18:48:25.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.172+0000 7f96a47ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969c0c2c90 con 0x7f969c0c2320 2023-08-31T18:48:25.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.172+0000 7f96a47ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c06a6b0 con 0x7f969c14ecd0 2023-08-31T18:48:25.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.172+0000 7f96a1d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f969c0c2320 0x7f969c0c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.172+0000 7f96a1d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f969c0c2320 0x7f969c0c27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32914/0 (socket says 172.21.15.72:32914) 2023-08-31T18:48:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.172+0000 7f96a1d9a700 1 -- 172.21.15.72:0/1396276052 learned_addr learned my addr 172.21.15.72:0/1396276052 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.172+0000 7f96a259b700 1 --2- 172.21.15.72:0/1396276052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f969c14ecd0 0x7f969c1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.173+0000 7f96a1d9a700 1 -- 172.21.15.72:0/1396276052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f969c14ecd0 msgr2=0x7f969c1556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.173+0000 7f96a1d9a700 1 --2- 172.21.15.72:0/1396276052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f969c14ecd0 0x7f969c1556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.173+0000 7f96a1d9a700 1 -- 172.21.15.72:0/1396276052 >> v1:172.21.15.146:6789/0 conn(0x7f969c0c1100 legacy=0x7f969c0c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:25.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.173+0000 7f96a1d9a700 1 -- 172.21.15.72:0/1396276052 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c155bc0 con 0x7f969c0c2320 2023-08-31T18:48:25.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.173+0000 7f96a259b700 1 --2- 172.21.15.72:0/1396276052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f969c14ecd0 0x7f969c1556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:25.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.173+0000 7f96a1d9a700 1 --2- 172.21.15.72:0/1396276052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f969c0c2320 0x7f969c0c27a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f968c006fd0 tx=0x7f968c0090f0).ready entity=mon.0 client_cookie=bf5bcf0f4b819a75 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:25.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.173+0000 7f96a1599700 1 -- 172.21.15.72:0/1396276052 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c00b600 con 0x7f969c0c2320 2023-08-31T18:48:25.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.173+0000 7f96a1599700 1 -- 172.21.15.72:0/1396276052 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c00b760 con 0x7f969c0c2320 2023-08-31T18:48:25.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.173+0000 7f96a1599700 1 -- 172.21.15.72:0/1396276052 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c00bae0 con 0x7f969c0c2320 2023-08-31T18:48:25.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.174+0000 7f96a47ff700 1 -- 172.21.15.72:0/1396276052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f969c0c2320 msgr2=0x7f969c0c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:25.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.174+0000 7f96a47ff700 1 --2- 172.21.15.72:0/1396276052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f969c0c2320 0x7f969c0c27a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f968c006fd0 tx=0x7f968c0090f0).stop 2023-08-31T18:48:25.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.174+0000 7f96a47ff700 1 -- 172.21.15.72:0/1396276052 shutdown_connections 2023-08-31T18:48:25.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.174+0000 7f96a47ff700 1 --2- 172.21.15.72:0/1396276052 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f969c14ecd0 0x7f969c1556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.174+0000 7f96a47ff700 1 --2- 172.21.15.72:0/1396276052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f969c0c2320 0x7f969c0c27a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.174+0000 7f96a47ff700 1 -- 172.21.15.72:0/1396276052 >> 172.21.15.72:0/1396276052 conn(0x7f969c0630c0 msgr2=0x7f969c0c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:25.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.174+0000 7f96a47ff700 1 -- 172.21.15.72:0/1396276052 shutdown_connections 2023-08-31T18:48:25.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.174+0000 7f96a47ff700 1 -- 172.21.15.72:0/1396276052 wait complete. 2023-08-31T18:48:25.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.176+0000 7f96a47ff700 1 Processor -- start 2023-08-31T18:48:25.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.176+0000 7f96a47ff700 1 -- start start 2023-08-31T18:48:25.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.177+0000 7f96a47ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f969c0c1100 0x7f969c14ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.177+0000 7f96a47ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f969c0c2320 0x7f969c0c0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.177+0000 7f96a47ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f969c14ecd0 0x7f969c14dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.177+0000 7f96a47ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c1680c0 con 0x7f969c0c2320 2023-08-31T18:48:25.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.177+0000 7f96a47ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c1683a0 con 0x7f969c14ecd0 2023-08-31T18:48:25.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.177+0000 7f96a47ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c168680 con 0x7f969c0c1100 2023-08-31T18:48:25.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.178+0000 7f96a1d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f969c0c2320 0x7f969c0c0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.178+0000 7f96a1d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f969c0c2320 0x7f969c0c0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32922/0 (socket says 172.21.15.72:32922) 2023-08-31T18:48:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.178+0000 7f96a1d9a700 1 -- 172.21.15.72:0/1767971464 learned_addr learned my addr 172.21.15.72:0/1767971464 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.178+0000 7f96a259b700 1 --2- 172.21.15.72:0/1767971464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f969c0c1100 0x7f969c14ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.178+0000 7f96a2d9c700 1 --2- 172.21.15.72:0/1767971464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f969c14ecd0 0x7f969c14dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.178+0000 7f96a1d9a700 1 -- 172.21.15.72:0/1767971464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f969c0c1100 msgr2=0x7f969c14ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.178+0000 7f96a1d9a700 1 --2- 172.21.15.72:0/1767971464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f969c0c1100 0x7f969c14ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.178+0000 7f96a1d9a700 1 -- 172.21.15.72:0/1767971464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f969c14ecd0 msgr2=0x7f969c14dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.178+0000 7f96a1d9a700 1 --2- 172.21.15.72:0/1767971464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f969c14ecd0 0x7f969c14dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.178+0000 7f96a1d9a700 1 -- 172.21.15.72:0/1767971464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c009370 con 0x7f969c0c2320 2023-08-31T18:48:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.178+0000 7f96a2d9c700 1 --2- 172.21.15.72:0/1767971464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f969c14ecd0 0x7f969c14dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.178+0000 7f96a1d9a700 1 --2- 172.21.15.72:0/1767971464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f969c0c2320 0x7f969c0c0380 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f969c0634d0 tx=0x7f968c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.178+0000 7f96927fc700 1 -- 172.21.15.72:0/1767971464 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c00b8d0 con 0x7f969c0c2320 2023-08-31T18:48:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.178+0000 7f96927fc700 1 -- 172.21.15.72:0/1767971464 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c00ba30 con 0x7f969c0c2320 2023-08-31T18:48:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.178+0000 7f96927fc700 1 -- 172.21.15.72:0/1767971464 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c01b660 con 0x7f969c0c2320 2023-08-31T18:48:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.179+0000 7f96a47ff700 1 -- 172.21.15.72:0/1767971464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969c168960 con 0x7f969c0c2320 2023-08-31T18:48:25.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.179+0000 7f96a47ff700 1 -- 172.21.15.72:0/1767971464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969c0c0870 con 0x7f969c0c2320 2023-08-31T18:48:25.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.180+0000 7f96a47ff700 1 -- 172.21.15.72:0/1767971464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969c06c6b0 con 0x7f969c0c2320 2023-08-31T18:48:25.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.180+0000 7f96927fc700 1 -- 172.21.15.72:0/1767971464 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f968c01ba10 con 0x7f969c0c2320 2023-08-31T18:48:25.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.181+0000 7f96927fc700 1 --2- 172.21.15.72:0/1767971464 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f968005ee10 0x7f96800612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.181+0000 7f96927fc700 1 -- 172.21.15.72:0/1767971464 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f968c07b830 con 0x7f969c0c2320 2023-08-31T18:48:25.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.181+0000 7f96a259b700 1 --2- 172.21.15.72:0/1767971464 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f968005ee10 0x7f96800612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.182+0000 7f96a259b700 1 --2- 172.21.15.72:0/1767971464 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f968005ee10 0x7f96800612d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9698006d80 tx=0x7f9698008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:25.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.186+0000 7f96927fc700 1 -- 172.21.15.72:0/1767971464 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f968c04cbe0 con 0x7f969c0c2320 2023-08-31T18:48:25.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.356+0000 7f96a47ff700 1 -- 172.21.15.72:0/1767971464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f969c151b10 con 0x7f969c0c2320 2023-08-31T18:48:25.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.356+0000 7f96927fc700 1 -- 172.21.15.72:0/1767971464 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f968c01f020 con 0x7f969c0c2320 2023-08-31T18:48:25.357 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T18:48:25.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.358+0000 7f96a47ff700 1 -- 172.21.15.72:0/1767971464 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f968005ee10 msgr2=0x7f96800612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:25.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.358+0000 7f96a47ff700 1 --2- 172.21.15.72:0/1767971464 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f968005ee10 0x7f96800612d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9698006d80 tx=0x7f9698008040).stop 2023-08-31T18:48:25.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.358+0000 7f96a47ff700 1 -- 172.21.15.72:0/1767971464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f969c0c2320 msgr2=0x7f969c0c0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:25.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.358+0000 7f96a47ff700 1 --2- 172.21.15.72:0/1767971464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f969c0c2320 0x7f969c0c0380 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f969c0634d0 tx=0x7f968c017000).stop 2023-08-31T18:48:25.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.359+0000 7f96a47ff700 1 -- 172.21.15.72:0/1767971464 shutdown_connections 2023-08-31T18:48:25.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.359+0000 7f96a47ff700 1 --2- 172.21.15.72:0/1767971464 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f968005ee10 0x7f96800612d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.359+0000 7f96a47ff700 1 --2- 172.21.15.72:0/1767971464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f969c14ecd0 0x7f969c14dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.359+0000 7f96a47ff700 1 --2- 172.21.15.72:0/1767971464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f969c0c1100 0x7f969c14ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.359+0000 7f96a47ff700 1 --2- 172.21.15.72:0/1767971464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f969c0c2320 0x7f969c0c0380 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.359+0000 7f96a47ff700 1 -- 172.21.15.72:0/1767971464 >> 172.21.15.72:0/1767971464 conn(0x7f969c0630c0 msgr2=0x7f969c0bbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:25.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.359+0000 7f96a47ff700 1 -- 172.21.15.72:0/1767971464 shutdown_connections 2023-08-31T18:48:25.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.359+0000 7f96a47ff700 1 -- 172.21.15.72:0/1767971464 wait complete. 2023-08-31T18:48:25.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T18:48:25.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.568+0000 7fd5a87ff700 1 Processor -- start 2023-08-31T18:48:25.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.568+0000 7fd5a87ff700 1 -- start start 2023-08-31T18:48:25.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.570+0000 7fd5a87ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5a0153e30 0x7fd5a0154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.570+0000 7fd5a87ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd5a00637c0 0x7fd5a00c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.570+0000 7fd5a87ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a00bfd40 con 0x7fd5a00c5cb0 2023-08-31T18:48:25.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.570+0000 7fd5a87ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a00c6730 con 0x7fd5a00637c0 2023-08-31T18:48:25.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.570+0000 7fd5a87ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a00bffe0 con 0x7fd5a0153e30 2023-08-31T18:48:25.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.570+0000 7fd5a6d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd5a00637c0 0x7fd5a00c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.570+0000 7fd5a6d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd5a00637c0 0x7fd5a00c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32932/0 (socket says 172.21.15.72:32932) 2023-08-31T18:48:25.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.570+0000 7fd5a6d9c700 1 -- 172.21.15.72:0/3464201592 learned_addr learned my addr 172.21.15.72:0/3464201592 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:25.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.570+0000 7fd5a659b700 1 --2- 172.21.15.72:0/3464201592 >> v2:172.21.15.146:3300/0 conn(0x7fd5a0153e30 0x7fd5a0154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.570+0000 7fd5a6d9c700 1 -- 172.21.15.72:0/3464201592 >> v2:172.21.15.146:3300/0 conn(0x7fd5a0153e30 msgr2=0x7fd5a0154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:25.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.570+0000 7fd5a6d9c700 1 --2- 172.21.15.72:0/3464201592 >> v2:172.21.15.146:3300/0 conn(0x7fd5a0153e30 0x7fd5a0154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.570+0000 7fd5a6d9c700 1 -- 172.21.15.72:0/3464201592 >> v1:172.21.15.146:6789/0 conn(0x7fd5a00c5cb0 legacy=0x7fd5a00630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:25.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.570+0000 7fd5a6d9c700 1 -- 172.21.15.72:0/3464201592 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a00c02c0 con 0x7fd5a00637c0 2023-08-31T18:48:25.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.570+0000 7fd5a659b700 1 --2- 172.21.15.72:0/3464201592 >> v2:172.21.15.146:3300/0 conn(0x7fd5a0153e30 0x7fd5a0154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:25.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.571+0000 7fd5a6d9c700 1 --2- 172.21.15.72:0/3464201592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5a00637c0 0x7fd5a00c6160 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fd5a006aa50 tx=0x7fd598009840).ready entity=mon.0 client_cookie=c6b9f0be17f42d41 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:25.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.571+0000 7fd5a5599700 1 -- 172.21.15.72:0/3464201592 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59800e070 con 0x7fd5a00637c0 2023-08-31T18:48:25.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.571+0000 7fd5a5599700 1 -- 172.21.15.72:0/3464201592 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59800ba10 con 0x7fd5a00637c0 2023-08-31T18:48:25.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.571+0000 7fd5a5599700 1 -- 172.21.15.72:0/3464201592 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59800bd90 con 0x7fd5a00637c0 2023-08-31T18:48:25.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.571+0000 7fd5a87ff700 1 -- 172.21.15.72:0/3464201592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5a00637c0 msgr2=0x7fd5a00c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:25.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.571+0000 7fd5a87ff700 1 --2- 172.21.15.72:0/3464201592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5a00637c0 0x7fd5a00c6160 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fd5a006aa50 tx=0x7fd598009840).stop 2023-08-31T18:48:25.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.571+0000 7fd5a87ff700 1 -- 172.21.15.72:0/3464201592 shutdown_connections 2023-08-31T18:48:25.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.571+0000 7fd5a87ff700 1 --2- 172.21.15.72:0/3464201592 >> v2:172.21.15.146:3300/0 conn(0x7fd5a0153e30 0x7fd5a0154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.571+0000 7fd5a87ff700 1 --2- 172.21.15.72:0/3464201592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5a00637c0 0x7fd5a00c6160 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.571+0000 7fd5a87ff700 1 -- 172.21.15.72:0/3464201592 >> 172.21.15.72:0/3464201592 conn(0x7fd5a005eb20 msgr2=0x7fd5a00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:25.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.571+0000 7fd5a87ff700 1 -- 172.21.15.72:0/3464201592 shutdown_connections 2023-08-31T18:48:25.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.571+0000 7fd5a87ff700 1 -- 172.21.15.72:0/3464201592 wait complete. 2023-08-31T18:48:25.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.573+0000 7fd5a87ff700 1 Processor -- start 2023-08-31T18:48:25.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.573+0000 7fd5a87ff700 1 -- start start 2023-08-31T18:48:25.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.574+0000 7fd5a87ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a00637c0 0x7fd5a0155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.574+0000 7fd5a87ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5a00c5cb0 0x7fd5a0155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.574+0000 7fd5a87ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5a0153e30 0x7fd5a014fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.574+0000 7fd5a87ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a0156eb0 con 0x7fd5a00c5cb0 2023-08-31T18:48:25.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.574+0000 7fd5a87ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a01557f0 con 0x7fd5a00637c0 2023-08-31T18:48:25.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.574+0000 7fd5a87ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a01562a0 con 0x7fd5a0153e30 2023-08-31T18:48:25.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.574+0000 7fd5a5d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5a00c5cb0 0x7fd5a0155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.574+0000 7fd5a5d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5a00c5cb0 0x7fd5a0155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32946/0 (socket says 172.21.15.72:32946) 2023-08-31T18:48:25.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.574+0000 7fd5a5d9a700 1 -- 172.21.15.72:0/1632191727 learned_addr learned my addr 172.21.15.72:0/1632191727 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:25.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.574+0000 7fd5a659b700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a00637c0 0x7fd5a0155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.575+0000 7fd5a6d9c700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5a0153e30 0x7fd5a014fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.575+0000 7fd5a5d9a700 1 -- 172.21.15.72:0/1632191727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5a0153e30 msgr2=0x7fd5a014fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:25.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.575+0000 7fd5a5d9a700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5a0153e30 0x7fd5a014fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.575+0000 7fd5a5d9a700 1 -- 172.21.15.72:0/1632191727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a00637c0 msgr2=0x7fd5a0155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:25.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.575+0000 7fd5a5d9a700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a00637c0 0x7fd5a0155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.575+0000 7fd5a5d9a700 1 -- 172.21.15.72:0/1632191727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd598009ae0 con 0x7fd5a00c5cb0 2023-08-31T18:48:25.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.575+0000 7fd5a659b700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a00637c0 0x7fd5a0155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:25.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.575+0000 7fd5a6d9c700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5a0153e30 0x7fd5a014fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:25.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.575+0000 7fd5a5d9a700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5a00c5cb0 0x7fd5a0155300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fd59000c440 tx=0x7fd590007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:25.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.575+0000 7fd5967fc700 1 -- 172.21.15.72:0/1632191727 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000f470 con 0x7fd5a00c5cb0 2023-08-31T18:48:25.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.575+0000 7fd5967fc700 1 -- 172.21.15.72:0/1632191727 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59000f5f0 con 0x7fd5a00c5cb0 2023-08-31T18:48:25.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.575+0000 7fd5a87ff700 1 -- 172.21.15.72:0/1632191727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a0156580 con 0x7fd5a00c5cb0 2023-08-31T18:48:25.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.575+0000 7fd5967fc700 1 -- 172.21.15.72:0/1632191727 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000f9b0 con 0x7fd5a00c5cb0 2023-08-31T18:48:25.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.575+0000 7fd5a87ff700 1 -- 172.21.15.72:0/1632191727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a0156b40 con 0x7fd5a00c5cb0 2023-08-31T18:48:25.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.576+0000 7fd5a87ff700 1 -- 172.21.15.72:0/1632191727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a006c6b0 con 0x7fd5a00c5cb0 2023-08-31T18:48:25.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.577+0000 7fd5967fc700 1 -- 172.21.15.72:0/1632191727 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fd590012400 con 0x7fd5a00c5cb0 2023-08-31T18:48:25.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.578+0000 7fd5967fc700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd58405ede0 0x7fd5840612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.578+0000 7fd5967fc700 1 -- 172.21.15.72:0/1632191727 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd590079380 con 0x7fd5a00c5cb0 2023-08-31T18:48:25.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.578+0000 7fd5a659b700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd58405ede0 0x7fd5840612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.579+0000 7fd5a659b700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd58405ede0 0x7fd5840612a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fd59c006fd0 tx=0x7fd59c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:25.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.582+0000 7fd5967fc700 1 -- 172.21.15.72:0/1632191727 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd5900488f0 con 0x7fd5a00c5cb0 2023-08-31T18:48:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.750+0000 7fd5a87ff700 1 -- 172.21.15.72:0/1632191727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5a0062970 con 0x7fd5a00c5cb0 2023-08-31T18:48:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.750+0000 7fd5967fc700 1 -- 172.21.15.72:0/1632191727 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd59004a780 con 0x7fd5a00c5cb0 2023-08-31T18:48:25.751 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T18:48:25.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.752+0000 7fd5a87ff700 1 -- 172.21.15.72:0/1632191727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd58405ede0 msgr2=0x7fd5840612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:25.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.752+0000 7fd5a87ff700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd58405ede0 0x7fd5840612a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fd59c006fd0 tx=0x7fd59c008040).stop 2023-08-31T18:48:25.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.752+0000 7fd5a87ff700 1 -- 172.21.15.72:0/1632191727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5a00c5cb0 msgr2=0x7fd5a0155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:25.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.752+0000 7fd5a87ff700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5a00c5cb0 0x7fd5a0155300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fd59000c440 tx=0x7fd590007de0).stop 2023-08-31T18:48:25.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.752+0000 7fd5a87ff700 1 -- 172.21.15.72:0/1632191727 shutdown_connections 2023-08-31T18:48:25.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.752+0000 7fd5a87ff700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5a0153e30 0x7fd5a014fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.752+0000 7fd5a87ff700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd58405ede0 0x7fd5840612a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.752+0000 7fd5a87ff700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a00637c0 0x7fd5a0155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.752+0000 7fd5a87ff700 1 --2- 172.21.15.72:0/1632191727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5a00c5cb0 0x7fd5a0155300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.752+0000 7fd5a87ff700 1 -- 172.21.15.72:0/1632191727 >> 172.21.15.72:0/1632191727 conn(0x7fd5a005eb20 msgr2=0x7fd5a00c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:25.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.752+0000 7fd5a87ff700 1 -- 172.21.15.72:0/1632191727 shutdown_connections 2023-08-31T18:48:25.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.753+0000 7fd5a87ff700 1 -- 172.21.15.72:0/1632191727 wait complete. 2023-08-31T18:48:25.770 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T18:48:25.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.962+0000 7f14eedff700 1 Processor -- start 2023-08-31T18:48:25.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.962+0000 7f14eedff700 1 -- start start 2023-08-31T18:48:25.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.963+0000 7f14eedff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f14e8153e30 0x7f14e8154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.963+0000 7f14eedff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14e80c5cb0 0x7f14e80c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.963+0000 7f14eedff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f14e80630b0 0x7f14e8063510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.963+0000 7f14eedff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e8063a00 con 0x7f14e80630b0 2023-08-31T18:48:25.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.963+0000 7f14eedff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e80bfd40 con 0x7f14e8153e30 2023-08-31T18:48:25.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.963+0000 7f14eedff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80c6730 con 0x7f14e80c5cb0 2023-08-31T18:48:25.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.964+0000 7f14ed39c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f14e80630b0 0x7f14e8063510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.964+0000 7f14ed39c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f14e80630b0 0x7f14e8063510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32956/0 (socket says 172.21.15.72:32956) 2023-08-31T18:48:25.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.964+0000 7f14ed39c700 1 -- 172.21.15.72:0/1822464764 learned_addr learned my addr 172.21.15.72:0/1822464764 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:25.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.964+0000 7f14ed39c700 1 -- 172.21.15.72:0/1822464764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14e80c5cb0 msgr2=0x7f14e80c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:25.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.964+0000 7f14ed39c700 1 --2- 172.21.15.72:0/1822464764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14e80c5cb0 0x7f14e80c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:25.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.964+0000 7f14ed39c700 1 -- 172.21.15.72:0/1822464764 >> v2:172.21.15.146:3300/0 conn(0x7f14e8153e30 msgr2=0x7f14e8154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:25.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.964+0000 7f14ecb9b700 1 --2- 172.21.15.72:0/1822464764 >> v2:172.21.15.146:3300/0 conn(0x7f14e8153e30 0x7f14e8154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.964+0000 7f14ed39c700 1 --2- 172.21.15.72:0/1822464764 >> v2:172.21.15.146:3300/0 conn(0x7f14e8153e30 0x7f14e8154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.964+0000 7f14ed39c700 1 -- 172.21.15.72:0/1822464764 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e80bffe0 con 0x7f14e80630b0 2023-08-31T18:48:25.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.964+0000 7f14ecb9b700 1 --2- 172.21.15.72:0/1822464764 >> v2:172.21.15.146:3300/0 conn(0x7f14e8153e30 0x7f14e8154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:25.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.964+0000 7f14ed39c700 1 --2- 172.21.15.72:0/1822464764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14e80630b0 0x7f14e8063510 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f14e806aa50 tx=0x7f14e0009840).ready entity=mon.0 client_cookie=fcba963608d0e2fb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:25.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.964+0000 7f14e77fe700 1 -- 172.21.15.72:0/1822464764 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e000e070 con 0x7f14e80630b0 2023-08-31T18:48:25.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.965+0000 7f14e77fe700 1 -- 172.21.15.72:0/1822464764 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e000ba50 con 0x7f14e80630b0 2023-08-31T18:48:25.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.965+0000 7f14e77fe700 1 -- 172.21.15.72:0/1822464764 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e000bdd0 con 0x7f14e80630b0 2023-08-31T18:48:25.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.965+0000 7f14eedff700 1 -- 172.21.15.72:0/1822464764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14e80630b0 msgr2=0x7f14e8063510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:25.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.965+0000 7f14eedff700 1 --2- 172.21.15.72:0/1822464764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14e80630b0 0x7f14e8063510 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f14e806aa50 tx=0x7f14e0009840).stop 2023-08-31T18:48:25.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.965+0000 7f14eedff700 1 -- 172.21.15.72:0/1822464764 shutdown_connections 2023-08-31T18:48:25.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.965+0000 7f14eedff700 1 --2- 172.21.15.72:0/1822464764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14e80630b0 0x7f14e8063510 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.965+0000 7f14eedff700 1 --2- 172.21.15.72:0/1822464764 >> v2:172.21.15.146:3300/0 conn(0x7f14e8153e30 0x7f14e8154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.965+0000 7f14eedff700 1 --2- 172.21.15.72:0/1822464764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14e80c5cb0 0x7f14e80c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:25.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.965+0000 7f14eedff700 1 -- 172.21.15.72:0/1822464764 >> 172.21.15.72:0/1822464764 conn(0x7f14e805eb20 msgr2=0x7f14e80cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:25.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.965+0000 7f14eedff700 1 -- 172.21.15.72:0/1822464764 shutdown_connections 2023-08-31T18:48:25.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.965+0000 7f14eedff700 1 -- 172.21.15.72:0/1822464764 wait complete. 2023-08-31T18:48:25.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.967+0000 7f14eedff700 1 Processor -- start 2023-08-31T18:48:25.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.967+0000 7f14eedff700 1 -- start start 2023-08-31T18:48:25.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.968+0000 7f14eedff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14e80630b0 0x7f14e814fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.968+0000 7f14eedff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14e80c5cb0 0x7f14e8156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.968+0000 7f14eedff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14e8153e30 0x7f14e81570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.968+0000 7f14eedff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80c47e0 con 0x7f14e8153e30 2023-08-31T18:48:25.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.968+0000 7f14eedff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e8150110 con 0x7f14e80630b0 2023-08-31T18:48:25.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.968+0000 7f14eedff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80af3f0 con 0x7f14e80c5cb0 2023-08-31T18:48:25.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.968+0000 7f14ed39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14e8153e30 0x7f14e81570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.968+0000 7f14ed39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14e8153e30 0x7f14e81570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32970/0 (socket says 172.21.15.72:32970) 2023-08-31T18:48:25.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.968+0000 7f14ed39c700 1 -- 172.21.15.72:0/1937197620 learned_addr learned my addr 172.21.15.72:0/1937197620 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:25.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.969+0000 7f14ed39c700 1 -- 172.21.15.72:0/1937197620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14e80c5cb0 msgr2=0x7f14e8156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:25.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.969+0000 7f14ecb9b700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14e80630b0 0x7f14e814fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.969+0000 7f14e7fff700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14e80c5cb0 0x7f14e8156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.969+0000 7f14ed39c700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14e80c5cb0 0x7f14e8156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.969+0000 7f14ed39c700 1 -- 172.21.15.72:0/1937197620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14e80630b0 msgr2=0x7f14e814fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:25.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.969+0000 7f14ed39c700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14e80630b0 0x7f14e814fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:25.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.969+0000 7f14ed39c700 1 -- 172.21.15.72:0/1937197620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e0009ae0 con 0x7f14e8153e30 2023-08-31T18:48:25.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.969+0000 7f14ecb9b700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14e80630b0 0x7f14e814fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.969+0000 7f14e7fff700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14e80c5cb0 0x7f14e8156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.969+0000 7f14ed39c700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14e8153e30 0x7f14e81570e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f14e0013f80 tx=0x7f14e0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.969+0000 7f14e4ff9700 1 -- 172.21.15.72:0/1937197620 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e000bdd0 con 0x7f14e8153e30 2023-08-31T18:48:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.969+0000 7f14e4ff9700 1 -- 172.21.15.72:0/1937197620 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e001d460 con 0x7f14e8153e30 2023-08-31T18:48:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.969+0000 7f14e4ff9700 1 -- 172.21.15.72:0/1937197620 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e001d820 con 0x7f14e8153e30 2023-08-31T18:48:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.969+0000 7f14eedff700 1 -- 172.21.15.72:0/1937197620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e80aeac0 con 0x7f14e8153e30 2023-08-31T18:48:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.969+0000 7f14eedff700 1 -- 172.21.15.72:0/1937197620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e80af080 con 0x7f14e8153e30 2023-08-31T18:48:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.970+0000 7f14eedff700 1 -- 172.21.15.72:0/1937197620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e806c6b0 con 0x7f14e8153e30 2023-08-31T18:48:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.971+0000 7f14e4ff9700 1 -- 172.21.15.72:0/1937197620 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f14e0003040 con 0x7f14e8153e30 2023-08-31T18:48:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.972+0000 7f14e4ff9700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f14cc05ee10 0x7f14cc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.972+0000 7f14e4ff9700 1 -- 172.21.15.72:0/1937197620 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f14e007b4b0 con 0x7f14e8153e30 2023-08-31T18:48:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.972+0000 7f14ecb9b700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f14cc05ee10 0x7f14cc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:25.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.973+0000 7f14ecb9b700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f14cc05ee10 0x7f14cc0612d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f14dc008990 tx=0x7f14dc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:25.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:25.976+0000 7f14e4ff9700 1 -- 172.21.15.72:0/1937197620 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f14e004c920 con 0x7f14e8153e30 2023-08-31T18:48:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.145+0000 7f14eedff700 1 -- 172.21.15.72:0/1937197620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f14e8062970 con 0x7f14e8153e30 2023-08-31T18:48:26.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.146+0000 7f14e4ff9700 1 -- 172.21.15.72:0/1937197620 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f14e004ff40 con 0x7f14e8153e30 2023-08-31T18:48:26.146 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T18:48:26.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.147+0000 7f14eedff700 1 -- 172.21.15.72:0/1937197620 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f14cc05ee10 msgr2=0x7f14cc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.147+0000 7f14eedff700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f14cc05ee10 0x7f14cc0612d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f14dc008990 tx=0x7f14dc008040).stop 2023-08-31T18:48:26.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.147+0000 7f14eedff700 1 -- 172.21.15.72:0/1937197620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14e8153e30 msgr2=0x7f14e81570e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.147+0000 7f14eedff700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14e8153e30 0x7f14e81570e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f14e0013f80 tx=0x7f14e0009840).stop 2023-08-31T18:48:26.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.148+0000 7f14eedff700 1 -- 172.21.15.72:0/1937197620 shutdown_connections 2023-08-31T18:48:26.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.148+0000 7f14eedff700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14e8153e30 0x7f14e81570e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.148+0000 7f14eedff700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f14cc05ee10 0x7f14cc0612d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.148+0000 7f14eedff700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14e80630b0 0x7f14e814fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.148+0000 7f14eedff700 1 --2- 172.21.15.72:0/1937197620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14e80c5cb0 0x7f14e8156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.148+0000 7f14eedff700 1 -- 172.21.15.72:0/1937197620 >> 172.21.15.72:0/1937197620 conn(0x7f14e805eb20 msgr2=0x7f14e80c0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:26.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.148+0000 7f14eedff700 1 -- 172.21.15.72:0/1937197620 shutdown_connections 2023-08-31T18:48:26.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.148+0000 7f14eedff700 1 -- 172.21.15.72:0/1937197620 wait complete. 2023-08-31T18:48:26.165 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T18:48:26.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.358+0000 7f04111ff700 1 Processor -- start 2023-08-31T18:48:26.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.358+0000 7f04111ff700 1 -- start start 2023-08-31T18:48:26.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.359+0000 7f04111ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f040c1544e0 0x7f040c05e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:26.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.359+0000 7f04111ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040c0bc4a0 con 0x7f040c0690e0 2023-08-31T18:48:26.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.359+0000 7f04111ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040c069c40 con 0x7f040c0c38d0 2023-08-31T18:48:26.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.359+0000 7f04111ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040c05e840 con 0x7f040c1544e0 2023-08-31T18:48:26.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.359+0000 7f040ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f040c1544e0 0x7f040c05e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:26.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.359+0000 7f040ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f040c1544e0 0x7f040c05e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32984/0 (socket says 172.21.15.72:32984) 2023-08-31T18:48:26.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.359+0000 7f040ad9d700 1 -- 172.21.15.72:0/3292874450 learned_addr learned my addr 172.21.15.72:0/3292874450 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:26.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.360+0000 7f040ad9d700 1 -- 172.21.15.72:0/3292874450 >> v1:172.21.15.146:6789/0 conn(0x7f040c0c38d0 legacy=0x7f040c0689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.360+0000 7f040ad9d700 1 -- 172.21.15.72:0/3292874450 >> v1:172.21.15.72:6789/0 conn(0x7f040c0690e0 legacy=0x7f040c0bc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.360+0000 7f040ad9d700 1 -- 172.21.15.72:0/3292874450 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c0c1c30 con 0x7f040c1544e0 2023-08-31T18:48:26.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.360+0000 7f040ad9d700 1 --2- 172.21.15.72:0/3292874450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f040c1544e0 0x7f040c05e350 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f03fc006fd0 tx=0x7f03fc0090f0).ready entity=mon.0 client_cookie=56d7d2ed0b539f2f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:26.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.360+0000 7f0409d9b700 1 -- 172.21.15.72:0/3292874450 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc00b600 con 0x7f040c1544e0 2023-08-31T18:48:26.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.360+0000 7f0409d9b700 1 -- 172.21.15.72:0/3292874450 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc00b760 con 0x7f040c1544e0 2023-08-31T18:48:26.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.360+0000 7f0409d9b700 1 -- 172.21.15.72:0/3292874450 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc00bb00 con 0x7f040c1544e0 2023-08-31T18:48:26.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.361+0000 7f04111ff700 1 -- 172.21.15.72:0/3292874450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f040c1544e0 msgr2=0x7f040c05e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.361+0000 7f04111ff700 1 --2- 172.21.15.72:0/3292874450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f040c1544e0 0x7f040c05e350 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f03fc006fd0 tx=0x7f03fc0090f0).stop 2023-08-31T18:48:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.361+0000 7f04111ff700 1 -- 172.21.15.72:0/3292874450 shutdown_connections 2023-08-31T18:48:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.361+0000 7f04111ff700 1 --2- 172.21.15.72:0/3292874450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f040c1544e0 0x7f040c05e350 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.361+0000 7f04111ff700 1 -- 172.21.15.72:0/3292874450 >> 172.21.15.72:0/3292874450 conn(0x7f040c0c7e00 msgr2=0x7f040c0c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.361+0000 7f04111ff700 1 -- 172.21.15.72:0/3292874450 shutdown_connections 2023-08-31T18:48:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.361+0000 7f04111ff700 1 -- 172.21.15.72:0/3292874450 wait complete. 2023-08-31T18:48:26.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.362+0000 7f04111ff700 1 Processor -- start 2023-08-31T18:48:26.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.362+0000 7f04111ff700 1 -- start start 2023-08-31T18:48:26.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.363+0000 7f04111ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f040c0690e0 0x7f040c0c1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:26.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.363+0000 7f04111ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f040c0c38d0 0x7f040c14ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:26.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.363+0000 7f04111ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f040c1544e0 0x7f040c156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:26.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.363+0000 7f04111ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c155f00 con 0x7f040c0c38d0 2023-08-31T18:48:26.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.363+0000 7f04111ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c0bfbb0 con 0x7f040c1544e0 2023-08-31T18:48:26.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.363+0000 7f04111ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040c0c0040 con 0x7f040c0690e0 2023-08-31T18:48:26.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.363+0000 7f040a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f040c0c38d0 0x7f040c14ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:26.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.364+0000 7f040a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f040c0c38d0 0x7f040c14ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33000/0 (socket says 172.21.15.72:33000) 2023-08-31T18:48:26.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.364+0000 7f040a59c700 1 -- 172.21.15.72:0/1541080536 learned_addr learned my addr 172.21.15.72:0/1541080536 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:26.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.364+0000 7f040ad9d700 1 --2- 172.21.15.72:0/1541080536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f040c0690e0 0x7f040c0c1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:26.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.364+0000 7f040b59e700 1 --2- 172.21.15.72:0/1541080536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f040c1544e0 0x7f040c156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:26.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.364+0000 7f040a59c700 1 -- 172.21.15.72:0/1541080536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f040c0690e0 msgr2=0x7f040c0c1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.364+0000 7f040a59c700 1 --2- 172.21.15.72:0/1541080536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f040c0690e0 0x7f040c0c1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.364+0000 7f040a59c700 1 -- 172.21.15.72:0/1541080536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f040c1544e0 msgr2=0x7f040c156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.364+0000 7f040a59c700 1 --2- 172.21.15.72:0/1541080536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f040c1544e0 0x7f040c156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.364+0000 7f040a59c700 1 -- 172.21.15.72:0/1541080536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc009370 con 0x7f040c0c38d0 2023-08-31T18:48:26.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.364+0000 7f040a59c700 1 --2- 172.21.15.72:0/1541080536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f040c0c38d0 0x7f040c14ee20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f040000c4c0 tx=0x7f0400007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:26.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.364+0000 7f03f2ffd700 1 -- 172.21.15.72:0/1541080536 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400007020 con 0x7f040c0c38d0 2023-08-31T18:48:26.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.364+0000 7f03f2ffd700 1 -- 172.21.15.72:0/1541080536 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0400007180 con 0x7f040c0c38d0 2023-08-31T18:48:26.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.364+0000 7f04111ff700 1 -- 172.21.15.72:0/1541080536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040c0c1710 con 0x7f040c0c38d0 2023-08-31T18:48:26.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.364+0000 7f03f2ffd700 1 -- 172.21.15.72:0/1541080536 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400007520 con 0x7f040c0c38d0 2023-08-31T18:48:26.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.365+0000 7f04111ff700 1 -- 172.21.15.72:0/1541080536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040c0bf560 con 0x7f040c0c38d0 2023-08-31T18:48:26.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.365+0000 7f04111ff700 1 -- 172.21.15.72:0/1541080536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040c06c6b0 con 0x7f040c0c38d0 2023-08-31T18:48:26.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.366+0000 7f03f2ffd700 1 -- 172.21.15.72:0/1541080536 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f04000068b0 con 0x7f040c0c38d0 2023-08-31T18:48:26.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.367+0000 7f03f2ffd700 1 --2- 172.21.15.72:0/1541080536 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f03f805ee10 0x7f03f80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:26.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.367+0000 7f03f2ffd700 1 -- 172.21.15.72:0/1541080536 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f04000791b0 con 0x7f040c0c38d0 2023-08-31T18:48:26.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.367+0000 7f040ad9d700 1 --2- 172.21.15.72:0/1541080536 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f03f805ee10 0x7f03f80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:26.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.368+0000 7f040ad9d700 1 --2- 172.21.15.72:0/1541080536 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f03f805ee10 0x7f03f80612d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f03fc009130 tx=0x7f03fc017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:26.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.371+0000 7f03f2ffd700 1 -- 172.21.15.72:0/1541080536 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f04000478f0 con 0x7f040c0c38d0 2023-08-31T18:48:26.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.538+0000 7f04111ff700 1 -- 172.21.15.72:0/1541080536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f040c0c1f10 con 0x7f040c0c38d0 2023-08-31T18:48:26.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.538+0000 7f03f2ffd700 1 -- 172.21.15.72:0/1541080536 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f040004a620 con 0x7f040c0c38d0 2023-08-31T18:48:26.539 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T18:48:26.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.540+0000 7f04111ff700 1 -- 172.21.15.72:0/1541080536 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f03f805ee10 msgr2=0x7f03f80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.540+0000 7f04111ff700 1 --2- 172.21.15.72:0/1541080536 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f03f805ee10 0x7f03f80612d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f03fc009130 tx=0x7f03fc017000).stop 2023-08-31T18:48:26.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.540+0000 7f04111ff700 1 -- 172.21.15.72:0/1541080536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f040c0c38d0 msgr2=0x7f040c14ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.540+0000 7f04111ff700 1 --2- 172.21.15.72:0/1541080536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f040c0c38d0 0x7f040c14ee20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f040000c4c0 tx=0x7f0400007dd0).stop 2023-08-31T18:48:26.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.540+0000 7f04111ff700 1 -- 172.21.15.72:0/1541080536 shutdown_connections 2023-08-31T18:48:26.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.540+0000 7f04111ff700 1 --2- 172.21.15.72:0/1541080536 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f03f805ee10 0x7f03f80612d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.540+0000 7f04111ff700 1 --2- 172.21.15.72:0/1541080536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f040c1544e0 0x7f040c156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.540+0000 7f04111ff700 1 --2- 172.21.15.72:0/1541080536 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f040c0690e0 0x7f040c0c1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.540+0000 7f04111ff700 1 --2- 172.21.15.72:0/1541080536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f040c0c38d0 0x7f040c14ee20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.541+0000 7f04111ff700 1 -- 172.21.15.72:0/1541080536 >> 172.21.15.72:0/1541080536 conn(0x7f040c0c7e00 msgr2=0x7f040c14fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:26.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.541+0000 7f04111ff700 1 -- 172.21.15.72:0/1541080536 shutdown_connections 2023-08-31T18:48:26.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.541+0000 7f04111ff700 1 -- 172.21.15.72:0/1541080536 wait complete. 2023-08-31T18:48:26.558 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:48:26.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.745+0000 7f57be5ff700 1 Processor -- start 2023-08-31T18:48:26.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.746+0000 7f57be5ff700 1 -- start start 2023-08-31T18:48:26.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.747+0000 7f57be5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f57b80c4740 0x7f57b8157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:26.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.747+0000 7f57be5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b8063be0 con 0x7f57b80c6c30 2023-08-31T18:48:26.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.747+0000 7f57be5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b8158640 con 0x7f57b81581d0 2023-08-31T18:48:26.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.747+0000 7f57be5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b80bca10 con 0x7f57b80c4740 2023-08-31T18:48:26.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.747+0000 7f57b77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f57b80c4740 0x7f57b8157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:26.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.747+0000 7f57b77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f57b80c4740 0x7f57b8157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33016/0 (socket says 172.21.15.72:33016) 2023-08-31T18:48:26.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.747+0000 7f57b77fe700 1 -- 172.21.15.72:0/406240580 learned_addr learned my addr 172.21.15.72:0/406240580 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:26.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.747+0000 7f57b7fff700 1 --1- 172.21.15.72:0/406240580 >> v1:172.21.15.72:6789/0 conn(0x7f57b80c6c30 0x7f57b80bc300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40164/0 (socket says 172.21.15.72:40164) 2023-08-31T18:48:26.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.748+0000 7f57b77fe700 1 -- 172.21.15.72:0/406240580 >> v1:172.21.15.146:6789/0 conn(0x7f57b81581d0 legacy=0x7f57b80c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.748+0000 7f57b77fe700 1 -- 172.21.15.72:0/406240580 >> v1:172.21.15.72:6789/0 conn(0x7f57b80c6c30 legacy=0x7f57b80bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.748+0000 7f57b77fe700 1 -- 172.21.15.72:0/406240580 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b8063010 con 0x7f57b80c4740 2023-08-31T18:48:26.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.748+0000 7f57b77fe700 1 --2- 172.21.15.72:0/406240580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80c4740 0x7f57b8157ce0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f57ac006fd0 tx=0x7f57ac0090f0).ready entity=mon.0 client_cookie=28d8fa3f56c74068 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:26.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.748+0000 7f57b6ffd700 1 -- 172.21.15.72:0/406240580 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00b600 con 0x7f57b80c4740 2023-08-31T18:48:26.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.748+0000 7f57b6ffd700 1 -- 172.21.15.72:0/406240580 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac00b760 con 0x7f57b80c4740 2023-08-31T18:48:26.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.748+0000 7f57b6ffd700 1 -- 172.21.15.72:0/406240580 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00bae0 con 0x7f57b80c4740 2023-08-31T18:48:26.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.749+0000 7f57be5ff700 1 -- 172.21.15.72:0/406240580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80c4740 msgr2=0x7f57b8157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.749+0000 7f57be5ff700 1 --2- 172.21.15.72:0/406240580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80c4740 0x7f57b8157ce0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f57ac006fd0 tx=0x7f57ac0090f0).stop 2023-08-31T18:48:26.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.749+0000 7f57be5ff700 1 -- 172.21.15.72:0/406240580 shutdown_connections 2023-08-31T18:48:26.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.749+0000 7f57be5ff700 1 --2- 172.21.15.72:0/406240580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80c4740 0x7f57b8157ce0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.749+0000 7f57be5ff700 1 -- 172.21.15.72:0/406240580 >> 172.21.15.72:0/406240580 conn(0x7f57b80c7e70 msgr2=0x7f57b80c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:26.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.749+0000 7f57be5ff700 1 -- 172.21.15.72:0/406240580 shutdown_connections 2023-08-31T18:48:26.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.749+0000 7f57be5ff700 1 -- 172.21.15.72:0/406240580 wait complete. 2023-08-31T18:48:26.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.750+0000 7f57be5ff700 1 Processor -- start 2023-08-31T18:48:26.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.750+0000 7f57be5ff700 1 -- start start 2023-08-31T18:48:26.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.751+0000 7f57be5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80c4740 0x7f57b80aace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:26.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.751+0000 7f57be5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57b80c6c30 0x7f57b80acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:26.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.751+0000 7f57be5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57b81581d0 0x7f57b80a5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:26.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.751+0000 7f57be5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b81653f0 con 0x7f57b80c4740 2023-08-31T18:48:26.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.751+0000 7f57be5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b8164590 con 0x7f57b80c6c30 2023-08-31T18:48:26.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.751+0000 7f57be5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b81647e0 con 0x7f57b81581d0 2023-08-31T18:48:26.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f57b7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80c4740 0x7f57b80aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:26.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f57b7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80c4740 0x7f57b80aace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33018/0 (socket says 172.21.15.72:33018) 2023-08-31T18:48:26.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f57b7fff700 1 -- 172.21.15.72:0/1730797174 learned_addr learned my addr 172.21.15.72:0/1730797174 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:26.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f57b77fe700 1 --2- 172.21.15.72:0/1730797174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57b80c6c30 0x7f57b80acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:26.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f57bcb9c700 1 --2- 172.21.15.72:0/1730797174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57b81581d0 0x7f57b80a5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:26.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f57b7fff700 1 -- 172.21.15.72:0/1730797174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57b81581d0 msgr2=0x7f57b80a5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f57b7fff700 1 --2- 172.21.15.72:0/1730797174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57b81581d0 0x7f57b80a5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f57b7fff700 1 -- 172.21.15.72:0/1730797174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57b80c6c30 msgr2=0x7f57b80acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f57b7fff700 1 --2- 172.21.15.72:0/1730797174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57b80c6c30 0x7f57b80acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f57b7fff700 1 -- 172.21.15.72:0/1730797174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac009370 con 0x7f57b80c4740 2023-08-31T18:48:26.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f57bcb9c700 1 --2- 172.21.15.72:0/1730797174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57b81581d0 0x7f57b80a5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:26.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f57b7fff700 1 --2- 172.21.15.72:0/1730797174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80c4740 0x7f57b80aace0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f57a8001eb0 tx=0x7f57a8007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:26.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f579ffff700 1 -- 172.21.15.72:0/1730797174 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80072e0 con 0x7f57b80c4740 2023-08-31T18:48:26.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f579ffff700 1 -- 172.21.15.72:0/1730797174 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a8007440 con 0x7f57b80c4740 2023-08-31T18:48:26.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f579ffff700 1 -- 172.21.15.72:0/1730797174 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80058f0 con 0x7f57b80c4740 2023-08-31T18:48:26.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.752+0000 7f57be5ff700 1 -- 172.21.15.72:0/1730797174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b8164ac0 con 0x7f57b80c4740 2023-08-31T18:48:26.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.753+0000 7f57be5ff700 1 -- 172.21.15.72:0/1730797174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b8165100 con 0x7f57b80c4740 2023-08-31T18:48:26.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.753+0000 7f57be5ff700 1 -- 172.21.15.72:0/1730797174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b8165700 con 0x7f57b80c4740 2023-08-31T18:48:26.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.754+0000 7f579ffff700 1 -- 172.21.15.72:0/1730797174 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f57a8005ce0 con 0x7f57b80c4740 2023-08-31T18:48:26.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.755+0000 7f579ffff700 1 --2- 172.21.15.72:0/1730797174 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f57a405ee10 0x7f57a40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:26.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.755+0000 7f579ffff700 1 -- 172.21.15.72:0/1730797174 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f57a80795c0 con 0x7f57b80c4740 2023-08-31T18:48:26.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.756+0000 7f57b77fe700 1 --2- 172.21.15.72:0/1730797174 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f57a405ee10 0x7f57a40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:26.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.756+0000 7f57b77fe700 1 --2- 172.21.15.72:0/1730797174 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f57a405ee10 0x7f57a40612d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f57ac009130 tx=0x7f57ac017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:26.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.759+0000 7f579ffff700 1 -- 172.21.15.72:0/1730797174 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f57a804a970 con 0x7f57b80c4740 2023-08-31T18:48:26.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.929+0000 7f57be5ff700 1 -- 172.21.15.72:0/1730797174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57b80ab230 con 0x7f57b80c4740 2023-08-31T18:48:26.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.930+0000 7f579ffff700 1 -- 172.21.15.72:0/1730797174 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17024 (secure 0 0 0) 0x7f57a804df90 con 0x7f57b80c4740 2023-08-31T18:48:26.931 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:26.931 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:53.972412+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:47:51.003304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-31T18:47:51.950765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:48:26.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.932+0000 7f57be5ff700 1 -- 172.21.15.72:0/1730797174 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f57a405ee10 msgr2=0x7f57a40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.932+0000 7f57be5ff700 1 --2- 172.21.15.72:0/1730797174 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f57a405ee10 0x7f57a40612d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f57ac009130 tx=0x7f57ac017000).stop 2023-08-31T18:48:26.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.932+0000 7f57be5ff700 1 -- 172.21.15.72:0/1730797174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80c4740 msgr2=0x7f57b80aace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:26.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.932+0000 7f57be5ff700 1 --2- 172.21.15.72:0/1730797174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80c4740 0x7f57b80aace0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f57a8001eb0 tx=0x7f57a8007df0).stop 2023-08-31T18:48:26.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.932+0000 7f57be5ff700 1 -- 172.21.15.72:0/1730797174 shutdown_connections 2023-08-31T18:48:26.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.932+0000 7f57be5ff700 1 --2- 172.21.15.72:0/1730797174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f57b81581d0 0x7f57b80a5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.932+0000 7f57be5ff700 1 --2- 172.21.15.72:0/1730797174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b80c4740 0x7f57b80aace0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.932+0000 7f57be5ff700 1 --2- 172.21.15.72:0/1730797174 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f57a405ee10 0x7f57a40612d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.932+0000 7f57be5ff700 1 --2- 172.21.15.72:0/1730797174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57b80c6c30 0x7f57b80acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:26.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.932+0000 7f57be5ff700 1 -- 172.21.15.72:0/1730797174 >> 172.21.15.72:0/1730797174 conn(0x7f57b80c7e70 msgr2=0x7f57b8151c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:26.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.933+0000 7f57be5ff700 1 -- 172.21.15.72:0/1730797174 shutdown_connections 2023-08-31T18:48:26.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:26.933+0000 7f57be5ff700 1 -- 172.21.15.72:0/1730797174 wait complete. 2023-08-31T18:48:26.950 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T18:47:51.003304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T18:47:51.950765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T18:48:26.951 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T18:48:27.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.142+0000 7f6406fff700 1 Processor -- start 2023-08-31T18:48:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.142+0000 7f6406fff700 1 -- start start 2023-08-31T18:48:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.143+0000 7f6406fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64000637c0 0x7f640015f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.143+0000 7f6406fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64000bfd40 con 0x7f6400154210 2023-08-31T18:48:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.143+0000 7f6406fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64000c6730 con 0x7f6400153e30 2023-08-31T18:48:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.143+0000 7f6406fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64001546c0 con 0x7f64000637c0 2023-08-31T18:48:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.144+0000 7f63fffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6400154210 0x7f64000630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40174/0 (socket says 172.21.15.72:40174) 2023-08-31T18:48:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.144+0000 7f63fffff700 1 -- 172.21.15.72:0/2026505723 learned_addr learned my addr 172.21.15.72:0/2026505723 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:27.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.144+0000 7f640559c700 1 --2- 172.21.15.72:0/2026505723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64000637c0 0x7f640015f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.144+0000 7f63ff7fe700 1 -- 172.21.15.72:0/2026505723 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912510415 0 0) 0x7f64000bfd40 con 0x7f6400154210 2023-08-31T18:48:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.144+0000 7f63ff7fe700 1 -- 172.21.15.72:0/2026505723 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63f00033f0 con 0x7f6400154210 2023-08-31T18:48:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.144+0000 7f63ff7fe700 1 -- 172.21.15.72:0/2026505723 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636841616 0 0) 0x7f64000c6730 con 0x7f6400153e30 2023-08-31T18:48:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.144+0000 7f63ff7fe700 1 -- 172.21.15.72:0/2026505723 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64000bfd40 con 0x7f6400153e30 2023-08-31T18:48:27.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.144+0000 7f640559c700 1 -- 172.21.15.72:0/2026505723 >> v1:172.21.15.146:6789/0 conn(0x7f6400153e30 legacy=0x7f64000c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.144+0000 7f640559c700 1 -- 172.21.15.72:0/2026505723 >> v1:172.21.15.72:6789/0 conn(0x7f6400154210 legacy=0x7f64000630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.144+0000 7f640559c700 1 -- 172.21.15.72:0/2026505723 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64000bffe0 con 0x7f64000637c0 2023-08-31T18:48:27.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.144+0000 7f640559c700 1 --2- 172.21.15.72:0/2026505723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64000637c0 0x7f640015f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f63f8009e90 tx=0x7f63f8009780).ready entity=mon.2 client_cookie=a5fa97d93626a72b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:27.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.145+0000 7f63ff7fe700 1 -- 172.21.15.72:0/2026505723 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f800e070 con 0x7f64000637c0 2023-08-31T18:48:27.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.145+0000 7f63ff7fe700 1 -- 172.21.15.72:0/2026505723 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f800bab0 con 0x7f64000637c0 2023-08-31T18:48:27.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.145+0000 7f63ff7fe700 1 -- 172.21.15.72:0/2026505723 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f800be30 con 0x7f64000637c0 2023-08-31T18:48:27.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.145+0000 7f6406fff700 1 -- 172.21.15.72:0/2026505723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64000637c0 msgr2=0x7f640015f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.145+0000 7f6406fff700 1 --2- 172.21.15.72:0/2026505723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64000637c0 0x7f640015f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f63f8009e90 tx=0x7f63f8009780).stop 2023-08-31T18:48:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.145+0000 7f6406fff700 1 -- 172.21.15.72:0/2026505723 shutdown_connections 2023-08-31T18:48:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.145+0000 7f6406fff700 1 --2- 172.21.15.72:0/2026505723 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64000637c0 0x7f640015f0b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.145+0000 7f6406fff700 1 -- 172.21.15.72:0/2026505723 >> 172.21.15.72:0/2026505723 conn(0x7f640005eb20 msgr2=0x7f64000cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.145+0000 7f6406fff700 1 -- 172.21.15.72:0/2026505723 shutdown_connections 2023-08-31T18:48:27.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.145+0000 7f6406fff700 1 -- 172.21.15.72:0/2026505723 wait complete. 2023-08-31T18:48:27.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.147+0000 7f6406fff700 1 Processor -- start 2023-08-31T18:48:27.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.147+0000 7f6406fff700 1 -- start start 2023-08-31T18:48:27.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.148+0000 7f6406fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64000637c0 0x7f640014f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.148+0000 7f6406fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6400153e30 0x7f64000b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.148+0000 7f6406fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6400154210 0x7f64000c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.148+0000 7f6406fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64000afc30 con 0x7f6400153e30 2023-08-31T18:48:27.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.148+0000 7f6406fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64000af020 con 0x7f64000637c0 2023-08-31T18:48:27.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.148+0000 7f6406fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64000af300 con 0x7f6400154210 2023-08-31T18:48:27.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.148+0000 7f63fffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6400153e30 0x7f64000b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.148+0000 7f63fffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6400153e30 0x7f64000b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33026/0 (socket says 172.21.15.72:33026) 2023-08-31T18:48:27.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.148+0000 7f63fffff700 1 -- 172.21.15.72:0/384440914 learned_addr learned my addr 172.21.15.72:0/384440914 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:27.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.148+0000 7f640559c700 1 --2- 172.21.15.72:0/384440914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6400154210 0x7f64000c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.148+0000 7f6404d9b700 1 --2- 172.21.15.72:0/384440914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64000637c0 0x7f640014f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.149+0000 7f63fffff700 1 -- 172.21.15.72:0/384440914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6400154210 msgr2=0x7f64000c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.149+0000 7f63fffff700 1 --2- 172.21.15.72:0/384440914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6400154210 0x7f64000c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.149+0000 7f63fffff700 1 -- 172.21.15.72:0/384440914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64000637c0 msgr2=0x7f640014f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.149+0000 7f63fffff700 1 --2- 172.21.15.72:0/384440914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64000637c0 0x7f640014f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.149+0000 7f63fffff700 1 -- 172.21.15.72:0/384440914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8009a20 con 0x7f6400153e30 2023-08-31T18:48:27.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.149+0000 7f63fffff700 1 --2- 172.21.15.72:0/384440914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6400153e30 0x7f64000b0640 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f63ec00c490 tx=0x7f63ec007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:27.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.149+0000 7f63fcff9700 1 -- 172.21.15.72:0/384440914 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec0070d0 con 0x7f6400153e30 2023-08-31T18:48:27.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.149+0000 7f63fcff9700 1 -- 172.21.15.72:0/384440914 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ec007230 con 0x7f6400153e30 2023-08-31T18:48:27.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.149+0000 7f63fcff9700 1 -- 172.21.15.72:0/384440914 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ec0075b0 con 0x7f6400153e30 2023-08-31T18:48:27.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.149+0000 7f6406fff700 1 -- 172.21.15.72:0/384440914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64000af5e0 con 0x7f6400153e30 2023-08-31T18:48:27.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.149+0000 7f6406fff700 1 -- 172.21.15.72:0/384440914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640014f560 con 0x7f6400153e30 2023-08-31T18:48:27.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.150+0000 7f6406fff700 1 -- 172.21.15.72:0/384440914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64000afda0 con 0x7f6400153e30 2023-08-31T18:48:27.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.151+0000 7f63fcff9700 1 -- 172.21.15.72:0/384440914 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f63ec0059b0 con 0x7f6400153e30 2023-08-31T18:48:27.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.152+0000 7f63fcff9700 1 --2- 172.21.15.72:0/384440914 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63e405ee10 0x7f63e40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.152+0000 7f63fcff9700 1 -- 172.21.15.72:0/384440914 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f63ec079580 con 0x7f6400153e30 2023-08-31T18:48:27.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.153+0000 7f6404d9b700 1 --2- 172.21.15.72:0/384440914 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63e405ee10 0x7f63e40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.153+0000 7f6404d9b700 1 --2- 172.21.15.72:0/384440914 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63e405ee10 0x7f63e40612d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f63f4003930 tx=0x7f63f4007bd0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:27.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.156+0000 7f63fcff9700 1 -- 172.21.15.72:0/384440914 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f63ec04a930 con 0x7f6400153e30 2023-08-31T18:48:27.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.326+0000 7f6406fff700 1 -- 172.21.15.72:0/384440914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f64000c02c0 con 0x7f6400153e30 2023-08-31T18:48:27.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.328+0000 7f63fcff9700 1 -- 172.21.15.72:0/384440914 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f63ec04df50 con 0x7f6400153e30 2023-08-31T18:48:27.328 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T18:48:27.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.330+0000 7f6406fff700 1 -- 172.21.15.72:0/384440914 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63e405ee10 msgr2=0x7f63e40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.330+0000 7f6406fff700 1 --2- 172.21.15.72:0/384440914 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63e405ee10 0x7f63e40612d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f63f4003930 tx=0x7f63f4007bd0).stop 2023-08-31T18:48:27.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.330+0000 7f6406fff700 1 -- 172.21.15.72:0/384440914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6400153e30 msgr2=0x7f64000b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.330+0000 7f6406fff700 1 --2- 172.21.15.72:0/384440914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6400153e30 0x7f64000b0640 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f63ec00c490 tx=0x7f63ec007d20).stop 2023-08-31T18:48:27.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.330+0000 7f6406fff700 1 -- 172.21.15.72:0/384440914 shutdown_connections 2023-08-31T18:48:27.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.331+0000 7f6406fff700 1 --2- 172.21.15.72:0/384440914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6400154210 0x7f64000c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.331+0000 7f6406fff700 1 --2- 172.21.15.72:0/384440914 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63e405ee10 0x7f63e40612d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.331+0000 7f6406fff700 1 --2- 172.21.15.72:0/384440914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64000637c0 0x7f640014f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.331+0000 7f6406fff700 1 --2- 172.21.15.72:0/384440914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6400153e30 0x7f64000b0640 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.331+0000 7f6406fff700 1 -- 172.21.15.72:0/384440914 >> 172.21.15.72:0/384440914 conn(0x7f640005eb20 msgr2=0x7f6400152e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.331+0000 7f6406fff700 1 -- 172.21.15.72:0/384440914 shutdown_connections 2023-08-31T18:48:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.331+0000 7f6406fff700 1 -- 172.21.15.72:0/384440914 wait complete. 2023-08-31T18:48:27.348 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T18:48:27.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.539+0000 7fc55fdff700 1 Processor -- start 2023-08-31T18:48:27.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.539+0000 7fc55fdff700 1 -- start start 2023-08-31T18:48:27.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.540+0000 7fc55fdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5580637c0 0x7fc55815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.540+0000 7fc55fdff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5580bfd40 con 0x7fc558154210 2023-08-31T18:48:27.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.540+0000 7fc55fdff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5580c6730 con 0x7fc558153e30 2023-08-31T18:48:27.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.540+0000 7fc55fdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5581546c0 con 0x7fc5580637c0 2023-08-31T18:48:27.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.540+0000 7fc55d39a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc558154210 0x7fc5580630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40190/0 (socket says 172.21.15.72:40190) 2023-08-31T18:48:27.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.540+0000 7fc55d39a700 1 -- 172.21.15.72:0/1524670802 learned_addr learned my addr 172.21.15.72:0/1524670802 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:27.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55cb99700 1 -- 172.21.15.72:0/1524670802 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887338225 0 0) 0x7fc5580bfd40 con 0x7fc558154210 2023-08-31T18:48:27.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55e39c700 1 --2- 172.21.15.72:0/1524670802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5580637c0 0x7fc55815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55cb99700 1 -- 172.21.15.72:0/1524670802 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5440033f0 con 0x7fc558154210 2023-08-31T18:48:27.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55cb99700 1 -- 172.21.15.72:0/1524670802 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1597522856 0 0) 0x7fc5440033f0 con 0x7fc558154210 2023-08-31T18:48:27.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55cb99700 1 -- 172.21.15.72:0/1524670802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5580637c0 msgr2=0x7fc55815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:27.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55cb99700 1 --2- 172.21.15.72:0/1524670802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5580637c0 0x7fc55815f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55cb99700 1 -- 172.21.15.72:0/1524670802 >> v1:172.21.15.146:6789/0 conn(0x7fc558153e30 legacy=0x7fc5580c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55cb99700 1 -- 172.21.15.72:0/1524670802 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5580bffe0 con 0x7fc558154210 2023-08-31T18:48:27.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55cb99700 1 -- 172.21.15.72:0/1524670802 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fc548001470 con 0x7fc558154210 2023-08-31T18:48:27.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55cb99700 1 -- 172.21.15.72:0/1524670802 >> v1:172.21.15.72:6789/0 conn(0x7fc558154210 legacy=0x7fc5580630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55cb99700 1 --2- 172.21.15.72:0/1524670802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc544003910 0x7fc544003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55cb99700 1 --2- 172.21.15.72:0/1524670802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc544004690 0x7fc544004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55cb99700 1 --2- 172.21.15.72:0/1524670802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5580637c0 0x7fc544005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55cb99700 1 -- 172.21.15.72:0/1524670802 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54400b900 con 0x7fc544003910 2023-08-31T18:48:27.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55cb99700 1 -- 172.21.15.72:0/1524670802 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54400ba70 con 0x7fc544004690 2023-08-31T18:48:27.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55cb99700 1 -- 172.21.15.72:0/1524670802 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54400bc30 con 0x7fc5580637c0 2023-08-31T18:48:27.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.541+0000 7fc55db9b700 1 --2- 172.21.15.72:0/1524670802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc544003910 0x7fc544003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.542+0000 7fc55d39a700 1 --2- 172.21.15.72:0/1524670802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc544004690 0x7fc544004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.542+0000 7fc55e39c700 1 --2- 172.21.15.72:0/1524670802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5580637c0 0x7fc544005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.542+0000 7fc55db9b700 1 -- 172.21.15.72:0/1524670802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5580637c0 msgr2=0x7fc544005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:27.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.542+0000 7fc55db9b700 1 --2- 172.21.15.72:0/1524670802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc5580637c0 0x7fc544005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.542+0000 7fc55db9b700 1 -- 172.21.15.72:0/1524670802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc544004690 msgr2=0x7fc544004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:27.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.542+0000 7fc55db9b700 1 --2- 172.21.15.72:0/1524670802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc544004690 0x7fc544004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.542+0000 7fc55db9b700 1 -- 172.21.15.72:0/1524670802 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5440033f0 con 0x7fc544003910 2023-08-31T18:48:27.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.542+0000 7fc55db9b700 1 --2- 172.21.15.72:0/1524670802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc544003910 0x7fc544003cf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fc554001820 tx=0x7fc554007b90).ready entity=mon.0 client_cookie=b0230f1edae1fdd3 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:27.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.542+0000 7fc55cb99700 1 -- 172.21.15.72:0/1524670802 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554007ea0 con 0x7fc544003910 2023-08-31T18:48:27.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.542+0000 7fc55cb99700 1 -- 172.21.15.72:0/1524670802 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc554012400 con 0x7fc544003910 2023-08-31T18:48:27.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.542+0000 7fc55cb99700 1 -- 172.21.15.72:0/1524670802 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5540127c0 con 0x7fc544003910 2023-08-31T18:48:27.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.543+0000 7fc55fdff700 1 -- 172.21.15.72:0/1524670802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc544003910 msgr2=0x7fc544003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.543+0000 7fc55fdff700 1 --2- 172.21.15.72:0/1524670802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc544003910 0x7fc544003cf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fc554001820 tx=0x7fc554007b90).stop 2023-08-31T18:48:27.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.543+0000 7fc55e39c700 1 -- 172.21.15.72:0/1524670802 reap_dead start 2023-08-31T18:48:27.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.543+0000 7fc55fdff700 1 -- 172.21.15.72:0/1524670802 shutdown_connections 2023-08-31T18:48:27.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.543+0000 7fc55fdff700 1 -- 172.21.15.72:0/1524670802 >> 172.21.15.72:0/1524670802 conn(0x7fc55805eb20 msgr2=0x7fc5580cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:27.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.543+0000 7fc55fdff700 1 -- 172.21.15.72:0/1524670802 shutdown_connections 2023-08-31T18:48:27.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.543+0000 7fc55fdff700 1 -- 172.21.15.72:0/1524670802 wait complete. 2023-08-31T18:48:27.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.544+0000 7fc55fdff700 1 Processor -- start 2023-08-31T18:48:27.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.545+0000 7fc55fdff700 1 -- start start 2023-08-31T18:48:27.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.545+0000 7fc55fdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc544003910 0x7fc55814f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55fdff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55814fb00 0x7fc558157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55fdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5580c47d0 0x7fc5580c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55fdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55815a960 con 0x7fc5580c47d0 2023-08-31T18:48:27.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55fdff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc558158b00 con 0x7fc55814fb00 2023-08-31T18:48:27.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55fdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc558157a00 con 0x7fc544003910 2023-08-31T18:48:27.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55e39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5580c47d0 0x7fc5580c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55e39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5580c47d0 0x7fc5580c4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33042/0 (socket says 172.21.15.72:33042) 2023-08-31T18:48:27.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55e39c700 1 -- 172.21.15.72:0/2737850890 learned_addr learned my addr 172.21.15.72:0/2737850890 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:27.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55e39c700 1 -- 172.21.15.72:0/2737850890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc544003910 msgr2=0x7fc55814f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55d39a700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55814fb00 0x7fc558157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55db9b700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc544003910 0x7fc55814f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55e39c700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc544003910 0x7fc55814f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55e39c700 1 -- 172.21.15.72:0/2737850890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55814fb00 msgr2=0x7fc558157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55e39c700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55814fb00 0x7fc558157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55e39c700 1 -- 172.21.15.72:0/2737850890 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5580c5120 con 0x7fc5580c47d0 2023-08-31T18:48:27.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55db9b700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc544003910 0x7fc55814f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:27.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55d39a700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55814fb00 0x7fc558157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:27.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc55e39c700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5580c47d0 0x7fc5580c4c30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fc550007de0 tx=0x7fc55000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:27.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.546+0000 7fc54dffb700 1 -- 172.21.15.72:0/2737850890 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55000e070 con 0x7fc5580c47d0 2023-08-31T18:48:27.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.547+0000 7fc54dffb700 1 -- 172.21.15.72:0/2737850890 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc550011d30 con 0x7fc5580c47d0 2023-08-31T18:48:27.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.547+0000 7fc54dffb700 1 -- 172.21.15.72:0/2737850890 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc550016680 con 0x7fc5580c47d0 2023-08-31T18:48:27.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.547+0000 7fc55fdff700 1 -- 172.21.15.72:0/2737850890 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc558155230 con 0x7fc5580c47d0 2023-08-31T18:48:27.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.547+0000 7fc55fdff700 1 -- 172.21.15.72:0/2737850890 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc558158d50 con 0x7fc5580c47d0 2023-08-31T18:48:27.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.548+0000 7fc55fdff700 1 -- 172.21.15.72:0/2737850890 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc558155750 con 0x7fc5580c47d0 2023-08-31T18:48:27.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.548+0000 7fc54dffb700 1 -- 172.21.15.72:0/2737850890 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc55001f3b0 con 0x7fc5580c47d0 2023-08-31T18:48:27.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.549+0000 7fc54dffb700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc53c05ee10 0x7fc53c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.549+0000 7fc54dffb700 1 -- 172.21.15.72:0/2737850890 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc55007a420 con 0x7fc5580c47d0 2023-08-31T18:48:27.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.549+0000 7fc55db9b700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc53c05ee10 0x7fc53c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.550+0000 7fc55db9b700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc53c05ee10 0x7fc53c0612d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc554001820 tx=0x7fc554016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:27.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.553+0000 7fc54dffb700 1 -- 172.21.15.72:0/2737850890 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc55004b830 con 0x7fc5580c47d0 2023-08-31T18:48:27.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.719+0000 7fc55fdff700 1 -- 172.21.15.72:0/2737850890 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc55806c6b0 con 0x7fc5580c47d0 2023-08-31T18:48:27.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.719+0000 7fc54dffb700 1 -- 172.21.15.72:0/2737850890 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc550011ea0 con 0x7fc5580c47d0 2023-08-31T18:48:27.720 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T18:48:27.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.721+0000 7fc55fdff700 1 -- 172.21.15.72:0/2737850890 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc53c05ee10 msgr2=0x7fc53c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.721+0000 7fc55fdff700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc53c05ee10 0x7fc53c0612d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc554001820 tx=0x7fc554016000).stop 2023-08-31T18:48:27.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.721+0000 7fc55fdff700 1 -- 172.21.15.72:0/2737850890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5580c47d0 msgr2=0x7fc5580c4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.721+0000 7fc55fdff700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5580c47d0 0x7fc5580c4c30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fc550007de0 tx=0x7fc55000b040).stop 2023-08-31T18:48:27.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.721+0000 7fc55fdff700 1 -- 172.21.15.72:0/2737850890 shutdown_connections 2023-08-31T18:48:27.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.721+0000 7fc55fdff700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5580c47d0 0x7fc5580c4c30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.721+0000 7fc55fdff700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc544003910 0x7fc55814f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.721+0000 7fc55fdff700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc53c05ee10 0x7fc53c0612d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.721+0000 7fc55fdff700 1 --2- 172.21.15.72:0/2737850890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc55814fb00 0x7fc558157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.721+0000 7fc55fdff700 1 -- 172.21.15.72:0/2737850890 >> 172.21.15.72:0/2737850890 conn(0x7fc55805eb20 msgr2=0x7fc5580c8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:27.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.722+0000 7fc55fdff700 1 -- 172.21.15.72:0/2737850890 shutdown_connections 2023-08-31T18:48:27.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.722+0000 7fc55fdff700 1 -- 172.21.15.72:0/2737850890 wait complete. 2023-08-31T18:48:27.739 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T18:48:27.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.929+0000 7f24e95ff700 1 Processor -- start 2023-08-31T18:48:27.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.930+0000 7f24e95ff700 1 -- start start 2023-08-31T18:48:27.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.931+0000 7f24e95ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24e4153e30 0x7f24e4154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.931+0000 7f24e95ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24e40c5cb0 0x7f24e40c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.931+0000 7f24e95ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e40bfd40 con 0x7f24e40630b0 2023-08-31T18:48:27.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.931+0000 7f24e95ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e40c6730 con 0x7f24e4153e30 2023-08-31T18:48:27.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.931+0000 7f24e95ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e40bffe0 con 0x7f24e40c5cb0 2023-08-31T18:48:27.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.931+0000 7f24e2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24e4153e30 0x7f24e4154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.931+0000 7f24e37fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f24e40630b0 0x7f24e4157d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40202/0 (socket says 172.21.15.72:40202) 2023-08-31T18:48:27.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.931+0000 7f24e37fe700 1 -- 172.21.15.72:0/2466688979 learned_addr learned my addr 172.21.15.72:0/2466688979 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:27.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.932+0000 7f24e27fc700 1 --2- 172.21.15.72:0/2466688979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24e40c5cb0 0x7f24e40c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.932+0000 7f24e2ffd700 1 -- 172.21.15.72:0/2466688979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24e40c5cb0 msgr2=0x7f24e40c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:27.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.932+0000 7f24e2ffd700 1 --2- 172.21.15.72:0/2466688979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24e40c5cb0 0x7f24e40c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.932+0000 7f24e2ffd700 1 -- 172.21.15.72:0/2466688979 >> v1:172.21.15.72:6789/0 conn(0x7f24e40630b0 legacy=0x7f24e4157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.932+0000 7f24e2ffd700 1 -- 172.21.15.72:0/2466688979 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e40c02c0 con 0x7f24e4153e30 2023-08-31T18:48:27.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.932+0000 7f24e1ffb700 1 -- 172.21.15.72:0/2466688979 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992879396 0 0) 0x7f24e40bfd40 con 0x7f24e40630b0 2023-08-31T18:48:27.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.932+0000 7f24e2ffd700 1 --2- 172.21.15.72:0/2466688979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e4153e30 0x7f24e4154210 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f24d4009760 tx=0x7f24d4009060).ready entity=mon.0 client_cookie=aa629560b2f24b5b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:27.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.932+0000 7f24e1ffb700 1 -- 172.21.15.72:0/2466688979 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d40090d0 con 0x7f24e4153e30 2023-08-31T18:48:27.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.932+0000 7f24e1ffb700 1 -- 172.21.15.72:0/2466688979 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d400b580 con 0x7f24e4153e30 2023-08-31T18:48:27.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.932+0000 7f24e1ffb700 1 -- 172.21.15.72:0/2466688979 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d400b900 con 0x7f24e4153e30 2023-08-31T18:48:27.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.933+0000 7f24e95ff700 1 -- 172.21.15.72:0/2466688979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e4153e30 msgr2=0x7f24e4154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.933+0000 7f24e95ff700 1 --2- 172.21.15.72:0/2466688979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e4153e30 0x7f24e4154210 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f24d4009760 tx=0x7f24d4009060).stop 2023-08-31T18:48:27.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.933+0000 7f24e95ff700 1 -- 172.21.15.72:0/2466688979 shutdown_connections 2023-08-31T18:48:27.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.933+0000 7f24e95ff700 1 --2- 172.21.15.72:0/2466688979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e4153e30 0x7f24e4154210 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.933+0000 7f24e95ff700 1 --2- 172.21.15.72:0/2466688979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24e40c5cb0 0x7f24e40c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.933+0000 7f24e95ff700 1 -- 172.21.15.72:0/2466688979 >> 172.21.15.72:0/2466688979 conn(0x7f24e405eb20 msgr2=0x7f24e40cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:27.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.933+0000 7f24e95ff700 1 -- 172.21.15.72:0/2466688979 shutdown_connections 2023-08-31T18:48:27.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.933+0000 7f24e95ff700 1 -- 172.21.15.72:0/2466688979 wait complete. 2023-08-31T18:48:27.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.935+0000 7f24e95ff700 1 Processor -- start 2023-08-31T18:48:27.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.935+0000 7f24e95ff700 1 -- start start 2023-08-31T18:48:27.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.936+0000 7f24e95ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24e40630b0 0x7f24e40c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.936+0000 7f24e95ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24e40c5cb0 0x7f24e4152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.936+0000 7f24e95ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e4153e30 0x7f24e4163fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.936+0000 7f24e95ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e40c3e40 con 0x7f24e4153e30 2023-08-31T18:48:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.936+0000 7f24e95ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e40c3230 con 0x7f24e40c5cb0 2023-08-31T18:48:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.936+0000 7f24e95ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e40c3510 con 0x7f24e40630b0 2023-08-31T18:48:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.937+0000 7f24e37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e4153e30 0x7f24e4163fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.937+0000 7f24e37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e4153e30 0x7f24e4163fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33052/0 (socket says 172.21.15.72:33052) 2023-08-31T18:48:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.937+0000 7f24e37fe700 1 -- 172.21.15.72:0/3651303897 learned_addr learned my addr 172.21.15.72:0/3651303897 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.937+0000 7f24e27fc700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24e40c5cb0 0x7f24e4152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.937+0000 7f24e2ffd700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24e40630b0 0x7f24e40c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.937+0000 7f24e37fe700 1 -- 172.21.15.72:0/3651303897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24e40630b0 msgr2=0x7f24e40c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.937+0000 7f24e37fe700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24e40630b0 0x7f24e40c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.937+0000 7f24e37fe700 1 -- 172.21.15.72:0/3651303897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24e40c5cb0 msgr2=0x7f24e4152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.937+0000 7f24e37fe700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24e40c5cb0 0x7f24e4152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.937+0000 7f24e37fe700 1 -- 172.21.15.72:0/3651303897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d40092a0 con 0x7f24e4153e30 2023-08-31T18:48:27.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.937+0000 7f24e27fc700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24e40c5cb0 0x7f24e4152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:27.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.937+0000 7f24e2ffd700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24e40630b0 0x7f24e40c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:27.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.937+0000 7f24e37fe700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e4153e30 0x7f24e4163fe0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f24dc00c730 tx=0x7f24dc001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:27.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.937+0000 7f24daffd700 1 -- 172.21.15.72:0/3651303897 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc005d30 con 0x7f24e4153e30 2023-08-31T18:48:27.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.938+0000 7f24daffd700 1 -- 172.21.15.72:0/3651303897 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24dc005e90 con 0x7f24e4153e30 2023-08-31T18:48:27.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.938+0000 7f24e95ff700 1 -- 172.21.15.72:0/3651303897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e40c37f0 con 0x7f24e4153e30 2023-08-31T18:48:27.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.938+0000 7f24daffd700 1 -- 172.21.15.72:0/3651303897 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc007340 con 0x7f24e4153e30 2023-08-31T18:48:27.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.938+0000 7f24e95ff700 1 -- 172.21.15.72:0/3651303897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e40c2e50 con 0x7f24e4153e30 2023-08-31T18:48:27.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.939+0000 7f24e95ff700 1 -- 172.21.15.72:0/3651303897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e40c47c0 con 0x7f24e4153e30 2023-08-31T18:48:27.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.939+0000 7f24daffd700 1 -- 172.21.15.72:0/3651303897 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f24dc0076f0 con 0x7f24e4153e30 2023-08-31T18:48:27.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.940+0000 7f24daffd700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f24c405ee10 0x7f24c40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:27.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.940+0000 7f24daffd700 1 -- 172.21.15.72:0/3651303897 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f24dc079e50 con 0x7f24e4153e30 2023-08-31T18:48:27.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.940+0000 7f24e2ffd700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f24c405ee10 0x7f24c40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:27.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.941+0000 7f24e2ffd700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f24c405ee10 0x7f24c40612d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f24d400b340 tx=0x7f24d4017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:27.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:27.944+0000 7f24daffd700 1 -- 172.21.15.72:0/3651303897 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f24dc04b200 con 0x7f24e4153e30 2023-08-31T18:48:28.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.111+0000 7f24e95ff700 1 -- 172.21.15.72:0/3651303897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24e4062970 con 0x7f24e4153e30 2023-08-31T18:48:28.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.112+0000 7f24daffd700 1 -- 172.21.15.72:0/3651303897 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f24dc0079a0 con 0x7f24e4153e30 2023-08-31T18:48:28.113 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T18:48:28.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.114+0000 7f24e95ff700 1 -- 172.21.15.72:0/3651303897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f24c405ee10 msgr2=0x7f24c40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:28.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.114+0000 7f24e95ff700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f24c405ee10 0x7f24c40612d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f24d400b340 tx=0x7f24d4017000).stop 2023-08-31T18:48:28.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.114+0000 7f24e95ff700 1 -- 172.21.15.72:0/3651303897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e4153e30 msgr2=0x7f24e4163fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:28.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.114+0000 7f24e95ff700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e4153e30 0x7f24e4163fe0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f24dc00c730 tx=0x7f24dc001520).stop 2023-08-31T18:48:28.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.114+0000 7f24e95ff700 1 -- 172.21.15.72:0/3651303897 shutdown_connections 2023-08-31T18:48:28.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.114+0000 7f24e95ff700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24e4153e30 0x7f24e4163fe0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.114+0000 7f24e95ff700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f24e40630b0 0x7f24e40c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.114+0000 7f24e95ff700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f24c405ee10 0x7f24c40612d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.114+0000 7f24e95ff700 1 --2- 172.21.15.72:0/3651303897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24e40c5cb0 0x7f24e4152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.114+0000 7f24e95ff700 1 -- 172.21.15.72:0/3651303897 >> 172.21.15.72:0/3651303897 conn(0x7f24e405eb20 msgr2=0x7f24e406b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:28.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.114+0000 7f24e95ff700 1 -- 172.21.15.72:0/3651303897 shutdown_connections 2023-08-31T18:48:28.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.114+0000 7f24e95ff700 1 -- 172.21.15.72:0/3651303897 wait complete. 2023-08-31T18:48:28.135 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T18:48:28.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.329+0000 7f7fea7ff700 1 Processor -- start 2023-08-31T18:48:28.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.330+0000 7f7fea7ff700 1 -- start start 2023-08-31T18:48:28.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.332+0000 7f7fea7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7fe4154410 0x7f7fe40c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:28.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.332+0000 7f7fea7ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7fe40c7360 0x7f7fe4063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:28.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.332+0000 7f7fea7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe40c6ed0 con 0x7f7fe4154030 2023-08-31T18:48:28.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.332+0000 7f7fea7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe40c66e0 con 0x7f7fe4154410 2023-08-31T18:48:28.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.332+0000 7f7fea7ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe40c68c0 con 0x7f7fe40c7360 2023-08-31T18:48:28.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.332+0000 7f7fe37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7fe4154410 0x7f7fe40c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:28.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.332+0000 7f7fe37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7fe4154410 0x7f7fe40c06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33068/0 (socket says 172.21.15.72:33068) 2023-08-31T18:48:28.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.332+0000 7f7fe37fe700 1 -- 172.21.15.72:0/4178578655 learned_addr learned my addr 172.21.15.72:0/4178578655 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:28.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.332+0000 7f7fe3fff700 1 --1- 172.21.15.72:0/4178578655 >> v1:172.21.15.72:6789/0 conn(0x7f7fe4154030 0x7f7fe40aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40216/0 (socket says 172.21.15.72:40216) 2023-08-31T18:48:28.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.333+0000 7f7fe8d9c700 1 --2- 172.21.15.72:0/4178578655 >> v2:172.21.15.146:3300/0 conn(0x7f7fe40c7360 0x7f7fe4063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:28.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.333+0000 7f7fe37fe700 1 -- 172.21.15.72:0/4178578655 >> v2:172.21.15.146:3300/0 conn(0x7f7fe40c7360 msgr2=0x7f7fe4063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:28.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.333+0000 7f7fe37fe700 1 --2- 172.21.15.72:0/4178578655 >> v2:172.21.15.146:3300/0 conn(0x7f7fe40c7360 0x7f7fe4063120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.333+0000 7f7fe37fe700 1 -- 172.21.15.72:0/4178578655 >> v1:172.21.15.72:6789/0 conn(0x7f7fe4154030 legacy=0x7f7fe40aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:28.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.333+0000 7f7fe37fe700 1 -- 172.21.15.72:0/4178578655 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe40c0f30 con 0x7f7fe4154410 2023-08-31T18:48:28.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.333+0000 7f7fe2ffd700 1 -- 172.21.15.72:0/4178578655 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260105626 0 0) 0x7f7fe40c6ed0 con 0x7f7fe4154030 2023-08-31T18:48:28.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.333+0000 7f7fe37fe700 1 --2- 172.21.15.72:0/4178578655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe4154410 0x7f7fe40c06b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f7fe40aad30 tx=0x7f7fd80090f0).ready entity=mon.0 client_cookie=c3deb2121382089b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:28.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.333+0000 7f7fe2ffd700 1 -- 172.21.15.72:0/4178578655 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800b600 con 0x7f7fe4154410 2023-08-31T18:48:28.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.333+0000 7f7fe2ffd700 1 -- 172.21.15.72:0/4178578655 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd800b760 con 0x7f7fe4154410 2023-08-31T18:48:28.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.333+0000 7f7fe2ffd700 1 -- 172.21.15.72:0/4178578655 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800bb00 con 0x7f7fe4154410 2023-08-31T18:48:28.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.334+0000 7f7fea7ff700 1 -- 172.21.15.72:0/4178578655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe4154410 msgr2=0x7f7fe40c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:28.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.334+0000 7f7fea7ff700 1 --2- 172.21.15.72:0/4178578655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe4154410 0x7f7fe40c06b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f7fe40aad30 tx=0x7f7fd80090f0).stop 2023-08-31T18:48:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.334+0000 7f7fea7ff700 1 -- 172.21.15.72:0/4178578655 shutdown_connections 2023-08-31T18:48:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.334+0000 7f7fea7ff700 1 --2- 172.21.15.72:0/4178578655 >> v2:172.21.15.146:3300/0 conn(0x7f7fe40c7360 0x7f7fe4063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.334+0000 7f7fea7ff700 1 --2- 172.21.15.72:0/4178578655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe4154410 0x7f7fe40c06b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.334+0000 7f7fea7ff700 1 -- 172.21.15.72:0/4178578655 >> 172.21.15.72:0/4178578655 conn(0x7f7fe405eb60 msgr2=0x7f7fe40cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.334+0000 7f7fea7ff700 1 -- 172.21.15.72:0/4178578655 shutdown_connections 2023-08-31T18:48:28.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.334+0000 7f7fea7ff700 1 -- 172.21.15.72:0/4178578655 wait complete. 2023-08-31T18:48:28.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.335+0000 7f7fea7ff700 1 Processor -- start 2023-08-31T18:48:28.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.336+0000 7f7fea7ff700 1 -- start start 2023-08-31T18:48:28.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.336+0000 7f7fea7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe40c7360 0x7f7fe4149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:28.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.336+0000 7f7fea7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fe4154030 0x7f7fe415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:28.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.336+0000 7f7fea7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fe4154410 0x7f7fe40afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:28.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.336+0000 7f7fea7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4151440 con 0x7f7fe40c7360 2023-08-31T18:48:28.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.336+0000 7f7fea7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4150550 con 0x7f7fe4154030 2023-08-31T18:48:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.336+0000 7f7fea7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4150830 con 0x7f7fe4154410 2023-08-31T18:48:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.337+0000 7f7fe3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe40c7360 0x7f7fe4149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.337+0000 7f7fe3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe40c7360 0x7f7fe4149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33074/0 (socket says 172.21.15.72:33074) 2023-08-31T18:48:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.337+0000 7f7fe3fff700 1 -- 172.21.15.72:0/735081896 learned_addr learned my addr 172.21.15.72:0/735081896 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.337+0000 7f7fe37fe700 1 --2- 172.21.15.72:0/735081896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fe4154030 0x7f7fe415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.337+0000 7f7fe8d9c700 1 --2- 172.21.15.72:0/735081896 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fe4154410 0x7f7fe40afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.337+0000 7f7fe3fff700 1 -- 172.21.15.72:0/735081896 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fe4154410 msgr2=0x7f7fe40afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.337+0000 7f7fe3fff700 1 --2- 172.21.15.72:0/735081896 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fe4154410 0x7f7fe40afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.337+0000 7f7fe3fff700 1 -- 172.21.15.72:0/735081896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fe4154030 msgr2=0x7f7fe415a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.337+0000 7f7fe3fff700 1 --2- 172.21.15.72:0/735081896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fe4154030 0x7f7fe415a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.337+0000 7f7fe3fff700 1 -- 172.21.15.72:0/735081896 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd8009370 con 0x7f7fe40c7360 2023-08-31T18:48:28.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.337+0000 7f7fe37fe700 1 --2- 172.21.15.72:0/735081896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fe4154030 0x7f7fe415a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:28.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.337+0000 7f7fe3fff700 1 --2- 172.21.15.72:0/735081896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe40c7360 0x7f7fe4149730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f7fd400c560 tx=0x7f7fd4007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:28.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.337+0000 7f7fcbfff700 1 -- 172.21.15.72:0/735081896 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40072e0 con 0x7f7fe40c7360 2023-08-31T18:48:28.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.337+0000 7f7fcbfff700 1 -- 172.21.15.72:0/735081896 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd4007440 con 0x7f7fe40c7360 2023-08-31T18:48:28.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.338+0000 7f7fea7ff700 1 -- 172.21.15.72:0/735081896 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe4150b10 con 0x7f7fe40c7360 2023-08-31T18:48:28.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.338+0000 7f7fcbfff700 1 -- 172.21.15.72:0/735081896 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40058f0 con 0x7f7fe40c7360 2023-08-31T18:48:28.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.338+0000 7f7fea7ff700 1 -- 172.21.15.72:0/735081896 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe41510d0 con 0x7f7fe40c7360 2023-08-31T18:48:28.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.339+0000 7f7fea7ff700 1 -- 172.21.15.72:0/735081896 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe406c6b0 con 0x7f7fe40c7360 2023-08-31T18:48:28.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.339+0000 7f7fcbfff700 1 -- 172.21.15.72:0/735081896 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f7fd4005ce0 con 0x7f7fe40c7360 2023-08-31T18:48:28.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.341+0000 7f7fcbfff700 1 --2- 172.21.15.72:0/735081896 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7fd005ee10 0x7f7fd00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:28.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.341+0000 7f7fcbfff700 1 -- 172.21.15.72:0/735081896 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7fd40796d0 con 0x7f7fe40c7360 2023-08-31T18:48:28.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.341+0000 7f7fe37fe700 1 --2- 172.21.15.72:0/735081896 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7fd005ee10 0x7f7fd00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:28.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.341+0000 7f7fe37fe700 1 --2- 172.21.15.72:0/735081896 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7fd005ee10 0x7f7fd00612d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f7fe40ca3f0 tx=0x7f7fd8017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:28.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.345+0000 7f7fcbfff700 1 -- 172.21.15.72:0/735081896 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7fd404aa80 con 0x7f7fe40c7360 2023-08-31T18:48:28.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.514+0000 7f7fea7ff700 1 -- 172.21.15.72:0/735081896 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7fe406aac0 con 0x7f7fe40c7360 2023-08-31T18:48:28.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.515+0000 7f7fcbfff700 1 -- 172.21.15.72:0/735081896 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7fd404e0a0 con 0x7f7fe40c7360 2023-08-31T18:48:28.516 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T18:48:28.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.517+0000 7f7fea7ff700 1 -- 172.21.15.72:0/735081896 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7fd005ee10 msgr2=0x7f7fd00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:28.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.517+0000 7f7fea7ff700 1 --2- 172.21.15.72:0/735081896 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7fd005ee10 0x7f7fd00612d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f7fe40ca3f0 tx=0x7f7fd8017000).stop 2023-08-31T18:48:28.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.517+0000 7f7fea7ff700 1 -- 172.21.15.72:0/735081896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe40c7360 msgr2=0x7f7fe4149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:28.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.517+0000 7f7fea7ff700 1 --2- 172.21.15.72:0/735081896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe40c7360 0x7f7fe4149730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f7fd400c560 tx=0x7f7fd4007c90).stop 2023-08-31T18:48:28.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.517+0000 7f7fea7ff700 1 -- 172.21.15.72:0/735081896 shutdown_connections 2023-08-31T18:48:28.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.517+0000 7f7fea7ff700 1 --2- 172.21.15.72:0/735081896 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fe4154410 0x7f7fe40afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.517+0000 7f7fea7ff700 1 --2- 172.21.15.72:0/735081896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fe40c7360 0x7f7fe4149730 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.517+0000 7f7fea7ff700 1 --2- 172.21.15.72:0/735081896 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7fd005ee10 0x7f7fd00612d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.517+0000 7f7fea7ff700 1 --2- 172.21.15.72:0/735081896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fe4154030 0x7f7fe415a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.517+0000 7f7fea7ff700 1 -- 172.21.15.72:0/735081896 >> 172.21.15.72:0/735081896 conn(0x7f7fe405eb60 msgr2=0x7f7fe40c8090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:28.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.517+0000 7f7fea7ff700 1 -- 172.21.15.72:0/735081896 shutdown_connections 2023-08-31T18:48:28.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.517+0000 7f7fea7ff700 1 -- 172.21.15.72:0/735081896 wait complete. 2023-08-31T18:48:28.535 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:48:28.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.725+0000 7efebf3ff700 1 Processor -- start 2023-08-31T18:48:28.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.725+0000 7efebf3ff700 1 -- start start 2023-08-31T18:48:28.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.726+0000 7efebf3ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efeb8154060 0x7efeb8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:28.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.726+0000 7efebf3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb80cb9b0 0x7efeb81581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.726+0000 7efebf3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efeb81586b0 0x7efeb80c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.726+0000 7efebf3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb80c1380 con 0x7efeb81586b0 2023-08-31T18:48:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.726+0000 7efebf3ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb8158b60 con 0x7efeb8154060 2023-08-31T18:48:28.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.726+0000 7efebf3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80c6120 con 0x7efeb80cb9b0 2023-08-31T18:48:28.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.726+0000 7efebd99c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efeb81586b0 0x7efeb80c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:28.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.726+0000 7efebd99c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efeb81586b0 0x7efeb80c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33088/0 (socket says 172.21.15.72:33088) 2023-08-31T18:48:28.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.726+0000 7efebd99c700 1 -- 172.21.15.72:0/718695409 learned_addr learned my addr 172.21.15.72:0/718695409 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:28.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.727+0000 7efebc99a700 1 --2- 172.21.15.72:0/718695409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb80cb9b0 0x7efeb81581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:28.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.727+0000 7efebd99c700 1 -- 172.21.15.72:0/718695409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb80cb9b0 msgr2=0x7efeb81581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:28.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.727+0000 7efebd19b700 1 --2- 172.21.15.72:0/718695409 >> v2:172.21.15.146:3300/0 conn(0x7efeb8154060 0x7efeb8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:28.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.727+0000 7efebd99c700 1 --2- 172.21.15.72:0/718695409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb80cb9b0 0x7efeb81581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.727+0000 7efebd99c700 1 -- 172.21.15.72:0/718695409 >> v2:172.21.15.146:3300/0 conn(0x7efeb8154060 msgr2=0x7efeb8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:28.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.727+0000 7efebd99c700 1 --2- 172.21.15.72:0/718695409 >> v2:172.21.15.146:3300/0 conn(0x7efeb8154060 0x7efeb8157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.727+0000 7efebd99c700 1 -- 172.21.15.72:0/718695409 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb80c5e10 con 0x7efeb81586b0 2023-08-31T18:48:28.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.727+0000 7efebc99a700 1 --2- 172.21.15.72:0/718695409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb80cb9b0 0x7efeb81581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:28.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.727+0000 7efebd19b700 1 --2- 172.21.15.72:0/718695409 >> v2:172.21.15.146:3300/0 conn(0x7efeb8154060 0x7efeb8157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:28.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.727+0000 7efebd99c700 1 --2- 172.21.15.72:0/718695409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeb81586b0 0x7efeb80c65b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7efeb81557e0 tx=0x7efeb0009840).ready entity=mon.0 client_cookie=7a32edf4e27eed69 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:28.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.727+0000 7efeaffff700 1 -- 172.21.15.72:0/718695409 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb000e070 con 0x7efeb81586b0 2023-08-31T18:48:28.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.727+0000 7efeaffff700 1 -- 172.21.15.72:0/718695409 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb000ba40 con 0x7efeb81586b0 2023-08-31T18:48:28.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.727+0000 7efeaffff700 1 -- 172.21.15.72:0/718695409 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb000bdc0 con 0x7efeb81586b0 2023-08-31T18:48:28.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.728+0000 7efebf3ff700 1 -- 172.21.15.72:0/718695409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeb81586b0 msgr2=0x7efeb80c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:28.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.728+0000 7efebf3ff700 1 --2- 172.21.15.72:0/718695409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeb81586b0 0x7efeb80c65b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7efeb81557e0 tx=0x7efeb0009840).stop 2023-08-31T18:48:28.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.728+0000 7efebf3ff700 1 -- 172.21.15.72:0/718695409 shutdown_connections 2023-08-31T18:48:28.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.728+0000 7efebf3ff700 1 --2- 172.21.15.72:0/718695409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeb81586b0 0x7efeb80c65b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.728+0000 7efebf3ff700 1 --2- 172.21.15.72:0/718695409 >> v2:172.21.15.146:3300/0 conn(0x7efeb8154060 0x7efeb8157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.728+0000 7efebf3ff700 1 --2- 172.21.15.72:0/718695409 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb80cb9b0 0x7efeb81581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.728+0000 7efebf3ff700 1 -- 172.21.15.72:0/718695409 >> 172.21.15.72:0/718695409 conn(0x7efeb805e870 msgr2=0x7efeb80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:28.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.728+0000 7efebf3ff700 1 -- 172.21.15.72:0/718695409 shutdown_connections 2023-08-31T18:48:28.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.728+0000 7efebf3ff700 1 -- 172.21.15.72:0/718695409 wait complete. 2023-08-31T18:48:28.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.729+0000 7efebf3ff700 1 Processor -- start 2023-08-31T18:48:28.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.729+0000 7efebf3ff700 1 -- start start 2023-08-31T18:48:28.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.730+0000 7efebf3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeb80cb9b0 0x7efeb814bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:28.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.730+0000 7efebf3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeb8154060 0x7efeb8166c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:28.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.730+0000 7efebf3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb81586b0 0x7efeb8167120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:28.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.730+0000 7efebf3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80c4cd0 con 0x7efeb80cb9b0 2023-08-31T18:48:28.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.730+0000 7efebf3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb8148040 con 0x7efeb8154060 2023-08-31T18:48:28.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.730+0000 7efebf3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80c44c0 con 0x7efeb81586b0 2023-08-31T18:48:28.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.731+0000 7efebd19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeb80cb9b0 0x7efeb814bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:28.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.731+0000 7efebd19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeb80cb9b0 0x7efeb814bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33104/0 (socket says 172.21.15.72:33104) 2023-08-31T18:48:28.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.731+0000 7efebd19b700 1 -- 172.21.15.72:0/2694376864 learned_addr learned my addr 172.21.15.72:0/2694376864 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:28.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.731+0000 7efebc99a700 1 --2- 172.21.15.72:0/2694376864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeb8154060 0x7efeb8166c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:28.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.731+0000 7efebd99c700 1 --2- 172.21.15.72:0/2694376864 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb81586b0 0x7efeb8167120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:28.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.731+0000 7efebd19b700 1 -- 172.21.15.72:0/2694376864 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb81586b0 msgr2=0x7efeb8167120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:28.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.731+0000 7efebd19b700 1 --2- 172.21.15.72:0/2694376864 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb81586b0 0x7efeb8167120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.731+0000 7efebd19b700 1 -- 172.21.15.72:0/2694376864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeb8154060 msgr2=0x7efeb8166c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:28.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.731+0000 7efebd19b700 1 --2- 172.21.15.72:0/2694376864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeb8154060 0x7efeb8166c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.731+0000 7efebd19b700 1 -- 172.21.15.72:0/2694376864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb0009ae0 con 0x7efeb80cb9b0 2023-08-31T18:48:28.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.731+0000 7efebd19b700 1 --2- 172.21.15.72:0/2694376864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeb80cb9b0 0x7efeb814bb20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7efeb400c880 tx=0x7efeb4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:28.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.731+0000 7efead7fa700 1 -- 172.21.15.72:0/2694376864 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4010580 con 0x7efeb80cb9b0 2023-08-31T18:48:28.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.731+0000 7efead7fa700 1 -- 172.21.15.72:0/2694376864 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb40106e0 con 0x7efeb80cb9b0 2023-08-31T18:48:28.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.732+0000 7efebf3ff700 1 -- 172.21.15.72:0/2694376864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb814c370 con 0x7efeb80cb9b0 2023-08-31T18:48:28.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.732+0000 7efead7fa700 1 -- 172.21.15.72:0/2694376864 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4010a60 con 0x7efeb80cb9b0 2023-08-31T18:48:28.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.732+0000 7efebf3ff700 1 -- 172.21.15.72:0/2694376864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb80c4710 con 0x7efeb80cb9b0 2023-08-31T18:48:28.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.733+0000 7efebf3ff700 1 -- 172.21.15.72:0/2694376864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb814c650 con 0x7efeb80cb9b0 2023-08-31T18:48:28.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.733+0000 7efead7fa700 1 -- 172.21.15.72:0/2694376864 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7efeb401b460 con 0x7efeb80cb9b0 2023-08-31T18:48:28.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.734+0000 7efead7fa700 1 --2- 172.21.15.72:0/2694376864 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe9c05ee10 0x7efe9c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:28.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.734+0000 7efead7fa700 1 -- 172.21.15.72:0/2694376864 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efeb4079dd0 con 0x7efeb80cb9b0 2023-08-31T18:48:28.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.735+0000 7efebc99a700 1 --2- 172.21.15.72:0/2694376864 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe9c05ee10 0x7efe9c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:28.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.735+0000 7efebc99a700 1 --2- 172.21.15.72:0/2694376864 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe9c05ee10 0x7efe9c0612d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7efeb8065080 tx=0x7efea8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:28.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.738+0000 7efead7fa700 1 -- 172.21.15.72:0/2694376864 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efeb404b180 con 0x7efeb80cb9b0 2023-08-31T18:48:28.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.908+0000 7efebf3ff700 1 -- 172.21.15.72:0/2694376864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efeb806c6b0 con 0x7efeb80cb9b0 2023-08-31T18:48:28.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.909+0000 7efead7fa700 1 -- 172.21.15.72:0/2694376864 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17024 (secure 0 0 0) 0x7efeb404e7a0 con 0x7efeb80cb9b0 2023-08-31T18:48:28.910 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:28.910 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:53.972412+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:47:51.003304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-31T18:47:51.950765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:48:28.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.912+0000 7efebf3ff700 1 -- 172.21.15.72:0/2694376864 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe9c05ee10 msgr2=0x7efe9c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.912+0000 7efebf3ff700 1 --2- 172.21.15.72:0/2694376864 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe9c05ee10 0x7efe9c0612d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7efeb8065080 tx=0x7efea8008040).stop 2023-08-31T18:48:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.912+0000 7efebf3ff700 1 -- 172.21.15.72:0/2694376864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeb80cb9b0 msgr2=0x7efeb814bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.912+0000 7efebf3ff700 1 --2- 172.21.15.72:0/2694376864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeb80cb9b0 0x7efeb814bb20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7efeb400c880 tx=0x7efeb4008040).stop 2023-08-31T18:48:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.912+0000 7efebf3ff700 1 -- 172.21.15.72:0/2694376864 shutdown_connections 2023-08-31T18:48:28.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.912+0000 7efebf3ff700 1 --2- 172.21.15.72:0/2694376864 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeb81586b0 0x7efeb8167120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.912+0000 7efebf3ff700 1 --2- 172.21.15.72:0/2694376864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeb80cb9b0 0x7efeb814bb20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.912+0000 7efebf3ff700 1 --2- 172.21.15.72:0/2694376864 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe9c05ee10 0x7efe9c0612d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.912+0000 7efebf3ff700 1 --2- 172.21.15.72:0/2694376864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeb8154060 0x7efeb8166c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:28.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.912+0000 7efebf3ff700 1 -- 172.21.15.72:0/2694376864 >> 172.21.15.72:0/2694376864 conn(0x7efeb805e870 msgr2=0x7efeb8063b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:28.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.912+0000 7efebf3ff700 1 -- 172.21.15.72:0/2694376864 shutdown_connections 2023-08-31T18:48:28.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:28.912+0000 7efebf3ff700 1 -- 172.21.15.72:0/2694376864 wait complete. 2023-08-31T18:48:28.930 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T18:47:51.003304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T18:47:51.950765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T18:48:28.931 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T18:48:29.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.125+0000 7f23815ff700 1 Processor -- start 2023-08-31T18:48:29.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.125+0000 7f23815ff700 1 -- start start 2023-08-31T18:48:29.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.126+0000 7f23815ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f237c154030 0x7f237c154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.126+0000 7f23815ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f237c0c06b0 0x7f237c0c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.126+0000 7f23815ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237c0c6ed0 con 0x7f237c0aa140 2023-08-31T18:48:29.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.126+0000 7f23815ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c0c66e0 con 0x7f237c154030 2023-08-31T18:48:29.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.126+0000 7f23815ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c0c68c0 con 0x7f237c0c06b0 2023-08-31T18:48:29.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.127+0000 7f237a7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f237c0c06b0 0x7f237c0c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.127+0000 7f237a7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f237c0c06b0 0x7f237c0c7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:60942/0 (socket says 172.21.15.72:60942) 2023-08-31T18:48:29.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.127+0000 7f237a7fc700 1 -- 172.21.15.72:0/3608385999 learned_addr learned my addr 172.21.15.72:0/3608385999 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:29.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.127+0000 7f237affd700 1 --2- 172.21.15.72:0/3608385999 >> v2:172.21.15.146:3300/0 conn(0x7f237c154030 0x7f237c154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.127+0000 7f237a7fc700 1 -- 172.21.15.72:0/3608385999 >> v2:172.21.15.146:3300/0 conn(0x7f237c154030 msgr2=0x7f237c154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:29.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.127+0000 7f237a7fc700 1 --2- 172.21.15.72:0/3608385999 >> v2:172.21.15.146:3300/0 conn(0x7f237c154030 0x7f237c154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.127+0000 7f237a7fc700 1 -- 172.21.15.72:0/3608385999 >> v1:172.21.15.146:6789/0 conn(0x7f237c0aa140 legacy=0x7f237c063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.127+0000 7f237a7fc700 1 -- 172.21.15.72:0/3608385999 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c0c0f30 con 0x7f237c0c06b0 2023-08-31T18:48:29.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.127+0000 7f2379ffb700 1 -- 172.21.15.72:0/3608385999 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686749920 0 0) 0x7f237c0c6ed0 con 0x7f237c0aa140 2023-08-31T18:48:29.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.127+0000 7f237a7fc700 1 --2- 172.21.15.72:0/3608385999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f237c0c06b0 0x7f237c0c7360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f2370006fd0 tx=0x7f23700090f0).ready entity=mon.2 client_cookie=56a7d9df7103b897 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:29.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.128+0000 7f2379ffb700 1 -- 172.21.15.72:0/3608385999 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237000b580 con 0x7f237c0c06b0 2023-08-31T18:48:29.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.128+0000 7f2379ffb700 1 -- 172.21.15.72:0/3608385999 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237000b6e0 con 0x7f237c0c06b0 2023-08-31T18:48:29.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.128+0000 7f2379ffb700 1 -- 172.21.15.72:0/3608385999 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237000ba60 con 0x7f237c0c06b0 2023-08-31T18:48:29.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.128+0000 7f23815ff700 1 -- 172.21.15.72:0/3608385999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f237c0c06b0 msgr2=0x7f237c0c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.128+0000 7f23815ff700 1 --2- 172.21.15.72:0/3608385999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f237c0c06b0 0x7f237c0c7360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f2370006fd0 tx=0x7f23700090f0).stop 2023-08-31T18:48:29.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.128+0000 7f23815ff700 1 -- 172.21.15.72:0/3608385999 shutdown_connections 2023-08-31T18:48:29.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.128+0000 7f23815ff700 1 --2- 172.21.15.72:0/3608385999 >> v2:172.21.15.146:3300/0 conn(0x7f237c154030 0x7f237c154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.128+0000 7f23815ff700 1 --2- 172.21.15.72:0/3608385999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f237c0c06b0 0x7f237c0c7360 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.128+0000 7f23815ff700 1 -- 172.21.15.72:0/3608385999 >> 172.21.15.72:0/3608385999 conn(0x7f237c05eb60 msgr2=0x7f237c0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:29.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.128+0000 7f23815ff700 1 -- 172.21.15.72:0/3608385999 shutdown_connections 2023-08-31T18:48:29.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.128+0000 7f23815ff700 1 -- 172.21.15.72:0/3608385999 wait complete. 2023-08-31T18:48:29.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.130+0000 7f23815ff700 1 Processor -- start 2023-08-31T18:48:29.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.130+0000 7f23815ff700 1 -- start start 2023-08-31T18:48:29.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f23815ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c0aa140 0x7f237c13c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f23815ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f237c0c06b0 0x7f237c0c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f23815ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f237c154030 0x7f237c0ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f23815ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c0b0e40 con 0x7f237c0aa140 2023-08-31T18:48:29.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f23815ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c157980 con 0x7f237c0c06b0 2023-08-31T18:48:29.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f23815ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c157c60 con 0x7f237c154030 2023-08-31T18:48:29.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f237affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c0aa140 0x7f237c13c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f237affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c0aa140 0x7f237c13c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33106/0 (socket says 172.21.15.72:33106) 2023-08-31T18:48:29.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f237affd700 1 -- 172.21.15.72:0/191565402 learned_addr learned my addr 172.21.15.72:0/191565402 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:29.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f237b7fe700 1 --2- 172.21.15.72:0/191565402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f237c154030 0x7f237c0ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f237a7fc700 1 --2- 172.21.15.72:0/191565402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f237c0c06b0 0x7f237c0c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f237affd700 1 -- 172.21.15.72:0/191565402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f237c154030 msgr2=0x7f237c0ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f237affd700 1 --2- 172.21.15.72:0/191565402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f237c154030 0x7f237c0ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f237affd700 1 -- 172.21.15.72:0/191565402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f237c0c06b0 msgr2=0x7f237c0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f237affd700 1 --2- 172.21.15.72:0/191565402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f237c0c06b0 0x7f237c0c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f237affd700 1 -- 172.21.15.72:0/191565402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2370009370 con 0x7f237c0aa140 2023-08-31T18:48:29.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.131+0000 7f237a7fc700 1 --2- 172.21.15.72:0/191565402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f237c0c06b0 0x7f237c0c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:29.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.132+0000 7f237affd700 1 --2- 172.21.15.72:0/191565402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c0aa140 0x7f237c13c110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f236c00e930 tx=0x7f236c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:29.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.132+0000 7f2362ffd700 1 -- 172.21.15.72:0/191565402 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c012600 con 0x7f237c0aa140 2023-08-31T18:48:29.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.132+0000 7f2362ffd700 1 -- 172.21.15.72:0/191565402 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c012760 con 0x7f237c0aa140 2023-08-31T18:48:29.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.132+0000 7f23815ff700 1 -- 172.21.15.72:0/191565402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237c0c4d40 con 0x7f237c0aa140 2023-08-31T18:48:29.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.132+0000 7f2362ffd700 1 -- 172.21.15.72:0/191565402 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c012ae0 con 0x7f237c0aa140 2023-08-31T18:48:29.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.132+0000 7f23815ff700 1 -- 172.21.15.72:0/191565402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c0c2ed0 con 0x7f237c0aa140 2023-08-31T18:48:29.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.133+0000 7f23815ff700 1 -- 172.21.15.72:0/191565402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237c06c6b0 con 0x7f237c0aa140 2023-08-31T18:48:29.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.134+0000 7f2362ffd700 1 -- 172.21.15.72:0/191565402 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f236c01b400 con 0x7f237c0aa140 2023-08-31T18:48:29.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.134+0000 7f2362ffd700 1 --2- 172.21.15.72:0/191565402 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f236805ee10 0x7f23680612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.135+0000 7f2362ffd700 1 -- 172.21.15.72:0/191565402 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f236c07a150 con 0x7f237c0aa140 2023-08-31T18:48:29.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.135+0000 7f237a7fc700 1 --2- 172.21.15.72:0/191565402 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f236805ee10 0x7f23680612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.135+0000 7f237a7fc700 1 --2- 172.21.15.72:0/191565402 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f236805ee10 0x7f23680612d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f2370009130 tx=0x7f2370017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:29.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.139+0000 7f2362ffd700 1 -- 172.21.15.72:0/191565402 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f236c04b560 con 0x7f237c0aa140 2023-08-31T18:48:29.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.306+0000 7f23815ff700 1 -- 172.21.15.72:0/191565402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f237c157f40 con 0x7f237c0aa140 2023-08-31T18:48:29.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.307+0000 7f2362ffd700 1 -- 172.21.15.72:0/191565402 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f236c04eb80 con 0x7f237c0aa140 2023-08-31T18:48:29.308 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T18:48:29.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.309+0000 7f23815ff700 1 -- 172.21.15.72:0/191565402 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f236805ee10 msgr2=0x7f23680612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.309+0000 7f23815ff700 1 --2- 172.21.15.72:0/191565402 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f236805ee10 0x7f23680612d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f2370009130 tx=0x7f2370017000).stop 2023-08-31T18:48:29.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.309+0000 7f23815ff700 1 -- 172.21.15.72:0/191565402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c0aa140 msgr2=0x7f237c13c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.309+0000 7f23815ff700 1 --2- 172.21.15.72:0/191565402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c0aa140 0x7f237c13c110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f236c00e930 tx=0x7f236c009060).stop 2023-08-31T18:48:29.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.309+0000 7f23815ff700 1 -- 172.21.15.72:0/191565402 shutdown_connections 2023-08-31T18:48:29.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.309+0000 7f23815ff700 1 --2- 172.21.15.72:0/191565402 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f237c154030 0x7f237c0ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.309+0000 7f23815ff700 1 --2- 172.21.15.72:0/191565402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f237c0aa140 0x7f237c13c110 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.309+0000 7f23815ff700 1 --2- 172.21.15.72:0/191565402 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f236805ee10 0x7f23680612d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.309+0000 7f23815ff700 1 --2- 172.21.15.72:0/191565402 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f237c0c06b0 0x7f237c0c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.309+0000 7f23815ff700 1 -- 172.21.15.72:0/191565402 >> 172.21.15.72:0/191565402 conn(0x7f237c05eb60 msgr2=0x7f237c151660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:29.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.309+0000 7f23815ff700 1 -- 172.21.15.72:0/191565402 shutdown_connections 2023-08-31T18:48:29.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.309+0000 7f23815ff700 1 -- 172.21.15.72:0/191565402 wait complete. 2023-08-31T18:48:29.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T18:48:29.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.518+0000 7f695cbff700 1 Processor -- start 2023-08-31T18:48:29.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.519+0000 7f695cbff700 1 -- start start 2023-08-31T18:48:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.520+0000 7f695cbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6958154210 0x7f69580630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.520+0000 7f695cbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f69580635a0 0x7f69580c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.520+0000 7f695cbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6958063a00 con 0x7f6958153e30 2023-08-31T18:48:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.520+0000 7f695cbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6958154690 con 0x7f69580635a0 2023-08-31T18:48:29.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.520+0000 7f695cbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69580bfd40 con 0x7f6958154210 2023-08-31T18:48:29.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.520+0000 7f6956d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f69580635a0 0x7f69580c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.520+0000 7f6956d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f69580635a0 0x7f69580c0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33122/0 (socket says 172.21.15.72:33122) 2023-08-31T18:48:29.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.520+0000 7f6956d9d700 1 -- 172.21.15.72:0/4236121185 learned_addr learned my addr 172.21.15.72:0/4236121185 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:29.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.520+0000 7f695659c700 1 --1- 172.21.15.72:0/4236121185 >> v1:172.21.15.72:6789/0 conn(0x7f6958153e30 0x7f69580c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40232/0 (socket says 172.21.15.72:40232) 2023-08-31T18:48:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.520+0000 7f6956d9d700 1 -- 172.21.15.72:0/4236121185 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6958154210 msgr2=0x7f69580630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.520+0000 7f6956d9d700 1 --2- 172.21.15.72:0/4236121185 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6958154210 0x7f69580630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.520+0000 7f6956d9d700 1 -- 172.21.15.72:0/4236121185 >> v1:172.21.15.72:6789/0 conn(0x7f6958153e30 legacy=0x7f69580c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.521+0000 7f6956d9d700 1 -- 172.21.15.72:0/4236121185 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69580c6730 con 0x7f69580635a0 2023-08-31T18:48:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.520+0000 7f695559a700 1 -- 172.21.15.72:0/4236121185 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421826762 0 0) 0x7f6958063a00 con 0x7f6958153e30 2023-08-31T18:48:29.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.521+0000 7f6956d9d700 1 --2- 172.21.15.72:0/4236121185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69580635a0 0x7f69580c0ac0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f6950009f20 tx=0x7f6950009840).ready entity=mon.0 client_cookie=8b506e6eedc51388 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:29.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.521+0000 7f695559a700 1 -- 172.21.15.72:0/4236121185 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695000e070 con 0x7f69580635a0 2023-08-31T18:48:29.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.521+0000 7f695559a700 1 -- 172.21.15.72:0/4236121185 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695000ba80 con 0x7f69580635a0 2023-08-31T18:48:29.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.521+0000 7f695559a700 1 -- 172.21.15.72:0/4236121185 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695000be00 con 0x7f69580635a0 2023-08-31T18:48:29.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.521+0000 7f695cbff700 1 -- 172.21.15.72:0/4236121185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69580635a0 msgr2=0x7f69580c0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.521+0000 7f695cbff700 1 --2- 172.21.15.72:0/4236121185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69580635a0 0x7f69580c0ac0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f6950009f20 tx=0x7f6950009840).stop 2023-08-31T18:48:29.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.521+0000 7f695cbff700 1 -- 172.21.15.72:0/4236121185 shutdown_connections 2023-08-31T18:48:29.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.522+0000 7f695cbff700 1 --2- 172.21.15.72:0/4236121185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69580635a0 0x7f69580c0ac0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.522+0000 7f695cbff700 1 --2- 172.21.15.72:0/4236121185 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6958154210 0x7f69580630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:29.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.522+0000 7f695cbff700 1 -- 172.21.15.72:0/4236121185 >> 172.21.15.72:0/4236121185 conn(0x7f695805eb20 msgr2=0x7f69580cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:29.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.522+0000 7f695cbff700 1 -- 172.21.15.72:0/4236121185 shutdown_connections 2023-08-31T18:48:29.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.522+0000 7f695cbff700 1 -- 172.21.15.72:0/4236121185 wait complete. 2023-08-31T18:48:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.523+0000 7f695cbff700 1 Processor -- start 2023-08-31T18:48:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.523+0000 7f695cbff700 1 -- start start 2023-08-31T18:48:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.524+0000 7f695cbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69580635a0 0x7f69580af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.524+0000 7f695cbff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6958153e30 0x7f69580afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.524+0000 7f695cbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6958154210 0x7f69581564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.524+0000 7f695cbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69581578c0 con 0x7f6958154210 2023-08-31T18:48:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.524+0000 7f695cbff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6958158af0 con 0x7f6958153e30 2023-08-31T18:48:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.524+0000 7f695cbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695815ad10 con 0x7f69580635a0 2023-08-31T18:48:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.524+0000 7f6956d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6958154210 0x7f69581564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.524+0000 7f6956d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6958154210 0x7f69581564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33136/0 (socket says 172.21.15.72:33136) 2023-08-31T18:48:29.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.524+0000 7f6956d9d700 1 -- 172.21.15.72:0/1202362571 learned_addr learned my addr 172.21.15.72:0/1202362571 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:29.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.524+0000 7f695659c700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69580635a0 0x7f69580af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.524+0000 7f6955d9b700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6958153e30 0x7f69580afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.525+0000 7f6956d9d700 1 -- 172.21.15.72:0/1202362571 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69580635a0 msgr2=0x7f69580af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.525+0000 7f6956d9d700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69580635a0 0x7f69580af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.525+0000 7f6956d9d700 1 -- 172.21.15.72:0/1202362571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6958153e30 msgr2=0x7f69580afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.525+0000 7f6956d9d700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6958153e30 0x7f69580afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.525+0000 7f6956d9d700 1 -- 172.21.15.72:0/1202362571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6950009ae0 con 0x7f6958154210 2023-08-31T18:48:29.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.525+0000 7f695659c700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69580635a0 0x7f69580af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:29.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.525+0000 7f6955d9b700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6958153e30 0x7f69580afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:29.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.525+0000 7f6956d9d700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6958154210 0x7f69581564b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f6958065940 tx=0x7f6950009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:29.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.525+0000 7f69467fc700 1 -- 172.21.15.72:0/1202362571 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69500092e0 con 0x7f6958154210 2023-08-31T18:48:29.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.525+0000 7f69467fc700 1 -- 172.21.15.72:0/1202362571 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695001d410 con 0x7f6958154210 2023-08-31T18:48:29.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.525+0000 7f695cbff700 1 -- 172.21.15.72:0/1202362571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69580b02e0 con 0x7f6958154210 2023-08-31T18:48:29.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.525+0000 7f69467fc700 1 -- 172.21.15.72:0/1202362571 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695001d7d0 con 0x7f6958154210 2023-08-31T18:48:29.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.525+0000 7f695cbff700 1 -- 172.21.15.72:0/1202362571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69581584a0 con 0x7f6958154210 2023-08-31T18:48:29.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.526+0000 7f695cbff700 1 -- 172.21.15.72:0/1202362571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6958158c60 con 0x7f6958154210 2023-08-31T18:48:29.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.527+0000 7f69467fc700 1 -- 172.21.15.72:0/1202362571 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f695001db80 con 0x7f6958154210 2023-08-31T18:48:29.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.528+0000 7f69467fc700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f693805ee10 0x7f69380612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.528+0000 7f69467fc700 1 -- 172.21.15.72:0/1202362571 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f695007bbb0 con 0x7f6958154210 2023-08-31T18:48:29.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.528+0000 7f695659c700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f693805ee10 0x7f69380612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.529+0000 7f695659c700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f693805ee10 0x7f69380612d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f69480011e0 tx=0x7f6948007b10).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:29.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.532+0000 7f69467fc700 1 -- 172.21.15.72:0/1202362571 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f695004cf60 con 0x7f6958154210 2023-08-31T18:48:29.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.701+0000 7f695cbff700 1 -- 172.21.15.72:0/1202362571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f69580bffe0 con 0x7f6958154210 2023-08-31T18:48:29.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.701+0000 7f69467fc700 1 -- 172.21.15.72:0/1202362571 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6950050580 con 0x7f6958154210 2023-08-31T18:48:29.702 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T18:48:29.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.703+0000 7f695cbff700 1 -- 172.21.15.72:0/1202362571 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f693805ee10 msgr2=0x7f69380612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.703+0000 7f695cbff700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f693805ee10 0x7f69380612d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f69480011e0 tx=0x7f6948007b10).stop 2023-08-31T18:48:29.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.703+0000 7f695cbff700 1 -- 172.21.15.72:0/1202362571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6958154210 msgr2=0x7f69581564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.703+0000 7f695cbff700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6958154210 0x7f69581564b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f6958065940 tx=0x7f6950009840).stop 2023-08-31T18:48:29.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.703+0000 7f695cbff700 1 -- 172.21.15.72:0/1202362571 shutdown_connections 2023-08-31T18:48:29.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.703+0000 7f695cbff700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6958154210 0x7f69581564b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.703+0000 7f695cbff700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69580635a0 0x7f69580af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.703+0000 7f695cbff700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f693805ee10 0x7f69380612d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.704+0000 7f695cbff700 1 --2- 172.21.15.72:0/1202362571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6958153e30 0x7f69580afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.704+0000 7f695cbff700 1 -- 172.21.15.72:0/1202362571 >> 172.21.15.72:0/1202362571 conn(0x7f695805eb20 msgr2=0x7f69580ad390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:29.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.704+0000 7f695cbff700 1 -- 172.21.15.72:0/1202362571 shutdown_connections 2023-08-31T18:48:29.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.704+0000 7f695cbff700 1 -- 172.21.15.72:0/1202362571 wait complete. 2023-08-31T18:48:29.721 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T18:48:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.911+0000 7f94d87ff700 1 Processor -- start 2023-08-31T18:48:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.911+0000 7f94d87ff700 1 -- start start 2023-08-31T18:48:29.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.912+0000 7f94d87ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f94d0153e30 0x7f94d0154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.912+0000 7f94d87ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d00c5cb0 0x7f94d00c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.912+0000 7f94d87ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d00bfd40 con 0x7f94d00630b0 2023-08-31T18:48:29.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.912+0000 7f94d87ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d00c6730 con 0x7f94d0153e30 2023-08-31T18:48:29.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.912+0000 7f94d87ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00bffe0 con 0x7f94d00c5cb0 2023-08-31T18:48:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.913+0000 7f94d659b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f94d0153e30 0x7f94d0154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.913+0000 7f94d6d9c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f94d00630b0 0x7f94d0157d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:32798/0 (socket says 172.21.15.72:32798) 2023-08-31T18:48:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.913+0000 7f94d5d9a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d00c5cb0 0x7f94d00c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.913+0000 7f94d6d9c700 1 -- 172.21.15.72:0/656291404 learned_addr learned my addr 172.21.15.72:0/656291404 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:29.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.913+0000 7f94d5599700 1 -- 172.21.15.72:0/656291404 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331567464 0 0) 0x7f94d00bfd40 con 0x7f94d00630b0 2023-08-31T18:48:29.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.913+0000 7f94d5599700 1 -- 172.21.15.72:0/656291404 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94bc0033f0 con 0x7f94d00630b0 2023-08-31T18:48:29.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.913+0000 7f94d659b700 1 -- 172.21.15.72:0/656291404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d00c5cb0 msgr2=0x7f94d00c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:29.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.913+0000 7f94d659b700 1 --2- 172.21.15.72:0/656291404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d00c5cb0 0x7f94d00c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.913+0000 7f94d659b700 1 -- 172.21.15.72:0/656291404 >> v1:172.21.15.146:6789/0 conn(0x7f94d00630b0 legacy=0x7f94d0157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.913+0000 7f94d659b700 1 -- 172.21.15.72:0/656291404 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d00c02c0 con 0x7f94d0153e30 2023-08-31T18:48:29.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.913+0000 7f94d5d9a700 1 --2- 172.21.15.72:0/656291404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d00c5cb0 0x7f94d00c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:29.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.914+0000 7f94d659b700 1 --2- 172.21.15.72:0/656291404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d0153e30 0x7f94d0154210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f94cc009760 tx=0x7f94cc009060).ready entity=mon.1 client_cookie=d6d3673fc6f50559 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:29.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.914+0000 7f94d5599700 1 -- 172.21.15.72:0/656291404 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc009120 con 0x7f94d0153e30 2023-08-31T18:48:29.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.914+0000 7f94d5599700 1 -- 172.21.15.72:0/656291404 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc00d4a0 con 0x7f94d0153e30 2023-08-31T18:48:29.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.914+0000 7f94d5599700 1 -- 172.21.15.72:0/656291404 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00d820 con 0x7f94d0153e30 2023-08-31T18:48:29.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.914+0000 7f94d87ff700 1 -- 172.21.15.72:0/656291404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d0153e30 msgr2=0x7f94d0154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.914+0000 7f94d87ff700 1 --2- 172.21.15.72:0/656291404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d0153e30 0x7f94d0154210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f94cc009760 tx=0x7f94cc009060).stop 2023-08-31T18:48:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.914+0000 7f94d87ff700 1 -- 172.21.15.72:0/656291404 shutdown_connections 2023-08-31T18:48:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.914+0000 7f94d87ff700 1 --2- 172.21.15.72:0/656291404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d0153e30 0x7f94d0154210 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.914+0000 7f94d87ff700 1 --2- 172.21.15.72:0/656291404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d00c5cb0 0x7f94d00c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.914+0000 7f94d87ff700 1 -- 172.21.15.72:0/656291404 >> 172.21.15.72:0/656291404 conn(0x7f94d005eb20 msgr2=0x7f94d00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.915+0000 7f94d87ff700 1 -- 172.21.15.72:0/656291404 shutdown_connections 2023-08-31T18:48:29.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.915+0000 7f94d87ff700 1 -- 172.21.15.72:0/656291404 wait complete. 2023-08-31T18:48:29.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.916+0000 7f94d87ff700 1 Processor -- start 2023-08-31T18:48:29.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.916+0000 7f94d87ff700 1 -- start start 2023-08-31T18:48:29.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.917+0000 7f94d87ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d00630b0 0x7f94d0152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.917+0000 7f94d87ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00c5cb0 0x7f94d00c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.917+0000 7f94d87ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d0153e30 0x7f94d00c3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.917+0000 7f94d87ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00c38f0 con 0x7f94d00c5cb0 2023-08-31T18:48:29.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.917+0000 7f94d87ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00c3bd0 con 0x7f94d0153e30 2023-08-31T18:48:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.917+0000 7f94d87ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00c3eb0 con 0x7f94d00630b0 2023-08-31T18:48:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.917+0000 7f94d5d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00c5cb0 0x7f94d00c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.917+0000 7f94d5d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00c5cb0 0x7f94d00c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33148/0 (socket says 172.21.15.72:33148) 2023-08-31T18:48:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.917+0000 7f94d5d9a700 1 -- 172.21.15.72:0/418278724 learned_addr learned my addr 172.21.15.72:0/418278724 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.918+0000 7f94d659b700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d00630b0 0x7f94d0152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.918+0000 7f94d6d9c700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d0153e30 0x7f94d00c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.918+0000 7f94d5d9a700 1 -- 172.21.15.72:0/418278724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d00630b0 msgr2=0x7f94d0152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.918+0000 7f94d5d9a700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d00630b0 0x7f94d0152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.918+0000 7f94d5d9a700 1 -- 172.21.15.72:0/418278724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d0153e30 msgr2=0x7f94d00c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.918+0000 7f94d5d9a700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d0153e30 0x7f94d00c3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.918+0000 7f94d5d9a700 1 -- 172.21.15.72:0/418278724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c00092a0 con 0x7f94d00c5cb0 2023-08-31T18:48:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.918+0000 7f94d6d9c700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d0153e30 0x7f94d00c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.918+0000 7f94d659b700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d00630b0 0x7f94d0152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.918+0000 7f94d5d9a700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00c5cb0 0x7f94d00c2e50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f94c000ea20 tx=0x7f94c0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.918+0000 7f94c67fc700 1 -- 172.21.15.72:0/418278724 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c000c850 con 0x7f94d00c5cb0 2023-08-31T18:48:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.918+0000 7f94c67fc700 1 -- 172.21.15.72:0/418278724 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c000c9b0 con 0x7f94d00c5cb0 2023-08-31T18:48:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.918+0000 7f94c67fc700 1 -- 172.21.15.72:0/418278724 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c000cd30 con 0x7f94d00c5cb0 2023-08-31T18:48:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.918+0000 7f94d87ff700 1 -- 172.21.15.72:0/418278724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94cc0092a0 con 0x7f94d00c5cb0 2023-08-31T18:48:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.918+0000 7f94d87ff700 1 -- 172.21.15.72:0/418278724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d00c4470 con 0x7f94d00c5cb0 2023-08-31T18:48:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.919+0000 7f94d87ff700 1 -- 172.21.15.72:0/418278724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d006c6b0 con 0x7f94d00c5cb0 2023-08-31T18:48:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.920+0000 7f94c67fc700 1 -- 172.21.15.72:0/418278724 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f94c0012600 con 0x7f94d00c5cb0 2023-08-31T18:48:29.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.921+0000 7f94c67fc700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94b405ee10 0x7f94b40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:29.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.921+0000 7f94c67fc700 1 -- 172.21.15.72:0/418278724 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f94c007a430 con 0x7f94d00c5cb0 2023-08-31T18:48:29.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.921+0000 7f94d659b700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94b405ee10 0x7f94b40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:29.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.921+0000 7f94d659b700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94b405ee10 0x7f94b40612d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f94cc00d260 tx=0x7f94cc016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:29.925+0000 7f94c67fc700 1 -- 172.21.15.72:0/418278724 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f94c004b8a0 con 0x7f94d00c5cb0 2023-08-31T18:48:30.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.091+0000 7f94d87ff700 1 -- 172.21.15.72:0/418278724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94d0064000 con 0x7f94d00c5cb0 2023-08-31T18:48:30.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.092+0000 7f94c67fc700 1 -- 172.21.15.72:0/418278724 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94c004eec0 con 0x7f94d00c5cb0 2023-08-31T18:48:30.092 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T18:48:30.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.094+0000 7f94d87ff700 1 -- 172.21.15.72:0/418278724 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94b405ee10 msgr2=0x7f94b40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:30.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.094+0000 7f94d87ff700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94b405ee10 0x7f94b40612d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f94cc00d260 tx=0x7f94cc016000).stop 2023-08-31T18:48:30.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.094+0000 7f94d87ff700 1 -- 172.21.15.72:0/418278724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00c5cb0 msgr2=0x7f94d00c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:30.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.094+0000 7f94d87ff700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00c5cb0 0x7f94d00c2e50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f94c000ea20 tx=0x7f94c0009060).stop 2023-08-31T18:48:30.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.094+0000 7f94d87ff700 1 -- 172.21.15.72:0/418278724 shutdown_connections 2023-08-31T18:48:30.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.094+0000 7f94d87ff700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94b405ee10 0x7f94b40612d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.094+0000 7f94d87ff700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d0153e30 0x7f94d00c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.094+0000 7f94d87ff700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d00630b0 0x7f94d0152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.094+0000 7f94d87ff700 1 --2- 172.21.15.72:0/418278724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00c5cb0 0x7f94d00c2e50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.094+0000 7f94d87ff700 1 -- 172.21.15.72:0/418278724 >> 172.21.15.72:0/418278724 conn(0x7f94d005eb20 msgr2=0x7f94d00c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:30.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.094+0000 7f94d87ff700 1 -- 172.21.15.72:0/418278724 shutdown_connections 2023-08-31T18:48:30.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.094+0000 7f94d87ff700 1 -- 172.21.15.72:0/418278724 wait complete. 2023-08-31T18:48:30.111 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T18:48:30.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.302+0000 7f9b7cfff700 1 Processor -- start 2023-08-31T18:48:30.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.303+0000 7f9b7cfff700 1 -- start start 2023-08-31T18:48:30.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.304+0000 7f9b7cfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9b78153e30 0x7f9b78154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:30.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.304+0000 7f9b7cfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9b780c5cb0 0x7f9b780c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:30.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.304+0000 7f9b7cfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b780bfd40 con 0x7f9b780630b0 2023-08-31T18:48:30.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.304+0000 7f9b7cfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b780c6730 con 0x7f9b78153e30 2023-08-31T18:48:30.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.304+0000 7f9b7cfff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b780bffe0 con 0x7f9b780c5cb0 2023-08-31T18:48:30.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.304+0000 7f9b7659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9b78153e30 0x7f9b78154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:30.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.304+0000 7f9b7659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9b78153e30 0x7f9b78154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33150/0 (socket says 172.21.15.72:33150) 2023-08-31T18:48:30.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.304+0000 7f9b7659c700 1 -- 172.21.15.72:0/2874963140 learned_addr learned my addr 172.21.15.72:0/2874963140 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:30.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.305+0000 7f9b7659c700 1 -- 172.21.15.72:0/2874963140 >> v2:172.21.15.146:3300/0 conn(0x7f9b780c5cb0 msgr2=0x7f9b780c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:30.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.305+0000 7f9b7659c700 1 --2- 172.21.15.72:0/2874963140 >> v2:172.21.15.146:3300/0 conn(0x7f9b780c5cb0 0x7f9b780c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:30.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.305+0000 7f9b7659c700 1 -- 172.21.15.72:0/2874963140 >> v1:172.21.15.146:6789/0 conn(0x7f9b780630b0 legacy=0x7f9b78157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:30.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.305+0000 7f9b7659c700 1 -- 172.21.15.72:0/2874963140 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b780c02c0 con 0x7f9b78153e30 2023-08-31T18:48:30.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.305+0000 7f9b7659c700 1 --2- 172.21.15.72:0/2874963140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b78153e30 0x7f9b78154210 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f9b78063d10 tx=0x7f9b680090f0).ready entity=mon.0 client_cookie=5257d79e40bbca61 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:30.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.305+0000 7f9b7559a700 1 -- 172.21.15.72:0/2874963140 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6800b5a0 con 0x7f9b78153e30 2023-08-31T18:48:30.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.305+0000 7f9b7559a700 1 -- 172.21.15.72:0/2874963140 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6800b700 con 0x7f9b78153e30 2023-08-31T18:48:30.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.305+0000 7f9b7559a700 1 -- 172.21.15.72:0/2874963140 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6800baa0 con 0x7f9b78153e30 2023-08-31T18:48:30.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.306+0000 7f9b7cfff700 1 -- 172.21.15.72:0/2874963140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b78153e30 msgr2=0x7f9b78154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:30.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.306+0000 7f9b7cfff700 1 --2- 172.21.15.72:0/2874963140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b78153e30 0x7f9b78154210 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f9b78063d10 tx=0x7f9b680090f0).stop 2023-08-31T18:48:30.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.306+0000 7f9b7cfff700 1 -- 172.21.15.72:0/2874963140 shutdown_connections 2023-08-31T18:48:30.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.306+0000 7f9b7cfff700 1 --2- 172.21.15.72:0/2874963140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b78153e30 0x7f9b78154210 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.306+0000 7f9b7cfff700 1 --2- 172.21.15.72:0/2874963140 >> v2:172.21.15.146:3300/0 conn(0x7f9b780c5cb0 0x7f9b780c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:30.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.306+0000 7f9b7cfff700 1 -- 172.21.15.72:0/2874963140 >> 172.21.15.72:0/2874963140 conn(0x7f9b7805eb20 msgr2=0x7f9b780cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:30.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.306+0000 7f9b7cfff700 1 -- 172.21.15.72:0/2874963140 shutdown_connections 2023-08-31T18:48:30.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.306+0000 7f9b7cfff700 1 -- 172.21.15.72:0/2874963140 wait complete. 2023-08-31T18:48:30.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.307+0000 7f9b7cfff700 1 Processor -- start 2023-08-31T18:48:30.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.307+0000 7f9b7cfff700 1 -- start start 2023-08-31T18:48:30.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.308+0000 7f9b7cfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b780630b0 0x7f9b780ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:30.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.308+0000 7f9b7cfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b780c5cb0 0x7f9b7814daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:30.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.308+0000 7f9b7cfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78153e30 0x7f9b780c2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:30.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.308+0000 7f9b7cfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78165250 con 0x7f9b780630b0 2023-08-31T18:48:30.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.308+0000 7f9b7cfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78164640 con 0x7f9b780c5cb0 2023-08-31T18:48:30.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.308+0000 7f9b7cfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78164920 con 0x7f9b78153e30 2023-08-31T18:48:30.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.308+0000 7f9b7659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b780630b0 0x7f9b780ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:30.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.308+0000 7f9b7659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b780630b0 0x7f9b780ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33154/0 (socket says 172.21.15.72:33154) 2023-08-31T18:48:30.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.309+0000 7f9b7659c700 1 -- 172.21.15.72:0/878980446 learned_addr learned my addr 172.21.15.72:0/878980446 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:30.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.309+0000 7f9b76d9d700 1 --2- 172.21.15.72:0/878980446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78153e30 0x7f9b780c2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:30.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.309+0000 7f9b75d9b700 1 --2- 172.21.15.72:0/878980446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b780c5cb0 0x7f9b7814daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:30.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.309+0000 7f9b7659c700 1 -- 172.21.15.72:0/878980446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78153e30 msgr2=0x7f9b780c2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:30.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.309+0000 7f9b7659c700 1 --2- 172.21.15.72:0/878980446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78153e30 0x7f9b780c2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.309+0000 7f9b7659c700 1 -- 172.21.15.72:0/878980446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b780c5cb0 msgr2=0x7f9b7814daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:30.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.309+0000 7f9b7659c700 1 --2- 172.21.15.72:0/878980446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b780c5cb0 0x7f9b7814daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.309+0000 7f9b7659c700 1 -- 172.21.15.72:0/878980446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b68009370 con 0x7f9b780630b0 2023-08-31T18:48:30.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.309+0000 7f9b75d9b700 1 --2- 172.21.15.72:0/878980446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b780c5cb0 0x7f9b7814daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:30.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.309+0000 7f9b7659c700 1 --2- 172.21.15.72:0/878980446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b780630b0 0x7f9b780ca5f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f9b78065940 tx=0x7f9b68015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:30.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.309+0000 7f9b667fc700 1 -- 172.21.15.72:0/878980446 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6800bee0 con 0x7f9b780630b0 2023-08-31T18:48:30.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.309+0000 7f9b667fc700 1 -- 172.21.15.72:0/878980446 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6800b870 con 0x7f9b780630b0 2023-08-31T18:48:30.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.309+0000 7f9b7cfff700 1 -- 172.21.15.72:0/878980446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b78164c00 con 0x7f9b780630b0 2023-08-31T18:48:30.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.309+0000 7f9b667fc700 1 -- 172.21.15.72:0/878980446 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6800ba20 con 0x7f9b780630b0 2023-08-31T18:48:30.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.310+0000 7f9b7cfff700 1 -- 172.21.15.72:0/878980446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b780caae0 con 0x7f9b780630b0 2023-08-31T18:48:30.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.311+0000 7f9b7cfff700 1 -- 172.21.15.72:0/878980446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b78165550 con 0x7f9b780630b0 2023-08-31T18:48:30.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.311+0000 7f9b667fc700 1 -- 172.21.15.72:0/878980446 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9b68022020 con 0x7f9b780630b0 2023-08-31T18:48:30.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.312+0000 7f9b667fc700 1 --2- 172.21.15.72:0/878980446 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9b5805ede0 0x7f9b580612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:30.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.312+0000 7f9b667fc700 1 -- 172.21.15.72:0/878980446 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9b6807b7e0 con 0x7f9b780630b0 2023-08-31T18:48:30.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.312+0000 7f9b75d9b700 1 --2- 172.21.15.72:0/878980446 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9b5805ede0 0x7f9b580612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:30.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.313+0000 7f9b75d9b700 1 --2- 172.21.15.72:0/878980446 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9b5805ede0 0x7f9b580612a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f9b78167820 tx=0x7f9b6c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:30.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.316+0000 7f9b667fc700 1 -- 172.21.15.72:0/878980446 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9b6804cb90 con 0x7f9b780630b0 2023-08-31T18:48:30.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.487+0000 7f9b7cfff700 1 -- 172.21.15.72:0/878980446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b7806c6b0 con 0x7f9b780630b0 2023-08-31T18:48:30.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.487+0000 7f9b667fc700 1 -- 172.21.15.72:0/878980446 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b6802a070 con 0x7f9b780630b0 2023-08-31T18:48:30.488 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T18:48:30.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.489+0000 7f9b7cfff700 1 -- 172.21.15.72:0/878980446 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9b5805ede0 msgr2=0x7f9b580612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:30.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.489+0000 7f9b7cfff700 1 --2- 172.21.15.72:0/878980446 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9b5805ede0 0x7f9b580612a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f9b78167820 tx=0x7f9b6c008040).stop 2023-08-31T18:48:30.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.489+0000 7f9b7cfff700 1 -- 172.21.15.72:0/878980446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b780630b0 msgr2=0x7f9b780ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:30.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.489+0000 7f9b7cfff700 1 --2- 172.21.15.72:0/878980446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b780630b0 0x7f9b780ca5f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f9b78065940 tx=0x7f9b68015000).stop 2023-08-31T18:48:30.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.489+0000 7f9b7cfff700 1 -- 172.21.15.72:0/878980446 shutdown_connections 2023-08-31T18:48:30.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.489+0000 7f9b7cfff700 1 --2- 172.21.15.72:0/878980446 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9b78153e30 0x7f9b780c2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.489+0000 7f9b7cfff700 1 --2- 172.21.15.72:0/878980446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b780630b0 0x7f9b780ca5f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.489+0000 7f9b7cfff700 1 --2- 172.21.15.72:0/878980446 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9b5805ede0 0x7f9b580612a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.489+0000 7f9b7cfff700 1 --2- 172.21.15.72:0/878980446 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b780c5cb0 0x7f9b7814daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.489+0000 7f9b7cfff700 1 -- 172.21.15.72:0/878980446 >> 172.21.15.72:0/878980446 conn(0x7f9b7805eb20 msgr2=0x7f9b780c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:30.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.489+0000 7f9b7cfff700 1 -- 172.21.15.72:0/878980446 shutdown_connections 2023-08-31T18:48:30.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.489+0000 7f9b7cfff700 1 -- 172.21.15.72:0/878980446 wait complete. 2023-08-31T18:48:30.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:48:30.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.695+0000 7fcbc8bff700 1 Processor -- start 2023-08-31T18:48:30.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.695+0000 7fcbc8bff700 1 -- start start 2023-08-31T18:48:30.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.696+0000 7fcbc8bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcbc4154060 0x7fcbc4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:30.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.696+0000 7fcbc8bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbc40cb9b0 0x7fcbc41581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:30.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.696+0000 7fcbc8bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcbc41586b0 0x7fcbc40c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:30.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.696+0000 7fcbc8bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc40c1380 con 0x7fcbc4154060 2023-08-31T18:48:30.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.696+0000 7fcbc8bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc4158b60 con 0x7fcbc41586b0 2023-08-31T18:48:30.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.696+0000 7fcbc8bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40c6120 con 0x7fcbc40cb9b0 2023-08-31T18:48:30.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.696+0000 7fcbc259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcbc4154060 0x7fcbc4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:30.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.696+0000 7fcbc259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcbc4154060 0x7fcbc4157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33162/0 (socket says 172.21.15.72:33162) 2023-08-31T18:48:30.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.696+0000 7fcbc259c700 1 -- 172.21.15.72:0/3387310361 learned_addr learned my addr 172.21.15.72:0/3387310361 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:30.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.697+0000 7fcbc1d9b700 1 --2- 172.21.15.72:0/3387310361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbc40cb9b0 0x7fcbc41581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:30.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.697+0000 7fcbc2d9d700 1 --2- 172.21.15.72:0/3387310361 >> v2:172.21.15.146:3300/0 conn(0x7fcbc41586b0 0x7fcbc40c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:30.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.697+0000 7fcbc259c700 1 -- 172.21.15.72:0/3387310361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbc40cb9b0 msgr2=0x7fcbc41581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:30.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.697+0000 7fcbc259c700 1 --2- 172.21.15.72:0/3387310361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbc40cb9b0 0x7fcbc41581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.697+0000 7fcbc259c700 1 -- 172.21.15.72:0/3387310361 >> v2:172.21.15.146:3300/0 conn(0x7fcbc41586b0 msgr2=0x7fcbc40c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:30.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.697+0000 7fcbc259c700 1 --2- 172.21.15.72:0/3387310361 >> v2:172.21.15.146:3300/0 conn(0x7fcbc41586b0 0x7fcbc40c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.697+0000 7fcbc259c700 1 -- 172.21.15.72:0/3387310361 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc40c5e10 con 0x7fcbc4154060 2023-08-31T18:48:30.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.697+0000 7fcbc259c700 1 --2- 172.21.15.72:0/3387310361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbc4154060 0x7fcbc4157cd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fcbc4085440 tx=0x7fcbb4009060).ready entity=mon.0 client_cookie=f8fcf194e8c0e59b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:30.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.697+0000 7fcbc159a700 1 -- 172.21.15.72:0/3387310361 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4005880 con 0x7fcbc4154060 2023-08-31T18:48:30.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.697+0000 7fcbc159a700 1 -- 172.21.15.72:0/3387310361 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb40059e0 con 0x7fcbc4154060 2023-08-31T18:48:30.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.697+0000 7fcbc159a700 1 -- 172.21.15.72:0/3387310361 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4005d60 con 0x7fcbc4154060 2023-08-31T18:48:30.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.698+0000 7fcbc8bff700 1 -- 172.21.15.72:0/3387310361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbc4154060 msgr2=0x7fcbc4157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:30.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.698+0000 7fcbc8bff700 1 --2- 172.21.15.72:0/3387310361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbc4154060 0x7fcbc4157cd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fcbc4085440 tx=0x7fcbb4009060).stop 2023-08-31T18:48:30.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.698+0000 7fcbc8bff700 1 -- 172.21.15.72:0/3387310361 shutdown_connections 2023-08-31T18:48:30.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.698+0000 7fcbc8bff700 1 --2- 172.21.15.72:0/3387310361 >> v2:172.21.15.146:3300/0 conn(0x7fcbc41586b0 0x7fcbc40c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.698+0000 7fcbc8bff700 1 --2- 172.21.15.72:0/3387310361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbc4154060 0x7fcbc4157cd0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.698+0000 7fcbc8bff700 1 --2- 172.21.15.72:0/3387310361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbc40cb9b0 0x7fcbc41581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.698+0000 7fcbc8bff700 1 -- 172.21.15.72:0/3387310361 >> 172.21.15.72:0/3387310361 conn(0x7fcbc405e870 msgr2=0x7fcbc40cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:30.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.698+0000 7fcbc8bff700 1 -- 172.21.15.72:0/3387310361 shutdown_connections 2023-08-31T18:48:30.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.698+0000 7fcbc8bff700 1 -- 172.21.15.72:0/3387310361 wait complete. 2023-08-31T18:48:30.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.699+0000 7fcbc8bff700 1 Processor -- start 2023-08-31T18:48:30.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.700+0000 7fcbc8bff700 1 -- start start 2023-08-31T18:48:30.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.700+0000 7fcbc8bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbc40cb9b0 0x7fcbc414b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:30.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.700+0000 7fcbc8bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbc4154060 0x7fcbc40a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:30.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc8bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbc41586b0 0x7fcbc4151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:30.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc8bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40c2f00 con 0x7fcbc41586b0 2023-08-31T18:48:30.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc8bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40a8d10 con 0x7fcbc40cb9b0 2023-08-31T18:48:30.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc8bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40a8470 con 0x7fcbc4154060 2023-08-31T18:48:30.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbc41586b0 0x7fcbc4151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:30.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbc41586b0 0x7fcbc4151b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33176/0 (socket says 172.21.15.72:33176) 2023-08-31T18:48:30.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc2d9d700 1 -- 172.21.15.72:0/2202136526 learned_addr learned my addr 172.21.15.72:0/2202136526 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:30.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc259c700 1 --2- 172.21.15.72:0/2202136526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbc40cb9b0 0x7fcbc414b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:30.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc1d9b700 1 --2- 172.21.15.72:0/2202136526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbc4154060 0x7fcbc40a7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:30.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc2d9d700 1 -- 172.21.15.72:0/2202136526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbc4154060 msgr2=0x7fcbc40a7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:30.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc2d9d700 1 --2- 172.21.15.72:0/2202136526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbc4154060 0x7fcbc40a7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc2d9d700 1 -- 172.21.15.72:0/2202136526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbc40cb9b0 msgr2=0x7fcbc414b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:30.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc2d9d700 1 --2- 172.21.15.72:0/2202136526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbc40cb9b0 0x7fcbc414b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc2d9d700 1 -- 172.21.15.72:0/2202136526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb4009300 con 0x7fcbc41586b0 2023-08-31T18:48:30.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc1d9b700 1 --2- 172.21.15.72:0/2202136526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbc4154060 0x7fcbc40a7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:30.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.701+0000 7fcbc2d9d700 1 --2- 172.21.15.72:0/2202136526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbc41586b0 0x7fcbc4151b90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fcbbc007f20 tx=0x7fcbbc009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:30.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.702+0000 7fcbb27fc700 1 -- 172.21.15.72:0/2202136526 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc00ebf0 con 0x7fcbc41586b0 2023-08-31T18:48:30.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.702+0000 7fcbb27fc700 1 -- 172.21.15.72:0/2202136526 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc00ed50 con 0x7fcbc41586b0 2023-08-31T18:48:30.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.702+0000 7fcbb27fc700 1 -- 172.21.15.72:0/2202136526 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc014610 con 0x7fcbc41586b0 2023-08-31T18:48:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.702+0000 7fcbc8bff700 1 -- 172.21.15.72:0/2202136526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc40a8750 con 0x7fcbc41586b0 2023-08-31T18:48:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.702+0000 7fcbc8bff700 1 -- 172.21.15.72:0/2202136526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc40c3130 con 0x7fcbc41586b0 2023-08-31T18:48:30.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.703+0000 7fcbc8bff700 1 -- 172.21.15.72:0/2202136526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc40c3350 con 0x7fcbc41586b0 2023-08-31T18:48:30.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.704+0000 7fcbb27fc700 1 -- 172.21.15.72:0/2202136526 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fcbbc014980 con 0x7fcbc41586b0 2023-08-31T18:48:30.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.704+0000 7fcbb27fc700 1 --2- 172.21.15.72:0/2202136526 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcba405ee40 0x7fcba4061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:30.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.704+0000 7fcbb27fc700 1 -- 172.21.15.72:0/2202136526 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcbbc07a260 con 0x7fcbc41586b0 2023-08-31T18:48:30.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.705+0000 7fcbc259c700 1 --2- 172.21.15.72:0/2202136526 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcba405ee40 0x7fcba4061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:30.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.705+0000 7fcbc259c700 1 --2- 172.21.15.72:0/2202136526 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcba405ee40 0x7fcba4061300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fcbb4009fd0 tx=0x7fcbb4016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:30.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.708+0000 7fcbb27fc700 1 -- 172.21.15.72:0/2202136526 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcbbc04b610 con 0x7fcbc41586b0 2023-08-31T18:48:30.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.877+0000 7fcbc8bff700 1 -- 172.21.15.72:0/2202136526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbc406c6b0 con 0x7fcbc41586b0 2023-08-31T18:48:30.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.878+0000 7fcbb27fc700 1 -- 172.21.15.72:0/2202136526 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17024 (secure 0 0 0) 0x7fcbbc04ec30 con 0x7fcbc41586b0 2023-08-31T18:48:30.879 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:30.879 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:53.972412+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:47:51.003304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-31T18:47:51.950765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:48:30.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.880+0000 7fcbc8bff700 1 -- 172.21.15.72:0/2202136526 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcba405ee40 msgr2=0x7fcba4061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:30.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.880+0000 7fcbc8bff700 1 --2- 172.21.15.72:0/2202136526 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcba405ee40 0x7fcba4061300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fcbb4009fd0 tx=0x7fcbb4016000).stop 2023-08-31T18:48:30.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.880+0000 7fcbc8bff700 1 -- 172.21.15.72:0/2202136526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbc41586b0 msgr2=0x7fcbc4151b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:30.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.880+0000 7fcbc8bff700 1 --2- 172.21.15.72:0/2202136526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbc41586b0 0x7fcbc4151b90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fcbbc007f20 tx=0x7fcbbc009860).stop 2023-08-31T18:48:30.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.880+0000 7fcbc8bff700 1 -- 172.21.15.72:0/2202136526 shutdown_connections 2023-08-31T18:48:30.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.880+0000 7fcbc8bff700 1 --2- 172.21.15.72:0/2202136526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbc41586b0 0x7fcbc4151b90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.880+0000 7fcbc8bff700 1 --2- 172.21.15.72:0/2202136526 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcba405ee40 0x7fcba4061300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.880+0000 7fcbc8bff700 1 --2- 172.21.15.72:0/2202136526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbc40cb9b0 0x7fcbc414b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.880+0000 7fcbc8bff700 1 --2- 172.21.15.72:0/2202136526 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbc4154060 0x7fcbc40a7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:30.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.880+0000 7fcbc8bff700 1 -- 172.21.15.72:0/2202136526 >> 172.21.15.72:0/2202136526 conn(0x7fcbc405e870 msgr2=0x7fcbc4157a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:30.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.880+0000 7fcbc8bff700 1 -- 172.21.15.72:0/2202136526 shutdown_connections 2023-08-31T18:48:30.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:30.880+0000 7fcbc8bff700 1 -- 172.21.15.72:0/2202136526 wait complete. 2023-08-31T18:48:30.899 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T18:47:51.003304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T18:47:51.950765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T18:48:30.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T18:48:31.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.089+0000 7f35bb5ff700 1 Processor -- start 2023-08-31T18:48:31.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.090+0000 7f35bb5ff700 1 -- start start 2023-08-31T18:48:31.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.091+0000 7f35bb5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35b4153e30 0x7f35b4154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.091+0000 7f35bb5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b40bfd40 con 0x7f35b40637c0 2023-08-31T18:48:31.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.091+0000 7f35bb5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b40c6730 con 0x7f35b40c5cb0 2023-08-31T18:48:31.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.091+0000 7f35bb5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b40bffe0 con 0x7f35b4153e30 2023-08-31T18:48:31.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.091+0000 7f35b9b9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f35b40637c0 0x7f35b40c0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40246/0 (socket says 172.21.15.72:40246) 2023-08-31T18:48:31.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.091+0000 7f35b9b9c700 1 -- 172.21.15.72:0/4055009676 learned_addr learned my addr 172.21.15.72:0/4055009676 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:31.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.091+0000 7f35b939b700 1 --2- 172.21.15.72:0/4055009676 >> v2:172.21.15.146:3300/0 conn(0x7f35b4153e30 0x7f35b4154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:31.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.092+0000 7f35abfff700 1 -- 172.21.15.72:0/4055009676 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398187343 0 0) 0x7f35b40bfd40 con 0x7f35b40637c0 2023-08-31T18:48:31.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.092+0000 7f35abfff700 1 -- 172.21.15.72:0/4055009676 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35a00033f0 con 0x7f35b40637c0 2023-08-31T18:48:31.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.092+0000 7f35b939b700 1 -- 172.21.15.72:0/4055009676 >> v1:172.21.15.146:6789/0 conn(0x7f35b40c5cb0 legacy=0x7f35b40630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.092+0000 7f35b939b700 1 -- 172.21.15.72:0/4055009676 >> v1:172.21.15.72:6789/0 conn(0x7f35b40637c0 legacy=0x7f35b40c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.092+0000 7f35b939b700 1 -- 172.21.15.72:0/4055009676 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b40c02c0 con 0x7f35b4153e30 2023-08-31T18:48:31.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.092+0000 7f35b939b700 1 --2- 172.21.15.72:0/4055009676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35b4153e30 0x7f35b4154210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f35b0009760 tx=0x7f35b0009060).ready entity=mon.1 client_cookie=57ddc3a3e138da22 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:31.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.092+0000 7f35abfff700 1 -- 172.21.15.72:0/4055009676 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b000f510 con 0x7f35b4153e30 2023-08-31T18:48:31.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.092+0000 7f35abfff700 1 -- 172.21.15.72:0/4055009676 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b000f670 con 0x7f35b4153e30 2023-08-31T18:48:31.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.092+0000 7f35abfff700 1 -- 172.21.15.72:0/4055009676 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b000f9f0 con 0x7f35b4153e30 2023-08-31T18:48:31.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.093+0000 7f35bb5ff700 1 -- 172.21.15.72:0/4055009676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35b4153e30 msgr2=0x7f35b4154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.093+0000 7f35bb5ff700 1 --2- 172.21.15.72:0/4055009676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35b4153e30 0x7f35b4154210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f35b0009760 tx=0x7f35b0009060).stop 2023-08-31T18:48:31.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.093+0000 7f35bb5ff700 1 -- 172.21.15.72:0/4055009676 shutdown_connections 2023-08-31T18:48:31.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.093+0000 7f35bb5ff700 1 --2- 172.21.15.72:0/4055009676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35b4153e30 0x7f35b4154210 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.093+0000 7f35bb5ff700 1 -- 172.21.15.72:0/4055009676 >> 172.21.15.72:0/4055009676 conn(0x7f35b405eb20 msgr2=0x7f35b40cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:31.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.093+0000 7f35bb5ff700 1 -- 172.21.15.72:0/4055009676 shutdown_connections 2023-08-31T18:48:31.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.093+0000 7f35bb5ff700 1 -- 172.21.15.72:0/4055009676 wait complete. 2023-08-31T18:48:31.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.094+0000 7f35bb5ff700 1 Processor -- start 2023-08-31T18:48:31.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.095+0000 7f35bb5ff700 1 -- start start 2023-08-31T18:48:31.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.095+0000 7f35bb5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35b40637c0 0x7f35b4164490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.095+0000 7f35bb5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35b40c5cb0 0x7f35b4162100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.095+0000 7f35bb5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35b4153e30 0x7f35b40a9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.095+0000 7f35bb5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b41665c0 con 0x7f35b40c5cb0 2023-08-31T18:48:31.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.095+0000 7f35bb5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b41659b0 con 0x7f35b4153e30 2023-08-31T18:48:31.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.095+0000 7f35bb5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b4165c90 con 0x7f35b40637c0 2023-08-31T18:48:31.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.096+0000 7f35b8b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35b40c5cb0 0x7f35b4162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:31.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.096+0000 7f35b8b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35b40c5cb0 0x7f35b4162100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33188/0 (socket says 172.21.15.72:33188) 2023-08-31T18:48:31.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.096+0000 7f35b8b9a700 1 -- 172.21.15.72:0/3635936173 learned_addr learned my addr 172.21.15.72:0/3635936173 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:31.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.096+0000 7f35b939b700 1 --2- 172.21.15.72:0/3635936173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35b40637c0 0x7f35b4164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:31.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.096+0000 7f35b9b9c700 1 --2- 172.21.15.72:0/3635936173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35b4153e30 0x7f35b40a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:31.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.096+0000 7f35b8b9a700 1 -- 172.21.15.72:0/3635936173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35b40637c0 msgr2=0x7f35b4164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.096+0000 7f35b8b9a700 1 --2- 172.21.15.72:0/3635936173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35b40637c0 0x7f35b4164490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.096+0000 7f35b8b9a700 1 -- 172.21.15.72:0/3635936173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35b4153e30 msgr2=0x7f35b40a9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.096+0000 7f35b8b9a700 1 --2- 172.21.15.72:0/3635936173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35b4153e30 0x7f35b40a9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.096+0000 7f35b8b9a700 1 -- 172.21.15.72:0/3635936173 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b00092a0 con 0x7f35b40c5cb0 2023-08-31T18:48:31.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.096+0000 7f35b8b9a700 1 --2- 172.21.15.72:0/3635936173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35b40c5cb0 0x7f35b4162100 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f35a400c440 tx=0x7f35a4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:31.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.097+0000 7f35a97fa700 1 -- 172.21.15.72:0/3635936173 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4007020 con 0x7f35b40c5cb0 2023-08-31T18:48:31.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.097+0000 7f35a97fa700 1 -- 172.21.15.72:0/3635936173 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a4007180 con 0x7f35b40c5cb0 2023-08-31T18:48:31.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.097+0000 7f35a97fa700 1 -- 172.21.15.72:0/3635936173 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4007520 con 0x7f35b40c5cb0 2023-08-31T18:48:31.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.097+0000 7f35bb5ff700 1 -- 172.21.15.72:0/3635936173 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b4165f70 con 0x7f35b40c5cb0 2023-08-31T18:48:31.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.097+0000 7f35bb5ff700 1 -- 172.21.15.72:0/3635936173 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b4165660 con 0x7f35b40c5cb0 2023-08-31T18:48:31.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.098+0000 7f35bb5ff700 1 -- 172.21.15.72:0/3635936173 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b4166770 con 0x7f35b40c5cb0 2023-08-31T18:48:31.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.098+0000 7f35a97fa700 1 -- 172.21.15.72:0/3635936173 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f35a40068b0 con 0x7f35b40c5cb0 2023-08-31T18:48:31.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.099+0000 7f35a97fa700 1 --2- 172.21.15.72:0/3635936173 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f359805ee10 0x7f35980612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.100+0000 7f35a97fa700 1 -- 172.21.15.72:0/3635936173 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f35a40790b0 con 0x7f35b40c5cb0 2023-08-31T18:48:31.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.100+0000 7f35b939b700 1 --2- 172.21.15.72:0/3635936173 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f359805ee10 0x7f35980612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:31.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.100+0000 7f35b939b700 1 --2- 172.21.15.72:0/3635936173 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f359805ee10 0x7f35980612d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f35b40a4810 tx=0x7f35b0017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:31.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.103+0000 7f35a97fa700 1 -- 172.21.15.72:0/3635936173 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f35a40478f0 con 0x7f35b40c5cb0 2023-08-31T18:48:31.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.272+0000 7f35bb5ff700 1 -- 172.21.15.72:0/3635936173 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f35b406c6b0 con 0x7f35b40c5cb0 2023-08-31T18:48:31.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.272+0000 7f35a97fa700 1 -- 172.21.15.72:0/3635936173 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f35b4166770 con 0x7f35b40c5cb0 2023-08-31T18:48:31.273 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T18:48:31.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.274+0000 7f35bb5ff700 1 -- 172.21.15.72:0/3635936173 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f359805ee10 msgr2=0x7f35980612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.274+0000 7f35bb5ff700 1 --2- 172.21.15.72:0/3635936173 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f359805ee10 0x7f35980612d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f35b40a4810 tx=0x7f35b0017000).stop 2023-08-31T18:48:31.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.274+0000 7f35bb5ff700 1 -- 172.21.15.72:0/3635936173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35b40c5cb0 msgr2=0x7f35b4162100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.274+0000 7f35bb5ff700 1 --2- 172.21.15.72:0/3635936173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35b40c5cb0 0x7f35b4162100 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f35a400c440 tx=0x7f35a4007e00).stop 2023-08-31T18:48:31.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.274+0000 7f35bb5ff700 1 -- 172.21.15.72:0/3635936173 shutdown_connections 2023-08-31T18:48:31.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.274+0000 7f35bb5ff700 1 --2- 172.21.15.72:0/3635936173 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f359805ee10 0x7f35980612d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.274+0000 7f35bb5ff700 1 --2- 172.21.15.72:0/3635936173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35b4153e30 0x7f35b40a9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.274+0000 7f35bb5ff700 1 --2- 172.21.15.72:0/3635936173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35b40637c0 0x7f35b4164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.274+0000 7f35bb5ff700 1 --2- 172.21.15.72:0/3635936173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35b40c5cb0 0x7f35b4162100 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.274+0000 7f35bb5ff700 1 -- 172.21.15.72:0/3635936173 >> 172.21.15.72:0/3635936173 conn(0x7f35b405eb20 msgr2=0x7f35b40c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:31.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.274+0000 7f35bb5ff700 1 -- 172.21.15.72:0/3635936173 shutdown_connections 2023-08-31T18:48:31.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.274+0000 7f35bb5ff700 1 -- 172.21.15.72:0/3635936173 wait complete. 2023-08-31T18:48:31.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T18:48:31.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.483+0000 7f2175dff700 1 Processor -- start 2023-08-31T18:48:31.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.483+0000 7f2175dff700 1 -- start start 2023-08-31T18:48:31.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.484+0000 7f2175dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f217014e3c0 0x7f21700bc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.484+0000 7f2175dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f217006a6c0 con 0x7f2170150f30 2023-08-31T18:48:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.484+0000 7f2175dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21700bca60 con 0x7f21700c2110 2023-08-31T18:48:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.484+0000 7f2175dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21700bcd40 con 0x7f217014e3c0 2023-08-31T18:48:31.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.484+0000 7f2167fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2170150f30 0x7f21700c1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40254/0 (socket says 172.21.15.72:40254) 2023-08-31T18:48:31.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.484+0000 7f2167fff700 1 -- 172.21.15.72:0/2690707009 learned_addr learned my addr 172.21.15.72:0/2690707009 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:31.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.485+0000 7f216f7fe700 1 --2- 172.21.15.72:0/2690707009 >> v2:172.21.15.146:3300/0 conn(0x7f217014e3c0 0x7f21700bc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:31.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.485+0000 7f216effd700 1 -- 172.21.15.72:0/2690707009 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062558808 0 0) 0x7f217006a6c0 con 0x7f2170150f30 2023-08-31T18:48:31.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.485+0000 7f216effd700 1 -- 172.21.15.72:0/2690707009 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f215c0033f0 con 0x7f2170150f30 2023-08-31T18:48:31.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.485+0000 7f216effd700 1 -- 172.21.15.72:0/2690707009 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736854887 0 0) 0x7f21700bca60 con 0x7f21700c2110 2023-08-31T18:48:31.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.485+0000 7f216effd700 1 -- 172.21.15.72:0/2690707009 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f217006a6c0 con 0x7f21700c2110 2023-08-31T18:48:31.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.485+0000 7f216f7fe700 1 -- 172.21.15.72:0/2690707009 >> v1:172.21.15.146:6789/0 conn(0x7f21700c2110 legacy=0x7f2170064700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.485+0000 7f216f7fe700 1 -- 172.21.15.72:0/2690707009 >> v1:172.21.15.72:6789/0 conn(0x7f2170150f30 legacy=0x7f21700c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.485+0000 7f216effd700 1 -- 172.21.15.72:0/2690707009 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 793947869 0 0) 0x7f215c0033f0 con 0x7f2170150f30 2023-08-31T18:48:31.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.485+0000 7f216f7fe700 1 -- 172.21.15.72:0/2690707009 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700bd020 con 0x7f217014e3c0 2023-08-31T18:48:31.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.485+0000 7f216f7fe700 1 --2- 172.21.15.72:0/2690707009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f217014e3c0 0x7f21700bc180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f2160009760 tx=0x7f2160009060).ready entity=mon.1 client_cookie=a3f675e403947548 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:31.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.486+0000 7f216effd700 1 -- 172.21.15.72:0/2690707009 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158001470 con 0x7f217014e3c0 2023-08-31T18:48:31.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.486+0000 7f216effd700 1 -- 172.21.15.72:0/2690707009 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2160011400 con 0x7f217014e3c0 2023-08-31T18:48:31.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.486+0000 7f216effd700 1 -- 172.21.15.72:0/2690707009 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160011780 con 0x7f217014e3c0 2023-08-31T18:48:31.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.486+0000 7f2175dff700 1 -- 172.21.15.72:0/2690707009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f217014e3c0 msgr2=0x7f21700bc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.486+0000 7f2175dff700 1 --2- 172.21.15.72:0/2690707009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f217014e3c0 0x7f21700bc180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f2160009760 tx=0x7f2160009060).stop 2023-08-31T18:48:31.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.486+0000 7f2175dff700 1 -- 172.21.15.72:0/2690707009 shutdown_connections 2023-08-31T18:48:31.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.486+0000 7f2175dff700 1 --2- 172.21.15.72:0/2690707009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f217014e3c0 0x7f21700bc180 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.486+0000 7f2175dff700 1 -- 172.21.15.72:0/2690707009 >> 172.21.15.72:0/2690707009 conn(0x7f21700630c0 msgr2=0x7f21700c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:31.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.486+0000 7f2175dff700 1 -- 172.21.15.72:0/2690707009 shutdown_connections 2023-08-31T18:48:31.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.486+0000 7f2175dff700 1 -- 172.21.15.72:0/2690707009 wait complete. 2023-08-31T18:48:31.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.488+0000 7f2175dff700 1 Processor -- start 2023-08-31T18:48:31.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.488+0000 7f2175dff700 1 -- start start 2023-08-31T18:48:31.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.489+0000 7f2175dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21700c2110 0x7f217014afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.489+0000 7f2175dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f217014e3c0 0x7f21700aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.489+0000 7f2175dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2170150f30 0x7f21700aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.489+0000 7f2175dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21700ab260 con 0x7f2170150f30 2023-08-31T18:48:31.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.489+0000 7f2175dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21700ac050 con 0x7f21700c2110 2023-08-31T18:48:31.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.489+0000 7f2175dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2170157a50 con 0x7f217014e3c0 2023-08-31T18:48:31.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.489+0000 7f216ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2170150f30 0x7f21700aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:31.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.489+0000 7f216ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2170150f30 0x7f21700aad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33196/0 (socket says 172.21.15.72:33196) 2023-08-31T18:48:31.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.489+0000 7f216ffff700 1 -- 172.21.15.72:0/4201913663 learned_addr learned my addr 172.21.15.72:0/4201913663 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:31.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.489+0000 7f216f7fe700 1 --2- 172.21.15.72:0/4201913663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21700c2110 0x7f217014afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:31.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.490+0000 7f2167fff700 1 --2- 172.21.15.72:0/4201913663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f217014e3c0 0x7f21700aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:31.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.490+0000 7f216ffff700 1 -- 172.21.15.72:0/4201913663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f217014e3c0 msgr2=0x7f21700aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.490+0000 7f216ffff700 1 --2- 172.21.15.72:0/4201913663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f217014e3c0 0x7f21700aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.490+0000 7f216ffff700 1 -- 172.21.15.72:0/4201913663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21700c2110 msgr2=0x7f217014afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.490+0000 7f216ffff700 1 --2- 172.21.15.72:0/4201913663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21700c2110 0x7f217014afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.490+0000 7f216ffff700 1 -- 172.21.15.72:0/4201913663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21600092a0 con 0x7f2170150f30 2023-08-31T18:48:31.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.490+0000 7f216ffff700 1 --2- 172.21.15.72:0/4201913663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2170150f30 0x7f21700aad70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f2168003260 tx=0x7f2168007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:31.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.490+0000 7f21677fe700 1 -- 172.21.15.72:0/4201913663 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216800e4a0 con 0x7f2170150f30 2023-08-31T18:48:31.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.490+0000 7f21677fe700 1 -- 172.21.15.72:0/4201913663 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216800e600 con 0x7f2170150f30 2023-08-31T18:48:31.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.490+0000 7f21677fe700 1 -- 172.21.15.72:0/4201913663 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216800e980 con 0x7f2170150f30 2023-08-31T18:48:31.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.490+0000 7f2175dff700 1 -- 172.21.15.72:0/4201913663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21700ab440 con 0x7f2170150f30 2023-08-31T18:48:31.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.490+0000 7f2175dff700 1 -- 172.21.15.72:0/4201913663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21700aba00 con 0x7f2170150f30 2023-08-31T18:48:31.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.492+0000 7f2175dff700 1 -- 172.21.15.72:0/4201913663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21700ac1e0 con 0x7f2170150f30 2023-08-31T18:48:31.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.492+0000 7f21677fe700 1 -- 172.21.15.72:0/4201913663 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f2168012400 con 0x7f2170150f30 2023-08-31T18:48:31.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.493+0000 7f21677fe700 1 --2- 172.21.15.72:0/4201913663 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f215005ee10 0x7f21500612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.494+0000 7f21677fe700 1 -- 172.21.15.72:0/4201913663 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2168079540 con 0x7f2170150f30 2023-08-31T18:48:31.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.494+0000 7f216f7fe700 1 --2- 172.21.15.72:0/4201913663 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f215005ee10 0x7f21500612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:31.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.494+0000 7f216f7fe700 1 --2- 172.21.15.72:0/4201913663 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f215005ee10 0x7f21500612d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f2160009760 tx=0x7f2160016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:31.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.497+0000 7f21677fe700 1 -- 172.21.15.72:0/4201913663 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f21680488f0 con 0x7f2170150f30 2023-08-31T18:48:31.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.665+0000 7f2175dff700 1 -- 172.21.15.72:0/4201913663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f21700bd300 con 0x7f2170150f30 2023-08-31T18:48:31.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.666+0000 7f21677fe700 1 -- 172.21.15.72:0/4201913663 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f216804a980 con 0x7f2170150f30 2023-08-31T18:48:31.667 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T18:48:31.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.668+0000 7f2175dff700 1 -- 172.21.15.72:0/4201913663 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f215005ee10 msgr2=0x7f21500612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.668+0000 7f2175dff700 1 --2- 172.21.15.72:0/4201913663 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f215005ee10 0x7f21500612d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f2160009760 tx=0x7f2160016000).stop 2023-08-31T18:48:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.668+0000 7f2175dff700 1 -- 172.21.15.72:0/4201913663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2170150f30 msgr2=0x7f21700aad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.668+0000 7f2175dff700 1 --2- 172.21.15.72:0/4201913663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2170150f30 0x7f21700aad70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f2168003260 tx=0x7f2168007f20).stop 2023-08-31T18:48:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.668+0000 7f2175dff700 1 -- 172.21.15.72:0/4201913663 shutdown_connections 2023-08-31T18:48:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.668+0000 7f2175dff700 1 --2- 172.21.15.72:0/4201913663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2170150f30 0x7f21700aad70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.668+0000 7f2175dff700 1 --2- 172.21.15.72:0/4201913663 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f215005ee10 0x7f21500612d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.668+0000 7f2175dff700 1 --2- 172.21.15.72:0/4201913663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21700c2110 0x7f217014afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.668+0000 7f2175dff700 1 --2- 172.21.15.72:0/4201913663 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f217014e3c0 0x7f21700aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.668+0000 7f2175dff700 1 -- 172.21.15.72:0/4201913663 >> 172.21.15.72:0/4201913663 conn(0x7f21700630c0 msgr2=0x7f2170069340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:31.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.668+0000 7f2175dff700 1 -- 172.21.15.72:0/4201913663 shutdown_connections 2023-08-31T18:48:31.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.668+0000 7f2175dff700 1 -- 172.21.15.72:0/4201913663 wait complete. 2023-08-31T18:48:31.685 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T18:48:31.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.876+0000 7f30f83ff700 1 Processor -- start 2023-08-31T18:48:31.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.876+0000 7f30f83ff700 1 -- start start 2023-08-31T18:48:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.877+0000 7f30f83ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f30f00c2320 0x7f30f00c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.877+0000 7f30f83ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f30f00696a0 0x7f30f0069af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.877+0000 7f30f83ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f00c2cc0 con 0x7f30f014ecd0 2023-08-31T18:48:31.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.877+0000 7f30f83ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f0152720 con 0x7f30f00c2320 2023-08-31T18:48:31.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.877+0000 7f30f83ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f0151b10 con 0x7f30f00696a0 2023-08-31T18:48:31.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.878+0000 7f30f599a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f30f00c2320 0x7f30f00c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:31.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.878+0000 7f30f599a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f30f00c2320 0x7f30f00c27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33204/0 (socket says 172.21.15.72:33204) 2023-08-31T18:48:31.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.878+0000 7f30f599a700 1 -- 172.21.15.72:0/743330842 learned_addr learned my addr 172.21.15.72:0/743330842 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:31.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.878+0000 7f30f619b700 1 --1- 172.21.15.72:0/743330842 >> v1:172.21.15.72:6789/0 conn(0x7f30f014ecd0 0x7f30f01556d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40258/0 (socket says 172.21.15.72:40258) 2023-08-31T18:48:31.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.878+0000 7f30f699c700 1 --2- 172.21.15.72:0/743330842 >> v2:172.21.15.146:3300/0 conn(0x7f30f00696a0 0x7f30f0069af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:31.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.878+0000 7f30f599a700 1 -- 172.21.15.72:0/743330842 >> v2:172.21.15.146:3300/0 conn(0x7f30f00696a0 msgr2=0x7f30f0069af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.878+0000 7f30f599a700 1 --2- 172.21.15.72:0/743330842 >> v2:172.21.15.146:3300/0 conn(0x7f30f00696a0 0x7f30f0069af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.878+0000 7f30f599a700 1 -- 172.21.15.72:0/743330842 >> v1:172.21.15.72:6789/0 conn(0x7f30f014ecd0 legacy=0x7f30f01556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.878+0000 7f30f599a700 1 -- 172.21.15.72:0/743330842 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f0151df0 con 0x7f30f00c2320 2023-08-31T18:48:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.878+0000 7f30f5199700 1 -- 172.21.15.72:0/743330842 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035003209 0 0) 0x7f30ec001110 con 0x7f30f014ecd0 2023-08-31T18:48:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.878+0000 7f30f599a700 1 --2- 172.21.15.72:0/743330842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f00c2320 0x7f30f00c27d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f30f00bd9d0 tx=0x7f30e000b3b0).ready entity=mon.0 client_cookie=617adc250c2c3dee server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:31.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.879+0000 7f30f5199700 1 -- 172.21.15.72:0/743330842 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e000db10 con 0x7f30f00c2320 2023-08-31T18:48:31.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.879+0000 7f30f5199700 1 -- 172.21.15.72:0/743330842 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e000dc70 con 0x7f30f00c2320 2023-08-31T18:48:31.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.879+0000 7f30f5199700 1 -- 172.21.15.72:0/743330842 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0010470 con 0x7f30f00c2320 2023-08-31T18:48:31.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.879+0000 7f30f83ff700 1 -- 172.21.15.72:0/743330842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f00c2320 msgr2=0x7f30f00c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.879+0000 7f30f83ff700 1 --2- 172.21.15.72:0/743330842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f00c2320 0x7f30f00c27d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f30f00bd9d0 tx=0x7f30e000b3b0).stop 2023-08-31T18:48:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.879+0000 7f30f83ff700 1 -- 172.21.15.72:0/743330842 shutdown_connections 2023-08-31T18:48:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.879+0000 7f30f83ff700 1 --2- 172.21.15.72:0/743330842 >> v2:172.21.15.146:3300/0 conn(0x7f30f00696a0 0x7f30f0069af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.879+0000 7f30f83ff700 1 --2- 172.21.15.72:0/743330842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f00c2320 0x7f30f00c27d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.879+0000 7f30f83ff700 1 -- 172.21.15.72:0/743330842 >> 172.21.15.72:0/743330842 conn(0x7f30f00630c0 msgr2=0x7f30f00c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.879+0000 7f30f83ff700 1 -- 172.21.15.72:0/743330842 shutdown_connections 2023-08-31T18:48:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.879+0000 7f30f83ff700 1 -- 172.21.15.72:0/743330842 wait complete. 2023-08-31T18:48:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.881+0000 7f30f83ff700 1 Processor -- start 2023-08-31T18:48:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.881+0000 7f30f83ff700 1 -- start start 2023-08-31T18:48:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.882+0000 7f30f83ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f00696a0 0x7f30f00a7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.882+0000 7f30f83ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30f00c2320 0x7f30f00c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.882+0000 7f30f83ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f30f014ecd0 0x7f30f01352d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.882+0000 7f30f83ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f00ac180 con 0x7f30f00696a0 2023-08-31T18:48:31.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.882+0000 7f30f83ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f01658e0 con 0x7f30f00c2320 2023-08-31T18:48:31.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.882+0000 7f30f83ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0165ba0 con 0x7f30f014ecd0 2023-08-31T18:48:31.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.882+0000 7f30f619b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f00696a0 0x7f30f00a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:31.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.882+0000 7f30f619b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f00696a0 0x7f30f00a7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33220/0 (socket says 172.21.15.72:33220) 2023-08-31T18:48:31.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.882+0000 7f30f619b700 1 -- 172.21.15.72:0/1312778266 learned_addr learned my addr 172.21.15.72:0/1312778266 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:31.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.882+0000 7f30f619b700 1 -- 172.21.15.72:0/1312778266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f30f014ecd0 msgr2=0x7f30f01352d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.882+0000 7f30f619b700 1 --2- 172.21.15.72:0/1312778266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f30f014ecd0 0x7f30f01352d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.882+0000 7f30f619b700 1 -- 172.21.15.72:0/1312778266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30f00c2320 msgr2=0x7f30f00c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.882+0000 7f30f619b700 1 --2- 172.21.15.72:0/1312778266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30f00c2320 0x7f30f00c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.882+0000 7f30f619b700 1 -- 172.21.15.72:0/1312778266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e000b610 con 0x7f30f00696a0 2023-08-31T18:48:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.883+0000 7f30f619b700 1 --2- 172.21.15.72:0/1312778266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f00696a0 0x7f30f00a7440 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f30ec00c440 tx=0x7f30ec007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.883+0000 7f30e67fc700 1 -- 172.21.15.72:0/1312778266 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec0072e0 con 0x7f30f00696a0 2023-08-31T18:48:31.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.883+0000 7f30e67fc700 1 -- 172.21.15.72:0/1312778266 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec007440 con 0x7f30f00696a0 2023-08-31T18:48:31.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.883+0000 7f30f83ff700 1 -- 172.21.15.72:0/1312778266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f00ac390 con 0x7f30f00696a0 2023-08-31T18:48:31.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.883+0000 7f30e67fc700 1 -- 172.21.15.72:0/1312778266 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec005910 con 0x7f30f00696a0 2023-08-31T18:48:31.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.883+0000 7f30f83ff700 1 -- 172.21.15.72:0/1312778266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f00ac950 con 0x7f30f00696a0 2023-08-31T18:48:31.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.884+0000 7f30f83ff700 1 -- 172.21.15.72:0/1312778266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f006c6b0 con 0x7f30f00696a0 2023-08-31T18:48:31.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.885+0000 7f30e67fc700 1 -- 172.21.15.72:0/1312778266 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f30ec005d00 con 0x7f30f00696a0 2023-08-31T18:48:31.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.885+0000 7f30e67fc700 1 --2- 172.21.15.72:0/1312778266 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f30d405ee10 0x7f30d40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:31.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.886+0000 7f30e67fc700 1 -- 172.21.15.72:0/1312778266 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f30ec0793b0 con 0x7f30f00696a0 2023-08-31T18:48:31.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.886+0000 7f30f599a700 1 --2- 172.21.15.72:0/1312778266 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f30d405ee10 0x7f30d40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:31.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.886+0000 7f30f599a700 1 --2- 172.21.15.72:0/1312778266 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f30d405ee10 0x7f30d40612d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f30f00aa100 tx=0x7f30e000b3b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:31.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:31.889+0000 7f30e67fc700 1 -- 172.21.15.72:0/1312778266 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f30ec04a760 con 0x7f30f00696a0 2023-08-31T18:48:32.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.059+0000 7f30f83ff700 1 -- 172.21.15.72:0/1312778266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f30f00acb70 con 0x7f30f00696a0 2023-08-31T18:48:32.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.060+0000 7f30e67fc700 1 -- 172.21.15.72:0/1312778266 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f30ec04dd80 con 0x7f30f00696a0 2023-08-31T18:48:32.062 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T18:48:32.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.062+0000 7f30f83ff700 1 -- 172.21.15.72:0/1312778266 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f30d405ee10 msgr2=0x7f30d40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.062+0000 7f30f83ff700 1 --2- 172.21.15.72:0/1312778266 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f30d405ee10 0x7f30d40612d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f30f00aa100 tx=0x7f30e000b3b0).stop 2023-08-31T18:48:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.062+0000 7f30f83ff700 1 -- 172.21.15.72:0/1312778266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f00696a0 msgr2=0x7f30f00a7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.062+0000 7f30f83ff700 1 --2- 172.21.15.72:0/1312778266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f00696a0 0x7f30f00a7440 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f30ec00c440 tx=0x7f30ec007e30).stop 2023-08-31T18:48:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.062+0000 7f30f83ff700 1 -- 172.21.15.72:0/1312778266 shutdown_connections 2023-08-31T18:48:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.062+0000 7f30f83ff700 1 --2- 172.21.15.72:0/1312778266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f30f014ecd0 0x7f30f01352d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.062+0000 7f30f83ff700 1 --2- 172.21.15.72:0/1312778266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f00696a0 0x7f30f00a7440 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.062+0000 7f30f83ff700 1 --2- 172.21.15.72:0/1312778266 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f30d405ee10 0x7f30d40612d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.062+0000 7f30f83ff700 1 --2- 172.21.15.72:0/1312778266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30f00c2320 0x7f30f00c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.062+0000 7f30f83ff700 1 -- 172.21.15.72:0/1312778266 >> 172.21.15.72:0/1312778266 conn(0x7f30f00630c0 msgr2=0x7f30f01528e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.062+0000 7f30f83ff700 1 -- 172.21.15.72:0/1312778266 shutdown_connections 2023-08-31T18:48:32.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.062+0000 7f30f83ff700 1 -- 172.21.15.72:0/1312778266 wait complete. 2023-08-31T18:48:32.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T18:48:32.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.269+0000 7f331afff700 1 Processor -- start 2023-08-31T18:48:32.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.269+0000 7f331afff700 1 -- start start 2023-08-31T18:48:32.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.271+0000 7f331afff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3314153e30 0x7f3314154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:32.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.271+0000 7f331afff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33140637c0 0x7f33140c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:32.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.271+0000 7f331afff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33140bfd40 con 0x7f33140c5cb0 2023-08-31T18:48:32.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.271+0000 7f331afff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33140c6730 con 0x7f3314153e30 2023-08-31T18:48:32.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.271+0000 7f331afff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33140bffe0 con 0x7f33140637c0 2023-08-31T18:48:32.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.271+0000 7f3318d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3314153e30 0x7f3314154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:32.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.271+0000 7f3318d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3314153e30 0x7f3314154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33234/0 (socket says 172.21.15.72:33234) 2023-08-31T18:48:32.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.271+0000 7f3318d9b700 1 -- 172.21.15.72:0/1849873977 learned_addr learned my addr 172.21.15.72:0/1849873977 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:32.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.271+0000 7f331959c700 1 --2- 172.21.15.72:0/1849873977 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33140637c0 0x7f33140c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:32.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.271+0000 7f3318d9b700 1 -- 172.21.15.72:0/1849873977 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33140637c0 msgr2=0x7f33140c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:32.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.271+0000 7f3318d9b700 1 --2- 172.21.15.72:0/1849873977 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33140637c0 0x7f33140c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.271+0000 7f3318d9b700 1 -- 172.21.15.72:0/1849873977 >> v1:172.21.15.146:6789/0 conn(0x7f33140c5cb0 legacy=0x7f33140630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:32.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.271+0000 7f3318d9b700 1 -- 172.21.15.72:0/1849873977 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33140c02c0 con 0x7f3314153e30 2023-08-31T18:48:32.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.272+0000 7f3318d9b700 1 --2- 172.21.15.72:0/1849873977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3314153e30 0x7f3314154210 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f3308006fd0 tx=0x7f33080090f0).ready entity=mon.0 client_cookie=9b5fa2ced9fa39f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:32.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.272+0000 7f33137fe700 1 -- 172.21.15.72:0/1849873977 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800b600 con 0x7f3314153e30 2023-08-31T18:48:32.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.272+0000 7f33137fe700 1 -- 172.21.15.72:0/1849873977 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330800b760 con 0x7f3314153e30 2023-08-31T18:48:32.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.272+0000 7f33137fe700 1 -- 172.21.15.72:0/1849873977 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330800bb00 con 0x7f3314153e30 2023-08-31T18:48:32.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.272+0000 7f331afff700 1 -- 172.21.15.72:0/1849873977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3314153e30 msgr2=0x7f3314154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:32.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.272+0000 7f331afff700 1 --2- 172.21.15.72:0/1849873977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3314153e30 0x7f3314154210 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f3308006fd0 tx=0x7f33080090f0).stop 2023-08-31T18:48:32.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.272+0000 7f331afff700 1 -- 172.21.15.72:0/1849873977 shutdown_connections 2023-08-31T18:48:32.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.272+0000 7f331afff700 1 --2- 172.21.15.72:0/1849873977 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33140637c0 0x7f33140c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.272+0000 7f331afff700 1 --2- 172.21.15.72:0/1849873977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3314153e30 0x7f3314154210 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.272+0000 7f331afff700 1 -- 172.21.15.72:0/1849873977 >> 172.21.15.72:0/1849873977 conn(0x7f331405eb20 msgr2=0x7f33140cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:32.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.272+0000 7f331afff700 1 -- 172.21.15.72:0/1849873977 shutdown_connections 2023-08-31T18:48:32.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.273+0000 7f331afff700 1 -- 172.21.15.72:0/1849873977 wait complete. 2023-08-31T18:48:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.274+0000 7f331afff700 1 Processor -- start 2023-08-31T18:48:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.274+0000 7f331afff700 1 -- start start 2023-08-31T18:48:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.275+0000 7f331afff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33140637c0 0x7f3314152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:32.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.275+0000 7f331afff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33140c5cb0 0x7f33140c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:32.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.275+0000 7f331afff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3314153e30 0x7f33140c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:32.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.275+0000 7f331afff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33140c2e50 con 0x7f3314153e30 2023-08-31T18:48:32.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.275+0000 7f331afff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33140c3130 con 0x7f33140c5cb0 2023-08-31T18:48:32.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.275+0000 7f331afff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33140c3410 con 0x7f33140637c0 2023-08-31T18:48:32.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.275+0000 7f331959c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3314153e30 0x7f33140c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:32.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.275+0000 7f331959c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3314153e30 0x7f33140c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33242/0 (socket says 172.21.15.72:33242) 2023-08-31T18:48:32.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.275+0000 7f331959c700 1 -- 172.21.15.72:0/2457744620 learned_addr learned my addr 172.21.15.72:0/2457744620 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:32.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.276+0000 7f3313fff700 1 --2- 172.21.15.72:0/2457744620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33140c5cb0 0x7f33140c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:32.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.275+0000 7f3318d9b700 1 --2- 172.21.15.72:0/2457744620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33140637c0 0x7f3314152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:32.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.276+0000 7f331959c700 1 -- 172.21.15.72:0/2457744620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33140637c0 msgr2=0x7f3314152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:32.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.276+0000 7f331959c700 1 --2- 172.21.15.72:0/2457744620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33140637c0 0x7f3314152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.276+0000 7f331959c700 1 -- 172.21.15.72:0/2457744620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33140c5cb0 msgr2=0x7f33140c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:32.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.276+0000 7f331959c700 1 --2- 172.21.15.72:0/2457744620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33140c5cb0 0x7f33140c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.276+0000 7f331959c700 1 -- 172.21.15.72:0/2457744620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3308009370 con 0x7f3314153e30 2023-08-31T18:48:32.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.276+0000 7f331959c700 1 --2- 172.21.15.72:0/2457744620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3314153e30 0x7f33140c46c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f330c007f20 tx=0x7f330c0098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:32.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.276+0000 7f3310ff9700 1 -- 172.21.15.72:0/2457744620 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00eb90 con 0x7f3314153e30 2023-08-31T18:48:32.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.276+0000 7f3310ff9700 1 -- 172.21.15.72:0/2457744620 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c00ecf0 con 0x7f3314153e30 2023-08-31T18:48:32.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.276+0000 7f331afff700 1 -- 172.21.15.72:0/2457744620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33140c36f0 con 0x7f3314153e30 2023-08-31T18:48:32.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.276+0000 7f3310ff9700 1 -- 172.21.15.72:0/2457744620 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c014610 con 0x7f3314153e30 2023-08-31T18:48:32.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.276+0000 7f331afff700 1 -- 172.21.15.72:0/2457744620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33140c3cb0 con 0x7f3314153e30 2023-08-31T18:48:32.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.277+0000 7f331afff700 1 -- 172.21.15.72:0/2457744620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33140c3ed0 con 0x7f3314153e30 2023-08-31T18:48:32.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.278+0000 7f3310ff9700 1 -- 172.21.15.72:0/2457744620 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f330c01d3b0 con 0x7f3314153e30 2023-08-31T18:48:32.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.279+0000 7f3310ff9700 1 --2- 172.21.15.72:0/2457744620 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f32f805ee10 0x7f32f80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:32.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.279+0000 7f3310ff9700 1 -- 172.21.15.72:0/2457744620 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f330c07a2a0 con 0x7f3314153e30 2023-08-31T18:48:32.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.279+0000 7f3318d9b700 1 --2- 172.21.15.72:0/2457744620 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f32f805ee10 0x7f32f80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:32.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.280+0000 7f3318d9b700 1 --2- 172.21.15.72:0/2457744620 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f32f805ee10 0x7f32f80612d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f330800b3c0 tx=0x7f3308017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:32.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.283+0000 7f3310ff9700 1 -- 172.21.15.72:0/2457744620 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f330c04b5f0 con 0x7f3314153e30 2023-08-31T18:48:32.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.451+0000 7f331afff700 1 -- 172.21.15.72:0/2457744620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3314062970 con 0x7f3314153e30 2023-08-31T18:48:32.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.452+0000 7f3310ff9700 1 -- 172.21.15.72:0/2457744620 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f330c00ee60 con 0x7f3314153e30 2023-08-31T18:48:32.452 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T18:48:32.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.454+0000 7f331afff700 1 -- 172.21.15.72:0/2457744620 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f32f805ee10 msgr2=0x7f32f80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:32.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.454+0000 7f331afff700 1 --2- 172.21.15.72:0/2457744620 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f32f805ee10 0x7f32f80612d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f330800b3c0 tx=0x7f3308017000).stop 2023-08-31T18:48:32.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.454+0000 7f331afff700 1 -- 172.21.15.72:0/2457744620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3314153e30 msgr2=0x7f33140c46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:32.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.454+0000 7f331afff700 1 --2- 172.21.15.72:0/2457744620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3314153e30 0x7f33140c46c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f330c007f20 tx=0x7f330c0098a0).stop 2023-08-31T18:48:32.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.454+0000 7f331afff700 1 -- 172.21.15.72:0/2457744620 shutdown_connections 2023-08-31T18:48:32.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.454+0000 7f331afff700 1 --2- 172.21.15.72:0/2457744620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3314153e30 0x7f33140c46c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.454+0000 7f331afff700 1 --2- 172.21.15.72:0/2457744620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33140637c0 0x7f3314152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.454+0000 7f331afff700 1 --2- 172.21.15.72:0/2457744620 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f32f805ee10 0x7f32f80612d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.454+0000 7f331afff700 1 --2- 172.21.15.72:0/2457744620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33140c5cb0 0x7f33140c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.454+0000 7f331afff700 1 -- 172.21.15.72:0/2457744620 >> 172.21.15.72:0/2457744620 conn(0x7f331405eb20 msgr2=0x7f33140ac970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:32.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.454+0000 7f331afff700 1 -- 172.21.15.72:0/2457744620 shutdown_connections 2023-08-31T18:48:32.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.454+0000 7f331afff700 1 -- 172.21.15.72:0/2457744620 wait complete. 2023-08-31T18:48:32.499 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-08-31T18:48:32.500 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-31T18:48:32.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-08-31T18:48:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.691+0000 7fdc773ff700 1 Processor -- start 2023-08-31T18:48:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.691+0000 7fdc773ff700 1 -- start start 2023-08-31T18:48:32.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.692+0000 7fdc773ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc700bea80 0x7fdc700c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:32.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.692+0000 7fdc773ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdc700c44a0 0x7fdc70063a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:32.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.692+0000 7fdc773ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc700c48f0 con 0x7fdc700c5fb0 2023-08-31T18:48:32.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.692+0000 7fdc773ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc70154690 con 0x7fdc700bea80 2023-08-31T18:48:32.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.692+0000 7fdc773ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc700bfb20 con 0x7fdc700c44a0 2023-08-31T18:48:32.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.693+0000 7fdc7499a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc700bea80 0x7fdc700c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:32.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.693+0000 7fdc7499a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc700bea80 0x7fdc700c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33248/0 (socket says 172.21.15.72:33248) 2023-08-31T18:48:32.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.693+0000 7fdc7499a700 1 -- 172.21.15.72:0/1478882950 learned_addr learned my addr 172.21.15.72:0/1478882950 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:32.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.693+0000 7fdc7599c700 1 --2- 172.21.15.72:0/1478882950 >> v2:172.21.15.146:3300/0 conn(0x7fdc700c44a0 0x7fdc70063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:32.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.693+0000 7fdc7499a700 1 -- 172.21.15.72:0/1478882950 >> v2:172.21.15.146:3300/0 conn(0x7fdc700c44a0 msgr2=0x7fdc70063a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:32.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.693+0000 7fdc7499a700 1 --2- 172.21.15.72:0/1478882950 >> v2:172.21.15.146:3300/0 conn(0x7fdc700c44a0 0x7fdc70063a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.693+0000 7fdc7499a700 1 -- 172.21.15.72:0/1478882950 >> v1:172.21.15.146:6789/0 conn(0x7fdc700c5fb0 legacy=0x7fdc700be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:32.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.693+0000 7fdc7499a700 1 -- 172.21.15.72:0/1478882950 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc700bef10 con 0x7fdc700bea80 2023-08-31T18:48:32.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.693+0000 7fdc7599c700 1 --2- 172.21.15.72:0/1478882950 >> v2:172.21.15.146:3300/0 conn(0x7fdc700c44a0 0x7fdc70063a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:32.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.693+0000 7fdc7499a700 1 --2- 172.21.15.72:0/1478882950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc700bea80 0x7fdc700c3fb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fdc7006a330 tx=0x7fdc600090f0).ready entity=mon.0 client_cookie=440dcd5ebc160538 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:32.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.694+0000 7fdc67fff700 1 -- 172.21.15.72:0/1478882950 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6000b600 con 0x7fdc700bea80 2023-08-31T18:48:32.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.694+0000 7fdc67fff700 1 -- 172.21.15.72:0/1478882950 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6000b760 con 0x7fdc700bea80 2023-08-31T18:48:32.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.694+0000 7fdc67fff700 1 -- 172.21.15.72:0/1478882950 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6000bae0 con 0x7fdc700bea80 2023-08-31T18:48:32.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.694+0000 7fdc773ff700 1 -- 172.21.15.72:0/1478882950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc700bea80 msgr2=0x7fdc700c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:32.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.694+0000 7fdc773ff700 1 --2- 172.21.15.72:0/1478882950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc700bea80 0x7fdc700c3fb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fdc7006a330 tx=0x7fdc600090f0).stop 2023-08-31T18:48:32.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.694+0000 7fdc773ff700 1 -- 172.21.15.72:0/1478882950 shutdown_connections 2023-08-31T18:48:32.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.694+0000 7fdc773ff700 1 --2- 172.21.15.72:0/1478882950 >> v2:172.21.15.146:3300/0 conn(0x7fdc700c44a0 0x7fdc70063a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.694+0000 7fdc773ff700 1 --2- 172.21.15.72:0/1478882950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc700bea80 0x7fdc700c3fb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.694+0000 7fdc773ff700 1 -- 172.21.15.72:0/1478882950 >> 172.21.15.72:0/1478882950 conn(0x7fdc70082f60 msgr2=0x7fdc7005e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:32.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.694+0000 7fdc773ff700 1 -- 172.21.15.72:0/1478882950 shutdown_connections 2023-08-31T18:48:32.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.694+0000 7fdc773ff700 1 -- 172.21.15.72:0/1478882950 wait complete. 2023-08-31T18:48:32.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.696+0000 7fdc773ff700 1 Processor -- start 2023-08-31T18:48:32.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.696+0000 7fdc773ff700 1 -- start start 2023-08-31T18:48:32.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.697+0000 7fdc773ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc700c44a0 0x7fdc70150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:32.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.697+0000 7fdc773ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc700c5fb0 0x7fdc700bfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:32.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.697+0000 7fdc773ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc700c0190 0x7fdc700c0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:32.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.697+0000 7fdc773ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc70151130 con 0x7fdc700c44a0 2023-08-31T18:48:32.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.697+0000 7fdc773ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc701555c0 con 0x7fdc700c0190 2023-08-31T18:48:32.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.697+0000 7fdc773ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc701558a0 con 0x7fdc700c5fb0 2023-08-31T18:48:32.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.697+0000 7fdc7519b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc700c44a0 0x7fdc70150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:32.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.697+0000 7fdc7519b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc700c44a0 0x7fdc70150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33250/0 (socket says 172.21.15.72:33250) 2023-08-31T18:48:32.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.697+0000 7fdc7519b700 1 -- 172.21.15.72:0/1410199367 learned_addr learned my addr 172.21.15.72:0/1410199367 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:32.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.697+0000 7fdc7599c700 1 --2- 172.21.15.72:0/1410199367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc700c0190 0x7fdc700c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:32.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.697+0000 7fdc7499a700 1 --2- 172.21.15.72:0/1410199367 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc700c5fb0 0x7fdc700bfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:32.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.697+0000 7fdc7519b700 1 -- 172.21.15.72:0/1410199367 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc700c5fb0 msgr2=0x7fdc700bfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:32.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.697+0000 7fdc7519b700 1 --2- 172.21.15.72:0/1410199367 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc700c5fb0 0x7fdc700bfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.698+0000 7fdc7519b700 1 -- 172.21.15.72:0/1410199367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc700c0190 msgr2=0x7fdc700c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:32.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.698+0000 7fdc7519b700 1 --2- 172.21.15.72:0/1410199367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc700c0190 0x7fdc700c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:32.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.698+0000 7fdc7519b700 1 -- 172.21.15.72:0/1410199367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc60009370 con 0x7fdc700c44a0 2023-08-31T18:48:32.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.698+0000 7fdc7499a700 1 --2- 172.21.15.72:0/1410199367 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc700c5fb0 0x7fdc700bfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:32.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.698+0000 7fdc7519b700 1 --2- 172.21.15.72:0/1410199367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc700c44a0 0x7fdc70150c40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fdc6c00c440 tx=0x7fdc6c007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:32.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.698+0000 7fdc657fa700 1 -- 172.21.15.72:0/1410199367 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c007020 con 0x7fdc700c44a0 2023-08-31T18:48:32.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.698+0000 7fdc657fa700 1 -- 172.21.15.72:0/1410199367 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6c007180 con 0x7fdc700c44a0 2023-08-31T18:48:32.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.698+0000 7fdc657fa700 1 -- 172.21.15.72:0/1410199367 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c007520 con 0x7fdc700c44a0 2023-08-31T18:48:32.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.698+0000 7fdc773ff700 1 -- 172.21.15.72:0/1410199367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc70155b80 con 0x7fdc700c44a0 2023-08-31T18:48:32.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.698+0000 7fdc773ff700 1 -- 172.21.15.72:0/1410199367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc701551b0 con 0x7fdc700c44a0 2023-08-31T18:48:32.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.699+0000 7fdc773ff700 1 -- 172.21.15.72:0/1410199367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7006c6b0 con 0x7fdc700c44a0 2023-08-31T18:48:32.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.700+0000 7fdc657fa700 1 -- 172.21.15.72:0/1410199367 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fdc6c006900 con 0x7fdc700c44a0 2023-08-31T18:48:32.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.701+0000 7fdc657fa700 1 --2- 172.21.15.72:0/1410199367 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdc5405ee10 0x7fdc540612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:32.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.701+0000 7fdc657fa700 1 -- 172.21.15.72:0/1410199367 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdc6c079280 con 0x7fdc700c44a0 2023-08-31T18:48:32.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.701+0000 7fdc7499a700 1 --2- 172.21.15.72:0/1410199367 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdc5405ee10 0x7fdc540612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:32.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.701+0000 7fdc7499a700 1 --2- 172.21.15.72:0/1410199367 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdc5405ee10 0x7fdc540612d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fdc60009130 tx=0x7fdc60017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:32.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.704+0000 7fdc657fa700 1 -- 172.21.15.72:0/1410199367 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdc6c0478f0 con 0x7fdc700c44a0 2023-08-31T18:48:32.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:32.935+0000 7fdc773ff700 1 -- 172.21.15.72:0/1410199367 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7fdc700bf1f0 con 0x7fdc700c44a0 2023-08-31T18:48:33.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.357+0000 7fdc657fa700 1 -- 172.21.15.72:0/1410199367 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdc6c04a630 con 0x7fdc700c44a0 2023-08-31T18:48:33.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.360+0000 7fdc773ff700 1 -- 172.21.15.72:0/1410199367 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdc5405ee10 msgr2=0x7fdc540612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:33.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.360+0000 7fdc773ff700 1 --2- 172.21.15.72:0/1410199367 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdc5405ee10 0x7fdc540612d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fdc60009130 tx=0x7fdc60017000).stop 2023-08-31T18:48:33.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.360+0000 7fdc773ff700 1 -- 172.21.15.72:0/1410199367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc700c44a0 msgr2=0x7fdc70150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.360+0000 7fdc773ff700 1 --2- 172.21.15.72:0/1410199367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc700c44a0 0x7fdc70150c40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fdc6c00c440 tx=0x7fdc6c007e50).stop 2023-08-31T18:48:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.360+0000 7fdc773ff700 1 -- 172.21.15.72:0/1410199367 shutdown_connections 2023-08-31T18:48:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.360+0000 7fdc773ff700 1 --2- 172.21.15.72:0/1410199367 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdc5405ee10 0x7fdc540612d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.360+0000 7fdc773ff700 1 --2- 172.21.15.72:0/1410199367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc700c0190 0x7fdc700c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.360+0000 7fdc773ff700 1 --2- 172.21.15.72:0/1410199367 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc700c44a0 0x7fdc70150c40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.360+0000 7fdc773ff700 1 --2- 172.21.15.72:0/1410199367 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc700c5fb0 0x7fdc700bfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.360+0000 7fdc773ff700 1 -- 172.21.15.72:0/1410199367 >> 172.21.15.72:0/1410199367 conn(0x7fdc70082f60 msgr2=0x7fdc700674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.360+0000 7fdc773ff700 1 -- 172.21.15.72:0/1410199367 shutdown_connections 2023-08-31T18:48:33.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.360+0000 7fdc773ff700 1 -- 172.21.15.72:0/1410199367 wait complete. 2023-08-31T18:48:33.379 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-31T18:48:33.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.570+0000 7f9515dff700 1 Processor -- start 2023-08-31T18:48:33.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.570+0000 7f9515dff700 1 -- start start 2023-08-31T18:48:33.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.571+0000 7f9515dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9510153e30 0x7f9510154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:33.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.571+0000 7f9515dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f95100c5cb0 0x7f95100c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:33.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.571+0000 7f9515dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95100bfd40 con 0x7f95100630b0 2023-08-31T18:48:33.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.571+0000 7f9515dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95100c6730 con 0x7f95100c5cb0 2023-08-31T18:48:33.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.571+0000 7f9515dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95100bffe0 con 0x7f9510153e30 2023-08-31T18:48:33.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.572+0000 7f950effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f95100c5cb0 0x7f95100c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:33.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.572+0000 7f950effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f95100c5cb0 0x7f95100c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60700/0 (socket says 172.21.15.72:60700) 2023-08-31T18:48:33.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.572+0000 7f950effd700 1 -- 172.21.15.72:0/4226349723 learned_addr learned my addr 172.21.15.72:0/4226349723 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:33.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.572+0000 7f950f7fe700 1 --2- 172.21.15.72:0/4226349723 >> v2:172.21.15.146:3300/0 conn(0x7f9510153e30 0x7f9510154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:33.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.572+0000 7f950effd700 1 -- 172.21.15.72:0/4226349723 >> v2:172.21.15.146:3300/0 conn(0x7f9510153e30 msgr2=0x7f9510154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:33.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.572+0000 7f950effd700 1 --2- 172.21.15.72:0/4226349723 >> v2:172.21.15.146:3300/0 conn(0x7f9510153e30 0x7f9510154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:33.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.572+0000 7f950effd700 1 -- 172.21.15.72:0/4226349723 >> v1:172.21.15.146:6789/0 conn(0x7f95100630b0 legacy=0x7f9510157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:33.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.572+0000 7f950effd700 1 -- 172.21.15.72:0/4226349723 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95100c02c0 con 0x7f95100c5cb0 2023-08-31T18:48:33.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.572+0000 7f950effd700 1 --2- 172.21.15.72:0/4226349723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95100c5cb0 0x7f95100c6160 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f951006aa50 tx=0x7f95040090f0).ready entity=mon.0 client_cookie=fde2b0d7e4097cff server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:33.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.573+0000 7f950e7fc700 1 -- 172.21.15.72:0/4226349723 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950400b600 con 0x7f95100c5cb0 2023-08-31T18:48:33.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.573+0000 7f950e7fc700 1 -- 172.21.15.72:0/4226349723 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950400b760 con 0x7f95100c5cb0 2023-08-31T18:48:33.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.573+0000 7f950e7fc700 1 -- 172.21.15.72:0/4226349723 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950400bb00 con 0x7f95100c5cb0 2023-08-31T18:48:33.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.573+0000 7f9515dff700 1 -- 172.21.15.72:0/4226349723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95100c5cb0 msgr2=0x7f95100c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:33.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.573+0000 7f9515dff700 1 --2- 172.21.15.72:0/4226349723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95100c5cb0 0x7f95100c6160 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f951006aa50 tx=0x7f95040090f0).stop 2023-08-31T18:48:33.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.573+0000 7f9515dff700 1 -- 172.21.15.72:0/4226349723 shutdown_connections 2023-08-31T18:48:33.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.573+0000 7f9515dff700 1 --2- 172.21.15.72:0/4226349723 >> v2:172.21.15.146:3300/0 conn(0x7f9510153e30 0x7f9510154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:33.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.573+0000 7f9515dff700 1 --2- 172.21.15.72:0/4226349723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95100c5cb0 0x7f95100c6160 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:33.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.573+0000 7f9515dff700 1 -- 172.21.15.72:0/4226349723 >> 172.21.15.72:0/4226349723 conn(0x7f951005eb20 msgr2=0x7f95100cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:33.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.573+0000 7f9515dff700 1 -- 172.21.15.72:0/4226349723 shutdown_connections 2023-08-31T18:48:33.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.573+0000 7f9515dff700 1 -- 172.21.15.72:0/4226349723 wait complete. 2023-08-31T18:48:33.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.575+0000 7f9515dff700 1 Processor -- start 2023-08-31T18:48:33.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.575+0000 7f9515dff700 1 -- start start 2023-08-31T18:48:33.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f9515dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95100630b0 0x7f95101509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:33.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f9515dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95100c5cb0 0x7f9510153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:33.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f9515dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9510153e30 0x7f9510141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:33.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f9515dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95101644b0 con 0x7f9510153e30 2023-08-31T18:48:33.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f9515dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9510151a70 con 0x7f95100630b0 2023-08-31T18:48:33.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f9515dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9510151140 con 0x7f95100c5cb0 2023-08-31T18:48:33.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f950ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9510153e30 0x7f9510141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:33.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f950ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9510153e30 0x7f9510141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60708/0 (socket says 172.21.15.72:60708) 2023-08-31T18:48:33.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f950ffff700 1 -- 172.21.15.72:0/1910161935 learned_addr learned my addr 172.21.15.72:0/1910161935 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f950effd700 1 --2- 172.21.15.72:0/1910161935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95100c5cb0 0x7f9510153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f950ffff700 1 -- 172.21.15.72:0/1910161935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95100c5cb0 msgr2=0x7f9510153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f950f7fe700 1 --2- 172.21.15.72:0/1910161935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95100630b0 0x7f95101509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f950ffff700 1 --2- 172.21.15.72:0/1910161935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95100c5cb0 0x7f9510153000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f950ffff700 1 -- 172.21.15.72:0/1910161935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95100630b0 msgr2=0x7f95101509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f950ffff700 1 --2- 172.21.15.72:0/1910161935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95100630b0 0x7f95101509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.576+0000 7f950ffff700 1 -- 172.21.15.72:0/1910161935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9504009370 con 0x7f9510153e30 2023-08-31T18:48:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.577+0000 7f950ffff700 1 --2- 172.21.15.72:0/1910161935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9510153e30 0x7f9510141fa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f9508002230 tx=0x7f95080015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.577+0000 7f94f77fe700 1 -- 172.21.15.72:0/1910161935 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508010510 con 0x7f9510153e30 2023-08-31T18:48:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.577+0000 7f94f77fe700 1 -- 172.21.15.72:0/1910161935 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9508010670 con 0x7f9510153e30 2023-08-31T18:48:33.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.577+0000 7f94f77fe700 1 -- 172.21.15.72:0/1910161935 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95080109f0 con 0x7f9510153e30 2023-08-31T18:48:33.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.577+0000 7f9515dff700 1 -- 172.21.15.72:0/1910161935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9510151420 con 0x7f9510153e30 2023-08-31T18:48:33.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.577+0000 7f9515dff700 1 -- 172.21.15.72:0/1910161935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95101534f0 con 0x7f9510153e30 2023-08-31T18:48:33.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.578+0000 7f9515dff700 1 -- 172.21.15.72:0/1910161935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951006c6b0 con 0x7f9510153e30 2023-08-31T18:48:33.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.579+0000 7f94f77fe700 1 -- 172.21.15.72:0/1910161935 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f950801b400 con 0x7f9510153e30 2023-08-31T18:48:33.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.579+0000 7f94f77fe700 1 --2- 172.21.15.72:0/1910161935 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94fc05ede0 0x7f94fc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:33.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.580+0000 7f94f77fe700 1 -- 172.21.15.72:0/1910161935 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9508079cc0 con 0x7f9510153e30 2023-08-31T18:48:33.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.580+0000 7f950f7fe700 1 --2- 172.21.15.72:0/1910161935 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94fc05ede0 0x7f94fc0612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:33.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.580+0000 7f950f7fe700 1 --2- 172.21.15.72:0/1910161935 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94fc05ede0 0x7f94fc0612a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f9500006fd0 tx=0x7f9500008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:33.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.584+0000 7f94f77fe700 1 -- 172.21.15.72:0/1910161935 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9508080080 con 0x7f9510153e30 2023-08-31T18:48:33.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.751+0000 7f9515dff700 1 -- 172.21.15.72:0/1910161935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9510062970 con 0x7f9510153e30 2023-08-31T18:48:33.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.755+0000 7f94f77fe700 1 -- 172.21.15.72:0/1910161935 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f950804b010 con 0x7f9510153e30 2023-08-31T18:48:33.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.757+0000 7f9515dff700 1 -- 172.21.15.72:0/1910161935 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94fc05ede0 msgr2=0x7f94fc0612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:33.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.757+0000 7f9515dff700 1 --2- 172.21.15.72:0/1910161935 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94fc05ede0 0x7f94fc0612a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f9500006fd0 tx=0x7f9500008040).stop 2023-08-31T18:48:33.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.758+0000 7f9515dff700 1 -- 172.21.15.72:0/1910161935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9510153e30 msgr2=0x7f9510141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:33.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.758+0000 7f9515dff700 1 --2- 172.21.15.72:0/1910161935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9510153e30 0x7f9510141fa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f9508002230 tx=0x7f95080015e0).stop 2023-08-31T18:48:33.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.758+0000 7f9515dff700 1 -- 172.21.15.72:0/1910161935 shutdown_connections 2023-08-31T18:48:33.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.758+0000 7f9515dff700 1 --2- 172.21.15.72:0/1910161935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9510153e30 0x7f9510141fa0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:33.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.758+0000 7f9515dff700 1 --2- 172.21.15.72:0/1910161935 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94fc05ede0 0x7f94fc0612a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:33.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.758+0000 7f9515dff700 1 --2- 172.21.15.72:0/1910161935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95100630b0 0x7f95101509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:33.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.758+0000 7f9515dff700 1 --2- 172.21.15.72:0/1910161935 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95100c5cb0 0x7f9510153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:33.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.758+0000 7f9515dff700 1 -- 172.21.15.72:0/1910161935 >> 172.21.15.72:0/1910161935 conn(0x7f951005eb20 msgr2=0x7f95100ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:33.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.758+0000 7f9515dff700 1 -- 172.21.15.72:0/1910161935 shutdown_connections 2023-08-31T18:48:33.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:33.758+0000 7f9515dff700 1 -- 172.21.15.72:0/1910161935 wait complete. 2023-08-31T18:48:33.775 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T18:48:33.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T18:48:33.877 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T18:48:33.982 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T18:48:33.983 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-31T18:48:33.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T18:48:33.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-08-31T18:48:34.069 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T18:48:34.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:34.071 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T18:48:34.124 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-31T18:48:34.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T18:48:34.125 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-08-31T18:48:34.219 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-08-31T18:48:34.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:34.220 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-31T18:48:34.274 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-08-31T18:48:34.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T18:48:34.275 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-08-31T18:48:34.359 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T18:48:34.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:34.360 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-31T18:48:34.406 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-08-31T18:48:34.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T18:48:34.407 DEBUG:teuthology.orchestra.run.smithi146:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-08-31T18:48:34.490 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-08-31T18:48:34.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:48:34.491 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-31T18:48:34.538 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-31T18:48:34.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T18:48:34.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.727+0000 7ff564dff700 1 Processor -- start 2023-08-31T18:48:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.727+0000 7ff564dff700 1 -- start start 2023-08-31T18:48:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.728+0000 7ff564dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff560154060 0x7ff560157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.728+0000 7ff564dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5600cb9b0 0x7ff5601581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.728+0000 7ff564dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff5601586b0 0x7ff5600c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.728+0000 7ff564dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5600c1380 con 0x7ff5600cb9b0 2023-08-31T18:48:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.728+0000 7ff564dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff560158b40 con 0x7ff5601586b0 2023-08-31T18:48:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.728+0000 7ff564dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5600c6120 con 0x7ff560154060 2023-08-31T18:48:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.729+0000 7ff55dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5600cb9b0 0x7ff5601581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.729+0000 7ff55dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5600cb9b0 0x7ff5601581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60724/0 (socket says 172.21.15.72:60724) 2023-08-31T18:48:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.729+0000 7ff55dd9b700 1 -- 172.21.15.72:0/2435839980 learned_addr learned my addr 172.21.15.72:0/2435839980 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:34.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.729+0000 7ff55e59c700 1 --2- 172.21.15.72:0/2435839980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff560154060 0x7ff560157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:34.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.729+0000 7ff55ed9d700 1 --2- 172.21.15.72:0/2435839980 >> v2:172.21.15.146:3300/0 conn(0x7ff5601586b0 0x7ff5600c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.729+0000 7ff55dd9b700 1 -- 172.21.15.72:0/2435839980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff560154060 msgr2=0x7ff560157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.729+0000 7ff55dd9b700 1 --2- 172.21.15.72:0/2435839980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff560154060 0x7ff560157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.729+0000 7ff55dd9b700 1 -- 172.21.15.72:0/2435839980 >> v2:172.21.15.146:3300/0 conn(0x7ff5601586b0 msgr2=0x7ff5600c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.729+0000 7ff55dd9b700 1 --2- 172.21.15.72:0/2435839980 >> v2:172.21.15.146:3300/0 conn(0x7ff5601586b0 0x7ff5600c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.729+0000 7ff55dd9b700 1 -- 172.21.15.72:0/2435839980 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5600c5e10 con 0x7ff5600cb9b0 2023-08-31T18:48:34.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.729+0000 7ff55dd9b700 1 --2- 172.21.15.72:0/2435839980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5600cb9b0 0x7ff5601581c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7ff5600835e0 tx=0x7ff5540090f0).ready entity=mon.0 client_cookie=863c4f2ea9f6042d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:34.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.730+0000 7ff55d59a700 1 -- 172.21.15.72:0/2435839980 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55400b600 con 0x7ff5600cb9b0 2023-08-31T18:48:34.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.730+0000 7ff55d59a700 1 -- 172.21.15.72:0/2435839980 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55400b760 con 0x7ff5600cb9b0 2023-08-31T18:48:34.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.730+0000 7ff55d59a700 1 -- 172.21.15.72:0/2435839980 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55400bae0 con 0x7ff5600cb9b0 2023-08-31T18:48:34.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.730+0000 7ff564dff700 1 -- 172.21.15.72:0/2435839980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5600cb9b0 msgr2=0x7ff5601581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:34.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.730+0000 7ff564dff700 1 --2- 172.21.15.72:0/2435839980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5600cb9b0 0x7ff5601581c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7ff5600835e0 tx=0x7ff5540090f0).stop 2023-08-31T18:48:34.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.730+0000 7ff564dff700 1 -- 172.21.15.72:0/2435839980 shutdown_connections 2023-08-31T18:48:34.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.730+0000 7ff564dff700 1 --2- 172.21.15.72:0/2435839980 >> v2:172.21.15.146:3300/0 conn(0x7ff5601586b0 0x7ff5600c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:34.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.730+0000 7ff564dff700 1 --2- 172.21.15.72:0/2435839980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff560154060 0x7ff560157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:34.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.730+0000 7ff564dff700 1 --2- 172.21.15.72:0/2435839980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5600cb9b0 0x7ff5601581c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:34.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.730+0000 7ff564dff700 1 -- 172.21.15.72:0/2435839980 >> 172.21.15.72:0/2435839980 conn(0x7ff56005e870 msgr2=0x7ff5600cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:34.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.730+0000 7ff564dff700 1 -- 172.21.15.72:0/2435839980 shutdown_connections 2023-08-31T18:48:34.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.730+0000 7ff564dff700 1 -- 172.21.15.72:0/2435839980 wait complete. 2023-08-31T18:48:34.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.732+0000 7ff564dff700 1 Processor -- start 2023-08-31T18:48:34.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.732+0000 7ff564dff700 1 -- start start 2023-08-31T18:48:34.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.733+0000 7ff564dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5600cb9b0 0x7ff560148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:34.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.733+0000 7ff564dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff560154060 0x7ff5600a8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:34.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.733+0000 7ff564dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5601586b0 0x7ff5600a8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:34.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.733+0000 7ff564dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5600a94d0 con 0x7ff5600cb9b0 2023-08-31T18:48:34.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.733+0000 7ff564dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff560148880 con 0x7ff560154060 2023-08-31T18:48:34.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.733+0000 7ff564dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5600acb00 con 0x7ff5601586b0 2023-08-31T18:48:34.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.733+0000 7ff55e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5600cb9b0 0x7ff560148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:34.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.733+0000 7ff55e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5600cb9b0 0x7ff560148390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60736/0 (socket says 172.21.15.72:60736) 2023-08-31T18:48:34.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.733+0000 7ff55e59c700 1 -- 172.21.15.72:0/2893498144 learned_addr learned my addr 172.21.15.72:0/2893498144 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:34.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.734+0000 7ff55dd9b700 1 --2- 172.21.15.72:0/2893498144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff560154060 0x7ff5600a8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:34.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.734+0000 7ff55ed9d700 1 --2- 172.21.15.72:0/2893498144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5601586b0 0x7ff5600a8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:34.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.734+0000 7ff55e59c700 1 -- 172.21.15.72:0/2893498144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5601586b0 msgr2=0x7ff5600a8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:34.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.734+0000 7ff55e59c700 1 --2- 172.21.15.72:0/2893498144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5601586b0 0x7ff5600a8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:34.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.734+0000 7ff55e59c700 1 -- 172.21.15.72:0/2893498144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff560154060 msgr2=0x7ff5600a8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:34.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.734+0000 7ff55e59c700 1 --2- 172.21.15.72:0/2893498144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff560154060 0x7ff5600a8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:34.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.734+0000 7ff55e59c700 1 -- 172.21.15.72:0/2893498144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff554009370 con 0x7ff5600cb9b0 2023-08-31T18:48:34.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.734+0000 7ff55ed9d700 1 --2- 172.21.15.72:0/2893498144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5601586b0 0x7ff5600a8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:34.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.734+0000 7ff55e59c700 1 --2- 172.21.15.72:0/2893498144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5600cb9b0 0x7ff560148390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff55000d890 tx=0x7ff550008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:34.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.734+0000 7ff54e7fc700 1 -- 172.21.15.72:0/2893498144 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5500125f0 con 0x7ff5600cb9b0 2023-08-31T18:48:34.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.734+0000 7ff54e7fc700 1 -- 172.21.15.72:0/2893498144 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff550012750 con 0x7ff5600cb9b0 2023-08-31T18:48:34.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.734+0000 7ff54e7fc700 1 -- 172.21.15.72:0/2893498144 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550012ad0 con 0x7ff5600cb9b0 2023-08-31T18:48:34.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.734+0000 7ff564dff700 1 -- 172.21.15.72:0/2893498144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5600acf90 con 0x7ff5600cb9b0 2023-08-31T18:48:34.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.734+0000 7ff564dff700 1 -- 172.21.15.72:0/2893498144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5600ac1d0 con 0x7ff5600cb9b0 2023-08-31T18:48:34.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.735+0000 7ff564dff700 1 -- 172.21.15.72:0/2893498144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5600acde0 con 0x7ff5600cb9b0 2023-08-31T18:48:34.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.736+0000 7ff54e7fc700 1 -- 172.21.15.72:0/2893498144 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff550013480 con 0x7ff5600cb9b0 2023-08-31T18:48:34.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.737+0000 7ff54e7fc700 1 --2- 172.21.15.72:0/2893498144 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff54005ee10 0x7ff5400612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:34.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.737+0000 7ff54e7fc700 1 -- 172.21.15.72:0/2893498144 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff55007a220 con 0x7ff5600cb9b0 2023-08-31T18:48:34.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.737+0000 7ff55dd9b700 1 --2- 172.21.15.72:0/2893498144 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff54005ee10 0x7ff5400612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:34.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.738+0000 7ff55dd9b700 1 --2- 172.21.15.72:0/2893498144 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff54005ee10 0x7ff5400612d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7ff560083c70 tx=0x7ff554017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:34.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.742+0000 7ff54e7fc700 1 -- 172.21.15.72:0/2893498144 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff55004b5d0 con 0x7ff5600cb9b0 2023-08-31T18:48:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.950+0000 7ff564dff700 1 -- 172.21.15.72:0/2893498144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff56006c6b0 con 0x7ff5600cb9b0 2023-08-31T18:48:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.951+0000 7ff54e7fc700 1 -- 172.21.15.72:0/2893498144 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4483 (secure 0 0 0) 0x7ff55004ebf0 con 0x7ff5600cb9b0 2023-08-31T18:48:34.952 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:34.952 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/111391994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":111391994},{"type":"v1","addr":"172.21.15.72:6837","nonce":111391994}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/4001102603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4001102603},{"type":"v1","addr":"172.21.15.146:6833","nonce":4001102603}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/522602179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":522602179},{"type":"v1","addr":"172.21.15.72:6835","nonce":522602179}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T18:47:52.970136+0000","modified":"2023-08-31T18:47:55.979886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3888852190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3888852190},{"type":"v1","addr":"172.21.15.146:6835","nonce":3888852190}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-31T18:48:34.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.953+0000 7ff564dff700 1 -- 172.21.15.72:0/2893498144 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff54005ee10 msgr2=0x7ff5400612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:34.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.953+0000 7ff564dff700 1 --2- 172.21.15.72:0/2893498144 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff54005ee10 0x7ff5400612d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7ff560083c70 tx=0x7ff554017000).stop 2023-08-31T18:48:34.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.953+0000 7ff564dff700 1 -- 172.21.15.72:0/2893498144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5600cb9b0 msgr2=0x7ff560148390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:34.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.953+0000 7ff564dff700 1 --2- 172.21.15.72:0/2893498144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5600cb9b0 0x7ff560148390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff55000d890 tx=0x7ff550008040).stop 2023-08-31T18:48:34.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.953+0000 7ff564dff700 1 -- 172.21.15.72:0/2893498144 shutdown_connections 2023-08-31T18:48:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.953+0000 7ff564dff700 1 --2- 172.21.15.72:0/2893498144 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff5601586b0 0x7ff5600a8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.953+0000 7ff564dff700 1 --2- 172.21.15.72:0/2893498144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5600cb9b0 0x7ff560148390 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.953+0000 7ff564dff700 1 --2- 172.21.15.72:0/2893498144 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff54005ee10 0x7ff5400612d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.953+0000 7ff564dff700 1 --2- 172.21.15.72:0/2893498144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff560154060 0x7ff5600a8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.953+0000 7ff564dff700 1 -- 172.21.15.72:0/2893498144 >> 172.21.15.72:0/2893498144 conn(0x7ff56005e870 msgr2=0x7ff5600c7050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.953+0000 7ff564dff700 1 -- 172.21.15.72:0/2893498144 shutdown_connections 2023-08-31T18:48:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:34.953+0000 7ff564dff700 1 -- 172.21.15.72:0/2893498144 wait complete. 2023-08-31T18:48:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-08-31T18:48:34.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:48:35.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.157+0000 7fb37c9ff700 1 Processor -- start 2023-08-31T18:48:35.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.157+0000 7fb37c9ff700 1 -- start start 2023-08-31T18:48:35.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.159+0000 7fb37c9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3780c5fb0 0x7fb3780be370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.159+0000 7fb37c9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb3780be860 0x7fb3780c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.159+0000 7fb37c9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3780bece0 con 0x7fb3780c44a0 2023-08-31T18:48:35.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.159+0000 7fb37c9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb378154690 con 0x7fb3780be860 2023-08-31T18:48:35.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.159+0000 7fb37c9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3780bfb20 con 0x7fb3780c5fb0 2023-08-31T18:48:35.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.159+0000 7fb375d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb3780be860 0x7fb3780c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.159+0000 7fb375d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb3780be860 0x7fb3780c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60744/0 (socket says 172.21.15.72:60744) 2023-08-31T18:48:35.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.159+0000 7fb37659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3780c5fb0 0x7fb3780be370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.159+0000 7fb375d9b700 1 -- 172.21.15.72:0/2284918084 learned_addr learned my addr 172.21.15.72:0/2284918084 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:35.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.159+0000 7fb376d9d700 1 --1- 172.21.15.72:0/2284918084 >> v1:172.21.15.72:6789/0 conn(0x7fb3780c44a0 0x7fb378157d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55394/0 (socket says 172.21.15.72:55394) 2023-08-31T18:48:35.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.159+0000 7fb375d9b700 1 -- 172.21.15.72:0/2284918084 >> v2:172.21.15.146:3300/0 conn(0x7fb3780c5fb0 msgr2=0x7fb3780be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:35.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.159+0000 7fb375d9b700 1 --2- 172.21.15.72:0/2284918084 >> v2:172.21.15.146:3300/0 conn(0x7fb3780c5fb0 0x7fb3780be370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.159+0000 7fb375d9b700 1 -- 172.21.15.72:0/2284918084 >> v1:172.21.15.72:6789/0 conn(0x7fb3780c44a0 legacy=0x7fb378157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.160+0000 7fb37559a700 1 -- 172.21.15.72:0/2284918084 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954116840 0 0) 0x7fb3780bece0 con 0x7fb3780c44a0 2023-08-31T18:48:35.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.160+0000 7fb375d9b700 1 -- 172.21.15.72:0/2284918084 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3780c4910 con 0x7fb3780be860 2023-08-31T18:48:35.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.160+0000 7fb375d9b700 1 --2- 172.21.15.72:0/2284918084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3780be860 0x7fb3780c3fb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fb3780c37a0 tx=0x7fb36c0090f0).ready entity=mon.0 client_cookie=f410bd2b1dd043 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:35.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.160+0000 7fb37559a700 1 -- 172.21.15.72:0/2284918084 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c00b520 con 0x7fb3780be860 2023-08-31T18:48:35.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.160+0000 7fb37559a700 1 -- 172.21.15.72:0/2284918084 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36c00b680 con 0x7fb3780be860 2023-08-31T18:48:35.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.160+0000 7fb37559a700 1 -- 172.21.15.72:0/2284918084 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c00ba00 con 0x7fb3780be860 2023-08-31T18:48:35.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.160+0000 7fb37c9ff700 1 -- 172.21.15.72:0/2284918084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3780be860 msgr2=0x7fb3780c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.160+0000 7fb37c9ff700 1 --2- 172.21.15.72:0/2284918084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3780be860 0x7fb3780c3fb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fb3780c37a0 tx=0x7fb36c0090f0).stop 2023-08-31T18:48:35.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.160+0000 7fb37c9ff700 1 -- 172.21.15.72:0/2284918084 shutdown_connections 2023-08-31T18:48:35.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.160+0000 7fb37c9ff700 1 --2- 172.21.15.72:0/2284918084 >> v2:172.21.15.146:3300/0 conn(0x7fb3780c5fb0 0x7fb3780be370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.161+0000 7fb37c9ff700 1 --2- 172.21.15.72:0/2284918084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3780be860 0x7fb3780c3fb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.161+0000 7fb37c9ff700 1 -- 172.21.15.72:0/2284918084 >> 172.21.15.72:0/2284918084 conn(0x7fb378082f60 msgr2=0x7fb37805e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:35.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.161+0000 7fb37c9ff700 1 -- 172.21.15.72:0/2284918084 shutdown_connections 2023-08-31T18:48:35.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.161+0000 7fb37c9ff700 1 -- 172.21.15.72:0/2284918084 wait complete. 2023-08-31T18:48:35.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.162+0000 7fb37c9ff700 1 Processor -- start 2023-08-31T18:48:35.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.162+0000 7fb37c9ff700 1 -- start start 2023-08-31T18:48:35.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.163+0000 7fb37c9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3780be860 0x7fb378141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.163+0000 7fb37c9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3780c44a0 0x7fb3780a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.163+0000 7fb37c9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3780c5fb0 0x7fb378064b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.163+0000 7fb37c9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3780aa730 con 0x7fb3780c5fb0 2023-08-31T18:48:35.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.163+0000 7fb37c9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3780aaa10 con 0x7fb3780c44a0 2023-08-31T18:48:35.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.163+0000 7fb37c9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3780aacf0 con 0x7fb3780be860 2023-08-31T18:48:35.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.163+0000 7fb376d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3780c5fb0 0x7fb378064b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.163+0000 7fb376d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3780c5fb0 0x7fb378064b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60760/0 (socket says 172.21.15.72:60760) 2023-08-31T18:48:35.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.163+0000 7fb376d9d700 1 -- 172.21.15.72:0/1157208840 learned_addr learned my addr 172.21.15.72:0/1157208840 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:35.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.164+0000 7fb37659c700 1 --2- 172.21.15.72:0/1157208840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3780be860 0x7fb378141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.164+0000 7fb375d9b700 1 --2- 172.21.15.72:0/1157208840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3780c44a0 0x7fb3780a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.164+0000 7fb376d9d700 1 -- 172.21.15.72:0/1157208840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3780be860 msgr2=0x7fb378141bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.164+0000 7fb376d9d700 1 --2- 172.21.15.72:0/1157208840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3780be860 0x7fb378141bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.164+0000 7fb376d9d700 1 -- 172.21.15.72:0/1157208840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3780c44a0 msgr2=0x7fb3780a9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.164+0000 7fb376d9d700 1 --2- 172.21.15.72:0/1157208840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3780c44a0 0x7fb3780a9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.164+0000 7fb376d9d700 1 -- 172.21.15.72:0/1157208840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c009370 con 0x7fb3780c5fb0 2023-08-31T18:48:35.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.164+0000 7fb376d9d700 1 --2- 172.21.15.72:0/1157208840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3780c5fb0 0x7fb378064b70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fb37000c7e0 tx=0x7fb370007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:35.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.164+0000 7fb3667fc700 1 -- 172.21.15.72:0/1157208840 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370005c70 con 0x7fb3780c5fb0 2023-08-31T18:48:35.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.164+0000 7fb3667fc700 1 -- 172.21.15.72:0/1157208840 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb370005dd0 con 0x7fb3780c5fb0 2023-08-31T18:48:35.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.164+0000 7fb37c9ff700 1 -- 172.21.15.72:0/1157208840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3780aafd0 con 0x7fb3780c5fb0 2023-08-31T18:48:35.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.164+0000 7fb3667fc700 1 -- 172.21.15.72:0/1157208840 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb370007320 con 0x7fb3780c5fb0 2023-08-31T18:48:35.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.164+0000 7fb37c9ff700 1 -- 172.21.15.72:0/1157208840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3780aa2d0 con 0x7fb3780c5fb0 2023-08-31T18:48:35.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.166+0000 7fb37c9ff700 1 -- 172.21.15.72:0/1157208840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3780ab4f0 con 0x7fb3780c5fb0 2023-08-31T18:48:35.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.166+0000 7fb3667fc700 1 -- 172.21.15.72:0/1157208840 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb370007710 con 0x7fb3780c5fb0 2023-08-31T18:48:35.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.167+0000 7fb3667fc700 1 --2- 172.21.15.72:0/1157208840 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb35805ee10 0x7fb3580612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.167+0000 7fb3667fc700 1 -- 172.21.15.72:0/1157208840 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb370079d00 con 0x7fb3780c5fb0 2023-08-31T18:48:35.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.167+0000 7fb37659c700 1 --2- 172.21.15.72:0/1157208840 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb35805ee10 0x7fb3580612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.168+0000 7fb37659c700 1 --2- 172.21.15.72:0/1157208840 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb35805ee10 0x7fb3580612d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fb368006fd0 tx=0x7fb368006f40).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:35.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.171+0000 7fb3667fc700 1 -- 172.21.15.72:0/1157208840 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb3780ab4f0 con 0x7fb3780c5fb0 2023-08-31T18:48:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.342+0000 7fb37c9ff700 1 -- 172.21.15.72:0/1157208840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3780ab4f0 con 0x7fb3780c5fb0 2023-08-31T18:48:35.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.342+0000 7fb3667fc700 1 -- 172.21.15.72:0/1157208840 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17024 (secure 0 0 0) 0x7fb3780ab4f0 con 0x7fb3780c5fb0 2023-08-31T18:48:35.343 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:35.344 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:53.972412+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:47:51.003304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-31T18:47:51.950765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:48:35.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.345+0000 7fb37c9ff700 1 -- 172.21.15.72:0/1157208840 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb35805ee10 msgr2=0x7fb3580612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.345+0000 7fb37c9ff700 1 --2- 172.21.15.72:0/1157208840 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb35805ee10 0x7fb3580612d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fb368006fd0 tx=0x7fb368006f40).stop 2023-08-31T18:48:35.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.345+0000 7fb37c9ff700 1 -- 172.21.15.72:0/1157208840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3780c5fb0 msgr2=0x7fb378064b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.345+0000 7fb37c9ff700 1 --2- 172.21.15.72:0/1157208840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3780c5fb0 0x7fb378064b70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fb37000c7e0 tx=0x7fb370007f60).stop 2023-08-31T18:48:35.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.345+0000 7fb37c9ff700 1 -- 172.21.15.72:0/1157208840 shutdown_connections 2023-08-31T18:48:35.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.345+0000 7fb37c9ff700 1 --2- 172.21.15.72:0/1157208840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3780c5fb0 0x7fb378064b70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.345+0000 7fb37c9ff700 1 --2- 172.21.15.72:0/1157208840 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3780be860 0x7fb378141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.345+0000 7fb37c9ff700 1 --2- 172.21.15.72:0/1157208840 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb35805ee10 0x7fb3580612d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.345+0000 7fb37c9ff700 1 --2- 172.21.15.72:0/1157208840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3780c44a0 0x7fb3780a9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.345+0000 7fb37c9ff700 1 -- 172.21.15.72:0/1157208840 >> 172.21.15.72:0/1157208840 conn(0x7fb378082f60 msgr2=0x7fb378153780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.345+0000 7fb37c9ff700 1 -- 172.21.15.72:0/1157208840 shutdown_connections 2023-08-31T18:48:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.345+0000 7fb37c9ff700 1 -- 172.21.15.72:0/1157208840 wait complete. 2023-08-31T18:48:35.363 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T18:47:51.003304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T18:47:51.950765+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T18:48:35.364 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T18:48:35.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.555+0000 7f4fb41ff700 1 Processor -- start 2023-08-31T18:48:35.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.555+0000 7f4fb41ff700 1 -- start start 2023-08-31T18:48:35.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.556+0000 7f4fb41ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fac154030 0x7f4fac154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.556+0000 7f4fb41ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4fac0c7360 0x7f4fac063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.556+0000 7f4fb41ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fac0c6ed0 con 0x7f4fac0c06b0 2023-08-31T18:48:35.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.556+0000 7f4fb41ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fac0c66e0 con 0x7f4fac0c7360 2023-08-31T18:48:35.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.556+0000 7f4fb41ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac0c68c0 con 0x7f4fac154030 2023-08-31T18:48:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.556+0000 7f4fb179a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4fac0c06b0 0x7f4fac0aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55402/0 (socket says 172.21.15.72:55402) 2023-08-31T18:48:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.557+0000 7f4fb179a700 1 -- 172.21.15.72:0/2276443551 learned_addr learned my addr 172.21.15.72:0/2276443551 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.557+0000 7f4fb279c700 1 --2- 172.21.15.72:0/2276443551 >> v2:172.21.15.72:3300/0 conn(0x7f4fac0c7360 0x7f4fac063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.557+0000 7f4fb1f9b700 1 --2- 172.21.15.72:0/2276443551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fac154030 0x7f4fac154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.557+0000 7f4fb0f99700 1 -- 172.21.15.72:0/2276443551 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538611613 0 0) 0x7f4fac0c6ed0 con 0x7f4fac0c06b0 2023-08-31T18:48:35.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.557+0000 7f4fb0f99700 1 -- 172.21.15.72:0/2276443551 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f980033f0 con 0x7f4fac0c06b0 2023-08-31T18:48:35.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.557+0000 7f4fb279c700 1 -- 172.21.15.72:0/2276443551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fac154030 msgr2=0x7f4fac154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:35.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.557+0000 7f4fb279c700 1 --2- 172.21.15.72:0/2276443551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fac154030 0x7f4fac154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.557+0000 7f4fb279c700 1 -- 172.21.15.72:0/2276443551 >> v1:172.21.15.72:6789/0 conn(0x7f4fac0c06b0 legacy=0x7f4fac0aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.557+0000 7f4fb279c700 1 -- 172.21.15.72:0/2276443551 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac0c0f30 con 0x7f4fac0c7360 2023-08-31T18:48:35.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.557+0000 7f4fb279c700 1 --2- 172.21.15.72:0/2276443551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fac0c7360 0x7f4fac063120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f4fa4009e60 tx=0x7f4fa4009780).ready entity=mon.0 client_cookie=8c0487b64ac3b7c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:35.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.557+0000 7f4fb0f99700 1 -- 172.21.15.72:0/2276443551 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa400e070 con 0x7f4fac0c7360 2023-08-31T18:48:35.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.558+0000 7f4fb0f99700 1 -- 172.21.15.72:0/2276443551 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa400bab0 con 0x7f4fac0c7360 2023-08-31T18:48:35.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.558+0000 7f4fb0f99700 1 -- 172.21.15.72:0/2276443551 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa400be30 con 0x7f4fac0c7360 2023-08-31T18:48:35.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.558+0000 7f4fb41ff700 1 -- 172.21.15.72:0/2276443551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fac0c7360 msgr2=0x7f4fac063120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.558+0000 7f4fb41ff700 1 --2- 172.21.15.72:0/2276443551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fac0c7360 0x7f4fac063120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f4fa4009e60 tx=0x7f4fa4009780).stop 2023-08-31T18:48:35.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.558+0000 7f4fb41ff700 1 -- 172.21.15.72:0/2276443551 shutdown_connections 2023-08-31T18:48:35.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.558+0000 7f4fb41ff700 1 --2- 172.21.15.72:0/2276443551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fac0c7360 0x7f4fac063120 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.558+0000 7f4fb41ff700 1 --2- 172.21.15.72:0/2276443551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fac154030 0x7f4fac154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.558+0000 7f4fb41ff700 1 -- 172.21.15.72:0/2276443551 >> 172.21.15.72:0/2276443551 conn(0x7f4fac05eb60 msgr2=0x7f4fac0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:35.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.558+0000 7f4fb41ff700 1 -- 172.21.15.72:0/2276443551 shutdown_connections 2023-08-31T18:48:35.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.558+0000 7f4fb41ff700 1 -- 172.21.15.72:0/2276443551 wait complete. 2023-08-31T18:48:35.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.560+0000 7f4fb41ff700 1 Processor -- start 2023-08-31T18:48:35.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.560+0000 7f4fb41ff700 1 -- start start 2023-08-31T18:48:35.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb41ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fac0c06b0 0x7f4fac14a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb41ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fac0c7360 0x7f4fac159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb41ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fac154030 0x7f4fac15a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb41ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac15a6f0 con 0x7f4fac154030 2023-08-31T18:48:35.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb41ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac14a6e0 con 0x7f4fac0c06b0 2023-08-31T18:48:35.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb41ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac0add80 con 0x7f4fac0c7360 2023-08-31T18:48:35.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb279c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fac154030 0x7f4fac15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb279c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fac154030 0x7f4fac15a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60784/0 (socket says 172.21.15.72:60784) 2023-08-31T18:48:35.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb279c700 1 -- 172.21.15.72:0/3270452891 learned_addr learned my addr 172.21.15.72:0/3270452891 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:35.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb179a700 1 --2- 172.21.15.72:0/3270452891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fac0c7360 0x7f4fac159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb1f9b700 1 --2- 172.21.15.72:0/3270452891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fac0c06b0 0x7f4fac14a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb279c700 1 -- 172.21.15.72:0/3270452891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fac0c7360 msgr2=0x7f4fac159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb279c700 1 --2- 172.21.15.72:0/3270452891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fac0c7360 0x7f4fac159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb279c700 1 -- 172.21.15.72:0/3270452891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fac0c06b0 msgr2=0x7f4fac14a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb279c700 1 --2- 172.21.15.72:0/3270452891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fac0c06b0 0x7f4fac14a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb279c700 1 -- 172.21.15.72:0/3270452891 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa4009a20 con 0x7f4fac154030 2023-08-31T18:48:35.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.561+0000 7f4fb179a700 1 --2- 172.21.15.72:0/3270452891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fac0c7360 0x7f4fac159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:35.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.562+0000 7f4fb279c700 1 --2- 172.21.15.72:0/3270452891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fac154030 0x7f4fac15a200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f4fa4012cb0 tx=0x7f4fa4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:35.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.562+0000 7f4fa1ffb700 1 -- 172.21.15.72:0/3270452891 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa401d630 con 0x7f4fac154030 2023-08-31T18:48:35.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.562+0000 7f4fa1ffb700 1 -- 172.21.15.72:0/3270452891 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa401d790 con 0x7f4fac154030 2023-08-31T18:48:35.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.562+0000 7f4fb41ff700 1 -- 172.21.15.72:0/3270452891 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fac0adfd0 con 0x7f4fac154030 2023-08-31T18:48:35.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.562+0000 7f4fa1ffb700 1 -- 172.21.15.72:0/3270452891 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa401db50 con 0x7f4fac154030 2023-08-31T18:48:35.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.562+0000 7f4fb41ff700 1 -- 172.21.15.72:0/3270452891 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fac0ae590 con 0x7f4fac154030 2023-08-31T18:48:35.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.563+0000 7f4fb41ff700 1 -- 172.21.15.72:0/3270452891 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fac06c6b0 con 0x7f4fac154030 2023-08-31T18:48:35.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.564+0000 7f4fa1ffb700 1 -- 172.21.15.72:0/3270452891 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f4fa4026410 con 0x7f4fac154030 2023-08-31T18:48:35.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.564+0000 7f4fa1ffb700 1 --2- 172.21.15.72:0/3270452891 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f9005ee10 0x7f4f900612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.565+0000 7f4fa1ffb700 1 -- 172.21.15.72:0/3270452891 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4fa407bb80 con 0x7f4fac154030 2023-08-31T18:48:35.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.565+0000 7f4fb1f9b700 1 --2- 172.21.15.72:0/3270452891 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f9005ee10 0x7f4f900612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.565+0000 7f4fb1f9b700 1 --2- 172.21.15.72:0/3270452891 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f9005ee10 0x7f4f900612d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f4fa8009b90 tx=0x7f4fa8009060).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:35.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.569+0000 7f4fa1ffb700 1 -- 172.21.15.72:0/3270452891 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4fa404cf90 con 0x7f4fac154030 2023-08-31T18:48:35.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.736+0000 7f4fb41ff700 1 -- 172.21.15.72:0/3270452891 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4fac06aac0 con 0x7f4fac154030 2023-08-31T18:48:35.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.737+0000 7f4fa1ffb700 1 -- 172.21.15.72:0/3270452891 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4fa40505b0 con 0x7f4fac154030 2023-08-31T18:48:35.737 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T18:48:35.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.738+0000 7f4fb41ff700 1 -- 172.21.15.72:0/3270452891 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f9005ee10 msgr2=0x7f4f900612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.738+0000 7f4fb41ff700 1 --2- 172.21.15.72:0/3270452891 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f9005ee10 0x7f4f900612d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f4fa8009b90 tx=0x7f4fa8009060).stop 2023-08-31T18:48:35.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.738+0000 7f4fb41ff700 1 -- 172.21.15.72:0/3270452891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fac154030 msgr2=0x7f4fac15a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.738+0000 7f4fb41ff700 1 --2- 172.21.15.72:0/3270452891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fac154030 0x7f4fac15a200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f4fa4012cb0 tx=0x7f4fa4009780).stop 2023-08-31T18:48:35.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.739+0000 7f4fb41ff700 1 -- 172.21.15.72:0/3270452891 shutdown_connections 2023-08-31T18:48:35.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.739+0000 7f4fb41ff700 1 --2- 172.21.15.72:0/3270452891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fac154030 0x7f4fac15a200 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.739+0000 7f4fb41ff700 1 --2- 172.21.15.72:0/3270452891 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f9005ee10 0x7f4f900612d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.739+0000 7f4fb41ff700 1 --2- 172.21.15.72:0/3270452891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fac0c06b0 0x7f4fac14a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.739+0000 7f4fb41ff700 1 --2- 172.21.15.72:0/3270452891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fac0c7360 0x7f4fac159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.739+0000 7f4fb41ff700 1 -- 172.21.15.72:0/3270452891 >> 172.21.15.72:0/3270452891 conn(0x7f4fac05eb60 msgr2=0x7f4fac156570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:35.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.739+0000 7f4fb41ff700 1 -- 172.21.15.72:0/3270452891 shutdown_connections 2023-08-31T18:48:35.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.739+0000 7f4fb41ff700 1 -- 172.21.15.72:0/3270452891 wait complete. 2023-08-31T18:48:35.756 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T18:48:35.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.946+0000 7fbb887ff700 1 Processor -- start 2023-08-31T18:48:35.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.947+0000 7fbb887ff700 1 -- start start 2023-08-31T18:48:35.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.948+0000 7fbb887ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb80154210 0x7fbb800630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.948+0000 7fbb887ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb800635a0 0x7fbb800c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.948+0000 7fbb887ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb80063a00 con 0x7fbb80153e30 2023-08-31T18:48:35.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.948+0000 7fbb887ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb801546c0 con 0x7fbb80154210 2023-08-31T18:48:35.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.948+0000 7fbb887ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800bfd40 con 0x7fbb800635a0 2023-08-31T18:48:35.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.948+0000 7fbb85d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb80154210 0x7fbb800630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.948+0000 7fbb85d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb80154210 0x7fbb800630b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60796/0 (socket says 172.21.15.72:60796) 2023-08-31T18:48:35.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.948+0000 7fbb85d9a700 1 -- 172.21.15.72:0/3743212492 learned_addr learned my addr 172.21.15.72:0/3743212492 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:35.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.948+0000 7fbb86d9c700 1 --2- 172.21.15.72:0/3743212492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb800635a0 0x7fbb800c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.949+0000 7fbb85d9a700 1 -- 172.21.15.72:0/3743212492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb800635a0 msgr2=0x7fbb800c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:35.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.949+0000 7fbb85d9a700 1 --2- 172.21.15.72:0/3743212492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb800635a0 0x7fbb800c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.949+0000 7fbb85d9a700 1 -- 172.21.15.72:0/3743212492 >> v1:172.21.15.72:6789/0 conn(0x7fbb80153e30 legacy=0x7fbb800c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.949+0000 7fbb85d9a700 1 -- 172.21.15.72:0/3743212492 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb800c6730 con 0x7fbb80154210 2023-08-31T18:48:35.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.949+0000 7fbb86d9c700 1 --2- 172.21.15.72:0/3743212492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb800635a0 0x7fbb800c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.949+0000 7fbb85599700 1 -- 172.21.15.72:0/3743212492 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251855235 0 0) 0x7fbb80063a00 con 0x7fbb80153e30 2023-08-31T18:48:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.949+0000 7fbb85d9a700 1 --2- 172.21.15.72:0/3743212492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb80154210 0x7fbb800630b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fbb70006fd0 tx=0x7fbb700090f0).ready entity=mon.0 client_cookie=a157cb0b904a4683 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.949+0000 7fbb85599700 1 -- 172.21.15.72:0/3743212492 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7000b600 con 0x7fbb80154210 2023-08-31T18:48:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.949+0000 7fbb85599700 1 -- 172.21.15.72:0/3743212492 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7000b760 con 0x7fbb80154210 2023-08-31T18:48:35.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.949+0000 7fbb85599700 1 -- 172.21.15.72:0/3743212492 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7000bb00 con 0x7fbb80154210 2023-08-31T18:48:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.949+0000 7fbb887ff700 1 -- 172.21.15.72:0/3743212492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb80154210 msgr2=0x7fbb800630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.949+0000 7fbb887ff700 1 --2- 172.21.15.72:0/3743212492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb80154210 0x7fbb800630b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fbb70006fd0 tx=0x7fbb700090f0).stop 2023-08-31T18:48:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.950+0000 7fbb887ff700 1 -- 172.21.15.72:0/3743212492 shutdown_connections 2023-08-31T18:48:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.950+0000 7fbb887ff700 1 --2- 172.21.15.72:0/3743212492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb800635a0 0x7fbb800c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.950+0000 7fbb887ff700 1 --2- 172.21.15.72:0/3743212492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb80154210 0x7fbb800630b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.950+0000 7fbb887ff700 1 -- 172.21.15.72:0/3743212492 >> 172.21.15.72:0/3743212492 conn(0x7fbb8005eb20 msgr2=0x7fbb800cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:35.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.950+0000 7fbb887ff700 1 -- 172.21.15.72:0/3743212492 shutdown_connections 2023-08-31T18:48:35.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.950+0000 7fbb887ff700 1 -- 172.21.15.72:0/3743212492 wait complete. 2023-08-31T18:48:35.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.951+0000 7fbb887ff700 1 Processor -- start 2023-08-31T18:48:35.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.951+0000 7fbb887ff700 1 -- start start 2023-08-31T18:48:35.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.952+0000 7fbb887ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb800635a0 0x7fbb8014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.952+0000 7fbb887ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb80153e30 0x7fbb800c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.952+0000 7fbb887ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb80154210 0x7fbb800c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.952+0000 7fbb887ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800b0aa0 con 0x7fbb800635a0 2023-08-31T18:48:35.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.952+0000 7fbb887ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800ae230 con 0x7fbb80154210 2023-08-31T18:48:35.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.952+0000 7fbb887ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800b04e0 con 0x7fbb80153e30 2023-08-31T18:48:35.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.953+0000 7fbb8659b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb800635a0 0x7fbb8014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.953+0000 7fbb8659b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb800635a0 0x7fbb8014d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60800/0 (socket says 172.21.15.72:60800) 2023-08-31T18:48:35.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.953+0000 7fbb8659b700 1 -- 172.21.15.72:0/3710966432 learned_addr learned my addr 172.21.15.72:0/3710966432 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:35.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.953+0000 7fbb85d9a700 1 --2- 172.21.15.72:0/3710966432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb80153e30 0x7fbb800c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.953+0000 7fbb86d9c700 1 --2- 172.21.15.72:0/3710966432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb80154210 0x7fbb800c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.953+0000 7fbb8659b700 1 -- 172.21.15.72:0/3710966432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb80153e30 msgr2=0x7fbb800c2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.953+0000 7fbb8659b700 1 --2- 172.21.15.72:0/3710966432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb80153e30 0x7fbb800c2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.953+0000 7fbb8659b700 1 -- 172.21.15.72:0/3710966432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb80154210 msgr2=0x7fbb800c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:35.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.953+0000 7fbb8659b700 1 --2- 172.21.15.72:0/3710966432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb80154210 0x7fbb800c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:35.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.953+0000 7fbb8659b700 1 -- 172.21.15.72:0/3710966432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb70009370 con 0x7fbb800635a0 2023-08-31T18:48:35.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.953+0000 7fbb8659b700 1 --2- 172.21.15.72:0/3710966432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb800635a0 0x7fbb8014d210 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fbb7c00c4e0 tx=0x7fbb7c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:35.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.953+0000 7fbb767fc700 1 -- 172.21.15.72:0/3710966432 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c00f470 con 0x7fbb800635a0 2023-08-31T18:48:35.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.953+0000 7fbb767fc700 1 -- 172.21.15.72:0/3710966432 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7c00f5f0 con 0x7fbb800635a0 2023-08-31T18:48:35.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.953+0000 7fbb887ff700 1 -- 172.21.15.72:0/3710966432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb800b07c0 con 0x7fbb800635a0 2023-08-31T18:48:35.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.953+0000 7fbb767fc700 1 -- 172.21.15.72:0/3710966432 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c00f9b0 con 0x7fbb800635a0 2023-08-31T18:48:35.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.954+0000 7fbb887ff700 1 -- 172.21.15.72:0/3710966432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8014d700 con 0x7fbb800635a0 2023-08-31T18:48:35.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.955+0000 7fbb887ff700 1 -- 172.21.15.72:0/3710966432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb800ae510 con 0x7fbb800635a0 2023-08-31T18:48:35.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.955+0000 7fbb767fc700 1 -- 172.21.15.72:0/3710966432 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fbb7c00fd20 con 0x7fbb800635a0 2023-08-31T18:48:35.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.957+0000 7fbb767fc700 1 --2- 172.21.15.72:0/3710966432 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbb6405ee10 0x7fbb640612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:35.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.957+0000 7fbb767fc700 1 -- 172.21.15.72:0/3710966432 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbb7c0794c0 con 0x7fbb800635a0 2023-08-31T18:48:35.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.957+0000 7fbb85d9a700 1 --2- 172.21.15.72:0/3710966432 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbb6405ee10 0x7fbb640612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:35.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.957+0000 7fbb85d9a700 1 --2- 172.21.15.72:0/3710966432 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbb6405ee10 0x7fbb640612d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fbb800ca640 tx=0x7fbb70017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:35.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:35.961+0000 7fbb767fc700 1 -- 172.21.15.72:0/3710966432 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbb7c04a870 con 0x7fbb800635a0 2023-08-31T18:48:36.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.126+0000 7fbb887ff700 1 -- 172.21.15.72:0/3710966432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbb800bffe0 con 0x7fbb800635a0 2023-08-31T18:48:36.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.127+0000 7fbb767fc700 1 -- 172.21.15.72:0/3710966432 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb7c04de90 con 0x7fbb800635a0 2023-08-31T18:48:36.128 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T18:48:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.129+0000 7fbb887ff700 1 -- 172.21.15.72:0/3710966432 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbb6405ee10 msgr2=0x7fbb640612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.129+0000 7fbb887ff700 1 --2- 172.21.15.72:0/3710966432 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbb6405ee10 0x7fbb640612d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fbb800ca640 tx=0x7fbb70017000).stop 2023-08-31T18:48:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.129+0000 7fbb887ff700 1 -- 172.21.15.72:0/3710966432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb800635a0 msgr2=0x7fbb8014d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.129+0000 7fbb887ff700 1 --2- 172.21.15.72:0/3710966432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb800635a0 0x7fbb8014d210 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fbb7c00c4e0 tx=0x7fbb7c007c70).stop 2023-08-31T18:48:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.129+0000 7fbb887ff700 1 -- 172.21.15.72:0/3710966432 shutdown_connections 2023-08-31T18:48:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.129+0000 7fbb887ff700 1 --2- 172.21.15.72:0/3710966432 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbb6405ee10 0x7fbb640612d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.129+0000 7fbb887ff700 1 --2- 172.21.15.72:0/3710966432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb80154210 0x7fbb800c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.129+0000 7fbb887ff700 1 --2- 172.21.15.72:0/3710966432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb800635a0 0x7fbb8014d210 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.129+0000 7fbb887ff700 1 --2- 172.21.15.72:0/3710966432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbb80153e30 0x7fbb800c2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.129+0000 7fbb887ff700 1 -- 172.21.15.72:0/3710966432 >> 172.21.15.72:0/3710966432 conn(0x7fbb8005eb20 msgr2=0x7fbb80151b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.129+0000 7fbb887ff700 1 -- 172.21.15.72:0/3710966432 shutdown_connections 2023-08-31T18:48:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.129+0000 7fbb887ff700 1 -- 172.21.15.72:0/3710966432 wait complete. 2023-08-31T18:48:36.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T18:48:36.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.337+0000 7fec627ff700 1 Processor -- start 2023-08-31T18:48:36.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.337+0000 7fec627ff700 1 -- start start 2023-08-31T18:48:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.338+0000 7fec627ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec5c0637c0 0x7fec5c15f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.339+0000 7fec627ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c0bfd40 con 0x7fec5c154210 2023-08-31T18:48:36.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.339+0000 7fec627ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c0c6730 con 0x7fec5c153e30 2023-08-31T18:48:36.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.339+0000 7fec627ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c1546c0 con 0x7fec5c0637c0 2023-08-31T18:48:36.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.339+0000 7fec5b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fec5c154210 0x7fec5c0630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55410/0 (socket says 172.21.15.72:55410) 2023-08-31T18:48:36.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.339+0000 7fec5b7fe700 1 -- 172.21.15.72:0/2027047080 learned_addr learned my addr 172.21.15.72:0/2027047080 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.339+0000 7fec60d9c700 1 --2- 172.21.15.72:0/2027047080 >> v2:172.21.15.72:3300/0 conn(0x7fec5c0637c0 0x7fec5c15f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.339+0000 7fec60d9c700 1 -- 172.21.15.72:0/2027047080 >> v1:172.21.15.146:6789/0 conn(0x7fec5c153e30 legacy=0x7fec5c0c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.339+0000 7fec60d9c700 1 -- 172.21.15.72:0/2027047080 >> v1:172.21.15.72:6789/0 conn(0x7fec5c154210 legacy=0x7fec5c0630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.339+0000 7fec60d9c700 1 -- 172.21.15.72:0/2027047080 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c0bffe0 con 0x7fec5c0637c0 2023-08-31T18:48:36.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.339+0000 7fec60d9c700 1 --2- 172.21.15.72:0/2027047080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c0637c0 0x7fec5c15f0b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fec54009e60 tx=0x7fec54009780).ready entity=mon.0 client_cookie=b1decc13ecd7fd6c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:36.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.340+0000 7fec5affd700 1 -- 172.21.15.72:0/2027047080 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400e070 con 0x7fec5c0637c0 2023-08-31T18:48:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.340+0000 7fec5affd700 1 -- 172.21.15.72:0/2027047080 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5400bbf0 con 0x7fec5c0637c0 2023-08-31T18:48:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.340+0000 7fec5affd700 1 -- 172.21.15.72:0/2027047080 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54012410 con 0x7fec5c0637c0 2023-08-31T18:48:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.340+0000 7fec627ff700 1 -- 172.21.15.72:0/2027047080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c0637c0 msgr2=0x7fec5c15f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.340+0000 7fec627ff700 1 --2- 172.21.15.72:0/2027047080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c0637c0 0x7fec5c15f0b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fec54009e60 tx=0x7fec54009780).stop 2023-08-31T18:48:36.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.340+0000 7fec627ff700 1 -- 172.21.15.72:0/2027047080 shutdown_connections 2023-08-31T18:48:36.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.340+0000 7fec627ff700 1 --2- 172.21.15.72:0/2027047080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c0637c0 0x7fec5c15f0b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:36.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.340+0000 7fec627ff700 1 -- 172.21.15.72:0/2027047080 >> 172.21.15.72:0/2027047080 conn(0x7fec5c05eb20 msgr2=0x7fec5c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:36.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.340+0000 7fec627ff700 1 -- 172.21.15.72:0/2027047080 shutdown_connections 2023-08-31T18:48:36.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.340+0000 7fec627ff700 1 -- 172.21.15.72:0/2027047080 wait complete. 2023-08-31T18:48:36.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.342+0000 7fec627ff700 1 Processor -- start 2023-08-31T18:48:36.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.342+0000 7fec627ff700 1 -- start start 2023-08-31T18:48:36.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.343+0000 7fec627ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec5c0637c0 0x7fec5c14dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:36.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.343+0000 7fec627ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec5c153e30 0x7fec5c0a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:36.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.343+0000 7fec627ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c154210 0x7fec5c0c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:36.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.343+0000 7fec627ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0c4a60 con 0x7fec5c154210 2023-08-31T18:48:36.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.343+0000 7fec627ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0c4ca0 con 0x7fec5c0637c0 2023-08-31T18:48:36.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.343+0000 7fec627ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0c28e0 con 0x7fec5c153e30 2023-08-31T18:48:36.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.343+0000 7fec60d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c154210 0x7fec5c0c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.343+0000 7fec60d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c154210 0x7fec5c0c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60818/0 (socket says 172.21.15.72:60818) 2023-08-31T18:48:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.343+0000 7fec60d9c700 1 -- 172.21.15.72:0/3647853260 learned_addr learned my addr 172.21.15.72:0/3647853260 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.343+0000 7fec60d9c700 1 -- 172.21.15.72:0/3647853260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec5c153e30 msgr2=0x7fec5c0a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.343+0000 7fec60d9c700 1 --2- 172.21.15.72:0/3647853260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec5c153e30 0x7fec5c0a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.343+0000 7fec60d9c700 1 -- 172.21.15.72:0/3647853260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec5c0637c0 msgr2=0x7fec5c14dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.343+0000 7fec60d9c700 1 --2- 172.21.15.72:0/3647853260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec5c0637c0 0x7fec5c14dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.343+0000 7fec60d9c700 1 -- 172.21.15.72:0/3647853260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec54009a20 con 0x7fec5c154210 2023-08-31T18:48:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.344+0000 7fec60d9c700 1 --2- 172.21.15.72:0/3647853260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c154210 0x7fec5c0c4570 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fec5400b6c0 tx=0x7fec54009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.344+0000 7fec43fff700 1 -- 172.21.15.72:0/3647853260 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec540117d0 con 0x7fec5c154210 2023-08-31T18:48:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.344+0000 7fec43fff700 1 -- 172.21.15.72:0/3647853260 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec54011930 con 0x7fec5c154210 2023-08-31T18:48:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.344+0000 7fec627ff700 1 -- 172.21.15.72:0/3647853260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c0c1fb0 con 0x7fec5c154210 2023-08-31T18:48:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.344+0000 7fec43fff700 1 -- 172.21.15.72:0/3647853260 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54011cf0 con 0x7fec5c154210 2023-08-31T18:48:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.344+0000 7fec627ff700 1 -- 172.21.15.72:0/3647853260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c0c2570 con 0x7fec5c154210 2023-08-31T18:48:36.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.345+0000 7fec627ff700 1 -- 172.21.15.72:0/3647853260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c06c6b0 con 0x7fec5c154210 2023-08-31T18:48:36.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.346+0000 7fec43fff700 1 -- 172.21.15.72:0/3647853260 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fec5401d630 con 0x7fec5c154210 2023-08-31T18:48:36.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.347+0000 7fec43fff700 1 --2- 172.21.15.72:0/3647853260 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fec4805ee10 0x7fec480612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:36.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.347+0000 7fec43fff700 1 -- 172.21.15.72:0/3647853260 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fec5407bed0 con 0x7fec5c154210 2023-08-31T18:48:36.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.347+0000 7fec5bfff700 1 --2- 172.21.15.72:0/3647853260 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fec4805ee10 0x7fec480612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:36.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.348+0000 7fec5bfff700 1 --2- 172.21.15.72:0/3647853260 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fec4805ee10 0x7fec480612d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fec4c002510 tx=0x7fec4c0079a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:36.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.351+0000 7fec43fff700 1 -- 172.21.15.72:0/3647853260 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fec5404d2e0 con 0x7fec5c154210 2023-08-31T18:48:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.522+0000 7fec627ff700 1 -- 172.21.15.72:0/3647853260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fec5c0c02c0 con 0x7fec5c154210 2023-08-31T18:48:36.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.522+0000 7fec43fff700 1 -- 172.21.15.72:0/3647853260 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fec54050900 con 0x7fec5c154210 2023-08-31T18:48:36.523 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T18:48:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.524+0000 7fec627ff700 1 -- 172.21.15.72:0/3647853260 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fec4805ee10 msgr2=0x7fec480612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.524+0000 7fec627ff700 1 --2- 172.21.15.72:0/3647853260 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fec4805ee10 0x7fec480612d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fec4c002510 tx=0x7fec4c0079a0).stop 2023-08-31T18:48:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.524+0000 7fec627ff700 1 -- 172.21.15.72:0/3647853260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c154210 msgr2=0x7fec5c0c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:36.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.524+0000 7fec627ff700 1 --2- 172.21.15.72:0/3647853260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c154210 0x7fec5c0c4570 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fec5400b6c0 tx=0x7fec54009780).stop 2023-08-31T18:48:36.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.524+0000 7fec627ff700 1 -- 172.21.15.72:0/3647853260 shutdown_connections 2023-08-31T18:48:36.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.524+0000 7fec627ff700 1 --2- 172.21.15.72:0/3647853260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5c154210 0x7fec5c0c4570 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:36.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.524+0000 7fec627ff700 1 --2- 172.21.15.72:0/3647853260 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fec4805ee10 0x7fec480612d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:36.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.524+0000 7fec627ff700 1 --2- 172.21.15.72:0/3647853260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec5c0637c0 0x7fec5c14dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.524+0000 7fec627ff700 1 --2- 172.21.15.72:0/3647853260 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec5c153e30 0x7fec5c0a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.524+0000 7fec627ff700 1 -- 172.21.15.72:0/3647853260 >> 172.21.15.72:0/3647853260 conn(0x7fec5c05eb20 msgr2=0x7fec5c0c0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.525+0000 7fec627ff700 1 -- 172.21.15.72:0/3647853260 shutdown_connections 2023-08-31T18:48:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.525+0000 7fec627ff700 1 -- 172.21.15.72:0/3647853260 wait complete. 2023-08-31T18:48:36.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T18:48:36.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.732+0000 7ff72dfff700 1 Processor -- start 2023-08-31T18:48:36.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.732+0000 7ff72dfff700 1 -- start start 2023-08-31T18:48:36.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.733+0000 7ff72dfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff728154210 0x7ff7280630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:36.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.733+0000 7ff72dfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7280635a0 0x7ff7280c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:36.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.733+0000 7ff72dfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff728063a00 con 0x7ff728153e30 2023-08-31T18:48:36.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.733+0000 7ff72dfff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff728154690 con 0x7ff7280635a0 2023-08-31T18:48:36.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.733+0000 7ff72dfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7280bfd40 con 0x7ff728154210 2023-08-31T18:48:36.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.734+0000 7ff7277fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff728153e30 0x7ff7280c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55426/0 (socket says 172.21.15.72:55426) 2023-08-31T18:48:36.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.734+0000 7ff7277fe700 1 -- 172.21.15.72:0/1503274684 learned_addr learned my addr 172.21.15.72:0/1503274684 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:36.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.734+0000 7ff726ffd700 1 --2- 172.21.15.72:0/1503274684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff728154210 0x7ff7280630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:36.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.734+0000 7ff727fff700 1 --2- 172.21.15.72:0/1503274684 >> v2:172.21.15.146:3300/0 conn(0x7ff7280635a0 0x7ff7280c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:36.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.734+0000 7ff7267fc700 1 -- 172.21.15.72:0/1503274684 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284083878 0 0) 0x7ff728063a00 con 0x7ff728153e30 2023-08-31T18:48:36.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.734+0000 7ff7267fc700 1 -- 172.21.15.72:0/1503274684 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7100033f0 con 0x7ff728153e30 2023-08-31T18:48:36.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.734+0000 7ff7267fc700 1 -- 172.21.15.72:0/1503274684 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4139284690 0 0) 0x7ff7100033f0 con 0x7ff728153e30 2023-08-31T18:48:36.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.734+0000 7ff7267fc700 1 -- 172.21.15.72:0/1503274684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff728154210 msgr2=0x7ff7280630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:36.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.734+0000 7ff7267fc700 1 --2- 172.21.15.72:0/1503274684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff728154210 0x7ff7280630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:36.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.734+0000 7ff7267fc700 1 -- 172.21.15.72:0/1503274684 >> v2:172.21.15.146:3300/0 conn(0x7ff7280635a0 msgr2=0x7ff7280c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:36.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.734+0000 7ff7267fc700 1 --2- 172.21.15.72:0/1503274684 >> v2:172.21.15.146:3300/0 conn(0x7ff7280635a0 0x7ff7280c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:36.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.734+0000 7ff7267fc700 1 -- 172.21.15.72:0/1503274684 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7280c6730 con 0x7ff728153e30 2023-08-31T18:48:36.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.734+0000 7ff7267fc700 1 -- 172.21.15.72:0/1503274684 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7ff718001470 con 0x7ff728153e30 2023-08-31T18:48:36.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff7267fc700 1 -- 172.21.15.72:0/1503274684 >> v1:172.21.15.72:6789/0 conn(0x7ff728153e30 legacy=0x7ff7280c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:36.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff7267fc700 1 --2- 172.21.15.72:0/1503274684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7100038e0 0x7ff710003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:36.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff7267fc700 1 --2- 172.21.15.72:0/1503274684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff728154210 0x7ff710004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:36.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff7267fc700 1 --2- 172.21.15.72:0/1503274684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff710004b80 0x7ff710005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:36.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff7267fc700 1 -- 172.21.15.72:0/1503274684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff728154690 con 0x7ff7100038e0 2023-08-31T18:48:36.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff7267fc700 1 -- 172.21.15.72:0/1503274684 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7280bfd40 con 0x7ff710004b80 2023-08-31T18:48:36.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff7267fc700 1 -- 172.21.15.72:0/1503274684 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71000b8e0 con 0x7ff728154210 2023-08-31T18:48:36.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff7277fe700 1 --2- 172.21.15.72:0/1503274684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7100038e0 0x7ff710003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:36.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff726ffd700 1 --2- 172.21.15.72:0/1503274684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff728154210 0x7ff710004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:36.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff727fff700 1 --2- 172.21.15.72:0/1503274684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff710004b80 0x7ff710005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:36.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff7277fe700 1 -- 172.21.15.72:0/1503274684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff728154210 msgr2=0x7ff710004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:36.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff7277fe700 1 --2- 172.21.15.72:0/1503274684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff728154210 0x7ff710004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:36.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff7277fe700 1 -- 172.21.15.72:0/1503274684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff710004b80 msgr2=0x7ff710005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:36.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff7277fe700 1 --2- 172.21.15.72:0/1503274684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff710004b80 0x7ff710005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:36.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff7277fe700 1 -- 172.21.15.72:0/1503274684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7100033f0 con 0x7ff7100038e0 2023-08-31T18:48:36.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.735+0000 7ff7277fe700 1 --2- 172.21.15.72:0/1503274684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7100038e0 0x7ff710003d00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff71800c210 tx=0x7ff718001e90).ready entity=mon.0 client_cookie=8ffde7820cded0d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:36.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.736+0000 7ff7267fc700 1 -- 172.21.15.72:0/1503274684 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718007a60 con 0x7ff7100038e0 2023-08-31T18:48:36.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.736+0000 7ff7267fc700 1 -- 172.21.15.72:0/1503274684 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71800cae0 con 0x7ff7100038e0 2023-08-31T18:48:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.736+0000 7ff7267fc700 1 -- 172.21.15.72:0/1503274684 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71800ce80 con 0x7ff7100038e0 2023-08-31T18:48:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.736+0000 7ff72dfff700 1 -- 172.21.15.72:0/1503274684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7100038e0 msgr2=0x7ff710003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.736+0000 7ff72dfff700 1 --2- 172.21.15.72:0/1503274684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7100038e0 0x7ff710003d00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff71800c210 tx=0x7ff718001e90).stop 2023-08-31T18:48:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.736+0000 7ff727fff700 1 -- 172.21.15.72:0/1503274684 reap_dead start 2023-08-31T18:48:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.736+0000 7ff72dfff700 1 -- 172.21.15.72:0/1503274684 shutdown_connections 2023-08-31T18:48:36.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.736+0000 7ff72dfff700 1 -- 172.21.15.72:0/1503274684 >> 172.21.15.72:0/1503274684 conn(0x7ff72805eb20 msgr2=0x7ff7280cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:36.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.736+0000 7ff72dfff700 1 -- 172.21.15.72:0/1503274684 shutdown_connections 2023-08-31T18:48:36.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.736+0000 7ff72dfff700 1 -- 172.21.15.72:0/1503274684 wait complete. 2023-08-31T18:48:36.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.738+0000 7ff72dfff700 1 Processor -- start 2023-08-31T18:48:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.738+0000 7ff72dfff700 1 -- start start 2023-08-31T18:48:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.739+0000 7ff72dfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7100038e0 0x7ff728167830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.739+0000 7ff72dfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff728167d20 0x7ff7280c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.739+0000 7ff72dfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7280c4960 0x7ff7280c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.739+0000 7ff72dfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7280c52b0 con 0x7ff7280c4960 2023-08-31T18:48:36.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.739+0000 7ff72dfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff728142400 con 0x7ff728167d20 2023-08-31T18:48:36.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.739+0000 7ff72dfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7280b0a20 con 0x7ff7100038e0 2023-08-31T18:48:36.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.739+0000 7ff727fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7280c4960 0x7ff7280c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:36.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.739+0000 7ff727fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7280c4960 0x7ff7280c4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60848/0 (socket says 172.21.15.72:60848) 2023-08-31T18:48:36.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.739+0000 7ff727fff700 1 -- 172.21.15.72:0/2948456937 learned_addr learned my addr 172.21.15.72:0/2948456937 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:36.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.739+0000 7ff727fff700 1 -- 172.21.15.72:0/2948456937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7100038e0 msgr2=0x7ff728167830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:36.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.739+0000 7ff727fff700 1 --2- 172.21.15.72:0/2948456937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7100038e0 0x7ff728167830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:36.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.739+0000 7ff727fff700 1 -- 172.21.15.72:0/2948456937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff728167d20 msgr2=0x7ff7280c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:36.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.739+0000 7ff727fff700 1 --2- 172.21.15.72:0/2948456937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff728167d20 0x7ff7280c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:36.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.739+0000 7ff727fff700 1 -- 172.21.15.72:0/2948456937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff728165bb0 con 0x7ff7280c4960 2023-08-31T18:48:36.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.740+0000 7ff727fff700 1 --2- 172.21.15.72:0/2948456937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7280c4960 0x7ff7280c4dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7ff720009d70 tx=0x7ff72000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:36.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.740+0000 7ff70f7fe700 1 -- 172.21.15.72:0/2948456937 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72000e040 con 0x7ff7280c4960 2023-08-31T18:48:36.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.740+0000 7ff70f7fe700 1 -- 172.21.15.72:0/2948456937 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72000f040 con 0x7ff7280c4960 2023-08-31T18:48:36.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.740+0000 7ff72dfff700 1 -- 172.21.15.72:0/2948456937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7281681a0 con 0x7ff7280c4960 2023-08-31T18:48:36.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.740+0000 7ff70f7fe700 1 -- 172.21.15.72:0/2948456937 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72000fe50 con 0x7ff7280c4960 2023-08-31T18:48:36.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.740+0000 7ff72dfff700 1 -- 172.21.15.72:0/2948456937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff728165560 con 0x7ff7280c4960 2023-08-31T18:48:36.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.741+0000 7ff72dfff700 1 -- 172.21.15.72:0/2948456937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72806c6b0 con 0x7ff7280c4960 2023-08-31T18:48:36.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.742+0000 7ff70f7fe700 1 -- 172.21.15.72:0/2948456937 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff720015660 con 0x7ff7280c4960 2023-08-31T18:48:36.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.742+0000 7ff70f7fe700 1 --2- 172.21.15.72:0/2948456937 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff71405ee10 0x7ff7140612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:36.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.743+0000 7ff70f7fe700 1 -- 172.21.15.72:0/2948456937 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff72007a8d0 con 0x7ff7280c4960 2023-08-31T18:48:36.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.743+0000 7ff7277fe700 1 --2- 172.21.15.72:0/2948456937 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff71405ee10 0x7ff7140612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:36.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.743+0000 7ff7277fe700 1 --2- 172.21.15.72:0/2948456937 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff71405ee10 0x7ff7140612d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7ff718001ed0 tx=0x7ff718015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:36.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.747+0000 7ff70f7fe700 1 -- 172.21.15.72:0/2948456937 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff72004bc80 con 0x7ff7280c4960 2023-08-31T18:48:36.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.912+0000 7ff72dfff700 1 -- 172.21.15.72:0/2948456937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff728165d40 con 0x7ff7280c4960 2023-08-31T18:48:36.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.912+0000 7ff70f7fe700 1 -- 172.21.15.72:0/2948456937 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff72004f2a0 con 0x7ff7280c4960 2023-08-31T18:48:36.913 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T18:48:36.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.914+0000 7ff72dfff700 1 -- 172.21.15.72:0/2948456937 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff71405ee10 msgr2=0x7ff7140612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:36.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.914+0000 7ff72dfff700 1 --2- 172.21.15.72:0/2948456937 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff71405ee10 0x7ff7140612d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7ff718001ed0 tx=0x7ff718015000).stop 2023-08-31T18:48:36.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.914+0000 7ff72dfff700 1 -- 172.21.15.72:0/2948456937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7280c4960 msgr2=0x7ff7280c4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:36.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.914+0000 7ff72dfff700 1 --2- 172.21.15.72:0/2948456937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7280c4960 0x7ff7280c4dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7ff720009d70 tx=0x7ff72000b040).stop 2023-08-31T18:48:36.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.914+0000 7ff72dfff700 1 -- 172.21.15.72:0/2948456937 shutdown_connections 2023-08-31T18:48:36.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.914+0000 7ff72dfff700 1 --2- 172.21.15.72:0/2948456937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7280c4960 0x7ff7280c4dc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:36.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.914+0000 7ff72dfff700 1 --2- 172.21.15.72:0/2948456937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7100038e0 0x7ff728167830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:36.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.914+0000 7ff72dfff700 1 --2- 172.21.15.72:0/2948456937 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff71405ee10 0x7ff7140612d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:36.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.914+0000 7ff72dfff700 1 --2- 172.21.15.72:0/2948456937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff728167d20 0x7ff7280c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:36.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.914+0000 7ff72dfff700 1 -- 172.21.15.72:0/2948456937 >> 172.21.15.72:0/2948456937 conn(0x7ff72805eb20 msgr2=0x7ff7280c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:36.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.914+0000 7ff72dfff700 1 -- 172.21.15.72:0/2948456937 shutdown_connections 2023-08-31T18:48:36.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:36.914+0000 7ff72dfff700 1 -- 172.21.15.72:0/2948456937 wait complete. 2023-08-31T18:48:36.931 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T18:48:37.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.119+0000 7f8eac9ff700 1 Processor -- start 2023-08-31T18:48:37.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.119+0000 7f8eac9ff700 1 -- start start 2023-08-31T18:48:37.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.120+0000 7f8eac9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ea815ce50 0x7f8ea815f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.120+0000 7f8eac9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea80c6120 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.120+0000 7f8eac9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea80c5e10 con 0x7f8ea8154060 2023-08-31T18:48:37.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.120+0000 7f8eac9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea80c1380 con 0x7f8ea815ce50 2023-08-31T18:48:37.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.121+0000 7f8ea5d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8ea80cb9b0 0x7f8ea81583e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55432/0 (socket says 172.21.15.72:55432) 2023-08-31T18:48:37.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.121+0000 7f8ea5d9b700 1 -- 172.21.15.72:0/3754303913 learned_addr learned my addr 172.21.15.72:0/3754303913 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:37.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.121+0000 7f8ea6d9d700 1 --2- 172.21.15.72:0/3754303913 >> v2:172.21.15.146:3300/0 conn(0x7f8ea815ce50 0x7f8ea815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.121+0000 7f8ea559a700 1 -- 172.21.15.72:0/3754303913 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715848597 0 0) 0x7f8ea80c6120 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.121+0000 7f8ea559a700 1 -- 172.21.15.72:0/3754303913 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e900033f0 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.121+0000 7f8ea6d9d700 1 -- 172.21.15.72:0/3754303913 >> v1:172.21.15.146:6789/0 conn(0x7f8ea8154060 legacy=0x7f8ea8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.121+0000 7f8ea6d9d700 1 -- 172.21.15.72:0/3754303913 >> v1:172.21.15.72:6789/0 conn(0x7f8ea80cb9b0 legacy=0x7f8ea81583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.121+0000 7f8ea6d9d700 1 -- 172.21.15.72:0/3754303913 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea8158af0 con 0x7f8ea815ce50 2023-08-31T18:48:37.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.122+0000 7f8ea6d9d700 1 --2- 172.21.15.72:0/3754303913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea815ce50 0x7f8ea815f240 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8ea0009e60 tx=0x7f8ea0009780).ready entity=mon.1 client_cookie=baf8d8eae2f1c1e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:37.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.122+0000 7f8ea559a700 1 -- 172.21.15.72:0/3754303913 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000e070 con 0x7f8ea815ce50 2023-08-31T18:48:37.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.122+0000 7f8ea559a700 1 -- 172.21.15.72:0/3754303913 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea000bb60 con 0x7f8ea815ce50 2023-08-31T18:48:37.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.122+0000 7f8ea559a700 1 -- 172.21.15.72:0/3754303913 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0012410 con 0x7f8ea815ce50 2023-08-31T18:48:37.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.122+0000 7f8eac9ff700 1 -- 172.21.15.72:0/3754303913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea815ce50 msgr2=0x7f8ea815f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.122+0000 7f8eac9ff700 1 --2- 172.21.15.72:0/3754303913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea815ce50 0x7f8ea815f240 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8ea0009e60 tx=0x7f8ea0009780).stop 2023-08-31T18:48:37.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.122+0000 7f8eac9ff700 1 -- 172.21.15.72:0/3754303913 shutdown_connections 2023-08-31T18:48:37.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.122+0000 7f8eac9ff700 1 --2- 172.21.15.72:0/3754303913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea815ce50 0x7f8ea815f240 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.122+0000 7f8eac9ff700 1 -- 172.21.15.72:0/3754303913 >> 172.21.15.72:0/3754303913 conn(0x7f8ea805e870 msgr2=0x7f8ea80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.122+0000 7f8eac9ff700 1 -- 172.21.15.72:0/3754303913 shutdown_connections 2023-08-31T18:48:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.122+0000 7f8eac9ff700 1 -- 172.21.15.72:0/3754303913 wait complete. 2023-08-31T18:48:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.124+0000 7f8eac9ff700 1 Processor -- start 2023-08-31T18:48:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.124+0000 7f8eac9ff700 1 -- start start 2023-08-31T18:48:37.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.125+0000 7f8eac9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ea80cb9b0 0x7f8ea814b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.125+0000 7f8eac9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea8154060 0x7f8ea8153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.125+0000 7f8eac9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ea815ce50 0x7f8ea8153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.125+0000 7f8eac9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea8153c20 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.125+0000 7f8eac9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea8152c30 con 0x7f8ea8154060 2023-08-31T18:48:37.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.125+0000 7f8eac9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea8152020 con 0x7f8ea815ce50 2023-08-31T18:48:37.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.125+0000 7f8ea659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ea80cb9b0 0x7f8ea814b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.125+0000 7f8ea659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ea80cb9b0 0x7f8ea814b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60850/0 (socket says 172.21.15.72:60850) 2023-08-31T18:48:37.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.125+0000 7f8ea659c700 1 -- 172.21.15.72:0/1001498683 learned_addr learned my addr 172.21.15.72:0/1001498683 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:37.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.125+0000 7f8ea5d9b700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea8154060 0x7f8ea8153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.126+0000 7f8ea659c700 1 -- 172.21.15.72:0/1001498683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ea815ce50 msgr2=0x7f8ea8153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.126+0000 7f8ea6d9d700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ea815ce50 0x7f8ea8153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.126+0000 7f8ea659c700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ea815ce50 0x7f8ea8153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.126+0000 7f8ea659c700 1 -- 172.21.15.72:0/1001498683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea8154060 msgr2=0x7f8ea8153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.126+0000 7f8ea659c700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea8154060 0x7f8ea8153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.126+0000 7f8ea659c700 1 -- 172.21.15.72:0/1001498683 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea0009a20 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.126+0000 7f8ea5d9b700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea8154060 0x7f8ea8153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:37.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.126+0000 7f8ea6d9d700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ea815ce50 0x7f8ea8153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:37.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.126+0000 7f8ea659c700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ea80cb9b0 0x7f8ea814b570 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f8e9800c4b0 tx=0x7f8e98007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:37.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.126+0000 7f8e967fc700 1 -- 172.21.15.72:0/1001498683 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800f470 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.126+0000 7f8e967fc700 1 -- 172.21.15.72:0/1001498683 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9800f5d0 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.126+0000 7f8eac9ff700 1 -- 172.21.15.72:0/1001498683 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea8152300 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.126+0000 7f8e967fc700 1 -- 172.21.15.72:0/1001498683 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800f950 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.126+0000 7f8eac9ff700 1 -- 172.21.15.72:0/1001498683 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea81528c0 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.127+0000 7f8eac9ff700 1 -- 172.21.15.72:0/1001498683 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea806c6b0 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.128+0000 7f8e967fc700 1 -- 172.21.15.72:0/1001498683 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8e9800fcc0 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.129+0000 7f8e967fc700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8e8805ee10 0x7f8e880612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.129+0000 7f8e967fc700 1 -- 172.21.15.72:0/1001498683 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8e98079350 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.129+0000 7f8ea5d9b700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8e8805ee10 0x7f8e880612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.130+0000 7f8ea5d9b700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8e8805ee10 0x7f8e880612d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f8e9c005750 tx=0x7f8e9c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:37.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.133+0000 7f8e967fc700 1 -- 172.21.15.72:0/1001498683 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8e980488f0 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.345+0000 7f8eac9ff700 1 -- 172.21.15.72:0/1001498683 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ea80c0ae0 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.346+0000 7f8e967fc700 1 -- 172.21.15.72:0/1001498683 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4483 (secure 0 0 0) 0x7f8e9804a7b0 con 0x7f8ea80cb9b0 2023-08-31T18:48:37.347 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:37.347 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/111391994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":111391994},{"type":"v1","addr":"172.21.15.72:6837","nonce":111391994}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/4001102603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4001102603},{"type":"v1","addr":"172.21.15.146:6833","nonce":4001102603}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/522602179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":522602179},{"type":"v1","addr":"172.21.15.72:6835","nonce":522602179}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T18:47:52.970136+0000","modified":"2023-08-31T18:47:55.979886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3888852190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3888852190},{"type":"v1","addr":"172.21.15.146:6835","nonce":3888852190}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-31T18:48:37.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.348+0000 7f8eac9ff700 1 -- 172.21.15.72:0/1001498683 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8e8805ee10 msgr2=0x7f8e880612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.348+0000 7f8eac9ff700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8e8805ee10 0x7f8e880612d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f8e9c005750 tx=0x7f8e9c009040).stop 2023-08-31T18:48:37.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.348+0000 7f8eac9ff700 1 -- 172.21.15.72:0/1001498683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ea80cb9b0 msgr2=0x7f8ea814b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.348+0000 7f8eac9ff700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ea80cb9b0 0x7f8ea814b570 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f8e9800c4b0 tx=0x7f8e98007e30).stop 2023-08-31T18:48:37.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.348+0000 7f8eac9ff700 1 -- 172.21.15.72:0/1001498683 shutdown_connections 2023-08-31T18:48:37.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.348+0000 7f8eac9ff700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ea815ce50 0x7f8ea8153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.348+0000 7f8eac9ff700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ea80cb9b0 0x7f8ea814b570 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.348+0000 7f8eac9ff700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8e8805ee10 0x7f8e880612d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.348+0000 7f8eac9ff700 1 --2- 172.21.15.72:0/1001498683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea8154060 0x7f8ea8153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.348+0000 7f8eac9ff700 1 -- 172.21.15.72:0/1001498683 >> 172.21.15.72:0/1001498683 conn(0x7f8ea805e870 msgr2=0x7f8ea80bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.348+0000 7f8eac9ff700 1 -- 172.21.15.72:0/1001498683 shutdown_connections 2023-08-31T18:48:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.348+0000 7f8eac9ff700 1 -- 172.21.15.72:0/1001498683 wait complete. 2023-08-31T18:48:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-08-31T18:48:37.366 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:48:37.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.554+0000 7f279e1ff700 1 Processor -- start 2023-08-31T18:48:37.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.554+0000 7f279e1ff700 1 -- start start 2023-08-31T18:48:37.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.555+0000 7f279e1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2798154060 0x7f2798157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.555+0000 7f279e1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f27980cb9b0 0x7f27981581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.555+0000 7f279e1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27980c6120 con 0x7f27981586b0 2023-08-31T18:48:37.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.555+0000 7f279e1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27980c1380 con 0x7f2798154060 2023-08-31T18:48:37.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.555+0000 7f279e1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27980c5e10 con 0x7f27980cb9b0 2023-08-31T18:48:37.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.555+0000 7f27977fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2798154060 0x7f2798157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.555+0000 7f2797fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f27981586b0 0x7f27980c65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55438/0 (socket says 172.21.15.72:55438) 2023-08-31T18:48:37.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.555+0000 7f2797fff700 1 -- 172.21.15.72:0/2079363996 learned_addr learned my addr 172.21.15.72:0/2079363996 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:37.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.556+0000 7f2796ffd700 1 --2- 172.21.15.72:0/2079363996 >> v2:172.21.15.146:3300/0 conn(0x7f27980cb9b0 0x7f27981581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.556+0000 7f27977fe700 1 -- 172.21.15.72:0/2079363996 >> v2:172.21.15.146:3300/0 conn(0x7f27980cb9b0 msgr2=0x7f27981581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:37.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.556+0000 7f27977fe700 1 --2- 172.21.15.72:0/2079363996 >> v2:172.21.15.146:3300/0 conn(0x7f27980cb9b0 0x7f27981581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.556+0000 7f27977fe700 1 -- 172.21.15.72:0/2079363996 >> v1:172.21.15.72:6789/0 conn(0x7f27981586b0 legacy=0x7f27980c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.556+0000 7f27977fe700 1 -- 172.21.15.72:0/2079363996 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2798158b00 con 0x7f2798154060 2023-08-31T18:48:37.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.556+0000 7f27967fc700 1 -- 172.21.15.72:0/2079363996 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581644146 0 0) 0x7f27980c6120 con 0x7f27981586b0 2023-08-31T18:48:37.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.556+0000 7f2796ffd700 1 --2- 172.21.15.72:0/2079363996 >> v2:172.21.15.146:3300/0 conn(0x7f27980cb9b0 0x7f27981581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:37.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.556+0000 7f27977fe700 1 --2- 172.21.15.72:0/2079363996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2798154060 0x7f2798157cd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f2798083190 tx=0x7f2788006f40).ready entity=mon.0 client_cookie=92343311793b1912 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:37.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.556+0000 7f27967fc700 1 -- 172.21.15.72:0/2079363996 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278800f510 con 0x7f2798154060 2023-08-31T18:48:37.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.556+0000 7f27967fc700 1 -- 172.21.15.72:0/2079363996 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278800f670 con 0x7f2798154060 2023-08-31T18:48:37.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.556+0000 7f27967fc700 1 -- 172.21.15.72:0/2079363996 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278800f9f0 con 0x7f2798154060 2023-08-31T18:48:37.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.557+0000 7f279e1ff700 1 -- 172.21.15.72:0/2079363996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2798154060 msgr2=0x7f2798157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.557+0000 7f279e1ff700 1 --2- 172.21.15.72:0/2079363996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2798154060 0x7f2798157cd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f2798083190 tx=0x7f2788006f40).stop 2023-08-31T18:48:37.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.557+0000 7f279e1ff700 1 -- 172.21.15.72:0/2079363996 shutdown_connections 2023-08-31T18:48:37.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.557+0000 7f279e1ff700 1 --2- 172.21.15.72:0/2079363996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2798154060 0x7f2798157cd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.557+0000 7f279e1ff700 1 --2- 172.21.15.72:0/2079363996 >> v2:172.21.15.146:3300/0 conn(0x7f27980cb9b0 0x7f27981581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.557+0000 7f279e1ff700 1 -- 172.21.15.72:0/2079363996 >> 172.21.15.72:0/2079363996 conn(0x7f279805e870 msgr2=0x7f27980cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:37.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.557+0000 7f279e1ff700 1 -- 172.21.15.72:0/2079363996 shutdown_connections 2023-08-31T18:48:37.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.557+0000 7f279e1ff700 1 -- 172.21.15.72:0/2079363996 wait complete. 2023-08-31T18:48:37.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.559+0000 7f279e1ff700 1 Processor -- start 2023-08-31T18:48:37.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.559+0000 7f279e1ff700 1 -- start start 2023-08-31T18:48:37.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.560+0000 7f279e1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27980cb9b0 0x7f2798146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.560+0000 7f279e1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2798154060 0x7f27980ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.560+0000 7f279e1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27981586b0 0x7f27980ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.560+0000 7f279e1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2798155ce0 con 0x7f27980cb9b0 2023-08-31T18:48:37.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.561+0000 7f279e1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2798156b40 con 0x7f27981586b0 2023-08-31T18:48:37.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.561+0000 7f279e1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2798146630 con 0x7f2798154060 2023-08-31T18:48:37.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.561+0000 7f27977fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27980cb9b0 0x7f2798146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.561+0000 7f27977fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27980cb9b0 0x7f2798146140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60862/0 (socket says 172.21.15.72:60862) 2023-08-31T18:48:37.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.561+0000 7f27977fe700 1 -- 172.21.15.72:0/980049318 learned_addr learned my addr 172.21.15.72:0/980049318 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:37.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.561+0000 7f2796ffd700 1 --2- 172.21.15.72:0/980049318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2798154060 0x7f27980ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.561+0000 7f2797fff700 1 --2- 172.21.15.72:0/980049318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27981586b0 0x7f27980ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.561+0000 7f27977fe700 1 -- 172.21.15.72:0/980049318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2798154060 msgr2=0x7f27980ab050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.561+0000 7f27977fe700 1 --2- 172.21.15.72:0/980049318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2798154060 0x7f27980ab050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.561+0000 7f27977fe700 1 -- 172.21.15.72:0/980049318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27981586b0 msgr2=0x7f27980ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.561+0000 7f27977fe700 1 --2- 172.21.15.72:0/980049318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27981586b0 0x7f27980ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.561+0000 7f27977fe700 1 -- 172.21.15.72:0/980049318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2788009250 con 0x7f27980cb9b0 2023-08-31T18:48:37.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.561+0000 7f2797fff700 1 --2- 172.21.15.72:0/980049318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27981586b0 0x7f27980ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:37.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.561+0000 7f27977fe700 1 --2- 172.21.15.72:0/980049318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27980cb9b0 0x7f2798146140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f2788006fd0 tx=0x7f2788017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:37.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.562+0000 7f277f7fe700 1 -- 172.21.15.72:0/980049318 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278800fe80 con 0x7f27980cb9b0 2023-08-31T18:48:37.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.562+0000 7f277f7fe700 1 -- 172.21.15.72:0/980049318 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278800f7e0 con 0x7f27980cb9b0 2023-08-31T18:48:37.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.562+0000 7f279e1ff700 1 -- 172.21.15.72:0/980049318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2798155f30 con 0x7f27980cb9b0 2023-08-31T18:48:37.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.562+0000 7f277f7fe700 1 -- 172.21.15.72:0/980049318 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2788024680 con 0x7f27980cb9b0 2023-08-31T18:48:37.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.562+0000 7f279e1ff700 1 -- 172.21.15.72:0/980049318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27981564f0 con 0x7f27980cb9b0 2023-08-31T18:48:37.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.563+0000 7f279e1ff700 1 -- 172.21.15.72:0/980049318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279806c6b0 con 0x7f27980cb9b0 2023-08-31T18:48:37.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.563+0000 7f277f7fe700 1 -- 172.21.15.72:0/980049318 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f2788021070 con 0x7f27980cb9b0 2023-08-31T18:48:37.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.564+0000 7f277f7fe700 1 --2- 172.21.15.72:0/980049318 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f278405ee10 0x7f27840612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.564+0000 7f277f7fe700 1 -- 172.21.15.72:0/980049318 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f278807b8b0 con 0x7f27980cb9b0 2023-08-31T18:48:37.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.565+0000 7f2796ffd700 1 --2- 172.21.15.72:0/980049318 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f278405ee10 0x7f27840612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.565+0000 7f2796ffd700 1 --2- 172.21.15.72:0/980049318 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f278405ee10 0x7f27840612d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f2798098e20 tx=0x7f278c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:37.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.569+0000 7f277f7fe700 1 -- 172.21.15.72:0/980049318 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f278804cc60 con 0x7f27980cb9b0 2023-08-31T18:48:37.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.737+0000 7f279e1ff700 1 -- 172.21.15.72:0/980049318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27980c0ae0 con 0x7f27980cb9b0 2023-08-31T18:48:37.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.738+0000 7f277f7fe700 1 -- 172.21.15.72:0/980049318 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17024 (secure 0 0 0) 0x7f2788050280 con 0x7f27980cb9b0 2023-08-31T18:48:37.738 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:37.739 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:53.972412+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:47:51.003304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-31T18:47:51.950765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:48:37.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.740+0000 7f279e1ff700 1 -- 172.21.15.72:0/980049318 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f278405ee10 msgr2=0x7f27840612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.740+0000 7f279e1ff700 1 --2- 172.21.15.72:0/980049318 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f278405ee10 0x7f27840612d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f2798098e20 tx=0x7f278c008040).stop 2023-08-31T18:48:37.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.740+0000 7f279e1ff700 1 -- 172.21.15.72:0/980049318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27980cb9b0 msgr2=0x7f2798146140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.740+0000 7f279e1ff700 1 --2- 172.21.15.72:0/980049318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27980cb9b0 0x7f2798146140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f2788006fd0 tx=0x7f2788017000).stop 2023-08-31T18:48:37.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.740+0000 7f279e1ff700 1 -- 172.21.15.72:0/980049318 shutdown_connections 2023-08-31T18:48:37.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.740+0000 7f279e1ff700 1 --2- 172.21.15.72:0/980049318 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f278405ee10 0x7f27840612d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.740+0000 7f279e1ff700 1 --2- 172.21.15.72:0/980049318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27981586b0 0x7f27980ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.740+0000 7f279e1ff700 1 --2- 172.21.15.72:0/980049318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27980cb9b0 0x7f2798146140 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.740+0000 7f279e1ff700 1 --2- 172.21.15.72:0/980049318 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2798154060 0x7f27980ab050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.740+0000 7f279e1ff700 1 -- 172.21.15.72:0/980049318 >> 172.21.15.72:0/980049318 conn(0x7f279805e870 msgr2=0x7f2798063090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:37.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.740+0000 7f279e1ff700 1 -- 172.21.15.72:0/980049318 shutdown_connections 2023-08-31T18:48:37.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.740+0000 7f279e1ff700 1 -- 172.21.15.72:0/980049318 wait complete. 2023-08-31T18:48:37.759 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T18:48:37.759 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T18:48:37.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.945+0000 7f10193ff700 1 Processor -- start 2023-08-31T18:48:37.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.945+0000 7f10193ff700 1 -- start start 2023-08-31T18:48:37.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.946+0000 7f10193ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1014154060 0x7f1014157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.946+0000 7f10193ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10140c6120 con 0x7f10140cb9b0 2023-08-31T18:48:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.946+0000 7f10193ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10140c5e10 con 0x7f10141588d0 2023-08-31T18:48:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.946+0000 7f10193ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10140c1380 con 0x7f1014154060 2023-08-31T18:48:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.946+0000 7f10127fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f10140cb9b0 0x7f10141581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55442/0 (socket says 172.21.15.72:55442) 2023-08-31T18:48:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.947+0000 7f10127fc700 1 -- 172.21.15.72:0/3445479125 learned_addr learned my addr 172.21.15.72:0/3445479125 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.947+0000 7f1012ffd700 1 --2- 172.21.15.72:0/3445479125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1014154060 0x7f1014157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.947+0000 7f1011ffb700 1 -- 172.21.15.72:0/3445479125 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278137722 0 0) 0x7f10140c6120 con 0x7f10140cb9b0 2023-08-31T18:48:37.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.947+0000 7f1011ffb700 1 -- 172.21.15.72:0/3445479125 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ffc0033f0 con 0x7f10140cb9b0 2023-08-31T18:48:37.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.947+0000 7f1011ffb700 1 -- 172.21.15.72:0/3445479125 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808257839 0 0) 0x7f10140c5e10 con 0x7f10141588d0 2023-08-31T18:48:37.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.947+0000 7f1011ffb700 1 -- 172.21.15.72:0/3445479125 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10140c6120 con 0x7f10141588d0 2023-08-31T18:48:37.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.947+0000 7f1012ffd700 1 -- 172.21.15.72:0/3445479125 >> v1:172.21.15.146:6789/0 conn(0x7f10141588d0 legacy=0x7f1014154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.947+0000 7f1012ffd700 1 -- 172.21.15.72:0/3445479125 >> v1:172.21.15.72:6789/0 conn(0x7f10140cb9b0 legacy=0x7f10141581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.947+0000 7f1012ffd700 1 -- 172.21.15.72:0/3445479125 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140c0ae0 con 0x7f1014154060 2023-08-31T18:48:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.947+0000 7f1012ffd700 1 --2- 172.21.15.72:0/3445479125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1014154060 0x7f1014157cd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1004009760 tx=0x7f1004006f40).ready entity=mon.2 client_cookie=b88bffc0fc5a7b47 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.948+0000 7f1011ffb700 1 -- 172.21.15.72:0/3445479125 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004005880 con 0x7f1014154060 2023-08-31T18:48:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.948+0000 7f1011ffb700 1 -- 172.21.15.72:0/3445479125 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10040059e0 con 0x7f1014154060 2023-08-31T18:48:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.948+0000 7f1011ffb700 1 -- 172.21.15.72:0/3445479125 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004005d60 con 0x7f1014154060 2023-08-31T18:48:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.948+0000 7f10193ff700 1 -- 172.21.15.72:0/3445479125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1014154060 msgr2=0x7f1014157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.948+0000 7f10193ff700 1 --2- 172.21.15.72:0/3445479125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1014154060 0x7f1014157cd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1004009760 tx=0x7f1004006f40).stop 2023-08-31T18:48:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.948+0000 7f10193ff700 1 -- 172.21.15.72:0/3445479125 shutdown_connections 2023-08-31T18:48:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.948+0000 7f10193ff700 1 --2- 172.21.15.72:0/3445479125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1014154060 0x7f1014157cd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.948+0000 7f10193ff700 1 -- 172.21.15.72:0/3445479125 >> 172.21.15.72:0/3445479125 conn(0x7f101405e870 msgr2=0x7f10140cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.948+0000 7f10193ff700 1 -- 172.21.15.72:0/3445479125 shutdown_connections 2023-08-31T18:48:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.948+0000 7f10193ff700 1 -- 172.21.15.72:0/3445479125 wait complete. 2023-08-31T18:48:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.950+0000 7f10193ff700 1 Processor -- start 2023-08-31T18:48:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.950+0000 7f10193ff700 1 -- start start 2023-08-31T18:48:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.951+0000 7f10193ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10140cb9b0 0x7f1014156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.951+0000 7f10193ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1014154060 0x7f10140b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.951+0000 7f10193ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10141588d0 0x7f1014152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.951+0000 7f10193ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10141485c0 con 0x7f10140cb9b0 2023-08-31T18:48:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.951+0000 7f10193ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140ade50 con 0x7f10141588d0 2023-08-31T18:48:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.951+0000 7f10193ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10140ae130 con 0x7f1014154060 2023-08-31T18:48:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.951+0000 7f1012ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10140cb9b0 0x7f1014156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.951+0000 7f1012ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10140cb9b0 0x7f1014156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60878/0 (socket says 172.21.15.72:60878) 2023-08-31T18:48:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.951+0000 7f1012ffd700 1 -- 172.21.15.72:0/2255346643 learned_addr learned my addr 172.21.15.72:0/2255346643 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.952+0000 7f10127fc700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1014154060 0x7f10140b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.952+0000 7f10137fe700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10141588d0 0x7f1014152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.952+0000 7f1012ffd700 1 -- 172.21.15.72:0/2255346643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1014154060 msgr2=0x7f10140b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.952+0000 7f1012ffd700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1014154060 0x7f10140b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.952+0000 7f1012ffd700 1 -- 172.21.15.72:0/2255346643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10141588d0 msgr2=0x7f1014152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.952+0000 7f1012ffd700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10141588d0 0x7f1014152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.952+0000 7f1012ffd700 1 -- 172.21.15.72:0/2255346643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1004009250 con 0x7f10140cb9b0 2023-08-31T18:48:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.952+0000 7f10127fc700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1014154060 0x7f10140b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.952+0000 7f10137fe700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10141588d0 0x7f1014152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:37.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.952+0000 7f1012ffd700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10140cb9b0 0x7f1014156380 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f1004009d50 tx=0x7f1004015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:37.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.952+0000 7f0ffaffd700 1 -- 172.21.15.72:0/2255346643 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100400d6b0 con 0x7f10140cb9b0 2023-08-31T18:48:37.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.952+0000 7f0ffaffd700 1 -- 172.21.15.72:0/2255346643 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100400d810 con 0x7f10140cb9b0 2023-08-31T18:48:37.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.952+0000 7f0ffaffd700 1 -- 172.21.15.72:0/2255346643 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100400db90 con 0x7f10140cb9b0 2023-08-31T18:48:37.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.952+0000 7f10193ff700 1 -- 172.21.15.72:0/2255346643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10140ae410 con 0x7f10140cb9b0 2023-08-31T18:48:37.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.952+0000 7f10193ff700 1 -- 172.21.15.72:0/2255346643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10140ae9d0 con 0x7f10140cb9b0 2023-08-31T18:48:37.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.953+0000 7f10193ff700 1 -- 172.21.15.72:0/2255346643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101406c6b0 con 0x7f10140cb9b0 2023-08-31T18:48:37.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.954+0000 7f0ffaffd700 1 -- 172.21.15.72:0/2255346643 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f100401e460 con 0x7f10140cb9b0 2023-08-31T18:48:37.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.955+0000 7f0ffaffd700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f100005ee10 0x7f10000612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:37.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.955+0000 7f0ffaffd700 1 -- 172.21.15.72:0/2255346643 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f100407b470 con 0x7f10140cb9b0 2023-08-31T18:48:37.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.955+0000 7f10127fc700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f100005ee10 0x7f10000612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:37.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.956+0000 7f10127fc700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f100005ee10 0x7f10000612d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f10140acf20 tx=0x7f1008009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:37.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:37.959+0000 7f0ffaffd700 1 -- 172.21.15.72:0/2255346643 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f100404c870 con 0x7f10140cb9b0 2023-08-31T18:48:38.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.166+0000 7f10193ff700 1 -- 172.21.15.72:0/2255346643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10140c0dc0 con 0x7f10140cb9b0 2023-08-31T18:48:38.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.167+0000 7f0ffaffd700 1 -- 172.21.15.72:0/2255346643 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4483 (secure 0 0 0) 0x7f1004023070 con 0x7f10140cb9b0 2023-08-31T18:48:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:38.168 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/111391994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":111391994},{"type":"v1","addr":"172.21.15.72:6837","nonce":111391994}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/4001102603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4001102603},{"type":"v1","addr":"172.21.15.146:6833","nonce":4001102603}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/522602179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":522602179},{"type":"v1","addr":"172.21.15.72:6835","nonce":522602179}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T18:47:52.970136+0000","modified":"2023-08-31T18:47:55.979886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3888852190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3888852190},{"type":"v1","addr":"172.21.15.146:6835","nonce":3888852190}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-31T18:48:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.169+0000 7f10193ff700 1 -- 172.21.15.72:0/2255346643 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f100005ee10 msgr2=0x7f10000612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.169+0000 7f10193ff700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f100005ee10 0x7f10000612d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f10140acf20 tx=0x7f1008009040).stop 2023-08-31T18:48:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.169+0000 7f10193ff700 1 -- 172.21.15.72:0/2255346643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10140cb9b0 msgr2=0x7f1014156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.169+0000 7f10193ff700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10140cb9b0 0x7f1014156380 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f1004009d50 tx=0x7f1004015000).stop 2023-08-31T18:48:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.169+0000 7f10193ff700 1 -- 172.21.15.72:0/2255346643 shutdown_connections 2023-08-31T18:48:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.169+0000 7f10193ff700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f100005ee10 0x7f10000612d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.169+0000 7f10193ff700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10141588d0 0x7f1014152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.169+0000 7f10193ff700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10140cb9b0 0x7f1014156380 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.169+0000 7f10193ff700 1 --2- 172.21.15.72:0/2255346643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1014154060 0x7f10140b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.169+0000 7f10193ff700 1 -- 172.21.15.72:0/2255346643 >> 172.21.15.72:0/2255346643 conn(0x7f101405e870 msgr2=0x7f1014064140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.169+0000 7f10193ff700 1 -- 172.21.15.72:0/2255346643 shutdown_connections 2023-08-31T18:48:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.169+0000 7f10193ff700 1 -- 172.21.15.72:0/2255346643 wait complete. 2023-08-31T18:48:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-08-31T18:48:38.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T18:48:38.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.374+0000 7f36b85ff700 1 Processor -- start 2023-08-31T18:48:38.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.374+0000 7f36b85ff700 1 -- start start 2023-08-31T18:48:38.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.375+0000 7f36b85ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36b0154060 0x7f36b0157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:38.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.375+0000 7f36b85ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36b00cb9b0 0x7f36b01581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.375+0000 7f36b85ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b00c6120 con 0x7f36b01586b0 2023-08-31T18:48:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.375+0000 7f36b85ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b00c1380 con 0x7f36b0154060 2023-08-31T18:48:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.375+0000 7f36b85ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b00c5e10 con 0x7f36b00cb9b0 2023-08-31T18:48:38.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.376+0000 7f36b639b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36b0154060 0x7f36b0157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:38.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.376+0000 7f36b639b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36b0154060 0x7f36b0157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60888/0 (socket says 172.21.15.72:60888) 2023-08-31T18:48:38.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.376+0000 7f36b6b9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f36b01586b0 0x7f36b00c65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55458/0 (socket says 172.21.15.72:55458) 2023-08-31T18:48:38.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.376+0000 7f36b639b700 1 -- 172.21.15.72:0/2031807179 learned_addr learned my addr 172.21.15.72:0/2031807179 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:38.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.376+0000 7f36b5b9a700 1 --2- 172.21.15.72:0/2031807179 >> v2:172.21.15.146:3300/0 conn(0x7f36b00cb9b0 0x7f36b01581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:38.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.376+0000 7f36b639b700 1 -- 172.21.15.72:0/2031807179 >> v2:172.21.15.146:3300/0 conn(0x7f36b00cb9b0 msgr2=0x7f36b01581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:38.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.376+0000 7f36b639b700 1 --2- 172.21.15.72:0/2031807179 >> v2:172.21.15.146:3300/0 conn(0x7f36b00cb9b0 0x7f36b01581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.376+0000 7f36b639b700 1 -- 172.21.15.72:0/2031807179 >> v1:172.21.15.72:6789/0 conn(0x7f36b01586b0 legacy=0x7f36b00c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:38.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.376+0000 7f36b639b700 1 -- 172.21.15.72:0/2031807179 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b0158b00 con 0x7f36b0154060 2023-08-31T18:48:38.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.376+0000 7f36b639b700 1 --2- 172.21.15.72:0/2031807179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36b0154060 0x7f36b0157cd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f36b0083190 tx=0x7f36ac009060).ready entity=mon.0 client_cookie=b79467cb8205ecd2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:38.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.377+0000 7f36b5399700 1 -- 172.21.15.72:0/2031807179 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac005880 con 0x7f36b0154060 2023-08-31T18:48:38.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.377+0000 7f36b5399700 1 -- 172.21.15.72:0/2031807179 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac0059e0 con 0x7f36b0154060 2023-08-31T18:48:38.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.377+0000 7f36b5399700 1 -- 172.21.15.72:0/2031807179 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac005d60 con 0x7f36b0154060 2023-08-31T18:48:38.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.378+0000 7f36b85ff700 1 -- 172.21.15.72:0/2031807179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36b0154060 msgr2=0x7f36b0157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:38.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.378+0000 7f36b85ff700 1 --2- 172.21.15.72:0/2031807179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36b0154060 0x7f36b0157cd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f36b0083190 tx=0x7f36ac009060).stop 2023-08-31T18:48:38.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.378+0000 7f36b85ff700 1 -- 172.21.15.72:0/2031807179 shutdown_connections 2023-08-31T18:48:38.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.378+0000 7f36b85ff700 1 --2- 172.21.15.72:0/2031807179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36b0154060 0x7f36b0157cd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.378+0000 7f36b85ff700 1 --2- 172.21.15.72:0/2031807179 >> v2:172.21.15.146:3300/0 conn(0x7f36b00cb9b0 0x7f36b01581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.378+0000 7f36b85ff700 1 -- 172.21.15.72:0/2031807179 >> 172.21.15.72:0/2031807179 conn(0x7f36b005e870 msgr2=0x7f36b00cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:38.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.378+0000 7f36b85ff700 1 -- 172.21.15.72:0/2031807179 shutdown_connections 2023-08-31T18:48:38.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.378+0000 7f36b85ff700 1 -- 172.21.15.72:0/2031807179 wait complete. 2023-08-31T18:48:38.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.379+0000 7f36b85ff700 1 Processor -- start 2023-08-31T18:48:38.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.379+0000 7f36b85ff700 1 -- start start 2023-08-31T18:48:38.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.380+0000 7f36b85ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36b00cb9b0 0x7f36b0156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:38.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.380+0000 7f36b85ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36b0154060 0x7f36b00ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:38.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.380+0000 7f36b85ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36b01586b0 0x7f36b0151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:38.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.380+0000 7f36b85ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00aaed0 con 0x7f36b0154060 2023-08-31T18:48:38.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.380+0000 7f36b85ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b0157280 con 0x7f36b01586b0 2023-08-31T18:48:38.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.380+0000 7f36b85ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b0157560 con 0x7f36b00cb9b0 2023-08-31T18:48:38.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.381+0000 7f36b5b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36b0154060 0x7f36b00ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:38.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.381+0000 7f36b5b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36b0154060 0x7f36b00ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60900/0 (socket says 172.21.15.72:60900) 2023-08-31T18:48:38.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.381+0000 7f36b5b9a700 1 -- 172.21.15.72:0/2968617895 learned_addr learned my addr 172.21.15.72:0/2968617895 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:38.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.381+0000 7f36b6b9c700 1 --2- 172.21.15.72:0/2968617895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36b01586b0 0x7f36b0151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:38.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.381+0000 7f36b639b700 1 --2- 172.21.15.72:0/2968617895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36b00cb9b0 0x7f36b0156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:38.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.381+0000 7f36b5b9a700 1 -- 172.21.15.72:0/2968617895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36b00cb9b0 msgr2=0x7f36b0156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:38.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.381+0000 7f36b5b9a700 1 --2- 172.21.15.72:0/2968617895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36b00cb9b0 0x7f36b0156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.381+0000 7f36b5b9a700 1 -- 172.21.15.72:0/2968617895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36b01586b0 msgr2=0x7f36b0151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:38.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.381+0000 7f36b5b9a700 1 --2- 172.21.15.72:0/2968617895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36b01586b0 0x7f36b0151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.381+0000 7f36b5b9a700 1 -- 172.21.15.72:0/2968617895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac009300 con 0x7f36b0154060 2023-08-31T18:48:38.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.381+0000 7f36b5b9a700 1 --2- 172.21.15.72:0/2968617895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36b0154060 0x7f36b00ca9a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f36a000e930 tx=0x7f36a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.381+0000 7f36a67fc700 1 -- 172.21.15.72:0/2968617895 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a000eed0 con 0x7f36b0154060 2023-08-31T18:48:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.382+0000 7f36a67fc700 1 -- 172.21.15.72:0/2968617895 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a000c850 con 0x7f36b0154060 2023-08-31T18:48:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.382+0000 7f36a67fc700 1 -- 172.21.15.72:0/2968617895 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a000cbd0 con 0x7f36b0154060 2023-08-31T18:48:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.382+0000 7f36b85ff700 1 -- 172.21.15.72:0/2968617895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b0157840 con 0x7f36b0154060 2023-08-31T18:48:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.382+0000 7f36b85ff700 1 -- 172.21.15.72:0/2968617895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b00add40 con 0x7f36b0154060 2023-08-31T18:48:38.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.383+0000 7f36b85ff700 1 -- 172.21.15.72:0/2968617895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b00aacc0 con 0x7f36b0154060 2023-08-31T18:48:38.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.383+0000 7f36a67fc700 1 -- 172.21.15.72:0/2968617895 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f36a001b400 con 0x7f36b0154060 2023-08-31T18:48:38.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.384+0000 7f36a67fc700 1 --2- 172.21.15.72:0/2968617895 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f369405ede0 0x7f36940612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:38.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.384+0000 7f36a67fc700 1 -- 172.21.15.72:0/2968617895 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f36a007a420 con 0x7f36b0154060 2023-08-31T18:48:38.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.384+0000 7f36b639b700 1 --2- 172.21.15.72:0/2968617895 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f369405ede0 0x7f36940612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:38.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.385+0000 7f36b639b700 1 --2- 172.21.15.72:0/2968617895 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f369405ede0 0x7f36940612a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f36ac009fd0 tx=0x7f36ac016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:38.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.389+0000 7f36a67fc700 1 -- 172.21.15.72:0/2968617895 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f36a004b820 con 0x7f36b0154060 2023-08-31T18:48:38.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.600+0000 7f36b85ff700 1 -- 172.21.15.72:0/2968617895 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36b00adfc0 con 0x7f36b0154060 2023-08-31T18:48:38.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.600+0000 7f36a67fc700 1 -- 172.21.15.72:0/2968617895 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4483 (secure 0 0 0) 0x7f36a004ee40 con 0x7f36b0154060 2023-08-31T18:48:38.601 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:38.601 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/111391994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":111391994},{"type":"v1","addr":"172.21.15.72:6837","nonce":111391994}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/4001102603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":4001102603},{"type":"v1","addr":"172.21.15.146:6833","nonce":4001102603}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/522602179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":522602179},{"type":"v1","addr":"172.21.15.72:6835","nonce":522602179}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T18:47:52.970136+0000","modified":"2023-08-31T18:47:55.979886+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3888852190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3888852190},{"type":"v1","addr":"172.21.15.146:6835","nonce":3888852190}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-31T18:48:38.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.602+0000 7f36b85ff700 1 -- 172.21.15.72:0/2968617895 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f369405ede0 msgr2=0x7f36940612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:38.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.602+0000 7f36b85ff700 1 --2- 172.21.15.72:0/2968617895 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f369405ede0 0x7f36940612a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f36ac009fd0 tx=0x7f36ac016000).stop 2023-08-31T18:48:38.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.602+0000 7f36b85ff700 1 -- 172.21.15.72:0/2968617895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36b0154060 msgr2=0x7f36b00ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:38.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.602+0000 7f36b85ff700 1 --2- 172.21.15.72:0/2968617895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36b0154060 0x7f36b00ca9a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f36a000e930 tx=0x7f36a0009060).stop 2023-08-31T18:48:38.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.602+0000 7f36b85ff700 1 -- 172.21.15.72:0/2968617895 shutdown_connections 2023-08-31T18:48:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.602+0000 7f36b85ff700 1 --2- 172.21.15.72:0/2968617895 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f369405ede0 0x7f36940612a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.602+0000 7f36b85ff700 1 --2- 172.21.15.72:0/2968617895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36b01586b0 0x7f36b0151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.602+0000 7f36b85ff700 1 --2- 172.21.15.72:0/2968617895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36b00cb9b0 0x7f36b0156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.602+0000 7f36b85ff700 1 --2- 172.21.15.72:0/2968617895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36b0154060 0x7f36b00ca9a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.602+0000 7f36b85ff700 1 -- 172.21.15.72:0/2968617895 >> 172.21.15.72:0/2968617895 conn(0x7f36b005e870 msgr2=0x7f36b00c01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:38.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.602+0000 7f36b85ff700 1 -- 172.21.15.72:0/2968617895 shutdown_connections 2023-08-31T18:48:38.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.603+0000 7f36b85ff700 1 -- 172.21.15.72:0/2968617895 wait complete. 2023-08-31T18:48:38.605 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-08-31T18:48:38.620 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:48:38.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.808+0000 7f2de23ff700 1 Processor -- start 2023-08-31T18:48:38.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.808+0000 7f2de23ff700 1 -- start start 2023-08-31T18:48:38.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.809+0000 7f2de23ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2ddc0c9ca0 0x7f2ddc1583f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:38.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.810+0000 7f2de23ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ddc0c7620 con 0x7f2ddc1588e0 2023-08-31T18:48:38.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.810+0000 7f2de23ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ddc0c0830 con 0x7f2ddc1575b0 2023-08-31T18:48:38.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.810+0000 7f2de23ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ddc0c0b10 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.810+0000 7f2ddb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2ddc0c9ca0 0x7f2ddc1583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:38.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.810+0000 7f2de099c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2ddc1588e0 0x7f2ddc0c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55468/0 (socket says 172.21.15.72:55468) 2023-08-31T18:48:38.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.810+0000 7f2de099c700 1 -- 172.21.15.72:0/901175364 learned_addr learned my addr 172.21.15.72:0/901175364 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.810+0000 7f2ddb7fe700 1 -- 172.21.15.72:0/901175364 >> v1:172.21.15.146:6789/0 conn(0x7f2ddc1575b0 legacy=0x7f2ddc157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.810+0000 7f2ddb7fe700 1 -- 172.21.15.72:0/901175364 >> v1:172.21.15.72:6789/0 conn(0x7f2ddc1588e0 legacy=0x7f2ddc0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:38.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.810+0000 7f2ddb7fe700 1 -- 172.21.15.72:0/901175364 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc0c0df0 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.810+0000 7f2ddaffd700 1 -- 172.21.15.72:0/901175364 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381902361 0 0) 0x7f2ddc0c7620 con 0x7f2ddc1588e0 2023-08-31T18:48:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.811+0000 7f2ddb7fe700 1 --2- 172.21.15.72:0/901175364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ddc0c9ca0 0x7f2ddc1583f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f2dd0009760 tx=0x7f2dd0009060).ready entity=mon.0 client_cookie=512b4ba01e38161b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.811+0000 7f2ddaffd700 1 -- 172.21.15.72:0/901175364 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd000b580 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.811+0000 7f2ddaffd700 1 -- 172.21.15.72:0/901175364 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd000b6e0 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.811+0000 7f2ddaffd700 1 -- 172.21.15.72:0/901175364 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd000ba60 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.811+0000 7f2de23ff700 1 -- 172.21.15.72:0/901175364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ddc0c9ca0 msgr2=0x7f2ddc1583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.811+0000 7f2de23ff700 1 --2- 172.21.15.72:0/901175364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ddc0c9ca0 0x7f2ddc1583f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f2dd0009760 tx=0x7f2dd0009060).stop 2023-08-31T18:48:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.811+0000 7f2de23ff700 1 -- 172.21.15.72:0/901175364 shutdown_connections 2023-08-31T18:48:38.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.811+0000 7f2de23ff700 1 --2- 172.21.15.72:0/901175364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ddc0c9ca0 0x7f2ddc1583f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.811+0000 7f2de23ff700 1 -- 172.21.15.72:0/901175364 >> 172.21.15.72:0/901175364 conn(0x7f2ddc05e870 msgr2=0x7f2ddc0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.811+0000 7f2de23ff700 1 -- 172.21.15.72:0/901175364 shutdown_connections 2023-08-31T18:48:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.811+0000 7f2de23ff700 1 -- 172.21.15.72:0/901175364 wait complete. 2023-08-31T18:48:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.813+0000 7f2de23ff700 1 Processor -- start 2023-08-31T18:48:38.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.813+0000 7f2de23ff700 1 -- start start 2023-08-31T18:48:38.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.814+0000 7f2de23ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ddc0c9ca0 0x7f2ddc0ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:38.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.814+0000 7f2de23ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ddc1575b0 0x7f2ddc0af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:38.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.814+0000 7f2de23ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ddc1588e0 0x7f2ddc0c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:38.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.814+0000 7f2de23ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc0ac9c0 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.814+0000 7f2de23ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc0ac040 con 0x7f2ddc1588e0 2023-08-31T18:48:38.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.814+0000 7f2de23ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc165620 con 0x7f2ddc1575b0 2023-08-31T18:48:38.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.814+0000 7f2ddbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ddc0c9ca0 0x7f2ddc0ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:38.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.814+0000 7f2ddbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ddc0c9ca0 0x7f2ddc0ac4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60922/0 (socket says 172.21.15.72:60922) 2023-08-31T18:48:38.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.814+0000 7f2ddbfff700 1 -- 172.21.15.72:0/941349102 learned_addr learned my addr 172.21.15.72:0/941349102 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:38.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.815+0000 7f2de099c700 1 --2- 172.21.15.72:0/941349102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ddc1588e0 0x7f2ddc0c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:38.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.815+0000 7f2ddb7fe700 1 --2- 172.21.15.72:0/941349102 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ddc1575b0 0x7f2ddc0af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:38.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.815+0000 7f2ddbfff700 1 -- 172.21.15.72:0/941349102 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ddc1575b0 msgr2=0x7f2ddc0af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:38.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.815+0000 7f2ddbfff700 1 --2- 172.21.15.72:0/941349102 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ddc1575b0 0x7f2ddc0af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.815+0000 7f2ddbfff700 1 -- 172.21.15.72:0/941349102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ddc1588e0 msgr2=0x7f2ddc0c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:38.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.815+0000 7f2ddbfff700 1 --2- 172.21.15.72:0/941349102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ddc1588e0 0x7f2ddc0c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.815+0000 7f2ddbfff700 1 -- 172.21.15.72:0/941349102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd00092a0 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.815+0000 7f2ddb7fe700 1 --2- 172.21.15.72:0/941349102 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ddc1575b0 0x7f2ddc0af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:38.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.815+0000 7f2ddbfff700 1 --2- 172.21.15.72:0/941349102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ddc0c9ca0 0x7f2ddc0ac4d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f2dcc00c4c0 tx=0x7f2dcc007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:38.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.815+0000 7f2dc3fff700 1 -- 172.21.15.72:0/941349102 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc007020 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.815+0000 7f2dc3fff700 1 -- 172.21.15.72:0/941349102 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc007180 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.815+0000 7f2de23ff700 1 -- 172.21.15.72:0/941349102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ddc0ab710 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.815+0000 7f2dc3fff700 1 -- 172.21.15.72:0/941349102 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc007520 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.815+0000 7f2de23ff700 1 -- 172.21.15.72:0/941349102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ddc0abcd0 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.816+0000 7f2de23ff700 1 -- 172.21.15.72:0/941349102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ddc0ac320 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.817+0000 7f2dc3fff700 1 -- 172.21.15.72:0/941349102 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f2dcc006900 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.818+0000 7f2dc3fff700 1 --2- 172.21.15.72:0/941349102 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2dc805ee10 0x7f2dc80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:38.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.819+0000 7f2dc3fff700 1 -- 172.21.15.72:0/941349102 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2dcc0799e0 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.819+0000 7f2ddb7fe700 1 --2- 172.21.15.72:0/941349102 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2dc805ee10 0x7f2dc80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:38.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.819+0000 7f2ddb7fe700 1 --2- 172.21.15.72:0/941349102 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2dc805ee10 0x7f2dc80612d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f2ddc083dd0 tx=0x7f2dd0017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:38.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.823+0000 7f2dc3fff700 1 -- 172.21.15.72:0/941349102 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2dcc04ad90 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.992+0000 7f2de23ff700 1 -- 172.21.15.72:0/941349102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ddc06c6b0 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.993+0000 7f2dc3fff700 1 -- 172.21.15.72:0/941349102 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17024 (secure 0 0 0) 0x7f2dcc04e3b0 con 0x7f2ddc0c9ca0 2023-08-31T18:48:38.994 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:38.994 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":21,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:47:53.972412+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:47:51.003304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-31T18:47:51.950765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:48:38.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.995+0000 7f2de23ff700 1 -- 172.21.15.72:0/941349102 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2dc805ee10 msgr2=0x7f2dc80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:38.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.995+0000 7f2de23ff700 1 --2- 172.21.15.72:0/941349102 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2dc805ee10 0x7f2dc80612d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f2ddc083dd0 tx=0x7f2dd0017000).stop 2023-08-31T18:48:38.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.995+0000 7f2de23ff700 1 -- 172.21.15.72:0/941349102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ddc0c9ca0 msgr2=0x7f2ddc0ac4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:38.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.995+0000 7f2de23ff700 1 --2- 172.21.15.72:0/941349102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ddc0c9ca0 0x7f2ddc0ac4d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f2dcc00c4c0 tx=0x7f2dcc007df0).stop 2023-08-31T18:48:38.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.996+0000 7f2de23ff700 1 -- 172.21.15.72:0/941349102 shutdown_connections 2023-08-31T18:48:38.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.996+0000 7f2de23ff700 1 --2- 172.21.15.72:0/941349102 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2dc805ee10 0x7f2dc80612d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.996+0000 7f2de23ff700 1 --2- 172.21.15.72:0/941349102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ddc1588e0 0x7f2ddc0c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.996+0000 7f2de23ff700 1 --2- 172.21.15.72:0/941349102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ddc0c9ca0 0x7f2ddc0ac4d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.996+0000 7f2de23ff700 1 --2- 172.21.15.72:0/941349102 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ddc1575b0 0x7f2ddc0af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:38.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.996+0000 7f2de23ff700 1 -- 172.21.15.72:0/941349102 >> 172.21.15.72:0/941349102 conn(0x7f2ddc05e870 msgr2=0x7f2ddc154890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:38.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.996+0000 7f2de23ff700 1 -- 172.21.15.72:0/941349102 shutdown_connections 2023-08-31T18:48:38.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:38.996+0000 7f2de23ff700 1 -- 172.21.15.72:0/941349102 wait complete. 2023-08-31T18:48:39.014 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T18:48:39.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.206+0000 7f0ddd9ff700 1 Processor -- start 2023-08-31T18:48:39.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.206+0000 7f0ddd9ff700 1 -- start start 2023-08-31T18:48:39.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.207+0000 7f0ddd9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0dd8153ca0 0x7f0dd8154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:39.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.207+0000 7f0ddd9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0dd80ca4f0 0x7f0dd8063100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:39.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.208+0000 7f0ddd9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd80c9450 con 0x7f0dd80c8ee0 2023-08-31T18:48:39.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.208+0000 7f0ddd9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd80c9730 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.208+0000 7f0ddd9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80c9a10 con 0x7f0dd8153ca0 2023-08-31T18:48:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.208+0000 7f0dd77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0dd80ca4f0 0x7f0dd8063100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.208+0000 7f0dd77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0dd80ca4f0 0x7f0dd8063100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60932/0 (socket says 172.21.15.72:60932) 2023-08-31T18:48:39.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.208+0000 7f0dd77fe700 1 -- 172.21.15.72:0/477591907 learned_addr learned my addr 172.21.15.72:0/477591907 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:39.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.208+0000 7f0dd6ffd700 1 --2- 172.21.15.72:0/477591907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0dd8153ca0 0x7f0dd8154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:39.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.208+0000 7f0dd77fe700 1 -- 172.21.15.72:0/477591907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0dd8153ca0 msgr2=0x7f0dd8154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:39.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.208+0000 7f0dd77fe700 1 --2- 172.21.15.72:0/477591907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0dd8153ca0 0x7f0dd8154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.208+0000 7f0dd77fe700 1 -- 172.21.15.72:0/477591907 >> v1:172.21.15.146:6789/0 conn(0x7f0dd80c8ee0 legacy=0x7f0dd8158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.208+0000 7f0dd77fe700 1 -- 172.21.15.72:0/477591907 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd80c9cf0 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.208+0000 7f0dd6ffd700 1 --2- 172.21.15.72:0/477591907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0dd8153ca0 0x7f0dd8154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.208+0000 7f0dd77fe700 1 --2- 172.21.15.72:0/477591907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dd80ca4f0 0x7f0dd8063100 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f0dd0009f20 tx=0x7f0dd0009840).ready entity=mon.0 client_cookie=22f7ab54d8446b17 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.209+0000 7f0dd5ffb700 1 -- 172.21.15.72:0/477591907 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000e070 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.209+0000 7f0dd5ffb700 1 -- 172.21.15.72:0/477591907 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd000ba40 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.209+0000 7f0dd5ffb700 1 -- 172.21.15.72:0/477591907 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000bdc0 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.209+0000 7f0ddd9ff700 1 -- 172.21.15.72:0/477591907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dd80ca4f0 msgr2=0x7f0dd8063100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:39.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.209+0000 7f0ddd9ff700 1 --2- 172.21.15.72:0/477591907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dd80ca4f0 0x7f0dd8063100 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f0dd0009f20 tx=0x7f0dd0009840).stop 2023-08-31T18:48:39.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.209+0000 7f0ddd9ff700 1 -- 172.21.15.72:0/477591907 shutdown_connections 2023-08-31T18:48:39.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.209+0000 7f0ddd9ff700 1 --2- 172.21.15.72:0/477591907 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0dd8153ca0 0x7f0dd8154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:39.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.209+0000 7f0ddd9ff700 1 --2- 172.21.15.72:0/477591907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dd80ca4f0 0x7f0dd8063100 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:39.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.209+0000 7f0ddd9ff700 1 -- 172.21.15.72:0/477591907 >> 172.21.15.72:0/477591907 conn(0x7f0dd80cadb0 msgr2=0x7f0dd80cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:39.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.209+0000 7f0ddd9ff700 1 -- 172.21.15.72:0/477591907 shutdown_connections 2023-08-31T18:48:39.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.209+0000 7f0ddd9ff700 1 -- 172.21.15.72:0/477591907 wait complete. 2023-08-31T18:48:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.211+0000 7f0ddd9ff700 1 Processor -- start 2023-08-31T18:48:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.211+0000 7f0ddd9ff700 1 -- start start 2023-08-31T18:48:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.212+0000 7f0ddd9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd80c8ee0 0x7f0dd814f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.212+0000 7f0ddd9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dd80ca4f0 0x7f0dd8154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.212+0000 7f0ddd9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0dd8153ca0 0x7f0dd80ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.212+0000 7f0ddd9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80c2df0 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.212+0000 7f0ddd9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80c3e90 con 0x7f0dd80c8ee0 2023-08-31T18:48:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.212+0000 7f0ddd9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80c3560 con 0x7f0dd8153ca0 2023-08-31T18:48:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.212+0000 7f0dd67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dd80ca4f0 0x7f0dd8154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.212+0000 7f0dd67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dd80ca4f0 0x7f0dd8154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60948/0 (socket says 172.21.15.72:60948) 2023-08-31T18:48:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.212+0000 7f0dd67fc700 1 -- 172.21.15.72:0/500027429 learned_addr learned my addr 172.21.15.72:0/500027429 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:39.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.212+0000 7f0dd6ffd700 1 --2- 172.21.15.72:0/500027429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd80c8ee0 0x7f0dd814f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:39.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.212+0000 7f0dd77fe700 1 --2- 172.21.15.72:0/500027429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0dd8153ca0 0x7f0dd80ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:39.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.213+0000 7f0dd67fc700 1 -- 172.21.15.72:0/500027429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0dd8153ca0 msgr2=0x7f0dd80ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:39.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.213+0000 7f0dd67fc700 1 --2- 172.21.15.72:0/500027429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0dd8153ca0 0x7f0dd80ac0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:39.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.213+0000 7f0dd67fc700 1 -- 172.21.15.72:0/500027429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd80c8ee0 msgr2=0x7f0dd814f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.213+0000 7f0dd67fc700 1 --2- 172.21.15.72:0/500027429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd80c8ee0 0x7f0dd814f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.213+0000 7f0dd67fc700 1 -- 172.21.15.72:0/500027429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd0009ae0 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.213+0000 7f0dd6ffd700 1 --2- 172.21.15.72:0/500027429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd80c8ee0 0x7f0dd814f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.213+0000 7f0dd67fc700 1 --2- 172.21.15.72:0/500027429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dd80ca4f0 0x7f0dd8154080 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f0dcc00c4c0 tx=0x7f0dcc007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.213+0000 7f0dbeffd700 1 -- 172.21.15.72:0/500027429 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc00f470 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.213+0000 7f0dbeffd700 1 -- 172.21.15.72:0/500027429 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc00f5d0 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.213+0000 7f0ddd9ff700 1 -- 172.21.15.72:0/500027429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd80c3840 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.213+0000 7f0dbeffd700 1 -- 172.21.15.72:0/500027429 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc00f990 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.213+0000 7f0ddd9ff700 1 -- 172.21.15.72:0/500027429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd814fe80 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.214+0000 7f0ddd9ff700 1 -- 172.21.15.72:0/500027429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd80c4020 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.215+0000 7f0dbeffd700 1 -- 172.21.15.72:0/500027429 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f0dcc012400 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.216+0000 7f0dbeffd700 1 --2- 172.21.15.72:0/500027429 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0dc405ee10 0x7f0dc40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:39.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.216+0000 7f0dbeffd700 1 -- 172.21.15.72:0/500027429 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0dcc0792a0 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.216+0000 7f0dd6ffd700 1 --2- 172.21.15.72:0/500027429 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0dc405ee10 0x7f0dc40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:39.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.216+0000 7f0dd6ffd700 1 --2- 172.21.15.72:0/500027429 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0dc405ee10 0x7f0dc40612d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f0dc8006fd0 tx=0x7f0dc8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:39.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.220+0000 7f0dbeffd700 1 -- 172.21.15.72:0/500027429 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0dcc0488f0 con 0x7f0dd80ca4f0 2023-08-31T18:48:39.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:39.439+0000 7f0ddd9ff700 1 -- 172.21.15.72:0/500027429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0dd806c6b0 con 0x7f0dd80ca4f0 2023-08-31T18:48:40.382 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-08-31T18:48:40.382+0000 7f89d2ff7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T18:48:40.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.390+0000 7f0dbeffd700 1 -- 172.21.15.72:0/500027429 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0dcc017070 con 0x7f0dd80ca4f0 2023-08-31T18:48:40.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.393+0000 7f0ddd9ff700 1 -- 172.21.15.72:0/500027429 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0dc405ee10 msgr2=0x7f0dc40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:40.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.393+0000 7f0ddd9ff700 1 --2- 172.21.15.72:0/500027429 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0dc405ee10 0x7f0dc40612d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f0dc8006fd0 tx=0x7f0dc8008040).stop 2023-08-31T18:48:40.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.393+0000 7f0ddd9ff700 1 -- 172.21.15.72:0/500027429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dd80ca4f0 msgr2=0x7f0dd8154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:40.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.393+0000 7f0ddd9ff700 1 --2- 172.21.15.72:0/500027429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dd80ca4f0 0x7f0dd8154080 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f0dcc00c4c0 tx=0x7f0dcc007db0).stop 2023-08-31T18:48:40.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.393+0000 7f0ddd9ff700 1 -- 172.21.15.72:0/500027429 shutdown_connections 2023-08-31T18:48:40.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.393+0000 7f0ddd9ff700 1 --2- 172.21.15.72:0/500027429 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0dd8153ca0 0x7f0dd80ac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:40.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.393+0000 7f0ddd9ff700 1 --2- 172.21.15.72:0/500027429 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0dc405ee10 0x7f0dc40612d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:40.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.393+0000 7f0ddd9ff700 1 --2- 172.21.15.72:0/500027429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0dd80c8ee0 0x7f0dd814f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:40.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.393+0000 7f0ddd9ff700 1 --2- 172.21.15.72:0/500027429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dd80ca4f0 0x7f0dd8154080 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:40.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.394+0000 7f0ddd9ff700 1 -- 172.21.15.72:0/500027429 >> 172.21.15.72:0/500027429 conn(0x7f0dd80cadb0 msgr2=0x7f0dd8150130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:40.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.394+0000 7f0ddd9ff700 1 -- 172.21.15.72:0/500027429 shutdown_connections 2023-08-31T18:48:40.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.394+0000 7f0ddd9ff700 1 -- 172.21.15.72:0/500027429 wait complete. 2023-08-31T18:48:40.397 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T18:48:40.399 INFO:tasks.ceph.mds.d.smithi146.stderr: -2271> 2023-08-31T18:47:53.485+0000 7fe69cff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T18:48:40.414 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T18:48:40.441 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-08-31T18:48:40.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.611+0000 7feac69ff700 1 Processor -- start 2023-08-31T18:48:40.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.611+0000 7feac69ff700 1 -- start start 2023-08-31T18:48:40.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.613+0000 7feac69ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feac0153e30 0x7feac0154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:40.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.613+0000 7feac69ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac00637c0 0x7feac00c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:40.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.613+0000 7feac69ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac00bfd40 con 0x7feac00c5cb0 2023-08-31T18:48:40.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.613+0000 7feac69ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac00c6730 con 0x7feac0153e30 2023-08-31T18:48:40.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.613+0000 7feac69ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac00bffe0 con 0x7feac00637c0 2023-08-31T18:48:40.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.613+0000 7feabffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feac0153e30 0x7feac0154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:40.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.613+0000 7feabffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feac0153e30 0x7feac0154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60958/0 (socket says 172.21.15.72:60958) 2023-08-31T18:48:40.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.613+0000 7feabffff700 1 -- 172.21.15.72:0/2886799900 learned_addr learned my addr 172.21.15.72:0/2886799900 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:40.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.613+0000 7feac4f9c700 1 --2- 172.21.15.72:0/2886799900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac00637c0 0x7feac00c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:40.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.613+0000 7feabffff700 1 -- 172.21.15.72:0/2886799900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac00637c0 msgr2=0x7feac00c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:40.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.613+0000 7feabffff700 1 --2- 172.21.15.72:0/2886799900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac00637c0 0x7feac00c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:40.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.613+0000 7feabffff700 1 -- 172.21.15.72:0/2886799900 >> v1:172.21.15.146:6789/0 conn(0x7feac00c5cb0 legacy=0x7feac00630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:40.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.613+0000 7feabffff700 1 -- 172.21.15.72:0/2886799900 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac00c02c0 con 0x7feac0153e30 2023-08-31T18:48:40.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.614+0000 7feabffff700 1 --2- 172.21.15.72:0/2886799900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac0153e30 0x7feac0154210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7feab0006fd0 tx=0x7feab00090f0).ready entity=mon.0 client_cookie=a89a7c32ca38783b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:40.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.614+0000 7feabeffd700 1 -- 172.21.15.72:0/2886799900 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab000b600 con 0x7feac0153e30 2023-08-31T18:48:40.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.614+0000 7feabeffd700 1 -- 172.21.15.72:0/2886799900 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab000b760 con 0x7feac0153e30 2023-08-31T18:48:40.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.614+0000 7feabeffd700 1 -- 172.21.15.72:0/2886799900 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab000bb00 con 0x7feac0153e30 2023-08-31T18:48:40.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.614+0000 7feac69ff700 1 -- 172.21.15.72:0/2886799900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac0153e30 msgr2=0x7feac0154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:40.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.614+0000 7feac69ff700 1 --2- 172.21.15.72:0/2886799900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac0153e30 0x7feac0154210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7feab0006fd0 tx=0x7feab00090f0).stop 2023-08-31T18:48:40.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.614+0000 7feac69ff700 1 -- 172.21.15.72:0/2886799900 shutdown_connections 2023-08-31T18:48:40.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.614+0000 7feac69ff700 1 --2- 172.21.15.72:0/2886799900 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac00637c0 0x7feac00c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:40.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.614+0000 7feac69ff700 1 --2- 172.21.15.72:0/2886799900 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac0153e30 0x7feac0154210 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:40.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.614+0000 7feac69ff700 1 -- 172.21.15.72:0/2886799900 >> 172.21.15.72:0/2886799900 conn(0x7feac005eb20 msgr2=0x7feac00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:40.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.614+0000 7feac69ff700 1 -- 172.21.15.72:0/2886799900 shutdown_connections 2023-08-31T18:48:40.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.615+0000 7feac69ff700 1 -- 172.21.15.72:0/2886799900 wait complete. 2023-08-31T18:48:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.616+0000 7feac69ff700 1 Processor -- start 2023-08-31T18:48:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.616+0000 7feac69ff700 1 -- start start 2023-08-31T18:48:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.617+0000 7feac69ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feac00637c0 0x7feac00c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:40.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.617+0000 7feac69ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac00c5cb0 0x7feac014d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.617+0000 7feac69ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac0153e30 0x7feac00af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.617+0000 7feac69ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac00c27e0 con 0x7feac0153e30 2023-08-31T18:48:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.617+0000 7feac69ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac00c1f20 con 0x7feac00637c0 2023-08-31T18:48:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.617+0000 7feac69ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac00c2190 con 0x7feac00c5cb0 2023-08-31T18:48:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.617+0000 7feac4f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac0153e30 0x7feac00af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.617+0000 7feac4f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac0153e30 0x7feac00af2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60970/0 (socket says 172.21.15.72:60970) 2023-08-31T18:48:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.617+0000 7feac4f9c700 1 -- 172.21.15.72:0/39637756 learned_addr learned my addr 172.21.15.72:0/39637756 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.617+0000 7feabffff700 1 --2- 172.21.15.72:0/39637756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feac00637c0 0x7feac00c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.617+0000 7feabf7fe700 1 --2- 172.21.15.72:0/39637756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac00c5cb0 0x7feac014d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.618+0000 7feac4f9c700 1 -- 172.21.15.72:0/39637756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac00c5cb0 msgr2=0x7feac014d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.618+0000 7feac4f9c700 1 --2- 172.21.15.72:0/39637756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac00c5cb0 0x7feac014d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.618+0000 7feac4f9c700 1 -- 172.21.15.72:0/39637756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feac00637c0 msgr2=0x7feac00c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.618+0000 7feac4f9c700 1 --2- 172.21.15.72:0/39637756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feac00637c0 0x7feac00c2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.618+0000 7feac4f9c700 1 -- 172.21.15.72:0/39637756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab0009370 con 0x7feac0153e30 2023-08-31T18:48:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.618+0000 7feac4f9c700 1 --2- 172.21.15.72:0/39637756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac0153e30 0x7feac00af2b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7feab8007f50 tx=0x7feab80098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:40.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.618+0000 7feaa7fff700 1 -- 172.21.15.72:0/39637756 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab800eb70 con 0x7feac0153e30 2023-08-31T18:48:40.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.618+0000 7feaa7fff700 1 -- 172.21.15.72:0/39637756 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab800ecd0 con 0x7feac0153e30 2023-08-31T18:48:40.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.618+0000 7feac69ff700 1 -- 172.21.15.72:0/39637756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac00c2470 con 0x7feac0153e30 2023-08-31T18:48:40.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.618+0000 7feaa7fff700 1 -- 172.21.15.72:0/39637756 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab8014610 con 0x7feac0153e30 2023-08-31T18:48:40.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.618+0000 7feac69ff700 1 -- 172.21.15.72:0/39637756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac014de00 con 0x7feac0153e30 2023-08-31T18:48:40.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.619+0000 7feac69ff700 1 -- 172.21.15.72:0/39637756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac00c2990 con 0x7feac0153e30 2023-08-31T18:48:40.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.620+0000 7feaa7fff700 1 -- 172.21.15.72:0/39637756 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7feab801d3b0 con 0x7feac0153e30 2023-08-31T18:48:40.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.621+0000 7feaa7fff700 1 --2- 172.21.15.72:0/39637756 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7feaac05ee40 0x7feaac061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:40.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.621+0000 7feaa7fff700 1 -- 172.21.15.72:0/39637756 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6381+0+0 (secure 0 0 0) 0x7feab807a320 con 0x7feac0153e30 2023-08-31T18:48:40.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.621+0000 7feabffff700 1 --2- 172.21.15.72:0/39637756 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7feaac05ee40 0x7feaac061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:40.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.622+0000 7feabffff700 1 --2- 172.21.15.72:0/39637756 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7feaac05ee40 0x7feaac061300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7feab000b3c0 tx=0x7feab0017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:40.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.625+0000 7feaa7fff700 1 -- 172.21.15.72:0/39637756 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feac00c2990 con 0x7feac0153e30 2023-08-31T18:48:40.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:40.833+0000 7feac69ff700 1 -- 172.21.15.72:0/39637756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7feac00c2990 con 0x7feac0153e30 2023-08-31T18:48:41.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.394+0000 7feaa7fff700 1 -- 172.21.15.72:0/39637756 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7feac00c2990 con 0x7feac0153e30 2023-08-31T18:48:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.396+0000 7feac69ff700 1 -- 172.21.15.72:0/39637756 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7feaac05ee40 msgr2=0x7feaac061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.396+0000 7feac69ff700 1 --2- 172.21.15.72:0/39637756 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7feaac05ee40 0x7feaac061300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7feab000b3c0 tx=0x7feab0017000).stop 2023-08-31T18:48:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.396+0000 7feac69ff700 1 -- 172.21.15.72:0/39637756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac0153e30 msgr2=0x7feac00af2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.396+0000 7feac69ff700 1 --2- 172.21.15.72:0/39637756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac0153e30 0x7feac00af2b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7feab8007f50 tx=0x7feab80098a0).stop 2023-08-31T18:48:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.396+0000 7feac69ff700 1 -- 172.21.15.72:0/39637756 shutdown_connections 2023-08-31T18:48:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.396+0000 7feac69ff700 1 --2- 172.21.15.72:0/39637756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac0153e30 0x7feac00af2b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.396+0000 7feac69ff700 1 --2- 172.21.15.72:0/39637756 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7feaac05ee40 0x7feaac061300 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.396+0000 7feac69ff700 1 --2- 172.21.15.72:0/39637756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feac00637c0 0x7feac00c2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.396+0000 7feac69ff700 1 --2- 172.21.15.72:0/39637756 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feac00c5cb0 0x7feac014d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.396+0000 7feac69ff700 1 -- 172.21.15.72:0/39637756 >> 172.21.15.72:0/39637756 conn(0x7feac005eb20 msgr2=0x7feac00ab930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.396+0000 7feac69ff700 1 -- 172.21.15.72:0/39637756 shutdown_connections 2023-08-31T18:48:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.396+0000 7feac69ff700 1 -- 172.21.15.72:0/39637756 wait complete. 2023-08-31T18:48:41.415 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T18:48:41.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.606+0000 7f6cf87ff700 1 Processor -- start 2023-08-31T18:48:41.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.606+0000 7f6cf87ff700 1 -- start start 2023-08-31T18:48:41.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.608+0000 7f6cf87ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf0154120 0x7f6cf00a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:41.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.608+0000 7f6cf87ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6cf0064db0 0x7f6cf015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:41.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.608+0000 7f6cf87ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf00aa620 con 0x7f6cf0154500 2023-08-31T18:48:41.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.608+0000 7f6cf87ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf00aa3a0 con 0x7f6cf0064db0 2023-08-31T18:48:41.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.608+0000 7f6cf87ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf00c5450 con 0x7f6cf0154120 2023-08-31T18:48:41.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.608+0000 7f6cf6d9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6cf0064db0 0x7f6cf015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:41.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.608+0000 7f6cf659b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf0154120 0x7f6cf00a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:41.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.608+0000 7f6cf659b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf0154120 0x7f6cf00a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:48288/0 (socket says 172.21.15.72:48288) 2023-08-31T18:48:41.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.608+0000 7f6cf5d9a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6cf0154500 0x7f6cf00646a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:55428/0 (socket says 172.21.15.72:55428) 2023-08-31T18:48:41.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.608+0000 7f6cf6d9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6cf0064db0 0x7f6cf015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:39088/0 (socket says 172.21.15.72:39088) 2023-08-31T18:48:41.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.609+0000 7f6cf659b700 1 -- 172.21.15.72:0/2101188222 learned_addr learned my addr 172.21.15.72:0/2101188222 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:41.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.609+0000 7f6cf6d9c700 1 -- 172.21.15.72:0/2101188222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf0154120 msgr2=0x7f6cf00a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:41.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.609+0000 7f6cf6d9c700 1 --2- 172.21.15.72:0/2101188222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf0154120 0x7f6cf00a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:41.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.609+0000 7f6cf6d9c700 1 -- 172.21.15.72:0/2101188222 >> v1:172.21.15.146:6789/0 conn(0x7f6cf0154500 legacy=0x7f6cf00646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:41.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.609+0000 7f6cf6d9c700 1 -- 172.21.15.72:0/2101188222 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf00c8050 con 0x7f6cf0064db0 2023-08-31T18:48:41.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.609+0000 7f6cf659b700 1 --2- 172.21.15.72:0/2101188222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf0154120 0x7f6cf00a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:41.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.609+0000 7f6cf5599700 1 -- 172.21.15.72:0/2101188222 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375231335 0 0) 0x7f6cf00aa620 con 0x7f6cf0154500 2023-08-31T18:48:41.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.609+0000 7f6cf6d9c700 1 --2- 172.21.15.72:0/2101188222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf0064db0 0x7f6cf015dec0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6ce8009e60 tx=0x7f6ce8009780).ready entity=mon.1 client_cookie=6b0772ebbff8774 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.609+0000 7f6cf5599700 1 -- 172.21.15.72:0/2101188222 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce800e070 con 0x7f6cf0064db0 2023-08-31T18:48:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.610+0000 7f6cf5599700 1 -- 172.21.15.72:0/2101188222 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce800bb60 con 0x7f6cf0064db0 2023-08-31T18:48:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.610+0000 7f6cf5599700 1 -- 172.21.15.72:0/2101188222 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8012410 con 0x7f6cf0064db0 2023-08-31T18:48:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.610+0000 7f6cf87ff700 1 -- 172.21.15.72:0/2101188222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf0064db0 msgr2=0x7f6cf015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.610+0000 7f6cf87ff700 1 --2- 172.21.15.72:0/2101188222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf0064db0 0x7f6cf015dec0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6ce8009e60 tx=0x7f6ce8009780).stop 2023-08-31T18:48:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.610+0000 7f6cf87ff700 1 -- 172.21.15.72:0/2101188222 shutdown_connections 2023-08-31T18:48:41.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.610+0000 7f6cf87ff700 1 --2- 172.21.15.72:0/2101188222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf0064db0 0x7f6cf015dec0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:41.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.610+0000 7f6cf87ff700 1 --2- 172.21.15.72:0/2101188222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf0154120 0x7f6cf00a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:41.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.610+0000 7f6cf87ff700 1 -- 172.21.15.72:0/2101188222 >> 172.21.15.72:0/2101188222 conn(0x7f6cf00cb7e0 msgr2=0x7f6cf00c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:41.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.610+0000 7f6cf87ff700 1 -- 172.21.15.72:0/2101188222 shutdown_connections 2023-08-31T18:48:41.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.610+0000 7f6cf87ff700 1 -- 172.21.15.72:0/2101188222 wait complete. 2023-08-31T18:48:41.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.612+0000 7f6cf87ff700 1 Processor -- start 2023-08-31T18:48:41.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.612+0000 7f6cf87ff700 1 -- start start 2023-08-31T18:48:41.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf87ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf0064db0 0x7f6cf0167b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf87ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cf0154120 0x7f6cf014ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf87ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf0154500 0x7f6cf014b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf87ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf0168a10 con 0x7f6cf0154120 2023-08-31T18:48:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf87ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf01646d0 con 0x7f6cf0064db0 2023-08-31T18:48:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf87ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf01504a0 con 0x7f6cf0154500 2023-08-31T18:48:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf5d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cf0154120 0x7f6cf014ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf5d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cf0154120 0x7f6cf014ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60980/0 (socket says 172.21.15.72:60980) 2023-08-31T18:48:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf5d9a700 1 -- 172.21.15.72:0/4220897067 learned_addr learned my addr 172.21.15.72:0/4220897067 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf659b700 1 --2- 172.21.15.72:0/4220897067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf0064db0 0x7f6cf0167b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf6d9c700 1 --2- 172.21.15.72:0/4220897067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf0154500 0x7f6cf014b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf5d9a700 1 -- 172.21.15.72:0/4220897067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf0154500 msgr2=0x7f6cf014b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf5d9a700 1 --2- 172.21.15.72:0/4220897067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf0154500 0x7f6cf014b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf5d9a700 1 -- 172.21.15.72:0/4220897067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf0064db0 msgr2=0x7f6cf0167b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf5d9a700 1 --2- 172.21.15.72:0/4220897067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf0064db0 0x7f6cf0167b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf5d9a700 1 -- 172.21.15.72:0/4220897067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec009370 con 0x7f6cf0154120 2023-08-31T18:48:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf6d9c700 1 --2- 172.21.15.72:0/4220897067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf0154500 0x7f6cf014b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.613+0000 7f6cf5d9a700 1 --2- 172.21.15.72:0/4220897067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cf0154120 0x7f6cf014ffb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f6ce000c490 tx=0x7f6ce0007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.614+0000 7f6ce67fc700 1 -- 172.21.15.72:0/4220897067 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00072e0 con 0x7f6cf0154120 2023-08-31T18:48:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.614+0000 7f6ce67fc700 1 -- 172.21.15.72:0/4220897067 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce0007460 con 0x7f6cf0154120 2023-08-31T18:48:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.614+0000 7f6cf87ff700 1 -- 172.21.15.72:0/4220897067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce8009a20 con 0x7f6cf0154120 2023-08-31T18:48:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.614+0000 7f6ce67fc700 1 -- 172.21.15.72:0/4220897067 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0005930 con 0x7f6cf0154120 2023-08-31T18:48:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.614+0000 7f6cf87ff700 1 -- 172.21.15.72:0/4220897067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf0168450 con 0x7f6cf0154120 2023-08-31T18:48:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.615+0000 7f6cf87ff700 1 -- 172.21.15.72:0/4220897067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf006a7e0 con 0x7f6cf0154120 2023-08-31T18:48:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.616+0000 7f6ce67fc700 1 -- 172.21.15.72:0/4220897067 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f6ce0005d20 con 0x7f6cf0154120 2023-08-31T18:48:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.616+0000 7f6ce67fc700 1 --2- 172.21.15.72:0/4220897067 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cd405ee10 0x7f6cd40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.616+0000 7f6ce67fc700 1 -- 172.21.15.72:0/4220897067 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f6ce0079700 con 0x7f6cf0154120 2023-08-31T18:48:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.617+0000 7f6cf659b700 1 --2- 172.21.15.72:0/4220897067 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cd405ee10 0x7f6cd40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.617+0000 7f6cf659b700 1 --2- 172.21.15.72:0/4220897067 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cd405ee10 0x7f6cd40612d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f6cec009340 tx=0x7f6cec008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.620+0000 7f6ce67fc700 1 -- 172.21.15.72:0/4220897067 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6ce004aa60 con 0x7f6cf0154120 2023-08-31T18:48:41.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:41.790+0000 7f6cf87ff700 1 -- 172.21.15.72:0/4220897067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6cf006c6b0 con 0x7f6cf0154120 2023-08-31T18:48:42.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.396+0000 7f6ce67fc700 1 -- 172.21.15.72:0/4220897067 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6ce004e080 con 0x7f6cf0154120 2023-08-31T18:48:42.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.401+0000 7f6cf87ff700 1 -- 172.21.15.72:0/4220897067 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cd405ee10 msgr2=0x7f6cd40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:42.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.401+0000 7f6cf87ff700 1 --2- 172.21.15.72:0/4220897067 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cd405ee10 0x7f6cd40612d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f6cec009340 tx=0x7f6cec008040).stop 2023-08-31T18:48:42.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.401+0000 7f6cf87ff700 1 -- 172.21.15.72:0/4220897067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cf0154120 msgr2=0x7f6cf014ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:42.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.401+0000 7f6cf87ff700 1 --2- 172.21.15.72:0/4220897067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cf0154120 0x7f6cf014ffb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f6ce000c490 tx=0x7f6ce0007da0).stop 2023-08-31T18:48:42.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.401+0000 7f6cf87ff700 1 -- 172.21.15.72:0/4220897067 shutdown_connections 2023-08-31T18:48:42.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.401+0000 7f6cf87ff700 1 --2- 172.21.15.72:0/4220897067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf0154500 0x7f6cf014b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:42.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.401+0000 7f6cf87ff700 1 --2- 172.21.15.72:0/4220897067 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cd405ee10 0x7f6cd40612d0 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0x7f6cec009340 tx=0x7f6cec008040).stop 2023-08-31T18:48:42.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.401+0000 7f6cf87ff700 1 --2- 172.21.15.72:0/4220897067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6cf0064db0 0x7f6cf0167b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:42.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.401+0000 7f6cf87ff700 1 --2- 172.21.15.72:0/4220897067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cf0154120 0x7f6cf014ffb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:42.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.401+0000 7f6cf87ff700 1 -- 172.21.15.72:0/4220897067 >> 172.21.15.72:0/4220897067 conn(0x7f6cf00cb7e0 msgr2=0x7f6cf00c9500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:42.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.402+0000 7f6cf87ff700 1 -- 172.21.15.72:0/4220897067 shutdown_connections 2023-08-31T18:48:42.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.402+0000 7f6cf87ff700 1 -- 172.21.15.72:0/4220897067 wait complete. 2023-08-31T18:48:42.404 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-08-31T18:48:42.424 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T18:48:42.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.618+0000 7f8a387ff700 1 Processor -- start 2023-08-31T18:48:42.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.618+0000 7f8a387ff700 1 -- start start 2023-08-31T18:48:42.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.619+0000 7f8a387ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8a30154500 0x7f8a300a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:42.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.619+0000 7f8a387ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a300aa620 con 0x7f8a30154120 2023-08-31T18:48:42.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.619+0000 7f8a387ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a300aa3a0 con 0x7f8a30064db0 2023-08-31T18:48:42.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.619+0000 7f8a387ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a300c5450 con 0x7f8a30154500 2023-08-31T18:48:42.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.619+0000 7f8a3659b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8a30154120 0x7f8a300646a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55476/0 (socket says 172.21.15.72:55476) 2023-08-31T18:48:42.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.619+0000 7f8a3659b700 1 -- 172.21.15.72:0/3343160327 learned_addr learned my addr 172.21.15.72:0/3343160327 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:42.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a36d9c700 1 --2- 172.21.15.72:0/3343160327 >> v2:172.21.15.146:3300/0 conn(0x7f8a30154500 0x7f8a300a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:42.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a35599700 1 -- 172.21.15.72:0/3343160327 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141476011 0 0) 0x7f8a300aa620 con 0x7f8a30154120 2023-08-31T18:48:42.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a35599700 1 -- 172.21.15.72:0/3343160327 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a1c0033f0 con 0x7f8a30154120 2023-08-31T18:48:42.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a35599700 1 -- 172.21.15.72:0/3343160327 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2014874450 0 0) 0x7f8a1c0033f0 con 0x7f8a30154120 2023-08-31T18:48:42.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a35599700 1 -- 172.21.15.72:0/3343160327 >> v2:172.21.15.146:3300/0 conn(0x7f8a30154500 msgr2=0x7f8a300a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:42.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a35599700 1 --2- 172.21.15.72:0/3343160327 >> v2:172.21.15.146:3300/0 conn(0x7f8a30154500 0x7f8a300a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:42.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a35599700 1 -- 172.21.15.72:0/3343160327 >> v1:172.21.15.146:6789/0 conn(0x7f8a30064db0 legacy=0x7f8a3015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:42.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a35599700 1 -- 172.21.15.72:0/3343160327 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a300c8050 con 0x7f8a30154120 2023-08-31T18:48:42.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a35599700 1 -- 172.21.15.72:0/3343160327 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f8a2c001470 con 0x7f8a30154120 2023-08-31T18:48:42.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a35599700 1 -- 172.21.15.72:0/3343160327 >> v1:172.21.15.72:6789/0 conn(0x7f8a30154120 legacy=0x7f8a300646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:42.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a35599700 1 --2- 172.21.15.72:0/3343160327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8a1c0038e0 0x7f8a1c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:42.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a35599700 1 --2- 172.21.15.72:0/3343160327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a1c004690 0x7f8a1c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:42.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a35599700 1 --2- 172.21.15.72:0/3343160327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1c005050 0x7f8a1c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:42.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a35599700 1 -- 172.21.15.72:0/3343160327 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300c5450 con 0x7f8a1c005050 2023-08-31T18:48:42.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a35599700 1 -- 172.21.15.72:0/3343160327 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c00bfe0 con 0x7f8a1c004690 2023-08-31T18:48:42.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a35599700 1 -- 172.21.15.72:0/3343160327 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c00c1a0 con 0x7f8a1c0038e0 2023-08-31T18:48:42.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.620+0000 7f8a36d9c700 1 --2- 172.21.15.72:0/3343160327 >> v2:172.21.15.146:3300/0 conn(0x7f8a30154500 0x7f8a300a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:42.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.621+0000 7f8a36d9c700 1 --2- 172.21.15.72:0/3343160327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1c005050 0x7f8a1c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:42.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.621+0000 7f8a3659b700 1 --2- 172.21.15.72:0/3343160327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8a1c0038e0 0x7f8a1c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:42.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.621+0000 7f8a35d9a700 1 --2- 172.21.15.72:0/3343160327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a1c004690 0x7f8a1c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:42.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.621+0000 7f8a36d9c700 1 -- 172.21.15.72:0/3343160327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8a1c0038e0 msgr2=0x7f8a1c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:42.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.621+0000 7f8a36d9c700 1 --2- 172.21.15.72:0/3343160327 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8a1c0038e0 0x7f8a1c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:42.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.621+0000 7f8a36d9c700 1 -- 172.21.15.72:0/3343160327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a1c004690 msgr2=0x7f8a1c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:42.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.621+0000 7f8a36d9c700 1 --2- 172.21.15.72:0/3343160327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a1c004690 0x7f8a1c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:42.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.621+0000 7f8a36d9c700 1 -- 172.21.15.72:0/3343160327 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c0033f0 con 0x7f8a1c005050 2023-08-31T18:48:42.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.621+0000 7f8a36d9c700 1 -- 172.21.15.72:0/3343160327 reap_dead start 2023-08-31T18:48:42.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.621+0000 7f8a36d9c700 1 --2- 172.21.15.72:0/3343160327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1c005050 0x7f8a1c00b8e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f8a280094d0 tx=0x7f8a2800b040).ready entity=mon.0 client_cookie=24217a1c132a4874 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:42.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.622+0000 7f8a35599700 1 -- 172.21.15.72:0/3343160327 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a28009c50 con 0x7f8a1c005050 2023-08-31T18:48:42.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.622+0000 7f8a35599700 1 -- 172.21.15.72:0/3343160327 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2800f040 con 0x7f8a1c005050 2023-08-31T18:48:42.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.622+0000 7f8a35599700 1 -- 172.21.15.72:0/3343160327 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2800ee50 con 0x7f8a1c005050 2023-08-31T18:48:42.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.622+0000 7f8a387ff700 1 -- 172.21.15.72:0/3343160327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1c005050 msgr2=0x7f8a1c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:42.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.622+0000 7f8a387ff700 1 --2- 172.21.15.72:0/3343160327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1c005050 0x7f8a1c00b8e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f8a280094d0 tx=0x7f8a2800b040).stop 2023-08-31T18:48:42.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.622+0000 7f8a387ff700 1 -- 172.21.15.72:0/3343160327 shutdown_connections 2023-08-31T18:48:42.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.622+0000 7f8a387ff700 1 --2- 172.21.15.72:0/3343160327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1c005050 0x7f8a1c00b8e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:42.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.622+0000 7f8a387ff700 1 -- 172.21.15.72:0/3343160327 >> 172.21.15.72:0/3343160327 conn(0x7f8a300cb7e0 msgr2=0x7f8a300c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:42.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.622+0000 7f8a387ff700 1 -- 172.21.15.72:0/3343160327 shutdown_connections 2023-08-31T18:48:42.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.622+0000 7f8a387ff700 1 -- 172.21.15.72:0/3343160327 wait complete. 2023-08-31T18:48:42.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.624+0000 7f8a387ff700 1 Processor -- start 2023-08-31T18:48:42.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.624+0000 7f8a387ff700 1 -- start start 2023-08-31T18:48:42.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a387ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1c005050 0x7f8a300c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:42.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a387ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8a301685c0 0x7f8a3013ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:42.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a387ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300c2390 0x7f8a30167930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:42.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a387ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300c4cb0 con 0x7f8a1c005050 2023-08-31T18:48:42.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a387ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3014d320 con 0x7f8a300c2390 2023-08-31T18:48:42.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a387ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3014d600 con 0x7f8a301685c0 2023-08-31T18:48:42.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a3659b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1c005050 0x7f8a300c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:42.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a3659b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1c005050 0x7f8a300c4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60994/0 (socket says 172.21.15.72:60994) 2023-08-31T18:48:42.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a3659b700 1 -- 172.21.15.72:0/3647302999 learned_addr learned my addr 172.21.15.72:0/3647302999 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:42.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a36d9c700 1 --2- 172.21.15.72:0/3647302999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300c2390 0x7f8a30167930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:42.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a35d9a700 1 --2- 172.21.15.72:0/3647302999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8a301685c0 0x7f8a3013ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:42.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a3659b700 1 -- 172.21.15.72:0/3647302999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8a301685c0 msgr2=0x7f8a3013ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:42.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a3659b700 1 --2- 172.21.15.72:0/3647302999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8a301685c0 0x7f8a3013ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:42.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a3659b700 1 -- 172.21.15.72:0/3647302999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300c2390 msgr2=0x7f8a30167930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:42.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a3659b700 1 --2- 172.21.15.72:0/3647302999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300c2390 0x7f8a30167930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:42.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.625+0000 7f8a3659b700 1 -- 172.21.15.72:0/3647302999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3014d8e0 con 0x7f8a1c005050 2023-08-31T18:48:42.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.626+0000 7f8a3659b700 1 --2- 172.21.15.72:0/3647302999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1c005050 0x7f8a300c4400 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f8a2c007790 tx=0x7f8a300c6ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:42.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.626+0000 7f8a267fc700 1 -- 172.21.15.72:0/3647302999 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0114c0 con 0x7f8a1c005050 2023-08-31T18:48:42.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.626+0000 7f8a267fc700 1 -- 172.21.15.72:0/3647302999 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c011620 con 0x7f8a1c005050 2023-08-31T18:48:42.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.626+0000 7f8a387ff700 1 -- 172.21.15.72:0/3647302999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3014dbc0 con 0x7f8a1c005050 2023-08-31T18:48:42.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.626+0000 7f8a267fc700 1 -- 172.21.15.72:0/3647302999 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0119a0 con 0x7f8a1c005050 2023-08-31T18:48:42.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.626+0000 7f8a387ff700 1 -- 172.21.15.72:0/3647302999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3013f3f0 con 0x7f8a1c005050 2023-08-31T18:48:42.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.627+0000 7f8a387ff700 1 -- 172.21.15.72:0/3647302999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3006a7e0 con 0x7f8a1c005050 2023-08-31T18:48:42.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.628+0000 7f8a267fc700 1 -- 172.21.15.72:0/3647302999 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8a2c01d3b0 con 0x7f8a1c005050 2023-08-31T18:48:42.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.629+0000 7f8a267fc700 1 --2- 172.21.15.72:0/3647302999 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8a1405ee10 0x7f8a140612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:42.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.629+0000 7f8a267fc700 1 -- 172.21.15.72:0/3647302999 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5827+0+0 (secure 0 0 0) 0x7f8a2c079440 con 0x7f8a1c005050 2023-08-31T18:48:42.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.629+0000 7f8a35d9a700 1 --2- 172.21.15.72:0/3647302999 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8a1405ee10 0x7f8a140612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:42.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.630+0000 7f8a35d9a700 1 --2- 172.21.15.72:0/3647302999 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8a1405ee10 0x7f8a140612d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f8a301689c0 tx=0x7f8a20007bb0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:42.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.633+0000 7f8a267fc700 1 -- 172.21.15.72:0/3647302999 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8a2c04a9a0 con 0x7f8a1c005050 2023-08-31T18:48:42.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:42.803+0000 7f8a387ff700 1 -- 172.21.15.72:0/3647302999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8a3006c6b0 con 0x7f8a1c005050 2023-08-31T18:48:43.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.401+0000 7f8a267fc700 1 -- 172.21.15.72:0/3647302999 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8a2c019030 con 0x7f8a1c005050 2023-08-31T18:48:43.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.405+0000 7f8a387ff700 1 -- 172.21.15.72:0/3647302999 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8a1405ee10 msgr2=0x7f8a140612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:43.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.405+0000 7f8a387ff700 1 --2- 172.21.15.72:0/3647302999 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8a1405ee10 0x7f8a140612d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f8a301689c0 tx=0x7f8a20007bb0).stop 2023-08-31T18:48:43.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.405+0000 7f8a387ff700 1 -- 172.21.15.72:0/3647302999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1c005050 msgr2=0x7f8a300c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:43.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.405+0000 7f8a387ff700 1 --2- 172.21.15.72:0/3647302999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1c005050 0x7f8a300c4400 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f8a2c007790 tx=0x7f8a300c6ba0).stop 2023-08-31T18:48:43.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.405+0000 7f8a387ff700 1 -- 172.21.15.72:0/3647302999 shutdown_connections 2023-08-31T18:48:43.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.405+0000 7f8a387ff700 1 --2- 172.21.15.72:0/3647302999 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8a1405ee10 0x7f8a140612d0 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0x7f8a301689c0 tx=0x7f8a20007bb0).stop 2023-08-31T18:48:43.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.405+0000 7f8a387ff700 1 --2- 172.21.15.72:0/3647302999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300c2390 0x7f8a30167930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:43.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.405+0000 7f8a387ff700 1 --2- 172.21.15.72:0/3647302999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1c005050 0x7f8a300c4400 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0x7f8a2c007790 tx=0x7f8a300c6ba0).stop 2023-08-31T18:48:43.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.405+0000 7f8a387ff700 1 --2- 172.21.15.72:0/3647302999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8a301685c0 0x7f8a3013ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:43.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.405+0000 7f8a387ff700 1 -- 172.21.15.72:0/3647302999 >> 172.21.15.72:0/3647302999 conn(0x7f8a300cb7e0 msgr2=0x7f8a300c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:43.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.407+0000 7f8a387ff700 1 -- 172.21.15.72:0/3647302999 shutdown_connections 2023-08-31T18:48:43.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.407+0000 7f8a387ff700 1 -- 172.21.15.72:0/3647302999 wait complete. 2023-08-31T18:48:43.410 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-08-31T18:48:43.431 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T18:48:43.431 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-31T18:48:43.432 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T18:48:43.432 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T18:48:43.432 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T18:48:43.432 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-31T18:48:43.433 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T18:48:43.433 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T18:48:43.433 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T18:48:43.433 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-31T18:48:43.434 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T18:48:43.434 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T18:48:43.434 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T18:48:43.435 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-31T18:48:43.435 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T18:48:43.435 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T18:48:43.446 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T18:48:43.447 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T18:48:43.448 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T18:48:43.448 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T18:48:43.450 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T18:48:43.450 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T18:48:43.451 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T18:48:43.452 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T18:48:43.492 INFO:tasks.ceph.mds.a:Started 2023-08-31T18:48:43.492 DEBUG:teuthology.parallel:result is None 2023-08-31T18:48:43.494 INFO:tasks.ceph.mds.c:Started 2023-08-31T18:48:43.495 DEBUG:teuthology.parallel:result is None 2023-08-31T18:48:43.496 INFO:tasks.ceph.mds.b:Started 2023-08-31T18:48:43.496 DEBUG:teuthology.parallel:result is None 2023-08-31T18:48:43.499 INFO:tasks.ceph.mds.d:Started 2023-08-31T18:48:43.500 DEBUG:teuthology.parallel:result is None 2023-08-31T18:48:43.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-31T18:48:43.637 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T18:48:43.638 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-31T18:48:43.644 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-08-31T18:48:43.644 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-08-31T18:48:43.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.709+0000 7f50b37ff700 1 Processor -- start 2023-08-31T18:48:43.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.709+0000 7f50b37ff700 1 -- start start 2023-08-31T18:48:43.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.710+0000 7f50b37ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f50ac1506e0 0x7f50ac069470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.710+0000 7f50b37ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ac0c1370 con 0x7f50ac0c1a80 2023-08-31T18:48:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.710+0000 7f50b37ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ac068fe0 con 0x7f50ac150300 2023-08-31T18:48:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.710+0000 7f50b37ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50ac150b60 con 0x7f50ac1506e0 2023-08-31T18:48:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.710+0000 7f50b0d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f50ac1506e0 0x7f50ac069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.710+0000 7f50b1d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f50ac0c1a80 0x7f50ac064230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41296/0 (socket says 172.21.15.72:41296) 2023-08-31T18:48:43.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.710+0000 7f50b1d9c700 1 -- 172.21.15.72:0/1690394806 learned_addr learned my addr 172.21.15.72:0/1690394806 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:43.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.711+0000 7f50b0d9a700 1 -- 172.21.15.72:0/1690394806 >> v1:172.21.15.146:6789/0 conn(0x7f50ac150300 legacy=0x7f50ac154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:43.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.711+0000 7f50b0d9a700 1 -- 172.21.15.72:0/1690394806 >> v1:172.21.15.72:6789/0 conn(0x7f50ac0c1a80 legacy=0x7f50ac064230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.711+0000 7f50b0d9a700 1 -- 172.21.15.72:0/1690394806 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ac0bd780 con 0x7f50ac1506e0 2023-08-31T18:48:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.711+0000 7f50a3fff700 1 -- 172.21.15.72:0/1690394806 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766233005 0 0) 0x7f50ac0c1370 con 0x7f50ac0c1a80 2023-08-31T18:48:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.711+0000 7f50b0d9a700 1 --2- 172.21.15.72:0/1690394806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50ac1506e0 0x7f50ac069470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f509c009760 tx=0x7f509c009060).ready entity=mon.0 client_cookie=732213c237f7fc11 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.711+0000 7f50a3fff700 1 -- 172.21.15.72:0/1690394806 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c009120 con 0x7f50ac1506e0 2023-08-31T18:48:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.711+0000 7f50a3fff700 1 -- 172.21.15.72:0/1690394806 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c00b580 con 0x7f50ac1506e0 2023-08-31T18:48:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.711+0000 7f50a3fff700 1 -- 172.21.15.72:0/1690394806 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c00b900 con 0x7f50ac1506e0 2023-08-31T18:48:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.712+0000 7f50b37ff700 1 -- 172.21.15.72:0/1690394806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50ac1506e0 msgr2=0x7f50ac069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.712+0000 7f50b37ff700 1 --2- 172.21.15.72:0/1690394806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50ac1506e0 0x7f50ac069470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f509c009760 tx=0x7f509c009060).stop 2023-08-31T18:48:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.712+0000 7f50b37ff700 1 -- 172.21.15.72:0/1690394806 shutdown_connections 2023-08-31T18:48:43.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.712+0000 7f50b37ff700 1 --2- 172.21.15.72:0/1690394806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50ac1506e0 0x7f50ac069470 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:43.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.712+0000 7f50b37ff700 1 -- 172.21.15.72:0/1690394806 >> 172.21.15.72:0/1690394806 conn(0x7f50ac062650 msgr2=0x7f50ac062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:43.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.712+0000 7f50b37ff700 1 -- 172.21.15.72:0/1690394806 shutdown_connections 2023-08-31T18:48:43.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.712+0000 7f50b37ff700 1 -- 172.21.15.72:0/1690394806 wait complete. 2023-08-31T18:48:43.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.714+0000 7f50b37ff700 1 Processor -- start 2023-08-31T18:48:43.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.714+0000 7f50b37ff700 1 -- start start 2023-08-31T18:48:43.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b37ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50ac0c1a80 0x7f50ac14be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:43.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b37ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50ac150300 0x7f50ac0ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:43.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b37ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50ac1506e0 0x7f50ac148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:43.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b37ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac0bf440 con 0x7f50ac150300 2023-08-31T18:48:43.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b37ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac168720 con 0x7f50ac0c1a80 2023-08-31T18:48:43.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b37ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac168a00 con 0x7f50ac1506e0 2023-08-31T18:48:43.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b0d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50ac150300 0x7f50ac0ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:43.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b0d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50ac150300 0x7f50ac0ab600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45894/0 (socket says 172.21.15.72:45894) 2023-08-31T18:48:43.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b0d9a700 1 -- 172.21.15.72:0/3153338078 learned_addr learned my addr 172.21.15.72:0/3153338078 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:43.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b1d9c700 1 --2- 172.21.15.72:0/3153338078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50ac1506e0 0x7f50ac148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:43.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b159b700 1 --2- 172.21.15.72:0/3153338078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50ac0c1a80 0x7f50ac14be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:43.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b0d9a700 1 -- 172.21.15.72:0/3153338078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50ac1506e0 msgr2=0x7f50ac148640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:43.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b0d9a700 1 --2- 172.21.15.72:0/3153338078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50ac1506e0 0x7f50ac148640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:43.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b0d9a700 1 -- 172.21.15.72:0/3153338078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50ac0c1a80 msgr2=0x7f50ac14be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:43.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b0d9a700 1 --2- 172.21.15.72:0/3153338078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50ac0c1a80 0x7f50ac14be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:43.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b0d9a700 1 -- 172.21.15.72:0/3153338078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c0092a0 con 0x7f50ac150300 2023-08-31T18:48:43.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.715+0000 7f50b0d9a700 1 --2- 172.21.15.72:0/3153338078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50ac150300 0x7f50ac0ab600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f50ac06add0 tx=0x7f509c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:43.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.716+0000 7f50a17fa700 1 -- 172.21.15.72:0/3153338078 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c00bcc0 con 0x7f50ac150300 2023-08-31T18:48:43.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.716+0000 7f50a17fa700 1 -- 172.21.15.72:0/3153338078 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c00be20 con 0x7f50ac150300 2023-08-31T18:48:43.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.716+0000 7f50a17fa700 1 -- 172.21.15.72:0/3153338078 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c01b640 con 0x7f50ac150300 2023-08-31T18:48:43.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.716+0000 7f50b37ff700 1 -- 172.21.15.72:0/3153338078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ac168ce0 con 0x7f50ac150300 2023-08-31T18:48:43.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.716+0000 7f50b37ff700 1 -- 172.21.15.72:0/3153338078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ac1682a0 con 0x7f50ac150300 2023-08-31T18:48:43.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.717+0000 7f50b37ff700 1 -- 172.21.15.72:0/3153338078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ac06c6b0 con 0x7f50ac150300 2023-08-31T18:48:43.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.718+0000 7f50a17fa700 1 -- 172.21.15.72:0/3153338078 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f509c01b9f0 con 0x7f50ac150300 2023-08-31T18:48:43.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.719+0000 7f50a17fa700 1 --2- 172.21.15.72:0/3153338078 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f509005ee10 0x7f50900612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:43.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.719+0000 7f50a17fa700 1 -- 172.21.15.72:0/3153338078 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f509c07b6a0 con 0x7f50ac150300 2023-08-31T18:48:43.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.719+0000 7f50b159b700 1 --2- 172.21.15.72:0/3153338078 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f509005ee10 0x7f50900612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:43.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.719+0000 7f50b159b700 1 --2- 172.21.15.72:0/3153338078 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f509005ee10 0x7f50900612d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f50a80036d0 tx=0x7f50a8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:43.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.723+0000 7f50a17fa700 1 -- 172.21.15.72:0/3153338078 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f509c04cd50 con 0x7f50ac150300 2023-08-31T18:48:43.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:43.906+0000 7f50b37ff700 1 -- 172.21.15.72:0/3153338078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f50ac14f290 con 0x7f50ac150300 2023-08-31T18:48:44.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.689+0000 7f50a17fa700 1 -- 172.21.15.72:0/3153338078 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f509c01f020 con 0x7f50ac150300 2023-08-31T18:48:44.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.691+0000 7f50b37ff700 1 -- 172.21.15.72:0/3153338078 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f509005ee10 msgr2=0x7f50900612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:44.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.691+0000 7f50b37ff700 1 --2- 172.21.15.72:0/3153338078 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f509005ee10 0x7f50900612d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f50a80036d0 tx=0x7f50a8009040).stop 2023-08-31T18:48:44.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.691+0000 7f50b37ff700 1 -- 172.21.15.72:0/3153338078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50ac150300 msgr2=0x7f50ac0ab600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:44.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.691+0000 7f50b37ff700 1 --2- 172.21.15.72:0/3153338078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50ac150300 0x7f50ac0ab600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f50ac06add0 tx=0x7f509c017000).stop 2023-08-31T18:48:44.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.692+0000 7f50b37ff700 1 -- 172.21.15.72:0/3153338078 shutdown_connections 2023-08-31T18:48:44.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.692+0000 7f50b37ff700 1 --2- 172.21.15.72:0/3153338078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f50ac1506e0 0x7f50ac148640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:44.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.692+0000 7f50b37ff700 1 --2- 172.21.15.72:0/3153338078 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f509005ee10 0x7f50900612d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:44.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.692+0000 7f50b37ff700 1 --2- 172.21.15.72:0/3153338078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50ac0c1a80 0x7f50ac14be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:44.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.692+0000 7f50b37ff700 1 --2- 172.21.15.72:0/3153338078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50ac150300 0x7f50ac0ab600 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:44.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.692+0000 7f50b37ff700 1 -- 172.21.15.72:0/3153338078 >> 172.21.15.72:0/3153338078 conn(0x7f50ac062650 msgr2=0x7f50ac0c4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:44.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.692+0000 7f50b37ff700 1 -- 172.21.15.72:0/3153338078 shutdown_connections 2023-08-31T18:48:44.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.692+0000 7f50b37ff700 1 -- 172.21.15.72:0/3153338078 wait complete. 2023-08-31T18:48:44.695 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-08-31T18:48:44.711 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-31T18:48:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.901+0000 7f96a99ff700 1 Processor -- start 2023-08-31T18:48:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.901+0000 7f96a99ff700 1 -- start start 2023-08-31T18:48:44.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.902+0000 7f96a99ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96a4062d60 0x7f96a4155460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:44.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.902+0000 7f96a99ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a4065940 con 0x7f96a4152090 2023-08-31T18:48:44.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.902+0000 7f96a99ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a4152470 con 0x7f96a40c25d0 2023-08-31T18:48:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.902+0000 7f96a99ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a4155950 con 0x7f96a4062d60 2023-08-31T18:48:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.903+0000 7f96a2ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f96a4152090 0x7f96a4062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41300/0 (socket says 172.21.15.72:41300) 2023-08-31T18:48:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.903+0000 7f96a2ffd700 1 -- 172.21.15.72:0/1349259342 learned_addr learned my addr 172.21.15.72:0/1349259342 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.903+0000 7f96a27fc700 1 --2- 172.21.15.72:0/1349259342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96a4062d60 0x7f96a4155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.903+0000 7f96a1ffb700 1 -- 172.21.15.72:0/1349259342 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801961883 0 0) 0x7f96a4065940 con 0x7f96a4152090 2023-08-31T18:48:44.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.903+0000 7f96a1ffb700 1 -- 172.21.15.72:0/1349259342 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f968c0033f0 con 0x7f96a4152090 2023-08-31T18:48:44.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.903+0000 7f96a1ffb700 1 -- 172.21.15.72:0/1349259342 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2895670620 0 0) 0x7f968c0033f0 con 0x7f96a4152090 2023-08-31T18:48:44.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.903+0000 7f96a1ffb700 1 -- 172.21.15.72:0/1349259342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96a4062d60 msgr2=0x7f96a4155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:44.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.903+0000 7f96a1ffb700 1 --2- 172.21.15.72:0/1349259342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96a4062d60 0x7f96a4155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:44.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.903+0000 7f96a1ffb700 1 -- 172.21.15.72:0/1349259342 >> v1:172.21.15.146:6789/0 conn(0x7f96a40c25d0 legacy=0x7f96a4069390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:44.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.903+0000 7f96a1ffb700 1 -- 172.21.15.72:0/1349259342 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a40a6e40 con 0x7f96a4152090 2023-08-31T18:48:44.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.903+0000 7f96a1ffb700 1 -- 172.21.15.72:0/1349259342 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f9694001470 con 0x7f96a4152090 2023-08-31T18:48:44.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.903+0000 7f96a1ffb700 1 -- 172.21.15.72:0/1349259342 >> v1:172.21.15.72:6789/0 conn(0x7f96a4152090 legacy=0x7f96a4062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.904+0000 7f96a1ffb700 1 --2- 172.21.15.72:0/1349259342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968c003910 0x7f968c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.904+0000 7f96a1ffb700 1 --2- 172.21.15.72:0/1349259342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c004690 0x7f968c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.904+0000 7f96a1ffb700 1 --2- 172.21.15.72:0/1349259342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96a4062d60 0x7f968c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.904+0000 7f96a1ffb700 1 -- 172.21.15.72:0/1349259342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a4155950 con 0x7f968c004690 2023-08-31T18:48:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.904+0000 7f96a1ffb700 1 -- 172.21.15.72:0/1349259342 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c00b8e0 con 0x7f968c003910 2023-08-31T18:48:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.904+0000 7f96a1ffb700 1 -- 172.21.15.72:0/1349259342 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c00ba50 con 0x7f96a4062d60 2023-08-31T18:48:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.904+0000 7f96a27fc700 1 --2- 172.21.15.72:0/1349259342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c004690 0x7f968c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.904+0000 7f96a2ffd700 1 --2- 172.21.15.72:0/1349259342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968c003910 0x7f968c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.904+0000 7f96a37fe700 1 --2- 172.21.15.72:0/1349259342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96a4062d60 0x7f968c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.904+0000 7f96a27fc700 1 -- 172.21.15.72:0/1349259342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96a4062d60 msgr2=0x7f968c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.904+0000 7f96a27fc700 1 --2- 172.21.15.72:0/1349259342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f96a4062d60 0x7f968c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.904+0000 7f96a27fc700 1 -- 172.21.15.72:0/1349259342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968c003910 msgr2=0x7f968c003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.904+0000 7f96a27fc700 1 --2- 172.21.15.72:0/1349259342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968c003910 0x7f968c003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.904+0000 7f96a27fc700 1 -- 172.21.15.72:0/1349259342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c0033f0 con 0x7f968c004690 2023-08-31T18:48:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.904+0000 7f96a27fc700 1 --2- 172.21.15.72:0/1349259342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c004690 0x7f968c004b10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f96a4063160 tx=0x7f9698009060).ready entity=mon.0 client_cookie=42e2b3cbd78a6687 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.905+0000 7f96a1ffb700 1 -- 172.21.15.72:0/1349259342 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698009e90 con 0x7f968c004690 2023-08-31T18:48:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.905+0000 7f96a1ffb700 1 -- 172.21.15.72:0/1349259342 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9698009430 con 0x7f968c004690 2023-08-31T18:48:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.905+0000 7f96a1ffb700 1 -- 172.21.15.72:0/1349259342 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969800e7f0 con 0x7f968c004690 2023-08-31T18:48:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.905+0000 7f96a99ff700 1 -- 172.21.15.72:0/1349259342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c004690 msgr2=0x7f968c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.905+0000 7f96a99ff700 1 --2- 172.21.15.72:0/1349259342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c004690 0x7f968c004b10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f96a4063160 tx=0x7f9698009060).stop 2023-08-31T18:48:44.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.905+0000 7f96a37fe700 1 -- 172.21.15.72:0/1349259342 reap_dead start 2023-08-31T18:48:44.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.905+0000 7f96a99ff700 1 -- 172.21.15.72:0/1349259342 shutdown_connections 2023-08-31T18:48:44.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.905+0000 7f96a99ff700 1 -- 172.21.15.72:0/1349259342 >> 172.21.15.72:0/1349259342 conn(0x7f96a40c7c30 msgr2=0x7f96a40c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:44.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.905+0000 7f96a99ff700 1 -- 172.21.15.72:0/1349259342 shutdown_connections 2023-08-31T18:48:44.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.905+0000 7f96a99ff700 1 -- 172.21.15.72:0/1349259342 wait complete. 2023-08-31T18:48:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.907+0000 7f96a99ff700 1 Processor -- start 2023-08-31T18:48:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.907+0000 7f96a99ff700 1 -- start start 2023-08-31T18:48:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a99ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c004690 0x7f96a40a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a99ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96a40a64e0 0x7f96a40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a99ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96a40a6960 0x7f96a40a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:44.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a99ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a40a61f0 con 0x7f96a40a6960 2023-08-31T18:48:44.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a99ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a40a82c0 con 0x7f96a40a64e0 2023-08-31T18:48:44.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a99ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a4164f20 con 0x7f968c004690 2023-08-31T18:48:44.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96a40a6960 0x7f96a40a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:44.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96a40a6960 0x7f96a40a5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45904/0 (socket says 172.21.15.72:45904) 2023-08-31T18:48:44.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a37fe700 1 -- 172.21.15.72:0/3322868607 learned_addr learned my addr 172.21.15.72:0/3322868607 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:44.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a2ffd700 1 --2- 172.21.15.72:0/3322868607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c004690 0x7f96a40a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:44.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a27fc700 1 --2- 172.21.15.72:0/3322868607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96a40a64e0 0x7f96a40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:44.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a37fe700 1 -- 172.21.15.72:0/3322868607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c004690 msgr2=0x7f96a40a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:44.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a37fe700 1 --2- 172.21.15.72:0/3322868607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c004690 0x7f96a40a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:44.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a37fe700 1 -- 172.21.15.72:0/3322868607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96a40a64e0 msgr2=0x7f96a40a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:44.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a37fe700 1 --2- 172.21.15.72:0/3322868607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96a40a64e0 0x7f96a40a5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:44.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.908+0000 7f96a37fe700 1 -- 172.21.15.72:0/3322868607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a4165200 con 0x7f96a40a6960 2023-08-31T18:48:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.909+0000 7f96a37fe700 1 --2- 172.21.15.72:0/3322868607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96a40a6960 0x7f96a40a5d00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f96a4068a50 tx=0x7f969c007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.909+0000 7f968affd700 1 -- 172.21.15.72:0/3322868607 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c010520 con 0x7f96a40a6960 2023-08-31T18:48:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.909+0000 7f968affd700 1 -- 172.21.15.72:0/3322868607 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c010680 con 0x7f96a40a6960 2023-08-31T18:48:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.909+0000 7f96a99ff700 1 -- 172.21.15.72:0/3322868607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a41654e0 con 0x7f96a40a6960 2023-08-31T18:48:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.909+0000 7f968affd700 1 -- 172.21.15.72:0/3322868607 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c010a40 con 0x7f96a40a6960 2023-08-31T18:48:44.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.909+0000 7f96a99ff700 1 -- 172.21.15.72:0/3322868607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a4164ad0 con 0x7f96a40a6960 2023-08-31T18:48:44.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.910+0000 7f96a99ff700 1 -- 172.21.15.72:0/3322868607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a406c6b0 con 0x7f96a40a6960 2023-08-31T18:48:44.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.911+0000 7f968affd700 1 -- 172.21.15.72:0/3322868607 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f969c0133e0 con 0x7f96a40a6960 2023-08-31T18:48:44.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.912+0000 7f968affd700 1 --2- 172.21.15.72:0/3322868607 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f969005ee10 0x7f96900612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:44.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.912+0000 7f968affd700 1 -- 172.21.15.72:0/3322868607 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f969c079560 con 0x7f96a40a6960 2023-08-31T18:48:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.912+0000 7f96a2ffd700 1 --2- 172.21.15.72:0/3322868607 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f969005ee10 0x7f96900612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.913+0000 7f96a2ffd700 1 --2- 172.21.15.72:0/3322868607 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f969005ee10 0x7f96900612d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f96940015a0 tx=0x7f9694001e70).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:44.917+0000 7f968affd700 1 -- 172.21.15.72:0/3322868607 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f969c04acc0 con 0x7f96a40a6960 2023-08-31T18:48:45.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.146+0000 7f96a99ff700 1 -- 172.21.15.72:0/3322868607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f96a40a7120 con 0x7f96a40a6960 2023-08-31T18:48:45.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.146+0000 7f968affd700 1 -- 172.21.15.72:0/3322868607 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f969c04e2e0 con 0x7f96a40a6960 2023-08-31T18:48:45.150 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:45.150 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T18:48:45.150 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-08-31T18:48:45.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.151 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-08-31T18:48:45.151 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkPeqvDBAAA2eEr6xr7iF5PPNT9eehSg==", 2023-08-31T18:48:45.151 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.151 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T18:48:45.151 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T18:48:45.152 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T18:48:45.152 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T18:48:45.152 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.153 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-08-31T18:48:45.153 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkctxUIxAAufSVXMwPzPA7Gq1s4ukXiQ==", 2023-08-31T18:48:45.153 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.153 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T18:48:45.153 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T18:48:45.154 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T18:48:45.154 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T18:48:45.154 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.155 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-08-31T18:48:45.155 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkcpLfFxAASIB//h8whjuh6s3YKBVffQ==", 2023-08-31T18:48:45.155 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.155 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T18:48:45.155 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T18:48:45.156 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T18:48:45.156 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T18:48:45.156 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.156 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-08-31T18:48:45.157 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkC1bbLhAAg/0wct2P0+cyWbZyI2bP/g==", 2023-08-31T18:48:45.157 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.157 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T18:48:45.157 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T18:48:45.157 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T18:48:45.158 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T18:48:45.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.158 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-08-31T18:48:45.159 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAi4PBkvfRJEBAAYQqPldOXrJxXAXnmZhXaBQ==", 2023-08-31T18:48:45.159 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.159 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T18:48:45.159 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T18:48:45.159 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T18:48:45.160 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.160 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-08-31T18:48:45.160 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAl4PBkYysSIhAA4nCmskcGV+i4vpH2k/gDBg==", 2023-08-31T18:48:45.161 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.161 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T18:48:45.161 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T18:48:45.161 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T18:48:45.161 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.162 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-08-31T18:48:45.162 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAp4PBkyDgJFxAAPynEKk15yN7+OxQxpzL0UQ==", 2023-08-31T18:48:45.162 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.163 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T18:48:45.163 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T18:48:45.163 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T18:48:45.163 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.164 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-08-31T18:48:45.164 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAs4PBkZMD2KBAAoJrO4YjJ4/8MjcPAtgEn1g==", 2023-08-31T18:48:45.164 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.164 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T18:48:45.165 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T18:48:45.165 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T18:48:45.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.165 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-08-31T18:48:45.166 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAz4PBkSgAoExAAJ95kdHV47jDTXSj/WSCiLw==", 2023-08-31T18:48:45.166 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.166 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T18:48:45.166 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T18:48:45.167 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T18:48:45.167 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.167 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-08-31T18:48:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA24PBkUxpLKBAAAu8d6iKME6wW+Q/6hhFIRQ==", 2023-08-31T18:48:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T18:48:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T18:48:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T18:48:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.169 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-08-31T18:48:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA54PBkURHJOhAA3HaPfENVQ4hLIjc/esF0bQ==", 2023-08-31T18:48:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T18:48:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T18:48:45.170 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T18:48:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-08-31T18:48:45.171 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA94PBkfoqTEBAAQHENgrp5tv1X47Br/dUksQ==", 2023-08-31T18:48:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T18:48:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T18:48:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T18:48:45.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-08-31T18:48:45.173 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkucWuOBAABLowlGxpCR3GgoOCRmC0FQ==", 2023-08-31T18:48:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T18:48:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T18:48:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T18:48:45.174 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T18:48:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-08-31T18:48:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkVGBPCxAAO4M9u24/yH0xwtV6oSz+JQ==", 2023-08-31T18:48:45.175 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T18:48:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T18:48:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T18:48:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T18:48:45.176 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.2", 2023-08-31T18:48:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkYeIoBBAAjoIzJJ9McIx3rLBSaorTKA==", 2023-08-31T18:48:45.177 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T18:48:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T18:48:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T18:48:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T18:48:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.179 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.3", 2023-08-31T18:48:45.179 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkX/V9EhAAqWuBMMhikN/JUQp3v5/ABQ==", 2023-08-31T18:48:45.179 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.179 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T18:48:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T18:48:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T18:48:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T18:48:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-08-31T18:48:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkCRlhDhAAxvcGr+KTvLoJmtuZC89Iuw==", 2023-08-31T18:48:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T18:48:45.181 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T18:48:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T18:48:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T18:48:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-mds", 2023-08-31T18:48:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBF4PBkbf1pHBAA+d4pfFX/KhLf5oHV7xQkLA==", 2023-08-31T18:48:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-mds" 2023-08-31T18:48:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-mgr", 2023-08-31T18:48:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBF4PBkWghqHBAA/y8oSsqXtoJUAGCK/cJP7A==", 2023-08-31T18:48:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.184 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-31T18:48:45.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.185 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-osd", 2023-08-31T18:48:45.185 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBF4PBkKxNqHBAAcktYogwP4A9Itjj4IUQbgw==", 2023-08-31T18:48:45.185 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.186 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-osd" 2023-08-31T18:48:45.186 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.186 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rbd", 2023-08-31T18:48:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBF4PBkkRtqHBAAI+nveXbwaD/erKhFOv4sXA==", 2023-08-31T18:48:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-31T18:48:45.187 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-31T18:48:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBF4PBkAiRqHBAAXmXC7YDcssQBV1frb9ISZw==", 2023-08-31T18:48:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.188 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-31T18:48:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rgw", 2023-08-31T18:48:45.189 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBF4PBkySxqHBAA2FBpb7HxM2bFFaTjBp101Q==", 2023-08-31T18:48:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-31T18:48:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.190 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-08-31T18:48:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkiGBUBRAAwWTFqrz+ELBSwb0Z2T9yhQ==", 2023-08-31T18:48:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T18:48:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T18:48:45.191 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T18:48:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-08-31T18:48:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkSWszNRAAdBxrfMEuBRgePfaiPx6kpQ==", 2023-08-31T18:48:45.192 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T18:48:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T18:48:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T18:48:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T18:48:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.193 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:45.194 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-08-31T18:48:45.194 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T18:48:45.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.148+0000 7f96a99ff700 1 -- 172.21.15.72:0/3322868607 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f969005ee10 msgr2=0x7f96900612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:45.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.148+0000 7f96a99ff700 1 --2- 172.21.15.72:0/3322868607 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f969005ee10 0x7f96900612d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f96940015a0 tx=0x7f9694001e70).stop 2023-08-31T18:48:45.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.148+0000 7f96a99ff700 1 -- 172.21.15.72:0/3322868607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96a40a6960 msgr2=0x7f96a40a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:45.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.148+0000 7f96a99ff700 1 --2- 172.21.15.72:0/3322868607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96a40a6960 0x7f96a40a5d00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f96a4068a50 tx=0x7f969c007f10).stop 2023-08-31T18:48:45.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.148+0000 7f96a99ff700 1 -- 172.21.15.72:0/3322868607 shutdown_connections 2023-08-31T18:48:45.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.148+0000 7f96a99ff700 1 --2- 172.21.15.72:0/3322868607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96a40a6960 0x7f96a40a5d00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.148+0000 7f96a99ff700 1 --2- 172.21.15.72:0/3322868607 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c004690 0x7f96a40a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.148+0000 7f96a99ff700 1 --2- 172.21.15.72:0/3322868607 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f969005ee10 0x7f96900612d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.148+0000 7f96a99ff700 1 --2- 172.21.15.72:0/3322868607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96a40a64e0 0x7f96a40a5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.148+0000 7f96a99ff700 1 -- 172.21.15.72:0/3322868607 >> 172.21.15.72:0/3322868607 conn(0x7f96a40c7c30 msgr2=0x7f96a414d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:45.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.149+0000 7f96a99ff700 1 -- 172.21.15.72:0/3322868607 shutdown_connections 2023-08-31T18:48:45.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.149+0000 7f96a99ff700 1 -- 172.21.15.72:0/3322868607 wait complete. 2023-08-31T18:48:45.198 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-31T18:48:45.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.387+0000 7f3f46fff700 1 Processor -- start 2023-08-31T18:48:45.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.387+0000 7f3f46fff700 1 -- start start 2023-08-31T18:48:45.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.389+0000 7f3f46fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f40153ca0 0x7f3f40154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.389+0000 7f3f46fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f400c9450 con 0x7f3f400c8ee0 2023-08-31T18:48:45.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.389+0000 7f3f46fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f400c9730 con 0x7f3f400ca4f0 2023-08-31T18:48:45.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.389+0000 7f3f46fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f400c9a10 con 0x7f3f40153ca0 2023-08-31T18:48:45.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.389+0000 7f3f3ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3f400c8ee0 0x7f3f40158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41304/0 (socket says 172.21.15.72:41304) 2023-08-31T18:48:45.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.389+0000 7f3f3ffff700 1 -- 172.21.15.72:0/1405289233 learned_addr learned my addr 172.21.15.72:0/1405289233 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:45.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.389+0000 7f3f44d9b700 1 --2- 172.21.15.72:0/1405289233 >> v2:172.21.15.146:3300/0 conn(0x7f3f40153ca0 0x7f3f40154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.389+0000 7f3f3f7fe700 1 -- 172.21.15.72:0/1405289233 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306656767 0 0) 0x7f3f400c9450 con 0x7f3f400c8ee0 2023-08-31T18:48:45.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.389+0000 7f3f3f7fe700 1 -- 172.21.15.72:0/1405289233 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f300033f0 con 0x7f3f400c8ee0 2023-08-31T18:48:45.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3f7fe700 1 -- 172.21.15.72:0/1405289233 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1874073462 0 0) 0x7f3f300033f0 con 0x7f3f400c8ee0 2023-08-31T18:48:45.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3f7fe700 1 -- 172.21.15.72:0/1405289233 >> v2:172.21.15.146:3300/0 conn(0x7f3f40153ca0 msgr2=0x7f3f40154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:45.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3f7fe700 1 --2- 172.21.15.72:0/1405289233 >> v2:172.21.15.146:3300/0 conn(0x7f3f40153ca0 0x7f3f40154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3f7fe700 1 -- 172.21.15.72:0/1405289233 >> v1:172.21.15.146:6789/0 conn(0x7f3f400ca4f0 legacy=0x7f3f40063100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:45.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3f7fe700 1 -- 172.21.15.72:0/1405289233 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f400c9cf0 con 0x7f3f400c8ee0 2023-08-31T18:48:45.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3f7fe700 1 -- 172.21.15.72:0/1405289233 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f3f2c001470 con 0x7f3f400c8ee0 2023-08-31T18:48:45.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3f7fe700 1 -- 172.21.15.72:0/1405289233 >> v1:172.21.15.72:6789/0 conn(0x7f3f400c8ee0 legacy=0x7f3f40158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:45.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3f7fe700 1 --2- 172.21.15.72:0/1405289233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f300038e0 0x7f3f30003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3f7fe700 1 --2- 172.21.15.72:0/1405289233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f30004690 0x7f3f30004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3f7fe700 1 --2- 172.21.15.72:0/1405289233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f30005000 0x7f3f3000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3f7fe700 1 -- 172.21.15.72:0/1405289233 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f400c9a10 con 0x7f3f30004690 2023-08-31T18:48:45.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3f7fe700 1 -- 172.21.15.72:0/1405289233 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3000bf60 con 0x7f3f30005000 2023-08-31T18:48:45.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3f7fe700 1 -- 172.21.15.72:0/1405289233 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3000c0f0 con 0x7f3f300038e0 2023-08-31T18:48:45.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3ffff700 1 --2- 172.21.15.72:0/1405289233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f30004690 0x7f3f30004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f44d9b700 1 --2- 172.21.15.72:0/1405289233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f300038e0 0x7f3f30003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f4559c700 1 --2- 172.21.15.72:0/1405289233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f30005000 0x7f3f3000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3ffff700 1 -- 172.21.15.72:0/1405289233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f300038e0 msgr2=0x7f3f30003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:45.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3ffff700 1 --2- 172.21.15.72:0/1405289233 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f300038e0 0x7f3f30003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3ffff700 1 -- 172.21.15.72:0/1405289233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f30005000 msgr2=0x7f3f3000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:45.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3ffff700 1 --2- 172.21.15.72:0/1405289233 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f30005000 0x7f3f3000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f3ffff700 1 -- 172.21.15.72:0/1405289233 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f300033f0 con 0x7f3f30004690 2023-08-31T18:48:45.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.390+0000 7f3f4559c700 1 -- 172.21.15.72:0/1405289233 reap_dead start 2023-08-31T18:48:45.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.391+0000 7f3f3ffff700 1 --2- 172.21.15.72:0/1405289233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f30004690 0x7f3f30004b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f3f2c00c190 tx=0x7f3f2c001e70).ready entity=mon.0 client_cookie=ff15c26b5ecb0d5d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:45.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.391+0000 7f3f3f7fe700 1 -- 172.21.15.72:0/1405289233 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c007a40 con 0x7f3f30004690 2023-08-31T18:48:45.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.391+0000 7f3f3f7fe700 1 -- 172.21.15.72:0/1405289233 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c00ca60 con 0x7f3f30004690 2023-08-31T18:48:45.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.391+0000 7f3f3f7fe700 1 -- 172.21.15.72:0/1405289233 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00ce00 con 0x7f3f30004690 2023-08-31T18:48:45.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.391+0000 7f3f46fff700 1 -- 172.21.15.72:0/1405289233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f30004690 msgr2=0x7f3f30004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:45.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.391+0000 7f3f46fff700 1 --2- 172.21.15.72:0/1405289233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f30004690 0x7f3f30004b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f3f2c00c190 tx=0x7f3f2c001e70).stop 2023-08-31T18:48:45.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.391+0000 7f3f46fff700 1 -- 172.21.15.72:0/1405289233 shutdown_connections 2023-08-31T18:48:45.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.391+0000 7f3f46fff700 1 --2- 172.21.15.72:0/1405289233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f30004690 0x7f3f30004b10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.391+0000 7f3f46fff700 1 -- 172.21.15.72:0/1405289233 >> 172.21.15.72:0/1405289233 conn(0x7f3f400cadb0 msgr2=0x7f3f400cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:45.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.391+0000 7f3f46fff700 1 -- 172.21.15.72:0/1405289233 shutdown_connections 2023-08-31T18:48:45.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.392+0000 7f3f46fff700 1 -- 172.21.15.72:0/1405289233 wait complete. 2023-08-31T18:48:45.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.393+0000 7f3f46fff700 1 Processor -- start 2023-08-31T18:48:45.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.393+0000 7f3f46fff700 1 -- start start 2023-08-31T18:48:45.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.394+0000 7f3f46fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f30004690 0x7f3f40152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.394+0000 7f3f46fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f401511d0 0x7f3f4014d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.394+0000 7f3f46fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f400b0500 0x7f3f400b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.394+0000 7f3f46fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f401522b0 con 0x7f3f30004690 2023-08-31T18:48:45.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.394+0000 7f3f46fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f401516c0 con 0x7f3f401511d0 2023-08-31T18:48:45.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.394+0000 7f3f46fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40151980 con 0x7f3f400b0500 2023-08-31T18:48:45.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.394+0000 7f3f44d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f30004690 0x7f3f40152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.394+0000 7f3f44d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f30004690 0x7f3f40152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45928/0 (socket says 172.21.15.72:45928) 2023-08-31T18:48:45.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.394+0000 7f3f44d9b700 1 -- 172.21.15.72:0/2982723510 learned_addr learned my addr 172.21.15.72:0/2982723510 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:45.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.394+0000 7f3f4559c700 1 --2- 172.21.15.72:0/2982723510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f400b0500 0x7f3f400b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.394+0000 7f3f3ffff700 1 --2- 172.21.15.72:0/2982723510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f401511d0 0x7f3f4014d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.395+0000 7f3f44d9b700 1 -- 172.21.15.72:0/2982723510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f400b0500 msgr2=0x7f3f400b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:45.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.395+0000 7f3f44d9b700 1 --2- 172.21.15.72:0/2982723510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f400b0500 0x7f3f400b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.395+0000 7f3f44d9b700 1 -- 172.21.15.72:0/2982723510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f401511d0 msgr2=0x7f3f4014d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:45.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.395+0000 7f3f44d9b700 1 --2- 172.21.15.72:0/2982723510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f401511d0 0x7f3f4014d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.395+0000 7f3f44d9b700 1 -- 172.21.15.72:0/2982723510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f40151c60 con 0x7f3f30004690 2023-08-31T18:48:45.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.395+0000 7f3f44d9b700 1 --2- 172.21.15.72:0/2982723510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f30004690 0x7f3f40152740 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f3f34011570 tx=0x7f3f34008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:45.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.395+0000 7f3f3cff9700 1 -- 172.21.15.72:0/2982723510 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34011ea0 con 0x7f3f30004690 2023-08-31T18:48:45.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.395+0000 7f3f3cff9700 1 -- 172.21.15.72:0/2982723510 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f340145f0 con 0x7f3f30004690 2023-08-31T18:48:45.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.395+0000 7f3f46fff700 1 -- 172.21.15.72:0/2982723510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f40151f40 con 0x7f3f30004690 2023-08-31T18:48:45.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.395+0000 7f3f3cff9700 1 -- 172.21.15.72:0/2982723510 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34014970 con 0x7f3f30004690 2023-08-31T18:48:45.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.395+0000 7f3f46fff700 1 -- 172.21.15.72:0/2982723510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4014eb90 con 0x7f3f30004690 2023-08-31T18:48:45.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.396+0000 7f3f46fff700 1 -- 172.21.15.72:0/2982723510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4006c6b0 con 0x7f3f30004690 2023-08-31T18:48:45.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.397+0000 7f3f3cff9700 1 -- 172.21.15.72:0/2982723510 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3f34014d20 con 0x7f3f30004690 2023-08-31T18:48:45.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.398+0000 7f3f3cff9700 1 --2- 172.21.15.72:0/2982723510 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f2405ee10 0x7f3f240612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.398+0000 7f3f3cff9700 1 -- 172.21.15.72:0/2982723510 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f3f3407a0e0 con 0x7f3f30004690 2023-08-31T18:48:45.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.398+0000 7f3f3ffff700 1 --2- 172.21.15.72:0/2982723510 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f2405ee10 0x7f3f240612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.399+0000 7f3f3ffff700 1 --2- 172.21.15.72:0/2982723510 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f2405ee10 0x7f3f240612d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3f2c001ed0 tx=0x7f3f2c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:45.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.402+0000 7f3f3cff9700 1 -- 172.21.15.72:0/2982723510 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3f3404b7e0 con 0x7f3f30004690 2023-08-31T18:48:45.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.635+0000 7f3f46fff700 1 -- 172.21.15.72:0/2982723510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f3f400c9fd0 con 0x7f3f30004690 2023-08-31T18:48:45.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.639+0000 7f3f3cff9700 1 -- 172.21.15.72:0/2982723510 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3f3404ee00 con 0x7f3f30004690 2023-08-31T18:48:45.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.641+0000 7f3f46fff700 1 -- 172.21.15.72:0/2982723510 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f2405ee10 msgr2=0x7f3f240612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:45.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.641+0000 7f3f46fff700 1 --2- 172.21.15.72:0/2982723510 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f2405ee10 0x7f3f240612d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3f2c001ed0 tx=0x7f3f2c015000).stop 2023-08-31T18:48:45.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.641+0000 7f3f46fff700 1 -- 172.21.15.72:0/2982723510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f30004690 msgr2=0x7f3f40152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:45.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.641+0000 7f3f46fff700 1 --2- 172.21.15.72:0/2982723510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f30004690 0x7f3f40152740 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f3f34011570 tx=0x7f3f34008040).stop 2023-08-31T18:48:45.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.641+0000 7f3f46fff700 1 -- 172.21.15.72:0/2982723510 shutdown_connections 2023-08-31T18:48:45.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.641+0000 7f3f46fff700 1 --2- 172.21.15.72:0/2982723510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f400b0500 0x7f3f400b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.641+0000 7f3f46fff700 1 --2- 172.21.15.72:0/2982723510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f30004690 0x7f3f40152740 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.641+0000 7f3f46fff700 1 --2- 172.21.15.72:0/2982723510 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f2405ee10 0x7f3f240612d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.641+0000 7f3f46fff700 1 --2- 172.21.15.72:0/2982723510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f401511d0 0x7f3f4014d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.641+0000 7f3f46fff700 1 -- 172.21.15.72:0/2982723510 >> 172.21.15.72:0/2982723510 conn(0x7f3f400cadb0 msgr2=0x7f3f400ab3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:45.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.641+0000 7f3f46fff700 1 -- 172.21.15.72:0/2982723510 shutdown_connections 2023-08-31T18:48:45.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.641+0000 7f3f46fff700 1 -- 172.21.15.72:0/2982723510 wait complete. 2023-08-31T18:48:45.644 INFO:teuthology.orchestra.run.smithi072.stderr:updated 2023-08-31T18:48:45.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-31T18:48:45.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.847+0000 7f7900bff700 1 Processor -- start 2023-08-31T18:48:45.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.847+0000 7f7900bff700 1 -- start start 2023-08-31T18:48:45.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.848+0000 7f7900bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78fc0c8ee0 0x7f78fc154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.848+0000 7f7900bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc0c9450 con 0x7f78fc0ca4f0 2023-08-31T18:48:45.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.848+0000 7f7900bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc0c9730 con 0x7f78fc153ca0 2023-08-31T18:48:45.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.848+0000 7f7900bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0c9a10 con 0x7f78fc0c8ee0 2023-08-31T18:48:45.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.849+0000 7f78fad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f78fc0ca4f0 0x7f78fc063100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41306/0 (socket says 172.21.15.72:41306) 2023-08-31T18:48:45.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.849+0000 7f78fad9d700 1 -- 172.21.15.72:0/3434810800 learned_addr learned my addr 172.21.15.72:0/3434810800 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:45.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.849+0000 7f78f9d9b700 1 --2- 172.21.15.72:0/3434810800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78fc0c8ee0 0x7f78fc154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.849+0000 7f78f959a700 1 -- 172.21.15.72:0/3434810800 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522719667 0 0) 0x7f78fc0c9450 con 0x7f78fc0ca4f0 2023-08-31T18:48:45.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.849+0000 7f78f959a700 1 -- 172.21.15.72:0/3434810800 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78e40033f0 con 0x7f78fc0ca4f0 2023-08-31T18:48:45.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.849+0000 7f78f959a700 1 -- 172.21.15.72:0/3434810800 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3303439911 0 0) 0x7f78e40033f0 con 0x7f78fc0ca4f0 2023-08-31T18:48:45.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.849+0000 7f78f959a700 1 -- 172.21.15.72:0/3434810800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78fc0c8ee0 msgr2=0x7f78fc154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:45.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.849+0000 7f78f959a700 1 --2- 172.21.15.72:0/3434810800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78fc0c8ee0 0x7f78fc154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.849+0000 7f78f959a700 1 -- 172.21.15.72:0/3434810800 >> v1:172.21.15.146:6789/0 conn(0x7f78fc153ca0 legacy=0x7f78fc158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:45.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.849+0000 7f78f959a700 1 -- 172.21.15.72:0/3434810800 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc0c9cf0 con 0x7f78fc0ca4f0 2023-08-31T18:48:45.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.849+0000 7f78f959a700 1 -- 172.21.15.72:0/3434810800 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f78f40017f0 con 0x7f78fc0ca4f0 2023-08-31T18:48:45.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78f959a700 1 -- 172.21.15.72:0/3434810800 >> v1:172.21.15.72:6789/0 conn(0x7f78fc0ca4f0 legacy=0x7f78fc063100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:45.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78f959a700 1 --2- 172.21.15.72:0/3434810800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78fc0c8ee0 0x7f78e4003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78f959a700 1 --2- 172.21.15.72:0/3434810800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78e4003e00 0x7f78e4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78f959a700 1 --2- 172.21.15.72:0/3434810800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e4004b80 0x7f78e4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78f959a700 1 -- 172.21.15.72:0/3434810800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0c9a10 con 0x7f78e4004b80 2023-08-31T18:48:45.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78f959a700 1 -- 172.21.15.72:0/3434810800 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e400b8e0 con 0x7f78e4003e00 2023-08-31T18:48:45.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78f959a700 1 -- 172.21.15.72:0/3434810800 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e400baa0 con 0x7f78fc0c8ee0 2023-08-31T18:48:45.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78fad9d700 1 --2- 172.21.15.72:0/3434810800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e4004b80 0x7f78e4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78f9d9b700 1 --2- 172.21.15.72:0/3434810800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78e4003e00 0x7f78e4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78fa59c700 1 --2- 172.21.15.72:0/3434810800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78fc0c8ee0 0x7f78e4003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78fad9d700 1 -- 172.21.15.72:0/3434810800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78fc0c8ee0 msgr2=0x7f78e4003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:45.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78fad9d700 1 --2- 172.21.15.72:0/3434810800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78fc0c8ee0 0x7f78e4003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78fad9d700 1 -- 172.21.15.72:0/3434810800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78e4003e00 msgr2=0x7f78e4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:45.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78fad9d700 1 --2- 172.21.15.72:0/3434810800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78e4003e00 0x7f78e4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78fad9d700 1 -- 172.21.15.72:0/3434810800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e40033f0 con 0x7f78e4004b80 2023-08-31T18:48:45.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.850+0000 7f78fad9d700 1 --2- 172.21.15.72:0/3434810800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e4004b80 0x7f78e4005000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f78f400c5f0 tx=0x7f78f4001d10).ready entity=mon.0 client_cookie=f199b3defd7ce56b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:45.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.851+0000 7f78f959a700 1 -- 172.21.15.72:0/3434810800 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4001f40 con 0x7f78e4004b80 2023-08-31T18:48:45.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.851+0000 7f78f959a700 1 -- 172.21.15.72:0/3434810800 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f400cdf0 con 0x7f78e4004b80 2023-08-31T18:48:45.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.851+0000 7f78f959a700 1 -- 172.21.15.72:0/3434810800 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4005d70 con 0x7f78e4004b80 2023-08-31T18:48:45.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.851+0000 7f7900bff700 1 -- 172.21.15.72:0/3434810800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e4004b80 msgr2=0x7f78e4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:45.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.851+0000 7f7900bff700 1 --2- 172.21.15.72:0/3434810800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e4004b80 0x7f78e4005000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f78f400c5f0 tx=0x7f78f4001d10).stop 2023-08-31T18:48:45.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.851+0000 7f78fad9d700 1 -- 172.21.15.72:0/3434810800 reap_dead start 2023-08-31T18:48:45.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.851+0000 7f7900bff700 1 -- 172.21.15.72:0/3434810800 shutdown_connections 2023-08-31T18:48:45.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.851+0000 7f7900bff700 1 -- 172.21.15.72:0/3434810800 >> 172.21.15.72:0/3434810800 conn(0x7f78fc0cadb0 msgr2=0x7f78fc0cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:45.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.851+0000 7f7900bff700 1 -- 172.21.15.72:0/3434810800 shutdown_connections 2023-08-31T18:48:45.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.851+0000 7f7900bff700 1 -- 172.21.15.72:0/3434810800 wait complete. 2023-08-31T18:48:45.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.853+0000 7f7900bff700 1 Processor -- start 2023-08-31T18:48:45.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.853+0000 7f7900bff700 1 -- start start 2023-08-31T18:48:45.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.854+0000 7f7900bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e4004b80 0x7f78fc1543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.854+0000 7f7900bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78fc0c2860 0x7f78fc150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.854+0000 7f7900bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78fc0acd30 0x7f78fc0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.854+0000 7f7900bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0aed30 con 0x7f78e4004b80 2023-08-31T18:48:45.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.854+0000 7f7900bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0ad6a0 con 0x7f78fc0c2860 2023-08-31T18:48:45.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.854+0000 7f7900bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0c3cf0 con 0x7f78fc0acd30 2023-08-31T18:48:45.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.854+0000 7f78fa59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e4004b80 0x7f78fc1543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.854+0000 7f78fa59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e4004b80 0x7f78fc1543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45942/0 (socket says 172.21.15.72:45942) 2023-08-31T18:48:45.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.854+0000 7f78fa59c700 1 -- 172.21.15.72:0/3764280000 learned_addr learned my addr 172.21.15.72:0/3764280000 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:45.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.854+0000 7f78f9d9b700 1 --2- 172.21.15.72:0/3764280000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78fc0c2860 0x7f78fc150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.854+0000 7f78fad9d700 1 --2- 172.21.15.72:0/3764280000 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78fc0acd30 0x7f78fc0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.854+0000 7f78fa59c700 1 -- 172.21.15.72:0/3764280000 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78fc0acd30 msgr2=0x7f78fc0ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:45.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.855+0000 7f78fa59c700 1 --2- 172.21.15.72:0/3764280000 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78fc0acd30 0x7f78fc0ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.855+0000 7f78fa59c700 1 -- 172.21.15.72:0/3764280000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78fc0c2860 msgr2=0x7f78fc150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:45.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.855+0000 7f78fa59c700 1 --2- 172.21.15.72:0/3764280000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78fc0c2860 0x7f78fc150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:45.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.855+0000 7f78fa59c700 1 -- 172.21.15.72:0/3764280000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc0ae120 con 0x7f78e4004b80 2023-08-31T18:48:45.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.855+0000 7f78fa59c700 1 --2- 172.21.15.72:0/3764280000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e4004b80 0x7f78fc1543a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f78ec00e600 tx=0x7f78ec009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:45.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.855+0000 7f78ea7fc700 1 -- 172.21.15.72:0/3764280000 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec007e40 con 0x7f78e4004b80 2023-08-31T18:48:45.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.855+0000 7f78ea7fc700 1 -- 172.21.15.72:0/3764280000 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec010040 con 0x7f78e4004b80 2023-08-31T18:48:45.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.855+0000 7f7900bff700 1 -- 172.21.15.72:0/3764280000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc0ae400 con 0x7f78e4004b80 2023-08-31T18:48:45.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.855+0000 7f78ea7fc700 1 -- 172.21.15.72:0/3764280000 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0017b0 con 0x7f78e4004b80 2023-08-31T18:48:45.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.855+0000 7f7900bff700 1 -- 172.21.15.72:0/3764280000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc0ae9c0 con 0x7f78e4004b80 2023-08-31T18:48:45.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.856+0000 7f7900bff700 1 -- 172.21.15.72:0/3764280000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc06c6b0 con 0x7f78e4004b80 2023-08-31T18:48:45.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.857+0000 7f78ea7fc700 1 -- 172.21.15.72:0/3764280000 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f78ec001b60 con 0x7f78e4004b80 2023-08-31T18:48:45.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.857+0000 7f78ea7fc700 1 --2- 172.21.15.72:0/3764280000 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f78dc05ee10 0x7f78dc0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:45.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.858+0000 7f78ea7fc700 1 -- 172.21.15.72:0/3764280000 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f78ec079b10 con 0x7f78e4004b80 2023-08-31T18:48:45.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.858+0000 7f78f9d9b700 1 --2- 172.21.15.72:0/3764280000 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f78dc05ee10 0x7f78dc0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:45.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.858+0000 7f78f9d9b700 1 --2- 172.21.15.72:0/3764280000 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f78dc05ee10 0x7f78dc0612d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f78fc0c0220 tx=0x7f78f0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:45.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:45.861+0000 7f78ea7fc700 1 -- 172.21.15.72:0/3764280000 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78ec04b210 con 0x7f78e4004b80 2023-08-31T18:48:46.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.095+0000 7f7900bff700 1 -- 172.21.15.72:0/3764280000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f78fc0c9fd0 con 0x7f78e4004b80 2023-08-31T18:48:46.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.099+0000 7f78ea7fc700 1 -- 172.21.15.72:0/3764280000 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f78ec04e830 con 0x7f78e4004b80 2023-08-31T18:48:46.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.101+0000 7f7900bff700 1 -- 172.21.15.72:0/3764280000 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f78dc05ee10 msgr2=0x7f78dc0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:46.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.101+0000 7f7900bff700 1 --2- 172.21.15.72:0/3764280000 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f78dc05ee10 0x7f78dc0612d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f78fc0c0220 tx=0x7f78f0008040).stop 2023-08-31T18:48:46.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.101+0000 7f7900bff700 1 -- 172.21.15.72:0/3764280000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e4004b80 msgr2=0x7f78fc1543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:46.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.101+0000 7f7900bff700 1 --2- 172.21.15.72:0/3764280000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e4004b80 0x7f78fc1543a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f78ec00e600 tx=0x7f78ec009040).stop 2023-08-31T18:48:46.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.101+0000 7f7900bff700 1 -- 172.21.15.72:0/3764280000 shutdown_connections 2023-08-31T18:48:46.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.101+0000 7f7900bff700 1 --2- 172.21.15.72:0/3764280000 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78fc0acd30 0x7f78fc0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.101+0000 7f7900bff700 1 --2- 172.21.15.72:0/3764280000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e4004b80 0x7f78fc1543a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.101+0000 7f7900bff700 1 --2- 172.21.15.72:0/3764280000 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f78dc05ee10 0x7f78dc0612d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.101+0000 7f7900bff700 1 --2- 172.21.15.72:0/3764280000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78fc0c2860 0x7f78fc150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.101+0000 7f7900bff700 1 -- 172.21.15.72:0/3764280000 >> 172.21.15.72:0/3764280000 conn(0x7f78fc0cadb0 msgr2=0x7f78fc0c6030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:46.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.101+0000 7f7900bff700 1 -- 172.21.15.72:0/3764280000 shutdown_connections 2023-08-31T18:48:46.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.101+0000 7f7900bff700 1 -- 172.21.15.72:0/3764280000 wait complete. 2023-08-31T18:48:46.104 INFO:teuthology.orchestra.run.smithi072.stderr:updated 2023-08-31T18:48:46.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-31T18:48:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.308+0000 7f3fb63ff700 1 Processor -- start 2023-08-31T18:48:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.308+0000 7f3fb63ff700 1 -- start start 2023-08-31T18:48:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.309+0000 7f3fb63ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3fb014b1c0 0x7f3fb0155010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.309+0000 7f3fb63ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3fb00c5c70 0x7f3fb00c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.309+0000 7f3fb63ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb00c6610 con 0x7f3fb00a9af0 2023-08-31T18:48:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.309+0000 7f3fb63ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb00ad990 con 0x7f3fb014b1c0 2023-08-31T18:48:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.309+0000 7f3fb63ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb0158aa0 con 0x7f3fb00c5c70 2023-08-31T18:48:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.310+0000 7f3faffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3fb014b1c0 0x7f3fb0155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.310+0000 7f3fb499c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3fb00a9af0 0x7f3fb00a9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41314/0 (socket says 172.21.15.72:41314) 2023-08-31T18:48:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.310+0000 7f3fb499c700 1 -- 172.21.15.72:0/2672302852 learned_addr learned my addr 172.21.15.72:0/2672302852 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.310+0000 7f3faf7fe700 1 --2- 172.21.15.72:0/2672302852 >> v2:172.21.15.146:3300/0 conn(0x7f3fb00c5c70 0x7f3fb00c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.310+0000 7f3faffff700 1 -- 172.21.15.72:0/2672302852 >> v2:172.21.15.146:3300/0 conn(0x7f3fb00c5c70 msgr2=0x7f3fb00c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.310+0000 7f3faffff700 1 --2- 172.21.15.72:0/2672302852 >> v2:172.21.15.146:3300/0 conn(0x7f3fb00c5c70 0x7f3fb00c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.310+0000 7f3faffff700 1 -- 172.21.15.72:0/2672302852 >> v1:172.21.15.72:6789/0 conn(0x7f3fb00a9af0 legacy=0x7f3fb00a9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.310+0000 7f3faffff700 1 -- 172.21.15.72:0/2672302852 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb0155500 con 0x7f3fb014b1c0 2023-08-31T18:48:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.310+0000 7f3faf7fe700 1 --2- 172.21.15.72:0/2672302852 >> v2:172.21.15.146:3300/0 conn(0x7f3fb00c5c70 0x7f3fb00c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.310+0000 7f3faeffd700 1 -- 172.21.15.72:0/2672302852 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095116515 0 0) 0x7f3fa8001490 con 0x7f3fb00a9af0 2023-08-31T18:48:46.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.310+0000 7f3faffff700 1 --2- 172.21.15.72:0/2672302852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb014b1c0 0x7f3fb0155010 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f3fb0082fe0 tx=0x7f3fa0009060).ready entity=mon.0 client_cookie=30984351f67720d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:46.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.311+0000 7f3faeffd700 1 -- 172.21.15.72:0/2672302852 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000b580 con 0x7f3fb014b1c0 2023-08-31T18:48:46.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.311+0000 7f3faeffd700 1 -- 172.21.15.72:0/2672302852 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa000b6e0 con 0x7f3fb014b1c0 2023-08-31T18:48:46.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.311+0000 7f3faeffd700 1 -- 172.21.15.72:0/2672302852 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000ba60 con 0x7f3fb014b1c0 2023-08-31T18:48:46.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.311+0000 7f3fb63ff700 1 -- 172.21.15.72:0/2672302852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb014b1c0 msgr2=0x7f3fb0155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:46.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.311+0000 7f3fb63ff700 1 --2- 172.21.15.72:0/2672302852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb014b1c0 0x7f3fb0155010 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f3fb0082fe0 tx=0x7f3fa0009060).stop 2023-08-31T18:48:46.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.311+0000 7f3fb63ff700 1 -- 172.21.15.72:0/2672302852 shutdown_connections 2023-08-31T18:48:46.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.311+0000 7f3fb63ff700 1 --2- 172.21.15.72:0/2672302852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb014b1c0 0x7f3fb0155010 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.311+0000 7f3fb63ff700 1 --2- 172.21.15.72:0/2672302852 >> v2:172.21.15.146:3300/0 conn(0x7f3fb00c5c70 0x7f3fb00c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.311+0000 7f3fb63ff700 1 -- 172.21.15.72:0/2672302852 >> 172.21.15.72:0/2672302852 conn(0x7f3fb00cadb0 msgr2=0x7f3fb00cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:46.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.311+0000 7f3fb63ff700 1 -- 172.21.15.72:0/2672302852 shutdown_connections 2023-08-31T18:48:46.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.311+0000 7f3fb63ff700 1 -- 172.21.15.72:0/2672302852 wait complete. 2023-08-31T18:48:46.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.313+0000 7f3fb63ff700 1 Processor -- start 2023-08-31T18:48:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.313+0000 7f3fb63ff700 1 -- start start 2023-08-31T18:48:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3fb63ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb00a9af0 0x7f3fb0166f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3fb63ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb00c5c70 0x7f3fb014e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3fb63ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb014b1c0 0x7f3fb00abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3fb63ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00aeb10 con 0x7f3fb00c5c70 2023-08-31T18:48:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3fb63ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00adf00 con 0x7f3fb00a9af0 2023-08-31T18:48:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3fb63ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00ae1e0 con 0x7f3fb014b1c0 2023-08-31T18:48:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3faf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb00c5c70 0x7f3fb014e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3faf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb00c5c70 0x7f3fb014e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45952/0 (socket says 172.21.15.72:45952) 2023-08-31T18:48:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3faf7fe700 1 -- 172.21.15.72:0/2526530952 learned_addr learned my addr 172.21.15.72:0/2526530952 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3faffff700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb00a9af0 0x7f3fb0166f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3fb499c700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb014b1c0 0x7f3fb00abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3faf7fe700 1 -- 172.21.15.72:0/2526530952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb014b1c0 msgr2=0x7f3fb00abca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3faf7fe700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb014b1c0 0x7f3fb00abca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3faf7fe700 1 -- 172.21.15.72:0/2526530952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb00a9af0 msgr2=0x7f3fb0166f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3faf7fe700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb00a9af0 0x7f3fb0166f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.314+0000 7f3faf7fe700 1 -- 172.21.15.72:0/2526530952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa00092a0 con 0x7f3fb00c5c70 2023-08-31T18:48:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.315+0000 7f3faffff700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb00a9af0 0x7f3fb0166f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.315+0000 7f3fb499c700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb014b1c0 0x7f3fb00abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.315+0000 7f3faf7fe700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb00c5c70 0x7f3fb014e2a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f3fa400d860 tx=0x7f3fa4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.315+0000 7f3f97fff700 1 -- 172.21.15.72:0/2526530952 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4011590 con 0x7f3fb00c5c70 2023-08-31T18:48:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.315+0000 7f3f97fff700 1 -- 172.21.15.72:0/2526530952 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa40116f0 con 0x7f3fb00c5c70 2023-08-31T18:48:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.315+0000 7f3fb63ff700 1 -- 172.21.15.72:0/2526530952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb00ae4c0 con 0x7f3fb00c5c70 2023-08-31T18:48:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.315+0000 7f3f97fff700 1 -- 172.21.15.72:0/2526530952 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4011a70 con 0x7f3fb00c5c70 2023-08-31T18:48:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.315+0000 7f3fb63ff700 1 -- 172.21.15.72:0/2526530952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb0167460 con 0x7f3fb00c5c70 2023-08-31T18:48:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.316+0000 7f3fb63ff700 1 -- 172.21.15.72:0/2526530952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb006c6b0 con 0x7f3fb00c5c70 2023-08-31T18:48:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.317+0000 7f3f97fff700 1 -- 172.21.15.72:0/2526530952 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3fa4012420 con 0x7f3fb00c5c70 2023-08-31T18:48:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.318+0000 7f3f97fff700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f9c05ee10 0x7f3f9c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.318+0000 7f3f97fff700 1 -- 172.21.15.72:0/2526530952 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f3fa4079620 con 0x7f3fb00c5c70 2023-08-31T18:48:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.318+0000 7f3faffff700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f9c05ee10 0x7f3f9c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:46.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.318+0000 7f3faffff700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f9c05ee10 0x7f3f9c0612d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f3fb00ac890 tx=0x7f3fa0017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:46.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.321+0000 7f3f97fff700 1 -- 172.21.15.72:0/2526530952 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3fa404ad80 con 0x7f3fb00c5c70 2023-08-31T18:48:46.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.556+0000 7f3fb63ff700 1 -- 172.21.15.72:0/2526530952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f3fb0157f20 con 0x7f3fb00c5c70 2023-08-31T18:48:46.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.560+0000 7f3f97fff700 1 -- 172.21.15.72:0/2526530952 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3fa404e3a0 con 0x7f3fb00c5c70 2023-08-31T18:48:46.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.562+0000 7f3fb63ff700 1 -- 172.21.15.72:0/2526530952 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f9c05ee10 msgr2=0x7f3f9c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:46.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.562+0000 7f3fb63ff700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f9c05ee10 0x7f3f9c0612d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f3fb00ac890 tx=0x7f3fa0017000).stop 2023-08-31T18:48:46.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.562+0000 7f3fb63ff700 1 -- 172.21.15.72:0/2526530952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb00c5c70 msgr2=0x7f3fb014e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:46.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.562+0000 7f3fb63ff700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb00c5c70 0x7f3fb014e2a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f3fa400d860 tx=0x7f3fa4008040).stop 2023-08-31T18:48:46.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.562+0000 7f3fb63ff700 1 -- 172.21.15.72:0/2526530952 shutdown_connections 2023-08-31T18:48:46.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.562+0000 7f3fb63ff700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb014b1c0 0x7f3fb00abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.562+0000 7f3fb63ff700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f9c05ee10 0x7f3f9c0612d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.562+0000 7f3fb63ff700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb00a9af0 0x7f3fb0166f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.562+0000 7f3fb63ff700 1 --2- 172.21.15.72:0/2526530952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb00c5c70 0x7f3fb014e2a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.562+0000 7f3fb63ff700 1 -- 172.21.15.72:0/2526530952 >> 172.21.15.72:0/2526530952 conn(0x7f3fb00cadb0 msgr2=0x7f3fb0064650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:46.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.562+0000 7f3fb63ff700 1 -- 172.21.15.72:0/2526530952 shutdown_connections 2023-08-31T18:48:46.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.562+0000 7f3fb63ff700 1 -- 172.21.15.72:0/2526530952 wait complete. 2023-08-31T18:48:46.565 INFO:teuthology.orchestra.run.smithi072.stderr:updated 2023-08-31T18:48:46.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-31T18:48:46.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.768+0000 7fdf8f9ff700 1 Processor -- start 2023-08-31T18:48:46.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.768+0000 7fdf8f9ff700 1 -- start start 2023-08-31T18:48:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.769+0000 7fdf8f9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf881580c0 0x7fdf880bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.769+0000 7fdf8f9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf88069410 0x7fdf881584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.769+0000 7fdf8f9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf88069890 con 0x7fdf88158990 2023-08-31T18:48:46.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.769+0000 7fdf8f9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf88069ae0 con 0x7fdf88069410 2023-08-31T18:48:46.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.769+0000 7fdf8f9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf88062880 con 0x7fdf881580c0 2023-08-31T18:48:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.769+0000 7fdf8cf9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf88069410 0x7fdf881584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.769+0000 7fdf8df9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdf88158990 0x7fdf88153e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41320/0 (socket says 172.21.15.72:41320) 2023-08-31T18:48:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.769+0000 7fdf8df9c700 1 -- 172.21.15.72:0/3250892273 learned_addr learned my addr 172.21.15.72:0/3250892273 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:46.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.770+0000 7fdf8d79b700 1 --2- 172.21.15.72:0/3250892273 >> v2:172.21.15.146:3300/0 conn(0x7fdf881580c0 0x7fdf880bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.770+0000 7fdf8cf9a700 1 -- 172.21.15.72:0/3250892273 >> v2:172.21.15.146:3300/0 conn(0x7fdf881580c0 msgr2=0x7fdf880bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.770+0000 7fdf8cf9a700 1 --2- 172.21.15.72:0/3250892273 >> v2:172.21.15.146:3300/0 conn(0x7fdf881580c0 0x7fdf880bc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.770+0000 7fdf8cf9a700 1 -- 172.21.15.72:0/3250892273 >> v1:172.21.15.72:6789/0 conn(0x7fdf88158990 legacy=0x7fdf88153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.770+0000 7fdf8cf9a700 1 -- 172.21.15.72:0/3250892273 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf88063f50 con 0x7fdf88069410 2023-08-31T18:48:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.770+0000 7fdf8d79b700 1 --2- 172.21.15.72:0/3250892273 >> v2:172.21.15.146:3300/0 conn(0x7fdf881580c0 0x7fdf880bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.770+0000 7fdf7ffff700 1 -- 172.21.15.72:0/3250892273 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027505964 0 0) 0x7fdf88069890 con 0x7fdf88158990 2023-08-31T18:48:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.770+0000 7fdf8cf9a700 1 --2- 172.21.15.72:0/3250892273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf88069410 0x7fdf881584a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fdf88066a10 tx=0x7fdf78009060).ready entity=mon.0 client_cookie=cd3620be046ca47 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.770+0000 7fdf7ffff700 1 -- 172.21.15.72:0/3250892273 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf780090d0 con 0x7fdf88069410 2023-08-31T18:48:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.770+0000 7fdf7ffff700 1 -- 172.21.15.72:0/3250892273 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7800b580 con 0x7fdf88069410 2023-08-31T18:48:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.770+0000 7fdf7ffff700 1 -- 172.21.15.72:0/3250892273 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7800b900 con 0x7fdf88069410 2023-08-31T18:48:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.771+0000 7fdf8f9ff700 1 -- 172.21.15.72:0/3250892273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf88069410 msgr2=0x7fdf881584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.771+0000 7fdf8f9ff700 1 --2- 172.21.15.72:0/3250892273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf88069410 0x7fdf881584a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fdf88066a10 tx=0x7fdf78009060).stop 2023-08-31T18:48:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.771+0000 7fdf8f9ff700 1 -- 172.21.15.72:0/3250892273 shutdown_connections 2023-08-31T18:48:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.771+0000 7fdf8f9ff700 1 --2- 172.21.15.72:0/3250892273 >> v2:172.21.15.146:3300/0 conn(0x7fdf881580c0 0x7fdf880bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.771+0000 7fdf8f9ff700 1 --2- 172.21.15.72:0/3250892273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf88069410 0x7fdf881584a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.771+0000 7fdf8f9ff700 1 -- 172.21.15.72:0/3250892273 >> 172.21.15.72:0/3250892273 conn(0x7fdf880c73a0 msgr2=0x7fdf880c77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:46.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.771+0000 7fdf8f9ff700 1 -- 172.21.15.72:0/3250892273 shutdown_connections 2023-08-31T18:48:46.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.771+0000 7fdf8f9ff700 1 -- 172.21.15.72:0/3250892273 wait complete. 2023-08-31T18:48:46.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.772+0000 7fdf8f9ff700 1 Processor -- start 2023-08-31T18:48:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.773+0000 7fdf8f9ff700 1 -- start start 2023-08-31T18:48:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.773+0000 7fdf8f9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf88069410 0x7fdf88141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.773+0000 7fdf8f9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf881580c0 0x7fdf881549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.773+0000 7fdf8f9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf88158990 0x7fdf88154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:46.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.774+0000 7fdf8f9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf881685c0 con 0x7fdf881580c0 2023-08-31T18:48:46.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.774+0000 7fdf8f9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880c0130 con 0x7fdf88069410 2023-08-31T18:48:46.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.774+0000 7fdf8f9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880bfc10 con 0x7fdf88158990 2023-08-31T18:48:46.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.774+0000 7fdf8cf9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf881580c0 0x7fdf881549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:46.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.774+0000 7fdf8cf9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf881580c0 0x7fdf881549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45976/0 (socket says 172.21.15.72:45976) 2023-08-31T18:48:46.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.774+0000 7fdf8cf9a700 1 -- 172.21.15.72:0/2875668790 learned_addr learned my addr 172.21.15.72:0/2875668790 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:46.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.774+0000 7fdf8df9c700 1 --2- 172.21.15.72:0/2875668790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf88158990 0x7fdf88154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:46.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.774+0000 7fdf8d79b700 1 --2- 172.21.15.72:0/2875668790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf88069410 0x7fdf88141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:46.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.774+0000 7fdf8cf9a700 1 -- 172.21.15.72:0/2875668790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf88158990 msgr2=0x7fdf88154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:46.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.774+0000 7fdf8cf9a700 1 --2- 172.21.15.72:0/2875668790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf88158990 0x7fdf88154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.774+0000 7fdf8cf9a700 1 -- 172.21.15.72:0/2875668790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf88069410 msgr2=0x7fdf88141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:46.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.774+0000 7fdf8cf9a700 1 --2- 172.21.15.72:0/2875668790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf88069410 0x7fdf88141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:46.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.774+0000 7fdf8cf9a700 1 -- 172.21.15.72:0/2875668790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf780092a0 con 0x7fdf881580c0 2023-08-31T18:48:46.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.774+0000 7fdf8cf9a700 1 --2- 172.21.15.72:0/2875668790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf881580c0 0x7fdf881549b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fdf78009e80 tx=0x7fdf78017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:46.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.775+0000 7fdf7d7fa700 1 -- 172.21.15.72:0/2875668790 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7800bcc0 con 0x7fdf881580c0 2023-08-31T18:48:46.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.775+0000 7fdf7d7fa700 1 -- 172.21.15.72:0/2875668790 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7800be20 con 0x7fdf881580c0 2023-08-31T18:48:46.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.775+0000 7fdf8f9ff700 1 -- 172.21.15.72:0/2875668790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf88167c90 con 0x7fdf881580c0 2023-08-31T18:48:46.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.775+0000 7fdf7d7fa700 1 -- 172.21.15.72:0/2875668790 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7801b640 con 0x7fdf881580c0 2023-08-31T18:48:46.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.775+0000 7fdf8f9ff700 1 -- 172.21.15.72:0/2875668790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf88168250 con 0x7fdf881580c0 2023-08-31T18:48:46.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.776+0000 7fdf8f9ff700 1 -- 172.21.15.72:0/2875668790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf880640e0 con 0x7fdf881580c0 2023-08-31T18:48:46.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.776+0000 7fdf7d7fa700 1 -- 172.21.15.72:0/2875668790 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fdf7801ba70 con 0x7fdf881580c0 2023-08-31T18:48:46.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.777+0000 7fdf7d7fa700 1 --2- 172.21.15.72:0/2875668790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf6c05ee10 0x7fdf6c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:46.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.778+0000 7fdf7d7fa700 1 -- 172.21.15.72:0/2875668790 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdf7807b670 con 0x7fdf881580c0 2023-08-31T18:48:46.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.778+0000 7fdf8d79b700 1 --2- 172.21.15.72:0/2875668790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf6c05ee10 0x7fdf6c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:46.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.778+0000 7fdf8d79b700 1 --2- 172.21.15.72:0/2875668790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf6c05ee10 0x7fdf6c0612d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fdf881548b0 tx=0x7fdf84008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:46.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:46.781+0000 7fdf7d7fa700 1 -- 172.21.15.72:0/2875668790 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdf880640e0 con 0x7fdf881580c0 2023-08-31T18:48:47.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.013+0000 7fdf8f9ff700 1 -- 172.21.15.72:0/2875668790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fdf88168770 con 0x7fdf881580c0 2023-08-31T18:48:47.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.017+0000 7fdf7d7fa700 1 -- 172.21.15.72:0/2875668790 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdf88168770 con 0x7fdf881580c0 2023-08-31T18:48:47.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.019+0000 7fdf8f9ff700 1 -- 172.21.15.72:0/2875668790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf6c05ee10 msgr2=0x7fdf6c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:47.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.019+0000 7fdf8f9ff700 1 --2- 172.21.15.72:0/2875668790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf6c05ee10 0x7fdf6c0612d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fdf881548b0 tx=0x7fdf84008040).stop 2023-08-31T18:48:47.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.019+0000 7fdf8f9ff700 1 -- 172.21.15.72:0/2875668790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf881580c0 msgr2=0x7fdf881549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:47.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.019+0000 7fdf8f9ff700 1 --2- 172.21.15.72:0/2875668790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf881580c0 0x7fdf881549b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fdf78009e80 tx=0x7fdf78017000).stop 2023-08-31T18:48:47.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.019+0000 7fdf8f9ff700 1 -- 172.21.15.72:0/2875668790 shutdown_connections 2023-08-31T18:48:47.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.019+0000 7fdf8f9ff700 1 --2- 172.21.15.72:0/2875668790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf88158990 0x7fdf88154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.019+0000 7fdf8f9ff700 1 --2- 172.21.15.72:0/2875668790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf6c05ee10 0x7fdf6c0612d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.019+0000 7fdf8f9ff700 1 --2- 172.21.15.72:0/2875668790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf88069410 0x7fdf88141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.020+0000 7fdf8f9ff700 1 --2- 172.21.15.72:0/2875668790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf881580c0 0x7fdf881549b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.020+0000 7fdf8f9ff700 1 -- 172.21.15.72:0/2875668790 >> 172.21.15.72:0/2875668790 conn(0x7fdf880c73a0 msgr2=0x7fdf881511f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:47.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.020+0000 7fdf8f9ff700 1 -- 172.21.15.72:0/2875668790 shutdown_connections 2023-08-31T18:48:47.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.020+0000 7fdf8f9ff700 1 -- 172.21.15.72:0/2875668790 wait complete. 2023-08-31T18:48:47.023 INFO:teuthology.orchestra.run.smithi072.stderr:updated 2023-08-31T18:48:47.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-31T18:48:47.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.227+0000 7f87063ff700 1 Processor -- start 2023-08-31T18:48:47.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.227+0000 7f87063ff700 1 -- start start 2023-08-31T18:48:47.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.228+0000 7f87063ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8700157c10 0x7f87000ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:47.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.229+0000 7f87063ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f87000637c0 0x7f8700155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:47.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.229+0000 7f87063ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87000c6130 con 0x7f87000ad1b0 2023-08-31T18:48:47.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.229+0000 7f87063ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87000c0350 con 0x7f8700157c10 2023-08-31T18:48:47.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.229+0000 7f87063ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87001580b0 con 0x7f87000637c0 2023-08-31T18:48:47.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.229+0000 7f86ff7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8700157c10 0x7f87000ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.229+0000 7f86fffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f87000ad1b0 0x7f87000630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41328/0 (socket says 172.21.15.72:41328) 2023-08-31T18:48:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.229+0000 7f86fffff700 1 -- 172.21.15.72:0/1967627901 learned_addr learned my addr 172.21.15.72:0/1967627901 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.229+0000 7f870499c700 1 --2- 172.21.15.72:0/1967627901 >> v2:172.21.15.146:3300/0 conn(0x7f87000637c0 0x7f8700155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.229+0000 7f86ff7fe700 1 -- 172.21.15.72:0/1967627901 >> v2:172.21.15.146:3300/0 conn(0x7f87000637c0 msgr2=0x7f8700155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.229+0000 7f86ff7fe700 1 --2- 172.21.15.72:0/1967627901 >> v2:172.21.15.146:3300/0 conn(0x7f87000637c0 0x7f8700155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.229+0000 7f86ff7fe700 1 -- 172.21.15.72:0/1967627901 >> v1:172.21.15.72:6789/0 conn(0x7f87000ad1b0 legacy=0x7f87000630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:47.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.229+0000 7f86feffd700 1 -- 172.21.15.72:0/1967627901 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697370790 0 0) 0x7f87000c6130 con 0x7f87000ad1b0 2023-08-31T18:48:47.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.229+0000 7f86ff7fe700 1 -- 172.21.15.72:0/1967627901 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8700155560 con 0x7f8700157c10 2023-08-31T18:48:47.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.229+0000 7f870499c700 1 --2- 172.21.15.72:0/1967627901 >> v2:172.21.15.146:3300/0 conn(0x7f87000637c0 0x7f8700155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:47.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.230+0000 7f86ff7fe700 1 --2- 172.21.15.72:0/1967627901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8700157c10 0x7f87000ad590 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f870014ec50 tx=0x7f86f4009060).ready entity=mon.0 client_cookie=61288789d3143626 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:47.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.230+0000 7f86feffd700 1 -- 172.21.15.72:0/1967627901 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f400b580 con 0x7f8700157c10 2023-08-31T18:48:47.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.230+0000 7f86feffd700 1 -- 172.21.15.72:0/1967627901 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f400b6e0 con 0x7f8700157c10 2023-08-31T18:48:47.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.230+0000 7f86feffd700 1 -- 172.21.15.72:0/1967627901 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f400ba60 con 0x7f8700157c10 2023-08-31T18:48:47.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.230+0000 7f87063ff700 1 -- 172.21.15.72:0/1967627901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8700157c10 msgr2=0x7f87000ad590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:47.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.230+0000 7f87063ff700 1 --2- 172.21.15.72:0/1967627901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8700157c10 0x7f87000ad590 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f870014ec50 tx=0x7f86f4009060).stop 2023-08-31T18:48:47.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.230+0000 7f87063ff700 1 -- 172.21.15.72:0/1967627901 shutdown_connections 2023-08-31T18:48:47.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.230+0000 7f87063ff700 1 --2- 172.21.15.72:0/1967627901 >> v2:172.21.15.146:3300/0 conn(0x7f87000637c0 0x7f8700155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.230+0000 7f87063ff700 1 --2- 172.21.15.72:0/1967627901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8700157c10 0x7f87000ad590 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.230+0000 7f87063ff700 1 -- 172.21.15.72:0/1967627901 >> 172.21.15.72:0/1967627901 conn(0x7f870005eb60 msgr2=0x7f87000cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:47.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.230+0000 7f87063ff700 1 -- 172.21.15.72:0/1967627901 shutdown_connections 2023-08-31T18:48:47.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.230+0000 7f87063ff700 1 -- 172.21.15.72:0/1967627901 wait complete. 2023-08-31T18:48:47.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.232+0000 7f87063ff700 1 Processor -- start 2023-08-31T18:48:47.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.232+0000 7f87063ff700 1 -- start start 2023-08-31T18:48:47.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.233+0000 7f87063ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87000637c0 0x7f870014a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:47.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.233+0000 7f87063ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87000ad1b0 0x7f87000adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:47.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.233+0000 7f87063ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700157c10 0x7f87000ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:47.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.233+0000 7f87063ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87000acbd0 con 0x7f87000637c0 2023-08-31T18:48:47.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.233+0000 7f87063ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87000abfc0 con 0x7f8700157c10 2023-08-31T18:48:47.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.233+0000 7f87063ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87000ac2a0 con 0x7f87000ad1b0 2023-08-31T18:48:47.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.233+0000 7f86fffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87000637c0 0x7f870014a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:47.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.233+0000 7f86fffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87000637c0 0x7f870014a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46002/0 (socket says 172.21.15.72:46002) 2023-08-31T18:48:47.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.233+0000 7f86fffff700 1 -- 172.21.15.72:0/1253768177 learned_addr learned my addr 172.21.15.72:0/1253768177 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:47.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.234+0000 7f86fffff700 1 -- 172.21.15.72:0/1253768177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87000ad1b0 msgr2=0x7f87000adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:47.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.234+0000 7f86fffff700 1 --2- 172.21.15.72:0/1253768177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87000ad1b0 0x7f87000adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:47.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.234+0000 7f86fffff700 1 -- 172.21.15.72:0/1253768177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700157c10 msgr2=0x7f87000ae450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:47.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.234+0000 7f870499c700 1 --2- 172.21.15.72:0/1253768177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700157c10 0x7f87000ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:47.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.234+0000 7f86fffff700 1 --2- 172.21.15.72:0/1253768177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700157c10 0x7f87000ae450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.234+0000 7f86fffff700 1 -- 172.21.15.72:0/1253768177 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f40092a0 con 0x7f87000637c0 2023-08-31T18:48:47.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.234+0000 7f870499c700 1 --2- 172.21.15.72:0/1253768177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700157c10 0x7f87000ae450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:47.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.234+0000 7f86fffff700 1 --2- 172.21.15.72:0/1253768177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87000637c0 0x7f870014a900 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f86f000c4e0 tx=0x7f86f0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:47.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.234+0000 7f86e7fff700 1 -- 172.21.15.72:0/1253768177 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f00072e0 con 0x7f87000637c0 2023-08-31T18:48:47.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.234+0000 7f86e7fff700 1 -- 172.21.15.72:0/1253768177 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f0007440 con 0x7f87000637c0 2023-08-31T18:48:47.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.234+0000 7f87063ff700 1 -- 172.21.15.72:0/1253768177 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87000ac580 con 0x7f87000637c0 2023-08-31T18:48:47.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.234+0000 7f86e7fff700 1 -- 172.21.15.72:0/1253768177 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f00057a0 con 0x7f87000637c0 2023-08-31T18:48:47.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.234+0000 7f87063ff700 1 -- 172.21.15.72:0/1253768177 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870014adf0 con 0x7f87000637c0 2023-08-31T18:48:47.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.235+0000 7f87063ff700 1 -- 172.21.15.72:0/1253768177 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870006c6b0 con 0x7f87000637c0 2023-08-31T18:48:47.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.236+0000 7f86e7fff700 1 -- 172.21.15.72:0/1253768177 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f86f0005bd0 con 0x7f87000637c0 2023-08-31T18:48:47.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.237+0000 7f86e7fff700 1 --2- 172.21.15.72:0/1253768177 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f86ec05ee10 0x7f86ec0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:47.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.237+0000 7f86e7fff700 1 -- 172.21.15.72:0/1253768177 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f86f0079540 con 0x7f87000637c0 2023-08-31T18:48:47.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.237+0000 7f86ff7fe700 1 --2- 172.21.15.72:0/1253768177 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f86ec05ee10 0x7f86ec0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:47.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.238+0000 7f86ff7fe700 1 --2- 172.21.15.72:0/1253768177 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f86ec05ee10 0x7f86ec0612d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f87001534e0 tx=0x7f86f4017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:47.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.241+0000 7f86e7fff700 1 -- 172.21.15.72:0/1253768177 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f86f004ace0 con 0x7f87000637c0 2023-08-31T18:48:47.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.473+0000 7f87063ff700 1 -- 172.21.15.72:0/1253768177 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f8700158350 con 0x7f87000637c0 2023-08-31T18:48:47.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.477+0000 7f86e7fff700 1 -- 172.21.15.72:0/1253768177 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f86f0018070 con 0x7f87000637c0 2023-08-31T18:48:47.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.479+0000 7f87063ff700 1 -- 172.21.15.72:0/1253768177 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f86ec05ee10 msgr2=0x7f86ec0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:47.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.479+0000 7f87063ff700 1 --2- 172.21.15.72:0/1253768177 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f86ec05ee10 0x7f86ec0612d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f87001534e0 tx=0x7f86f4017000).stop 2023-08-31T18:48:47.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.479+0000 7f87063ff700 1 -- 172.21.15.72:0/1253768177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87000637c0 msgr2=0x7f870014a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:47.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.479+0000 7f87063ff700 1 --2- 172.21.15.72:0/1253768177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87000637c0 0x7f870014a900 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f86f000c4e0 tx=0x7f86f0007c70).stop 2023-08-31T18:48:47.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.479+0000 7f87063ff700 1 -- 172.21.15.72:0/1253768177 shutdown_connections 2023-08-31T18:48:47.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.479+0000 7f87063ff700 1 --2- 172.21.15.72:0/1253768177 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f86ec05ee10 0x7f86ec0612d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.479+0000 7f87063ff700 1 --2- 172.21.15.72:0/1253768177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8700157c10 0x7f87000ae450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.479+0000 7f87063ff700 1 --2- 172.21.15.72:0/1253768177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87000637c0 0x7f870014a900 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.479+0000 7f87063ff700 1 --2- 172.21.15.72:0/1253768177 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87000ad1b0 0x7f87000adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:47.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.479+0000 7f87063ff700 1 -- 172.21.15.72:0/1253768177 >> 172.21.15.72:0/1253768177 conn(0x7f870005eb60 msgr2=0x7f8700153930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:47.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.479+0000 7f87063ff700 1 -- 172.21.15.72:0/1253768177 shutdown_connections 2023-08-31T18:48:47.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.479+0000 7f87063ff700 1 -- 172.21.15.72:0/1253768177 wait complete. 2023-08-31T18:48:47.482 INFO:teuthology.orchestra.run.smithi072.stderr:updated 2023-08-31T18:48:47.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-31T18:48:47.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.685+0000 7f2b811ff700 1 Processor -- start 2023-08-31T18:48:47.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.685+0000 7f2b811ff700 1 -- start start 2023-08-31T18:48:47.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.687+0000 7f2b811ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b7c153ca0 0x7f2b7c154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:47.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.687+0000 7f2b811ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b7c0c8ee0 0x7f2b7c158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:47.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.687+0000 7f2b811ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c0c9450 con 0x7f2b7c0ca4f0 2023-08-31T18:48:47.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.687+0000 7f2b811ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7c0c9730 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.687+0000 7f2b811ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0c9a10 con 0x7f2b7c153ca0 2023-08-31T18:48:47.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.687+0000 7f2b7a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b7c0c8ee0 0x7f2b7c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:47.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.687+0000 7f2b7a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b7c0c8ee0 0x7f2b7c158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46016/0 (socket says 172.21.15.72:46016) 2023-08-31T18:48:47.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.687+0000 7f2b7a59c700 1 -- 172.21.15.72:0/3740887261 learned_addr learned my addr 172.21.15.72:0/3740887261 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.687+0000 7f2b7ad9d700 1 --2- 172.21.15.72:0/3740887261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b7c153ca0 0x7f2b7c154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.687+0000 7f2b7a59c700 1 -- 172.21.15.72:0/3740887261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b7c153ca0 msgr2=0x7f2b7c154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.687+0000 7f2b7a59c700 1 --2- 172.21.15.72:0/3740887261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b7c153ca0 0x7f2b7c154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.687+0000 7f2b7a59c700 1 -- 172.21.15.72:0/3740887261 >> v1:172.21.15.146:6789/0 conn(0x7f2b7c0ca4f0 legacy=0x7f2b7c063100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.688+0000 7f2b7a59c700 1 -- 172.21.15.72:0/3740887261 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0c9cf0 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.688+0000 7f2b7a59c700 1 --2- 172.21.15.72:0/3740887261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b7c0c8ee0 0x7f2b7c158540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f2b70006fd0 tx=0x7f2b700090f0).ready entity=mon.0 client_cookie=fa7234df56157a23 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:47.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.688+0000 7f2b79d9b700 1 -- 172.21.15.72:0/3740887261 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7000b580 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.688+0000 7f2b79d9b700 1 -- 172.21.15.72:0/3740887261 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7000b6e0 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.688+0000 7f2b79d9b700 1 -- 172.21.15.72:0/3740887261 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7000ba60 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.688+0000 7f2b811ff700 1 -- 172.21.15.72:0/3740887261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b7c0c8ee0 msgr2=0x7f2b7c158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:47.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.688+0000 7f2b811ff700 1 --2- 172.21.15.72:0/3740887261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b7c0c8ee0 0x7f2b7c158540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f2b70006fd0 tx=0x7f2b700090f0).stop 2023-08-31T18:48:47.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.688+0000 7f2b811ff700 1 -- 172.21.15.72:0/3740887261 shutdown_connections 2023-08-31T18:48:47.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.689+0000 7f2b811ff700 1 --2- 172.21.15.72:0/3740887261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b7c153ca0 0x7f2b7c154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.689+0000 7f2b811ff700 1 --2- 172.21.15.72:0/3740887261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b7c0c8ee0 0x7f2b7c158540 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.689+0000 7f2b811ff700 1 -- 172.21.15.72:0/3740887261 >> 172.21.15.72:0/3740887261 conn(0x7f2b7c0cadb0 msgr2=0x7f2b7c0cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:47.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.689+0000 7f2b811ff700 1 -- 172.21.15.72:0/3740887261 shutdown_connections 2023-08-31T18:48:47.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.689+0000 7f2b811ff700 1 -- 172.21.15.72:0/3740887261 wait complete. 2023-08-31T18:48:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.690+0000 7f2b811ff700 1 Processor -- start 2023-08-31T18:48:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.690+0000 7f2b811ff700 1 -- start start 2023-08-31T18:48:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.691+0000 7f2b811ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b7c0c8ee0 0x7f2b7c166f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.691+0000 7f2b811ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b7c0ca4f0 0x7f2b7c1641f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.691+0000 7f2b811ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b7c153ca0 0x7f2b7c150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.691+0000 7f2b811ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0b0680 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.691+0000 7f2b811ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0add60 con 0x7f2b7c153ca0 2023-08-31T18:48:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.691+0000 7f2b811ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0ae8e0 con 0x7f2b7c0ca4f0 2023-08-31T18:48:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.691+0000 7f2b7ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b7c0c8ee0 0x7f2b7c166f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.691+0000 7f2b7ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b7c0c8ee0 0x7f2b7c166f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46032/0 (socket says 172.21.15.72:46032) 2023-08-31T18:48:47.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.691+0000 7f2b7ad9d700 1 -- 172.21.15.72:0/259371076 learned_addr learned my addr 172.21.15.72:0/259371076 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:47.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.692+0000 7f2b7b59e700 1 --2- 172.21.15.72:0/259371076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b7c153ca0 0x7f2b7c150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:47.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.692+0000 7f2b7a59c700 1 --2- 172.21.15.72:0/259371076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b7c0ca4f0 0x7f2b7c1641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:47.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.692+0000 7f2b7ad9d700 1 -- 172.21.15.72:0/259371076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b7c0ca4f0 msgr2=0x7f2b7c1641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:47.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.692+0000 7f2b7ad9d700 1 --2- 172.21.15.72:0/259371076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b7c0ca4f0 0x7f2b7c1641f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.692+0000 7f2b7ad9d700 1 -- 172.21.15.72:0/259371076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b7c153ca0 msgr2=0x7f2b7c150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:47.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.692+0000 7f2b7ad9d700 1 --2- 172.21.15.72:0/259371076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b7c153ca0 0x7f2b7c150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.692+0000 7f2b7ad9d700 1 -- 172.21.15.72:0/259371076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b70009370 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.692+0000 7f2b7ad9d700 1 --2- 172.21.15.72:0/259371076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b7c0c8ee0 0x7f2b7c166f00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f2b6c00e900 tx=0x7f2b6c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.692+0000 7f2b62ffd700 1 -- 172.21.15.72:0/259371076 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00c640 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.692+0000 7f2b62ffd700 1 -- 172.21.15.72:0/259371076 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c00c7a0 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.692+0000 7f2b62ffd700 1 -- 172.21.15.72:0/259371076 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00cb20 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.692+0000 7f2b811ff700 1 -- 172.21.15.72:0/259371076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c0adfb0 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.692+0000 7f2b811ff700 1 -- 172.21.15.72:0/259371076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c0ae570 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.693+0000 7f2b811ff700 1 -- 172.21.15.72:0/259371076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c0aebc0 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.694+0000 7f2b62ffd700 1 -- 172.21.15.72:0/259371076 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f2b6c01b400 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.695+0000 7f2b62ffd700 1 --2- 172.21.15.72:0/259371076 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b6805ee10 0x7f2b680612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:47.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.695+0000 7f2b62ffd700 1 -- 172.21.15.72:0/259371076 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2b6c079f70 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.695+0000 7f2b7a59c700 1 --2- 172.21.15.72:0/259371076 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b6805ee10 0x7f2b680612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:47.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.696+0000 7f2b7a59c700 1 --2- 172.21.15.72:0/259371076 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b6805ee10 0x7f2b680612d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f2b70006fd0 tx=0x7f2b70017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:47.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.699+0000 7f2b62ffd700 1 -- 172.21.15.72:0/259371076 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2b6c04b610 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.933+0000 7f2b811ff700 1 -- 172.21.15.72:0/259371076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f2b7c06c6b0 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.937+0000 7f2b62ffd700 1 -- 172.21.15.72:0/259371076 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v14) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2b6c016030 con 0x7f2b7c0c8ee0 2023-08-31T18:48:47.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.939+0000 7f2b811ff700 1 -- 172.21.15.72:0/259371076 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b6805ee10 msgr2=0x7f2b680612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:47.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.939+0000 7f2b811ff700 1 --2- 172.21.15.72:0/259371076 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b6805ee10 0x7f2b680612d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f2b70006fd0 tx=0x7f2b70017000).stop 2023-08-31T18:48:47.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.939+0000 7f2b811ff700 1 -- 172.21.15.72:0/259371076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b7c0c8ee0 msgr2=0x7f2b7c166f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.939+0000 7f2b811ff700 1 --2- 172.21.15.72:0/259371076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b7c0c8ee0 0x7f2b7c166f00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f2b6c00e900 tx=0x7f2b6c009060).stop 2023-08-31T18:48:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.940+0000 7f2b811ff700 1 -- 172.21.15.72:0/259371076 shutdown_connections 2023-08-31T18:48:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.940+0000 7f2b811ff700 1 --2- 172.21.15.72:0/259371076 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b6805ee10 0x7f2b680612d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.940+0000 7f2b811ff700 1 --2- 172.21.15.72:0/259371076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b7c153ca0 0x7f2b7c150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.940+0000 7f2b811ff700 1 --2- 172.21.15.72:0/259371076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b7c0c8ee0 0x7f2b7c166f00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.940+0000 7f2b811ff700 1 --2- 172.21.15.72:0/259371076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b7c0ca4f0 0x7f2b7c1641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.940+0000 7f2b811ff700 1 -- 172.21.15.72:0/259371076 >> 172.21.15.72:0/259371076 conn(0x7f2b7c0cadb0 msgr2=0x7f2b7c0ab780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.940+0000 7f2b811ff700 1 -- 172.21.15.72:0/259371076 shutdown_connections 2023-08-31T18:48:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:47.940+0000 7f2b811ff700 1 -- 172.21.15.72:0/259371076 wait complete. 2023-08-31T18:48:47.943 INFO:teuthology.orchestra.run.smithi072.stderr:updated 2023-08-31T18:48:47.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:48:48.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.146+0000 7ff44d5ff700 1 Processor -- start 2023-08-31T18:48:48.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.146+0000 7ff44d5ff700 1 -- start start 2023-08-31T18:48:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.147+0000 7ff44d5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff448154060 0x7ff448157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.147+0000 7ff44d5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4480c6120 con 0x7ff4480cb9b0 2023-08-31T18:48:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.147+0000 7ff44d5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4480c5e10 con 0x7ff4481588d0 2023-08-31T18:48:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.147+0000 7ff44d5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4480c1380 con 0x7ff448154060 2023-08-31T18:48:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.148+0000 7ff446ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff448154060 0x7ff448157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.148+0000 7ff4467fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff4480cb9b0 0x7ff4481581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41342/0 (socket says 172.21.15.72:41342) 2023-08-31T18:48:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.148+0000 7ff4467fc700 1 -- 172.21.15.72:0/1820955487 learned_addr learned my addr 172.21.15.72:0/1820955487 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.148+0000 7ff446ffd700 1 -- 172.21.15.72:0/1820955487 >> v1:172.21.15.146:6789/0 conn(0x7ff4481588d0 legacy=0x7ff448154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.148+0000 7ff446ffd700 1 -- 172.21.15.72:0/1820955487 >> v1:172.21.15.72:6789/0 conn(0x7ff4480cb9b0 legacy=0x7ff4481581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.148+0000 7ff446ffd700 1 -- 172.21.15.72:0/1820955487 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4480c0ae0 con 0x7ff448154060 2023-08-31T18:48:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.148+0000 7ff445ffb700 1 -- 172.21.15.72:0/1820955487 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532748367 0 0) 0x7ff4480c6120 con 0x7ff4480cb9b0 2023-08-31T18:48:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.148+0000 7ff446ffd700 1 --2- 172.21.15.72:0/1820955487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff448154060 0x7ff448157cd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7ff438006fd0 tx=0x7ff438006f40).ready entity=mon.0 client_cookie=d0003a8b3e097306 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.148+0000 7ff445ffb700 1 -- 172.21.15.72:0/1820955487 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438005880 con 0x7ff448154060 2023-08-31T18:48:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.148+0000 7ff445ffb700 1 -- 172.21.15.72:0/1820955487 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4380059e0 con 0x7ff448154060 2023-08-31T18:48:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.149+0000 7ff445ffb700 1 -- 172.21.15.72:0/1820955487 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438005d60 con 0x7ff448154060 2023-08-31T18:48:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.149+0000 7ff44d5ff700 1 -- 172.21.15.72:0/1820955487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff448154060 msgr2=0x7ff448157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.149+0000 7ff44d5ff700 1 --2- 172.21.15.72:0/1820955487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff448154060 0x7ff448157cd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7ff438006fd0 tx=0x7ff438006f40).stop 2023-08-31T18:48:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.149+0000 7ff44d5ff700 1 -- 172.21.15.72:0/1820955487 shutdown_connections 2023-08-31T18:48:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.149+0000 7ff44d5ff700 1 --2- 172.21.15.72:0/1820955487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff448154060 0x7ff448157cd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.149+0000 7ff44d5ff700 1 -- 172.21.15.72:0/1820955487 >> 172.21.15.72:0/1820955487 conn(0x7ff44805e870 msgr2=0x7ff4480cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.149+0000 7ff44d5ff700 1 -- 172.21.15.72:0/1820955487 shutdown_connections 2023-08-31T18:48:48.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.149+0000 7ff44d5ff700 1 -- 172.21.15.72:0/1820955487 wait complete. 2023-08-31T18:48:48.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.151+0000 7ff44d5ff700 1 Processor -- start 2023-08-31T18:48:48.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.151+0000 7ff44d5ff700 1 -- start start 2023-08-31T18:48:48.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff44d5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4480cb9b0 0x7ff4481417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff44d5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff448154060 0x7ff4480c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff44d5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4481588d0 0x7ff4480c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff44d5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480c7880 con 0x7ff448154060 2023-08-31T18:48:48.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff44d5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480aea50 con 0x7ff4480cb9b0 2023-08-31T18:48:48.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff44d5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480aed30 con 0x7ff4481588d0 2023-08-31T18:48:48.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff4467fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff448154060 0x7ff4480c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff4467fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff448154060 0x7ff4480c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46054/0 (socket says 172.21.15.72:46054) 2023-08-31T18:48:48.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff4467fc700 1 -- 172.21.15.72:0/2508714845 learned_addr learned my addr 172.21.15.72:0/2508714845 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:48.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff4477fe700 1 --2- 172.21.15.72:0/2508714845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4481588d0 0x7ff4480c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff446ffd700 1 --2- 172.21.15.72:0/2508714845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4480cb9b0 0x7ff4481417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff4467fc700 1 -- 172.21.15.72:0/2508714845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4481588d0 msgr2=0x7ff4480c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff4467fc700 1 --2- 172.21.15.72:0/2508714845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4481588d0 0x7ff4480c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff4467fc700 1 -- 172.21.15.72:0/2508714845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4480cb9b0 msgr2=0x7ff4481417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff4467fc700 1 --2- 172.21.15.72:0/2508714845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4480cb9b0 0x7ff4481417c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.152+0000 7ff4467fc700 1 -- 172.21.15.72:0/2508714845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438009250 con 0x7ff448154060 2023-08-31T18:48:48.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.153+0000 7ff4467fc700 1 --2- 172.21.15.72:0/2508714845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff448154060 0x7ff4480c6ea0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7ff43c00c4e0 tx=0x7ff43c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.153+0000 7ff42effd700 1 -- 172.21.15.72:0/2508714845 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0072e0 con 0x7ff448154060 2023-08-31T18:48:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.153+0000 7ff42effd700 1 -- 172.21.15.72:0/2508714845 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c007440 con 0x7ff448154060 2023-08-31T18:48:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.153+0000 7ff42effd700 1 -- 172.21.15.72:0/2508714845 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0057a0 con 0x7ff448154060 2023-08-31T18:48:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.153+0000 7ff44d5ff700 1 -- 172.21.15.72:0/2508714845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4480af010 con 0x7ff448154060 2023-08-31T18:48:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.153+0000 7ff44d5ff700 1 -- 172.21.15.72:0/2508714845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4480af5d0 con 0x7ff448154060 2023-08-31T18:48:48.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.154+0000 7ff44d5ff700 1 -- 172.21.15.72:0/2508714845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44806c6b0 con 0x7ff448154060 2023-08-31T18:48:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.155+0000 7ff42effd700 1 -- 172.21.15.72:0/2508714845 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7ff43c005bd0 con 0x7ff448154060 2023-08-31T18:48:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.155+0000 7ff42effd700 1 --2- 172.21.15.72:0/2508714845 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff43405ee10 0x7ff4340612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.155+0000 7ff42effd700 1 -- 172.21.15.72:0/2508714845 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff43c079320 con 0x7ff448154060 2023-08-31T18:48:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.156+0000 7ff446ffd700 1 --2- 172.21.15.72:0/2508714845 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff43405ee10 0x7ff4340612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.156+0000 7ff446ffd700 1 --2- 172.21.15.72:0/2508714845 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff43405ee10 0x7ff4340612d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7ff438009fd0 tx=0x7ff438016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:48.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.159+0000 7ff42effd700 1 -- 172.21.15.72:0/2508714845 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff43c04aa20 con 0x7ff448154060 2023-08-31T18:48:48.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.330+0000 7ff44d5ff700 1 -- 172.21.15.72:0/2508714845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4480c0dc0 con 0x7ff448154060 2023-08-31T18:48:48.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.331+0000 7ff42effd700 1 -- 172.21.15.72:0/2508714845 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13808 (secure 0 0 0) 0x7ff43c04e040 con 0x7ff448154060 2023-08-31T18:48:48.332 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:48.332 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":30,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:48:44.686698+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:48:48.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.333+0000 7ff44d5ff700 1 -- 172.21.15.72:0/2508714845 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff43405ee10 msgr2=0x7ff4340612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.333+0000 7ff44d5ff700 1 --2- 172.21.15.72:0/2508714845 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff43405ee10 0x7ff4340612d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7ff438009fd0 tx=0x7ff438016000).stop 2023-08-31T18:48:48.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.333+0000 7ff44d5ff700 1 -- 172.21.15.72:0/2508714845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff448154060 msgr2=0x7ff4480c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.333+0000 7ff44d5ff700 1 --2- 172.21.15.72:0/2508714845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff448154060 0x7ff4480c6ea0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7ff43c00c4e0 tx=0x7ff43c007c70).stop 2023-08-31T18:48:48.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.334+0000 7ff44d5ff700 1 -- 172.21.15.72:0/2508714845 shutdown_connections 2023-08-31T18:48:48.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.334+0000 7ff44d5ff700 1 --2- 172.21.15.72:0/2508714845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4481588d0 0x7ff4480c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.334+0000 7ff44d5ff700 1 --2- 172.21.15.72:0/2508714845 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff43405ee10 0x7ff4340612d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.334+0000 7ff44d5ff700 1 --2- 172.21.15.72:0/2508714845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4480cb9b0 0x7ff4481417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.334+0000 7ff44d5ff700 1 --2- 172.21.15.72:0/2508714845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff448154060 0x7ff4480c6ea0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.334+0000 7ff44d5ff700 1 -- 172.21.15.72:0/2508714845 >> 172.21.15.72:0/2508714845 conn(0x7ff44805e870 msgr2=0x7ff448063090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:48.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.334+0000 7ff44d5ff700 1 -- 172.21.15.72:0/2508714845 shutdown_connections 2023-08-31T18:48:48.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.334+0000 7ff44d5ff700 1 -- 172.21.15.72:0/2508714845 wait complete. 2023-08-31T18:48:48.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-31T18:48:48.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T18:48:48.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.545+0000 7f8d987ff700 1 Processor -- start 2023-08-31T18:48:48.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.545+0000 7f8d987ff700 1 -- start start 2023-08-31T18:48:48.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.546+0000 7f8d987ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d9014ecd0 0x7f8d901556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.546+0000 7f8d987ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d90152720 con 0x7f8d900c27a0 2023-08-31T18:48:48.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.546+0000 7f8d987ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d900c1f20 con 0x7f8d900c2320 2023-08-31T18:48:48.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.546+0000 7f8d987ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9006a6b0 con 0x7f8d9014ecd0 2023-08-31T18:48:48.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d96d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8d900c27a0 0x7f8d900c1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41356/0 (socket says 172.21.15.72:41356) 2023-08-31T18:48:48.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d96d9c700 1 -- 172.21.15.72:0/4156977665 learned_addr learned my addr 172.21.15.72:0/4156977665 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:48.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d9659b700 1 --2- 172.21.15.72:0/4156977665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d9014ecd0 0x7f8d901556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d95599700 1 -- 172.21.15.72:0/4156977665 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145140104 0 0) 0x7f8d90152720 con 0x7f8d900c27a0 2023-08-31T18:48:48.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d95599700 1 -- 172.21.15.72:0/4156977665 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d7c0033f0 con 0x7f8d900c27a0 2023-08-31T18:48:48.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d95599700 1 -- 172.21.15.72:0/4156977665 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 689189324 0 0) 0x7f8d7c0033f0 con 0x7f8d900c27a0 2023-08-31T18:48:48.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d95599700 1 -- 172.21.15.72:0/4156977665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d9014ecd0 msgr2=0x7f8d901556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:48.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d95599700 1 --2- 172.21.15.72:0/4156977665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d9014ecd0 0x7f8d901556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d95599700 1 -- 172.21.15.72:0/4156977665 >> v1:172.21.15.146:6789/0 conn(0x7f8d900c2320 legacy=0x7f8d900c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d95599700 1 -- 172.21.15.72:0/4156977665 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d900c2c50 con 0x7f8d900c27a0 2023-08-31T18:48:48.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d95599700 1 -- 172.21.15.72:0/4156977665 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f8d880017f0 con 0x7f8d900c27a0 2023-08-31T18:48:48.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d95599700 1 -- 172.21.15.72:0/4156977665 >> v1:172.21.15.72:6789/0 conn(0x7f8d900c27a0 legacy=0x7f8d900c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d95599700 1 --2- 172.21.15.72:0/4156977665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c003910 0x7f8d7c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d95599700 1 --2- 172.21.15.72:0/4156977665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d7c004690 0x7f8d7c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d95599700 1 --2- 172.21.15.72:0/4156977665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d9014ecd0 0x7f8d7c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d95599700 1 -- 172.21.15.72:0/4156977665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9006a6b0 con 0x7f8d7c003910 2023-08-31T18:48:48.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d95599700 1 -- 172.21.15.72:0/4156977665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c00b910 con 0x7f8d7c004690 2023-08-31T18:48:48.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.547+0000 7f8d95599700 1 -- 172.21.15.72:0/4156977665 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c00dce0 con 0x7f8d9014ecd0 2023-08-31T18:48:48.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.548+0000 7f8d9659b700 1 --2- 172.21.15.72:0/4156977665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c003910 0x7f8d7c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.548+0000 7f8d95d9a700 1 --2- 172.21.15.72:0/4156977665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d7c004690 0x7f8d7c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.548+0000 7f8d96d9c700 1 --2- 172.21.15.72:0/4156977665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d9014ecd0 0x7f8d7c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.548+0000 7f8d9659b700 1 -- 172.21.15.72:0/4156977665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d9014ecd0 msgr2=0x7f8d7c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:48.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.548+0000 7f8d9659b700 1 --2- 172.21.15.72:0/4156977665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d9014ecd0 0x7f8d7c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.548+0000 7f8d9659b700 1 -- 172.21.15.72:0/4156977665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d7c004690 msgr2=0x7f8d7c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:48.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.548+0000 7f8d9659b700 1 --2- 172.21.15.72:0/4156977665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d7c004690 0x7f8d7c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.548+0000 7f8d9659b700 1 -- 172.21.15.72:0/4156977665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c0033f0 con 0x7f8d7c003910 2023-08-31T18:48:48.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.548+0000 7f8d9659b700 1 --2- 172.21.15.72:0/4156977665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c003910 0x7f8d7c003d30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f8d8c009a80 tx=0x7f8d8c009060).ready entity=mon.0 client_cookie=297e17fe04ba9748 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:48.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.549+0000 7f8d95599700 1 -- 172.21.15.72:0/4156977665 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c009430 con 0x7f8d7c003910 2023-08-31T18:48:48.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.549+0000 7f8d95599700 1 -- 172.21.15.72:0/4156977665 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8c00e640 con 0x7f8d7c003910 2023-08-31T18:48:48.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.549+0000 7f8d95599700 1 -- 172.21.15.72:0/4156977665 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c00e9c0 con 0x7f8d7c003910 2023-08-31T18:48:48.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.549+0000 7f8d987ff700 1 -- 172.21.15.72:0/4156977665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c003910 msgr2=0x7f8d7c003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.549+0000 7f8d987ff700 1 --2- 172.21.15.72:0/4156977665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7c003910 0x7f8d7c003d30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f8d8c009a80 tx=0x7f8d8c009060).stop 2023-08-31T18:48:48.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.549+0000 7f8d96d9c700 1 -- 172.21.15.72:0/4156977665 reap_dead start 2023-08-31T18:48:48.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.549+0000 7f8d987ff700 1 -- 172.21.15.72:0/4156977665 shutdown_connections 2023-08-31T18:48:48.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.549+0000 7f8d987ff700 1 -- 172.21.15.72:0/4156977665 >> 172.21.15.72:0/4156977665 conn(0x7f8d900630c0 msgr2=0x7f8d900c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:48.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.549+0000 7f8d987ff700 1 -- 172.21.15.72:0/4156977665 shutdown_connections 2023-08-31T18:48:48.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.549+0000 7f8d987ff700 1 -- 172.21.15.72:0/4156977665 wait complete. 2023-08-31T18:48:48.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.551+0000 7f8d987ff700 1 Processor -- start 2023-08-31T18:48:48.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.551+0000 7f8d987ff700 1 -- start start 2023-08-31T18:48:48.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.552+0000 7f8d987ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d7c003910 0x7f8d900c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.552+0000 7f8d987ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9014dd40 0x7f8d9014e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.552+0000 7f8d987ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d900aaa60 0x7f8d900aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.552+0000 7f8d987ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d900ab3d0 con 0x7f8d900aaa60 2023-08-31T18:48:48.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.552+0000 7f8d987ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d900c3c00 con 0x7f8d9014dd40 2023-08-31T18:48:48.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.552+0000 7f8d987ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d900c3ea0 con 0x7f8d7c003910 2023-08-31T18:48:48.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.552+0000 7f8d96d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d900aaa60 0x7f8d900aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.552+0000 7f8d96d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d900aaa60 0x7f8d900aaee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46068/0 (socket says 172.21.15.72:46068) 2023-08-31T18:48:48.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.552+0000 7f8d96d9c700 1 -- 172.21.15.72:0/3381494947 learned_addr learned my addr 172.21.15.72:0/3381494947 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:48.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.553+0000 7f8d9659b700 1 --2- 172.21.15.72:0/3381494947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d7c003910 0x7f8d900c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.553+0000 7f8d95d9a700 1 --2- 172.21.15.72:0/3381494947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9014dd40 0x7f8d9014e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.553+0000 7f8d96d9c700 1 -- 172.21.15.72:0/3381494947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d7c003910 msgr2=0x7f8d900c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.553+0000 7f8d96d9c700 1 --2- 172.21.15.72:0/3381494947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d7c003910 0x7f8d900c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.553+0000 7f8d96d9c700 1 -- 172.21.15.72:0/3381494947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9014dd40 msgr2=0x7f8d9014e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.553+0000 7f8d96d9c700 1 --2- 172.21.15.72:0/3381494947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9014dd40 0x7f8d9014e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.553+0000 7f8d96d9c700 1 -- 172.21.15.72:0/3381494947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d900ac1b0 con 0x7f8d900aaa60 2023-08-31T18:48:48.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.553+0000 7f8d95d9a700 1 --2- 172.21.15.72:0/3381494947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9014dd40 0x7f8d9014e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:48.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.553+0000 7f8d96d9c700 1 --2- 172.21.15.72:0/3381494947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d900aaa60 0x7f8d900aaee0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f8d900c4610 tx=0x7f8d88001860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:48.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.553+0000 7f8d867fc700 1 -- 172.21.15.72:0/3381494947 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800f910 con 0x7f8d900aaa60 2023-08-31T18:48:48.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.553+0000 7f8d867fc700 1 -- 172.21.15.72:0/3381494947 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8800fa70 con 0x7f8d900aaa60 2023-08-31T18:48:48.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.553+0000 7f8d867fc700 1 -- 172.21.15.72:0/3381494947 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800fe30 con 0x7f8d900aaa60 2023-08-31T18:48:48.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.553+0000 7f8d987ff700 1 -- 172.21.15.72:0/3381494947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d900ac490 con 0x7f8d900aaa60 2023-08-31T18:48:48.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.553+0000 7f8d987ff700 1 -- 172.21.15.72:0/3381494947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d900a6ba0 con 0x7f8d900aaa60 2023-08-31T18:48:48.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.554+0000 7f8d987ff700 1 -- 172.21.15.72:0/3381494947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d900a6840 con 0x7f8d900aaa60 2023-08-31T18:48:48.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.555+0000 7f8d867fc700 1 -- 172.21.15.72:0/3381494947 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8d88012560 con 0x7f8d900aaa60 2023-08-31T18:48:48.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.556+0000 7f8d867fc700 1 --2- 172.21.15.72:0/3381494947 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8d7405ee10 0x7f8d740612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.556+0000 7f8d867fc700 1 -- 172.21.15.72:0/3381494947 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f8d880796b0 con 0x7f8d900aaa60 2023-08-31T18:48:48.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.556+0000 7f8d9659b700 1 --2- 172.21.15.72:0/3381494947 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8d7405ee10 0x7f8d740612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.556+0000 7f8d9659b700 1 --2- 172.21.15.72:0/3381494947 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8d7405ee10 0x7f8d740612d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f8d8c006d50 tx=0x7f8d8c01a000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:48.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.560+0000 7f8d867fc700 1 -- 172.21.15.72:0/3381494947 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8d8804aec0 con 0x7f8d900aaa60 2023-08-31T18:48:48.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.727+0000 7f8d987ff700 1 -- 172.21.15.72:0/3381494947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8d900a69f0 con 0x7f8d900aaa60 2023-08-31T18:48:48.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.727+0000 7f8d867fc700 1 -- 172.21.15.72:0/3381494947 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v30) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8d88019020 con 0x7f8d900aaa60 2023-08-31T18:48:48.728 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T18:48:48.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.729+0000 7f8d987ff700 1 -- 172.21.15.72:0/3381494947 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8d7405ee10 msgr2=0x7f8d740612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.729+0000 7f8d987ff700 1 --2- 172.21.15.72:0/3381494947 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8d7405ee10 0x7f8d740612d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f8d8c006d50 tx=0x7f8d8c01a000).stop 2023-08-31T18:48:48.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.729+0000 7f8d987ff700 1 -- 172.21.15.72:0/3381494947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d900aaa60 msgr2=0x7f8d900aaee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.729+0000 7f8d987ff700 1 --2- 172.21.15.72:0/3381494947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d900aaa60 0x7f8d900aaee0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f8d900c4610 tx=0x7f8d88001860).stop 2023-08-31T18:48:48.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.730+0000 7f8d987ff700 1 -- 172.21.15.72:0/3381494947 shutdown_connections 2023-08-31T18:48:48.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.730+0000 7f8d987ff700 1 --2- 172.21.15.72:0/3381494947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d900aaa60 0x7f8d900aaee0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.730+0000 7f8d987ff700 1 --2- 172.21.15.72:0/3381494947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8d7c003910 0x7f8d900c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.730+0000 7f8d987ff700 1 --2- 172.21.15.72:0/3381494947 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8d7405ee10 0x7f8d740612d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.730+0000 7f8d987ff700 1 --2- 172.21.15.72:0/3381494947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9014dd40 0x7f8d9014e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.730+0000 7f8d987ff700 1 -- 172.21.15.72:0/3381494947 >> 172.21.15.72:0/3381494947 conn(0x7f8d900630c0 msgr2=0x7f8d900c34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:48.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.730+0000 7f8d987ff700 1 -- 172.21.15.72:0/3381494947 shutdown_connections 2023-08-31T18:48:48.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.730+0000 7f8d987ff700 1 -- 172.21.15.72:0/3381494947 wait complete. 2023-08-31T18:48:48.747 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T18:48:48.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:48:48.804 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:48:48.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.942+0000 7fa011fff700 1 Processor -- start 2023-08-31T18:48:48.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.942+0000 7fa011fff700 1 -- start start 2023-08-31T18:48:48.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.944+0000 7fa011fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa00c153e30 0x7fa00c154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.944+0000 7fa011fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa00c0637c0 0x7fa00c0c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.944+0000 7fa011fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00c0bfd40 con 0x7fa00c0c5cb0 2023-08-31T18:48:48.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.944+0000 7fa011fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00c0c6730 con 0x7fa00c153e30 2023-08-31T18:48:48.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.944+0000 7fa011fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0bffe0 con 0x7fa00c0637c0 2023-08-31T18:48:48.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.944+0000 7fa00b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa00c153e30 0x7fa00c154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.944+0000 7fa00bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa00c0637c0 0x7fa00c0c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.944+0000 7fa00bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa00c0637c0 0x7fa00c0c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:60448/0 (socket says 172.21.15.72:60448) 2023-08-31T18:48:48.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.944+0000 7fa00b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa00c153e30 0x7fa00c154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:58040/0 (socket says 172.21.15.72:58040) 2023-08-31T18:48:48.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.944+0000 7fa00bfff700 1 -- 172.21.15.72:0/2644060821 learned_addr learned my addr 172.21.15.72:0/2644060821 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:48.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.945+0000 7fa00bfff700 1 -- 172.21.15.72:0/2644060821 >> v2:172.21.15.146:3300/0 conn(0x7fa00c153e30 msgr2=0x7fa00c154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:48.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.945+0000 7fa00bfff700 1 --2- 172.21.15.72:0/2644060821 >> v2:172.21.15.146:3300/0 conn(0x7fa00c153e30 0x7fa00c154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.945+0000 7fa00bfff700 1 -- 172.21.15.72:0/2644060821 >> v1:172.21.15.146:6789/0 conn(0x7fa00c0c5cb0 legacy=0x7fa00c0630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.945+0000 7fa00bfff700 1 -- 172.21.15.72:0/2644060821 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0c02c0 con 0x7fa00c0637c0 2023-08-31T18:48:48.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.945+0000 7fa00b7fe700 1 --2- 172.21.15.72:0/2644060821 >> v2:172.21.15.146:3300/0 conn(0x7fa00c153e30 0x7fa00c154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:48.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.945+0000 7fa00bfff700 1 --2- 172.21.15.72:0/2644060821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa00c0637c0 0x7fa00c0c6160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa004009f20 tx=0x7fa004009840).ready entity=mon.2 client_cookie=c5eb1aa7049c84c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:48.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.945+0000 7fa00a7fc700 1 -- 172.21.15.72:0/2644060821 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00400e070 con 0x7fa00c0637c0 2023-08-31T18:48:48.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.945+0000 7fa00a7fc700 1 -- 172.21.15.72:0/2644060821 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00400b9d0 con 0x7fa00c0637c0 2023-08-31T18:48:48.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.945+0000 7fa00a7fc700 1 -- 172.21.15.72:0/2644060821 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00400bd50 con 0x7fa00c0637c0 2023-08-31T18:48:48.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.946+0000 7fa011fff700 1 -- 172.21.15.72:0/2644060821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa00c0637c0 msgr2=0x7fa00c0c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.946+0000 7fa011fff700 1 --2- 172.21.15.72:0/2644060821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa00c0637c0 0x7fa00c0c6160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa004009f20 tx=0x7fa004009840).stop 2023-08-31T18:48:48.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.946+0000 7fa011fff700 1 -- 172.21.15.72:0/2644060821 shutdown_connections 2023-08-31T18:48:48.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.946+0000 7fa011fff700 1 --2- 172.21.15.72:0/2644060821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa00c0637c0 0x7fa00c0c6160 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.946+0000 7fa011fff700 1 --2- 172.21.15.72:0/2644060821 >> v2:172.21.15.146:3300/0 conn(0x7fa00c153e30 0x7fa00c154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.946+0000 7fa011fff700 1 -- 172.21.15.72:0/2644060821 >> 172.21.15.72:0/2644060821 conn(0x7fa00c05eb20 msgr2=0x7fa00c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.946+0000 7fa011fff700 1 -- 172.21.15.72:0/2644060821 shutdown_connections 2023-08-31T18:48:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.946+0000 7fa011fff700 1 -- 172.21.15.72:0/2644060821 wait complete. 2023-08-31T18:48:48.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.947+0000 7fa011fff700 1 Processor -- start 2023-08-31T18:48:48.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.947+0000 7fa011fff700 1 -- start start 2023-08-31T18:48:48.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.948+0000 7fa011fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa00c0637c0 0x7fa00c14fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.948+0000 7fa011fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa00c0c5cb0 0x7fa00c0acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.948+0000 7fa011fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00c153e30 0x7fa00c0ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.948+0000 7fa011fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0ad520 con 0x7fa00c0c5cb0 2023-08-31T18:48:48.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.948+0000 7fa011fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0af9a0 con 0x7fa00c153e30 2023-08-31T18:48:48.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.948+0000 7fa011fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0aed90 con 0x7fa00c0637c0 2023-08-31T18:48:48.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.949+0000 7fa00b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa00c0637c0 0x7fa00c14fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.949+0000 7fa00b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa00c0637c0 0x7fa00c14fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:60456/0 (socket says 172.21.15.72:60456) 2023-08-31T18:48:48.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.949+0000 7fa00b7fe700 1 -- 172.21.15.72:0/2241454172 learned_addr learned my addr 172.21.15.72:0/2241454172 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:48.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.949+0000 7fa00affd700 1 --2- 172.21.15.72:0/2241454172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa00c0c5cb0 0x7fa00c0acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.949+0000 7fa00bfff700 1 --2- 172.21.15.72:0/2241454172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00c153e30 0x7fa00c0ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.949+0000 7fa00b7fe700 1 -- 172.21.15.72:0/2241454172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00c153e30 msgr2=0x7fa00c0ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.949+0000 7fa00b7fe700 1 --2- 172.21.15.72:0/2241454172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00c153e30 0x7fa00c0ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.949+0000 7fa00b7fe700 1 -- 172.21.15.72:0/2241454172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa00c0c5cb0 msgr2=0x7fa00c0acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:48.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.949+0000 7fa00b7fe700 1 --2- 172.21.15.72:0/2241454172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa00c0c5cb0 0x7fa00c0acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:48.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.949+0000 7fa00b7fe700 1 -- 172.21.15.72:0/2241454172 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc0092a0 con 0x7fa00c0637c0 2023-08-31T18:48:48.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.949+0000 7fa00affd700 1 --2- 172.21.15.72:0/2241454172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa00c0c5cb0 0x7fa00c0acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:48.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.949+0000 7fa00b7fe700 1 --2- 172.21.15.72:0/2241454172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa00c0637c0 0x7fa00c14fc10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9ffc00e9b0 tx=0x7f9ffc009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:48.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.950+0000 7f9ff37fe700 1 -- 172.21.15.72:0/2241454172 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc00c670 con 0x7fa00c0637c0 2023-08-31T18:48:48.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.950+0000 7f9ff37fe700 1 -- 172.21.15.72:0/2241454172 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc00c7d0 con 0x7fa00c0637c0 2023-08-31T18:48:48.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.950+0000 7fa011fff700 1 -- 172.21.15.72:0/2241454172 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa004009ae0 con 0x7fa00c0637c0 2023-08-31T18:48:48.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.950+0000 7f9ff37fe700 1 -- 172.21.15.72:0/2241454172 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc00cb50 con 0x7fa00c0637c0 2023-08-31T18:48:48.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.950+0000 7fa011fff700 1 -- 172.21.15.72:0/2241454172 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00c0af350 con 0x7fa00c0637c0 2023-08-31T18:48:48.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.951+0000 7fa011fff700 1 -- 172.21.15.72:0/2241454172 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00c06c6b0 con 0x7fa00c0637c0 2023-08-31T18:48:48.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.951+0000 7f9ff37fe700 1 -- 172.21.15.72:0/2241454172 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9ffc01b400 con 0x7fa00c0637c0 2023-08-31T18:48:48.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.952+0000 7f9ff37fe700 1 --2- 172.21.15.72:0/2241454172 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ff805ee10 0x7f9ff80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:48.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.952+0000 7f9ff37fe700 1 -- 172.21.15.72:0/2241454172 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9ffc079f40 con 0x7fa00c0637c0 2023-08-31T18:48:48.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.952+0000 7fa00affd700 1 --2- 172.21.15.72:0/2241454172 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ff805ee10 0x7f9ff80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:48.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.953+0000 7fa00affd700 1 --2- 172.21.15.72:0/2241454172 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ff805ee10 0x7f9ff80612d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fa00c0656f0 tx=0x7fa000009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:48.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:48.957+0000 7f9ff37fe700 1 -- 172.21.15.72:0/2241454172 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ffc04b6a0 con 0x7fa00c0637c0 2023-08-31T18:48:49.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.127+0000 7fa011fff700 1 -- 172.21.15.72:0/2241454172 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa00c150540 con 0x7fa00c0637c0 2023-08-31T18:48:49.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.128+0000 7f9ff37fe700 1 -- 172.21.15.72:0/2241454172 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa00c150540 con 0x7fa00c0637c0 2023-08-31T18:48:49.128 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T18:48:49.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.130+0000 7fa011fff700 1 -- 172.21.15.72:0/2241454172 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ff805ee10 msgr2=0x7f9ff80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:49.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.130+0000 7fa011fff700 1 --2- 172.21.15.72:0/2241454172 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ff805ee10 0x7f9ff80612d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fa00c0656f0 tx=0x7fa000009040).stop 2023-08-31T18:48:49.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.130+0000 7fa011fff700 1 -- 172.21.15.72:0/2241454172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa00c0637c0 msgr2=0x7fa00c14fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:49.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.130+0000 7fa011fff700 1 --2- 172.21.15.72:0/2241454172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa00c0637c0 0x7fa00c14fc10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9ffc00e9b0 tx=0x7f9ffc009060).stop 2023-08-31T18:48:49.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.130+0000 7fa011fff700 1 -- 172.21.15.72:0/2241454172 shutdown_connections 2023-08-31T18:48:49.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.130+0000 7fa011fff700 1 --2- 172.21.15.72:0/2241454172 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ff805ee10 0x7f9ff80612d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:49.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.130+0000 7fa011fff700 1 --2- 172.21.15.72:0/2241454172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00c153e30 0x7fa00c0ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:49.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.130+0000 7fa011fff700 1 --2- 172.21.15.72:0/2241454172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa00c0637c0 0x7fa00c14fc10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:49.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.130+0000 7fa011fff700 1 --2- 172.21.15.72:0/2241454172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa00c0c5cb0 0x7fa00c0acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:49.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.130+0000 7fa011fff700 1 -- 172.21.15.72:0/2241454172 >> 172.21.15.72:0/2241454172 conn(0x7fa00c05eb20 msgr2=0x7fa00c0ab3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:49.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.130+0000 7fa011fff700 1 -- 172.21.15.72:0/2241454172 shutdown_connections 2023-08-31T18:48:49.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.130+0000 7fa011fff700 1 -- 172.21.15.72:0/2241454172 wait complete. 2023-08-31T18:48:49.148 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T18:48:49.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.337+0000 7fc2091ff700 1 Processor -- start 2023-08-31T18:48:49.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.337+0000 7fc2091ff700 1 -- start start 2023-08-31T18:48:49.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.339+0000 7fc2091ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc2040c9ca0 0x7fc2041583f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:49.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.339+0000 7fc2091ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2040c7620 con 0x7fc2041588e0 2023-08-31T18:48:49.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.339+0000 7fc2091ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2040c0830 con 0x7fc2041575b0 2023-08-31T18:48:49.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.339+0000 7fc2091ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2040c0b10 con 0x7fc2040c9ca0 2023-08-31T18:48:49.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.339+0000 7fc20359e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc2041588e0 0x7fc2040c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41366/0 (socket says 172.21.15.72:41366) 2023-08-31T18:48:49.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.339+0000 7fc20359e700 1 -- 172.21.15.72:0/3169286363 learned_addr learned my addr 172.21.15.72:0/3169286363 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:49.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.339+0000 7fc20259c700 1 --2- 172.21.15.72:0/3169286363 >> v2:172.21.15.146:3300/0 conn(0x7fc2040c9ca0 0x7fc2041583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:49.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.339+0000 7fc201d9b700 1 -- 172.21.15.72:0/3169286363 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300687634 0 0) 0x7fc2040c7620 con 0x7fc2041588e0 2023-08-31T18:48:49.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.339+0000 7fc201d9b700 1 -- 172.21.15.72:0/3169286363 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1ec0033f0 con 0x7fc2041588e0 2023-08-31T18:48:49.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.339+0000 7fc201d9b700 1 -- 172.21.15.72:0/3169286363 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127236214 0 0) 0x7fc2040c0830 con 0x7fc2041575b0 2023-08-31T18:48:49.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.339+0000 7fc201d9b700 1 -- 172.21.15.72:0/3169286363 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2040c7620 con 0x7fc2041575b0 2023-08-31T18:48:49.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.340+0000 7fc20259c700 1 -- 172.21.15.72:0/3169286363 >> v1:172.21.15.146:6789/0 conn(0x7fc2041575b0 legacy=0x7fc204157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:49.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.340+0000 7fc201d9b700 1 -- 172.21.15.72:0/3169286363 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 234221711 0 0) 0x7fc1ec0033f0 con 0x7fc2041588e0 2023-08-31T18:48:49.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.340+0000 7fc20259c700 1 -- 172.21.15.72:0/3169286363 >> v1:172.21.15.72:6789/0 conn(0x7fc2041588e0 legacy=0x7fc2040c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:49.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.340+0000 7fc20259c700 1 -- 172.21.15.72:0/3169286363 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2040c0df0 con 0x7fc2040c9ca0 2023-08-31T18:48:49.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.340+0000 7fc20259c700 1 --2- 172.21.15.72:0/3169286363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2040c9ca0 0x7fc2041583f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fc1f8009760 tx=0x7fc1f8009060).ready entity=mon.1 client_cookie=f3363acf0dc8b872 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:49.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.340+0000 7fc201d9b700 1 -- 172.21.15.72:0/3169286363 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc0017f0 con 0x7fc2040c9ca0 2023-08-31T18:48:49.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.340+0000 7fc201d9b700 1 -- 172.21.15.72:0/3169286363 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f8011400 con 0x7fc2040c9ca0 2023-08-31T18:48:49.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.340+0000 7fc201d9b700 1 -- 172.21.15.72:0/3169286363 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8011780 con 0x7fc2040c9ca0 2023-08-31T18:48:49.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.340+0000 7fc2091ff700 1 -- 172.21.15.72:0/3169286363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2040c9ca0 msgr2=0x7fc2041583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:49.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.340+0000 7fc2091ff700 1 --2- 172.21.15.72:0/3169286363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2040c9ca0 0x7fc2041583f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fc1f8009760 tx=0x7fc1f8009060).stop 2023-08-31T18:48:49.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.341+0000 7fc2091ff700 1 -- 172.21.15.72:0/3169286363 shutdown_connections 2023-08-31T18:48:49.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.341+0000 7fc2091ff700 1 --2- 172.21.15.72:0/3169286363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2040c9ca0 0x7fc2041583f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:49.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.341+0000 7fc2091ff700 1 -- 172.21.15.72:0/3169286363 >> 172.21.15.72:0/3169286363 conn(0x7fc20405e870 msgr2=0x7fc2040cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:49.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.341+0000 7fc2091ff700 1 -- 172.21.15.72:0/3169286363 shutdown_connections 2023-08-31T18:48:49.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.341+0000 7fc2091ff700 1 -- 172.21.15.72:0/3169286363 wait complete. 2023-08-31T18:48:49.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.343+0000 7fc2091ff700 1 Processor -- start 2023-08-31T18:48:49.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.343+0000 7fc2091ff700 1 -- start start 2023-08-31T18:48:49.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.344+0000 7fc2091ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2040c9ca0 0x7fc2040c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:49.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.344+0000 7fc2091ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2041575b0 0x7fc2040c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:49.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.344+0000 7fc2091ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2041588e0 0x7fc204165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:49.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.344+0000 7fc2091ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040c97c0 con 0x7fc2041588e0 2023-08-31T18:48:49.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.344+0000 7fc2091ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040abd90 con 0x7fc2040c9ca0 2023-08-31T18:48:49.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.344+0000 7fc2091ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040af3c0 con 0x7fc2041575b0 2023-08-31T18:48:49.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.344+0000 7fc20359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2041588e0 0x7fc204165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:49.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.344+0000 7fc20359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2041588e0 0x7fc204165010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46098/0 (socket says 172.21.15.72:46098) 2023-08-31T18:48:49.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.344+0000 7fc20359e700 1 -- 172.21.15.72:0/2429408509 learned_addr learned my addr 172.21.15.72:0/2429408509 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:49.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.345+0000 7fc202d9d700 1 --2- 172.21.15.72:0/2429408509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2040c9ca0 0x7fc2040c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:49.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.345+0000 7fc20259c700 1 --2- 172.21.15.72:0/2429408509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2041575b0 0x7fc2040c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:49.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.345+0000 7fc20359e700 1 -- 172.21.15.72:0/2429408509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2041575b0 msgr2=0x7fc2040c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:49.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.345+0000 7fc20359e700 1 --2- 172.21.15.72:0/2429408509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2041575b0 0x7fc2040c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:49.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.345+0000 7fc20359e700 1 -- 172.21.15.72:0/2429408509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2040c9ca0 msgr2=0x7fc2040c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:49.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.345+0000 7fc20359e700 1 --2- 172.21.15.72:0/2429408509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2040c9ca0 0x7fc2040c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:49.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.345+0000 7fc20359e700 1 -- 172.21.15.72:0/2429408509 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f80092a0 con 0x7fc2041588e0 2023-08-31T18:48:49.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.345+0000 7fc20359e700 1 --2- 172.21.15.72:0/2429408509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2041588e0 0x7fc204165010 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fc1fc00cb60 tx=0x7fc1fc0018e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:49.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.345+0000 7fc1eaffd700 1 -- 172.21.15.72:0/2429408509 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc00ce70 con 0x7fc2041588e0 2023-08-31T18:48:49.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.345+0000 7fc1eaffd700 1 -- 172.21.15.72:0/2429408509 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc004c40 con 0x7fc2041588e0 2023-08-31T18:48:49.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.345+0000 7fc1eaffd700 1 -- 172.21.15.72:0/2429408509 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc007170 con 0x7fc2041588e0 2023-08-31T18:48:49.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.345+0000 7fc2091ff700 1 -- 172.21.15.72:0/2429408509 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2040af6a0 con 0x7fc2041588e0 2023-08-31T18:48:49.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.346+0000 7fc2091ff700 1 -- 172.21.15.72:0/2429408509 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2040afc60 con 0x7fc2041588e0 2023-08-31T18:48:49.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.347+0000 7fc2091ff700 1 -- 172.21.15.72:0/2429408509 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20406acb0 con 0x7fc2041588e0 2023-08-31T18:48:49.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.347+0000 7fc1eaffd700 1 -- 172.21.15.72:0/2429408509 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc1fc0075a0 con 0x7fc2041588e0 2023-08-31T18:48:49.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.348+0000 7fc1eaffd700 1 --2- 172.21.15.72:0/2429408509 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc1f005ee10 0x7fc1f00612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:49.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.348+0000 7fc1eaffd700 1 -- 172.21.15.72:0/2429408509 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc1fc079760 con 0x7fc2041588e0 2023-08-31T18:48:49.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.348+0000 7fc202d9d700 1 --2- 172.21.15.72:0/2429408509 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc1f005ee10 0x7fc1f00612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:49.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.349+0000 7fc202d9d700 1 --2- 172.21.15.72:0/2429408509 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc1f005ee10 0x7fc1f00612d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fc1f4003960 tx=0x7fc1f4007bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:49.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.352+0000 7fc1eaffd700 1 -- 172.21.15.72:0/2429408509 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc20406acb0 con 0x7fc2041588e0 2023-08-31T18:48:49.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.527+0000 7fc2091ff700 1 -- 172.21.15.72:0/2429408509 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc20406acb0 con 0x7fc2041588e0 2023-08-31T18:48:49.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.528+0000 7fc1eaffd700 1 -- 172.21.15.72:0/2429408509 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc1fc0190a0 con 0x7fc2041588e0 2023-08-31T18:48:49.528 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:49.529 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T18:48:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-08-31T18:48:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "device_health_metrics" 2023-08-31T18:48:49.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T18:48:49.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:48:49.530 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-08-31T18:48:49.530 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-08-31T18:48:49.530 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:48:49.530 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T18:48:49.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.530+0000 7fc2091ff700 1 -- 172.21.15.72:0/2429408509 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc1f005ee10 msgr2=0x7fc1f00612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:49.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.530+0000 7fc2091ff700 1 --2- 172.21.15.72:0/2429408509 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc1f005ee10 0x7fc1f00612d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fc1f4003960 tx=0x7fc1f4007bc0).stop 2023-08-31T18:48:49.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.530+0000 7fc2091ff700 1 -- 172.21.15.72:0/2429408509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2041588e0 msgr2=0x7fc204165010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:49.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.530+0000 7fc2091ff700 1 --2- 172.21.15.72:0/2429408509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2041588e0 0x7fc204165010 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fc1fc00cb60 tx=0x7fc1fc0018e0).stop 2023-08-31T18:48:49.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.530+0000 7fc2091ff700 1 -- 172.21.15.72:0/2429408509 shutdown_connections 2023-08-31T18:48:49.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.530+0000 7fc2091ff700 1 --2- 172.21.15.72:0/2429408509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2041588e0 0x7fc204165010 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:49.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.530+0000 7fc2091ff700 1 --2- 172.21.15.72:0/2429408509 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc1f005ee10 0x7fc1f00612d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:49.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.530+0000 7fc2091ff700 1 --2- 172.21.15.72:0/2429408509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2040c9ca0 0x7fc2040c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:49.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.530+0000 7fc2091ff700 1 --2- 172.21.15.72:0/2429408509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2041575b0 0x7fc2040c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:49.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.530+0000 7fc2091ff700 1 -- 172.21.15.72:0/2429408509 >> 172.21.15.72:0/2429408509 conn(0x7fc20405e870 msgr2=0x7fc2040a9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:49.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.530+0000 7fc2091ff700 1 -- 172.21.15.72:0/2429408509 shutdown_connections 2023-08-31T18:48:49.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.530+0000 7fc2091ff700 1 -- 172.21.15.72:0/2429408509 wait complete. 2023-08-31T18:48:49.547 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T18:48:49.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-31T18:48:49.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.741+0000 7f2a36bff700 1 Processor -- start 2023-08-31T18:48:49.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.741+0000 7f2a36bff700 1 -- start start 2023-08-31T18:48:49.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.742+0000 7f2a36bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a30064d70 0x7f2a301553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:49.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.742+0000 7f2a36bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a300c5370 0x7f2a300bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:49.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.742+0000 7f2a36bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a30154f40 con 0x7f2a30151da0 2023-08-31T18:48:49.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.742+0000 7f2a36bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a300c57e0 con 0x7f2a300c5370 2023-08-31T18:48:49.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.742+0000 7f2a36bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a30154960 con 0x7f2a30064d70 2023-08-31T18:48:49.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.742+0000 7f2a3499b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2a30151da0 0x7f2a30064660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41376/0 (socket says 172.21.15.72:41376) 2023-08-31T18:48:49.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.742+0000 7f2a3499b700 1 -- 172.21.15.72:0/1030680434 learned_addr learned my addr 172.21.15.72:0/1030680434 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:49.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a3519c700 1 --2- 172.21.15.72:0/1030680434 >> v2:172.21.15.146:3300/0 conn(0x7f2a300c5370 0x7f2a300bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:49.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2ffff700 1 --2- 172.21.15.72:0/1030680434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a30064d70 0x7f2a301553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:49.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 -- 172.21.15.72:0/1030680434 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506050447 0 0) 0x7f2a30154f40 con 0x7f2a30151da0 2023-08-31T18:48:49.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 -- 172.21.15.72:0/1030680434 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a200033f0 con 0x7f2a30151da0 2023-08-31T18:48:49.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 -- 172.21.15.72:0/1030680434 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3915705995 0 0) 0x7f2a200033f0 con 0x7f2a30151da0 2023-08-31T18:48:49.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 -- 172.21.15.72:0/1030680434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a30064d70 msgr2=0x7f2a301553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:49.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 --2- 172.21.15.72:0/1030680434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a30064d70 0x7f2a301553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:49.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 -- 172.21.15.72:0/1030680434 >> v2:172.21.15.146:3300/0 conn(0x7f2a300c5370 msgr2=0x7f2a300bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:49.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 --2- 172.21.15.72:0/1030680434 >> v2:172.21.15.146:3300/0 conn(0x7f2a300c5370 0x7f2a300bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:49.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 -- 172.21.15.72:0/1030680434 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a300aa2c0 con 0x7f2a30151da0 2023-08-31T18:48:49.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 -- 172.21.15.72:0/1030680434 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f2a24001470 con 0x7f2a30151da0 2023-08-31T18:48:49.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 -- 172.21.15.72:0/1030680434 >> v1:172.21.15.72:6789/0 conn(0x7f2a30151da0 legacy=0x7f2a30064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:49.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 --2- 172.21.15.72:0/1030680434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a200038e0 0x7f2a20003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:49.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 --2- 172.21.15.72:0/1030680434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a20004690 0x7f2a20004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:49.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 --2- 172.21.15.72:0/1030680434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a30064d70 0x7f2a20005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:49.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 -- 172.21.15.72:0/1030680434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a30154960 con 0x7f2a20004690 2023-08-31T18:48:49.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 -- 172.21.15.72:0/1030680434 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a200044b0 con 0x7f2a200038e0 2023-08-31T18:48:49.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.743+0000 7f2a2f7fe700 1 -- 172.21.15.72:0/1030680434 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2000b910 con 0x7f2a30064d70 2023-08-31T18:48:49.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.744+0000 7f2a2ffff700 1 --2- 172.21.15.72:0/1030680434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a20004690 0x7f2a20004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:49.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.744+0000 7f2a3499b700 1 --2- 172.21.15.72:0/1030680434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a200038e0 0x7f2a20003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:49.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.744+0000 7f2a3519c700 1 --2- 172.21.15.72:0/1030680434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a30064d70 0x7f2a20005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:49.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.744+0000 7f2a2ffff700 1 -- 172.21.15.72:0/1030680434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a30064d70 msgr2=0x7f2a20005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:49.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.744+0000 7f2a2ffff700 1 --2- 172.21.15.72:0/1030680434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a30064d70 0x7f2a20005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:49.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.744+0000 7f2a2ffff700 1 -- 172.21.15.72:0/1030680434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a200038e0 msgr2=0x7f2a20003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:49.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.744+0000 7f2a2ffff700 1 --2- 172.21.15.72:0/1030680434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a200038e0 0x7f2a20003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:49.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.744+0000 7f2a2ffff700 1 -- 172.21.15.72:0/1030680434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a200033f0 con 0x7f2a20004690 2023-08-31T18:48:49.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.744+0000 7f2a3519c700 1 --2- 172.21.15.72:0/1030680434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a30064d70 0x7f2a20005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:49.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.744+0000 7f2a2ffff700 1 --2- 172.21.15.72:0/1030680434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a20004690 0x7f2a20004b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f2a30065170 tx=0x7f2a1c009060).ready entity=mon.0 client_cookie=b887a8b9c290be3d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:49.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.744+0000 7f2a2f7fe700 1 -- 172.21.15.72:0/1030680434 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c009e90 con 0x7f2a20004690 2023-08-31T18:48:49.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.744+0000 7f2a2f7fe700 1 -- 172.21.15.72:0/1030680434 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c009430 con 0x7f2a20004690 2023-08-31T18:48:49.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.744+0000 7f2a2f7fe700 1 -- 172.21.15.72:0/1030680434 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00e850 con 0x7f2a20004690 2023-08-31T18:48:49.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.745+0000 7f2a36bff700 1 -- 172.21.15.72:0/1030680434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a20004690 msgr2=0x7f2a20004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:49.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.745+0000 7f2a36bff700 1 --2- 172.21.15.72:0/1030680434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a20004690 0x7f2a20004b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f2a30065170 tx=0x7f2a1c009060).stop 2023-08-31T18:48:49.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.745+0000 7f2a3519c700 1 -- 172.21.15.72:0/1030680434 reap_dead start 2023-08-31T18:48:49.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.745+0000 7f2a36bff700 1 -- 172.21.15.72:0/1030680434 shutdown_connections 2023-08-31T18:48:49.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.745+0000 7f2a36bff700 1 -- 172.21.15.72:0/1030680434 >> 172.21.15.72:0/1030680434 conn(0x7f2a30063a90 msgr2=0x7f2a300cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:49.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.745+0000 7f2a36bff700 1 -- 172.21.15.72:0/1030680434 shutdown_connections 2023-08-31T18:48:49.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.745+0000 7f2a36bff700 1 -- 172.21.15.72:0/1030680434 wait complete. 2023-08-31T18:48:49.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.747+0000 7f2a36bff700 1 Processor -- start 2023-08-31T18:48:49.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.747+0000 7f2a36bff700 1 -- start start 2023-08-31T18:48:49.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.748+0000 7f2a36bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a20004690 0x7f2a3014aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:49.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.748+0000 7f2a36bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a30150390 0x7f2a3014c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:49.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.748+0000 7f2a36bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a3014c5b0 0x7f2a301684d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:49.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.748+0000 7f2a36bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3014f210 con 0x7f2a20004690 2023-08-31T18:48:49.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.748+0000 7f2a36bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3014ca10 con 0x7f2a3014c5b0 2023-08-31T18:48:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.748+0000 7f2a36bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3014e690 con 0x7f2a30150390 2023-08-31T18:48:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.748+0000 7f2a3499b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a20004690 0x7f2a3014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.748+0000 7f2a3499b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a20004690 0x7f2a3014aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46122/0 (socket says 172.21.15.72:46122) 2023-08-31T18:48:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.748+0000 7f2a3499b700 1 -- 172.21.15.72:0/1411071476 learned_addr learned my addr 172.21.15.72:0/1411071476 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.748+0000 7f2a3499b700 1 -- 172.21.15.72:0/1411071476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a30150390 msgr2=0x7f2a3014c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:49.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.748+0000 7f2a3499b700 1 --2- 172.21.15.72:0/1411071476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a30150390 0x7f2a3014c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:49.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.748+0000 7f2a3499b700 1 -- 172.21.15.72:0/1411071476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a3014c5b0 msgr2=0x7f2a301684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:49.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.748+0000 7f2a3499b700 1 --2- 172.21.15.72:0/1411071476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a3014c5b0 0x7f2a301684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:49.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.748+0000 7f2a3499b700 1 -- 172.21.15.72:0/1411071476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3014e970 con 0x7f2a20004690 2023-08-31T18:48:49.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.748+0000 7f2a3499b700 1 --2- 172.21.15.72:0/1411071476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a20004690 0x7f2a3014aa70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f2a240049e0 tx=0x7f2a24001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:49.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.749+0000 7f2a2cff9700 1 -- 172.21.15.72:0/1411071476 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24001550 con 0x7f2a20004690 2023-08-31T18:48:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.749+0000 7f2a2cff9700 1 -- 172.21.15.72:0/1411071476 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2400f870 con 0x7f2a20004690 2023-08-31T18:48:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.749+0000 7f2a2cff9700 1 -- 172.21.15.72:0/1411071476 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2400fbf0 con 0x7f2a20004690 2023-08-31T18:48:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.749+0000 7f2a36bff700 1 -- 172.21.15.72:0/1411071476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3014ec50 con 0x7f2a20004690 2023-08-31T18:48:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.749+0000 7f2a36bff700 1 -- 172.21.15.72:0/1411071476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a30150810 con 0x7f2a20004690 2023-08-31T18:48:49.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.750+0000 7f2a36bff700 1 -- 172.21.15.72:0/1411071476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a300add90 con 0x7f2a20004690 2023-08-31T18:48:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.750+0000 7f2a2cff9700 1 -- 172.21.15.72:0/1411071476 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f2a2401d3b0 con 0x7f2a20004690 2023-08-31T18:48:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.751+0000 7f2a2cff9700 1 --2- 172.21.15.72:0/1411071476 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2a1405ee10 0x7f2a140612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.752+0000 7f2a2cff9700 1 -- 172.21.15.72:0/1411071476 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2a24079500 con 0x7f2a20004690 2023-08-31T18:48:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.752+0000 7f2a2ffff700 1 --2- 172.21.15.72:0/1411071476 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2a1405ee10 0x7f2a140612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:49.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.752+0000 7f2a2ffff700 1 --2- 172.21.15.72:0/1411071476 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2a1405ee10 0x7f2a140612d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f2a30065170 tx=0x7f2a1c01a000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:49.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.755+0000 7f2a2cff9700 1 -- 172.21.15.72:0/1411071476 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a300add90 con 0x7f2a20004690 2023-08-31T18:48:49.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:49.924+0000 7f2a36bff700 1 -- 172.21.15.72:0/1411071476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f2a3006a7e0 con 0x7f2a20004690 2023-08-31T18:48:50.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.427+0000 7f2a2cff9700 1 -- 172.21.15.72:0/1411071476 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 152+0+0 (secure 0 0 0) 0x7f2a24019020 con 0x7f2a20004690 2023-08-31T18:48:50.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.433+0000 7f2a36bff700 1 -- 172.21.15.72:0/1411071476 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2a1405ee10 msgr2=0x7f2a140612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:50.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.433+0000 7f2a36bff700 1 --2- 172.21.15.72:0/1411071476 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2a1405ee10 0x7f2a140612d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f2a30065170 tx=0x7f2a1c01a000).stop 2023-08-31T18:48:50.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.433+0000 7f2a36bff700 1 -- 172.21.15.72:0/1411071476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a20004690 msgr2=0x7f2a3014aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:50.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.433+0000 7f2a36bff700 1 --2- 172.21.15.72:0/1411071476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a20004690 0x7f2a3014aa70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f2a240049e0 tx=0x7f2a24001e90).stop 2023-08-31T18:48:50.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.433+0000 7f2a36bff700 1 -- 172.21.15.72:0/1411071476 shutdown_connections 2023-08-31T18:48:50.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.433+0000 7f2a36bff700 1 --2- 172.21.15.72:0/1411071476 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2a1405ee10 0x7f2a140612d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:50.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.433+0000 7f2a36bff700 1 --2- 172.21.15.72:0/1411071476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a3014c5b0 0x7f2a301684d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:50.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.433+0000 7f2a36bff700 1 --2- 172.21.15.72:0/1411071476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a20004690 0x7f2a3014aa70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:50.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.433+0000 7f2a36bff700 1 --2- 172.21.15.72:0/1411071476 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2a30150390 0x7f2a3014c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:50.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.433+0000 7f2a36bff700 1 -- 172.21.15.72:0/1411071476 >> 172.21.15.72:0/1411071476 conn(0x7f2a30063a90 msgr2=0x7f2a300c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:50.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.435+0000 7f2a36bff700 1 -- 172.21.15.72:0/1411071476 shutdown_connections 2023-08-31T18:48:50.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.435+0000 7f2a36bff700 1 -- 172.21.15.72:0/1411071476 wait complete. 2023-08-31T18:48:50.440 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-08-31T18:48:50.457 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T18:48:50.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.652+0000 7f9f12bff700 1 Processor -- start 2023-08-31T18:48:50.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.652+0000 7f9f12bff700 1 -- start start 2023-08-31T18:48:50.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.653+0000 7f9f12bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9f0c153e30 0x7f9f0c154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:50.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.653+0000 7f9f12bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f0c0c5cb0 0x7f9f0c0c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:50.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.653+0000 7f9f12bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0c0bfd40 con 0x7f9f0c0630b0 2023-08-31T18:48:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.653+0000 7f9f12bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c0c6730 con 0x7f9f0c0c5cb0 2023-08-31T18:48:50.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.653+0000 7f9f12bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c0bffe0 con 0x7f9f0c153e30 2023-08-31T18:48:50.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.653+0000 7f9f0bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f0c0c5cb0 0x7f9f0c0c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:50.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.653+0000 7f9f0bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f0c0c5cb0 0x7f9f0c0c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46136/0 (socket says 172.21.15.72:46136) 2023-08-31T18:48:50.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.653+0000 7f9f0bfff700 1 -- 172.21.15.72:0/2569746516 learned_addr learned my addr 172.21.15.72:0/2569746516 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:50.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.654+0000 7f9f1099b700 1 --2- 172.21.15.72:0/2569746516 >> v2:172.21.15.146:3300/0 conn(0x7f9f0c153e30 0x7f9f0c154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:50.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.654+0000 7f9f0bfff700 1 -- 172.21.15.72:0/2569746516 >> v2:172.21.15.146:3300/0 conn(0x7f9f0c153e30 msgr2=0x7f9f0c154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:50.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.654+0000 7f9f0bfff700 1 --2- 172.21.15.72:0/2569746516 >> v2:172.21.15.146:3300/0 conn(0x7f9f0c153e30 0x7f9f0c154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:50.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.654+0000 7f9f0bfff700 1 -- 172.21.15.72:0/2569746516 >> v1:172.21.15.146:6789/0 conn(0x7f9f0c0630b0 legacy=0x7f9f0c157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:50.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.654+0000 7f9f0bfff700 1 -- 172.21.15.72:0/2569746516 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c0c02c0 con 0x7f9f0c0c5cb0 2023-08-31T18:48:50.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.654+0000 7f9f0bfff700 1 --2- 172.21.15.72:0/2569746516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f0c0c5cb0 0x7f9f0c0c6160 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f9f0c06aa50 tx=0x7f9ef80090f0).ready entity=mon.0 client_cookie=477a1bb32579eaa8 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:50.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.654+0000 7f9f0b7fe700 1 -- 172.21.15.72:0/2569746516 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef800b600 con 0x7f9f0c0c5cb0 2023-08-31T18:48:50.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.654+0000 7f9f0b7fe700 1 -- 172.21.15.72:0/2569746516 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef800b760 con 0x7f9f0c0c5cb0 2023-08-31T18:48:50.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.654+0000 7f9f0b7fe700 1 -- 172.21.15.72:0/2569746516 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef800bb00 con 0x7f9f0c0c5cb0 2023-08-31T18:48:50.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.655+0000 7f9f12bff700 1 -- 172.21.15.72:0/2569746516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f0c0c5cb0 msgr2=0x7f9f0c0c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:50.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.655+0000 7f9f12bff700 1 --2- 172.21.15.72:0/2569746516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f0c0c5cb0 0x7f9f0c0c6160 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f9f0c06aa50 tx=0x7f9ef80090f0).stop 2023-08-31T18:48:50.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.655+0000 7f9f12bff700 1 -- 172.21.15.72:0/2569746516 shutdown_connections 2023-08-31T18:48:50.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.655+0000 7f9f12bff700 1 --2- 172.21.15.72:0/2569746516 >> v2:172.21.15.146:3300/0 conn(0x7f9f0c153e30 0x7f9f0c154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:50.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.655+0000 7f9f12bff700 1 --2- 172.21.15.72:0/2569746516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f0c0c5cb0 0x7f9f0c0c6160 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:50.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.655+0000 7f9f12bff700 1 -- 172.21.15.72:0/2569746516 >> 172.21.15.72:0/2569746516 conn(0x7f9f0c05eb20 msgr2=0x7f9f0c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.655+0000 7f9f12bff700 1 -- 172.21.15.72:0/2569746516 shutdown_connections 2023-08-31T18:48:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.655+0000 7f9f12bff700 1 -- 172.21.15.72:0/2569746516 wait complete. 2023-08-31T18:48:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.657+0000 7f9f12bff700 1 Processor -- start 2023-08-31T18:48:50.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.657+0000 7f9f12bff700 1 -- start start 2023-08-31T18:48:50.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.658+0000 7f9f12bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f0c0630b0 0x7f9f0c14c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:50.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.659+0000 7f9f12bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f0c0c5cb0 0x7f9f0c0c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:50.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.659+0000 7f9f12bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f0c153e30 0x7f9f0c0c2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:50.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.659+0000 7f9f12bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c168c80 con 0x7f9f0c153e30 2023-08-31T18:48:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.659+0000 7f9f12bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c168070 con 0x7f9f0c0c5cb0 2023-08-31T18:48:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.659+0000 7f9f12bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c168350 con 0x7f9f0c0630b0 2023-08-31T18:48:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.659+0000 7f9f1119c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f0c153e30 0x7f9f0c0c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:50.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.659+0000 7f9f1099b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f0c0630b0 0x7f9f0c14c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:50.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.659+0000 7f9f1119c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f0c153e30 0x7f9f0c0c2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46138/0 (socket says 172.21.15.72:46138) 2023-08-31T18:48:50.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.659+0000 7f9f1119c700 1 -- 172.21.15.72:0/4112276885 learned_addr learned my addr 172.21.15.72:0/4112276885 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:50.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.659+0000 7f9f0bfff700 1 --2- 172.21.15.72:0/4112276885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f0c0c5cb0 0x7f9f0c0c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:50.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.659+0000 7f9f1119c700 1 -- 172.21.15.72:0/4112276885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f0c0630b0 msgr2=0x7f9f0c14c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:50.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.659+0000 7f9f1119c700 1 --2- 172.21.15.72:0/4112276885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f0c0630b0 0x7f9f0c14c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:50.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.659+0000 7f9f1119c700 1 -- 172.21.15.72:0/4112276885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f0c0c5cb0 msgr2=0x7f9f0c0c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:50.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.659+0000 7f9f1119c700 1 --2- 172.21.15.72:0/4112276885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f0c0c5cb0 0x7f9f0c0c1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:50.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.659+0000 7f9f1119c700 1 -- 172.21.15.72:0/4112276885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef8009370 con 0x7f9f0c153e30 2023-08-31T18:48:50.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.660+0000 7f9f1119c700 1 --2- 172.21.15.72:0/4112276885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f0c153e30 0x7f9f0c0c2890 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f9f04002230 tx=0x7f9f040015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:50.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.660+0000 7f9f08ff9700 1 -- 172.21.15.72:0/4112276885 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400e4a0 con 0x7f9f0c153e30 2023-08-31T18:48:50.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.660+0000 7f9f08ff9700 1 -- 172.21.15.72:0/4112276885 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0400e600 con 0x7f9f0c153e30 2023-08-31T18:48:50.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.660+0000 7f9f12bff700 1 -- 172.21.15.72:0/4112276885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c168630 con 0x7f9f0c153e30 2023-08-31T18:48:50.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.660+0000 7f9f08ff9700 1 -- 172.21.15.72:0/4112276885 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400e980 con 0x7f9f0c153e30 2023-08-31T18:48:50.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.660+0000 7f9f12bff700 1 -- 172.21.15.72:0/4112276885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c0c4ef0 con 0x7f9f0c153e30 2023-08-31T18:48:50.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.661+0000 7f9f12bff700 1 -- 172.21.15.72:0/4112276885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c0c5280 con 0x7f9f0c153e30 2023-08-31T18:48:50.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.662+0000 7f9f08ff9700 1 -- 172.21.15.72:0/4112276885 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f9f0401b3b0 con 0x7f9f0c153e30 2023-08-31T18:48:50.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.663+0000 7f9f08ff9700 1 --2- 172.21.15.72:0/4112276885 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ef005ede0 0x7f9ef00612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:50.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.663+0000 7f9f08ff9700 1 -- 172.21.15.72:0/4112276885 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f9f04079250 con 0x7f9f0c153e30 2023-08-31T18:48:50.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.663+0000 7f9f1099b700 1 --2- 172.21.15.72:0/4112276885 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ef005ede0 0x7f9ef00612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:50.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.664+0000 7f9f1099b700 1 --2- 172.21.15.72:0/4112276885 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ef005ede0 0x7f9ef00612a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f9f0000bb10 tx=0x7f9f00008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:50.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.667+0000 7f9f08ff9700 1 -- 172.21.15.72:0/4112276885 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f040488f0 con 0x7f9f0c153e30 2023-08-31T18:48:50.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:50.837+0000 7f9f12bff700 1 -- 172.21.15.72:0/4112276885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9f0c06c6b0 con 0x7f9f0c153e30 2023-08-31T18:48:51.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.434+0000 7f9f08ff9700 1 -- 172.21.15.72:0/4112276885 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9f0404a8f0 con 0x7f9f0c153e30 2023-08-31T18:48:51.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.438+0000 7f9f12bff700 1 -- 172.21.15.72:0/4112276885 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ef005ede0 msgr2=0x7f9ef00612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:51.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.438+0000 7f9f12bff700 1 --2- 172.21.15.72:0/4112276885 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ef005ede0 0x7f9ef00612a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f9f0000bb10 tx=0x7f9f00008040).stop 2023-08-31T18:48:51.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.438+0000 7f9f12bff700 1 -- 172.21.15.72:0/4112276885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f0c153e30 msgr2=0x7f9f0c0c2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:51.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.438+0000 7f9f12bff700 1 --2- 172.21.15.72:0/4112276885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f0c153e30 0x7f9f0c0c2890 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f9f04002230 tx=0x7f9f040015e0).stop 2023-08-31T18:48:51.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.439+0000 7f9f12bff700 1 -- 172.21.15.72:0/4112276885 shutdown_connections 2023-08-31T18:48:51.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.439+0000 7f9f12bff700 1 --2- 172.21.15.72:0/4112276885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f0c153e30 0x7f9f0c0c2890 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:51.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.439+0000 7f9f12bff700 1 --2- 172.21.15.72:0/4112276885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9f0c0630b0 0x7f9f0c14c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:51.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.439+0000 7f9f12bff700 1 --2- 172.21.15.72:0/4112276885 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ef005ede0 0x7f9ef00612a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:51.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.439+0000 7f9f12bff700 1 --2- 172.21.15.72:0/4112276885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f0c0c5cb0 0x7f9f0c0c1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:51.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.439+0000 7f9f12bff700 1 -- 172.21.15.72:0/4112276885 >> 172.21.15.72:0/4112276885 conn(0x7f9f0c05eb20 msgr2=0x7f9f0c0ab770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:51.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.442+0000 7f9f12bff700 1 -- 172.21.15.72:0/4112276885 shutdown_connections 2023-08-31T18:48:51.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.444+0000 7f9f12bff700 1 -- 172.21.15.72:0/4112276885 wait complete. 2023-08-31T18:48:51.453 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-08-31T18:48:51.476 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T18:48:51.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.668+0000 7fb2dedff700 1 Processor -- start 2023-08-31T18:48:51.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.668+0000 7fb2dedff700 1 -- start start 2023-08-31T18:48:51.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.669+0000 7fb2dedff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2d8153e30 0x7fb2d8154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:51.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.669+0000 7fb2dedff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2d80637c0 0x7fb2d80c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:51.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.669+0000 7fb2dedff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d80bfd40 con 0x7fb2d80c5cb0 2023-08-31T18:48:51.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.669+0000 7fb2dedff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d80c6730 con 0x7fb2d80637c0 2023-08-31T18:48:51.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.669+0000 7fb2dedff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80bffe0 con 0x7fb2d8153e30 2023-08-31T18:48:51.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.670+0000 7fb2dd39c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2d80637c0 0x7fb2d80c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:51.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.670+0000 7fb2dd39c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2d80637c0 0x7fb2d80c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:58102/0 (socket says 172.21.15.72:58102) 2023-08-31T18:48:51.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.670+0000 7fb2dd39c700 1 -- 172.21.15.72:0/1185934088 learned_addr learned my addr 172.21.15.72:0/1185934088 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:51.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.670+0000 7fb2d7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb2d80c5cb0 0x7fb2d80630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:53804/0 (socket says 172.21.15.72:53804) 2023-08-31T18:48:51.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.670+0000 7fb2dcb9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2d8153e30 0x7fb2d8154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:51.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.670+0000 7fb2dd39c700 1 -- 172.21.15.72:0/1185934088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2d8153e30 msgr2=0x7fb2d8154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:51.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.670+0000 7fb2dd39c700 1 --2- 172.21.15.72:0/1185934088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2d8153e30 0x7fb2d8154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:51.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.670+0000 7fb2dd39c700 1 -- 172.21.15.72:0/1185934088 >> v1:172.21.15.146:6789/0 conn(0x7fb2d80c5cb0 legacy=0x7fb2d80630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:51.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.670+0000 7fb2dd39c700 1 -- 172.21.15.72:0/1185934088 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80c02c0 con 0x7fb2d80637c0 2023-08-31T18:48:51.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.670+0000 7fb2dcb9b700 1 --2- 172.21.15.72:0/1185934088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2d8153e30 0x7fb2d8154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:51.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.670+0000 7fb2d77fe700 1 -- 172.21.15.72:0/1185934088 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497199072 0 0) 0x7fb2d80bfd40 con 0x7fb2d80c5cb0 2023-08-31T18:48:51.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.670+0000 7fb2dd39c700 1 --2- 172.21.15.72:0/1185934088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2d80637c0 0x7fb2d80c6130 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fb2d0009f20 tx=0x7fb2d0009840).ready entity=mon.1 client_cookie=bbf85609e9d2cae4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:51.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.671+0000 7fb2d77fe700 1 -- 172.21.15.72:0/1185934088 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d000e070 con 0x7fb2d80637c0 2023-08-31T18:48:51.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.671+0000 7fb2d77fe700 1 -- 172.21.15.72:0/1185934088 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d000b9d0 con 0x7fb2d80637c0 2023-08-31T18:48:51.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.671+0000 7fb2d77fe700 1 -- 172.21.15.72:0/1185934088 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d000bd50 con 0x7fb2d80637c0 2023-08-31T18:48:51.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.671+0000 7fb2dedff700 1 -- 172.21.15.72:0/1185934088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2d80637c0 msgr2=0x7fb2d80c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:51.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.671+0000 7fb2dedff700 1 --2- 172.21.15.72:0/1185934088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2d80637c0 0x7fb2d80c6130 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fb2d0009f20 tx=0x7fb2d0009840).stop 2023-08-31T18:48:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.671+0000 7fb2dedff700 1 -- 172.21.15.72:0/1185934088 shutdown_connections 2023-08-31T18:48:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.671+0000 7fb2dedff700 1 --2- 172.21.15.72:0/1185934088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2d80637c0 0x7fb2d80c6130 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.671+0000 7fb2dedff700 1 --2- 172.21.15.72:0/1185934088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2d8153e30 0x7fb2d8154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.671+0000 7fb2dedff700 1 -- 172.21.15.72:0/1185934088 >> 172.21.15.72:0/1185934088 conn(0x7fb2d805eb20 msgr2=0x7fb2d80cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:51.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.671+0000 7fb2dedff700 1 -- 172.21.15.72:0/1185934088 shutdown_connections 2023-08-31T18:48:51.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.671+0000 7fb2dedff700 1 -- 172.21.15.72:0/1185934088 wait complete. 2023-08-31T18:48:51.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.673+0000 7fb2dedff700 1 Processor -- start 2023-08-31T18:48:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.673+0000 7fb2dedff700 1 -- start start 2023-08-31T18:48:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.674+0000 7fb2dedff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2d80637c0 0x7fb2d8154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.674+0000 7fb2dedff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2d80c5cb0 0x7fb2d8154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.674+0000 7fb2dedff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2d8153e30 0x7fb2d8156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.674+0000 7fb2dedff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80b0740 con 0x7fb2d80c5cb0 2023-08-31T18:48:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.674+0000 7fb2dedff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d81551f0 con 0x7fb2d8153e30 2023-08-31T18:48:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.674+0000 7fb2dedff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80b0460 con 0x7fb2d80637c0 2023-08-31T18:48:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.674+0000 7fb2d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2d80c5cb0 0x7fb2d8154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.674+0000 7fb2d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2d80c5cb0 0x7fb2d8154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46142/0 (socket says 172.21.15.72:46142) 2023-08-31T18:48:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.674+0000 7fb2d7fff700 1 -- 172.21.15.72:0/1912777216 learned_addr learned my addr 172.21.15.72:0/1912777216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.674+0000 7fb2dcb9b700 1 --2- 172.21.15.72:0/1912777216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2d80637c0 0x7fb2d8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.674+0000 7fb2dd39c700 1 --2- 172.21.15.72:0/1912777216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2d8153e30 0x7fb2d8156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.675+0000 7fb2d7fff700 1 -- 172.21.15.72:0/1912777216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2d80637c0 msgr2=0x7fb2d8154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.675+0000 7fb2d7fff700 1 --2- 172.21.15.72:0/1912777216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2d80637c0 0x7fb2d8154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:51.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.675+0000 7fb2d7fff700 1 -- 172.21.15.72:0/1912777216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2d8153e30 msgr2=0x7fb2d8156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:51.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.675+0000 7fb2d7fff700 1 --2- 172.21.15.72:0/1912777216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2d8153e30 0x7fb2d8156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:51.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.675+0000 7fb2d7fff700 1 -- 172.21.15.72:0/1912777216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc0092a0 con 0x7fb2d80c5cb0 2023-08-31T18:48:51.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.675+0000 7fb2d7fff700 1 --2- 172.21.15.72:0/1912777216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2d80c5cb0 0x7fb2d8154d00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fb2c400c510 tx=0x7fb2c4007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:51.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.675+0000 7fb2d4ff9700 1 -- 172.21.15.72:0/1912777216 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c400ce40 con 0x7fb2d80c5cb0 2023-08-31T18:48:51.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.675+0000 7fb2d4ff9700 1 -- 172.21.15.72:0/1912777216 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c40072e0 con 0x7fb2d80c5cb0 2023-08-31T18:48:51.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.675+0000 7fb2d4ff9700 1 -- 172.21.15.72:0/1912777216 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c40056e0 con 0x7fb2d80c5cb0 2023-08-31T18:48:51.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.675+0000 7fb2dedff700 1 -- 172.21.15.72:0/1912777216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d0009ae0 con 0x7fb2d80c5cb0 2023-08-31T18:48:51.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.675+0000 7fb2dedff700 1 -- 172.21.15.72:0/1912777216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d8158cb0 con 0x7fb2d80c5cb0 2023-08-31T18:48:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.676+0000 7fb2dedff700 1 -- 172.21.15.72:0/1912777216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d806c6b0 con 0x7fb2d80c5cb0 2023-08-31T18:48:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.677+0000 7fb2d4ff9700 1 -- 172.21.15.72:0/1912777216 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fb2c4005ad0 con 0x7fb2d80c5cb0 2023-08-31T18:48:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.679+0000 7fb2d4ff9700 1 --2- 172.21.15.72:0/1912777216 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb2bc05ede0 0x7fb2bc0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.679+0000 7fb2d4ff9700 1 -- 172.21.15.72:0/1912777216 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fb2c4079430 con 0x7fb2d80c5cb0 2023-08-31T18:48:51.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.679+0000 7fb2dcb9b700 1 --2- 172.21.15.72:0/1912777216 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb2bc05ede0 0x7fb2bc0612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:51.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.679+0000 7fb2dcb9b700 1 --2- 172.21.15.72:0/1912777216 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb2bc05ede0 0x7fb2bc0612a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb2cc009d20 tx=0x7fb2cc009060).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.683+0000 7fb2d4ff9700 1 -- 172.21.15.72:0/1912777216 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2c404a900 con 0x7fb2d80c5cb0 2023-08-31T18:48:51.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.890+0000 7fb2dedff700 1 -- 172.21.15.72:0/1912777216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb2d8062970 con 0x7fb2d80c5cb0 2023-08-31T18:48:51.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.897+0000 7fb2d4ff9700 1 -- 172.21.15.72:0/1912777216 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb2c404df20 con 0x7fb2d80c5cb0 2023-08-31T18:48:51.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.906+0000 7fb2dedff700 1 -- 172.21.15.72:0/1912777216 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb2bc05ede0 msgr2=0x7fb2bc0612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:51.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.906+0000 7fb2dedff700 1 --2- 172.21.15.72:0/1912777216 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb2bc05ede0 0x7fb2bc0612a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb2cc009d20 tx=0x7fb2cc009060).stop 2023-08-31T18:48:51.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.906+0000 7fb2dedff700 1 -- 172.21.15.72:0/1912777216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2d80c5cb0 msgr2=0x7fb2d8154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:51.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.906+0000 7fb2dedff700 1 --2- 172.21.15.72:0/1912777216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2d80c5cb0 0x7fb2d8154d00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fb2c400c510 tx=0x7fb2c4007c60).stop 2023-08-31T18:48:51.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.908+0000 7fb2dedff700 1 -- 172.21.15.72:0/1912777216 shutdown_connections 2023-08-31T18:48:51.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.908+0000 7fb2dedff700 1 --2- 172.21.15.72:0/1912777216 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb2bc05ede0 0x7fb2bc0612a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:51.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.908+0000 7fb2dedff700 1 --2- 172.21.15.72:0/1912777216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2d8153e30 0x7fb2d8156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:51.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.908+0000 7fb2dedff700 1 --2- 172.21.15.72:0/1912777216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2d80637c0 0x7fb2d8154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:51.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.908+0000 7fb2dedff700 1 --2- 172.21.15.72:0/1912777216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2d80c5cb0 0x7fb2d8154d00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:51.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.909+0000 7fb2dedff700 1 -- 172.21.15.72:0/1912777216 >> 172.21.15.72:0/1912777216 conn(0x7fb2d805eb20 msgr2=0x7fb2d80c7620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:51.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.910+0000 7fb2dedff700 1 -- 172.21.15.72:0/1912777216 shutdown_connections 2023-08-31T18:48:51.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:51.911+0000 7fb2dedff700 1 -- 172.21.15.72:0/1912777216 wait complete. 2023-08-31T18:48:51.917 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 5 and data pool 6 2023-08-31T18:48:51.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:48:52.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.126+0000 7f3d769ff700 1 Processor -- start 2023-08-31T18:48:52.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.126+0000 7f3d769ff700 1 -- start start 2023-08-31T18:48:52.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.128+0000 7f3d769ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d70154060 0x7f3d70157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.128+0000 7f3d769ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d700c6120 con 0x7f3d701588d0 2023-08-31T18:48:52.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.128+0000 7f3d769ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d700c5e10 con 0x7f3d700cb9b0 2023-08-31T18:48:52.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.128+0000 7f3d769ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d700c1380 con 0x7f3d70154060 2023-08-31T18:48:52.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.128+0000 7f3d74f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3d701588d0 0x7f3d70154440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41392/0 (socket says 172.21.15.72:41392) 2023-08-31T18:48:52.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.128+0000 7f3d74f9c700 1 -- 172.21.15.72:0/3866857067 learned_addr learned my addr 172.21.15.72:0/3866857067 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:52.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.128+0000 7f3d6ffff700 1 --2- 172.21.15.72:0/3866857067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d70154060 0x7f3d70157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.128+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795184817 0 0) 0x7f3d700c6120 con 0x7f3d701588d0 2023-08-31T18:48:52.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d580033f0 con 0x7f3d701588d0 2023-08-31T18:48:52.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246060018 0 0) 0x7f3d700c5e10 con 0x7f3d700cb9b0 2023-08-31T18:48:52.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d700c6120 con 0x7f3d700cb9b0 2023-08-31T18:48:52.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3006243331 0 0) 0x7f3d580033f0 con 0x7f3d701588d0 2023-08-31T18:48:52.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d70154060 msgr2=0x7f3d70157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:52.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 --2- 172.21.15.72:0/3866857067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d70154060 0x7f3d70157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 >> v1:172.21.15.146:6789/0 conn(0x7f3d700cb9b0 legacy=0x7f3d701581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d700c0ae0 con 0x7f3d701588d0 2023-08-31T18:48:52.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f3d680017f0 con 0x7f3d701588d0 2023-08-31T18:48:52.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 >> v1:172.21.15.72:6789/0 conn(0x7f3d701588d0 legacy=0x7f3d70154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 --2- 172.21.15.72:0/3866857067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d58003aa0 0x7f3d58003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 --2- 172.21.15.72:0/3866857067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d70154060 0x7f3d58004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 --2- 172.21.15.72:0/3866857067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d58004b80 0x7f3d58005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d700c1380 con 0x7f3d58003aa0 2023-08-31T18:48:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5800b910 con 0x7f3d58004b80 2023-08-31T18:48:52.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5800bad0 con 0x7f3d70154060 2023-08-31T18:48:52.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6ffff700 1 --2- 172.21.15.72:0/3866857067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d58003aa0 0x7f3d58003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d74f9c700 1 --2- 172.21.15.72:0/3866857067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d58004b80 0x7f3d58005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.129+0000 7f3d6f7fe700 1 --2- 172.21.15.72:0/3866857067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d70154060 0x7f3d58004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.130+0000 7f3d6ffff700 1 -- 172.21.15.72:0/3866857067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d70154060 msgr2=0x7f3d58004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:52.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.130+0000 7f3d6ffff700 1 --2- 172.21.15.72:0/3866857067 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d70154060 0x7f3d58004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.130+0000 7f3d6ffff700 1 -- 172.21.15.72:0/3866857067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d58004b80 msgr2=0x7f3d58005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:52.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.130+0000 7f3d6ffff700 1 --2- 172.21.15.72:0/3866857067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d58004b80 0x7f3d58005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.130+0000 7f3d6ffff700 1 -- 172.21.15.72:0/3866857067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d580033f0 con 0x7f3d58003aa0 2023-08-31T18:48:52.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.130+0000 7f3d6ffff700 1 --2- 172.21.15.72:0/3866857067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d58003aa0 0x7f3d58003ea0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f3d60006fd0 tx=0x7f3d60006f40).ready entity=mon.0 client_cookie=43e348da6dfbe93f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:52.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.130+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60009430 con 0x7f3d58003aa0 2023-08-31T18:48:52.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.130+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6000e640 con 0x7f3d58003aa0 2023-08-31T18:48:52.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.130+0000 7f3d6effd700 1 -- 172.21.15.72:0/3866857067 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6000e9c0 con 0x7f3d58003aa0 2023-08-31T18:48:52.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.131+0000 7f3d769ff700 1 -- 172.21.15.72:0/3866857067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d58003aa0 msgr2=0x7f3d58003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.131+0000 7f3d769ff700 1 --2- 172.21.15.72:0/3866857067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d58003aa0 0x7f3d58003ea0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f3d60006fd0 tx=0x7f3d60006f40).stop 2023-08-31T18:48:52.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.131+0000 7f3d74f9c700 1 -- 172.21.15.72:0/3866857067 reap_dead start 2023-08-31T18:48:52.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.131+0000 7f3d769ff700 1 -- 172.21.15.72:0/3866857067 shutdown_connections 2023-08-31T18:48:52.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.131+0000 7f3d769ff700 1 -- 172.21.15.72:0/3866857067 >> 172.21.15.72:0/3866857067 conn(0x7f3d7005e870 msgr2=0x7f3d700cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:52.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.131+0000 7f3d769ff700 1 -- 172.21.15.72:0/3866857067 shutdown_connections 2023-08-31T18:48:52.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.131+0000 7f3d769ff700 1 -- 172.21.15.72:0/3866857067 wait complete. 2023-08-31T18:48:52.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.132+0000 7f3d769ff700 1 Processor -- start 2023-08-31T18:48:52.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.132+0000 7f3d769ff700 1 -- start start 2023-08-31T18:48:52.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.133+0000 7f3d769ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d58003aa0 0x7f3d700c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.133+0000 7f3d769ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d70147840 0x7f3d70157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.133+0000 7f3d769ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d70153160 0x7f3d701535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.133+0000 7f3d769ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d70157770 con 0x7f3d70153160 2023-08-31T18:48:52.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.133+0000 7f3d769ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d70158590 con 0x7f3d70147840 2023-08-31T18:48:52.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.133+0000 7f3d769ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d70147cc0 con 0x7f3d58003aa0 2023-08-31T18:48:52.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.134+0000 7f3d74f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d70153160 0x7f3d701535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.134+0000 7f3d74f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d70153160 0x7f3d701535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46162/0 (socket says 172.21.15.72:46162) 2023-08-31T18:48:52.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.134+0000 7f3d74f9c700 1 -- 172.21.15.72:0/4182940839 learned_addr learned my addr 172.21.15.72:0/4182940839 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:52.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.134+0000 7f3d6ffff700 1 --2- 172.21.15.72:0/4182940839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d58003aa0 0x7f3d700c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.134+0000 7f3d6f7fe700 1 --2- 172.21.15.72:0/4182940839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d70147840 0x7f3d70157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.134+0000 7f3d74f9c700 1 -- 172.21.15.72:0/4182940839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d58003aa0 msgr2=0x7f3d700c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.134+0000 7f3d74f9c700 1 --2- 172.21.15.72:0/4182940839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d58003aa0 0x7f3d700c43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.134+0000 7f3d74f9c700 1 -- 172.21.15.72:0/4182940839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d70147840 msgr2=0x7f3d70157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.134+0000 7f3d74f9c700 1 --2- 172.21.15.72:0/4182940839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d70147840 0x7f3d70157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.134+0000 7f3d74f9c700 1 -- 172.21.15.72:0/4182940839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d70153ad0 con 0x7f3d70153160 2023-08-31T18:48:52.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.134+0000 7f3d74f9c700 1 --2- 172.21.15.72:0/4182940839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d70153160 0x7f3d701535e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f3d700844f0 tx=0x7f3d68007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:52.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.134+0000 7f3d57fff700 1 -- 172.21.15.72:0/4182940839 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6800f970 con 0x7f3d70153160 2023-08-31T18:48:52.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.134+0000 7f3d57fff700 1 -- 172.21.15.72:0/4182940839 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6800fad0 con 0x7f3d70153160 2023-08-31T18:48:52.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.134+0000 7f3d769ff700 1 -- 172.21.15.72:0/4182940839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d70157980 con 0x7f3d70153160 2023-08-31T18:48:52.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.134+0000 7f3d57fff700 1 -- 172.21.15.72:0/4182940839 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6800fe50 con 0x7f3d70153160 2023-08-31T18:48:52.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.135+0000 7f3d769ff700 1 -- 172.21.15.72:0/4182940839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d70157f40 con 0x7f3d70153160 2023-08-31T18:48:52.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.136+0000 7f3d769ff700 1 -- 172.21.15.72:0/4182940839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d7006acb0 con 0x7f3d70153160 2023-08-31T18:48:52.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.136+0000 7f3d57fff700 1 -- 172.21.15.72:0/4182940839 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3d68015620 con 0x7f3d70153160 2023-08-31T18:48:52.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.137+0000 7f3d57fff700 1 --2- 172.21.15.72:0/4182940839 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3d5c05ee10 0x7f3d5c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.137+0000 7f3d57fff700 1 -- 172.21.15.72:0/4182940839 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3d6807a070 con 0x7f3d70153160 2023-08-31T18:48:52.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.137+0000 7f3d6ffff700 1 --2- 172.21.15.72:0/4182940839 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3d5c05ee10 0x7f3d5c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.138+0000 7f3d6ffff700 1 --2- 172.21.15.72:0/4182940839 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3d5c05ee10 0x7f3d5c0612d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f3d60006cf0 tx=0x7f3d6001a000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:52.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.141+0000 7f3d57fff700 1 -- 172.21.15.72:0/4182940839 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d7006acb0 con 0x7f3d70153160 2023-08-31T18:48:52.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.312+0000 7f3d769ff700 1 -- 172.21.15.72:0/4182940839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d701586d0 con 0x7f3d70153160 2023-08-31T18:48:52.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.313+0000 7f3d57fff700 1 -- 172.21.15.72:0/4182940839 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+17037 (secure 0 0 0) 0x7f3d701586d0 con 0x7f3d70153160 2023-08-31T18:48:52.313 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:52.314 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":33,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:48:51.891745+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:48:49.967130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T18:48:50.880157+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:48:52.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.315+0000 7f3d769ff700 1 -- 172.21.15.72:0/4182940839 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3d5c05ee10 msgr2=0x7f3d5c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.315+0000 7f3d769ff700 1 --2- 172.21.15.72:0/4182940839 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3d5c05ee10 0x7f3d5c0612d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f3d60006cf0 tx=0x7f3d6001a000).stop 2023-08-31T18:48:52.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.315+0000 7f3d769ff700 1 -- 172.21.15.72:0/4182940839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d70153160 msgr2=0x7f3d701535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.315+0000 7f3d769ff700 1 --2- 172.21.15.72:0/4182940839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d70153160 0x7f3d701535e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f3d700844f0 tx=0x7f3d68007f40).stop 2023-08-31T18:48:52.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.315+0000 7f3d769ff700 1 -- 172.21.15.72:0/4182940839 shutdown_connections 2023-08-31T18:48:52.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.315+0000 7f3d769ff700 1 --2- 172.21.15.72:0/4182940839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d70153160 0x7f3d701535e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.315+0000 7f3d769ff700 1 --2- 172.21.15.72:0/4182940839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d58003aa0 0x7f3d700c43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.315+0000 7f3d769ff700 1 --2- 172.21.15.72:0/4182940839 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3d5c05ee10 0x7f3d5c0612d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.315+0000 7f3d769ff700 1 --2- 172.21.15.72:0/4182940839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d70147840 0x7f3d70157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.315+0000 7f3d769ff700 1 -- 172.21.15.72:0/4182940839 >> 172.21.15.72:0/4182940839 conn(0x7f3d7005e870 msgr2=0x7f3d701480d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:52.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.315+0000 7f3d769ff700 1 -- 172.21.15.72:0/4182940839 shutdown_connections 2023-08-31T18:48:52.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.315+0000 7f3d769ff700 1 -- 172.21.15.72:0/4182940839 wait complete. 2023-08-31T18:48:52.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:48:52.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.522+0000 7f8b307ff700 1 Processor -- start 2023-08-31T18:48:52.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.522+0000 7f8b307ff700 1 -- start start 2023-08-31T18:48:52.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b307ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8b28154060 0x7f8b28157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b307ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b280cb9b0 0x7f8b281581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b307ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8b281586b0 0x7f8b280c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b307ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b280c1380 con 0x7f8b281586b0 2023-08-31T18:48:52.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b307ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b28158b60 con 0x7f8b28154060 2023-08-31T18:48:52.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b307ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280c6120 con 0x7f8b280cb9b0 2023-08-31T18:48:52.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b2ed9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8b281586b0 0x7f8b280c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b2ed9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8b281586b0 0x7f8b280c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46164/0 (socket says 172.21.15.72:46164) 2023-08-31T18:48:52.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b2ed9c700 1 -- 172.21.15.72:0/2376154093 learned_addr learned my addr 172.21.15.72:0/2376154093 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:52.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b2dd9a700 1 --2- 172.21.15.72:0/2376154093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b280cb9b0 0x7f8b281581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b2e59b700 1 --2- 172.21.15.72:0/2376154093 >> v2:172.21.15.146:3300/0 conn(0x7f8b28154060 0x7f8b28157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b2ed9c700 1 -- 172.21.15.72:0/2376154093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b280cb9b0 msgr2=0x7f8b281581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:52.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b2ed9c700 1 --2- 172.21.15.72:0/2376154093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b280cb9b0 0x7f8b281581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b2ed9c700 1 -- 172.21.15.72:0/2376154093 >> v2:172.21.15.146:3300/0 conn(0x7f8b28154060 msgr2=0x7f8b28157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:52.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b2ed9c700 1 --2- 172.21.15.72:0/2376154093 >> v2:172.21.15.146:3300/0 conn(0x7f8b28154060 0x7f8b28157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.524+0000 7f8b2ed9c700 1 -- 172.21.15.72:0/2376154093 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b280c5e10 con 0x7f8b281586b0 2023-08-31T18:48:52.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.525+0000 7f8b2e59b700 1 --2- 172.21.15.72:0/2376154093 >> v2:172.21.15.146:3300/0 conn(0x7f8b28154060 0x7f8b28157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:52.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.525+0000 7f8b2ed9c700 1 --2- 172.21.15.72:0/2376154093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b281586b0 0x7f8b280c65b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f8b281557e0 tx=0x7f8b20009840).ready entity=mon.0 client_cookie=7990006ed3dab206 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:52.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.525+0000 7f8b2d599700 1 -- 172.21.15.72:0/2376154093 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000e070 con 0x7f8b281586b0 2023-08-31T18:48:52.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.525+0000 7f8b2d599700 1 -- 172.21.15.72:0/2376154093 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2000ba40 con 0x7f8b281586b0 2023-08-31T18:48:52.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.525+0000 7f8b2d599700 1 -- 172.21.15.72:0/2376154093 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000bdc0 con 0x7f8b281586b0 2023-08-31T18:48:52.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.525+0000 7f8b307ff700 1 -- 172.21.15.72:0/2376154093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b281586b0 msgr2=0x7f8b280c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.525+0000 7f8b307ff700 1 --2- 172.21.15.72:0/2376154093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b281586b0 0x7f8b280c65b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f8b281557e0 tx=0x7f8b20009840).stop 2023-08-31T18:48:52.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.525+0000 7f8b307ff700 1 -- 172.21.15.72:0/2376154093 shutdown_connections 2023-08-31T18:48:52.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.525+0000 7f8b307ff700 1 --2- 172.21.15.72:0/2376154093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b281586b0 0x7f8b280c65b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.525+0000 7f8b307ff700 1 --2- 172.21.15.72:0/2376154093 >> v2:172.21.15.146:3300/0 conn(0x7f8b28154060 0x7f8b28157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.525+0000 7f8b307ff700 1 --2- 172.21.15.72:0/2376154093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b280cb9b0 0x7f8b281581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.525+0000 7f8b307ff700 1 -- 172.21.15.72:0/2376154093 >> 172.21.15.72:0/2376154093 conn(0x7f8b2805e870 msgr2=0x7f8b280cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.526+0000 7f8b307ff700 1 -- 172.21.15.72:0/2376154093 shutdown_connections 2023-08-31T18:48:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.526+0000 7f8b307ff700 1 -- 172.21.15.72:0/2376154093 wait complete. 2023-08-31T18:48:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.527+0000 7f8b307ff700 1 Processor -- start 2023-08-31T18:48:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.527+0000 7f8b307ff700 1 -- start start 2023-08-31T18:48:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.528+0000 7f8b307ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b280cb9b0 0x7f8b28150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.528+0000 7f8b307ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b28154060 0x7f8b280add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.528+0000 7f8b307ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b281586b0 0x7f8b28167f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.528+0000 7f8b307ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b28155830 con 0x7f8b280cb9b0 2023-08-31T18:48:52.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.528+0000 7f8b307ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280ae230 con 0x7f8b28154060 2023-08-31T18:48:52.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.528+0000 7f8b307ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b28156090 con 0x7f8b281586b0 2023-08-31T18:48:52.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.528+0000 7f8b2e59b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b280cb9b0 0x7f8b28150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.528+0000 7f8b2e59b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b280cb9b0 0x7f8b28150d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46176/0 (socket says 172.21.15.72:46176) 2023-08-31T18:48:52.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.528+0000 7f8b2e59b700 1 -- 172.21.15.72:0/1058022286 learned_addr learned my addr 172.21.15.72:0/1058022286 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:52.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.529+0000 7f8b2dd9a700 1 --2- 172.21.15.72:0/1058022286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b28154060 0x7f8b280add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.529+0000 7f8b2ed9c700 1 --2- 172.21.15.72:0/1058022286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b281586b0 0x7f8b28167f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.529+0000 7f8b2e59b700 1 -- 172.21.15.72:0/1058022286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b281586b0 msgr2=0x7f8b28167f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.529+0000 7f8b2e59b700 1 --2- 172.21.15.72:0/1058022286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b281586b0 0x7f8b28167f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.529+0000 7f8b2e59b700 1 -- 172.21.15.72:0/1058022286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b28154060 msgr2=0x7f8b280add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.529+0000 7f8b2e59b700 1 --2- 172.21.15.72:0/1058022286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b28154060 0x7f8b280add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.529+0000 7f8b2e59b700 1 -- 172.21.15.72:0/1058022286 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b20009ae0 con 0x7f8b280cb9b0 2023-08-31T18:48:52.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.529+0000 7f8b2e59b700 1 --2- 172.21.15.72:0/1058022286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b280cb9b0 0x7f8b28150d30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f8b2400d890 tx=0x7f8b24008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:52.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.529+0000 7f8b1e7fc700 1 -- 172.21.15.72:0/1058022286 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24017070 con 0x7f8b280cb9b0 2023-08-31T18:48:52.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.529+0000 7f8b1e7fc700 1 -- 172.21.15.72:0/1058022286 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b24005880 con 0x7f8b280cb9b0 2023-08-31T18:48:52.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.529+0000 7f8b307ff700 1 -- 172.21.15.72:0/1058022286 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b28168480 con 0x7f8b280cb9b0 2023-08-31T18:48:52.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.529+0000 7f8b1e7fc700 1 -- 172.21.15.72:0/1058022286 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24005c00 con 0x7f8b280cb9b0 2023-08-31T18:48:52.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.529+0000 7f8b307ff700 1 -- 172.21.15.72:0/1058022286 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b28155a40 con 0x7f8b280cb9b0 2023-08-31T18:48:52.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.530+0000 7f8b307ff700 1 -- 172.21.15.72:0/1058022286 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b28156370 con 0x7f8b280cb9b0 2023-08-31T18:48:52.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.531+0000 7f8b1e7fc700 1 -- 172.21.15.72:0/1058022286 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8b24006020 con 0x7f8b280cb9b0 2023-08-31T18:48:52.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.532+0000 7f8b1e7fc700 1 --2- 172.21.15.72:0/1058022286 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8b0c05ee10 0x7f8b0c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.532+0000 7f8b1e7fc700 1 -- 172.21.15.72:0/1058022286 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8b24079980 con 0x7f8b280cb9b0 2023-08-31T18:48:52.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.532+0000 7f8b2dd9a700 1 --2- 172.21.15.72:0/1058022286 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8b0c05ee10 0x7f8b0c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.532+0000 7f8b2dd9a700 1 --2- 172.21.15.72:0/1058022286 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8b0c05ee10 0x7f8b0c0612d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f8b28151220 tx=0x7f8b18008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.536+0000 7f8b1e7fc700 1 -- 172.21.15.72:0/1058022286 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8b240498f0 con 0x7f8b280cb9b0 2023-08-31T18:48:52.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.705+0000 7f8b307ff700 1 -- 172.21.15.72:0/1058022286 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b2806c6b0 con 0x7f8b280cb9b0 2023-08-31T18:48:52.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.706+0000 7f8b1e7fc700 1 -- 172.21.15.72:0/1058022286 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+17037 (secure 0 0 0) 0x7f8b2404ad30 con 0x7f8b280cb9b0 2023-08-31T18:48:52.707 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:52.707 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":33,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:48:51.891745+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:48:49.967130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T18:48:50.880157+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:48:52.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.708+0000 7f8b307ff700 1 -- 172.21.15.72:0/1058022286 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8b0c05ee10 msgr2=0x7f8b0c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.708+0000 7f8b307ff700 1 --2- 172.21.15.72:0/1058022286 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8b0c05ee10 0x7f8b0c0612d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f8b28151220 tx=0x7f8b18008040).stop 2023-08-31T18:48:52.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.708+0000 7f8b307ff700 1 -- 172.21.15.72:0/1058022286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b280cb9b0 msgr2=0x7f8b28150d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.708+0000 7f8b307ff700 1 --2- 172.21.15.72:0/1058022286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b280cb9b0 0x7f8b28150d30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f8b2400d890 tx=0x7f8b24008040).stop 2023-08-31T18:48:52.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.708+0000 7f8b307ff700 1 -- 172.21.15.72:0/1058022286 shutdown_connections 2023-08-31T18:48:52.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.708+0000 7f8b307ff700 1 --2- 172.21.15.72:0/1058022286 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8b281586b0 0x7f8b28167f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.708+0000 7f8b307ff700 1 --2- 172.21.15.72:0/1058022286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b280cb9b0 0x7f8b28150d30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.708+0000 7f8b307ff700 1 --2- 172.21.15.72:0/1058022286 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8b0c05ee10 0x7f8b0c0612d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.708+0000 7f8b307ff700 1 --2- 172.21.15.72:0/1058022286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b28154060 0x7f8b280add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.708+0000 7f8b307ff700 1 -- 172.21.15.72:0/1058022286 >> 172.21.15.72:0/1058022286 conn(0x7f8b2805e870 msgr2=0x7f8b28064700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:52.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.709+0000 7f8b307ff700 1 -- 172.21.15.72:0/1058022286 shutdown_connections 2023-08-31T18:48:52.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.709+0000 7f8b307ff700 1 -- 172.21.15.72:0/1058022286 wait complete. 2023-08-31T18:48:52.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T18:48:52.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.918+0000 7fe1a33ff700 1 Processor -- start 2023-08-31T18:48:52.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.918+0000 7fe1a33ff700 1 -- start start 2023-08-31T18:48:52.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.919+0000 7fe1a33ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe19c14e3c0 0x7fe19c0bc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.919+0000 7fe1a33ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe19c150f30 0x7fe19c0c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.920+0000 7fe1a33ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19c06a6c0 con 0x7fe19c0c1ef0 2023-08-31T18:48:52.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.920+0000 7fe1a33ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19c0c2380 con 0x7fe19c14e3c0 2023-08-31T18:48:52.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.920+0000 7fe1a33ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c0bca60 con 0x7fe19c150f30 2023-08-31T18:48:52.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.920+0000 7fe1a119b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe19c14e3c0 0x7fe19c0bc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.920+0000 7fe1a199c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe19c0c1ef0 0x7fe19c154460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42190/0 (socket says 172.21.15.72:42190) 2023-08-31T18:48:52.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.920+0000 7fe1a199c700 1 -- 172.21.15.72:0/2509667681 learned_addr learned my addr 172.21.15.72:0/2509667681 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:52.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.920+0000 7fe1a119b700 1 -- 172.21.15.72:0/2509667681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe19c150f30 msgr2=0x7fe19c0c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:52.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.920+0000 7fe1a099a700 1 --2- 172.21.15.72:0/2509667681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe19c150f30 0x7fe19c0c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.920+0000 7fe193fff700 1 -- 172.21.15.72:0/2509667681 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838942673 0 0) 0x7fe19c06a6c0 con 0x7fe19c0c1ef0 2023-08-31T18:48:52.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.920+0000 7fe1a119b700 1 --2- 172.21.15.72:0/2509667681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe19c150f30 0x7fe19c0c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.920+0000 7fe1a119b700 1 -- 172.21.15.72:0/2509667681 >> v1:172.21.15.72:6789/0 conn(0x7fe19c0c1ef0 legacy=0x7fe19c154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.920+0000 7fe1a119b700 1 -- 172.21.15.72:0/2509667681 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c0bcd40 con 0x7fe19c14e3c0 2023-08-31T18:48:52.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.920+0000 7fe1a099a700 1 --2- 172.21.15.72:0/2509667681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe19c150f30 0x7fe19c0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:52.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.921+0000 7fe1a119b700 1 --2- 172.21.15.72:0/2509667681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c14e3c0 0x7fe19c0bc180 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fe19800a900 tx=0x7fe19800a200).ready entity=mon.0 client_cookie=6724fdffbeacdc66 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:52.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.921+0000 7fe193fff700 1 -- 172.21.15.72:0/2509667681 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19800aea0 con 0x7fe19c14e3c0 2023-08-31T18:48:52.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.921+0000 7fe193fff700 1 -- 172.21.15.72:0/2509667681 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19800c970 con 0x7fe19c14e3c0 2023-08-31T18:48:52.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.921+0000 7fe193fff700 1 -- 172.21.15.72:0/2509667681 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19800ccf0 con 0x7fe19c14e3c0 2023-08-31T18:48:52.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.921+0000 7fe1a33ff700 1 -- 172.21.15.72:0/2509667681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c14e3c0 msgr2=0x7fe19c0bc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.921+0000 7fe1a33ff700 1 --2- 172.21.15.72:0/2509667681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c14e3c0 0x7fe19c0bc180 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fe19800a900 tx=0x7fe19800a200).stop 2023-08-31T18:48:52.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.921+0000 7fe1a33ff700 1 -- 172.21.15.72:0/2509667681 shutdown_connections 2023-08-31T18:48:52.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.921+0000 7fe1a33ff700 1 --2- 172.21.15.72:0/2509667681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c14e3c0 0x7fe19c0bc180 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.921+0000 7fe1a33ff700 1 --2- 172.21.15.72:0/2509667681 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe19c150f30 0x7fe19c0c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.921+0000 7fe1a33ff700 1 -- 172.21.15.72:0/2509667681 >> 172.21.15.72:0/2509667681 conn(0x7fe19c0630c0 msgr2=0x7fe19c0c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:52.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.921+0000 7fe1a33ff700 1 -- 172.21.15.72:0/2509667681 shutdown_connections 2023-08-31T18:48:52.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.921+0000 7fe1a33ff700 1 -- 172.21.15.72:0/2509667681 wait complete. 2023-08-31T18:48:52.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.923+0000 7fe1a33ff700 1 Processor -- start 2023-08-31T18:48:52.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.923+0000 7fe1a33ff700 1 -- start start 2023-08-31T18:48:52.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.924+0000 7fe1a33ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c0c1ef0 0x7fe19c0a9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.924+0000 7fe1a33ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19c14e3c0 0x7fe19c167650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.924+0000 7fe1a33ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe19c150f30 0x7fe19c14c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.924+0000 7fe1a33ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c1671c0 con 0x7fe19c0c1ef0 2023-08-31T18:48:52.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.924+0000 7fe1a33ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c0a9550 con 0x7fe19c14e3c0 2023-08-31T18:48:52.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.924+0000 7fe1a33ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c068e40 con 0x7fe19c150f30 2023-08-31T18:48:52.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.924+0000 7fe1a119b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c0c1ef0 0x7fe19c0a9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.924+0000 7fe1a119b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c0c1ef0 0x7fe19c0a9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37234/0 (socket says 172.21.15.72:37234) 2023-08-31T18:48:52.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.924+0000 7fe1a119b700 1 -- 172.21.15.72:0/795400109 learned_addr learned my addr 172.21.15.72:0/795400109 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:52.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.925+0000 7fe1a099a700 1 --2- 172.21.15.72:0/795400109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19c14e3c0 0x7fe19c167650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.925+0000 7fe1a119b700 1 -- 172.21.15.72:0/795400109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe19c150f30 msgr2=0x7fe19c14c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.925+0000 7fe1a119b700 1 --2- 172.21.15.72:0/795400109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe19c150f30 0x7fe19c14c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:52.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.925+0000 7fe1a119b700 1 -- 172.21.15.72:0/795400109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19c14e3c0 msgr2=0x7fe19c167650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:52.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.925+0000 7fe1a119b700 1 --2- 172.21.15.72:0/795400109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19c14e3c0 0x7fe19c167650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:52.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.925+0000 7fe1a119b700 1 -- 172.21.15.72:0/795400109 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19800a440 con 0x7fe19c0c1ef0 2023-08-31T18:48:52.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.925+0000 7fe1a099a700 1 --2- 172.21.15.72:0/795400109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19c14e3c0 0x7fe19c167650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:48:52.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.925+0000 7fe1a119b700 1 --2- 172.21.15.72:0/795400109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c0c1ef0 0x7fe19c0a9060 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fe19800c4d0 tx=0x7fe19800a200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:52.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.925+0000 7fe1917fa700 1 -- 172.21.15.72:0/795400109 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe198019420 con 0x7fe19c0c1ef0 2023-08-31T18:48:52.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.925+0000 7fe1917fa700 1 -- 172.21.15.72:0/795400109 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe198019580 con 0x7fe19c0c1ef0 2023-08-31T18:48:52.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.925+0000 7fe1a33ff700 1 -- 172.21.15.72:0/795400109 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19c069120 con 0x7fe19c0c1ef0 2023-08-31T18:48:52.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.925+0000 7fe1917fa700 1 -- 172.21.15.72:0/795400109 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe198019920 con 0x7fe19c0c1ef0 2023-08-31T18:48:52.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.925+0000 7fe1a33ff700 1 -- 172.21.15.72:0/795400109 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19c166e20 con 0x7fe19c0c1ef0 2023-08-31T18:48:52.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.926+0000 7fe1a33ff700 1 -- 172.21.15.72:0/795400109 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19c06c6b0 con 0x7fe19c0c1ef0 2023-08-31T18:48:52.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.927+0000 7fe1917fa700 1 -- 172.21.15.72:0/795400109 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fe198019d50 con 0x7fe19c0c1ef0 2023-08-31T18:48:52.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.928+0000 7fe1917fa700 1 --2- 172.21.15.72:0/795400109 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe18005ee40 0x7fe180061300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:52.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.928+0000 7fe1917fa700 1 -- 172.21.15.72:0/795400109 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe19807b450 con 0x7fe19c0c1ef0 2023-08-31T18:48:52.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.928+0000 7fe1a099a700 1 --2- 172.21.15.72:0/795400109 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe18005ee40 0x7fe180061300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:52.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.929+0000 7fe1a099a700 1 --2- 172.21.15.72:0/795400109 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe18005ee40 0x7fe180061300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fe18c006fd0 tx=0x7fe18c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:52.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:52.932+0000 7fe1917fa700 1 -- 172.21.15.72:0/795400109 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe19804c800 con 0x7fe19c0c1ef0 2023-08-31T18:48:53.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:53.146+0000 7fe1a33ff700 1 -- 172.21.15.72:0/795400109 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe19c0bd020 con 0x7fe19c0c1ef0 2023-08-31T18:48:53.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:53.905+0000 7fe1917fa700 1 -- 172.21.15.72:0/795400109 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe19804fe20 con 0x7fe19c0c1ef0 2023-08-31T18:48:53.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:53.907+0000 7fe1a33ff700 1 -- 172.21.15.72:0/795400109 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe18005ee40 msgr2=0x7fe180061300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:53.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:53.907+0000 7fe1a33ff700 1 --2- 172.21.15.72:0/795400109 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe18005ee40 0x7fe180061300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fe18c006fd0 tx=0x7fe18c008040).stop 2023-08-31T18:48:53.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:53.907+0000 7fe1a33ff700 1 -- 172.21.15.72:0/795400109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c0c1ef0 msgr2=0x7fe19c0a9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:53.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:53.907+0000 7fe1a33ff700 1 --2- 172.21.15.72:0/795400109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c0c1ef0 0x7fe19c0a9060 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fe19800c4d0 tx=0x7fe19800a200).stop 2023-08-31T18:48:53.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:53.907+0000 7fe1a33ff700 1 -- 172.21.15.72:0/795400109 shutdown_connections 2023-08-31T18:48:53.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:53.907+0000 7fe1a33ff700 1 --2- 172.21.15.72:0/795400109 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe19c150f30 0x7fe19c14c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:53.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:53.907+0000 7fe1a33ff700 1 --2- 172.21.15.72:0/795400109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe19c0c1ef0 0x7fe19c0a9060 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:53.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:53.907+0000 7fe1a33ff700 1 --2- 172.21.15.72:0/795400109 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe18005ee40 0x7fe180061300 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:53.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:53.907+0000 7fe1a33ff700 1 --2- 172.21.15.72:0/795400109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe19c14e3c0 0x7fe19c167650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:53.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:53.907+0000 7fe1a33ff700 1 -- 172.21.15.72:0/795400109 >> 172.21.15.72:0/795400109 conn(0x7fe19c0630c0 msgr2=0x7fe19c1507b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:53.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:53.908+0000 7fe1a33ff700 1 -- 172.21.15.72:0/795400109 shutdown_connections 2023-08-31T18:48:53.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:53.908+0000 7fe1a33ff700 1 -- 172.21.15.72:0/795400109 wait complete. 2023-08-31T18:48:53.927 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-31T18:48:53.927 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T18:48:54.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.121+0000 7f034f9ff700 1 Processor -- start 2023-08-31T18:48:54.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.121+0000 7f034f9ff700 1 -- start start 2023-08-31T18:48:54.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.122+0000 7f034f9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0348153e30 0x7f0348154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:54.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.122+0000 7f034f9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03480bfd40 con 0x7f03480637c0 2023-08-31T18:48:54.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.122+0000 7f034f9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03480c6730 con 0x7f03480c5cb0 2023-08-31T18:48:54.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.122+0000 7f034f9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03480bffe0 con 0x7f0348153e30 2023-08-31T18:48:54.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.122+0000 7f034df9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f03480637c0 0x7f03480c0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42194/0 (socket says 172.21.15.72:42194) 2023-08-31T18:48:54.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.122+0000 7f034df9c700 1 -- 172.21.15.72:0/1246669 learned_addr learned my addr 172.21.15.72:0/1246669 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:54.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f034d79b700 1 --2- 172.21.15.72:0/1246669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0348153e30 0x7f0348154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:54.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f033ffff700 1 -- 172.21.15.72:0/1246669 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533778235 0 0) 0x7f03480bfd40 con 0x7f03480637c0 2023-08-31T18:48:54.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f033ffff700 1 -- 172.21.15.72:0/1246669 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03340033f0 con 0x7f03480637c0 2023-08-31T18:48:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f033ffff700 1 -- 172.21.15.72:0/1246669 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2639201971 0 0) 0x7f03340033f0 con 0x7f03480637c0 2023-08-31T18:48:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f033ffff700 1 -- 172.21.15.72:0/1246669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0348153e30 msgr2=0x7f0348154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f033ffff700 1 --2- 172.21.15.72:0/1246669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0348153e30 0x7f0348154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:54.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f033ffff700 1 -- 172.21.15.72:0/1246669 >> v1:172.21.15.146:6789/0 conn(0x7f03480c5cb0 legacy=0x7f03480630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:54.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f033ffff700 1 -- 172.21.15.72:0/1246669 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03480c02c0 con 0x7f03480637c0 2023-08-31T18:48:54.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f033ffff700 1 -- 172.21.15.72:0/1246669 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f03400017f0 con 0x7f03480637c0 2023-08-31T18:48:54.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f033ffff700 1 -- 172.21.15.72:0/1246669 >> v1:172.21.15.72:6789/0 conn(0x7f03480637c0 legacy=0x7f03480c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:54.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f033ffff700 1 --2- 172.21.15.72:0/1246669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0334003910 0x7f0334003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f033ffff700 1 --2- 172.21.15.72:0/1246669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0334004690 0x7f0334004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f033ffff700 1 --2- 172.21.15.72:0/1246669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0348153e30 0x7f0334005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f033ffff700 1 -- 172.21.15.72:0/1246669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03480bffe0 con 0x7f0334004690 2023-08-31T18:48:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f033ffff700 1 -- 172.21.15.72:0/1246669 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033400b8e0 con 0x7f0334003910 2023-08-31T18:48:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.123+0000 7f033ffff700 1 -- 172.21.15.72:0/1246669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033400ba50 con 0x7f0348153e30 2023-08-31T18:48:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.124+0000 7f034cf9a700 1 --2- 172.21.15.72:0/1246669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0334004690 0x7f0334004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:54.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.124+0000 7f034d79b700 1 --2- 172.21.15.72:0/1246669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0334003910 0x7f0334003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:54.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.124+0000 7f034df9c700 1 --2- 172.21.15.72:0/1246669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0348153e30 0x7f0334005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:54.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.124+0000 7f034cf9a700 1 -- 172.21.15.72:0/1246669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0348153e30 msgr2=0x7f0334005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:54.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.124+0000 7f034cf9a700 1 --2- 172.21.15.72:0/1246669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0348153e30 0x7f0334005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:54.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.124+0000 7f034cf9a700 1 -- 172.21.15.72:0/1246669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0334003910 msgr2=0x7f0334003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:54.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.124+0000 7f034cf9a700 1 --2- 172.21.15.72:0/1246669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0334003910 0x7f0334003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:54.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.124+0000 7f034cf9a700 1 -- 172.21.15.72:0/1246669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03340033f0 con 0x7f0334004690 2023-08-31T18:48:54.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.124+0000 7f034cf9a700 1 --2- 172.21.15.72:0/1246669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0334004690 0x7f0334004b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f03480aa890 tx=0x7f0338007bb0).ready entity=mon.0 client_cookie=35cdc540d96c0247 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:54.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.124+0000 7f033ffff700 1 -- 172.21.15.72:0/1246669 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338012400 con 0x7f0334004690 2023-08-31T18:48:54.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.124+0000 7f033ffff700 1 -- 172.21.15.72:0/1246669 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0338012560 con 0x7f0334004690 2023-08-31T18:48:54.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.124+0000 7f033ffff700 1 -- 172.21.15.72:0/1246669 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338012920 con 0x7f0334004690 2023-08-31T18:48:54.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.125+0000 7f034f9ff700 1 -- 172.21.15.72:0/1246669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0334004690 msgr2=0x7f0334004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:54.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.125+0000 7f034f9ff700 1 --2- 172.21.15.72:0/1246669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0334004690 0x7f0334004b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f03480aa890 tx=0x7f0338007bb0).stop 2023-08-31T18:48:54.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.125+0000 7f034df9c700 1 -- 172.21.15.72:0/1246669 reap_dead start 2023-08-31T18:48:54.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.125+0000 7f034f9ff700 1 -- 172.21.15.72:0/1246669 shutdown_connections 2023-08-31T18:48:54.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.125+0000 7f034f9ff700 1 -- 172.21.15.72:0/1246669 >> 172.21.15.72:0/1246669 conn(0x7f034805eb20 msgr2=0x7f03480cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:54.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.125+0000 7f034f9ff700 1 -- 172.21.15.72:0/1246669 shutdown_connections 2023-08-31T18:48:54.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.125+0000 7f034f9ff700 1 -- 172.21.15.72:0/1246669 wait complete. 2023-08-31T18:48:54.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.127+0000 7f034f9ff700 1 Processor -- start 2023-08-31T18:48:54.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.127+0000 7f034f9ff700 1 -- start start 2023-08-31T18:48:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034f9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0334004690 0x7f034814eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034f9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0348150670 0x7f0348150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034f9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0348152c30 0x7f0348153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034f9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0348150fe0 con 0x7f0334004690 2023-08-31T18:48:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034f9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0348151df0 con 0x7f0348150670 2023-08-31T18:48:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034f9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03481640d0 con 0x7f0348152c30 2023-08-31T18:48:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034d79b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0334004690 0x7f034814eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034d79b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0334004690 0x7f034814eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37252/0 (socket says 172.21.15.72:37252) 2023-08-31T18:48:54.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034d79b700 1 -- 172.21.15.72:0/4146721480 learned_addr learned my addr 172.21.15.72:0/4146721480 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:54.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034df9c700 1 --2- 172.21.15.72:0/4146721480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0348152c30 0x7f0348153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:54.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034cf9a700 1 --2- 172.21.15.72:0/4146721480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0348150670 0x7f0348150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:54.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034d79b700 1 -- 172.21.15.72:0/4146721480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0348152c30 msgr2=0x7f0348153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:54.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034d79b700 1 --2- 172.21.15.72:0/4146721480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0348152c30 0x7f0348153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:54.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034d79b700 1 -- 172.21.15.72:0/4146721480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0348150670 msgr2=0x7f0348150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:54.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034d79b700 1 --2- 172.21.15.72:0/4146721480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0348150670 0x7f0348150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:54.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034d79b700 1 -- 172.21.15.72:0/4146721480 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0348153580 con 0x7f0334004690 2023-08-31T18:48:54.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034cf9a700 1 --2- 172.21.15.72:0/4146721480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0348150670 0x7f0348150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:54.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.128+0000 7f034d79b700 1 --2- 172.21.15.72:0/4146721480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0334004690 0x7f034814eab0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f0344011a20 tx=0x7f0344009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:54.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.129+0000 7f033d7fa700 1 -- 172.21.15.72:0/4146721480 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034400f940 con 0x7f0334004690 2023-08-31T18:48:54.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.129+0000 7f033d7fa700 1 -- 172.21.15.72:0/4146721480 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034400faa0 con 0x7f0334004690 2023-08-31T18:48:54.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.129+0000 7f033d7fa700 1 -- 172.21.15.72:0/4146721480 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034400fe20 con 0x7f0334004690 2023-08-31T18:48:54.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.129+0000 7f034f9ff700 1 -- 172.21.15.72:0/4146721480 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03481511e0 con 0x7f0334004690 2023-08-31T18:48:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.129+0000 7f034f9ff700 1 -- 172.21.15.72:0/4146721480 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03481517a0 con 0x7f0334004690 2023-08-31T18:48:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.130+0000 7f034f9ff700 1 -- 172.21.15.72:0/4146721480 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034806c6b0 con 0x7f0334004690 2023-08-31T18:48:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.130+0000 7f033d7fa700 1 -- 172.21.15.72:0/4146721480 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f0344014650 con 0x7f0334004690 2023-08-31T18:48:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.131+0000 7f033d7fa700 1 --2- 172.21.15.72:0/4146721480 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f032c05ee10 0x7f032c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.132+0000 7f033d7fa700 1 -- 172.21.15.72:0/4146721480 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f034407aa20 con 0x7f0334004690 2023-08-31T18:48:54.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.132+0000 7f034cf9a700 1 --2- 172.21.15.72:0/4146721480 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f032c05ee10 0x7f032c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.132+0000 7f034cf9a700 1 --2- 172.21.15.72:0/4146721480 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f032c05ee10 0x7f032c0612d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f0338000ff0 tx=0x7f0338017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:54.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.136+0000 7f033d7fa700 1 -- 172.21.15.72:0/4146721480 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f034404bdd0 con 0x7f0334004690 2023-08-31T18:48:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.345+0000 7f034f9ff700 1 -- 172.21.15.72:0/4146721480 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f03480c05a0 con 0x7f0334004690 2023-08-31T18:48:54.410 INFO:tasks.ceph.mds.b.smithi146.stderr:2023-08-31T18:48:54.409+0000 7fb320ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T18:48:54.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.906+0000 7f033d7fa700 1 -- 172.21.15.72:0/4146721480 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f034404f3f0 con 0x7f0334004690 2023-08-31T18:48:54.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.909+0000 7f034f9ff700 1 -- 172.21.15.72:0/4146721480 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f032c05ee10 msgr2=0x7f032c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:54.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.909+0000 7f034f9ff700 1 --2- 172.21.15.72:0/4146721480 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f032c05ee10 0x7f032c0612d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f0338000ff0 tx=0x7f0338017000).stop 2023-08-31T18:48:54.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.909+0000 7f034f9ff700 1 -- 172.21.15.72:0/4146721480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0334004690 msgr2=0x7f034814eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:54.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.909+0000 7f034f9ff700 1 --2- 172.21.15.72:0/4146721480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0334004690 0x7f034814eab0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f0344011a20 tx=0x7f0344009060).stop 2023-08-31T18:48:54.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.909+0000 7f034f9ff700 1 -- 172.21.15.72:0/4146721480 shutdown_connections 2023-08-31T18:48:54.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.909+0000 7f034f9ff700 1 --2- 172.21.15.72:0/4146721480 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0348152c30 0x7f0348153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:54.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.909+0000 7f034f9ff700 1 --2- 172.21.15.72:0/4146721480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0334004690 0x7f034814eab0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.909+0000 7f034f9ff700 1 --2- 172.21.15.72:0/4146721480 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f032c05ee10 0x7f032c0612d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.909+0000 7f034f9ff700 1 --2- 172.21.15.72:0/4146721480 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0348150670 0x7f0348150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.909+0000 7f034f9ff700 1 -- 172.21.15.72:0/4146721480 >> 172.21.15.72:0/4146721480 conn(0x7f034805eb20 msgr2=0x7f03480ac3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.909+0000 7f034f9ff700 1 -- 172.21.15.72:0/4146721480 shutdown_connections 2023-08-31T18:48:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:54.909+0000 7f034f9ff700 1 -- 172.21.15.72:0/4146721480 wait complete. 2023-08-31T18:48:54.928 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T18:48:54.928 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T18:48:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.115+0000 7fc511bff700 1 Processor -- start 2023-08-31T18:48:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.116+0000 7fc511bff700 1 -- start start 2023-08-31T18:48:55.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.117+0000 7fc511bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc50c15ce50 0x7fc50c15f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.117+0000 7fc511bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50c0c6120 con 0x7fc50c0cb9b0 2023-08-31T18:48:55.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.117+0000 7fc511bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50c0c5e10 con 0x7fc50c154060 2023-08-31T18:48:55.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.117+0000 7fc511bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c0c1380 con 0x7fc50c15ce50 2023-08-31T18:48:55.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.117+0000 7fc50affd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc50c0cb9b0 0x7fc50c1583e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42204/0 (socket says 172.21.15.72:42204) 2023-08-31T18:48:55.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.117+0000 7fc50affd700 1 -- 172.21.15.72:0/1803121266 learned_addr learned my addr 172.21.15.72:0/1803121266 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:55.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50bfff700 1 --2- 172.21.15.72:0/1803121266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc50c15ce50 0x7fc50c15f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408946899 0 0) 0x7fc50c0c6120 con 0x7fc50c0cb9b0 2023-08-31T18:48:55.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4f40033f0 con 0x7fc50c0cb9b0 2023-08-31T18:48:55.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287854171 0 0) 0x7fc50c0c5e10 con 0x7fc50c154060 2023-08-31T18:48:55.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc50c0c6120 con 0x7fc50c154060 2023-08-31T18:48:55.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 293349344 0 0) 0x7fc4f40033f0 con 0x7fc50c0cb9b0 2023-08-31T18:48:55.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc50c15ce50 msgr2=0x7fc50c15f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 --2- 172.21.15.72:0/1803121266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc50c15ce50 0x7fc50c15f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 >> v1:172.21.15.146:6789/0 conn(0x7fc50c154060 legacy=0x7fc50c157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c158af0 con 0x7fc50c0cb9b0 2023-08-31T18:48:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fc500001470 con 0x7fc50c0cb9b0 2023-08-31T18:48:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 >> v1:172.21.15.72:6789/0 conn(0x7fc50c0cb9b0 legacy=0x7fc50c1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 --2- 172.21.15.72:0/1803121266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4f4003aa0 0x7fc4f4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 --2- 172.21.15.72:0/1803121266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc50c15ce50 0x7fc4f4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 --2- 172.21.15.72:0/1803121266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4f4004b80 0x7fc4f4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c0c1380 con 0x7fc4f4003aa0 2023-08-31T18:48:55.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f400b910 con 0x7fc4f4004b80 2023-08-31T18:48:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f400bad0 con 0x7fc50c15ce50 2023-08-31T18:48:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.118+0000 7fc50b7fe700 1 --2- 172.21.15.72:0/1803121266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4f4003aa0 0x7fc4f4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.119+0000 7fc50affd700 1 --2- 172.21.15.72:0/1803121266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc50c15ce50 0x7fc4f4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.119+0000 7fc50bfff700 1 --2- 172.21.15.72:0/1803121266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4f4004b80 0x7fc4f4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.119+0000 7fc50b7fe700 1 -- 172.21.15.72:0/1803121266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc50c15ce50 msgr2=0x7fc4f4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:55.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.119+0000 7fc50b7fe700 1 --2- 172.21.15.72:0/1803121266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc50c15ce50 0x7fc4f4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.119+0000 7fc50b7fe700 1 -- 172.21.15.72:0/1803121266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4f4004b80 msgr2=0x7fc4f4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.119+0000 7fc50b7fe700 1 --2- 172.21.15.72:0/1803121266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4f4004b80 0x7fc4f4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.119+0000 7fc50b7fe700 1 -- 172.21.15.72:0/1803121266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f40033f0 con 0x7fc4f4003aa0 2023-08-31T18:48:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.119+0000 7fc50b7fe700 1 --2- 172.21.15.72:0/1803121266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4f4003aa0 0x7fc4f4003ea0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fc4fc001920 tx=0x7fc4fc007c00).ready entity=mon.0 client_cookie=44246bc3d5ad7d81 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.119+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc007020 con 0x7fc4f4003aa0 2023-08-31T18:48:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.119+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc007180 con 0x7fc4f4003aa0 2023-08-31T18:48:55.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.119+0000 7fc50a7fc700 1 -- 172.21.15.72:0/1803121266 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc007500 con 0x7fc4f4003aa0 2023-08-31T18:48:55.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.120+0000 7fc511bff700 1 -- 172.21.15.72:0/1803121266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4f4003aa0 msgr2=0x7fc4f4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.120+0000 7fc511bff700 1 --2- 172.21.15.72:0/1803121266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4f4003aa0 0x7fc4f4003ea0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fc4fc001920 tx=0x7fc4fc007c00).stop 2023-08-31T18:48:55.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.120+0000 7fc50bfff700 1 -- 172.21.15.72:0/1803121266 reap_dead start 2023-08-31T18:48:55.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.120+0000 7fc511bff700 1 -- 172.21.15.72:0/1803121266 shutdown_connections 2023-08-31T18:48:55.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.120+0000 7fc511bff700 1 -- 172.21.15.72:0/1803121266 >> 172.21.15.72:0/1803121266 conn(0x7fc50c05e870 msgr2=0x7fc50c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:55.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.120+0000 7fc511bff700 1 -- 172.21.15.72:0/1803121266 shutdown_connections 2023-08-31T18:48:55.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.120+0000 7fc511bff700 1 -- 172.21.15.72:0/1803121266 wait complete. 2023-08-31T18:48:55.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.121+0000 7fc511bff700 1 Processor -- start 2023-08-31T18:48:55.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.121+0000 7fc511bff700 1 -- start start 2023-08-31T18:48:55.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.122+0000 7fc511bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4f4003aa0 0x7fc50c14a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.122+0000 7fc511bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc50c151c50 0x7fc50c0af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.122+0000 7fc511bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc50c155a70 0x7fc50c155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.122+0000 7fc511bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c152cf0 con 0x7fc4f4003aa0 2023-08-31T18:48:55.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.122+0000 7fc511bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c1520e0 con 0x7fc50c155a70 2023-08-31T18:48:55.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.122+0000 7fc511bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c1523c0 con 0x7fc50c151c50 2023-08-31T18:48:55.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.123+0000 7fc50b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4f4003aa0 0x7fc50c14a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.123+0000 7fc50b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4f4003aa0 0x7fc50c14a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37276/0 (socket says 172.21.15.72:37276) 2023-08-31T18:48:55.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.123+0000 7fc50b7fe700 1 -- 172.21.15.72:0/2745087019 learned_addr learned my addr 172.21.15.72:0/2745087019 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:55.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.123+0000 7fc50affd700 1 --2- 172.21.15.72:0/2745087019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc50c151c50 0x7fc50c0af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.123+0000 7fc50bfff700 1 --2- 172.21.15.72:0/2745087019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc50c155a70 0x7fc50c155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.123+0000 7fc50b7fe700 1 -- 172.21.15.72:0/2745087019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc50c151c50 msgr2=0x7fc50c0af9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.123+0000 7fc50b7fe700 1 --2- 172.21.15.72:0/2745087019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc50c151c50 0x7fc50c0af9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.123+0000 7fc50b7fe700 1 -- 172.21.15.72:0/2745087019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc50c155a70 msgr2=0x7fc50c155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.123+0000 7fc50b7fe700 1 --2- 172.21.15.72:0/2745087019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc50c155a70 0x7fc50c155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.123+0000 7fc50b7fe700 1 -- 172.21.15.72:0/2745087019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c1526a0 con 0x7fc4f4003aa0 2023-08-31T18:48:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.123+0000 7fc50b7fe700 1 --2- 172.21.15.72:0/2745087019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4f4003aa0 0x7fc50c14a980 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fc4fc007fd0 tx=0x7fc4fc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.123+0000 7fc4f37fe700 1 -- 172.21.15.72:0/2745087019 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc012610 con 0x7fc4f4003aa0 2023-08-31T18:48:55.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.124+0000 7fc4f37fe700 1 -- 172.21.15.72:0/2745087019 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc012770 con 0x7fc4f4003aa0 2023-08-31T18:48:55.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.124+0000 7fc4f37fe700 1 -- 172.21.15.72:0/2745087019 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc012b30 con 0x7fc4f4003aa0 2023-08-31T18:48:55.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.124+0000 7fc511bff700 1 -- 172.21.15.72:0/2745087019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50c152980 con 0x7fc4f4003aa0 2023-08-31T18:48:55.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.124+0000 7fc511bff700 1 -- 172.21.15.72:0/2745087019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50c0afea0 con 0x7fc4f4003aa0 2023-08-31T18:48:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.125+0000 7fc511bff700 1 -- 172.21.15.72:0/2745087019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc50c0b00c0 con 0x7fc4f4003aa0 2023-08-31T18:48:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.125+0000 7fc4f37fe700 1 -- 172.21.15.72:0/2745087019 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc4fc01e450 con 0x7fc4f4003aa0 2023-08-31T18:48:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.126+0000 7fc4f37fe700 1 --2- 172.21.15.72:0/2745087019 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc4f805ee10 0x7fc4f80612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.126+0000 7fc4f37fe700 1 -- 172.21.15.72:0/2745087019 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc4fc07ae00 con 0x7fc4f4003aa0 2023-08-31T18:48:55.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.126+0000 7fc50affd700 1 --2- 172.21.15.72:0/2745087019 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc4f805ee10 0x7fc4f80612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.127+0000 7fc50affd700 1 --2- 172.21.15.72:0/2745087019 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc4f805ee10 0x7fc4f80612d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc50c0639d0 tx=0x7fc500007040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:55.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.131+0000 7fc4f37fe700 1 -- 172.21.15.72:0/2745087019 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4fc04c150 con 0x7fc4f4003aa0 2023-08-31T18:48:55.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.339+0000 7fc511bff700 1 -- 172.21.15.72:0/2745087019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc50c06c6b0 con 0x7fc4f4003aa0 2023-08-31T18:48:55.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.340+0000 7fc4f37fe700 1 -- 172.21.15.72:0/2745087019 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4489 (secure 0 0 0) 0x7fc4fc04f770 con 0x7fc4f4003aa0 2023-08-31T18:48:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:55.340 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/682775915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":682775915},{"type":"v1","addr":"172.21.15.146:6835","nonce":682775915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/934559211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":934559211},{"type":"v1","addr":"172.21.15.72:6836","nonce":934559211}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2587704834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2587704834},{"type":"v1","addr":"172.21.15.72:6837","nonce":2587704834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T18:48:51.892123+0000","modified":"2023-08-31T18:48:54.904501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/1295593403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1295593403},{"type":"v1","addr":"172.21.15.146:6834","nonce":1295593403}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-31T18:48:55.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.342+0000 7fc511bff700 1 -- 172.21.15.72:0/2745087019 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc4f805ee10 msgr2=0x7fc4f80612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.342+0000 7fc511bff700 1 --2- 172.21.15.72:0/2745087019 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc4f805ee10 0x7fc4f80612d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc50c0639d0 tx=0x7fc500007040).stop 2023-08-31T18:48:55.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.342+0000 7fc511bff700 1 -- 172.21.15.72:0/2745087019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4f4003aa0 msgr2=0x7fc50c14a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.342+0000 7fc511bff700 1 --2- 172.21.15.72:0/2745087019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4f4003aa0 0x7fc50c14a980 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fc4fc007fd0 tx=0x7fc4fc016000).stop 2023-08-31T18:48:55.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.342+0000 7fc511bff700 1 -- 172.21.15.72:0/2745087019 shutdown_connections 2023-08-31T18:48:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.342+0000 7fc511bff700 1 --2- 172.21.15.72:0/2745087019 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc4f805ee10 0x7fc4f80612d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.342+0000 7fc511bff700 1 --2- 172.21.15.72:0/2745087019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc50c155a70 0x7fc50c155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.342+0000 7fc511bff700 1 --2- 172.21.15.72:0/2745087019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4f4003aa0 0x7fc50c14a980 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.342+0000 7fc511bff700 1 --2- 172.21.15.72:0/2745087019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc50c151c50 0x7fc50c0af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.342+0000 7fc511bff700 1 -- 172.21.15.72:0/2745087019 >> 172.21.15.72:0/2745087019 conn(0x7fc50c05e870 msgr2=0x7fc50c064110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:55.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.342+0000 7fc511bff700 1 -- 172.21.15.72:0/2745087019 shutdown_connections 2023-08-31T18:48:55.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.342+0000 7fc511bff700 1 -- 172.21.15.72:0/2745087019 wait complete. 2023-08-31T18:48:55.345 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2023-08-31T18:48:55.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T18:48:55.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.547+0000 7f0aa7dff700 1 Processor -- start 2023-08-31T18:48:55.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.548+0000 7f0aa7dff700 1 -- start start 2023-08-31T18:48:55.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.549+0000 7f0aa7dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aa0154220 0x7f0aa0157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.549+0000 7f0aa7dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0aa01588d0 0x7f0aa00c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.549+0000 7f0aa7dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa00c8c90 con 0x7f0aa00cb940 2023-08-31T18:48:55.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.549+0000 7f0aa7dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa00aa700 con 0x7f0aa01588d0 2023-08-31T18:48:55.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.549+0000 7f0aa7dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00c5e10 con 0x7f0aa0154220 2023-08-31T18:48:55.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.549+0000 7f0aa639c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0aa01588d0 0x7f0aa00c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.549+0000 7f0aa639c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0aa01588d0 0x7f0aa00c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37284/0 (socket says 172.21.15.72:37284) 2023-08-31T18:48:55.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.549+0000 7f0aa639c700 1 -- 172.21.15.72:0/2239646516 learned_addr learned my addr 172.21.15.72:0/2239646516 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:55.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.549+0000 7f0aa5b9b700 1 --2- 172.21.15.72:0/2239646516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aa0154220 0x7f0aa0157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.550+0000 7f0aa639c700 1 -- 172.21.15.72:0/2239646516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aa0154220 msgr2=0x7f0aa0157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:55.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.550+0000 7f0aa639c700 1 --2- 172.21.15.72:0/2239646516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aa0154220 0x7f0aa0157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.550+0000 7f0aa639c700 1 -- 172.21.15.72:0/2239646516 >> v1:172.21.15.146:6789/0 conn(0x7f0aa00cb940 legacy=0x7f0aa01581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.550+0000 7f0aa639c700 1 -- 172.21.15.72:0/2239646516 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa0155610 con 0x7f0aa01588d0 2023-08-31T18:48:55.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.550+0000 7f0aa4b99700 1 -- 172.21.15.72:0/2239646516 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597455557 0 0) 0x7f0aa00c8c90 con 0x7f0aa00cb940 2023-08-31T18:48:55.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.550+0000 7f0aa639c700 1 --2- 172.21.15.72:0/2239646516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa01588d0 0x7f0aa00c6540 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f0a98009f20 tx=0x7f0a98009840).ready entity=mon.0 client_cookie=b8845e2c1276872d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:55.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.550+0000 7f0aa4b99700 1 -- 172.21.15.72:0/2239646516 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800e070 con 0x7f0aa01588d0 2023-08-31T18:48:55.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.550+0000 7f0aa4b99700 1 -- 172.21.15.72:0/2239646516 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9800b9d0 con 0x7f0aa01588d0 2023-08-31T18:48:55.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.550+0000 7f0aa4b99700 1 -- 172.21.15.72:0/2239646516 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800bd50 con 0x7f0aa01588d0 2023-08-31T18:48:55.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.551+0000 7f0aa7dff700 1 -- 172.21.15.72:0/2239646516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa01588d0 msgr2=0x7f0aa00c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.551+0000 7f0aa7dff700 1 --2- 172.21.15.72:0/2239646516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa01588d0 0x7f0aa00c6540 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f0a98009f20 tx=0x7f0a98009840).stop 2023-08-31T18:48:55.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.551+0000 7f0aa7dff700 1 -- 172.21.15.72:0/2239646516 shutdown_connections 2023-08-31T18:48:55.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.551+0000 7f0aa7dff700 1 --2- 172.21.15.72:0/2239646516 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aa0154220 0x7f0aa0157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.551+0000 7f0aa7dff700 1 --2- 172.21.15.72:0/2239646516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa01588d0 0x7f0aa00c6540 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.551+0000 7f0aa7dff700 1 -- 172.21.15.72:0/2239646516 >> 172.21.15.72:0/2239646516 conn(0x7f0aa005e870 msgr2=0x7f0aa00cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:55.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.551+0000 7f0aa7dff700 1 -- 172.21.15.72:0/2239646516 shutdown_connections 2023-08-31T18:48:55.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.551+0000 7f0aa7dff700 1 -- 172.21.15.72:0/2239646516 wait complete. 2023-08-31T18:48:55.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.552+0000 7f0aa7dff700 1 Processor -- start 2023-08-31T18:48:55.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.553+0000 7f0aa7dff700 1 -- start start 2023-08-31T18:48:55.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.553+0000 7f0aa7dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aa00cb940 0x7f0aa014b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.553+0000 7f0aa7dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa0154220 0x7f0aa014ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa7dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aa01588d0 0x7f0aa0150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa7dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa0151710 con 0x7f0aa0154220 2023-08-31T18:48:55.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa7dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa0150500 con 0x7f0aa00cb940 2023-08-31T18:48:55.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa7dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa014fb80 con 0x7f0aa01588d0 2023-08-31T18:48:55.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa539a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa0154220 0x7f0aa014ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa539a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa0154220 0x7f0aa014ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37298/0 (socket says 172.21.15.72:37298) 2023-08-31T18:48:55.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa539a700 1 -- 172.21.15.72:0/3895434398 learned_addr learned my addr 172.21.15.72:0/3895434398 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:55.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa5b9b700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aa00cb940 0x7f0aa014b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa639c700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aa01588d0 0x7f0aa0150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa539a700 1 -- 172.21.15.72:0/3895434398 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aa01588d0 msgr2=0x7f0aa0150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa539a700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aa01588d0 0x7f0aa0150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa539a700 1 -- 172.21.15.72:0/3895434398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aa00cb940 msgr2=0x7f0aa014b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa539a700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aa00cb940 0x7f0aa014b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa539a700 1 -- 172.21.15.72:0/3895434398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a98009ae0 con 0x7f0aa0154220 2023-08-31T18:48:55.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa639c700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aa01588d0 0x7f0aa0150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:55.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa5b9b700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aa00cb940 0x7f0aa014b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:55.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.554+0000 7f0aa539a700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa0154220 0x7f0aa014ad40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f0a90001eb0 tx=0x7f0a90007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:55.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.555+0000 7f0a95ffb700 1 -- 172.21.15.72:0/3895434398 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9000f470 con 0x7f0aa0154220 2023-08-31T18:48:55.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.555+0000 7f0a95ffb700 1 -- 172.21.15.72:0/3895434398 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9000f5f0 con 0x7f0aa0154220 2023-08-31T18:48:55.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.555+0000 7f0aa7dff700 1 -- 172.21.15.72:0/3895434398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa014f570 con 0x7f0aa0154220 2023-08-31T18:48:55.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.555+0000 7f0a95ffb700 1 -- 172.21.15.72:0/3895434398 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9000f9b0 con 0x7f0aa0154220 2023-08-31T18:48:55.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.555+0000 7f0aa7dff700 1 -- 172.21.15.72:0/3895434398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa014f810 con 0x7f0aa0154220 2023-08-31T18:48:55.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.556+0000 7f0aa7dff700 1 -- 172.21.15.72:0/3895434398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa006c6b0 con 0x7f0aa0154220 2023-08-31T18:48:55.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.556+0000 7f0a95ffb700 1 -- 172.21.15.72:0/3895434398 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f0a9000fd20 con 0x7f0aa0154220 2023-08-31T18:48:55.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.557+0000 7f0a95ffb700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0a8405ee10 0x7f0a840612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.557+0000 7f0a95ffb700 1 -- 172.21.15.72:0/3895434398 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0a90079300 con 0x7f0aa0154220 2023-08-31T18:48:55.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.557+0000 7f0aa5b9b700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0a8405ee10 0x7f0a840612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.558+0000 7f0aa5b9b700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0a8405ee10 0x7f0a840612d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f0a9c009200 tx=0x7f0a9c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:55.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.561+0000 7f0a95ffb700 1 -- 172.21.15.72:0/3895434398 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0a900488f0 con 0x7f0aa0154220 2023-08-31T18:48:55.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.731+0000 7f0aa7dff700 1 -- 172.21.15.72:0/3895434398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0aa014e4e0 con 0x7f0aa0154220 2023-08-31T18:48:55.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.732+0000 7f0a95ffb700 1 -- 172.21.15.72:0/3895434398 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+17024 (secure 0 0 0) 0x7f0a9004a760 con 0x7f0aa0154220 2023-08-31T18:48:55.732 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:55.733 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":34,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T18:48:52.894678+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:48:49.967130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T18:48:50.880157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T18:48:55.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.734+0000 7f0aa7dff700 1 -- 172.21.15.72:0/3895434398 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0a8405ee10 msgr2=0x7f0a840612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.734+0000 7f0aa7dff700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0a8405ee10 0x7f0a840612d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f0a9c009200 tx=0x7f0a9c008040).stop 2023-08-31T18:48:55.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.734+0000 7f0aa7dff700 1 -- 172.21.15.72:0/3895434398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa0154220 msgr2=0x7f0aa014ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.734+0000 7f0aa7dff700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa0154220 0x7f0aa014ad40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f0a90001eb0 tx=0x7f0a90007c40).stop 2023-08-31T18:48:55.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.734+0000 7f0aa7dff700 1 -- 172.21.15.72:0/3895434398 shutdown_connections 2023-08-31T18:48:55.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.734+0000 7f0aa7dff700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0aa01588d0 0x7f0aa0150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.734+0000 7f0aa7dff700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0a8405ee10 0x7f0a840612d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.734+0000 7f0aa7dff700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0aa00cb940 0x7f0aa014b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.734+0000 7f0aa7dff700 1 --2- 172.21.15.72:0/3895434398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0aa0154220 0x7f0aa014ad40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.734+0000 7f0aa7dff700 1 -- 172.21.15.72:0/3895434398 >> 172.21.15.72:0/3895434398 conn(0x7f0aa005e870 msgr2=0x7f0aa00a7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:55.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.734+0000 7f0aa7dff700 1 -- 172.21.15.72:0/3895434398 shutdown_connections 2023-08-31T18:48:55.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.734+0000 7f0aa7dff700 1 -- 172.21.15.72:0/3895434398 wait complete. 2023-08-31T18:48:55.752 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T18:48:55.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T18:48:55.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.941+0000 7fe210fff700 1 Processor -- start 2023-08-31T18:48:55.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.941+0000 7fe210fff700 1 -- start start 2023-08-31T18:48:55.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.942+0000 7fe210fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe20c154060 0x7fe20c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.942+0000 7fe210fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe20c1588d0 0x7fe20c154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.942+0000 7fe210fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20c0c6120 con 0x7fe20c0cb9b0 2023-08-31T18:48:55.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.942+0000 7fe210fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20c0c1380 con 0x7fe20c1588d0 2023-08-31T18:48:55.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.942+0000 7fe210fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c0c5e10 con 0x7fe20c154060 2023-08-31T18:48:55.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.942+0000 7fe20ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe20c1588d0 0x7fe20c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.943+0000 7fe20ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe20c1588d0 0x7fe20c154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37304/0 (socket says 172.21.15.72:37304) 2023-08-31T18:48:55.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.943+0000 7fe20ad9d700 1 -- 172.21.15.72:0/759411330 learned_addr learned my addr 172.21.15.72:0/759411330 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:55.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.943+0000 7fe20a59c700 1 --2- 172.21.15.72:0/759411330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe20c154060 0x7fe20c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.943+0000 7fe20ad9d700 1 -- 172.21.15.72:0/759411330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe20c154060 msgr2=0x7fe20c157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:55.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.943+0000 7fe20ad9d700 1 --2- 172.21.15.72:0/759411330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe20c154060 0x7fe20c157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.943+0000 7fe20ad9d700 1 -- 172.21.15.72:0/759411330 >> v1:172.21.15.146:6789/0 conn(0x7fe20c0cb9b0 legacy=0x7fe20c1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.943+0000 7fe20ad9d700 1 -- 172.21.15.72:0/759411330 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c0c0ae0 con 0x7fe20c1588d0 2023-08-31T18:48:55.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.943+0000 7fe20ad9d700 1 --2- 172.21.15.72:0/759411330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c1588d0 0x7fe20c154440 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fe204009f20 tx=0x7fe204009840).ready entity=mon.0 client_cookie=a7739ec711ae737a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:55.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.943+0000 7fe20959a700 1 -- 172.21.15.72:0/759411330 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20400e070 con 0x7fe20c1588d0 2023-08-31T18:48:55.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.943+0000 7fe20959a700 1 -- 172.21.15.72:0/759411330 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20400b9d0 con 0x7fe20c1588d0 2023-08-31T18:48:55.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.943+0000 7fe20959a700 1 -- 172.21.15.72:0/759411330 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20400bd50 con 0x7fe20c1588d0 2023-08-31T18:48:55.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.944+0000 7fe210fff700 1 -- 172.21.15.72:0/759411330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c1588d0 msgr2=0x7fe20c154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.944+0000 7fe210fff700 1 --2- 172.21.15.72:0/759411330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c1588d0 0x7fe20c154440 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fe204009f20 tx=0x7fe204009840).stop 2023-08-31T18:48:55.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.944+0000 7fe210fff700 1 -- 172.21.15.72:0/759411330 shutdown_connections 2023-08-31T18:48:55.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.944+0000 7fe210fff700 1 --2- 172.21.15.72:0/759411330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe20c154060 0x7fe20c157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.944+0000 7fe210fff700 1 --2- 172.21.15.72:0/759411330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c1588d0 0x7fe20c154440 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.944+0000 7fe210fff700 1 -- 172.21.15.72:0/759411330 >> 172.21.15.72:0/759411330 conn(0x7fe20c05e870 msgr2=0x7fe20c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:55.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.944+0000 7fe210fff700 1 -- 172.21.15.72:0/759411330 shutdown_connections 2023-08-31T18:48:55.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.944+0000 7fe210fff700 1 -- 172.21.15.72:0/759411330 wait complete. 2023-08-31T18:48:55.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.946+0000 7fe210fff700 1 Processor -- start 2023-08-31T18:48:55.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.946+0000 7fe210fff700 1 -- start start 2023-08-31T18:48:55.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe210fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c0cb9b0 0x7fe20c0a8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe210fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe20c154060 0x7fe20c156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe210fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe20c1588d0 0x7fe20c14ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe210fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c0c2c90 con 0x7fe20c0cb9b0 2023-08-31T18:48:55.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe210fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c1576c0 con 0x7fe20c154060 2023-08-31T18:48:55.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe210fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c1579a0 con 0x7fe20c1588d0 2023-08-31T18:48:55.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe20a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c0cb9b0 0x7fe20c0a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe20a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c0cb9b0 0x7fe20c0a8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37314/0 (socket says 172.21.15.72:37314) 2023-08-31T18:48:55.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe20a59c700 1 -- 172.21.15.72:0/2420547968 learned_addr learned my addr 172.21.15.72:0/2420547968 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:55.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe20ad9d700 1 --2- 172.21.15.72:0/2420547968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe20c1588d0 0x7fe20c14ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe20a59c700 1 -- 172.21.15.72:0/2420547968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe20c1588d0 msgr2=0x7fe20c14ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe20a59c700 1 --2- 172.21.15.72:0/2420547968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe20c1588d0 0x7fe20c14ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:55.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe20a59c700 1 -- 172.21.15.72:0/2420547968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe20c154060 msgr2=0x7fe20c156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:55.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe20a59c700 1 --2- 172.21.15.72:0/2420547968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe20c154060 0x7fe20c156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:55.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe20a59c700 1 -- 172.21.15.72:0/2420547968 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe204009ae0 con 0x7fe20c0cb9b0 2023-08-31T18:48:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.947+0000 7fe20a59c700 1 --2- 172.21.15.72:0/2420547968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c0cb9b0 0x7fe20c0a8880 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fe1fc00e8d0 tx=0x7fe1fc006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.948+0000 7fe1fa7fc700 1 -- 172.21.15.72:0/2420547968 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc00c640 con 0x7fe20c0cb9b0 2023-08-31T18:48:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.948+0000 7fe1fa7fc700 1 -- 172.21.15.72:0/2420547968 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1fc00c7a0 con 0x7fe20c0cb9b0 2023-08-31T18:48:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.948+0000 7fe210fff700 1 -- 172.21.15.72:0/2420547968 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20c157c80 con 0x7fe20c0cb9b0 2023-08-31T18:48:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.948+0000 7fe1fa7fc700 1 -- 172.21.15.72:0/2420547968 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc00cb20 con 0x7fe20c0cb9b0 2023-08-31T18:48:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.948+0000 7fe210fff700 1 -- 172.21.15.72:0/2420547968 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20c1573a0 con 0x7fe20c0cb9b0 2023-08-31T18:48:55.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.949+0000 7fe210fff700 1 -- 172.21.15.72:0/2420547968 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20c0c2f50 con 0x7fe20c0cb9b0 2023-08-31T18:48:55.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.949+0000 7fe1fa7fc700 1 -- 172.21.15.72:0/2420547968 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fe1fc01b400 con 0x7fe20c0cb9b0 2023-08-31T18:48:55.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.950+0000 7fe1fa7fc700 1 --2- 172.21.15.72:0/2420547968 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe1ec05ee10 0x7fe1ec0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:55.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.950+0000 7fe1fa7fc700 1 -- 172.21.15.72:0/2420547968 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe1fc07a450 con 0x7fe20c0cb9b0 2023-08-31T18:48:55.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.950+0000 7fe209d9b700 1 --2- 172.21.15.72:0/2420547968 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe1ec05ee10 0x7fe1ec0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:55.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.951+0000 7fe209d9b700 1 --2- 172.21.15.72:0/2420547968 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe1ec05ee10 0x7fe1ec0612d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fe20c1588a0 tx=0x7fe2000079c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:55.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:55.954+0000 7fe1fa7fc700 1 -- 172.21.15.72:0/2420547968 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1fc04b7a0 con 0x7fe20c0cb9b0 2023-08-31T18:48:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.118+0000 7fe210fff700 1 -- 172.21.15.72:0/2420547968 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe20c06c6b0 con 0x7fe1ec05ee10 2023-08-31T18:48:56.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.128+0000 7fe1fa7fc700 1 -- 172.21.15.72:0/2420547968 <== mgr.4101 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+348962 (secure 0 0 0) 0x7fe20c06c6b0 con 0x7fe1ec05ee10 2023-08-31T18:48:56.133 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:56.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.133+0000 7fe210fff700 1 -- 172.21.15.72:0/2420547968 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe1ec05ee10 msgr2=0x7fe1ec0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:56.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.133+0000 7fe210fff700 1 --2- 172.21.15.72:0/2420547968 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe1ec05ee10 0x7fe1ec0612d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fe20c1588a0 tx=0x7fe2000079c0).stop 2023-08-31T18:48:56.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.133+0000 7fe210fff700 1 -- 172.21.15.72:0/2420547968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c0cb9b0 msgr2=0x7fe20c0a8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:56.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.133+0000 7fe210fff700 1 --2- 172.21.15.72:0/2420547968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c0cb9b0 0x7fe20c0a8880 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fe1fc00e8d0 tx=0x7fe1fc006f40).stop 2023-08-31T18:48:56.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.133+0000 7fe210fff700 1 -- 172.21.15.72:0/2420547968 shutdown_connections 2023-08-31T18:48:56.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.133+0000 7fe210fff700 1 --2- 172.21.15.72:0/2420547968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe20c1588d0 0x7fe20c14ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:56.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.133+0000 7fe210fff700 1 --2- 172.21.15.72:0/2420547968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c0cb9b0 0x7fe20c0a8880 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:56.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.133+0000 7fe210fff700 1 --2- 172.21.15.72:0/2420547968 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe1ec05ee10 0x7fe1ec0612d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:56.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.133+0000 7fe210fff700 1 --2- 172.21.15.72:0/2420547968 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe20c154060 0x7fe20c156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:56.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.133+0000 7fe210fff700 1 -- 172.21.15.72:0/2420547968 >> 172.21.15.72:0/2420547968 conn(0x7fe20c05e870 msgr2=0x7fe20c0bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:56.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.133+0000 7fe210fff700 1 -- 172.21.15.72:0/2420547968 shutdown_connections 2023-08-31T18:48:56.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.133+0000 7fe210fff700 1 -- 172.21.15.72:0/2420547968 wait complete. 2023-08-31T18:48:56.138 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T18:48:56.151 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-08-31T18:48:55.170619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2379392,"kb_used_data":2624,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595328,"statfs":{"total":773094113280,"available":770657615872,"internally_reserved":0,"allocated":2686976,"data_stored":1070848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4297,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.229268"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:43.691263+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T18:48:43.691263+0000","last_peered":"2023-08-31T18:48:43.691263+0000","last_clean":"2023-08-31T18:48:43.691263+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T18:48:43.691263+0000","last_undegraded":"2023-08-31T18:48:43.691263+0000","last_fullsized":"2023-08-31T18:48:43.691263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.131225+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T18:48:44.131225+0000","last_peered":"2023-08-31T18:48:44.131225+0000","last_clean":"2023-08-31T18:48:44.131225+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T18:48:44.131225+0000","last_undegraded":"2023-08-31T18:48:44.131225+0000","last_fullsized":"2023-08-31T18:48:44.131225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.130586+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T18:48:44.130586+0000","last_peered":"2023-08-31T18:48:44.130586+0000","last_clean":"2023-08-31T18:48:44.130586+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T18:48:44.130586+0000","last_undegraded":"2023-08-31T18:48:44.130586+0000","last_fullsized":"2023-08-31T18:48:44.130586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.131245+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T18:48:44.131245+0000","last_peered":"2023-08-31T18:48:44.131245+0000","last_clean":"2023-08-31T18:48:44.131245+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T18:48:44.131245+0000","last_undegraded":"2023-08-31T18:48:44.131245+0000","last_fullsized":"2023-08-31T18:48:44.131245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.131167+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T18:48:44.131167+0000","last_peered":"2023-08-31T18:48:44.131167+0000","last_clean":"2023-08-31T18:48:44.131167+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T18:48:44.131167+0000","last_undegraded":"2023-08-31T18:48:44.131167+0000","last_fullsized":"2023-08-31T18:48:44.131167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.131170+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T18:48:44.131170+0000","last_peered":"2023-08-31T18:48:44.131170+0000","last_clean":"2023-08-31T18:48:44.131170+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T18:48:44.131170+0000","last_undegraded":"2023-08-31T18:48:44.131170+0000","last_fullsized":"2023-08-31T18:48:44.131170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.131167+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T18:48:44.131167+0000","last_peered":"2023-08-31T18:48:44.131167+0000","last_clean":"2023-08-31T18:48:44.131167+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T18:48:44.131167+0000","last_undegraded":"2023-08-31T18:48:44.131167+0000","last_fullsized":"2023-08-31T18:48:44.131167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:43.691223+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T18:48:43.691223+0000","last_peered":"2023-08-31T18:48:43.691223+0000","last_clean":"2023-08-31T18:48:43.691223+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T18:48:43.691223+0000","last_undegraded":"2023-08-31T18:48:43.691223+0000","last_fullsized":"2023-08-31T18:48:43.691223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:43.690414+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T18:48:43.690414+0000","last_peered":"2023-08-31T18:48:43.690414+0000","last_clean":"2023-08-31T18:48:43.690414+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T18:48:43.690414+0000","last_undegraded":"2023-08-31T18:48:43.690414+0000","last_fullsized":"2023-08-31T18:48:43.690414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.83299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.621}]},{"osd":1,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.502},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.751},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.498},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.746}]},{"osd":6,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.68000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.311},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.379},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.439}]},{"osd":4,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":1.028}]},{"osd":5,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.95899999999999996}]},{"osd":7,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":1.0029999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.432},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.64600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.317},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.499}]},{"osd":4,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":9.6289999999999996,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.403,"5min":3.403,"15min":3.403},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":9.8399999999999999,"5min":9.8399999999999999,"15min":9.8399999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":9.7569999999999997,"5min":9.7569999999999997,"15min":9.7569999999999997},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":9.7840000000000007,"5min":9.7840000000000007,"15min":9.7840000000000007},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":9.7200000000000006,"5min":9.7200000000000006,"15min":9.7200000000000006},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":5.133,"5min":5.133,"15min":5.133},"last":0.751},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":12.589,"5min":12.589,"15min":12.589},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":9.6780000000000008,"5min":9.6780000000000008,"15min":9.6780000000000008},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.3610000000000002,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":9.4760000000000009,"5min":9.4760000000000009,"15min":9.4760000000000009},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":9.8640000000000008,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.86799999999999999}]},{"osd":7,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":7.1769999999999996,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":12.634,"5min":12.634,"15min":12.634},"last":0.97599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.77300000000000002}]},{"osd":1,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.82999999999999996}]},{"osd":2,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.623},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.749}]},{"osd":4,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1,"5min":1,"15min":1},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.877}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T18:48:56.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T18:48:56.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.378+0000 7f08a6dff700 1 Processor -- start 2023-08-31T18:48:56.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.379+0000 7f08a6dff700 1 -- start start 2023-08-31T18:48:56.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.380+0000 7f08a6dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f08a0154060 0x7f08a0157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:56.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.380+0000 7f08a6dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f08a00cb9b0 0x7f08a01581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:56.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.380+0000 7f08a6dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a00c6120 con 0x7f08a01586b0 2023-08-31T18:48:56.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.380+0000 7f08a6dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a00c1380 con 0x7f08a00cb9b0 2023-08-31T18:48:56.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.380+0000 7f08a6dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a00c5e10 con 0x7f08a0154060 2023-08-31T18:48:56.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.380+0000 7f089ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f08a00cb9b0 0x7f08a01581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:56.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.380+0000 7f08a539c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f08a01586b0 0x7f08a00c65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42210/0 (socket says 172.21.15.72:42210) 2023-08-31T18:48:56.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.380+0000 7f08a539c700 1 -- 172.21.15.72:0/1150036679 learned_addr learned my addr 172.21.15.72:0/1150036679 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:56.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.380+0000 7f08a4b9b700 1 --2- 172.21.15.72:0/1150036679 >> v2:172.21.15.146:3300/0 conn(0x7f08a0154060 0x7f08a0157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:56.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.380+0000 7f089ffff700 1 -- 172.21.15.72:0/1150036679 >> v2:172.21.15.146:3300/0 conn(0x7f08a0154060 msgr2=0x7f08a0157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:56.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.380+0000 7f089ffff700 1 --2- 172.21.15.72:0/1150036679 >> v2:172.21.15.146:3300/0 conn(0x7f08a0154060 0x7f08a0157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:56.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.381+0000 7f089ffff700 1 -- 172.21.15.72:0/1150036679 >> v1:172.21.15.72:6789/0 conn(0x7f08a01586b0 legacy=0x7f08a00c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:56.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.381+0000 7f089ffff700 1 -- 172.21.15.72:0/1150036679 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a0158b00 con 0x7f08a00cb9b0 2023-08-31T18:48:56.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.380+0000 7f089f7fe700 1 -- 172.21.15.72:0/1150036679 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150608832 0 0) 0x7f08a00c6120 con 0x7f08a01586b0 2023-08-31T18:48:56.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.381+0000 7f089ffff700 1 --2- 172.21.15.72:0/1150036679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a00cb9b0 0x7f08a01581c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f08a01557e0 tx=0x7f088c009060).ready entity=mon.0 client_cookie=6bafc52c12b6396c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:56.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.381+0000 7f089f7fe700 1 -- 172.21.15.72:0/1150036679 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c00b580 con 0x7f08a00cb9b0 2023-08-31T18:48:56.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.381+0000 7f089f7fe700 1 -- 172.21.15.72:0/1150036679 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c00b6e0 con 0x7f08a00cb9b0 2023-08-31T18:48:56.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.381+0000 7f089f7fe700 1 -- 172.21.15.72:0/1150036679 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c00ba60 con 0x7f08a00cb9b0 2023-08-31T18:48:56.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.381+0000 7f08a6dff700 1 -- 172.21.15.72:0/1150036679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a00cb9b0 msgr2=0x7f08a01581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:56.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.381+0000 7f08a6dff700 1 --2- 172.21.15.72:0/1150036679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a00cb9b0 0x7f08a01581c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f08a01557e0 tx=0x7f088c009060).stop 2023-08-31T18:48:56.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.382+0000 7f08a6dff700 1 -- 172.21.15.72:0/1150036679 shutdown_connections 2023-08-31T18:48:56.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.382+0000 7f08a6dff700 1 --2- 172.21.15.72:0/1150036679 >> v2:172.21.15.146:3300/0 conn(0x7f08a0154060 0x7f08a0157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:56.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.382+0000 7f08a6dff700 1 --2- 172.21.15.72:0/1150036679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a00cb9b0 0x7f08a01581c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:56.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.382+0000 7f08a6dff700 1 -- 172.21.15.72:0/1150036679 >> 172.21.15.72:0/1150036679 conn(0x7f08a005e870 msgr2=0x7f08a00cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:56.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.382+0000 7f08a6dff700 1 -- 172.21.15.72:0/1150036679 shutdown_connections 2023-08-31T18:48:56.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.382+0000 7f08a6dff700 1 -- 172.21.15.72:0/1150036679 wait complete. 2023-08-31T18:48:56.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.383+0000 7f08a6dff700 1 Processor -- start 2023-08-31T18:48:56.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.383+0000 7f08a6dff700 1 -- start start 2023-08-31T18:48:56.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.384+0000 7f08a6dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08a00cb9b0 0x7f08a00c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:56.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.384+0000 7f08a6dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a0154060 0x7f08a00ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:56.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.384+0000 7f08a6dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a01586b0 0x7f08a0167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:56.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.384+0000 7f08a6dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a00c9680 con 0x7f08a0154060 2023-08-31T18:48:56.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.384+0000 7f08a6dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a00c8a70 con 0x7f08a01586b0 2023-08-31T18:48:56.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.384+0000 7f08a6dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a00c8d50 con 0x7f08a00cb9b0 2023-08-31T18:48:56.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.385+0000 7f089ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a0154060 0x7f08a00ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:56.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.385+0000 7f089ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a0154060 0x7f08a00ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37342/0 (socket says 172.21.15.72:37342) 2023-08-31T18:48:56.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.385+0000 7f089ffff700 1 -- 172.21.15.72:0/1227186204 learned_addr learned my addr 172.21.15.72:0/1227186204 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:56.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.385+0000 7f08a4b9b700 1 --2- 172.21.15.72:0/1227186204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08a00cb9b0 0x7f08a00c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:56.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.385+0000 7f08a539c700 1 --2- 172.21.15.72:0/1227186204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a01586b0 0x7f08a0167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:56.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.385+0000 7f089ffff700 1 -- 172.21.15.72:0/1227186204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08a00cb9b0 msgr2=0x7f08a00c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:56.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.385+0000 7f089ffff700 1 --2- 172.21.15.72:0/1227186204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08a00cb9b0 0x7f08a00c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:56.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.385+0000 7f089ffff700 1 -- 172.21.15.72:0/1227186204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a01586b0 msgr2=0x7f08a0167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:56.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.385+0000 7f089ffff700 1 --2- 172.21.15.72:0/1227186204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a01586b0 0x7f08a0167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:56.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.385+0000 7f089ffff700 1 -- 172.21.15.72:0/1227186204 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c0092a0 con 0x7f08a0154060 2023-08-31T18:48:56.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.385+0000 7f089ffff700 1 --2- 172.21.15.72:0/1227186204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a0154060 0x7f08a00ace50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f088c009e80 tx=0x7f088c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:56.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.385+0000 7f089cff9700 1 -- 172.21.15.72:0/1227186204 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c000bc0 con 0x7f08a0154060 2023-08-31T18:48:56.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.386+0000 7f089cff9700 1 -- 172.21.15.72:0/1227186204 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c00b850 con 0x7f08a0154060 2023-08-31T18:48:56.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.386+0000 7f08a6dff700 1 -- 172.21.15.72:0/1227186204 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a00c9030 con 0x7f08a0154060 2023-08-31T18:48:56.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.386+0000 7f089cff9700 1 -- 172.21.15.72:0/1227186204 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c000d20 con 0x7f08a0154060 2023-08-31T18:48:56.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.386+0000 7f08a6dff700 1 -- 172.21.15.72:0/1227186204 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a00ca000 con 0x7f08a0154060 2023-08-31T18:48:56.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.387+0000 7f08a6dff700 1 -- 172.21.15.72:0/1227186204 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a00ca220 con 0x7f08a0154060 2023-08-31T18:48:56.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.387+0000 7f089cff9700 1 -- 172.21.15.72:0/1227186204 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f088c01bac0 con 0x7f08a0154060 2023-08-31T18:48:56.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.388+0000 7f089cff9700 1 --2- 172.21.15.72:0/1227186204 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f088405ee10 0x7f08840612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:56.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.388+0000 7f089cff9700 1 -- 172.21.15.72:0/1227186204 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f088c07ba00 con 0x7f08a0154060 2023-08-31T18:48:56.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.389+0000 7f08a4b9b700 1 --2- 172.21.15.72:0/1227186204 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f088405ee10 0x7f08840612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:56.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.389+0000 7f08a4b9b700 1 --2- 172.21.15.72:0/1227186204 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f088405ee10 0x7f08840612d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f0894006fd0 tx=0x7f0894008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:56.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.392+0000 7f089cff9700 1 -- 172.21.15.72:0/1227186204 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f088c04cdb0 con 0x7f08a0154060 2023-08-31T18:48:56.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.558+0000 7f08a6dff700 1 -- 172.21.15.72:0/1227186204 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08a006c6b0 con 0x7f088405ee10 2023-08-31T18:48:56.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.568+0000 7f089cff9700 1 -- 172.21.15.72:0/1227186204 <== mgr.4101 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+348962 (secure 0 0 0) 0x7f08a006c6b0 con 0x7f088405ee10 2023-08-31T18:48:56.572 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:56.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.572+0000 7f08a6dff700 1 -- 172.21.15.72:0/1227186204 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f088405ee10 msgr2=0x7f08840612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:56.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.572+0000 7f08a6dff700 1 --2- 172.21.15.72:0/1227186204 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f088405ee10 0x7f08840612d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f0894006fd0 tx=0x7f0894008040).stop 2023-08-31T18:48:56.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.572+0000 7f08a6dff700 1 -- 172.21.15.72:0/1227186204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a0154060 msgr2=0x7f08a00ace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:56.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.572+0000 7f08a6dff700 1 --2- 172.21.15.72:0/1227186204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a0154060 0x7f08a00ace50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f088c009e80 tx=0x7f088c017000).stop 2023-08-31T18:48:56.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.572+0000 7f08a6dff700 1 -- 172.21.15.72:0/1227186204 shutdown_connections 2023-08-31T18:48:56.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.572+0000 7f08a6dff700 1 --2- 172.21.15.72:0/1227186204 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f088405ee10 0x7f08840612d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:56.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.572+0000 7f08a6dff700 1 --2- 172.21.15.72:0/1227186204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08a01586b0 0x7f08a0167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:56.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.572+0000 7f08a6dff700 1 --2- 172.21.15.72:0/1227186204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08a00cb9b0 0x7f08a00c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:56.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.572+0000 7f08a6dff700 1 --2- 172.21.15.72:0/1227186204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08a0154060 0x7f08a00ace50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:56.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.572+0000 7f08a6dff700 1 -- 172.21.15.72:0/1227186204 >> 172.21.15.72:0/1227186204 conn(0x7f08a005e870 msgr2=0x7f08a0063e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:56.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.572+0000 7f08a6dff700 1 -- 172.21.15.72:0/1227186204 shutdown_connections 2023-08-31T18:48:56.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.572+0000 7f08a6dff700 1 -- 172.21.15.72:0/1227186204 wait complete. 2023-08-31T18:48:56.579 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T18:48:56.590 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-08-31T18:48:55.170619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2379392,"kb_used_data":2624,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595328,"statfs":{"total":773094113280,"available":770657615872,"internally_reserved":0,"allocated":2686976,"data_stored":1070848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4297,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.229268"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:43.691263+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T18:48:43.691263+0000","last_peered":"2023-08-31T18:48:43.691263+0000","last_clean":"2023-08-31T18:48:43.691263+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T18:48:43.691263+0000","last_undegraded":"2023-08-31T18:48:43.691263+0000","last_fullsized":"2023-08-31T18:48:43.691263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.131225+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T18:48:44.131225+0000","last_peered":"2023-08-31T18:48:44.131225+0000","last_clean":"2023-08-31T18:48:44.131225+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T18:48:44.131225+0000","last_undegraded":"2023-08-31T18:48:44.131225+0000","last_fullsized":"2023-08-31T18:48:44.131225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.130586+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T18:48:44.130586+0000","last_peered":"2023-08-31T18:48:44.130586+0000","last_clean":"2023-08-31T18:48:44.130586+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T18:48:44.130586+0000","last_undegraded":"2023-08-31T18:48:44.130586+0000","last_fullsized":"2023-08-31T18:48:44.130586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.131245+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T18:48:44.131245+0000","last_peered":"2023-08-31T18:48:44.131245+0000","last_clean":"2023-08-31T18:48:44.131245+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T18:48:44.131245+0000","last_undegraded":"2023-08-31T18:48:44.131245+0000","last_fullsized":"2023-08-31T18:48:44.131245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.131167+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T18:48:44.131167+0000","last_peered":"2023-08-31T18:48:44.131167+0000","last_clean":"2023-08-31T18:48:44.131167+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T18:48:44.131167+0000","last_undegraded":"2023-08-31T18:48:44.131167+0000","last_fullsized":"2023-08-31T18:48:44.131167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.131170+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T18:48:44.131170+0000","last_peered":"2023-08-31T18:48:44.131170+0000","last_clean":"2023-08-31T18:48:44.131170+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T18:48:44.131170+0000","last_undegraded":"2023-08-31T18:48:44.131170+0000","last_fullsized":"2023-08-31T18:48:44.131170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.131167+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T18:48:44.131167+0000","last_peered":"2023-08-31T18:48:44.131167+0000","last_clean":"2023-08-31T18:48:44.131167+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T18:48:44.131167+0000","last_undegraded":"2023-08-31T18:48:44.131167+0000","last_fullsized":"2023-08-31T18:48:44.131167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:43.691223+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T18:48:43.691223+0000","last_peered":"2023-08-31T18:48:43.691223+0000","last_clean":"2023-08-31T18:48:43.691223+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T18:48:43.691223+0000","last_undegraded":"2023-08-31T18:48:43.691223+0000","last_fullsized":"2023-08-31T18:48:43.691223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:43.690414+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T18:48:43.690414+0000","last_peered":"2023-08-31T18:48:43.690414+0000","last_clean":"2023-08-31T18:48:43.690414+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T18:48:43.690414+0000","last_undegraded":"2023-08-31T18:48:43.690414+0000","last_fullsized":"2023-08-31T18:48:43.690414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.83299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.621}]},{"osd":1,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.502},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.751},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.498},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.746}]},{"osd":6,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.68000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.311},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.379},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.439}]},{"osd":4,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":1.028}]},{"osd":5,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.95899999999999996}]},{"osd":7,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":1.0029999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.432},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.64600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.317},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.499}]},{"osd":4,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":9.6289999999999996,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.403,"5min":3.403,"15min":3.403},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":9.8399999999999999,"5min":9.8399999999999999,"15min":9.8399999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":9.7569999999999997,"5min":9.7569999999999997,"15min":9.7569999999999997},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":9.7840000000000007,"5min":9.7840000000000007,"15min":9.7840000000000007},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":9.7200000000000006,"5min":9.7200000000000006,"15min":9.7200000000000006},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":5.133,"5min":5.133,"15min":5.133},"last":0.751},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":12.589,"5min":12.589,"15min":12.589},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":9.6780000000000008,"5min":9.6780000000000008,"15min":9.6780000000000008},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.3610000000000002,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":9.4760000000000009,"5min":9.4760000000000009,"15min":9.4760000000000009},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":9.8640000000000008,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.86799999999999999}]},{"osd":7,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":7.1769999999999996,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":12.634,"5min":12.634,"15min":12.634},"last":0.97599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.77300000000000002}]},{"osd":1,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.82999999999999996}]},{"osd":2,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.623},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.749}]},{"osd":4,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1,"5min":1,"15min":1},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.877}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T18:48:56.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T18:48:56.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.817+0000 7fc83d1ff700 1 Processor -- start 2023-08-31T18:48:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.817+0000 7fc83d1ff700 1 -- start start 2023-08-31T18:48:56.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.818+0000 7fc83d1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8380c46c0 0x7fc83815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:56.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.818+0000 7fc83d1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8380bef10 con 0x7fc8380bea80 2023-08-31T18:48:56.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.818+0000 7fc83d1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8380bf1f0 con 0x7fc8380c5fb0 2023-08-31T18:48:56.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.818+0000 7fc83d1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc838154690 con 0x7fc8380c46c0 2023-08-31T18:48:56.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc83659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc8380bea80 0x7fc8380c3fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42222/0 (socket says 172.21.15.72:42222) 2023-08-31T18:48:56.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc83659c700 1 -- 172.21.15.72:0/3780160966 learned_addr learned my addr 172.21.15.72:0/3780160966 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:56.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc83759e700 1 --2- 172.21.15.72:0/3780160966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8380c46c0 0x7fc83815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431701465 0 0) 0x7fc8380bef10 con 0x7fc8380bea80 2023-08-31T18:48:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8200033f0 con 0x7fc8380bea80 2023-08-31T18:48:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830482022 0 0) 0x7fc8380bf1f0 con 0x7fc8380c5fb0 2023-08-31T18:48:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8380bef10 con 0x7fc8380c5fb0 2023-08-31T18:48:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1726938600 0 0) 0x7fc8200033f0 con 0x7fc8380bea80 2023-08-31T18:48:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8380c46c0 msgr2=0x7fc83815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc835d9b700 1 --2- 172.21.15.72:0/3780160966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8380c46c0 0x7fc83815f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 >> v1:172.21.15.146:6789/0 conn(0x7fc8380c5fb0 legacy=0x7fc8380be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8380bf4d0 con 0x7fc8380bea80 2023-08-31T18:48:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fc82c001470 con 0x7fc8380bea80 2023-08-31T18:48:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 >> v1:172.21.15.72:6789/0 conn(0x7fc8380bea80 legacy=0x7fc8380c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc835d9b700 1 --2- 172.21.15.72:0/3780160966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc820003aa0 0x7fc820003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc835d9b700 1 --2- 172.21.15.72:0/3780160966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8380c46c0 0x7fc820004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.819+0000 7fc835d9b700 1 --2- 172.21.15.72:0/3780160966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc820004b80 0x7fc820005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.820+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc838154690 con 0x7fc820004b80 2023-08-31T18:48:56.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.820+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82000b910 con 0x7fc820003aa0 2023-08-31T18:48:56.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.820+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82000bad0 con 0x7fc8380c46c0 2023-08-31T18:48:56.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.820+0000 7fc83759e700 1 --2- 172.21.15.72:0/3780160966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc820004b80 0x7fc820005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:56.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.820+0000 7fc836d9d700 1 --2- 172.21.15.72:0/3780160966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc820003aa0 0x7fc820003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:56.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.820+0000 7fc83659c700 1 --2- 172.21.15.72:0/3780160966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8380c46c0 0x7fc820004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:56.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.820+0000 7fc83759e700 1 -- 172.21.15.72:0/3780160966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8380c46c0 msgr2=0x7fc820004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:56.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.820+0000 7fc83759e700 1 --2- 172.21.15.72:0/3780160966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8380c46c0 0x7fc820004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:56.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.820+0000 7fc83759e700 1 -- 172.21.15.72:0/3780160966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc820003aa0 msgr2=0x7fc820003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:56.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.820+0000 7fc83759e700 1 --2- 172.21.15.72:0/3780160966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc820003aa0 0x7fc820003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:56.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.820+0000 7fc83759e700 1 -- 172.21.15.72:0/3780160966 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8200033f0 con 0x7fc820004b80 2023-08-31T18:48:56.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.820+0000 7fc83759e700 1 --2- 172.21.15.72:0/3780160966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc820004b80 0x7fc820005000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fc83806a350 tx=0x7fc83000b040).ready entity=mon.0 client_cookie=a8429287b43c6b73 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:56.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.820+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830009ac0 con 0x7fc820004b80 2023-08-31T18:48:56.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.820+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83000f040 con 0x7fc820004b80 2023-08-31T18:48:56.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.820+0000 7fc835d9b700 1 -- 172.21.15.72:0/3780160966 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000ec70 con 0x7fc820004b80 2023-08-31T18:48:56.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.821+0000 7fc83d1ff700 1 -- 172.21.15.72:0/3780160966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc820004b80 msgr2=0x7fc820005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:56.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.821+0000 7fc83d1ff700 1 --2- 172.21.15.72:0/3780160966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc820004b80 0x7fc820005000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fc83806a350 tx=0x7fc83000b040).stop 2023-08-31T18:48:56.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.821+0000 7fc83759e700 1 -- 172.21.15.72:0/3780160966 reap_dead start 2023-08-31T18:48:56.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.821+0000 7fc83d1ff700 1 -- 172.21.15.72:0/3780160966 shutdown_connections 2023-08-31T18:48:56.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.821+0000 7fc83d1ff700 1 -- 172.21.15.72:0/3780160966 >> 172.21.15.72:0/3780160966 conn(0x7fc838082f60 msgr2=0x7fc83805e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:56.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.821+0000 7fc83d1ff700 1 -- 172.21.15.72:0/3780160966 shutdown_connections 2023-08-31T18:48:56.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.821+0000 7fc83d1ff700 1 -- 172.21.15.72:0/3780160966 wait complete. 2023-08-31T18:48:56.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.823+0000 7fc83d1ff700 1 Processor -- start 2023-08-31T18:48:56.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.823+0000 7fc83d1ff700 1 -- start start 2023-08-31T18:48:56.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.824+0000 7fc83d1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc838152b70 0x7fc8380c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:56.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.824+0000 7fc83d1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8380c11d0 0x7fc838152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:56.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.824+0000 7fc83d1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8380c7c60 0x7fc8380c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:56.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.824+0000 7fc83d1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380c2b90 con 0x7fc8380c11d0 2023-08-31T18:48:56.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.824+0000 7fc83d1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380ace30 con 0x7fc8380c7c60 2023-08-31T18:48:56.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.824+0000 7fc83d1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380c85d0 con 0x7fc838152b70 2023-08-31T18:48:56.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.824+0000 7fc83659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8380c11d0 0x7fc838152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:56.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.824+0000 7fc83659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8380c11d0 0x7fc838152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37360/0 (socket says 172.21.15.72:37360) 2023-08-31T18:48:56.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.824+0000 7fc83659c700 1 -- 172.21.15.72:0/707463179 learned_addr learned my addr 172.21.15.72:0/707463179 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:56.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.824+0000 7fc83659c700 1 -- 172.21.15.72:0/707463179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc838152b70 msgr2=0x7fc8380c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:56.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.824+0000 7fc83659c700 1 --2- 172.21.15.72:0/707463179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc838152b70 0x7fc8380c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:56.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.824+0000 7fc83659c700 1 -- 172.21.15.72:0/707463179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8380c7c60 msgr2=0x7fc8380c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:56.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.824+0000 7fc83659c700 1 --2- 172.21.15.72:0/707463179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8380c7c60 0x7fc8380c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:56.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.824+0000 7fc83659c700 1 -- 172.21.15.72:0/707463179 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8380ad2c0 con 0x7fc8380c11d0 2023-08-31T18:48:56.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.824+0000 7fc83659c700 1 --2- 172.21.15.72:0/707463179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8380c11d0 0x7fc838152f50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fc82c00e7e0 tx=0x7fc82c001040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:56.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.825+0000 7fc81effd700 1 -- 172.21.15.72:0/707463179 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00a500 con 0x7fc8380c11d0 2023-08-31T18:48:56.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.825+0000 7fc81effd700 1 -- 172.21.15.72:0/707463179 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c010040 con 0x7fc8380c11d0 2023-08-31T18:48:56.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.825+0000 7fc83d1ff700 1 -- 172.21.15.72:0/707463179 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8380c28b0 con 0x7fc8380c11d0 2023-08-31T18:48:56.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.825+0000 7fc81effd700 1 -- 172.21.15.72:0/707463179 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00a870 con 0x7fc8380c11d0 2023-08-31T18:48:56.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.825+0000 7fc83d1ff700 1 -- 172.21.15.72:0/707463179 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8380acac0 con 0x7fc8380c11d0 2023-08-31T18:48:56.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.826+0000 7fc83d1ff700 1 -- 172.21.15.72:0/707463179 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8380ac640 con 0x7fc8380c11d0 2023-08-31T18:48:56.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.827+0000 7fc81effd700 1 -- 172.21.15.72:0/707463179 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7fc82c00ac20 con 0x7fc8380c11d0 2023-08-31T18:48:56.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.828+0000 7fc81effd700 1 --2- 172.21.15.72:0/707463179 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc82405ee10 0x7fc8240612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:56.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.828+0000 7fc81effd700 1 -- 172.21.15.72:0/707463179 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc82c0796a0 con 0x7fc8380c11d0 2023-08-31T18:48:56.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.828+0000 7fc836d9d700 1 --2- 172.21.15.72:0/707463179 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc82405ee10 0x7fc8240612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:56.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.828+0000 7fc836d9d700 1 --2- 172.21.15.72:0/707463179 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc82405ee10 0x7fc8240612d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fc828000c00 tx=0x7fc828007c00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:56.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.832+0000 7fc81effd700 1 -- 172.21.15.72:0/707463179 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc8380ac640 con 0x7fc8380c11d0 2023-08-31T18:48:56.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:56.997+0000 7fc83d1ff700 1 -- 172.21.15.72:0/707463179 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8380acfa0 con 0x7fc82405ee10 2023-08-31T18:48:57.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.007+0000 7fc81effd700 1 -- 172.21.15.72:0/707463179 <== mgr.4101 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+348962 (secure 0 0 0) 0x7fc8380acfa0 con 0x7fc82405ee10 2023-08-31T18:48:57.011 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:57.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.011+0000 7fc83d1ff700 1 -- 172.21.15.72:0/707463179 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc82405ee10 msgr2=0x7fc8240612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:57.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.011+0000 7fc83d1ff700 1 --2- 172.21.15.72:0/707463179 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc82405ee10 0x7fc8240612d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fc828000c00 tx=0x7fc828007c00).stop 2023-08-31T18:48:57.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.011+0000 7fc83d1ff700 1 -- 172.21.15.72:0/707463179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8380c11d0 msgr2=0x7fc838152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:57.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.011+0000 7fc83d1ff700 1 --2- 172.21.15.72:0/707463179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8380c11d0 0x7fc838152f50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fc82c00e7e0 tx=0x7fc82c001040).stop 2023-08-31T18:48:57.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.011+0000 7fc83d1ff700 1 -- 172.21.15.72:0/707463179 shutdown_connections 2023-08-31T18:48:57.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.011+0000 7fc83d1ff700 1 --2- 172.21.15.72:0/707463179 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc82405ee10 0x7fc8240612d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.011+0000 7fc83d1ff700 1 --2- 172.21.15.72:0/707463179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8380c7c60 0x7fc8380c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:57.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.011+0000 7fc83d1ff700 1 --2- 172.21.15.72:0/707463179 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc838152b70 0x7fc8380c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:48:57.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.011+0000 7fc83d1ff700 1 --2- 172.21.15.72:0/707463179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8380c11d0 0x7fc838152f50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.011+0000 7fc83d1ff700 1 -- 172.21.15.72:0/707463179 >> 172.21.15.72:0/707463179 conn(0x7fc838082f60 msgr2=0x7fc838067b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:57.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.011+0000 7fc83d1ff700 1 -- 172.21.15.72:0/707463179 shutdown_connections 2023-08-31T18:48:57.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.011+0000 7fc83d1ff700 1 -- 172.21.15.72:0/707463179 wait complete. 2023-08-31T18:48:57.017 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T18:48:57.029 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-08-31T18:48:55.170619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2379392,"kb_used_data":2624,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595328,"statfs":{"total":773094113280,"available":770657615872,"internally_reserved":0,"allocated":2686976,"data_stored":1070848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4297,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.229268"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:43.691263+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T18:48:43.691263+0000","last_peered":"2023-08-31T18:48:43.691263+0000","last_clean":"2023-08-31T18:48:43.691263+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T18:48:43.691263+0000","last_undegraded":"2023-08-31T18:48:43.691263+0000","last_fullsized":"2023-08-31T18:48:43.691263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.131225+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T18:48:44.131225+0000","last_peered":"2023-08-31T18:48:44.131225+0000","last_clean":"2023-08-31T18:48:44.131225+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T18:48:44.131225+0000","last_undegraded":"2023-08-31T18:48:44.131225+0000","last_fullsized":"2023-08-31T18:48:44.131225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.130586+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T18:48:44.130586+0000","last_peered":"2023-08-31T18:48:44.130586+0000","last_clean":"2023-08-31T18:48:44.130586+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T18:48:44.130586+0000","last_undegraded":"2023-08-31T18:48:44.130586+0000","last_fullsized":"2023-08-31T18:48:44.130586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.131245+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T18:48:44.131245+0000","last_peered":"2023-08-31T18:48:44.131245+0000","last_clean":"2023-08-31T18:48:44.131245+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T18:48:44.131245+0000","last_undegraded":"2023-08-31T18:48:44.131245+0000","last_fullsized":"2023-08-31T18:48:44.131245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.131167+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T18:48:44.131167+0000","last_peered":"2023-08-31T18:48:44.131167+0000","last_clean":"2023-08-31T18:48:44.131167+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T18:48:44.131167+0000","last_undegraded":"2023-08-31T18:48:44.131167+0000","last_fullsized":"2023-08-31T18:48:44.131167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.131170+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T18:48:44.131170+0000","last_peered":"2023-08-31T18:48:44.131170+0000","last_clean":"2023-08-31T18:48:44.131170+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T18:48:44.131170+0000","last_undegraded":"2023-08-31T18:48:44.131170+0000","last_fullsized":"2023-08-31T18:48:44.131170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:44.131167+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T18:48:44.131167+0000","last_peered":"2023-08-31T18:48:44.131167+0000","last_clean":"2023-08-31T18:48:44.131167+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T18:48:44.131167+0000","last_undegraded":"2023-08-31T18:48:44.131167+0000","last_fullsized":"2023-08-31T18:48:44.131167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:43.691223+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T18:48:43.691223+0000","last_peered":"2023-08-31T18:48:43.691223+0000","last_clean":"2023-08-31T18:48:43.691223+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T18:48:43.691223+0000","last_undegraded":"2023-08-31T18:48:43.691223+0000","last_fullsized":"2023-08-31T18:48:43.691223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:51.428025+0000","last_change":"2023-08-31T18:48:51.428025+0000","last_active":"2023-08-31T18:48:51.428025+0000","last_peered":"2023-08-31T18:48:51.428025+0000","last_clean":"2023-08-31T18:48:51.428025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:51.428025+0000","last_undegraded":"2023-08-31T18:48:51.428025+0000","last_fullsized":"2023-08-31T18:48:51.428025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T18:48:50.420026+0000","last_change":"2023-08-31T18:48:50.420026+0000","last_active":"2023-08-31T18:48:50.420026+0000","last_peered":"2023-08-31T18:48:50.420026+0000","last_clean":"2023-08-31T18:48:50.420026+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T18:48:50.420026+0000","last_undegraded":"2023-08-31T18:48:50.420026+0000","last_fullsized":"2023-08-31T18:48:50.420026+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-31T18:48:43.690414+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T18:48:43.690414+0000","last_peered":"2023-08-31T18:48:43.690414+0000","last_clean":"2023-08-31T18:48:43.690414+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T18:48:43.690414+0000","last_undegraded":"2023-08-31T18:48:43.690414+0000","last_fullsized":"2023-08-31T18:48:43.690414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.83299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.621}]},{"osd":1,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.502},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.751},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.498},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.746}]},{"osd":6,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.68000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.311},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.379},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.439}]},{"osd":4,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":1.028}]},{"osd":5,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.95899999999999996}]},{"osd":7,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":1.0029999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.432},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.64600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.317},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.499}]},{"osd":4,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":9.6289999999999996,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.403,"5min":3.403,"15min":3.403},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":9.8399999999999999,"5min":9.8399999999999999,"15min":9.8399999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":9.7569999999999997,"5min":9.7569999999999997,"15min":9.7569999999999997},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":9.7840000000000007,"5min":9.7840000000000007,"15min":9.7840000000000007},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":9.7200000000000006,"5min":9.7200000000000006,"15min":9.7200000000000006},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":5.133,"5min":5.133,"15min":5.133},"last":0.751},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":12.589,"5min":12.589,"15min":12.589},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":9.6780000000000008,"5min":9.6780000000000008,"15min":9.6780000000000008},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.3610000000000002,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":9.4760000000000009,"5min":9.4760000000000009,"15min":9.4760000000000009},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":9.8640000000000008,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.86799999999999999}]},{"osd":7,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":7.1769999999999996,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":12.634,"5min":12.634,"15min":12.634},"last":0.97599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":133856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.77300000000000002}]},{"osd":1,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.82999999999999996}]},{"osd":2,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.623},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.749}]},{"osd":4,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1,"5min":1,"15min":1},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.877}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T18:48:57.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-08-31T18:48:57.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-08-31T18:48:57.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-08-31T18:48:57.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-08-31T18:48:57.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-08-31T18:48:57.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-08-31T18:48:57.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-08-31T18:48:57.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-08-31T18:48:57.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-08-31T18:48:57.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-08-31T18:48:57.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-08-31T18:48:57.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-08-31T18:48:57.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-08-31T18:48:57.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-08-31T18:48:57.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-08-31T18:48:57.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-08-31T18:48:57.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-08-31T18:48:57.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-08-31T18:48:57.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-08-31T18:48:57.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-08-31T18:48:57.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-08-31T18:48:57.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-08-31T18:48:57.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-08-31T18:48:57.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-08-31T18:48:57.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-08-31T18:48:57.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-08-31T18:48:57.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-08-31T18:48:57.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-08-31T18:48:57.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-08-31T18:48:57.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-08-31T18:48:57.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-08-31T18:48:57.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-08-31T18:48:57.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-08-31T18:48:57.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-08-31T18:48:57.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-08-31T18:48:57.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-08-31T18:48:57.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-08-31T18:48:57.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-08-31T18:48:57.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-08-31T18:48:57.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-08-31T18:48:57.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-08-31T18:48:57.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-08-31T18:48:57.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-08-31T18:48:57.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-08-31T18:48:57.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-08-31T18:48:57.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-08-31T18:48:57.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-08-31T18:48:57.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-08-31T18:48:57.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-08-31T18:48:57.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-08-31T18:48:57.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-08-31T18:48:57.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-08-31T18:48:57.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-08-31T18:48:57.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-08-31T18:48:57.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-08-31T18:48:57.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-08-31T18:48:57.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-08-31T18:48:57.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-08-31T18:48:57.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-08-31T18:48:57.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-08-31T18:48:57.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-08-31T18:48:57.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-08-31T18:48:57.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-08-31T18:48:57.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-08-31T18:48:57.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-08-31T18:48:57.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-08-31T18:48:57.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-08-31T18:48:57.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-08-31T18:48:57.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-08-31T18:48:57.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-08-31T18:48:57.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-08-31T18:48:57.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-08-31T18:48:57.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-08-31T18:48:57.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-08-31T18:48:57.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-08-31T18:48:57.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-08-31T18:48:57.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-08-31T18:48:57.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-08-31T18:48:57.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-08-31T18:48:57.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-08-31T18:48:57.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-08-31T18:48:57.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-08-31T18:48:57.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-08-31T18:48:57.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-08-31T18:48:57.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-08-31T18:48:57.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-08-31T18:48:57.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-08-31T18:48:57.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-08-31T18:48:57.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-08-31T18:48:57.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-08-31T18:48:57.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-08-31T18:48:57.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-08-31T18:48:57.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-08-31T18:48:57.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-08-31T18:48:57.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-08-31T18:48:57.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-08-31T18:48:57.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-08-31T18:48:57.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-08-31T18:48:57.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-08-31T18:48:57.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-08-31T18:48:57.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-08-31T18:48:57.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-08-31T18:48:57.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-08-31T18:48:57.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-08-31T18:48:57.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-08-31T18:48:57.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-08-31T18:48:57.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-08-31T18:48:57.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-08-31T18:48:57.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-08-31T18:48:57.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-08-31T18:48:57.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-08-31T18:48:57.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-08-31T18:48:57.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-08-31T18:48:57.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-08-31T18:48:57.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-08-31T18:48:57.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-08-31T18:48:57.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-08-31T18:48:57.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-08-31T18:48:57.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-08-31T18:48:57.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-08-31T18:48:57.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-08-31T18:48:57.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-08-31T18:48:57.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-08-31T18:48:57.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-08-31T18:48:57.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-08-31T18:48:57.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-08-31T18:48:57.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-08-31T18:48:57.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:51.428025+0000', 'last_change': '2023-08-31T18:48:51.428025+0000', 'last_active': '2023-08-31T18:48:51.428025+0000', 'last_peered': '2023-08-31T18:48:51.428025+0000', 'last_clean': '2023-08-31T18:48:51.428025+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:51.428025+0000', 'last_undegraded': '2023-08-31T18:48:51.428025+0000', 'last_fullsized': '2023-08-31T18:48:51.428025+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:51.428025+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-08-31T18:48:57.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T18:48:50.420026+0000', 'last_change': '2023-08-31T18:48:50.420026+0000', 'last_active': '2023-08-31T18:48:50.420026+0000', 'last_peered': '2023-08-31T18:48:50.420026+0000', 'last_clean': '2023-08-31T18:48:50.420026+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T18:48:50.420026+0000', 'last_undegraded': '2023-08-31T18:48:50.420026+0000', 'last_fullsized': '2023-08-31T18:48:50.420026+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'last_clean_scrub_stamp': '2023-08-31T18:48:50.420026+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T18:48:57.148 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-31T18:48:57.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.333+0000 7f8cbadff700 1 Processor -- start 2023-08-31T18:48:57.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.333+0000 7f8cbadff700 1 -- start start 2023-08-31T18:48:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.334+0000 7f8cbadff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cb4153e80 0x7f8cb40c0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.334+0000 7f8cbadff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8cb40c5d00 0x7f8cb40c6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.334+0000 7f8cbadff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb40c1610 con 0x7f8cb4154260 2023-08-31T18:48:57.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.334+0000 7f8cbadff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb40c6680 con 0x7f8cb40c5d00 2023-08-31T18:48:57.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.334+0000 7f8cbadff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40c0a00 con 0x7f8cb4153e80 2023-08-31T18:48:57.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.335+0000 7f8cb3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8cb4154260 0x7f8cb40aa080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42228/0 (socket says 172.21.15.72:42228) 2023-08-31T18:48:57.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.335+0000 7f8cb3fff700 1 -- 172.21.15.72:0/2302851735 learned_addr learned my addr 172.21.15.72:0/2302851735 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:57.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.335+0000 7f8cb8b9b700 1 --2- 172.21.15.72:0/2302851735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cb4153e80 0x7f8cb40c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:57.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.335+0000 7f8cb939c700 1 --2- 172.21.15.72:0/2302851735 >> v2:172.21.15.146:3300/0 conn(0x7f8cb40c5d00 0x7f8cb40c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:57.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.335+0000 7f8cb37fe700 1 -- 172.21.15.72:0/2302851735 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223707997 0 0) 0x7f8cb40c1610 con 0x7f8cb4154260 2023-08-31T18:48:57.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.335+0000 7f8cb37fe700 1 -- 172.21.15.72:0/2302851735 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ca40033f0 con 0x7f8cb4154260 2023-08-31T18:48:57.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.335+0000 7f8cb939c700 1 -- 172.21.15.72:0/2302851735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cb4153e80 msgr2=0x7f8cb40c0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:48:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.335+0000 7f8cb939c700 1 --2- 172.21.15.72:0/2302851735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cb4153e80 0x7f8cb40c0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.335+0000 7f8cb939c700 1 -- 172.21.15.72:0/2302851735 >> v1:172.21.15.72:6789/0 conn(0x7f8cb4154260 legacy=0x7f8cb40aa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.335+0000 7f8cb939c700 1 -- 172.21.15.72:0/2302851735 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb40c0ce0 con 0x7f8cb40c5d00 2023-08-31T18:48:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.335+0000 7f8cb8b9b700 1 --2- 172.21.15.72:0/2302851735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cb4153e80 0x7f8cb40c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:48:57.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.336+0000 7f8cb939c700 1 --2- 172.21.15.72:0/2302851735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb40c5d00 0x7f8cb40c6190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f8cac009e60 tx=0x7f8cac009780).ready entity=mon.1 client_cookie=1c91893abb4b3b03 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:57.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.336+0000 7f8cb37fe700 1 -- 172.21.15.72:0/2302851735 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac00e070 con 0x7f8cb40c5d00 2023-08-31T18:48:57.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.336+0000 7f8cb37fe700 1 -- 172.21.15.72:0/2302851735 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac00bab0 con 0x7f8cb40c5d00 2023-08-31T18:48:57.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.336+0000 7f8cb37fe700 1 -- 172.21.15.72:0/2302851735 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac00be30 con 0x7f8cb40c5d00 2023-08-31T18:48:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.336+0000 7f8cbadff700 1 -- 172.21.15.72:0/2302851735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb40c5d00 msgr2=0x7f8cb40c6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:57.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.336+0000 7f8cbadff700 1 --2- 172.21.15.72:0/2302851735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb40c5d00 0x7f8cb40c6190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f8cac009e60 tx=0x7f8cac009780).stop 2023-08-31T18:48:57.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.336+0000 7f8cbadff700 1 -- 172.21.15.72:0/2302851735 shutdown_connections 2023-08-31T18:48:57.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.336+0000 7f8cbadff700 1 --2- 172.21.15.72:0/2302851735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb40c5d00 0x7f8cb40c6190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.336+0000 7f8cbadff700 1 --2- 172.21.15.72:0/2302851735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cb4153e80 0x7f8cb40c0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.336+0000 7f8cbadff700 1 -- 172.21.15.72:0/2302851735 >> 172.21.15.72:0/2302851735 conn(0x7f8cb40c7860 msgr2=0x7f8cb40c7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:57.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.337+0000 7f8cbadff700 1 -- 172.21.15.72:0/2302851735 shutdown_connections 2023-08-31T18:48:57.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.337+0000 7f8cbadff700 1 -- 172.21.15.72:0/2302851735 wait complete. 2023-08-31T18:48:57.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.338+0000 7f8cbadff700 1 Processor -- start 2023-08-31T18:48:57.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.338+0000 7f8cbadff700 1 -- start start 2023-08-31T18:48:57.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.339+0000 7f8cbadff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb40c5d00 0x7f8cb40b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:57.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.339+0000 7f8cbadff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cb4153e80 0x7f8cb414eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:57.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.339+0000 7f8cbadff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb4154260 0x7f8cb414da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:57.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.339+0000 7f8cbadff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb414eff0 con 0x7f8cb40c5d00 2023-08-31T18:48:57.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.339+0000 7f8cbadff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb414f7a0 con 0x7f8cb4154260 2023-08-31T18:48:57.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.339+0000 7f8cbadff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb414df60 con 0x7f8cb4153e80 2023-08-31T18:48:57.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.339+0000 7f8cb8b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb40c5d00 0x7f8cb40b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:57.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.339+0000 7f8cb8b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb40c5d00 0x7f8cb40b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37372/0 (socket says 172.21.15.72:37372) 2023-08-31T18:48:57.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.339+0000 7f8cb8b9b700 1 -- 172.21.15.72:0/3513311289 learned_addr learned my addr 172.21.15.72:0/3513311289 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:57.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.340+0000 7f8cb939c700 1 --2- 172.21.15.72:0/3513311289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb4154260 0x7f8cb414da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:57.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.340+0000 7f8cb3fff700 1 --2- 172.21.15.72:0/3513311289 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cb4153e80 0x7f8cb414eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:57.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.340+0000 7f8cb8b9b700 1 -- 172.21.15.72:0/3513311289 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cb4153e80 msgr2=0x7f8cb414eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:57.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.340+0000 7f8cb8b9b700 1 --2- 172.21.15.72:0/3513311289 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cb4153e80 0x7f8cb414eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.340+0000 7f8cb8b9b700 1 -- 172.21.15.72:0/3513311289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb4154260 msgr2=0x7f8cb414da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:57.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.340+0000 7f8cb8b9b700 1 --2- 172.21.15.72:0/3513311289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb4154260 0x7f8cb414da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.340+0000 7f8cb8b9b700 1 -- 172.21.15.72:0/3513311289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca80092a0 con 0x7f8cb40c5d00 2023-08-31T18:48:57.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.340+0000 7f8cb939c700 1 --2- 172.21.15.72:0/3513311289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb4154260 0x7f8cb414da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:48:57.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.340+0000 7f8cb8b9b700 1 --2- 172.21.15.72:0/3513311289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb40c5d00 0x7f8cb40b0910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f8ca800ea20 tx=0x7f8ca8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:57.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.340+0000 7f8cb0ff9700 1 -- 172.21.15.72:0/3513311289 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca800c850 con 0x7f8cb40c5d00 2023-08-31T18:48:57.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.340+0000 7f8cb0ff9700 1 -- 172.21.15.72:0/3513311289 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca800c9b0 con 0x7f8cb40c5d00 2023-08-31T18:48:57.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.340+0000 7f8cbadff700 1 -- 172.21.15.72:0/3513311289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac009a20 con 0x7f8cb40c5d00 2023-08-31T18:48:57.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.340+0000 7f8cb0ff9700 1 -- 172.21.15.72:0/3513311289 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca800cd30 con 0x7f8cb40c5d00 2023-08-31T18:48:57.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.340+0000 7f8cbadff700 1 -- 172.21.15.72:0/3513311289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb414e300 con 0x7f8cb40c5d00 2023-08-31T18:48:57.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.341+0000 7f8cbadff700 1 -- 172.21.15.72:0/3513311289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb414e950 con 0x7f8cb40c5d00 2023-08-31T18:48:57.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.342+0000 7f8cb0ff9700 1 -- 172.21.15.72:0/3513311289 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8ca8012600 con 0x7f8cb40c5d00 2023-08-31T18:48:57.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.344+0000 7f8cb0ff9700 1 --2- 172.21.15.72:0/3513311289 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8c9805ee10 0x7f8c980612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:57.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.344+0000 7f8cb0ff9700 1 -- 172.21.15.72:0/3513311289 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8ca807a460 con 0x7f8cb40c5d00 2023-08-31T18:48:57.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.344+0000 7f8cb3fff700 1 --2- 172.21.15.72:0/3513311289 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8c9805ee10 0x7f8c980612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:57.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.344+0000 7f8cb3fff700 1 --2- 172.21.15.72:0/3513311289 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8c9805ee10 0x7f8c980612d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f8cb4157ae0 tx=0x7f8ca0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:57.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.348+0000 7f8cb0ff9700 1 -- 172.21.15.72:0/3513311289 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ca804b8d0 con 0x7f8cb40c5d00 2023-08-31T18:48:57.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.582+0000 7f8cbadff700 1 -- 172.21.15.72:0/3513311289 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8cb40c0fc0 con 0x7f8cb40c5d00 2023-08-31T18:48:57.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.583+0000 7f8cb0ff9700 1 -- 172.21.15.72:0/3513311289 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1569 (secure 0 0 0) 0x7f8ca804eef0 con 0x7f8cb40c5d00 2023-08-31T18:48:57.584 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:57.584 INFO:teuthology.orchestra.run.smithi072.stdout:{"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":84,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1693507664,"num_in_osds":8,"osd_in_since":1693507656,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":128},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2436497408,"bytes_avail":770657615872,"bytes_total":773094113280,"unknown_pgs_ratio":0.9343065619468689},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":4974}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-08-31T18:48:47.169169+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-31T18:48:57.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.585+0000 7f8cbadff700 1 -- 172.21.15.72:0/3513311289 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8c9805ee10 msgr2=0x7f8c980612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:57.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.585+0000 7f8cbadff700 1 --2- 172.21.15.72:0/3513311289 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8c9805ee10 0x7f8c980612d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f8cb4157ae0 tx=0x7f8ca0009040).stop 2023-08-31T18:48:57.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.585+0000 7f8cbadff700 1 -- 172.21.15.72:0/3513311289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb40c5d00 msgr2=0x7f8cb40b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:57.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.585+0000 7f8cbadff700 1 --2- 172.21.15.72:0/3513311289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb40c5d00 0x7f8cb40b0910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f8ca800ea20 tx=0x7f8ca8009060).stop 2023-08-31T18:48:57.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.585+0000 7f8cbadff700 1 -- 172.21.15.72:0/3513311289 shutdown_connections 2023-08-31T18:48:57.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.585+0000 7f8cbadff700 1 --2- 172.21.15.72:0/3513311289 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8c9805ee10 0x7f8c980612d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.585+0000 7f8cbadff700 1 --2- 172.21.15.72:0/3513311289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8cb4154260 0x7f8cb414da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.585+0000 7f8cbadff700 1 --2- 172.21.15.72:0/3513311289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8cb40c5d00 0x7f8cb40b0910 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.585+0000 7f8cbadff700 1 --2- 172.21.15.72:0/3513311289 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8cb4153e80 0x7f8cb414eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.585+0000 7f8cbadff700 1 -- 172.21.15.72:0/3513311289 >> 172.21.15.72:0/3513311289 conn(0x7f8cb40c7860 msgr2=0x7f8cb4063060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:57.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.585+0000 7f8cbadff700 1 -- 172.21.15.72:0/3513311289 shutdown_connections 2023-08-31T18:48:57.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.585+0000 7f8cbadff700 1 -- 172.21.15.72:0/3513311289 wait complete. 2023-08-31T18:48:57.603 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-31T18:48:57.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T18:48:57.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.792+0000 7f73267ff700 1 Processor -- start 2023-08-31T18:48:57.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.792+0000 7f73267ff700 1 -- start start 2023-08-31T18:48:57.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.794+0000 7f73267ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f73200cb9b0 0x7f73201583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:57.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.794+0000 7f73267ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73200c6120 con 0x7f73201588d0 2023-08-31T18:48:57.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.794+0000 7f73267ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73200c5e10 con 0x7f7320154060 2023-08-31T18:48:57.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.794+0000 7f73267ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73200c1380 con 0x7f73200cb9b0 2023-08-31T18:48:57.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.794+0000 7f7324d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f73201588d0 0x7f7320154440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42244/0 (socket says 172.21.15.72:42244) 2023-08-31T18:48:57.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.794+0000 7f7324d9c700 1 -- 172.21.15.72:0/2108127202 learned_addr learned my addr 172.21.15.72:0/2108127202 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:48:57.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.794+0000 7f731f7fe700 1 --2- 172.21.15.72:0/2108127202 >> v2:172.21.15.146:3300/0 conn(0x7f73200cb9b0 0x7f73201583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:57.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.794+0000 7f731effd700 1 -- 172.21.15.72:0/2108127202 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560536933 0 0) 0x7f73200c6120 con 0x7f73201588d0 2023-08-31T18:48:57.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.794+0000 7f731effd700 1 -- 172.21.15.72:0/2108127202 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73080033f0 con 0x7f73201588d0 2023-08-31T18:48:57.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.794+0000 7f731effd700 1 -- 172.21.15.72:0/2108127202 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797521042 0 0) 0x7f73200c5e10 con 0x7f7320154060 2023-08-31T18:48:57.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.795+0000 7f731effd700 1 -- 172.21.15.72:0/2108127202 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73200c6120 con 0x7f7320154060 2023-08-31T18:48:57.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.795+0000 7f731f7fe700 1 -- 172.21.15.72:0/2108127202 >> v1:172.21.15.146:6789/0 conn(0x7f7320154060 legacy=0x7f7320157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:57.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.795+0000 7f731f7fe700 1 -- 172.21.15.72:0/2108127202 >> v1:172.21.15.72:6789/0 conn(0x7f73201588d0 legacy=0x7f7320154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:57.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.795+0000 7f731f7fe700 1 -- 172.21.15.72:0/2108127202 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73200c0ae0 con 0x7f73200cb9b0 2023-08-31T18:48:57.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.795+0000 7f731f7fe700 1 --2- 172.21.15.72:0/2108127202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73200cb9b0 0x7f73201583e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f7314009760 tx=0x7f7314009060).ready entity=mon.1 client_cookie=e33089c3028a568b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:57.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.795+0000 7f731effd700 1 -- 172.21.15.72:0/2108127202 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731400d4a0 con 0x7f73200cb9b0 2023-08-31T18:48:57.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.795+0000 7f731effd700 1 -- 172.21.15.72:0/2108127202 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731400d600 con 0x7f73200cb9b0 2023-08-31T18:48:57.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.795+0000 7f731effd700 1 -- 172.21.15.72:0/2108127202 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731400d980 con 0x7f73200cb9b0 2023-08-31T18:48:57.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.795+0000 7f73267ff700 1 -- 172.21.15.72:0/2108127202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73200cb9b0 msgr2=0x7f73201583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:57.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.795+0000 7f73267ff700 1 --2- 172.21.15.72:0/2108127202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73200cb9b0 0x7f73201583e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f7314009760 tx=0x7f7314009060).stop 2023-08-31T18:48:57.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.796+0000 7f73267ff700 1 -- 172.21.15.72:0/2108127202 shutdown_connections 2023-08-31T18:48:57.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.796+0000 7f73267ff700 1 --2- 172.21.15.72:0/2108127202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73200cb9b0 0x7f73201583e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.796+0000 7f73267ff700 1 -- 172.21.15.72:0/2108127202 >> 172.21.15.72:0/2108127202 conn(0x7f732005e870 msgr2=0x7f73200cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:57.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.796+0000 7f73267ff700 1 -- 172.21.15.72:0/2108127202 shutdown_connections 2023-08-31T18:48:57.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.796+0000 7f73267ff700 1 -- 172.21.15.72:0/2108127202 wait complete. 2023-08-31T18:48:57.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.797+0000 7f73267ff700 1 Processor -- start 2023-08-31T18:48:57.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.797+0000 7f73267ff700 1 -- start start 2023-08-31T18:48:57.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.798+0000 7f73267ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73200cb9b0 0x7f7320167520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:57.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.798+0000 7f73267ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7320154060 0x7f7320167e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:57.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.798+0000 7f73267ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73201588d0 0x7f7320168360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:57.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.798+0000 7f73267ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7320155f30 con 0x7f7320154060 2023-08-31T18:48:57.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.798+0000 7f73267ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7320155950 con 0x7f73201588d0 2023-08-31T18:48:57.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.798+0000 7f73267ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7320164bf0 con 0x7f73200cb9b0 2023-08-31T18:48:57.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.798+0000 7f731f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7320154060 0x7f7320167e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:57.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.798+0000 7f731f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7320154060 0x7f7320167e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37386/0 (socket says 172.21.15.72:37386) 2023-08-31T18:48:57.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.798+0000 7f731f7fe700 1 -- 172.21.15.72:0/2542863850 learned_addr learned my addr 172.21.15.72:0/2542863850 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:48:57.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.799+0000 7f731ffff700 1 --2- 172.21.15.72:0/2542863850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73200cb9b0 0x7f7320167520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:57.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.799+0000 7f7324d9c700 1 --2- 172.21.15.72:0/2542863850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73201588d0 0x7f7320168360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:57.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.799+0000 7f731f7fe700 1 -- 172.21.15.72:0/2542863850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73200cb9b0 msgr2=0x7f7320167520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:57.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.799+0000 7f731f7fe700 1 --2- 172.21.15.72:0/2542863850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73200cb9b0 0x7f7320167520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.799+0000 7f731f7fe700 1 -- 172.21.15.72:0/2542863850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73201588d0 msgr2=0x7f7320168360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:57.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.799+0000 7f731f7fe700 1 --2- 172.21.15.72:0/2542863850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73201588d0 0x7f7320168360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.799+0000 7f731f7fe700 1 -- 172.21.15.72:0/2542863850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73140092a0 con 0x7f7320154060 2023-08-31T18:48:57.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.799+0000 7f731f7fe700 1 --2- 172.21.15.72:0/2542863850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7320154060 0x7f7320167e70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f7314009d50 tx=0x7f7314016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:57.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.799+0000 7f7307fff700 1 -- 172.21.15.72:0/2542863850 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731400dcf0 con 0x7f7320154060 2023-08-31T18:48:57.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.799+0000 7f7307fff700 1 -- 172.21.15.72:0/2542863850 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731400de50 con 0x7f7320154060 2023-08-31T18:48:57.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.799+0000 7f73267ff700 1 -- 172.21.15.72:0/2542863850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73201689a0 con 0x7f7320154060 2023-08-31T18:48:57.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.799+0000 7f7307fff700 1 -- 172.21.15.72:0/2542863850 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731401d430 con 0x7f7320154060 2023-08-31T18:48:57.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.799+0000 7f73267ff700 1 -- 172.21.15.72:0/2542863850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7320167a10 con 0x7f7320154060 2023-08-31T18:48:57.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.801+0000 7f73267ff700 1 -- 172.21.15.72:0/2542863850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73201560e0 con 0x7f7320154060 2023-08-31T18:48:57.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.801+0000 7f7307fff700 1 -- 172.21.15.72:0/2542863850 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f731401d7a0 con 0x7f7320154060 2023-08-31T18:48:57.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.802+0000 7f7307fff700 1 --2- 172.21.15.72:0/2542863850 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f730c05ee10 0x7f730c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:48:57.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.803+0000 7f7307fff700 1 -- 172.21.15.72:0/2542863850 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f731407b630 con 0x7f7320154060 2023-08-31T18:48:57.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.803+0000 7f731ffff700 1 --2- 172.21.15.72:0/2542863850 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f730c05ee10 0x7f730c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:48:57.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.803+0000 7f731ffff700 1 --2- 172.21.15.72:0/2542863850 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f730c05ee10 0x7f730c0612d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f7310001170 tx=0x7f7310007bb0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:48:57.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.807+0000 7f7307fff700 1 -- 172.21.15.72:0/2542863850 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f73201560e0 con 0x7f7320154060 2023-08-31T18:48:57.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.973+0000 7f73267ff700 1 -- 172.21.15.72:0/2542863850 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73201560e0 con 0x7f730c05ee10 2023-08-31T18:48:57.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.984+0000 7f7307fff700 1 -- 172.21.15.72:0/2542863850 <== mgr.4101 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360231 (secure 0 0 0) 0x7f73201560e0 con 0x7f730c05ee10 2023-08-31T18:48:57.989 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:48:57.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.990+0000 7f73267ff700 1 -- 172.21.15.72:0/2542863850 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f730c05ee10 msgr2=0x7f730c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:57.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.990+0000 7f73267ff700 1 --2- 172.21.15.72:0/2542863850 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f730c05ee10 0x7f730c0612d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f7310001170 tx=0x7f7310007bb0).stop 2023-08-31T18:48:57.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.990+0000 7f73267ff700 1 -- 172.21.15.72:0/2542863850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7320154060 msgr2=0x7f7320167e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:48:57.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.990+0000 7f73267ff700 1 --2- 172.21.15.72:0/2542863850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7320154060 0x7f7320167e70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f7314009d50 tx=0x7f7314016000).stop 2023-08-31T18:48:57.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.990+0000 7f73267ff700 1 -- 172.21.15.72:0/2542863850 shutdown_connections 2023-08-31T18:48:57.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.990+0000 7f73267ff700 1 --2- 172.21.15.72:0/2542863850 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f730c05ee10 0x7f730c0612d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.990+0000 7f73267ff700 1 --2- 172.21.15.72:0/2542863850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73201588d0 0x7f7320168360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.990+0000 7f73267ff700 1 --2- 172.21.15.72:0/2542863850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f73200cb9b0 0x7f7320167520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.990+0000 7f73267ff700 1 --2- 172.21.15.72:0/2542863850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7320154060 0x7f7320167e70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:48:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.990+0000 7f73267ff700 1 -- 172.21.15.72:0/2542863850 >> 172.21.15.72:0/2542863850 conn(0x7f732005e870 msgr2=0x7f73201536b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:48:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.990+0000 7f73267ff700 1 -- 172.21.15.72:0/2542863850 shutdown_connections 2023-08-31T18:48:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:48:57.990+0000 7f73267ff700 1 -- 172.21.15.72:0/2542863850 wait complete. 2023-08-31T18:48:57.996 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T18:48:58.008 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-08-31T18:48:57.170960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379816,"kb_used_data":3048,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594904,"statfs":{"total":773094113280,"available":770657181696,"internally_reserved":0,"allocated":3121152,"data_stored":1276316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4297,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.229268"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.927922+0000","last_change":"2023-08-31T18:48:51.924978+0000","last_active":"2023-08-31T18:48:51.927922+0000","last_peered":"2023-08-31T18:48:51.927922+0000","last_clean":"2023-08-31T18:48:51.927922+0000","last_became_active":"2023-08-31T18:48:51.924701+0000","last_became_peered":"2023-08-31T18:48:51.924701+0000","last_unstale":"2023-08-31T18:48:51.927922+0000","last_undegraded":"2023-08-31T18:48:51.927922+0000","last_fullsized":"2023-08-31T18:48:51.927922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.932971+0000","last_change":"2023-08-31T18:48:51.459541+0000","last_active":"2023-08-31T18:48:51.932971+0000","last_peered":"2023-08-31T18:48:51.932971+0000","last_clean":"2023-08-31T18:48:51.932971+0000","last_became_active":"2023-08-31T18:48:51.459196+0000","last_became_peered":"2023-08-31T18:48:51.459196+0000","last_unstale":"2023-08-31T18:48:51.932971+0000","last_undegraded":"2023-08-31T18:48:51.932971+0000","last_fullsized":"2023-08-31T18:48:51.932971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.935608+0000","last_change":"2023-08-31T18:48:51.931607+0000","last_active":"2023-08-31T18:48:51.935608+0000","last_peered":"2023-08-31T18:48:51.935608+0000","last_clean":"2023-08-31T18:48:51.935608+0000","last_became_active":"2023-08-31T18:48:51.931326+0000","last_became_peered":"2023-08-31T18:48:51.931326+0000","last_unstale":"2023-08-31T18:48:51.935608+0000","last_undegraded":"2023-08-31T18:48:51.935608+0000","last_fullsized":"2023-08-31T18:48:51.935608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.903411+0000","last_change":"2023-08-31T18:48:51.463860+0000","last_active":"2023-08-31T18:48:51.903411+0000","last_peered":"2023-08-31T18:48:51.903411+0000","last_clean":"2023-08-31T18:48:51.903411+0000","last_became_active":"2023-08-31T18:48:51.463460+0000","last_became_peered":"2023-08-31T18:48:51.463460+0000","last_unstale":"2023-08-31T18:48:51.903411+0000","last_undegraded":"2023-08-31T18:48:51.903411+0000","last_fullsized":"2023-08-31T18:48:51.903411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.918728+0000","last_change":"2023-08-31T18:48:51.912861+0000","last_active":"2023-08-31T18:48:51.918728+0000","last_peered":"2023-08-31T18:48:51.918728+0000","last_clean":"2023-08-31T18:48:51.918728+0000","last_became_active":"2023-08-31T18:48:51.912470+0000","last_became_peered":"2023-08-31T18:48:51.912470+0000","last_unstale":"2023-08-31T18:48:51.918728+0000","last_undegraded":"2023-08-31T18:48:51.918728+0000","last_fullsized":"2023-08-31T18:48:51.918728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.920051+0000","last_change":"2023-08-31T18:48:51.459128+0000","last_active":"2023-08-31T18:48:51.920051+0000","last_peered":"2023-08-31T18:48:51.920051+0000","last_clean":"2023-08-31T18:48:51.920051+0000","last_became_active":"2023-08-31T18:48:51.458673+0000","last_became_peered":"2023-08-31T18:48:51.458673+0000","last_unstale":"2023-08-31T18:48:51.920051+0000","last_undegraded":"2023-08-31T18:48:51.920051+0000","last_fullsized":"2023-08-31T18:48:51.920051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.918661+0000","last_change":"2023-08-31T18:48:51.912317+0000","last_active":"2023-08-31T18:48:51.918661+0000","last_peered":"2023-08-31T18:48:51.918661+0000","last_clean":"2023-08-31T18:48:51.918661+0000","last_became_active":"2023-08-31T18:48:51.912025+0000","last_became_peered":"2023-08-31T18:48:51.912025+0000","last_unstale":"2023-08-31T18:48:51.918661+0000","last_undegraded":"2023-08-31T18:48:51.918661+0000","last_fullsized":"2023-08-31T18:48:51.918661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.923833+0000","last_change":"2023-08-31T18:48:51.462525+0000","last_active":"2023-08-31T18:48:51.923833+0000","last_peered":"2023-08-31T18:48:51.923833+0000","last_clean":"2023-08-31T18:48:51.923833+0000","last_became_active":"2023-08-31T18:48:51.461845+0000","last_became_peered":"2023-08-31T18:48:51.461845+0000","last_unstale":"2023-08-31T18:48:51.923833+0000","last_undegraded":"2023-08-31T18:48:51.923833+0000","last_fullsized":"2023-08-31T18:48:51.923833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.935460+0000","last_change":"2023-08-31T18:48:51.932419+0000","last_active":"2023-08-31T18:48:51.935460+0000","last_peered":"2023-08-31T18:48:51.935460+0000","last_clean":"2023-08-31T18:48:51.935460+0000","last_became_active":"2023-08-31T18:48:51.932160+0000","last_became_peered":"2023-08-31T18:48:51.932160+0000","last_unstale":"2023-08-31T18:48:51.935460+0000","last_undegraded":"2023-08-31T18:48:51.935460+0000","last_fullsized":"2023-08-31T18:48:51.935460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.917285+0000","last_change":"2023-08-31T18:48:51.456342+0000","last_active":"2023-08-31T18:48:51.917285+0000","last_peered":"2023-08-31T18:48:51.917285+0000","last_clean":"2023-08-31T18:48:51.917285+0000","last_became_active":"2023-08-31T18:48:51.456064+0000","last_became_peered":"2023-08-31T18:48:51.456064+0000","last_unstale":"2023-08-31T18:48:51.917285+0000","last_undegraded":"2023-08-31T18:48:51.917285+0000","last_fullsized":"2023-08-31T18:48:51.917285+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.936958+0000","last_change":"2023-08-31T18:48:51.931929+0000","last_active":"2023-08-31T18:48:51.936958+0000","last_peered":"2023-08-31T18:48:51.936958+0000","last_clean":"2023-08-31T18:48:51.936958+0000","last_became_active":"2023-08-31T18:48:51.931467+0000","last_became_peered":"2023-08-31T18:48:51.931467+0000","last_unstale":"2023-08-31T18:48:51.936958+0000","last_undegraded":"2023-08-31T18:48:51.936958+0000","last_fullsized":"2023-08-31T18:48:51.936958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.931726+0000","last_change":"2023-08-31T18:48:51.460013+0000","last_active":"2023-08-31T18:48:51.931726+0000","last_peered":"2023-08-31T18:48:51.931726+0000","last_clean":"2023-08-31T18:48:51.931726+0000","last_became_active":"2023-08-31T18:48:51.459792+0000","last_became_peered":"2023-08-31T18:48:51.459792+0000","last_unstale":"2023-08-31T18:48:51.931726+0000","last_undegraded":"2023-08-31T18:48:51.931726+0000","last_fullsized":"2023-08-31T18:48:51.931726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.922750+0000","last_change":"2023-08-31T18:48:51.917907+0000","last_active":"2023-08-31T18:48:51.922750+0000","last_peered":"2023-08-31T18:48:51.922750+0000","last_clean":"2023-08-31T18:48:51.922750+0000","last_became_active":"2023-08-31T18:48:51.917683+0000","last_became_peered":"2023-08-31T18:48:51.917683+0000","last_unstale":"2023-08-31T18:48:51.922750+0000","last_undegraded":"2023-08-31T18:48:51.922750+0000","last_fullsized":"2023-08-31T18:48:51.922750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907374+0000","last_change":"2023-08-31T18:48:51.466995+0000","last_active":"2023-08-31T18:48:51.907374+0000","last_peered":"2023-08-31T18:48:51.907374+0000","last_clean":"2023-08-31T18:48:51.907374+0000","last_became_active":"2023-08-31T18:48:51.461980+0000","last_became_peered":"2023-08-31T18:48:51.461980+0000","last_unstale":"2023-08-31T18:48:51.907374+0000","last_undegraded":"2023-08-31T18:48:51.907374+0000","last_fullsized":"2023-08-31T18:48:51.907374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.927921+0000","last_change":"2023-08-31T18:48:51.924769+0000","last_active":"2023-08-31T18:48:51.927921+0000","last_peered":"2023-08-31T18:48:51.927921+0000","last_clean":"2023-08-31T18:48:51.927921+0000","last_became_active":"2023-08-31T18:48:51.924458+0000","last_became_peered":"2023-08-31T18:48:51.924458+0000","last_unstale":"2023-08-31T18:48:51.927921+0000","last_undegraded":"2023-08-31T18:48:51.927921+0000","last_fullsized":"2023-08-31T18:48:51.927921+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.906573+0000","last_change":"2023-08-31T18:48:51.461548+0000","last_active":"2023-08-31T18:48:51.906573+0000","last_peered":"2023-08-31T18:48:51.906573+0000","last_clean":"2023-08-31T18:48:51.906573+0000","last_became_active":"2023-08-31T18:48:51.461187+0000","last_became_peered":"2023-08-31T18:48:51.461187+0000","last_unstale":"2023-08-31T18:48:51.906573+0000","last_undegraded":"2023-08-31T18:48:51.906573+0000","last_fullsized":"2023-08-31T18:48:51.906573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.910855+0000","last_change":"2023-08-31T18:48:51.905611+0000","last_active":"2023-08-31T18:48:51.910855+0000","last_peered":"2023-08-31T18:48:51.910855+0000","last_clean":"2023-08-31T18:48:51.910855+0000","last_became_active":"2023-08-31T18:48:51.905343+0000","last_became_peered":"2023-08-31T18:48:51.905343+0000","last_unstale":"2023-08-31T18:48:51.910855+0000","last_undegraded":"2023-08-31T18:48:51.910855+0000","last_fullsized":"2023-08-31T18:48:51.910855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.908835+0000","last_change":"2023-08-31T18:48:51.466332+0000","last_active":"2023-08-31T18:48:51.908835+0000","last_peered":"2023-08-31T18:48:51.908835+0000","last_clean":"2023-08-31T18:48:51.908835+0000","last_became_active":"2023-08-31T18:48:51.465802+0000","last_became_peered":"2023-08-31T18:48:51.465802+0000","last_unstale":"2023-08-31T18:48:51.908835+0000","last_undegraded":"2023-08-31T18:48:51.908835+0000","last_fullsized":"2023-08-31T18:48:51.908835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.937376+0000","last_change":"2023-08-31T18:48:51.932397+0000","last_active":"2023-08-31T18:48:51.937376+0000","last_peered":"2023-08-31T18:48:51.937376+0000","last_clean":"2023-08-31T18:48:51.937376+0000","last_became_active":"2023-08-31T18:48:51.931887+0000","last_became_peered":"2023-08-31T18:48:51.931887+0000","last_unstale":"2023-08-31T18:48:51.937376+0000","last_undegraded":"2023-08-31T18:48:51.937376+0000","last_fullsized":"2023-08-31T18:48:51.937376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.905426+0000","last_change":"2023-08-31T18:48:51.453770+0000","last_active":"2023-08-31T18:48:51.905426+0000","last_peered":"2023-08-31T18:48:51.905426+0000","last_clean":"2023-08-31T18:48:51.905426+0000","last_became_active":"2023-08-31T18:48:51.453480+0000","last_became_peered":"2023-08-31T18:48:51.453480+0000","last_unstale":"2023-08-31T18:48:51.905426+0000","last_undegraded":"2023-08-31T18:48:51.905426+0000","last_fullsized":"2023-08-31T18:48:51.905426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.939540+0000","last_change":"2023-08-31T18:48:51.935795+0000","last_active":"2023-08-31T18:48:51.939540+0000","last_peered":"2023-08-31T18:48:51.939540+0000","last_clean":"2023-08-31T18:48:51.939540+0000","last_became_active":"2023-08-31T18:48:51.935427+0000","last_became_peered":"2023-08-31T18:48:51.935427+0000","last_unstale":"2023-08-31T18:48:51.939540+0000","last_undegraded":"2023-08-31T18:48:51.939540+0000","last_fullsized":"2023-08-31T18:48:51.939540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.911492+0000","last_change":"2023-08-31T18:48:51.461384+0000","last_active":"2023-08-31T18:48:51.911492+0000","last_peered":"2023-08-31T18:48:51.911492+0000","last_clean":"2023-08-31T18:48:51.911492+0000","last_became_active":"2023-08-31T18:48:51.461043+0000","last_became_peered":"2023-08-31T18:48:51.461043+0000","last_unstale":"2023-08-31T18:48:51.911492+0000","last_undegraded":"2023-08-31T18:48:51.911492+0000","last_fullsized":"2023-08-31T18:48:51.911492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.931276+0000","last_change":"2023-08-31T18:48:51.930572+0000","last_active":"2023-08-31T18:48:51.931276+0000","last_peered":"2023-08-31T18:48:51.931276+0000","last_clean":"2023-08-31T18:48:51.931276+0000","last_became_active":"2023-08-31T18:48:51.930346+0000","last_became_peered":"2023-08-31T18:48:51.930346+0000","last_unstale":"2023-08-31T18:48:51.931276+0000","last_undegraded":"2023-08-31T18:48:51.931276+0000","last_fullsized":"2023-08-31T18:48:51.931276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.939913+0000","last_change":"2023-08-31T18:48:51.457060+0000","last_active":"2023-08-31T18:48:51.939913+0000","last_peered":"2023-08-31T18:48:51.939913+0000","last_clean":"2023-08-31T18:48:51.939913+0000","last_became_active":"2023-08-31T18:48:51.456703+0000","last_became_peered":"2023-08-31T18:48:51.456703+0000","last_unstale":"2023-08-31T18:48:51.939913+0000","last_undegraded":"2023-08-31T18:48:51.939913+0000","last_fullsized":"2023-08-31T18:48:51.939913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.939476+0000","last_change":"2023-08-31T18:48:51.935264+0000","last_active":"2023-08-31T18:48:51.939476+0000","last_peered":"2023-08-31T18:48:51.939476+0000","last_clean":"2023-08-31T18:48:51.939476+0000","last_became_active":"2023-08-31T18:48:51.934950+0000","last_became_peered":"2023-08-31T18:48:51.934950+0000","last_unstale":"2023-08-31T18:48:51.939476+0000","last_undegraded":"2023-08-31T18:48:51.939476+0000","last_fullsized":"2023-08-31T18:48:51.939476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.914608+0000","last_change":"2023-08-31T18:48:51.454115+0000","last_active":"2023-08-31T18:48:51.914608+0000","last_peered":"2023-08-31T18:48:51.914608+0000","last_clean":"2023-08-31T18:48:51.914608+0000","last_became_active":"2023-08-31T18:48:51.453835+0000","last_became_peered":"2023-08-31T18:48:51.453835+0000","last_unstale":"2023-08-31T18:48:51.914608+0000","last_undegraded":"2023-08-31T18:48:51.914608+0000","last_fullsized":"2023-08-31T18:48:51.914608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.932093+0000","last_change":"2023-08-31T18:48:51.927819+0000","last_active":"2023-08-31T18:48:51.932093+0000","last_peered":"2023-08-31T18:48:51.932093+0000","last_clean":"2023-08-31T18:48:51.932093+0000","last_became_active":"2023-08-31T18:48:51.927265+0000","last_became_peered":"2023-08-31T18:48:51.927265+0000","last_unstale":"2023-08-31T18:48:51.932093+0000","last_undegraded":"2023-08-31T18:48:51.932093+0000","last_fullsized":"2023-08-31T18:48:51.932093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.903145+0000","last_change":"2023-08-31T18:48:51.456747+0000","last_active":"2023-08-31T18:48:51.903145+0000","last_peered":"2023-08-31T18:48:51.903145+0000","last_clean":"2023-08-31T18:48:51.903145+0000","last_became_active":"2023-08-31T18:48:51.455416+0000","last_became_peered":"2023-08-31T18:48:51.455416+0000","last_unstale":"2023-08-31T18:48:51.903145+0000","last_undegraded":"2023-08-31T18:48:51.903145+0000","last_fullsized":"2023-08-31T18:48:51.903145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.932126+0000","last_change":"2023-08-31T18:48:51.925170+0000","last_active":"2023-08-31T18:48:51.932126+0000","last_peered":"2023-08-31T18:48:51.932126+0000","last_clean":"2023-08-31T18:48:51.932126+0000","last_became_active":"2023-08-31T18:48:51.924878+0000","last_became_peered":"2023-08-31T18:48:51.924878+0000","last_unstale":"2023-08-31T18:48:51.932126+0000","last_undegraded":"2023-08-31T18:48:51.932126+0000","last_fullsized":"2023-08-31T18:48:51.932126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.917249+0000","last_change":"2023-08-31T18:48:51.464493+0000","last_active":"2023-08-31T18:48:51.917249+0000","last_peered":"2023-08-31T18:48:51.917249+0000","last_clean":"2023-08-31T18:48:51.917249+0000","last_became_active":"2023-08-31T18:48:51.464183+0000","last_became_peered":"2023-08-31T18:48:51.464183+0000","last_unstale":"2023-08-31T18:48:51.917249+0000","last_undegraded":"2023-08-31T18:48:51.917249+0000","last_fullsized":"2023-08-31T18:48:51.917249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934955+0000","last_change":"2023-08-31T18:48:51.929997+0000","last_active":"2023-08-31T18:48:51.934955+0000","last_peered":"2023-08-31T18:48:51.934955+0000","last_clean":"2023-08-31T18:48:51.934955+0000","last_became_active":"2023-08-31T18:48:51.929670+0000","last_became_peered":"2023-08-31T18:48:51.929670+0000","last_unstale":"2023-08-31T18:48:51.934955+0000","last_undegraded":"2023-08-31T18:48:51.934955+0000","last_fullsized":"2023-08-31T18:48:51.934955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.922448+0000","last_change":"2023-08-31T18:48:51.464671+0000","last_active":"2023-08-31T18:48:51.922448+0000","last_peered":"2023-08-31T18:48:51.922448+0000","last_clean":"2023-08-31T18:48:51.922448+0000","last_became_active":"2023-08-31T18:48:51.461835+0000","last_became_peered":"2023-08-31T18:48:51.461835+0000","last_unstale":"2023-08-31T18:48:51.922448+0000","last_undegraded":"2023-08-31T18:48:51.922448+0000","last_fullsized":"2023-08-31T18:48:51.922448+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.927360+0000","last_change":"2023-08-31T18:48:51.924912+0000","last_active":"2023-08-31T18:48:51.927360+0000","last_peered":"2023-08-31T18:48:51.927360+0000","last_clean":"2023-08-31T18:48:51.927360+0000","last_became_active":"2023-08-31T18:48:51.924539+0000","last_became_peered":"2023-08-31T18:48:51.924539+0000","last_unstale":"2023-08-31T18:48:51.927360+0000","last_undegraded":"2023-08-31T18:48:51.927360+0000","last_fullsized":"2023-08-31T18:48:51.927360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.906691+0000","last_change":"2023-08-31T18:48:51.463272+0000","last_active":"2023-08-31T18:48:51.906691+0000","last_peered":"2023-08-31T18:48:51.906691+0000","last_clean":"2023-08-31T18:48:51.906691+0000","last_became_active":"2023-08-31T18:48:51.460803+0000","last_became_peered":"2023-08-31T18:48:51.460803+0000","last_unstale":"2023-08-31T18:48:51.906691+0000","last_undegraded":"2023-08-31T18:48:51.906691+0000","last_fullsized":"2023-08-31T18:48:51.906691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.919897+0000","last_change":"2023-08-31T18:48:51.913477+0000","last_active":"2023-08-31T18:48:51.919897+0000","last_peered":"2023-08-31T18:48:51.919897+0000","last_clean":"2023-08-31T18:48:51.919897+0000","last_became_active":"2023-08-31T18:48:51.913223+0000","last_became_peered":"2023-08-31T18:48:51.913223+0000","last_unstale":"2023-08-31T18:48:51.919897+0000","last_undegraded":"2023-08-31T18:48:51.919897+0000","last_fullsized":"2023-08-31T18:48:51.919897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.903317+0000","last_change":"2023-08-31T18:48:51.460512+0000","last_active":"2023-08-31T18:48:51.903317+0000","last_peered":"2023-08-31T18:48:51.903317+0000","last_clean":"2023-08-31T18:48:51.903317+0000","last_became_active":"2023-08-31T18:48:51.460210+0000","last_became_peered":"2023-08-31T18:48:51.460210+0000","last_unstale":"2023-08-31T18:48:51.903317+0000","last_undegraded":"2023-08-31T18:48:51.903317+0000","last_fullsized":"2023-08-31T18:48:51.903317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.926965+0000","last_change":"2023-08-31T18:48:51.923770+0000","last_active":"2023-08-31T18:48:51.926965+0000","last_peered":"2023-08-31T18:48:51.926965+0000","last_clean":"2023-08-31T18:48:51.926965+0000","last_became_active":"2023-08-31T18:48:51.923091+0000","last_became_peered":"2023-08-31T18:48:51.923091+0000","last_unstale":"2023-08-31T18:48:51.926965+0000","last_undegraded":"2023-08-31T18:48:51.926965+0000","last_fullsized":"2023-08-31T18:48:51.926965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.918507+0000","last_change":"2023-08-31T18:48:51.452485+0000","last_active":"2023-08-31T18:48:51.918507+0000","last_peered":"2023-08-31T18:48:51.918507+0000","last_clean":"2023-08-31T18:48:51.918507+0000","last_became_active":"2023-08-31T18:48:51.452171+0000","last_became_peered":"2023-08-31T18:48:51.452171+0000","last_unstale":"2023-08-31T18:48:51.918507+0000","last_undegraded":"2023-08-31T18:48:51.918507+0000","last_fullsized":"2023-08-31T18:48:51.918507+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.935544+0000","last_change":"2023-08-31T18:48:51.930776+0000","last_active":"2023-08-31T18:48:51.935544+0000","last_peered":"2023-08-31T18:48:51.935544+0000","last_clean":"2023-08-31T18:48:51.935544+0000","last_became_active":"2023-08-31T18:48:51.930482+0000","last_became_peered":"2023-08-31T18:48:51.930482+0000","last_unstale":"2023-08-31T18:48:51.935544+0000","last_undegraded":"2023-08-31T18:48:51.935544+0000","last_fullsized":"2023-08-31T18:48:51.935544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.901427+0000","last_change":"2023-08-31T18:48:51.465199+0000","last_active":"2023-08-31T18:48:51.901427+0000","last_peered":"2023-08-31T18:48:51.901427+0000","last_clean":"2023-08-31T18:48:51.901427+0000","last_became_active":"2023-08-31T18:48:51.464923+0000","last_became_peered":"2023-08-31T18:48:51.464923+0000","last_unstale":"2023-08-31T18:48:51.901427+0000","last_undegraded":"2023-08-31T18:48:51.901427+0000","last_fullsized":"2023-08-31T18:48:51.901427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.919943+0000","last_change":"2023-08-31T18:48:51.915195+0000","last_active":"2023-08-31T18:48:51.919943+0000","last_peered":"2023-08-31T18:48:51.919943+0000","last_clean":"2023-08-31T18:48:51.919943+0000","last_became_active":"2023-08-31T18:48:51.914647+0000","last_became_peered":"2023-08-31T18:48:51.914647+0000","last_unstale":"2023-08-31T18:48:51.919943+0000","last_undegraded":"2023-08-31T18:48:51.919943+0000","last_fullsized":"2023-08-31T18:48:51.919943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.922412+0000","last_change":"2023-08-31T18:48:51.464518+0000","last_active":"2023-08-31T18:48:51.922412+0000","last_peered":"2023-08-31T18:48:51.922412+0000","last_clean":"2023-08-31T18:48:51.922412+0000","last_became_active":"2023-08-31T18:48:51.463756+0000","last_became_peered":"2023-08-31T18:48:51.463756+0000","last_unstale":"2023-08-31T18:48:51.922412+0000","last_undegraded":"2023-08-31T18:48:51.922412+0000","last_fullsized":"2023-08-31T18:48:51.922412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934751+0000","last_change":"2023-08-31T18:48:51.921242+0000","last_active":"2023-08-31T18:48:51.934751+0000","last_peered":"2023-08-31T18:48:51.934751+0000","last_clean":"2023-08-31T18:48:51.934751+0000","last_became_active":"2023-08-31T18:48:51.920896+0000","last_became_peered":"2023-08-31T18:48:51.920896+0000","last_unstale":"2023-08-31T18:48:51.934751+0000","last_undegraded":"2023-08-31T18:48:51.934751+0000","last_fullsized":"2023-08-31T18:48:51.934751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907703+0000","last_change":"2023-08-31T18:48:51.468437+0000","last_active":"2023-08-31T18:48:51.907703+0000","last_peered":"2023-08-31T18:48:51.907703+0000","last_clean":"2023-08-31T18:48:51.907703+0000","last_became_active":"2023-08-31T18:48:51.468137+0000","last_became_peered":"2023-08-31T18:48:51.468137+0000","last_unstale":"2023-08-31T18:48:51.907703+0000","last_undegraded":"2023-08-31T18:48:51.907703+0000","last_fullsized":"2023-08-31T18:48:51.907703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.922429+0000","last_change":"2023-08-31T18:48:51.917968+0000","last_active":"2023-08-31T18:48:51.922429+0000","last_peered":"2023-08-31T18:48:51.922429+0000","last_clean":"2023-08-31T18:48:51.922429+0000","last_became_active":"2023-08-31T18:48:51.917615+0000","last_became_peered":"2023-08-31T18:48:51.917615+0000","last_unstale":"2023-08-31T18:48:51.922429+0000","last_undegraded":"2023-08-31T18:48:51.922429+0000","last_fullsized":"2023-08-31T18:48:51.922429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.897675+0000","last_change":"2023-08-31T18:48:51.464778+0000","last_active":"2023-08-31T18:48:51.897675+0000","last_peered":"2023-08-31T18:48:51.897675+0000","last_clean":"2023-08-31T18:48:51.897675+0000","last_became_active":"2023-08-31T18:48:51.464505+0000","last_became_peered":"2023-08-31T18:48:51.464505+0000","last_unstale":"2023-08-31T18:48:51.897675+0000","last_undegraded":"2023-08-31T18:48:51.897675+0000","last_fullsized":"2023-08-31T18:48:51.897675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.931875+0000","last_change":"2023-08-31T18:48:51.927083+0000","last_active":"2023-08-31T18:48:51.931875+0000","last_peered":"2023-08-31T18:48:51.931875+0000","last_clean":"2023-08-31T18:48:51.931875+0000","last_became_active":"2023-08-31T18:48:51.926756+0000","last_became_peered":"2023-08-31T18:48:51.926756+0000","last_unstale":"2023-08-31T18:48:51.931875+0000","last_undegraded":"2023-08-31T18:48:51.931875+0000","last_fullsized":"2023-08-31T18:48:51.931875+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.917655+0000","last_change":"2023-08-31T18:48:51.452220+0000","last_active":"2023-08-31T18:48:51.917655+0000","last_peered":"2023-08-31T18:48:51.917655+0000","last_clean":"2023-08-31T18:48:51.917655+0000","last_became_active":"2023-08-31T18:48:51.451874+0000","last_became_peered":"2023-08-31T18:48:51.451874+0000","last_unstale":"2023-08-31T18:48:51.917655+0000","last_undegraded":"2023-08-31T18:48:51.917655+0000","last_fullsized":"2023-08-31T18:48:51.917655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.935002+0000","last_change":"2023-08-31T18:48:51.929957+0000","last_active":"2023-08-31T18:48:51.935002+0000","last_peered":"2023-08-31T18:48:51.935002+0000","last_clean":"2023-08-31T18:48:51.935002+0000","last_became_active":"2023-08-31T18:48:51.929600+0000","last_became_peered":"2023-08-31T18:48:51.929600+0000","last_unstale":"2023-08-31T18:48:51.935002+0000","last_undegraded":"2023-08-31T18:48:51.935002+0000","last_fullsized":"2023-08-31T18:48:51.935002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.905878+0000","last_change":"2023-08-31T18:48:51.466576+0000","last_active":"2023-08-31T18:48:51.905878+0000","last_peered":"2023-08-31T18:48:51.905878+0000","last_clean":"2023-08-31T18:48:51.905878+0000","last_became_active":"2023-08-31T18:48:51.466252+0000","last_became_peered":"2023-08-31T18:48:51.466252+0000","last_unstale":"2023-08-31T18:48:51.905878+0000","last_undegraded":"2023-08-31T18:48:51.905878+0000","last_fullsized":"2023-08-31T18:48:51.905878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.925188+0000","last_change":"2023-08-31T18:48:51.913650+0000","last_active":"2023-08-31T18:48:51.925188+0000","last_peered":"2023-08-31T18:48:51.925188+0000","last_clean":"2023-08-31T18:48:51.925188+0000","last_became_active":"2023-08-31T18:48:51.912270+0000","last_became_peered":"2023-08-31T18:48:51.912270+0000","last_unstale":"2023-08-31T18:48:51.925188+0000","last_undegraded":"2023-08-31T18:48:51.925188+0000","last_fullsized":"2023-08-31T18:48:51.925188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.26","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-31T18:48:53.190918+0000","last_change":"2023-08-31T18:48:51.468624+0000","last_active":"2023-08-31T18:48:53.190918+0000","last_peered":"2023-08-31T18:48:53.190918+0000","last_clean":"2023-08-31T18:48:53.190918+0000","last_became_active":"2023-08-31T18:48:51.468356+0000","last_became_peered":"2023-08-31T18:48:51.468356+0000","last_unstale":"2023-08-31T18:48:53.190918+0000","last_undegraded":"2023-08-31T18:48:53.190918+0000","last_fullsized":"2023-08-31T18:48:53.190918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.936328+0000","last_change":"2023-08-31T18:48:51.933396+0000","last_active":"2023-08-31T18:48:51.936328+0000","last_peered":"2023-08-31T18:48:51.936328+0000","last_clean":"2023-08-31T18:48:51.936328+0000","last_became_active":"2023-08-31T18:48:51.933082+0000","last_became_peered":"2023-08-31T18:48:51.933082+0000","last_unstale":"2023-08-31T18:48:51.936328+0000","last_undegraded":"2023-08-31T18:48:51.936328+0000","last_fullsized":"2023-08-31T18:48:51.936328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907160+0000","last_change":"2023-08-31T18:48:51.463464+0000","last_active":"2023-08-31T18:48:51.907160+0000","last_peered":"2023-08-31T18:48:51.907160+0000","last_clean":"2023-08-31T18:48:51.907160+0000","last_became_active":"2023-08-31T18:48:51.463067+0000","last_became_peered":"2023-08-31T18:48:51.463067+0000","last_unstale":"2023-08-31T18:48:51.907160+0000","last_undegraded":"2023-08-31T18:48:51.907160+0000","last_fullsized":"2023-08-31T18:48:51.907160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.924159+0000","last_change":"2023-08-31T18:48:51.911306+0000","last_active":"2023-08-31T18:48:51.924159+0000","last_peered":"2023-08-31T18:48:51.924159+0000","last_clean":"2023-08-31T18:48:51.924159+0000","last_became_active":"2023-08-31T18:48:51.911065+0000","last_became_peered":"2023-08-31T18:48:51.911065+0000","last_unstale":"2023-08-31T18:48:51.924159+0000","last_undegraded":"2023-08-31T18:48:51.924159+0000","last_fullsized":"2023-08-31T18:48:51.924159+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.918417+0000","last_change":"2023-08-31T18:48:51.457502+0000","last_active":"2023-08-31T18:48:51.918417+0000","last_peered":"2023-08-31T18:48:51.918417+0000","last_clean":"2023-08-31T18:48:51.918417+0000","last_became_active":"2023-08-31T18:48:51.457250+0000","last_became_peered":"2023-08-31T18:48:51.457250+0000","last_unstale":"2023-08-31T18:48:51.918417+0000","last_undegraded":"2023-08-31T18:48:51.918417+0000","last_fullsized":"2023-08-31T18:48:51.918417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.917294+0000","last_change":"2023-08-31T18:48:51.912564+0000","last_active":"2023-08-31T18:48:51.917294+0000","last_peered":"2023-08-31T18:48:51.917294+0000","last_clean":"2023-08-31T18:48:51.917294+0000","last_became_active":"2023-08-31T18:48:51.912298+0000","last_became_peered":"2023-08-31T18:48:51.912298+0000","last_unstale":"2023-08-31T18:48:51.917294+0000","last_undegraded":"2023-08-31T18:48:51.917294+0000","last_fullsized":"2023-08-31T18:48:51.917294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.908429+0000","last_change":"2023-08-31T18:48:51.464556+0000","last_active":"2023-08-31T18:48:51.908429+0000","last_peered":"2023-08-31T18:48:51.908429+0000","last_clean":"2023-08-31T18:48:51.908429+0000","last_became_active":"2023-08-31T18:48:51.464122+0000","last_became_peered":"2023-08-31T18:48:51.464122+0000","last_unstale":"2023-08-31T18:48:51.908429+0000","last_undegraded":"2023-08-31T18:48:51.908429+0000","last_fullsized":"2023-08-31T18:48:51.908429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.921658+0000","last_change":"2023-08-31T18:48:51.916228+0000","last_active":"2023-08-31T18:48:51.921658+0000","last_peered":"2023-08-31T18:48:51.921658+0000","last_clean":"2023-08-31T18:48:51.921658+0000","last_became_active":"2023-08-31T18:48:51.915878+0000","last_became_peered":"2023-08-31T18:48:51.915878+0000","last_unstale":"2023-08-31T18:48:51.921658+0000","last_undegraded":"2023-08-31T18:48:51.921658+0000","last_fullsized":"2023-08-31T18:48:51.921658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907984+0000","last_change":"2023-08-31T18:48:51.466671+0000","last_active":"2023-08-31T18:48:51.907984+0000","last_peered":"2023-08-31T18:48:51.907984+0000","last_clean":"2023-08-31T18:48:51.907984+0000","last_became_active":"2023-08-31T18:48:51.466134+0000","last_became_peered":"2023-08-31T18:48:51.466134+0000","last_unstale":"2023-08-31T18:48:51.907984+0000","last_undegraded":"2023-08-31T18:48:51.907984+0000","last_fullsized":"2023-08-31T18:48:51.907984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.924490+0000","last_change":"2023-08-31T18:48:51.913214+0000","last_active":"2023-08-31T18:48:51.924490+0000","last_peered":"2023-08-31T18:48:51.924490+0000","last_clean":"2023-08-31T18:48:51.924490+0000","last_became_active":"2023-08-31T18:48:51.912858+0000","last_became_peered":"2023-08-31T18:48:51.912858+0000","last_unstale":"2023-08-31T18:48:51.924490+0000","last_undegraded":"2023-08-31T18:48:51.924490+0000","last_fullsized":"2023-08-31T18:48:51.924490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.903111+0000","last_change":"2023-08-31T18:48:51.455481+0000","last_active":"2023-08-31T18:48:51.903111+0000","last_peered":"2023-08-31T18:48:51.903111+0000","last_clean":"2023-08-31T18:48:51.903111+0000","last_became_active":"2023-08-31T18:48:51.453382+0000","last_became_peered":"2023-08-31T18:48:51.453382+0000","last_unstale":"2023-08-31T18:48:51.903111+0000","last_undegraded":"2023-08-31T18:48:51.903111+0000","last_fullsized":"2023-08-31T18:48:51.903111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.925895+0000","last_change":"2023-08-31T18:48:51.921422+0000","last_active":"2023-08-31T18:48:51.925895+0000","last_peered":"2023-08-31T18:48:51.925895+0000","last_clean":"2023-08-31T18:48:51.925895+0000","last_became_active":"2023-08-31T18:48:51.921120+0000","last_became_peered":"2023-08-31T18:48:51.921120+0000","last_unstale":"2023-08-31T18:48:51.925895+0000","last_undegraded":"2023-08-31T18:48:51.925895+0000","last_fullsized":"2023-08-31T18:48:51.925895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907075+0000","last_change":"2023-08-31T18:48:51.463991+0000","last_active":"2023-08-31T18:48:51.907075+0000","last_peered":"2023-08-31T18:48:51.907075+0000","last_clean":"2023-08-31T18:48:51.907075+0000","last_became_active":"2023-08-31T18:48:51.463671+0000","last_became_peered":"2023-08-31T18:48:51.463671+0000","last_unstale":"2023-08-31T18:48:51.907075+0000","last_undegraded":"2023-08-31T18:48:51.907075+0000","last_fullsized":"2023-08-31T18:48:51.907075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.935846+0000","last_change":"2023-08-31T18:48:51.930811+0000","last_active":"2023-08-31T18:48:51.935846+0000","last_peered":"2023-08-31T18:48:51.935846+0000","last_clean":"2023-08-31T18:48:51.935846+0000","last_became_active":"2023-08-31T18:48:51.930521+0000","last_became_peered":"2023-08-31T18:48:51.930521+0000","last_unstale":"2023-08-31T18:48:51.935846+0000","last_undegraded":"2023-08-31T18:48:51.935846+0000","last_fullsized":"2023-08-31T18:48:51.935846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.925487+0000","last_change":"2023-08-31T18:48:51.463273+0000","last_active":"2023-08-31T18:48:51.925487+0000","last_peered":"2023-08-31T18:48:51.925487+0000","last_clean":"2023-08-31T18:48:51.925487+0000","last_became_active":"2023-08-31T18:48:51.462921+0000","last_became_peered":"2023-08-31T18:48:51.462921+0000","last_unstale":"2023-08-31T18:48:51.925487+0000","last_undegraded":"2023-08-31T18:48:51.925487+0000","last_fullsized":"2023-08-31T18:48:51.925487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.936321+0000","last_change":"2023-08-31T18:48:51.933239+0000","last_active":"2023-08-31T18:48:51.936321+0000","last_peered":"2023-08-31T18:48:51.936321+0000","last_clean":"2023-08-31T18:48:51.936321+0000","last_became_active":"2023-08-31T18:48:51.932810+0000","last_became_peered":"2023-08-31T18:48:51.932810+0000","last_unstale":"2023-08-31T18:48:51.936321+0000","last_undegraded":"2023-08-31T18:48:51.936321+0000","last_fullsized":"2023-08-31T18:48:51.936321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.919825+0000","last_change":"2023-08-31T18:48:51.468350+0000","last_active":"2023-08-31T18:48:51.919825+0000","last_peered":"2023-08-31T18:48:51.919825+0000","last_clean":"2023-08-31T18:48:51.919825+0000","last_became_active":"2023-08-31T18:48:51.468077+0000","last_became_peered":"2023-08-31T18:48:51.468077+0000","last_unstale":"2023-08-31T18:48:51.919825+0000","last_undegraded":"2023-08-31T18:48:51.919825+0000","last_fullsized":"2023-08-31T18:48:51.919825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.932515+0000","last_change":"2023-08-31T18:48:51.926115+0000","last_active":"2023-08-31T18:48:51.932515+0000","last_peered":"2023-08-31T18:48:51.932515+0000","last_clean":"2023-08-31T18:48:51.932515+0000","last_became_active":"2023-08-31T18:48:51.925831+0000","last_became_peered":"2023-08-31T18:48:51.925831+0000","last_unstale":"2023-08-31T18:48:51.932515+0000","last_undegraded":"2023-08-31T18:48:51.932515+0000","last_fullsized":"2023-08-31T18:48:51.932515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.923825+0000","last_change":"2023-08-31T18:48:51.463945+0000","last_active":"2023-08-31T18:48:51.923825+0000","last_peered":"2023-08-31T18:48:51.923825+0000","last_clean":"2023-08-31T18:48:51.923825+0000","last_became_active":"2023-08-31T18:48:51.463687+0000","last_became_peered":"2023-08-31T18:48:51.463687+0000","last_unstale":"2023-08-31T18:48:51.923825+0000","last_undegraded":"2023-08-31T18:48:51.923825+0000","last_fullsized":"2023-08-31T18:48:51.923825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.929975+0000","last_change":"2023-08-31T18:48:51.923054+0000","last_active":"2023-08-31T18:48:51.929975+0000","last_peered":"2023-08-31T18:48:51.929975+0000","last_clean":"2023-08-31T18:48:51.929975+0000","last_became_active":"2023-08-31T18:48:51.922765+0000","last_became_peered":"2023-08-31T18:48:51.922765+0000","last_unstale":"2023-08-31T18:48:51.929975+0000","last_undegraded":"2023-08-31T18:48:51.929975+0000","last_fullsized":"2023-08-31T18:48:51.929975+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.910047+0000","last_change":"2023-08-31T18:48:51.468804+0000","last_active":"2023-08-31T18:48:51.910047+0000","last_peered":"2023-08-31T18:48:51.910047+0000","last_clean":"2023-08-31T18:48:51.910047+0000","last_became_active":"2023-08-31T18:48:51.468526+0000","last_became_peered":"2023-08-31T18:48:51.468526+0000","last_unstale":"2023-08-31T18:48:51.910047+0000","last_undegraded":"2023-08-31T18:48:51.910047+0000","last_fullsized":"2023-08-31T18:48:51.910047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.913946+0000","last_change":"2023-08-31T18:48:51.909561+0000","last_active":"2023-08-31T18:48:51.913946+0000","last_peered":"2023-08-31T18:48:51.913946+0000","last_clean":"2023-08-31T18:48:51.913946+0000","last_became_active":"2023-08-31T18:48:51.909240+0000","last_became_peered":"2023-08-31T18:48:51.909240+0000","last_unstale":"2023-08-31T18:48:51.913946+0000","last_undegraded":"2023-08-31T18:48:51.913946+0000","last_fullsized":"2023-08-31T18:48:51.913946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.917593+0000","last_change":"2023-08-31T18:48:51.457270+0000","last_active":"2023-08-31T18:48:51.917593+0000","last_peered":"2023-08-31T18:48:51.917593+0000","last_clean":"2023-08-31T18:48:51.917593+0000","last_became_active":"2023-08-31T18:48:51.457021+0000","last_became_peered":"2023-08-31T18:48:51.457021+0000","last_unstale":"2023-08-31T18:48:51.917593+0000","last_undegraded":"2023-08-31T18:48:51.917593+0000","last_fullsized":"2023-08-31T18:48:51.917593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.932074+0000","last_change":"2023-08-31T18:48:51.927646+0000","last_active":"2023-08-31T18:48:51.932074+0000","last_peered":"2023-08-31T18:48:51.932074+0000","last_clean":"2023-08-31T18:48:51.932074+0000","last_became_active":"2023-08-31T18:48:51.926932+0000","last_became_peered":"2023-08-31T18:48:51.926932+0000","last_unstale":"2023-08-31T18:48:51.932074+0000","last_undegraded":"2023-08-31T18:48:51.932074+0000","last_fullsized":"2023-08-31T18:48:51.932074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907861+0000","last_change":"2023-08-31T18:48:51.466463+0000","last_active":"2023-08-31T18:48:51.907861+0000","last_peered":"2023-08-31T18:48:51.907861+0000","last_clean":"2023-08-31T18:48:51.907861+0000","last_became_active":"2023-08-31T18:48:51.465707+0000","last_became_peered":"2023-08-31T18:48:51.465707+0000","last_unstale":"2023-08-31T18:48:51.907861+0000","last_undegraded":"2023-08-31T18:48:51.907861+0000","last_fullsized":"2023-08-31T18:48:51.907861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934903+0000","last_change":"2023-08-31T18:48:51.932243+0000","last_active":"2023-08-31T18:48:51.934903+0000","last_peered":"2023-08-31T18:48:51.934903+0000","last_clean":"2023-08-31T18:48:51.934903+0000","last_became_active":"2023-08-31T18:48:51.931912+0000","last_became_peered":"2023-08-31T18:48:51.931912+0000","last_unstale":"2023-08-31T18:48:51.934903+0000","last_undegraded":"2023-08-31T18:48:51.934903+0000","last_fullsized":"2023-08-31T18:48:51.934903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.906069+0000","last_change":"2023-08-31T18:48:51.465042+0000","last_active":"2023-08-31T18:48:51.906069+0000","last_peered":"2023-08-31T18:48:51.906069+0000","last_clean":"2023-08-31T18:48:51.906069+0000","last_became_active":"2023-08-31T18:48:51.464770+0000","last_became_peered":"2023-08-31T18:48:51.464770+0000","last_unstale":"2023-08-31T18:48:51.906069+0000","last_undegraded":"2023-08-31T18:48:51.906069+0000","last_fullsized":"2023-08-31T18:48:51.906069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.927978+0000","last_change":"2023-08-31T18:48:51.922213+0000","last_active":"2023-08-31T18:48:51.927978+0000","last_peered":"2023-08-31T18:48:51.927978+0000","last_clean":"2023-08-31T18:48:51.927978+0000","last_became_active":"2023-08-31T18:48:51.921927+0000","last_became_peered":"2023-08-31T18:48:51.921927+0000","last_unstale":"2023-08-31T18:48:51.927978+0000","last_undegraded":"2023-08-31T18:48:51.927978+0000","last_fullsized":"2023-08-31T18:48:51.927978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.905663+0000","last_change":"2023-08-31T18:48:51.460471+0000","last_active":"2023-08-31T18:48:51.905663+0000","last_peered":"2023-08-31T18:48:51.905663+0000","last_clean":"2023-08-31T18:48:51.905663+0000","last_became_active":"2023-08-31T18:48:51.460189+0000","last_became_peered":"2023-08-31T18:48:51.460189+0000","last_unstale":"2023-08-31T18:48:51.905663+0000","last_undegraded":"2023-08-31T18:48:51.905663+0000","last_fullsized":"2023-08-31T18:48:51.905663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.927900+0000","last_change":"2023-08-31T18:48:51.924675+0000","last_active":"2023-08-31T18:48:51.927900+0000","last_peered":"2023-08-31T18:48:51.927900+0000","last_clean":"2023-08-31T18:48:51.927900+0000","last_became_active":"2023-08-31T18:48:51.924316+0000","last_became_peered":"2023-08-31T18:48:51.924316+0000","last_unstale":"2023-08-31T18:48:51.927900+0000","last_undegraded":"2023-08-31T18:48:51.927900+0000","last_fullsized":"2023-08-31T18:48:51.927900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.903549+0000","last_change":"2023-08-31T18:48:51.453010+0000","last_active":"2023-08-31T18:48:51.903549+0000","last_peered":"2023-08-31T18:48:51.903549+0000","last_clean":"2023-08-31T18:48:51.903549+0000","last_became_active":"2023-08-31T18:48:51.452744+0000","last_became_peered":"2023-08-31T18:48:51.452744+0000","last_unstale":"2023-08-31T18:48:51.903549+0000","last_undegraded":"2023-08-31T18:48:51.903549+0000","last_fullsized":"2023-08-31T18:48:51.903549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934662+0000","last_change":"2023-08-31T18:48:51.926704+0000","last_active":"2023-08-31T18:48:51.934662+0000","last_peered":"2023-08-31T18:48:51.934662+0000","last_clean":"2023-08-31T18:48:51.934662+0000","last_became_active":"2023-08-31T18:48:51.926041+0000","last_became_peered":"2023-08-31T18:48:51.926041+0000","last_unstale":"2023-08-31T18:48:51.934662+0000","last_undegraded":"2023-08-31T18:48:51.934662+0000","last_fullsized":"2023-08-31T18:48:51.934662+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.918308+0000","last_change":"2023-08-31T18:48:51.459998+0000","last_active":"2023-08-31T18:48:51.918308+0000","last_peered":"2023-08-31T18:48:51.918308+0000","last_clean":"2023-08-31T18:48:51.918308+0000","last_became_active":"2023-08-31T18:48:51.459693+0000","last_became_peered":"2023-08-31T18:48:51.459693+0000","last_unstale":"2023-08-31T18:48:51.918308+0000","last_undegraded":"2023-08-31T18:48:51.918308+0000","last_fullsized":"2023-08-31T18:48:51.918308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.923283+0000","last_change":"2023-08-31T18:48:51.918075+0000","last_active":"2023-08-31T18:48:51.923283+0000","last_peered":"2023-08-31T18:48:51.923283+0000","last_clean":"2023-08-31T18:48:51.923283+0000","last_became_active":"2023-08-31T18:48:51.917780+0000","last_became_peered":"2023-08-31T18:48:51.917780+0000","last_unstale":"2023-08-31T18:48:51.923283+0000","last_undegraded":"2023-08-31T18:48:51.923283+0000","last_fullsized":"2023-08-31T18:48:51.923283+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.936900+0000","last_change":"2023-08-31T18:48:51.458951+0000","last_active":"2023-08-31T18:48:51.936900+0000","last_peered":"2023-08-31T18:48:51.936900+0000","last_clean":"2023-08-31T18:48:51.936900+0000","last_became_active":"2023-08-31T18:48:51.458339+0000","last_became_peered":"2023-08-31T18:48:51.458339+0000","last_unstale":"2023-08-31T18:48:51.936900+0000","last_undegraded":"2023-08-31T18:48:51.936900+0000","last_fullsized":"2023-08-31T18:48:51.936900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.931395+0000","last_change":"2023-08-31T18:48:51.924957+0000","last_active":"2023-08-31T18:48:51.931395+0000","last_peered":"2023-08-31T18:48:51.931395+0000","last_clean":"2023-08-31T18:48:51.931395+0000","last_became_active":"2023-08-31T18:48:51.924596+0000","last_became_peered":"2023-08-31T18:48:51.924596+0000","last_unstale":"2023-08-31T18:48:51.931395+0000","last_undegraded":"2023-08-31T18:48:51.931395+0000","last_fullsized":"2023-08-31T18:48:51.931395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.922087+0000","last_change":"2023-08-31T18:48:51.466127+0000","last_active":"2023-08-31T18:48:51.922087+0000","last_peered":"2023-08-31T18:48:51.922087+0000","last_clean":"2023-08-31T18:48:51.922087+0000","last_became_active":"2023-08-31T18:48:51.465815+0000","last_became_peered":"2023-08-31T18:48:51.465815+0000","last_unstale":"2023-08-31T18:48:51.922087+0000","last_undegraded":"2023-08-31T18:48:51.922087+0000","last_fullsized":"2023-08-31T18:48:51.922087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.935584+0000","last_change":"2023-08-31T18:48:51.931596+0000","last_active":"2023-08-31T18:48:51.935584+0000","last_peered":"2023-08-31T18:48:51.935584+0000","last_clean":"2023-08-31T18:48:51.935584+0000","last_became_active":"2023-08-31T18:48:51.931328+0000","last_became_peered":"2023-08-31T18:48:51.931328+0000","last_unstale":"2023-08-31T18:48:51.935584+0000","last_undegraded":"2023-08-31T18:48:51.935584+0000","last_fullsized":"2023-08-31T18:48:51.935584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.916981+0000","last_change":"2023-08-31T18:48:51.459271+0000","last_active":"2023-08-31T18:48:51.916981+0000","last_peered":"2023-08-31T18:48:51.916981+0000","last_clean":"2023-08-31T18:48:51.916981+0000","last_became_active":"2023-08-31T18:48:51.458994+0000","last_became_peered":"2023-08-31T18:48:51.458994+0000","last_unstale":"2023-08-31T18:48:51.916981+0000","last_undegraded":"2023-08-31T18:48:51.916981+0000","last_fullsized":"2023-08-31T18:48:51.916981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.922979+0000","last_change":"2023-08-31T18:48:51.917094+0000","last_active":"2023-08-31T18:48:51.922979+0000","last_peered":"2023-08-31T18:48:51.922979+0000","last_clean":"2023-08-31T18:48:51.922979+0000","last_became_active":"2023-08-31T18:48:51.916805+0000","last_became_peered":"2023-08-31T18:48:51.916805+0000","last_unstale":"2023-08-31T18:48:51.922979+0000","last_undegraded":"2023-08-31T18:48:51.922979+0000","last_fullsized":"2023-08-31T18:48:51.922979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.904203+0000","last_change":"2023-08-31T18:48:51.463406+0000","last_active":"2023-08-31T18:48:51.904203+0000","last_peered":"2023-08-31T18:48:51.904203+0000","last_clean":"2023-08-31T18:48:51.904203+0000","last_became_active":"2023-08-31T18:48:51.463123+0000","last_became_peered":"2023-08-31T18:48:51.463123+0000","last_unstale":"2023-08-31T18:48:51.904203+0000","last_undegraded":"2023-08-31T18:48:51.904203+0000","last_fullsized":"2023-08-31T18:48:51.904203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934555+0000","last_change":"2023-08-31T18:48:51.922348+0000","last_active":"2023-08-31T18:48:51.934555+0000","last_peered":"2023-08-31T18:48:51.934555+0000","last_clean":"2023-08-31T18:48:51.934555+0000","last_became_active":"2023-08-31T18:48:51.922029+0000","last_became_peered":"2023-08-31T18:48:51.922029+0000","last_unstale":"2023-08-31T18:48:51.934555+0000","last_undegraded":"2023-08-31T18:48:51.934555+0000","last_fullsized":"2023-08-31T18:48:51.934555+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.902996+0000","last_change":"2023-08-31T18:48:51.463743+0000","last_active":"2023-08-31T18:48:51.902996+0000","last_peered":"2023-08-31T18:48:51.902996+0000","last_clean":"2023-08-31T18:48:51.902996+0000","last_became_active":"2023-08-31T18:48:51.463418+0000","last_became_peered":"2023-08-31T18:48:51.463418+0000","last_unstale":"2023-08-31T18:48:51.902996+0000","last_undegraded":"2023-08-31T18:48:51.902996+0000","last_fullsized":"2023-08-31T18:48:51.902996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.918988+0000","last_change":"2023-08-31T18:48:51.913311+0000","last_active":"2023-08-31T18:48:51.918988+0000","last_peered":"2023-08-31T18:48:51.918988+0000","last_clean":"2023-08-31T18:48:51.918988+0000","last_became_active":"2023-08-31T18:48:51.912772+0000","last_became_peered":"2023-08-31T18:48:51.912772+0000","last_unstale":"2023-08-31T18:48:51.918988+0000","last_undegraded":"2023-08-31T18:48:51.918988+0000","last_fullsized":"2023-08-31T18:48:51.918988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.927067+0000","last_change":"2023-08-31T18:48:51.467642+0000","last_active":"2023-08-31T18:48:51.927067+0000","last_peered":"2023-08-31T18:48:51.927067+0000","last_clean":"2023-08-31T18:48:51.927067+0000","last_became_active":"2023-08-31T18:48:51.467337+0000","last_became_peered":"2023-08-31T18:48:51.467337+0000","last_unstale":"2023-08-31T18:48:51.927067+0000","last_undegraded":"2023-08-31T18:48:51.927067+0000","last_fullsized":"2023-08-31T18:48:51.927067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.930064+0000","last_change":"2023-08-31T18:48:51.924308+0000","last_active":"2023-08-31T18:48:51.930064+0000","last_peered":"2023-08-31T18:48:51.930064+0000","last_clean":"2023-08-31T18:48:51.930064+0000","last_became_active":"2023-08-31T18:48:51.924001+0000","last_became_peered":"2023-08-31T18:48:51.924001+0000","last_unstale":"2023-08-31T18:48:51.930064+0000","last_undegraded":"2023-08-31T18:48:51.930064+0000","last_fullsized":"2023-08-31T18:48:51.930064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.937598+0000","last_change":"2023-08-31T18:48:51.470995+0000","last_active":"2023-08-31T18:48:51.937598+0000","last_peered":"2023-08-31T18:48:51.937598+0000","last_clean":"2023-08-31T18:48:51.937598+0000","last_became_active":"2023-08-31T18:48:51.470680+0000","last_became_peered":"2023-08-31T18:48:51.470680+0000","last_unstale":"2023-08-31T18:48:51.937598+0000","last_undegraded":"2023-08-31T18:48:51.937598+0000","last_fullsized":"2023-08-31T18:48:51.937598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934923+0000","last_change":"2023-08-31T18:48:51.930597+0000","last_active":"2023-08-31T18:48:51.934923+0000","last_peered":"2023-08-31T18:48:51.934923+0000","last_clean":"2023-08-31T18:48:51.934923+0000","last_became_active":"2023-08-31T18:48:51.930279+0000","last_became_peered":"2023-08-31T18:48:51.930279+0000","last_unstale":"2023-08-31T18:48:51.934923+0000","last_undegraded":"2023-08-31T18:48:51.934923+0000","last_fullsized":"2023-08-31T18:48:51.934923+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.937697+0000","last_change":"2023-08-31T18:48:51.461613+0000","last_active":"2023-08-31T18:48:51.937697+0000","last_peered":"2023-08-31T18:48:51.937697+0000","last_clean":"2023-08-31T18:48:51.937697+0000","last_became_active":"2023-08-31T18:48:51.461230+0000","last_became_peered":"2023-08-31T18:48:51.461230+0000","last_unstale":"2023-08-31T18:48:51.937697+0000","last_undegraded":"2023-08-31T18:48:51.937697+0000","last_fullsized":"2023-08-31T18:48:51.937697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.930903+0000","last_change":"2023-08-31T18:48:51.922772+0000","last_active":"2023-08-31T18:48:51.930903+0000","last_peered":"2023-08-31T18:48:51.930903+0000","last_clean":"2023-08-31T18:48:51.930903+0000","last_became_active":"2023-08-31T18:48:51.922506+0000","last_became_peered":"2023-08-31T18:48:51.922506+0000","last_unstale":"2023-08-31T18:48:51.930903+0000","last_undegraded":"2023-08-31T18:48:51.930903+0000","last_fullsized":"2023-08-31T18:48:51.930903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.900177+0000","last_change":"2023-08-31T18:48:51.462993+0000","last_active":"2023-08-31T18:48:51.900177+0000","last_peered":"2023-08-31T18:48:51.900177+0000","last_clean":"2023-08-31T18:48:51.900177+0000","last_became_active":"2023-08-31T18:48:51.462705+0000","last_became_peered":"2023-08-31T18:48:51.462705+0000","last_unstale":"2023-08-31T18:48:51.900177+0000","last_undegraded":"2023-08-31T18:48:51.900177+0000","last_fullsized":"2023-08-31T18:48:51.900177+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.919932+0000","last_change":"2023-08-31T18:48:51.914113+0000","last_active":"2023-08-31T18:48:51.919932+0000","last_peered":"2023-08-31T18:48:51.919932+0000","last_clean":"2023-08-31T18:48:51.919932+0000","last_became_active":"2023-08-31T18:48:51.912941+0000","last_became_peered":"2023-08-31T18:48:51.912941+0000","last_unstale":"2023-08-31T18:48:51.919932+0000","last_undegraded":"2023-08-31T18:48:51.919932+0000","last_fullsized":"2023-08-31T18:48:51.919932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.904813+0000","last_change":"2023-08-31T18:48:51.462681+0000","last_active":"2023-08-31T18:48:51.904813+0000","last_peered":"2023-08-31T18:48:51.904813+0000","last_clean":"2023-08-31T18:48:51.904813+0000","last_became_active":"2023-08-31T18:48:51.462265+0000","last_became_peered":"2023-08-31T18:48:51.462265+0000","last_unstale":"2023-08-31T18:48:51.904813+0000","last_undegraded":"2023-08-31T18:48:51.904813+0000","last_fullsized":"2023-08-31T18:48:51.904813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.918047+0000","last_change":"2023-08-31T18:48:51.913902+0000","last_active":"2023-08-31T18:48:51.918047+0000","last_peered":"2023-08-31T18:48:51.918047+0000","last_clean":"2023-08-31T18:48:51.918047+0000","last_became_active":"2023-08-31T18:48:51.913535+0000","last_became_peered":"2023-08-31T18:48:51.913535+0000","last_unstale":"2023-08-31T18:48:51.918047+0000","last_undegraded":"2023-08-31T18:48:51.918047+0000","last_fullsized":"2023-08-31T18:48:51.918047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.916692+0000","last_change":"2023-08-31T18:48:51.456246+0000","last_active":"2023-08-31T18:48:51.916692+0000","last_peered":"2023-08-31T18:48:51.916692+0000","last_clean":"2023-08-31T18:48:51.916692+0000","last_became_active":"2023-08-31T18:48:51.455870+0000","last_became_peered":"2023-08-31T18:48:51.455870+0000","last_unstale":"2023-08-31T18:48:51.916692+0000","last_undegraded":"2023-08-31T18:48:51.916692+0000","last_fullsized":"2023-08-31T18:48:51.916692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.923298+0000","last_change":"2023-08-31T18:48:51.918104+0000","last_active":"2023-08-31T18:48:51.923298+0000","last_peered":"2023-08-31T18:48:51.923298+0000","last_clean":"2023-08-31T18:48:51.923298+0000","last_became_active":"2023-08-31T18:48:51.917824+0000","last_became_peered":"2023-08-31T18:48:51.917824+0000","last_unstale":"2023-08-31T18:48:51.923298+0000","last_undegraded":"2023-08-31T18:48:51.923298+0000","last_fullsized":"2023-08-31T18:48:51.923298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.900579+0000","last_change":"2023-08-31T18:48:51.460591+0000","last_active":"2023-08-31T18:48:51.900579+0000","last_peered":"2023-08-31T18:48:51.900579+0000","last_clean":"2023-08-31T18:48:51.900579+0000","last_became_active":"2023-08-31T18:48:51.460314+0000","last_became_peered":"2023-08-31T18:48:51.460314+0000","last_unstale":"2023-08-31T18:48:51.900579+0000","last_undegraded":"2023-08-31T18:48:51.900579+0000","last_fullsized":"2023-08-31T18:48:51.900579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934868+0000","last_change":"2023-08-31T18:48:51.929606+0000","last_active":"2023-08-31T18:48:51.934868+0000","last_peered":"2023-08-31T18:48:51.934868+0000","last_clean":"2023-08-31T18:48:51.934868+0000","last_became_active":"2023-08-31T18:48:51.929287+0000","last_became_peered":"2023-08-31T18:48:51.929287+0000","last_unstale":"2023-08-31T18:48:51.934868+0000","last_undegraded":"2023-08-31T18:48:51.934868+0000","last_fullsized":"2023-08-31T18:48:51.934868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.908114+0000","last_change":"2023-08-31T18:48:51.467377+0000","last_active":"2023-08-31T18:48:51.908114+0000","last_peered":"2023-08-31T18:48:51.908114+0000","last_clean":"2023-08-31T18:48:51.908114+0000","last_became_active":"2023-08-31T18:48:51.461996+0000","last_became_peered":"2023-08-31T18:48:51.461996+0000","last_unstale":"2023-08-31T18:48:51.908114+0000","last_undegraded":"2023-08-31T18:48:51.908114+0000","last_fullsized":"2023-08-31T18:48:51.908114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.927918+0000","last_change":"2023-08-31T18:48:51.922197+0000","last_active":"2023-08-31T18:48:51.927918+0000","last_peered":"2023-08-31T18:48:51.927918+0000","last_clean":"2023-08-31T18:48:51.927918+0000","last_became_active":"2023-08-31T18:48:51.921904+0000","last_became_peered":"2023-08-31T18:48:51.921904+0000","last_unstale":"2023-08-31T18:48:51.927918+0000","last_undegraded":"2023-08-31T18:48:51.927918+0000","last_fullsized":"2023-08-31T18:48:51.927918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.900333+0000","last_change":"2023-08-31T18:48:51.453104+0000","last_active":"2023-08-31T18:48:51.900333+0000","last_peered":"2023-08-31T18:48:51.900333+0000","last_clean":"2023-08-31T18:48:51.900333+0000","last_became_active":"2023-08-31T18:48:51.452817+0000","last_became_peered":"2023-08-31T18:48:51.452817+0000","last_unstale":"2023-08-31T18:48:51.900333+0000","last_undegraded":"2023-08-31T18:48:51.900333+0000","last_fullsized":"2023-08-31T18:48:51.900333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.920089+0000","last_change":"2023-08-31T18:48:51.914360+0000","last_active":"2023-08-31T18:48:51.920089+0000","last_peered":"2023-08-31T18:48:51.920089+0000","last_clean":"2023-08-31T18:48:51.920089+0000","last_became_active":"2023-08-31T18:48:51.913757+0000","last_became_peered":"2023-08-31T18:48:51.913757+0000","last_unstale":"2023-08-31T18:48:51.920089+0000","last_undegraded":"2023-08-31T18:48:51.920089+0000","last_fullsized":"2023-08-31T18:48:51.920089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.898382+0000","last_change":"2023-08-31T18:48:51.446277+0000","last_active":"2023-08-31T18:48:51.898382+0000","last_peered":"2023-08-31T18:48:51.898382+0000","last_clean":"2023-08-31T18:48:51.898382+0000","last_became_active":"2023-08-31T18:48:51.445887+0000","last_became_peered":"2023-08-31T18:48:51.445887+0000","last_unstale":"2023-08-31T18:48:51.898382+0000","last_undegraded":"2023-08-31T18:48:51.898382+0000","last_fullsized":"2023-08-31T18:48:51.898382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.904833+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T18:48:51.904833+0000","last_peered":"2023-08-31T18:48:51.904833+0000","last_clean":"2023-08-31T18:48:51.904833+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T18:48:51.904833+0000","last_undegraded":"2023-08-31T18:48:51.904833+0000","last_fullsized":"2023-08-31T18:48:51.904833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.930023+0000","last_change":"2023-08-31T18:48:51.923632+0000","last_active":"2023-08-31T18:48:51.930023+0000","last_peered":"2023-08-31T18:48:51.930023+0000","last_clean":"2023-08-31T18:48:51.930023+0000","last_became_active":"2023-08-31T18:48:51.923375+0000","last_became_peered":"2023-08-31T18:48:51.923375+0000","last_unstale":"2023-08-31T18:48:51.930023+0000","last_undegraded":"2023-08-31T18:48:51.930023+0000","last_fullsized":"2023-08-31T18:48:51.930023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.898961+0000","last_change":"2023-08-31T18:48:51.451427+0000","last_active":"2023-08-31T18:48:51.898961+0000","last_peered":"2023-08-31T18:48:51.898961+0000","last_clean":"2023-08-31T18:48:51.898961+0000","last_became_active":"2023-08-31T18:48:51.451160+0000","last_became_peered":"2023-08-31T18:48:51.451160+0000","last_unstale":"2023-08-31T18:48:51.898961+0000","last_undegraded":"2023-08-31T18:48:51.898961+0000","last_fullsized":"2023-08-31T18:48:51.898961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.917520+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T18:48:51.917520+0000","last_peered":"2023-08-31T18:48:51.917520+0000","last_clean":"2023-08-31T18:48:51.917520+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T18:48:51.917520+0000","last_undegraded":"2023-08-31T18:48:51.917520+0000","last_fullsized":"2023-08-31T18:48:51.917520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934684+0000","last_change":"2023-08-31T18:48:51.926914+0000","last_active":"2023-08-31T18:48:51.934684+0000","last_peered":"2023-08-31T18:48:51.934684+0000","last_clean":"2023-08-31T18:48:51.934684+0000","last_became_active":"2023-08-31T18:48:51.926451+0000","last_became_peered":"2023-08-31T18:48:51.926451+0000","last_unstale":"2023-08-31T18:48:51.934684+0000","last_undegraded":"2023-08-31T18:48:51.934684+0000","last_fullsized":"2023-08-31T18:48:51.934684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.900350+0000","last_change":"2023-08-31T18:48:51.464693+0000","last_active":"2023-08-31T18:48:51.900350+0000","last_peered":"2023-08-31T18:48:51.900350+0000","last_clean":"2023-08-31T18:48:51.900350+0000","last_became_active":"2023-08-31T18:48:51.464441+0000","last_became_peered":"2023-08-31T18:48:51.464441+0000","last_unstale":"2023-08-31T18:48:51.900350+0000","last_undegraded":"2023-08-31T18:48:51.900350+0000","last_fullsized":"2023-08-31T18:48:51.900350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.900828+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T18:48:51.900828+0000","last_peered":"2023-08-31T18:48:51.900828+0000","last_clean":"2023-08-31T18:48:51.900828+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T18:48:51.900828+0000","last_undegraded":"2023-08-31T18:48:51.900828+0000","last_fullsized":"2023-08-31T18:48:51.900828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.937013+0000","last_change":"2023-08-31T18:48:51.931891+0000","last_active":"2023-08-31T18:48:51.937013+0000","last_peered":"2023-08-31T18:48:51.937013+0000","last_clean":"2023-08-31T18:48:51.937013+0000","last_became_active":"2023-08-31T18:48:51.931251+0000","last_became_peered":"2023-08-31T18:48:51.931251+0000","last_unstale":"2023-08-31T18:48:51.937013+0000","last_undegraded":"2023-08-31T18:48:51.937013+0000","last_fullsized":"2023-08-31T18:48:51.937013+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.905858+0000","last_change":"2023-08-31T18:48:51.466971+0000","last_active":"2023-08-31T18:48:51.905858+0000","last_peered":"2023-08-31T18:48:51.905858+0000","last_clean":"2023-08-31T18:48:51.905858+0000","last_became_active":"2023-08-31T18:48:51.464663+0000","last_became_peered":"2023-08-31T18:48:51.464663+0000","last_unstale":"2023-08-31T18:48:51.905858+0000","last_undegraded":"2023-08-31T18:48:51.905858+0000","last_fullsized":"2023-08-31T18:48:51.905858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.917429+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T18:48:51.917429+0000","last_peered":"2023-08-31T18:48:51.917429+0000","last_clean":"2023-08-31T18:48:51.917429+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T18:48:51.917429+0000","last_undegraded":"2023-08-31T18:48:51.917429+0000","last_fullsized":"2023-08-31T18:48:51.917429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907225+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T18:48:51.907225+0000","last_peered":"2023-08-31T18:48:51.907225+0000","last_clean":"2023-08-31T18:48:51.907225+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T18:48:51.907225+0000","last_undegraded":"2023-08-31T18:48:51.907225+0000","last_fullsized":"2023-08-31T18:48:51.907225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.936365+0000","last_change":"2023-08-31T18:48:51.933908+0000","last_active":"2023-08-31T18:48:51.936365+0000","last_peered":"2023-08-31T18:48:51.936365+0000","last_clean":"2023-08-31T18:48:51.936365+0000","last_became_active":"2023-08-31T18:48:51.932325+0000","last_became_peered":"2023-08-31T18:48:51.932325+0000","last_unstale":"2023-08-31T18:48:51.936365+0000","last_undegraded":"2023-08-31T18:48:51.936365+0000","last_fullsized":"2023-08-31T18:48:51.936365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.932072+0000","last_change":"2023-08-31T18:48:51.457839+0000","last_active":"2023-08-31T18:48:51.932072+0000","last_peered":"2023-08-31T18:48:51.932072+0000","last_clean":"2023-08-31T18:48:51.932072+0000","last_became_active":"2023-08-31T18:48:51.457556+0000","last_became_peered":"2023-08-31T18:48:51.457556+0000","last_unstale":"2023-08-31T18:48:51.932072+0000","last_undegraded":"2023-08-31T18:48:51.932072+0000","last_fullsized":"2023-08-31T18:48:51.932072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907313+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T18:48:51.907313+0000","last_peered":"2023-08-31T18:48:51.907313+0000","last_clean":"2023-08-31T18:48:51.907313+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T18:48:51.907313+0000","last_undegraded":"2023-08-31T18:48:51.907313+0000","last_fullsized":"2023-08-31T18:48:51.907313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.930215+0000","last_change":"2023-08-31T18:48:51.925984+0000","last_active":"2023-08-31T18:48:51.930215+0000","last_peered":"2023-08-31T18:48:51.930215+0000","last_clean":"2023-08-31T18:48:51.930215+0000","last_became_active":"2023-08-31T18:48:51.925737+0000","last_became_peered":"2023-08-31T18:48:51.925737+0000","last_unstale":"2023-08-31T18:48:51.930215+0000","last_undegraded":"2023-08-31T18:48:51.930215+0000","last_fullsized":"2023-08-31T18:48:51.930215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.903001+0000","last_change":"2023-08-31T18:48:51.452990+0000","last_active":"2023-08-31T18:48:51.903001+0000","last_peered":"2023-08-31T18:48:51.903001+0000","last_clean":"2023-08-31T18:48:51.903001+0000","last_became_active":"2023-08-31T18:48:51.452683+0000","last_became_peered":"2023-08-31T18:48:51.452683+0000","last_unstale":"2023-08-31T18:48:51.903001+0000","last_undegraded":"2023-08-31T18:48:51.903001+0000","last_fullsized":"2023-08-31T18:48:51.903001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.911591+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T18:48:51.911591+0000","last_peered":"2023-08-31T18:48:51.911591+0000","last_clean":"2023-08-31T18:48:51.911591+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T18:48:51.911591+0000","last_undegraded":"2023-08-31T18:48:51.911591+0000","last_fullsized":"2023-08-31T18:48:51.911591+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.924384+0000","last_change":"2023-08-31T18:48:51.920777+0000","last_active":"2023-08-31T18:48:51.924384+0000","last_peered":"2023-08-31T18:48:51.924384+0000","last_clean":"2023-08-31T18:48:51.924384+0000","last_became_active":"2023-08-31T18:48:51.920392+0000","last_became_peered":"2023-08-31T18:48:51.920392+0000","last_unstale":"2023-08-31T18:48:51.924384+0000","last_undegraded":"2023-08-31T18:48:51.924384+0000","last_fullsized":"2023-08-31T18:48:51.924384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.905865+0000","last_change":"2023-08-31T18:48:51.465654+0000","last_active":"2023-08-31T18:48:51.905865+0000","last_peered":"2023-08-31T18:48:51.905865+0000","last_clean":"2023-08-31T18:48:51.905865+0000","last_became_active":"2023-08-31T18:48:51.465020+0000","last_became_peered":"2023-08-31T18:48:51.465020+0000","last_unstale":"2023-08-31T18:48:51.905865+0000","last_undegraded":"2023-08-31T18:48:51.905865+0000","last_fullsized":"2023-08-31T18:48:51.905865+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.905528+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T18:48:51.905528+0000","last_peered":"2023-08-31T18:48:51.905528+0000","last_clean":"2023-08-31T18:48:51.905528+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T18:48:51.905528+0000","last_undegraded":"2023-08-31T18:48:51.905528+0000","last_fullsized":"2023-08-31T18:48:51.905528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934721+0000","last_change":"2023-08-31T18:48:51.926057+0000","last_active":"2023-08-31T18:48:51.934721+0000","last_peered":"2023-08-31T18:48:51.934721+0000","last_clean":"2023-08-31T18:48:51.934721+0000","last_became_active":"2023-08-31T18:48:51.925722+0000","last_became_peered":"2023-08-31T18:48:51.925722+0000","last_unstale":"2023-08-31T18:48:51.934721+0000","last_undegraded":"2023-08-31T18:48:51.934721+0000","last_fullsized":"2023-08-31T18:48:51.934721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.902956+0000","last_change":"2023-08-31T18:48:51.460515+0000","last_active":"2023-08-31T18:48:51.902956+0000","last_peered":"2023-08-31T18:48:51.902956+0000","last_clean":"2023-08-31T18:48:51.902956+0000","last_became_active":"2023-08-31T18:48:51.460271+0000","last_became_peered":"2023-08-31T18:48:51.460271+0000","last_unstale":"2023-08-31T18:48:51.902956+0000","last_undegraded":"2023-08-31T18:48:51.902956+0000","last_fullsized":"2023-08-31T18:48:51.902956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.903480+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T18:48:51.903480+0000","last_peered":"2023-08-31T18:48:51.903480+0000","last_clean":"2023-08-31T18:48:51.903480+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T18:48:51.903480+0000","last_undegraded":"2023-08-31T18:48:51.903480+0000","last_fullsized":"2023-08-31T18:48:51.903480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":393216,"data_stored":161283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.629},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.85599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":161193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.621}]},{"osd":1,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.502},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.751},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":393216,"data_stored":160799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.433},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.90400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":160673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.442},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.501},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.749}]},{"osd":5,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.76100000000000001}]},{"osd":7,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.61699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":160639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.504}]},{"osd":4,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":1.1859999999999999}]},{"osd":5,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":1.071},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":1.002}]},{"osd":6,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":1.081},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":1.1399999999999999}]},{"osd":7,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":1.024},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":1.175}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":405504,"data_stored":162279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.496},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.54200000000000004}]},{"osd":4,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.746},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.80500000000000005}]},{"osd":7,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.86299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":376832,"data_stored":153957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":9.6289999999999996,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.403,"5min":3.403,"15min":3.403},"last":0.65800000000000003}]},{"osd":1,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":9.8399999999999999,"5min":9.8399999999999999,"15min":9.8399999999999999},"last":0.752},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":9.7569999999999997,"5min":9.7569999999999997,"15min":9.7569999999999997},"last":0.77900000000000003}]},{"osd":2,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":9.7840000000000007,"5min":9.7840000000000007,"15min":9.7840000000000007},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":9.7200000000000006,"5min":9.7200000000000006,"15min":9.7200000000000006},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":5.133,"5min":5.133,"15min":5.133},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":12.589,"5min":12.589,"15min":12.589},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":9.6780000000000008,"5min":9.6780000000000008,"15min":9.6780000000000008},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.3610000000000002,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":9.4760000000000009,"5min":9.4760000000000009,"15min":9.4760000000000009},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":9.8640000000000008,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":7.1769999999999996,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.505},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":12.634,"5min":12.634,"15min":12.634},"last":0.51400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":155493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1,"5min":1,"15min":1},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.51100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T18:49:01.017 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T18:49:01.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.216+0000 7f75fd1ff700 1 Processor -- start 2023-08-31T18:49:01.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.216+0000 7f75fd1ff700 1 -- start start 2023-08-31T18:49:01.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.218+0000 7f75fd1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75f80aa290 0x7f75f8156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:01.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.218+0000 7f75fd1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75f81574b0 0x7f75f80c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:01.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.218+0000 7f75fd1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f80bfd00 con 0x7f75f80a9eb0 2023-08-31T18:49:01.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.218+0000 7f75fd1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f80c05a0 con 0x7f75f81574b0 2023-08-31T18:49:01.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.218+0000 7f75fd1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80aaea0 con 0x7f75f80aa290 2023-08-31T18:49:01.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.218+0000 7f75f759e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75f81574b0 0x7f75f80c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:01.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.218+0000 7f75f6d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f75f80a9eb0 0x7f75f80c5bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42250/0 (socket says 172.21.15.72:42250) 2023-08-31T18:49:01.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.218+0000 7f75f6d9d700 1 -- 172.21.15.72:0/3624671486 learned_addr learned my addr 172.21.15.72:0/3624671486 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:49:01.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.218+0000 7f75f659c700 1 --2- 172.21.15.72:0/3624671486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75f80aa290 0x7f75f8156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:01.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.219+0000 7f75f759e700 1 -- 172.21.15.72:0/3624671486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75f80aa290 msgr2=0x7f75f8156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:01.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.219+0000 7f75f759e700 1 --2- 172.21.15.72:0/3624671486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75f80aa290 0x7f75f8156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:01.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.219+0000 7f75f759e700 1 -- 172.21.15.72:0/3624671486 >> v1:172.21.15.72:6789/0 conn(0x7f75f80a9eb0 legacy=0x7f75f80c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:01.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.219+0000 7f75f759e700 1 -- 172.21.15.72:0/3624671486 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f80c6670 con 0x7f75f81574b0 2023-08-31T18:49:01.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.219+0000 7f75f5d9b700 1 -- 172.21.15.72:0/3624671486 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735397273 0 0) 0x7f75f80bfd00 con 0x7f75f80a9eb0 2023-08-31T18:49:01.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.219+0000 7f75f659c700 1 --2- 172.21.15.72:0/3624671486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75f80aa290 0x7f75f8156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:49:01.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.219+0000 7f75f759e700 1 --2- 172.21.15.72:0/3624671486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f81574b0 0x7f75f80c0a30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f75f0009e60 tx=0x7f75f0009780).ready entity=mon.0 client_cookie=4180726429ab86b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:01.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.219+0000 7f75f5d9b700 1 -- 172.21.15.72:0/3624671486 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f000e070 con 0x7f75f81574b0 2023-08-31T18:49:01.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.219+0000 7f75f5d9b700 1 -- 172.21.15.72:0/3624671486 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f000bc30 con 0x7f75f81574b0 2023-08-31T18:49:01.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.219+0000 7f75f5d9b700 1 -- 172.21.15.72:0/3624671486 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0012410 con 0x7f75f81574b0 2023-08-31T18:49:01.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.219+0000 7f75fd1ff700 1 -- 172.21.15.72:0/3624671486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f81574b0 msgr2=0x7f75f80c0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:01.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.219+0000 7f75fd1ff700 1 --2- 172.21.15.72:0/3624671486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f81574b0 0x7f75f80c0a30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f75f0009e60 tx=0x7f75f0009780).stop 2023-08-31T18:49:01.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.220+0000 7f75fd1ff700 1 -- 172.21.15.72:0/3624671486 shutdown_connections 2023-08-31T18:49:01.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.220+0000 7f75fd1ff700 1 --2- 172.21.15.72:0/3624671486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f81574b0 0x7f75f80c0a30 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:01.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.220+0000 7f75fd1ff700 1 --2- 172.21.15.72:0/3624671486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75f80aa290 0x7f75f8156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:01.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.220+0000 7f75fd1ff700 1 -- 172.21.15.72:0/3624671486 >> 172.21.15.72:0/3624671486 conn(0x7f75f80c82e0 msgr2=0x7f75f805e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:01.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.220+0000 7f75fd1ff700 1 -- 172.21.15.72:0/3624671486 shutdown_connections 2023-08-31T18:49:01.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.220+0000 7f75fd1ff700 1 -- 172.21.15.72:0/3624671486 wait complete. 2023-08-31T18:49:01.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.221+0000 7f75fd1ff700 1 Processor -- start 2023-08-31T18:49:01.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.221+0000 7f75fd1ff700 1 -- start start 2023-08-31T18:49:01.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.222+0000 7f75fd1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f80a9eb0 0x7f75f8148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:01.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.222+0000 7f75fd1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75f80aa290 0x7f75f80ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:01.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.222+0000 7f75fd1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75f81574b0 0x7f75f814c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:01.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.222+0000 7f75fd1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f81496c0 con 0x7f75f80a9eb0 2023-08-31T18:49:01.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.222+0000 7f75fd1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80b0380 con 0x7f75f81574b0 2023-08-31T18:49:01.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.222+0000 7f75fd1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80b0660 con 0x7f75f80aa290 2023-08-31T18:49:01.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.223+0000 7f75f6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f80a9eb0 0x7f75f8148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:01.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.223+0000 7f75f6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f80a9eb0 0x7f75f8148780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37412/0 (socket says 172.21.15.72:37412) 2023-08-31T18:49:01.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.223+0000 7f75f6d9d700 1 -- 172.21.15.72:0/2164145075 learned_addr learned my addr 172.21.15.72:0/2164145075 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:01.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.223+0000 7f75f6d9d700 1 -- 172.21.15.72:0/2164145075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75f80aa290 msgr2=0x7f75f80ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:01.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.223+0000 7f75f6d9d700 1 --2- 172.21.15.72:0/2164145075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75f80aa290 0x7f75f80ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:01.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.223+0000 7f75f6d9d700 1 -- 172.21.15.72:0/2164145075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75f81574b0 msgr2=0x7f75f814c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:01.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.223+0000 7f75f6d9d700 1 --2- 172.21.15.72:0/2164145075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75f81574b0 0x7f75f814c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:01.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.223+0000 7f75f6d9d700 1 -- 172.21.15.72:0/2164145075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f0009a20 con 0x7f75f80a9eb0 2023-08-31T18:49:01.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.223+0000 7f75f6d9d700 1 --2- 172.21.15.72:0/2164145075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f80a9eb0 0x7f75f8148780 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f75e800c4e0 tx=0x7f75e8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:01.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.223+0000 7f75deffd700 1 -- 172.21.15.72:0/2164145075 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e80072e0 con 0x7f75f80a9eb0 2023-08-31T18:49:01.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.223+0000 7f75deffd700 1 -- 172.21.15.72:0/2164145075 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e8007440 con 0x7f75f80a9eb0 2023-08-31T18:49:01.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.223+0000 7f75deffd700 1 -- 172.21.15.72:0/2164145075 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e80057a0 con 0x7f75f80a9eb0 2023-08-31T18:49:01.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.223+0000 7f75fd1ff700 1 -- 172.21.15.72:0/2164145075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f80b0940 con 0x7f75f80a9eb0 2023-08-31T18:49:01.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.223+0000 7f75fd1ff700 1 -- 172.21.15.72:0/2164145075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f80c4be0 con 0x7f75f80a9eb0 2023-08-31T18:49:01.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.225+0000 7f75fd1ff700 1 -- 172.21.15.72:0/2164145075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f80b0e60 con 0x7f75f80a9eb0 2023-08-31T18:49:01.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.225+0000 7f75deffd700 1 -- 172.21.15.72:0/2164145075 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f75e8005bd0 con 0x7f75f80a9eb0 2023-08-31T18:49:01.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.226+0000 7f75deffd700 1 --2- 172.21.15.72:0/2164145075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f75e405ee10 0x7f75e40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:01.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.226+0000 7f75deffd700 1 -- 172.21.15.72:0/2164145075 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f75e8079800 con 0x7f75f80a9eb0 2023-08-31T18:49:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.226+0000 7f75f659c700 1 --2- 172.21.15.72:0/2164145075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f75e405ee10 0x7f75e40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.227+0000 7f75f659c700 1 --2- 172.21.15.72:0/2164145075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f75e405ee10 0x7f75e40612d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f75ec006d80 tx=0x7f75ec008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.230+0000 7f75deffd700 1 -- 172.21.15.72:0/2164145075 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f75f80b0e60 con 0x7f75f80a9eb0 2023-08-31T18:49:01.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.397+0000 7f75fd1ff700 1 -- 172.21.15.72:0/2164145075 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75f80b0e60 con 0x7f75e405ee10 2023-08-31T18:49:01.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.407+0000 7f75deffd700 1 -- 172.21.15.72:0/2164145075 <== mgr.4101 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360219 (secure 0 0 0) 0x7f75f80b0e60 con 0x7f75e405ee10 2023-08-31T18:49:01.412 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:49:01.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.411+0000 7f75fd1ff700 1 -- 172.21.15.72:0/2164145075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f75e405ee10 msgr2=0x7f75e40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:01.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.411+0000 7f75fd1ff700 1 --2- 172.21.15.72:0/2164145075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f75e405ee10 0x7f75e40612d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f75ec006d80 tx=0x7f75ec008040).stop 2023-08-31T18:49:01.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.411+0000 7f75fd1ff700 1 -- 172.21.15.72:0/2164145075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f80a9eb0 msgr2=0x7f75f8148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:01.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.411+0000 7f75fd1ff700 1 --2- 172.21.15.72:0/2164145075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f80a9eb0 0x7f75f8148780 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f75e800c4e0 tx=0x7f75e8007c70).stop 2023-08-31T18:49:01.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.411+0000 7f75fd1ff700 1 -- 172.21.15.72:0/2164145075 shutdown_connections 2023-08-31T18:49:01.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.411+0000 7f75fd1ff700 1 --2- 172.21.15.72:0/2164145075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f75e405ee10 0x7f75e40612d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:01.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.411+0000 7f75fd1ff700 1 --2- 172.21.15.72:0/2164145075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75f81574b0 0x7f75f814c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:01.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.411+0000 7f75fd1ff700 1 --2- 172.21.15.72:0/2164145075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75f80a9eb0 0x7f75f8148780 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:01.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.411+0000 7f75fd1ff700 1 --2- 172.21.15.72:0/2164145075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75f80aa290 0x7f75f80ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:01.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.411+0000 7f75fd1ff700 1 -- 172.21.15.72:0/2164145075 >> 172.21.15.72:0/2164145075 conn(0x7f75f80c82e0 msgr2=0x7f75f815a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:01.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.411+0000 7f75fd1ff700 1 -- 172.21.15.72:0/2164145075 shutdown_connections 2023-08-31T18:49:01.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.411+0000 7f75fd1ff700 1 -- 172.21.15.72:0/2164145075 wait complete. 2023-08-31T18:49:01.419 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T18:49:01.429 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-08-31T18:49:01.171793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379840,"kb_used_data":3072,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594880,"statfs":{"total":773094113280,"available":770657157120,"internally_reserved":0,"allocated":3145728,"data_stored":1289724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4861,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.229240"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.927922+0000","last_change":"2023-08-31T18:48:51.924978+0000","last_active":"2023-08-31T18:48:51.927922+0000","last_peered":"2023-08-31T18:48:51.927922+0000","last_clean":"2023-08-31T18:48:51.927922+0000","last_became_active":"2023-08-31T18:48:51.924701+0000","last_became_peered":"2023-08-31T18:48:51.924701+0000","last_unstale":"2023-08-31T18:48:51.927922+0000","last_undegraded":"2023-08-31T18:48:51.927922+0000","last_fullsized":"2023-08-31T18:48:51.927922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.932971+0000","last_change":"2023-08-31T18:48:51.459541+0000","last_active":"2023-08-31T18:48:51.932971+0000","last_peered":"2023-08-31T18:48:51.932971+0000","last_clean":"2023-08-31T18:48:51.932971+0000","last_became_active":"2023-08-31T18:48:51.459196+0000","last_became_peered":"2023-08-31T18:48:51.459196+0000","last_unstale":"2023-08-31T18:48:51.932971+0000","last_undegraded":"2023-08-31T18:48:51.932971+0000","last_fullsized":"2023-08-31T18:48:51.932971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.935608+0000","last_change":"2023-08-31T18:48:51.931607+0000","last_active":"2023-08-31T18:48:51.935608+0000","last_peered":"2023-08-31T18:48:51.935608+0000","last_clean":"2023-08-31T18:48:51.935608+0000","last_became_active":"2023-08-31T18:48:51.931326+0000","last_became_peered":"2023-08-31T18:48:51.931326+0000","last_unstale":"2023-08-31T18:48:51.935608+0000","last_undegraded":"2023-08-31T18:48:51.935608+0000","last_fullsized":"2023-08-31T18:48:51.935608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.903411+0000","last_change":"2023-08-31T18:48:51.463860+0000","last_active":"2023-08-31T18:48:51.903411+0000","last_peered":"2023-08-31T18:48:51.903411+0000","last_clean":"2023-08-31T18:48:51.903411+0000","last_became_active":"2023-08-31T18:48:51.463460+0000","last_became_peered":"2023-08-31T18:48:51.463460+0000","last_unstale":"2023-08-31T18:48:51.903411+0000","last_undegraded":"2023-08-31T18:48:51.903411+0000","last_fullsized":"2023-08-31T18:48:51.903411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.918728+0000","last_change":"2023-08-31T18:48:51.912861+0000","last_active":"2023-08-31T18:48:51.918728+0000","last_peered":"2023-08-31T18:48:51.918728+0000","last_clean":"2023-08-31T18:48:51.918728+0000","last_became_active":"2023-08-31T18:48:51.912470+0000","last_became_peered":"2023-08-31T18:48:51.912470+0000","last_unstale":"2023-08-31T18:48:51.918728+0000","last_undegraded":"2023-08-31T18:48:51.918728+0000","last_fullsized":"2023-08-31T18:48:51.918728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.920051+0000","last_change":"2023-08-31T18:48:51.459128+0000","last_active":"2023-08-31T18:48:51.920051+0000","last_peered":"2023-08-31T18:48:51.920051+0000","last_clean":"2023-08-31T18:48:51.920051+0000","last_became_active":"2023-08-31T18:48:51.458673+0000","last_became_peered":"2023-08-31T18:48:51.458673+0000","last_unstale":"2023-08-31T18:48:51.920051+0000","last_undegraded":"2023-08-31T18:48:51.920051+0000","last_fullsized":"2023-08-31T18:48:51.920051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.918661+0000","last_change":"2023-08-31T18:48:51.912317+0000","last_active":"2023-08-31T18:48:51.918661+0000","last_peered":"2023-08-31T18:48:51.918661+0000","last_clean":"2023-08-31T18:48:51.918661+0000","last_became_active":"2023-08-31T18:48:51.912025+0000","last_became_peered":"2023-08-31T18:48:51.912025+0000","last_unstale":"2023-08-31T18:48:51.918661+0000","last_undegraded":"2023-08-31T18:48:51.918661+0000","last_fullsized":"2023-08-31T18:48:51.918661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.923833+0000","last_change":"2023-08-31T18:48:51.462525+0000","last_active":"2023-08-31T18:48:51.923833+0000","last_peered":"2023-08-31T18:48:51.923833+0000","last_clean":"2023-08-31T18:48:51.923833+0000","last_became_active":"2023-08-31T18:48:51.461845+0000","last_became_peered":"2023-08-31T18:48:51.461845+0000","last_unstale":"2023-08-31T18:48:51.923833+0000","last_undegraded":"2023-08-31T18:48:51.923833+0000","last_fullsized":"2023-08-31T18:48:51.923833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.935460+0000","last_change":"2023-08-31T18:48:51.932419+0000","last_active":"2023-08-31T18:48:51.935460+0000","last_peered":"2023-08-31T18:48:51.935460+0000","last_clean":"2023-08-31T18:48:51.935460+0000","last_became_active":"2023-08-31T18:48:51.932160+0000","last_became_peered":"2023-08-31T18:48:51.932160+0000","last_unstale":"2023-08-31T18:48:51.935460+0000","last_undegraded":"2023-08-31T18:48:51.935460+0000","last_fullsized":"2023-08-31T18:48:51.935460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.917285+0000","last_change":"2023-08-31T18:48:51.456342+0000","last_active":"2023-08-31T18:48:51.917285+0000","last_peered":"2023-08-31T18:48:51.917285+0000","last_clean":"2023-08-31T18:48:51.917285+0000","last_became_active":"2023-08-31T18:48:51.456064+0000","last_became_peered":"2023-08-31T18:48:51.456064+0000","last_unstale":"2023-08-31T18:48:51.917285+0000","last_undegraded":"2023-08-31T18:48:51.917285+0000","last_fullsized":"2023-08-31T18:48:51.917285+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.936958+0000","last_change":"2023-08-31T18:48:51.931929+0000","last_active":"2023-08-31T18:48:51.936958+0000","last_peered":"2023-08-31T18:48:51.936958+0000","last_clean":"2023-08-31T18:48:51.936958+0000","last_became_active":"2023-08-31T18:48:51.931467+0000","last_became_peered":"2023-08-31T18:48:51.931467+0000","last_unstale":"2023-08-31T18:48:51.936958+0000","last_undegraded":"2023-08-31T18:48:51.936958+0000","last_fullsized":"2023-08-31T18:48:51.936958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.931726+0000","last_change":"2023-08-31T18:48:51.460013+0000","last_active":"2023-08-31T18:48:51.931726+0000","last_peered":"2023-08-31T18:48:51.931726+0000","last_clean":"2023-08-31T18:48:51.931726+0000","last_became_active":"2023-08-31T18:48:51.459792+0000","last_became_peered":"2023-08-31T18:48:51.459792+0000","last_unstale":"2023-08-31T18:48:51.931726+0000","last_undegraded":"2023-08-31T18:48:51.931726+0000","last_fullsized":"2023-08-31T18:48:51.931726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.922750+0000","last_change":"2023-08-31T18:48:51.917907+0000","last_active":"2023-08-31T18:48:51.922750+0000","last_peered":"2023-08-31T18:48:51.922750+0000","last_clean":"2023-08-31T18:48:51.922750+0000","last_became_active":"2023-08-31T18:48:51.917683+0000","last_became_peered":"2023-08-31T18:48:51.917683+0000","last_unstale":"2023-08-31T18:48:51.922750+0000","last_undegraded":"2023-08-31T18:48:51.922750+0000","last_fullsized":"2023-08-31T18:48:51.922750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907374+0000","last_change":"2023-08-31T18:48:51.466995+0000","last_active":"2023-08-31T18:48:51.907374+0000","last_peered":"2023-08-31T18:48:51.907374+0000","last_clean":"2023-08-31T18:48:51.907374+0000","last_became_active":"2023-08-31T18:48:51.461980+0000","last_became_peered":"2023-08-31T18:48:51.461980+0000","last_unstale":"2023-08-31T18:48:51.907374+0000","last_undegraded":"2023-08-31T18:48:51.907374+0000","last_fullsized":"2023-08-31T18:48:51.907374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.927921+0000","last_change":"2023-08-31T18:48:51.924769+0000","last_active":"2023-08-31T18:48:51.927921+0000","last_peered":"2023-08-31T18:48:51.927921+0000","last_clean":"2023-08-31T18:48:51.927921+0000","last_became_active":"2023-08-31T18:48:51.924458+0000","last_became_peered":"2023-08-31T18:48:51.924458+0000","last_unstale":"2023-08-31T18:48:51.927921+0000","last_undegraded":"2023-08-31T18:48:51.927921+0000","last_fullsized":"2023-08-31T18:48:51.927921+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.906573+0000","last_change":"2023-08-31T18:48:51.461548+0000","last_active":"2023-08-31T18:48:51.906573+0000","last_peered":"2023-08-31T18:48:51.906573+0000","last_clean":"2023-08-31T18:48:51.906573+0000","last_became_active":"2023-08-31T18:48:51.461187+0000","last_became_peered":"2023-08-31T18:48:51.461187+0000","last_unstale":"2023-08-31T18:48:51.906573+0000","last_undegraded":"2023-08-31T18:48:51.906573+0000","last_fullsized":"2023-08-31T18:48:51.906573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.910855+0000","last_change":"2023-08-31T18:48:51.905611+0000","last_active":"2023-08-31T18:48:51.910855+0000","last_peered":"2023-08-31T18:48:51.910855+0000","last_clean":"2023-08-31T18:48:51.910855+0000","last_became_active":"2023-08-31T18:48:51.905343+0000","last_became_peered":"2023-08-31T18:48:51.905343+0000","last_unstale":"2023-08-31T18:48:51.910855+0000","last_undegraded":"2023-08-31T18:48:51.910855+0000","last_fullsized":"2023-08-31T18:48:51.910855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.908835+0000","last_change":"2023-08-31T18:48:51.466332+0000","last_active":"2023-08-31T18:48:51.908835+0000","last_peered":"2023-08-31T18:48:51.908835+0000","last_clean":"2023-08-31T18:48:51.908835+0000","last_became_active":"2023-08-31T18:48:51.465802+0000","last_became_peered":"2023-08-31T18:48:51.465802+0000","last_unstale":"2023-08-31T18:48:51.908835+0000","last_undegraded":"2023-08-31T18:48:51.908835+0000","last_fullsized":"2023-08-31T18:48:51.908835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.937376+0000","last_change":"2023-08-31T18:48:51.932397+0000","last_active":"2023-08-31T18:48:51.937376+0000","last_peered":"2023-08-31T18:48:51.937376+0000","last_clean":"2023-08-31T18:48:51.937376+0000","last_became_active":"2023-08-31T18:48:51.931887+0000","last_became_peered":"2023-08-31T18:48:51.931887+0000","last_unstale":"2023-08-31T18:48:51.937376+0000","last_undegraded":"2023-08-31T18:48:51.937376+0000","last_fullsized":"2023-08-31T18:48:51.937376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.905426+0000","last_change":"2023-08-31T18:48:51.453770+0000","last_active":"2023-08-31T18:48:51.905426+0000","last_peered":"2023-08-31T18:48:51.905426+0000","last_clean":"2023-08-31T18:48:51.905426+0000","last_became_active":"2023-08-31T18:48:51.453480+0000","last_became_peered":"2023-08-31T18:48:51.453480+0000","last_unstale":"2023-08-31T18:48:51.905426+0000","last_undegraded":"2023-08-31T18:48:51.905426+0000","last_fullsized":"2023-08-31T18:48:51.905426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.939540+0000","last_change":"2023-08-31T18:48:51.935795+0000","last_active":"2023-08-31T18:48:51.939540+0000","last_peered":"2023-08-31T18:48:51.939540+0000","last_clean":"2023-08-31T18:48:51.939540+0000","last_became_active":"2023-08-31T18:48:51.935427+0000","last_became_peered":"2023-08-31T18:48:51.935427+0000","last_unstale":"2023-08-31T18:48:51.939540+0000","last_undegraded":"2023-08-31T18:48:51.939540+0000","last_fullsized":"2023-08-31T18:48:51.939540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.911492+0000","last_change":"2023-08-31T18:48:51.461384+0000","last_active":"2023-08-31T18:48:51.911492+0000","last_peered":"2023-08-31T18:48:51.911492+0000","last_clean":"2023-08-31T18:48:51.911492+0000","last_became_active":"2023-08-31T18:48:51.461043+0000","last_became_peered":"2023-08-31T18:48:51.461043+0000","last_unstale":"2023-08-31T18:48:51.911492+0000","last_undegraded":"2023-08-31T18:48:51.911492+0000","last_fullsized":"2023-08-31T18:48:51.911492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.931276+0000","last_change":"2023-08-31T18:48:51.930572+0000","last_active":"2023-08-31T18:48:51.931276+0000","last_peered":"2023-08-31T18:48:51.931276+0000","last_clean":"2023-08-31T18:48:51.931276+0000","last_became_active":"2023-08-31T18:48:51.930346+0000","last_became_peered":"2023-08-31T18:48:51.930346+0000","last_unstale":"2023-08-31T18:48:51.931276+0000","last_undegraded":"2023-08-31T18:48:51.931276+0000","last_fullsized":"2023-08-31T18:48:51.931276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.939913+0000","last_change":"2023-08-31T18:48:51.457060+0000","last_active":"2023-08-31T18:48:51.939913+0000","last_peered":"2023-08-31T18:48:51.939913+0000","last_clean":"2023-08-31T18:48:51.939913+0000","last_became_active":"2023-08-31T18:48:51.456703+0000","last_became_peered":"2023-08-31T18:48:51.456703+0000","last_unstale":"2023-08-31T18:48:51.939913+0000","last_undegraded":"2023-08-31T18:48:51.939913+0000","last_fullsized":"2023-08-31T18:48:51.939913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.939476+0000","last_change":"2023-08-31T18:48:51.935264+0000","last_active":"2023-08-31T18:48:51.939476+0000","last_peered":"2023-08-31T18:48:51.939476+0000","last_clean":"2023-08-31T18:48:51.939476+0000","last_became_active":"2023-08-31T18:48:51.934950+0000","last_became_peered":"2023-08-31T18:48:51.934950+0000","last_unstale":"2023-08-31T18:48:51.939476+0000","last_undegraded":"2023-08-31T18:48:51.939476+0000","last_fullsized":"2023-08-31T18:48:51.939476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.914608+0000","last_change":"2023-08-31T18:48:51.454115+0000","last_active":"2023-08-31T18:48:51.914608+0000","last_peered":"2023-08-31T18:48:51.914608+0000","last_clean":"2023-08-31T18:48:51.914608+0000","last_became_active":"2023-08-31T18:48:51.453835+0000","last_became_peered":"2023-08-31T18:48:51.453835+0000","last_unstale":"2023-08-31T18:48:51.914608+0000","last_undegraded":"2023-08-31T18:48:51.914608+0000","last_fullsized":"2023-08-31T18:48:51.914608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.932093+0000","last_change":"2023-08-31T18:48:51.927819+0000","last_active":"2023-08-31T18:48:51.932093+0000","last_peered":"2023-08-31T18:48:51.932093+0000","last_clean":"2023-08-31T18:48:51.932093+0000","last_became_active":"2023-08-31T18:48:51.927265+0000","last_became_peered":"2023-08-31T18:48:51.927265+0000","last_unstale":"2023-08-31T18:48:51.932093+0000","last_undegraded":"2023-08-31T18:48:51.932093+0000","last_fullsized":"2023-08-31T18:48:51.932093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.903145+0000","last_change":"2023-08-31T18:48:51.456747+0000","last_active":"2023-08-31T18:48:51.903145+0000","last_peered":"2023-08-31T18:48:51.903145+0000","last_clean":"2023-08-31T18:48:51.903145+0000","last_became_active":"2023-08-31T18:48:51.455416+0000","last_became_peered":"2023-08-31T18:48:51.455416+0000","last_unstale":"2023-08-31T18:48:51.903145+0000","last_undegraded":"2023-08-31T18:48:51.903145+0000","last_fullsized":"2023-08-31T18:48:51.903145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.932126+0000","last_change":"2023-08-31T18:48:51.925170+0000","last_active":"2023-08-31T18:48:51.932126+0000","last_peered":"2023-08-31T18:48:51.932126+0000","last_clean":"2023-08-31T18:48:51.932126+0000","last_became_active":"2023-08-31T18:48:51.924878+0000","last_became_peered":"2023-08-31T18:48:51.924878+0000","last_unstale":"2023-08-31T18:48:51.932126+0000","last_undegraded":"2023-08-31T18:48:51.932126+0000","last_fullsized":"2023-08-31T18:48:51.932126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.917249+0000","last_change":"2023-08-31T18:48:51.464493+0000","last_active":"2023-08-31T18:48:51.917249+0000","last_peered":"2023-08-31T18:48:51.917249+0000","last_clean":"2023-08-31T18:48:51.917249+0000","last_became_active":"2023-08-31T18:48:51.464183+0000","last_became_peered":"2023-08-31T18:48:51.464183+0000","last_unstale":"2023-08-31T18:48:51.917249+0000","last_undegraded":"2023-08-31T18:48:51.917249+0000","last_fullsized":"2023-08-31T18:48:51.917249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934955+0000","last_change":"2023-08-31T18:48:51.929997+0000","last_active":"2023-08-31T18:48:51.934955+0000","last_peered":"2023-08-31T18:48:51.934955+0000","last_clean":"2023-08-31T18:48:51.934955+0000","last_became_active":"2023-08-31T18:48:51.929670+0000","last_became_peered":"2023-08-31T18:48:51.929670+0000","last_unstale":"2023-08-31T18:48:51.934955+0000","last_undegraded":"2023-08-31T18:48:51.934955+0000","last_fullsized":"2023-08-31T18:48:51.934955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.922448+0000","last_change":"2023-08-31T18:48:51.464671+0000","last_active":"2023-08-31T18:48:51.922448+0000","last_peered":"2023-08-31T18:48:51.922448+0000","last_clean":"2023-08-31T18:48:51.922448+0000","last_became_active":"2023-08-31T18:48:51.461835+0000","last_became_peered":"2023-08-31T18:48:51.461835+0000","last_unstale":"2023-08-31T18:48:51.922448+0000","last_undegraded":"2023-08-31T18:48:51.922448+0000","last_fullsized":"2023-08-31T18:48:51.922448+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.927360+0000","last_change":"2023-08-31T18:48:51.924912+0000","last_active":"2023-08-31T18:48:51.927360+0000","last_peered":"2023-08-31T18:48:51.927360+0000","last_clean":"2023-08-31T18:48:51.927360+0000","last_became_active":"2023-08-31T18:48:51.924539+0000","last_became_peered":"2023-08-31T18:48:51.924539+0000","last_unstale":"2023-08-31T18:48:51.927360+0000","last_undegraded":"2023-08-31T18:48:51.927360+0000","last_fullsized":"2023-08-31T18:48:51.927360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.906691+0000","last_change":"2023-08-31T18:48:51.463272+0000","last_active":"2023-08-31T18:48:51.906691+0000","last_peered":"2023-08-31T18:48:51.906691+0000","last_clean":"2023-08-31T18:48:51.906691+0000","last_became_active":"2023-08-31T18:48:51.460803+0000","last_became_peered":"2023-08-31T18:48:51.460803+0000","last_unstale":"2023-08-31T18:48:51.906691+0000","last_undegraded":"2023-08-31T18:48:51.906691+0000","last_fullsized":"2023-08-31T18:48:51.906691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.919897+0000","last_change":"2023-08-31T18:48:51.913477+0000","last_active":"2023-08-31T18:48:51.919897+0000","last_peered":"2023-08-31T18:48:51.919897+0000","last_clean":"2023-08-31T18:48:51.919897+0000","last_became_active":"2023-08-31T18:48:51.913223+0000","last_became_peered":"2023-08-31T18:48:51.913223+0000","last_unstale":"2023-08-31T18:48:51.919897+0000","last_undegraded":"2023-08-31T18:48:51.919897+0000","last_fullsized":"2023-08-31T18:48:51.919897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.903317+0000","last_change":"2023-08-31T18:48:51.460512+0000","last_active":"2023-08-31T18:48:51.903317+0000","last_peered":"2023-08-31T18:48:51.903317+0000","last_clean":"2023-08-31T18:48:51.903317+0000","last_became_active":"2023-08-31T18:48:51.460210+0000","last_became_peered":"2023-08-31T18:48:51.460210+0000","last_unstale":"2023-08-31T18:48:51.903317+0000","last_undegraded":"2023-08-31T18:48:51.903317+0000","last_fullsized":"2023-08-31T18:48:51.903317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.926965+0000","last_change":"2023-08-31T18:48:51.923770+0000","last_active":"2023-08-31T18:48:51.926965+0000","last_peered":"2023-08-31T18:48:51.926965+0000","last_clean":"2023-08-31T18:48:51.926965+0000","last_became_active":"2023-08-31T18:48:51.923091+0000","last_became_peered":"2023-08-31T18:48:51.923091+0000","last_unstale":"2023-08-31T18:48:51.926965+0000","last_undegraded":"2023-08-31T18:48:51.926965+0000","last_fullsized":"2023-08-31T18:48:51.926965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.918507+0000","last_change":"2023-08-31T18:48:51.452485+0000","last_active":"2023-08-31T18:48:51.918507+0000","last_peered":"2023-08-31T18:48:51.918507+0000","last_clean":"2023-08-31T18:48:51.918507+0000","last_became_active":"2023-08-31T18:48:51.452171+0000","last_became_peered":"2023-08-31T18:48:51.452171+0000","last_unstale":"2023-08-31T18:48:51.918507+0000","last_undegraded":"2023-08-31T18:48:51.918507+0000","last_fullsized":"2023-08-31T18:48:51.918507+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.935544+0000","last_change":"2023-08-31T18:48:51.930776+0000","last_active":"2023-08-31T18:48:51.935544+0000","last_peered":"2023-08-31T18:48:51.935544+0000","last_clean":"2023-08-31T18:48:51.935544+0000","last_became_active":"2023-08-31T18:48:51.930482+0000","last_became_peered":"2023-08-31T18:48:51.930482+0000","last_unstale":"2023-08-31T18:48:51.935544+0000","last_undegraded":"2023-08-31T18:48:51.935544+0000","last_fullsized":"2023-08-31T18:48:51.935544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.901427+0000","last_change":"2023-08-31T18:48:51.465199+0000","last_active":"2023-08-31T18:48:51.901427+0000","last_peered":"2023-08-31T18:48:51.901427+0000","last_clean":"2023-08-31T18:48:51.901427+0000","last_became_active":"2023-08-31T18:48:51.464923+0000","last_became_peered":"2023-08-31T18:48:51.464923+0000","last_unstale":"2023-08-31T18:48:51.901427+0000","last_undegraded":"2023-08-31T18:48:51.901427+0000","last_fullsized":"2023-08-31T18:48:51.901427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.919943+0000","last_change":"2023-08-31T18:48:51.915195+0000","last_active":"2023-08-31T18:48:51.919943+0000","last_peered":"2023-08-31T18:48:51.919943+0000","last_clean":"2023-08-31T18:48:51.919943+0000","last_became_active":"2023-08-31T18:48:51.914647+0000","last_became_peered":"2023-08-31T18:48:51.914647+0000","last_unstale":"2023-08-31T18:48:51.919943+0000","last_undegraded":"2023-08-31T18:48:51.919943+0000","last_fullsized":"2023-08-31T18:48:51.919943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.922412+0000","last_change":"2023-08-31T18:48:51.464518+0000","last_active":"2023-08-31T18:48:51.922412+0000","last_peered":"2023-08-31T18:48:51.922412+0000","last_clean":"2023-08-31T18:48:51.922412+0000","last_became_active":"2023-08-31T18:48:51.463756+0000","last_became_peered":"2023-08-31T18:48:51.463756+0000","last_unstale":"2023-08-31T18:48:51.922412+0000","last_undegraded":"2023-08-31T18:48:51.922412+0000","last_fullsized":"2023-08-31T18:48:51.922412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934751+0000","last_change":"2023-08-31T18:48:51.921242+0000","last_active":"2023-08-31T18:48:51.934751+0000","last_peered":"2023-08-31T18:48:51.934751+0000","last_clean":"2023-08-31T18:48:51.934751+0000","last_became_active":"2023-08-31T18:48:51.920896+0000","last_became_peered":"2023-08-31T18:48:51.920896+0000","last_unstale":"2023-08-31T18:48:51.934751+0000","last_undegraded":"2023-08-31T18:48:51.934751+0000","last_fullsized":"2023-08-31T18:48:51.934751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907703+0000","last_change":"2023-08-31T18:48:51.468437+0000","last_active":"2023-08-31T18:48:51.907703+0000","last_peered":"2023-08-31T18:48:51.907703+0000","last_clean":"2023-08-31T18:48:51.907703+0000","last_became_active":"2023-08-31T18:48:51.468137+0000","last_became_peered":"2023-08-31T18:48:51.468137+0000","last_unstale":"2023-08-31T18:48:51.907703+0000","last_undegraded":"2023-08-31T18:48:51.907703+0000","last_fullsized":"2023-08-31T18:48:51.907703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.922429+0000","last_change":"2023-08-31T18:48:51.917968+0000","last_active":"2023-08-31T18:48:51.922429+0000","last_peered":"2023-08-31T18:48:51.922429+0000","last_clean":"2023-08-31T18:48:51.922429+0000","last_became_active":"2023-08-31T18:48:51.917615+0000","last_became_peered":"2023-08-31T18:48:51.917615+0000","last_unstale":"2023-08-31T18:48:51.922429+0000","last_undegraded":"2023-08-31T18:48:51.922429+0000","last_fullsized":"2023-08-31T18:48:51.922429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.897675+0000","last_change":"2023-08-31T18:48:51.464778+0000","last_active":"2023-08-31T18:48:51.897675+0000","last_peered":"2023-08-31T18:48:51.897675+0000","last_clean":"2023-08-31T18:48:51.897675+0000","last_became_active":"2023-08-31T18:48:51.464505+0000","last_became_peered":"2023-08-31T18:48:51.464505+0000","last_unstale":"2023-08-31T18:48:51.897675+0000","last_undegraded":"2023-08-31T18:48:51.897675+0000","last_fullsized":"2023-08-31T18:48:51.897675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.931875+0000","last_change":"2023-08-31T18:48:51.927083+0000","last_active":"2023-08-31T18:48:51.931875+0000","last_peered":"2023-08-31T18:48:51.931875+0000","last_clean":"2023-08-31T18:48:51.931875+0000","last_became_active":"2023-08-31T18:48:51.926756+0000","last_became_peered":"2023-08-31T18:48:51.926756+0000","last_unstale":"2023-08-31T18:48:51.931875+0000","last_undegraded":"2023-08-31T18:48:51.931875+0000","last_fullsized":"2023-08-31T18:48:51.931875+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.917655+0000","last_change":"2023-08-31T18:48:51.452220+0000","last_active":"2023-08-31T18:48:51.917655+0000","last_peered":"2023-08-31T18:48:51.917655+0000","last_clean":"2023-08-31T18:48:51.917655+0000","last_became_active":"2023-08-31T18:48:51.451874+0000","last_became_peered":"2023-08-31T18:48:51.451874+0000","last_unstale":"2023-08-31T18:48:51.917655+0000","last_undegraded":"2023-08-31T18:48:51.917655+0000","last_fullsized":"2023-08-31T18:48:51.917655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.935002+0000","last_change":"2023-08-31T18:48:51.929957+0000","last_active":"2023-08-31T18:48:51.935002+0000","last_peered":"2023-08-31T18:48:51.935002+0000","last_clean":"2023-08-31T18:48:51.935002+0000","last_became_active":"2023-08-31T18:48:51.929600+0000","last_became_peered":"2023-08-31T18:48:51.929600+0000","last_unstale":"2023-08-31T18:48:51.935002+0000","last_undegraded":"2023-08-31T18:48:51.935002+0000","last_fullsized":"2023-08-31T18:48:51.935002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.905878+0000","last_change":"2023-08-31T18:48:51.466576+0000","last_active":"2023-08-31T18:48:51.905878+0000","last_peered":"2023-08-31T18:48:51.905878+0000","last_clean":"2023-08-31T18:48:51.905878+0000","last_became_active":"2023-08-31T18:48:51.466252+0000","last_became_peered":"2023-08-31T18:48:51.466252+0000","last_unstale":"2023-08-31T18:48:51.905878+0000","last_undegraded":"2023-08-31T18:48:51.905878+0000","last_fullsized":"2023-08-31T18:48:51.905878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.925188+0000","last_change":"2023-08-31T18:48:51.913650+0000","last_active":"2023-08-31T18:48:51.925188+0000","last_peered":"2023-08-31T18:48:51.925188+0000","last_clean":"2023-08-31T18:48:51.925188+0000","last_became_active":"2023-08-31T18:48:51.912270+0000","last_became_peered":"2023-08-31T18:48:51.912270+0000","last_unstale":"2023-08-31T18:48:51.925188+0000","last_undegraded":"2023-08-31T18:48:51.925188+0000","last_fullsized":"2023-08-31T18:48:51.925188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.26","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-31T18:48:53.190918+0000","last_change":"2023-08-31T18:48:51.468624+0000","last_active":"2023-08-31T18:48:53.190918+0000","last_peered":"2023-08-31T18:48:53.190918+0000","last_clean":"2023-08-31T18:48:53.190918+0000","last_became_active":"2023-08-31T18:48:51.468356+0000","last_became_peered":"2023-08-31T18:48:51.468356+0000","last_unstale":"2023-08-31T18:48:53.190918+0000","last_undegraded":"2023-08-31T18:48:53.190918+0000","last_fullsized":"2023-08-31T18:48:53.190918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.936328+0000","last_change":"2023-08-31T18:48:51.933396+0000","last_active":"2023-08-31T18:48:51.936328+0000","last_peered":"2023-08-31T18:48:51.936328+0000","last_clean":"2023-08-31T18:48:51.936328+0000","last_became_active":"2023-08-31T18:48:51.933082+0000","last_became_peered":"2023-08-31T18:48:51.933082+0000","last_unstale":"2023-08-31T18:48:51.936328+0000","last_undegraded":"2023-08-31T18:48:51.936328+0000","last_fullsized":"2023-08-31T18:48:51.936328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907160+0000","last_change":"2023-08-31T18:48:51.463464+0000","last_active":"2023-08-31T18:48:51.907160+0000","last_peered":"2023-08-31T18:48:51.907160+0000","last_clean":"2023-08-31T18:48:51.907160+0000","last_became_active":"2023-08-31T18:48:51.463067+0000","last_became_peered":"2023-08-31T18:48:51.463067+0000","last_unstale":"2023-08-31T18:48:51.907160+0000","last_undegraded":"2023-08-31T18:48:51.907160+0000","last_fullsized":"2023-08-31T18:48:51.907160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.924159+0000","last_change":"2023-08-31T18:48:51.911306+0000","last_active":"2023-08-31T18:48:51.924159+0000","last_peered":"2023-08-31T18:48:51.924159+0000","last_clean":"2023-08-31T18:48:51.924159+0000","last_became_active":"2023-08-31T18:48:51.911065+0000","last_became_peered":"2023-08-31T18:48:51.911065+0000","last_unstale":"2023-08-31T18:48:51.924159+0000","last_undegraded":"2023-08-31T18:48:51.924159+0000","last_fullsized":"2023-08-31T18:48:51.924159+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.918417+0000","last_change":"2023-08-31T18:48:51.457502+0000","last_active":"2023-08-31T18:48:51.918417+0000","last_peered":"2023-08-31T18:48:51.918417+0000","last_clean":"2023-08-31T18:48:51.918417+0000","last_became_active":"2023-08-31T18:48:51.457250+0000","last_became_peered":"2023-08-31T18:48:51.457250+0000","last_unstale":"2023-08-31T18:48:51.918417+0000","last_undegraded":"2023-08-31T18:48:51.918417+0000","last_fullsized":"2023-08-31T18:48:51.918417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.917294+0000","last_change":"2023-08-31T18:48:51.912564+0000","last_active":"2023-08-31T18:48:51.917294+0000","last_peered":"2023-08-31T18:48:51.917294+0000","last_clean":"2023-08-31T18:48:51.917294+0000","last_became_active":"2023-08-31T18:48:51.912298+0000","last_became_peered":"2023-08-31T18:48:51.912298+0000","last_unstale":"2023-08-31T18:48:51.917294+0000","last_undegraded":"2023-08-31T18:48:51.917294+0000","last_fullsized":"2023-08-31T18:48:51.917294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.908429+0000","last_change":"2023-08-31T18:48:51.464556+0000","last_active":"2023-08-31T18:48:51.908429+0000","last_peered":"2023-08-31T18:48:51.908429+0000","last_clean":"2023-08-31T18:48:51.908429+0000","last_became_active":"2023-08-31T18:48:51.464122+0000","last_became_peered":"2023-08-31T18:48:51.464122+0000","last_unstale":"2023-08-31T18:48:51.908429+0000","last_undegraded":"2023-08-31T18:48:51.908429+0000","last_fullsized":"2023-08-31T18:48:51.908429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.921658+0000","last_change":"2023-08-31T18:48:51.916228+0000","last_active":"2023-08-31T18:48:51.921658+0000","last_peered":"2023-08-31T18:48:51.921658+0000","last_clean":"2023-08-31T18:48:51.921658+0000","last_became_active":"2023-08-31T18:48:51.915878+0000","last_became_peered":"2023-08-31T18:48:51.915878+0000","last_unstale":"2023-08-31T18:48:51.921658+0000","last_undegraded":"2023-08-31T18:48:51.921658+0000","last_fullsized":"2023-08-31T18:48:51.921658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907984+0000","last_change":"2023-08-31T18:48:51.466671+0000","last_active":"2023-08-31T18:48:51.907984+0000","last_peered":"2023-08-31T18:48:51.907984+0000","last_clean":"2023-08-31T18:48:51.907984+0000","last_became_active":"2023-08-31T18:48:51.466134+0000","last_became_peered":"2023-08-31T18:48:51.466134+0000","last_unstale":"2023-08-31T18:48:51.907984+0000","last_undegraded":"2023-08-31T18:48:51.907984+0000","last_fullsized":"2023-08-31T18:48:51.907984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.924490+0000","last_change":"2023-08-31T18:48:51.913214+0000","last_active":"2023-08-31T18:48:51.924490+0000","last_peered":"2023-08-31T18:48:51.924490+0000","last_clean":"2023-08-31T18:48:51.924490+0000","last_became_active":"2023-08-31T18:48:51.912858+0000","last_became_peered":"2023-08-31T18:48:51.912858+0000","last_unstale":"2023-08-31T18:48:51.924490+0000","last_undegraded":"2023-08-31T18:48:51.924490+0000","last_fullsized":"2023-08-31T18:48:51.924490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.903111+0000","last_change":"2023-08-31T18:48:51.455481+0000","last_active":"2023-08-31T18:48:51.903111+0000","last_peered":"2023-08-31T18:48:51.903111+0000","last_clean":"2023-08-31T18:48:51.903111+0000","last_became_active":"2023-08-31T18:48:51.453382+0000","last_became_peered":"2023-08-31T18:48:51.453382+0000","last_unstale":"2023-08-31T18:48:51.903111+0000","last_undegraded":"2023-08-31T18:48:51.903111+0000","last_fullsized":"2023-08-31T18:48:51.903111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.925895+0000","last_change":"2023-08-31T18:48:51.921422+0000","last_active":"2023-08-31T18:48:51.925895+0000","last_peered":"2023-08-31T18:48:51.925895+0000","last_clean":"2023-08-31T18:48:51.925895+0000","last_became_active":"2023-08-31T18:48:51.921120+0000","last_became_peered":"2023-08-31T18:48:51.921120+0000","last_unstale":"2023-08-31T18:48:51.925895+0000","last_undegraded":"2023-08-31T18:48:51.925895+0000","last_fullsized":"2023-08-31T18:48:51.925895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907075+0000","last_change":"2023-08-31T18:48:51.463991+0000","last_active":"2023-08-31T18:48:51.907075+0000","last_peered":"2023-08-31T18:48:51.907075+0000","last_clean":"2023-08-31T18:48:51.907075+0000","last_became_active":"2023-08-31T18:48:51.463671+0000","last_became_peered":"2023-08-31T18:48:51.463671+0000","last_unstale":"2023-08-31T18:48:51.907075+0000","last_undegraded":"2023-08-31T18:48:51.907075+0000","last_fullsized":"2023-08-31T18:48:51.907075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.935846+0000","last_change":"2023-08-31T18:48:51.930811+0000","last_active":"2023-08-31T18:48:51.935846+0000","last_peered":"2023-08-31T18:48:51.935846+0000","last_clean":"2023-08-31T18:48:51.935846+0000","last_became_active":"2023-08-31T18:48:51.930521+0000","last_became_peered":"2023-08-31T18:48:51.930521+0000","last_unstale":"2023-08-31T18:48:51.935846+0000","last_undegraded":"2023-08-31T18:48:51.935846+0000","last_fullsized":"2023-08-31T18:48:51.935846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.925487+0000","last_change":"2023-08-31T18:48:51.463273+0000","last_active":"2023-08-31T18:48:51.925487+0000","last_peered":"2023-08-31T18:48:51.925487+0000","last_clean":"2023-08-31T18:48:51.925487+0000","last_became_active":"2023-08-31T18:48:51.462921+0000","last_became_peered":"2023-08-31T18:48:51.462921+0000","last_unstale":"2023-08-31T18:48:51.925487+0000","last_undegraded":"2023-08-31T18:48:51.925487+0000","last_fullsized":"2023-08-31T18:48:51.925487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.936321+0000","last_change":"2023-08-31T18:48:51.933239+0000","last_active":"2023-08-31T18:48:51.936321+0000","last_peered":"2023-08-31T18:48:51.936321+0000","last_clean":"2023-08-31T18:48:51.936321+0000","last_became_active":"2023-08-31T18:48:51.932810+0000","last_became_peered":"2023-08-31T18:48:51.932810+0000","last_unstale":"2023-08-31T18:48:51.936321+0000","last_undegraded":"2023-08-31T18:48:51.936321+0000","last_fullsized":"2023-08-31T18:48:51.936321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.919825+0000","last_change":"2023-08-31T18:48:51.468350+0000","last_active":"2023-08-31T18:48:51.919825+0000","last_peered":"2023-08-31T18:48:51.919825+0000","last_clean":"2023-08-31T18:48:51.919825+0000","last_became_active":"2023-08-31T18:48:51.468077+0000","last_became_peered":"2023-08-31T18:48:51.468077+0000","last_unstale":"2023-08-31T18:48:51.919825+0000","last_undegraded":"2023-08-31T18:48:51.919825+0000","last_fullsized":"2023-08-31T18:48:51.919825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.932515+0000","last_change":"2023-08-31T18:48:51.926115+0000","last_active":"2023-08-31T18:48:51.932515+0000","last_peered":"2023-08-31T18:48:51.932515+0000","last_clean":"2023-08-31T18:48:51.932515+0000","last_became_active":"2023-08-31T18:48:51.925831+0000","last_became_peered":"2023-08-31T18:48:51.925831+0000","last_unstale":"2023-08-31T18:48:51.932515+0000","last_undegraded":"2023-08-31T18:48:51.932515+0000","last_fullsized":"2023-08-31T18:48:51.932515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.923825+0000","last_change":"2023-08-31T18:48:51.463945+0000","last_active":"2023-08-31T18:48:51.923825+0000","last_peered":"2023-08-31T18:48:51.923825+0000","last_clean":"2023-08-31T18:48:51.923825+0000","last_became_active":"2023-08-31T18:48:51.463687+0000","last_became_peered":"2023-08-31T18:48:51.463687+0000","last_unstale":"2023-08-31T18:48:51.923825+0000","last_undegraded":"2023-08-31T18:48:51.923825+0000","last_fullsized":"2023-08-31T18:48:51.923825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.929975+0000","last_change":"2023-08-31T18:48:51.923054+0000","last_active":"2023-08-31T18:48:51.929975+0000","last_peered":"2023-08-31T18:48:51.929975+0000","last_clean":"2023-08-31T18:48:51.929975+0000","last_became_active":"2023-08-31T18:48:51.922765+0000","last_became_peered":"2023-08-31T18:48:51.922765+0000","last_unstale":"2023-08-31T18:48:51.929975+0000","last_undegraded":"2023-08-31T18:48:51.929975+0000","last_fullsized":"2023-08-31T18:48:51.929975+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.910047+0000","last_change":"2023-08-31T18:48:51.468804+0000","last_active":"2023-08-31T18:48:51.910047+0000","last_peered":"2023-08-31T18:48:51.910047+0000","last_clean":"2023-08-31T18:48:51.910047+0000","last_became_active":"2023-08-31T18:48:51.468526+0000","last_became_peered":"2023-08-31T18:48:51.468526+0000","last_unstale":"2023-08-31T18:48:51.910047+0000","last_undegraded":"2023-08-31T18:48:51.910047+0000","last_fullsized":"2023-08-31T18:48:51.910047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.913946+0000","last_change":"2023-08-31T18:48:51.909561+0000","last_active":"2023-08-31T18:48:51.913946+0000","last_peered":"2023-08-31T18:48:51.913946+0000","last_clean":"2023-08-31T18:48:51.913946+0000","last_became_active":"2023-08-31T18:48:51.909240+0000","last_became_peered":"2023-08-31T18:48:51.909240+0000","last_unstale":"2023-08-31T18:48:51.913946+0000","last_undegraded":"2023-08-31T18:48:51.913946+0000","last_fullsized":"2023-08-31T18:48:51.913946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.917593+0000","last_change":"2023-08-31T18:48:51.457270+0000","last_active":"2023-08-31T18:48:51.917593+0000","last_peered":"2023-08-31T18:48:51.917593+0000","last_clean":"2023-08-31T18:48:51.917593+0000","last_became_active":"2023-08-31T18:48:51.457021+0000","last_became_peered":"2023-08-31T18:48:51.457021+0000","last_unstale":"2023-08-31T18:48:51.917593+0000","last_undegraded":"2023-08-31T18:48:51.917593+0000","last_fullsized":"2023-08-31T18:48:51.917593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.932074+0000","last_change":"2023-08-31T18:48:51.927646+0000","last_active":"2023-08-31T18:48:51.932074+0000","last_peered":"2023-08-31T18:48:51.932074+0000","last_clean":"2023-08-31T18:48:51.932074+0000","last_became_active":"2023-08-31T18:48:51.926932+0000","last_became_peered":"2023-08-31T18:48:51.926932+0000","last_unstale":"2023-08-31T18:48:51.932074+0000","last_undegraded":"2023-08-31T18:48:51.932074+0000","last_fullsized":"2023-08-31T18:48:51.932074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907861+0000","last_change":"2023-08-31T18:48:51.466463+0000","last_active":"2023-08-31T18:48:51.907861+0000","last_peered":"2023-08-31T18:48:51.907861+0000","last_clean":"2023-08-31T18:48:51.907861+0000","last_became_active":"2023-08-31T18:48:51.465707+0000","last_became_peered":"2023-08-31T18:48:51.465707+0000","last_unstale":"2023-08-31T18:48:51.907861+0000","last_undegraded":"2023-08-31T18:48:51.907861+0000","last_fullsized":"2023-08-31T18:48:51.907861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934903+0000","last_change":"2023-08-31T18:48:51.932243+0000","last_active":"2023-08-31T18:48:51.934903+0000","last_peered":"2023-08-31T18:48:51.934903+0000","last_clean":"2023-08-31T18:48:51.934903+0000","last_became_active":"2023-08-31T18:48:51.931912+0000","last_became_peered":"2023-08-31T18:48:51.931912+0000","last_unstale":"2023-08-31T18:48:51.934903+0000","last_undegraded":"2023-08-31T18:48:51.934903+0000","last_fullsized":"2023-08-31T18:48:51.934903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.906069+0000","last_change":"2023-08-31T18:48:51.465042+0000","last_active":"2023-08-31T18:48:51.906069+0000","last_peered":"2023-08-31T18:48:51.906069+0000","last_clean":"2023-08-31T18:48:51.906069+0000","last_became_active":"2023-08-31T18:48:51.464770+0000","last_became_peered":"2023-08-31T18:48:51.464770+0000","last_unstale":"2023-08-31T18:48:51.906069+0000","last_undegraded":"2023-08-31T18:48:51.906069+0000","last_fullsized":"2023-08-31T18:48:51.906069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.927978+0000","last_change":"2023-08-31T18:48:51.922213+0000","last_active":"2023-08-31T18:48:51.927978+0000","last_peered":"2023-08-31T18:48:51.927978+0000","last_clean":"2023-08-31T18:48:51.927978+0000","last_became_active":"2023-08-31T18:48:51.921927+0000","last_became_peered":"2023-08-31T18:48:51.921927+0000","last_unstale":"2023-08-31T18:48:51.927978+0000","last_undegraded":"2023-08-31T18:48:51.927978+0000","last_fullsized":"2023-08-31T18:48:51.927978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.905663+0000","last_change":"2023-08-31T18:48:51.460471+0000","last_active":"2023-08-31T18:48:51.905663+0000","last_peered":"2023-08-31T18:48:51.905663+0000","last_clean":"2023-08-31T18:48:51.905663+0000","last_became_active":"2023-08-31T18:48:51.460189+0000","last_became_peered":"2023-08-31T18:48:51.460189+0000","last_unstale":"2023-08-31T18:48:51.905663+0000","last_undegraded":"2023-08-31T18:48:51.905663+0000","last_fullsized":"2023-08-31T18:48:51.905663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.927900+0000","last_change":"2023-08-31T18:48:51.924675+0000","last_active":"2023-08-31T18:48:51.927900+0000","last_peered":"2023-08-31T18:48:51.927900+0000","last_clean":"2023-08-31T18:48:51.927900+0000","last_became_active":"2023-08-31T18:48:51.924316+0000","last_became_peered":"2023-08-31T18:48:51.924316+0000","last_unstale":"2023-08-31T18:48:51.927900+0000","last_undegraded":"2023-08-31T18:48:51.927900+0000","last_fullsized":"2023-08-31T18:48:51.927900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.903549+0000","last_change":"2023-08-31T18:48:51.453010+0000","last_active":"2023-08-31T18:48:51.903549+0000","last_peered":"2023-08-31T18:48:51.903549+0000","last_clean":"2023-08-31T18:48:51.903549+0000","last_became_active":"2023-08-31T18:48:51.452744+0000","last_became_peered":"2023-08-31T18:48:51.452744+0000","last_unstale":"2023-08-31T18:48:51.903549+0000","last_undegraded":"2023-08-31T18:48:51.903549+0000","last_fullsized":"2023-08-31T18:48:51.903549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934662+0000","last_change":"2023-08-31T18:48:51.926704+0000","last_active":"2023-08-31T18:48:51.934662+0000","last_peered":"2023-08-31T18:48:51.934662+0000","last_clean":"2023-08-31T18:48:51.934662+0000","last_became_active":"2023-08-31T18:48:51.926041+0000","last_became_peered":"2023-08-31T18:48:51.926041+0000","last_unstale":"2023-08-31T18:48:51.934662+0000","last_undegraded":"2023-08-31T18:48:51.934662+0000","last_fullsized":"2023-08-31T18:48:51.934662+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.918308+0000","last_change":"2023-08-31T18:48:51.459998+0000","last_active":"2023-08-31T18:48:51.918308+0000","last_peered":"2023-08-31T18:48:51.918308+0000","last_clean":"2023-08-31T18:48:51.918308+0000","last_became_active":"2023-08-31T18:48:51.459693+0000","last_became_peered":"2023-08-31T18:48:51.459693+0000","last_unstale":"2023-08-31T18:48:51.918308+0000","last_undegraded":"2023-08-31T18:48:51.918308+0000","last_fullsized":"2023-08-31T18:48:51.918308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.923283+0000","last_change":"2023-08-31T18:48:51.918075+0000","last_active":"2023-08-31T18:48:51.923283+0000","last_peered":"2023-08-31T18:48:51.923283+0000","last_clean":"2023-08-31T18:48:51.923283+0000","last_became_active":"2023-08-31T18:48:51.917780+0000","last_became_peered":"2023-08-31T18:48:51.917780+0000","last_unstale":"2023-08-31T18:48:51.923283+0000","last_undegraded":"2023-08-31T18:48:51.923283+0000","last_fullsized":"2023-08-31T18:48:51.923283+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.936900+0000","last_change":"2023-08-31T18:48:51.458951+0000","last_active":"2023-08-31T18:48:51.936900+0000","last_peered":"2023-08-31T18:48:51.936900+0000","last_clean":"2023-08-31T18:48:51.936900+0000","last_became_active":"2023-08-31T18:48:51.458339+0000","last_became_peered":"2023-08-31T18:48:51.458339+0000","last_unstale":"2023-08-31T18:48:51.936900+0000","last_undegraded":"2023-08-31T18:48:51.936900+0000","last_fullsized":"2023-08-31T18:48:51.936900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.931395+0000","last_change":"2023-08-31T18:48:51.924957+0000","last_active":"2023-08-31T18:48:51.931395+0000","last_peered":"2023-08-31T18:48:51.931395+0000","last_clean":"2023-08-31T18:48:51.931395+0000","last_became_active":"2023-08-31T18:48:51.924596+0000","last_became_peered":"2023-08-31T18:48:51.924596+0000","last_unstale":"2023-08-31T18:48:51.931395+0000","last_undegraded":"2023-08-31T18:48:51.931395+0000","last_fullsized":"2023-08-31T18:48:51.931395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.922087+0000","last_change":"2023-08-31T18:48:51.466127+0000","last_active":"2023-08-31T18:48:51.922087+0000","last_peered":"2023-08-31T18:48:51.922087+0000","last_clean":"2023-08-31T18:48:51.922087+0000","last_became_active":"2023-08-31T18:48:51.465815+0000","last_became_peered":"2023-08-31T18:48:51.465815+0000","last_unstale":"2023-08-31T18:48:51.922087+0000","last_undegraded":"2023-08-31T18:48:51.922087+0000","last_fullsized":"2023-08-31T18:48:51.922087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.935584+0000","last_change":"2023-08-31T18:48:51.931596+0000","last_active":"2023-08-31T18:48:51.935584+0000","last_peered":"2023-08-31T18:48:51.935584+0000","last_clean":"2023-08-31T18:48:51.935584+0000","last_became_active":"2023-08-31T18:48:51.931328+0000","last_became_peered":"2023-08-31T18:48:51.931328+0000","last_unstale":"2023-08-31T18:48:51.935584+0000","last_undegraded":"2023-08-31T18:48:51.935584+0000","last_fullsized":"2023-08-31T18:48:51.935584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.916981+0000","last_change":"2023-08-31T18:48:51.459271+0000","last_active":"2023-08-31T18:48:51.916981+0000","last_peered":"2023-08-31T18:48:51.916981+0000","last_clean":"2023-08-31T18:48:51.916981+0000","last_became_active":"2023-08-31T18:48:51.458994+0000","last_became_peered":"2023-08-31T18:48:51.458994+0000","last_unstale":"2023-08-31T18:48:51.916981+0000","last_undegraded":"2023-08-31T18:48:51.916981+0000","last_fullsized":"2023-08-31T18:48:51.916981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.922979+0000","last_change":"2023-08-31T18:48:51.917094+0000","last_active":"2023-08-31T18:48:51.922979+0000","last_peered":"2023-08-31T18:48:51.922979+0000","last_clean":"2023-08-31T18:48:51.922979+0000","last_became_active":"2023-08-31T18:48:51.916805+0000","last_became_peered":"2023-08-31T18:48:51.916805+0000","last_unstale":"2023-08-31T18:48:51.922979+0000","last_undegraded":"2023-08-31T18:48:51.922979+0000","last_fullsized":"2023-08-31T18:48:51.922979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.904203+0000","last_change":"2023-08-31T18:48:51.463406+0000","last_active":"2023-08-31T18:48:51.904203+0000","last_peered":"2023-08-31T18:48:51.904203+0000","last_clean":"2023-08-31T18:48:51.904203+0000","last_became_active":"2023-08-31T18:48:51.463123+0000","last_became_peered":"2023-08-31T18:48:51.463123+0000","last_unstale":"2023-08-31T18:48:51.904203+0000","last_undegraded":"2023-08-31T18:48:51.904203+0000","last_fullsized":"2023-08-31T18:48:51.904203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934555+0000","last_change":"2023-08-31T18:48:51.922348+0000","last_active":"2023-08-31T18:48:51.934555+0000","last_peered":"2023-08-31T18:48:51.934555+0000","last_clean":"2023-08-31T18:48:51.934555+0000","last_became_active":"2023-08-31T18:48:51.922029+0000","last_became_peered":"2023-08-31T18:48:51.922029+0000","last_unstale":"2023-08-31T18:48:51.934555+0000","last_undegraded":"2023-08-31T18:48:51.934555+0000","last_fullsized":"2023-08-31T18:48:51.934555+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.902996+0000","last_change":"2023-08-31T18:48:51.463743+0000","last_active":"2023-08-31T18:48:51.902996+0000","last_peered":"2023-08-31T18:48:51.902996+0000","last_clean":"2023-08-31T18:48:51.902996+0000","last_became_active":"2023-08-31T18:48:51.463418+0000","last_became_peered":"2023-08-31T18:48:51.463418+0000","last_unstale":"2023-08-31T18:48:51.902996+0000","last_undegraded":"2023-08-31T18:48:51.902996+0000","last_fullsized":"2023-08-31T18:48:51.902996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.918988+0000","last_change":"2023-08-31T18:48:51.913311+0000","last_active":"2023-08-31T18:48:51.918988+0000","last_peered":"2023-08-31T18:48:51.918988+0000","last_clean":"2023-08-31T18:48:51.918988+0000","last_became_active":"2023-08-31T18:48:51.912772+0000","last_became_peered":"2023-08-31T18:48:51.912772+0000","last_unstale":"2023-08-31T18:48:51.918988+0000","last_undegraded":"2023-08-31T18:48:51.918988+0000","last_fullsized":"2023-08-31T18:48:51.918988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.927067+0000","last_change":"2023-08-31T18:48:51.467642+0000","last_active":"2023-08-31T18:48:51.927067+0000","last_peered":"2023-08-31T18:48:51.927067+0000","last_clean":"2023-08-31T18:48:51.927067+0000","last_became_active":"2023-08-31T18:48:51.467337+0000","last_became_peered":"2023-08-31T18:48:51.467337+0000","last_unstale":"2023-08-31T18:48:51.927067+0000","last_undegraded":"2023-08-31T18:48:51.927067+0000","last_fullsized":"2023-08-31T18:48:51.927067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.930064+0000","last_change":"2023-08-31T18:48:51.924308+0000","last_active":"2023-08-31T18:48:51.930064+0000","last_peered":"2023-08-31T18:48:51.930064+0000","last_clean":"2023-08-31T18:48:51.930064+0000","last_became_active":"2023-08-31T18:48:51.924001+0000","last_became_peered":"2023-08-31T18:48:51.924001+0000","last_unstale":"2023-08-31T18:48:51.930064+0000","last_undegraded":"2023-08-31T18:48:51.930064+0000","last_fullsized":"2023-08-31T18:48:51.930064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.937598+0000","last_change":"2023-08-31T18:48:51.470995+0000","last_active":"2023-08-31T18:48:51.937598+0000","last_peered":"2023-08-31T18:48:51.937598+0000","last_clean":"2023-08-31T18:48:51.937598+0000","last_became_active":"2023-08-31T18:48:51.470680+0000","last_became_peered":"2023-08-31T18:48:51.470680+0000","last_unstale":"2023-08-31T18:48:51.937598+0000","last_undegraded":"2023-08-31T18:48:51.937598+0000","last_fullsized":"2023-08-31T18:48:51.937598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934923+0000","last_change":"2023-08-31T18:48:51.930597+0000","last_active":"2023-08-31T18:48:51.934923+0000","last_peered":"2023-08-31T18:48:51.934923+0000","last_clean":"2023-08-31T18:48:51.934923+0000","last_became_active":"2023-08-31T18:48:51.930279+0000","last_became_peered":"2023-08-31T18:48:51.930279+0000","last_unstale":"2023-08-31T18:48:51.934923+0000","last_undegraded":"2023-08-31T18:48:51.934923+0000","last_fullsized":"2023-08-31T18:48:51.934923+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.937697+0000","last_change":"2023-08-31T18:48:51.461613+0000","last_active":"2023-08-31T18:48:51.937697+0000","last_peered":"2023-08-31T18:48:51.937697+0000","last_clean":"2023-08-31T18:48:51.937697+0000","last_became_active":"2023-08-31T18:48:51.461230+0000","last_became_peered":"2023-08-31T18:48:51.461230+0000","last_unstale":"2023-08-31T18:48:51.937697+0000","last_undegraded":"2023-08-31T18:48:51.937697+0000","last_fullsized":"2023-08-31T18:48:51.937697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.930903+0000","last_change":"2023-08-31T18:48:51.922772+0000","last_active":"2023-08-31T18:48:51.930903+0000","last_peered":"2023-08-31T18:48:51.930903+0000","last_clean":"2023-08-31T18:48:51.930903+0000","last_became_active":"2023-08-31T18:48:51.922506+0000","last_became_peered":"2023-08-31T18:48:51.922506+0000","last_unstale":"2023-08-31T18:48:51.930903+0000","last_undegraded":"2023-08-31T18:48:51.930903+0000","last_fullsized":"2023-08-31T18:48:51.930903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.900177+0000","last_change":"2023-08-31T18:48:51.462993+0000","last_active":"2023-08-31T18:48:51.900177+0000","last_peered":"2023-08-31T18:48:51.900177+0000","last_clean":"2023-08-31T18:48:51.900177+0000","last_became_active":"2023-08-31T18:48:51.462705+0000","last_became_peered":"2023-08-31T18:48:51.462705+0000","last_unstale":"2023-08-31T18:48:51.900177+0000","last_undegraded":"2023-08-31T18:48:51.900177+0000","last_fullsized":"2023-08-31T18:48:51.900177+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.919932+0000","last_change":"2023-08-31T18:48:51.914113+0000","last_active":"2023-08-31T18:48:51.919932+0000","last_peered":"2023-08-31T18:48:51.919932+0000","last_clean":"2023-08-31T18:48:51.919932+0000","last_became_active":"2023-08-31T18:48:51.912941+0000","last_became_peered":"2023-08-31T18:48:51.912941+0000","last_unstale":"2023-08-31T18:48:51.919932+0000","last_undegraded":"2023-08-31T18:48:51.919932+0000","last_fullsized":"2023-08-31T18:48:51.919932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.904813+0000","last_change":"2023-08-31T18:48:51.462681+0000","last_active":"2023-08-31T18:48:51.904813+0000","last_peered":"2023-08-31T18:48:51.904813+0000","last_clean":"2023-08-31T18:48:51.904813+0000","last_became_active":"2023-08-31T18:48:51.462265+0000","last_became_peered":"2023-08-31T18:48:51.462265+0000","last_unstale":"2023-08-31T18:48:51.904813+0000","last_undegraded":"2023-08-31T18:48:51.904813+0000","last_fullsized":"2023-08-31T18:48:51.904813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.918047+0000","last_change":"2023-08-31T18:48:51.913902+0000","last_active":"2023-08-31T18:48:51.918047+0000","last_peered":"2023-08-31T18:48:51.918047+0000","last_clean":"2023-08-31T18:48:51.918047+0000","last_became_active":"2023-08-31T18:48:51.913535+0000","last_became_peered":"2023-08-31T18:48:51.913535+0000","last_unstale":"2023-08-31T18:48:51.918047+0000","last_undegraded":"2023-08-31T18:48:51.918047+0000","last_fullsized":"2023-08-31T18:48:51.918047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.916692+0000","last_change":"2023-08-31T18:48:51.456246+0000","last_active":"2023-08-31T18:48:51.916692+0000","last_peered":"2023-08-31T18:48:51.916692+0000","last_clean":"2023-08-31T18:48:51.916692+0000","last_became_active":"2023-08-31T18:48:51.455870+0000","last_became_peered":"2023-08-31T18:48:51.455870+0000","last_unstale":"2023-08-31T18:48:51.916692+0000","last_undegraded":"2023-08-31T18:48:51.916692+0000","last_fullsized":"2023-08-31T18:48:51.916692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.923298+0000","last_change":"2023-08-31T18:48:51.918104+0000","last_active":"2023-08-31T18:48:51.923298+0000","last_peered":"2023-08-31T18:48:51.923298+0000","last_clean":"2023-08-31T18:48:51.923298+0000","last_became_active":"2023-08-31T18:48:51.917824+0000","last_became_peered":"2023-08-31T18:48:51.917824+0000","last_unstale":"2023-08-31T18:48:51.923298+0000","last_undegraded":"2023-08-31T18:48:51.923298+0000","last_fullsized":"2023-08-31T18:48:51.923298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.900579+0000","last_change":"2023-08-31T18:48:51.460591+0000","last_active":"2023-08-31T18:48:51.900579+0000","last_peered":"2023-08-31T18:48:51.900579+0000","last_clean":"2023-08-31T18:48:51.900579+0000","last_became_active":"2023-08-31T18:48:51.460314+0000","last_became_peered":"2023-08-31T18:48:51.460314+0000","last_unstale":"2023-08-31T18:48:51.900579+0000","last_undegraded":"2023-08-31T18:48:51.900579+0000","last_fullsized":"2023-08-31T18:48:51.900579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934868+0000","last_change":"2023-08-31T18:48:51.929606+0000","last_active":"2023-08-31T18:48:51.934868+0000","last_peered":"2023-08-31T18:48:51.934868+0000","last_clean":"2023-08-31T18:48:51.934868+0000","last_became_active":"2023-08-31T18:48:51.929287+0000","last_became_peered":"2023-08-31T18:48:51.929287+0000","last_unstale":"2023-08-31T18:48:51.934868+0000","last_undegraded":"2023-08-31T18:48:51.934868+0000","last_fullsized":"2023-08-31T18:48:51.934868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.908114+0000","last_change":"2023-08-31T18:48:51.467377+0000","last_active":"2023-08-31T18:48:51.908114+0000","last_peered":"2023-08-31T18:48:51.908114+0000","last_clean":"2023-08-31T18:48:51.908114+0000","last_became_active":"2023-08-31T18:48:51.461996+0000","last_became_peered":"2023-08-31T18:48:51.461996+0000","last_unstale":"2023-08-31T18:48:51.908114+0000","last_undegraded":"2023-08-31T18:48:51.908114+0000","last_fullsized":"2023-08-31T18:48:51.908114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.927918+0000","last_change":"2023-08-31T18:48:51.922197+0000","last_active":"2023-08-31T18:48:51.927918+0000","last_peered":"2023-08-31T18:48:51.927918+0000","last_clean":"2023-08-31T18:48:51.927918+0000","last_became_active":"2023-08-31T18:48:51.921904+0000","last_became_peered":"2023-08-31T18:48:51.921904+0000","last_unstale":"2023-08-31T18:48:51.927918+0000","last_undegraded":"2023-08-31T18:48:51.927918+0000","last_fullsized":"2023-08-31T18:48:51.927918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.900333+0000","last_change":"2023-08-31T18:48:51.453104+0000","last_active":"2023-08-31T18:48:51.900333+0000","last_peered":"2023-08-31T18:48:51.900333+0000","last_clean":"2023-08-31T18:48:51.900333+0000","last_became_active":"2023-08-31T18:48:51.452817+0000","last_became_peered":"2023-08-31T18:48:51.452817+0000","last_unstale":"2023-08-31T18:48:51.900333+0000","last_undegraded":"2023-08-31T18:48:51.900333+0000","last_fullsized":"2023-08-31T18:48:51.900333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.920089+0000","last_change":"2023-08-31T18:48:51.914360+0000","last_active":"2023-08-31T18:48:51.920089+0000","last_peered":"2023-08-31T18:48:51.920089+0000","last_clean":"2023-08-31T18:48:51.920089+0000","last_became_active":"2023-08-31T18:48:51.913757+0000","last_became_peered":"2023-08-31T18:48:51.913757+0000","last_unstale":"2023-08-31T18:48:51.920089+0000","last_undegraded":"2023-08-31T18:48:51.920089+0000","last_fullsized":"2023-08-31T18:48:51.920089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.898382+0000","last_change":"2023-08-31T18:48:51.446277+0000","last_active":"2023-08-31T18:48:51.898382+0000","last_peered":"2023-08-31T18:48:51.898382+0000","last_clean":"2023-08-31T18:48:51.898382+0000","last_became_active":"2023-08-31T18:48:51.445887+0000","last_became_peered":"2023-08-31T18:48:51.445887+0000","last_unstale":"2023-08-31T18:48:51.898382+0000","last_undegraded":"2023-08-31T18:48:51.898382+0000","last_fullsized":"2023-08-31T18:48:51.898382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.904833+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T18:48:51.904833+0000","last_peered":"2023-08-31T18:48:51.904833+0000","last_clean":"2023-08-31T18:48:51.904833+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T18:48:51.904833+0000","last_undegraded":"2023-08-31T18:48:51.904833+0000","last_fullsized":"2023-08-31T18:48:51.904833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.930023+0000","last_change":"2023-08-31T18:48:51.923632+0000","last_active":"2023-08-31T18:48:51.930023+0000","last_peered":"2023-08-31T18:48:51.930023+0000","last_clean":"2023-08-31T18:48:51.930023+0000","last_became_active":"2023-08-31T18:48:51.923375+0000","last_became_peered":"2023-08-31T18:48:51.923375+0000","last_unstale":"2023-08-31T18:48:51.930023+0000","last_undegraded":"2023-08-31T18:48:51.930023+0000","last_fullsized":"2023-08-31T18:48:51.930023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.898961+0000","last_change":"2023-08-31T18:48:51.451427+0000","last_active":"2023-08-31T18:48:51.898961+0000","last_peered":"2023-08-31T18:48:51.898961+0000","last_clean":"2023-08-31T18:48:51.898961+0000","last_became_active":"2023-08-31T18:48:51.451160+0000","last_became_peered":"2023-08-31T18:48:51.451160+0000","last_unstale":"2023-08-31T18:48:51.898961+0000","last_undegraded":"2023-08-31T18:48:51.898961+0000","last_fullsized":"2023-08-31T18:48:51.898961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.917520+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T18:48:51.917520+0000","last_peered":"2023-08-31T18:48:51.917520+0000","last_clean":"2023-08-31T18:48:51.917520+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T18:48:51.917520+0000","last_undegraded":"2023-08-31T18:48:51.917520+0000","last_fullsized":"2023-08-31T18:48:51.917520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934684+0000","last_change":"2023-08-31T18:48:51.926914+0000","last_active":"2023-08-31T18:48:51.934684+0000","last_peered":"2023-08-31T18:48:51.934684+0000","last_clean":"2023-08-31T18:48:51.934684+0000","last_became_active":"2023-08-31T18:48:51.926451+0000","last_became_peered":"2023-08-31T18:48:51.926451+0000","last_unstale":"2023-08-31T18:48:51.934684+0000","last_undegraded":"2023-08-31T18:48:51.934684+0000","last_fullsized":"2023-08-31T18:48:51.934684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.900350+0000","last_change":"2023-08-31T18:48:51.464693+0000","last_active":"2023-08-31T18:48:51.900350+0000","last_peered":"2023-08-31T18:48:51.900350+0000","last_clean":"2023-08-31T18:48:51.900350+0000","last_became_active":"2023-08-31T18:48:51.464441+0000","last_became_peered":"2023-08-31T18:48:51.464441+0000","last_unstale":"2023-08-31T18:48:51.900350+0000","last_undegraded":"2023-08-31T18:48:51.900350+0000","last_fullsized":"2023-08-31T18:48:51.900350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.900828+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T18:48:51.900828+0000","last_peered":"2023-08-31T18:48:51.900828+0000","last_clean":"2023-08-31T18:48:51.900828+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T18:48:51.900828+0000","last_undegraded":"2023-08-31T18:48:51.900828+0000","last_fullsized":"2023-08-31T18:48:51.900828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.937013+0000","last_change":"2023-08-31T18:48:51.931891+0000","last_active":"2023-08-31T18:48:51.937013+0000","last_peered":"2023-08-31T18:48:51.937013+0000","last_clean":"2023-08-31T18:48:51.937013+0000","last_became_active":"2023-08-31T18:48:51.931251+0000","last_became_peered":"2023-08-31T18:48:51.931251+0000","last_unstale":"2023-08-31T18:48:51.937013+0000","last_undegraded":"2023-08-31T18:48:51.937013+0000","last_fullsized":"2023-08-31T18:48:51.937013+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.905858+0000","last_change":"2023-08-31T18:48:51.466971+0000","last_active":"2023-08-31T18:48:51.905858+0000","last_peered":"2023-08-31T18:48:51.905858+0000","last_clean":"2023-08-31T18:48:51.905858+0000","last_became_active":"2023-08-31T18:48:51.464663+0000","last_became_peered":"2023-08-31T18:48:51.464663+0000","last_unstale":"2023-08-31T18:48:51.905858+0000","last_undegraded":"2023-08-31T18:48:51.905858+0000","last_fullsized":"2023-08-31T18:48:51.905858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.917429+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T18:48:51.917429+0000","last_peered":"2023-08-31T18:48:51.917429+0000","last_clean":"2023-08-31T18:48:51.917429+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T18:48:51.917429+0000","last_undegraded":"2023-08-31T18:48:51.917429+0000","last_fullsized":"2023-08-31T18:48:51.917429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907225+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T18:48:51.907225+0000","last_peered":"2023-08-31T18:48:51.907225+0000","last_clean":"2023-08-31T18:48:51.907225+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T18:48:51.907225+0000","last_undegraded":"2023-08-31T18:48:51.907225+0000","last_fullsized":"2023-08-31T18:48:51.907225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.936365+0000","last_change":"2023-08-31T18:48:51.933908+0000","last_active":"2023-08-31T18:48:51.936365+0000","last_peered":"2023-08-31T18:48:51.936365+0000","last_clean":"2023-08-31T18:48:51.936365+0000","last_became_active":"2023-08-31T18:48:51.932325+0000","last_became_peered":"2023-08-31T18:48:51.932325+0000","last_unstale":"2023-08-31T18:48:51.936365+0000","last_undegraded":"2023-08-31T18:48:51.936365+0000","last_fullsized":"2023-08-31T18:48:51.936365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.932072+0000","last_change":"2023-08-31T18:48:51.457839+0000","last_active":"2023-08-31T18:48:51.932072+0000","last_peered":"2023-08-31T18:48:51.932072+0000","last_clean":"2023-08-31T18:48:51.932072+0000","last_became_active":"2023-08-31T18:48:51.457556+0000","last_became_peered":"2023-08-31T18:48:51.457556+0000","last_unstale":"2023-08-31T18:48:51.932072+0000","last_undegraded":"2023-08-31T18:48:51.932072+0000","last_fullsized":"2023-08-31T18:48:51.932072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.907313+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T18:48:51.907313+0000","last_peered":"2023-08-31T18:48:51.907313+0000","last_clean":"2023-08-31T18:48:51.907313+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T18:48:51.907313+0000","last_undegraded":"2023-08-31T18:48:51.907313+0000","last_fullsized":"2023-08-31T18:48:51.907313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.930215+0000","last_change":"2023-08-31T18:48:51.925984+0000","last_active":"2023-08-31T18:48:51.930215+0000","last_peered":"2023-08-31T18:48:51.930215+0000","last_clean":"2023-08-31T18:48:51.930215+0000","last_became_active":"2023-08-31T18:48:51.925737+0000","last_became_peered":"2023-08-31T18:48:51.925737+0000","last_unstale":"2023-08-31T18:48:51.930215+0000","last_undegraded":"2023-08-31T18:48:51.930215+0000","last_fullsized":"2023-08-31T18:48:51.930215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.903001+0000","last_change":"2023-08-31T18:48:51.452990+0000","last_active":"2023-08-31T18:48:51.903001+0000","last_peered":"2023-08-31T18:48:51.903001+0000","last_clean":"2023-08-31T18:48:51.903001+0000","last_became_active":"2023-08-31T18:48:51.452683+0000","last_became_peered":"2023-08-31T18:48:51.452683+0000","last_unstale":"2023-08-31T18:48:51.903001+0000","last_undegraded":"2023-08-31T18:48:51.903001+0000","last_fullsized":"2023-08-31T18:48:51.903001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.911591+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T18:48:51.911591+0000","last_peered":"2023-08-31T18:48:51.911591+0000","last_clean":"2023-08-31T18:48:51.911591+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T18:48:51.911591+0000","last_undegraded":"2023-08-31T18:48:51.911591+0000","last_fullsized":"2023-08-31T18:48:51.911591+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.924384+0000","last_change":"2023-08-31T18:48:51.920777+0000","last_active":"2023-08-31T18:48:51.924384+0000","last_peered":"2023-08-31T18:48:51.924384+0000","last_clean":"2023-08-31T18:48:51.924384+0000","last_became_active":"2023-08-31T18:48:51.920392+0000","last_became_peered":"2023-08-31T18:48:51.920392+0000","last_unstale":"2023-08-31T18:48:51.924384+0000","last_undegraded":"2023-08-31T18:48:51.924384+0000","last_fullsized":"2023-08-31T18:48:51.924384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.905865+0000","last_change":"2023-08-31T18:48:51.465654+0000","last_active":"2023-08-31T18:48:51.905865+0000","last_peered":"2023-08-31T18:48:51.905865+0000","last_clean":"2023-08-31T18:48:51.905865+0000","last_became_active":"2023-08-31T18:48:51.465020+0000","last_became_peered":"2023-08-31T18:48:51.465020+0000","last_unstale":"2023-08-31T18:48:51.905865+0000","last_undegraded":"2023-08-31T18:48:51.905865+0000","last_fullsized":"2023-08-31T18:48:51.905865+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.905528+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T18:48:51.905528+0000","last_peered":"2023-08-31T18:48:51.905528+0000","last_clean":"2023-08-31T18:48:51.905528+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T18:48:51.905528+0000","last_undegraded":"2023-08-31T18:48:51.905528+0000","last_fullsized":"2023-08-31T18:48:51.905528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.934721+0000","last_change":"2023-08-31T18:48:51.926057+0000","last_active":"2023-08-31T18:48:51.934721+0000","last_peered":"2023-08-31T18:48:51.934721+0000","last_clean":"2023-08-31T18:48:51.934721+0000","last_became_active":"2023-08-31T18:48:51.925722+0000","last_became_peered":"2023-08-31T18:48:51.925722+0000","last_unstale":"2023-08-31T18:48:51.934721+0000","last_undegraded":"2023-08-31T18:48:51.934721+0000","last_fullsized":"2023-08-31T18:48:51.934721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:51.428025+0000","last_clean_scrub_stamp":"2023-08-31T18:48:51.428025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.902956+0000","last_change":"2023-08-31T18:48:51.460515+0000","last_active":"2023-08-31T18:48:51.902956+0000","last_peered":"2023-08-31T18:48:51.902956+0000","last_clean":"2023-08-31T18:48:51.902956+0000","last_became_active":"2023-08-31T18:48:51.460271+0000","last_became_peered":"2023-08-31T18:48:51.460271+0000","last_unstale":"2023-08-31T18:48:51.902956+0000","last_undegraded":"2023-08-31T18:48:51.902956+0000","last_fullsized":"2023-08-31T18:48:51.902956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:48:50.420026+0000","last_clean_scrub_stamp":"2023-08-31T18:48:50.420026+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-31T18:48:51.903480+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T18:48:51.903480+0000","last_peered":"2023-08-31T18:48:51.903480+0000","last_clean":"2023-08-31T18:48:51.903480+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T18:48:51.903480+0000","last_undegraded":"2023-08-31T18:48:51.903480+0000","last_fullsized":"2023-08-31T18:48:51.903480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":393216,"data_stored":161283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.80400000000000005}]},{"osd":1,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.753},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.78400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":161193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.87}]},{"osd":3,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.73699999999999999}]},{"osd":4,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.84199999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":393216,"data_stored":160799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.433},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Aug 31 18:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.78500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":160673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.442}]},{"osd":3,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.623}]},{"osd":5,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Aug 31 18:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.69099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":160639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.621}]},{"osd":6,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.83099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":405504,"data_stored":162279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.312},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.373}]},{"osd":1,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.85399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":160661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":9.6289999999999996,"5min":9.6289999999999996,"15min":9.6289999999999996},"last":0.622},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.403,"5min":3.403,"15min":3.403},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":9.8399999999999999,"5min":9.8399999999999999,"15min":9.8399999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":9.7569999999999997,"5min":9.7569999999999997,"15min":9.7569999999999997},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":9.7840000000000007,"5min":9.7840000000000007,"15min":9.7840000000000007},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":9.7200000000000006,"5min":9.7200000000000006,"15min":9.7200000000000006},"last":0.80600000000000005}]},{"osd":3,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":5.133,"5min":5.133,"15min":5.133},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":12.589,"5min":12.589,"15min":12.589},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":9.6780000000000008,"5min":9.6780000000000008,"15min":9.6780000000000008},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.3610000000000002,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":9.4760000000000009,"5min":9.4760000000000009,"15min":9.4760000000000009},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":9.8640000000000008,"5min":9.8640000000000008,"15min":9.8640000000000008},"last":0.83399999999999996}]},{"osd":7,"last update":"Thu Aug 31 18:48:47 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":7.1769999999999996,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":12.634,"5min":12.634,"15min":12.634},"last":0.77100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":401408,"data_stored":162197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.81799999999999995}]},{"osd":1,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.751}]},{"osd":4,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Aug 31 18:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1,"5min":1,"15min":1},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.80300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T18:49:01.436 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T18:49:01.437 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-31T18:49:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.664+0000 7f87d0fff700 1 Processor -- start 2023-08-31T18:49:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.664+0000 7f87d0fff700 1 -- start start 2023-08-31T18:49:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.665+0000 7f87d0fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87cc154030 0x7f87cc154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.665+0000 7f87d0fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f87cc0c06b0 0x7f87cc0c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.665+0000 7f87d0fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87cc0c6ed0 con 0x7f87cc0aa140 2023-08-31T18:49:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.665+0000 7f87d0fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87cc0c66e0 con 0x7f87cc154030 2023-08-31T18:49:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.665+0000 7f87d0fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87cc0c68c0 con 0x7f87cc0c06b0 2023-08-31T18:49:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.665+0000 7f87ca59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87cc154030 0x7f87cc154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.666+0000 7f87ca59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87cc154030 0x7f87cc154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37414/0 (socket says 172.21.15.72:37414) 2023-08-31T18:49:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.666+0000 7f87ca59c700 1 -- 172.21.15.72:0/414661648 learned_addr learned my addr 172.21.15.72:0/414661648 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.666+0000 7f87c9d9b700 1 --2- 172.21.15.72:0/414661648 >> v2:172.21.15.146:3300/0 conn(0x7f87cc0c06b0 0x7f87cc0c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.666+0000 7f87ca59c700 1 -- 172.21.15.72:0/414661648 >> v2:172.21.15.146:3300/0 conn(0x7f87cc0c06b0 msgr2=0x7f87cc0c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:01.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.666+0000 7f87ca59c700 1 --2- 172.21.15.72:0/414661648 >> v2:172.21.15.146:3300/0 conn(0x7f87cc0c06b0 0x7f87cc0c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:01.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.666+0000 7f87ca59c700 1 -- 172.21.15.72:0/414661648 >> v1:172.21.15.146:6789/0 conn(0x7f87cc0aa140 legacy=0x7f87cc063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:01.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.666+0000 7f87ca59c700 1 -- 172.21.15.72:0/414661648 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc0c0f30 con 0x7f87cc154030 2023-08-31T18:49:01.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.666+0000 7f87c9d9b700 1 --2- 172.21.15.72:0/414661648 >> v2:172.21.15.146:3300/0 conn(0x7f87cc0c06b0 0x7f87cc0c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:01.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.666+0000 7f87ca59c700 1 --2- 172.21.15.72:0/414661648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87cc154030 0x7f87cc154410 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f87cc0cb6d0 tx=0x7f87bc0090f0).ready entity=mon.0 client_cookie=e0e8fee23dcb0c2a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:01.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.666+0000 7f87c959a700 1 -- 172.21.15.72:0/414661648 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc00b5a0 con 0x7f87cc154030 2023-08-31T18:49:01.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.666+0000 7f87c959a700 1 -- 172.21.15.72:0/414661648 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87bc00b700 con 0x7f87cc154030 2023-08-31T18:49:01.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.666+0000 7f87c959a700 1 -- 172.21.15.72:0/414661648 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc00ba80 con 0x7f87cc154030 2023-08-31T18:49:01.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.667+0000 7f87d0fff700 1 -- 172.21.15.72:0/414661648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87cc154030 msgr2=0x7f87cc154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:01.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.667+0000 7f87d0fff700 1 --2- 172.21.15.72:0/414661648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87cc154030 0x7f87cc154410 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f87cc0cb6d0 tx=0x7f87bc0090f0).stop 2023-08-31T18:49:01.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.667+0000 7f87d0fff700 1 -- 172.21.15.72:0/414661648 shutdown_connections 2023-08-31T18:49:01.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.667+0000 7f87d0fff700 1 --2- 172.21.15.72:0/414661648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87cc154030 0x7f87cc154410 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:01.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.667+0000 7f87d0fff700 1 --2- 172.21.15.72:0/414661648 >> v2:172.21.15.146:3300/0 conn(0x7f87cc0c06b0 0x7f87cc0c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:01.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.667+0000 7f87d0fff700 1 -- 172.21.15.72:0/414661648 >> 172.21.15.72:0/414661648 conn(0x7f87cc05eb60 msgr2=0x7f87cc0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:01.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.667+0000 7f87d0fff700 1 -- 172.21.15.72:0/414661648 shutdown_connections 2023-08-31T18:49:01.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.667+0000 7f87d0fff700 1 -- 172.21.15.72:0/414661648 wait complete. 2023-08-31T18:49:01.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.668+0000 7f87d0fff700 1 Processor -- start 2023-08-31T18:49:01.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.669+0000 7f87d0fff700 1 -- start start 2023-08-31T18:49:01.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.669+0000 7f87d0fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87cc0aa140 0x7f87cc0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.669+0000 7f87d0fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87cc0c06b0 0x7f87cc150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87d0fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87cc154030 0x7f87cc0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87d0fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc0ae270 con 0x7f87cc0aa140 2023-08-31T18:49:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87d0fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc151990 con 0x7f87cc0c06b0 2023-08-31T18:49:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87d0fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc1527f0 con 0x7f87cc154030 2023-08-31T18:49:01.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87ca59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87cc0aa140 0x7f87cc0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:01.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87ca59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87cc0aa140 0x7f87cc0add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37418/0 (socket says 172.21.15.72:37418) 2023-08-31T18:49:01.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87ca59c700 1 -- 172.21.15.72:0/3447423195 learned_addr learned my addr 172.21.15.72:0/3447423195 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:01.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87c9d9b700 1 --2- 172.21.15.72:0/3447423195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87cc0c06b0 0x7f87cc150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87cad9d700 1 --2- 172.21.15.72:0/3447423195 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87cc154030 0x7f87cc0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87ca59c700 1 -- 172.21.15.72:0/3447423195 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87cc154030 msgr2=0x7f87cc0c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87ca59c700 1 --2- 172.21.15.72:0/3447423195 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87cc154030 0x7f87cc0c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87ca59c700 1 -- 172.21.15.72:0/3447423195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87cc0c06b0 msgr2=0x7f87cc150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87ca59c700 1 --2- 172.21.15.72:0/3447423195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87cc0c06b0 0x7f87cc150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87ca59c700 1 -- 172.21.15.72:0/3447423195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87bc009370 con 0x7f87cc0aa140 2023-08-31T18:49:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87c9d9b700 1 --2- 172.21.15.72:0/3447423195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87cc0c06b0 0x7f87cc150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:49:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87ca59c700 1 --2- 172.21.15.72:0/3447423195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87cc0aa140 0x7f87cc0add80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f87bc009130 tx=0x7f87bc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.670+0000 7f87ba7fc700 1 -- 172.21.15.72:0/3447423195 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc00ba80 con 0x7f87cc0aa140 2023-08-31T18:49:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.671+0000 7f87ba7fc700 1 -- 172.21.15.72:0/3447423195 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87bc000d10 con 0x7f87cc0aa140 2023-08-31T18:49:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.671+0000 7f87ba7fc700 1 -- 172.21.15.72:0/3447423195 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc01c670 con 0x7f87cc0aa140 2023-08-31T18:49:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.671+0000 7f87d0fff700 1 -- 172.21.15.72:0/3447423195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87cc151be0 con 0x7f87cc0aa140 2023-08-31T18:49:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.671+0000 7f87d0fff700 1 -- 172.21.15.72:0/3447423195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87cc1521a0 con 0x7f87cc0aa140 2023-08-31T18:49:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.672+0000 7f87d0fff700 1 -- 172.21.15.72:0/3447423195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87cc06c6b0 con 0x7f87cc0aa140 2023-08-31T18:49:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.673+0000 7f87ba7fc700 1 -- 172.21.15.72:0/3447423195 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f87bc01c9e0 con 0x7f87cc0aa140 2023-08-31T18:49:01.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.674+0000 7f87ba7fc700 1 --2- 172.21.15.72:0/3447423195 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87ac05ede0 0x7f87ac0612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:01.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.674+0000 7f87ba7fc700 1 -- 172.21.15.72:0/3447423195 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f87bc07bac0 con 0x7f87cc0aa140 2023-08-31T18:49:01.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.674+0000 7f87c9d9b700 1 --2- 172.21.15.72:0/3447423195 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87ac05ede0 0x7f87ac0612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:01.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.674+0000 7f87c9d9b700 1 --2- 172.21.15.72:0/3447423195 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87ac05ede0 0x7f87ac0612a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f87cc157040 tx=0x7f87c0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:01.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.677+0000 7f87ba7fc700 1 -- 172.21.15.72:0/3447423195 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f87bc04cf30 con 0x7f87cc0aa140 2023-08-31T18:49:01.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.908+0000 7f87d0fff700 1 -- 172.21.15.72:0/3447423195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f87cc0c0c50 con 0x7f87cc0aa140 2023-08-31T18:49:01.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.912+0000 7f87ba7fc700 1 -- 172.21.15.72:0/3447423195 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f87bc07be60 con 0x7f87cc0aa140 2023-08-31T18:49:01.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.914+0000 7f87d0fff700 1 -- 172.21.15.72:0/3447423195 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87ac05ede0 msgr2=0x7f87ac0612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:01.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.914+0000 7f87d0fff700 1 --2- 172.21.15.72:0/3447423195 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87ac05ede0 0x7f87ac0612a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f87cc157040 tx=0x7f87c0008040).stop 2023-08-31T18:49:01.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.914+0000 7f87d0fff700 1 -- 172.21.15.72:0/3447423195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87cc0aa140 msgr2=0x7f87cc0add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:01.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.914+0000 7f87d0fff700 1 --2- 172.21.15.72:0/3447423195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87cc0aa140 0x7f87cc0add80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f87bc009130 tx=0x7f87bc015000).stop 2023-08-31T18:49:01.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.915+0000 7f87d0fff700 1 -- 172.21.15.72:0/3447423195 shutdown_connections 2023-08-31T18:49:01.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.915+0000 7f87d0fff700 1 --2- 172.21.15.72:0/3447423195 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87cc154030 0x7f87cc0c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:01.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.915+0000 7f87d0fff700 1 --2- 172.21.15.72:0/3447423195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87cc0aa140 0x7f87cc0add80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:01.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.915+0000 7f87d0fff700 1 --2- 172.21.15.72:0/3447423195 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87ac05ede0 0x7f87ac0612a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:01.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.915+0000 7f87d0fff700 1 --2- 172.21.15.72:0/3447423195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87cc0c06b0 0x7f87cc150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:01.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.915+0000 7f87d0fff700 1 -- 172.21.15.72:0/3447423195 >> 172.21.15.72:0/3447423195 conn(0x7f87cc05eb60 msgr2=0x7f87cc0ad3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:01.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.915+0000 7f87d0fff700 1 -- 172.21.15.72:0/3447423195 shutdown_connections 2023-08-31T18:49:01.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:01.915+0000 7f87d0fff700 1 -- 172.21.15.72:0/3447423195 wait complete. 2023-08-31T18:49:01.919 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-08-31T18:49:01.932 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T18:49:02.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.120+0000 7f8efe3ff700 1 Processor -- start 2023-08-31T18:49:02.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.120+0000 7f8efe3ff700 1 -- start start 2023-08-31T18:49:02.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.122+0000 7f8efe3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ef80cb9b0 0x7f8ef81583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.122+0000 7f8efe3ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ef81588d0 0x7f8ef8154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.122+0000 7f8efe3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef80c6120 con 0x7f8ef8154060 2023-08-31T18:49:02.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.122+0000 7f8efe3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef80c1380 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.122+0000 7f8efe3ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef80c5e10 con 0x7f8ef81588d0 2023-08-31T18:49:02.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.122+0000 7f8ef77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ef80cb9b0 0x7f8ef81583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.122+0000 7f8ef7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8ef8154060 0x7f8ef8157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42266/0 (socket says 172.21.15.72:42266) 2023-08-31T18:49:02.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.122+0000 7f8ef7fff700 1 -- 172.21.15.72:0/2667923789 learned_addr learned my addr 172.21.15.72:0/2667923789 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:49:02.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.122+0000 7f8efc99c700 1 --2- 172.21.15.72:0/2667923789 >> v2:172.21.15.146:3300/0 conn(0x7f8ef81588d0 0x7f8ef8154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.123+0000 7f8ef77fe700 1 -- 172.21.15.72:0/2667923789 >> v2:172.21.15.146:3300/0 conn(0x7f8ef81588d0 msgr2=0x7f8ef8154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:02.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.123+0000 7f8ef77fe700 1 --2- 172.21.15.72:0/2667923789 >> v2:172.21.15.146:3300/0 conn(0x7f8ef81588d0 0x7f8ef8154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.123+0000 7f8ef77fe700 1 -- 172.21.15.72:0/2667923789 >> v1:172.21.15.72:6789/0 conn(0x7f8ef8154060 legacy=0x7f8ef8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.123+0000 7f8ef77fe700 1 -- 172.21.15.72:0/2667923789 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef80c0ae0 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.123+0000 7f8ef6ffd700 1 -- 172.21.15.72:0/2667923789 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373544990 0 0) 0x7f8ef80c6120 con 0x7f8ef8154060 2023-08-31T18:49:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.123+0000 7f8efc99c700 1 --2- 172.21.15.72:0/2667923789 >> v2:172.21.15.146:3300/0 conn(0x7f8ef81588d0 0x7f8ef8154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.123+0000 7f8ef77fe700 1 --2- 172.21.15.72:0/2667923789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ef80cb9b0 0x7f8ef81583e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f8ef80844d0 tx=0x7f8eec009060).ready entity=mon.0 client_cookie=920310d6c6834477 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.123+0000 7f8ef6ffd700 1 -- 172.21.15.72:0/2667923789 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00b580 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.123+0000 7f8ef6ffd700 1 -- 172.21.15.72:0/2667923789 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec00b6e0 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.123+0000 7f8ef6ffd700 1 -- 172.21.15.72:0/2667923789 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00ba60 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.124+0000 7f8efe3ff700 1 -- 172.21.15.72:0/2667923789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ef80cb9b0 msgr2=0x7f8ef81583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:02.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.124+0000 7f8efe3ff700 1 --2- 172.21.15.72:0/2667923789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ef80cb9b0 0x7f8ef81583e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f8ef80844d0 tx=0x7f8eec009060).stop 2023-08-31T18:49:02.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.124+0000 7f8efe3ff700 1 -- 172.21.15.72:0/2667923789 shutdown_connections 2023-08-31T18:49:02.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.124+0000 7f8efe3ff700 1 --2- 172.21.15.72:0/2667923789 >> v2:172.21.15.146:3300/0 conn(0x7f8ef81588d0 0x7f8ef8154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.124+0000 7f8efe3ff700 1 --2- 172.21.15.72:0/2667923789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ef80cb9b0 0x7f8ef81583e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.124+0000 7f8efe3ff700 1 -- 172.21.15.72:0/2667923789 >> 172.21.15.72:0/2667923789 conn(0x7f8ef805e870 msgr2=0x7f8ef80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:02.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.124+0000 7f8efe3ff700 1 -- 172.21.15.72:0/2667923789 shutdown_connections 2023-08-31T18:49:02.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.124+0000 7f8efe3ff700 1 -- 172.21.15.72:0/2667923789 wait complete. 2023-08-31T18:49:02.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.125+0000 7f8efe3ff700 1 Processor -- start 2023-08-31T18:49:02.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.125+0000 7f8efe3ff700 1 -- start start 2023-08-31T18:49:02.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.126+0000 7f8efe3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ef80cb9b0 0x7f8ef8152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.126+0000 7f8efe3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef8154060 0x7f8ef80a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.126+0000 7f8efe3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef81588d0 0x7f8ef814c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.126+0000 7f8efe3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef80c28a0 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.126+0000 7f8efe3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef80a8d80 con 0x7f8ef81588d0 2023-08-31T18:49:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.126+0000 7f8efe3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef80a9060 con 0x7f8ef8154060 2023-08-31T18:49:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.127+0000 7f8ef7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ef80cb9b0 0x7f8ef8152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.127+0000 7f8ef7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ef80cb9b0 0x7f8ef8152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37430/0 (socket says 172.21.15.72:37430) 2023-08-31T18:49:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.127+0000 7f8ef7fff700 1 -- 172.21.15.72:0/3492243465 learned_addr learned my addr 172.21.15.72:0/3492243465 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.127+0000 7f8efc99c700 1 --2- 172.21.15.72:0/3492243465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef81588d0 0x7f8ef814c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.127+0000 7f8ef77fe700 1 --2- 172.21.15.72:0/3492243465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef8154060 0x7f8ef80a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.127+0000 7f8ef7fff700 1 -- 172.21.15.72:0/3492243465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef8154060 msgr2=0x7f8ef80a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:02.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.127+0000 7f8ef7fff700 1 --2- 172.21.15.72:0/3492243465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef8154060 0x7f8ef80a84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.127+0000 7f8ef7fff700 1 -- 172.21.15.72:0/3492243465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef81588d0 msgr2=0x7f8ef814c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:02.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.127+0000 7f8ef7fff700 1 --2- 172.21.15.72:0/3492243465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef81588d0 0x7f8ef814c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.127+0000 7f8ef7fff700 1 -- 172.21.15.72:0/3492243465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec0092a0 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.127+0000 7f8ef7fff700 1 --2- 172.21.15.72:0/3492243465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ef80cb9b0 0x7f8ef8152380 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f8ee8001360 tx=0x7f8ee8007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:02.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.127+0000 7f8edffff700 1 -- 172.21.15.72:0/3492243465 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80072e0 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.127+0000 7f8edffff700 1 -- 172.21.15.72:0/3492243465 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee8007440 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.127+0000 7f8edffff700 1 -- 172.21.15.72:0/3492243465 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80058a0 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.128+0000 7f8efe3ff700 1 -- 172.21.15.72:0/3492243465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef80a9340 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.128+0000 7f8efe3ff700 1 -- 172.21.15.72:0/3492243465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef80c2430 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.129+0000 7f8efe3ff700 1 -- 172.21.15.72:0/3492243465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef80c2620 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.129+0000 7f8edffff700 1 -- 172.21.15.72:0/3492243465 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f8ee8005c90 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.130+0000 7f8edffff700 1 --2- 172.21.15.72:0/3492243465 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8ee405ee10 0x7f8ee40612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.130+0000 7f8edffff700 1 -- 172.21.15.72:0/3492243465 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8ee8079680 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.130+0000 7f8ef77fe700 1 --2- 172.21.15.72:0/3492243465 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8ee405ee10 0x7f8ee40612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.131+0000 7f8ef77fe700 1 --2- 172.21.15.72:0/3492243465 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8ee405ee10 0x7f8ee40612d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f8eec009fd0 tx=0x7f8eec017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:02.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.134+0000 7f8edffff700 1 -- 172.21.15.72:0/3492243465 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ee804aa30 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.342+0000 7f8efe3ff700 1 -- 172.21.15.72:0/3492243465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ef806c6b0 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.343+0000 7f8edffff700 1 -- 172.21.15.72:0/3492243465 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f8ee804e050 con 0x7f8ef80cb9b0 2023-08-31T18:49:02.343 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T18:49:02.344 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/682775915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":682775915},{"type":"v1","addr":"172.21.15.146:6835","nonce":682775915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/934559211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":934559211},{"type":"v1","addr":"172.21.15.72:6836","nonce":934559211}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2587704834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2587704834},{"type":"v1","addr":"172.21.15.72:6837","nonce":2587704834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T18:48:51.892123+0000","modified":"2023-08-31T18:48:54.904501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/1295593403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1295593403},{"type":"v1","addr":"172.21.15.146:6834","nonce":1295593403}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-31T18:49:02.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.345+0000 7f8efe3ff700 1 -- 172.21.15.72:0/3492243465 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8ee405ee10 msgr2=0x7f8ee40612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:02.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.345+0000 7f8efe3ff700 1 --2- 172.21.15.72:0/3492243465 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8ee405ee10 0x7f8ee40612d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f8eec009fd0 tx=0x7f8eec017000).stop 2023-08-31T18:49:02.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.345+0000 7f8efe3ff700 1 -- 172.21.15.72:0/3492243465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ef80cb9b0 msgr2=0x7f8ef8152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:02.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.345+0000 7f8efe3ff700 1 --2- 172.21.15.72:0/3492243465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ef80cb9b0 0x7f8ef8152380 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f8ee8001360 tx=0x7f8ee8007b00).stop 2023-08-31T18:49:02.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.345+0000 7f8efe3ff700 1 -- 172.21.15.72:0/3492243465 shutdown_connections 2023-08-31T18:49:02.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.345+0000 7f8efe3ff700 1 --2- 172.21.15.72:0/3492243465 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8ee405ee10 0x7f8ee40612d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.345+0000 7f8efe3ff700 1 --2- 172.21.15.72:0/3492243465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef81588d0 0x7f8ef814c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.345+0000 7f8efe3ff700 1 --2- 172.21.15.72:0/3492243465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ef80cb9b0 0x7f8ef8152380 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.345+0000 7f8efe3ff700 1 --2- 172.21.15.72:0/3492243465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ef8154060 0x7f8ef80a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.345+0000 7f8efe3ff700 1 -- 172.21.15.72:0/3492243465 >> 172.21.15.72:0/3492243465 conn(0x7f8ef805e870 msgr2=0x7f8ef80bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:02.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.345+0000 7f8efe3ff700 1 -- 172.21.15.72:0/3492243465 shutdown_connections 2023-08-31T18:49:02.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.345+0000 7f8efe3ff700 1 -- 172.21.15.72:0/3492243465 wait complete. 2023-08-31T18:49:02.349 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2023-08-31T18:49:02.765 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T18:48:51.892123+0000', 'modified': '2023-08-31T18:48:54.904501+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4974}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4974': {'gid': 4974, 'name': 'b', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.146:6834/1295593403', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 1295593403}, {'type': 'v1', 'addr': '172.21.15.146:6834', 'nonce': 1295593403}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-31T18:49:02.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T18:49:02.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-31T18:49:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.955+0000 7f38509ff700 1 Processor -- start 2023-08-31T18:49:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.955+0000 7f38509ff700 1 -- start start 2023-08-31T18:49:02.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.956+0000 7f38509ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f384c157c10 0x7f384c0ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.956+0000 7f38509ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f384c0637c0 0x7f384c155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.956+0000 7f38509ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384c0c6130 con 0x7f384c0ad1b0 2023-08-31T18:49:02.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.956+0000 7f38509ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384c0c0350 con 0x7f384c0637c0 2023-08-31T18:49:02.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.956+0000 7f38509ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c1580b0 con 0x7f384c157c10 2023-08-31T18:49:02.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.957+0000 7f3849d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f384c157c10 0x7f384c0ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.957+0000 7f384ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f384c0637c0 0x7f384c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.957+0000 7f384ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f384c0637c0 0x7f384c155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:48982/0 (socket says 172.21.15.72:48982) 2023-08-31T18:49:02.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.957+0000 7f384ad9d700 1 -- 172.21.15.72:0/570459896 learned_addr learned my addr 172.21.15.72:0/570459896 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:02.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.957+0000 7f384a59c700 1 --1- 172.21.15.72:0/570459896 >> v1:172.21.15.146:6789/0 conn(0x7f384c0ad1b0 0x7f384c0630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:58860/0 (socket says 172.21.15.72:58860) 2023-08-31T18:49:02.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.958+0000 7f384ad9d700 1 -- 172.21.15.72:0/570459896 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f384c157c10 msgr2=0x7f384c0ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:02.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.958+0000 7f384ad9d700 1 --2- 172.21.15.72:0/570459896 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f384c157c10 0x7f384c0ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.958+0000 7f384ad9d700 1 -- 172.21.15.72:0/570459896 >> v1:172.21.15.146:6789/0 conn(0x7f384c0ad1b0 legacy=0x7f384c0630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:02.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.958+0000 7f384ad9d700 1 -- 172.21.15.72:0/570459896 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c155560 con 0x7f384c0637c0 2023-08-31T18:49:02.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.958+0000 7f384959a700 1 -- 172.21.15.72:0/570459896 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061435211 0 0) 0x7f384c0c6130 con 0x7f384c0ad1b0 2023-08-31T18:49:02.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.958+0000 7f384ad9d700 1 --2- 172.21.15.72:0/570459896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f384c0637c0 0x7f384c155070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3844009f20 tx=0x7f3844009840).ready entity=mon.1 client_cookie=195ce00edb80cd01 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:02.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.958+0000 7f384959a700 1 -- 172.21.15.72:0/570459896 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400e070 con 0x7f384c0637c0 2023-08-31T18:49:02.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.958+0000 7f384959a700 1 -- 172.21.15.72:0/570459896 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384400b9d0 con 0x7f384c0637c0 2023-08-31T18:49:02.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.958+0000 7f384959a700 1 -- 172.21.15.72:0/570459896 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400bd50 con 0x7f384c0637c0 2023-08-31T18:49:02.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.959+0000 7f38509ff700 1 -- 172.21.15.72:0/570459896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f384c0637c0 msgr2=0x7f384c155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:02.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.959+0000 7f38509ff700 1 --2- 172.21.15.72:0/570459896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f384c0637c0 0x7f384c155070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3844009f20 tx=0x7f3844009840).stop 2023-08-31T18:49:02.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.959+0000 7f38509ff700 1 -- 172.21.15.72:0/570459896 shutdown_connections 2023-08-31T18:49:02.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.959+0000 7f38509ff700 1 --2- 172.21.15.72:0/570459896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f384c0637c0 0x7f384c155070 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.959+0000 7f38509ff700 1 --2- 172.21.15.72:0/570459896 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f384c157c10 0x7f384c0ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.959+0000 7f38509ff700 1 -- 172.21.15.72:0/570459896 >> 172.21.15.72:0/570459896 conn(0x7f384c05eb60 msgr2=0x7f384c0cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:02.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.959+0000 7f38509ff700 1 -- 172.21.15.72:0/570459896 shutdown_connections 2023-08-31T18:49:02.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.959+0000 7f38509ff700 1 -- 172.21.15.72:0/570459896 wait complete. 2023-08-31T18:49:02.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.960+0000 7f38509ff700 1 Processor -- start 2023-08-31T18:49:02.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.960+0000 7f38509ff700 1 -- start start 2023-08-31T18:49:02.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.961+0000 7f38509ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f384c0637c0 0x7f384c14a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.961+0000 7f38509ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f384c0ad1b0 0x7f384c0ac110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.961+0000 7f38509ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f384c157c10 0x7f384c0ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.961+0000 7f38509ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0c2eb0 con 0x7f384c157c10 2023-08-31T18:49:02.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.961+0000 7f38509ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0adda0 con 0x7f384c0637c0 2023-08-31T18:49:02.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.961+0000 7f38509ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c163aa0 con 0x7f384c0ad1b0 2023-08-31T18:49:02.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.962+0000 7f384ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f384c157c10 0x7f384c0ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.962+0000 7f384ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f384c157c10 0x7f384c0ca1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49310/0 (socket says 172.21.15.72:49310) 2023-08-31T18:49:02.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.962+0000 7f384ad9d700 1 -- 172.21.15.72:0/3636883740 learned_addr learned my addr 172.21.15.72:0/3636883740 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:02.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.962+0000 7f384a59c700 1 --2- 172.21.15.72:0/3636883740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f384c0637c0 0x7f384c14a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.962+0000 7f3849d9b700 1 --2- 172.21.15.72:0/3636883740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f384c0ad1b0 0x7f384c0ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.962+0000 7f384ad9d700 1 -- 172.21.15.72:0/3636883740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f384c0ad1b0 msgr2=0x7f384c0ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:02.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.962+0000 7f384ad9d700 1 --2- 172.21.15.72:0/3636883740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f384c0ad1b0 0x7f384c0ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.962+0000 7f384ad9d700 1 -- 172.21.15.72:0/3636883740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f384c0637c0 msgr2=0x7f384c14a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:02.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.962+0000 7f384ad9d700 1 --2- 172.21.15.72:0/3636883740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f384c0637c0 0x7f384c14a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.962+0000 7f384ad9d700 1 -- 172.21.15.72:0/3636883740 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3844009ae0 con 0x7f384c157c10 2023-08-31T18:49:02.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.962+0000 7f384ad9d700 1 --2- 172.21.15.72:0/3636883740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f384c157c10 0x7f384c0ca1b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f384400b610 tx=0x7f384c158bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:02.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.962+0000 7f383a7fc700 1 -- 172.21.15.72:0/3636883740 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844013e30 con 0x7f384c157c10 2023-08-31T18:49:02.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.962+0000 7f383a7fc700 1 -- 172.21.15.72:0/3636883740 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384401e470 con 0x7f384c157c10 2023-08-31T18:49:02.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.962+0000 7f38509ff700 1 -- 172.21.15.72:0/3636883740 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384c164900 con 0x7f384c157c10 2023-08-31T18:49:02.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.962+0000 7f383a7fc700 1 -- 172.21.15.72:0/3636883740 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384401e830 con 0x7f384c157c10 2023-08-31T18:49:02.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.963+0000 7f38509ff700 1 -- 172.21.15.72:0/3636883740 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c1642b0 con 0x7f384c157c10 2023-08-31T18:49:02.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.964+0000 7f383a7fc700 1 -- 172.21.15.72:0/3636883740 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3844003040 con 0x7f384c157c10 2023-08-31T18:49:02.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.965+0000 7f383a7fc700 1 --2- 172.21.15.72:0/3636883740 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f382c05ee10 0x7f382c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.965+0000 7f383a7fc700 1 -- 172.21.15.72:0/3636883740 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f384407b270 con 0x7f384c157c10 2023-08-31T18:49:02.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.965+0000 7f384a59c700 1 --2- 172.21.15.72:0/3636883740 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f382c05ee10 0x7f382c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.966+0000 7f384a59c700 1 --2- 172.21.15.72:0/3636883740 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f382c05ee10 0x7f382c0612d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f384c0afbc0 tx=0x7f383c007180).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:02.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.967+0000 7f3867d9ab80 1 Processor -- start 2023-08-31T18:49:02.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.968+0000 7f3867d9ab80 1 -- start start 2023-08-31T18:49:02.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.968+0000 7f3867d9ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 0x56131e71a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.968+0000 7f3867d9ab80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 0x56131e715600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.968+0000 7f3867d9ab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e715f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.968+0000 7f3867d9ab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131e656db0 con 0x56131e715af0 2023-08-31T18:49:02.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f3867d9ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131e66c030 con 0x56131e71a2c0 2023-08-31T18:49:02.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f3867d9ab80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x56131e66c170 con 0x56131e762f60 2023-08-31T18:49:02.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f384ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e715f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f384ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e715f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49322/0 (socket says 172.21.15.72:49322) 2023-08-31T18:49:02.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f384ad9d700 1 -- 172.21.15.72:0/4085270902 learned_addr learned my addr 172.21.15.72:0/4085270902 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:02.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f384a59c700 1 --2- 172.21.15.72:0/4085270902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 0x56131e71a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f3849d9b700 1 --2- 172.21.15.72:0/4085270902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 0x56131e715600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f384ad9d700 1 -- 172.21.15.72:0/4085270902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 msgr2=0x56131e715600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f384ad9d700 1 --2- 172.21.15.72:0/4085270902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 0x56131e715600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f384ad9d700 1 -- 172.21.15.72:0/4085270902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 msgr2=0x56131e71a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f384ad9d700 1 --2- 172.21.15.72:0/4085270902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 0x56131e71a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f384ad9d700 1 -- 172.21.15.72:0/4085270902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56131e63eb00 con 0x56131e715af0 2023-08-31T18:49:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f3849d9b700 1 --2- 172.21.15.72:0/4085270902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 0x56131e715600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:49:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f384ad9d700 1 --2- 172.21.15.72:0/4085270902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e715f70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f384404c8c0 tx=0x7f384400e000).ready entity=mon.0 client_cookie=c407a2e09292984 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f382b7fe700 1 -- 172.21.15.72:0/4085270902 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384404e7f0 con 0x56131e715af0 2023-08-31T18:49:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.969+0000 7f382b7fe700 1 -- 172.21.15.72:0/4085270902 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384404cb60 con 0x56131e715af0 2023-08-31T18:49:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.970+0000 7f382b7fe700 1 -- 172.21.15.72:0/4085270902 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384404fb50 con 0x56131e715af0 2023-08-31T18:49:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.970+0000 7f3867d9ab80 1 -- 172.21.15.72:0/4085270902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 msgr2=0x56131e715f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.970+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/4085270902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e715f70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f384404c8c0 tx=0x7f384400e000).stop 2023-08-31T18:49:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.970+0000 7f3867d9ab80 1 -- 172.21.15.72:0/4085270902 shutdown_connections 2023-08-31T18:49:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.970+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/4085270902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e715f70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.970+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/4085270902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 0x56131e71a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.970+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/4085270902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 0x56131e715600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.970+0000 7f3867d9ab80 1 -- 172.21.15.72:0/4085270902 >> 172.21.15.72:0/4085270902 conn(0x56131e584940 msgr2=0x56131e7633f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.970+0000 7f3867d9ab80 1 -- 172.21.15.72:0/4085270902 shutdown_connections 2023-08-31T18:49:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.970+0000 7f3867d9ab80 1 -- 172.21.15.72:0/4085270902 wait complete. 2023-08-31T18:49:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.971+0000 7f3867d9ab80 1 -- start start 2023-08-31T18:49:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.971+0000 7f3867d9ab80 1 Processor -- start 2023-08-31T18:49:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.973+0000 7f3867d9ab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e76f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.973+0000 7f3867d9ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 0x56131e761df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.973+0000 7f3867d9ab80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 0x56131e7622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.973+0000 7f3867d9ab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131e66c3f0 con 0x56131e715af0 2023-08-31T18:49:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.973+0000 7f3867d9ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131e637920 con 0x56131e71a2c0 2023-08-31T18:49:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.973+0000 7f3867d9ab80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x56131e76fe10 con 0x56131e762f60 2023-08-31T18:49:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.973+0000 7f3867d9ab80 10 client.0 ll_register_callbacks cb 0x56131e60cce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T18:49:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.973+0000 7f384a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e76f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.973+0000 7f384a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e76f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49324/0 (socket says 172.21.15.72:49324) 2023-08-31T18:49:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.973+0000 7f384a59c700 1 -- 172.21.15.72:0/1869313136 learned_addr learned my addr 172.21.15.72:0/1869313136 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f384ad9d700 1 --2- 172.21.15.72:0/1869313136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 0x56131e7622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f3849d9b700 1 --2- 172.21.15.72:0/1869313136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 0x56131e761df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f384a59c700 1 -- 172.21.15.72:0/1869313136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 msgr2=0x56131e7622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f384a59c700 1 --2- 172.21.15.72:0/1869313136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 0x56131e7622e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f384a59c700 1 -- 172.21.15.72:0/1869313136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 msgr2=0x56131e761df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f384a59c700 1 --2- 172.21.15.72:0/1869313136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 0x56131e761df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f384a59c700 1 -- 172.21.15.72:0/1869313136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c1642b0 con 0x56131e715af0 2023-08-31T18:49:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f3849d9b700 1 --2- 172.21.15.72:0/1869313136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 0x56131e761df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f384a59c700 1 --2- 172.21.15.72:0/1869313136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e76f920 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f383c018c10 tx=0x7f383c00a000).ready entity=mon.0 client_cookie=5951a71b9a1ec2aa server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f3828ff9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T18:49:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f3828ff9700 1 -- 172.21.15.72:0/1869313136 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c01d070 con 0x56131e715af0 2023-08-31T18:49:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f3828ff9700 1 -- 172.21.15.72:0/1869313136 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f383c018240 con 0x56131e715af0 2023-08-31T18:49:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1869313136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56131e714aa0 con 0x56131e715af0 2023-08-31T18:49:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f3828ff9700 1 -- 172.21.15.72:0/1869313136 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f383c016e80 con 0x56131e715af0 2023-08-31T18:49:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f3867d9ab80 10 client.5181 fetch_fsmap learned FSMap version 15 2023-08-31T18:49:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.974+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1869313136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56131e664f70 con 0x56131e715af0 2023-08-31T18:49:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.975+0000 7f3828ff9700 1 -- 172.21.15.72:0/1869313136 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56131e714aa0 con 0x56131e715af0 2023-08-31T18:49:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.975+0000 7f3828ff9700 1 -- 172.21.15.72:0/1869313136 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f383c001890 con 0x56131e715af0 2023-08-31T18:49:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.975+0000 7f3867d9ab80 10 client.5181 fetch_fsmap finished waiting for FSMap version 15 2023-08-31T18:49:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.975+0000 7f3867d9ab80 10 client.5181 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-31T18:49:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.975+0000 7f3867d9ab80 20 client.5181 populate_metadata read hostname 'smithi072' 2023-08-31T18:49:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.975+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/1869313136 >> [v2:172.21.15.146:6832/1295593403,v1:172.21.15.146:6834/1295593403] conn(0x56131e7718b0 0x56131e771c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.975+0000 7f3867d9ab80 4 client.5181 mds_command: new command op to 4974 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T18:49:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.975+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1869313136 --> [v2:172.21.15.146:6832/1295593403,v1:172.21.15.146:6834/1295593403] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56131e4d4ef0 con 0x56131e7718b0 2023-08-31T18:49:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.975+0000 7f3849d9b700 1 --2- 172.21.15.72:0/1869313136 >> [v2:172.21.15.146:6832/1295593403,v1:172.21.15.146:6834/1295593403] conn(0x56131e7718b0 0x56131e771c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.976+0000 7f3828ff9700 10 client.5181 ms_handle_connect on v2:172.21.15.146:6832/1295593403 2023-08-31T18:49:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.976+0000 7f3849d9b700 1 --2- 172.21.15.72:0/1869313136 >> [v2:172.21.15.146:6832/1295593403,v1:172.21.15.146:6834/1295593403] conn(0x56131e7718b0 0x56131e771c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e03d4b872f61a22c server_cookie=d6e2ee2c3d7c466 in_seq=0 out_seq=0 2023-08-31T18:49:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.977+0000 7f3828ff9700 1 -- 172.21.15.72:0/1869313136 <== mds.0 v2:172.21.15.146:6832/1295593403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x56131e4d4ef0 con 0x56131e7718b0 2023-08-31T18:49:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.977+0000 7f3828ff9700 10 client.5181 handle_command_reply: tid=0 2023-08-31T18:49:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.977+0000 7f3867d9ab80 1 client.5181 shutdown 2023-08-31T18:49:02.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.977+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1869313136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 msgr2=0x56131e76f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:02.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.977+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/1869313136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e76f920 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f383c018c10 tx=0x7f383c00a000).stop 2023-08-31T18:49:02.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.977+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1869313136 shutdown_connections 2023-08-31T18:49:02.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.977+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/1869313136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 0x56131e7622e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.977+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/1869313136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e76f920 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.977+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/1869313136 >> [v2:172.21.15.146:6832/1295593403,v1:172.21.15.146:6834/1295593403] conn(0x56131e7718b0 0x56131e771c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.977+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/1869313136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 0x56131e761df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:02.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.977+0000 7f3828ff9700 0 client.5181 ms_handle_reset on v2:172.21.15.146:6832/1295593403 2023-08-31T18:49:02.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.977+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1869313136 >> 172.21.15.72:0/1869313136 conn(0x56131e584940 msgr2=0x56131e71a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:02.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.978+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1869313136 shutdown_connections 2023-08-31T18:49:02.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.978+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1869313136 wait complete. 2023-08-31T18:49:02.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.978+0000 7f3867d9ab80 20 client.5181 trim_cache size 0 max 16384 2023-08-31T18:49:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.994+0000 7f3867d9ab80 1 Processor -- start 2023-08-31T18:49:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.994+0000 7f3867d9ab80 1 -- start start 2023-08-31T18:49:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.995+0000 7f3867d9ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e715af0 0x56131e710cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.995+0000 7f3867d9ab80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e71a2c0 0x56131e7111c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.995+0000 7f3867d9ab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e762f60 0x56131e7608d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:02.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.995+0000 7f3867d9ab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131e71b6f0 con 0x56131e762f60 2023-08-31T18:49:02.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.995+0000 7f3867d9ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131e717c60 con 0x56131e715af0 2023-08-31T18:49:02.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.995+0000 7f3867d9ab80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x56131e7116b0 con 0x56131e71a2c0 2023-08-31T18:49:02.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.995+0000 7f384ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e762f60 0x56131e7608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:03.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.995+0000 7f384ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e762f60 0x56131e7608d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49330/0 (socket says 172.21.15.72:49330) 2023-08-31T18:49:03.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.995+0000 7f384ad9d700 1 -- 172.21.15.72:0/212664064 learned_addr learned my addr 172.21.15.72:0/212664064 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:03.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.996+0000 7f3849d9b700 1 --2- 172.21.15.72:0/212664064 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e71a2c0 0x56131e7111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:03.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.996+0000 7f384a59c700 1 --2- 172.21.15.72:0/212664064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e715af0 0x56131e710cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:03.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.996+0000 7f384ad9d700 1 -- 172.21.15.72:0/212664064 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e71a2c0 msgr2=0x56131e7111c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.996+0000 7f384ad9d700 1 --2- 172.21.15.72:0/212664064 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e71a2c0 0x56131e7111c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.996+0000 7f384ad9d700 1 -- 172.21.15.72:0/212664064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e715af0 msgr2=0x56131e710cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.996+0000 7f384ad9d700 1 --2- 172.21.15.72:0/212664064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e715af0 0x56131e710cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.996+0000 7f384ad9d700 1 -- 172.21.15.72:0/212664064 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56131e660580 con 0x56131e762f60 2023-08-31T18:49:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.996+0000 7f384a59c700 1 --2- 172.21.15.72:0/212664064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e715af0 0x56131e710cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.996+0000 7f384ad9d700 1 --2- 172.21.15.72:0/212664064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e762f60 0x56131e7608d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f3844050150 tx=0x7f384402d000).ready entity=mon.0 client_cookie=7030d001688ea042 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.996+0000 7f382bfff700 1 -- 172.21.15.72:0/212664064 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400e040 con 0x56131e762f60 2023-08-31T18:49:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.996+0000 7f382bfff700 1 -- 172.21.15.72:0/212664064 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384407b0d0 con 0x56131e762f60 2023-08-31T18:49:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.996+0000 7f382bfff700 1 -- 172.21.15.72:0/212664064 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384404ccd0 con 0x56131e762f60 2023-08-31T18:49:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.997+0000 7f3867d9ab80 1 -- 172.21.15.72:0/212664064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e762f60 msgr2=0x56131e7608d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.997+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/212664064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e762f60 0x56131e7608d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f3844050150 tx=0x7f384402d000).stop 2023-08-31T18:49:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.997+0000 7f3867d9ab80 1 -- 172.21.15.72:0/212664064 shutdown_connections 2023-08-31T18:49:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.997+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/212664064 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e762f60 0x56131e7608d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.997+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/212664064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e715af0 0x56131e710cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.997+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/212664064 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e71a2c0 0x56131e7111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.997+0000 7f3867d9ab80 1 -- 172.21.15.72:0/212664064 >> 172.21.15.72:0/212664064 conn(0x56131e584940 msgr2=0x56131e7633f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:03.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.997+0000 7f3867d9ab80 1 -- 172.21.15.72:0/212664064 shutdown_connections 2023-08-31T18:49:03.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.997+0000 7f3867d9ab80 1 -- 172.21.15.72:0/212664064 wait complete. 2023-08-31T18:49:03.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.997+0000 7f3867d9ab80 1 -- start start 2023-08-31T18:49:03.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.998+0000 7f3867d9ab80 1 Processor -- start 2023-08-31T18:49:03.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f3867d9ab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e7c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:03.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f3867d9ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 0x56131e740c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:03.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f3867d9ab80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 0x56131e748480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:03.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f3867d9ab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131e7419e0 con 0x56131e715af0 2023-08-31T18:49:03.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f3867d9ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131e717080 con 0x56131e71a2c0 2023-08-31T18:49:03.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f3867d9ab80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x56131e7491a0 con 0x56131e762f60 2023-08-31T18:49:03.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f3867d9ab80 10 client.0 ll_register_callbacks cb 0x56131e60cce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T18:49:03.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f384a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e7c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:03.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f384a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e7c4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49344/0 (socket says 172.21.15.72:49344) 2023-08-31T18:49:03.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f384a59c700 1 -- 172.21.15.72:0/1809082846 learned_addr learned my addr 172.21.15.72:0/1809082846 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:03.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f3849d9b700 1 --2- 172.21.15.72:0/1809082846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 0x56131e740c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:03.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f384ad9d700 1 --2- 172.21.15.72:0/1809082846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 0x56131e748480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:03.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f384a59c700 1 -- 172.21.15.72:0/1809082846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 msgr2=0x56131e748480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:03.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f384a59c700 1 --2- 172.21.15.72:0/1809082846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 0x56131e748480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f384a59c700 1 -- 172.21.15.72:0/1809082846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 msgr2=0x56131e740c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:03.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f384a59c700 1 --2- 172.21.15.72:0/1809082846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 0x56131e740c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f384a59c700 1 -- 172.21.15.72:0/1809082846 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56131e63eb00 con 0x56131e715af0 2023-08-31T18:49:03.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f384a59c700 1 --2- 172.21.15.72:0/1809082846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e7c4cd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f383c005e90 tx=0x7f383c015000).ready entity=mon.0 client_cookie=a0ea081645cc4a9b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:03.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:02.999+0000 7f3828ff9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T18:49:03.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.000+0000 7f3828ff9700 1 -- 172.21.15.72:0/1809082846 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c033070 con 0x56131e715af0 2023-08-31T18:49:03.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.000+0000 7f3828ff9700 1 -- 172.21.15.72:0/1809082846 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f383c023c60 con 0x56131e715af0 2023-08-31T18:49:03.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.000+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1809082846 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f384404cb60 con 0x56131e715af0 2023-08-31T18:49:03.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.000+0000 7f3828ff9700 1 -- 172.21.15.72:0/1809082846 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f383c023e20 con 0x56131e715af0 2023-08-31T18:49:03.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.000+0000 7f3867d9ab80 10 client.5187 fetch_fsmap learned FSMap version 15 2023-08-31T18:49:03.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.000+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1809082846 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56131e6602d0 con 0x56131e715af0 2023-08-31T18:49:03.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.000+0000 7f3828ff9700 1 -- 172.21.15.72:0/1809082846 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c03c070 con 0x56131e715af0 2023-08-31T18:49:03.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.000+0000 7f3828ff9700 1 -- 172.21.15.72:0/1809082846 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 15) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f383c015620 con 0x56131e715af0 2023-08-31T18:49:03.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.000+0000 7f3867d9ab80 10 client.5187 fetch_fsmap finished waiting for FSMap version 15 2023-08-31T18:49:03.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.000+0000 7f3867d9ab80 10 client.5187 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-31T18:49:03.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.000+0000 7f3867d9ab80 20 client.5187 populate_metadata read hostname 'smithi072' 2023-08-31T18:49:03.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.000+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/1809082846 >> [v2:172.21.15.146:6832/1295593403,v1:172.21.15.146:6834/1295593403] conn(0x56131e710cd0 0x56131e7110b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:03.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.000+0000 7f3867d9ab80 4 client.5187 mds_command: new command op to 4974 tid=0[{"prefix": "status"}] 2023-08-31T18:49:03.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.000+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1809082846 --> [v2:172.21.15.146:6832/1295593403,v1:172.21.15.146:6834/1295593403] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56131e50a040 con 0x56131e710cd0 2023-08-31T18:49:03.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.001+0000 7f3849d9b700 1 --2- 172.21.15.72:0/1809082846 >> [v2:172.21.15.146:6832/1295593403,v1:172.21.15.146:6834/1295593403] conn(0x56131e710cd0 0x56131e7110b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:03.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.001+0000 7f3828ff9700 10 client.5187 ms_handle_connect on v2:172.21.15.146:6832/1295593403 2023-08-31T18:49:03.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.001+0000 7f3849d9b700 1 --2- 172.21.15.72:0/1809082846 >> [v2:172.21.15.146:6832/1295593403,v1:172.21.15.146:6834/1295593403] conn(0x56131e710cd0 0x56131e7110b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1d96af32a9361dbf server_cookie=300a39041e223bbb in_seq=0 out_seq=0 2023-08-31T18:49:03.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.001+0000 7f3828ff9700 1 -- 172.21.15.72:0/1809082846 <== mds.0 v2:172.21.15.146:6832/1295593403 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56131e50a040 con 0x56131e710cd0 2023-08-31T18:49:03.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.001+0000 7f3828ff9700 10 client.5187 handle_command_reply: tid=0 2023-08-31T18:49:03.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.001+0000 7f3867d9ab80 1 client.5187 shutdown 2023-08-31T18:49:03.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.002+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1809082846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 msgr2=0x56131e7c4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:03.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.002+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/1809082846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e7c4cd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f383c005e90 tx=0x7f383c015000).stop 2023-08-31T18:49:03.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.002+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1809082846 shutdown_connections 2023-08-31T18:49:03.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.002+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/1809082846 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x56131e762f60 0x56131e748480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.002+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/1809082846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x56131e715af0 0x56131e7c4cd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.002+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/1809082846 >> [v2:172.21.15.146:6832/1295593403,v1:172.21.15.146:6834/1295593403] conn(0x56131e710cd0 0x56131e7110b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.002+0000 7f3867d9ab80 1 --2- 172.21.15.72:0/1809082846 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56131e71a2c0 0x56131e740c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.002+0000 7f3828ff9700 0 client.5187 ms_handle_reset on v2:172.21.15.146:6832/1295593403 2023-08-31T18:49:03.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.002+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1809082846 >> 172.21.15.72:0/1809082846 conn(0x56131e584940 msgr2=0x56131e763570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:03.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.002+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1809082846 shutdown_connections 2023-08-31T18:49:03.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.002+0000 7f3867d9ab80 1 -- 172.21.15.72:0/1809082846 wait complete. 2023-08-31T18:49:03.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.002+0000 7f3867d9ab80 20 client.5187 trim_cache size 0 max 16384 2023-08-31T18:49:03.020 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T18:49:03.020 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "acadb8ca-1685-49e1-a73f-5e9d14d95be9", 2023-08-31T18:49:03.020 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-08-31T18:49:03.020 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4974, 2023-08-31T18:49:03.021 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-08-31T18:49:03.021 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-08-31T18:49:03.021 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-08-31T18:49:03.021 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 11.107784011, 2023-08-31T18:49:03.021 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 15, 2023-08-31T18:49:03.022 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 34, 2023-08-31T18:49:03.022 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 34, 2023-08-31T18:49:03.022 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 19.353412857999999 2023-08-31T18:49:03.022 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T18:49:03.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.002+0000 7f38509ff700 1 -- 172.21.15.72:0/3636883740 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f382c05ee10 msgr2=0x7f382c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:03.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.002+0000 7f38509ff700 1 --2- 172.21.15.72:0/3636883740 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f382c05ee10 0x7f382c0612d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f384c0afbc0 tx=0x7f383c007180).stop 2023-08-31T18:49:03.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.003+0000 7f38509ff700 1 -- 172.21.15.72:0/3636883740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f384c157c10 msgr2=0x7f384c0ca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:03.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.003+0000 7f38509ff700 1 --2- 172.21.15.72:0/3636883740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f384c157c10 0x7f384c0ca1b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f384400b610 tx=0x7f384c158bd0).stop 2023-08-31T18:49:03.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.003+0000 7f38509ff700 1 -- 172.21.15.72:0/3636883740 shutdown_connections 2023-08-31T18:49:03.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.003+0000 7f38509ff700 1 --2- 172.21.15.72:0/3636883740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f384c157c10 0x7f384c0ca1b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.003+0000 7f38509ff700 1 --2- 172.21.15.72:0/3636883740 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f382c05ee10 0x7f382c0612d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.003+0000 7f38509ff700 1 --2- 172.21.15.72:0/3636883740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f384c0637c0 0x7f384c14a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.003+0000 7f38509ff700 1 --2- 172.21.15.72:0/3636883740 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f384c0ad1b0 0x7f384c0ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.003+0000 7f38509ff700 1 -- 172.21.15.72:0/3636883740 >> 172.21.15.72:0/3636883740 conn(0x7f384c05eb60 msgr2=0x7f384c0c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:03.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.003+0000 7f38509ff700 1 -- 172.21.15.72:0/3636883740 shutdown_connections 2023-08-31T18:49:03.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.003+0000 7f38509ff700 1 -- 172.21.15.72:0/3636883740 wait complete. 2023-08-31T18:49:03.026 DEBUG:teuthology.orchestra.run.smithi072:> ceph fs ls 2023-08-31T18:49:03.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.184+0000 7f3f4f1ff700 1 Processor -- start 2023-08-31T18:49:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.184+0000 7f3f4f1ff700 1 -- start start 2023-08-31T18:49:03.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.185+0000 7f3f4f1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f480a7f70 0x7f3f480c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:03.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.185+0000 7f3f4f1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f480c7ae0 con 0x7f3f480beb60 2023-08-31T18:49:03.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.185+0000 7f3f4f1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f480c6ed0 con 0x7f3f480c9810 2023-08-31T18:49:03.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.185+0000 7f3f4f1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f480c71b0 con 0x7f3f480a7f70 2023-08-31T18:49:03.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.186+0000 7f3f4d79c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3f480beb60 0x7f3f48064270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48960/0 (socket says 172.21.15.72:48960) 2023-08-31T18:49:03.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.186+0000 7f3f4d79c700 1 -- 172.21.15.72:0/2082181124 learned_addr learned my addr 172.21.15.72:0/2082181124 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:49:03.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.186+0000 7f3f4cf9b700 1 --2- 172.21.15.72:0/2082181124 >> v2:172.21.15.146:3300/0 conn(0x7f3f480a7f70 0x7f3f480c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:03.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.186+0000 7f3f477fe700 1 -- 172.21.15.72:0/2082181124 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603625735 0 0) 0x7f3f480c7ae0 con 0x7f3f480beb60 2023-08-31T18:49:03.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.186+0000 7f3f477fe700 1 -- 172.21.15.72:0/2082181124 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f380033f0 con 0x7f3f480beb60 2023-08-31T18:49:03.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.186+0000 7f3f477fe700 1 -- 172.21.15.72:0/2082181124 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705314130 0 0) 0x7f3f480c6ed0 con 0x7f3f480c9810 2023-08-31T18:49:03.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.186+0000 7f3f477fe700 1 -- 172.21.15.72:0/2082181124 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f480c7ae0 con 0x7f3f480c9810 2023-08-31T18:49:03.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.186+0000 7f3f477fe700 1 -- 172.21.15.72:0/2082181124 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2374604398 0 0) 0x7f3f380033f0 con 0x7f3f480beb60 2023-08-31T18:49:03.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.186+0000 7f3f4cf9b700 1 -- 172.21.15.72:0/2082181124 >> v1:172.21.15.146:6789/0 conn(0x7f3f480c9810 legacy=0x7f3f480c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:03.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.186+0000 7f3f4cf9b700 1 -- 172.21.15.72:0/2082181124 >> v1:172.21.15.72:6789/0 conn(0x7f3f480beb60 legacy=0x7f3f48064270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:03.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.186+0000 7f3f4cf9b700 1 -- 172.21.15.72:0/2082181124 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f480c7490 con 0x7f3f480a7f70 2023-08-31T18:49:03.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.187+0000 7f3f4cf9b700 1 --2- 172.21.15.72:0/2082181124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f480a7f70 0x7f3f480c7f70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f3f3c009760 tx=0x7f3f3c009060).ready entity=mon.1 client_cookie=c006f0438ef75379 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:03.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.187+0000 7f3f477fe700 1 -- 172.21.15.72:0/2082181124 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f400017f0 con 0x7f3f480a7f70 2023-08-31T18:49:03.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.187+0000 7f3f477fe700 1 -- 172.21.15.72:0/2082181124 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c011400 con 0x7f3f480a7f70 2023-08-31T18:49:03.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.187+0000 7f3f477fe700 1 -- 172.21.15.72:0/2082181124 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c011780 con 0x7f3f480a7f70 2023-08-31T18:49:03.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.187+0000 7f3f4f1ff700 1 -- 172.21.15.72:0/2082181124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f480a7f70 msgr2=0x7f3f480c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:03.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.187+0000 7f3f4f1ff700 1 --2- 172.21.15.72:0/2082181124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f480a7f70 0x7f3f480c7f70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f3f3c009760 tx=0x7f3f3c009060).stop 2023-08-31T18:49:03.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.187+0000 7f3f4f1ff700 1 -- 172.21.15.72:0/2082181124 shutdown_connections 2023-08-31T18:49:03.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.187+0000 7f3f4f1ff700 1 --2- 172.21.15.72:0/2082181124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f480a7f70 0x7f3f480c7f70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.187+0000 7f3f4f1ff700 1 -- 172.21.15.72:0/2082181124 >> 172.21.15.72:0/2082181124 conn(0x7f3f48062e30 msgr2=0x7f3f480c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:03.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.187+0000 7f3f4f1ff700 1 -- 172.21.15.72:0/2082181124 shutdown_connections 2023-08-31T18:49:03.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.188+0000 7f3f4f1ff700 1 -- 172.21.15.72:0/2082181124 wait complete. 2023-08-31T18:49:03.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.189+0000 7f3f4f1ff700 1 Processor -- start 2023-08-31T18:49:03.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.189+0000 7f3f4f1ff700 1 -- start start 2023-08-31T18:49:03.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.190+0000 7f3f4f1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f480a7f70 0x7f3f480ad400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:03.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.190+0000 7f3f4f1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f480beb60 0x7f3f480abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:03.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.190+0000 7f3f4f1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f480c9810 0x7f3f48152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:03.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.190+0000 7f3f4f1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480acf70 con 0x7f3f480a7f70 2023-08-31T18:49:03.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.190+0000 7f3f4f1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480ad8f0 con 0x7f3f480c9810 2023-08-31T18:49:03.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.190+0000 7f3f4f1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480ac090 con 0x7f3f480beb60 2023-08-31T18:49:03.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.190+0000 7f3f4cf9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f480a7f70 0x7f3f480ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:03.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.190+0000 7f3f4cf9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f480a7f70 0x7f3f480ad400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49358/0 (socket says 172.21.15.72:49358) 2023-08-31T18:49:03.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.190+0000 7f3f4cf9b700 1 -- 172.21.15.72:0/1196633281 learned_addr learned my addr 172.21.15.72:0/1196633281 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:03.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.191+0000 7f3f4cf9b700 1 -- 172.21.15.72:0/1196633281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f480beb60 msgr2=0x7f3f480abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:03.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.191+0000 7f3f4cf9b700 1 --2- 172.21.15.72:0/1196633281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f480beb60 0x7f3f480abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:03.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.191+0000 7f3f4cf9b700 1 -- 172.21.15.72:0/1196633281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f480c9810 msgr2=0x7f3f48152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:03.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.191+0000 7f3f4cf9b700 1 --2- 172.21.15.72:0/1196633281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f480c9810 0x7f3f48152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:03.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.191+0000 7f3f4cf9b700 1 -- 172.21.15.72:0/1196633281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c0092a0 con 0x7f3f480a7f70 2023-08-31T18:49:03.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.191+0000 7f3f4cf9b700 1 --2- 172.21.15.72:0/1196633281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f480a7f70 0x7f3f480ad400 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f3f3c0118a0 tx=0x7f3f3c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:03.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.191+0000 7f3f44ff9700 1 -- 172.21.15.72:0/1196633281 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c0108e0 con 0x7f3f480a7f70 2023-08-31T18:49:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.191+0000 7f3f44ff9700 1 -- 172.21.15.72:0/1196633281 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c010a40 con 0x7f3f480a7f70 2023-08-31T18:49:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.191+0000 7f3f44ff9700 1 -- 172.21.15.72:0/1196633281 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c010dc0 con 0x7f3f480a7f70 2023-08-31T18:49:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.191+0000 7f3f4f1ff700 1 -- 172.21.15.72:0/1196633281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f480ac360 con 0x7f3f480a7f70 2023-08-31T18:49:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.191+0000 7f3f4f1ff700 1 -- 172.21.15.72:0/1196633281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f480ac920 con 0x7f3f480a7f70 2023-08-31T18:49:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.192+0000 7f3f4f1ff700 1 -- 172.21.15.72:0/1196633281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f48047480 con 0x7f3f480a7f70 2023-08-31T18:49:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.193+0000 7f3f44ff9700 1 -- 172.21.15.72:0/1196633281 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f3f3c01d640 con 0x7f3f480a7f70 2023-08-31T18:49:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.194+0000 7f3f44ff9700 1 --2- 172.21.15.72:0/1196633281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f2c05ee10 0x7f3f2c0612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.194+0000 7f3f44ff9700 1 -- 172.21.15.72:0/1196633281 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3f3c07b450 con 0x7f3f480a7f70 2023-08-31T18:49:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.194+0000 7f3f47fff700 1 --2- 172.21.15.72:0/1196633281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f2c05ee10 0x7f3f2c0612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.195+0000 7f3f47fff700 1 --2- 172.21.15.72:0/1196633281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f2c05ee10 0x7f3f2c0612d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f3f48167870 tx=0x7f3f34007810).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:03.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.198+0000 7f3f44ff9700 1 -- 172.21.15.72:0/1196633281 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3f3c04c800 con 0x7f3f480a7f70 2023-08-31T18:49:03.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.418+0000 7f3f4f1ff700 1 -- 172.21.15.72:0/1196633281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3f4805ed00 con 0x7f3f480a7f70 2023-08-31T18:49:03.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.419+0000 7f3f44ff9700 1 -- 172.21.15.72:0/1196633281 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3f3c04fe20 con 0x7f3f480a7f70 2023-08-31T18:49:03.420 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T18:49:03.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.421+0000 7f3f4f1ff700 1 -- 172.21.15.72:0/1196633281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f2c05ee10 msgr2=0x7f3f2c0612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:03.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.421+0000 7f3f4f1ff700 1 --2- 172.21.15.72:0/1196633281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f2c05ee10 0x7f3f2c0612d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f3f48167870 tx=0x7f3f34007810).stop 2023-08-31T18:49:03.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.421+0000 7f3f4f1ff700 1 -- 172.21.15.72:0/1196633281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f480a7f70 msgr2=0x7f3f480ad400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:03.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.421+0000 7f3f4f1ff700 1 --2- 172.21.15.72:0/1196633281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f480a7f70 0x7f3f480ad400 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f3f3c0118a0 tx=0x7f3f3c016000).stop 2023-08-31T18:49:03.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.421+0000 7f3f4f1ff700 1 -- 172.21.15.72:0/1196633281 shutdown_connections 2023-08-31T18:49:03.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.421+0000 7f3f4f1ff700 1 --2- 172.21.15.72:0/1196633281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f2c05ee10 0x7f3f2c0612d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.421+0000 7f3f4f1ff700 1 --2- 172.21.15.72:0/1196633281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f480c9810 0x7f3f48152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:03.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.421+0000 7f3f4f1ff700 1 --2- 172.21.15.72:0/1196633281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f480a7f70 0x7f3f480ad400 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:03.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.421+0000 7f3f4f1ff700 1 --2- 172.21.15.72:0/1196633281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f480beb60 0x7f3f480abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.421+0000 7f3f4f1ff700 1 -- 172.21.15.72:0/1196633281 >> 172.21.15.72:0/1196633281 conn(0x7f3f48062e30 msgr2=0x7f3f48066320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.421+0000 7f3f4f1ff700 1 -- 172.21.15.72:0/1196633281 shutdown_connections 2023-08-31T18:49:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:03.421+0000 7f3f4f1ff700 1 -- 172.21.15.72:0/1196633281 wait complete. 2023-08-31T18:49:03.436 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-31T18:49:03.437 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T18:49:03.438 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-31T18:49:03.439 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T18:49:03.439 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T18:49:03.440 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-31T18:49:03.440 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-31T18:49:03.441 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T18:49:03.442 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T18:49:03.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:49:03.443 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-31T18:49:03.491 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T18:49:03.491 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T18:49:03.492 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T18:49:03.492 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:49:03.492 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-31T18:49:03.492 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:49:03.492 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T18:49:03.493 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-31T18:49:03.493 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-31T18:49:03.493 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T18:49:03.493 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-31T18:49:03.493 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-31T18:49:03.494 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T18:49:03.494 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-31T18:49:03.494 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T18:49:03.495 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-31T18:49:03.495 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T18:49:03.495 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 37933sec preferred_lft 37933sec 2023-08-31T18:49:03.495 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-31T18:49:03.495 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:49:03.495 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T18:49:03.496 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff 2023-08-31T18:49:03.496 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T18:49:03.496 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:49:03.496 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::7c68:c9ff:fe82:9771/64 scope link 2023-08-31T18:49:03.496 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:49:03.497 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T18:49:03.497 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e2:e1:71:f6:f6:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T18:49:03.497 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e0e1:71ff:fef6:f6fa/64 scope link 2023-08-31T18:49:03.497 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:49:03.497 INFO:teuthology.orchestra.run.smithi072.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T18:49:03.498 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T18:49:03.498 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::38f6:6ff:fe3c:1ef/64 scope link 2023-08-31T18:49:03.498 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T18:49:03.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:49:03.499 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T18:49:03.599 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-31T18:49:03.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:49:03.603 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-31T18:49:03.652 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-31T18:49:03.652 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T18:49:03.652 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T18:49:03.653 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T18:49:03.653 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T18:49:03.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:49:03.654 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T18:49:03.654 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T18:49:03.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T18:49:03.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T18:49:03.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T18:49:03.656 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T18:49:03.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:49:03.825 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T18:49:03.872 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T18:49:03.872 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T18:49:03.873 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T18:49:03.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:49:03.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-08-31T18:49:03.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:49:03.945 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-31T18:49:03.991 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-31T18:49:03.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T18:49:04.128 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T18:49:04.128 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T18:49:04.156 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T18:49:04.156 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T18:49:04.160 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-31T18:49:04.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T18:49:04.161 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T18:49:04.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-31T18:49:04.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.422+0000 7f22087ff700 1 Processor -- start 2023-08-31T18:49:04.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.423+0000 7f22087ff700 1 -- start start 2023-08-31T18:49:04.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.424+0000 7f22087ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2200152140 0x7f22000a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:04.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.424+0000 7f22087ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22000a9ef0 0x7f22000be140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:04.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.424+0000 7f22087ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2200156970 con 0x7f22000be630 2023-08-31T18:49:04.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.424+0000 7f22087ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2200156e00 con 0x7f22000a9ef0 2023-08-31T18:49:04.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.424+0000 7f22087ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22000bea70 con 0x7f2200152140 2023-08-31T18:49:04.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.424+0000 7f2205d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22000a9ef0 0x7f22000be140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:04.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.424+0000 7f2205d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22000a9ef0 0x7f22000be140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49370/0 (socket says 172.21.15.72:49370) 2023-08-31T18:49:04.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.424+0000 7f2205d9a700 1 -- 172.21.15.72:0/3425085221 learned_addr learned my addr 172.21.15.72:0/3425085221 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:04.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.425+0000 7f220659b700 1 --2- 172.21.15.72:0/3425085221 >> v2:172.21.15.146:3300/0 conn(0x7f2200152140 0x7f22000a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:04.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.425+0000 7f2205d9a700 1 -- 172.21.15.72:0/3425085221 >> v2:172.21.15.146:3300/0 conn(0x7f2200152140 msgr2=0x7f22000a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:04.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.425+0000 7f2205d9a700 1 --2- 172.21.15.72:0/3425085221 >> v2:172.21.15.146:3300/0 conn(0x7f2200152140 0x7f22000a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:04.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.425+0000 7f2205d9a700 1 -- 172.21.15.72:0/3425085221 >> v1:172.21.15.146:6789/0 conn(0x7f22000be630 legacy=0x7f2200062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:04.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.425+0000 7f2205d9a700 1 -- 172.21.15.72:0/3425085221 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22000bcba0 con 0x7f22000a9ef0 2023-08-31T18:49:04.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.425+0000 7f220659b700 1 --2- 172.21.15.72:0/3425085221 >> v2:172.21.15.146:3300/0 conn(0x7f2200152140 0x7f22000a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.425+0000 7f2205d9a700 1 --2- 172.21.15.72:0/3425085221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22000a9ef0 0x7f22000be140 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f22000addf0 tx=0x7f21f00090f0).ready entity=mon.0 client_cookie=669449df88ac6a92 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.425+0000 7f2205599700 1 -- 172.21.15.72:0/3425085221 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f000b5a0 con 0x7f22000a9ef0 2023-08-31T18:49:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.425+0000 7f2205599700 1 -- 172.21.15.72:0/3425085221 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f000b700 con 0x7f22000a9ef0 2023-08-31T18:49:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.425+0000 7f2205599700 1 -- 172.21.15.72:0/3425085221 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f000ba80 con 0x7f22000a9ef0 2023-08-31T18:49:04.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.426+0000 7f22087ff700 1 -- 172.21.15.72:0/3425085221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22000a9ef0 msgr2=0x7f22000be140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:04.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.426+0000 7f22087ff700 1 --2- 172.21.15.72:0/3425085221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22000a9ef0 0x7f22000be140 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f22000addf0 tx=0x7f21f00090f0).stop 2023-08-31T18:49:04.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.426+0000 7f22087ff700 1 -- 172.21.15.72:0/3425085221 shutdown_connections 2023-08-31T18:49:04.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.426+0000 7f22087ff700 1 --2- 172.21.15.72:0/3425085221 >> v2:172.21.15.146:3300/0 conn(0x7f2200152140 0x7f22000a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:04.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.426+0000 7f22087ff700 1 --2- 172.21.15.72:0/3425085221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22000a9ef0 0x7f22000be140 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:04.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.426+0000 7f22087ff700 1 -- 172.21.15.72:0/3425085221 >> 172.21.15.72:0/3425085221 conn(0x7f2200064230 msgr2=0x7f22000c7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:04.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.426+0000 7f22087ff700 1 -- 172.21.15.72:0/3425085221 shutdown_connections 2023-08-31T18:49:04.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.426+0000 7f22087ff700 1 -- 172.21.15.72:0/3425085221 wait complete. 2023-08-31T18:49:04.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.427+0000 7f22087ff700 1 Processor -- start 2023-08-31T18:49:04.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.427+0000 7f22087ff700 1 -- start start 2023-08-31T18:49:04.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.428+0000 7f22087ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22000a9ef0 0x7f22000ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:04.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.428+0000 7f22087ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22000be630 0x7f2200165610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:04.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.428+0000 7f22087ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2200152140 0x7f22000ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:04.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.428+0000 7f22087ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22000aabd0 con 0x7f2200152140 2023-08-31T18:49:04.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.428+0000 7f22087ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22000ab430 con 0x7f22000be630 2023-08-31T18:49:04.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.428+0000 7f22087ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22000c6a30 con 0x7f22000a9ef0 2023-08-31T18:49:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.429+0000 7f2206d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2200152140 0x7f22000ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.429+0000 7f2206d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2200152140 0x7f22000ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49386/0 (socket says 172.21.15.72:49386) 2023-08-31T18:49:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.429+0000 7f2206d9c700 1 -- 172.21.15.72:0/218851189 learned_addr learned my addr 172.21.15.72:0/218851189 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.429+0000 7f2205d9a700 1 --2- 172.21.15.72:0/218851189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22000be630 0x7f2200165610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.429+0000 7f220659b700 1 --2- 172.21.15.72:0/218851189 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22000a9ef0 0x7f22000ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.429+0000 7f2206d9c700 1 -- 172.21.15.72:0/218851189 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22000a9ef0 msgr2=0x7f22000ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.429+0000 7f2206d9c700 1 --2- 172.21.15.72:0/218851189 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22000a9ef0 0x7f22000ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.429+0000 7f2206d9c700 1 -- 172.21.15.72:0/218851189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22000be630 msgr2=0x7f2200165610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.429+0000 7f2206d9c700 1 --2- 172.21.15.72:0/218851189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22000be630 0x7f2200165610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.429+0000 7f2206d9c700 1 -- 172.21.15.72:0/218851189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f0009370 con 0x7f2200152140 2023-08-31T18:49:04.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.429+0000 7f2206d9c700 1 --2- 172.21.15.72:0/218851189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2200152140 0x7f22000ac6e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f21f800c840 tx=0x7f21f8002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:04.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.429+0000 7f21f67fc700 1 -- 172.21.15.72:0/218851189 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8010510 con 0x7f2200152140 2023-08-31T18:49:04.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.429+0000 7f21f67fc700 1 -- 172.21.15.72:0/218851189 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f8010690 con 0x7f2200152140 2023-08-31T18:49:04.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.429+0000 7f22087ff700 1 -- 172.21.15.72:0/218851189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22000aade0 con 0x7f2200152140 2023-08-31T18:49:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.429+0000 7f21f67fc700 1 -- 172.21.15.72:0/218851189 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8010a50 con 0x7f2200152140 2023-08-31T18:49:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.430+0000 7f22087ff700 1 -- 172.21.15.72:0/218851189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2200165b00 con 0x7f2200152140 2023-08-31T18:49:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.431+0000 7f22087ff700 1 -- 172.21.15.72:0/218851189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22000c6d10 con 0x7f2200152140 2023-08-31T18:49:04.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.431+0000 7f21f67fc700 1 -- 172.21.15.72:0/218851189 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f21f8012440 con 0x7f2200152140 2023-08-31T18:49:04.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.432+0000 7f21f67fc700 1 --2- 172.21.15.72:0/218851189 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f21e405ede0 0x7f21e40612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:04.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.432+0000 7f21f67fc700 1 -- 172.21.15.72:0/218851189 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f21f8079860 con 0x7f2200152140 2023-08-31T18:49:04.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.432+0000 7f220659b700 1 --2- 172.21.15.72:0/218851189 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f21e405ede0 0x7f21e40612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:04.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.433+0000 7f220659b700 1 --2- 172.21.15.72:0/218851189 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f21e405ede0 0x7f21e40612a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f21fc00ab40 tx=0x7f21fc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:04.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.436+0000 7f21f67fc700 1 -- 172.21.15.72:0/218851189 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f21f80488f0 con 0x7f2200152140 2023-08-31T18:49:04.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.632+0000 7f22087ff700 1 -- 172.21.15.72:0/218851189 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f22000ab5c0 con 0x7f21e405ede0 2023-08-31T18:49:04.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.633+0000 7f21f67fc700 1 -- 172.21.15.72:0/218851189 <== mgr.4101 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f22000ab5c0 con 0x7f21e405ede0 2023-08-31T18:49:04.634 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T18:49:04.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T18:49:04.634 INFO:teuthology.orchestra.run.smithi072.stdout: "name": "cephfs" 2023-08-31T18:49:04.634 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T18:49:04.635 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T18:49:04.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.635+0000 7f22087ff700 1 -- 172.21.15.72:0/218851189 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f21e405ede0 msgr2=0x7f21e40612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:04.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.635+0000 7f22087ff700 1 --2- 172.21.15.72:0/218851189 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f21e405ede0 0x7f21e40612a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f21fc00ab40 tx=0x7f21fc008040).stop 2023-08-31T18:49:04.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.635+0000 7f22087ff700 1 -- 172.21.15.72:0/218851189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2200152140 msgr2=0x7f22000ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:04.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.635+0000 7f22087ff700 1 --2- 172.21.15.72:0/218851189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2200152140 0x7f22000ac6e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f21f800c840 tx=0x7f21f8002560).stop 2023-08-31T18:49:04.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.635+0000 7f22087ff700 1 -- 172.21.15.72:0/218851189 shutdown_connections 2023-08-31T18:49:04.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.635+0000 7f22087ff700 1 --2- 172.21.15.72:0/218851189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2200152140 0x7f22000ac6e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:04.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.635+0000 7f22087ff700 1 --2- 172.21.15.72:0/218851189 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22000a9ef0 0x7f22000ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:04.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.635+0000 7f22087ff700 1 --2- 172.21.15.72:0/218851189 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f21e405ede0 0x7f21e40612a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.635+0000 7f22087ff700 1 --2- 172.21.15.72:0/218851189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22000be630 0x7f2200165610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.635+0000 7f22087ff700 1 -- 172.21.15.72:0/218851189 >> 172.21.15.72:0/218851189 conn(0x7f2200064230 msgr2=0x7f220014c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.635+0000 7f22087ff700 1 -- 172.21.15.72:0/218851189 shutdown_connections 2023-08-31T18:49:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.635+0000 7f22087ff700 1 -- 172.21.15.72:0/218851189 wait complete. 2023-08-31T18:49:04.653 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-31T18:49:04.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.844+0000 7f785dfff700 1 Processor -- start 2023-08-31T18:49:04.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.845+0000 7f785dfff700 1 -- start start 2023-08-31T18:49:04.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.846+0000 7f785dfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7858154210 0x7f78580630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:04.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.846+0000 7f785dfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7858063a30 con 0x7f7858153e30 2023-08-31T18:49:04.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.846+0000 7f785dfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78580bfd40 con 0x7f78580635a0 2023-08-31T18:49:04.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.846+0000 7f785dfff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78581546c0 con 0x7f7858154210 2023-08-31T18:49:04.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.846+0000 7f78577fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7858153e30 0x7f78580c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48976/0 (socket says 172.21.15.72:48976) 2023-08-31T18:49:04.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.846+0000 7f78577fe700 1 -- 172.21.15.72:0/2926079297 learned_addr learned my addr 172.21.15.72:0/2926079297 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:49:04.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.846+0000 7f78567fc700 1 -- 172.21.15.72:0/2926079297 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923816032 0 0) 0x7f7858063a30 con 0x7f7858153e30 2023-08-31T18:49:04.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f78567fc700 1 -- 172.21.15.72:0/2926079297 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78400033f0 con 0x7f7858153e30 2023-08-31T18:49:04.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.846+0000 7f7856ffd700 1 --2- 172.21.15.72:0/2926079297 >> v2:172.21.15.146:3300/0 conn(0x7f7858154210 0x7f78580630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f78567fc700 1 -- 172.21.15.72:0/2926079297 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2657741183 0 0) 0x7f78400033f0 con 0x7f7858153e30 2023-08-31T18:49:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f78567fc700 1 -- 172.21.15.72:0/2926079297 >> v2:172.21.15.146:3300/0 conn(0x7f7858154210 msgr2=0x7f78580630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f78567fc700 1 --2- 172.21.15.72:0/2926079297 >> v2:172.21.15.146:3300/0 conn(0x7f7858154210 0x7f78580630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:04.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f78567fc700 1 -- 172.21.15.72:0/2926079297 >> v1:172.21.15.146:6789/0 conn(0x7f78580635a0 legacy=0x7f78580c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f78567fc700 1 -- 172.21.15.72:0/2926079297 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78580c6730 con 0x7f7858153e30 2023-08-31T18:49:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f78567fc700 1 -- 172.21.15.72:0/2926079297 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f7848001470 con 0x7f7858153e30 2023-08-31T18:49:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f78567fc700 1 -- 172.21.15.72:0/2926079297 >> v1:172.21.15.72:6789/0 conn(0x7f7858153e30 legacy=0x7f78580c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f78567fc700 1 --2- 172.21.15.72:0/2926079297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78400038e0 0x7f7840003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f78567fc700 1 --2- 172.21.15.72:0/2926079297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7840004690 0x7f7840004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:04.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f78567fc700 1 --2- 172.21.15.72:0/2926079297 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7840005000 0x7f784000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:04.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f78567fc700 1 -- 172.21.15.72:0/2926079297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784000bf60 con 0x7f78400038e0 2023-08-31T18:49:04.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f78567fc700 1 -- 172.21.15.72:0/2926079297 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784000c0a0 con 0x7f7840004690 2023-08-31T18:49:04.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f78567fc700 1 -- 172.21.15.72:0/2926079297 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784000c230 con 0x7f7840005000 2023-08-31T18:49:04.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f78577fe700 1 --2- 172.21.15.72:0/2926079297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78400038e0 0x7f7840003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:04.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f7856ffd700 1 --2- 172.21.15.72:0/2926079297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7840004690 0x7f7840004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:04.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.847+0000 7f7857fff700 1 --2- 172.21.15.72:0/2926079297 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7840005000 0x7f784000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:04.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.848+0000 7f7856ffd700 1 -- 172.21.15.72:0/2926079297 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7840005000 msgr2=0x7f784000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:04.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.848+0000 7f7856ffd700 1 --2- 172.21.15.72:0/2926079297 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7840005000 0x7f784000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:04.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.848+0000 7f7856ffd700 1 -- 172.21.15.72:0/2926079297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78400038e0 msgr2=0x7f7840003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:04.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.848+0000 7f7856ffd700 1 --2- 172.21.15.72:0/2926079297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78400038e0 0x7f7840003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:04.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.848+0000 7f7856ffd700 1 -- 172.21.15.72:0/2926079297 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78400033f0 con 0x7f7840004690 2023-08-31T18:49:04.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.848+0000 7f7857fff700 1 -- 172.21.15.72:0/2926079297 reap_dead start 2023-08-31T18:49:04.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.848+0000 7f7856ffd700 1 --2- 172.21.15.72:0/2926079297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7840004690 0x7f7840004b10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f784c009a80 tx=0x7f784c009060).ready entity=mon.1 client_cookie=da5200bb1217577c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:04.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.848+0000 7f78567fc700 1 -- 172.21.15.72:0/2926079297 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c009430 con 0x7f7840004690 2023-08-31T18:49:04.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.848+0000 7f78567fc700 1 -- 172.21.15.72:0/2926079297 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c00e640 con 0x7f7840004690 2023-08-31T18:49:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.848+0000 7f78567fc700 1 -- 172.21.15.72:0/2926079297 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c00e9c0 con 0x7f7840004690 2023-08-31T18:49:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.849+0000 7f785dfff700 1 -- 172.21.15.72:0/2926079297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7840004690 msgr2=0x7f7840004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.849+0000 7f785dfff700 1 --2- 172.21.15.72:0/2926079297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7840004690 0x7f7840004b10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f784c009a80 tx=0x7f784c009060).stop 2023-08-31T18:49:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.849+0000 7f785dfff700 1 -- 172.21.15.72:0/2926079297 shutdown_connections 2023-08-31T18:49:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.849+0000 7f785dfff700 1 --2- 172.21.15.72:0/2926079297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7840004690 0x7f7840004b10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:04.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.849+0000 7f785dfff700 1 -- 172.21.15.72:0/2926079297 >> 172.21.15.72:0/2926079297 conn(0x7f785805eb20 msgr2=0x7f78580cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:04.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.849+0000 7f785dfff700 1 -- 172.21.15.72:0/2926079297 shutdown_connections 2023-08-31T18:49:04.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.849+0000 7f785dfff700 1 -- 172.21.15.72:0/2926079297 wait complete. 2023-08-31T18:49:04.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.850+0000 7f785dfff700 1 Processor -- start 2023-08-31T18:49:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.851+0000 7f785dfff700 1 -- start start 2023-08-31T18:49:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.851+0000 7f785dfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7840004690 0x7f78580b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.851+0000 7f785dfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78581641b0 0x7f785814d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.851+0000 7f785dfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f785814dc70 0x7f78580c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.851+0000 7f785dfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78580ae9a0 con 0x7f78581641b0 2023-08-31T18:49:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.851+0000 7f785dfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78580add90 con 0x7f7840004690 2023-08-31T18:49:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.851+0000 7f785dfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78580ae070 con 0x7f785814dc70 2023-08-31T18:49:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.852+0000 7f7856ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78581641b0 0x7f785814d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.852+0000 7f7856ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78581641b0 0x7f785814d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49398/0 (socket says 172.21.15.72:49398) 2023-08-31T18:49:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.852+0000 7f7856ffd700 1 -- 172.21.15.72:0/3626378484 learned_addr learned my addr 172.21.15.72:0/3626378484 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.852+0000 7f78577fe700 1 --2- 172.21.15.72:0/3626378484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7840004690 0x7f78580b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.852+0000 7f7857fff700 1 --2- 172.21.15.72:0/3626378484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f785814dc70 0x7f78580c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.852+0000 7f7856ffd700 1 -- 172.21.15.72:0/3626378484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f785814dc70 msgr2=0x7f78580c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:04.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.852+0000 7f7856ffd700 1 --2- 172.21.15.72:0/3626378484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f785814dc70 0x7f78580c1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:04.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.852+0000 7f7856ffd700 1 -- 172.21.15.72:0/3626378484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7840004690 msgr2=0x7f78580b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:04.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.852+0000 7f7856ffd700 1 --2- 172.21.15.72:0/3626378484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7840004690 0x7f78580b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:04.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.852+0000 7f7856ffd700 1 -- 172.21.15.72:0/3626378484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78580ae350 con 0x7f78581641b0 2023-08-31T18:49:04.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.852+0000 7f78577fe700 1 --2- 172.21.15.72:0/3626378484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7840004690 0x7f78580b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:49:04.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.852+0000 7f7856ffd700 1 --2- 172.21.15.72:0/3626378484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78581641b0 0x7f785814d780 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f7840005670 tx=0x7f784c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:04.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.852+0000 7f783f7fe700 1 -- 172.21.15.72:0/3626378484 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c00ed30 con 0x7f78581641b0 2023-08-31T18:49:04.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.852+0000 7f783f7fe700 1 -- 172.21.15.72:0/3626378484 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c00ee90 con 0x7f78581641b0 2023-08-31T18:49:04.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.852+0000 7f783f7fe700 1 -- 172.21.15.72:0/3626378484 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c00e9c0 con 0x7f78581641b0 2023-08-31T18:49:04.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.853+0000 7f785dfff700 1 -- 172.21.15.72:0/3626378484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78580ae630 con 0x7f78581641b0 2023-08-31T18:49:04.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.853+0000 7f785dfff700 1 -- 172.21.15.72:0/3626378484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78580c2370 con 0x7f78581641b0 2023-08-31T18:49:04.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.854+0000 7f785dfff700 1 -- 172.21.15.72:0/3626378484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78580aeb10 con 0x7f78581641b0 2023-08-31T18:49:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.854+0000 7f783f7fe700 1 -- 172.21.15.72:0/3626378484 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 75272+0+0 (secure 0 0 0) 0x7f784c024600 con 0x7f78581641b0 2023-08-31T18:49:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.855+0000 7f783f7fe700 1 --2- 172.21.15.72:0/3626378484 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f784405ee10 0x7f78440612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.855+0000 7f783f7fe700 1 -- 172.21.15.72:0/3626378484 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f784c07b3b0 con 0x7f78581641b0 2023-08-31T18:49:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.855+0000 7f78577fe700 1 --2- 172.21.15.72:0/3626378484 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f784405ee10 0x7f78440612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.856+0000 7f78577fe700 1 --2- 172.21.15.72:0/3626378484 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f784405ee10 0x7f78440612d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f7848001ce0 tx=0x7f7848009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:04.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:04.859+0000 7f783f7fe700 1 -- 172.21.15.72:0/3626378484 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f784c04c7b0 con 0x7f78581641b0 2023-08-31T18:49:05.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.072+0000 7f785dfff700 1 -- 172.21.15.72:0/3626378484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f785806c6b0 con 0x7f78581641b0 2023-08-31T18:49:05.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.298+0000 7f783f7fe700 1 -- 172.21.15.72:0/3626378484 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 5) v1 ==== 75289+0+0 (secure 0 0 0) 0x7f784c07b080 con 0x7f78581641b0 2023-08-31T18:49:05.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.299+0000 7f783f7fe700 1 -- 172.21.15.72:0/3626378484 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v5) v1 ==== 92+0+0 (secure 0 0 0) 0x7f784c053000 con 0x7f78581641b0 2023-08-31T18:49:05.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.302+0000 7f785dfff700 1 -- 172.21.15.72:0/3626378484 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f784405ee10 msgr2=0x7f78440612d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:05.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.302+0000 7f785dfff700 1 --2- 172.21.15.72:0/3626378484 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f784405ee10 0x7f78440612d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f7848001ce0 tx=0x7f7848009040).stop 2023-08-31T18:49:05.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.302+0000 7f785dfff700 1 -- 172.21.15.72:0/3626378484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78581641b0 msgr2=0x7f785814d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:05.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.302+0000 7f785dfff700 1 --2- 172.21.15.72:0/3626378484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78581641b0 0x7f785814d780 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f7840005670 tx=0x7f784c01a000).stop 2023-08-31T18:49:05.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.302+0000 7f785dfff700 1 -- 172.21.15.72:0/3626378484 shutdown_connections 2023-08-31T18:49:05.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.302+0000 7f785dfff700 1 --2- 172.21.15.72:0/3626378484 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f785814dc70 0x7f78580c1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:05.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.302+0000 7f785dfff700 1 --2- 172.21.15.72:0/3626378484 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f784405ee10 0x7f78440612d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:05.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.302+0000 7f785dfff700 1 --2- 172.21.15.72:0/3626378484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7840004690 0x7f78580b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:05.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.302+0000 7f785dfff700 1 --2- 172.21.15.72:0/3626378484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78581641b0 0x7f785814d780 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:05.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.302+0000 7f785dfff700 1 -- 172.21.15.72:0/3626378484 >> 172.21.15.72:0/3626378484 conn(0x7f785805eb20 msgr2=0x7f78580c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:05.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.302+0000 7f785dfff700 1 -- 172.21.15.72:0/3626378484 shutdown_connections 2023-08-31T18:49:05.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.302+0000 7f785dfff700 1 -- 172.21.15.72:0/3626378484 wait complete. 2023-08-31T18:49:05.320 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-31T18:49:05.505 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:05.505+0000 7f6d50951680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T18:49:05.515 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:05.515+0000 7ff25a312680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T18:49:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.518+0000 7f68a4fff700 1 Processor -- start 2023-08-31T18:49:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.518+0000 7f68a4fff700 1 -- start start 2023-08-31T18:49:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.520+0000 7f68a4fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68a01544e0 0x7f68a005e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f68a4fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a00c38d0 0x7f68a00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f68a4fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f68a0068ec0 0x7f68a0062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:05.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f68a4fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a005e840 con 0x7f68a01544e0 2023-08-31T18:49:05.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f68a4fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a00bc4a0 con 0x7f68a0068ec0 2023-08-31T18:49:05.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f68a4fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0069350 con 0x7f68a00c38d0 2023-08-31T18:49:05.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f689e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68a01544e0 0x7f68a005e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:05.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f689e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68a01544e0 0x7f68a005e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49424/0 (socket says 172.21.15.72:49424) 2023-08-31T18:49:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f689e59c700 1 -- 172.21.15.72:0/1244175690 learned_addr learned my addr 172.21.15.72:0/1244175690 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f689dd9b700 1 --2- 172.21.15.72:0/1244175690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a00c38d0 0x7f68a00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f689ed9d700 1 --2- 172.21.15.72:0/1244175690 >> v2:172.21.15.146:3300/0 conn(0x7f68a0068ec0 0x7f68a0062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f689e59c700 1 -- 172.21.15.72:0/1244175690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a00c38d0 msgr2=0x7f68a00689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f689e59c700 1 --2- 172.21.15.72:0/1244175690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a00c38d0 0x7f68a00689d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:05.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f689e59c700 1 -- 172.21.15.72:0/1244175690 >> v2:172.21.15.146:3300/0 conn(0x7f68a0068ec0 msgr2=0x7f68a0062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:05.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f689e59c700 1 --2- 172.21.15.72:0/1244175690 >> v2:172.21.15.146:3300/0 conn(0x7f68a0068ec0 0x7f68a0062650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:05.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f689e59c700 1 -- 172.21.15.72:0/1244175690 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a0069c40 con 0x7f68a01544e0 2023-08-31T18:49:05.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f689dd9b700 1 --2- 172.21.15.72:0/1244175690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a00c38d0 0x7f68a00689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:49:05.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.521+0000 7f689ed9d700 1 --2- 172.21.15.72:0/1244175690 >> v2:172.21.15.146:3300/0 conn(0x7f68a0068ec0 0x7f68a0062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:49:05.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.522+0000 7f689e59c700 1 --2- 172.21.15.72:0/1244175690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68a01544e0 0x7f68a005e350 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f68a005f040 tx=0x7f68900090f0).ready entity=mon.0 client_cookie=6d5f0d2f413a9504 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:05.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.522+0000 7f689d59a700 1 -- 172.21.15.72:0/1244175690 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689000b600 con 0x7f68a01544e0 2023-08-31T18:49:05.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.522+0000 7f689d59a700 1 -- 172.21.15.72:0/1244175690 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689000b760 con 0x7f68a01544e0 2023-08-31T18:49:05.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.522+0000 7f689d59a700 1 -- 172.21.15.72:0/1244175690 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689000bb00 con 0x7f68a01544e0 2023-08-31T18:49:05.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.523+0000 7f68a4fff700 1 -- 172.21.15.72:0/1244175690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68a01544e0 msgr2=0x7f68a005e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.523+0000 7f68a4fff700 1 --2- 172.21.15.72:0/1244175690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68a01544e0 0x7f68a005e350 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f68a005f040 tx=0x7f68900090f0).stop 2023-08-31T18:49:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.523+0000 7f68a4fff700 1 -- 172.21.15.72:0/1244175690 shutdown_connections 2023-08-31T18:49:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.523+0000 7f68a4fff700 1 --2- 172.21.15.72:0/1244175690 >> v2:172.21.15.146:3300/0 conn(0x7f68a0068ec0 0x7f68a0062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.523+0000 7f68a4fff700 1 --2- 172.21.15.72:0/1244175690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68a01544e0 0x7f68a005e350 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:05.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.523+0000 7f68a4fff700 1 --2- 172.21.15.72:0/1244175690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a00c38d0 0x7f68a00689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:05.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.523+0000 7f68a4fff700 1 -- 172.21.15.72:0/1244175690 >> 172.21.15.72:0/1244175690 conn(0x7f68a00c7e00 msgr2=0x7f68a00c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:05.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.523+0000 7f68a4fff700 1 -- 172.21.15.72:0/1244175690 shutdown_connections 2023-08-31T18:49:05.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.523+0000 7f68a4fff700 1 -- 172.21.15.72:0/1244175690 wait complete. 2023-08-31T18:49:05.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.524+0000 7f68a4fff700 1 Processor -- start 2023-08-31T18:49:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.524+0000 7f68a4fff700 1 -- start start 2023-08-31T18:49:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.525+0000 7f68a4fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68a0068ec0 0x7f68a0167fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.525+0000 7f68a4fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a00c38d0 0x7f68a014cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.525+0000 7f68a4fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a01544e0 0x7f68a0152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.525+0000 7f68a4fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a00c09f0 con 0x7f68a0068ec0 2023-08-31T18:49:05.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.525+0000 7f68a4fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a00bfb40 con 0x7f68a00c38d0 2023-08-31T18:49:05.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.525+0000 7f68a4fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a01684d0 con 0x7f68a01544e0 2023-08-31T18:49:05.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.526+0000 7f689e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68a0068ec0 0x7f68a0167fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:05.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.526+0000 7f689e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68a0068ec0 0x7f68a0167fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49430/0 (socket says 172.21.15.72:49430) 2023-08-31T18:49:05.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.526+0000 7f689e59c700 1 -- 172.21.15.72:0/3813067558 learned_addr learned my addr 172.21.15.72:0/3813067558 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:05.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.526+0000 7f689dd9b700 1 --2- 172.21.15.72:0/3813067558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a00c38d0 0x7f68a014cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:05.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.526+0000 7f689ed9d700 1 --2- 172.21.15.72:0/3813067558 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a01544e0 0x7f68a0152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:05.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.526+0000 7f689e59c700 1 -- 172.21.15.72:0/3813067558 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a01544e0 msgr2=0x7f68a0152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:05.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.526+0000 7f689e59c700 1 --2- 172.21.15.72:0/3813067558 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a01544e0 0x7f68a0152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:05.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.526+0000 7f689e59c700 1 -- 172.21.15.72:0/3813067558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a00c38d0 msgr2=0x7f68a014cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:05.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.526+0000 7f689e59c700 1 --2- 172.21.15.72:0/3813067558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a00c38d0 0x7f68a014cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:05.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.526+0000 7f689e59c700 1 -- 172.21.15.72:0/3813067558 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6890009370 con 0x7f68a0068ec0 2023-08-31T18:49:05.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.526+0000 7f689e59c700 1 --2- 172.21.15.72:0/3813067558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68a0068ec0 0x7f68a0167fe0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f68a00684e0 tx=0x7f6890017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:05.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.527+0000 7f688e7fc700 1 -- 172.21.15.72:0/3813067558 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689000bec0 con 0x7f68a0068ec0 2023-08-31T18:49:05.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.527+0000 7f688e7fc700 1 -- 172.21.15.72:0/3813067558 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6890002f30 con 0x7f68a0068ec0 2023-08-31T18:49:05.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.527+0000 7f688e7fc700 1 -- 172.21.15.72:0/3813067558 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689000bb00 con 0x7f68a0068ec0 2023-08-31T18:49:05.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.527+0000 7f68a4fff700 1 -- 172.21.15.72:0/3813067558 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a00bfde0 con 0x7f68a0068ec0 2023-08-31T18:49:05.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.527+0000 7f68a4fff700 1 -- 172.21.15.72:0/3813067558 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a00c03a0 con 0x7f68a0068ec0 2023-08-31T18:49:05.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.528+0000 7f68a4fff700 1 -- 172.21.15.72:0/3813067558 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a006c6b0 con 0x7f68a0068ec0 2023-08-31T18:49:05.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.529+0000 7f688e7fc700 1 -- 172.21.15.72:0/3813067558 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 75289+0+0 (secure 0 0 0) 0x7f6890021070 con 0x7f68a0068ec0 2023-08-31T18:49:05.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.530+0000 7f688e7fc700 1 --2- 172.21.15.72:0/3813067558 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f688005ee60 0x7f6880061320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:05.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.530+0000 7f688e7fc700 1 -- 172.21.15.72:0/3813067558 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f689007b880 con 0x7f68a0068ec0 2023-08-31T18:49:05.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.530+0000 7f689dd9b700 1 -- 172.21.15.72:0/3813067558 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f688005ee60 msgr2=0x7f6880061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T18:49:05.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.530+0000 7f689dd9b700 1 --2- 172.21.15.72:0/3813067558 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f688005ee60 0x7f6880061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T18:49:05.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.534+0000 7f688e7fc700 1 -- 172.21.15.72:0/3813067558 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f689004ccf0 con 0x7f68a0068ec0 2023-08-31T18:49:05.585 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:05.585+0000 7f6d50951680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T18:49:05.608 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:05.608+0000 7ff25a312680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T18:49:05.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.723+0000 7f68a4fff700 1 -- 172.21.15.72:0/3813067558 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f68a0153410 con 0x7f68a0068ec0 2023-08-31T18:49:05.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.727+0000 7f688e7fc700 1 -- 172.21.15.72:0/3813067558 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v3)=0 v3) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6890029070 con 0x7f68a0068ec0 2023-08-31T18:49:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.730+0000 7f68a4fff700 1 -- 172.21.15.72:0/3813067558 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f688005ee60 msgr2=0x7f6880061320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T18:49:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.730+0000 7f68a4fff700 1 --2- 172.21.15.72:0/3813067558 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f688005ee60 0x7f6880061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:05.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.730+0000 7f68a4fff700 1 -- 172.21.15.72:0/3813067558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68a0068ec0 msgr2=0x7f68a0167fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:05.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.730+0000 7f68a4fff700 1 --2- 172.21.15.72:0/3813067558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68a0068ec0 0x7f68a0167fe0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f68a00684e0 tx=0x7f6890017000).stop 2023-08-31T18:49:05.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.730+0000 7f68a4fff700 1 -- 172.21.15.72:0/3813067558 shutdown_connections 2023-08-31T18:49:05.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.730+0000 7f68a4fff700 1 --2- 172.21.15.72:0/3813067558 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f68a01544e0 0x7f68a0152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:05.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.730+0000 7f68a4fff700 1 --2- 172.21.15.72:0/3813067558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68a0068ec0 0x7f68a0167fe0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:05.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.730+0000 7f68a4fff700 1 --2- 172.21.15.72:0/3813067558 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f688005ee60 0x7f6880061320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:05.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.730+0000 7f68a4fff700 1 --2- 172.21.15.72:0/3813067558 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68a00c38d0 0x7f68a014cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:05.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.730+0000 7f68a4fff700 1 -- 172.21.15.72:0/3813067558 >> 172.21.15.72:0/3813067558 conn(0x7f68a00c7e00 msgr2=0x7f68a00c51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:05.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.730+0000 7f68a4fff700 1 -- 172.21.15.72:0/3813067558 shutdown_connections 2023-08-31T18:49:05.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:05.730+0000 7f68a4fff700 1 -- 172.21.15.72:0/3813067558 wait complete. 2023-08-31T18:49:05.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T18:49:05.748 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-31T18:49:05.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T18:49:05.803 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-08-31T18:49:05.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-08-31T18:49:05.919 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:05.919+0000 7f6d50951680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T18:49:05.962 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:05.962+0000 7ff25a312680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T18:49:06.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.056+0000 7fc0655ff700 1 Processor -- start 2023-08-31T18:49:06.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.056+0000 7fc0655ff700 1 -- start start 2023-08-31T18:49:06.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.057+0000 7fc0655ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc060155630 0x7fc060153220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:06.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.057+0000 7fc0655ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc0601537e0 0x7fc0600bb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:06.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.057+0000 7fc0655ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0600c3410 0x7fc0600c3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:06.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.057+0000 7fc0655ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc060155a10 con 0x7fc0601537e0 2023-08-31T18:49:06.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.057+0000 7fc0655ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc060065b60 con 0x7fc060155630 2023-08-31T18:49:06.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.057+0000 7fc0655ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0600c1880 con 0x7fc0600c3410 2023-08-31T18:49:06.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.058+0000 7fc05e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc0601537e0 0x7fc0600bb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:06.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.058+0000 7fc05e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc0601537e0 0x7fc0600bb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49446/0 (socket says 172.21.15.72:49446) 2023-08-31T18:49:06.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.058+0000 7fc05e7fc700 1 -- 172.21.15.72:0/2708913697 learned_addr learned my addr 172.21.15.72:0/2708913697 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:06.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.058+0000 7fc05effd700 1 --2- 172.21.15.72:0/2708913697 >> v2:172.21.15.146:3300/0 conn(0x7fc060155630 0x7fc060153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.058+0000 7fc05f7fe700 1 --2- 172.21.15.72:0/2708913697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0600c3410 0x7fc0600c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.058+0000 7fc05e7fc700 1 -- 172.21.15.72:0/2708913697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0600c3410 msgr2=0x7fc0600c3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.058+0000 7fc05e7fc700 1 --2- 172.21.15.72:0/2708913697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0600c3410 0x7fc0600c3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.058+0000 7fc05e7fc700 1 -- 172.21.15.72:0/2708913697 >> v2:172.21.15.146:3300/0 conn(0x7fc060155630 msgr2=0x7fc060153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.058+0000 7fc05e7fc700 1 --2- 172.21.15.72:0/2708913697 >> v2:172.21.15.146:3300/0 conn(0x7fc060155630 0x7fc060153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.058+0000 7fc05e7fc700 1 -- 172.21.15.72:0/2708913697 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc060153c90 con 0x7fc0601537e0 2023-08-31T18:49:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.058+0000 7fc05f7fe700 1 --2- 172.21.15.72:0/2708913697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0600c3410 0x7fc0600c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:49:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.058+0000 7fc05effd700 1 --2- 172.21.15.72:0/2708913697 >> v2:172.21.15.146:3300/0 conn(0x7fc060155630 0x7fc060153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:49:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.058+0000 7fc05e7fc700 1 --2- 172.21.15.72:0/2708913697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0601537e0 0x7fc0600bb9a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fc060063290 tx=0x7fc0540090f0).ready entity=mon.0 client_cookie=6a77da9d1b853dd6 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.059+0000 7fc05dffb700 1 -- 172.21.15.72:0/2708913697 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05400b600 con 0x7fc0601537e0 2023-08-31T18:49:06.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.059+0000 7fc05dffb700 1 -- 172.21.15.72:0/2708913697 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05400b760 con 0x7fc0601537e0 2023-08-31T18:49:06.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.059+0000 7fc05dffb700 1 -- 172.21.15.72:0/2708913697 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05400bae0 con 0x7fc0601537e0 2023-08-31T18:49:06.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.059+0000 7fc0655ff700 1 -- 172.21.15.72:0/2708913697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0601537e0 msgr2=0x7fc0600bb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.059+0000 7fc0655ff700 1 --2- 172.21.15.72:0/2708913697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0601537e0 0x7fc0600bb9a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fc060063290 tx=0x7fc0540090f0).stop 2023-08-31T18:49:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.059+0000 7fc0655ff700 1 -- 172.21.15.72:0/2708913697 shutdown_connections 2023-08-31T18:49:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.059+0000 7fc0655ff700 1 --2- 172.21.15.72:0/2708913697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0600c3410 0x7fc0600c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.059+0000 7fc0655ff700 1 --2- 172.21.15.72:0/2708913697 >> v2:172.21.15.146:3300/0 conn(0x7fc060155630 0x7fc060153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.059+0000 7fc0655ff700 1 --2- 172.21.15.72:0/2708913697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0601537e0 0x7fc0600bb9a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:06.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.059+0000 7fc0655ff700 1 -- 172.21.15.72:0/2708913697 >> 172.21.15.72:0/2708913697 conn(0x7fc060062650 msgr2=0x7fc060062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:06.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.060+0000 7fc0655ff700 1 -- 172.21.15.72:0/2708913697 shutdown_connections 2023-08-31T18:49:06.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.060+0000 7fc0655ff700 1 -- 172.21.15.72:0/2708913697 wait complete. 2023-08-31T18:49:06.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.062+0000 7fc0655ff700 1 Processor -- start 2023-08-31T18:49:06.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.062+0000 7fc0655ff700 1 -- start start 2023-08-31T18:49:06.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.063+0000 7fc0655ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600c3410 0x7fc060153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:06.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.063+0000 7fc0655ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0601537e0 0x7fc06014e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:06.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.063+0000 7fc0655ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc060155630 0x7fc06014ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:06.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.063+0000 7fc0655ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06014f310 con 0x7fc0601537e0 2023-08-31T18:49:06.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.063+0000 7fc0655ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc060155b50 con 0x7fc0600c3410 2023-08-31T18:49:06.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.063+0000 7fc0655ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0601563f0 con 0x7fc060155630 2023-08-31T18:49:06.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.064+0000 7fc05e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0601537e0 0x7fc06014e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:06.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.064+0000 7fc05effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600c3410 0x7fc060153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:06.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.064+0000 7fc05e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0601537e0 0x7fc06014e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49462/0 (socket says 172.21.15.72:49462) 2023-08-31T18:49:06.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.064+0000 7fc05e7fc700 1 -- 172.21.15.72:0/519152261 learned_addr learned my addr 172.21.15.72:0/519152261 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.064+0000 7fc05f7fe700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc060155630 0x7fc06014ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.064+0000 7fc05e7fc700 1 -- 172.21.15.72:0/519152261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc060155630 msgr2=0x7fc06014ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.064+0000 7fc05e7fc700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc060155630 0x7fc06014ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.064+0000 7fc05e7fc700 1 -- 172.21.15.72:0/519152261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600c3410 msgr2=0x7fc060153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.064+0000 7fc05e7fc700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600c3410 0x7fc060153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.064+0000 7fc05e7fc700 1 -- 172.21.15.72:0/519152261 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc054009370 con 0x7fc0601537e0 2023-08-31T18:49:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.064+0000 7fc05e7fc700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0601537e0 0x7fc06014e930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fc054006fd0 tx=0x7fc054017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.064+0000 7fc046ffd700 1 -- 172.21.15.72:0/519152261 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05400bea0 con 0x7fc0601537e0 2023-08-31T18:49:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.064+0000 7fc046ffd700 1 -- 172.21.15.72:0/519152261 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05400b8d0 con 0x7fc0601537e0 2023-08-31T18:49:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.064+0000 7fc0655ff700 1 -- 172.21.15.72:0/519152261 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc060138920 con 0x7fc0601537e0 2023-08-31T18:49:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.065+0000 7fc046ffd700 1 -- 172.21.15.72:0/519152261 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05401b690 con 0x7fc0601537e0 2023-08-31T18:49:06.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.065+0000 7fc0655ff700 1 -- 172.21.15.72:0/519152261 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc060155da0 con 0x7fc0601537e0 2023-08-31T18:49:06.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.066+0000 7fc0655ff700 1 -- 172.21.15.72:0/519152261 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc060156560 con 0x7fc0601537e0 2023-08-31T18:49:06.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.066+0000 7fc046ffd700 1 -- 172.21.15.72:0/519152261 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 75289+0+0 (secure 0 0 0) 0x7fc05401ba00 con 0x7fc0601537e0 2023-08-31T18:49:06.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.068+0000 7fc046ffd700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 0x7fc04c061320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:06.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.068+0000 7fc046ffd700 1 -- 172.21.15.72:0/519152261 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc05407b4b0 con 0x7fc0601537e0 2023-08-31T18:49:06.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.068+0000 7fc05effd700 1 -- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 msgr2=0x7fc04c061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T18:49:06.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.068+0000 7fc05effd700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 0x7fc04c061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T18:49:06.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.071+0000 7fc046ffd700 1 -- 172.21.15.72:0/519152261 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc05404c8e0 con 0x7fc0601537e0 2023-08-31T18:49:06.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.269+0000 7fc05effd700 1 -- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 msgr2=0x7fc04c061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T18:49:06.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.269+0000 7fc05effd700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 0x7fc04c061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T18:49:06.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.295+0000 7fc0655ff700 1 -- 172.21.15.72:0/519152261 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc060156140 con 0x7fc04c05ee60 2023-08-31T18:49:06.663 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:06.663+0000 7f6d50951680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T18:49:06.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.670+0000 7fc05effd700 1 -- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 msgr2=0x7fc04c061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T18:49:06.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:06.670+0000 7fc05effd700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 0x7fc04c061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-31T18:49:06.729 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:06.728+0000 7ff25a312680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T18:49:06.745 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:06.745+0000 7f6d50951680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T18:49:06.812 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:06.812+0000 7ff25a312680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T18:49:06.976 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:06.976+0000 7f6d50951680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T18:49:07.039 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:07.038+0000 7ff25a312680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T18:49:07.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:07.471+0000 7fc05effd700 1 -- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 msgr2=0x7fc04c061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T18:49:07.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:07.471+0000 7fc05effd700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 0x7fc04c061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-31T18:49:07.494 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:07.494+0000 7f6d50951680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T18:49:07.550 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:07.550+0000 7ff25a312680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T18:49:07.621 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:07.620+0000 7f6d50951680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T18:49:07.676 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:07.675+0000 7ff25a312680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T18:49:07.806 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:07.806+0000 7f6d50951680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T18:49:07.857 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:07.857+0000 7ff25a312680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T18:49:07.901 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:07.898+0000 7f6d50951680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T18:49:07.952 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:07.952+0000 7ff25a312680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T18:49:07.986 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:07.986+0000 7f6d50951680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T18:49:08.036 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:08.035+0000 7ff25a312680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T18:49:08.296 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:08.296+0000 7f6d50951680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T18:49:08.341 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:08.341+0000 7ff25a312680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T18:49:08.520 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:08.520+0000 7f6d50951680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T18:49:08.560 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:08.560+0000 7ff25a312680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T18:49:09.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:09.072+0000 7fc05effd700 1 -- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 msgr2=0x7fc04c061320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T18:49:09.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:09.072+0000 7fc05effd700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 0x7fc04c061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-31T18:49:09.329 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:09.328+0000 7f6d50951680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T18:49:09.355 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:09.355+0000 7ff25a312680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T18:49:09.414 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:09.414+0000 7f6d50951680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T18:49:09.440 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:09.440+0000 7ff25a312680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T18:49:09.507 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:09.507+0000 7f6d50951680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T18:49:09.533 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:09.533+0000 7ff25a312680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T18:49:09.690 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:09.690+0000 7f6d50951680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T18:49:09.713 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:09.713+0000 7ff25a312680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T18:49:09.777 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:09.777+0000 7f6d50951680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T18:49:09.799 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:09.799+0000 7ff25a312680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T18:49:09.918 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:09.918+0000 7f6d50951680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T18:49:09.939 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:09.938+0000 7ff25a312680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T18:49:10.048 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:10.048+0000 7f6d50951680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T18:49:10.067 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:10.067+0000 7ff25a312680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T18:49:10.394 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:10.394+0000 7f6d50951680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T18:49:10.406 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:10.406+0000 7ff25a312680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T18:49:10.480 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T18:49:10.480+0000 7f6d50951680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T18:49:10.494 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:10.495+0000 7ff25a312680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T18:49:10.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:10.505+0000 7fc046ffd700 1 -- 172.21.15.72:0/519152261 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 6) v1 ==== 75113+0+0 (secure 0 0 0) 0x7fc054079240 con 0x7fc0601537e0 2023-08-31T18:49:10.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:10.505+0000 7fc046ffd700 1 -- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 msgr2=0x7fc04c061320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T18:49:10.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:10.505+0000 7fc046ffd700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 0x7fc04c061320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:10.577 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:10.576+0000 7ff1cce01700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T18:49:10.577 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:10.576+0000 7ff1cce01700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T18:49:10.577 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:10.576+0000 7ff1cce01700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T18:49:10.577 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:10.576+0000 7ff1cce01700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T18:49:10.578 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:10.576+0000 7ff1cce01700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T18:49:10.578 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:10.578+0000 7ff1cfe07700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T18:49:10.578 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:10.578+0000 7ff1cfe07700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T18:49:10.578 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:10.578+0000 7ff1cfe07700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T18:49:10.579 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:10.578+0000 7ff1cfe07700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T18:49:10.579 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:49:10.578+0000 7ff1cfe07700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T18:49:11.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.508+0000 7fc046ffd700 1 -- 172.21.15.72:0/519152261 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mgrmap(e 7) v1 ==== 75183+0+0 (secure 0 0 0) 0x7fc0540795c0 con 0x7fc0601537e0 2023-08-31T18:49:11.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.508+0000 7fc046ffd700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 0x7fc04c02fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:11.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.508+0000 7fc046ffd700 1 -- 172.21.15.72:0/519152261 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc060156140 con 0x7fc04c05ee60 2023-08-31T18:49:11.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.512+0000 7fc05effd700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 0x7fc04c02fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:11.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.520+0000 7fc05effd700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 0x7fc04c02fdc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fc050008010 tx=0x7fc050008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:11.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.541+0000 7fc046ffd700 1 -- 172.21.15.72:0/519152261 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fc060156140 con 0x7fc04c05ee60 2023-08-31T18:49:11.541 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path /snap_test_dir1/dir0 2023-08-31T18:49:11.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.543+0000 7fc0655ff700 1 -- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 msgr2=0x7fc04c02fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:11.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.543+0000 7fc0655ff700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 0x7fc04c02fdc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fc050008010 tx=0x7fc050008040).stop 2023-08-31T18:49:11.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.543+0000 7fc0655ff700 1 -- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0601537e0 msgr2=0x7fc06014e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:11.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.543+0000 7fc0655ff700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0601537e0 0x7fc06014e930 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fc054006fd0 tx=0x7fc054017000).stop 2023-08-31T18:49:11.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.544+0000 7fc0655ff700 1 -- 172.21.15.72:0/519152261 shutdown_connections 2023-08-31T18:49:11.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.544+0000 7fc0655ff700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc060155630 0x7fc06014ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:11.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.544+0000 7fc0655ff700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc04c05ee60 0x7fc04c02fdc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:11.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.544+0000 7fc0655ff700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0600c3410 0x7fc060153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:11.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.544+0000 7fc0655ff700 1 --2- 172.21.15.72:0/519152261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0601537e0 0x7fc06014e930 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:11.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.544+0000 7fc0655ff700 1 -- 172.21.15.72:0/519152261 >> 172.21.15.72:0/519152261 conn(0x7fc060062650 msgr2=0x7fc06013a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:11.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.544+0000 7fc0655ff700 1 -- 172.21.15.72:0/519152261 shutdown_connections 2023-08-31T18:49:11.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.544+0000 7fc0655ff700 1 -- 172.21.15.72:0/519152261 wait complete. 2023-08-31T18:49:11.563 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-08-31T18:49:11.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T18:49:11.564 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-08-31T18:49:11.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-08-31T18:49:11.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.809+0000 7f2ca3dff700 1 Processor -- start 2023-08-31T18:49:11.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.809+0000 7f2ca3dff700 1 -- start start 2023-08-31T18:49:11.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.810+0000 7f2ca3dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c9c151da0 0x7f2c9c155110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:11.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.810+0000 7f2ca3dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c9c064db0 0x7f2c9c0bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:11.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.810+0000 7f2ca3dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c9c154c80 con 0x7f2c9c0c7f20 2023-08-31T18:49:11.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.810+0000 7f2ca3dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c9c0a9f10 con 0x7f2c9c064db0 2023-08-31T18:49:11.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.810+0000 7f2ca3dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c0aa1f0 con 0x7f2c9c151da0 2023-08-31T18:49:11.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.811+0000 7f2ca239c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c9c064db0 0x7f2c9c0bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.811+0000 7f2ca239c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c9c064db0 0x7f2c9c0bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49562/0 (socket says 172.21.15.72:49562) 2023-08-31T18:49:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.811+0000 7f2ca239c700 1 -- 172.21.15.72:0/700153826 learned_addr learned my addr 172.21.15.72:0/700153826 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.811+0000 7f2ca139a700 1 --1- 172.21.15.72:0/700153826 >> v1:172.21.15.72:6789/0 conn(0x7f2c9c0c7f20 0x7f2c9c0646a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49004/0 (socket says 172.21.15.72:49004) 2023-08-31T18:49:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.811+0000 7f2ca1b9b700 1 --2- 172.21.15.72:0/700153826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c9c151da0 0x7f2c9c155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:11.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.811+0000 7f2ca239c700 1 -- 172.21.15.72:0/700153826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c9c151da0 msgr2=0x7f2c9c155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:11.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.811+0000 7f2ca239c700 1 --2- 172.21.15.72:0/700153826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c9c151da0 0x7f2c9c155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:11.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.811+0000 7f2ca239c700 1 -- 172.21.15.72:0/700153826 >> v1:172.21.15.72:6789/0 conn(0x7f2c9c0c7f20 legacy=0x7f2c9c0646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:11.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.811+0000 7f2ca0b99700 1 -- 172.21.15.72:0/700153826 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437482533 0 0) 0x7f2c9c154c80 con 0x7f2c9c0c7f20 2023-08-31T18:49:11.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.811+0000 7f2ca239c700 1 -- 172.21.15.72:0/700153826 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9c0aa4d0 con 0x7f2c9c064db0 2023-08-31T18:49:11.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.811+0000 7f2ca239c700 1 --2- 172.21.15.72:0/700153826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c064db0 0x7f2c9c0bfcd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f2c94009f20 tx=0x7f2c94009840).ready entity=mon.0 client_cookie=f2ee9b3f526e2a2e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:11.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.811+0000 7f2ca0b99700 1 -- 172.21.15.72:0/700153826 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9400e070 con 0x7f2c9c064db0 2023-08-31T18:49:11.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.812+0000 7f2ca0b99700 1 -- 172.21.15.72:0/700153826 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9400ba80 con 0x7f2c9c064db0 2023-08-31T18:49:11.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.812+0000 7f2ca0b99700 1 -- 172.21.15.72:0/700153826 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9400be00 con 0x7f2c9c064db0 2023-08-31T18:49:11.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.812+0000 7f2ca3dff700 1 -- 172.21.15.72:0/700153826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c064db0 msgr2=0x7f2c9c0bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.812+0000 7f2ca3dff700 1 --2- 172.21.15.72:0/700153826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c064db0 0x7f2c9c0bfcd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f2c94009f20 tx=0x7f2c94009840).stop 2023-08-31T18:49:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.812+0000 7f2ca3dff700 1 -- 172.21.15.72:0/700153826 shutdown_connections 2023-08-31T18:49:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.812+0000 7f2ca3dff700 1 --2- 172.21.15.72:0/700153826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c064db0 0x7f2c9c0bfcd0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.812+0000 7f2ca3dff700 1 --2- 172.21.15.72:0/700153826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c9c151da0 0x7f2c9c155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.812+0000 7f2ca3dff700 1 -- 172.21.15.72:0/700153826 >> 172.21.15.72:0/700153826 conn(0x7f2c9c0cb840 msgr2=0x7f2c9c0c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:11.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.812+0000 7f2ca3dff700 1 -- 172.21.15.72:0/700153826 shutdown_connections 2023-08-31T18:49:11.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.812+0000 7f2ca3dff700 1 -- 172.21.15.72:0/700153826 wait complete. 2023-08-31T18:49:11.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.814+0000 7f2ca3dff700 1 Processor -- start 2023-08-31T18:49:11.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.814+0000 7f2ca3dff700 1 -- start start 2023-08-31T18:49:11.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca3dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c064db0 0x7f2c9c145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:11.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca3dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c9c0c7f20 0x7f2c9c0c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:11.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca3dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c9c151da0 0x7f2c9c0c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:11.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca3dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c14e730 con 0x7f2c9c064db0 2023-08-31T18:49:11.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca3dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c0c4040 con 0x7f2c9c0c7f20 2023-08-31T18:49:11.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca3dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c0c37a0 con 0x7f2c9c151da0 2023-08-31T18:49:11.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca1b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c064db0 0x7f2c9c145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:11.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca1b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c064db0 0x7f2c9c145920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49570/0 (socket says 172.21.15.72:49570) 2023-08-31T18:49:11.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca1b9b700 1 -- 172.21.15.72:0/4228731802 learned_addr learned my addr 172.21.15.72:0/4228731802 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:11.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca139a700 1 --2- 172.21.15.72:0/4228731802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c9c0c7f20 0x7f2c9c0c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:11.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca239c700 1 --2- 172.21.15.72:0/4228731802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c9c151da0 0x7f2c9c0c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:11.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca1b9b700 1 -- 172.21.15.72:0/4228731802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c9c151da0 msgr2=0x7f2c9c0c11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:11.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca1b9b700 1 --2- 172.21.15.72:0/4228731802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c9c151da0 0x7f2c9c0c11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:11.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca1b9b700 1 -- 172.21.15.72:0/4228731802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c9c0c7f20 msgr2=0x7f2c9c0c2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:11.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca1b9b700 1 --2- 172.21.15.72:0/4228731802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c9c0c7f20 0x7f2c9c0c2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.815+0000 7f2ca1b9b700 1 -- 172.21.15.72:0/4228731802 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c94009ae0 con 0x7f2c9c064db0 2023-08-31T18:49:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.816+0000 7f2ca1b9b700 1 --2- 172.21.15.72:0/4228731802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c064db0 0x7f2c9c145920 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f2c9800d890 tx=0x7f2c98008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.816+0000 7f2c91ffb700 1 -- 172.21.15.72:0/4228731802 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c980125f0 con 0x7f2c9c064db0 2023-08-31T18:49:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.816+0000 7f2c91ffb700 1 -- 172.21.15.72:0/4228731802 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c98012750 con 0x7f2c9c064db0 2023-08-31T18:49:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.816+0000 7f2c91ffb700 1 -- 172.21.15.72:0/4228731802 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98012ad0 con 0x7f2c9c064db0 2023-08-31T18:49:11.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.816+0000 7f2ca3dff700 1 -- 172.21.15.72:0/4228731802 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9c0c3a80 con 0x7f2c9c064db0 2023-08-31T18:49:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.816+0000 7f2ca3dff700 1 -- 172.21.15.72:0/4228731802 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9c14e960 con 0x7f2c9c064db0 2023-08-31T18:49:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.817+0000 7f2ca3dff700 1 -- 172.21.15.72:0/4228731802 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c9c06a7e0 con 0x7f2c9c064db0 2023-08-31T18:49:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.818+0000 7f2c91ffb700 1 -- 172.21.15.72:0/4228731802 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 7) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f2c98013480 con 0x7f2c9c064db0 2023-08-31T18:49:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.818+0000 7f2c91ffb700 1 --2- 172.21.15.72:0/4228731802 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2c8005ed40 0x7f2c80061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:11.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.819+0000 7f2c91ffb700 1 -- 172.21.15.72:0/4228731802 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f2c98079a80 con 0x7f2c9c064db0 2023-08-31T18:49:11.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.819+0000 7f2ca139a700 1 --2- 172.21.15.72:0/4228731802 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2c8005ed40 0x7f2c80061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:11.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.819+0000 7f2ca139a700 1 --2- 172.21.15.72:0/4228731802 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2c8005ed40 0x7f2c80061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2c9c0c0f80 tx=0x7f2c8c007180).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:11.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:11.823+0000 7f2c91ffb700 1 -- 172.21.15.72:0/4228731802 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c9804afb0 con 0x7f2c9c064db0 2023-08-31T18:49:12.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.015+0000 7f2ca3dff700 1 -- 172.21.15.72:0/4228731802 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c9c06c6b0 con 0x7f2c8005ed40 2023-08-31T18:49:12.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.019+0000 7f2c91ffb700 1 -- 172.21.15.72:0/4228731802 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f2c9c06c6b0 con 0x7f2c8005ed40 2023-08-31T18:49:12.019 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path /snap_test_dir1/dir1 2023-08-31T18:49:12.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.021+0000 7f2ca3dff700 1 -- 172.21.15.72:0/4228731802 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2c8005ed40 msgr2=0x7f2c80061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:12.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.021+0000 7f2ca3dff700 1 --2- 172.21.15.72:0/4228731802 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2c8005ed40 0x7f2c80061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2c9c0c0f80 tx=0x7f2c8c007180).stop 2023-08-31T18:49:12.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.021+0000 7f2ca3dff700 1 -- 172.21.15.72:0/4228731802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c064db0 msgr2=0x7f2c9c145920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:12.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.021+0000 7f2ca3dff700 1 --2- 172.21.15.72:0/4228731802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c064db0 0x7f2c9c145920 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f2c9800d890 tx=0x7f2c98008040).stop 2023-08-31T18:49:12.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.022+0000 7f2ca3dff700 1 -- 172.21.15.72:0/4228731802 shutdown_connections 2023-08-31T18:49:12.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.022+0000 7f2ca3dff700 1 --2- 172.21.15.72:0/4228731802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2c9c151da0 0x7f2c9c0c11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.022+0000 7f2ca3dff700 1 --2- 172.21.15.72:0/4228731802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c064db0 0x7f2c9c145920 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.022+0000 7f2ca3dff700 1 --2- 172.21.15.72:0/4228731802 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2c8005ed40 0x7f2c80061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.022+0000 7f2ca3dff700 1 --2- 172.21.15.72:0/4228731802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c9c0c7f20 0x7f2c9c0c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.022+0000 7f2ca3dff700 1 -- 172.21.15.72:0/4228731802 >> 172.21.15.72:0/4228731802 conn(0x7f2c9c0cb840 msgr2=0x7f2c9c0ad1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:12.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.022+0000 7f2ca3dff700 1 -- 172.21.15.72:0/4228731802 shutdown_connections 2023-08-31T18:49:12.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.022+0000 7f2ca3dff700 1 -- 172.21.15.72:0/4228731802 wait complete. 2023-08-31T18:49:12.038 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-08-31T18:49:12.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T18:49:12.039 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-08-31T18:49:12.088 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-08-31T18:49:12.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.281+0000 7fb9ac3ff700 1 Processor -- start 2023-08-31T18:49:12.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.282+0000 7fb9ac3ff700 1 -- start start 2023-08-31T18:49:12.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.283+0000 7fb9ac3ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb9a4068c20 0x7fb9a4069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:12.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.283+0000 7fb9ac3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a4062650 0x7fb9a4063c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:12.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.283+0000 7fb9ac3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a4064110 con 0x7fb9a40c1b50 2023-08-31T18:49:12.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.283+0000 7fb9ac3ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a4062b80 con 0x7fb9a4068c20 2023-08-31T18:49:12.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.283+0000 7fb9ac3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a4062e60 con 0x7fb9a4062650 2023-08-31T18:49:12.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.283+0000 7fb9aa99c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb9a40c1b50 0x7fb9a4157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49014/0 (socket says 172.21.15.72:49014) 2023-08-31T18:49:12.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.283+0000 7fb9aa99c700 1 -- 172.21.15.72:0/1190072396 learned_addr learned my addr 172.21.15.72:0/1190072396 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:49:12.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.283+0000 7fb9a9199700 1 -- 172.21.15.72:0/1190072396 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125937321 0 0) 0x7fb9a4064110 con 0x7fb9a40c1b50 2023-08-31T18:49:12.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9aa19b700 1 --2- 172.21.15.72:0/1190072396 >> v2:172.21.15.146:3300/0 conn(0x7fb9a4068c20 0x7fb9a4069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a999a700 1 --2- 172.21.15.72:0/1190072396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a4062650 0x7fb9a4063c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a9199700 1 -- 172.21.15.72:0/1190072396 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9900033f0 con 0x7fb9a40c1b50 2023-08-31T18:49:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a9199700 1 -- 172.21.15.72:0/1190072396 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 276066717 0 0) 0x7fb9900033f0 con 0x7fb9a40c1b50 2023-08-31T18:49:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a9199700 1 -- 172.21.15.72:0/1190072396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a4062650 msgr2=0x7fb9a4063c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a9199700 1 --2- 172.21.15.72:0/1190072396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a4062650 0x7fb9a4063c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a9199700 1 -- 172.21.15.72:0/1190072396 >> v2:172.21.15.146:3300/0 conn(0x7fb9a4068c20 msgr2=0x7fb9a4069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:12.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a9199700 1 --2- 172.21.15.72:0/1190072396 >> v2:172.21.15.146:3300/0 conn(0x7fb9a4068c20 0x7fb9a4069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a9199700 1 -- 172.21.15.72:0/1190072396 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a4063140 con 0x7fb9a40c1b50 2023-08-31T18:49:12.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a9199700 1 -- 172.21.15.72:0/1190072396 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fb99c0017f0 con 0x7fb9a40c1b50 2023-08-31T18:49:12.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a9199700 1 -- 172.21.15.72:0/1190072396 >> v1:172.21.15.72:6789/0 conn(0x7fb9a40c1b50 legacy=0x7fb9a4157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:12.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a9199700 1 --2- 172.21.15.72:0/1190072396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9900038e0 0x7fb990003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:12.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a9199700 1 --2- 172.21.15.72:0/1190072396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a4062650 0x7fb990004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:12.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a9199700 1 --2- 172.21.15.72:0/1190072396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb990004b80 0x7fb990005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:12.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a9199700 1 -- 172.21.15.72:0/1190072396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a4062b80 con 0x7fb990004b80 2023-08-31T18:49:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a9199700 1 -- 172.21.15.72:0/1190072396 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a4062e60 con 0x7fb9900038e0 2023-08-31T18:49:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a9199700 1 -- 172.21.15.72:0/1190072396 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99000b8e0 con 0x7fb9a4062650 2023-08-31T18:49:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9aa99c700 1 --2- 172.21.15.72:0/1190072396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb990004b80 0x7fb990005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9a999a700 1 --2- 172.21.15.72:0/1190072396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a4062650 0x7fb990004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:12.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.284+0000 7fb9aa19b700 1 --2- 172.21.15.72:0/1190072396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9900038e0 0x7fb990003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.285+0000 7fb9aa99c700 1 -- 172.21.15.72:0/1190072396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a4062650 msgr2=0x7fb990004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.285+0000 7fb9aa99c700 1 --2- 172.21.15.72:0/1190072396 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a4062650 0x7fb990004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.285+0000 7fb9aa99c700 1 -- 172.21.15.72:0/1190072396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9900038e0 msgr2=0x7fb990003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.285+0000 7fb9aa99c700 1 --2- 172.21.15.72:0/1190072396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9900038e0 0x7fb990003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.285+0000 7fb9aa99c700 1 -- 172.21.15.72:0/1190072396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9900033f0 con 0x7fb990004b80 2023-08-31T18:49:12.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.285+0000 7fb9aa19b700 1 --2- 172.21.15.72:0/1190072396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9900038e0 0x7fb990003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:49:12.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.285+0000 7fb9aa99c700 1 --2- 172.21.15.72:0/1190072396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb990004b80 0x7fb990005000 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fb99c00c530 tx=0x7fb99c002210).ready entity=mon.0 client_cookie=18542de61bd25117 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:12.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.285+0000 7fb9a9199700 1 -- 172.21.15.72:0/1190072396 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c007de0 con 0x7fb990004b80 2023-08-31T18:49:12.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.285+0000 7fb9a9199700 1 -- 172.21.15.72:0/1190072396 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99c00ce60 con 0x7fb990004b80 2023-08-31T18:49:12.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.285+0000 7fb9a9199700 1 -- 172.21.15.72:0/1190072396 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c005d50 con 0x7fb990004b80 2023-08-31T18:49:12.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.286+0000 7fb9ac3ff700 1 -- 172.21.15.72:0/1190072396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb990004b80 msgr2=0x7fb990005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:12.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.286+0000 7fb9ac3ff700 1 --2- 172.21.15.72:0/1190072396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb990004b80 0x7fb990005000 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fb99c00c530 tx=0x7fb99c002210).stop 2023-08-31T18:49:12.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.286+0000 7fb9aa99c700 1 -- 172.21.15.72:0/1190072396 reap_dead start 2023-08-31T18:49:12.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.286+0000 7fb9ac3ff700 1 -- 172.21.15.72:0/1190072396 shutdown_connections 2023-08-31T18:49:12.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.286+0000 7fb9ac3ff700 1 -- 172.21.15.72:0/1190072396 >> 172.21.15.72:0/1190072396 conn(0x7fb9a40c72f0 msgr2=0x7fb9a40c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:12.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.286+0000 7fb9ac3ff700 1 -- 172.21.15.72:0/1190072396 shutdown_connections 2023-08-31T18:49:12.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.286+0000 7fb9ac3ff700 1 -- 172.21.15.72:0/1190072396 wait complete. 2023-08-31T18:49:12.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.287+0000 7fb9ac3ff700 1 Processor -- start 2023-08-31T18:49:12.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.287+0000 7fb9ac3ff700 1 -- start start 2023-08-31T18:49:12.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.288+0000 7fb9ac3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb990004b80 0x7fb9a40a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:12.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.288+0000 7fb9ac3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a40a89b0 0x7fb9a40a8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:12.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.288+0000 7fb9ac3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a40a9320 0x7fb9a40a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:12.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.288+0000 7fb9ac3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a40a8030 con 0x7fb990004b80 2023-08-31T18:49:12.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.288+0000 7fb9ac3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a40a7460 con 0x7fb9a40a9320 2023-08-31T18:49:12.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.288+0000 7fb9ac3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a40a7700 con 0x7fb9a40a89b0 2023-08-31T18:49:12.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.288+0000 7fb9aa19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb990004b80 0x7fb9a40a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:12.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.288+0000 7fb9aa19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb990004b80 0x7fb9a40a84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49598/0 (socket says 172.21.15.72:49598) 2023-08-31T18:49:12.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.288+0000 7fb9aa19b700 1 -- 172.21.15.72:0/3037717142 learned_addr learned my addr 172.21.15.72:0/3037717142 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:12.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.289+0000 7fb9aa99c700 1 --2- 172.21.15.72:0/3037717142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a40a9320 0x7fb9a40a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:12.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.289+0000 7fb9a999a700 1 --2- 172.21.15.72:0/3037717142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a40a89b0 0x7fb9a40a8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:12.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.289+0000 7fb9aa19b700 1 -- 172.21.15.72:0/3037717142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a40a89b0 msgr2=0x7fb9a40a8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:12.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.289+0000 7fb9aa19b700 1 --2- 172.21.15.72:0/3037717142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a40a89b0 0x7fb9a40a8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.289+0000 7fb9aa19b700 1 -- 172.21.15.72:0/3037717142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a40a9320 msgr2=0x7fb9a40a4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:12.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.289+0000 7fb9aa19b700 1 --2- 172.21.15.72:0/3037717142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a40a9320 0x7fb9a40a4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.289+0000 7fb9aa19b700 1 -- 172.21.15.72:0/3037717142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a40a79e0 con 0x7fb990004b80 2023-08-31T18:49:12.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.289+0000 7fb9a999a700 1 --2- 172.21.15.72:0/3037717142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a40a89b0 0x7fb9a40a8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:12.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.289+0000 7fb9aa19b700 1 --2- 172.21.15.72:0/3037717142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb990004b80 0x7fb9a40a84c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fb9a0011690 tx=0x7fb9a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:12.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.289+0000 7fb99a7fc700 1 -- 172.21.15.72:0/3037717142 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0013620 con 0x7fb990004b80 2023-08-31T18:49:12.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.289+0000 7fb99a7fc700 1 -- 172.21.15.72:0/3037717142 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a0013780 con 0x7fb990004b80 2023-08-31T18:49:12.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.289+0000 7fb9ac3ff700 1 -- 172.21.15.72:0/3037717142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a40a7cc0 con 0x7fb990004b80 2023-08-31T18:49:12.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.289+0000 7fb99a7fc700 1 -- 172.21.15.72:0/3037717142 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0013b00 con 0x7fb990004b80 2023-08-31T18:49:12.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.289+0000 7fb9ac3ff700 1 -- 172.21.15.72:0/3037717142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a40a4d40 con 0x7fb990004b80 2023-08-31T18:49:12.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.290+0000 7fb9ac3ff700 1 -- 172.21.15.72:0/3037717142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a40a8310 con 0x7fb990004b80 2023-08-31T18:49:12.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.291+0000 7fb99a7fc700 1 -- 172.21.15.72:0/3037717142 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 7) v1 ==== 75183+0+0 (secure 0 0 0) 0x7fb9a0015480 con 0x7fb990004b80 2023-08-31T18:49:12.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.292+0000 7fb99a7fc700 1 --2- 172.21.15.72:0/3037717142 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb98805ed40 0x7fb988061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:12.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.292+0000 7fb99a7fc700 1 -- 172.21.15.72:0/3037717142 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fb9a007a4e0 con 0x7fb990004b80 2023-08-31T18:49:12.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.292+0000 7fb9a999a700 1 --2- 172.21.15.72:0/3037717142 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb98805ed40 0x7fb988061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:12.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.293+0000 7fb9a999a700 1 --2- 172.21.15.72:0/3037717142 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb98805ed40 0x7fb988061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fb994009270 tx=0x7fb994008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:12.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.296+0000 7fb99a7fc700 1 -- 172.21.15.72:0/3037717142 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb9a004b900 con 0x7fb990004b80 2023-08-31T18:49:12.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.491+0000 7fb9ac3ff700 1 -- 172.21.15.72:0/3037717142 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9a40a8170 con 0x7fb98805ed40 2023-08-31T18:49:12.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.495+0000 7fb99a7fc700 1 -- 172.21.15.72:0/3037717142 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fb994009e70 con 0x7fb98805ed40 2023-08-31T18:49:12.495 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path /snap_test_dir1/dir2 2023-08-31T18:49:12.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.497+0000 7fb9ac3ff700 1 -- 172.21.15.72:0/3037717142 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb98805ed40 msgr2=0x7fb988061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:12.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.497+0000 7fb9ac3ff700 1 --2- 172.21.15.72:0/3037717142 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb98805ed40 0x7fb988061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fb994009270 tx=0x7fb994008040).stop 2023-08-31T18:49:12.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.497+0000 7fb9ac3ff700 1 -- 172.21.15.72:0/3037717142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb990004b80 msgr2=0x7fb9a40a84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:12.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.497+0000 7fb9ac3ff700 1 --2- 172.21.15.72:0/3037717142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb990004b80 0x7fb9a40a84c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fb9a0011690 tx=0x7fb9a0008040).stop 2023-08-31T18:49:12.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.497+0000 7fb9ac3ff700 1 -- 172.21.15.72:0/3037717142 shutdown_connections 2023-08-31T18:49:12.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.497+0000 7fb9ac3ff700 1 --2- 172.21.15.72:0/3037717142 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb98805ed40 0x7fb988061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.497+0000 7fb9ac3ff700 1 --2- 172.21.15.72:0/3037717142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a40a9320 0x7fb9a40a4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.497+0000 7fb9ac3ff700 1 --2- 172.21.15.72:0/3037717142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb990004b80 0x7fb9a40a84c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.497+0000 7fb9ac3ff700 1 --2- 172.21.15.72:0/3037717142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9a40a89b0 0x7fb9a40a8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.497+0000 7fb9ac3ff700 1 -- 172.21.15.72:0/3037717142 >> 172.21.15.72:0/3037717142 conn(0x7fb9a40c72f0 msgr2=0x7fb9a4154540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.498+0000 7fb9ac3ff700 1 -- 172.21.15.72:0/3037717142 shutdown_connections 2023-08-31T18:49:12.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.498+0000 7fb9ac3ff700 1 -- 172.21.15.72:0/3037717142 wait complete. 2023-08-31T18:49:12.515 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-08-31T18:49:12.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T18:49:12.518 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-08-31T18:49:12.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-08-31T18:49:12.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.764+0000 7fd51e7ff700 1 Processor -- start 2023-08-31T18:49:12.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.765+0000 7fd51e7ff700 1 -- start start 2023-08-31T18:49:12.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.766+0000 7fd51e7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd518064db0 0x7fd5180a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:12.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.766+0000 7fd51e7ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd518154500 0x7fd51815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:12.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.766+0000 7fd51e7ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5180aa620 con 0x7fd518154120 2023-08-31T18:49:12.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.766+0000 7fd51e7ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5180aa3a0 con 0x7fd518154500 2023-08-31T18:49:12.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.766+0000 7fd51e7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180c5450 con 0x7fd518064db0 2023-08-31T18:49:12.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.767+0000 7fd5177fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd518064db0 0x7fd5180a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:12.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.767+0000 7fd51cd9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd518154500 0x7fd51815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:12.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.767+0000 7fd51cd9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd518154500 0x7fd51815dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:49288/0 (socket says 172.21.15.72:49288) 2023-08-31T18:49:12.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.767+0000 7fd5177fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd518064db0 0x7fd5180a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:40418/0 (socket says 172.21.15.72:40418) 2023-08-31T18:49:12.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.767+0000 7fd51cd9c700 1 -- 172.21.15.72:0/371263133 learned_addr learned my addr 172.21.15.72:0/371263133 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:12.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.767+0000 7fd517fff700 1 --1- 172.21.15.72:0/371263133 >> v1:172.21.15.146:6789/0 conn(0x7fd518154120 0x7fd5180646a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:58892/0 (socket says 172.21.15.72:58892) 2023-08-31T18:49:12.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.767+0000 7fd5177fe700 1 -- 172.21.15.72:0/371263133 >> v2:172.21.15.146:3300/0 conn(0x7fd518154500 msgr2=0x7fd51815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:12.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.767+0000 7fd5177fe700 1 --2- 172.21.15.72:0/371263133 >> v2:172.21.15.146:3300/0 conn(0x7fd518154500 0x7fd51815dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.767+0000 7fd5177fe700 1 -- 172.21.15.72:0/371263133 >> v1:172.21.15.146:6789/0 conn(0x7fd518154120 legacy=0x7fd5180646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:12.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.767+0000 7fd5177fe700 1 -- 172.21.15.72:0/371263133 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5180c8050 con 0x7fd518064db0 2023-08-31T18:49:12.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.767+0000 7fd51cd9c700 1 --2- 172.21.15.72:0/371263133 >> v2:172.21.15.146:3300/0 conn(0x7fd518154500 0x7fd51815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:49:12.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.767+0000 7fd516ffd700 1 -- 172.21.15.72:0/371263133 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764708661 0 0) 0x7fd5180aa620 con 0x7fd518154120 2023-08-31T18:49:12.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.768+0000 7fd5177fe700 1 --2- 172.21.15.72:0/371263133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd518064db0 0x7fd5180a9eb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd50c009760 tx=0x7fd50c009060).ready entity=mon.2 client_cookie=4ac02daf72ef5681 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:12.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.768+0000 7fd516ffd700 1 -- 172.21.15.72:0/371263133 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00f510 con 0x7fd518064db0 2023-08-31T18:49:12.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.768+0000 7fd516ffd700 1 -- 172.21.15.72:0/371263133 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00f670 con 0x7fd518064db0 2023-08-31T18:49:12.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.768+0000 7fd516ffd700 1 -- 172.21.15.72:0/371263133 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00f9f0 con 0x7fd518064db0 2023-08-31T18:49:12.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.768+0000 7fd51e7ff700 1 -- 172.21.15.72:0/371263133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd518064db0 msgr2=0x7fd5180a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:12.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.768+0000 7fd51e7ff700 1 --2- 172.21.15.72:0/371263133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd518064db0 0x7fd5180a9eb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd50c009760 tx=0x7fd50c009060).stop 2023-08-31T18:49:12.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.768+0000 7fd51e7ff700 1 -- 172.21.15.72:0/371263133 shutdown_connections 2023-08-31T18:49:12.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.768+0000 7fd51e7ff700 1 --2- 172.21.15.72:0/371263133 >> v2:172.21.15.146:3300/0 conn(0x7fd518154500 0x7fd51815dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.768+0000 7fd51e7ff700 1 --2- 172.21.15.72:0/371263133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd518064db0 0x7fd5180a9eb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.768+0000 7fd51e7ff700 1 -- 172.21.15.72:0/371263133 >> 172.21.15.72:0/371263133 conn(0x7fd5180cb7e0 msgr2=0x7fd5180c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:12.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.769+0000 7fd51e7ff700 1 -- 172.21.15.72:0/371263133 shutdown_connections 2023-08-31T18:49:12.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.769+0000 7fd51e7ff700 1 -- 172.21.15.72:0/371263133 wait complete. 2023-08-31T18:49:12.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.771+0000 7fd51e7ff700 1 Processor -- start 2023-08-31T18:49:12.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.771+0000 7fd51e7ff700 1 -- start start 2023-08-31T18:49:12.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.772+0000 7fd51e7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd518064db0 0x7fd5180c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:12.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.772+0000 7fd51e7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd518154120 0x7fd5180c10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:12.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.772+0000 7fd51e7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd518154500 0x7fd5180c15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:12.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.772+0000 7fd51e7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180c1a90 con 0x7fd518154120 2023-08-31T18:49:12.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.772+0000 7fd51e7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180c3ab0 con 0x7fd518064db0 2023-08-31T18:49:12.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.772+0000 7fd51e7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180c48f0 con 0x7fd518154500 2023-08-31T18:49:12.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.772+0000 7fd5177fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd518154120 0x7fd5180c10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:12.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.772+0000 7fd5177fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd518154120 0x7fd5180c10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49602/0 (socket says 172.21.15.72:49602) 2023-08-31T18:49:12.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.772+0000 7fd5177fe700 1 -- 172.21.15.72:0/1017901140 learned_addr learned my addr 172.21.15.72:0/1017901140 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:12.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.773+0000 7fd517fff700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd518064db0 0x7fd5180c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:12.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.773+0000 7fd5177fe700 1 -- 172.21.15.72:0/1017901140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd518154500 msgr2=0x7fd5180c15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:12.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.773+0000 7fd51cd9c700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd518154500 0x7fd5180c15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.773+0000 7fd5177fe700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd518154500 0x7fd5180c15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.773+0000 7fd5177fe700 1 -- 172.21.15.72:0/1017901140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd518064db0 msgr2=0x7fd5180c1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.773+0000 7fd5177fe700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd518064db0 0x7fd5180c1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.773+0000 7fd5177fe700 1 -- 172.21.15.72:0/1017901140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd510009ae0 con 0x7fd518154120 2023-08-31T18:49:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.773+0000 7fd517fff700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd518064db0 0x7fd5180c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:12.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.773+0000 7fd51cd9c700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd518154500 0x7fd5180c15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:12.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.773+0000 7fd5177fe700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd518154120 0x7fd5180c10b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fd50c011000 tx=0x7fd50c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:12.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.773+0000 7fd4fffff700 1 -- 172.21.15.72:0/1017901140 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00f7e0 con 0x7fd518154120 2023-08-31T18:49:12.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.773+0000 7fd4fffff700 1 -- 172.21.15.72:0/1017901140 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00f960 con 0x7fd518154120 2023-08-31T18:49:12.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.773+0000 7fd51e7ff700 1 -- 172.21.15.72:0/1017901140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50c0092a0 con 0x7fd518154120 2023-08-31T18:49:12.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.773+0000 7fd4fffff700 1 -- 172.21.15.72:0/1017901140 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c01b660 con 0x7fd518154120 2023-08-31T18:49:12.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.773+0000 7fd51e7ff700 1 -- 172.21.15.72:0/1017901140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5180c3d90 con 0x7fd518154120 2023-08-31T18:49:12.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.775+0000 7fd51e7ff700 1 -- 172.21.15.72:0/1017901140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51806a7e0 con 0x7fd518154120 2023-08-31T18:49:12.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.775+0000 7fd4fffff700 1 -- 172.21.15.72:0/1017901140 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7fd50c01b9d0 con 0x7fd518154120 2023-08-31T18:49:12.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.776+0000 7fd4fffff700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd50405f010 0x7fd5040614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:12.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.776+0000 7fd4fffff700 1 -- 172.21.15.72:0/1017901140 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fd50c07ba20 con 0x7fd518154120 2023-08-31T18:49:12.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.776+0000 7fd517fff700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd50405f010 0x7fd5040614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:12.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.777+0000 7fd517fff700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd50405f010 0x7fd5040614d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd508001750 tx=0x7fd508009040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:12.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.780+0000 7fd4fffff700 1 -- 172.21.15.72:0/1017901140 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd50c04cbe0 con 0x7fd518154120 2023-08-31T18:49:12.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.975+0000 7fd51e7ff700 1 -- 172.21.15.72:0/1017901140 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5180c4aa0 con 0x7fd50405f010 2023-08-31T18:49:12.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.980+0000 7fd4fffff700 1 -- 172.21.15.72:0/1017901140 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fd5180c4aa0 con 0x7fd50405f010 2023-08-31T18:49:12.979 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path /snap_test_dir1/dir3 2023-08-31T18:49:12.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.982+0000 7fd51e7ff700 1 -- 172.21.15.72:0/1017901140 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd50405f010 msgr2=0x7fd5040614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:12.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.982+0000 7fd51e7ff700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd50405f010 0x7fd5040614d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd508001750 tx=0x7fd508009040).stop 2023-08-31T18:49:12.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.982+0000 7fd51e7ff700 1 -- 172.21.15.72:0/1017901140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd518154120 msgr2=0x7fd5180c10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:12.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.982+0000 7fd51e7ff700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd518154120 0x7fd5180c10b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fd50c011000 tx=0x7fd50c017000).stop 2023-08-31T18:49:12.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.982+0000 7fd51e7ff700 1 -- 172.21.15.72:0/1017901140 shutdown_connections 2023-08-31T18:49:12.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.982+0000 7fd51e7ff700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd518154500 0x7fd5180c15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.982+0000 7fd51e7ff700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd50405f010 0x7fd5040614d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.982+0000 7fd51e7ff700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd518064db0 0x7fd5180c1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.982+0000 7fd51e7ff700 1 --2- 172.21.15.72:0/1017901140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd518154120 0x7fd5180c10b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.982+0000 7fd51e7ff700 1 -- 172.21.15.72:0/1017901140 >> 172.21.15.72:0/1017901140 conn(0x7fd5180cb7e0 msgr2=0x7fd51814d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.982+0000 7fd51e7ff700 1 -- 172.21.15.72:0/1017901140 shutdown_connections 2023-08-31T18:49:12.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:12.982+0000 7fd51e7ff700 1 -- 172.21.15.72:0/1017901140 wait complete. 2023-08-31T18:49:12.998 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-08-31T18:49:12.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T18:49:12.999 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-08-31T18:49:13.047 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-08-31T18:49:13.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.240+0000 7faa97fff700 1 Processor -- start 2023-08-31T18:49:13.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.240+0000 7faa97fff700 1 -- start start 2023-08-31T18:49:13.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.242+0000 7faa97fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa90154120 0x7faa900a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:13.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.242+0000 7faa97fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faa90154500 0x7faa900646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:13.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.242+0000 7faa97fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa900aa620 con 0x7faa90064b90 2023-08-31T18:49:13.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.242+0000 7faa97fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa90065020 con 0x7faa90154500 2023-08-31T18:49:13.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.242+0000 7faa97fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa900aa3a0 con 0x7faa90154120 2023-08-31T18:49:13.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.242+0000 7faa9559a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faa90154500 0x7faa900646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:13.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.242+0000 7faa9559a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faa90154500 0x7faa900646a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32782/0 (socket says 172.21.15.72:32782) 2023-08-31T18:49:13.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.242+0000 7faa9559a700 1 -- 172.21.15.72:0/3040565098 learned_addr learned my addr 172.21.15.72:0/3040565098 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:13.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.242+0000 7faa95d9b700 1 --2- 172.21.15.72:0/3040565098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa90154120 0x7faa900a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:13.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.242+0000 7faa9559a700 1 -- 172.21.15.72:0/3040565098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa90154120 msgr2=0x7faa900a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:13.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.242+0000 7faa9559a700 1 --2- 172.21.15.72:0/3040565098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa90154120 0x7faa900a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.242+0000 7faa9559a700 1 -- 172.21.15.72:0/3040565098 >> v1:172.21.15.72:6789/0 conn(0x7faa90064b90 legacy=0x7faa900c0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.242+0000 7faa9559a700 1 -- 172.21.15.72:0/3040565098 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa900c5450 con 0x7faa90154500 2023-08-31T18:49:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.242+0000 7faa95d9b700 1 --2- 172.21.15.72:0/3040565098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa90154120 0x7faa900a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.242+0000 7faa94d99700 1 -- 172.21.15.72:0/3040565098 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996976970 0 0) 0x7faa900aa620 con 0x7faa90064b90 2023-08-31T18:49:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.243+0000 7faa9559a700 1 --2- 172.21.15.72:0/3040565098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa90154500 0x7faa900646a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7faa80006fd0 tx=0x7faa800090f0).ready entity=mon.0 client_cookie=546c3e8c4b4d574f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:13.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.243+0000 7faa94d99700 1 -- 172.21.15.72:0/3040565098 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8000b600 con 0x7faa90154500 2023-08-31T18:49:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.243+0000 7faa94d99700 1 -- 172.21.15.72:0/3040565098 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8000b760 con 0x7faa90154500 2023-08-31T18:49:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.243+0000 7faa94d99700 1 -- 172.21.15.72:0/3040565098 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8000bae0 con 0x7faa90154500 2023-08-31T18:49:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.243+0000 7faa97fff700 1 -- 172.21.15.72:0/3040565098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa90154500 msgr2=0x7faa900646a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.243+0000 7faa97fff700 1 --2- 172.21.15.72:0/3040565098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa90154500 0x7faa900646a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7faa80006fd0 tx=0x7faa800090f0).stop 2023-08-31T18:49:13.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.243+0000 7faa97fff700 1 -- 172.21.15.72:0/3040565098 shutdown_connections 2023-08-31T18:49:13.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.243+0000 7faa97fff700 1 --2- 172.21.15.72:0/3040565098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa90154120 0x7faa900a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.243+0000 7faa97fff700 1 --2- 172.21.15.72:0/3040565098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa90154500 0x7faa900646a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.243+0000 7faa97fff700 1 -- 172.21.15.72:0/3040565098 >> 172.21.15.72:0/3040565098 conn(0x7faa900cb7e0 msgr2=0x7faa900c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:13.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.244+0000 7faa97fff700 1 -- 172.21.15.72:0/3040565098 shutdown_connections 2023-08-31T18:49:13.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.244+0000 7faa97fff700 1 -- 172.21.15.72:0/3040565098 wait complete. 2023-08-31T18:49:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.245+0000 7faa97fff700 1 Processor -- start 2023-08-31T18:49:13.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.245+0000 7faa97fff700 1 -- start start 2023-08-31T18:49:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.246+0000 7faa97fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa90064b90 0x7faa90139060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.246+0000 7faa97fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa90154120 0x7faa900ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.246+0000 7faa97fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa90154500 0x7faa90152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:13.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.246+0000 7faa97fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa90139550 con 0x7faa90154120 2023-08-31T18:49:13.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.246+0000 7faa97fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa900c2da0 con 0x7faa90154500 2023-08-31T18:49:13.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.246+0000 7faa97fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa900ac9f0 con 0x7faa90064b90 2023-08-31T18:49:13.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.246+0000 7faa9559a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa90154120 0x7faa900ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:13.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.246+0000 7faa9559a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa90154120 0x7faa900ac080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32786/0 (socket says 172.21.15.72:32786) 2023-08-31T18:49:13.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.246+0000 7faa9559a700 1 -- 172.21.15.72:0/869520755 learned_addr learned my addr 172.21.15.72:0/869520755 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:13.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.247+0000 7faa95d9b700 1 --2- 172.21.15.72:0/869520755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa90064b90 0x7faa90139060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:13.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.247+0000 7faa9659c700 1 --2- 172.21.15.72:0/869520755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa90154500 0x7faa90152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:13.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.247+0000 7faa9559a700 1 -- 172.21.15.72:0/869520755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa90064b90 msgr2=0x7faa90139060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:13.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.247+0000 7faa9559a700 1 --2- 172.21.15.72:0/869520755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa90064b90 0x7faa90139060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.247+0000 7faa9559a700 1 -- 172.21.15.72:0/869520755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa90154500 msgr2=0x7faa90152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:13.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.247+0000 7faa9559a700 1 --2- 172.21.15.72:0/869520755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa90154500 0x7faa90152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.247+0000 7faa9559a700 1 -- 172.21.15.72:0/869520755 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa80009370 con 0x7faa90154120 2023-08-31T18:49:13.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.247+0000 7faa9659c700 1 --2- 172.21.15.72:0/869520755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa90154500 0x7faa90152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:13.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.247+0000 7faa9559a700 1 --2- 172.21.15.72:0/869520755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa90154120 0x7faa900ac080 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7faa80011000 tx=0x7faa80017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:13.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.247+0000 7faa85ffb700 1 -- 172.21.15.72:0/869520755 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8000bae0 con 0x7faa90154120 2023-08-31T18:49:13.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.247+0000 7faa85ffb700 1 -- 172.21.15.72:0/869520755 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa80000c90 con 0x7faa90154120 2023-08-31T18:49:13.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.247+0000 7faa85ffb700 1 -- 172.21.15.72:0/869520755 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8001c670 con 0x7faa90154120 2023-08-31T18:49:13.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.247+0000 7faa97fff700 1 -- 172.21.15.72:0/869520755 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa900accd0 con 0x7faa90154120 2023-08-31T18:49:13.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.247+0000 7faa97fff700 1 -- 172.21.15.72:0/869520755 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa900ac570 con 0x7faa90154120 2023-08-31T18:49:13.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.248+0000 7faa97fff700 1 -- 172.21.15.72:0/869520755 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa9006a7e0 con 0x7faa90154120 2023-08-31T18:49:13.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.249+0000 7faa85ffb700 1 -- 172.21.15.72:0/869520755 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7faa8001c9e0 con 0x7faa90154120 2023-08-31T18:49:13.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.250+0000 7faa85ffb700 1 --2- 172.21.15.72:0/869520755 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faa7405f010 0x7faa740614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:13.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.250+0000 7faa85ffb700 1 -- 172.21.15.72:0/869520755 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7faa8007bee0 con 0x7faa90154120 2023-08-31T18:49:13.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.250+0000 7faa95d9b700 1 --2- 172.21.15.72:0/869520755 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faa7405f010 0x7faa740614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:13.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.251+0000 7faa95d9b700 1 --2- 172.21.15.72:0/869520755 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faa7405f010 0x7faa740614d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7faa8c00aa70 tx=0x7faa8c008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:13.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.254+0000 7faa85ffb700 1 -- 172.21.15.72:0/869520755 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faa8004cfa0 con 0x7faa90154120 2023-08-31T18:49:13.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.450+0000 7faa97fff700 1 -- 172.21.15.72:0/869520755 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7faa900ac760 con 0x7faa7405f010 2023-08-31T18:49:13.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.454+0000 7faa85ffb700 1 -- 172.21.15.72:0/869520755 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7faa900ac760 con 0x7faa7405f010 2023-08-31T18:49:13.455 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path /snap_test_dir1/dir4 2023-08-31T18:49:13.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.456+0000 7faa97fff700 1 -- 172.21.15.72:0/869520755 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faa7405f010 msgr2=0x7faa740614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:13.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.456+0000 7faa97fff700 1 --2- 172.21.15.72:0/869520755 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faa7405f010 0x7faa740614d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7faa8c00aa70 tx=0x7faa8c008040).stop 2023-08-31T18:49:13.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.456+0000 7faa97fff700 1 -- 172.21.15.72:0/869520755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa90154120 msgr2=0x7faa900ac080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:13.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.456+0000 7faa97fff700 1 --2- 172.21.15.72:0/869520755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa90154120 0x7faa900ac080 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7faa80011000 tx=0x7faa80017000).stop 2023-08-31T18:49:13.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.456+0000 7faa97fff700 1 -- 172.21.15.72:0/869520755 shutdown_connections 2023-08-31T18:49:13.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.456+0000 7faa97fff700 1 --2- 172.21.15.72:0/869520755 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faa7405f010 0x7faa740614d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.456+0000 7faa97fff700 1 --2- 172.21.15.72:0/869520755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa90154500 0x7faa90152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.456+0000 7faa97fff700 1 --2- 172.21.15.72:0/869520755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa90064b90 0x7faa90139060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.456+0000 7faa97fff700 1 --2- 172.21.15.72:0/869520755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa90154120 0x7faa900ac080 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.456+0000 7faa97fff700 1 -- 172.21.15.72:0/869520755 >> 172.21.15.72:0/869520755 conn(0x7faa900cb7e0 msgr2=0x7faa900a9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.457+0000 7faa97fff700 1 -- 172.21.15.72:0/869520755 shutdown_connections 2023-08-31T18:49:13.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.457+0000 7faa97fff700 1 -- 172.21.15.72:0/869520755 wait complete. 2023-08-31T18:49:13.473 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-08-31T18:49:13.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T18:49:13.474 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-08-31T18:49:13.524 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-08-31T18:49:13.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.719+0000 7fd0b3fff700 1 Processor -- start 2023-08-31T18:49:13.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.720+0000 7fd0b3fff700 1 -- start start 2023-08-31T18:49:13.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.721+0000 7fd0b3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0ac0c4bb0 0x7fd0ac0653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:13.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.721+0000 7fd0b3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd0ac13d960 0x7fd0ac0c5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:13.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.721+0000 7fd0b3fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ac0c5cf0 con 0x7fd0ac0c5880 2023-08-31T18:49:13.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.721+0000 7fd0b3fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ac0c4f90 con 0x7fd0ac0c4bb0 2023-08-31T18:49:13.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.721+0000 7fd0b3fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ac0c6020 con 0x7fd0ac13d960 2023-08-31T18:49:13.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.721+0000 7fd0b1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0ac0c4bb0 0x7fd0ac0653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:13.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.721+0000 7fd0b1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0ac0c4bb0 0x7fd0ac0653d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32788/0 (socket says 172.21.15.72:32788) 2023-08-31T18:49:13.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.721+0000 7fd0b259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd0ac0c5880 0x7fd0ac1546b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40096/0 (socket says 172.21.15.72:40096) 2023-08-31T18:49:13.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.721+0000 7fd0b1d9b700 1 -- 172.21.15.72:0/1691456617 learned_addr learned my addr 172.21.15.72:0/1691456617 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:13.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.722+0000 7fd0b1d9b700 1 -- 172.21.15.72:0/1691456617 >> v2:172.21.15.146:3300/0 conn(0x7fd0ac13d960 msgr2=0x7fd0ac0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:13.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.722+0000 7fd0b159a700 1 --2- 172.21.15.72:0/1691456617 >> v2:172.21.15.146:3300/0 conn(0x7fd0ac13d960 0x7fd0ac0c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:13.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.722+0000 7fd0b1d9b700 1 --2- 172.21.15.72:0/1691456617 >> v2:172.21.15.146:3300/0 conn(0x7fd0ac13d960 0x7fd0ac0c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.722+0000 7fd0b0d99700 1 -- 172.21.15.72:0/1691456617 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497092521 0 0) 0x7fd0ac0c5cf0 con 0x7fd0ac0c5880 2023-08-31T18:49:13.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.722+0000 7fd0b1d9b700 1 -- 172.21.15.72:0/1691456617 >> v1:172.21.15.72:6789/0 conn(0x7fd0ac0c5880 legacy=0x7fd0ac1546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:13.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.722+0000 7fd0b1d9b700 1 -- 172.21.15.72:0/1691456617 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac1587f0 con 0x7fd0ac0c4bb0 2023-08-31T18:49:13.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.722+0000 7fd0b159a700 1 --2- 172.21.15.72:0/1691456617 >> v2:172.21.15.146:3300/0 conn(0x7fd0ac13d960 0x7fd0ac0c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:13.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.722+0000 7fd0b1d9b700 1 --2- 172.21.15.72:0/1691456617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ac0c4bb0 0x7fd0ac0653d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fd0ac069410 tx=0x7fd0a80090f0).ready entity=mon.0 client_cookie=ab36fb4ba07f0323 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:13.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.722+0000 7fd0b0d99700 1 -- 172.21.15.72:0/1691456617 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a800b600 con 0x7fd0ac0c4bb0 2023-08-31T18:49:13.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.722+0000 7fd0b0d99700 1 -- 172.21.15.72:0/1691456617 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a800b760 con 0x7fd0ac0c4bb0 2023-08-31T18:49:13.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.722+0000 7fd0b0d99700 1 -- 172.21.15.72:0/1691456617 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a800bae0 con 0x7fd0ac0c4bb0 2023-08-31T18:49:13.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.723+0000 7fd0b3fff700 1 -- 172.21.15.72:0/1691456617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ac0c4bb0 msgr2=0x7fd0ac0653d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:13.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.723+0000 7fd0b3fff700 1 --2- 172.21.15.72:0/1691456617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ac0c4bb0 0x7fd0ac0653d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fd0ac069410 tx=0x7fd0a80090f0).stop 2023-08-31T18:49:13.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.723+0000 7fd0b3fff700 1 -- 172.21.15.72:0/1691456617 shutdown_connections 2023-08-31T18:49:13.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.723+0000 7fd0b3fff700 1 --2- 172.21.15.72:0/1691456617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ac0c4bb0 0x7fd0ac0653d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.723+0000 7fd0b3fff700 1 --2- 172.21.15.72:0/1691456617 >> v2:172.21.15.146:3300/0 conn(0x7fd0ac13d960 0x7fd0ac0c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.723+0000 7fd0b3fff700 1 -- 172.21.15.72:0/1691456617 >> 172.21.15.72:0/1691456617 conn(0x7fd0ac066350 msgr2=0x7fd0ac066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:13.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.723+0000 7fd0b3fff700 1 -- 172.21.15.72:0/1691456617 shutdown_connections 2023-08-31T18:49:13.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.723+0000 7fd0b3fff700 1 -- 172.21.15.72:0/1691456617 wait complete. 2023-08-31T18:49:13.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.724+0000 7fd0b3fff700 1 Processor -- start 2023-08-31T18:49:13.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.724+0000 7fd0b3fff700 1 -- start start 2023-08-31T18:49:13.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.725+0000 7fd0b3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ac0c4bb0 0x7fd0ac167430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:13.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.725+0000 7fd0b3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0ac0c5880 0x7fd0ac13aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:13.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.725+0000 7fd0b3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ac13d960 0x7fd0ac13c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:13.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.725+0000 7fd0b3fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac13c2f0 con 0x7fd0ac13d960 2023-08-31T18:49:13.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.725+0000 7fd0b3fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac13b6e0 con 0x7fd0ac0c5880 2023-08-31T18:49:13.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.725+0000 7fd0b3fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac13b9c0 con 0x7fd0ac0c4bb0 2023-08-31T18:49:13.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0b259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ac13d960 0x7fd0ac13c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:13.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0b259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ac13d960 0x7fd0ac13c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32794/0 (socket says 172.21.15.72:32794) 2023-08-31T18:49:13.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0b259c700 1 -- 172.21.15.72:0/1193990769 learned_addr learned my addr 172.21.15.72:0/1193990769 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:13.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0b159a700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0ac0c5880 0x7fd0ac13aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:13.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0b1d9b700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ac0c4bb0 0x7fd0ac167430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:13.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0b259c700 1 -- 172.21.15.72:0/1193990769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ac0c4bb0 msgr2=0x7fd0ac167430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:13.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0b259c700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ac0c4bb0 0x7fd0ac167430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0b259c700 1 -- 172.21.15.72:0/1193990769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0ac0c5880 msgr2=0x7fd0ac13aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:13.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0b259c700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0ac0c5880 0x7fd0ac13aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0b259c700 1 -- 172.21.15.72:0/1193990769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a8009370 con 0x7fd0ac13d960 2023-08-31T18:49:13.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0b1d9b700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ac0c4bb0 0x7fd0ac167430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:49:13.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0b159a700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0ac0c5880 0x7fd0ac13aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:49:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0b259c700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ac13d960 0x7fd0ac13c780 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fd0a400c730 tx=0x7fd0a4001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0a1ffb700 1 -- 172.21.15.72:0/1193990769 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4005c70 con 0x7fd0ac13d960 2023-08-31T18:49:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0a1ffb700 1 -- 172.21.15.72:0/1193990769 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a4005dd0 con 0x7fd0ac13d960 2023-08-31T18:49:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.726+0000 7fd0a1ffb700 1 -- 172.21.15.72:0/1193990769 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4007340 con 0x7fd0ac13d960 2023-08-31T18:49:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.727+0000 7fd0b3fff700 1 -- 172.21.15.72:0/1193990769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ac13bca0 con 0x7fd0ac13d960 2023-08-31T18:49:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.727+0000 7fd0b3fff700 1 -- 172.21.15.72:0/1193990769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ac13b3a0 con 0x7fd0ac13d960 2023-08-31T18:49:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.728+0000 7fd0b3fff700 1 -- 172.21.15.72:0/1193990769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ac06c6b0 con 0x7fd0ac13d960 2023-08-31T18:49:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.728+0000 7fd0a1ffb700 1 -- 172.21.15.72:0/1193990769 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7fd0a40076f0 con 0x7fd0ac13d960 2023-08-31T18:49:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.729+0000 7fd0a1ffb700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd09005f010 0x7fd0900614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.729+0000 7fd0a1ffb700 1 -- 172.21.15.72:0/1193990769 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fd0a407a2b0 con 0x7fd0ac13d960 2023-08-31T18:49:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.729+0000 7fd0b1d9b700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd09005f010 0x7fd0900614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.730+0000 7fd0b1d9b700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd09005f010 0x7fd0900614d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd0a8009130 tx=0x7fd0a8017000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.733+0000 7fd0a1ffb700 1 -- 172.21.15.72:0/1193990769 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd0a404b3f0 con 0x7fd0ac13d960 2023-08-31T18:49:13.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.925+0000 7fd0b3fff700 1 -- 172.21.15.72:0/1193990769 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0ac13c430 con 0x7fd09005f010 2023-08-31T18:49:13.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.930+0000 7fd0a1ffb700 1 -- 172.21.15.72:0/1193990769 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fd0ac13c430 con 0x7fd09005f010 2023-08-31T18:49:13.930 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path /snap_test_dir1/dir5 2023-08-31T18:49:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.932+0000 7fd0b3fff700 1 -- 172.21.15.72:0/1193990769 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd09005f010 msgr2=0x7fd0900614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.932+0000 7fd0b3fff700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd09005f010 0x7fd0900614d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd0a8009130 tx=0x7fd0a8017000).stop 2023-08-31T18:49:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.932+0000 7fd0b3fff700 1 -- 172.21.15.72:0/1193990769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ac13d960 msgr2=0x7fd0ac13c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.932+0000 7fd0b3fff700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ac13d960 0x7fd0ac13c780 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fd0a400c730 tx=0x7fd0a4001520).stop 2023-08-31T18:49:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.932+0000 7fd0b3fff700 1 -- 172.21.15.72:0/1193990769 shutdown_connections 2023-08-31T18:49:13.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.932+0000 7fd0b3fff700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ac13d960 0x7fd0ac13c780 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.932+0000 7fd0b3fff700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ac0c4bb0 0x7fd0ac167430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.932+0000 7fd0b3fff700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd09005f010 0x7fd0900614d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.932+0000 7fd0b3fff700 1 --2- 172.21.15.72:0/1193990769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0ac0c5880 0x7fd0ac13aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:13.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.932+0000 7fd0b3fff700 1 -- 172.21.15.72:0/1193990769 >> 172.21.15.72:0/1193990769 conn(0x7fd0ac066350 msgr2=0x7fd0ac0c5160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:13.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.932+0000 7fd0b3fff700 1 -- 172.21.15.72:0/1193990769 shutdown_connections 2023-08-31T18:49:13.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:13.932+0000 7fd0b3fff700 1 -- 172.21.15.72:0/1193990769 wait complete. 2023-08-31T18:49:13.949 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-08-31T18:49:13.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T18:49:13.950 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-08-31T18:49:13.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-08-31T18:49:14.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.193+0000 7f7278bff700 1 Processor -- start 2023-08-31T18:49:14.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.193+0000 7f7278bff700 1 -- start start 2023-08-31T18:49:14.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.195+0000 7f7278bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7274154500 0x7f72740a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:14.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.195+0000 7f7278bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72740aa620 con 0x7f7274064db0 2023-08-31T18:49:14.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.195+0000 7f7278bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72740aa3a0 con 0x7f7274154120 2023-08-31T18:49:14.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.195+0000 7f7278bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72740c5450 con 0x7f7274154500 2023-08-31T18:49:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.195+0000 7f7271d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7274064db0 0x7f727415beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40108/0 (socket says 172.21.15.72:40108) 2023-08-31T18:49:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.195+0000 7f7271d9b700 1 -- 172.21.15.72:0/2895410188 learned_addr learned my addr 172.21.15.72:0/2895410188 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:49:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.195+0000 7f7272d9d700 1 --2- 172.21.15.72:0/2895410188 >> v2:172.21.15.72:3300/0 conn(0x7f7274154500 0x7f72740a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.196+0000 7f727159a700 1 -- 172.21.15.72:0/2895410188 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321294576 0 0) 0x7f72740aa620 con 0x7f7274064db0 2023-08-31T18:49:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.196+0000 7f727159a700 1 -- 172.21.15.72:0/2895410188 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f725c0033f0 con 0x7f7274064db0 2023-08-31T18:49:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.196+0000 7f727159a700 1 -- 172.21.15.72:0/2895410188 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698824654 0 0) 0x7f72740aa3a0 con 0x7f7274154120 2023-08-31T18:49:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.196+0000 7f7272d9d700 1 -- 172.21.15.72:0/2895410188 >> v1:172.21.15.146:6789/0 conn(0x7f7274154120 legacy=0x7f72740646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.196+0000 7f7272d9d700 1 -- 172.21.15.72:0/2895410188 >> v1:172.21.15.72:6789/0 conn(0x7f7274064db0 legacy=0x7f727415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.196+0000 7f7272d9d700 1 -- 172.21.15.72:0/2895410188 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72740c8050 con 0x7f7274154500 2023-08-31T18:49:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.196+0000 7f7272d9d700 1 --2- 172.21.15.72:0/2895410188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7274154500 0x7f72740a9eb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f726c009e60 tx=0x7f726c009780).ready entity=mon.0 client_cookie=731d56c449e360a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.196+0000 7f727159a700 1 -- 172.21.15.72:0/2895410188 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00e070 con 0x7f7274154500 2023-08-31T18:49:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.196+0000 7f727159a700 1 -- 172.21.15.72:0/2895410188 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c00bb60 con 0x7f7274154500 2023-08-31T18:49:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.196+0000 7f727159a700 1 -- 172.21.15.72:0/2895410188 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00bee0 con 0x7f7274154500 2023-08-31T18:49:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.197+0000 7f7278bff700 1 -- 172.21.15.72:0/2895410188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7274154500 msgr2=0x7f72740a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.197+0000 7f7278bff700 1 --2- 172.21.15.72:0/2895410188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7274154500 0x7f72740a9eb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f726c009e60 tx=0x7f726c009780).stop 2023-08-31T18:49:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.197+0000 7f7278bff700 1 -- 172.21.15.72:0/2895410188 shutdown_connections 2023-08-31T18:49:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.197+0000 7f7278bff700 1 --2- 172.21.15.72:0/2895410188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7274154500 0x7f72740a9eb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.197+0000 7f7278bff700 1 -- 172.21.15.72:0/2895410188 >> 172.21.15.72:0/2895410188 conn(0x7f72740cb7e0 msgr2=0x7f72740c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.197+0000 7f7278bff700 1 -- 172.21.15.72:0/2895410188 shutdown_connections 2023-08-31T18:49:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.197+0000 7f7278bff700 1 -- 172.21.15.72:0/2895410188 wait complete. 2023-08-31T18:49:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.198+0000 7f7278bff700 1 Processor -- start 2023-08-31T18:49:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.198+0000 7f7278bff700 1 -- start start 2023-08-31T18:49:14.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.199+0000 7f7278bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7274064db0 0x7f7274164780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:14.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.199+0000 7f7278bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7274154120 0x7f7274165950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:14.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.199+0000 7f7278bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7274154500 0x7f72740c2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:14.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.199+0000 7f7278bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72741517e0 con 0x7f7274154500 2023-08-31T18:49:14.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.199+0000 7f7278bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7274164d40 con 0x7f7274064db0 2023-08-31T18:49:14.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.199+0000 7f7278bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7274165020 con 0x7f7274154120 2023-08-31T18:49:14.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f7272d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7274154500 0x7f72740c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:14.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f7272d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7274154500 0x7f72740c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32814/0 (socket says 172.21.15.72:32814) 2023-08-31T18:49:14.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f7272d9d700 1 -- 172.21.15.72:0/1029312729 learned_addr learned my addr 172.21.15.72:0/1029312729 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:14.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f7271d9b700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7274154120 0x7f7274165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:14.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f727259c700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7274064db0 0x7f7274164780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:14.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f7272d9d700 1 -- 172.21.15.72:0/1029312729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7274154120 msgr2=0x7f7274165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:14.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f7272d9d700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7274154120 0x7f7274165950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f7272d9d700 1 -- 172.21.15.72:0/1029312729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7274064db0 msgr2=0x7f7274164780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:14.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f7272d9d700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7274064db0 0x7f7274164780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f7272d9d700 1 -- 172.21.15.72:0/1029312729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c009a20 con 0x7f7274154500 2023-08-31T18:49:14.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f7271d9b700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7274154120 0x7f7274165950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:14.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f727259c700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7274064db0 0x7f7274164780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:14.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f7272d9d700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7274154500 0x7f72740c2440 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f726c009d30 tx=0x7f72740c6ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:14.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f72627fc700 1 -- 172.21.15.72:0/1029312729 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c01d630 con 0x7f7274154500 2023-08-31T18:49:14.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f72627fc700 1 -- 172.21.15.72:0/1029312729 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c01d790 con 0x7f7274154500 2023-08-31T18:49:14.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f7278bff700 1 -- 172.21.15.72:0/1029312729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7274165300 con 0x7f7274154500 2023-08-31T18:49:14.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.200+0000 7f72627fc700 1 -- 172.21.15.72:0/1029312729 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c01db50 con 0x7f7274154500 2023-08-31T18:49:14.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.201+0000 7f7278bff700 1 -- 172.21.15.72:0/1029312729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7274165e40 con 0x7f7274154500 2023-08-31T18:49:14.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.202+0000 7f7278bff700 1 -- 172.21.15.72:0/1029312729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7274151990 con 0x7f7274154500 2023-08-31T18:49:14.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.202+0000 7f72627fc700 1 -- 172.21.15.72:0/1029312729 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f726c003040 con 0x7f7274154500 2023-08-31T18:49:14.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.203+0000 7f72627fc700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f725405f010 0x7f72540614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:14.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.203+0000 7f72627fc700 1 -- 172.21.15.72:0/1029312729 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f726c07c0f0 con 0x7f7274154500 2023-08-31T18:49:14.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.203+0000 7f727259c700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f725405f010 0x7f72540614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:14.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.204+0000 7f727259c700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f725405f010 0x7f72540614d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f72740c3ca0 tx=0x7f7264009040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:14.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.208+0000 7f72627fc700 1 -- 172.21.15.72:0/1029312729 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7274151990 con 0x7f7274154500 2023-08-31T18:49:14.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.400+0000 7f7278bff700 1 -- 172.21.15.72:0/1029312729 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f72740c3eb0 con 0x7f725405f010 2023-08-31T18:49:14.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.404+0000 7f72627fc700 1 -- 172.21.15.72:0/1029312729 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f72740c3eb0 con 0x7f725405f010 2023-08-31T18:49:14.405 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path /snap_test_dir1/dir6 2023-08-31T18:49:14.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.406+0000 7f7278bff700 1 -- 172.21.15.72:0/1029312729 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f725405f010 msgr2=0x7f72540614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:14.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.406+0000 7f7278bff700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f725405f010 0x7f72540614d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f72740c3ca0 tx=0x7f7264009040).stop 2023-08-31T18:49:14.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.406+0000 7f7278bff700 1 -- 172.21.15.72:0/1029312729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7274154500 msgr2=0x7f72740c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.406+0000 7f7278bff700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7274154500 0x7f72740c2440 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f726c009d30 tx=0x7f72740c6ba0).stop 2023-08-31T18:49:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.406+0000 7f7278bff700 1 -- 172.21.15.72:0/1029312729 shutdown_connections 2023-08-31T18:49:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.406+0000 7f7278bff700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7274154500 0x7f72740c2440 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.406+0000 7f7278bff700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f725405f010 0x7f72540614d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.406+0000 7f7278bff700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7274064db0 0x7f7274164780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.406+0000 7f7278bff700 1 --2- 172.21.15.72:0/1029312729 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7274154120 0x7f7274165950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.407+0000 7f7278bff700 1 -- 172.21.15.72:0/1029312729 >> 172.21.15.72:0/1029312729 conn(0x7f72740cb7e0 msgr2=0x7f7274065190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.407+0000 7f7278bff700 1 -- 172.21.15.72:0/1029312729 shutdown_connections 2023-08-31T18:49:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.407+0000 7f7278bff700 1 -- 172.21.15.72:0/1029312729 wait complete. 2023-08-31T18:49:14.424 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-08-31T18:49:14.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T18:49:14.425 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-08-31T18:49:14.474 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-08-31T18:49:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.668+0000 7f613d3ff700 1 Processor -- start 2023-08-31T18:49:14.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.668+0000 7f613d3ff700 1 -- start start 2023-08-31T18:49:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.669+0000 7f613d3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6138068c20 0x7f6138069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.669+0000 7f613d3ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6138062650 0x7f6138063c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.669+0000 7f613d3ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6138064110 con 0x7f61380c1b50 2023-08-31T18:49:14.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.669+0000 7f613d3ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6138062b80 con 0x7f6138062650 2023-08-31T18:49:14.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.669+0000 7f613d3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6138062e60 con 0x7f6138068c20 2023-08-31T18:49:14.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.669+0000 7f6136ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6138068c20 0x7f6138069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:14.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.669+0000 7f61367fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6138062650 0x7f6138063c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:14.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.670+0000 7f6136ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6138068c20 0x7f6138069000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:39628/0 (socket says 172.21.15.72:39628) 2023-08-31T18:49:14.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.670+0000 7f6136ffd700 1 -- 172.21.15.72:0/461079143 learned_addr learned my addr 172.21.15.72:0/461079143 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:14.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.670+0000 7f61377fe700 1 --1- 172.21.15.72:0/461079143 >> v1:172.21.15.146:6789/0 conn(0x7f61380c1b50 0x7f6138157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:48102/0 (socket says 172.21.15.72:48102) 2023-08-31T18:49:14.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.670+0000 7f6136ffd700 1 -- 172.21.15.72:0/461079143 >> v2:172.21.15.146:3300/0 conn(0x7f6138062650 msgr2=0x7f6138063c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:14.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.670+0000 7f6136ffd700 1 --2- 172.21.15.72:0/461079143 >> v2:172.21.15.146:3300/0 conn(0x7f6138062650 0x7f6138063c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.670+0000 7f6136ffd700 1 -- 172.21.15.72:0/461079143 >> v1:172.21.15.146:6789/0 conn(0x7f61380c1b50 legacy=0x7f6138157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:14.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.670+0000 7f6136ffd700 1 -- 172.21.15.72:0/461079143 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6138063140 con 0x7f6138068c20 2023-08-31T18:49:14.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.670+0000 7f6136ffd700 1 --2- 172.21.15.72:0/461079143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6138068c20 0x7f6138069000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6128006fd0 tx=0x7f61280090f0).ready entity=mon.2 client_cookie=d56402805c33e605 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:14.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.670+0000 7f6135ffb700 1 -- 172.21.15.72:0/461079143 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612800b580 con 0x7f6138068c20 2023-08-31T18:49:14.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.670+0000 7f6135ffb700 1 -- 172.21.15.72:0/461079143 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612800b6e0 con 0x7f6138068c20 2023-08-31T18:49:14.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.670+0000 7f6135ffb700 1 -- 172.21.15.72:0/461079143 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612800ba60 con 0x7f6138068c20 2023-08-31T18:49:14.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.671+0000 7f613d3ff700 1 -- 172.21.15.72:0/461079143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6138068c20 msgr2=0x7f6138069000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.671+0000 7f613d3ff700 1 --2- 172.21.15.72:0/461079143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6138068c20 0x7f6138069000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6128006fd0 tx=0x7f61280090f0).stop 2023-08-31T18:49:14.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.671+0000 7f613d3ff700 1 -- 172.21.15.72:0/461079143 shutdown_connections 2023-08-31T18:49:14.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.671+0000 7f613d3ff700 1 --2- 172.21.15.72:0/461079143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6138068c20 0x7f6138069000 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.671+0000 7f613d3ff700 1 --2- 172.21.15.72:0/461079143 >> v2:172.21.15.146:3300/0 conn(0x7f6138062650 0x7f6138063c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.671+0000 7f613d3ff700 1 -- 172.21.15.72:0/461079143 >> 172.21.15.72:0/461079143 conn(0x7f61380c72f0 msgr2=0x7f61380c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:14.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.671+0000 7f613d3ff700 1 -- 172.21.15.72:0/461079143 shutdown_connections 2023-08-31T18:49:14.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.671+0000 7f613d3ff700 1 -- 172.21.15.72:0/461079143 wait complete. 2023-08-31T18:49:14.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.673+0000 7f613d3ff700 1 Processor -- start 2023-08-31T18:49:14.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.673+0000 7f613d3ff700 1 -- start start 2023-08-31T18:49:14.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.674+0000 7f613d3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6138062650 0x7f61380ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:14.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f613d3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6138068c20 0x7f61380ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:14.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f613d3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61380c1b50 0x7f6138148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:14.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f613d3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61380ad390 con 0x7f6138062650 2023-08-31T18:49:14.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f613d3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61380ac780 con 0x7f6138068c20 2023-08-31T18:49:14.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f613d3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61380aca60 con 0x7f61380c1b50 2023-08-31T18:49:14.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f6136ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6138062650 0x7f61380ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:14.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f6136ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6138062650 0x7f61380ac1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32818/0 (socket says 172.21.15.72:32818) 2023-08-31T18:49:14.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f6136ffd700 1 -- 172.21.15.72:0/3491589773 learned_addr learned my addr 172.21.15.72:0/3491589773 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:14.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f61367fc700 1 --2- 172.21.15.72:0/3491589773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6138068c20 0x7f61380ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:14.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f61377fe700 1 --2- 172.21.15.72:0/3491589773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61380c1b50 0x7f6138148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:14.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f6136ffd700 1 -- 172.21.15.72:0/3491589773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61380c1b50 msgr2=0x7f6138148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:14.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f6136ffd700 1 --2- 172.21.15.72:0/3491589773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61380c1b50 0x7f6138148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f6136ffd700 1 -- 172.21.15.72:0/3491589773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6138068c20 msgr2=0x7f61380ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:14.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f6136ffd700 1 --2- 172.21.15.72:0/3491589773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6138068c20 0x7f61380ab750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f6136ffd700 1 -- 172.21.15.72:0/3491589773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6128009370 con 0x7f6138062650 2023-08-31T18:49:14.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.675+0000 7f6136ffd700 1 --2- 172.21.15.72:0/3491589773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6138062650 0x7f61380ac1a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f6128009130 tx=0x7f6128017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:14.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.676+0000 7f611effd700 1 -- 172.21.15.72:0/3491589773 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128000bc0 con 0x7f6138062650 2023-08-31T18:49:14.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.676+0000 7f611effd700 1 -- 172.21.15.72:0/3491589773 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612800b850 con 0x7f6138062650 2023-08-31T18:49:14.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.676+0000 7f611effd700 1 -- 172.21.15.72:0/3491589773 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128000d20 con 0x7f6138062650 2023-08-31T18:49:14.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.676+0000 7f613d3ff700 1 -- 172.21.15.72:0/3491589773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61380acd40 con 0x7f6138062650 2023-08-31T18:49:14.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.676+0000 7f613d3ff700 1 -- 172.21.15.72:0/3491589773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61380abc40 con 0x7f6138062650 2023-08-31T18:49:14.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.677+0000 7f613d3ff700 1 -- 172.21.15.72:0/3491589773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613806c6b0 con 0x7f6138062650 2023-08-31T18:49:14.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.678+0000 7f611effd700 1 -- 172.21.15.72:0/3491589773 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f612801c900 con 0x7f6138062650 2023-08-31T18:49:14.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.678+0000 7f611effd700 1 --2- 172.21.15.72:0/3491589773 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f612405f010 0x7f61240614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:14.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.678+0000 7f611effd700 1 -- 172.21.15.72:0/3491589773 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f612807be60 con 0x7f6138062650 2023-08-31T18:49:14.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.679+0000 7f61367fc700 1 --2- 172.21.15.72:0/3491589773 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f612405f010 0x7f61240614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:14.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.679+0000 7f61367fc700 1 --2- 172.21.15.72:0/3491589773 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f612405f010 0x7f61240614d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f6138155bd0 tx=0x7f612c009060).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:14.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.683+0000 7f611effd700 1 -- 172.21.15.72:0/3491589773 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f612804cfc0 con 0x7f6138062650 2023-08-31T18:49:14.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.875+0000 7f613d3ff700 1 -- 172.21.15.72:0/3491589773 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6138063420 con 0x7f612405f010 2023-08-31T18:49:14.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.880+0000 7f611effd700 1 -- 172.21.15.72:0/3491589773 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f6138063420 con 0x7f612405f010 2023-08-31T18:49:14.881 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path /snap_test_dir1/dir7 2023-08-31T18:49:14.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.882+0000 7f613d3ff700 1 -- 172.21.15.72:0/3491589773 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f612405f010 msgr2=0x7f61240614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:14.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.882+0000 7f613d3ff700 1 --2- 172.21.15.72:0/3491589773 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f612405f010 0x7f61240614d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f6138155bd0 tx=0x7f612c009060).stop 2023-08-31T18:49:14.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.882+0000 7f613d3ff700 1 -- 172.21.15.72:0/3491589773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6138062650 msgr2=0x7f61380ac1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:14.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.882+0000 7f613d3ff700 1 --2- 172.21.15.72:0/3491589773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6138062650 0x7f61380ac1a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f6128009130 tx=0x7f6128017000).stop 2023-08-31T18:49:14.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.882+0000 7f613d3ff700 1 -- 172.21.15.72:0/3491589773 shutdown_connections 2023-08-31T18:49:14.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.882+0000 7f613d3ff700 1 --2- 172.21.15.72:0/3491589773 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f61380c1b50 0x7f6138148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.882+0000 7f613d3ff700 1 --2- 172.21.15.72:0/3491589773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6138062650 0x7f61380ac1a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.882+0000 7f613d3ff700 1 --2- 172.21.15.72:0/3491589773 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f612405f010 0x7f61240614d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.882+0000 7f613d3ff700 1 --2- 172.21.15.72:0/3491589773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6138068c20 0x7f61380ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:14.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.882+0000 7f613d3ff700 1 -- 172.21.15.72:0/3491589773 >> 172.21.15.72:0/3491589773 conn(0x7f61380c72f0 msgr2=0x7f61380c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:14.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.882+0000 7f613d3ff700 1 -- 172.21.15.72:0/3491589773 shutdown_connections 2023-08-31T18:49:14.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:14.882+0000 7f613d3ff700 1 -- 172.21.15.72:0/3491589773 wait complete. 2023-08-31T18:49:14.900 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-08-31T18:49:14.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T18:49:14.901 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-08-31T18:49:14.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-08-31T18:49:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.151+0000 7f59917ff700 1 Processor -- start 2023-08-31T18:49:15.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.151+0000 7f59917ff700 1 -- start start 2023-08-31T18:49:15.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.153+0000 7f59917ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f598c068c20 0x7f598c069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:15.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.153+0000 7f59917ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598c0c2260 con 0x7f598c063c20 2023-08-31T18:49:15.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.153+0000 7f59917ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598c062b80 con 0x7f598c062650 2023-08-31T18:49:15.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.153+0000 7f59917ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598c062e60 con 0x7f598c068c20 2023-08-31T18:49:15.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.153+0000 7f598b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f598c063c20 0x7f598c157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40116/0 (socket says 172.21.15.72:40116) 2023-08-31T18:49:15.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.153+0000 7f598b7fe700 1 -- 172.21.15.72:0/819586254 learned_addr learned my addr 172.21.15.72:0/819586254 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:49:15.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.153+0000 7f598affd700 1 --2- 172.21.15.72:0/819586254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f598c068c20 0x7f598c069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:15.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.153+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889801662 0 0) 0x7f598c0c2260 con 0x7f598c063c20 2023-08-31T18:49:15.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.153+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59740033f0 con 0x7f598c063c20 2023-08-31T18:49:15.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700549134 0 0) 0x7f598c062b80 con 0x7f598c062650 2023-08-31T18:49:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f598c0c2260 con 0x7f598c062650 2023-08-31T18:49:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2968956874 0 0) 0x7f59740033f0 con 0x7f598c063c20 2023-08-31T18:49:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f598c068c20 msgr2=0x7f598c069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f5989ffb700 1 --2- 172.21.15.72:0/819586254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f598c068c20 0x7f598c069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 >> v1:172.21.15.146:6789/0 conn(0x7f598c062650 legacy=0x7f598c0c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c063140 con 0x7f598c063c20 2023-08-31T18:49:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f5984001770 con 0x7f598c063c20 2023-08-31T18:49:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 >> v1:172.21.15.72:6789/0 conn(0x7f598c063c20 legacy=0x7f598c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:15.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f5989ffb700 1 --2- 172.21.15.72:0/819586254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5974003aa0 0x7f5974003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f5989ffb700 1 --2- 172.21.15.72:0/819586254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5974004690 0x7f5974004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f5989ffb700 1 --2- 172.21.15.72:0/819586254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5974005000 0x7f597400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c062e60 con 0x7f5974003aa0 2023-08-31T18:49:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597400be30 con 0x7f5974004690 2023-08-31T18:49:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597400bff0 con 0x7f5974005000 2023-08-31T18:49:15.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f598affd700 1 --2- 172.21.15.72:0/819586254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f598c068c20 0x7f598c069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:49:15.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f598affd700 1 --2- 172.21.15.72:0/819586254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5974003aa0 0x7f5974003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:15.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f598a7fc700 1 --2- 172.21.15.72:0/819586254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5974004690 0x7f5974004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:15.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.154+0000 7f598b7fe700 1 --2- 172.21.15.72:0/819586254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5974005000 0x7f597400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:15.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.155+0000 7f598affd700 1 -- 172.21.15.72:0/819586254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5974005000 msgr2=0x7f597400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.155+0000 7f598affd700 1 --2- 172.21.15.72:0/819586254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5974005000 0x7f597400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.155+0000 7f598affd700 1 -- 172.21.15.72:0/819586254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5974004690 msgr2=0x7f5974004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.155+0000 7f598affd700 1 --2- 172.21.15.72:0/819586254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5974004690 0x7f5974004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.155+0000 7f598affd700 1 -- 172.21.15.72:0/819586254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59740033f0 con 0x7f5974003aa0 2023-08-31T18:49:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.155+0000 7f598affd700 1 --2- 172.21.15.72:0/819586254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5974003aa0 0x7f5974003ea0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f598c068510 tx=0x7f597c009060).ready entity=mon.0 client_cookie=a55b7a4b1c08717c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.155+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c0094d0 con 0x7f5974003aa0 2023-08-31T18:49:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.155+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c00e640 con 0x7f5974003aa0 2023-08-31T18:49:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.155+0000 7f5989ffb700 1 -- 172.21.15.72:0/819586254 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c00ea00 con 0x7f5974003aa0 2023-08-31T18:49:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.155+0000 7f59917ff700 1 -- 172.21.15.72:0/819586254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5974003aa0 msgr2=0x7f5974003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.156+0000 7f59917ff700 1 --2- 172.21.15.72:0/819586254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5974003aa0 0x7f5974003ea0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f598c068510 tx=0x7f597c009060).stop 2023-08-31T18:49:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.156+0000 7f598b7fe700 1 -- 172.21.15.72:0/819586254 reap_dead start 2023-08-31T18:49:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.156+0000 7f59917ff700 1 -- 172.21.15.72:0/819586254 shutdown_connections 2023-08-31T18:49:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.156+0000 7f59917ff700 1 -- 172.21.15.72:0/819586254 >> 172.21.15.72:0/819586254 conn(0x7f598c0c72f0 msgr2=0x7f598c0c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.156+0000 7f59917ff700 1 -- 172.21.15.72:0/819586254 shutdown_connections 2023-08-31T18:49:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.156+0000 7f59917ff700 1 -- 172.21.15.72:0/819586254 wait complete. 2023-08-31T18:49:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.157+0000 7f59917ff700 1 Processor -- start 2023-08-31T18:49:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.157+0000 7f59917ff700 1 -- start start 2023-08-31T18:49:15.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.158+0000 7f59917ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5974003aa0 0x7f598c166810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.158+0000 7f59917ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f598c0ab8c0 0x7f598c0abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.158+0000 7f59917ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f598c14e480 0x7f598c14e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.158+0000 7f59917ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c0acf20 con 0x7f5974003aa0 2023-08-31T18:49:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.158+0000 7f59917ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c14edf0 con 0x7f598c0ab8c0 2023-08-31T18:49:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.158+0000 7f59917ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598c0ac310 con 0x7f598c14e480 2023-08-31T18:49:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.158+0000 7f598affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5974003aa0 0x7f598c166810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.158+0000 7f598affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5974003aa0 0x7f598c166810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32848/0 (socket says 172.21.15.72:32848) 2023-08-31T18:49:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.158+0000 7f598affd700 1 -- 172.21.15.72:0/2070683449 learned_addr learned my addr 172.21.15.72:0/2070683449 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:15.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.159+0000 7f598b7fe700 1 --2- 172.21.15.72:0/2070683449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f598c14e480 0x7f598c14e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:15.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.159+0000 7f598a7fc700 1 --2- 172.21.15.72:0/2070683449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f598c0ab8c0 0x7f598c0abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:15.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.159+0000 7f598affd700 1 -- 172.21.15.72:0/2070683449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f598c14e480 msgr2=0x7f598c14e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:15.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.159+0000 7f598affd700 1 --2- 172.21.15.72:0/2070683449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f598c14e480 0x7f598c14e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.159+0000 7f598affd700 1 -- 172.21.15.72:0/2070683449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f598c0ab8c0 msgr2=0x7f598c0abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:15.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.159+0000 7f598affd700 1 --2- 172.21.15.72:0/2070683449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f598c0ab8c0 0x7f598c0abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.159+0000 7f598affd700 1 -- 172.21.15.72:0/2070683449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c0ac5f0 con 0x7f5974003aa0 2023-08-31T18:49:15.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.159+0000 7f598a7fc700 1 --2- 172.21.15.72:0/2070683449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f598c0ab8c0 0x7f598c0abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:49:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.159+0000 7f598affd700 1 --2- 172.21.15.72:0/2070683449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5974003aa0 0x7f598c166810 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f597c01ed40 tx=0x7f597c019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.159+0000 7f5972ffd700 1 -- 172.21.15.72:0/2070683449 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c0094d0 con 0x7f5974003aa0 2023-08-31T18:49:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.159+0000 7f5972ffd700 1 -- 172.21.15.72:0/2070683449 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c00ed70 con 0x7f5974003aa0 2023-08-31T18:49:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.159+0000 7f59917ff700 1 -- 172.21.15.72:0/2070683449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598c0ac8d0 con 0x7f5974003aa0 2023-08-31T18:49:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.159+0000 7f5972ffd700 1 -- 172.21.15.72:0/2070683449 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c00eee0 con 0x7f5974003aa0 2023-08-31T18:49:15.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.159+0000 7f59917ff700 1 -- 172.21.15.72:0/2070683449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598c166d00 con 0x7f5974003aa0 2023-08-31T18:49:15.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.160+0000 7f59917ff700 1 -- 172.21.15.72:0/2070683449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598c06c6b0 con 0x7f5974003aa0 2023-08-31T18:49:15.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.161+0000 7f5972ffd700 1 -- 172.21.15.72:0/2070683449 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f597c01c900 con 0x7f5974003aa0 2023-08-31T18:49:15.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.162+0000 7f5972ffd700 1 --2- 172.21.15.72:0/2070683449 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f597805f010 0x7f59780614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:15.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.162+0000 7f5972ffd700 1 -- 172.21.15.72:0/2070683449 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f597c07c3f0 con 0x7f5974003aa0 2023-08-31T18:49:15.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.162+0000 7f598a7fc700 1 --2- 172.21.15.72:0/2070683449 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f597805f010 0x7f59780614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:15.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.163+0000 7f598a7fc700 1 --2- 172.21.15.72:0/2070683449 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f597805f010 0x7f59780614d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f59800010e0 tx=0x7f5980009040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:15.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.166+0000 7f5972ffd700 1 -- 172.21.15.72:0/2070683449 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f597c04d4b0 con 0x7f5974003aa0 2023-08-31T18:49:15.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.360+0000 7f59917ff700 1 -- 172.21.15.72:0/2070683449 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f598c063420 con 0x7f597805f010 2023-08-31T18:49:15.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.365+0000 7f5972ffd700 1 -- 172.21.15.72:0/2070683449 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f598c063420 con 0x7f597805f010 2023-08-31T18:49:15.365 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path /snap_test_dir1/dir8 2023-08-31T18:49:15.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.367+0000 7f59917ff700 1 -- 172.21.15.72:0/2070683449 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f597805f010 msgr2=0x7f59780614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.367+0000 7f59917ff700 1 --2- 172.21.15.72:0/2070683449 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f597805f010 0x7f59780614d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f59800010e0 tx=0x7f5980009040).stop 2023-08-31T18:49:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.367+0000 7f59917ff700 1 -- 172.21.15.72:0/2070683449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5974003aa0 msgr2=0x7f598c166810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.367+0000 7f59917ff700 1 --2- 172.21.15.72:0/2070683449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5974003aa0 0x7f598c166810 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f597c01ed40 tx=0x7f597c019000).stop 2023-08-31T18:49:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.367+0000 7f59917ff700 1 -- 172.21.15.72:0/2070683449 shutdown_connections 2023-08-31T18:49:15.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.367+0000 7f59917ff700 1 --2- 172.21.15.72:0/2070683449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f598c14e480 0x7f598c14e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.367+0000 7f59917ff700 1 --2- 172.21.15.72:0/2070683449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5974003aa0 0x7f598c166810 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.367+0000 7f59917ff700 1 --2- 172.21.15.72:0/2070683449 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f597805f010 0x7f59780614d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.367+0000 7f59917ff700 1 --2- 172.21.15.72:0/2070683449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f598c0ab8c0 0x7f598c0abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.367+0000 7f59917ff700 1 -- 172.21.15.72:0/2070683449 >> 172.21.15.72:0/2070683449 conn(0x7f598c0c72f0 msgr2=0x7f598c154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:15.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.367+0000 7f59917ff700 1 -- 172.21.15.72:0/2070683449 shutdown_connections 2023-08-31T18:49:15.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.367+0000 7f59917ff700 1 -- 172.21.15.72:0/2070683449 wait complete. 2023-08-31T18:49:15.385 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-08-31T18:49:15.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T18:49:15.386 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-08-31T18:49:15.437 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-08-31T18:49:15.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.637+0000 7fba31dff700 1 Processor -- start 2023-08-31T18:49:15.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.637+0000 7fba31dff700 1 -- start start 2023-08-31T18:49:15.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.638+0000 7fba31dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba2c151da0 0x7fba2c155110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:15.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.638+0000 7fba31dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2c154c80 con 0x7fba2c0c7f20 2023-08-31T18:49:15.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.638+0000 7fba31dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2c0a9f10 con 0x7fba2c064db0 2023-08-31T18:49:15.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.638+0000 7fba31dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2c0aa1f0 con 0x7fba2c151da0 2023-08-31T18:49:15.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.638+0000 7fba2b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba2c151da0 0x7fba2c155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:15.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.639+0000 7fba2b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba2c151da0 0x7fba2c155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32862/0 (socket says 172.21.15.72:32862) 2023-08-31T18:49:15.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.639+0000 7fba2b7fe700 1 -- 172.21.15.72:0/3141556049 learned_addr learned my addr 172.21.15.72:0/3141556049 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:15.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.639+0000 7fba2b7fe700 1 -- 172.21.15.72:0/3141556049 >> v1:172.21.15.146:6789/0 conn(0x7fba2c064db0 legacy=0x7fba2c0bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:15.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.639+0000 7fba2b7fe700 1 -- 172.21.15.72:0/3141556049 >> v1:172.21.15.72:6789/0 conn(0x7fba2c0c7f20 legacy=0x7fba2c0646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:15.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.639+0000 7fba2b7fe700 1 -- 172.21.15.72:0/3141556049 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c0aa4d0 con 0x7fba2c151da0 2023-08-31T18:49:15.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.639+0000 7fba2a7fc700 1 -- 172.21.15.72:0/3141556049 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271010342 0 0) 0x7fba2c154c80 con 0x7fba2c0c7f20 2023-08-31T18:49:15.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.639+0000 7fba2b7fe700 1 --2- 172.21.15.72:0/3141556049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba2c151da0 0x7fba2c155110 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fba1c006fd0 tx=0x7fba1c0090f0).ready entity=mon.0 client_cookie=ebbea719b4a21dd2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:15.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.639+0000 7fba2a7fc700 1 -- 172.21.15.72:0/3141556049 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c00b600 con 0x7fba2c151da0 2023-08-31T18:49:15.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.639+0000 7fba2a7fc700 1 -- 172.21.15.72:0/3141556049 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1c00b760 con 0x7fba2c151da0 2023-08-31T18:49:15.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.639+0000 7fba2a7fc700 1 -- 172.21.15.72:0/3141556049 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c00bae0 con 0x7fba2c151da0 2023-08-31T18:49:15.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.640+0000 7fba31dff700 1 -- 172.21.15.72:0/3141556049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba2c151da0 msgr2=0x7fba2c155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:15.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.640+0000 7fba31dff700 1 --2- 172.21.15.72:0/3141556049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba2c151da0 0x7fba2c155110 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fba1c006fd0 tx=0x7fba1c0090f0).stop 2023-08-31T18:49:15.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.640+0000 7fba31dff700 1 -- 172.21.15.72:0/3141556049 shutdown_connections 2023-08-31T18:49:15.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.640+0000 7fba31dff700 1 --2- 172.21.15.72:0/3141556049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba2c151da0 0x7fba2c155110 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.640+0000 7fba31dff700 1 -- 172.21.15.72:0/3141556049 >> 172.21.15.72:0/3141556049 conn(0x7fba2c0cb840 msgr2=0x7fba2c0c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:15.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.640+0000 7fba31dff700 1 -- 172.21.15.72:0/3141556049 shutdown_connections 2023-08-31T18:49:15.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.640+0000 7fba31dff700 1 -- 172.21.15.72:0/3141556049 wait complete. 2023-08-31T18:49:15.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.642+0000 7fba31dff700 1 Processor -- start 2023-08-31T18:49:15.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.642+0000 7fba31dff700 1 -- start start 2023-08-31T18:49:15.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba31dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba2c064db0 0x7fba2c141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:15.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba31dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba2c0c7f20 0x7fba2c0add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:15.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba31dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba2c151da0 0x7fba2c0c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:15.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba31dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c150260 con 0x7fba2c064db0 2023-08-31T18:49:15.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba31dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c14f650 con 0x7fba2c0c7f20 2023-08-31T18:49:15.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba31dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c14f930 con 0x7fba2c151da0 2023-08-31T18:49:15.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba2b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba2c064db0 0x7fba2c141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:15.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba2b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba2c064db0 0x7fba2c141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32870/0 (socket says 172.21.15.72:32870) 2023-08-31T18:49:15.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba2b7fe700 1 -- 172.21.15.72:0/90940292 learned_addr learned my addr 172.21.15.72:0/90940292 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:15.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba2bfff700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba2c151da0 0x7fba2c0c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:15.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba2affd700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba2c0c7f20 0x7fba2c0add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:15.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba2b7fe700 1 -- 172.21.15.72:0/90940292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba2c151da0 msgr2=0x7fba2c0c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:15.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba2b7fe700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba2c151da0 0x7fba2c0c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba2b7fe700 1 -- 172.21.15.72:0/90940292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba2c0c7f20 msgr2=0x7fba2c0add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:15.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba2b7fe700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba2c0c7f20 0x7fba2c0add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba2b7fe700 1 -- 172.21.15.72:0/90940292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c009370 con 0x7fba2c064db0 2023-08-31T18:49:15.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba2bfff700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba2c151da0 0x7fba2c0c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:15.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba2affd700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba2c0c7f20 0x7fba2c0add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:15.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.643+0000 7fba2b7fe700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba2c064db0 0x7fba2c141770 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fba2c0612c0 tx=0x7fba1c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:15.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.644+0000 7fba137fe700 1 -- 172.21.15.72:0/90940292 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c00b8d0 con 0x7fba2c064db0 2023-08-31T18:49:15.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.644+0000 7fba137fe700 1 -- 172.21.15.72:0/90940292 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1c00ba30 con 0x7fba2c064db0 2023-08-31T18:49:15.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.644+0000 7fba137fe700 1 -- 172.21.15.72:0/90940292 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c01b660 con 0x7fba2c064db0 2023-08-31T18:49:15.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.644+0000 7fba31dff700 1 -- 172.21.15.72:0/90940292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2c14fc10 con 0x7fba2c064db0 2023-08-31T18:49:15.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.644+0000 7fba31dff700 1 -- 172.21.15.72:0/90940292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2c141c60 con 0x7fba2c064db0 2023-08-31T18:49:15.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.645+0000 7fba31dff700 1 -- 172.21.15.72:0/90940292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2c06ac80 con 0x7fba2c064db0 2023-08-31T18:49:15.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.645+0000 7fba137fe700 1 -- 172.21.15.72:0/90940292 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7fba1c01ba50 con 0x7fba2c064db0 2023-08-31T18:49:15.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.646+0000 7fba137fe700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fba1805f010 0x7fba180614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:15.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.646+0000 7fba137fe700 1 -- 172.21.15.72:0/90940292 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fba1c07bb90 con 0x7fba2c064db0 2023-08-31T18:49:15.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.647+0000 7fba2affd700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fba1805f010 0x7fba180614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:15.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.647+0000 7fba2affd700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fba1805f010 0x7fba180614d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fba200011e0 tx=0x7fba20009040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:15.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.650+0000 7fba137fe700 1 -- 172.21.15.72:0/90940292 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fba2c06ac80 con 0x7fba2c064db0 2023-08-31T18:49:15.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.846+0000 7fba31dff700 1 -- 172.21.15.72:0/90940292 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fba2c1503a0 con 0x7fba1805f010 2023-08-31T18:49:15.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.850+0000 7fba137fe700 1 -- 172.21.15.72:0/90940292 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fba200013d0 con 0x7fba1805f010 2023-08-31T18:49:15.850 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path /snap_test_dir1/dir9 2023-08-31T18:49:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.852+0000 7fba31dff700 1 -- 172.21.15.72:0/90940292 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fba1805f010 msgr2=0x7fba180614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.852+0000 7fba31dff700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fba1805f010 0x7fba180614d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fba200011e0 tx=0x7fba20009040).stop 2023-08-31T18:49:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.852+0000 7fba31dff700 1 -- 172.21.15.72:0/90940292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba2c064db0 msgr2=0x7fba2c141770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.852+0000 7fba31dff700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba2c064db0 0x7fba2c141770 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fba2c0612c0 tx=0x7fba1c017000).stop 2023-08-31T18:49:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.852+0000 7fba31dff700 1 -- 172.21.15.72:0/90940292 shutdown_connections 2023-08-31T18:49:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.852+0000 7fba31dff700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fba2c151da0 0x7fba2c0c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.852+0000 7fba31dff700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba2c064db0 0x7fba2c141770 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.852+0000 7fba31dff700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fba1805f010 0x7fba180614d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.852+0000 7fba31dff700 1 --2- 172.21.15.72:0/90940292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fba2c0c7f20 0x7fba2c0add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.852+0000 7fba31dff700 1 -- 172.21.15.72:0/90940292 >> 172.21.15.72:0/90940292 conn(0x7fba2c0cb840 msgr2=0x7fba2c0ad1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.852+0000 7fba31dff700 1 -- 172.21.15.72:0/90940292 shutdown_connections 2023-08-31T18:49:15.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:15.852+0000 7fba31dff700 1 -- 172.21.15.72:0/90940292 wait complete. 2023-08-31T18:49:15.869 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-08-31T18:49:15.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-08-31T18:49:16.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.066+0000 7f69f53ff700 1 Processor -- start 2023-08-31T18:49:16.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.066+0000 7f69f53ff700 1 -- start start 2023-08-31T18:49:16.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69f53ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f69f0154120 0x7f69f00a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69f53ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f69f0154500 0x7f69f00646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69f53ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f0064b90 0x7f69f00c0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69f53ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f00aa620 con 0x7f69f0154500 2023-08-31T18:49:16.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69f53ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f0065020 con 0x7f69f0154120 2023-08-31T18:49:16.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69f53ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f00aa3a0 con 0x7f69f0064b90 2023-08-31T18:49:16.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69ee7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f69f0154500 0x7f69f00646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69ee7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f69f0154500 0x7f69f00646a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32872/0 (socket says 172.21.15.72:32872) 2023-08-31T18:49:16.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69ee7fc700 1 -- 172.21.15.72:0/2440627753 learned_addr learned my addr 172.21.15.72:0/2440627753 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:16.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69eeffd700 1 --2- 172.21.15.72:0/2440627753 >> v2:172.21.15.146:3300/0 conn(0x7f69f0154120 0x7f69f00a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69ef7fe700 1 --2- 172.21.15.72:0/2440627753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f0064b90 0x7f69f00c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69ee7fc700 1 -- 172.21.15.72:0/2440627753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f0064b90 msgr2=0x7f69f00c0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:16.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69ee7fc700 1 --2- 172.21.15.72:0/2440627753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f0064b90 0x7f69f00c0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69ee7fc700 1 -- 172.21.15.72:0/2440627753 >> v2:172.21.15.146:3300/0 conn(0x7f69f0154120 msgr2=0x7f69f00a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:16.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69ee7fc700 1 --2- 172.21.15.72:0/2440627753 >> v2:172.21.15.146:3300/0 conn(0x7f69f0154120 0x7f69f00a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69ee7fc700 1 -- 172.21.15.72:0/2440627753 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f00c5450 con 0x7f69f0154500 2023-08-31T18:49:16.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69eeffd700 1 --2- 172.21.15.72:0/2440627753 >> v2:172.21.15.146:3300/0 conn(0x7f69f0154120 0x7f69f00a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:16.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.068+0000 7f69ef7fe700 1 --2- 172.21.15.72:0/2440627753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f0064b90 0x7f69f00c0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:16.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.069+0000 7f69ee7fc700 1 --2- 172.21.15.72:0/2440627753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f0154500 0x7f69f00646a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f69f00643c0 tx=0x7f69e40090f0).ready entity=mon.0 client_cookie=e346bf58e6615458 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:16.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.069+0000 7f69edffb700 1 -- 172.21.15.72:0/2440627753 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e400b600 con 0x7f69f0154500 2023-08-31T18:49:16.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.069+0000 7f69edffb700 1 -- 172.21.15.72:0/2440627753 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e400b760 con 0x7f69f0154500 2023-08-31T18:49:16.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.069+0000 7f69edffb700 1 -- 172.21.15.72:0/2440627753 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e400bae0 con 0x7f69f0154500 2023-08-31T18:49:16.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.069+0000 7f69f53ff700 1 -- 172.21.15.72:0/2440627753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f0154500 msgr2=0x7f69f00646a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:16.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.069+0000 7f69f53ff700 1 --2- 172.21.15.72:0/2440627753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f0154500 0x7f69f00646a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f69f00643c0 tx=0x7f69e40090f0).stop 2023-08-31T18:49:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.069+0000 7f69f53ff700 1 -- 172.21.15.72:0/2440627753 shutdown_connections 2023-08-31T18:49:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.069+0000 7f69f53ff700 1 --2- 172.21.15.72:0/2440627753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f0064b90 0x7f69f00c0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.069+0000 7f69f53ff700 1 --2- 172.21.15.72:0/2440627753 >> v2:172.21.15.146:3300/0 conn(0x7f69f0154120 0x7f69f00a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.069+0000 7f69f53ff700 1 --2- 172.21.15.72:0/2440627753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f0154500 0x7f69f00646a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.069+0000 7f69f53ff700 1 -- 172.21.15.72:0/2440627753 >> 172.21.15.72:0/2440627753 conn(0x7f69f00cb7e0 msgr2=0x7f69f00c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:16.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.069+0000 7f69f53ff700 1 -- 172.21.15.72:0/2440627753 shutdown_connections 2023-08-31T18:49:16.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.070+0000 7f69f53ff700 1 -- 172.21.15.72:0/2440627753 wait complete. 2023-08-31T18:49:16.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.071+0000 7f69f53ff700 1 Processor -- start 2023-08-31T18:49:16.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.071+0000 7f69f53ff700 1 -- start start 2023-08-31T18:49:16.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.072+0000 7f69f53ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f0064b90 0x7f69f014ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.072+0000 7f69f53ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f0154120 0x7f69f00c0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.072+0000 7f69f53ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f0154500 0x7f69f00c0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.072+0000 7f69f53ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f00c0df0 con 0x7f69f0154500 2023-08-31T18:49:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.072+0000 7f69f53ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f0168920 con 0x7f69f0064b90 2023-08-31T18:49:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.072+0000 7f69f53ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f0168030 con 0x7f69f0154120 2023-08-31T18:49:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.072+0000 7f69ef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f0154500 0x7f69f00c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.072+0000 7f69ef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f0154500 0x7f69f00c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32882/0 (socket says 172.21.15.72:32882) 2023-08-31T18:49:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.072+0000 7f69ef7fe700 1 -- 172.21.15.72:0/2855348256 learned_addr learned my addr 172.21.15.72:0/2855348256 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.073+0000 7f69ee7fc700 1 --2- 172.21.15.72:0/2855348256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f0154120 0x7f69f00c0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.073+0000 7f69eeffd700 1 --2- 172.21.15.72:0/2855348256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f0064b90 0x7f69f014ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.073+0000 7f69ef7fe700 1 -- 172.21.15.72:0/2855348256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f0154120 msgr2=0x7f69f00c0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:16.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.073+0000 7f69ef7fe700 1 --2- 172.21.15.72:0/2855348256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f0154120 0x7f69f00c0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.073+0000 7f69ef7fe700 1 -- 172.21.15.72:0/2855348256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f0064b90 msgr2=0x7f69f014ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:16.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.073+0000 7f69ef7fe700 1 --2- 172.21.15.72:0/2855348256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f0064b90 0x7f69f014ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.073+0000 7f69ef7fe700 1 -- 172.21.15.72:0/2855348256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e4009370 con 0x7f69f0154500 2023-08-31T18:49:16.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.073+0000 7f69ef7fe700 1 --2- 172.21.15.72:0/2855348256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f0154500 0x7f69f00c0900 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f69e800a380 tx=0x7f69e8007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:16.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.073+0000 7f69d6ffd700 1 -- 172.21.15.72:0/2855348256 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e800ae10 con 0x7f69f0154500 2023-08-31T18:49:16.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.073+0000 7f69d6ffd700 1 -- 172.21.15.72:0/2855348256 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e800d650 con 0x7f69f0154500 2023-08-31T18:49:16.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.073+0000 7f69f53ff700 1 -- 172.21.15.72:0/2855348256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f0168db0 con 0x7f69f0154500 2023-08-31T18:49:16.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.073+0000 7f69d6ffd700 1 -- 172.21.15.72:0/2855348256 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e800d9d0 con 0x7f69f0154500 2023-08-31T18:49:16.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.073+0000 7f69f53ff700 1 -- 172.21.15.72:0/2855348256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f0168630 con 0x7f69f0154500 2023-08-31T18:49:16.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.074+0000 7f69f53ff700 1 -- 172.21.15.72:0/2855348256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f01577e0 con 0x7f69f0154500 2023-08-31T18:49:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.075+0000 7f69d6ffd700 1 -- 172.21.15.72:0/2855348256 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f69e8013070 con 0x7f69f0154500 2023-08-31T18:49:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.076+0000 7f69d6ffd700 1 --2- 172.21.15.72:0/2855348256 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f69dc05efe0 0x7f69dc0614a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.076+0000 7f69d6ffd700 1 -- 172.21.15.72:0/2855348256 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f69e807aa10 con 0x7f69f0154500 2023-08-31T18:49:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.076+0000 7f69eeffd700 1 --2- 172.21.15.72:0/2855348256 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f69dc05efe0 0x7f69dc0614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.077+0000 7f69eeffd700 1 --2- 172.21.15.72:0/2855348256 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f69dc05efe0 0x7f69dc0614a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f69e000aa70 tx=0x7f69e0008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:16.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.080+0000 7f69d6ffd700 1 -- 172.21.15.72:0/2855348256 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f69e804bad0 con 0x7f69f0154500 2023-08-31T18:49:16.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.276+0000 7f69f53ff700 1 -- 172.21.15.72:0/2855348256 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f69f006a7e0 con 0x7f69dc05efe0 2023-08-31T18:49:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.281+0000 7f69d6ffd700 1 -- 172.21.15.72:0/2855348256 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f69f006a7e0 con 0x7f69dc05efe0 2023-08-31T18:49:16.281 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-08-31T18:49:16.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.283+0000 7f69f53ff700 1 -- 172.21.15.72:0/2855348256 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f69dc05efe0 msgr2=0x7f69dc0614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:16.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.283+0000 7f69f53ff700 1 --2- 172.21.15.72:0/2855348256 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f69dc05efe0 0x7f69dc0614a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f69e000aa70 tx=0x7f69e0008040).stop 2023-08-31T18:49:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.283+0000 7f69f53ff700 1 -- 172.21.15.72:0/2855348256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f0154500 msgr2=0x7f69f00c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.283+0000 7f69f53ff700 1 --2- 172.21.15.72:0/2855348256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f0154500 0x7f69f00c0900 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f69e800a380 tx=0x7f69e8007900).stop 2023-08-31T18:49:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.283+0000 7f69f53ff700 1 -- 172.21.15.72:0/2855348256 shutdown_connections 2023-08-31T18:49:16.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.283+0000 7f69f53ff700 1 --2- 172.21.15.72:0/2855348256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69f0154500 0x7f69f00c0900 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.283+0000 7f69f53ff700 1 --2- 172.21.15.72:0/2855348256 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f69dc05efe0 0x7f69dc0614a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.283+0000 7f69f53ff700 1 --2- 172.21.15.72:0/2855348256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f0064b90 0x7f69f014ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.283+0000 7f69f53ff700 1 --2- 172.21.15.72:0/2855348256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69f0154120 0x7f69f00c0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.283+0000 7f69f53ff700 1 -- 172.21.15.72:0/2855348256 >> 172.21.15.72:0/2855348256 conn(0x7f69f00cb7e0 msgr2=0x7f69f00ca060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:16.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.283+0000 7f69f53ff700 1 -- 172.21.15.72:0/2855348256 shutdown_connections 2023-08-31T18:49:16.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.283+0000 7f69f53ff700 1 -- 172.21.15.72:0/2855348256 wait complete. 2023-08-31T18:49:16.300 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-08-31T18:49:16.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-08-31T18:49:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.495+0000 7f58391ff700 1 Processor -- start 2023-08-31T18:49:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.495+0000 7f58391ff700 1 -- start start 2023-08-31T18:49:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.496+0000 7f58391ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834154120 0x7f58340a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.496+0000 7f58391ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5834064db0 0x7f583415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.496+0000 7f58391ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58340aa620 con 0x7f5834154500 2023-08-31T18:49:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.496+0000 7f58391ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58340aa3a0 con 0x7f5834064db0 2023-08-31T18:49:16.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.496+0000 7f58391ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58340c5450 con 0x7f5834154120 2023-08-31T18:49:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.497+0000 7f5832d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834154120 0x7f58340a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.497+0000 7f583359e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5834064db0 0x7f583415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.497+0000 7f583359e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5834064db0 0x7f583415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:36562/0 (socket says 172.21.15.72:36562) 2023-08-31T18:49:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.497+0000 7f5832d9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834154120 0x7f58340a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:39700/0 (socket says 172.21.15.72:39700) 2023-08-31T18:49:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.497+0000 7f583359e700 1 -- 172.21.15.72:0/1012172612 learned_addr learned my addr 172.21.15.72:0/1012172612 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.497+0000 7f583259c700 1 --1- 172.21.15.72:0/1012172612 >> v1:172.21.15.146:6789/0 conn(0x7f5834154500 0x7f58340646a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:48124/0 (socket says 172.21.15.72:48124) 2023-08-31T18:49:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.497+0000 7f583359e700 1 -- 172.21.15.72:0/1012172612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834154120 msgr2=0x7f58340a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.497+0000 7f583359e700 1 --2- 172.21.15.72:0/1012172612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834154120 0x7f58340a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.497+0000 7f583359e700 1 -- 172.21.15.72:0/1012172612 >> v1:172.21.15.146:6789/0 conn(0x7f5834154500 legacy=0x7f58340646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.498+0000 7f583359e700 1 -- 172.21.15.72:0/1012172612 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58340c8050 con 0x7f5834064db0 2023-08-31T18:49:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.498+0000 7f5832d9d700 1 --2- 172.21.15.72:0/1012172612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834154120 0x7f58340a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T18:49:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.498+0000 7f5831d9b700 1 -- 172.21.15.72:0/1012172612 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092586819 0 0) 0x7f58340aa620 con 0x7f5834154500 2023-08-31T18:49:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.498+0000 7f583359e700 1 --2- 172.21.15.72:0/1012172612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834064db0 0x7f583415dec0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f582c009f20 tx=0x7f582c009840).ready entity=mon.1 client_cookie=f1357697952797d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:16.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.498+0000 7f5831d9b700 1 -- 172.21.15.72:0/1012172612 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c00e070 con 0x7f5834064db0 2023-08-31T18:49:16.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.498+0000 7f5831d9b700 1 -- 172.21.15.72:0/1012172612 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c00b9d0 con 0x7f5834064db0 2023-08-31T18:49:16.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.498+0000 7f5831d9b700 1 -- 172.21.15.72:0/1012172612 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c00bd50 con 0x7f5834064db0 2023-08-31T18:49:16.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.498+0000 7f58391ff700 1 -- 172.21.15.72:0/1012172612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834064db0 msgr2=0x7f583415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:16.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.498+0000 7f58391ff700 1 --2- 172.21.15.72:0/1012172612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834064db0 0x7f583415dec0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f582c009f20 tx=0x7f582c009840).stop 2023-08-31T18:49:16.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.499+0000 7f58391ff700 1 -- 172.21.15.72:0/1012172612 shutdown_connections 2023-08-31T18:49:16.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.499+0000 7f58391ff700 1 --2- 172.21.15.72:0/1012172612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834064db0 0x7f583415dec0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.499+0000 7f58391ff700 1 --2- 172.21.15.72:0/1012172612 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834154120 0x7f58340a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.499+0000 7f58391ff700 1 -- 172.21.15.72:0/1012172612 >> 172.21.15.72:0/1012172612 conn(0x7f58340cb7e0 msgr2=0x7f58340c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:16.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.499+0000 7f58391ff700 1 -- 172.21.15.72:0/1012172612 shutdown_connections 2023-08-31T18:49:16.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.499+0000 7f58391ff700 1 -- 172.21.15.72:0/1012172612 wait complete. 2023-08-31T18:49:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.500+0000 7f58391ff700 1 Processor -- start 2023-08-31T18:49:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.500+0000 7f58391ff700 1 -- start start 2023-08-31T18:49:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.501+0000 7f58391ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834064db0 0x7f58340ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.501+0000 7f58391ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5834154120 0x7f5834142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.501+0000 7f58391ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834154500 0x7f5834142950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.501+0000 7f58391ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5834142e40 con 0x7f5834154120 2023-08-31T18:49:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.501+0000 7f58391ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583414a6e0 con 0x7f5834154500 2023-08-31T18:49:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.501+0000 7f58391ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5834149b40 con 0x7f5834064db0 2023-08-31T18:49:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.502+0000 7f583259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5834154120 0x7f5834142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.502+0000 7f583259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5834154120 0x7f5834142460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32884/0 (socket says 172.21.15.72:32884) 2023-08-31T18:49:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.502+0000 7f583259c700 1 -- 172.21.15.72:0/158090075 learned_addr learned my addr 172.21.15.72:0/158090075 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.502+0000 7f5832d9d700 1 --2- 172.21.15.72:0/158090075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834064db0 0x7f58340ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.502+0000 7f583359e700 1 --2- 172.21.15.72:0/158090075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834154500 0x7f5834142950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.502+0000 7f583259c700 1 -- 172.21.15.72:0/158090075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834064db0 msgr2=0x7f58340ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.502+0000 7f583259c700 1 --2- 172.21.15.72:0/158090075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834064db0 0x7f58340ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.502+0000 7f583259c700 1 -- 172.21.15.72:0/158090075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834154500 msgr2=0x7f5834142950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.502+0000 7f583259c700 1 --2- 172.21.15.72:0/158090075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834154500 0x7f5834142950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.502+0000 7f583259c700 1 -- 172.21.15.72:0/158090075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58240092a0 con 0x7f5834154120 2023-08-31T18:49:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.502+0000 7f583259c700 1 --2- 172.21.15.72:0/158090075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5834154120 0x7f5834142460 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f582800c4f0 tx=0x7f5828007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.502+0000 7f581affd700 1 -- 172.21.15.72:0/158090075 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280070d0 con 0x7f5834154120 2023-08-31T18:49:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.503+0000 7f581affd700 1 -- 172.21.15.72:0/158090075 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5828007230 con 0x7f5834154120 2023-08-31T18:49:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.503+0000 7f58391ff700 1 -- 172.21.15.72:0/158090075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c009ae0 con 0x7f5834154120 2023-08-31T18:49:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.503+0000 7f581affd700 1 -- 172.21.15.72:0/158090075 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280056e0 con 0x7f5834154120 2023-08-31T18:49:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.503+0000 7f58391ff700 1 -- 172.21.15.72:0/158090075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583414a090 con 0x7f5834154120 2023-08-31T18:49:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.504+0000 7f58391ff700 1 -- 172.21.15.72:0/158090075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583406a7e0 con 0x7f5834154120 2023-08-31T18:49:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.505+0000 7f581affd700 1 -- 172.21.15.72:0/158090075 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f5828005a90 con 0x7f5834154120 2023-08-31T18:49:16.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.506+0000 7f581affd700 1 --2- 172.21.15.72:0/158090075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f582005f010 0x7f58200614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.506+0000 7f581affd700 1 -- 172.21.15.72:0/158090075 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f5828079800 con 0x7f5834154120 2023-08-31T18:49:16.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.506+0000 7f5832d9d700 1 --2- 172.21.15.72:0/158090075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f582005f010 0x7f58200614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.507+0000 7f5832d9d700 1 --2- 172.21.15.72:0/158090075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f582005f010 0x7f58200614d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5824009dc0 tx=0x7f5824009060).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:16.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.510+0000 7f581affd700 1 -- 172.21.15.72:0/158090075 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f582804a9c0 con 0x7f5834154120 2023-08-31T18:49:16.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.709+0000 7f58391ff700 1 -- 172.21.15.72:0/158090075 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f583406c6b0 con 0x7f582005f010 2023-08-31T18:49:16.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.713+0000 7f581affd700 1 -- 172.21.15.72:0/158090075 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f583406c6b0 con 0x7f582005f010 2023-08-31T18:49:16.713 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-08-31T18:49:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.715+0000 7f58391ff700 1 -- 172.21.15.72:0/158090075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f582005f010 msgr2=0x7f58200614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.715+0000 7f58391ff700 1 --2- 172.21.15.72:0/158090075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f582005f010 0x7f58200614d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f5824009dc0 tx=0x7f5824009060).stop 2023-08-31T18:49:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.715+0000 7f58391ff700 1 -- 172.21.15.72:0/158090075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5834154120 msgr2=0x7f5834142460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.715+0000 7f58391ff700 1 --2- 172.21.15.72:0/158090075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5834154120 0x7f5834142460 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f582800c4f0 tx=0x7f5828007da0).stop 2023-08-31T18:49:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.715+0000 7f58391ff700 1 -- 172.21.15.72:0/158090075 shutdown_connections 2023-08-31T18:49:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.715+0000 7f58391ff700 1 --2- 172.21.15.72:0/158090075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f582005f010 0x7f58200614d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.715+0000 7f58391ff700 1 --2- 172.21.15.72:0/158090075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5834154500 0x7f5834142950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.715+0000 7f58391ff700 1 --2- 172.21.15.72:0/158090075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834064db0 0x7f58340ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.715+0000 7f58391ff700 1 --2- 172.21.15.72:0/158090075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5834154120 0x7f5834142460 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.715+0000 7f58391ff700 1 -- 172.21.15.72:0/158090075 >> 172.21.15.72:0/158090075 conn(0x7f58340cb7e0 msgr2=0x7f58340c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:16.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.715+0000 7f58391ff700 1 -- 172.21.15.72:0/158090075 shutdown_connections 2023-08-31T18:49:16.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.716+0000 7f58391ff700 1 -- 172.21.15.72:0/158090075 wait complete. 2023-08-31T18:49:16.733 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-08-31T18:49:16.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-08-31T18:49:16.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.926+0000 7f28fb5ff700 1 Processor -- start 2023-08-31T18:49:16.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.926+0000 7f28fb5ff700 1 -- start start 2023-08-31T18:49:16.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.927+0000 7f28fb5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f28f4154120 0x7f28f40a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.927+0000 7f28fb5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f28f4064db0 0x7f28f415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.927+0000 7f28fb5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f40aa620 con 0x7f28f4154500 2023-08-31T18:49:16.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.927+0000 7f28fb5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f40aa3a0 con 0x7f28f4154120 2023-08-31T18:49:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.927+0000 7f28fb5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f40c5450 con 0x7f28f4064db0 2023-08-31T18:49:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.928+0000 7f28f939b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f28f4154120 0x7f28f40a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.928+0000 7f28f939b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f28f4154120 0x7f28f40a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32886/0 (socket says 172.21.15.72:32886) 2023-08-31T18:49:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.928+0000 7f28f939b700 1 -- 172.21.15.72:0/1701042166 learned_addr learned my addr 172.21.15.72:0/1701042166 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:16.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.928+0000 7f28f8b9a700 1 --1- 172.21.15.72:0/1701042166 >> v1:172.21.15.72:6789/0 conn(0x7f28f4154500 0x7f28f40646a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40130/0 (socket says 172.21.15.72:40130) 2023-08-31T18:49:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.928+0000 7f28f9b9c700 1 --2- 172.21.15.72:0/1701042166 >> v2:172.21.15.146:3300/0 conn(0x7f28f4064db0 0x7f28f415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.928+0000 7f28f939b700 1 -- 172.21.15.72:0/1701042166 >> v2:172.21.15.146:3300/0 conn(0x7f28f4064db0 msgr2=0x7f28f415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.928+0000 7f28f939b700 1 --2- 172.21.15.72:0/1701042166 >> v2:172.21.15.146:3300/0 conn(0x7f28f4064db0 0x7f28f415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.928+0000 7f28f939b700 1 -- 172.21.15.72:0/1701042166 >> v1:172.21.15.72:6789/0 conn(0x7f28f4154500 legacy=0x7f28f40646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:16.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.928+0000 7f28ebfff700 1 -- 172.21.15.72:0/1701042166 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690499349 0 0) 0x7f28f40aa620 con 0x7f28f4154500 2023-08-31T18:49:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.928+0000 7f28f939b700 1 -- 172.21.15.72:0/1701042166 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f40c8050 con 0x7f28f4154120 2023-08-31T18:49:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.928+0000 7f28f939b700 1 --2- 172.21.15.72:0/1701042166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f4154120 0x7f28f40a9eb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f28f40c6b70 tx=0x7f28f00090f0).ready entity=mon.0 client_cookie=e575a96f09ba8497 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.929+0000 7f28ebfff700 1 -- 172.21.15.72:0/1701042166 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000b600 con 0x7f28f4154120 2023-08-31T18:49:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.929+0000 7f28ebfff700 1 -- 172.21.15.72:0/1701042166 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f000b760 con 0x7f28f4154120 2023-08-31T18:49:16.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.929+0000 7f28ebfff700 1 -- 172.21.15.72:0/1701042166 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000bb00 con 0x7f28f4154120 2023-08-31T18:49:16.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.929+0000 7f28fb5ff700 1 -- 172.21.15.72:0/1701042166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f4154120 msgr2=0x7f28f40a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:16.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.929+0000 7f28fb5ff700 1 --2- 172.21.15.72:0/1701042166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f4154120 0x7f28f40a9eb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f28f40c6b70 tx=0x7f28f00090f0).stop 2023-08-31T18:49:16.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.929+0000 7f28fb5ff700 1 -- 172.21.15.72:0/1701042166 shutdown_connections 2023-08-31T18:49:16.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.929+0000 7f28fb5ff700 1 --2- 172.21.15.72:0/1701042166 >> v2:172.21.15.146:3300/0 conn(0x7f28f4064db0 0x7f28f415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.929+0000 7f28fb5ff700 1 --2- 172.21.15.72:0/1701042166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f4154120 0x7f28f40a9eb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.929+0000 7f28fb5ff700 1 -- 172.21.15.72:0/1701042166 >> 172.21.15.72:0/1701042166 conn(0x7f28f40cb7e0 msgr2=0x7f28f40c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:16.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.929+0000 7f28fb5ff700 1 -- 172.21.15.72:0/1701042166 shutdown_connections 2023-08-31T18:49:16.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.929+0000 7f28fb5ff700 1 -- 172.21.15.72:0/1701042166 wait complete. 2023-08-31T18:49:16.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.931+0000 7f28fb5ff700 1 Processor -- start 2023-08-31T18:49:16.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.931+0000 7f28fb5ff700 1 -- start start 2023-08-31T18:49:16.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.932+0000 7f28fb5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28f4064db0 0x7f28f4141700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.932+0000 7f28fb5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28f4154120 0x7f28f40c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.932+0000 7f28fb5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f4154500 0x7f28f40af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.932+0000 7f28fb5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40c3450 con 0x7f28f4154500 2023-08-31T18:49:16.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.932+0000 7f28fb5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40c2840 con 0x7f28f4154120 2023-08-31T18:49:16.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.932+0000 7f28fb5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40c2b20 con 0x7f28f4064db0 2023-08-31T18:49:16.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.932+0000 7f28f9b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f4154500 0x7f28f40af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.932+0000 7f28f9b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f4154500 0x7f28f40af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32890/0 (socket says 172.21.15.72:32890) 2023-08-31T18:49:16.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.932+0000 7f28f9b9c700 1 -- 172.21.15.72:0/1376432283 learned_addr learned my addr 172.21.15.72:0/1376432283 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:16.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.932+0000 7f28f939b700 1 --2- 172.21.15.72:0/1376432283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28f4064db0 0x7f28f4141700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.932+0000 7f28f8b9a700 1 --2- 172.21.15.72:0/1376432283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28f4154120 0x7f28f40c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.932+0000 7f28f9b9c700 1 -- 172.21.15.72:0/1376432283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28f4064db0 msgr2=0x7f28f4141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:16.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.932+0000 7f28f9b9c700 1 --2- 172.21.15.72:0/1376432283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28f4064db0 0x7f28f4141700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.932+0000 7f28f9b9c700 1 -- 172.21.15.72:0/1376432283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28f4154120 msgr2=0x7f28f40c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:16.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.933+0000 7f28f9b9c700 1 --2- 172.21.15.72:0/1376432283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28f4154120 0x7f28f40c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:16.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.933+0000 7f28f9b9c700 1 -- 172.21.15.72:0/1376432283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f0009370 con 0x7f28f4154500 2023-08-31T18:49:16.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.933+0000 7f28f939b700 1 --2- 172.21.15.72:0/1376432283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28f4064db0 0x7f28f4141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:16.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.933+0000 7f28f9b9c700 1 --2- 172.21.15.72:0/1376432283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f4154500 0x7f28f40af890 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f28ec009fa0 tx=0x7f28ec009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:16.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.933+0000 7f28e97fa700 1 -- 172.21.15.72:0/1376432283 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec00ed20 con 0x7f28f4154500 2023-08-31T18:49:16.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.933+0000 7f28e97fa700 1 -- 172.21.15.72:0/1376432283 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec00ee80 con 0x7f28f4154500 2023-08-31T18:49:16.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.933+0000 7f28e97fa700 1 -- 172.21.15.72:0/1376432283 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec014610 con 0x7f28f4154500 2023-08-31T18:49:16.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.933+0000 7f28fb5ff700 1 -- 172.21.15.72:0/1376432283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f40c2e00 con 0x7f28f4154500 2023-08-31T18:49:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.933+0000 7f28fb5ff700 1 -- 172.21.15.72:0/1376432283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f4151070 con 0x7f28f4154500 2023-08-31T18:49:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.934+0000 7f28fb5ff700 1 -- 172.21.15.72:0/1376432283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f40c37e0 con 0x7f28f4154500 2023-08-31T18:49:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.935+0000 7f28e97fa700 1 -- 172.21.15.72:0/1376432283 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f28ec01d3b0 con 0x7f28f4154500 2023-08-31T18:49:16.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.936+0000 7f28e97fa700 1 --2- 172.21.15.72:0/1376432283 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f28d805efe0 0x7f28d80614a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:16.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.936+0000 7f28e97fa700 1 -- 172.21.15.72:0/1376432283 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f28ec07a7b0 con 0x7f28f4154500 2023-08-31T18:49:16.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.936+0000 7f28f939b700 1 --2- 172.21.15.72:0/1376432283 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f28d805efe0 0x7f28d80614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:16.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.936+0000 7f28f939b700 1 --2- 172.21.15.72:0/1376432283 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f28d805efe0 0x7f28d80614a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f28f0009fd0 tx=0x7f28f0017000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:16.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:16.940+0000 7f28e97fa700 1 -- 172.21.15.72:0/1376432283 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f28f40c37e0 con 0x7f28f4154500 2023-08-31T18:49:17.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.134+0000 7f28fb5ff700 1 -- 172.21.15.72:0/1376432283 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f28f40c37e0 con 0x7f28d805efe0 2023-08-31T18:49:17.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.138+0000 7f28e97fa700 1 -- 172.21.15.72:0/1376432283 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f28f40c37e0 con 0x7f28d805efe0 2023-08-31T18:49:17.138 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-08-31T18:49:17.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.140+0000 7f28fb5ff700 1 -- 172.21.15.72:0/1376432283 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f28d805efe0 msgr2=0x7f28d80614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:17.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.140+0000 7f28fb5ff700 1 --2- 172.21.15.72:0/1376432283 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f28d805efe0 0x7f28d80614a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f28f0009fd0 tx=0x7f28f0017000).stop 2023-08-31T18:49:17.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.140+0000 7f28fb5ff700 1 -- 172.21.15.72:0/1376432283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f4154500 msgr2=0x7f28f40af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:17.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.140+0000 7f28fb5ff700 1 --2- 172.21.15.72:0/1376432283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f4154500 0x7f28f40af890 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f28ec009fa0 tx=0x7f28ec009900).stop 2023-08-31T18:49:17.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.140+0000 7f28fb5ff700 1 -- 172.21.15.72:0/1376432283 shutdown_connections 2023-08-31T18:49:17.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.140+0000 7f28fb5ff700 1 --2- 172.21.15.72:0/1376432283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28f4154500 0x7f28f40af890 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.140+0000 7f28fb5ff700 1 --2- 172.21.15.72:0/1376432283 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28f4064db0 0x7f28f4141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.140+0000 7f28fb5ff700 1 --2- 172.21.15.72:0/1376432283 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f28d805efe0 0x7f28d80614a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.140+0000 7f28fb5ff700 1 --2- 172.21.15.72:0/1376432283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28f4154120 0x7f28f40c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.140+0000 7f28fb5ff700 1 -- 172.21.15.72:0/1376432283 >> 172.21.15.72:0/1376432283 conn(0x7f28f40cb7e0 msgr2=0x7f28f40ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:17.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.140+0000 7f28fb5ff700 1 -- 172.21.15.72:0/1376432283 shutdown_connections 2023-08-31T18:49:17.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.140+0000 7f28fb5ff700 1 -- 172.21.15.72:0/1376432283 wait complete. 2023-08-31T18:49:17.158 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-08-31T18:49:17.158 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-08-31T18:49:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.352+0000 7fc00d3ff700 1 Processor -- start 2023-08-31T18:49:17.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.352+0000 7fc00d3ff700 1 -- start start 2023-08-31T18:49:17.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.353+0000 7fc00d3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc0080c4bb0 0x7fc0080653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:17.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.353+0000 7fc00d3ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc00813d960 0x7fc0080c5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:17.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.353+0000 7fc00d3ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0080c5cf0 con 0x7fc0080c5880 2023-08-31T18:49:17.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.353+0000 7fc00d3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0080c4f90 con 0x7fc0080c4bb0 2023-08-31T18:49:17.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.353+0000 7fc00d3ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0080c6020 con 0x7fc00813d960 2023-08-31T18:49:17.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.353+0000 7fc006ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc0080c4bb0 0x7fc0080653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:17.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.354+0000 7fc006ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc0080c4bb0 0x7fc0080653d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32906/0 (socket says 172.21.15.72:32906) 2023-08-31T18:49:17.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.354+0000 7fc006ffd700 1 -- 172.21.15.72:0/1104368589 learned_addr learned my addr 172.21.15.72:0/1104368589 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:17.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.354+0000 7fc0067fc700 1 --2- 172.21.15.72:0/1104368589 >> v2:172.21.15.146:3300/0 conn(0x7fc00813d960 0x7fc0080c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:17.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.354+0000 7fc006ffd700 1 -- 172.21.15.72:0/1104368589 >> v2:172.21.15.146:3300/0 conn(0x7fc00813d960 msgr2=0x7fc0080c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:17.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.354+0000 7fc006ffd700 1 --2- 172.21.15.72:0/1104368589 >> v2:172.21.15.146:3300/0 conn(0x7fc00813d960 0x7fc0080c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.354+0000 7fc006ffd700 1 -- 172.21.15.72:0/1104368589 >> v1:172.21.15.146:6789/0 conn(0x7fc0080c5880 legacy=0x7fc0081546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:17.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.354+0000 7fc006ffd700 1 -- 172.21.15.72:0/1104368589 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0081587f0 con 0x7fc0080c4bb0 2023-08-31T18:49:17.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.354+0000 7fc006ffd700 1 --2- 172.21.15.72:0/1104368589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0080c4bb0 0x7fc0080653d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fc008069410 tx=0x7fbff80090f0).ready entity=mon.0 client_cookie=8bbb2f012d2d3fc server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:17.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.354+0000 7fc005ffb700 1 -- 172.21.15.72:0/1104368589 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff800b600 con 0x7fc0080c4bb0 2023-08-31T18:49:17.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.354+0000 7fc005ffb700 1 -- 172.21.15.72:0/1104368589 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff800b760 con 0x7fc0080c4bb0 2023-08-31T18:49:17.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.354+0000 7fc005ffb700 1 -- 172.21.15.72:0/1104368589 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff800bae0 con 0x7fc0080c4bb0 2023-08-31T18:49:17.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.355+0000 7fc00d3ff700 1 -- 172.21.15.72:0/1104368589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0080c4bb0 msgr2=0x7fc0080653d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:17.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.355+0000 7fc00d3ff700 1 --2- 172.21.15.72:0/1104368589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0080c4bb0 0x7fc0080653d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fc008069410 tx=0x7fbff80090f0).stop 2023-08-31T18:49:17.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.355+0000 7fc00d3ff700 1 -- 172.21.15.72:0/1104368589 shutdown_connections 2023-08-31T18:49:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.355+0000 7fc00d3ff700 1 --2- 172.21.15.72:0/1104368589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0080c4bb0 0x7fc0080653d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.355+0000 7fc00d3ff700 1 --2- 172.21.15.72:0/1104368589 >> v2:172.21.15.146:3300/0 conn(0x7fc00813d960 0x7fc0080c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.355+0000 7fc00d3ff700 1 -- 172.21.15.72:0/1104368589 >> 172.21.15.72:0/1104368589 conn(0x7fc008066350 msgr2=0x7fc008066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.355+0000 7fc00d3ff700 1 -- 172.21.15.72:0/1104368589 shutdown_connections 2023-08-31T18:49:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.355+0000 7fc00d3ff700 1 -- 172.21.15.72:0/1104368589 wait complete. 2023-08-31T18:49:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.356+0000 7fc00d3ff700 1 Processor -- start 2023-08-31T18:49:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.357+0000 7fc00d3ff700 1 -- start start 2023-08-31T18:49:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc00d3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0080c4bb0 0x7fc0081397d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc00d3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0080c5880 0x7fc00813ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc00d3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc00813d960 0x7fc0080c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc00d3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080ad020 con 0x7fc00813d960 2023-08-31T18:49:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc00d3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080c0880 con 0x7fc0080c5880 2023-08-31T18:49:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc00d3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080c0b60 con 0x7fc0080c4bb0 2023-08-31T18:49:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc0077fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc00813d960 0x7fc0080c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc0077fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc00813d960 0x7fc0080c00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32908/0 (socket says 172.21.15.72:32908) 2023-08-31T18:49:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc0077fe700 1 -- 172.21.15.72:0/3726727273 learned_addr learned my addr 172.21.15.72:0/3726727273 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc006ffd700 1 --2- 172.21.15.72:0/3726727273 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0080c4bb0 0x7fc0081397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc0067fc700 1 --2- 172.21.15.72:0/3726727273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0080c5880 0x7fc00813ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:17.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc0077fe700 1 -- 172.21.15.72:0/3726727273 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0080c4bb0 msgr2=0x7fc0081397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:17.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc0077fe700 1 --2- 172.21.15.72:0/3726727273 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0080c4bb0 0x7fc0081397d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc0077fe700 1 -- 172.21.15.72:0/3726727273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0080c5880 msgr2=0x7fc00813ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:17.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc0077fe700 1 --2- 172.21.15.72:0/3726727273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0080c5880 0x7fc00813ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc0077fe700 1 -- 172.21.15.72:0/3726727273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff8009370 con 0x7fc00813d960 2023-08-31T18:49:17.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc006ffd700 1 --2- 172.21.15.72:0/3726727273 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0080c4bb0 0x7fc0081397d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:49:17.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.358+0000 7fc0077fe700 1 --2- 172.21.15.72:0/3726727273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc00813d960 0x7fc0080c00a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fc00000c7c0 tx=0x7fc000001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:17.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.359+0000 7fbfeeffd700 1 -- 172.21.15.72:0/3726727273 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000010510 con 0x7fc00813d960 2023-08-31T18:49:17.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.359+0000 7fbfeeffd700 1 -- 172.21.15.72:0/3726727273 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc000010670 con 0x7fc00813d960 2023-08-31T18:49:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.359+0000 7fbfeeffd700 1 -- 172.21.15.72:0/3726727273 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0000109f0 con 0x7fc00813d960 2023-08-31T18:49:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.359+0000 7fc00d3ff700 1 -- 172.21.15.72:0/3726727273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0080c0e40 con 0x7fc00813d960 2023-08-31T18:49:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.359+0000 7fc00d3ff700 1 -- 172.21.15.72:0/3726727273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0080acbb0 con 0x7fc00813d960 2023-08-31T18:49:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.360+0000 7fc00d3ff700 1 -- 172.21.15.72:0/3726727273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0080ad1d0 con 0x7fc00813d960 2023-08-31T18:49:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.361+0000 7fbfeeffd700 1 -- 172.21.15.72:0/3726727273 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7fc00001b400 con 0x7fc00813d960 2023-08-31T18:49:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.362+0000 7fbfeeffd700 1 --2- 172.21.15.72:0/3726727273 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbff405f010 0x7fbff40614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.362+0000 7fbfeeffd700 1 -- 172.21.15.72:0/3726727273 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fc000079f10 con 0x7fc00813d960 2023-08-31T18:49:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.362+0000 7fc006ffd700 1 --2- 172.21.15.72:0/3726727273 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbff405f010 0x7fbff40614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.362+0000 7fc006ffd700 1 --2- 172.21.15.72:0/3726727273 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbff405f010 0x7fbff40614d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbff8009130 tx=0x7fbff8017000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.366+0000 7fbfeeffd700 1 -- 172.21.15.72:0/3726727273 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc00004b070 con 0x7fc00813d960 2023-08-31T18:49:17.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.561+0000 7fc00d3ff700 1 -- 172.21.15.72:0/3726727273 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0080ace90 con 0x7fbff405f010 2023-08-31T18:49:17.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.565+0000 7fbfeeffd700 1 -- 172.21.15.72:0/3726727273 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fc0080ace90 con 0x7fbff405f010 2023-08-31T18:49:17.566 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-08-31T18:49:17.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.567+0000 7fc00d3ff700 1 -- 172.21.15.72:0/3726727273 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbff405f010 msgr2=0x7fbff40614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:17.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.567+0000 7fc00d3ff700 1 --2- 172.21.15.72:0/3726727273 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbff405f010 0x7fbff40614d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fbff8009130 tx=0x7fbff8017000).stop 2023-08-31T18:49:17.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.567+0000 7fc00d3ff700 1 -- 172.21.15.72:0/3726727273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc00813d960 msgr2=0x7fc0080c00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:17.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.567+0000 7fc00d3ff700 1 --2- 172.21.15.72:0/3726727273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc00813d960 0x7fc0080c00a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fc00000c7c0 tx=0x7fc000001510).stop 2023-08-31T18:49:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.567+0000 7fc00d3ff700 1 -- 172.21.15.72:0/3726727273 shutdown_connections 2023-08-31T18:49:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.567+0000 7fc00d3ff700 1 --2- 172.21.15.72:0/3726727273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc00813d960 0x7fc0080c00a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.567+0000 7fc00d3ff700 1 --2- 172.21.15.72:0/3726727273 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc0080c4bb0 0x7fc0081397d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.567+0000 7fc00d3ff700 1 --2- 172.21.15.72:0/3726727273 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbff405f010 0x7fbff40614d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.567+0000 7fc00d3ff700 1 --2- 172.21.15.72:0/3726727273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0080c5880 0x7fc00813ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.567+0000 7fc00d3ff700 1 -- 172.21.15.72:0/3726727273 >> 172.21.15.72:0/3726727273 conn(0x7fc008066350 msgr2=0x7fc0080c83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:17.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.567+0000 7fc00d3ff700 1 -- 172.21.15.72:0/3726727273 shutdown_connections 2023-08-31T18:49:17.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.568+0000 7fc00d3ff700 1 -- 172.21.15.72:0/3726727273 wait complete. 2023-08-31T18:49:17.585 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-08-31T18:49:17.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-08-31T18:49:17.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.779+0000 7f2d939ff700 1 Processor -- start 2023-08-31T18:49:17.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.779+0000 7f2d939ff700 1 -- start start 2023-08-31T18:49:17.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.780+0000 7f2d939ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8c154120 0x7f2d8c0a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:17.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.780+0000 7f2d939ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2d8c154500 0x7f2d8c0646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:17.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.780+0000 7f2d939ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2d8c064b90 0x7f2d8c0c0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:17.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.780+0000 7f2d939ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8c0aa620 con 0x7f2d8c064b90 2023-08-31T18:49:17.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.780+0000 7f2d939ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8c065020 con 0x7f2d8c154500 2023-08-31T18:49:17.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.780+0000 7f2d939ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c0aa3a0 con 0x7f2d8c154120 2023-08-31T18:49:17.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.780+0000 7f2d91f9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2d8c064b90 0x7f2d8c0c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:17.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.780+0000 7f2d91f9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2d8c064b90 0x7f2d8c0c0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32920/0 (socket says 172.21.15.72:32920) 2023-08-31T18:49:17.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.780+0000 7f2d91f9c700 1 -- 172.21.15.72:0/2961388256 learned_addr learned my addr 172.21.15.72:0/2961388256 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:17.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.780+0000 7f2d90f9a700 1 --2- 172.21.15.72:0/2961388256 >> v2:172.21.15.146:3300/0 conn(0x7f2d8c154500 0x7f2d8c0646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:17.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.781+0000 7f2d9179b700 1 --2- 172.21.15.72:0/2961388256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8c154120 0x7f2d8c0a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:17.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.781+0000 7f2d91f9c700 1 -- 172.21.15.72:0/2961388256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8c154120 msgr2=0x7f2d8c0a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:17.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.781+0000 7f2d91f9c700 1 --2- 172.21.15.72:0/2961388256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8c154120 0x7f2d8c0a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.781+0000 7f2d91f9c700 1 -- 172.21.15.72:0/2961388256 >> v2:172.21.15.146:3300/0 conn(0x7f2d8c154500 msgr2=0x7f2d8c0646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:17.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.781+0000 7f2d91f9c700 1 --2- 172.21.15.72:0/2961388256 >> v2:172.21.15.146:3300/0 conn(0x7f2d8c154500 0x7f2d8c0646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.781+0000 7f2d91f9c700 1 -- 172.21.15.72:0/2961388256 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c0c5450 con 0x7f2d8c064b90 2023-08-31T18:49:17.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.781+0000 7f2d9179b700 1 --2- 172.21.15.72:0/2961388256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8c154120 0x7f2d8c0a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T18:49:17.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.781+0000 7f2d91f9c700 1 --2- 172.21.15.72:0/2961388256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d8c064b90 0x7f2d8c0c0290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f2d8c0612c0 tx=0x7f2d84009840).ready entity=mon.0 client_cookie=54f68c7e392ab5d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:17.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.781+0000 7f2d83fff700 1 -- 172.21.15.72:0/2961388256 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400e070 con 0x7f2d8c064b90 2023-08-31T18:49:17.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.781+0000 7f2d83fff700 1 -- 172.21.15.72:0/2961388256 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8400ba20 con 0x7f2d8c064b90 2023-08-31T18:49:17.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.781+0000 7f2d83fff700 1 -- 172.21.15.72:0/2961388256 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400bda0 con 0x7f2d8c064b90 2023-08-31T18:49:17.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.782+0000 7f2d939ff700 1 -- 172.21.15.72:0/2961388256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d8c064b90 msgr2=0x7f2d8c0c0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:17.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.782+0000 7f2d939ff700 1 --2- 172.21.15.72:0/2961388256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d8c064b90 0x7f2d8c0c0290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f2d8c0612c0 tx=0x7f2d84009840).stop 2023-08-31T18:49:17.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.782+0000 7f2d939ff700 1 -- 172.21.15.72:0/2961388256 shutdown_connections 2023-08-31T18:49:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.782+0000 7f2d939ff700 1 --2- 172.21.15.72:0/2961388256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d8c064b90 0x7f2d8c0c0290 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.782+0000 7f2d939ff700 1 --2- 172.21.15.72:0/2961388256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8c154120 0x7f2d8c0a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.782+0000 7f2d939ff700 1 --2- 172.21.15.72:0/2961388256 >> v2:172.21.15.146:3300/0 conn(0x7f2d8c154500 0x7f2d8c0646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.782+0000 7f2d939ff700 1 -- 172.21.15.72:0/2961388256 >> 172.21.15.72:0/2961388256 conn(0x7f2d8c0cb7e0 msgr2=0x7f2d8c0c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.782+0000 7f2d939ff700 1 -- 172.21.15.72:0/2961388256 shutdown_connections 2023-08-31T18:49:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.782+0000 7f2d939ff700 1 -- 172.21.15.72:0/2961388256 wait complete. 2023-08-31T18:49:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.783+0000 7f2d939ff700 1 Processor -- start 2023-08-31T18:49:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.784+0000 7f2d939ff700 1 -- start start 2023-08-31T18:49:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.784+0000 7f2d939ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8c064b90 0x7f2d8c164c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:17.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d939ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d8c154120 0x7f2d8c150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d939ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d8c154500 0x7f2d8c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d939ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c165230 con 0x7f2d8c154120 2023-08-31T18:49:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d939ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c14a1e0 con 0x7f2d8c154500 2023-08-31T18:49:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d939ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c14b120 con 0x7f2d8c064b90 2023-08-31T18:49:17.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d90f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d8c154120 0x7f2d8c150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:17.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d90f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d8c154120 0x7f2d8c150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32924/0 (socket says 172.21.15.72:32924) 2023-08-31T18:49:17.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d90f9a700 1 -- 172.21.15.72:0/1591270428 learned_addr learned my addr 172.21.15.72:0/1591270428 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:17.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d9179b700 1 --2- 172.21.15.72:0/1591270428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8c064b90 0x7f2d8c164c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:17.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d91f9c700 1 --2- 172.21.15.72:0/1591270428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d8c154500 0x7f2d8c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:17.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d90f9a700 1 -- 172.21.15.72:0/1591270428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8c064b90 msgr2=0x7f2d8c164c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d90f9a700 1 --2- 172.21.15.72:0/1591270428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8c064b90 0x7f2d8c164c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d90f9a700 1 -- 172.21.15.72:0/1591270428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d8c154500 msgr2=0x7f2d8c1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d90f9a700 1 --2- 172.21.15.72:0/1591270428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d8c154500 0x7f2d8c1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d90f9a700 1 -- 172.21.15.72:0/1591270428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d84009ae0 con 0x7f2d8c154120 2023-08-31T18:49:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.785+0000 7f2d90f9a700 1 --2- 172.21.15.72:0/1591270428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d8c154120 0x7f2d8c150030 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f2d7c00e8d0 tx=0x7f2d7c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.786+0000 7f2d817fa700 1 -- 172.21.15.72:0/1591270428 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c00c640 con 0x7f2d8c154120 2023-08-31T18:49:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.786+0000 7f2d817fa700 1 -- 172.21.15.72:0/1591270428 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c00c7a0 con 0x7f2d8c154120 2023-08-31T18:49:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.786+0000 7f2d939ff700 1 -- 172.21.15.72:0/1591270428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8c14b400 con 0x7f2d8c154120 2023-08-31T18:49:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.786+0000 7f2d817fa700 1 -- 172.21.15.72:0/1591270428 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c00cb20 con 0x7f2d8c154120 2023-08-31T18:49:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.786+0000 7f2d939ff700 1 -- 172.21.15.72:0/1591270428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8c14d030 con 0x7f2d8c154120 2023-08-31T18:49:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.787+0000 7f2d939ff700 1 -- 172.21.15.72:0/1591270428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8c083d50 con 0x7f2d8c154120 2023-08-31T18:49:17.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.787+0000 7f2d817fa700 1 -- 172.21.15.72:0/1591270428 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f2d7c01b400 con 0x7f2d8c154120 2023-08-31T18:49:17.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.788+0000 7f2d817fa700 1 --2- 172.21.15.72:0/1591270428 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2d7005f010 0x7f2d700614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:17.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.788+0000 7f2d817fa700 1 -- 172.21.15.72:0/1591270428 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f2d7c07a640 con 0x7f2d8c154120 2023-08-31T18:49:17.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.789+0000 7f2d9179b700 1 --2- 172.21.15.72:0/1591270428 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2d7005f010 0x7f2d700614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:17.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.789+0000 7f2d9179b700 1 --2- 172.21.15.72:0/1591270428 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2d7005f010 0x7f2d700614d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2d88006fd0 tx=0x7f2d88008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:17.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.792+0000 7f2d817fa700 1 -- 172.21.15.72:0/1591270428 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2d7c04b750 con 0x7f2d8c154120 2023-08-31T18:49:17.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.987+0000 7f2d939ff700 1 -- 172.21.15.72:0/1591270428 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d8c06a7e0 con 0x7f2d7005f010 2023-08-31T18:49:17.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.992+0000 7f2d817fa700 1 -- 172.21.15.72:0/1591270428 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f2d8c06a7e0 con 0x7f2d7005f010 2023-08-31T18:49:17.992 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-08-31T18:49:17.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.994+0000 7f2d939ff700 1 -- 172.21.15.72:0/1591270428 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2d7005f010 msgr2=0x7f2d700614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.994+0000 7f2d939ff700 1 --2- 172.21.15.72:0/1591270428 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2d7005f010 0x7f2d700614d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2d88006fd0 tx=0x7f2d88008040).stop 2023-08-31T18:49:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.994+0000 7f2d939ff700 1 -- 172.21.15.72:0/1591270428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d8c154120 msgr2=0x7f2d8c150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.994+0000 7f2d939ff700 1 --2- 172.21.15.72:0/1591270428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d8c154120 0x7f2d8c150030 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f2d7c00e8d0 tx=0x7f2d7c009060).stop 2023-08-31T18:49:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.994+0000 7f2d939ff700 1 -- 172.21.15.72:0/1591270428 shutdown_connections 2023-08-31T18:49:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.994+0000 7f2d939ff700 1 --2- 172.21.15.72:0/1591270428 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2d7005f010 0x7f2d700614d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.994+0000 7f2d939ff700 1 --2- 172.21.15.72:0/1591270428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d8c154500 0x7f2d8c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.994+0000 7f2d939ff700 1 --2- 172.21.15.72:0/1591270428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2d8c064b90 0x7f2d8c164c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.994+0000 7f2d939ff700 1 --2- 172.21.15.72:0/1591270428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d8c154120 0x7f2d8c150030 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.994+0000 7f2d939ff700 1 -- 172.21.15.72:0/1591270428 >> 172.21.15.72:0/1591270428 conn(0x7f2d8c0cb7e0 msgr2=0x7f2d8c14d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.994+0000 7f2d939ff700 1 -- 172.21.15.72:0/1591270428 shutdown_connections 2023-08-31T18:49:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:17.994+0000 7f2d939ff700 1 -- 172.21.15.72:0/1591270428 wait complete. 2023-08-31T18:49:18.011 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-08-31T18:49:18.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-08-31T18:49:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.205+0000 7f1ebcbff700 1 Processor -- start 2023-08-31T18:49:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.205+0000 7f1ebcbff700 1 -- start start 2023-08-31T18:49:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.206+0000 7f1ebcbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1eb8154120 0x7f1eb80a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.207+0000 7f1ebcbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb80aa620 con 0x7f1eb8064db0 2023-08-31T18:49:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.207+0000 7f1ebcbff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb80aa3a0 con 0x7f1eb8154500 2023-08-31T18:49:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.207+0000 7f1ebcbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb80c5450 con 0x7f1eb8154120 2023-08-31T18:49:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.207+0000 7f1eb659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1eb8154120 0x7f1eb80a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.207+0000 7f1eb6d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1eb8064db0 0x7f1eb815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40140/0 (socket says 172.21.15.72:40140) 2023-08-31T18:49:18.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.207+0000 7f1eb6d9d700 1 -- 172.21.15.72:0/716221831 learned_addr learned my addr 172.21.15.72:0/716221831 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:49:18.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.207+0000 7f1eb659c700 1 -- 172.21.15.72:0/716221831 >> v1:172.21.15.146:6789/0 conn(0x7f1eb8154500 legacy=0x7f1eb80646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:18.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.207+0000 7f1eb659c700 1 -- 172.21.15.72:0/716221831 >> v1:172.21.15.72:6789/0 conn(0x7f1eb8064db0 legacy=0x7f1eb815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:18.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.207+0000 7f1eb659c700 1 -- 172.21.15.72:0/716221831 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb80c8050 con 0x7f1eb8154120 2023-08-31T18:49:18.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.207+0000 7f1eb559a700 1 -- 172.21.15.72:0/716221831 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411033687 0 0) 0x7f1eb80aa620 con 0x7f1eb8064db0 2023-08-31T18:49:18.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.207+0000 7f1eb659c700 1 --2- 172.21.15.72:0/716221831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb8154120 0x7f1eb80a9eb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f1ea8009760 tx=0x7f1ea8009060).ready entity=mon.0 client_cookie=775807720b433f9d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:18.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.208+0000 7f1eb559a700 1 -- 172.21.15.72:0/716221831 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea80090d0 con 0x7f1eb8154120 2023-08-31T18:49:18.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.208+0000 7f1eb559a700 1 -- 172.21.15.72:0/716221831 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea800b520 con 0x7f1eb8154120 2023-08-31T18:49:18.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.208+0000 7f1eb559a700 1 -- 172.21.15.72:0/716221831 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea800b8a0 con 0x7f1eb8154120 2023-08-31T18:49:18.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.208+0000 7f1ebcbff700 1 -- 172.21.15.72:0/716221831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb8154120 msgr2=0x7f1eb80a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:18.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.208+0000 7f1ebcbff700 1 --2- 172.21.15.72:0/716221831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb8154120 0x7f1eb80a9eb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f1ea8009760 tx=0x7f1ea8009060).stop 2023-08-31T18:49:18.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.208+0000 7f1ebcbff700 1 -- 172.21.15.72:0/716221831 shutdown_connections 2023-08-31T18:49:18.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.208+0000 7f1ebcbff700 1 --2- 172.21.15.72:0/716221831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb8154120 0x7f1eb80a9eb0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.208+0000 7f1ebcbff700 1 -- 172.21.15.72:0/716221831 >> 172.21.15.72:0/716221831 conn(0x7f1eb80cb7e0 msgr2=0x7f1eb80c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.208+0000 7f1ebcbff700 1 -- 172.21.15.72:0/716221831 shutdown_connections 2023-08-31T18:49:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.208+0000 7f1ebcbff700 1 -- 172.21.15.72:0/716221831 wait complete. 2023-08-31T18:49:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.210+0000 7f1ebcbff700 1 Processor -- start 2023-08-31T18:49:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.210+0000 7f1ebcbff700 1 -- start start 2023-08-31T18:49:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.211+0000 7f1ebcbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb8064db0 0x7f1eb81518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.211+0000 7f1ebcbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1eb8154120 0x7f1eb80a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.211+0000 7f1ebcbff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1eb8154500 0x7f1eb814eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.211+0000 7f1ebcbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8150c50 con 0x7f1eb8064db0 2023-08-31T18:49:18.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.211+0000 7f1ebcbff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8150340 con 0x7f1eb8154500 2023-08-31T18:49:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.211+0000 7f1ebcbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8151e70 con 0x7f1eb8154120 2023-08-31T18:49:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.211+0000 7f1eb659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb8064db0 0x7f1eb81518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.211+0000 7f1eb659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb8064db0 0x7f1eb81518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32928/0 (socket says 172.21.15.72:32928) 2023-08-31T18:49:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.211+0000 7f1eb659c700 1 -- 172.21.15.72:0/3383196721 learned_addr learned my addr 172.21.15.72:0/3383196721 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:18.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.212+0000 7f1eb6d9d700 1 --2- 172.21.15.72:0/3383196721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1eb8154500 0x7f1eb814eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:18.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.212+0000 7f1eb5d9b700 1 --2- 172.21.15.72:0/3383196721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1eb8154120 0x7f1eb80a9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:18.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.212+0000 7f1eb659c700 1 -- 172.21.15.72:0/3383196721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1eb8154120 msgr2=0x7f1eb80a9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:18.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.212+0000 7f1eb659c700 1 --2- 172.21.15.72:0/3383196721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1eb8154120 0x7f1eb80a9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.212+0000 7f1eb659c700 1 -- 172.21.15.72:0/3383196721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1eb8154500 msgr2=0x7f1eb814eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:18.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.212+0000 7f1eb659c700 1 --2- 172.21.15.72:0/3383196721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1eb8154500 0x7f1eb814eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.212+0000 7f1eb659c700 1 -- 172.21.15.72:0/3383196721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea80092a0 con 0x7f1eb8064db0 2023-08-31T18:49:18.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.212+0000 7f1eb659c700 1 --2- 172.21.15.72:0/3383196721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb8064db0 0x7f1eb81518d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f1ea8009eb0 tx=0x7f1ea8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:18.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.212+0000 7f1ea67fc700 1 -- 172.21.15.72:0/3383196721 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8011b30 con 0x7f1eb8064db0 2023-08-31T18:49:18.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.212+0000 7f1ea67fc700 1 -- 172.21.15.72:0/3383196721 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea8011c90 con 0x7f1eb8064db0 2023-08-31T18:49:18.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.212+0000 7f1ea67fc700 1 -- 172.21.15.72:0/3383196721 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea801b620 con 0x7f1eb8064db0 2023-08-31T18:49:18.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.212+0000 7f1ebcbff700 1 -- 172.21.15.72:0/3383196721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb8150600 con 0x7f1eb8064db0 2023-08-31T18:49:18.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.212+0000 7f1ebcbff700 1 -- 172.21.15.72:0/3383196721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb80a9860 con 0x7f1eb8064db0 2023-08-31T18:49:18.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.214+0000 7f1ebcbff700 1 -- 172.21.15.72:0/3383196721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb806a7e0 con 0x7f1eb8064db0 2023-08-31T18:49:18.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.214+0000 7f1ea67fc700 1 -- 172.21.15.72:0/3383196721 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f1ea801ba10 con 0x7f1eb8064db0 2023-08-31T18:49:18.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.215+0000 7f1ea67fc700 1 --2- 172.21.15.72:0/3383196721 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1e9805f010 0x7f1e980614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:18.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.215+0000 7f1ea67fc700 1 -- 172.21.15.72:0/3383196721 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f1ea807bcd0 con 0x7f1eb8064db0 2023-08-31T18:49:18.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.215+0000 7f1eb5d9b700 1 --2- 172.21.15.72:0/3383196721 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1e9805f010 0x7f1e980614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:18.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.216+0000 7f1eb5d9b700 1 --2- 172.21.15.72:0/3383196721 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1e9805f010 0x7f1e980614d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1eb80ca220 tx=0x7f1eac009040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:18.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.219+0000 7f1ea67fc700 1 -- 172.21.15.72:0/3383196721 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ea804ce90 con 0x7f1eb8064db0 2023-08-31T18:49:18.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.413+0000 7f1ebcbff700 1 -- 172.21.15.72:0/3383196721 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1eb8150d90 con 0x7f1e9805f010 2023-08-31T18:49:18.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.417+0000 7f1ea67fc700 1 -- 172.21.15.72:0/3383196721 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1eac003340 con 0x7f1e9805f010 2023-08-31T18:49:18.418 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-08-31T18:49:18.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.419+0000 7f1ebcbff700 1 -- 172.21.15.72:0/3383196721 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1e9805f010 msgr2=0x7f1e980614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:18.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.419+0000 7f1ebcbff700 1 --2- 172.21.15.72:0/3383196721 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1e9805f010 0x7f1e980614d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1eb80ca220 tx=0x7f1eac009040).stop 2023-08-31T18:49:18.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.419+0000 7f1ebcbff700 1 -- 172.21.15.72:0/3383196721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb8064db0 msgr2=0x7f1eb81518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:18.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.419+0000 7f1ebcbff700 1 --2- 172.21.15.72:0/3383196721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb8064db0 0x7f1eb81518d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f1ea8009eb0 tx=0x7f1ea8017000).stop 2023-08-31T18:49:18.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.420+0000 7f1ebcbff700 1 -- 172.21.15.72:0/3383196721 shutdown_connections 2023-08-31T18:49:18.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.420+0000 7f1ebcbff700 1 --2- 172.21.15.72:0/3383196721 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1e9805f010 0x7f1e980614d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.420+0000 7f1ebcbff700 1 --2- 172.21.15.72:0/3383196721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1eb8154500 0x7f1eb814eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.420+0000 7f1ebcbff700 1 --2- 172.21.15.72:0/3383196721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1eb8064db0 0x7f1eb81518d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.420+0000 7f1ebcbff700 1 --2- 172.21.15.72:0/3383196721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1eb8154120 0x7f1eb80a9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.420+0000 7f1ebcbff700 1 -- 172.21.15.72:0/3383196721 >> 172.21.15.72:0/3383196721 conn(0x7f1eb80cb7e0 msgr2=0x7f1eb80ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:18.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.420+0000 7f1ebcbff700 1 -- 172.21.15.72:0/3383196721 shutdown_connections 2023-08-31T18:49:18.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.420+0000 7f1ebcbff700 1 -- 172.21.15.72:0/3383196721 wait complete. 2023-08-31T18:49:18.437 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-08-31T18:49:18.437 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-08-31T18:49:18.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.631+0000 7f4069fff700 1 Processor -- start 2023-08-31T18:49:18.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.631+0000 7f4069fff700 1 -- start start 2023-08-31T18:49:18.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.632+0000 7f4069fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4064151da0 0x7f40641553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:18.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.632+0000 7f4069fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f40640c5370 0x7f4064064660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.632+0000 7f4069fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4064064b50 0x7f40640bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.632+0000 7f4069fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40640c57f0 con 0x7f4064064b50 2023-08-31T18:49:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.632+0000 7f4069fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4064154f40 con 0x7f4064151da0 2023-08-31T18:49:18.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.632+0000 7f4069fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4064154960 con 0x7f40640c5370 2023-08-31T18:49:18.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.633+0000 7f4063fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4064064b50 0x7f40640bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:18.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.633+0000 7f4063fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4064064b50 0x7f40640bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32942/0 (socket says 172.21.15.72:32942) 2023-08-31T18:49:18.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.633+0000 7f4063fff700 1 -- 172.21.15.72:0/3123312867 learned_addr learned my addr 172.21.15.72:0/3123312867 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:18.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.633+0000 7f40637fe700 1 --2- 172.21.15.72:0/3123312867 >> v2:172.21.15.146:3300/0 conn(0x7f4064151da0 0x7f40641553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:18.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.633+0000 7f4062ffd700 1 --2- 172.21.15.72:0/3123312867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f40640c5370 0x7f4064064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.633+0000 7f4063fff700 1 -- 172.21.15.72:0/3123312867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f40640c5370 msgr2=0x7f4064064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.633+0000 7f4063fff700 1 --2- 172.21.15.72:0/3123312867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f40640c5370 0x7f4064064660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.633+0000 7f4063fff700 1 -- 172.21.15.72:0/3123312867 >> v2:172.21.15.146:3300/0 conn(0x7f4064151da0 msgr2=0x7f40641553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.633+0000 7f4063fff700 1 --2- 172.21.15.72:0/3123312867 >> v2:172.21.15.146:3300/0 conn(0x7f4064151da0 0x7f40641553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.633+0000 7f4063fff700 1 -- 172.21.15.72:0/3123312867 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4064064fc0 con 0x7f4064064b50 2023-08-31T18:49:18.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.633+0000 7f4063fff700 1 --2- 172.21.15.72:0/3123312867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4064064b50 0x7f40640bfcd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f4064061630 tx=0x7f405c009840).ready entity=mon.0 client_cookie=22b21546a85de0c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:18.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.633+0000 7f40627fc700 1 -- 172.21.15.72:0/3123312867 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c00e070 con 0x7f4064064b50 2023-08-31T18:49:18.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.633+0000 7f40627fc700 1 -- 172.21.15.72:0/3123312867 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c00ba50 con 0x7f4064064b50 2023-08-31T18:49:18.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.634+0000 7f40627fc700 1 -- 172.21.15.72:0/3123312867 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c00bdd0 con 0x7f4064064b50 2023-08-31T18:49:18.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.634+0000 7f4069fff700 1 -- 172.21.15.72:0/3123312867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4064064b50 msgr2=0x7f40640bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:18.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.634+0000 7f4069fff700 1 --2- 172.21.15.72:0/3123312867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4064064b50 0x7f40640bfcd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f4064061630 tx=0x7f405c009840).stop 2023-08-31T18:49:18.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.634+0000 7f4069fff700 1 -- 172.21.15.72:0/3123312867 shutdown_connections 2023-08-31T18:49:18.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.634+0000 7f4069fff700 1 --2- 172.21.15.72:0/3123312867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4064064b50 0x7f40640bfcd0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.634+0000 7f4069fff700 1 --2- 172.21.15.72:0/3123312867 >> v2:172.21.15.146:3300/0 conn(0x7f4064151da0 0x7f40641553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.634+0000 7f4069fff700 1 --2- 172.21.15.72:0/3123312867 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f40640c5370 0x7f4064064660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.634+0000 7f4069fff700 1 -- 172.21.15.72:0/3123312867 >> 172.21.15.72:0/3123312867 conn(0x7f4064063a90 msgr2=0x7f40640cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:18.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.634+0000 7f4069fff700 1 -- 172.21.15.72:0/3123312867 shutdown_connections 2023-08-31T18:49:18.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.634+0000 7f4069fff700 1 -- 172.21.15.72:0/3123312867 wait complete. 2023-08-31T18:49:18.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.636+0000 7f4069fff700 1 Processor -- start 2023-08-31T18:49:18.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.636+0000 7f4069fff700 1 -- start start 2023-08-31T18:49:18.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f4069fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4064064b50 0x7f4064151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:18.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f4069fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40640c5370 0x7f40640ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:18.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f4069fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4064151da0 0x7f40640aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:18.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f4069fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40640acd60 con 0x7f4064064b50 2023-08-31T18:49:18.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f4069fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40641515f0 con 0x7f40640c5370 2023-08-31T18:49:18.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f4069fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40640ac150 con 0x7f4064151da0 2023-08-31T18:49:18.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f40637fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4064064b50 0x7f4064151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:18.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f40637fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4064064b50 0x7f4064151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32952/0 (socket says 172.21.15.72:32952) 2023-08-31T18:49:18.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f40637fe700 1 -- 172.21.15.72:0/1972704241 learned_addr learned my addr 172.21.15.72:0/1972704241 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:18.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f4062ffd700 1 --2- 172.21.15.72:0/1972704241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40640c5370 0x7f40640ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:18.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f4063fff700 1 --2- 172.21.15.72:0/1972704241 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4064151da0 0x7f40640aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:18.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f40637fe700 1 -- 172.21.15.72:0/1972704241 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4064151da0 msgr2=0x7f40640aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:18.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f40637fe700 1 --2- 172.21.15.72:0/1972704241 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4064151da0 0x7f40640aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f40637fe700 1 -- 172.21.15.72:0/1972704241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40640c5370 msgr2=0x7f40640ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:18.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f40637fe700 1 --2- 172.21.15.72:0/1972704241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40640c5370 0x7f40640ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f40637fe700 1 -- 172.21.15.72:0/1972704241 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c009ae0 con 0x7f4064064b50 2023-08-31T18:49:18.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.637+0000 7f40637fe700 1 --2- 172.21.15.72:0/1972704241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4064064b50 0x7f4064151100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f405400d890 tx=0x7f4054008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:18.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.638+0000 7f404b7fe700 1 -- 172.21.15.72:0/1972704241 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40540125f0 con 0x7f4064064b50 2023-08-31T18:49:18.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.638+0000 7f404b7fe700 1 -- 172.21.15.72:0/1972704241 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4054012750 con 0x7f4064064b50 2023-08-31T18:49:18.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.638+0000 7f404b7fe700 1 -- 172.21.15.72:0/1972704241 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054012ad0 con 0x7f4064064b50 2023-08-31T18:49:18.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.638+0000 7f4069fff700 1 -- 172.21.15.72:0/1972704241 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40640ac430 con 0x7f4064064b50 2023-08-31T18:49:18.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.638+0000 7f4069fff700 1 -- 172.21.15.72:0/1972704241 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40640ac9f0 con 0x7f4064064b50 2023-08-31T18:49:18.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.639+0000 7f4069fff700 1 -- 172.21.15.72:0/1972704241 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406406a7e0 con 0x7f4064064b50 2023-08-31T18:49:18.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.640+0000 7f404b7fe700 1 -- 172.21.15.72:0/1972704241 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f4054013480 con 0x7f4064064b50 2023-08-31T18:49:18.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.640+0000 7f404b7fe700 1 --2- 172.21.15.72:0/1972704241 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f405005f010 0x7f40500614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:18.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.640+0000 7f404b7fe700 1 -- 172.21.15.72:0/1972704241 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f405407a310 con 0x7f4064064b50 2023-08-31T18:49:18.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.641+0000 7f4062ffd700 1 --2- 172.21.15.72:0/1972704241 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f405005f010 0x7f40500614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:18.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.641+0000 7f4062ffd700 1 --2- 172.21.15.72:0/1972704241 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f405005f010 0x7f40500614d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f406415a950 tx=0x7f4058008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:18.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.645+0000 7f404b7fe700 1 -- 172.21.15.72:0/1972704241 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f405404b470 con 0x7f4064064b50 2023-08-31T18:49:18.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.840+0000 7f4069fff700 1 -- 172.21.15.72:0/1972704241 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f406406c6b0 con 0x7f405005f010 2023-08-31T18:49:18.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.844+0000 7f404b7fe700 1 -- 172.21.15.72:0/1972704241 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f406406c6b0 con 0x7f405005f010 2023-08-31T18:49:18.844 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-08-31T18:49:18.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.846+0000 7f4069fff700 1 -- 172.21.15.72:0/1972704241 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f405005f010 msgr2=0x7f40500614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:18.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.846+0000 7f4069fff700 1 --2- 172.21.15.72:0/1972704241 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f405005f010 0x7f40500614d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f406415a950 tx=0x7f4058008040).stop 2023-08-31T18:49:18.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.846+0000 7f4069fff700 1 -- 172.21.15.72:0/1972704241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4064064b50 msgr2=0x7f4064151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:18.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.846+0000 7f4069fff700 1 --2- 172.21.15.72:0/1972704241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4064064b50 0x7f4064151100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f405400d890 tx=0x7f4054008040).stop 2023-08-31T18:49:18.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.846+0000 7f4069fff700 1 -- 172.21.15.72:0/1972704241 shutdown_connections 2023-08-31T18:49:18.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.846+0000 7f4069fff700 1 --2- 172.21.15.72:0/1972704241 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4064151da0 0x7f40640aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.846+0000 7f4069fff700 1 --2- 172.21.15.72:0/1972704241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4064064b50 0x7f4064151100 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.846+0000 7f4069fff700 1 --2- 172.21.15.72:0/1972704241 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f405005f010 0x7f40500614d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.846+0000 7f4069fff700 1 --2- 172.21.15.72:0/1972704241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40640c5370 0x7f40640ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:18.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.846+0000 7f4069fff700 1 -- 172.21.15.72:0/1972704241 >> 172.21.15.72:0/1972704241 conn(0x7f4064063a90 msgr2=0x7f40640cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:18.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.846+0000 7f4069fff700 1 -- 172.21.15.72:0/1972704241 shutdown_connections 2023-08-31T18:49:18.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:18.846+0000 7f4069fff700 1 -- 172.21.15.72:0/1972704241 wait complete. 2023-08-31T18:49:18.863 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-08-31T18:49:18.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-08-31T18:49:18.974 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:49:18.981 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:49:19.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.068+0000 7f47843ff700 1 Processor -- start 2023-08-31T18:49:19.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.068+0000 7f47843ff700 1 -- start start 2023-08-31T18:49:19.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.069+0000 7f47843ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f477c154120 0x7f477c0a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.069+0000 7f47843ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f477c154500 0x7f477c0646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.069+0000 7f47843ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f477c064b90 0x7f477c0c0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.069+0000 7f47843ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c0aa620 con 0x7f477c154120 2023-08-31T18:49:19.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.069+0000 7f47843ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c065020 con 0x7f477c154500 2023-08-31T18:49:19.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.069+0000 7f47843ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0aa3a0 con 0x7f477c064b90 2023-08-31T18:49:19.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.070+0000 7f478219b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f477c154120 0x7f477c0a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.070+0000 7f478219b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f477c154120 0x7f477c0a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32962/0 (socket says 172.21.15.72:32962) 2023-08-31T18:49:19.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.070+0000 7f478219b700 1 -- 172.21.15.72:0/4243916171 learned_addr learned my addr 172.21.15.72:0/4243916171 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:19.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.070+0000 7f478199a700 1 --2- 172.21.15.72:0/4243916171 >> v2:172.21.15.146:3300/0 conn(0x7f477c154500 0x7f477c0646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.070+0000 7f478299c700 1 --2- 172.21.15.72:0/4243916171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f477c064b90 0x7f477c0c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.070+0000 7f478219b700 1 -- 172.21.15.72:0/4243916171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f477c064b90 msgr2=0x7f477c0c0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:19.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.070+0000 7f478219b700 1 --2- 172.21.15.72:0/4243916171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f477c064b90 0x7f477c0c0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.070+0000 7f478219b700 1 -- 172.21.15.72:0/4243916171 >> v2:172.21.15.146:3300/0 conn(0x7f477c154500 msgr2=0x7f477c0646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:19.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.070+0000 7f478219b700 1 --2- 172.21.15.72:0/4243916171 >> v2:172.21.15.146:3300/0 conn(0x7f477c154500 0x7f477c0646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.070+0000 7f478219b700 1 -- 172.21.15.72:0/4243916171 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c0c5450 con 0x7f477c154120 2023-08-31T18:49:19.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.070+0000 7f478299c700 1 --2- 172.21.15.72:0/4243916171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f477c064b90 0x7f477c0c0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T18:49:19.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.070+0000 7f478219b700 1 --2- 172.21.15.72:0/4243916171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c154120 0x7f477c0a9eb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f477c061290 tx=0x7f47780090f0).ready entity=mon.0 client_cookie=f72ba2bbc6e70e04 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.070+0000 7f4781199700 1 -- 172.21.15.72:0/4243916171 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477800b600 con 0x7f477c154120 2023-08-31T18:49:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.071+0000 7f4781199700 1 -- 172.21.15.72:0/4243916171 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477800b760 con 0x7f477c154120 2023-08-31T18:49:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.071+0000 7f4781199700 1 -- 172.21.15.72:0/4243916171 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477800bae0 con 0x7f477c154120 2023-08-31T18:49:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.071+0000 7f47843ff700 1 -- 172.21.15.72:0/4243916171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c154120 msgr2=0x7f477c0a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.071+0000 7f47843ff700 1 --2- 172.21.15.72:0/4243916171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c154120 0x7f477c0a9eb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f477c061290 tx=0x7f47780090f0).stop 2023-08-31T18:49:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.071+0000 7f47843ff700 1 -- 172.21.15.72:0/4243916171 shutdown_connections 2023-08-31T18:49:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.071+0000 7f47843ff700 1 --2- 172.21.15.72:0/4243916171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f477c064b90 0x7f477c0c0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.071+0000 7f47843ff700 1 --2- 172.21.15.72:0/4243916171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c154120 0x7f477c0a9eb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.071+0000 7f47843ff700 1 --2- 172.21.15.72:0/4243916171 >> v2:172.21.15.146:3300/0 conn(0x7f477c154500 0x7f477c0646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.071+0000 7f47843ff700 1 -- 172.21.15.72:0/4243916171 >> 172.21.15.72:0/4243916171 conn(0x7f477c0cb7e0 msgr2=0x7f477c0c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:19.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.071+0000 7f47843ff700 1 -- 172.21.15.72:0/4243916171 shutdown_connections 2023-08-31T18:49:19.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.071+0000 7f47843ff700 1 -- 172.21.15.72:0/4243916171 wait complete. 2023-08-31T18:49:19.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.073+0000 7f47843ff700 1 Processor -- start 2023-08-31T18:49:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.074+0000 7f47843ff700 1 -- start start 2023-08-31T18:49:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.075+0000 7f47843ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f477c064b90 0x7f477c0c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.075+0000 7f47843ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c154120 0x7f477c14f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.075+0000 7f47843ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f477c154500 0x7f477c14fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.075+0000 7f47843ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c1502e0 con 0x7f477c154120 2023-08-31T18:49:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.075+0000 7f47843ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0b0950 con 0x7f477c064b90 2023-08-31T18:49:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.075+0000 7f47843ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0b0c30 con 0x7f477c154500 2023-08-31T18:49:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.075+0000 7f478199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c154120 0x7f477c14f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.075+0000 7f478199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c154120 0x7f477c14f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32968/0 (socket says 172.21.15.72:32968) 2023-08-31T18:49:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.075+0000 7f478199a700 1 -- 172.21.15.72:0/3056055845 learned_addr learned my addr 172.21.15.72:0/3056055845 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.075+0000 7f478219b700 1 --2- 172.21.15.72:0/3056055845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f477c064b90 0x7f477c0c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.075+0000 7f478299c700 1 --2- 172.21.15.72:0/3056055845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f477c154500 0x7f477c14fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.076+0000 7f478199a700 1 -- 172.21.15.72:0/3056055845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f477c154500 msgr2=0x7f477c14fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.076+0000 7f478199a700 1 --2- 172.21.15.72:0/3056055845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f477c154500 0x7f477c14fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.076+0000 7f478199a700 1 -- 172.21.15.72:0/3056055845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f477c064b90 msgr2=0x7f477c0c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.076+0000 7f478199a700 1 --2- 172.21.15.72:0/3056055845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f477c064b90 0x7f477c0c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.076+0000 7f478199a700 1 -- 172.21.15.72:0/3056055845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4778009370 con 0x7f477c154120 2023-08-31T18:49:19.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.076+0000 7f478199a700 1 --2- 172.21.15.72:0/3056055845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c154120 0x7f477c14f900 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f476c00d890 tx=0x7f476c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:19.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.076+0000 7f47727fc700 1 -- 172.21.15.72:0/3056055845 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c00f520 con 0x7f477c154120 2023-08-31T18:49:19.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.076+0000 7f47727fc700 1 -- 172.21.15.72:0/3056055845 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c00f680 con 0x7f477c154120 2023-08-31T18:49:19.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.076+0000 7f47727fc700 1 -- 172.21.15.72:0/3056055845 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c00fa00 con 0x7f477c154120 2023-08-31T18:49:19.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.076+0000 7f47843ff700 1 -- 172.21.15.72:0/3056055845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477c0c21a0 con 0x7f477c154120 2023-08-31T18:49:19.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.076+0000 7f47843ff700 1 -- 172.21.15.72:0/3056055845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c0c2760 con 0x7f477c154120 2023-08-31T18:49:19.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.077+0000 7f47843ff700 1 -- 172.21.15.72:0/3056055845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c06a7e0 con 0x7f477c154120 2023-08-31T18:49:19.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.078+0000 7f47727fc700 1 -- 172.21.15.72:0/3056055845 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f476c013480 con 0x7f477c154120 2023-08-31T18:49:19.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.079+0000 7f47727fc700 1 --2- 172.21.15.72:0/3056055845 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f476005f040 0x7f4760061500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.079+0000 7f47727fc700 1 -- 172.21.15.72:0/3056055845 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f476c079c20 con 0x7f477c154120 2023-08-31T18:49:19.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.079+0000 7f478219b700 1 --2- 172.21.15.72:0/3056055845 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f476005f040 0x7f4760061500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.080+0000 7f478219b700 1 --2- 172.21.15.72:0/3056055845 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f476005f040 0x7f4760061500 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4778009130 tx=0x7f4778017000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:19.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.083+0000 7f47727fc700 1 -- 172.21.15.72:0/3056055845 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f476c04ad80 con 0x7f477c154120 2023-08-31T18:49:19.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.279+0000 7f47843ff700 1 -- 172.21.15.72:0/3056055845 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f477c06c6b0 con 0x7f476005f040 2023-08-31T18:49:19.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.283+0000 7f47727fc700 1 -- 172.21.15.72:0/3056055845 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f477c06c6b0 con 0x7f476005f040 2023-08-31T18:49:19.284 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-08-31T18:49:19.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.285+0000 7f47843ff700 1 -- 172.21.15.72:0/3056055845 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f476005f040 msgr2=0x7f4760061500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.285+0000 7f47843ff700 1 --2- 172.21.15.72:0/3056055845 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f476005f040 0x7f4760061500 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4778009130 tx=0x7f4778017000).stop 2023-08-31T18:49:19.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.285+0000 7f47843ff700 1 -- 172.21.15.72:0/3056055845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c154120 msgr2=0x7f477c14f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.285+0000 7f47843ff700 1 --2- 172.21.15.72:0/3056055845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c154120 0x7f477c14f900 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f476c00d890 tx=0x7f476c008040).stop 2023-08-31T18:49:19.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.285+0000 7f47843ff700 1 -- 172.21.15.72:0/3056055845 shutdown_connections 2023-08-31T18:49:19.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.285+0000 7f47843ff700 1 --2- 172.21.15.72:0/3056055845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f477c154500 0x7f477c14fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.285+0000 7f47843ff700 1 --2- 172.21.15.72:0/3056055845 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f476005f040 0x7f4760061500 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.285+0000 7f47843ff700 1 --2- 172.21.15.72:0/3056055845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f477c064b90 0x7f477c0c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.285+0000 7f47843ff700 1 --2- 172.21.15.72:0/3056055845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c154120 0x7f477c14f900 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.286+0000 7f47843ff700 1 -- 172.21.15.72:0/3056055845 >> 172.21.15.72:0/3056055845 conn(0x7f477c0cb7e0 msgr2=0x7f477c0c9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:19.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.286+0000 7f47843ff700 1 -- 172.21.15.72:0/3056055845 shutdown_connections 2023-08-31T18:49:19.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.286+0000 7f47843ff700 1 -- 172.21.15.72:0/3056055845 wait complete. 2023-08-31T18:49:19.303 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-08-31T18:49:19.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-08-31T18:49:19.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.536+0000 7f386f1ff700 1 Processor -- start 2023-08-31T18:49:19.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.536+0000 7f386f1ff700 1 -- start start 2023-08-31T18:49:19.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.537+0000 7f386f1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3868064d70 0x7f38681553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.537+0000 7f386f1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3868154f40 con 0x7f3868151da0 2023-08-31T18:49:19.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.537+0000 7f386f1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3868154960 con 0x7f38680c5370 2023-08-31T18:49:19.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.537+0000 7f386f1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38680c57e0 con 0x7f3868064d70 2023-08-31T18:49:19.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.538+0000 7f386cf9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3868151da0 0x7f3868064660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40154/0 (socket says 172.21.15.72:40154) 2023-08-31T18:49:19.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.538+0000 7f386cf9b700 1 -- 172.21.15.72:0/1697848781 learned_addr learned my addr 172.21.15.72:0/1697848781 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T18:49:19.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.538+0000 7f3867fff700 1 --2- 172.21.15.72:0/1697848781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3868064d70 0x7f38681553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.538+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638893987 0 0) 0x7f3868154f40 con 0x7f3868151da0 2023-08-31T18:49:19.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.538+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38580033f0 con 0x7f3868151da0 2023-08-31T18:49:19.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.538+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566118647 0 0) 0x7f3868154960 con 0x7f38680c5370 2023-08-31T18:49:19.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.538+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3868154f40 con 0x7f38680c5370 2023-08-31T18:49:19.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.538+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1627784212 0 0) 0x7f38580033f0 con 0x7f3868151da0 2023-08-31T18:49:19.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.538+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3868064d70 msgr2=0x7f38681553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:19.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.538+0000 7f38677fe700 1 --2- 172.21.15.72:0/1697848781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3868064d70 0x7f38681553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.538+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 >> v1:172.21.15.146:6789/0 conn(0x7f38680c5370 legacy=0x7f38680bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.538+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38680aa2c0 con 0x7f3868151da0 2023-08-31T18:49:19.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.538+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f385c001470 con 0x7f3868151da0 2023-08-31T18:49:19.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.538+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 >> v1:172.21.15.72:6789/0 conn(0x7f3868151da0 legacy=0x7f3868064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.538+0000 7f38677fe700 1 --2- 172.21.15.72:0/1697848781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3858003aa0 0x7f3858003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.539+0000 7f38677fe700 1 --2- 172.21.15.72:0/1697848781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3858004690 0x7f3858004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.539+0000 7f38677fe700 1 --2- 172.21.15.72:0/1697848781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3868064d70 0x7f3858005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.539+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385800b8e0 con 0x7f3858004690 2023-08-31T18:49:19.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.539+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385800ba50 con 0x7f3858003aa0 2023-08-31T18:49:19.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.539+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385800bc10 con 0x7f3868064d70 2023-08-31T18:49:19.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.539+0000 7f3867fff700 1 --2- 172.21.15.72:0/1697848781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3858004690 0x7f3858004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.539+0000 7f386cf9b700 1 --2- 172.21.15.72:0/1697848781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3858003aa0 0x7f3858003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.539+0000 7f386d79c700 1 --2- 172.21.15.72:0/1697848781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3868064d70 0x7f3858005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.539+0000 7f3867fff700 1 -- 172.21.15.72:0/1697848781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3868064d70 msgr2=0x7f3858005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:19.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.539+0000 7f3867fff700 1 --2- 172.21.15.72:0/1697848781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3868064d70 0x7f3858005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.539+0000 7f3867fff700 1 -- 172.21.15.72:0/1697848781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3858003aa0 msgr2=0x7f3858003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:19.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.539+0000 7f3867fff700 1 --2- 172.21.15.72:0/1697848781 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3858003aa0 0x7f3858003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.539+0000 7f3867fff700 1 -- 172.21.15.72:0/1697848781 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38580033f0 con 0x7f3858004690 2023-08-31T18:49:19.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.539+0000 7f3867fff700 1 --2- 172.21.15.72:0/1697848781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3858004690 0x7f3858004b10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f3868065170 tx=0x7f3854009060).ready entity=mon.0 client_cookie=ed772c8a2041439b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:19.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.540+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854009e90 con 0x7f3858004690 2023-08-31T18:49:19.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.540+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3854009430 con 0x7f3858004690 2023-08-31T18:49:19.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.540+0000 7f38677fe700 1 -- 172.21.15.72:0/1697848781 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385400e850 con 0x7f3858004690 2023-08-31T18:49:19.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.540+0000 7f386f1ff700 1 -- 172.21.15.72:0/1697848781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3858004690 msgr2=0x7f3858004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.540+0000 7f386f1ff700 1 --2- 172.21.15.72:0/1697848781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3858004690 0x7f3858004b10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f3868065170 tx=0x7f3854009060).stop 2023-08-31T18:49:19.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.540+0000 7f386d79c700 1 -- 172.21.15.72:0/1697848781 reap_dead start 2023-08-31T18:49:19.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.540+0000 7f386f1ff700 1 -- 172.21.15.72:0/1697848781 shutdown_connections 2023-08-31T18:49:19.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.540+0000 7f386f1ff700 1 -- 172.21.15.72:0/1697848781 >> 172.21.15.72:0/1697848781 conn(0x7f3868063a90 msgr2=0x7f38680cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:19.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.540+0000 7f386f1ff700 1 -- 172.21.15.72:0/1697848781 shutdown_connections 2023-08-31T18:49:19.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.540+0000 7f386f1ff700 1 -- 172.21.15.72:0/1697848781 wait complete. 2023-08-31T18:49:19.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.542+0000 7f386f1ff700 1 Processor -- start 2023-08-31T18:49:19.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.542+0000 7f386f1ff700 1 -- start start 2023-08-31T18:49:19.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.543+0000 7f386f1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3858004690 0x7f386813f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.543+0000 7f386f1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f386813f530 0x7f386814e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.543+0000 7f386f1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f386814e7a0 0x7f38680aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.543+0000 7f386f1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38680b05d0 con 0x7f386813f530 2023-08-31T18:49:19.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.543+0000 7f386f1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38680af9c0 con 0x7f386814e7a0 2023-08-31T18:49:19.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.543+0000 7f386f1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38680afca0 con 0x7f3858004690 2023-08-31T18:49:19.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.543+0000 7f3867fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f386813f530 0x7f386814e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.543+0000 7f3867fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f386813f530 0x7f386814e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32978/0 (socket says 172.21.15.72:32978) 2023-08-31T18:49:19.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.543+0000 7f3867fff700 1 -- 172.21.15.72:0/3639423791 learned_addr learned my addr 172.21.15.72:0/3639423791 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:19.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.544+0000 7f3867fff700 1 -- 172.21.15.72:0/3639423791 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3858004690 msgr2=0x7f386813f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.544+0000 7f3867fff700 1 --2- 172.21.15.72:0/3639423791 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3858004690 0x7f386813f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:19.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.544+0000 7f3867fff700 1 -- 172.21.15.72:0/3639423791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f386814e7a0 msgr2=0x7f38680aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.544+0000 7f3867fff700 1 --2- 172.21.15.72:0/3639423791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f386814e7a0 0x7f38680aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:19.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.544+0000 7f3867fff700 1 -- 172.21.15.72:0/3639423791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38680aff80 con 0x7f386813f530 2023-08-31T18:49:19.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.544+0000 7f3867fff700 1 --2- 172.21.15.72:0/3639423791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f386813f530 0x7f386814e2b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f385400e4b0 tx=0x7f385401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:19.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.544+0000 7f3864ff9700 1 -- 172.21.15.72:0/3639423791 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385401da30 con 0x7f386813f530 2023-08-31T18:49:19.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.544+0000 7f3864ff9700 1 -- 172.21.15.72:0/3639423791 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385401db90 con 0x7f386813f530 2023-08-31T18:49:19.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.544+0000 7f3864ff9700 1 -- 172.21.15.72:0/3639423791 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854026440 con 0x7f386813f530 2023-08-31T18:49:19.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.544+0000 7f386f1ff700 1 -- 172.21.15.72:0/3639423791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38680b0260 con 0x7f386813f530 2023-08-31T18:49:19.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.544+0000 7f386f1ff700 1 -- 172.21.15.72:0/3639423791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38680af1c0 con 0x7f386813f530 2023-08-31T18:49:19.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.545+0000 7f386f1ff700 1 -- 172.21.15.72:0/3639423791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386806a7e0 con 0x7f386813f530 2023-08-31T18:49:19.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.546+0000 7f3864ff9700 1 -- 172.21.15.72:0/3639423791 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f385402f440 con 0x7f386813f530 2023-08-31T18:49:19.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.547+0000 7f3864ff9700 1 --2- 172.21.15.72:0/3639423791 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f384c05f010 0x7f384c0614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.547+0000 7f3864ff9700 1 -- 172.21.15.72:0/3639423791 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f385407bf90 con 0x7f386813f530 2023-08-31T18:49:19.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.547+0000 7f386cf9b700 1 --2- 172.21.15.72:0/3639423791 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f384c05f010 0x7f384c0614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.548+0000 7f386cf9b700 1 --2- 172.21.15.72:0/3639423791 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f384c05f010 0x7f384c0614d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f385c007b10 tx=0x7f385c001e10).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:19.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.551+0000 7f3864ff9700 1 -- 172.21.15.72:0/3639423791 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f385404d0a0 con 0x7f386813f530 2023-08-31T18:49:19.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.748+0000 7f386f1ff700 1 -- 172.21.15.72:0/3639423791 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f386806c6b0 con 0x7f384c05f010 2023-08-31T18:49:19.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.753+0000 7f3864ff9700 1 -- 172.21.15.72:0/3639423791 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f386806c6b0 con 0x7f384c05f010 2023-08-31T18:49:19.753 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-08-31T18:49:19.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.755+0000 7f386f1ff700 1 -- 172.21.15.72:0/3639423791 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f384c05f010 msgr2=0x7f384c0614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.755+0000 7f386f1ff700 1 --2- 172.21.15.72:0/3639423791 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f384c05f010 0x7f384c0614d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f385c007b10 tx=0x7f385c001e10).stop 2023-08-31T18:49:19.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.755+0000 7f386f1ff700 1 -- 172.21.15.72:0/3639423791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f386813f530 msgr2=0x7f386814e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.755+0000 7f386f1ff700 1 --2- 172.21.15.72:0/3639423791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f386813f530 0x7f386814e2b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f385400e4b0 tx=0x7f385401a000).stop 2023-08-31T18:49:19.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.755+0000 7f386f1ff700 1 -- 172.21.15.72:0/3639423791 shutdown_connections 2023-08-31T18:49:19.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.755+0000 7f386f1ff700 1 --2- 172.21.15.72:0/3639423791 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f384c05f010 0x7f384c0614d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.755+0000 7f386f1ff700 1 --2- 172.21.15.72:0/3639423791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f386814e7a0 0x7f38680aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:19.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.755+0000 7f386f1ff700 1 --2- 172.21.15.72:0/3639423791 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3858004690 0x7f386813f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:19.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.755+0000 7f386f1ff700 1 --2- 172.21.15.72:0/3639423791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f386813f530 0x7f386814e2b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.755+0000 7f386f1ff700 1 -- 172.21.15.72:0/3639423791 >> 172.21.15.72:0/3639423791 conn(0x7f3868063a90 msgr2=0x7f38680c0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:19.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.755+0000 7f386f1ff700 1 -- 172.21.15.72:0/3639423791 shutdown_connections 2023-08-31T18:49:19.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.755+0000 7f386f1ff700 1 -- 172.21.15.72:0/3639423791 wait complete. 2023-08-31T18:49:19.772 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-08-31T18:49:19.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-08-31T18:49:19.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.966+0000 7fa88d5ff700 1 Processor -- start 2023-08-31T18:49:19.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.966+0000 7fa88d5ff700 1 -- start start 2023-08-31T18:49:19.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.967+0000 7fa88d5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa888154120 0x7fa8880a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.967+0000 7fa88d5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa888064db0 0x7fa88815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.967+0000 7fa88d5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8880aa620 con 0x7fa888154500 2023-08-31T18:49:19.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.967+0000 7fa88d5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8880aa3a0 con 0x7fa888064db0 2023-08-31T18:49:19.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.967+0000 7fa88d5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8880c5450 con 0x7fa888154120 2023-08-31T18:49:19.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.968+0000 7fa8877fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa888064db0 0x7fa88815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.968+0000 7fa8877fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa888064db0 0x7fa88815dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32988/0 (socket says 172.21.15.72:32988) 2023-08-31T18:49:19.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.968+0000 7fa8877fe700 1 -- 172.21.15.72:0/2743940967 learned_addr learned my addr 172.21.15.72:0/2743940967 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:19.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.968+0000 7fa886ffd700 1 --2- 172.21.15.72:0/2743940967 >> v2:172.21.15.146:3300/0 conn(0x7fa888154120 0x7fa8880a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.968+0000 7fa8877fe700 1 -- 172.21.15.72:0/2743940967 >> v2:172.21.15.146:3300/0 conn(0x7fa888154120 msgr2=0x7fa8880a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T18:49:19.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.968+0000 7fa8877fe700 1 --2- 172.21.15.72:0/2743940967 >> v2:172.21.15.146:3300/0 conn(0x7fa888154120 0x7fa8880a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.968+0000 7fa8877fe700 1 -- 172.21.15.72:0/2743940967 >> v1:172.21.15.146:6789/0 conn(0x7fa888154500 legacy=0x7fa8880646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.968+0000 7fa8877fe700 1 -- 172.21.15.72:0/2743940967 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8880c8050 con 0x7fa888064db0 2023-08-31T18:49:19.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.968+0000 7fa8877fe700 1 --2- 172.21.15.72:0/2743940967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888064db0 0x7fa88815dec0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fa8880643c0 tx=0x7fa880009840).ready entity=mon.0 client_cookie=d340fe25d2da522b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:19.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.968+0000 7fa885ffb700 1 -- 172.21.15.72:0/2743940967 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000e070 con 0x7fa888064db0 2023-08-31T18:49:19.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.969+0000 7fa885ffb700 1 -- 172.21.15.72:0/2743940967 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88000ba20 con 0x7fa888064db0 2023-08-31T18:49:19.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.969+0000 7fa885ffb700 1 -- 172.21.15.72:0/2743940967 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000bda0 con 0x7fa888064db0 2023-08-31T18:49:19.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.969+0000 7fa88d5ff700 1 -- 172.21.15.72:0/2743940967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888064db0 msgr2=0x7fa88815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.969+0000 7fa88d5ff700 1 --2- 172.21.15.72:0/2743940967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888064db0 0x7fa88815dec0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fa8880643c0 tx=0x7fa880009840).stop 2023-08-31T18:49:19.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.969+0000 7fa88d5ff700 1 -- 172.21.15.72:0/2743940967 shutdown_connections 2023-08-31T18:49:19.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.969+0000 7fa88d5ff700 1 --2- 172.21.15.72:0/2743940967 >> v2:172.21.15.146:3300/0 conn(0x7fa888154120 0x7fa8880a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.969+0000 7fa88d5ff700 1 --2- 172.21.15.72:0/2743940967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888064db0 0x7fa88815dec0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:19.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.969+0000 7fa88d5ff700 1 -- 172.21.15.72:0/2743940967 >> 172.21.15.72:0/2743940967 conn(0x7fa8880cb7e0 msgr2=0x7fa8880c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:19.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.969+0000 7fa88d5ff700 1 -- 172.21.15.72:0/2743940967 shutdown_connections 2023-08-31T18:49:19.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.969+0000 7fa88d5ff700 1 -- 172.21.15.72:0/2743940967 wait complete. 2023-08-31T18:49:19.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.971+0000 7fa88d5ff700 1 Processor -- start 2023-08-31T18:49:19.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.971+0000 7fa88d5ff700 1 -- start start 2023-08-31T18:49:19.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.972+0000 7fa88d5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888064db0 0x7fa8880c3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.972+0000 7fa88d5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa888154120 0x7fa8880c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.972+0000 7fa88d5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa888154500 0x7fa88814fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.972+0000 7fa88d5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88814ec50 con 0x7fa888064db0 2023-08-31T18:49:19.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.972+0000 7fa88d5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880c2490 con 0x7fa888154120 2023-08-31T18:49:19.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.972+0000 7fa88d5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880ad430 con 0x7fa888154500 2023-08-31T18:49:19.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.972+0000 7fa886ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888064db0 0x7fa8880c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.972+0000 7fa886ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888064db0 0x7fa8880c3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33002/0 (socket says 172.21.15.72:33002) 2023-08-31T18:49:19.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.972+0000 7fa886ffd700 1 -- 172.21.15.72:0/2549857814 learned_addr learned my addr 172.21.15.72:0/2549857814 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T18:49:19.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.972+0000 7fa886ffd700 1 -- 172.21.15.72:0/2549857814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa888154500 msgr2=0x7fa88814fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.972+0000 7fa886ffd700 1 --2- 172.21.15.72:0/2549857814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa888154500 0x7fa88814fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:19.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.972+0000 7fa886ffd700 1 -- 172.21.15.72:0/2549857814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa888154120 msgr2=0x7fa8880c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:19.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.972+0000 7fa886ffd700 1 --2- 172.21.15.72:0/2549857814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa888154120 0x7fa8880c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:19.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.972+0000 7fa886ffd700 1 -- 172.21.15.72:0/2549857814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa880009ae0 con 0x7fa888064db0 2023-08-31T18:49:19.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.973+0000 7fa886ffd700 1 --2- 172.21.15.72:0/2549857814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888064db0 0x7fa8880c3950 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fa87800e930 tx=0x7fa878009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:19.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.973+0000 7fa86effd700 1 -- 172.21.15.72:0/2549857814 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87800eed0 con 0x7fa888064db0 2023-08-31T18:49:19.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.973+0000 7fa86effd700 1 -- 172.21.15.72:0/2549857814 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87800c850 con 0x7fa888064db0 2023-08-31T18:49:19.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.973+0000 7fa86effd700 1 -- 172.21.15.72:0/2549857814 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87800cbd0 con 0x7fa888064db0 2023-08-31T18:49:19.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.973+0000 7fa88d5ff700 1 -- 172.21.15.72:0/2549857814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8880c4c60 con 0x7fa888064db0 2023-08-31T18:49:19.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.973+0000 7fa88d5ff700 1 -- 172.21.15.72:0/2549857814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88814ee30 con 0x7fa888064db0 2023-08-31T18:49:19.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.974+0000 7fa88d5ff700 1 -- 172.21.15.72:0/2549857814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88806a7e0 con 0x7fa888064db0 2023-08-31T18:49:19.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.975+0000 7fa86effd700 1 -- 172.21.15.72:0/2549857814 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 8) v1 ==== 75448+0+0 (secure 0 0 0) 0x7fa87801b400 con 0x7fa888064db0 2023-08-31T18:49:19.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.976+0000 7fa86effd700 1 --2- 172.21.15.72:0/2549857814 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa87405f010 0x7fa8740614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T18:49:19.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.976+0000 7fa86effd700 1 -- 172.21.15.72:0/2549857814 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa87807a7a0 con 0x7fa888064db0 2023-08-31T18:49:19.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.976+0000 7fa8867fc700 1 --2- 172.21.15.72:0/2549857814 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa87405f010 0x7fa8740614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T18:49:19.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.977+0000 7fa8867fc700 1 --2- 172.21.15.72:0/2549857814 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa87405f010 0x7fa8740614d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa88814dea0 tx=0x7fa87c0079c0).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T18:49:19.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:19.980+0000 7fa86effd700 1 -- 172.21.15.72:0/2549857814 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa87804b900 con 0x7fa888064db0 2023-08-31T18:49:20.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:20.173+0000 7fa88d5ff700 1 -- 172.21.15.72:0/2549857814 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8880c3e40 con 0x7fa87405f010 2023-08-31T18:49:20.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:20.177+0000 7fa86effd700 1 -- 172.21.15.72:0/2549857814 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa8880c3e40 con 0x7fa87405f010 2023-08-31T18:49:20.178 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-08-31T18:49:20.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:20.180+0000 7fa88d5ff700 1 -- 172.21.15.72:0/2549857814 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa87405f010 msgr2=0x7fa8740614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:20.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:20.180+0000 7fa88d5ff700 1 --2- 172.21.15.72:0/2549857814 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa87405f010 0x7fa8740614d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa88814dea0 tx=0x7fa87c0079c0).stop 2023-08-31T18:49:20.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:20.180+0000 7fa88d5ff700 1 -- 172.21.15.72:0/2549857814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888064db0 msgr2=0x7fa8880c3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T18:49:20.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:20.180+0000 7fa88d5ff700 1 --2- 172.21.15.72:0/2549857814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888064db0 0x7fa8880c3950 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fa87800e930 tx=0x7fa878009060).stop 2023-08-31T18:49:20.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:20.180+0000 7fa88d5ff700 1 -- 172.21.15.72:0/2549857814 shutdown_connections 2023-08-31T18:49:20.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:20.180+0000 7fa88d5ff700 1 --2- 172.21.15.72:0/2549857814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa888154500 0x7fa88814fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:20.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:20.180+0000 7fa88d5ff700 1 --2- 172.21.15.72:0/2549857814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888064db0 0x7fa8880c3950 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:20.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:20.180+0000 7fa88d5ff700 1 --2- 172.21.15.72:0/2549857814 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa87405f010 0x7fa8740614d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T18:49:20.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:20.180+0000 7fa88d5ff700 1 --2- 172.21.15.72:0/2549857814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa888154120 0x7fa8880c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T18:49:20.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:20.180+0000 7fa88d5ff700 1 -- 172.21.15.72:0/2549857814 >> 172.21.15.72:0/2549857814 conn(0x7fa8880cb7e0 msgr2=0x7fa8880c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T18:49:20.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:20.180+0000 7fa88d5ff700 1 -- 172.21.15.72:0/2549857814 shutdown_connections 2023-08-31T18:49:20.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T18:49:20.180+0000 7fa88d5ff700 1 -- 172.21.15.72:0/2549857814 wait complete. 2023-08-31T18:49:20.197 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-08-31T18:49:49.181 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:49:49.187 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:50:00.145 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:50:00.144+0000 7ff1beda5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T18:50:00.145 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:50:00.144+0000 7ff1beda5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T18:50:00.145 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:50:00.144+0000 7ff1beda5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T18:50:00.146 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:50:00.144+0000 7ff1beda5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T18:50:00.146 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T18:50:00.144+0000 7ff1beda5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T18:50:19.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:50:19.375 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:50:49.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:50:49.587 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:51:19.694 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:51:19.700 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:51:49.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:51:49.881 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:52:20.062 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:52:20.068 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:52:50.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:52:50.258 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:53:20.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:53:20.437 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:53:50.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:53:50.557 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:54:20.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:54:20.754 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:54:50.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:54:50.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:55:21.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:55:21.147 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:55:51.287 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:55:51.293 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:56:21.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:56:21.490 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:56:51.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:56:51.661 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:57:22.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:57:22.033 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:57:52.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:57:52.238 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:58:22.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:58:22.409 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:58:52.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:58:52.589 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:59:22.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:59:22.710 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:59:52.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T18:59:52.899 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:00:20.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-08-31T19:00:20.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.407+0000 7fc8cf9ff700 1 Processor -- start 2023-08-31T19:00:20.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.407+0000 7fc8cf9ff700 1 -- start start 2023-08-31T19:00:20.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.408+0000 7fc8cf9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8c8064d70 0x7fc8c81553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.408+0000 7fc8cf9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c8154f40 con 0x7fc8c80c5370 2023-08-31T19:00:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.408+0000 7fc8cf9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c8154960 con 0x7fc8c8151da0 2023-08-31T19:00:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.408+0000 7fc8cf9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80c57e0 con 0x7fc8c8064d70 2023-08-31T19:00:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.408+0000 7fc8cdf9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc8c80c5370 0x7fc8c80bfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39348/0 (socket says 172.21.15.72:39348) 2023-08-31T19:00:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.408+0000 7fc8cdf9c700 1 -- 172.21.15.72:0/2000597008 learned_addr learned my addr 172.21.15.72:0/2000597008 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:20.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8ccf9a700 1 --2- 172.21.15.72:0/2000597008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8c8064d70 0x7fc8c81553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497114075 0 0) 0x7fc8c8154f40 con 0x7fc8c80c5370 2023-08-31T19:00:20.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8b40033f0 con 0x7fc8c80c5370 2023-08-31T19:00:20.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185939870 0 0) 0x7fc8c8154960 con 0x7fc8c8151da0 2023-08-31T19:00:20.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c8154f40 con 0x7fc8c8151da0 2023-08-31T19:00:20.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 522099257 0 0) 0x7fc8b40033f0 con 0x7fc8c80c5370 2023-08-31T19:00:20.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8c8064d70 msgr2=0x7fc8c81553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:20.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 --2- 172.21.15.72:0/2000597008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8c8064d70 0x7fc8c81553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:20.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 >> v1:172.21.15.146:6789/0 conn(0x7fc8c8151da0 legacy=0x7fc8c8064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c80aa2c0 con 0x7fc8c80c5370 2023-08-31T19:00:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fc8c00017f0 con 0x7fc8c80c5370 2023-08-31T19:00:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 >> v1:172.21.15.72:6789/0 conn(0x7fc8c80c5370 legacy=0x7fc8c80bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 --2- 172.21.15.72:0/2000597008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8b4003aa0 0x7fc8b4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 --2- 172.21.15.72:0/2000597008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8c8064d70 0x7fc8b4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 --2- 172.21.15.72:0/2000597008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b4004b80 0x7fc8b4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b400b8e0 con 0x7fc8b4003aa0 2023-08-31T19:00:20.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b400ba50 con 0x7fc8b4004b80 2023-08-31T19:00:20.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.409+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b400bc10 con 0x7fc8c8064d70 2023-08-31T19:00:20.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.410+0000 7fc8cd79b700 1 --2- 172.21.15.72:0/2000597008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8b4003aa0 0x7fc8b4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.410+0000 7fc8cdf9c700 1 --2- 172.21.15.72:0/2000597008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b4004b80 0x7fc8b4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.410+0000 7fc8ccf9a700 1 --2- 172.21.15.72:0/2000597008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8c8064d70 0x7fc8b4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.410+0000 7fc8cd79b700 1 -- 172.21.15.72:0/2000597008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8c8064d70 msgr2=0x7fc8b4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:20.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.410+0000 7fc8cd79b700 1 --2- 172.21.15.72:0/2000597008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8c8064d70 0x7fc8b4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:20.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.410+0000 7fc8cd79b700 1 -- 172.21.15.72:0/2000597008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b4004b80 msgr2=0x7fc8b4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:20.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.410+0000 7fc8cd79b700 1 --2- 172.21.15.72:0/2000597008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b4004b80 0x7fc8b4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:20.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.410+0000 7fc8cd79b700 1 -- 172.21.15.72:0/2000597008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b40033f0 con 0x7fc8b4003aa0 2023-08-31T19:00:20.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.410+0000 7fc8cdf9c700 1 --2- 172.21.15.72:0/2000597008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8b4004b80 0x7fc8b4005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:20.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.410+0000 7fc8ccf9a700 1 --2- 172.21.15.72:0/2000597008 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8c8064d70 0x7fc8b4004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:20.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.410+0000 7fc8cd79b700 1 --2- 172.21.15.72:0/2000597008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8b4003aa0 0x7fc8b4003ea0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fc8c4001890 tx=0x7fc8c4007bb0).ready entity=mon.0 client_cookie=15c235532b6d7c9c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:20.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.410+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4007020 con 0x7fc8b4003aa0 2023-08-31T19:00:20.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.410+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c4007180 con 0x7fc8b4003aa0 2023-08-31T19:00:20.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.410+0000 7fc8bffff700 1 -- 172.21.15.72:0/2000597008 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4007500 con 0x7fc8b4003aa0 2023-08-31T19:00:20.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.411+0000 7fc8cf9ff700 1 -- 172.21.15.72:0/2000597008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8b4003aa0 msgr2=0x7fc8b4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:20.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.411+0000 7fc8cf9ff700 1 --2- 172.21.15.72:0/2000597008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8b4003aa0 0x7fc8b4003ea0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fc8c4001890 tx=0x7fc8c4007bb0).stop 2023-08-31T19:00:20.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.411+0000 7fc8cdf9c700 1 -- 172.21.15.72:0/2000597008 reap_dead start 2023-08-31T19:00:20.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.411+0000 7fc8cf9ff700 1 -- 172.21.15.72:0/2000597008 shutdown_connections 2023-08-31T19:00:20.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.411+0000 7fc8cf9ff700 1 -- 172.21.15.72:0/2000597008 >> 172.21.15.72:0/2000597008 conn(0x7fc8c8063a90 msgr2=0x7fc8c80cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:20.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.411+0000 7fc8cf9ff700 1 -- 172.21.15.72:0/2000597008 shutdown_connections 2023-08-31T19:00:20.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.411+0000 7fc8cf9ff700 1 -- 172.21.15.72:0/2000597008 wait complete. 2023-08-31T19:00:20.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.413+0000 7fc8cf9ff700 1 Processor -- start 2023-08-31T19:00:20.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.413+0000 7fc8cf9ff700 1 -- start start 2023-08-31T19:00:20.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cf9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8b4003aa0 0x7fc8c8140600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cf9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8c80aed10 0x7fc8c80c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cf9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c8140af0 0x7fc8c80c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cf9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80c4bf0 con 0x7fc8b4003aa0 2023-08-31T19:00:20.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cf9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80add00 con 0x7fc8c8140af0 2023-08-31T19:00:20.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cf9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80ae880 con 0x7fc8c80aed10 2023-08-31T19:00:20.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cd79b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8b4003aa0 0x7fc8c8140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cd79b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8b4003aa0 0x7fc8c8140600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58044/0 (socket says 172.21.15.72:58044) 2023-08-31T19:00:20.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cd79b700 1 -- 172.21.15.72:0/3270665296 learned_addr learned my addr 172.21.15.72:0/3270665296 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:20.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8ccf9a700 1 --2- 172.21.15.72:0/3270665296 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8c80aed10 0x7fc8c80c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cdf9c700 1 --2- 172.21.15.72:0/3270665296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c8140af0 0x7fc8c80c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cd79b700 1 -- 172.21.15.72:0/3270665296 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8c80aed10 msgr2=0x7fc8c80c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:20.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cd79b700 1 --2- 172.21.15.72:0/3270665296 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8c80aed10 0x7fc8c80c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:20.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cd79b700 1 -- 172.21.15.72:0/3270665296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c8140af0 msgr2=0x7fc8c80c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:20.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cd79b700 1 --2- 172.21.15.72:0/3270665296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c8140af0 0x7fc8c80c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:20.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cd79b700 1 -- 172.21.15.72:0/3270665296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c80adf50 con 0x7fc8b4003aa0 2023-08-31T19:00:20.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.414+0000 7fc8cd79b700 1 --2- 172.21.15.72:0/3270665296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8b4003aa0 0x7fc8c8140600 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7fc8c4001e80 tx=0x7fc8c4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:20.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.415+0000 7fc8bd7fa700 1 -- 172.21.15.72:0/3270665296 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c401e440 con 0x7fc8b4003aa0 2023-08-31T19:00:20.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.415+0000 7fc8bd7fa700 1 -- 172.21.15.72:0/3270665296 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c401e5a0 con 0x7fc8b4003aa0 2023-08-31T19:00:20.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.415+0000 7fc8bd7fa700 1 -- 172.21.15.72:0/3270665296 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c401e960 con 0x7fc8b4003aa0 2023-08-31T19:00:20.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.415+0000 7fc8cf9ff700 1 -- 172.21.15.72:0/3270665296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c80ae230 con 0x7fc8b4003aa0 2023-08-31T19:00:20.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.415+0000 7fc8cf9ff700 1 -- 172.21.15.72:0/3270665296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c80af960 con 0x7fc8b4003aa0 2023-08-31T19:00:20.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.416+0000 7fc8cf9ff700 1 -- 172.21.15.72:0/3270665296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c80aeb60 con 0x7fc8b4003aa0 2023-08-31T19:00:20.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.417+0000 7fc8bd7fa700 1 -- 172.21.15.72:0/3270665296 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fc8c401ed50 con 0x7fc8b4003aa0 2023-08-31T19:00:20.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.418+0000 7fc8bd7fa700 1 --2- 172.21.15.72:0/3270665296 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc8ac05ef80 0x7fc8ac061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.418+0000 7fc8bd7fa700 1 -- 172.21.15.72:0/3270665296 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fc8c407b050 con 0x7fc8b4003aa0 2023-08-31T19:00:20.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.418+0000 7fc8ccf9a700 1 --2- 172.21.15.72:0/3270665296 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc8ac05ef80 0x7fc8ac061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.418+0000 7fc8ccf9a700 1 --2- 172.21.15.72:0/3270665296 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc8ac05ef80 0x7fc8ac061440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc8b8009270 tx=0x7fc8b8008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:20.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.422+0000 7fc8bd7fa700 1 -- 172.21.15.72:0/3270665296 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc8c404c210 con 0x7fc8b4003aa0 2023-08-31T19:00:20.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.616+0000 7fc8cf9ff700 1 -- 172.21.15.72:0/3270665296 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8c806a7e0 con 0x7fc8ac05ef80 2023-08-31T19:00:20.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.620+0000 7fc8bd7fa700 1 -- 172.21.15.72:0/3270665296 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc8c806a7e0 con 0x7fc8ac05ef80 2023-08-31T19:00:20.620 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-08-31T19:00:20.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.622+0000 7fc8cf9ff700 1 -- 172.21.15.72:0/3270665296 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc8ac05ef80 msgr2=0x7fc8ac061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:20.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.622+0000 7fc8cf9ff700 1 --2- 172.21.15.72:0/3270665296 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc8ac05ef80 0x7fc8ac061440 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc8b8009270 tx=0x7fc8b8008040).stop 2023-08-31T19:00:20.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.622+0000 7fc8cf9ff700 1 -- 172.21.15.72:0/3270665296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8b4003aa0 msgr2=0x7fc8c8140600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:20.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.622+0000 7fc8cf9ff700 1 --2- 172.21.15.72:0/3270665296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8b4003aa0 0x7fc8c8140600 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7fc8c4001e80 tx=0x7fc8c4016000).stop 2023-08-31T19:00:20.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.622+0000 7fc8cf9ff700 1 -- 172.21.15.72:0/3270665296 shutdown_connections 2023-08-31T19:00:20.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.622+0000 7fc8cf9ff700 1 --2- 172.21.15.72:0/3270665296 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc8ac05ef80 0x7fc8ac061440 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:20.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.622+0000 7fc8cf9ff700 1 --2- 172.21.15.72:0/3270665296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c8140af0 0x7fc8c80c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:20.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.622+0000 7fc8cf9ff700 1 --2- 172.21.15.72:0/3270665296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8b4003aa0 0x7fc8c8140600 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:20.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.622+0000 7fc8cf9ff700 1 --2- 172.21.15.72:0/3270665296 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8c80aed10 0x7fc8c80c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:20.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.622+0000 7fc8cf9ff700 1 -- 172.21.15.72:0/3270665296 >> 172.21.15.72:0/3270665296 conn(0x7fc8c8063a90 msgr2=0x7fc8c814d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:20.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.622+0000 7fc8cf9ff700 1 -- 172.21.15.72:0/3270665296 shutdown_connections 2023-08-31T19:00:20.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.622+0000 7fc8cf9ff700 1 -- 172.21.15.72:0/3270665296 wait complete. 2023-08-31T19:00:20.640 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-08-31T19:00:20.640 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-08-31T19:00:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.836+0000 7f18a6fff700 1 Processor -- start 2023-08-31T19:00:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.836+0000 7f18a6fff700 1 -- start start 2023-08-31T19:00:20.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.837+0000 7f18a6fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18a0151da0 0x7f18a01553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.837+0000 7f18a6fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a0154f40 con 0x7f18a0064d70 2023-08-31T19:00:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.837+0000 7f18a6fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a0154960 con 0x7f18a00c5370 2023-08-31T19:00:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.837+0000 7f18a6fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a00aa2c0 con 0x7f18a0151da0 2023-08-31T19:00:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f18a559c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f18a0064d70 0x7f18a00bfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39356/0 (socket says 172.21.15.72:39356) 2023-08-31T19:00:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f18a559c700 1 -- 172.21.15.72:0/1812307032 learned_addr learned my addr 172.21.15.72:0/1812307032 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f18a4d9b700 1 --2- 172.21.15.72:0/1812307032 >> v2:172.21.15.146:3300/0 conn(0x7f18a0151da0 0x7f18a01553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f189f7fe700 1 -- 172.21.15.72:0/1812307032 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836875715 0 0) 0x7f18a0154f40 con 0x7f18a0064d70 2023-08-31T19:00:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f189f7fe700 1 -- 172.21.15.72:0/1812307032 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18900033f0 con 0x7f18a0064d70 2023-08-31T19:00:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f189f7fe700 1 -- 172.21.15.72:0/1812307032 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1707234178 0 0) 0x7f18900033f0 con 0x7f18a0064d70 2023-08-31T19:00:20.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f189f7fe700 1 -- 172.21.15.72:0/1812307032 >> v2:172.21.15.146:3300/0 conn(0x7f18a0151da0 msgr2=0x7f18a01553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f189f7fe700 1 --2- 172.21.15.72:0/1812307032 >> v2:172.21.15.146:3300/0 conn(0x7f18a0151da0 0x7f18a01553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f189f7fe700 1 -- 172.21.15.72:0/1812307032 >> v1:172.21.15.146:6789/0 conn(0x7f18a00c5370 legacy=0x7f18a0064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f189f7fe700 1 -- 172.21.15.72:0/1812307032 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a0154bd0 con 0x7f18a0064d70 2023-08-31T19:00:20.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f189f7fe700 1 -- 172.21.15.72:0/1812307032 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f18980017f0 con 0x7f18a0064d70 2023-08-31T19:00:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f18a4d9b700 1 --2- 172.21.15.72:0/1812307032 >> v2:172.21.15.146:3300/0 conn(0x7f18a0151da0 0x7f18a01553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:00:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f189f7fe700 1 -- 172.21.15.72:0/1812307032 >> v1:172.21.15.72:6789/0 conn(0x7f18a0064d70 legacy=0x7f18a00bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f189f7fe700 1 --2- 172.21.15.72:0/1812307032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900038e0 0x7f1890003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f189f7fe700 1 --2- 172.21.15.72:0/1812307032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1890004690 0x7f1890004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.838+0000 7f189f7fe700 1 --2- 172.21.15.72:0/1812307032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1890005000 0x7f189000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.839+0000 7f189f7fe700 1 -- 172.21.15.72:0/1812307032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00aa2c0 con 0x7f18900038e0 2023-08-31T19:00:20.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.839+0000 7f189f7fe700 1 -- 172.21.15.72:0/1812307032 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189000be00 con 0x7f1890005000 2023-08-31T19:00:20.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.839+0000 7f189f7fe700 1 -- 172.21.15.72:0/1812307032 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189000bfc0 con 0x7f1890004690 2023-08-31T19:00:20.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.839+0000 7f18a4d9b700 1 --2- 172.21.15.72:0/1812307032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900038e0 0x7f1890003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.839+0000 7f18a559c700 1 --2- 172.21.15.72:0/1812307032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1890005000 0x7f189000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.839+0000 7f189ffff700 1 --2- 172.21.15.72:0/1812307032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1890004690 0x7f1890004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.839+0000 7f18a4d9b700 1 -- 172.21.15.72:0/1812307032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1890004690 msgr2=0x7f1890004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:20.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.839+0000 7f18a4d9b700 1 --2- 172.21.15.72:0/1812307032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1890004690 0x7f1890004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:20.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.839+0000 7f18a4d9b700 1 -- 172.21.15.72:0/1812307032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1890005000 msgr2=0x7f189000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:20.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.839+0000 7f18a4d9b700 1 --2- 172.21.15.72:0/1812307032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1890005000 0x7f189000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:20.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.839+0000 7f18a4d9b700 1 -- 172.21.15.72:0/1812307032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18900033f0 con 0x7f18900038e0 2023-08-31T19:00:20.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.839+0000 7f18a559c700 1 --2- 172.21.15.72:0/1812307032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1890005000 0x7f189000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:20.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.839+0000 7f18a559c700 1 -- 172.21.15.72:0/1812307032 reap_dead start 2023-08-31T19:00:20.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.839+0000 7f18a4d9b700 1 --2- 172.21.15.72:0/1812307032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900038e0 0x7f1890003cc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f1894009c70 tx=0x7f1894009060).ready entity=mon.0 client_cookie=514a25be70c0be8c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:20.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.839+0000 7f189f7fe700 1 -- 172.21.15.72:0/1812307032 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18940095c0 con 0x7f18900038e0 2023-08-31T19:00:20.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.840+0000 7f189f7fe700 1 -- 172.21.15.72:0/1812307032 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189400e6f0 con 0x7f18900038e0 2023-08-31T19:00:20.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.840+0000 7f189f7fe700 1 -- 172.21.15.72:0/1812307032 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189400ea70 con 0x7f18900038e0 2023-08-31T19:00:20.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.840+0000 7f18a6fff700 1 -- 172.21.15.72:0/1812307032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900038e0 msgr2=0x7f1890003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:20.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.840+0000 7f18a6fff700 1 --2- 172.21.15.72:0/1812307032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900038e0 0x7f1890003cc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f1894009c70 tx=0x7f1894009060).stop 2023-08-31T19:00:20.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.840+0000 7f18a6fff700 1 -- 172.21.15.72:0/1812307032 shutdown_connections 2023-08-31T19:00:20.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.840+0000 7f18a6fff700 1 --2- 172.21.15.72:0/1812307032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18900038e0 0x7f1890003cc0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:20.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.840+0000 7f18a6fff700 1 -- 172.21.15.72:0/1812307032 >> 172.21.15.72:0/1812307032 conn(0x7f18a0063a90 msgr2=0x7f18a00cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:20.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.840+0000 7f18a6fff700 1 -- 172.21.15.72:0/1812307032 shutdown_connections 2023-08-31T19:00:20.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.840+0000 7f18a6fff700 1 -- 172.21.15.72:0/1812307032 wait complete. 2023-08-31T19:00:20.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.841+0000 7f18a6fff700 1 Processor -- start 2023-08-31T19:00:20.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.842+0000 7f18a6fff700 1 -- start start 2023-08-31T19:00:20.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.842+0000 7f18a6fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18900038e0 0x7f18a0164e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f18a6fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a0165340 0x7f18a013e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f18a6fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18a013e610 0x7f18a0166c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f18a6fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a01667a0 con 0x7f18a013e610 2023-08-31T19:00:20.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f18a6fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a0165b90 con 0x7f18a0165340 2023-08-31T19:00:20.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f18a6fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a0165e70 con 0x7f18900038e0 2023-08-31T19:00:20.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f18a559c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18a013e610 0x7f18a0166c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f18a559c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18a013e610 0x7f18a0166c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58066/0 (socket says 172.21.15.72:58066) 2023-08-31T19:00:20.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f18a559c700 1 -- 172.21.15.72:0/589765950 learned_addr learned my addr 172.21.15.72:0/589765950 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:20.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f189ffff700 1 --2- 172.21.15.72:0/589765950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a0165340 0x7f18a013e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f18a4d9b700 1 --2- 172.21.15.72:0/589765950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18900038e0 0x7f18a0164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f18a559c700 1 -- 172.21.15.72:0/589765950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18900038e0 msgr2=0x7f18a0164e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:20.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f18a559c700 1 --2- 172.21.15.72:0/589765950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18900038e0 0x7f18a0164e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:20.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f18a559c700 1 -- 172.21.15.72:0/589765950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a0165340 msgr2=0x7f18a013e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:20.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f18a559c700 1 --2- 172.21.15.72:0/589765950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a0165340 0x7f18a013e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:20.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f18a559c700 1 -- 172.21.15.72:0/589765950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a0166150 con 0x7f18a013e610 2023-08-31T19:00:20.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.843+0000 7f18a559c700 1 --2- 172.21.15.72:0/589765950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18a013e610 0x7f18a0166c30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f18a0083830 tx=0x7f1898007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:20.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.844+0000 7f189cff9700 1 -- 172.21.15.72:0/589765950 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898010520 con 0x7f18a013e610 2023-08-31T19:00:20.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.844+0000 7f189cff9700 1 -- 172.21.15.72:0/589765950 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18980106a0 con 0x7f18a013e610 2023-08-31T19:00:20.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.844+0000 7f189cff9700 1 -- 172.21.15.72:0/589765950 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898010a60 con 0x7f18a013e610 2023-08-31T19:00:20.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.844+0000 7f18a6fff700 1 -- 172.21.15.72:0/589765950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a0166430 con 0x7f18a013e610 2023-08-31T19:00:20.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.844+0000 7f18a6fff700 1 -- 172.21.15.72:0/589765950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a0167120 con 0x7f18a013e610 2023-08-31T19:00:20.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.845+0000 7f18a6fff700 1 -- 172.21.15.72:0/589765950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a006a7e0 con 0x7f18a013e610 2023-08-31T19:00:20.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.846+0000 7f189cff9700 1 -- 172.21.15.72:0/589765950 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f1898014430 con 0x7f18a013e610 2023-08-31T19:00:20.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.846+0000 7f189cff9700 1 --2- 172.21.15.72:0/589765950 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f188405ef80 0x7f1884061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:20.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.847+0000 7f189cff9700 1 -- 172.21.15.72:0/589765950 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f1898079f70 con 0x7f18a013e610 2023-08-31T19:00:20.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.847+0000 7f18a4d9b700 1 --2- 172.21.15.72:0/589765950 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f188405ef80 0x7f1884061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.847+0000 7f18a4d9b700 1 --2- 172.21.15.72:0/589765950 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f188405ef80 0x7f1884061440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f18a00b0eb0 tx=0x7f189401a000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:20.851+0000 7f189cff9700 1 -- 172.21.15.72:0/589765950 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f18980498f0 con 0x7f18a013e610 2023-08-31T19:00:21.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.044+0000 7f18a6fff700 1 -- 172.21.15.72:0/589765950 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f18a0165980 con 0x7f188405ef80 2023-08-31T19:00:21.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.048+0000 7f189cff9700 1 -- 172.21.15.72:0/589765950 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f18a0165980 con 0x7f188405ef80 2023-08-31T19:00:21.049 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-08-31T19:00:21.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.050+0000 7f18a6fff700 1 -- 172.21.15.72:0/589765950 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f188405ef80 msgr2=0x7f1884061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:21.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.050+0000 7f18a6fff700 1 --2- 172.21.15.72:0/589765950 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f188405ef80 0x7f1884061440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f18a00b0eb0 tx=0x7f189401a000).stop 2023-08-31T19:00:21.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.050+0000 7f18a6fff700 1 -- 172.21.15.72:0/589765950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18a013e610 msgr2=0x7f18a0166c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:21.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.050+0000 7f18a6fff700 1 --2- 172.21.15.72:0/589765950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18a013e610 0x7f18a0166c30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f18a0083830 tx=0x7f1898007df0).stop 2023-08-31T19:00:21.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.050+0000 7f18a6fff700 1 -- 172.21.15.72:0/589765950 shutdown_connections 2023-08-31T19:00:21.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.050+0000 7f18a6fff700 1 --2- 172.21.15.72:0/589765950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18a013e610 0x7f18a0166c30 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.050+0000 7f18a6fff700 1 --2- 172.21.15.72:0/589765950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18900038e0 0x7f18a0164e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.050+0000 7f18a6fff700 1 --2- 172.21.15.72:0/589765950 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f188405ef80 0x7f1884061440 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.050+0000 7f18a6fff700 1 --2- 172.21.15.72:0/589765950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a0165340 0x7f18a013e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.050+0000 7f18a6fff700 1 -- 172.21.15.72:0/589765950 >> 172.21.15.72:0/589765950 conn(0x7f18a0063a90 msgr2=0x7f18a00ab0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.051+0000 7f18a6fff700 1 -- 172.21.15.72:0/589765950 shutdown_connections 2023-08-31T19:00:21.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.051+0000 7f18a6fff700 1 -- 172.21.15.72:0/589765950 wait complete. 2023-08-31T19:00:21.068 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-08-31T19:00:21.068 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-08-31T19:00:21.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.261+0000 7f678c9ff700 1 Processor -- start 2023-08-31T19:00:21.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.261+0000 7f678c9ff700 1 -- start start 2023-08-31T19:00:21.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.262+0000 7f678c9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6788154120 0x7f67880a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:21.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.262+0000 7f678c9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67880aa620 con 0x7f6788064db0 2023-08-31T19:00:21.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.262+0000 7f678c9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67880aa3a0 con 0x7f6788154500 2023-08-31T19:00:21.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.262+0000 7f678c9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67880c5450 con 0x7f6788154120 2023-08-31T19:00:21.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.262+0000 7f6786d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6788064db0 0x7f678815dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39372/0 (socket says 172.21.15.72:39372) 2023-08-31T19:00:21.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.262+0000 7f6786d9d700 1 -- 172.21.15.72:0/3319891287 learned_addr learned my addr 172.21.15.72:0/3319891287 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:21.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.263+0000 7f678659c700 1 --2- 172.21.15.72:0/3319891287 >> v2:172.21.15.146:3300/0 conn(0x7f6788154120 0x7f67880a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:21.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.263+0000 7f678559a700 1 -- 172.21.15.72:0/3319891287 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491075176 0 0) 0x7f67880aa620 con 0x7f6788064db0 2023-08-31T19:00:21.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.263+0000 7f678559a700 1 -- 172.21.15.72:0/3319891287 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67700033f0 con 0x7f6788064db0 2023-08-31T19:00:21.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.263+0000 7f678559a700 1 -- 172.21.15.72:0/3319891287 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13037583 0 0) 0x7f67880aa3a0 con 0x7f6788154500 2023-08-31T19:00:21.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.263+0000 7f678659c700 1 -- 172.21.15.72:0/3319891287 >> v1:172.21.15.146:6789/0 conn(0x7f6788154500 legacy=0x7f67880646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:21.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.263+0000 7f678659c700 1 -- 172.21.15.72:0/3319891287 >> v1:172.21.15.72:6789/0 conn(0x7f6788064db0 legacy=0x7f678815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:21.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.263+0000 7f678659c700 1 -- 172.21.15.72:0/3319891287 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67880c8050 con 0x7f6788154120 2023-08-31T19:00:21.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.263+0000 7f678659c700 1 --2- 172.21.15.72:0/3319891287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6788154120 0x7f67880a9eb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f6778009760 tx=0x7f6778009060).ready entity=mon.1 client_cookie=a11df1db656dacc2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:21.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.264+0000 7f678559a700 1 -- 172.21.15.72:0/3319891287 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67800017f0 con 0x7f6788154120 2023-08-31T19:00:21.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.264+0000 7f678559a700 1 -- 172.21.15.72:0/3319891287 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6778009130 con 0x7f6788154120 2023-08-31T19:00:21.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.264+0000 7f678559a700 1 -- 172.21.15.72:0/3319891287 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778012620 con 0x7f6788154120 2023-08-31T19:00:21.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.264+0000 7f678c9ff700 1 -- 172.21.15.72:0/3319891287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6788154120 msgr2=0x7f67880a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:21.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.264+0000 7f678c9ff700 1 --2- 172.21.15.72:0/3319891287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6788154120 0x7f67880a9eb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f6778009760 tx=0x7f6778009060).stop 2023-08-31T19:00:21.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.264+0000 7f678c9ff700 1 -- 172.21.15.72:0/3319891287 shutdown_connections 2023-08-31T19:00:21.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.264+0000 7f678c9ff700 1 --2- 172.21.15.72:0/3319891287 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6788154120 0x7f67880a9eb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.264+0000 7f678c9ff700 1 -- 172.21.15.72:0/3319891287 >> 172.21.15.72:0/3319891287 conn(0x7f67880cb7e0 msgr2=0x7f67880c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:21.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.264+0000 7f678c9ff700 1 -- 172.21.15.72:0/3319891287 shutdown_connections 2023-08-31T19:00:21.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.264+0000 7f678c9ff700 1 -- 172.21.15.72:0/3319891287 wait complete. 2023-08-31T19:00:21.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.266+0000 7f678c9ff700 1 Processor -- start 2023-08-31T19:00:21.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.266+0000 7f678c9ff700 1 -- start start 2023-08-31T19:00:21.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.267+0000 7f678c9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6788064db0 0x7f678814c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:21.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.267+0000 7f678c9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6788154120 0x7f6788156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:21.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.267+0000 7f678c9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6788154500 0x7f6788156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:21.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.267+0000 7f678c9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6788157410 con 0x7f6788154120 2023-08-31T19:00:21.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.267+0000 7f678c9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67880c95c0 con 0x7f6788064db0 2023-08-31T19:00:21.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.267+0000 7f678c9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67880c8cd0 con 0x7f6788154500 2023-08-31T19:00:21.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.267+0000 7f6785d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6788154120 0x7f6788156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:21.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.267+0000 7f6785d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6788154120 0x7f6788156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58074/0 (socket says 172.21.15.72:58074) 2023-08-31T19:00:21.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.267+0000 7f6785d9b700 1 -- 172.21.15.72:0/1023132885 learned_addr learned my addr 172.21.15.72:0/1023132885 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:21.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.267+0000 7f678659c700 1 --2- 172.21.15.72:0/1023132885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6788064db0 0x7f678814c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:21.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.267+0000 7f6786d9d700 1 --2- 172.21.15.72:0/1023132885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6788154500 0x7f6788156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:21.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.267+0000 7f6785d9b700 1 -- 172.21.15.72:0/1023132885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6788154500 msgr2=0x7f6788156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:21.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.267+0000 7f6785d9b700 1 --2- 172.21.15.72:0/1023132885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6788154500 0x7f6788156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.268+0000 7f6785d9b700 1 -- 172.21.15.72:0/1023132885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6788064db0 msgr2=0x7f678814c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:21.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.268+0000 7f6785d9b700 1 --2- 172.21.15.72:0/1023132885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6788064db0 0x7f678814c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.268+0000 7f6785d9b700 1 -- 172.21.15.72:0/1023132885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67780092a0 con 0x7f6788154120 2023-08-31T19:00:21.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.268+0000 7f678659c700 1 --2- 172.21.15.72:0/1023132885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6788064db0 0x7f678814c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:21.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.268+0000 7f6785d9b700 1 --2- 172.21.15.72:0/1023132885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6788154120 0x7f6788156a30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f677c001eb0 tx=0x7f677c007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:21.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.268+0000 7f67767fc700 1 -- 172.21.15.72:0/1023132885 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c00f470 con 0x7f6788154120 2023-08-31T19:00:21.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.268+0000 7f67767fc700 1 -- 172.21.15.72:0/1023132885 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c00f5f0 con 0x7f6788154120 2023-08-31T19:00:21.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.268+0000 7f67767fc700 1 -- 172.21.15.72:0/1023132885 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c00f9b0 con 0x7f6788154120 2023-08-31T19:00:21.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.268+0000 7f678c9ff700 1 -- 172.21.15.72:0/1023132885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67880c8f70 con 0x7f6788154120 2023-08-31T19:00:21.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.268+0000 7f678c9ff700 1 -- 172.21.15.72:0/1023132885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67880c2a40 con 0x7f6788154120 2023-08-31T19:00:21.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.269+0000 7f678c9ff700 1 -- 172.21.15.72:0/1023132885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67880c9770 con 0x7f6788154120 2023-08-31T19:00:21.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.270+0000 7f67767fc700 1 -- 172.21.15.72:0/1023132885 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f677c00fd20 con 0x7f6788154120 2023-08-31T19:00:21.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.271+0000 7f67767fc700 1 --2- 172.21.15.72:0/1023132885 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f676805ef50 0x7f6768061410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:21.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.271+0000 7f67767fc700 1 -- 172.21.15.72:0/1023132885 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f677c0797d0 con 0x7f6788154120 2023-08-31T19:00:21.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.271+0000 7f678659c700 1 --2- 172.21.15.72:0/1023132885 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f676805ef50 0x7f6768061410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:21.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.272+0000 7f678659c700 1 --2- 172.21.15.72:0/1023132885 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f676805ef50 0x7f6768061410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6778009630 tx=0x7f6778015000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:21.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.275+0000 7f67767fc700 1 -- 172.21.15.72:0/1023132885 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f67880c9770 con 0x7f6788154120 2023-08-31T19:00:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.470+0000 7f678c9ff700 1 -- 172.21.15.72:0/1023132885 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f678806a7e0 con 0x7f676805ef50 2023-08-31T19:00:21.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.474+0000 7f67767fc700 1 -- 172.21.15.72:0/1023132885 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f678806a7e0 con 0x7f676805ef50 2023-08-31T19:00:21.475 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-08-31T19:00:21.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.476+0000 7f678c9ff700 1 -- 172.21.15.72:0/1023132885 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f676805ef50 msgr2=0x7f6768061410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:21.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.476+0000 7f678c9ff700 1 --2- 172.21.15.72:0/1023132885 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f676805ef50 0x7f6768061410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6778009630 tx=0x7f6778015000).stop 2023-08-31T19:00:21.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.476+0000 7f678c9ff700 1 -- 172.21.15.72:0/1023132885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6788154120 msgr2=0x7f6788156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:21.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.476+0000 7f678c9ff700 1 --2- 172.21.15.72:0/1023132885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6788154120 0x7f6788156a30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f677c001eb0 tx=0x7f677c007c40).stop 2023-08-31T19:00:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.476+0000 7f678c9ff700 1 -- 172.21.15.72:0/1023132885 shutdown_connections 2023-08-31T19:00:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.476+0000 7f678c9ff700 1 --2- 172.21.15.72:0/1023132885 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6788154500 0x7f6788156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.476+0000 7f678c9ff700 1 --2- 172.21.15.72:0/1023132885 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f676805ef50 0x7f6768061410 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.477+0000 7f678c9ff700 1 --2- 172.21.15.72:0/1023132885 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6788064db0 0x7f678814c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.477+0000 7f678c9ff700 1 --2- 172.21.15.72:0/1023132885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6788154120 0x7f6788156a30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.477+0000 7f678c9ff700 1 -- 172.21.15.72:0/1023132885 >> 172.21.15.72:0/1023132885 conn(0x7f67880cb7e0 msgr2=0x7f678815a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.477+0000 7f678c9ff700 1 -- 172.21.15.72:0/1023132885 shutdown_connections 2023-08-31T19:00:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.477+0000 7f678c9ff700 1 -- 172.21.15.72:0/1023132885 wait complete. 2023-08-31T19:00:21.493 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-08-31T19:00:21.494 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-08-31T19:00:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.688+0000 7fbd5e5ff700 1 Processor -- start 2023-08-31T19:00:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.689+0000 7fbd5e5ff700 1 -- start start 2023-08-31T19:00:21.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.690+0000 7fbd5e5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd58154120 0x7fbd580a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:21.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.690+0000 7fbd5e5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbd58154500 0x7fbd580646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:21.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.690+0000 7fbd5e5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd580aa620 con 0x7fbd58064b90 2023-08-31T19:00:21.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.690+0000 7fbd5e5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd58065020 con 0x7fbd58154500 2023-08-31T19:00:21.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.690+0000 7fbd5e5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd580aa3a0 con 0x7fbd58154120 2023-08-31T19:00:21.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.690+0000 7fbd577fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbd58154500 0x7fbd580646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:21.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.690+0000 7fbd577fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbd58154500 0x7fbd580646a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58084/0 (socket says 172.21.15.72:58084) 2023-08-31T19:00:21.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.690+0000 7fbd577fe700 1 -- 172.21.15.72:0/1867339216 learned_addr learned my addr 172.21.15.72:0/1867339216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:21.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.690+0000 7fbd57fff700 1 --2- 172.21.15.72:0/1867339216 >> v2:172.21.15.146:3300/0 conn(0x7fbd58154120 0x7fbd580a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:21.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.690+0000 7fbd577fe700 1 -- 172.21.15.72:0/1867339216 >> v2:172.21.15.146:3300/0 conn(0x7fbd58154120 msgr2=0x7fbd580a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:21.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.690+0000 7fbd577fe700 1 --2- 172.21.15.72:0/1867339216 >> v2:172.21.15.146:3300/0 conn(0x7fbd58154120 0x7fbd580a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.691+0000 7fbd577fe700 1 -- 172.21.15.72:0/1867339216 >> v1:172.21.15.146:6789/0 conn(0x7fbd58064b90 legacy=0x7fbd580c0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:21.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.691+0000 7fbd577fe700 1 -- 172.21.15.72:0/1867339216 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd580c5450 con 0x7fbd58154500 2023-08-31T19:00:21.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.691+0000 7fbd577fe700 1 --2- 172.21.15.72:0/1867339216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd58154500 0x7fbd580646a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fbd580643c0 tx=0x7fbd4c0090f0).ready entity=mon.0 client_cookie=918381015b096fbd server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.691+0000 7fbd56ffd700 1 -- 172.21.15.72:0/1867339216 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00b5a0 con 0x7fbd58154500 2023-08-31T19:00:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.691+0000 7fbd56ffd700 1 -- 172.21.15.72:0/1867339216 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c00b700 con 0x7fbd58154500 2023-08-31T19:00:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.691+0000 7fbd56ffd700 1 -- 172.21.15.72:0/1867339216 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00ba80 con 0x7fbd58154500 2023-08-31T19:00:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.691+0000 7fbd5e5ff700 1 -- 172.21.15.72:0/1867339216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd58154500 msgr2=0x7fbd580646a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.691+0000 7fbd5e5ff700 1 --2- 172.21.15.72:0/1867339216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd58154500 0x7fbd580646a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fbd580643c0 tx=0x7fbd4c0090f0).stop 2023-08-31T19:00:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.691+0000 7fbd5e5ff700 1 -- 172.21.15.72:0/1867339216 shutdown_connections 2023-08-31T19:00:21.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.691+0000 7fbd5e5ff700 1 --2- 172.21.15.72:0/1867339216 >> v2:172.21.15.146:3300/0 conn(0x7fbd58154120 0x7fbd580a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.691+0000 7fbd5e5ff700 1 --2- 172.21.15.72:0/1867339216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd58154500 0x7fbd580646a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.692+0000 7fbd5e5ff700 1 -- 172.21.15.72:0/1867339216 >> 172.21.15.72:0/1867339216 conn(0x7fbd580cb7e0 msgr2=0x7fbd580c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:21.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.692+0000 7fbd5e5ff700 1 -- 172.21.15.72:0/1867339216 shutdown_connections 2023-08-31T19:00:21.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.692+0000 7fbd5e5ff700 1 -- 172.21.15.72:0/1867339216 wait complete. 2023-08-31T19:00:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.693+0000 7fbd5e5ff700 1 Processor -- start 2023-08-31T19:00:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.693+0000 7fbd5e5ff700 1 -- start start 2023-08-31T19:00:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.694+0000 7fbd5e5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd58064b90 0x7fbd5814ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.694+0000 7fbd5e5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd58154120 0x7fbd580ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.694+0000 7fbd5e5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd58154500 0x7fbd580abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.694+0000 7fbd5e5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580ac200 con 0x7fbd58154120 2023-08-31T19:00:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.694+0000 7fbd5e5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd58152480 con 0x7fbd58064b90 2023-08-31T19:00:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.694+0000 7fbd5e5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd58152760 con 0x7fbd58154500 2023-08-31T19:00:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.694+0000 7fbd577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd58154120 0x7fbd580ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.694+0000 7fbd577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd58154120 0x7fbd580ab820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58094/0 (socket says 172.21.15.72:58094) 2023-08-31T19:00:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.694+0000 7fbd577fe700 1 -- 172.21.15.72:0/3048286078 learned_addr learned my addr 172.21.15.72:0/3048286078 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.695+0000 7fbd577fe700 1 -- 172.21.15.72:0/3048286078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd58154500 msgr2=0x7fbd580abd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.695+0000 7fbd577fe700 1 --2- 172.21.15.72:0/3048286078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd58154500 0x7fbd580abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.695+0000 7fbd57fff700 1 --2- 172.21.15.72:0/3048286078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd58064b90 0x7fbd5814ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.695+0000 7fbd577fe700 1 -- 172.21.15.72:0/3048286078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd58064b90 msgr2=0x7fbd5814ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.695+0000 7fbd577fe700 1 --2- 172.21.15.72:0/3048286078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd58064b90 0x7fbd5814ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.695+0000 7fbd577fe700 1 -- 172.21.15.72:0/3048286078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c009370 con 0x7fbd58154120 2023-08-31T19:00:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.695+0000 7fbd57fff700 1 --2- 172.21.15.72:0/3048286078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd58064b90 0x7fbd5814ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.695+0000 7fbd577fe700 1 --2- 172.21.15.72:0/3048286078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd58154120 0x7fbd580ab820 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fbd4c009130 tx=0x7fbd4c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.695+0000 7fbd3ffff700 1 -- 172.21.15.72:0/3048286078 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00ba80 con 0x7fbd58154120 2023-08-31T19:00:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.695+0000 7fbd3ffff700 1 -- 172.21.15.72:0/3048286078 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c000c90 con 0x7fbd58154120 2023-08-31T19:00:21.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.695+0000 7fbd5e5ff700 1 -- 172.21.15.72:0/3048286078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd58152a40 con 0x7fbd58154120 2023-08-31T19:00:21.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.695+0000 7fbd3ffff700 1 -- 172.21.15.72:0/3048286078 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c01b660 con 0x7fbd58154120 2023-08-31T19:00:21.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.695+0000 7fbd5e5ff700 1 -- 172.21.15.72:0/3048286078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd58153000 con 0x7fbd58154120 2023-08-31T19:00:21.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.696+0000 7fbd5e5ff700 1 -- 172.21.15.72:0/3048286078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5806a7e0 con 0x7fbd58154120 2023-08-31T19:00:21.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.697+0000 7fbd3ffff700 1 -- 172.21.15.72:0/3048286078 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fbd4c01b9d0 con 0x7fbd58154120 2023-08-31T19:00:21.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.698+0000 7fbd3ffff700 1 --2- 172.21.15.72:0/3048286078 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbd4405ef80 0x7fbd44061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:21.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.698+0000 7fbd3ffff700 1 -- 172.21.15.72:0/3048286078 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fbd4c07b620 con 0x7fbd58154120 2023-08-31T19:00:21.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.698+0000 7fbd57fff700 1 --2- 172.21.15.72:0/3048286078 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbd4405ef80 0x7fbd44061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:21.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.699+0000 7fbd57fff700 1 --2- 172.21.15.72:0/3048286078 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbd4405ef80 0x7fbd44061440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fbd480098c0 tx=0x7fbd48008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:21.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.702+0000 7fbd3ffff700 1 -- 172.21.15.72:0/3048286078 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbd4c04c780 con 0x7fbd58154120 2023-08-31T19:00:21.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.900+0000 7fbd5e5ff700 1 -- 172.21.15.72:0/3048286078 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd580c2230 con 0x7fbd4405ef80 2023-08-31T19:00:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.903+0000 7fbd3ffff700 1 -- 172.21.15.72:0/3048286078 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fbd580c2230 con 0x7fbd4405ef80 2023-08-31T19:00:21.904 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-08-31T19:00:21.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.906+0000 7fbd5e5ff700 1 -- 172.21.15.72:0/3048286078 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbd4405ef80 msgr2=0x7fbd44061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:21.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.906+0000 7fbd5e5ff700 1 --2- 172.21.15.72:0/3048286078 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbd4405ef80 0x7fbd44061440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fbd480098c0 tx=0x7fbd48008040).stop 2023-08-31T19:00:21.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.906+0000 7fbd5e5ff700 1 -- 172.21.15.72:0/3048286078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd58154120 msgr2=0x7fbd580ab820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:21.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.906+0000 7fbd5e5ff700 1 --2- 172.21.15.72:0/3048286078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd58154120 0x7fbd580ab820 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fbd4c009130 tx=0x7fbd4c015000).stop 2023-08-31T19:00:21.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.906+0000 7fbd5e5ff700 1 -- 172.21.15.72:0/3048286078 shutdown_connections 2023-08-31T19:00:21.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.906+0000 7fbd5e5ff700 1 --2- 172.21.15.72:0/3048286078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd58154500 0x7fbd580abd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:21.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.906+0000 7fbd5e5ff700 1 --2- 172.21.15.72:0/3048286078 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbd4405ef80 0x7fbd44061440 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.906+0000 7fbd5e5ff700 1 --2- 172.21.15.72:0/3048286078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd58064b90 0x7fbd5814ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.906+0000 7fbd5e5ff700 1 --2- 172.21.15.72:0/3048286078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd58154120 0x7fbd580ab820 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:21.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.906+0000 7fbd5e5ff700 1 -- 172.21.15.72:0/3048286078 >> 172.21.15.72:0/3048286078 conn(0x7fbd580cb7e0 msgr2=0x7fbd580c97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:21.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.906+0000 7fbd5e5ff700 1 -- 172.21.15.72:0/3048286078 shutdown_connections 2023-08-31T19:00:21.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:21.906+0000 7fbd5e5ff700 1 -- 172.21.15.72:0/3048286078 wait complete. 2023-08-31T19:00:21.923 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-08-31T19:00:21.923 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-08-31T19:00:22.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.117+0000 7ff6c6dff700 1 Processor -- start 2023-08-31T19:00:22.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.117+0000 7ff6c6dff700 1 -- start start 2023-08-31T19:00:22.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.118+0000 7ff6c6dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6c0068c20 0x7ff6c0069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.118+0000 7ff6c6dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c0063c20 0x7ff6c0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.118+0000 7ff6c6dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c00c2260 con 0x7ff6c0062650 2023-08-31T19:00:22.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.118+0000 7ff6c6dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c0062b80 con 0x7ff6c0068c20 2023-08-31T19:00:22.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.118+0000 7ff6c6dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0062e60 con 0x7ff6c0063c20 2023-08-31T19:00:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.119+0000 7ff6c4b9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6c0068c20 0x7ff6c0069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.119+0000 7ff6c539c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c0063c20 0x7ff6c0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.119+0000 7ff6bffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff6c0062650 0x7ff6c00c1b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:44944/0 (socket says 172.21.15.72:44944) 2023-08-31T19:00:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.119+0000 7ff6bffff700 1 -- 172.21.15.72:0/331260735 learned_addr learned my addr 172.21.15.72:0/331260735 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.120+0000 7ff6c4b9b700 1 -- 172.21.15.72:0/331260735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c0063c20 msgr2=0x7ff6c0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.120+0000 7ff6c4b9b700 1 --2- 172.21.15.72:0/331260735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c0063c20 0x7ff6c0157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.120+0000 7ff6c4b9b700 1 -- 172.21.15.72:0/331260735 >> v1:172.21.15.146:6789/0 conn(0x7ff6c0062650 legacy=0x7ff6c00c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.120+0000 7ff6c4b9b700 1 -- 172.21.15.72:0/331260735 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c0063140 con 0x7ff6c0068c20 2023-08-31T19:00:22.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.120+0000 7ff6bf7fe700 1 -- 172.21.15.72:0/331260735 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302894480 0 0) 0x7ff6c00c2260 con 0x7ff6c0062650 2023-08-31T19:00:22.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.120+0000 7ff6c539c700 1 --2- 172.21.15.72:0/331260735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c0063c20 0x7ff6c0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:00:22.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.120+0000 7ff6c4b9b700 1 --2- 172.21.15.72:0/331260735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c0068c20 0x7ff6c0069000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7ff6b4009760 tx=0x7ff6b4009060).ready entity=mon.1 client_cookie=68f74f796529d989 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:22.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.120+0000 7ff6bf7fe700 1 -- 172.21.15.72:0/331260735 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b400f510 con 0x7ff6c0068c20 2023-08-31T19:00:22.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.120+0000 7ff6bf7fe700 1 -- 172.21.15.72:0/331260735 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b400f670 con 0x7ff6c0068c20 2023-08-31T19:00:22.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.120+0000 7ff6bf7fe700 1 -- 172.21.15.72:0/331260735 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b400f9f0 con 0x7ff6c0068c20 2023-08-31T19:00:22.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.121+0000 7ff6c6dff700 1 -- 172.21.15.72:0/331260735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c0068c20 msgr2=0x7ff6c0069000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.121+0000 7ff6c6dff700 1 --2- 172.21.15.72:0/331260735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c0068c20 0x7ff6c0069000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7ff6b4009760 tx=0x7ff6b4009060).stop 2023-08-31T19:00:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.121+0000 7ff6c6dff700 1 -- 172.21.15.72:0/331260735 shutdown_connections 2023-08-31T19:00:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.121+0000 7ff6c6dff700 1 --2- 172.21.15.72:0/331260735 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c0063c20 0x7ff6c0157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.121+0000 7ff6c6dff700 1 --2- 172.21.15.72:0/331260735 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c0068c20 0x7ff6c0069000 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.121+0000 7ff6c6dff700 1 -- 172.21.15.72:0/331260735 >> 172.21.15.72:0/331260735 conn(0x7ff6c00c72f0 msgr2=0x7ff6c00c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.121+0000 7ff6c6dff700 1 -- 172.21.15.72:0/331260735 shutdown_connections 2023-08-31T19:00:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.121+0000 7ff6c6dff700 1 -- 172.21.15.72:0/331260735 wait complete. 2023-08-31T19:00:22.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.122+0000 7ff6c6dff700 1 Processor -- start 2023-08-31T19:00:22.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.123+0000 7ff6c6dff700 1 -- start start 2023-08-31T19:00:22.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.123+0000 7ff6c6dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c0062650 0x7ff6c014ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.123+0000 7ff6c6dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c0063c20 0x7ff6c0151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.123+0000 7ff6c6dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c0068c20 0x7ff6c0152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.124+0000 7ff6c6dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0152600 con 0x7ff6c0068c20 2023-08-31T19:00:22.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.124+0000 7ff6c6dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0157c80 con 0x7ff6c0063c20 2023-08-31T19:00:22.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.124+0000 7ff6c6dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0156dd0 con 0x7ff6c0062650 2023-08-31T19:00:22.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.124+0000 7ff6c539c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c0068c20 0x7ff6c0152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.124+0000 7ff6c539c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c0068c20 0x7ff6c0152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58110/0 (socket says 172.21.15.72:58110) 2023-08-31T19:00:22.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.124+0000 7ff6c539c700 1 -- 172.21.15.72:0/1552846700 learned_addr learned my addr 172.21.15.72:0/1552846700 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:22.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.124+0000 7ff6c4b9b700 1 --2- 172.21.15.72:0/1552846700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c0062650 0x7ff6c014ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.124+0000 7ff6bffff700 1 --2- 172.21.15.72:0/1552846700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c0063c20 0x7ff6c0151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.124+0000 7ff6c539c700 1 -- 172.21.15.72:0/1552846700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c0062650 msgr2=0x7ff6c014ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.124+0000 7ff6c539c700 1 --2- 172.21.15.72:0/1552846700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c0062650 0x7ff6c014ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.124+0000 7ff6c539c700 1 -- 172.21.15.72:0/1552846700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c0063c20 msgr2=0x7ff6c0151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.124+0000 7ff6c539c700 1 --2- 172.21.15.72:0/1552846700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c0063c20 0x7ff6c0151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.124+0000 7ff6c539c700 1 -- 172.21.15.72:0/1552846700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b8009a20 con 0x7ff6c0068c20 2023-08-31T19:00:22.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.124+0000 7ff6bffff700 1 --2- 172.21.15.72:0/1552846700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c0063c20 0x7ff6c0151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:22.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.124+0000 7ff6c539c700 1 --2- 172.21.15.72:0/1552846700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c0068c20 0x7ff6c0152110 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7ff6b8009fc0 tx=0x7ff6b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:22.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.125+0000 7ff6bcff9700 1 -- 172.21.15.72:0/1552846700 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b800cc80 con 0x7ff6c0068c20 2023-08-31T19:00:22.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.125+0000 7ff6bcff9700 1 -- 172.21.15.72:0/1552846700 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b800f040 con 0x7ff6c0068c20 2023-08-31T19:00:22.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.125+0000 7ff6bcff9700 1 -- 172.21.15.72:0/1552846700 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8013400 con 0x7ff6c0068c20 2023-08-31T19:00:22.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.125+0000 7ff6c6dff700 1 -- 172.21.15.72:0/1552846700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b40092a0 con 0x7ff6c0068c20 2023-08-31T19:00:22.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.125+0000 7ff6c6dff700 1 -- 172.21.15.72:0/1552846700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c01570f0 con 0x7ff6c0068c20 2023-08-31T19:00:22.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.126+0000 7ff6c6dff700 1 -- 172.21.15.72:0/1552846700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c0157e10 con 0x7ff6c0068c20 2023-08-31T19:00:22.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.126+0000 7ff6bcff9700 1 -- 172.21.15.72:0/1552846700 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7ff6b80137b0 con 0x7ff6c0068c20 2023-08-31T19:00:22.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.127+0000 7ff6bcff9700 1 --2- 172.21.15.72:0/1552846700 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff6a405ef80 0x7ff6a4061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.128+0000 7ff6bcff9700 1 -- 172.21.15.72:0/1552846700 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7ff6b807ab90 con 0x7ff6c0068c20 2023-08-31T19:00:22.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.128+0000 7ff6c4b9b700 1 --2- 172.21.15.72:0/1552846700 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff6a405ef80 0x7ff6a4061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.128+0000 7ff6c4b9b700 1 --2- 172.21.15.72:0/1552846700 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff6a405ef80 0x7ff6a4061440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff6b4009fd0 tx=0x7ff6b4017000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:22.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.131+0000 7ff6bcff9700 1 -- 172.21.15.72:0/1552846700 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff6b804bcf0 con 0x7ff6c0068c20 2023-08-31T19:00:22.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.324+0000 7ff6c6dff700 1 -- 172.21.15.72:0/1552846700 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6c0063420 con 0x7ff6a405ef80 2023-08-31T19:00:22.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.328+0000 7ff6bcff9700 1 -- 172.21.15.72:0/1552846700 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7ff6c0063420 con 0x7ff6a405ef80 2023-08-31T19:00:22.331 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-08-31T19:00:22.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.331+0000 7ff6c6dff700 1 -- 172.21.15.72:0/1552846700 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff6a405ef80 msgr2=0x7ff6a4061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.331+0000 7ff6c6dff700 1 --2- 172.21.15.72:0/1552846700 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff6a405ef80 0x7ff6a4061440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff6b4009fd0 tx=0x7ff6b4017000).stop 2023-08-31T19:00:22.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.331+0000 7ff6c6dff700 1 -- 172.21.15.72:0/1552846700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c0068c20 msgr2=0x7ff6c0152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.331+0000 7ff6c6dff700 1 --2- 172.21.15.72:0/1552846700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c0068c20 0x7ff6c0152110 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7ff6b8009fc0 tx=0x7ff6b800b040).stop 2023-08-31T19:00:22.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.331+0000 7ff6c6dff700 1 -- 172.21.15.72:0/1552846700 shutdown_connections 2023-08-31T19:00:22.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.331+0000 7ff6c6dff700 1 --2- 172.21.15.72:0/1552846700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6c0068c20 0x7ff6c0152110 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.331+0000 7ff6c6dff700 1 --2- 172.21.15.72:0/1552846700 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6c0062650 0x7ff6c014ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.331+0000 7ff6c6dff700 1 --2- 172.21.15.72:0/1552846700 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff6a405ef80 0x7ff6a4061440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.331+0000 7ff6c6dff700 1 --2- 172.21.15.72:0/1552846700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6c0063c20 0x7ff6c0151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.331+0000 7ff6c6dff700 1 -- 172.21.15.72:0/1552846700 >> 172.21.15.72:0/1552846700 conn(0x7ff6c00c72f0 msgr2=0x7ff6c00c6590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:22.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.331+0000 7ff6c6dff700 1 -- 172.21.15.72:0/1552846700 shutdown_connections 2023-08-31T19:00:22.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.331+0000 7ff6c6dff700 1 -- 172.21.15.72:0/1552846700 wait complete. 2023-08-31T19:00:22.348 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-08-31T19:00:22.349 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-08-31T19:00:22.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.541+0000 7fc9697ff700 1 Processor -- start 2023-08-31T19:00:22.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.541+0000 7fc9697ff700 1 -- start start 2023-08-31T19:00:22.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.542+0000 7fc9697ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc964154120 0x7fc9640a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.542+0000 7fc9697ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc964154500 0x7fc9640646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.542+0000 7fc9697ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9640aa620 con 0x7fc964064b90 2023-08-31T19:00:22.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.542+0000 7fc9697ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc964065020 con 0x7fc964154500 2023-08-31T19:00:22.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.542+0000 7fc9697ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9640aa3a0 con 0x7fc964154120 2023-08-31T19:00:22.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.543+0000 7fc9627fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc964154500 0x7fc9640646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.543+0000 7fc9637fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc964064b90 0x7fc9640c0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39380/0 (socket says 172.21.15.72:39380) 2023-08-31T19:00:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.543+0000 7fc9637fe700 1 -- 172.21.15.72:0/446276636 learned_addr learned my addr 172.21.15.72:0/446276636 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.543+0000 7fc962ffd700 1 --2- 172.21.15.72:0/446276636 >> v2:172.21.15.146:3300/0 conn(0x7fc964154120 0x7fc9640a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.543+0000 7fc9627fc700 1 -- 172.21.15.72:0/446276636 >> v2:172.21.15.146:3300/0 conn(0x7fc964154120 msgr2=0x7fc9640a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.543+0000 7fc9627fc700 1 --2- 172.21.15.72:0/446276636 >> v2:172.21.15.146:3300/0 conn(0x7fc964154120 0x7fc9640a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.543+0000 7fc9627fc700 1 -- 172.21.15.72:0/446276636 >> v1:172.21.15.72:6789/0 conn(0x7fc964064b90 legacy=0x7fc9640c0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.543+0000 7fc961ffb700 1 -- 172.21.15.72:0/446276636 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728955612 0 0) 0x7fc9640aa620 con 0x7fc964064b90 2023-08-31T19:00:22.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.543+0000 7fc9627fc700 1 -- 172.21.15.72:0/446276636 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9640c5450 con 0x7fc964154500 2023-08-31T19:00:22.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.543+0000 7fc9627fc700 1 --2- 172.21.15.72:0/446276636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964154500 0x7fc9640646a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fc9640643c0 tx=0x7fc958009060).ready entity=mon.0 client_cookie=cf3930b1aa764cdb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:22.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.544+0000 7fc961ffb700 1 -- 172.21.15.72:0/446276636 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800b580 con 0x7fc964154500 2023-08-31T19:00:22.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.544+0000 7fc961ffb700 1 -- 172.21.15.72:0/446276636 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95800b6e0 con 0x7fc964154500 2023-08-31T19:00:22.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.544+0000 7fc961ffb700 1 -- 172.21.15.72:0/446276636 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800ba60 con 0x7fc964154500 2023-08-31T19:00:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.544+0000 7fc9697ff700 1 -- 172.21.15.72:0/446276636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964154500 msgr2=0x7fc9640646a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.544+0000 7fc9697ff700 1 --2- 172.21.15.72:0/446276636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964154500 0x7fc9640646a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fc9640643c0 tx=0x7fc958009060).stop 2023-08-31T19:00:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.544+0000 7fc9697ff700 1 -- 172.21.15.72:0/446276636 shutdown_connections 2023-08-31T19:00:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.544+0000 7fc9697ff700 1 --2- 172.21.15.72:0/446276636 >> v2:172.21.15.146:3300/0 conn(0x7fc964154120 0x7fc9640a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.544+0000 7fc9697ff700 1 --2- 172.21.15.72:0/446276636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964154500 0x7fc9640646a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.544+0000 7fc9697ff700 1 -- 172.21.15.72:0/446276636 >> 172.21.15.72:0/446276636 conn(0x7fc9640cb7e0 msgr2=0x7fc9640c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:22.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.544+0000 7fc9697ff700 1 -- 172.21.15.72:0/446276636 shutdown_connections 2023-08-31T19:00:22.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.544+0000 7fc9697ff700 1 -- 172.21.15.72:0/446276636 wait complete. 2023-08-31T19:00:22.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.546+0000 7fc9697ff700 1 Processor -- start 2023-08-31T19:00:22.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.546+0000 7fc9697ff700 1 -- start start 2023-08-31T19:00:22.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc9697ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964064b90 0x7fc9640af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc9697ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc964154120 0x7fc964164e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc9697ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc964154500 0x7fc96413f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc9697ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640af9f0 con 0x7fc964064b90 2023-08-31T19:00:22.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc9697ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640b07f0 con 0x7fc964154120 2023-08-31T19:00:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc9697ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc964165340 con 0x7fc964154500 2023-08-31T19:00:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc962ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964064b90 0x7fc9640af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc962ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964064b90 0x7fc9640af500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58126/0 (socket says 172.21.15.72:58126) 2023-08-31T19:00:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc962ffd700 1 -- 172.21.15.72:0/2200257849 learned_addr learned my addr 172.21.15.72:0/2200257849 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:22.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc9637fe700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc964154500 0x7fc96413f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc9627fc700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc964154120 0x7fc964164e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc962ffd700 1 -- 172.21.15.72:0/2200257849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc964154500 msgr2=0x7fc96413f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc962ffd700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc964154500 0x7fc96413f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc962ffd700 1 -- 172.21.15.72:0/2200257849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc964154120 msgr2=0x7fc964164e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc962ffd700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc964154120 0x7fc964164e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc962ffd700 1 -- 172.21.15.72:0/2200257849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580092a0 con 0x7fc964064b90 2023-08-31T19:00:22.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc9627fc700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc964154120 0x7fc964164e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:22.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.547+0000 7fc9637fe700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc964154500 0x7fc96413f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:22.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.548+0000 7fc962ffd700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964064b90 0x7fc9640af500 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fc95400d8c0 tx=0x7fc954008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:22.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.548+0000 7fc94affd700 1 -- 172.21.15.72:0/2200257849 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9540095b0 con 0x7fc964064b90 2023-08-31T19:00:22.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.548+0000 7fc94affd700 1 -- 172.21.15.72:0/2200257849 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc954009710 con 0x7fc964064b90 2023-08-31T19:00:22.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.548+0000 7fc9697ff700 1 -- 172.21.15.72:0/2200257849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96413f5b0 con 0x7fc964064b90 2023-08-31T19:00:22.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.548+0000 7fc94affd700 1 -- 172.21.15.72:0/2200257849 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954009a90 con 0x7fc964064b90 2023-08-31T19:00:22.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.548+0000 7fc9697ff700 1 -- 172.21.15.72:0/2200257849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9640afec0 con 0x7fc964064b90 2023-08-31T19:00:22.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.549+0000 7fc9697ff700 1 -- 172.21.15.72:0/2200257849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96406a7e0 con 0x7fc964064b90 2023-08-31T19:00:22.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.550+0000 7fc94affd700 1 -- 172.21.15.72:0/2200257849 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fc954013480 con 0x7fc964064b90 2023-08-31T19:00:22.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.551+0000 7fc94affd700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc95005ef80 0x7fc950061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.551+0000 7fc94affd700 1 -- 172.21.15.72:0/2200257849 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fc954079ef0 con 0x7fc964064b90 2023-08-31T19:00:22.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.551+0000 7fc9627fc700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc95005ef80 0x7fc950061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.551+0000 7fc9627fc700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc95005ef80 0x7fc950061440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc9640643c0 tx=0x7fc958017000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:22.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.555+0000 7fc94affd700 1 -- 172.21.15.72:0/2200257849 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc95404b0b0 con 0x7fc964064b90 2023-08-31T19:00:22.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.751+0000 7fc9697ff700 1 -- 172.21.15.72:0/2200257849 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc96406c6b0 con 0x7fc95005ef80 2023-08-31T19:00:22.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.756+0000 7fc94affd700 1 -- 172.21.15.72:0/2200257849 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc96406c6b0 con 0x7fc95005ef80 2023-08-31T19:00:22.756 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-08-31T19:00:22.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.758+0000 7fc9697ff700 1 -- 172.21.15.72:0/2200257849 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc95005ef80 msgr2=0x7fc950061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.758+0000 7fc9697ff700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc95005ef80 0x7fc950061440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc9640643c0 tx=0x7fc958017000).stop 2023-08-31T19:00:22.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.758+0000 7fc9697ff700 1 -- 172.21.15.72:0/2200257849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964064b90 msgr2=0x7fc9640af500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.758+0000 7fc9697ff700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964064b90 0x7fc9640af500 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fc95400d8c0 tx=0x7fc954008040).stop 2023-08-31T19:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.758+0000 7fc9697ff700 1 -- 172.21.15.72:0/2200257849 shutdown_connections 2023-08-31T19:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.758+0000 7fc9697ff700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc964154500 0x7fc96413f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.758+0000 7fc9697ff700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc964064b90 0x7fc9640af500 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.758+0000 7fc9697ff700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc95005ef80 0x7fc950061440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.758+0000 7fc9697ff700 1 --2- 172.21.15.72:0/2200257849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc964154120 0x7fc964164e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.758+0000 7fc9697ff700 1 -- 172.21.15.72:0/2200257849 >> 172.21.15.72:0/2200257849 conn(0x7fc9640cb7e0 msgr2=0x7fc9640a9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:22.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.759+0000 7fc9697ff700 1 -- 172.21.15.72:0/2200257849 shutdown_connections 2023-08-31T19:00:22.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.759+0000 7fc9697ff700 1 -- 172.21.15.72:0/2200257849 wait complete. 2023-08-31T19:00:22.776 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-08-31T19:00:22.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-08-31T19:00:22.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.968+0000 7f0079bff700 1 Processor -- start 2023-08-31T19:00:22.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.969+0000 7f0079bff700 1 -- start start 2023-08-31T19:00:22.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.970+0000 7f0079bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0074064db0 0x7f00740a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.970+0000 7f0079bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0074154500 0x7f007415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.970+0000 7f0079bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00740aa620 con 0x7f0074154120 2023-08-31T19:00:22.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.970+0000 7f0079bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00740aa3a0 con 0x7f0074064db0 2023-08-31T19:00:22.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.970+0000 7f0079bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00740c5450 con 0x7f0074154500 2023-08-31T19:00:22.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.970+0000 7f00737fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0074154120 0x7f00740646a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55072/0 (socket says 172.21.15.72:55072) 2023-08-31T19:00:22.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.970+0000 7f00737fe700 1 -- 172.21.15.72:0/614933323 learned_addr learned my addr 172.21.15.72:0/614933323 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:22.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.970+0000 7f0072ffd700 1 --2- 172.21.15.72:0/614933323 >> v2:172.21.15.72:3300/0 conn(0x7f0074064db0 0x7f00740a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.971+0000 7f00727fc700 1 -- 172.21.15.72:0/614933323 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456384824 0 0) 0x7f00740aa620 con 0x7f0074154120 2023-08-31T19:00:22.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.971+0000 7f00727fc700 1 -- 172.21.15.72:0/614933323 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f005c0033f0 con 0x7f0074154120 2023-08-31T19:00:22.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.971+0000 7f0072ffd700 1 -- 172.21.15.72:0/614933323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0074154500 msgr2=0x7f007415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:22.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.971+0000 7f0073fff700 1 --2- 172.21.15.72:0/614933323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0074154500 0x7f007415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.971+0000 7f0072ffd700 1 --2- 172.21.15.72:0/614933323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0074154500 0x7f007415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.971+0000 7f0072ffd700 1 -- 172.21.15.72:0/614933323 >> v1:172.21.15.72:6789/0 conn(0x7f0074154120 legacy=0x7f00740646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.971+0000 7f0072ffd700 1 -- 172.21.15.72:0/614933323 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00740c8050 con 0x7f0074064db0 2023-08-31T19:00:22.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.971+0000 7f0073fff700 1 --2- 172.21.15.72:0/614933323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0074154500 0x7f007415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:22.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.971+0000 7f0072ffd700 1 --2- 172.21.15.72:0/614933323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0074064db0 0x7f00740a9eb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f0068009760 tx=0x7f0068009060).ready entity=mon.0 client_cookie=c81225341e4bbabe server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:22.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.971+0000 7f00727fc700 1 -- 172.21.15.72:0/614933323 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006800f510 con 0x7f0074064db0 2023-08-31T19:00:22.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.971+0000 7f00727fc700 1 -- 172.21.15.72:0/614933323 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006800f670 con 0x7f0074064db0 2023-08-31T19:00:22.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.971+0000 7f00727fc700 1 -- 172.21.15.72:0/614933323 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006800f9f0 con 0x7f0074064db0 2023-08-31T19:00:22.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.972+0000 7f0079bff700 1 -- 172.21.15.72:0/614933323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0074064db0 msgr2=0x7f00740a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.972+0000 7f0079bff700 1 --2- 172.21.15.72:0/614933323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0074064db0 0x7f00740a9eb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f0068009760 tx=0x7f0068009060).stop 2023-08-31T19:00:22.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.972+0000 7f0079bff700 1 -- 172.21.15.72:0/614933323 shutdown_connections 2023-08-31T19:00:22.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.972+0000 7f0079bff700 1 --2- 172.21.15.72:0/614933323 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0074154500 0x7f007415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.972+0000 7f0079bff700 1 --2- 172.21.15.72:0/614933323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0074064db0 0x7f00740a9eb0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:22.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.972+0000 7f0079bff700 1 -- 172.21.15.72:0/614933323 >> 172.21.15.72:0/614933323 conn(0x7f00740cb7e0 msgr2=0x7f00740c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:22.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.972+0000 7f0079bff700 1 -- 172.21.15.72:0/614933323 shutdown_connections 2023-08-31T19:00:22.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.972+0000 7f0079bff700 1 -- 172.21.15.72:0/614933323 wait complete. 2023-08-31T19:00:22.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.973+0000 7f0079bff700 1 Processor -- start 2023-08-31T19:00:22.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.974+0000 7f0079bff700 1 -- start start 2023-08-31T19:00:22.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.974+0000 7f0079bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0074064db0 0x7f0074155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.974+0000 7f0079bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0074154120 0x7f007414baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.975+0000 7f0079bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0074154500 0x7f007414fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.975+0000 7f0079bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00740c23a0 con 0x7f0074064db0 2023-08-31T19:00:22.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.975+0000 7f0079bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0074156d70 con 0x7f0074154500 2023-08-31T19:00:22.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.975+0000 7f0079bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0074155af0 con 0x7f0074154120 2023-08-31T19:00:22.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.975+0000 7f00737fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0074064db0 0x7f0074155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.975+0000 7f00737fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0074064db0 0x7f0074155d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53912/0 (socket says 172.21.15.72:53912) 2023-08-31T19:00:22.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.975+0000 7f00737fe700 1 -- 172.21.15.72:0/258225259 learned_addr learned my addr 172.21.15.72:0/258225259 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:22.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.975+0000 7f00737fe700 1 -- 172.21.15.72:0/258225259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0074154120 msgr2=0x7f007414baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.975+0000 7f00737fe700 1 --2- 172.21.15.72:0/258225259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0074154120 0x7f007414baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:22.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.975+0000 7f00737fe700 1 -- 172.21.15.72:0/258225259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0074154500 msgr2=0x7f007414fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:22.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.975+0000 7f00737fe700 1 --2- 172.21.15.72:0/258225259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0074154500 0x7f007414fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:22.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.975+0000 7f00737fe700 1 -- 172.21.15.72:0/258225259 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00680092a0 con 0x7f0074064db0 2023-08-31T19:00:22.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.975+0000 7f00737fe700 1 --2- 172.21.15.72:0/258225259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0074064db0 0x7f0074155d60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f006400c590 tx=0x7f0064007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:22.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.975+0000 7f005b7fe700 1 -- 172.21.15.72:0/258225259 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0064007e40 con 0x7f0074064db0 2023-08-31T19:00:22.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.976+0000 7f005b7fe700 1 -- 172.21.15.72:0/258225259 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00640072e0 con 0x7f0074064db0 2023-08-31T19:00:22.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.976+0000 7f0079bff700 1 -- 172.21.15.72:0/258225259 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007414bfe0 con 0x7f0074064db0 2023-08-31T19:00:22.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.976+0000 7f005b7fe700 1 -- 172.21.15.72:0/258225259 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00640057a0 con 0x7f0074064db0 2023-08-31T19:00:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.976+0000 7f0079bff700 1 -- 172.21.15.72:0/258225259 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0074156340 con 0x7f0074064db0 2023-08-31T19:00:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.977+0000 7f0079bff700 1 -- 172.21.15.72:0/258225259 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007406a7e0 con 0x7f0074064db0 2023-08-31T19:00:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.978+0000 7f005b7fe700 1 -- 172.21.15.72:0/258225259 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f0064005bd0 con 0x7f0074064db0 2023-08-31T19:00:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.978+0000 7f005b7fe700 1 --2- 172.21.15.72:0/258225259 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f006005ef80 0x7f0060061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.978+0000 7f005b7fe700 1 -- 172.21.15.72:0/258225259 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f00640799c0 con 0x7f0074064db0 2023-08-31T19:00:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.979+0000 7f0072ffd700 1 --2- 172.21.15.72:0/258225259 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f006005ef80 0x7f0060061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.979+0000 7f0072ffd700 1 --2- 172.21.15.72:0/258225259 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f006005ef80 0x7f0060061440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0068009760 tx=0x7f0068017000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:22.982+0000 7f005b7fe700 1 -- 172.21.15.72:0/258225259 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f006404aba0 con 0x7f0074064db0 2023-08-31T19:00:23.047 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:00:23.052 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:00:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.185+0000 7f0079bff700 1 -- 172.21.15.72:0/258225259 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f00740c3770 con 0x7f006005ef80 2023-08-31T19:00:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.189+0000 7f005b7fe700 1 -- 172.21.15.72:0/258225259 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f00740c3770 con 0x7f006005ef80 2023-08-31T19:00:23.189 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-08-31T19:00:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.191+0000 7f0079bff700 1 -- 172.21.15.72:0/258225259 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f006005ef80 msgr2=0x7f0060061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.191+0000 7f0079bff700 1 --2- 172.21.15.72:0/258225259 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f006005ef80 0x7f0060061440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0068009760 tx=0x7f0068017000).stop 2023-08-31T19:00:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.191+0000 7f0079bff700 1 -- 172.21.15.72:0/258225259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0074064db0 msgr2=0x7f0074155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.191+0000 7f0079bff700 1 --2- 172.21.15.72:0/258225259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0074064db0 0x7f0074155d60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f006400c590 tx=0x7f0064007c80).stop 2023-08-31T19:00:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.191+0000 7f0079bff700 1 -- 172.21.15.72:0/258225259 shutdown_connections 2023-08-31T19:00:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.191+0000 7f0079bff700 1 --2- 172.21.15.72:0/258225259 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f006005ef80 0x7f0060061440 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.191+0000 7f0079bff700 1 --2- 172.21.15.72:0/258225259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0074154500 0x7f007414fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.191+0000 7f0079bff700 1 --2- 172.21.15.72:0/258225259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0074064db0 0x7f0074155d60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.191+0000 7f0079bff700 1 --2- 172.21.15.72:0/258225259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0074154120 0x7f007414baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.191+0000 7f0079bff700 1 -- 172.21.15.72:0/258225259 >> 172.21.15.72:0/258225259 conn(0x7f00740cb7e0 msgr2=0x7f00740c97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.191+0000 7f0079bff700 1 -- 172.21.15.72:0/258225259 shutdown_connections 2023-08-31T19:00:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.191+0000 7f0079bff700 1 -- 172.21.15.72:0/258225259 wait complete. 2023-08-31T19:00:23.208 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-08-31T19:00:23.209 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-08-31T19:00:23.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.441+0000 7f8fde19d700 1 Processor -- start 2023-08-31T19:00:23.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.441+0000 7f8fde19d700 1 -- start start 2023-08-31T19:00:23.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.442+0000 7f8fde19d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fd814e5e0 0x7f8fd80c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:23.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.442+0000 7f8fde19d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8fd80c6030 0x7f8fd80c0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:23.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.442+0000 7f8fde19d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd81579f0 con 0x7f8fd814e200 2023-08-31T19:00:23.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.442+0000 7f8fde19d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd8158850 con 0x7f8fd80c6030 2023-08-31T19:00:23.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.442+0000 7f8fde19d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80c64c0 con 0x7f8fd814e5e0 2023-08-31T19:00:23.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.443+0000 7f8fdc99a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fd814e5e0 0x7f8fd80c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:23.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.443+0000 7f8fdd99c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8fd80c6030 0x7f8fd80c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:23.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.443+0000 7f8fdd19b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8fd814e200 0x7f8fd80c79e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:50390/0 (socket says 172.21.15.72:50390) 2023-08-31T19:00:23.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.443+0000 7f8fdd19b700 1 -- 172.21.15.72:0/39689100 learned_addr learned my addr 172.21.15.72:0/39689100 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:23.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.443+0000 7f8fcffff700 1 -- 172.21.15.72:0/39689100 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909520142 0 0) 0x7f8fd81579f0 con 0x7f8fd814e200 2023-08-31T19:00:23.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.443+0000 7f8fcffff700 1 -- 172.21.15.72:0/39689100 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fc40033f0 con 0x7f8fd814e200 2023-08-31T19:00:23.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.443+0000 7f8fdd99c700 1 -- 172.21.15.72:0/39689100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fd814e5e0 msgr2=0x7f8fd80c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:23.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.443+0000 7f8fdd99c700 1 --2- 172.21.15.72:0/39689100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fd814e5e0 0x7f8fd80c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.443+0000 7f8fdd99c700 1 -- 172.21.15.72:0/39689100 >> v1:172.21.15.146:6789/0 conn(0x7f8fd814e200 legacy=0x7f8fd80c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.443+0000 7f8fdd99c700 1 -- 172.21.15.72:0/39689100 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd8157c40 con 0x7f8fd80c6030 2023-08-31T19:00:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.443+0000 7f8fdc99a700 1 --2- 172.21.15.72:0/39689100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fd814e5e0 0x7f8fd80c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:00:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.444+0000 7f8fdd99c700 1 --2- 172.21.15.72:0/39689100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd80c6030 0x7f8fd80c0580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f8fd0009e60 tx=0x7f8fd0009780).ready entity=mon.1 client_cookie=8da7ebc860341e4e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.444+0000 7f8fcffff700 1 -- 172.21.15.72:0/39689100 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000e070 con 0x7f8fd80c6030 2023-08-31T19:00:23.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.444+0000 7f8fcffff700 1 -- 172.21.15.72:0/39689100 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd000bab0 con 0x7f8fd80c6030 2023-08-31T19:00:23.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.444+0000 7f8fcffff700 1 -- 172.21.15.72:0/39689100 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000be30 con 0x7f8fd80c6030 2023-08-31T19:00:23.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.444+0000 7f8fde19d700 1 -- 172.21.15.72:0/39689100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd80c6030 msgr2=0x7f8fd80c0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:23.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.444+0000 7f8fde19d700 1 --2- 172.21.15.72:0/39689100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd80c6030 0x7f8fd80c0580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f8fd0009e60 tx=0x7f8fd0009780).stop 2023-08-31T19:00:23.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.444+0000 7f8fde19d700 1 -- 172.21.15.72:0/39689100 shutdown_connections 2023-08-31T19:00:23.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.444+0000 7f8fde19d700 1 --2- 172.21.15.72:0/39689100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd80c6030 0x7f8fd80c0580 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.444+0000 7f8fde19d700 1 --2- 172.21.15.72:0/39689100 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fd814e5e0 0x7f8fd80c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.444+0000 7f8fde19d700 1 -- 172.21.15.72:0/39689100 >> 172.21.15.72:0/39689100 conn(0x7f8fd805e090 msgr2=0x7f8fd805e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:23.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.445+0000 7f8fde19d700 1 -- 172.21.15.72:0/39689100 shutdown_connections 2023-08-31T19:00:23.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.445+0000 7f8fde19d700 1 -- 172.21.15.72:0/39689100 wait complete. 2023-08-31T19:00:23.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.446+0000 7f8fde19d700 1 Processor -- start 2023-08-31T19:00:23.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.446+0000 7f8fde19d700 1 -- start start 2023-08-31T19:00:23.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.447+0000 7f8fde19d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fd80c6030 0x7f8fd80b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:23.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.447+0000 7f8fde19d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fd814e200 0x7f8fd8138e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:23.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.447+0000 7f8fde19d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd814e5e0 0x7f8fd80c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:23.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.447+0000 7f8fde19d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd814be60 con 0x7f8fd814e200 2023-08-31T19:00:23.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.447+0000 7f8fde19d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80b0a30 con 0x7f8fd814e5e0 2023-08-31T19:00:23.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.447+0000 7f8fde19d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80aac90 con 0x7f8fd80c6030 2023-08-31T19:00:23.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.447+0000 7f8fdc99a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fd814e200 0x7f8fd8138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.447+0000 7f8fdc99a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fd814e200 0x7f8fd8138e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53922/0 (socket says 172.21.15.72:53922) 2023-08-31T19:00:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.447+0000 7f8fdc99a700 1 -- 172.21.15.72:0/843280316 learned_addr learned my addr 172.21.15.72:0/843280316 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.447+0000 7f8fdd19b700 1 --2- 172.21.15.72:0/843280316 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fd80c6030 0x7f8fd80b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:23.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.447+0000 7f8fdd99c700 1 --2- 172.21.15.72:0/843280316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd814e5e0 0x7f8fd80c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:23.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.448+0000 7f8fdc99a700 1 -- 172.21.15.72:0/843280316 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fd80c6030 msgr2=0x7f8fd80b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:23.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.448+0000 7f8fdc99a700 1 --2- 172.21.15.72:0/843280316 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fd80c6030 0x7f8fd80b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.448+0000 7f8fdc99a700 1 -- 172.21.15.72:0/843280316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd814e5e0 msgr2=0x7f8fd80c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:23.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.448+0000 7f8fdc99a700 1 --2- 172.21.15.72:0/843280316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd814e5e0 0x7f8fd80c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.448+0000 7f8fdc99a700 1 -- 172.21.15.72:0/843280316 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc80092a0 con 0x7f8fd814e200 2023-08-31T19:00:23.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.448+0000 7f8fdc99a700 1 --2- 172.21.15.72:0/843280316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fd814e200 0x7f8fd8138e80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f8fc800ea20 tx=0x7f8fc8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:23.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.448+0000 7f8fcd7fa700 1 -- 172.21.15.72:0/843280316 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc800c850 con 0x7f8fd814e200 2023-08-31T19:00:23.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.448+0000 7f8fcd7fa700 1 -- 172.21.15.72:0/843280316 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc800c9b0 con 0x7f8fd814e200 2023-08-31T19:00:23.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.448+0000 7f8fcd7fa700 1 -- 172.21.15.72:0/843280316 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc800cd30 con 0x7f8fd814e200 2023-08-31T19:00:23.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.448+0000 7f8fde19d700 1 -- 172.21.15.72:0/843280316 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd0009a20 con 0x7f8fd814e200 2023-08-31T19:00:23.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.448+0000 7f8fde19d700 1 -- 172.21.15.72:0/843280316 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd80ab250 con 0x7f8fd814e200 2023-08-31T19:00:23.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.449+0000 7f8fde19d700 1 -- 172.21.15.72:0/843280316 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd8047480 con 0x7f8fd814e200 2023-08-31T19:00:23.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.450+0000 7f8fcd7fa700 1 -- 172.21.15.72:0/843280316 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f8fc8012600 con 0x7f8fd814e200 2023-08-31T19:00:23.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.451+0000 7f8fcd7fa700 1 --2- 172.21.15.72:0/843280316 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8fbc05ef80 0x7f8fbc061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:23.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.451+0000 7f8fcd7fa700 1 -- 172.21.15.72:0/843280316 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f8fc807a840 con 0x7f8fd814e200 2023-08-31T19:00:23.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.451+0000 7f8fdd19b700 1 --2- 172.21.15.72:0/843280316 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8fbc05ef80 0x7f8fbc061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:23.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.451+0000 7f8fdd19b700 1 --2- 172.21.15.72:0/843280316 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8fbc05ef80 0x7f8fbc061440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8fd4005750 tx=0x7f8fd4009040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:23.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.455+0000 7f8fcd7fa700 1 -- 172.21.15.72:0/843280316 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8fc804b9a0 con 0x7f8fd814e200 2023-08-31T19:00:23.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.652+0000 7f8fde19d700 1 -- 172.21.15.72:0/843280316 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fd80bfca0 con 0x7f8fbc05ef80 2023-08-31T19:00:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.656+0000 7f8fcd7fa700 1 -- 172.21.15.72:0/843280316 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f8fd80bfca0 con 0x7f8fbc05ef80 2023-08-31T19:00:23.657 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-08-31T19:00:23.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.658+0000 7f8fde19d700 1 -- 172.21.15.72:0/843280316 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8fbc05ef80 msgr2=0x7f8fbc061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.658+0000 7f8fde19d700 1 --2- 172.21.15.72:0/843280316 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8fbc05ef80 0x7f8fbc061440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8fd4005750 tx=0x7f8fd4009040).stop 2023-08-31T19:00:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.658+0000 7f8fde19d700 1 -- 172.21.15.72:0/843280316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fd814e200 msgr2=0x7f8fd8138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.658+0000 7f8fde19d700 1 --2- 172.21.15.72:0/843280316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fd814e200 0x7f8fd8138e80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f8fc800ea20 tx=0x7f8fc8009060).stop 2023-08-31T19:00:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.658+0000 7f8fde19d700 1 -- 172.21.15.72:0/843280316 shutdown_connections 2023-08-31T19:00:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.658+0000 7f8fde19d700 1 --2- 172.21.15.72:0/843280316 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8fbc05ef80 0x7f8fbc061440 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.658+0000 7f8fde19d700 1 --2- 172.21.15.72:0/843280316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fd814e5e0 0x7f8fd80c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.658+0000 7f8fde19d700 1 --2- 172.21.15.72:0/843280316 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fd80c6030 0x7f8fd80b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.658+0000 7f8fde19d700 1 --2- 172.21.15.72:0/843280316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fd814e200 0x7f8fd8138e80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.658+0000 7f8fde19d700 1 -- 172.21.15.72:0/843280316 >> 172.21.15.72:0/843280316 conn(0x7f8fd805e090 msgr2=0x7f8fd8154960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:23.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.659+0000 7f8fde19d700 1 -- 172.21.15.72:0/843280316 shutdown_connections 2023-08-31T19:00:23.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.659+0000 7f8fde19d700 1 -- 172.21.15.72:0/843280316 wait complete. 2023-08-31T19:00:23.676 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-08-31T19:00:23.677 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-08-31T19:00:23.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.870+0000 7fa7dfdff700 1 Processor -- start 2023-08-31T19:00:23.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.871+0000 7fa7dfdff700 1 -- start start 2023-08-31T19:00:23.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.872+0000 7fa7dfdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7d8064db0 0x7fa7d80a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:23.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.872+0000 7fa7dfdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa7d8154500 0x7fa7d815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:23.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.872+0000 7fa7dfdff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d80aa620 con 0x7fa7d8154120 2023-08-31T19:00:23.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.872+0000 7fa7dfdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d80aa3a0 con 0x7fa7d8154500 2023-08-31T19:00:23.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.872+0000 7fa7dfdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d80c5450 con 0x7fa7d8064db0 2023-08-31T19:00:23.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.872+0000 7fa7de39c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa7d8154500 0x7fa7d815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:23.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.872+0000 7fa7ddb9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa7d8154120 0x7fa7d80646a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55080/0 (socket says 172.21.15.72:55080) 2023-08-31T19:00:23.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.872+0000 7fa7ddb9b700 1 -- 172.21.15.72:0/2003075284 learned_addr learned my addr 172.21.15.72:0/2003075284 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:23.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.872+0000 7fa7dd39a700 1 --2- 172.21.15.72:0/2003075284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7d8064db0 0x7fa7d80a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:23.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.873+0000 7fa7de39c700 1 -- 172.21.15.72:0/2003075284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7d8064db0 msgr2=0x7fa7d80a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.873+0000 7fa7de39c700 1 --2- 172.21.15.72:0/2003075284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7d8064db0 0x7fa7d80a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.873+0000 7fa7de39c700 1 -- 172.21.15.72:0/2003075284 >> v1:172.21.15.72:6789/0 conn(0x7fa7d8154120 legacy=0x7fa7d80646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.873+0000 7fa7dcb99700 1 -- 172.21.15.72:0/2003075284 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368396957 0 0) 0x7fa7d80aa620 con 0x7fa7d8154120 2023-08-31T19:00:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.873+0000 7fa7de39c700 1 -- 172.21.15.72:0/2003075284 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d80c8050 con 0x7fa7d8154500 2023-08-31T19:00:23.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.873+0000 7fa7de39c700 1 --2- 172.21.15.72:0/2003075284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7d8154500 0x7fa7d815dec0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fa7d0009e60 tx=0x7fa7d0009780).ready entity=mon.0 client_cookie=7db5f51473041e9e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:23.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.873+0000 7fa7dcb99700 1 -- 172.21.15.72:0/2003075284 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d000e070 con 0x7fa7d8154500 2023-08-31T19:00:23.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.873+0000 7fa7dcb99700 1 -- 172.21.15.72:0/2003075284 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d000bb60 con 0x7fa7d8154500 2023-08-31T19:00:23.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.873+0000 7fa7dcb99700 1 -- 172.21.15.72:0/2003075284 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0012410 con 0x7fa7d8154500 2023-08-31T19:00:23.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.874+0000 7fa7dfdff700 1 -- 172.21.15.72:0/2003075284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7d8154500 msgr2=0x7fa7d815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:23.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.874+0000 7fa7dfdff700 1 --2- 172.21.15.72:0/2003075284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7d8154500 0x7fa7d815dec0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fa7d0009e60 tx=0x7fa7d0009780).stop 2023-08-31T19:00:23.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.874+0000 7fa7dfdff700 1 -- 172.21.15.72:0/2003075284 shutdown_connections 2023-08-31T19:00:23.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.874+0000 7fa7dfdff700 1 --2- 172.21.15.72:0/2003075284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7d8154500 0x7fa7d815dec0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.874+0000 7fa7dfdff700 1 --2- 172.21.15.72:0/2003075284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7d8064db0 0x7fa7d80a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.874+0000 7fa7dfdff700 1 -- 172.21.15.72:0/2003075284 >> 172.21.15.72:0/2003075284 conn(0x7fa7d80cb7e0 msgr2=0x7fa7d80c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:23.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.874+0000 7fa7dfdff700 1 -- 172.21.15.72:0/2003075284 shutdown_connections 2023-08-31T19:00:23.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.874+0000 7fa7dfdff700 1 -- 172.21.15.72:0/2003075284 wait complete. 2023-08-31T19:00:23.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.875+0000 7fa7dfdff700 1 Processor -- start 2023-08-31T19:00:23.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.875+0000 7fa7dfdff700 1 -- start start 2023-08-31T19:00:23.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.876+0000 7fa7dfdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7d8064db0 0x7fa7d814b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.876+0000 7fa7dfdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7d8154120 0x7fa7d81517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:23.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.876+0000 7fa7dfdff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7d8154500 0x7fa7d814e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:23.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.876+0000 7fa7dfdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d81520e0 con 0x7fa7d8154120 2023-08-31T19:00:23.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.876+0000 7fa7dfdff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d81523c0 con 0x7fa7d8154500 2023-08-31T19:00:23.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.876+0000 7fa7dfdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d81526a0 con 0x7fa7d8064db0 2023-08-31T19:00:23.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.876+0000 7fa7dd39a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7d8154120 0x7fa7d81517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:23.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.877+0000 7fa7dd39a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7d8154120 0x7fa7d81517e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53926/0 (socket says 172.21.15.72:53926) 2023-08-31T19:00:23.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.877+0000 7fa7dd39a700 1 -- 172.21.15.72:0/1796406667 learned_addr learned my addr 172.21.15.72:0/1796406667 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:23.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.877+0000 7fa7ddb9b700 1 --2- 172.21.15.72:0/1796406667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7d8064db0 0x7fa7d814b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:23.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.877+0000 7fa7de39c700 1 --2- 172.21.15.72:0/1796406667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7d8154500 0x7fa7d814e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:23.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.877+0000 7fa7dd39a700 1 -- 172.21.15.72:0/1796406667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7d8064db0 msgr2=0x7fa7d814b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:23.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.877+0000 7fa7dd39a700 1 --2- 172.21.15.72:0/1796406667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7d8064db0 0x7fa7d814b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.877+0000 7fa7dd39a700 1 -- 172.21.15.72:0/1796406667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7d8154500 msgr2=0x7fa7d814e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:23.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.877+0000 7fa7dd39a700 1 --2- 172.21.15.72:0/1796406667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7d8154500 0x7fa7d814e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:23.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.877+0000 7fa7dd39a700 1 -- 172.21.15.72:0/1796406667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d0009a20 con 0x7fa7d8154120 2023-08-31T19:00:23.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.877+0000 7fa7de39c700 1 --2- 172.21.15.72:0/1796406667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7d8154500 0x7fa7d814e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:23.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.877+0000 7fa7dd39a700 1 --2- 172.21.15.72:0/1796406667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7d8154120 0x7fa7d81517e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fa7c800e8d0 tx=0x7fa7c8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:23.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.877+0000 7fa7cdffb700 1 -- 172.21.15.72:0/1796406667 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8012600 con 0x7fa7d8154120 2023-08-31T19:00:23.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.877+0000 7fa7cdffb700 1 -- 172.21.15.72:0/1796406667 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c8012760 con 0x7fa7d8154120 2023-08-31T19:00:23.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.877+0000 7fa7dfdff700 1 -- 172.21.15.72:0/1796406667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d80ae830 con 0x7fa7d8154120 2023-08-31T19:00:23.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.877+0000 7fa7cdffb700 1 -- 172.21.15.72:0/1796406667 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8012ae0 con 0x7fa7d8154120 2023-08-31T19:00:23.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.878+0000 7fa7dfdff700 1 -- 172.21.15.72:0/1796406667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d814be00 con 0x7fa7d8154120 2023-08-31T19:00:23.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.879+0000 7fa7dfdff700 1 -- 172.21.15.72:0/1796406667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d806a7e0 con 0x7fa7d8154120 2023-08-31T19:00:23.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.879+0000 7fa7cdffb700 1 -- 172.21.15.72:0/1796406667 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fa7c801b400 con 0x7fa7d8154120 2023-08-31T19:00:23.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.880+0000 7fa7cdffb700 1 --2- 172.21.15.72:0/1796406667 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa7bc05ef80 0x7fa7bc061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:23.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.880+0000 7fa7cdffb700 1 -- 172.21.15.72:0/1796406667 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fa7c807a3f0 con 0x7fa7d8154120 2023-08-31T19:00:23.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.880+0000 7fa7ddb9b700 1 --2- 172.21.15.72:0/1796406667 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa7bc05ef80 0x7fa7bc061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:23.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.881+0000 7fa7ddb9b700 1 --2- 172.21.15.72:0/1796406667 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa7bc05ef80 0x7fa7bc061440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa7d40011e0 tx=0x7fa7d4007bb0).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:23.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:23.884+0000 7fa7cdffb700 1 -- 172.21.15.72:0/1796406667 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa7c804b5b0 con 0x7fa7d8154120 2023-08-31T19:00:24.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.080+0000 7fa7dfdff700 1 -- 172.21.15.72:0/1796406667 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7d806c6b0 con 0x7fa7bc05ef80 2023-08-31T19:00:24.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.084+0000 7fa7cdffb700 1 -- 172.21.15.72:0/1796406667 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa7d806c6b0 con 0x7fa7bc05ef80 2023-08-31T19:00:24.085 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-08-31T19:00:24.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.086+0000 7fa7dfdff700 1 -- 172.21.15.72:0/1796406667 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa7bc05ef80 msgr2=0x7fa7bc061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:24.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.086+0000 7fa7dfdff700 1 --2- 172.21.15.72:0/1796406667 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa7bc05ef80 0x7fa7bc061440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa7d40011e0 tx=0x7fa7d4007bb0).stop 2023-08-31T19:00:24.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.086+0000 7fa7dfdff700 1 -- 172.21.15.72:0/1796406667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7d8154120 msgr2=0x7fa7d81517e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.086+0000 7fa7dfdff700 1 --2- 172.21.15.72:0/1796406667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7d8154120 0x7fa7d81517e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fa7c800e8d0 tx=0x7fa7c8009060).stop 2023-08-31T19:00:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.087+0000 7fa7dfdff700 1 -- 172.21.15.72:0/1796406667 shutdown_connections 2023-08-31T19:00:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.087+0000 7fa7dfdff700 1 --2- 172.21.15.72:0/1796406667 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa7bc05ef80 0x7fa7bc061440 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.087+0000 7fa7dfdff700 1 --2- 172.21.15.72:0/1796406667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7d8154500 0x7fa7d814e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.087+0000 7fa7dfdff700 1 --2- 172.21.15.72:0/1796406667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7d8064db0 0x7fa7d814b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.087+0000 7fa7dfdff700 1 --2- 172.21.15.72:0/1796406667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7d8154120 0x7fa7d81517e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.087+0000 7fa7dfdff700 1 -- 172.21.15.72:0/1796406667 >> 172.21.15.72:0/1796406667 conn(0x7fa7d80cb7e0 msgr2=0x7fa7d814d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:24.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.087+0000 7fa7dfdff700 1 -- 172.21.15.72:0/1796406667 shutdown_connections 2023-08-31T19:00:24.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.087+0000 7fa7dfdff700 1 -- 172.21.15.72:0/1796406667 wait complete. 2023-08-31T19:00:24.104 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-08-31T19:00:24.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-08-31T19:00:24.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.298+0000 7f5dad3ff700 1 Processor -- start 2023-08-31T19:00:24.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.298+0000 7f5dad3ff700 1 -- start start 2023-08-31T19:00:24.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.299+0000 7f5dad3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5da8153e60 0x7f5da80a70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:24.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.299+0000 7f5dad3ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5da8062650 0x7f5da8062ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:24.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.299+0000 7f5dad3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da8062fd0 con 0x7f5da8154240 2023-08-31T19:00:24.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.299+0000 7f5dad3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da81546c0 con 0x7f5da8153e60 2023-08-31T19:00:24.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.299+0000 7f5dad3ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da80c4360 con 0x7f5da8062650 2023-08-31T19:00:24.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.299+0000 7f5da6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5da8153e60 0x7f5da80a70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:24.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.299+0000 7f5da67fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5da8154240 0x7f5da8069b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55096/0 (socket says 172.21.15.72:55096) 2023-08-31T19:00:24.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.299+0000 7f5da67fc700 1 -- 172.21.15.72:0/2586248430 learned_addr learned my addr 172.21.15.72:0/2586248430 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:24.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.300+0000 7f5da77fe700 1 --2- 172.21.15.72:0/2586248430 >> v2:172.21.15.146:3300/0 conn(0x7f5da8062650 0x7f5da8062ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:24.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.300+0000 7f5da5ffb700 1 -- 172.21.15.72:0/2586248430 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144616056 0 0) 0x7f5da8062fd0 con 0x7f5da8154240 2023-08-31T19:00:24.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.300+0000 7f5da6ffd700 1 -- 172.21.15.72:0/2586248430 >> v2:172.21.15.146:3300/0 conn(0x7f5da8062650 msgr2=0x7f5da8062ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:24.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.300+0000 7f5da6ffd700 1 --2- 172.21.15.72:0/2586248430 >> v2:172.21.15.146:3300/0 conn(0x7f5da8062650 0x7f5da8062ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.300+0000 7f5da6ffd700 1 -- 172.21.15.72:0/2586248430 >> v1:172.21.15.72:6789/0 conn(0x7f5da8154240 legacy=0x7f5da8069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:24.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.300+0000 7f5da6ffd700 1 -- 172.21.15.72:0/2586248430 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da806a410 con 0x7f5da8153e60 2023-08-31T19:00:24.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.300+0000 7f5da77fe700 1 --2- 172.21.15.72:0/2586248430 >> v2:172.21.15.146:3300/0 conn(0x7f5da8062650 0x7f5da8062ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:24.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.300+0000 7f5da6ffd700 1 --2- 172.21.15.72:0/2586248430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5da8153e60 0x7f5da80a70b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f5da80be720 tx=0x7f5d98009060).ready entity=mon.0 client_cookie=f7fac11d7f51bb87 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:24.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.300+0000 7f5da5ffb700 1 -- 172.21.15.72:0/2586248430 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9800b580 con 0x7f5da8153e60 2023-08-31T19:00:24.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.300+0000 7f5da5ffb700 1 -- 172.21.15.72:0/2586248430 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9800b6e0 con 0x7f5da8153e60 2023-08-31T19:00:24.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.300+0000 7f5da5ffb700 1 -- 172.21.15.72:0/2586248430 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9800ba60 con 0x7f5da8153e60 2023-08-31T19:00:24.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.301+0000 7f5dad3ff700 1 -- 172.21.15.72:0/2586248430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5da8153e60 msgr2=0x7f5da80a70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:24.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.301+0000 7f5dad3ff700 1 --2- 172.21.15.72:0/2586248430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5da8153e60 0x7f5da80a70b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f5da80be720 tx=0x7f5d98009060).stop 2023-08-31T19:00:24.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.301+0000 7f5dad3ff700 1 -- 172.21.15.72:0/2586248430 shutdown_connections 2023-08-31T19:00:24.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.301+0000 7f5dad3ff700 1 --2- 172.21.15.72:0/2586248430 >> v2:172.21.15.146:3300/0 conn(0x7f5da8062650 0x7f5da8062ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.301+0000 7f5dad3ff700 1 --2- 172.21.15.72:0/2586248430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5da8153e60 0x7f5da80a70b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.301+0000 7f5dad3ff700 1 -- 172.21.15.72:0/2586248430 >> 172.21.15.72:0/2586248430 conn(0x7f5da80c7b50 msgr2=0x7f5da80c7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.301+0000 7f5dad3ff700 1 -- 172.21.15.72:0/2586248430 shutdown_connections 2023-08-31T19:00:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.301+0000 7f5dad3ff700 1 -- 172.21.15.72:0/2586248430 wait complete. 2023-08-31T19:00:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.302+0000 7f5dad3ff700 1 Processor -- start 2023-08-31T19:00:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.303+0000 7f5dad3ff700 1 -- start start 2023-08-31T19:00:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.303+0000 7f5dad3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da8062650 0x7f5da8159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.303+0000 7f5dad3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5da8153e60 0x7f5da814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.303+0000 7f5dad3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da8154240 0x7f5da8066370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.303+0000 7f5dad3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da8158ba0 con 0x7f5da8153e60 2023-08-31T19:00:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.303+0000 7f5dad3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da8157cf0 con 0x7f5da8062650 2023-08-31T19:00:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.303+0000 7f5dad3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da8157f90 con 0x7f5da8154240 2023-08-31T19:00:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.304+0000 7f5da67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5da8153e60 0x7f5da814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:24.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.304+0000 7f5da67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5da8153e60 0x7f5da814c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53934/0 (socket says 172.21.15.72:53934) 2023-08-31T19:00:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.304+0000 7f5da67fc700 1 -- 172.21.15.72:0/438360580 learned_addr learned my addr 172.21.15.72:0/438360580 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.304+0000 7f5da6ffd700 1 --2- 172.21.15.72:0/438360580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da8062650 0x7f5da8159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.304+0000 7f5da77fe700 1 --2- 172.21.15.72:0/438360580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da8154240 0x7f5da8066370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.304+0000 7f5da67fc700 1 -- 172.21.15.72:0/438360580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da8154240 msgr2=0x7f5da8066370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.304+0000 7f5da67fc700 1 --2- 172.21.15.72:0/438360580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da8154240 0x7f5da8066370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.304+0000 7f5da67fc700 1 -- 172.21.15.72:0/438360580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da8062650 msgr2=0x7f5da8159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:24.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.304+0000 7f5da67fc700 1 --2- 172.21.15.72:0/438360580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da8062650 0x7f5da8159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.304+0000 7f5da67fc700 1 -- 172.21.15.72:0/438360580 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d980092a0 con 0x7f5da8153e60 2023-08-31T19:00:24.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.304+0000 7f5da67fc700 1 --2- 172.21.15.72:0/438360580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5da8153e60 0x7f5da814c4d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f5d9c001eb0 tx=0x7f5d9c007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:24.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.304+0000 7f5d8effd700 1 -- 172.21.15.72:0/438360580 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00ce90 con 0x7f5da8153e60 2023-08-31T19:00:24.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.305+0000 7f5d8effd700 1 -- 172.21.15.72:0/438360580 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c0072e0 con 0x7f5da8153e60 2023-08-31T19:00:24.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.305+0000 7f5dad3ff700 1 -- 172.21.15.72:0/438360580 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da8158270 con 0x7f5da8153e60 2023-08-31T19:00:24.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.305+0000 7f5d8effd700 1 -- 172.21.15.72:0/438360580 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c007680 con 0x7f5da8153e60 2023-08-31T19:00:24.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.305+0000 7f5dad3ff700 1 -- 172.21.15.72:0/438360580 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da8158830 con 0x7f5da8153e60 2023-08-31T19:00:24.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.306+0000 7f5dad3ff700 1 -- 172.21.15.72:0/438360580 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da806c6b0 con 0x7f5da8153e60 2023-08-31T19:00:24.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.306+0000 7f5d8effd700 1 -- 172.21.15.72:0/438360580 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f5d9c0059b0 con 0x7f5da8153e60 2023-08-31T19:00:24.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.307+0000 7f5d8effd700 1 --2- 172.21.15.72:0/438360580 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d9405ef80 0x7f5d94061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:24.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.307+0000 7f5d8effd700 1 -- 172.21.15.72:0/438360580 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f5d9c0799e0 con 0x7f5da8153e60 2023-08-31T19:00:24.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.307+0000 7f5da6ffd700 1 --2- 172.21.15.72:0/438360580 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d9405ef80 0x7f5d94061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:24.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.308+0000 7f5da6ffd700 1 --2- 172.21.15.72:0/438360580 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d9405ef80 0x7f5d94061440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5d98009fd0 tx=0x7f5d98017000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.311+0000 7f5d8effd700 1 -- 172.21.15.72:0/438360580 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5d9c04ab40 con 0x7f5da8153e60 2023-08-31T19:00:24.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.508+0000 7f5dad3ff700 1 -- 172.21.15.72:0/438360580 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5da80a7380 con 0x7f5d9405ef80 2023-08-31T19:00:24.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.512+0000 7f5d8effd700 1 -- 172.21.15.72:0/438360580 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f5da80a7380 con 0x7f5d9405ef80 2023-08-31T19:00:24.513 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-08-31T19:00:24.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.514+0000 7f5dad3ff700 1 -- 172.21.15.72:0/438360580 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d9405ef80 msgr2=0x7f5d94061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:24.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.514+0000 7f5dad3ff700 1 --2- 172.21.15.72:0/438360580 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d9405ef80 0x7f5d94061440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5d98009fd0 tx=0x7f5d98017000).stop 2023-08-31T19:00:24.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.514+0000 7f5dad3ff700 1 -- 172.21.15.72:0/438360580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5da8153e60 msgr2=0x7f5da814c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:24.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.514+0000 7f5dad3ff700 1 --2- 172.21.15.72:0/438360580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5da8153e60 0x7f5da814c4d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f5d9c001eb0 tx=0x7f5d9c007e90).stop 2023-08-31T19:00:24.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.515+0000 7f5dad3ff700 1 -- 172.21.15.72:0/438360580 shutdown_connections 2023-08-31T19:00:24.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.515+0000 7f5dad3ff700 1 --2- 172.21.15.72:0/438360580 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5da8154240 0x7f5da8066370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.515+0000 7f5dad3ff700 1 --2- 172.21.15.72:0/438360580 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d9405ef80 0x7f5d94061440 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.515+0000 7f5dad3ff700 1 --2- 172.21.15.72:0/438360580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5da8062650 0x7f5da8159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.515+0000 7f5dad3ff700 1 --2- 172.21.15.72:0/438360580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5da8153e60 0x7f5da814c4d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.515+0000 7f5dad3ff700 1 -- 172.21.15.72:0/438360580 >> 172.21.15.72:0/438360580 conn(0x7f5da80c7b50 msgr2=0x7f5da80c73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:24.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.515+0000 7f5dad3ff700 1 -- 172.21.15.72:0/438360580 shutdown_connections 2023-08-31T19:00:24.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.515+0000 7f5dad3ff700 1 -- 172.21.15.72:0/438360580 wait complete. 2023-08-31T19:00:24.532 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-08-31T19:00:24.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:24.533 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-08-31T19:00:24.583 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:24.583 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:24.584 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:24.584 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:24.584 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:24.584 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:24.584 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:24.585 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:24.585 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:24.585 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:24.585 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:24.586 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-31-18_50_00_UTC', 'scheduled-2023-08-31-18_51_00_UTC', 'scheduled-2023-08-31-18_52_00_UTC', 'scheduled-2023-08-31-18_53_00_UTC', 'scheduled-2023-08-31-18_54_00_UTC', 'scheduled-2023-08-31-18_55_00_UTC', 'scheduled-2023-08-31-18_56_00_UTC', 'scheduled-2023-08-31-18_57_00_UTC', 'scheduled-2023-08-31-18_58_00_UTC', 'scheduled-2023-08-31-18_59_00_UTC', 'scheduled-2023-08-31-19_00_00_UTC'] 2023-08-31T19:00:24.587 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-08-31T19:00:24.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.780+0000 7f5d417ff700 1 Processor -- start 2023-08-31T19:00:24.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.780+0000 7f5d417ff700 1 -- start start 2023-08-31T19:00:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.781+0000 7f5d417ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5d3c0c4d10 0x7f5d3c158720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.782+0000 7f5d417ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3c0682a0 con 0x7f5d3c0c5b10 2023-08-31T19:00:24.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.782+0000 7f5d417ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3c0679e0 con 0x7f5d3c0636e0 2023-08-31T19:00:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.782+0000 7f5d417ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3c067c50 con 0x7f5d3c0c4d10 2023-08-31T19:00:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.782+0000 7f5d3b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5d3c0c5b10 0x7f5d3c0c3130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55108/0 (socket says 172.21.15.72:55108) 2023-08-31T19:00:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.782+0000 7f5d3b7fe700 1 -- 172.21.15.72:0/3292638988 learned_addr learned my addr 172.21.15.72:0/3292638988 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.782+0000 7f5d3affd700 1 --2- 172.21.15.72:0/3292638988 >> v2:172.21.15.146:3300/0 conn(0x7f5d3c0c4d10 0x7f5d3c158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:24.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.782+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693992017 0 0) 0x7f5d3c0682a0 con 0x7f5d3c0c5b10 2023-08-31T19:00:24.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.782+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d240033f0 con 0x7f5d3c0c5b10 2023-08-31T19:00:24.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.782+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306708649 0 0) 0x7f5d3c0679e0 con 0x7f5d3c0636e0 2023-08-31T19:00:24.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.782+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d3c0682a0 con 0x7f5d3c0636e0 2023-08-31T19:00:24.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.782+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2529290196 0 0) 0x7f5d240033f0 con 0x7f5d3c0c5b10 2023-08-31T19:00:24.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.782+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 >> v2:172.21.15.146:3300/0 conn(0x7f5d3c0c4d10 msgr2=0x7f5d3c158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:24.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.782+0000 7f5d39ffb700 1 --2- 172.21.15.72:0/3292638988 >> v2:172.21.15.146:3300/0 conn(0x7f5d3c0c4d10 0x7f5d3c158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.782+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 >> v1:172.21.15.146:6789/0 conn(0x7f5d3c0636e0 legacy=0x7f5d3c0c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:24.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c067f30 con 0x7f5d3c0c5b10 2023-08-31T19:00:24.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f5d340017f0 con 0x7f5d3c0c5b10 2023-08-31T19:00:24.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 >> v1:172.21.15.72:6789/0 conn(0x7f5d3c0c5b10 legacy=0x7f5d3c0c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:24.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d39ffb700 1 --2- 172.21.15.72:0/3292638988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d24003a70 0x7f5d24003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:24.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d39ffb700 1 --2- 172.21.15.72:0/3292638988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24004690 0x7f5d24004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:24.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d39ffb700 1 --2- 172.21.15.72:0/3292638988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d24005000 0x7f5d2400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:24.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c067c50 con 0x7f5d24004690 2023-08-31T19:00:24.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2400be80 con 0x7f5d24003a70 2023-08-31T19:00:24.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2400c040 con 0x7f5d24005000 2023-08-31T19:00:24.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d3a7fc700 1 --2- 172.21.15.72:0/3292638988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24004690 0x7f5d24004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:24.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d3affd700 1 --2- 172.21.15.72:0/3292638988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d24003a70 0x7f5d24003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:24.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d3b7fe700 1 --2- 172.21.15.72:0/3292638988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d24005000 0x7f5d2400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:24.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d3a7fc700 1 -- 172.21.15.72:0/3292638988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d24005000 msgr2=0x7f5d2400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:24.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d3a7fc700 1 --2- 172.21.15.72:0/3292638988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d24005000 0x7f5d2400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d3a7fc700 1 -- 172.21.15.72:0/3292638988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d24003a70 msgr2=0x7f5d24003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:24.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d3a7fc700 1 --2- 172.21.15.72:0/3292638988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d24003a70 0x7f5d24003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d3a7fc700 1 -- 172.21.15.72:0/3292638988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d240033f0 con 0x7f5d24004690 2023-08-31T19:00:24.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d3b7fe700 1 -- 172.21.15.72:0/3292638988 reap_dead start 2023-08-31T19:00:24.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.783+0000 7f5d3a7fc700 1 --2- 172.21.15.72:0/3292638988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24004690 0x7f5d24004b10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f5d30001860 tx=0x7f5d30007bb0).ready entity=mon.0 client_cookie=4924824553384891 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:24.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.784+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30007020 con 0x7f5d24004690 2023-08-31T19:00:24.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.784+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d30007180 con 0x7f5d24004690 2023-08-31T19:00:24.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.784+0000 7f5d39ffb700 1 -- 172.21.15.72:0/3292638988 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30007500 con 0x7f5d24004690 2023-08-31T19:00:24.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.784+0000 7f5d417ff700 1 -- 172.21.15.72:0/3292638988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24004690 msgr2=0x7f5d24004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:24.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.784+0000 7f5d417ff700 1 --2- 172.21.15.72:0/3292638988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24004690 0x7f5d24004b10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f5d30001860 tx=0x7f5d30007bb0).stop 2023-08-31T19:00:24.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.784+0000 7f5d417ff700 1 -- 172.21.15.72:0/3292638988 shutdown_connections 2023-08-31T19:00:24.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.784+0000 7f5d417ff700 1 --2- 172.21.15.72:0/3292638988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24004690 0x7f5d24004b10 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.784+0000 7f5d417ff700 1 -- 172.21.15.72:0/3292638988 >> 172.21.15.72:0/3292638988 conn(0x7f5d3c066350 msgr2=0x7f5d3c066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:24.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.784+0000 7f5d417ff700 1 -- 172.21.15.72:0/3292638988 shutdown_connections 2023-08-31T19:00:24.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.784+0000 7f5d417ff700 1 -- 172.21.15.72:0/3292638988 wait complete. 2023-08-31T19:00:24.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.786+0000 7f5d417ff700 1 Processor -- start 2023-08-31T19:00:24.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.787+0000 7f5d417ff700 1 -- start start 2023-08-31T19:00:24.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d417ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24004690 0x7f5d3c0c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:24.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d417ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d3c0c1fa0 0x7f5d3c0a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:24.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d417ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d3c0a8960 0x7f5d3c0a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:24.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d417ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0a92d0 con 0x7f5d24004690 2023-08-31T19:00:24.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d417ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c13c2f0 con 0x7f5d3c0a8960 2023-08-31T19:00:24.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d417ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0c2850 con 0x7f5d3c0c1fa0 2023-08-31T19:00:24.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d3affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24004690 0x7f5d3c0c1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:24.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d3affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24004690 0x7f5d3c0c1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53964/0 (socket says 172.21.15.72:53964) 2023-08-31T19:00:24.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d3affd700 1 -- 172.21.15.72:0/285297880 learned_addr learned my addr 172.21.15.72:0/285297880 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:24.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d3a7fc700 1 --2- 172.21.15.72:0/285297880 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d3c0c1fa0 0x7f5d3c0a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:24.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d3b7fe700 1 --2- 172.21.15.72:0/285297880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d3c0a8960 0x7f5d3c0a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:24.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d3affd700 1 -- 172.21.15.72:0/285297880 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d3c0c1fa0 msgr2=0x7f5d3c0a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:24.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d3affd700 1 --2- 172.21.15.72:0/285297880 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d3c0c1fa0 0x7f5d3c0a8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d3affd700 1 -- 172.21.15.72:0/285297880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d3c0a8960 msgr2=0x7f5d3c0a8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:24.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d3affd700 1 --2- 172.21.15.72:0/285297880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d3c0a8960 0x7f5d3c0a8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.788+0000 7f5d3affd700 1 -- 172.21.15.72:0/285297880 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c13c5b0 con 0x7f5d24004690 2023-08-31T19:00:24.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.789+0000 7f5d3affd700 1 --2- 172.21.15.72:0/285297880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24004690 0x7f5d3c0c1ab0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f5d2c0119a0 tx=0x7f5d2c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:24.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.789+0000 7f5d22ffd700 1 -- 172.21.15.72:0/285297880 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c011ee0 con 0x7f5d24004690 2023-08-31T19:00:24.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.789+0000 7f5d22ffd700 1 -- 172.21.15.72:0/285297880 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2c00f940 con 0x7f5d24004690 2023-08-31T19:00:24.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.789+0000 7f5d417ff700 1 -- 172.21.15.72:0/285297880 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3c13c890 con 0x7f5d24004690 2023-08-31T19:00:24.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.789+0000 7f5d22ffd700 1 -- 172.21.15.72:0/285297880 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c00fcc0 con 0x7f5d24004690 2023-08-31T19:00:24.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.789+0000 7f5d417ff700 1 -- 172.21.15.72:0/285297880 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3c139ec0 con 0x7f5d24004690 2023-08-31T19:00:24.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.790+0000 7f5d417ff700 1 -- 172.21.15.72:0/285297880 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3c13cad0 con 0x7f5d24004690 2023-08-31T19:00:24.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.791+0000 7f5d22ffd700 1 -- 172.21.15.72:0/285297880 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f5d2c014650 con 0x7f5d24004690 2023-08-31T19:00:24.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.792+0000 7f5d22ffd700 1 --2- 172.21.15.72:0/285297880 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d2805efb0 0x7f5d28061470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:24.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.792+0000 7f5d22ffd700 1 -- 172.21.15.72:0/285297880 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f5d2c07ac00 con 0x7f5d24004690 2023-08-31T19:00:24.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.792+0000 7f5d3a7fc700 1 --2- 172.21.15.72:0/285297880 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d2805efb0 0x7f5d28061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:24.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.792+0000 7f5d3a7fc700 1 --2- 172.21.15.72:0/285297880 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d2805efb0 0x7f5d28061470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5d3c13bae0 tx=0x7f5d30015000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:24.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.796+0000 7f5d22ffd700 1 -- 172.21.15.72:0/285297880 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5d3c13cad0 con 0x7f5d24004690 2023-08-31T19:00:24.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.988+0000 7f5d417ff700 1 -- 172.21.15.72:0/285297880 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d3c13c170 con 0x7f5d2805efb0 2023-08-31T19:00:24.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.989+0000 7f5d22ffd700 1 -- 172.21.15.72:0/285297880 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f5d300072f0 con 0x7f5d2805efb0 2023-08-31T19:00:24.989 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:24.990 INFO:teuthology.orchestra.run.smithi072.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:11", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:24.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.991+0000 7f5d417ff700 1 -- 172.21.15.72:0/285297880 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d2805efb0 msgr2=0x7f5d28061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:24.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.991+0000 7f5d417ff700 1 --2- 172.21.15.72:0/285297880 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d2805efb0 0x7f5d28061470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5d3c13bae0 tx=0x7f5d30015000).stop 2023-08-31T19:00:24.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.991+0000 7f5d417ff700 1 -- 172.21.15.72:0/285297880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24004690 msgr2=0x7f5d3c0c1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:24.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.991+0000 7f5d417ff700 1 --2- 172.21.15.72:0/285297880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24004690 0x7f5d3c0c1ab0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f5d2c0119a0 tx=0x7f5d2c009060).stop 2023-08-31T19:00:24.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.991+0000 7f5d417ff700 1 -- 172.21.15.72:0/285297880 shutdown_connections 2023-08-31T19:00:24.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.991+0000 7f5d417ff700 1 --2- 172.21.15.72:0/285297880 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5d2805efb0 0x7f5d28061470 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.991+0000 7f5d417ff700 1 --2- 172.21.15.72:0/285297880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d3c0a8960 0x7f5d3c0a8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.991+0000 7f5d417ff700 1 --2- 172.21.15.72:0/285297880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d24004690 0x7f5d3c0c1ab0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.991+0000 7f5d417ff700 1 --2- 172.21.15.72:0/285297880 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5d3c0c1fa0 0x7f5d3c0a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:24.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.991+0000 7f5d417ff700 1 -- 172.21.15.72:0/285297880 >> 172.21.15.72:0/285297880 conn(0x7f5d3c066350 msgr2=0x7f5d3c0c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:24.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.992+0000 7f5d417ff700 1 -- 172.21.15.72:0/285297880 shutdown_connections 2023-08-31T19:00:24.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:24.992+0000 7f5d417ff700 1 -- 172.21.15.72:0/285297880 wait complete. 2023-08-31T19:00:25.009 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:11", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:25.009 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-08-31T00:00:00', 'created': '2023-08-31T18:49:11', 'first': '2023-08-31T18:50:00', 'last': '2023-08-31T19:00:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-31T19:00:25.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:25.010 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-08-31T19:00:25.058 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:25.059 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:25.059 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:25.059 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:25.059 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:25.060 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:25.060 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:25.060 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:25.060 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:25.060 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:25.061 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:25.062 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-31-18_50_00_UTC', 'scheduled-2023-08-31-18_51_00_UTC', 'scheduled-2023-08-31-18_52_00_UTC', 'scheduled-2023-08-31-18_53_00_UTC', 'scheduled-2023-08-31-18_54_00_UTC', 'scheduled-2023-08-31-18_55_00_UTC', 'scheduled-2023-08-31-18_56_00_UTC', 'scheduled-2023-08-31-18_57_00_UTC', 'scheduled-2023-08-31-18_58_00_UTC', 'scheduled-2023-08-31-18_59_00_UTC', 'scheduled-2023-08-31-19_00_00_UTC'] 2023-08-31T19:00:25.062 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-08-31T19:00:25.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.255+0000 7fa4affff700 1 Processor -- start 2023-08-31T19:00:25.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.256+0000 7fa4affff700 1 -- start start 2023-08-31T19:00:25.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.257+0000 7fa4affff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4a8154500 0x7fa4a80a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.257+0000 7fa4affff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a80aa620 con 0x7fa4a8064db0 2023-08-31T19:00:25.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.257+0000 7fa4affff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a80aa3a0 con 0x7fa4a8154120 2023-08-31T19:00:25.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.257+0000 7fa4affff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80c5450 con 0x7fa4a8154500 2023-08-31T19:00:25.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.257+0000 7fa4ad59a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa4a8064db0 0x7fa4a815beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55110/0 (socket says 172.21.15.72:55110) 2023-08-31T19:00:25.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.257+0000 7fa4ad59a700 1 -- 172.21.15.72:0/664094891 learned_addr learned my addr 172.21.15.72:0/664094891 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4ae59c700 1 --2- 172.21.15.72:0/664094891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4a8154500 0x7fa4a80a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591067727 0 0) 0x7fa4a80aa620 con 0x7fa4a8064db0 2023-08-31T19:00:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4940033f0 con 0x7fa4a8064db0 2023-08-31T19:00:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058204752 0 0) 0x7fa4a80aa3a0 con 0x7fa4a8154120 2023-08-31T19:00:25.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a80aa620 con 0x7fa4a8154120 2023-08-31T19:00:25.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1114074784 0 0) 0x7fa4940033f0 con 0x7fa4a8064db0 2023-08-31T19:00:25.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4a8154500 msgr2=0x7fa4a80a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:25.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 --2- 172.21.15.72:0/664094891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4a8154500 0x7fa4a80a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 >> v1:172.21.15.146:6789/0 conn(0x7fa4a8154120 legacy=0x7fa4a80646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:25.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a80c8050 con 0x7fa4a8064db0 2023-08-31T19:00:25.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fa498001470 con 0x7fa4a8064db0 2023-08-31T19:00:25.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 >> v1:172.21.15.72:6789/0 conn(0x7fa4a8064db0 legacy=0x7fa4a815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:25.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 --2- 172.21.15.72:0/664094891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa494003aa0 0x7fa494003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 --2- 172.21.15.72:0/664094891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4a8154500 0x7fa494004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 --2- 172.21.15.72:0/664094891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa494004b80 0x7fa494005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80c5450 con 0x7fa494004b80 2023-08-31T19:00:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49400b910 con 0x7fa494003aa0 2023-08-31T19:00:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.258+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49400bad0 con 0x7fa4a8154500 2023-08-31T19:00:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.259+0000 7fa4ae59c700 1 --2- 172.21.15.72:0/664094891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa494004b80 0x7fa494005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.259+0000 7fa4ad59a700 1 --2- 172.21.15.72:0/664094891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4a8154500 0x7fa494004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.259+0000 7fa4add9b700 1 --2- 172.21.15.72:0/664094891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa494003aa0 0x7fa494003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.259+0000 7fa4ae59c700 1 -- 172.21.15.72:0/664094891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4a8154500 msgr2=0x7fa494004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.259+0000 7fa4ae59c700 1 --2- 172.21.15.72:0/664094891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4a8154500 0x7fa494004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.259+0000 7fa4ae59c700 1 -- 172.21.15.72:0/664094891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa494003aa0 msgr2=0x7fa494003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.259+0000 7fa4ae59c700 1 --2- 172.21.15.72:0/664094891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa494003aa0 0x7fa494003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.259+0000 7fa4ae59c700 1 -- 172.21.15.72:0/664094891 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4940033f0 con 0x7fa494004b80 2023-08-31T19:00:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.259+0000 7fa4ae59c700 1 --2- 172.21.15.72:0/664094891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa494004b80 0x7fa494005000 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fa4a8065340 tx=0x7fa4a000b040).ready entity=mon.0 client_cookie=d860dab81beecfa0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.259+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0009ac0 con 0x7fa494004b80 2023-08-31T19:00:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.259+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a000f040 con 0x7fa494004b80 2023-08-31T19:00:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.259+0000 7fa4acd99700 1 -- 172.21.15.72:0/664094891 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a000eca0 con 0x7fa494004b80 2023-08-31T19:00:25.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.260+0000 7fa4affff700 1 -- 172.21.15.72:0/664094891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa494004b80 msgr2=0x7fa494005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:25.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.260+0000 7fa4affff700 1 --2- 172.21.15.72:0/664094891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa494004b80 0x7fa494005000 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fa4a8065340 tx=0x7fa4a000b040).stop 2023-08-31T19:00:25.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.260+0000 7fa4ae59c700 1 -- 172.21.15.72:0/664094891 reap_dead start 2023-08-31T19:00:25.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.260+0000 7fa4affff700 1 -- 172.21.15.72:0/664094891 shutdown_connections 2023-08-31T19:00:25.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.260+0000 7fa4affff700 1 -- 172.21.15.72:0/664094891 >> 172.21.15.72:0/664094891 conn(0x7fa4a80cb7e0 msgr2=0x7fa4a80c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:25.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.260+0000 7fa4affff700 1 -- 172.21.15.72:0/664094891 shutdown_connections 2023-08-31T19:00:25.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.260+0000 7fa4affff700 1 -- 172.21.15.72:0/664094891 wait complete. 2023-08-31T19:00:25.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.261+0000 7fa4affff700 1 Processor -- start 2023-08-31T19:00:25.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.262+0000 7fa4affff700 1 -- start start 2023-08-31T19:00:25.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4affff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa494004b80 0x7fa4a80adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4affff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4a814a8d0 0x7fa4a8150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4affff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4a814ad50 0x7fa4a8150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4affff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a81509f0 con 0x7fa494004b80 2023-08-31T19:00:25.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4affff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80ae3b0 con 0x7fa4a814ad50 2023-08-31T19:00:25.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4affff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80c1ad0 con 0x7fa4a814a8d0 2023-08-31T19:00:25.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4add9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa494004b80 0x7fa4a80adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4add9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa494004b80 0x7fa4a80adec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53974/0 (socket says 172.21.15.72:53974) 2023-08-31T19:00:25.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4add9b700 1 -- 172.21.15.72:0/2848691077 learned_addr learned my addr 172.21.15.72:0/2848691077 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:25.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4ae59c700 1 --2- 172.21.15.72:0/2848691077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4a814ad50 0x7fa4a8150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4ad59a700 1 --2- 172.21.15.72:0/2848691077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4a814a8d0 0x7fa4a8150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4add9b700 1 -- 172.21.15.72:0/2848691077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4a814a8d0 msgr2=0x7fa4a8150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:25.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4add9b700 1 --2- 172.21.15.72:0/2848691077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4a814a8d0 0x7fa4a8150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4add9b700 1 -- 172.21.15.72:0/2848691077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4a814ad50 msgr2=0x7fa4a8150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:25.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4add9b700 1 --2- 172.21.15.72:0/2848691077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4a814ad50 0x7fa4a8150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4add9b700 1 -- 172.21.15.72:0/2848691077 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a80c1f40 con 0x7fa494004b80 2023-08-31T19:00:25.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.263+0000 7fa4add9b700 1 --2- 172.21.15.72:0/2848691077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa494004b80 0x7fa4a80adec0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fa4a4002a90 tx=0x7fa4a4007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:25.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.264+0000 7fa49dffb700 1 -- 172.21.15.72:0/2848691077 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400f8d0 con 0x7fa494004b80 2023-08-31T19:00:25.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.264+0000 7fa49dffb700 1 -- 172.21.15.72:0/2848691077 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a400fa30 con 0x7fa494004b80 2023-08-31T19:00:25.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.264+0000 7fa4affff700 1 -- 172.21.15.72:0/2848691077 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a80c2220 con 0x7fa494004b80 2023-08-31T19:00:25.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.264+0000 7fa49dffb700 1 -- 172.21.15.72:0/2848691077 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400fdb0 con 0x7fa494004b80 2023-08-31T19:00:25.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.264+0000 7fa4affff700 1 -- 172.21.15.72:0/2848691077 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a80c27e0 con 0x7fa494004b80 2023-08-31T19:00:25.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.265+0000 7fa4affff700 1 -- 172.21.15.72:0/2848691077 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a8063c50 con 0x7fa494004b80 2023-08-31T19:00:25.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.265+0000 7fa49dffb700 1 -- 172.21.15.72:0/2848691077 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fa4a4014660 con 0x7fa494004b80 2023-08-31T19:00:25.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.267+0000 7fa49dffb700 1 --2- 172.21.15.72:0/2848691077 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa48c05ef80 0x7fa48c061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.267+0000 7fa49dffb700 1 -- 172.21.15.72:0/2848691077 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fa4a4079fe0 con 0x7fa494004b80 2023-08-31T19:00:25.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.267+0000 7fa4ad59a700 1 --2- 172.21.15.72:0/2848691077 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa48c05ef80 0x7fa48c061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.267+0000 7fa4ad59a700 1 --2- 172.21.15.72:0/2848691077 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa48c05ef80 0x7fa48c061440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa4a815ac70 tx=0x7fa498001e10).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:25.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.271+0000 7fa49dffb700 1 -- 172.21.15.72:0/2848691077 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa4a404a8f0 con 0x7fa494004b80 2023-08-31T19:00:25.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.465+0000 7fa4affff700 1 -- 172.21.15.72:0/2848691077 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4a806a7e0 con 0x7fa48c05ef80 2023-08-31T19:00:25.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.466+0000 7fa49dffb700 1 -- 172.21.15.72:0/2848691077 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fa4a806a7e0 con 0x7fa48c05ef80 2023-08-31T19:00:25.467 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:25.467 INFO:teuthology.orchestra.run.smithi072.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:12", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.468+0000 7fa4affff700 1 -- 172.21.15.72:0/2848691077 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa48c05ef80 msgr2=0x7fa48c061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.468+0000 7fa4affff700 1 --2- 172.21.15.72:0/2848691077 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa48c05ef80 0x7fa48c061440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa4a815ac70 tx=0x7fa498001e10).stop 2023-08-31T19:00:25.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.468+0000 7fa4affff700 1 -- 172.21.15.72:0/2848691077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa494004b80 msgr2=0x7fa4a80adec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:25.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.468+0000 7fa4affff700 1 --2- 172.21.15.72:0/2848691077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa494004b80 0x7fa4a80adec0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fa4a4002a90 tx=0x7fa4a4007bb0).stop 2023-08-31T19:00:25.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.469+0000 7fa4affff700 1 -- 172.21.15.72:0/2848691077 shutdown_connections 2023-08-31T19:00:25.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.469+0000 7fa4affff700 1 --2- 172.21.15.72:0/2848691077 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa48c05ef80 0x7fa48c061440 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.469+0000 7fa4affff700 1 --2- 172.21.15.72:0/2848691077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4a814ad50 0x7fa4a8150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.469+0000 7fa4affff700 1 --2- 172.21.15.72:0/2848691077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa494004b80 0x7fa4a80adec0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.469+0000 7fa4affff700 1 --2- 172.21.15.72:0/2848691077 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4a814a8d0 0x7fa4a8150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.469+0000 7fa4affff700 1 -- 172.21.15.72:0/2848691077 >> 172.21.15.72:0/2848691077 conn(0x7fa4a80cb7e0 msgr2=0x7fa4a81531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:25.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.469+0000 7fa4affff700 1 -- 172.21.15.72:0/2848691077 shutdown_connections 2023-08-31T19:00:25.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.469+0000 7fa4affff700 1 -- 172.21.15.72:0/2848691077 wait complete. 2023-08-31T19:00:25.486 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:12", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:25.486 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-08-31T00:00:00', 'created': '2023-08-31T18:49:12', 'first': '2023-08-31T18:50:00', 'last': '2023-08-31T19:00:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-31T19:00:25.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:25.487 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-08-31T19:00:25.535 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:25.535 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:25.536 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:25.536 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:25.536 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:25.536 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:25.536 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:25.537 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:25.537 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:25.537 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:25.537 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:25.538 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-31-18_50_00_UTC', 'scheduled-2023-08-31-18_51_00_UTC', 'scheduled-2023-08-31-18_52_00_UTC', 'scheduled-2023-08-31-18_53_00_UTC', 'scheduled-2023-08-31-18_54_00_UTC', 'scheduled-2023-08-31-18_55_00_UTC', 'scheduled-2023-08-31-18_56_00_UTC', 'scheduled-2023-08-31-18_57_00_UTC', 'scheduled-2023-08-31-18_58_00_UTC', 'scheduled-2023-08-31-18_59_00_UTC', 'scheduled-2023-08-31-19_00_00_UTC'] 2023-08-31T19:00:25.539 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-08-31T19:00:25.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.733+0000 7f9393dff700 1 Processor -- start 2023-08-31T19:00:25.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.733+0000 7f9393dff700 1 -- start start 2023-08-31T19:00:25.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.734+0000 7f9393dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f938c13d960 0x7f938c0653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.734+0000 7f9393dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c0c4f90 con 0x7f938c0c4bb0 2023-08-31T19:00:25.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.734+0000 7f9393dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c0c6020 con 0x7f938c0c5aa0 2023-08-31T19:00:25.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.734+0000 7f9393dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938c1587f0 con 0x7f938c13d960 2023-08-31T19:00:25.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.734+0000 7f9391b9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f938c0c4bb0 0x7f938c0c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55124/0 (socket says 172.21.15.72:55124) 2023-08-31T19:00:25.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.734+0000 7f9391b9b700 1 -- 172.21.15.72:0/4152847948 learned_addr learned my addr 172.21.15.72:0/4152847948 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:25.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9390b99700 1 -- 172.21.15.72:0/4152847948 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223953837 0 0) 0x7f938c0c4f90 con 0x7f938c0c4bb0 2023-08-31T19:00:25.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9390b99700 1 -- 172.21.15.72:0/4152847948 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93780033f0 con 0x7f938c0c4bb0 2023-08-31T19:00:25.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f939239c700 1 --2- 172.21.15.72:0/4152847948 >> v2:172.21.15.146:3300/0 conn(0x7f938c13d960 0x7f938c0653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9390b99700 1 -- 172.21.15.72:0/4152847948 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2339143171 0 0) 0x7f93780033f0 con 0x7f938c0c4bb0 2023-08-31T19:00:25.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9390b99700 1 -- 172.21.15.72:0/4152847948 >> v2:172.21.15.146:3300/0 conn(0x7f938c13d960 msgr2=0x7f938c0653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:25.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9390b99700 1 --2- 172.21.15.72:0/4152847948 >> v2:172.21.15.146:3300/0 conn(0x7f938c13d960 0x7f938c0653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9390b99700 1 -- 172.21.15.72:0/4152847948 >> v1:172.21.15.146:6789/0 conn(0x7f938c0c5aa0 legacy=0x7f938c067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:25.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9390b99700 1 -- 172.21.15.72:0/4152847948 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c158ad0 con 0x7f938c0c4bb0 2023-08-31T19:00:25.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9390b99700 1 -- 172.21.15.72:0/4152847948 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f9388001470 con 0x7f938c0c4bb0 2023-08-31T19:00:25.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9390b99700 1 -- 172.21.15.72:0/4152847948 >> v1:172.21.15.72:6789/0 conn(0x7f938c0c4bb0 legacy=0x7f938c0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:25.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9390b99700 1 --2- 172.21.15.72:0/4152847948 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780038e0 0x7f9378003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9390b99700 1 --2- 172.21.15.72:0/4152847948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9378004690 0x7f9378004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9390b99700 1 --2- 172.21.15.72:0/4152847948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9378005000 0x7f937800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9390b99700 1 -- 172.21.15.72:0/4152847948 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c1587f0 con 0x7f93780038e0 2023-08-31T19:00:25.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9390b99700 1 -- 172.21.15.72:0/4152847948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937800beb0 con 0x7f9378005000 2023-08-31T19:00:25.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9390b99700 1 -- 172.21.15.72:0/4152847948 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937800c070 con 0x7f9378004690 2023-08-31T19:00:25.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.735+0000 7f9391b9b700 1 --2- 172.21.15.72:0/4152847948 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780038e0 0x7f9378003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.736+0000 7f939239c700 1 --2- 172.21.15.72:0/4152847948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9378005000 0x7f937800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.736+0000 7f939139a700 1 --2- 172.21.15.72:0/4152847948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9378004690 0x7f9378004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.736+0000 7f9391b9b700 1 -- 172.21.15.72:0/4152847948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9378004690 msgr2=0x7f9378004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:25.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.736+0000 7f9391b9b700 1 --2- 172.21.15.72:0/4152847948 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9378004690 0x7f9378004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.736+0000 7f9391b9b700 1 -- 172.21.15.72:0/4152847948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9378005000 msgr2=0x7f937800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:25.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.736+0000 7f9391b9b700 1 --2- 172.21.15.72:0/4152847948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9378005000 0x7f937800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.736+0000 7f9391b9b700 1 -- 172.21.15.72:0/4152847948 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93780033f0 con 0x7f93780038e0 2023-08-31T19:00:25.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.736+0000 7f939239c700 1 -- 172.21.15.72:0/4152847948 reap_dead start 2023-08-31T19:00:25.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.736+0000 7f9391b9b700 1 --2- 172.21.15.72:0/4152847948 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780038e0 0x7f9378003d00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f938800c190 tx=0x7f9388001e50).ready entity=mon.0 client_cookie=c2a74b8f60095c7d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:25.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.736+0000 7f9390b99700 1 -- 172.21.15.72:0/4152847948 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388007a20 con 0x7f93780038e0 2023-08-31T19:00:25.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.736+0000 7f9390b99700 1 -- 172.21.15.72:0/4152847948 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938800cac0 con 0x7f93780038e0 2023-08-31T19:00:25.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.736+0000 7f9390b99700 1 -- 172.21.15.72:0/4152847948 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938800ce40 con 0x7f93780038e0 2023-08-31T19:00:25.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.737+0000 7f9393dff700 1 -- 172.21.15.72:0/4152847948 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780038e0 msgr2=0x7f9378003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:25.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.737+0000 7f9393dff700 1 --2- 172.21.15.72:0/4152847948 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780038e0 0x7f9378003d00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f938800c190 tx=0x7f9388001e50).stop 2023-08-31T19:00:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.737+0000 7f9393dff700 1 -- 172.21.15.72:0/4152847948 shutdown_connections 2023-08-31T19:00:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.737+0000 7f9393dff700 1 --2- 172.21.15.72:0/4152847948 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780038e0 0x7f9378003d00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.737+0000 7f9393dff700 1 -- 172.21.15.72:0/4152847948 >> 172.21.15.72:0/4152847948 conn(0x7f938c066350 msgr2=0x7f938c066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.737+0000 7f9393dff700 1 -- 172.21.15.72:0/4152847948 shutdown_connections 2023-08-31T19:00:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.737+0000 7f9393dff700 1 -- 172.21.15.72:0/4152847948 wait complete. 2023-08-31T19:00:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.738+0000 7f9393dff700 1 Processor -- start 2023-08-31T19:00:25.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.738+0000 7f9393dff700 1 -- start start 2023-08-31T19:00:25.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.739+0000 7f9393dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780038e0 0x7f938c1538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.739+0000 7f9393dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938c153dc0 0x7f938c067e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.739+0000 7f9393dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f938c068340 0x7f938c0c16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.739+0000 7f9393dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c1398d0 con 0x7f93780038e0 2023-08-31T19:00:25.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.739+0000 7f9393dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c1644e0 con 0x7f938c153dc0 2023-08-31T19:00:25.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.739+0000 7f9393dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938c0687c0 con 0x7f938c068340 2023-08-31T19:00:25.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.739+0000 7f9391b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780038e0 0x7f938c1538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.740+0000 7f9391b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780038e0 0x7f938c1538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54002/0 (socket says 172.21.15.72:54002) 2023-08-31T19:00:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.740+0000 7f9391b9b700 1 -- 172.21.15.72:0/1044289817 learned_addr learned my addr 172.21.15.72:0/1044289817 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.740+0000 7f939139a700 1 --2- 172.21.15.72:0/1044289817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938c153dc0 0x7f938c067e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.740+0000 7f939239c700 1 --2- 172.21.15.72:0/1044289817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f938c068340 0x7f938c0c16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.740+0000 7f9391b9b700 1 -- 172.21.15.72:0/1044289817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f938c068340 msgr2=0x7f938c0c16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.740+0000 7f9391b9b700 1 --2- 172.21.15.72:0/1044289817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f938c068340 0x7f938c0c16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.740+0000 7f9391b9b700 1 -- 172.21.15.72:0/1044289817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938c153dc0 msgr2=0x7f938c067e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.740+0000 7f9391b9b700 1 --2- 172.21.15.72:0/1044289817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938c153dc0 0x7f938c067e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.740+0000 7f9391b9b700 1 -- 172.21.15.72:0/1044289817 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c164730 con 0x7f93780038e0 2023-08-31T19:00:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.740+0000 7f9391b9b700 1 --2- 172.21.15.72:0/1044289817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780038e0 0x7f938c1538d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f938800c780 tx=0x7f9388015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.740+0000 7f9381ffb700 1 -- 172.21.15.72:0/1044289817 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93880073b0 con 0x7f93780038e0 2023-08-31T19:00:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.740+0000 7f9381ffb700 1 -- 172.21.15.72:0/1044289817 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9388007510 con 0x7f93780038e0 2023-08-31T19:00:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.740+0000 7f9381ffb700 1 -- 172.21.15.72:0/1044289817 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93880048e0 con 0x7f93780038e0 2023-08-31T19:00:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.740+0000 7f9393dff700 1 -- 172.21.15.72:0/1044289817 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c164a10 con 0x7f93780038e0 2023-08-31T19:00:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.741+0000 7f9393dff700 1 -- 172.21.15.72:0/1044289817 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c164fd0 con 0x7f93780038e0 2023-08-31T19:00:25.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.742+0000 7f9393dff700 1 -- 172.21.15.72:0/1044289817 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c1651f0 con 0x7f93780038e0 2023-08-31T19:00:25.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.742+0000 7f9381ffb700 1 -- 172.21.15.72:0/1044289817 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f938801c070 con 0x7f93780038e0 2023-08-31T19:00:25.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.743+0000 7f9381ffb700 1 --2- 172.21.15.72:0/1044289817 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f937005ef50 0x7f9370061410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:25.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.743+0000 7f9381ffb700 1 -- 172.21.15.72:0/1044289817 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f938807a870 con 0x7f93780038e0 2023-08-31T19:00:25.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.743+0000 7f939139a700 1 --2- 172.21.15.72:0/1044289817 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f937005ef50 0x7f9370061410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:25.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.744+0000 7f939139a700 1 --2- 172.21.15.72:0/1044289817 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f937005ef50 0x7f9370061410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f938c1541c0 tx=0x7f937c009040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:25.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.747+0000 7f9381ffb700 1 -- 172.21.15.72:0/1044289817 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f938804ba90 con 0x7f93780038e0 2023-08-31T19:00:25.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.941+0000 7f9393dff700 1 -- 172.21.15.72:0/1044289817 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f938c06c6b0 con 0x7f937005ef50 2023-08-31T19:00:25.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.942+0000 7f9381ffb700 1 -- 172.21.15.72:0/1044289817 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f938c06c6b0 con 0x7f937005ef50 2023-08-31T19:00:25.943 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:25.943 INFO:teuthology.orchestra.run.smithi072.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:12", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:25.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.944+0000 7f9393dff700 1 -- 172.21.15.72:0/1044289817 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f937005ef50 msgr2=0x7f9370061410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:25.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.944+0000 7f9393dff700 1 --2- 172.21.15.72:0/1044289817 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f937005ef50 0x7f9370061410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f938c1541c0 tx=0x7f937c009040).stop 2023-08-31T19:00:25.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.944+0000 7f9393dff700 1 -- 172.21.15.72:0/1044289817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780038e0 msgr2=0x7f938c1538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:25.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.944+0000 7f9393dff700 1 --2- 172.21.15.72:0/1044289817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780038e0 0x7f938c1538d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f938800c780 tx=0x7f9388015000).stop 2023-08-31T19:00:25.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.945+0000 7f9393dff700 1 -- 172.21.15.72:0/1044289817 shutdown_connections 2023-08-31T19:00:25.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.945+0000 7f9393dff700 1 --2- 172.21.15.72:0/1044289817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f938c068340 0x7f938c0c16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.945+0000 7f9393dff700 1 --2- 172.21.15.72:0/1044289817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93780038e0 0x7f938c1538d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.945+0000 7f9393dff700 1 --2- 172.21.15.72:0/1044289817 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f937005ef50 0x7f9370061410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.945+0000 7f9393dff700 1 --2- 172.21.15.72:0/1044289817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f938c153dc0 0x7f938c067e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:25.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.945+0000 7f9393dff700 1 -- 172.21.15.72:0/1044289817 >> 172.21.15.72:0/1044289817 conn(0x7f938c066350 msgr2=0x7f938c13d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:25.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.945+0000 7f9393dff700 1 -- 172.21.15.72:0/1044289817 shutdown_connections 2023-08-31T19:00:25.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:25.945+0000 7f9393dff700 1 -- 172.21.15.72:0/1044289817 wait complete. 2023-08-31T19:00:25.962 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:12", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:25.963 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-08-31T00:00:00', 'created': '2023-08-31T18:49:12', 'first': '2023-08-31T18:50:00', 'last': '2023-08-31T19:00:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-31T19:00:25.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:25.963 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-08-31T19:00:26.012 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:26.013 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:26.013 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:26.013 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:26.013 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:26.013 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:26.014 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:26.014 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:26.014 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:26.014 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:26.015 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:26.016 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-31-18_50_00_UTC', 'scheduled-2023-08-31-18_51_00_UTC', 'scheduled-2023-08-31-18_52_00_UTC', 'scheduled-2023-08-31-18_53_00_UTC', 'scheduled-2023-08-31-18_54_00_UTC', 'scheduled-2023-08-31-18_55_00_UTC', 'scheduled-2023-08-31-18_56_00_UTC', 'scheduled-2023-08-31-18_57_00_UTC', 'scheduled-2023-08-31-18_58_00_UTC', 'scheduled-2023-08-31-18_59_00_UTC', 'scheduled-2023-08-31-19_00_00_UTC'] 2023-08-31T19:00:26.016 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-08-31T19:00:26.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.208+0000 7fcfff5ff700 1 Processor -- start 2023-08-31T19:00:26.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.208+0000 7fcfff5ff700 1 -- start start 2023-08-31T19:00:26.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.209+0000 7fcfff5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcff80c5aa0 0x7fcff80653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:26.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.209+0000 7fcfff5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcff813d960 0x7fcff8067a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:26.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.209+0000 7fcfff5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff80c4f90 con 0x7fcff80c4bb0 2023-08-31T19:00:26.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.209+0000 7fcfff5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff80c6020 con 0x7fcff813d960 2023-08-31T19:00:26.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.209+0000 7fcfff5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff81587f0 con 0x7fcff80c5aa0 2023-08-31T19:00:26.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.209+0000 7fcffdb9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcff813d960 0x7fcff8067a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:26.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.210+0000 7fcffdb9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcff813d960 0x7fcff8067a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54014/0 (socket says 172.21.15.72:54014) 2023-08-31T19:00:26.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.210+0000 7fcffdb9c700 1 -- 172.21.15.72:0/1941935419 learned_addr learned my addr 172.21.15.72:0/1941935419 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:26.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.210+0000 7fcffcb9a700 1 --2- 172.21.15.72:0/1941935419 >> v2:172.21.15.146:3300/0 conn(0x7fcff80c5aa0 0x7fcff80653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:26.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.210+0000 7fcffdb9c700 1 -- 172.21.15.72:0/1941935419 >> v2:172.21.15.146:3300/0 conn(0x7fcff80c5aa0 msgr2=0x7fcff80653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:26.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.210+0000 7fcffdb9c700 1 --2- 172.21.15.72:0/1941935419 >> v2:172.21.15.146:3300/0 conn(0x7fcff80c5aa0 0x7fcff80653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.210+0000 7fcffdb9c700 1 -- 172.21.15.72:0/1941935419 >> v1:172.21.15.146:6789/0 conn(0x7fcff80c4bb0 legacy=0x7fcff80c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:26.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.210+0000 7fcffdb9c700 1 -- 172.21.15.72:0/1941935419 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff8158ad0 con 0x7fcff813d960 2023-08-31T19:00:26.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.210+0000 7fcffdb9c700 1 --2- 172.21.15.72:0/1941935419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff813d960 0x7fcff8067a20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fcff8069410 tx=0x7fcff0009840).ready entity=mon.0 client_cookie=f087324135cf92a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:26.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.210+0000 7fcfeffff700 1 -- 172.21.15.72:0/1941935419 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000e070 con 0x7fcff813d960 2023-08-31T19:00:26.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.210+0000 7fcfeffff700 1 -- 172.21.15.72:0/1941935419 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff000ba10 con 0x7fcff813d960 2023-08-31T19:00:26.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.210+0000 7fcfeffff700 1 -- 172.21.15.72:0/1941935419 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000bd90 con 0x7fcff813d960 2023-08-31T19:00:26.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.211+0000 7fcfff5ff700 1 -- 172.21.15.72:0/1941935419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff813d960 msgr2=0x7fcff8067a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:26.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.211+0000 7fcfff5ff700 1 --2- 172.21.15.72:0/1941935419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff813d960 0x7fcff8067a20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fcff8069410 tx=0x7fcff0009840).stop 2023-08-31T19:00:26.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.211+0000 7fcfff5ff700 1 -- 172.21.15.72:0/1941935419 shutdown_connections 2023-08-31T19:00:26.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.211+0000 7fcfff5ff700 1 --2- 172.21.15.72:0/1941935419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff813d960 0x7fcff8067a20 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.211+0000 7fcfff5ff700 1 --2- 172.21.15.72:0/1941935419 >> v2:172.21.15.146:3300/0 conn(0x7fcff80c5aa0 0x7fcff80653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.211+0000 7fcfff5ff700 1 -- 172.21.15.72:0/1941935419 >> 172.21.15.72:0/1941935419 conn(0x7fcff8066350 msgr2=0x7fcff8066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:26.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.211+0000 7fcfff5ff700 1 -- 172.21.15.72:0/1941935419 shutdown_connections 2023-08-31T19:00:26.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.211+0000 7fcfff5ff700 1 -- 172.21.15.72:0/1941935419 wait complete. 2023-08-31T19:00:26.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.213+0000 7fcfff5ff700 1 Processor -- start 2023-08-31T19:00:26.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.213+0000 7fcfff5ff700 1 -- start start 2023-08-31T19:00:26.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcfff5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff80c4bb0 0x7fcff80a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:26.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcfff5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff80c5aa0 0x7fcff8167940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:26.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcfff5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff813d960 0x7fcff81538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:26.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcfff5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff8153dd0 con 0x7fcff80c5aa0 2023-08-31T19:00:26.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcfff5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff8167f20 con 0x7fcff80c4bb0 2023-08-31T19:00:26.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcfff5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff8168200 con 0x7fcff813d960 2023-08-31T19:00:26.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcffcb9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff80c5aa0 0x7fcff8167940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:26.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcffcb9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff80c5aa0 0x7fcff8167940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54024/0 (socket says 172.21.15.72:54024) 2023-08-31T19:00:26.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcffcb9a700 1 -- 172.21.15.72:0/3481848432 learned_addr learned my addr 172.21.15.72:0/3481848432 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:26.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcffd39b700 1 --2- 172.21.15.72:0/3481848432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff80c4bb0 0x7fcff80a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:26.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcffdb9c700 1 --2- 172.21.15.72:0/3481848432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff813d960 0x7fcff81538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:26.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcffcb9a700 1 -- 172.21.15.72:0/3481848432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff813d960 msgr2=0x7fcff81538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:26.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcffcb9a700 1 --2- 172.21.15.72:0/3481848432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff813d960 0x7fcff81538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcffcb9a700 1 -- 172.21.15.72:0/3481848432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff80c4bb0 msgr2=0x7fcff80a4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:26.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcffcb9a700 1 --2- 172.21.15.72:0/3481848432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff80c4bb0 0x7fcff80a4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcffcb9a700 1 -- 172.21.15.72:0/3481848432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff0009ae0 con 0x7fcff80c5aa0 2023-08-31T19:00:26.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.214+0000 7fcffcb9a700 1 --2- 172.21.15.72:0/3481848432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff80c5aa0 0x7fcff8167940 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fcfe8006980 tx=0x7fcfe8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.215+0000 7fcfed7fa700 1 -- 172.21.15.72:0/3481848432 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80125f0 con 0x7fcff80c5aa0 2023-08-31T19:00:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.215+0000 7fcfed7fa700 1 -- 172.21.15.72:0/3481848432 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe8012750 con 0x7fcff80c5aa0 2023-08-31T19:00:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.215+0000 7fcfff5ff700 1 -- 172.21.15.72:0/3481848432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff81684e0 con 0x7fcff80c5aa0 2023-08-31T19:00:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.215+0000 7fcfed7fa700 1 -- 172.21.15.72:0/3481848432 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8012ad0 con 0x7fcff80c5aa0 2023-08-31T19:00:26.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.215+0000 7fcfff5ff700 1 -- 172.21.15.72:0/3481848432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff80bfc70 con 0x7fcff80c5aa0 2023-08-31T19:00:26.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.216+0000 7fcfff5ff700 1 -- 172.21.15.72:0/3481848432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff806c6b0 con 0x7fcff80c5aa0 2023-08-31T19:00:26.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.217+0000 7fcfed7fa700 1 -- 172.21.15.72:0/3481848432 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fcfe8013480 con 0x7fcff80c5aa0 2023-08-31T19:00:26.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.217+0000 7fcfed7fa700 1 --2- 172.21.15.72:0/3481848432 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcfdc05ef80 0x7fcfdc061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:26.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.218+0000 7fcfed7fa700 1 -- 172.21.15.72:0/3481848432 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fcfe8079e40 con 0x7fcff80c5aa0 2023-08-31T19:00:26.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.218+0000 7fcffd39b700 1 --2- 172.21.15.72:0/3481848432 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcfdc05ef80 0x7fcfdc061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.218+0000 7fcffd39b700 1 --2- 172.21.15.72:0/3481848432 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcfdc05ef80 0x7fcfdc061440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fcff400b7f0 tx=0x7fcff4008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.221+0000 7fcfed7fa700 1 -- 172.21.15.72:0/3481848432 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcfe804b0b0 con 0x7fcff80c5aa0 2023-08-31T19:00:26.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.415+0000 7fcfff5ff700 1 -- 172.21.15.72:0/3481848432 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcff80c6250 con 0x7fcfdc05ef80 2023-08-31T19:00:26.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.416+0000 7fcfed7fa700 1 -- 172.21.15.72:0/3481848432 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fcff80c6250 con 0x7fcfdc05ef80 2023-08-31T19:00:26.417 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:26.417 INFO:teuthology.orchestra.run.smithi072.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:12", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:26.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.418+0000 7fcfff5ff700 1 -- 172.21.15.72:0/3481848432 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcfdc05ef80 msgr2=0x7fcfdc061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:26.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.418+0000 7fcfff5ff700 1 --2- 172.21.15.72:0/3481848432 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcfdc05ef80 0x7fcfdc061440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fcff400b7f0 tx=0x7fcff4008040).stop 2023-08-31T19:00:26.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.418+0000 7fcfff5ff700 1 -- 172.21.15.72:0/3481848432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff80c5aa0 msgr2=0x7fcff8167940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:26.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.418+0000 7fcfff5ff700 1 --2- 172.21.15.72:0/3481848432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff80c5aa0 0x7fcff8167940 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fcfe8006980 tx=0x7fcfe8008040).stop 2023-08-31T19:00:26.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.418+0000 7fcfff5ff700 1 -- 172.21.15.72:0/3481848432 shutdown_connections 2023-08-31T19:00:26.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.418+0000 7fcfff5ff700 1 --2- 172.21.15.72:0/3481848432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcff813d960 0x7fcff81538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.418+0000 7fcfff5ff700 1 --2- 172.21.15.72:0/3481848432 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcfdc05ef80 0x7fcfdc061440 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.418+0000 7fcfff5ff700 1 --2- 172.21.15.72:0/3481848432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcff80c4bb0 0x7fcff80a4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.418+0000 7fcfff5ff700 1 --2- 172.21.15.72:0/3481848432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcff80c5aa0 0x7fcff8167940 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.419+0000 7fcfff5ff700 1 -- 172.21.15.72:0/3481848432 >> 172.21.15.72:0/3481848432 conn(0x7fcff8066350 msgr2=0x7fcff80c2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:26.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.419+0000 7fcfff5ff700 1 -- 172.21.15.72:0/3481848432 shutdown_connections 2023-08-31T19:00:26.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.419+0000 7fcfff5ff700 1 -- 172.21.15.72:0/3481848432 wait complete. 2023-08-31T19:00:26.436 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:12", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:26.437 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-08-31T00:00:00', 'created': '2023-08-31T18:49:12', 'first': '2023-08-31T18:50:00', 'last': '2023-08-31T19:00:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-31T19:00:26.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:26.437 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-08-31T19:00:26.486 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:26.487 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:26.487 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:26.487 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:26.488 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:26.488 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:26.488 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:26.489 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:26.489 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:26.489 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:26.490 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:26.491 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-31-18_50_00_UTC', 'scheduled-2023-08-31-18_51_00_UTC', 'scheduled-2023-08-31-18_52_00_UTC', 'scheduled-2023-08-31-18_53_00_UTC', 'scheduled-2023-08-31-18_54_00_UTC', 'scheduled-2023-08-31-18_55_00_UTC', 'scheduled-2023-08-31-18_56_00_UTC', 'scheduled-2023-08-31-18_57_00_UTC', 'scheduled-2023-08-31-18_58_00_UTC', 'scheduled-2023-08-31-18_59_00_UTC', 'scheduled-2023-08-31-19_00_00_UTC'] 2023-08-31T19:00:26.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-08-31T19:00:26.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.685+0000 7f11ea9ff700 1 Processor -- start 2023-08-31T19:00:26.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.686+0000 7f11ea9ff700 1 -- start start 2023-08-31T19:00:26.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.687+0000 7f11ea9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f11e4154120 0x7f11e40a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:26.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.687+0000 7f11ea9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e40aa620 con 0x7f11e4064db0 2023-08-31T19:00:26.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.687+0000 7f11ea9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e40aa3a0 con 0x7f11e4154500 2023-08-31T19:00:26.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.687+0000 7f11ea9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e40c5450 con 0x7f11e4154120 2023-08-31T19:00:26.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.687+0000 7f11e3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f11e4154120 0x7f11e40a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:26.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.687+0000 7f11e8f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f11e4064db0 0x7f11e415dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55134/0 (socket says 172.21.15.72:55134) 2023-08-31T19:00:26.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.687+0000 7f11e8f9c700 1 -- 172.21.15.72:0/1459133305 learned_addr learned my addr 172.21.15.72:0/1459133305 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:26.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.688+0000 7f11e3fff700 1 -- 172.21.15.72:0/1459133305 >> v1:172.21.15.146:6789/0 conn(0x7f11e4154500 legacy=0x7f11e40646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:26.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.688+0000 7f11e3fff700 1 -- 172.21.15.72:0/1459133305 >> v1:172.21.15.72:6789/0 conn(0x7f11e4064db0 legacy=0x7f11e415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:26.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.688+0000 7f11e2ffd700 1 -- 172.21.15.72:0/1459133305 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107276143 0 0) 0x7f11e40aa620 con 0x7f11e4064db0 2023-08-31T19:00:26.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.688+0000 7f11e3fff700 1 -- 172.21.15.72:0/1459133305 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e40c8050 con 0x7f11e4154120 2023-08-31T19:00:26.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.688+0000 7f11e3fff700 1 --2- 172.21.15.72:0/1459133305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e4154120 0x7f11e40a9eb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f11d4009760 tx=0x7f11d4009060).ready entity=mon.0 client_cookie=1e92cbad74a909aa server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:26.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.688+0000 7f11e2ffd700 1 -- 172.21.15.72:0/1459133305 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4009120 con 0x7f11e4154120 2023-08-31T19:00:26.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.688+0000 7f11e2ffd700 1 -- 172.21.15.72:0/1459133305 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d400b580 con 0x7f11e4154120 2023-08-31T19:00:26.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.688+0000 7f11e2ffd700 1 -- 172.21.15.72:0/1459133305 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d400b900 con 0x7f11e4154120 2023-08-31T19:00:26.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.689+0000 7f11ea9ff700 1 -- 172.21.15.72:0/1459133305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e4154120 msgr2=0x7f11e40a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:26.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.689+0000 7f11ea9ff700 1 --2- 172.21.15.72:0/1459133305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e4154120 0x7f11e40a9eb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f11d4009760 tx=0x7f11d4009060).stop 2023-08-31T19:00:26.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.689+0000 7f11ea9ff700 1 -- 172.21.15.72:0/1459133305 shutdown_connections 2023-08-31T19:00:26.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.689+0000 7f11ea9ff700 1 --2- 172.21.15.72:0/1459133305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e4154120 0x7f11e40a9eb0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.689+0000 7f11ea9ff700 1 -- 172.21.15.72:0/1459133305 >> 172.21.15.72:0/1459133305 conn(0x7f11e40cb7e0 msgr2=0x7f11e40c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:26.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.689+0000 7f11ea9ff700 1 -- 172.21.15.72:0/1459133305 shutdown_connections 2023-08-31T19:00:26.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.689+0000 7f11ea9ff700 1 -- 172.21.15.72:0/1459133305 wait complete. 2023-08-31T19:00:26.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.690+0000 7f11ea9ff700 1 Processor -- start 2023-08-31T19:00:26.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.690+0000 7f11ea9ff700 1 -- start start 2023-08-31T19:00:26.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.691+0000 7f11ea9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11e4064db0 0x7f11e4141700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:26.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.691+0000 7f11ea9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e4154120 0x7f11e41589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:26.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.691+0000 7f11ea9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11e4154500 0x7f11e4158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:26.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.691+0000 7f11ea9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4159380 con 0x7f11e4154120 2023-08-31T19:00:26.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.691+0000 7f11ea9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4156d10 con 0x7f11e4064db0 2023-08-31T19:00:26.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.691+0000 7f11ea9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e4156f60 con 0x7f11e4154500 2023-08-31T19:00:26.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11e37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e4154120 0x7f11e41589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:26.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11e37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e4154120 0x7f11e41589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54054/0 (socket says 172.21.15.72:54054) 2023-08-31T19:00:26.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11e37fe700 1 -- 172.21.15.72:0/1681936524 learned_addr learned my addr 172.21.15.72:0/1681936524 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:26.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11e3fff700 1 --2- 172.21.15.72:0/1681936524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11e4064db0 0x7f11e4141700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:26.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11e8f9c700 1 --2- 172.21.15.72:0/1681936524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11e4154500 0x7f11e4158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:26.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11e37fe700 1 -- 172.21.15.72:0/1681936524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11e4154500 msgr2=0x7f11e4158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:26.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11e37fe700 1 --2- 172.21.15.72:0/1681936524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11e4154500 0x7f11e4158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11e37fe700 1 -- 172.21.15.72:0/1681936524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11e4064db0 msgr2=0x7f11e4141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:26.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11e37fe700 1 --2- 172.21.15.72:0/1681936524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11e4064db0 0x7f11e4141700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11e37fe700 1 -- 172.21.15.72:0/1681936524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d40092a0 con 0x7f11e4154120 2023-08-31T19:00:26.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11e8f9c700 1 --2- 172.21.15.72:0/1681936524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11e4154500 0x7f11e4158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:26.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11e37fe700 1 --2- 172.21.15.72:0/1681936524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e4154120 0x7f11e41589a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f11d800c4c0 tx=0x7f11d8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:26.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11cbfff700 1 -- 172.21.15.72:0/1681936524 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d8007020 con 0x7f11e4154120 2023-08-31T19:00:26.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11cbfff700 1 -- 172.21.15.72:0/1681936524 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d8007180 con 0x7f11e4154120 2023-08-31T19:00:26.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11ea9ff700 1 -- 172.21.15.72:0/1681936524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e4157240 con 0x7f11e4154120 2023-08-31T19:00:26.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.692+0000 7f11cbfff700 1 -- 172.21.15.72:0/1681936524 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d8007520 con 0x7f11e4154120 2023-08-31T19:00:26.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.693+0000 7f11ea9ff700 1 -- 172.21.15.72:0/1681936524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e4157ae0 con 0x7f11e4154120 2023-08-31T19:00:26.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.694+0000 7f11ea9ff700 1 -- 172.21.15.72:0/1681936524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e4157430 con 0x7f11e4154120 2023-08-31T19:00:26.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.694+0000 7f11cbfff700 1 -- 172.21.15.72:0/1681936524 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f11d80068b0 con 0x7f11e4154120 2023-08-31T19:00:26.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.696+0000 7f11cbfff700 1 --2- 172.21.15.72:0/1681936524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f11d005ef80 0x7f11d0061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:26.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.696+0000 7f11cbfff700 1 -- 172.21.15.72:0/1681936524 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f11d8079500 con 0x7f11e4154120 2023-08-31T19:00:26.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.696+0000 7f11e3fff700 1 --2- 172.21.15.72:0/1681936524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f11d005ef80 0x7f11d0061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:26.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.696+0000 7f11e3fff700 1 --2- 172.21.15.72:0/1681936524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f11d005ef80 0x7f11d0061440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f11d4009630 tx=0x7f11d4017000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:26.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.700+0000 7f11cbfff700 1 -- 172.21.15.72:0/1681936524 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f11d80478f0 con 0x7f11e4154120 2023-08-31T19:00:26.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.893+0000 7f11ea9ff700 1 -- 172.21.15.72:0/1681936524 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11e406a7e0 con 0x7f11d005ef80 2023-08-31T19:00:26.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.894+0000 7f11cbfff700 1 -- 172.21.15.72:0/1681936524 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f11e406a7e0 con 0x7f11d005ef80 2023-08-31T19:00:26.894 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:26.895 INFO:teuthology.orchestra.run.smithi072.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:13", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.896+0000 7f11ea9ff700 1 -- 172.21.15.72:0/1681936524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f11d005ef80 msgr2=0x7f11d0061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.896+0000 7f11ea9ff700 1 --2- 172.21.15.72:0/1681936524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f11d005ef80 0x7f11d0061440 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f11d4009630 tx=0x7f11d4017000).stop 2023-08-31T19:00:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.896+0000 7f11ea9ff700 1 -- 172.21.15.72:0/1681936524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e4154120 msgr2=0x7f11e41589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.896+0000 7f11ea9ff700 1 --2- 172.21.15.72:0/1681936524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e4154120 0x7f11e41589a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f11d800c4c0 tx=0x7f11d8007dd0).stop 2023-08-31T19:00:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.896+0000 7f11ea9ff700 1 -- 172.21.15.72:0/1681936524 shutdown_connections 2023-08-31T19:00:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.896+0000 7f11ea9ff700 1 --2- 172.21.15.72:0/1681936524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11e4154500 0x7f11e4158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.896+0000 7f11ea9ff700 1 --2- 172.21.15.72:0/1681936524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f11d005ef80 0x7f11d0061440 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.896+0000 7f11ea9ff700 1 --2- 172.21.15.72:0/1681936524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11e4064db0 0x7f11e4141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.896+0000 7f11ea9ff700 1 --2- 172.21.15.72:0/1681936524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11e4154120 0x7f11e41589a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:26.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.896+0000 7f11ea9ff700 1 -- 172.21.15.72:0/1681936524 >> 172.21.15.72:0/1681936524 conn(0x7f11e40cb7e0 msgr2=0x7f11e4152d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:26.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.896+0000 7f11ea9ff700 1 -- 172.21.15.72:0/1681936524 shutdown_connections 2023-08-31T19:00:26.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:26.896+0000 7f11ea9ff700 1 -- 172.21.15.72:0/1681936524 wait complete. 2023-08-31T19:00:26.914 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:13", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:26.914 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-08-31T00:00:00', 'created': '2023-08-31T18:49:13', 'first': '2023-08-31T18:50:00', 'last': '2023-08-31T19:00:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-31T19:00:26.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:26.915 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-08-31T19:00:26.963 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:26.963 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:26.964 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:26.964 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:26.964 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:26.964 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:26.964 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:26.965 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:26.965 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:26.965 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:26.965 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:26.966 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-31-18_50_00_UTC', 'scheduled-2023-08-31-18_51_00_UTC', 'scheduled-2023-08-31-18_52_00_UTC', 'scheduled-2023-08-31-18_53_00_UTC', 'scheduled-2023-08-31-18_54_00_UTC', 'scheduled-2023-08-31-18_55_00_UTC', 'scheduled-2023-08-31-18_56_00_UTC', 'scheduled-2023-08-31-18_57_00_UTC', 'scheduled-2023-08-31-18_58_00_UTC', 'scheduled-2023-08-31-18_59_00_UTC', 'scheduled-2023-08-31-19_00_00_UTC'] 2023-08-31T19:00:26.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-08-31T19:00:27.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.159+0000 7fd3f31ff700 1 Processor -- start 2023-08-31T19:00:27.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.159+0000 7fd3f31ff700 1 -- start start 2023-08-31T19:00:27.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.160+0000 7fd3f31ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd3ec0c7f20 0x7fd3ec0646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:27.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.160+0000 7fd3f31ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd3ec0c83d0 0x7fd3ec064b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:27.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.160+0000 7fd3f31ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ec154c80 con 0x7fd3ec151da0 2023-08-31T19:00:27.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.160+0000 7fd3f31ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ec065080 con 0x7fd3ec0c83d0 2023-08-31T19:00:27.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.160+0000 7fd3f31ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ec155820 con 0x7fd3ec0c7f20 2023-08-31T19:00:27.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.160+0000 7fd3f179c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd3ec0c83d0 0x7fd3ec064b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:27.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.161+0000 7fd3f179c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd3ec0c83d0 0x7fd3ec064b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54060/0 (socket says 172.21.15.72:54060) 2023-08-31T19:00:27.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.161+0000 7fd3f179c700 1 -- 172.21.15.72:0/2128700462 learned_addr learned my addr 172.21.15.72:0/2128700462 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:27.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.161+0000 7fd3ebfff700 1 --2- 172.21.15.72:0/2128700462 >> v2:172.21.15.146:3300/0 conn(0x7fd3ec0c7f20 0x7fd3ec0646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:27.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.161+0000 7fd3f179c700 1 -- 172.21.15.72:0/2128700462 >> v2:172.21.15.146:3300/0 conn(0x7fd3ec0c7f20 msgr2=0x7fd3ec0646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:27.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.161+0000 7fd3f179c700 1 --2- 172.21.15.72:0/2128700462 >> v2:172.21.15.146:3300/0 conn(0x7fd3ec0c7f20 0x7fd3ec0646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.161+0000 7fd3f179c700 1 -- 172.21.15.72:0/2128700462 >> v1:172.21.15.146:6789/0 conn(0x7fd3ec151da0 legacy=0x7fd3ec155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:27.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.161+0000 7fd3f179c700 1 -- 172.21.15.72:0/2128700462 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec0a9f10 con 0x7fd3ec0c83d0 2023-08-31T19:00:27.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.161+0000 7fd3ebfff700 1 --2- 172.21.15.72:0/2128700462 >> v2:172.21.15.146:3300/0 conn(0x7fd3ec0c7f20 0x7fd3ec0646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:27.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.161+0000 7fd3f179c700 1 --2- 172.21.15.72:0/2128700462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3ec0c83d0 0x7fd3ec064b90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fd3ec0aaf20 tx=0x7fd3e4009840).ready entity=mon.0 client_cookie=def47f050faffd47 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:27.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.161+0000 7fd3eb7fe700 1 -- 172.21.15.72:0/2128700462 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e400e070 con 0x7fd3ec0c83d0 2023-08-31T19:00:27.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.161+0000 7fd3eb7fe700 1 -- 172.21.15.72:0/2128700462 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e400ba10 con 0x7fd3ec0c83d0 2023-08-31T19:00:27.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.161+0000 7fd3eb7fe700 1 -- 172.21.15.72:0/2128700462 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e400bd90 con 0x7fd3ec0c83d0 2023-08-31T19:00:27.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.162+0000 7fd3f31ff700 1 -- 172.21.15.72:0/2128700462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3ec0c83d0 msgr2=0x7fd3ec064b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:27.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.162+0000 7fd3f31ff700 1 --2- 172.21.15.72:0/2128700462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3ec0c83d0 0x7fd3ec064b90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fd3ec0aaf20 tx=0x7fd3e4009840).stop 2023-08-31T19:00:27.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.162+0000 7fd3f31ff700 1 -- 172.21.15.72:0/2128700462 shutdown_connections 2023-08-31T19:00:27.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.162+0000 7fd3f31ff700 1 --2- 172.21.15.72:0/2128700462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3ec0c83d0 0x7fd3ec064b90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.162+0000 7fd3f31ff700 1 --2- 172.21.15.72:0/2128700462 >> v2:172.21.15.146:3300/0 conn(0x7fd3ec0c7f20 0x7fd3ec0646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.162+0000 7fd3f31ff700 1 -- 172.21.15.72:0/2128700462 >> 172.21.15.72:0/2128700462 conn(0x7fd3ec0cb840 msgr2=0x7fd3ec0c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:27.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.162+0000 7fd3f31ff700 1 -- 172.21.15.72:0/2128700462 shutdown_connections 2023-08-31T19:00:27.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.162+0000 7fd3f31ff700 1 -- 172.21.15.72:0/2128700462 wait complete. 2023-08-31T19:00:27.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.164+0000 7fd3f31ff700 1 Processor -- start 2023-08-31T19:00:27.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.164+0000 7fd3f31ff700 1 -- start start 2023-08-31T19:00:27.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3f31ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3ec0c7f20 0x7fd3ec14d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:27.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3f31ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3ec0c83d0 0x7fd3ec1535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:27.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3f31ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3ec151da0 0x7fd3ec153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:27.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3f31ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec153fb0 con 0x7fd3ec151da0 2023-08-31T19:00:27.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3f31ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec0c42d0 con 0x7fd3ec0c7f20 2023-08-31T19:00:27.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3f31ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec0c45b0 con 0x7fd3ec0c83d0 2023-08-31T19:00:27.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3f179c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3ec151da0 0x7fd3ec153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:27.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3f179c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3ec151da0 0x7fd3ec153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54070/0 (socket says 172.21.15.72:54070) 2023-08-31T19:00:27.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3f179c700 1 -- 172.21.15.72:0/3625763381 learned_addr learned my addr 172.21.15.72:0/3625763381 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:27.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3f0f9b700 1 --2- 172.21.15.72:0/3625763381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3ec0c7f20 0x7fd3ec14d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:27.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3ebfff700 1 --2- 172.21.15.72:0/3625763381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3ec0c83d0 0x7fd3ec1535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:27.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3f179c700 1 -- 172.21.15.72:0/3625763381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3ec0c83d0 msgr2=0x7fd3ec1535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:27.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3f179c700 1 --2- 172.21.15.72:0/3625763381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3ec0c83d0 0x7fd3ec1535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3f179c700 1 -- 172.21.15.72:0/3625763381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3ec0c7f20 msgr2=0x7fd3ec14d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:27.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3f179c700 1 --2- 172.21.15.72:0/3625763381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3ec0c7f20 0x7fd3ec14d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.166+0000 7fd3f179c700 1 -- 172.21.15.72:0/3625763381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e4009ae0 con 0x7fd3ec151da0 2023-08-31T19:00:27.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.167+0000 7fd3f179c700 1 --2- 172.21.15.72:0/3625763381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3ec151da0 0x7fd3ec153ac0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fd3e4009880 tx=0x7fd3ec155960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:27.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.167+0000 7fd3e8ff9700 1 -- 172.21.15.72:0/3625763381 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4013e40 con 0x7fd3ec151da0 2023-08-31T19:00:27.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.167+0000 7fd3e8ff9700 1 -- 172.21.15.72:0/3625763381 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e401d410 con 0x7fd3ec151da0 2023-08-31T19:00:27.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.167+0000 7fd3f31ff700 1 -- 172.21.15.72:0/3625763381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ec0c4890 con 0x7fd3ec151da0 2023-08-31T19:00:27.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.167+0000 7fd3e8ff9700 1 -- 172.21.15.72:0/3625763381 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e401d7b0 con 0x7fd3ec151da0 2023-08-31T19:00:27.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.167+0000 7fd3f31ff700 1 -- 172.21.15.72:0/3625763381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec14dc10 con 0x7fd3ec151da0 2023-08-31T19:00:27.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.168+0000 7fd3f31ff700 1 -- 172.21.15.72:0/3625763381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ec06a7e0 con 0x7fd3ec151da0 2023-08-31T19:00:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.169+0000 7fd3e8ff9700 1 -- 172.21.15.72:0/3625763381 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fd3e401db60 con 0x7fd3ec151da0 2023-08-31T19:00:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.170+0000 7fd3e8ff9700 1 --2- 172.21.15.72:0/3625763381 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd3d005ef80 0x7fd3d0061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.170+0000 7fd3e8ff9700 1 -- 172.21.15.72:0/3625763381 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fd3e407be60 con 0x7fd3ec151da0 2023-08-31T19:00:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.170+0000 7fd3f0f9b700 1 --2- 172.21.15.72:0/3625763381 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd3d005ef80 0x7fd3d0061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.170+0000 7fd3f0f9b700 1 --2- 172.21.15.72:0/3625763381 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd3d005ef80 0x7fd3d0061440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd3e000b9b0 tx=0x7fd3e0008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:27.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.174+0000 7fd3e8ff9700 1 -- 172.21.15.72:0/3625763381 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd3e404d080 con 0x7fd3ec151da0 2023-08-31T19:00:27.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.367+0000 7fd3f31ff700 1 -- 172.21.15.72:0/3625763381 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3ec06a7e0 con 0x7fd3d005ef80 2023-08-31T19:00:27.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.369+0000 7fd3e8ff9700 1 -- 172.21.15.72:0/3625763381 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fd3ec06a7e0 con 0x7fd3d005ef80 2023-08-31T19:00:27.369 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:27.369 INFO:teuthology.orchestra.run.smithi072.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:13", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:27.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.370+0000 7fd3f31ff700 1 -- 172.21.15.72:0/3625763381 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd3d005ef80 msgr2=0x7fd3d0061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:27.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.370+0000 7fd3f31ff700 1 --2- 172.21.15.72:0/3625763381 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd3d005ef80 0x7fd3d0061440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd3e000b9b0 tx=0x7fd3e0008040).stop 2023-08-31T19:00:27.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.371+0000 7fd3f31ff700 1 -- 172.21.15.72:0/3625763381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3ec151da0 msgr2=0x7fd3ec153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.371+0000 7fd3f31ff700 1 --2- 172.21.15.72:0/3625763381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3ec151da0 0x7fd3ec153ac0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fd3e4009880 tx=0x7fd3ec155960).stop 2023-08-31T19:00:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.371+0000 7fd3f31ff700 1 -- 172.21.15.72:0/3625763381 shutdown_connections 2023-08-31T19:00:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.371+0000 7fd3f31ff700 1 --2- 172.21.15.72:0/3625763381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3ec151da0 0x7fd3ec153ac0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.371+0000 7fd3f31ff700 1 --2- 172.21.15.72:0/3625763381 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd3d005ef80 0x7fd3d0061440 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.371+0000 7fd3f31ff700 1 --2- 172.21.15.72:0/3625763381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3ec0c7f20 0x7fd3ec14d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.371+0000 7fd3f31ff700 1 --2- 172.21.15.72:0/3625763381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3ec0c83d0 0x7fd3ec1535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.371+0000 7fd3f31ff700 1 -- 172.21.15.72:0/3625763381 >> 172.21.15.72:0/3625763381 conn(0x7fd3ec0cb840 msgr2=0x7fd3ec0c9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:27.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.371+0000 7fd3f31ff700 1 -- 172.21.15.72:0/3625763381 shutdown_connections 2023-08-31T19:00:27.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.371+0000 7fd3f31ff700 1 -- 172.21.15.72:0/3625763381 wait complete. 2023-08-31T19:00:27.388 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:13", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:27.389 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-08-31T00:00:00', 'created': '2023-08-31T18:49:13', 'first': '2023-08-31T18:50:00', 'last': '2023-08-31T19:00:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-31T19:00:27.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:27.389 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-08-31T19:00:27.438 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:27.438 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:27.438 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:27.439 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:27.439 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:27.439 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:27.440 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:27.440 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:27.440 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:27.440 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:27.440 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:27.441 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-31-18_50_00_UTC', 'scheduled-2023-08-31-18_51_00_UTC', 'scheduled-2023-08-31-18_52_00_UTC', 'scheduled-2023-08-31-18_53_00_UTC', 'scheduled-2023-08-31-18_54_00_UTC', 'scheduled-2023-08-31-18_55_00_UTC', 'scheduled-2023-08-31-18_56_00_UTC', 'scheduled-2023-08-31-18_57_00_UTC', 'scheduled-2023-08-31-18_58_00_UTC', 'scheduled-2023-08-31-18_59_00_UTC', 'scheduled-2023-08-31-19_00_00_UTC'] 2023-08-31T19:00:27.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-08-31T19:00:27.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.635+0000 7f88499ff700 1 Processor -- start 2023-08-31T19:00:27.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.635+0000 7f88499ff700 1 -- start start 2023-08-31T19:00:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.636+0000 7f88499ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8844153db0 0x7f8844154190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:27.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.636+0000 7f88499ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88440aa330 0x7f88440c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:27.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.636+0000 7f88499ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88440c0650 con 0x7f88440c5d40 2023-08-31T19:00:27.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.636+0000 7f88499ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88440bfd60 con 0x7f88440aa330 2023-08-31T19:00:27.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.636+0000 7f88499ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88440c0000 con 0x7f8844153db0 2023-08-31T19:00:27.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.637+0000 7f88437fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88440aa330 0x7f88440c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:27.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.637+0000 7f88437fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88440aa330 0x7f88440c61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54080/0 (socket says 172.21.15.72:54080) 2023-08-31T19:00:27.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.637+0000 7f88437fe700 1 -- 172.21.15.72:0/1627717297 learned_addr learned my addr 172.21.15.72:0/1627717297 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:27.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.637+0000 7f8842ffd700 1 --2- 172.21.15.72:0/1627717297 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8844153db0 0x7f8844154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:27.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.637+0000 7f88437fe700 1 -- 172.21.15.72:0/1627717297 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8844153db0 msgr2=0x7f8844154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:27.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.637+0000 7f88437fe700 1 --2- 172.21.15.72:0/1627717297 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8844153db0 0x7f8844154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.637+0000 7f88437fe700 1 -- 172.21.15.72:0/1627717297 >> v1:172.21.15.146:6789/0 conn(0x7f88440c5d40 legacy=0x7f88440a9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:27.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.637+0000 7f88437fe700 1 -- 172.21.15.72:0/1627717297 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88440c02e0 con 0x7f88440aa330 2023-08-31T19:00:27.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.637+0000 7f88437fe700 1 --2- 172.21.15.72:0/1627717297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440aa330 0x7f88440c61c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f883c009f20 tx=0x7f883c009840).ready entity=mon.0 client_cookie=97daccc8dc0c7469 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:27.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.638+0000 7f8841ffb700 1 -- 172.21.15.72:0/1627717297 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c00e070 con 0x7f88440aa330 2023-08-31T19:00:27.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.638+0000 7f8841ffb700 1 -- 172.21.15.72:0/1627717297 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c00b9d0 con 0x7f88440aa330 2023-08-31T19:00:27.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.638+0000 7f8841ffb700 1 -- 172.21.15.72:0/1627717297 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c00bd50 con 0x7f88440aa330 2023-08-31T19:00:27.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.638+0000 7f88499ff700 1 -- 172.21.15.72:0/1627717297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440aa330 msgr2=0x7f88440c61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:27.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.638+0000 7f88499ff700 1 --2- 172.21.15.72:0/1627717297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440aa330 0x7f88440c61c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f883c009f20 tx=0x7f883c009840).stop 2023-08-31T19:00:27.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.638+0000 7f88499ff700 1 -- 172.21.15.72:0/1627717297 shutdown_connections 2023-08-31T19:00:27.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.638+0000 7f88499ff700 1 --2- 172.21.15.72:0/1627717297 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8844153db0 0x7f8844154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.638+0000 7f88499ff700 1 --2- 172.21.15.72:0/1627717297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440aa330 0x7f88440c61c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.638+0000 7f88499ff700 1 -- 172.21.15.72:0/1627717297 >> 172.21.15.72:0/1627717297 conn(0x7f88440cb7c0 msgr2=0x7f88440c7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.638+0000 7f88499ff700 1 -- 172.21.15.72:0/1627717297 shutdown_connections 2023-08-31T19:00:27.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.638+0000 7f88499ff700 1 -- 172.21.15.72:0/1627717297 wait complete. 2023-08-31T19:00:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.640+0000 7f88499ff700 1 Processor -- start 2023-08-31T19:00:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.640+0000 7f88499ff700 1 -- start start 2023-08-31T19:00:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.641+0000 7f88499ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88440aa330 0x7f88441559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.641+0000 7f88499ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440c5d40 0x7f8844063130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:27.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.641+0000 7f88499ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8844153db0 0x7f88440c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:27.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.641+0000 7f88499ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8844167b20 con 0x7f88440c5d40 2023-08-31T19:00:27.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.641+0000 7f88499ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88440c3940 con 0x7f8844153db0 2023-08-31T19:00:27.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.641+0000 7f88499ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88440c3c20 con 0x7f88440aa330 2023-08-31T19:00:27.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.641+0000 7f88427fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440c5d40 0x7f8844063130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:27.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.641+0000 7f88427fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440c5d40 0x7f8844063130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54096/0 (socket says 172.21.15.72:54096) 2023-08-31T19:00:27.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.641+0000 7f88427fc700 1 -- 172.21.15.72:0/2380446244 learned_addr learned my addr 172.21.15.72:0/2380446244 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:27.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.641+0000 7f8842ffd700 1 --2- 172.21.15.72:0/2380446244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88440aa330 0x7f88441559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:27.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.641+0000 7f88437fe700 1 --2- 172.21.15.72:0/2380446244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8844153db0 0x7f88440c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:27.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.642+0000 7f88427fc700 1 -- 172.21.15.72:0/2380446244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88440aa330 msgr2=0x7f88441559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:27.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.642+0000 7f88427fc700 1 --2- 172.21.15.72:0/2380446244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88440aa330 0x7f88441559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.642+0000 7f88427fc700 1 -- 172.21.15.72:0/2380446244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8844153db0 msgr2=0x7f88440c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:27.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.642+0000 7f88427fc700 1 --2- 172.21.15.72:0/2380446244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8844153db0 0x7f88440c2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.642+0000 7f88427fc700 1 -- 172.21.15.72:0/2380446244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c009ae0 con 0x7f88440c5d40 2023-08-31T19:00:27.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.642+0000 7f88437fe700 1 --2- 172.21.15.72:0/2380446244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8844153db0 0x7f88440c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:27.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.642+0000 7f88427fc700 1 --2- 172.21.15.72:0/2380446244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440c5d40 0x7f8844063130 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f883800c4c0 tx=0x7f8838007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:27.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.642+0000 7f882affd700 1 -- 172.21.15.72:0/2380446244 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838007020 con 0x7f88440c5d40 2023-08-31T19:00:27.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.642+0000 7f882affd700 1 -- 172.21.15.72:0/2380446244 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8838007180 con 0x7f88440c5d40 2023-08-31T19:00:27.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.642+0000 7f88499ff700 1 -- 172.21.15.72:0/2380446244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88440af8e0 con 0x7f88440c5d40 2023-08-31T19:00:27.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.642+0000 7f882affd700 1 -- 172.21.15.72:0/2380446244 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838007520 con 0x7f88440c5d40 2023-08-31T19:00:27.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.642+0000 7f88499ff700 1 -- 172.21.15.72:0/2380446244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8844155e90 con 0x7f88440c5d40 2023-08-31T19:00:27.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.643+0000 7f88499ff700 1 -- 172.21.15.72:0/2380446244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88441535b0 con 0x7f88440c5d40 2023-08-31T19:00:27.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.644+0000 7f882affd700 1 -- 172.21.15.72:0/2380446244 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f88380068b0 con 0x7f88440c5d40 2023-08-31T19:00:27.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.645+0000 7f882affd700 1 --2- 172.21.15.72:0/2380446244 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883005ef50 0x7f8830061410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:27.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.645+0000 7f882affd700 1 -- 172.21.15.72:0/2380446244 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f8838079520 con 0x7f88440c5d40 2023-08-31T19:00:27.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.645+0000 7f8842ffd700 1 --2- 172.21.15.72:0/2380446244 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883005ef50 0x7f8830061410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:27.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.645+0000 7f8842ffd700 1 --2- 172.21.15.72:0/2380446244 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883005ef50 0x7f8830061410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8834009b90 tx=0x7f8834009060).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:27.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.649+0000 7f882affd700 1 -- 172.21.15.72:0/2380446244 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f88380478f0 con 0x7f88440c5d40 2023-08-31T19:00:27.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.842+0000 7f88499ff700 1 -- 172.21.15.72:0/2380446244 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88440af740 con 0x7f883005ef50 2023-08-31T19:00:27.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.844+0000 7f882affd700 1 -- 172.21.15.72:0/2380446244 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f88440af740 con 0x7f883005ef50 2023-08-31T19:00:27.844 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:27.844 INFO:teuthology.orchestra.run.smithi072.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:14", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:27.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.846+0000 7f88499ff700 1 -- 172.21.15.72:0/2380446244 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883005ef50 msgr2=0x7f8830061410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:27.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.846+0000 7f88499ff700 1 --2- 172.21.15.72:0/2380446244 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883005ef50 0x7f8830061410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8834009b90 tx=0x7f8834009060).stop 2023-08-31T19:00:27.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.846+0000 7f88499ff700 1 -- 172.21.15.72:0/2380446244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440c5d40 msgr2=0x7f8844063130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:27.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.846+0000 7f88499ff700 1 --2- 172.21.15.72:0/2380446244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440c5d40 0x7f8844063130 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f883800c4c0 tx=0x7f8838007dd0).stop 2023-08-31T19:00:27.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.846+0000 7f88499ff700 1 -- 172.21.15.72:0/2380446244 shutdown_connections 2023-08-31T19:00:27.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.846+0000 7f88499ff700 1 --2- 172.21.15.72:0/2380446244 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883005ef50 0x7f8830061410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.846+0000 7f88499ff700 1 --2- 172.21.15.72:0/2380446244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8844153db0 0x7f88440c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.846+0000 7f88499ff700 1 --2- 172.21.15.72:0/2380446244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88440aa330 0x7f88441559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.846+0000 7f88499ff700 1 --2- 172.21.15.72:0/2380446244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88440c5d40 0x7f8844063130 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:27.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.846+0000 7f88499ff700 1 -- 172.21.15.72:0/2380446244 >> 172.21.15.72:0/2380446244 conn(0x7f88440cb7c0 msgr2=0x7f884414dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:27.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.846+0000 7f88499ff700 1 -- 172.21.15.72:0/2380446244 shutdown_connections 2023-08-31T19:00:27.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:27.846+0000 7f88499ff700 1 -- 172.21.15.72:0/2380446244 wait complete. 2023-08-31T19:00:27.863 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:14", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:27.864 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-08-31T00:00:00', 'created': '2023-08-31T18:49:14', 'first': '2023-08-31T18:50:00', 'last': '2023-08-31T19:00:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-31T19:00:27.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:27.865 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-08-31T19:00:27.912 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:27.913 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:27.913 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:27.913 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:27.913 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:27.914 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:27.914 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:27.914 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:27.914 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:27.914 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:27.915 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:27.916 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-31-18_50_00_UTC', 'scheduled-2023-08-31-18_51_00_UTC', 'scheduled-2023-08-31-18_52_00_UTC', 'scheduled-2023-08-31-18_53_00_UTC', 'scheduled-2023-08-31-18_54_00_UTC', 'scheduled-2023-08-31-18_55_00_UTC', 'scheduled-2023-08-31-18_56_00_UTC', 'scheduled-2023-08-31-18_57_00_UTC', 'scheduled-2023-08-31-18_58_00_UTC', 'scheduled-2023-08-31-18_59_00_UTC', 'scheduled-2023-08-31-19_00_00_UTC'] 2023-08-31T19:00:27.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-08-31T19:00:28.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.109+0000 7f1fe61ff700 1 Processor -- start 2023-08-31T19:00:28.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.109+0000 7f1fe61ff700 1 -- start start 2023-08-31T19:00:28.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.110+0000 7f1fe61ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1fe0153de0 0x7f1fe01585b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:28.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.110+0000 7f1fe61ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1fe01541c0 0x7f1fe00a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:28.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.110+0000 7f1fe61ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fe00c1dc0 0x7f1fe00c2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:28.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.110+0000 7f1fe61ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe00c2740 con 0x7f1fe01541c0 2023-08-31T19:00:28.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.110+0000 7f1fe61ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe006a7f0 con 0x7f1fe0153de0 2023-08-31T19:00:28.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.110+0000 7f1fe61ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe00c17c0 con 0x7f1fe00c1dc0 2023-08-31T19:00:28.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.111+0000 7f1fdeffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1fe01541c0 0x7f1fe00a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:28.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.111+0000 7f1fdeffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1fe01541c0 0x7f1fe00a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54106/0 (socket says 172.21.15.72:54106) 2023-08-31T19:00:28.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.111+0000 7f1fdeffd700 1 -- 172.21.15.72:0/1775157116 learned_addr learned my addr 172.21.15.72:0/1775157116 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:28.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.111+0000 7f1fdffff700 1 --2- 172.21.15.72:0/1775157116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fe00c1dc0 0x7f1fe00c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:28.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.111+0000 7f1fdf7fe700 1 --2- 172.21.15.72:0/1775157116 >> v2:172.21.15.146:3300/0 conn(0x7f1fe0153de0 0x7f1fe01585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:28.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.111+0000 7f1fdeffd700 1 -- 172.21.15.72:0/1775157116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fe00c1dc0 msgr2=0x7f1fe00c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:28.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.111+0000 7f1fdeffd700 1 --2- 172.21.15.72:0/1775157116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fe00c1dc0 0x7f1fe00c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.111+0000 7f1fdeffd700 1 -- 172.21.15.72:0/1775157116 >> v2:172.21.15.146:3300/0 conn(0x7f1fe0153de0 msgr2=0x7f1fe01585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:28.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.111+0000 7f1fdeffd700 1 --2- 172.21.15.72:0/1775157116 >> v2:172.21.15.146:3300/0 conn(0x7f1fe0153de0 0x7f1fe01585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.111+0000 7f1fdeffd700 1 -- 172.21.15.72:0/1775157116 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe0068de0 con 0x7f1fe01541c0 2023-08-31T19:00:28.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.111+0000 7f1fdeffd700 1 --2- 172.21.15.72:0/1775157116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe01541c0 0x7f1fe00a4840 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f1fe005eb20 tx=0x7f1fd40090f0).ready entity=mon.0 client_cookie=4cbbad8a380f1d32 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:28.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.112+0000 7f1fde7fc700 1 -- 172.21.15.72:0/1775157116 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd400b600 con 0x7f1fe01541c0 2023-08-31T19:00:28.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.112+0000 7f1fde7fc700 1 -- 172.21.15.72:0/1775157116 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd400b760 con 0x7f1fe01541c0 2023-08-31T19:00:28.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.112+0000 7f1fde7fc700 1 -- 172.21.15.72:0/1775157116 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd400bae0 con 0x7f1fe01541c0 2023-08-31T19:00:28.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.112+0000 7f1fe61ff700 1 -- 172.21.15.72:0/1775157116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe01541c0 msgr2=0x7f1fe00a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:28.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.112+0000 7f1fe61ff700 1 --2- 172.21.15.72:0/1775157116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe01541c0 0x7f1fe00a4840 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f1fe005eb20 tx=0x7f1fd40090f0).stop 2023-08-31T19:00:28.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.112+0000 7f1fe61ff700 1 -- 172.21.15.72:0/1775157116 shutdown_connections 2023-08-31T19:00:28.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.112+0000 7f1fe61ff700 1 --2- 172.21.15.72:0/1775157116 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fe00c1dc0 0x7f1fe00c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.112+0000 7f1fe61ff700 1 --2- 172.21.15.72:0/1775157116 >> v2:172.21.15.146:3300/0 conn(0x7f1fe0153de0 0x7f1fe01585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.112+0000 7f1fe61ff700 1 --2- 172.21.15.72:0/1775157116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe01541c0 0x7f1fe00a4840 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.112+0000 7f1fe61ff700 1 -- 172.21.15.72:0/1775157116 >> 172.21.15.72:0/1775157116 conn(0x7f1fe00c6de0 msgr2=0x7f1fe00c71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:28.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.112+0000 7f1fe61ff700 1 -- 172.21.15.72:0/1775157116 shutdown_connections 2023-08-31T19:00:28.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.112+0000 7f1fe61ff700 1 -- 172.21.15.72:0/1775157116 wait complete. 2023-08-31T19:00:28.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.114+0000 7f1fe61ff700 1 Processor -- start 2023-08-31T19:00:28.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.114+0000 7f1fe61ff700 1 -- start start 2023-08-31T19:00:28.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.115+0000 7f1fe61ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fe00c1dc0 0x7f1fe0153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:28.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.115+0000 7f1fe61ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe0153de0 0x7f1fe0163dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:28.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.115+0000 7f1fe61ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fe01541c0 0x7f1fe00bf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:28.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.115+0000 7f1fe61ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe0164e30 con 0x7f1fe0153de0 2023-08-31T19:00:28.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.115+0000 7f1fe61ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe0164590 con 0x7f1fe00c1dc0 2023-08-31T19:00:28.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.115+0000 7f1fe61ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe0164870 con 0x7f1fe01541c0 2023-08-31T19:00:28.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.115+0000 7f1fdeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe0153de0 0x7f1fe0163dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:28.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.115+0000 7f1fdeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe0153de0 0x7f1fe0163dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54122/0 (socket says 172.21.15.72:54122) 2023-08-31T19:00:28.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.115+0000 7f1fdeffd700 1 -- 172.21.15.72:0/2679858035 learned_addr learned my addr 172.21.15.72:0/2679858035 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:28.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.116+0000 7f1fdf7fe700 1 --2- 172.21.15.72:0/2679858035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fe00c1dc0 0x7f1fe0153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:28.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.116+0000 7f1fdffff700 1 --2- 172.21.15.72:0/2679858035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fe01541c0 0x7f1fe00bf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:28.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.116+0000 7f1fdeffd700 1 -- 172.21.15.72:0/2679858035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fe01541c0 msgr2=0x7f1fe00bf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:28.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.116+0000 7f1fdeffd700 1 --2- 172.21.15.72:0/2679858035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fe01541c0 0x7f1fe00bf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.116+0000 7f1fdeffd700 1 -- 172.21.15.72:0/2679858035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fe00c1dc0 msgr2=0x7f1fe0153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:28.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.116+0000 7f1fdeffd700 1 --2- 172.21.15.72:0/2679858035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fe00c1dc0 0x7f1fe0153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.116+0000 7f1fdeffd700 1 -- 172.21.15.72:0/2679858035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd4009370 con 0x7f1fe0153de0 2023-08-31T19:00:28.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.116+0000 7f1fdeffd700 1 --2- 172.21.15.72:0/2679858035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe0153de0 0x7f1fe0163dc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f1fd4009130 tx=0x7f1fd4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:28.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.116+0000 7f1fc77fe700 1 -- 172.21.15.72:0/2679858035 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd400b8d0 con 0x7f1fe0153de0 2023-08-31T19:00:28.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.116+0000 7f1fc77fe700 1 -- 172.21.15.72:0/2679858035 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd400ba30 con 0x7f1fe0153de0 2023-08-31T19:00:28.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.116+0000 7f1fe61ff700 1 -- 172.21.15.72:0/2679858035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe0164b50 con 0x7f1fe0153de0 2023-08-31T19:00:28.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.116+0000 7f1fc77fe700 1 -- 172.21.15.72:0/2679858035 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd401b660 con 0x7f1fe0153de0 2023-08-31T19:00:28.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.116+0000 7f1fe61ff700 1 -- 172.21.15.72:0/2679858035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe01642b0 con 0x7f1fe0153de0 2023-08-31T19:00:28.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.117+0000 7f1fe61ff700 1 -- 172.21.15.72:0/2679858035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe0064600 con 0x7f1fe0153de0 2023-08-31T19:00:28.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.118+0000 7f1fc77fe700 1 -- 172.21.15.72:0/2679858035 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f1fd401ba10 con 0x7f1fe0153de0 2023-08-31T19:00:28.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.119+0000 7f1fc77fe700 1 --2- 172.21.15.72:0/2679858035 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1fcc05ef80 0x7f1fcc061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:28.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.119+0000 7f1fc77fe700 1 -- 172.21.15.72:0/2679858035 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f1fd407bac0 con 0x7f1fe0153de0 2023-08-31T19:00:28.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.119+0000 7f1fdf7fe700 1 --2- 172.21.15.72:0/2679858035 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1fcc05ef80 0x7f1fcc061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:28.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.119+0000 7f1fdf7fe700 1 --2- 172.21.15.72:0/2679858035 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1fcc05ef80 0x7f1fcc061440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1fe00a4d60 tx=0x7f1fd0008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:28.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.123+0000 7f1fc77fe700 1 -- 172.21.15.72:0/2679858035 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1fe0064600 con 0x7f1fe0153de0 2023-08-31T19:00:28.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.314+0000 7f1fe61ff700 1 -- 172.21.15.72:0/2679858035 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fe0064600 con 0x7f1fcc05ef80 2023-08-31T19:00:28.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.316+0000 7f1fc77fe700 1 -- 172.21.15.72:0/2679858035 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f1fe0064600 con 0x7f1fcc05ef80 2023-08-31T19:00:28.316 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:28.316 INFO:teuthology.orchestra.run.smithi072.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:14", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:28.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.318+0000 7f1fe61ff700 1 -- 172.21.15.72:0/2679858035 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1fcc05ef80 msgr2=0x7f1fcc061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:28.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.318+0000 7f1fe61ff700 1 --2- 172.21.15.72:0/2679858035 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1fcc05ef80 0x7f1fcc061440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1fe00a4d60 tx=0x7f1fd0008040).stop 2023-08-31T19:00:28.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.318+0000 7f1fe61ff700 1 -- 172.21.15.72:0/2679858035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe0153de0 msgr2=0x7f1fe0163dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:28.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.318+0000 7f1fe61ff700 1 --2- 172.21.15.72:0/2679858035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe0153de0 0x7f1fe0163dc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f1fd4009130 tx=0x7f1fd4017000).stop 2023-08-31T19:00:28.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.318+0000 7f1fe61ff700 1 -- 172.21.15.72:0/2679858035 shutdown_connections 2023-08-31T19:00:28.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.318+0000 7f1fe61ff700 1 --2- 172.21.15.72:0/2679858035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1fe01541c0 0x7f1fe00bf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.318+0000 7f1fe61ff700 1 --2- 172.21.15.72:0/2679858035 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1fcc05ef80 0x7f1fcc061440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.318+0000 7f1fe61ff700 1 --2- 172.21.15.72:0/2679858035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fe00c1dc0 0x7f1fe0153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.318+0000 7f1fe61ff700 1 --2- 172.21.15.72:0/2679858035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe0153de0 0x7f1fe0163dc0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.318+0000 7f1fe61ff700 1 -- 172.21.15.72:0/2679858035 >> 172.21.15.72:0/2679858035 conn(0x7f1fe00c6de0 msgr2=0x7f1fe00697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:28.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.318+0000 7f1fe61ff700 1 -- 172.21.15.72:0/2679858035 shutdown_connections 2023-08-31T19:00:28.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.318+0000 7f1fe61ff700 1 -- 172.21.15.72:0/2679858035 wait complete. 2023-08-31T19:00:28.335 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:14", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:28.335 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-08-31T00:00:00', 'created': '2023-08-31T18:49:14', 'first': '2023-08-31T18:50:00', 'last': '2023-08-31T19:00:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-31T19:00:28.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:28.336 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-08-31T19:00:28.384 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:28.384 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:28.385 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:28.385 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:28.385 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:28.385 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:28.386 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:28.389 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:28.389 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:28.389 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:28.389 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:28.391 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-31-18_50_00_UTC', 'scheduled-2023-08-31-18_51_00_UTC', 'scheduled-2023-08-31-18_52_00_UTC', 'scheduled-2023-08-31-18_53_00_UTC', 'scheduled-2023-08-31-18_54_00_UTC', 'scheduled-2023-08-31-18_55_00_UTC', 'scheduled-2023-08-31-18_56_00_UTC', 'scheduled-2023-08-31-18_57_00_UTC', 'scheduled-2023-08-31-18_58_00_UTC', 'scheduled-2023-08-31-18_59_00_UTC', 'scheduled-2023-08-31-19_00_00_UTC'] 2023-08-31T19:00:28.391 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-08-31T19:00:28.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.585+0000 7fd511fff700 1 Processor -- start 2023-08-31T19:00:28.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.585+0000 7fd511fff700 1 -- start start 2023-08-31T19:00:28.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.586+0000 7fd511fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd50c0c4bb0 0x7fd50c0653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:28.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.586+0000 7fd511fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd50c13d960 0x7fd50c0c5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:28.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.586+0000 7fd511fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50c0c5d30 con 0x7fd50c0c5880 2023-08-31T19:00:28.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.586+0000 7fd511fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd50c0c4f90 con 0x7fd50c13d960 2023-08-31T19:00:28.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.586+0000 7fd511fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0c6020 con 0x7fd50c0c4bb0 2023-08-31T19:00:28.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.587+0000 7fd50affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd50c13d960 0x7fd50c0c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:28.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.587+0000 7fd50affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd50c13d960 0x7fd50c0c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54138/0 (socket says 172.21.15.72:54138) 2023-08-31T19:00:28.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.587+0000 7fd50affd700 1 -- 172.21.15.72:0/1281127020 learned_addr learned my addr 172.21.15.72:0/1281127020 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:28.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.587+0000 7fd50b7fe700 1 --2- 172.21.15.72:0/1281127020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd50c0c4bb0 0x7fd50c0653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:28.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.587+0000 7fd50affd700 1 -- 172.21.15.72:0/1281127020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd50c0c4bb0 msgr2=0x7fd50c0653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:28.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.587+0000 7fd50affd700 1 --2- 172.21.15.72:0/1281127020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd50c0c4bb0 0x7fd50c0653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.587+0000 7fd50affd700 1 -- 172.21.15.72:0/1281127020 >> v1:172.21.15.146:6789/0 conn(0x7fd50c0c5880 legacy=0x7fd50c1546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:28.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.587+0000 7fd50affd700 1 -- 172.21.15.72:0/1281127020 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c1587f0 con 0x7fd50c13d960 2023-08-31T19:00:28.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.587+0000 7fd50affd700 1 --2- 172.21.15.72:0/1281127020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd50c13d960 0x7fd50c0c5390 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fd500006fd0 tx=0x7fd5000090f0).ready entity=mon.0 client_cookie=8eae49d0ee29a750 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:28.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.587+0000 7fd50a7fc700 1 -- 172.21.15.72:0/1281127020 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000b600 con 0x7fd50c13d960 2023-08-31T19:00:28.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.588+0000 7fd50a7fc700 1 -- 172.21.15.72:0/1281127020 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50000b760 con 0x7fd50c13d960 2023-08-31T19:00:28.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.588+0000 7fd50a7fc700 1 -- 172.21.15.72:0/1281127020 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000bae0 con 0x7fd50c13d960 2023-08-31T19:00:28.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.588+0000 7fd511fff700 1 -- 172.21.15.72:0/1281127020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd50c13d960 msgr2=0x7fd50c0c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:28.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.588+0000 7fd511fff700 1 --2- 172.21.15.72:0/1281127020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd50c13d960 0x7fd50c0c5390 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fd500006fd0 tx=0x7fd5000090f0).stop 2023-08-31T19:00:28.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.588+0000 7fd511fff700 1 -- 172.21.15.72:0/1281127020 shutdown_connections 2023-08-31T19:00:28.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.588+0000 7fd511fff700 1 --2- 172.21.15.72:0/1281127020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd50c0c4bb0 0x7fd50c0653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.588+0000 7fd511fff700 1 --2- 172.21.15.72:0/1281127020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd50c13d960 0x7fd50c0c5390 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.588+0000 7fd511fff700 1 -- 172.21.15.72:0/1281127020 >> 172.21.15.72:0/1281127020 conn(0x7fd50c066350 msgr2=0x7fd50c066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:28.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.588+0000 7fd511fff700 1 -- 172.21.15.72:0/1281127020 shutdown_connections 2023-08-31T19:00:28.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.588+0000 7fd511fff700 1 -- 172.21.15.72:0/1281127020 wait complete. 2023-08-31T19:00:28.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.590+0000 7fd511fff700 1 Processor -- start 2023-08-31T19:00:28.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.590+0000 7fd511fff700 1 -- start start 2023-08-31T19:00:28.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd511fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd50c0c4bb0 0x7fd50c157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:28.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd511fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd50c0c5880 0x7fd50c0bfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:28.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd511fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd50c13d960 0x7fd50c164620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:28.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd511fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c165630 con 0x7fd50c0c5880 2023-08-31T19:00:28.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd511fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0a53c0 con 0x7fd50c0c4bb0 2023-08-31T19:00:28.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd511fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c165070 con 0x7fd50c13d960 2023-08-31T19:00:28.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd50affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd50c0c5880 0x7fd50c0bfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:28.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd50affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd50c0c5880 0x7fd50c0bfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54146/0 (socket says 172.21.15.72:54146) 2023-08-31T19:00:28.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd50affd700 1 -- 172.21.15.72:0/2833140099 learned_addr learned my addr 172.21.15.72:0/2833140099 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:28.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd50b7fe700 1 --2- 172.21.15.72:0/2833140099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd50c0c4bb0 0x7fd50c157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:28.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd50bfff700 1 --2- 172.21.15.72:0/2833140099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd50c13d960 0x7fd50c164620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:28.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd50affd700 1 -- 172.21.15.72:0/2833140099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd50c13d960 msgr2=0x7fd50c164620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:28.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd50affd700 1 --2- 172.21.15.72:0/2833140099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd50c13d960 0x7fd50c164620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd50affd700 1 -- 172.21.15.72:0/2833140099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd50c0c4bb0 msgr2=0x7fd50c157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:28.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd50affd700 1 --2- 172.21.15.72:0/2833140099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd50c0c4bb0 0x7fd50c157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.591+0000 7fd50affd700 1 -- 172.21.15.72:0/2833140099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd500009370 con 0x7fd50c0c5880 2023-08-31T19:00:28.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.592+0000 7fd50affd700 1 --2- 172.21.15.72:0/2833140099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd50c0c5880 0x7fd50c0bfbd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fd500011000 tx=0x7fd500017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:28.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.592+0000 7fd4f37fe700 1 -- 172.21.15.72:0/2833140099 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000bea0 con 0x7fd50c0c5880 2023-08-31T19:00:28.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.592+0000 7fd4f37fe700 1 -- 172.21.15.72:0/2833140099 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50000b8d0 con 0x7fd50c0c5880 2023-08-31T19:00:28.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.592+0000 7fd4f37fe700 1 -- 172.21.15.72:0/2833140099 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500024680 con 0x7fd50c0c5880 2023-08-31T19:00:28.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.592+0000 7fd511fff700 1 -- 172.21.15.72:0/2833140099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50c165350 con 0x7fd50c0c5880 2023-08-31T19:00:28.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.592+0000 7fd511fff700 1 -- 172.21.15.72:0/2833140099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50c0a5710 con 0x7fd50c0c5880 2023-08-31T19:00:28.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.593+0000 7fd511fff700 1 -- 172.21.15.72:0/2833140099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50c0a5b30 con 0x7fd50c0c5880 2023-08-31T19:00:28.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.594+0000 7fd4f37fe700 1 -- 172.21.15.72:0/2833140099 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fd500021070 con 0x7fd50c0c5880 2023-08-31T19:00:28.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.595+0000 7fd4f37fe700 1 --2- 172.21.15.72:0/2833140099 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd4f805ef80 0x7fd4f8061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:28.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.595+0000 7fd4f37fe700 1 -- 172.21.15.72:0/2833140099 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fd50007bca0 con 0x7fd50c0c5880 2023-08-31T19:00:28.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.595+0000 7fd50b7fe700 1 --2- 172.21.15.72:0/2833140099 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd4f805ef80 0x7fd4f8061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:28.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.596+0000 7fd50b7fe700 1 --2- 172.21.15.72:0/2833140099 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd4f805ef80 0x7fd4f8061440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd50c13d5b0 tx=0x7fd4fc008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:28.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.599+0000 7fd4f37fe700 1 -- 172.21.15.72:0/2833140099 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd5000508f0 con 0x7fd50c0c5880 2023-08-31T19:00:28.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.795+0000 7fd511fff700 1 -- 172.21.15.72:0/2833140099 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd50c06c6b0 con 0x7fd4f805ef80 2023-08-31T19:00:28.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.797+0000 7fd4f37fe700 1 -- 172.21.15.72:0/2833140099 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fd50c06c6b0 con 0x7fd4f805ef80 2023-08-31T19:00:28.797 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:28.797 INFO:teuthology.orchestra.run.smithi072.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:15", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:28.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.799+0000 7fd511fff700 1 -- 172.21.15.72:0/2833140099 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd4f805ef80 msgr2=0x7fd4f8061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:28.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.799+0000 7fd511fff700 1 --2- 172.21.15.72:0/2833140099 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd4f805ef80 0x7fd4f8061440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd50c13d5b0 tx=0x7fd4fc008040).stop 2023-08-31T19:00:28.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.799+0000 7fd511fff700 1 -- 172.21.15.72:0/2833140099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd50c0c5880 msgr2=0x7fd50c0bfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:28.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.799+0000 7fd511fff700 1 --2- 172.21.15.72:0/2833140099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd50c0c5880 0x7fd50c0bfbd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fd500011000 tx=0x7fd500017000).stop 2023-08-31T19:00:28.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.799+0000 7fd511fff700 1 -- 172.21.15.72:0/2833140099 shutdown_connections 2023-08-31T19:00:28.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.799+0000 7fd511fff700 1 --2- 172.21.15.72:0/2833140099 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd50c13d960 0x7fd50c164620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.799+0000 7fd511fff700 1 --2- 172.21.15.72:0/2833140099 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd4f805ef80 0x7fd4f8061440 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.799+0000 7fd511fff700 1 --2- 172.21.15.72:0/2833140099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd50c0c4bb0 0x7fd50c157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.799+0000 7fd511fff700 1 --2- 172.21.15.72:0/2833140099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd50c0c5880 0x7fd50c0bfbd0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:28.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.799+0000 7fd511fff700 1 -- 172.21.15.72:0/2833140099 >> 172.21.15.72:0/2833140099 conn(0x7fd50c066350 msgr2=0x7fd50c0c2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:28.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.799+0000 7fd511fff700 1 -- 172.21.15.72:0/2833140099 shutdown_connections 2023-08-31T19:00:28.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:28.799+0000 7fd511fff700 1 -- 172.21.15.72:0/2833140099 wait complete. 2023-08-31T19:00:28.817 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:15", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:28.818 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-08-31T00:00:00', 'created': '2023-08-31T18:49:15', 'first': '2023-08-31T18:50:00', 'last': '2023-08-31T19:00:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-31T19:00:28.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:28.819 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-08-31T19:00:28.871 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:28.871 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:28.871 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:28.871 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:28.872 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:28.872 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:28.872 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:28.872 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:28.872 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:28.873 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:28.873 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:28.873 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-31-18_50_00_UTC', 'scheduled-2023-08-31-18_51_00_UTC', 'scheduled-2023-08-31-18_52_00_UTC', 'scheduled-2023-08-31-18_53_00_UTC', 'scheduled-2023-08-31-18_54_00_UTC', 'scheduled-2023-08-31-18_55_00_UTC', 'scheduled-2023-08-31-18_56_00_UTC', 'scheduled-2023-08-31-18_57_00_UTC', 'scheduled-2023-08-31-18_58_00_UTC', 'scheduled-2023-08-31-18_59_00_UTC', 'scheduled-2023-08-31-19_00_00_UTC'] 2023-08-31T19:00:28.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-08-31T19:00:29.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.065+0000 7f6ceb1ff700 1 Processor -- start 2023-08-31T19:00:29.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.065+0000 7f6ceb1ff700 1 -- start start 2023-08-31T19:00:29.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.066+0000 7f6ceb1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce4151da0 0x7f6ce41553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:29.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.066+0000 7f6ceb1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6ce40c5370 0x7f6ce4064660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:29.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.066+0000 7f6ceb1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce4154f40 con 0x7f6ce4064b50 2023-08-31T19:00:29.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.066+0000 7f6ceb1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce40c57f0 con 0x7f6ce40c5370 2023-08-31T19:00:29.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.066+0000 7f6ceb1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4064fe0 con 0x7f6ce4151da0 2023-08-31T19:00:29.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.067+0000 7f6ce3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6ce40c5370 0x7f6ce4064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:29.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.067+0000 7f6ce8f9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce4151da0 0x7f6ce41553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:29.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.067+0000 7f6ce3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6ce40c5370 0x7f6ce4064660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:40434/0 (socket says 172.21.15.72:40434) 2023-08-31T19:00:29.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.067+0000 7f6ce979c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6ce4064b50 0x7f6ce40bfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:50476/0 (socket says 172.21.15.72:50476) 2023-08-31T19:00:29.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.067+0000 7f6ce3fff700 1 -- 172.21.15.72:0/3731047543 learned_addr learned my addr 172.21.15.72:0/3731047543 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:29.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.067+0000 7f6ce8f9b700 1 -- 172.21.15.72:0/3731047543 >> v2:172.21.15.146:3300/0 conn(0x7f6ce40c5370 msgr2=0x7f6ce4064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:29.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.067+0000 7f6ce8f9b700 1 --2- 172.21.15.72:0/3731047543 >> v2:172.21.15.146:3300/0 conn(0x7f6ce40c5370 0x7f6ce4064660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.067+0000 7f6ce8f9b700 1 -- 172.21.15.72:0/3731047543 >> v1:172.21.15.146:6789/0 conn(0x7f6ce4064b50 legacy=0x7f6ce40bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.067+0000 7f6ce8f9b700 1 -- 172.21.15.72:0/3731047543 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce4154960 con 0x7f6ce4151da0 2023-08-31T19:00:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.068+0000 7f6ce8f9b700 1 --2- 172.21.15.72:0/3731047543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce4151da0 0x7f6ce41553d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f6cd8009760 tx=0x7f6cd8009060).ready entity=mon.2 client_cookie=9544a25044e8816d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.068+0000 7f6ce37fe700 1 -- 172.21.15.72:0/3731047543 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd800f510 con 0x7f6ce4151da0 2023-08-31T19:00:29.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.068+0000 7f6ce37fe700 1 -- 172.21.15.72:0/3731047543 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd800f670 con 0x7f6ce4151da0 2023-08-31T19:00:29.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.068+0000 7f6ce37fe700 1 -- 172.21.15.72:0/3731047543 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd800f9f0 con 0x7f6ce4151da0 2023-08-31T19:00:29.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.068+0000 7f6ceb1ff700 1 -- 172.21.15.72:0/3731047543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce4151da0 msgr2=0x7f6ce41553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:29.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.068+0000 7f6ceb1ff700 1 --2- 172.21.15.72:0/3731047543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce4151da0 0x7f6ce41553d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f6cd8009760 tx=0x7f6cd8009060).stop 2023-08-31T19:00:29.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.069+0000 7f6ceb1ff700 1 -- 172.21.15.72:0/3731047543 shutdown_connections 2023-08-31T19:00:29.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.069+0000 7f6ceb1ff700 1 --2- 172.21.15.72:0/3731047543 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce4151da0 0x7f6ce41553d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.069+0000 7f6ceb1ff700 1 --2- 172.21.15.72:0/3731047543 >> v2:172.21.15.146:3300/0 conn(0x7f6ce40c5370 0x7f6ce4064660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.069+0000 7f6ceb1ff700 1 -- 172.21.15.72:0/3731047543 >> 172.21.15.72:0/3731047543 conn(0x7f6ce4063a90 msgr2=0x7f6ce40cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:29.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.069+0000 7f6ceb1ff700 1 -- 172.21.15.72:0/3731047543 shutdown_connections 2023-08-31T19:00:29.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.069+0000 7f6ceb1ff700 1 -- 172.21.15.72:0/3731047543 wait complete. 2023-08-31T19:00:29.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.070+0000 7f6ceb1ff700 1 Processor -- start 2023-08-31T19:00:29.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.070+0000 7f6ceb1ff700 1 -- start start 2023-08-31T19:00:29.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.071+0000 7f6ceb1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4064b50 0x7f6ce40c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:29.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.071+0000 7f6ceb1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce40c5370 0x7f6ce4164280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:29.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.071+0000 7f6ceb1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ce4151da0 0x7f6ce40b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:29.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.071+0000 7f6ceb1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4164770 con 0x7f6ce4151da0 2023-08-31T19:00:29.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.071+0000 7f6ceb1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40c43d0 con 0x7f6ce4064b50 2023-08-31T19:00:29.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.071+0000 7f6ceb1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40c46b0 con 0x7f6ce40c5370 2023-08-31T19:00:29.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.071+0000 7f6ce979c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ce4151da0 0x7f6ce40b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:29.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ce979c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ce4151da0 0x7f6ce40b0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54158/0 (socket says 172.21.15.72:54158) 2023-08-31T19:00:29.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ce979c700 1 -- 172.21.15.72:0/1163600158 learned_addr learned my addr 172.21.15.72:0/1163600158 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:29.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ce3fff700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce40c5370 0x7f6ce4164280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:29.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ce8f9b700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4064b50 0x7f6ce40c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:29.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ce979c700 1 -- 172.21.15.72:0/1163600158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce40c5370 msgr2=0x7f6ce4164280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:29.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ce979c700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce40c5370 0x7f6ce4164280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ce979c700 1 -- 172.21.15.72:0/1163600158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4064b50 msgr2=0x7f6ce40c3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:29.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ce979c700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4064b50 0x7f6ce40c3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ce979c700 1 -- 172.21.15.72:0/1163600158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd80092a0 con 0x7f6ce4151da0 2023-08-31T19:00:29.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ce8f9b700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4064b50 0x7f6ce40c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:29.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ce3fff700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce40c5370 0x7f6ce4164280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:29.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ce979c700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ce4151da0 0x7f6ce40b0830 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f6cdc00c7c0 tx=0x7f6cdc001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:29.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ce0ff9700 1 -- 172.21.15.72:0/1163600158 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc005c70 con 0x7f6ce4151da0 2023-08-31T19:00:29.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ce0ff9700 1 -- 172.21.15.72:0/1163600158 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc005dd0 con 0x7f6ce4151da0 2023-08-31T19:00:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ce0ff9700 1 -- 172.21.15.72:0/1163600158 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc007320 con 0x7f6ce4151da0 2023-08-31T19:00:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.072+0000 7f6ceb1ff700 1 -- 172.21.15.72:0/1163600158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce40c4990 con 0x7f6ce4151da0 2023-08-31T19:00:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.073+0000 7f6ceb1ff700 1 -- 172.21.15.72:0/1163600158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce40c4f50 con 0x7f6ce4151da0 2023-08-31T19:00:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.074+0000 7f6ceb1ff700 1 -- 172.21.15.72:0/1163600158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce40c5170 con 0x7f6ce4151da0 2023-08-31T19:00:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.074+0000 7f6ce0ff9700 1 -- 172.21.15.72:0/1163600158 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f6cdc007710 con 0x7f6ce4151da0 2023-08-31T19:00:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.075+0000 7f6ce0ff9700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cc805ef80 0x7f6cc8061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:29.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.075+0000 7f6ce0ff9700 1 -- 172.21.15.72:0/1163600158 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f6cdc07a050 con 0x7f6ce4151da0 2023-08-31T19:00:29.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.076+0000 7f6ce8f9b700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cc805ef80 0x7f6cc8061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:29.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.076+0000 7f6ce8f9b700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cc805ef80 0x7f6cc8061440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6cd8009fd0 tx=0x7f6cd8017000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:29.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.079+0000 7f6ce0ff9700 1 -- 172.21.15.72:0/1163600158 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6cdc04b270 con 0x7f6ce4151da0 2023-08-31T19:00:29.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.272+0000 7f6ceb1ff700 1 -- 172.21.15.72:0/1163600158 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ce406a7e0 con 0x7f6cc805ef80 2023-08-31T19:00:29.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.274+0000 7f6ce0ff9700 1 -- 172.21.15.72:0/1163600158 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f6ce406a7e0 con 0x7f6cc805ef80 2023-08-31T19:00:29.274 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:29.274 INFO:teuthology.orchestra.run.smithi072.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:15", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:29.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.276+0000 7f6ceb1ff700 1 -- 172.21.15.72:0/1163600158 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cc805ef80 msgr2=0x7f6cc8061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:29.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.276+0000 7f6ceb1ff700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cc805ef80 0x7f6cc8061440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6cd8009fd0 tx=0x7f6cd8017000).stop 2023-08-31T19:00:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.276+0000 7f6ceb1ff700 1 -- 172.21.15.72:0/1163600158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ce4151da0 msgr2=0x7f6ce40b0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.276+0000 7f6ceb1ff700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ce4151da0 0x7f6ce40b0830 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f6cdc00c7c0 tx=0x7f6cdc001510).stop 2023-08-31T19:00:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.276+0000 7f6ceb1ff700 1 -- 172.21.15.72:0/1163600158 shutdown_connections 2023-08-31T19:00:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.276+0000 7f6ceb1ff700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ce4151da0 0x7f6ce40b0830 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.276+0000 7f6ceb1ff700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cc805ef80 0x7f6cc8061440 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.276+0000 7f6ceb1ff700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4064b50 0x7f6ce40c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.276+0000 7f6ceb1ff700 1 --2- 172.21.15.72:0/1163600158 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce40c5370 0x7f6ce4164280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.276+0000 7f6ceb1ff700 1 -- 172.21.15.72:0/1163600158 >> 172.21.15.72:0/1163600158 conn(0x7f6ce4063a90 msgr2=0x7f6ce40c9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.276+0000 7f6ceb1ff700 1 -- 172.21.15.72:0/1163600158 shutdown_connections 2023-08-31T19:00:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.276+0000 7f6ceb1ff700 1 -- 172.21.15.72:0/1163600158 wait complete. 2023-08-31T19:00:29.293 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T18:49:15", "first": "2023-08-31T18:50:00", "last": "2023-08-31T19:00:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-31T19:00:29.294 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-08-31T00:00:00', 'created': '2023-08-31T18:49:15', 'first': '2023-08-31T18:50:00', 'last': '2023-08-31T19:00:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-31T19:00:29.294 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-08-31T19:00:29.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.491+0000 7fe87bfff700 1 Processor -- start 2023-08-31T19:00:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.491+0000 7fe87bfff700 1 -- start start 2023-08-31T19:00:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.492+0000 7fe87bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe874154120 0x7fe8740a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.492+0000 7fe87bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe874154500 0x7fe8740646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.492+0000 7fe87bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe874064b90 0x7fe8740c0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.492+0000 7fe87bfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8740aa620 con 0x7fe874064b90 2023-08-31T19:00:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.492+0000 7fe87bfff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8740aa3a0 con 0x7fe874154120 2023-08-31T19:00:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.492+0000 7fe87bfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe874064ff0 con 0x7fe874154500 2023-08-31T19:00:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.493+0000 7fe87a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe874064b90 0x7fe8740c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.493+0000 7fe87a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe874064b90 0x7fe8740c0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54164/0 (socket says 172.21.15.72:54164) 2023-08-31T19:00:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.493+0000 7fe87a59c700 1 -- 172.21.15.72:0/2881950547 learned_addr learned my addr 172.21.15.72:0/2881950547 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.493+0000 7fe879d9b700 1 --2- 172.21.15.72:0/2881950547 >> v2:172.21.15.146:3300/0 conn(0x7fe874154120 0x7fe8740a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.493+0000 7fe87959a700 1 --2- 172.21.15.72:0/2881950547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe874154500 0x7fe8740646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:29.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.493+0000 7fe87a59c700 1 -- 172.21.15.72:0/2881950547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe874154500 msgr2=0x7fe8740646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:29.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.493+0000 7fe87a59c700 1 --2- 172.21.15.72:0/2881950547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe874154500 0x7fe8740646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.493+0000 7fe87a59c700 1 -- 172.21.15.72:0/2881950547 >> v2:172.21.15.146:3300/0 conn(0x7fe874154120 msgr2=0x7fe8740a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:29.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.493+0000 7fe87a59c700 1 --2- 172.21.15.72:0/2881950547 >> v2:172.21.15.146:3300/0 conn(0x7fe874154120 0x7fe8740a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.493+0000 7fe87a59c700 1 -- 172.21.15.72:0/2881950547 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8740c5450 con 0x7fe874064b90 2023-08-31T19:00:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.493+0000 7fe879d9b700 1 --2- 172.21.15.72:0/2881950547 >> v2:172.21.15.146:3300/0 conn(0x7fe874154120 0x7fe8740a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.493+0000 7fe87959a700 1 --2- 172.21.15.72:0/2881950547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe874154500 0x7fe8740646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.493+0000 7fe87a59c700 1 --2- 172.21.15.72:0/2881950547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874064b90 0x7fe8740c0290 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fe8740643c0 tx=0x7fe86c009840).ready entity=mon.0 client_cookie=bbede5338f106958 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.493+0000 7fe878d99700 1 -- 172.21.15.72:0/2881950547 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c00e070 con 0x7fe874064b90 2023-08-31T19:00:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.494+0000 7fe878d99700 1 -- 172.21.15.72:0/2881950547 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c00ba50 con 0x7fe874064b90 2023-08-31T19:00:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.494+0000 7fe878d99700 1 -- 172.21.15.72:0/2881950547 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c00bdd0 con 0x7fe874064b90 2023-08-31T19:00:29.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.494+0000 7fe87bfff700 1 -- 172.21.15.72:0/2881950547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874064b90 msgr2=0x7fe8740c0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:29.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.494+0000 7fe87bfff700 1 --2- 172.21.15.72:0/2881950547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874064b90 0x7fe8740c0290 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fe8740643c0 tx=0x7fe86c009840).stop 2023-08-31T19:00:29.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.494+0000 7fe87bfff700 1 -- 172.21.15.72:0/2881950547 shutdown_connections 2023-08-31T19:00:29.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.494+0000 7fe87bfff700 1 --2- 172.21.15.72:0/2881950547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874064b90 0x7fe8740c0290 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.494+0000 7fe87bfff700 1 --2- 172.21.15.72:0/2881950547 >> v2:172.21.15.146:3300/0 conn(0x7fe874154120 0x7fe8740a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.494+0000 7fe87bfff700 1 --2- 172.21.15.72:0/2881950547 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe874154500 0x7fe8740646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.494+0000 7fe87bfff700 1 -- 172.21.15.72:0/2881950547 >> 172.21.15.72:0/2881950547 conn(0x7fe8740cb7e0 msgr2=0x7fe8740c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:29.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.494+0000 7fe87bfff700 1 -- 172.21.15.72:0/2881950547 shutdown_connections 2023-08-31T19:00:29.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.494+0000 7fe87bfff700 1 -- 172.21.15.72:0/2881950547 wait complete. 2023-08-31T19:00:29.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.496+0000 7fe87bfff700 1 Processor -- start 2023-08-31T19:00:29.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.496+0000 7fe87bfff700 1 -- start start 2023-08-31T19:00:29.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.497+0000 7fe87bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe874064b90 0x7fe8740c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:29.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.497+0000 7fe87bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe874154120 0x7fe87414eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:29.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.497+0000 7fe87bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874154500 0x7fe8740c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:29.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.497+0000 7fe87bfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87414f030 con 0x7fe874154500 2023-08-31T19:00:29.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.497+0000 7fe87bfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740c2300 con 0x7fe874154120 2023-08-31T19:00:29.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.497+0000 7fe87bfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740c38a0 con 0x7fe874064b90 2023-08-31T19:00:29.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.497+0000 7fe87a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874154500 0x7fe8740c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:29.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.497+0000 7fe87a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874154500 0x7fe8740c1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54168/0 (socket says 172.21.15.72:54168) 2023-08-31T19:00:29.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.497+0000 7fe87a59c700 1 -- 172.21.15.72:0/2897538018 learned_addr learned my addr 172.21.15.72:0/2897538018 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:29.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.497+0000 7fe87959a700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe874154120 0x7fe87414eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:29.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.497+0000 7fe879d9b700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe874064b90 0x7fe8740c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:29.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.497+0000 7fe87a59c700 1 -- 172.21.15.72:0/2897538018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe874064b90 msgr2=0x7fe8740c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:29.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.498+0000 7fe87a59c700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe874064b90 0x7fe8740c4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.498+0000 7fe87a59c700 1 -- 172.21.15.72:0/2897538018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe874154120 msgr2=0x7fe87414eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:29.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.498+0000 7fe87a59c700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe874154120 0x7fe87414eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.498+0000 7fe87a59c700 1 -- 172.21.15.72:0/2897538018 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c009ae0 con 0x7fe874154500 2023-08-31T19:00:29.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.498+0000 7fe879d9b700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe874064b90 0x7fe8740c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:29.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.498+0000 7fe87959a700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe874154120 0x7fe87414eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:29.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.498+0000 7fe87a59c700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874154500 0x7fe8740c1e10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fe86c009fd0 tx=0x7fe8740aa760).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:29.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.498+0000 7fe869ffb700 1 -- 172.21.15.72:0/2897538018 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c0032f0 con 0x7fe874154500 2023-08-31T19:00:29.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.498+0000 7fe869ffb700 1 -- 172.21.15.72:0/2897538018 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c0092e0 con 0x7fe874154500 2023-08-31T19:00:29.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.498+0000 7fe869ffb700 1 -- 172.21.15.72:0/2897538018 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c01e6a0 con 0x7fe874154500 2023-08-31T19:00:29.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.498+0000 7fe87bfff700 1 -- 172.21.15.72:0/2897538018 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8740c4b10 con 0x7fe874154500 2023-08-31T19:00:29.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.498+0000 7fe87bfff700 1 -- 172.21.15.72:0/2897538018 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8740c3530 con 0x7fe874154500 2023-08-31T19:00:29.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.499+0000 7fe87bfff700 1 -- 172.21.15.72:0/2897538018 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87406a7e0 con 0x7fe874154500 2023-08-31T19:00:29.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.500+0000 7fe869ffb700 1 -- 172.21.15.72:0/2897538018 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fe86c003040 con 0x7fe874154500 2023-08-31T19:00:29.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.500+0000 7fe869ffb700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe85805ef80 0x7fe858061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:29.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.500+0000 7fe869ffb700 1 -- 172.21.15.72:0/2897538018 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fe86c07b6f0 con 0x7fe874154500 2023-08-31T19:00:29.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.501+0000 7fe879d9b700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe85805ef80 0x7fe858061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:29.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.501+0000 7fe879d9b700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe85805ef80 0x7fe858061440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fe870006d80 tx=0x7fe870008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:29.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.504+0000 7fe869ffb700 1 -- 172.21.15.72:0/2897538018 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe86c04c900 con 0x7fe874154500 2023-08-31T19:00:29.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.698+0000 7fe87bfff700 1 -- 172.21.15.72:0/2897538018 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe87406c6b0 con 0x7fe85805ef80 2023-08-31T19:00:29.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.702+0000 7fe869ffb700 1 -- 172.21.15.72:0/2897538018 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fe87406c6b0 con 0x7fe85805ef80 2023-08-31T19:00:29.702 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-08-31T19:00:29.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.703+0000 7fe87bfff700 1 -- 172.21.15.72:0/2897538018 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe85805ef80 msgr2=0x7fe858061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:29.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.703+0000 7fe87bfff700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe85805ef80 0x7fe858061440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fe870006d80 tx=0x7fe870008040).stop 2023-08-31T19:00:29.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.704+0000 7fe87bfff700 1 -- 172.21.15.72:0/2897538018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874154500 msgr2=0x7fe8740c1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:29.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.704+0000 7fe87bfff700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874154500 0x7fe8740c1e10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fe86c009fd0 tx=0x7fe8740aa760).stop 2023-08-31T19:00:29.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.704+0000 7fe87bfff700 1 -- 172.21.15.72:0/2897538018 shutdown_connections 2023-08-31T19:00:29.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.704+0000 7fe87bfff700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe874154500 0x7fe8740c1e10 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.704+0000 7fe87bfff700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe874064b90 0x7fe8740c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.704+0000 7fe87bfff700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe85805ef80 0x7fe858061440 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.704+0000 7fe87bfff700 1 --2- 172.21.15.72:0/2897538018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe874154120 0x7fe87414eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:29.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.704+0000 7fe87bfff700 1 -- 172.21.15.72:0/2897538018 >> 172.21.15.72:0/2897538018 conn(0x7fe8740cb7e0 msgr2=0x7fe8740ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:29.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.704+0000 7fe87bfff700 1 -- 172.21.15.72:0/2897538018 shutdown_connections 2023-08-31T19:00:29.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:29.704+0000 7fe87bfff700 1 -- 172.21.15.72:0/2897538018 wait complete. 2023-08-31T19:00:29.721 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-08-31T19:00:29.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:29.722 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-08-31T19:00:29.769 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:29.769 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:29.769 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:29.769 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:29.770 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:29.770 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:29.770 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:29.770 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:29.770 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:29.771 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:29.771 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:29.772 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:29.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:29.773 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_50_00_UTC) 2023-08-31T19:00:29.829 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:29.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:29.830 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_51_00_UTC) 2023-08-31T19:00:29.885 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:29.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:29.886 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_52_00_UTC) 2023-08-31T19:00:29.941 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:29.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:29.942 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_53_00_UTC) 2023-08-31T19:00:29.996 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:29.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:29.997 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_54_00_UTC) 2023-08-31T19:00:30.053 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:30.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:30.054 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_55_00_UTC) 2023-08-31T19:00:30.113 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:30.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:30.114 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_56_00_UTC) 2023-08-31T19:00:30.168 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:30.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:30.169 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_57_00_UTC) 2023-08-31T19:00:30.225 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:30.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:30.226 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_58_00_UTC) 2023-08-31T19:00:30.282 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:30.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:30.283 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-31-18_59_00_UTC) 2023-08-31T19:00:30.338 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:30.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:30.339 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-31-19_00_00_UTC) 2023-08-31T19:00:30.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:30.395 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-08-31T19:00:30.447 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-08-31T19:00:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.640+0000 7fa9dc5ff700 1 Processor -- start 2023-08-31T19:00:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.640+0000 7fa9dc5ff700 1 -- start start 2023-08-31T19:00:30.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.641+0000 7fa9dc5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9d4068c20 0x7fa9d4069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:30.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.641+0000 7fa9dc5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9d4062650 0x7fa9d4063c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:30.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.641+0000 7fa9dc5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d4064110 con 0x7fa9d40c1b50 2023-08-31T19:00:30.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.641+0000 7fa9dc5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d4062b80 con 0x7fa9d4062650 2023-08-31T19:00:30.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.641+0000 7fa9dc5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d4062e60 con 0x7fa9d4068c20 2023-08-31T19:00:30.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.642+0000 7fa9d9b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9d4062650 0x7fa9d4063c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:30.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.642+0000 7fa9dab9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa9d40c1b50 0x7fa9d4157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55148/0 (socket says 172.21.15.72:55148) 2023-08-31T19:00:30.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.642+0000 7fa9dab9c700 1 -- 172.21.15.72:0/4051396771 learned_addr learned my addr 172.21.15.72:0/4051396771 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:30.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.642+0000 7fa9da39b700 1 --2- 172.21.15.72:0/4051396771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9d4068c20 0x7fa9d4069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:30.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.642+0000 7fa9d9b9a700 1 -- 172.21.15.72:0/4051396771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9d4068c20 msgr2=0x7fa9d4069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:30.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.642+0000 7fa9d9b9a700 1 --2- 172.21.15.72:0/4051396771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9d4068c20 0x7fa9d4069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:30.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.642+0000 7fa9d9b9a700 1 -- 172.21.15.72:0/4051396771 >> v1:172.21.15.72:6789/0 conn(0x7fa9d40c1b50 legacy=0x7fa9d4157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:30.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.642+0000 7fa9d9b9a700 1 -- 172.21.15.72:0/4051396771 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4063140 con 0x7fa9d4062650 2023-08-31T19:00:30.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.642+0000 7fa9d9399700 1 -- 172.21.15.72:0/4051396771 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778859661 0 0) 0x7fa9d4064110 con 0x7fa9d40c1b50 2023-08-31T19:00:30.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.642+0000 7fa9d9b9a700 1 --2- 172.21.15.72:0/4051396771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d4062650 0x7fa9d4063c20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fa9c4009760 tx=0x7fa9c4009060).ready entity=mon.0 client_cookie=c16bb7c80831ceb4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:30.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.642+0000 7fa9d9399700 1 -- 172.21.15.72:0/4051396771 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c400b580 con 0x7fa9d4062650 2023-08-31T19:00:30.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.643+0000 7fa9d9399700 1 -- 172.21.15.72:0/4051396771 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c400b6e0 con 0x7fa9d4062650 2023-08-31T19:00:30.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.643+0000 7fa9d9399700 1 -- 172.21.15.72:0/4051396771 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c400ba60 con 0x7fa9d4062650 2023-08-31T19:00:30.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.643+0000 7fa9dc5ff700 1 -- 172.21.15.72:0/4051396771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d4062650 msgr2=0x7fa9d4063c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:30.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.643+0000 7fa9dc5ff700 1 --2- 172.21.15.72:0/4051396771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d4062650 0x7fa9d4063c20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fa9c4009760 tx=0x7fa9c4009060).stop 2023-08-31T19:00:30.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.643+0000 7fa9dc5ff700 1 -- 172.21.15.72:0/4051396771 shutdown_connections 2023-08-31T19:00:30.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.643+0000 7fa9dc5ff700 1 --2- 172.21.15.72:0/4051396771 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9d4068c20 0x7fa9d4069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:30.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.643+0000 7fa9dc5ff700 1 --2- 172.21.15.72:0/4051396771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d4062650 0x7fa9d4063c20 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:30.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.643+0000 7fa9dc5ff700 1 -- 172.21.15.72:0/4051396771 >> 172.21.15.72:0/4051396771 conn(0x7fa9d40c72f0 msgr2=0x7fa9d40c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:30.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.643+0000 7fa9dc5ff700 1 -- 172.21.15.72:0/4051396771 shutdown_connections 2023-08-31T19:00:30.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.643+0000 7fa9dc5ff700 1 -- 172.21.15.72:0/4051396771 wait complete. 2023-08-31T19:00:30.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.645+0000 7fa9dc5ff700 1 Processor -- start 2023-08-31T19:00:30.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.645+0000 7fa9dc5ff700 1 -- start start 2023-08-31T19:00:30.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9dc5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9d4062650 0x7fa9d40ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:30.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9dc5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d4068c20 0x7fa9d4150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:30.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9dc5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9d40c1b50 0x7fa9d40a5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:30.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9dc5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d40aa3e0 con 0x7fa9d4068c20 2023-08-31T19:00:30.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9dc5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d40aac80 con 0x7fa9d4062650 2023-08-31T19:00:30.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9dc5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d40ab600 con 0x7fa9d40c1b50 2023-08-31T19:00:30.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9d9b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d4068c20 0x7fa9d4150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:30.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9d9b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d4068c20 0x7fa9d4150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54182/0 (socket says 172.21.15.72:54182) 2023-08-31T19:00:30.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9d9b9a700 1 -- 172.21.15.72:0/958915173 learned_addr learned my addr 172.21.15.72:0/958915173 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:30.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9dab9c700 1 --2- 172.21.15.72:0/958915173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9d40c1b50 0x7fa9d40a5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:30.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9da39b700 1 --2- 172.21.15.72:0/958915173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9d4062650 0x7fa9d40ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:30.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9d9b9a700 1 -- 172.21.15.72:0/958915173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9d40c1b50 msgr2=0x7fa9d40a5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:30.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9d9b9a700 1 --2- 172.21.15.72:0/958915173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9d40c1b50 0x7fa9d40a5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:30.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9d9b9a700 1 -- 172.21.15.72:0/958915173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9d4062650 msgr2=0x7fa9d40ab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:30.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9d9b9a700 1 --2- 172.21.15.72:0/958915173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9d4062650 0x7fa9d40ab110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:30.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.646+0000 7fa9d9b9a700 1 -- 172.21.15.72:0/958915173 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c40092a0 con 0x7fa9d4068c20 2023-08-31T19:00:30.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.647+0000 7fa9d9b9a700 1 --2- 172.21.15.72:0/958915173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d4068c20 0x7fa9d4150eb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fa9d40c7f40 tx=0x7fa9c4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:30.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.647+0000 7fa9ca7fc700 1 -- 172.21.15.72:0/958915173 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c400b850 con 0x7fa9d4068c20 2023-08-31T19:00:30.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.647+0000 7fa9ca7fc700 1 -- 172.21.15.72:0/958915173 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c400b9b0 con 0x7fa9d4068c20 2023-08-31T19:00:30.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.647+0000 7fa9dc5ff700 1 -- 172.21.15.72:0/958915173 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d40a5f80 con 0x7fa9d4068c20 2023-08-31T19:00:30.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.647+0000 7fa9ca7fc700 1 -- 172.21.15.72:0/958915173 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c401b660 con 0x7fa9d4068c20 2023-08-31T19:00:30.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.647+0000 7fa9dc5ff700 1 -- 172.21.15.72:0/958915173 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d40aa910 con 0x7fa9d4068c20 2023-08-31T19:00:30.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.648+0000 7fa9dc5ff700 1 -- 172.21.15.72:0/958915173 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d4154590 con 0x7fa9d4068c20 2023-08-31T19:00:30.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.649+0000 7fa9ca7fc700 1 -- 172.21.15.72:0/958915173 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fa9c401ba90 con 0x7fa9d4068c20 2023-08-31T19:00:30.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.649+0000 7fa9ca7fc700 1 --2- 172.21.15.72:0/958915173 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa9b805ef80 0x7fa9b8061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:30.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.650+0000 7fa9ca7fc700 1 -- 172.21.15.72:0/958915173 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fa9c407bc40 con 0x7fa9d4068c20 2023-08-31T19:00:30.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.650+0000 7fa9da39b700 1 --2- 172.21.15.72:0/958915173 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa9b805ef80 0x7fa9b8061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:30.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.650+0000 7fa9da39b700 1 --2- 172.21.15.72:0/958915173 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa9b805ef80 0x7fa9b8061440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa9d000bb20 tx=0x7fa9d0008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.653+0000 7fa9ca7fc700 1 -- 172.21.15.72:0/958915173 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa9c4081020 con 0x7fa9d4068c20 2023-08-31T19:00:30.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.849+0000 7fa9dc5ff700 1 -- 172.21.15.72:0/958915173 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9d4063420 con 0x7fa9b805ef80 2023-08-31T19:00:30.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.853+0000 7fa9ca7fc700 1 -- 172.21.15.72:0/958915173 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fa9d4063420 con 0x7fa9b805ef80 2023-08-31T19:00:30.853 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-08-31T19:00:30.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.855+0000 7fa9dc5ff700 1 -- 172.21.15.72:0/958915173 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa9b805ef80 msgr2=0x7fa9b8061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:30.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.855+0000 7fa9dc5ff700 1 --2- 172.21.15.72:0/958915173 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa9b805ef80 0x7fa9b8061440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa9d000bb20 tx=0x7fa9d0008040).stop 2023-08-31T19:00:30.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.855+0000 7fa9dc5ff700 1 -- 172.21.15.72:0/958915173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d4068c20 msgr2=0x7fa9d4150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:30.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.855+0000 7fa9dc5ff700 1 --2- 172.21.15.72:0/958915173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d4068c20 0x7fa9d4150eb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fa9d40c7f40 tx=0x7fa9c4017000).stop 2023-08-31T19:00:30.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.855+0000 7fa9dc5ff700 1 -- 172.21.15.72:0/958915173 shutdown_connections 2023-08-31T19:00:30.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.855+0000 7fa9dc5ff700 1 --2- 172.21.15.72:0/958915173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9d40c1b50 0x7fa9d40a5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:30.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.855+0000 7fa9dc5ff700 1 --2- 172.21.15.72:0/958915173 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa9b805ef80 0x7fa9b8061440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:30.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.855+0000 7fa9dc5ff700 1 --2- 172.21.15.72:0/958915173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9d4062650 0x7fa9d40ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:30.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.855+0000 7fa9dc5ff700 1 --2- 172.21.15.72:0/958915173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9d4068c20 0x7fa9d4150eb0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:30.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.855+0000 7fa9dc5ff700 1 -- 172.21.15.72:0/958915173 >> 172.21.15.72:0/958915173 conn(0x7fa9d40c72f0 msgr2=0x7fa9d4153c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:30.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.855+0000 7fa9dc5ff700 1 -- 172.21.15.72:0/958915173 shutdown_connections 2023-08-31T19:00:30.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:30.855+0000 7fa9dc5ff700 1 -- 172.21.15.72:0/958915173 wait complete. 2023-08-31T19:00:30.873 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-08-31T19:00:30.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:30.874 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-08-31T19:00:30.921 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:30.922 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:30.922 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:30.922 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:30.922 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:30.923 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:30.923 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:30.923 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:30.923 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:30.923 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:30.924 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:30.925 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:30.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:30.925 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_50_00_UTC) 2023-08-31T19:00:30.981 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:30.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:30.982 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_51_00_UTC) 2023-08-31T19:00:31.036 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:31.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:31.037 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_52_00_UTC) 2023-08-31T19:00:31.091 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:31.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:31.092 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_53_00_UTC) 2023-08-31T19:00:31.146 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:31.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:31.146 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_54_00_UTC) 2023-08-31T19:00:31.200 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:31.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:31.201 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_55_00_UTC) 2023-08-31T19:00:31.258 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:31.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:31.258 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_56_00_UTC) 2023-08-31T19:00:31.313 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:31.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:31.314 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_57_00_UTC) 2023-08-31T19:00:31.368 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:31.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:31.369 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_58_00_UTC) 2023-08-31T19:00:31.422 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:31.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:31.423 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-31-18_59_00_UTC) 2023-08-31T19:00:31.479 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:31.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:31.480 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-31-19_00_00_UTC) 2023-08-31T19:00:31.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:31.535 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-08-31T19:00:31.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-08-31T19:00:31.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.780+0000 7fecdfdff700 1 Processor -- start 2023-08-31T19:00:31.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.781+0000 7fecdfdff700 1 -- start start 2023-08-31T19:00:31.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.782+0000 7fecdfdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd80c7f20 0x7fecd80646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:31.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.782+0000 7fecdfdff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd8154c80 con 0x7fecd80c83a0 2023-08-31T19:00:31.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.782+0000 7fecdfdff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd8155820 con 0x7fecd8151da0 2023-08-31T19:00:31.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.782+0000 7fecdfdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80a9f10 con 0x7fecd80c7f20 2023-08-31T19:00:31.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.782+0000 7fecde39c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fecd80c83a0 0x7fecd80bfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55152/0 (socket says 172.21.15.72:55152) 2023-08-31T19:00:31.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.782+0000 7fecde39c700 1 -- 172.21.15.72:0/4099519339 learned_addr learned my addr 172.21.15.72:0/4099519339 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:31.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.782+0000 7fecdcb99700 1 -- 172.21.15.72:0/4099519339 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231557368 0 0) 0x7fecd8154c80 con 0x7fecd80c83a0 2023-08-31T19:00:31.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdd39a700 1 --2- 172.21.15.72:0/4099519339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd80c7f20 0x7fecd80646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:31.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdcb99700 1 -- 172.21.15.72:0/4099519339 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc40033f0 con 0x7fecd80c83a0 2023-08-31T19:00:31.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdcb99700 1 -- 172.21.15.72:0/4099519339 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 259032273 0 0) 0x7fecc40033f0 con 0x7fecd80c83a0 2023-08-31T19:00:31.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdcb99700 1 -- 172.21.15.72:0/4099519339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd80c7f20 msgr2=0x7fecd80646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:31.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdcb99700 1 --2- 172.21.15.72:0/4099519339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd80c7f20 0x7fecd80646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:31.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdcb99700 1 -- 172.21.15.72:0/4099519339 >> v1:172.21.15.146:6789/0 conn(0x7fecd8151da0 legacy=0x7fecd8155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:31.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdcb99700 1 -- 172.21.15.72:0/4099519339 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd80aa1f0 con 0x7fecd80c83a0 2023-08-31T19:00:31.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdcb99700 1 -- 172.21.15.72:0/4099519339 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fecd00017f0 con 0x7fecd80c83a0 2023-08-31T19:00:31.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdcb99700 1 -- 172.21.15.72:0/4099519339 >> v1:172.21.15.72:6789/0 conn(0x7fecd80c83a0 legacy=0x7fecd80bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:31.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdcb99700 1 --2- 172.21.15.72:0/4099519339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd80c7f20 0x7fecc4003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:31.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdcb99700 1 --2- 172.21.15.72:0/4099519339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc4003e90 0x7fecc4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:31.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdcb99700 1 --2- 172.21.15.72:0/4099519339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecc4004b80 0x7fecc4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:31.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdcb99700 1 -- 172.21.15.72:0/4099519339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80a9f10 con 0x7fecc4003e90 2023-08-31T19:00:31.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdcb99700 1 -- 172.21.15.72:0/4099519339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc400b9c0 con 0x7fecc4004b80 2023-08-31T19:00:31.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdcb99700 1 -- 172.21.15.72:0/4099519339 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc400bb80 con 0x7fecd80c7f20 2023-08-31T19:00:31.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecdd39a700 1 --2- 172.21.15.72:0/4099519339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc4003e90 0x7fecc4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:31.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecde39c700 1 --2- 172.21.15.72:0/4099519339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecc4004b80 0x7fecc4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:31.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.783+0000 7fecddb9b700 1 --2- 172.21.15.72:0/4099519339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd80c7f20 0x7fecc4003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:31.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.784+0000 7fecdd39a700 1 -- 172.21.15.72:0/4099519339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd80c7f20 msgr2=0x7fecc4003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:31.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.784+0000 7fecdd39a700 1 --2- 172.21.15.72:0/4099519339 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecd80c7f20 0x7fecc4003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:31.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.784+0000 7fecdd39a700 1 -- 172.21.15.72:0/4099519339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecc4004b80 msgr2=0x7fecc4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:31.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.784+0000 7fecdd39a700 1 --2- 172.21.15.72:0/4099519339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecc4004b80 0x7fecc4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:31.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.784+0000 7fecdd39a700 1 -- 172.21.15.72:0/4099519339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc40033f0 con 0x7fecc4003e90 2023-08-31T19:00:31.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.784+0000 7fecdd39a700 1 --2- 172.21.15.72:0/4099519339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc4003e90 0x7fecc4004690 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fecc8009a80 tx=0x7fecc8009060).ready entity=mon.0 client_cookie=7c16c876072c1ba3 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:31.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.784+0000 7fecdcb99700 1 -- 172.21.15.72:0/4099519339 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8009430 con 0x7fecc4003e90 2023-08-31T19:00:31.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.784+0000 7fecdcb99700 1 -- 172.21.15.72:0/4099519339 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc800e640 con 0x7fecc4003e90 2023-08-31T19:00:31.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.784+0000 7fecdcb99700 1 -- 172.21.15.72:0/4099519339 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc800e9c0 con 0x7fecc4003e90 2023-08-31T19:00:31.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.785+0000 7fecdfdff700 1 -- 172.21.15.72:0/4099519339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc4003e90 msgr2=0x7fecc4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:31.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.785+0000 7fecdfdff700 1 --2- 172.21.15.72:0/4099519339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc4003e90 0x7fecc4004690 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fecc8009a80 tx=0x7fecc8009060).stop 2023-08-31T19:00:31.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.785+0000 7fecde39c700 1 -- 172.21.15.72:0/4099519339 reap_dead start 2023-08-31T19:00:31.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.785+0000 7fecdfdff700 1 -- 172.21.15.72:0/4099519339 shutdown_connections 2023-08-31T19:00:31.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.785+0000 7fecdfdff700 1 -- 172.21.15.72:0/4099519339 >> 172.21.15.72:0/4099519339 conn(0x7fecd80cb840 msgr2=0x7fecd80c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:31.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.785+0000 7fecdfdff700 1 -- 172.21.15.72:0/4099519339 shutdown_connections 2023-08-31T19:00:31.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.785+0000 7fecdfdff700 1 -- 172.21.15.72:0/4099519339 wait complete. 2023-08-31T19:00:31.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.787+0000 7fecdfdff700 1 Processor -- start 2023-08-31T19:00:31.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.787+0000 7fecdfdff700 1 -- start start 2023-08-31T19:00:31.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.788+0000 7fecdfdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecc4003e90 0x7fecd80aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:31.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.788+0000 7fecdfdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd81406d0 0x7fecd80ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:31.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.788+0000 7fecdfdff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecd814da80 0x7fecd80c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.788+0000 7fecdfdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd8140b50 con 0x7fecd81406d0 2023-08-31T19:00:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.788+0000 7fecdfdff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80aeb90 con 0x7fecd814da80 2023-08-31T19:00:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.788+0000 7fecdfdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80af420 con 0x7fecc4003e90 2023-08-31T19:00:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.789+0000 7fecdd39a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd81406d0 0x7fecd80ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.789+0000 7fecdd39a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd81406d0 0x7fecd80ae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54200/0 (socket says 172.21.15.72:54200) 2023-08-31T19:00:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.789+0000 7fecdd39a700 1 -- 172.21.15.72:0/206915253 learned_addr learned my addr 172.21.15.72:0/206915253 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.789+0000 7fecddb9b700 1 --2- 172.21.15.72:0/206915253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecc4003e90 0x7fecd80aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.789+0000 7fecde39c700 1 --2- 172.21.15.72:0/206915253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecd814da80 0x7fecd80c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.789+0000 7fecdd39a700 1 -- 172.21.15.72:0/206915253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecc4003e90 msgr2=0x7fecd80aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.789+0000 7fecdd39a700 1 --2- 172.21.15.72:0/206915253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecc4003e90 0x7fecd80aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.789+0000 7fecdd39a700 1 -- 172.21.15.72:0/206915253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecd814da80 msgr2=0x7fecd80c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.789+0000 7fecdd39a700 1 --2- 172.21.15.72:0/206915253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecd814da80 0x7fecd80c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.789+0000 7fecdd39a700 1 -- 172.21.15.72:0/206915253 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd80af700 con 0x7fecd81406d0 2023-08-31T19:00:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.789+0000 7fecddb9b700 1 --2- 172.21.15.72:0/206915253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecc4003e90 0x7fecd80aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.789+0000 7fecdd39a700 1 --2- 172.21.15.72:0/206915253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd81406d0 0x7fecd80ae6a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fecc800e4b0 tx=0x7fecc801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.789+0000 7feccdffb700 1 -- 172.21.15.72:0/206915253 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc800e7b0 con 0x7fecd81406d0 2023-08-31T19:00:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.789+0000 7feccdffb700 1 -- 172.21.15.72:0/206915253 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc800e930 con 0x7fecd81406d0 2023-08-31T19:00:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.790+0000 7fecdfdff700 1 -- 172.21.15.72:0/206915253 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd80adea0 con 0x7fecd81406d0 2023-08-31T19:00:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.790+0000 7feccdffb700 1 -- 172.21.15.72:0/206915253 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc801b6a0 con 0x7fecd81406d0 2023-08-31T19:00:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.790+0000 7fecdfdff700 1 -- 172.21.15.72:0/206915253 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd814df00 con 0x7fecd81406d0 2023-08-31T19:00:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.791+0000 7fecdfdff700 1 -- 172.21.15.72:0/206915253 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd80ae4f0 con 0x7fecd81406d0 2023-08-31T19:00:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.791+0000 7feccdffb700 1 -- 172.21.15.72:0/206915253 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fecc801ba90 con 0x7fecd81406d0 2023-08-31T19:00:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.792+0000 7feccdffb700 1 --2- 172.21.15.72:0/206915253 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fecbc05ef50 0x7fecbc061410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.792+0000 7feccdffb700 1 -- 172.21.15.72:0/206915253 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fecc807bd00 con 0x7fecd81406d0 2023-08-31T19:00:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.792+0000 7fecddb9b700 1 --2- 172.21.15.72:0/206915253 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fecbc05ef50 0x7fecbc061410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:31.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.793+0000 7fecddb9b700 1 --2- 172.21.15.72:0/206915253 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fecbc05ef50 0x7fecbc061410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fecd4000f60 tx=0x7fecd4009040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:31.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.796+0000 7feccdffb700 1 -- 172.21.15.72:0/206915253 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fecc804ce60 con 0x7fecd81406d0 2023-08-31T19:00:31.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.989+0000 7fecdfdff700 1 -- 172.21.15.72:0/206915253 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fecd80add20 con 0x7fecbc05ef50 2023-08-31T19:00:31.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.993+0000 7feccdffb700 1 -- 172.21.15.72:0/206915253 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fecd4003670 con 0x7fecbc05ef50 2023-08-31T19:00:31.993 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-08-31T19:00:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.995+0000 7fecdfdff700 1 -- 172.21.15.72:0/206915253 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fecbc05ef50 msgr2=0x7fecbc061410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.995+0000 7fecdfdff700 1 --2- 172.21.15.72:0/206915253 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fecbc05ef50 0x7fecbc061410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fecd4000f60 tx=0x7fecd4009040).stop 2023-08-31T19:00:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.995+0000 7fecdfdff700 1 -- 172.21.15.72:0/206915253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd81406d0 msgr2=0x7fecd80ae6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.995+0000 7fecdfdff700 1 --2- 172.21.15.72:0/206915253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd81406d0 0x7fecd80ae6a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fecc800e4b0 tx=0x7fecc801a000).stop 2023-08-31T19:00:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.995+0000 7fecdfdff700 1 -- 172.21.15.72:0/206915253 shutdown_connections 2023-08-31T19:00:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.995+0000 7fecdfdff700 1 --2- 172.21.15.72:0/206915253 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fecbc05ef50 0x7fecbc061410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.995+0000 7fecdfdff700 1 --2- 172.21.15.72:0/206915253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fecd814da80 0x7fecd80c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.995+0000 7fecdfdff700 1 --2- 172.21.15.72:0/206915253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fecc4003e90 0x7fecd80aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.995+0000 7fecdfdff700 1 --2- 172.21.15.72:0/206915253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd81406d0 0x7fecd80ae6a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:31.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.995+0000 7fecdfdff700 1 -- 172.21.15.72:0/206915253 >> 172.21.15.72:0/206915253 conn(0x7fecd80cb840 msgr2=0x7fecd80ab510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:31.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.995+0000 7fecdfdff700 1 -- 172.21.15.72:0/206915253 shutdown_connections 2023-08-31T19:00:31.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:31.995+0000 7fecdfdff700 1 -- 172.21.15.72:0/206915253 wait complete. 2023-08-31T19:00:32.013 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-08-31T19:00:32.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:32.014 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-08-31T19:00:32.062 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:32.062 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:32.062 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:32.063 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:32.063 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:32.063 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:32.063 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:32.063 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:32.064 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:32.064 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:32.064 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:32.065 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:32.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:32.066 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_50_00_UTC) 2023-08-31T19:00:32.125 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:32.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:32.126 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_51_00_UTC) 2023-08-31T19:00:32.181 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:32.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:32.182 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_52_00_UTC) 2023-08-31T19:00:32.236 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:32.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:32.237 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_53_00_UTC) 2023-08-31T19:00:32.291 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:32.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:32.292 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_54_00_UTC) 2023-08-31T19:00:32.346 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:32.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:32.347 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_55_00_UTC) 2023-08-31T19:00:32.401 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:32.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:32.402 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_56_00_UTC) 2023-08-31T19:00:32.457 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:32.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:32.458 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_57_00_UTC) 2023-08-31T19:00:32.514 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:32.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:32.515 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_58_00_UTC) 2023-08-31T19:00:32.570 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:32.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:32.571 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-31-18_59_00_UTC) 2023-08-31T19:00:32.626 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:32.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:32.627 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-31-19_00_00_UTC) 2023-08-31T19:00:32.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:32.683 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-08-31T19:00:32.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-08-31T19:00:32.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.926+0000 7f289a1ff700 1 Processor -- start 2023-08-31T19:00:32.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.926+0000 7f289a1ff700 1 -- start start 2023-08-31T19:00:32.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.928+0000 7f289a1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28940c5aa0 0x7f28940653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:32.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.928+0000 7f289a1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f289413d960 0x7f2894067a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:32.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.928+0000 7f289a1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28940c4f90 con 0x7f28940c4bb0 2023-08-31T19:00:32.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.928+0000 7f289a1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28940c6020 con 0x7f289413d960 2023-08-31T19:00:32.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.928+0000 7f289a1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28941587f0 con 0x7f28940c5aa0 2023-08-31T19:00:32.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.928+0000 7f28937fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f28940c4bb0 0x7f28940c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51280/0 (socket says 172.21.15.72:51280) 2023-08-31T19:00:32.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.928+0000 7f28937fe700 1 -- 172.21.15.72:0/3566126321 learned_addr learned my addr 172.21.15.72:0/3566126321 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:32.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.928+0000 7f2893fff700 1 --2- 172.21.15.72:0/3566126321 >> v2:172.21.15.72:3300/0 conn(0x7f289413d960 0x7f2894067a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:32.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.928+0000 7f28927fc700 1 -- 172.21.15.72:0/3566126321 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661442476 0 0) 0x7f28940c4f90 con 0x7f28940c4bb0 2023-08-31T19:00:32.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.928+0000 7f2892ffd700 1 --2- 172.21.15.72:0/3566126321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28940c5aa0 0x7f28940653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:32.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.928+0000 7f28927fc700 1 -- 172.21.15.72:0/3566126321 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f287c0033f0 con 0x7f28940c4bb0 2023-08-31T19:00:32.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.928+0000 7f2893fff700 1 -- 172.21.15.72:0/3566126321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28940c5aa0 msgr2=0x7f28940653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:32.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.928+0000 7f2893fff700 1 --2- 172.21.15.72:0/3566126321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28940c5aa0 0x7f28940653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:32.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.928+0000 7f2893fff700 1 -- 172.21.15.72:0/3566126321 >> v1:172.21.15.72:6789/0 conn(0x7f28940c4bb0 legacy=0x7f28940c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:32.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.928+0000 7f2893fff700 1 -- 172.21.15.72:0/3566126321 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2894158ad0 con 0x7f289413d960 2023-08-31T19:00:32.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.929+0000 7f2893fff700 1 --2- 172.21.15.72:0/3566126321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f289413d960 0x7f2894067a20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f288c009e60 tx=0x7f288c009780).ready entity=mon.0 client_cookie=815953f919cd0133 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:32.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.929+0000 7f28927fc700 1 -- 172.21.15.72:0/3566126321 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c00e070 con 0x7f289413d960 2023-08-31T19:00:32.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.929+0000 7f28927fc700 1 -- 172.21.15.72:0/3566126321 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c00bb60 con 0x7f289413d960 2023-08-31T19:00:32.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.929+0000 7f28927fc700 1 -- 172.21.15.72:0/3566126321 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c012410 con 0x7f289413d960 2023-08-31T19:00:32.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.929+0000 7f289a1ff700 1 -- 172.21.15.72:0/3566126321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f289413d960 msgr2=0x7f2894067a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:32.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.929+0000 7f289a1ff700 1 --2- 172.21.15.72:0/3566126321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f289413d960 0x7f2894067a20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f288c009e60 tx=0x7f288c009780).stop 2023-08-31T19:00:32.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.929+0000 7f289a1ff700 1 -- 172.21.15.72:0/3566126321 shutdown_connections 2023-08-31T19:00:32.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.929+0000 7f289a1ff700 1 --2- 172.21.15.72:0/3566126321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f289413d960 0x7f2894067a20 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:32.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.929+0000 7f289a1ff700 1 --2- 172.21.15.72:0/3566126321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28940c5aa0 0x7f28940653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:32.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.930+0000 7f289a1ff700 1 -- 172.21.15.72:0/3566126321 >> 172.21.15.72:0/3566126321 conn(0x7f2894066350 msgr2=0x7f2894066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:32.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.930+0000 7f289a1ff700 1 -- 172.21.15.72:0/3566126321 shutdown_connections 2023-08-31T19:00:32.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.930+0000 7f289a1ff700 1 -- 172.21.15.72:0/3566126321 wait complete. 2023-08-31T19:00:32.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.931+0000 7f289a1ff700 1 Processor -- start 2023-08-31T19:00:32.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.931+0000 7f289a1ff700 1 -- start start 2023-08-31T19:00:32.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.932+0000 7f289a1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28940c4bb0 0x7f2894153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:32.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.932+0000 7f289a1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28940c5aa0 0x7f2894067d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:32.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.932+0000 7f289a1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f289413d960 0x7f28940bdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:32.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.932+0000 7f289a1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28941683f0 con 0x7f28940c4bb0 2023-08-31T19:00:32.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.932+0000 7f289a1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28941677e0 con 0x7f289413d960 2023-08-31T19:00:32.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.932+0000 7f289a1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2894167ac0 con 0x7f28940c5aa0 2023-08-31T19:00:32.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.932+0000 7f28937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28940c4bb0 0x7f2894153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:32.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.932+0000 7f28937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28940c4bb0 0x7f2894153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48470/0 (socket says 172.21.15.72:48470) 2023-08-31T19:00:32.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.932+0000 7f28937fe700 1 -- 172.21.15.72:0/3174316347 learned_addr learned my addr 172.21.15.72:0/3174316347 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:32.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.933+0000 7f2892ffd700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28940c5aa0 0x7f2894067d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:32.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.933+0000 7f2893fff700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f289413d960 0x7f28940bdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:32.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.933+0000 7f28937fe700 1 -- 172.21.15.72:0/3174316347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28940c5aa0 msgr2=0x7f2894067d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:32.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.933+0000 7f28937fe700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28940c5aa0 0x7f2894067d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:32.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.933+0000 7f28937fe700 1 -- 172.21.15.72:0/3174316347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f289413d960 msgr2=0x7f28940bdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:32.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.933+0000 7f28937fe700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f289413d960 0x7f28940bdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:32.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.933+0000 7f28937fe700 1 -- 172.21.15.72:0/3174316347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c009a20 con 0x7f28940c4bb0 2023-08-31T19:00:32.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.933+0000 7f2892ffd700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28940c5aa0 0x7f2894067d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:32.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.933+0000 7f2893fff700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f289413d960 0x7f28940bdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:32.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.933+0000 7f28937fe700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28940c4bb0 0x7f2894153810 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f288400c420 tx=0x7f2884007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:32.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.933+0000 7f287b7fe700 1 -- 172.21.15.72:0/3174316347 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28840072e0 con 0x7f28940c4bb0 2023-08-31T19:00:32.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.933+0000 7f287b7fe700 1 -- 172.21.15.72:0/3174316347 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2884007440 con 0x7f28940c4bb0 2023-08-31T19:00:32.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.933+0000 7f287b7fe700 1 -- 172.21.15.72:0/3174316347 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28840057a0 con 0x7f28940c4bb0 2023-08-31T19:00:32.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.933+0000 7f289a1ff700 1 -- 172.21.15.72:0/3174316347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2894167da0 con 0x7f28940c4bb0 2023-08-31T19:00:32.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.933+0000 7f289a1ff700 1 -- 172.21.15.72:0/3174316347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2894153d00 con 0x7f28940c4bb0 2023-08-31T19:00:32.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.934+0000 7f289a1ff700 1 -- 172.21.15.72:0/3174316347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2894064220 con 0x7f28940c4bb0 2023-08-31T19:00:32.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.935+0000 7f287b7fe700 1 -- 172.21.15.72:0/3174316347 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f2884005bd0 con 0x7f28940c4bb0 2023-08-31T19:00:32.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.936+0000 7f287b7fe700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f288005ef80 0x7f2880061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:32.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.936+0000 7f287b7fe700 1 -- 172.21.15.72:0/3174316347 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f28840799b0 con 0x7f28940c4bb0 2023-08-31T19:00:32.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.936+0000 7f2892ffd700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f288005ef80 0x7f2880061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:32.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.936+0000 7f2892ffd700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f288005ef80 0x7f2880061440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f28941578b0 tx=0x7f2888008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:32.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:32.940+0000 7f287b7fe700 1 -- 172.21.15.72:0/3174316347 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f288404ab10 con 0x7f28940c4bb0 2023-08-31T19:00:33.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:33.132+0000 7f289a1ff700 1 -- 172.21.15.72:0/3174316347 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2894168530 con 0x7f288005ef80 2023-08-31T19:00:33.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:33.135+0000 7f287b7fe700 1 -- 172.21.15.72:0/3174316347 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f2888009570 con 0x7f288005ef80 2023-08-31T19:00:33.136 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-08-31T19:00:33.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:33.137+0000 7f289a1ff700 1 -- 172.21.15.72:0/3174316347 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f288005ef80 msgr2=0x7f2880061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:33.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:33.137+0000 7f289a1ff700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f288005ef80 0x7f2880061440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f28941578b0 tx=0x7f2888008040).stop 2023-08-31T19:00:33.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:33.137+0000 7f289a1ff700 1 -- 172.21.15.72:0/3174316347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28940c4bb0 msgr2=0x7f2894153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:33.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:33.137+0000 7f289a1ff700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28940c4bb0 0x7f2894153810 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f288400c420 tx=0x7f2884007c80).stop 2023-08-31T19:00:33.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:33.138+0000 7f289a1ff700 1 -- 172.21.15.72:0/3174316347 shutdown_connections 2023-08-31T19:00:33.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:33.138+0000 7f289a1ff700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f288005ef80 0x7f2880061440 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:33.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:33.138+0000 7f289a1ff700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f289413d960 0x7f28940bdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:33.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:33.138+0000 7f289a1ff700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28940c4bb0 0x7f2894153810 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:33.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:33.138+0000 7f289a1ff700 1 --2- 172.21.15.72:0/3174316347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28940c5aa0 0x7f2894067d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:33.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:33.138+0000 7f289a1ff700 1 -- 172.21.15.72:0/3174316347 >> 172.21.15.72:0/3174316347 conn(0x7f2894066350 msgr2=0x7f289413a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:33.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:33.138+0000 7f289a1ff700 1 -- 172.21.15.72:0/3174316347 shutdown_connections 2023-08-31T19:00:33.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:33.138+0000 7f289a1ff700 1 -- 172.21.15.72:0/3174316347 wait complete. 2023-08-31T19:00:33.155 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-08-31T19:00:33.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:33.156 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-08-31T19:00:33.205 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:33.206 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:33.206 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:33.206 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:33.206 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:33.206 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:33.207 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:33.207 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:33.207 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:33.207 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:33.207 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:33.208 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:33.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:33.209 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_50_00_UTC) 2023-08-31T19:00:33.265 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:33.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:33.266 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_51_00_UTC) 2023-08-31T19:00:33.322 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:33.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:33.323 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_52_00_UTC) 2023-08-31T19:00:33.377 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:33.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:33.378 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_53_00_UTC) 2023-08-31T19:00:33.436 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:33.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:33.437 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_54_00_UTC) 2023-08-31T19:00:33.493 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:33.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:33.494 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_55_00_UTC) 2023-08-31T19:00:33.548 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:33.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:33.549 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_56_00_UTC) 2023-08-31T19:00:33.603 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:33.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:33.604 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_57_00_UTC) 2023-08-31T19:00:33.658 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:33.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:33.659 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_58_00_UTC) 2023-08-31T19:00:33.715 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:33.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:33.716 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-31-18_59_00_UTC) 2023-08-31T19:00:33.771 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:33.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:33.771 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-31-19_00_00_UTC) 2023-08-31T19:00:33.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:33.827 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-08-31T19:00:33.877 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-08-31T19:00:34.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.069+0000 7fbcb61ff700 1 Processor -- start 2023-08-31T19:00:34.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.069+0000 7fbcb61ff700 1 -- start start 2023-08-31T19:00:34.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.071+0000 7fbcb61ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbcb0154120 0x7fbcb00a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:34.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.071+0000 7fbcb61ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbcb0154500 0x7fbcb00646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:34.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.071+0000 7fbcb61ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcb0064b90 0x7fbcb00c0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:34.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.071+0000 7fbcb61ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb00aa620 con 0x7fbcb0154120 2023-08-31T19:00:34.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.071+0000 7fbcb61ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb0065020 con 0x7fbcb0154500 2023-08-31T19:00:34.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.071+0000 7fbcb61ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00aa3a0 con 0x7fbcb0064b90 2023-08-31T19:00:34.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.071+0000 7fbcaf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbcb0154120 0x7fbcb00a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:34.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.071+0000 7fbcaf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbcb0154120 0x7fbcb00a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48482/0 (socket says 172.21.15.72:48482) 2023-08-31T19:00:34.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.071+0000 7fbcaf7fe700 1 -- 172.21.15.72:0/611823861 learned_addr learned my addr 172.21.15.72:0/611823861 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:34.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.071+0000 7fbcaffff700 1 --2- 172.21.15.72:0/611823861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcb0064b90 0x7fbcb00c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:34.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.071+0000 7fbcaf7fe700 1 -- 172.21.15.72:0/611823861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcb0064b90 msgr2=0x7fbcb00c0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:34.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.071+0000 7fbcaeffd700 1 --2- 172.21.15.72:0/611823861 >> v2:172.21.15.146:3300/0 conn(0x7fbcb0154500 0x7fbcb00646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:34.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.071+0000 7fbcaf7fe700 1 --2- 172.21.15.72:0/611823861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcb0064b90 0x7fbcb00c0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:34.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.071+0000 7fbcaf7fe700 1 -- 172.21.15.72:0/611823861 >> v2:172.21.15.146:3300/0 conn(0x7fbcb0154500 msgr2=0x7fbcb00646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:34.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.071+0000 7fbcaf7fe700 1 --2- 172.21.15.72:0/611823861 >> v2:172.21.15.146:3300/0 conn(0x7fbcb0154500 0x7fbcb00646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:34.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.072+0000 7fbcaf7fe700 1 -- 172.21.15.72:0/611823861 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb00c5450 con 0x7fbcb0154120 2023-08-31T19:00:34.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.072+0000 7fbcaeffd700 1 --2- 172.21.15.72:0/611823861 >> v2:172.21.15.146:3300/0 conn(0x7fbcb0154500 0x7fbcb00646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:34.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.072+0000 7fbcaffff700 1 --2- 172.21.15.72:0/611823861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcb0064b90 0x7fbcb00c0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:34.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.072+0000 7fbcaf7fe700 1 --2- 172.21.15.72:0/611823861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcb0154120 0x7fbcb00a9eb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fbcb0061290 tx=0x7fbca00090f0).ready entity=mon.0 client_cookie=997fbe193d3668de server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:34.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.072+0000 7fbcae7fc700 1 -- 172.21.15.72:0/611823861 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca000b600 con 0x7fbcb0154120 2023-08-31T19:00:34.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.072+0000 7fbcae7fc700 1 -- 172.21.15.72:0/611823861 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca000b760 con 0x7fbcb0154120 2023-08-31T19:00:34.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.072+0000 7fbcae7fc700 1 -- 172.21.15.72:0/611823861 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca000bae0 con 0x7fbcb0154120 2023-08-31T19:00:34.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.072+0000 7fbcb61ff700 1 -- 172.21.15.72:0/611823861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcb0154120 msgr2=0x7fbcb00a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:34.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.072+0000 7fbcb61ff700 1 --2- 172.21.15.72:0/611823861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcb0154120 0x7fbcb00a9eb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fbcb0061290 tx=0x7fbca00090f0).stop 2023-08-31T19:00:34.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.072+0000 7fbcb61ff700 1 -- 172.21.15.72:0/611823861 shutdown_connections 2023-08-31T19:00:34.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.072+0000 7fbcb61ff700 1 --2- 172.21.15.72:0/611823861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcb0064b90 0x7fbcb00c0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:34.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.073+0000 7fbcb61ff700 1 --2- 172.21.15.72:0/611823861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcb0154120 0x7fbcb00a9eb0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:34.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.073+0000 7fbcb61ff700 1 --2- 172.21.15.72:0/611823861 >> v2:172.21.15.146:3300/0 conn(0x7fbcb0154500 0x7fbcb00646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:34.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.073+0000 7fbcb61ff700 1 -- 172.21.15.72:0/611823861 >> 172.21.15.72:0/611823861 conn(0x7fbcb00cb7e0 msgr2=0x7fbcb00c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:34.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.073+0000 7fbcb61ff700 1 -- 172.21.15.72:0/611823861 shutdown_connections 2023-08-31T19:00:34.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.073+0000 7fbcb61ff700 1 -- 172.21.15.72:0/611823861 wait complete. 2023-08-31T19:00:34.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.074+0000 7fbcb61ff700 1 Processor -- start 2023-08-31T19:00:34.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.074+0000 7fbcb61ff700 1 -- start start 2023-08-31T19:00:34.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.075+0000 7fbcb61ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb0064b90 0x7fbcb0147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:34.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.075+0000 7fbcb61ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcb0154120 0x7fbcb00af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:34.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.075+0000 7fbcb61ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcb0154500 0x7fbcb00af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:34.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.075+0000 7fbcb61ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00b07b0 con 0x7fbcb0154500 2023-08-31T19:00:34.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.075+0000 7fbcb61ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00afba0 con 0x7fbcb0064b90 2023-08-31T19:00:34.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.075+0000 7fbcb61ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00afe80 con 0x7fbcb0154120 2023-08-31T19:00:34.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.075+0000 7fbcaffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcb0154500 0x7fbcb00af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:34.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.075+0000 7fbcaffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcb0154500 0x7fbcb00af4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48488/0 (socket says 172.21.15.72:48488) 2023-08-31T19:00:34.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.075+0000 7fbcaffff700 1 -- 172.21.15.72:0/1850935279 learned_addr learned my addr 172.21.15.72:0/1850935279 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:34.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.076+0000 7fbcaeffd700 1 --2- 172.21.15.72:0/1850935279 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcb0154120 0x7fbcb00af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:34.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.076+0000 7fbcaf7fe700 1 --2- 172.21.15.72:0/1850935279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb0064b90 0x7fbcb0147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:34.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.076+0000 7fbcaffff700 1 -- 172.21.15.72:0/1850935279 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcb0154120 msgr2=0x7fbcb00af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:34.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.076+0000 7fbcaffff700 1 --2- 172.21.15.72:0/1850935279 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcb0154120 0x7fbcb00af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:34.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.076+0000 7fbcaffff700 1 -- 172.21.15.72:0/1850935279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb0064b90 msgr2=0x7fbcb0147b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:34.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.076+0000 7fbcaffff700 1 --2- 172.21.15.72:0/1850935279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb0064b90 0x7fbcb0147b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:34.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.076+0000 7fbcaffff700 1 -- 172.21.15.72:0/1850935279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca0009370 con 0x7fbcb0154500 2023-08-31T19:00:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.076+0000 7fbcaffff700 1 --2- 172.21.15.72:0/1850935279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcb0154500 0x7fbcb00af4f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fbca800a380 tx=0x7fbca8007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.076+0000 7fbc977fe700 1 -- 172.21.15.72:0/1850935279 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca800ae10 con 0x7fbcb0154500 2023-08-31T19:00:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.076+0000 7fbc977fe700 1 -- 172.21.15.72:0/1850935279 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca800d650 con 0x7fbcb0154500 2023-08-31T19:00:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.076+0000 7fbcb61ff700 1 -- 172.21.15.72:0/1850935279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb00b0160 con 0x7fbcb0154500 2023-08-31T19:00:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.076+0000 7fbc977fe700 1 -- 172.21.15.72:0/1850935279 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca800d9d0 con 0x7fbcb0154500 2023-08-31T19:00:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.076+0000 7fbcb61ff700 1 -- 172.21.15.72:0/1850935279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb0150c60 con 0x7fbcb0154500 2023-08-31T19:00:34.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.077+0000 7fbcb61ff700 1 -- 172.21.15.72:0/1850935279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb00b0920 con 0x7fbcb0154500 2023-08-31T19:00:34.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.078+0000 7fbc977fe700 1 -- 172.21.15.72:0/1850935279 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fbca8013070 con 0x7fbcb0154500 2023-08-31T19:00:34.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.079+0000 7fbc977fe700 1 --2- 172.21.15.72:0/1850935279 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbc9c05ef80 0x7fbc9c061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:34.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.079+0000 7fbc977fe700 1 -- 172.21.15.72:0/1850935279 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fbca807a950 con 0x7fbcb0154500 2023-08-31T19:00:34.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.079+0000 7fbcaf7fe700 1 --2- 172.21.15.72:0/1850935279 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbc9c05ef80 0x7fbc9c061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:34.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.080+0000 7fbcaf7fe700 1 --2- 172.21.15.72:0/1850935279 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbc9c05ef80 0x7fbc9c061440 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fbca0009130 tx=0x7fbca0017000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:34.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.083+0000 7fbc977fe700 1 -- 172.21.15.72:0/1850935279 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbca804bab0 con 0x7fbcb0154500 2023-08-31T19:00:34.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.279+0000 7fbcb61ff700 1 -- 172.21.15.72:0/1850935279 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcb006c6b0 con 0x7fbc9c05ef80 2023-08-31T19:00:34.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.283+0000 7fbc977fe700 1 -- 172.21.15.72:0/1850935279 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fbcb006c6b0 con 0x7fbc9c05ef80 2023-08-31T19:00:34.284 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-08-31T19:00:34.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.285+0000 7fbcb61ff700 1 -- 172.21.15.72:0/1850935279 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbc9c05ef80 msgr2=0x7fbc9c061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:34.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.285+0000 7fbcb61ff700 1 --2- 172.21.15.72:0/1850935279 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbc9c05ef80 0x7fbc9c061440 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fbca0009130 tx=0x7fbca0017000).stop 2023-08-31T19:00:34.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.285+0000 7fbcb61ff700 1 -- 172.21.15.72:0/1850935279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcb0154500 msgr2=0x7fbcb00af4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:34.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.285+0000 7fbcb61ff700 1 --2- 172.21.15.72:0/1850935279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcb0154500 0x7fbcb00af4f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fbca800a380 tx=0x7fbca8007900).stop 2023-08-31T19:00:34.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.285+0000 7fbcb61ff700 1 -- 172.21.15.72:0/1850935279 shutdown_connections 2023-08-31T19:00:34.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.285+0000 7fbcb61ff700 1 --2- 172.21.15.72:0/1850935279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcb0154500 0x7fbcb00af4f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:34.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.285+0000 7fbcb61ff700 1 --2- 172.21.15.72:0/1850935279 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbc9c05ef80 0x7fbc9c061440 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:34.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.285+0000 7fbcb61ff700 1 --2- 172.21.15.72:0/1850935279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcb0064b90 0x7fbcb0147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:34.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.285+0000 7fbcb61ff700 1 --2- 172.21.15.72:0/1850935279 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbcb0154120 0x7fbcb00af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:34.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.285+0000 7fbcb61ff700 1 -- 172.21.15.72:0/1850935279 >> 172.21.15.72:0/1850935279 conn(0x7fbcb00cb7e0 msgr2=0x7fbcb00ca020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:34.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.285+0000 7fbcb61ff700 1 -- 172.21.15.72:0/1850935279 shutdown_connections 2023-08-31T19:00:34.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:34.285+0000 7fbcb61ff700 1 -- 172.21.15.72:0/1850935279 wait complete. 2023-08-31T19:00:34.303 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-08-31T19:00:34.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:34.304 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-08-31T19:00:34.355 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:34.355 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:34.355 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:34.356 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:34.356 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:34.356 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:34.356 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:34.356 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:34.357 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:34.357 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:34.357 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:34.358 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:34.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:34.359 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_50_00_UTC) 2023-08-31T19:00:34.415 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:34.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:34.416 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_51_00_UTC) 2023-08-31T19:00:34.470 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:34.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:34.471 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_52_00_UTC) 2023-08-31T19:00:34.605 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:34.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:34.606 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_53_00_UTC) 2023-08-31T19:00:34.769 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:34.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:34.770 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_54_00_UTC) 2023-08-31T19:00:34.865 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:34.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:34.866 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_55_00_UTC) 2023-08-31T19:00:34.921 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:34.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:34.921 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_56_00_UTC) 2023-08-31T19:00:34.975 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:34.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:34.975 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_57_00_UTC) 2023-08-31T19:00:35.029 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:35.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:35.030 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_58_00_UTC) 2023-08-31T19:00:35.083 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:35.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:35.084 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-31-18_59_00_UTC) 2023-08-31T19:00:35.138 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:35.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:35.139 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-31-19_00_00_UTC) 2023-08-31T19:00:35.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:35.195 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-08-31T19:00:35.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-08-31T19:00:35.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.439+0000 7f7939fff700 1 Processor -- start 2023-08-31T19:00:35.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.439+0000 7f7939fff700 1 -- start start 2023-08-31T19:00:35.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.441+0000 7f7939fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79340c1ed0 0x7f79340c3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:35.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.441+0000 7f7939fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79340c37f0 0x7f79340bbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:35.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.441+0000 7f7939fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7934158aa0 con 0x7f79340a5e50 2023-08-31T19:00:35.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.441+0000 7f7939fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79340c2350 con 0x7f79340c1ed0 2023-08-31T19:00:35.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.441+0000 7f7939fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7934157e90 con 0x7f79340c37f0 2023-08-31T19:00:35.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.441+0000 7f7932ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79340c1ed0 0x7f79340c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:35.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.441+0000 7f7932ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79340c1ed0 0x7f79340c3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48492/0 (socket says 172.21.15.72:48492) 2023-08-31T19:00:35.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.441+0000 7f7932ffd700 1 -- 172.21.15.72:0/2547394811 learned_addr learned my addr 172.21.15.72:0/2547394811 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:35.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.441+0000 7f7933fff700 1 --2- 172.21.15.72:0/2547394811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79340c37f0 0x7f79340bbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:35.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.442+0000 7f7932ffd700 1 -- 172.21.15.72:0/2547394811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79340c37f0 msgr2=0x7f79340bbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:35.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.442+0000 7f7932ffd700 1 --2- 172.21.15.72:0/2547394811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79340c37f0 0x7f79340bbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:35.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.442+0000 7f7932ffd700 1 -- 172.21.15.72:0/2547394811 >> v1:172.21.15.146:6789/0 conn(0x7f79340a5e50 legacy=0x7f7934155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:35.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.442+0000 7f7932ffd700 1 -- 172.21.15.72:0/2547394811 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7934158170 con 0x7f79340c1ed0 2023-08-31T19:00:35.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.442+0000 7f7932ffd700 1 --2- 172.21.15.72:0/2547394811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340c1ed0 0x7f79340c3300 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f7928006fd0 tx=0x7f79280090f0).ready entity=mon.0 client_cookie=1b6ff990bb13b4b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:35.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.442+0000 7f79327fc700 1 -- 172.21.15.72:0/2547394811 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792800b600 con 0x7f79340c1ed0 2023-08-31T19:00:35.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.442+0000 7f79327fc700 1 -- 172.21.15.72:0/2547394811 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792800b760 con 0x7f79340c1ed0 2023-08-31T19:00:35.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.442+0000 7f79327fc700 1 -- 172.21.15.72:0/2547394811 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792800bae0 con 0x7f79340c1ed0 2023-08-31T19:00:35.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.443+0000 7f7939fff700 1 -- 172.21.15.72:0/2547394811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340c1ed0 msgr2=0x7f79340c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:35.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.443+0000 7f7939fff700 1 --2- 172.21.15.72:0/2547394811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340c1ed0 0x7f79340c3300 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f7928006fd0 tx=0x7f79280090f0).stop 2023-08-31T19:00:35.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.443+0000 7f7939fff700 1 -- 172.21.15.72:0/2547394811 shutdown_connections 2023-08-31T19:00:35.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.443+0000 7f7939fff700 1 --2- 172.21.15.72:0/2547394811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79340c37f0 0x7f79340bbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:35.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.443+0000 7f7939fff700 1 --2- 172.21.15.72:0/2547394811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340c1ed0 0x7f79340c3300 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:35.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.443+0000 7f7939fff700 1 -- 172.21.15.72:0/2547394811 >> 172.21.15.72:0/2547394811 conn(0x7f7934062650 msgr2=0x7f7934062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:35.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.443+0000 7f7939fff700 1 -- 172.21.15.72:0/2547394811 shutdown_connections 2023-08-31T19:00:35.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.443+0000 7f7939fff700 1 -- 172.21.15.72:0/2547394811 wait complete. 2023-08-31T19:00:35.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.444+0000 7f7939fff700 1 Processor -- start 2023-08-31T19:00:35.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.444+0000 7f7939fff700 1 -- start start 2023-08-31T19:00:35.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.445+0000 7f7939fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79340a5e50 0x7f79340c0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:35.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.445+0000 7f7939fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340c1ed0 0x7f793414dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:35.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.445+0000 7f7939fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79340c37f0 0x7f7934167b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:35.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.445+0000 7f7939fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79340bdae0 con 0x7f79340c1ed0 2023-08-31T19:00:35.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.445+0000 7f7939fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79340bddc0 con 0x7f79340c37f0 2023-08-31T19:00:35.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.445+0000 7f7939fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79340ab9e0 con 0x7f79340a5e50 2023-08-31T19:00:35.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.446+0000 7f7932ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340c1ed0 0x7f793414dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:35.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.446+0000 7f7932ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340c1ed0 0x7f793414dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48500/0 (socket says 172.21.15.72:48500) 2023-08-31T19:00:35.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.446+0000 7f7932ffd700 1 -- 172.21.15.72:0/837473195 learned_addr learned my addr 172.21.15.72:0/837473195 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:35.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.446+0000 7f7933fff700 1 --2- 172.21.15.72:0/837473195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79340c37f0 0x7f7934167b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:35.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.446+0000 7f79337fe700 1 --2- 172.21.15.72:0/837473195 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79340a5e50 0x7f79340c0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:35.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.446+0000 7f7932ffd700 1 -- 172.21.15.72:0/837473195 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79340a5e50 msgr2=0x7f79340c0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:35.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.446+0000 7f7932ffd700 1 --2- 172.21.15.72:0/837473195 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79340a5e50 0x7f79340c0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:35.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.446+0000 7f7932ffd700 1 -- 172.21.15.72:0/837473195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79340c37f0 msgr2=0x7f7934167b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:35.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.446+0000 7f7932ffd700 1 --2- 172.21.15.72:0/837473195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79340c37f0 0x7f7934167b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:35.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.446+0000 7f7932ffd700 1 -- 172.21.15.72:0/837473195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7928009370 con 0x7f79340c1ed0 2023-08-31T19:00:35.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.446+0000 7f7932ffd700 1 --2- 172.21.15.72:0/837473195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340c1ed0 0x7f793414dbe0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f7928009f50 tx=0x7f7928017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:35.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.446+0000 7f791b7fe700 1 -- 172.21.15.72:0/837473195 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792800bea0 con 0x7f79340c1ed0 2023-08-31T19:00:35.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.447+0000 7f791b7fe700 1 -- 172.21.15.72:0/837473195 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792800b8d0 con 0x7f79340c1ed0 2023-08-31T19:00:35.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.447+0000 7f7939fff700 1 -- 172.21.15.72:0/837473195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79340abcc0 con 0x7f79340c1ed0 2023-08-31T19:00:35.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.447+0000 7f791b7fe700 1 -- 172.21.15.72:0/837473195 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792801c670 con 0x7f79340c1ed0 2023-08-31T19:00:35.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.447+0000 7f7939fff700 1 -- 172.21.15.72:0/837473195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793414e6e0 con 0x7f79340c1ed0 2023-08-31T19:00:35.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.448+0000 7f7939fff700 1 -- 172.21.15.72:0/837473195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79340bdf50 con 0x7f79340c1ed0 2023-08-31T19:00:35.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.448+0000 7f791b7fe700 1 -- 172.21.15.72:0/837473195 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f792801ca60 con 0x7f79340c1ed0 2023-08-31T19:00:35.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.449+0000 7f791b7fe700 1 --2- 172.21.15.72:0/837473195 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f792005ef80 0x7f7920061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:35.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.449+0000 7f791b7fe700 1 -- 172.21.15.72:0/837473195 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7434+0+0 (secure 0 0 0) 0x7f792807be00 con 0x7f79340c1ed0 2023-08-31T19:00:35.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.450+0000 7f79337fe700 1 --2- 172.21.15.72:0/837473195 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f792005ef80 0x7f7920061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:35.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.450+0000 7f79337fe700 1 --2- 172.21.15.72:0/837473195 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f792005ef80 0x7f7920061440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f79340a9530 tx=0x7f7924009040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:35.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.453+0000 7f791b7fe700 1 -- 172.21.15.72:0/837473195 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f792804cbc0 con 0x7f79340c1ed0 2023-08-31T19:00:35.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.689+0000 7f7939fff700 1 -- 172.21.15.72:0/837473195 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f793406c6b0 con 0x7f792005ef80 2023-08-31T19:00:35.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.692+0000 7f791b7fe700 1 -- 172.21.15.72:0/837473195 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f7924001e90 con 0x7f792005ef80 2023-08-31T19:00:35.693 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-08-31T19:00:35.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.694+0000 7f7939fff700 1 -- 172.21.15.72:0/837473195 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f792005ef80 msgr2=0x7f7920061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:35.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.694+0000 7f7939fff700 1 --2- 172.21.15.72:0/837473195 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f792005ef80 0x7f7920061440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f79340a9530 tx=0x7f7924009040).stop 2023-08-31T19:00:35.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.694+0000 7f7939fff700 1 -- 172.21.15.72:0/837473195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340c1ed0 msgr2=0x7f793414dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:35.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.694+0000 7f7939fff700 1 --2- 172.21.15.72:0/837473195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340c1ed0 0x7f793414dbe0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f7928009f50 tx=0x7f7928017000).stop 2023-08-31T19:00:35.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.694+0000 7f7939fff700 1 -- 172.21.15.72:0/837473195 shutdown_connections 2023-08-31T19:00:35.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.694+0000 7f7939fff700 1 --2- 172.21.15.72:0/837473195 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f792005ef80 0x7f7920061440 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:35.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.694+0000 7f7939fff700 1 --2- 172.21.15.72:0/837473195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79340c37f0 0x7f7934167b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:35.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.694+0000 7f7939fff700 1 --2- 172.21.15.72:0/837473195 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79340a5e50 0x7f79340c0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:35.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.694+0000 7f7939fff700 1 --2- 172.21.15.72:0/837473195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340c1ed0 0x7f793414dbe0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:35.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.695+0000 7f7939fff700 1 -- 172.21.15.72:0/837473195 >> 172.21.15.72:0/837473195 conn(0x7f7934062650 msgr2=0x7f7934069b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:35.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.695+0000 7f7939fff700 1 -- 172.21.15.72:0/837473195 shutdown_connections 2023-08-31T19:00:35.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:35.695+0000 7f7939fff700 1 -- 172.21.15.72:0/837473195 wait complete. 2023-08-31T19:00:35.712 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-08-31T19:00:35.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:35.713 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-08-31T19:00:35.761 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:35.761 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:35.762 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:35.762 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:35.762 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:35.762 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:35.762 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:35.763 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:35.763 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:35.763 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:35.763 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:35.764 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:35.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:35.765 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_50_00_UTC) 2023-08-31T19:00:35.822 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:35.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:35.823 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_51_00_UTC) 2023-08-31T19:00:35.877 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:35.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:35.878 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_52_00_UTC) 2023-08-31T19:00:35.933 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:35.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:35.934 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_53_00_UTC) 2023-08-31T19:00:35.989 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:35.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:35.990 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_54_00_UTC) 2023-08-31T19:00:36.043 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:36.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:36.044 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_55_00_UTC) 2023-08-31T19:00:36.098 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:36.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:36.099 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_56_00_UTC) 2023-08-31T19:00:36.152 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:36.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:36.153 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_57_00_UTC) 2023-08-31T19:00:36.206 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:36.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:36.207 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_58_00_UTC) 2023-08-31T19:00:36.260 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:36.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:36.261 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-31-18_59_00_UTC) 2023-08-31T19:00:36.313 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:36.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:36.314 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-31-19_00_00_UTC) 2023-08-31T19:00:36.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:36.368 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-08-31T19:00:36.418 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-08-31T19:00:36.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.666+0000 7f55539ff700 1 Processor -- start 2023-08-31T19:00:36.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.666+0000 7f55539ff700 1 -- start start 2023-08-31T19:00:36.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.667+0000 7f55539ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f554c155630 0x7f554c153220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:36.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.667+0000 7f55539ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f554c0c3410 0x7f554c0c3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:36.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.667+0000 7f55539ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c065b60 con 0x7f554c1537e0 2023-08-31T19:00:36.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.667+0000 7f55539ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c155a10 con 0x7f554c155630 2023-08-31T19:00:36.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.667+0000 7f55539ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0bc0b0 con 0x7f554c0c3410 2023-08-31T19:00:36.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.667+0000 7f555179b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f554c155630 0x7f554c153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:36.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.667+0000 7f5550f9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f554c1537e0 0x7f554c0bb9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51282/0 (socket says 172.21.15.72:51282) 2023-08-31T19:00:36.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.668+0000 7f5550f9a700 1 -- 172.21.15.72:0/520446911 learned_addr learned my addr 172.21.15.72:0/520446911 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:36.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.668+0000 7f5551f9c700 1 --2- 172.21.15.72:0/520446911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f554c0c3410 0x7f554c0c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:36.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.668+0000 7f5543fff700 1 -- 172.21.15.72:0/520446911 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746634444 0 0) 0x7f554c065b60 con 0x7f554c1537e0 2023-08-31T19:00:36.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.668+0000 7f555179b700 1 -- 172.21.15.72:0/520446911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f554c0c3410 msgr2=0x7f554c0c3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:36.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.668+0000 7f555179b700 1 --2- 172.21.15.72:0/520446911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f554c0c3410 0x7f554c0c3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:36.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.668+0000 7f555179b700 1 -- 172.21.15.72:0/520446911 >> v1:172.21.15.72:6789/0 conn(0x7f554c1537e0 legacy=0x7f554c0bb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:36.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.668+0000 7f555179b700 1 -- 172.21.15.72:0/520446911 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0c1880 con 0x7f554c155630 2023-08-31T19:00:36.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.668+0000 7f555179b700 1 --2- 172.21.15.72:0/520446911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c155630 0x7f554c153220 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f5548009760 tx=0x7f5548009060).ready entity=mon.0 client_cookie=e4023c1b8d6b2e77 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:36.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.668+0000 7f5543fff700 1 -- 172.21.15.72:0/520446911 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800f510 con 0x7f554c155630 2023-08-31T19:00:36.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.668+0000 7f5543fff700 1 -- 172.21.15.72:0/520446911 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554800f670 con 0x7f554c155630 2023-08-31T19:00:36.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.668+0000 7f5543fff700 1 -- 172.21.15.72:0/520446911 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800f9f0 con 0x7f554c155630 2023-08-31T19:00:36.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.669+0000 7f55539ff700 1 -- 172.21.15.72:0/520446911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c155630 msgr2=0x7f554c153220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:36.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.669+0000 7f55539ff700 1 --2- 172.21.15.72:0/520446911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c155630 0x7f554c153220 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f5548009760 tx=0x7f5548009060).stop 2023-08-31T19:00:36.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.669+0000 7f55539ff700 1 -- 172.21.15.72:0/520446911 shutdown_connections 2023-08-31T19:00:36.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.669+0000 7f55539ff700 1 --2- 172.21.15.72:0/520446911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c155630 0x7f554c153220 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:36.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.669+0000 7f55539ff700 1 --2- 172.21.15.72:0/520446911 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f554c0c3410 0x7f554c0c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:36.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.669+0000 7f55539ff700 1 -- 172.21.15.72:0/520446911 >> 172.21.15.72:0/520446911 conn(0x7f554c062650 msgr2=0x7f554c062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:36.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.669+0000 7f55539ff700 1 -- 172.21.15.72:0/520446911 shutdown_connections 2023-08-31T19:00:36.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.669+0000 7f55539ff700 1 -- 172.21.15.72:0/520446911 wait complete. 2023-08-31T19:00:36.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.671+0000 7f55539ff700 1 Processor -- start 2023-08-31T19:00:36.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.671+0000 7f55539ff700 1 -- start start 2023-08-31T19:00:36.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f55539ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f554c0c3410 0x7f554c0a8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:36.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f55539ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f554c1537e0 0x7f554c144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:36.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f55539ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c155630 0x7f554c144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:36.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f55539ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c144e40 con 0x7f554c155630 2023-08-31T19:00:36.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f55539ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c143e20 con 0x7f554c1537e0 2023-08-31T19:00:36.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f55539ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c1577b0 con 0x7f554c0c3410 2023-08-31T19:00:36.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f5551f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c155630 0x7f554c144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:36.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f5551f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c155630 0x7f554c144950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48516/0 (socket says 172.21.15.72:48516) 2023-08-31T19:00:36.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f5551f9c700 1 -- 172.21.15.72:0/677555931 learned_addr learned my addr 172.21.15.72:0/677555931 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:36.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f555179b700 1 --2- 172.21.15.72:0/677555931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f554c0c3410 0x7f554c0a8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:36.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f5550f9a700 1 --2- 172.21.15.72:0/677555931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f554c1537e0 0x7f554c144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f5551f9c700 1 -- 172.21.15.72:0/677555931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f554c0c3410 msgr2=0x7f554c0a8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f5551f9c700 1 --2- 172.21.15.72:0/677555931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f554c0c3410 0x7f554c0a8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f5551f9c700 1 -- 172.21.15.72:0/677555931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f554c1537e0 msgr2=0x7f554c144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f5551f9c700 1 --2- 172.21.15.72:0/677555931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f554c1537e0 0x7f554c144460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.672+0000 7f5551f9c700 1 -- 172.21.15.72:0/677555931 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55480092a0 con 0x7f554c155630 2023-08-31T19:00:36.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.673+0000 7f5551f9c700 1 --2- 172.21.15.72:0/677555931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c155630 0x7f554c144950 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f5544009e20 tx=0x7f554400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:36.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.673+0000 7f55417fa700 1 -- 172.21.15.72:0/677555931 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554400caa0 con 0x7f554c155630 2023-08-31T19:00:36.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.673+0000 7f55417fa700 1 -- 172.21.15.72:0/677555931 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554400f040 con 0x7f554c155630 2023-08-31T19:00:36.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.673+0000 7f55539ff700 1 -- 172.21.15.72:0/677555931 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c0a9460 con 0x7f554c155630 2023-08-31T19:00:36.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.673+0000 7f55417fa700 1 -- 172.21.15.72:0/677555931 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554400ce10 con 0x7f554c155630 2023-08-31T19:00:36.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.673+0000 7f55539ff700 1 -- 172.21.15.72:0/677555931 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c156ba0 con 0x7f554c155630 2023-08-31T19:00:36.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.674+0000 7f55539ff700 1 -- 172.21.15.72:0/677555931 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c06c6b0 con 0x7f554c155630 2023-08-31T19:00:36.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.675+0000 7f55417fa700 1 -- 172.21.15.72:0/677555931 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f5544013610 con 0x7f554c155630 2023-08-31T19:00:36.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.676+0000 7f55417fa700 1 --2- 172.21.15.72:0/677555931 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f553005ef80 0x7f5530061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:36.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.676+0000 7f55417fa700 1 -- 172.21.15.72:0/677555931 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 7050+0+0 (secure 0 0 0) 0x7f554407aa90 con 0x7f554c155630 2023-08-31T19:00:36.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.676+0000 7f555179b700 1 --2- 172.21.15.72:0/677555931 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f553005ef80 0x7f5530061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:36.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.676+0000 7f555179b700 1 --2- 172.21.15.72:0/677555931 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f553005ef80 0x7f5530061440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f5548009fd0 tx=0x7f5548017000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:36.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.679+0000 7f55417fa700 1 -- 172.21.15.72:0/677555931 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f554404b9e0 con 0x7f554c155630 2023-08-31T19:00:36.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.876+0000 7f55539ff700 1 -- 172.21.15.72:0/677555931 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f554c05f0a0 con 0x7f553005ef80 2023-08-31T19:00:36.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.880+0000 7f55417fa700 1 -- 172.21.15.72:0/677555931 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f554c05f0a0 con 0x7f553005ef80 2023-08-31T19:00:36.881 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-08-31T19:00:36.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.882+0000 7f55539ff700 1 -- 172.21.15.72:0/677555931 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f553005ef80 msgr2=0x7f5530061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:36.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.882+0000 7f55539ff700 1 --2- 172.21.15.72:0/677555931 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f553005ef80 0x7f5530061440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f5548009fd0 tx=0x7f5548017000).stop 2023-08-31T19:00:36.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.883+0000 7f55539ff700 1 -- 172.21.15.72:0/677555931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c155630 msgr2=0x7f554c144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:36.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.883+0000 7f55539ff700 1 --2- 172.21.15.72:0/677555931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c155630 0x7f554c144950 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f5544009e20 tx=0x7f554400b040).stop 2023-08-31T19:00:36.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.883+0000 7f55539ff700 1 -- 172.21.15.72:0/677555931 shutdown_connections 2023-08-31T19:00:36.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.883+0000 7f55539ff700 1 --2- 172.21.15.72:0/677555931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c155630 0x7f554c144950 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:36.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.883+0000 7f55539ff700 1 --2- 172.21.15.72:0/677555931 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f554c0c3410 0x7f554c0a8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:36.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.883+0000 7f55539ff700 1 --2- 172.21.15.72:0/677555931 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f553005ef80 0x7f5530061440 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:36.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.883+0000 7f55539ff700 1 --2- 172.21.15.72:0/677555931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f554c1537e0 0x7f554c144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:36.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.883+0000 7f55539ff700 1 -- 172.21.15.72:0/677555931 >> 172.21.15.72:0/677555931 conn(0x7f554c062650 msgr2=0x7f554c0c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:36.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.883+0000 7f55539ff700 1 -- 172.21.15.72:0/677555931 shutdown_connections 2023-08-31T19:00:36.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:36.883+0000 7f55539ff700 1 -- 172.21.15.72:0/677555931 wait complete. 2023-08-31T19:00:36.900 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-08-31T19:00:36.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:36.901 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-08-31T19:00:36.948 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:36.949 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:36.949 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:36.949 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:36.949 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:36.949 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:36.950 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:36.950 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:36.950 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:36.950 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:36.950 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:36.951 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:36.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:36.952 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_50_00_UTC) 2023-08-31T19:00:37.007 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:37.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:37.008 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_51_00_UTC) 2023-08-31T19:00:37.062 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:37.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:37.063 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_52_00_UTC) 2023-08-31T19:00:37.116 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:37.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:37.117 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_53_00_UTC) 2023-08-31T19:00:37.170 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:37.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:37.171 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_54_00_UTC) 2023-08-31T19:00:37.224 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:37.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:37.226 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_55_00_UTC) 2023-08-31T19:00:37.279 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:37.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:37.280 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_56_00_UTC) 2023-08-31T19:00:37.334 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:37.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:37.335 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_57_00_UTC) 2023-08-31T19:00:37.388 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:37.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:37.389 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_58_00_UTC) 2023-08-31T19:00:37.442 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:37.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:37.443 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-31-18_59_00_UTC) 2023-08-31T19:00:37.533 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:37.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:37.534 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-31-19_00_00_UTC) 2023-08-31T19:00:37.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:37.600 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-08-31T19:00:37.649 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-08-31T19:00:37.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.842+0000 7fa09a3ff700 1 Processor -- start 2023-08-31T19:00:37.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.842+0000 7fa09a3ff700 1 -- start start 2023-08-31T19:00:37.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.843+0000 7fa09a3ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa0940c4bb0 0x7fa0940653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:37.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.843+0000 7fa09a3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa09413d960 0x7fa0940c5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:37.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.843+0000 7fa09a3ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0940c5cf0 con 0x7fa0940c5880 2023-08-31T19:00:37.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.843+0000 7fa09a3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0940c4f90 con 0x7fa09413d960 2023-08-31T19:00:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.843+0000 7fa09a3ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0940c6020 con 0x7fa0940c4bb0 2023-08-31T19:00:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.844+0000 7fa0937fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa09413d960 0x7fa0940c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.844+0000 7fa0937fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa09413d960 0x7fa0940c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48518/0 (socket says 172.21.15.72:48518) 2023-08-31T19:00:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.844+0000 7fa0937fe700 1 -- 172.21.15.72:0/1446572717 learned_addr learned my addr 172.21.15.72:0/1446572717 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.844+0000 7fa093fff700 1 --2- 172.21.15.72:0/1446572717 >> v2:172.21.15.146:3300/0 conn(0x7fa0940c4bb0 0x7fa0940653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.844+0000 7fa0937fe700 1 -- 172.21.15.72:0/1446572717 >> v2:172.21.15.146:3300/0 conn(0x7fa0940c4bb0 msgr2=0x7fa0940653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.844+0000 7fa0937fe700 1 --2- 172.21.15.72:0/1446572717 >> v2:172.21.15.146:3300/0 conn(0x7fa0940c4bb0 0x7fa0940653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.844+0000 7fa0937fe700 1 -- 172.21.15.72:0/1446572717 >> v1:172.21.15.146:6789/0 conn(0x7fa0940c5880 legacy=0x7fa0941546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.844+0000 7fa0937fe700 1 -- 172.21.15.72:0/1446572717 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0941587f0 con 0x7fa09413d960 2023-08-31T19:00:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.844+0000 7fa0937fe700 1 --2- 172.21.15.72:0/1446572717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa09413d960 0x7fa0940c5390 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fa0940699f0 tx=0x7fa0880090f0).ready entity=mon.0 client_cookie=fa549b6f2802cfa5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.845+0000 7fa092ffd700 1 -- 172.21.15.72:0/1446572717 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08800b520 con 0x7fa09413d960 2023-08-31T19:00:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.845+0000 7fa092ffd700 1 -- 172.21.15.72:0/1446572717 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08800b680 con 0x7fa09413d960 2023-08-31T19:00:37.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.845+0000 7fa092ffd700 1 -- 172.21.15.72:0/1446572717 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08800ba00 con 0x7fa09413d960 2023-08-31T19:00:37.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.845+0000 7fa09a3ff700 1 -- 172.21.15.72:0/1446572717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa09413d960 msgr2=0x7fa0940c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:37.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.845+0000 7fa09a3ff700 1 --2- 172.21.15.72:0/1446572717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa09413d960 0x7fa0940c5390 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fa0940699f0 tx=0x7fa0880090f0).stop 2023-08-31T19:00:37.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.845+0000 7fa09a3ff700 1 -- 172.21.15.72:0/1446572717 shutdown_connections 2023-08-31T19:00:37.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.845+0000 7fa09a3ff700 1 --2- 172.21.15.72:0/1446572717 >> v2:172.21.15.146:3300/0 conn(0x7fa0940c4bb0 0x7fa0940653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:37.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.845+0000 7fa09a3ff700 1 --2- 172.21.15.72:0/1446572717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa09413d960 0x7fa0940c5390 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:37.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.845+0000 7fa09a3ff700 1 -- 172.21.15.72:0/1446572717 >> 172.21.15.72:0/1446572717 conn(0x7fa094066350 msgr2=0x7fa094066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:37.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.845+0000 7fa09a3ff700 1 -- 172.21.15.72:0/1446572717 shutdown_connections 2023-08-31T19:00:37.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.845+0000 7fa09a3ff700 1 -- 172.21.15.72:0/1446572717 wait complete. 2023-08-31T19:00:37.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.847+0000 7fa09a3ff700 1 Processor -- start 2023-08-31T19:00:37.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.847+0000 7fa09a3ff700 1 -- start start 2023-08-31T19:00:37.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.848+0000 7fa09a3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0940c4bb0 0x7fa0941395a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.848+0000 7fa09a3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0940c5880 0x7fa0941546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.848+0000 7fa09a3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09413d960 0x7fa094154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.848+0000 7fa09a3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa094155090 con 0x7fa0940c4bb0 2023-08-31T19:00:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.848+0000 7fa09a3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa094139a90 con 0x7fa09413d960 2023-08-31T19:00:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.848+0000 7fa09a3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa094165000 con 0x7fa0940c5880 2023-08-31T19:00:37.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.848+0000 7fa093fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0940c4bb0 0x7fa0941395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:37.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.848+0000 7fa093fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0940c4bb0 0x7fa0941395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48520/0 (socket says 172.21.15.72:48520) 2023-08-31T19:00:37.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.848+0000 7fa093fff700 1 -- 172.21.15.72:0/2051495979 learned_addr learned my addr 172.21.15.72:0/2051495979 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:37.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.848+0000 7fa093fff700 1 -- 172.21.15.72:0/2051495979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0940c5880 msgr2=0x7fa0941546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:37.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.848+0000 7fa093fff700 1 --2- 172.21.15.72:0/2051495979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0940c5880 0x7fa0941546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:37.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.848+0000 7fa093fff700 1 -- 172.21.15.72:0/2051495979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09413d960 msgr2=0x7fa094154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:37.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.848+0000 7fa093fff700 1 --2- 172.21.15.72:0/2051495979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09413d960 0x7fa094154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:37.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.848+0000 7fa093fff700 1 -- 172.21.15.72:0/2051495979 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa088009370 con 0x7fa0940c4bb0 2023-08-31T19:00:37.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.848+0000 7fa093fff700 1 --2- 172.21.15.72:0/2051495979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0940c4bb0 0x7fa0941395a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fa08400e930 tx=0x7fa084009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:37.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.849+0000 7fa07bfff700 1 -- 172.21.15.72:0/2051495979 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400c640 con 0x7fa0940c4bb0 2023-08-31T19:00:37.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.849+0000 7fa07bfff700 1 -- 172.21.15.72:0/2051495979 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08400c7a0 con 0x7fa0940c4bb0 2023-08-31T19:00:37.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.849+0000 7fa07bfff700 1 -- 172.21.15.72:0/2051495979 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400cb20 con 0x7fa0940c4bb0 2023-08-31T19:00:37.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.849+0000 7fa09a3ff700 1 -- 172.21.15.72:0/2051495979 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0941643f0 con 0x7fa0940c4bb0 2023-08-31T19:00:37.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.849+0000 7fa09a3ff700 1 -- 172.21.15.72:0/2051495979 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0941649b0 con 0x7fa0940c4bb0 2023-08-31T19:00:37.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.850+0000 7fa09a3ff700 1 -- 172.21.15.72:0/2051495979 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09406c6b0 con 0x7fa0940c4bb0 2023-08-31T19:00:37.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.851+0000 7fa07bfff700 1 -- 172.21.15.72:0/2051495979 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fa08401b400 con 0x7fa0940c4bb0 2023-08-31T19:00:37.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.851+0000 7fa07bfff700 1 --2- 172.21.15.72:0/2051495979 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa08005ef80 0x7fa080061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:37.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.851+0000 7fa07bfff700 1 -- 172.21.15.72:0/2051495979 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7082+0+0 (secure 0 0 0) 0x7fa08407a8d0 con 0x7fa0940c4bb0 2023-08-31T19:00:37.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.852+0000 7fa0937fe700 1 --2- 172.21.15.72:0/2051495979 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa08005ef80 0x7fa080061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:37.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.852+0000 7fa0937fe700 1 --2- 172.21.15.72:0/2051495979 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa08005ef80 0x7fa080061440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fa0940699f0 tx=0x7fa088017000).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:37.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:37.856+0000 7fa07bfff700 1 -- 172.21.15.72:0/2051495979 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa08404b6e0 con 0x7fa0940c4bb0 2023-08-31T19:00:38.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:38.085+0000 7fa09a3ff700 1 -- 172.21.15.72:0/2051495979 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0940c6250 con 0x7fa08005ef80 2023-08-31T19:00:38.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:38.089+0000 7fa07bfff700 1 -- 172.21.15.72:0/2051495979 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fa0940c6250 con 0x7fa08005ef80 2023-08-31T19:00:38.089 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-08-31T19:00:38.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:38.091+0000 7fa09a3ff700 1 -- 172.21.15.72:0/2051495979 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa08005ef80 msgr2=0x7fa080061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:38.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:38.091+0000 7fa09a3ff700 1 --2- 172.21.15.72:0/2051495979 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa08005ef80 0x7fa080061440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fa0940699f0 tx=0x7fa088017000).stop 2023-08-31T19:00:38.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:38.091+0000 7fa09a3ff700 1 -- 172.21.15.72:0/2051495979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0940c4bb0 msgr2=0x7fa0941395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:38.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:38.091+0000 7fa09a3ff700 1 --2- 172.21.15.72:0/2051495979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0940c4bb0 0x7fa0941395a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fa08400e930 tx=0x7fa084009060).stop 2023-08-31T19:00:38.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:38.091+0000 7fa09a3ff700 1 -- 172.21.15.72:0/2051495979 shutdown_connections 2023-08-31T19:00:38.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:38.091+0000 7fa09a3ff700 1 --2- 172.21.15.72:0/2051495979 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa08005ef80 0x7fa080061440 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:38.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:38.091+0000 7fa09a3ff700 1 --2- 172.21.15.72:0/2051495979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa09413d960 0x7fa094154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:38.091+0000 7fa09a3ff700 1 --2- 172.21.15.72:0/2051495979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0940c4bb0 0x7fa0941395a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:38.091+0000 7fa09a3ff700 1 --2- 172.21.15.72:0/2051495979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0940c5880 0x7fa0941546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:38.091+0000 7fa09a3ff700 1 -- 172.21.15.72:0/2051495979 >> 172.21.15.72:0/2051495979 conn(0x7fa094066350 msgr2=0x7fa0940c5160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:38.091+0000 7fa09a3ff700 1 -- 172.21.15.72:0/2051495979 shutdown_connections 2023-08-31T19:00:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:38.091+0000 7fa09a3ff700 1 -- 172.21.15.72:0/2051495979 wait complete. 2023-08-31T19:00:38.109 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-08-31T19:00:38.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:38.110 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-08-31T19:00:38.158 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:38.158 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:38.159 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:38.159 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:38.159 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:38.159 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:38.159 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:38.160 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:38.160 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:38.160 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:38.160 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:38.161 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:38.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:38.162 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_50_00_UTC) 2023-08-31T19:00:38.217 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:38.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:38.218 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_51_00_UTC) 2023-08-31T19:00:38.271 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:38.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:38.272 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_52_00_UTC) 2023-08-31T19:00:38.325 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:38.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:38.326 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_53_00_UTC) 2023-08-31T19:00:38.380 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:38.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:38.381 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_54_00_UTC) 2023-08-31T19:00:38.447 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:38.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:38.449 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_55_00_UTC) 2023-08-31T19:00:38.525 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:38.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:38.526 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_56_00_UTC) 2023-08-31T19:00:38.584 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:38.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:38.585 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_57_00_UTC) 2023-08-31T19:00:38.648 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:38.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:38.649 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_58_00_UTC) 2023-08-31T19:00:38.713 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:38.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:38.714 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-31-18_59_00_UTC) 2023-08-31T19:00:38.768 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:38.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:38.769 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-31-19_00_00_UTC) 2023-08-31T19:00:38.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:38.823 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-08-31T19:00:38.873 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-08-31T19:00:39.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.066+0000 7f47b8dff700 1 Processor -- start 2023-08-31T19:00:39.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.066+0000 7f47b8dff700 1 -- start start 2023-08-31T19:00:39.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.067+0000 7f47b8dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47b4151da0 0x7f47b41553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:39.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.067+0000 7f47b8dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f47b40c5370 0x7f47b4064660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:39.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.067+0000 7f47b8dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47b4064b50 0x7f47b40bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:39.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.067+0000 7f47b8dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b40c57f0 con 0x7f47b4064b50 2023-08-31T19:00:39.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.067+0000 7f47b8dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b4154f40 con 0x7f47b40c5370 2023-08-31T19:00:39.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.067+0000 7f47b8dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b4064fe0 con 0x7f47b4151da0 2023-08-31T19:00:39.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.067+0000 7f47b2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47b4064b50 0x7f47b40bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:39.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.067+0000 7f47b2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47b4064b50 0x7f47b40bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48534/0 (socket says 172.21.15.72:48534) 2023-08-31T19:00:39.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.067+0000 7f47b2d9d700 1 -- 172.21.15.72:0/1583248486 learned_addr learned my addr 172.21.15.72:0/1583248486 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:39.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.067+0000 7f47b1d9b700 1 --2- 172.21.15.72:0/1583248486 >> v2:172.21.15.146:3300/0 conn(0x7f47b40c5370 0x7f47b4064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:39.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.067+0000 7f47b259c700 1 --2- 172.21.15.72:0/1583248486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47b4151da0 0x7f47b41553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:39.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.068+0000 7f47b2d9d700 1 -- 172.21.15.72:0/1583248486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47b4151da0 msgr2=0x7f47b41553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:39.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.068+0000 7f47b2d9d700 1 --2- 172.21.15.72:0/1583248486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47b4151da0 0x7f47b41553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:39.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.068+0000 7f47b2d9d700 1 -- 172.21.15.72:0/1583248486 >> v2:172.21.15.146:3300/0 conn(0x7f47b40c5370 msgr2=0x7f47b4064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:39.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.068+0000 7f47b2d9d700 1 --2- 172.21.15.72:0/1583248486 >> v2:172.21.15.146:3300/0 conn(0x7f47b40c5370 0x7f47b4064660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:39.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.068+0000 7f47b2d9d700 1 -- 172.21.15.72:0/1583248486 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4154960 con 0x7f47b4064b50 2023-08-31T19:00:39.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.068+0000 7f47b2d9d700 1 --2- 172.21.15.72:0/1583248486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b4064b50 0x7f47b40bfcd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f47b40616c0 tx=0x7f47ac009840).ready entity=mon.0 client_cookie=8ed1109343ec6187 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:39.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.068+0000 7f47b159a700 1 -- 172.21.15.72:0/1583248486 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac00e070 con 0x7f47b4064b50 2023-08-31T19:00:39.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.068+0000 7f47b159a700 1 -- 172.21.15.72:0/1583248486 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac00b970 con 0x7f47b4064b50 2023-08-31T19:00:39.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.068+0000 7f47b159a700 1 -- 172.21.15.72:0/1583248486 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac00bcf0 con 0x7f47b4064b50 2023-08-31T19:00:39.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.069+0000 7f47b8dff700 1 -- 172.21.15.72:0/1583248486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b4064b50 msgr2=0x7f47b40bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:39.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.069+0000 7f47b8dff700 1 --2- 172.21.15.72:0/1583248486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b4064b50 0x7f47b40bfcd0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f47b40616c0 tx=0x7f47ac009840).stop 2023-08-31T19:00:39.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.069+0000 7f47b8dff700 1 -- 172.21.15.72:0/1583248486 shutdown_connections 2023-08-31T19:00:39.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.069+0000 7f47b8dff700 1 --2- 172.21.15.72:0/1583248486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b4064b50 0x7f47b40bfcd0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:39.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.069+0000 7f47b8dff700 1 --2- 172.21.15.72:0/1583248486 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47b4151da0 0x7f47b41553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:39.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.069+0000 7f47b8dff700 1 --2- 172.21.15.72:0/1583248486 >> v2:172.21.15.146:3300/0 conn(0x7f47b40c5370 0x7f47b4064660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:39.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.069+0000 7f47b8dff700 1 -- 172.21.15.72:0/1583248486 >> 172.21.15.72:0/1583248486 conn(0x7f47b4063a90 msgr2=0x7f47b40cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:39.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.069+0000 7f47b8dff700 1 -- 172.21.15.72:0/1583248486 shutdown_connections 2023-08-31T19:00:39.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.069+0000 7f47b8dff700 1 -- 172.21.15.72:0/1583248486 wait complete. 2023-08-31T19:00:39.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.070+0000 7f47b8dff700 1 Processor -- start 2023-08-31T19:00:39.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.071+0000 7f47b8dff700 1 -- start start 2023-08-31T19:00:39.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b8dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b4064b50 0x7f47b40ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:39.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b8dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40c5370 0x7f47b40ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:39.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b8dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47b4151da0 0x7f47b4144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:39.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b8dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40c9cc0 con 0x7f47b40c5370 2023-08-31T19:00:39.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b8dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40ae950 con 0x7f47b4064b50 2023-08-31T19:00:39.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b8dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b414f210 con 0x7f47b4151da0 2023-08-31T19:00:39.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40c5370 0x7f47b40ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:39.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40c5370 0x7f47b40ac3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48550/0 (socket says 172.21.15.72:48550) 2023-08-31T19:00:39.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b1d9b700 1 -- 172.21.15.72:0/2339879497 learned_addr learned my addr 172.21.15.72:0/2339879497 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:39.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b2d9d700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47b4151da0 0x7f47b4144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:39.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b259c700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b4064b50 0x7f47b40ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:39.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b1d9b700 1 -- 172.21.15.72:0/2339879497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47b4151da0 msgr2=0x7f47b4144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:39.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b1d9b700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47b4151da0 0x7f47b4144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:39.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b1d9b700 1 -- 172.21.15.72:0/2339879497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b4064b50 msgr2=0x7f47b40ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:39.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b1d9b700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b4064b50 0x7f47b40ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:39.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b1d9b700 1 -- 172.21.15.72:0/2339879497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ac009ae0 con 0x7f47b40c5370 2023-08-31T19:00:39.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b259c700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b4064b50 0x7f47b40ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:39.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b2d9d700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47b4151da0 0x7f47b4144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:39.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.072+0000 7f47b1d9b700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40c5370 0x7f47b40ac3f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f47a800e900 tx=0x7f47a8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:39.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.073+0000 7f47a27fc700 1 -- 172.21.15.72:0/2339879497 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a800eea0 con 0x7f47b40c5370 2023-08-31T19:00:39.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.073+0000 7f47a27fc700 1 -- 172.21.15.72:0/2339879497 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a800c850 con 0x7f47b40c5370 2023-08-31T19:00:39.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.073+0000 7f47b8dff700 1 -- 172.21.15.72:0/2339879497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b40c2f10 con 0x7f47b40c5370 2023-08-31T19:00:39.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.073+0000 7f47a27fc700 1 -- 172.21.15.72:0/2339879497 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a800cbd0 con 0x7f47b40c5370 2023-08-31T19:00:39.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.073+0000 7f47b8dff700 1 -- 172.21.15.72:0/2339879497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b414ebc0 con 0x7f47b40c5370 2023-08-31T19:00:39.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.074+0000 7f47b8dff700 1 -- 172.21.15.72:0/2339879497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b406a7e0 con 0x7f47b40c5370 2023-08-31T19:00:39.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.075+0000 7f47a27fc700 1 -- 172.21.15.72:0/2339879497 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f47a801b400 con 0x7f47b40c5370 2023-08-31T19:00:39.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.075+0000 7f47a27fc700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f479405efb0 0x7f4794061470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:39.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.075+0000 7f47a27fc700 1 -- 172.21.15.72:0/2339879497 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7446+0+0 (secure 0 0 0) 0x7f47a807abc0 con 0x7f47b40c5370 2023-08-31T19:00:39.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.076+0000 7f47b259c700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f479405efb0 0x7f4794061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:39.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.076+0000 7f47b259c700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f479405efb0 0x7f4794061470 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f47a4006d80 tx=0x7f47a4008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:39.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.080+0000 7f47a27fc700 1 -- 172.21.15.72:0/2339879497 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f47a804b910 con 0x7f47b40c5370 2023-08-31T19:00:39.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.274+0000 7f47b8dff700 1 -- 172.21.15.72:0/2339879497 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f47b406c6b0 con 0x7f479405efb0 2023-08-31T19:00:39.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.278+0000 7f47a27fc700 1 -- 172.21.15.72:0/2339879497 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f47b406c6b0 con 0x7f479405efb0 2023-08-31T19:00:39.279 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-08-31T19:00:39.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.280+0000 7f47b8dff700 1 -- 172.21.15.72:0/2339879497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f479405efb0 msgr2=0x7f4794061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:39.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.280+0000 7f47b8dff700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f479405efb0 0x7f4794061470 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f47a4006d80 tx=0x7f47a4008040).stop 2023-08-31T19:00:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.280+0000 7f47b8dff700 1 -- 172.21.15.72:0/2339879497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40c5370 msgr2=0x7f47b40ac3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.280+0000 7f47b8dff700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40c5370 0x7f47b40ac3f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f47a800e900 tx=0x7f47a8009060).stop 2023-08-31T19:00:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.280+0000 7f47b8dff700 1 -- 172.21.15.72:0/2339879497 shutdown_connections 2023-08-31T19:00:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.280+0000 7f47b8dff700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47b4151da0 0x7f47b4144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.280+0000 7f47b8dff700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f479405efb0 0x7f4794061470 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.280+0000 7f47b8dff700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47b4064b50 0x7f47b40ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.280+0000 7f47b8dff700 1 --2- 172.21.15.72:0/2339879497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b40c5370 0x7f47b40ac3f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.280+0000 7f47b8dff700 1 -- 172.21.15.72:0/2339879497 >> 172.21.15.72:0/2339879497 conn(0x7f47b4063a90 msgr2=0x7f47b40cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.280+0000 7f47b8dff700 1 -- 172.21.15.72:0/2339879497 shutdown_connections 2023-08-31T19:00:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:39.280+0000 7f47b8dff700 1 -- 172.21.15.72:0/2339879497 wait complete. 2023-08-31T19:00:39.297 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-08-31T19:00:39.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:39.298 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-08-31T19:00:39.346 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:39.347 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:39.347 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:39.347 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:39.347 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:39.348 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:39.348 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:39.348 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:39.348 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:39.348 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:39.349 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:39.350 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:39.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:39.350 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_50_00_UTC) 2023-08-31T19:00:39.406 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:39.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:39.407 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_51_00_UTC) 2023-08-31T19:00:39.498 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:39.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:39.499 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_52_00_UTC) 2023-08-31T19:00:39.571 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:39.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:39.572 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_53_00_UTC) 2023-08-31T19:00:39.627 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:39.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:39.628 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_54_00_UTC) 2023-08-31T19:00:39.682 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:39.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:39.684 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_55_00_UTC) 2023-08-31T19:00:39.737 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:39.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:39.738 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_56_00_UTC) 2023-08-31T19:00:39.792 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:39.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:39.792 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_57_00_UTC) 2023-08-31T19:00:39.847 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:39.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:39.848 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_58_00_UTC) 2023-08-31T19:00:39.901 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:39.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:39.902 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-31-18_59_00_UTC) 2023-08-31T19:00:39.957 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:39.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:39.958 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-31-19_00_00_UTC) 2023-08-31T19:00:40.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:40.013 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-08-31T19:00:40.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-08-31T19:00:40.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.259+0000 7feda21ff700 1 Processor -- start 2023-08-31T19:00:40.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.260+0000 7feda21ff700 1 -- start start 2023-08-31T19:00:40.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.261+0000 7feda21ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed9c068c20 0x7fed9c069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:40.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.261+0000 7feda21ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fed9c063c20 0x7fed9c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:40.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.261+0000 7feda21ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9c0c2260 con 0x7fed9c062650 2023-08-31T19:00:40.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.261+0000 7feda21ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c062b80 con 0x7fed9c063c20 2023-08-31T19:00:40.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.261+0000 7feda21ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c062e60 con 0x7fed9c068c20 2023-08-31T19:00:40.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.261+0000 7fed9bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fed9c063c20 0x7fed9c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:40.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.261+0000 7fed9b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed9c068c20 0x7fed9c069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:40.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.261+0000 7fed9bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fed9c063c20 0x7fed9c157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:37542/0 (socket says 172.21.15.72:37542) 2023-08-31T19:00:40.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.261+0000 7fed9b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed9c068c20 0x7fed9c069000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:41056/0 (socket says 172.21.15.72:41056) 2023-08-31T19:00:40.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.261+0000 7fed9bfff700 1 -- 172.21.15.72:0/4271359357 learned_addr learned my addr 172.21.15.72:0/4271359357 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:40.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.261+0000 7fed9affd700 1 --1- 172.21.15.72:0/4271359357 >> v1:172.21.15.146:6789/0 conn(0x7fed9c062650 0x7fed9c0c1b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:42738/0 (socket says 172.21.15.72:42738) 2023-08-31T19:00:40.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.262+0000 7fed9bfff700 1 -- 172.21.15.72:0/4271359357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed9c068c20 msgr2=0x7fed9c069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:40.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.262+0000 7fed9bfff700 1 --2- 172.21.15.72:0/4271359357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed9c068c20 0x7fed9c069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:40.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.262+0000 7fed9bfff700 1 -- 172.21.15.72:0/4271359357 >> v1:172.21.15.146:6789/0 conn(0x7fed9c062650 legacy=0x7fed9c0c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:40.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.262+0000 7fed9bfff700 1 -- 172.21.15.72:0/4271359357 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c063140 con 0x7fed9c063c20 2023-08-31T19:00:40.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.262+0000 7fed9a7fc700 1 -- 172.21.15.72:0/4271359357 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1851161260 0 0) 0x7fed9c0c2260 con 0x7fed9c062650 2023-08-31T19:00:40.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.262+0000 7fed9bfff700 1 --2- 172.21.15.72:0/4271359357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed9c063c20 0x7fed9c157000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fed94009f20 tx=0x7fed94009840).ready entity=mon.1 client_cookie=e9d4cc55fc16d4d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:40.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.262+0000 7fed9a7fc700 1 -- 172.21.15.72:0/4271359357 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400e070 con 0x7fed9c063c20 2023-08-31T19:00:40.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.262+0000 7fed9a7fc700 1 -- 172.21.15.72:0/4271359357 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400b9d0 con 0x7fed9c063c20 2023-08-31T19:00:40.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.262+0000 7fed9a7fc700 1 -- 172.21.15.72:0/4271359357 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400bd50 con 0x7fed9c063c20 2023-08-31T19:00:40.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.263+0000 7feda21ff700 1 -- 172.21.15.72:0/4271359357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed9c063c20 msgr2=0x7fed9c157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.263+0000 7feda21ff700 1 --2- 172.21.15.72:0/4271359357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed9c063c20 0x7fed9c157000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fed94009f20 tx=0x7fed94009840).stop 2023-08-31T19:00:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.263+0000 7feda21ff700 1 -- 172.21.15.72:0/4271359357 shutdown_connections 2023-08-31T19:00:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.263+0000 7feda21ff700 1 --2- 172.21.15.72:0/4271359357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed9c063c20 0x7fed9c157000 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.263+0000 7feda21ff700 1 --2- 172.21.15.72:0/4271359357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed9c068c20 0x7fed9c069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.263+0000 7feda21ff700 1 -- 172.21.15.72:0/4271359357 >> 172.21.15.72:0/4271359357 conn(0x7fed9c0c72f0 msgr2=0x7fed9c0c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:40.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.263+0000 7feda21ff700 1 -- 172.21.15.72:0/4271359357 shutdown_connections 2023-08-31T19:00:40.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.263+0000 7feda21ff700 1 -- 172.21.15.72:0/4271359357 wait complete. 2023-08-31T19:00:40.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.265+0000 7feda21ff700 1 Processor -- start 2023-08-31T19:00:40.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.265+0000 7feda21ff700 1 -- start start 2023-08-31T19:00:40.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.266+0000 7feda21ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed9c062650 0x7fed9c1500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:40.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.266+0000 7feda21ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed9c063c20 0x7fed9c167590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:40.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.266+0000 7feda21ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed9c068c20 0x7fed9c14ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:40.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.266+0000 7feda21ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c14e840 con 0x7fed9c062650 2023-08-31T19:00:40.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.266+0000 7feda21ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c14d950 con 0x7fed9c068c20 2023-08-31T19:00:40.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.266+0000 7feda21ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c14dc30 con 0x7fed9c063c20 2023-08-31T19:00:40.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.267+0000 7fed9b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed9c062650 0x7fed9c1500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:40.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.267+0000 7fed9b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed9c062650 0x7fed9c1500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48552/0 (socket says 172.21.15.72:48552) 2023-08-31T19:00:40.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.267+0000 7fed9b7fe700 1 -- 172.21.15.72:0/1862980081 learned_addr learned my addr 172.21.15.72:0/1862980081 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:40.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.267+0000 7fed9bfff700 1 --2- 172.21.15.72:0/1862980081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed9c068c20 0x7fed9c14ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:40.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.267+0000 7fed9affd700 1 --2- 172.21.15.72:0/1862980081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed9c063c20 0x7fed9c167590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:40.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.267+0000 7fed9b7fe700 1 -- 172.21.15.72:0/1862980081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed9c063c20 msgr2=0x7fed9c167590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:40.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.267+0000 7fed9b7fe700 1 --2- 172.21.15.72:0/1862980081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed9c063c20 0x7fed9c167590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:40.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.267+0000 7fed9b7fe700 1 -- 172.21.15.72:0/1862980081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed9c068c20 msgr2=0x7fed9c14ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:40.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.267+0000 7fed9b7fe700 1 --2- 172.21.15.72:0/1862980081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed9c068c20 0x7fed9c14ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:40.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.267+0000 7fed9b7fe700 1 -- 172.21.15.72:0/1862980081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed94009ae0 con 0x7fed9c062650 2023-08-31T19:00:40.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.267+0000 7fed9bfff700 1 --2- 172.21.15.72:0/1862980081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed9c068c20 0x7fed9c14ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:00:40.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.267+0000 7fed9b7fe700 1 --2- 172.21.15.72:0/1862980081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed9c062650 0x7fed9c1500d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fed8c00e900 tx=0x7fed8c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:40.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.267+0000 7fed837fe700 1 -- 172.21.15.72:0/1862980081 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c012600 con 0x7fed9c062650 2023-08-31T19:00:40.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.268+0000 7fed837fe700 1 -- 172.21.15.72:0/1862980081 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c012760 con 0x7fed9c062650 2023-08-31T19:00:40.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.268+0000 7feda21ff700 1 -- 172.21.15.72:0/1862980081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c14df10 con 0x7fed9c062650 2023-08-31T19:00:40.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.268+0000 7fed837fe700 1 -- 172.21.15.72:0/1862980081 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c012ae0 con 0x7fed9c062650 2023-08-31T19:00:40.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.268+0000 7feda21ff700 1 -- 172.21.15.72:0/1862980081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c14e4d0 con 0x7fed9c062650 2023-08-31T19:00:40.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.269+0000 7feda21ff700 1 -- 172.21.15.72:0/1862980081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c14eb20 con 0x7fed9c062650 2023-08-31T19:00:40.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.270+0000 7fed837fe700 1 -- 172.21.15.72:0/1862980081 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fed8c01b400 con 0x7fed9c062650 2023-08-31T19:00:40.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.270+0000 7fed837fe700 1 --2- 172.21.15.72:0/1862980081 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fed8805ef80 0x7fed88061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:40.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.270+0000 7fed837fe700 1 -- 172.21.15.72:0/1862980081 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6906+0+0 (secure 0 0 0) 0x7fed8c07a660 con 0x7fed9c062650 2023-08-31T19:00:40.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.271+0000 7fed9affd700 1 --2- 172.21.15.72:0/1862980081 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fed8805ef80 0x7fed88061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:40.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.271+0000 7fed9affd700 1 --2- 172.21.15.72:0/1862980081 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fed8805ef80 0x7fed88061440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fed9c158570 tx=0x7fed90007bd0).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:40.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.274+0000 7fed837fe700 1 -- 172.21.15.72:0/1862980081 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fed8c04b5e0 con 0x7fed9c062650 2023-08-31T19:00:40.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.479+0000 7feda21ff700 1 -- 172.21.15.72:0/1862980081 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fed9c14e980 con 0x7fed8805ef80 2023-08-31T19:00:40.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.483+0000 7fed837fe700 1 -- 172.21.15.72:0/1862980081 <== mgr.5223 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fed90001370 con 0x7fed8805ef80 2023-08-31T19:00:40.483 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-08-31T19:00:40.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.486+0000 7feda21ff700 1 -- 172.21.15.72:0/1862980081 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fed8805ef80 msgr2=0x7fed88061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:40.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.486+0000 7feda21ff700 1 --2- 172.21.15.72:0/1862980081 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fed8805ef80 0x7fed88061440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fed9c158570 tx=0x7fed90007bd0).stop 2023-08-31T19:00:40.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.487+0000 7feda21ff700 1 -- 172.21.15.72:0/1862980081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed9c062650 msgr2=0x7fed9c1500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:40.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.487+0000 7feda21ff700 1 --2- 172.21.15.72:0/1862980081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed9c062650 0x7fed9c1500d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fed8c00e900 tx=0x7fed8c009060).stop 2023-08-31T19:00:40.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.487+0000 7feda21ff700 1 -- 172.21.15.72:0/1862980081 shutdown_connections 2023-08-31T19:00:40.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.487+0000 7feda21ff700 1 --2- 172.21.15.72:0/1862980081 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fed8805ef80 0x7fed88061440 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:40.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.487+0000 7feda21ff700 1 --2- 172.21.15.72:0/1862980081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed9c068c20 0x7fed9c14ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:40.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.487+0000 7feda21ff700 1 --2- 172.21.15.72:0/1862980081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed9c062650 0x7fed9c1500d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:40.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.487+0000 7feda21ff700 1 --2- 172.21.15.72:0/1862980081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fed9c063c20 0x7fed9c167590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:40.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.487+0000 7feda21ff700 1 -- 172.21.15.72:0/1862980081 >> 172.21.15.72:0/1862980081 conn(0x7fed9c0c72f0 msgr2=0x7fed9c155890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:40.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.487+0000 7feda21ff700 1 -- 172.21.15.72:0/1862980081 shutdown_connections 2023-08-31T19:00:40.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:40.487+0000 7feda21ff700 1 -- 172.21.15.72:0/1862980081 wait complete. 2023-08-31T19:00:40.507 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-08-31T19:00:40.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:40.508 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-08-31T19:00:40.563 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:40.564 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:40.564 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:40.564 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:40.564 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:40.564 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:40.565 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:40.565 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:40.565 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:40.565 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:40.565 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:40.566 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_50_00_UTC 2023-08-31T19:00:40.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:40.567 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_50_00_UTC) 2023-08-31T19:00:40.628 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_51_00_UTC 2023-08-31T19:00:40.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:40.629 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_51_00_UTC) 2023-08-31T19:00:40.682 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_52_00_UTC 2023-08-31T19:00:40.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:40.683 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_52_00_UTC) 2023-08-31T19:00:40.735 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_53_00_UTC 2023-08-31T19:00:40.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:40.736 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_53_00_UTC) 2023-08-31T19:00:40.789 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_54_00_UTC 2023-08-31T19:00:40.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:40.790 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_54_00_UTC) 2023-08-31T19:00:40.842 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_55_00_UTC 2023-08-31T19:00:40.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:40.843 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_55_00_UTC) 2023-08-31T19:00:40.896 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_56_00_UTC 2023-08-31T19:00:40.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:40.897 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_56_00_UTC) 2023-08-31T19:00:40.951 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_57_00_UTC 2023-08-31T19:00:40.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:40.952 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_57_00_UTC) 2023-08-31T19:00:41.013 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_58_00_UTC 2023-08-31T19:00:41.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:41.014 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_58_00_UTC) 2023-08-31T19:00:41.067 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_59_00_UTC 2023-08-31T19:00:41.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:41.068 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-31-18_59_00_UTC) 2023-08-31T19:00:41.121 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-31-19_00_00_UTC 2023-08-31T19:00:41.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:41.122 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-31-19_00_00_UTC) 2023-08-31T19:00:41.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:41.176 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-08-31T19:00:41.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-31T19:00:41.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.416+0000 7fab1b9ff700 1 Processor -- start 2023-08-31T19:00:41.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.416+0000 7fab1b9ff700 1 -- start start 2023-08-31T19:00:41.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.417+0000 7fab1b9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab141524c0 0x7fab14068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:41.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.418+0000 7fab1b9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab14068980 0x7fab14064840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:41.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.418+0000 7fab1b9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab140a9660 con 0x7fab141520e0 2023-08-31T19:00:41.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.418+0000 7fab1b9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab14068dc0 con 0x7fab141524c0 2023-08-31T19:00:41.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.418+0000 7fab1b9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab14064340 con 0x7fab14068980 2023-08-31T19:00:41.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.418+0000 7fab18f9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab141524c0 0x7fab14068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:41.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.418+0000 7fab18f9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab141524c0 0x7fab14068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48560/0 (socket says 172.21.15.72:48560) 2023-08-31T19:00:41.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.418+0000 7fab18f9a700 1 -- 172.21.15.72:0/2474887128 learned_addr learned my addr 172.21.15.72:0/2474887128 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:41.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.418+0000 7fab18f9a700 1 -- 172.21.15.72:0/2474887128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab14068980 msgr2=0x7fab14064840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:41.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.418+0000 7fab18f9a700 1 --2- 172.21.15.72:0/2474887128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab14068980 0x7fab14064840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:41.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.418+0000 7fab18f9a700 1 -- 172.21.15.72:0/2474887128 >> v1:172.21.15.146:6789/0 conn(0x7fab141520e0 legacy=0x7fab140a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:41.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.418+0000 7fab18f9a700 1 -- 172.21.15.72:0/2474887128 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab140bcd00 con 0x7fab141524c0 2023-08-31T19:00:41.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.418+0000 7fab18f9a700 1 --2- 172.21.15.72:0/2474887128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab141524c0 0x7fab14068490 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fab04006fd0 tx=0x7fab040090f0).ready entity=mon.0 client_cookie=2ab6148b852601ef server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:41.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.419+0000 7fab0bfff700 1 -- 172.21.15.72:0/2474887128 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0400b600 con 0x7fab141524c0 2023-08-31T19:00:41.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.419+0000 7fab0bfff700 1 -- 172.21.15.72:0/2474887128 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0400b760 con 0x7fab141524c0 2023-08-31T19:00:41.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.419+0000 7fab0bfff700 1 -- 172.21.15.72:0/2474887128 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0400bae0 con 0x7fab141524c0 2023-08-31T19:00:41.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.419+0000 7fab1b9ff700 1 -- 172.21.15.72:0/2474887128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab141524c0 msgr2=0x7fab14068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:41.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.419+0000 7fab1b9ff700 1 --2- 172.21.15.72:0/2474887128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab141524c0 0x7fab14068490 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fab04006fd0 tx=0x7fab040090f0).stop 2023-08-31T19:00:41.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.419+0000 7fab1b9ff700 1 -- 172.21.15.72:0/2474887128 shutdown_connections 2023-08-31T19:00:41.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.419+0000 7fab1b9ff700 1 --2- 172.21.15.72:0/2474887128 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab14068980 0x7fab14064840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:41.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.419+0000 7fab1b9ff700 1 --2- 172.21.15.72:0/2474887128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab141524c0 0x7fab14068490 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:41.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.419+0000 7fab1b9ff700 1 -- 172.21.15.72:0/2474887128 >> 172.21.15.72:0/2474887128 conn(0x7fab140630c0 msgr2=0x7fab140c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:41.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.419+0000 7fab1b9ff700 1 -- 172.21.15.72:0/2474887128 shutdown_connections 2023-08-31T19:00:41.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.419+0000 7fab1b9ff700 1 -- 172.21.15.72:0/2474887128 wait complete. 2023-08-31T19:00:41.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.421+0000 7fab1b9ff700 1 Processor -- start 2023-08-31T19:00:41.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.421+0000 7fab1b9ff700 1 -- start start 2023-08-31T19:00:41.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab1b9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab14068980 0x7fab141504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:41.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab1b9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab141520e0 0x7fab140c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:41.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab1b9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab141524c0 0x7fab14167cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:41.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab1b9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1414b400 con 0x7fab141520e0 2023-08-31T19:00:41.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab1b9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab14164ae0 con 0x7fab14068980 2023-08-31T19:00:41.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab1b9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab140c11a0 con 0x7fab141524c0 2023-08-31T19:00:41.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab18f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab141520e0 0x7fab140c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:41.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab18f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab141520e0 0x7fab140c1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48562/0 (socket says 172.21.15.72:48562) 2023-08-31T19:00:41.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab18f9a700 1 -- 172.21.15.72:0/3086195784 learned_addr learned my addr 172.21.15.72:0/3086195784 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:41.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab1979b700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab14068980 0x7fab141504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:41.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab19f9c700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab141524c0 0x7fab14167cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:41.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab18f9a700 1 -- 172.21.15.72:0/3086195784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab141524c0 msgr2=0x7fab14167cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:41.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab18f9a700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab141524c0 0x7fab14167cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:41.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab18f9a700 1 -- 172.21.15.72:0/3086195784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab14068980 msgr2=0x7fab141504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:41.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab18f9a700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab14068980 0x7fab141504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:41.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab18f9a700 1 -- 172.21.15.72:0/3086195784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab04009370 con 0x7fab141520e0 2023-08-31T19:00:41.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab19f9c700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab141524c0 0x7fab14167cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:41.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.422+0000 7fab1979b700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab14068980 0x7fab141504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:41.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.423+0000 7fab18f9a700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab141520e0 0x7fab140c1c40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fab14067cb0 tx=0x7fab04017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:41.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.423+0000 7fab097fa700 1 -- 172.21.15.72:0/3086195784 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0400b8d0 con 0x7fab141520e0 2023-08-31T19:00:41.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.423+0000 7fab097fa700 1 -- 172.21.15.72:0/3086195784 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0400ba30 con 0x7fab141520e0 2023-08-31T19:00:41.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.423+0000 7fab1b9ff700 1 -- 172.21.15.72:0/3086195784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab141509b0 con 0x7fab141520e0 2023-08-31T19:00:41.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.423+0000 7fab097fa700 1 -- 172.21.15.72:0/3086195784 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0401b660 con 0x7fab141520e0 2023-08-31T19:00:41.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.423+0000 7fab1b9ff700 1 -- 172.21.15.72:0/3086195784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab140c1440 con 0x7fab141520e0 2023-08-31T19:00:41.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.424+0000 7fab1b9ff700 1 -- 172.21.15.72:0/3086195784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1406c6b0 con 0x7fab141520e0 2023-08-31T19:00:41.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.425+0000 7fab097fa700 1 -- 172.21.15.72:0/3086195784 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fab0401b9d0 con 0x7fab141520e0 2023-08-31T19:00:41.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.426+0000 7fab097fa700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faaf805ef80 0x7faaf8061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:41.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.426+0000 7fab097fa700 1 -- 172.21.15.72:0/3086195784 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6810+0+0 (secure 0 0 0) 0x7fab0407bd20 con 0x7fab141520e0 2023-08-31T19:00:41.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.426+0000 7fab1979b700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faaf805ef80 0x7faaf8061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:41.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.426+0000 7fab1979b700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faaf805ef80 0x7faaf8061440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fab14151a60 tx=0x7fab10008040).ready entity=mgr.5223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:41.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.429+0000 7fab097fa700 1 -- 172.21.15.72:0/3086195784 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fab0404cd20 con 0x7fab141520e0 2023-08-31T19:00:41.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:41.708+0000 7fab1b9ff700 1 -- 172.21.15.72:0/3086195784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fab140c7710 con 0x7fab141520e0 2023-08-31T19:00:42.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:42.547+0000 7fab097fa700 1 -- 172.21.15.72:0/3086195784 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 11) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fab040aa8f0 con 0x7fab141520e0 2023-08-31T19:00:42.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:42.548+0000 7fab097fa700 1 -- 172.21.15.72:0/3086195784 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v11) v1 ==== 93+0+0 (secure 0 0 0) 0x7fab04041aa0 con 0x7fab141520e0 2023-08-31T19:00:42.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:42.551+0000 7fab1b9ff700 1 -- 172.21.15.72:0/3086195784 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faaf805ef80 msgr2=0x7faaf8061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:42.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:42.551+0000 7fab1b9ff700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faaf805ef80 0x7faaf8061440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fab14151a60 tx=0x7fab10008040).stop 2023-08-31T19:00:42.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:42.552+0000 7fab1b9ff700 1 -- 172.21.15.72:0/3086195784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab141520e0 msgr2=0x7fab140c1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:42.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:42.552+0000 7fab1b9ff700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab141520e0 0x7fab140c1c40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fab14067cb0 tx=0x7fab04017000).stop 2023-08-31T19:00:42.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:42.552+0000 7fab1b9ff700 1 -- 172.21.15.72:0/3086195784 shutdown_connections 2023-08-31T19:00:42.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:42.552+0000 7fab1b9ff700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab141524c0 0x7fab14167cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:42.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:42.552+0000 7fab1b9ff700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faaf805ef80 0x7faaf8061440 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:42.552+0000 7fab1b9ff700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab14068980 0x7fab141504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:42.552+0000 7fab1b9ff700 1 --2- 172.21.15.72:0/3086195784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab141520e0 0x7fab140c1c40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:42.552+0000 7fab1b9ff700 1 -- 172.21.15.72:0/3086195784 >> 172.21.15.72:0/3086195784 conn(0x7fab140630c0 msgr2=0x7fab1414bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:42.552+0000 7fab1b9ff700 1 -- 172.21.15.72:0/3086195784 shutdown_connections 2023-08-31T19:00:42.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:42.552+0000 7fab1b9ff700 1 -- 172.21.15.72:0/3086195784 wait complete. 2023-08-31T19:00:42.573 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:00:42.573 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:00:42.711 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:00:42.783 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:42.783+0000 7f84b7b76680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:00:42.801 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:42.801+0000 7fcfe17f4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:00:42.819 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:00:42.820 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-31T19:00:42.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:00:42.820 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-31T19:00:42.864 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:42.864+0000 7f84b7b76680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:00:42.883 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:42.883+0000 7fcfe17f4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:00:42.927 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T19:00:42.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:00:42.928 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T19:00:42.975 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:00:43.220 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:43.220+0000 7f84b7b76680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:00:43.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.229+0000 7f7fadbff700 1 Processor -- start 2023-08-31T19:00:43.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.229+0000 7f7fadbff700 1 -- start start 2023-08-31T19:00:43.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.231+0000 7f7fadbff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7fa80bea80 0x7f7fa80c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:43.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.231+0000 7f7fadbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa80c44a0 0x7f7fa8063a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:43.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.231+0000 7f7fadbff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa80c4930 con 0x7f7fa80c5fb0 2023-08-31T19:00:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.231+0000 7f7fadbff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa8154690 con 0x7f7fa80bea80 2023-08-31T19:00:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.231+0000 7f7fadbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80bfb20 con 0x7f7fa80c44a0 2023-08-31T19:00:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.231+0000 7f7fa77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7fa80c5fb0 0x7f7fa80be370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:57318/0 (socket says 172.21.15.72:57318) 2023-08-31T19:00:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.231+0000 7f7fa77fe700 1 -- 172.21.15.72:0/531907479 learned_addr learned my addr 172.21.15.72:0/531907479 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:43.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.231+0000 7f7fa7fff700 1 --2- 172.21.15.72:0/531907479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa80c44a0 0x7f7fa8063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:43.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.231+0000 7f7fa6ffd700 1 --2- 172.21.15.72:0/531907479 >> v2:172.21.15.146:3300/0 conn(0x7f7fa80bea80 0x7f7fa80c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:43.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.232+0000 7f7fa67fc700 1 -- 172.21.15.72:0/531907479 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988246040 0 0) 0x7f7fa80c4930 con 0x7f7fa80c5fb0 2023-08-31T19:00:43.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.232+0000 7f7fa67fc700 1 -- 172.21.15.72:0/531907479 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f900033f0 con 0x7f7fa80c5fb0 2023-08-31T19:00:43.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.232+0000 7f7fa6ffd700 1 -- 172.21.15.72:0/531907479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa80c44a0 msgr2=0x7f7fa8063a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:43.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.232+0000 7f7fa6ffd700 1 --2- 172.21.15.72:0/531907479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa80c44a0 0x7f7fa8063a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:43.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.232+0000 7f7fa6ffd700 1 -- 172.21.15.72:0/531907479 >> v1:172.21.15.146:6789/0 conn(0x7f7fa80c5fb0 legacy=0x7f7fa80be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:43.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.232+0000 7f7fa6ffd700 1 -- 172.21.15.72:0/531907479 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa80bef10 con 0x7f7fa80bea80 2023-08-31T19:00:43.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.232+0000 7f7fa7fff700 1 --2- 172.21.15.72:0/531907479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa80c44a0 0x7f7fa8063a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:00:43.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.232+0000 7f7fa6ffd700 1 --2- 172.21.15.72:0/531907479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fa80bea80 0x7f7fa80c3fb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f7f9c009760 tx=0x7f7f9c009060).ready entity=mon.1 client_cookie=fd44e0ab74e48a00 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:43.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.232+0000 7f7fa67fc700 1 -- 172.21.15.72:0/531907479 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c00d4a0 con 0x7f7fa80bea80 2023-08-31T19:00:43.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.232+0000 7f7fa67fc700 1 -- 172.21.15.72:0/531907479 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c00d600 con 0x7f7fa80bea80 2023-08-31T19:00:43.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.232+0000 7f7fa67fc700 1 -- 172.21.15.72:0/531907479 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c00d980 con 0x7f7fa80bea80 2023-08-31T19:00:43.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.233+0000 7f7fadbff700 1 -- 172.21.15.72:0/531907479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fa80bea80 msgr2=0x7f7fa80c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:43.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.233+0000 7f7fadbff700 1 --2- 172.21.15.72:0/531907479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fa80bea80 0x7f7fa80c3fb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f7f9c009760 tx=0x7f7f9c009060).stop 2023-08-31T19:00:43.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.233+0000 7f7fadbff700 1 -- 172.21.15.72:0/531907479 shutdown_connections 2023-08-31T19:00:43.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.233+0000 7f7fadbff700 1 --2- 172.21.15.72:0/531907479 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa80c44a0 0x7f7fa8063a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:43.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.233+0000 7f7fadbff700 1 --2- 172.21.15.72:0/531907479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fa80bea80 0x7f7fa80c3fb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:43.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.233+0000 7f7fadbff700 1 -- 172.21.15.72:0/531907479 >> 172.21.15.72:0/531907479 conn(0x7f7fa8082f60 msgr2=0x7f7fa805e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:43.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.233+0000 7f7fadbff700 1 -- 172.21.15.72:0/531907479 shutdown_connections 2023-08-31T19:00:43.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.233+0000 7f7fadbff700 1 -- 172.21.15.72:0/531907479 wait complete. 2023-08-31T19:00:43.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.234+0000 7f7fadbff700 1 Processor -- start 2023-08-31T19:00:43.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.235+0000 7f7fadbff700 1 -- start start 2023-08-31T19:00:43.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.235+0000 7f7fadbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa80c44a0 0x7f7fa80c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:43.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.236+0000 7f7fadbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa80c5fb0 0x7f7fa80ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:43.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.236+0000 7f7fadbff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fa81518b0 0x7f7fa8153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:43.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.236+0000 7f7fadbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80c2320 con 0x7f7fa80c44a0 2023-08-31T19:00:43.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.236+0000 7f7fadbff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80abf00 con 0x7f7fa81518b0 2023-08-31T19:00:43.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.236+0000 7f7fadbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80aea30 con 0x7f7fa80c5fb0 2023-08-31T19:00:43.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.236+0000 7f7fa77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa80c44a0 0x7f7fa80c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:43.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.236+0000 7f7fa77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa80c44a0 0x7f7fa80c1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55166/0 (socket says 172.21.15.72:55166) 2023-08-31T19:00:43.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.236+0000 7f7fa77fe700 1 -- 172.21.15.72:0/3155229790 learned_addr learned my addr 172.21.15.72:0/3155229790 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:43.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.236+0000 7f7fa6ffd700 1 --2- 172.21.15.72:0/3155229790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa80c5fb0 0x7f7fa80ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:43.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.236+0000 7f7fa7fff700 1 --2- 172.21.15.72:0/3155229790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fa81518b0 0x7f7fa8153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:43.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.236+0000 7f7fa77fe700 1 -- 172.21.15.72:0/3155229790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa80c5fb0 msgr2=0x7f7fa80ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:43.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.236+0000 7f7fa77fe700 1 --2- 172.21.15.72:0/3155229790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa80c5fb0 0x7f7fa80ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:43.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.236+0000 7f7fa77fe700 1 -- 172.21.15.72:0/3155229790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fa81518b0 msgr2=0x7f7fa8153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:43.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.236+0000 7f7fa77fe700 1 --2- 172.21.15.72:0/3155229790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fa81518b0 0x7f7fa8153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:43.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.236+0000 7f7fa77fe700 1 -- 172.21.15.72:0/3155229790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa0009a20 con 0x7f7fa80c44a0 2023-08-31T19:00:43.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.237+0000 7f7fa77fe700 1 --2- 172.21.15.72:0/3155229790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa80c44a0 0x7f7fa80c1e30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f7f9800c3f0 tx=0x7f7f98007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:43.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.237+0000 7f7f8f7fe700 1 -- 172.21.15.72:0/3155229790 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9800ce50 con 0x7f7fa80c44a0 2023-08-31T19:00:43.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.237+0000 7f7f8f7fe700 1 -- 172.21.15.72:0/3155229790 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f980072e0 con 0x7f7fa80c44a0 2023-08-31T19:00:43.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.237+0000 7f7fadbff700 1 -- 172.21.15.72:0/3155229790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9c0092a0 con 0x7f7fa80c44a0 2023-08-31T19:00:43.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.237+0000 7f7f8f7fe700 1 -- 172.21.15.72:0/3155229790 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98007660 con 0x7f7fa80c44a0 2023-08-31T19:00:43.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.237+0000 7f7fadbff700 1 -- 172.21.15.72:0/3155229790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa80c27e0 con 0x7f7fa80c44a0 2023-08-31T19:00:43.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.238+0000 7f7fadbff700 1 -- 172.21.15.72:0/3155229790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa806c6b0 con 0x7f7fa80c44a0 2023-08-31T19:00:43.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.239+0000 7f7f8f7fe700 1 -- 172.21.15.72:0/3155229790 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 11) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f7f98005a00 con 0x7f7fa80c44a0 2023-08-31T19:00:43.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.240+0000 7f7f8f7fe700 1 --2- 172.21.15.72:0/3155229790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f9405ef30 0x7f7f940613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:43.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.240+0000 7f7f8f7fe700 1 -- 172.21.15.72:0/3155229790 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f7f98079bf0 con 0x7f7fa80c44a0 2023-08-31T19:00:43.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.240+0000 7f7fa6ffd700 1 -- 172.21.15.72:0/3155229790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f9405ef30 msgr2=0x7f7f940613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:00:43.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.240+0000 7f7fa6ffd700 1 --2- 172.21.15.72:0/3155229790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f9405ef30 0x7f7f940613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:00:43.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.248+0000 7f7f8f7fe700 1 -- 172.21.15.72:0/3155229790 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f9804aa60 con 0x7f7fa80c44a0 2023-08-31T19:00:43.258 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:43.258+0000 7fcfe17f4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:00:43.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.441+0000 7f7fa6ffd700 1 -- 172.21.15.72:0/3155229790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f9405ef30 msgr2=0x7f7f940613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:00:43.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.441+0000 7f7fa6ffd700 1 --2- 172.21.15.72:0/3155229790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f9405ef30 0x7f7f940613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:00:43.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.467+0000 7f7fadbff700 1 -- 172.21.15.72:0/3155229790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fa80bf1f0 con 0x7f7fa80c44a0 2023-08-31T19:00:43.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.468+0000 7f7f8f7fe700 1 -- 172.21.15.72:0/3155229790 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f7f9804e080 con 0x7f7fa80c44a0 2023-08-31T19:00:43.468 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:43.469 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/682775915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":682775915},{"type":"v1","addr":"172.21.15.146:6835","nonce":682775915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/934559211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":934559211},{"type":"v1","addr":"172.21.15.72:6836","nonce":934559211}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2587704834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2587704834},{"type":"v1","addr":"172.21.15.72:6837","nonce":2587704834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T18:48:51.892123+0000","modified":"2023-08-31T18:48:54.904501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/1295593403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1295593403},{"type":"v1","addr":"172.21.15.146:6834","nonce":1295593403}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-31T19:00:43.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.470+0000 7f7fadbff700 1 -- 172.21.15.72:0/3155229790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f9405ef30 msgr2=0x7f7f940613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:00:43.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.470+0000 7f7fadbff700 1 --2- 172.21.15.72:0/3155229790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f9405ef30 0x7f7f940613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:43.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.470+0000 7f7fadbff700 1 -- 172.21.15.72:0/3155229790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa80c44a0 msgr2=0x7f7fa80c1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:43.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.470+0000 7f7fadbff700 1 --2- 172.21.15.72:0/3155229790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa80c44a0 0x7f7fa80c1e30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f7f9800c3f0 tx=0x7f7f98007c80).stop 2023-08-31T19:00:43.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.470+0000 7f7fadbff700 1 -- 172.21.15.72:0/3155229790 shutdown_connections 2023-08-31T19:00:43.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.470+0000 7f7fadbff700 1 --2- 172.21.15.72:0/3155229790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f9405ef30 0x7f7f940613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:43.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.470+0000 7f7fadbff700 1 --2- 172.21.15.72:0/3155229790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fa81518b0 0x7f7fa8153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:43.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.470+0000 7f7fadbff700 1 --2- 172.21.15.72:0/3155229790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa80c44a0 0x7f7fa80c1e30 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:43.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.470+0000 7f7fadbff700 1 --2- 172.21.15.72:0/3155229790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fa80c5fb0 0x7f7fa80ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:43.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.470+0000 7f7fadbff700 1 -- 172.21.15.72:0/3155229790 >> 172.21.15.72:0/3155229790 conn(0x7f7fa8082f60 msgr2=0x7f7fa8067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:43.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.471+0000 7f7fadbff700 1 -- 172.21.15.72:0/3155229790 shutdown_connections 2023-08-31T19:00:43.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.471+0000 7f7fadbff700 1 -- 172.21.15.72:0/3155229790 wait complete. 2023-08-31T19:00:43.473 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2023-08-31T19:00:43.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:00:43.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.684+0000 7f7cf07ff700 1 Processor -- start 2023-08-31T19:00:43.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.684+0000 7f7cf07ff700 1 -- start start 2023-08-31T19:00:43.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.685+0000 7f7cf07ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ce80a9eb0 0x7f7ce80aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:43.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.685+0000 7f7cf07ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce80bfd00 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.685+0000 7f7cf07ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce80c05a0 con 0x7f7ce81576d0 2023-08-31T19:00:43.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.685+0000 7f7cf07ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80aaea0 con 0x7f7ce80a9eb0 2023-08-31T19:00:43.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.685+0000 7f7cedd9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7ce80c5bf0 0x7f7ce8156fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51316/0 (socket says 172.21.15.72:51316) 2023-08-31T19:00:43.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.686+0000 7f7cedd9a700 1 -- 172.21.15.72:0/2137674882 learned_addr learned my addr 172.21.15.72:0/2137674882 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:43.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.686+0000 7f7cee59b700 1 --2- 172.21.15.72:0/2137674882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ce80a9eb0 0x7f7ce80aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:43.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.686+0000 7f7ced599700 1 -- 172.21.15.72:0/2137674882 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679247876 0 0) 0x7f7ce80bfd00 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.686+0000 7f7ced599700 1 -- 172.21.15.72:0/2137674882 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cd40033f0 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.686+0000 7f7ced599700 1 -- 172.21.15.72:0/2137674882 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075507369 0 0) 0x7f7ce80c05a0 con 0x7f7ce81576d0 2023-08-31T19:00:43.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.686+0000 7f7ced599700 1 -- 172.21.15.72:0/2137674882 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce80bfd00 con 0x7f7ce81576d0 2023-08-31T19:00:43.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.686+0000 7f7cee59b700 1 -- 172.21.15.72:0/2137674882 >> v1:172.21.15.146:6789/0 conn(0x7f7ce81576d0 legacy=0x7f7ce80c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:43.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.686+0000 7f7cee59b700 1 -- 172.21.15.72:0/2137674882 >> v1:172.21.15.72:6789/0 conn(0x7f7ce80c5bf0 legacy=0x7f7ce8156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:43.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.686+0000 7f7cee59b700 1 -- 172.21.15.72:0/2137674882 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce80c6670 con 0x7f7ce80a9eb0 2023-08-31T19:00:43.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.686+0000 7f7cee59b700 1 --2- 172.21.15.72:0/2137674882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ce80a9eb0 0x7f7ce80aa290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7ce40097c0 tx=0x7f7ce4009060).ready entity=mon.2 client_cookie=1b8220078a017689 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:43.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.687+0000 7f7ced599700 1 -- 172.21.15.72:0/2137674882 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400d4a0 con 0x7f7ce80a9eb0 2023-08-31T19:00:43.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.687+0000 7f7ced599700 1 -- 172.21.15.72:0/2137674882 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce400d600 con 0x7f7ce80a9eb0 2023-08-31T19:00:43.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.687+0000 7f7ced599700 1 -- 172.21.15.72:0/2137674882 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400d980 con 0x7f7ce80a9eb0 2023-08-31T19:00:43.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.687+0000 7f7cf07ff700 1 -- 172.21.15.72:0/2137674882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ce80a9eb0 msgr2=0x7f7ce80aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:43.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.687+0000 7f7cf07ff700 1 --2- 172.21.15.72:0/2137674882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ce80a9eb0 0x7f7ce80aa290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7ce40097c0 tx=0x7f7ce4009060).stop 2023-08-31T19:00:43.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.687+0000 7f7cf07ff700 1 -- 172.21.15.72:0/2137674882 shutdown_connections 2023-08-31T19:00:43.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.687+0000 7f7cf07ff700 1 --2- 172.21.15.72:0/2137674882 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ce80a9eb0 0x7f7ce80aa290 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:43.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.687+0000 7f7cf07ff700 1 -- 172.21.15.72:0/2137674882 >> 172.21.15.72:0/2137674882 conn(0x7f7ce80c82e0 msgr2=0x7f7ce805e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:43.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.687+0000 7f7cf07ff700 1 -- 172.21.15.72:0/2137674882 shutdown_connections 2023-08-31T19:00:43.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.687+0000 7f7cf07ff700 1 -- 172.21.15.72:0/2137674882 wait complete. 2023-08-31T19:00:43.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.689+0000 7f7cf07ff700 1 Processor -- start 2023-08-31T19:00:43.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.689+0000 7f7cf07ff700 1 -- start start 2023-08-31T19:00:43.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7cf07ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ce80a9eb0 0x7f7ce814bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:43.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7cf07ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ce80c5bf0 0x7f7ce81688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:43.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7cf07ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ce81576d0 0x7f7ce80add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:43.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7cf07ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80af0b0 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7cf07ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80ae240 con 0x7f7ce80a9eb0 2023-08-31T19:00:43.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7cf07ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80ae4a0 con 0x7f7ce81576d0 2023-08-31T19:00:43.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7cedd9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ce80c5bf0 0x7f7ce81688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:43.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7cedd9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ce80c5bf0 0x7f7ce81688b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55182/0 (socket says 172.21.15.72:55182) 2023-08-31T19:00:43.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7cedd9a700 1 -- 172.21.15.72:0/3543736913 learned_addr learned my addr 172.21.15.72:0/3543736913 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:43.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7cee59b700 1 --2- 172.21.15.72:0/3543736913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ce80a9eb0 0x7f7ce814bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:43.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7ceed9c700 1 --2- 172.21.15.72:0/3543736913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ce81576d0 0x7f7ce80add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:43.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7cedd9a700 1 -- 172.21.15.72:0/3543736913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ce81576d0 msgr2=0x7f7ce80add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:43.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7cedd9a700 1 --2- 172.21.15.72:0/3543736913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ce81576d0 0x7f7ce80add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:43.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7cedd9a700 1 -- 172.21.15.72:0/3543736913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ce80a9eb0 msgr2=0x7f7ce814bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:43.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7cedd9a700 1 --2- 172.21.15.72:0/3543736913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ce80a9eb0 0x7f7ce814bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:43.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.690+0000 7f7cedd9a700 1 -- 172.21.15.72:0/3543736913 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce40092a0 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.691+0000 7f7cedd9a700 1 --2- 172.21.15.72:0/3543736913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ce80c5bf0 0x7f7ce81688b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f7cd800c560 tx=0x7f7cd8007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:43.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.691+0000 7f7cde7fc700 1 -- 172.21.15.72:0/3543736913 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd800ce50 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.691+0000 7f7cde7fc700 1 -- 172.21.15.72:0/3543736913 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd80072e0 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.691+0000 7f7cde7fc700 1 -- 172.21.15.72:0/3543736913 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8007660 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.691+0000 7f7cf07ff700 1 -- 172.21.15.72:0/3543736913 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce80ae780 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.691+0000 7f7cf07ff700 1 -- 172.21.15.72:0/3543736913 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce80aed40 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.692+0000 7f7cf07ff700 1 -- 172.21.15.72:0/3543736913 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce806c6b0 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.693+0000 7f7cde7fc700 1 -- 172.21.15.72:0/3543736913 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 11) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f7cd80059b0 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.694+0000 7f7cde7fc700 1 --2- 172.21.15.72:0/3543736913 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ccc05ef30 0x7f7ccc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:43.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.694+0000 7f7cde7fc700 1 -- 172.21.15.72:0/3543736913 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f7cd8079a10 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.694+0000 7f7cee59b700 1 -- 172.21.15.72:0/3543736913 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ccc05ef30 msgr2=0x7f7ccc0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:00:43.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.694+0000 7f7cee59b700 1 --2- 172.21.15.72:0/3543736913 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ccc05ef30 0x7f7ccc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:00:43.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.702+0000 7f7cde7fc700 1 -- 172.21.15.72:0/3543736913 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7cd804a880 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.879+0000 7f7cf07ff700 1 -- 172.21.15.72:0/3543736913 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ce80af1f0 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.881+0000 7f7cde7fc700 1 -- 172.21.15.72:0/3543736913 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18490 (secure 0 0 0) 0x7f7ce80af1f0 con 0x7f7ce80c5bf0 2023-08-31T19:00:43.881 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:43.881 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":46,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:00:42.435712+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:48:49.967130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T18:48:50.880157+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":46,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1a","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6833/143463":"2023-09-01T18:49:10.496601+0000","172.21.15.72:6832/143463":"2023-09-01T18:49:10.496601+0000","172.21.15.72:0/1955814246":"2023-09-01T18:49:10.496601+0000","172.21.15.72:0/3497520169":"2023-09-01T18:49:10.496601+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":64}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":14,"length":1},{"begin":24,"length":1},{"begin":34,"length":1},{"begin":44,"length":1},{"begin":54,"length":1},{"begin":64,"length":1},{"begin":74,"length":1},{"begin":84,"length":1},{"begin":94,"length":1},{"begin":110,"length":1},{"begin":210,"length":11}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:00:43.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.883+0000 7f7cf07ff700 1 -- 172.21.15.72:0/3543736913 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ccc05ef30 msgr2=0x7f7ccc0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:00:43.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.883+0000 7f7cf07ff700 1 --2- 172.21.15.72:0/3543736913 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ccc05ef30 0x7f7ccc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:43.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.883+0000 7f7cf07ff700 1 -- 172.21.15.72:0/3543736913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ce80c5bf0 msgr2=0x7f7ce81688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:43.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.883+0000 7f7cf07ff700 1 --2- 172.21.15.72:0/3543736913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ce80c5bf0 0x7f7ce81688b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f7cd800c560 tx=0x7f7cd8007cc0).stop 2023-08-31T19:00:43.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.883+0000 7f7cf07ff700 1 -- 172.21.15.72:0/3543736913 shutdown_connections 2023-08-31T19:00:43.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.883+0000 7f7cf07ff700 1 --2- 172.21.15.72:0/3543736913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ce81576d0 0x7f7ce80add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:43.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.883+0000 7f7cf07ff700 1 --2- 172.21.15.72:0/3543736913 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ccc05ef30 0x7f7ccc0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:43.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.883+0000 7f7cf07ff700 1 --2- 172.21.15.72:0/3543736913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ce80a9eb0 0x7f7ce814bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:43.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.883+0000 7f7cf07ff700 1 --2- 172.21.15.72:0/3543736913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ce80c5bf0 0x7f7ce81688b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:43.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.883+0000 7f7cf07ff700 1 -- 172.21.15.72:0/3543736913 >> 172.21.15.72:0/3543736913 conn(0x7f7ce80c82e0 msgr2=0x7f7ce80ac3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:43.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.883+0000 7f7cf07ff700 1 -- 172.21.15.72:0/3543736913 shutdown_connections 2023-08-31T19:00:43.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:43.883+0000 7f7cf07ff700 1 -- 172.21.15.72:0/3543736913 wait complete. 2023-08-31T19:00:43.901 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T18:48:49.967130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T18:48:50.880157+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 220, 'snap_epoch': 46, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:00:43.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:00:43.970 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:43.970+0000 7f84b7b76680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:00:44.035 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:44.035+0000 7fcfe17f4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:00:44.053 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:44.053+0000 7f84b7b76680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:00:44.120 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:44.119+0000 7fcfe17f4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:00:44.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.144+0000 7f11371ff700 1 Processor -- start 2023-08-31T19:00:44.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.144+0000 7f11371ff700 1 -- start start 2023-08-31T19:00:44.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.145+0000 7f11371ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1130154210 0x7f11300630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.145+0000 7f11371ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f11300635a0 0x7f11300c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.145+0000 7f11371ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1130063a00 con 0x7f1130153e30 2023-08-31T19:00:44.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.145+0000 7f11371ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1130154690 con 0x7f11300635a0 2023-08-31T19:00:44.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.145+0000 7f11371ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11300bfd40 con 0x7f1130154210 2023-08-31T19:00:44.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.145+0000 7f1134f9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1130153e30 0x7f11300c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51332/0 (socket says 172.21.15.72:51332) 2023-08-31T19:00:44.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.145+0000 7f1134f9b700 1 -- 172.21.15.72:0/391129685 learned_addr learned my addr 172.21.15.72:0/391129685 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:44.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.146+0000 7f113579c700 1 --2- 172.21.15.72:0/391129685 >> v2:172.21.15.72:3300/0 conn(0x7f11300635a0 0x7f11300c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:44.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.146+0000 7f112ffff700 1 --2- 172.21.15.72:0/391129685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1130154210 0x7f11300630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:44.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.146+0000 7f112f7fe700 1 -- 172.21.15.72:0/391129685 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974101970 0 0) 0x7f1130063a00 con 0x7f1130153e30 2023-08-31T19:00:44.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.146+0000 7f112f7fe700 1 -- 172.21.15.72:0/391129685 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11200033f0 con 0x7f1130153e30 2023-08-31T19:00:44.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.146+0000 7f113579c700 1 -- 172.21.15.72:0/391129685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1130154210 msgr2=0x7f11300630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:44.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.146+0000 7f113579c700 1 --2- 172.21.15.72:0/391129685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1130154210 0x7f11300630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.146+0000 7f113579c700 1 -- 172.21.15.72:0/391129685 >> v1:172.21.15.72:6789/0 conn(0x7f1130153e30 legacy=0x7f11300c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:44.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.146+0000 7f113579c700 1 -- 172.21.15.72:0/391129685 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11300c6730 con 0x7f11300635a0 2023-08-31T19:00:44.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.146+0000 7f112ffff700 1 --2- 172.21.15.72:0/391129685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1130154210 0x7f11300630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:00:44.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.146+0000 7f113579c700 1 --2- 172.21.15.72:0/391129685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11300635a0 0x7f11300c0ac0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f1128009e60 tx=0x7f1128009780).ready entity=mon.0 client_cookie=14e58f1902957f50 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:44.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.146+0000 7f112f7fe700 1 -- 172.21.15.72:0/391129685 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112800e070 con 0x7f11300635a0 2023-08-31T19:00:44.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.147+0000 7f112f7fe700 1 -- 172.21.15.72:0/391129685 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112800bab0 con 0x7f11300635a0 2023-08-31T19:00:44.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.147+0000 7f112f7fe700 1 -- 172.21.15.72:0/391129685 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112800be30 con 0x7f11300635a0 2023-08-31T19:00:44.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.147+0000 7f11371ff700 1 -- 172.21.15.72:0/391129685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11300635a0 msgr2=0x7f11300c0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:44.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.147+0000 7f11371ff700 1 --2- 172.21.15.72:0/391129685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11300635a0 0x7f11300c0ac0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f1128009e60 tx=0x7f1128009780).stop 2023-08-31T19:00:44.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.147+0000 7f11371ff700 1 -- 172.21.15.72:0/391129685 shutdown_connections 2023-08-31T19:00:44.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.147+0000 7f11371ff700 1 --2- 172.21.15.72:0/391129685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11300635a0 0x7f11300c0ac0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.147+0000 7f11371ff700 1 --2- 172.21.15.72:0/391129685 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1130154210 0x7f11300630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.147+0000 7f11371ff700 1 -- 172.21.15.72:0/391129685 >> 172.21.15.72:0/391129685 conn(0x7f113005eb20 msgr2=0x7f11300cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:44.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.147+0000 7f11371ff700 1 -- 172.21.15.72:0/391129685 shutdown_connections 2023-08-31T19:00:44.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.147+0000 7f11371ff700 1 -- 172.21.15.72:0/391129685 wait complete. 2023-08-31T19:00:44.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.149+0000 7f11371ff700 1 Processor -- start 2023-08-31T19:00:44.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.149+0000 7f11371ff700 1 -- start start 2023-08-31T19:00:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f11371ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11300635a0 0x7f1130164080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f11371ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1130153e30 0x7f113014d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f11371ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1130154210 0x7f1130159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f11371ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113014dcf0 con 0x7f11300635a0 2023-08-31T19:00:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f11371ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11300ade20 con 0x7f1130153e30 2023-08-31T19:00:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f11371ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1130159930 con 0x7f1130154210 2023-08-31T19:00:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f1134f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11300635a0 0x7f1130164080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f1134f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11300635a0 0x7f1130164080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55202/0 (socket says 172.21.15.72:55202) 2023-08-31T19:00:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f1134f9b700 1 -- 172.21.15.72:0/2045342514 learned_addr learned my addr 172.21.15.72:0/2045342514 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f112ffff700 1 --2- 172.21.15.72:0/2045342514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1130153e30 0x7f113014d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:44.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f113579c700 1 --2- 172.21.15.72:0/2045342514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1130154210 0x7f1130159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:44.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f1134f9b700 1 -- 172.21.15.72:0/2045342514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1130154210 msgr2=0x7f1130159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:44.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f1134f9b700 1 --2- 172.21.15.72:0/2045342514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1130154210 0x7f1130159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f1134f9b700 1 -- 172.21.15.72:0/2045342514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1130153e30 msgr2=0x7f113014d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:44.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f1134f9b700 1 --2- 172.21.15.72:0/2045342514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1130153e30 0x7f113014d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.150+0000 7f1134f9b700 1 -- 172.21.15.72:0/2045342514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c0092a0 con 0x7f11300635a0 2023-08-31T19:00:44.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.151+0000 7f1134f9b700 1 --2- 172.21.15.72:0/2045342514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11300635a0 0x7f1130164080 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f112400c590 tx=0x7f1124007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:44.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.151+0000 7f112cff9700 1 -- 172.21.15.72:0/2045342514 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124007e40 con 0x7f11300635a0 2023-08-31T19:00:44.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.151+0000 7f112cff9700 1 -- 172.21.15.72:0/2045342514 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11240072e0 con 0x7f11300635a0 2023-08-31T19:00:44.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.151+0000 7f112cff9700 1 -- 172.21.15.72:0/2045342514 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11240057a0 con 0x7f11300635a0 2023-08-31T19:00:44.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.151+0000 7f11371ff700 1 -- 172.21.15.72:0/2045342514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1128009a20 con 0x7f11300635a0 2023-08-31T19:00:44.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.151+0000 7f11371ff700 1 -- 172.21.15.72:0/2045342514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1130164940 con 0x7f11300635a0 2023-08-31T19:00:44.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.152+0000 7f11371ff700 1 -- 172.21.15.72:0/2045342514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113006c6b0 con 0x7f11300635a0 2023-08-31T19:00:44.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.154+0000 7f112cff9700 1 -- 172.21.15.72:0/2045342514 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 11) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f1124005bd0 con 0x7f11300635a0 2023-08-31T19:00:44.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.155+0000 7f112cff9700 1 --2- 172.21.15.72:0/2045342514 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f111405ef30 0x7f11140613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.155+0000 7f112cff9700 1 -- 172.21.15.72:0/2045342514 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f1124079c10 con 0x7f11300635a0 2023-08-31T19:00:44.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.155+0000 7f112ffff700 1 -- 172.21.15.72:0/2045342514 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f111405ef30 msgr2=0x7f11140613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:00:44.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.155+0000 7f112ffff700 1 --2- 172.21.15.72:0/2045342514 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f111405ef30 0x7f11140613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:00:44.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.158+0000 7f112cff9700 1 -- 172.21.15.72:0/2045342514 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f112404ab40 con 0x7f11300635a0 2023-08-31T19:00:44.283 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:44.283+0000 7f84b7b76680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:00:44.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.335+0000 7f11371ff700 1 -- 172.21.15.72:0/2045342514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f113014ded0 con 0x7f11300635a0 2023-08-31T19:00:44.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.336+0000 7f112cff9700 1 -- 172.21.15.72:0/2045342514 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v46) v1 ==== 110+0+10 (secure 0 0 0) 0x7f112404e160 con 0x7f11300635a0 2023-08-31T19:00:44.337 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:00:44.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.338+0000 7f11371ff700 1 -- 172.21.15.72:0/2045342514 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f111405ef30 msgr2=0x7f11140613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:00:44.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.338+0000 7f11371ff700 1 --2- 172.21.15.72:0/2045342514 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f111405ef30 0x7f11140613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:44.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.338+0000 7f11371ff700 1 -- 172.21.15.72:0/2045342514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11300635a0 msgr2=0x7f1130164080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:44.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.338+0000 7f11371ff700 1 --2- 172.21.15.72:0/2045342514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11300635a0 0x7f1130164080 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f112400c590 tx=0x7f1124007c80).stop 2023-08-31T19:00:44.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.338+0000 7f11371ff700 1 -- 172.21.15.72:0/2045342514 shutdown_connections 2023-08-31T19:00:44.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.338+0000 7f11371ff700 1 --2- 172.21.15.72:0/2045342514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1130154210 0x7f1130159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.338+0000 7f11371ff700 1 --2- 172.21.15.72:0/2045342514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11300635a0 0x7f1130164080 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.338+0000 7f11371ff700 1 --2- 172.21.15.72:0/2045342514 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f111405ef30 0x7f11140613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:44.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.338+0000 7f11371ff700 1 --2- 172.21.15.72:0/2045342514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1130153e30 0x7f113014d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.338+0000 7f11371ff700 1 -- 172.21.15.72:0/2045342514 >> 172.21.15.72:0/2045342514 conn(0x7f113005eb20 msgr2=0x7f11300aba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:44.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.338+0000 7f11371ff700 1 -- 172.21.15.72:0/2045342514 shutdown_connections 2023-08-31T19:00:44.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.339+0000 7f11371ff700 1 -- 172.21.15.72:0/2045342514 wait complete. 2023-08-31T19:00:44.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:00:44.361 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:44.359+0000 7fcfe17f4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:00:44.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.557+0000 7efbf11ff700 1 Processor -- start 2023-08-31T19:00:44.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.558+0000 7efbf11ff700 1 -- start start 2023-08-31T19:00:44.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.559+0000 7efbf11ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efbec14ca00 0x7efbec065450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.559+0000 7efbf11ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efbec0a9f80 0x7efbec0aa400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.559+0000 7efbf11ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbec153900 con 0x7efbec062650 2023-08-31T19:00:44.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.559+0000 7efbf11ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbec06a910 con 0x7efbec14ca00 2023-08-31T19:00:44.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.559+0000 7efbf11ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbec152cf0 con 0x7efbec0a9f80 2023-08-31T19:00:44.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.559+0000 7efbeb59e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efbec062650 0x7efbec1561b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51334/0 (socket says 172.21.15.72:51334) 2023-08-31T19:00:44.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.559+0000 7efbeb59e700 1 -- 172.21.15.72:0/304755004 learned_addr learned my addr 172.21.15.72:0/304755004 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:44.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.559+0000 7efbea59c700 1 --2- 172.21.15.72:0/304755004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efbec0a9f80 0x7efbec0aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:44.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.560+0000 7efbead9d700 1 --2- 172.21.15.72:0/304755004 >> v2:172.21.15.146:3300/0 conn(0x7efbec14ca00 0x7efbec065450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:44.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.560+0000 7efbe9d9b700 1 -- 172.21.15.72:0/304755004 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871949483 0 0) 0x7efbec153900 con 0x7efbec062650 2023-08-31T19:00:44.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.560+0000 7efbe9d9b700 1 -- 172.21.15.72:0/304755004 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbd40033f0 con 0x7efbec062650 2023-08-31T19:00:44.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.560+0000 7efbea59c700 1 -- 172.21.15.72:0/304755004 >> v2:172.21.15.146:3300/0 conn(0x7efbec14ca00 msgr2=0x7efbec065450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:44.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.560+0000 7efbea59c700 1 --2- 172.21.15.72:0/304755004 >> v2:172.21.15.146:3300/0 conn(0x7efbec14ca00 0x7efbec065450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.560+0000 7efbea59c700 1 -- 172.21.15.72:0/304755004 >> v1:172.21.15.72:6789/0 conn(0x7efbec062650 legacy=0x7efbec1561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:44.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.560+0000 7efbea59c700 1 -- 172.21.15.72:0/304755004 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbec152fd0 con 0x7efbec0a9f80 2023-08-31T19:00:44.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.560+0000 7efbead9d700 1 --2- 172.21.15.72:0/304755004 >> v2:172.21.15.146:3300/0 conn(0x7efbec14ca00 0x7efbec065450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:00:44.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.560+0000 7efbea59c700 1 --2- 172.21.15.72:0/304755004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efbec0a9f80 0x7efbec0aa400 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7efbe0009760 tx=0x7efbe0009060).ready entity=mon.2 client_cookie=938789ea80c34028 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:44.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.561+0000 7efbe9d9b700 1 -- 172.21.15.72:0/304755004 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe0009120 con 0x7efbec0a9f80 2023-08-31T19:00:44.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.561+0000 7efbe9d9b700 1 -- 172.21.15.72:0/304755004 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe000d4a0 con 0x7efbec0a9f80 2023-08-31T19:00:44.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.561+0000 7efbe9d9b700 1 -- 172.21.15.72:0/304755004 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe000d820 con 0x7efbec0a9f80 2023-08-31T19:00:44.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.561+0000 7efbf11ff700 1 -- 172.21.15.72:0/304755004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efbec0a9f80 msgr2=0x7efbec0aa400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:44.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.561+0000 7efbf11ff700 1 --2- 172.21.15.72:0/304755004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efbec0a9f80 0x7efbec0aa400 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7efbe0009760 tx=0x7efbe0009060).stop 2023-08-31T19:00:44.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.561+0000 7efbf11ff700 1 -- 172.21.15.72:0/304755004 shutdown_connections 2023-08-31T19:00:44.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.561+0000 7efbf11ff700 1 --2- 172.21.15.72:0/304755004 >> v2:172.21.15.146:3300/0 conn(0x7efbec14ca00 0x7efbec065450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.561+0000 7efbf11ff700 1 --2- 172.21.15.72:0/304755004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efbec0a9f80 0x7efbec0aa400 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.561+0000 7efbf11ff700 1 -- 172.21.15.72:0/304755004 >> 172.21.15.72:0/304755004 conn(0x7efbec0c7c20 msgr2=0x7efbec0c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:44.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.561+0000 7efbf11ff700 1 -- 172.21.15.72:0/304755004 shutdown_connections 2023-08-31T19:00:44.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.561+0000 7efbf11ff700 1 -- 172.21.15.72:0/304755004 wait complete. 2023-08-31T19:00:44.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.563+0000 7efbf11ff700 1 Processor -- start 2023-08-31T19:00:44.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.563+0000 7efbf11ff700 1 -- start start 2023-08-31T19:00:44.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbf11ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbec062650 0x7efbec1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbf11ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efbec0a9f80 0x7efbec147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbf11ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbec14ca00 0x7efbec0c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbf11ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbec0acd00 con 0x7efbec062650 2023-08-31T19:00:44.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbf11ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbec0ac0f0 con 0x7efbec14ca00 2023-08-31T19:00:44.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbf11ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbec0ac3d0 con 0x7efbec0a9f80 2023-08-31T19:00:44.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbead9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbec062650 0x7efbec1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:44.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbead9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbec062650 0x7efbec1545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55212/0 (socket says 172.21.15.72:55212) 2023-08-31T19:00:44.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbead9d700 1 -- 172.21.15.72:0/1023830013 learned_addr learned my addr 172.21.15.72:0/1023830013 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:44.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbea59c700 1 --2- 172.21.15.72:0/1023830013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efbec0a9f80 0x7efbec147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:44.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbeb59e700 1 --2- 172.21.15.72:0/1023830013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbec14ca00 0x7efbec0c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:44.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbead9d700 1 -- 172.21.15.72:0/1023830013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efbec0a9f80 msgr2=0x7efbec147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:44.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbead9d700 1 --2- 172.21.15.72:0/1023830013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efbec0a9f80 0x7efbec147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbead9d700 1 -- 172.21.15.72:0/1023830013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbec14ca00 msgr2=0x7efbec0c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:44.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbead9d700 1 --2- 172.21.15.72:0/1023830013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbec14ca00 0x7efbec0c3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.564+0000 7efbead9d700 1 -- 172.21.15.72:0/1023830013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbdc0092a0 con 0x7efbec062650 2023-08-31T19:00:44.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.565+0000 7efbead9d700 1 --2- 172.21.15.72:0/1023830013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbec062650 0x7efbec1545c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7efbdc00ea20 tx=0x7efbdc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:44.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.565+0000 7efbd2ffd700 1 -- 172.21.15.72:0/1023830013 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbdc00c850 con 0x7efbec062650 2023-08-31T19:00:44.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.565+0000 7efbd2ffd700 1 -- 172.21.15.72:0/1023830013 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbdc00c9b0 con 0x7efbec062650 2023-08-31T19:00:44.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.565+0000 7efbf11ff700 1 -- 172.21.15.72:0/1023830013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbe00092a0 con 0x7efbec062650 2023-08-31T19:00:44.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.565+0000 7efbd2ffd700 1 -- 172.21.15.72:0/1023830013 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbdc00cd30 con 0x7efbec062650 2023-08-31T19:00:44.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.565+0000 7efbf11ff700 1 -- 172.21.15.72:0/1023830013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbec0ac990 con 0x7efbec062650 2023-08-31T19:00:44.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.566+0000 7efbf11ff700 1 -- 172.21.15.72:0/1023830013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbec06c6b0 con 0x7efbec062650 2023-08-31T19:00:44.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.567+0000 7efbd2ffd700 1 -- 172.21.15.72:0/1023830013 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 11) v1 ==== 75386+0+0 (secure 0 0 0) 0x7efbdc012600 con 0x7efbec062650 2023-08-31T19:00:44.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.568+0000 7efbd2ffd700 1 --2- 172.21.15.72:0/1023830013 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efbd805ef30 0x7efbd80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.568+0000 7efbd2ffd700 1 -- 172.21.15.72:0/1023830013 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6938+0+0 (secure 0 0 0) 0x7efbdc07a980 con 0x7efbec062650 2023-08-31T19:00:44.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.568+0000 7efbea59c700 1 -- 172.21.15.72:0/1023830013 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efbd805ef30 msgr2=0x7efbd80613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:00:44.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.568+0000 7efbea59c700 1 --2- 172.21.15.72:0/1023830013 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efbd805ef30 0x7efbd80613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:00:44.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.572+0000 7efbd2ffd700 1 -- 172.21.15.72:0/1023830013 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efbdc04b940 con 0x7efbec062650 2023-08-31T19:00:44.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.751+0000 7efbf11ff700 1 -- 172.21.15.72:0/1023830013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efbec1532b0 con 0x7efbec062650 2023-08-31T19:00:44.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.752+0000 7efbd2ffd700 1 -- 172.21.15.72:0/1023830013 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7efbdc04ef60 con 0x7efbec062650 2023-08-31T19:00:44.752 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:00:44.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.754+0000 7efbf11ff700 1 -- 172.21.15.72:0/1023830013 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efbd805ef30 msgr2=0x7efbd80613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:00:44.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.754+0000 7efbf11ff700 1 --2- 172.21.15.72:0/1023830013 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efbd805ef30 0x7efbd80613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:44.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.754+0000 7efbf11ff700 1 -- 172.21.15.72:0/1023830013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbec062650 msgr2=0x7efbec1545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:44.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.754+0000 7efbf11ff700 1 --2- 172.21.15.72:0/1023830013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbec062650 0x7efbec1545c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7efbdc00ea20 tx=0x7efbdc009060).stop 2023-08-31T19:00:44.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.754+0000 7efbf11ff700 1 -- 172.21.15.72:0/1023830013 shutdown_connections 2023-08-31T19:00:44.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.754+0000 7efbf11ff700 1 --2- 172.21.15.72:0/1023830013 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efbd805ef30 0x7efbd80613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:44.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.754+0000 7efbf11ff700 1 --2- 172.21.15.72:0/1023830013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efbec14ca00 0x7efbec0c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.754+0000 7efbf11ff700 1 --2- 172.21.15.72:0/1023830013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbec062650 0x7efbec1545c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.754+0000 7efbf11ff700 1 --2- 172.21.15.72:0/1023830013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efbec0a9f80 0x7efbec147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.754+0000 7efbf11ff700 1 -- 172.21.15.72:0/1023830013 >> 172.21.15.72:0/1023830013 conn(0x7efbec0c7c20 msgr2=0x7efbec152280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:44.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.754+0000 7efbf11ff700 1 -- 172.21.15.72:0/1023830013 shutdown_connections 2023-08-31T19:00:44.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.754+0000 7efbf11ff700 1 -- 172.21.15.72:0/1023830013 wait complete. 2023-08-31T19:00:44.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:00:44.806 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:44.806+0000 7f84b7b76680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:00:44.901 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:44.901+0000 7fcfe17f4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:00:44.931 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:44.931+0000 7f84b7b76680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:00:44.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.974+0000 7f97663ff700 1 Processor -- start 2023-08-31T19:00:44.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.974+0000 7f97663ff700 1 -- start start 2023-08-31T19:00:44.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.975+0000 7f97663ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9760154030 0x7f9760154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.975+0000 7f97663ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97600c06b0 0x7f97600c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.975+0000 7f97663ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97600c6ed0 con 0x7f97600aa140 2023-08-31T19:00:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.975+0000 7f97663ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97600c66e0 con 0x7f9760154030 2023-08-31T19:00:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.975+0000 7f97663ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97600c68c0 con 0x7f97600c06b0 2023-08-31T19:00:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.976+0000 7f976499c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f97600aa140 0x7f9760063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51338/0 (socket says 172.21.15.72:51338) 2023-08-31T19:00:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.976+0000 7f976499c700 1 -- 172.21.15.72:0/1151856418 learned_addr learned my addr 172.21.15.72:0/1151856418 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:44.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.976+0000 7f975f7fe700 1 --2- 172.21.15.72:0/1151856418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97600c06b0 0x7f97600c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:44.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.976+0000 7f975ffff700 1 --2- 172.21.15.72:0/1151856418 >> v2:172.21.15.146:3300/0 conn(0x7f9760154030 0x7f9760154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:44.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.976+0000 7f975effd700 1 -- 172.21.15.72:0/1151856418 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120271764 0 0) 0x7f97600c6ed0 con 0x7f97600aa140 2023-08-31T19:00:44.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.976+0000 7f975effd700 1 -- 172.21.15.72:0/1151856418 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97480033f0 con 0x7f97600aa140 2023-08-31T19:00:44.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.976+0000 7f975ffff700 1 -- 172.21.15.72:0/1151856418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97600c06b0 msgr2=0x7f97600c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:44.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.976+0000 7f975ffff700 1 --2- 172.21.15.72:0/1151856418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97600c06b0 0x7f97600c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.976+0000 7f975ffff700 1 -- 172.21.15.72:0/1151856418 >> v1:172.21.15.72:6789/0 conn(0x7f97600aa140 legacy=0x7f9760063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:44.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.976+0000 7f975ffff700 1 -- 172.21.15.72:0/1151856418 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97600c0f30 con 0x7f9760154030 2023-08-31T19:00:44.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.976+0000 7f975ffff700 1 --2- 172.21.15.72:0/1151856418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9760154030 0x7f9760154410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f9750009760 tx=0x7f9750009060).ready entity=mon.1 client_cookie=adf1af78f4aa6397 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:44.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.977+0000 7f975effd700 1 -- 172.21.15.72:0/1151856418 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975000d4a0 con 0x7f9760154030 2023-08-31T19:00:44.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.977+0000 7f975effd700 1 -- 172.21.15.72:0/1151856418 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975000d600 con 0x7f9760154030 2023-08-31T19:00:44.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.977+0000 7f975effd700 1 -- 172.21.15.72:0/1151856418 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975000d980 con 0x7f9760154030 2023-08-31T19:00:44.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.977+0000 7f97663ff700 1 -- 172.21.15.72:0/1151856418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9760154030 msgr2=0x7f9760154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:44.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.977+0000 7f97663ff700 1 --2- 172.21.15.72:0/1151856418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9760154030 0x7f9760154410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f9750009760 tx=0x7f9750009060).stop 2023-08-31T19:00:44.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.977+0000 7f97663ff700 1 -- 172.21.15.72:0/1151856418 shutdown_connections 2023-08-31T19:00:44.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.977+0000 7f97663ff700 1 --2- 172.21.15.72:0/1151856418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9760154030 0x7f9760154410 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.977+0000 7f97663ff700 1 --2- 172.21.15.72:0/1151856418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97600c06b0 0x7f97600c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.977+0000 7f97663ff700 1 -- 172.21.15.72:0/1151856418 >> 172.21.15.72:0/1151856418 conn(0x7f976005eb60 msgr2=0x7f97600cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:44.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.977+0000 7f97663ff700 1 -- 172.21.15.72:0/1151856418 shutdown_connections 2023-08-31T19:00:44.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.978+0000 7f97663ff700 1 -- 172.21.15.72:0/1151856418 wait complete. 2023-08-31T19:00:44.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.979+0000 7f97663ff700 1 Processor -- start 2023-08-31T19:00:44.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.979+0000 7f97663ff700 1 -- start start 2023-08-31T19:00:44.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.980+0000 7f97663ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97600aa140 0x7f976014dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.980+0000 7f97663ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97600c06b0 0x7f9760140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.980+0000 7f97663ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9760154030 0x7f9760150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.980+0000 7f97663ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976014efb0 con 0x7f97600c06b0 2023-08-31T19:00:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.980+0000 7f97663ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976014f290 con 0x7f9760154030 2023-08-31T19:00:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.980+0000 7f97663ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976014f570 con 0x7f97600aa140 2023-08-31T19:00:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.980+0000 7f975f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97600c06b0 0x7f9760140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.980+0000 7f975f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97600c06b0 0x7f9760140820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55218/0 (socket says 172.21.15.72:55218) 2023-08-31T19:00:44.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.980+0000 7f975f7fe700 1 -- 172.21.15.72:0/3245335361 learned_addr learned my addr 172.21.15.72:0/3245335361 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.981+0000 7f975ffff700 1 --2- 172.21.15.72:0/3245335361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97600aa140 0x7f976014dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.981+0000 7f976499c700 1 --2- 172.21.15.72:0/3245335361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9760154030 0x7f9760150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.981+0000 7f975f7fe700 1 -- 172.21.15.72:0/3245335361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97600aa140 msgr2=0x7f976014dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.981+0000 7f975f7fe700 1 --2- 172.21.15.72:0/3245335361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97600aa140 0x7f976014dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.981+0000 7f975f7fe700 1 -- 172.21.15.72:0/3245335361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9760154030 msgr2=0x7f9760150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:44.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.981+0000 7f975f7fe700 1 --2- 172.21.15.72:0/3245335361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9760154030 0x7f9760150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:44.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.981+0000 7f975f7fe700 1 -- 172.21.15.72:0/3245335361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500092a0 con 0x7f97600c06b0 2023-08-31T19:00:44.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.981+0000 7f976499c700 1 --2- 172.21.15.72:0/3245335361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9760154030 0x7f9760150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:44.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.981+0000 7f975f7fe700 1 --2- 172.21.15.72:0/3245335361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97600c06b0 0x7f9760140820 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f975400e930 tx=0x7f9754009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:44.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.981+0000 7f9747fff700 1 -- 172.21.15.72:0/3245335361 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975400c670 con 0x7f97600c06b0 2023-08-31T19:00:44.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.981+0000 7f9747fff700 1 -- 172.21.15.72:0/3245335361 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975400c7d0 con 0x7f97600c06b0 2023-08-31T19:00:44.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.981+0000 7f9747fff700 1 -- 172.21.15.72:0/3245335361 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975400cb50 con 0x7f97600c06b0 2023-08-31T19:00:44.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.981+0000 7f97663ff700 1 -- 172.21.15.72:0/3245335361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976014f850 con 0x7f97600c06b0 2023-08-31T19:00:44.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.981+0000 7f97663ff700 1 -- 172.21.15.72:0/3245335361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976014e210 con 0x7f97600c06b0 2023-08-31T19:00:44.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.983+0000 7f97663ff700 1 -- 172.21.15.72:0/3245335361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976014fea0 con 0x7f97600c06b0 2023-08-31T19:00:44.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.983+0000 7f9747fff700 1 -- 172.21.15.72:0/3245335361 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 11) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f975401b400 con 0x7f97600c06b0 2023-08-31T19:00:44.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.984+0000 7f9747fff700 1 --2- 172.21.15.72:0/3245335361 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f974c05ef30 0x7f974c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:44.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.984+0000 7f9747fff700 1 -- 172.21.15.72:0/3245335361 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6938+0+0 (secure 0 0 0) 0x7f975407a880 con 0x7f97600c06b0 2023-08-31T19:00:44.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.984+0000 7f975ffff700 1 -- 172.21.15.72:0/3245335361 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f974c05ef30 msgr2=0x7f974c0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:00:44.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.984+0000 7f975ffff700 1 --2- 172.21.15.72:0/3245335361 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f974c05ef30 0x7f974c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:00:44.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:44.988+0000 7f9747fff700 1 -- 172.21.15.72:0/3245335361 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f975404b720 con 0x7f97600c06b0 2023-08-31T19:00:45.035 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:45.035+0000 7fcfe17f4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:00:45.118 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:45.118+0000 7f84b7b76680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:00:45.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.160+0000 7f97663ff700 1 -- 172.21.15.72:0/3245335361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f976006c6b0 con 0x7f97600c06b0 2023-08-31T19:00:45.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.160+0000 7f9747fff700 1 -- 172.21.15.72:0/3245335361 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f975404ed40 con 0x7f97600c06b0 2023-08-31T19:00:45.161 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:00:45.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.162+0000 7f97663ff700 1 -- 172.21.15.72:0/3245335361 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f974c05ef30 msgr2=0x7f974c0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:00:45.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.162+0000 7f97663ff700 1 --2- 172.21.15.72:0/3245335361 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f974c05ef30 0x7f974c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:45.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.162+0000 7f97663ff700 1 -- 172.21.15.72:0/3245335361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97600c06b0 msgr2=0x7f9760140820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:45.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.162+0000 7f97663ff700 1 --2- 172.21.15.72:0/3245335361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97600c06b0 0x7f9760140820 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f975400e930 tx=0x7f9754009060).stop 2023-08-31T19:00:45.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.163+0000 7f97663ff700 1 -- 172.21.15.72:0/3245335361 shutdown_connections 2023-08-31T19:00:45.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.163+0000 7f97663ff700 1 --2- 172.21.15.72:0/3245335361 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f974c05ef30 0x7f974c0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:45.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.163+0000 7f97663ff700 1 --2- 172.21.15.72:0/3245335361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9760154030 0x7f9760150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.163+0000 7f97663ff700 1 --2- 172.21.15.72:0/3245335361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97600aa140 0x7f976014dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.163+0000 7f97663ff700 1 --2- 172.21.15.72:0/3245335361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97600c06b0 0x7f9760140820 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.163+0000 7f97663ff700 1 -- 172.21.15.72:0/3245335361 >> 172.21.15.72:0/3245335361 conn(0x7f976005eb60 msgr2=0x7f976015a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:45.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.163+0000 7f97663ff700 1 -- 172.21.15.72:0/3245335361 shutdown_connections 2023-08-31T19:00:45.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.163+0000 7f97663ff700 1 -- 172.21.15.72:0/3245335361 wait complete. 2023-08-31T19:00:45.181 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:00:45.209 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:45.209+0000 7f84b7b76680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:00:45.222 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:45.222+0000 7fcfe17f4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:00:45.293 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:45.293+0000 7f84b7b76680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:00:45.319 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:45.319+0000 7fcfe17f4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:00:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.377+0000 7fdf79fff700 1 Processor -- start 2023-08-31T19:00:45.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.378+0000 7fdf79fff700 1 -- start start 2023-08-31T19:00:45.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.379+0000 7fdf79fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf741544e0 0x7fdf7405e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:45.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.379+0000 7fdf79fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf740bc4a0 con 0x7fdf740c38d0 2023-08-31T19:00:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.379+0000 7fdf79fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf74069c40 con 0x7fdf740690e0 2023-08-31T19:00:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.379+0000 7fdf79fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7405e840 con 0x7fdf741544e0 2023-08-31T19:00:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.379+0000 7fdf72ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdf740c38d0 0x7fdf740689d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51352/0 (socket says 172.21.15.72:51352) 2023-08-31T19:00:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.379+0000 7fdf72ffd700 1 -- 172.21.15.72:0/3598079057 learned_addr learned my addr 172.21.15.72:0/3598079057 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:45.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.379+0000 7fdf737fe700 1 --2- 172.21.15.72:0/3598079057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf741544e0 0x7fdf7405e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.380+0000 7fdf727fc700 1 -- 172.21.15.72:0/3598079057 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876726167 0 0) 0x7fdf740bc4a0 con 0x7fdf740c38d0 2023-08-31T19:00:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.380+0000 7fdf727fc700 1 -- 172.21.15.72:0/3598079057 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf5c0033f0 con 0x7fdf740c38d0 2023-08-31T19:00:45.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.380+0000 7fdf727fc700 1 -- 172.21.15.72:0/3598079057 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725191154 0 0) 0x7fdf74069c40 con 0x7fdf740690e0 2023-08-31T19:00:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.380+0000 7fdf727fc700 1 -- 172.21.15.72:0/3598079057 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf740bc4a0 con 0x7fdf740690e0 2023-08-31T19:00:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.380+0000 7fdf737fe700 1 -- 172.21.15.72:0/3598079057 >> v1:172.21.15.146:6789/0 conn(0x7fdf740690e0 legacy=0x7fdf740bc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.380+0000 7fdf737fe700 1 -- 172.21.15.72:0/3598079057 >> v1:172.21.15.72:6789/0 conn(0x7fdf740c38d0 legacy=0x7fdf740689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.380+0000 7fdf737fe700 1 -- 172.21.15.72:0/3598079057 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf740c1c30 con 0x7fdf741544e0 2023-08-31T19:00:45.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.380+0000 7fdf737fe700 1 --2- 172.21.15.72:0/3598079057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf741544e0 0x7fdf7405e350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdf64009790 tx=0x7fdf64009060).ready entity=mon.2 client_cookie=fc58774b36a1f34e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:45.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.380+0000 7fdf727fc700 1 -- 172.21.15.72:0/3598079057 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf640090d0 con 0x7fdf741544e0 2023-08-31T19:00:45.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.380+0000 7fdf727fc700 1 -- 172.21.15.72:0/3598079057 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6400f510 con 0x7fdf741544e0 2023-08-31T19:00:45.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.380+0000 7fdf727fc700 1 -- 172.21.15.72:0/3598079057 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6400f890 con 0x7fdf741544e0 2023-08-31T19:00:45.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.381+0000 7fdf79fff700 1 -- 172.21.15.72:0/3598079057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf741544e0 msgr2=0x7fdf7405e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:45.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.381+0000 7fdf79fff700 1 --2- 172.21.15.72:0/3598079057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf741544e0 0x7fdf7405e350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdf64009790 tx=0x7fdf64009060).stop 2023-08-31T19:00:45.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.381+0000 7fdf79fff700 1 -- 172.21.15.72:0/3598079057 shutdown_connections 2023-08-31T19:00:45.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.381+0000 7fdf79fff700 1 --2- 172.21.15.72:0/3598079057 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf741544e0 0x7fdf7405e350 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.381+0000 7fdf79fff700 1 -- 172.21.15.72:0/3598079057 >> 172.21.15.72:0/3598079057 conn(0x7fdf740c7e00 msgr2=0x7fdf740c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:45.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.381+0000 7fdf79fff700 1 -- 172.21.15.72:0/3598079057 shutdown_connections 2023-08-31T19:00:45.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.381+0000 7fdf79fff700 1 -- 172.21.15.72:0/3598079057 wait complete. 2023-08-31T19:00:45.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.383+0000 7fdf79fff700 1 Processor -- start 2023-08-31T19:00:45.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.383+0000 7fdf79fff700 1 -- start start 2023-08-31T19:00:45.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf79fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf740690e0 0x7fdf740aba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:45.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf79fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf740c38d0 0x7fdf741685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:45.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf79fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf741544e0 0x7fdf7414f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:45.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf79fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf74150290 con 0x7fdf741544e0 2023-08-31T19:00:45.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf79fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf74156860 con 0x7fdf740c38d0 2023-08-31T19:00:45.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf79fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf740abf20 con 0x7fdf740690e0 2023-08-31T19:00:45.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf73fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf741544e0 0x7fdf7414f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:45.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf737fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf740690e0 0x7fdf740aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:45.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf73fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf741544e0 0x7fdf7414f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55234/0 (socket says 172.21.15.72:55234) 2023-08-31T19:00:45.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf737fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf740690e0 0x7fdf740aba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:44892/0 (socket says 172.21.15.72:44892) 2023-08-31T19:00:45.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf73fff700 1 -- 172.21.15.72:0/124556575 learned_addr learned my addr 172.21.15.72:0/124556575 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:45.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf72ffd700 1 --2- 172.21.15.72:0/124556575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf740c38d0 0x7fdf741685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:45.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf737fe700 1 -- 172.21.15.72:0/124556575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf740c38d0 msgr2=0x7fdf741685b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:45.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf737fe700 1 --2- 172.21.15.72:0/124556575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf740c38d0 0x7fdf741685b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf737fe700 1 -- 172.21.15.72:0/124556575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf741544e0 msgr2=0x7fdf7414f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:45.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf737fe700 1 --2- 172.21.15.72:0/124556575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf741544e0 0x7fdf7414f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf737fe700 1 -- 172.21.15.72:0/124556575 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf640092a0 con 0x7fdf740690e0 2023-08-31T19:00:45.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.384+0000 7fdf73fff700 1 --2- 172.21.15.72:0/124556575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf741544e0 0x7fdf7414f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:00:45.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.385+0000 7fdf737fe700 1 --2- 172.21.15.72:0/124556575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf740690e0 0x7fdf740aba30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdf64014000 tx=0x7fdf64017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:45.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.385+0000 7fdf5b7fe700 1 -- 172.21.15.72:0/124556575 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64006cd0 con 0x7fdf740690e0 2023-08-31T19:00:45.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.385+0000 7fdf5b7fe700 1 -- 172.21.15.72:0/124556575 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6400fc50 con 0x7fdf740690e0 2023-08-31T19:00:45.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.385+0000 7fdf79fff700 1 -- 172.21.15.72:0/124556575 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf74156050 con 0x7fdf740690e0 2023-08-31T19:00:45.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.385+0000 7fdf5b7fe700 1 -- 172.21.15.72:0/124556575 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64006970 con 0x7fdf740690e0 2023-08-31T19:00:45.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.385+0000 7fdf79fff700 1 -- 172.21.15.72:0/124556575 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf74156580 con 0x7fdf740690e0 2023-08-31T19:00:45.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.387+0000 7fdf79fff700 1 -- 172.21.15.72:0/124556575 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7406c6b0 con 0x7fdf740690e0 2023-08-31T19:00:45.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.387+0000 7fdf5b7fe700 1 -- 172.21.15.72:0/124556575 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 11) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fdf6401b620 con 0x7fdf740690e0 2023-08-31T19:00:45.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.388+0000 7fdf5b7fe700 1 --2- 172.21.15.72:0/124556575 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf6005ef30 0x7fdf600613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:45.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.388+0000 7fdf5b7fe700 1 -- 172.21.15.72:0/124556575 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6938+0+0 (secure 0 0 0) 0x7fdf6407beb0 con 0x7fdf740690e0 2023-08-31T19:00:45.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.388+0000 7fdf72ffd700 1 -- 172.21.15.72:0/124556575 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf6005ef30 msgr2=0x7fdf600613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:00:45.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.388+0000 7fdf72ffd700 1 --2- 172.21.15.72:0/124556575 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf6005ef30 0x7fdf600613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:00:45.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.392+0000 7fdf5b7fe700 1 -- 172.21.15.72:0/124556575 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdf6404cd50 con 0x7fdf740690e0 2023-08-31T19:00:45.409 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:45.408+0000 7fcfe17f4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:00:45.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.568+0000 7fdf79fff700 1 -- 172.21.15.72:0/124556575 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf740c1f10 con 0x7fdf740690e0 2023-08-31T19:00:45.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.568+0000 7fdf5b7fe700 1 -- 172.21.15.72:0/124556575 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf740c1f10 con 0x7fdf740690e0 2023-08-31T19:00:45.569 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:00:45.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.570+0000 7fdf79fff700 1 -- 172.21.15.72:0/124556575 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf6005ef30 msgr2=0x7fdf600613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:00:45.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.570+0000 7fdf79fff700 1 --2- 172.21.15.72:0/124556575 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf6005ef30 0x7fdf600613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:45.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.571+0000 7fdf79fff700 1 -- 172.21.15.72:0/124556575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf740690e0 msgr2=0x7fdf740aba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:45.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.571+0000 7fdf79fff700 1 --2- 172.21.15.72:0/124556575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf740690e0 0x7fdf740aba30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdf64014000 tx=0x7fdf64017000).stop 2023-08-31T19:00:45.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.571+0000 7fdf79fff700 1 -- 172.21.15.72:0/124556575 shutdown_connections 2023-08-31T19:00:45.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.571+0000 7fdf79fff700 1 --2- 172.21.15.72:0/124556575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf741544e0 0x7fdf7414f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.571+0000 7fdf79fff700 1 --2- 172.21.15.72:0/124556575 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdf740690e0 0x7fdf740aba30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.571+0000 7fdf79fff700 1 --2- 172.21.15.72:0/124556575 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdf6005ef30 0x7fdf600613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.571+0000 7fdf79fff700 1 --2- 172.21.15.72:0/124556575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf740c38d0 0x7fdf741685b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.571+0000 7fdf79fff700 1 -- 172.21.15.72:0/124556575 >> 172.21.15.72:0/124556575 conn(0x7fdf740c7e00 msgr2=0x7fdf740c5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:45.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.571+0000 7fdf79fff700 1 -- 172.21.15.72:0/124556575 shutdown_connections 2023-08-31T19:00:45.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.571+0000 7fdf79fff700 1 -- 172.21.15.72:0/124556575 wait complete. 2023-08-31T19:00:45.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:00:45.603 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:45.603+0000 7f84b7b76680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:00:45.732 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:45.731+0000 7fcfe17f4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:00:45.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.823+0000 7f3b439ff700 1 Processor -- start 2023-08-31T19:00:45.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.823+0000 7f3b439ff700 1 -- start start 2023-08-31T19:00:45.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.824+0000 7f3b439ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c1541a0 0x7f3b3c0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:45.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.824+0000 7f3b439ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3b3c0bf460 0x7f3b3c0c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:45.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.824+0000 7f3b439ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b3c0c4300 0x7f3b3c0be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:45.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.824+0000 7f3b439ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3c0c47b0 con 0x7f3b3c0bf460 2023-08-31T19:00:45.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.824+0000 7f3b439ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3c0c5950 con 0x7f3b3c0c4300 2023-08-31T19:00:45.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.824+0000 7f3b439ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0c5c30 con 0x7f3b3c1541a0 2023-08-31T19:00:45.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.825+0000 7f3b40f9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3b3c0bf460 0x7f3b3c0c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:45.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.825+0000 7f3b40f9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3b3c0bf460 0x7f3b3c0c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55242/0 (socket says 172.21.15.72:55242) 2023-08-31T19:00:45.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.825+0000 7f3b40f9a700 1 -- 172.21.15.72:0/4159910244 learned_addr learned my addr 172.21.15.72:0/4159910244 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:45.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.825+0000 7f3b4179b700 1 --2- 172.21.15.72:0/4159910244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c1541a0 0x7f3b3c0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:45.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.825+0000 7f3b41f9c700 1 --2- 172.21.15.72:0/4159910244 >> v2:172.21.15.146:3300/0 conn(0x7f3b3c0c4300 0x7f3b3c0be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:45.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.825+0000 7f3b40f9a700 1 -- 172.21.15.72:0/4159910244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c1541a0 msgr2=0x7f3b3c0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:45.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.825+0000 7f3b40f9a700 1 --2- 172.21.15.72:0/4159910244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c1541a0 0x7f3b3c0c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.825+0000 7f3b40f9a700 1 -- 172.21.15.72:0/4159910244 >> v2:172.21.15.146:3300/0 conn(0x7f3b3c0c4300 msgr2=0x7f3b3c0be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:45.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.825+0000 7f3b40f9a700 1 --2- 172.21.15.72:0/4159910244 >> v2:172.21.15.146:3300/0 conn(0x7f3b3c0c4300 0x7f3b3c0be2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.825+0000 7f3b40f9a700 1 -- 172.21.15.72:0/4159910244 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c0c5f10 con 0x7f3b3c0bf460 2023-08-31T19:00:45.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.825+0000 7f3b40f9a700 1 --2- 172.21.15.72:0/4159910244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b3c0bf460 0x7f3b3c0c3e10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f3b2c006fd0 tx=0x7f3b2c0090f0).ready entity=mon.0 client_cookie=6f4b38122971259b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:45.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.826+0000 7f3b33fff700 1 -- 172.21.15.72:0/4159910244 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c00f510 con 0x7f3b3c0bf460 2023-08-31T19:00:45.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.826+0000 7f3b33fff700 1 -- 172.21.15.72:0/4159910244 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c00f670 con 0x7f3b3c0bf460 2023-08-31T19:00:45.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.826+0000 7f3b33fff700 1 -- 172.21.15.72:0/4159910244 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c00f9f0 con 0x7f3b3c0bf460 2023-08-31T19:00:45.830 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:45.827+0000 7f84b7b76680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:00:45.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.826+0000 7f3b439ff700 1 -- 172.21.15.72:0/4159910244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b3c0bf460 msgr2=0x7f3b3c0c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:45.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.826+0000 7f3b439ff700 1 --2- 172.21.15.72:0/4159910244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b3c0bf460 0x7f3b3c0c3e10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f3b2c006fd0 tx=0x7f3b2c0090f0).stop 2023-08-31T19:00:45.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.826+0000 7f3b439ff700 1 -- 172.21.15.72:0/4159910244 shutdown_connections 2023-08-31T19:00:45.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.826+0000 7f3b439ff700 1 --2- 172.21.15.72:0/4159910244 >> v2:172.21.15.146:3300/0 conn(0x7f3b3c0c4300 0x7f3b3c0be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.826+0000 7f3b439ff700 1 --2- 172.21.15.72:0/4159910244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c1541a0 0x7f3b3c0c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.826+0000 7f3b439ff700 1 --2- 172.21.15.72:0/4159910244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b3c0bf460 0x7f3b3c0c3e10 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.826+0000 7f3b439ff700 1 -- 172.21.15.72:0/4159910244 >> 172.21.15.72:0/4159910244 conn(0x7f3b3c082f60 msgr2=0x7f3b3c05e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:45.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.826+0000 7f3b439ff700 1 -- 172.21.15.72:0/4159910244 shutdown_connections 2023-08-31T19:00:45.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.826+0000 7f3b439ff700 1 -- 172.21.15.72:0/4159910244 wait complete. 2023-08-31T19:00:45.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.828+0000 7f3b439ff700 1 Processor -- start 2023-08-31T19:00:45.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.828+0000 7f3b439ff700 1 -- start start 2023-08-31T19:00:45.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.829+0000 7f3b439ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c0bf460 0x7f3b3c14de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:45.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.829+0000 7f3b439ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0c4300 0x7f3b3c0c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:45.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.829+0000 7f3b439ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b3c1541a0 0x7f3b3c064730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:45.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.829+0000 7f3b439ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0c7820 con 0x7f3b3c1541a0 2023-08-31T19:00:45.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.829+0000 7f3b439ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0c6970 con 0x7f3b3c0bf460 2023-08-31T19:00:45.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.829+0000 7f3b439ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c0c6c10 con 0x7f3b3c0c4300 2023-08-31T19:00:45.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.829+0000 7f3b41f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b3c1541a0 0x7f3b3c064730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:45.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.829+0000 7f3b41f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b3c1541a0 0x7f3b3c064730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55248/0 (socket says 172.21.15.72:55248) 2023-08-31T19:00:45.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.829+0000 7f3b41f9c700 1 -- 172.21.15.72:0/4194515157 learned_addr learned my addr 172.21.15.72:0/4194515157 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:45.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.829+0000 7f3b4179b700 1 --2- 172.21.15.72:0/4194515157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c0bf460 0x7f3b3c14de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:45.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.829+0000 7f3b40f9a700 1 --2- 172.21.15.72:0/4194515157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0c4300 0x7f3b3c0c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:45.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.829+0000 7f3b41f9c700 1 -- 172.21.15.72:0/4194515157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0c4300 msgr2=0x7f3b3c0c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:45.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.829+0000 7f3b41f9c700 1 --2- 172.21.15.72:0/4194515157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0c4300 0x7f3b3c0c2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.829+0000 7f3b41f9c700 1 -- 172.21.15.72:0/4194515157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c0bf460 msgr2=0x7f3b3c14de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:45.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.829+0000 7f3b41f9c700 1 --2- 172.21.15.72:0/4194515157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c0bf460 0x7f3b3c14de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:45.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.830+0000 7f3b41f9c700 1 -- 172.21.15.72:0/4194515157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c009370 con 0x7f3b3c1541a0 2023-08-31T19:00:45.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.830+0000 7f3b41f9c700 1 --2- 172.21.15.72:0/4194515157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b3c1541a0 0x7f3b3c064730 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f3b34009e90 tx=0x7f3b3400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:45.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.830+0000 7f3b317fa700 1 -- 172.21.15.72:0/4194515157 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3400caa0 con 0x7f3b3c1541a0 2023-08-31T19:00:45.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.830+0000 7f3b317fa700 1 -- 172.21.15.72:0/4194515157 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3400f040 con 0x7f3b3c1541a0 2023-08-31T19:00:45.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.830+0000 7f3b317fa700 1 -- 172.21.15.72:0/4194515157 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3400ce10 con 0x7f3b3c1541a0 2023-08-31T19:00:45.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.830+0000 7f3b439ff700 1 -- 172.21.15.72:0/4194515157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3c0c6ef0 con 0x7f3b3c1541a0 2023-08-31T19:00:45.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.830+0000 7f3b439ff700 1 -- 172.21.15.72:0/4194515157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3c0c74b0 con 0x7f3b3c1541a0 2023-08-31T19:00:45.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.831+0000 7f3b439ff700 1 -- 172.21.15.72:0/4194515157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3c0c7990 con 0x7f3b3c1541a0 2023-08-31T19:00:45.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.832+0000 7f3b317fa700 1 -- 172.21.15.72:0/4194515157 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 11) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f3b34013610 con 0x7f3b3c1541a0 2023-08-31T19:00:45.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.833+0000 7f3b317fa700 1 --2- 172.21.15.72:0/4194515157 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3b2005ef30 0x7f3b200613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:45.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.833+0000 7f3b317fa700 1 -- 172.21.15.72:0/4194515157 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6938+0+0 (secure 0 0 0) 0x7f3b3407ab70 con 0x7f3b3c1541a0 2023-08-31T19:00:45.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.833+0000 7f3b4179b700 1 -- 172.21.15.72:0/4194515157 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3b2005ef30 msgr2=0x7f3b200613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:00:45.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.833+0000 7f3b4179b700 1 --2- 172.21.15.72:0/4194515157 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3b2005ef30 0x7f3b200613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:00:45.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:45.837+0000 7f3b317fa700 1 -- 172.21.15.72:0/4194515157 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b3404bbf0 con 0x7f3b3c1541a0 2023-08-31T19:00:45.960 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:45.960+0000 7fcfe17f4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:00:46.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.034+0000 7f3b4179b700 1 -- 172.21.15.72:0/4194515157 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3b2005ef30 msgr2=0x7f3b200613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:00:46.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.034+0000 7f3b4179b700 1 --2- 172.21.15.72:0/4194515157 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3b2005ef30 0x7f3b200613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:00:46.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.053+0000 7f3b439ff700 1 -- 172.21.15.72:0/4194515157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b3c06c6b0 con 0x7f3b3c1541a0 2023-08-31T19:00:46.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.053+0000 7f3b317fa700 1 -- 172.21.15.72:0/4194515157 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f3b3404f210 con 0x7f3b3c1541a0 2023-08-31T19:00:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:46.054 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/682775915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":682775915},{"type":"v1","addr":"172.21.15.146:6835","nonce":682775915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/934559211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":934559211},{"type":"v1","addr":"172.21.15.72:6836","nonce":934559211}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2587704834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2587704834},{"type":"v1","addr":"172.21.15.72:6837","nonce":2587704834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T18:48:51.892123+0000","modified":"2023-08-31T18:48:54.904501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/1295593403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1295593403},{"type":"v1","addr":"172.21.15.146:6834","nonce":1295593403}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-31T19:00:46.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.056+0000 7f3b439ff700 1 -- 172.21.15.72:0/4194515157 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3b2005ef30 msgr2=0x7f3b200613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:00:46.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.056+0000 7f3b439ff700 1 --2- 172.21.15.72:0/4194515157 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3b2005ef30 0x7f3b200613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:46.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.056+0000 7f3b439ff700 1 -- 172.21.15.72:0/4194515157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b3c1541a0 msgr2=0x7f3b3c064730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:46.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.056+0000 7f3b439ff700 1 --2- 172.21.15.72:0/4194515157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b3c1541a0 0x7f3b3c064730 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f3b34009e90 tx=0x7f3b3400b040).stop 2023-08-31T19:00:46.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.056+0000 7f3b439ff700 1 -- 172.21.15.72:0/4194515157 shutdown_connections 2023-08-31T19:00:46.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.056+0000 7f3b439ff700 1 --2- 172.21.15.72:0/4194515157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b3c1541a0 0x7f3b3c064730 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.056+0000 7f3b439ff700 1 --2- 172.21.15.72:0/4194515157 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3b2005ef30 0x7f3b200613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:46.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.056+0000 7f3b439ff700 1 --2- 172.21.15.72:0/4194515157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b3c0bf460 0x7f3b3c14de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.056+0000 7f3b439ff700 1 --2- 172.21.15.72:0/4194515157 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b3c0c4300 0x7f3b3c0c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.056+0000 7f3b439ff700 1 -- 172.21.15.72:0/4194515157 >> 172.21.15.72:0/4194515157 conn(0x7f3b3c082f60 msgr2=0x7f3b3c14e720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:46.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.056+0000 7f3b439ff700 1 -- 172.21.15.72:0/4194515157 shutdown_connections 2023-08-31T19:00:46.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.056+0000 7f3b439ff700 1 -- 172.21.15.72:0/4194515157 wait complete. 2023-08-31T19:00:46.059 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2023-08-31T19:00:46.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:00:46.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.267+0000 7f2ce61ff700 1 Processor -- start 2023-08-31T19:00:46.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.267+0000 7f2ce61ff700 1 -- start start 2023-08-31T19:00:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.268+0000 7f2ce61ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2ce01575b0 0x7f2ce0157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.268+0000 7f2ce61ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce00c6f20 0x7f2ce0158630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.268+0000 7f2ce61ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce00c73b0 con 0x7f2ce01581d0 2023-08-31T19:00:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.268+0000 7f2ce61ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce0158b20 con 0x7f2ce01575b0 2023-08-31T19:00:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.268+0000 7f2ce61ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce00c7620 con 0x7f2ce00c6f20 2023-08-31T19:00:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.269+0000 7f2cdeffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2ce01581d0 0x7f2ce00c8c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51360/0 (socket says 172.21.15.72:51360) 2023-08-31T19:00:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.269+0000 7f2cdeffd700 1 -- 172.21.15.72:0/4002235028 learned_addr learned my addr 172.21.15.72:0/4002235028 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.269+0000 7f2cdf7fe700 1 --2- 172.21.15.72:0/4002235028 >> v2:172.21.15.72:3300/0 conn(0x7f2ce01575b0 0x7f2ce0157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:46.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.269+0000 7f2cdffff700 1 --2- 172.21.15.72:0/4002235028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce00c6f20 0x7f2ce0158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:46.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.269+0000 7f2cdf7fe700 1 -- 172.21.15.72:0/4002235028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce00c6f20 msgr2=0x7f2ce0158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:46.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.269+0000 7f2cdf7fe700 1 --2- 172.21.15.72:0/4002235028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce00c6f20 0x7f2ce0158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.269+0000 7f2cdf7fe700 1 -- 172.21.15.72:0/4002235028 >> v1:172.21.15.72:6789/0 conn(0x7f2ce01581d0 legacy=0x7f2ce00c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.269+0000 7f2cdf7fe700 1 -- 172.21.15.72:0/4002235028 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce00c0830 con 0x7f2ce01575b0 2023-08-31T19:00:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.269+0000 7f2cde7fc700 1 -- 172.21.15.72:0/4002235028 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706969391 0 0) 0x7f2ce00c73b0 con 0x7f2ce01581d0 2023-08-31T19:00:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.269+0000 7f2cdf7fe700 1 --2- 172.21.15.72:0/4002235028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ce01575b0 0x7f2ce0157ce0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f2cd0006fd0 tx=0x7f2cd0006f40).ready entity=mon.0 client_cookie=f22f3c8a2da5e872 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.270+0000 7f2cde7fc700 1 -- 172.21.15.72:0/4002235028 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0005880 con 0x7f2ce01575b0 2023-08-31T19:00:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.270+0000 7f2cde7fc700 1 -- 172.21.15.72:0/4002235028 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd00059e0 con 0x7f2ce01575b0 2023-08-31T19:00:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.270+0000 7f2cde7fc700 1 -- 172.21.15.72:0/4002235028 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0005d60 con 0x7f2ce01575b0 2023-08-31T19:00:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.270+0000 7f2ce61ff700 1 -- 172.21.15.72:0/4002235028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ce01575b0 msgr2=0x7f2ce0157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.270+0000 7f2ce61ff700 1 --2- 172.21.15.72:0/4002235028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ce01575b0 0x7f2ce0157ce0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f2cd0006fd0 tx=0x7f2cd0006f40).stop 2023-08-31T19:00:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.270+0000 7f2ce61ff700 1 -- 172.21.15.72:0/4002235028 shutdown_connections 2023-08-31T19:00:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.270+0000 7f2ce61ff700 1 --2- 172.21.15.72:0/4002235028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ce01575b0 0x7f2ce0157ce0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.270+0000 7f2ce61ff700 1 --2- 172.21.15.72:0/4002235028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce00c6f20 0x7f2ce0158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.270+0000 7f2ce61ff700 1 -- 172.21.15.72:0/4002235028 >> 172.21.15.72:0/4002235028 conn(0x7f2ce005e870 msgr2=0x7f2ce00cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.271+0000 7f2ce61ff700 1 -- 172.21.15.72:0/4002235028 shutdown_connections 2023-08-31T19:00:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.271+0000 7f2ce61ff700 1 -- 172.21.15.72:0/4002235028 wait complete. 2023-08-31T19:00:46.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.272+0000 7f2ce61ff700 1 Processor -- start 2023-08-31T19:00:46.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.272+0000 7f2ce61ff700 1 -- start start 2023-08-31T19:00:46.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.273+0000 7f2ce61ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ce00c6f20 0x7f2ce00c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.273+0000 7f2ce61ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce01575b0 0x7f2ce0153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.273+0000 7f2ce61ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ce01581d0 0x7f2ce00bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.273+0000 7f2ce61ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce00ae1f0 con 0x7f2ce01581d0 2023-08-31T19:00:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.273+0000 7f2ce61ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce0168b70 con 0x7f2ce00c6f20 2023-08-31T19:00:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.273+0000 7f2ce61ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce0167d10 con 0x7f2ce01575b0 2023-08-31T19:00:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.273+0000 7f2cdffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ce01581d0 0x7f2ce00bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.273+0000 7f2cdf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ce00c6f20 0x7f2ce00c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.273+0000 7f2cdeffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce01575b0 0x7f2ce0153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.273+0000 7f2cdf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ce00c6f20 0x7f2ce00c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:52270/0 (socket says 172.21.15.72:52270) 2023-08-31T19:00:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.273+0000 7f2cdffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ce01581d0 0x7f2ce00bfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55252/0 (socket says 172.21.15.72:55252) 2023-08-31T19:00:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.273+0000 7f2cdf7fe700 1 -- 172.21.15.72:0/401072408 learned_addr learned my addr 172.21.15.72:0/401072408 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.274+0000 7f2cdffff700 1 -- 172.21.15.72:0/401072408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce01575b0 msgr2=0x7f2ce0153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.274+0000 7f2cdffff700 1 --2- 172.21.15.72:0/401072408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce01575b0 0x7f2ce0153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.274+0000 7f2cdffff700 1 -- 172.21.15.72:0/401072408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ce00c6f20 msgr2=0x7f2ce00c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.274+0000 7f2cdffff700 1 --2- 172.21.15.72:0/401072408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ce00c6f20 0x7f2ce00c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.274+0000 7f2cdffff700 1 -- 172.21.15.72:0/401072408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd0009250 con 0x7f2ce01581d0 2023-08-31T19:00:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.274+0000 7f2cdffff700 1 --2- 172.21.15.72:0/401072408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ce01581d0 0x7f2ce00bfcf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f2cd800ecc0 tx=0x7f2cd800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.274+0000 7f2cc77fe700 1 -- 172.21.15.72:0/401072408 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd800c8c0 con 0x7f2ce01581d0 2023-08-31T19:00:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.274+0000 7f2cc77fe700 1 -- 172.21.15.72:0/401072408 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd800f040 con 0x7f2ce01581d0 2023-08-31T19:00:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.274+0000 7f2cc77fe700 1 -- 172.21.15.72:0/401072408 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd800cc30 con 0x7f2ce01581d0 2023-08-31T19:00:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.274+0000 7f2ce61ff700 1 -- 172.21.15.72:0/401072408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce0167f60 con 0x7f2ce01581d0 2023-08-31T19:00:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.274+0000 7f2ce61ff700 1 -- 172.21.15.72:0/401072408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce0168520 con 0x7f2ce01581d0 2023-08-31T19:00:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.275+0000 7f2ce61ff700 1 -- 172.21.15.72:0/401072408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce006c6b0 con 0x7f2ce01581d0 2023-08-31T19:00:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.277+0000 7f2cc77fe700 1 -- 172.21.15.72:0/401072408 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 11) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f2cd801d460 con 0x7f2ce01581d0 2023-08-31T19:00:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.278+0000 7f2cc77fe700 1 --2- 172.21.15.72:0/401072408 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2ccc05ef30 0x7f2ccc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.278+0000 7f2cc77fe700 1 -- 172.21.15.72:0/401072408 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6938+0+0 (secure 0 0 0) 0x7f2cd807a920 con 0x7f2ce01581d0 2023-08-31T19:00:46.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.278+0000 7f2cdf7fe700 1 -- 172.21.15.72:0/401072408 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2ccc05ef30 msgr2=0x7f2ccc0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:00:46.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.278+0000 7f2cdf7fe700 1 --2- 172.21.15.72:0/401072408 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2ccc05ef30 0x7f2ccc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:00:46.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.282+0000 7f2cc77fe700 1 -- 172.21.15.72:0/401072408 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2cd804b880 con 0x7f2ce01581d0 2023-08-31T19:00:46.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.458+0000 7f2ce61ff700 1 -- 172.21.15.72:0/401072408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ce00cb6b0 con 0x7f2ce01581d0 2023-08-31T19:00:46.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.459+0000 7f2cc77fe700 1 -- 172.21.15.72:0/401072408 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+18275 (secure 0 0 0) 0x7f2cd804eea0 con 0x7f2ce01581d0 2023-08-31T19:00:46.460 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:46.460 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":47,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:00:44.444491+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:48:49.967130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T18:48:50.880157+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":47,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1a","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6833/143463":"2023-09-01T18:49:10.496601+0000","172.21.15.72:6832/143463":"2023-09-01T18:49:10.496601+0000","172.21.15.72:0/1955814246":"2023-09-01T18:49:10.496601+0000","172.21.15.72:0/3497520169":"2023-09-01T18:49:10.496601+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":104,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:00:46.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.461+0000 7f2ce61ff700 1 -- 172.21.15.72:0/401072408 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2ccc05ef30 msgr2=0x7f2ccc0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:00:46.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.461+0000 7f2ce61ff700 1 --2- 172.21.15.72:0/401072408 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2ccc05ef30 0x7f2ccc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:46.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.461+0000 7f2ce61ff700 1 -- 172.21.15.72:0/401072408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ce01581d0 msgr2=0x7f2ce00bfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:46.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.461+0000 7f2ce61ff700 1 --2- 172.21.15.72:0/401072408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ce01581d0 0x7f2ce00bfcf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f2cd800ecc0 tx=0x7f2cd800b040).stop 2023-08-31T19:00:46.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.462+0000 7f2ce61ff700 1 -- 172.21.15.72:0/401072408 shutdown_connections 2023-08-31T19:00:46.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.462+0000 7f2ce61ff700 1 --2- 172.21.15.72:0/401072408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ce01581d0 0x7f2ce00bfcf0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.462+0000 7f2ce61ff700 1 --2- 172.21.15.72:0/401072408 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2ccc05ef30 0x7f2ccc0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:46.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.462+0000 7f2ce61ff700 1 --2- 172.21.15.72:0/401072408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ce00c6f20 0x7f2ce00c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.462+0000 7f2ce61ff700 1 --2- 172.21.15.72:0/401072408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ce01575b0 0x7f2ce0153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.462+0000 7f2ce61ff700 1 -- 172.21.15.72:0/401072408 >> 172.21.15.72:0/401072408 conn(0x7f2ce005e870 msgr2=0x7f2ce01548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:46.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.462+0000 7f2ce61ff700 1 -- 172.21.15.72:0/401072408 shutdown_connections 2023-08-31T19:00:46.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.462+0000 7f2ce61ff700 1 -- 172.21.15.72:0/401072408 wait complete. 2023-08-31T19:00:46.480 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T19:00:46.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:00:46.633 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:46.633+0000 7f84b7b76680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:00:46.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.676+0000 7f0dfedff700 1 Processor -- start 2023-08-31T19:00:46.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.677+0000 7f0dfedff700 1 -- start start 2023-08-31T19:00:46.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.678+0000 7f0dfedff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0df81541a0 0x7f0df80c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:46.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.678+0000 7f0dfedff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0df80bf460 0x7f0df80c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:46.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.678+0000 7f0dfedff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0df80c4300 0x7f0df80be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:46.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.678+0000 7f0dfedff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df80c47b0 con 0x7f0df80bf460 2023-08-31T19:00:46.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.678+0000 7f0dfedff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df80c5950 con 0x7f0df80c4300 2023-08-31T19:00:46.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.678+0000 7f0dfedff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80c5c30 con 0x7f0df81541a0 2023-08-31T19:00:46.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.678+0000 7f0df7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0df80bf460 0x7f0df80c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:46.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.678+0000 7f0dfcb9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0df81541a0 0x7f0df80c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:46.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.678+0000 7f0df7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0df80bf460 0x7f0df80c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55262/0 (socket says 172.21.15.72:55262) 2023-08-31T19:00:46.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.678+0000 7f0df7fff700 1 -- 172.21.15.72:0/730177114 learned_addr learned my addr 172.21.15.72:0/730177114 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:46.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.678+0000 7f0dfd39c700 1 --2- 172.21.15.72:0/730177114 >> v2:172.21.15.146:3300/0 conn(0x7f0df80c4300 0x7f0df80be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:46.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.679+0000 7f0df7fff700 1 -- 172.21.15.72:0/730177114 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0df81541a0 msgr2=0x7f0df80c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:46.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.679+0000 7f0df7fff700 1 --2- 172.21.15.72:0/730177114 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0df81541a0 0x7f0df80c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.679+0000 7f0df7fff700 1 -- 172.21.15.72:0/730177114 >> v2:172.21.15.146:3300/0 conn(0x7f0df80c4300 msgr2=0x7f0df80be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.679+0000 7f0df7fff700 1 --2- 172.21.15.72:0/730177114 >> v2:172.21.15.146:3300/0 conn(0x7f0df80c4300 0x7f0df80be2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.679+0000 7f0df7fff700 1 -- 172.21.15.72:0/730177114 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df80c5f10 con 0x7f0df80bf460 2023-08-31T19:00:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.679+0000 7f0df7fff700 1 --2- 172.21.15.72:0/730177114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df80bf460 0x7f0df80c3e10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f0de4006fd0 tx=0x7f0de40090f0).ready entity=mon.0 client_cookie=e6391c0445dbe371 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.679+0000 7f0df77fe700 1 -- 172.21.15.72:0/730177114 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de400f510 con 0x7f0df80bf460 2023-08-31T19:00:46.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.679+0000 7f0df77fe700 1 -- 172.21.15.72:0/730177114 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de400f670 con 0x7f0df80bf460 2023-08-31T19:00:46.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.679+0000 7f0df77fe700 1 -- 172.21.15.72:0/730177114 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de400f9f0 con 0x7f0df80bf460 2023-08-31T19:00:46.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.680+0000 7f0dfedff700 1 -- 172.21.15.72:0/730177114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df80bf460 msgr2=0x7f0df80c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:46.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.680+0000 7f0dfedff700 1 --2- 172.21.15.72:0/730177114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df80bf460 0x7f0df80c3e10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f0de4006fd0 tx=0x7f0de40090f0).stop 2023-08-31T19:00:46.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.680+0000 7f0dfedff700 1 -- 172.21.15.72:0/730177114 shutdown_connections 2023-08-31T19:00:46.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.680+0000 7f0dfedff700 1 --2- 172.21.15.72:0/730177114 >> v2:172.21.15.146:3300/0 conn(0x7f0df80c4300 0x7f0df80be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.680+0000 7f0dfedff700 1 --2- 172.21.15.72:0/730177114 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0df81541a0 0x7f0df80c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.680+0000 7f0dfedff700 1 --2- 172.21.15.72:0/730177114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df80bf460 0x7f0df80c3e10 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.680+0000 7f0dfedff700 1 -- 172.21.15.72:0/730177114 >> 172.21.15.72:0/730177114 conn(0x7f0df8082f60 msgr2=0x7f0df805e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:46.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.680+0000 7f0dfedff700 1 -- 172.21.15.72:0/730177114 shutdown_connections 2023-08-31T19:00:46.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.680+0000 7f0dfedff700 1 -- 172.21.15.72:0/730177114 wait complete. 2023-08-31T19:00:46.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.682+0000 7f0dfedff700 1 Processor -- start 2023-08-31T19:00:46.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.682+0000 7f0dfedff700 1 -- start start 2023-08-31T19:00:46.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.683+0000 7f0dfedff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0df80bf460 0x7f0df81637c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:46.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.683+0000 7f0dfedff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0df80c4300 0x7f0df80aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.683+0000 7f0dfedff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df81541a0 0x7f0df80a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.683+0000 7f0dfedff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df8163cb0 con 0x7f0df81541a0 2023-08-31T19:00:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.683+0000 7f0dfedff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80acf00 con 0x7f0df80bf460 2023-08-31T19:00:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.683+0000 7f0dfedff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80add20 con 0x7f0df80c4300 2023-08-31T19:00:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.683+0000 7f0dfd39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df81541a0 0x7f0df80a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.683+0000 7f0dfd39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df81541a0 0x7f0df80a89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55272/0 (socket says 172.21.15.72:55272) 2023-08-31T19:00:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.683+0000 7f0dfd39c700 1 -- 172.21.15.72:0/4187115470 learned_addr learned my addr 172.21.15.72:0/4187115470 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.683+0000 7f0dfcb9b700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0df80bf460 0x7f0df81637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.683+0000 7f0df7fff700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0df80c4300 0x7f0df80aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:46.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.684+0000 7f0dfd39c700 1 -- 172.21.15.72:0/4187115470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0df80c4300 msgr2=0x7f0df80aca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:46.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.684+0000 7f0dfd39c700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0df80c4300 0x7f0df80aca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.684+0000 7f0dfd39c700 1 -- 172.21.15.72:0/4187115470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0df80bf460 msgr2=0x7f0df81637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.684+0000 7f0dfd39c700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0df80bf460 0x7f0df81637c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.684+0000 7f0dfd39c700 1 -- 172.21.15.72:0/4187115470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de4009370 con 0x7f0df81541a0 2023-08-31T19:00:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.684+0000 7f0dfcb9b700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0df80bf460 0x7f0df81637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:00:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.684+0000 7f0df7fff700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0df80c4300 0x7f0df80aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:00:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.684+0000 7f0dfd39c700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df81541a0 0x7f0df80a89f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f0df0009e90 tx=0x7f0df000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.684+0000 7f0df4ff9700 1 -- 172.21.15.72:0/4187115470 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df000caa0 con 0x7f0df81541a0 2023-08-31T19:00:46.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.684+0000 7f0df4ff9700 1 -- 172.21.15.72:0/4187115470 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df000f040 con 0x7f0df81541a0 2023-08-31T19:00:46.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.684+0000 7f0dfedff700 1 -- 172.21.15.72:0/4187115470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df80ab780 con 0x7f0df81541a0 2023-08-31T19:00:46.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.684+0000 7f0df4ff9700 1 -- 172.21.15.72:0/4187115470 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df000ce10 con 0x7f0df81541a0 2023-08-31T19:00:46.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.684+0000 7f0dfedff700 1 -- 172.21.15.72:0/4187115470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df80ad3f0 con 0x7f0df81541a0 2023-08-31T19:00:46.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.686+0000 7f0dfedff700 1 -- 172.21.15.72:0/4187115470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df806c6b0 con 0x7f0df81541a0 2023-08-31T19:00:46.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.686+0000 7f0df4ff9700 1 -- 172.21.15.72:0/4187115470 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 11) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f0df0013610 con 0x7f0df81541a0 2023-08-31T19:00:46.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.687+0000 7f0df4ff9700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0ddc05ef30 0x7f0ddc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:46.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.687+0000 7f0df4ff9700 1 -- 172.21.15.72:0/4187115470 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6938+0+0 (secure 0 0 0) 0x7f0df007abe0 con 0x7f0df81541a0 2023-08-31T19:00:46.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.687+0000 7f0dfcb9b700 1 -- 172.21.15.72:0/4187115470 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0ddc05ef30 msgr2=0x7f0ddc0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:00:46.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.687+0000 7f0dfcb9b700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0ddc05ef30 0x7f0ddc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:00:46.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.694+0000 7f0df4ff9700 1 -- 172.21.15.72:0/4187115470 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0df004bae0 con 0x7f0df81541a0 2023-08-31T19:00:46.722 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:46.722+0000 7f84b7b76680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:00:46.804 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:46.804+0000 7fcfe17f4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:00:46.814 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:46.814+0000 7f84b7b76680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:00:46.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.888+0000 7f0dfcb9b700 1 -- 172.21.15.72:0/4187115470 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0ddc05ef30 msgr2=0x7f0ddc0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:00:46.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.888+0000 7f0dfcb9b700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0ddc05ef30 0x7f0ddc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:00:46.893 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:46.893+0000 7fcfe17f4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:00:46.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.912+0000 7f0dfedff700 1 -- 172.21.15.72:0/4187115470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0df80ade60 con 0x7f0df81541a0 2023-08-31T19:00:46.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.912+0000 7f0df4ff9700 1 -- 172.21.15.72:0/4187115470 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f0df004f100 con 0x7f0df81541a0 2023-08-31T19:00:46.913 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:46.913 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/682775915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":682775915},{"type":"v1","addr":"172.21.15.146:6835","nonce":682775915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/934559211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":934559211},{"type":"v1","addr":"172.21.15.72:6836","nonce":934559211}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2587704834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2587704834},{"type":"v1","addr":"172.21.15.72:6837","nonce":2587704834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T18:48:51.892123+0000","modified":"2023-08-31T18:48:54.904501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/1295593403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1295593403},{"type":"v1","addr":"172.21.15.146:6834","nonce":1295593403}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-31T19:00:46.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.914+0000 7f0dfedff700 1 -- 172.21.15.72:0/4187115470 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0ddc05ef30 msgr2=0x7f0ddc0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:00:46.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.914+0000 7f0dfedff700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0ddc05ef30 0x7f0ddc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:46.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.914+0000 7f0dfedff700 1 -- 172.21.15.72:0/4187115470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df81541a0 msgr2=0x7f0df80a89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:46.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.914+0000 7f0dfedff700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df81541a0 0x7f0df80a89f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f0df0009e90 tx=0x7f0df000b040).stop 2023-08-31T19:00:46.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.915+0000 7f0dfedff700 1 -- 172.21.15.72:0/4187115470 shutdown_connections 2023-08-31T19:00:46.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.915+0000 7f0dfedff700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0df81541a0 0x7f0df80a89f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.915+0000 7f0dfedff700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0ddc05ef30 0x7f0ddc0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:46.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.915+0000 7f0dfedff700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0df80bf460 0x7f0df81637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.915+0000 7f0dfedff700 1 --2- 172.21.15.72:0/4187115470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0df80c4300 0x7f0df80aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:46.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.915+0000 7f0dfedff700 1 -- 172.21.15.72:0/4187115470 >> 172.21.15.72:0/4187115470 conn(0x7f0df8082f60 msgr2=0x7f0df80c7020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:46.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.915+0000 7f0dfedff700 1 -- 172.21.15.72:0/4187115470 shutdown_connections 2023-08-31T19:00:46.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:46.915+0000 7f0dfedff700 1 -- 172.21.15.72:0/4187115470 wait complete. 2023-08-31T19:00:46.918 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2023-08-31T19:00:46.932 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:00:46.991 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:46.991+0000 7fcfe17f4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:00:46.995 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:46.995+0000 7f84b7b76680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:00:47.083 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:47.083+0000 7f84b7b76680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:00:47.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.125+0000 7f91a59ff700 1 Processor -- start 2023-08-31T19:00:47.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.125+0000 7f91a59ff700 1 -- start start 2023-08-31T19:00:47.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.127+0000 7f91a59ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f91a00a4a00 0x7f91a00a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:47.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.127+0000 7f91a59ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91a00bda40 0x7f91a0064ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:47.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.127+0000 7f91a59ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a00bcb50 con 0x7f91a0065190 2023-08-31T19:00:47.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.127+0000 7f91a59ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a00bbf40 con 0x7f91a00bda40 2023-08-31T19:00:47.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.127+0000 7f91a59ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a00bc220 con 0x7f91a00a4a00 2023-08-31T19:00:47.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.127+0000 7f919e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91a00bda40 0x7f91a0064ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:47.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.127+0000 7f919e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91a00bda40 0x7f91a0064ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55276/0 (socket says 172.21.15.72:55276) 2023-08-31T19:00:47.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.127+0000 7f919e7fc700 1 -- 172.21.15.72:0/2164506159 learned_addr learned my addr 172.21.15.72:0/2164506159 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:47.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.127+0000 7f919effd700 1 --2- 172.21.15.72:0/2164506159 >> v2:172.21.15.146:3300/0 conn(0x7f91a00a4a00 0x7f91a00a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:47.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.127+0000 7f919e7fc700 1 -- 172.21.15.72:0/2164506159 >> v2:172.21.15.146:3300/0 conn(0x7f91a00a4a00 msgr2=0x7f91a00a4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:47.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.127+0000 7f919e7fc700 1 --2- 172.21.15.72:0/2164506159 >> v2:172.21.15.146:3300/0 conn(0x7f91a00a4a00 0x7f91a00a4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.127+0000 7f919e7fc700 1 -- 172.21.15.72:0/2164506159 >> v1:172.21.15.146:6789/0 conn(0x7f91a0065190 legacy=0x7f91a00c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:47.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.127+0000 7f919e7fc700 1 -- 172.21.15.72:0/2164506159 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a00bc500 con 0x7f91a00bda40 2023-08-31T19:00:47.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.127+0000 7f919e7fc700 1 --2- 172.21.15.72:0/2164506159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a00bda40 0x7f91a0064ca0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f91a0061d40 tx=0x7f91940090f0).ready entity=mon.0 client_cookie=d97dd999c4be2419 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:47.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.128+0000 7f919dffb700 1 -- 172.21.15.72:0/2164506159 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919400b600 con 0x7f91a00bda40 2023-08-31T19:00:47.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.128+0000 7f919dffb700 1 -- 172.21.15.72:0/2164506159 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919400b760 con 0x7f91a00bda40 2023-08-31T19:00:47.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.128+0000 7f919dffb700 1 -- 172.21.15.72:0/2164506159 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919400bb00 con 0x7f91a00bda40 2023-08-31T19:00:47.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.128+0000 7f91a59ff700 1 -- 172.21.15.72:0/2164506159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a00bda40 msgr2=0x7f91a0064ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:47.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.128+0000 7f91a59ff700 1 --2- 172.21.15.72:0/2164506159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a00bda40 0x7f91a0064ca0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f91a0061d40 tx=0x7f91940090f0).stop 2023-08-31T19:00:47.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.128+0000 7f91a59ff700 1 -- 172.21.15.72:0/2164506159 shutdown_connections 2023-08-31T19:00:47.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.128+0000 7f91a59ff700 1 --2- 172.21.15.72:0/2164506159 >> v2:172.21.15.146:3300/0 conn(0x7f91a00a4a00 0x7f91a00a4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.128+0000 7f91a59ff700 1 --2- 172.21.15.72:0/2164506159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a00bda40 0x7f91a0064ca0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.128+0000 7f91a59ff700 1 -- 172.21.15.72:0/2164506159 >> 172.21.15.72:0/2164506159 conn(0x7f91a0063120 msgr2=0x7f91a00c6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:47.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.128+0000 7f91a59ff700 1 -- 172.21.15.72:0/2164506159 shutdown_connections 2023-08-31T19:00:47.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.129+0000 7f91a59ff700 1 -- 172.21.15.72:0/2164506159 wait complete. 2023-08-31T19:00:47.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.130+0000 7f91a59ff700 1 Processor -- start 2023-08-31T19:00:47.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.130+0000 7f91a59ff700 1 -- start start 2023-08-31T19:00:47.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.131+0000 7f91a59ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a00a4a00 0x7f91a00c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:47.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.131+0000 7f91a59ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91a00bda40 0x7f91a00a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:47.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.131+0000 7f91a59ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a00a6e30 0x7f91a00aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:47.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.131+0000 7f91a59ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a013a060 con 0x7f91a00a4a00 2023-08-31T19:00:47.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.131+0000 7f91a59ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a00aa5f0 con 0x7f91a00a6e30 2023-08-31T19:00:47.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.131+0000 7f91a59ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a00a72b0 con 0x7f91a00bda40 2023-08-31T19:00:47.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.131+0000 7f919effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a00a4a00 0x7f91a00c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:47.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.131+0000 7f919effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a00a4a00 0x7f91a00c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55288/0 (socket says 172.21.15.72:55288) 2023-08-31T19:00:47.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.131+0000 7f919effd700 1 -- 172.21.15.72:0/2856687949 learned_addr learned my addr 172.21.15.72:0/2856687949 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:47.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.131+0000 7f919e7fc700 1 --2- 172.21.15.72:0/2856687949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91a00bda40 0x7f91a00a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:47.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.132+0000 7f919f7fe700 1 --2- 172.21.15.72:0/2856687949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a00a6e30 0x7f91a00aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:47.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.132+0000 7f919effd700 1 -- 172.21.15.72:0/2856687949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91a00bda40 msgr2=0x7f91a00a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:47.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.132+0000 7f919effd700 1 --2- 172.21.15.72:0/2856687949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91a00bda40 0x7f91a00a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.132+0000 7f919effd700 1 -- 172.21.15.72:0/2856687949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a00a6e30 msgr2=0x7f91a00aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:47.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.132+0000 7f919effd700 1 --2- 172.21.15.72:0/2856687949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a00a6e30 0x7f91a00aa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.132+0000 7f919effd700 1 -- 172.21.15.72:0/2856687949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9194009370 con 0x7f91a00a4a00 2023-08-31T19:00:47.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.132+0000 7f919effd700 1 --2- 172.21.15.72:0/2856687949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a00a4a00 0x7f91a00c6180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f919000d8c0 tx=0x7f9190008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:47.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.132+0000 7f9186ffd700 1 -- 172.21.15.72:0/2856687949 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190011590 con 0x7f91a00a4a00 2023-08-31T19:00:47.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.132+0000 7f9186ffd700 1 -- 172.21.15.72:0/2856687949 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91900116f0 con 0x7f91a00a4a00 2023-08-31T19:00:47.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.132+0000 7f91a59ff700 1 -- 172.21.15.72:0/2856687949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a00c50e0 con 0x7f91a00a4a00 2023-08-31T19:00:47.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.132+0000 7f9186ffd700 1 -- 172.21.15.72:0/2856687949 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190011a70 con 0x7f91a00a4a00 2023-08-31T19:00:47.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.132+0000 7f91a59ff700 1 -- 172.21.15.72:0/2856687949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a00c56a0 con 0x7f91a00a4a00 2023-08-31T19:00:47.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.134+0000 7f91a59ff700 1 -- 172.21.15.72:0/2856687949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a006c6b0 con 0x7f91a00a4a00 2023-08-31T19:00:47.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.134+0000 7f9186ffd700 1 -- 172.21.15.72:0/2856687949 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 11) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f919001c460 con 0x7f91a00a4a00 2023-08-31T19:00:47.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.135+0000 7f9186ffd700 1 --2- 172.21.15.72:0/2856687949 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f918c05ef30 0x7f918c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:47.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.135+0000 7f9186ffd700 1 -- 172.21.15.72:0/2856687949 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6938+0+0 (secure 0 0 0) 0x7f919007a030 con 0x7f91a00a4a00 2023-08-31T19:00:47.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.135+0000 7f919e7fc700 1 -- 172.21.15.72:0/2856687949 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f918c05ef30 msgr2=0x7f918c0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:00:47.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.135+0000 7f919e7fc700 1 --2- 172.21.15.72:0/2856687949 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f918c05ef30 0x7f918c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:00:47.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.139+0000 7f9186ffd700 1 -- 172.21.15.72:0/2856687949 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f919004af90 con 0x7f91a00a4a00 2023-08-31T19:00:47.184 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:47.184+0000 7fcfe17f4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:00:47.225 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:47.225+0000 7f84b7b76680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:00:47.275 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:47.275+0000 7fcfe17f4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:00:47.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.336+0000 7f919e7fc700 1 -- 172.21.15.72:0/2856687949 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f918c05ef30 msgr2=0x7f918c0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:00:47.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.336+0000 7f919e7fc700 1 --2- 172.21.15.72:0/2856687949 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f918c05ef30 0x7f918c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:00:47.355 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:47.355+0000 7f84b7b76680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:00:47.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.358+0000 7f91a59ff700 1 -- 172.21.15.72:0/2856687949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91a00bc7e0 con 0x7f91a00a4a00 2023-08-31T19:00:47.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.359+0000 7f9186ffd700 1 -- 172.21.15.72:0/2856687949 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4489 (secure 0 0 0) 0x7f91a00bc7e0 con 0x7f91a00a4a00 2023-08-31T19:00:47.359 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:47.360 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/682775915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":682775915},{"type":"v1","addr":"172.21.15.146:6835","nonce":682775915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/934559211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":934559211},{"type":"v1","addr":"172.21.15.72:6836","nonce":934559211}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2587704834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2587704834},{"type":"v1","addr":"172.21.15.72:6837","nonce":2587704834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T18:48:51.892123+0000","modified":"2023-08-31T18:48:54.904501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6834/1295593403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1295593403},{"type":"v1","addr":"172.21.15.146:6834","nonce":1295593403}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-31T19:00:47.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.361+0000 7f91a59ff700 1 -- 172.21.15.72:0/2856687949 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f918c05ef30 msgr2=0x7f918c0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:00:47.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.361+0000 7f91a59ff700 1 --2- 172.21.15.72:0/2856687949 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f918c05ef30 0x7f918c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:47.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.361+0000 7f91a59ff700 1 -- 172.21.15.72:0/2856687949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a00a4a00 msgr2=0x7f91a00c6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:47.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.361+0000 7f91a59ff700 1 --2- 172.21.15.72:0/2856687949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a00a4a00 0x7f91a00c6180 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f919000d8c0 tx=0x7f9190008040).stop 2023-08-31T19:00:47.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.361+0000 7f91a59ff700 1 -- 172.21.15.72:0/2856687949 shutdown_connections 2023-08-31T19:00:47.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.361+0000 7f91a59ff700 1 --2- 172.21.15.72:0/2856687949 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f918c05ef30 0x7f918c0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:47.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.361+0000 7f91a59ff700 1 --2- 172.21.15.72:0/2856687949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91a00a6e30 0x7f91a00aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.361+0000 7f91a59ff700 1 --2- 172.21.15.72:0/2856687949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a00a4a00 0x7f91a00c6180 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.361+0000 7f91a59ff700 1 --2- 172.21.15.72:0/2856687949 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91a00bda40 0x7f91a00a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.361+0000 7f91a59ff700 1 -- 172.21.15.72:0/2856687949 >> 172.21.15.72:0/2856687949 conn(0x7f91a0063120 msgr2=0x7f91a0156ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:47.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.361+0000 7f91a59ff700 1 -- 172.21.15.72:0/2856687949 shutdown_connections 2023-08-31T19:00:47.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.361+0000 7f91a59ff700 1 -- 172.21.15.72:0/2856687949 wait complete. 2023-08-31T19:00:47.364 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2023-08-31T19:00:47.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:00:47.430 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:47.430+0000 7fcfe17f4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:00:47.568 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:47.568+0000 7fcfe17f4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:00:47.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.580+0000 7f60b6dff700 1 Processor -- start 2023-08-31T19:00:47.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.580+0000 7f60b6dff700 1 -- start start 2023-08-31T19:00:47.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.581+0000 7f60b6dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f60b00a9eb0 0x7f60b00aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:47.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.581+0000 7f60b6dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b00c5bf0 0x7f60b00c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:47.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.581+0000 7f60b6dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b00bfd00 con 0x7f60b0156fc0 2023-08-31T19:00:47.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.581+0000 7f60b6dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b00c05a0 con 0x7f60b00a9eb0 2023-08-31T19:00:47.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.581+0000 7f60b6dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00aaea0 con 0x7f60b00c5bf0 2023-08-31T19:00:47.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.581+0000 7f60b539c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f60b0156fc0 0x7f60b0157450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51372/0 (socket says 172.21.15.72:51372) 2023-08-31T19:00:47.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.582+0000 7f60b539c700 1 -- 172.21.15.72:0/1521023797 learned_addr learned my addr 172.21.15.72:0/1521023797 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:47.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.582+0000 7f60b4b9b700 1 --2- 172.21.15.72:0/1521023797 >> v2:172.21.15.146:3300/0 conn(0x7f60b00a9eb0 0x7f60b00aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:47.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.582+0000 7f60affff700 1 --2- 172.21.15.72:0/1521023797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b00c5bf0 0x7f60b00c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:47.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.582+0000 7f60af7fe700 1 -- 172.21.15.72:0/1521023797 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532781980 0 0) 0x7f60b00bfd00 con 0x7f60b0156fc0 2023-08-31T19:00:47.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.582+0000 7f60af7fe700 1 -- 172.21.15.72:0/1521023797 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a00033f0 con 0x7f60b0156fc0 2023-08-31T19:00:47.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.582+0000 7f60b4b9b700 1 -- 172.21.15.72:0/1521023797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b00c5bf0 msgr2=0x7f60b00c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:47.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.582+0000 7f60b4b9b700 1 --2- 172.21.15.72:0/1521023797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b00c5bf0 0x7f60b00c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.582+0000 7f60b4b9b700 1 -- 172.21.15.72:0/1521023797 >> v1:172.21.15.72:6789/0 conn(0x7f60b0156fc0 legacy=0x7f60b0157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:47.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.582+0000 7f60b4b9b700 1 -- 172.21.15.72:0/1521023797 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b00c6670 con 0x7f60b00a9eb0 2023-08-31T19:00:47.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.582+0000 7f60affff700 1 --2- 172.21.15.72:0/1521023797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b00c5bf0 0x7f60b00c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:00:47.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.582+0000 7f60b4b9b700 1 --2- 172.21.15.72:0/1521023797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b00a9eb0 0x7f60b00aa290 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f60a4009760 tx=0x7f60a4009060).ready entity=mon.1 client_cookie=c99d67b85396827b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:47.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.583+0000 7f60af7fe700 1 -- 172.21.15.72:0/1521023797 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a400d4a0 con 0x7f60b00a9eb0 2023-08-31T19:00:47.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.583+0000 7f60af7fe700 1 -- 172.21.15.72:0/1521023797 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a400d600 con 0x7f60b00a9eb0 2023-08-31T19:00:47.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.583+0000 7f60af7fe700 1 -- 172.21.15.72:0/1521023797 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a400d980 con 0x7f60b00a9eb0 2023-08-31T19:00:47.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.583+0000 7f60b6dff700 1 -- 172.21.15.72:0/1521023797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b00a9eb0 msgr2=0x7f60b00aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:47.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.583+0000 7f60b6dff700 1 --2- 172.21.15.72:0/1521023797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b00a9eb0 0x7f60b00aa290 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f60a4009760 tx=0x7f60a4009060).stop 2023-08-31T19:00:47.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.583+0000 7f60b6dff700 1 -- 172.21.15.72:0/1521023797 shutdown_connections 2023-08-31T19:00:47.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.583+0000 7f60b6dff700 1 --2- 172.21.15.72:0/1521023797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b00a9eb0 0x7f60b00aa290 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.583+0000 7f60b6dff700 1 --2- 172.21.15.72:0/1521023797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b00c5bf0 0x7f60b00c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.583+0000 7f60b6dff700 1 -- 172.21.15.72:0/1521023797 >> 172.21.15.72:0/1521023797 conn(0x7f60b00c82e0 msgr2=0x7f60b005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:47.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.583+0000 7f60b6dff700 1 -- 172.21.15.72:0/1521023797 shutdown_connections 2023-08-31T19:00:47.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.583+0000 7f60b6dff700 1 -- 172.21.15.72:0/1521023797 wait complete. 2023-08-31T19:00:47.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.585+0000 7f60b6dff700 1 Processor -- start 2023-08-31T19:00:47.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.585+0000 7f60b6dff700 1 -- start start 2023-08-31T19:00:47.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.586+0000 7f60b6dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b00a9eb0 0x7f60b01564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:47.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.586+0000 7f60b6dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b00c5bf0 0x7f60b00af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:47.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.586+0000 7f60b6dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b0156fc0 0x7f60b0164450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:47.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.586+0000 7f60b6dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b0153bb0 con 0x7f60b00c5bf0 2023-08-31T19:00:47.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.586+0000 7f60b6dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00afcd0 con 0x7f60b00a9eb0 2023-08-31T19:00:47.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.586+0000 7f60b6dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00affb0 con 0x7f60b0156fc0 2023-08-31T19:00:47.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.586+0000 7f60affff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b00c5bf0 0x7f60b00af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:47.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.586+0000 7f60affff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b00c5bf0 0x7f60b00af3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55304/0 (socket says 172.21.15.72:55304) 2023-08-31T19:00:47.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.586+0000 7f60affff700 1 -- 172.21.15.72:0/4148255190 learned_addr learned my addr 172.21.15.72:0/4148255190 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:47.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.586+0000 7f60b4b9b700 1 --2- 172.21.15.72:0/4148255190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b00a9eb0 0x7f60b01564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:47.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.586+0000 7f60b539c700 1 --2- 172.21.15.72:0/4148255190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b0156fc0 0x7f60b0164450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.586+0000 7f60affff700 1 -- 172.21.15.72:0/4148255190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b0156fc0 msgr2=0x7f60b0164450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.586+0000 7f60affff700 1 --2- 172.21.15.72:0/4148255190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b0156fc0 0x7f60b0164450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.586+0000 7f60affff700 1 -- 172.21.15.72:0/4148255190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b00a9eb0 msgr2=0x7f60b01564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.587+0000 7f60affff700 1 --2- 172.21.15.72:0/4148255190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b00a9eb0 0x7f60b01564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.587+0000 7f60affff700 1 -- 172.21.15.72:0/4148255190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c0092a0 con 0x7f60b00c5bf0 2023-08-31T19:00:47.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.587+0000 7f60affff700 1 --2- 172.21.15.72:0/4148255190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b00c5bf0 0x7f60b00af3a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f609c00ea20 tx=0x7f609c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:47.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.587+0000 7f60acff9700 1 -- 172.21.15.72:0/4148255190 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c00ee60 con 0x7f60b00c5bf0 2023-08-31T19:00:47.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.587+0000 7f60acff9700 1 -- 172.21.15.72:0/4148255190 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c00c850 con 0x7f60b00c5bf0 2023-08-31T19:00:47.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.587+0000 7f60b6dff700 1 -- 172.21.15.72:0/4148255190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a40092a0 con 0x7f60b00c5bf0 2023-08-31T19:00:47.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.587+0000 7f60acff9700 1 -- 172.21.15.72:0/4148255190 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c00cbd0 con 0x7f60b00c5bf0 2023-08-31T19:00:47.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.587+0000 7f60b6dff700 1 -- 172.21.15.72:0/4148255190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b00b0570 con 0x7f60b00c5bf0 2023-08-31T19:00:47.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.588+0000 7f60b6dff700 1 -- 172.21.15.72:0/4148255190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b00ac4c0 con 0x7f60b00c5bf0 2023-08-31T19:00:47.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.590+0000 7f60acff9700 1 -- 172.21.15.72:0/4148255190 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 11) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f609c01b400 con 0x7f60b00c5bf0 2023-08-31T19:00:47.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.591+0000 7f60acff9700 1 --2- 172.21.15.72:0/4148255190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f609405ef30 0x7f60940613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:47.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.591+0000 7f60acff9700 1 -- 172.21.15.72:0/4148255190 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6938+0+0 (secure 0 0 0) 0x7f609c07a870 con 0x7f60b00c5bf0 2023-08-31T19:00:47.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.591+0000 7f60b4b9b700 1 -- 172.21.15.72:0/4148255190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f609405ef30 msgr2=0x7f60940613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:00:47.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.591+0000 7f60b4b9b700 1 --2- 172.21.15.72:0/4148255190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f609405ef30 0x7f60940613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:00:47.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.595+0000 7f60acff9700 1 -- 172.21.15.72:0/4148255190 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f609c04b890 con 0x7f60b00c5bf0 2023-08-31T19:00:47.703 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:47.703+0000 7f84b7b76680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:00:47.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.771+0000 7f60b6dff700 1 -- 172.21.15.72:0/4148255190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60b006c6b0 con 0x7f60b00c5bf0 2023-08-31T19:00:47.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.772+0000 7f60acff9700 1 -- 172.21.15.72:0/4148255190 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+18275 (secure 0 0 0) 0x7f609c04eeb0 con 0x7f60b00c5bf0 2023-08-31T19:00:47.773 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:47.773 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":47,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:00:44.444491+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T18:48:49.967130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T18:48:50.880157+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":47,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1a","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6833/143463":"2023-09-01T18:49:10.496601+0000","172.21.15.72:6832/143463":"2023-09-01T18:49:10.496601+0000","172.21.15.72:0/1955814246":"2023-09-01T18:49:10.496601+0000","172.21.15.72:0/3497520169":"2023-09-01T18:49:10.496601+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":104,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:00:47.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.775+0000 7f60b6dff700 1 -- 172.21.15.72:0/4148255190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f609405ef30 msgr2=0x7f60940613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:00:47.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.775+0000 7f60b6dff700 1 --2- 172.21.15.72:0/4148255190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f609405ef30 0x7f60940613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:47.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.775+0000 7f60b6dff700 1 -- 172.21.15.72:0/4148255190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b00c5bf0 msgr2=0x7f60b00af3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:47.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.775+0000 7f60b6dff700 1 --2- 172.21.15.72:0/4148255190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b00c5bf0 0x7f60b00af3a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f609c00ea20 tx=0x7f609c009060).stop 2023-08-31T19:00:47.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.775+0000 7f60b6dff700 1 -- 172.21.15.72:0/4148255190 shutdown_connections 2023-08-31T19:00:47.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.775+0000 7f60b6dff700 1 --2- 172.21.15.72:0/4148255190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60b0156fc0 0x7f60b0164450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.775+0000 7f60b6dff700 1 --2- 172.21.15.72:0/4148255190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f609405ef30 0x7f60940613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:47.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.775+0000 7f60b6dff700 1 --2- 172.21.15.72:0/4148255190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b00a9eb0 0x7f60b01564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.775+0000 7f60b6dff700 1 --2- 172.21.15.72:0/4148255190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60b00c5bf0 0x7f60b00af3a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:47.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.775+0000 7f60b6dff700 1 -- 172.21.15.72:0/4148255190 >> 172.21.15.72:0/4148255190 conn(0x7f60b00c82e0 msgr2=0x7f60b00ab740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:47.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.775+0000 7f60b6dff700 1 -- 172.21.15.72:0/4148255190 shutdown_connections 2023-08-31T19:00:47.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:47.775+0000 7f60b6dff700 1 -- 172.21.15.72:0/4148255190 wait complete. 2023-08-31T19:00:47.790 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:00:47.790+0000 7f84b7b76680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:00:47.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T19:00:47.932 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:47.932+0000 7fcfe17f4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:00:48.024 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:48.024+0000 7fcfe17f4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:00:48.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.026+0000 7f2771dff700 1 Processor -- start 2023-08-31T19:00:48.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.027+0000 7f2771dff700 1 -- start start 2023-08-31T19:00:48.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.029+0000 7f2771dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f276c1580c0 0x7f276c0bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:48.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.029+0000 7f2771dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f276c153e10 0x7f276c1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:48.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.029+0000 7f2771dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276c069890 con 0x7f276c069410 2023-08-31T19:00:48.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.029+0000 7f2771dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276c069ae0 con 0x7f276c153e10 2023-08-31T19:00:48.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.029+0000 7f2771dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276c062880 con 0x7f276c1580c0 2023-08-31T19:00:48.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.029+0000 7f276affd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f276c069410 0x7f276c1584a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51386/0 (socket says 172.21.15.72:51386) 2023-08-31T19:00:48.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.029+0000 7f276affd700 1 -- 172.21.15.72:0/4035206166 learned_addr learned my addr 172.21.15.72:0/4035206166 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:48.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.029+0000 7f276b7fe700 1 --2- 172.21.15.72:0/4035206166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f276c1580c0 0x7f276c0bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:48.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.029+0000 7f276bfff700 1 --2- 172.21.15.72:0/4035206166 >> v2:172.21.15.146:3300/0 conn(0x7f276c153e10 0x7f276c1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:48.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.029+0000 7f276a7fc700 1 -- 172.21.15.72:0/4035206166 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658699129 0 0) 0x7f276c069890 con 0x7f276c069410 2023-08-31T19:00:48.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.029+0000 7f276a7fc700 1 -- 172.21.15.72:0/4035206166 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27540033f0 con 0x7f276c069410 2023-08-31T19:00:48.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.030+0000 7f276b7fe700 1 -- 172.21.15.72:0/4035206166 >> v2:172.21.15.146:3300/0 conn(0x7f276c153e10 msgr2=0x7f276c1542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:48.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.030+0000 7f276b7fe700 1 --2- 172.21.15.72:0/4035206166 >> v2:172.21.15.146:3300/0 conn(0x7f276c153e10 0x7f276c1542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:48.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.030+0000 7f276b7fe700 1 -- 172.21.15.72:0/4035206166 >> v1:172.21.15.72:6789/0 conn(0x7f276c069410 legacy=0x7f276c1584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:48.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.030+0000 7f276b7fe700 1 -- 172.21.15.72:0/4035206166 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c063f50 con 0x7f276c1580c0 2023-08-31T19:00:48.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.030+0000 7f276bfff700 1 --2- 172.21.15.72:0/4035206166 >> v2:172.21.15.146:3300/0 conn(0x7f276c153e10 0x7f276c1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:00:48.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.030+0000 7f276b7fe700 1 --2- 172.21.15.72:0/4035206166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f276c1580c0 0x7f276c0bc300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f275c006fd0 tx=0x7f275c006f40).ready entity=mon.2 client_cookie=25835a738f41e9aa server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:48.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.030+0000 7f276a7fc700 1 -- 172.21.15.72:0/4035206166 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c005880 con 0x7f276c1580c0 2023-08-31T19:00:48.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.030+0000 7f276a7fc700 1 -- 172.21.15.72:0/4035206166 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c0059e0 con 0x7f276c1580c0 2023-08-31T19:00:48.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.030+0000 7f276a7fc700 1 -- 172.21.15.72:0/4035206166 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c005d60 con 0x7f276c1580c0 2023-08-31T19:00:48.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.031+0000 7f2771dff700 1 -- 172.21.15.72:0/4035206166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f276c1580c0 msgr2=0x7f276c0bc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:48.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.031+0000 7f2771dff700 1 --2- 172.21.15.72:0/4035206166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f276c1580c0 0x7f276c0bc300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f275c006fd0 tx=0x7f275c006f40).stop 2023-08-31T19:00:48.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.031+0000 7f2771dff700 1 -- 172.21.15.72:0/4035206166 shutdown_connections 2023-08-31T19:00:48.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.031+0000 7f2771dff700 1 --2- 172.21.15.72:0/4035206166 >> v2:172.21.15.146:3300/0 conn(0x7f276c153e10 0x7f276c1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:48.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.031+0000 7f2771dff700 1 --2- 172.21.15.72:0/4035206166 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f276c1580c0 0x7f276c0bc300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:48.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.031+0000 7f2771dff700 1 -- 172.21.15.72:0/4035206166 >> 172.21.15.72:0/4035206166 conn(0x7f276c0c73a0 msgr2=0x7f276c0c77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:48.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.031+0000 7f2771dff700 1 -- 172.21.15.72:0/4035206166 shutdown_connections 2023-08-31T19:00:48.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.031+0000 7f2771dff700 1 -- 172.21.15.72:0/4035206166 wait complete. 2023-08-31T19:00:48.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.033+0000 7f2771dff700 1 Processor -- start 2023-08-31T19:00:48.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.033+0000 7f2771dff700 1 -- start start 2023-08-31T19:00:48.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.034+0000 7f2771dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f276c069410 0x7f276c148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:48.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.034+0000 7f2771dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c153e10 0x7f276c0c0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:48.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.034+0000 7f2771dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f276c1580c0 0x7f276c0c0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:48.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.034+0000 7f2771dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c0c0ab0 con 0x7f276c153e10 2023-08-31T19:00:48.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.034+0000 7f2771dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c0c0d90 con 0x7f276c1580c0 2023-08-31T19:00:48.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.034+0000 7f2771dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276c0c1070 con 0x7f276c069410 2023-08-31T19:00:48.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.034+0000 7f276affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c153e10 0x7f276c0c0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:48.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.034+0000 7f276affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c153e10 0x7f276c0c0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55320/0 (socket says 172.21.15.72:55320) 2023-08-31T19:00:48.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.034+0000 7f276affd700 1 -- 172.21.15.72:0/1969239870 learned_addr learned my addr 172.21.15.72:0/1969239870 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:48.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.034+0000 7f276b7fe700 1 --2- 172.21.15.72:0/1969239870 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f276c069410 0x7f276c148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:48.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.034+0000 7f276bfff700 1 --2- 172.21.15.72:0/1969239870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f276c1580c0 0x7f276c0c0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:48.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.035+0000 7f276affd700 1 -- 172.21.15.72:0/1969239870 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f276c069410 msgr2=0x7f276c148e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:48.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.035+0000 7f276affd700 1 --2- 172.21.15.72:0/1969239870 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f276c069410 0x7f276c148e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:48.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.035+0000 7f276affd700 1 -- 172.21.15.72:0/1969239870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f276c1580c0 msgr2=0x7f276c0c0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:48.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.035+0000 7f276affd700 1 --2- 172.21.15.72:0/1969239870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f276c1580c0 0x7f276c0c0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:48.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.035+0000 7f276affd700 1 -- 172.21.15.72:0/1969239870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2764009a20 con 0x7f276c153e10 2023-08-31T19:00:48.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.035+0000 7f276affd700 1 --2- 172.21.15.72:0/1969239870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c153e10 0x7f276c0c0030 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f276000c4c0 tx=0x7f2760007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:48.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.036+0000 7f27537fe700 1 -- 172.21.15.72:0/1969239870 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27600072e0 con 0x7f276c153e10 2023-08-31T19:00:48.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.036+0000 7f27537fe700 1 -- 172.21.15.72:0/1969239870 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2760007440 con 0x7f276c153e10 2023-08-31T19:00:48.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.036+0000 7f27537fe700 1 -- 172.21.15.72:0/1969239870 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27600057a0 con 0x7f276c153e10 2023-08-31T19:00:48.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.036+0000 7f2771dff700 1 -- 172.21.15.72:0/1969239870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275c009250 con 0x7f276c153e10 2023-08-31T19:00:48.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.036+0000 7f2771dff700 1 -- 172.21.15.72:0/1969239870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276c0c1630 con 0x7f276c153e10 2023-08-31T19:00:48.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.038+0000 7f2771dff700 1 -- 172.21.15.72:0/1969239870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276c0c17f0 con 0x7f276c153e10 2023-08-31T19:00:48.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.040+0000 7f27537fe700 1 -- 172.21.15.72:0/1969239870 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 12) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f2760005bd0 con 0x7f276c153e10 2023-08-31T19:00:48.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.042+0000 7f27537fe700 1 -- 172.21.15.72:0/1969239870 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 7066+0+0 (secure 0 0 0) 0x7f2760079780 con 0x7f276c153e10 2023-08-31T19:00:48.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.047+0000 7f27537fe700 1 -- 172.21.15.72:0/1969239870 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f276004a900 con 0x7f276c153e10 2023-08-31T19:00:48.108 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:48.107+0000 7fcf5a30d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:00:48.108 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:48.107+0000 7fcf5a30d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:00:48.109 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:48.107+0000 7fcf5d313700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:00:48.109 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:48.107+0000 7fcf5d313700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:00:48.109 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:48.107+0000 7fcf5a30d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:00:48.109 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:48.107+0000 7fcf5a30d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:00:48.109 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:48.107+0000 7fcf5a30d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:00:48.110 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:48.107+0000 7fcf5d313700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:00:48.110 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:48.107+0000 7fcf5d313700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:00:48.110 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:00:48.107+0000 7fcf5d313700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:00:48.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:48.273+0000 7f2771dff700 1 -- 172.21.15.72:0/1969239870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f276c0c7ed0 con 0x7f276c153e10 2023-08-31T19:00:48.674 INFO:tasks.ceph.mds.b.smithi146.stderr:2023-08-31T19:00:48.674+0000 7fb31d7ea700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-31T19:00:48.698 INFO:tasks.ceph.mds.b.smithi146.stderr: -1> 2023-08-31T19:00:48.674+0000 7fb31d7ea700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-31T19:00:48.734 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-08-31T19:00:49.031 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-08-31T19:00:49.031+0000 7f89d2ff7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T19:00:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.035+0000 7f27537fe700 1 -- 172.21.15.72:0/1969239870 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2760007d90 con 0x7f276c153e10 2023-08-31T19:00:49.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.037+0000 7f2771dff700 1 -- 172.21.15.72:0/1969239870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c153e10 msgr2=0x7f276c0c0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:49.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.037+0000 7f2771dff700 1 --2- 172.21.15.72:0/1969239870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c153e10 0x7f276c0c0030 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f276000c4c0 tx=0x7f2760007c50).stop 2023-08-31T19:00:49.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.037+0000 7f2771dff700 1 -- 172.21.15.72:0/1969239870 shutdown_connections 2023-08-31T19:00:49.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.037+0000 7f2771dff700 1 --2- 172.21.15.72:0/1969239870 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f276c1580c0 0x7f276c0c0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.037+0000 7f2771dff700 1 --2- 172.21.15.72:0/1969239870 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f276c069410 0x7f276c148e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.037+0000 7f2771dff700 1 --2- 172.21.15.72:0/1969239870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276c153e10 0x7f276c0c0030 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.037+0000 7f2771dff700 1 -- 172.21.15.72:0/1969239870 >> 172.21.15.72:0/1969239870 conn(0x7f276c0c73a0 msgr2=0x7f276c0c5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.038+0000 7f2771dff700 1 -- 172.21.15.72:0/1969239870 shutdown_connections 2023-08-31T19:00:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.038+0000 7f2771dff700 1 -- 172.21.15.72:0/1969239870 wait complete. 2023-08-31T19:00:49.040 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T19:00:49.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T19:00:49.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.255+0000 7f0d933ff700 1 Processor -- start 2023-08-31T19:00:49.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.255+0000 7f0d933ff700 1 -- start start 2023-08-31T19:00:49.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.256+0000 7f0d933ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d8c0690e0 0x7f0d8c05e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:49.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.256+0000 7f0d933ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8c0bc4a0 con 0x7f0d8c0c38d0 2023-08-31T19:00:49.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.256+0000 7f0d933ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8c069c40 con 0x7f0d8c1544e0 2023-08-31T19:00:49.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.256+0000 7f0d933ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8c05e840 con 0x7f0d8c0690e0 2023-08-31T19:00:49.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.257+0000 7f0d9099a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d8c0690e0 0x7f0d8c05e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:49.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.257+0000 7f0d9199c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0d8c0c38d0 0x7f0d8c0bc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51388/0 (socket says 172.21.15.72:51388) 2023-08-31T19:00:49.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.257+0000 7f0d9199c700 1 -- 172.21.15.72:0/886701473 learned_addr learned my addr 172.21.15.72:0/886701473 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:49.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.257+0000 7f0d83fff700 1 -- 172.21.15.72:0/886701473 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566035976 0 0) 0x7f0d8c0bc4a0 con 0x7f0d8c0c38d0 2023-08-31T19:00:49.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.257+0000 7f0d83fff700 1 -- 172.21.15.72:0/886701473 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d780033f0 con 0x7f0d8c0c38d0 2023-08-31T19:00:49.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.257+0000 7f0d83fff700 1 -- 172.21.15.72:0/886701473 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289810705 0 0) 0x7f0d8c069c40 con 0x7f0d8c1544e0 2023-08-31T19:00:49.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.257+0000 7f0d9099a700 1 -- 172.21.15.72:0/886701473 >> v1:172.21.15.146:6789/0 conn(0x7f0d8c1544e0 legacy=0x7f0d8c0689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:49.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.257+0000 7f0d9099a700 1 -- 172.21.15.72:0/886701473 >> v1:172.21.15.72:6789/0 conn(0x7f0d8c0c38d0 legacy=0x7f0d8c0bc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:49.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.257+0000 7f0d9099a700 1 -- 172.21.15.72:0/886701473 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c0c1c30 con 0x7f0d8c0690e0 2023-08-31T19:00:49.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.257+0000 7f0d9099a700 1 --2- 172.21.15.72:0/886701473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d8c0690e0 0x7f0d8c05e350 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f0d7c009760 tx=0x7f0d7c009060).ready entity=mon.0 client_cookie=7403b989f106ff23 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:49.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.258+0000 7f0d83fff700 1 -- 172.21.15.72:0/886701473 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0090d0 con 0x7f0d8c0690e0 2023-08-31T19:00:49.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.258+0000 7f0d83fff700 1 -- 172.21.15.72:0/886701473 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c00f510 con 0x7f0d8c0690e0 2023-08-31T19:00:49.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.258+0000 7f0d83fff700 1 -- 172.21.15.72:0/886701473 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00f890 con 0x7f0d8c0690e0 2023-08-31T19:00:49.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.258+0000 7f0d933ff700 1 -- 172.21.15.72:0/886701473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d8c0690e0 msgr2=0x7f0d8c05e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:49.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.258+0000 7f0d933ff700 1 --2- 172.21.15.72:0/886701473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d8c0690e0 0x7f0d8c05e350 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f0d7c009760 tx=0x7f0d7c009060).stop 2023-08-31T19:00:49.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.258+0000 7f0d933ff700 1 -- 172.21.15.72:0/886701473 shutdown_connections 2023-08-31T19:00:49.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.258+0000 7f0d933ff700 1 --2- 172.21.15.72:0/886701473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d8c0690e0 0x7f0d8c05e350 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:49.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.258+0000 7f0d933ff700 1 -- 172.21.15.72:0/886701473 >> 172.21.15.72:0/886701473 conn(0x7f0d8c0c7e00 msgr2=0x7f0d8c0c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:49.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.258+0000 7f0d933ff700 1 -- 172.21.15.72:0/886701473 shutdown_connections 2023-08-31T19:00:49.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.258+0000 7f0d933ff700 1 -- 172.21.15.72:0/886701473 wait complete. 2023-08-31T19:00:49.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.260+0000 7f0d933ff700 1 Processor -- start 2023-08-31T19:00:49.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.260+0000 7f0d933ff700 1 -- start start 2023-08-31T19:00:49.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d933ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d8c0690e0 0x7f0d8c150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:49.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d933ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d8c0c38d0 0x7f0d8c1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:49.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d933ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d8c1544e0 0x7f0d8c154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:49.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d933ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0aa3e0 con 0x7f0d8c1544e0 2023-08-31T19:00:49.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d933ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c151140 con 0x7f0d8c0690e0 2023-08-31T19:00:49.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d933ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c155410 con 0x7f0d8c0c38d0 2023-08-31T19:00:49.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d9199c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d8c1544e0 0x7f0d8c154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:49.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d9199c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d8c1544e0 0x7f0d8c154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55456/0 (socket says 172.21.15.72:55456) 2023-08-31T19:00:49.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d9199c700 1 -- 172.21.15.72:0/400869375 learned_addr learned my addr 172.21.15.72:0/400869375 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:49.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d9119b700 1 --2- 172.21.15.72:0/400869375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d8c0690e0 0x7f0d8c150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:49.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d9099a700 1 --2- 172.21.15.72:0/400869375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d8c0c38d0 0x7f0d8c1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:49.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d9199c700 1 -- 172.21.15.72:0/400869375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d8c0c38d0 msgr2=0x7f0d8c1548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:49.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d9199c700 1 --2- 172.21.15.72:0/400869375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d8c0c38d0 0x7f0d8c1548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:49.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d9199c700 1 -- 172.21.15.72:0/400869375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d8c0690e0 msgr2=0x7f0d8c150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:49.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d9199c700 1 --2- 172.21.15.72:0/400869375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d8c0690e0 0x7f0d8c150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:49.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d9199c700 1 -- 172.21.15.72:0/400869375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c0092a0 con 0x7f0d8c1544e0 2023-08-31T19:00:49.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.261+0000 7f0d9199c700 1 --2- 172.21.15.72:0/400869375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d8c1544e0 0x7f0d8c154db0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f0d84005ad0 tx=0x7f0d84001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:49.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.262+0000 7f0d817fa700 1 -- 172.21.15.72:0/400869375 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d84005d30 con 0x7f0d8c1544e0 2023-08-31T19:00:49.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.262+0000 7f0d817fa700 1 -- 172.21.15.72:0/400869375 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d84005e90 con 0x7f0d8c1544e0 2023-08-31T19:00:49.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.262+0000 7f0d933ff700 1 -- 172.21.15.72:0/400869375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8c1556f0 con 0x7f0d8c1544e0 2023-08-31T19:00:49.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.262+0000 7f0d817fa700 1 -- 172.21.15.72:0/400869375 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d84007320 con 0x7f0d8c1544e0 2023-08-31T19:00:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.262+0000 7f0d933ff700 1 -- 172.21.15.72:0/400869375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8c0aa8a0 con 0x7f0d8c1544e0 2023-08-31T19:00:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.263+0000 7f0d933ff700 1 -- 172.21.15.72:0/400869375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8c155930 con 0x7f0d8c1544e0 2023-08-31T19:00:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.264+0000 7f0d817fa700 1 -- 172.21.15.72:0/400869375 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 13) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f0d84007710 con 0x7f0d8c1544e0 2023-08-31T19:00:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.265+0000 7f0d817fa700 1 --2- 172.21.15.72:0/400869375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0d7005ecf0 0x7f0d700611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.265+0000 7f0d817fa700 1 -- 172.21.15.72:0/400869375 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7152+0+0 (secure 0 0 0) 0x7f0d8407a040 con 0x7f0d8c1544e0 2023-08-31T19:00:49.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.265+0000 7f0d9119b700 1 --2- 172.21.15.72:0/400869375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0d7005ecf0 0x7f0d700611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:49.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.266+0000 7f0d9119b700 1 --2- 172.21.15.72:0/400869375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0d7005ecf0 0x7f0d700611b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0d8c167780 tx=0x7f0d88009040).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:49.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.269+0000 7f0d817fa700 1 -- 172.21.15.72:0/400869375 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0d8c155930 con 0x7f0d8c1544e0 2023-08-31T19:00:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:49.484+0000 7f0d933ff700 1 -- 172.21.15.72:0/400869375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0d8c155930 con 0x7f0d8c1544e0 2023-08-31T19:00:50.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.472+0000 7f0d817fa700 1 -- 172.21.15.72:0/400869375 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0d84077be0 con 0x7f0d8c1544e0 2023-08-31T19:00:50.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.473+0000 7f0d817fa700 1 -- 172.21.15.72:0/400869375 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0d84072a90 con 0x7f0d8c1544e0 2023-08-31T19:00:50.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.476+0000 7f0d933ff700 1 -- 172.21.15.72:0/400869375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0d7005ecf0 msgr2=0x7f0d700611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:50.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.476+0000 7f0d933ff700 1 --2- 172.21.15.72:0/400869375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0d7005ecf0 0x7f0d700611b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0d8c167780 tx=0x7f0d88009040).stop 2023-08-31T19:00:50.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.476+0000 7f0d933ff700 1 -- 172.21.15.72:0/400869375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d8c1544e0 msgr2=0x7f0d8c154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:50.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.476+0000 7f0d933ff700 1 --2- 172.21.15.72:0/400869375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d8c1544e0 0x7f0d8c154db0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f0d84005ad0 tx=0x7f0d84001650).stop 2023-08-31T19:00:50.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.476+0000 7f0d933ff700 1 -- 172.21.15.72:0/400869375 shutdown_connections 2023-08-31T19:00:50.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.476+0000 7f0d933ff700 1 --2- 172.21.15.72:0/400869375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d8c1544e0 0x7f0d8c154db0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:50.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.476+0000 7f0d933ff700 1 --2- 172.21.15.72:0/400869375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0d7005ecf0 0x7f0d700611b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:50.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.476+0000 7f0d933ff700 1 --2- 172.21.15.72:0/400869375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d8c0690e0 0x7f0d8c150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:50.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.476+0000 7f0d933ff700 1 --2- 172.21.15.72:0/400869375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d8c0c38d0 0x7f0d8c1548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:50.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.476+0000 7f0d933ff700 1 -- 172.21.15.72:0/400869375 >> 172.21.15.72:0/400869375 conn(0x7f0d8c0c7e00 msgr2=0x7f0d8c0c6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:50.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.476+0000 7f0d933ff700 1 -- 172.21.15.72:0/400869375 shutdown_connections 2023-08-31T19:00:50.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.476+0000 7f0d933ff700 1 -- 172.21.15.72:0/400869375 wait complete. 2023-08-31T19:00:50.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T19:00:50.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.693+0000 7ff460dff700 1 Processor -- start 2023-08-31T19:00:50.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.693+0000 7ff460dff700 1 -- start start 2023-08-31T19:00:50.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.694+0000 7ff460dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff45c064db0 0x7ff45c0a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:50.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.694+0000 7ff460dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff45c154500 0x7ff45c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.694+0000 7ff460dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45c0aa620 con 0x7ff45c154120 2023-08-31T19:00:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.694+0000 7ff460dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45c0aa3a0 con 0x7ff45c064db0 2023-08-31T19:00:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.694+0000 7ff460dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0c5450 con 0x7ff45c154500 2023-08-31T19:00:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.695+0000 7ff459d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff45c064db0 0x7ff45c0a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.695+0000 7ff459d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff45c064db0 0x7ff45c0a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55472/0 (socket says 172.21.15.72:55472) 2023-08-31T19:00:50.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.695+0000 7ff459d9b700 1 -- 172.21.15.72:0/260432738 learned_addr learned my addr 172.21.15.72:0/260432738 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:50.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.695+0000 7ff45ad9d700 1 --2- 172.21.15.72:0/260432738 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff45c154500 0x7ff45c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:50.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.695+0000 7ff459d9b700 1 -- 172.21.15.72:0/260432738 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff45c154500 msgr2=0x7ff45c15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:50.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.695+0000 7ff459d9b700 1 --2- 172.21.15.72:0/260432738 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff45c154500 0x7ff45c15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:50.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.695+0000 7ff459d9b700 1 -- 172.21.15.72:0/260432738 >> v1:172.21.15.146:6789/0 conn(0x7ff45c154120 legacy=0x7ff45c0646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:50.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.695+0000 7ff459d9b700 1 -- 172.21.15.72:0/260432738 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c0c8050 con 0x7ff45c064db0 2023-08-31T19:00:50.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.695+0000 7ff459d9b700 1 --2- 172.21.15.72:0/260432738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c064db0 0x7ff45c0a9eb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7ff450006fd0 tx=0x7ff4500090f0).ready entity=mon.0 client_cookie=d854dbf3f518deec server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:50.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.696+0000 7ff45959a700 1 -- 172.21.15.72:0/260432738 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45000b580 con 0x7ff45c064db0 2023-08-31T19:00:50.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.696+0000 7ff45959a700 1 -- 172.21.15.72:0/260432738 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45000b6e0 con 0x7ff45c064db0 2023-08-31T19:00:50.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.696+0000 7ff45959a700 1 -- 172.21.15.72:0/260432738 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45000ba60 con 0x7ff45c064db0 2023-08-31T19:00:50.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.696+0000 7ff460dff700 1 -- 172.21.15.72:0/260432738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c064db0 msgr2=0x7ff45c0a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:50.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.696+0000 7ff460dff700 1 --2- 172.21.15.72:0/260432738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c064db0 0x7ff45c0a9eb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7ff450006fd0 tx=0x7ff4500090f0).stop 2023-08-31T19:00:50.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.696+0000 7ff460dff700 1 -- 172.21.15.72:0/260432738 shutdown_connections 2023-08-31T19:00:50.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.696+0000 7ff460dff700 1 --2- 172.21.15.72:0/260432738 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff45c154500 0x7ff45c15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:50.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.696+0000 7ff460dff700 1 --2- 172.21.15.72:0/260432738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c064db0 0x7ff45c0a9eb0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:50.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.696+0000 7ff460dff700 1 -- 172.21.15.72:0/260432738 >> 172.21.15.72:0/260432738 conn(0x7ff45c0cb7e0 msgr2=0x7ff45c0c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:50.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.696+0000 7ff460dff700 1 -- 172.21.15.72:0/260432738 shutdown_connections 2023-08-31T19:00:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.696+0000 7ff460dff700 1 -- 172.21.15.72:0/260432738 wait complete. 2023-08-31T19:00:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.698+0000 7ff460dff700 1 Processor -- start 2023-08-31T19:00:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.698+0000 7ff460dff700 1 -- start start 2023-08-31T19:00:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.699+0000 7ff460dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff45c064db0 0x7ff45c163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.699+0000 7ff460dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff45c154120 0x7ff45c0add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:50.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.699+0000 7ff460dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c154500 0x7ff45c0ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:50.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.699+0000 7ff460dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0ae700 con 0x7ff45c154500 2023-08-31T19:00:50.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.699+0000 7ff460dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0c31e0 con 0x7ff45c064db0 2023-08-31T19:00:50.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.699+0000 7ff460dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0c25d0 con 0x7ff45c154120 2023-08-31T19:00:50.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.699+0000 7ff45ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c154500 0x7ff45c0ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.699+0000 7ff45ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c154500 0x7ff45c0ae210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55476/0 (socket says 172.21.15.72:55476) 2023-08-31T19:00:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.699+0000 7ff45ad9d700 1 -- 172.21.15.72:0/2423645897 learned_addr learned my addr 172.21.15.72:0/2423645897 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.699+0000 7ff45a59c700 1 --2- 172.21.15.72:0/2423645897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff45c064db0 0x7ff45c163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.700+0000 7ff459d9b700 1 --2- 172.21.15.72:0/2423645897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff45c154120 0x7ff45c0add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.700+0000 7ff45ad9d700 1 -- 172.21.15.72:0/2423645897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff45c154120 msgr2=0x7ff45c0add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.700+0000 7ff45ad9d700 1 --2- 172.21.15.72:0/2423645897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff45c154120 0x7ff45c0add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.700+0000 7ff45ad9d700 1 -- 172.21.15.72:0/2423645897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff45c064db0 msgr2=0x7ff45c163fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.700+0000 7ff45ad9d700 1 --2- 172.21.15.72:0/2423645897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff45c064db0 0x7ff45c163fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.700+0000 7ff45ad9d700 1 -- 172.21.15.72:0/2423645897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff450009370 con 0x7ff45c154500 2023-08-31T19:00:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.700+0000 7ff45ad9d700 1 --2- 172.21.15.72:0/2423645897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c154500 0x7ff45c0ae210 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7ff454009d70 tx=0x7ff45400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.700+0000 7ff44a7fc700 1 -- 172.21.15.72:0/2423645897 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45400cb50 con 0x7ff45c154500 2023-08-31T19:00:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.700+0000 7ff44a7fc700 1 -- 172.21.15.72:0/2423645897 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45400f040 con 0x7ff45c154500 2023-08-31T19:00:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.700+0000 7ff44a7fc700 1 -- 172.21.15.72:0/2423645897 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff454013400 con 0x7ff45c154500 2023-08-31T19:00:50.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.700+0000 7ff460dff700 1 -- 172.21.15.72:0/2423645897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c0c28b0 con 0x7ff45c154500 2023-08-31T19:00:50.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.700+0000 7ff460dff700 1 -- 172.21.15.72:0/2423645897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c0c2e70 con 0x7ff45c154500 2023-08-31T19:00:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.701+0000 7ff460dff700 1 -- 172.21.15.72:0/2423645897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45c065370 con 0x7ff45c154500 2023-08-31T19:00:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.702+0000 7ff44a7fc700 1 -- 172.21.15.72:0/2423645897 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff454013770 con 0x7ff45c154500 2023-08-31T19:00:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.703+0000 7ff44a7fc700 1 --2- 172.21.15.72:0/2423645897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff43c05ef30 0x7ff43c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.703+0000 7ff44a7fc700 1 -- 172.21.15.72:0/2423645897 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7152+0+0 (secure 0 0 0) 0x7ff45407ac00 con 0x7ff45c154500 2023-08-31T19:00:50.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.703+0000 7ff45a59c700 1 --2- 172.21.15.72:0/2423645897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff43c05ef30 0x7ff43c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:50.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.704+0000 7ff45a59c700 1 --2- 172.21.15.72:0/2423645897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff43c05ef30 0x7ff43c0613f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff44c0036d0 tx=0x7ff44c009040).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:50.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.707+0000 7ff44a7fc700 1 -- 172.21.15.72:0/2423645897 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff454081080 con 0x7ff45c154500 2023-08-31T19:00:50.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:50.877+0000 7ff460dff700 1 -- 172.21.15.72:0/2423645897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff45c06a7e0 con 0x7ff45c154500 2023-08-31T19:00:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.472+0000 7ff44a7fc700 1 -- 172.21.15.72:0/2423645897 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff45404baf0 con 0x7ff45c154500 2023-08-31T19:00:51.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.478+0000 7ff460dff700 1 -- 172.21.15.72:0/2423645897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff43c05ef30 msgr2=0x7ff43c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:51.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.478+0000 7ff460dff700 1 --2- 172.21.15.72:0/2423645897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff43c05ef30 0x7ff43c0613f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff44c0036d0 tx=0x7ff44c009040).stop 2023-08-31T19:00:51.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.478+0000 7ff460dff700 1 -- 172.21.15.72:0/2423645897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c154500 msgr2=0x7ff45c0ae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:51.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.478+0000 7ff460dff700 1 --2- 172.21.15.72:0/2423645897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c154500 0x7ff45c0ae210 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7ff454009d70 tx=0x7ff45400b040).stop 2023-08-31T19:00:51.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.481+0000 7ff460dff700 1 -- 172.21.15.72:0/2423645897 shutdown_connections 2023-08-31T19:00:51.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.481+0000 7ff460dff700 1 --2- 172.21.15.72:0/2423645897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff45c154500 0x7ff45c0ae210 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:51.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.481+0000 7ff460dff700 1 --2- 172.21.15.72:0/2423645897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff43c05ef30 0x7ff43c0613f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:51.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.481+0000 7ff460dff700 1 --2- 172.21.15.72:0/2423645897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff45c064db0 0x7ff45c163fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:51.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.481+0000 7ff460dff700 1 --2- 172.21.15.72:0/2423645897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff45c154120 0x7ff45c0add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:51.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.481+0000 7ff460dff700 1 -- 172.21.15.72:0/2423645897 >> 172.21.15.72:0/2423645897 conn(0x7ff45c0cb7e0 msgr2=0x7ff45c0c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:51.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.481+0000 7ff460dff700 1 -- 172.21.15.72:0/2423645897 shutdown_connections 2023-08-31T19:00:51.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.482+0000 7ff460dff700 1 -- 172.21.15.72:0/2423645897 wait complete. 2023-08-31T19:00:51.486 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-08-31T19:00:51.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T19:00:51.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.698+0000 7f6683dff700 1 Processor -- start 2023-08-31T19:00:51.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.699+0000 7f6683dff700 1 -- start start 2023-08-31T19:00:51.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.700+0000 7f6683dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f667c154500 0x7f667c0a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:51.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.700+0000 7f6683dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c0aa620 con 0x7f667c064db0 2023-08-31T19:00:51.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.700+0000 7f6683dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c0aa3a0 con 0x7f667c154120 2023-08-31T19:00:51.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.700+0000 7f6683dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0c5450 con 0x7f667c154500 2023-08-31T19:00:51.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.700+0000 7f668139a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f667c064db0 0x7f667c15beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51404/0 (socket says 172.21.15.72:51404) 2023-08-31T19:00:51.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.700+0000 7f668139a700 1 -- 172.21.15.72:0/3028051606 learned_addr learned my addr 172.21.15.72:0/3028051606 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:51.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.700+0000 7f6680b99700 1 -- 172.21.15.72:0/3028051606 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890790146 0 0) 0x7f667c0aa620 con 0x7f667c064db0 2023-08-31T19:00:51.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f6680b99700 1 -- 172.21.15.72:0/3028051606 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66680033f0 con 0x7f667c064db0 2023-08-31T19:00:51.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f668239c700 1 --2- 172.21.15.72:0/3028051606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f667c154500 0x7f667c0a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:51.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f6680b99700 1 -- 172.21.15.72:0/3028051606 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4008665962 0 0) 0x7f66680033f0 con 0x7f667c064db0 2023-08-31T19:00:51.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f6680b99700 1 -- 172.21.15.72:0/3028051606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f667c154500 msgr2=0x7f667c0a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:51.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f6680b99700 1 --2- 172.21.15.72:0/3028051606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f667c154500 0x7f667c0a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:51.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f6680b99700 1 -- 172.21.15.72:0/3028051606 >> v1:172.21.15.146:6789/0 conn(0x7f667c154120 legacy=0x7f667c0646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:51.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f6680b99700 1 -- 172.21.15.72:0/3028051606 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0c8050 con 0x7f667c064db0 2023-08-31T19:00:51.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f6680b99700 1 -- 172.21.15.72:0/3028051606 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f666c001470 con 0x7f667c064db0 2023-08-31T19:00:51.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f6680b99700 1 -- 172.21.15.72:0/3028051606 >> v1:172.21.15.72:6789/0 conn(0x7f667c064db0 legacy=0x7f667c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:51.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f6680b99700 1 --2- 172.21.15.72:0/3028051606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6668003910 0x7f6668003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:51.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f6680b99700 1 --2- 172.21.15.72:0/3028051606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f667c154500 0x7f6668004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:51.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f6680b99700 1 --2- 172.21.15.72:0/3028051606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6668004b80 0x7f6668005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:51.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f6680b99700 1 -- 172.21.15.72:0/3028051606 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0c5450 con 0x7f6668003910 2023-08-31T19:00:51.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f6680b99700 1 -- 172.21.15.72:0/3028051606 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666800b910 con 0x7f6668004b80 2023-08-31T19:00:51.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f6680b99700 1 -- 172.21.15.72:0/3028051606 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666800bad0 con 0x7f667c154500 2023-08-31T19:00:51.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f6681b9b700 1 --2- 172.21.15.72:0/3028051606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6668003910 0x7f6668003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:51.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f668139a700 1 --2- 172.21.15.72:0/3028051606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f667c154500 0x7f6668004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:51.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.701+0000 7f668239c700 1 --2- 172.21.15.72:0/3028051606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6668004b80 0x7f6668005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:51.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.702+0000 7f6681b9b700 1 -- 172.21.15.72:0/3028051606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f667c154500 msgr2=0x7f6668004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:51.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.702+0000 7f6681b9b700 1 --2- 172.21.15.72:0/3028051606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f667c154500 0x7f6668004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:51.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.702+0000 7f6681b9b700 1 -- 172.21.15.72:0/3028051606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6668004b80 msgr2=0x7f6668005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:51.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.702+0000 7f6681b9b700 1 --2- 172.21.15.72:0/3028051606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6668004b80 0x7f6668005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:51.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.702+0000 7f6681b9b700 1 -- 172.21.15.72:0/3028051606 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66680033f0 con 0x7f6668003910 2023-08-31T19:00:51.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.702+0000 7f668139a700 1 --2- 172.21.15.72:0/3028051606 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f667c154500 0x7f6668004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:51.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.702+0000 7f6681b9b700 1 --2- 172.21.15.72:0/3028051606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6668003910 0x7f6668003d30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f6678001760 tx=0x7f6678007bb0).ready entity=mon.0 client_cookie=de1131bbfd6f089e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:51.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.702+0000 7f6680b99700 1 -- 172.21.15.72:0/3028051606 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678007020 con 0x7f6668003910 2023-08-31T19:00:51.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.702+0000 7f6680b99700 1 -- 172.21.15.72:0/3028051606 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6678007180 con 0x7f6668003910 2023-08-31T19:00:51.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.702+0000 7f6680b99700 1 -- 172.21.15.72:0/3028051606 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678007500 con 0x7f6668003910 2023-08-31T19:00:51.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.703+0000 7f6683dff700 1 -- 172.21.15.72:0/3028051606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6668003910 msgr2=0x7f6668003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:51.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.703+0000 7f6683dff700 1 --2- 172.21.15.72:0/3028051606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6668003910 0x7f6668003d30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f6678001760 tx=0x7f6678007bb0).stop 2023-08-31T19:00:51.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.703+0000 7f668239c700 1 -- 172.21.15.72:0/3028051606 reap_dead start 2023-08-31T19:00:51.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.703+0000 7f6683dff700 1 -- 172.21.15.72:0/3028051606 shutdown_connections 2023-08-31T19:00:51.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.703+0000 7f6683dff700 1 -- 172.21.15.72:0/3028051606 >> 172.21.15.72:0/3028051606 conn(0x7f667c0cb7e0 msgr2=0x7f667c0c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:51.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.703+0000 7f6683dff700 1 -- 172.21.15.72:0/3028051606 shutdown_connections 2023-08-31T19:00:51.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.703+0000 7f6683dff700 1 -- 172.21.15.72:0/3028051606 wait complete. 2023-08-31T19:00:51.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.704+0000 7f6683dff700 1 Processor -- start 2023-08-31T19:00:51.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.704+0000 7f6683dff700 1 -- start start 2023-08-31T19:00:51.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.705+0000 7f6683dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6668003910 0x7f667c145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:51.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.705+0000 7f6683dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c1420f0 0x7f667c143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:51.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.705+0000 7f6683dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f667c143950 0x7f667c145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:51.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.705+0000 7f6683dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c145880 con 0x7f667c1420f0 2023-08-31T19:00:51.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.705+0000 7f6683dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c144f00 con 0x7f6668003910 2023-08-31T19:00:51.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.705+0000 7f6683dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c1442f0 con 0x7f667c143950 2023-08-31T19:00:51.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.705+0000 7f668139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c1420f0 0x7f667c143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:51.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.706+0000 7f668139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c1420f0 0x7f667c143460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55494/0 (socket says 172.21.15.72:55494) 2023-08-31T19:00:51.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.706+0000 7f668139a700 1 -- 172.21.15.72:0/2331266500 learned_addr learned my addr 172.21.15.72:0/2331266500 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:51.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.706+0000 7f668139a700 1 -- 172.21.15.72:0/2331266500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f667c143950 msgr2=0x7f667c145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:51.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.706+0000 7f668139a700 1 --2- 172.21.15.72:0/2331266500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f667c143950 0x7f667c145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:51.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.706+0000 7f6681b9b700 1 --2- 172.21.15.72:0/2331266500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6668003910 0x7f667c145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:51.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.706+0000 7f668139a700 1 -- 172.21.15.72:0/2331266500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6668003910 msgr2=0x7f667c145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:51.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.706+0000 7f668139a700 1 --2- 172.21.15.72:0/2331266500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6668003910 0x7f667c145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:51.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.706+0000 7f668139a700 1 -- 172.21.15.72:0/2331266500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c1445d0 con 0x7f667c1420f0 2023-08-31T19:00:51.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.706+0000 7f6681b9b700 1 --2- 172.21.15.72:0/2331266500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6668003910 0x7f667c145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:51.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.706+0000 7f668139a700 1 --2- 172.21.15.72:0/2331266500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c1420f0 0x7f667c143460 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f666c00e810 tx=0x7f666c001120).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:51.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.706+0000 7f6671ffb700 1 -- 172.21.15.72:0/2331266500 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c010520 con 0x7f667c1420f0 2023-08-31T19:00:51.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.706+0000 7f6671ffb700 1 -- 172.21.15.72:0/2331266500 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c010680 con 0x7f667c1420f0 2023-08-31T19:00:51.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.706+0000 7f6683dff700 1 -- 172.21.15.72:0/2331266500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c1448b0 con 0x7f667c1420f0 2023-08-31T19:00:51.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.706+0000 7f6671ffb700 1 -- 172.21.15.72:0/2331266500 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c010a00 con 0x7f667c1420f0 2023-08-31T19:00:51.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.706+0000 7f6683dff700 1 -- 172.21.15.72:0/2331266500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c142570 con 0x7f667c1420f0 2023-08-31T19:00:51.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.708+0000 7f6683dff700 1 -- 172.21.15.72:0/2331266500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c06a7e0 con 0x7f667c1420f0 2023-08-31T19:00:51.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.708+0000 7f6671ffb700 1 -- 172.21.15.72:0/2331266500 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f666c01d440 con 0x7f667c1420f0 2023-08-31T19:00:51.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.709+0000 7f6671ffb700 1 --2- 172.21.15.72:0/2331266500 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f666005ef30 0x7f66600613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:51.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.709+0000 7f6671ffb700 1 -- 172.21.15.72:0/2331266500 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f666c079d60 con 0x7f667c1420f0 2023-08-31T19:00:51.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.709+0000 7f6681b9b700 1 --2- 172.21.15.72:0/2331266500 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f666005ef30 0x7f66600613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:51.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.710+0000 7f6681b9b700 1 --2- 172.21.15.72:0/2331266500 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f666005ef30 0x7f66600613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6678001540 tx=0x7f6678016000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:51.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.713+0000 7f6671ffb700 1 -- 172.21.15.72:0/2331266500 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f666c04ada0 con 0x7f667c1420f0 2023-08-31T19:00:51.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:51.883+0000 7f6683dff700 1 -- 172.21.15.72:0/2331266500 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f667c06c6b0 con 0x7f667c1420f0 2023-08-31T19:00:52.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.478+0000 7f6671ffb700 1 -- 172.21.15.72:0/2331266500 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 169+0+0 (secure 0 0 0) 0x7f666c04e3c0 con 0x7f667c1420f0 2023-08-31T19:00:52.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.480+0000 7f6683dff700 1 -- 172.21.15.72:0/2331266500 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f666005ef30 msgr2=0x7f66600613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:52.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.480+0000 7f6683dff700 1 --2- 172.21.15.72:0/2331266500 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f666005ef30 0x7f66600613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6678001540 tx=0x7f6678016000).stop 2023-08-31T19:00:52.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.480+0000 7f6683dff700 1 -- 172.21.15.72:0/2331266500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c1420f0 msgr2=0x7f667c143460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:52.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.480+0000 7f6683dff700 1 --2- 172.21.15.72:0/2331266500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c1420f0 0x7f667c143460 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f666c00e810 tx=0x7f666c001120).stop 2023-08-31T19:00:52.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.480+0000 7f6683dff700 1 -- 172.21.15.72:0/2331266500 shutdown_connections 2023-08-31T19:00:52.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.480+0000 7f6683dff700 1 --2- 172.21.15.72:0/2331266500 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f667c143950 0x7f667c145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:52.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.480+0000 7f6683dff700 1 --2- 172.21.15.72:0/2331266500 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f666005ef30 0x7f66600613f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:52.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.480+0000 7f6683dff700 1 --2- 172.21.15.72:0/2331266500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6668003910 0x7f667c145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:52.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.480+0000 7f6683dff700 1 --2- 172.21.15.72:0/2331266500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c1420f0 0x7f667c143460 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:52.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.480+0000 7f6683dff700 1 -- 172.21.15.72:0/2331266500 >> 172.21.15.72:0/2331266500 conn(0x7f667c0cb7e0 msgr2=0x7f667c0abd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:52.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.480+0000 7f6683dff700 1 -- 172.21.15.72:0/2331266500 shutdown_connections 2023-08-31T19:00:52.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.481+0000 7f6683dff700 1 -- 172.21.15.72:0/2331266500 wait complete. 2023-08-31T19:00:52.484 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-08-31T19:00:52.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-31T19:00:52.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.696+0000 7f56725ff700 1 Processor -- start 2023-08-31T19:00:52.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.696+0000 7f56725ff700 1 -- start start 2023-08-31T19:00:52.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.698+0000 7f56725ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f566c1544e0 0x7f566c05e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:52.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.698+0000 7f56725ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f566c0690e0 0x7f566c0bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:52.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.698+0000 7f56725ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c0bc4a0 con 0x7f566c0c38d0 2023-08-31T19:00:52.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.698+0000 7f56725ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566c05e840 con 0x7f566c0690e0 2023-08-31T19:00:52.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.698+0000 7f56725ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c069c40 con 0x7f566c1544e0 2023-08-31T19:00:52.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.698+0000 7f5670b9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f566c0690e0 0x7f566c0bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:52.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.699+0000 7f566bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f566c1544e0 0x7f566c05e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:52.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.699+0000 7f5670b9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f566c0690e0 0x7f566c0bc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:52500/0 (socket says 172.21.15.72:52500) 2023-08-31T19:00:52.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.699+0000 7f5670b9c700 1 -- 172.21.15.72:0/2600242023 learned_addr learned my addr 172.21.15.72:0/2600242023 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:52.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.699+0000 7f566b7fe700 1 --1- 172.21.15.72:0/2600242023 >> v1:172.21.15.146:6789/0 conn(0x7f566c0c38d0 0x7f566c0689d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:57392/0 (socket says 172.21.15.72:57392) 2023-08-31T19:00:52.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.699+0000 7f5670b9c700 1 -- 172.21.15.72:0/2600242023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f566c1544e0 msgr2=0x7f566c05e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.699+0000 7f5670b9c700 1 --2- 172.21.15.72:0/2600242023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f566c1544e0 0x7f566c05e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.699+0000 7f5670b9c700 1 -- 172.21.15.72:0/2600242023 >> v1:172.21.15.146:6789/0 conn(0x7f566c0c38d0 legacy=0x7f566c0689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.699+0000 7f5670b9c700 1 -- 172.21.15.72:0/2600242023 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c0c1c30 con 0x7f566c0690e0 2023-08-31T19:00:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.699+0000 7f566affd700 1 -- 172.21.15.72:0/2600242023 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638850567 0 0) 0x7f566c0bc4a0 con 0x7f566c0c38d0 2023-08-31T19:00:52.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.699+0000 7f5670b9c700 1 --2- 172.21.15.72:0/2600242023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f566c0690e0 0x7f566c0bc930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f5664009f20 tx=0x7f5664009840).ready entity=mon.1 client_cookie=81113fff22be4ca5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:52.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.700+0000 7f566affd700 1 -- 172.21.15.72:0/2600242023 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566400e070 con 0x7f566c0690e0 2023-08-31T19:00:52.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.700+0000 7f566affd700 1 -- 172.21.15.72:0/2600242023 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566400b9d0 con 0x7f566c0690e0 2023-08-31T19:00:52.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.700+0000 7f566affd700 1 -- 172.21.15.72:0/2600242023 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566400bd50 con 0x7f566c0690e0 2023-08-31T19:00:52.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.700+0000 7f56725ff700 1 -- 172.21.15.72:0/2600242023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f566c0690e0 msgr2=0x7f566c0bc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:52.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.700+0000 7f56725ff700 1 --2- 172.21.15.72:0/2600242023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f566c0690e0 0x7f566c0bc930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f5664009f20 tx=0x7f5664009840).stop 2023-08-31T19:00:52.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.700+0000 7f56725ff700 1 -- 172.21.15.72:0/2600242023 shutdown_connections 2023-08-31T19:00:52.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.700+0000 7f56725ff700 1 --2- 172.21.15.72:0/2600242023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f566c0690e0 0x7f566c0bc930 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:52.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.700+0000 7f56725ff700 1 --2- 172.21.15.72:0/2600242023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f566c1544e0 0x7f566c05e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:52.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.700+0000 7f56725ff700 1 -- 172.21.15.72:0/2600242023 >> 172.21.15.72:0/2600242023 conn(0x7f566c0c7e00 msgr2=0x7f566c0c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:52.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.700+0000 7f56725ff700 1 -- 172.21.15.72:0/2600242023 shutdown_connections 2023-08-31T19:00:52.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.700+0000 7f56725ff700 1 -- 172.21.15.72:0/2600242023 wait complete. 2023-08-31T19:00:52.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.702+0000 7f56725ff700 1 Processor -- start 2023-08-31T19:00:52.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.702+0000 7f56725ff700 1 -- start start 2023-08-31T19:00:52.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f56725ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566c0690e0 0x7f566c0bef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:52.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f56725ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f566c0c38d0 0x7f566c0ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:52.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f56725ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f566c1544e0 0x7f566c0ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:52.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f56725ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0acdf0 con 0x7f566c0690e0 2023-08-31T19:00:52.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f56725ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0ac4c0 con 0x7f566c0c38d0 2023-08-31T19:00:52.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f56725ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0ac7a0 con 0x7f566c1544e0 2023-08-31T19:00:52.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f566bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566c0690e0 0x7f566c0bef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:52.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f566bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566c0690e0 0x7f566c0bef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55508/0 (socket says 172.21.15.72:55508) 2023-08-31T19:00:52.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f566bfff700 1 -- 172.21.15.72:0/659629746 learned_addr learned my addr 172.21.15.72:0/659629746 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:52.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f566b7fe700 1 --2- 172.21.15.72:0/659629746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f566c0c38d0 0x7f566c0ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:52.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f5670b9c700 1 --2- 172.21.15.72:0/659629746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f566c1544e0 0x7f566c0ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:52.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f566bfff700 1 -- 172.21.15.72:0/659629746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f566c1544e0 msgr2=0x7f566c0ab820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:52.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f566bfff700 1 --2- 172.21.15.72:0/659629746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f566c1544e0 0x7f566c0ab820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:52.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f566bfff700 1 -- 172.21.15.72:0/659629746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f566c0c38d0 msgr2=0x7f566c0ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:52.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f566bfff700 1 --2- 172.21.15.72:0/659629746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f566c0c38d0 0x7f566c0ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:52.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f566bfff700 1 -- 172.21.15.72:0/659629746 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5664009ae0 con 0x7f566c0690e0 2023-08-31T19:00:52.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.703+0000 7f566b7fe700 1 --2- 172.21.15.72:0/659629746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f566c0c38d0 0x7f566c0ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:52.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.704+0000 7f566bfff700 1 --2- 172.21.15.72:0/659629746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566c0690e0 0x7f566c0bef90 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f565c00e900 tx=0x7f565c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:52.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.704+0000 7f5653fff700 1 -- 172.21.15.72:0/659629746 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c00c640 con 0x7f566c0690e0 2023-08-31T19:00:52.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.704+0000 7f5653fff700 1 -- 172.21.15.72:0/659629746 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c00c7a0 con 0x7f566c0690e0 2023-08-31T19:00:52.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.704+0000 7f5653fff700 1 -- 172.21.15.72:0/659629746 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c00cb20 con 0x7f566c0690e0 2023-08-31T19:00:52.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.704+0000 7f56725ff700 1 -- 172.21.15.72:0/659629746 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c0aca80 con 0x7f566c0690e0 2023-08-31T19:00:52.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.704+0000 7f56725ff700 1 -- 172.21.15.72:0/659629746 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c0ad100 con 0x7f566c0690e0 2023-08-31T19:00:52.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.705+0000 7f56725ff700 1 -- 172.21.15.72:0/659629746 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566c06c6b0 con 0x7f566c0690e0 2023-08-31T19:00:52.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.706+0000 7f5653fff700 1 -- 172.21.15.72:0/659629746 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f565c01b400 con 0x7f566c0690e0 2023-08-31T19:00:52.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.707+0000 7f5653fff700 1 --2- 172.21.15.72:0/659629746 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f565805ef30 0x7f56580613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:52.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.707+0000 7f5653fff700 1 -- 172.21.15.72:0/659629746 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6271+0+0 (secure 0 0 0) 0x7f565c07a470 con 0x7f566c0690e0 2023-08-31T19:00:52.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.707+0000 7f566b7fe700 1 --2- 172.21.15.72:0/659629746 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f565805ef30 0x7f56580613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:52.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.707+0000 7f566b7fe700 1 --2- 172.21.15.72:0/659629746 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f565805ef30 0x7f56580613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f566c0c1920 tx=0x7f5660007b10).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:52.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.711+0000 7f5653fff700 1 -- 172.21.15.72:0/659629746 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f565c04b670 con 0x7f566c0690e0 2023-08-31T19:00:52.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.887+0000 7f56725ff700 1 -- 172.21.15.72:0/659629746 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f566c0c1f10 con 0x7f566c0690e0 2023-08-31T19:00:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.891+0000 7f5653fff700 1 -- 172.21.15.72:0/659629746 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v4) v1 ==== 120+0+0 (secure 0 0 0) 0x7f565c0160b0 con 0x7f566c0690e0 2023-08-31T19:00:52.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.894+0000 7f56725ff700 1 -- 172.21.15.72:0/659629746 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f565805ef30 msgr2=0x7f56580613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:52.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.894+0000 7f56725ff700 1 --2- 172.21.15.72:0/659629746 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f565805ef30 0x7f56580613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f566c0c1920 tx=0x7f5660007b10).stop 2023-08-31T19:00:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.894+0000 7f56725ff700 1 -- 172.21.15.72:0/659629746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566c0690e0 msgr2=0x7f566c0bef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.894+0000 7f56725ff700 1 --2- 172.21.15.72:0/659629746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566c0690e0 0x7f566c0bef90 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f565c00e900 tx=0x7f565c009060).stop 2023-08-31T19:00:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.894+0000 7f56725ff700 1 -- 172.21.15.72:0/659629746 shutdown_connections 2023-08-31T19:00:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.894+0000 7f56725ff700 1 --2- 172.21.15.72:0/659629746 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f566c1544e0 0x7f566c0ab820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.894+0000 7f56725ff700 1 --2- 172.21.15.72:0/659629746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566c0690e0 0x7f566c0bef90 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:52.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.894+0000 7f56725ff700 1 --2- 172.21.15.72:0/659629746 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f565805ef30 0x7f56580613f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:52.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.894+0000 7f56725ff700 1 --2- 172.21.15.72:0/659629746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f566c0c38d0 0x7f566c0ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:52.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.894+0000 7f56725ff700 1 -- 172.21.15.72:0/659629746 >> 172.21.15.72:0/659629746 conn(0x7f566c0c7e00 msgr2=0x7f566c0c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:52.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.894+0000 7f56725ff700 1 -- 172.21.15.72:0/659629746 shutdown_connections 2023-08-31T19:00:52.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:52.894+0000 7f56725ff700 1 -- 172.21.15.72:0/659629746 wait complete. 2023-08-31T19:00:52.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-31T19:00:53.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.104+0000 7f83477ff700 1 Processor -- start 2023-08-31T19:00:53.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.104+0000 7f83477ff700 1 -- start start 2023-08-31T19:00:53.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.105+0000 7f83477ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8340153ed0 0x7f83401542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.105+0000 7f83477ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83400663d0 0x7f8340066840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.105+0000 7f83477ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83400a84b0 con 0x7f83400bdb30 2023-08-31T19:00:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.105+0000 7f83477ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83400c9410 con 0x7f83400663d0 2023-08-31T19:00:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.105+0000 7f83477ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83400c5310 con 0x7f8340153ed0 2023-08-31T19:00:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.106+0000 7f8345d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83400663d0 0x7f8340066840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.106+0000 7f8345d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83400663d0 0x7f8340066840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38468/0 (socket says 172.21.15.72:38468) 2023-08-31T19:00:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.106+0000 7f8345d9c700 1 -- 172.21.15.72:0/1358664916 learned_addr learned my addr 172.21.15.72:0/1358664916 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.106+0000 7f834559b700 1 --2- 172.21.15.72:0/1358664916 >> v2:172.21.15.146:3300/0 conn(0x7f8340153ed0 0x7f83401542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.106+0000 7f8345d9c700 1 -- 172.21.15.72:0/1358664916 >> v2:172.21.15.146:3300/0 conn(0x7f8340153ed0 msgr2=0x7f83401542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.106+0000 7f8345d9c700 1 --2- 172.21.15.72:0/1358664916 >> v2:172.21.15.146:3300/0 conn(0x7f8340153ed0 0x7f83401542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:53.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.106+0000 7f8345d9c700 1 -- 172.21.15.72:0/1358664916 >> v1:172.21.15.146:6789/0 conn(0x7f83400bdb30 legacy=0x7f8340155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:53.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.106+0000 7f8345d9c700 1 -- 172.21.15.72:0/1358664916 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8340066d30 con 0x7f83400663d0 2023-08-31T19:00:53.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.106+0000 7f8345d9c700 1 --2- 172.21.15.72:0/1358664916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83400663d0 0x7f8340066840 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f83400c66e0 tx=0x7f8338009840).ready entity=mon.0 client_cookie=b2cb8940d614b461 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:53.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.107+0000 7f8337fff700 1 -- 172.21.15.72:0/1358664916 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800e070 con 0x7f83400663d0 2023-08-31T19:00:53.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.107+0000 7f8337fff700 1 -- 172.21.15.72:0/1358664916 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833800ba50 con 0x7f83400663d0 2023-08-31T19:00:53.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.107+0000 7f8337fff700 1 -- 172.21.15.72:0/1358664916 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800bdd0 con 0x7f83400663d0 2023-08-31T19:00:53.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.107+0000 7f83477ff700 1 -- 172.21.15.72:0/1358664916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83400663d0 msgr2=0x7f8340066840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:53.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.107+0000 7f83477ff700 1 --2- 172.21.15.72:0/1358664916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83400663d0 0x7f8340066840 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f83400c66e0 tx=0x7f8338009840).stop 2023-08-31T19:00:53.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.107+0000 7f83477ff700 1 -- 172.21.15.72:0/1358664916 shutdown_connections 2023-08-31T19:00:53.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.107+0000 7f83477ff700 1 --2- 172.21.15.72:0/1358664916 >> v2:172.21.15.146:3300/0 conn(0x7f8340153ed0 0x7f83401542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:53.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.107+0000 7f83477ff700 1 --2- 172.21.15.72:0/1358664916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83400663d0 0x7f8340066840 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:53.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.107+0000 7f83477ff700 1 -- 172.21.15.72:0/1358664916 >> 172.21.15.72:0/1358664916 conn(0x7f834005eb60 msgr2=0x7f83400c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:53.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.107+0000 7f83477ff700 1 -- 172.21.15.72:0/1358664916 shutdown_connections 2023-08-31T19:00:53.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.107+0000 7f83477ff700 1 -- 172.21.15.72:0/1358664916 wait complete. 2023-08-31T19:00:53.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.109+0000 7f83477ff700 1 Processor -- start 2023-08-31T19:00:53.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.109+0000 7f83477ff700 1 -- start start 2023-08-31T19:00:53.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f83477ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83400663d0 0x7f83400ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:53.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f83477ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8340153ed0 0x7f834014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:53.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f83477ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83401554f0 0x7f8340155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:53.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f83477ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400adc10 con 0x7f83401554f0 2023-08-31T19:00:53.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f83477ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400ad000 con 0x7f8340153ed0 2023-08-31T19:00:53.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f83477ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83400ad2e0 con 0x7f83400663d0 2023-08-31T19:00:53.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f8345d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83401554f0 0x7f8340155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:53.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f8345d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83401554f0 0x7f8340155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38470/0 (socket says 172.21.15.72:38470) 2023-08-31T19:00:53.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f8345d9c700 1 -- 172.21.15.72:0/3836261725 learned_addr learned my addr 172.21.15.72:0/3836261725 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:53.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f834559b700 1 --2- 172.21.15.72:0/3836261725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83400663d0 0x7f83400ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:53.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f8344d9a700 1 --2- 172.21.15.72:0/3836261725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8340153ed0 0x7f834014bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:53.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f8345d9c700 1 -- 172.21.15.72:0/3836261725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83400663d0 msgr2=0x7f83400ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:53.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f8345d9c700 1 --2- 172.21.15.72:0/3836261725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83400663d0 0x7f83400ae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:53.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f8345d9c700 1 -- 172.21.15.72:0/3836261725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8340153ed0 msgr2=0x7f834014bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:53.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f8345d9c700 1 --2- 172.21.15.72:0/3836261725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8340153ed0 0x7f834014bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:53.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.110+0000 7f8345d9c700 1 -- 172.21.15.72:0/3836261725 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8338009ae0 con 0x7f83401554f0 2023-08-31T19:00:53.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.111+0000 7f8345d9c700 1 --2- 172.21.15.72:0/3836261725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83401554f0 0x7f8340155970 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f83400c3470 tx=0x7f83400c9550).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:53.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.111+0000 7f83357fa700 1 -- 172.21.15.72:0/3836261725 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338013e80 con 0x7f83401554f0 2023-08-31T19:00:53.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.111+0000 7f83357fa700 1 -- 172.21.15.72:0/3836261725 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83380092e0 con 0x7f83401554f0 2023-08-31T19:00:53.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.111+0000 7f83477ff700 1 -- 172.21.15.72:0/3836261725 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83400ad5c0 con 0x7f83401554f0 2023-08-31T19:00:53.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.111+0000 7f83357fa700 1 -- 172.21.15.72:0/3836261725 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833801e6a0 con 0x7f83401554f0 2023-08-31T19:00:53.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.111+0000 7f83477ff700 1 -- 172.21.15.72:0/3836261725 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83400ae590 con 0x7f83401554f0 2023-08-31T19:00:53.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.112+0000 7f83477ff700 1 -- 172.21.15.72:0/3836261725 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83400c5f60 con 0x7f83401554f0 2023-08-31T19:00:53.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.113+0000 7f83357fa700 1 -- 172.21.15.72:0/3836261725 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f83380123c0 con 0x7f83401554f0 2023-08-31T19:00:53.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.114+0000 7f83357fa700 1 --2- 172.21.15.72:0/3836261725 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f832405ef30 0x7f83240613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:53.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.114+0000 7f83357fa700 1 -- 172.21.15.72:0/3836261725 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6271+0+0 (secure 0 0 0) 0x7f833807b8d0 con 0x7f83401554f0 2023-08-31T19:00:53.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.114+0000 7f834559b700 1 --2- 172.21.15.72:0/3836261725 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f832405ef30 0x7f83240613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:53.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.115+0000 7f834559b700 1 --2- 172.21.15.72:0/3836261725 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f832405ef30 0x7f83240613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f833c006fd0 tx=0x7f833c008040).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:53.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.118+0000 7f83357fa700 1 -- 172.21.15.72:0/3836261725 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f833804cac0 con 0x7f83401554f0 2023-08-31T19:00:53.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:00:53.216 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:00:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.295+0000 7f83477ff700 1 -- 172.21.15.72:0/3836261725 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f83400add50 con 0x7f83401554f0 2023-08-31T19:00:53.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.300+0000 7f83357fa700 1 -- 172.21.15.72:0/3836261725 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8338023020 con 0x7f83401554f0 2023-08-31T19:00:53.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.302+0000 7f83477ff700 1 -- 172.21.15.72:0/3836261725 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f832405ef30 msgr2=0x7f83240613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:53.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.302+0000 7f83477ff700 1 --2- 172.21.15.72:0/3836261725 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f832405ef30 0x7f83240613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f833c006fd0 tx=0x7f833c008040).stop 2023-08-31T19:00:53.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.302+0000 7f83477ff700 1 -- 172.21.15.72:0/3836261725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83401554f0 msgr2=0x7f8340155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:53.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.302+0000 7f83477ff700 1 --2- 172.21.15.72:0/3836261725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83401554f0 0x7f8340155970 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f83400c3470 tx=0x7f83400c9550).stop 2023-08-31T19:00:53.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.302+0000 7f83477ff700 1 -- 172.21.15.72:0/3836261725 shutdown_connections 2023-08-31T19:00:53.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.302+0000 7f83477ff700 1 --2- 172.21.15.72:0/3836261725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83401554f0 0x7f8340155970 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:53.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.302+0000 7f83477ff700 1 --2- 172.21.15.72:0/3836261725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83400663d0 0x7f83400ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:53.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.302+0000 7f83477ff700 1 --2- 172.21.15.72:0/3836261725 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f832405ef30 0x7f83240613f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:53.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.302+0000 7f83477ff700 1 --2- 172.21.15.72:0/3836261725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8340153ed0 0x7f834014bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:53.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.302+0000 7f83477ff700 1 -- 172.21.15.72:0/3836261725 >> 172.21.15.72:0/3836261725 conn(0x7f834005eb60 msgr2=0x7f83400c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:53.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.303+0000 7f83477ff700 1 -- 172.21.15.72:0/3836261725 shutdown_connections 2023-08-31T19:00:53.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.303+0000 7f83477ff700 1 -- 172.21.15.72:0/3836261725 wait complete. 2023-08-31T19:00:53.320 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-08-31T19:00:53.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.549+0000 7fb16a7ff700 1 Processor -- start 2023-08-31T19:00:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.549+0000 7fb16a7ff700 1 -- start start 2023-08-31T19:00:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.551+0000 7fb16a7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb1640c5fb0 0x7fb1640be370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.551+0000 7fb16a7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1640c46c0 0x7fb164063a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.551+0000 7fb16a7ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1640bece0 con 0x7fb1640be860 2023-08-31T19:00:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.551+0000 7fb16a7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb164154690 con 0x7fb1640c5fb0 2023-08-31T19:00:53.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.551+0000 7fb16a7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640bfb20 con 0x7fb1640c46c0 2023-08-31T19:00:53.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.551+0000 7fb163fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb1640c5fb0 0x7fb1640be370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:53.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.551+0000 7fb163fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb1640c5fb0 0x7fb1640be370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38486/0 (socket says 172.21.15.72:38486) 2023-08-31T19:00:53.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.551+0000 7fb163fff700 1 -- 172.21.15.72:0/2416774875 learned_addr learned my addr 172.21.15.72:0/2416774875 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:53.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.551+0000 7fb168d9c700 1 --2- 172.21.15.72:0/2416774875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1640c46c0 0x7fb164063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:53.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.551+0000 7fb163fff700 1 -- 172.21.15.72:0/2416774875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1640c46c0 msgr2=0x7fb164063a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:53.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.551+0000 7fb163fff700 1 --2- 172.21.15.72:0/2416774875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1640c46c0 0x7fb164063a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:53.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.551+0000 7fb163fff700 1 -- 172.21.15.72:0/2416774875 >> v1:172.21.15.146:6789/0 conn(0x7fb1640be860 legacy=0x7fb1640c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:53.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.552+0000 7fb163fff700 1 -- 172.21.15.72:0/2416774875 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1640bef10 con 0x7fb1640c5fb0 2023-08-31T19:00:53.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.552+0000 7fb163fff700 1 --2- 172.21.15.72:0/2416774875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1640c5fb0 0x7fb1640be370 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fb154009810 tx=0x7fb154009060).ready entity=mon.0 client_cookie=75e7308262a88e68 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:53.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.552+0000 7fb162ffd700 1 -- 172.21.15.72:0/2416774875 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154005880 con 0x7fb1640c5fb0 2023-08-31T19:00:53.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.552+0000 7fb162ffd700 1 -- 172.21.15.72:0/2416774875 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1540059e0 con 0x7fb1640c5fb0 2023-08-31T19:00:53.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.552+0000 7fb162ffd700 1 -- 172.21.15.72:0/2416774875 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154005d60 con 0x7fb1640c5fb0 2023-08-31T19:00:53.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.552+0000 7fb16a7ff700 1 -- 172.21.15.72:0/2416774875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1640c5fb0 msgr2=0x7fb1640be370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:53.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.552+0000 7fb16a7ff700 1 --2- 172.21.15.72:0/2416774875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1640c5fb0 0x7fb1640be370 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fb154009810 tx=0x7fb154009060).stop 2023-08-31T19:00:53.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.553+0000 7fb16a7ff700 1 -- 172.21.15.72:0/2416774875 shutdown_connections 2023-08-31T19:00:53.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.553+0000 7fb16a7ff700 1 --2- 172.21.15.72:0/2416774875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1640c46c0 0x7fb164063a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:53.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.553+0000 7fb16a7ff700 1 --2- 172.21.15.72:0/2416774875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1640c5fb0 0x7fb1640be370 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:53.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.553+0000 7fb16a7ff700 1 -- 172.21.15.72:0/2416774875 >> 172.21.15.72:0/2416774875 conn(0x7fb164082f60 msgr2=0x7fb16405e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:53.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.553+0000 7fb16a7ff700 1 -- 172.21.15.72:0/2416774875 shutdown_connections 2023-08-31T19:00:53.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.553+0000 7fb16a7ff700 1 -- 172.21.15.72:0/2416774875 wait complete. 2023-08-31T19:00:53.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.554+0000 7fb16a7ff700 1 Processor -- start 2023-08-31T19:00:53.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.554+0000 7fb16a7ff700 1 -- start start 2023-08-31T19:00:53.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.555+0000 7fb16a7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1640be860 0x7fb1640c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:53.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.555+0000 7fb16a7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1640c46c0 0x7fb164167890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:53.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.555+0000 7fb16a7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1640c5fb0 0x7fb164167d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:53.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.555+0000 7fb16a7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb164168270 con 0x7fb1640c5fb0 2023-08-31T19:00:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.555+0000 7fb16a7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640aa1b0 con 0x7fb1640be860 2023-08-31T19:00:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.555+0000 7fb16a7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640a95a0 con 0x7fb1640c46c0 2023-08-31T19:00:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb168d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1640c5fb0 0x7fb164167d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb168d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1640c5fb0 0x7fb164167d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38488/0 (socket says 172.21.15.72:38488) 2023-08-31T19:00:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb168d9c700 1 -- 172.21.15.72:0/3834498727 learned_addr learned my addr 172.21.15.72:0/3834498727 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:53.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb163fff700 1 --2- 172.21.15.72:0/3834498727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1640be860 0x7fb1640c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:53.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb1637fe700 1 --2- 172.21.15.72:0/3834498727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1640c46c0 0x7fb164167890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:53.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb168d9c700 1 -- 172.21.15.72:0/3834498727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1640c46c0 msgr2=0x7fb164167890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:53.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb168d9c700 1 --2- 172.21.15.72:0/3834498727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1640c46c0 0x7fb164167890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:53.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb168d9c700 1 -- 172.21.15.72:0/3834498727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1640be860 msgr2=0x7fb1640c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb168d9c700 1 --2- 172.21.15.72:0/3834498727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1640be860 0x7fb1640c14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb168d9c700 1 -- 172.21.15.72:0/3834498727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb154009300 con 0x7fb1640c5fb0 2023-08-31T19:00:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb1637fe700 1 --2- 172.21.15.72:0/3834498727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1640c46c0 0x7fb164167890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb168d9c700 1 --2- 172.21.15.72:0/3834498727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1640c5fb0 0x7fb164167d80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fb15c007f20 tx=0x7fb15c0098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb14bfff700 1 -- 172.21.15.72:0/3834498727 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00ebf0 con 0x7fb1640c5fb0 2023-08-31T19:00:53.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb14bfff700 1 -- 172.21.15.72:0/3834498727 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c00ed50 con 0x7fb1640c5fb0 2023-08-31T19:00:53.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb16a7ff700 1 -- 172.21.15.72:0/3834498727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1640a9880 con 0x7fb1640c5fb0 2023-08-31T19:00:53.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.556+0000 7fb14bfff700 1 -- 172.21.15.72:0/3834498727 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c014610 con 0x7fb1640c5fb0 2023-08-31T19:00:53.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.557+0000 7fb16a7ff700 1 -- 172.21.15.72:0/3834498727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1640a9e40 con 0x7fb1640c5fb0 2023-08-31T19:00:53.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.558+0000 7fb16a7ff700 1 -- 172.21.15.72:0/3834498727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1640aa320 con 0x7fb1640c5fb0 2023-08-31T19:00:53.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.559+0000 7fb14bfff700 1 -- 172.21.15.72:0/3834498727 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb15c0149c0 con 0x7fb1640c5fb0 2023-08-31T19:00:53.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.560+0000 7fb14bfff700 1 --2- 172.21.15.72:0/3834498727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb15005ef30 0x7fb1500613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:53.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.560+0000 7fb14bfff700 1 -- 172.21.15.72:0/3834498727 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6271+0+0 (secure 0 0 0) 0x7fb15c07a440 con 0x7fb1640c5fb0 2023-08-31T19:00:53.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.560+0000 7fb163fff700 1 --2- 172.21.15.72:0/3834498727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb15005ef30 0x7fb1500613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:53.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.561+0000 7fb163fff700 1 --2- 172.21.15.72:0/3834498727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb15005ef30 0x7fb1500613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb154009fd0 tx=0x7fb154016000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:53.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.564+0000 7fb14bfff700 1 -- 172.21.15.72:0/3834498727 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb15c04b640 con 0x7fb1640c5fb0 2023-08-31T19:00:53.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:53.797+0000 7fb16a7ff700 1 -- 172.21.15.72:0/3834498727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7fb16406c6b0 con 0x7fb1640c5fb0 2023-08-31T19:00:54.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.488+0000 7fb14bfff700 1 -- 172.21.15.72:0/3834498727 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v462) v1 ==== 158+0+0 (secure 0 0 0) 0x7fb15c04ec60 con 0x7fb1640c5fb0 2023-08-31T19:00:54.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.490+0000 7fb16a7ff700 1 -- 172.21.15.72:0/3834498727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb15005ef30 msgr2=0x7fb1500613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:54.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.490+0000 7fb16a7ff700 1 --2- 172.21.15.72:0/3834498727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb15005ef30 0x7fb1500613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb154009fd0 tx=0x7fb154016000).stop 2023-08-31T19:00:54.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.490+0000 7fb16a7ff700 1 -- 172.21.15.72:0/3834498727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1640c5fb0 msgr2=0x7fb164167d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:54.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.490+0000 7fb16a7ff700 1 --2- 172.21.15.72:0/3834498727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1640c5fb0 0x7fb164167d80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fb15c007f20 tx=0x7fb15c0098a0).stop 2023-08-31T19:00:54.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.490+0000 7fb16a7ff700 1 -- 172.21.15.72:0/3834498727 shutdown_connections 2023-08-31T19:00:54.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.490+0000 7fb16a7ff700 1 --2- 172.21.15.72:0/3834498727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1640c5fb0 0x7fb164167d80 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:54.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.490+0000 7fb16a7ff700 1 --2- 172.21.15.72:0/3834498727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb15005ef30 0x7fb1500613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:54.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.490+0000 7fb16a7ff700 1 --2- 172.21.15.72:0/3834498727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1640be860 0x7fb1640c14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:54.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.490+0000 7fb16a7ff700 1 --2- 172.21.15.72:0/3834498727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1640c46c0 0x7fb164167890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:54.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.490+0000 7fb16a7ff700 1 -- 172.21.15.72:0/3834498727 >> 172.21.15.72:0/3834498727 conn(0x7fb164082f60 msgr2=0x7fb164063a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:54.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.490+0000 7fb16a7ff700 1 -- 172.21.15.72:0/3834498727 shutdown_connections 2023-08-31T19:00:54.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.491+0000 7fb16a7ff700 1 -- 172.21.15.72:0/3834498727 wait complete. 2023-08-31T19:00:54.510 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-08-31T19:00:54.511 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-08-31T19:00:54.511 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-31T19:00:54.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-08-31T19:00:54.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.705+0000 7fe24cfff700 1 Processor -- start 2023-08-31T19:00:54.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.705+0000 7fe24cfff700 1 -- start start 2023-08-31T19:00:54.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.706+0000 7fe24cfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe24815ce50 0x7fe24815f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.706+0000 7fe24cfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2480c6120 con 0x7fe2480cb9b0 2023-08-31T19:00:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.706+0000 7fe24cfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2480c5e10 con 0x7fe248154060 2023-08-31T19:00:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.706+0000 7fe24cfff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2480c1380 con 0x7fe24815ce50 2023-08-31T19:00:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.706+0000 7fe245d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe2480cb9b0 0x7fe2481583e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55326/0 (socket says 172.21.15.72:55326) 2023-08-31T19:00:54.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.706+0000 7fe245d9b700 1 -- 172.21.15.72:0/2498047875 learned_addr learned my addr 172.21.15.72:0/2498047875 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:54.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe246d9d700 1 --2- 172.21.15.72:0/2498047875 >> v2:172.21.15.146:3300/0 conn(0x7fe24815ce50 0x7fe24815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:54.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734664126 0 0) 0x7fe2480c6120 con 0x7fe2480cb9b0 2023-08-31T19:00:54.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2300033f0 con 0x7fe2480cb9b0 2023-08-31T19:00:54.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631069804 0 0) 0x7fe2480c5e10 con 0x7fe248154060 2023-08-31T19:00:54.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2480c6120 con 0x7fe248154060 2023-08-31T19:00:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3159263405 0 0) 0x7fe2300033f0 con 0x7fe2480cb9b0 2023-08-31T19:00:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 >> v2:172.21.15.146:3300/0 conn(0x7fe24815ce50 msgr2=0x7fe24815f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 --2- 172.21.15.72:0/2498047875 >> v2:172.21.15.146:3300/0 conn(0x7fe24815ce50 0x7fe24815f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 >> v1:172.21.15.146:6789/0 conn(0x7fe248154060 legacy=0x7fe248157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe248158af0 con 0x7fe2480cb9b0 2023-08-31T19:00:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fe23c001470 con 0x7fe2480cb9b0 2023-08-31T19:00:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 >> v1:172.21.15.72:6789/0 conn(0x7fe2480cb9b0 legacy=0x7fe2481583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 --2- 172.21.15.72:0/2498047875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe230003a70 0x7fe230003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 --2- 172.21.15.72:0/2498047875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe230004690 0x7fe230004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 --2- 172.21.15.72:0/2498047875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe230005000 0x7fe23000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2480c1380 con 0x7fe230003a70 2023-08-31T19:00:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23000be80 con 0x7fe230005000 2023-08-31T19:00:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.707+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23000c040 con 0x7fe230004690 2023-08-31T19:00:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.708+0000 7fe24659c700 1 --2- 172.21.15.72:0/2498047875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe230003a70 0x7fe230003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.708+0000 7fe246d9d700 1 --2- 172.21.15.72:0/2498047875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe230005000 0x7fe23000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.708+0000 7fe245d9b700 1 --2- 172.21.15.72:0/2498047875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe230004690 0x7fe230004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.708+0000 7fe24659c700 1 -- 172.21.15.72:0/2498047875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe230004690 msgr2=0x7fe230004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.708+0000 7fe24659c700 1 --2- 172.21.15.72:0/2498047875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe230004690 0x7fe230004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.708+0000 7fe24659c700 1 -- 172.21.15.72:0/2498047875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe230005000 msgr2=0x7fe23000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.708+0000 7fe24659c700 1 --2- 172.21.15.72:0/2498047875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe230005000 0x7fe23000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.708+0000 7fe24659c700 1 -- 172.21.15.72:0/2498047875 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2300033f0 con 0x7fe230003a70 2023-08-31T19:00:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.708+0000 7fe246d9d700 1 --2- 172.21.15.72:0/2498047875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe230005000 0x7fe23000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.708+0000 7fe246d9d700 1 -- 172.21.15.72:0/2498047875 reap_dead start 2023-08-31T19:00:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.708+0000 7fe24659c700 1 --2- 172.21.15.72:0/2498047875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe230003a70 0x7fe230003e70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fe2380018f0 tx=0x7fe238007c00).ready entity=mon.0 client_cookie=e4c0bf3441929dcf server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:54.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.708+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238007020 con 0x7fe230003a70 2023-08-31T19:00:54.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.708+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe238007180 con 0x7fe230003a70 2023-08-31T19:00:54.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.708+0000 7fe24559a700 1 -- 172.21.15.72:0/2498047875 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238007520 con 0x7fe230003a70 2023-08-31T19:00:54.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.709+0000 7fe24cfff700 1 -- 172.21.15.72:0/2498047875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe230003a70 msgr2=0x7fe230003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:54.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.709+0000 7fe24cfff700 1 --2- 172.21.15.72:0/2498047875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe230003a70 0x7fe230003e70 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fe2380018f0 tx=0x7fe238007c00).stop 2023-08-31T19:00:54.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.709+0000 7fe24cfff700 1 -- 172.21.15.72:0/2498047875 shutdown_connections 2023-08-31T19:00:54.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.709+0000 7fe24cfff700 1 --2- 172.21.15.72:0/2498047875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe230003a70 0x7fe230003e70 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:54.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.709+0000 7fe24cfff700 1 -- 172.21.15.72:0/2498047875 >> 172.21.15.72:0/2498047875 conn(0x7fe24805e870 msgr2=0x7fe2480cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:54.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.709+0000 7fe24cfff700 1 -- 172.21.15.72:0/2498047875 shutdown_connections 2023-08-31T19:00:54.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.709+0000 7fe24cfff700 1 -- 172.21.15.72:0/2498047875 wait complete. 2023-08-31T19:00:54.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.710+0000 7fe24cfff700 1 Processor -- start 2023-08-31T19:00:54.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.711+0000 7fe24cfff700 1 -- start start 2023-08-31T19:00:54.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.711+0000 7fe24cfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe230003a70 0x7fe248148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.711+0000 7fe24cfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2480a9ce0 0x7fe2480a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.712+0000 7fe24cfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe248152e20 0x7fe2481532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.712+0000 7fe24cfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24814a400 con 0x7fe2480a9ce0 2023-08-31T19:00:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.712+0000 7fe24cfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe248153790 con 0x7fe230003a70 2023-08-31T19:00:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.712+0000 7fe24cfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2481497f0 con 0x7fe248152e20 2023-08-31T19:00:54.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.712+0000 7fe245d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2480a9ce0 0x7fe2480a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:54.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.712+0000 7fe245d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2480a9ce0 0x7fe2480a84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38506/0 (socket says 172.21.15.72:38506) 2023-08-31T19:00:54.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.712+0000 7fe245d9b700 1 -- 172.21.15.72:0/3061392142 learned_addr learned my addr 172.21.15.72:0/3061392142 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:54.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.712+0000 7fe24659c700 1 --2- 172.21.15.72:0/3061392142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe230003a70 0x7fe248148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:54.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.712+0000 7fe246d9d700 1 --2- 172.21.15.72:0/3061392142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe248152e20 0x7fe2481532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:54.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.712+0000 7fe245d9b700 1 -- 172.21.15.72:0/3061392142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe248152e20 msgr2=0x7fe2481532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:54.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.712+0000 7fe245d9b700 1 --2- 172.21.15.72:0/3061392142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe248152e20 0x7fe2481532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:54.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.712+0000 7fe245d9b700 1 -- 172.21.15.72:0/3061392142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe230003a70 msgr2=0x7fe248148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:54.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.712+0000 7fe245d9b700 1 --2- 172.21.15.72:0/3061392142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe230003a70 0x7fe248148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.712+0000 7fe245d9b700 1 -- 172.21.15.72:0/3061392142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe248149ad0 con 0x7fe2480a9ce0 2023-08-31T19:00:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.712+0000 7fe245d9b700 1 --2- 172.21.15.72:0/3061392142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2480a9ce0 0x7fe2480a84f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fe23c00e540 tx=0x7fe23c00e850).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:54.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.713+0000 7fe2367fc700 1 -- 172.21.15.72:0/3061392142 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00eee0 con 0x7fe2480a9ce0 2023-08-31T19:00:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.713+0000 7fe2367fc700 1 -- 172.21.15.72:0/3061392142 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c010450 con 0x7fe2480a9ce0 2023-08-31T19:00:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.713+0000 7fe24cfff700 1 -- 172.21.15.72:0/3061392142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe248149db0 con 0x7fe2480a9ce0 2023-08-31T19:00:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.713+0000 7fe2367fc700 1 -- 172.21.15.72:0/3061392142 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0107d0 con 0x7fe2480a9ce0 2023-08-31T19:00:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.713+0000 7fe24cfff700 1 -- 172.21.15.72:0/3061392142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2481494a0 con 0x7fe2480a9ce0 2023-08-31T19:00:54.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.714+0000 7fe24cfff700 1 -- 172.21.15.72:0/3061392142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24806c6b0 con 0x7fe2480a9ce0 2023-08-31T19:00:54.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.715+0000 7fe2367fc700 1 -- 172.21.15.72:0/3061392142 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe23c010b40 con 0x7fe2480a9ce0 2023-08-31T19:00:54.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.715+0000 7fe2367fc700 1 --2- 172.21.15.72:0/3061392142 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe22805ef30 0x7fe2280613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:54.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.715+0000 7fe2367fc700 1 -- 172.21.15.72:0/3061392142 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6271+0+0 (secure 0 0 0) 0x7fe23c079f30 con 0x7fe2480a9ce0 2023-08-31T19:00:54.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.716+0000 7fe24659c700 1 --2- 172.21.15.72:0/3061392142 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe22805ef30 0x7fe2280613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:54.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.716+0000 7fe24659c700 1 --2- 172.21.15.72:0/3061392142 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe22805ef30 0x7fe2280613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe238000c00 tx=0x7fe238015000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:54.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.719+0000 7fe2367fc700 1 -- 172.21.15.72:0/3061392142 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe23c04b0d0 con 0x7fe2480a9ce0 2023-08-31T19:00:54.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:54.952+0000 7fe24cfff700 1 -- 172.21.15.72:0/3061392142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7fe24814a540 con 0x7fe2480a9ce0 2023-08-31T19:00:55.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.490+0000 7fe2367fc700 1 -- 172.21.15.72:0/3061392142 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v463) v1 ==== 157+0+0 (secure 0 0 0) 0x7fe23c04e6f0 con 0x7fe2480a9ce0 2023-08-31T19:00:55.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.492+0000 7fe24cfff700 1 -- 172.21.15.72:0/3061392142 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe22805ef30 msgr2=0x7fe2280613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:55.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.492+0000 7fe24cfff700 1 --2- 172.21.15.72:0/3061392142 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe22805ef30 0x7fe2280613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe238000c00 tx=0x7fe238015000).stop 2023-08-31T19:00:55.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.492+0000 7fe24cfff700 1 -- 172.21.15.72:0/3061392142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2480a9ce0 msgr2=0x7fe2480a84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:55.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.492+0000 7fe24cfff700 1 --2- 172.21.15.72:0/3061392142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2480a9ce0 0x7fe2480a84f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fe23c00e540 tx=0x7fe23c00e850).stop 2023-08-31T19:00:55.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.492+0000 7fe24cfff700 1 -- 172.21.15.72:0/3061392142 shutdown_connections 2023-08-31T19:00:55.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.492+0000 7fe24cfff700 1 --2- 172.21.15.72:0/3061392142 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe248152e20 0x7fe2481532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:55.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.492+0000 7fe24cfff700 1 --2- 172.21.15.72:0/3061392142 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe22805ef30 0x7fe2280613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:55.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.492+0000 7fe24cfff700 1 --2- 172.21.15.72:0/3061392142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe230003a70 0x7fe248148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:55.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.492+0000 7fe24cfff700 1 --2- 172.21.15.72:0/3061392142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2480a9ce0 0x7fe2480a84f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:55.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.492+0000 7fe24cfff700 1 -- 172.21.15.72:0/3061392142 >> 172.21.15.72:0/3061392142 conn(0x7fe24805e870 msgr2=0x7fe2480c6830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:55.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.493+0000 7fe24cfff700 1 -- 172.21.15.72:0/3061392142 shutdown_connections 2023-08-31T19:00:55.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.493+0000 7fe24cfff700 1 -- 172.21.15.72:0/3061392142 wait complete. 2023-08-31T19:00:55.511 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-31T19:00:55.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.703+0000 7f91f63ff700 1 Processor -- start 2023-08-31T19:00:55.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.703+0000 7f91f63ff700 1 -- start start 2023-08-31T19:00:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.704+0000 7f91f63ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91f0154210 0x7f91f00630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.704+0000 7f91f63ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91f00635a0 0x7f91f00c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:55.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.704+0000 7f91f63ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f0063a00 con 0x7f91f0153e30 2023-08-31T19:00:55.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.704+0000 7f91f63ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f0154690 con 0x7f91f00635a0 2023-08-31T19:00:55.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.704+0000 7f91f63ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00bfd40 con 0x7f91f0154210 2023-08-31T19:00:55.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.704+0000 7f91f499c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91f00635a0 0x7f91f00c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:55.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.704+0000 7f91f499c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91f00635a0 0x7f91f00c0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38508/0 (socket says 172.21.15.72:38508) 2023-08-31T19:00:55.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.704+0000 7f91f499c700 1 -- 172.21.15.72:0/2180587728 learned_addr learned my addr 172.21.15.72:0/2180587728 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:55.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.704+0000 7f91ef7fe700 1 --2- 172.21.15.72:0/2180587728 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91f0154210 0x7f91f00630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:55.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.705+0000 7f91f499c700 1 -- 172.21.15.72:0/2180587728 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91f0154210 msgr2=0x7f91f00630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:55.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.705+0000 7f91f499c700 1 --2- 172.21.15.72:0/2180587728 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91f0154210 0x7f91f00630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:55.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.705+0000 7f91f499c700 1 -- 172.21.15.72:0/2180587728 >> v1:172.21.15.146:6789/0 conn(0x7f91f0153e30 legacy=0x7f91f00c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:55.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.705+0000 7f91f499c700 1 -- 172.21.15.72:0/2180587728 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f00c6730 con 0x7f91f00635a0 2023-08-31T19:00:55.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.705+0000 7f91f499c700 1 --2- 172.21.15.72:0/2180587728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f00635a0 0x7f91f00c0ac0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f91e8009f20 tx=0x7f91e8009840).ready entity=mon.0 client_cookie=aebfa0ec92c04a4d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:55.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.705+0000 7f91eeffd700 1 -- 172.21.15.72:0/2180587728 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e800e070 con 0x7f91f00635a0 2023-08-31T19:00:55.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.705+0000 7f91eeffd700 1 -- 172.21.15.72:0/2180587728 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e800b9d0 con 0x7f91f00635a0 2023-08-31T19:00:55.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.705+0000 7f91eeffd700 1 -- 172.21.15.72:0/2180587728 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e800bd50 con 0x7f91f00635a0 2023-08-31T19:00:55.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.706+0000 7f91f63ff700 1 -- 172.21.15.72:0/2180587728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f00635a0 msgr2=0x7f91f00c0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:55.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.706+0000 7f91f63ff700 1 --2- 172.21.15.72:0/2180587728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f00635a0 0x7f91f00c0ac0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f91e8009f20 tx=0x7f91e8009840).stop 2023-08-31T19:00:55.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.706+0000 7f91f63ff700 1 -- 172.21.15.72:0/2180587728 shutdown_connections 2023-08-31T19:00:55.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.706+0000 7f91f63ff700 1 --2- 172.21.15.72:0/2180587728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f00635a0 0x7f91f00c0ac0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:55.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.706+0000 7f91f63ff700 1 --2- 172.21.15.72:0/2180587728 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91f0154210 0x7f91f00630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:55.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.706+0000 7f91f63ff700 1 -- 172.21.15.72:0/2180587728 >> 172.21.15.72:0/2180587728 conn(0x7f91f005eb20 msgr2=0x7f91f00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:55.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.706+0000 7f91f63ff700 1 -- 172.21.15.72:0/2180587728 shutdown_connections 2023-08-31T19:00:55.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.706+0000 7f91f63ff700 1 -- 172.21.15.72:0/2180587728 wait complete. 2023-08-31T19:00:55.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.707+0000 7f91f63ff700 1 Processor -- start 2023-08-31T19:00:55.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.708+0000 7f91f63ff700 1 -- start start 2023-08-31T19:00:55.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91f63ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f00635a0 0x7f91f0167980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:55.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91f63ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f0153e30 0x7f91f0167e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:55.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91f63ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91f0154210 0x7f91f01643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:55.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91f63ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f0168360 con 0x7f91f0153e30 2023-08-31T19:00:55.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91f63ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f0166190 con 0x7f91f00635a0 2023-08-31T19:00:55.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91f63ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00c26a0 con 0x7f91f0154210 2023-08-31T19:00:55.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91ef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f0153e30 0x7f91f0167e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:55.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91ef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f0153e30 0x7f91f0167e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38512/0 (socket says 172.21.15.72:38512) 2023-08-31T19:00:55.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91ef7fe700 1 -- 172.21.15.72:0/1123476496 learned_addr learned my addr 172.21.15.72:0/1123476496 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:55.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91effff700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f00635a0 0x7f91f0167980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:55.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91f499c700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91f0154210 0x7f91f01643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:55.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91ef7fe700 1 -- 172.21.15.72:0/1123476496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91f0154210 msgr2=0x7f91f01643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:55.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91ef7fe700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91f0154210 0x7f91f01643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:55.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91ef7fe700 1 -- 172.21.15.72:0/1123476496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f00635a0 msgr2=0x7f91f0167980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:55.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91ef7fe700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f00635a0 0x7f91f0167980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:55.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91ef7fe700 1 -- 172.21.15.72:0/1123476496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e8009ae0 con 0x7f91f0153e30 2023-08-31T19:00:55.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91effff700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f00635a0 0x7f91f0167980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:55.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91f499c700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91f0154210 0x7f91f01643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:55.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.709+0000 7f91ef7fe700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f0153e30 0x7f91f0167e70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f91e400e930 tx=0x7f91e4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:55.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.710+0000 7f91d7fff700 1 -- 172.21.15.72:0/1123476496 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e400c640 con 0x7f91f0153e30 2023-08-31T19:00:55.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.710+0000 7f91d7fff700 1 -- 172.21.15.72:0/1123476496 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e400c7a0 con 0x7f91f0153e30 2023-08-31T19:00:55.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.710+0000 7f91d7fff700 1 -- 172.21.15.72:0/1123476496 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e400cb20 con 0x7f91f0153e30 2023-08-31T19:00:55.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.710+0000 7f91f63ff700 1 -- 172.21.15.72:0/1123476496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f0165580 con 0x7f91f0153e30 2023-08-31T19:00:55.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.710+0000 7f91f63ff700 1 -- 172.21.15.72:0/1123476496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f0165b40 con 0x7f91f0153e30 2023-08-31T19:00:55.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.711+0000 7f91f63ff700 1 -- 172.21.15.72:0/1123476496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f006c6b0 con 0x7f91f0153e30 2023-08-31T19:00:55.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.712+0000 7f91d7fff700 1 -- 172.21.15.72:0/1123476496 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f91e401b400 con 0x7f91f0153e30 2023-08-31T19:00:55.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.712+0000 7f91d7fff700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f91dc05ef30 0x7f91dc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:55.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.713+0000 7f91d7fff700 1 -- 172.21.15.72:0/1123476496 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6271+0+0 (secure 0 0 0) 0x7f91e407a470 con 0x7f91f0153e30 2023-08-31T19:00:55.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.713+0000 7f91effff700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f91dc05ef30 0x7f91dc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:55.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.713+0000 7f91effff700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f91dc05ef30 0x7f91dc0613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f91e0001730 tx=0x7f91e0009040).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:55.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.717+0000 7f91d7fff700 1 -- 172.21.15.72:0/1123476496 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f91e404b670 con 0x7f91f0153e30 2023-08-31T19:00:55.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.886+0000 7f91f63ff700 1 -- 172.21.15.72:0/1123476496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f91f0062970 con 0x7f91f0153e30 2023-08-31T19:00:55.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.890+0000 7f91d7fff700 1 -- 172.21.15.72:0/1123476496 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f91e4016020 con 0x7f91f0153e30 2023-08-31T19:00:55.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.892+0000 7f91f63ff700 1 -- 172.21.15.72:0/1123476496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f91dc05ef30 msgr2=0x7f91dc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:55.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.892+0000 7f91f63ff700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f91dc05ef30 0x7f91dc0613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f91e0001730 tx=0x7f91e0009040).stop 2023-08-31T19:00:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.892+0000 7f91f63ff700 1 -- 172.21.15.72:0/1123476496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f0153e30 msgr2=0x7f91f0167e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.892+0000 7f91f63ff700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f0153e30 0x7f91f0167e70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f91e400e930 tx=0x7f91e4009060).stop 2023-08-31T19:00:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.892+0000 7f91f63ff700 1 -- 172.21.15.72:0/1123476496 shutdown_connections 2023-08-31T19:00:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.892+0000 7f91f63ff700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91f0154210 0x7f91f01643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:55.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.892+0000 7f91f63ff700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f91dc05ef30 0x7f91dc0613f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:55.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.892+0000 7f91f63ff700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91f00635a0 0x7f91f0167980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:55.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.892+0000 7f91f63ff700 1 --2- 172.21.15.72:0/1123476496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f0153e30 0x7f91f0167e70 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:55.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.892+0000 7f91f63ff700 1 -- 172.21.15.72:0/1123476496 >> 172.21.15.72:0/1123476496 conn(0x7f91f005eb20 msgr2=0x7f91f00c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:55.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.892+0000 7f91f63ff700 1 -- 172.21.15.72:0/1123476496 shutdown_connections 2023-08-31T19:00:55.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:55.892+0000 7f91f63ff700 1 -- 172.21.15.72:0/1123476496 wait complete. 2023-08-31T19:00:55.909 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:00:55.910 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:00:56.007 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:00:56.115 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:00:56.116 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-31T19:00:56.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:00:56.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.305+0000 7f40735ff700 1 Processor -- start 2023-08-31T19:00:56.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.305+0000 7f40735ff700 1 -- start start 2023-08-31T19:00:56.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.306+0000 7f40735ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c0a9eb0 0x7f406c0aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:56.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.306+0000 7f40735ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f406c0c5bf0 0x7f406c0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:56.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.306+0000 7f40735ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f406c156fc0 0x7f406c157470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:56.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.306+0000 7f40735ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406c0bfd00 con 0x7f406c156fc0 2023-08-31T19:00:56.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.306+0000 7f40735ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406c0c05a0 con 0x7f406c0c5bf0 2023-08-31T19:00:56.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.306+0000 7f40735ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0aaea0 con 0x7f406c0a9eb0 2023-08-31T19:00:56.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.307+0000 7f4071b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f406c156fc0 0x7f406c157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:56.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.307+0000 7f4071b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f406c156fc0 0x7f406c157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38516/0 (socket says 172.21.15.72:38516) 2023-08-31T19:00:56.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.307+0000 7f4071b9c700 1 -- 172.21.15.72:0/2712532653 learned_addr learned my addr 172.21.15.72:0/2712532653 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:56.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.307+0000 7f4070b9a700 1 --2- 172.21.15.72:0/2712532653 >> v2:172.21.15.146:3300/0 conn(0x7f406c0c5bf0 0x7f406c0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:56.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.307+0000 7f407139b700 1 --2- 172.21.15.72:0/2712532653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c0a9eb0 0x7f406c0aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:56.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.307+0000 7f4071b9c700 1 -- 172.21.15.72:0/2712532653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c0a9eb0 msgr2=0x7f406c0aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:56.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.307+0000 7f4071b9c700 1 --2- 172.21.15.72:0/2712532653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c0a9eb0 0x7f406c0aa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:56.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.307+0000 7f4071b9c700 1 -- 172.21.15.72:0/2712532653 >> v2:172.21.15.146:3300/0 conn(0x7f406c0c5bf0 msgr2=0x7f406c0c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:56.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.307+0000 7f4071b9c700 1 --2- 172.21.15.72:0/2712532653 >> v2:172.21.15.146:3300/0 conn(0x7f406c0c5bf0 0x7f406c0c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:56.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.307+0000 7f4071b9c700 1 -- 172.21.15.72:0/2712532653 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c0c6670 con 0x7f406c156fc0 2023-08-31T19:00:56.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.307+0000 7f4071b9c700 1 --2- 172.21.15.72:0/2712532653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406c156fc0 0x7f406c157470 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f406c064060 tx=0x7f4064009840).ready entity=mon.0 client_cookie=25b2a603d098717a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:56.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.308+0000 7f4063fff700 1 -- 172.21.15.72:0/2712532653 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406400e070 con 0x7f406c156fc0 2023-08-31T19:00:56.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.308+0000 7f4063fff700 1 -- 172.21.15.72:0/2712532653 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406400b970 con 0x7f406c156fc0 2023-08-31T19:00:56.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.308+0000 7f4063fff700 1 -- 172.21.15.72:0/2712532653 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406400bcf0 con 0x7f406c156fc0 2023-08-31T19:00:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.308+0000 7f40735ff700 1 -- 172.21.15.72:0/2712532653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406c156fc0 msgr2=0x7f406c157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.308+0000 7f40735ff700 1 --2- 172.21.15.72:0/2712532653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406c156fc0 0x7f406c157470 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f406c064060 tx=0x7f4064009840).stop 2023-08-31T19:00:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.308+0000 7f40735ff700 1 -- 172.21.15.72:0/2712532653 shutdown_connections 2023-08-31T19:00:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.308+0000 7f40735ff700 1 --2- 172.21.15.72:0/2712532653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406c156fc0 0x7f406c157470 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:56.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.308+0000 7f40735ff700 1 --2- 172.21.15.72:0/2712532653 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c0a9eb0 0x7f406c0aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:56.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.308+0000 7f40735ff700 1 --2- 172.21.15.72:0/2712532653 >> v2:172.21.15.146:3300/0 conn(0x7f406c0c5bf0 0x7f406c0c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:56.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.308+0000 7f40735ff700 1 -- 172.21.15.72:0/2712532653 >> 172.21.15.72:0/2712532653 conn(0x7f406c0c82e0 msgr2=0x7f406c05e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:56.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.308+0000 7f40735ff700 1 -- 172.21.15.72:0/2712532653 shutdown_connections 2023-08-31T19:00:56.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.308+0000 7f40735ff700 1 -- 172.21.15.72:0/2712532653 wait complete. 2023-08-31T19:00:56.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.310+0000 7f40735ff700 1 Processor -- start 2023-08-31T19:00:56.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.310+0000 7f40735ff700 1 -- start start 2023-08-31T19:00:56.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.311+0000 7f40735ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c0a9eb0 0x7f406c164d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:56.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.311+0000 7f40735ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406c0c5bf0 0x7f406c1678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:56.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.311+0000 7f40735ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406c156fc0 0x7f406c14c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:56.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.311+0000 7f40735ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c164320 con 0x7f406c156fc0 2023-08-31T19:00:56.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.311+0000 7f40735ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c165200 con 0x7f406c0c5bf0 2023-08-31T19:00:56.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.311+0000 7f40735ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c1682d0 con 0x7f406c0a9eb0 2023-08-31T19:00:56.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.311+0000 7f4071b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406c156fc0 0x7f406c14c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:56.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.311+0000 7f4071b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406c156fc0 0x7f406c14c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38524/0 (socket says 172.21.15.72:38524) 2023-08-31T19:00:56.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.311+0000 7f4071b9c700 1 -- 172.21.15.72:0/2458714404 learned_addr learned my addr 172.21.15.72:0/2458714404 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:56.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.311+0000 7f4071b9c700 1 -- 172.21.15.72:0/2458714404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c0a9eb0 msgr2=0x7f406c164d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:56.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.311+0000 7f4070b9a700 1 --2- 172.21.15.72:0/2458714404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406c0c5bf0 0x7f406c1678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:56.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.311+0000 7f4071b9c700 1 --2- 172.21.15.72:0/2458714404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c0a9eb0 0x7f406c164d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:56.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.311+0000 7f4071b9c700 1 -- 172.21.15.72:0/2458714404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406c0c5bf0 msgr2=0x7f406c1678f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:56.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.312+0000 7f4071b9c700 1 --2- 172.21.15.72:0/2458714404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406c0c5bf0 0x7f406c1678f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:56.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.312+0000 7f4071b9c700 1 -- 172.21.15.72:0/2458714404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4064009ae0 con 0x7f406c156fc0 2023-08-31T19:00:56.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.312+0000 7f4071b9c700 1 --2- 172.21.15.72:0/2458714404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406c156fc0 0x7f406c14c920 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f406400be10 tx=0x7f4064009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:56.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.312+0000 7f40617fa700 1 -- 172.21.15.72:0/2458714404 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064013e60 con 0x7f406c156fc0 2023-08-31T19:00:56.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.312+0000 7f40617fa700 1 -- 172.21.15.72:0/2458714404 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40640092e0 con 0x7f406c156fc0 2023-08-31T19:00:56.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.312+0000 7f40735ff700 1 -- 172.21.15.72:0/2458714404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406c1685b0 con 0x7f406c156fc0 2023-08-31T19:00:56.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.312+0000 7f40617fa700 1 -- 172.21.15.72:0/2458714404 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064007860 con 0x7f406c156fc0 2023-08-31T19:00:56.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.312+0000 7f40735ff700 1 -- 172.21.15.72:0/2458714404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c1647f0 con 0x7f406c156fc0 2023-08-31T19:00:56.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.313+0000 7f40735ff700 1 -- 172.21.15.72:0/2458714404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406c1649e0 con 0x7f406c156fc0 2023-08-31T19:00:56.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.314+0000 7f40617fa700 1 -- 172.21.15.72:0/2458714404 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4064003040 con 0x7f406c156fc0 2023-08-31T19:00:56.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.315+0000 7f40617fa700 1 --2- 172.21.15.72:0/2458714404 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f405005ef30 0x7f40500613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:56.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.315+0000 7f40617fa700 1 -- 172.21.15.72:0/2458714404 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6271+0+0 (secure 0 0 0) 0x7f406407bd20 con 0x7f406c156fc0 2023-08-31T19:00:56.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.315+0000 7f407139b700 1 --2- 172.21.15.72:0/2458714404 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f405005ef30 0x7f40500613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:56.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.316+0000 7f407139b700 1 --2- 172.21.15.72:0/2458714404 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f405005ef30 0x7f40500613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4068009990 tx=0x7f4068009060).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:56.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.319+0000 7f40617fa700 1 -- 172.21.15.72:0/2458714404 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f406404cec0 con 0x7f406c156fc0 2023-08-31T19:00:56.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.527+0000 7f40735ff700 1 -- 172.21.15.72:0/2458714404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f406c06c6b0 con 0x7f406c156fc0 2023-08-31T19:00:56.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.527+0000 7f40617fa700 1 -- 172.21.15.72:0/2458714404 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f4064024030 con 0x7f406c156fc0 2023-08-31T19:00:56.528 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:56.528 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/682775915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":682775915},{"type":"v1","addr":"172.21.15.146:6835","nonce":682775915}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/934559211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":934559211},{"type":"v1","addr":"172.21.15.72:6836","nonce":934559211}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2587704834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2587704834},{"type":"v1","addr":"172.21.15.72:6837","nonce":2587704834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5422,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3925501961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3925501961},{"type":"v1","addr":"172.21.15.146:6834","nonce":3925501961}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[]} 2023-08-31T19:00:56.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.530+0000 7f40735ff700 1 -- 172.21.15.72:0/2458714404 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f405005ef30 msgr2=0x7f40500613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:56.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.530+0000 7f40735ff700 1 --2- 172.21.15.72:0/2458714404 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f405005ef30 0x7f40500613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4068009990 tx=0x7f4068009060).stop 2023-08-31T19:00:56.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.530+0000 7f40735ff700 1 -- 172.21.15.72:0/2458714404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406c156fc0 msgr2=0x7f406c14c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:56.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.530+0000 7f40735ff700 1 --2- 172.21.15.72:0/2458714404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406c156fc0 0x7f406c14c920 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f406400be10 tx=0x7f4064009840).stop 2023-08-31T19:00:56.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.530+0000 7f40735ff700 1 -- 172.21.15.72:0/2458714404 shutdown_connections 2023-08-31T19:00:56.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.530+0000 7f40735ff700 1 --2- 172.21.15.72:0/2458714404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406c156fc0 0x7f406c14c920 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:56.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.530+0000 7f40735ff700 1 --2- 172.21.15.72:0/2458714404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f406c0a9eb0 0x7f406c164d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:56.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.530+0000 7f40735ff700 1 --2- 172.21.15.72:0/2458714404 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f405005ef30 0x7f40500613f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:56.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.530+0000 7f40735ff700 1 --2- 172.21.15.72:0/2458714404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f406c0c5bf0 0x7f406c1678f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:56.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.530+0000 7f40735ff700 1 -- 172.21.15.72:0/2458714404 >> 172.21.15.72:0/2458714404 conn(0x7f406c0c82e0 msgr2=0x7f406c0ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:56.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.530+0000 7f40735ff700 1 -- 172.21.15.72:0/2458714404 shutdown_connections 2023-08-31T19:00:56.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.530+0000 7f40735ff700 1 -- 172.21.15.72:0/2458714404 wait complete. 2023-08-31T19:00:56.533 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2023-08-31T19:00:56.547 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T19:00:56.548 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-31T19:00:56.548 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T19:00:56.548 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:00:56.548 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T19:00:56.549 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-31T19:00:56.549 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T19:00:56.549 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:00:56.550 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T19:00:56.550 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-31T19:00:56.550 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T19:00:56.550 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:00:56.551 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T19:00:56.551 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-31T19:00:56.551 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T19:00:56.551 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:00:56.562 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T19:00:56.563 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T19:00:56.564 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T19:00:56.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T19:00:56.566 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T19:00:56.566 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T19:00:56.568 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T19:00:56.568 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T19:00:56.608 INFO:tasks.ceph.mds.a:Started 2023-08-31T19:00:56.608 DEBUG:teuthology.parallel:result is None 2023-08-31T19:00:56.611 INFO:tasks.ceph.mds.c:Started 2023-08-31T19:00:56.612 DEBUG:teuthology.parallel:result is None 2023-08-31T19:00:56.613 INFO:tasks.ceph.mds.b:Started 2023-08-31T19:00:56.613 DEBUG:teuthology.parallel:result is None 2023-08-31T19:00:56.616 INFO:tasks.ceph.mds.d:Started 2023-08-31T19:00:56.617 DEBUG:teuthology.parallel:result is None 2023-08-31T19:00:56.617 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-31T19:00:56.749 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T19:00:56.752 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-31T19:00:56.761 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-08-31T19:00:56.761 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-08-31T19:00:56.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.819+0000 7f77247ff700 1 Processor -- start 2023-08-31T19:00:56.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.820+0000 7f77247ff700 1 -- start start 2023-08-31T19:00:56.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.821+0000 7f77247ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c0bc300 0x7f771c069410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:56.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.821+0000 7f77247ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771c063f50 con 0x7f771c153e10 2023-08-31T19:00:56.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.821+0000 7f77247ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771c0c24a0 con 0x7f771c1580c0 2023-08-31T19:00:56.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.821+0000 7f77247ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771c069ae0 con 0x7f771c0bc300 2023-08-31T19:00:56.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.821+0000 7f7722d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f771c153e10 0x7f771c1542a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55346/0 (socket says 172.21.15.72:55346) 2023-08-31T19:00:56.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.821+0000 7f7722d9c700 1 -- 172.21.15.72:0/1191257866 learned_addr learned my addr 172.21.15.72:0/1191257866 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:00:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.821+0000 7f7721d9a700 1 --2- 172.21.15.72:0/1191257866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c0bc300 0x7f771c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.822+0000 7f7721599700 1 -- 172.21.15.72:0/1191257866 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228955554 0 0) 0x7f771c063f50 con 0x7f771c153e10 2023-08-31T19:00:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.822+0000 7f7721599700 1 -- 172.21.15.72:0/1191257866 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77080033f0 con 0x7f771c153e10 2023-08-31T19:00:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.822+0000 7f7721599700 1 -- 172.21.15.72:0/1191257866 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181345889 0 0) 0x7f771c0c24a0 con 0x7f771c1580c0 2023-08-31T19:00:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.822+0000 7f7721599700 1 -- 172.21.15.72:0/1191257866 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f771c063f50 con 0x7f771c1580c0 2023-08-31T19:00:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.822+0000 7f7721d9a700 1 -- 172.21.15.72:0/1191257866 >> v1:172.21.15.146:6789/0 conn(0x7f771c1580c0 legacy=0x7f771c1584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.822+0000 7f7721d9a700 1 -- 172.21.15.72:0/1191257866 >> v1:172.21.15.72:6789/0 conn(0x7f771c153e10 legacy=0x7f771c1542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.822+0000 7f7721d9a700 1 -- 172.21.15.72:0/1191257866 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771c0c1ee0 con 0x7f771c0bc300 2023-08-31T19:00:56.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.822+0000 7f7721d9a700 1 --2- 172.21.15.72:0/1191257866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c0bc300 0x7f771c069410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f770c0097c0 tx=0x7f770c009060).ready entity=mon.2 client_cookie=de8af396eed42369 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:56.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.822+0000 7f7721599700 1 -- 172.21.15.72:0/1191257866 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c00d4a0 con 0x7f771c0bc300 2023-08-31T19:00:56.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.822+0000 7f7721599700 1 -- 172.21.15.72:0/1191257866 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c00d600 con 0x7f771c0bc300 2023-08-31T19:00:56.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.822+0000 7f7721599700 1 -- 172.21.15.72:0/1191257866 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c00d980 con 0x7f771c0bc300 2023-08-31T19:00:56.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.823+0000 7f77247ff700 1 -- 172.21.15.72:0/1191257866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c0bc300 msgr2=0x7f771c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:56.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.823+0000 7f77247ff700 1 --2- 172.21.15.72:0/1191257866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c0bc300 0x7f771c069410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f770c0097c0 tx=0x7f770c009060).stop 2023-08-31T19:00:56.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.823+0000 7f77247ff700 1 -- 172.21.15.72:0/1191257866 shutdown_connections 2023-08-31T19:00:56.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.823+0000 7f77247ff700 1 --2- 172.21.15.72:0/1191257866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c0bc300 0x7f771c069410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:56.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.823+0000 7f77247ff700 1 -- 172.21.15.72:0/1191257866 >> 172.21.15.72:0/1191257866 conn(0x7f771c0c73a0 msgr2=0x7f771c0c77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:56.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.823+0000 7f77247ff700 1 -- 172.21.15.72:0/1191257866 shutdown_connections 2023-08-31T19:00:56.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.823+0000 7f77247ff700 1 -- 172.21.15.72:0/1191257866 wait complete. 2023-08-31T19:00:56.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.825+0000 7f77247ff700 1 Processor -- start 2023-08-31T19:00:56.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.825+0000 7f77247ff700 1 -- start start 2023-08-31T19:00:56.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f77247ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f771c0bc300 0x7f771c13e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:56.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f77247ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c153e10 0x7f771c151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:56.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f77247ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c1580c0 0x7f771c152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:56.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f77247ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c069900 con 0x7f771c0bc300 2023-08-31T19:00:56.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f77247ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c0c0420 con 0x7f771c1580c0 2023-08-31T19:00:56.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f77247ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771c0c0700 con 0x7f771c153e10 2023-08-31T19:00:56.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f772259b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f771c0bc300 0x7f771c13e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:56.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f772259b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f771c0bc300 0x7f771c13e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38540/0 (socket says 172.21.15.72:38540) 2023-08-31T19:00:56.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f772259b700 1 -- 172.21.15.72:0/740106992 learned_addr learned my addr 172.21.15.72:0/740106992 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:56.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f7721d9a700 1 --2- 172.21.15.72:0/740106992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c153e10 0x7f771c151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:56.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f7722d9c700 1 --2- 172.21.15.72:0/740106992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c1580c0 0x7f771c152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:56.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f772259b700 1 -- 172.21.15.72:0/740106992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c153e10 msgr2=0x7f771c151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:56.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f772259b700 1 --2- 172.21.15.72:0/740106992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c153e10 0x7f771c151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:56.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f772259b700 1 -- 172.21.15.72:0/740106992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c1580c0 msgr2=0x7f771c152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:56.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f772259b700 1 --2- 172.21.15.72:0/740106992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c1580c0 0x7f771c152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:56.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.826+0000 7f772259b700 1 -- 172.21.15.72:0/740106992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c0092a0 con 0x7f771c0bc300 2023-08-31T19:00:56.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.827+0000 7f772259b700 1 --2- 172.21.15.72:0/740106992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f771c0bc300 0x7f771c13e790 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f771800c440 tx=0x7f7718007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:56.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.827+0000 7f77127fc700 1 -- 172.21.15.72:0/740106992 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718012400 con 0x7f771c0bc300 2023-08-31T19:00:56.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.827+0000 7f77127fc700 1 -- 172.21.15.72:0/740106992 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7718012560 con 0x7f771c0bc300 2023-08-31T19:00:56.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.827+0000 7f77247ff700 1 -- 172.21.15.72:0/740106992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f771c0c09e0 con 0x7f771c0bc300 2023-08-31T19:00:56.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.827+0000 7f77127fc700 1 -- 172.21.15.72:0/740106992 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718012920 con 0x7f771c0bc300 2023-08-31T19:00:56.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.827+0000 7f77247ff700 1 -- 172.21.15.72:0/740106992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771c0c0fa0 con 0x7f771c0bc300 2023-08-31T19:00:56.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.828+0000 7f77247ff700 1 -- 172.21.15.72:0/740106992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771c06c6b0 con 0x7f771c0bc300 2023-08-31T19:00:56.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.829+0000 7f77127fc700 1 -- 172.21.15.72:0/740106992 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f771801b3b0 con 0x7f771c0bc300 2023-08-31T19:00:56.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.830+0000 7f77127fc700 1 --2- 172.21.15.72:0/740106992 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f770005ef30 0x7f77000613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:56.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.830+0000 7f77127fc700 1 -- 172.21.15.72:0/740106992 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6271+0+0 (secure 0 0 0) 0x7f7718079880 con 0x7f771c0bc300 2023-08-31T19:00:56.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.830+0000 7f7721d9a700 1 --2- 172.21.15.72:0/740106992 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f770005ef30 0x7f77000613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:56.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.830+0000 7f7721d9a700 1 --2- 172.21.15.72:0/740106992 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f770005ef30 0x7f77000613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f770c0096e0 tx=0x7f770c016000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:56.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:56.834+0000 7f77127fc700 1 -- 172.21.15.72:0/740106992 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f771804aa80 con 0x7f771c0bc300 2023-08-31T19:00:57.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:57.018+0000 7f77247ff700 1 -- 172.21.15.72:0/740106992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f771c0c6f60 con 0x7f771c0bc300 2023-08-31T19:00:57.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:57.895+0000 7f77127fc700 1 -- 172.21.15.72:0/740106992 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v57) v1 ==== 97+0+0 (secure 0 0 0) 0x7f771804e0a0 con 0x7f771c0bc300 2023-08-31T19:00:57.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:57.898+0000 7f77247ff700 1 -- 172.21.15.72:0/740106992 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f770005ef30 msgr2=0x7f77000613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:57.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:57.898+0000 7f77247ff700 1 --2- 172.21.15.72:0/740106992 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f770005ef30 0x7f77000613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f770c0096e0 tx=0x7f770c016000).stop 2023-08-31T19:00:57.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:57.898+0000 7f77247ff700 1 -- 172.21.15.72:0/740106992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f771c0bc300 msgr2=0x7f771c13e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:57.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:57.898+0000 7f77247ff700 1 --2- 172.21.15.72:0/740106992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f771c0bc300 0x7f771c13e790 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f771800c440 tx=0x7f7718007c80).stop 2023-08-31T19:00:57.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:57.898+0000 7f77247ff700 1 -- 172.21.15.72:0/740106992 shutdown_connections 2023-08-31T19:00:57.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:57.898+0000 7f77247ff700 1 --2- 172.21.15.72:0/740106992 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f770005ef30 0x7f77000613f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:57.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:57.898+0000 7f77247ff700 1 --2- 172.21.15.72:0/740106992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f771c1580c0 0x7f771c152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:57.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:57.898+0000 7f77247ff700 1 --2- 172.21.15.72:0/740106992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f771c0bc300 0x7f771c13e790 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:57.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:57.898+0000 7f77247ff700 1 --2- 172.21.15.72:0/740106992 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f771c153e10 0x7f771c151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:57.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:57.898+0000 7f77247ff700 1 -- 172.21.15.72:0/740106992 >> 172.21.15.72:0/740106992 conn(0x7f771c0c73a0 msgr2=0x7f771c0c54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:57.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:57.898+0000 7f77247ff700 1 -- 172.21.15.72:0/740106992 shutdown_connections 2023-08-31T19:00:57.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:57.898+0000 7f77247ff700 1 -- 172.21.15.72:0/740106992 wait complete. 2023-08-31T19:00:57.901 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-08-31T19:00:57.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-31T19:00:58.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.112+0000 7f0be97ff700 1 Processor -- start 2023-08-31T19:00:58.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.112+0000 7f0be97ff700 1 -- start start 2023-08-31T19:00:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.113+0000 7f0be97ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0be41505b0 0x7f0be40c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:58.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be97ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0be40c2b10 0x7f0be40c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:58.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be97ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0be4150990 0x7f0be4150e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:58.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be97ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be40c2720 con 0x7f0be41505b0 2023-08-31T19:00:58.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be97ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be40641e0 con 0x7f0be40c2b10 2023-08-31T19:00:58.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be97ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be4068b90 con 0x7f0be4150990 2023-08-31T19:00:58.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0be41505b0 0x7f0be40c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:58.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0be41505b0 0x7f0be40c1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38544/0 (socket says 172.21.15.72:38544) 2023-08-31T19:00:58.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be2ffd700 1 -- 172.21.15.72:0/2237022159 learned_addr learned my addr 172.21.15.72:0/2237022159 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:58.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be37fe700 1 --2- 172.21.15.72:0/2237022159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0be4150990 0x7f0be4150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:58.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be27fc700 1 --2- 172.21.15.72:0/2237022159 >> v2:172.21.15.146:3300/0 conn(0x7f0be40c2b10 0x7f0be40c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:58.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be2ffd700 1 -- 172.21.15.72:0/2237022159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0be4150990 msgr2=0x7f0be4150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:58.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be2ffd700 1 --2- 172.21.15.72:0/2237022159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0be4150990 0x7f0be4150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be2ffd700 1 -- 172.21.15.72:0/2237022159 >> v2:172.21.15.146:3300/0 conn(0x7f0be40c2b10 msgr2=0x7f0be40c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:58.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be2ffd700 1 --2- 172.21.15.72:0/2237022159 >> v2:172.21.15.146:3300/0 conn(0x7f0be40c2b10 0x7f0be40c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be2ffd700 1 -- 172.21.15.72:0/2237022159 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be4151330 con 0x7f0be41505b0 2023-08-31T19:00:58.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be37fe700 1 --2- 172.21.15.72:0/2237022159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0be4150990 0x7f0be4150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:58.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.114+0000 7f0be2ffd700 1 --2- 172.21.15.72:0/2237022159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0be41505b0 0x7f0be40c1d40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f0be40637d0 tx=0x7f0bd400a2b0).ready entity=mon.0 client_cookie=25739dde7d352788 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:58.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.115+0000 7f0be1ffb700 1 -- 172.21.15.72:0/2237022159 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400c930 con 0x7f0be41505b0 2023-08-31T19:00:58.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.115+0000 7f0be1ffb700 1 -- 172.21.15.72:0/2237022159 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd400ca90 con 0x7f0be41505b0 2023-08-31T19:00:58.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.115+0000 7f0be1ffb700 1 -- 172.21.15.72:0/2237022159 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400ce10 con 0x7f0be41505b0 2023-08-31T19:00:58.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.115+0000 7f0be97ff700 1 -- 172.21.15.72:0/2237022159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0be41505b0 msgr2=0x7f0be40c1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:58.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.115+0000 7f0be97ff700 1 --2- 172.21.15.72:0/2237022159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0be41505b0 0x7f0be40c1d40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f0be40637d0 tx=0x7f0bd400a2b0).stop 2023-08-31T19:00:58.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.115+0000 7f0be97ff700 1 -- 172.21.15.72:0/2237022159 shutdown_connections 2023-08-31T19:00:58.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.115+0000 7f0be97ff700 1 --2- 172.21.15.72:0/2237022159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0be4150990 0x7f0be4150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.115+0000 7f0be97ff700 1 --2- 172.21.15.72:0/2237022159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0be41505b0 0x7f0be40c1d40 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.115+0000 7f0be97ff700 1 --2- 172.21.15.72:0/2237022159 >> v2:172.21.15.146:3300/0 conn(0x7f0be40c2b10 0x7f0be40c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.115+0000 7f0be97ff700 1 -- 172.21.15.72:0/2237022159 >> 172.21.15.72:0/2237022159 conn(0x7f0be40c6b10 msgr2=0x7f0be40c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:58.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.115+0000 7f0be97ff700 1 -- 172.21.15.72:0/2237022159 shutdown_connections 2023-08-31T19:00:58.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.115+0000 7f0be97ff700 1 -- 172.21.15.72:0/2237022159 wait complete. 2023-08-31T19:00:58.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.117+0000 7f0be97ff700 1 Processor -- start 2023-08-31T19:00:58.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.117+0000 7f0be97ff700 1 -- start start 2023-08-31T19:00:58.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.118+0000 7f0be97ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0be40c2b10 0x7f0be4151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:58.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.118+0000 7f0be97ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0be41505b0 0x7f0be4160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:58.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.118+0000 7f0be97ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0be4150990 0x7f0be4154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:58.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.118+0000 7f0be97ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be4161210 con 0x7f0be40c2b10 2023-08-31T19:00:58.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.118+0000 7f0be97ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be41541b0 con 0x7f0be41505b0 2023-08-31T19:00:58.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.118+0000 7f0be97ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be41535a0 con 0x7f0be4150990 2023-08-31T19:00:58.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.118+0000 7f0be2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0be40c2b10 0x7f0be4151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:58.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.118+0000 7f0be2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0be40c2b10 0x7f0be4151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38550/0 (socket says 172.21.15.72:38550) 2023-08-31T19:00:58.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.118+0000 7f0be2ffd700 1 -- 172.21.15.72:0/3548868404 learned_addr learned my addr 172.21.15.72:0/3548868404 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:58.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.118+0000 7f0be37fe700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0be4150990 0x7f0be4154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:58.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.118+0000 7f0be27fc700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0be41505b0 0x7f0be4160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:58.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.119+0000 7f0be2ffd700 1 -- 172.21.15.72:0/3548868404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0be4150990 msgr2=0x7f0be4154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:58.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.119+0000 7f0be2ffd700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0be4150990 0x7f0be4154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.119+0000 7f0be2ffd700 1 -- 172.21.15.72:0/3548868404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0be41505b0 msgr2=0x7f0be4160d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:58.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.119+0000 7f0be2ffd700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0be41505b0 0x7f0be4160d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.119+0000 7f0be2ffd700 1 -- 172.21.15.72:0/3548868404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd400a510 con 0x7f0be40c2b10 2023-08-31T19:00:58.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.119+0000 7f0be37fe700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0be4150990 0x7f0be4154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:58.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.119+0000 7f0be27fc700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0be41505b0 0x7f0be4160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:00:58.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.119+0000 7f0be2ffd700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0be40c2b10 0x7f0be4151d80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f0bd4013000 tx=0x7f0bd4019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:58.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.119+0000 7f0bcaffd700 1 -- 172.21.15.72:0/3548868404 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400ae10 con 0x7f0be40c2b10 2023-08-31T19:00:58.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.119+0000 7f0bcaffd700 1 -- 172.21.15.72:0/3548868404 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd4021410 con 0x7f0be40c2b10 2023-08-31T19:00:58.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.119+0000 7f0be97ff700 1 -- 172.21.15.72:0/3548868404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be4153880 con 0x7f0be40c2b10 2023-08-31T19:00:58.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.119+0000 7f0bcaffd700 1 -- 172.21.15.72:0/3548868404 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40217d0 con 0x7f0be40c2b10 2023-08-31T19:00:58.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.119+0000 7f0be97ff700 1 -- 172.21.15.72:0/3548868404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be4153e40 con 0x7f0be40c2b10 2023-08-31T19:00:58.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.120+0000 7f0be97ff700 1 -- 172.21.15.72:0/3548868404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be406c6b0 con 0x7f0be40c2b10 2023-08-31T19:00:58.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.121+0000 7f0bcaffd700 1 -- 172.21.15.72:0/3548868404 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0bd4017400 con 0x7f0be40c2b10 2023-08-31T19:00:58.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.122+0000 7f0bcaffd700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0bd005ef30 0x7f0bd00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:58.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.122+0000 7f0bcaffd700 1 -- 172.21.15.72:0/3548868404 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f0bd407ce10 con 0x7f0be40c2b10 2023-08-31T19:00:58.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.122+0000 7f0be27fc700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0bd005ef30 0x7f0bd00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:58.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.123+0000 7f0be27fc700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0bd005ef30 0x7f0bd00613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0be40bf720 tx=0x7f0bd8008040).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:58.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.126+0000 7f0bcaffd700 1 -- 172.21.15.72:0/3548868404 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0bd4080030 con 0x7f0be40c2b10 2023-08-31T19:00:58.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.358+0000 7f0be97ff700 1 -- 172.21.15.72:0/3548868404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0be4151580 con 0x7f0be40c2b10 2023-08-31T19:00:58.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.358+0000 7f0bcaffd700 1 -- 172.21.15.72:0/3548868404 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0bd4026070 con 0x7f0be40c2b10 2023-08-31T19:00:58.359 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:58.360 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:00:58.360 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-08-31T19:00:58.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.360 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-08-31T19:00:58.360 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkPeqvDBAAA2eEr6xr7iF5PPNT9eehSg==", 2023-08-31T19:00:58.361 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.361 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:00:58.361 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:00:58.361 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:00:58.361 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:00:58.362 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.362 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-08-31T19:00:58.362 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkctxUIxAAufSVXMwPzPA7Gq1s4ukXiQ==", 2023-08-31T19:00:58.363 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.363 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:00:58.363 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:00:58.363 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:00:58.363 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:00:58.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.364 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-08-31T19:00:58.364 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkcpLfFxAASIB//h8whjuh6s3YKBVffQ==", 2023-08-31T19:00:58.364 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.365 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:00:58.365 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:00:58.365 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:00:58.365 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:00:58.365 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.366 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-08-31T19:00:58.366 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkC1bbLhAAg/0wct2P0+cyWbZyI2bP/g==", 2023-08-31T19:00:58.366 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.367 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:00:58.367 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:00:58.367 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:00:58.367 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:00:58.367 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.368 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-08-31T19:00:58.368 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAi4PBkvfRJEBAAYQqPldOXrJxXAXnmZhXaBQ==", 2023-08-31T19:00:58.368 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.368 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:00:58.369 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:00:58.369 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:00:58.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.370 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-08-31T19:00:58.370 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAl4PBkYysSIhAA4nCmskcGV+i4vpH2k/gDBg==", 2023-08-31T19:00:58.370 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.370 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:00:58.371 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:00:58.371 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:00:58.371 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.372 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-08-31T19:00:58.372 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAp4PBkyDgJFxAAPynEKk15yN7+OxQxpzL0UQ==", 2023-08-31T19:00:58.372 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.372 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:00:58.372 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:00:58.373 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:00:58.373 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.373 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-08-31T19:00:58.374 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAs4PBkZMD2KBAAoJrO4YjJ4/8MjcPAtgEn1g==", 2023-08-31T19:00:58.374 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.374 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:00:58.374 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:00:58.374 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:00:58.375 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.375 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-08-31T19:00:58.375 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAz4PBkSgAoExAAJ95kdHV47jDTXSj/WSCiLw==", 2023-08-31T19:00:58.376 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.376 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:00:58.376 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:00:58.376 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:00:58.376 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.377 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-08-31T19:00:58.377 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA24PBkUxpLKBAAAu8d6iKME6wW+Q/6hhFIRQ==", 2023-08-31T19:00:58.377 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.378 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:00:58.378 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:00:58.378 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:00:58.378 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.379 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-08-31T19:00:58.379 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA54PBkURHJOhAA3HaPfENVQ4hLIjc/esF0bQ==", 2023-08-31T19:00:58.379 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.379 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:00:58.379 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:00:58.380 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:00:58.380 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.380 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-08-31T19:00:58.381 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA94PBkfoqTEBAAQHENgrp5tv1X47Br/dUksQ==", 2023-08-31T19:00:58.381 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.381 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:00:58.381 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:00:58.381 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:00:58.382 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.382 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-08-31T19:00:58.382 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkucWuOBAABLowlGxpCR3GgoOCRmC0FQ==", 2023-08-31T19:00:58.383 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.383 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:00:58.383 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow r", 2023-08-31T19:00:58.383 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-31T19:00:58.384 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.385 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-08-31T19:00:58.385 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkVGBPCxAAO4M9u24/yH0xwtV6oSz+JQ==", 2023-08-31T19:00:58.385 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.386 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:00:58.386 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:00:58.386 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:00:58.386 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:00:58.386 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.387 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.2", 2023-08-31T19:00:58.387 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkYeIoBBAAjoIzJJ9McIx3rLBSaorTKA==", 2023-08-31T19:00:58.387 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.388 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:00:58.388 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:00:58.388 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:00:58.388 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:00:58.388 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.389 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.3", 2023-08-31T19:00:58.389 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkX/V9EhAAqWuBMMhikN/JUQp3v5/ABQ==", 2023-08-31T19:00:58.390 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.390 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:00:58.390 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:00:58.390 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:00:58.390 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:00:58.391 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.391 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-08-31T19:00:58.391 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkCRlhDhAAxvcGr+KTvLoJmtuZC89Iuw==", 2023-08-31T19:00:58.392 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.392 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:00:58.392 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:00:58.392 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:00:58.392 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:00:58.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.393 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-08-31T19:00:58.393 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkiGBUBRAAwWTFqrz+ELBSwb0Z2T9yhQ==", 2023-08-31T19:00:58.394 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.395 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:00:58.395 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:00:58.395 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:00:58.395 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:58.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:58.396 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-08-31T19:00:58.396 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkSWszNRAAdBxrfMEuBRgePfaiPx6kpQ==", 2023-08-31T19:00:58.396 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:00:58.396 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:00:58.397 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:00:58.397 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:00:58.397 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.397 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:58.397 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-08-31T19:00:58.398 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:00:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.360+0000 7f0be97ff700 1 -- 172.21.15.72:0/3548868404 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0bd005ef30 msgr2=0x7f0bd00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.360+0000 7f0be97ff700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0bd005ef30 0x7f0bd00613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0be40bf720 tx=0x7f0bd8008040).stop 2023-08-31T19:00:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.360+0000 7f0be97ff700 1 -- 172.21.15.72:0/3548868404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0be40c2b10 msgr2=0x7f0be4151d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.360+0000 7f0be97ff700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0be40c2b10 0x7f0be4151d80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f0bd4013000 tx=0x7f0bd4019000).stop 2023-08-31T19:00:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.361+0000 7f0be97ff700 1 -- 172.21.15.72:0/3548868404 shutdown_connections 2023-08-31T19:00:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.361+0000 7f0be97ff700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0be4150990 0x7f0be4154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.361+0000 7f0be97ff700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0be40c2b10 0x7f0be4151d80 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.361+0000 7f0be97ff700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0bd005ef30 0x7f0bd00613f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.361+0000 7f0be97ff700 1 --2- 172.21.15.72:0/3548868404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0be41505b0 0x7f0be4160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.361+0000 7f0be97ff700 1 -- 172.21.15.72:0/3548868404 >> 172.21.15.72:0/3548868404 conn(0x7f0be40c6b10 msgr2=0x7f0be4064370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.361+0000 7f0be97ff700 1 -- 172.21.15.72:0/3548868404 shutdown_connections 2023-08-31T19:00:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.361+0000 7f0be97ff700 1 -- 172.21.15.72:0/3548868404 wait complete. 2023-08-31T19:00:58.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:00:58.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.593+0000 7fe7addff700 1 Processor -- start 2023-08-31T19:00:58.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.593+0000 7fe7addff700 1 -- start start 2023-08-31T19:00:58.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.594+0000 7fe7addff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7a8154060 0x7fe7a8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:58.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.594+0000 7fe7addff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe7a80cb9b0 0x7fe7a81581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:58.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.595+0000 7fe7addff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a8158b40 con 0x7fe7a81586b0 2023-08-31T19:00:58.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.595+0000 7fe7addff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a80c1380 con 0x7fe7a80cb9b0 2023-08-31T19:00:58.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.595+0000 7fe7addff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a80c6120 con 0x7fe7a8154060 2023-08-31T19:00:58.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.595+0000 7fe7a77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7a8154060 0x7fe7a8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:58.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.595+0000 7fe79ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe7a80cb9b0 0x7fe7a81581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:58.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.595+0000 7fe7a77fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7a8154060 0x7fe7a8157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:49726/0 (socket says 172.21.15.72:49726) 2023-08-31T19:00:58.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.595+0000 7fe7a77fe700 1 -- 172.21.15.72:0/3820247755 learned_addr learned my addr 172.21.15.72:0/3820247755 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:58.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.596+0000 7fe7a77fe700 1 -- 172.21.15.72:0/3820247755 >> v2:172.21.15.146:3300/0 conn(0x7fe7a80cb9b0 msgr2=0x7fe7a81581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:58.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.596+0000 7fe7a77fe700 1 --2- 172.21.15.72:0/3820247755 >> v2:172.21.15.146:3300/0 conn(0x7fe7a80cb9b0 0x7fe7a81581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.596+0000 7fe7a77fe700 1 -- 172.21.15.72:0/3820247755 >> v1:172.21.15.146:6789/0 conn(0x7fe7a81586b0 legacy=0x7fe7a80c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:58.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.596+0000 7fe7a77fe700 1 -- 172.21.15.72:0/3820247755 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a80c5e10 con 0x7fe7a8154060 2023-08-31T19:00:58.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.596+0000 7fe7a6ffd700 1 -- 172.21.15.72:0/3820247755 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962022208 0 0) 0x7fe7a0001490 con 0x7fe7a81586b0 2023-08-31T19:00:58.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.596+0000 7fe79ffff700 1 --2- 172.21.15.72:0/3820247755 >> v2:172.21.15.146:3300/0 conn(0x7fe7a80cb9b0 0x7fe7a81581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:00:58.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.596+0000 7fe7a77fe700 1 --2- 172.21.15.72:0/3820247755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7a8154060 0x7fe7a8157cd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe798009810 tx=0x7fe798009060).ready entity=mon.2 client_cookie=9d8bdbbd1be1ea6d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:58.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.596+0000 7fe7a6ffd700 1 -- 172.21.15.72:0/3820247755 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798005880 con 0x7fe7a8154060 2023-08-31T19:00:58.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.596+0000 7fe7a6ffd700 1 -- 172.21.15.72:0/3820247755 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7980059e0 con 0x7fe7a8154060 2023-08-31T19:00:58.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.596+0000 7fe7a6ffd700 1 -- 172.21.15.72:0/3820247755 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798005d60 con 0x7fe7a8154060 2023-08-31T19:00:58.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.596+0000 7fe7addff700 1 -- 172.21.15.72:0/3820247755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7a8154060 msgr2=0x7fe7a8157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:58.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.597+0000 7fe7addff700 1 --2- 172.21.15.72:0/3820247755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7a8154060 0x7fe7a8157cd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fe798009810 tx=0x7fe798009060).stop 2023-08-31T19:00:58.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.597+0000 7fe7addff700 1 -- 172.21.15.72:0/3820247755 shutdown_connections 2023-08-31T19:00:58.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.597+0000 7fe7addff700 1 --2- 172.21.15.72:0/3820247755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7a8154060 0x7fe7a8157cd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.597+0000 7fe7addff700 1 --2- 172.21.15.72:0/3820247755 >> v2:172.21.15.146:3300/0 conn(0x7fe7a80cb9b0 0x7fe7a81581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.597+0000 7fe7addff700 1 -- 172.21.15.72:0/3820247755 >> 172.21.15.72:0/3820247755 conn(0x7fe7a805e870 msgr2=0x7fe7a80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:58.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.597+0000 7fe7addff700 1 -- 172.21.15.72:0/3820247755 shutdown_connections 2023-08-31T19:00:58.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.597+0000 7fe7addff700 1 -- 172.21.15.72:0/3820247755 wait complete. 2023-08-31T19:00:58.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.598+0000 7fe7addff700 1 Processor -- start 2023-08-31T19:00:58.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.598+0000 7fe7addff700 1 -- start start 2023-08-31T19:00:58.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.599+0000 7fe7addff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7a80cb9b0 0x7fe7a8168400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:58.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.599+0000 7fe7addff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7a8154060 0x7fe7a814b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:58.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.599+0000 7fe7addff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7a81586b0 0x7fe7a8152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:58.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.599+0000 7fe7addff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a81688f0 con 0x7fe7a81586b0 2023-08-31T19:00:58.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.599+0000 7fe7addff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a80a97e0 con 0x7fe7a80cb9b0 2023-08-31T19:00:58.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.599+0000 7fe7addff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a80a8020 con 0x7fe7a8154060 2023-08-31T19:00:58.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.600+0000 7fe7a7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7a81586b0 0x7fe7a8152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:58.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.600+0000 7fe79ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7a8154060 0x7fe7a814b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:58.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.600+0000 7fe7a77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7a80cb9b0 0x7fe7a8168400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:58.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.600+0000 7fe79ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7a8154060 0x7fe7a814b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:49742/0 (socket says 172.21.15.72:49742) 2023-08-31T19:00:58.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.600+0000 7fe79ffff700 1 -- 172.21.15.72:0/3777866281 learned_addr learned my addr 172.21.15.72:0/3777866281 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:58.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.600+0000 7fe7a7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7a81586b0 0x7fe7a8152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38560/0 (socket says 172.21.15.72:38560) 2023-08-31T19:00:58.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.600+0000 7fe79ffff700 1 -- 172.21.15.72:0/3777866281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7a80cb9b0 msgr2=0x7fe7a8168400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:58.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.600+0000 7fe79ffff700 1 --2- 172.21.15.72:0/3777866281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7a80cb9b0 0x7fe7a8168400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.600+0000 7fe79ffff700 1 -- 172.21.15.72:0/3777866281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7a81586b0 msgr2=0x7fe7a8152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:58.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.600+0000 7fe79ffff700 1 --2- 172.21.15.72:0/3777866281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7a81586b0 0x7fe7a8152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.600+0000 7fe79ffff700 1 -- 172.21.15.72:0/3777866281 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7900092a0 con 0x7fe7a8154060 2023-08-31T19:00:58.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.600+0000 7fe7a7fff700 1 --2- 172.21.15.72:0/3777866281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7a81586b0 0x7fe7a8152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:00:58.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.600+0000 7fe7a77fe700 1 --2- 172.21.15.72:0/3777866281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7a80cb9b0 0x7fe7a8168400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:00:58.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.601+0000 7fe79ffff700 1 --2- 172.21.15.72:0/3777866281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7a8154060 0x7fe7a814b820 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe79000ea20 tx=0x7fe790009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:58.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.601+0000 7fe79f7fe700 1 -- 172.21.15.72:0/3777866281 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79000c640 con 0x7fe7a8154060 2023-08-31T19:00:58.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.601+0000 7fe79f7fe700 1 -- 172.21.15.72:0/3777866281 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79000c7a0 con 0x7fe7a8154060 2023-08-31T19:00:58.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.601+0000 7fe7addff700 1 -- 172.21.15.72:0/3777866281 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe798009300 con 0x7fe7a8154060 2023-08-31T19:00:58.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.601+0000 7fe79f7fe700 1 -- 172.21.15.72:0/3777866281 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79000cb20 con 0x7fe7a8154060 2023-08-31T19:00:58.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.601+0000 7fe7addff700 1 -- 172.21.15.72:0/3777866281 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a80a85e0 con 0x7fe7a8154060 2023-08-31T19:00:58.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.602+0000 7fe7addff700 1 -- 172.21.15.72:0/3777866281 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a80af4b0 con 0x7fe7a8154060 2023-08-31T19:00:58.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.603+0000 7fe79f7fe700 1 -- 172.21.15.72:0/3777866281 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe79001b400 con 0x7fe7a8154060 2023-08-31T19:00:58.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.603+0000 7fe79f7fe700 1 --2- 172.21.15.72:0/3777866281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe78805ef30 0x7fe7880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:58.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.604+0000 7fe79f7fe700 1 -- 172.21.15.72:0/3777866281 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fe79007a430 con 0x7fe7a8154060 2023-08-31T19:00:58.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.604+0000 7fe7a77fe700 1 --2- 172.21.15.72:0/3777866281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe78805ef30 0x7fe7880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:58.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.604+0000 7fe7a77fe700 1 --2- 172.21.15.72:0/3777866281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe78805ef30 0x7fe7880613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe79800b340 tx=0x7fe798016000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:58.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.609+0000 7fe79f7fe700 1 -- 172.21.15.72:0/3777866281 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe79004b710 con 0x7fe7a8154060 2023-08-31T19:00:58.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.778+0000 7fe7addff700 1 -- 172.21.15.72:0/3777866281 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7a806c6b0 con 0x7fe7a8154060 2023-08-31T19:00:58.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.780+0000 7fe79f7fe700 1 -- 172.21.15.72:0/3777866281 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+14671 (secure 0 0 0) 0x7fe79004ed30 con 0x7fe7a8154060 2023-08-31T19:00:58.780 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:58.780 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":57,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:00:57.890730+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:00:58.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.782+0000 7fe7addff700 1 -- 172.21.15.72:0/3777866281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe78805ef30 msgr2=0x7fe7880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:58.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.782+0000 7fe7addff700 1 --2- 172.21.15.72:0/3777866281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe78805ef30 0x7fe7880613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe79800b340 tx=0x7fe798016000).stop 2023-08-31T19:00:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.782+0000 7fe7addff700 1 -- 172.21.15.72:0/3777866281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7a8154060 msgr2=0x7fe7a814b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.782+0000 7fe7addff700 1 --2- 172.21.15.72:0/3777866281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7a8154060 0x7fe7a814b820 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe79000ea20 tx=0x7fe790009060).stop 2023-08-31T19:00:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.782+0000 7fe7addff700 1 -- 172.21.15.72:0/3777866281 shutdown_connections 2023-08-31T19:00:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.782+0000 7fe7addff700 1 --2- 172.21.15.72:0/3777866281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7a81586b0 0x7fe7a8152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.782+0000 7fe7addff700 1 --2- 172.21.15.72:0/3777866281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe78805ef30 0x7fe7880613f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.782+0000 7fe7addff700 1 --2- 172.21.15.72:0/3777866281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7a80cb9b0 0x7fe7a8168400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.782+0000 7fe7addff700 1 --2- 172.21.15.72:0/3777866281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe7a8154060 0x7fe7a814b820 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.782+0000 7fe7addff700 1 -- 172.21.15.72:0/3777866281 >> 172.21.15.72:0/3777866281 conn(0x7fe7a805e870 msgr2=0x7fe7a80c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:58.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.782+0000 7fe7addff700 1 -- 172.21.15.72:0/3777866281 shutdown_connections 2023-08-31T19:00:58.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.782+0000 7fe7addff700 1 -- 172.21.15.72:0/3777866281 wait complete. 2023-08-31T19:00:58.800 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-31T19:00:58.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:00:58.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.993+0000 7fd0f1fff700 1 Processor -- start 2023-08-31T19:00:58.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.993+0000 7fd0f1fff700 1 -- start start 2023-08-31T19:00:58.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.995+0000 7fd0f1fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ec154030 0x7fd0ec154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:58.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.995+0000 7fd0f1fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd0ec0c7360 0x7fd0ec063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:58.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.995+0000 7fd0f1fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ec0c6ed0 con 0x7fd0ec0c06b0 2023-08-31T19:00:58.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.995+0000 7fd0f1fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ec0c66e0 con 0x7fd0ec0c7360 2023-08-31T19:00:58.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.995+0000 7fd0f1fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0c68c0 con 0x7fd0ec154030 2023-08-31T19:00:58.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.995+0000 7fd0eb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ec154030 0x7fd0ec154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:58.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.995+0000 7fd0ebfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd0ec0c7360 0x7fd0ec063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:58.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.995+0000 7fd0eb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ec154030 0x7fd0ec154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:49752/0 (socket says 172.21.15.72:49752) 2023-08-31T19:00:58.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.995+0000 7fd0eb7fe700 1 -- 172.21.15.72:0/793053909 learned_addr learned my addr 172.21.15.72:0/793053909 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:58.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.995+0000 7fd0eaffd700 1 --1- 172.21.15.72:0/793053909 >> v1:172.21.15.146:6789/0 conn(0x7fd0ec0c06b0 0x7fd0ec0aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:40690/0 (socket says 172.21.15.72:40690) 2023-08-31T19:00:58.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.996+0000 7fd0eb7fe700 1 -- 172.21.15.72:0/793053909 >> v2:172.21.15.146:3300/0 conn(0x7fd0ec0c7360 msgr2=0x7fd0ec063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:58.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.996+0000 7fd0eb7fe700 1 --2- 172.21.15.72:0/793053909 >> v2:172.21.15.146:3300/0 conn(0x7fd0ec0c7360 0x7fd0ec063120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:58.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.996+0000 7fd0eb7fe700 1 -- 172.21.15.72:0/793053909 >> v1:172.21.15.146:6789/0 conn(0x7fd0ec0c06b0 legacy=0x7fd0ec0aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:58.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.996+0000 7fd0eb7fe700 1 -- 172.21.15.72:0/793053909 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec0c0f30 con 0x7fd0ec154030 2023-08-31T19:00:58.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.996+0000 7fd0eb7fe700 1 --2- 172.21.15.72:0/793053909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ec154030 0x7fd0ec154410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd0dc006fd0 tx=0x7fd0dc0090f0).ready entity=mon.2 client_cookie=2823ae84dc9eec45 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:58.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.996+0000 7fd0ea7fc700 1 -- 172.21.15.72:0/793053909 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc00b580 con 0x7fd0ec154030 2023-08-31T19:00:59.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.996+0000 7fd0ea7fc700 1 -- 172.21.15.72:0/793053909 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0dc00b6e0 con 0x7fd0ec154030 2023-08-31T19:00:59.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.996+0000 7fd0ea7fc700 1 -- 172.21.15.72:0/793053909 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc00ba60 con 0x7fd0ec154030 2023-08-31T19:00:59.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.997+0000 7fd0f1fff700 1 -- 172.21.15.72:0/793053909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ec154030 msgr2=0x7fd0ec154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.997+0000 7fd0f1fff700 1 --2- 172.21.15.72:0/793053909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ec154030 0x7fd0ec154410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd0dc006fd0 tx=0x7fd0dc0090f0).stop 2023-08-31T19:00:59.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.997+0000 7fd0f1fff700 1 -- 172.21.15.72:0/793053909 shutdown_connections 2023-08-31T19:00:59.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.997+0000 7fd0f1fff700 1 --2- 172.21.15.72:0/793053909 >> v2:172.21.15.146:3300/0 conn(0x7fd0ec0c7360 0x7fd0ec063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.997+0000 7fd0f1fff700 1 --2- 172.21.15.72:0/793053909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ec154030 0x7fd0ec154410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.997+0000 7fd0f1fff700 1 -- 172.21.15.72:0/793053909 >> 172.21.15.72:0/793053909 conn(0x7fd0ec05eb60 msgr2=0x7fd0ec0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:59.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.997+0000 7fd0f1fff700 1 -- 172.21.15.72:0/793053909 shutdown_connections 2023-08-31T19:00:59.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.997+0000 7fd0f1fff700 1 -- 172.21.15.72:0/793053909 wait complete. 2023-08-31T19:00:59.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.999+0000 7fd0f1fff700 1 Processor -- start 2023-08-31T19:00:59.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:58.999+0000 7fd0f1fff700 1 -- start start 2023-08-31T19:00:59.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.000+0000 7fd0f1fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ec0c06b0 0x7fd0ec0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0f1fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ec0c7360 0x7fd0ec14a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0f1fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0ec154030 0x7fd0ec155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0f1fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0c4be0 con 0x7fd0ec0c7360 2023-08-31T19:00:59.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0f1fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0aafc0 con 0x7fd0ec154030 2023-08-31T19:00:59.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0f1fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0ab2a0 con 0x7fd0ec0c06b0 2023-08-31T19:00:59.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0eaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ec0c7360 0x7fd0ec14a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:59.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0eb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ec0c06b0 0x7fd0ec0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:59.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0eaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ec0c7360 0x7fd0ec14a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38562/0 (socket says 172.21.15.72:38562) 2023-08-31T19:00:59.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0eaffd700 1 -- 172.21.15.72:0/4019922619 learned_addr learned my addr 172.21.15.72:0/4019922619 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:59.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0ebfff700 1 --2- 172.21.15.72:0/4019922619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0ec154030 0x7fd0ec155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:59.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0eaffd700 1 -- 172.21.15.72:0/4019922619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ec0c06b0 msgr2=0x7fd0ec0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0eaffd700 1 --2- 172.21.15.72:0/4019922619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ec0c06b0 0x7fd0ec0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0eaffd700 1 -- 172.21.15.72:0/4019922619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0ec154030 msgr2=0x7fd0ec155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0eaffd700 1 --2- 172.21.15.72:0/4019922619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0ec154030 0x7fd0ec155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0eaffd700 1 -- 172.21.15.72:0/4019922619 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc009370 con 0x7fd0ec0c7360 2023-08-31T19:00:59.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.001+0000 7fd0eaffd700 1 --2- 172.21.15.72:0/4019922619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ec0c7360 0x7fd0ec14a260 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fd0e000c4c0 tx=0x7fd0e0007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:59.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.002+0000 7fd0d37fe700 1 -- 172.21.15.72:0/4019922619 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e000ce10 con 0x7fd0ec0c7360 2023-08-31T19:00:59.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.002+0000 7fd0d37fe700 1 -- 172.21.15.72:0/4019922619 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e00072e0 con 0x7fd0ec0c7360 2023-08-31T19:00:59.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.002+0000 7fd0f1fff700 1 -- 172.21.15.72:0/4019922619 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ec0ab580 con 0x7fd0ec0c7360 2023-08-31T19:00:59.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.002+0000 7fd0d37fe700 1 -- 172.21.15.72:0/4019922619 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00056e0 con 0x7fd0ec0c7360 2023-08-31T19:00:59.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.002+0000 7fd0f1fff700 1 -- 172.21.15.72:0/4019922619 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ec0ae270 con 0x7fd0ec0c7360 2023-08-31T19:00:59.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.003+0000 7fd0f1fff700 1 -- 172.21.15.72:0/4019922619 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ec06c6b0 con 0x7fd0ec0c7360 2023-08-31T19:00:59.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.004+0000 7fd0d37fe700 1 -- 172.21.15.72:0/4019922619 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd0e0005b10 con 0x7fd0ec0c7360 2023-08-31T19:00:59.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.004+0000 7fd0d37fe700 1 --2- 172.21.15.72:0/4019922619 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd0d805ef30 0x7fd0d80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.005+0000 7fd0d37fe700 1 -- 172.21.15.72:0/4019922619 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5841+0+0 (secure 0 0 0) 0x7fd0e00794a0 con 0x7fd0ec0c7360 2023-08-31T19:00:59.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.005+0000 7fd0eb7fe700 1 --2- 172.21.15.72:0/4019922619 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd0d805ef30 0x7fd0d80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:59.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.005+0000 7fd0eb7fe700 1 --2- 172.21.15.72:0/4019922619 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd0d805ef30 0x7fd0d80613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd0dc009130 tx=0x7fd0dc017000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:59.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.009+0000 7fd0d37fe700 1 -- 172.21.15.72:0/4019922619 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd0e004a7e0 con 0x7fd0ec0c7360 2023-08-31T19:00:59.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.179+0000 7fd0f1fff700 1 -- 172.21.15.72:0/4019922619 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd0ec06aac0 con 0x7fd0ec0c7360 2023-08-31T19:00:59.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.179+0000 7fd0d37fe700 1 -- 172.21.15.72:0/4019922619 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v57) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd0e0018020 con 0x7fd0ec0c7360 2023-08-31T19:00:59.180 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:00:59.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.181+0000 7fd0f1fff700 1 -- 172.21.15.72:0/4019922619 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd0d805ef30 msgr2=0x7fd0d80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.181+0000 7fd0f1fff700 1 --2- 172.21.15.72:0/4019922619 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd0d805ef30 0x7fd0d80613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd0dc009130 tx=0x7fd0dc017000).stop 2023-08-31T19:00:59.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.181+0000 7fd0f1fff700 1 -- 172.21.15.72:0/4019922619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ec0c7360 msgr2=0x7fd0ec14a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.181+0000 7fd0f1fff700 1 --2- 172.21.15.72:0/4019922619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ec0c7360 0x7fd0ec14a260 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fd0e000c4c0 tx=0x7fd0e0007dc0).stop 2023-08-31T19:00:59.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.181+0000 7fd0f1fff700 1 -- 172.21.15.72:0/4019922619 shutdown_connections 2023-08-31T19:00:59.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.181+0000 7fd0f1fff700 1 --2- 172.21.15.72:0/4019922619 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd0d805ef30 0x7fd0d80613f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.181+0000 7fd0f1fff700 1 --2- 172.21.15.72:0/4019922619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0ec154030 0x7fd0ec155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.181+0000 7fd0f1fff700 1 --2- 172.21.15.72:0/4019922619 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd0ec0c06b0 0x7fd0ec0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.181+0000 7fd0f1fff700 1 --2- 172.21.15.72:0/4019922619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0ec0c7360 0x7fd0ec14a260 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.181+0000 7fd0f1fff700 1 -- 172.21.15.72:0/4019922619 >> 172.21.15.72:0/4019922619 conn(0x7fd0ec05eb60 msgr2=0x7fd0ec1529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:59.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.182+0000 7fd0f1fff700 1 -- 172.21.15.72:0/4019922619 shutdown_connections 2023-08-31T19:00:59.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.182+0000 7fd0f1fff700 1 -- 172.21.15.72:0/4019922619 wait complete. 2023-08-31T19:00:59.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:00:59.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.391+0000 7f14cb5ff700 1 Processor -- start 2023-08-31T19:00:59.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.391+0000 7f14cb5ff700 1 -- start start 2023-08-31T19:00:59.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.392+0000 7f14cb5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f14c4154030 0x7f14c4154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.393+0000 7f14cb5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14c40c7360 0x7f14c4063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.393+0000 7f14cb5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c40c6ed0 con 0x7f14c40c06b0 2023-08-31T19:00:59.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.393+0000 7f14cb5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c40c66e0 con 0x7f14c4154030 2023-08-31T19:00:59.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.393+0000 7f14cb5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c40c68c0 con 0x7f14c40c7360 2023-08-31T19:00:59.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.393+0000 7f14c939b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f14c4154030 0x7f14c4154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:59.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.393+0000 7f14c939b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f14c4154030 0x7f14c4154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38572/0 (socket says 172.21.15.72:38572) 2023-08-31T19:00:59.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.393+0000 7f14c8b9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f14c40c06b0 0x7f14c40aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55352/0 (socket says 172.21.15.72:55352) 2023-08-31T19:00:59.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.393+0000 7f14c939b700 1 -- 172.21.15.72:0/582512975 learned_addr learned my addr 172.21.15.72:0/582512975 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:59.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.393+0000 7f14c9b9c700 1 --2- 172.21.15.72:0/582512975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14c40c7360 0x7f14c4063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:59.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.393+0000 7f14bbfff700 1 -- 172.21.15.72:0/582512975 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782519708 0 0) 0x7f14c40c6ed0 con 0x7f14c40c06b0 2023-08-31T19:00:59.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.393+0000 7f14bbfff700 1 -- 172.21.15.72:0/582512975 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14b00033f0 con 0x7f14c40c06b0 2023-08-31T19:00:59.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.393+0000 7f14c939b700 1 -- 172.21.15.72:0/582512975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14c40c7360 msgr2=0x7f14c4063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:59.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.393+0000 7f14c939b700 1 --2- 172.21.15.72:0/582512975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14c40c7360 0x7f14c4063120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.393+0000 7f14c939b700 1 -- 172.21.15.72:0/582512975 >> v1:172.21.15.72:6789/0 conn(0x7f14c40c06b0 legacy=0x7f14c40aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.393+0000 7f14c939b700 1 -- 172.21.15.72:0/582512975 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c40c0f30 con 0x7f14c4154030 2023-08-31T19:00:59.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.394+0000 7f14c939b700 1 --2- 172.21.15.72:0/582512975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14c4154030 0x7f14c4154410 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f14c0006fd0 tx=0x7f14c00090f0).ready entity=mon.0 client_cookie=78dce4da78f7bae1 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:59.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.394+0000 7f14bbfff700 1 -- 172.21.15.72:0/582512975 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c000b580 con 0x7f14c4154030 2023-08-31T19:00:59.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.394+0000 7f14bbfff700 1 -- 172.21.15.72:0/582512975 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c000b6e0 con 0x7f14c4154030 2023-08-31T19:00:59.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.394+0000 7f14bbfff700 1 -- 172.21.15.72:0/582512975 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c000ba60 con 0x7f14c4154030 2023-08-31T19:00:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.394+0000 7f14cb5ff700 1 -- 172.21.15.72:0/582512975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14c4154030 msgr2=0x7f14c4154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.394+0000 7f14cb5ff700 1 --2- 172.21.15.72:0/582512975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14c4154030 0x7f14c4154410 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f14c0006fd0 tx=0x7f14c00090f0).stop 2023-08-31T19:00:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.394+0000 7f14cb5ff700 1 -- 172.21.15.72:0/582512975 shutdown_connections 2023-08-31T19:00:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.394+0000 7f14cb5ff700 1 --2- 172.21.15.72:0/582512975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14c4154030 0x7f14c4154410 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.394+0000 7f14cb5ff700 1 --2- 172.21.15.72:0/582512975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14c40c7360 0x7f14c4063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.394+0000 7f14cb5ff700 1 -- 172.21.15.72:0/582512975 >> 172.21.15.72:0/582512975 conn(0x7f14c405eb60 msgr2=0x7f14c40cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:59.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.394+0000 7f14cb5ff700 1 -- 172.21.15.72:0/582512975 shutdown_connections 2023-08-31T19:00:59.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.395+0000 7f14cb5ff700 1 -- 172.21.15.72:0/582512975 wait complete. 2023-08-31T19:00:59.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.396+0000 7f14cb5ff700 1 Processor -- start 2023-08-31T19:00:59.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.397+0000 7f14cb5ff700 1 -- start start 2023-08-31T19:00:59.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.398+0000 7f14cb5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14c40c06b0 0x7f14c4149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.398+0000 7f14cb5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14c40c7360 0x7f14c4150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.398+0000 7f14cb5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14c4154030 0x7f14c41678b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.398+0000 7f14cb5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c40c2ea0 con 0x7f14c40c7360 2023-08-31T19:00:59.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.398+0000 7f14cb5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c40c4400 con 0x7f14c40c06b0 2023-08-31T19:00:59.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.398+0000 7f14cb5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c40c46c0 con 0x7f14c4154030 2023-08-31T19:00:59.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.398+0000 7f14c8b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14c40c7360 0x7f14c4150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:59.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.398+0000 7f14c8b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14c40c7360 0x7f14c4150610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38588/0 (socket says 172.21.15.72:38588) 2023-08-31T19:00:59.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.398+0000 7f14c8b9a700 1 -- 172.21.15.72:0/4012412308 learned_addr learned my addr 172.21.15.72:0/4012412308 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:59.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.399+0000 7f14c939b700 1 --2- 172.21.15.72:0/4012412308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14c40c06b0 0x7f14c4149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:59.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.399+0000 7f14c8b9a700 1 -- 172.21.15.72:0/4012412308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14c4154030 msgr2=0x7f14c41678b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.399+0000 7f14c8b9a700 1 --2- 172.21.15.72:0/4012412308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14c4154030 0x7f14c41678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:59.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.399+0000 7f14c8b9a700 1 -- 172.21.15.72:0/4012412308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14c40c06b0 msgr2=0x7f14c4149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.399+0000 7f14c8b9a700 1 --2- 172.21.15.72:0/4012412308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14c40c06b0 0x7f14c4149620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.399+0000 7f14c8b9a700 1 -- 172.21.15.72:0/4012412308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c0009370 con 0x7f14c40c7360 2023-08-31T19:00:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.399+0000 7f14c939b700 1 --2- 172.21.15.72:0/4012412308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14c40c06b0 0x7f14c4149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.399+0000 7f14c8b9a700 1 --2- 172.21.15.72:0/4012412308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14c40c7360 0x7f14c4150610 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f14b400c590 tx=0x7f14b4007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.399+0000 7f14b97fa700 1 -- 172.21.15.72:0/4012412308 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b4007e40 con 0x7f14c40c7360 2023-08-31T19:00:59.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.399+0000 7f14b97fa700 1 -- 172.21.15.72:0/4012412308 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b40072e0 con 0x7f14c40c7360 2023-08-31T19:00:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.399+0000 7f14cb5ff700 1 -- 172.21.15.72:0/4012412308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c40c3080 con 0x7f14c40c7360 2023-08-31T19:00:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.399+0000 7f14b97fa700 1 -- 172.21.15.72:0/4012412308 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40056e0 con 0x7f14c40c7360 2023-08-31T19:00:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.399+0000 7f14cb5ff700 1 -- 172.21.15.72:0/4012412308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c4154890 con 0x7f14c40c7360 2023-08-31T19:00:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.400+0000 7f14cb5ff700 1 -- 172.21.15.72:0/4012412308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c406c6b0 con 0x7f14c40c7360 2023-08-31T19:00:59.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.401+0000 7f14b97fa700 1 -- 172.21.15.72:0/4012412308 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f14b4005b10 con 0x7f14c40c7360 2023-08-31T19:00:59.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.402+0000 7f14b97fa700 1 --2- 172.21.15.72:0/4012412308 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f14a805ef30 0x7f14a80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.402+0000 7f14b97fa700 1 -- 172.21.15.72:0/4012412308 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f14b40794d0 con 0x7f14c40c7360 2023-08-31T19:00:59.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.402+0000 7f14c939b700 1 --2- 172.21.15.72:0/4012412308 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f14a805ef30 0x7f14a80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:59.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.403+0000 7f14c939b700 1 --2- 172.21.15.72:0/4012412308 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f14a805ef30 0x7f14a80613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f14c0009fd0 tx=0x7f14c0017000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:59.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.406+0000 7f14b97fa700 1 -- 172.21.15.72:0/4012412308 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f14b404a810 con 0x7f14c40c7360 2023-08-31T19:00:59.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.576+0000 7f14cb5ff700 1 -- 172.21.15.72:0/4012412308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f14c40c3520 con 0x7f14c40c7360 2023-08-31T19:00:59.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.577+0000 7f14b97fa700 1 -- 172.21.15.72:0/4012412308 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7f14b40180a0 con 0x7f14c40c7360 2023-08-31T19:00:59.579 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:00:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.579+0000 7f14cb5ff700 1 -- 172.21.15.72:0/4012412308 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f14a805ef30 msgr2=0x7f14a80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.579+0000 7f14cb5ff700 1 --2- 172.21.15.72:0/4012412308 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f14a805ef30 0x7f14a80613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f14c0009fd0 tx=0x7f14c0017000).stop 2023-08-31T19:00:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.579+0000 7f14cb5ff700 1 -- 172.21.15.72:0/4012412308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14c40c7360 msgr2=0x7f14c4150610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.579+0000 7f14cb5ff700 1 --2- 172.21.15.72:0/4012412308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14c40c7360 0x7f14c4150610 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f14b400c590 tx=0x7f14b4007c80).stop 2023-08-31T19:00:59.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.579+0000 7f14cb5ff700 1 -- 172.21.15.72:0/4012412308 shutdown_connections 2023-08-31T19:00:59.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.579+0000 7f14cb5ff700 1 --2- 172.21.15.72:0/4012412308 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14c4154030 0x7f14c41678b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:00:59.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.579+0000 7f14cb5ff700 1 --2- 172.21.15.72:0/4012412308 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f14a805ef30 0x7f14a80613f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.579+0000 7f14cb5ff700 1 --2- 172.21.15.72:0/4012412308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14c40c06b0 0x7f14c4149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.579+0000 7f14cb5ff700 1 --2- 172.21.15.72:0/4012412308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14c40c7360 0x7f14c4150610 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.579+0000 7f14cb5ff700 1 -- 172.21.15.72:0/4012412308 >> 172.21.15.72:0/4012412308 conn(0x7f14c405eb60 msgr2=0x7f14c4151250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:59.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.579+0000 7f14cb5ff700 1 -- 172.21.15.72:0/4012412308 shutdown_connections 2023-08-31T19:00:59.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.579+0000 7f14cb5ff700 1 -- 172.21.15.72:0/4012412308 wait complete. 2023-08-31T19:00:59.596 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T19:00:59.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.786+0000 7f71d71ff700 1 Processor -- start 2023-08-31T19:00:59.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.787+0000 7f71d71ff700 1 -- start start 2023-08-31T19:00:59.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.788+0000 7f71d71ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71d00cb9b0 0x7f71d01583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.788+0000 7f71d71ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71d01588d0 0x7f71d0154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.788+0000 7f71d71ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d00c6120 con 0x7f71d0154060 2023-08-31T19:00:59.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.788+0000 7f71d71ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d00c1380 con 0x7f71d00cb9b0 2023-08-31T19:00:59.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.788+0000 7f71d71ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d00c5e10 con 0x7f71d01588d0 2023-08-31T19:00:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.788+0000 7f71cffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71d00cb9b0 0x7f71d01583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.788+0000 7f71cffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71d00cb9b0 0x7f71d01583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38596/0 (socket says 172.21.15.72:38596) 2023-08-31T19:00:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.788+0000 7f71cffff700 1 -- 172.21.15.72:0/2551047280 learned_addr learned my addr 172.21.15.72:0/2551047280 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.788+0000 7f71d4f9b700 1 --1- 172.21.15.72:0/2551047280 >> v1:172.21.15.72:6789/0 conn(0x7f71d0154060 0x7f71d0157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55368/0 (socket says 172.21.15.72:55368) 2023-08-31T19:00:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.788+0000 7f71cffff700 1 -- 172.21.15.72:0/2551047280 >> v2:172.21.15.146:3300/0 conn(0x7f71d01588d0 msgr2=0x7f71d0154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:00:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.788+0000 7f71d579c700 1 --2- 172.21.15.72:0/2551047280 >> v2:172.21.15.146:3300/0 conn(0x7f71d01588d0 0x7f71d0154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:59.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.788+0000 7f71cf7fe700 1 -- 172.21.15.72:0/2551047280 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359630928 0 0) 0x7f71d00c6120 con 0x7f71d0154060 2023-08-31T19:00:59.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.789+0000 7f71cffff700 1 --2- 172.21.15.72:0/2551047280 >> v2:172.21.15.146:3300/0 conn(0x7f71d01588d0 0x7f71d0154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.789+0000 7f71cffff700 1 -- 172.21.15.72:0/2551047280 >> v1:172.21.15.72:6789/0 conn(0x7f71d0154060 legacy=0x7f71d0157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.789+0000 7f71cffff700 1 -- 172.21.15.72:0/2551047280 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d00c0ae0 con 0x7f71d00cb9b0 2023-08-31T19:00:59.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.789+0000 7f71d579c700 1 --2- 172.21.15.72:0/2551047280 >> v2:172.21.15.146:3300/0 conn(0x7f71d01588d0 0x7f71d0154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:59.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.789+0000 7f71cffff700 1 --2- 172.21.15.72:0/2551047280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00cb9b0 0x7f71d01583e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f71d00844d0 tx=0x7f71bc0090f0).ready entity=mon.0 client_cookie=697d9bc2c505422c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:59.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.789+0000 7f71cf7fe700 1 -- 172.21.15.72:0/2551047280 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc00b600 con 0x7f71d00cb9b0 2023-08-31T19:00:59.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.789+0000 7f71cf7fe700 1 -- 172.21.15.72:0/2551047280 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc00b760 con 0x7f71d00cb9b0 2023-08-31T19:00:59.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.789+0000 7f71cf7fe700 1 -- 172.21.15.72:0/2551047280 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc00bae0 con 0x7f71d00cb9b0 2023-08-31T19:00:59.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.789+0000 7f71d71ff700 1 -- 172.21.15.72:0/2551047280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00cb9b0 msgr2=0x7f71d01583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.789+0000 7f71d71ff700 1 --2- 172.21.15.72:0/2551047280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00cb9b0 0x7f71d01583e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f71d00844d0 tx=0x7f71bc0090f0).stop 2023-08-31T19:00:59.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.790+0000 7f71d71ff700 1 -- 172.21.15.72:0/2551047280 shutdown_connections 2023-08-31T19:00:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.790+0000 7f71d71ff700 1 --2- 172.21.15.72:0/2551047280 >> v2:172.21.15.146:3300/0 conn(0x7f71d01588d0 0x7f71d0154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.790+0000 7f71d71ff700 1 --2- 172.21.15.72:0/2551047280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00cb9b0 0x7f71d01583e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.790+0000 7f71d71ff700 1 -- 172.21.15.72:0/2551047280 >> 172.21.15.72:0/2551047280 conn(0x7f71d005e870 msgr2=0x7f71d00cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.790+0000 7f71d71ff700 1 -- 172.21.15.72:0/2551047280 shutdown_connections 2023-08-31T19:00:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.790+0000 7f71d71ff700 1 -- 172.21.15.72:0/2551047280 wait complete. 2023-08-31T19:00:59.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.791+0000 7f71d71ff700 1 Processor -- start 2023-08-31T19:00:59.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.791+0000 7f71d71ff700 1 -- start start 2023-08-31T19:00:59.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.792+0000 7f71d71ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00cb9b0 0x7f71d0151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.792+0000 7f71d71ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d0154060 0x7f71d01564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.792+0000 7f71d71ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d01588d0 0x7f71d01569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.792+0000 7f71d71ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00aed50 con 0x7f71d00cb9b0 2023-08-31T19:00:59.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.792+0000 7f71d71ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00aea70 con 0x7f71d0154060 2023-08-31T19:00:59.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.792+0000 7f71d71ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d01559d0 con 0x7f71d01588d0 2023-08-31T19:00:59.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.792+0000 7f71d4f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00cb9b0 0x7f71d0151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:59.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.792+0000 7f71d4f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00cb9b0 0x7f71d0151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38598/0 (socket says 172.21.15.72:38598) 2023-08-31T19:00:59.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.792+0000 7f71d4f9b700 1 -- 172.21.15.72:0/1395705228 learned_addr learned my addr 172.21.15.72:0/1395705228 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:00:59.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.793+0000 7f71d579c700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d01588d0 0x7f71d01569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:59.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.793+0000 7f71cffff700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d0154060 0x7f71d01564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:59.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.793+0000 7f71d4f9b700 1 -- 172.21.15.72:0/1395705228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d01588d0 msgr2=0x7f71d01569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.793+0000 7f71d4f9b700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d01588d0 0x7f71d01569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.793+0000 7f71d4f9b700 1 -- 172.21.15.72:0/1395705228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d0154060 msgr2=0x7f71d01564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.793+0000 7f71d4f9b700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d0154060 0x7f71d01564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.793+0000 7f71d4f9b700 1 -- 172.21.15.72:0/1395705228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc009370 con 0x7f71d00cb9b0 2023-08-31T19:00:59.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.793+0000 7f71d579c700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d01588d0 0x7f71d01569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:59.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.793+0000 7f71cffff700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d0154060 0x7f71d01564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:00:59.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.793+0000 7f71d4f9b700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00cb9b0 0x7f71d0151790 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f71c400c7c0 tx=0x7f71c4007ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:59.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.793+0000 7f71ccff9700 1 -- 172.21.15.72:0/1395705228 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c40072e0 con 0x7f71d00cb9b0 2023-08-31T19:00:59.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.793+0000 7f71ccff9700 1 -- 172.21.15.72:0/1395705228 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c4007440 con 0x7f71d00cb9b0 2023-08-31T19:00:59.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.793+0000 7f71ccff9700 1 -- 172.21.15.72:0/1395705228 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c40058a0 con 0x7f71d00cb9b0 2023-08-31T19:00:59.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.793+0000 7f71d71ff700 1 -- 172.21.15.72:0/1395705228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d0155cb0 con 0x7f71d00cb9b0 2023-08-31T19:00:59.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.793+0000 7f71d71ff700 1 -- 172.21.15.72:0/1395705228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d0151c80 con 0x7f71d00cb9b0 2023-08-31T19:00:59.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.794+0000 7f71d71ff700 1 -- 172.21.15.72:0/1395705228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d0155810 con 0x7f71d00cb9b0 2023-08-31T19:00:59.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.795+0000 7f71ccff9700 1 -- 172.21.15.72:0/1395705228 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f71c4005c50 con 0x7f71d00cb9b0 2023-08-31T19:00:59.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.796+0000 7f71ccff9700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f71b405ef30 0x7f71b40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:00:59.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.796+0000 7f71ccff9700 1 -- 172.21.15.72:0/1395705228 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f71c4079890 con 0x7f71d00cb9b0 2023-08-31T19:00:59.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.796+0000 7f71cffff700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f71b405ef30 0x7f71b40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:00:59.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.797+0000 7f71cffff700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f71b405ef30 0x7f71b40613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f71d00c7eb0 tx=0x7f71bc017000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:00:59.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.800+0000 7f71ccff9700 1 -- 172.21.15.72:0/1395705228 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f71c404abd0 con 0x7f71d00cb9b0 2023-08-31T19:00:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.971+0000 7f71d71ff700 1 -- 172.21.15.72:0/1395705228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f71d006c6b0 con 0x7f71d00cb9b0 2023-08-31T19:00:59.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.972+0000 7f71ccff9700 1 -- 172.21.15.72:0/1395705228 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v57) v1 ==== 84+0+143 (secure 0 0 0) 0x7f71c404e1f0 con 0x7f71d00cb9b0 2023-08-31T19:00:59.972 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:00:59.972 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:00:59.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:59.973 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-08-31T19:00:59.973 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "device_health_metrics" 2023-08-31T19:00:59.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:00:59.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:00:59.974 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-08-31T19:00:59.974 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-08-31T19:00:59.974 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:00:59.974 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:00:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.974+0000 7f71d71ff700 1 -- 172.21.15.72:0/1395705228 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f71b405ef30 msgr2=0x7f71b40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.974+0000 7f71d71ff700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f71b405ef30 0x7f71b40613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f71d00c7eb0 tx=0x7f71bc017000).stop 2023-08-31T19:00:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.974+0000 7f71d71ff700 1 -- 172.21.15.72:0/1395705228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00cb9b0 msgr2=0x7f71d0151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:00:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.974+0000 7f71d71ff700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00cb9b0 0x7f71d0151790 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f71c400c7c0 tx=0x7f71c4007ba0).stop 2023-08-31T19:00:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.974+0000 7f71d71ff700 1 -- 172.21.15.72:0/1395705228 shutdown_connections 2023-08-31T19:00:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.974+0000 7f71d71ff700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71d01588d0 0x7f71d01569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.974+0000 7f71d71ff700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d00cb9b0 0x7f71d0151790 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.974+0000 7f71d71ff700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f71b405ef30 0x7f71b40613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.974+0000 7f71d71ff700 1 --2- 172.21.15.72:0/1395705228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71d0154060 0x7f71d01564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:00:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.974+0000 7f71d71ff700 1 -- 172.21.15.72:0/1395705228 >> 172.21.15.72:0/1395705228 conn(0x7f71d005e870 msgr2=0x7f71d0064650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:00:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.974+0000 7f71d71ff700 1 -- 172.21.15.72:0/1395705228 shutdown_connections 2023-08-31T19:00:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:00:59.974+0000 7f71d71ff700 1 -- 172.21.15.72:0/1395705228 wait complete. 2023-08-31T19:00:59.991 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T19:00:59.992 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-31T19:01:00.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.185+0000 7f29e6bff700 1 Processor -- start 2023-08-31T19:01:00.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.185+0000 7f29e6bff700 1 -- start start 2023-08-31T19:01:00.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.186+0000 7f29e6bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e0150470 0x7f29e0068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:00.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.186+0000 7f29e6bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f29e00bcbb0 0x7f29e0068e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:00.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.186+0000 7f29e6bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e006a010 con 0x7f29e0150850 2023-08-31T19:01:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.186+0000 7f29e6bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e0069400 con 0x7f29e00bcbb0 2023-08-31T19:01:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.186+0000 7f29e6bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00696e0 con 0x7f29e0150470 2023-08-31T19:01:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.187+0000 7f29dffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f29e00bcbb0 0x7f29e0068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.187+0000 7f29dffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f29e00bcbb0 0x7f29e0068e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38614/0 (socket says 172.21.15.72:38614) 2023-08-31T19:01:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.187+0000 7f29dffff700 1 -- 172.21.15.72:0/1292611875 learned_addr learned my addr 172.21.15.72:0/1292611875 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.187+0000 7f29e499b700 1 --2- 172.21.15.72:0/1292611875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e0150470 0x7f29e0068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.187+0000 7f29dffff700 1 -- 172.21.15.72:0/1292611875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e0150470 msgr2=0x7f29e0068920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.187+0000 7f29dffff700 1 --2- 172.21.15.72:0/1292611875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e0150470 0x7f29e0068920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.187+0000 7f29dffff700 1 -- 172.21.15.72:0/1292611875 >> v1:172.21.15.146:6789/0 conn(0x7f29e0150850 legacy=0x7f29e0064270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.187+0000 7f29dffff700 1 -- 172.21.15.72:0/1292611875 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e00699c0 con 0x7f29e00bcbb0 2023-08-31T19:01:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.187+0000 7f29dffff700 1 --2- 172.21.15.72:0/1292611875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e00bcbb0 0x7f29e0068e10 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f29cc00bac0 tx=0x7f29cc00b370).ready entity=mon.0 client_cookie=dd24f954d84a04e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.188+0000 7f29df7fe700 1 -- 172.21.15.72:0/1292611875 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc00dc40 con 0x7f29e00bcbb0 2023-08-31T19:01:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.188+0000 7f29df7fe700 1 -- 172.21.15.72:0/1292611875 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc00dda0 con 0x7f29e00bcbb0 2023-08-31T19:01:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.188+0000 7f29df7fe700 1 -- 172.21.15.72:0/1292611875 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc015600 con 0x7f29e00bcbb0 2023-08-31T19:01:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.188+0000 7f29e6bff700 1 -- 172.21.15.72:0/1292611875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e00bcbb0 msgr2=0x7f29e0068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.188+0000 7f29e6bff700 1 --2- 172.21.15.72:0/1292611875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e00bcbb0 0x7f29e0068e10 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f29cc00bac0 tx=0x7f29cc00b370).stop 2023-08-31T19:01:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.188+0000 7f29e6bff700 1 -- 172.21.15.72:0/1292611875 shutdown_connections 2023-08-31T19:01:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.188+0000 7f29e6bff700 1 --2- 172.21.15.72:0/1292611875 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e0150470 0x7f29e0068920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.188+0000 7f29e6bff700 1 --2- 172.21.15.72:0/1292611875 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e00bcbb0 0x7f29e0068e10 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.188+0000 7f29e6bff700 1 -- 172.21.15.72:0/1292611875 >> 172.21.15.72:0/1292611875 conn(0x7f29e0062650 msgr2=0x7f29e0062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.188+0000 7f29e6bff700 1 -- 172.21.15.72:0/1292611875 shutdown_connections 2023-08-31T19:01:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.188+0000 7f29e6bff700 1 -- 172.21.15.72:0/1292611875 wait complete. 2023-08-31T19:01:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.190+0000 7f29e6bff700 1 Processor -- start 2023-08-31T19:01:00.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.190+0000 7f29e6bff700 1 -- start start 2023-08-31T19:01:00.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.191+0000 7f29e6bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e00bcbb0 0x7f29e0158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:00.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.191+0000 7f29e6bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e0150470 0x7f29e015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:00.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.191+0000 7f29e6bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e0150850 0x7f29e014f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:00.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.191+0000 7f29e6bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e0159000 con 0x7f29e00bcbb0 2023-08-31T19:01:00.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.191+0000 7f29e6bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00bdae0 con 0x7f29e0150850 2023-08-31T19:01:00.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.191+0000 7f29e6bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00be620 con 0x7f29e0150470 2023-08-31T19:01:00.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.191+0000 7f29e499b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e00bcbb0 0x7f29e0158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:00.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.191+0000 7f29e499b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e00bcbb0 0x7f29e0158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38618/0 (socket says 172.21.15.72:38618) 2023-08-31T19:01:00.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.191+0000 7f29e499b700 1 -- 172.21.15.72:0/4184202634 learned_addr learned my addr 172.21.15.72:0/4184202634 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.191+0000 7f29dffff700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e0150470 0x7f29e015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.191+0000 7f29e499b700 1 -- 172.21.15.72:0/4184202634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e0150470 msgr2=0x7f29e015aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.191+0000 7f29e499b700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e0150470 0x7f29e015aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.191+0000 7f29e499b700 1 -- 172.21.15.72:0/4184202634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e0150850 msgr2=0x7f29e014f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.192+0000 7f29e519c700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e0150850 0x7f29e014f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.192+0000 7f29e499b700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e0150850 0x7f29e014f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.192+0000 7f29e499b700 1 -- 172.21.15.72:0/4184202634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc00b6a0 con 0x7f29e00bcbb0 2023-08-31T19:01:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.192+0000 7f29dffff700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e0150470 0x7f29e015aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:01:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.192+0000 7f29e519c700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e0150850 0x7f29e014f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:01:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.192+0000 7f29e499b700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e00bcbb0 0x7f29e0158b10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f29d400d890 tx=0x7f29d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.192+0000 7f29dcff9700 1 -- 172.21.15.72:0/4184202634 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d40125f0 con 0x7f29e00bcbb0 2023-08-31T19:01:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.192+0000 7f29dcff9700 1 -- 172.21.15.72:0/4184202634 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d4012750 con 0x7f29e00bcbb0 2023-08-31T19:01:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.192+0000 7f29e6bff700 1 -- 172.21.15.72:0/4184202634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e015af80 con 0x7f29e00bcbb0 2023-08-31T19:01:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.192+0000 7f29dcff9700 1 -- 172.21.15.72:0/4184202634 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4012ad0 con 0x7f29e00bcbb0 2023-08-31T19:01:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.192+0000 7f29e6bff700 1 -- 172.21.15.72:0/4184202634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e00bdfd0 con 0x7f29e00bcbb0 2023-08-31T19:01:00.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.193+0000 7f29e6bff700 1 -- 172.21.15.72:0/4184202634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e006c6b0 con 0x7f29e00bcbb0 2023-08-31T19:01:00.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.194+0000 7f29dcff9700 1 -- 172.21.15.72:0/4184202634 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f29d4013480 con 0x7f29e00bcbb0 2023-08-31T19:01:00.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.195+0000 7f29dcff9700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29c405ef30 0x7f29c40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:00.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.195+0000 7f29dcff9700 1 -- 172.21.15.72:0/4184202634 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5841+0+0 (secure 0 0 0) 0x7f29d4079d80 con 0x7f29e00bcbb0 2023-08-31T19:01:00.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.195+0000 7f29dffff700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29c405ef30 0x7f29c40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:00.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.195+0000 7f29dffff700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29c405ef30 0x7f29c40613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f29cc00bac0 tx=0x7f29cc01a000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:00.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.199+0000 7f29dcff9700 1 -- 172.21.15.72:0/4184202634 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f29d404b060 con 0x7f29e00bcbb0 2023-08-31T19:01:00.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.369+0000 7f29e6bff700 1 -- 172.21.15.72:0/4184202634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f29e0069ca0 con 0x7f29e00bcbb0 2023-08-31T19:01:00.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.516+0000 7f29dcff9700 1 -- 172.21.15.72:0/4184202634 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v58) v1 ==== 152+0+0 (secure 0 0 0) 0x7f29d404e680 con 0x7f29e00bcbb0 2023-08-31T19:01:00.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.522+0000 7f29e6bff700 1 -- 172.21.15.72:0/4184202634 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29c405ef30 msgr2=0x7f29c40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:00.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.522+0000 7f29e6bff700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29c405ef30 0x7f29c40613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f29cc00bac0 tx=0x7f29cc01a000).stop 2023-08-31T19:01:00.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.522+0000 7f29e6bff700 1 -- 172.21.15.72:0/4184202634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e00bcbb0 msgr2=0x7f29e0158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:00.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.522+0000 7f29e6bff700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e00bcbb0 0x7f29e0158b10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f29d400d890 tx=0x7f29d4008040).stop 2023-08-31T19:01:00.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.522+0000 7f29e6bff700 1 -- 172.21.15.72:0/4184202634 shutdown_connections 2023-08-31T19:01:00.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.522+0000 7f29e6bff700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29c405ef30 0x7f29c40613f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:00.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.522+0000 7f29e6bff700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29e0150850 0x7f29e014f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.522+0000 7f29e6bff700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29e00bcbb0 0x7f29e0158b10 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.522+0000 7f29e6bff700 1 --2- 172.21.15.72:0/4184202634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29e0150470 0x7f29e015aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.522+0000 7f29e6bff700 1 -- 172.21.15.72:0/4184202634 >> 172.21.15.72:0/4184202634 conn(0x7f29e0062650 msgr2=0x7f29e01531e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:00.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.523+0000 7f29e6bff700 1 -- 172.21.15.72:0/4184202634 shutdown_connections 2023-08-31T19:01:00.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.523+0000 7f29e6bff700 1 -- 172.21.15.72:0/4184202634 wait complete. 2023-08-31T19:01:00.526 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-08-31T19:01:00.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T19:01:00.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.738+0000 7f63e55ff700 1 Processor -- start 2023-08-31T19:01:00.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.738+0000 7f63e55ff700 1 -- start start 2023-08-31T19:01:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.739+0000 7f63e55ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63e0063980 0x7f63e0154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.739+0000 7f63e55ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63e00a9d40 0x7f63e00aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.739+0000 7f63e55ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e0158a90 con 0x7f63e0153e20 2023-08-31T19:01:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.739+0000 7f63e55ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e0157c70 con 0x7f63e0063980 2023-08-31T19:01:00.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.739+0000 7f63e55ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e00aa6a0 con 0x7f63e00a9d40 2023-08-31T19:01:00.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.740+0000 7f63de7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63e0063980 0x7f63e0154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:00.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.740+0000 7f63de7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63e0063980 0x7f63e0154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38632/0 (socket says 172.21.15.72:38632) 2023-08-31T19:01:00.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.740+0000 7f63de7fc700 1 -- 172.21.15.72:0/4086564429 learned_addr learned my addr 172.21.15.72:0/4086564429 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:00.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.740+0000 7f63df7fe700 1 --2- 172.21.15.72:0/4086564429 >> v2:172.21.15.146:3300/0 conn(0x7f63e00a9d40 0x7f63e00aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:00.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.740+0000 7f63de7fc700 1 -- 172.21.15.72:0/4086564429 >> v2:172.21.15.146:3300/0 conn(0x7f63e00a9d40 msgr2=0x7f63e00aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:00.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.740+0000 7f63de7fc700 1 --2- 172.21.15.72:0/4086564429 >> v2:172.21.15.146:3300/0 conn(0x7f63e00a9d40 0x7f63e00aa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:00.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.740+0000 7f63de7fc700 1 -- 172.21.15.72:0/4086564429 >> v1:172.21.15.146:6789/0 conn(0x7f63e0153e20 legacy=0x7f63e0063270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:00.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.740+0000 7f63de7fc700 1 -- 172.21.15.72:0/4086564429 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e0157e80 con 0x7f63e0063980 2023-08-31T19:01:00.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.740+0000 7f63de7fc700 1 --2- 172.21.15.72:0/4086564429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0063980 0x7f63e0154200 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f63e00bfe90 tx=0x7f63d40090f0).ready entity=mon.0 client_cookie=f6ff0eb96a46fd9d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:00.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.741+0000 7f63ddffb700 1 -- 172.21.15.72:0/4086564429 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d400b600 con 0x7f63e0063980 2023-08-31T19:01:00.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.741+0000 7f63ddffb700 1 -- 172.21.15.72:0/4086564429 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d400b760 con 0x7f63e0063980 2023-08-31T19:01:00.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.741+0000 7f63ddffb700 1 -- 172.21.15.72:0/4086564429 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d400bae0 con 0x7f63e0063980 2023-08-31T19:01:00.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.741+0000 7f63e55ff700 1 -- 172.21.15.72:0/4086564429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0063980 msgr2=0x7f63e0154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:00.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.741+0000 7f63e55ff700 1 --2- 172.21.15.72:0/4086564429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0063980 0x7f63e0154200 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f63e00bfe90 tx=0x7f63d40090f0).stop 2023-08-31T19:01:00.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.741+0000 7f63e55ff700 1 -- 172.21.15.72:0/4086564429 shutdown_connections 2023-08-31T19:01:00.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.741+0000 7f63e55ff700 1 --2- 172.21.15.72:0/4086564429 >> v2:172.21.15.146:3300/0 conn(0x7f63e00a9d40 0x7f63e00aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:00.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.741+0000 7f63e55ff700 1 --2- 172.21.15.72:0/4086564429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0063980 0x7f63e0154200 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:00.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.741+0000 7f63e55ff700 1 -- 172.21.15.72:0/4086564429 >> 172.21.15.72:0/4086564429 conn(0x7f63e005eb60 msgr2=0x7f63e00cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:00.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.741+0000 7f63e55ff700 1 -- 172.21.15.72:0/4086564429 shutdown_connections 2023-08-31T19:01:00.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.741+0000 7f63e55ff700 1 -- 172.21.15.72:0/4086564429 wait complete. 2023-08-31T19:01:00.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.743+0000 7f63e55ff700 1 Processor -- start 2023-08-31T19:01:00.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.744+0000 7f63e55ff700 1 -- start start 2023-08-31T19:01:00.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.745+0000 7f63e55ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0063980 0x7f63e01418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:00.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.745+0000 7f63e55ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e00a9d40 0x7f63e0156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:00.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.745+0000 7f63e55ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63e0153e20 0x7f63e0156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:00.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.745+0000 7f63e55ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e0156e00 con 0x7f63e0063980 2023-08-31T19:01:00.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.745+0000 7f63e55ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00c2ed0 con 0x7f63e00a9d40 2023-08-31T19:01:00.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.745+0000 7f63e55ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e0156fe0 con 0x7f63e0153e20 2023-08-31T19:01:00.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.745+0000 7f63deffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0063980 0x7f63e01418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:00.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.745+0000 7f63deffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0063980 0x7f63e01418a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38634/0 (socket says 172.21.15.72:38634) 2023-08-31T19:01:00.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.745+0000 7f63deffd700 1 -- 172.21.15.72:0/3722981684 learned_addr learned my addr 172.21.15.72:0/3722981684 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:00.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.745+0000 7f63df7fe700 1 --2- 172.21.15.72:0/3722981684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63e0153e20 0x7f63e0156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:00.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.745+0000 7f63de7fc700 1 --2- 172.21.15.72:0/3722981684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e00a9d40 0x7f63e0156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:00.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.745+0000 7f63deffd700 1 -- 172.21.15.72:0/3722981684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63e0153e20 msgr2=0x7f63e0156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:00.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.745+0000 7f63deffd700 1 --2- 172.21.15.72:0/3722981684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63e0153e20 0x7f63e0156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:00.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.745+0000 7f63deffd700 1 -- 172.21.15.72:0/3722981684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e00a9d40 msgr2=0x7f63e0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:00.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.745+0000 7f63deffd700 1 --2- 172.21.15.72:0/3722981684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e00a9d40 0x7f63e0156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:00.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.746+0000 7f63deffd700 1 -- 172.21.15.72:0/3722981684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d4009370 con 0x7f63e0063980 2023-08-31T19:01:00.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.746+0000 7f63deffd700 1 --2- 172.21.15.72:0/3722981684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0063980 0x7f63e01418a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f63d000c440 tx=0x7f63d0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:00.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.746+0000 7f63c6ffd700 1 -- 172.21.15.72:0/3722981684 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0007020 con 0x7f63e0063980 2023-08-31T19:01:00.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.746+0000 7f63c6ffd700 1 -- 172.21.15.72:0/3722981684 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d0007180 con 0x7f63e0063980 2023-08-31T19:01:00.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.746+0000 7f63c6ffd700 1 -- 172.21.15.72:0/3722981684 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0007520 con 0x7f63e0063980 2023-08-31T19:01:00.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.746+0000 7f63e55ff700 1 -- 172.21.15.72:0/3722981684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e01572c0 con 0x7f63e0063980 2023-08-31T19:01:00.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.746+0000 7f63e55ff700 1 -- 172.21.15.72:0/3722981684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e0157880 con 0x7f63e0063980 2023-08-31T19:01:00.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.747+0000 7f63e55ff700 1 -- 172.21.15.72:0/3722981684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e006c6b0 con 0x7f63e0063980 2023-08-31T19:01:00.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.748+0000 7f63c6ffd700 1 -- 172.21.15.72:0/3722981684 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f63d00068b0 con 0x7f63e0063980 2023-08-31T19:01:00.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.749+0000 7f63c6ffd700 1 --2- 172.21.15.72:0/3722981684 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63cc05ef30 0x7f63cc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:00.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.749+0000 7f63c6ffd700 1 -- 172.21.15.72:0/3722981684 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6211+0+0 (secure 0 0 0) 0x7f63d00793c0 con 0x7f63e0063980 2023-08-31T19:01:00.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.749+0000 7f63de7fc700 1 --2- 172.21.15.72:0/3722981684 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63cc05ef30 0x7f63cc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:00.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.750+0000 7f63de7fc700 1 --2- 172.21.15.72:0/3722981684 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63cc05ef30 0x7f63cc0613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f63e0063d80 tx=0x7f63d4017000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:00.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.753+0000 7f63c6ffd700 1 -- 172.21.15.72:0/3722981684 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f63d00478f0 con 0x7f63e0063980 2023-08-31T19:01:00.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:00.922+0000 7f63e55ff700 1 -- 172.21.15.72:0/3722981684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f63e0158160 con 0x7f63e0063980 2023-08-31T19:01:01.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.520+0000 7f63c6ffd700 1 -- 172.21.15.72:0/3722981684 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v59) v1 ==== 170+0+0 (secure 0 0 0) 0x7f63d004e080 con 0x7f63e0063980 2023-08-31T19:01:01.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.525+0000 7f63e55ff700 1 -- 172.21.15.72:0/3722981684 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63cc05ef30 msgr2=0x7f63cc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:01.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.525+0000 7f63e55ff700 1 --2- 172.21.15.72:0/3722981684 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63cc05ef30 0x7f63cc0613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f63e0063d80 tx=0x7f63d4017000).stop 2023-08-31T19:01:01.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.525+0000 7f63e55ff700 1 -- 172.21.15.72:0/3722981684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0063980 msgr2=0x7f63e01418a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:01.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.525+0000 7f63e55ff700 1 --2- 172.21.15.72:0/3722981684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0063980 0x7f63e01418a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f63d000c440 tx=0x7f63d0007e00).stop 2023-08-31T19:01:01.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.527+0000 7f63e55ff700 1 -- 172.21.15.72:0/3722981684 shutdown_connections 2023-08-31T19:01:01.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.527+0000 7f63e55ff700 1 --2- 172.21.15.72:0/3722981684 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f63e0153e20 0x7f63e0156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:01.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.527+0000 7f63e55ff700 1 --2- 172.21.15.72:0/3722981684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e0063980 0x7f63e01418a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:01.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.527+0000 7f63e55ff700 1 --2- 172.21.15.72:0/3722981684 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63cc05ef30 0x7f63cc0613f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:01.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.527+0000 7f63e55ff700 1 --2- 172.21.15.72:0/3722981684 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e00a9d40 0x7f63e0156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:01.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.527+0000 7f63e55ff700 1 -- 172.21.15.72:0/3722981684 >> 172.21.15.72:0/3722981684 conn(0x7f63e005eb60 msgr2=0x7f63e014d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:01.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.530+0000 7f63e55ff700 1 -- 172.21.15.72:0/3722981684 shutdown_connections 2023-08-31T19:01:01.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.532+0000 7f63e55ff700 1 -- 172.21.15.72:0/3722981684 wait complete. 2023-08-31T19:01:01.539 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-08-31T19:01:01.561 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T19:01:01.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.754+0000 7f45ef3ff700 1 Processor -- start 2023-08-31T19:01:01.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.754+0000 7f45ef3ff700 1 -- start start 2023-08-31T19:01:01.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.756+0000 7f45ef3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45e8154030 0x7f45e8154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:01.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.756+0000 7f45ef3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45e80c7360 0x7f45e8063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:01.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.756+0000 7f45ef3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e80c6ed0 con 0x7f45e80c06b0 2023-08-31T19:01:01.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.756+0000 7f45ef3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e80c66e0 con 0x7f45e8154030 2023-08-31T19:01:01.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.756+0000 7f45ef3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e80c68c0 con 0x7f45e80c7360 2023-08-31T19:01:01.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.756+0000 7f45ed19b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45e8154030 0x7f45e8154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:01.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.756+0000 7f45ed19b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45e8154030 0x7f45e8154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38648/0 (socket says 172.21.15.72:38648) 2023-08-31T19:01:01.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.756+0000 7f45ed19b700 1 -- 172.21.15.72:0/3000670423 learned_addr learned my addr 172.21.15.72:0/3000670423 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:01.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.756+0000 7f45ec99a700 1 --1- 172.21.15.72:0/3000670423 >> v1:172.21.15.72:6789/0 conn(0x7f45e80c06b0 0x7f45e80aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55378/0 (socket says 172.21.15.72:55378) 2023-08-31T19:01:01.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.757+0000 7f45ed99c700 1 --2- 172.21.15.72:0/3000670423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45e80c7360 0x7f45e8063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:01.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.757+0000 7f45ed19b700 1 -- 172.21.15.72:0/3000670423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45e80c7360 msgr2=0x7f45e8063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:01.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.757+0000 7f45ed19b700 1 --2- 172.21.15.72:0/3000670423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45e80c7360 0x7f45e8063120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:01.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.757+0000 7f45ed19b700 1 -- 172.21.15.72:0/3000670423 >> v1:172.21.15.72:6789/0 conn(0x7f45e80c06b0 legacy=0x7f45e80aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:01.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.757+0000 7f45ed19b700 1 -- 172.21.15.72:0/3000670423 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e80c0f30 con 0x7f45e8154030 2023-08-31T19:01:01.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.757+0000 7f45ed99c700 1 --2- 172.21.15.72:0/3000670423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45e80c7360 0x7f45e8063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:01.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.757+0000 7f45dffff700 1 -- 172.21.15.72:0/3000670423 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220824277 0 0) 0x7f45e80c6ed0 con 0x7f45e80c06b0 2023-08-31T19:01:01.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.757+0000 7f45ed19b700 1 --2- 172.21.15.72:0/3000670423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e8154030 0x7f45e8154410 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f45e4006fd0 tx=0x7f45e40090f0).ready entity=mon.0 client_cookie=48b6f7fba5cab262 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:01.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.757+0000 7f45dffff700 1 -- 172.21.15.72:0/3000670423 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e400b600 con 0x7f45e8154030 2023-08-31T19:01:01.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.757+0000 7f45dffff700 1 -- 172.21.15.72:0/3000670423 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e400b760 con 0x7f45e8154030 2023-08-31T19:01:01.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.757+0000 7f45dffff700 1 -- 172.21.15.72:0/3000670423 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e400bae0 con 0x7f45e8154030 2023-08-31T19:01:01.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.758+0000 7f45ef3ff700 1 -- 172.21.15.72:0/3000670423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e8154030 msgr2=0x7f45e8154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:01.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.758+0000 7f45ef3ff700 1 --2- 172.21.15.72:0/3000670423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e8154030 0x7f45e8154410 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f45e4006fd0 tx=0x7f45e40090f0).stop 2023-08-31T19:01:01.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.758+0000 7f45ef3ff700 1 -- 172.21.15.72:0/3000670423 shutdown_connections 2023-08-31T19:01:01.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.758+0000 7f45ef3ff700 1 --2- 172.21.15.72:0/3000670423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e8154030 0x7f45e8154410 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:01.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.758+0000 7f45ef3ff700 1 --2- 172.21.15.72:0/3000670423 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45e80c7360 0x7f45e8063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:01.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.758+0000 7f45ef3ff700 1 -- 172.21.15.72:0/3000670423 >> 172.21.15.72:0/3000670423 conn(0x7f45e805eb60 msgr2=0x7f45e80cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:01.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.758+0000 7f45ef3ff700 1 -- 172.21.15.72:0/3000670423 shutdown_connections 2023-08-31T19:01:01.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.758+0000 7f45ef3ff700 1 -- 172.21.15.72:0/3000670423 wait complete. 2023-08-31T19:01:01.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.760+0000 7f45ef3ff700 1 Processor -- start 2023-08-31T19:01:01.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.760+0000 7f45ef3ff700 1 -- start start 2023-08-31T19:01:01.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ef3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45e80c06b0 0x7f45e81495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:01.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ef3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45e80c7360 0x7f45e80add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:01.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ef3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e8154030 0x7f45e80c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:01.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ef3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8155280 con 0x7f45e8154030 2023-08-31T19:01:01.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ef3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8155560 con 0x7f45e80c7360 2023-08-31T19:01:01.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ef3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8155840 con 0x7f45e80c06b0 2023-08-31T19:01:01.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ed99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e8154030 0x7f45e80c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:01.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ed99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e8154030 0x7f45e80c25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38658/0 (socket says 172.21.15.72:38658) 2023-08-31T19:01:01.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ed99c700 1 -- 172.21.15.72:0/511938004 learned_addr learned my addr 172.21.15.72:0/511938004 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:01.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ed19b700 1 --2- 172.21.15.72:0/511938004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45e80c06b0 0x7f45e81495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:01.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ec99a700 1 --2- 172.21.15.72:0/511938004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45e80c7360 0x7f45e80add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:01.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ed99c700 1 -- 172.21.15.72:0/511938004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45e80c06b0 msgr2=0x7f45e81495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:01.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ed99c700 1 --2- 172.21.15.72:0/511938004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45e80c06b0 0x7f45e81495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:01.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ed99c700 1 -- 172.21.15.72:0/511938004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45e80c7360 msgr2=0x7f45e80add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:01.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ed99c700 1 --2- 172.21.15.72:0/511938004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45e80c7360 0x7f45e80add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:01.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ed99c700 1 -- 172.21.15.72:0/511938004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e4009370 con 0x7f45e8154030 2023-08-31T19:01:01.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ec99a700 1 --2- 172.21.15.72:0/511938004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45e80c7360 0x7f45e80add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:01.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.762+0000 7f45ed99c700 1 --2- 172.21.15.72:0/511938004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e8154030 0x7f45e80c25e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f45e000d180 tx=0x7f45e0009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:01.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.763+0000 7f45dd7fa700 1 -- 172.21.15.72:0/511938004 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e000dd70 con 0x7f45e8154030 2023-08-31T19:01:01.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.763+0000 7f45dd7fa700 1 -- 172.21.15.72:0/511938004 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e000f040 con 0x7f45e8154030 2023-08-31T19:01:01.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.763+0000 7f45ef3ff700 1 -- 172.21.15.72:0/511938004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e8155b20 con 0x7f45e8154030 2023-08-31T19:01:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.763+0000 7f45dd7fa700 1 -- 172.21.15.72:0/511938004 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0013600 con 0x7f45e8154030 2023-08-31T19:01:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.763+0000 7f45ef3ff700 1 -- 172.21.15.72:0/511938004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e8154f30 con 0x7f45e8154030 2023-08-31T19:01:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.764+0000 7f45ef3ff700 1 -- 172.21.15.72:0/511938004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e806c6b0 con 0x7f45e8154030 2023-08-31T19:01:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.765+0000 7f45dd7fa700 1 -- 172.21.15.72:0/511938004 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f45e00139f0 con 0x7f45e8154030 2023-08-31T19:01:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.766+0000 7f45dd7fa700 1 --2- 172.21.15.72:0/511938004 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f45cc05ef60 0x7f45cc061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.766+0000 7f45dd7fa700 1 -- 172.21.15.72:0/511938004 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6593+0+0 (secure 0 0 0) 0x7f45e007a650 con 0x7f45e8154030 2023-08-31T19:01:01.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.766+0000 7f45ed19b700 1 --2- 172.21.15.72:0/511938004 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f45cc05ef60 0x7f45cc061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:01.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.767+0000 7f45ed19b700 1 --2- 172.21.15.72:0/511938004 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f45cc05ef60 0x7f45cc061420 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f45e4009130 tx=0x7f45e4017000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:01.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.770+0000 7f45dd7fa700 1 -- 172.21.15.72:0/511938004 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f45e004b640 con 0x7f45e8154030 2023-08-31T19:01:01.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.980+0000 7f45ef3ff700 1 -- 172.21.15.72:0/511938004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f45e80c0c50 con 0x7f45e8154030 2023-08-31T19:01:01.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.986+0000 7f45dd7fa700 1 -- 172.21.15.72:0/511938004 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v19) v1 ==== 172+0+0 (secure 0 0 0) 0x7f45e004ec60 con 0x7f45e8154030 2023-08-31T19:01:01.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.994+0000 7f45ef3ff700 1 -- 172.21.15.72:0/511938004 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f45cc05ef60 msgr2=0x7f45cc061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:01.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.994+0000 7f45ef3ff700 1 --2- 172.21.15.72:0/511938004 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f45cc05ef60 0x7f45cc061420 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f45e4009130 tx=0x7f45e4017000).stop 2023-08-31T19:01:01.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.994+0000 7f45ef3ff700 1 -- 172.21.15.72:0/511938004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e8154030 msgr2=0x7f45e80c25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.994+0000 7f45ef3ff700 1 --2- 172.21.15.72:0/511938004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e8154030 0x7f45e80c25e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f45e000d180 tx=0x7f45e0009a50).stop 2023-08-31T19:01:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.994+0000 7f45ef3ff700 1 -- 172.21.15.72:0/511938004 shutdown_connections 2023-08-31T19:01:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.994+0000 7f45ef3ff700 1 --2- 172.21.15.72:0/511938004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e8154030 0x7f45e80c25e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.994+0000 7f45ef3ff700 1 --2- 172.21.15.72:0/511938004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45e80c06b0 0x7f45e81495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.994+0000 7f45ef3ff700 1 --2- 172.21.15.72:0/511938004 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f45cc05ef60 0x7f45cc061420 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0x7f45e4009130 tx=0x7f45e4017000).stop 2023-08-31T19:01:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.994+0000 7f45ef3ff700 1 --2- 172.21.15.72:0/511938004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45e80c7360 0x7f45e80add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.994+0000 7f45ef3ff700 1 -- 172.21.15.72:0/511938004 >> 172.21.15.72:0/511938004 conn(0x7f45e805eb60 msgr2=0x7f45e8151b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:01.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.996+0000 7f45ef3ff700 1 -- 172.21.15.72:0/511938004 shutdown_connections 2023-08-31T19:01:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:01.999+0000 7f45ef3ff700 1 -- 172.21.15.72:0/511938004 wait complete. 2023-08-31T19:01:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 7 and data pool 8 2023-08-31T19:01:02.034 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:01:02.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.222+0000 7f273a9ff700 1 Processor -- start 2023-08-31T19:01:02.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.222+0000 7f273a9ff700 1 -- start start 2023-08-31T19:01:02.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.223+0000 7f273a9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2734154220 0x7f2734157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:02.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.224+0000 7f273a9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f27341588d0 0x7f27340c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:02.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.224+0000 7f273a9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27340c8c90 con 0x7f27340cb940 2023-08-31T19:01:02.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.224+0000 7f273a9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27340aa700 con 0x7f27341588d0 2023-08-31T19:01:02.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.224+0000 7f273a9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27340c5e10 con 0x7f2734154220 2023-08-31T19:01:02.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.224+0000 7f27337fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f27340cb940 0x7f27341581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55382/0 (socket says 172.21.15.72:55382) 2023-08-31T19:01:02.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.224+0000 7f27337fe700 1 -- 172.21.15.72:0/589677899 learned_addr learned my addr 172.21.15.72:0/589677899 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:01:02.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.224+0000 7f2733fff700 1 --2- 172.21.15.72:0/589677899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2734154220 0x7f2734157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:02.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.224+0000 7f2732ffd700 1 -- 172.21.15.72:0/589677899 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722776504 0 0) 0x7f27340c8c90 con 0x7f27340cb940 2023-08-31T19:01:02.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.224+0000 7f2738f9c700 1 --2- 172.21.15.72:0/589677899 >> v2:172.21.15.146:3300/0 conn(0x7f27341588d0 0x7f27340c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:02.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.224+0000 7f2732ffd700 1 -- 172.21.15.72:0/589677899 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f271c0033f0 con 0x7f27340cb940 2023-08-31T19:01:02.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2732ffd700 1 -- 172.21.15.72:0/589677899 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 264865014 0 0) 0x7f271c0033f0 con 0x7f27340cb940 2023-08-31T19:01:02.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2732ffd700 1 -- 172.21.15.72:0/589677899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2734154220 msgr2=0x7f2734157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:02.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2732ffd700 1 --2- 172.21.15.72:0/589677899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2734154220 0x7f2734157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2732ffd700 1 -- 172.21.15.72:0/589677899 >> v2:172.21.15.146:3300/0 conn(0x7f27341588d0 msgr2=0x7f27340c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:02.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2732ffd700 1 --2- 172.21.15.72:0/589677899 >> v2:172.21.15.146:3300/0 conn(0x7f27341588d0 0x7f27340c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2732ffd700 1 -- 172.21.15.72:0/589677899 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2734155610 con 0x7f27340cb940 2023-08-31T19:01:02.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2732ffd700 1 -- 172.21.15.72:0/589677899 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f2728001470 con 0x7f27340cb940 2023-08-31T19:01:02.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2732ffd700 1 -- 172.21.15.72:0/589677899 >> v1:172.21.15.72:6789/0 conn(0x7f27340cb940 legacy=0x7f27341581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:02.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2732ffd700 1 --2- 172.21.15.72:0/589677899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f271c0038e0 0x7f271c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:02.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2732ffd700 1 --2- 172.21.15.72:0/589677899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2734154220 0x7f271c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:02.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2732ffd700 1 --2- 172.21.15.72:0/589677899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f271c004b80 0x7f271c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:02.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2732ffd700 1 -- 172.21.15.72:0/589677899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27340aa700 con 0x7f271c004b80 2023-08-31T19:01:02.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2732ffd700 1 -- 172.21.15.72:0/589677899 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27340c5e10 con 0x7f271c0038e0 2023-08-31T19:01:02.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2732ffd700 1 -- 172.21.15.72:0/589677899 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c00b8e0 con 0x7f2734154220 2023-08-31T19:01:02.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2738f9c700 1 --2- 172.21.15.72:0/589677899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f271c004b80 0x7f271c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:02.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f27337fe700 1 --2- 172.21.15.72:0/589677899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2734154220 0x7f271c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:02.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2733fff700 1 --2- 172.21.15.72:0/589677899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f271c0038e0 0x7f271c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:02.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2738f9c700 1 -- 172.21.15.72:0/589677899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2734154220 msgr2=0x7f271c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:02.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2738f9c700 1 --2- 172.21.15.72:0/589677899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2734154220 0x7f271c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.225+0000 7f2738f9c700 1 -- 172.21.15.72:0/589677899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f271c0038e0 msgr2=0x7f271c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:02.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.226+0000 7f2738f9c700 1 --2- 172.21.15.72:0/589677899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f271c0038e0 0x7f271c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.226+0000 7f2738f9c700 1 -- 172.21.15.72:0/589677899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c0033f0 con 0x7f271c004b80 2023-08-31T19:01:02.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.226+0000 7f27337fe700 1 --2- 172.21.15.72:0/589677899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2734154220 0x7f271c004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:02.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.226+0000 7f2738f9c700 1 --2- 172.21.15.72:0/589677899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f271c004b80 0x7f271c005000 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f272c00e210 tx=0x7f272c00b040).ready entity=mon.0 client_cookie=b57013624c53c946 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:02.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.226+0000 7f2732ffd700 1 -- 172.21.15.72:0/589677899 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c009ac0 con 0x7f271c004b80 2023-08-31T19:01:02.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.226+0000 7f2732ffd700 1 -- 172.21.15.72:0/589677899 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c00f040 con 0x7f271c004b80 2023-08-31T19:01:02.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.226+0000 7f2732ffd700 1 -- 172.21.15.72:0/589677899 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c00ecd0 con 0x7f271c004b80 2023-08-31T19:01:02.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.226+0000 7f273a9ff700 1 -- 172.21.15.72:0/589677899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f271c004b80 msgr2=0x7f271c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:02.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.226+0000 7f273a9ff700 1 --2- 172.21.15.72:0/589677899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f271c004b80 0x7f271c005000 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f272c00e210 tx=0x7f272c00b040).stop 2023-08-31T19:01:02.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.226+0000 7f2738f9c700 1 -- 172.21.15.72:0/589677899 reap_dead start 2023-08-31T19:01:02.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.226+0000 7f273a9ff700 1 -- 172.21.15.72:0/589677899 shutdown_connections 2023-08-31T19:01:02.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.226+0000 7f273a9ff700 1 -- 172.21.15.72:0/589677899 >> 172.21.15.72:0/589677899 conn(0x7f273405e870 msgr2=0x7f27340cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:02.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.227+0000 7f273a9ff700 1 -- 172.21.15.72:0/589677899 shutdown_connections 2023-08-31T19:01:02.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.227+0000 7f273a9ff700 1 -- 172.21.15.72:0/589677899 wait complete. 2023-08-31T19:01:02.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.229+0000 7f273a9ff700 1 Processor -- start 2023-08-31T19:01:02.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.229+0000 7f273a9ff700 1 -- start start 2023-08-31T19:01:02.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.230+0000 7f273a9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f271c004b80 0x7f2734141780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:02.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.230+0000 7f273a9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27340ad130 0x7f2734152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:02.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.230+0000 7f273a9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2734152a70 0x7f27340ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:02.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.230+0000 7f273a9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27341534b0 con 0x7f27340ad130 2023-08-31T19:01:02.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.230+0000 7f273a9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27340c7310 con 0x7f271c004b80 2023-08-31T19:01:02.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.230+0000 7f273a9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2734152ef0 con 0x7f2734152a70 2023-08-31T19:01:02.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.230+0000 7f27337fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27340ad130 0x7f2734152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:02.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.230+0000 7f27337fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27340ad130 0x7f2734152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38674/0 (socket says 172.21.15.72:38674) 2023-08-31T19:01:02.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.230+0000 7f27337fe700 1 -- 172.21.15.72:0/663856002 learned_addr learned my addr 172.21.15.72:0/663856002 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:02.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.231+0000 7f2733fff700 1 --2- 172.21.15.72:0/663856002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f271c004b80 0x7f2734141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:02.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.231+0000 7f2738f9c700 1 --2- 172.21.15.72:0/663856002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2734152a70 0x7f27340ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:02.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.231+0000 7f27337fe700 1 -- 172.21.15.72:0/663856002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2734152a70 msgr2=0x7f27340ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:02.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.231+0000 7f27337fe700 1 --2- 172.21.15.72:0/663856002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2734152a70 0x7f27340ab0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.231+0000 7f27337fe700 1 -- 172.21.15.72:0/663856002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f271c004b80 msgr2=0x7f2734141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:02.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.231+0000 7f27337fe700 1 --2- 172.21.15.72:0/663856002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f271c004b80 0x7f2734141780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.231+0000 7f27337fe700 1 -- 172.21.15.72:0/663856002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27341531d0 con 0x7f27340ad130 2023-08-31T19:01:02.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.231+0000 7f2733fff700 1 --2- 172.21.15.72:0/663856002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f271c004b80 0x7f2734141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:02.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.231+0000 7f27337fe700 1 --2- 172.21.15.72:0/663856002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27340ad130 0x7f2734152580 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f272800e830 tx=0x7f2728000d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:02.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.231+0000 7f271bfff700 1 -- 172.21.15.72:0/663856002 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272800a520 con 0x7f27340ad130 2023-08-31T19:01:02.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.231+0000 7f271bfff700 1 -- 172.21.15.72:0/663856002 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2728010040 con 0x7f27340ad130 2023-08-31T19:01:02.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.231+0000 7f273a9ff700 1 -- 172.21.15.72:0/663856002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27340c6fa0 con 0x7f27340ad130 2023-08-31T19:01:02.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.231+0000 7f271bfff700 1 -- 172.21.15.72:0/663856002 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272800a890 con 0x7f27340ad130 2023-08-31T19:01:02.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.231+0000 7f273a9ff700 1 -- 172.21.15.72:0/663856002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27340ab5a0 con 0x7f27340ad130 2023-08-31T19:01:02.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.232+0000 7f273a9ff700 1 -- 172.21.15.72:0/663856002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273406c6b0 con 0x7f27340ad130 2023-08-31T19:01:02.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.233+0000 7f271bfff700 1 -- 172.21.15.72:0/663856002 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f272800ac40 con 0x7f27340ad130 2023-08-31T19:01:02.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.234+0000 7f271bfff700 1 --2- 172.21.15.72:0/663856002 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f272005ef30 0x7f27200613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:02.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.234+0000 7f271bfff700 1 -- 172.21.15.72:0/663856002 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6693+0+0 (secure 0 0 0) 0x7f2728079b40 con 0x7f27340ad130 2023-08-31T19:01:02.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.234+0000 7f2733fff700 1 --2- 172.21.15.72:0/663856002 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f272005ef30 0x7f27200613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:02.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.235+0000 7f2733fff700 1 --2- 172.21.15.72:0/663856002 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f272005ef30 0x7f27200613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2724006cf0 tx=0x7f2724008040).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:02.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.238+0000 7f271bfff700 1 -- 172.21.15.72:0/663856002 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f272804ab50 con 0x7f27340ad130 2023-08-31T19:01:02.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.408+0000 7f273a9ff700 1 -- 172.21.15.72:0/663856002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27340c0a50 con 0x7f27340ad130 2023-08-31T19:01:02.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.409+0000 7f271bfff700 1 -- 172.21.15.72:0/663856002 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+17900 (secure 0 0 0) 0x7f272804e170 con 0x7f27340ad130 2023-08-31T19:01:02.410 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:01:02.410 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":60,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:01:01.982153+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:01:00.413643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-31T19:01:00.966624+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:01:02.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.411+0000 7f273a9ff700 1 -- 172.21.15.72:0/663856002 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f272005ef30 msgr2=0x7f27200613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:02.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.411+0000 7f273a9ff700 1 --2- 172.21.15.72:0/663856002 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f272005ef30 0x7f27200613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2724006cf0 tx=0x7f2724008040).stop 2023-08-31T19:01:02.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.411+0000 7f273a9ff700 1 -- 172.21.15.72:0/663856002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27340ad130 msgr2=0x7f2734152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:02.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.411+0000 7f273a9ff700 1 --2- 172.21.15.72:0/663856002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27340ad130 0x7f2734152580 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f272800e830 tx=0x7f2728000d70).stop 2023-08-31T19:01:02.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.412+0000 7f273a9ff700 1 -- 172.21.15.72:0/663856002 shutdown_connections 2023-08-31T19:01:02.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.412+0000 7f273a9ff700 1 --2- 172.21.15.72:0/663856002 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2734152a70 0x7f27340ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.412+0000 7f273a9ff700 1 --2- 172.21.15.72:0/663856002 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f272005ef30 0x7f27200613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.412+0000 7f273a9ff700 1 --2- 172.21.15.72:0/663856002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f271c004b80 0x7f2734141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.412+0000 7f273a9ff700 1 --2- 172.21.15.72:0/663856002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27340ad130 0x7f2734152580 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.412+0000 7f273a9ff700 1 -- 172.21.15.72:0/663856002 >> 172.21.15.72:0/663856002 conn(0x7f273405e870 msgr2=0x7f27340cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:02.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.412+0000 7f273a9ff700 1 -- 172.21.15.72:0/663856002 shutdown_connections 2023-08-31T19:01:02.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.412+0000 7f273a9ff700 1 -- 172.21.15.72:0/663856002 wait complete. 2023-08-31T19:01:02.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:01:02.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.617+0000 7f29513ff700 1 Processor -- start 2023-08-31T19:01:02.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.618+0000 7f29513ff700 1 -- start start 2023-08-31T19:01:02.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.619+0000 7f29513ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f294c0c4740 0x7f294c157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:02.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.619+0000 7f29513ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f294c1581d0 0x7f294c0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:02.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.619+0000 7f29513ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294c063be0 con 0x7f294c0c6c30 2023-08-31T19:01:02.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.619+0000 7f29513ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294c0bca10 con 0x7f294c0c4740 2023-08-31T19:01:02.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.619+0000 7f29513ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294c158640 con 0x7f294c1581d0 2023-08-31T19:01:02.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.619+0000 7f294a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f294c0c4740 0x7f294c157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:02.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.619+0000 7f294a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f294c0c4740 0x7f294c157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38680/0 (socket says 172.21.15.72:38680) 2023-08-31T19:01:02.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.619+0000 7f294a7fc700 1 -- 172.21.15.72:0/1477025445 learned_addr learned my addr 172.21.15.72:0/1477025445 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:02.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.619+0000 7f294b7fe700 1 --2- 172.21.15.72:0/1477025445 >> v2:172.21.15.146:3300/0 conn(0x7f294c1581d0 0x7f294c0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:02.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.620+0000 7f294a7fc700 1 -- 172.21.15.72:0/1477025445 >> v2:172.21.15.146:3300/0 conn(0x7f294c1581d0 msgr2=0x7f294c0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:02.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.620+0000 7f294a7fc700 1 --2- 172.21.15.72:0/1477025445 >> v2:172.21.15.146:3300/0 conn(0x7f294c1581d0 0x7f294c0c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.620+0000 7f294a7fc700 1 -- 172.21.15.72:0/1477025445 >> v1:172.21.15.146:6789/0 conn(0x7f294c0c6c30 legacy=0x7f294c0bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:02.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.620+0000 7f294a7fc700 1 -- 172.21.15.72:0/1477025445 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c063010 con 0x7f294c0c4740 2023-08-31T19:01:02.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.620+0000 7f294a7fc700 1 --2- 172.21.15.72:0/1477025445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c0c4740 0x7f294c157ce0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f294c158cc0 tx=0x7f29400090f0).ready entity=mon.0 client_cookie=3b3a22c65e9a60ee server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:02.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.620+0000 7f2949ffb700 1 -- 172.21.15.72:0/1477025445 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294000b5a0 con 0x7f294c0c4740 2023-08-31T19:01:02.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.620+0000 7f2949ffb700 1 -- 172.21.15.72:0/1477025445 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294000b700 con 0x7f294c0c4740 2023-08-31T19:01:02.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.620+0000 7f2949ffb700 1 -- 172.21.15.72:0/1477025445 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294000ba80 con 0x7f294c0c4740 2023-08-31T19:01:02.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.621+0000 7f29513ff700 1 -- 172.21.15.72:0/1477025445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c0c4740 msgr2=0x7f294c157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:02.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.621+0000 7f29513ff700 1 --2- 172.21.15.72:0/1477025445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c0c4740 0x7f294c157ce0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f294c158cc0 tx=0x7f29400090f0).stop 2023-08-31T19:01:02.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.621+0000 7f29513ff700 1 -- 172.21.15.72:0/1477025445 shutdown_connections 2023-08-31T19:01:02.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.621+0000 7f29513ff700 1 --2- 172.21.15.72:0/1477025445 >> v2:172.21.15.146:3300/0 conn(0x7f294c1581d0 0x7f294c0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.621+0000 7f29513ff700 1 --2- 172.21.15.72:0/1477025445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c0c4740 0x7f294c157ce0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.621+0000 7f29513ff700 1 -- 172.21.15.72:0/1477025445 >> 172.21.15.72:0/1477025445 conn(0x7f294c0c7e70 msgr2=0x7f294c0c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:02.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.621+0000 7f29513ff700 1 -- 172.21.15.72:0/1477025445 shutdown_connections 2023-08-31T19:01:02.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.621+0000 7f29513ff700 1 -- 172.21.15.72:0/1477025445 wait complete. 2023-08-31T19:01:02.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.623+0000 7f29513ff700 1 Processor -- start 2023-08-31T19:01:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.623+0000 7f29513ff700 1 -- start start 2023-08-31T19:01:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.624+0000 7f29513ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f294c0c4740 0x7f294c0a9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.624+0000 7f29513ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c0c6c30 0x7f294c0aa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.624+0000 7f29513ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f294c1581d0 0x7f294c136cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:02.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.624+0000 7f29513ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0aa820 con 0x7f294c0c6c30 2023-08-31T19:01:02.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.624+0000 7f29513ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0ab640 con 0x7f294c0c4740 2023-08-31T19:01:02.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.624+0000 7f29513ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0aaa30 con 0x7f294c1581d0 2023-08-31T19:01:02.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.624+0000 7f294a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c0c6c30 0x7f294c0aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:02.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.625+0000 7f294a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c0c6c30 0x7f294c0aa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38686/0 (socket says 172.21.15.72:38686) 2023-08-31T19:01:02.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.625+0000 7f294a7fc700 1 -- 172.21.15.72:0/3658096901 learned_addr learned my addr 172.21.15.72:0/3658096901 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:02.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.625+0000 7f294b7fe700 1 --2- 172.21.15.72:0/3658096901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f294c1581d0 0x7f294c136cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:02.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.625+0000 7f294affd700 1 --2- 172.21.15.72:0/3658096901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f294c0c4740 0x7f294c0a9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:02.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.625+0000 7f294a7fc700 1 -- 172.21.15.72:0/3658096901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f294c1581d0 msgr2=0x7f294c136cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:02.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.625+0000 7f294a7fc700 1 --2- 172.21.15.72:0/3658096901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f294c1581d0 0x7f294c136cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.625+0000 7f294a7fc700 1 -- 172.21.15.72:0/3658096901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f294c0c4740 msgr2=0x7f294c0a9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:02.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.625+0000 7f294a7fc700 1 --2- 172.21.15.72:0/3658096901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f294c0c4740 0x7f294c0a9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.625+0000 7f294a7fc700 1 -- 172.21.15.72:0/3658096901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2940009370 con 0x7f294c0c6c30 2023-08-31T19:01:02.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.625+0000 7f294a7fc700 1 --2- 172.21.15.72:0/3658096901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c0c6c30 0x7f294c0aa330 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f294c064200 tx=0x7f2940015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.625+0000 7f2932ffd700 1 -- 172.21.15.72:0/3658096901 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294000b870 con 0x7f294c0c6c30 2023-08-31T19:01:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.625+0000 7f2932ffd700 1 -- 172.21.15.72:0/3658096901 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294000b9d0 con 0x7f294c0c6c30 2023-08-31T19:01:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.625+0000 7f29513ff700 1 -- 172.21.15.72:0/3658096901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294c0aad10 con 0x7f294c0c6c30 2023-08-31T19:01:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.625+0000 7f2932ffd700 1 -- 172.21.15.72:0/3658096901 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294001c670 con 0x7f294c0c6c30 2023-08-31T19:01:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.626+0000 7f29513ff700 1 -- 172.21.15.72:0/3658096901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294c0ab2d0 con 0x7f294c0c6c30 2023-08-31T19:01:02.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.627+0000 7f29513ff700 1 -- 172.21.15.72:0/3658096901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294c0ab7d0 con 0x7f294c0c6c30 2023-08-31T19:01:02.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.627+0000 7f2932ffd700 1 -- 172.21.15.72:0/3658096901 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f294001c9e0 con 0x7f294c0c6c30 2023-08-31T19:01:02.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.628+0000 7f2932ffd700 1 --2- 172.21.15.72:0/3658096901 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f293805ef30 0x7f29380613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:02.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.628+0000 7f2932ffd700 1 -- 172.21.15.72:0/3658096901 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6693+0+0 (secure 0 0 0) 0x7f294007bf40 con 0x7f294c0c6c30 2023-08-31T19:01:02.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.628+0000 7f294affd700 1 --2- 172.21.15.72:0/3658096901 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f293805ef30 0x7f29380613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:02.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.629+0000 7f294affd700 1 --2- 172.21.15.72:0/3658096901 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f293805ef30 0x7f29380613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f293c0036e0 tx=0x7f293c009040).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:02.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.632+0000 7f2932ffd700 1 -- 172.21.15.72:0/3658096901 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f294004cff0 con 0x7f294c0c6c30 2023-08-31T19:01:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.802+0000 7f29513ff700 1 -- 172.21.15.72:0/3658096901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f294c0655b0 con 0x7f294c0c6c30 2023-08-31T19:01:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.803+0000 7f2932ffd700 1 -- 172.21.15.72:0/3658096901 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+17900 (secure 0 0 0) 0x7f294002a020 con 0x7f294c0c6c30 2023-08-31T19:01:02.804 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:01:02.804 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":60,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:01:01.982153+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:01:00.413643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-31T19:01:00.966624+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:01:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.805+0000 7f29513ff700 1 -- 172.21.15.72:0/3658096901 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f293805ef30 msgr2=0x7f29380613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.805+0000 7f29513ff700 1 --2- 172.21.15.72:0/3658096901 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f293805ef30 0x7f29380613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f293c0036e0 tx=0x7f293c009040).stop 2023-08-31T19:01:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.805+0000 7f29513ff700 1 -- 172.21.15.72:0/3658096901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c0c6c30 msgr2=0x7f294c0aa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.805+0000 7f29513ff700 1 --2- 172.21.15.72:0/3658096901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c0c6c30 0x7f294c0aa330 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f294c064200 tx=0x7f2940015000).stop 2023-08-31T19:01:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.805+0000 7f29513ff700 1 -- 172.21.15.72:0/3658096901 shutdown_connections 2023-08-31T19:01:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.805+0000 7f29513ff700 1 --2- 172.21.15.72:0/3658096901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f294c1581d0 0x7f294c136cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.805+0000 7f29513ff700 1 --2- 172.21.15.72:0/3658096901 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f293805ef30 0x7f29380613f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.805+0000 7f29513ff700 1 --2- 172.21.15.72:0/3658096901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f294c0c4740 0x7f294c0a9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.805+0000 7f29513ff700 1 --2- 172.21.15.72:0/3658096901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c0c6c30 0x7f294c0aa330 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:02.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.805+0000 7f29513ff700 1 -- 172.21.15.72:0/3658096901 >> 172.21.15.72:0/3658096901 conn(0x7f294c0c7e70 msgr2=0x7f294c0689d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:02.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.805+0000 7f29513ff700 1 -- 172.21.15.72:0/3658096901 shutdown_connections 2023-08-31T19:01:02.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:02.805+0000 7f29513ff700 1 -- 172.21.15.72:0/3658096901 wait complete. 2023-08-31T19:01:02.822 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T19:01:03.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.017+0000 7f85473ff700 1 Processor -- start 2023-08-31T19:01:03.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.017+0000 7f85473ff700 1 -- start start 2023-08-31T19:01:03.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.018+0000 7f85473ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8540154210 0x7f85400630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:03.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.018+0000 7f85473ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85400635a0 0x7f85400c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:03.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.018+0000 7f85473ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8540063a30 con 0x7f8540153e30 2023-08-31T19:01:03.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.018+0000 7f85473ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85401546c0 con 0x7f8540154210 2023-08-31T19:01:03.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.018+0000 7f85473ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85400bfd40 con 0x7f85400635a0 2023-08-31T19:01:03.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.019+0000 7f854499a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8540154210 0x7f85400630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:03.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.019+0000 7f854519b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8540153e30 0x7f85400c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35164/0 (socket says 172.21.15.72:35164) 2023-08-31T19:01:03.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.019+0000 7f854519b700 1 -- 172.21.15.72:0/705560341 learned_addr learned my addr 172.21.15.72:0/705560341 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:01:03.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.019+0000 7f854599c700 1 --2- 172.21.15.72:0/705560341 >> v2:172.21.15.146:3300/0 conn(0x7f85400635a0 0x7f85400c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:03.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.019+0000 7f854499a700 1 -- 172.21.15.72:0/705560341 >> v2:172.21.15.146:3300/0 conn(0x7f85400635a0 msgr2=0x7f85400c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:03.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.019+0000 7f854499a700 1 --2- 172.21.15.72:0/705560341 >> v2:172.21.15.146:3300/0 conn(0x7f85400635a0 0x7f85400c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:03.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.019+0000 7f854499a700 1 -- 172.21.15.72:0/705560341 >> v1:172.21.15.72:6789/0 conn(0x7f8540153e30 legacy=0x7f85400c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:03.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.019+0000 7f8537fff700 1 -- 172.21.15.72:0/705560341 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238865621 0 0) 0x7f8540063a30 con 0x7f8540153e30 2023-08-31T19:01:03.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.019+0000 7f854499a700 1 -- 172.21.15.72:0/705560341 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85400c6730 con 0x7f8540154210 2023-08-31T19:01:03.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.019+0000 7f854499a700 1 --2- 172.21.15.72:0/705560341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8540154210 0x7f85400630b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f8540084380 tx=0x7f8530009060).ready entity=mon.0 client_cookie=bd7bd23d22630dd5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:03.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.019+0000 7f8537fff700 1 -- 172.21.15.72:0/705560341 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853000b580 con 0x7f8540154210 2023-08-31T19:01:03.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.019+0000 7f8537fff700 1 -- 172.21.15.72:0/705560341 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853000b6e0 con 0x7f8540154210 2023-08-31T19:01:03.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.019+0000 7f8537fff700 1 -- 172.21.15.72:0/705560341 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853000ba60 con 0x7f8540154210 2023-08-31T19:01:03.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.020+0000 7f85473ff700 1 -- 172.21.15.72:0/705560341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8540154210 msgr2=0x7f85400630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:03.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.020+0000 7f85473ff700 1 --2- 172.21.15.72:0/705560341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8540154210 0x7f85400630b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f8540084380 tx=0x7f8530009060).stop 2023-08-31T19:01:03.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.020+0000 7f85473ff700 1 -- 172.21.15.72:0/705560341 shutdown_connections 2023-08-31T19:01:03.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.020+0000 7f85473ff700 1 --2- 172.21.15.72:0/705560341 >> v2:172.21.15.146:3300/0 conn(0x7f85400635a0 0x7f85400c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:03.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.020+0000 7f85473ff700 1 --2- 172.21.15.72:0/705560341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8540154210 0x7f85400630b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:03.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.020+0000 7f85473ff700 1 -- 172.21.15.72:0/705560341 >> 172.21.15.72:0/705560341 conn(0x7f854005eb20 msgr2=0x7f85400cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:03.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.020+0000 7f85473ff700 1 -- 172.21.15.72:0/705560341 shutdown_connections 2023-08-31T19:01:03.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.020+0000 7f85473ff700 1 -- 172.21.15.72:0/705560341 wait complete. 2023-08-31T19:01:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.022+0000 7f85473ff700 1 Processor -- start 2023-08-31T19:01:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.022+0000 7f85473ff700 1 -- start start 2023-08-31T19:01:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.022+0000 7f85473ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85400635a0 0x7f8540142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f85473ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8540153e30 0x7f85400a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f85473ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8540154210 0x7f8540167d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:03.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f85473ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85400c3b20 con 0x7f85400635a0 2023-08-31T19:01:03.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f85473ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85400c2f10 con 0x7f8540154210 2023-08-31T19:01:03.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f85473ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85400c31f0 con 0x7f8540153e30 2023-08-31T19:01:03.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f854519b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85400635a0 0x7f8540142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:03.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f854519b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85400635a0 0x7f8540142390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54234/0 (socket says 172.21.15.72:54234) 2023-08-31T19:01:03.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f854519b700 1 -- 172.21.15.72:0/452835591 learned_addr learned my addr 172.21.15.72:0/452835591 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:03.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f854499a700 1 --2- 172.21.15.72:0/452835591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8540153e30 0x7f85400a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:03.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f854599c700 1 --2- 172.21.15.72:0/452835591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8540154210 0x7f8540167d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:03.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f854519b700 1 -- 172.21.15.72:0/452835591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8540153e30 msgr2=0x7f85400a1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:03.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f854519b700 1 --2- 172.21.15.72:0/452835591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8540153e30 0x7f85400a1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:03.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f854519b700 1 -- 172.21.15.72:0/452835591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8540154210 msgr2=0x7f8540167d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:03.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f854519b700 1 --2- 172.21.15.72:0/452835591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8540154210 0x7f8540167d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:03.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f854519b700 1 -- 172.21.15.72:0/452835591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85300092a0 con 0x7f85400635a0 2023-08-31T19:01:03.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.023+0000 7f854519b700 1 --2- 172.21.15.72:0/452835591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85400635a0 0x7f8540142390 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f853c00c4e0 tx=0x7f853c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:03.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.024+0000 7f85357fa700 1 -- 172.21.15.72:0/452835591 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c00ce90 con 0x7f85400635a0 2023-08-31T19:01:03.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.024+0000 7f85357fa700 1 -- 172.21.15.72:0/452835591 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c0072e0 con 0x7f85400635a0 2023-08-31T19:01:03.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.024+0000 7f85473ff700 1 -- 172.21.15.72:0/452835591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85400c34d0 con 0x7f85400635a0 2023-08-31T19:01:03.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.024+0000 7f85357fa700 1 -- 172.21.15.72:0/452835591 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c007660 con 0x7f85400635a0 2023-08-31T19:01:03.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.024+0000 7f85473ff700 1 -- 172.21.15.72:0/452835591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8540142880 con 0x7f85400635a0 2023-08-31T19:01:03.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.025+0000 7f85473ff700 1 -- 172.21.15.72:0/452835591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8540142a70 con 0x7f85400635a0 2023-08-31T19:01:03.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.025+0000 7f85357fa700 1 -- 172.21.15.72:0/452835591 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f853c0059b0 con 0x7f85400635a0 2023-08-31T19:01:03.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.026+0000 7f85357fa700 1 --2- 172.21.15.72:0/452835591 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f852405ef30 0x7f85240613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:03.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.027+0000 7f85357fa700 1 -- 172.21.15.72:0/452835591 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7f853c079a30 con 0x7f85400635a0 2023-08-31T19:01:03.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.027+0000 7f854499a700 1 --2- 172.21.15.72:0/452835591 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f852405ef30 0x7f85240613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:03.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.027+0000 7f854499a700 1 --2- 172.21.15.72:0/452835591 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f852405ef30 0x7f85240613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f8530009630 tx=0x7f8530017000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:03.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.030+0000 7f85357fa700 1 -- 172.21.15.72:0/452835591 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8540142a70 con 0x7f85400635a0 2023-08-31T19:01:03.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:03.245+0000 7f85473ff700 1 -- 172.21.15.72:0/452835591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8540142a70 con 0x7f85400635a0 2023-08-31T19:01:04.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.004+0000 7f85357fa700 1 -- 172.21.15.72:0/452835591 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8540142a70 con 0x7f85400635a0 2023-08-31T19:01:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.007+0000 7f85473ff700 1 -- 172.21.15.72:0/452835591 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f852405ef30 msgr2=0x7f85240613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.007+0000 7f85473ff700 1 --2- 172.21.15.72:0/452835591 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f852405ef30 0x7f85240613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f8530009630 tx=0x7f8530017000).stop 2023-08-31T19:01:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.007+0000 7f85473ff700 1 -- 172.21.15.72:0/452835591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85400635a0 msgr2=0x7f8540142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.007+0000 7f85473ff700 1 --2- 172.21.15.72:0/452835591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85400635a0 0x7f8540142390 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f853c00c4e0 tx=0x7f853c007c70).stop 2023-08-31T19:01:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.007+0000 7f85473ff700 1 -- 172.21.15.72:0/452835591 shutdown_connections 2023-08-31T19:01:04.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.007+0000 7f85473ff700 1 --2- 172.21.15.72:0/452835591 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f852405ef30 0x7f85240613f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:04.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.007+0000 7f85473ff700 1 --2- 172.21.15.72:0/452835591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8540154210 0x7f8540167d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:04.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.007+0000 7f85473ff700 1 --2- 172.21.15.72:0/452835591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85400635a0 0x7f8540142390 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:04.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.007+0000 7f85473ff700 1 --2- 172.21.15.72:0/452835591 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8540153e30 0x7f85400a1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:04.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.007+0000 7f85473ff700 1 -- 172.21.15.72:0/452835591 >> 172.21.15.72:0/452835591 conn(0x7f854005eb20 msgr2=0x7f85400c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:04.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.007+0000 7f85473ff700 1 -- 172.21.15.72:0/452835591 shutdown_connections 2023-08-31T19:01:04.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.007+0000 7f85473ff700 1 -- 172.21.15.72:0/452835591 wait complete. 2023-08-31T19:01:04.028 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-31T19:01:04.029 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T19:01:04.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.223+0000 7fdaeefff700 1 Processor -- start 2023-08-31T19:01:04.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.223+0000 7fdaeefff700 1 -- start start 2023-08-31T19:01:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.224+0000 7fdaeefff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdae8065d50 0x7fdae8154c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.225+0000 7fdaeefff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae8158720 con 0x7fdae8154140 2023-08-31T19:01:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.225+0000 7fdaeefff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae8157e30 con 0x7fdae80658d0 2023-08-31T19:01:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.225+0000 7fdaeefff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae80c45f0 con 0x7fdae8065d50 2023-08-31T19:01:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.225+0000 7fdaed59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdae8065d50 0x7fdae8154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.225+0000 7fdaecd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdae8154140 0x7fdae80a4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35180/0 (socket says 172.21.15.72:35180) 2023-08-31T19:01:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.225+0000 7fdaecd9b700 1 -- 172.21.15.72:0/748423722 learned_addr learned my addr 172.21.15.72:0/748423722 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:01:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.225+0000 7fdaed59c700 1 -- 172.21.15.72:0/748423722 >> v1:172.21.15.146:6789/0 conn(0x7fdae80658d0 legacy=0x7fdae8154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:04.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.225+0000 7fdaed59c700 1 -- 172.21.15.72:0/748423722 >> v1:172.21.15.72:6789/0 conn(0x7fdae8154140 legacy=0x7fdae80a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:04.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.225+0000 7fdae77fe700 1 -- 172.21.15.72:0/748423722 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460939782 0 0) 0x7fdae8158720 con 0x7fdae8154140 2023-08-31T19:01:04.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.225+0000 7fdaed59c700 1 -- 172.21.15.72:0/748423722 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae81580d0 con 0x7fdae8065d50 2023-08-31T19:01:04.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.225+0000 7fdaed59c700 1 --2- 172.21.15.72:0/748423722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdae8065d50 0x7fdae8154c30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fdae81586d0 tx=0x7fdae0009780).ready entity=mon.0 client_cookie=321fc513bf08ea7f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.226+0000 7fdae77fe700 1 -- 172.21.15.72:0/748423722 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000e070 con 0x7fdae8065d50 2023-08-31T19:01:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.226+0000 7fdae77fe700 1 -- 172.21.15.72:0/748423722 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae000bc30 con 0x7fdae8065d50 2023-08-31T19:01:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.226+0000 7fdae77fe700 1 -- 172.21.15.72:0/748423722 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0012410 con 0x7fdae8065d50 2023-08-31T19:01:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.226+0000 7fdaeefff700 1 -- 172.21.15.72:0/748423722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdae8065d50 msgr2=0x7fdae8154c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.226+0000 7fdaeefff700 1 --2- 172.21.15.72:0/748423722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdae8065d50 0x7fdae8154c30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fdae81586d0 tx=0x7fdae0009780).stop 2023-08-31T19:01:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.226+0000 7fdaeefff700 1 -- 172.21.15.72:0/748423722 shutdown_connections 2023-08-31T19:01:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.226+0000 7fdaeefff700 1 --2- 172.21.15.72:0/748423722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdae8065d50 0x7fdae8154c30 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.226+0000 7fdaeefff700 1 -- 172.21.15.72:0/748423722 >> 172.21.15.72:0/748423722 conn(0x7fdae80c7910 msgr2=0x7fdae80c38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.226+0000 7fdaeefff700 1 -- 172.21.15.72:0/748423722 shutdown_connections 2023-08-31T19:01:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.226+0000 7fdaeefff700 1 -- 172.21.15.72:0/748423722 wait complete. 2023-08-31T19:01:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.228+0000 7fdaeefff700 1 Processor -- start 2023-08-31T19:01:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.229+0000 7fdaeefff700 1 -- start start 2023-08-31T19:01:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.230+0000 7fdaeefff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdae80658d0 0x7fdae80c3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.230+0000 7fdaeefff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdae8065d50 0x7fdae80bf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.230+0000 7fdaeefff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdae8154140 0x7fdae80ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.230+0000 7fdaeefff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80bebf0 con 0x7fdae8154140 2023-08-31T19:01:04.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.230+0000 7fdaeefff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80c3b30 con 0x7fdae8065d50 2023-08-31T19:01:04.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.230+0000 7fdaeefff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae8168720 con 0x7fdae80658d0 2023-08-31T19:01:04.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.230+0000 7fdaed59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdae8154140 0x7fdae80ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:04.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.230+0000 7fdaed59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdae8154140 0x7fdae80ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54258/0 (socket says 172.21.15.72:54258) 2023-08-31T19:01:04.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.230+0000 7fdaed59c700 1 -- 172.21.15.72:0/191137503 learned_addr learned my addr 172.21.15.72:0/191137503 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:04.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.230+0000 7fdaecd9b700 1 --2- 172.21.15.72:0/191137503 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdae80658d0 0x7fdae80c3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:04.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.230+0000 7fdae7fff700 1 --2- 172.21.15.72:0/191137503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdae8065d50 0x7fdae80bf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:04.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.230+0000 7fdaed59c700 1 -- 172.21.15.72:0/191137503 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdae80658d0 msgr2=0x7fdae80c3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:04.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.231+0000 7fdaed59c700 1 --2- 172.21.15.72:0/191137503 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdae80658d0 0x7fdae80c3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:04.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.231+0000 7fdaed59c700 1 -- 172.21.15.72:0/191137503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdae8065d50 msgr2=0x7fdae80bf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:04.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.231+0000 7fdaed59c700 1 --2- 172.21.15.72:0/191137503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdae8065d50 0x7fdae80bf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:04.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.231+0000 7fdaed59c700 1 -- 172.21.15.72:0/191137503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae0009a20 con 0x7fdae8154140 2023-08-31T19:01:04.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.231+0000 7fdaed59c700 1 --2- 172.21.15.72:0/191137503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdae8154140 0x7fdae80ab8f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fdae000b6c0 tx=0x7fdae8157fc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:04.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.231+0000 7fdae4ff9700 1 -- 172.21.15.72:0/191137503 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae00117d0 con 0x7fdae8154140 2023-08-31T19:01:04.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.231+0000 7fdae4ff9700 1 -- 172.21.15.72:0/191137503 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae0011930 con 0x7fdae8154140 2023-08-31T19:01:04.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.231+0000 7fdaeefff700 1 -- 172.21.15.72:0/191137503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae80bdfe0 con 0x7fdae8154140 2023-08-31T19:01:04.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.231+0000 7fdae4ff9700 1 -- 172.21.15.72:0/191137503 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0011cb0 con 0x7fdae8154140 2023-08-31T19:01:04.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.231+0000 7fdaeefff700 1 -- 172.21.15.72:0/191137503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae80be5a0 con 0x7fdae8154140 2023-08-31T19:01:04.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.232+0000 7fdaeefff700 1 -- 172.21.15.72:0/191137503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae806c6b0 con 0x7fdae8154140 2023-08-31T19:01:04.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.233+0000 7fdae4ff9700 1 -- 172.21.15.72:0/191137503 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fdae0003040 con 0x7fdae8154140 2023-08-31T19:01:04.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.234+0000 7fdae4ff9700 1 --2- 172.21.15.72:0/191137503 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdacc05ef30 0x7fdacc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:04.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.234+0000 7fdae4ff9700 1 -- 172.21.15.72:0/191137503 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7fdae007c370 con 0x7fdae8154140 2023-08-31T19:01:04.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.234+0000 7fdaecd9b700 1 --2- 172.21.15.72:0/191137503 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdacc05ef30 0x7fdacc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:04.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.235+0000 7fdaecd9b700 1 --2- 172.21.15.72:0/191137503 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdacc05ef30 0x7fdacc0613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fdadc000c00 tx=0x7fdadc009040).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:04.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.238+0000 7fdae4ff9700 1 -- 172.21.15.72:0/191137503 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdae0050d90 con 0x7fdae8154140 2023-08-31T19:01:04.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:04.449+0000 7fdaeefff700 1 -- 172.21.15.72:0/191137503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdae80bed30 con 0x7fdae8154140 2023-08-31T19:01:05.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.012+0000 7fdae4ff9700 1 -- 172.21.15.72:0/191137503 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdae0050980 con 0x7fdae8154140 2023-08-31T19:01:05.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.014+0000 7fdaeefff700 1 -- 172.21.15.72:0/191137503 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdacc05ef30 msgr2=0x7fdacc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.014+0000 7fdaeefff700 1 --2- 172.21.15.72:0/191137503 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdacc05ef30 0x7fdacc0613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fdadc000c00 tx=0x7fdadc009040).stop 2023-08-31T19:01:05.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.014+0000 7fdaeefff700 1 -- 172.21.15.72:0/191137503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdae8154140 msgr2=0x7fdae80ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.014+0000 7fdaeefff700 1 --2- 172.21.15.72:0/191137503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdae8154140 0x7fdae80ab8f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fdae000b6c0 tx=0x7fdae8157fc0).stop 2023-08-31T19:01:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.015+0000 7fdaeefff700 1 -- 172.21.15.72:0/191137503 shutdown_connections 2023-08-31T19:01:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.015+0000 7fdaeefff700 1 --2- 172.21.15.72:0/191137503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdae8154140 0x7fdae80ab8f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.015+0000 7fdaeefff700 1 --2- 172.21.15.72:0/191137503 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdae80658d0 0x7fdae80c3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.015+0000 7fdaeefff700 1 --2- 172.21.15.72:0/191137503 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdacc05ef30 0x7fdacc0613f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.015+0000 7fdaeefff700 1 --2- 172.21.15.72:0/191137503 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdae8065d50 0x7fdae80bf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.015+0000 7fdaeefff700 1 -- 172.21.15.72:0/191137503 >> 172.21.15.72:0/191137503 conn(0x7fdae80c7910 msgr2=0x7fdae80bc060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.015+0000 7fdaeefff700 1 -- 172.21.15.72:0/191137503 shutdown_connections 2023-08-31T19:01:05.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.015+0000 7fdaeefff700 1 -- 172.21.15.72:0/191137503 wait complete. 2023-08-31T19:01:05.033 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T19:01:05.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:01:05.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.223+0000 7f20565ff700 1 Processor -- start 2023-08-31T19:01:05.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.223+0000 7f20565ff700 1 -- start start 2023-08-31T19:01:05.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.224+0000 7f20565ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f205015ce50 0x7f205015f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:05.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.224+0000 7f20565ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20500c8c90 con 0x7f2050154220 2023-08-31T19:01:05.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.224+0000 7f20565ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2050158af0 con 0x7f20500cb940 2023-08-31T19:01:05.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.224+0000 7f20565ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20500aa700 con 0x7f205015ce50 2023-08-31T19:01:05.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.224+0000 7f204ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2050154220 0x7f2050157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35196/0 (socket says 172.21.15.72:35196) 2023-08-31T19:01:05.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.224+0000 7f204ffff700 1 -- 172.21.15.72:0/3572930769 learned_addr learned my addr 172.21.15.72:0/3572930769 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:01:05.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f2054b9c700 1 --2- 172.21.15.72:0/3572930769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f205015ce50 0x7f205015f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:05.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296424 0 0) 0x7f20500c8c90 con 0x7f2050154220 2023-08-31T19:01:05.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20380033f0 con 0x7f2050154220 2023-08-31T19:01:05.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572874369 0 0) 0x7f2050158af0 con 0x7f20500cb940 2023-08-31T19:01:05.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20500c8c90 con 0x7f20500cb940 2023-08-31T19:01:05.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 41143844 0 0) 0x7f20380033f0 con 0x7f2050154220 2023-08-31T19:01:05.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f205015ce50 msgr2=0x7f205015f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:05.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 --2- 172.21.15.72:0/3572930769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f205015ce50 0x7f205015f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 >> v1:172.21.15.146:6789/0 conn(0x7f20500cb940 legacy=0x7f20501583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2050155610 con 0x7f2050154220 2023-08-31T19:01:05.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f20400015f0 con 0x7f2050154220 2023-08-31T19:01:05.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f2054b9c700 1 --2- 172.21.15.72:0/3572930769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f205015ce50 0x7f205015f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:01:05.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 >> v1:172.21.15.72:6789/0 conn(0x7f2050154220 legacy=0x7f2050157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 --2- 172.21.15.72:0/3572930769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2038003aa0 0x7f2038003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:05.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 --2- 172.21.15.72:0/3572930769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f205015ce50 0x7f2038004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:05.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 --2- 172.21.15.72:0/3572930769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2038004b80 0x7f2038005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:05.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20500aa700 con 0x7f2038003aa0 2023-08-31T19:01:05.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203800b8e0 con 0x7f2038004b80 2023-08-31T19:01:05.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.225+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203800baa0 con 0x7f205015ce50 2023-08-31T19:01:05.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.226+0000 7f204ffff700 1 --2- 172.21.15.72:0/3572930769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2038003aa0 0x7f2038003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:05.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.226+0000 7f204f7fe700 1 --2- 172.21.15.72:0/3572930769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f205015ce50 0x7f2038004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:05.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.226+0000 7f2054b9c700 1 --2- 172.21.15.72:0/3572930769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2038004b80 0x7f2038005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:05.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.226+0000 7f204ffff700 1 -- 172.21.15.72:0/3572930769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f205015ce50 msgr2=0x7f2038004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:05.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.226+0000 7f204ffff700 1 --2- 172.21.15.72:0/3572930769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f205015ce50 0x7f2038004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.226+0000 7f204ffff700 1 -- 172.21.15.72:0/3572930769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2038004b80 msgr2=0x7f2038005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:05.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.226+0000 7f204ffff700 1 --2- 172.21.15.72:0/3572930769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2038004b80 0x7f2038005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.226+0000 7f204ffff700 1 -- 172.21.15.72:0/3572930769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2048009a20 con 0x7f2038003aa0 2023-08-31T19:01:05.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.226+0000 7f204f7fe700 1 --2- 172.21.15.72:0/3572930769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f205015ce50 0x7f2038004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:05.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.226+0000 7f204ffff700 1 --2- 172.21.15.72:0/3572930769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2038003aa0 0x7f2038003ea0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f204000c190 tx=0x7f2040007720).ready entity=mon.0 client_cookie=3aa227d16d407680 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:05.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.226+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204000ca60 con 0x7f2038003aa0 2023-08-31T19:01:05.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.226+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204000cbc0 con 0x7f2038003aa0 2023-08-31T19:01:05.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.226+0000 7f204effd700 1 -- 172.21.15.72:0/3572930769 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20400070d0 con 0x7f2038003aa0 2023-08-31T19:01:05.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.227+0000 7f20565ff700 1 -- 172.21.15.72:0/3572930769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2038003aa0 msgr2=0x7f2038003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.227+0000 7f20565ff700 1 --2- 172.21.15.72:0/3572930769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2038003aa0 0x7f2038003ea0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f204000c190 tx=0x7f2040007720).stop 2023-08-31T19:01:05.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.227+0000 7f2054b9c700 1 -- 172.21.15.72:0/3572930769 reap_dead start 2023-08-31T19:01:05.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.227+0000 7f20565ff700 1 -- 172.21.15.72:0/3572930769 shutdown_connections 2023-08-31T19:01:05.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.227+0000 7f20565ff700 1 -- 172.21.15.72:0/3572930769 >> 172.21.15.72:0/3572930769 conn(0x7f205005e870 msgr2=0x7f20500cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:05.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.227+0000 7f20565ff700 1 -- 172.21.15.72:0/3572930769 shutdown_connections 2023-08-31T19:01:05.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.227+0000 7f20565ff700 1 -- 172.21.15.72:0/3572930769 wait complete. 2023-08-31T19:01:05.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.228+0000 7f20565ff700 1 Processor -- start 2023-08-31T19:01:05.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.228+0000 7f20565ff700 1 -- start start 2023-08-31T19:01:05.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.229+0000 7f20565ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2038003aa0 0x7f2050165130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:05.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.229+0000 7f20565ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2050143bc0 0x7f205014f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:05.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.229+0000 7f20565ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f205014fd40 0x7f205014c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:05.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.229+0000 7f20565ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205014c2d0 con 0x7f2038003aa0 2023-08-31T19:01:05.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.229+0000 7f20565ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2050150180 con 0x7f2050143bc0 2023-08-31T19:01:05.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.229+0000 7f20565ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205014b6c0 con 0x7f205014fd40 2023-08-31T19:01:05.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f204ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2038003aa0 0x7f2050165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:05.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f204ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2038003aa0 0x7f2050165130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54276/0 (socket says 172.21.15.72:54276) 2023-08-31T19:01:05.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f204ffff700 1 -- 172.21.15.72:0/1768514998 learned_addr learned my addr 172.21.15.72:0/1768514998 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:05.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f204f7fe700 1 --2- 172.21.15.72:0/1768514998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2050143bc0 0x7f205014f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:05.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f2054b9c700 1 --2- 172.21.15.72:0/1768514998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f205014fd40 0x7f205014c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:05.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f204ffff700 1 -- 172.21.15.72:0/1768514998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f205014fd40 msgr2=0x7f205014c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f204ffff700 1 --2- 172.21.15.72:0/1768514998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f205014fd40 0x7f205014c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f204ffff700 1 -- 172.21.15.72:0/1768514998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2050143bc0 msgr2=0x7f205014f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f204ffff700 1 --2- 172.21.15.72:0/1768514998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2050143bc0 0x7f205014f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f204ffff700 1 -- 172.21.15.72:0/1768514998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205014b9a0 con 0x7f2038003aa0 2023-08-31T19:01:05.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f204f7fe700 1 --2- 172.21.15.72:0/1768514998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2050143bc0 0x7f205014f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:05.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f204ffff700 1 --2- 172.21.15.72:0/1768514998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2038003aa0 0x7f2050165130 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f2038004610 tx=0x7f2040015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:05.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f2037fff700 1 -- 172.21.15.72:0/1768514998 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040001b10 con 0x7f2038003aa0 2023-08-31T19:01:05.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f2037fff700 1 -- 172.21.15.72:0/1768514998 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2040001c70 con 0x7f2038003aa0 2023-08-31T19:01:05.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f20565ff700 1 -- 172.21.15.72:0/1768514998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205014bc80 con 0x7f2038003aa0 2023-08-31T19:01:05.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.230+0000 7f2037fff700 1 -- 172.21.15.72:0/1768514998 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2040005670 con 0x7f2038003aa0 2023-08-31T19:01:05.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.231+0000 7f20565ff700 1 -- 172.21.15.72:0/1768514998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2050165620 con 0x7f2038003aa0 2023-08-31T19:01:05.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.232+0000 7f20565ff700 1 -- 172.21.15.72:0/1768514998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20500ab780 con 0x7f2038003aa0 2023-08-31T19:01:05.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.232+0000 7f2037fff700 1 -- 172.21.15.72:0/1768514998 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f20400059e0 con 0x7f2038003aa0 2023-08-31T19:01:05.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.233+0000 7f2037fff700 1 --2- 172.21.15.72:0/1768514998 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f203c05ef30 0x7f203c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:05.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.233+0000 7f2037fff700 1 -- 172.21.15.72:0/1768514998 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7f204007b0d0 con 0x7f2038003aa0 2023-08-31T19:01:05.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.233+0000 7f204f7fe700 1 --2- 172.21.15.72:0/1768514998 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f203c05ef30 0x7f203c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:05.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.234+0000 7f204f7fe700 1 --2- 172.21.15.72:0/1768514998 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f203c05ef30 0x7f203c0613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2044000c00 tx=0x7f2044009040).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:05.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.237+0000 7f2037fff700 1 -- 172.21.15.72:0/1768514998 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f204004c180 con 0x7f2038003aa0 2023-08-31T19:01:05.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.449+0000 7f20565ff700 1 -- 172.21.15.72:0/1768514998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f205006c6b0 con 0x7f2038003aa0 2023-08-31T19:01:05.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.450+0000 7f2037fff700 1 -- 172.21.15.72:0/1768514998 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f2040025020 con 0x7f2038003aa0 2023-08-31T19:01:05.451 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:01:05.451 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1085369530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1085369530},{"type":"v1","addr":"172.21.15.146:6834","nonce":1085369530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3852978729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3852978729},{"type":"v1","addr":"172.21.15.146:6835","nonce":3852978729}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/654480318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":654480318},{"type":"v1","addr":"172.21.15.72:6835","nonce":654480318}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:01:01.982648+0000","modified":"2023-08-31T19:01:05.003693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3101703480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3101703480},{"type":"v1","addr":"172.21.15.72:6837","nonce":3101703480}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-31T19:01:05.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.452+0000 7f20565ff700 1 -- 172.21.15.72:0/1768514998 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f203c05ef30 msgr2=0x7f203c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.452+0000 7f20565ff700 1 --2- 172.21.15.72:0/1768514998 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f203c05ef30 0x7f203c0613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2044000c00 tx=0x7f2044009040).stop 2023-08-31T19:01:05.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.452+0000 7f20565ff700 1 -- 172.21.15.72:0/1768514998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2038003aa0 msgr2=0x7f2050165130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.452+0000 7f20565ff700 1 --2- 172.21.15.72:0/1768514998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2038003aa0 0x7f2050165130 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f2038004610 tx=0x7f2040015000).stop 2023-08-31T19:01:05.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.452+0000 7f20565ff700 1 -- 172.21.15.72:0/1768514998 shutdown_connections 2023-08-31T19:01:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.452+0000 7f20565ff700 1 --2- 172.21.15.72:0/1768514998 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f205014fd40 0x7f205014c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.452+0000 7f20565ff700 1 --2- 172.21.15.72:0/1768514998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2038003aa0 0x7f2050165130 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.452+0000 7f20565ff700 1 --2- 172.21.15.72:0/1768514998 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f203c05ef30 0x7f203c0613f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.452+0000 7f20565ff700 1 --2- 172.21.15.72:0/1768514998 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2050143bc0 0x7f205014f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.452+0000 7f20565ff700 1 -- 172.21.15.72:0/1768514998 >> 172.21.15.72:0/1768514998 conn(0x7f205005e870 msgr2=0x7f205014d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.452+0000 7f20565ff700 1 -- 172.21.15.72:0/1768514998 shutdown_connections 2023-08-31T19:01:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.453+0000 7f20565ff700 1 -- 172.21.15.72:0/1768514998 wait complete. 2023-08-31T19:01:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 23 2023-08-31T19:01:05.470 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:01:05.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.659+0000 7f87ef5ff700 1 Processor -- start 2023-08-31T19:01:05.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.659+0000 7f87ef5ff700 1 -- start start 2023-08-31T19:01:05.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.661+0000 7f87ef5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f87e8154100 0x7f87e80a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:05.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.661+0000 7f87ef5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e8154a00 con 0x7f87e8153d20 2023-08-31T19:01:05.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.661+0000 7f87ef5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e8154ce0 con 0x7f87e8154580 2023-08-31T19:01:05.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.661+0000 7f87ef5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e8154fc0 con 0x7f87e8154100 2023-08-31T19:01:05.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.661+0000 7f87ed39b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f87e8153d20 0x7f87e80c0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35210/0 (socket says 172.21.15.72:35210) 2023-08-31T19:01:05.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.661+0000 7f87ed39b700 1 -- 172.21.15.72:0/3022834730 learned_addr learned my addr 172.21.15.72:0/3022834730 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:01:05.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.661+0000 7f87ecb9a700 1 --2- 172.21.15.72:0/3022834730 >> v2:172.21.15.146:3300/0 conn(0x7f87e8154100 0x7f87e80a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:05.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.661+0000 7f87dffff700 1 -- 172.21.15.72:0/3022834730 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028706459 0 0) 0x7f87e8154a00 con 0x7f87e8153d20 2023-08-31T19:01:05.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.661+0000 7f87dffff700 1 -- 172.21.15.72:0/3022834730 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87d40033f0 con 0x7f87e8153d20 2023-08-31T19:01:05.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.662+0000 7f87dffff700 1 -- 172.21.15.72:0/3022834730 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 862580607 0 0) 0x7f87d40033f0 con 0x7f87e8153d20 2023-08-31T19:01:05.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.662+0000 7f87ecb9a700 1 -- 172.21.15.72:0/3022834730 >> v1:172.21.15.146:6789/0 conn(0x7f87e8154580 legacy=0x7f87e80c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.662+0000 7f87ecb9a700 1 -- 172.21.15.72:0/3022834730 >> v1:172.21.15.72:6789/0 conn(0x7f87e8153d20 legacy=0x7f87e80c0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.662+0000 7f87ecb9a700 1 -- 172.21.15.72:0/3022834730 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e81552a0 con 0x7f87e8154100 2023-08-31T19:01:05.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.662+0000 7f87ecb9a700 1 --2- 172.21.15.72:0/3022834730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e8154100 0x7f87e80a9ec0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f87d8009760 tx=0x7f87d8009060).ready entity=mon.1 client_cookie=bcafaabbef285d14 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:05.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.662+0000 7f87dffff700 1 -- 172.21.15.72:0/3022834730 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4001470 con 0x7f87e8154100 2023-08-31T19:01:05.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.662+0000 7f87dffff700 1 -- 172.21.15.72:0/3022834730 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d8009130 con 0x7f87e8154100 2023-08-31T19:01:05.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.662+0000 7f87dffff700 1 -- 172.21.15.72:0/3022834730 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8012620 con 0x7f87e8154100 2023-08-31T19:01:05.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.663+0000 7f87ef5ff700 1 -- 172.21.15.72:0/3022834730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e8154100 msgr2=0x7f87e80a9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.663+0000 7f87ef5ff700 1 --2- 172.21.15.72:0/3022834730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e8154100 0x7f87e80a9ec0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f87d8009760 tx=0x7f87d8009060).stop 2023-08-31T19:01:05.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.663+0000 7f87ef5ff700 1 -- 172.21.15.72:0/3022834730 shutdown_connections 2023-08-31T19:01:05.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.663+0000 7f87ef5ff700 1 --2- 172.21.15.72:0/3022834730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e8154100 0x7f87e80a9ec0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.663+0000 7f87ef5ff700 1 -- 172.21.15.72:0/3022834730 >> 172.21.15.72:0/3022834730 conn(0x7f87e805e090 msgr2=0x7f87e805e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:05.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.663+0000 7f87ef5ff700 1 -- 172.21.15.72:0/3022834730 shutdown_connections 2023-08-31T19:01:05.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.663+0000 7f87ef5ff700 1 -- 172.21.15.72:0/3022834730 wait complete. 2023-08-31T19:01:05.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.664+0000 7f87ef5ff700 1 Processor -- start 2023-08-31T19:01:05.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.665+0000 7f87ef5ff700 1 -- start start 2023-08-31T19:01:05.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.665+0000 7f87ef5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e8153d20 0x7f87e81657f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:05.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87ef5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87e8154100 0x7f87e8164ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:05.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87ef5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87e8154580 0x7f87e81672b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87ef5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e814d960 con 0x7f87e8154580 2023-08-31T19:01:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87ef5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e814d030 con 0x7f87e8153d20 2023-08-31T19:01:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87ef5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e814d310 con 0x7f87e8154100 2023-08-31T19:01:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87edb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87e8154580 0x7f87e81672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87edb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87e8154580 0x7f87e81672b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54284/0 (socket says 172.21.15.72:54284) 2023-08-31T19:01:05.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87edb9c700 1 -- 172.21.15.72:0/3848994499 learned_addr learned my addr 172.21.15.72:0/3848994499 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:05.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87ed39b700 1 --2- 172.21.15.72:0/3848994499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e8153d20 0x7f87e81657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:05.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87ecb9a700 1 --2- 172.21.15.72:0/3848994499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87e8154100 0x7f87e8164ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:05.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87edb9c700 1 -- 172.21.15.72:0/3848994499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87e8154100 msgr2=0x7f87e8164ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87edb9c700 1 --2- 172.21.15.72:0/3848994499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87e8154100 0x7f87e8164ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87edb9c700 1 -- 172.21.15.72:0/3848994499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e8153d20 msgr2=0x7f87e81657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87edb9c700 1 --2- 172.21.15.72:0/3848994499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e8153d20 0x7f87e81657f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87edb9c700 1 -- 172.21.15.72:0/3848994499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d80092a0 con 0x7f87e8154580 2023-08-31T19:01:05.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.666+0000 7f87edb9c700 1 --2- 172.21.15.72:0/3848994499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87e8154580 0x7f87e81672b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f87e000c810 tx=0x7f87e0001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:05.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.667+0000 7f87dd7fa700 1 -- 172.21.15.72:0/3848994499 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000e4a0 con 0x7f87e8154580 2023-08-31T19:01:05.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.667+0000 7f87dd7fa700 1 -- 172.21.15.72:0/3848994499 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e000e600 con 0x7f87e8154580 2023-08-31T19:01:05.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.667+0000 7f87ef5ff700 1 -- 172.21.15.72:0/3848994499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e814d5f0 con 0x7f87e8154580 2023-08-31T19:01:05.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.667+0000 7f87dd7fa700 1 -- 172.21.15.72:0/3848994499 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000e9a0 con 0x7f87e8154580 2023-08-31T19:01:05.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.667+0000 7f87ef5ff700 1 -- 172.21.15.72:0/3848994499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e813c560 con 0x7f87e8154580 2023-08-31T19:01:05.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.668+0000 7f87ef5ff700 1 -- 172.21.15.72:0/3848994499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e806c6b0 con 0x7f87e8154580 2023-08-31T19:01:05.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.669+0000 7f87dd7fa700 1 -- 172.21.15.72:0/3848994499 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f87e0012400 con 0x7f87e8154580 2023-08-31T19:01:05.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.670+0000 7f87dd7fa700 1 --2- 172.21.15.72:0/3848994499 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87cc05ef30 0x7f87cc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:05.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.670+0000 7f87dd7fa700 1 -- 172.21.15.72:0/3848994499 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7f87e0079880 con 0x7f87e8154580 2023-08-31T19:01:05.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.670+0000 7f87ed39b700 1 --2- 172.21.15.72:0/3848994499 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87cc05ef30 0x7f87cc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:05.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.670+0000 7f87ed39b700 1 --2- 172.21.15.72:0/3848994499 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87cc05ef30 0x7f87cc0613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f87e813f970 tx=0x7f87e4000bc0).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:05.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.673+0000 7f87dd7fa700 1 -- 172.21.15.72:0/3848994499 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f87e00488f0 con 0x7f87e8154580 2023-08-31T19:01:05.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.844+0000 7f87ef5ff700 1 -- 172.21.15.72:0/3848994499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87e80bff20 con 0x7f87e8154580 2023-08-31T19:01:05.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.845+0000 7f87dd7fa700 1 -- 172.21.15.72:0/3848994499 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+17887 (secure 0 0 0) 0x7f87e0017070 con 0x7f87e8154580 2023-08-31T19:01:05.846 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:01:05.846 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":61,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:01:02.985542+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:01:00.413643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-31T19:01:00.966624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:01:05.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.847+0000 7f87ef5ff700 1 -- 172.21.15.72:0/3848994499 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87cc05ef30 msgr2=0x7f87cc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.847+0000 7f87ef5ff700 1 --2- 172.21.15.72:0/3848994499 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87cc05ef30 0x7f87cc0613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f87e813f970 tx=0x7f87e4000bc0).stop 2023-08-31T19:01:05.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.847+0000 7f87ef5ff700 1 -- 172.21.15.72:0/3848994499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87e8154580 msgr2=0x7f87e81672b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:05.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.847+0000 7f87ef5ff700 1 --2- 172.21.15.72:0/3848994499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87e8154580 0x7f87e81672b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f87e000c810 tx=0x7f87e0001520).stop 2023-08-31T19:01:05.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.847+0000 7f87ef5ff700 1 -- 172.21.15.72:0/3848994499 shutdown_connections 2023-08-31T19:01:05.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.847+0000 7f87ef5ff700 1 --2- 172.21.15.72:0/3848994499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87e8154580 0x7f87e81672b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.847+0000 7f87ef5ff700 1 --2- 172.21.15.72:0/3848994499 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87cc05ef30 0x7f87cc0613f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.847+0000 7f87ef5ff700 1 --2- 172.21.15.72:0/3848994499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87e8153d20 0x7f87e81657f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.847+0000 7f87ef5ff700 1 --2- 172.21.15.72:0/3848994499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87e8154100 0x7f87e8164ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:05.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.847+0000 7f87ef5ff700 1 -- 172.21.15.72:0/3848994499 >> 172.21.15.72:0/3848994499 conn(0x7f87e805e090 msgr2=0x7f87e814f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:05.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.847+0000 7f87ef5ff700 1 -- 172.21.15.72:0/3848994499 shutdown_connections 2023-08-31T19:01:05.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:05.847+0000 7f87ef5ff700 1 -- 172.21.15.72:0/3848994499 wait complete. 2023-08-31T19:01:05.865 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T19:01:05.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:01:06.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.057+0000 7f3ec85ff700 1 Processor -- start 2023-08-31T19:01:06.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.057+0000 7f3ec85ff700 1 -- start start 2023-08-31T19:01:06.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.058+0000 7f3ec85ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3ec006a260 0x7f3ec0069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.058+0000 7f3ec85ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ec0065710 0x7f3ec0069a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.058+0000 7f3ec85ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec0064270 con 0x7f3ec0069170 2023-08-31T19:01:06.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.058+0000 7f3ec85ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec00bca40 con 0x7f3ec006a260 2023-08-31T19:01:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.058+0000 7f3ec85ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec00bcc20 con 0x7f3ec0065710 2023-08-31T19:01:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.059+0000 7f3ec639b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3ec0069170 0x7f3ec00c2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35222/0 (socket says 172.21.15.72:35222) 2023-08-31T19:01:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.059+0000 7f3ec639b700 1 -- 172.21.15.72:0/3794063020 learned_addr learned my addr 172.21.15.72:0/3794063020 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:01:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.059+0000 7f3ec5b9a700 1 --2- 172.21.15.72:0/3794063020 >> v2:172.21.15.146:3300/0 conn(0x7f3ec006a260 0x7f3ec0069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.059+0000 7f3ec6b9c700 1 --2- 172.21.15.72:0/3794063020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ec0065710 0x7f3ec0069a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.059+0000 7f3ec5399700 1 -- 172.21.15.72:0/3794063020 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187413728 0 0) 0x7f3ec0064270 con 0x7f3ec0069170 2023-08-31T19:01:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.059+0000 7f3ec5399700 1 -- 172.21.15.72:0/3794063020 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eac0033f0 con 0x7f3ec0069170 2023-08-31T19:01:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.059+0000 7f3ec5399700 1 -- 172.21.15.72:0/3794063020 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2267937094 0 0) 0x7f3eac0033f0 con 0x7f3ec0069170 2023-08-31T19:01:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.059+0000 7f3ec5399700 1 -- 172.21.15.72:0/3794063020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ec0065710 msgr2=0x7f3ec0069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.059+0000 7f3ec5399700 1 --2- 172.21.15.72:0/3794063020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ec0065710 0x7f3ec0069a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.059+0000 7f3ec5399700 1 -- 172.21.15.72:0/3794063020 >> v2:172.21.15.146:3300/0 conn(0x7f3ec006a260 msgr2=0x7f3ec0069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:06.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.059+0000 7f3ec5399700 1 --2- 172.21.15.72:0/3794063020 >> v2:172.21.15.146:3300/0 conn(0x7f3ec006a260 0x7f3ec0069550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.059+0000 7f3ec5399700 1 -- 172.21.15.72:0/3794063020 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0154890 con 0x7f3ec0069170 2023-08-31T19:01:06.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.059+0000 7f3ec5399700 1 -- 172.21.15.72:0/3794063020 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f3ebc001470 con 0x7f3ec0069170 2023-08-31T19:01:06.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.059+0000 7f3ec5399700 1 -- 172.21.15.72:0/3794063020 >> v1:172.21.15.72:6789/0 conn(0x7f3ec0069170 legacy=0x7f3ec00c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.059+0000 7f3ec5399700 1 --2- 172.21.15.72:0/3794063020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ec0065710 0x7f3eac0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.060+0000 7f3ec5399700 1 --2- 172.21.15.72:0/3794063020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac003e10 0x7f3eac004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.060+0000 7f3ec5399700 1 --2- 172.21.15.72:0/3794063020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eac004b80 0x7f3eac005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.060+0000 7f3ec5399700 1 -- 172.21.15.72:0/3794063020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec00bca40 con 0x7f3eac003e10 2023-08-31T19:01:06.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.060+0000 7f3ec5399700 1 -- 172.21.15.72:0/3794063020 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec00bcc20 con 0x7f3eac004b80 2023-08-31T19:01:06.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.060+0000 7f3ec5399700 1 -- 172.21.15.72:0/3794063020 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0058b0 con 0x7f3ec0065710 2023-08-31T19:01:06.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.060+0000 7f3ec5b9a700 1 --2- 172.21.15.72:0/3794063020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac003e10 0x7f3eac004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.060+0000 7f3ec639b700 1 --2- 172.21.15.72:0/3794063020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ec0065710 0x7f3eac0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.060+0000 7f3ec6b9c700 1 --2- 172.21.15.72:0/3794063020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eac004b80 0x7f3eac005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.060+0000 7f3ec5b9a700 1 -- 172.21.15.72:0/3794063020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ec0065710 msgr2=0x7f3eac0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:06.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.060+0000 7f3ec5b9a700 1 --2- 172.21.15.72:0/3794063020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ec0065710 0x7f3eac0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.060+0000 7f3ec5b9a700 1 -- 172.21.15.72:0/3794063020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eac004b80 msgr2=0x7f3eac005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.060+0000 7f3ec5b9a700 1 --2- 172.21.15.72:0/3794063020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eac004b80 0x7f3eac005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.060+0000 7f3ec5b9a700 1 -- 172.21.15.72:0/3794063020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac0033f0 con 0x7f3eac003e10 2023-08-31T19:01:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.060+0000 7f3ec5b9a700 1 --2- 172.21.15.72:0/3794063020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac003e10 0x7f3eac004690 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f3ec006a6c0 tx=0x7f3eb0009060).ready entity=mon.0 client_cookie=4f849301d38ddcbe server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.061+0000 7f3ec5399700 1 -- 172.21.15.72:0/3794063020 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0009e90 con 0x7f3eac003e10 2023-08-31T19:01:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.061+0000 7f3ec5399700 1 -- 172.21.15.72:0/3794063020 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb0009430 con 0x7f3eac003e10 2023-08-31T19:01:06.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.061+0000 7f3ec5399700 1 -- 172.21.15.72:0/3794063020 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb000e850 con 0x7f3eac003e10 2023-08-31T19:01:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.061+0000 7f3ec85ff700 1 -- 172.21.15.72:0/3794063020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac003e10 msgr2=0x7f3eac004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.061+0000 7f3ec85ff700 1 --2- 172.21.15.72:0/3794063020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac003e10 0x7f3eac004690 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f3ec006a6c0 tx=0x7f3eb0009060).stop 2023-08-31T19:01:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.061+0000 7f3ec6b9c700 1 -- 172.21.15.72:0/3794063020 reap_dead start 2023-08-31T19:01:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.061+0000 7f3ec85ff700 1 -- 172.21.15.72:0/3794063020 shutdown_connections 2023-08-31T19:01:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.061+0000 7f3ec85ff700 1 -- 172.21.15.72:0/3794063020 >> 172.21.15.72:0/3794063020 conn(0x7f3ec00c6b10 msgr2=0x7f3ec00c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.061+0000 7f3ec85ff700 1 -- 172.21.15.72:0/3794063020 shutdown_connections 2023-08-31T19:01:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.061+0000 7f3ec85ff700 1 -- 172.21.15.72:0/3794063020 wait complete. 2023-08-31T19:01:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.063+0000 7f3ec85ff700 1 Processor -- start 2023-08-31T19:01:06.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.063+0000 7f3ec85ff700 1 -- start start 2023-08-31T19:01:06.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec85ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac003e10 0x7f3ec013d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec85ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ec00c0080 0x7f3ec00c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec85ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ec0160220 0x7f3ec0160680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec85ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec00bfbf0 con 0x7f3eac003e10 2023-08-31T19:01:06.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec85ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec00befe0 con 0x7f3ec0160220 2023-08-31T19:01:06.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec85ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec00bf2c0 con 0x7f3ec00c0080 2023-08-31T19:01:06.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec639b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac003e10 0x7f3ec013d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec639b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac003e10 0x7f3ec013d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54294/0 (socket says 172.21.15.72:54294) 2023-08-31T19:01:06.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec639b700 1 -- 172.21.15.72:0/786244320 learned_addr learned my addr 172.21.15.72:0/786244320 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:06.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec5b9a700 1 --2- 172.21.15.72:0/786244320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ec00c0080 0x7f3ec00c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec6b9c700 1 --2- 172.21.15.72:0/786244320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ec0160220 0x7f3ec0160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec639b700 1 -- 172.21.15.72:0/786244320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ec00c0080 msgr2=0x7f3ec00c04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec639b700 1 --2- 172.21.15.72:0/786244320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ec00c0080 0x7f3ec00c04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec639b700 1 -- 172.21.15.72:0/786244320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ec0160220 msgr2=0x7f3ec0160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec639b700 1 --2- 172.21.15.72:0/786244320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ec0160220 0x7f3ec0160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.064+0000 7f3ec639b700 1 -- 172.21.15.72:0/786244320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec00bf5a0 con 0x7f3eac003e10 2023-08-31T19:01:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.065+0000 7f3ec639b700 1 --2- 172.21.15.72:0/786244320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac003e10 0x7f3ec013d480 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f3ebc004960 tx=0x7f3ebc001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.065+0000 7f3eb67fc700 1 -- 172.21.15.72:0/786244320 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc004ea0 con 0x7f3eac003e10 2023-08-31T19:01:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.065+0000 7f3eb67fc700 1 -- 172.21.15.72:0/786244320 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc00f850 con 0x7f3eac003e10 2023-08-31T19:01:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.065+0000 7f3ec85ff700 1 -- 172.21.15.72:0/786244320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec00bf880 con 0x7f3eac003e10 2023-08-31T19:01:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.065+0000 7f3eb67fc700 1 -- 172.21.15.72:0/786244320 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc00fbd0 con 0x7f3eac003e10 2023-08-31T19:01:06.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.065+0000 7f3ec85ff700 1 -- 172.21.15.72:0/786244320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec013d970 con 0x7f3eac003e10 2023-08-31T19:01:06.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.066+0000 7f3ec85ff700 1 -- 172.21.15.72:0/786244320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec006c6b0 con 0x7f3eac003e10 2023-08-31T19:01:06.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.067+0000 7f3eb67fc700 1 -- 172.21.15.72:0/786244320 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f3ebc01d3b0 con 0x7f3eac003e10 2023-08-31T19:01:06.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.068+0000 7f3eb67fc700 1 --2- 172.21.15.72:0/786244320 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3ea405ef30 0x7f3ea40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.068+0000 7f3eb67fc700 1 -- 172.21.15.72:0/786244320 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7f3ebc079c60 con 0x7f3eac003e10 2023-08-31T19:01:06.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.068+0000 7f3ec5b9a700 1 --2- 172.21.15.72:0/786244320 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3ea405ef30 0x7f3ea40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.069+0000 7f3ec5b9a700 1 --2- 172.21.15.72:0/786244320 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3ea405ef30 0x7f3ea40613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3eb00095a0 tx=0x7f3eb001a000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:06.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.072+0000 7f3eb67fc700 1 -- 172.21.15.72:0/786244320 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ebc04aca0 con 0x7f3eac003e10 2023-08-31T19:01:06.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.236+0000 7f3ec85ff700 1 -- 172.21.15.72:0/786244320 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ec00bfd30 con 0x7f3ea405ef30 2023-08-31T19:01:06.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.249+0000 7f3eb67fc700 1 -- 172.21.15.72:0/786244320 <== mgr.4997 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361309 (secure 0 0 0) 0x7f3eb000e640 con 0x7f3ea405ef30 2023-08-31T19:01:06.253 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:01:06.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.253+0000 7f3ec85ff700 1 -- 172.21.15.72:0/786244320 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3ea405ef30 msgr2=0x7f3ea40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.253+0000 7f3ec85ff700 1 --2- 172.21.15.72:0/786244320 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3ea405ef30 0x7f3ea40613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3eb00095a0 tx=0x7f3eb001a000).stop 2023-08-31T19:01:06.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.253+0000 7f3ec85ff700 1 -- 172.21.15.72:0/786244320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac003e10 msgr2=0x7f3ec013d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.253+0000 7f3ec85ff700 1 --2- 172.21.15.72:0/786244320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac003e10 0x7f3ec013d480 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f3ebc004960 tx=0x7f3ebc001e90).stop 2023-08-31T19:01:06.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.253+0000 7f3ec85ff700 1 -- 172.21.15.72:0/786244320 shutdown_connections 2023-08-31T19:01:06.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.253+0000 7f3ec85ff700 1 --2- 172.21.15.72:0/786244320 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3ea405ef30 0x7f3ea40613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.253+0000 7f3ec85ff700 1 --2- 172.21.15.72:0/786244320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ec0160220 0x7f3ec0160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.253+0000 7f3ec85ff700 1 --2- 172.21.15.72:0/786244320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac003e10 0x7f3ec013d480 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.253+0000 7f3ec85ff700 1 --2- 172.21.15.72:0/786244320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3ec00c0080 0x7f3ec00c04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.253+0000 7f3ec85ff700 1 -- 172.21.15.72:0/786244320 >> 172.21.15.72:0/786244320 conn(0x7f3ec00c6b10 msgr2=0x7f3ec00c56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:06.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.253+0000 7f3ec85ff700 1 -- 172.21.15.72:0/786244320 shutdown_connections 2023-08-31T19:01:06.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.253+0000 7f3ec85ff700 1 -- 172.21.15.72:0/786244320 wait complete. 2023-08-31T19:01:06.259 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:01:06.271 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-31T19:01:06.058674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2402916,"kb_used_data":5668,"kb_used_omap":0,"kb_used_meta":2397184,"kb_avail":752571804,"statfs":{"total":773094113280,"available":770633527296,"internally_reserved":0,"allocated":5804032,"data_stored":2831936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2454716416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14991405,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-723,"num_write_kb":-15546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.417795"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012083+0000","last_change":"2023-08-31T19:01:02.008126+0000","last_active":"2023-08-31T19:01:02.012083+0000","last_peered":"2023-08-31T19:01:02.012083+0000","last_clean":"2023-08-31T19:01:02.012083+0000","last_became_active":"2023-08-31T19:01:02.007860+0000","last_became_peered":"2023-08-31T19:01:02.007860+0000","last_unstale":"2023-08-31T19:01:02.012083+0000","last_undegraded":"2023-08-31T19:01:02.012083+0000","last_fullsized":"2023-08-31T19:01:02.012083+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"60'3","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.015208+0000","last_change":"2023-08-31T19:01:01.543895+0000","last_active":"2023-08-31T19:01:02.015208+0000","last_peered":"2023-08-31T19:01:02.015208+0000","last_clean":"2023-08-31T19:01:02.015208+0000","last_became_active":"2023-08-31T19:01:01.543576+0000","last_became_peered":"2023-08-31T19:01:01.543576+0000","last_unstale":"2023-08-31T19:01:02.015208+0000","last_undegraded":"2023-08-31T19:01:02.015208+0000","last_fullsized":"2023-08-31T19:01:02.015208+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.014428+0000","last_change":"2023-08-31T19:01:02.005213+0000","last_active":"2023-08-31T19:01:02.014428+0000","last_peered":"2023-08-31T19:01:02.014428+0000","last_clean":"2023-08-31T19:01:02.014428+0000","last_became_active":"2023-08-31T19:01:02.004847+0000","last_became_peered":"2023-08-31T19:01:02.004847+0000","last_unstale":"2023-08-31T19:01:02.014428+0000","last_undegraded":"2023-08-31T19:01:02.014428+0000","last_fullsized":"2023-08-31T19:01:02.014428+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.551559+0000","last_change":"2023-08-31T19:01:01.550782+0000","last_active":"2023-08-31T19:01:01.551559+0000","last_peered":"2023-08-31T19:01:01.551559+0000","last_clean":"2023-08-31T19:01:01.551559+0000","last_became_active":"2023-08-31T19:01:01.550480+0000","last_became_peered":"2023-08-31T19:01:01.550480+0000","last_unstale":"2023-08-31T19:01:01.551559+0000","last_undegraded":"2023-08-31T19:01:01.551559+0000","last_fullsized":"2023-08-31T19:01:01.551559+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016764+0000","last_change":"2023-08-31T19:01:02.016764+0000","last_active":"2023-08-31T19:01:02.016764+0000","last_peered":"2023-08-31T19:01:02.016764+0000","last_clean":"2023-08-31T19:01:02.016764+0000","last_became_active":"2023-08-31T19:01:02.016204+0000","last_became_peered":"2023-08-31T19:01:02.016204+0000","last_unstale":"2023-08-31T19:01:02.016764+0000","last_undegraded":"2023-08-31T19:01:02.016764+0000","last_fullsized":"2023-08-31T19:01:02.016764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.538093+0000","last_change":"2023-08-31T19:01:01.535412+0000","last_active":"2023-08-31T19:01:01.538093+0000","last_peered":"2023-08-31T19:01:01.538093+0000","last_clean":"2023-08-31T19:01:01.538093+0000","last_became_active":"2023-08-31T19:01:01.535104+0000","last_became_peered":"2023-08-31T19:01:01.535104+0000","last_unstale":"2023-08-31T19:01:01.538093+0000","last_undegraded":"2023-08-31T19:01:01.538093+0000","last_fullsized":"2023-08-31T19:01:01.538093+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016530+0000","last_change":"2023-08-31T19:01:02.014595+0000","last_active":"2023-08-31T19:01:02.016530+0000","last_peered":"2023-08-31T19:01:02.016530+0000","last_clean":"2023-08-31T19:01:02.016530+0000","last_became_active":"2023-08-31T19:01:02.014341+0000","last_became_peered":"2023-08-31T19:01:02.014341+0000","last_unstale":"2023-08-31T19:01:02.016530+0000","last_undegraded":"2023-08-31T19:01:02.016530+0000","last_fullsized":"2023-08-31T19:01:02.016530+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"60'2","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.021360+0000","last_change":"2023-08-31T19:01:01.542317+0000","last_active":"2023-08-31T19:01:02.021360+0000","last_peered":"2023-08-31T19:01:02.021360+0000","last_clean":"2023-08-31T19:01:02.021360+0000","last_became_active":"2023-08-31T19:01:01.542048+0000","last_became_peered":"2023-08-31T19:01:01.542048+0000","last_unstale":"2023-08-31T19:01:02.021360+0000","last_undegraded":"2023-08-31T19:01:02.021360+0000","last_fullsized":"2023-08-31T19:01:02.021360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011782+0000","last_change":"2023-08-31T19:01:02.000679+0000","last_active":"2023-08-31T19:01:02.011782+0000","last_peered":"2023-08-31T19:01:02.011782+0000","last_clean":"2023-08-31T19:01:02.011782+0000","last_became_active":"2023-08-31T19:01:02.000364+0000","last_became_peered":"2023-08-31T19:01:02.000364+0000","last_unstale":"2023-08-31T19:01:02.011782+0000","last_undegraded":"2023-08-31T19:01:02.011782+0000","last_fullsized":"2023-08-31T19:01:02.011782+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"60'1","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.992783+0000","last_change":"2023-08-31T19:01:01.548824+0000","last_active":"2023-08-31T19:01:01.992783+0000","last_peered":"2023-08-31T19:01:01.992783+0000","last_clean":"2023-08-31T19:01:01.992783+0000","last_became_active":"2023-08-31T19:01:01.548507+0000","last_became_peered":"2023-08-31T19:01:01.548507+0000","last_unstale":"2023-08-31T19:01:01.992783+0000","last_undegraded":"2023-08-31T19:01:01.992783+0000","last_fullsized":"2023-08-31T19:01:01.992783+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.021247+0000","last_change":"2023-08-31T19:01:02.019201+0000","last_active":"2023-08-31T19:01:02.021247+0000","last_peered":"2023-08-31T19:01:02.021247+0000","last_clean":"2023-08-31T19:01:02.021247+0000","last_became_active":"2023-08-31T19:01:02.018930+0000","last_became_peered":"2023-08-31T19:01:02.018930+0000","last_unstale":"2023-08-31T19:01:02.021247+0000","last_undegraded":"2023-08-31T19:01:02.021247+0000","last_fullsized":"2023-08-31T19:01:02.021247+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.010366+0000","last_change":"2023-08-31T19:01:01.551167+0000","last_active":"2023-08-31T19:01:02.010366+0000","last_peered":"2023-08-31T19:01:02.010366+0000","last_clean":"2023-08-31T19:01:02.010366+0000","last_became_active":"2023-08-31T19:01:01.550889+0000","last_became_peered":"2023-08-31T19:01:01.550889+0000","last_unstale":"2023-08-31T19:01:02.010366+0000","last_undegraded":"2023-08-31T19:01:02.010366+0000","last_fullsized":"2023-08-31T19:01:02.010366+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.017010+0000","last_change":"2023-08-31T19:01:02.014408+0000","last_active":"2023-08-31T19:01:02.017010+0000","last_peered":"2023-08-31T19:01:02.017010+0000","last_clean":"2023-08-31T19:01:02.017010+0000","last_became_active":"2023-08-31T19:01:02.014162+0000","last_became_peered":"2023-08-31T19:01:02.014162+0000","last_unstale":"2023-08-31T19:01:02.017010+0000","last_undegraded":"2023-08-31T19:01:02.017010+0000","last_fullsized":"2023-08-31T19:01:02.017010+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.998506+0000","last_change":"2023-08-31T19:01:01.548788+0000","last_active":"2023-08-31T19:01:01.998506+0000","last_peered":"2023-08-31T19:01:01.998506+0000","last_clean":"2023-08-31T19:01:01.998506+0000","last_became_active":"2023-08-31T19:01:01.548482+0000","last_became_peered":"2023-08-31T19:01:01.548482+0000","last_unstale":"2023-08-31T19:01:01.998506+0000","last_undegraded":"2023-08-31T19:01:01.998506+0000","last_fullsized":"2023-08-31T19:01:01.998506+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.023003+0000","last_change":"2023-08-31T19:01:02.018395+0000","last_active":"2023-08-31T19:01:02.023003+0000","last_peered":"2023-08-31T19:01:02.023003+0000","last_clean":"2023-08-31T19:01:02.023003+0000","last_became_active":"2023-08-31T19:01:02.018125+0000","last_became_peered":"2023-08-31T19:01:02.018125+0000","last_unstale":"2023-08-31T19:01:02.023003+0000","last_undegraded":"2023-08-31T19:01:02.023003+0000","last_fullsized":"2023-08-31T19:01:02.023003+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.555397+0000","last_change":"2023-08-31T19:01:01.551567+0000","last_active":"2023-08-31T19:01:01.555397+0000","last_peered":"2023-08-31T19:01:01.555397+0000","last_clean":"2023-08-31T19:01:01.555397+0000","last_became_active":"2023-08-31T19:01:01.549719+0000","last_became_peered":"2023-08-31T19:01:01.549719+0000","last_unstale":"2023-08-31T19:01:01.555397+0000","last_undegraded":"2023-08-31T19:01:01.555397+0000","last_fullsized":"2023-08-31T19:01:01.555397+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018633+0000","last_change":"2023-08-31T19:01:02.010351+0000","last_active":"2023-08-31T19:01:02.018633+0000","last_peered":"2023-08-31T19:01:02.018633+0000","last_clean":"2023-08-31T19:01:02.018633+0000","last_became_active":"2023-08-31T19:01:02.010003+0000","last_became_peered":"2023-08-31T19:01:02.010003+0000","last_unstale":"2023-08-31T19:01:02.018633+0000","last_undegraded":"2023-08-31T19:01:02.018633+0000","last_fullsized":"2023-08-31T19:01:02.018633+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.547802+0000","last_change":"2023-08-31T19:01:01.534995+0000","last_active":"2023-08-31T19:01:01.547802+0000","last_peered":"2023-08-31T19:01:01.547802+0000","last_clean":"2023-08-31T19:01:01.547802+0000","last_became_active":"2023-08-31T19:01:01.534730+0000","last_became_peered":"2023-08-31T19:01:01.534730+0000","last_unstale":"2023-08-31T19:01:01.547802+0000","last_undegraded":"2023-08-31T19:01:01.547802+0000","last_fullsized":"2023-08-31T19:01:01.547802+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.005708+0000","last_change":"2023-08-31T19:01:02.005708+0000","last_active":"2023-08-31T19:01:02.005708+0000","last_peered":"2023-08-31T19:01:02.005708+0000","last_clean":"2023-08-31T19:01:02.005708+0000","last_became_active":"2023-08-31T19:01:02.005293+0000","last_became_peered":"2023-08-31T19:01:02.005293+0000","last_unstale":"2023-08-31T19:01:02.005708+0000","last_undegraded":"2023-08-31T19:01:02.005708+0000","last_fullsized":"2023-08-31T19:01:02.005708+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.549339+0000","last_change":"2023-08-31T19:01:01.542603+0000","last_active":"2023-08-31T19:01:01.549339+0000","last_peered":"2023-08-31T19:01:01.549339+0000","last_clean":"2023-08-31T19:01:01.549339+0000","last_became_active":"2023-08-31T19:01:01.542295+0000","last_became_peered":"2023-08-31T19:01:01.542295+0000","last_unstale":"2023-08-31T19:01:01.549339+0000","last_undegraded":"2023-08-31T19:01:01.549339+0000","last_fullsized":"2023-08-31T19:01:01.549339+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.022487+0000","last_change":"2023-08-31T19:01:02.015997+0000","last_active":"2023-08-31T19:01:02.022487+0000","last_peered":"2023-08-31T19:01:02.022487+0000","last_clean":"2023-08-31T19:01:02.022487+0000","last_became_active":"2023-08-31T19:01:02.015697+0000","last_became_peered":"2023-08-31T19:01:02.015697+0000","last_unstale":"2023-08-31T19:01:02.022487+0000","last_undegraded":"2023-08-31T19:01:02.022487+0000","last_fullsized":"2023-08-31T19:01:02.022487+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.548982+0000","last_change":"2023-08-31T19:01:01.546013+0000","last_active":"2023-08-31T19:01:01.548982+0000","last_peered":"2023-08-31T19:01:01.548982+0000","last_clean":"2023-08-31T19:01:01.548982+0000","last_became_active":"2023-08-31T19:01:01.542791+0000","last_became_peered":"2023-08-31T19:01:01.542791+0000","last_unstale":"2023-08-31T19:01:01.548982+0000","last_undegraded":"2023-08-31T19:01:01.548982+0000","last_fullsized":"2023-08-31T19:01:01.548982+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.008018+0000","last_change":"2023-08-31T19:01:02.008018+0000","last_active":"2023-08-31T19:01:02.008018+0000","last_peered":"2023-08-31T19:01:02.008018+0000","last_clean":"2023-08-31T19:01:02.008018+0000","last_became_active":"2023-08-31T19:01:02.007640+0000","last_became_peered":"2023-08-31T19:01:02.007640+0000","last_unstale":"2023-08-31T19:01:02.008018+0000","last_undegraded":"2023-08-31T19:01:02.008018+0000","last_fullsized":"2023-08-31T19:01:02.008018+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"60'4","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.009527+0000","last_change":"2023-08-31T19:01:01.546579+0000","last_active":"2023-08-31T19:01:02.009527+0000","last_peered":"2023-08-31T19:01:02.009527+0000","last_clean":"2023-08-31T19:01:02.009527+0000","last_became_active":"2023-08-31T19:01:01.546283+0000","last_became_peered":"2023-08-31T19:01:01.546283+0000","last_unstale":"2023-08-31T19:01:02.009527+0000","last_undegraded":"2023-08-31T19:01:02.009527+0000","last_fullsized":"2023-08-31T19:01:02.009527+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018076+0000","last_change":"2023-08-31T19:01:02.014924+0000","last_active":"2023-08-31T19:01:02.018076+0000","last_peered":"2023-08-31T19:01:02.018076+0000","last_clean":"2023-08-31T19:01:02.018076+0000","last_became_active":"2023-08-31T19:01:02.014559+0000","last_became_peered":"2023-08-31T19:01:02.014559+0000","last_unstale":"2023-08-31T19:01:02.018076+0000","last_undegraded":"2023-08-31T19:01:02.018076+0000","last_fullsized":"2023-08-31T19:01:02.018076+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016249+0000","last_change":"2023-08-31T19:01:01.555453+0000","last_active":"2023-08-31T19:01:02.016249+0000","last_peered":"2023-08-31T19:01:02.016249+0000","last_clean":"2023-08-31T19:01:02.016249+0000","last_became_active":"2023-08-31T19:01:01.554959+0000","last_became_peered":"2023-08-31T19:01:01.554959+0000","last_unstale":"2023-08-31T19:01:02.016249+0000","last_undegraded":"2023-08-31T19:01:02.016249+0000","last_fullsized":"2023-08-31T19:01:02.016249+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.014448+0000","last_change":"2023-08-31T19:01:02.014448+0000","last_active":"2023-08-31T19:01:02.014448+0000","last_peered":"2023-08-31T19:01:02.014448+0000","last_clean":"2023-08-31T19:01:02.014448+0000","last_became_active":"2023-08-31T19:01:02.014196+0000","last_became_peered":"2023-08-31T19:01:02.014196+0000","last_unstale":"2023-08-31T19:01:02.014448+0000","last_undegraded":"2023-08-31T19:01:02.014448+0000","last_fullsized":"2023-08-31T19:01:02.014448+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.545061+0000","last_change":"2023-08-31T19:01:01.534659+0000","last_active":"2023-08-31T19:01:01.545061+0000","last_peered":"2023-08-31T19:01:01.545061+0000","last_clean":"2023-08-31T19:01:01.545061+0000","last_became_active":"2023-08-31T19:01:01.534378+0000","last_became_peered":"2023-08-31T19:01:01.534378+0000","last_unstale":"2023-08-31T19:01:01.545061+0000","last_undegraded":"2023-08-31T19:01:01.545061+0000","last_fullsized":"2023-08-31T19:01:01.545061+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018049+0000","last_change":"2023-08-31T19:01:02.014668+0000","last_active":"2023-08-31T19:01:02.018049+0000","last_peered":"2023-08-31T19:01:02.018049+0000","last_clean":"2023-08-31T19:01:02.018049+0000","last_became_active":"2023-08-31T19:01:02.014316+0000","last_became_peered":"2023-08-31T19:01:02.014316+0000","last_unstale":"2023-08-31T19:01:02.018049+0000","last_undegraded":"2023-08-31T19:01:02.018049+0000","last_fullsized":"2023-08-31T19:01:02.018049+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.989773+0000","last_change":"2023-08-31T19:01:01.551057+0000","last_active":"2023-08-31T19:01:01.989773+0000","last_peered":"2023-08-31T19:01:01.989773+0000","last_clean":"2023-08-31T19:01:01.989773+0000","last_became_active":"2023-08-31T19:01:01.550461+0000","last_became_peered":"2023-08-31T19:01:01.550461+0000","last_unstale":"2023-08-31T19:01:01.989773+0000","last_undegraded":"2023-08-31T19:01:01.989773+0000","last_fullsized":"2023-08-31T19:01:01.989773+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.013705+0000","last_change":"2023-08-31T19:01:02.011341+0000","last_active":"2023-08-31T19:01:02.013705+0000","last_peered":"2023-08-31T19:01:02.013705+0000","last_clean":"2023-08-31T19:01:02.013705+0000","last_became_active":"2023-08-31T19:01:02.011024+0000","last_became_peered":"2023-08-31T19:01:02.011024+0000","last_unstale":"2023-08-31T19:01:02.013705+0000","last_undegraded":"2023-08-31T19:01:02.013705+0000","last_fullsized":"2023-08-31T19:01:02.013705+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.023228+0000","last_change":"2023-08-31T19:01:01.543430+0000","last_active":"2023-08-31T19:01:02.023228+0000","last_peered":"2023-08-31T19:01:02.023228+0000","last_clean":"2023-08-31T19:01:02.023228+0000","last_became_active":"2023-08-31T19:01:01.542999+0000","last_became_peered":"2023-08-31T19:01:01.542999+0000","last_unstale":"2023-08-31T19:01:02.023228+0000","last_undegraded":"2023-08-31T19:01:02.023228+0000","last_fullsized":"2023-08-31T19:01:02.023228+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012380+0000","last_change":"2023-08-31T19:01:02.012380+0000","last_active":"2023-08-31T19:01:02.012380+0000","last_peered":"2023-08-31T19:01:02.012380+0000","last_clean":"2023-08-31T19:01:02.012380+0000","last_became_active":"2023-08-31T19:01:02.012053+0000","last_became_peered":"2023-08-31T19:01:02.012053+0000","last_unstale":"2023-08-31T19:01:02.012380+0000","last_undegraded":"2023-08-31T19:01:02.012380+0000","last_fullsized":"2023-08-31T19:01:02.012380+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.544176+0000","last_change":"2023-08-31T19:01:01.539417+0000","last_active":"2023-08-31T19:01:01.544176+0000","last_peered":"2023-08-31T19:01:01.544176+0000","last_clean":"2023-08-31T19:01:01.544176+0000","last_became_active":"2023-08-31T19:01:01.539153+0000","last_became_peered":"2023-08-31T19:01:01.539153+0000","last_unstale":"2023-08-31T19:01:01.544176+0000","last_undegraded":"2023-08-31T19:01:01.544176+0000","last_fullsized":"2023-08-31T19:01:01.544176+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.005543+0000","last_change":"2023-08-31T19:01:02.005543+0000","last_active":"2023-08-31T19:01:02.005543+0000","last_peered":"2023-08-31T19:01:02.005543+0000","last_clean":"2023-08-31T19:01:02.005543+0000","last_became_active":"2023-08-31T19:01:02.004943+0000","last_became_peered":"2023-08-31T19:01:02.004943+0000","last_unstale":"2023-08-31T19:01:02.005543+0000","last_undegraded":"2023-08-31T19:01:02.005543+0000","last_fullsized":"2023-08-31T19:01:02.005543+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.545000+0000","last_change":"2023-08-31T19:01:01.540866+0000","last_active":"2023-08-31T19:01:01.545000+0000","last_peered":"2023-08-31T19:01:01.545000+0000","last_clean":"2023-08-31T19:01:01.545000+0000","last_became_active":"2023-08-31T19:01:01.540598+0000","last_became_peered":"2023-08-31T19:01:01.540598+0000","last_unstale":"2023-08-31T19:01:01.545000+0000","last_undegraded":"2023-08-31T19:01:01.545000+0000","last_fullsized":"2023-08-31T19:01:01.545000+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016261+0000","last_change":"2023-08-31T19:01:02.012849+0000","last_active":"2023-08-31T19:01:02.016261+0000","last_peered":"2023-08-31T19:01:02.016261+0000","last_clean":"2023-08-31T19:01:02.016261+0000","last_became_active":"2023-08-31T19:01:02.012527+0000","last_became_peered":"2023-08-31T19:01:02.012527+0000","last_unstale":"2023-08-31T19:01:02.016261+0000","last_undegraded":"2023-08-31T19:01:02.016261+0000","last_fullsized":"2023-08-31T19:01:02.016261+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.022848+0000","last_change":"2023-08-31T19:01:01.548878+0000","last_active":"2023-08-31T19:01:02.022848+0000","last_peered":"2023-08-31T19:01:02.022848+0000","last_clean":"2023-08-31T19:01:02.022848+0000","last_became_active":"2023-08-31T19:01:01.548558+0000","last_became_peered":"2023-08-31T19:01:01.548558+0000","last_unstale":"2023-08-31T19:01:02.022848+0000","last_undegraded":"2023-08-31T19:01:02.022848+0000","last_fullsized":"2023-08-31T19:01:02.022848+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.001302+0000","last_change":"2023-08-31T19:01:02.001302+0000","last_active":"2023-08-31T19:01:02.001302+0000","last_peered":"2023-08-31T19:01:02.001302+0000","last_clean":"2023-08-31T19:01:02.001302+0000","last_became_active":"2023-08-31T19:01:02.001004+0000","last_became_peered":"2023-08-31T19:01:02.001004+0000","last_unstale":"2023-08-31T19:01:02.001302+0000","last_undegraded":"2023-08-31T19:01:02.001302+0000","last_fullsized":"2023-08-31T19:01:02.001302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.006227+0000","last_change":"2023-08-31T19:01:01.538223+0000","last_active":"2023-08-31T19:01:02.006227+0000","last_peered":"2023-08-31T19:01:02.006227+0000","last_clean":"2023-08-31T19:01:02.006227+0000","last_became_active":"2023-08-31T19:01:01.537936+0000","last_became_peered":"2023-08-31T19:01:01.537936+0000","last_unstale":"2023-08-31T19:01:02.006227+0000","last_undegraded":"2023-08-31T19:01:02.006227+0000","last_fullsized":"2023-08-31T19:01:02.006227+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011434+0000","last_change":"2023-08-31T19:01:02.003513+0000","last_active":"2023-08-31T19:01:02.011434+0000","last_peered":"2023-08-31T19:01:02.011434+0000","last_clean":"2023-08-31T19:01:02.011434+0000","last_became_active":"2023-08-31T19:01:02.003213+0000","last_became_peered":"2023-08-31T19:01:02.003213+0000","last_unstale":"2023-08-31T19:01:02.011434+0000","last_undegraded":"2023-08-31T19:01:02.011434+0000","last_fullsized":"2023-08-31T19:01:02.011434+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.017748+0000","last_change":"2023-08-31T19:01:01.553038+0000","last_active":"2023-08-31T19:01:02.017748+0000","last_peered":"2023-08-31T19:01:02.017748+0000","last_clean":"2023-08-31T19:01:02.017748+0000","last_became_active":"2023-08-31T19:01:01.552773+0000","last_became_peered":"2023-08-31T19:01:01.552773+0000","last_unstale":"2023-08-31T19:01:02.017748+0000","last_undegraded":"2023-08-31T19:01:02.017748+0000","last_fullsized":"2023-08-31T19:01:02.017748+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.024693+0000","last_change":"2023-08-31T19:01:02.021051+0000","last_active":"2023-08-31T19:01:02.024693+0000","last_peered":"2023-08-31T19:01:02.024693+0000","last_clean":"2023-08-31T19:01:02.024693+0000","last_became_active":"2023-08-31T19:01:02.020810+0000","last_became_peered":"2023-08-31T19:01:02.020810+0000","last_unstale":"2023-08-31T19:01:02.024693+0000","last_undegraded":"2023-08-31T19:01:02.024693+0000","last_fullsized":"2023-08-31T19:01:02.024693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.549278+0000","last_change":"2023-08-31T19:01:01.545193+0000","last_active":"2023-08-31T19:01:01.549278+0000","last_peered":"2023-08-31T19:01:01.549278+0000","last_clean":"2023-08-31T19:01:01.549278+0000","last_became_active":"2023-08-31T19:01:01.542977+0000","last_became_peered":"2023-08-31T19:01:01.542977+0000","last_unstale":"2023-08-31T19:01:01.549278+0000","last_undegraded":"2023-08-31T19:01:01.549278+0000","last_fullsized":"2023-08-31T19:01:01.549278+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012015+0000","last_change":"2023-08-31T19:01:02.005777+0000","last_active":"2023-08-31T19:01:02.012015+0000","last_peered":"2023-08-31T19:01:02.012015+0000","last_clean":"2023-08-31T19:01:02.012015+0000","last_became_active":"2023-08-31T19:01:02.004459+0000","last_became_peered":"2023-08-31T19:01:02.004459+0000","last_unstale":"2023-08-31T19:01:02.012015+0000","last_undegraded":"2023-08-31T19:01:02.012015+0000","last_fullsized":"2023-08-31T19:01:02.012015+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.991741+0000","last_change":"2023-08-31T19:01:01.545166+0000","last_active":"2023-08-31T19:01:01.991741+0000","last_peered":"2023-08-31T19:01:01.991741+0000","last_clean":"2023-08-31T19:01:01.991741+0000","last_became_active":"2023-08-31T19:01:01.544642+0000","last_became_peered":"2023-08-31T19:01:01.544642+0000","last_unstale":"2023-08-31T19:01:01.991741+0000","last_undegraded":"2023-08-31T19:01:01.991741+0000","last_fullsized":"2023-08-31T19:01:01.991741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.009385+0000","last_change":"2023-08-31T19:01:02.009385+0000","last_active":"2023-08-31T19:01:02.009385+0000","last_peered":"2023-08-31T19:01:02.009385+0000","last_clean":"2023-08-31T19:01:02.009385+0000","last_became_active":"2023-08-31T19:01:02.008894+0000","last_became_peered":"2023-08-31T19:01:02.008894+0000","last_unstale":"2023-08-31T19:01:02.009385+0000","last_undegraded":"2023-08-31T19:01:02.009385+0000","last_fullsized":"2023-08-31T19:01:02.009385+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.991416+0000","last_change":"2023-08-31T19:01:01.543646+0000","last_active":"2023-08-31T19:01:01.991416+0000","last_peered":"2023-08-31T19:01:01.991416+0000","last_clean":"2023-08-31T19:01:01.991416+0000","last_became_active":"2023-08-31T19:01:01.543335+0000","last_became_peered":"2023-08-31T19:01:01.543335+0000","last_unstale":"2023-08-31T19:01:01.991416+0000","last_undegraded":"2023-08-31T19:01:01.991416+0000","last_fullsized":"2023-08-31T19:01:01.991416+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.006657+0000","last_change":"2023-08-31T19:01:02.006657+0000","last_active":"2023-08-31T19:01:02.006657+0000","last_peered":"2023-08-31T19:01:02.006657+0000","last_clean":"2023-08-31T19:01:02.006657+0000","last_became_active":"2023-08-31T19:01:02.006392+0000","last_became_peered":"2023-08-31T19:01:02.006392+0000","last_unstale":"2023-08-31T19:01:02.006657+0000","last_undegraded":"2023-08-31T19:01:02.006657+0000","last_fullsized":"2023-08-31T19:01:02.006657+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.991444+0000","last_change":"2023-08-31T19:01:01.541614+0000","last_active":"2023-08-31T19:01:01.991444+0000","last_peered":"2023-08-31T19:01:01.991444+0000","last_clean":"2023-08-31T19:01:01.991444+0000","last_became_active":"2023-08-31T19:01:01.541338+0000","last_became_peered":"2023-08-31T19:01:01.541338+0000","last_unstale":"2023-08-31T19:01:01.991444+0000","last_undegraded":"2023-08-31T19:01:01.991444+0000","last_fullsized":"2023-08-31T19:01:01.991444+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.009879+0000","last_change":"2023-08-31T19:01:02.005291+0000","last_active":"2023-08-31T19:01:02.009879+0000","last_peered":"2023-08-31T19:01:02.009879+0000","last_clean":"2023-08-31T19:01:02.009879+0000","last_became_active":"2023-08-31T19:01:02.005035+0000","last_became_peered":"2023-08-31T19:01:02.005035+0000","last_unstale":"2023-08-31T19:01:02.009879+0000","last_undegraded":"2023-08-31T19:01:02.009879+0000","last_fullsized":"2023-08-31T19:01:02.009879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.006041+0000","last_change":"2023-08-31T19:01:01.548299+0000","last_active":"2023-08-31T19:01:02.006041+0000","last_peered":"2023-08-31T19:01:02.006041+0000","last_clean":"2023-08-31T19:01:02.006041+0000","last_became_active":"2023-08-31T19:01:01.547969+0000","last_became_peered":"2023-08-31T19:01:01.547969+0000","last_unstale":"2023-08-31T19:01:02.006041+0000","last_undegraded":"2023-08-31T19:01:02.006041+0000","last_fullsized":"2023-08-31T19:01:02.006041+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.022940+0000","last_change":"2023-08-31T19:01:02.018577+0000","last_active":"2023-08-31T19:01:02.022940+0000","last_peered":"2023-08-31T19:01:02.022940+0000","last_clean":"2023-08-31T19:01:02.022940+0000","last_became_active":"2023-08-31T19:01:02.018242+0000","last_became_peered":"2023-08-31T19:01:02.018242+0000","last_unstale":"2023-08-31T19:01:02.022940+0000","last_undegraded":"2023-08-31T19:01:02.022940+0000","last_fullsized":"2023-08-31T19:01:02.022940+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.541850+0000","last_change":"2023-08-31T19:01:01.538839+0000","last_active":"2023-08-31T19:01:01.541850+0000","last_peered":"2023-08-31T19:01:01.541850+0000","last_clean":"2023-08-31T19:01:01.541850+0000","last_became_active":"2023-08-31T19:01:01.538580+0000","last_became_peered":"2023-08-31T19:01:01.538580+0000","last_unstale":"2023-08-31T19:01:01.541850+0000","last_undegraded":"2023-08-31T19:01:01.541850+0000","last_fullsized":"2023-08-31T19:01:01.541850+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016959+0000","last_change":"2023-08-31T19:01:02.007483+0000","last_active":"2023-08-31T19:01:02.016959+0000","last_peered":"2023-08-31T19:01:02.016959+0000","last_clean":"2023-08-31T19:01:02.016959+0000","last_became_active":"2023-08-31T19:01:02.006868+0000","last_became_peered":"2023-08-31T19:01:02.006868+0000","last_unstale":"2023-08-31T19:01:02.016959+0000","last_undegraded":"2023-08-31T19:01:02.016959+0000","last_fullsized":"2023-08-31T19:01:02.016959+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.548215+0000","last_change":"2023-08-31T19:01:01.546417+0000","last_active":"2023-08-31T19:01:01.548215+0000","last_peered":"2023-08-31T19:01:01.548215+0000","last_clean":"2023-08-31T19:01:01.548215+0000","last_became_active":"2023-08-31T19:01:01.546135+0000","last_became_peered":"2023-08-31T19:01:01.546135+0000","last_unstale":"2023-08-31T19:01:01.548215+0000","last_undegraded":"2023-08-31T19:01:01.548215+0000","last_fullsized":"2023-08-31T19:01:01.548215+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.004174+0000","last_change":"2023-08-31T19:01:02.001494+0000","last_active":"2023-08-31T19:01:02.004174+0000","last_peered":"2023-08-31T19:01:02.004174+0000","last_clean":"2023-08-31T19:01:02.004174+0000","last_became_active":"2023-08-31T19:01:02.001180+0000","last_became_peered":"2023-08-31T19:01:02.001180+0000","last_unstale":"2023-08-31T19:01:02.004174+0000","last_undegraded":"2023-08-31T19:01:02.004174+0000","last_fullsized":"2023-08-31T19:01:02.004174+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.992361+0000","last_change":"2023-08-31T19:01:01.543191+0000","last_active":"2023-08-31T19:01:01.992361+0000","last_peered":"2023-08-31T19:01:01.992361+0000","last_clean":"2023-08-31T19:01:01.992361+0000","last_became_active":"2023-08-31T19:01:01.542918+0000","last_became_peered":"2023-08-31T19:01:01.542918+0000","last_unstale":"2023-08-31T19:01:01.992361+0000","last_undegraded":"2023-08-31T19:01:01.992361+0000","last_fullsized":"2023-08-31T19:01:01.992361+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011944+0000","last_change":"2023-08-31T19:01:02.011944+0000","last_active":"2023-08-31T19:01:02.011944+0000","last_peered":"2023-08-31T19:01:02.011944+0000","last_clean":"2023-08-31T19:01:02.011944+0000","last_became_active":"2023-08-31T19:01:02.011294+0000","last_became_peered":"2023-08-31T19:01:02.011294+0000","last_unstale":"2023-08-31T19:01:02.011944+0000","last_undegraded":"2023-08-31T19:01:02.011944+0000","last_fullsized":"2023-08-31T19:01:02.011944+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.547003+0000","last_change":"2023-08-31T19:01:01.544765+0000","last_active":"2023-08-31T19:01:01.547003+0000","last_peered":"2023-08-31T19:01:01.547003+0000","last_clean":"2023-08-31T19:01:01.547003+0000","last_became_active":"2023-08-31T19:01:01.544438+0000","last_became_peered":"2023-08-31T19:01:01.544438+0000","last_unstale":"2023-08-31T19:01:01.547003+0000","last_undegraded":"2023-08-31T19:01:01.547003+0000","last_fullsized":"2023-08-31T19:01:01.547003+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018067+0000","last_change":"2023-08-31T19:01:02.014706+0000","last_active":"2023-08-31T19:01:02.018067+0000","last_peered":"2023-08-31T19:01:02.018067+0000","last_clean":"2023-08-31T19:01:02.018067+0000","last_became_active":"2023-08-31T19:01:02.014354+0000","last_became_peered":"2023-08-31T19:01:02.014354+0000","last_unstale":"2023-08-31T19:01:02.018067+0000","last_undegraded":"2023-08-31T19:01:02.018067+0000","last_fullsized":"2023-08-31T19:01:02.018067+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.989674+0000","last_change":"2023-08-31T19:01:01.551230+0000","last_active":"2023-08-31T19:01:01.989674+0000","last_peered":"2023-08-31T19:01:01.989674+0000","last_clean":"2023-08-31T19:01:01.989674+0000","last_became_active":"2023-08-31T19:01:01.550749+0000","last_became_peered":"2023-08-31T19:01:01.550749+0000","last_unstale":"2023-08-31T19:01:01.989674+0000","last_undegraded":"2023-08-31T19:01:01.989674+0000","last_fullsized":"2023-08-31T19:01:01.989674+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.009171+0000","last_change":"2023-08-31T19:01:02.009171+0000","last_active":"2023-08-31T19:01:02.009171+0000","last_peered":"2023-08-31T19:01:02.009171+0000","last_clean":"2023-08-31T19:01:02.009171+0000","last_became_active":"2023-08-31T19:01:02.008591+0000","last_became_peered":"2023-08-31T19:01:02.008591+0000","last_unstale":"2023-08-31T19:01:02.009171+0000","last_undegraded":"2023-08-31T19:01:02.009171+0000","last_fullsized":"2023-08-31T19:01:02.009171+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.005587+0000","last_change":"2023-08-31T19:01:01.538096+0000","last_active":"2023-08-31T19:01:02.005587+0000","last_peered":"2023-08-31T19:01:02.005587+0000","last_clean":"2023-08-31T19:01:02.005587+0000","last_became_active":"2023-08-31T19:01:01.537817+0000","last_became_peered":"2023-08-31T19:01:01.537817+0000","last_unstale":"2023-08-31T19:01:02.005587+0000","last_undegraded":"2023-08-31T19:01:02.005587+0000","last_fullsized":"2023-08-31T19:01:02.005587+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018042+0000","last_change":"2023-08-31T19:01:02.014363+0000","last_active":"2023-08-31T19:01:02.018042+0000","last_peered":"2023-08-31T19:01:02.018042+0000","last_clean":"2023-08-31T19:01:02.018042+0000","last_became_active":"2023-08-31T19:01:02.014062+0000","last_became_peered":"2023-08-31T19:01:02.014062+0000","last_unstale":"2023-08-31T19:01:02.018042+0000","last_undegraded":"2023-08-31T19:01:02.018042+0000","last_fullsized":"2023-08-31T19:01:02.018042+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.017023+0000","last_change":"2023-08-31T19:01:01.536662+0000","last_active":"2023-08-31T19:01:02.017023+0000","last_peered":"2023-08-31T19:01:02.017023+0000","last_clean":"2023-08-31T19:01:02.017023+0000","last_became_active":"2023-08-31T19:01:01.536373+0000","last_became_peered":"2023-08-31T19:01:01.536373+0000","last_unstale":"2023-08-31T19:01:02.017023+0000","last_undegraded":"2023-08-31T19:01:02.017023+0000","last_fullsized":"2023-08-31T19:01:02.017023+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.005725+0000","last_change":"2023-08-31T19:01:02.005725+0000","last_active":"2023-08-31T19:01:02.005725+0000","last_peered":"2023-08-31T19:01:02.005725+0000","last_clean":"2023-08-31T19:01:02.005725+0000","last_became_active":"2023-08-31T19:01:02.005389+0000","last_became_peered":"2023-08-31T19:01:02.005389+0000","last_unstale":"2023-08-31T19:01:02.005725+0000","last_undegraded":"2023-08-31T19:01:02.005725+0000","last_fullsized":"2023-08-31T19:01:02.005725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.014625+0000","last_change":"2023-08-31T19:01:01.552789+0000","last_active":"2023-08-31T19:01:02.014625+0000","last_peered":"2023-08-31T19:01:02.014625+0000","last_clean":"2023-08-31T19:01:02.014625+0000","last_became_active":"2023-08-31T19:01:01.552446+0000","last_became_peered":"2023-08-31T19:01:01.552446+0000","last_unstale":"2023-08-31T19:01:02.014625+0000","last_undegraded":"2023-08-31T19:01:02.014625+0000","last_fullsized":"2023-08-31T19:01:02.014625+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.013764+0000","last_change":"2023-08-31T19:01:02.005574+0000","last_active":"2023-08-31T19:01:02.013764+0000","last_peered":"2023-08-31T19:01:02.013764+0000","last_clean":"2023-08-31T19:01:02.013764+0000","last_became_active":"2023-08-31T19:01:02.005275+0000","last_became_peered":"2023-08-31T19:01:02.005275+0000","last_unstale":"2023-08-31T19:01:02.013764+0000","last_undegraded":"2023-08-31T19:01:02.013764+0000","last_fullsized":"2023-08-31T19:01:02.013764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.022463+0000","last_change":"2023-08-31T19:01:01.541213+0000","last_active":"2023-08-31T19:01:02.022463+0000","last_peered":"2023-08-31T19:01:02.022463+0000","last_clean":"2023-08-31T19:01:02.022463+0000","last_became_active":"2023-08-31T19:01:01.540896+0000","last_became_peered":"2023-08-31T19:01:01.540896+0000","last_unstale":"2023-08-31T19:01:02.022463+0000","last_undegraded":"2023-08-31T19:01:02.022463+0000","last_fullsized":"2023-08-31T19:01:02.022463+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.013959+0000","last_change":"2023-08-31T19:01:02.005142+0000","last_active":"2023-08-31T19:01:02.013959+0000","last_peered":"2023-08-31T19:01:02.013959+0000","last_clean":"2023-08-31T19:01:02.013959+0000","last_became_active":"2023-08-31T19:01:02.004785+0000","last_became_peered":"2023-08-31T19:01:02.004785+0000","last_unstale":"2023-08-31T19:01:02.013959+0000","last_undegraded":"2023-08-31T19:01:02.013959+0000","last_fullsized":"2023-08-31T19:01:02.013959+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.555164+0000","last_change":"2023-08-31T19:01:01.554167+0000","last_active":"2023-08-31T19:01:01.555164+0000","last_peered":"2023-08-31T19:01:01.555164+0000","last_clean":"2023-08-31T19:01:01.555164+0000","last_became_active":"2023-08-31T19:01:01.553890+0000","last_became_peered":"2023-08-31T19:01:01.553890+0000","last_unstale":"2023-08-31T19:01:01.555164+0000","last_undegraded":"2023-08-31T19:01:01.555164+0000","last_fullsized":"2023-08-31T19:01:01.555164+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.019096+0000","last_change":"2023-08-31T19:01:02.019096+0000","last_active":"2023-08-31T19:01:02.019096+0000","last_peered":"2023-08-31T19:01:02.019096+0000","last_clean":"2023-08-31T19:01:02.019096+0000","last_became_active":"2023-08-31T19:01:02.018739+0000","last_became_peered":"2023-08-31T19:01:02.018739+0000","last_unstale":"2023-08-31T19:01:02.019096+0000","last_undegraded":"2023-08-31T19:01:02.019096+0000","last_fullsized":"2023-08-31T19:01:02.019096+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.547954+0000","last_change":"2023-08-31T19:01:01.537056+0000","last_active":"2023-08-31T19:01:01.547954+0000","last_peered":"2023-08-31T19:01:01.547954+0000","last_clean":"2023-08-31T19:01:01.547954+0000","last_became_active":"2023-08-31T19:01:01.536760+0000","last_became_peered":"2023-08-31T19:01:01.536760+0000","last_unstale":"2023-08-31T19:01:01.547954+0000","last_undegraded":"2023-08-31T19:01:01.547954+0000","last_fullsized":"2023-08-31T19:01:01.547954+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016366+0000","last_change":"2023-08-31T19:01:02.013771+0000","last_active":"2023-08-31T19:01:02.016366+0000","last_peered":"2023-08-31T19:01:02.016366+0000","last_clean":"2023-08-31T19:01:02.016366+0000","last_became_active":"2023-08-31T19:01:02.011039+0000","last_became_peered":"2023-08-31T19:01:02.011039+0000","last_unstale":"2023-08-31T19:01:02.016366+0000","last_undegraded":"2023-08-31T19:01:02.016366+0000","last_fullsized":"2023-08-31T19:01:02.016366+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.542223+0000","last_change":"2023-08-31T19:01:01.538485+0000","last_active":"2023-08-31T19:01:01.542223+0000","last_peered":"2023-08-31T19:01:01.542223+0000","last_clean":"2023-08-31T19:01:01.542223+0000","last_became_active":"2023-08-31T19:01:01.538218+0000","last_became_peered":"2023-08-31T19:01:01.538218+0000","last_unstale":"2023-08-31T19:01:01.542223+0000","last_undegraded":"2023-08-31T19:01:01.542223+0000","last_fullsized":"2023-08-31T19:01:01.542223+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011968+0000","last_change":"2023-08-31T19:01:02.005308+0000","last_active":"2023-08-31T19:01:02.011968+0000","last_peered":"2023-08-31T19:01:02.011968+0000","last_clean":"2023-08-31T19:01:02.011968+0000","last_became_active":"2023-08-31T19:01:02.004370+0000","last_became_peered":"2023-08-31T19:01:02.004370+0000","last_unstale":"2023-08-31T19:01:02.011968+0000","last_undegraded":"2023-08-31T19:01:02.011968+0000","last_fullsized":"2023-08-31T19:01:02.011968+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.991858+0000","last_change":"2023-08-31T19:01:01.544949+0000","last_active":"2023-08-31T19:01:01.991858+0000","last_peered":"2023-08-31T19:01:01.991858+0000","last_clean":"2023-08-31T19:01:01.991858+0000","last_became_active":"2023-08-31T19:01:01.544234+0000","last_became_peered":"2023-08-31T19:01:01.544234+0000","last_unstale":"2023-08-31T19:01:01.991858+0000","last_undegraded":"2023-08-31T19:01:01.991858+0000","last_fullsized":"2023-08-31T19:01:01.991858+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.024369+0000","last_change":"2023-08-31T19:01:02.020267+0000","last_active":"2023-08-31T19:01:02.024369+0000","last_peered":"2023-08-31T19:01:02.024369+0000","last_clean":"2023-08-31T19:01:02.024369+0000","last_became_active":"2023-08-31T19:01:02.019925+0000","last_became_peered":"2023-08-31T19:01:02.019925+0000","last_unstale":"2023-08-31T19:01:02.024369+0000","last_undegraded":"2023-08-31T19:01:02.024369+0000","last_fullsized":"2023-08-31T19:01:02.024369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.548046+0000","last_change":"2023-08-31T19:01:01.542603+0000","last_active":"2023-08-31T19:01:01.548046+0000","last_peered":"2023-08-31T19:01:01.548046+0000","last_clean":"2023-08-31T19:01:01.548046+0000","last_became_active":"2023-08-31T19:01:01.542320+0000","last_became_peered":"2023-08-31T19:01:01.542320+0000","last_unstale":"2023-08-31T19:01:01.548046+0000","last_undegraded":"2023-08-31T19:01:01.548046+0000","last_fullsized":"2023-08-31T19:01:01.548046+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.002998+0000","last_change":"2023-08-31T19:01:02.002998+0000","last_active":"2023-08-31T19:01:02.002998+0000","last_peered":"2023-08-31T19:01:02.002998+0000","last_clean":"2023-08-31T19:01:02.002998+0000","last_became_active":"2023-08-31T19:01:02.002245+0000","last_became_peered":"2023-08-31T19:01:02.002245+0000","last_unstale":"2023-08-31T19:01:02.002998+0000","last_undegraded":"2023-08-31T19:01:02.002998+0000","last_fullsized":"2023-08-31T19:01:02.002998+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.998205+0000","last_change":"2023-08-31T19:01:01.542769+0000","last_active":"2023-08-31T19:01:01.998205+0000","last_peered":"2023-08-31T19:01:01.998205+0000","last_clean":"2023-08-31T19:01:01.998205+0000","last_became_active":"2023-08-31T19:01:01.542482+0000","last_became_peered":"2023-08-31T19:01:01.542482+0000","last_unstale":"2023-08-31T19:01:01.998205+0000","last_undegraded":"2023-08-31T19:01:01.998205+0000","last_fullsized":"2023-08-31T19:01:01.998205+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.006811+0000","last_change":"2023-08-31T19:01:02.006811+0000","last_active":"2023-08-31T19:01:02.006811+0000","last_peered":"2023-08-31T19:01:02.006811+0000","last_clean":"2023-08-31T19:01:02.006811+0000","last_became_active":"2023-08-31T19:01:02.006452+0000","last_became_peered":"2023-08-31T19:01:02.006452+0000","last_unstale":"2023-08-31T19:01:02.006811+0000","last_undegraded":"2023-08-31T19:01:02.006811+0000","last_fullsized":"2023-08-31T19:01:02.006811+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.538621+0000","last_change":"2023-08-31T19:01:01.536817+0000","last_active":"2023-08-31T19:01:01.538621+0000","last_peered":"2023-08-31T19:01:01.538621+0000","last_clean":"2023-08-31T19:01:01.538621+0000","last_became_active":"2023-08-31T19:01:01.536538+0000","last_became_peered":"2023-08-31T19:01:01.536538+0000","last_unstale":"2023-08-31T19:01:01.538621+0000","last_undegraded":"2023-08-31T19:01:01.538621+0000","last_fullsized":"2023-08-31T19:01:01.538621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016921+0000","last_change":"2023-08-31T19:01:02.016921+0000","last_active":"2023-08-31T19:01:02.016921+0000","last_peered":"2023-08-31T19:01:02.016921+0000","last_clean":"2023-08-31T19:01:02.016921+0000","last_became_active":"2023-08-31T19:01:02.016499+0000","last_became_peered":"2023-08-31T19:01:02.016499+0000","last_unstale":"2023-08-31T19:01:02.016921+0000","last_undegraded":"2023-08-31T19:01:02.016921+0000","last_fullsized":"2023-08-31T19:01:02.016921+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"60'3","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016911+0000","last_change":"2023-08-31T19:01:01.552733+0000","last_active":"2023-08-31T19:01:02.016911+0000","last_peered":"2023-08-31T19:01:02.016911+0000","last_clean":"2023-08-31T19:01:02.016911+0000","last_became_active":"2023-08-31T19:01:01.552369+0000","last_became_peered":"2023-08-31T19:01:01.552369+0000","last_unstale":"2023-08-31T19:01:02.016911+0000","last_undegraded":"2023-08-31T19:01:02.016911+0000","last_fullsized":"2023-08-31T19:01:02.016911+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.002758+0000","last_change":"2023-08-31T19:01:02.002758+0000","last_active":"2023-08-31T19:01:02.002758+0000","last_peered":"2023-08-31T19:01:02.002758+0000","last_clean":"2023-08-31T19:01:02.002758+0000","last_became_active":"2023-08-31T19:01:02.002462+0000","last_became_peered":"2023-08-31T19:01:02.002462+0000","last_unstale":"2023-08-31T19:01:02.002758+0000","last_undegraded":"2023-08-31T19:01:02.002758+0000","last_fullsized":"2023-08-31T19:01:02.002758+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011923+0000","last_change":"2023-08-31T19:01:01.554230+0000","last_active":"2023-08-31T19:01:02.011923+0000","last_peered":"2023-08-31T19:01:02.011923+0000","last_clean":"2023-08-31T19:01:02.011923+0000","last_became_active":"2023-08-31T19:01:01.553947+0000","last_became_peered":"2023-08-31T19:01:01.553947+0000","last_unstale":"2023-08-31T19:01:02.011923+0000","last_undegraded":"2023-08-31T19:01:02.011923+0000","last_fullsized":"2023-08-31T19:01:02.011923+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.015178+0000","last_change":"2023-08-31T19:01:02.015178+0000","last_active":"2023-08-31T19:01:02.015178+0000","last_peered":"2023-08-31T19:01:02.015178+0000","last_clean":"2023-08-31T19:01:02.015178+0000","last_became_active":"2023-08-31T19:01:02.014844+0000","last_became_peered":"2023-08-31T19:01:02.014844+0000","last_unstale":"2023-08-31T19:01:02.015178+0000","last_undegraded":"2023-08-31T19:01:02.015178+0000","last_fullsized":"2023-08-31T19:01:02.015178+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"60'1","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.991888+0000","last_change":"2023-08-31T19:01:01.545832+0000","last_active":"2023-08-31T19:01:01.991888+0000","last_peered":"2023-08-31T19:01:01.991888+0000","last_clean":"2023-08-31T19:01:01.991888+0000","last_became_active":"2023-08-31T19:01:01.545519+0000","last_became_peered":"2023-08-31T19:01:01.545519+0000","last_unstale":"2023-08-31T19:01:01.991888+0000","last_undegraded":"2023-08-31T19:01:01.991888+0000","last_fullsized":"2023-08-31T19:01:01.991888+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012118+0000","last_change":"2023-08-31T19:01:02.012118+0000","last_active":"2023-08-31T19:01:02.012118+0000","last_peered":"2023-08-31T19:01:02.012118+0000","last_clean":"2023-08-31T19:01:02.012118+0000","last_became_active":"2023-08-31T19:01:02.011639+0000","last_became_peered":"2023-08-31T19:01:02.011639+0000","last_unstale":"2023-08-31T19:01:02.012118+0000","last_undegraded":"2023-08-31T19:01:02.012118+0000","last_fullsized":"2023-08-31T19:01:02.012118+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.992431+0000","last_change":"2023-08-31T19:01:01.539906+0000","last_active":"2023-08-31T19:01:01.992431+0000","last_peered":"2023-08-31T19:01:01.992431+0000","last_clean":"2023-08-31T19:01:01.992431+0000","last_became_active":"2023-08-31T19:01:01.539593+0000","last_became_peered":"2023-08-31T19:01:01.539593+0000","last_unstale":"2023-08-31T19:01:01.992431+0000","last_undegraded":"2023-08-31T19:01:01.992431+0000","last_fullsized":"2023-08-31T19:01:01.992431+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012066+0000","last_change":"2023-08-31T19:01:02.006899+0000","last_active":"2023-08-31T19:01:02.012066+0000","last_peered":"2023-08-31T19:01:02.012066+0000","last_clean":"2023-08-31T19:01:02.012066+0000","last_became_active":"2023-08-31T19:01:02.006648+0000","last_became_peered":"2023-08-31T19:01:02.006648+0000","last_unstale":"2023-08-31T19:01:02.012066+0000","last_undegraded":"2023-08-31T19:01:02.012066+0000","last_fullsized":"2023-08-31T19:01:02.012066+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.998387+0000","last_change":"2023-08-31T19:01:01.546918+0000","last_active":"2023-08-31T19:01:01.998387+0000","last_peered":"2023-08-31T19:01:01.998387+0000","last_clean":"2023-08-31T19:01:01.998387+0000","last_became_active":"2023-08-31T19:01:01.546474+0000","last_became_peered":"2023-08-31T19:01:01.546474+0000","last_unstale":"2023-08-31T19:01:01.998387+0000","last_undegraded":"2023-08-31T19:01:01.998387+0000","last_fullsized":"2023-08-31T19:01:01.998387+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012945+0000","last_change":"2023-08-31T19:01:02.012945+0000","last_active":"2023-08-31T19:01:02.012945+0000","last_peered":"2023-08-31T19:01:02.012945+0000","last_clean":"2023-08-31T19:01:02.012945+0000","last_became_active":"2023-08-31T19:01:02.011382+0000","last_became_peered":"2023-08-31T19:01:02.011382+0000","last_unstale":"2023-08-31T19:01:02.012945+0000","last_undegraded":"2023-08-31T19:01:02.012945+0000","last_fullsized":"2023-08-31T19:01:02.012945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018557+0000","last_change":"2023-08-31T19:01:01.549598+0000","last_active":"2023-08-31T19:01:02.018557+0000","last_peered":"2023-08-31T19:01:02.018557+0000","last_clean":"2023-08-31T19:01:02.018557+0000","last_became_active":"2023-08-31T19:01:01.549318+0000","last_became_peered":"2023-08-31T19:01:01.549318+0000","last_unstale":"2023-08-31T19:01:02.018557+0000","last_undegraded":"2023-08-31T19:01:02.018557+0000","last_fullsized":"2023-08-31T19:01:02.018557+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018615+0000","last_change":"2023-08-31T19:01:02.009753+0000","last_active":"2023-08-31T19:01:02.018615+0000","last_peered":"2023-08-31T19:01:02.018615+0000","last_clean":"2023-08-31T19:01:02.018615+0000","last_became_active":"2023-08-31T19:01:02.009465+0000","last_became_peered":"2023-08-31T19:01:02.009465+0000","last_unstale":"2023-08-31T19:01:02.018615+0000","last_undegraded":"2023-08-31T19:01:02.018615+0000","last_fullsized":"2023-08-31T19:01:02.018615+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"60'1","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.994320+0000","last_change":"2023-08-31T19:01:01.555324+0000","last_active":"2023-08-31T19:01:01.994320+0000","last_peered":"2023-08-31T19:01:01.994320+0000","last_clean":"2023-08-31T19:01:01.994320+0000","last_became_active":"2023-08-31T19:01:01.555013+0000","last_became_peered":"2023-08-31T19:01:01.555013+0000","last_unstale":"2023-08-31T19:01:01.994320+0000","last_undegraded":"2023-08-31T19:01:01.994320+0000","last_fullsized":"2023-08-31T19:01:01.994320+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.024663+0000","last_change":"2023-08-31T19:01:02.020700+0000","last_active":"2023-08-31T19:01:02.024663+0000","last_peered":"2023-08-31T19:01:02.024663+0000","last_clean":"2023-08-31T19:01:02.024663+0000","last_became_active":"2023-08-31T19:01:02.020397+0000","last_became_peered":"2023-08-31T19:01:02.020397+0000","last_unstale":"2023-08-31T19:01:02.024663+0000","last_undegraded":"2023-08-31T19:01:02.024663+0000","last_fullsized":"2023-08-31T19:01:02.024663+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012579+0000","last_change":"2023-08-31T19:01:01.536913+0000","last_active":"2023-08-31T19:01:02.012579+0000","last_peered":"2023-08-31T19:01:02.012579+0000","last_clean":"2023-08-31T19:01:02.012579+0000","last_became_active":"2023-08-31T19:01:01.536625+0000","last_became_peered":"2023-08-31T19:01:01.536625+0000","last_unstale":"2023-08-31T19:01:02.012579+0000","last_undegraded":"2023-08-31T19:01:02.012579+0000","last_fullsized":"2023-08-31T19:01:02.012579+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018985+0000","last_change":"2023-08-31T19:01:02.018985+0000","last_active":"2023-08-31T19:01:02.018985+0000","last_peered":"2023-08-31T19:01:02.018985+0000","last_clean":"2023-08-31T19:01:02.018985+0000","last_became_active":"2023-08-31T19:01:02.018694+0000","last_became_peered":"2023-08-31T19:01:02.018694+0000","last_unstale":"2023-08-31T19:01:02.018985+0000","last_undegraded":"2023-08-31T19:01:02.018985+0000","last_fullsized":"2023-08-31T19:01:02.018985+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.992801+0000","last_change":"2023-08-31T19:01:01.537643+0000","last_active":"2023-08-31T19:01:01.992801+0000","last_peered":"2023-08-31T19:01:01.992801+0000","last_clean":"2023-08-31T19:01:01.992801+0000","last_became_active":"2023-08-31T19:01:01.537354+0000","last_became_peered":"2023-08-31T19:01:01.537354+0000","last_unstale":"2023-08-31T19:01:01.992801+0000","last_undegraded":"2023-08-31T19:01:01.992801+0000","last_fullsized":"2023-08-31T19:01:01.992801+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.015204+0000","last_change":"2023-08-31T19:01:02.012188+0000","last_active":"2023-08-31T19:01:02.015204+0000","last_peered":"2023-08-31T19:01:02.015204+0000","last_clean":"2023-08-31T19:01:02.015204+0000","last_became_active":"2023-08-31T19:01:02.011888+0000","last_became_peered":"2023-08-31T19:01:02.011888+0000","last_unstale":"2023-08-31T19:01:02.015204+0000","last_undegraded":"2023-08-31T19:01:02.015204+0000","last_fullsized":"2023-08-31T19:01:02.015204+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.992255+0000","last_change":"2023-08-31T19:01:01.554258+0000","last_active":"2023-08-31T19:01:01.992255+0000","last_peered":"2023-08-31T19:01:01.992255+0000","last_clean":"2023-08-31T19:01:01.992255+0000","last_became_active":"2023-08-31T19:01:01.553921+0000","last_became_peered":"2023-08-31T19:01:01.553921+0000","last_unstale":"2023-08-31T19:01:01.992255+0000","last_undegraded":"2023-08-31T19:01:01.992255+0000","last_fullsized":"2023-08-31T19:01:01.992255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.007053+0000","last_change":"2023-08-31T19:01:02.007053+0000","last_active":"2023-08-31T19:01:02.007053+0000","last_peered":"2023-08-31T19:01:02.007053+0000","last_clean":"2023-08-31T19:01:02.007053+0000","last_became_active":"2023-08-31T19:01:02.006662+0000","last_became_peered":"2023-08-31T19:01:02.006662+0000","last_unstale":"2023-08-31T19:01:02.007053+0000","last_undegraded":"2023-08-31T19:01:02.007053+0000","last_fullsized":"2023-08-31T19:01:02.007053+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012563+0000","last_change":"2023-08-31T19:01:01.539889+0000","last_active":"2023-08-31T19:01:02.012563+0000","last_peered":"2023-08-31T19:01:02.012563+0000","last_clean":"2023-08-31T19:01:02.012563+0000","last_became_active":"2023-08-31T19:01:01.539589+0000","last_became_peered":"2023-08-31T19:01:01.539589+0000","last_unstale":"2023-08-31T19:01:02.012563+0000","last_undegraded":"2023-08-31T19:01:02.012563+0000","last_fullsized":"2023-08-31T19:01:02.012563+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011700+0000","last_change":"2023-08-31T19:01:02.002788+0000","last_active":"2023-08-31T19:01:02.011700+0000","last_peered":"2023-08-31T19:01:02.011700+0000","last_clean":"2023-08-31T19:01:02.011700+0000","last_became_active":"2023-08-31T19:01:02.002528+0000","last_became_peered":"2023-08-31T19:01:02.002528+0000","last_unstale":"2023-08-31T19:01:02.011700+0000","last_undegraded":"2023-08-31T19:01:02.011700+0000","last_fullsized":"2023-08-31T19:01:02.011700+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.989632+0000","last_change":"2023-08-31T19:01:01.553606+0000","last_active":"2023-08-31T19:01:01.989632+0000","last_peered":"2023-08-31T19:01:01.989632+0000","last_clean":"2023-08-31T19:01:01.989632+0000","last_became_active":"2023-08-31T19:01:01.553329+0000","last_became_peered":"2023-08-31T19:01:01.553329+0000","last_unstale":"2023-08-31T19:01:01.989632+0000","last_undegraded":"2023-08-31T19:01:01.989632+0000","last_fullsized":"2023-08-31T19:01:01.989632+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.000714+0000","last_change":"2023-08-31T19:01:02.000714+0000","last_active":"2023-08-31T19:01:02.000714+0000","last_peered":"2023-08-31T19:01:02.000714+0000","last_clean":"2023-08-31T19:01:02.000714+0000","last_became_active":"2023-08-31T19:01:02.000452+0000","last_became_peered":"2023-08-31T19:01:02.000452+0000","last_unstale":"2023-08-31T19:01:02.000714+0000","last_undegraded":"2023-08-31T19:01:02.000714+0000","last_fullsized":"2023-08-31T19:01:02.000714+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.547845+0000","last_change":"2023-08-31T19:01:01.542381+0000","last_active":"2023-08-31T19:01:01.547845+0000","last_peered":"2023-08-31T19:01:01.547845+0000","last_clean":"2023-08-31T19:01:01.547845+0000","last_became_active":"2023-08-31T19:01:01.542037+0000","last_became_peered":"2023-08-31T19:01:01.542037+0000","last_unstale":"2023-08-31T19:01:01.547845+0000","last_undegraded":"2023-08-31T19:01:01.547845+0000","last_fullsized":"2023-08-31T19:01:01.547845+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.020324+0000","last_change":"2023-08-31T19:01:02.015115+0000","last_active":"2023-08-31T19:01:02.020324+0000","last_peered":"2023-08-31T19:01:02.020324+0000","last_clean":"2023-08-31T19:01:02.020324+0000","last_became_active":"2023-08-31T19:01:02.014839+0000","last_became_peered":"2023-08-31T19:01:02.014839+0000","last_unstale":"2023-08-31T19:01:02.020324+0000","last_undegraded":"2023-08-31T19:01:02.020324+0000","last_fullsized":"2023-08-31T19:01:02.020324+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.005539+0000","last_change":"2023-08-31T19:01:01.544401+0000","last_active":"2023-08-31T19:01:02.005539+0000","last_peered":"2023-08-31T19:01:02.005539+0000","last_clean":"2023-08-31T19:01:02.005539+0000","last_became_active":"2023-08-31T19:01:01.543725+0000","last_became_peered":"2023-08-31T19:01:01.543725+0000","last_unstale":"2023-08-31T19:01:02.005539+0000","last_undegraded":"2023-08-31T19:01:02.005539+0000","last_fullsized":"2023-08-31T19:01:02.005539+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.010903+0000","last_change":"2023-08-31T19:01:02.010903+0000","last_active":"2023-08-31T19:01:02.010903+0000","last_peered":"2023-08-31T19:01:02.010903+0000","last_clean":"2023-08-31T19:01:02.010903+0000","last_became_active":"2023-08-31T19:01:02.010583+0000","last_became_peered":"2023-08-31T19:01:02.010583+0000","last_unstale":"2023-08-31T19:01:02.010903+0000","last_undegraded":"2023-08-31T19:01:02.010903+0000","last_fullsized":"2023-08-31T19:01:02.010903+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.554627+0000","last_change":"2023-08-31T19:01:01.552518+0000","last_active":"2023-08-31T19:01:01.554627+0000","last_peered":"2023-08-31T19:01:01.554627+0000","last_clean":"2023-08-31T19:01:01.554627+0000","last_became_active":"2023-08-31T19:01:01.552203+0000","last_became_peered":"2023-08-31T19:01:01.552203+0000","last_unstale":"2023-08-31T19:01:01.554627+0000","last_undegraded":"2023-08-31T19:01:01.554627+0000","last_fullsized":"2023-08-31T19:01:01.554627+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.002330+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:01:02.002330+0000","last_peered":"2023-08-31T19:01:02.002330+0000","last_clean":"2023-08-31T19:01:02.002330+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:01:02.002330+0000","last_undegraded":"2023-08-31T19:01:02.002330+0000","last_fullsized":"2023-08-31T19:01:02.002330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012212+0000","last_change":"2023-08-31T19:01:02.012212+0000","last_active":"2023-08-31T19:01:02.012212+0000","last_peered":"2023-08-31T19:01:02.012212+0000","last_clean":"2023-08-31T19:01:02.012212+0000","last_became_active":"2023-08-31T19:01:02.011811+0000","last_became_peered":"2023-08-31T19:01:02.011811+0000","last_unstale":"2023-08-31T19:01:02.012212+0000","last_undegraded":"2023-08-31T19:01:02.012212+0000","last_fullsized":"2023-08-31T19:01:02.012212+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.020052+0000","last_change":"2023-08-31T19:01:01.548899+0000","last_active":"2023-08-31T19:01:02.020052+0000","last_peered":"2023-08-31T19:01:02.020052+0000","last_clean":"2023-08-31T19:01:02.020052+0000","last_became_active":"2023-08-31T19:01:01.548546+0000","last_became_peered":"2023-08-31T19:01:01.548546+0000","last_unstale":"2023-08-31T19:01:02.020052+0000","last_undegraded":"2023-08-31T19:01:02.020052+0000","last_fullsized":"2023-08-31T19:01:02.020052+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.533148+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:01:01.533148+0000","last_peered":"2023-08-31T19:01:01.533148+0000","last_clean":"2023-08-31T19:01:01.533148+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:01:01.533148+0000","last_undegraded":"2023-08-31T19:01:01.533148+0000","last_fullsized":"2023-08-31T19:01:01.533148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.013980+0000","last_change":"2023-08-31T19:01:02.006304+0000","last_active":"2023-08-31T19:01:02.013980+0000","last_peered":"2023-08-31T19:01:02.013980+0000","last_clean":"2023-08-31T19:01:02.013980+0000","last_became_active":"2023-08-31T19:01:02.006014+0000","last_became_peered":"2023-08-31T19:01:02.006014+0000","last_unstale":"2023-08-31T19:01:02.013980+0000","last_undegraded":"2023-08-31T19:01:02.013980+0000","last_fullsized":"2023-08-31T19:01:02.013980+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.548063+0000","last_change":"2023-08-31T19:01:01.541516+0000","last_active":"2023-08-31T19:01:01.548063+0000","last_peered":"2023-08-31T19:01:01.548063+0000","last_clean":"2023-08-31T19:01:01.548063+0000","last_became_active":"2023-08-31T19:01:01.541160+0000","last_became_peered":"2023-08-31T19:01:01.541160+0000","last_unstale":"2023-08-31T19:01:01.548063+0000","last_undegraded":"2023-08-31T19:01:01.548063+0000","last_fullsized":"2023-08-31T19:01:01.548063+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.007489+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:01:02.007489+0000","last_peered":"2023-08-31T19:01:02.007489+0000","last_clean":"2023-08-31T19:01:02.007489+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:01:02.007489+0000","last_undegraded":"2023-08-31T19:01:02.007489+0000","last_fullsized":"2023-08-31T19:01:02.007489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011548+0000","last_change":"2023-08-31T19:01:02.002588+0000","last_active":"2023-08-31T19:01:02.011548+0000","last_peered":"2023-08-31T19:01:02.011548+0000","last_clean":"2023-08-31T19:01:02.011548+0000","last_became_active":"2023-08-31T19:01:02.002328+0000","last_became_peered":"2023-08-31T19:01:02.002328+0000","last_unstale":"2023-08-31T19:01:02.011548+0000","last_undegraded":"2023-08-31T19:01:02.011548+0000","last_fullsized":"2023-08-31T19:01:02.011548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.549365+0000","last_change":"2023-08-31T19:01:01.546226+0000","last_active":"2023-08-31T19:01:01.549365+0000","last_peered":"2023-08-31T19:01:01.549365+0000","last_clean":"2023-08-31T19:01:01.549365+0000","last_became_active":"2023-08-31T19:01:01.545825+0000","last_became_peered":"2023-08-31T19:01:01.545825+0000","last_unstale":"2023-08-31T19:01:01.549365+0000","last_undegraded":"2023-08-31T19:01:01.549365+0000","last_fullsized":"2023-08-31T19:01:01.549365+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.532390+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:01:01.532390+0000","last_peered":"2023-08-31T19:01:01.532390+0000","last_clean":"2023-08-31T19:01:01.532390+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:01:01.532390+0000","last_undegraded":"2023-08-31T19:01:01.532390+0000","last_fullsized":"2023-08-31T19:01:01.532390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":50,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.999721+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:01:01.999721+0000","last_peered":"2023-08-31T19:01:01.999721+0000","last_clean":"2023-08-31T19:01:01.999721+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:01:01.999721+0000","last_undegraded":"2023-08-31T19:01:01.999721+0000","last_fullsized":"2023-08-31T19:01:01.999721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011892+0000","last_change":"2023-08-31T19:01:02.007541+0000","last_active":"2023-08-31T19:01:02.011892+0000","last_peered":"2023-08-31T19:01:02.011892+0000","last_clean":"2023-08-31T19:01:02.011892+0000","last_became_active":"2023-08-31T19:01:02.007240+0000","last_became_peered":"2023-08-31T19:01:02.007240+0000","last_unstale":"2023-08-31T19:01:02.011892+0000","last_undegraded":"2023-08-31T19:01:02.011892+0000","last_fullsized":"2023-08-31T19:01:02.011892+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.000171+0000","last_change":"2023-08-31T19:01:01.543149+0000","last_active":"2023-08-31T19:01:02.000171+0000","last_peered":"2023-08-31T19:01:02.000171+0000","last_clean":"2023-08-31T19:01:02.000171+0000","last_became_active":"2023-08-31T19:01:01.542872+0000","last_became_peered":"2023-08-31T19:01:01.542872+0000","last_unstale":"2023-08-31T19:01:02.000171+0000","last_undegraded":"2023-08-31T19:01:02.000171+0000","last_fullsized":"2023-08-31T19:01:02.000171+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.999808+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:01:01.999808+0000","last_peered":"2023-08-31T19:01:01.999808+0000","last_clean":"2023-08-31T19:01:01.999808+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:01:01.999808+0000","last_undegraded":"2023-08-31T19:01:01.999808+0000","last_fullsized":"2023-08-31T19:01:01.999808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.019876+0000","last_change":"2023-08-31T19:01:02.015805+0000","last_active":"2023-08-31T19:01:02.019876+0000","last_peered":"2023-08-31T19:01:02.019876+0000","last_clean":"2023-08-31T19:01:02.019876+0000","last_became_active":"2023-08-31T19:01:02.015503+0000","last_became_peered":"2023-08-31T19:01:02.015503+0000","last_unstale":"2023-08-31T19:01:02.019876+0000","last_undegraded":"2023-08-31T19:01:02.019876+0000","last_fullsized":"2023-08-31T19:01:02.019876+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.545814+0000","last_change":"2023-08-31T19:01:01.538748+0000","last_active":"2023-08-31T19:01:01.545814+0000","last_peered":"2023-08-31T19:01:01.545814+0000","last_clean":"2023-08-31T19:01:01.545814+0000","last_became_active":"2023-08-31T19:01:01.538473+0000","last_became_peered":"2023-08-31T19:01:01.538473+0000","last_unstale":"2023-08-31T19:01:01.545814+0000","last_undegraded":"2023-08-31T19:01:01.545814+0000","last_fullsized":"2023-08-31T19:01:01.545814+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.000249+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:01:02.000249+0000","last_peered":"2023-08-31T19:01:02.000249+0000","last_clean":"2023-08-31T19:01:02.000249+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:01:02.000249+0000","last_undegraded":"2023-08-31T19:01:02.000249+0000","last_fullsized":"2023-08-31T19:01:02.000249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018070+0000","last_change":"2023-08-31T19:01:02.018070+0000","last_active":"2023-08-31T19:01:02.018070+0000","last_peered":"2023-08-31T19:01:02.018070+0000","last_clean":"2023-08-31T19:01:02.018070+0000","last_became_active":"2023-08-31T19:01:02.017662+0000","last_became_peered":"2023-08-31T19:01:02.017662+0000","last_unstale":"2023-08-31T19:01:02.018070+0000","last_undegraded":"2023-08-31T19:01:02.018070+0000","last_fullsized":"2023-08-31T19:01:02.018070+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.992141+0000","last_change":"2023-08-31T19:01:01.554002+0000","last_active":"2023-08-31T19:01:01.992141+0000","last_peered":"2023-08-31T19:01:01.992141+0000","last_clean":"2023-08-31T19:01:01.992141+0000","last_became_active":"2023-08-31T19:01:01.553717+0000","last_became_peered":"2023-08-31T19:01:01.553717+0000","last_unstale":"2023-08-31T19:01:01.992141+0000","last_undegraded":"2023-08-31T19:01:01.992141+0000","last_fullsized":"2023-08-31T19:01:01.992141+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.003011+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:01:02.003011+0000","last_peered":"2023-08-31T19:01:02.003011+0000","last_clean":"2023-08-31T19:01:02.003011+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:01:02.003011+0000","last_undegraded":"2023-08-31T19:01:02.003011+0000","last_fullsized":"2023-08-31T19:01:02.003011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.015326+0000","last_change":"2023-08-31T19:01:02.015326+0000","last_active":"2023-08-31T19:01:02.015326+0000","last_peered":"2023-08-31T19:01:02.015326+0000","last_clean":"2023-08-31T19:01:02.015326+0000","last_became_active":"2023-08-31T19:01:02.015009+0000","last_became_peered":"2023-08-31T19:01:02.015009+0000","last_unstale":"2023-08-31T19:01:02.015326+0000","last_undegraded":"2023-08-31T19:01:02.015326+0000","last_fullsized":"2023-08-31T19:01:02.015326+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.989834+0000","last_change":"2023-08-31T19:01:01.551096+0000","last_active":"2023-08-31T19:01:01.989834+0000","last_peered":"2023-08-31T19:01:01.989834+0000","last_clean":"2023-08-31T19:01:01.989834+0000","last_became_active":"2023-08-31T19:01:01.550596+0000","last_became_peered":"2023-08-31T19:01:01.550596+0000","last_unstale":"2023-08-31T19:01:01.989834+0000","last_undegraded":"2023-08-31T19:01:01.989834+0000","last_fullsized":"2023-08-31T19:01:01.989834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.991854+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:01:01.991854+0000","last_peered":"2023-08-31T19:01:01.991854+0000","last_clean":"2023-08-31T19:01:01.991854+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:01:01.991854+0000","last_undegraded":"2023-08-31T19:01:01.991854+0000","last_fullsized":"2023-08-31T19:01:01.991854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":724992,"data_stored":351365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.73699999999999999,"15min":0.72799999999999998},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.39500000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":1.0489999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76500000000000001,"15min":0.74399999999999999},"min":{"1min":0.57599999999999996,"5min":0.48399999999999999,"15min":0.42199999999999999},"max":{"1min":0.91500000000000004,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.99299999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70299999999999996,"15min":0.69099999999999995},"min":{"1min":0.48599999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89300000000000002,"5min":0.93000000000000005,"15min":0.97299999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.41699999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88700000000000001,"5min":0.92000000000000004,"15min":0.96799999999999997},"last":0.93100000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70399999999999996,"15min":0.69599999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.874,"5min":0.97499999999999998,"15min":1.093},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.745,"15min":0.72499999999999998},"min":{"1min":0.52600000000000002,"5min":0.50700000000000001,"15min":0.41199999999999998},"max":{"1min":0.95199999999999996,"5min":1.054,"15min":1.054},"last":0.89600000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.1160000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.55400000000000005,"5min":0.54700000000000004,"15min":0.495},"max":{"1min":0.93999999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81200000000000006,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.45500000000000002},"max":{"1min":0.83999999999999997,"5min":0.98499999999999999,"15min":1.163},"last":0.625}]},{"osd":5,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.52200000000000002,"5min":0.39900000000000002,"15min":0.377},"max":{"1min":0.98299999999999998,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.139},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70399999999999996,"15min":0.71099999999999997},"min":{"1min":0.47499999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97699999999999998,"5min":1.048,"15min":1.353},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67500000000000004,"15min":0.68400000000000005},"min":{"1min":0.46300000000000002,"5min":0.45600000000000002,"15min":0.41399999999999998},"max":{"1min":0.93100000000000005,"5min":1.0740000000000001,"15min":1.3999999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.47899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88900000000000001,"5min":0.96899999999999997,"15min":1.462},"last":1.038}]}]},{"osd":6,"up_from":13,"seq":55834575009,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301904,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069936,"statfs":{"total":96636764160,"available":96327614464,"internally_reserved":0,"allocated":729088,"data_stored":358033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.39600000000000002},"max":{"1min":0.91200000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72799999999999998,"15min":0.69099999999999995},"min":{"1min":0.61399999999999999,"5min":0.44800000000000001,"15min":0.43099999999999999},"max":{"1min":0.89000000000000001,"5min":0.93400000000000005,"15min":0.94499999999999995},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.69199999999999995},"min":{"1min":0.58199999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.82399999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.72999999999999998,"15min":0.71199999999999997},"min":{"1min":0.52500000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86599999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73999999999999999,"15min":0.71699999999999997},"min":{"1min":0.54000000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88600000000000001,"5min":1.036,"15min":1.129},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.58899999999999997,"5min":0.50900000000000001,"15min":0.5},"max":{"1min":0.85099999999999998,"5min":0.98699999999999999,"15min":1.3260000000000001},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.56100000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.873,"5min":0.98299999999999998,"15min":1.0860000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76200000000000001,"15min":0.745},"min":{"1min":0.61199999999999999,"5min":0.55300000000000005,"15min":0.49399999999999999},"max":{"1min":0.94799999999999995,"5min":1.052,"15min":1.052},"last":0.71799999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.60499999999999998,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.40999999999999998},"max":{"1min":0.71699999999999997,"5min":0.92900000000000005,"15min":0.97799999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.45900000000000002,"5min":0.44600000000000001,"15min":0.371},"max":{"1min":0.86299999999999999,"5min":0.88400000000000001,"15min":1.091},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66100000000000003,"15min":0.67500000000000004},"min":{"1min":0.44400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.1000000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71099999999999997,"15min":0.71899999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.46200000000000002},"max":{"1min":0.90300000000000002,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.441},"max":{"1min":0.93300000000000005,"5min":0.998,"15min":1.0620000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.496,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0800000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.76400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301904,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069936,"statfs":{"total":96636764160,"available":96327614464,"internally_reserved":0,"allocated":729088,"data_stored":358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45900000000000002,"15min":0.433},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.23300000000000001},"max":{"1min":0.63100000000000001,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48399999999999999,"15min":0.45700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33400000000000002,"15min":0.254},"max":{"1min":0.63800000000000001,"5min":0.752,"15min":0.752},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51400000000000001,"15min":0.498},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.28899999999999998},"max":{"1min":0.78000000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59599999999999997,"15min":0.55900000000000005},"min":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.36599999999999999},"max":{"1min":0.73799999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.53400000000000003},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.378},"max":{"1min":0.67300000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52200000000000002,"15min":0.505},"min":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":0.65700000000000003,"5min":0.72299999999999998,"15min":1.673},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.78500000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.53600000000000003},"max":{"1min":1.1739999999999999,"5min":1.2110000000000001,"15min":1.4119999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.83499999999999996,"15min":0.80400000000000005},"min":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.49099999999999999},"max":{"1min":1.1379999999999999,"5min":1.1799999999999999,"15min":1.3},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79100000000000004,"15min":0.77300000000000002},"min":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.46800000000000003},"max":{"1min":1.0309999999999999,"5min":1.052,"15min":1.8540000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78700000000000003,"15min":0.76300000000000001},"min":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.48799999999999999},"max":{"1min":1.1040000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.749}]},{"osd":6,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78900000000000003,"15min":0.76800000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.51400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1990000000000001,"15min":1.8979999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81899999999999995,"15min":0.78800000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.48999999999999999},"max":{"1min":1.024,"5min":1.2,"15min":1.2629999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81000000000000005,"15min":0.76900000000000002},"min":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.47699999999999998},"max":{"1min":1.085,"5min":1.087,"15min":1.113},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81299999999999994,"15min":0.80000000000000004},"min":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.504},"max":{"1min":1.1000000000000001,"5min":1.1399999999999999,"15min":2.0720000000000001},"last":0.81999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575009,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":724992,"data_stored":350813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.44600000000000001},"min":{"1min":0.33300000000000002,"5min":0.27400000000000002,"15min":0.26100000000000001},"max":{"1min":0.64500000000000002,"5min":0.66100000000000003,"15min":0.78400000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.499,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.58699999999999997,"5min":0.752,"15min":0.78500000000000003},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.497},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":0.67900000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.51900000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.33800000000000002},"max":{"1min":0.69699999999999995,"5min":0.71199999999999997,"15min":1.0029999999999999},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52200000000000002,"15min":0.51500000000000001},"min":{"1min":0.41799999999999998,"5min":0.374,"15min":0.35399999999999998},"max":{"1min":0.63100000000000001,"5min":0.73099999999999998,"15min":0.83399999999999996},"last":0.434},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.41999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70499999999999996,"5min":0.80400000000000005,"15min":1.0509999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83399999999999996,"15min":0.81799999999999995},"min":{"1min":0.67400000000000004,"5min":0.60499999999999998,"15min":0.53900000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.931},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82899999999999996,"15min":0.80600000000000005},"min":{"1min":0.66100000000000003,"5min":0.55800000000000005,"15min":0.49399999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.276},"last":0.85899999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76200000000000001,"15min":0.755},"min":{"1min":0.59599999999999997,"5min":0.50800000000000001,"15min":0.49399999999999999},"max":{"1min":1.0009999999999999,"5min":1.079,"15min":1.3480000000000001},"last":0.872},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77700000000000002,"15min":0.77200000000000002},"min":{"1min":0.60999999999999999,"5min":0.53000000000000003,"15min":0.50700000000000001},"max":{"1min":0.99199999999999999,"5min":1.113,"15min":1.9810000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.80500000000000005,"15min":0.80100000000000005},"min":{"1min":0.63700000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0960000000000001,"5min":1.181,"15min":1.3280000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.84099999999999997,"15min":0.83899999999999997},"min":{"1min":0.65600000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.071,"5min":1.1359999999999999,"15min":1.2350000000000001},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.171,"5min":1.171,"15min":2.1760000000000002},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84499999999999997,"15min":0.82899999999999996},"min":{"1min":0.72099999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.337},"last":0.90700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575009,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":724992,"data_stored":352223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.441,"15min":0.432},"min":{"1min":0.33000000000000002,"5min":0.32300000000000001,"15min":0.29099999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.90200000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.81899999999999995,"15min":1.5900000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.5,"15min":0.5},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72199999999999998,"5min":0.77300000000000002,"15min":0.96599999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53900000000000003,"15min":0.52500000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.36499999999999999},"max":{"1min":0.748,"5min":0.877,"15min":1.288},"last":0.64100000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":0.49199999999999999},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.33100000000000002},"max":{"1min":0.58799999999999997,"5min":1.022,"15min":1.022},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.54400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.35599999999999998},"max":{"1min":0.68000000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78900000000000003,"15min":0.77800000000000002},"min":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.50600000000000001},"max":{"1min":1.0309999999999999,"5min":1.161,"15min":1.208},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.79800000000000004,"15min":0.79100000000000004},"min":{"1min":0.60799999999999998,"5min":0.57699999999999996,"15min":0.47699999999999998},"max":{"1min":0.96199999999999997,"5min":1.1870000000000001,"15min":1.464},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79700000000000004,"15min":0.78500000000000003},"min":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0840000000000001,"5min":1.1339999999999999,"15min":1.361},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.78900000000000003},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.53400000000000003},"max":{"1min":1.1020000000000001,"5min":1.145,"15min":1.3},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.81399999999999995,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.60399999999999998,"15min":0.501},"max":{"1min":1.137,"5min":1.137,"15min":1.51},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80700000000000005,"15min":0.79800000000000004},"min":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.48199999999999998},"max":{"1min":1.1579999999999999,"5min":1.2989999999999999,"15min":1.4359999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.62,"5min":0.54800000000000004,"15min":0.51900000000000002},"max":{"1min":1.044,"5min":1.0820000000000001,"15min":1.55},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81999999999999995,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.59199999999999997,"15min":0.55100000000000005},"max":{"1min":1.0549999999999999,"5min":1.2050000000000001,"15min":1.387},"last":0.83499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575009,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301912,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069928,"statfs":{"total":96636764160,"available":96327606272,"internally_reserved":0,"allocated":737280,"data_stored":358629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.442,"15min":0.42499999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.252},"max":{"1min":0.58199999999999996,"5min":0.79400000000000004,"15min":0.995},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48099999999999998,"15min":0.45800000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.29199999999999998},"max":{"1min":0.59999999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44700000000000001,"15min":0.442},"min":{"1min":0.33900000000000002,"5min":0.32600000000000001,"15min":0.254},"max":{"1min":0.56100000000000005,"5min":0.66800000000000004,"15min":0.90700000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.503,"15min":0.49299999999999999},"min":{"1min":0.436,"5min":0.35599999999999998,"15min":0.28799999999999998},"max":{"1min":0.59899999999999998,"5min":0.78100000000000003,"15min":0.92800000000000005},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.56399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":1.0640000000000001,"15min":1.407},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.628,"15min":0.59399999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.40400000000000003},"max":{"1min":0.73499999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Aug 31 19:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.752,"15min":0.73899999999999999},"min":{"1min":0.56599999999999995,"5min":0.52500000000000002,"15min":0.47299999999999998},"max":{"1min":0.95499999999999996,"5min":1.0860000000000001,"15min":1.2849999999999999},"last":0.755},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.76900000000000002,"15min":0.751},"min":{"1min":0.64400000000000002,"5min":0.56000000000000005,"15min":0.47299999999999998},"max":{"1min":0.98799999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76200000000000001,"15min":0.75},"min":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.46600000000000003},"max":{"1min":0.89200000000000002,"5min":0.97899999999999998,"15min":1.3220000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78800000000000003,"15min":0.76500000000000001},"min":{"1min":0.625,"5min":0.53200000000000003,"15min":0.50700000000000001},"max":{"1min":0.95199999999999996,"5min":1.165,"15min":1.165},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.79400000000000004,"15min":0.78000000000000003},"min":{"1min":0.59299999999999997,"5min":0.55300000000000005,"15min":0.52000000000000002},"max":{"1min":1.0169999999999999,"5min":1.111,"15min":1.2270000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.78500000000000003,"15min":0.76400000000000001},"min":{"1min":0.65800000000000003,"5min":0.55400000000000005,"15min":0.50600000000000001},"max":{"1min":1.03,"5min":1.036,"15min":1.1379999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.81000000000000005,"15min":0.77500000000000002},"min":{"1min":0.65800000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.98899999999999999,"5min":1.147,"15min":1.181},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79300000000000004,"15min":0.77500000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.54700000000000004},"max":{"1min":0.91900000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.69299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575009,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297796,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074044,"statfs":{"total":96636764160,"available":96331821056,"internally_reserved":0,"allocated":716800,"data_stored":351241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:00:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71299999999999997,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.46800000000000003,"15min":0.36799999999999999},"max":{"1min":0.87,"5min":0.95499999999999996,"15min":9.6289999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73299999999999998},"min":{"1min":0.55000000000000004,"5min":0.48199999999999998,"15min":0.42099999999999999},"max":{"1min":0.878,"5min":0.93400000000000005,"15min":3.403},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Aug 31 19:00:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73099999999999998,"15min":0.82299999999999995},"min":{"1min":0.54000000000000004,"5min":0.48699999999999999,"15min":0.437},"max":{"1min":0.93100000000000005,"5min":1.004,"15min":9.8399999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72899999999999998,"15min":0.82799999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.44900000000000001},"max":{"1min":0.90500000000000003,"5min":0.99299999999999999,"15min":9.7569999999999997},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:00:13 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73099999999999998,"15min":0.81999999999999995},"min":{"1min":0.51700000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88700000000000001,"5min":0.96399999999999997,"15min":9.7840000000000007},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.84499999999999997},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90000000000000002,"5min":0.97199999999999998,"15min":9.7200000000000006},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:00:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.77100000000000002},"min":{"1min":0.55800000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91900000000000004,"5min":0.98599999999999999,"15min":5.133},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.751,"15min":0.88800000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.53200000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":12.589},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:00:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.72899999999999998},"min":{"1min":0.42599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.87,"5min":0.90100000000000002,"15min":9.6780000000000008},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60899999999999999,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.42699999999999999,"15min":0.38300000000000001},"max":{"1min":0.79400000000000004,"5min":0.89000000000000001,"15min":3.3610000000000002},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:00:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63500000000000001,"15min":0.77000000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83199999999999996,"5min":0.96899999999999997,"15min":9.4760000000000009},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.82199999999999995},"min":{"1min":0.50600000000000001,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":0.86099999999999999,"5min":0.95799999999999996,"15min":9.8640000000000008},"last":0.82599999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:00:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67300000000000004,"15min":0.77900000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.38600000000000001},"max":{"1min":0.86899999999999999,"5min":0.91700000000000004,"15min":7.1769999999999996},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70599999999999996,"15min":0.88200000000000001},"min":{"1min":0.48199999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91300000000000003,"5min":1.036,"15min":12.634},"last":0.92900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575009,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":716800,"data_stored":351579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73399999999999999,"15min":0.71099999999999997},"min":{"1min":0.47499999999999998,"5min":0.46800000000000003,"15min":0.40899999999999997},"max":{"1min":0.93400000000000005,"5min":0.97099999999999997,"15min":1.4019999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73799999999999999,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.44500000000000001},"max":{"1min":0.93799999999999994,"5min":1.0600000000000001,"15min":1.629},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72499999999999998,"15min":0.71199999999999997},"min":{"1min":0.56100000000000005,"5min":0.54200000000000004,"15min":0.45700000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.1699999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.747,"15min":0.72299999999999998},"min":{"1min":0.58599999999999997,"5min":0.51000000000000001,"15min":0.46300000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.2989999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72199999999999998,"15min":0.69899999999999995},"min":{"1min":0.52600000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97799999999999998,"5min":0.98299999999999998,"15min":1.004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.45200000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.355},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.73699999999999999},"min":{"1min":0.64500000000000002,"5min":0.51100000000000001,"15min":0.499},"max":{"1min":0.98999999999999999,"5min":1.012,"15min":2.0070000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.73799999999999999,"15min":0.72099999999999997},"min":{"1min":0.57199999999999995,"5min":0.50900000000000001,"15min":0.47799999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.1279999999999999},"last":0.66900000000000004}]},{"osd":4,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61399999999999999,"15min":0.64200000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":0.98399999999999999,"15min":1.6890000000000001},"last":0.754},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.66400000000000003},"min":{"1min":0.42499999999999999,"5min":0.42299999999999999,"15min":0.41499999999999998},"max":{"1min":0.84399999999999997,"5min":0.98099999999999998,"15min":1.306},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65300000000000002},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.39100000000000001},"max":{"1min":0.89700000000000002,"5min":0.97499999999999998,"15min":1.054},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.441},"max":{"1min":0.89300000000000002,"5min":1.0309999999999999,"15min":1.3440000000000001},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70999999999999996,"15min":0.72799999999999998},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97799999999999998,"5min":1.002,"15min":1.5249999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.72099999999999997,"15min":0.73899999999999999},"min":{"1min":0.50700000000000001,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":1.03,"5min":1.03,"15min":1.4890000000000001},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:01:06.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:01:06.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.497+0000 7f1bfdbff700 1 Processor -- start 2023-08-31T19:01:06.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.498+0000 7f1bfdbff700 1 -- start start 2023-08-31T19:01:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.499+0000 7f1bfdbff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1bf80c5510 0x7f1bf8062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.499+0000 7f1bfdbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1bf80c6590 0x7f1bf80c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.499+0000 7f1bfdbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf8063b40 con 0x7f1bf80c5de0 2023-08-31T19:01:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.499+0000 7f1bfdbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf8150a70 con 0x7f1bf80c6590 2023-08-31T19:01:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.499+0000 7f1bfdbff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf8063fd0 con 0x7f1bf80c5510 2023-08-31T19:01:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.499+0000 7f1bf6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1bf80c6590 0x7f1bf80c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.499+0000 7f1bf7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1bf80c5de0 0x7f1bf805e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35224/0 (socket says 172.21.15.72:35224) 2023-08-31T19:01:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.499+0000 7f1bf6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1bf80c6590 0x7f1bf80c58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54302/0 (socket says 172.21.15.72:54302) 2023-08-31T19:01:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.499+0000 7f1bf7fff700 1 -- 172.21.15.72:0/3368733593 learned_addr learned my addr 172.21.15.72:0/3368733593 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:01:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.499+0000 7f1bf77fe700 1 --2- 172.21.15.72:0/3368733593 >> v2:172.21.15.146:3300/0 conn(0x7f1bf80c5510 0x7f1bf8062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.500+0000 7f1bf6ffd700 1 -- 172.21.15.72:0/3368733593 >> v2:172.21.15.146:3300/0 conn(0x7f1bf80c5510 msgr2=0x7f1bf8062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.500+0000 7f1bf6ffd700 1 --2- 172.21.15.72:0/3368733593 >> v2:172.21.15.146:3300/0 conn(0x7f1bf80c5510 0x7f1bf8062650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.500+0000 7f1bf6ffd700 1 -- 172.21.15.72:0/3368733593 >> v1:172.21.15.72:6789/0 conn(0x7f1bf80c5de0 legacy=0x7f1bf805e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.500+0000 7f1bf6ffd700 1 -- 172.21.15.72:0/3368733593 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf8062f30 con 0x7f1bf80c6590 2023-08-31T19:01:06.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.500+0000 7f1bf67fc700 1 -- 172.21.15.72:0/3368733593 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164994382 0 0) 0x7f1bf8063b40 con 0x7f1bf80c5de0 2023-08-31T19:01:06.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.500+0000 7f1bf6ffd700 1 --2- 172.21.15.72:0/3368733593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf80c6590 0x7f1bf80c58f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f1bf8067bf0 tx=0x7f1bec00b300).ready entity=mon.0 client_cookie=425dc6832bb1b58a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:06.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.500+0000 7f1bf67fc700 1 -- 172.21.15.72:0/3368733593 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec00da70 con 0x7f1bf80c6590 2023-08-31T19:01:06.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.500+0000 7f1bf67fc700 1 -- 172.21.15.72:0/3368733593 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec00dbd0 con 0x7f1bf80c6590 2023-08-31T19:01:06.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.500+0000 7f1bf67fc700 1 -- 172.21.15.72:0/3368733593 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec010470 con 0x7f1bf80c6590 2023-08-31T19:01:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.501+0000 7f1bfdbff700 1 -- 172.21.15.72:0/3368733593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf80c6590 msgr2=0x7f1bf80c58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.501+0000 7f1bfdbff700 1 --2- 172.21.15.72:0/3368733593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf80c6590 0x7f1bf80c58f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f1bf8067bf0 tx=0x7f1bec00b300).stop 2023-08-31T19:01:06.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.501+0000 7f1bfdbff700 1 -- 172.21.15.72:0/3368733593 shutdown_connections 2023-08-31T19:01:06.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.501+0000 7f1bfdbff700 1 --2- 172.21.15.72:0/3368733593 >> v2:172.21.15.146:3300/0 conn(0x7f1bf80c5510 0x7f1bf8062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.501+0000 7f1bfdbff700 1 --2- 172.21.15.72:0/3368733593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf80c6590 0x7f1bf80c58f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.501+0000 7f1bfdbff700 1 -- 172.21.15.72:0/3368733593 >> 172.21.15.72:0/3368733593 conn(0x7f1bf80c7e70 msgr2=0x7f1bf80c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:06.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.501+0000 7f1bfdbff700 1 -- 172.21.15.72:0/3368733593 shutdown_connections 2023-08-31T19:01:06.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.501+0000 7f1bfdbff700 1 -- 172.21.15.72:0/3368733593 wait complete. 2023-08-31T19:01:06.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.502+0000 7f1bfdbff700 1 Processor -- start 2023-08-31T19:01:06.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.502+0000 7f1bfdbff700 1 -- start start 2023-08-31T19:01:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.503+0000 7f1bfdbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf80c5510 0x7f1bf813ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.503+0000 7f1bfdbff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bf80c5de0 0x7f1bf80a6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.503+0000 7f1bfdbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bf80c6590 0x7f1bf80ac170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.503+0000 7f1bfdbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf80a83c0 con 0x7f1bf80c5510 2023-08-31T19:01:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.504+0000 7f1bfdbff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf80a77b0 con 0x7f1bf80c5de0 2023-08-31T19:01:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.504+0000 7f1bfdbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf80a7a90 con 0x7f1bf80c6590 2023-08-31T19:01:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.504+0000 7f1bf77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf80c5510 0x7f1bf813ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.504+0000 7f1bf77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf80c5510 0x7f1bf813ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54314/0 (socket says 172.21.15.72:54314) 2023-08-31T19:01:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.504+0000 7f1bf77fe700 1 -- 172.21.15.72:0/3567358960 learned_addr learned my addr 172.21.15.72:0/3567358960 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:06.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.504+0000 7f1bf77fe700 1 -- 172.21.15.72:0/3567358960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bf80c6590 msgr2=0x7f1bf80ac170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.504+0000 7f1bf77fe700 1 --2- 172.21.15.72:0/3567358960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bf80c6590 0x7f1bf80ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:01:06.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.504+0000 7f1bf6ffd700 1 --2- 172.21.15.72:0/3567358960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bf80c5de0 0x7f1bf80a6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.504+0000 7f1bf77fe700 1 -- 172.21.15.72:0/3567358960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bf80c5de0 msgr2=0x7f1bf80a6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.504+0000 7f1bf77fe700 1 --2- 172.21.15.72:0/3567358960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bf80c5de0 0x7f1bf80a6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.504+0000 7f1bf77fe700 1 -- 172.21.15.72:0/3567358960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec00b540 con 0x7f1bf80c5510 2023-08-31T19:01:06.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.504+0000 7f1bf6ffd700 1 --2- 172.21.15.72:0/3567358960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bf80c5de0 0x7f1bf80a6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:01:06.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.504+0000 7f1bf77fe700 1 --2- 172.21.15.72:0/3567358960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf80c5510 0x7f1bf813ee10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f1be800d890 tx=0x7f1be8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:06.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.504+0000 7f1bdf7fe700 1 -- 172.21.15.72:0/3567358960 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be80125f0 con 0x7f1bf80c5510 2023-08-31T19:01:06.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.504+0000 7f1bdf7fe700 1 -- 172.21.15.72:0/3567358960 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be8012750 con 0x7f1bf80c5510 2023-08-31T19:01:06.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.505+0000 7f1bdf7fe700 1 -- 172.21.15.72:0/3567358960 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be8012ad0 con 0x7f1bf80c5510 2023-08-31T19:01:06.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.505+0000 7f1bfdbff700 1 -- 172.21.15.72:0/3567358960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf80a7d70 con 0x7f1bf80c5510 2023-08-31T19:01:06.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.505+0000 7f1bfdbff700 1 -- 172.21.15.72:0/3567358960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf813f300 con 0x7f1bf80c5510 2023-08-31T19:01:06.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.506+0000 7f1bfdbff700 1 -- 172.21.15.72:0/3567358960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf80a86a0 con 0x7f1bf80c5510 2023-08-31T19:01:06.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.506+0000 7f1bdf7fe700 1 -- 172.21.15.72:0/3567358960 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f1be8013480 con 0x7f1bf80c5510 2023-08-31T19:01:06.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.507+0000 7f1bdf7fe700 1 --2- 172.21.15.72:0/3567358960 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1be405ef30 0x7f1be40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.507+0000 7f1bdf7fe700 1 -- 172.21.15.72:0/3567358960 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7f1be8079fe0 con 0x7f1bf80c5510 2023-08-31T19:01:06.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.507+0000 7f1bf6ffd700 1 --2- 172.21.15.72:0/3567358960 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1be405ef30 0x7f1be40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.508+0000 7f1bf6ffd700 1 --2- 172.21.15.72:0/3567358960 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1be405ef30 0x7f1be40613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1bf8167b20 tx=0x7f1bec00b300).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:06.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.511+0000 7f1bdf7fe700 1 -- 172.21.15.72:0/3567358960 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1be804afb0 con 0x7f1bf80c5510 2023-08-31T19:01:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.679+0000 7f1bfdbff700 1 -- 172.21.15.72:0/3567358960 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1bf80a8500 con 0x7f1be405ef30 2023-08-31T19:01:06.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.689+0000 7f1bdf7fe700 1 -- 172.21.15.72:0/3567358960 <== mgr.4997 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361309 (secure 0 0 0) 0x7f1bec00dd40 con 0x7f1be405ef30 2023-08-31T19:01:06.696 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:01:06.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.694+0000 7f1bfdbff700 1 -- 172.21.15.72:0/3567358960 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1be405ef30 msgr2=0x7f1be40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.694+0000 7f1bfdbff700 1 --2- 172.21.15.72:0/3567358960 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1be405ef30 0x7f1be40613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1bf8167b20 tx=0x7f1bec00b300).stop 2023-08-31T19:01:06.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.694+0000 7f1bfdbff700 1 -- 172.21.15.72:0/3567358960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf80c5510 msgr2=0x7f1bf813ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.694+0000 7f1bfdbff700 1 --2- 172.21.15.72:0/3567358960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf80c5510 0x7f1bf813ee10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f1be800d890 tx=0x7f1be8008040).stop 2023-08-31T19:01:06.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.694+0000 7f1bfdbff700 1 -- 172.21.15.72:0/3567358960 shutdown_connections 2023-08-31T19:01:06.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.694+0000 7f1bfdbff700 1 --2- 172.21.15.72:0/3567358960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1bf80c6590 0x7f1bf80ac170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:01:06.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.694+0000 7f1bfdbff700 1 --2- 172.21.15.72:0/3567358960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bf80c5510 0x7f1bf813ee10 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.694+0000 7f1bfdbff700 1 --2- 172.21.15.72:0/3567358960 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1be405ef30 0x7f1be40613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.694+0000 7f1bfdbff700 1 --2- 172.21.15.72:0/3567358960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bf80c5de0 0x7f1bf80a6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.694+0000 7f1bfdbff700 1 -- 172.21.15.72:0/3567358960 >> 172.21.15.72:0/3567358960 conn(0x7f1bf80c7e70 msgr2=0x7f1bf80bc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.694+0000 7f1bfdbff700 1 -- 172.21.15.72:0/3567358960 shutdown_connections 2023-08-31T19:01:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.694+0000 7f1bfdbff700 1 -- 172.21.15.72:0/3567358960 wait complete. 2023-08-31T19:01:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:01:06.711 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-31T19:01:06.058674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":208,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2402916,"kb_used_data":5668,"kb_used_omap":0,"kb_used_meta":2397184,"kb_avail":752571804,"statfs":{"total":773094113280,"available":770633527296,"internally_reserved":0,"allocated":5804032,"data_stored":2831936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2454716416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14991405,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-723,"num_write_kb":-15546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.417795"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012083+0000","last_change":"2023-08-31T19:01:02.008126+0000","last_active":"2023-08-31T19:01:02.012083+0000","last_peered":"2023-08-31T19:01:02.012083+0000","last_clean":"2023-08-31T19:01:02.012083+0000","last_became_active":"2023-08-31T19:01:02.007860+0000","last_became_peered":"2023-08-31T19:01:02.007860+0000","last_unstale":"2023-08-31T19:01:02.012083+0000","last_undegraded":"2023-08-31T19:01:02.012083+0000","last_fullsized":"2023-08-31T19:01:02.012083+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"60'3","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.015208+0000","last_change":"2023-08-31T19:01:01.543895+0000","last_active":"2023-08-31T19:01:02.015208+0000","last_peered":"2023-08-31T19:01:02.015208+0000","last_clean":"2023-08-31T19:01:02.015208+0000","last_became_active":"2023-08-31T19:01:01.543576+0000","last_became_peered":"2023-08-31T19:01:01.543576+0000","last_unstale":"2023-08-31T19:01:02.015208+0000","last_undegraded":"2023-08-31T19:01:02.015208+0000","last_fullsized":"2023-08-31T19:01:02.015208+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.014428+0000","last_change":"2023-08-31T19:01:02.005213+0000","last_active":"2023-08-31T19:01:02.014428+0000","last_peered":"2023-08-31T19:01:02.014428+0000","last_clean":"2023-08-31T19:01:02.014428+0000","last_became_active":"2023-08-31T19:01:02.004847+0000","last_became_peered":"2023-08-31T19:01:02.004847+0000","last_unstale":"2023-08-31T19:01:02.014428+0000","last_undegraded":"2023-08-31T19:01:02.014428+0000","last_fullsized":"2023-08-31T19:01:02.014428+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.551559+0000","last_change":"2023-08-31T19:01:01.550782+0000","last_active":"2023-08-31T19:01:01.551559+0000","last_peered":"2023-08-31T19:01:01.551559+0000","last_clean":"2023-08-31T19:01:01.551559+0000","last_became_active":"2023-08-31T19:01:01.550480+0000","last_became_peered":"2023-08-31T19:01:01.550480+0000","last_unstale":"2023-08-31T19:01:01.551559+0000","last_undegraded":"2023-08-31T19:01:01.551559+0000","last_fullsized":"2023-08-31T19:01:01.551559+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016764+0000","last_change":"2023-08-31T19:01:02.016764+0000","last_active":"2023-08-31T19:01:02.016764+0000","last_peered":"2023-08-31T19:01:02.016764+0000","last_clean":"2023-08-31T19:01:02.016764+0000","last_became_active":"2023-08-31T19:01:02.016204+0000","last_became_peered":"2023-08-31T19:01:02.016204+0000","last_unstale":"2023-08-31T19:01:02.016764+0000","last_undegraded":"2023-08-31T19:01:02.016764+0000","last_fullsized":"2023-08-31T19:01:02.016764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.538093+0000","last_change":"2023-08-31T19:01:01.535412+0000","last_active":"2023-08-31T19:01:01.538093+0000","last_peered":"2023-08-31T19:01:01.538093+0000","last_clean":"2023-08-31T19:01:01.538093+0000","last_became_active":"2023-08-31T19:01:01.535104+0000","last_became_peered":"2023-08-31T19:01:01.535104+0000","last_unstale":"2023-08-31T19:01:01.538093+0000","last_undegraded":"2023-08-31T19:01:01.538093+0000","last_fullsized":"2023-08-31T19:01:01.538093+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016530+0000","last_change":"2023-08-31T19:01:02.014595+0000","last_active":"2023-08-31T19:01:02.016530+0000","last_peered":"2023-08-31T19:01:02.016530+0000","last_clean":"2023-08-31T19:01:02.016530+0000","last_became_active":"2023-08-31T19:01:02.014341+0000","last_became_peered":"2023-08-31T19:01:02.014341+0000","last_unstale":"2023-08-31T19:01:02.016530+0000","last_undegraded":"2023-08-31T19:01:02.016530+0000","last_fullsized":"2023-08-31T19:01:02.016530+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"60'2","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.021360+0000","last_change":"2023-08-31T19:01:01.542317+0000","last_active":"2023-08-31T19:01:02.021360+0000","last_peered":"2023-08-31T19:01:02.021360+0000","last_clean":"2023-08-31T19:01:02.021360+0000","last_became_active":"2023-08-31T19:01:01.542048+0000","last_became_peered":"2023-08-31T19:01:01.542048+0000","last_unstale":"2023-08-31T19:01:02.021360+0000","last_undegraded":"2023-08-31T19:01:02.021360+0000","last_fullsized":"2023-08-31T19:01:02.021360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011782+0000","last_change":"2023-08-31T19:01:02.000679+0000","last_active":"2023-08-31T19:01:02.011782+0000","last_peered":"2023-08-31T19:01:02.011782+0000","last_clean":"2023-08-31T19:01:02.011782+0000","last_became_active":"2023-08-31T19:01:02.000364+0000","last_became_peered":"2023-08-31T19:01:02.000364+0000","last_unstale":"2023-08-31T19:01:02.011782+0000","last_undegraded":"2023-08-31T19:01:02.011782+0000","last_fullsized":"2023-08-31T19:01:02.011782+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"60'1","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.992783+0000","last_change":"2023-08-31T19:01:01.548824+0000","last_active":"2023-08-31T19:01:01.992783+0000","last_peered":"2023-08-31T19:01:01.992783+0000","last_clean":"2023-08-31T19:01:01.992783+0000","last_became_active":"2023-08-31T19:01:01.548507+0000","last_became_peered":"2023-08-31T19:01:01.548507+0000","last_unstale":"2023-08-31T19:01:01.992783+0000","last_undegraded":"2023-08-31T19:01:01.992783+0000","last_fullsized":"2023-08-31T19:01:01.992783+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.021247+0000","last_change":"2023-08-31T19:01:02.019201+0000","last_active":"2023-08-31T19:01:02.021247+0000","last_peered":"2023-08-31T19:01:02.021247+0000","last_clean":"2023-08-31T19:01:02.021247+0000","last_became_active":"2023-08-31T19:01:02.018930+0000","last_became_peered":"2023-08-31T19:01:02.018930+0000","last_unstale":"2023-08-31T19:01:02.021247+0000","last_undegraded":"2023-08-31T19:01:02.021247+0000","last_fullsized":"2023-08-31T19:01:02.021247+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.010366+0000","last_change":"2023-08-31T19:01:01.551167+0000","last_active":"2023-08-31T19:01:02.010366+0000","last_peered":"2023-08-31T19:01:02.010366+0000","last_clean":"2023-08-31T19:01:02.010366+0000","last_became_active":"2023-08-31T19:01:01.550889+0000","last_became_peered":"2023-08-31T19:01:01.550889+0000","last_unstale":"2023-08-31T19:01:02.010366+0000","last_undegraded":"2023-08-31T19:01:02.010366+0000","last_fullsized":"2023-08-31T19:01:02.010366+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.017010+0000","last_change":"2023-08-31T19:01:02.014408+0000","last_active":"2023-08-31T19:01:02.017010+0000","last_peered":"2023-08-31T19:01:02.017010+0000","last_clean":"2023-08-31T19:01:02.017010+0000","last_became_active":"2023-08-31T19:01:02.014162+0000","last_became_peered":"2023-08-31T19:01:02.014162+0000","last_unstale":"2023-08-31T19:01:02.017010+0000","last_undegraded":"2023-08-31T19:01:02.017010+0000","last_fullsized":"2023-08-31T19:01:02.017010+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.998506+0000","last_change":"2023-08-31T19:01:01.548788+0000","last_active":"2023-08-31T19:01:01.998506+0000","last_peered":"2023-08-31T19:01:01.998506+0000","last_clean":"2023-08-31T19:01:01.998506+0000","last_became_active":"2023-08-31T19:01:01.548482+0000","last_became_peered":"2023-08-31T19:01:01.548482+0000","last_unstale":"2023-08-31T19:01:01.998506+0000","last_undegraded":"2023-08-31T19:01:01.998506+0000","last_fullsized":"2023-08-31T19:01:01.998506+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.023003+0000","last_change":"2023-08-31T19:01:02.018395+0000","last_active":"2023-08-31T19:01:02.023003+0000","last_peered":"2023-08-31T19:01:02.023003+0000","last_clean":"2023-08-31T19:01:02.023003+0000","last_became_active":"2023-08-31T19:01:02.018125+0000","last_became_peered":"2023-08-31T19:01:02.018125+0000","last_unstale":"2023-08-31T19:01:02.023003+0000","last_undegraded":"2023-08-31T19:01:02.023003+0000","last_fullsized":"2023-08-31T19:01:02.023003+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.555397+0000","last_change":"2023-08-31T19:01:01.551567+0000","last_active":"2023-08-31T19:01:01.555397+0000","last_peered":"2023-08-31T19:01:01.555397+0000","last_clean":"2023-08-31T19:01:01.555397+0000","last_became_active":"2023-08-31T19:01:01.549719+0000","last_became_peered":"2023-08-31T19:01:01.549719+0000","last_unstale":"2023-08-31T19:01:01.555397+0000","last_undegraded":"2023-08-31T19:01:01.555397+0000","last_fullsized":"2023-08-31T19:01:01.555397+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018633+0000","last_change":"2023-08-31T19:01:02.010351+0000","last_active":"2023-08-31T19:01:02.018633+0000","last_peered":"2023-08-31T19:01:02.018633+0000","last_clean":"2023-08-31T19:01:02.018633+0000","last_became_active":"2023-08-31T19:01:02.010003+0000","last_became_peered":"2023-08-31T19:01:02.010003+0000","last_unstale":"2023-08-31T19:01:02.018633+0000","last_undegraded":"2023-08-31T19:01:02.018633+0000","last_fullsized":"2023-08-31T19:01:02.018633+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.547802+0000","last_change":"2023-08-31T19:01:01.534995+0000","last_active":"2023-08-31T19:01:01.547802+0000","last_peered":"2023-08-31T19:01:01.547802+0000","last_clean":"2023-08-31T19:01:01.547802+0000","last_became_active":"2023-08-31T19:01:01.534730+0000","last_became_peered":"2023-08-31T19:01:01.534730+0000","last_unstale":"2023-08-31T19:01:01.547802+0000","last_undegraded":"2023-08-31T19:01:01.547802+0000","last_fullsized":"2023-08-31T19:01:01.547802+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.005708+0000","last_change":"2023-08-31T19:01:02.005708+0000","last_active":"2023-08-31T19:01:02.005708+0000","last_peered":"2023-08-31T19:01:02.005708+0000","last_clean":"2023-08-31T19:01:02.005708+0000","last_became_active":"2023-08-31T19:01:02.005293+0000","last_became_peered":"2023-08-31T19:01:02.005293+0000","last_unstale":"2023-08-31T19:01:02.005708+0000","last_undegraded":"2023-08-31T19:01:02.005708+0000","last_fullsized":"2023-08-31T19:01:02.005708+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.549339+0000","last_change":"2023-08-31T19:01:01.542603+0000","last_active":"2023-08-31T19:01:01.549339+0000","last_peered":"2023-08-31T19:01:01.549339+0000","last_clean":"2023-08-31T19:01:01.549339+0000","last_became_active":"2023-08-31T19:01:01.542295+0000","last_became_peered":"2023-08-31T19:01:01.542295+0000","last_unstale":"2023-08-31T19:01:01.549339+0000","last_undegraded":"2023-08-31T19:01:01.549339+0000","last_fullsized":"2023-08-31T19:01:01.549339+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.022487+0000","last_change":"2023-08-31T19:01:02.015997+0000","last_active":"2023-08-31T19:01:02.022487+0000","last_peered":"2023-08-31T19:01:02.022487+0000","last_clean":"2023-08-31T19:01:02.022487+0000","last_became_active":"2023-08-31T19:01:02.015697+0000","last_became_peered":"2023-08-31T19:01:02.015697+0000","last_unstale":"2023-08-31T19:01:02.022487+0000","last_undegraded":"2023-08-31T19:01:02.022487+0000","last_fullsized":"2023-08-31T19:01:02.022487+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.548982+0000","last_change":"2023-08-31T19:01:01.546013+0000","last_active":"2023-08-31T19:01:01.548982+0000","last_peered":"2023-08-31T19:01:01.548982+0000","last_clean":"2023-08-31T19:01:01.548982+0000","last_became_active":"2023-08-31T19:01:01.542791+0000","last_became_peered":"2023-08-31T19:01:01.542791+0000","last_unstale":"2023-08-31T19:01:01.548982+0000","last_undegraded":"2023-08-31T19:01:01.548982+0000","last_fullsized":"2023-08-31T19:01:01.548982+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.008018+0000","last_change":"2023-08-31T19:01:02.008018+0000","last_active":"2023-08-31T19:01:02.008018+0000","last_peered":"2023-08-31T19:01:02.008018+0000","last_clean":"2023-08-31T19:01:02.008018+0000","last_became_active":"2023-08-31T19:01:02.007640+0000","last_became_peered":"2023-08-31T19:01:02.007640+0000","last_unstale":"2023-08-31T19:01:02.008018+0000","last_undegraded":"2023-08-31T19:01:02.008018+0000","last_fullsized":"2023-08-31T19:01:02.008018+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"60'4","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.009527+0000","last_change":"2023-08-31T19:01:01.546579+0000","last_active":"2023-08-31T19:01:02.009527+0000","last_peered":"2023-08-31T19:01:02.009527+0000","last_clean":"2023-08-31T19:01:02.009527+0000","last_became_active":"2023-08-31T19:01:01.546283+0000","last_became_peered":"2023-08-31T19:01:01.546283+0000","last_unstale":"2023-08-31T19:01:02.009527+0000","last_undegraded":"2023-08-31T19:01:02.009527+0000","last_fullsized":"2023-08-31T19:01:02.009527+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018076+0000","last_change":"2023-08-31T19:01:02.014924+0000","last_active":"2023-08-31T19:01:02.018076+0000","last_peered":"2023-08-31T19:01:02.018076+0000","last_clean":"2023-08-31T19:01:02.018076+0000","last_became_active":"2023-08-31T19:01:02.014559+0000","last_became_peered":"2023-08-31T19:01:02.014559+0000","last_unstale":"2023-08-31T19:01:02.018076+0000","last_undegraded":"2023-08-31T19:01:02.018076+0000","last_fullsized":"2023-08-31T19:01:02.018076+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016249+0000","last_change":"2023-08-31T19:01:01.555453+0000","last_active":"2023-08-31T19:01:02.016249+0000","last_peered":"2023-08-31T19:01:02.016249+0000","last_clean":"2023-08-31T19:01:02.016249+0000","last_became_active":"2023-08-31T19:01:01.554959+0000","last_became_peered":"2023-08-31T19:01:01.554959+0000","last_unstale":"2023-08-31T19:01:02.016249+0000","last_undegraded":"2023-08-31T19:01:02.016249+0000","last_fullsized":"2023-08-31T19:01:02.016249+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.014448+0000","last_change":"2023-08-31T19:01:02.014448+0000","last_active":"2023-08-31T19:01:02.014448+0000","last_peered":"2023-08-31T19:01:02.014448+0000","last_clean":"2023-08-31T19:01:02.014448+0000","last_became_active":"2023-08-31T19:01:02.014196+0000","last_became_peered":"2023-08-31T19:01:02.014196+0000","last_unstale":"2023-08-31T19:01:02.014448+0000","last_undegraded":"2023-08-31T19:01:02.014448+0000","last_fullsized":"2023-08-31T19:01:02.014448+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.545061+0000","last_change":"2023-08-31T19:01:01.534659+0000","last_active":"2023-08-31T19:01:01.545061+0000","last_peered":"2023-08-31T19:01:01.545061+0000","last_clean":"2023-08-31T19:01:01.545061+0000","last_became_active":"2023-08-31T19:01:01.534378+0000","last_became_peered":"2023-08-31T19:01:01.534378+0000","last_unstale":"2023-08-31T19:01:01.545061+0000","last_undegraded":"2023-08-31T19:01:01.545061+0000","last_fullsized":"2023-08-31T19:01:01.545061+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018049+0000","last_change":"2023-08-31T19:01:02.014668+0000","last_active":"2023-08-31T19:01:02.018049+0000","last_peered":"2023-08-31T19:01:02.018049+0000","last_clean":"2023-08-31T19:01:02.018049+0000","last_became_active":"2023-08-31T19:01:02.014316+0000","last_became_peered":"2023-08-31T19:01:02.014316+0000","last_unstale":"2023-08-31T19:01:02.018049+0000","last_undegraded":"2023-08-31T19:01:02.018049+0000","last_fullsized":"2023-08-31T19:01:02.018049+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.989773+0000","last_change":"2023-08-31T19:01:01.551057+0000","last_active":"2023-08-31T19:01:01.989773+0000","last_peered":"2023-08-31T19:01:01.989773+0000","last_clean":"2023-08-31T19:01:01.989773+0000","last_became_active":"2023-08-31T19:01:01.550461+0000","last_became_peered":"2023-08-31T19:01:01.550461+0000","last_unstale":"2023-08-31T19:01:01.989773+0000","last_undegraded":"2023-08-31T19:01:01.989773+0000","last_fullsized":"2023-08-31T19:01:01.989773+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.013705+0000","last_change":"2023-08-31T19:01:02.011341+0000","last_active":"2023-08-31T19:01:02.013705+0000","last_peered":"2023-08-31T19:01:02.013705+0000","last_clean":"2023-08-31T19:01:02.013705+0000","last_became_active":"2023-08-31T19:01:02.011024+0000","last_became_peered":"2023-08-31T19:01:02.011024+0000","last_unstale":"2023-08-31T19:01:02.013705+0000","last_undegraded":"2023-08-31T19:01:02.013705+0000","last_fullsized":"2023-08-31T19:01:02.013705+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.023228+0000","last_change":"2023-08-31T19:01:01.543430+0000","last_active":"2023-08-31T19:01:02.023228+0000","last_peered":"2023-08-31T19:01:02.023228+0000","last_clean":"2023-08-31T19:01:02.023228+0000","last_became_active":"2023-08-31T19:01:01.542999+0000","last_became_peered":"2023-08-31T19:01:01.542999+0000","last_unstale":"2023-08-31T19:01:02.023228+0000","last_undegraded":"2023-08-31T19:01:02.023228+0000","last_fullsized":"2023-08-31T19:01:02.023228+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012380+0000","last_change":"2023-08-31T19:01:02.012380+0000","last_active":"2023-08-31T19:01:02.012380+0000","last_peered":"2023-08-31T19:01:02.012380+0000","last_clean":"2023-08-31T19:01:02.012380+0000","last_became_active":"2023-08-31T19:01:02.012053+0000","last_became_peered":"2023-08-31T19:01:02.012053+0000","last_unstale":"2023-08-31T19:01:02.012380+0000","last_undegraded":"2023-08-31T19:01:02.012380+0000","last_fullsized":"2023-08-31T19:01:02.012380+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.544176+0000","last_change":"2023-08-31T19:01:01.539417+0000","last_active":"2023-08-31T19:01:01.544176+0000","last_peered":"2023-08-31T19:01:01.544176+0000","last_clean":"2023-08-31T19:01:01.544176+0000","last_became_active":"2023-08-31T19:01:01.539153+0000","last_became_peered":"2023-08-31T19:01:01.539153+0000","last_unstale":"2023-08-31T19:01:01.544176+0000","last_undegraded":"2023-08-31T19:01:01.544176+0000","last_fullsized":"2023-08-31T19:01:01.544176+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.005543+0000","last_change":"2023-08-31T19:01:02.005543+0000","last_active":"2023-08-31T19:01:02.005543+0000","last_peered":"2023-08-31T19:01:02.005543+0000","last_clean":"2023-08-31T19:01:02.005543+0000","last_became_active":"2023-08-31T19:01:02.004943+0000","last_became_peered":"2023-08-31T19:01:02.004943+0000","last_unstale":"2023-08-31T19:01:02.005543+0000","last_undegraded":"2023-08-31T19:01:02.005543+0000","last_fullsized":"2023-08-31T19:01:02.005543+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.545000+0000","last_change":"2023-08-31T19:01:01.540866+0000","last_active":"2023-08-31T19:01:01.545000+0000","last_peered":"2023-08-31T19:01:01.545000+0000","last_clean":"2023-08-31T19:01:01.545000+0000","last_became_active":"2023-08-31T19:01:01.540598+0000","last_became_peered":"2023-08-31T19:01:01.540598+0000","last_unstale":"2023-08-31T19:01:01.545000+0000","last_undegraded":"2023-08-31T19:01:01.545000+0000","last_fullsized":"2023-08-31T19:01:01.545000+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016261+0000","last_change":"2023-08-31T19:01:02.012849+0000","last_active":"2023-08-31T19:01:02.016261+0000","last_peered":"2023-08-31T19:01:02.016261+0000","last_clean":"2023-08-31T19:01:02.016261+0000","last_became_active":"2023-08-31T19:01:02.012527+0000","last_became_peered":"2023-08-31T19:01:02.012527+0000","last_unstale":"2023-08-31T19:01:02.016261+0000","last_undegraded":"2023-08-31T19:01:02.016261+0000","last_fullsized":"2023-08-31T19:01:02.016261+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.022848+0000","last_change":"2023-08-31T19:01:01.548878+0000","last_active":"2023-08-31T19:01:02.022848+0000","last_peered":"2023-08-31T19:01:02.022848+0000","last_clean":"2023-08-31T19:01:02.022848+0000","last_became_active":"2023-08-31T19:01:01.548558+0000","last_became_peered":"2023-08-31T19:01:01.548558+0000","last_unstale":"2023-08-31T19:01:02.022848+0000","last_undegraded":"2023-08-31T19:01:02.022848+0000","last_fullsized":"2023-08-31T19:01:02.022848+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.001302+0000","last_change":"2023-08-31T19:01:02.001302+0000","last_active":"2023-08-31T19:01:02.001302+0000","last_peered":"2023-08-31T19:01:02.001302+0000","last_clean":"2023-08-31T19:01:02.001302+0000","last_became_active":"2023-08-31T19:01:02.001004+0000","last_became_peered":"2023-08-31T19:01:02.001004+0000","last_unstale":"2023-08-31T19:01:02.001302+0000","last_undegraded":"2023-08-31T19:01:02.001302+0000","last_fullsized":"2023-08-31T19:01:02.001302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.006227+0000","last_change":"2023-08-31T19:01:01.538223+0000","last_active":"2023-08-31T19:01:02.006227+0000","last_peered":"2023-08-31T19:01:02.006227+0000","last_clean":"2023-08-31T19:01:02.006227+0000","last_became_active":"2023-08-31T19:01:01.537936+0000","last_became_peered":"2023-08-31T19:01:01.537936+0000","last_unstale":"2023-08-31T19:01:02.006227+0000","last_undegraded":"2023-08-31T19:01:02.006227+0000","last_fullsized":"2023-08-31T19:01:02.006227+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011434+0000","last_change":"2023-08-31T19:01:02.003513+0000","last_active":"2023-08-31T19:01:02.011434+0000","last_peered":"2023-08-31T19:01:02.011434+0000","last_clean":"2023-08-31T19:01:02.011434+0000","last_became_active":"2023-08-31T19:01:02.003213+0000","last_became_peered":"2023-08-31T19:01:02.003213+0000","last_unstale":"2023-08-31T19:01:02.011434+0000","last_undegraded":"2023-08-31T19:01:02.011434+0000","last_fullsized":"2023-08-31T19:01:02.011434+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.017748+0000","last_change":"2023-08-31T19:01:01.553038+0000","last_active":"2023-08-31T19:01:02.017748+0000","last_peered":"2023-08-31T19:01:02.017748+0000","last_clean":"2023-08-31T19:01:02.017748+0000","last_became_active":"2023-08-31T19:01:01.552773+0000","last_became_peered":"2023-08-31T19:01:01.552773+0000","last_unstale":"2023-08-31T19:01:02.017748+0000","last_undegraded":"2023-08-31T19:01:02.017748+0000","last_fullsized":"2023-08-31T19:01:02.017748+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.024693+0000","last_change":"2023-08-31T19:01:02.021051+0000","last_active":"2023-08-31T19:01:02.024693+0000","last_peered":"2023-08-31T19:01:02.024693+0000","last_clean":"2023-08-31T19:01:02.024693+0000","last_became_active":"2023-08-31T19:01:02.020810+0000","last_became_peered":"2023-08-31T19:01:02.020810+0000","last_unstale":"2023-08-31T19:01:02.024693+0000","last_undegraded":"2023-08-31T19:01:02.024693+0000","last_fullsized":"2023-08-31T19:01:02.024693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.549278+0000","last_change":"2023-08-31T19:01:01.545193+0000","last_active":"2023-08-31T19:01:01.549278+0000","last_peered":"2023-08-31T19:01:01.549278+0000","last_clean":"2023-08-31T19:01:01.549278+0000","last_became_active":"2023-08-31T19:01:01.542977+0000","last_became_peered":"2023-08-31T19:01:01.542977+0000","last_unstale":"2023-08-31T19:01:01.549278+0000","last_undegraded":"2023-08-31T19:01:01.549278+0000","last_fullsized":"2023-08-31T19:01:01.549278+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012015+0000","last_change":"2023-08-31T19:01:02.005777+0000","last_active":"2023-08-31T19:01:02.012015+0000","last_peered":"2023-08-31T19:01:02.012015+0000","last_clean":"2023-08-31T19:01:02.012015+0000","last_became_active":"2023-08-31T19:01:02.004459+0000","last_became_peered":"2023-08-31T19:01:02.004459+0000","last_unstale":"2023-08-31T19:01:02.012015+0000","last_undegraded":"2023-08-31T19:01:02.012015+0000","last_fullsized":"2023-08-31T19:01:02.012015+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.991741+0000","last_change":"2023-08-31T19:01:01.545166+0000","last_active":"2023-08-31T19:01:01.991741+0000","last_peered":"2023-08-31T19:01:01.991741+0000","last_clean":"2023-08-31T19:01:01.991741+0000","last_became_active":"2023-08-31T19:01:01.544642+0000","last_became_peered":"2023-08-31T19:01:01.544642+0000","last_unstale":"2023-08-31T19:01:01.991741+0000","last_undegraded":"2023-08-31T19:01:01.991741+0000","last_fullsized":"2023-08-31T19:01:01.991741+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.009385+0000","last_change":"2023-08-31T19:01:02.009385+0000","last_active":"2023-08-31T19:01:02.009385+0000","last_peered":"2023-08-31T19:01:02.009385+0000","last_clean":"2023-08-31T19:01:02.009385+0000","last_became_active":"2023-08-31T19:01:02.008894+0000","last_became_peered":"2023-08-31T19:01:02.008894+0000","last_unstale":"2023-08-31T19:01:02.009385+0000","last_undegraded":"2023-08-31T19:01:02.009385+0000","last_fullsized":"2023-08-31T19:01:02.009385+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.991416+0000","last_change":"2023-08-31T19:01:01.543646+0000","last_active":"2023-08-31T19:01:01.991416+0000","last_peered":"2023-08-31T19:01:01.991416+0000","last_clean":"2023-08-31T19:01:01.991416+0000","last_became_active":"2023-08-31T19:01:01.543335+0000","last_became_peered":"2023-08-31T19:01:01.543335+0000","last_unstale":"2023-08-31T19:01:01.991416+0000","last_undegraded":"2023-08-31T19:01:01.991416+0000","last_fullsized":"2023-08-31T19:01:01.991416+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.006657+0000","last_change":"2023-08-31T19:01:02.006657+0000","last_active":"2023-08-31T19:01:02.006657+0000","last_peered":"2023-08-31T19:01:02.006657+0000","last_clean":"2023-08-31T19:01:02.006657+0000","last_became_active":"2023-08-31T19:01:02.006392+0000","last_became_peered":"2023-08-31T19:01:02.006392+0000","last_unstale":"2023-08-31T19:01:02.006657+0000","last_undegraded":"2023-08-31T19:01:02.006657+0000","last_fullsized":"2023-08-31T19:01:02.006657+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.991444+0000","last_change":"2023-08-31T19:01:01.541614+0000","last_active":"2023-08-31T19:01:01.991444+0000","last_peered":"2023-08-31T19:01:01.991444+0000","last_clean":"2023-08-31T19:01:01.991444+0000","last_became_active":"2023-08-31T19:01:01.541338+0000","last_became_peered":"2023-08-31T19:01:01.541338+0000","last_unstale":"2023-08-31T19:01:01.991444+0000","last_undegraded":"2023-08-31T19:01:01.991444+0000","last_fullsized":"2023-08-31T19:01:01.991444+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.009879+0000","last_change":"2023-08-31T19:01:02.005291+0000","last_active":"2023-08-31T19:01:02.009879+0000","last_peered":"2023-08-31T19:01:02.009879+0000","last_clean":"2023-08-31T19:01:02.009879+0000","last_became_active":"2023-08-31T19:01:02.005035+0000","last_became_peered":"2023-08-31T19:01:02.005035+0000","last_unstale":"2023-08-31T19:01:02.009879+0000","last_undegraded":"2023-08-31T19:01:02.009879+0000","last_fullsized":"2023-08-31T19:01:02.009879+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.006041+0000","last_change":"2023-08-31T19:01:01.548299+0000","last_active":"2023-08-31T19:01:02.006041+0000","last_peered":"2023-08-31T19:01:02.006041+0000","last_clean":"2023-08-31T19:01:02.006041+0000","last_became_active":"2023-08-31T19:01:01.547969+0000","last_became_peered":"2023-08-31T19:01:01.547969+0000","last_unstale":"2023-08-31T19:01:02.006041+0000","last_undegraded":"2023-08-31T19:01:02.006041+0000","last_fullsized":"2023-08-31T19:01:02.006041+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.022940+0000","last_change":"2023-08-31T19:01:02.018577+0000","last_active":"2023-08-31T19:01:02.022940+0000","last_peered":"2023-08-31T19:01:02.022940+0000","last_clean":"2023-08-31T19:01:02.022940+0000","last_became_active":"2023-08-31T19:01:02.018242+0000","last_became_peered":"2023-08-31T19:01:02.018242+0000","last_unstale":"2023-08-31T19:01:02.022940+0000","last_undegraded":"2023-08-31T19:01:02.022940+0000","last_fullsized":"2023-08-31T19:01:02.022940+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.541850+0000","last_change":"2023-08-31T19:01:01.538839+0000","last_active":"2023-08-31T19:01:01.541850+0000","last_peered":"2023-08-31T19:01:01.541850+0000","last_clean":"2023-08-31T19:01:01.541850+0000","last_became_active":"2023-08-31T19:01:01.538580+0000","last_became_peered":"2023-08-31T19:01:01.538580+0000","last_unstale":"2023-08-31T19:01:01.541850+0000","last_undegraded":"2023-08-31T19:01:01.541850+0000","last_fullsized":"2023-08-31T19:01:01.541850+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016959+0000","last_change":"2023-08-31T19:01:02.007483+0000","last_active":"2023-08-31T19:01:02.016959+0000","last_peered":"2023-08-31T19:01:02.016959+0000","last_clean":"2023-08-31T19:01:02.016959+0000","last_became_active":"2023-08-31T19:01:02.006868+0000","last_became_peered":"2023-08-31T19:01:02.006868+0000","last_unstale":"2023-08-31T19:01:02.016959+0000","last_undegraded":"2023-08-31T19:01:02.016959+0000","last_fullsized":"2023-08-31T19:01:02.016959+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.548215+0000","last_change":"2023-08-31T19:01:01.546417+0000","last_active":"2023-08-31T19:01:01.548215+0000","last_peered":"2023-08-31T19:01:01.548215+0000","last_clean":"2023-08-31T19:01:01.548215+0000","last_became_active":"2023-08-31T19:01:01.546135+0000","last_became_peered":"2023-08-31T19:01:01.546135+0000","last_unstale":"2023-08-31T19:01:01.548215+0000","last_undegraded":"2023-08-31T19:01:01.548215+0000","last_fullsized":"2023-08-31T19:01:01.548215+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.004174+0000","last_change":"2023-08-31T19:01:02.001494+0000","last_active":"2023-08-31T19:01:02.004174+0000","last_peered":"2023-08-31T19:01:02.004174+0000","last_clean":"2023-08-31T19:01:02.004174+0000","last_became_active":"2023-08-31T19:01:02.001180+0000","last_became_peered":"2023-08-31T19:01:02.001180+0000","last_unstale":"2023-08-31T19:01:02.004174+0000","last_undegraded":"2023-08-31T19:01:02.004174+0000","last_fullsized":"2023-08-31T19:01:02.004174+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.992361+0000","last_change":"2023-08-31T19:01:01.543191+0000","last_active":"2023-08-31T19:01:01.992361+0000","last_peered":"2023-08-31T19:01:01.992361+0000","last_clean":"2023-08-31T19:01:01.992361+0000","last_became_active":"2023-08-31T19:01:01.542918+0000","last_became_peered":"2023-08-31T19:01:01.542918+0000","last_unstale":"2023-08-31T19:01:01.992361+0000","last_undegraded":"2023-08-31T19:01:01.992361+0000","last_fullsized":"2023-08-31T19:01:01.992361+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011944+0000","last_change":"2023-08-31T19:01:02.011944+0000","last_active":"2023-08-31T19:01:02.011944+0000","last_peered":"2023-08-31T19:01:02.011944+0000","last_clean":"2023-08-31T19:01:02.011944+0000","last_became_active":"2023-08-31T19:01:02.011294+0000","last_became_peered":"2023-08-31T19:01:02.011294+0000","last_unstale":"2023-08-31T19:01:02.011944+0000","last_undegraded":"2023-08-31T19:01:02.011944+0000","last_fullsized":"2023-08-31T19:01:02.011944+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.547003+0000","last_change":"2023-08-31T19:01:01.544765+0000","last_active":"2023-08-31T19:01:01.547003+0000","last_peered":"2023-08-31T19:01:01.547003+0000","last_clean":"2023-08-31T19:01:01.547003+0000","last_became_active":"2023-08-31T19:01:01.544438+0000","last_became_peered":"2023-08-31T19:01:01.544438+0000","last_unstale":"2023-08-31T19:01:01.547003+0000","last_undegraded":"2023-08-31T19:01:01.547003+0000","last_fullsized":"2023-08-31T19:01:01.547003+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018067+0000","last_change":"2023-08-31T19:01:02.014706+0000","last_active":"2023-08-31T19:01:02.018067+0000","last_peered":"2023-08-31T19:01:02.018067+0000","last_clean":"2023-08-31T19:01:02.018067+0000","last_became_active":"2023-08-31T19:01:02.014354+0000","last_became_peered":"2023-08-31T19:01:02.014354+0000","last_unstale":"2023-08-31T19:01:02.018067+0000","last_undegraded":"2023-08-31T19:01:02.018067+0000","last_fullsized":"2023-08-31T19:01:02.018067+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.989674+0000","last_change":"2023-08-31T19:01:01.551230+0000","last_active":"2023-08-31T19:01:01.989674+0000","last_peered":"2023-08-31T19:01:01.989674+0000","last_clean":"2023-08-31T19:01:01.989674+0000","last_became_active":"2023-08-31T19:01:01.550749+0000","last_became_peered":"2023-08-31T19:01:01.550749+0000","last_unstale":"2023-08-31T19:01:01.989674+0000","last_undegraded":"2023-08-31T19:01:01.989674+0000","last_fullsized":"2023-08-31T19:01:01.989674+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.009171+0000","last_change":"2023-08-31T19:01:02.009171+0000","last_active":"2023-08-31T19:01:02.009171+0000","last_peered":"2023-08-31T19:01:02.009171+0000","last_clean":"2023-08-31T19:01:02.009171+0000","last_became_active":"2023-08-31T19:01:02.008591+0000","last_became_peered":"2023-08-31T19:01:02.008591+0000","last_unstale":"2023-08-31T19:01:02.009171+0000","last_undegraded":"2023-08-31T19:01:02.009171+0000","last_fullsized":"2023-08-31T19:01:02.009171+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.005587+0000","last_change":"2023-08-31T19:01:01.538096+0000","last_active":"2023-08-31T19:01:02.005587+0000","last_peered":"2023-08-31T19:01:02.005587+0000","last_clean":"2023-08-31T19:01:02.005587+0000","last_became_active":"2023-08-31T19:01:01.537817+0000","last_became_peered":"2023-08-31T19:01:01.537817+0000","last_unstale":"2023-08-31T19:01:02.005587+0000","last_undegraded":"2023-08-31T19:01:02.005587+0000","last_fullsized":"2023-08-31T19:01:02.005587+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018042+0000","last_change":"2023-08-31T19:01:02.014363+0000","last_active":"2023-08-31T19:01:02.018042+0000","last_peered":"2023-08-31T19:01:02.018042+0000","last_clean":"2023-08-31T19:01:02.018042+0000","last_became_active":"2023-08-31T19:01:02.014062+0000","last_became_peered":"2023-08-31T19:01:02.014062+0000","last_unstale":"2023-08-31T19:01:02.018042+0000","last_undegraded":"2023-08-31T19:01:02.018042+0000","last_fullsized":"2023-08-31T19:01:02.018042+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.017023+0000","last_change":"2023-08-31T19:01:01.536662+0000","last_active":"2023-08-31T19:01:02.017023+0000","last_peered":"2023-08-31T19:01:02.017023+0000","last_clean":"2023-08-31T19:01:02.017023+0000","last_became_active":"2023-08-31T19:01:01.536373+0000","last_became_peered":"2023-08-31T19:01:01.536373+0000","last_unstale":"2023-08-31T19:01:02.017023+0000","last_undegraded":"2023-08-31T19:01:02.017023+0000","last_fullsized":"2023-08-31T19:01:02.017023+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.005725+0000","last_change":"2023-08-31T19:01:02.005725+0000","last_active":"2023-08-31T19:01:02.005725+0000","last_peered":"2023-08-31T19:01:02.005725+0000","last_clean":"2023-08-31T19:01:02.005725+0000","last_became_active":"2023-08-31T19:01:02.005389+0000","last_became_peered":"2023-08-31T19:01:02.005389+0000","last_unstale":"2023-08-31T19:01:02.005725+0000","last_undegraded":"2023-08-31T19:01:02.005725+0000","last_fullsized":"2023-08-31T19:01:02.005725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.014625+0000","last_change":"2023-08-31T19:01:01.552789+0000","last_active":"2023-08-31T19:01:02.014625+0000","last_peered":"2023-08-31T19:01:02.014625+0000","last_clean":"2023-08-31T19:01:02.014625+0000","last_became_active":"2023-08-31T19:01:01.552446+0000","last_became_peered":"2023-08-31T19:01:01.552446+0000","last_unstale":"2023-08-31T19:01:02.014625+0000","last_undegraded":"2023-08-31T19:01:02.014625+0000","last_fullsized":"2023-08-31T19:01:02.014625+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.013764+0000","last_change":"2023-08-31T19:01:02.005574+0000","last_active":"2023-08-31T19:01:02.013764+0000","last_peered":"2023-08-31T19:01:02.013764+0000","last_clean":"2023-08-31T19:01:02.013764+0000","last_became_active":"2023-08-31T19:01:02.005275+0000","last_became_peered":"2023-08-31T19:01:02.005275+0000","last_unstale":"2023-08-31T19:01:02.013764+0000","last_undegraded":"2023-08-31T19:01:02.013764+0000","last_fullsized":"2023-08-31T19:01:02.013764+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.022463+0000","last_change":"2023-08-31T19:01:01.541213+0000","last_active":"2023-08-31T19:01:02.022463+0000","last_peered":"2023-08-31T19:01:02.022463+0000","last_clean":"2023-08-31T19:01:02.022463+0000","last_became_active":"2023-08-31T19:01:01.540896+0000","last_became_peered":"2023-08-31T19:01:01.540896+0000","last_unstale":"2023-08-31T19:01:02.022463+0000","last_undegraded":"2023-08-31T19:01:02.022463+0000","last_fullsized":"2023-08-31T19:01:02.022463+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.013959+0000","last_change":"2023-08-31T19:01:02.005142+0000","last_active":"2023-08-31T19:01:02.013959+0000","last_peered":"2023-08-31T19:01:02.013959+0000","last_clean":"2023-08-31T19:01:02.013959+0000","last_became_active":"2023-08-31T19:01:02.004785+0000","last_became_peered":"2023-08-31T19:01:02.004785+0000","last_unstale":"2023-08-31T19:01:02.013959+0000","last_undegraded":"2023-08-31T19:01:02.013959+0000","last_fullsized":"2023-08-31T19:01:02.013959+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.555164+0000","last_change":"2023-08-31T19:01:01.554167+0000","last_active":"2023-08-31T19:01:01.555164+0000","last_peered":"2023-08-31T19:01:01.555164+0000","last_clean":"2023-08-31T19:01:01.555164+0000","last_became_active":"2023-08-31T19:01:01.553890+0000","last_became_peered":"2023-08-31T19:01:01.553890+0000","last_unstale":"2023-08-31T19:01:01.555164+0000","last_undegraded":"2023-08-31T19:01:01.555164+0000","last_fullsized":"2023-08-31T19:01:01.555164+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.019096+0000","last_change":"2023-08-31T19:01:02.019096+0000","last_active":"2023-08-31T19:01:02.019096+0000","last_peered":"2023-08-31T19:01:02.019096+0000","last_clean":"2023-08-31T19:01:02.019096+0000","last_became_active":"2023-08-31T19:01:02.018739+0000","last_became_peered":"2023-08-31T19:01:02.018739+0000","last_unstale":"2023-08-31T19:01:02.019096+0000","last_undegraded":"2023-08-31T19:01:02.019096+0000","last_fullsized":"2023-08-31T19:01:02.019096+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.547954+0000","last_change":"2023-08-31T19:01:01.537056+0000","last_active":"2023-08-31T19:01:01.547954+0000","last_peered":"2023-08-31T19:01:01.547954+0000","last_clean":"2023-08-31T19:01:01.547954+0000","last_became_active":"2023-08-31T19:01:01.536760+0000","last_became_peered":"2023-08-31T19:01:01.536760+0000","last_unstale":"2023-08-31T19:01:01.547954+0000","last_undegraded":"2023-08-31T19:01:01.547954+0000","last_fullsized":"2023-08-31T19:01:01.547954+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016366+0000","last_change":"2023-08-31T19:01:02.013771+0000","last_active":"2023-08-31T19:01:02.016366+0000","last_peered":"2023-08-31T19:01:02.016366+0000","last_clean":"2023-08-31T19:01:02.016366+0000","last_became_active":"2023-08-31T19:01:02.011039+0000","last_became_peered":"2023-08-31T19:01:02.011039+0000","last_unstale":"2023-08-31T19:01:02.016366+0000","last_undegraded":"2023-08-31T19:01:02.016366+0000","last_fullsized":"2023-08-31T19:01:02.016366+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.542223+0000","last_change":"2023-08-31T19:01:01.538485+0000","last_active":"2023-08-31T19:01:01.542223+0000","last_peered":"2023-08-31T19:01:01.542223+0000","last_clean":"2023-08-31T19:01:01.542223+0000","last_became_active":"2023-08-31T19:01:01.538218+0000","last_became_peered":"2023-08-31T19:01:01.538218+0000","last_unstale":"2023-08-31T19:01:01.542223+0000","last_undegraded":"2023-08-31T19:01:01.542223+0000","last_fullsized":"2023-08-31T19:01:01.542223+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011968+0000","last_change":"2023-08-31T19:01:02.005308+0000","last_active":"2023-08-31T19:01:02.011968+0000","last_peered":"2023-08-31T19:01:02.011968+0000","last_clean":"2023-08-31T19:01:02.011968+0000","last_became_active":"2023-08-31T19:01:02.004370+0000","last_became_peered":"2023-08-31T19:01:02.004370+0000","last_unstale":"2023-08-31T19:01:02.011968+0000","last_undegraded":"2023-08-31T19:01:02.011968+0000","last_fullsized":"2023-08-31T19:01:02.011968+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.991858+0000","last_change":"2023-08-31T19:01:01.544949+0000","last_active":"2023-08-31T19:01:01.991858+0000","last_peered":"2023-08-31T19:01:01.991858+0000","last_clean":"2023-08-31T19:01:01.991858+0000","last_became_active":"2023-08-31T19:01:01.544234+0000","last_became_peered":"2023-08-31T19:01:01.544234+0000","last_unstale":"2023-08-31T19:01:01.991858+0000","last_undegraded":"2023-08-31T19:01:01.991858+0000","last_fullsized":"2023-08-31T19:01:01.991858+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.024369+0000","last_change":"2023-08-31T19:01:02.020267+0000","last_active":"2023-08-31T19:01:02.024369+0000","last_peered":"2023-08-31T19:01:02.024369+0000","last_clean":"2023-08-31T19:01:02.024369+0000","last_became_active":"2023-08-31T19:01:02.019925+0000","last_became_peered":"2023-08-31T19:01:02.019925+0000","last_unstale":"2023-08-31T19:01:02.024369+0000","last_undegraded":"2023-08-31T19:01:02.024369+0000","last_fullsized":"2023-08-31T19:01:02.024369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.548046+0000","last_change":"2023-08-31T19:01:01.542603+0000","last_active":"2023-08-31T19:01:01.548046+0000","last_peered":"2023-08-31T19:01:01.548046+0000","last_clean":"2023-08-31T19:01:01.548046+0000","last_became_active":"2023-08-31T19:01:01.542320+0000","last_became_peered":"2023-08-31T19:01:01.542320+0000","last_unstale":"2023-08-31T19:01:01.548046+0000","last_undegraded":"2023-08-31T19:01:01.548046+0000","last_fullsized":"2023-08-31T19:01:01.548046+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.002998+0000","last_change":"2023-08-31T19:01:02.002998+0000","last_active":"2023-08-31T19:01:02.002998+0000","last_peered":"2023-08-31T19:01:02.002998+0000","last_clean":"2023-08-31T19:01:02.002998+0000","last_became_active":"2023-08-31T19:01:02.002245+0000","last_became_peered":"2023-08-31T19:01:02.002245+0000","last_unstale":"2023-08-31T19:01:02.002998+0000","last_undegraded":"2023-08-31T19:01:02.002998+0000","last_fullsized":"2023-08-31T19:01:02.002998+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.998205+0000","last_change":"2023-08-31T19:01:01.542769+0000","last_active":"2023-08-31T19:01:01.998205+0000","last_peered":"2023-08-31T19:01:01.998205+0000","last_clean":"2023-08-31T19:01:01.998205+0000","last_became_active":"2023-08-31T19:01:01.542482+0000","last_became_peered":"2023-08-31T19:01:01.542482+0000","last_unstale":"2023-08-31T19:01:01.998205+0000","last_undegraded":"2023-08-31T19:01:01.998205+0000","last_fullsized":"2023-08-31T19:01:01.998205+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.006811+0000","last_change":"2023-08-31T19:01:02.006811+0000","last_active":"2023-08-31T19:01:02.006811+0000","last_peered":"2023-08-31T19:01:02.006811+0000","last_clean":"2023-08-31T19:01:02.006811+0000","last_became_active":"2023-08-31T19:01:02.006452+0000","last_became_peered":"2023-08-31T19:01:02.006452+0000","last_unstale":"2023-08-31T19:01:02.006811+0000","last_undegraded":"2023-08-31T19:01:02.006811+0000","last_fullsized":"2023-08-31T19:01:02.006811+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.538621+0000","last_change":"2023-08-31T19:01:01.536817+0000","last_active":"2023-08-31T19:01:01.538621+0000","last_peered":"2023-08-31T19:01:01.538621+0000","last_clean":"2023-08-31T19:01:01.538621+0000","last_became_active":"2023-08-31T19:01:01.536538+0000","last_became_peered":"2023-08-31T19:01:01.536538+0000","last_unstale":"2023-08-31T19:01:01.538621+0000","last_undegraded":"2023-08-31T19:01:01.538621+0000","last_fullsized":"2023-08-31T19:01:01.538621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016921+0000","last_change":"2023-08-31T19:01:02.016921+0000","last_active":"2023-08-31T19:01:02.016921+0000","last_peered":"2023-08-31T19:01:02.016921+0000","last_clean":"2023-08-31T19:01:02.016921+0000","last_became_active":"2023-08-31T19:01:02.016499+0000","last_became_peered":"2023-08-31T19:01:02.016499+0000","last_unstale":"2023-08-31T19:01:02.016921+0000","last_undegraded":"2023-08-31T19:01:02.016921+0000","last_fullsized":"2023-08-31T19:01:02.016921+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"60'3","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.016911+0000","last_change":"2023-08-31T19:01:01.552733+0000","last_active":"2023-08-31T19:01:02.016911+0000","last_peered":"2023-08-31T19:01:02.016911+0000","last_clean":"2023-08-31T19:01:02.016911+0000","last_became_active":"2023-08-31T19:01:01.552369+0000","last_became_peered":"2023-08-31T19:01:01.552369+0000","last_unstale":"2023-08-31T19:01:02.016911+0000","last_undegraded":"2023-08-31T19:01:02.016911+0000","last_fullsized":"2023-08-31T19:01:02.016911+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.002758+0000","last_change":"2023-08-31T19:01:02.002758+0000","last_active":"2023-08-31T19:01:02.002758+0000","last_peered":"2023-08-31T19:01:02.002758+0000","last_clean":"2023-08-31T19:01:02.002758+0000","last_became_active":"2023-08-31T19:01:02.002462+0000","last_became_peered":"2023-08-31T19:01:02.002462+0000","last_unstale":"2023-08-31T19:01:02.002758+0000","last_undegraded":"2023-08-31T19:01:02.002758+0000","last_fullsized":"2023-08-31T19:01:02.002758+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011923+0000","last_change":"2023-08-31T19:01:01.554230+0000","last_active":"2023-08-31T19:01:02.011923+0000","last_peered":"2023-08-31T19:01:02.011923+0000","last_clean":"2023-08-31T19:01:02.011923+0000","last_became_active":"2023-08-31T19:01:01.553947+0000","last_became_peered":"2023-08-31T19:01:01.553947+0000","last_unstale":"2023-08-31T19:01:02.011923+0000","last_undegraded":"2023-08-31T19:01:02.011923+0000","last_fullsized":"2023-08-31T19:01:02.011923+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.015178+0000","last_change":"2023-08-31T19:01:02.015178+0000","last_active":"2023-08-31T19:01:02.015178+0000","last_peered":"2023-08-31T19:01:02.015178+0000","last_clean":"2023-08-31T19:01:02.015178+0000","last_became_active":"2023-08-31T19:01:02.014844+0000","last_became_peered":"2023-08-31T19:01:02.014844+0000","last_unstale":"2023-08-31T19:01:02.015178+0000","last_undegraded":"2023-08-31T19:01:02.015178+0000","last_fullsized":"2023-08-31T19:01:02.015178+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"60'1","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.991888+0000","last_change":"2023-08-31T19:01:01.545832+0000","last_active":"2023-08-31T19:01:01.991888+0000","last_peered":"2023-08-31T19:01:01.991888+0000","last_clean":"2023-08-31T19:01:01.991888+0000","last_became_active":"2023-08-31T19:01:01.545519+0000","last_became_peered":"2023-08-31T19:01:01.545519+0000","last_unstale":"2023-08-31T19:01:01.991888+0000","last_undegraded":"2023-08-31T19:01:01.991888+0000","last_fullsized":"2023-08-31T19:01:01.991888+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012118+0000","last_change":"2023-08-31T19:01:02.012118+0000","last_active":"2023-08-31T19:01:02.012118+0000","last_peered":"2023-08-31T19:01:02.012118+0000","last_clean":"2023-08-31T19:01:02.012118+0000","last_became_active":"2023-08-31T19:01:02.011639+0000","last_became_peered":"2023-08-31T19:01:02.011639+0000","last_unstale":"2023-08-31T19:01:02.012118+0000","last_undegraded":"2023-08-31T19:01:02.012118+0000","last_fullsized":"2023-08-31T19:01:02.012118+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.992431+0000","last_change":"2023-08-31T19:01:01.539906+0000","last_active":"2023-08-31T19:01:01.992431+0000","last_peered":"2023-08-31T19:01:01.992431+0000","last_clean":"2023-08-31T19:01:01.992431+0000","last_became_active":"2023-08-31T19:01:01.539593+0000","last_became_peered":"2023-08-31T19:01:01.539593+0000","last_unstale":"2023-08-31T19:01:01.992431+0000","last_undegraded":"2023-08-31T19:01:01.992431+0000","last_fullsized":"2023-08-31T19:01:01.992431+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012066+0000","last_change":"2023-08-31T19:01:02.006899+0000","last_active":"2023-08-31T19:01:02.012066+0000","last_peered":"2023-08-31T19:01:02.012066+0000","last_clean":"2023-08-31T19:01:02.012066+0000","last_became_active":"2023-08-31T19:01:02.006648+0000","last_became_peered":"2023-08-31T19:01:02.006648+0000","last_unstale":"2023-08-31T19:01:02.012066+0000","last_undegraded":"2023-08-31T19:01:02.012066+0000","last_fullsized":"2023-08-31T19:01:02.012066+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.998387+0000","last_change":"2023-08-31T19:01:01.546918+0000","last_active":"2023-08-31T19:01:01.998387+0000","last_peered":"2023-08-31T19:01:01.998387+0000","last_clean":"2023-08-31T19:01:01.998387+0000","last_became_active":"2023-08-31T19:01:01.546474+0000","last_became_peered":"2023-08-31T19:01:01.546474+0000","last_unstale":"2023-08-31T19:01:01.998387+0000","last_undegraded":"2023-08-31T19:01:01.998387+0000","last_fullsized":"2023-08-31T19:01:01.998387+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012945+0000","last_change":"2023-08-31T19:01:02.012945+0000","last_active":"2023-08-31T19:01:02.012945+0000","last_peered":"2023-08-31T19:01:02.012945+0000","last_clean":"2023-08-31T19:01:02.012945+0000","last_became_active":"2023-08-31T19:01:02.011382+0000","last_became_peered":"2023-08-31T19:01:02.011382+0000","last_unstale":"2023-08-31T19:01:02.012945+0000","last_undegraded":"2023-08-31T19:01:02.012945+0000","last_fullsized":"2023-08-31T19:01:02.012945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018557+0000","last_change":"2023-08-31T19:01:01.549598+0000","last_active":"2023-08-31T19:01:02.018557+0000","last_peered":"2023-08-31T19:01:02.018557+0000","last_clean":"2023-08-31T19:01:02.018557+0000","last_became_active":"2023-08-31T19:01:01.549318+0000","last_became_peered":"2023-08-31T19:01:01.549318+0000","last_unstale":"2023-08-31T19:01:02.018557+0000","last_undegraded":"2023-08-31T19:01:02.018557+0000","last_fullsized":"2023-08-31T19:01:02.018557+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018615+0000","last_change":"2023-08-31T19:01:02.009753+0000","last_active":"2023-08-31T19:01:02.018615+0000","last_peered":"2023-08-31T19:01:02.018615+0000","last_clean":"2023-08-31T19:01:02.018615+0000","last_became_active":"2023-08-31T19:01:02.009465+0000","last_became_peered":"2023-08-31T19:01:02.009465+0000","last_unstale":"2023-08-31T19:01:02.018615+0000","last_undegraded":"2023-08-31T19:01:02.018615+0000","last_fullsized":"2023-08-31T19:01:02.018615+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"60'1","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.994320+0000","last_change":"2023-08-31T19:01:01.555324+0000","last_active":"2023-08-31T19:01:01.994320+0000","last_peered":"2023-08-31T19:01:01.994320+0000","last_clean":"2023-08-31T19:01:01.994320+0000","last_became_active":"2023-08-31T19:01:01.555013+0000","last_became_peered":"2023-08-31T19:01:01.555013+0000","last_unstale":"2023-08-31T19:01:01.994320+0000","last_undegraded":"2023-08-31T19:01:01.994320+0000","last_fullsized":"2023-08-31T19:01:01.994320+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.024663+0000","last_change":"2023-08-31T19:01:02.020700+0000","last_active":"2023-08-31T19:01:02.024663+0000","last_peered":"2023-08-31T19:01:02.024663+0000","last_clean":"2023-08-31T19:01:02.024663+0000","last_became_active":"2023-08-31T19:01:02.020397+0000","last_became_peered":"2023-08-31T19:01:02.020397+0000","last_unstale":"2023-08-31T19:01:02.024663+0000","last_undegraded":"2023-08-31T19:01:02.024663+0000","last_fullsized":"2023-08-31T19:01:02.024663+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012579+0000","last_change":"2023-08-31T19:01:01.536913+0000","last_active":"2023-08-31T19:01:02.012579+0000","last_peered":"2023-08-31T19:01:02.012579+0000","last_clean":"2023-08-31T19:01:02.012579+0000","last_became_active":"2023-08-31T19:01:01.536625+0000","last_became_peered":"2023-08-31T19:01:01.536625+0000","last_unstale":"2023-08-31T19:01:02.012579+0000","last_undegraded":"2023-08-31T19:01:02.012579+0000","last_fullsized":"2023-08-31T19:01:02.012579+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018985+0000","last_change":"2023-08-31T19:01:02.018985+0000","last_active":"2023-08-31T19:01:02.018985+0000","last_peered":"2023-08-31T19:01:02.018985+0000","last_clean":"2023-08-31T19:01:02.018985+0000","last_became_active":"2023-08-31T19:01:02.018694+0000","last_became_peered":"2023-08-31T19:01:02.018694+0000","last_unstale":"2023-08-31T19:01:02.018985+0000","last_undegraded":"2023-08-31T19:01:02.018985+0000","last_fullsized":"2023-08-31T19:01:02.018985+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.992801+0000","last_change":"2023-08-31T19:01:01.537643+0000","last_active":"2023-08-31T19:01:01.992801+0000","last_peered":"2023-08-31T19:01:01.992801+0000","last_clean":"2023-08-31T19:01:01.992801+0000","last_became_active":"2023-08-31T19:01:01.537354+0000","last_became_peered":"2023-08-31T19:01:01.537354+0000","last_unstale":"2023-08-31T19:01:01.992801+0000","last_undegraded":"2023-08-31T19:01:01.992801+0000","last_fullsized":"2023-08-31T19:01:01.992801+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.015204+0000","last_change":"2023-08-31T19:01:02.012188+0000","last_active":"2023-08-31T19:01:02.015204+0000","last_peered":"2023-08-31T19:01:02.015204+0000","last_clean":"2023-08-31T19:01:02.015204+0000","last_became_active":"2023-08-31T19:01:02.011888+0000","last_became_peered":"2023-08-31T19:01:02.011888+0000","last_unstale":"2023-08-31T19:01:02.015204+0000","last_undegraded":"2023-08-31T19:01:02.015204+0000","last_fullsized":"2023-08-31T19:01:02.015204+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.992255+0000","last_change":"2023-08-31T19:01:01.554258+0000","last_active":"2023-08-31T19:01:01.992255+0000","last_peered":"2023-08-31T19:01:01.992255+0000","last_clean":"2023-08-31T19:01:01.992255+0000","last_became_active":"2023-08-31T19:01:01.553921+0000","last_became_peered":"2023-08-31T19:01:01.553921+0000","last_unstale":"2023-08-31T19:01:01.992255+0000","last_undegraded":"2023-08-31T19:01:01.992255+0000","last_fullsized":"2023-08-31T19:01:01.992255+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.007053+0000","last_change":"2023-08-31T19:01:02.007053+0000","last_active":"2023-08-31T19:01:02.007053+0000","last_peered":"2023-08-31T19:01:02.007053+0000","last_clean":"2023-08-31T19:01:02.007053+0000","last_became_active":"2023-08-31T19:01:02.006662+0000","last_became_peered":"2023-08-31T19:01:02.006662+0000","last_unstale":"2023-08-31T19:01:02.007053+0000","last_undegraded":"2023-08-31T19:01:02.007053+0000","last_fullsized":"2023-08-31T19:01:02.007053+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012563+0000","last_change":"2023-08-31T19:01:01.539889+0000","last_active":"2023-08-31T19:01:02.012563+0000","last_peered":"2023-08-31T19:01:02.012563+0000","last_clean":"2023-08-31T19:01:02.012563+0000","last_became_active":"2023-08-31T19:01:01.539589+0000","last_became_peered":"2023-08-31T19:01:01.539589+0000","last_unstale":"2023-08-31T19:01:02.012563+0000","last_undegraded":"2023-08-31T19:01:02.012563+0000","last_fullsized":"2023-08-31T19:01:02.012563+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011700+0000","last_change":"2023-08-31T19:01:02.002788+0000","last_active":"2023-08-31T19:01:02.011700+0000","last_peered":"2023-08-31T19:01:02.011700+0000","last_clean":"2023-08-31T19:01:02.011700+0000","last_became_active":"2023-08-31T19:01:02.002528+0000","last_became_peered":"2023-08-31T19:01:02.002528+0000","last_unstale":"2023-08-31T19:01:02.011700+0000","last_undegraded":"2023-08-31T19:01:02.011700+0000","last_fullsized":"2023-08-31T19:01:02.011700+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.989632+0000","last_change":"2023-08-31T19:01:01.553606+0000","last_active":"2023-08-31T19:01:01.989632+0000","last_peered":"2023-08-31T19:01:01.989632+0000","last_clean":"2023-08-31T19:01:01.989632+0000","last_became_active":"2023-08-31T19:01:01.553329+0000","last_became_peered":"2023-08-31T19:01:01.553329+0000","last_unstale":"2023-08-31T19:01:01.989632+0000","last_undegraded":"2023-08-31T19:01:01.989632+0000","last_fullsized":"2023-08-31T19:01:01.989632+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.000714+0000","last_change":"2023-08-31T19:01:02.000714+0000","last_active":"2023-08-31T19:01:02.000714+0000","last_peered":"2023-08-31T19:01:02.000714+0000","last_clean":"2023-08-31T19:01:02.000714+0000","last_became_active":"2023-08-31T19:01:02.000452+0000","last_became_peered":"2023-08-31T19:01:02.000452+0000","last_unstale":"2023-08-31T19:01:02.000714+0000","last_undegraded":"2023-08-31T19:01:02.000714+0000","last_fullsized":"2023-08-31T19:01:02.000714+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.547845+0000","last_change":"2023-08-31T19:01:01.542381+0000","last_active":"2023-08-31T19:01:01.547845+0000","last_peered":"2023-08-31T19:01:01.547845+0000","last_clean":"2023-08-31T19:01:01.547845+0000","last_became_active":"2023-08-31T19:01:01.542037+0000","last_became_peered":"2023-08-31T19:01:01.542037+0000","last_unstale":"2023-08-31T19:01:01.547845+0000","last_undegraded":"2023-08-31T19:01:01.547845+0000","last_fullsized":"2023-08-31T19:01:01.547845+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.020324+0000","last_change":"2023-08-31T19:01:02.015115+0000","last_active":"2023-08-31T19:01:02.020324+0000","last_peered":"2023-08-31T19:01:02.020324+0000","last_clean":"2023-08-31T19:01:02.020324+0000","last_became_active":"2023-08-31T19:01:02.014839+0000","last_became_peered":"2023-08-31T19:01:02.014839+0000","last_unstale":"2023-08-31T19:01:02.020324+0000","last_undegraded":"2023-08-31T19:01:02.020324+0000","last_fullsized":"2023-08-31T19:01:02.020324+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.005539+0000","last_change":"2023-08-31T19:01:01.544401+0000","last_active":"2023-08-31T19:01:02.005539+0000","last_peered":"2023-08-31T19:01:02.005539+0000","last_clean":"2023-08-31T19:01:02.005539+0000","last_became_active":"2023-08-31T19:01:01.543725+0000","last_became_peered":"2023-08-31T19:01:01.543725+0000","last_unstale":"2023-08-31T19:01:02.005539+0000","last_undegraded":"2023-08-31T19:01:02.005539+0000","last_fullsized":"2023-08-31T19:01:02.005539+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.010903+0000","last_change":"2023-08-31T19:01:02.010903+0000","last_active":"2023-08-31T19:01:02.010903+0000","last_peered":"2023-08-31T19:01:02.010903+0000","last_clean":"2023-08-31T19:01:02.010903+0000","last_became_active":"2023-08-31T19:01:02.010583+0000","last_became_peered":"2023-08-31T19:01:02.010583+0000","last_unstale":"2023-08-31T19:01:02.010903+0000","last_undegraded":"2023-08-31T19:01:02.010903+0000","last_fullsized":"2023-08-31T19:01:02.010903+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.554627+0000","last_change":"2023-08-31T19:01:01.552518+0000","last_active":"2023-08-31T19:01:01.554627+0000","last_peered":"2023-08-31T19:01:01.554627+0000","last_clean":"2023-08-31T19:01:01.554627+0000","last_became_active":"2023-08-31T19:01:01.552203+0000","last_became_peered":"2023-08-31T19:01:01.552203+0000","last_unstale":"2023-08-31T19:01:01.554627+0000","last_undegraded":"2023-08-31T19:01:01.554627+0000","last_fullsized":"2023-08-31T19:01:01.554627+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.002330+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:01:02.002330+0000","last_peered":"2023-08-31T19:01:02.002330+0000","last_clean":"2023-08-31T19:01:02.002330+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:01:02.002330+0000","last_undegraded":"2023-08-31T19:01:02.002330+0000","last_fullsized":"2023-08-31T19:01:02.002330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.012212+0000","last_change":"2023-08-31T19:01:02.012212+0000","last_active":"2023-08-31T19:01:02.012212+0000","last_peered":"2023-08-31T19:01:02.012212+0000","last_clean":"2023-08-31T19:01:02.012212+0000","last_became_active":"2023-08-31T19:01:02.011811+0000","last_became_peered":"2023-08-31T19:01:02.011811+0000","last_unstale":"2023-08-31T19:01:02.012212+0000","last_undegraded":"2023-08-31T19:01:02.012212+0000","last_fullsized":"2023-08-31T19:01:02.012212+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.020052+0000","last_change":"2023-08-31T19:01:01.548899+0000","last_active":"2023-08-31T19:01:02.020052+0000","last_peered":"2023-08-31T19:01:02.020052+0000","last_clean":"2023-08-31T19:01:02.020052+0000","last_became_active":"2023-08-31T19:01:01.548546+0000","last_became_peered":"2023-08-31T19:01:01.548546+0000","last_unstale":"2023-08-31T19:01:02.020052+0000","last_undegraded":"2023-08-31T19:01:02.020052+0000","last_fullsized":"2023-08-31T19:01:02.020052+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.533148+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:01:01.533148+0000","last_peered":"2023-08-31T19:01:01.533148+0000","last_clean":"2023-08-31T19:01:01.533148+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:01:01.533148+0000","last_undegraded":"2023-08-31T19:01:01.533148+0000","last_fullsized":"2023-08-31T19:01:01.533148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.013980+0000","last_change":"2023-08-31T19:01:02.006304+0000","last_active":"2023-08-31T19:01:02.013980+0000","last_peered":"2023-08-31T19:01:02.013980+0000","last_clean":"2023-08-31T19:01:02.013980+0000","last_became_active":"2023-08-31T19:01:02.006014+0000","last_became_peered":"2023-08-31T19:01:02.006014+0000","last_unstale":"2023-08-31T19:01:02.013980+0000","last_undegraded":"2023-08-31T19:01:02.013980+0000","last_fullsized":"2023-08-31T19:01:02.013980+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.548063+0000","last_change":"2023-08-31T19:01:01.541516+0000","last_active":"2023-08-31T19:01:01.548063+0000","last_peered":"2023-08-31T19:01:01.548063+0000","last_clean":"2023-08-31T19:01:01.548063+0000","last_became_active":"2023-08-31T19:01:01.541160+0000","last_became_peered":"2023-08-31T19:01:01.541160+0000","last_unstale":"2023-08-31T19:01:01.548063+0000","last_undegraded":"2023-08-31T19:01:01.548063+0000","last_fullsized":"2023-08-31T19:01:01.548063+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.007489+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:01:02.007489+0000","last_peered":"2023-08-31T19:01:02.007489+0000","last_clean":"2023-08-31T19:01:02.007489+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:01:02.007489+0000","last_undegraded":"2023-08-31T19:01:02.007489+0000","last_fullsized":"2023-08-31T19:01:02.007489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011548+0000","last_change":"2023-08-31T19:01:02.002588+0000","last_active":"2023-08-31T19:01:02.011548+0000","last_peered":"2023-08-31T19:01:02.011548+0000","last_clean":"2023-08-31T19:01:02.011548+0000","last_became_active":"2023-08-31T19:01:02.002328+0000","last_became_peered":"2023-08-31T19:01:02.002328+0000","last_unstale":"2023-08-31T19:01:02.011548+0000","last_undegraded":"2023-08-31T19:01:02.011548+0000","last_fullsized":"2023-08-31T19:01:02.011548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.549365+0000","last_change":"2023-08-31T19:01:01.546226+0000","last_active":"2023-08-31T19:01:01.549365+0000","last_peered":"2023-08-31T19:01:01.549365+0000","last_clean":"2023-08-31T19:01:01.549365+0000","last_became_active":"2023-08-31T19:01:01.545825+0000","last_became_peered":"2023-08-31T19:01:01.545825+0000","last_unstale":"2023-08-31T19:01:01.549365+0000","last_undegraded":"2023-08-31T19:01:01.549365+0000","last_fullsized":"2023-08-31T19:01:01.549365+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.532390+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:01:01.532390+0000","last_peered":"2023-08-31T19:01:01.532390+0000","last_clean":"2023-08-31T19:01:01.532390+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:01:01.532390+0000","last_undegraded":"2023-08-31T19:01:01.532390+0000","last_fullsized":"2023-08-31T19:01:01.532390+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":50,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.999721+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:01:01.999721+0000","last_peered":"2023-08-31T19:01:01.999721+0000","last_clean":"2023-08-31T19:01:01.999721+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:01:01.999721+0000","last_undegraded":"2023-08-31T19:01:01.999721+0000","last_fullsized":"2023-08-31T19:01:01.999721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.011892+0000","last_change":"2023-08-31T19:01:02.007541+0000","last_active":"2023-08-31T19:01:02.011892+0000","last_peered":"2023-08-31T19:01:02.011892+0000","last_clean":"2023-08-31T19:01:02.011892+0000","last_became_active":"2023-08-31T19:01:02.007240+0000","last_became_peered":"2023-08-31T19:01:02.007240+0000","last_unstale":"2023-08-31T19:01:02.011892+0000","last_undegraded":"2023-08-31T19:01:02.011892+0000","last_fullsized":"2023-08-31T19:01:02.011892+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.000171+0000","last_change":"2023-08-31T19:01:01.543149+0000","last_active":"2023-08-31T19:01:02.000171+0000","last_peered":"2023-08-31T19:01:02.000171+0000","last_clean":"2023-08-31T19:01:02.000171+0000","last_became_active":"2023-08-31T19:01:01.542872+0000","last_became_peered":"2023-08-31T19:01:01.542872+0000","last_unstale":"2023-08-31T19:01:02.000171+0000","last_undegraded":"2023-08-31T19:01:02.000171+0000","last_fullsized":"2023-08-31T19:01:02.000171+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.999808+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:01:01.999808+0000","last_peered":"2023-08-31T19:01:01.999808+0000","last_clean":"2023-08-31T19:01:01.999808+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:01:01.999808+0000","last_undegraded":"2023-08-31T19:01:01.999808+0000","last_fullsized":"2023-08-31T19:01:01.999808+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.019876+0000","last_change":"2023-08-31T19:01:02.015805+0000","last_active":"2023-08-31T19:01:02.019876+0000","last_peered":"2023-08-31T19:01:02.019876+0000","last_clean":"2023-08-31T19:01:02.019876+0000","last_became_active":"2023-08-31T19:01:02.015503+0000","last_became_peered":"2023-08-31T19:01:02.015503+0000","last_unstale":"2023-08-31T19:01:02.019876+0000","last_undegraded":"2023-08-31T19:01:02.019876+0000","last_fullsized":"2023-08-31T19:01:02.019876+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.545814+0000","last_change":"2023-08-31T19:01:01.538748+0000","last_active":"2023-08-31T19:01:01.545814+0000","last_peered":"2023-08-31T19:01:01.545814+0000","last_clean":"2023-08-31T19:01:01.545814+0000","last_became_active":"2023-08-31T19:01:01.538473+0000","last_became_peered":"2023-08-31T19:01:01.538473+0000","last_unstale":"2023-08-31T19:01:01.545814+0000","last_undegraded":"2023-08-31T19:01:01.545814+0000","last_fullsized":"2023-08-31T19:01:01.545814+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.000249+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:01:02.000249+0000","last_peered":"2023-08-31T19:01:02.000249+0000","last_clean":"2023-08-31T19:01:02.000249+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:01:02.000249+0000","last_undegraded":"2023-08-31T19:01:02.000249+0000","last_fullsized":"2023-08-31T19:01:02.000249+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.018070+0000","last_change":"2023-08-31T19:01:02.018070+0000","last_active":"2023-08-31T19:01:02.018070+0000","last_peered":"2023-08-31T19:01:02.018070+0000","last_clean":"2023-08-31T19:01:02.018070+0000","last_became_active":"2023-08-31T19:01:02.017662+0000","last_became_peered":"2023-08-31T19:01:02.017662+0000","last_unstale":"2023-08-31T19:01:02.018070+0000","last_undegraded":"2023-08-31T19:01:02.018070+0000","last_fullsized":"2023-08-31T19:01:02.018070+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.992141+0000","last_change":"2023-08-31T19:01:01.554002+0000","last_active":"2023-08-31T19:01:01.992141+0000","last_peered":"2023-08-31T19:01:01.992141+0000","last_clean":"2023-08-31T19:01:01.992141+0000","last_became_active":"2023-08-31T19:01:01.553717+0000","last_became_peered":"2023-08-31T19:01:01.553717+0000","last_unstale":"2023-08-31T19:01:01.992141+0000","last_undegraded":"2023-08-31T19:01:01.992141+0000","last_fullsized":"2023-08-31T19:01:01.992141+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.003011+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:01:02.003011+0000","last_peered":"2023-08-31T19:01:02.003011+0000","last_clean":"2023-08-31T19:01:02.003011+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:01:02.003011+0000","last_undegraded":"2023-08-31T19:01:02.003011+0000","last_fullsized":"2023-08-31T19:01:02.003011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:02.015326+0000","last_change":"2023-08-31T19:01:02.015326+0000","last_active":"2023-08-31T19:01:02.015326+0000","last_peered":"2023-08-31T19:01:02.015326+0000","last_clean":"2023-08-31T19:01:02.015326+0000","last_became_active":"2023-08-31T19:01:02.015009+0000","last_became_peered":"2023-08-31T19:01:02.015009+0000","last_unstale":"2023-08-31T19:01:02.015326+0000","last_undegraded":"2023-08-31T19:01:02.015326+0000","last_fullsized":"2023-08-31T19:01:02.015326+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:01.512333+0000","last_clean_scrub_stamp":"2023-08-31T19:01:01.512333+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.989834+0000","last_change":"2023-08-31T19:01:01.551096+0000","last_active":"2023-08-31T19:01:01.989834+0000","last_peered":"2023-08-31T19:01:01.989834+0000","last_clean":"2023-08-31T19:01:01.989834+0000","last_became_active":"2023-08-31T19:01:01.550596+0000","last_became_peered":"2023-08-31T19:01:01.550596+0000","last_unstale":"2023-08-31T19:01:01.989834+0000","last_undegraded":"2023-08-31T19:01:01.989834+0000","last_fullsized":"2023-08-31T19:01:01.989834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:01:00.505321+0000","last_clean_scrub_stamp":"2023-08-31T19:01:00.505321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-08-31T19:01:01.991854+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:01:01.991854+0000","last_peered":"2023-08-31T19:01:01.991854+0000","last_clean":"2023-08-31T19:01:01.991854+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:01:01.991854+0000","last_undegraded":"2023-08-31T19:01:01.991854+0000","last_fullsized":"2023-08-31T19:01:01.991854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":724992,"data_stored":351365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.73699999999999999,"15min":0.72799999999999998},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.39500000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":1.0489999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.76500000000000001,"15min":0.74399999999999999},"min":{"1min":0.57599999999999996,"5min":0.48399999999999999,"15min":0.42199999999999999},"max":{"1min":0.91500000000000004,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.99299999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70299999999999996,"15min":0.69099999999999995},"min":{"1min":0.48599999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89300000000000002,"5min":0.93000000000000005,"15min":0.97299999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.41699999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88700000000000001,"5min":0.92000000000000004,"15min":0.96799999999999997},"last":0.93100000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70399999999999996,"15min":0.69599999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.874,"5min":0.97499999999999998,"15min":1.093},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.745,"15min":0.72499999999999998},"min":{"1min":0.52600000000000002,"5min":0.50700000000000001,"15min":0.41199999999999998},"max":{"1min":0.95199999999999996,"5min":1.054,"15min":1.054},"last":0.89600000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.1160000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.55400000000000005,"5min":0.54700000000000004,"15min":0.495},"max":{"1min":0.93999999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81200000000000006,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.72699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.45500000000000002},"max":{"1min":0.83999999999999997,"5min":0.98499999999999999,"15min":1.163},"last":0.625}]},{"osd":5,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67100000000000004,"15min":0.67700000000000005},"min":{"1min":0.52200000000000002,"5min":0.39900000000000002,"15min":0.377},"max":{"1min":0.98299999999999998,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":1.139},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70399999999999996,"15min":0.71099999999999997},"min":{"1min":0.47499999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97699999999999998,"5min":1.048,"15min":1.353},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67500000000000004,"15min":0.68400000000000005},"min":{"1min":0.46300000000000002,"5min":0.45600000000000002,"15min":0.41399999999999998},"max":{"1min":0.93100000000000005,"5min":1.0740000000000001,"15min":1.3999999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.47899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88900000000000001,"5min":0.96899999999999997,"15min":1.462},"last":1.038}]}]},{"osd":6,"up_from":13,"seq":55834575009,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301904,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069936,"statfs":{"total":96636764160,"available":96327614464,"internally_reserved":0,"allocated":729088,"data_stored":358033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.71399999999999997,"15min":0.69899999999999995},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.39600000000000002},"max":{"1min":0.91200000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72799999999999998,"15min":0.69099999999999995},"min":{"1min":0.61399999999999999,"5min":0.44800000000000001,"15min":0.43099999999999999},"max":{"1min":0.89000000000000001,"5min":0.93400000000000005,"15min":0.94499999999999995},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.69199999999999995},"min":{"1min":0.58199999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.82399999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.72999999999999998,"15min":0.71199999999999997},"min":{"1min":0.52500000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86599999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73999999999999999,"15min":0.71699999999999997},"min":{"1min":0.54000000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88600000000000001,"5min":1.036,"15min":1.129},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.58899999999999997,"5min":0.50900000000000001,"15min":0.5},"max":{"1min":0.85099999999999998,"5min":0.98699999999999999,"15min":1.3260000000000001},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.56100000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.873,"5min":0.98299999999999998,"15min":1.0860000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76200000000000001,"15min":0.745},"min":{"1min":0.61199999999999999,"5min":0.55300000000000005,"15min":0.49399999999999999},"max":{"1min":0.94799999999999995,"5min":1.052,"15min":1.052},"last":0.71799999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.60499999999999998,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.40999999999999998},"max":{"1min":0.71699999999999997,"5min":0.92900000000000005,"15min":0.97799999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.45900000000000002,"5min":0.44600000000000001,"15min":0.371},"max":{"1min":0.86299999999999999,"5min":0.88400000000000001,"15min":1.091},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66100000000000003,"15min":0.67500000000000004},"min":{"1min":0.44400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.1000000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71099999999999997,"15min":0.71899999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.46200000000000002},"max":{"1min":0.90300000000000002,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70199999999999996,"15min":0.70599999999999996},"min":{"1min":0.50800000000000001,"5min":0.48199999999999998,"15min":0.441},"max":{"1min":0.93300000000000005,"5min":0.998,"15min":1.0620000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.496,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0800000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.76400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301904,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069936,"statfs":{"total":96636764160,"available":96327614464,"internally_reserved":0,"allocated":729088,"data_stored":358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.45900000000000002,"15min":0.433},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.23300000000000001},"max":{"1min":0.63100000000000001,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48399999999999999,"15min":0.45700000000000002},"min":{"1min":0.34699999999999998,"5min":0.33400000000000002,"15min":0.254},"max":{"1min":0.63800000000000001,"5min":0.752,"15min":0.752},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51400000000000001,"15min":0.498},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.28899999999999998},"max":{"1min":0.78000000000000003,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59599999999999997,"15min":0.55900000000000005},"min":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.36599999999999999},"max":{"1min":0.73799999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.53400000000000003},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.378},"max":{"1min":0.67300000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52200000000000002,"15min":0.505},"min":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":0.65700000000000003,"5min":0.72299999999999998,"15min":1.673},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.78500000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.53600000000000003},"max":{"1min":1.1739999999999999,"5min":1.2110000000000001,"15min":1.4119999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.83499999999999996,"15min":0.80400000000000005},"min":{"1min":0.67100000000000004,"5min":0.65200000000000002,"15min":0.49099999999999999},"max":{"1min":1.1379999999999999,"5min":1.1799999999999999,"15min":1.3},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79100000000000004,"15min":0.77300000000000002},"min":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.46800000000000003},"max":{"1min":1.0309999999999999,"5min":1.052,"15min":1.8540000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78700000000000003,"15min":0.76300000000000001},"min":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.48799999999999999},"max":{"1min":1.1040000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.749}]},{"osd":6,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78900000000000003,"15min":0.76800000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.51400000000000001},"max":{"1min":1.1080000000000001,"5min":1.1990000000000001,"15min":1.8979999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81899999999999995,"15min":0.78800000000000003},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.48999999999999999},"max":{"1min":1.024,"5min":1.2,"15min":1.2629999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.81000000000000005,"15min":0.76900000000000002},"min":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.47699999999999998},"max":{"1min":1.085,"5min":1.087,"15min":1.113},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81299999999999994,"15min":0.80000000000000004},"min":{"1min":0.58199999999999996,"5min":0.56799999999999995,"15min":0.504},"max":{"1min":1.1000000000000001,"5min":1.1399999999999999,"15min":2.0720000000000001},"last":0.81999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575009,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297804,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074036,"statfs":{"total":96636764160,"available":96331812864,"internally_reserved":0,"allocated":724992,"data_stored":350813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42899999999999999,"15min":0.44600000000000001},"min":{"1min":0.33300000000000002,"5min":0.27400000000000002,"15min":0.26100000000000001},"max":{"1min":0.64500000000000002,"5min":0.66100000000000003,"15min":0.78400000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.499,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.58699999999999997,"5min":0.752,"15min":0.78500000000000003},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.505,"15min":0.497},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.32900000000000001},"max":{"1min":0.67900000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.51900000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.33800000000000002},"max":{"1min":0.69699999999999995,"5min":0.71199999999999997,"15min":1.0029999999999999},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52200000000000002,"15min":0.51500000000000001},"min":{"1min":0.41799999999999998,"5min":0.374,"15min":0.35399999999999998},"max":{"1min":0.63100000000000001,"5min":0.73099999999999998,"15min":0.83399999999999996},"last":0.434},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56299999999999994,"15min":0.57099999999999995},"min":{"1min":0.41999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70499999999999996,"5min":0.80400000000000005,"15min":1.0509999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83399999999999996,"15min":0.81799999999999995},"min":{"1min":0.67400000000000004,"5min":0.60499999999999998,"15min":0.53900000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.931},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82899999999999996,"15min":0.80600000000000005},"min":{"1min":0.66100000000000003,"5min":0.55800000000000005,"15min":0.49399999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.276},"last":0.85899999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76200000000000001,"15min":0.755},"min":{"1min":0.59599999999999997,"5min":0.50800000000000001,"15min":0.49399999999999999},"max":{"1min":1.0009999999999999,"5min":1.079,"15min":1.3480000000000001},"last":0.872},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77700000000000002,"15min":0.77200000000000002},"min":{"1min":0.60999999999999999,"5min":0.53000000000000003,"15min":0.50700000000000001},"max":{"1min":0.99199999999999999,"5min":1.113,"15min":1.9810000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.80500000000000005,"15min":0.80100000000000005},"min":{"1min":0.63700000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0960000000000001,"5min":1.181,"15min":1.3280000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.84099999999999997,"15min":0.83899999999999997},"min":{"1min":0.65600000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.071,"5min":1.1359999999999999,"15min":1.2350000000000001},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:00:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.171,"5min":1.171,"15min":2.1760000000000002},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84499999999999997,"15min":0.82899999999999996},"min":{"1min":0.72099999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.337},"last":0.90700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575009,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":724992,"data_stored":352223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.441,"15min":0.432},"min":{"1min":0.33000000000000002,"5min":0.32300000000000001,"15min":0.29099999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.90200000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.81899999999999995,"15min":1.5900000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.5,"15min":0.5},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72199999999999998,"5min":0.77300000000000002,"15min":0.96599999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53900000000000003,"15min":0.52500000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.36499999999999999},"max":{"1min":0.748,"5min":0.877,"15min":1.288},"last":0.64100000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":0.49199999999999999},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.33100000000000002},"max":{"1min":0.58799999999999997,"5min":1.022,"15min":1.022},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.54400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.35599999999999998},"max":{"1min":0.68000000000000005,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78900000000000003,"15min":0.77800000000000002},"min":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.50600000000000001},"max":{"1min":1.0309999999999999,"5min":1.161,"15min":1.208},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.79800000000000004,"15min":0.79100000000000004},"min":{"1min":0.60799999999999998,"5min":0.57699999999999996,"15min":0.47699999999999998},"max":{"1min":0.96199999999999997,"5min":1.1870000000000001,"15min":1.464},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79700000000000004,"15min":0.78500000000000003},"min":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0840000000000001,"5min":1.1339999999999999,"15min":1.361},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.78900000000000003},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.53400000000000003},"max":{"1min":1.1020000000000001,"5min":1.145,"15min":1.3},"last":0.70099999999999996}]},{"osd":6,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.81399999999999995,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.60399999999999998,"15min":0.501},"max":{"1min":1.137,"5min":1.137,"15min":1.51},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80700000000000005,"15min":0.79800000000000004},"min":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.48199999999999998},"max":{"1min":1.1579999999999999,"5min":1.2989999999999999,"15min":1.4359999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:00:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.62,"5min":0.54800000000000004,"15min":0.51900000000000002},"max":{"1min":1.044,"5min":1.0820000000000001,"15min":1.55},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81999999999999995,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.59199999999999997,"15min":0.55100000000000005},"max":{"1min":1.0549999999999999,"5min":1.2050000000000001,"15min":1.387},"last":0.83499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575009,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301912,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069928,"statfs":{"total":96636764160,"available":96327606272,"internally_reserved":0,"allocated":737280,"data_stored":358629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.442,"15min":0.42499999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.252},"max":{"1min":0.58199999999999996,"5min":0.79400000000000004,"15min":0.995},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.48099999999999998,"15min":0.45800000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.29199999999999998},"max":{"1min":0.59999999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44700000000000001,"15min":0.442},"min":{"1min":0.33900000000000002,"5min":0.32600000000000001,"15min":0.254},"max":{"1min":0.56100000000000005,"5min":0.66800000000000004,"15min":0.90700000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.503,"15min":0.49299999999999999},"min":{"1min":0.436,"5min":0.35599999999999998,"15min":0.28799999999999998},"max":{"1min":0.59899999999999998,"5min":0.78100000000000003,"15min":0.92800000000000005},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58999999999999997,"15min":0.56399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39300000000000002,"15min":0.33400000000000002},"max":{"1min":0.77500000000000002,"5min":1.0640000000000001,"15min":1.407},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.628,"15min":0.59399999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.40400000000000003},"max":{"1min":0.73499999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Aug 31 19:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.752,"15min":0.73899999999999999},"min":{"1min":0.56599999999999995,"5min":0.52500000000000002,"15min":0.47299999999999998},"max":{"1min":0.95499999999999996,"5min":1.0860000000000001,"15min":1.2849999999999999},"last":0.755},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.76900000000000002,"15min":0.751},"min":{"1min":0.64400000000000002,"5min":0.56000000000000005,"15min":0.47299999999999998},"max":{"1min":0.98799999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76200000000000001,"15min":0.75},"min":{"1min":0.55000000000000004,"5min":0.51500000000000001,"15min":0.46600000000000003},"max":{"1min":0.89200000000000002,"5min":0.97899999999999998,"15min":1.3220000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78800000000000003,"15min":0.76500000000000001},"min":{"1min":0.625,"5min":0.53200000000000003,"15min":0.50700000000000001},"max":{"1min":0.95199999999999996,"5min":1.165,"15min":1.165},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.79400000000000004,"15min":0.78000000000000003},"min":{"1min":0.59299999999999997,"5min":0.55300000000000005,"15min":0.52000000000000002},"max":{"1min":1.0169999999999999,"5min":1.111,"15min":1.2270000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.78500000000000003,"15min":0.76400000000000001},"min":{"1min":0.65800000000000003,"5min":0.55400000000000005,"15min":0.50600000000000001},"max":{"1min":1.03,"5min":1.036,"15min":1.1379999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.81000000000000005,"15min":0.77500000000000002},"min":{"1min":0.65800000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.98899999999999999,"5min":1.147,"15min":1.181},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79300000000000004,"15min":0.77500000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.54700000000000004},"max":{"1min":0.91900000000000004,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.69299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575009,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297796,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074044,"statfs":{"total":96636764160,"available":96331821056,"internally_reserved":0,"allocated":716800,"data_stored":351241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:00:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71299999999999997,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.46800000000000003,"15min":0.36799999999999999},"max":{"1min":0.87,"5min":0.95499999999999996,"15min":9.6289999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73299999999999998},"min":{"1min":0.55000000000000004,"5min":0.48199999999999998,"15min":0.42099999999999999},"max":{"1min":0.878,"5min":0.93400000000000005,"15min":3.403},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Aug 31 19:00:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73099999999999998,"15min":0.82299999999999995},"min":{"1min":0.54000000000000004,"5min":0.48699999999999999,"15min":0.437},"max":{"1min":0.93100000000000005,"5min":1.004,"15min":9.8399999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72899999999999998,"15min":0.82799999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.44900000000000001},"max":{"1min":0.90500000000000003,"5min":0.99299999999999999,"15min":9.7569999999999997},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:00:13 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73099999999999998,"15min":0.81999999999999995},"min":{"1min":0.51700000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88700000000000001,"5min":0.96399999999999997,"15min":9.7840000000000007},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74399999999999999,"15min":0.84499999999999997},"min":{"1min":0.57799999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90000000000000002,"5min":0.97199999999999998,"15min":9.7200000000000006},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:00:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72699999999999998,"15min":0.77100000000000002},"min":{"1min":0.55800000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91900000000000004,"5min":0.98599999999999999,"15min":5.133},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.751,"15min":0.88800000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.53200000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":12.589},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:00:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.72899999999999998},"min":{"1min":0.42599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.87,"5min":0.90100000000000002,"15min":9.6780000000000008},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60899999999999999,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.42699999999999999,"15min":0.38300000000000001},"max":{"1min":0.79400000000000004,"5min":0.89000000000000001,"15min":3.3610000000000002},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:00:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63500000000000001,"15min":0.77000000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83199999999999996,"5min":0.96899999999999997,"15min":9.4760000000000009},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.68100000000000005,"15min":0.82199999999999995},"min":{"1min":0.50600000000000001,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":0.86099999999999999,"5min":0.95799999999999996,"15min":9.8640000000000008},"last":0.82599999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:00:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67300000000000004,"15min":0.77900000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.38600000000000001},"max":{"1min":0.86899999999999999,"5min":0.91700000000000004,"15min":7.1769999999999996},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70599999999999996,"15min":0.88200000000000001},"min":{"1min":0.48199999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91300000000000003,"5min":1.036,"15min":12.634},"last":0.92900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575009,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":716800,"data_stored":351579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73399999999999999,"15min":0.71099999999999997},"min":{"1min":0.47499999999999998,"5min":0.46800000000000003,"15min":0.40899999999999997},"max":{"1min":0.93400000000000005,"5min":0.97099999999999997,"15min":1.4019999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73799999999999999,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.44500000000000001},"max":{"1min":0.93799999999999994,"5min":1.0600000000000001,"15min":1.629},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72499999999999998,"15min":0.71199999999999997},"min":{"1min":0.56100000000000005,"5min":0.54200000000000004,"15min":0.45700000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.1699999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.747,"15min":0.72299999999999998},"min":{"1min":0.58599999999999997,"5min":0.51000000000000001,"15min":0.46300000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.2989999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72199999999999998,"15min":0.69899999999999995},"min":{"1min":0.52600000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97799999999999998,"5min":0.98299999999999998,"15min":1.004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.45200000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.355},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.76000000000000001,"15min":0.73699999999999999},"min":{"1min":0.64500000000000002,"5min":0.51100000000000001,"15min":0.499},"max":{"1min":0.98999999999999999,"5min":1.012,"15min":2.0070000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.73799999999999999,"15min":0.72099999999999997},"min":{"1min":0.57199999999999995,"5min":0.50900000000000001,"15min":0.47799999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.1279999999999999},"last":0.66900000000000004}]},{"osd":4,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61399999999999999,"15min":0.64200000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":0.98399999999999999,"15min":1.6890000000000001},"last":0.754},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.66400000000000003},"min":{"1min":0.42499999999999999,"5min":0.42299999999999999,"15min":0.41499999999999998},"max":{"1min":0.84399999999999997,"5min":0.98099999999999998,"15min":1.306},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65300000000000002},"min":{"1min":0.45300000000000001,"5min":0.435,"15min":0.39100000000000001},"max":{"1min":0.89700000000000002,"5min":0.97499999999999998,"15min":1.054},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.441},"max":{"1min":0.89300000000000002,"5min":1.0309999999999999,"15min":1.3440000000000001},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Aug 31 19:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70999999999999996,"15min":0.72799999999999998},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97799999999999998,"5min":1.002,"15min":1.5249999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.72099999999999997,"15min":0.73899999999999999},"min":{"1min":0.50700000000000001,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":1.03,"5min":1.03,"15min":1.4890000000000001},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:01:06.719 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T19:01:06.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-31T19:01:06.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.946+0000 7f282cfff700 1 Processor -- start 2023-08-31T19:01:06.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.947+0000 7f282cfff700 1 -- start start 2023-08-31T19:01:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.948+0000 7f282cfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2828153e30 0x7f2828154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.948+0000 7f282cfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28280bfd40 con 0x7f28280c5cb0 2023-08-31T19:01:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.948+0000 7f282cfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28280c6730 con 0x7f28280637c0 2023-08-31T19:01:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.948+0000 7f282cfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28280bffe0 con 0x7f2828153e30 2023-08-31T19:01:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.948+0000 7f2825d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f28280c5cb0 0x7f28280630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35240/0 (socket says 172.21.15.72:35240) 2023-08-31T19:01:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.948+0000 7f2825d9b700 1 -- 172.21.15.72:0/488976252 learned_addr learned my addr 172.21.15.72:0/488976252 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:01:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.948+0000 7f282659c700 1 --2- 172.21.15.72:0/488976252 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2828153e30 0x7f2828154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.948+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263236013 0 0) 0x7f28280bfd40 con 0x7f28280c5cb0 2023-08-31T19:01:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28100033f0 con 0x7f28280c5cb0 2023-08-31T19:01:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438725335 0 0) 0x7f28280c6730 con 0x7f28280637c0 2023-08-31T19:01:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28280bfd40 con 0x7f28280637c0 2023-08-31T19:01:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1835146975 0 0) 0x7f28100033f0 con 0x7f28280c5cb0 2023-08-31T19:01:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2828153e30 msgr2=0x7f2828154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 --2- 172.21.15.72:0/488976252 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2828153e30 0x7f2828154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 >> v1:172.21.15.146:6789/0 conn(0x7f28280637c0 legacy=0x7f28280c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28280c02c0 con 0x7f28280c5cb0 2023-08-31T19:01:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f281c001470 con 0x7f28280c5cb0 2023-08-31T19:01:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 >> v1:172.21.15.72:6789/0 conn(0x7f28280c5cb0 legacy=0x7f28280630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 --2- 172.21.15.72:0/488976252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2810003aa0 0x7f2810003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 --2- 172.21.15.72:0/488976252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2810004690 0x7f2810004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 --2- 172.21.15.72:0/488976252 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2828153e30 0x7f2810005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28280bffe0 con 0x7f2810003aa0 2023-08-31T19:01:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281000b910 con 0x7f2810004690 2023-08-31T19:01:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281000bad0 con 0x7f2828153e30 2023-08-31T19:01:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f282659c700 1 --2- 172.21.15.72:0/488976252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2810003aa0 0x7f2810003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f2825d9b700 1 --2- 172.21.15.72:0/488976252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2810004690 0x7f2810004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.949+0000 7f2826d9d700 1 --2- 172.21.15.72:0/488976252 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2828153e30 0x7f2810005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.950+0000 7f282659c700 1 -- 172.21.15.72:0/488976252 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2828153e30 msgr2=0x7f2810005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.950+0000 7f282659c700 1 --2- 172.21.15.72:0/488976252 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2828153e30 0x7f2810005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.950+0000 7f282659c700 1 -- 172.21.15.72:0/488976252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2810004690 msgr2=0x7f2810004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.950+0000 7f282659c700 1 --2- 172.21.15.72:0/488976252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2810004690 0x7f2810004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.950+0000 7f282659c700 1 -- 172.21.15.72:0/488976252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28100033f0 con 0x7f2810003aa0 2023-08-31T19:01:06.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.950+0000 7f2826d9d700 1 --2- 172.21.15.72:0/488976252 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2828153e30 0x7f2810005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:06.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.950+0000 7f282659c700 1 --2- 172.21.15.72:0/488976252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2810003aa0 0x7f2810003ea0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f2818009a80 tx=0x7f2818009060).ready entity=mon.0 client_cookie=4824a4961ad1a5f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:06.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.950+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818009430 con 0x7f2810003aa0 2023-08-31T19:01:06.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.950+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281800e640 con 0x7f2810003aa0 2023-08-31T19:01:06.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.950+0000 7f282559a700 1 -- 172.21.15.72:0/488976252 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281800e9c0 con 0x7f2810003aa0 2023-08-31T19:01:06.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.950+0000 7f282cfff700 1 -- 172.21.15.72:0/488976252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2810003aa0 msgr2=0x7f2810003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.950+0000 7f282cfff700 1 --2- 172.21.15.72:0/488976252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2810003aa0 0x7f2810003ea0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f2818009a80 tx=0x7f2818009060).stop 2023-08-31T19:01:06.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.950+0000 7f2826d9d700 1 -- 172.21.15.72:0/488976252 reap_dead start 2023-08-31T19:01:06.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.951+0000 7f282cfff700 1 -- 172.21.15.72:0/488976252 shutdown_connections 2023-08-31T19:01:06.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.951+0000 7f282cfff700 1 -- 172.21.15.72:0/488976252 >> 172.21.15.72:0/488976252 conn(0x7f282805eb20 msgr2=0x7f28280cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:06.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.951+0000 7f282cfff700 1 -- 172.21.15.72:0/488976252 shutdown_connections 2023-08-31T19:01:06.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.951+0000 7f282cfff700 1 -- 172.21.15.72:0/488976252 wait complete. 2023-08-31T19:01:06.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.952+0000 7f282cfff700 1 Processor -- start 2023-08-31T19:01:06.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.952+0000 7f282cfff700 1 -- start start 2023-08-31T19:01:06.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.953+0000 7f282cfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2810003aa0 0x7f28281648d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.953+0000 7f282cfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28280afe70 0x7f28280ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.953+0000 7f282cfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2828141750 0x7f28280c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.953+0000 7f282cfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28280af810 con 0x7f28280afe70 2023-08-31T19:01:06.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.953+0000 7f282cfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28280b02f0 con 0x7f2810003aa0 2023-08-31T19:01:06.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.953+0000 7f282cfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28280aed60 con 0x7f2828141750 2023-08-31T19:01:06.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.953+0000 7f2825d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28280afe70 0x7f28280ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.953+0000 7f2825d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28280afe70 0x7f28280ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54326/0 (socket says 172.21.15.72:54326) 2023-08-31T19:01:06.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.953+0000 7f2825d9b700 1 -- 172.21.15.72:0/4138134676 learned_addr learned my addr 172.21.15.72:0/4138134676 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:06.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.954+0000 7f282659c700 1 --2- 172.21.15.72:0/4138134676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2810003aa0 0x7f28281648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.954+0000 7f2826d9d700 1 --2- 172.21.15.72:0/4138134676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2828141750 0x7f28280c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.954+0000 7f2825d9b700 1 -- 172.21.15.72:0/4138134676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2828141750 msgr2=0x7f28280c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.954+0000 7f2825d9b700 1 --2- 172.21.15.72:0/4138134676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2828141750 0x7f28280c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.954+0000 7f2825d9b700 1 -- 172.21.15.72:0/4138134676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2810003aa0 msgr2=0x7f28281648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:06.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.954+0000 7f2825d9b700 1 --2- 172.21.15.72:0/4138134676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2810003aa0 0x7f28281648d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:06.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.954+0000 7f2825d9b700 1 -- 172.21.15.72:0/4138134676 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28281503e0 con 0x7f28280afe70 2023-08-31T19:01:06.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.954+0000 7f2826d9d700 1 --2- 172.21.15.72:0/4138134676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2828141750 0x7f28280c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:06.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.954+0000 7f2825d9b700 1 --2- 172.21.15.72:0/4138134676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28280afe70 0x7f28280ae870 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f281c004760 tx=0x7f281c001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:06.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.954+0000 7f28167fc700 1 -- 172.21.15.72:0/4138134676 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c011590 con 0x7f28280afe70 2023-08-31T19:01:06.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.954+0000 7f28167fc700 1 -- 172.21.15.72:0/4138134676 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c0116f0 con 0x7f28280afe70 2023-08-31T19:01:06.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.954+0000 7f282cfff700 1 -- 172.21.15.72:0/4138134676 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28280aef70 con 0x7f28280afe70 2023-08-31T19:01:06.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.954+0000 7f28167fc700 1 -- 172.21.15.72:0/4138134676 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c011a90 con 0x7f28280afe70 2023-08-31T19:01:06.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.954+0000 7f282cfff700 1 -- 172.21.15.72:0/4138134676 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28280af530 con 0x7f28280afe70 2023-08-31T19:01:06.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.955+0000 7f282cfff700 1 -- 172.21.15.72:0/4138134676 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2828150570 con 0x7f28280afe70 2023-08-31T19:01:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.956+0000 7f28167fc700 1 -- 172.21.15.72:0/4138134676 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f281c01d3b0 con 0x7f28280afe70 2023-08-31T19:01:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.957+0000 7f28167fc700 1 --2- 172.21.15.72:0/4138134676 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f280805ef30 0x7f28080613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.957+0000 7f28167fc700 1 -- 172.21.15.72:0/4138134676 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7f281c079bc0 con 0x7f28280afe70 2023-08-31T19:01:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.957+0000 7f282659c700 1 --2- 172.21.15.72:0/4138134676 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f280805ef30 0x7f28080613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:06.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.958+0000 7f282659c700 1 --2- 172.21.15.72:0/4138134676 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f280805ef30 0x7f28080613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2818006d50 tx=0x7f281801a000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:06.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:06.961+0000 7f28167fc700 1 -- 172.21.15.72:0/4138134676 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f281c04ab50 con 0x7f28280afe70 2023-08-31T19:01:07.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.193+0000 7f282cfff700 1 -- 172.21.15.72:0/4138134676 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f28280c05a0 con 0x7f28280afe70 2023-08-31T19:01:07.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.198+0000 7f28167fc700 1 -- 172.21.15.72:0/4138134676 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f281c019020 con 0x7f28280afe70 2023-08-31T19:01:07.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.200+0000 7f282cfff700 1 -- 172.21.15.72:0/4138134676 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f280805ef30 msgr2=0x7f28080613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:07.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.201+0000 7f282cfff700 1 --2- 172.21.15.72:0/4138134676 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f280805ef30 0x7f28080613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2818006d50 tx=0x7f281801a000).stop 2023-08-31T19:01:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.201+0000 7f282cfff700 1 -- 172.21.15.72:0/4138134676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28280afe70 msgr2=0x7f28280ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.201+0000 7f282cfff700 1 --2- 172.21.15.72:0/4138134676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28280afe70 0x7f28280ae870 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f281c004760 tx=0x7f281c001e10).stop 2023-08-31T19:01:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.201+0000 7f282cfff700 1 -- 172.21.15.72:0/4138134676 shutdown_connections 2023-08-31T19:01:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.201+0000 7f282cfff700 1 --2- 172.21.15.72:0/4138134676 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2828141750 0x7f28280c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.201+0000 7f282cfff700 1 --2- 172.21.15.72:0/4138134676 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f280805ef30 0x7f28080613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.201+0000 7f282cfff700 1 --2- 172.21.15.72:0/4138134676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2810003aa0 0x7f28281648d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.201+0000 7f282cfff700 1 --2- 172.21.15.72:0/4138134676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28280afe70 0x7f28280ae870 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.201+0000 7f282cfff700 1 -- 172.21.15.72:0/4138134676 >> 172.21.15.72:0/4138134676 conn(0x7f282805eb20 msgr2=0x7f282814f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.201+0000 7f282cfff700 1 -- 172.21.15.72:0/4138134676 shutdown_connections 2023-08-31T19:01:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.201+0000 7f282cfff700 1 -- 172.21.15.72:0/4138134676 wait complete. 2023-08-31T19:01:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-08-31T19:01:07.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:01:07.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.406+0000 7f797b7ff700 1 Processor -- start 2023-08-31T19:01:07.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.406+0000 7f797b7ff700 1 -- start start 2023-08-31T19:01:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.408+0000 7f797b7ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79740c5fb0 0x7f79740be370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.408+0000 7f797b7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79740be860 0x7f79740c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:07.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.408+0000 7f797b7ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79740bece0 con 0x7f79740c44a0 2023-08-31T19:01:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.408+0000 7f797b7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7974154690 con 0x7f79740be860 2023-08-31T19:01:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.408+0000 7f797b7ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79740bfb20 con 0x7f79740c5fb0 2023-08-31T19:01:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.408+0000 7f7978d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79740be860 0x7f79740c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:07.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.408+0000 7f7978d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79740be860 0x7f79740c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54342/0 (socket says 172.21.15.72:54342) 2023-08-31T19:01:07.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.408+0000 7f7978d9a700 1 -- 172.21.15.72:0/4234427961 learned_addr learned my addr 172.21.15.72:0/4234427961 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:07.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.408+0000 7f797959b700 1 --2- 172.21.15.72:0/4234427961 >> v2:172.21.15.146:3300/0 conn(0x7f79740c5fb0 0x7f79740be370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:07.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.408+0000 7f7978d9a700 1 -- 172.21.15.72:0/4234427961 >> v2:172.21.15.146:3300/0 conn(0x7f79740c5fb0 msgr2=0x7f79740be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:07.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.408+0000 7f7978d9a700 1 --2- 172.21.15.72:0/4234427961 >> v2:172.21.15.146:3300/0 conn(0x7f79740c5fb0 0x7f79740be370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:07.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.408+0000 7f7978d9a700 1 -- 172.21.15.72:0/4234427961 >> v1:172.21.15.146:6789/0 conn(0x7f79740c44a0 legacy=0x7f7974157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:07.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.408+0000 7f7978d9a700 1 -- 172.21.15.72:0/4234427961 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79740c4910 con 0x7f79740be860 2023-08-31T19:01:07.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.408+0000 7f797959b700 1 --2- 172.21.15.72:0/4234427961 >> v2:172.21.15.146:3300/0 conn(0x7f79740c5fb0 0x7f79740be370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:07.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.409+0000 7f7978d9a700 1 --2- 172.21.15.72:0/4234427961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79740be860 0x7f79740c3fb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f79740c37a0 tx=0x7f79640090f0).ready entity=mon.0 client_cookie=28f7740a77e997db server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:07.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.409+0000 7f796bfff700 1 -- 172.21.15.72:0/4234427961 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796400b600 con 0x7f79740be860 2023-08-31T19:01:07.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.409+0000 7f796bfff700 1 -- 172.21.15.72:0/4234427961 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796400b760 con 0x7f79740be860 2023-08-31T19:01:07.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.409+0000 7f796bfff700 1 -- 172.21.15.72:0/4234427961 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796400bae0 con 0x7f79740be860 2023-08-31T19:01:07.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.409+0000 7f797b7ff700 1 -- 172.21.15.72:0/4234427961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79740be860 msgr2=0x7f79740c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:07.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.409+0000 7f797b7ff700 1 --2- 172.21.15.72:0/4234427961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79740be860 0x7f79740c3fb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f79740c37a0 tx=0x7f79640090f0).stop 2023-08-31T19:01:07.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.409+0000 7f797b7ff700 1 -- 172.21.15.72:0/4234427961 shutdown_connections 2023-08-31T19:01:07.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.409+0000 7f797b7ff700 1 --2- 172.21.15.72:0/4234427961 >> v2:172.21.15.146:3300/0 conn(0x7f79740c5fb0 0x7f79740be370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:07.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.409+0000 7f797b7ff700 1 --2- 172.21.15.72:0/4234427961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79740be860 0x7f79740c3fb0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:07.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.409+0000 7f797b7ff700 1 -- 172.21.15.72:0/4234427961 >> 172.21.15.72:0/4234427961 conn(0x7f7974082f60 msgr2=0x7f797405e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:07.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.410+0000 7f797b7ff700 1 -- 172.21.15.72:0/4234427961 shutdown_connections 2023-08-31T19:01:07.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.410+0000 7f797b7ff700 1 -- 172.21.15.72:0/4234427961 wait complete. 2023-08-31T19:01:07.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.411+0000 7f797b7ff700 1 Processor -- start 2023-08-31T19:01:07.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.411+0000 7f797b7ff700 1 -- start start 2023-08-31T19:01:07.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.412+0000 7f797b7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79740be860 0x7f797413f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:07.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.412+0000 7f797b7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79740c44a0 0x7f7974152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:07.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.412+0000 7f797b7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79740c5fb0 0x7f79740c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:07.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.412+0000 7f797b7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79740abd40 con 0x7f79740be860 2023-08-31T19:01:07.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.412+0000 7f797b7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79740c2810 con 0x7f79740c5fb0 2023-08-31T19:01:07.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.412+0000 7f797b7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79740c2af0 con 0x7f79740c44a0 2023-08-31T19:01:07.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.412+0000 7f797959b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79740be860 0x7f797413f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:07.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.412+0000 7f797959b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79740be860 0x7f797413f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54346/0 (socket says 172.21.15.72:54346) 2023-08-31T19:01:07.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.412+0000 7f797959b700 1 -- 172.21.15.72:0/3159816136 learned_addr learned my addr 172.21.15.72:0/3159816136 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:07.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.413+0000 7f7978d9a700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79740c44a0 0x7f7974152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:07.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.413+0000 7f7979d9c700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79740c5fb0 0x7f79740c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:07.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.413+0000 7f797959b700 1 -- 172.21.15.72:0/3159816136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79740c44a0 msgr2=0x7f7974152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:07.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.413+0000 7f797959b700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79740c44a0 0x7f7974152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:07.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.413+0000 7f797959b700 1 -- 172.21.15.72:0/3159816136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79740c5fb0 msgr2=0x7f79740c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:07.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.413+0000 7f797959b700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79740c5fb0 0x7f79740c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:07.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.413+0000 7f797959b700 1 -- 172.21.15.72:0/3159816136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7964009370 con 0x7f79740be860 2023-08-31T19:01:07.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.413+0000 7f7978d9a700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79740c44a0 0x7f7974152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:01:07.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.413+0000 7f7979d9c700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79740c5fb0 0x7f79740c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:01:07.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.413+0000 7f797959b700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79740be860 0x7f797413f330 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f797000d860 tx=0x7f7970008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:07.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.413+0000 7f79697fa700 1 -- 172.21.15.72:0/3159816136 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970017070 con 0x7f79740be860 2023-08-31T19:01:07.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.413+0000 7f79697fa700 1 -- 172.21.15.72:0/3159816136 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7970005880 con 0x7f79740be860 2023-08-31T19:01:07.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.413+0000 7f797b7ff700 1 -- 172.21.15.72:0/3159816136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79740abf90 con 0x7f79740be860 2023-08-31T19:01:07.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.413+0000 7f79697fa700 1 -- 172.21.15.72:0/3159816136 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970005c00 con 0x7f79740be860 2023-08-31T19:01:07.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.413+0000 7f797b7ff700 1 -- 172.21.15.72:0/3159816136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79741533e0 con 0x7f79740be860 2023-08-31T19:01:07.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.414+0000 7f797b7ff700 1 -- 172.21.15.72:0/3159816136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79740ac5e0 con 0x7f79740be860 2023-08-31T19:01:07.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.415+0000 7f79697fa700 1 -- 172.21.15.72:0/3159816136 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7970006020 con 0x7f79740be860 2023-08-31T19:01:07.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.416+0000 7f79697fa700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f795805ef30 0x7f79580613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:07.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.416+0000 7f79697fa700 1 -- 172.21.15.72:0/3159816136 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7f797007a230 con 0x7f79740be860 2023-08-31T19:01:07.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.416+0000 7f7978d9a700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f795805ef30 0x7f79580613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:07.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.417+0000 7f7978d9a700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f795805ef30 0x7f79580613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f7964009130 tx=0x7f7964017000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:07.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.420+0000 7f79697fa700 1 -- 172.21.15.72:0/3159816136 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f797004b220 con 0x7f79740be860 2023-08-31T19:01:07.505 INFO:tasks.ceph.mds.c.smithi072.stderr:2023-08-31T19:01:07.505+0000 7fdd161f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:01:07.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.629+0000 7f797b7ff700 1 -- 172.21.15.72:0/3159816136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f797406c6b0 con 0x7f79740be860 2023-08-31T19:01:07.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.629+0000 7f79697fa700 1 -- 172.21.15.72:0/3159816136 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f797004e840 con 0x7f79740be860 2023-08-31T19:01:07.630 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:01:07.630 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1085369530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1085369530},{"type":"v1","addr":"172.21.15.146:6834","nonce":1085369530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3852978729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3852978729},{"type":"v1","addr":"172.21.15.146:6835","nonce":3852978729}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/654480318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":654480318},{"type":"v1","addr":"172.21.15.72:6835","nonce":654480318}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:01:01.982648+0000","modified":"2023-08-31T19:01:05.003693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3101703480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3101703480},{"type":"v1","addr":"172.21.15.72:6837","nonce":3101703480}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-31T19:01:07.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.631+0000 7f797b7ff700 1 -- 172.21.15.72:0/3159816136 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f795805ef30 msgr2=0x7f79580613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:07.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.631+0000 7f797b7ff700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f795805ef30 0x7f79580613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f7964009130 tx=0x7f7964017000).stop 2023-08-31T19:01:07.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.631+0000 7f797b7ff700 1 -- 172.21.15.72:0/3159816136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79740be860 msgr2=0x7f797413f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:07.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.631+0000 7f797b7ff700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79740be860 0x7f797413f330 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f797000d860 tx=0x7f7970008040).stop 2023-08-31T19:01:07.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.631+0000 7f797b7ff700 1 -- 172.21.15.72:0/3159816136 shutdown_connections 2023-08-31T19:01:07.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.631+0000 7f797b7ff700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f795805ef30 0x7f79580613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:07.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.631+0000 7f797b7ff700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79740c5fb0 0x7f79740c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:07.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.632+0000 7f797b7ff700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79740be860 0x7f797413f330 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:07.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.632+0000 7f797b7ff700 1 --2- 172.21.15.72:0/3159816136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f79740c44a0 0x7f7974152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:07.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.632+0000 7f797b7ff700 1 -- 172.21.15.72:0/3159816136 >> 172.21.15.72:0/3159816136 conn(0x7f7974082f60 msgr2=0x7f797415a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:07.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.632+0000 7f797b7ff700 1 -- 172.21.15.72:0/3159816136 shutdown_connections 2023-08-31T19:01:07.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:07.632+0000 7f797b7ff700 1 -- 172.21.15.72:0/3159816136 wait complete. 2023-08-31T19:01:07.635 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 23 2023-08-31T19:01:08.052 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T19:01:01.982648+0000', 'modified': '2023-08-31T19:01:05.003693+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5781}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5781': {'gid': 5781, 'name': 'c', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6837/3101703480', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6836', 'nonce': 3101703480}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 3101703480}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-31T19:01:08.053 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T19:01:08.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-31T19:01:08.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.242+0000 7ff3d4dff700 1 Processor -- start 2023-08-31T19:01:08.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.242+0000 7ff3d4dff700 1 -- start start 2023-08-31T19:01:08.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.244+0000 7ff3d4dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d0153ca0 0x7ff3d0154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.244+0000 7ff3d4dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3d00ca4f0 0x7ff3d0063100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.244+0000 7ff3d4dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d00c9450 con 0x7ff3d00c8ee0 2023-08-31T19:01:08.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.244+0000 7ff3d4dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d00c9730 con 0x7ff3d00ca4f0 2023-08-31T19:01:08.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.244+0000 7ff3d4dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d00c9a10 con 0x7ff3d0153ca0 2023-08-31T19:01:08.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.244+0000 7ff3cdd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff3d00c8ee0 0x7ff3d0158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35244/0 (socket says 172.21.15.72:35244) 2023-08-31T19:01:08.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.244+0000 7ff3cdd9b700 1 -- 172.21.15.72:0/1365536789 learned_addr learned my addr 172.21.15.72:0/1365536789 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:01:08.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.244+0000 7ff3ced9d700 1 --2- 172.21.15.72:0/1365536789 >> v2:172.21.15.72:3300/0 conn(0x7ff3d00ca4f0 0x7ff3d0063100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.244+0000 7ff3ce59c700 1 --2- 172.21.15.72:0/1365536789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d0153ca0 0x7ff3d0154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.244+0000 7ff3cd59a700 1 -- 172.21.15.72:0/1365536789 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920481149 0 0) 0x7ff3d00c9450 con 0x7ff3d00c8ee0 2023-08-31T19:01:08.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.244+0000 7ff3cd59a700 1 -- 172.21.15.72:0/1365536789 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3b80033f0 con 0x7ff3d00c8ee0 2023-08-31T19:01:08.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.244+0000 7ff3ced9d700 1 -- 172.21.15.72:0/1365536789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d0153ca0 msgr2=0x7ff3d0154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:08.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.245+0000 7ff3ced9d700 1 --2- 172.21.15.72:0/1365536789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d0153ca0 0x7ff3d0154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.245+0000 7ff3ced9d700 1 -- 172.21.15.72:0/1365536789 >> v1:172.21.15.72:6789/0 conn(0x7ff3d00c8ee0 legacy=0x7ff3d0158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.245+0000 7ff3ced9d700 1 -- 172.21.15.72:0/1365536789 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d00c9cf0 con 0x7ff3d00ca4f0 2023-08-31T19:01:08.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.245+0000 7ff3ced9d700 1 --2- 172.21.15.72:0/1365536789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d00ca4f0 0x7ff3d0063100 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7ff3c8009e60 tx=0x7ff3c8009780).ready entity=mon.0 client_cookie=b3e84be5dfff6837 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:08.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.245+0000 7ff3cd59a700 1 -- 172.21.15.72:0/1365536789 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800e070 con 0x7ff3d00ca4f0 2023-08-31T19:01:08.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.245+0000 7ff3cd59a700 1 -- 172.21.15.72:0/1365536789 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c800bb60 con 0x7ff3d00ca4f0 2023-08-31T19:01:08.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.245+0000 7ff3cd59a700 1 -- 172.21.15.72:0/1365536789 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8012410 con 0x7ff3d00ca4f0 2023-08-31T19:01:08.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.245+0000 7ff3d4dff700 1 -- 172.21.15.72:0/1365536789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d00ca4f0 msgr2=0x7ff3d0063100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.245+0000 7ff3d4dff700 1 --2- 172.21.15.72:0/1365536789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d00ca4f0 0x7ff3d0063100 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7ff3c8009e60 tx=0x7ff3c8009780).stop 2023-08-31T19:01:08.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.246+0000 7ff3d4dff700 1 -- 172.21.15.72:0/1365536789 shutdown_connections 2023-08-31T19:01:08.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.246+0000 7ff3d4dff700 1 --2- 172.21.15.72:0/1365536789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d00ca4f0 0x7ff3d0063100 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.246+0000 7ff3d4dff700 1 --2- 172.21.15.72:0/1365536789 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d0153ca0 0x7ff3d0154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.246+0000 7ff3d4dff700 1 -- 172.21.15.72:0/1365536789 >> 172.21.15.72:0/1365536789 conn(0x7ff3d00cadb0 msgr2=0x7ff3d00cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:08.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.246+0000 7ff3d4dff700 1 -- 172.21.15.72:0/1365536789 shutdown_connections 2023-08-31T19:01:08.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.246+0000 7ff3d4dff700 1 -- 172.21.15.72:0/1365536789 wait complete. 2023-08-31T19:01:08.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.247+0000 7ff3d4dff700 1 Processor -- start 2023-08-31T19:01:08.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.247+0000 7ff3d4dff700 1 -- start start 2023-08-31T19:01:08.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.248+0000 7ff3d4dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d00c8ee0 0x7ff3d0147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.248+0000 7ff3d4dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3d00ca4f0 0x7ff3d00add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.248+0000 7ff3d4dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d0153ca0 0x7ff3d00ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.248+0000 7ff3d4dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d00af970 con 0x7ff3d00c8ee0 2023-08-31T19:01:08.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.248+0000 7ff3d4dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d0147a70 con 0x7ff3d00ca4f0 2023-08-31T19:01:08.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.248+0000 7ff3d4dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d00ae8d0 con 0x7ff3d0153ca0 2023-08-31T19:01:08.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.248+0000 7ff3ce59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d00c8ee0 0x7ff3d0147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3ce59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d00c8ee0 0x7ff3d0147030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54358/0 (socket says 172.21.15.72:54358) 2023-08-31T19:01:08.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3ce59c700 1 -- 172.21.15.72:0/1906716753 learned_addr learned my addr 172.21.15.72:0/1906716753 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:08.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3cdd9b700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3d00ca4f0 0x7ff3d00add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3ced9d700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d0153ca0 0x7ff3d00ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3ce59c700 1 -- 172.21.15.72:0/1906716753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d0153ca0 msgr2=0x7ff3d00ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3ce59c700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d0153ca0 0x7ff3d00ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3ce59c700 1 -- 172.21.15.72:0/1906716753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3d00ca4f0 msgr2=0x7ff3d00add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3ce59c700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3d00ca4f0 0x7ff3d00add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3ce59c700 1 -- 172.21.15.72:0/1906716753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c8009a20 con 0x7ff3d00c8ee0 2023-08-31T19:01:08.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3ced9d700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d0153ca0 0x7ff3d00ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:01:08.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3cdd9b700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3d00ca4f0 0x7ff3d00add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:01:08.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3ce59c700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d00c8ee0 0x7ff3d0147030 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7ff3c000d890 tx=0x7ff3c0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:08.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3be7fc700 1 -- 172.21.15.72:0/1906716753 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c00125f0 con 0x7ff3d00c8ee0 2023-08-31T19:01:08.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3be7fc700 1 -- 172.21.15.72:0/1906716753 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c0012750 con 0x7ff3d00c8ee0 2023-08-31T19:01:08.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3d4dff700 1 -- 172.21.15.72:0/1906716753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d00aebb0 con 0x7ff3d00c8ee0 2023-08-31T19:01:08.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3be7fc700 1 -- 172.21.15.72:0/1906716753 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0012ad0 con 0x7ff3d00c8ee0 2023-08-31T19:01:08.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.249+0000 7ff3d4dff700 1 -- 172.21.15.72:0/1906716753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d00af170 con 0x7ff3d00c8ee0 2023-08-31T19:01:08.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.251+0000 7ff3be7fc700 1 -- 172.21.15.72:0/1906716753 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff3c0013480 con 0x7ff3d00c8ee0 2023-08-31T19:01:08.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.253+0000 7ff3be7fc700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3b005ef30 0x7ff3b00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.253+0000 7ff3be7fc700 1 -- 172.21.15.72:0/1906716753 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7ff3c0079fe0 con 0x7ff3d00c8ee0 2023-08-31T19:01:08.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.253+0000 7ff3cdd9b700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3b005ef30 0x7ff3b00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.253+0000 7ff3cdd9b700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3b005ef30 0x7ff3b00613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff3c4005750 tx=0x7ff3c4009040).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:08.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.255+0000 7ff3ec218b80 1 Processor -- start 2023-08-31T19:01:08.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.255+0000 7ff3ec218b80 1 -- start start 2023-08-31T19:01:08.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3ec218b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f868972c0 0x557f868976a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3ec218b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f86892600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3ec218b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86892af0 0x557f86892f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3ec218b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f867d3db0 con 0x557f868dff60 2023-08-31T19:01:08.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3ec218b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f867e9030 con 0x557f86892af0 2023-08-31T19:01:08.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3ec218b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f867e9170 con 0x557f868972c0 2023-08-31T19:01:08.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3cdd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f86892600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3cdd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f86892600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54364/0 (socket says 172.21.15.72:54364) 2023-08-31T19:01:08.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3cdd9b700 1 -- 172.21.15.72:0/3850409082 learned_addr learned my addr 172.21.15.72:0/3850409082 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:08.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3ce59c700 1 --2- 172.21.15.72:0/3850409082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f868972c0 0x557f868976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3ced9d700 1 --2- 172.21.15.72:0/3850409082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86892af0 0x557f86892f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3cdd9b700 1 -- 172.21.15.72:0/3850409082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f868972c0 msgr2=0x557f868976a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3cdd9b700 1 --2- 172.21.15.72:0/3850409082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f868972c0 0x557f868976a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3cdd9b700 1 -- 172.21.15.72:0/3850409082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86892af0 msgr2=0x557f86892f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3cdd9b700 1 --2- 172.21.15.72:0/3850409082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86892af0 0x557f86892f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.256+0000 7ff3cdd9b700 1 -- 172.21.15.72:0/3850409082 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f867bbb00 con 0x557f868dff60 2023-08-31T19:01:08.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.257+0000 7ff3cdd9b700 1 --2- 172.21.15.72:0/3850409082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f86892600 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7ff3c40072f0 tx=0x7ff3c4007000).ready entity=mon.0 client_cookie=483482333dcf0c67 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:08.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.257+0000 7ff3af7fe700 1 -- 172.21.15.72:0/3850409082 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4005e40 con 0x557f868dff60 2023-08-31T19:01:08.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.257+0000 7ff3af7fe700 1 -- 172.21.15.72:0/3850409082 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c400d460 con 0x557f868dff60 2023-08-31T19:01:08.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.257+0000 7ff3af7fe700 1 -- 172.21.15.72:0/3850409082 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400d7e0 con 0x557f868dff60 2023-08-31T19:01:08.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.257+0000 7ff3ec218b80 1 -- 172.21.15.72:0/3850409082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 msgr2=0x557f86892600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.257+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/3850409082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f86892600 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7ff3c40072f0 tx=0x7ff3c4007000).stop 2023-08-31T19:01:08.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.258+0000 7ff3ec218b80 1 -- 172.21.15.72:0/3850409082 shutdown_connections 2023-08-31T19:01:08.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.258+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/3850409082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86892af0 0x557f86892f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.258+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/3850409082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f868972c0 0x557f868976a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.258+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/3850409082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f86892600 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.258+0000 7ff3ec218b80 1 -- 172.21.15.72:0/3850409082 >> 172.21.15.72:0/3850409082 conn(0x557f86701940 msgr2=0x557f868e03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:08.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.258+0000 7ff3ec218b80 1 -- 172.21.15.72:0/3850409082 shutdown_connections 2023-08-31T19:01:08.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.258+0000 7ff3ec218b80 1 -- 172.21.15.72:0/3850409082 wait complete. 2023-08-31T19:01:08.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.258+0000 7ff3ec218b80 1 -- start start 2023-08-31T19:01:08.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.259+0000 7ff3ec218b80 1 Processor -- start 2023-08-31T19:01:08.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ec218b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f86892af0 0x557f868c2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ec218b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f868972c0 0x557f868d7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ec218b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868be880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ec218b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f867e93f0 con 0x557f868dff60 2023-08-31T19:01:08.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ec218b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f867b4920 con 0x557f868972c0 2023-08-31T19:01:08.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ec218b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f868c4ba0 con 0x557f86892af0 2023-08-31T19:01:08.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ec218b80 10 client.0 ll_register_callbacks cb 0x557f86789ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:01:08.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ced9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ced9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868be880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54374/0 (socket says 172.21.15.72:54374) 2023-08-31T19:01:08.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ced9d700 1 -- 172.21.15.72:0/1402762701 learned_addr learned my addr 172.21.15.72:0/1402762701 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:08.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ce59c700 1 --2- 172.21.15.72:0/1402762701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f86892af0 0x557f868c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3cdd9b700 1 --2- 172.21.15.72:0/1402762701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f868972c0 0x557f868d7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ced9d700 1 -- 172.21.15.72:0/1402762701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f86892af0 msgr2=0x557f868c2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:08.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ced9d700 1 --2- 172.21.15.72:0/1402762701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f86892af0 0x557f868c2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ced9d700 1 -- 172.21.15.72:0/1402762701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f868972c0 msgr2=0x557f868d7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:08.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ced9d700 1 --2- 172.21.15.72:0/1402762701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f868972c0 0x557f868d7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.260+0000 7ff3ced9d700 1 -- 172.21.15.72:0/1402762701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b80033f0 con 0x557f868dff60 2023-08-31T19:01:08.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3ced9d700 1 --2- 172.21.15.72:0/1402762701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868be880 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7ff3d00c1de0 tx=0x7ff3c8009780).ready entity=mon.0 client_cookie=541ab263f90219c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:08.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3acff9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:01:08.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3acff9700 1 -- 172.21.15.72:0/1402762701 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800b6f0 con 0x557f868dff60 2023-08-31T19:01:08.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3ec218b80 1 -- 172.21.15.72:0/1402762701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f86891aa0 con 0x557f868dff60 2023-08-31T19:01:08.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3acff9700 1 -- 172.21.15.72:0/1402762701 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7ff3c8012e10 con 0x557f868dff60 2023-08-31T19:01:08.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3acff9700 1 -- 172.21.15.72:0/1402762701 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3c801e610 con 0x557f868dff60 2023-08-31T19:01:08.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3ec218b80 10 client.5928 fetch_fsmap learned FSMap version 23 2023-08-31T19:01:08.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3ec218b80 1 -- 172.21.15.72:0/1402762701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x557f867e1f70 con 0x557f868dff60 2023-08-31T19:01:08.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3acff9700 1 -- 172.21.15.72:0/1402762701 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f86891aa0 con 0x557f868dff60 2023-08-31T19:01:08.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3acff9700 1 -- 172.21.15.72:0/1402762701 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff3c800b050 con 0x557f868dff60 2023-08-31T19:01:08.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3ec218b80 10 client.5928 fetch_fsmap finished waiting for FSMap version 23 2023-08-31T19:01:08.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3ec218b80 10 client.5928 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-31T19:01:08.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3ec218b80 20 client.5928 populate_metadata read hostname 'smithi072' 2023-08-31T19:01:08.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/1402762701 >> [v2:172.21.15.72:6836/3101703480,v1:172.21.15.72:6837/3101703480] conn(0x557f868c5540 0x557f868c5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3ec218b80 4 client.5928 mds_command: new command op to 5781 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T19:01:08.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.261+0000 7ff3ec218b80 1 -- 172.21.15.72:0/1402762701 --> [v2:172.21.15.72:6836/3101703480,v1:172.21.15.72:6837/3101703480] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f86651ef0 con 0x557f868c5540 2023-08-31T19:01:08.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.262+0000 7ff3ce59c700 1 --2- 172.21.15.72:0/1402762701 >> [v2:172.21.15.72:6836/3101703480,v1:172.21.15.72:6837/3101703480] conn(0x557f868c5540 0x557f868c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.262+0000 7ff3ce59c700 1 --2- 172.21.15.72:0/1402762701 >> [v2:172.21.15.72:6836/3101703480,v1:172.21.15.72:6837/3101703480] conn(0x557f868c5540 0x557f868c5920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c287f598cdfd5f9c server_cookie=5c0ec41aaa9fe5d5 in_seq=0 out_seq=0 2023-08-31T19:01:08.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.262+0000 7ff3acff9700 10 client.5928 ms_handle_connect on v2:172.21.15.72:6836/3101703480 2023-08-31T19:01:08.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.263+0000 7ff3acff9700 1 -- 172.21.15.72:0/1402762701 <== mds.0 v2:172.21.15.72:6836/3101703480 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x557f86651ef0 con 0x557f868c5540 2023-08-31T19:01:08.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.263+0000 7ff3acff9700 10 client.5928 handle_command_reply: tid=0 2023-08-31T19:01:08.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.263+0000 7ff3ec218b80 1 client.5928 shutdown 2023-08-31T19:01:08.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.263+0000 7ff3ec218b80 1 -- 172.21.15.72:0/1402762701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 msgr2=0x557f868be880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.263+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/1402762701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868be880 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7ff3d00c1de0 tx=0x7ff3c8009780).stop 2023-08-31T19:01:08.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.263+0000 7ff3ec218b80 1 -- 172.21.15.72:0/1402762701 shutdown_connections 2023-08-31T19:01:08.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.263+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/1402762701 >> [v2:172.21.15.72:6836/3101703480,v1:172.21.15.72:6837/3101703480] conn(0x557f868c5540 0x557f868c5920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.263+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/1402762701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868be880 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.263+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/1402762701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f86892af0 0x557f868c2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.263+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/1402762701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f868972c0 0x557f868d7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.263+0000 7ff3ec218b80 1 -- 172.21.15.72:0/1402762701 >> 172.21.15.72:0/1402762701 conn(0x557f86701940 msgr2=0x557f86895330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:08.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.263+0000 7ff3acff9700 0 client.5928 ms_handle_reset on v2:172.21.15.72:6836/3101703480 2023-08-31T19:01:08.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.263+0000 7ff3ec218b80 1 -- 172.21.15.72:0/1402762701 shutdown_connections 2023-08-31T19:01:08.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.263+0000 7ff3ec218b80 1 -- 172.21.15.72:0/1402762701 wait complete. 2023-08-31T19:01:08.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.263+0000 7ff3ec218b80 20 client.5928 trim_cache size 0 max 16384 2023-08-31T19:01:08.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.280+0000 7ff3ec218b80 1 Processor -- start 2023-08-31T19:01:08.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.280+0000 7ff3ec218b80 1 -- start start 2023-08-31T19:01:08.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.281+0000 7ff3ec218b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86892af0 0x557f8688dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.281+0000 7ff3ec218b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f868972c0 0x557f8688e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.281+0000 7ff3ec218b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868930a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.281+0000 7ff3ec218b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f86899350 con 0x557f868dff60 2023-08-31T19:01:08.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.281+0000 7ff3ec218b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f86891aa0 con 0x557f86892af0 2023-08-31T19:01:08.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.281+0000 7ff3ec218b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f868c1710 con 0x557f868972c0 2023-08-31T19:01:08.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.281+0000 7ff3ced9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868930a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.281+0000 7ff3ced9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868930a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54378/0 (socket says 172.21.15.72:54378) 2023-08-31T19:01:08.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.281+0000 7ff3ced9d700 1 -- 172.21.15.72:0/2878962795 learned_addr learned my addr 172.21.15.72:0/2878962795 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:08.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.282+0000 7ff3cdd9b700 1 --2- 172.21.15.72:0/2878962795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f868972c0 0x557f8688e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.282+0000 7ff3ce59c700 1 --2- 172.21.15.72:0/2878962795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86892af0 0x557f8688dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.282+0000 7ff3ced9d700 1 -- 172.21.15.72:0/2878962795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f868972c0 msgr2=0x557f8688e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:08.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.282+0000 7ff3ced9d700 1 --2- 172.21.15.72:0/2878962795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f868972c0 0x557f8688e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.282+0000 7ff3ced9d700 1 -- 172.21.15.72:0/2878962795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86892af0 msgr2=0x557f8688dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:08.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.282+0000 7ff3ced9d700 1 --2- 172.21.15.72:0/2878962795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86892af0 0x557f8688dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.282+0000 7ff3ced9d700 1 -- 172.21.15.72:0/2878962795 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f867dd580 con 0x557f868dff60 2023-08-31T19:01:08.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.282+0000 7ff3ce59c700 1 --2- 172.21.15.72:0/2878962795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86892af0 0x557f8688dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:08.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.282+0000 7ff3cdd9b700 1 --2- 172.21.15.72:0/2878962795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f868972c0 0x557f8688e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:08.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.282+0000 7ff3ced9d700 1 --2- 172.21.15.72:0/2878962795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868930a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7ff3c80094b0 tx=0x7ff3c801f000).ready entity=mon.0 client_cookie=f519055da6fe3312 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:08.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.282+0000 7ff3affff700 1 -- 172.21.15.72:0/2878962795 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800b0d0 con 0x557f868dff60 2023-08-31T19:01:08.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.282+0000 7ff3affff700 1 -- 172.21.15.72:0/2878962795 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c800b6c0 con 0x557f868dff60 2023-08-31T19:01:08.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.282+0000 7ff3affff700 1 -- 172.21.15.72:0/2878962795 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c801e9a0 con 0x557f868dff60 2023-08-31T19:01:08.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.283+0000 7ff3ec218b80 1 -- 172.21.15.72:0/2878962795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 msgr2=0x557f868930a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.283+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/2878962795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868930a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7ff3c80094b0 tx=0x7ff3c801f000).stop 2023-08-31T19:01:08.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.283+0000 7ff3ec218b80 1 -- 172.21.15.72:0/2878962795 shutdown_connections 2023-08-31T19:01:08.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.283+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/2878962795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868930a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.283+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/2878962795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f86892af0 0x557f8688dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.283+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/2878962795 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f868972c0 0x557f8688e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.283+0000 7ff3ec218b80 1 -- 172.21.15.72:0/2878962795 >> 172.21.15.72:0/2878962795 conn(0x557f86701940 msgr2=0x557f868e03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:08.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.283+0000 7ff3ec218b80 1 -- 172.21.15.72:0/2878962795 shutdown_connections 2023-08-31T19:01:08.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.283+0000 7ff3ec218b80 1 -- 172.21.15.72:0/2878962795 wait complete. 2023-08-31T19:01:08.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.284+0000 7ff3ec218b80 1 -- start start 2023-08-31T19:01:08.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.284+0000 7ff3ec218b80 1 Processor -- start 2023-08-31T19:01:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.285+0000 7ff3ec218b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f86892af0 0x557f86897780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.285+0000 7ff3ec218b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f868972c0 0x557f8693f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.285+0000 7ff3ec218b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868c0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.285+0000 7ff3ec218b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f86942090 con 0x557f868dff60 2023-08-31T19:01:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.285+0000 7ff3ec218b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f86894b30 con 0x557f868972c0 2023-08-31T19:01:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.285+0000 7ff3ec218b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f8693f580 con 0x557f86892af0 2023-08-31T19:01:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.285+0000 7ff3ec218b80 10 client.0 ll_register_callbacks cb 0x557f86789ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:01:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.285+0000 7ff3ced9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.285+0000 7ff3ced9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868c0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54384/0 (socket says 172.21.15.72:54384) 2023-08-31T19:01:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.285+0000 7ff3ced9d700 1 -- 172.21.15.72:0/2606622615 learned_addr learned my addr 172.21.15.72:0/2606622615 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.285+0000 7ff3ce59c700 1 --2- 172.21.15.72:0/2606622615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f86892af0 0x557f86897780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.285+0000 7ff3cdd9b700 1 --2- 172.21.15.72:0/2606622615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f868972c0 0x557f8693f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.285+0000 7ff3ced9d700 1 -- 172.21.15.72:0/2606622615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f86892af0 msgr2=0x557f86897780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:08.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.285+0000 7ff3ced9d700 1 --2- 172.21.15.72:0/2606622615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f86892af0 0x557f86897780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.286+0000 7ff3ced9d700 1 -- 172.21.15.72:0/2606622615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f868972c0 msgr2=0x557f8693f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:08.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.286+0000 7ff3ced9d700 1 --2- 172.21.15.72:0/2606622615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f868972c0 0x557f8693f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.286+0000 7ff3ced9d700 1 -- 172.21.15.72:0/2606622615 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f867e1f70 con 0x557f868dff60 2023-08-31T19:01:08.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.286+0000 7ff3cdd9b700 1 --2- 172.21.15.72:0/2606622615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f868972c0 0x557f8693f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:08.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.286+0000 7ff3ced9d700 1 --2- 172.21.15.72:0/2606622615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868c0450 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7ff3c800b040 tx=0x7ff3c8034040).ready entity=mon.0 client_cookie=c9f634b8de294821 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:08.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.286+0000 7ff3acff9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:01:08.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.286+0000 7ff3acff9700 1 -- 172.21.15.72:0/2606622615 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c803b450 con 0x557f868dff60 2023-08-31T19:01:08.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.286+0000 7ff3acff9700 1 -- 172.21.15.72:0/2606622615 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7ff3c803b5b0 con 0x557f868dff60 2023-08-31T19:01:08.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.286+0000 7ff3ec218b80 1 -- 172.21.15.72:0/2606622615 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff3c400d460 con 0x557f868dff60 2023-08-31T19:01:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.286+0000 7ff3acff9700 1 -- 172.21.15.72:0/2606622615 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3c803b980 con 0x557f868dff60 2023-08-31T19:01:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.286+0000 7ff3ec218b80 10 client.5934 fetch_fsmap learned FSMap version 23 2023-08-31T19:01:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.286+0000 7ff3ec218b80 1 -- 172.21.15.72:0/2606622615 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x557f867dd2d0 con 0x557f868dff60 2023-08-31T19:01:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.286+0000 7ff3acff9700 1 -- 172.21.15.72:0/2606622615 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c400d460 con 0x557f868dff60 2023-08-31T19:01:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.287+0000 7ff3acff9700 1 -- 172.21.15.72:0/2606622615 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff3c8045070 con 0x557f868dff60 2023-08-31T19:01:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.287+0000 7ff3ec218b80 10 client.5934 fetch_fsmap finished waiting for FSMap version 23 2023-08-31T19:01:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.287+0000 7ff3ec218b80 10 client.5934 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-31T19:01:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.287+0000 7ff3ec218b80 20 client.5934 populate_metadata read hostname 'smithi072' 2023-08-31T19:01:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.287+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/2606622615 >> [v2:172.21.15.72:6836/3101703480,v1:172.21.15.72:6837/3101703480] conn(0x557f86945400 0x557f869457e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.287+0000 7ff3ec218b80 4 client.5934 mds_command: new command op to 5781 tid=0[{"prefix": "status"}] 2023-08-31T19:01:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.287+0000 7ff3ec218b80 1 -- 172.21.15.72:0/2606622615 --> [v2:172.21.15.72:6836/3101703480,v1:172.21.15.72:6837/3101703480] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557f86687040 con 0x557f86945400 2023-08-31T19:01:08.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.287+0000 7ff3ce59c700 1 --2- 172.21.15.72:0/2606622615 >> [v2:172.21.15.72:6836/3101703480,v1:172.21.15.72:6837/3101703480] conn(0x557f86945400 0x557f869457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.287+0000 7ff3acff9700 10 client.5934 ms_handle_connect on v2:172.21.15.72:6836/3101703480 2023-08-31T19:01:08.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.287+0000 7ff3ce59c700 1 --2- 172.21.15.72:0/2606622615 >> [v2:172.21.15.72:6836/3101703480,v1:172.21.15.72:6837/3101703480] conn(0x557f86945400 0x557f869457e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6d7b2b35acb89682 server_cookie=4a91e51536674a28 in_seq=0 out_seq=0 2023-08-31T19:01:08.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.287+0000 7ff3acff9700 1 -- 172.21.15.72:0/2606622615 <== mds.0 v2:172.21.15.72:6836/3101703480 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x557f86687040 con 0x557f86945400 2023-08-31T19:01:08.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.287+0000 7ff3acff9700 10 client.5934 handle_command_reply: tid=0 2023-08-31T19:01:08.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.287+0000 7ff3ec218b80 1 client.5934 shutdown 2023-08-31T19:01:08.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3ec218b80 1 -- 172.21.15.72:0/2606622615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 msgr2=0x557f868c0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/2606622615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868c0450 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7ff3c800b040 tx=0x7ff3c8034040).stop 2023-08-31T19:01:08.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3ec218b80 1 -- 172.21.15.72:0/2606622615 shutdown_connections 2023-08-31T19:01:08.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/2606622615 >> [v2:172.21.15.72:6836/3101703480,v1:172.21.15.72:6837/3101703480] conn(0x557f86945400 0x557f869457e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/2606622615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557f868dff60 0x557f868c0450 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/2606622615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557f86892af0 0x557f86897780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3acff9700 0 client.5934 ms_handle_reset on v2:172.21.15.72:6836/3101703480 2023-08-31T19:01:08.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3ec218b80 1 --2- 172.21.15.72:0/2606622615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557f868972c0 0x557f8693f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3ec218b80 1 -- 172.21.15.72:0/2606622615 >> 172.21.15.72:0/2606622615 conn(0x557f86701940 msgr2=0x557f868930a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:08.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3ec218b80 1 -- 172.21.15.72:0/2606622615 shutdown_connections 2023-08-31T19:01:08.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3ec218b80 1 -- 172.21.15.72:0/2606622615 wait complete. 2023-08-31T19:01:08.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3ec218b80 20 client.5934 trim_cache size 0 max 16384 2023-08-31T19:01:08.304 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:01:08.305 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "acadb8ca-1685-49e1-a73f-5e9d14d95be9", 2023-08-31T19:01:08.305 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-08-31T19:01:08.305 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 5781, 2023-08-31T19:01:08.305 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-08-31T19:01:08.305 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-08-31T19:01:08.306 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-08-31T19:01:08.306 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 6.3029750529999999, 2023-08-31T19:01:08.306 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 23, 2023-08-31T19:01:08.306 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 61, 2023-08-31T19:01:08.306 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 61, 2023-08-31T19:01:08.307 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 11.530205625000001 2023-08-31T19:01:08.307 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:01:08.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3d4dff700 1 -- 172.21.15.72:0/1906716753 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3b005ef30 msgr2=0x7ff3b00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3d4dff700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3b005ef30 0x7ff3b00613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff3c4005750 tx=0x7ff3c4009040).stop 2023-08-31T19:01:08.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3d4dff700 1 -- 172.21.15.72:0/1906716753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d00c8ee0 msgr2=0x7ff3d0147030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.288+0000 7ff3d4dff700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d00c8ee0 0x7ff3d0147030 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7ff3c000d890 tx=0x7ff3c0008040).stop 2023-08-31T19:01:08.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.289+0000 7ff3d4dff700 1 -- 172.21.15.72:0/1906716753 shutdown_connections 2023-08-31T19:01:08.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.289+0000 7ff3d4dff700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3d0153ca0 0x7ff3d00ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.289+0000 7ff3d4dff700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d00c8ee0 0x7ff3d0147030 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.289+0000 7ff3d4dff700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3b005ef30 0x7ff3b00613f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.289+0000 7ff3d4dff700 1 --2- 172.21.15.72:0/1906716753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3d00ca4f0 0x7ff3d00add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.289+0000 7ff3d4dff700 1 -- 172.21.15.72:0/1906716753 >> 172.21.15.72:0/1906716753 conn(0x7ff3d00cadb0 msgr2=0x7ff3d00ab7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:08.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.289+0000 7ff3d4dff700 1 -- 172.21.15.72:0/1906716753 shutdown_connections 2023-08-31T19:01:08.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.289+0000 7ff3d4dff700 1 -- 172.21.15.72:0/1906716753 wait complete. 2023-08-31T19:01:08.311 DEBUG:teuthology.orchestra.run.smithi072:> ceph fs ls 2023-08-31T19:01:08.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.470+0000 7f54769ff700 1 Processor -- start 2023-08-31T19:01:08.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.470+0000 7f54769ff700 1 -- start start 2023-08-31T19:01:08.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.471+0000 7f54769ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5470154460 0x7f54700c1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.471+0000 7f54769ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54700ca080 con 0x7f54700ca510 2023-08-31T19:01:08.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.471+0000 7f54769ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54700c72d0 con 0x7f54700a8200 2023-08-31T19:01:08.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.471+0000 7f54769ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54700c9750 con 0x7f5470154460 2023-08-31T19:01:08.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.472+0000 7f546f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f54700ca510 0x7f54700a7af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35254/0 (socket says 172.21.15.72:35254) 2023-08-31T19:01:08.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.472+0000 7f546f7fe700 1 -- 172.21.15.72:0/306535412 learned_addr learned my addr 172.21.15.72:0/306535412 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:01:08.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.472+0000 7f546ffff700 1 --2- 172.21.15.72:0/306535412 >> v2:172.21.15.146:3300/0 conn(0x7f5470154460 0x7f54700c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.472+0000 7f546effd700 1 -- 172.21.15.72:0/306535412 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559302868 0 0) 0x7f54700ca080 con 0x7f54700ca510 2023-08-31T19:01:08.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.472+0000 7f546effd700 1 -- 172.21.15.72:0/306535412 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54580033f0 con 0x7f54700ca510 2023-08-31T19:01:08.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.472+0000 7f546effd700 1 -- 172.21.15.72:0/306535412 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2648739548 0 0) 0x7f54580033f0 con 0x7f54700ca510 2023-08-31T19:01:08.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.472+0000 7f546effd700 1 -- 172.21.15.72:0/306535412 >> v2:172.21.15.146:3300/0 conn(0x7f5470154460 msgr2=0x7f54700c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:08.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.472+0000 7f546effd700 1 --2- 172.21.15.72:0/306535412 >> v2:172.21.15.146:3300/0 conn(0x7f5470154460 0x7f54700c1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.472+0000 7f546effd700 1 -- 172.21.15.72:0/306535412 >> v1:172.21.15.146:6789/0 conn(0x7f54700a8200 legacy=0x7f54700c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.472+0000 7f546effd700 1 -- 172.21.15.72:0/306535412 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54700c9a30 con 0x7f54700ca510 2023-08-31T19:01:08.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.472+0000 7f546effd700 1 -- 172.21.15.72:0/306535412 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f5464001470 con 0x7f54700ca510 2023-08-31T19:01:08.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f546effd700 1 -- 172.21.15.72:0/306535412 >> v1:172.21.15.72:6789/0 conn(0x7f54700ca510 legacy=0x7f54700a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f546effd700 1 --2- 172.21.15.72:0/306535412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54580038e0 0x7f5458003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f546effd700 1 --2- 172.21.15.72:0/306535412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5458004690 0x7f5458004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f546effd700 1 --2- 172.21.15.72:0/306535412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5458005000 0x7f545800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f546effd700 1 -- 172.21.15.72:0/306535412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54700c9750 con 0x7f5458004690 2023-08-31T19:01:08.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f546effd700 1 -- 172.21.15.72:0/306535412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545800bf60 con 0x7f54580038e0 2023-08-31T19:01:08.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f546effd700 1 -- 172.21.15.72:0/306535412 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545800c0f0 con 0x7f5458005000 2023-08-31T19:01:08.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f546f7fe700 1 --2- 172.21.15.72:0/306535412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5458004690 0x7f5458004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f546ffff700 1 --2- 172.21.15.72:0/306535412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54580038e0 0x7f5458003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f5474f9c700 1 --2- 172.21.15.72:0/306535412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5458005000 0x7f545800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f546f7fe700 1 -- 172.21.15.72:0/306535412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5458005000 msgr2=0x7f545800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:08.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f546f7fe700 1 --2- 172.21.15.72:0/306535412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5458005000 0x7f545800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f546f7fe700 1 -- 172.21.15.72:0/306535412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54580038e0 msgr2=0x7f5458003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:08.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f546f7fe700 1 --2- 172.21.15.72:0/306535412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54580038e0 0x7f5458003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f546f7fe700 1 -- 172.21.15.72:0/306535412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54580033f0 con 0x7f5458004690 2023-08-31T19:01:08.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.473+0000 7f5474f9c700 1 -- 172.21.15.72:0/306535412 reap_dead start 2023-08-31T19:01:08.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.474+0000 7f546f7fe700 1 --2- 172.21.15.72:0/306535412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5458004690 0x7f5458004b10 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f546400c190 tx=0x7f5464001e50).ready entity=mon.0 client_cookie=9891c0aeafc079d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:08.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.474+0000 7f546effd700 1 -- 172.21.15.72:0/306535412 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464007a20 con 0x7f5458004690 2023-08-31T19:01:08.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.474+0000 7f546effd700 1 -- 172.21.15.72:0/306535412 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546400cac0 con 0x7f5458004690 2023-08-31T19:01:08.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.474+0000 7f546effd700 1 -- 172.21.15.72:0/306535412 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546400ce40 con 0x7f5458004690 2023-08-31T19:01:08.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.474+0000 7f54769ff700 1 -- 172.21.15.72:0/306535412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5458004690 msgr2=0x7f5458004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.474+0000 7f54769ff700 1 --2- 172.21.15.72:0/306535412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5458004690 0x7f5458004b10 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f546400c190 tx=0x7f5464001e50).stop 2023-08-31T19:01:08.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.474+0000 7f54769ff700 1 -- 172.21.15.72:0/306535412 shutdown_connections 2023-08-31T19:01:08.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.474+0000 7f54769ff700 1 --2- 172.21.15.72:0/306535412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5458004690 0x7f5458004b10 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.474+0000 7f54769ff700 1 -- 172.21.15.72:0/306535412 >> 172.21.15.72:0/306535412 conn(0x7f547006a560 msgr2=0x7f54700cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:08.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.474+0000 7f54769ff700 1 -- 172.21.15.72:0/306535412 shutdown_connections 2023-08-31T19:01:08.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.474+0000 7f54769ff700 1 -- 172.21.15.72:0/306535412 wait complete. 2023-08-31T19:01:08.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.476+0000 7f54769ff700 1 Processor -- start 2023-08-31T19:01:08.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.477+0000 7f54769ff700 1 -- start start 2023-08-31T19:01:08.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.478+0000 7f54769ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5458004690 0x7f54701568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.478+0000 7f54769ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5470164af0 0x7f54700c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.478+0000 7f54769ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54700c79e0 0x7f5470154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.478+0000 7f54769ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5470156dc0 con 0x7f54700c79e0 2023-08-31T19:01:08.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.478+0000 7f54769ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5470168110 con 0x7f5470164af0 2023-08-31T19:01:08.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.478+0000 7f54769ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54700c7e60 con 0x7f5458004690 2023-08-31T19:01:08.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.478+0000 7f5474f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54700c79e0 0x7f5470154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.478+0000 7f5474f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54700c79e0 0x7f5470154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54400/0 (socket says 172.21.15.72:54400) 2023-08-31T19:01:08.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.478+0000 7f5474f9c700 1 -- 172.21.15.72:0/628286572 learned_addr learned my addr 172.21.15.72:0/628286572 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:08.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.478+0000 7f546f7fe700 1 --2- 172.21.15.72:0/628286572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5470164af0 0x7f54700c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.478+0000 7f546ffff700 1 --2- 172.21.15.72:0/628286572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5458004690 0x7f54701568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.479+0000 7f5474f9c700 1 -- 172.21.15.72:0/628286572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5458004690 msgr2=0x7f54701568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.479+0000 7f5474f9c700 1 --2- 172.21.15.72:0/628286572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5458004690 0x7f54701568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.479+0000 7f5474f9c700 1 -- 172.21.15.72:0/628286572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5470164af0 msgr2=0x7f54700c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.479+0000 7f5474f9c700 1 --2- 172.21.15.72:0/628286572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5470164af0 0x7f54700c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.479+0000 7f5474f9c700 1 -- 172.21.15.72:0/628286572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5470156fb0 con 0x7f54700c79e0 2023-08-31T19:01:08.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.479+0000 7f546f7fe700 1 --2- 172.21.15.72:0/628286572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5470164af0 0x7f54700c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:08.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.479+0000 7f5474f9c700 1 --2- 172.21.15.72:0/628286572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54700c79e0 0x7f5470154840 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f546800e8e0 tx=0x7f5468007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:08.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.479+0000 7f5457fff700 1 -- 172.21.15.72:0/628286572 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468004100 con 0x7f54700c79e0 2023-08-31T19:01:08.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.479+0000 7f5457fff700 1 -- 172.21.15.72:0/628286572 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5468006a20 con 0x7f54700c79e0 2023-08-31T19:01:08.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.479+0000 7f54769ff700 1 -- 172.21.15.72:0/628286572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54701677e0 con 0x7f54700c79e0 2023-08-31T19:01:08.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.479+0000 7f5457fff700 1 -- 172.21.15.72:0/628286572 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468006dc0 con 0x7f54700c79e0 2023-08-31T19:01:08.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.479+0000 7f54769ff700 1 -- 172.21.15.72:0/628286572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5470167da0 con 0x7f54700c79e0 2023-08-31T19:01:08.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.480+0000 7f54769ff700 1 -- 172.21.15.72:0/628286572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5470167f60 con 0x7f54700c79e0 2023-08-31T19:01:08.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.481+0000 7f5457fff700 1 -- 172.21.15.72:0/628286572 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f546800c9f0 con 0x7f54700c79e0 2023-08-31T19:01:08.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.482+0000 7f5457fff700 1 --2- 172.21.15.72:0/628286572 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f545c05ef30 0x7f545c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:08.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.482+0000 7f5457fff700 1 -- 172.21.15.72:0/628286572 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7f5468079e50 con 0x7f54700c79e0 2023-08-31T19:01:08.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.482+0000 7f546ffff700 1 --2- 172.21.15.72:0/628286572 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f545c05ef30 0x7f545c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:08.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.482+0000 7f546ffff700 1 --2- 172.21.15.72:0/628286572 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f545c05ef30 0x7f545c0613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5470061c70 tx=0x7f5460008040).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:08.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.486+0000 7f5457fff700 1 -- 172.21.15.72:0/628286572 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f54680498f0 con 0x7f54700c79e0 2023-08-31T19:01:08.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.696+0000 7f54769ff700 1 -- 172.21.15.72:0/628286572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5470047480 con 0x7f54700c79e0 2023-08-31T19:01:08.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.696+0000 7f5457fff700 1 -- 172.21.15.72:0/628286572 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f546804ae40 con 0x7f54700c79e0 2023-08-31T19:01:08.697 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T19:01:08.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.698+0000 7f54769ff700 1 -- 172.21.15.72:0/628286572 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f545c05ef30 msgr2=0x7f545c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.698+0000 7f54769ff700 1 --2- 172.21.15.72:0/628286572 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f545c05ef30 0x7f545c0613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5470061c70 tx=0x7f5460008040).stop 2023-08-31T19:01:08.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.698+0000 7f54769ff700 1 -- 172.21.15.72:0/628286572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54700c79e0 msgr2=0x7f5470154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:08.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.698+0000 7f54769ff700 1 --2- 172.21.15.72:0/628286572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54700c79e0 0x7f5470154840 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f546800e8e0 tx=0x7f5468007f30).stop 2023-08-31T19:01:08.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.698+0000 7f54769ff700 1 -- 172.21.15.72:0/628286572 shutdown_connections 2023-08-31T19:01:08.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.699+0000 7f54769ff700 1 --2- 172.21.15.72:0/628286572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54700c79e0 0x7f5470154840 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.699+0000 7f54769ff700 1 --2- 172.21.15.72:0/628286572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5458004690 0x7f54701568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.699+0000 7f54769ff700 1 --2- 172.21.15.72:0/628286572 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f545c05ef30 0x7f545c0613f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.699+0000 7f54769ff700 1 --2- 172.21.15.72:0/628286572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5470164af0 0x7f54700c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:08.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.699+0000 7f54769ff700 1 -- 172.21.15.72:0/628286572 >> 172.21.15.72:0/628286572 conn(0x7f547006a560 msgr2=0x7f54700a9020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:08.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.699+0000 7f54769ff700 1 -- 172.21.15.72:0/628286572 shutdown_connections 2023-08-31T19:01:08.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:08.699+0000 7f54769ff700 1 -- 172.21.15.72:0/628286572 wait complete. 2023-08-31T19:01:08.713 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-31T19:01:08.713 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:01:08.714 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-31T19:01:08.714 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T19:01:08.715 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T19:01:08.715 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-31T19:01:08.716 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-31T19:01:08.716 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:01:08.716 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:01:08.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:01:08.718 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-31T19:01:08.765 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:01:08.766 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:01:08.769 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:01:08.769 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:01:08.769 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-31T19:01:08.769 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:01:08.770 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:01:08.770 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:01:08.770 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-31T19:01:08.770 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:01:08.771 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:01:08.771 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-31T19:01:08.771 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:01:08.771 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:01:08.771 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:01:08.772 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:01:08.772 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:01:08.772 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 37208sec preferred_lft 37208sec 2023-08-31T19:01:08.772 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-31T19:01:08.773 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:01:08.773 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:01:08.773 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff 2023-08-31T19:01:08.773 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T19:01:08.773 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:01:08.773 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::7c68:c9ff:fe82:9771/64 scope link 2023-08-31T19:01:08.774 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:01:08.774 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:01:08.774 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e2:e1:71:f6:f6:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T19:01:08.774 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e0e1:71ff:fef6:f6fa/64 scope link 2023-08-31T19:01:08.775 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:01:08.775 INFO:teuthology.orchestra.run.smithi072.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:01:08.775 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T19:01:08.775 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::38f6:6ff:fe3c:1ef/64 scope link 2023-08-31T19:01:08.775 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:01:08.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:01:08.776 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:01:08.844 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-31T19:01:08.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:01:08.847 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-31T19:01:08.896 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-31T19:01:08.897 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:01:08.897 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:01:08.897 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:01:08.897 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:01:08.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:01:08.899 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T19:01:08.900 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T19:01:08.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:01:08.901 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:01:08.901 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:01:08.901 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T19:01:09.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:01:09.073 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T19:01:09.120 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T19:01:09.120 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T19:01:09.121 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:01:09.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:01:09.122 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-08-31T19:01:09.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:01:09.193 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-31T19:01:09.240 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-31T19:01:09.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:01:09.378 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:01:09.379 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:01:09.405 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:01:09.405 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:01:09.410 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-31T19:01:09.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:01:09.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T19:01:09.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-31T19:01:09.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.674+0000 7fe454bff700 1 Processor -- start 2023-08-31T19:01:09.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.675+0000 7fe454bff700 1 -- start start 2023-08-31T19:01:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.676+0000 7fe454bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4501508b0 0x7fe4500bc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.676+0000 7fe454bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe4500c2460 0x7fe450069090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.676+0000 7fe454bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4500bcbc0 con 0x7fe4500bc760 2023-08-31T19:01:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.676+0000 7fe454bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe450151340 con 0x7fe4501508b0 2023-08-31T19:01:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.676+0000 7fe454bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4500c29d0 con 0x7fe4500c2460 2023-08-31T19:01:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.677+0000 7fe44e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4501508b0 0x7fe4500bc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.677+0000 7fe44dd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe4500bc760 0x7fe4500c1d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35270/0 (socket says 172.21.15.72:35270) 2023-08-31T19:01:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.677+0000 7fe44dd9b700 1 -- 172.21.15.72:0/935495713 learned_addr learned my addr 172.21.15.72:0/935495713 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:01:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.677+0000 7fe44ed9d700 1 --2- 172.21.15.72:0/935495713 >> v2:172.21.15.146:3300/0 conn(0x7fe4500c2460 0x7fe450069090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.677+0000 7fe44e59c700 1 -- 172.21.15.72:0/935495713 >> v2:172.21.15.146:3300/0 conn(0x7fe4500c2460 msgr2=0x7fe450069090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.677+0000 7fe44e59c700 1 --2- 172.21.15.72:0/935495713 >> v2:172.21.15.146:3300/0 conn(0x7fe4500c2460 0x7fe450069090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:09.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.677+0000 7fe44e59c700 1 -- 172.21.15.72:0/935495713 >> v1:172.21.15.72:6789/0 conn(0x7fe4500bc760 legacy=0x7fe4500c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:09.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.677+0000 7fe44e59c700 1 -- 172.21.15.72:0/935495713 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4500c2cb0 con 0x7fe4501508b0 2023-08-31T19:01:09.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.677+0000 7fe44d59a700 1 -- 172.21.15.72:0/935495713 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880954257 0 0) 0x7fe4500bcbc0 con 0x7fe4500bc760 2023-08-31T19:01:09.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.677+0000 7fe44e59c700 1 --2- 172.21.15.72:0/935495713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4501508b0 0x7fe4500bc270 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fe45006a6c0 tx=0x7fe440009060).ready entity=mon.0 client_cookie=ff67a9245f886a2b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:09.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.678+0000 7fe44d59a700 1 -- 172.21.15.72:0/935495713 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44000b580 con 0x7fe4501508b0 2023-08-31T19:01:09.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.678+0000 7fe44d59a700 1 -- 172.21.15.72:0/935495713 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44000b6e0 con 0x7fe4501508b0 2023-08-31T19:01:09.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.678+0000 7fe44d59a700 1 -- 172.21.15.72:0/935495713 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44000ba60 con 0x7fe4501508b0 2023-08-31T19:01:09.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.678+0000 7fe454bff700 1 -- 172.21.15.72:0/935495713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4501508b0 msgr2=0x7fe4500bc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:09.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.678+0000 7fe454bff700 1 --2- 172.21.15.72:0/935495713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4501508b0 0x7fe4500bc270 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fe45006a6c0 tx=0x7fe440009060).stop 2023-08-31T19:01:09.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.678+0000 7fe454bff700 1 -- 172.21.15.72:0/935495713 shutdown_connections 2023-08-31T19:01:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.678+0000 7fe454bff700 1 --2- 172.21.15.72:0/935495713 >> v2:172.21.15.146:3300/0 conn(0x7fe4500c2460 0x7fe450069090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.678+0000 7fe454bff700 1 --2- 172.21.15.72:0/935495713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4501508b0 0x7fe4500bc270 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.678+0000 7fe454bff700 1 -- 172.21.15.72:0/935495713 >> 172.21.15.72:0/935495713 conn(0x7fe450063120 msgr2=0x7fe4500c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.678+0000 7fe454bff700 1 -- 172.21.15.72:0/935495713 shutdown_connections 2023-08-31T19:01:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.678+0000 7fe454bff700 1 -- 172.21.15.72:0/935495713 wait complete. 2023-08-31T19:01:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.680+0000 7fe454bff700 1 Processor -- start 2023-08-31T19:01:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.680+0000 7fe454bff700 1 -- start start 2023-08-31T19:01:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.681+0000 7fe454bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4500bc760 0x7fe45014e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.681+0000 7fe454bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4500c2460 0x7fe4500a7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.681+0000 7fe454bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4501508b0 0x7fe45013d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.681+0000 7fe454bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4500a8360 con 0x7fe4500c2460 2023-08-31T19:01:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.681+0000 7fe454bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4500a9610 con 0x7fe4501508b0 2023-08-31T19:01:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.681+0000 7fe454bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4500a8570 con 0x7fe4500bc760 2023-08-31T19:01:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.681+0000 7fe44dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4500c2460 0x7fe4500a7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.681+0000 7fe44dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4500c2460 0x7fe4500a7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54418/0 (socket says 172.21.15.72:54418) 2023-08-31T19:01:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.681+0000 7fe44dd9b700 1 -- 172.21.15.72:0/214330467 learned_addr learned my addr 172.21.15.72:0/214330467 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.681+0000 7fe44ed9d700 1 --2- 172.21.15.72:0/214330467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4501508b0 0x7fe45013d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.681+0000 7fe44e59c700 1 --2- 172.21.15.72:0/214330467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4500bc760 0x7fe45014e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.682+0000 7fe44dd9b700 1 -- 172.21.15.72:0/214330467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4500bc760 msgr2=0x7fe45014e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.682+0000 7fe44dd9b700 1 --2- 172.21.15.72:0/214330467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4500bc760 0x7fe45014e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.682+0000 7fe44dd9b700 1 -- 172.21.15.72:0/214330467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4501508b0 msgr2=0x7fe45013d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.682+0000 7fe44dd9b700 1 --2- 172.21.15.72:0/214330467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4501508b0 0x7fe45013d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.682+0000 7fe44dd9b700 1 -- 172.21.15.72:0/214330467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4400092a0 con 0x7fe4500c2460 2023-08-31T19:01:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.682+0000 7fe44e59c700 1 --2- 172.21.15.72:0/214330467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4500bc760 0x7fe45014e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:01:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.682+0000 7fe44dd9b700 1 --2- 172.21.15.72:0/214330467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4500c2460 0x7fe4500a7e70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fe44400c4e0 tx=0x7fe444007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.682+0000 7fe43e7fc700 1 -- 172.21.15.72:0/214330467 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4440072e0 con 0x7fe4500c2460 2023-08-31T19:01:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.682+0000 7fe43e7fc700 1 -- 172.21.15.72:0/214330467 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe444007440 con 0x7fe4500c2460 2023-08-31T19:01:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.682+0000 7fe454bff700 1 -- 172.21.15.72:0/214330467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4500a8850 con 0x7fe4500c2460 2023-08-31T19:01:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.682+0000 7fe43e7fc700 1 -- 172.21.15.72:0/214330467 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4440057a0 con 0x7fe4500c2460 2023-08-31T19:01:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.682+0000 7fe454bff700 1 -- 172.21.15.72:0/214330467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4500a8e10 con 0x7fe4500c2460 2023-08-31T19:01:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.683+0000 7fe454bff700 1 -- 172.21.15.72:0/214330467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45006c6b0 con 0x7fe4500c2460 2023-08-31T19:01:09.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.684+0000 7fe43e7fc700 1 -- 172.21.15.72:0/214330467 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe444005bd0 con 0x7fe4500c2460 2023-08-31T19:01:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.685+0000 7fe43e7fc700 1 --2- 172.21.15.72:0/214330467 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe43005ef30 0x7fe4300613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.685+0000 7fe43e7fc700 1 -- 172.21.15.72:0/214330467 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7fe444079c40 con 0x7fe4500c2460 2023-08-31T19:01:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.685+0000 7fe44e59c700 1 --2- 172.21.15.72:0/214330467 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe43005ef30 0x7fe4300613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.685+0000 7fe44e59c700 1 --2- 172.21.15.72:0/214330467 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe43005ef30 0x7fe4300613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe44000b340 tx=0x7fe440017000).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.689+0000 7fe43e7fc700 1 -- 172.21.15.72:0/214330467 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe44407f020 con 0x7fe4500c2460 2023-08-31T19:01:09.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.883+0000 7fe454bff700 1 -- 172.21.15.72:0/214330467 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4500c2f90 con 0x7fe43005ef30 2023-08-31T19:01:09.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.884+0000 7fe43e7fc700 1 -- 172.21.15.72:0/214330467 <== mgr.4997 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe4500c2f90 con 0x7fe43005ef30 2023-08-31T19:01:09.885 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:01:09.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:01:09.885 INFO:teuthology.orchestra.run.smithi072.stdout: "name": "cephfs" 2023-08-31T19:01:09.885 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:01:09.885 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:01:09.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.886+0000 7fe454bff700 1 -- 172.21.15.72:0/214330467 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe43005ef30 msgr2=0x7fe4300613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:09.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.886+0000 7fe454bff700 1 --2- 172.21.15.72:0/214330467 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe43005ef30 0x7fe4300613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe44000b340 tx=0x7fe440017000).stop 2023-08-31T19:01:09.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.886+0000 7fe454bff700 1 -- 172.21.15.72:0/214330467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4500c2460 msgr2=0x7fe4500a7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:09.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.886+0000 7fe454bff700 1 --2- 172.21.15.72:0/214330467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4500c2460 0x7fe4500a7e70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fe44400c4e0 tx=0x7fe444007c70).stop 2023-08-31T19:01:09.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.886+0000 7fe454bff700 1 -- 172.21.15.72:0/214330467 shutdown_connections 2023-08-31T19:01:09.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.886+0000 7fe454bff700 1 --2- 172.21.15.72:0/214330467 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe43005ef30 0x7fe4300613f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:09.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.886+0000 7fe454bff700 1 --2- 172.21.15.72:0/214330467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4501508b0 0x7fe45013d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:09.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.886+0000 7fe454bff700 1 --2- 172.21.15.72:0/214330467 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe4500bc760 0x7fe45014e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:09.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.886+0000 7fe454bff700 1 --2- 172.21.15.72:0/214330467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4500c2460 0x7fe4500a7e70 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:09.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.886+0000 7fe454bff700 1 -- 172.21.15.72:0/214330467 >> 172.21.15.72:0/214330467 conn(0x7fe450063120 msgr2=0x7fe450068f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:09.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.887+0000 7fe454bff700 1 -- 172.21.15.72:0/214330467 shutdown_connections 2023-08-31T19:01:09.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:09.887+0000 7fe454bff700 1 -- 172.21.15.72:0/214330467 wait complete. 2023-08-31T19:01:09.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-31T19:01:10.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.099+0000 7f59613ff700 1 Processor -- start 2023-08-31T19:01:10.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.099+0000 7f59613ff700 1 -- start start 2023-08-31T19:01:10.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.100+0000 7f59613ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f595c0bdb30 0x7f595c1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:10.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.100+0000 7f59613ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f595c0663d0 0x7f595c066840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:10.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.100+0000 7f59613ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c0a84b0 con 0x7f595c153ed0 2023-08-31T19:01:10.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.100+0000 7f59613ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595c0c9410 con 0x7f595c0bdb30 2023-08-31T19:01:10.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.100+0000 7f59613ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595c0c5310 con 0x7f595c0663d0 2023-08-31T19:01:10.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.101+0000 7f595a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f595c0bdb30 0x7f595c1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:10.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.101+0000 7f595affd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f595c153ed0 0x7f595c155200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35272/0 (socket says 172.21.15.72:35272) 2023-08-31T19:01:10.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.101+0000 7f595affd700 1 -- 172.21.15.72:0/3018505236 learned_addr learned my addr 172.21.15.72:0/3018505236 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:01:10.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.101+0000 7f595b7fe700 1 --2- 172.21.15.72:0/3018505236 >> v2:172.21.15.146:3300/0 conn(0x7f595c0663d0 0x7f595c066840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:10.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.101+0000 7f595a7fc700 1 -- 172.21.15.72:0/3018505236 >> v2:172.21.15.146:3300/0 conn(0x7f595c0663d0 msgr2=0x7f595c066840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:10.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.101+0000 7f595a7fc700 1 --2- 172.21.15.72:0/3018505236 >> v2:172.21.15.146:3300/0 conn(0x7f595c0663d0 0x7f595c066840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.101+0000 7f595a7fc700 1 -- 172.21.15.72:0/3018505236 >> v1:172.21.15.72:6789/0 conn(0x7f595c153ed0 legacy=0x7f595c155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:10.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.101+0000 7f595a7fc700 1 -- 172.21.15.72:0/3018505236 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c066d30 con 0x7f595c0bdb30 2023-08-31T19:01:10.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.101+0000 7f5959ffb700 1 -- 172.21.15.72:0/3018505236 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360391655 0 0) 0x7f595c0a84b0 con 0x7f595c153ed0 2023-08-31T19:01:10.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.101+0000 7f595a7fc700 1 --2- 172.21.15.72:0/3018505236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f595c0bdb30 0x7f595c1542b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f595c0be880 tx=0x7f5950009060).ready entity=mon.0 client_cookie=965c65353e8207be server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:10.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.102+0000 7f5959ffb700 1 -- 172.21.15.72:0/3018505236 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59500090d0 con 0x7f595c0bdb30 2023-08-31T19:01:10.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.102+0000 7f5959ffb700 1 -- 172.21.15.72:0/3018505236 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595000b580 con 0x7f595c0bdb30 2023-08-31T19:01:10.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.102+0000 7f5959ffb700 1 -- 172.21.15.72:0/3018505236 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595000b900 con 0x7f595c0bdb30 2023-08-31T19:01:10.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.102+0000 7f59613ff700 1 -- 172.21.15.72:0/3018505236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f595c0bdb30 msgr2=0x7f595c1542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:10.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.102+0000 7f59613ff700 1 --2- 172.21.15.72:0/3018505236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f595c0bdb30 0x7f595c1542b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f595c0be880 tx=0x7f5950009060).stop 2023-08-31T19:01:10.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.102+0000 7f59613ff700 1 -- 172.21.15.72:0/3018505236 shutdown_connections 2023-08-31T19:01:10.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.102+0000 7f59613ff700 1 --2- 172.21.15.72:0/3018505236 >> v2:172.21.15.146:3300/0 conn(0x7f595c0663d0 0x7f595c066840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.102+0000 7f59613ff700 1 --2- 172.21.15.72:0/3018505236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f595c0bdb30 0x7f595c1542b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.102+0000 7f59613ff700 1 -- 172.21.15.72:0/3018505236 >> 172.21.15.72:0/3018505236 conn(0x7f595c05eb60 msgr2=0x7f595c0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:10.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.102+0000 7f59613ff700 1 -- 172.21.15.72:0/3018505236 shutdown_connections 2023-08-31T19:01:10.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.102+0000 7f59613ff700 1 -- 172.21.15.72:0/3018505236 wait complete. 2023-08-31T19:01:10.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.104+0000 7f59613ff700 1 Processor -- start 2023-08-31T19:01:10.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.104+0000 7f59613ff700 1 -- start start 2023-08-31T19:01:10.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f59613ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f595c0663d0 0x7f595c1444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:10.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f59613ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f595c153ed0 0x7f595c0a69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:10.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f59613ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f595c1449b0 0x7f595c0a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:10.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f59613ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0a73b0 con 0x7f595c153ed0 2023-08-31T19:01:10.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f59613ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0a4d50 con 0x7f595c0663d0 2023-08-31T19:01:10.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f59613ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0acac0 con 0x7f595c1449b0 2023-08-31T19:01:10.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f595a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f595c153ed0 0x7f595c0a69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:10.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f595a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f595c153ed0 0x7f595c0a69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54444/0 (socket says 172.21.15.72:54444) 2023-08-31T19:01:10.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f595a7fc700 1 -- 172.21.15.72:0/3997632901 learned_addr learned my addr 172.21.15.72:0/3997632901 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:10.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f595affd700 1 --2- 172.21.15.72:0/3997632901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f595c0663d0 0x7f595c1444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:10.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f595b7fe700 1 --2- 172.21.15.72:0/3997632901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f595c1449b0 0x7f595c0a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:10.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f595a7fc700 1 -- 172.21.15.72:0/3997632901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f595c1449b0 msgr2=0x7f595c0a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:10.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f595a7fc700 1 --2- 172.21.15.72:0/3997632901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f595c1449b0 0x7f595c0a6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f595a7fc700 1 -- 172.21.15.72:0/3997632901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f595c0663d0 msgr2=0x7f595c1444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:10.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f595a7fc700 1 --2- 172.21.15.72:0/3997632901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f595c0663d0 0x7f595c1444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.105+0000 7f595a7fc700 1 -- 172.21.15.72:0/3997632901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59500092a0 con 0x7f595c153ed0 2023-08-31T19:01:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.106+0000 7f595a7fc700 1 --2- 172.21.15.72:0/3997632901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f595c153ed0 0x7f595c0a69d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f5950009fd0 tx=0x7f5950017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.106+0000 7f5942ffd700 1 -- 172.21.15.72:0/3997632901 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595000b900 con 0x7f595c153ed0 2023-08-31T19:01:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.106+0000 7f5942ffd700 1 -- 172.21.15.72:0/3997632901 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595000bcc0 con 0x7f595c153ed0 2023-08-31T19:01:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.106+0000 7f59613ff700 1 -- 172.21.15.72:0/3997632901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595c0acda0 con 0x7f595c153ed0 2023-08-31T19:01:10.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.106+0000 7f5942ffd700 1 -- 172.21.15.72:0/3997632901 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595001b410 con 0x7f595c153ed0 2023-08-31T19:01:10.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.106+0000 7f59613ff700 1 -- 172.21.15.72:0/3997632901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595c1552b0 con 0x7f595c153ed0 2023-08-31T19:01:10.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.107+0000 7f59613ff700 1 -- 172.21.15.72:0/3997632901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595c0a4840 con 0x7f595c153ed0 2023-08-31T19:01:10.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.108+0000 7f5942ffd700 1 -- 172.21.15.72:0/3997632901 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 14) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f595001b800 con 0x7f595c153ed0 2023-08-31T19:01:10.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.109+0000 7f5942ffd700 1 --2- 172.21.15.72:0/3997632901 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f594805ef30 0x7f59480613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:10.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.109+0000 7f5942ffd700 1 -- 172.21.15.72:0/3997632901 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7f595007bce0 con 0x7f595c153ed0 2023-08-31T19:01:10.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.109+0000 7f595affd700 1 --2- 172.21.15.72:0/3997632901 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f594805ef30 0x7f59480613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:10.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.110+0000 7f595affd700 1 --2- 172.21.15.72:0/3997632901 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f594805ef30 0x7f59480613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f594c00c7d0 tx=0x7f594c009040).ready entity=mgr.4997 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:10.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.113+0000 7f5942ffd700 1 -- 172.21.15.72:0/3997632901 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f595c0a4840 con 0x7f595c153ed0 2023-08-31T19:01:10.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.322+0000 7f59613ff700 1 -- 172.21.15.72:0/3997632901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f595c0a4840 con 0x7f595c153ed0 2023-08-31T19:01:10.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.455+0000 7f5942ffd700 1 -- 172.21.15.72:0/3997632901 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 15) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f59500796f0 con 0x7f595c153ed0 2023-08-31T19:01:10.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.456+0000 7f5942ffd700 1 -- 172.21.15.72:0/3997632901 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v15) v1 ==== 92+0+0 (secure 0 0 0) 0x7f5950041610 con 0x7f595c153ed0 2023-08-31T19:01:10.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.458+0000 7f59613ff700 1 -- 172.21.15.72:0/3997632901 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f594805ef30 msgr2=0x7f59480613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:10.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.458+0000 7f59613ff700 1 --2- 172.21.15.72:0/3997632901 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f594805ef30 0x7f59480613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f594c00c7d0 tx=0x7f594c009040).stop 2023-08-31T19:01:10.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.458+0000 7f59613ff700 1 -- 172.21.15.72:0/3997632901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f595c153ed0 msgr2=0x7f595c0a69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:10.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.458+0000 7f59613ff700 1 --2- 172.21.15.72:0/3997632901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f595c153ed0 0x7f595c0a69d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f5950009fd0 tx=0x7f5950017000).stop 2023-08-31T19:01:10.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.458+0000 7f59613ff700 1 -- 172.21.15.72:0/3997632901 shutdown_connections 2023-08-31T19:01:10.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.458+0000 7f59613ff700 1 --2- 172.21.15.72:0/3997632901 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f595c1449b0 0x7f595c0a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.458+0000 7f59613ff700 1 --2- 172.21.15.72:0/3997632901 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f594805ef30 0x7f59480613f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.458+0000 7f59613ff700 1 --2- 172.21.15.72:0/3997632901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f595c0663d0 0x7f595c1444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.458+0000 7f59613ff700 1 --2- 172.21.15.72:0/3997632901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f595c153ed0 0x7f595c0a69d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.458+0000 7f59613ff700 1 -- 172.21.15.72:0/3997632901 >> 172.21.15.72:0/3997632901 conn(0x7f595c05eb60 msgr2=0x7f595c0c7620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:10.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.459+0000 7f59613ff700 1 -- 172.21.15.72:0/3997632901 shutdown_connections 2023-08-31T19:01:10.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.459+0000 7f59613ff700 1 -- 172.21.15.72:0/3997632901 wait complete. 2023-08-31T19:01:10.477 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-31T19:01:10.666 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:10.666+0000 7f3bcee40680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:01:10.672 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:10.672+0000 7fad70a14680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:01:10.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.674+0000 7f214a1ff700 1 Processor -- start 2023-08-31T19:01:10.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.674+0000 7f214a1ff700 1 -- start start 2023-08-31T19:01:10.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.675+0000 7f214a1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2144154210 0x7f21440630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:10.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.675+0000 7f214a1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21440635a0 0x7f21440c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:10.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.675+0000 7f214a1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2144063a00 con 0x7f2144153e30 2023-08-31T19:01:10.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.675+0000 7f214a1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21441546c0 con 0x7f2144154210 2023-08-31T19:01:10.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.675+0000 7f214a1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21440bfd40 con 0x7f21440635a0 2023-08-31T19:01:10.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.675+0000 7f2142ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2144154210 0x7f21440630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:10.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.676+0000 7f2142ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2144154210 0x7f21440630b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54458/0 (socket says 172.21.15.72:54458) 2023-08-31T19:01:10.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.676+0000 7f21437fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2144153e30 0x7f21440c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35292/0 (socket says 172.21.15.72:35292) 2023-08-31T19:01:10.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.676+0000 7f2142ffd700 1 -- 172.21.15.72:0/2475217644 learned_addr learned my addr 172.21.15.72:0/2475217644 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:10.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.676+0000 7f2143fff700 1 --2- 172.21.15.72:0/2475217644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21440635a0 0x7f21440c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:10.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.676+0000 7f2142ffd700 1 -- 172.21.15.72:0/2475217644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21440635a0 msgr2=0x7f21440c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:10.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.676+0000 7f2142ffd700 1 --2- 172.21.15.72:0/2475217644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21440635a0 0x7f21440c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.676+0000 7f2142ffd700 1 -- 172.21.15.72:0/2475217644 >> v1:172.21.15.72:6789/0 conn(0x7f2144153e30 legacy=0x7f21440c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:10.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.676+0000 7f2142ffd700 1 -- 172.21.15.72:0/2475217644 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21440c6730 con 0x7f2144154210 2023-08-31T19:01:10.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.676+0000 7f2142ffd700 1 --2- 172.21.15.72:0/2475217644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2144154210 0x7f21440630b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f2138006fd0 tx=0x7f21380090f0).ready entity=mon.0 client_cookie=6129179d9cf817ef server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:10.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.676+0000 7f21427fc700 1 -- 172.21.15.72:0/2475217644 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213800b580 con 0x7f2144154210 2023-08-31T19:01:10.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.676+0000 7f21427fc700 1 -- 172.21.15.72:0/2475217644 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213800b6e0 con 0x7f2144154210 2023-08-31T19:01:10.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.677+0000 7f21427fc700 1 -- 172.21.15.72:0/2475217644 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213800ba80 con 0x7f2144154210 2023-08-31T19:01:10.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.677+0000 7f214a1ff700 1 -- 172.21.15.72:0/2475217644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2144154210 msgr2=0x7f21440630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:10.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.677+0000 7f214a1ff700 1 --2- 172.21.15.72:0/2475217644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2144154210 0x7f21440630b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f2138006fd0 tx=0x7f21380090f0).stop 2023-08-31T19:01:10.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.677+0000 7f214a1ff700 1 -- 172.21.15.72:0/2475217644 shutdown_connections 2023-08-31T19:01:10.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.677+0000 7f214a1ff700 1 --2- 172.21.15.72:0/2475217644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21440635a0 0x7f21440c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.677+0000 7f214a1ff700 1 --2- 172.21.15.72:0/2475217644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2144154210 0x7f21440630b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.677+0000 7f214a1ff700 1 -- 172.21.15.72:0/2475217644 >> 172.21.15.72:0/2475217644 conn(0x7f214405eb20 msgr2=0x7f21440cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:10.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.677+0000 7f214a1ff700 1 -- 172.21.15.72:0/2475217644 shutdown_connections 2023-08-31T19:01:10.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.677+0000 7f214a1ff700 1 -- 172.21.15.72:0/2475217644 wait complete. 2023-08-31T19:01:10.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.679+0000 7f214a1ff700 1 Processor -- start 2023-08-31T19:01:10.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.679+0000 7f214a1ff700 1 -- start start 2023-08-31T19:01:10.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f214a1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21440635a0 0x7f214414da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:10.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f214a1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2144153e30 0x7f21440ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:10.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f214a1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2144154210 0x7f21440aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:10.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f214a1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21440c2b30 con 0x7f2144154210 2023-08-31T19:01:10.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f214a1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21440c1f20 con 0x7f2144153e30 2023-08-31T19:01:10.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f214a1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21440c2200 con 0x7f21440635a0 2023-08-31T19:01:10.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f2143fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2144154210 0x7f21440aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:10.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f2143fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2144154210 0x7f21440aec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54460/0 (socket says 172.21.15.72:54460) 2023-08-31T19:01:10.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f2143fff700 1 -- 172.21.15.72:0/2128445641 learned_addr learned my addr 172.21.15.72:0/2128445641 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:10.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f21437fe700 1 --2- 172.21.15.72:0/2128445641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21440635a0 0x7f214414da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:10.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f2142ffd700 1 --2- 172.21.15.72:0/2128445641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2144153e30 0x7f21440ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:10.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f2143fff700 1 -- 172.21.15.72:0/2128445641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21440635a0 msgr2=0x7f214414da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:10.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f2143fff700 1 --2- 172.21.15.72:0/2128445641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21440635a0 0x7f214414da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f2143fff700 1 -- 172.21.15.72:0/2128445641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2144153e30 msgr2=0x7f21440ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:10.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f2143fff700 1 --2- 172.21.15.72:0/2128445641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2144153e30 0x7f21440ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f2143fff700 1 -- 172.21.15.72:0/2128445641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2138009370 con 0x7f2144154210 2023-08-31T19:01:10.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.680+0000 7f2142ffd700 1 --2- 172.21.15.72:0/2128445641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2144153e30 0x7f21440ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:10.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.681+0000 7f2143fff700 1 --2- 172.21.15.72:0/2128445641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2144154210 0x7f21440aec50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f213c009e90 tx=0x7f213c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:10.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.681+0000 7f212b7fe700 1 -- 172.21.15.72:0/2128445641 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c00cb50 con 0x7f2144154210 2023-08-31T19:01:10.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.681+0000 7f212b7fe700 1 -- 172.21.15.72:0/2128445641 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c00f040 con 0x7f2144154210 2023-08-31T19:01:10.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.681+0000 7f212b7fe700 1 -- 172.21.15.72:0/2128445641 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c00cec0 con 0x7f2144154210 2023-08-31T19:01:10.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.681+0000 7f214a1ff700 1 -- 172.21.15.72:0/2128445641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21440c24e0 con 0x7f2144154210 2023-08-31T19:01:10.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.681+0000 7f214a1ff700 1 -- 172.21.15.72:0/2128445641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214414df30 con 0x7f2144154210 2023-08-31T19:01:10.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.682+0000 7f214a1ff700 1 -- 172.21.15.72:0/2128445641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214414e120 con 0x7f2144154210 2023-08-31T19:01:10.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.683+0000 7f212b7fe700 1 -- 172.21.15.72:0/2128445641 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 15) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f213c013610 con 0x7f2144154210 2023-08-31T19:01:10.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.684+0000 7f212b7fe700 1 --2- 172.21.15.72:0/2128445641 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f213005ef80 0x7f2130061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:10.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.684+0000 7f21437fe700 1 -- 172.21.15.72:0/2128445641 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f213005ef80 msgr2=0x7f2130061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:01:10.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.684+0000 7f212b7fe700 1 -- 172.21.15.72:0/2128445641 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7f213c07aca0 con 0x7f2144154210 2023-08-31T19:01:10.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.684+0000 7f21437fe700 1 --2- 172.21.15.72:0/2128445641 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f213005ef80 0x7f2130061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:01:10.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.689+0000 7f212b7fe700 1 -- 172.21.15.72:0/2128445641 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f213c04bc90 con 0x7f2144154210 2023-08-31T19:01:10.746 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:10.745+0000 7f3bcee40680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:01:10.755 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:10.755+0000 7fad70a14680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:01:10.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.869+0000 7f214a1ff700 1 -- 172.21.15.72:0/2128445641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f21440c2c70 con 0x7f2144154210 2023-08-31T19:01:10.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.872+0000 7f212b7fe700 1 -- 172.21.15.72:0/2128445641 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v7)=0 v7) v1 ==== 138+0+0 (secure 0 0 0) 0x7f213c04f2b0 con 0x7f2144154210 2023-08-31T19:01:10.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.874+0000 7f214a1ff700 1 -- 172.21.15.72:0/2128445641 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f213005ef80 msgr2=0x7f2130061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:01:10.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.875+0000 7f214a1ff700 1 --2- 172.21.15.72:0/2128445641 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f213005ef80 0x7f2130061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:01:10.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.875+0000 7f214a1ff700 1 -- 172.21.15.72:0/2128445641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2144154210 msgr2=0x7f21440aec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:10.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.875+0000 7f214a1ff700 1 --2- 172.21.15.72:0/2128445641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2144154210 0x7f21440aec50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f213c009e90 tx=0x7f213c00b040).stop 2023-08-31T19:01:10.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.875+0000 7f214a1ff700 1 -- 172.21.15.72:0/2128445641 shutdown_connections 2023-08-31T19:01:10.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.875+0000 7f214a1ff700 1 --2- 172.21.15.72:0/2128445641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2144154210 0x7f21440aec50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.875+0000 7f214a1ff700 1 --2- 172.21.15.72:0/2128445641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21440635a0 0x7f214414da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.875+0000 7f214a1ff700 1 --2- 172.21.15.72:0/2128445641 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f213005ef80 0x7f2130061440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:01:10.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.875+0000 7f214a1ff700 1 --2- 172.21.15.72:0/2128445641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2144153e30 0x7f21440ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:10.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.875+0000 7f214a1ff700 1 -- 172.21.15.72:0/2128445641 >> 172.21.15.72:0/2128445641 conn(0x7f214405eb20 msgr2=0x7f21440c92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:10.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.875+0000 7f214a1ff700 1 -- 172.21.15.72:0/2128445641 shutdown_connections 2023-08-31T19:01:10.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:10.875+0000 7f214a1ff700 1 -- 172.21.15.72:0/2128445641 wait complete. 2023-08-31T19:01:10.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:10.893 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-31T19:01:10.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-31T19:01:11.076 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:11.076+0000 7f3bcee40680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:01:11.098 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:11.098+0000 7fad70a14680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:01:11.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.145+0000 7ff0697ff700 1 Processor -- start 2023-08-31T19:01:11.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.145+0000 7ff0697ff700 1 -- start start 2023-08-31T19:01:11.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.146+0000 7ff0697ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff064151da0 0x7ff0641553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:11.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.146+0000 7ff0697ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff064064d70 0x7ff0640bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:11.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.146+0000 7ff0697ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff064154f40 con 0x7ff0640c5370 2023-08-31T19:01:11.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.146+0000 7ff0697ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff064154960 con 0x7ff064151da0 2023-08-31T19:01:11.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.146+0000 7ff0697ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0640aa2c0 con 0x7ff064064d70 2023-08-31T19:01:11.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.146+0000 7ff062ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff064151da0 0x7ff0641553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:11.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.146+0000 7ff062ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff064151da0 0x7ff0641553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54470/0 (socket says 172.21.15.72:54470) 2023-08-31T19:01:11.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.146+0000 7ff062ffd700 1 -- 172.21.15.72:0/3105042137 learned_addr learned my addr 172.21.15.72:0/3105042137 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:11.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.147+0000 7ff0637fe700 1 --2- 172.21.15.72:0/3105042137 >> v2:172.21.15.146:3300/0 conn(0x7ff064064d70 0x7ff0640bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:11.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.147+0000 7ff062ffd700 1 -- 172.21.15.72:0/3105042137 >> v2:172.21.15.146:3300/0 conn(0x7ff064064d70 msgr2=0x7ff0640bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:11.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.147+0000 7ff062ffd700 1 --2- 172.21.15.72:0/3105042137 >> v2:172.21.15.146:3300/0 conn(0x7ff064064d70 0x7ff0640bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:11.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.147+0000 7ff062ffd700 1 -- 172.21.15.72:0/3105042137 >> v1:172.21.15.146:6789/0 conn(0x7ff0640c5370 legacy=0x7ff064064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:11.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.147+0000 7ff062ffd700 1 -- 172.21.15.72:0/3105042137 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff064154bd0 con 0x7ff064151da0 2023-08-31T19:01:11.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.147+0000 7ff0637fe700 1 --2- 172.21.15.72:0/3105042137 >> v2:172.21.15.146:3300/0 conn(0x7ff064064d70 0x7ff0640bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:11.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.147+0000 7ff062ffd700 1 --2- 172.21.15.72:0/3105042137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff064151da0 0x7ff0641553d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7ff0640c7750 tx=0x7ff0540090f0).ready entity=mon.0 client_cookie=8bffa3e448c5a8c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:11.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.147+0000 7ff061ffb700 1 -- 172.21.15.72:0/3105042137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05400b600 con 0x7ff064151da0 2023-08-31T19:01:11.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.147+0000 7ff061ffb700 1 -- 172.21.15.72:0/3105042137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05400b760 con 0x7ff064151da0 2023-08-31T19:01:11.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.147+0000 7ff061ffb700 1 -- 172.21.15.72:0/3105042137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05400bae0 con 0x7ff064151da0 2023-08-31T19:01:11.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.148+0000 7ff0697ff700 1 -- 172.21.15.72:0/3105042137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff064151da0 msgr2=0x7ff0641553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:11.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.148+0000 7ff0697ff700 1 --2- 172.21.15.72:0/3105042137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff064151da0 0x7ff0641553d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7ff0640c7750 tx=0x7ff0540090f0).stop 2023-08-31T19:01:11.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.148+0000 7ff0697ff700 1 -- 172.21.15.72:0/3105042137 shutdown_connections 2023-08-31T19:01:11.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.148+0000 7ff0697ff700 1 --2- 172.21.15.72:0/3105042137 >> v2:172.21.15.146:3300/0 conn(0x7ff064064d70 0x7ff0640bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:11.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.148+0000 7ff0697ff700 1 --2- 172.21.15.72:0/3105042137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff064151da0 0x7ff0641553d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:11.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.148+0000 7ff0697ff700 1 -- 172.21.15.72:0/3105042137 >> 172.21.15.72:0/3105042137 conn(0x7ff064063a90 msgr2=0x7ff0640cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:11.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.148+0000 7ff0697ff700 1 -- 172.21.15.72:0/3105042137 shutdown_connections 2023-08-31T19:01:11.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.148+0000 7ff0697ff700 1 -- 172.21.15.72:0/3105042137 wait complete. 2023-08-31T19:01:11.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.150+0000 7ff0697ff700 1 Processor -- start 2023-08-31T19:01:11.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.150+0000 7ff0697ff700 1 -- start start 2023-08-31T19:01:11.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.151+0000 7ff0697ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff064064d70 0x7ff064168810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:11.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.151+0000 7ff0697ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0640c5370 0x7ff064139290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:11.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.151+0000 7ff0697ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff064151da0 0x7ff0640c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:11.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.151+0000 7ff0697ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0641516b0 con 0x7ff064151da0 2023-08-31T19:01:11.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.151+0000 7ff0697ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff064150610 con 0x7ff0640c5370 2023-08-31T19:01:11.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.151+0000 7ff0697ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0641508f0 con 0x7ff064064d70 2023-08-31T19:01:11.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.151+0000 7ff0637fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff064151da0 0x7ff0640c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:11.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.151+0000 7ff062ffd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff064064d70 0x7ff064168810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:11.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.151+0000 7ff0637fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff064151da0 0x7ff0640c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54472/0 (socket says 172.21.15.72:54472) 2023-08-31T19:01:11.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.151+0000 7ff0637fe700 1 -- 172.21.15.72:0/3867588594 learned_addr learned my addr 172.21.15.72:0/3867588594 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:11.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.151+0000 7ff0627fc700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0640c5370 0x7ff064139290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:11.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.152+0000 7ff062ffd700 1 -- 172.21.15.72:0/3867588594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0640c5370 msgr2=0x7ff064139290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:11.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.152+0000 7ff062ffd700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0640c5370 0x7ff064139290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:11.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.152+0000 7ff062ffd700 1 -- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff064151da0 msgr2=0x7ff0640c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:11.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.152+0000 7ff062ffd700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff064151da0 0x7ff0640c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:11.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.152+0000 7ff062ffd700 1 -- 172.21.15.72:0/3867588594 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff054009370 con 0x7ff064064d70 2023-08-31T19:01:11.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.152+0000 7ff0637fe700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff064151da0 0x7ff0640c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:01:11.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.152+0000 7ff062ffd700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff064064d70 0x7ff064168810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff054014000 tx=0x7ff054017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:11.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.152+0000 7ff04affd700 1 -- 172.21.15.72:0/3867588594 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05400b8d0 con 0x7ff064064d70 2023-08-31T19:01:11.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.152+0000 7ff04affd700 1 -- 172.21.15.72:0/3867588594 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05400ba30 con 0x7ff064064d70 2023-08-31T19:01:11.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.152+0000 7ff04affd700 1 -- 172.21.15.72:0/3867588594 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05401b660 con 0x7ff064064d70 2023-08-31T19:01:11.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.152+0000 7ff0697ff700 1 -- 172.21.15.72:0/3867588594 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff064150bd0 con 0x7ff064064d70 2023-08-31T19:01:11.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.152+0000 7ff0697ff700 1 -- 172.21.15.72:0/3867588594 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff064151190 con 0x7ff064064d70 2023-08-31T19:01:11.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.153+0000 7ff0697ff700 1 -- 172.21.15.72:0/3867588594 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06406a7e0 con 0x7ff064064d70 2023-08-31T19:01:11.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.154+0000 7ff04affd700 1 -- 172.21.15.72:0/3867588594 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 15) v1 ==== 75391+0+0 (secure 0 0 0) 0x7ff05401b9d0 con 0x7ff064064d70 2023-08-31T19:01:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.155+0000 7ff04affd700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 0x7ff050061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.155+0000 7ff04affd700 1 -- 172.21.15.72:0/3867588594 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6693+0+0 (secure 0 0 0) 0x7ff05407bbe0 con 0x7ff064064d70 2023-08-31T19:01:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.155+0000 7ff0627fc700 1 -- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 msgr2=0x7ff050061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:01:11.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.155+0000 7ff0627fc700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 0x7ff050061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:01:11.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.159+0000 7ff04affd700 1 -- 172.21.15.72:0/3867588594 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff05404cbd0 con 0x7ff064064d70 2023-08-31T19:01:11.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.356+0000 7ff0627fc700 1 -- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 msgr2=0x7ff050061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:01:11.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.356+0000 7ff0627fc700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 0x7ff050061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:01:11.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.362+0000 7ff0697ff700 1 -- 172.21.15.72:0/3867588594 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff064151380 con 0x7ff05005ef80 2023-08-31T19:01:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.757+0000 7ff0627fc700 1 -- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 msgr2=0x7ff050061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:01:11.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:11.757+0000 7ff0627fc700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 0x7ff050061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-31T19:01:11.821 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:11.821+0000 7f3bcee40680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:01:11.850 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:11.849+0000 7fad70a14680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:01:11.904 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:11.903+0000 7f3bcee40680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:01:11.933 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:11.933+0000 7fad70a14680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:01:12.132 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:12.132+0000 7f3bcee40680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:01:12.161 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:12.161+0000 7fad70a14680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:01:12.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:12.558+0000 7ff0627fc700 1 -- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 msgr2=0x7ff050061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:01:12.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:12.558+0000 7ff0627fc700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 0x7ff050061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-31T19:01:12.640 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:12.640+0000 7f3bcee40680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:01:12.668 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:12.668+0000 7fad70a14680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:01:12.764 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:12.764+0000 7f3bcee40680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:01:12.792 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:12.792+0000 7fad70a14680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:01:12.947 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:12.947+0000 7f3bcee40680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:01:12.973 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:12.973+0000 7fad70a14680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:01:13.040 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:13.040+0000 7f3bcee40680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:01:13.065 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:13.065+0000 7fad70a14680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:01:13.123 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:13.123+0000 7f3bcee40680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:01:13.150 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:13.150+0000 7fad70a14680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:01:13.430 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:13.430+0000 7f3bcee40680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:01:13.457 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:13.457+0000 7fad70a14680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:01:13.654 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:13.654+0000 7f3bcee40680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:01:13.677 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:13.677+0000 7fad70a14680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:01:14.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:14.160+0000 7ff0627fc700 1 -- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 msgr2=0x7ff050061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:01:14.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:14.160+0000 7ff0627fc700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 0x7ff050061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-31T19:01:14.455 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:14.455+0000 7f3bcee40680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:01:14.470 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:14.470+0000 7fad70a14680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:01:14.541 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:14.540+0000 7f3bcee40680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:01:14.557 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:14.557+0000 7fad70a14680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:01:14.634 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:14.634+0000 7f3bcee40680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:01:14.650 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:14.650+0000 7fad70a14680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:01:14.814 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:14.814+0000 7f3bcee40680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:01:14.833 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:14.833+0000 7fad70a14680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:01:14.901 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:14.901+0000 7f3bcee40680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:01:14.922 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:14.921+0000 7fad70a14680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:01:15.039 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:15.039+0000 7f3bcee40680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:01:15.062 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:15.062+0000 7fad70a14680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:01:15.168 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:15.168+0000 7f3bcee40680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:01:15.191 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:15.191+0000 7fad70a14680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:01:15.512 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:15.512+0000 7f3bcee40680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:01:15.533 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:15.532+0000 7fad70a14680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:01:15.599 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:01:15.599+0000 7f3bcee40680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:01:15.620 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:15.620+0000 7fad70a14680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:01:15.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:15.633+0000 7ff04affd700 1 -- 172.21.15.72:0/3867588594 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mgrmap(e 16) v1 ==== 75113+0+0 (secure 0 0 0) 0x7ff054079530 con 0x7ff064064d70 2023-08-31T19:01:15.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:15.633+0000 7ff04affd700 1 -- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 msgr2=0x7ff050061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:01:15.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:15.633+0000 7ff04affd700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 0x7ff050061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:01:15.702 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:15.702+0000 7face5505700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:01:15.703 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:15.702+0000 7face5505700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:01:15.703 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:15.702+0000 7face5505700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:01:15.703 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:15.702+0000 7face5505700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:01:15.703 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:15.702+0000 7face5505700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:01:15.704 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:15.703+0000 7face1cbe700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:01:15.704 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:15.703+0000 7face1cbe700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:01:15.704 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:15.703+0000 7face1cbe700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:01:15.704 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:15.703+0000 7face1cbe700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:01:15.705 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:01:15.703+0000 7face1cbe700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:01:16.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.639+0000 7ff04affd700 1 -- 172.21.15.72:0/3867588594 <== mon.2 v2:172.21.15.146:3301/0 8 ==== mgrmap(e 17) v1 ==== 75183+0+0 (secure 0 0 0) 0x7ff0540798b0 con 0x7ff064064d70 2023-08-31T19:01:16.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.639+0000 7ff04affd700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 0x7ff0500613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:16.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.639+0000 7ff04affd700 1 -- 172.21.15.72:0/3867588594 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff064151380 con 0x7ff05005ef80 2023-08-31T19:01:16.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.640+0000 7ff0627fc700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 0x7ff0500613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:16.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.644+0000 7ff0627fc700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 0x7ff0500613c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7ff0640b0ed0 tx=0x7ff058007d40).ready entity=mgr.5973 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:16.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.652+0000 7ff04affd700 1 -- 172.21.15.72:0/3867588594 <== mgr.5973 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff064151380 con 0x7ff05005ef80 2023-08-31T19:01:16.652 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path snap_test_dir1 2023-08-31T19:01:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.654+0000 7ff0697ff700 1 -- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 msgr2=0x7ff0500613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.654+0000 7ff0697ff700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 0x7ff0500613c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7ff0640b0ed0 tx=0x7ff058007d40).stop 2023-08-31T19:01:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.654+0000 7ff0697ff700 1 -- 172.21.15.72:0/3867588594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff064064d70 msgr2=0x7ff064168810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.654+0000 7ff0697ff700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff064064d70 0x7ff064168810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff054014000 tx=0x7ff054017000).stop 2023-08-31T19:01:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.654+0000 7ff0697ff700 1 -- 172.21.15.72:0/3867588594 shutdown_connections 2023-08-31T19:01:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.654+0000 7ff0697ff700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff064151da0 0x7ff0640c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.654+0000 7ff0697ff700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff064064d70 0x7ff064168810 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.654+0000 7ff0697ff700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff05005ef80 0x7ff0500613c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.654+0000 7ff0697ff700 1 --2- 172.21.15.72:0/3867588594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff0640c5370 0x7ff064139290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.654+0000 7ff0697ff700 1 -- 172.21.15.72:0/3867588594 >> 172.21.15.72:0/3867588594 conn(0x7ff064063a90 msgr2=0x7ff0640cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.654+0000 7ff0697ff700 1 -- 172.21.15.72:0/3867588594 shutdown_connections 2023-08-31T19:01:16.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.654+0000 7ff0697ff700 1 -- 172.21.15.72:0/3867588594 wait complete. 2023-08-31T19:01:16.675 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-31T19:01:16.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-08-31T19:01:16.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.872+0000 7f6dec9ff700 1 Processor -- start 2023-08-31T19:01:16.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.873+0000 7f6dec9ff700 1 -- start start 2023-08-31T19:01:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.874+0000 7f6dec9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6de8154120 0x7f6de80a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.874+0000 7f6dec9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de80aa620 con 0x7f6de8154500 2023-08-31T19:01:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.874+0000 7f6dec9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de80aa3a0 con 0x7f6de8064db0 2023-08-31T19:01:16.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.874+0000 7f6dec9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de80c5450 con 0x7f6de8154120 2023-08-31T19:01:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.874+0000 7f6de5d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6de8154500 0x7f6de80646a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57800/0 (socket says 172.21.15.72:57800) 2023-08-31T19:01:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.874+0000 7f6de5d9b700 1 -- 172.21.15.72:0/3155383632 learned_addr learned my addr 172.21.15.72:0/3155383632 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:01:16.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.874+0000 7f6de659c700 1 --2- 172.21.15.72:0/3155383632 >> v2:172.21.15.146:3300/0 conn(0x7f6de8154120 0x7f6de80a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:16.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.874+0000 7f6de559a700 1 -- 172.21.15.72:0/3155383632 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602541487 0 0) 0x7f6de80aa620 con 0x7f6de8154500 2023-08-31T19:01:16.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.874+0000 7f6de559a700 1 -- 172.21.15.72:0/3155383632 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dd00033f0 con 0x7f6de8154500 2023-08-31T19:01:16.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de559a700 1 -- 172.21.15.72:0/3155383632 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2159272792 0 0) 0x7f6dd00033f0 con 0x7f6de8154500 2023-08-31T19:01:16.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de559a700 1 -- 172.21.15.72:0/3155383632 >> v2:172.21.15.146:3300/0 conn(0x7f6de8154120 msgr2=0x7f6de80a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:16.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de559a700 1 --2- 172.21.15.72:0/3155383632 >> v2:172.21.15.146:3300/0 conn(0x7f6de8154120 0x7f6de80a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:16.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de559a700 1 -- 172.21.15.72:0/3155383632 >> v1:172.21.15.146:6789/0 conn(0x7f6de8064db0 legacy=0x7f6de815dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:16.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de559a700 1 -- 172.21.15.72:0/3155383632 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de80c8050 con 0x7f6de8154500 2023-08-31T19:01:16.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de559a700 1 -- 172.21.15.72:0/3155383632 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f6ddc001470 con 0x7f6de8154500 2023-08-31T19:01:16.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de559a700 1 -- 172.21.15.72:0/3155383632 >> v1:172.21.15.72:6789/0 conn(0x7f6de8154500 legacy=0x7f6de80646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:16.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de559a700 1 --2- 172.21.15.72:0/3155383632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd00038e0 0x7f6dd0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:16.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de559a700 1 --2- 172.21.15.72:0/3155383632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd0004690 0x7f6dd0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:16.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de559a700 1 --2- 172.21.15.72:0/3155383632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd0005050 0x7f6dd000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:16.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de559a700 1 -- 172.21.15.72:0/3155383632 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80c5450 con 0x7f6dd00038e0 2023-08-31T19:01:16.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de559a700 1 -- 172.21.15.72:0/3155383632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd000bfe0 con 0x7f6dd0005050 2023-08-31T19:01:16.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de559a700 1 -- 172.21.15.72:0/3155383632 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd000c1a0 con 0x7f6dd0004690 2023-08-31T19:01:16.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de659c700 1 --2- 172.21.15.72:0/3155383632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd00038e0 0x7f6dd0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:16.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de5d9b700 1 --2- 172.21.15.72:0/3155383632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd0004690 0x7f6dd0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:16.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.875+0000 7f6de6d9d700 1 --2- 172.21.15.72:0/3155383632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd0005050 0x7f6dd000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:16.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.876+0000 7f6de659c700 1 -- 172.21.15.72:0/3155383632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd0004690 msgr2=0x7f6dd0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:16.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.876+0000 7f6de659c700 1 --2- 172.21.15.72:0/3155383632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd0004690 0x7f6dd0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:16.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.876+0000 7f6de659c700 1 -- 172.21.15.72:0/3155383632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd0005050 msgr2=0x7f6dd000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:16.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.876+0000 7f6de659c700 1 --2- 172.21.15.72:0/3155383632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd0005050 0x7f6dd000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:16.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.876+0000 7f6de659c700 1 -- 172.21.15.72:0/3155383632 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd00033f0 con 0x7f6dd00038e0 2023-08-31T19:01:16.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.876+0000 7f6de6d9d700 1 --2- 172.21.15.72:0/3155383632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd0005050 0x7f6dd000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:16.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.876+0000 7f6de6d9d700 1 -- 172.21.15.72:0/3155383632 reap_dead start 2023-08-31T19:01:16.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.876+0000 7f6de5d9b700 1 --2- 172.21.15.72:0/3155383632 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd0004690 0x7f6dd0004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:16.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.876+0000 7f6de659c700 1 --2- 172.21.15.72:0/3155383632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd00038e0 0x7f6dd0003d00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f6dd8006d80 tx=0x7f6dd8009060).ready entity=mon.0 client_cookie=733c1dd792a7a53d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:16.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.876+0000 7f6de559a700 1 -- 172.21.15.72:0/3155383632 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8009e90 con 0x7f6dd00038e0 2023-08-31T19:01:16.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.876+0000 7f6de559a700 1 -- 172.21.15.72:0/3155383632 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd8009430 con 0x7f6dd00038e0 2023-08-31T19:01:16.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.876+0000 7f6de559a700 1 -- 172.21.15.72:0/3155383632 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd800e850 con 0x7f6dd00038e0 2023-08-31T19:01:16.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.876+0000 7f6dec9ff700 1 -- 172.21.15.72:0/3155383632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd00038e0 msgr2=0x7f6dd0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:16.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.876+0000 7f6dec9ff700 1 --2- 172.21.15.72:0/3155383632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd00038e0 0x7f6dd0003d00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f6dd8006d80 tx=0x7f6dd8009060).stop 2023-08-31T19:01:16.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.877+0000 7f6dec9ff700 1 -- 172.21.15.72:0/3155383632 shutdown_connections 2023-08-31T19:01:16.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.877+0000 7f6dec9ff700 1 --2- 172.21.15.72:0/3155383632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dd00038e0 0x7f6dd0003d00 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:16.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.877+0000 7f6dec9ff700 1 -- 172.21.15.72:0/3155383632 >> 172.21.15.72:0/3155383632 conn(0x7f6de80cb7e0 msgr2=0x7f6de80c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:16.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.877+0000 7f6dec9ff700 1 -- 172.21.15.72:0/3155383632 shutdown_connections 2023-08-31T19:01:16.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.877+0000 7f6dec9ff700 1 -- 172.21.15.72:0/3155383632 wait complete. 2023-08-31T19:01:16.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.879+0000 7f6dec9ff700 1 Processor -- start 2023-08-31T19:01:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.879+0000 7f6dec9ff700 1 -- start start 2023-08-31T19:01:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.880+0000 7f6dec9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd00038e0 0x7f6de813f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.880+0000 7f6dec9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6de81655f0 0x7f6de8150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.880+0000 7f6dec9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8150620 0x7f6de81526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.880+0000 7f6dec9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de813f7e0 con 0x7f6de8150620 2023-08-31T19:01:16.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.880+0000 7f6dec9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80c3280 con 0x7f6de81655f0 2023-08-31T19:01:16.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.880+0000 7f6dec9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de8150aa0 con 0x7f6dd00038e0 2023-08-31T19:01:16.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.880+0000 7f6de6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8150620 0x7f6de81526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:16.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.881+0000 7f6de6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8150620 0x7f6de81526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39062/0 (socket says 172.21.15.72:39062) 2023-08-31T19:01:16.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.881+0000 7f6de6d9d700 1 -- 172.21.15.72:0/3376304561 learned_addr learned my addr 172.21.15.72:0/3376304561 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:16.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.881+0000 7f6de5d9b700 1 --2- 172.21.15.72:0/3376304561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6de81655f0 0x7f6de8150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:16.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.881+0000 7f6de659c700 1 --2- 172.21.15.72:0/3376304561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd00038e0 0x7f6de813f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:16.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.881+0000 7f6de6d9d700 1 -- 172.21.15.72:0/3376304561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd00038e0 msgr2=0x7f6de813f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:16.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.881+0000 7f6de6d9d700 1 --2- 172.21.15.72:0/3376304561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd00038e0 0x7f6de813f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:16.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.881+0000 7f6de6d9d700 1 -- 172.21.15.72:0/3376304561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6de81655f0 msgr2=0x7f6de8150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:16.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.881+0000 7f6de6d9d700 1 --2- 172.21.15.72:0/3376304561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6de81655f0 0x7f6de8150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.881+0000 7f6de6d9d700 1 -- 172.21.15.72:0/3376304561 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de8153a20 con 0x7f6de8150620 2023-08-31T19:01:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.881+0000 7f6de659c700 1 --2- 172.21.15.72:0/3376304561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd00038e0 0x7f6de813f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.881+0000 7f6de6d9d700 1 --2- 172.21.15.72:0/3376304561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8150620 0x7f6de81526d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f6de8063ff0 tx=0x7f6de0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.881+0000 7f6dd67fc700 1 -- 172.21.15.72:0/3376304561 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de000eeb0 con 0x7f6de8150620 2023-08-31T19:01:16.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.881+0000 7f6dd67fc700 1 -- 172.21.15.72:0/3376304561 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de0002490 con 0x7f6de8150620 2023-08-31T19:01:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.881+0000 7f6dec9ff700 1 -- 172.21.15.72:0/3376304561 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de8153460 con 0x7f6de8150620 2023-08-31T19:01:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.881+0000 7f6dd67fc700 1 -- 172.21.15.72:0/3376304561 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0002810 con 0x7f6de8150620 2023-08-31T19:01:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.882+0000 7f6dec9ff700 1 -- 172.21.15.72:0/3376304561 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de80c2f10 con 0x7f6de8150620 2023-08-31T19:01:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.883+0000 7f6dec9ff700 1 -- 172.21.15.72:0/3376304561 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de806a7e0 con 0x7f6de8150620 2023-08-31T19:01:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.883+0000 7f6dd67fc700 1 -- 172.21.15.72:0/3376304561 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f6de0003070 con 0x7f6de8150620 2023-08-31T19:01:16.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.884+0000 7f6dd67fc700 1 --2- 172.21.15.72:0/3376304561 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6dc805ed40 0x7f6dc8061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:16.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.884+0000 7f6dd67fc700 1 -- 172.21.15.72:0/3376304561 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6951+0+0 (secure 0 0 0) 0x7f6de00797d0 con 0x7f6de8150620 2023-08-31T19:01:16.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.884+0000 7f6de659c700 1 --2- 172.21.15.72:0/3376304561 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6dc805ed40 0x7f6dc8061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:16.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.885+0000 7f6de659c700 1 --2- 172.21.15.72:0/3376304561 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6dc805ed40 0x7f6dc8061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6dd80095a0 tx=0x7f6dd801a000).ready entity=mgr.5973 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:16.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:16.888+0000 7f6dd67fc700 1 -- 172.21.15.72:0/3376304561 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6de00498f0 con 0x7f6de8150620 2023-08-31T19:01:17.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.081+0000 7f6dec9ff700 1 -- 172.21.15.72:0/3376304561 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6de80c3410 con 0x7f6dc805ed40 2023-08-31T19:01:17.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.086+0000 7f6dd67fc700 1 -- 172.21.15.72:0/3376304561 <== mgr.5973 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6de80c3410 con 0x7f6dc805ed40 2023-08-31T19:01:17.086 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path snap_test_dir1 2023-08-31T19:01:17.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.088+0000 7f6dec9ff700 1 -- 172.21.15.72:0/3376304561 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6dc805ed40 msgr2=0x7f6dc8061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:17.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.088+0000 7f6dec9ff700 1 --2- 172.21.15.72:0/3376304561 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6dc805ed40 0x7f6dc8061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6dd80095a0 tx=0x7f6dd801a000).stop 2023-08-31T19:01:17.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.088+0000 7f6dec9ff700 1 -- 172.21.15.72:0/3376304561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8150620 msgr2=0x7f6de81526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:17.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.088+0000 7f6dec9ff700 1 --2- 172.21.15.72:0/3376304561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8150620 0x7f6de81526d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f6de8063ff0 tx=0x7f6de0009040).stop 2023-08-31T19:01:17.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.088+0000 7f6dec9ff700 1 -- 172.21.15.72:0/3376304561 shutdown_connections 2023-08-31T19:01:17.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.088+0000 7f6dec9ff700 1 --2- 172.21.15.72:0/3376304561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de8150620 0x7f6de81526d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:17.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.088+0000 7f6dec9ff700 1 --2- 172.21.15.72:0/3376304561 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dd00038e0 0x7f6de813f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:17.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.088+0000 7f6dec9ff700 1 --2- 172.21.15.72:0/3376304561 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6dc805ed40 0x7f6dc8061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:17.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.088+0000 7f6dec9ff700 1 --2- 172.21.15.72:0/3376304561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6de81655f0 0x7f6de8150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:17.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.088+0000 7f6dec9ff700 1 -- 172.21.15.72:0/3376304561 >> 172.21.15.72:0/3376304561 conn(0x7f6de80cb7e0 msgr2=0x7f6de80ab0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:17.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.088+0000 7f6dec9ff700 1 -- 172.21.15.72:0/3376304561 shutdown_connections 2023-08-31T19:01:17.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.088+0000 7f6dec9ff700 1 -- 172.21.15.72:0/3376304561 wait complete. 2023-08-31T19:01:17.106 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-31T19:01:17.106 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-31-19_02_00 in ~43s... 2023-08-31T19:01:17.107 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-31-19_03_00 in ~103s... 2023-08-31T19:01:17.107 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-08-31T19:01:17.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-31T19:01:17.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.301+0000 7f6b66dff700 1 Processor -- start 2023-08-31T19:01:17.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.301+0000 7f6b66dff700 1 -- start start 2023-08-31T19:01:17.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.303+0000 7f6b66dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b60064d70 0x7f6b601553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.303+0000 7f6b66dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6b600c5370 0x7f6b600bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.303+0000 7f6b66dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b60154f40 con 0x7f6b60151da0 2023-08-31T19:01:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.303+0000 7f6b66dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b600c57e0 con 0x7f6b600c5370 2023-08-31T19:01:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.303+0000 7f6b66dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60154960 con 0x7f6b60064d70 2023-08-31T19:01:17.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.303+0000 7f6b64b9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6b60151da0 0x7f6b60064660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57816/0 (socket says 172.21.15.72:57816) 2023-08-31T19:01:17.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.303+0000 7f6b64b9b700 1 -- 172.21.15.72:0/79779841 learned_addr learned my addr 172.21.15.72:0/79779841 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:01:17.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5ffff700 1 --2- 172.21.15.72:0/79779841 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b60064d70 0x7f6b601553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:17.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 -- 172.21.15.72:0/79779841 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705913557 0 0) 0x7f6b60154f40 con 0x7f6b60151da0 2023-08-31T19:01:17.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b6539c700 1 --2- 172.21.15.72:0/79779841 >> v2:172.21.15.146:3300/0 conn(0x7f6b600c5370 0x7f6b600bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:17.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 -- 172.21.15.72:0/79779841 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b500033f0 con 0x7f6b60151da0 2023-08-31T19:01:17.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 -- 172.21.15.72:0/79779841 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1057465415 0 0) 0x7f6b500033f0 con 0x7f6b60151da0 2023-08-31T19:01:17.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 -- 172.21.15.72:0/79779841 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b60064d70 msgr2=0x7f6b601553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:17.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 --2- 172.21.15.72:0/79779841 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b60064d70 0x7f6b601553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:17.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 -- 172.21.15.72:0/79779841 >> v2:172.21.15.146:3300/0 conn(0x7f6b600c5370 msgr2=0x7f6b600bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:17.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 --2- 172.21.15.72:0/79779841 >> v2:172.21.15.146:3300/0 conn(0x7f6b600c5370 0x7f6b600bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:17.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 -- 172.21.15.72:0/79779841 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b600aa2c0 con 0x7f6b60151da0 2023-08-31T19:01:17.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 -- 172.21.15.72:0/79779841 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f6b54001470 con 0x7f6b60151da0 2023-08-31T19:01:17.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 -- 172.21.15.72:0/79779841 >> v1:172.21.15.72:6789/0 conn(0x7f6b60151da0 legacy=0x7f6b60064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:17.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 --2- 172.21.15.72:0/79779841 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b60064d70 0x7f6b500038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:17.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 --2- 172.21.15.72:0/79779841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b50003e10 0x7f6b50004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:17.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 --2- 172.21.15.72:0/79779841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b50004b80 0x7f6b50005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:17.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 -- 172.21.15.72:0/79779841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60154960 con 0x7f6b50003e10 2023-08-31T19:01:17.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 -- 172.21.15.72:0/79779841 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5000b8e0 con 0x7f6b50004b80 2023-08-31T19:01:17.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.304+0000 7f6b5f7fe700 1 -- 172.21.15.72:0/79779841 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5000ba20 con 0x7f6b60064d70 2023-08-31T19:01:17.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.305+0000 7f6b5ffff700 1 --2- 172.21.15.72:0/79779841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b50003e10 0x7f6b50004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:17.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.305+0000 7f6b6539c700 1 --2- 172.21.15.72:0/79779841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b50004b80 0x7f6b50005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:17.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.305+0000 7f6b64b9b700 1 --2- 172.21.15.72:0/79779841 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b60064d70 0x7f6b500038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:17.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.305+0000 7f6b5ffff700 1 -- 172.21.15.72:0/79779841 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b60064d70 msgr2=0x7f6b500038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:17.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.305+0000 7f6b5ffff700 1 --2- 172.21.15.72:0/79779841 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b60064d70 0x7f6b500038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:17.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.305+0000 7f6b5ffff700 1 -- 172.21.15.72:0/79779841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b50004b80 msgr2=0x7f6b50005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:01:17.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.305+0000 7f6b5ffff700 1 --2- 172.21.15.72:0/79779841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b50004b80 0x7f6b50005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:17.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.305+0000 7f6b5ffff700 1 -- 172.21.15.72:0/79779841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b500033f0 con 0x7f6b50003e10 2023-08-31T19:01:17.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.305+0000 7f6b5ffff700 1 --2- 172.21.15.72:0/79779841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b50003e10 0x7f6b50004690 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f6b4c009a60 tx=0x7f6b4c009060).ready entity=mon.0 client_cookie=f4dda4d43371441 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:17.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.305+0000 7f6b5f7fe700 1 -- 172.21.15.72:0/79779841 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c009ea0 con 0x7f6b50003e10 2023-08-31T19:01:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.305+0000 7f6b5f7fe700 1 -- 172.21.15.72:0/79779841 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4c009430 con 0x7f6b50003e10 2023-08-31T19:01:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.305+0000 7f6b5f7fe700 1 -- 172.21.15.72:0/79779841 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c00e870 con 0x7f6b50003e10 2023-08-31T19:01:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.306+0000 7f6b66dff700 1 -- 172.21.15.72:0/79779841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b50003e10 msgr2=0x7f6b50004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.306+0000 7f6b66dff700 1 --2- 172.21.15.72:0/79779841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b50003e10 0x7f6b50004690 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f6b4c009a60 tx=0x7f6b4c009060).stop 2023-08-31T19:01:17.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.306+0000 7f6b6539c700 1 -- 172.21.15.72:0/79779841 reap_dead start 2023-08-31T19:01:17.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.306+0000 7f6b66dff700 1 -- 172.21.15.72:0/79779841 shutdown_connections 2023-08-31T19:01:17.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.306+0000 7f6b66dff700 1 -- 172.21.15.72:0/79779841 >> 172.21.15.72:0/79779841 conn(0x7f6b60063a90 msgr2=0x7f6b600cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:17.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.306+0000 7f6b66dff700 1 -- 172.21.15.72:0/79779841 shutdown_connections 2023-08-31T19:01:17.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.306+0000 7f6b66dff700 1 -- 172.21.15.72:0/79779841 wait complete. 2023-08-31T19:01:17.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.307+0000 7f6b66dff700 1 Processor -- start 2023-08-31T19:01:17.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.308+0000 7f6b66dff700 1 -- start start 2023-08-31T19:01:17.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.308+0000 7f6b66dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b50003e10 0x7f6b600af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:17.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.308+0000 7f6b66dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b600c47a0 0x7f6b600af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.308+0000 7f6b66dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b600afee0 0x7f6b600b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.308+0000 7f6b66dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60151050 con 0x7f6b50003e10 2023-08-31T19:01:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.308+0000 7f6b66dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6014f0c0 con 0x7f6b600afee0 2023-08-31T19:01:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.308+0000 7f6b66dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b601500b0 con 0x7f6b600c47a0 2023-08-31T19:01:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b64b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b50003e10 0x7f6b600af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:17.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b64b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b50003e10 0x7f6b600af500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39080/0 (socket says 172.21.15.72:39080) 2023-08-31T19:01:17.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b64b9b700 1 -- 172.21.15.72:0/3360335225 learned_addr learned my addr 172.21.15.72:0/3360335225 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:01:17.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b6539c700 1 --2- 172.21.15.72:0/3360335225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b600afee0 0x7f6b600b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:17.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b5ffff700 1 --2- 172.21.15.72:0/3360335225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b600c47a0 0x7f6b600af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:17.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b64b9b700 1 -- 172.21.15.72:0/3360335225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b600c47a0 msgr2=0x7f6b600af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:17.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b64b9b700 1 --2- 172.21.15.72:0/3360335225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b600c47a0 0x7f6b600af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:17.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b64b9b700 1 -- 172.21.15.72:0/3360335225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b600afee0 msgr2=0x7f6b600b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:17.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b64b9b700 1 --2- 172.21.15.72:0/3360335225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b600afee0 0x7f6b600b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:17.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b64b9b700 1 -- 172.21.15.72:0/3360335225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6014f310 con 0x7f6b50003e10 2023-08-31T19:01:17.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b6539c700 1 --2- 172.21.15.72:0/3360335225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b600afee0 0x7f6b600b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:01:17.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b64b9b700 1 --2- 172.21.15.72:0/3360335225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b50003e10 0x7f6b600af500 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f6b54004990 tx=0x7f6b54001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b5cff9700 1 -- 172.21.15.72:0/3360335225 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b54004e00 con 0x7f6b50003e10 2023-08-31T19:01:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b5cff9700 1 -- 172.21.15.72:0/3360335225 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5400f8d0 con 0x7f6b50003e10 2023-08-31T19:01:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b5cff9700 1 -- 172.21.15.72:0/3360335225 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400fc50 con 0x7f6b50003e10 2023-08-31T19:01:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.309+0000 7f6b66dff700 1 -- 172.21.15.72:0/3360335225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6014f5f0 con 0x7f6b50003e10 2023-08-31T19:01:17.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.310+0000 7f6b66dff700 1 -- 172.21.15.72:0/3360335225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6014fbb0 con 0x7f6b50003e10 2023-08-31T19:01:17.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.311+0000 7f6b66dff700 1 -- 172.21.15.72:0/3360335225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6006a7e0 con 0x7f6b50003e10 2023-08-31T19:01:17.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.311+0000 7f6b5cff9700 1 -- 172.21.15.72:0/3360335225 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 17) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f6b5401d3b0 con 0x7f6b50003e10 2023-08-31T19:01:17.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.312+0000 7f6b5cff9700 1 --2- 172.21.15.72:0/3360335225 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6b4405ed40 0x7f6b44061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:01:17.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.312+0000 7f6b5cff9700 1 -- 172.21.15.72:0/3360335225 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6951+0+0 (secure 0 0 0) 0x7f6b54079a10 con 0x7f6b50003e10 2023-08-31T19:01:17.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.313+0000 7f6b5ffff700 1 --2- 172.21.15.72:0/3360335225 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6b4405ed40 0x7f6b44061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:01:17.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.313+0000 7f6b5ffff700 1 --2- 172.21.15.72:0/3360335225 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6b4405ed40 0x7f6b44061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6b4c009a60 tx=0x7f6b4c01a000).ready entity=mgr.5973 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:01:17.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.316+0000 7f6b5cff9700 1 -- 172.21.15.72:0/3360335225 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6b5404ac50 con 0x7f6b50003e10 2023-08-31T19:01:17.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.506+0000 7f6b66dff700 1 -- 172.21.15.72:0/3360335225 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b6006c6b0 con 0x7f6b4405ed40 2023-08-31T19:01:17.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.509+0000 7f6b5cff9700 1 -- 172.21.15.72:0/3360335225 <== mgr.5973 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7f6b6006c6b0 con 0x7f6b4405ed40 2023-08-31T19:01:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:01:17.509 INFO:teuthology.orchestra.run.smithi072.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-08-31T19:01:17.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.511+0000 7f6b66dff700 1 -- 172.21.15.72:0/3360335225 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6b4405ed40 msgr2=0x7f6b44061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:17.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.511+0000 7f6b66dff700 1 --2- 172.21.15.72:0/3360335225 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6b4405ed40 0x7f6b44061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6b4c009a60 tx=0x7f6b4c01a000).stop 2023-08-31T19:01:17.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.511+0000 7f6b66dff700 1 -- 172.21.15.72:0/3360335225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b50003e10 msgr2=0x7f6b600af500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:01:17.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.511+0000 7f6b66dff700 1 --2- 172.21.15.72:0/3360335225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b50003e10 0x7f6b600af500 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f6b54004990 tx=0x7f6b54001e90).stop 2023-08-31T19:01:17.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.511+0000 7f6b66dff700 1 -- 172.21.15.72:0/3360335225 shutdown_connections 2023-08-31T19:01:17.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.511+0000 7f6b66dff700 1 --2- 172.21.15.72:0/3360335225 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6b4405ed40 0x7f6b44061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:17.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.511+0000 7f6b66dff700 1 --2- 172.21.15.72:0/3360335225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b600afee0 0x7f6b600b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:17.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.511+0000 7f6b66dff700 1 --2- 172.21.15.72:0/3360335225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b50003e10 0x7f6b600af500 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:17.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.511+0000 7f6b66dff700 1 --2- 172.21.15.72:0/3360335225 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b600c47a0 0x7f6b600af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:01:17.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.511+0000 7f6b66dff700 1 -- 172.21.15.72:0/3360335225 >> 172.21.15.72:0/3360335225 conn(0x7f6b60063a90 msgr2=0x7f6b600cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:01:17.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.511+0000 7f6b66dff700 1 -- 172.21.15.72:0/3360335225 shutdown_connections 2023-08-31T19:01:17.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:01:17.511+0000 7f6b66dff700 1 -- 172.21.15.72:0/3360335225 wait complete. 2023-08-31T19:01:17.528 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-08-31T19:01:17.528 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-08-31T19:01:17.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:17.529 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:18.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:18.580 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:19.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:19.635 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:20.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:20.691 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:21.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:21.746 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:22.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:22.801 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:23.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:01:23.328 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:01:23.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:23.856 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:24.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:24.910 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:25.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:25.966 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:27.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:27.024 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:28.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:28.081 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:29.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:29.139 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:30.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:30.196 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:31.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:31.251 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:32.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:32.306 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:33.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:33.361 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:34.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:34.415 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:35.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:35.471 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:36.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:36.528 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:37.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:37.584 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:38.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:38.640 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:39.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:39.695 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:40.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:40.751 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:41.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:41.807 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:42.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:42.864 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:43.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:43.920 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:44.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:44.976 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:46.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:46.036 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:47.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:47.090 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:48.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:48.146 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:49.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:49.201 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:50.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:50.256 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:51.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:51.310 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:52.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:52.365 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:53.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:53.420 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:53.529 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:01:53.535 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:01:54.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:54.480 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:55.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:55.536 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:56.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:56.592 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:57.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:57.649 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:58.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:58.704 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:01:59.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:01:59.760 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:00.093 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:02:00.092+0000 7facd54a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:02:00.093 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:02:00.092+0000 7facd54a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:02:00.094 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:02:00.092+0000 7facd54a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:02:00.094 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:02:00.092+0000 7facd54a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:02:00.094 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:02:00.092+0000 7facd54a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:02:00.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:00.815 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:00.870 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:00.871 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-31-19_02_00_UTC'] 2023-08-31T19:02:00.871 DEBUG:tasks.cephfs.test_snap_schedules:exec=1693508477.1067948, now = 1693508520.8717885, timo = 43 2023-08-31T19:02:01.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:01.873 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:01.926 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:02.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:02.928 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:02.981 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:03.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:03.984 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:04.039 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:05.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:05.042 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:05.095 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:06.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:06.098 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:06.150 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:07.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:07.152 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:07.205 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:08.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:08.208 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:08.260 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:09.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:09.263 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:09.315 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:10.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:10.317 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:10.370 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:11.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:11.372 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:11.424 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:12.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:12.427 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:12.480 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:13.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:13.482 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:13.535 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:14.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:14.538 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:14.591 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:15.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:15.595 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:15.647 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:16.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:16.650 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:16.703 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:17.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:17.705 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:17.758 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:18.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:18.760 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:18.812 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:19.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:19.815 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:19.867 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:20.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:20.869 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:20.921 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:21.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:21.926 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:21.981 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:22.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:22.983 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:23.035 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:23.636 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:02:23.641 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:02:24.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:24.038 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:24.092 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:25.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:25.093 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:25.148 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:26.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:26.152 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:26.204 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:27.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:27.206 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:27.263 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:28.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:28.264 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:28.317 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:29.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:29.319 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:29.371 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:30.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:30.374 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:30.427 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:31.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:31.429 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:31.482 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:32.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:32.484 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:32.537 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:33.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:33.540 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:33.592 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:34.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:34.595 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:34.647 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:35.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:35.650 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:35.703 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:36.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:36.705 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:36.758 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:37.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:37.761 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:37.813 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:38.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:38.816 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:38.869 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:39.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:39.872 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:39.926 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:40.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:40.929 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:40.981 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:41.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:41.984 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:42.038 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:43.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:43.040 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:43.092 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:44.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:44.095 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:44.147 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:45.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:45.150 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:45.203 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:46.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:46.206 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:46.258 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:47.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:47.262 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:47.315 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:48.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:48.318 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:48.370 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:49.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:49.372 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:49.426 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:50.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:50.428 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:50.481 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:51.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:51.483 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:51.536 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:52.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:52.539 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:52.592 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:53.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:53.594 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:53.647 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:53.821 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:02:53.827 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:02:54.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:54.650 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:54.702 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:55.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:55.706 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:55.758 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:56.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:56.761 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:56.814 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:57.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:57.816 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:57.868 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:58.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:58.872 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:58.925 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:02:59.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:02:59.927 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:02:59.979 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:03:00.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:03:00.983 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:03:01.040 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:03:01.043 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_03_00_UTC 2023-08-31T19:03:01.044 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-31-19_03_00_UTC'] 2023-08-31T19:03:01.044 DEBUG:tasks.cephfs.test_snap_schedules:exec=1693508477.1067948, now = 1693508581.04489, timo = 103 2023-08-31T19:03:02.046 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-31T19:03:02.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.247+0000 7f48d43ff700 1 Processor -- start 2023-08-31T19:03:02.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.247+0000 7f48d43ff700 1 -- start start 2023-08-31T19:03:02.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.249+0000 7f48d43ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48cc1377c0 0x7f48cc069460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.249+0000 7f48d43ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48cc0c13e0 con 0x7f48cc0c3ac0 2023-08-31T19:03:02.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.249+0000 7f48d43ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48cc0c19a0 con 0x7f48cc1373e0 2023-08-31T19:03:02.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.249+0000 7f48d43ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc06a1d0 con 0x7f48cc1377c0 2023-08-31T19:03:02.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.249+0000 7f48d299c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f48cc0c3ac0 0x7f48cc069950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60408/0 (socket says 172.21.15.72:60408) 2023-08-31T19:03:02.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.249+0000 7f48d299c700 1 -- 172.21.15.72:0/1911484598 learned_addr learned my addr 172.21.15.72:0/1911484598 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:02.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.249+0000 7f48d199a700 1 --2- 172.21.15.72:0/1911484598 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48cc1377c0 0x7f48cc069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.249+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950529378 0 0) 0x7f48cc0c13e0 con 0x7f48cc0c3ac0 2023-08-31T19:03:02.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.249+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48b80033f0 con 0x7f48cc0c3ac0 2023-08-31T19:03:02.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009381579 0 0) 0x7f48cc0c19a0 con 0x7f48cc1373e0 2023-08-31T19:03:02.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48cc0c13e0 con 0x7f48cc1373e0 2023-08-31T19:03:02.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 598795986 0 0) 0x7f48b80033f0 con 0x7f48cc0c3ac0 2023-08-31T19:03:02.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48cc1377c0 msgr2=0x7f48cc069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:02.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d1199700 1 --2- 172.21.15.72:0/1911484598 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48cc1377c0 0x7f48cc069460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:02.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 >> v1:172.21.15.146:6789/0 conn(0x7f48cc1373e0 legacy=0x7f48cc0c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:02.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc06a4b0 con 0x7f48cc0c3ac0 2023-08-31T19:03:02.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f48c40017f0 con 0x7f48cc0c3ac0 2023-08-31T19:03:02.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 >> v1:172.21.15.72:6789/0 conn(0x7f48cc0c3ac0 legacy=0x7f48cc069950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:02.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d1199700 1 --2- 172.21.15.72:0/1911484598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48b8003aa0 0x7f48b8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d1199700 1 --2- 172.21.15.72:0/1911484598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b8004690 0x7f48b8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d1199700 1 --2- 172.21.15.72:0/1911484598 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48cc1377c0 0x7f48b8005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc06a1d0 con 0x7f48b8003aa0 2023-08-31T19:03:02.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b800b990 con 0x7f48b8004690 2023-08-31T19:03:02.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b800bb20 con 0x7f48cc1377c0 2023-08-31T19:03:02.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d299c700 1 --2- 172.21.15.72:0/1911484598 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48cc1377c0 0x7f48b8005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d219b700 1 --2- 172.21.15.72:0/1911484598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48b8003aa0 0x7f48b8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.250+0000 7f48d199a700 1 --2- 172.21.15.72:0/1911484598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b8004690 0x7f48b8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.251+0000 7f48d219b700 1 -- 172.21.15.72:0/1911484598 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48cc1377c0 msgr2=0x7f48b8005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:02.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.251+0000 7f48d219b700 1 --2- 172.21.15.72:0/1911484598 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48cc1377c0 0x7f48b8005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:02.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.251+0000 7f48d219b700 1 -- 172.21.15.72:0/1911484598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b8004690 msgr2=0x7f48b8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:02.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.251+0000 7f48d219b700 1 --2- 172.21.15.72:0/1911484598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b8004690 0x7f48b8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:02.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.251+0000 7f48d219b700 1 -- 172.21.15.72:0/1911484598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b80033f0 con 0x7f48b8003aa0 2023-08-31T19:03:02.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.251+0000 7f48d299c700 1 --2- 172.21.15.72:0/1911484598 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48cc1377c0 0x7f48b8005020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:03:02.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.251+0000 7f48d219b700 1 --2- 172.21.15.72:0/1911484598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48b8003aa0 0x7f48b8003ea0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f48c80018c0 tx=0x7f48c8007bb0).ready entity=mon.0 client_cookie=4206bd1808b73b43 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:02.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.251+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c8007020 con 0x7f48b8003aa0 2023-08-31T19:03:02.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.251+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c8007180 con 0x7f48b8003aa0 2023-08-31T19:03:02.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.251+0000 7f48d1199700 1 -- 172.21.15.72:0/1911484598 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c8007500 con 0x7f48b8003aa0 2023-08-31T19:03:02.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.251+0000 7f48d43ff700 1 -- 172.21.15.72:0/1911484598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48b8003aa0 msgr2=0x7f48b8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:02.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.251+0000 7f48d43ff700 1 --2- 172.21.15.72:0/1911484598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48b8003aa0 0x7f48b8003ea0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f48c80018c0 tx=0x7f48c8007bb0).stop 2023-08-31T19:03:02.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.251+0000 7f48d299c700 1 -- 172.21.15.72:0/1911484598 reap_dead start 2023-08-31T19:03:02.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.251+0000 7f48d43ff700 1 -- 172.21.15.72:0/1911484598 shutdown_connections 2023-08-31T19:03:02.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.251+0000 7f48d43ff700 1 -- 172.21.15.72:0/1911484598 >> 172.21.15.72:0/1911484598 conn(0x7f48cc062650 msgr2=0x7f48cc062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:02.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.252+0000 7f48d43ff700 1 -- 172.21.15.72:0/1911484598 shutdown_connections 2023-08-31T19:03:02.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.252+0000 7f48d43ff700 1 -- 172.21.15.72:0/1911484598 wait complete. 2023-08-31T19:03:02.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.253+0000 7f48d43ff700 1 Processor -- start 2023-08-31T19:03:02.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.253+0000 7f48d43ff700 1 -- start start 2023-08-31T19:03:02.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.254+0000 7f48d43ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b8003aa0 0x7f48cc168500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.254+0000 7f48d43ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48cc0a90a0 0x7f48cc14cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.254+0000 7f48d43ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48cc069250 0x7f48cc0696d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.254+0000 7f48d43ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc136d30 con 0x7f48cc069250 2023-08-31T19:03:02.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.254+0000 7f48d43ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc14e4b0 con 0x7f48b8003aa0 2023-08-31T19:03:02.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.254+0000 7f48d43ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc069bc0 con 0x7f48cc0a90a0 2023-08-31T19:03:02.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.254+0000 7f48d299c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48cc069250 0x7f48cc0696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.254+0000 7f48d299c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48cc069250 0x7f48cc0696d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35068/0 (socket says 172.21.15.72:35068) 2023-08-31T19:03:02.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.254+0000 7f48d299c700 1 -- 172.21.15.72:0/2166814513 learned_addr learned my addr 172.21.15.72:0/2166814513 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:02.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.254+0000 7f48d199a700 1 --2- 172.21.15.72:0/2166814513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48cc0a90a0 0x7f48cc14cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.254+0000 7f48d219b700 1 --2- 172.21.15.72:0/2166814513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b8003aa0 0x7f48cc168500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.255+0000 7f48d299c700 1 -- 172.21.15.72:0/2166814513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48cc0a90a0 msgr2=0x7f48cc14cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:02.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.255+0000 7f48d299c700 1 --2- 172.21.15.72:0/2166814513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48cc0a90a0 0x7f48cc14cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:02.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.255+0000 7f48d299c700 1 -- 172.21.15.72:0/2166814513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b8003aa0 msgr2=0x7f48cc168500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:02.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.255+0000 7f48d299c700 1 --2- 172.21.15.72:0/2166814513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b8003aa0 0x7f48cc168500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:02.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.255+0000 7f48d299c700 1 -- 172.21.15.72:0/2166814513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc14e940 con 0x7f48cc069250 2023-08-31T19:03:02.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.255+0000 7f48d299c700 1 --2- 172.21.15.72:0/2166814513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48cc069250 0x7f48cc0696d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f48cc1485c0 tx=0x7f48c4007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:02.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.255+0000 7f48c27fc700 1 -- 172.21.15.72:0/2166814513 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c40013e0 con 0x7f48cc069250 2023-08-31T19:03:02.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.255+0000 7f48c27fc700 1 -- 172.21.15.72:0/2166814513 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c400f8a0 con 0x7f48cc069250 2023-08-31T19:03:02.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.255+0000 7f48d43ff700 1 -- 172.21.15.72:0/2166814513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48cc14d8a0 con 0x7f48cc069250 2023-08-31T19:03:02.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.255+0000 7f48c27fc700 1 -- 172.21.15.72:0/2166814513 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400fc20 con 0x7f48cc069250 2023-08-31T19:03:02.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.255+0000 7f48d43ff700 1 -- 172.21.15.72:0/2166814513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48cc14de60 con 0x7f48cc069250 2023-08-31T19:03:02.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.257+0000 7f48d43ff700 1 -- 172.21.15.72:0/2166814513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc14e660 con 0x7f48cc069250 2023-08-31T19:03:02.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.257+0000 7f48c27fc700 1 -- 172.21.15.72:0/2166814513 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 20) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f48c4020440 con 0x7f48cc069250 2023-08-31T19:03:02.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.258+0000 7f48c27fc700 1 --2- 172.21.15.72:0/2166814513 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f48b005ef80 0x7f48b0061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.258+0000 7f48c27fc700 1 -- 172.21.15.72:0/2166814513 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7067+0+0 (secure 0 0 0) 0x7f48c407a070 con 0x7f48cc069250 2023-08-31T19:03:02.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.258+0000 7f48d219b700 1 --2- 172.21.15.72:0/2166814513 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f48b005ef80 0x7f48b0061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.259+0000 7f48d219b700 1 --2- 172.21.15.72:0/2166814513 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f48b005ef80 0x7f48b0061440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f48c8000c00 tx=0x7f48c8016000).ready entity=mgr.5973 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:02.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.262+0000 7f48c27fc700 1 -- 172.21.15.72:0/2166814513 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f48cc14e660 con 0x7f48cc069250 2023-08-31T19:03:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.455+0000 7f48d43ff700 1 -- 172.21.15.72:0/2166814513 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f48cc14e620 con 0x7f48b005ef80 2023-08-31T19:03:02.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.460+0000 7f48c27fc700 1 -- 172.21.15.72:0/2166814513 <== mgr.5973 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f48cc14e620 con 0x7f48b005ef80 2023-08-31T19:03:02.460 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path snap_test_dir1 2023-08-31T19:03:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.461+0000 7f48d43ff700 1 -- 172.21.15.72:0/2166814513 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f48b005ef80 msgr2=0x7f48b0061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.461+0000 7f48d43ff700 1 --2- 172.21.15.72:0/2166814513 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f48b005ef80 0x7f48b0061440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f48c8000c00 tx=0x7f48c8016000).stop 2023-08-31T19:03:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.461+0000 7f48d43ff700 1 -- 172.21.15.72:0/2166814513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48cc069250 msgr2=0x7f48cc0696d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:02.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.461+0000 7f48d43ff700 1 --2- 172.21.15.72:0/2166814513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48cc069250 0x7f48cc0696d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f48cc1485c0 tx=0x7f48c4007f40).stop 2023-08-31T19:03:02.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.462+0000 7f48d43ff700 1 -- 172.21.15.72:0/2166814513 shutdown_connections 2023-08-31T19:03:02.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.462+0000 7f48d43ff700 1 --2- 172.21.15.72:0/2166814513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48cc069250 0x7f48cc0696d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:02.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.462+0000 7f48d43ff700 1 --2- 172.21.15.72:0/2166814513 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f48b005ef80 0x7f48b0061440 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:02.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.462+0000 7f48d43ff700 1 --2- 172.21.15.72:0/2166814513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48b8003aa0 0x7f48cc168500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.462+0000 7f48d43ff700 1 --2- 172.21.15.72:0/2166814513 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f48cc0a90a0 0x7f48cc14cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.462+0000 7f48d43ff700 1 -- 172.21.15.72:0/2166814513 >> 172.21.15.72:0/2166814513 conn(0x7f48cc062650 msgr2=0x7f48cc14fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.462+0000 7f48d43ff700 1 -- 172.21.15.72:0/2166814513 shutdown_connections 2023-08-31T19:03:02.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.462+0000 7f48d43ff700 1 -- 172.21.15.72:0/2166814513 wait complete. 2023-08-31T19:03:02.479 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-31T19:03:02.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:03:02.480 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:03:02.527 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:03:02.527 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_03_00_UTC 2023-08-31T19:03:02.528 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-31-19_02_00_UTC 2023-08-31T19:03:02.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:03:02.529 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-31-19_02_00_UTC) 2023-08-31T19:03:02.621 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-31-19_03_00_UTC 2023-08-31T19:03:02.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:03:02.622 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-31-19_03_00_UTC) 2023-08-31T19:03:02.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:03:02.674 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-31T19:03:02.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-31T19:03:02.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.913+0000 7f64ef9ff700 1 Processor -- start 2023-08-31T19:03:02.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.914+0000 7f64ef9ff700 1 -- start start 2023-08-31T19:03:02.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.915+0000 7f64ef9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64e8153ed0 0x7f64e81542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.915+0000 7f64ef9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e80a84b0 con 0x7f64e80bdb30 2023-08-31T19:03:02.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.915+0000 7f64ef9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e80c9410 con 0x7f64e80663d0 2023-08-31T19:03:02.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.915+0000 7f64ef9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80c5310 con 0x7f64e8153ed0 2023-08-31T19:03:02.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.915+0000 7f64ecf9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f64e80bdb30 0x7f64e8155200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34836/0 (socket says 172.21.15.72:34836) 2023-08-31T19:03:02.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.915+0000 7f64ecf9a700 1 -- 172.21.15.72:0/2834323320 learned_addr learned my addr 172.21.15.72:0/2834323320 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:02.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.915+0000 7f64ed79b700 1 --2- 172.21.15.72:0/2834323320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64e8153ed0 0x7f64e81542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992768345 0 0) 0x7f64e80a84b0 con 0x7f64e80bdb30 2023-08-31T19:03:02.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64d40033f0 con 0x7f64e80bdb30 2023-08-31T19:03:02.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253916453 0 0) 0x7f64e80c9410 con 0x7f64e80663d0 2023-08-31T19:03:02.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64e80a84b0 con 0x7f64e80663d0 2023-08-31T19:03:02.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2206052773 0 0) 0x7f64d40033f0 con 0x7f64e80bdb30 2023-08-31T19:03:02.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64e8153ed0 msgr2=0x7f64e81542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:02.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 --2- 172.21.15.72:0/2834323320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64e8153ed0 0x7f64e81542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:02.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 >> v1:172.21.15.146:6789/0 conn(0x7f64e80663d0 legacy=0x7f64e8157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:02.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e80a7ef0 con 0x7f64e80bdb30 2023-08-31T19:03:02.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f64d8001470 con 0x7f64e80bdb30 2023-08-31T19:03:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 >> v1:172.21.15.72:6789/0 conn(0x7f64e80bdb30 legacy=0x7f64e8155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 --2- 172.21.15.72:0/2834323320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64e8153ed0 0x7f64d4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 --2- 172.21.15.72:0/2834323320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d4003fb0 0x7f64d4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 --2- 172.21.15.72:0/2834323320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d4004b80 0x7f64d4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80c5310 con 0x7f64d4004b80 2023-08-31T19:03:02.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d400b9f0 con 0x7f64d4003fb0 2023-08-31T19:03:02.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d400bbb0 con 0x7f64e8153ed0 2023-08-31T19:03:02.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64edf9c700 1 --2- 172.21.15.72:0/2834323320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d4004b80 0x7f64d4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64ecf9a700 1 --2- 172.21.15.72:0/2834323320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d4003fb0 0x7f64d4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.916+0000 7f64ed79b700 1 --2- 172.21.15.72:0/2834323320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64e8153ed0 0x7f64d4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.917+0000 7f64edf9c700 1 -- 172.21.15.72:0/2834323320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64e8153ed0 msgr2=0x7f64d4003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:02.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.917+0000 7f64edf9c700 1 --2- 172.21.15.72:0/2834323320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64e8153ed0 0x7f64d4003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:02.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.917+0000 7f64edf9c700 1 -- 172.21.15.72:0/2834323320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d4003fb0 msgr2=0x7f64d4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:02.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.917+0000 7f64edf9c700 1 --2- 172.21.15.72:0/2834323320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d4003fb0 0x7f64d4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:02.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.917+0000 7f64edf9c700 1 -- 172.21.15.72:0/2834323320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d40033f0 con 0x7f64d4004b80 2023-08-31T19:03:02.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.917+0000 7f64edf9c700 1 --2- 172.21.15.72:0/2834323320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d4004b80 0x7f64d4005000 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f64e0001f60 tx=0x7f64e000c0e0).ready entity=mon.0 client_cookie=1026f5721adc9b2c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:02.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.917+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0001970 con 0x7f64d4004b80 2023-08-31T19:03:02.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.917+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e0006a70 con 0x7f64d4004b80 2023-08-31T19:03:02.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.917+0000 7f64dffff700 1 -- 172.21.15.72:0/2834323320 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0006e10 con 0x7f64d4004b80 2023-08-31T19:03:02.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.918+0000 7f64ef9ff700 1 -- 172.21.15.72:0/2834323320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d4004b80 msgr2=0x7f64d4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:02.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.918+0000 7f64ef9ff700 1 --2- 172.21.15.72:0/2834323320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d4004b80 0x7f64d4005000 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f64e0001f60 tx=0x7f64e000c0e0).stop 2023-08-31T19:03:02.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.918+0000 7f64edf9c700 1 -- 172.21.15.72:0/2834323320 reap_dead start 2023-08-31T19:03:02.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.918+0000 7f64ef9ff700 1 -- 172.21.15.72:0/2834323320 shutdown_connections 2023-08-31T19:03:02.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.918+0000 7f64ef9ff700 1 -- 172.21.15.72:0/2834323320 >> 172.21.15.72:0/2834323320 conn(0x7f64e805eb60 msgr2=0x7f64e80c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:02.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.918+0000 7f64ef9ff700 1 -- 172.21.15.72:0/2834323320 shutdown_connections 2023-08-31T19:03:02.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.918+0000 7f64ef9ff700 1 -- 172.21.15.72:0/2834323320 wait complete. 2023-08-31T19:03:02.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.919+0000 7f64ef9ff700 1 Processor -- start 2023-08-31T19:03:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.919+0000 7f64ef9ff700 1 -- start start 2023-08-31T19:03:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.920+0000 7f64ef9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64d4004b80 0x7f64e80c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.920+0000 7f64ef9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e80bfdc0 0x7f64e80c0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.920+0000 7f64ef9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e80c1df0 0x7f64e80c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.920+0000 7f64ef9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80c18e0 con 0x7f64e80bfdc0 2023-08-31T19:03:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.920+0000 7f64ef9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80ad020 con 0x7f64e80c1df0 2023-08-31T19:03:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.920+0000 7f64ef9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80c0730 con 0x7f64d4004b80 2023-08-31T19:03:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.920+0000 7f64ecf9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e80bfdc0 0x7f64e80c0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.921+0000 7f64ecf9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e80bfdc0 0x7f64e80c0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55724/0 (socket says 172.21.15.72:55724) 2023-08-31T19:03:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.921+0000 7f64ecf9a700 1 -- 172.21.15.72:0/4036977925 learned_addr learned my addr 172.21.15.72:0/4036977925 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.921+0000 7f64edf9c700 1 --2- 172.21.15.72:0/4036977925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e80c1df0 0x7f64e80c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.921+0000 7f64ed79b700 1 --2- 172.21.15.72:0/4036977925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64d4004b80 0x7f64e80c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.921+0000 7f64ecf9a700 1 -- 172.21.15.72:0/4036977925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64d4004b80 msgr2=0x7f64e80c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:02.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.921+0000 7f64ecf9a700 1 --2- 172.21.15.72:0/4036977925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64d4004b80 0x7f64e80c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:02.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.921+0000 7f64ecf9a700 1 -- 172.21.15.72:0/4036977925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e80c1df0 msgr2=0x7f64e80c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:02.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.921+0000 7f64ecf9a700 1 --2- 172.21.15.72:0/4036977925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e80c1df0 0x7f64e80c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:02.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.921+0000 7f64ecf9a700 1 -- 172.21.15.72:0/4036977925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e8164a70 con 0x7f64e80bfdc0 2023-08-31T19:03:02.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.921+0000 7f64ecf9a700 1 --2- 172.21.15.72:0/4036977925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e80bfdc0 0x7f64e80c0240 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f64d80077f0 tx=0x7f64d8001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:02.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.921+0000 7f64dd7fa700 1 -- 172.21.15.72:0/4036977925 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8011590 con 0x7f64e80bfdc0 2023-08-31T19:03:02.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.921+0000 7f64dd7fa700 1 -- 172.21.15.72:0/4036977925 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d80116f0 con 0x7f64e80bfdc0 2023-08-31T19:03:02.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.921+0000 7f64ef9ff700 1 -- 172.21.15.72:0/4036977925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e80c2a40 con 0x7f64e80bfdc0 2023-08-31T19:03:02.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.921+0000 7f64dd7fa700 1 -- 172.21.15.72:0/4036977925 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8011a70 con 0x7f64e80bfdc0 2023-08-31T19:03:02.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.921+0000 7f64ef9ff700 1 -- 172.21.15.72:0/4036977925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e80accb0 con 0x7f64e80bfdc0 2023-08-31T19:03:02.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.922+0000 7f64ef9ff700 1 -- 172.21.15.72:0/4036977925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e80c2f60 con 0x7f64e80bfdc0 2023-08-31T19:03:02.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.923+0000 7f64dd7fa700 1 -- 172.21.15.72:0/4036977925 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 20) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f64d801d3b0 con 0x7f64e80bfdc0 2023-08-31T19:03:02.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.925+0000 7f64dd7fa700 1 --2- 172.21.15.72:0/4036977925 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f64cc05ef80 0x7f64cc061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:02.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.925+0000 7f64dd7fa700 1 -- 172.21.15.72:0/4036977925 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7067+0+0 (secure 0 0 0) 0x7f64d8079c00 con 0x7f64e80bfdc0 2023-08-31T19:03:02.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.925+0000 7f64ed79b700 1 --2- 172.21.15.72:0/4036977925 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f64cc05ef80 0x7f64cc061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:02.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.925+0000 7f64ed79b700 1 --2- 172.21.15.72:0/4036977925 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f64cc05ef80 0x7f64cc061440 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f64e4006f70 tx=0x7f64e4008040).ready entity=mgr.5973 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:02.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:02.929+0000 7f64dd7fa700 1 -- 172.21.15.72:0/4036977925 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f64e80c2f60 con 0x7f64e80bfdc0 2023-08-31T19:03:03.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:03.142+0000 7f64ef9ff700 1 -- 172.21.15.72:0/4036977925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f64e80c2f60 con 0x7f64e80bfdc0 2023-08-31T19:03:03.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:03.539+0000 7f64dd7fa700 1 -- 172.21.15.72:0/4036977925 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 21) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f64d80773e0 con 0x7f64e80bfdc0 2023-08-31T19:03:03.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:03.540+0000 7f64dd7fa700 1 -- 172.21.15.72:0/4036977925 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v21) v1 ==== 93+0+0 (secure 0 0 0) 0x7f64d8072170 con 0x7f64e80bfdc0 2023-08-31T19:03:03.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:03.542+0000 7f64ef9ff700 1 -- 172.21.15.72:0/4036977925 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f64cc05ef80 msgr2=0x7f64cc061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:03.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:03.542+0000 7f64ef9ff700 1 --2- 172.21.15.72:0/4036977925 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f64cc05ef80 0x7f64cc061440 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f64e4006f70 tx=0x7f64e4008040).stop 2023-08-31T19:03:03.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:03.542+0000 7f64ef9ff700 1 -- 172.21.15.72:0/4036977925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e80bfdc0 msgr2=0x7f64e80c0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:03.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:03.542+0000 7f64ef9ff700 1 --2- 172.21.15.72:0/4036977925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e80bfdc0 0x7f64e80c0240 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f64d80077f0 tx=0x7f64d8001e10).stop 2023-08-31T19:03:03.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:03.542+0000 7f64ef9ff700 1 -- 172.21.15.72:0/4036977925 shutdown_connections 2023-08-31T19:03:03.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:03.542+0000 7f64ef9ff700 1 --2- 172.21.15.72:0/4036977925 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f64cc05ef80 0x7f64cc061440 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:03.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:03.542+0000 7f64ef9ff700 1 --2- 172.21.15.72:0/4036977925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64e80c1df0 0x7f64e80c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:03.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:03.542+0000 7f64ef9ff700 1 --2- 172.21.15.72:0/4036977925 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64d4004b80 0x7f64e80c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:03.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:03.542+0000 7f64ef9ff700 1 --2- 172.21.15.72:0/4036977925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e80bfdc0 0x7f64e80c0240 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:03.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:03.542+0000 7f64ef9ff700 1 -- 172.21.15.72:0/4036977925 >> 172.21.15.72:0/4036977925 conn(0x7f64e805eb60 msgr2=0x7f64e80c3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:03.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:03.543+0000 7f64ef9ff700 1 -- 172.21.15.72:0/4036977925 shutdown_connections 2023-08-31T19:03:03.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:03.543+0000 7f64ef9ff700 1 -- 172.21.15.72:0/4036977925 wait complete. 2023-08-31T19:03:03.561 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:03:03.562 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:03:03.670 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:03:03.755 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:03.755+0000 7f5e0dd8f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:03:03.759 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:03.759+0000 7feaf38ae680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:03:03.779 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:03:03.780 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-31T19:03:03.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:03:03.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-31T19:03:03.837 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:03.837+0000 7f5e0dd8f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:03:03.839 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:03.839+0000 7feaf38ae680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:03:03.871 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T19:03:03.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:03:03.872 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T19:03:03.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:03:04.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.150+0000 7fe44e5ff700 1 Processor -- start 2023-08-31T19:03:04.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.150+0000 7fe44e5ff700 1 -- start start 2023-08-31T19:03:04.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.152+0000 7fe44e5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe448154060 0x7fe448157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:04.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.152+0000 7fe44e5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4481588d0 0x7fe448154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:04.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.152+0000 7fe44e5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4480c6120 con 0x7fe4480cb9b0 2023-08-31T19:03:04.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.152+0000 7fe44e5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4480c1380 con 0x7fe4481588d0 2023-08-31T19:03:04.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.152+0000 7fe44e5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480c5e10 con 0x7fe448154060 2023-08-31T19:03:04.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.152+0000 7fe44cb9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4481588d0 0x7fe448154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:04.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.152+0000 7fe44cb9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4481588d0 0x7fe448154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55746/0 (socket says 172.21.15.72:55746) 2023-08-31T19:03:04.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.152+0000 7fe44cb9c700 1 -- 172.21.15.72:0/642028855 learned_addr learned my addr 172.21.15.72:0/642028855 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:04.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.152+0000 7fe447fff700 1 --2- 172.21.15.72:0/642028855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe448154060 0x7fe448157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:04.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.152+0000 7fe44cb9c700 1 -- 172.21.15.72:0/642028855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe448154060 msgr2=0x7fe448157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:04.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.152+0000 7fe44cb9c700 1 --2- 172.21.15.72:0/642028855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe448154060 0x7fe448157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:04.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.152+0000 7fe44cb9c700 1 -- 172.21.15.72:0/642028855 >> v1:172.21.15.146:6789/0 conn(0x7fe4480cb9b0 legacy=0x7fe4481581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:04.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.152+0000 7fe44cb9c700 1 -- 172.21.15.72:0/642028855 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4480c0ae0 con 0x7fe4481588d0 2023-08-31T19:03:04.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.153+0000 7fe44cb9c700 1 --2- 172.21.15.72:0/642028855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4481588d0 0x7fe448154440 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fe440009f20 tx=0x7fe440009840).ready entity=mon.0 client_cookie=e8c1680fc02bc3dd server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:04.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.153+0000 7fe446ffd700 1 -- 172.21.15.72:0/642028855 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44000e070 con 0x7fe4481588d0 2023-08-31T19:03:04.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.153+0000 7fe446ffd700 1 -- 172.21.15.72:0/642028855 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44000ba80 con 0x7fe4481588d0 2023-08-31T19:03:04.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.153+0000 7fe446ffd700 1 -- 172.21.15.72:0/642028855 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44000be00 con 0x7fe4481588d0 2023-08-31T19:03:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.153+0000 7fe44e5ff700 1 -- 172.21.15.72:0/642028855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4481588d0 msgr2=0x7fe448154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.153+0000 7fe44e5ff700 1 --2- 172.21.15.72:0/642028855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4481588d0 0x7fe448154440 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fe440009f20 tx=0x7fe440009840).stop 2023-08-31T19:03:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.153+0000 7fe44e5ff700 1 -- 172.21.15.72:0/642028855 shutdown_connections 2023-08-31T19:03:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.153+0000 7fe44e5ff700 1 --2- 172.21.15.72:0/642028855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe448154060 0x7fe448157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.153+0000 7fe44e5ff700 1 --2- 172.21.15.72:0/642028855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4481588d0 0x7fe448154440 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.153+0000 7fe44e5ff700 1 -- 172.21.15.72:0/642028855 >> 172.21.15.72:0/642028855 conn(0x7fe44805e870 msgr2=0x7fe4480cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.154+0000 7fe44e5ff700 1 -- 172.21.15.72:0/642028855 shutdown_connections 2023-08-31T19:03:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.154+0000 7fe44e5ff700 1 -- 172.21.15.72:0/642028855 wait complete. 2023-08-31T19:03:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.155+0000 7fe44e5ff700 1 Processor -- start 2023-08-31T19:03:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.155+0000 7fe44e5ff700 1 -- start start 2023-08-31T19:03:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.156+0000 7fe44e5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4480cb9b0 0x7fe44813f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.156+0000 7fe44e5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe448154060 0x7fe4480a92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.156+0000 7fe44e5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4481588d0 0x7fe448152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.156+0000 7fe44e5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480c2a40 con 0x7fe4480cb9b0 2023-08-31T19:03:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.156+0000 7fe44e5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44813fd40 con 0x7fe4481588d0 2023-08-31T19:03:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.156+0000 7fe44e5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4480c1e30 con 0x7fe448154060 2023-08-31T19:03:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.156+0000 7fe447fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4480cb9b0 0x7fe44813f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.156+0000 7fe447fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4480cb9b0 0x7fe44813f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55760/0 (socket says 172.21.15.72:55760) 2023-08-31T19:03:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.156+0000 7fe447fff700 1 -- 172.21.15.72:0/1184436048 learned_addr learned my addr 172.21.15.72:0/1184436048 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.156+0000 7fe4477fe700 1 --2- 172.21.15.72:0/1184436048 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe448154060 0x7fe4480a92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.157+0000 7fe44cb9c700 1 --2- 172.21.15.72:0/1184436048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4481588d0 0x7fe448152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.157+0000 7fe447fff700 1 -- 172.21.15.72:0/1184436048 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe448154060 msgr2=0x7fe4480a92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.157+0000 7fe447fff700 1 --2- 172.21.15.72:0/1184436048 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe448154060 0x7fe4480a92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.157+0000 7fe447fff700 1 -- 172.21.15.72:0/1184436048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4481588d0 msgr2=0x7fe448152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.157+0000 7fe447fff700 1 --2- 172.21.15.72:0/1184436048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4481588d0 0x7fe448152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.157+0000 7fe447fff700 1 -- 172.21.15.72:0/1184436048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe440009ae0 con 0x7fe4480cb9b0 2023-08-31T19:03:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.157+0000 7fe447fff700 1 --2- 172.21.15.72:0/1184436048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4480cb9b0 0x7fe44813f850 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7fe43800d890 tx=0x7fe438008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.157+0000 7fe42ffff700 1 -- 172.21.15.72:0/1184436048 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe438011590 con 0x7fe4480cb9b0 2023-08-31T19:03:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.157+0000 7fe42ffff700 1 -- 172.21.15.72:0/1184436048 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4380116f0 con 0x7fe4480cb9b0 2023-08-31T19:03:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.157+0000 7fe44e5ff700 1 -- 172.21.15.72:0/1184436048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4480c2110 con 0x7fe4480cb9b0 2023-08-31T19:03:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.157+0000 7fe42ffff700 1 -- 172.21.15.72:0/1184436048 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe438011a70 con 0x7fe4480cb9b0 2023-08-31T19:03:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.158+0000 7fe44e5ff700 1 -- 172.21.15.72:0/1184436048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4480c26d0 con 0x7fe4480cb9b0 2023-08-31T19:03:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.159+0000 7fe44e5ff700 1 -- 172.21.15.72:0/1184436048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4480c2d20 con 0x7fe4480cb9b0 2023-08-31T19:03:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.159+0000 7fe42ffff700 1 -- 172.21.15.72:0/1184436048 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fe43801c460 con 0x7fe4480cb9b0 2023-08-31T19:03:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.160+0000 7fe42ffff700 1 --2- 172.21.15.72:0/1184436048 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe43405ef30 0x7fe4340613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.160+0000 7fe42ffff700 1 -- 172.21.15.72:0/1184436048 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7067+0+0 (secure 0 0 0) 0x7fe43807a440 con 0x7fe4480cb9b0 2023-08-31T19:03:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.160+0000 7fe4477fe700 1 -- 172.21.15.72:0/1184436048 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe43405ef30 msgr2=0x7fe4340613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.160+0000 7fe4477fe700 1 --2- 172.21.15.72:0/1184436048 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe43405ef30 0x7fe4340613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.165+0000 7fe42ffff700 1 -- 172.21.15.72:0/1184436048 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe43804b260 con 0x7fe4480cb9b0 2023-08-31T19:03:04.169 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:04.168+0000 7feaf38ae680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:03:04.180 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:04.180+0000 7f5e0dd8f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:03:04.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.361+0000 7fe4477fe700 1 -- 172.21.15.72:0/1184436048 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe43405ef30 msgr2=0x7fe4340613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:04.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.361+0000 7fe4477fe700 1 --2- 172.21.15.72:0/1184436048 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe43405ef30 0x7fe4340613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:03:04.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.383+0000 7fe44e5ff700 1 -- 172.21.15.72:0/1184436048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe44806c6b0 con 0x7fe4480cb9b0 2023-08-31T19:03:04.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.384+0000 7fe42ffff700 1 -- 172.21.15.72:0/1184436048 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fe43804e880 con 0x7fe4480cb9b0 2023-08-31T19:03:04.384 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:04.384 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1085369530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1085369530},{"type":"v1","addr":"172.21.15.146:6834","nonce":1085369530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3852978729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3852978729},{"type":"v1","addr":"172.21.15.146:6835","nonce":3852978729}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/654480318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":654480318},{"type":"v1","addr":"172.21.15.72:6835","nonce":654480318}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:01:01.982648+0000","modified":"2023-08-31T19:01:05.003693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3101703480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3101703480},{"type":"v1","addr":"172.21.15.72:6837","nonce":3101703480}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-31T19:03:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.386+0000 7fe44e5ff700 1 -- 172.21.15.72:0/1184436048 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe43405ef30 msgr2=0x7fe4340613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.386+0000 7fe44e5ff700 1 --2- 172.21.15.72:0/1184436048 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe43405ef30 0x7fe4340613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.386+0000 7fe44e5ff700 1 -- 172.21.15.72:0/1184436048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4480cb9b0 msgr2=0x7fe44813f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.386+0000 7fe44e5ff700 1 --2- 172.21.15.72:0/1184436048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4480cb9b0 0x7fe44813f850 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7fe43800d890 tx=0x7fe438008040).stop 2023-08-31T19:03:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.386+0000 7fe44e5ff700 1 -- 172.21.15.72:0/1184436048 shutdown_connections 2023-08-31T19:03:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.386+0000 7fe44e5ff700 1 --2- 172.21.15.72:0/1184436048 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe43405ef30 0x7fe4340613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:04.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.386+0000 7fe44e5ff700 1 --2- 172.21.15.72:0/1184436048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4481588d0 0x7fe448152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:04.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.386+0000 7fe44e5ff700 1 --2- 172.21.15.72:0/1184436048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4480cb9b0 0x7fe44813f850 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:04.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.386+0000 7fe44e5ff700 1 --2- 172.21.15.72:0/1184436048 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe448154060 0x7fe4480a92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:04.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.386+0000 7fe44e5ff700 1 -- 172.21.15.72:0/1184436048 >> 172.21.15.72:0/1184436048 conn(0x7fe44805e870 msgr2=0x7fe448063090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:04.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.386+0000 7fe44e5ff700 1 -- 172.21.15.72:0/1184436048 shutdown_connections 2023-08-31T19:03:04.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.386+0000 7fe44e5ff700 1 -- 172.21.15.72:0/1184436048 wait complete. 2023-08-31T19:03:04.389 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 23 2023-08-31T19:03:04.405 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:03:04.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.597+0000 7fec8f7ff700 1 Processor -- start 2023-08-31T19:03:04.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.597+0000 7fec8f7ff700 1 -- start start 2023-08-31T19:03:04.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.599+0000 7fec8f7ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec880bea80 0x7fec880c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:04.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.599+0000 7fec8f7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec880c48f0 con 0x7fec880c44a0 2023-08-31T19:03:04.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.599+0000 7fec8f7ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec880bef10 con 0x7fec880c5fb0 2023-08-31T19:03:04.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.599+0000 7fec8f7ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec88154690 con 0x7fec880bea80 2023-08-31T19:03:04.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.599+0000 7fec8dd9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fec880c44a0 0x7fec88063a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34846/0 (socket says 172.21.15.72:34846) 2023-08-31T19:03:04.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.599+0000 7fec8dd9c700 1 -- 172.21.15.72:0/3248925456 learned_addr learned my addr 172.21.15.72:0/3248925456 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:04.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.599+0000 7fec8cd9a700 1 --2- 172.21.15.72:0/3248925456 >> v2:172.21.15.146:3300/0 conn(0x7fec880bea80 0x7fec880c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:04.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.600+0000 7fec7ffff700 1 -- 172.21.15.72:0/3248925456 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035638108 0 0) 0x7fec880c48f0 con 0x7fec880c44a0 2023-08-31T19:03:04.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.600+0000 7fec7ffff700 1 -- 172.21.15.72:0/3248925456 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec740033f0 con 0x7fec880c44a0 2023-08-31T19:03:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.600+0000 7fec7ffff700 1 -- 172.21.15.72:0/3248925456 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554974541 0 0) 0x7fec880bef10 con 0x7fec880c5fb0 2023-08-31T19:03:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.600+0000 7fec7ffff700 1 -- 172.21.15.72:0/3248925456 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec880c48f0 con 0x7fec880c5fb0 2023-08-31T19:03:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.600+0000 7fec8cd9a700 1 -- 172.21.15.72:0/3248925456 >> v1:172.21.15.146:6789/0 conn(0x7fec880c5fb0 legacy=0x7fec880be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.600+0000 7fec8cd9a700 1 -- 172.21.15.72:0/3248925456 >> v1:172.21.15.72:6789/0 conn(0x7fec880c44a0 legacy=0x7fec88063a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:04.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.600+0000 7fec8cd9a700 1 -- 172.21.15.72:0/3248925456 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec880bf1f0 con 0x7fec880bea80 2023-08-31T19:03:04.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.600+0000 7fec8cd9a700 1 --2- 172.21.15.72:0/3248925456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec880bea80 0x7fec880c3fb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fec78009760 tx=0x7fec78009060).ready entity=mon.1 client_cookie=ec9db8731afdef16 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:04.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.600+0000 7fec7ffff700 1 -- 172.21.15.72:0/3248925456 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7800d4a0 con 0x7fec880bea80 2023-08-31T19:03:04.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.600+0000 7fec7ffff700 1 -- 172.21.15.72:0/3248925456 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7800d600 con 0x7fec880bea80 2023-08-31T19:03:04.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.601+0000 7fec7ffff700 1 -- 172.21.15.72:0/3248925456 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7800d980 con 0x7fec880bea80 2023-08-31T19:03:04.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.601+0000 7fec8f7ff700 1 -- 172.21.15.72:0/3248925456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec880bea80 msgr2=0x7fec880c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:04.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.601+0000 7fec8f7ff700 1 --2- 172.21.15.72:0/3248925456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec880bea80 0x7fec880c3fb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fec78009760 tx=0x7fec78009060).stop 2023-08-31T19:03:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.601+0000 7fec8f7ff700 1 -- 172.21.15.72:0/3248925456 shutdown_connections 2023-08-31T19:03:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.601+0000 7fec8f7ff700 1 --2- 172.21.15.72:0/3248925456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec880bea80 0x7fec880c3fb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.601+0000 7fec8f7ff700 1 -- 172.21.15.72:0/3248925456 >> 172.21.15.72:0/3248925456 conn(0x7fec88082f60 msgr2=0x7fec8805e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.601+0000 7fec8f7ff700 1 -- 172.21.15.72:0/3248925456 shutdown_connections 2023-08-31T19:03:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.601+0000 7fec8f7ff700 1 -- 172.21.15.72:0/3248925456 wait complete. 2023-08-31T19:03:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.603+0000 7fec8f7ff700 1 Processor -- start 2023-08-31T19:03:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.603+0000 7fec8f7ff700 1 -- start start 2023-08-31T19:03:04.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8f7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec880c44a0 0x7fec880a86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:04.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8f7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec880c5fb0 0x7fec88152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:04.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8f7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec880a6c20 0x7fec880a7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:04.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8f7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec880ac870 con 0x7fec880c44a0 2023-08-31T19:03:04.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8f7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec880a7570 con 0x7fec880c5fb0 2023-08-31T19:03:04.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8f7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec880abc30 con 0x7fec880a6c20 2023-08-31T19:03:04.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8d59b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec880c44a0 0x7fec880a86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:04.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8d59b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec880c44a0 0x7fec880a86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55768/0 (socket says 172.21.15.72:55768) 2023-08-31T19:03:04.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8d59b700 1 -- 172.21.15.72:0/885776943 learned_addr learned my addr 172.21.15.72:0/885776943 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:04.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8cd9a700 1 --2- 172.21.15.72:0/885776943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec880c5fb0 0x7fec88152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:04.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8dd9c700 1 --2- 172.21.15.72:0/885776943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec880a6c20 0x7fec880a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:04.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8d59b700 1 -- 172.21.15.72:0/885776943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec880a6c20 msgr2=0x7fec880a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:04.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8d59b700 1 --2- 172.21.15.72:0/885776943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec880a6c20 0x7fec880a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:04.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8d59b700 1 -- 172.21.15.72:0/885776943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec880c5fb0 msgr2=0x7fec88152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:04.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8d59b700 1 --2- 172.21.15.72:0/885776943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec880c5fb0 0x7fec88152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:04.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8d59b700 1 -- 172.21.15.72:0/885776943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec780092a0 con 0x7fec880c44a0 2023-08-31T19:03:04.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.605+0000 7fec8dd9c700 1 --2- 172.21.15.72:0/885776943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec880a6c20 0x7fec880a7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:04.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.606+0000 7fec8d59b700 1 --2- 172.21.15.72:0/885776943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec880c44a0 0x7fec880a86e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fec8400c440 tx=0x7fec84007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:04.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.606+0000 7fec7d7fa700 1 -- 172.21.15.72:0/885776943 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8400ce40 con 0x7fec880c44a0 2023-08-31T19:03:04.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.606+0000 7fec7d7fa700 1 -- 172.21.15.72:0/885776943 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8400f470 con 0x7fec880c44a0 2023-08-31T19:03:04.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.606+0000 7fec8f7ff700 1 -- 172.21.15.72:0/885776943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec880abed0 con 0x7fec880c44a0 2023-08-31T19:03:04.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.606+0000 7fec7d7fa700 1 -- 172.21.15.72:0/885776943 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8400f830 con 0x7fec880c44a0 2023-08-31T19:03:04.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.606+0000 7fec8f7ff700 1 -- 172.21.15.72:0/885776943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec880ac490 con 0x7fec880c44a0 2023-08-31T19:03:04.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.607+0000 7fec8f7ff700 1 -- 172.21.15.72:0/885776943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec880ac9b0 con 0x7fec880c44a0 2023-08-31T19:03:04.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.608+0000 7fec7d7fa700 1 -- 172.21.15.72:0/885776943 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fec8400fbe0 con 0x7fec880c44a0 2023-08-31T19:03:04.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.609+0000 7fec7d7fa700 1 --2- 172.21.15.72:0/885776943 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fec6c05ef30 0x7fec6c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:04.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.609+0000 7fec8cd9a700 1 -- 172.21.15.72:0/885776943 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fec6c05ef30 msgr2=0x7fec6c0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:04.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.609+0000 7fec7d7fa700 1 -- 172.21.15.72:0/885776943 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7067+0+0 (secure 0 0 0) 0x7fec84079870 con 0x7fec880c44a0 2023-08-31T19:03:04.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.609+0000 7fec8cd9a700 1 --2- 172.21.15.72:0/885776943 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fec6c05ef30 0x7fec6c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:04.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.613+0000 7fec7d7fa700 1 -- 172.21.15.72:0/885776943 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fec880ac9b0 con 0x7fec880c44a0 2023-08-31T19:03:04.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.787+0000 7fec8f7ff700 1 -- 172.21.15.72:0/885776943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec880ac9b0 con 0x7fec880c44a0 2023-08-31T19:03:04.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.788+0000 7fec7d7fa700 1 -- 172.21.15.72:0/885776943 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+18446 (secure 0 0 0) 0x7fec880ac9b0 con 0x7fec880c44a0 2023-08-31T19:03:04.789 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:04.789 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":64,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:02:17.463801+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:01:00.413643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-31T19:01:00.966624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"8.25","mappings":[{"from":0,"to":6}]},{"pgid":"8.2f","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/1369274110":"2023-09-01T19:01:15.623246+0000","172.21.15.72:0/1336378034":"2023-09-01T19:01:15.623246+0000","172.21.15.72:6833/143463":"2023-09-01T19:01:15.623246+0000","172.21.15.72:0/1927962454":"2023-09-01T19:01:15.623246+0000","172.21.15.72:6832/143463":"2023-09-01T19:01:15.623246+0000","172.21.15.72:0/1354492929":"2023-09-01T19:01:15.623246+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:03:04.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.790+0000 7fec8f7ff700 1 -- 172.21.15.72:0/885776943 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fec6c05ef30 msgr2=0x7fec6c0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:04.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.790+0000 7fec8f7ff700 1 --2- 172.21.15.72:0/885776943 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fec6c05ef30 0x7fec6c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:04.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.790+0000 7fec8f7ff700 1 -- 172.21.15.72:0/885776943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec880c44a0 msgr2=0x7fec880a86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:04.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.790+0000 7fec8f7ff700 1 --2- 172.21.15.72:0/885776943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec880c44a0 0x7fec880a86e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fec8400c440 tx=0x7fec84007c80).stop 2023-08-31T19:03:04.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.790+0000 7fec8f7ff700 1 -- 172.21.15.72:0/885776943 shutdown_connections 2023-08-31T19:03:04.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.790+0000 7fec8f7ff700 1 --2- 172.21.15.72:0/885776943 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fec880a6c20 0x7fec880a7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:04.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.790+0000 7fec8f7ff700 1 --2- 172.21.15.72:0/885776943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec880c44a0 0x7fec880a86e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:04.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.790+0000 7fec8f7ff700 1 --2- 172.21.15.72:0/885776943 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fec6c05ef30 0x7fec6c0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:04.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.790+0000 7fec8f7ff700 1 --2- 172.21.15.72:0/885776943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec880c5fb0 0x7fec88152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:04.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.790+0000 7fec8f7ff700 1 -- 172.21.15.72:0/885776943 >> 172.21.15.72:0/885776943 conn(0x7fec88082f60 msgr2=0x7fec88064bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:04.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.790+0000 7fec8f7ff700 1 -- 172.21.15.72:0/885776943 shutdown_connections 2023-08-31T19:03:04.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:04.790+0000 7fec8f7ff700 1 -- 172.21.15.72:0/885776943 wait complete. 2023-08-31T19:03:04.811 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:01:00.413643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:01:00.966624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:03:04.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:03:04.908 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:04.908+0000 7feaf38ae680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:03:04.947 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:04.947+0000 7f5e0dd8f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:03:04.991 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:04.991+0000 7feaf38ae680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:03:05.033 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:05.034+0000 7f5e0dd8f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:03:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.039+0000 7f0b66fff700 1 Processor -- start 2023-08-31T19:03:05.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.039+0000 7f0b66fff700 1 -- start start 2023-08-31T19:03:05.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.041+0000 7f0b66fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b60153ed0 0x7f0b601542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.041+0000 7f0b66fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b600bdb30 0x7f0b60155200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.041+0000 7f0b66fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b600a84b0 con 0x7f0b600663d0 2023-08-31T19:03:05.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.041+0000 7f0b66fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b600c9410 con 0x7f0b600bdb30 2023-08-31T19:03:05.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.041+0000 7f0b66fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600c5310 con 0x7f0b60153ed0 2023-08-31T19:03:05.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.041+0000 7f0b5ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b600bdb30 0x7f0b60155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:05.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.041+0000 7f0b5ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b600bdb30 0x7f0b60155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55770/0 (socket says 172.21.15.72:55770) 2023-08-31T19:03:05.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.041+0000 7f0b5ffff700 1 -- 172.21.15.72:0/3376972236 learned_addr learned my addr 172.21.15.72:0/3376972236 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:05.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.041+0000 7f0b64d9b700 1 --2- 172.21.15.72:0/3376972236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b60153ed0 0x7f0b601542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:05.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.041+0000 7f0b5ffff700 1 -- 172.21.15.72:0/3376972236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b60153ed0 msgr2=0x7f0b601542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:05.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.041+0000 7f0b5ffff700 1 --2- 172.21.15.72:0/3376972236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b60153ed0 0x7f0b601542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.041+0000 7f0b5ffff700 1 -- 172.21.15.72:0/3376972236 >> v1:172.21.15.146:6789/0 conn(0x7f0b600663d0 legacy=0x7f0b60067900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:05.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.041+0000 7f0b5ffff700 1 -- 172.21.15.72:0/3376972236 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b601556f0 con 0x7f0b600bdb30 2023-08-31T19:03:05.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.041+0000 7f0b64d9b700 1 --2- 172.21.15.72:0/3376972236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b60153ed0 0x7f0b601542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:05.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.042+0000 7f0b5ffff700 1 --2- 172.21.15.72:0/3376972236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b600bdb30 0x7f0b60155200 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f0b4c006fd0 tx=0x7f0b4c0090f0).ready entity=mon.0 client_cookie=1169205e53f40a54 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:05.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.042+0000 7f0b5f7fe700 1 -- 172.21.15.72:0/3376972236 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c00b600 con 0x7f0b600bdb30 2023-08-31T19:03:05.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.042+0000 7f0b5f7fe700 1 -- 172.21.15.72:0/3376972236 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c00b760 con 0x7f0b600bdb30 2023-08-31T19:03:05.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.042+0000 7f0b5f7fe700 1 -- 172.21.15.72:0/3376972236 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c00bae0 con 0x7f0b600bdb30 2023-08-31T19:03:05.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.042+0000 7f0b66fff700 1 -- 172.21.15.72:0/3376972236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b600bdb30 msgr2=0x7f0b60155200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:05.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.042+0000 7f0b66fff700 1 --2- 172.21.15.72:0/3376972236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b600bdb30 0x7f0b60155200 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f0b4c006fd0 tx=0x7f0b4c0090f0).stop 2023-08-31T19:03:05.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.042+0000 7f0b66fff700 1 -- 172.21.15.72:0/3376972236 shutdown_connections 2023-08-31T19:03:05.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.042+0000 7f0b66fff700 1 --2- 172.21.15.72:0/3376972236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b60153ed0 0x7f0b601542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.042+0000 7f0b66fff700 1 --2- 172.21.15.72:0/3376972236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b600bdb30 0x7f0b60155200 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.042+0000 7f0b66fff700 1 -- 172.21.15.72:0/3376972236 >> 172.21.15.72:0/3376972236 conn(0x7f0b6005eb60 msgr2=0x7f0b600c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:05.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.043+0000 7f0b66fff700 1 -- 172.21.15.72:0/3376972236 shutdown_connections 2023-08-31T19:03:05.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.043+0000 7f0b66fff700 1 -- 172.21.15.72:0/3376972236 wait complete. 2023-08-31T19:03:05.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.044+0000 7f0b66fff700 1 Processor -- start 2023-08-31T19:03:05.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.044+0000 7f0b66fff700 1 -- start start 2023-08-31T19:03:05.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.045+0000 7f0b66fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b600663d0 0x7f0b600a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.045+0000 7f0b66fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b60153ed0 0x7f0b600a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.045+0000 7f0b66fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b600a8ec0 0x7f0b60156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.045+0000 7f0b66fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600abb60 con 0x7f0b60153ed0 2023-08-31T19:03:05.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.045+0000 7f0b66fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600abe40 con 0x7f0b600663d0 2023-08-31T19:03:05.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.045+0000 7f0b66fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b600ac120 con 0x7f0b600a8ec0 2023-08-31T19:03:05.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.045+0000 7f0b5ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b60153ed0 0x7f0b600a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:05.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.045+0000 7f0b5ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b60153ed0 0x7f0b600a89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55786/0 (socket says 172.21.15.72:55786) 2023-08-31T19:03:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.045+0000 7f0b64d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b600663d0 0x7f0b600a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.045+0000 7f0b5ffff700 1 -- 172.21.15.72:0/4064821170 learned_addr learned my addr 172.21.15.72:0/4064821170 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.045+0000 7f0b6559c700 1 --2- 172.21.15.72:0/4064821170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b600a8ec0 0x7f0b60156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.046+0000 7f0b5ffff700 1 -- 172.21.15.72:0/4064821170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b600a8ec0 msgr2=0x7f0b60156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:05.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.046+0000 7f0b5ffff700 1 --2- 172.21.15.72:0/4064821170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b600a8ec0 0x7f0b60156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.046+0000 7f0b5ffff700 1 -- 172.21.15.72:0/4064821170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b600663d0 msgr2=0x7f0b600a5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:05.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.046+0000 7f0b5ffff700 1 --2- 172.21.15.72:0/4064821170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b600663d0 0x7f0b600a5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.046+0000 7f0b5ffff700 1 -- 172.21.15.72:0/4064821170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c009370 con 0x7f0b60153ed0 2023-08-31T19:03:05.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.046+0000 7f0b64d9b700 1 --2- 172.21.15.72:0/4064821170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b600663d0 0x7f0b600a5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:03:05.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.046+0000 7f0b5ffff700 1 --2- 172.21.15.72:0/4064821170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b60153ed0 0x7f0b600a89d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f0b600c3470 tx=0x7f0b4c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:05.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.046+0000 7f0b5cff9700 1 -- 172.21.15.72:0/4064821170 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c006910 con 0x7f0b60153ed0 2023-08-31T19:03:05.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.046+0000 7f0b5cff9700 1 -- 172.21.15.72:0/4064821170 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c00be50 con 0x7f0b60153ed0 2023-08-31T19:03:05.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.046+0000 7f0b5cff9700 1 -- 172.21.15.72:0/4064821170 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c01b410 con 0x7f0b60153ed0 2023-08-31T19:03:05.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.046+0000 7f0b66fff700 1 -- 172.21.15.72:0/4064821170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b600ac400 con 0x7f0b60153ed0 2023-08-31T19:03:05.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.047+0000 7f0b66fff700 1 -- 172.21.15.72:0/4064821170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b600ac9c0 con 0x7f0b60153ed0 2023-08-31T19:03:05.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.048+0000 7f0b66fff700 1 -- 172.21.15.72:0/4064821170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b600acbe0 con 0x7f0b60153ed0 2023-08-31T19:03:05.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.049+0000 7f0b5cff9700 1 -- 172.21.15.72:0/4064821170 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f0b4c01b780 con 0x7f0b60153ed0 2023-08-31T19:03:05.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.050+0000 7f0b5cff9700 1 --2- 172.21.15.72:0/4064821170 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0b4405ef30 0x7f0b440613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.050+0000 7f0b5cff9700 1 -- 172.21.15.72:0/4064821170 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7067+0+0 (secure 0 0 0) 0x7f0b4c07ba90 con 0x7f0b60153ed0 2023-08-31T19:03:05.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.050+0000 7f0b64d9b700 1 -- 172.21.15.72:0/4064821170 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0b4405ef30 msgr2=0x7f0b440613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:05.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.050+0000 7f0b64d9b700 1 --2- 172.21.15.72:0/4064821170 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0b4405ef30 0x7f0b440613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:05.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.054+0000 7f0b5cff9700 1 -- 172.21.15.72:0/4064821170 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b4c04c9d0 con 0x7f0b60153ed0 2023-08-31T19:03:05.225 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:05.225+0000 7feaf38ae680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:03:05.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.231+0000 7f0b66fff700 1 -- 172.21.15.72:0/4064821170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0b6006c6b0 con 0x7f0b60153ed0 2023-08-31T19:03:05.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.231+0000 7f0b5cff9700 1 -- 172.21.15.72:0/4064821170 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v64) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0b4c01f020 con 0x7f0b60153ed0 2023-08-31T19:03:05.231 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:03:05.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.233+0000 7f0b66fff700 1 -- 172.21.15.72:0/4064821170 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0b4405ef30 msgr2=0x7f0b440613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:05.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.233+0000 7f0b66fff700 1 --2- 172.21.15.72:0/4064821170 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0b4405ef30 0x7f0b440613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:05.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.233+0000 7f0b66fff700 1 -- 172.21.15.72:0/4064821170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b60153ed0 msgr2=0x7f0b600a89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:05.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.233+0000 7f0b66fff700 1 --2- 172.21.15.72:0/4064821170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b60153ed0 0x7f0b600a89d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f0b600c3470 tx=0x7f0b4c017000).stop 2023-08-31T19:03:05.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.233+0000 7f0b66fff700 1 -- 172.21.15.72:0/4064821170 shutdown_connections 2023-08-31T19:03:05.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.233+0000 7f0b66fff700 1 --2- 172.21.15.72:0/4064821170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b600a8ec0 0x7f0b60156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.233+0000 7f0b66fff700 1 --2- 172.21.15.72:0/4064821170 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0b4405ef30 0x7f0b440613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:05.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.233+0000 7f0b66fff700 1 --2- 172.21.15.72:0/4064821170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b600663d0 0x7f0b600a5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.233+0000 7f0b66fff700 1 --2- 172.21.15.72:0/4064821170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b60153ed0 0x7f0b600a89d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.233+0000 7f0b66fff700 1 -- 172.21.15.72:0/4064821170 >> 172.21.15.72:0/4064821170 conn(0x7f0b6005eb60 msgr2=0x7f0b60152b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:05.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.234+0000 7f0b66fff700 1 -- 172.21.15.72:0/4064821170 shutdown_connections 2023-08-31T19:03:05.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.234+0000 7f0b66fff700 1 -- 172.21.15.72:0/4064821170 wait complete. 2023-08-31T19:03:05.250 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:03:05.273 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:05.274+0000 7f5e0dd8f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:03:05.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.448+0000 7f4688bff700 1 Processor -- start 2023-08-31T19:03:05.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.448+0000 7f4688bff700 1 -- start start 2023-08-31T19:03:05.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.449+0000 7f4688bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4684153ed0 0x7f46841542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.449+0000 7f4688bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46840a84b0 con 0x7f46840bdb30 2023-08-31T19:03:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.449+0000 7f4688bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46840c9410 con 0x7f46840663d0 2023-08-31T19:03:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.449+0000 7f4688bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46840c5310 con 0x7f4684153ed0 2023-08-31T19:03:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.449+0000 7f468259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4684153ed0 0x7f46841542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.449+0000 7f468259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4684153ed0 0x7f46841542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55796/0 (socket says 172.21.15.72:55796) 2023-08-31T19:03:05.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.449+0000 7f468259c700 1 -- 172.21.15.72:0/3673185014 learned_addr learned my addr 172.21.15.72:0/3673185014 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.449+0000 7f4681d9b700 1 --1- 172.21.15.72:0/3673185014 >> v1:172.21.15.72:6789/0 conn(0x7f46840bdb30 0x7f4684155200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34854/0 (socket says 172.21.15.72:34854) 2023-08-31T19:03:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.450+0000 7f468259c700 1 -- 172.21.15.72:0/3673185014 >> v1:172.21.15.146:6789/0 conn(0x7f46840663d0 legacy=0x7f4684157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.450+0000 7f468259c700 1 -- 172.21.15.72:0/3673185014 >> v1:172.21.15.72:6789/0 conn(0x7f46840bdb30 legacy=0x7f4684155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.450+0000 7f468259c700 1 -- 172.21.15.72:0/3673185014 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46840a7ef0 con 0x7f4684153ed0 2023-08-31T19:03:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.450+0000 7f468259c700 1 --2- 172.21.15.72:0/3673185014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4684153ed0 0x7f46841542b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f4674006fd0 tx=0x7f46740090f0).ready entity=mon.0 client_cookie=6f063238437ee650 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:05.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.450+0000 7f468159a700 1 -- 172.21.15.72:0/3673185014 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467400b600 con 0x7f4684153ed0 2023-08-31T19:03:05.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.450+0000 7f468159a700 1 -- 172.21.15.72:0/3673185014 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467400b760 con 0x7f4684153ed0 2023-08-31T19:03:05.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.450+0000 7f468159a700 1 -- 172.21.15.72:0/3673185014 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467400bb00 con 0x7f4684153ed0 2023-08-31T19:03:05.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.451+0000 7f4688bff700 1 -- 172.21.15.72:0/3673185014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4684153ed0 msgr2=0x7f46841542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:05.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.451+0000 7f4688bff700 1 --2- 172.21.15.72:0/3673185014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4684153ed0 0x7f46841542b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f4674006fd0 tx=0x7f46740090f0).stop 2023-08-31T19:03:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.451+0000 7f4688bff700 1 -- 172.21.15.72:0/3673185014 shutdown_connections 2023-08-31T19:03:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.451+0000 7f4688bff700 1 --2- 172.21.15.72:0/3673185014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4684153ed0 0x7f46841542b0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.451+0000 7f4688bff700 1 -- 172.21.15.72:0/3673185014 >> 172.21.15.72:0/3673185014 conn(0x7f468405eb60 msgr2=0x7f46840c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.451+0000 7f4688bff700 1 -- 172.21.15.72:0/3673185014 shutdown_connections 2023-08-31T19:03:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.451+0000 7f4688bff700 1 -- 172.21.15.72:0/3673185014 wait complete. 2023-08-31T19:03:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.452+0000 7f4688bff700 1 Processor -- start 2023-08-31T19:03:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.453+0000 7f4688bff700 1 -- start start 2023-08-31T19:03:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.453+0000 7f4688bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46840663d0 0x7f4684142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.453+0000 7f4688bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4684153ed0 0x7f46840aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.453+0000 7f4688bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46840ab460 0x7f46840a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.453+0000 7f4688bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46840a58b0 con 0x7f46840663d0 2023-08-31T19:03:05.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.453+0000 7f4688bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46840a5b90 con 0x7f4684153ed0 2023-08-31T19:03:05.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.453+0000 7f4688bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46840a5e70 con 0x7f46840ab460 2023-08-31T19:03:05.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.454+0000 7f468259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46840663d0 0x7f4684142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.454+0000 7f468259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46840663d0 0x7f4684142430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55812/0 (socket says 172.21.15.72:55812) 2023-08-31T19:03:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.454+0000 7f468259c700 1 -- 172.21.15.72:0/3546263892 learned_addr learned my addr 172.21.15.72:0/3546263892 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.454+0000 7f4681d9b700 1 --2- 172.21.15.72:0/3546263892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4684153ed0 0x7f46840aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.454+0000 7f4682d9d700 1 --2- 172.21.15.72:0/3546263892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46840ab460 0x7f46840a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.454+0000 7f468259c700 1 -- 172.21.15.72:0/3546263892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46840ab460 msgr2=0x7f46840a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.454+0000 7f468259c700 1 --2- 172.21.15.72:0/3546263892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46840ab460 0x7f46840a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.454+0000 7f468259c700 1 -- 172.21.15.72:0/3546263892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4684153ed0 msgr2=0x7f46840aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.454+0000 7f468259c700 1 --2- 172.21.15.72:0/3546263892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4684153ed0 0x7f46840aaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.454+0000 7f468259c700 1 -- 172.21.15.72:0/3546263892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4674009370 con 0x7f46840663d0 2023-08-31T19:03:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.454+0000 7f4682d9d700 1 --2- 172.21.15.72:0/3546263892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46840ab460 0x7f46840a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.454+0000 7f468259c700 1 --2- 172.21.15.72:0/3546263892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46840663d0 0x7f4684142430 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f4674009f50 tx=0x7f4674017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.455+0000 7f46727fc700 1 -- 172.21.15.72:0/3546263892 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674006910 con 0x7f46840663d0 2023-08-31T19:03:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.455+0000 7f46727fc700 1 -- 172.21.15.72:0/3546263892 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467400b8d0 con 0x7f46840663d0 2023-08-31T19:03:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.455+0000 7f46727fc700 1 -- 172.21.15.72:0/3546263892 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674024470 con 0x7f46840663d0 2023-08-31T19:03:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.455+0000 7f4688bff700 1 -- 172.21.15.72:0/3546263892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46840a6150 con 0x7f46840663d0 2023-08-31T19:03:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.455+0000 7f4688bff700 1 -- 172.21.15.72:0/3546263892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46840aaa50 con 0x7f46840663d0 2023-08-31T19:03:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.456+0000 7f4688bff700 1 -- 172.21.15.72:0/3546263892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468406c6b0 con 0x7f46840663d0 2023-08-31T19:03:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.457+0000 7f46727fc700 1 -- 172.21.15.72:0/3546263892 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f4674021070 con 0x7f46840663d0 2023-08-31T19:03:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.458+0000 7f46727fc700 1 --2- 172.21.15.72:0/3546263892 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f466405ef30 0x7f46640613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.458+0000 7f46727fc700 1 -- 172.21.15.72:0/3546263892 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7067+0+0 (secure 0 0 0) 0x7f467407bf50 con 0x7f46840663d0 2023-08-31T19:03:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.458+0000 7f4681d9b700 1 -- 172.21.15.72:0/3546263892 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f466405ef30 msgr2=0x7f46640613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.458+0000 7f4681d9b700 1 --2- 172.21.15.72:0/3546263892 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f466405ef30 0x7f46640613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.461+0000 7f46727fc700 1 -- 172.21.15.72:0/3546263892 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f467404ce90 con 0x7f46840663d0 2023-08-31T19:03:05.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.640+0000 7f4688bff700 1 -- 172.21.15.72:0/3546263892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f46840a81d0 con 0x7f46840663d0 2023-08-31T19:03:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.641+0000 7f46727fc700 1 -- 172.21.15.72:0/3546263892 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4674029020 con 0x7f46840663d0 2023-08-31T19:03:05.640 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:03:05.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.643+0000 7f4688bff700 1 -- 172.21.15.72:0/3546263892 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f466405ef30 msgr2=0x7f46640613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:05.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.643+0000 7f4688bff700 1 --2- 172.21.15.72:0/3546263892 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f466405ef30 0x7f46640613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:05.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.643+0000 7f4688bff700 1 -- 172.21.15.72:0/3546263892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46840663d0 msgr2=0x7f4684142430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.643+0000 7f4688bff700 1 --2- 172.21.15.72:0/3546263892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46840663d0 0x7f4684142430 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f4674009f50 tx=0x7f4674017000).stop 2023-08-31T19:03:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.643+0000 7f4688bff700 1 -- 172.21.15.72:0/3546263892 shutdown_connections 2023-08-31T19:03:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.643+0000 7f4688bff700 1 --2- 172.21.15.72:0/3546263892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46840ab460 0x7f46840a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.643+0000 7f4688bff700 1 --2- 172.21.15.72:0/3546263892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46840663d0 0x7f4684142430 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.643+0000 7f4688bff700 1 --2- 172.21.15.72:0/3546263892 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f466405ef30 0x7f46640613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.643+0000 7f4688bff700 1 --2- 172.21.15.72:0/3546263892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4684153ed0 0x7f46840aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.643+0000 7f4688bff700 1 -- 172.21.15.72:0/3546263892 >> 172.21.15.72:0/3546263892 conn(0x7f468405eb60 msgr2=0x7f46840c7850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.643+0000 7f4688bff700 1 -- 172.21.15.72:0/3546263892 shutdown_connections 2023-08-31T19:03:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.643+0000 7f4688bff700 1 -- 172.21.15.72:0/3546263892 wait complete. 2023-08-31T19:03:05.660 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:03:05.738 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:05.738+0000 7feaf38ae680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:03:05.804 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:05.805+0000 7f5e0dd8f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:03:05.863 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:05.863+0000 7feaf38ae680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:03:05.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.898+0000 7f6452bff700 1 Processor -- start 2023-08-31T19:03:05.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.898+0000 7f6452bff700 1 -- start start 2023-08-31T19:03:05.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.900+0000 7f6452bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f644c154030 0x7f644c154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.900+0000 7f6452bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644c0c06b0 0x7f644c0c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.900+0000 7f6452bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644c0c6ed0 con 0x7f644c0aa140 2023-08-31T19:03:05.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.900+0000 7f6452bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644c0c66e0 con 0x7f644c154030 2023-08-31T19:03:05.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.900+0000 7f6452bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644c0c68c0 con 0x7f644c0c06b0 2023-08-31T19:03:05.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.900+0000 7f645119c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f644c0aa140 0x7f644c063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34860/0 (socket says 172.21.15.72:34860) 2023-08-31T19:03:05.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.900+0000 7f645119c700 1 -- 172.21.15.72:0/953070544 learned_addr learned my addr 172.21.15.72:0/953070544 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:05.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.900+0000 7f644bfff700 1 --2- 172.21.15.72:0/953070544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644c0c06b0 0x7f644c0c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:05.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.900+0000 7f645099b700 1 --2- 172.21.15.72:0/953070544 >> v2:172.21.15.146:3300/0 conn(0x7f644c154030 0x7f644c154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:05.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.900+0000 7f644b7fe700 1 -- 172.21.15.72:0/953070544 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729179057 0 0) 0x7f644c0c6ed0 con 0x7f644c0aa140 2023-08-31T19:03:05.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.901+0000 7f644b7fe700 1 -- 172.21.15.72:0/953070544 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f643c0033f0 con 0x7f644c0aa140 2023-08-31T19:03:05.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.901+0000 7f644bfff700 1 -- 172.21.15.72:0/953070544 >> v2:172.21.15.146:3300/0 conn(0x7f644c154030 msgr2=0x7f644c154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:05.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.901+0000 7f644bfff700 1 --2- 172.21.15.72:0/953070544 >> v2:172.21.15.146:3300/0 conn(0x7f644c154030 0x7f644c154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.901+0000 7f644bfff700 1 -- 172.21.15.72:0/953070544 >> v1:172.21.15.72:6789/0 conn(0x7f644c0aa140 legacy=0x7f644c063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:05.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.901+0000 7f644bfff700 1 -- 172.21.15.72:0/953070544 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c0c0f30 con 0x7f644c0c06b0 2023-08-31T19:03:05.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.901+0000 7f644bfff700 1 --2- 172.21.15.72:0/953070544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644c0c06b0 0x7f644c0c7360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6438009760 tx=0x7f6438009060).ready entity=mon.2 client_cookie=1bf5f2bf70508830 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:05.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.901+0000 7f644b7fe700 1 -- 172.21.15.72:0/953070544 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800d4a0 con 0x7f644c0c06b0 2023-08-31T19:03:05.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.901+0000 7f644b7fe700 1 -- 172.21.15.72:0/953070544 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643800d600 con 0x7f644c0c06b0 2023-08-31T19:03:05.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.901+0000 7f644b7fe700 1 -- 172.21.15.72:0/953070544 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800d980 con 0x7f644c0c06b0 2023-08-31T19:03:05.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.902+0000 7f6452bff700 1 -- 172.21.15.72:0/953070544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644c0c06b0 msgr2=0x7f644c0c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:05.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.902+0000 7f6452bff700 1 --2- 172.21.15.72:0/953070544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644c0c06b0 0x7f644c0c7360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6438009760 tx=0x7f6438009060).stop 2023-08-31T19:03:05.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.902+0000 7f6452bff700 1 -- 172.21.15.72:0/953070544 shutdown_connections 2023-08-31T19:03:05.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.902+0000 7f6452bff700 1 --2- 172.21.15.72:0/953070544 >> v2:172.21.15.146:3300/0 conn(0x7f644c154030 0x7f644c154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.902+0000 7f6452bff700 1 --2- 172.21.15.72:0/953070544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644c0c06b0 0x7f644c0c7360 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.902+0000 7f6452bff700 1 -- 172.21.15.72:0/953070544 >> 172.21.15.72:0/953070544 conn(0x7f644c05eb60 msgr2=0x7f644c0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:05.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.902+0000 7f6452bff700 1 -- 172.21.15.72:0/953070544 shutdown_connections 2023-08-31T19:03:05.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.902+0000 7f6452bff700 1 -- 172.21.15.72:0/953070544 wait complete. 2023-08-31T19:03:05.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.903+0000 7f6452bff700 1 Processor -- start 2023-08-31T19:03:05.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.903+0000 7f6452bff700 1 -- start start 2023-08-31T19:03:05.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.904+0000 7f6452bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f644c0aa140 0x7f644c0ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.904+0000 7f6452bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644c0c06b0 0x7f644c0c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.904+0000 7f6452bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f644c154030 0x7f644c150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.904+0000 7f6452bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c0ad7e0 con 0x7f644c0aa140 2023-08-31T19:03:05.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.904+0000 7f6452bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c0abf70 con 0x7f644c154030 2023-08-31T19:03:05.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.904+0000 7f6452bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644c0acbd0 con 0x7f644c0c06b0 2023-08-31T19:03:05.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.905+0000 7f645099b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f644c0aa140 0x7f644c0ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:05.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.905+0000 7f645099b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f644c0aa140 0x7f644c0ac610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55828/0 (socket says 172.21.15.72:55828) 2023-08-31T19:03:05.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.905+0000 7f645099b700 1 -- 172.21.15.72:0/444313568 learned_addr learned my addr 172.21.15.72:0/444313568 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:05.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.905+0000 7f644bfff700 1 --2- 172.21.15.72:0/444313568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644c0c06b0 0x7f644c0c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.905+0000 7f645119c700 1 --2- 172.21.15.72:0/444313568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f644c154030 0x7f644c150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.905+0000 7f645099b700 1 -- 172.21.15.72:0/444313568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644c0c06b0 msgr2=0x7f644c0c30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.905+0000 7f645099b700 1 --2- 172.21.15.72:0/444313568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644c0c06b0 0x7f644c0c30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.905+0000 7f645099b700 1 -- 172.21.15.72:0/444313568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f644c154030 msgr2=0x7f644c150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:05.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.905+0000 7f645099b700 1 --2- 172.21.15.72:0/444313568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f644c154030 0x7f644c150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:05.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.905+0000 7f645099b700 1 -- 172.21.15.72:0/444313568 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64380092a0 con 0x7f644c0aa140 2023-08-31T19:03:05.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.905+0000 7f645099b700 1 --2- 172.21.15.72:0/444313568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f644c0aa140 0x7f644c0ac610 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f644000e900 tx=0x7f6440009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:05.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.905+0000 7f6448ff9700 1 -- 172.21.15.72:0/444313568 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440012600 con 0x7f644c0aa140 2023-08-31T19:03:05.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.905+0000 7f6448ff9700 1 -- 172.21.15.72:0/444313568 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6440012760 con 0x7f644c0aa140 2023-08-31T19:03:05.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.905+0000 7f6452bff700 1 -- 172.21.15.72:0/444313568 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644c0aceb0 con 0x7f644c0aa140 2023-08-31T19:03:05.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.906+0000 7f6448ff9700 1 -- 172.21.15.72:0/444313568 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440012ae0 con 0x7f644c0aa140 2023-08-31T19:03:05.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.906+0000 7f6452bff700 1 -- 172.21.15.72:0/444313568 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644c0ad470 con 0x7f644c0aa140 2023-08-31T19:03:05.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.907+0000 7f6452bff700 1 -- 172.21.15.72:0/444313568 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644c06c6b0 con 0x7f644c0aa140 2023-08-31T19:03:05.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.908+0000 7f6448ff9700 1 -- 172.21.15.72:0/444313568 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f644001b400 con 0x7f644c0aa140 2023-08-31T19:03:05.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.909+0000 7f6448ff9700 1 --2- 172.21.15.72:0/444313568 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f643005ef30 0x7f64300613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:05.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.909+0000 7f6448ff9700 1 -- 172.21.15.72:0/444313568 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7067+0+0 (secure 0 0 0) 0x7f644007a730 con 0x7f644c0aa140 2023-08-31T19:03:05.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.909+0000 7f644bfff700 1 -- 172.21.15.72:0/444313568 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f643005ef30 msgr2=0x7f64300613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:05.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.909+0000 7f644bfff700 1 --2- 172.21.15.72:0/444313568 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f643005ef30 0x7f64300613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:05.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:05.912+0000 7f6448ff9700 1 -- 172.21.15.72:0/444313568 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f644004b550 con 0x7f644c0aa140 2023-08-31T19:03:05.937 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:05.938+0000 7f5e0dd8f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:03:06.048 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:06.048+0000 7feaf38ae680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:03:06.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.089+0000 7f6452bff700 1 -- 172.21.15.72:0/444313568 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f644c0c0c50 con 0x7f644c0aa140 2023-08-31T19:03:06.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.090+0000 7f6448ff9700 1 -- 172.21.15.72:0/444313568 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v64) v1 ==== 104+0+11 (secure 0 0 0) 0x7f644004eb70 con 0x7f644c0aa140 2023-08-31T19:03:06.089 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:03:06.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.092+0000 7f6452bff700 1 -- 172.21.15.72:0/444313568 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f643005ef30 msgr2=0x7f64300613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:06.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.092+0000 7f6452bff700 1 --2- 172.21.15.72:0/444313568 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f643005ef30 0x7f64300613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:06.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.092+0000 7f6452bff700 1 -- 172.21.15.72:0/444313568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f644c0aa140 msgr2=0x7f644c0ac610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:06.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.092+0000 7f6452bff700 1 --2- 172.21.15.72:0/444313568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f644c0aa140 0x7f644c0ac610 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f644000e900 tx=0x7f6440009060).stop 2023-08-31T19:03:06.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.092+0000 7f6452bff700 1 -- 172.21.15.72:0/444313568 shutdown_connections 2023-08-31T19:03:06.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.092+0000 7f6452bff700 1 --2- 172.21.15.72:0/444313568 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f643005ef30 0x7f64300613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:06.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.092+0000 7f6452bff700 1 --2- 172.21.15.72:0/444313568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f644c154030 0x7f644c150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.092+0000 7f6452bff700 1 --2- 172.21.15.72:0/444313568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f644c0aa140 0x7f644c0ac610 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.092+0000 7f6452bff700 1 --2- 172.21.15.72:0/444313568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f644c0c06b0 0x7f644c0c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.092+0000 7f6452bff700 1 -- 172.21.15.72:0/444313568 >> 172.21.15.72:0/444313568 conn(0x7f644c05eb60 msgr2=0x7f644c151af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:06.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.092+0000 7f6452bff700 1 -- 172.21.15.72:0/444313568 shutdown_connections 2023-08-31T19:03:06.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.092+0000 7f6452bff700 1 -- 172.21.15.72:0/444313568 wait complete. 2023-08-31T19:03:06.109 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:03:06.126 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:06.127+0000 7f5e0dd8f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:03:06.140 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:06.139+0000 7feaf38ae680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:03:06.223 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:06.224+0000 7f5e0dd8f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:03:06.224 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:06.224+0000 7feaf38ae680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:03:06.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.305+0000 7f69ec9ff700 1 Processor -- start 2023-08-31T19:03:06.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.305+0000 7f69ec9ff700 1 -- start start 2023-08-31T19:03:06.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.307+0000 7f69ec9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f69e8153e30 0x7f69e8154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:06.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.307+0000 7f69ec9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f69e80c5cb0 0x7f69e80c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:06.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.307+0000 7f69ec9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e80630b0 0x7f69e8063540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:06.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.307+0000 7f69ec9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e8063a30 con 0x7f69e80c5cb0 2023-08-31T19:03:06.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.307+0000 7f69ec9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e80bfd40 con 0x7f69e8153e30 2023-08-31T19:03:06.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.307+0000 7f69ec9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80c6730 con 0x7f69e80630b0 2023-08-31T19:03:06.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.307+0000 7f69e5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f69e80c5cb0 0x7f69e80c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:06.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.307+0000 7f69e5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f69e80c5cb0 0x7f69e80c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55838/0 (socket says 172.21.15.72:55838) 2023-08-31T19:03:06.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.307+0000 7f69e5d9b700 1 -- 172.21.15.72:0/3236382964 learned_addr learned my addr 172.21.15.72:0/3236382964 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:06.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.307+0000 7f69e659c700 1 --2- 172.21.15.72:0/3236382964 >> v2:172.21.15.146:3300/0 conn(0x7f69e8153e30 0x7f69e8154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:06.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.307+0000 7f69e6d9d700 1 --2- 172.21.15.72:0/3236382964 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e80630b0 0x7f69e8063540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:06.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.308+0000 7f69e5d9b700 1 -- 172.21.15.72:0/3236382964 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e80630b0 msgr2=0x7f69e8063540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:06.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.308+0000 7f69e5d9b700 1 --2- 172.21.15.72:0/3236382964 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e80630b0 0x7f69e8063540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.308+0000 7f69e5d9b700 1 -- 172.21.15.72:0/3236382964 >> v2:172.21.15.146:3300/0 conn(0x7f69e8153e30 msgr2=0x7f69e8154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:06.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.308+0000 7f69e5d9b700 1 --2- 172.21.15.72:0/3236382964 >> v2:172.21.15.146:3300/0 conn(0x7f69e8153e30 0x7f69e8154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.308+0000 7f69e5d9b700 1 -- 172.21.15.72:0/3236382964 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e80bffe0 con 0x7f69e80c5cb0 2023-08-31T19:03:06.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.308+0000 7f69e5d9b700 1 --2- 172.21.15.72:0/3236382964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e80c5cb0 0x7f69e80c6160 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f69e806aa50 tx=0x7f69dc0090f0).ready entity=mon.0 client_cookie=d1b8ef2cc1dc919f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:06.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.308+0000 7f69e559a700 1 -- 172.21.15.72:0/3236382964 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc00f510 con 0x7f69e80c5cb0 2023-08-31T19:03:06.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.308+0000 7f69e559a700 1 -- 172.21.15.72:0/3236382964 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc00f670 con 0x7f69e80c5cb0 2023-08-31T19:03:06.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.308+0000 7f69e559a700 1 -- 172.21.15.72:0/3236382964 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc00fa10 con 0x7f69e80c5cb0 2023-08-31T19:03:06.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.309+0000 7f69ec9ff700 1 -- 172.21.15.72:0/3236382964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e80c5cb0 msgr2=0x7f69e80c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:06.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.309+0000 7f69ec9ff700 1 --2- 172.21.15.72:0/3236382964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e80c5cb0 0x7f69e80c6160 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f69e806aa50 tx=0x7f69dc0090f0).stop 2023-08-31T19:03:06.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.309+0000 7f69ec9ff700 1 -- 172.21.15.72:0/3236382964 shutdown_connections 2023-08-31T19:03:06.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.309+0000 7f69ec9ff700 1 --2- 172.21.15.72:0/3236382964 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e80630b0 0x7f69e8063540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.309+0000 7f69ec9ff700 1 --2- 172.21.15.72:0/3236382964 >> v2:172.21.15.146:3300/0 conn(0x7f69e8153e30 0x7f69e8154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.309+0000 7f69ec9ff700 1 --2- 172.21.15.72:0/3236382964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e80c5cb0 0x7f69e80c6160 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.309+0000 7f69ec9ff700 1 -- 172.21.15.72:0/3236382964 >> 172.21.15.72:0/3236382964 conn(0x7f69e805eb20 msgr2=0x7f69e80cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:06.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.309+0000 7f69ec9ff700 1 -- 172.21.15.72:0/3236382964 shutdown_connections 2023-08-31T19:03:06.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.309+0000 7f69ec9ff700 1 -- 172.21.15.72:0/3236382964 wait complete. 2023-08-31T19:03:06.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.311+0000 7f69ec9ff700 1 Processor -- start 2023-08-31T19:03:06.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.311+0000 7f69ec9ff700 1 -- start start 2023-08-31T19:03:06.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.312+0000 7f69ec9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80630b0 0x7f69e8167ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:06.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.312+0000 7f69ec9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e80c5cb0 0x7f69e8141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:06.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.312+0000 7f69ec9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e8153e30 0x7f69e8141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:06.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.313+0000 7f69ec9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8143190 con 0x7f69e80c5cb0 2023-08-31T19:03:06.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.313+0000 7f69ec9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8143470 con 0x7f69e80630b0 2023-08-31T19:03:06.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.313+0000 7f69ec9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8143750 con 0x7f69e8153e30 2023-08-31T19:03:06.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.313+0000 7f69e5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e80c5cb0 0x7f69e8141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:06.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.313+0000 7f69e5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e80c5cb0 0x7f69e8141590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55846/0 (socket says 172.21.15.72:55846) 2023-08-31T19:03:06.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.313+0000 7f69e5d9b700 1 -- 172.21.15.72:0/2740838975 learned_addr learned my addr 172.21.15.72:0/2740838975 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:06.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.313+0000 7f69e659c700 1 --2- 172.21.15.72:0/2740838975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80630b0 0x7f69e8167ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:06.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.313+0000 7f69e6d9d700 1 --2- 172.21.15.72:0/2740838975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e8153e30 0x7f69e8141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:06.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.313+0000 7f69e5d9b700 1 -- 172.21.15.72:0/2740838975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e8153e30 msgr2=0x7f69e8141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:06.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.313+0000 7f69e5d9b700 1 --2- 172.21.15.72:0/2740838975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e8153e30 0x7f69e8141a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.313+0000 7f69e5d9b700 1 -- 172.21.15.72:0/2740838975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80630b0 msgr2=0x7f69e8167ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:06.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.313+0000 7f69e5d9b700 1 --2- 172.21.15.72:0/2740838975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80630b0 0x7f69e8167ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.318 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:06.313+0000 7f5e0dd8f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:03:06.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.313+0000 7f69e5d9b700 1 -- 172.21.15.72:0/2740838975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc009370 con 0x7f69e80c5cb0 2023-08-31T19:03:06.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.313+0000 7f69e5d9b700 1 --2- 172.21.15.72:0/2740838975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e80c5cb0 0x7f69e8141590 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f69dc006fd0 tx=0x7f69dc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:06.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.314+0000 7f69d67fc700 1 -- 172.21.15.72:0/2740838975 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc006d90 con 0x7f69e80c5cb0 2023-08-31T19:03:06.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.314+0000 7f69d67fc700 1 -- 172.21.15.72:0/2740838975 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc000bc0 con 0x7f69e80c5cb0 2023-08-31T19:03:06.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.314+0000 7f69ec9ff700 1 -- 172.21.15.72:0/2740838975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e8143a30 con 0x7f69e80c5cb0 2023-08-31T19:03:06.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.314+0000 7f69d67fc700 1 -- 172.21.15.72:0/2740838975 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc00fa10 con 0x7f69e80c5cb0 2023-08-31T19:03:06.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.314+0000 7f69ec9ff700 1 -- 172.21.15.72:0/2740838975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e8141f70 con 0x7f69e80c5cb0 2023-08-31T19:03:06.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.315+0000 7f69ec9ff700 1 -- 172.21.15.72:0/2740838975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e806c6b0 con 0x7f69e80c5cb0 2023-08-31T19:03:06.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.316+0000 7f69d67fc700 1 -- 172.21.15.72:0/2740838975 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f69dc01b640 con 0x7f69e80c5cb0 2023-08-31T19:03:06.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.316+0000 7f69d67fc700 1 --2- 172.21.15.72:0/2740838975 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f69c805ef30 0x7f69c80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:06.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.317+0000 7f69d67fc700 1 -- 172.21.15.72:0/2740838975 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7067+0+0 (secure 0 0 0) 0x7f69dc07bad0 con 0x7f69e80c5cb0 2023-08-31T19:03:06.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.317+0000 7f69e659c700 1 -- 172.21.15.72:0/2740838975 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f69c805ef30 msgr2=0x7f69c80613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:06.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.317+0000 7f69e659c700 1 --2- 172.21.15.72:0/2740838975 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f69c805ef30 0x7f69c80613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:06.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.320+0000 7f69d67fc700 1 -- 172.21.15.72:0/2740838975 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f69dc04ca10 con 0x7f69e80c5cb0 2023-08-31T19:03:06.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.496+0000 7f69ec9ff700 1 -- 172.21.15.72:0/2740838975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69e8062970 con 0x7f69e80c5cb0 2023-08-31T19:03:06.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.497+0000 7f69d67fc700 1 -- 172.21.15.72:0/2740838975 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v64) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69dc015070 con 0x7f69e80c5cb0 2023-08-31T19:03:06.498 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:03:06.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.499+0000 7f69ec9ff700 1 -- 172.21.15.72:0/2740838975 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f69c805ef30 msgr2=0x7f69c80613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.499+0000 7f69ec9ff700 1 --2- 172.21.15.72:0/2740838975 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f69c805ef30 0x7f69c80613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.499+0000 7f69ec9ff700 1 -- 172.21.15.72:0/2740838975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e80c5cb0 msgr2=0x7f69e8141590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.499+0000 7f69ec9ff700 1 --2- 172.21.15.72:0/2740838975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e80c5cb0 0x7f69e8141590 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f69dc006fd0 tx=0x7f69dc016000).stop 2023-08-31T19:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.499+0000 7f69ec9ff700 1 -- 172.21.15.72:0/2740838975 shutdown_connections 2023-08-31T19:03:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.499+0000 7f69ec9ff700 1 --2- 172.21.15.72:0/2740838975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f69e8153e30 0x7f69e8141a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.499+0000 7f69ec9ff700 1 --2- 172.21.15.72:0/2740838975 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f69c805ef30 0x7f69c80613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.499+0000 7f69ec9ff700 1 --2- 172.21.15.72:0/2740838975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69e80630b0 0x7f69e8167ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.499+0000 7f69ec9ff700 1 --2- 172.21.15.72:0/2740838975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e80c5cb0 0x7f69e8141590 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.499+0000 7f69ec9ff700 1 -- 172.21.15.72:0/2740838975 >> 172.21.15.72:0/2740838975 conn(0x7f69e805eb20 msgr2=0x7f69e80ca080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.499+0000 7f69ec9ff700 1 -- 172.21.15.72:0/2740838975 shutdown_connections 2023-08-31T19:03:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.499+0000 7f69ec9ff700 1 -- 172.21.15.72:0/2740838975 wait complete. 2023-08-31T19:03:06.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:03:06.533 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:06.533+0000 7feaf38ae680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:03:06.634 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:06.634+0000 7f5e0dd8f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:03:06.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.750+0000 7ff3d45ff700 1 Processor -- start 2023-08-31T19:03:06.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.751+0000 7ff3d45ff700 1 -- start start 2023-08-31T19:03:06.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.752+0000 7ff3d45ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff3cc065710 0x7ff3cc069c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:06.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.752+0000 7ff3d45ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3cc064270 con 0x7ff3cc06a260 2023-08-31T19:03:06.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.752+0000 7ff3d45ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3cc0bcc20 con 0x7ff3cc069170 2023-08-31T19:03:06.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.752+0000 7ff3d45ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3cc0bca40 con 0x7ff3cc065710 2023-08-31T19:03:06.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.752+0000 7ff3d1b9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff3cc06a260 0x7ff3cc069550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34868/0 (socket says 172.21.15.72:34868) 2023-08-31T19:03:06.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.752+0000 7ff3d1b9a700 1 -- 172.21.15.72:0/170980926 learned_addr learned my addr 172.21.15.72:0/170980926 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:06.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.752+0000 7ff3d2b9c700 1 --2- 172.21.15.72:0/170980926 >> v2:172.21.15.146:3300/0 conn(0x7ff3cc065710 0x7ff3cc069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:06.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.753+0000 7ff3d1399700 1 -- 172.21.15.72:0/170980926 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20012702 0 0) 0x7ff3cc064270 con 0x7ff3cc06a260 2023-08-31T19:03:06.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.753+0000 7ff3d1399700 1 -- 172.21.15.72:0/170980926 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3b80033f0 con 0x7ff3cc06a260 2023-08-31T19:03:06.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.753+0000 7ff3d1399700 1 -- 172.21.15.72:0/170980926 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836582323 0 0) 0x7ff3cc0bcc20 con 0x7ff3cc069170 2023-08-31T19:03:06.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.753+0000 7ff3d1399700 1 -- 172.21.15.72:0/170980926 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3cc064270 con 0x7ff3cc069170 2023-08-31T19:03:06.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.753+0000 7ff3d2b9c700 1 -- 172.21.15.72:0/170980926 >> v1:172.21.15.146:6789/0 conn(0x7ff3cc069170 legacy=0x7ff3cc0c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:06.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.753+0000 7ff3d1399700 1 -- 172.21.15.72:0/170980926 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4102864848 0 0) 0x7ff3b80033f0 con 0x7ff3cc06a260 2023-08-31T19:03:06.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.753+0000 7ff3d2b9c700 1 -- 172.21.15.72:0/170980926 >> v1:172.21.15.72:6789/0 conn(0x7ff3cc06a260 legacy=0x7ff3cc069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:06.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.753+0000 7ff3d2b9c700 1 -- 172.21.15.72:0/170980926 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc154890 con 0x7ff3cc065710 2023-08-31T19:03:06.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.753+0000 7ff3d2b9c700 1 --2- 172.21.15.72:0/170980926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3cc065710 0x7ff3cc069c60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7ff3cc0c7670 tx=0x7ff3c4009780).ready entity=mon.1 client_cookie=71a4b730235f12e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:06.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.754+0000 7ff3d1399700 1 -- 172.21.15.72:0/170980926 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400e070 con 0x7ff3cc065710 2023-08-31T19:03:06.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.754+0000 7ff3d1399700 1 -- 172.21.15.72:0/170980926 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c400b7a0 con 0x7ff3cc065710 2023-08-31T19:03:06.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.754+0000 7ff3d1399700 1 -- 172.21.15.72:0/170980926 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc001470 con 0x7ff3cc065710 2023-08-31T19:03:06.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.754+0000 7ff3d45ff700 1 -- 172.21.15.72:0/170980926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3cc065710 msgr2=0x7ff3cc069c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:06.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.754+0000 7ff3d45ff700 1 --2- 172.21.15.72:0/170980926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3cc065710 0x7ff3cc069c60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7ff3cc0c7670 tx=0x7ff3c4009780).stop 2023-08-31T19:03:06.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.754+0000 7ff3d45ff700 1 -- 172.21.15.72:0/170980926 shutdown_connections 2023-08-31T19:03:06.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.754+0000 7ff3d45ff700 1 --2- 172.21.15.72:0/170980926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3cc065710 0x7ff3cc069c60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.754+0000 7ff3d45ff700 1 -- 172.21.15.72:0/170980926 >> 172.21.15.72:0/170980926 conn(0x7ff3cc0c6b10 msgr2=0x7ff3cc0c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:06.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.754+0000 7ff3d45ff700 1 -- 172.21.15.72:0/170980926 shutdown_connections 2023-08-31T19:03:06.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.755+0000 7ff3d45ff700 1 -- 172.21.15.72:0/170980926 wait complete. 2023-08-31T19:03:06.760 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:06.758+0000 7feaf38ae680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:03:06.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.756+0000 7ff3d45ff700 1 Processor -- start 2023-08-31T19:03:06.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.756+0000 7ff3d45ff700 1 -- start start 2023-08-31T19:03:06.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.757+0000 7ff3d45ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc065710 0x7ff3cc0c0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:06.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.757+0000 7ff3d45ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3cc069170 0x7ff3cc147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:06.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.757+0000 7ff3d45ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3cc06a260 0x7ff3cc0a8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:06.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.757+0000 7ff3d45ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0a8830 con 0x7ff3cc065710 2023-08-31T19:03:06.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.757+0000 7ff3d45ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0a7c20 con 0x7ff3cc06a260 2023-08-31T19:03:06.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.757+0000 7ff3d45ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0a7f00 con 0x7ff3cc069170 2023-08-31T19:03:06.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.757+0000 7ff3d239b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc065710 0x7ff3cc0c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:06.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.758+0000 7ff3d239b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc065710 0x7ff3cc0c0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55862/0 (socket says 172.21.15.72:55862) 2023-08-31T19:03:06.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.758+0000 7ff3d239b700 1 -- 172.21.15.72:0/361259355 learned_addr learned my addr 172.21.15.72:0/361259355 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:06.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.758+0000 7ff3d2b9c700 1 --2- 172.21.15.72:0/361259355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3cc06a260 0x7ff3cc0a8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:06.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.758+0000 7ff3d1b9a700 1 --2- 172.21.15.72:0/361259355 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3cc069170 0x7ff3cc147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:06.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.758+0000 7ff3d239b700 1 -- 172.21.15.72:0/361259355 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3cc069170 msgr2=0x7ff3cc147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:06.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.758+0000 7ff3d239b700 1 --2- 172.21.15.72:0/361259355 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3cc069170 0x7ff3cc147260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.758+0000 7ff3d239b700 1 -- 172.21.15.72:0/361259355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3cc06a260 msgr2=0x7ff3cc0a8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:06.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.758+0000 7ff3d239b700 1 --2- 172.21.15.72:0/361259355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3cc06a260 0x7ff3cc0a8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.758+0000 7ff3d239b700 1 -- 172.21.15.72:0/361259355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c4009a20 con 0x7ff3cc065710 2023-08-31T19:03:06.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.758+0000 7ff3d2b9c700 1 --2- 172.21.15.72:0/361259355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3cc06a260 0x7ff3cc0a8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:06.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.758+0000 7ff3d239b700 1 --2- 172.21.15.72:0/361259355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc065710 0x7ff3cc0c0670 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7ff3c800c490 tx=0x7ff3c8007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:06.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.758+0000 7ff3c27fc700 1 -- 172.21.15.72:0/361259355 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800f470 con 0x7ff3cc065710 2023-08-31T19:03:06.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.758+0000 7ff3c27fc700 1 -- 172.21.15.72:0/361259355 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c800f5d0 con 0x7ff3cc065710 2023-08-31T19:03:06.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.758+0000 7ff3d45ff700 1 -- 172.21.15.72:0/361259355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3cc0a81e0 con 0x7ff3cc065710 2023-08-31T19:03:06.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.758+0000 7ff3c27fc700 1 -- 172.21.15.72:0/361259355 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800f970 con 0x7ff3cc065710 2023-08-31T19:03:06.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.759+0000 7ff3d45ff700 1 -- 172.21.15.72:0/361259355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3cc0c0b60 con 0x7ff3cc065710 2023-08-31T19:03:06.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.760+0000 7ff3d45ff700 1 -- 172.21.15.72:0/361259355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3cc0a8b10 con 0x7ff3cc065710 2023-08-31T19:03:06.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.761+0000 7ff3c27fc700 1 -- 172.21.15.72:0/361259355 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) v1 ==== 75386+0+0 (secure 0 0 0) 0x7ff3c800fd20 con 0x7ff3cc065710 2023-08-31T19:03:06.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.762+0000 7ff3c27fc700 1 --2- 172.21.15.72:0/361259355 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3b005ef60 0x7ff3b0061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:06.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.762+0000 7ff3d1b9a700 1 -- 172.21.15.72:0/361259355 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3b005ef60 msgr2=0x7ff3b0061420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:06.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.762+0000 7ff3c27fc700 1 -- 172.21.15.72:0/361259355 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7067+0+0 (secure 0 0 0) 0x7ff3c80799b0 con 0x7ff3cc065710 2023-08-31T19:03:06.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.762+0000 7ff3d1b9a700 1 --2- 172.21.15.72:0/361259355 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3b005ef60 0x7ff3b0061420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:06.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.766+0000 7ff3c27fc700 1 -- 172.21.15.72:0/361259355 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3c804a830 con 0x7ff3cc065710 2023-08-31T19:03:06.864 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:06.863+0000 7f5e0dd8f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:03:06.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.963+0000 7ff3d1b9a700 1 -- 172.21.15.72:0/361259355 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3b005ef60 msgr2=0x7ff3b0061420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:06.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.963+0000 7ff3d1b9a700 1 --2- 172.21.15.72:0/361259355 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3b005ef60 0x7ff3b0061420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:03:06.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.987+0000 7ff3d45ff700 1 -- 172.21.15.72:0/361259355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3cc06c6b0 con 0x7ff3cc065710 2023-08-31T19:03:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.988+0000 7ff3c27fc700 1 -- 172.21.15.72:0/361259355 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4492 (secure 0 0 0) 0x7ff3c804de50 con 0x7ff3cc065710 2023-08-31T19:03:06.988 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:06.989 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1085369530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1085369530},{"type":"v1","addr":"172.21.15.146:6834","nonce":1085369530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3852978729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3852978729},{"type":"v1","addr":"172.21.15.146:6835","nonce":3852978729}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/654480318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":654480318},{"type":"v1","addr":"172.21.15.72:6835","nonce":654480318}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:01:01.982648+0000","modified":"2023-08-31T19:01:05.003693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3101703480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3101703480},{"type":"v1","addr":"172.21.15.72:6837","nonce":3101703480}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-31T19:03:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.990+0000 7ff3d45ff700 1 -- 172.21.15.72:0/361259355 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3b005ef60 msgr2=0x7ff3b0061420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.990+0000 7ff3d45ff700 1 --2- 172.21.15.72:0/361259355 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3b005ef60 0x7ff3b0061420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.990+0000 7ff3d45ff700 1 -- 172.21.15.72:0/361259355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc065710 msgr2=0x7ff3cc0c0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.990+0000 7ff3d45ff700 1 --2- 172.21.15.72:0/361259355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc065710 0x7ff3cc0c0670 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7ff3c800c490 tx=0x7ff3c8007c90).stop 2023-08-31T19:03:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.990+0000 7ff3d45ff700 1 -- 172.21.15.72:0/361259355 shutdown_connections 2023-08-31T19:03:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.990+0000 7ff3d45ff700 1 --2- 172.21.15.72:0/361259355 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3b005ef60 0x7ff3b0061420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.990+0000 7ff3d45ff700 1 --2- 172.21.15.72:0/361259355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3cc06a260 0x7ff3cc0a8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.990+0000 7ff3d45ff700 1 --2- 172.21.15.72:0/361259355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc065710 0x7ff3cc0c0670 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.990+0000 7ff3d45ff700 1 --2- 172.21.15.72:0/361259355 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3cc069170 0x7ff3cc147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.990+0000 7ff3d45ff700 1 -- 172.21.15.72:0/361259355 >> 172.21.15.72:0/361259355 conn(0x7ff3cc0c6b10 msgr2=0x7ff3cc0c5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.990+0000 7ff3d45ff700 1 -- 172.21.15.72:0/361259355 shutdown_connections 2023-08-31T19:03:06.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:06.990+0000 7ff3d45ff700 1 -- 172.21.15.72:0/361259355 wait complete. 2023-08-31T19:03:06.993 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 23 2023-08-31T19:03:07.008 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:03:07.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.200+0000 7f93b4fff700 1 Processor -- start 2023-08-31T19:03:07.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.200+0000 7f93b4fff700 1 -- start start 2023-08-31T19:03:07.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.201+0000 7f93b4fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93b0069170 0x7f93b00c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.201+0000 7f93b4fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b0065710 0x7f93b0069c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.201+0000 7f93b4fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b0064270 con 0x7f93b006a260 2023-08-31T19:03:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.201+0000 7f93b4fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b00bca40 con 0x7f93b0069170 2023-08-31T19:03:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.201+0000 7f93b4fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b00bcc20 con 0x7f93b0065710 2023-08-31T19:03:07.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.202+0000 7f93ae59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93b0069170 0x7f93b00c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.202+0000 7f93ae59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93b0069170 0x7f93b00c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55866/0 (socket says 172.21.15.72:55866) 2023-08-31T19:03:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.202+0000 7f93ae59c700 1 -- 172.21.15.72:0/3767681726 learned_addr learned my addr 172.21.15.72:0/3767681726 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.202+0000 7f93aed9d700 1 --2- 172.21.15.72:0/3767681726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b0065710 0x7f93b0069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.202+0000 7f93ae59c700 1 -- 172.21.15.72:0/3767681726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b0065710 msgr2=0x7f93b0069c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:07.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.202+0000 7f93ae59c700 1 --2- 172.21.15.72:0/3767681726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b0065710 0x7f93b0069c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.202+0000 7f93ae59c700 1 -- 172.21.15.72:0/3767681726 >> v1:172.21.15.146:6789/0 conn(0x7f93b006a260 legacy=0x7f93b0069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.202+0000 7f93ae59c700 1 -- 172.21.15.72:0/3767681726 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b0154890 con 0x7f93b0069170 2023-08-31T19:03:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.202+0000 7f93aed9d700 1 --2- 172.21.15.72:0/3767681726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b0065710 0x7f93b0069c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.202+0000 7f93ae59c700 1 --2- 172.21.15.72:0/3767681726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b0069170 0x7f93b00c2e50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f93a0006fd0 tx=0x7f93a00090f0).ready entity=mon.0 client_cookie=5488d84df63fcddb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:07.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.202+0000 7f93ad59a700 1 -- 172.21.15.72:0/3767681726 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a000b600 con 0x7f93b0069170 2023-08-31T19:03:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.203+0000 7f93ad59a700 1 -- 172.21.15.72:0/3767681726 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a000b760 con 0x7f93b0069170 2023-08-31T19:03:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.203+0000 7f93ad59a700 1 -- 172.21.15.72:0/3767681726 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a000bae0 con 0x7f93b0069170 2023-08-31T19:03:07.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.203+0000 7f93b4fff700 1 -- 172.21.15.72:0/3767681726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b0069170 msgr2=0x7f93b00c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:07.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.203+0000 7f93b4fff700 1 --2- 172.21.15.72:0/3767681726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b0069170 0x7f93b00c2e50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f93a0006fd0 tx=0x7f93a00090f0).stop 2023-08-31T19:03:07.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.203+0000 7f93b4fff700 1 -- 172.21.15.72:0/3767681726 shutdown_connections 2023-08-31T19:03:07.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.203+0000 7f93b4fff700 1 --2- 172.21.15.72:0/3767681726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b0065710 0x7f93b0069c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.203+0000 7f93b4fff700 1 --2- 172.21.15.72:0/3767681726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b0069170 0x7f93b00c2e50 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.203+0000 7f93b4fff700 1 -- 172.21.15.72:0/3767681726 >> 172.21.15.72:0/3767681726 conn(0x7f93b00c6b10 msgr2=0x7f93b00c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:07.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.203+0000 7f93b4fff700 1 -- 172.21.15.72:0/3767681726 shutdown_connections 2023-08-31T19:03:07.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.203+0000 7f93b4fff700 1 -- 172.21.15.72:0/3767681726 wait complete. 2023-08-31T19:03:07.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.205+0000 7f93b4fff700 1 Processor -- start 2023-08-31T19:03:07.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.205+0000 7f93b4fff700 1 -- start start 2023-08-31T19:03:07.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.206+0000 7f93b4fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b0065710 0x7f93b014a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:07.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.206+0000 7f93b4fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93b0069170 0x7f93b0142150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:07.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.206+0000 7f93b4fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b006a260 0x7f93b0148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:07.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.206+0000 7f93b4fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b0141cc0 con 0x7f93b0065710 2023-08-31T19:03:07.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.206+0000 7f93b4fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b0168b30 con 0x7f93b0069170 2023-08-31T19:03:07.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.206+0000 7f93b4fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b0141670 con 0x7f93b006a260 2023-08-31T19:03:07.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.206+0000 7f93ae59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b0065710 0x7f93b014a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:07.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.206+0000 7f93ae59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b0065710 0x7f93b014a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55870/0 (socket says 172.21.15.72:55870) 2023-08-31T19:03:07.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.206+0000 7f93ae59c700 1 -- 172.21.15.72:0/2653759215 learned_addr learned my addr 172.21.15.72:0/2653759215 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:07.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.206+0000 7f93aed9d700 1 --2- 172.21.15.72:0/2653759215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b006a260 0x7f93b0148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:07.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.206+0000 7f93add9b700 1 --2- 172.21.15.72:0/2653759215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93b0069170 0x7f93b0142150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.207+0000 7f93ae59c700 1 -- 172.21.15.72:0/2653759215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b006a260 msgr2=0x7f93b0148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.207+0000 7f93ae59c700 1 --2- 172.21.15.72:0/2653759215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b006a260 0x7f93b0148670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.207+0000 7f93ae59c700 1 -- 172.21.15.72:0/2653759215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93b0069170 msgr2=0x7f93b0142150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.207+0000 7f93ae59c700 1 --2- 172.21.15.72:0/2653759215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93b0069170 0x7f93b0142150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.207+0000 7f93ae59c700 1 -- 172.21.15.72:0/2653759215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a0009370 con 0x7f93b0065710 2023-08-31T19:03:07.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.207+0000 7f93aed9d700 1 --2- 172.21.15.72:0/2653759215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b006a260 0x7f93b0148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.207+0000 7f93add9b700 1 --2- 172.21.15.72:0/2653759215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93b0069170 0x7f93b0142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.207+0000 7f93ae59c700 1 --2- 172.21.15.72:0/2653759215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b0065710 0x7f93b014a7a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f93b0067940 tx=0x7f93a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.207+0000 7f939e7fc700 1 -- 172.21.15.72:0/2653759215 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a000b8d0 con 0x7f93b0065710 2023-08-31T19:03:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.207+0000 7f939e7fc700 1 -- 172.21.15.72:0/2653759215 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a000ba30 con 0x7f93b0065710 2023-08-31T19:03:07.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.207+0000 7f93b4fff700 1 -- 172.21.15.72:0/2653759215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b0141950 con 0x7f93b0065710 2023-08-31T19:03:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.207+0000 7f939e7fc700 1 -- 172.21.15.72:0/2653759215 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a001b660 con 0x7f93b0065710 2023-08-31T19:03:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.207+0000 7f93b4fff700 1 -- 172.21.15.72:0/2653759215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b014ac90 con 0x7f93b0065710 2023-08-31T19:03:07.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.208+0000 7f93b4fff700 1 -- 172.21.15.72:0/2653759215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b01414e0 con 0x7f93b0065710 2023-08-31T19:03:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.209+0000 7f939e7fc700 1 -- 172.21.15.72:0/2653759215 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f93a001ba50 con 0x7f93b0065710 2023-08-31T19:03:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.211+0000 7f939e7fc700 1 --2- 172.21.15.72:0/2653759215 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f939005ef30 0x7f93900613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.211+0000 7f93add9b700 1 -- 172.21.15.72:0/2653759215 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f939005ef30 msgr2=0x7f93900613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.211+0000 7f939e7fc700 1 -- 172.21.15.72:0/2653759215 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 7067+0+0 (secure 0 0 0) 0x7f93a007bf60 con 0x7f93b0065710 2023-08-31T19:03:07.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.211+0000 7f93add9b700 1 --2- 172.21.15.72:0/2653759215 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f939005ef30 0x7f93900613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:07.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.215+0000 7f939e7fc700 1 -- 172.21.15.72:0/2653759215 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f93a004cde0 con 0x7f93b0065710 2023-08-31T19:03:07.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.391+0000 7f93b4fff700 1 -- 172.21.15.72:0/2653759215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93b006c6b0 con 0x7f93b0065710 2023-08-31T19:03:07.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.392+0000 7f939e7fc700 1 -- 172.21.15.72:0/2653759215 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+18446 (secure 0 0 0) 0x7f93a001f070 con 0x7f93b0065710 2023-08-31T19:03:07.393 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:07.393 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":64,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:02:17.463801+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:01:00.413643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-31T19:01:00.966624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"8.25","mappings":[{"from":0,"to":6}]},{"pgid":"8.2f","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/1369274110":"2023-09-01T19:01:15.623246+0000","172.21.15.72:0/1336378034":"2023-09-01T19:01:15.623246+0000","172.21.15.72:6833/143463":"2023-09-01T19:01:15.623246+0000","172.21.15.72:0/1927962454":"2023-09-01T19:01:15.623246+0000","172.21.15.72:6832/143463":"2023-09-01T19:01:15.623246+0000","172.21.15.72:0/1354492929":"2023-09-01T19:01:15.623246+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:03:07.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.394+0000 7f93b4fff700 1 -- 172.21.15.72:0/2653759215 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f939005ef30 msgr2=0x7f93900613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:07.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.394+0000 7f93b4fff700 1 --2- 172.21.15.72:0/2653759215 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f939005ef30 0x7f93900613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:07.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.394+0000 7f93b4fff700 1 -- 172.21.15.72:0/2653759215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b0065710 msgr2=0x7f93b014a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:07.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.394+0000 7f93b4fff700 1 --2- 172.21.15.72:0/2653759215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b0065710 0x7f93b014a7a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f93b0067940 tx=0x7f93a0017000).stop 2023-08-31T19:03:07.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.394+0000 7f93b4fff700 1 -- 172.21.15.72:0/2653759215 shutdown_connections 2023-08-31T19:03:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.394+0000 7f93b4fff700 1 --2- 172.21.15.72:0/2653759215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b006a260 0x7f93b0148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.394+0000 7f93b4fff700 1 --2- 172.21.15.72:0/2653759215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b0065710 0x7f93b014a7a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.394+0000 7f93b4fff700 1 --2- 172.21.15.72:0/2653759215 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f939005ef30 0x7f93900613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.394+0000 7f93b4fff700 1 --2- 172.21.15.72:0/2653759215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93b0069170 0x7f93b0142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.394+0000 7f93b4fff700 1 -- 172.21.15.72:0/2653759215 >> 172.21.15.72:0/2653759215 conn(0x7f93b00c6b10 msgr2=0x7f93b00c3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:07.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.394+0000 7f93b4fff700 1 -- 172.21.15.72:0/2653759215 shutdown_connections 2023-08-31T19:03:07.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.394+0000 7f93b4fff700 1 -- 172.21.15.72:0/2653759215 wait complete. 2023-08-31T19:03:07.412 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T19:03:07.413 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:03:07.562 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:07.561+0000 7feaf38ae680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:03:07.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.610+0000 7faf93fff700 1 Processor -- start 2023-08-31T19:03:07.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.610+0000 7faf93fff700 1 -- start start 2023-08-31T19:03:07.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.611+0000 7faf93fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf8c156310 0x7faf8c0c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:07.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.611+0000 7faf93fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf8c0bba70 0x7faf8c0c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:07.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.611+0000 7faf93fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8c0c26b0 con 0x7faf8c135030 2023-08-31T19:03:07.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.611+0000 7faf93fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8c0c1e80 con 0x7faf8c0bba70 2023-08-31T19:03:07.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.611+0000 7faf93fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c0bc250 con 0x7faf8c156310 2023-08-31T19:03:07.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.612+0000 7faf9259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf8c0bba70 0x7faf8c0c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:07.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.612+0000 7faf9259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf8c0bba70 0x7faf8c0c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55884/0 (socket says 172.21.15.72:55884) 2023-08-31T19:03:07.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.612+0000 7faf9259c700 1 -- 172.21.15.72:0/2994396587 learned_addr learned my addr 172.21.15.72:0/2994396587 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:07.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.612+0000 7faf9159a700 1 --2- 172.21.15.72:0/2994396587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf8c156310 0x7faf8c0c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.612+0000 7faf9259c700 1 -- 172.21.15.72:0/2994396587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf8c156310 msgr2=0x7faf8c0c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.612+0000 7faf90d99700 1 -- 172.21.15.72:0/2994396587 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020281249 0 0) 0x7faf8c0c26b0 con 0x7faf8c135030 2023-08-31T19:03:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.612+0000 7faf9259c700 1 --2- 172.21.15.72:0/2994396587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf8c156310 0x7faf8c0c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.612+0000 7faf9259c700 1 -- 172.21.15.72:0/2994396587 >> v1:172.21.15.146:6789/0 conn(0x7faf8c135030 legacy=0x7faf8c155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.612+0000 7faf9259c700 1 -- 172.21.15.72:0/2994396587 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c0bbf70 con 0x7faf8c0bba70 2023-08-31T19:03:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.612+0000 7faf9259c700 1 --2- 172.21.15.72:0/2994396587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf8c0bba70 0x7faf8c0c2b40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7faf84009f20 tx=0x7faf84009840).ready entity=mon.0 client_cookie=afd565cd06c9929 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.613+0000 7faf90d99700 1 -- 172.21.15.72:0/2994396587 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8400e070 con 0x7faf8c0bba70 2023-08-31T19:03:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.613+0000 7faf90d99700 1 -- 172.21.15.72:0/2994396587 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8400b9d0 con 0x7faf8c0bba70 2023-08-31T19:03:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.613+0000 7faf90d99700 1 -- 172.21.15.72:0/2994396587 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8400bd50 con 0x7faf8c0bba70 2023-08-31T19:03:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.613+0000 7faf93fff700 1 -- 172.21.15.72:0/2994396587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf8c0bba70 msgr2=0x7faf8c0c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.613+0000 7faf93fff700 1 --2- 172.21.15.72:0/2994396587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf8c0bba70 0x7faf8c0c2b40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7faf84009f20 tx=0x7faf84009840).stop 2023-08-31T19:03:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.614+0000 7faf93fff700 1 -- 172.21.15.72:0/2994396587 shutdown_connections 2023-08-31T19:03:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.614+0000 7faf93fff700 1 --2- 172.21.15.72:0/2994396587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf8c0bba70 0x7faf8c0c2b40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.614+0000 7faf93fff700 1 --2- 172.21.15.72:0/2994396587 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf8c156310 0x7faf8c0c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.614+0000 7faf93fff700 1 -- 172.21.15.72:0/2994396587 >> 172.21.15.72:0/2994396587 conn(0x7faf8c0c6b10 msgr2=0x7faf8c0c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.614+0000 7faf93fff700 1 -- 172.21.15.72:0/2994396587 shutdown_connections 2023-08-31T19:03:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.614+0000 7faf93fff700 1 -- 172.21.15.72:0/2994396587 wait complete. 2023-08-31T19:03:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.615+0000 7faf93fff700 1 Processor -- start 2023-08-31T19:03:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.615+0000 7faf93fff700 1 -- start start 2023-08-31T19:03:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf93fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf8c0bba70 0x7faf8c0a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf93fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf8c135030 0x7faf8c14b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf93fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf8c156310 0x7faf8c1320a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf93fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c14b650 con 0x7faf8c0bba70 2023-08-31T19:03:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf93fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c0aa110 con 0x7faf8c156310 2023-08-31T19:03:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf93fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c0ac500 con 0x7faf8c135030 2023-08-31T19:03:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf91d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf8c0bba70 0x7faf8c0a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:07.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf91d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf8c0bba70 0x7faf8c0a9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55892/0 (socket says 172.21.15.72:55892) 2023-08-31T19:03:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf91d9b700 1 -- 172.21.15.72:0/3458749170 learned_addr learned my addr 172.21.15.72:0/3458749170 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf9159a700 1 --2- 172.21.15.72:0/3458749170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf8c135030 0x7faf8c14b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf9259c700 1 --2- 172.21.15.72:0/3458749170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf8c156310 0x7faf8c1320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf91d9b700 1 -- 172.21.15.72:0/3458749170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf8c135030 msgr2=0x7faf8c14b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf91d9b700 1 --2- 172.21.15.72:0/3458749170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf8c135030 0x7faf8c14b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf91d9b700 1 -- 172.21.15.72:0/3458749170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf8c156310 msgr2=0x7faf8c1320a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf91d9b700 1 --2- 172.21.15.72:0/3458749170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf8c156310 0x7faf8c1320a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.617+0000 7faf91d9b700 1 -- 172.21.15.72:0/3458749170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf84009ae0 con 0x7faf8c0bba70 2023-08-31T19:03:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.618+0000 7faf91d9b700 1 --2- 172.21.15.72:0/3458749170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf8c0bba70 0x7faf8c0a9aa0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7faf88001eb0 tx=0x7faf88007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.618+0000 7faf81ffb700 1 -- 172.21.15.72:0/3458749170 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8800f470 con 0x7faf8c0bba70 2023-08-31T19:03:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.618+0000 7faf81ffb700 1 -- 172.21.15.72:0/3458749170 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8800f5f0 con 0x7faf8c0bba70 2023-08-31T19:03:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.618+0000 7faf93fff700 1 -- 172.21.15.72:0/3458749170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8c0ac7e0 con 0x7faf8c0bba70 2023-08-31T19:03:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.618+0000 7faf81ffb700 1 -- 172.21.15.72:0/3458749170 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8800f9b0 con 0x7faf8c0bba70 2023-08-31T19:03:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.618+0000 7faf93fff700 1 -- 172.21.15.72:0/3458749170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8c1356e0 con 0x7faf8c0bba70 2023-08-31T19:03:07.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.619+0000 7faf93fff700 1 -- 172.21.15.72:0/3458749170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8c156ce0 con 0x7faf8c0bba70 2023-08-31T19:03:07.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.620+0000 7faf81ffb700 1 -- 172.21.15.72:0/3458749170 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) v1 ==== 75386+0+0 (secure 0 0 0) 0x7faf8800fd20 con 0x7faf8c0bba70 2023-08-31T19:03:07.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.621+0000 7faf81ffb700 1 --2- 172.21.15.72:0/3458749170 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf7005ef30 0x7faf700613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:07.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.621+0000 7faf81ffb700 1 -- 172.21.15.72:0/3458749170 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7123+0+0 (secure 0 0 0) 0x7faf88079980 con 0x7faf8c0bba70 2023-08-31T19:03:07.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.621+0000 7faf9159a700 1 -- 172.21.15.72:0/3458749170 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf7005ef30 msgr2=0x7faf700613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:07.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.621+0000 7faf9159a700 1 --2- 172.21.15.72:0/3458749170 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf7005ef30 0x7faf700613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:07.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.625+0000 7faf81ffb700 1 -- 172.21.15.72:0/3458749170 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faf8804a880 con 0x7faf8c0bba70 2023-08-31T19:03:07.651 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:07.650+0000 7feaf38ae680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:03:07.698 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:07.698+0000 7f5e0dd8f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:03:07.743 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:07.742+0000 7feaf38ae680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:03:07.790 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:07.790+0000 7f5e0dd8f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:03:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.822+0000 7faf9159a700 1 -- 172.21.15.72:0/3458749170 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf7005ef30 msgr2=0x7faf700613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.822+0000 7faf9159a700 1 --2- 172.21.15.72:0/3458749170 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf7005ef30 0x7faf700613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:03:07.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.849+0000 7faf93fff700 1 -- 172.21.15.72:0/3458749170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf8c06c6b0 con 0x7faf8c0bba70 2023-08-31T19:03:07.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.849+0000 7faf81ffb700 1 -- 172.21.15.72:0/3458749170 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4492 (secure 0 0 0) 0x7faf8804dea0 con 0x7faf8c0bba70 2023-08-31T19:03:07.850 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:07.850 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1085369530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1085369530},{"type":"v1","addr":"172.21.15.146:6834","nonce":1085369530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3852978729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3852978729},{"type":"v1","addr":"172.21.15.146:6835","nonce":3852978729}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/654480318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":654480318},{"type":"v1","addr":"172.21.15.72:6835","nonce":654480318}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:01:01.982648+0000","modified":"2023-08-31T19:01:05.003693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3101703480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3101703480},{"type":"v1","addr":"172.21.15.72:6837","nonce":3101703480}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-31T19:03:07.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.852+0000 7faf93fff700 1 -- 172.21.15.72:0/3458749170 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf7005ef30 msgr2=0x7faf700613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:07.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.852+0000 7faf93fff700 1 --2- 172.21.15.72:0/3458749170 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf7005ef30 0x7faf700613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:07.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.852+0000 7faf93fff700 1 -- 172.21.15.72:0/3458749170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf8c0bba70 msgr2=0x7faf8c0a9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:07.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.852+0000 7faf93fff700 1 --2- 172.21.15.72:0/3458749170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf8c0bba70 0x7faf8c0a9aa0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7faf88001eb0 tx=0x7faf88007c70).stop 2023-08-31T19:03:07.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.852+0000 7faf93fff700 1 -- 172.21.15.72:0/3458749170 shutdown_connections 2023-08-31T19:03:07.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.852+0000 7faf93fff700 1 --2- 172.21.15.72:0/3458749170 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf7005ef30 0x7faf700613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:07.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.852+0000 7faf93fff700 1 --2- 172.21.15.72:0/3458749170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf8c156310 0x7faf8c1320a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.852+0000 7faf93fff700 1 --2- 172.21.15.72:0/3458749170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf8c0bba70 0x7faf8c0a9aa0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.852+0000 7faf93fff700 1 --2- 172.21.15.72:0/3458749170 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf8c135030 0x7faf8c14b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:07.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.852+0000 7faf93fff700 1 -- 172.21.15.72:0/3458749170 >> 172.21.15.72:0/3458749170 conn(0x7faf8c0c6b10 msgr2=0x7faf8c0c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:07.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.852+0000 7faf93fff700 1 -- 172.21.15.72:0/3458749170 shutdown_connections 2023-08-31T19:03:07.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:07.852+0000 7faf93fff700 1 -- 172.21.15.72:0/3458749170 wait complete. 2023-08-31T19:03:07.856 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 23 2023-08-31T19:03:07.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:03:07.889 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:07.889+0000 7f5e0dd8f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:03:07.930 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:07.929+0000 7feaf38ae680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:03:08.019 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:08.018+0000 7feaf38ae680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:03:08.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.062+0000 7f736b3ff700 1 Processor -- start 2023-08-31T19:03:08.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.062+0000 7f736b3ff700 1 -- start start 2023-08-31T19:03:08.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.064+0000 7f736b3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7364154220 0x7f7364157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.064+0000 7f736b3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f73641588d0 0x7f73640c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.064+0000 7f736b3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73640c8c90 con 0x7f73640cb940 2023-08-31T19:03:08.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.064+0000 7f736b3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73640aa700 con 0x7f73641588d0 2023-08-31T19:03:08.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.064+0000 7f736b3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73640c5e10 con 0x7f7364154220 2023-08-31T19:03:08.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.064+0000 7f736999c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f73641588d0 0x7f73640c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:08.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.064+0000 7f736999c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f73641588d0 0x7f73640c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55908/0 (socket says 172.21.15.72:55908) 2023-08-31T19:03:08.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.064+0000 7f736999c700 1 -- 172.21.15.72:0/2370450340 learned_addr learned my addr 172.21.15.72:0/2370450340 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:08.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.064+0000 7f736899a700 1 --1- 172.21.15.72:0/2370450340 >> v1:172.21.15.72:6789/0 conn(0x7f73640cb940 0x7f73641581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34880/0 (socket says 172.21.15.72:34880) 2023-08-31T19:03:08.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.064+0000 7f736919b700 1 --2- 172.21.15.72:0/2370450340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7364154220 0x7f7364157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.064+0000 7f736999c700 1 -- 172.21.15.72:0/2370450340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7364154220 msgr2=0x7f7364157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:08.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.064+0000 7f736999c700 1 --2- 172.21.15.72:0/2370450340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7364154220 0x7f7364157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.064+0000 7f736999c700 1 -- 172.21.15.72:0/2370450340 >> v1:172.21.15.72:6789/0 conn(0x7f73640cb940 legacy=0x7f73641581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:08.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.064+0000 7f736999c700 1 -- 172.21.15.72:0/2370450340 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7364155610 con 0x7f73641588d0 2023-08-31T19:03:08.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.065+0000 7f736999c700 1 --2- 172.21.15.72:0/2370450340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73641588d0 0x7f73640c6540 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f735c009f20 tx=0x7f735c009840).ready entity=mon.0 client_cookie=556977f0a8de1b3a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.065+0000 7f735bfff700 1 -- 172.21.15.72:0/2370450340 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c00e070 con 0x7f73641588d0 2023-08-31T19:03:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.065+0000 7f735bfff700 1 -- 172.21.15.72:0/2370450340 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c00b9d0 con 0x7f73641588d0 2023-08-31T19:03:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.065+0000 7f735bfff700 1 -- 172.21.15.72:0/2370450340 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c00bd50 con 0x7f73641588d0 2023-08-31T19:03:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.065+0000 7f736b3ff700 1 -- 172.21.15.72:0/2370450340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73641588d0 msgr2=0x7f73640c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.065+0000 7f736b3ff700 1 --2- 172.21.15.72:0/2370450340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73641588d0 0x7f73640c6540 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f735c009f20 tx=0x7f735c009840).stop 2023-08-31T19:03:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.066+0000 7f736b3ff700 1 -- 172.21.15.72:0/2370450340 shutdown_connections 2023-08-31T19:03:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.066+0000 7f736b3ff700 1 --2- 172.21.15.72:0/2370450340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73641588d0 0x7f73640c6540 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.066+0000 7f736b3ff700 1 --2- 172.21.15.72:0/2370450340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7364154220 0x7f7364157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.066+0000 7f736b3ff700 1 -- 172.21.15.72:0/2370450340 >> 172.21.15.72:0/2370450340 conn(0x7f736405e870 msgr2=0x7f73640cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.066+0000 7f736b3ff700 1 -- 172.21.15.72:0/2370450340 shutdown_connections 2023-08-31T19:03:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.066+0000 7f736b3ff700 1 -- 172.21.15.72:0/2370450340 wait complete. 2023-08-31T19:03:08.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.067+0000 7f736b3ff700 1 Processor -- start 2023-08-31T19:03:08.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.067+0000 7f736b3ff700 1 -- start start 2023-08-31T19:03:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.068+0000 7f736b3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73640cb940 0x7f736414e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.068+0000 7f736b3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7364154220 0x7f7364150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.068+0000 7f736b3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73641588d0 0x7f7364150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.068+0000 7f736b3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73640aa840 con 0x7f73641588d0 2023-08-31T19:03:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.068+0000 7f736b3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73641565e0 con 0x7f73640cb940 2023-08-31T19:03:08.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.068+0000 7f736b3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73640c51a0 con 0x7f7364154220 2023-08-31T19:03:08.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.068+0000 7f736999c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73641588d0 0x7f7364150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:08.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.069+0000 7f736999c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73641588d0 0x7f7364150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55924/0 (socket says 172.21.15.72:55924) 2023-08-31T19:03:08.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.069+0000 7f736999c700 1 -- 172.21.15.72:0/3942269293 learned_addr learned my addr 172.21.15.72:0/3942269293 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:08.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.069+0000 7f736919b700 1 --2- 172.21.15.72:0/3942269293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73640cb940 0x7f736414e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:08.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.069+0000 7f736899a700 1 --2- 172.21.15.72:0/3942269293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7364154220 0x7f7364150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:08.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.069+0000 7f736999c700 1 -- 172.21.15.72:0/3942269293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7364154220 msgr2=0x7f7364150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:08.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.069+0000 7f736999c700 1 --2- 172.21.15.72:0/3942269293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7364154220 0x7f7364150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.069+0000 7f736999c700 1 -- 172.21.15.72:0/3942269293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73640cb940 msgr2=0x7f736414e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:08.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.069+0000 7f736999c700 1 --2- 172.21.15.72:0/3942269293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73640cb940 0x7f736414e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.069+0000 7f736999c700 1 -- 172.21.15.72:0/3942269293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c009ae0 con 0x7f73641588d0 2023-08-31T19:03:08.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.069+0000 7f736999c700 1 --2- 172.21.15.72:0/3942269293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73641588d0 0x7f7364150860 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f7364083570 tx=0x7f735c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:08.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.069+0000 7f73597fa700 1 -- 172.21.15.72:0/3942269293 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c013d30 con 0x7f73641588d0 2023-08-31T19:03:08.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.069+0000 7f73597fa700 1 -- 172.21.15.72:0/3942269293 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c013e90 con 0x7f73641588d0 2023-08-31T19:03:08.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.069+0000 7f736b3ff700 1 -- 172.21.15.72:0/3942269293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73641559d0 con 0x7f73641588d0 2023-08-31T19:03:08.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.070+0000 7f73597fa700 1 -- 172.21.15.72:0/3942269293 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c01e6b0 con 0x7f73641588d0 2023-08-31T19:03:08.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.070+0000 7f736b3ff700 1 -- 172.21.15.72:0/3942269293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7364155f90 con 0x7f73641588d0 2023-08-31T19:03:08.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.071+0000 7f736b3ff700 1 -- 172.21.15.72:0/3942269293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736414ea80 con 0x7f73641588d0 2023-08-31T19:03:08.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.071+0000 7f73597fa700 1 -- 172.21.15.72:0/3942269293 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f735c01eae0 con 0x7f73641588d0 2023-08-31T19:03:08.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.072+0000 7f73597fa700 1 --2- 172.21.15.72:0/3942269293 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f734805ef30 0x7f73480613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.072+0000 7f73597fa700 1 -- 172.21.15.72:0/3942269293 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f735c07c4f0 con 0x7f73641588d0 2023-08-31T19:03:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.072+0000 7f736919b700 1 -- 172.21.15.72:0/3942269293 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f734805ef30 msgr2=0x7f73480613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.072+0000 7f736919b700 1 --2- 172.21.15.72:0/3942269293 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f734805ef30 0x7f73480613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.076+0000 7f73597fa700 1 -- 172.21.15.72:0/3942269293 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f736414ea80 con 0x7f73641588d0 2023-08-31T19:03:08.085 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:08.085+0000 7f5e0dd8f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:03:08.159 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:08.158+0000 7feaf38ae680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:03:08.177 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:08.177+0000 7f5e0dd8f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:03:08.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.273+0000 7f736919b700 1 -- 172.21.15.72:0/3942269293 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f734805ef30 msgr2=0x7f73480613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:08.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.273+0000 7f736919b700 1 --2- 172.21.15.72:0/3942269293 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f734805ef30 0x7f73480613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:03:08.295 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:08.294+0000 7feaf38ae680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:03:08.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.306+0000 7f736b3ff700 1 -- 172.21.15.72:0/3942269293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f736414ea80 con 0x7f73641588d0 2023-08-31T19:03:08.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.307+0000 7f73597fa700 1 -- 172.21.15.72:0/3942269293 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f736414ea80 con 0x7f73641588d0 2023-08-31T19:03:08.307 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:08.307 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":23,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1085369530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1085369530},{"type":"v1","addr":"172.21.15.146:6834","nonce":1085369530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3852978729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3852978729},{"type":"v1","addr":"172.21.15.146:6835","nonce":3852978729}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/654480318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":654480318},{"type":"v1","addr":"172.21.15.72:6835","nonce":654480318}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:01:01.982648+0000","modified":"2023-08-31T19:01:05.003693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5781},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5781":{"gid":5781,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3101703480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3101703480},{"type":"v1","addr":"172.21.15.72:6837","nonce":3101703480}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-31T19:03:08.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.309+0000 7f736b3ff700 1 -- 172.21.15.72:0/3942269293 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f734805ef30 msgr2=0x7f73480613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:08.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.309+0000 7f736b3ff700 1 --2- 172.21.15.72:0/3942269293 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f734805ef30 0x7f73480613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.309+0000 7f736b3ff700 1 -- 172.21.15.72:0/3942269293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73641588d0 msgr2=0x7f7364150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.309+0000 7f736b3ff700 1 --2- 172.21.15.72:0/3942269293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73641588d0 0x7f7364150860 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f7364083570 tx=0x7f735c009840).stop 2023-08-31T19:03:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.309+0000 7f736b3ff700 1 -- 172.21.15.72:0/3942269293 shutdown_connections 2023-08-31T19:03:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.309+0000 7f736b3ff700 1 --2- 172.21.15.72:0/3942269293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73641588d0 0x7f7364150860 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.309+0000 7f736b3ff700 1 --2- 172.21.15.72:0/3942269293 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f734805ef30 0x7f73480613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.309+0000 7f736b3ff700 1 --2- 172.21.15.72:0/3942269293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73640cb940 0x7f736414e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.309+0000 7f736b3ff700 1 --2- 172.21.15.72:0/3942269293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7364154220 0x7f7364150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.309+0000 7f736b3ff700 1 -- 172.21.15.72:0/3942269293 >> 172.21.15.72:0/3942269293 conn(0x7f736405e870 msgr2=0x7f7364064200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.309+0000 7f736b3ff700 1 -- 172.21.15.72:0/3942269293 shutdown_connections 2023-08-31T19:03:08.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.309+0000 7f736b3ff700 1 -- 172.21.15.72:0/3942269293 wait complete. 2023-08-31T19:03:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 23 2023-08-31T19:03:08.327 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:03:08.331 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:08.331+0000 7f5e0dd8f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:03:08.468 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:08.467+0000 7f5e0dd8f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:03:08.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.524+0000 7f97961ff700 1 Processor -- start 2023-08-31T19:03:08.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.524+0000 7f97961ff700 1 -- start start 2023-08-31T19:03:08.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.525+0000 7f97961ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97900cb9b0 0x7f97901583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.525+0000 7f97961ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f97901588d0 0x7f9790154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.525+0000 7f97961ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97900c6120 con 0x7f9790154060 2023-08-31T19:03:08.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.525+0000 7f97961ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97900c1380 con 0x7f97900cb9b0 2023-08-31T19:03:08.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.525+0000 7f97961ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97900c5e10 con 0x7f97901588d0 2023-08-31T19:03:08.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.526+0000 7f978effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97900cb9b0 0x7f97901583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:08.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.526+0000 7f978effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97900cb9b0 0x7f97901583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55940/0 (socket says 172.21.15.72:55940) 2023-08-31T19:03:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.526+0000 7f978effd700 1 -- 172.21.15.72:0/810321342 learned_addr learned my addr 172.21.15.72:0/810321342 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.526+0000 7f978f7fe700 1 --1- 172.21.15.72:0/810321342 >> v1:172.21.15.72:6789/0 conn(0x7f9790154060 0x7f9790157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34882/0 (socket says 172.21.15.72:34882) 2023-08-31T19:03:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.526+0000 7f978ffff700 1 --2- 172.21.15.72:0/810321342 >> v2:172.21.15.146:3300/0 conn(0x7f97901588d0 0x7f9790154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.526+0000 7f978effd700 1 -- 172.21.15.72:0/810321342 >> v2:172.21.15.146:3300/0 conn(0x7f97901588d0 msgr2=0x7f9790154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.526+0000 7f978effd700 1 --2- 172.21.15.72:0/810321342 >> v2:172.21.15.146:3300/0 conn(0x7f97901588d0 0x7f9790154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.526+0000 7f978effd700 1 -- 172.21.15.72:0/810321342 >> v1:172.21.15.72:6789/0 conn(0x7f9790154060 legacy=0x7f9790157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:08.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.526+0000 7f978effd700 1 -- 172.21.15.72:0/810321342 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97900c0ae0 con 0x7f97900cb9b0 2023-08-31T19:03:08.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.526+0000 7f978ffff700 1 --2- 172.21.15.72:0/810321342 >> v2:172.21.15.146:3300/0 conn(0x7f97901588d0 0x7f9790154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:08.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.526+0000 7f978e7fc700 1 -- 172.21.15.72:0/810321342 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973996663 0 0) 0x7f97900c6120 con 0x7f9790154060 2023-08-31T19:03:08.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.526+0000 7f978effd700 1 --2- 172.21.15.72:0/810321342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97900cb9b0 0x7f97901583e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f97900844d0 tx=0x7f97840090f0).ready entity=mon.0 client_cookie=a479c5085b08c236 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:08.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.527+0000 7f978e7fc700 1 -- 172.21.15.72:0/810321342 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978400b600 con 0x7f97900cb9b0 2023-08-31T19:03:08.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.527+0000 7f978e7fc700 1 -- 172.21.15.72:0/810321342 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978400b760 con 0x7f97900cb9b0 2023-08-31T19:03:08.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.527+0000 7f978e7fc700 1 -- 172.21.15.72:0/810321342 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978400bae0 con 0x7f97900cb9b0 2023-08-31T19:03:08.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.527+0000 7f97961ff700 1 -- 172.21.15.72:0/810321342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97900cb9b0 msgr2=0x7f97901583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:08.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.527+0000 7f97961ff700 1 --2- 172.21.15.72:0/810321342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97900cb9b0 0x7f97901583e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f97900844d0 tx=0x7f97840090f0).stop 2023-08-31T19:03:08.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.527+0000 7f97961ff700 1 -- 172.21.15.72:0/810321342 shutdown_connections 2023-08-31T19:03:08.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.527+0000 7f97961ff700 1 --2- 172.21.15.72:0/810321342 >> v2:172.21.15.146:3300/0 conn(0x7f97901588d0 0x7f9790154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.527+0000 7f97961ff700 1 --2- 172.21.15.72:0/810321342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97900cb9b0 0x7f97901583e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.527+0000 7f97961ff700 1 -- 172.21.15.72:0/810321342 >> 172.21.15.72:0/810321342 conn(0x7f979005e870 msgr2=0x7f97900cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:08.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.527+0000 7f97961ff700 1 -- 172.21.15.72:0/810321342 shutdown_connections 2023-08-31T19:03:08.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.528+0000 7f97961ff700 1 -- 172.21.15.72:0/810321342 wait complete. 2023-08-31T19:03:08.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.529+0000 7f97961ff700 1 Processor -- start 2023-08-31T19:03:08.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.529+0000 7f97961ff700 1 -- start start 2023-08-31T19:03:08.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.530+0000 7f97961ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97900cb9b0 0x7f979014cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.530+0000 7f97961ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9790154060 0x7f97900ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.530+0000 7f97961ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97901588d0 0x7f97900ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.530+0000 7f97961ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9790150f60 con 0x7f97901588d0 2023-08-31T19:03:08.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.530+0000 7f97961ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97901511b0 con 0x7f9790154060 2023-08-31T19:03:08.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.530+0000 7f97961ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9790151490 con 0x7f97900cb9b0 2023-08-31T19:03:08.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.530+0000 7f978ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97901588d0 0x7f97900ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:08.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.530+0000 7f978ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97901588d0 0x7f97900ab590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55944/0 (socket says 172.21.15.72:55944) 2023-08-31T19:03:08.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.530+0000 7f978ffff700 1 -- 172.21.15.72:0/2415805725 learned_addr learned my addr 172.21.15.72:0/2415805725 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:08.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.531+0000 7f978f7fe700 1 --2- 172.21.15.72:0/2415805725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97900cb9b0 0x7f979014cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:08.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.531+0000 7f978effd700 1 --2- 172.21.15.72:0/2415805725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9790154060 0x7f97900ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:08.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.531+0000 7f978ffff700 1 -- 172.21.15.72:0/2415805725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97900cb9b0 msgr2=0x7f979014cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:08.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.531+0000 7f978ffff700 1 --2- 172.21.15.72:0/2415805725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97900cb9b0 0x7f979014cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.531+0000 7f978ffff700 1 -- 172.21.15.72:0/2415805725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9790154060 msgr2=0x7f97900ab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:08.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.531+0000 7f978ffff700 1 --2- 172.21.15.72:0/2415805725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9790154060 0x7f97900ab0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.531+0000 7f978ffff700 1 -- 172.21.15.72:0/2415805725 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9784009370 con 0x7f97901588d0 2023-08-31T19:03:08.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.531+0000 7f978ffff700 1 --2- 172.21.15.72:0/2415805725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97901588d0 0x7f97900ab590 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f978800d150 tx=0x7f9788009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:08.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.531+0000 7f97777fe700 1 -- 172.21.15.72:0/2415805725 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978800dc90 con 0x7f97901588d0 2023-08-31T19:03:08.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.531+0000 7f97777fe700 1 -- 172.21.15.72:0/2415805725 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978800f040 con 0x7f97901588d0 2023-08-31T19:03:08.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.531+0000 7f97961ff700 1 -- 172.21.15.72:0/2415805725 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9790151770 con 0x7f97901588d0 2023-08-31T19:03:08.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.531+0000 7f97777fe700 1 -- 172.21.15.72:0/2415805725 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880133f0 con 0x7f97901588d0 2023-08-31T19:03:08.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.532+0000 7f97961ff700 1 -- 172.21.15.72:0/2415805725 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9790151d30 con 0x7f97901588d0 2023-08-31T19:03:08.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.533+0000 7f97961ff700 1 -- 172.21.15.72:0/2415805725 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979006c6b0 con 0x7f97901588d0 2023-08-31T19:03:08.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.533+0000 7f97777fe700 1 -- 172.21.15.72:0/2415805725 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 21) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f97880137e0 con 0x7f97901588d0 2023-08-31T19:03:08.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.534+0000 7f97777fe700 1 --2- 172.21.15.72:0/2415805725 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f977c05ef30 0x7f977c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.534+0000 7f97777fe700 1 -- 172.21.15.72:0/2415805725 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f978807aa60 con 0x7f97901588d0 2023-08-31T19:03:08.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.534+0000 7f978f7fe700 1 -- 172.21.15.72:0/2415805725 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f977c05ef30 msgr2=0x7f977c0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:08.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.534+0000 7f978f7fe700 1 --2- 172.21.15.72:0/2415805725 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f977c05ef30 0x7f977c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:08.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.538+0000 7f97777fe700 1 -- 172.21.15.72:0/2415805725 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f978804b900 con 0x7f97901588d0 2023-08-31T19:03:08.646 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:08.645+0000 7feaf38ae680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:03:08.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.719+0000 7f97961ff700 1 -- 172.21.15.72:0/2415805725 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97900c0dc0 con 0x7f97901588d0 2023-08-31T19:03:08.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.720+0000 7f97777fe700 1 -- 172.21.15.72:0/2415805725 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18555 (secure 0 0 0) 0x7f978804ef20 con 0x7f97901588d0 2023-08-31T19:03:08.721 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:08.721 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":65,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:03:07.542280+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:01:00.413643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-31T19:01:00.966624+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":65,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]},{"pgid":"8.25","mappings":[{"from":0,"to":6}]},{"pgid":"8.2f","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/1369274110":"2023-09-01T19:01:15.623246+0000","172.21.15.72:0/1336378034":"2023-09-01T19:01:15.623246+0000","172.21.15.72:6833/143463":"2023-09-01T19:01:15.623246+0000","172.21.15.72:0/1927962454":"2023-09-01T19:01:15.623246+0000","172.21.15.72:6832/143463":"2023-09-01T19:01:15.623246+0000","172.21.15.72:0/1354492929":"2023-09-01T19:01:15.623246+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:03:08.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.722+0000 7f97961ff700 1 -- 172.21.15.72:0/2415805725 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f977c05ef30 msgr2=0x7f977c0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:08.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.722+0000 7f97961ff700 1 --2- 172.21.15.72:0/2415805725 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f977c05ef30 0x7f977c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:08.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.722+0000 7f97961ff700 1 -- 172.21.15.72:0/2415805725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97901588d0 msgr2=0x7f97900ab590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:08.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.722+0000 7f97961ff700 1 --2- 172.21.15.72:0/2415805725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97901588d0 0x7f97900ab590 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f978800d150 tx=0x7f9788009a50).stop 2023-08-31T19:03:08.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.722+0000 7f97961ff700 1 -- 172.21.15.72:0/2415805725 shutdown_connections 2023-08-31T19:03:08.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.722+0000 7f97961ff700 1 --2- 172.21.15.72:0/2415805725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97901588d0 0x7f97900ab590 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.722+0000 7f97961ff700 1 --2- 172.21.15.72:0/2415805725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f97900cb9b0 0x7f979014cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.722+0000 7f97961ff700 1 --2- 172.21.15.72:0/2415805725 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f977c05ef30 0x7f977c0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:08.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.722+0000 7f97961ff700 1 --2- 172.21.15.72:0/2415805725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9790154060 0x7f97900ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.722+0000 7f97961ff700 1 -- 172.21.15.72:0/2415805725 >> 172.21.15.72:0/2415805725 conn(0x7f979005e870 msgr2=0x7f9790063090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:08.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.722+0000 7f97961ff700 1 -- 172.21.15.72:0/2415805725 shutdown_connections 2023-08-31T19:03:08.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.722+0000 7f97961ff700 1 -- 172.21.15.72:0/2415805725 wait complete. 2023-08-31T19:03:08.734 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:08.733+0000 7feaf38ae680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:03:08.741 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T19:03:08.829 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:08.829+0000 7f5e0dd8f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:03:08.921 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:08.921+0000 7f5e0dd8f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:03:08.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.941+0000 7f12aa9ff700 1 Processor -- start 2023-08-31T19:03:08.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.941+0000 7f12aa9ff700 1 -- start start 2023-08-31T19:03:08.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.943+0000 7f12aa9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a4153ca0 0x7f12a4154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.943+0000 7f12aa9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f12a40c8ee0 0x7f12a4158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.943+0000 7f12aa9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a40c9450 con 0x7f12a40ca4f0 2023-08-31T19:03:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.943+0000 7f12aa9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a40c9730 con 0x7f12a40c8ee0 2023-08-31T19:03:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.943+0000 7f12aa9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40c9a10 con 0x7f12a4153ca0 2023-08-31T19:03:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.943+0000 7f12a8f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f12a40ca4f0 0x7f12a4063100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34898/0 (socket says 172.21.15.72:34898) 2023-08-31T19:03:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.943+0000 7f12a8f9c700 1 -- 172.21.15.72:0/848572802 learned_addr learned my addr 172.21.15.72:0/848572802 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.944+0000 7f12a37fe700 1 --2- 172.21.15.72:0/848572802 >> v2:172.21.15.146:3300/0 conn(0x7f12a40c8ee0 0x7f12a4158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.944+0000 7f12a3fff700 1 --2- 172.21.15.72:0/848572802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a4153ca0 0x7f12a4154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:08.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.944+0000 7f12a2ffd700 1 -- 172.21.15.72:0/848572802 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640165342 0 0) 0x7f12a40c9450 con 0x7f12a40ca4f0 2023-08-31T19:03:08.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.944+0000 7f12a2ffd700 1 -- 172.21.15.72:0/848572802 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f128c0033f0 con 0x7f12a40ca4f0 2023-08-31T19:03:08.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.944+0000 7f12a37fe700 1 -- 172.21.15.72:0/848572802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a4153ca0 msgr2=0x7f12a4154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:08.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.944+0000 7f12a37fe700 1 --2- 172.21.15.72:0/848572802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a4153ca0 0x7f12a4154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.944+0000 7f12a37fe700 1 -- 172.21.15.72:0/848572802 >> v1:172.21.15.72:6789/0 conn(0x7f12a40ca4f0 legacy=0x7f12a4063100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:08.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.944+0000 7f12a37fe700 1 -- 172.21.15.72:0/848572802 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a40c9cf0 con 0x7f12a40c8ee0 2023-08-31T19:03:08.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.944+0000 7f12a3fff700 1 --2- 172.21.15.72:0/848572802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a4153ca0 0x7f12a4154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:03:08.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.944+0000 7f12a37fe700 1 --2- 172.21.15.72:0/848572802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a40c8ee0 0x7f12a4158540 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f1298009760 tx=0x7f1298009060).ready entity=mon.1 client_cookie=447457a1d27a45ff server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:08.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.945+0000 7f12a2ffd700 1 -- 172.21.15.72:0/848572802 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129800d4a0 con 0x7f12a40c8ee0 2023-08-31T19:03:08.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.945+0000 7f12a2ffd700 1 -- 172.21.15.72:0/848572802 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129800d600 con 0x7f12a40c8ee0 2023-08-31T19:03:08.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.945+0000 7f12a2ffd700 1 -- 172.21.15.72:0/848572802 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129800d980 con 0x7f12a40c8ee0 2023-08-31T19:03:08.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.946+0000 7f12aa9ff700 1 -- 172.21.15.72:0/848572802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a40c8ee0 msgr2=0x7f12a4158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:08.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.946+0000 7f12aa9ff700 1 --2- 172.21.15.72:0/848572802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a40c8ee0 0x7f12a4158540 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f1298009760 tx=0x7f1298009060).stop 2023-08-31T19:03:08.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.946+0000 7f12aa9ff700 1 -- 172.21.15.72:0/848572802 shutdown_connections 2023-08-31T19:03:08.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.946+0000 7f12aa9ff700 1 --2- 172.21.15.72:0/848572802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a4153ca0 0x7f12a4154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.946+0000 7f12aa9ff700 1 --2- 172.21.15.72:0/848572802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a40c8ee0 0x7f12a4158540 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.946+0000 7f12aa9ff700 1 -- 172.21.15.72:0/848572802 >> 172.21.15.72:0/848572802 conn(0x7f12a40cadb0 msgr2=0x7f12a40cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:08.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.946+0000 7f12aa9ff700 1 -- 172.21.15.72:0/848572802 shutdown_connections 2023-08-31T19:03:08.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.946+0000 7f12aa9ff700 1 -- 172.21.15.72:0/848572802 wait complete. 2023-08-31T19:03:08.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.948+0000 7f12aa9ff700 1 Processor -- start 2023-08-31T19:03:08.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.948+0000 7f12aa9ff700 1 -- start start 2023-08-31T19:03:08.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.949+0000 7f12aa9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12a40c8ee0 0x7f12a40a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.949+0000 7f12aa9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a40ca4f0 0x7f12a40c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.949+0000 7f12aa9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a4153ca0 0x7f12a40aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:08.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.949+0000 7f12aa9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40aa470 con 0x7f12a40c8ee0 2023-08-31T19:03:08.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.949+0000 7f12aa9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40adee0 con 0x7f12a40ca4f0 2023-08-31T19:03:08.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.949+0000 7f12aa9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40ae1c0 con 0x7f12a4153ca0 2023-08-31T19:03:08.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.949+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12a40c8ee0 0x7f12a40a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:08.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.949+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12a40c8ee0 0x7f12a40a9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55962/0 (socket says 172.21.15.72:55962) 2023-08-31T19:03:08.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.949+0000 7f12a3fff700 1 -- 172.21.15.72:0/3566335193 learned_addr learned my addr 172.21.15.72:0/3566335193 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:08.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.950+0000 7f12a37fe700 1 --2- 172.21.15.72:0/3566335193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a40ca4f0 0x7f12a40c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:08.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.950+0000 7f12a8f9c700 1 --2- 172.21.15.72:0/3566335193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a4153ca0 0x7f12a40aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:08.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.950+0000 7f12a3fff700 1 -- 172.21.15.72:0/3566335193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a4153ca0 msgr2=0x7f12a40aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:08.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.950+0000 7f12a3fff700 1 --2- 172.21.15.72:0/3566335193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a4153ca0 0x7f12a40aeca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.950+0000 7f12a3fff700 1 -- 172.21.15.72:0/3566335193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a40ca4f0 msgr2=0x7f12a40c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:08.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.950+0000 7f12a3fff700 1 --2- 172.21.15.72:0/3566335193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a40ca4f0 0x7f12a40c2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:08.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.950+0000 7f12a3fff700 1 -- 172.21.15.72:0/3566335193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12940092a0 con 0x7f12a40c8ee0 2023-08-31T19:03:08.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.950+0000 7f12a3fff700 1 --2- 172.21.15.72:0/3566335193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12a40c8ee0 0x7f12a40a9f80 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f129400e980 tx=0x7f1294009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:08.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.950+0000 7f128bfff700 1 -- 172.21.15.72:0/3566335193 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129400ee70 con 0x7f12a40c8ee0 2023-08-31T19:03:08.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.950+0000 7f128bfff700 1 -- 172.21.15.72:0/3566335193 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129400c850 con 0x7f12a40c8ee0 2023-08-31T19:03:08.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.950+0000 7f128bfff700 1 -- 172.21.15.72:0/3566335193 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129400cbd0 con 0x7f12a40c8ee0 2023-08-31T19:03:08.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.950+0000 7f12aa9ff700 1 -- 172.21.15.72:0/3566335193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12980092a0 con 0x7f12a40c8ee0 2023-08-31T19:03:08.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.951+0000 7f12aa9ff700 1 -- 172.21.15.72:0/3566335193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a40ae780 con 0x7f12a40c8ee0 2023-08-31T19:03:08.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.952+0000 7f12aa9ff700 1 -- 172.21.15.72:0/3566335193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a40ae9a0 con 0x7f12a40c8ee0 2023-08-31T19:03:08.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.953+0000 7f128bfff700 1 -- 172.21.15.72:0/3566335193 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 22) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f129401b400 con 0x7f12a40c8ee0 2023-08-31T19:03:08.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.954+0000 7f128bfff700 1 -- 172.21.15.72:0/3566335193 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7267+0+0 (secure 0 0 0) 0x7f129407a610 con 0x7f12a40c8ee0 2023-08-31T19:03:08.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:08.959+0000 7f128bfff700 1 -- 172.21.15.72:0/3566335193 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f129404b710 con 0x7f12a40c8ee0 2023-08-31T19:03:09.004 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:09.004+0000 7f5d88891700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:09.004 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:09.004+0000 7f5d88891700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:09.005 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:09.004+0000 7f5d88891700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:09.005 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:09.004+0000 7f5d88891700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:09.005 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:09.004+0000 7f5d88891700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:09.005 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:09.004+0000 7f5d8588b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:09.006 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:09.004+0000 7f5d8588b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:09.006 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:09.004+0000 7f5d8588b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:09.006 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:09.004+0000 7f5d8588b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:09.006 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:09.004+0000 7f5d8588b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:09.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:09.186+0000 7f12aa9ff700 1 -- 172.21.15.72:0/3566335193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f12a406c6b0 con 0x7f12a40c8ee0 2023-08-31T19:03:09.926 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-08-31T19:03:09.926+0000 7f89d2ff7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T19:03:09.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:09.930+0000 7f128bfff700 1 -- 172.21.15.72:0/3566335193 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f129404ed30 con 0x7f12a40c8ee0 2023-08-31T19:03:09.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:09.933+0000 7f12aa9ff700 1 -- 172.21.15.72:0/3566335193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12a40c8ee0 msgr2=0x7f12a40a9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:09.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:09.933+0000 7f12aa9ff700 1 --2- 172.21.15.72:0/3566335193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12a40c8ee0 0x7f12a40a9f80 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f129400e980 tx=0x7f1294009060).stop 2023-08-31T19:03:09.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:09.933+0000 7f12aa9ff700 1 -- 172.21.15.72:0/3566335193 shutdown_connections 2023-08-31T19:03:09.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:09.933+0000 7f12aa9ff700 1 --2- 172.21.15.72:0/3566335193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a4153ca0 0x7f12a40aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:09.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:09.933+0000 7f12aa9ff700 1 --2- 172.21.15.72:0/3566335193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12a40c8ee0 0x7f12a40a9f80 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:09.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:09.933+0000 7f12aa9ff700 1 --2- 172.21.15.72:0/3566335193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a40ca4f0 0x7f12a40c2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:09.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:09.933+0000 7f12aa9ff700 1 -- 172.21.15.72:0/3566335193 >> 172.21.15.72:0/3566335193 conn(0x7f12a40cadb0 msgr2=0x7f12a4063010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:09.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:09.933+0000 7f12aa9ff700 1 -- 172.21.15.72:0/3566335193 shutdown_connections 2023-08-31T19:03:09.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:09.933+0000 7f12aa9ff700 1 -- 172.21.15.72:0/3566335193 wait complete. 2023-08-31T19:03:09.937 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T19:03:09.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T19:03:10.002 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-31T19:03:10.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.160+0000 7ff30e5ff700 1 Processor -- start 2023-08-31T19:03:10.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.160+0000 7ff30e5ff700 1 -- start start 2023-08-31T19:03:10.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.162+0000 7ff30e5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff308153e30 0x7ff308154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:10.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.162+0000 7ff30e5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3080c5cb0 0x7ff3080c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:10.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.162+0000 7ff30e5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3080bfd40 con 0x7ff3080630b0 2023-08-31T19:03:10.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.162+0000 7ff30e5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3080c6730 con 0x7ff308153e30 2023-08-31T19:03:10.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.162+0000 7ff30e5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3080bffe0 con 0x7ff3080c5cb0 2023-08-31T19:03:10.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.162+0000 7ff3077fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3080c5cb0 0x7ff3080c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:10.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.162+0000 7ff307fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff308153e30 0x7ff308154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:10.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.162+0000 7ff3077fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3080c5cb0 0x7ff3080c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:54480/0 (socket says 172.21.15.72:54480) 2023-08-31T19:03:10.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.162+0000 7ff3077fe700 1 -- 172.21.15.72:0/2158475168 learned_addr learned my addr 172.21.15.72:0/2158475168 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:10.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.163+0000 7ff307fff700 1 -- 172.21.15.72:0/2158475168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3080c5cb0 msgr2=0x7ff3080c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:10.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.163+0000 7ff307fff700 1 --2- 172.21.15.72:0/2158475168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3080c5cb0 0x7ff3080c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:10.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.163+0000 7ff307fff700 1 -- 172.21.15.72:0/2158475168 >> v1:172.21.15.146:6789/0 conn(0x7ff3080630b0 legacy=0x7ff308157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:10.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.163+0000 7ff307fff700 1 -- 172.21.15.72:0/2158475168 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3080c02c0 con 0x7ff308153e30 2023-08-31T19:03:10.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.163+0000 7ff3077fe700 1 --2- 172.21.15.72:0/2158475168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3080c5cb0 0x7ff3080c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:03:10.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.163+0000 7ff307fff700 1 --2- 172.21.15.72:0/2158475168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff308153e30 0x7ff308154210 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7ff2f8009760 tx=0x7ff2f8009060).ready entity=mon.1 client_cookie=8bcf3a10749f9539 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:10.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.163+0000 7ff306ffd700 1 -- 172.21.15.72:0/2158475168 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80090d0 con 0x7ff308153e30 2023-08-31T19:03:10.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.163+0000 7ff306ffd700 1 -- 172.21.15.72:0/2158475168 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f800f510 con 0x7ff308153e30 2023-08-31T19:03:10.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.163+0000 7ff306ffd700 1 -- 172.21.15.72:0/2158475168 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f800f890 con 0x7ff308153e30 2023-08-31T19:03:10.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.164+0000 7ff30e5ff700 1 -- 172.21.15.72:0/2158475168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff308153e30 msgr2=0x7ff308154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:10.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.164+0000 7ff30e5ff700 1 --2- 172.21.15.72:0/2158475168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff308153e30 0x7ff308154210 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7ff2f8009760 tx=0x7ff2f8009060).stop 2023-08-31T19:03:10.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.164+0000 7ff30e5ff700 1 -- 172.21.15.72:0/2158475168 shutdown_connections 2023-08-31T19:03:10.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.164+0000 7ff30e5ff700 1 --2- 172.21.15.72:0/2158475168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff308153e30 0x7ff308154210 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:10.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.164+0000 7ff30e5ff700 1 --2- 172.21.15.72:0/2158475168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3080c5cb0 0x7ff3080c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:10.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.164+0000 7ff30e5ff700 1 -- 172.21.15.72:0/2158475168 >> 172.21.15.72:0/2158475168 conn(0x7ff30805eb20 msgr2=0x7ff3080cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:10.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.164+0000 7ff30e5ff700 1 -- 172.21.15.72:0/2158475168 shutdown_connections 2023-08-31T19:03:10.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.164+0000 7ff30e5ff700 1 -- 172.21.15.72:0/2158475168 wait complete. 2023-08-31T19:03:10.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.166+0000 7ff30e5ff700 1 Processor -- start 2023-08-31T19:03:10.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.166+0000 7ff30e5ff700 1 -- start start 2023-08-31T19:03:10.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.167+0000 7ff30e5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3080630b0 0x7ff30813f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:10.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.167+0000 7ff30e5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3080c5cb0 0x7ff30813fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:10.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.167+0000 7ff30e5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff308153e30 0x7ff3081571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:10.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.167+0000 7ff30e5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3080c2e50 con 0x7ff3080c5cb0 2023-08-31T19:03:10.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.167+0000 7ff30e5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3080c39d0 con 0x7ff308153e30 2023-08-31T19:03:10.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.167+0000 7ff30e5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30813fa80 con 0x7ff3080630b0 2023-08-31T19:03:10.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff3077fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3080c5cb0 0x7ff30813fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:10.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff3077fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3080c5cb0 0x7ff30813fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56082/0 (socket says 172.21.15.72:56082) 2023-08-31T19:03:10.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff3077fe700 1 -- 172.21.15.72:0/1025168374 learned_addr learned my addr 172.21.15.72:0/1025168374 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:10.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff307fff700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3080630b0 0x7ff30813f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:10.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff30cb9c700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff308153e30 0x7ff3081571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:10.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff3077fe700 1 -- 172.21.15.72:0/1025168374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3080630b0 msgr2=0x7ff30813f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:10.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff3077fe700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3080630b0 0x7ff30813f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:10.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff3077fe700 1 -- 172.21.15.72:0/1025168374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff308153e30 msgr2=0x7ff3081571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:10.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff3077fe700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff308153e30 0x7ff3081571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:10.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff3077fe700 1 -- 172.21.15.72:0/1025168374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc009370 con 0x7ff3080c5cb0 2023-08-31T19:03:10.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff307fff700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3080630b0 0x7ff30813f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:10.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff30cb9c700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff308153e30 0x7ff3081571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:10.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff3077fe700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3080c5cb0 0x7ff30813fd20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7ff2fc00ea50 tx=0x7ff2fc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:10.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff2effff700 1 -- 172.21.15.72:0/1025168374 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc00c850 con 0x7ff3080c5cb0 2023-08-31T19:03:10.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff2effff700 1 -- 172.21.15.72:0/1025168374 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc00c9b0 con 0x7ff3080c5cb0 2023-08-31T19:03:10.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff30e5ff700 1 -- 172.21.15.72:0/1025168374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f80092a0 con 0x7ff3080c5cb0 2023-08-31T19:03:10.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.168+0000 7ff2effff700 1 -- 172.21.15.72:0/1025168374 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc00cd30 con 0x7ff3080c5cb0 2023-08-31T19:03:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.169+0000 7ff30e5ff700 1 -- 172.21.15.72:0/1025168374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3080c3380 con 0x7ff3080c5cb0 2023-08-31T19:03:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.170+0000 7ff30e5ff700 1 -- 172.21.15.72:0/1025168374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3080c3b40 con 0x7ff3080c5cb0 2023-08-31T19:03:10.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.170+0000 7ff2effff700 1 -- 172.21.15.72:0/1025168374 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 23) v1 ==== 75166+0+0 (secure 0 0 0) 0x7ff2fc012600 con 0x7ff3080c5cb0 2023-08-31T19:03:10.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.172+0000 7ff2effff700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff2f405ecf0 0x7ff2f40611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:10.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.172+0000 7ff2effff700 1 -- 172.21.15.72:0/1025168374 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 7353+0+0 (secure 0 0 0) 0x7ff2fc07a850 con 0x7ff3080c5cb0 2023-08-31T19:03:10.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.172+0000 7ff307fff700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff2f405ecf0 0x7ff2f40611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:10.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.172+0000 7ff307fff700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff2f405ecf0 0x7ff2f40611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7ff30806b740 tx=0x7ff2f8017000).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:10.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.176+0000 7ff2effff700 1 -- 172.21.15.72:0/1025168374 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff2fc04b940 con 0x7ff3080c5cb0 2023-08-31T19:03:10.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.387+0000 7ff30e5ff700 1 -- 172.21.15.72:0/1025168374 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff308062970 con 0x7ff3080c5cb0 2023-08-31T19:03:10.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.946+0000 7ff2effff700 1 -- 172.21.15.72:0/1025168374 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff2fc04ef60 con 0x7ff3080c5cb0 2023-08-31T19:03:10.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.949+0000 7ff30e5ff700 1 -- 172.21.15.72:0/1025168374 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff2f405ecf0 msgr2=0x7ff2f40611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:10.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.949+0000 7ff30e5ff700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff2f405ecf0 0x7ff2f40611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7ff30806b740 tx=0x7ff2f8017000).stop 2023-08-31T19:03:10.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.949+0000 7ff30e5ff700 1 -- 172.21.15.72:0/1025168374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3080c5cb0 msgr2=0x7ff30813fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:10.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.949+0000 7ff30e5ff700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3080c5cb0 0x7ff30813fd20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7ff2fc00ea50 tx=0x7ff2fc0090f0).stop 2023-08-31T19:03:10.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.949+0000 7ff30e5ff700 1 -- 172.21.15.72:0/1025168374 shutdown_connections 2023-08-31T19:03:10.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.949+0000 7ff30e5ff700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff2f405ecf0 0x7ff2f40611b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:10.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.949+0000 7ff30e5ff700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff308153e30 0x7ff3081571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:10.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.949+0000 7ff30e5ff700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3080630b0 0x7ff30813f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:10.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.949+0000 7ff30e5ff700 1 --2- 172.21.15.72:0/1025168374 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3080c5cb0 0x7ff30813fd20 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:10.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.949+0000 7ff30e5ff700 1 -- 172.21.15.72:0/1025168374 >> 172.21.15.72:0/1025168374 conn(0x7ff30805eb20 msgr2=0x7ff3080abc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:10.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.950+0000 7ff30e5ff700 1 -- 172.21.15.72:0/1025168374 shutdown_connections 2023-08-31T19:03:10.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:10.950+0000 7ff30e5ff700 1 -- 172.21.15.72:0/1025168374 wait complete. 2023-08-31T19:03:10.970 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T19:03:11.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.207+0000 7f6d521ff700 1 Processor -- start 2023-08-31T19:03:11.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.207+0000 7f6d521ff700 1 -- start start 2023-08-31T19:03:11.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.208+0000 7f6d521ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d4c1377c0 0x7f6d4c069460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:11.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.208+0000 7f6d521ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6d4c0c3ac0 0x7f6d4c069950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:11.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.208+0000 7f6d521ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4c0c13e0 con 0x7f6d4c1373e0 2023-08-31T19:03:11.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.208+0000 7f6d521ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4c0c19a0 con 0x7f6d4c0c3ac0 2023-08-31T19:03:11.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.208+0000 7f6d521ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c06a1d0 con 0x7f6d4c1377c0 2023-08-31T19:03:11.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.208+0000 7f6d4b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6d4c1373e0 0x7f6d4c0c33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34900/0 (socket says 172.21.15.72:34900) 2023-08-31T19:03:11.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.208+0000 7f6d4b7fe700 1 -- 172.21.15.72:0/2200791268 learned_addr learned my addr 172.21.15.72:0/2200791268 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:11.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.208+0000 7f6d4bfff700 1 --2- 172.21.15.72:0/2200791268 >> v2:172.21.15.72:3300/0 conn(0x7f6d4c0c3ac0 0x7f6d4c069950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:11.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.209+0000 7f6d4affd700 1 --2- 172.21.15.72:0/2200791268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d4c1377c0 0x7f6d4c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:11.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.209+0000 7f6d4a7fc700 1 -- 172.21.15.72:0/2200791268 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582214324 0 0) 0x7f6d4c0c13e0 con 0x7f6d4c1373e0 2023-08-31T19:03:11.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.209+0000 7f6d4a7fc700 1 -- 172.21.15.72:0/2200791268 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d340033f0 con 0x7f6d4c1373e0 2023-08-31T19:03:11.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.209+0000 7f6d4bfff700 1 -- 172.21.15.72:0/2200791268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d4c1377c0 msgr2=0x7f6d4c069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:11.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.209+0000 7f6d4bfff700 1 --2- 172.21.15.72:0/2200791268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d4c1377c0 0x7f6d4c069460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:11.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.209+0000 7f6d4bfff700 1 -- 172.21.15.72:0/2200791268 >> v1:172.21.15.72:6789/0 conn(0x7f6d4c1373e0 legacy=0x7f6d4c0c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:11.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.209+0000 7f6d4bfff700 1 -- 172.21.15.72:0/2200791268 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c06a4b0 con 0x7f6d4c0c3ac0 2023-08-31T19:03:11.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.209+0000 7f6d4bfff700 1 --2- 172.21.15.72:0/2200791268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d4c0c3ac0 0x7f6d4c069950 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f6d44009e60 tx=0x7f6d44009780).ready entity=mon.0 client_cookie=2bc9d92df27c0183 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:11.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.209+0000 7f6d4a7fc700 1 -- 172.21.15.72:0/2200791268 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4400e070 con 0x7f6d4c0c3ac0 2023-08-31T19:03:11.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.209+0000 7f6d4a7fc700 1 -- 172.21.15.72:0/2200791268 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4400bb60 con 0x7f6d4c0c3ac0 2023-08-31T19:03:11.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.209+0000 7f6d4a7fc700 1 -- 172.21.15.72:0/2200791268 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44012410 con 0x7f6d4c0c3ac0 2023-08-31T19:03:11.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.210+0000 7f6d521ff700 1 -- 172.21.15.72:0/2200791268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d4c0c3ac0 msgr2=0x7f6d4c069950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:11.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.210+0000 7f6d521ff700 1 --2- 172.21.15.72:0/2200791268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d4c0c3ac0 0x7f6d4c069950 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f6d44009e60 tx=0x7f6d44009780).stop 2023-08-31T19:03:11.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.210+0000 7f6d521ff700 1 -- 172.21.15.72:0/2200791268 shutdown_connections 2023-08-31T19:03:11.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.210+0000 7f6d521ff700 1 --2- 172.21.15.72:0/2200791268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d4c0c3ac0 0x7f6d4c069950 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:11.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.210+0000 7f6d521ff700 1 --2- 172.21.15.72:0/2200791268 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d4c1377c0 0x7f6d4c069460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:11.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.210+0000 7f6d521ff700 1 -- 172.21.15.72:0/2200791268 >> 172.21.15.72:0/2200791268 conn(0x7f6d4c062650 msgr2=0x7f6d4c062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:11.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.210+0000 7f6d521ff700 1 -- 172.21.15.72:0/2200791268 shutdown_connections 2023-08-31T19:03:11.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.210+0000 7f6d521ff700 1 -- 172.21.15.72:0/2200791268 wait complete. 2023-08-31T19:03:11.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.211+0000 7f6d521ff700 1 Processor -- start 2023-08-31T19:03:11.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.212+0000 7f6d521ff700 1 -- start start 2023-08-31T19:03:11.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d521ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d4c0c3ac0 0x7f6d4c0c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:11.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d521ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d4c1373e0 0x7f6d4c1679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d521ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d4c1377c0 0x7f6d4c0c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d521ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c1644f0 con 0x7f6d4c1373e0 2023-08-31T19:03:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d521ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0c0230 con 0x7f6d4c0c3ac0 2023-08-31T19:03:11.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d521ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0c0510 con 0x7f6d4c1377c0 2023-08-31T19:03:11.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d4affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d4c1373e0 0x7f6d4c1679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:11.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d4affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d4c1373e0 0x7f6d4c1679a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56106/0 (socket says 172.21.15.72:56106) 2023-08-31T19:03:11.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d4affd700 1 -- 172.21.15.72:0/3252242902 learned_addr learned my addr 172.21.15.72:0/3252242902 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:11.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d4b7fe700 1 --2- 172.21.15.72:0/3252242902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d4c0c3ac0 0x7f6d4c0c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:11.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d4bfff700 1 --2- 172.21.15.72:0/3252242902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d4c1377c0 0x7f6d4c0c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:11.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d4affd700 1 -- 172.21.15.72:0/3252242902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d4c1377c0 msgr2=0x7f6d4c0c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:11.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d4affd700 1 --2- 172.21.15.72:0/3252242902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d4c1377c0 0x7f6d4c0c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:11.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d4affd700 1 -- 172.21.15.72:0/3252242902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d4c0c3ac0 msgr2=0x7f6d4c0c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:11.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d4affd700 1 --2- 172.21.15.72:0/3252242902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d4c0c3ac0 0x7f6d4c0c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:11.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d4affd700 1 -- 172.21.15.72:0/3252242902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44009a20 con 0x7f6d4c1373e0 2023-08-31T19:03:11.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d4bfff700 1 --2- 172.21.15.72:0/3252242902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d4c1377c0 0x7f6d4c0c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:11.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.213+0000 7f6d4affd700 1 --2- 172.21.15.72:0/3252242902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d4c1373e0 0x7f6d4c1679a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f6d4000d890 tx=0x7f6d40008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:11.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.214+0000 7f6d337fe700 1 -- 172.21.15.72:0/3252242902 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40011590 con 0x7f6d4c1373e0 2023-08-31T19:03:11.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.214+0000 7f6d337fe700 1 -- 172.21.15.72:0/3252242902 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d400116f0 con 0x7f6d4c1373e0 2023-08-31T19:03:11.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.214+0000 7f6d337fe700 1 -- 172.21.15.72:0/3252242902 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40011a70 con 0x7f6d4c1373e0 2023-08-31T19:03:11.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.214+0000 7f6d521ff700 1 -- 172.21.15.72:0/3252242902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4c0c07f0 con 0x7f6d4c1373e0 2023-08-31T19:03:11.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.214+0000 7f6d521ff700 1 -- 172.21.15.72:0/3252242902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4c157790 con 0x7f6d4c1373e0 2023-08-31T19:03:11.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.215+0000 7f6d521ff700 1 -- 172.21.15.72:0/3252242902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4c06c6b0 con 0x7f6d4c1373e0 2023-08-31T19:03:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.216+0000 7f6d337fe700 1 -- 172.21.15.72:0/3252242902 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 23) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f6d40012420 con 0x7f6d4c1373e0 2023-08-31T19:03:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.216+0000 7f6d337fe700 1 --2- 172.21.15.72:0/3252242902 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6d3805ecf0 0x7f6d380611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.216+0000 7f6d337fe700 1 -- 172.21.15.72:0/3252242902 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 7353+0+0 (secure 0 0 0) 0x7f6d40079b70 con 0x7f6d4c1373e0 2023-08-31T19:03:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.217+0000 7f6d4b7fe700 1 --2- 172.21.15.72:0/3252242902 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6d3805ecf0 0x7f6d380611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.217+0000 7f6d4b7fe700 1 --2- 172.21.15.72:0/3252242902 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6d3805ecf0 0x7f6d380611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f6d3c005750 tx=0x7f6d3c009040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:11.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.221+0000 7f6d337fe700 1 -- 172.21.15.72:0/3252242902 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6d4004ac80 con 0x7f6d4c1373e0 2023-08-31T19:03:11.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.390+0000 7f6d521ff700 1 -- 172.21.15.72:0/3252242902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d4c0656e0 con 0x7f6d4c1373e0 2023-08-31T19:03:11.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.571+0000 7f6d337fe700 1 -- 172.21.15.72:0/3252242902 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6d40077640 con 0x7f6d4c1373e0 2023-08-31T19:03:11.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.952+0000 7f6d337fe700 1 -- 172.21.15.72:0/3252242902 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6d400729d0 con 0x7f6d4c1373e0 2023-08-31T19:03:11.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.958+0000 7f6d521ff700 1 -- 172.21.15.72:0/3252242902 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6d3805ecf0 msgr2=0x7f6d380611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:11.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.958+0000 7f6d521ff700 1 --2- 172.21.15.72:0/3252242902 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6d3805ecf0 0x7f6d380611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f6d3c005750 tx=0x7f6d3c009040).stop 2023-08-31T19:03:11.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.958+0000 7f6d521ff700 1 -- 172.21.15.72:0/3252242902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d4c1373e0 msgr2=0x7f6d4c1679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:11.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.958+0000 7f6d521ff700 1 --2- 172.21.15.72:0/3252242902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d4c1373e0 0x7f6d4c1679a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f6d4000d890 tx=0x7f6d40008040).stop 2023-08-31T19:03:11.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.959+0000 7f6d521ff700 1 -- 172.21.15.72:0/3252242902 shutdown_connections 2023-08-31T19:03:11.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.959+0000 7f6d521ff700 1 --2- 172.21.15.72:0/3252242902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d4c1377c0 0x7f6d4c0c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:11.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.959+0000 7f6d521ff700 1 --2- 172.21.15.72:0/3252242902 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6d3805ecf0 0x7f6d380611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:11.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.959+0000 7f6d521ff700 1 --2- 172.21.15.72:0/3252242902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d4c0c3ac0 0x7f6d4c0c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:11.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.959+0000 7f6d521ff700 1 --2- 172.21.15.72:0/3252242902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d4c1373e0 0x7f6d4c1679a0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:11.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.959+0000 7f6d521ff700 1 -- 172.21.15.72:0/3252242902 >> 172.21.15.72:0/3252242902 conn(0x7f6d4c062650 msgr2=0x7f6d4c1512f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:11.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.959+0000 7f6d521ff700 1 -- 172.21.15.72:0/3252242902 shutdown_connections 2023-08-31T19:03:11.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:11.960+0000 7f6d521ff700 1 -- 172.21.15.72:0/3252242902 wait complete. 2023-08-31T19:03:11.962 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-08-31T19:03:11.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T19:03:12.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.176+0000 7f1878dff700 1 Processor -- start 2023-08-31T19:03:12.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.176+0000 7f1878dff700 1 -- start start 2023-08-31T19:03:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.177+0000 7f1878dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1874154120 0x7f18740a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.177+0000 7f1878dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1874064db0 0x7f187415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:12.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.177+0000 7f1878dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18740aa620 con 0x7f1874154500 2023-08-31T19:03:12.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.177+0000 7f1878dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18740aa3a0 con 0x7f1874154120 2023-08-31T19:03:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.177+0000 7f1878dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18740c5450 con 0x7f1874064db0 2023-08-31T19:03:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.178+0000 7f187259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1874154120 0x7f18740a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.178+0000 7f187259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1874154120 0x7f18740a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56116/0 (socket says 172.21.15.72:56116) 2023-08-31T19:03:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.178+0000 7f187259c700 1 -- 172.21.15.72:0/3832100317 learned_addr learned my addr 172.21.15.72:0/3832100317 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.178+0000 7f1872d9d700 1 --2- 172.21.15.72:0/3832100317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1874064db0 0x7f187415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.178+0000 7f187259c700 1 -- 172.21.15.72:0/3832100317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1874064db0 msgr2=0x7f187415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.178+0000 7f187259c700 1 --2- 172.21.15.72:0/3832100317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1874064db0 0x7f187415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:12.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.178+0000 7f187259c700 1 -- 172.21.15.72:0/3832100317 >> v1:172.21.15.146:6789/0 conn(0x7f1874154500 legacy=0x7f18740646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:12.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.178+0000 7f187259c700 1 -- 172.21.15.72:0/3832100317 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18740c8050 con 0x7f1874154120 2023-08-31T19:03:12.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.178+0000 7f187259c700 1 --2- 172.21.15.72:0/3832100317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1874154120 0x7f18740a9eb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f1864006fd0 tx=0x7f18640090f0).ready entity=mon.0 client_cookie=7ed938ddd2e5d488 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.178+0000 7f187159a700 1 -- 172.21.15.72:0/3832100317 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186400b600 con 0x7f1874154120 2023-08-31T19:03:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.178+0000 7f187159a700 1 -- 172.21.15.72:0/3832100317 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186400b760 con 0x7f1874154120 2023-08-31T19:03:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.178+0000 7f187159a700 1 -- 172.21.15.72:0/3832100317 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186400bae0 con 0x7f1874154120 2023-08-31T19:03:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.179+0000 7f1878dff700 1 -- 172.21.15.72:0/3832100317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1874154120 msgr2=0x7f18740a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.179+0000 7f1878dff700 1 --2- 172.21.15.72:0/3832100317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1874154120 0x7f18740a9eb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f1864006fd0 tx=0x7f18640090f0).stop 2023-08-31T19:03:12.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.179+0000 7f1878dff700 1 -- 172.21.15.72:0/3832100317 shutdown_connections 2023-08-31T19:03:12.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.179+0000 7f1878dff700 1 --2- 172.21.15.72:0/3832100317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1874064db0 0x7f187415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:12.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.179+0000 7f1878dff700 1 --2- 172.21.15.72:0/3832100317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1874154120 0x7f18740a9eb0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:12.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.179+0000 7f1878dff700 1 -- 172.21.15.72:0/3832100317 >> 172.21.15.72:0/3832100317 conn(0x7f18740cb7e0 msgr2=0x7f18740c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:12.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.179+0000 7f1878dff700 1 -- 172.21.15.72:0/3832100317 shutdown_connections 2023-08-31T19:03:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.179+0000 7f1878dff700 1 -- 172.21.15.72:0/3832100317 wait complete. 2023-08-31T19:03:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.180+0000 7f1878dff700 1 Processor -- start 2023-08-31T19:03:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.181+0000 7f1878dff700 1 -- start start 2023-08-31T19:03:12.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.181+0000 7f1878dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1874064db0 0x7f18740c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:12.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.181+0000 7f1878dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1874154120 0x7f18740add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:12.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.181+0000 7f1878dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1874154500 0x7f187415a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:12.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.181+0000 7f1878dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1874164a20 con 0x7f1874154500 2023-08-31T19:03:12.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.182+0000 7f1878dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18741683d0 con 0x7f1874154120 2023-08-31T19:03:12.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.182+0000 7f1878dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18741686b0 con 0x7f1874064db0 2023-08-31T19:03:12.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.182+0000 7f1872d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1874154500 0x7f187415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:12.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.182+0000 7f1872d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1874154500 0x7f187415a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56124/0 (socket says 172.21.15.72:56124) 2023-08-31T19:03:12.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.182+0000 7f1872d9d700 1 -- 172.21.15.72:0/1103695623 learned_addr learned my addr 172.21.15.72:0/1103695623 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:12.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.182+0000 7f187259c700 1 --2- 172.21.15.72:0/1103695623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1874064db0 0x7f18740c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:12.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.182+0000 7f1871d9b700 1 --2- 172.21.15.72:0/1103695623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1874154120 0x7f18740add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:12.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.182+0000 7f1872d9d700 1 -- 172.21.15.72:0/1103695623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1874064db0 msgr2=0x7f18740c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:12.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.182+0000 7f1872d9d700 1 --2- 172.21.15.72:0/1103695623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1874064db0 0x7f18740c4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.182+0000 7f1872d9d700 1 -- 172.21.15.72:0/1103695623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1874154120 msgr2=0x7f18740add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.182+0000 7f1872d9d700 1 --2- 172.21.15.72:0/1103695623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1874154120 0x7f18740add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.182+0000 7f1872d9d700 1 -- 172.21.15.72:0/1103695623 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864009370 con 0x7f1874154500 2023-08-31T19:03:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.182+0000 7f1872d9d700 1 --2- 172.21.15.72:0/1103695623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1874154500 0x7f187415a290 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f186c007f30 tx=0x7f186c0098e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.183+0000 7f18627fc700 1 -- 172.21.15.72:0/1103695623 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c00eb90 con 0x7f1874154500 2023-08-31T19:03:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.183+0000 7f18627fc700 1 -- 172.21.15.72:0/1103695623 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c00ecf0 con 0x7f1874154500 2023-08-31T19:03:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.183+0000 7f1878dff700 1 -- 172.21.15.72:0/1103695623 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1874168990 con 0x7f1874154500 2023-08-31T19:03:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.183+0000 7f18627fc700 1 -- 172.21.15.72:0/1103695623 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c014610 con 0x7f1874154500 2023-08-31T19:03:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.183+0000 7f1878dff700 1 -- 172.21.15.72:0/1103695623 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1874167ff0 con 0x7f1874154500 2023-08-31T19:03:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.184+0000 7f1878dff700 1 -- 172.21.15.72:0/1103695623 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1874168e30 con 0x7f1874154500 2023-08-31T19:03:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.185+0000 7f18627fc700 1 -- 172.21.15.72:0/1103695623 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f186c014a00 con 0x7f1874154500 2023-08-31T19:03:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.185+0000 7f18627fc700 1 --2- 172.21.15.72:0/1103695623 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f185405ef30 0x7f18540613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.186+0000 7f18627fc700 1 -- 172.21.15.72:0/1103695623 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6857+0+0 (secure 0 0 0) 0x7f186c07a760 con 0x7f1874154500 2023-08-31T19:03:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.186+0000 7f187259c700 1 --2- 172.21.15.72:0/1103695623 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f185405ef30 0x7f18540613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.186+0000 7f187259c700 1 --2- 172.21.15.72:0/1103695623 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f185405ef30 0x7f18540613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f1864009130 tx=0x7f1864017000).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.189+0000 7f18627fc700 1 -- 172.21.15.72:0/1103695623 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f186c04b770 con 0x7f1874154500 2023-08-31T19:03:12.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.358+0000 7f1878dff700 1 -- 172.21.15.72:0/1103695623 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1874164b60 con 0x7f1874154500 2023-08-31T19:03:12.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.956+0000 7f18627fc700 1 -- 172.21.15.72:0/1103695623 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v70) v1 ==== 169+0+0 (secure 0 0 0) 0x7f186c00ee60 con 0x7f1874154500 2023-08-31T19:03:12.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.960+0000 7f1878dff700 1 -- 172.21.15.72:0/1103695623 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f185405ef30 msgr2=0x7f18540613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:12.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.960+0000 7f1878dff700 1 --2- 172.21.15.72:0/1103695623 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f185405ef30 0x7f18540613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f1864009130 tx=0x7f1864017000).stop 2023-08-31T19:03:12.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.960+0000 7f1878dff700 1 -- 172.21.15.72:0/1103695623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1874154500 msgr2=0x7f187415a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.960+0000 7f1878dff700 1 --2- 172.21.15.72:0/1103695623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1874154500 0x7f187415a290 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f186c007f30 tx=0x7f186c0098e0).stop 2023-08-31T19:03:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.960+0000 7f1878dff700 1 -- 172.21.15.72:0/1103695623 shutdown_connections 2023-08-31T19:03:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.960+0000 7f1878dff700 1 --2- 172.21.15.72:0/1103695623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1874154500 0x7f187415a290 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.960+0000 7f1878dff700 1 --2- 172.21.15.72:0/1103695623 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1874064db0 0x7f18740c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.960+0000 7f1878dff700 1 --2- 172.21.15.72:0/1103695623 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f185405ef30 0x7f18540613f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.960+0000 7f1878dff700 1 --2- 172.21.15.72:0/1103695623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1874154120 0x7f18740add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.960+0000 7f1878dff700 1 -- 172.21.15.72:0/1103695623 >> 172.21.15.72:0/1103695623 conn(0x7f18740cb7e0 msgr2=0x7f18740ca000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.961+0000 7f1878dff700 1 -- 172.21.15.72:0/1103695623 shutdown_connections 2023-08-31T19:03:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:12.961+0000 7f1878dff700 1 -- 172.21.15.72:0/1103695623 wait complete. 2023-08-31T19:03:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-08-31T19:03:12.990 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-31T19:03:13.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.181+0000 7f2b4f5ff700 1 Processor -- start 2023-08-31T19:03:13.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.182+0000 7f2b4f5ff700 1 -- start start 2023-08-31T19:03:13.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.183+0000 7f2b4f5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b48153ed0 0x7f2b481542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.183+0000 7f2b4f5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b480bdb30 0x7f2b48155200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.183+0000 7f2b4f5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b480a84b0 con 0x7f2b480663d0 2023-08-31T19:03:13.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.183+0000 7f2b4f5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b480c9410 con 0x7f2b48153ed0 2023-08-31T19:03:13.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.183+0000 7f2b4f5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b480c5310 con 0x7f2b480bdb30 2023-08-31T19:03:13.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.183+0000 7f2b4d39b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b48153ed0 0x7f2b481542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.183+0000 7f2b4d39b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b48153ed0 0x7f2b481542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33792/0 (socket says 172.21.15.72:33792) 2023-08-31T19:03:13.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.183+0000 7f2b4d39b700 1 -- 172.21.15.72:0/1755657261 learned_addr learned my addr 172.21.15.72:0/1755657261 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:13.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.183+0000 7f2b4cb9a700 1 --2- 172.21.15.72:0/1755657261 >> v2:172.21.15.146:3300/0 conn(0x7f2b480bdb30 0x7f2b48155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.184+0000 7f2b4d39b700 1 -- 172.21.15.72:0/1755657261 >> v2:172.21.15.146:3300/0 conn(0x7f2b480bdb30 msgr2=0x7f2b48155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:13.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.184+0000 7f2b4d39b700 1 --2- 172.21.15.72:0/1755657261 >> v2:172.21.15.146:3300/0 conn(0x7f2b480bdb30 0x7f2b48155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.184+0000 7f2b4d39b700 1 -- 172.21.15.72:0/1755657261 >> v1:172.21.15.146:6789/0 conn(0x7f2b480663d0 legacy=0x7f2b48067900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:13.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.184+0000 7f2b4d39b700 1 -- 172.21.15.72:0/1755657261 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b481556f0 con 0x7f2b48153ed0 2023-08-31T19:03:13.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.184+0000 7f2b4d39b700 1 --2- 172.21.15.72:0/1755657261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b48153ed0 0x7f2b481542b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f2b48065f00 tx=0x7f2b440090f0).ready entity=mon.0 client_cookie=6c552d15e6b301ba server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:13.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.184+0000 7f2b3ffff700 1 -- 172.21.15.72:0/1755657261 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4400b600 con 0x7f2b48153ed0 2023-08-31T19:03:13.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.184+0000 7f2b3ffff700 1 -- 172.21.15.72:0/1755657261 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4400b760 con 0x7f2b48153ed0 2023-08-31T19:03:13.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.184+0000 7f2b3ffff700 1 -- 172.21.15.72:0/1755657261 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4400bb00 con 0x7f2b48153ed0 2023-08-31T19:03:13.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.185+0000 7f2b4f5ff700 1 -- 172.21.15.72:0/1755657261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b48153ed0 msgr2=0x7f2b481542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:13.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.185+0000 7f2b4f5ff700 1 --2- 172.21.15.72:0/1755657261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b48153ed0 0x7f2b481542b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f2b48065f00 tx=0x7f2b440090f0).stop 2023-08-31T19:03:13.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.185+0000 7f2b4f5ff700 1 -- 172.21.15.72:0/1755657261 shutdown_connections 2023-08-31T19:03:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.185+0000 7f2b4f5ff700 1 --2- 172.21.15.72:0/1755657261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b48153ed0 0x7f2b481542b0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.185+0000 7f2b4f5ff700 1 --2- 172.21.15.72:0/1755657261 >> v2:172.21.15.146:3300/0 conn(0x7f2b480bdb30 0x7f2b48155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.185+0000 7f2b4f5ff700 1 -- 172.21.15.72:0/1755657261 >> 172.21.15.72:0/1755657261 conn(0x7f2b4805eb60 msgr2=0x7f2b480c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.185+0000 7f2b4f5ff700 1 -- 172.21.15.72:0/1755657261 shutdown_connections 2023-08-31T19:03:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.185+0000 7f2b4f5ff700 1 -- 172.21.15.72:0/1755657261 wait complete. 2023-08-31T19:03:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.186+0000 7f2b4f5ff700 1 Processor -- start 2023-08-31T19:03:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.186+0000 7f2b4f5ff700 1 -- start start 2023-08-31T19:03:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.187+0000 7f2b4f5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b480663d0 0x7f2b48152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.187+0000 7f2b4f5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b48153ed0 0x7f2b480ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.187+0000 7f2b4f5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b480ad570 0x7f2b480a86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.187+0000 7f2b4f5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480ae710 con 0x7f2b480663d0 2023-08-31T19:03:13.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.187+0000 7f2b4f5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480adb00 con 0x7f2b480ad570 2023-08-31T19:03:13.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.187+0000 7f2b4f5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480adde0 con 0x7f2b48153ed0 2023-08-31T19:03:13.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.187+0000 7f2b4d39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b480663d0 0x7f2b48152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b4d39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b480663d0 0x7f2b48152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33796/0 (socket says 172.21.15.72:33796) 2023-08-31T19:03:13.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b4d39b700 1 -- 172.21.15.72:0/156159190 learned_addr learned my addr 172.21.15.72:0/156159190 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:13.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b4db9c700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b480ad570 0x7f2b480a86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b4cb9a700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b48153ed0 0x7f2b480ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b4d39b700 1 -- 172.21.15.72:0/156159190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b48153ed0 msgr2=0x7f2b480ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:13.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b4d39b700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b48153ed0 0x7f2b480ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b4d39b700 1 -- 172.21.15.72:0/156159190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b480ad570 msgr2=0x7f2b480a86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:13.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b4d39b700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b480ad570 0x7f2b480a86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b4d39b700 1 -- 172.21.15.72:0/156159190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b44009370 con 0x7f2b480663d0 2023-08-31T19:03:13.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b4db9c700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b480ad570 0x7f2b480a86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:13.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b4cb9a700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b48153ed0 0x7f2b480ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:13.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b4d39b700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b480663d0 0x7f2b48152870 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f2b480c3470 tx=0x7f2b44017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:13.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b3d7fa700 1 -- 172.21.15.72:0/156159190 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4400bec0 con 0x7f2b480663d0 2023-08-31T19:03:13.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b3d7fa700 1 -- 172.21.15.72:0/156159190 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4400b8d0 con 0x7f2b480663d0 2023-08-31T19:03:13.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b4f5ff700 1 -- 172.21.15.72:0/156159190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b480ae0c0 con 0x7f2b480663d0 2023-08-31T19:03:13.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.188+0000 7f2b3d7fa700 1 -- 172.21.15.72:0/156159190 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44024470 con 0x7f2b480663d0 2023-08-31T19:03:13.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.189+0000 7f2b4f5ff700 1 -- 172.21.15.72:0/156159190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b48152d60 con 0x7f2b480663d0 2023-08-31T19:03:13.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.190+0000 7f2b4f5ff700 1 -- 172.21.15.72:0/156159190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4806c6b0 con 0x7f2b480663d0 2023-08-31T19:03:13.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.190+0000 7f2b3d7fa700 1 -- 172.21.15.72:0/156159190 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2b44021070 con 0x7f2b480663d0 2023-08-31T19:03:13.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.191+0000 7f2b3d7fa700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b2c05ef30 0x7f2b2c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.191+0000 7f2b3d7fa700 1 -- 172.21.15.72:0/156159190 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f2b4407bb20 con 0x7f2b480663d0 2023-08-31T19:03:13.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.192+0000 7f2b4cb9a700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b2c05ef30 0x7f2b2c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.192+0000 7f2b4cb9a700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b2c05ef30 0x7f2b2c0613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2b480c87c0 tx=0x7f2b38008040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:13.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.195+0000 7f2b3d7fa700 1 -- 172.21.15.72:0/156159190 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2b4404cc40 con 0x7f2b480663d0 2023-08-31T19:03:13.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.364+0000 7f2b4f5ff700 1 -- 172.21.15.72:0/156159190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f2b480ae9f0 con 0x7f2b480663d0 2023-08-31T19:03:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.369+0000 7f2b3d7fa700 1 -- 172.21.15.72:0/156159190 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v8) v1 ==== 120+0+0 (secure 0 0 0) 0x7f2b44029020 con 0x7f2b480663d0 2023-08-31T19:03:13.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.371+0000 7f2b4f5ff700 1 -- 172.21.15.72:0/156159190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b2c05ef30 msgr2=0x7f2b2c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:13.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.371+0000 7f2b4f5ff700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b2c05ef30 0x7f2b2c0613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2b480c87c0 tx=0x7f2b38008040).stop 2023-08-31T19:03:13.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.371+0000 7f2b4f5ff700 1 -- 172.21.15.72:0/156159190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b480663d0 msgr2=0x7f2b48152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:13.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.371+0000 7f2b4f5ff700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b480663d0 0x7f2b48152870 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f2b480c3470 tx=0x7f2b44017000).stop 2023-08-31T19:03:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.371+0000 7f2b4f5ff700 1 -- 172.21.15.72:0/156159190 shutdown_connections 2023-08-31T19:03:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.371+0000 7f2b4f5ff700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b2c05ef30 0x7f2b2c0613f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.371+0000 7f2b4f5ff700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b480ad570 0x7f2b480a86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.371+0000 7f2b4f5ff700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b480663d0 0x7f2b48152870 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.371+0000 7f2b4f5ff700 1 --2- 172.21.15.72:0/156159190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b48153ed0 0x7f2b480ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.371+0000 7f2b4f5ff700 1 -- 172.21.15.72:0/156159190 >> 172.21.15.72:0/156159190 conn(0x7f2b4805eb60 msgr2=0x7f2b48153680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.371+0000 7f2b4f5ff700 1 -- 172.21.15.72:0/156159190 shutdown_connections 2023-08-31T19:03:13.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.371+0000 7f2b4f5ff700 1 -- 172.21.15.72:0/156159190 wait complete. 2023-08-31T19:03:13.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-31T19:03:13.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.579+0000 7fcb1d3ff700 1 Processor -- start 2023-08-31T19:03:13.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.579+0000 7fcb1d3ff700 1 -- start start 2023-08-31T19:03:13.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb1d3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb18153e30 0x7fcb18154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb1d3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb180c5cb0 0x7fcb180c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb1d3ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb180630b0 0x7fcb18063530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb1d3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb18063a20 con 0x7fcb180c5cb0 2023-08-31T19:03:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb1d3ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb180bfd40 con 0x7fcb180630b0 2023-08-31T19:03:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb1d3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180c6730 con 0x7fcb18153e30 2023-08-31T19:03:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb167fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb180c5cb0 0x7fcb180c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb167fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb180c5cb0 0x7fcb180c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33798/0 (socket says 172.21.15.72:33798) 2023-08-31T19:03:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb167fc700 1 -- 172.21.15.72:0/4012605459 learned_addr learned my addr 172.21.15.72:0/4012605459 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:13.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb16ffd700 1 --2- 172.21.15.72:0/4012605459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb18153e30 0x7fcb18154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb177fe700 1 --2- 172.21.15.72:0/4012605459 >> v2:172.21.15.146:3300/0 conn(0x7fcb180630b0 0x7fcb18063530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb167fc700 1 -- 172.21.15.72:0/4012605459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb18153e30 msgr2=0x7fcb18154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:13.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb167fc700 1 --2- 172.21.15.72:0/4012605459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb18153e30 0x7fcb18154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb167fc700 1 -- 172.21.15.72:0/4012605459 >> v2:172.21.15.146:3300/0 conn(0x7fcb180630b0 msgr2=0x7fcb18063530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb167fc700 1 --2- 172.21.15.72:0/4012605459 >> v2:172.21.15.146:3300/0 conn(0x7fcb180630b0 0x7fcb18063530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb167fc700 1 -- 172.21.15.72:0/4012605459 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb180bffe0 con 0x7fcb180c5cb0 2023-08-31T19:03:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.581+0000 7fcb177fe700 1 --2- 172.21.15.72:0/4012605459 >> v2:172.21.15.146:3300/0 conn(0x7fcb180630b0 0x7fcb18063530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.582+0000 7fcb167fc700 1 --2- 172.21.15.72:0/4012605459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb180c5cb0 0x7fcb180c6130 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fcb18062910 tx=0x7fcb0c0090f0).ready entity=mon.0 client_cookie=91b9887e107c4f71 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.582+0000 7fcb15ffb700 1 -- 172.21.15.72:0/4012605459 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c00b600 con 0x7fcb180c5cb0 2023-08-31T19:03:13.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.582+0000 7fcb15ffb700 1 -- 172.21.15.72:0/4012605459 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c00b760 con 0x7fcb180c5cb0 2023-08-31T19:03:13.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.582+0000 7fcb15ffb700 1 -- 172.21.15.72:0/4012605459 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c00bb00 con 0x7fcb180c5cb0 2023-08-31T19:03:13.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.582+0000 7fcb1d3ff700 1 -- 172.21.15.72:0/4012605459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb180c5cb0 msgr2=0x7fcb180c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.582+0000 7fcb1d3ff700 1 --2- 172.21.15.72:0/4012605459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb180c5cb0 0x7fcb180c6130 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fcb18062910 tx=0x7fcb0c0090f0).stop 2023-08-31T19:03:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.582+0000 7fcb1d3ff700 1 -- 172.21.15.72:0/4012605459 shutdown_connections 2023-08-31T19:03:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.582+0000 7fcb1d3ff700 1 --2- 172.21.15.72:0/4012605459 >> v2:172.21.15.146:3300/0 conn(0x7fcb180630b0 0x7fcb18063530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.582+0000 7fcb1d3ff700 1 --2- 172.21.15.72:0/4012605459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb18153e30 0x7fcb18154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.582+0000 7fcb1d3ff700 1 --2- 172.21.15.72:0/4012605459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb180c5cb0 0x7fcb180c6130 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.582+0000 7fcb1d3ff700 1 -- 172.21.15.72:0/4012605459 >> 172.21.15.72:0/4012605459 conn(0x7fcb1805eb20 msgr2=0x7fcb180cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:13.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.583+0000 7fcb1d3ff700 1 -- 172.21.15.72:0/4012605459 shutdown_connections 2023-08-31T19:03:13.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.583+0000 7fcb1d3ff700 1 -- 172.21.15.72:0/4012605459 wait complete. 2023-08-31T19:03:13.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.584+0000 7fcb1d3ff700 1 Processor -- start 2023-08-31T19:03:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.584+0000 7fcb1d3ff700 1 -- start start 2023-08-31T19:03:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.585+0000 7fcb1d3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb180630b0 0x7fcb180b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.585+0000 7fcb1d3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb180c5cb0 0x7fcb180c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.585+0000 7fcb1d3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb18153e30 0x7fcb180c0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.585+0000 7fcb1d3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180ae130 con 0x7fcb18153e30 2023-08-31T19:03:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.585+0000 7fcb1d3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180b08f0 con 0x7fcb180c5cb0 2023-08-31T19:03:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.585+0000 7fcb1d3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180b0bd0 con 0x7fcb180630b0 2023-08-31T19:03:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.585+0000 7fcb177fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb18153e30 0x7fcb180c0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.585+0000 7fcb177fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb18153e30 0x7fcb180c0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33804/0 (socket says 172.21.15.72:33804) 2023-08-31T19:03:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.585+0000 7fcb177fe700 1 -- 172.21.15.72:0/2630475683 learned_addr learned my addr 172.21.15.72:0/2630475683 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:13.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.586+0000 7fcb167fc700 1 --2- 172.21.15.72:0/2630475683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb180c5cb0 0x7fcb180c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.586+0000 7fcb16ffd700 1 --2- 172.21.15.72:0/2630475683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb180630b0 0x7fcb180b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.586+0000 7fcb177fe700 1 -- 172.21.15.72:0/2630475683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb180630b0 msgr2=0x7fcb180b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:13.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.586+0000 7fcb177fe700 1 --2- 172.21.15.72:0/2630475683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb180630b0 0x7fcb180b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.586+0000 7fcb177fe700 1 -- 172.21.15.72:0/2630475683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb180c5cb0 msgr2=0x7fcb180c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:13.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.586+0000 7fcb177fe700 1 --2- 172.21.15.72:0/2630475683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb180c5cb0 0x7fcb180c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.586+0000 7fcb177fe700 1 -- 172.21.15.72:0/2630475683 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c009370 con 0x7fcb18153e30 2023-08-31T19:03:13.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.586+0000 7fcb177fe700 1 --2- 172.21.15.72:0/2630475683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb18153e30 0x7fcb180c0ad0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fcb1000cef0 tx=0x7fcb10007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:13.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.586+0000 7fcafeffd700 1 -- 172.21.15.72:0/2630475683 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1000ae00 con 0x7fcb18153e30 2023-08-31T19:03:13.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.586+0000 7fcafeffd700 1 -- 172.21.15.72:0/2630475683 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb10016400 con 0x7fcb18153e30 2023-08-31T19:03:13.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.586+0000 7fcafeffd700 1 -- 172.21.15.72:0/2630475683 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10016780 con 0x7fcb18153e30 2023-08-31T19:03:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.586+0000 7fcb1d3ff700 1 -- 172.21.15.72:0/2630475683 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb180ae310 con 0x7fcb18153e30 2023-08-31T19:03:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.586+0000 7fcb1d3ff700 1 -- 172.21.15.72:0/2630475683 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb180c40f0 con 0x7fcb18153e30 2023-08-31T19:03:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.588+0000 7fcb1d3ff700 1 -- 172.21.15.72:0/2630475683 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb180ae830 con 0x7fcb18153e30 2023-08-31T19:03:13.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.588+0000 7fcafeffd700 1 -- 172.21.15.72:0/2630475683 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fcb100203f0 con 0x7fcb18153e30 2023-08-31T19:03:13.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.589+0000 7fcafeffd700 1 --2- 172.21.15.72:0/2630475683 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb0405ef30 0x7fcb040613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.589+0000 7fcafeffd700 1 -- 172.21.15.72:0/2630475683 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fcb1007ab40 con 0x7fcb18153e30 2023-08-31T19:03:13.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.589+0000 7fcb16ffd700 1 --2- 172.21.15.72:0/2630475683 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb0405ef30 0x7fcb040613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.590+0000 7fcb16ffd700 1 --2- 172.21.15.72:0/2630475683 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb0405ef30 0x7fcb040613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fcb0800bb20 tx=0x7fcb08008040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:13.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.594+0000 7fcafeffd700 1 -- 172.21.15.72:0/2630475683 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcb180ae830 con 0x7fcb18153e30 2023-08-31T19:03:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.765+0000 7fcb1d3ff700 1 -- 172.21.15.72:0/2630475683 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcb180ae830 con 0x7fcb18153e30 2023-08-31T19:03:13.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.769+0000 7fcafeffd700 1 -- 172.21.15.72:0/2630475683 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcb180ae830 con 0x7fcb18153e30 2023-08-31T19:03:13.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.771+0000 7fcb1d3ff700 1 -- 172.21.15.72:0/2630475683 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb0405ef30 msgr2=0x7fcb040613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:13.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.771+0000 7fcb1d3ff700 1 --2- 172.21.15.72:0/2630475683 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb0405ef30 0x7fcb040613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fcb0800bb20 tx=0x7fcb08008040).stop 2023-08-31T19:03:13.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.771+0000 7fcb1d3ff700 1 -- 172.21.15.72:0/2630475683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb18153e30 msgr2=0x7fcb180c0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:13.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.771+0000 7fcb1d3ff700 1 --2- 172.21.15.72:0/2630475683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb18153e30 0x7fcb180c0ad0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7fcb1000cef0 tx=0x7fcb10007860).stop 2023-08-31T19:03:13.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.771+0000 7fcb1d3ff700 1 -- 172.21.15.72:0/2630475683 shutdown_connections 2023-08-31T19:03:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.771+0000 7fcb1d3ff700 1 --2- 172.21.15.72:0/2630475683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb18153e30 0x7fcb180c0ad0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.771+0000 7fcb1d3ff700 1 --2- 172.21.15.72:0/2630475683 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb180630b0 0x7fcb180b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.771+0000 7fcb1d3ff700 1 --2- 172.21.15.72:0/2630475683 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb0405ef30 0x7fcb040613f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.771+0000 7fcb1d3ff700 1 --2- 172.21.15.72:0/2630475683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb180c5cb0 0x7fcb180c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.771+0000 7fcb1d3ff700 1 -- 172.21.15.72:0/2630475683 >> 172.21.15.72:0/2630475683 conn(0x7fcb1805eb20 msgr2=0x7fcb180ab9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.771+0000 7fcb1d3ff700 1 -- 172.21.15.72:0/2630475683 shutdown_connections 2023-08-31T19:03:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.772+0000 7fcb1d3ff700 1 -- 172.21.15.72:0/2630475683 wait complete. 2023-08-31T19:03:13.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-08-31T19:03:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.978+0000 7fe863bff700 1 Processor -- start 2023-08-31T19:03:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.978+0000 7fe863bff700 1 -- start start 2023-08-31T19:03:13.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.979+0000 7fe863bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe85c1575b0 0x7fe85c157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.979+0000 7fe863bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe85c1581d0 0x7fe85c158630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.979+0000 7fe863bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85c158b20 con 0x7fe85c0c8c90 2023-08-31T19:03:13.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.979+0000 7fe863bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85c0c7620 con 0x7fe85c1581d0 2023-08-31T19:03:13.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.979+0000 7fe863bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c0c0830 con 0x7fe85c1575b0 2023-08-31T19:03:13.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.980+0000 7fe86219c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe85c0c8c90 0x7fe85c0c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40860/0 (socket says 172.21.15.72:40860) 2023-08-31T19:03:13.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.980+0000 7fe86219c700 1 -- 172.21.15.72:0/68544014 learned_addr learned my addr 172.21.15.72:0/68544014 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:13.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.980+0000 7fe86199b700 1 --2- 172.21.15.72:0/68544014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe85c1575b0 0x7fe85c157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.980+0000 7fe86119a700 1 --2- 172.21.15.72:0/68544014 >> v2:172.21.15.146:3300/0 conn(0x7fe85c1581d0 0x7fe85c158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.980+0000 7fe860999700 1 -- 172.21.15.72:0/68544014 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365287925 0 0) 0x7fe85c158b20 con 0x7fe85c0c8c90 2023-08-31T19:03:13.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.980+0000 7fe860999700 1 -- 172.21.15.72:0/68544014 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8480033f0 con 0x7fe85c0c8c90 2023-08-31T19:03:13.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.980+0000 7fe86199b700 1 -- 172.21.15.72:0/68544014 >> v2:172.21.15.146:3300/0 conn(0x7fe85c1581d0 msgr2=0x7fe85c158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:13.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.980+0000 7fe86199b700 1 --2- 172.21.15.72:0/68544014 >> v2:172.21.15.146:3300/0 conn(0x7fe85c1581d0 0x7fe85c158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.980+0000 7fe86199b700 1 -- 172.21.15.72:0/68544014 >> v1:172.21.15.72:6789/0 conn(0x7fe85c0c8c90 legacy=0x7fe85c0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:13.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.980+0000 7fe86199b700 1 -- 172.21.15.72:0/68544014 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c0c0b10 con 0x7fe85c1575b0 2023-08-31T19:03:13.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.980+0000 7fe86119a700 1 --2- 172.21.15.72:0/68544014 >> v2:172.21.15.146:3300/0 conn(0x7fe85c1581d0 0x7fe85c158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:03:13.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.980+0000 7fe86199b700 1 --2- 172.21.15.72:0/68544014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe85c1575b0 0x7fe85c157ce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe858006fd0 tx=0x7fe858006f40).ready entity=mon.2 client_cookie=36bd885c4f917bb0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:13.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.981+0000 7fe860999700 1 -- 172.21.15.72:0/68544014 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858005880 con 0x7fe85c1575b0 2023-08-31T19:03:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.981+0000 7fe860999700 1 -- 172.21.15.72:0/68544014 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8580059e0 con 0x7fe85c1575b0 2023-08-31T19:03:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.981+0000 7fe860999700 1 -- 172.21.15.72:0/68544014 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858005d60 con 0x7fe85c1575b0 2023-08-31T19:03:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.981+0000 7fe863bff700 1 -- 172.21.15.72:0/68544014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe85c1575b0 msgr2=0x7fe85c157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.981+0000 7fe863bff700 1 --2- 172.21.15.72:0/68544014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe85c1575b0 0x7fe85c157ce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe858006fd0 tx=0x7fe858006f40).stop 2023-08-31T19:03:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.981+0000 7fe863bff700 1 -- 172.21.15.72:0/68544014 shutdown_connections 2023-08-31T19:03:13.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.981+0000 7fe863bff700 1 --2- 172.21.15.72:0/68544014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe85c1575b0 0x7fe85c157ce0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.981+0000 7fe863bff700 1 --2- 172.21.15.72:0/68544014 >> v2:172.21.15.146:3300/0 conn(0x7fe85c1581d0 0x7fe85c158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.981+0000 7fe863bff700 1 -- 172.21.15.72:0/68544014 >> 172.21.15.72:0/68544014 conn(0x7fe85c05e870 msgr2=0x7fe85c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.981+0000 7fe863bff700 1 -- 172.21.15.72:0/68544014 shutdown_connections 2023-08-31T19:03:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.981+0000 7fe863bff700 1 -- 172.21.15.72:0/68544014 wait complete. 2023-08-31T19:03:13.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.983+0000 7fe863bff700 1 Processor -- start 2023-08-31T19:03:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.983+0000 7fe863bff700 1 -- start start 2023-08-31T19:03:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.984+0000 7fe863bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe85c0c8c90 0x7fe85c0afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.984+0000 7fe863bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe85c1575b0 0x7fe85c148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.984+0000 7fe863bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe85c1581d0 0x7fe85c155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.984+0000 7fe863bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c0b0190 con 0x7fe85c1581d0 2023-08-31T19:03:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.984+0000 7fe863bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c0ae1e0 con 0x7fe85c1575b0 2023-08-31T19:03:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.984+0000 7fe863bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c0ae4c0 con 0x7fe85c0c8c90 2023-08-31T19:03:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.984+0000 7fe86219c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe85c1581d0 0x7fe85c155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.984+0000 7fe86219c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe85c1581d0 0x7fe85c155540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33806/0 (socket says 172.21.15.72:33806) 2023-08-31T19:03:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.984+0000 7fe86219c700 1 -- 172.21.15.72:0/2110037910 learned_addr learned my addr 172.21.15.72:0/2110037910 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.984+0000 7fe86219c700 1 -- 172.21.15.72:0/2110037910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe85c0c8c90 msgr2=0x7fe85c0afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.984+0000 7fe86219c700 1 --2- 172.21.15.72:0/2110037910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe85c0c8c90 0x7fe85c0afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.984+0000 7fe86219c700 1 -- 172.21.15.72:0/2110037910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe85c1575b0 msgr2=0x7fe85c148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.984+0000 7fe86219c700 1 --2- 172.21.15.72:0/2110037910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe85c1575b0 0x7fe85c148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.984+0000 7fe86219c700 1 -- 172.21.15.72:0/2110037910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c0092a0 con 0x7fe85c1581d0 2023-08-31T19:03:13.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.985+0000 7fe86219c700 1 --2- 172.21.15.72:0/2110037910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe85c1581d0 0x7fe85c155540 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fe854005ad0 tx=0x7fe854001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:13.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.985+0000 7fe851ffb700 1 -- 172.21.15.72:0/2110037910 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854005d30 con 0x7fe85c1581d0 2023-08-31T19:03:13.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.985+0000 7fe851ffb700 1 -- 172.21.15.72:0/2110037910 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe854005e90 con 0x7fe85c1581d0 2023-08-31T19:03:13.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.985+0000 7fe863bff700 1 -- 172.21.15.72:0/2110037910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe858009250 con 0x7fe85c1581d0 2023-08-31T19:03:13.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.985+0000 7fe851ffb700 1 -- 172.21.15.72:0/2110037910 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854007320 con 0x7fe85c1581d0 2023-08-31T19:03:13.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.985+0000 7fe863bff700 1 -- 172.21.15.72:0/2110037910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85c0aea80 con 0x7fe85c1581d0 2023-08-31T19:03:13.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.986+0000 7fe863bff700 1 -- 172.21.15.72:0/2110037910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85c06c6b0 con 0x7fe85c1581d0 2023-08-31T19:03:13.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.987+0000 7fe851ffb700 1 -- 172.21.15.72:0/2110037910 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe854007710 con 0x7fe85c1581d0 2023-08-31T19:03:13.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.987+0000 7fe851ffb700 1 --2- 172.21.15.72:0/2110037910 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe84005ef30 0x7fe8400613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.988+0000 7fe851ffb700 1 -- 172.21.15.72:0/2110037910 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fe85407a170 con 0x7fe85c1581d0 2023-08-31T19:03:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.988+0000 7fe86199b700 1 --2- 172.21.15.72:0/2110037910 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe84005ef30 0x7fe8400613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.988+0000 7fe86199b700 1 --2- 172.21.15.72:0/2110037910 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe84005ef30 0x7fe8400613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe858006fa0 tx=0x7fe858015000).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:13.991+0000 7fe851ffb700 1 -- 172.21.15.72:0/2110037910 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe85404b350 con 0x7fe85c1581d0 2023-08-31T19:03:14.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:14.223+0000 7fe863bff700 1 -- 172.21.15.72:0/2110037910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7fe85c0cb6b0 con 0x7fe85c1581d0 2023-08-31T19:03:14.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:14.962+0000 7fe851ffb700 1 -- 172.21.15.72:0/2110037910 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v548) v1 ==== 154+0+0 (secure 0 0 0) 0x7fe85404e970 con 0x7fe85c1581d0 2023-08-31T19:03:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:14.965+0000 7fe863bff700 1 -- 172.21.15.72:0/2110037910 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe84005ef30 msgr2=0x7fe8400613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:14.965+0000 7fe863bff700 1 --2- 172.21.15.72:0/2110037910 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe84005ef30 0x7fe8400613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe858006fa0 tx=0x7fe858015000).stop 2023-08-31T19:03:14.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:14.965+0000 7fe863bff700 1 -- 172.21.15.72:0/2110037910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe85c1581d0 msgr2=0x7fe85c155540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:14.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:14.965+0000 7fe863bff700 1 --2- 172.21.15.72:0/2110037910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe85c1581d0 0x7fe85c155540 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fe854005ad0 tx=0x7fe854001650).stop 2023-08-31T19:03:14.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:14.965+0000 7fe863bff700 1 -- 172.21.15.72:0/2110037910 shutdown_connections 2023-08-31T19:03:14.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:14.965+0000 7fe863bff700 1 --2- 172.21.15.72:0/2110037910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe85c1581d0 0x7fe85c155540 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:14.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:14.965+0000 7fe863bff700 1 --2- 172.21.15.72:0/2110037910 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe85c0c8c90 0x7fe85c0afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:14.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:14.965+0000 7fe863bff700 1 --2- 172.21.15.72:0/2110037910 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe84005ef30 0x7fe8400613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:14.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:14.965+0000 7fe863bff700 1 --2- 172.21.15.72:0/2110037910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe85c1575b0 0x7fe85c148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:14.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:14.965+0000 7fe863bff700 1 -- 172.21.15.72:0/2110037910 >> 172.21.15.72:0/2110037910 conn(0x7fe85c05e870 msgr2=0x7fe85c0a9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:14.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:14.965+0000 7fe863bff700 1 -- 172.21.15.72:0/2110037910 shutdown_connections 2023-08-31T19:03:14.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:14.965+0000 7fe863bff700 1 -- 172.21.15.72:0/2110037910 wait complete. 2023-08-31T19:03:14.985 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-08-31T19:03:14.986 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-08-31T19:03:14.986 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-31T19:03:14.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-08-31T19:03:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.178+0000 7f142d9ff700 1 Processor -- start 2023-08-31T19:03:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.179+0000 7f142d9ff700 1 -- start start 2023-08-31T19:03:15.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.180+0000 7f142d9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f14280c46c0 0x7f142815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:15.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.180+0000 7f142d9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14280bef10 con 0x7f14280bea80 2023-08-31T19:03:15.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.180+0000 7f142d9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14280bf1f0 con 0x7f14280c5fb0 2023-08-31T19:03:15.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.180+0000 7f142d9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1428154690 con 0x7f14280c46c0 2023-08-31T19:03:15.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.180+0000 7f14267fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f14280bea80 0x7f14280c3fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40862/0 (socket says 172.21.15.72:40862) 2023-08-31T19:03:15.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.180+0000 7f14267fc700 1 -- 172.21.15.72:0/1422864483 learned_addr learned my addr 172.21.15.72:0/1422864483 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:15.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.180+0000 7f14277fe700 1 --2- 172.21.15.72:0/1422864483 >> v2:172.21.15.146:3300/0 conn(0x7f14280c46c0 0x7f142815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:15.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.180+0000 7f1425ffb700 1 -- 172.21.15.72:0/1422864483 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368615811 0 0) 0x7f14280bef10 con 0x7f14280bea80 2023-08-31T19:03:15.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.180+0000 7f1425ffb700 1 -- 172.21.15.72:0/1422864483 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14100033f0 con 0x7f14280bea80 2023-08-31T19:03:15.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f1425ffb700 1 -- 172.21.15.72:0/1422864483 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2545484366 0 0) 0x7f14100033f0 con 0x7f14280bea80 2023-08-31T19:03:15.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f1425ffb700 1 -- 172.21.15.72:0/1422864483 >> v2:172.21.15.146:3300/0 conn(0x7f14280c46c0 msgr2=0x7f142815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:15.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f1425ffb700 1 --2- 172.21.15.72:0/1422864483 >> v2:172.21.15.146:3300/0 conn(0x7f14280c46c0 0x7f142815f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:15.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f1425ffb700 1 -- 172.21.15.72:0/1422864483 >> v1:172.21.15.146:6789/0 conn(0x7f14280c5fb0 legacy=0x7f14280be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:15.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f1425ffb700 1 -- 172.21.15.72:0/1422864483 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14280bf4d0 con 0x7f14280bea80 2023-08-31T19:03:15.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f1425ffb700 1 -- 172.21.15.72:0/1422864483 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f141c001470 con 0x7f14280bea80 2023-08-31T19:03:15.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f1425ffb700 1 -- 172.21.15.72:0/1422864483 >> v1:172.21.15.72:6789/0 conn(0x7f14280bea80 legacy=0x7f14280c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:15.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f1425ffb700 1 --2- 172.21.15.72:0/1422864483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14100038e0 0x7f1410003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:15.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f1425ffb700 1 --2- 172.21.15.72:0/1422864483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410004690 0x7f1410004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:15.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f1425ffb700 1 --2- 172.21.15.72:0/1422864483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1410005000 0x7f141000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:15.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f1425ffb700 1 -- 172.21.15.72:0/1422864483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1428154690 con 0x7f1410005000 2023-08-31T19:03:15.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f1425ffb700 1 -- 172.21.15.72:0/1422864483 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141000bf60 con 0x7f1410004690 2023-08-31T19:03:15.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f1425ffb700 1 -- 172.21.15.72:0/1422864483 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141000c0f0 con 0x7f14100038e0 2023-08-31T19:03:15.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f14277fe700 1 --2- 172.21.15.72:0/1422864483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1410005000 0x7f141000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:15.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f14267fc700 1 --2- 172.21.15.72:0/1422864483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410004690 0x7f1410004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:15.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.181+0000 7f1426ffd700 1 --2- 172.21.15.72:0/1422864483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14100038e0 0x7f1410003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:15.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.182+0000 7f14277fe700 1 -- 172.21.15.72:0/1422864483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14100038e0 msgr2=0x7f1410003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:15.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.182+0000 7f14277fe700 1 --2- 172.21.15.72:0/1422864483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f14100038e0 0x7f1410003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:15.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.182+0000 7f14277fe700 1 -- 172.21.15.72:0/1422864483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410004690 msgr2=0x7f1410004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:15.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.182+0000 7f14277fe700 1 --2- 172.21.15.72:0/1422864483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410004690 0x7f1410004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:15.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.182+0000 7f14277fe700 1 -- 172.21.15.72:0/1422864483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14100033f0 con 0x7f1410005000 2023-08-31T19:03:15.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.182+0000 7f14267fc700 1 --2- 172.21.15.72:0/1422864483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410004690 0x7f1410004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:15.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.182+0000 7f14277fe700 1 -- 172.21.15.72:0/1422864483 reap_dead start 2023-08-31T19:03:15.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.182+0000 7f14277fe700 1 --2- 172.21.15.72:0/1422864483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1410005000 0x7f141000b8e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f14280c34a0 tx=0x7f142000b040).ready entity=mon.0 client_cookie=4a46f4f3c7dcbbac server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:15.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.182+0000 7f1425ffb700 1 -- 172.21.15.72:0/1422864483 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420017070 con 0x7f1410005000 2023-08-31T19:03:15.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.182+0000 7f1425ffb700 1 -- 172.21.15.72:0/1422864483 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142000f040 con 0x7f1410005000 2023-08-31T19:03:15.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.182+0000 7f1425ffb700 1 -- 172.21.15.72:0/1422864483 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142000ece0 con 0x7f1410005000 2023-08-31T19:03:15.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.182+0000 7f142d9ff700 1 -- 172.21.15.72:0/1422864483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1410005000 msgr2=0x7f141000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:15.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.182+0000 7f142d9ff700 1 --2- 172.21.15.72:0/1422864483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1410005000 0x7f141000b8e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f14280c34a0 tx=0x7f142000b040).stop 2023-08-31T19:03:15.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.183+0000 7f142d9ff700 1 -- 172.21.15.72:0/1422864483 shutdown_connections 2023-08-31T19:03:15.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.183+0000 7f142d9ff700 1 --2- 172.21.15.72:0/1422864483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1410005000 0x7f141000b8e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:15.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.183+0000 7f142d9ff700 1 -- 172.21.15.72:0/1422864483 >> 172.21.15.72:0/1422864483 conn(0x7f1428082f60 msgr2=0x7f142805e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:15.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.183+0000 7f142d9ff700 1 -- 172.21.15.72:0/1422864483 shutdown_connections 2023-08-31T19:03:15.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.183+0000 7f142d9ff700 1 -- 172.21.15.72:0/1422864483 wait complete. 2023-08-31T19:03:15.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.184+0000 7f142d9ff700 1 Processor -- start 2023-08-31T19:03:15.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.184+0000 7f142d9ff700 1 -- start start 2023-08-31T19:03:15.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.185+0000 7f142d9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410005000 0x7f14281552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:15.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.185+0000 7f142d9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14280a86e0 0x7f14280acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:15.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.185+0000 7f142d9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1428152ec0 0x7f1428064980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:15.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.185+0000 7f142d9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14280a8b60 con 0x7f14280a86e0 2023-08-31T19:03:15.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.185+0000 7f142d9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14280ad030 con 0x7f1410005000 2023-08-31T19:03:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.185+0000 7f142d9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14280ad2f0 con 0x7f1428152ec0 2023-08-31T19:03:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.185+0000 7f14267fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14280a86e0 0x7f14280acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.185+0000 7f14267fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14280a86e0 0x7f14280acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33822/0 (socket says 172.21.15.72:33822) 2023-08-31T19:03:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.185+0000 7f14267fc700 1 -- 172.21.15.72:0/3352288887 learned_addr learned my addr 172.21.15.72:0/3352288887 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:15.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.186+0000 7f14267fc700 1 -- 172.21.15.72:0/3352288887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1428152ec0 msgr2=0x7f1428064980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:15.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.186+0000 7f14277fe700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1428152ec0 0x7f1428064980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:15.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.186+0000 7f1426ffd700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410005000 0x7f14281552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:15.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.186+0000 7f14267fc700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1428152ec0 0x7f1428064980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:15.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.186+0000 7f14267fc700 1 -- 172.21.15.72:0/3352288887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410005000 msgr2=0x7f14281552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:15.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.186+0000 7f14267fc700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410005000 0x7f14281552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:15.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.186+0000 7f14267fc700 1 -- 172.21.15.72:0/3352288887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1428155e50 con 0x7f14280a86e0 2023-08-31T19:03:15.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.186+0000 7f1426ffd700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410005000 0x7f14281552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:15.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.186+0000 7f14277fe700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1428152ec0 0x7f1428064980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:15.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.186+0000 7f14267fc700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14280a86e0 0x7f14280acb40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f141c001200 tx=0x7f141c001c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:15.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.186+0000 7f140effd700 1 -- 172.21.15.72:0/3352288887 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c00a500 con 0x7f14280a86e0 2023-08-31T19:03:15.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.186+0000 7f140effd700 1 -- 172.21.15.72:0/3352288887 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c010040 con 0x7f14280a86e0 2023-08-31T19:03:15.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.186+0000 7f140effd700 1 -- 172.21.15.72:0/3352288887 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c00a870 con 0x7f14280a86e0 2023-08-31T19:03:15.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.186+0000 7f142d9ff700 1 -- 172.21.15.72:0/3352288887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1428156130 con 0x7f14280a86e0 2023-08-31T19:03:15.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.186+0000 7f142d9ff700 1 -- 172.21.15.72:0/3352288887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14280ad5d0 con 0x7f14280a86e0 2023-08-31T19:03:15.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.188+0000 7f142d9ff700 1 -- 172.21.15.72:0/3352288887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14280c87e0 con 0x7f14280a86e0 2023-08-31T19:03:15.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.188+0000 7f140effd700 1 -- 172.21.15.72:0/3352288887 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f141c00ac20 con 0x7f14280a86e0 2023-08-31T19:03:15.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.189+0000 7f140effd700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f141405ef30 0x7f14140613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:15.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.190+0000 7f140effd700 1 -- 172.21.15.72:0/3352288887 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f141c079ab0 con 0x7f14280a86e0 2023-08-31T19:03:15.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.190+0000 7f1426ffd700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f141405ef30 0x7f14140613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:15.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.190+0000 7f1426ffd700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f141405ef30 0x7f14140613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f1418000c00 tx=0x7f1418009040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:15.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.193+0000 7f140effd700 1 -- 172.21.15.72:0/3352288887 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f141c04ac90 con 0x7f14280a86e0 2023-08-31T19:03:15.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.429+0000 7f142d9ff700 1 -- 172.21.15.72:0/3352288887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f142806c6b0 con 0x7f14280a86e0 2023-08-31T19:03:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.965+0000 7f140effd700 1 -- 172.21.15.72:0/3352288887 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v549) v1 ==== 159+0+0 (secure 0 0 0) 0x7f141c079e60 con 0x7f14280a86e0 2023-08-31T19:03:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.967+0000 7f142d9ff700 1 -- 172.21.15.72:0/3352288887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f141405ef30 msgr2=0x7f14140613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.967+0000 7f142d9ff700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f141405ef30 0x7f14140613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f1418000c00 tx=0x7f1418009040).stop 2023-08-31T19:03:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.967+0000 7f142d9ff700 1 -- 172.21.15.72:0/3352288887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14280a86e0 msgr2=0x7f14280acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.967+0000 7f142d9ff700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14280a86e0 0x7f14280acb40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f141c001200 tx=0x7f141c001c50).stop 2023-08-31T19:03:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.967+0000 7f142d9ff700 1 -- 172.21.15.72:0/3352288887 shutdown_connections 2023-08-31T19:03:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.967+0000 7f142d9ff700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1428152ec0 0x7f1428064980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.967+0000 7f142d9ff700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f141405ef30 0x7f14140613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.967+0000 7f142d9ff700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410005000 0x7f14281552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.967+0000 7f142d9ff700 1 --2- 172.21.15.72:0/3352288887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14280a86e0 0x7f14280acb40 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.967+0000 7f142d9ff700 1 -- 172.21.15.72:0/3352288887 >> 172.21.15.72:0/3352288887 conn(0x7f1428082f60 msgr2=0x7f1428153910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.967+0000 7f142d9ff700 1 -- 172.21.15.72:0/3352288887 shutdown_connections 2023-08-31T19:03:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:15.967+0000 7f142d9ff700 1 -- 172.21.15.72:0/3352288887 wait complete. 2023-08-31T19:03:15.986 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-31T19:03:16.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.178+0000 7f013e1ff700 1 Processor -- start 2023-08-31T19:03:16.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.178+0000 7f013e1ff700 1 -- start start 2023-08-31T19:03:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.180+0000 7f013e1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0138154410 0x7f01380c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.180+0000 7f013e1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01380c6ed0 con 0x7f0138154030 2023-08-31T19:03:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.180+0000 7f013e1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01380c68c0 con 0x7f01380c7360 2023-08-31T19:03:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.180+0000 7f013e1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01380c66e0 con 0x7f0138154410 2023-08-31T19:03:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.180+0000 7f0136ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0138154410 0x7f01380c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.180+0000 7f01377fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0138154030 0x7f01380aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40872/0 (socket says 172.21.15.72:40872) 2023-08-31T19:03:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.180+0000 7f0136ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0138154410 0x7f01380c06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33838/0 (socket says 172.21.15.72:33838) 2023-08-31T19:03:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.180+0000 7f01377fe700 1 -- 172.21.15.72:0/2450849414 learned_addr learned my addr 172.21.15.72:0/2450849414 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:16.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.180+0000 7f0136ffd700 1 -- 172.21.15.72:0/2450849414 >> v1:172.21.15.146:6789/0 conn(0x7f01380c7360 legacy=0x7f0138063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:16.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.180+0000 7f0136ffd700 1 -- 172.21.15.72:0/2450849414 >> v1:172.21.15.72:6789/0 conn(0x7f0138154030 legacy=0x7f01380aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:16.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.180+0000 7f01367fc700 1 -- 172.21.15.72:0/2450849414 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044520838 0 0) 0x7f01380c6ed0 con 0x7f0138154030 2023-08-31T19:03:16.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.180+0000 7f0136ffd700 1 -- 172.21.15.72:0/2450849414 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01380c0f30 con 0x7f0138154410 2023-08-31T19:03:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.181+0000 7f0136ffd700 1 --2- 172.21.15.72:0/2450849414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0138154410 0x7f01380c06b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f012c009760 tx=0x7f012c009060).ready entity=mon.0 client_cookie=1b97830b01dae022 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.181+0000 7f01367fc700 1 -- 172.21.15.72:0/2450849414 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c0090d0 con 0x7f0138154410 2023-08-31T19:03:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.181+0000 7f01367fc700 1 -- 172.21.15.72:0/2450849414 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c00b520 con 0x7f0138154410 2023-08-31T19:03:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.181+0000 7f01367fc700 1 -- 172.21.15.72:0/2450849414 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c00b8a0 con 0x7f0138154410 2023-08-31T19:03:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.181+0000 7f013e1ff700 1 -- 172.21.15.72:0/2450849414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0138154410 msgr2=0x7f01380c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.181+0000 7f013e1ff700 1 --2- 172.21.15.72:0/2450849414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0138154410 0x7f01380c06b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f012c009760 tx=0x7f012c009060).stop 2023-08-31T19:03:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.181+0000 7f013e1ff700 1 -- 172.21.15.72:0/2450849414 shutdown_connections 2023-08-31T19:03:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.181+0000 7f013e1ff700 1 --2- 172.21.15.72:0/2450849414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0138154410 0x7f01380c06b0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.181+0000 7f013e1ff700 1 -- 172.21.15.72:0/2450849414 >> 172.21.15.72:0/2450849414 conn(0x7f013805eb60 msgr2=0x7f01380cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.181+0000 7f013e1ff700 1 -- 172.21.15.72:0/2450849414 shutdown_connections 2023-08-31T19:03:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.181+0000 7f013e1ff700 1 -- 172.21.15.72:0/2450849414 wait complete. 2023-08-31T19:03:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.183+0000 7f013e1ff700 1 Processor -- start 2023-08-31T19:03:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.183+0000 7f013e1ff700 1 -- start start 2023-08-31T19:03:16.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.184+0000 7f013e1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01380c7360 0x7f01381646a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:16.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.184+0000 7f013e1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0138154030 0x7f013814d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:16.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.184+0000 7f013e1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0138154410 0x7f01380afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:16.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.184+0000 7f013e1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01380ae710 con 0x7f0138154030 2023-08-31T19:03:16.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.184+0000 7f013e1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01380ade20 con 0x7f0138154410 2023-08-31T19:03:16.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.184+0000 7f013e1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01380ae0c0 con 0x7f01380c7360 2023-08-31T19:03:16.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.184+0000 7f0136ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0138154030 0x7f013814d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:16.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.184+0000 7f0136ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0138154030 0x7f013814d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33842/0 (socket says 172.21.15.72:33842) 2023-08-31T19:03:16.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.184+0000 7f0136ffd700 1 -- 172.21.15.72:0/3757181994 learned_addr learned my addr 172.21.15.72:0/3757181994 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.184+0000 7f01377fe700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01380c7360 0x7f01381646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.185+0000 7f0136ffd700 1 -- 172.21.15.72:0/3757181994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01380c7360 msgr2=0x7f01381646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.185+0000 7f0137fff700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0138154410 0x7f01380afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.185+0000 7f0136ffd700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01380c7360 0x7f01381646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.185+0000 7f0136ffd700 1 -- 172.21.15.72:0/3757181994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0138154410 msgr2=0x7f01380afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.185+0000 7f0136ffd700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0138154410 0x7f01380afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.185+0000 7f0136ffd700 1 -- 172.21.15.72:0/3757181994 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c0092a0 con 0x7f0138154030 2023-08-31T19:03:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.185+0000 7f01377fe700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01380c7360 0x7f01381646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.185+0000 7f0137fff700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0138154410 0x7f01380afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.185+0000 7f0136ffd700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0138154030 0x7f013814d910 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f012c009eb0 tx=0x7f012c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.185+0000 7f011f7fe700 1 -- 172.21.15.72:0/3757181994 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c011c90 con 0x7f0138154030 2023-08-31T19:03:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.185+0000 7f011f7fe700 1 -- 172.21.15.72:0/3757181994 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c011df0 con 0x7f0138154030 2023-08-31T19:03:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.185+0000 7f013e1ff700 1 -- 172.21.15.72:0/3757181994 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01380ae3a0 con 0x7f0138154030 2023-08-31T19:03:16.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.185+0000 7f011f7fe700 1 -- 172.21.15.72:0/3757181994 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c01b660 con 0x7f0138154030 2023-08-31T19:03:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.185+0000 7f013e1ff700 1 -- 172.21.15.72:0/3757181994 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01380b0840 con 0x7f0138154030 2023-08-31T19:03:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.186+0000 7f013e1ff700 1 -- 172.21.15.72:0/3757181994 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013806c6b0 con 0x7f0138154030 2023-08-31T19:03:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.187+0000 7f011f7fe700 1 -- 172.21.15.72:0/3757181994 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f012c01ba50 con 0x7f0138154030 2023-08-31T19:03:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.188+0000 7f011f7fe700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f012405ef30 0x7f01240613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:16.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.188+0000 7f011f7fe700 1 -- 172.21.15.72:0/3757181994 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f012c07bb80 con 0x7f0138154030 2023-08-31T19:03:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.188+0000 7f01377fe700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f012405ef30 0x7f01240613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.188+0000 7f01377fe700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f012405ef30 0x7f01240613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0128001750 tx=0x7f0128009040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.192+0000 7f011f7fe700 1 -- 172.21.15.72:0/3757181994 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f012c04cd60 con 0x7f0138154030 2023-08-31T19:03:16.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.360+0000 7f013e1ff700 1 -- 172.21.15.72:0/3757181994 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f01380cb870 con 0x7f0138154030 2023-08-31T19:03:16.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.364+0000 7f011f7fe700 1 -- 172.21.15.72:0/3757181994 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f012c01f020 con 0x7f0138154030 2023-08-31T19:03:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.366+0000 7f013e1ff700 1 -- 172.21.15.72:0/3757181994 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f012405ef30 msgr2=0x7f01240613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.366+0000 7f013e1ff700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f012405ef30 0x7f01240613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0128001750 tx=0x7f0128009040).stop 2023-08-31T19:03:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.366+0000 7f013e1ff700 1 -- 172.21.15.72:0/3757181994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0138154030 msgr2=0x7f013814d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:16.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.366+0000 7f013e1ff700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0138154030 0x7f013814d910 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f012c009eb0 tx=0x7f012c017000).stop 2023-08-31T19:03:16.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.366+0000 7f013e1ff700 1 -- 172.21.15.72:0/3757181994 shutdown_connections 2023-08-31T19:03:16.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.366+0000 7f013e1ff700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f012405ef30 0x7f01240613f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:16.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.366+0000 7f013e1ff700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0138154410 0x7f01380afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:16.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.366+0000 7f013e1ff700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01380c7360 0x7f01381646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:16.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.366+0000 7f013e1ff700 1 --2- 172.21.15.72:0/3757181994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0138154030 0x7f013814d910 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:16.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.366+0000 7f013e1ff700 1 -- 172.21.15.72:0/3757181994 >> 172.21.15.72:0/3757181994 conn(0x7f013805eb60 msgr2=0x7f013815a370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:16.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.367+0000 7f013e1ff700 1 -- 172.21.15.72:0/3757181994 shutdown_connections 2023-08-31T19:03:16.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.367+0000 7f013e1ff700 1 -- 172.21.15.72:0/3757181994 wait complete. 2023-08-31T19:03:16.384 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:03:16.384 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:03:16.486 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:03:16.594 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:03:16.595 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-31T19:03:16.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:03:16.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.784+0000 7fb1d21ff700 1 Processor -- start 2023-08-31T19:03:16.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.784+0000 7fb1d21ff700 1 -- start start 2023-08-31T19:03:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.785+0000 7fb1d21ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1cc0cb940 0x7fb1cc1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.785+0000 7fb1d21ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc0c8c90 con 0x7fb1cc1588d0 2023-08-31T19:03:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.785+0000 7fb1d21ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc155610 con 0x7fb1cc154220 2023-08-31T19:03:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.785+0000 7fb1d21ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc0aa700 con 0x7fb1cc0cb940 2023-08-31T19:03:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.786+0000 7fb1cbfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb1cc1588d0 0x7fb1cc0c6540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40884/0 (socket says 172.21.15.72:40884) 2023-08-31T19:03:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.786+0000 7fb1cbfff700 1 -- 172.21.15.72:0/1802645218 learned_addr learned my addr 172.21.15.72:0/1802645218 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:16.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.786+0000 7fb1caffd700 1 --2- 172.21.15.72:0/1802645218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1cc0cb940 0x7fb1cc1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:16.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.786+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274461183 0 0) 0x7fb1cc0c8c90 con 0x7fb1cc1588d0 2023-08-31T19:03:16.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.786+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1b40033f0 con 0x7fb1cc1588d0 2023-08-31T19:03:16.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.786+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055771136 0 0) 0x7fb1cc155610 con 0x7fb1cc154220 2023-08-31T19:03:16.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.786+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1cc0c8c90 con 0x7fb1cc154220 2023-08-31T19:03:16.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.786+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3271371332 0 0) 0x7fb1b40033f0 con 0x7fb1cc1588d0 2023-08-31T19:03:16.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.786+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1cc0cb940 msgr2=0x7fb1cc1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:16.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.786+0000 7fb1ca7fc700 1 --2- 172.21.15.72:0/1802645218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1cc0cb940 0x7fb1cc1583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.786+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 >> v1:172.21.15.146:6789/0 conn(0x7fb1cc154220 legacy=0x7fb1cc157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.786+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc0c0a50 con 0x7fb1cc1588d0 2023-08-31T19:03:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.786+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fb1c40017f0 con 0x7fb1cc1588d0 2023-08-31T19:03:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.786+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 >> v1:172.21.15.72:6789/0 conn(0x7fb1cc1588d0 legacy=0x7fb1cc0c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1ca7fc700 1 --2- 172.21.15.72:0/1802645218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1b4003aa0 0x7fb1b4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:16.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1ca7fc700 1 --2- 172.21.15.72:0/1802645218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1b4004690 0x7fb1b4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:16.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1ca7fc700 1 --2- 172.21.15.72:0/1802645218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b4005000 0x7fb1b400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:16.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc0aa700 con 0x7fb1b4004690 2023-08-31T19:03:16.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b400bdd0 con 0x7fb1b4003aa0 2023-08-31T19:03:16.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b400bf90 con 0x7fb1b4005000 2023-08-31T19:03:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1caffd700 1 --2- 172.21.15.72:0/1802645218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1cc0cb940 0x7fb1cc1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:03:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1caffd700 1 --2- 172.21.15.72:0/1802645218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1b4004690 0x7fb1b4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1cb7fe700 1 --2- 172.21.15.72:0/1802645218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1b4003aa0 0x7fb1b4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:16.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1cbfff700 1 --2- 172.21.15.72:0/1802645218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b4005000 0x7fb1b400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1caffd700 1 -- 172.21.15.72:0/1802645218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b4005000 msgr2=0x7fb1b400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1caffd700 1 --2- 172.21.15.72:0/1802645218 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1b4005000 0x7fb1b400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1caffd700 1 -- 172.21.15.72:0/1802645218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1b4003aa0 msgr2=0x7fb1b4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1caffd700 1 --2- 172.21.15.72:0/1802645218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1b4003aa0 0x7fb1b4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1caffd700 1 -- 172.21.15.72:0/1802645218 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b40033f0 con 0x7fb1b4004690 2023-08-31T19:03:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1cb7fe700 1 --2- 172.21.15.72:0/1802645218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1b4003aa0 0x7fb1b4003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:03:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.787+0000 7fb1caffd700 1 --2- 172.21.15.72:0/1802645218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1b4004690 0x7fb1b4004b10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fb1cc083190 tx=0x7fb1c0009060).ready entity=mon.0 client_cookie=da4caf70d7f4fa13 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.788+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00094d0 con 0x7fb1b4004690 2023-08-31T19:03:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.788+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c000e640 con 0x7fb1b4004690 2023-08-31T19:03:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.788+0000 7fb1ca7fc700 1 -- 172.21.15.72:0/1802645218 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000ea00 con 0x7fb1b4004690 2023-08-31T19:03:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.788+0000 7fb1d21ff700 1 -- 172.21.15.72:0/1802645218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1b4004690 msgr2=0x7fb1b4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:16.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.788+0000 7fb1d21ff700 1 --2- 172.21.15.72:0/1802645218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1b4004690 0x7fb1b4004b10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fb1cc083190 tx=0x7fb1c0009060).stop 2023-08-31T19:03:16.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.788+0000 7fb1cbfff700 1 -- 172.21.15.72:0/1802645218 reap_dead start 2023-08-31T19:03:16.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.788+0000 7fb1d21ff700 1 -- 172.21.15.72:0/1802645218 shutdown_connections 2023-08-31T19:03:16.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.788+0000 7fb1d21ff700 1 -- 172.21.15.72:0/1802645218 >> 172.21.15.72:0/1802645218 conn(0x7fb1cc05e870 msgr2=0x7fb1cc0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:16.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.788+0000 7fb1d21ff700 1 -- 172.21.15.72:0/1802645218 shutdown_connections 2023-08-31T19:03:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.788+0000 7fb1d21ff700 1 -- 172.21.15.72:0/1802645218 wait complete. 2023-08-31T19:03:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.790+0000 7fb1d21ff700 1 Processor -- start 2023-08-31T19:03:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.790+0000 7fb1d21ff700 1 -- start start 2023-08-31T19:03:16.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.791+0000 7fb1d21ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1b4004690 0x7fb1cc14ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:16.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.791+0000 7fb1d21ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1cc156400 0x7fb1cc14fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:16.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.791+0000 7fb1d21ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1cc156880 0x7fb1cc1503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:16.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.791+0000 7fb1d21ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc1508c0 con 0x7fb1cc156400 2023-08-31T19:03:16.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.791+0000 7fb1d21ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc157f30 con 0x7fb1b4004690 2023-08-31T19:03:16.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.791+0000 7fb1d21ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc1583c0 con 0x7fb1cc156880 2023-08-31T19:03:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.791+0000 7fb1caffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1cc156400 0x7fb1cc14fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.791+0000 7fb1caffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1cc156400 0x7fb1cc14fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33854/0 (socket says 172.21.15.72:33854) 2023-08-31T19:03:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.791+0000 7fb1caffd700 1 -- 172.21.15.72:0/2612615673 learned_addr learned my addr 172.21.15.72:0/2612615673 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.791+0000 7fb1cbfff700 1 --2- 172.21.15.72:0/2612615673 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1cc156880 0x7fb1cc1503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.791+0000 7fb1cb7fe700 1 --2- 172.21.15.72:0/2612615673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1b4004690 0x7fb1cc14ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.792+0000 7fb1caffd700 1 -- 172.21.15.72:0/2612615673 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1cc156880 msgr2=0x7fb1cc1503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.792+0000 7fb1caffd700 1 --2- 172.21.15.72:0/2612615673 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1cc156880 0x7fb1cc1503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.792+0000 7fb1caffd700 1 -- 172.21.15.72:0/2612615673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1b4004690 msgr2=0x7fb1cc14ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.792+0000 7fb1caffd700 1 --2- 172.21.15.72:0/2612615673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1b4004690 0x7fb1cc14ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.792+0000 7fb1caffd700 1 -- 172.21.15.72:0/2612615673 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc157320 con 0x7fb1cc156400 2023-08-31T19:03:16.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.792+0000 7fb1caffd700 1 --2- 172.21.15.72:0/2612615673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1cc156400 0x7fb1cc14fee0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fb1c001ee40 tx=0x7fb1c0019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:16.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.792+0000 7fb1b37fe700 1 -- 172.21.15.72:0/2612615673 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0006c30 con 0x7fb1cc156400 2023-08-31T19:03:16.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.792+0000 7fb1b37fe700 1 -- 172.21.15.72:0/2612615673 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c00094d0 con 0x7fb1cc156400 2023-08-31T19:03:16.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.792+0000 7fb1b37fe700 1 -- 172.21.15.72:0/2612615673 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c001c690 con 0x7fb1cc156400 2023-08-31T19:03:16.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.792+0000 7fb1d21ff700 1 -- 172.21.15.72:0/2612615673 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1cc157600 con 0x7fb1cc156400 2023-08-31T19:03:16.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.792+0000 7fb1d21ff700 1 -- 172.21.15.72:0/2612615673 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1cc157bc0 con 0x7fb1cc156400 2023-08-31T19:03:16.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.793+0000 7fb1d21ff700 1 -- 172.21.15.72:0/2612615673 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1cc0c8ab0 con 0x7fb1cc156400 2023-08-31T19:03:16.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.794+0000 7fb1b37fe700 1 -- 172.21.15.72:0/2612615673 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb1c001ca00 con 0x7fb1cc156400 2023-08-31T19:03:16.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.795+0000 7fb1b37fe700 1 --2- 172.21.15.72:0/2612615673 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb1b805ef30 0x7fb1b80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:16.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.795+0000 7fb1b37fe700 1 -- 172.21.15.72:0/2612615673 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fb1c007c340 con 0x7fb1cc156400 2023-08-31T19:03:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.795+0000 7fb1cb7fe700 1 --2- 172.21.15.72:0/2612615673 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb1b805ef30 0x7fb1b80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.796+0000 7fb1cb7fe700 1 --2- 172.21.15.72:0/2612615673 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb1b805ef30 0x7fb1b80613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fb1bc000c00 tx=0x7fb1bc007c00).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:16.799+0000 7fb1b37fe700 1 -- 172.21.15.72:0/2612615673 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb1c004d400 con 0x7fb1cc156400 2023-08-31T19:03:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:17.011+0000 7fb1d21ff700 1 -- 172.21.15.72:0/2612615673 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1cc1580a0 con 0x7fb1cc156400 2023-08-31T19:03:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:17.011+0000 7fb1b37fe700 1 -- 172.21.15.72:0/2612615673 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fb1c002c090 con 0x7fb1cc156400 2023-08-31T19:03:17.012 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:17.012 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5147,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1085369530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1085369530},{"type":"v1","addr":"172.21.15.146:6834","nonce":1085369530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5503,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3852978729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3852978729},{"type":"v1","addr":"172.21.15.146:6835","nonce":3852978729}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/654480318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":654480318},{"type":"v1","addr":"172.21.15.72:6835","nonce":654480318}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5830,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/204750526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":204750526},{"type":"v1","addr":"172.21.15.72:6837","nonce":204750526}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2023-08-31T19:03:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:17.013+0000 7fb1d21ff700 1 -- 172.21.15.72:0/2612615673 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb1b805ef30 msgr2=0x7fb1b80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:17.013+0000 7fb1d21ff700 1 --2- 172.21.15.72:0/2612615673 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb1b805ef30 0x7fb1b80613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fb1bc000c00 tx=0x7fb1bc007c00).stop 2023-08-31T19:03:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:17.013+0000 7fb1d21ff700 1 -- 172.21.15.72:0/2612615673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1cc156400 msgr2=0x7fb1cc14fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:17.013+0000 7fb1d21ff700 1 --2- 172.21.15.72:0/2612615673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1cc156400 0x7fb1cc14fee0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fb1c001ee40 tx=0x7fb1c0019000).stop 2023-08-31T19:03:17.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:17.013+0000 7fb1d21ff700 1 -- 172.21.15.72:0/2612615673 shutdown_connections 2023-08-31T19:03:17.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:17.013+0000 7fb1d21ff700 1 --2- 172.21.15.72:0/2612615673 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb1cc156880 0x7fb1cc1503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:17.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:17.013+0000 7fb1d21ff700 1 --2- 172.21.15.72:0/2612615673 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb1b805ef30 0x7fb1b80613f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:17.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:17.013+0000 7fb1d21ff700 1 --2- 172.21.15.72:0/2612615673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1b4004690 0x7fb1cc14ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:17.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:17.013+0000 7fb1d21ff700 1 --2- 172.21.15.72:0/2612615673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1cc156400 0x7fb1cc14fee0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:17.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:17.014+0000 7fb1d21ff700 1 -- 172.21.15.72:0/2612615673 >> 172.21.15.72:0/2612615673 conn(0x7fb1cc05e870 msgr2=0x7fb1cc150d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:17.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:17.014+0000 7fb1d21ff700 1 -- 172.21.15.72:0/2612615673 shutdown_connections 2023-08-31T19:03:17.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:17.014+0000 7fb1d21ff700 1 -- 172.21.15.72:0/2612615673 wait complete. 2023-08-31T19:03:17.016 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 25 2023-08-31T19:03:17.031 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T19:03:17.032 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-31T19:03:17.032 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T19:03:17.032 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:03:17.033 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T19:03:17.033 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-31T19:03:17.033 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T19:03:17.033 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:03:17.034 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T19:03:17.034 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-31T19:03:17.034 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T19:03:17.035 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:03:17.035 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T19:03:17.035 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-31T19:03:17.035 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T19:03:17.036 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:03:17.047 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T19:03:17.048 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T19:03:17.050 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T19:03:17.051 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T19:03:17.052 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T19:03:17.052 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T19:03:17.092 INFO:tasks.ceph.mds.c:Started 2023-08-31T19:03:17.093 DEBUG:teuthology.parallel:result is None 2023-08-31T19:03:17.096 INFO:tasks.ceph.mds.b:Started 2023-08-31T19:03:17.096 DEBUG:teuthology.parallel:result is None 2023-08-31T19:03:17.100 INFO:tasks.ceph.mds.d:Started 2023-08-31T19:03:17.100 DEBUG:teuthology.parallel:result is None 2023-08-31T19:03:17.227 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-31T19:03:17.250 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-08-31T19:03:17.251 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-08-31T19:03:18.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-08-31T19:03:23.047 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T19:03:23.047 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T19:03:23.053 INFO:tasks.ceph.mds.a:Started 2023-08-31T19:03:23.054 DEBUG:teuthology.parallel:result is None 2023-08-31T19:03:23.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-31T19:03:23.201 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T19:03:23.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.256+0000 7f8801fff700 1 Processor -- start 2023-08-31T19:03:23.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.256+0000 7f8801fff700 1 -- start start 2023-08-31T19:03:23.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.258+0000 7f8801fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87fc0ad1b0 0x7f87fc0ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:23.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.258+0000 7f8801fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87fc0637c0 0x7f87fc155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:23.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.258+0000 7f8801fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87fc0c6130 con 0x7f87fc157c10 2023-08-31T19:03:23.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.258+0000 7f8801fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87fc0c0350 con 0x7f87fc0637c0 2023-08-31T19:03:23.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.258+0000 7f8801fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc1580b0 con 0x7f87fc0ad1b0 2023-08-31T19:03:23.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.258+0000 7f87fbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87fc0637c0 0x7f87fc155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:23.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.258+0000 7f87fbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87fc0637c0 0x7f87fc155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60228/0 (socket says 172.21.15.72:60228) 2023-08-31T19:03:23.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.258+0000 7f87fbfff700 1 -- 172.21.15.72:0/2911322232 learned_addr learned my addr 172.21.15.72:0/2911322232 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:23.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.258+0000 7f87fb7fe700 1 --2- 172.21.15.72:0/2911322232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87fc0ad1b0 0x7f87fc0ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:23.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.258+0000 7f87fbfff700 1 -- 172.21.15.72:0/2911322232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87fc0ad1b0 msgr2=0x7f87fc0ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:23.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.258+0000 7f87fbfff700 1 --2- 172.21.15.72:0/2911322232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87fc0ad1b0 0x7f87fc0ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:23.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.258+0000 7f87fbfff700 1 -- 172.21.15.72:0/2911322232 >> v1:172.21.15.146:6789/0 conn(0x7f87fc157c10 legacy=0x7f87fc0630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:23.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.258+0000 7f87fbfff700 1 -- 172.21.15.72:0/2911322232 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc155560 con 0x7f87fc0637c0 2023-08-31T19:03:23.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.259+0000 7f87fbfff700 1 --2- 172.21.15.72:0/2911322232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87fc0637c0 0x7f87fc155070 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f87f4009f20 tx=0x7f87f4009840).ready entity=mon.0 client_cookie=6853bdb6824aed83 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:23.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.259+0000 7f87fa7fc700 1 -- 172.21.15.72:0/2911322232 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f400e070 con 0x7f87fc0637c0 2023-08-31T19:03:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.259+0000 7f87fa7fc700 1 -- 172.21.15.72:0/2911322232 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f400ba40 con 0x7f87fc0637c0 2023-08-31T19:03:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.259+0000 7f87fa7fc700 1 -- 172.21.15.72:0/2911322232 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f400bdc0 con 0x7f87fc0637c0 2023-08-31T19:03:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.259+0000 7f8801fff700 1 -- 172.21.15.72:0/2911322232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87fc0637c0 msgr2=0x7f87fc155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.259+0000 7f8801fff700 1 --2- 172.21.15.72:0/2911322232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87fc0637c0 0x7f87fc155070 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f87f4009f20 tx=0x7f87f4009840).stop 2023-08-31T19:03:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.259+0000 7f8801fff700 1 -- 172.21.15.72:0/2911322232 shutdown_connections 2023-08-31T19:03:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.259+0000 7f8801fff700 1 --2- 172.21.15.72:0/2911322232 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87fc0ad1b0 0x7f87fc0ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:23.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.259+0000 7f8801fff700 1 --2- 172.21.15.72:0/2911322232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87fc0637c0 0x7f87fc155070 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:23.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.259+0000 7f8801fff700 1 -- 172.21.15.72:0/2911322232 >> 172.21.15.72:0/2911322232 conn(0x7f87fc05eb60 msgr2=0x7f87fc0cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:23.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.260+0000 7f8801fff700 1 -- 172.21.15.72:0/2911322232 shutdown_connections 2023-08-31T19:03:23.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.260+0000 7f8801fff700 1 -- 172.21.15.72:0/2911322232 wait complete. 2023-08-31T19:03:23.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.261+0000 7f8801fff700 1 Processor -- start 2023-08-31T19:03:23.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.261+0000 7f8801fff700 1 -- start start 2023-08-31T19:03:23.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.262+0000 7f8801fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87fc0637c0 0x7f87fc14e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:23.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.262+0000 7f8801fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87fc0ad1b0 0x7f87fc0b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:23.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.262+0000 7f8801fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87fc157c10 0x7f87fc1570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:23.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.262+0000 7f8801fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0b0490 con 0x7f87fc0637c0 2023-08-31T19:03:23.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.262+0000 7f8801fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0af8c0 con 0x7f87fc0ad1b0 2023-08-31T19:03:23.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.262+0000 7f8801fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0afb60 con 0x7f87fc157c10 2023-08-31T19:03:23.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.262+0000 7f87fb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87fc0637c0 0x7f87fc14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:23.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.262+0000 7f87fb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87fc0637c0 0x7f87fc14e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60242/0 (socket says 172.21.15.72:60242) 2023-08-31T19:03:23.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.262+0000 7f87fb7fe700 1 -- 172.21.15.72:0/217973856 learned_addr learned my addr 172.21.15.72:0/217973856 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.263+0000 7f87fbfff700 1 --2- 172.21.15.72:0/217973856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87fc157c10 0x7f87fc1570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.263+0000 7f87faffd700 1 --2- 172.21.15.72:0/217973856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87fc0ad1b0 0x7f87fc0b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.263+0000 7f87fb7fe700 1 -- 172.21.15.72:0/217973856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87fc157c10 msgr2=0x7f87fc1570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.263+0000 7f87fb7fe700 1 --2- 172.21.15.72:0/217973856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87fc157c10 0x7f87fc1570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.263+0000 7f87fb7fe700 1 -- 172.21.15.72:0/217973856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87fc0ad1b0 msgr2=0x7f87fc0b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.263+0000 7f87fb7fe700 1 --2- 172.21.15.72:0/217973856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87fc0ad1b0 0x7f87fc0b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.263+0000 7f87fb7fe700 1 -- 172.21.15.72:0/217973856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f4009ae0 con 0x7f87fc0637c0 2023-08-31T19:03:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.263+0000 7f87faffd700 1 --2- 172.21.15.72:0/217973856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87fc0ad1b0 0x7f87fc0b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.263+0000 7f87fb7fe700 1 --2- 172.21.15.72:0/217973856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87fc0637c0 0x7f87fc14e180 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f87ec00d890 tx=0x7f87ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.263+0000 7f87e37fe700 1 -- 172.21.15.72:0/217973856 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec0125f0 con 0x7f87fc0637c0 2023-08-31T19:03:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.263+0000 7f87e37fe700 1 -- 172.21.15.72:0/217973856 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec012750 con 0x7f87fc0637c0 2023-08-31T19:03:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.263+0000 7f8801fff700 1 -- 172.21.15.72:0/217973856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87fc0afe40 con 0x7f87fc0637c0 2023-08-31T19:03:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.263+0000 7f87e37fe700 1 -- 172.21.15.72:0/217973856 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec012ad0 con 0x7f87fc0637c0 2023-08-31T19:03:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.263+0000 7f8801fff700 1 -- 172.21.15.72:0/217973856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87fc1575e0 con 0x7f87fc0637c0 2023-08-31T19:03:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.264+0000 7f8801fff700 1 -- 172.21.15.72:0/217973856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87fc06c6b0 con 0x7f87fc0637c0 2023-08-31T19:03:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.265+0000 7f87e37fe700 1 -- 172.21.15.72:0/217973856 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f87ec013480 con 0x7f87fc0637c0 2023-08-31T19:03:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.266+0000 7f87e37fe700 1 --2- 172.21.15.72:0/217973856 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87e805ef30 0x7f87e80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.266+0000 7f87e37fe700 1 -- 172.21.15.72:0/217973856 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f87ec079fb0 con 0x7f87fc0637c0 2023-08-31T19:03:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.266+0000 7f87faffd700 1 --2- 172.21.15.72:0/217973856 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87e805ef30 0x7f87e80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.266+0000 7f87faffd700 1 --2- 172.21.15.72:0/217973856 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87e805ef30 0x7f87e80613f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f87fc0ac9c0 tx=0x7f87f0008040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.270+0000 7f87e37fe700 1 -- 172.21.15.72:0/217973856 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f87ec04b070 con 0x7f87fc0637c0 2023-08-31T19:03:23.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:23.455+0000 7f8801fff700 1 -- 172.21.15.72:0/217973856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f87fc158350 con 0x7f87fc0637c0 2023-08-31T19:03:24.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:03:24.007 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:03:24.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.220+0000 7f87e37fe700 1 -- 172.21.15.72:0/217973856 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) v1 ==== 97+0+0 (secure 0 0 0) 0x7f87ec04e690 con 0x7f87fc0637c0 2023-08-31T19:03:24.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.222+0000 7f8801fff700 1 -- 172.21.15.72:0/217973856 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87e805ef30 msgr2=0x7f87e80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:24.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.222+0000 7f8801fff700 1 --2- 172.21.15.72:0/217973856 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87e805ef30 0x7f87e80613f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f87fc0ac9c0 tx=0x7f87f0008040).stop 2023-08-31T19:03:24.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.222+0000 7f8801fff700 1 -- 172.21.15.72:0/217973856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87fc0637c0 msgr2=0x7f87fc14e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:24.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.222+0000 7f8801fff700 1 --2- 172.21.15.72:0/217973856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87fc0637c0 0x7f87fc14e180 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f87ec00d890 tx=0x7f87ec008040).stop 2023-08-31T19:03:24.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.222+0000 7f8801fff700 1 -- 172.21.15.72:0/217973856 shutdown_connections 2023-08-31T19:03:24.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.222+0000 7f8801fff700 1 --2- 172.21.15.72:0/217973856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87fc157c10 0x7f87fc1570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.222+0000 7f8801fff700 1 --2- 172.21.15.72:0/217973856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87fc0637c0 0x7f87fc14e180 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.222+0000 7f8801fff700 1 --2- 172.21.15.72:0/217973856 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87e805ef30 0x7f87e80613f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.222+0000 7f8801fff700 1 --2- 172.21.15.72:0/217973856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87fc0ad1b0 0x7f87fc0b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.222+0000 7f8801fff700 1 -- 172.21.15.72:0/217973856 >> 172.21.15.72:0/217973856 conn(0x7f87fc05eb60 msgr2=0x7f87fc154ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:24.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.222+0000 7f8801fff700 1 -- 172.21.15.72:0/217973856 shutdown_connections 2023-08-31T19:03:24.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.222+0000 7f8801fff700 1 -- 172.21.15.72:0/217973856 wait complete. 2023-08-31T19:03:24.225 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-08-31T19:03:24.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-31T19:03:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.431+0000 7f42ff5ff700 1 Processor -- start 2023-08-31T19:03:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.431+0000 7f42ff5ff700 1 -- start start 2023-08-31T19:03:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.432+0000 7f42ff5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f42f8154060 0x7f42f8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.432+0000 7f42ff5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42f80cb9b0 0x7f42f81581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.432+0000 7f42ff5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f80c6120 con 0x7f42f81586b0 2023-08-31T19:03:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.432+0000 7f42ff5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f80c1380 con 0x7f42f80cb9b0 2023-08-31T19:03:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.432+0000 7f42ff5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f80c5e10 con 0x7f42f8154060 2023-08-31T19:03:24.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.433+0000 7f42fcb9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42f80cb9b0 0x7f42f81581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:24.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.433+0000 7f42fcb9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42f80cb9b0 0x7f42f81581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60248/0 (socket says 172.21.15.72:60248) 2023-08-31T19:03:24.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.433+0000 7f42fcb9a700 1 -- 172.21.15.72:0/1802756053 learned_addr learned my addr 172.21.15.72:0/1802756053 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:24.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.433+0000 7f42fd39b700 1 --2- 172.21.15.72:0/1802756053 >> v2:172.21.15.146:3300/0 conn(0x7f42f8154060 0x7f42f8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:24.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.433+0000 7f42fcb9a700 1 -- 172.21.15.72:0/1802756053 >> v2:172.21.15.146:3300/0 conn(0x7f42f8154060 msgr2=0x7f42f8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:24.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.433+0000 7f42fcb9a700 1 --2- 172.21.15.72:0/1802756053 >> v2:172.21.15.146:3300/0 conn(0x7f42f8154060 0x7f42f8157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.433+0000 7f42fcb9a700 1 -- 172.21.15.72:0/1802756053 >> v1:172.21.15.146:6789/0 conn(0x7f42f81586b0 legacy=0x7f42f80c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:24.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.433+0000 7f42fcb9a700 1 -- 172.21.15.72:0/1802756053 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f8158b00 con 0x7f42f80cb9b0 2023-08-31T19:03:24.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.433+0000 7f42fcb9a700 1 --2- 172.21.15.72:0/1802756053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f80cb9b0 0x7f42f81581c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f42f81557e0 tx=0x7f42e80090f0).ready entity=mon.0 client_cookie=105f73fb93f18ba5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:24.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.434+0000 7f42effff700 1 -- 172.21.15.72:0/1802756053 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e800b5a0 con 0x7f42f80cb9b0 2023-08-31T19:03:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.434+0000 7f42effff700 1 -- 172.21.15.72:0/1802756053 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e800b700 con 0x7f42f80cb9b0 2023-08-31T19:03:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.434+0000 7f42effff700 1 -- 172.21.15.72:0/1802756053 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e800ba80 con 0x7f42f80cb9b0 2023-08-31T19:03:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.434+0000 7f42ff5ff700 1 -- 172.21.15.72:0/1802756053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f80cb9b0 msgr2=0x7f42f81581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.434+0000 7f42ff5ff700 1 --2- 172.21.15.72:0/1802756053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f80cb9b0 0x7f42f81581c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f42f81557e0 tx=0x7f42e80090f0).stop 2023-08-31T19:03:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.434+0000 7f42ff5ff700 1 -- 172.21.15.72:0/1802756053 shutdown_connections 2023-08-31T19:03:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.434+0000 7f42ff5ff700 1 --2- 172.21.15.72:0/1802756053 >> v2:172.21.15.146:3300/0 conn(0x7f42f8154060 0x7f42f8157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.434+0000 7f42ff5ff700 1 --2- 172.21.15.72:0/1802756053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f80cb9b0 0x7f42f81581c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.434+0000 7f42ff5ff700 1 -- 172.21.15.72:0/1802756053 >> 172.21.15.72:0/1802756053 conn(0x7f42f805e870 msgr2=0x7f42f80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.434+0000 7f42ff5ff700 1 -- 172.21.15.72:0/1802756053 shutdown_connections 2023-08-31T19:03:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.434+0000 7f42ff5ff700 1 -- 172.21.15.72:0/1802756053 wait complete. 2023-08-31T19:03:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.436+0000 7f42ff5ff700 1 Processor -- start 2023-08-31T19:03:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.436+0000 7f42ff5ff700 1 -- start start 2023-08-31T19:03:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.437+0000 7f42ff5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42f80cb9b0 0x7f42f80c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.437+0000 7f42ff5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42f8154060 0x7f42f8151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.437+0000 7f42ff5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f81586b0 0x7f42f8155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.437+0000 7f42ff5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f8155810 con 0x7f42f81586b0 2023-08-31T19:03:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.437+0000 7f42ff5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f8155af0 con 0x7f42f80cb9b0 2023-08-31T19:03:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.437+0000 7f42ff5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80c2d30 con 0x7f42f8154060 2023-08-31T19:03:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.437+0000 7f42fdb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f81586b0 0x7f42f8155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.437+0000 7f42fdb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f81586b0 0x7f42f8155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60260/0 (socket says 172.21.15.72:60260) 2023-08-31T19:03:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.437+0000 7f42fdb9c700 1 -- 172.21.15.72:0/3099339043 learned_addr learned my addr 172.21.15.72:0/3099339043 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.437+0000 7f42fd39b700 1 --2- 172.21.15.72:0/3099339043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42f80cb9b0 0x7f42f80c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.437+0000 7f42fcb9a700 1 --2- 172.21.15.72:0/3099339043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42f8154060 0x7f42f8151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.437+0000 7f42fdb9c700 1 -- 172.21.15.72:0/3099339043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42f8154060 msgr2=0x7f42f8151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.437+0000 7f42fdb9c700 1 --2- 172.21.15.72:0/3099339043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42f8154060 0x7f42f8151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.437+0000 7f42fdb9c700 1 -- 172.21.15.72:0/3099339043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42f80cb9b0 msgr2=0x7f42f80c2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.437+0000 7f42fdb9c700 1 --2- 172.21.15.72:0/3099339043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42f80cb9b0 0x7f42f80c2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.438+0000 7f42fdb9c700 1 -- 172.21.15.72:0/3099339043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e8009370 con 0x7f42f81586b0 2023-08-31T19:03:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.438+0000 7f42fcb9a700 1 --2- 172.21.15.72:0/3099339043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42f8154060 0x7f42f8151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.438+0000 7f42fdb9c700 1 --2- 172.21.15.72:0/3099339043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f81586b0 0x7f42f8155f80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f42f000b840 tx=0x7f42f0009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.438+0000 7f42ed7fa700 1 -- 172.21.15.72:0/3099339043 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f000d500 con 0x7f42f81586b0 2023-08-31T19:03:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.438+0000 7f42ed7fa700 1 -- 172.21.15.72:0/3099339043 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f000d6a0 con 0x7f42f81586b0 2023-08-31T19:03:24.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.438+0000 7f42ed7fa700 1 -- 172.21.15.72:0/3099339043 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f000da60 con 0x7f42f81586b0 2023-08-31T19:03:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.438+0000 7f42ff5ff700 1 -- 172.21.15.72:0/3099339043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f80c32c0 con 0x7f42f81586b0 2023-08-31T19:03:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.438+0000 7f42ff5ff700 1 -- 172.21.15.72:0/3099339043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f80c3880 con 0x7f42f81586b0 2023-08-31T19:03:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.439+0000 7f42ff5ff700 1 -- 172.21.15.72:0/3099339043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f806c6b0 con 0x7f42f81586b0 2023-08-31T19:03:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.440+0000 7f42ed7fa700 1 -- 172.21.15.72:0/3099339043 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f42f0011460 con 0x7f42f81586b0 2023-08-31T19:03:24.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.441+0000 7f42ed7fa700 1 --2- 172.21.15.72:0/3099339043 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f42dc05ef30 0x7f42dc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:24.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.441+0000 7f42ed7fa700 1 -- 172.21.15.72:0/3099339043 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f42f00798c0 con 0x7f42f81586b0 2023-08-31T19:03:24.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.441+0000 7f42fd39b700 1 --2- 172.21.15.72:0/3099339043 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f42dc05ef30 0x7f42dc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:24.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.441+0000 7f42fd39b700 1 --2- 172.21.15.72:0/3099339043 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f42dc05ef30 0x7f42dc0613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f42f4006090 tx=0x7f42f4008040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:24.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.445+0000 7f42ed7fa700 1 -- 172.21.15.72:0/3099339043 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f42f00478f0 con 0x7f42f81586b0 2023-08-31T19:03:24.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.678+0000 7f42ff5ff700 1 -- 172.21.15.72:0/3099339043 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f42f8156890 con 0x7f42f81586b0 2023-08-31T19:03:24.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.678+0000 7f42ed7fa700 1 -- 172.21.15.72:0/3099339043 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f42f8156890 con 0x7f42f81586b0 2023-08-31T19:03:24.679 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:24.679 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:03:24.679 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-08-31T19:03:24.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.679 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-08-31T19:03:24.680 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkPeqvDBAAA2eEr6xr7iF5PPNT9eehSg==", 2023-08-31T19:03:24.680 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.680 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:03:24.680 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:03:24.680 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:03:24.681 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:03:24.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.681 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-08-31T19:03:24.682 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkctxUIxAAufSVXMwPzPA7Gq1s4ukXiQ==", 2023-08-31T19:03:24.682 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.682 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:03:24.682 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:03:24.682 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:03:24.683 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:03:24.683 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.683 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-08-31T19:03:24.684 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkcpLfFxAASIB//h8whjuh6s3YKBVffQ==", 2023-08-31T19:03:24.684 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.684 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:03:24.684 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:03:24.684 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:03:24.685 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:03:24.685 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.685 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-08-31T19:03:24.685 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkC1bbLhAAg/0wct2P0+cyWbZyI2bP/g==", 2023-08-31T19:03:24.686 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.686 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:03:24.686 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:03:24.686 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:03:24.686 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:03:24.687 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.687 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-08-31T19:03:24.687 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAi4PBkvfRJEBAAYQqPldOXrJxXAXnmZhXaBQ==", 2023-08-31T19:03:24.688 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.688 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:03:24.688 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:03:24.688 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:03:24.688 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.689 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-08-31T19:03:24.689 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAl4PBkYysSIhAA4nCmskcGV+i4vpH2k/gDBg==", 2023-08-31T19:03:24.689 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.689 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:03:24.690 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:03:24.690 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:03:24.690 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.691 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-08-31T19:03:24.691 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAp4PBkyDgJFxAAPynEKk15yN7+OxQxpzL0UQ==", 2023-08-31T19:03:24.691 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.691 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:03:24.691 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:03:24.692 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:03:24.692 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.692 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-08-31T19:03:24.693 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAs4PBkZMD2KBAAoJrO4YjJ4/8MjcPAtgEn1g==", 2023-08-31T19:03:24.693 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.693 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:03:24.693 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:03:24.693 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:03:24.694 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.694 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-08-31T19:03:24.694 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAz4PBkSgAoExAAJ95kdHV47jDTXSj/WSCiLw==", 2023-08-31T19:03:24.695 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.695 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:03:24.695 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:03:24.695 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:03:24.695 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.696 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-08-31T19:03:24.696 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA24PBkUxpLKBAAAu8d6iKME6wW+Q/6hhFIRQ==", 2023-08-31T19:03:24.696 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.697 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:03:24.697 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:03:24.697 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:03:24.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.698 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-08-31T19:03:24.698 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA54PBkURHJOhAA3HaPfENVQ4hLIjc/esF0bQ==", 2023-08-31T19:03:24.698 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.698 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:03:24.699 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:03:24.699 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:03:24.699 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.700 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-08-31T19:03:24.700 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA94PBkfoqTEBAAQHENgrp5tv1X47Br/dUksQ==", 2023-08-31T19:03:24.700 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.700 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:03:24.700 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:03:24.700 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:03:24.701 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.701 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-08-31T19:03:24.701 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkucWuOBAABLowlGxpCR3GgoOCRmC0FQ==", 2023-08-31T19:03:24.701 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.702 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:03:24.702 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow r", 2023-08-31T19:03:24.702 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-31T19:03:24.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.703 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-08-31T19:03:24.703 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkVGBPCxAAO4M9u24/yH0xwtV6oSz+JQ==", 2023-08-31T19:03:24.703 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.703 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:03:24.704 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:03:24.704 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:03:24.704 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:03:24.704 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.705 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.2", 2023-08-31T19:03:24.705 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkYeIoBBAAjoIzJJ9McIx3rLBSaorTKA==", 2023-08-31T19:03:24.705 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.705 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:03:24.706 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:03:24.706 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:03:24.706 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:03:24.706 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.707 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.3", 2023-08-31T19:03:24.707 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkX/V9EhAAqWuBMMhikN/JUQp3v5/ABQ==", 2023-08-31T19:03:24.707 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.707 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:03:24.708 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:03:24.708 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:03:24.708 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:03:24.708 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.709 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-08-31T19:03:24.709 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkCRlhDhAAxvcGr+KTvLoJmtuZC89Iuw==", 2023-08-31T19:03:24.709 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.709 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:03:24.710 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:03:24.710 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:03:24.710 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:03:24.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.711 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-08-31T19:03:24.711 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkiGBUBRAAwWTFqrz+ELBSwb0Z2T9yhQ==", 2023-08-31T19:03:24.711 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.711 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:03:24.712 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:03:24.712 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:03:24.712 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:24.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:24.712 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-08-31T19:03:24.713 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkSWszNRAAdBxrfMEuBRgePfaiPx6kpQ==", 2023-08-31T19:03:24.713 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:03:24.713 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:03:24.713 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:03:24.713 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:03:24.714 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.714 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:24.714 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-08-31T19:03:24.714 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:03:24.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.680+0000 7f42ff5ff700 1 -- 172.21.15.72:0/3099339043 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f42dc05ef30 msgr2=0x7f42dc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:24.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.680+0000 7f42ff5ff700 1 --2- 172.21.15.72:0/3099339043 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f42dc05ef30 0x7f42dc0613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f42f4006090 tx=0x7f42f4008040).stop 2023-08-31T19:03:24.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.680+0000 7f42ff5ff700 1 -- 172.21.15.72:0/3099339043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f81586b0 msgr2=0x7f42f8155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:24.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.680+0000 7f42ff5ff700 1 --2- 172.21.15.72:0/3099339043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f81586b0 0x7f42f8155f80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f42f000b840 tx=0x7f42f0009290).stop 2023-08-31T19:03:24.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.680+0000 7f42ff5ff700 1 -- 172.21.15.72:0/3099339043 shutdown_connections 2023-08-31T19:03:24.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.680+0000 7f42ff5ff700 1 --2- 172.21.15.72:0/3099339043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f81586b0 0x7f42f8155f80 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.680+0000 7f42ff5ff700 1 --2- 172.21.15.72:0/3099339043 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f42dc05ef30 0x7f42dc0613f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.680+0000 7f42ff5ff700 1 --2- 172.21.15.72:0/3099339043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42f80cb9b0 0x7f42f80c2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.680+0000 7f42ff5ff700 1 --2- 172.21.15.72:0/3099339043 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42f8154060 0x7f42f8151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.680+0000 7f42ff5ff700 1 -- 172.21.15.72:0/3099339043 >> 172.21.15.72:0/3099339043 conn(0x7f42f805e870 msgr2=0x7f42f81536c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:24.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.680+0000 7f42ff5ff700 1 -- 172.21.15.72:0/3099339043 shutdown_connections 2023-08-31T19:03:24.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.680+0000 7f42ff5ff700 1 -- 172.21.15.72:0/3099339043 wait complete. 2023-08-31T19:03:24.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:03:24.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.908+0000 7fe99a5ff700 1 Processor -- start 2023-08-31T19:03:24.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.909+0000 7fe99a5ff700 1 -- start start 2023-08-31T19:03:24.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.910+0000 7fe99a5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9940c46c0 0x7fe99415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:24.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.910+0000 7fe99a5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9940bef10 con 0x7fe9940bea80 2023-08-31T19:03:24.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.910+0000 7fe99a5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9940bf1f0 con 0x7fe9940c5fb0 2023-08-31T19:03:24.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.910+0000 7fe99a5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe994154690 con 0x7fe9940c46c0 2023-08-31T19:03:24.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.910+0000 7fe9937fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe9940bea80 0x7fe9940c3fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43590/0 (socket says 172.21.15.72:43590) 2023-08-31T19:03:24.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.911+0000 7fe9937fe700 1 -- 172.21.15.72:0/2650109242 learned_addr learned my addr 172.21.15.72:0/2650109242 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:24.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.911+0000 7fe998b9c700 1 --2- 172.21.15.72:0/2650109242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9940c46c0 0x7fe99415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:24.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.911+0000 7fe992ffd700 1 -- 172.21.15.72:0/2650109242 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955055140 0 0) 0x7fe9940bef10 con 0x7fe9940bea80 2023-08-31T19:03:24.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.911+0000 7fe992ffd700 1 -- 172.21.15.72:0/2650109242 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe97c0033f0 con 0x7fe9940bea80 2023-08-31T19:03:24.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.911+0000 7fe992ffd700 1 -- 172.21.15.72:0/2650109242 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438395214 0 0) 0x7fe9940bf1f0 con 0x7fe9940c5fb0 2023-08-31T19:03:24.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.911+0000 7fe992ffd700 1 -- 172.21.15.72:0/2650109242 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9940bef10 con 0x7fe9940c5fb0 2023-08-31T19:03:24.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.911+0000 7fe998b9c700 1 -- 172.21.15.72:0/2650109242 >> v1:172.21.15.146:6789/0 conn(0x7fe9940c5fb0 legacy=0x7fe9940be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:24.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.911+0000 7fe992ffd700 1 -- 172.21.15.72:0/2650109242 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1995664949 0 0) 0x7fe97c0033f0 con 0x7fe9940bea80 2023-08-31T19:03:24.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.911+0000 7fe998b9c700 1 -- 172.21.15.72:0/2650109242 >> v1:172.21.15.72:6789/0 conn(0x7fe9940bea80 legacy=0x7fe9940c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:24.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.911+0000 7fe998b9c700 1 -- 172.21.15.72:0/2650109242 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9940bf4d0 con 0x7fe9940c46c0 2023-08-31T19:03:24.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.911+0000 7fe998b9c700 1 --2- 172.21.15.72:0/2650109242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9940c46c0 0x7fe99415f0f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe98c009e90 tx=0x7fe98c009780).ready entity=mon.2 client_cookie=fc8693d5dc911306 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:24.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.912+0000 7fe992ffd700 1 -- 172.21.15.72:0/2650109242 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c00e070 con 0x7fe9940c46c0 2023-08-31T19:03:24.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.912+0000 7fe992ffd700 1 -- 172.21.15.72:0/2650109242 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c00b7a0 con 0x7fe9940c46c0 2023-08-31T19:03:24.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.912+0000 7fe992ffd700 1 -- 172.21.15.72:0/2650109242 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988001470 con 0x7fe9940c46c0 2023-08-31T19:03:24.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.912+0000 7fe99a5ff700 1 -- 172.21.15.72:0/2650109242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9940c46c0 msgr2=0x7fe99415f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:24.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.912+0000 7fe99a5ff700 1 --2- 172.21.15.72:0/2650109242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9940c46c0 0x7fe99415f0f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe98c009e90 tx=0x7fe98c009780).stop 2023-08-31T19:03:24.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.912+0000 7fe99a5ff700 1 -- 172.21.15.72:0/2650109242 shutdown_connections 2023-08-31T19:03:24.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.912+0000 7fe99a5ff700 1 --2- 172.21.15.72:0/2650109242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe9940c46c0 0x7fe99415f0f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.912+0000 7fe99a5ff700 1 -- 172.21.15.72:0/2650109242 >> 172.21.15.72:0/2650109242 conn(0x7fe994082f60 msgr2=0x7fe99405e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:24.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.912+0000 7fe99a5ff700 1 -- 172.21.15.72:0/2650109242 shutdown_connections 2023-08-31T19:03:24.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.912+0000 7fe99a5ff700 1 -- 172.21.15.72:0/2650109242 wait complete. 2023-08-31T19:03:24.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.914+0000 7fe99a5ff700 1 Processor -- start 2023-08-31T19:03:24.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.914+0000 7fe99a5ff700 1 -- start start 2023-08-31T19:03:24.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.915+0000 7fe99a5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9940c46c0 0x7fe9940acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:24.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.915+0000 7fe99a5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9940c5fb0 0x7fe994153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:24.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.915+0000 7fe99a5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe994153e60 0x7fe9940ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:24.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.915+0000 7fe99a5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9940ab650 con 0x7fe9940c5fb0 2023-08-31T19:03:24.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.915+0000 7fe99a5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9940a5b50 con 0x7fe9940c46c0 2023-08-31T19:03:24.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.915+0000 7fe99a5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9940aadb0 con 0x7fe994153e60 2023-08-31T19:03:24.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.915+0000 7fe9937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9940c5fb0 0x7fe994153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:24.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.915+0000 7fe9937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9940c5fb0 0x7fe994153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60276/0 (socket says 172.21.15.72:60276) 2023-08-31T19:03:24.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.915+0000 7fe9937fe700 1 -- 172.21.15.72:0/2356631514 learned_addr learned my addr 172.21.15.72:0/2356631514 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:24.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.915+0000 7fe998b9c700 1 --2- 172.21.15.72:0/2356631514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe994153e60 0x7fe9940ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:24.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.915+0000 7fe993fff700 1 --2- 172.21.15.72:0/2356631514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9940c46c0 0x7fe9940acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.916+0000 7fe9937fe700 1 -- 172.21.15.72:0/2356631514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe994153e60 msgr2=0x7fe9940ade20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.916+0000 7fe9937fe700 1 --2- 172.21.15.72:0/2356631514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe994153e60 0x7fe9940ade20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.916+0000 7fe9937fe700 1 -- 172.21.15.72:0/2356631514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9940c46c0 msgr2=0x7fe9940acde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.916+0000 7fe9937fe700 1 --2- 172.21.15.72:0/2356631514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9940c46c0 0x7fe9940acde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.916+0000 7fe9937fe700 1 -- 172.21.15.72:0/2356631514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c009a20 con 0x7fe9940c5fb0 2023-08-31T19:03:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.916+0000 7fe9937fe700 1 --2- 172.21.15.72:0/2356631514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9940c5fb0 0x7fe994153970 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fe98800c830 tx=0x7fe988001ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.916+0000 7fe97bfff700 1 -- 172.21.15.72:0/2356631514 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988007170 con 0x7fe9940c5fb0 2023-08-31T19:03:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.916+0000 7fe97bfff700 1 -- 172.21.15.72:0/2356631514 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9880072d0 con 0x7fe9940c5fb0 2023-08-31T19:03:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.916+0000 7fe97bfff700 1 -- 172.21.15.72:0/2356631514 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9880048c0 con 0x7fe9940c5fb0 2023-08-31T19:03:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.916+0000 7fe99a5ff700 1 -- 172.21.15.72:0/2356631514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9940ab090 con 0x7fe9940c5fb0 2023-08-31T19:03:24.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.916+0000 7fe99a5ff700 1 -- 172.21.15.72:0/2356631514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9940ad2d0 con 0x7fe9940c5fb0 2023-08-31T19:03:24.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.917+0000 7fe99a5ff700 1 -- 172.21.15.72:0/2356631514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99406c6b0 con 0x7fe9940c5fb0 2023-08-31T19:03:24.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.918+0000 7fe97bfff700 1 -- 172.21.15.72:0/2356631514 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe988004c30 con 0x7fe9940c5fb0 2023-08-31T19:03:24.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.919+0000 7fe97bfff700 1 --2- 172.21.15.72:0/2356631514 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe98005ef30 0x7fe9800613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:24.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.919+0000 7fe97bfff700 1 -- 172.21.15.72:0/2356631514 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5869+0+0 (secure 0 0 0) 0x7fe988079830 con 0x7fe9940c5fb0 2023-08-31T19:03:24.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.919+0000 7fe993fff700 1 --2- 172.21.15.72:0/2356631514 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe98005ef30 0x7fe9800613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:24.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.919+0000 7fe993fff700 1 --2- 172.21.15.72:0/2356631514 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe98005ef30 0x7fe9800613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe984001170 tx=0x7fe984007bb0).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:24.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:24.923+0000 7fe97bfff700 1 -- 172.21.15.72:0/2356631514 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe98804ab00 con 0x7fe9940c5fb0 2023-08-31T19:03:25.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.095+0000 7fe99a5ff700 1 -- 172.21.15.72:0/2356631514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9940c64a0 con 0x7fe9940c5fb0 2023-08-31T19:03:25.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.096+0000 7fe97bfff700 1 -- 172.21.15.72:0/2356631514 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+14715 (secure 0 0 0) 0x7fe988019030 con 0x7fe9940c5fb0 2023-08-31T19:03:25.096 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:25.097 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":75,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:03:24.214865+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:03:25.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.098+0000 7fe99a5ff700 1 -- 172.21.15.72:0/2356631514 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe98005ef30 msgr2=0x7fe9800613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:25.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.098+0000 7fe99a5ff700 1 --2- 172.21.15.72:0/2356631514 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe98005ef30 0x7fe9800613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe984001170 tx=0x7fe984007bb0).stop 2023-08-31T19:03:25.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.098+0000 7fe99a5ff700 1 -- 172.21.15.72:0/2356631514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9940c5fb0 msgr2=0x7fe994153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:25.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.098+0000 7fe99a5ff700 1 --2- 172.21.15.72:0/2356631514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9940c5fb0 0x7fe994153970 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fe98800c830 tx=0x7fe988001ab0).stop 2023-08-31T19:03:25.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.098+0000 7fe99a5ff700 1 -- 172.21.15.72:0/2356631514 shutdown_connections 2023-08-31T19:03:25.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.098+0000 7fe99a5ff700 1 --2- 172.21.15.72:0/2356631514 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe994153e60 0x7fe9940ade20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.098+0000 7fe99a5ff700 1 --2- 172.21.15.72:0/2356631514 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe98005ef30 0x7fe9800613f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.098+0000 7fe99a5ff700 1 --2- 172.21.15.72:0/2356631514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9940c46c0 0x7fe9940acde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.098+0000 7fe99a5ff700 1 --2- 172.21.15.72:0/2356631514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9940c5fb0 0x7fe994153970 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.098+0000 7fe99a5ff700 1 -- 172.21.15.72:0/2356631514 >> 172.21.15.72:0/2356631514 conn(0x7fe994082f60 msgr2=0x7fe9940c7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:25.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.098+0000 7fe99a5ff700 1 -- 172.21.15.72:0/2356631514 shutdown_connections 2023-08-31T19:03:25.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.098+0000 7fe99a5ff700 1 -- 172.21.15.72:0/2356631514 wait complete. 2023-08-31T19:03:25.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-31T19:03:25.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:03:25.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.309+0000 7f1adc7ff700 1 Processor -- start 2023-08-31T19:03:25.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.310+0000 7f1adc7ff700 1 -- start start 2023-08-31T19:03:25.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.311+0000 7f1adc7ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ad40bdb30 0x7f1ad41542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:25.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.311+0000 7f1adc7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ad40663d0 0x7f1ad4066840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:25.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.311+0000 7f1adc7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad40a84b0 con 0x7f1ad4153ed0 2023-08-31T19:03:25.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.311+0000 7f1adc7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad40c9410 con 0x7f1ad40663d0 2023-08-31T19:03:25.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.311+0000 7f1adc7ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad40c5310 con 0x7f1ad40bdb30 2023-08-31T19:03:25.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.311+0000 7f1adad9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ad40663d0 0x7f1ad4066840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:25.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.311+0000 7f1ada59b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1ad4153ed0 0x7f1ad4155200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43592/0 (socket says 172.21.15.72:43592) 2023-08-31T19:03:25.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.311+0000 7f1ada59b700 1 -- 172.21.15.72:0/2902501720 learned_addr learned my addr 172.21.15.72:0/2902501720 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:25.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.311+0000 7f1ad9d9a700 1 --2- 172.21.15.72:0/2902501720 >> v2:172.21.15.146:3300/0 conn(0x7f1ad40bdb30 0x7f1ad41542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:25.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.311+0000 7f1adad9c700 1 -- 172.21.15.72:0/2902501720 >> v2:172.21.15.146:3300/0 conn(0x7f1ad40bdb30 msgr2=0x7f1ad41542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:25.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.311+0000 7f1adad9c700 1 --2- 172.21.15.72:0/2902501720 >> v2:172.21.15.146:3300/0 conn(0x7f1ad40bdb30 0x7f1ad41542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.312+0000 7f1adad9c700 1 -- 172.21.15.72:0/2902501720 >> v1:172.21.15.72:6789/0 conn(0x7f1ad4153ed0 legacy=0x7f1ad4155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:25.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.312+0000 7f1adad9c700 1 -- 172.21.15.72:0/2902501720 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4066d30 con 0x7f1ad40663d0 2023-08-31T19:03:25.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.312+0000 7f1ad9599700 1 -- 172.21.15.72:0/2902501720 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448077255 0 0) 0x7f1ad40a84b0 con 0x7f1ad4153ed0 2023-08-31T19:03:25.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.312+0000 7f1ad9d9a700 1 --2- 172.21.15.72:0/2902501720 >> v2:172.21.15.146:3300/0 conn(0x7f1ad40bdb30 0x7f1ad41542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:25.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.312+0000 7f1adad9c700 1 --2- 172.21.15.72:0/2902501720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad40663d0 0x7f1ad4066840 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f1ad4065f00 tx=0x7f1acc009780).ready entity=mon.0 client_cookie=1cab353d65bc3b56 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:25.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.312+0000 7f1ad9599700 1 -- 172.21.15.72:0/2902501720 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc00e070 con 0x7f1ad40663d0 2023-08-31T19:03:25.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.312+0000 7f1ad9599700 1 -- 172.21.15.72:0/2902501720 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc00bc30 con 0x7f1ad40663d0 2023-08-31T19:03:25.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.312+0000 7f1ad9599700 1 -- 172.21.15.72:0/2902501720 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc012410 con 0x7f1ad40663d0 2023-08-31T19:03:25.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.312+0000 7f1adc7ff700 1 -- 172.21.15.72:0/2902501720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad40663d0 msgr2=0x7f1ad4066840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:25.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.312+0000 7f1adc7ff700 1 --2- 172.21.15.72:0/2902501720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad40663d0 0x7f1ad4066840 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f1ad4065f00 tx=0x7f1acc009780).stop 2023-08-31T19:03:25.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.313+0000 7f1adc7ff700 1 -- 172.21.15.72:0/2902501720 shutdown_connections 2023-08-31T19:03:25.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.313+0000 7f1adc7ff700 1 --2- 172.21.15.72:0/2902501720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad40663d0 0x7f1ad4066840 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.313+0000 7f1adc7ff700 1 --2- 172.21.15.72:0/2902501720 >> v2:172.21.15.146:3300/0 conn(0x7f1ad40bdb30 0x7f1ad41542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.313+0000 7f1adc7ff700 1 -- 172.21.15.72:0/2902501720 >> 172.21.15.72:0/2902501720 conn(0x7f1ad405eb60 msgr2=0x7f1ad40c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:25.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.313+0000 7f1adc7ff700 1 -- 172.21.15.72:0/2902501720 shutdown_connections 2023-08-31T19:03:25.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.313+0000 7f1adc7ff700 1 -- 172.21.15.72:0/2902501720 wait complete. 2023-08-31T19:03:25.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.314+0000 7f1adc7ff700 1 Processor -- start 2023-08-31T19:03:25.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.314+0000 7f1adc7ff700 1 -- start start 2023-08-31T19:03:25.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.315+0000 7f1adc7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ad40663d0 0x7f1ad4156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:25.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.315+0000 7f1adc7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad4153ed0 0x7f1ad40a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:25.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.315+0000 7f1adc7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ad40aa0e0 0x7f1ad4154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:25.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.315+0000 7f1adc7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40aa520 con 0x7f1ad4153ed0 2023-08-31T19:03:25.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.315+0000 7f1adc7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40aa790 con 0x7f1ad40663d0 2023-08-31T19:03:25.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.315+0000 7f1adc7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40aaa70 con 0x7f1ad40aa0e0 2023-08-31T19:03:25.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1ad9d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad4153ed0 0x7f1ad40a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:25.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1ad9d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad4153ed0 0x7f1ad40a9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60288/0 (socket says 172.21.15.72:60288) 2023-08-31T19:03:25.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1ad9d9a700 1 -- 172.21.15.72:0/1614620136 learned_addr learned my addr 172.21.15.72:0/1614620136 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:25.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1ada59b700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ad40663d0 0x7f1ad4156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1adad9c700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ad40aa0e0 0x7f1ad4154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1ad9d9a700 1 -- 172.21.15.72:0/1614620136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ad40aa0e0 msgr2=0x7f1ad4154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1ad9d9a700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ad40aa0e0 0x7f1ad4154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1ad9d9a700 1 -- 172.21.15.72:0/1614620136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ad40663d0 msgr2=0x7f1ad4156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1ad9d9a700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ad40663d0 0x7f1ad4156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1ad9d9a700 1 -- 172.21.15.72:0/1614620136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc009a20 con 0x7f1ad4153ed0 2023-08-31T19:03:25.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1adad9c700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ad40aa0e0 0x7f1ad4154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:25.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1ada59b700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ad40663d0 0x7f1ad4156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:25.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1ad9d9a700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad4153ed0 0x7f1ad40a9bf0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f1ac400c880 tx=0x7f1ac4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:25.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1aca7fc700 1 -- 172.21.15.72:0/1614620136 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4010580 con 0x7f1ad4153ed0 2023-08-31T19:03:25.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1aca7fc700 1 -- 172.21.15.72:0/1614620136 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac40106e0 con 0x7f1ad4153ed0 2023-08-31T19:03:25.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1aca7fc700 1 -- 172.21.15.72:0/1614620136 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4010a60 con 0x7f1ad4153ed0 2023-08-31T19:03:25.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.316+0000 7f1adc7ff700 1 -- 172.21.15.72:0/1614620136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad40aad50 con 0x7f1ad4153ed0 2023-08-31T19:03:25.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.317+0000 7f1adc7ff700 1 -- 172.21.15.72:0/1614620136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad40ab310 con 0x7f1ad4153ed0 2023-08-31T19:03:25.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.318+0000 7f1adc7ff700 1 -- 172.21.15.72:0/1614620136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad406c6b0 con 0x7f1ad4153ed0 2023-08-31T19:03:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.318+0000 7f1aca7fc700 1 -- 172.21.15.72:0/1614620136 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f1ac401b460 con 0x7f1ad4153ed0 2023-08-31T19:03:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.319+0000 7f1aca7fc700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1ab805ef30 0x7f1ab80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.319+0000 7f1aca7fc700 1 -- 172.21.15.72:0/1614620136 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f1ac407a080 con 0x7f1ad4153ed0 2023-08-31T19:03:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.319+0000 7f1ada59b700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1ab805ef30 0x7f1ab80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.320+0000 7f1ada59b700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1ab805ef30 0x7f1ab80613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1ad0001710 tx=0x7f1ad0009040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:25.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.323+0000 7f1aca7fc700 1 -- 172.21.15.72:0/1614620136 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ac404b350 con 0x7f1ad4153ed0 2023-08-31T19:03:25.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.489+0000 7f1adc7ff700 1 -- 172.21.15.72:0/1614620136 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1ad40a7ef0 con 0x7f1ad4153ed0 2023-08-31T19:03:25.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.489+0000 7f1aca7fc700 1 -- 172.21.15.72:0/1614620136 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v75) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1ac404e970 con 0x7f1ad4153ed0 2023-08-31T19:03:25.490 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:03:25.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.491+0000 7f1adc7ff700 1 -- 172.21.15.72:0/1614620136 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1ab805ef30 msgr2=0x7f1ab80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:25.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.491+0000 7f1adc7ff700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1ab805ef30 0x7f1ab80613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1ad0001710 tx=0x7f1ad0009040).stop 2023-08-31T19:03:25.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.491+0000 7f1adc7ff700 1 -- 172.21.15.72:0/1614620136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad4153ed0 msgr2=0x7f1ad40a9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:25.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.491+0000 7f1adc7ff700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad4153ed0 0x7f1ad40a9bf0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f1ac400c880 tx=0x7f1ac4008040).stop 2023-08-31T19:03:25.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.491+0000 7f1adc7ff700 1 -- 172.21.15.72:0/1614620136 shutdown_connections 2023-08-31T19:03:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.491+0000 7f1adc7ff700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ad40aa0e0 0x7f1ad4154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.491+0000 7f1adc7ff700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1ab805ef30 0x7f1ab80613f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.491+0000 7f1adc7ff700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ad40663d0 0x7f1ad4156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.491+0000 7f1adc7ff700 1 --2- 172.21.15.72:0/1614620136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad4153ed0 0x7f1ad40a9bf0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.491+0000 7f1adc7ff700 1 -- 172.21.15.72:0/1614620136 >> 172.21.15.72:0/1614620136 conn(0x7f1ad405eb60 msgr2=0x7f1ad4152c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:25.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.491+0000 7f1adc7ff700 1 -- 172.21.15.72:0/1614620136 shutdown_connections 2023-08-31T19:03:25.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.491+0000 7f1adc7ff700 1 -- 172.21.15.72:0/1614620136 wait complete. 2023-08-31T19:03:25.510 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:03:25.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-08-31T19:03:25.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.702+0000 7f09849ff700 1 Processor -- start 2023-08-31T19:03:25.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.703+0000 7f09849ff700 1 -- start start 2023-08-31T19:03:25.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.704+0000 7f09849ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09800c2320 0x7f09800c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:25.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.704+0000 7f09849ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09800696a0 0x7f0980069af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:25.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.704+0000 7f09849ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09800c2cc0 con 0x7f098014ecd0 2023-08-31T19:03:25.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.704+0000 7f09849ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0980152720 con 0x7f09800c2320 2023-08-31T19:03:25.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.704+0000 7f09849ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0980151b10 con 0x7f09800696a0 2023-08-31T19:03:25.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.704+0000 7f097e59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f098014ecd0 0x7f09801556d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43604/0 (socket says 172.21.15.72:43604) 2023-08-31T19:03:25.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.704+0000 7f097e59c700 1 -- 172.21.15.72:0/2781814114 learned_addr learned my addr 172.21.15.72:0/2781814114 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:25.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.704+0000 7f097dd9b700 1 --2- 172.21.15.72:0/2781814114 >> v2:172.21.15.72:3300/0 conn(0x7f09800c2320 0x7f09800c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:25.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.704+0000 7f097ed9d700 1 --2- 172.21.15.72:0/2781814114 >> v2:172.21.15.146:3300/0 conn(0x7f09800696a0 0x7f0980069af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:25.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.704+0000 7f097d59a700 1 -- 172.21.15.72:0/2781814114 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095211542 0 0) 0x7f0970001110 con 0x7f098014ecd0 2023-08-31T19:03:25.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.705+0000 7f097d59a700 1 -- 172.21.15.72:0/2781814114 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09680033f0 con 0x7f098014ecd0 2023-08-31T19:03:25.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.705+0000 7f097dd9b700 1 -- 172.21.15.72:0/2781814114 >> v2:172.21.15.146:3300/0 conn(0x7f09800696a0 msgr2=0x7f0980069af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:25.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.705+0000 7f097dd9b700 1 --2- 172.21.15.72:0/2781814114 >> v2:172.21.15.146:3300/0 conn(0x7f09800696a0 0x7f0980069af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.705+0000 7f097dd9b700 1 -- 172.21.15.72:0/2781814114 >> v1:172.21.15.72:6789/0 conn(0x7f098014ecd0 legacy=0x7f09801556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.705+0000 7f097dd9b700 1 -- 172.21.15.72:0/2781814114 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0980151df0 con 0x7f09800c2320 2023-08-31T19:03:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.705+0000 7f097ed9d700 1 --2- 172.21.15.72:0/2781814114 >> v2:172.21.15.146:3300/0 conn(0x7f09800696a0 0x7f0980069af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.705+0000 7f097dd9b700 1 --2- 172.21.15.72:0/2781814114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09800c2320 0x7f09800c27d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f09800bd9d0 tx=0x7f0974009060).ready entity=mon.0 client_cookie=e1f6a4c1879e5e5a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.705+0000 7f097d59a700 1 -- 172.21.15.72:0/2781814114 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097400f510 con 0x7f09800c2320 2023-08-31T19:03:25.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.705+0000 7f097d59a700 1 -- 172.21.15.72:0/2781814114 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097400f670 con 0x7f09800c2320 2023-08-31T19:03:25.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.705+0000 7f097d59a700 1 -- 172.21.15.72:0/2781814114 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097400f9f0 con 0x7f09800c2320 2023-08-31T19:03:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.705+0000 7f09849ff700 1 -- 172.21.15.72:0/2781814114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09800c2320 msgr2=0x7f09800c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.705+0000 7f09849ff700 1 --2- 172.21.15.72:0/2781814114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09800c2320 0x7f09800c27d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f09800bd9d0 tx=0x7f0974009060).stop 2023-08-31T19:03:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.706+0000 7f09849ff700 1 -- 172.21.15.72:0/2781814114 shutdown_connections 2023-08-31T19:03:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.706+0000 7f09849ff700 1 --2- 172.21.15.72:0/2781814114 >> v2:172.21.15.146:3300/0 conn(0x7f09800696a0 0x7f0980069af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.706+0000 7f09849ff700 1 --2- 172.21.15.72:0/2781814114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09800c2320 0x7f09800c27d0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.706+0000 7f09849ff700 1 -- 172.21.15.72:0/2781814114 >> 172.21.15.72:0/2781814114 conn(0x7f09800630c0 msgr2=0x7f09800c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.706+0000 7f09849ff700 1 -- 172.21.15.72:0/2781814114 shutdown_connections 2023-08-31T19:03:25.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.706+0000 7f09849ff700 1 -- 172.21.15.72:0/2781814114 wait complete. 2023-08-31T19:03:25.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.707+0000 7f09849ff700 1 Processor -- start 2023-08-31T19:03:25.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.707+0000 7f09849ff700 1 -- start start 2023-08-31T19:03:25.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.708+0000 7f09849ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09800696a0 0x7f09800a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:25.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.708+0000 7f09849ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09800c2320 0x7f09800aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:25.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.708+0000 7f09849ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098014ecd0 0x7f09800aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:25.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.708+0000 7f09849ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09800ac9d0 con 0x7f09800c2320 2023-08-31T19:03:25.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.708+0000 7f09849ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09800a8d40 con 0x7f09800696a0 2023-08-31T19:03:25.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.708+0000 7f09849ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09800ac6f0 con 0x7f098014ecd0 2023-08-31T19:03:25.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.708+0000 7f097dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09800c2320 0x7f09800aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:25.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f097dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09800c2320 0x7f09800aa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60312/0 (socket says 172.21.15.72:60312) 2023-08-31T19:03:25.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f097dd9b700 1 -- 172.21.15.72:0/2746806671 learned_addr learned my addr 172.21.15.72:0/2746806671 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:25.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f097e59c700 1 --2- 172.21.15.72:0/2746806671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09800696a0 0x7f09800a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:25.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f097ed9d700 1 --2- 172.21.15.72:0/2746806671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098014ecd0 0x7f09800aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:25.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f097dd9b700 1 -- 172.21.15.72:0/2746806671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098014ecd0 msgr2=0x7f09800aaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:25.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f097dd9b700 1 --2- 172.21.15.72:0/2746806671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098014ecd0 0x7f09800aaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f097dd9b700 1 -- 172.21.15.72:0/2746806671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09800696a0 msgr2=0x7f09800a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:25.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f097dd9b700 1 --2- 172.21.15.72:0/2746806671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09800696a0 0x7f09800a9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f097dd9b700 1 -- 172.21.15.72:0/2746806671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09740092a0 con 0x7f09800c2320 2023-08-31T19:03:25.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f097ed9d700 1 --2- 172.21.15.72:0/2746806671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098014ecd0 0x7f09800aaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:25.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f097dd9b700 1 --2- 172.21.15.72:0/2746806671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09800c2320 0x7f09800aa6b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f09800634d0 tx=0x7f0974017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f096e7fc700 1 -- 172.21.15.72:0/2746806671 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097400f7e0 con 0x7f09800c2320 2023-08-31T19:03:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f096e7fc700 1 -- 172.21.15.72:0/2746806671 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097400f940 con 0x7f09800c2320 2023-08-31T19:03:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f09849ff700 1 -- 172.21.15.72:0/2746806671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09800a8fe0 con 0x7f09800c2320 2023-08-31T19:03:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f096e7fc700 1 -- 172.21.15.72:0/2746806671 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097401b690 con 0x7f09800c2320 2023-08-31T19:03:25.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.709+0000 7f09849ff700 1 -- 172.21.15.72:0/2746806671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09800aa4d0 con 0x7f09800c2320 2023-08-31T19:03:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.710+0000 7f09849ff700 1 -- 172.21.15.72:0/2746806671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09800a9310 con 0x7f09800c2320 2023-08-31T19:03:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.711+0000 7f096e7fc700 1 -- 172.21.15.72:0/2746806671 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f097401ba40 con 0x7f09800c2320 2023-08-31T19:03:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.712+0000 7f096e7fc700 1 --2- 172.21.15.72:0/2746806671 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f096005ef30 0x7f09600613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.712+0000 7f096e7fc700 1 -- 172.21.15.72:0/2746806671 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f097407b660 con 0x7f09800c2320 2023-08-31T19:03:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.712+0000 7f097e59c700 1 --2- 172.21.15.72:0/2746806671 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f096005ef30 0x7f09600613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:25.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.713+0000 7f097e59c700 1 --2- 172.21.15.72:0/2746806671 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f096005ef30 0x7f09600613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0970007fd0 tx=0x7f0970009040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:25.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.716+0000 7f096e7fc700 1 -- 172.21.15.72:0/2746806671 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f097404ca50 con 0x7f09800c2320 2023-08-31T19:03:25.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.885+0000 7f09849ff700 1 -- 172.21.15.72:0/2746806671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f09801520d0 con 0x7f09800c2320 2023-08-31T19:03:25.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.885+0000 7f096e7fc700 1 -- 172.21.15.72:0/2746806671 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v75) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0974050070 con 0x7f09800c2320 2023-08-31T19:03:25.886 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:03:25.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.887+0000 7f09849ff700 1 -- 172.21.15.72:0/2746806671 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f096005ef30 msgr2=0x7f09600613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:25.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.887+0000 7f09849ff700 1 --2- 172.21.15.72:0/2746806671 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f096005ef30 0x7f09600613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0970007fd0 tx=0x7f0970009040).stop 2023-08-31T19:03:25.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.887+0000 7f09849ff700 1 -- 172.21.15.72:0/2746806671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09800c2320 msgr2=0x7f09800aa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:25.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.887+0000 7f09849ff700 1 --2- 172.21.15.72:0/2746806671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09800c2320 0x7f09800aa6b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f09800634d0 tx=0x7f0974017000).stop 2023-08-31T19:03:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.887+0000 7f09849ff700 1 -- 172.21.15.72:0/2746806671 shutdown_connections 2023-08-31T19:03:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.887+0000 7f09849ff700 1 --2- 172.21.15.72:0/2746806671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f098014ecd0 0x7f09800aaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.887+0000 7f09849ff700 1 --2- 172.21.15.72:0/2746806671 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f096005ef30 0x7f09600613f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.887+0000 7f09849ff700 1 --2- 172.21.15.72:0/2746806671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09800696a0 0x7f09800a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.887+0000 7f09849ff700 1 --2- 172.21.15.72:0/2746806671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09800c2320 0x7f09800aa6b0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.887+0000 7f09849ff700 1 -- 172.21.15.72:0/2746806671 >> 172.21.15.72:0/2746806671 conn(0x7f09800630c0 msgr2=0x7f09800bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.888+0000 7f09849ff700 1 -- 172.21.15.72:0/2746806671 shutdown_connections 2023-08-31T19:03:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:25.888+0000 7f09849ff700 1 -- 172.21.15.72:0/2746806671 wait complete. 2023-08-31T19:03:25.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T19:03:26.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.096+0000 7fa47e3ff700 1 Processor -- start 2023-08-31T19:03:26.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.096+0000 7fa47e3ff700 1 -- start start 2023-08-31T19:03:26.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.097+0000 7fa47e3ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa478154220 0x7fa478157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:26.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.097+0000 7fa47e3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4780cb940 0x7fa4781581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:26.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.097+0000 7fa47e3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4781586b0 0x7fa478154600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:26.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.097+0000 7fa47e3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4780aa700 con 0x7fa4780cb940 2023-08-31T19:03:26.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.097+0000 7fa47e3ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4780c5e10 con 0x7fa478154220 2023-08-31T19:03:26.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.097+0000 7fa47e3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa478158b40 con 0x7fa4781586b0 2023-08-31T19:03:26.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.097+0000 7fa4777fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4780cb940 0x7fa4781581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:26.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.097+0000 7fa4777fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4780cb940 0x7fa4781581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60316/0 (socket says 172.21.15.72:60316) 2023-08-31T19:03:26.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.097+0000 7fa4777fe700 1 -- 172.21.15.72:0/1981456418 learned_addr learned my addr 172.21.15.72:0/1981456418 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:26.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.097+0000 7fa477fff700 1 --2- 172.21.15.72:0/1981456418 >> v2:172.21.15.146:3300/0 conn(0x7fa478154220 0x7fa478157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:26.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.097+0000 7fa47c99c700 1 --2- 172.21.15.72:0/1981456418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4781586b0 0x7fa478154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:26.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.098+0000 7fa4777fe700 1 -- 172.21.15.72:0/1981456418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4781586b0 msgr2=0x7fa478154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:26.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.098+0000 7fa4777fe700 1 --2- 172.21.15.72:0/1981456418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4781586b0 0x7fa478154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.098+0000 7fa4777fe700 1 -- 172.21.15.72:0/1981456418 >> v2:172.21.15.146:3300/0 conn(0x7fa478154220 msgr2=0x7fa478157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:26.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.098+0000 7fa4777fe700 1 --2- 172.21.15.72:0/1981456418 >> v2:172.21.15.146:3300/0 conn(0x7fa478154220 0x7fa478157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.098+0000 7fa4777fe700 1 -- 172.21.15.72:0/1981456418 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4780c8c90 con 0x7fa4780cb940 2023-08-31T19:03:26.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.098+0000 7fa4777fe700 1 --2- 172.21.15.72:0/1981456418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4780cb940 0x7fa4781581c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fa478065550 tx=0x7fa46c0090f0).ready entity=mon.0 client_cookie=8cc96ceac4f7d73d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:26.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.098+0000 7fa476ffd700 1 -- 172.21.15.72:0/1981456418 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c00b600 con 0x7fa4780cb940 2023-08-31T19:03:26.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.098+0000 7fa476ffd700 1 -- 172.21.15.72:0/1981456418 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46c00b760 con 0x7fa4780cb940 2023-08-31T19:03:26.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.098+0000 7fa476ffd700 1 -- 172.21.15.72:0/1981456418 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c00bae0 con 0x7fa4780cb940 2023-08-31T19:03:26.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.099+0000 7fa47e3ff700 1 -- 172.21.15.72:0/1981456418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4780cb940 msgr2=0x7fa4781581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:26.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.099+0000 7fa47e3ff700 1 --2- 172.21.15.72:0/1981456418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4780cb940 0x7fa4781581c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fa478065550 tx=0x7fa46c0090f0).stop 2023-08-31T19:03:26.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.099+0000 7fa47e3ff700 1 -- 172.21.15.72:0/1981456418 shutdown_connections 2023-08-31T19:03:26.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.099+0000 7fa47e3ff700 1 --2- 172.21.15.72:0/1981456418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa4781586b0 0x7fa478154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.099+0000 7fa47e3ff700 1 --2- 172.21.15.72:0/1981456418 >> v2:172.21.15.146:3300/0 conn(0x7fa478154220 0x7fa478157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.099+0000 7fa47e3ff700 1 --2- 172.21.15.72:0/1981456418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4780cb940 0x7fa4781581c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.099+0000 7fa47e3ff700 1 -- 172.21.15.72:0/1981456418 >> 172.21.15.72:0/1981456418 conn(0x7fa47805e870 msgr2=0x7fa4780cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:26.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.099+0000 7fa47e3ff700 1 -- 172.21.15.72:0/1981456418 shutdown_connections 2023-08-31T19:03:26.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.099+0000 7fa47e3ff700 1 -- 172.21.15.72:0/1981456418 wait complete. 2023-08-31T19:03:26.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.100+0000 7fa47e3ff700 1 Processor -- start 2023-08-31T19:03:26.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.100+0000 7fa47e3ff700 1 -- start start 2023-08-31T19:03:26.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.101+0000 7fa47e3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4780cb940 0x7fa478150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:26.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.101+0000 7fa47e3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa478154220 0x7fa478150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:26.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.101+0000 7fa47e3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4781586b0 0x7fa4780aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:26.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.101+0000 7fa47e3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4780ae710 con 0x7fa4781586b0 2023-08-31T19:03:26.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.101+0000 7fa47e3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4780c7420 con 0x7fa4780cb940 2023-08-31T19:03:26.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.101+0000 7fa47e3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4781511a0 con 0x7fa478154220 2023-08-31T19:03:26.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.101+0000 7fa47c99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4781586b0 0x7fa4780aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:26.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.102+0000 7fa47c99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4781586b0 0x7fa4780aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60324/0 (socket says 172.21.15.72:60324) 2023-08-31T19:03:26.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.102+0000 7fa47c99c700 1 -- 172.21.15.72:0/1823362191 learned_addr learned my addr 172.21.15.72:0/1823362191 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:26.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.102+0000 7fa477fff700 1 --2- 172.21.15.72:0/1823362191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4780cb940 0x7fa478150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:26.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.102+0000 7fa4777fe700 1 --2- 172.21.15.72:0/1823362191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa478154220 0x7fa478150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:26.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.102+0000 7fa47c99c700 1 -- 172.21.15.72:0/1823362191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa478154220 msgr2=0x7fa478150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:26.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.102+0000 7fa47c99c700 1 --2- 172.21.15.72:0/1823362191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa478154220 0x7fa478150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.102+0000 7fa47c99c700 1 -- 172.21.15.72:0/1823362191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4780cb940 msgr2=0x7fa478150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:26.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.102+0000 7fa47c99c700 1 --2- 172.21.15.72:0/1823362191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4780cb940 0x7fa478150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.102+0000 7fa47c99c700 1 -- 172.21.15.72:0/1823362191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c009370 con 0x7fa4781586b0 2023-08-31T19:03:26.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.102+0000 7fa47c99c700 1 --2- 172.21.15.72:0/1823362191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4781586b0 0x7fa4780aefd0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fa470007f20 tx=0x7fa470009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:26.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.102+0000 7fa45ffff700 1 -- 172.21.15.72:0/1823362191 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47000eb90 con 0x7fa4781586b0 2023-08-31T19:03:26.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.102+0000 7fa45ffff700 1 -- 172.21.15.72:0/1823362191 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47000ecf0 con 0x7fa4781586b0 2023-08-31T19:03:26.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.102+0000 7fa45ffff700 1 -- 172.21.15.72:0/1823362191 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470014610 con 0x7fa4781586b0 2023-08-31T19:03:26.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.103+0000 7fa47e3ff700 1 -- 172.21.15.72:0/1823362191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4780adde0 con 0x7fa4781586b0 2023-08-31T19:03:26.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.103+0000 7fa47e3ff700 1 -- 172.21.15.72:0/1823362191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4780ae3a0 con 0x7fa4781586b0 2023-08-31T19:03:26.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.104+0000 7fa47e3ff700 1 -- 172.21.15.72:0/1823362191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4780ae880 con 0x7fa4781586b0 2023-08-31T19:03:26.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.104+0000 7fa45ffff700 1 -- 172.21.15.72:0/1823362191 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa470014980 con 0x7fa4781586b0 2023-08-31T19:03:26.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.105+0000 7fa45ffff700 1 --2- 172.21.15.72:0/1823362191 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa46405ef00 0x7fa4640613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:26.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.105+0000 7fa45ffff700 1 -- 172.21.15.72:0/1823362191 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5869+0+0 (secure 0 0 0) 0x7fa47007a320 con 0x7fa4781586b0 2023-08-31T19:03:26.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.105+0000 7fa477fff700 1 --2- 172.21.15.72:0/1823362191 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa46405ef00 0x7fa4640613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:26.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.106+0000 7fa477fff700 1 --2- 172.21.15.72:0/1823362191 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa46405ef00 0x7fa4640613c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa468006090 tx=0x7fa468008040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:26.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.109+0000 7fa45ffff700 1 -- 172.21.15.72:0/1823362191 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa47004b650 con 0x7fa4781586b0 2023-08-31T19:03:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.278+0000 7fa47e3ff700 1 -- 172.21.15.72:0/1823362191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa47806c6b0 con 0x7fa4781586b0 2023-08-31T19:03:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.279+0000 7fa45ffff700 1 -- 172.21.15.72:0/1823362191 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) v1 ==== 84+0+143 (secure 0 0 0) 0x7fa47000ee60 con 0x7fa4781586b0 2023-08-31T19:03:26.280 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:26.280 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:03:26.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:26.280 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-08-31T19:03:26.280 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "device_health_metrics" 2023-08-31T19:03:26.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:03:26.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:26.281 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-08-31T19:03:26.281 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-08-31T19:03:26.281 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:26.282 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:03:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.281+0000 7fa47e3ff700 1 -- 172.21.15.72:0/1823362191 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa46405ef00 msgr2=0x7fa4640613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.281+0000 7fa47e3ff700 1 --2- 172.21.15.72:0/1823362191 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa46405ef00 0x7fa4640613c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa468006090 tx=0x7fa468008040).stop 2023-08-31T19:03:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.281+0000 7fa47e3ff700 1 -- 172.21.15.72:0/1823362191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4781586b0 msgr2=0x7fa4780aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.281+0000 7fa47e3ff700 1 --2- 172.21.15.72:0/1823362191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4781586b0 0x7fa4780aefd0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fa470007f20 tx=0x7fa470009860).stop 2023-08-31T19:03:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.281+0000 7fa47e3ff700 1 -- 172.21.15.72:0/1823362191 shutdown_connections 2023-08-31T19:03:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.281+0000 7fa47e3ff700 1 --2- 172.21.15.72:0/1823362191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4781586b0 0x7fa4780aefd0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.281+0000 7fa47e3ff700 1 --2- 172.21.15.72:0/1823362191 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa46405ef00 0x7fa4640613c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.281+0000 7fa47e3ff700 1 --2- 172.21.15.72:0/1823362191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4780cb940 0x7fa478150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.281+0000 7fa47e3ff700 1 --2- 172.21.15.72:0/1823362191 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa478154220 0x7fa478150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.281+0000 7fa47e3ff700 1 -- 172.21.15.72:0/1823362191 >> 172.21.15.72:0/1823362191 conn(0x7fa47805e870 msgr2=0x7fa478151b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:26.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.281+0000 7fa47e3ff700 1 -- 172.21.15.72:0/1823362191 shutdown_connections 2023-08-31T19:03:26.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.281+0000 7fa47e3ff700 1 -- 172.21.15.72:0/1823362191 wait complete. 2023-08-31T19:03:26.299 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T19:03:26.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-31T19:03:26.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.494+0000 7f12673ff700 1 Processor -- start 2023-08-31T19:03:26.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.494+0000 7f12673ff700 1 -- start start 2023-08-31T19:03:26.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.495+0000 7f12673ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1260154120 0x7f12600a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:26.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.495+0000 7f12673ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1260064db0 0x7f126015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:26.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.495+0000 7f12673ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12600aa620 con 0x7f1260154500 2023-08-31T19:03:26.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.495+0000 7f12673ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12600aa3a0 con 0x7f1260064db0 2023-08-31T19:03:26.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.495+0000 7f12673ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12600c5450 con 0x7f1260154120 2023-08-31T19:03:26.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.496+0000 7f126499a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1260154500 0x7f12600646a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43608/0 (socket says 172.21.15.72:43608) 2023-08-31T19:03:26.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.496+0000 7f126499a700 1 -- 172.21.15.72:0/2473883074 learned_addr learned my addr 172.21.15.72:0/2473883074 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:26.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.496+0000 7f126519b700 1 --2- 172.21.15.72:0/2473883074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1260154120 0x7f12600a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:26.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.496+0000 7f126599c700 1 --2- 172.21.15.72:0/2473883074 >> v2:172.21.15.146:3300/0 conn(0x7f1260064db0 0x7f126015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:26.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.496+0000 7f1257fff700 1 -- 172.21.15.72:0/2473883074 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822951676 0 0) 0x7f12600aa620 con 0x7f1260154500 2023-08-31T19:03:26.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.496+0000 7f1257fff700 1 -- 172.21.15.72:0/2473883074 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f124c0033f0 con 0x7f1260154500 2023-08-31T19:03:26.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.496+0000 7f126519b700 1 -- 172.21.15.72:0/2473883074 >> v2:172.21.15.146:3300/0 conn(0x7f1260064db0 msgr2=0x7f126015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:26.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.496+0000 7f126519b700 1 --2- 172.21.15.72:0/2473883074 >> v2:172.21.15.146:3300/0 conn(0x7f1260064db0 0x7f126015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.496+0000 7f126519b700 1 -- 172.21.15.72:0/2473883074 >> v1:172.21.15.72:6789/0 conn(0x7f1260154500 legacy=0x7f12600646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:26.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.496+0000 7f126519b700 1 -- 172.21.15.72:0/2473883074 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12600c8050 con 0x7f1260154120 2023-08-31T19:03:26.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.497+0000 7f126519b700 1 --2- 172.21.15.72:0/2473883074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1260154120 0x7f12600a9eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f125c009760 tx=0x7f125c009060).ready entity=mon.2 client_cookie=db258d6a903bd190 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:26.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.497+0000 7f1257fff700 1 -- 172.21.15.72:0/2473883074 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c00d4a0 con 0x7f1260154120 2023-08-31T19:03:26.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.497+0000 7f1257fff700 1 -- 172.21.15.72:0/2473883074 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c00d600 con 0x7f1260154120 2023-08-31T19:03:26.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.497+0000 7f1257fff700 1 -- 172.21.15.72:0/2473883074 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c00d980 con 0x7f1260154120 2023-08-31T19:03:26.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.497+0000 7f12673ff700 1 -- 172.21.15.72:0/2473883074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1260154120 msgr2=0x7f12600a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:26.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.497+0000 7f12673ff700 1 --2- 172.21.15.72:0/2473883074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1260154120 0x7f12600a9eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f125c009760 tx=0x7f125c009060).stop 2023-08-31T19:03:26.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.497+0000 7f12673ff700 1 -- 172.21.15.72:0/2473883074 shutdown_connections 2023-08-31T19:03:26.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.497+0000 7f12673ff700 1 --2- 172.21.15.72:0/2473883074 >> v2:172.21.15.146:3300/0 conn(0x7f1260064db0 0x7f126015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.497+0000 7f12673ff700 1 --2- 172.21.15.72:0/2473883074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1260154120 0x7f12600a9eb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.497+0000 7f12673ff700 1 -- 172.21.15.72:0/2473883074 >> 172.21.15.72:0/2473883074 conn(0x7f12600cb7e0 msgr2=0x7f12600c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:26.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.498+0000 7f12673ff700 1 -- 172.21.15.72:0/2473883074 shutdown_connections 2023-08-31T19:03:26.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.498+0000 7f12673ff700 1 -- 172.21.15.72:0/2473883074 wait complete. 2023-08-31T19:03:26.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.499+0000 7f12673ff700 1 Processor -- start 2023-08-31T19:03:26.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.500+0000 7f12673ff700 1 -- start start 2023-08-31T19:03:26.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.500+0000 7f12673ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1260064db0 0x7f12600c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:26.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.500+0000 7f12673ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1260154120 0x7f1260165170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:26.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.500+0000 7f12673ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1260154500 0x7f126014e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:26.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.501+0000 7f12673ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12600c32d0 con 0x7f1260154500 2023-08-31T19:03:26.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.501+0000 7f12673ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1260165660 con 0x7f1260064db0 2023-08-31T19:03:26.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.501+0000 7f12673ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12600c34e0 con 0x7f1260154120 2023-08-31T19:03:26.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.501+0000 7f126599c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1260154500 0x7f126014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:26.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.501+0000 7f126599c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1260154500 0x7f126014e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60332/0 (socket says 172.21.15.72:60332) 2023-08-31T19:03:26.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.501+0000 7f126599c700 1 -- 172.21.15.72:0/1436617811 learned_addr learned my addr 172.21.15.72:0/1436617811 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:26.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.501+0000 7f126519b700 1 --2- 172.21.15.72:0/1436617811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1260064db0 0x7f12600c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:26.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.501+0000 7f126499a700 1 --2- 172.21.15.72:0/1436617811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1260154120 0x7f1260165170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:26.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.501+0000 7f126599c700 1 -- 172.21.15.72:0/1436617811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1260154120 msgr2=0x7f1260165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:26.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.501+0000 7f126599c700 1 --2- 172.21.15.72:0/1436617811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1260154120 0x7f1260165170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.501+0000 7f126599c700 1 -- 172.21.15.72:0/1436617811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1260064db0 msgr2=0x7f12600c2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:26.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.501+0000 7f126599c700 1 --2- 172.21.15.72:0/1436617811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1260064db0 0x7f12600c2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:26.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.501+0000 7f126599c700 1 -- 172.21.15.72:0/1436617811 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c0092a0 con 0x7f1260154500 2023-08-31T19:03:26.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.501+0000 7f126499a700 1 --2- 172.21.15.72:0/1436617811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1260154120 0x7f1260165170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:26.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.501+0000 7f126599c700 1 --2- 172.21.15.72:0/1436617811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1260154500 0x7f126014e510 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f1258009ef0 tx=0x7f125800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:26.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.502+0000 7f12557fa700 1 -- 172.21.15.72:0/1436617811 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125800cc20 con 0x7f1260154500 2023-08-31T19:03:26.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.502+0000 7f12557fa700 1 -- 172.21.15.72:0/1436617811 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125800f040 con 0x7f1260154500 2023-08-31T19:03:26.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.502+0000 7f12673ff700 1 -- 172.21.15.72:0/1436617811 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12600c37c0 con 0x7f1260154500 2023-08-31T19:03:26.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.502+0000 7f12557fa700 1 -- 172.21.15.72:0/1436617811 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258013400 con 0x7f1260154500 2023-08-31T19:03:26.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.502+0000 7f12673ff700 1 -- 172.21.15.72:0/1436617811 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12600c3d80 con 0x7f1260154500 2023-08-31T19:03:26.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.503+0000 7f12673ff700 1 -- 172.21.15.72:0/1436617811 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126006c6b0 con 0x7f1260154500 2023-08-31T19:03:26.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.503+0000 7f12557fa700 1 -- 172.21.15.72:0/1436617811 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f12580137b0 con 0x7f1260154500 2023-08-31T19:03:26.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.504+0000 7f12557fa700 1 --2- 172.21.15.72:0/1436617811 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f124405ef30 0x7f12440613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:26.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.505+0000 7f12557fa700 1 -- 172.21.15.72:0/1436617811 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f125807a7f0 con 0x7f1260154500 2023-08-31T19:03:26.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.505+0000 7f126519b700 1 --2- 172.21.15.72:0/1436617811 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f124405ef30 0x7f12440613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:26.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.505+0000 7f126519b700 1 --2- 172.21.15.72:0/1436617811 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f124405ef30 0x7f12440613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f125c00d260 tx=0x7f125c016000).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:26.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.508+0000 7f12557fa700 1 -- 172.21.15.72:0/1436617811 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f125804bbe0 con 0x7f1260154500 2023-08-31T19:03:26.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:26.679+0000 7f12673ff700 1 -- 172.21.15.72:0/1436617811 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f126006a790 con 0x7f1260154500 2023-08-31T19:03:27.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.511+0000 7f12557fa700 1 -- 172.21.15.72:0/1436617811 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) v1 ==== 152+0+0 (secure 0 0 0) 0x7f125804f200 con 0x7f1260154500 2023-08-31T19:03:27.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.516+0000 7f12673ff700 1 -- 172.21.15.72:0/1436617811 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f124405ef30 msgr2=0x7f12440613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:27.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.516+0000 7f12673ff700 1 --2- 172.21.15.72:0/1436617811 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f124405ef30 0x7f12440613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f125c00d260 tx=0x7f125c016000).stop 2023-08-31T19:03:27.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.516+0000 7f12673ff700 1 -- 172.21.15.72:0/1436617811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1260154500 msgr2=0x7f126014e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:27.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.516+0000 7f12673ff700 1 --2- 172.21.15.72:0/1436617811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1260154500 0x7f126014e510 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f1258009ef0 tx=0x7f125800b040).stop 2023-08-31T19:03:27.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.516+0000 7f12673ff700 1 -- 172.21.15.72:0/1436617811 shutdown_connections 2023-08-31T19:03:27.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.516+0000 7f12673ff700 1 --2- 172.21.15.72:0/1436617811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1260154500 0x7f126014e510 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:27.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.516+0000 7f12673ff700 1 --2- 172.21.15.72:0/1436617811 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f124405ef30 0x7f12440613f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:27.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.516+0000 7f12673ff700 1 --2- 172.21.15.72:0/1436617811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1260064db0 0x7f12600c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:27.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.516+0000 7f12673ff700 1 --2- 172.21.15.72:0/1436617811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1260154120 0x7f1260165170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:27.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.516+0000 7f12673ff700 1 -- 172.21.15.72:0/1436617811 >> 172.21.15.72:0/1436617811 conn(0x7f12600cb7e0 msgr2=0x7f12600ca1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:27.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.517+0000 7f12673ff700 1 -- 172.21.15.72:0/1436617811 shutdown_connections 2023-08-31T19:03:27.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.517+0000 7f12673ff700 1 -- 172.21.15.72:0/1436617811 wait complete. 2023-08-31T19:03:27.519 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-08-31T19:03:27.537 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T19:03:27.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.734+0000 7f42783ff700 1 Processor -- start 2023-08-31T19:03:27.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.734+0000 7f42783ff700 1 -- start start 2023-08-31T19:03:27.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.736+0000 7f42783ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4270153e30 0x7f4270154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:27.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.736+0000 7f42783ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42700637c0 0x7f42700c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:27.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.736+0000 7f42783ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42700bfd40 con 0x7f42700c5cb0 2023-08-31T19:03:27.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.736+0000 7f42783ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42700c6730 con 0x7f42700637c0 2023-08-31T19:03:27.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.736+0000 7f42783ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42700bffe0 con 0x7f4270153e30 2023-08-31T19:03:27.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.736+0000 7f427699c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42700637c0 0x7f42700c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:27.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.736+0000 7f427699c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42700637c0 0x7f42700c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60338/0 (socket says 172.21.15.72:60338) 2023-08-31T19:03:27.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.736+0000 7f427699c700 1 -- 172.21.15.72:0/3609421046 learned_addr learned my addr 172.21.15.72:0/3609421046 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:27.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.736+0000 7f427619b700 1 --2- 172.21.15.72:0/3609421046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4270153e30 0x7f4270154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:27.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.737+0000 7f427699c700 1 -- 172.21.15.72:0/3609421046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4270153e30 msgr2=0x7f4270154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:27.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.737+0000 7f427699c700 1 --2- 172.21.15.72:0/3609421046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4270153e30 0x7f4270154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:27.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.737+0000 7f427699c700 1 -- 172.21.15.72:0/3609421046 >> v1:172.21.15.146:6789/0 conn(0x7f42700c5cb0 legacy=0x7f42700630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:27.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.737+0000 7f427699c700 1 -- 172.21.15.72:0/3609421046 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42700c02c0 con 0x7f42700637c0 2023-08-31T19:03:27.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.737+0000 7f427699c700 1 --2- 172.21.15.72:0/3609421046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42700637c0 0x7f42700c6130 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f4268009f20 tx=0x7f4268009840).ready entity=mon.0 client_cookie=184b9426b2a922d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:27.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.737+0000 7f4275199700 1 -- 172.21.15.72:0/3609421046 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426800e070 con 0x7f42700637c0 2023-08-31T19:03:27.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.737+0000 7f4275199700 1 -- 172.21.15.72:0/3609421046 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426800b9d0 con 0x7f42700637c0 2023-08-31T19:03:27.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.737+0000 7f4275199700 1 -- 172.21.15.72:0/3609421046 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426800bd50 con 0x7f42700637c0 2023-08-31T19:03:27.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.737+0000 7f42783ff700 1 -- 172.21.15.72:0/3609421046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42700637c0 msgr2=0x7f42700c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:27.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.738+0000 7f42783ff700 1 --2- 172.21.15.72:0/3609421046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42700637c0 0x7f42700c6130 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f4268009f20 tx=0x7f4268009840).stop 2023-08-31T19:03:27.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.738+0000 7f42783ff700 1 -- 172.21.15.72:0/3609421046 shutdown_connections 2023-08-31T19:03:27.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.738+0000 7f42783ff700 1 --2- 172.21.15.72:0/3609421046 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4270153e30 0x7f4270154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:27.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.738+0000 7f42783ff700 1 --2- 172.21.15.72:0/3609421046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42700637c0 0x7f42700c6130 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:27.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.738+0000 7f42783ff700 1 -- 172.21.15.72:0/3609421046 >> 172.21.15.72:0/3609421046 conn(0x7f427005eb20 msgr2=0x7f42700cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:27.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.738+0000 7f42783ff700 1 -- 172.21.15.72:0/3609421046 shutdown_connections 2023-08-31T19:03:27.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.738+0000 7f42783ff700 1 -- 172.21.15.72:0/3609421046 wait complete. 2023-08-31T19:03:27.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.739+0000 7f42783ff700 1 Processor -- start 2023-08-31T19:03:27.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.739+0000 7f42783ff700 1 -- start start 2023-08-31T19:03:27.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.740+0000 7f42783ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42700637c0 0x7f42700b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:27.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.740+0000 7f42783ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42700c5cb0 0x7f42700aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:27.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.740+0000 7f42783ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4270153e30 0x7f42700c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:27.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.740+0000 7f42783ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42701586c0 con 0x7f4270153e30 2023-08-31T19:03:27.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.740+0000 7f42783ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4270158960 con 0x7f42700c5cb0 2023-08-31T19:03:27.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.740+0000 7f42783ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4270158c40 con 0x7f42700637c0 2023-08-31T19:03:27.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.740+0000 7f427699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4270153e30 0x7f42700c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:27.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.741+0000 7f427699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4270153e30 0x7f42700c4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60350/0 (socket says 172.21.15.72:60350) 2023-08-31T19:03:27.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.741+0000 7f427699c700 1 -- 172.21.15.72:0/2337976849 learned_addr learned my addr 172.21.15.72:0/2337976849 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:27.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.741+0000 7f427619b700 1 --2- 172.21.15.72:0/2337976849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42700637c0 0x7f42700b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:27.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.741+0000 7f427599a700 1 --2- 172.21.15.72:0/2337976849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42700c5cb0 0x7f42700aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:27.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.741+0000 7f427699c700 1 -- 172.21.15.72:0/2337976849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42700637c0 msgr2=0x7f42700b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:27.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.741+0000 7f427699c700 1 --2- 172.21.15.72:0/2337976849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42700637c0 0x7f42700b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:27.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.741+0000 7f427699c700 1 -- 172.21.15.72:0/2337976849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42700c5cb0 msgr2=0x7f42700aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:27.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.741+0000 7f427699c700 1 --2- 172.21.15.72:0/2337976849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42700c5cb0 0x7f42700aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:27.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.741+0000 7f427699c700 1 -- 172.21.15.72:0/2337976849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4268009ae0 con 0x7f4270153e30 2023-08-31T19:03:27.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.741+0000 7f427699c700 1 --2- 172.21.15.72:0/2337976849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4270153e30 0x7f42700c4550 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f4268010000 tx=0x7f4268009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:27.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.741+0000 7f42667fc700 1 -- 172.21.15.72:0/2337976849 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268007080 con 0x7f4270153e30 2023-08-31T19:03:27.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.741+0000 7f42667fc700 1 -- 172.21.15.72:0/2337976849 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426800bd50 con 0x7f4270153e30 2023-08-31T19:03:27.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.741+0000 7f42667fc700 1 -- 172.21.15.72:0/2337976849 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426801d670 con 0x7f4270153e30 2023-08-31T19:03:27.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.741+0000 7f42783ff700 1 -- 172.21.15.72:0/2337976849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42700c4030 con 0x7f4270153e30 2023-08-31T19:03:27.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.742+0000 7f42783ff700 1 -- 172.21.15.72:0/2337976849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42700c3d20 con 0x7f4270153e30 2023-08-31T19:03:27.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.742+0000 7f42783ff700 1 -- 172.21.15.72:0/2337976849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4270158e00 con 0x7f4270153e30 2023-08-31T19:03:27.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.743+0000 7f42667fc700 1 -- 172.21.15.72:0/2337976849 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4268003040 con 0x7f4270153e30 2023-08-31T19:03:27.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.744+0000 7f42667fc700 1 --2- 172.21.15.72:0/2337976849 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f425405ef30 0x7f42540613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:27.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.744+0000 7f42667fc700 1 -- 172.21.15.72:0/2337976849 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6239+0+0 (secure 0 0 0) 0x7f426807b330 con 0x7f4270153e30 2023-08-31T19:03:27.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.744+0000 7f427619b700 1 --2- 172.21.15.72:0/2337976849 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f425405ef30 0x7f42540613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:27.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.745+0000 7f427619b700 1 --2- 172.21.15.72:0/2337976849 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f425405ef30 0x7f42540613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f426c009c30 tx=0x7f426c009060).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:27.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.749+0000 7f42667fc700 1 -- 172.21.15.72:0/2337976849 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f426804c5a0 con 0x7f4270153e30 2023-08-31T19:03:27.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:27.917+0000 7f42783ff700 1 -- 172.21.15.72:0/2337976849 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f427006c6b0 con 0x7f4270153e30 2023-08-31T19:03:28.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.509+0000 7f42667fc700 1 -- 172.21.15.72:0/2337976849 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4268022020 con 0x7f4270153e30 2023-08-31T19:03:28.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.515+0000 7f42783ff700 1 -- 172.21.15.72:0/2337976849 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f425405ef30 msgr2=0x7f42540613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:28.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.515+0000 7f42783ff700 1 --2- 172.21.15.72:0/2337976849 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f425405ef30 0x7f42540613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f426c009c30 tx=0x7f426c009060).stop 2023-08-31T19:03:28.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.515+0000 7f42783ff700 1 -- 172.21.15.72:0/2337976849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4270153e30 msgr2=0x7f42700c4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:28.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.515+0000 7f42783ff700 1 --2- 172.21.15.72:0/2337976849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4270153e30 0x7f42700c4550 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f4268010000 tx=0x7f4268009840).stop 2023-08-31T19:03:28.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.517+0000 7f42783ff700 1 -- 172.21.15.72:0/2337976849 shutdown_connections 2023-08-31T19:03:28.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.517+0000 7f42783ff700 1 --2- 172.21.15.72:0/2337976849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4270153e30 0x7f42700c4550 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:28.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.517+0000 7f42783ff700 1 --2- 172.21.15.72:0/2337976849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42700637c0 0x7f42700b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:28.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.517+0000 7f42783ff700 1 --2- 172.21.15.72:0/2337976849 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f425405ef30 0x7f42540613f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:28.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.517+0000 7f42783ff700 1 --2- 172.21.15.72:0/2337976849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42700c5cb0 0x7f42700aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:28.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.517+0000 7f42783ff700 1 -- 172.21.15.72:0/2337976849 >> 172.21.15.72:0/2337976849 conn(0x7f427005eb20 msgr2=0x7f42700acf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:28.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.520+0000 7f42783ff700 1 -- 172.21.15.72:0/2337976849 shutdown_connections 2023-08-31T19:03:28.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.520+0000 7f42783ff700 1 -- 172.21.15.72:0/2337976849 wait complete. 2023-08-31T19:03:28.524 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-08-31T19:03:28.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T19:03:28.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.743+0000 7f21c23ff700 1 Processor -- start 2023-08-31T19:03:28.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.744+0000 7f21c23ff700 1 -- start start 2023-08-31T19:03:28.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.745+0000 7f21c23ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21bc154210 0x7f21bc0630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:28.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.745+0000 7f21c23ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21bc063a30 con 0x7f21bc0635a0 2023-08-31T19:03:28.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.745+0000 7f21c23ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21bc0bfd40 con 0x7f21bc153e30 2023-08-31T19:03:28.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.745+0000 7f21c23ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc1546c0 con 0x7f21bc154210 2023-08-31T19:03:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.745+0000 7f21bb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21bc154210 0x7f21bc0630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.745+0000 7f21c099c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f21bc0635a0 0x7f21bc0c0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43620/0 (socket says 172.21.15.72:43620) 2023-08-31T19:03:28.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.745+0000 7f21c099c700 1 -- 172.21.15.72:0/3501349879 learned_addr learned my addr 172.21.15.72:0/3501349879 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:28.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.746+0000 7f21bb7fe700 1 -- 172.21.15.72:0/3501349879 >> v1:172.21.15.146:6789/0 conn(0x7f21bc153e30 legacy=0x7f21bc0c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:28.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.746+0000 7f21baffd700 1 -- 172.21.15.72:0/3501349879 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350834010 0 0) 0x7f21bc063a30 con 0x7f21bc0635a0 2023-08-31T19:03:28.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.746+0000 7f21bb7fe700 1 -- 172.21.15.72:0/3501349879 >> v1:172.21.15.72:6789/0 conn(0x7f21bc0635a0 legacy=0x7f21bc0c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:28.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.746+0000 7f21bb7fe700 1 -- 172.21.15.72:0/3501349879 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc0c6730 con 0x7f21bc154210 2023-08-31T19:03:28.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.746+0000 7f21bb7fe700 1 --2- 172.21.15.72:0/3501349879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc154210 0x7f21bc0630b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f21b0009760 tx=0x7f21b0009060).ready entity=mon.0 client_cookie=799ee7aaf87d3d6d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:28.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.746+0000 7f21baffd700 1 -- 172.21.15.72:0/3501349879 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000b580 con 0x7f21bc154210 2023-08-31T19:03:28.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.746+0000 7f21baffd700 1 -- 172.21.15.72:0/3501349879 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b000b6e0 con 0x7f21bc154210 2023-08-31T19:03:28.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.746+0000 7f21baffd700 1 -- 172.21.15.72:0/3501349879 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000ba60 con 0x7f21bc154210 2023-08-31T19:03:28.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.747+0000 7f21c23ff700 1 -- 172.21.15.72:0/3501349879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc154210 msgr2=0x7f21bc0630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:28.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.747+0000 7f21c23ff700 1 --2- 172.21.15.72:0/3501349879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc154210 0x7f21bc0630b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f21b0009760 tx=0x7f21b0009060).stop 2023-08-31T19:03:28.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.747+0000 7f21c23ff700 1 -- 172.21.15.72:0/3501349879 shutdown_connections 2023-08-31T19:03:28.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.747+0000 7f21c23ff700 1 --2- 172.21.15.72:0/3501349879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc154210 0x7f21bc0630b0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:28.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.747+0000 7f21c23ff700 1 -- 172.21.15.72:0/3501349879 >> 172.21.15.72:0/3501349879 conn(0x7f21bc05eb20 msgr2=0x7f21bc0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:28.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.747+0000 7f21c23ff700 1 -- 172.21.15.72:0/3501349879 shutdown_connections 2023-08-31T19:03:28.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.747+0000 7f21c23ff700 1 -- 172.21.15.72:0/3501349879 wait complete. 2023-08-31T19:03:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.748+0000 7f21c23ff700 1 Processor -- start 2023-08-31T19:03:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.748+0000 7f21c23ff700 1 -- start start 2023-08-31T19:03:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.749+0000 7f21c23ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc0635a0 0x7f21bc14f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.749+0000 7f21c23ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21bc153e30 0x7f21bc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.749+0000 7f21c23ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21bc154210 0x7f21bc0af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.749+0000 7f21c23ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0b04c0 con 0x7f21bc0635a0 2023-08-31T19:03:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.749+0000 7f21c23ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc14f720 con 0x7f21bc153e30 2023-08-31T19:03:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.749+0000 7f21c23ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0a1d10 con 0x7f21bc154210 2023-08-31T19:03:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.749+0000 7f21bbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc0635a0 0x7f21bc14f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.750+0000 7f21bbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc0635a0 0x7f21bc14f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60358/0 (socket says 172.21.15.72:60358) 2023-08-31T19:03:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.750+0000 7f21bbfff700 1 -- 172.21.15.72:0/320100880 learned_addr learned my addr 172.21.15.72:0/320100880 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.750+0000 7f21bbfff700 1 -- 172.21.15.72:0/320100880 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21bc154210 msgr2=0x7f21bc0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.750+0000 7f21bbfff700 1 --2- 172.21.15.72:0/320100880 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21bc154210 0x7f21bc0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.750+0000 7f21bbfff700 1 -- 172.21.15.72:0/320100880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21bc153e30 msgr2=0x7f21bc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.750+0000 7f21bb7fe700 1 --2- 172.21.15.72:0/320100880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21bc153e30 0x7f21bc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:28.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.750+0000 7f21bbfff700 1 --2- 172.21.15.72:0/320100880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21bc153e30 0x7f21bc0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:28.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.750+0000 7f21bbfff700 1 -- 172.21.15.72:0/320100880 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b00092a0 con 0x7f21bc0635a0 2023-08-31T19:03:28.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.750+0000 7f21bb7fe700 1 --2- 172.21.15.72:0/320100880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21bc153e30 0x7f21bc0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:28.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.750+0000 7f21bbfff700 1 --2- 172.21.15.72:0/320100880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc0635a0 0x7f21bc14f230 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f21ac00c4c0 tx=0x7f21ac007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:28.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.750+0000 7f21a3fff700 1 -- 172.21.15.72:0/320100880 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac007020 con 0x7f21bc0635a0 2023-08-31T19:03:28.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.750+0000 7f21a3fff700 1 -- 172.21.15.72:0/320100880 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac001e90 con 0x7f21bc0635a0 2023-08-31T19:03:28.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.750+0000 7f21c23ff700 1 -- 172.21.15.72:0/320100880 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21bc0af8b0 con 0x7f21bc0635a0 2023-08-31T19:03:28.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.750+0000 7f21a3fff700 1 -- 172.21.15.72:0/320100880 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0073b0 con 0x7f21bc0635a0 2023-08-31T19:03:28.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.750+0000 7f21c23ff700 1 -- 172.21.15.72:0/320100880 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21bc0afe70 con 0x7f21bc0635a0 2023-08-31T19:03:28.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.752+0000 7f21c23ff700 1 -- 172.21.15.72:0/320100880 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21bc0b07a0 con 0x7f21bc0635a0 2023-08-31T19:03:28.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.752+0000 7f21a3fff700 1 -- 172.21.15.72:0/320100880 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f21ac0068b0 con 0x7f21bc0635a0 2023-08-31T19:03:28.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.753+0000 7f21a3fff700 1 --2- 172.21.15.72:0/320100880 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f21a805ef30 0x7f21a80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:28.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.753+0000 7f21a3fff700 1 -- 172.21.15.72:0/320100880 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6621+0+0 (secure 0 0 0) 0x7f21ac079c00 con 0x7f21bc0635a0 2023-08-31T19:03:28.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.753+0000 7f21bb7fe700 1 --2- 172.21.15.72:0/320100880 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f21a805ef30 0x7f21a80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:28.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.754+0000 7f21bb7fe700 1 --2- 172.21.15.72:0/320100880 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f21a805ef30 0x7f21a80613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f21bc167670 tx=0x7f21b0017000).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:28.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.758+0000 7f21a3fff700 1 -- 172.21.15.72:0/320100880 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f21ac04ac40 con 0x7f21bc0635a0 2023-08-31T19:03:28.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.967+0000 7f21c23ff700 1 -- 172.21.15.72:0/320100880 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f21bc06c6b0 con 0x7f21bc0635a0 2023-08-31T19:03:28.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.972+0000 7f21a3fff700 1 -- 172.21.15.72:0/320100880 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v28) v1 ==== 173+0+0 (secure 0 0 0) 0x7f21ac04e260 con 0x7f21bc0635a0 2023-08-31T19:03:28.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.976+0000 7f21c23ff700 1 -- 172.21.15.72:0/320100880 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f21a805ef30 msgr2=0x7f21a80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:28.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.976+0000 7f21c23ff700 1 --2- 172.21.15.72:0/320100880 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f21a805ef30 0x7f21a80613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f21bc167670 tx=0x7f21b0017000).stop 2023-08-31T19:03:28.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.976+0000 7f21c23ff700 1 -- 172.21.15.72:0/320100880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc0635a0 msgr2=0x7f21bc14f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:28.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.976+0000 7f21c23ff700 1 --2- 172.21.15.72:0/320100880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc0635a0 0x7f21bc14f230 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f21ac00c4c0 tx=0x7f21ac007e00).stop 2023-08-31T19:03:28.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.977+0000 7f21c23ff700 1 -- 172.21.15.72:0/320100880 shutdown_connections 2023-08-31T19:03:28.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.977+0000 7f21c23ff700 1 --2- 172.21.15.72:0/320100880 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f21bc154210 0x7f21bc0af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:28.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.977+0000 7f21c23ff700 1 --2- 172.21.15.72:0/320100880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc0635a0 0x7f21bc14f230 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:28.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.977+0000 7f21c23ff700 1 --2- 172.21.15.72:0/320100880 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f21a805ef30 0x7f21a80613f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:28.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.977+0000 7f21c23ff700 1 --2- 172.21.15.72:0/320100880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21bc153e30 0x7f21bc0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:28.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.977+0000 7f21c23ff700 1 -- 172.21.15.72:0/320100880 >> 172.21.15.72:0/320100880 conn(0x7f21bc05eb20 msgr2=0x7f21bc0c5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:28.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.978+0000 7f21c23ff700 1 -- 172.21.15.72:0/320100880 shutdown_connections 2023-08-31T19:03:28.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:28.978+0000 7f21c23ff700 1 -- 172.21.15.72:0/320100880 wait complete. 2023-08-31T19:03:28.984 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 9 and data pool 10 2023-08-31T19:03:29.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:03:29.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.201+0000 7f0c1efff700 1 Processor -- start 2023-08-31T19:03:29.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.201+0000 7f0c1efff700 1 -- start start 2023-08-31T19:03:29.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.202+0000 7f0c1efff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0c1815ce50 0x7f0c1815f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:29.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.203+0000 7f0c1efff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c180c6120 con 0x7f0c180cb9b0 2023-08-31T19:03:29.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.203+0000 7f0c1efff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c180c5e10 con 0x7f0c18154060 2023-08-31T19:03:29.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.203+0000 7f0c1efff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c180c1380 con 0x7f0c1815ce50 2023-08-31T19:03:29.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.203+0000 7f0c17fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0c180cb9b0 0x7f0c181583e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43622/0 (socket says 172.21.15.72:43622) 2023-08-31T19:03:29.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.203+0000 7f0c17fff700 1 -- 172.21.15.72:0/826219491 learned_addr learned my addr 172.21.15.72:0/826219491 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:29.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.203+0000 7f0c1d59c700 1 --2- 172.21.15.72:0/826219491 >> v2:172.21.15.72:3300/0 conn(0x7f0c1815ce50 0x7f0c1815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:29.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.203+0000 7f0c177fe700 1 -- 172.21.15.72:0/826219491 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542480087 0 0) 0x7f0c180c6120 con 0x7f0c180cb9b0 2023-08-31T19:03:29.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.203+0000 7f0c177fe700 1 -- 172.21.15.72:0/826219491 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c080033f0 con 0x7f0c180cb9b0 2023-08-31T19:03:29.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.203+0000 7f0c1d59c700 1 -- 172.21.15.72:0/826219491 >> v1:172.21.15.146:6789/0 conn(0x7f0c18154060 legacy=0x7f0c18157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:29.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.203+0000 7f0c1d59c700 1 -- 172.21.15.72:0/826219491 >> v1:172.21.15.72:6789/0 conn(0x7f0c180cb9b0 legacy=0x7f0c181583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:29.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.203+0000 7f0c1d59c700 1 -- 172.21.15.72:0/826219491 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c18158af0 con 0x7f0c1815ce50 2023-08-31T19:03:29.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.204+0000 7f0c1d59c700 1 --2- 172.21.15.72:0/826219491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c1815ce50 0x7f0c1815f240 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f0c10009e60 tx=0x7f0c10009780).ready entity=mon.0 client_cookie=a089e6c9f8f8849b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:29.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.204+0000 7f0c177fe700 1 -- 172.21.15.72:0/826219491 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1000e070 con 0x7f0c1815ce50 2023-08-31T19:03:29.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.204+0000 7f0c177fe700 1 -- 172.21.15.72:0/826219491 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1000bb60 con 0x7f0c1815ce50 2023-08-31T19:03:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.204+0000 7f0c177fe700 1 -- 172.21.15.72:0/826219491 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c10012410 con 0x7f0c1815ce50 2023-08-31T19:03:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.204+0000 7f0c1efff700 1 -- 172.21.15.72:0/826219491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c1815ce50 msgr2=0x7f0c1815f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.204+0000 7f0c1efff700 1 --2- 172.21.15.72:0/826219491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c1815ce50 0x7f0c1815f240 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f0c10009e60 tx=0x7f0c10009780).stop 2023-08-31T19:03:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.204+0000 7f0c1efff700 1 -- 172.21.15.72:0/826219491 shutdown_connections 2023-08-31T19:03:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.204+0000 7f0c1efff700 1 --2- 172.21.15.72:0/826219491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c1815ce50 0x7f0c1815f240 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.204+0000 7f0c1efff700 1 -- 172.21.15.72:0/826219491 >> 172.21.15.72:0/826219491 conn(0x7f0c1805e870 msgr2=0x7f0c180cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.205+0000 7f0c1efff700 1 -- 172.21.15.72:0/826219491 shutdown_connections 2023-08-31T19:03:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.205+0000 7f0c1efff700 1 -- 172.21.15.72:0/826219491 wait complete. 2023-08-31T19:03:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.206+0000 7f0c1efff700 1 Processor -- start 2023-08-31T19:03:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.206+0000 7f0c1efff700 1 -- start start 2023-08-31T19:03:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.207+0000 7f0c1efff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c180cb9b0 0x7f0c180c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.207+0000 7f0c1efff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c18154060 0x7f0c1814a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.207+0000 7f0c1efff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c1815ce50 0x7f0c1814b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.207+0000 7f0c1efff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180c23f0 con 0x7f0c180cb9b0 2023-08-31T19:03:29.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.207+0000 7f0c1efff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180c7120 con 0x7f0c18154060 2023-08-31T19:03:29.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.207+0000 7f0c1efff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180c7400 con 0x7f0c1815ce50 2023-08-31T19:03:29.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.207+0000 7f0c1cd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c180cb9b0 0x7f0c180c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:29.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.207+0000 7f0c1cd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c180cb9b0 0x7f0c180c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60380/0 (socket says 172.21.15.72:60380) 2023-08-31T19:03:29.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.207+0000 7f0c1cd9b700 1 -- 172.21.15.72:0/932126863 learned_addr learned my addr 172.21.15.72:0/932126863 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:29.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.208+0000 7f0c17fff700 1 --2- 172.21.15.72:0/932126863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c18154060 0x7f0c1814a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:29.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.208+0000 7f0c1d59c700 1 --2- 172.21.15.72:0/932126863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c1815ce50 0x7f0c1814b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:29.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.208+0000 7f0c1cd9b700 1 -- 172.21.15.72:0/932126863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c1815ce50 msgr2=0x7f0c1814b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:29.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.208+0000 7f0c1cd9b700 1 --2- 172.21.15.72:0/932126863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c1815ce50 0x7f0c1814b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.208+0000 7f0c1cd9b700 1 -- 172.21.15.72:0/932126863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c18154060 msgr2=0x7f0c1814a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:29.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.208+0000 7f0c1cd9b700 1 --2- 172.21.15.72:0/932126863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c18154060 0x7f0c1814a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.208+0000 7f0c1cd9b700 1 -- 172.21.15.72:0/932126863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c10009a20 con 0x7f0c180cb9b0 2023-08-31T19:03:29.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.208+0000 7f0c1cd9b700 1 --2- 172.21.15.72:0/932126863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c180cb9b0 0x7f0c180c68d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f0c0c00c4c0 tx=0x7f0c0c007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:29.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.208+0000 7f0c14ff9700 1 -- 172.21.15.72:0/932126863 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c00f470 con 0x7f0c180cb9b0 2023-08-31T19:03:29.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.208+0000 7f0c14ff9700 1 -- 172.21.15.72:0/932126863 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c00f5d0 con 0x7f0c180cb9b0 2023-08-31T19:03:29.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.208+0000 7f0c14ff9700 1 -- 172.21.15.72:0/932126863 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c00f950 con 0x7f0c180cb9b0 2023-08-31T19:03:29.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.208+0000 7f0c1efff700 1 -- 172.21.15.72:0/932126863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c180c76e0 con 0x7f0c180cb9b0 2023-08-31T19:03:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.208+0000 7f0c1efff700 1 -- 172.21.15.72:0/932126863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c180c6dc0 con 0x7f0c180cb9b0 2023-08-31T19:03:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.209+0000 7f0c1efff700 1 -- 172.21.15.72:0/932126863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c1806c6b0 con 0x7f0c180cb9b0 2023-08-31T19:03:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.210+0000 7f0c14ff9700 1 -- 172.21.15.72:0/932126863 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0c0c00fd00 con 0x7f0c180cb9b0 2023-08-31T19:03:29.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.212+0000 7f0c14ff9700 1 --2- 172.21.15.72:0/932126863 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0bfc05ef30 0x7f0bfc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:29.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.212+0000 7f0c14ff9700 1 -- 172.21.15.72:0/932126863 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f0c0c079940 con 0x7f0c180cb9b0 2023-08-31T19:03:29.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.212+0000 7f0c17fff700 1 --2- 172.21.15.72:0/932126863 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0bfc05ef30 0x7f0bfc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:29.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.212+0000 7f0c17fff700 1 --2- 172.21.15.72:0/932126863 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0bfc05ef30 0x7f0bfc0613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f0c1814b010 tx=0x7f0c04009040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:29.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.216+0000 7f0c14ff9700 1 -- 172.21.15.72:0/932126863 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0c0c0478f0 con 0x7f0c180cb9b0 2023-08-31T19:03:29.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.385+0000 7f0c1efff700 1 -- 172.21.15.72:0/932126863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c180c0ae0 con 0x7f0c180cb9b0 2023-08-31T19:03:29.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.387+0000 7f0c14ff9700 1 -- 172.21.15.72:0/932126863 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+17946 (secure 0 0 0) 0x7f0c0c04a8b0 con 0x7f0c180cb9b0 2023-08-31T19:03:29.387 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:29.387 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":78,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:03:28.968990+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:03:26.723490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-31T19:03:27.961871+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:03:29.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.388+0000 7f0c1efff700 1 -- 172.21.15.72:0/932126863 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0bfc05ef30 msgr2=0x7f0bfc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:29.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.388+0000 7f0c1efff700 1 --2- 172.21.15.72:0/932126863 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0bfc05ef30 0x7f0bfc0613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f0c1814b010 tx=0x7f0c04009040).stop 2023-08-31T19:03:29.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.389+0000 7f0c1efff700 1 -- 172.21.15.72:0/932126863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c180cb9b0 msgr2=0x7f0c180c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:29.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.389+0000 7f0c1efff700 1 --2- 172.21.15.72:0/932126863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c180cb9b0 0x7f0c180c68d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f0c0c00c4c0 tx=0x7f0c0c007df0).stop 2023-08-31T19:03:29.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.389+0000 7f0c1efff700 1 -- 172.21.15.72:0/932126863 shutdown_connections 2023-08-31T19:03:29.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.389+0000 7f0c1efff700 1 --2- 172.21.15.72:0/932126863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c1815ce50 0x7f0c1814b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.389+0000 7f0c1efff700 1 --2- 172.21.15.72:0/932126863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c180cb9b0 0x7f0c180c68d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.389+0000 7f0c1efff700 1 --2- 172.21.15.72:0/932126863 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0bfc05ef30 0x7f0bfc0613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.389+0000 7f0c1efff700 1 --2- 172.21.15.72:0/932126863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c18154060 0x7f0c1814a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.389+0000 7f0c1efff700 1 -- 172.21.15.72:0/932126863 >> 172.21.15.72:0/932126863 conn(0x7f0c1805e870 msgr2=0x7f0c180bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:29.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.389+0000 7f0c1efff700 1 -- 172.21.15.72:0/932126863 shutdown_connections 2023-08-31T19:03:29.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.389+0000 7f0c1efff700 1 -- 172.21.15.72:0/932126863 wait complete. 2023-08-31T19:03:29.407 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:03:29.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.597+0000 7f4ae71ff700 1 Processor -- start 2023-08-31T19:03:29.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.597+0000 7f4ae71ff700 1 -- start start 2023-08-31T19:03:29.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.599+0000 7f4ae71ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ae0154060 0x7f4ae0157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:29.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.599+0000 7f4ae71ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae00c6120 con 0x7f4ae00cb9b0 2023-08-31T19:03:29.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.599+0000 7f4ae71ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae00c5e10 con 0x7f4ae01588d0 2023-08-31T19:03:29.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.599+0000 7f4ae71ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae00c1380 con 0x7f4ae0154060 2023-08-31T19:03:29.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.599+0000 7f4adffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4ae00cb9b0 0x7f4ae01581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43638/0 (socket says 172.21.15.72:43638) 2023-08-31T19:03:29.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.599+0000 7f4adffff700 1 -- 172.21.15.72:0/3884951291 learned_addr learned my addr 172.21.15.72:0/3884951291 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:29.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.599+0000 7f4ae4f9b700 1 --2- 172.21.15.72:0/3884951291 >> v2:172.21.15.146:3300/0 conn(0x7f4ae0154060 0x7f4ae0157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:29.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.599+0000 7f4adf7fe700 1 -- 172.21.15.72:0/3884951291 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279860474 0 0) 0x7f4ae00c6120 con 0x7f4ae00cb9b0 2023-08-31T19:03:29.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.599+0000 7f4adf7fe700 1 -- 172.21.15.72:0/3884951291 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ad00033f0 con 0x7f4ae00cb9b0 2023-08-31T19:03:29.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4adf7fe700 1 -- 172.21.15.72:0/3884951291 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 110547599 0 0) 0x7f4ad00033f0 con 0x7f4ae00cb9b0 2023-08-31T19:03:29.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4adf7fe700 1 -- 172.21.15.72:0/3884951291 >> v2:172.21.15.146:3300/0 conn(0x7f4ae0154060 msgr2=0x7f4ae0157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:29.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4adf7fe700 1 --2- 172.21.15.72:0/3884951291 >> v2:172.21.15.146:3300/0 conn(0x7f4ae0154060 0x7f4ae0157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4adf7fe700 1 -- 172.21.15.72:0/3884951291 >> v1:172.21.15.146:6789/0 conn(0x7f4ae01588d0 legacy=0x7f4ae0154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4adf7fe700 1 -- 172.21.15.72:0/3884951291 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae00c0ae0 con 0x7f4ae00cb9b0 2023-08-31T19:03:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4adf7fe700 1 -- 172.21.15.72:0/3884951291 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f4acc001470 con 0x7f4ae00cb9b0 2023-08-31T19:03:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4ae4f9b700 1 --2- 172.21.15.72:0/3884951291 >> v2:172.21.15.146:3300/0 conn(0x7f4ae0154060 0x7f4ae0157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:03:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4adf7fe700 1 -- 172.21.15.72:0/3884951291 >> v1:172.21.15.72:6789/0 conn(0x7f4ae00cb9b0 legacy=0x7f4ae01581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4adf7fe700 1 --2- 172.21.15.72:0/3884951291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ad00038e0 0x7f4ad0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4adf7fe700 1 --2- 172.21.15.72:0/3884951291 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad0004690 0x7f4ad0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4adf7fe700 1 --2- 172.21.15.72:0/3884951291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad0005000 0x7f4ad000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4adf7fe700 1 -- 172.21.15.72:0/3884951291 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00c1380 con 0x7f4ad00038e0 2023-08-31T19:03:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4adf7fe700 1 -- 172.21.15.72:0/3884951291 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad000beb0 con 0x7f4ad0005000 2023-08-31T19:03:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4adf7fe700 1 -- 172.21.15.72:0/3884951291 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad000c070 con 0x7f4ad0004690 2023-08-31T19:03:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4ae4f9b700 1 --2- 172.21.15.72:0/3884951291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ad00038e0 0x7f4ad0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4adffff700 1 --2- 172.21.15.72:0/3884951291 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad0004690 0x7f4ad0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4ae579c700 1 --2- 172.21.15.72:0/3884951291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad0005000 0x7f4ad000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4ae4f9b700 1 -- 172.21.15.72:0/3884951291 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad0004690 msgr2=0x7f4ad0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:29.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4ae4f9b700 1 --2- 172.21.15.72:0/3884951291 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ad0004690 0x7f4ad0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4ae4f9b700 1 -- 172.21.15.72:0/3884951291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad0005000 msgr2=0x7f4ad000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:29.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4ae4f9b700 1 --2- 172.21.15.72:0/3884951291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad0005000 0x7f4ad000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4ae4f9b700 1 -- 172.21.15.72:0/3884951291 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad00033f0 con 0x7f4ad00038e0 2023-08-31T19:03:29.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.600+0000 7f4ae579c700 1 -- 172.21.15.72:0/3884951291 reap_dead start 2023-08-31T19:03:29.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.601+0000 7f4ae4f9b700 1 --2- 172.21.15.72:0/3884951291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ad00038e0 0x7f4ad0003d00 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f4ad4009d00 tx=0x7f4ad4006f40).ready entity=mon.0 client_cookie=36b197ebb014699f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:29.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.601+0000 7f4adf7fe700 1 -- 172.21.15.72:0/3884951291 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4009e60 con 0x7f4ad00038e0 2023-08-31T19:03:29.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.601+0000 7f4adf7fe700 1 -- 172.21.15.72:0/3884951291 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad4009670 con 0x7f4ad00038e0 2023-08-31T19:03:29.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.601+0000 7f4adf7fe700 1 -- 172.21.15.72:0/3884951291 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad400eb30 con 0x7f4ad00038e0 2023-08-31T19:03:29.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.601+0000 7f4ae71ff700 1 -- 172.21.15.72:0/3884951291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ad00038e0 msgr2=0x7f4ad0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:29.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.601+0000 7f4ae71ff700 1 --2- 172.21.15.72:0/3884951291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ad00038e0 0x7f4ad0003d00 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f4ad4009d00 tx=0x7f4ad4006f40).stop 2023-08-31T19:03:29.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.601+0000 7f4ae71ff700 1 -- 172.21.15.72:0/3884951291 shutdown_connections 2023-08-31T19:03:29.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.601+0000 7f4ae71ff700 1 --2- 172.21.15.72:0/3884951291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ad00038e0 0x7f4ad0003d00 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.601+0000 7f4ae71ff700 1 -- 172.21.15.72:0/3884951291 >> 172.21.15.72:0/3884951291 conn(0x7f4ae005e870 msgr2=0x7f4ae00cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:29.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.601+0000 7f4ae71ff700 1 -- 172.21.15.72:0/3884951291 shutdown_connections 2023-08-31T19:03:29.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.601+0000 7f4ae71ff700 1 -- 172.21.15.72:0/3884951291 wait complete. 2023-08-31T19:03:29.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.603+0000 7f4ae71ff700 1 Processor -- start 2023-08-31T19:03:29.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.603+0000 7f4ae71ff700 1 -- start start 2023-08-31T19:03:29.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.604+0000 7f4ae71ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad00038e0 0x7f4ae0164e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:29.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.604+0000 7f4ae71ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ae00b05a0 0x7f4ae0150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:29.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.604+0000 7f4ae71ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ae0151ef0 0x7f4ae00ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:29.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.604+0000 7f4ae71ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00b0d30 con 0x7f4ae0151ef0 2023-08-31T19:03:29.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.604+0000 7f4ae71ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae0156290 con 0x7f4ad00038e0 2023-08-31T19:03:29.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.604+0000 7f4ae71ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae0165310 con 0x7f4ae00b05a0 2023-08-31T19:03:29.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.604+0000 7f4ae579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ae0151ef0 0x7f4ae00ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:29.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.604+0000 7f4ae579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ae0151ef0 0x7f4ae00ae1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60394/0 (socket says 172.21.15.72:60394) 2023-08-31T19:03:29.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.604+0000 7f4ae579c700 1 -- 172.21.15.72:0/1414822441 learned_addr learned my addr 172.21.15.72:0/1414822441 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:29.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.604+0000 7f4adffff700 1 --2- 172.21.15.72:0/1414822441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ae00b05a0 0x7f4ae0150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:29.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.604+0000 7f4ae4f9b700 1 --2- 172.21.15.72:0/1414822441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad00038e0 0x7f4ae0164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:29.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.605+0000 7f4ae579c700 1 -- 172.21.15.72:0/1414822441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ae00b05a0 msgr2=0x7f4ae0150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:29.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.605+0000 7f4ae579c700 1 --2- 172.21.15.72:0/1414822441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ae00b05a0 0x7f4ae0150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.605+0000 7f4ae579c700 1 -- 172.21.15.72:0/1414822441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad00038e0 msgr2=0x7f4ae0164e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:29.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.605+0000 7f4ae579c700 1 --2- 172.21.15.72:0/1414822441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad00038e0 0x7f4ae0164e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.605+0000 7f4ae579c700 1 -- 172.21.15.72:0/1414822441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae0155960 con 0x7f4ae0151ef0 2023-08-31T19:03:29.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.605+0000 7f4adffff700 1 --2- 172.21.15.72:0/1414822441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ae00b05a0 0x7f4ae0150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:29.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.605+0000 7f4ae579c700 1 --2- 172.21.15.72:0/1414822441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ae0151ef0 0x7f4ae00ae1c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f4ae00837d0 tx=0x7f4ad8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:29.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.605+0000 7f4adcff9700 1 -- 172.21.15.72:0/1414822441 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80030d0 con 0x7f4ae0151ef0 2023-08-31T19:03:29.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.605+0000 7f4adcff9700 1 -- 172.21.15.72:0/1414822441 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad8003230 con 0x7f4ae0151ef0 2023-08-31T19:03:29.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.605+0000 7f4adcff9700 1 -- 172.21.15.72:0/1414822441 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80017c0 con 0x7f4ae0151ef0 2023-08-31T19:03:29.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.605+0000 7f4ae71ff700 1 -- 172.21.15.72:0/1414822441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae0155c40 con 0x7f4ae0151ef0 2023-08-31T19:03:29.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.605+0000 7f4ae71ff700 1 -- 172.21.15.72:0/1414822441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae00b0a20 con 0x7f4ae0151ef0 2023-08-31T19:03:29.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.606+0000 7f4ae71ff700 1 -- 172.21.15.72:0/1414822441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae00a9fd0 con 0x7f4ae0151ef0 2023-08-31T19:03:29.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.607+0000 7f4adcff9700 1 -- 172.21.15.72:0/1414822441 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4ad8001b30 con 0x7f4ae0151ef0 2023-08-31T19:03:29.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.608+0000 7f4adcff9700 1 --2- 172.21.15.72:0/1414822441 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ac405ef30 0x7f4ac40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:29.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.608+0000 7f4adcff9700 1 -- 172.21.15.72:0/1414822441 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f4ad8079460 con 0x7f4ae0151ef0 2023-08-31T19:03:29.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.608+0000 7f4ae4f9b700 1 --2- 172.21.15.72:0/1414822441 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ac405ef30 0x7f4ac40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:29.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.609+0000 7f4ae4f9b700 1 --2- 172.21.15.72:0/1414822441 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ac405ef30 0x7f4ac40613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4ad4009820 tx=0x7f4ad4019000).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:29.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.612+0000 7f4adcff9700 1 -- 172.21.15.72:0/1414822441 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ad804a4f0 con 0x7f4ae0151ef0 2023-08-31T19:03:29.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.781+0000 7f4ae71ff700 1 -- 172.21.15.72:0/1414822441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ae0156420 con 0x7f4ae0151ef0 2023-08-31T19:03:29.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.782+0000 7f4adcff9700 1 -- 172.21.15.72:0/1414822441 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+17946 (secure 0 0 0) 0x7f4ad804db10 con 0x7f4ae0151ef0 2023-08-31T19:03:29.783 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:29.783 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":78,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:03:28.968990+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:03:26.723490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-31T19:03:27.961871+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:03:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.784+0000 7f4ae71ff700 1 -- 172.21.15.72:0/1414822441 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ac405ef30 msgr2=0x7f4ac40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.784+0000 7f4ae71ff700 1 --2- 172.21.15.72:0/1414822441 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ac405ef30 0x7f4ac40613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4ad4009820 tx=0x7f4ad4019000).stop 2023-08-31T19:03:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.784+0000 7f4ae71ff700 1 -- 172.21.15.72:0/1414822441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ae0151ef0 msgr2=0x7f4ae00ae1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.784+0000 7f4ae71ff700 1 --2- 172.21.15.72:0/1414822441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ae0151ef0 0x7f4ae00ae1c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f4ae00837d0 tx=0x7f4ad8009040).stop 2023-08-31T19:03:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.784+0000 7f4ae71ff700 1 -- 172.21.15.72:0/1414822441 shutdown_connections 2023-08-31T19:03:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.784+0000 7f4ae71ff700 1 --2- 172.21.15.72:0/1414822441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ae0151ef0 0x7f4ae00ae1c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.784+0000 7f4ae71ff700 1 --2- 172.21.15.72:0/1414822441 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ac405ef30 0x7f4ac40613f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.784+0000 7f4ae71ff700 1 --2- 172.21.15.72:0/1414822441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad00038e0 0x7f4ae0164e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.784+0000 7f4ae71ff700 1 --2- 172.21.15.72:0/1414822441 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ae00b05a0 0x7f4ae0150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.784+0000 7f4ae71ff700 1 -- 172.21.15.72:0/1414822441 >> 172.21.15.72:0/1414822441 conn(0x7f4ae005e870 msgr2=0x7f4ae0157c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.784+0000 7f4ae71ff700 1 -- 172.21.15.72:0/1414822441 shutdown_connections 2023-08-31T19:03:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.784+0000 7f4ae71ff700 1 -- 172.21.15.72:0/1414822441 wait complete. 2023-08-31T19:03:29.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T19:03:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.998+0000 7fb50d7ff700 1 Processor -- start 2023-08-31T19:03:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.998+0000 7fb50d7ff700 1 -- start start 2023-08-31T19:03:30.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.999+0000 7fb50d7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb508066ae0 0x7fb5081542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:30.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.999+0000 7fb50d7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5080a84b0 con 0x7fb508153ed0 2023-08-31T19:03:30.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.999+0000 7fb50d7ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5080c9410 con 0x7fb5080bdb30 2023-08-31T19:03:30.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:29.999+0000 7fb50d7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5080c5310 con 0x7fb508066ae0 2023-08-31T19:03:30.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.000+0000 7fb506ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb508153ed0 0x7fb508155200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43648/0 (socket says 172.21.15.72:43648) 2023-08-31T19:03:30.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.000+0000 7fb506ffd700 1 -- 172.21.15.72:0/143329733 learned_addr learned my addr 172.21.15.72:0/143329733 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:30.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.000+0000 7fb5077fe700 1 --2- 172.21.15.72:0/143329733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb508066ae0 0x7fb5081542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:30.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.000+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134013712 0 0) 0x7fb5080a84b0 con 0x7fb508153ed0 2023-08-31T19:03:30.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.000+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4f00033f0 con 0x7fb508153ed0 2023-08-31T19:03:30.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.000+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860782827 0 0) 0x7fb5080c9410 con 0x7fb5080bdb30 2023-08-31T19:03:30.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.000+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5080a84b0 con 0x7fb5080bdb30 2023-08-31T19:03:30.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.000+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3543777508 0 0) 0x7fb4f00033f0 con 0x7fb508153ed0 2023-08-31T19:03:30.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.000+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb508066ae0 msgr2=0x7fb5081542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:30.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.000+0000 7fb505ffb700 1 --2- 172.21.15.72:0/143329733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb508066ae0 0x7fb5081542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:30.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.000+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 >> v1:172.21.15.146:6789/0 conn(0x7fb5080bdb30 legacy=0x7fb5080663d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:30.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.000+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5080a7ef0 con 0x7fb508153ed0 2023-08-31T19:03:30.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.000+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fb4f8001470 con 0x7fb508153ed0 2023-08-31T19:03:30.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.000+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 >> v1:172.21.15.72:6789/0 conn(0x7fb508153ed0 legacy=0x7fb508155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:30.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.001+0000 7fb505ffb700 1 --2- 172.21.15.72:0/143329733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4f0003aa0 0x7fb4f0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:30.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.001+0000 7fb505ffb700 1 --2- 172.21.15.72:0/143329733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb508066ae0 0x7fb4f0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:30.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.001+0000 7fb505ffb700 1 --2- 172.21.15.72:0/143329733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4f0004b80 0x7fb4f0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:30.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.001+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5080c5310 con 0x7fb4f0004b80 2023-08-31T19:03:30.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.001+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f000b910 con 0x7fb4f0003aa0 2023-08-31T19:03:30.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.001+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f000bad0 con 0x7fb508066ae0 2023-08-31T19:03:30.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.001+0000 7fb5077fe700 1 --2- 172.21.15.72:0/143329733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4f0004b80 0x7fb4f0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:30.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.001+0000 7fb506ffd700 1 --2- 172.21.15.72:0/143329733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4f0003aa0 0x7fb4f0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:30.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.001+0000 7fb5067fc700 1 --2- 172.21.15.72:0/143329733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb508066ae0 0x7fb4f0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:30.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.001+0000 7fb5077fe700 1 -- 172.21.15.72:0/143329733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb508066ae0 msgr2=0x7fb4f0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:30.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.001+0000 7fb5077fe700 1 --2- 172.21.15.72:0/143329733 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb508066ae0 0x7fb4f0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:30.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.001+0000 7fb5077fe700 1 -- 172.21.15.72:0/143329733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4f0003aa0 msgr2=0x7fb4f0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:30.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.001+0000 7fb5077fe700 1 --2- 172.21.15.72:0/143329733 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4f0003aa0 0x7fb4f0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:30.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.001+0000 7fb5077fe700 1 -- 172.21.15.72:0/143329733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f00033f0 con 0x7fb4f0004b80 2023-08-31T19:03:30.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.001+0000 7fb5077fe700 1 --2- 172.21.15.72:0/143329733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4f0004b80 0x7fb4f0005000 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fb5080c93c0 tx=0x7fb50000b040).ready entity=mon.0 client_cookie=2eb90a3bb1ba1aec server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:30.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.002+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500009ac0 con 0x7fb4f0004b80 2023-08-31T19:03:30.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.002+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50000f040 con 0x7fb4f0004b80 2023-08-31T19:03:30.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.002+0000 7fb505ffb700 1 -- 172.21.15.72:0/143329733 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50000ec40 con 0x7fb4f0004b80 2023-08-31T19:03:30.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.002+0000 7fb50d7ff700 1 -- 172.21.15.72:0/143329733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4f0004b80 msgr2=0x7fb4f0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:30.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.002+0000 7fb50d7ff700 1 --2- 172.21.15.72:0/143329733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4f0004b80 0x7fb4f0005000 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fb5080c93c0 tx=0x7fb50000b040).stop 2023-08-31T19:03:30.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.002+0000 7fb5077fe700 1 -- 172.21.15.72:0/143329733 reap_dead start 2023-08-31T19:03:30.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.002+0000 7fb50d7ff700 1 -- 172.21.15.72:0/143329733 shutdown_connections 2023-08-31T19:03:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.002+0000 7fb50d7ff700 1 -- 172.21.15.72:0/143329733 >> 172.21.15.72:0/143329733 conn(0x7fb50805eb60 msgr2=0x7fb5080c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.002+0000 7fb50d7ff700 1 -- 172.21.15.72:0/143329733 shutdown_connections 2023-08-31T19:03:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.002+0000 7fb50d7ff700 1 -- 172.21.15.72:0/143329733 wait complete. 2023-08-31T19:03:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.004+0000 7fb50d7ff700 1 Processor -- start 2023-08-31T19:03:30.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.005+0000 7fb50d7ff700 1 -- start start 2023-08-31T19:03:30.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb50d7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4f0004b80 0x7fb5080a86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:30.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb50d7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb508155df0 0x7fb508156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:30.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb50d7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508150420 0x7fb5081508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:30.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb50d7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5080ab790 con 0x7fb508150420 2023-08-31T19:03:30.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb50d7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5081549d0 con 0x7fb4f0004b80 2023-08-31T19:03:30.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb50d7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5080aaef0 con 0x7fb508155df0 2023-08-31T19:03:30.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb5077fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508150420 0x7fb5081508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:30.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb5077fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508150420 0x7fb5081508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60418/0 (socket says 172.21.15.72:60418) 2023-08-31T19:03:30.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb5077fe700 1 -- 172.21.15.72:0/2803682662 learned_addr learned my addr 172.21.15.72:0/2803682662 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:30.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb506ffd700 1 --2- 172.21.15.72:0/2803682662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4f0004b80 0x7fb5080a86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:30.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb5067fc700 1 --2- 172.21.15.72:0/2803682662 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb508155df0 0x7fb508156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:30.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb5077fe700 1 -- 172.21.15.72:0/2803682662 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb508155df0 msgr2=0x7fb508156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:30.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb5077fe700 1 --2- 172.21.15.72:0/2803682662 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb508155df0 0x7fb508156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:30.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb5077fe700 1 -- 172.21.15.72:0/2803682662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4f0004b80 msgr2=0x7fb5080a86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:30.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb5077fe700 1 --2- 172.21.15.72:0/2803682662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4f0004b80 0x7fb5080a86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:30.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.006+0000 7fb5077fe700 1 -- 172.21.15.72:0/2803682662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5080ab1d0 con 0x7fb508150420 2023-08-31T19:03:30.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.007+0000 7fb5077fe700 1 --2- 172.21.15.72:0/2803682662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508150420 0x7fb5081508a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fb500014000 tx=0x7fb50001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:30.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.007+0000 7fb4eeffd700 1 -- 172.21.15.72:0/2803682662 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500021030 con 0x7fb508150420 2023-08-31T19:03:30.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.007+0000 7fb4eeffd700 1 -- 172.21.15.72:0/2803682662 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb500009ac0 con 0x7fb508150420 2023-08-31T19:03:30.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.007+0000 7fb4eeffd700 1 -- 172.21.15.72:0/2803682662 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500013e70 con 0x7fb508150420 2023-08-31T19:03:30.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.007+0000 7fb50d7ff700 1 -- 172.21.15.72:0/2803682662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5080ab4b0 con 0x7fb508150420 2023-08-31T19:03:30.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.007+0000 7fb50d7ff700 1 -- 172.21.15.72:0/2803682662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5080a8ba0 con 0x7fb508150420 2023-08-31T19:03:30.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.008+0000 7fb50d7ff700 1 -- 172.21.15.72:0/2803682662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb508154830 con 0x7fb508150420 2023-08-31T19:03:30.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.009+0000 7fb4eeffd700 1 -- 172.21.15.72:0/2803682662 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb500024070 con 0x7fb508150420 2023-08-31T19:03:30.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.010+0000 7fb4eeffd700 1 --2- 172.21.15.72:0/2803682662 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4f405ef30 0x7fb4f40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:30.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.010+0000 7fb4eeffd700 1 -- 172.21.15.72:0/2803682662 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7fb500022070 con 0x7fb508150420 2023-08-31T19:03:30.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.010+0000 7fb506ffd700 1 --2- 172.21.15.72:0/2803682662 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4f405ef30 0x7fb4f40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:30.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.011+0000 7fb506ffd700 1 --2- 172.21.15.72:0/2803682662 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4f405ef30 0x7fb4f40613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb4f8001200 tx=0x7fb4f8009040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:30.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.014+0000 7fb4eeffd700 1 -- 172.21.15.72:0/2803682662 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb508154830 con 0x7fb508150420 2023-08-31T19:03:30.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.227+0000 7fb50d7ff700 1 -- 172.21.15.72:0/2803682662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb508154830 con 0x7fb508150420 2023-08-31T19:03:30.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.984+0000 7fb4eeffd700 1 -- 172.21.15.72:0/2803682662 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb508154830 con 0x7fb508150420 2023-08-31T19:03:30.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.987+0000 7fb50d7ff700 1 -- 172.21.15.72:0/2803682662 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4f405ef30 msgr2=0x7fb4f40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:30.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.987+0000 7fb50d7ff700 1 --2- 172.21.15.72:0/2803682662 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4f405ef30 0x7fb4f40613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb4f8001200 tx=0x7fb4f8009040).stop 2023-08-31T19:03:30.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.987+0000 7fb50d7ff700 1 -- 172.21.15.72:0/2803682662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508150420 msgr2=0x7fb5081508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:30.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.987+0000 7fb50d7ff700 1 --2- 172.21.15.72:0/2803682662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508150420 0x7fb5081508a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fb500014000 tx=0x7fb50001a000).stop 2023-08-31T19:03:30.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.987+0000 7fb50d7ff700 1 -- 172.21.15.72:0/2803682662 shutdown_connections 2023-08-31T19:03:30.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.987+0000 7fb50d7ff700 1 --2- 172.21.15.72:0/2803682662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb508150420 0x7fb5081508a0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.987+0000 7fb50d7ff700 1 --2- 172.21.15.72:0/2803682662 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4f405ef30 0x7fb4f40613f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.987+0000 7fb50d7ff700 1 --2- 172.21.15.72:0/2803682662 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4f0004b80 0x7fb5080a86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.987+0000 7fb50d7ff700 1 --2- 172.21.15.72:0/2803682662 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb508155df0 0x7fb508156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.987+0000 7fb50d7ff700 1 -- 172.21.15.72:0/2803682662 >> 172.21.15.72:0/2803682662 conn(0x7fb50805eb60 msgr2=0x7fb508151480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.987+0000 7fb50d7ff700 1 -- 172.21.15.72:0/2803682662 shutdown_connections 2023-08-31T19:03:30.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:30.987+0000 7fb50d7ff700 1 -- 172.21.15.72:0/2803682662 wait complete. 2023-08-31T19:03:31.005 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-31T19:03:31.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T19:03:31.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.199+0000 7f4bc89ff700 1 Processor -- start 2023-08-31T19:03:31.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.199+0000 7f4bc89ff700 1 -- start start 2023-08-31T19:03:31.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.200+0000 7f4bc89ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4bc40690e0 0x7f4bc405e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:31.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.200+0000 7f4bc89ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc40c38d0 0x7f4bc40bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:31.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.200+0000 7f4bc89ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc40bc4a0 con 0x7f4bc41544e0 2023-08-31T19:03:31.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.200+0000 7f4bc89ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc405e840 con 0x7f4bc40690e0 2023-08-31T19:03:31.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.200+0000 7f4bc89ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc4069c40 con 0x7f4bc40c38d0 2023-08-31T19:03:31.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.201+0000 7f4bc1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4bc40690e0 0x7f4bc405e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:31.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.201+0000 7f4bc1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4bc40690e0 0x7f4bc405e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60428/0 (socket says 172.21.15.72:60428) 2023-08-31T19:03:31.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.201+0000 7f4bc1d9b700 1 -- 172.21.15.72:0/1014773657 learned_addr learned my addr 172.21.15.72:0/1014773657 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:31.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.201+0000 7f4bc1d9b700 1 -- 172.21.15.72:0/1014773657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc40c38d0 msgr2=0x7f4bc40bc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:31.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.201+0000 7f4bc2d9d700 1 --2- 172.21.15.72:0/1014773657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc40c38d0 0x7f4bc40bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:31.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.201+0000 7f4bc1d9b700 1 --2- 172.21.15.72:0/1014773657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc40c38d0 0x7f4bc40bc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:31.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.201+0000 7f4bc1d9b700 1 -- 172.21.15.72:0/1014773657 >> v1:172.21.15.146:6789/0 conn(0x7f4bc41544e0 legacy=0x7f4bc40689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:31.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.201+0000 7f4bc1d9b700 1 -- 172.21.15.72:0/1014773657 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc40c1c30 con 0x7f4bc40690e0 2023-08-31T19:03:31.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.201+0000 7f4bc2d9d700 1 --2- 172.21.15.72:0/1014773657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc40c38d0 0x7f4bc40bc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:31.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.201+0000 7f4bc1d9b700 1 --2- 172.21.15.72:0/1014773657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc40690e0 0x7f4bc405e350 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f4bb8006fd0 tx=0x7f4bb80090f0).ready entity=mon.0 client_cookie=d2fecf6be1cfa223 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:31.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.202+0000 7f4bc159a700 1 -- 172.21.15.72:0/1014773657 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb800b600 con 0x7f4bc40690e0 2023-08-31T19:03:31.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.202+0000 7f4bc159a700 1 -- 172.21.15.72:0/1014773657 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb800b760 con 0x7f4bc40690e0 2023-08-31T19:03:31.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.202+0000 7f4bc159a700 1 -- 172.21.15.72:0/1014773657 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb800bb00 con 0x7f4bc40690e0 2023-08-31T19:03:31.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.202+0000 7f4bc89ff700 1 -- 172.21.15.72:0/1014773657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc40690e0 msgr2=0x7f4bc405e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:31.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.202+0000 7f4bc89ff700 1 --2- 172.21.15.72:0/1014773657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc40690e0 0x7f4bc405e350 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f4bb8006fd0 tx=0x7f4bb80090f0).stop 2023-08-31T19:03:31.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.202+0000 7f4bc89ff700 1 -- 172.21.15.72:0/1014773657 shutdown_connections 2023-08-31T19:03:31.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.202+0000 7f4bc89ff700 1 --2- 172.21.15.72:0/1014773657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc40c38d0 0x7f4bc40bc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:31.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.202+0000 7f4bc89ff700 1 --2- 172.21.15.72:0/1014773657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc40690e0 0x7f4bc405e350 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:31.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.202+0000 7f4bc89ff700 1 -- 172.21.15.72:0/1014773657 >> 172.21.15.72:0/1014773657 conn(0x7f4bc40c7e00 msgr2=0x7f4bc40c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:31.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.202+0000 7f4bc89ff700 1 -- 172.21.15.72:0/1014773657 shutdown_connections 2023-08-31T19:03:31.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.202+0000 7f4bc89ff700 1 -- 172.21.15.72:0/1014773657 wait complete. 2023-08-31T19:03:31.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.204+0000 7f4bc89ff700 1 Processor -- start 2023-08-31T19:03:31.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.204+0000 7f4bc89ff700 1 -- start start 2023-08-31T19:03:31.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc89ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc40690e0 0x7f4bc4155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:31.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc89ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc40c38d0 0x7f4bc40ab730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:31.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc89ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc41544e0 0x7f4bc4152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:31.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc89ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc4154fb0 con 0x7f4bc40c38d0 2023-08-31T19:03:31.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc89ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40ad2a0 con 0x7f4bc40690e0 2023-08-31T19:03:31.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc89ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc4164e90 con 0x7f4bc41544e0 2023-08-31T19:03:31.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc40c38d0 0x7f4bc40ab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:31.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc40c38d0 0x7f4bc40ab730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60444/0 (socket says 172.21.15.72:60444) 2023-08-31T19:03:31.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc1d9b700 1 -- 172.21.15.72:0/1017998794 learned_addr learned my addr 172.21.15.72:0/1017998794 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:31.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc2d9d700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc41544e0 0x7f4bc4152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:31.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc259c700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc40690e0 0x7f4bc4155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:31.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc1d9b700 1 -- 172.21.15.72:0/1017998794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc41544e0 msgr2=0x7f4bc4152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:31.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc1d9b700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc41544e0 0x7f4bc4152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:31.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc1d9b700 1 -- 172.21.15.72:0/1017998794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc40690e0 msgr2=0x7f4bc4155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:31.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc1d9b700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc40690e0 0x7f4bc4155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:31.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.205+0000 7f4bc1d9b700 1 -- 172.21.15.72:0/1017998794 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb8009370 con 0x7f4bc40c38d0 2023-08-31T19:03:31.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.206+0000 7f4bc259c700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc40690e0 0x7f4bc4155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:31.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.206+0000 7f4bc2d9d700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc41544e0 0x7f4bc4152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:31.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.206+0000 7f4bc1d9b700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc40c38d0 0x7f4bc40ab730 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f4bc40684e0 tx=0x7f4bb8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:31.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.206+0000 7f4bb27fc700 1 -- 172.21.15.72:0/1017998794 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb800b8d0 con 0x7f4bc40c38d0 2023-08-31T19:03:31.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.206+0000 7f4bb27fc700 1 -- 172.21.15.72:0/1017998794 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb800ba30 con 0x7f4bc40c38d0 2023-08-31T19:03:31.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.206+0000 7f4bc89ff700 1 -- 172.21.15.72:0/1017998794 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc4164bb0 con 0x7f4bc40c38d0 2023-08-31T19:03:31.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.206+0000 7f4bb27fc700 1 -- 172.21.15.72:0/1017998794 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb801c670 con 0x7f4bc40c38d0 2023-08-31T19:03:31.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.206+0000 7f4bc89ff700 1 -- 172.21.15.72:0/1017998794 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc4154c40 con 0x7f4bc40c38d0 2023-08-31T19:03:31.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.207+0000 7f4bc89ff700 1 -- 172.21.15.72:0/1017998794 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc4155120 con 0x7f4bc40c38d0 2023-08-31T19:03:31.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.208+0000 7f4bb27fc700 1 -- 172.21.15.72:0/1017998794 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4bb801ca20 con 0x7f4bc40c38d0 2023-08-31T19:03:31.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.209+0000 7f4bb27fc700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ba405ef30 0x7f4ba40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:31.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.209+0000 7f4bb27fc700 1 -- 172.21.15.72:0/1017998794 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f4bb807bf60 con 0x7f4bc40c38d0 2023-08-31T19:03:31.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.209+0000 7f4bc259c700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ba405ef30 0x7f4ba40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:31.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.210+0000 7f4bc259c700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ba405ef30 0x7f4ba40613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f4bb400a820 tx=0x7f4bb4008040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:31.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.213+0000 7f4bb27fc700 1 -- 172.21.15.72:0/1017998794 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4bb80aa8f0 con 0x7f4bc40c38d0 2023-08-31T19:03:31.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.425+0000 7f4bc89ff700 1 -- 172.21.15.72:0/1017998794 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4bc406c6b0 con 0x7f4bc40c38d0 2023-08-31T19:03:31.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.993+0000 7f4bb27fc700 1 -- 172.21.15.72:0/1017998794 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4bb802a070 con 0x7f4bc40c38d0 2023-08-31T19:03:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.996+0000 7f4bc89ff700 1 -- 172.21.15.72:0/1017998794 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ba405ef30 msgr2=0x7f4ba40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.996+0000 7f4bc89ff700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ba405ef30 0x7f4ba40613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f4bb400a820 tx=0x7f4bb4008040).stop 2023-08-31T19:03:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.996+0000 7f4bc89ff700 1 -- 172.21.15.72:0/1017998794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc40c38d0 msgr2=0x7f4bc40ab730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.996+0000 7f4bc89ff700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc40c38d0 0x7f4bc40ab730 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f4bc40684e0 tx=0x7f4bb8017000).stop 2023-08-31T19:03:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.996+0000 7f4bc89ff700 1 -- 172.21.15.72:0/1017998794 shutdown_connections 2023-08-31T19:03:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.996+0000 7f4bc89ff700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4bc41544e0 0x7f4bc4152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:31.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.996+0000 7f4bc89ff700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4ba405ef30 0x7f4ba40613f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:31.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.996+0000 7f4bc89ff700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4bc40690e0 0x7f4bc4155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:31.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.996+0000 7f4bc89ff700 1 --2- 172.21.15.72:0/1017998794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc40c38d0 0x7f4bc40ab730 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:31.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.996+0000 7f4bc89ff700 1 -- 172.21.15.72:0/1017998794 >> 172.21.15.72:0/1017998794 conn(0x7f4bc40c7e00 msgr2=0x7f4bc414fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:31.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.996+0000 7f4bc89ff700 1 -- 172.21.15.72:0/1017998794 shutdown_connections 2023-08-31T19:03:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:31.996+0000 7f4bc89ff700 1 -- 172.21.15.72:0/1017998794 wait complete. 2023-08-31T19:03:32.015 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T19:03:32.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:03:32.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.205+0000 7f36c9bff700 1 Processor -- start 2023-08-31T19:03:32.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.205+0000 7f36c9bff700 1 -- start start 2023-08-31T19:03:32.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.206+0000 7f36c9bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36c4154060 0x7f36c4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.206+0000 7f36c9bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f36c41588d0 0x7f36c4154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.206+0000 7f36c9bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c40c6120 con 0x7f36c40cb9b0 2023-08-31T19:03:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.206+0000 7f36c9bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c40c1380 con 0x7f36c4154060 2023-08-31T19:03:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.206+0000 7f36c9bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c40c5e10 con 0x7f36c41588d0 2023-08-31T19:03:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.207+0000 7f36c37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36c4154060 0x7f36c4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.207+0000 7f36c37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36c4154060 0x7f36c4157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60454/0 (socket says 172.21.15.72:60454) 2023-08-31T19:03:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.207+0000 7f36c37fe700 1 -- 172.21.15.72:0/3366467615 learned_addr learned my addr 172.21.15.72:0/3366467615 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.207+0000 7f36c3fff700 1 --2- 172.21.15.72:0/3366467615 >> v2:172.21.15.146:3300/0 conn(0x7f36c41588d0 0x7f36c4154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.207+0000 7f36c37fe700 1 -- 172.21.15.72:0/3366467615 >> v2:172.21.15.146:3300/0 conn(0x7f36c41588d0 msgr2=0x7f36c4154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.207+0000 7f36c37fe700 1 --2- 172.21.15.72:0/3366467615 >> v2:172.21.15.146:3300/0 conn(0x7f36c41588d0 0x7f36c4154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.207+0000 7f36c37fe700 1 -- 172.21.15.72:0/3366467615 >> v1:172.21.15.146:6789/0 conn(0x7f36c40cb9b0 legacy=0x7f36c41581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.207+0000 7f36c37fe700 1 -- 172.21.15.72:0/3366467615 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c40c0ae0 con 0x7f36c4154060 2023-08-31T19:03:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.207+0000 7f36c3fff700 1 --2- 172.21.15.72:0/3366467615 >> v2:172.21.15.146:3300/0 conn(0x7f36c41588d0 0x7f36c4154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.207+0000 7f36c37fe700 1 --2- 172.21.15.72:0/3366467615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c4154060 0x7f36c4157cd0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f36c40844d0 tx=0x7f36b4009060).ready entity=mon.0 client_cookie=a2afbd2e749ded5c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.207+0000 7f36c27fc700 1 -- 172.21.15.72:0/3366467615 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4005880 con 0x7f36c4154060 2023-08-31T19:03:32.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.208+0000 7f36c27fc700 1 -- 172.21.15.72:0/3366467615 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b40059e0 con 0x7f36c4154060 2023-08-31T19:03:32.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.208+0000 7f36c27fc700 1 -- 172.21.15.72:0/3366467615 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4005d60 con 0x7f36c4154060 2023-08-31T19:03:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.208+0000 7f36c9bff700 1 -- 172.21.15.72:0/3366467615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c4154060 msgr2=0x7f36c4157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.208+0000 7f36c9bff700 1 --2- 172.21.15.72:0/3366467615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c4154060 0x7f36c4157cd0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f36c40844d0 tx=0x7f36b4009060).stop 2023-08-31T19:03:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.208+0000 7f36c9bff700 1 -- 172.21.15.72:0/3366467615 shutdown_connections 2023-08-31T19:03:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.208+0000 7f36c9bff700 1 --2- 172.21.15.72:0/3366467615 >> v2:172.21.15.146:3300/0 conn(0x7f36c41588d0 0x7f36c4154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.208+0000 7f36c9bff700 1 --2- 172.21.15.72:0/3366467615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c4154060 0x7f36c4157cd0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.208+0000 7f36c9bff700 1 -- 172.21.15.72:0/3366467615 >> 172.21.15.72:0/3366467615 conn(0x7f36c405e870 msgr2=0x7f36c40cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:32.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.208+0000 7f36c9bff700 1 -- 172.21.15.72:0/3366467615 shutdown_connections 2023-08-31T19:03:32.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.208+0000 7f36c9bff700 1 -- 172.21.15.72:0/3366467615 wait complete. 2023-08-31T19:03:32.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.210+0000 7f36c9bff700 1 Processor -- start 2023-08-31T19:03:32.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.210+0000 7f36c9bff700 1 -- start start 2023-08-31T19:03:32.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c9bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c40cb9b0 0x7f36c4167f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:32.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c9bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36c4154060 0x7f36c40ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:32.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c9bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36c41588d0 0x7f36c4163f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:32.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c9bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c4167510 con 0x7f36c40cb9b0 2023-08-31T19:03:32.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c9bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c41649e0 con 0x7f36c41588d0 2023-08-31T19:03:32.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c9bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c4164cc0 con 0x7f36c4154060 2023-08-31T19:03:32.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c40cb9b0 0x7f36c4167f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:32.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c40cb9b0 0x7f36c4167f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60464/0 (socket says 172.21.15.72:60464) 2023-08-31T19:03:32.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c37fe700 1 -- 172.21.15.72:0/3488381261 learned_addr learned my addr 172.21.15.72:0/3488381261 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:32.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c3fff700 1 --2- 172.21.15.72:0/3488381261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36c41588d0 0x7f36c4163f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:32.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c2ffd700 1 --2- 172.21.15.72:0/3488381261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36c4154060 0x7f36c40ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:32.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c37fe700 1 -- 172.21.15.72:0/3488381261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36c4154060 msgr2=0x7f36c40ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:32.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c37fe700 1 --2- 172.21.15.72:0/3488381261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36c4154060 0x7f36c40ab4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c37fe700 1 -- 172.21.15.72:0/3488381261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36c41588d0 msgr2=0x7f36c4163f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:32.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c37fe700 1 --2- 172.21.15.72:0/3488381261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36c41588d0 0x7f36c4163f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c37fe700 1 -- 172.21.15.72:0/3488381261 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b4009300 con 0x7f36c40cb9b0 2023-08-31T19:03:32.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.211+0000 7f36c3fff700 1 --2- 172.21.15.72:0/3488381261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36c41588d0 0x7f36c4163f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:32.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.212+0000 7f36c37fe700 1 --2- 172.21.15.72:0/3488381261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c40cb9b0 0x7f36c4167f20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f36b4009f30 tx=0x7f36b4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:32.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.212+0000 7f36ab7fe700 1 -- 172.21.15.72:0/3488381261 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b400b7b0 con 0x7f36c40cb9b0 2023-08-31T19:03:32.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.212+0000 7f36ab7fe700 1 -- 172.21.15.72:0/3488381261 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b400b910 con 0x7f36c40cb9b0 2023-08-31T19:03:32.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.212+0000 7f36ab7fe700 1 -- 172.21.15.72:0/3488381261 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b400bcd0 con 0x7f36c40cb9b0 2023-08-31T19:03:32.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.212+0000 7f36c9bff700 1 -- 172.21.15.72:0/3488381261 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c4167720 con 0x7f36c40cb9b0 2023-08-31T19:03:32.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.212+0000 7f36c9bff700 1 -- 172.21.15.72:0/3488381261 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c40ab990 con 0x7f36c40cb9b0 2023-08-31T19:03:32.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.213+0000 7f36c9bff700 1 -- 172.21.15.72:0/3488381261 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c406c6b0 con 0x7f36c40cb9b0 2023-08-31T19:03:32.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.214+0000 7f36ab7fe700 1 -- 172.21.15.72:0/3488381261 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f36b4018030 con 0x7f36c40cb9b0 2023-08-31T19:03:32.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.215+0000 7f36ab7fe700 1 --2- 172.21.15.72:0/3488381261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f36b005ef60 0x7f36b0061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:32.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.215+0000 7f36ab7fe700 1 -- 172.21.15.72:0/3488381261 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f36b407b3f0 con 0x7f36c40cb9b0 2023-08-31T19:03:32.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.215+0000 7f36c2ffd700 1 --2- 172.21.15.72:0/3488381261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f36b005ef60 0x7f36b0061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:32.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.216+0000 7f36c2ffd700 1 --2- 172.21.15.72:0/3488381261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f36b005ef60 0x7f36b0061420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f36c40c9950 tx=0x7f36b8008040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:32.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.219+0000 7f36ab7fe700 1 -- 172.21.15.72:0/3488381261 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f36b404c3c0 con 0x7f36c40cb9b0 2023-08-31T19:03:32.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.429+0000 7f36c9bff700 1 -- 172.21.15.72:0/3488381261 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36c40c0dc0 con 0x7f36c40cb9b0 2023-08-31T19:03:32.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.429+0000 7f36ab7fe700 1 -- 172.21.15.72:0/3488381261 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f36b4028090 con 0x7f36c40cb9b0 2023-08-31T19:03:32.430 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:32.431 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5890,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1362322123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1362322123},{"type":"v1","addr":"172.21.15.146:6834","nonce":1362322123}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5893,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2001208412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2001208412},{"type":"v1","addr":"172.21.15.146:6835","nonce":2001208412}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3154756193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3154756193},{"type":"v1","addr":"172.21.15.72:6835","nonce":3154756193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:03:28.969345+0000","modified":"2023-08-31T19:03:31.984576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6252},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6252":{"gid":6252,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/2633506693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2633506693},{"type":"v1","addr":"172.21.15.72:6837","nonce":2633506693}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-31T19:03:32.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.431+0000 7f36c9bff700 1 -- 172.21.15.72:0/3488381261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f36b005ef60 msgr2=0x7f36b0061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:32.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.431+0000 7f36c9bff700 1 --2- 172.21.15.72:0/3488381261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f36b005ef60 0x7f36b0061420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f36c40c9950 tx=0x7f36b8008040).stop 2023-08-31T19:03:32.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.431+0000 7f36c9bff700 1 -- 172.21.15.72:0/3488381261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c40cb9b0 msgr2=0x7f36c4167f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:32.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.431+0000 7f36c9bff700 1 --2- 172.21.15.72:0/3488381261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c40cb9b0 0x7f36c4167f20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f36b4009f30 tx=0x7f36b4016000).stop 2023-08-31T19:03:32.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.431+0000 7f36c9bff700 1 -- 172.21.15.72:0/3488381261 shutdown_connections 2023-08-31T19:03:32.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.431+0000 7f36c9bff700 1 --2- 172.21.15.72:0/3488381261 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f36b005ef60 0x7f36b0061420 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.431+0000 7f36c9bff700 1 --2- 172.21.15.72:0/3488381261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36c41588d0 0x7f36c4163f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.432+0000 7f36c9bff700 1 --2- 172.21.15.72:0/3488381261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36c40cb9b0 0x7f36c4167f20 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.432+0000 7f36c9bff700 1 --2- 172.21.15.72:0/3488381261 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36c4154060 0x7f36c40ab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.432+0000 7f36c9bff700 1 -- 172.21.15.72:0/3488381261 >> 172.21.15.72:0/3488381261 conn(0x7f36c405e870 msgr2=0x7f36c40c79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:32.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.432+0000 7f36c9bff700 1 -- 172.21.15.72:0/3488381261 shutdown_connections 2023-08-31T19:03:32.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.432+0000 7f36c9bff700 1 -- 172.21.15.72:0/3488381261 wait complete. 2023-08-31T19:03:32.434 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 32 2023-08-31T19:03:32.449 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:03:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.638+0000 7f87a13ff700 1 Processor -- start 2023-08-31T19:03:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.638+0000 7f87a13ff700 1 -- start start 2023-08-31T19:03:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.639+0000 7f87a13ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f879c1575b0 0x7f879c157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.639+0000 7f87a13ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879c0c7390 con 0x7f879c0c6f20 2023-08-31T19:03:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.639+0000 7f87a13ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f879c0c7620 con 0x7f879c1581d0 2023-08-31T19:03:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.639+0000 7f87a13ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879c0c0830 con 0x7f879c1575b0 2023-08-31T19:03:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.640+0000 7f879b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f879c0c6f20 0x7f879c0c93a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43654/0 (socket says 172.21.15.72:43654) 2023-08-31T19:03:32.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.640+0000 7f879b7fe700 1 -- 172.21.15.72:0/2536806498 learned_addr learned my addr 172.21.15.72:0/2536806498 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:32.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.640+0000 7f879affd700 1 --2- 172.21.15.72:0/2536806498 >> v2:172.21.15.146:3300/0 conn(0x7f879c1575b0 0x7f879c157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:32.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.640+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450024796 0 0) 0x7f879c0c7390 con 0x7f879c0c6f20 2023-08-31T19:03:32.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.640+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87840033f0 con 0x7f879c0c6f20 2023-08-31T19:03:32.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.640+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303844599 0 0) 0x7f879c0c7620 con 0x7f879c1581d0 2023-08-31T19:03:32.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.640+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f879c0c7390 con 0x7f879c1581d0 2023-08-31T19:03:32.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.640+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 301541879 0 0) 0x7f87840033f0 con 0x7f879c0c6f20 2023-08-31T19:03:32.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.640+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 >> v2:172.21.15.146:3300/0 conn(0x7f879c1575b0 msgr2=0x7f879c157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:32.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.640+0000 7f8799ffb700 1 --2- 172.21.15.72:0/2536806498 >> v2:172.21.15.146:3300/0 conn(0x7f879c1575b0 0x7f879c157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.640+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 >> v1:172.21.15.146:6789/0 conn(0x7f879c1581d0 legacy=0x7f879c0c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:32.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.640+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c0c0b10 con 0x7f879c0c6f20 2023-08-31T19:03:32.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f87940017f0 con 0x7f879c0c6f20 2023-08-31T19:03:32.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f879affd700 1 --2- 172.21.15.72:0/2536806498 >> v2:172.21.15.146:3300/0 conn(0x7f879c1575b0 0x7f879c157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:03:32.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 >> v1:172.21.15.72:6789/0 conn(0x7f879c0c6f20 legacy=0x7f879c0c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:32.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f8799ffb700 1 --2- 172.21.15.72:0/2536806498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8784003a70 0x7f8784003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:32.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f8799ffb700 1 --2- 172.21.15.72:0/2536806498 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8784004690 0x7f8784004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:32.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f8799ffb700 1 --2- 172.21.15.72:0/2536806498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8784005000 0x7f878400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:32.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0c0830 con 0x7f8784003a70 2023-08-31T19:03:32.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878400be80 con 0x7f8784005000 2023-08-31T19:03:32.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878400c040 con 0x7f8784004690 2023-08-31T19:03:32.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f879affd700 1 --2- 172.21.15.72:0/2536806498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8784003a70 0x7f8784003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:32.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f879b7fe700 1 --2- 172.21.15.72:0/2536806498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8784005000 0x7f878400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:32.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f879a7fc700 1 --2- 172.21.15.72:0/2536806498 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8784004690 0x7f8784004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:32.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f879affd700 1 -- 172.21.15.72:0/2536806498 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8784004690 msgr2=0x7f8784004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:32.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f879affd700 1 --2- 172.21.15.72:0/2536806498 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8784004690 0x7f8784004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f879affd700 1 -- 172.21.15.72:0/2536806498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8784005000 msgr2=0x7f878400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:32.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f879affd700 1 --2- 172.21.15.72:0/2536806498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8784005000 0x7f878400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f879affd700 1 -- 172.21.15.72:0/2536806498 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87840033f0 con 0x7f8784003a70 2023-08-31T19:03:32.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f879b7fe700 1 -- 172.21.15.72:0/2536806498 reap_dead start 2023-08-31T19:03:32.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.641+0000 7f879affd700 1 --2- 172.21.15.72:0/2536806498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8784003a70 0x7f8784003e70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f878c006fd0 tx=0x7f878c006f40).ready entity=mon.0 client_cookie=d1679ed30e3d4947 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:32.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.642+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c009670 con 0x7f8784003a70 2023-08-31T19:03:32.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.642+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c005880 con 0x7f8784003a70 2023-08-31T19:03:32.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.642+0000 7f8799ffb700 1 -- 172.21.15.72:0/2536806498 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c005c00 con 0x7f8784003a70 2023-08-31T19:03:32.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.642+0000 7f87a13ff700 1 -- 172.21.15.72:0/2536806498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8784003a70 msgr2=0x7f8784003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:32.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.642+0000 7f87a13ff700 1 --2- 172.21.15.72:0/2536806498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8784003a70 0x7f8784003e70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f878c006fd0 tx=0x7f878c006f40).stop 2023-08-31T19:03:32.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.642+0000 7f87a13ff700 1 -- 172.21.15.72:0/2536806498 shutdown_connections 2023-08-31T19:03:32.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.642+0000 7f87a13ff700 1 --2- 172.21.15.72:0/2536806498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8784003a70 0x7f8784003e70 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.642+0000 7f87a13ff700 1 -- 172.21.15.72:0/2536806498 >> 172.21.15.72:0/2536806498 conn(0x7f879c05e870 msgr2=0x7f879c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:32.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.642+0000 7f87a13ff700 1 -- 172.21.15.72:0/2536806498 shutdown_connections 2023-08-31T19:03:32.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.642+0000 7f87a13ff700 1 -- 172.21.15.72:0/2536806498 wait complete. 2023-08-31T19:03:32.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.644+0000 7f87a13ff700 1 Processor -- start 2023-08-31T19:03:32.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.644+0000 7f87a13ff700 1 -- start start 2023-08-31T19:03:32.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f87a13ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8784003a70 0x7f879c098430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:32.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f87a13ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f879c165580 0x7f879c0c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:32.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f87a13ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f879c165a00 0x7f879c0c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:32.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f87a13ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0c47f0 con 0x7f879c165580 2023-08-31T19:03:32.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f87a13ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0c2e00 con 0x7f879c165a00 2023-08-31T19:03:32.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f87a13ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0c3980 con 0x7f8784003a70 2023-08-31T19:03:32.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f879a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f879c165580 0x7f879c0c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:32.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f879a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f879c165580 0x7f879c0c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60476/0 (socket says 172.21.15.72:60476) 2023-08-31T19:03:32.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f879a7fc700 1 -- 172.21.15.72:0/1624642828 learned_addr learned my addr 172.21.15.72:0/1624642828 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:32.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f879affd700 1 --2- 172.21.15.72:0/1624642828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8784003a70 0x7f879c098430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:32.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f879b7fe700 1 --2- 172.21.15.72:0/1624642828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f879c165a00 0x7f879c0c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:32.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f879a7fc700 1 -- 172.21.15.72:0/1624642828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8784003a70 msgr2=0x7f879c098430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:32.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f879a7fc700 1 --2- 172.21.15.72:0/1624642828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8784003a70 0x7f879c098430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f879a7fc700 1 -- 172.21.15.72:0/1624642828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f879c165a00 msgr2=0x7f879c0c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f879a7fc700 1 --2- 172.21.15.72:0/1624642828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f879c165a00 0x7f879c0c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.645+0000 7f879a7fc700 1 -- 172.21.15.72:0/1624642828 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c0c3050 con 0x7f879c165580 2023-08-31T19:03:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.646+0000 7f879a7fc700 1 --2- 172.21.15.72:0/1624642828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f879c165580 0x7f879c0c3e10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f879000e490 tx=0x7f8790009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:32.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.646+0000 7f8782ffd700 1 -- 172.21.15.72:0/1624642828 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790001570 con 0x7f879c165580 2023-08-31T19:03:32.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.646+0000 7f8782ffd700 1 -- 172.21.15.72:0/1624642828 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87900016d0 con 0x7f879c165580 2023-08-31T19:03:32.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.646+0000 7f87a13ff700 1 -- 172.21.15.72:0/1624642828 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879c0c3330 con 0x7f879c165580 2023-08-31T19:03:32.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.646+0000 7f8782ffd700 1 -- 172.21.15.72:0/1624642828 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790001a50 con 0x7f879c165580 2023-08-31T19:03:32.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.646+0000 7f87a13ff700 1 -- 172.21.15.72:0/1624642828 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c098920 con 0x7f879c165580 2023-08-31T19:03:32.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.647+0000 7f87a13ff700 1 -- 172.21.15.72:0/1624642828 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c0c3b30 con 0x7f879c165580 2023-08-31T19:03:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.648+0000 7f8782ffd700 1 -- 172.21.15.72:0/1624642828 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8790014430 con 0x7f879c165580 2023-08-31T19:03:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.648+0000 7f8782ffd700 1 --2- 172.21.15.72:0/1624642828 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f878805ef30 0x7f87880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.649+0000 7f8782ffd700 1 -- 172.21.15.72:0/1624642828 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f8790079fd0 con 0x7f879c165580 2023-08-31T19:03:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.649+0000 7f879affd700 1 --2- 172.21.15.72:0/1624642828 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f878805ef30 0x7f87880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.649+0000 7f879affd700 1 --2- 172.21.15.72:0/1624642828 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f878805ef30 0x7f87880613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f878c006f80 tx=0x7f878c019000).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:32.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.652+0000 7f8782ffd700 1 -- 172.21.15.72:0/1624642828 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f87900498f0 con 0x7f879c165580 2023-08-31T19:03:32.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.823+0000 7f87a13ff700 1 -- 172.21.15.72:0/1624642828 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f879c06c6b0 con 0x7f879c165580 2023-08-31T19:03:32.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.824+0000 7f8782ffd700 1 -- 172.21.15.72:0/1624642828 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+17933 (secure 0 0 0) 0x7f879c0c3b30 con 0x7f879c165580 2023-08-31T19:03:32.825 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:32.825 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":79,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:03:29.971497+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:03:26.723490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-31T19:03:27.961871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:03:32.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.826+0000 7f87a13ff700 1 -- 172.21.15.72:0/1624642828 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f878805ef30 msgr2=0x7f87880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:32.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.826+0000 7f87a13ff700 1 --2- 172.21.15.72:0/1624642828 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f878805ef30 0x7f87880613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f878c006f80 tx=0x7f878c019000).stop 2023-08-31T19:03:32.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.826+0000 7f87a13ff700 1 -- 172.21.15.72:0/1624642828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f879c165580 msgr2=0x7f879c0c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:32.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.826+0000 7f87a13ff700 1 --2- 172.21.15.72:0/1624642828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f879c165580 0x7f879c0c3e10 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f879000e490 tx=0x7f8790009040).stop 2023-08-31T19:03:32.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.826+0000 7f87a13ff700 1 -- 172.21.15.72:0/1624642828 shutdown_connections 2023-08-31T19:03:32.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.826+0000 7f87a13ff700 1 --2- 172.21.15.72:0/1624642828 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f878805ef30 0x7f87880613f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.826+0000 7f87a13ff700 1 --2- 172.21.15.72:0/1624642828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f879c165a00 0x7f879c0c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.826+0000 7f87a13ff700 1 --2- 172.21.15.72:0/1624642828 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8784003a70 0x7f879c098430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.826+0000 7f87a13ff700 1 --2- 172.21.15.72:0/1624642828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f879c165580 0x7f879c0c3e10 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:32.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.826+0000 7f87a13ff700 1 -- 172.21.15.72:0/1624642828 >> 172.21.15.72:0/1624642828 conn(0x7f879c05e870 msgr2=0x7f879c0c9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:32.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.826+0000 7f87a13ff700 1 -- 172.21.15.72:0/1624642828 shutdown_connections 2023-08-31T19:03:32.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:32.826+0000 7f87a13ff700 1 -- 172.21.15.72:0/1624642828 wait complete. 2023-08-31T19:03:32.844 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T19:03:32.844 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:03:33.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.034+0000 7f6b255ff700 1 Processor -- start 2023-08-31T19:03:33.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.034+0000 7f6b255ff700 1 -- start start 2023-08-31T19:03:33.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.035+0000 7f6b255ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b20154220 0x7f6b20157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.035+0000 7f6b255ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b200c8c90 con 0x7f6b200cb940 2023-08-31T19:03:33.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.035+0000 7f6b255ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b20155610 con 0x7f6b201588d0 2023-08-31T19:03:33.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.035+0000 7f6b255ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b200aa700 con 0x7f6b20154220 2023-08-31T19:03:33.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.035+0000 7f6b1e7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6b200cb940 0x7f6b201581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50026/0 (socket says 172.21.15.72:50026) 2023-08-31T19:03:33.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.035+0000 7f6b1e7fc700 1 -- 172.21.15.72:0/145346686 learned_addr learned my addr 172.21.15.72:0/145346686 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:33.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1effd700 1 --2- 172.21.15.72:0/145346686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b20154220 0x7f6b20157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1dffb700 1 -- 172.21.15.72:0/145346686 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059999800 0 0) 0x7f6b200c8c90 con 0x7f6b200cb940 2023-08-31T19:03:33.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1dffb700 1 -- 172.21.15.72:0/145346686 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b080033f0 con 0x7f6b200cb940 2023-08-31T19:03:33.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1dffb700 1 -- 172.21.15.72:0/145346686 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2144844619 0 0) 0x7f6b080033f0 con 0x7f6b200cb940 2023-08-31T19:03:33.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1dffb700 1 -- 172.21.15.72:0/145346686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b20154220 msgr2=0x7f6b20157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:33.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1dffb700 1 --2- 172.21.15.72:0/145346686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b20154220 0x7f6b20157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1dffb700 1 -- 172.21.15.72:0/145346686 >> v1:172.21.15.146:6789/0 conn(0x7f6b201588d0 legacy=0x7f6b200c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1dffb700 1 -- 172.21.15.72:0/145346686 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b200c0a50 con 0x7f6b200cb940 2023-08-31T19:03:33.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1effd700 1 --2- 172.21.15.72:0/145346686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b20154220 0x7f6b20157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:33.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1dffb700 1 -- 172.21.15.72:0/145346686 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f6b14001470 con 0x7f6b200cb940 2023-08-31T19:03:33.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1dffb700 1 -- 172.21.15.72:0/145346686 >> v1:172.21.15.72:6789/0 conn(0x7f6b200cb940 legacy=0x7f6b201581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1dffb700 1 --2- 172.21.15.72:0/145346686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b08003910 0x7f6b08003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1dffb700 1 --2- 172.21.15.72:0/145346686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b08004690 0x7f6b08004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1dffb700 1 --2- 172.21.15.72:0/145346686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b20154220 0x7f6b08005050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1dffb700 1 -- 172.21.15.72:0/145346686 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b200aa700 con 0x7f6b08003910 2023-08-31T19:03:33.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1dffb700 1 -- 172.21.15.72:0/145346686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0800b990 con 0x7f6b08004690 2023-08-31T19:03:33.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.036+0000 7f6b1dffb700 1 -- 172.21.15.72:0/145346686 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0800bb50 con 0x7f6b20154220 2023-08-31T19:03:33.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.037+0000 7f6b1effd700 1 --2- 172.21.15.72:0/145346686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b08003910 0x7f6b08003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.037+0000 7f6b1e7fc700 1 --2- 172.21.15.72:0/145346686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b08004690 0x7f6b08004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.037+0000 7f6b1f7fe700 1 --2- 172.21.15.72:0/145346686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b20154220 0x7f6b08005050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.037+0000 7f6b1effd700 1 -- 172.21.15.72:0/145346686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b20154220 msgr2=0x7f6b08005050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:33.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.037+0000 7f6b1effd700 1 --2- 172.21.15.72:0/145346686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b20154220 0x7f6b08005050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.037+0000 7f6b1effd700 1 -- 172.21.15.72:0/145346686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b08004690 msgr2=0x7f6b08004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:33.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.037+0000 7f6b1effd700 1 --2- 172.21.15.72:0/145346686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b08004690 0x7f6b08004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.037+0000 7f6b1effd700 1 -- 172.21.15.72:0/145346686 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b080033f0 con 0x7f6b08003910 2023-08-31T19:03:33.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.037+0000 7f6b1f7fe700 1 --2- 172.21.15.72:0/145346686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b20154220 0x7f6b08005050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:33.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.037+0000 7f6b1effd700 1 --2- 172.21.15.72:0/145346686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b08003910 0x7f6b08003d30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f6b1000bab0 tx=0x7f6b10008040).ready entity=mon.0 client_cookie=aac62f7947976056 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:33.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.037+0000 7f6b1dffb700 1 -- 172.21.15.72:0/145346686 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000b3f0 con 0x7f6b08003910 2023-08-31T19:03:33.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.037+0000 7f6b1dffb700 1 -- 172.21.15.72:0/145346686 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b10005880 con 0x7f6b08003910 2023-08-31T19:03:33.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.037+0000 7f6b1dffb700 1 -- 172.21.15.72:0/145346686 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10005c20 con 0x7f6b08003910 2023-08-31T19:03:33.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.038+0000 7f6b255ff700 1 -- 172.21.15.72:0/145346686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b08003910 msgr2=0x7f6b08003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.038+0000 7f6b255ff700 1 --2- 172.21.15.72:0/145346686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b08003910 0x7f6b08003d30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f6b1000bab0 tx=0x7f6b10008040).stop 2023-08-31T19:03:33.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.038+0000 7f6b1f7fe700 1 -- 172.21.15.72:0/145346686 reap_dead start 2023-08-31T19:03:33.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.038+0000 7f6b255ff700 1 -- 172.21.15.72:0/145346686 shutdown_connections 2023-08-31T19:03:33.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.038+0000 7f6b255ff700 1 -- 172.21.15.72:0/145346686 >> 172.21.15.72:0/145346686 conn(0x7f6b2005e870 msgr2=0x7f6b200cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:33.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.038+0000 7f6b255ff700 1 -- 172.21.15.72:0/145346686 shutdown_connections 2023-08-31T19:03:33.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.038+0000 7f6b255ff700 1 -- 172.21.15.72:0/145346686 wait complete. 2023-08-31T19:03:33.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.039+0000 7f6b255ff700 1 Processor -- start 2023-08-31T19:03:33.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.040+0000 7f6b255ff700 1 -- start start 2023-08-31T19:03:33.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.040+0000 7f6b255ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b08003910 0x7f6b201504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.040+0000 7f6b255ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b201581f0 0x7f6b201557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.040+0000 7f6b255ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b20064060 0x7f6b200644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.041+0000 7f6b255ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b200aef50 con 0x7f6b201581f0 2023-08-31T19:03:33.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.041+0000 7f6b255ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b200649d0 con 0x7f6b20064060 2023-08-31T19:03:33.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.041+0000 7f6b255ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b20158670 con 0x7f6b08003910 2023-08-31T19:03:33.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.041+0000 7f6b1e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b201581f0 0x7f6b201557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.041+0000 7f6b1e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b201581f0 0x7f6b201557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59472/0 (socket says 172.21.15.72:59472) 2023-08-31T19:03:33.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.041+0000 7f6b1e7fc700 1 -- 172.21.15.72:0/1513036294 learned_addr learned my addr 172.21.15.72:0/1513036294 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:33.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.041+0000 7f6b1f7fe700 1 --2- 172.21.15.72:0/1513036294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b20064060 0x7f6b200644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.041+0000 7f6b1effd700 1 --2- 172.21.15.72:0/1513036294 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b08003910 0x7f6b201504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.041+0000 7f6b1e7fc700 1 -- 172.21.15.72:0/1513036294 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b08003910 msgr2=0x7f6b201504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.041+0000 7f6b1e7fc700 1 --2- 172.21.15.72:0/1513036294 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b08003910 0x7f6b201504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.041+0000 7f6b1e7fc700 1 -- 172.21.15.72:0/1513036294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b20064060 msgr2=0x7f6b200644e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.041+0000 7f6b1e7fc700 1 --2- 172.21.15.72:0/1513036294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b20064060 0x7f6b200644e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.041+0000 7f6b1e7fc700 1 -- 172.21.15.72:0/1513036294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b20155c90 con 0x7f6b201581f0 2023-08-31T19:03:33.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.041+0000 7f6b1e7fc700 1 --2- 172.21.15.72:0/1513036294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b201581f0 0x7f6b201557a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f6b14000e10 tx=0x7f6b14000da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:33.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.042+0000 7f6b06ffd700 1 -- 172.21.15.72:0/1513036294 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b14010520 con 0x7f6b201581f0 2023-08-31T19:03:33.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.042+0000 7f6b06ffd700 1 -- 172.21.15.72:0/1513036294 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b14010680 con 0x7f6b201581f0 2023-08-31T19:03:33.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.042+0000 7f6b255ff700 1 -- 172.21.15.72:0/1513036294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b20155f60 con 0x7f6b201581f0 2023-08-31T19:03:33.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.042+0000 7f6b06ffd700 1 -- 172.21.15.72:0/1513036294 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b14010a20 con 0x7f6b201581f0 2023-08-31T19:03:33.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.042+0000 7f6b255ff700 1 -- 172.21.15.72:0/1513036294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b20156520 con 0x7f6b201581f0 2023-08-31T19:03:33.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.043+0000 7f6b255ff700 1 -- 172.21.15.72:0/1513036294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2006c6b0 con 0x7f6b201581f0 2023-08-31T19:03:33.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.043+0000 7f6b06ffd700 1 -- 172.21.15.72:0/1513036294 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6b14014430 con 0x7f6b201581f0 2023-08-31T19:03:33.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.044+0000 7f6b06ffd700 1 --2- 172.21.15.72:0/1513036294 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6b0c05ef30 0x7f6b0c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.044+0000 7f6b06ffd700 1 -- 172.21.15.72:0/1513036294 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f6b14079e70 con 0x7f6b201581f0 2023-08-31T19:03:33.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.044+0000 7f6b1effd700 1 --2- 172.21.15.72:0/1513036294 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6b0c05ef30 0x7f6b0c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.045+0000 7f6b1effd700 1 --2- 172.21.15.72:0/1513036294 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6b0c05ef30 0x7f6b0c0613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6b10005fd0 tx=0x7f6b10008040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:33.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.048+0000 7f6b06ffd700 1 -- 172.21.15.72:0/1513036294 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6b140498f0 con 0x7f6b201581f0 2023-08-31T19:03:33.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.213+0000 7f6b255ff700 1 -- 172.21.15.72:0/1513036294 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b20150a00 con 0x7f6b0c05ef30 2023-08-31T19:03:33.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.225+0000 7f6b06ffd700 1 -- 172.21.15.72:0/1513036294 <== mgr.6060 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361008 (secure 0 0 0) 0x7f6b20150a00 con 0x7f6b0c05ef30 2023-08-31T19:03:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:33.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.230+0000 7f6b255ff700 1 -- 172.21.15.72:0/1513036294 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6b0c05ef30 msgr2=0x7f6b0c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.230+0000 7f6b255ff700 1 --2- 172.21.15.72:0/1513036294 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6b0c05ef30 0x7f6b0c0613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6b10005fd0 tx=0x7f6b10008040).stop 2023-08-31T19:03:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.230+0000 7f6b255ff700 1 -- 172.21.15.72:0/1513036294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b201581f0 msgr2=0x7f6b201557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.230+0000 7f6b255ff700 1 --2- 172.21.15.72:0/1513036294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b201581f0 0x7f6b201557a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f6b14000e10 tx=0x7f6b14000da0).stop 2023-08-31T19:03:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.230+0000 7f6b255ff700 1 -- 172.21.15.72:0/1513036294 shutdown_connections 2023-08-31T19:03:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.230+0000 7f6b255ff700 1 --2- 172.21.15.72:0/1513036294 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6b0c05ef30 0x7f6b0c0613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.230+0000 7f6b255ff700 1 --2- 172.21.15.72:0/1513036294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b20064060 0x7f6b200644e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.230+0000 7f6b255ff700 1 --2- 172.21.15.72:0/1513036294 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6b08003910 0x7f6b201504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.230+0000 7f6b255ff700 1 --2- 172.21.15.72:0/1513036294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b201581f0 0x7f6b201557a0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.230+0000 7f6b255ff700 1 -- 172.21.15.72:0/1513036294 >> 172.21.15.72:0/1513036294 conn(0x7f6b2005e870 msgr2=0x7f6b200a7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:33.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.230+0000 7f6b255ff700 1 -- 172.21.15.72:0/1513036294 shutdown_connections 2023-08-31T19:03:33.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.230+0000 7f6b255ff700 1 -- 172.21.15.72:0/1513036294 wait complete. 2023-08-31T19:03:33.239 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:03:33.248 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-08-31T19:03:32.950460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2416960,"kb_used_data":7424,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752557760,"statfs":{"total":773094113280,"available":770619146240,"internally_reserved":0,"allocated":7602176,"data_stored":3849772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28925,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-82,"num_write_kb":-67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-34,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.967526"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.002115+0000","last_change":"2023-08-31T19:03:29.002115+0000","last_active":"2023-08-31T19:03:29.002115+0000","last_peered":"2023-08-31T19:03:29.002115+0000","last_clean":"2023-08-31T19:03:29.002115+0000","last_became_active":"2023-08-31T19:03:29.001461+0000","last_became_peered":"2023-08-31T19:03:29.001461+0000","last_unstale":"2023-08-31T19:03:29.002115+0000","last_undegraded":"2023-08-31T19:03:29.002115+0000","last_fullsized":"2023-08-31T19:03:29.002115+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"78'3","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.001482+0000","last_change":"2023-08-31T19:03:28.522928+0000","last_active":"2023-08-31T19:03:29.001482+0000","last_peered":"2023-08-31T19:03:29.001482+0000","last_clean":"2023-08-31T19:03:29.001482+0000","last_became_active":"2023-08-31T19:03:28.522635+0000","last_became_peered":"2023-08-31T19:03:28.522635+0000","last_unstale":"2023-08-31T19:03:29.001482+0000","last_undegraded":"2023-08-31T19:03:29.001482+0000","last_fullsized":"2023-08-31T19:03:29.001482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.001958+0000","last_change":"2023-08-31T19:03:29.001958+0000","last_active":"2023-08-31T19:03:29.001958+0000","last_peered":"2023-08-31T19:03:29.001958+0000","last_clean":"2023-08-31T19:03:29.001958+0000","last_became_active":"2023-08-31T19:03:29.001526+0000","last_became_peered":"2023-08-31T19:03:29.001526+0000","last_unstale":"2023-08-31T19:03:29.001958+0000","last_undegraded":"2023-08-31T19:03:29.001958+0000","last_fullsized":"2023-08-31T19:03:29.001958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.541773+0000","last_change":"2023-08-31T19:03:28.534348+0000","last_active":"2023-08-31T19:03:28.541773+0000","last_peered":"2023-08-31T19:03:28.541773+0000","last_clean":"2023-08-31T19:03:28.541773+0000","last_became_active":"2023-08-31T19:03:28.533643+0000","last_became_peered":"2023-08-31T19:03:28.533643+0000","last_unstale":"2023-08-31T19:03:28.541773+0000","last_undegraded":"2023-08-31T19:03:28.541773+0000","last_fullsized":"2023-08-31T19:03:28.541773+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.992658+0000","last_change":"2023-08-31T19:03:28.992658+0000","last_active":"2023-08-31T19:03:28.992658+0000","last_peered":"2023-08-31T19:03:28.992658+0000","last_clean":"2023-08-31T19:03:28.992658+0000","last_became_active":"2023-08-31T19:03:28.992398+0000","last_became_peered":"2023-08-31T19:03:28.992398+0000","last_unstale":"2023-08-31T19:03:28.992658+0000","last_undegraded":"2023-08-31T19:03:28.992658+0000","last_fullsized":"2023-08-31T19:03:28.992658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.546167+0000","last_change":"2023-08-31T19:03:28.544261+0000","last_active":"2023-08-31T19:03:28.546167+0000","last_peered":"2023-08-31T19:03:28.546167+0000","last_clean":"2023-08-31T19:03:28.546167+0000","last_became_active":"2023-08-31T19:03:28.543964+0000","last_became_peered":"2023-08-31T19:03:28.543964+0000","last_unstale":"2023-08-31T19:03:28.546167+0000","last_undegraded":"2023-08-31T19:03:28.546167+0000","last_fullsized":"2023-08-31T19:03:28.546167+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.006794+0000","last_change":"2023-08-31T19:03:29.006794+0000","last_active":"2023-08-31T19:03:29.006794+0000","last_peered":"2023-08-31T19:03:29.006794+0000","last_clean":"2023-08-31T19:03:29.006794+0000","last_became_active":"2023-08-31T19:03:29.006508+0000","last_became_peered":"2023-08-31T19:03:29.006508+0000","last_unstale":"2023-08-31T19:03:29.006794+0000","last_undegraded":"2023-08-31T19:03:29.006794+0000","last_fullsized":"2023-08-31T19:03:29.006794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"78'2","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.005493+0000","last_change":"2023-08-31T19:03:28.541351+0000","last_active":"2023-08-31T19:03:29.005493+0000","last_peered":"2023-08-31T19:03:29.005493+0000","last_clean":"2023-08-31T19:03:29.005493+0000","last_became_active":"2023-08-31T19:03:28.541034+0000","last_became_peered":"2023-08-31T19:03:28.541034+0000","last_unstale":"2023-08-31T19:03:29.005493+0000","last_undegraded":"2023-08-31T19:03:29.005493+0000","last_fullsized":"2023-08-31T19:03:29.005493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.993395+0000","last_change":"2023-08-31T19:03:28.993395+0000","last_active":"2023-08-31T19:03:28.993395+0000","last_peered":"2023-08-31T19:03:28.993395+0000","last_clean":"2023-08-31T19:03:28.993395+0000","last_became_active":"2023-08-31T19:03:28.993116+0000","last_became_peered":"2023-08-31T19:03:28.993116+0000","last_unstale":"2023-08-31T19:03:28.993395+0000","last_undegraded":"2023-08-31T19:03:28.993395+0000","last_fullsized":"2023-08-31T19:03:28.993395+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.987180+0000","last_change":"2023-08-31T19:03:28.540145+0000","last_active":"2023-08-31T19:03:28.987180+0000","last_peered":"2023-08-31T19:03:28.987180+0000","last_clean":"2023-08-31T19:03:28.987180+0000","last_became_active":"2023-08-31T19:03:28.539867+0000","last_became_peered":"2023-08-31T19:03:28.539867+0000","last_unstale":"2023-08-31T19:03:28.987180+0000","last_undegraded":"2023-08-31T19:03:28.987180+0000","last_fullsized":"2023-08-31T19:03:28.987180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.010254+0000","last_change":"2023-08-31T19:03:29.010254+0000","last_active":"2023-08-31T19:03:29.010254+0000","last_peered":"2023-08-31T19:03:29.010254+0000","last_clean":"2023-08-31T19:03:29.010254+0000","last_became_active":"2023-08-31T19:03:29.009938+0000","last_became_peered":"2023-08-31T19:03:29.009938+0000","last_unstale":"2023-08-31T19:03:29.010254+0000","last_undegraded":"2023-08-31T19:03:29.010254+0000","last_fullsized":"2023-08-31T19:03:29.010254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.976043+0000","last_change":"2023-08-31T19:03:28.523660+0000","last_active":"2023-08-31T19:03:28.976043+0000","last_peered":"2023-08-31T19:03:28.976043+0000","last_clean":"2023-08-31T19:03:28.976043+0000","last_became_active":"2023-08-31T19:03:28.523049+0000","last_became_peered":"2023-08-31T19:03:28.523049+0000","last_unstale":"2023-08-31T19:03:28.976043+0000","last_undegraded":"2023-08-31T19:03:28.976043+0000","last_fullsized":"2023-08-31T19:03:28.976043+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.988202+0000","last_change":"2023-08-31T19:03:28.988202+0000","last_active":"2023-08-31T19:03:28.988202+0000","last_peered":"2023-08-31T19:03:28.988202+0000","last_clean":"2023-08-31T19:03:28.988202+0000","last_became_active":"2023-08-31T19:03:28.987861+0000","last_became_peered":"2023-08-31T19:03:28.987861+0000","last_unstale":"2023-08-31T19:03:28.988202+0000","last_undegraded":"2023-08-31T19:03:28.988202+0000","last_fullsized":"2023-08-31T19:03:28.988202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.535731+0000","last_change":"2023-08-31T19:03:28.533725+0000","last_active":"2023-08-31T19:03:28.535731+0000","last_peered":"2023-08-31T19:03:28.535731+0000","last_clean":"2023-08-31T19:03:28.535731+0000","last_became_active":"2023-08-31T19:03:28.533377+0000","last_became_peered":"2023-08-31T19:03:28.533377+0000","last_unstale":"2023-08-31T19:03:28.535731+0000","last_undegraded":"2023-08-31T19:03:28.535731+0000","last_fullsized":"2023-08-31T19:03:28.535731+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.006741+0000","last_change":"2023-08-31T19:03:29.006741+0000","last_active":"2023-08-31T19:03:29.006741+0000","last_peered":"2023-08-31T19:03:29.006741+0000","last_clean":"2023-08-31T19:03:29.006741+0000","last_became_active":"2023-08-31T19:03:29.006415+0000","last_became_peered":"2023-08-31T19:03:29.006415+0000","last_unstale":"2023-08-31T19:03:29.006741+0000","last_undegraded":"2023-08-31T19:03:29.006741+0000","last_fullsized":"2023-08-31T19:03:29.006741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.533949+0000","last_change":"2023-08-31T19:03:28.526552+0000","last_active":"2023-08-31T19:03:28.533949+0000","last_peered":"2023-08-31T19:03:28.533949+0000","last_clean":"2023-08-31T19:03:28.533949+0000","last_became_active":"2023-08-31T19:03:28.526277+0000","last_became_peered":"2023-08-31T19:03:28.526277+0000","last_unstale":"2023-08-31T19:03:28.533949+0000","last_undegraded":"2023-08-31T19:03:28.533949+0000","last_fullsized":"2023-08-31T19:03:28.533949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.005354+0000","last_change":"2023-08-31T19:03:29.005354+0000","last_active":"2023-08-31T19:03:29.005354+0000","last_peered":"2023-08-31T19:03:29.005354+0000","last_clean":"2023-08-31T19:03:29.005354+0000","last_became_active":"2023-08-31T19:03:29.005032+0000","last_became_peered":"2023-08-31T19:03:29.005032+0000","last_unstale":"2023-08-31T19:03:29.005354+0000","last_undegraded":"2023-08-31T19:03:29.005354+0000","last_fullsized":"2023-08-31T19:03:29.005354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.544882+0000","last_change":"2023-08-31T19:03:28.543593+0000","last_active":"2023-08-31T19:03:28.544882+0000","last_peered":"2023-08-31T19:03:28.544882+0000","last_clean":"2023-08-31T19:03:28.544882+0000","last_became_active":"2023-08-31T19:03:28.543293+0000","last_became_peered":"2023-08-31T19:03:28.543293+0000","last_unstale":"2023-08-31T19:03:28.544882+0000","last_undegraded":"2023-08-31T19:03:28.544882+0000","last_fullsized":"2023-08-31T19:03:28.544882+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.998470+0000","last_change":"2023-08-31T19:03:28.998470+0000","last_active":"2023-08-31T19:03:28.998470+0000","last_peered":"2023-08-31T19:03:28.998470+0000","last_clean":"2023-08-31T19:03:28.998470+0000","last_became_active":"2023-08-31T19:03:28.998106+0000","last_became_peered":"2023-08-31T19:03:28.998106+0000","last_unstale":"2023-08-31T19:03:28.998470+0000","last_undegraded":"2023-08-31T19:03:28.998470+0000","last_fullsized":"2023-08-31T19:03:28.998470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.545648+0000","last_change":"2023-08-31T19:03:28.534470+0000","last_active":"2023-08-31T19:03:28.545648+0000","last_peered":"2023-08-31T19:03:28.545648+0000","last_clean":"2023-08-31T19:03:28.545648+0000","last_became_active":"2023-08-31T19:03:28.534256+0000","last_became_peered":"2023-08-31T19:03:28.534256+0000","last_unstale":"2023-08-31T19:03:28.545648+0000","last_undegraded":"2023-08-31T19:03:28.545648+0000","last_fullsized":"2023-08-31T19:03:28.545648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.993868+0000","last_change":"2023-08-31T19:03:28.993868+0000","last_active":"2023-08-31T19:03:28.993868+0000","last_peered":"2023-08-31T19:03:28.993868+0000","last_clean":"2023-08-31T19:03:28.993868+0000","last_became_active":"2023-08-31T19:03:28.993558+0000","last_became_peered":"2023-08-31T19:03:28.993558+0000","last_unstale":"2023-08-31T19:03:28.993868+0000","last_undegraded":"2023-08-31T19:03:28.993868+0000","last_fullsized":"2023-08-31T19:03:28.993868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.538691+0000","last_change":"2023-08-31T19:03:28.530051+0000","last_active":"2023-08-31T19:03:28.538691+0000","last_peered":"2023-08-31T19:03:28.538691+0000","last_clean":"2023-08-31T19:03:28.538691+0000","last_became_active":"2023-08-31T19:03:28.529764+0000","last_became_peered":"2023-08-31T19:03:28.529764+0000","last_unstale":"2023-08-31T19:03:28.538691+0000","last_undegraded":"2023-08-31T19:03:28.538691+0000","last_fullsized":"2023-08-31T19:03:28.538691+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.006547+0000","last_change":"2023-08-31T19:03:29.006547+0000","last_active":"2023-08-31T19:03:29.006547+0000","last_peered":"2023-08-31T19:03:29.006547+0000","last_clean":"2023-08-31T19:03:29.006547+0000","last_became_active":"2023-08-31T19:03:29.006266+0000","last_became_peered":"2023-08-31T19:03:29.006266+0000","last_unstale":"2023-08-31T19:03:29.006547+0000","last_undegraded":"2023-08-31T19:03:29.006547+0000","last_fullsized":"2023-08-31T19:03:29.006547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"78'4","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.010775+0000","last_change":"2023-08-31T19:03:28.537857+0000","last_active":"2023-08-31T19:03:29.010775+0000","last_peered":"2023-08-31T19:03:29.010775+0000","last_clean":"2023-08-31T19:03:29.010775+0000","last_became_active":"2023-08-31T19:03:28.537602+0000","last_became_peered":"2023-08-31T19:03:28.537602+0000","last_unstale":"2023-08-31T19:03:29.010775+0000","last_undegraded":"2023-08-31T19:03:29.010775+0000","last_fullsized":"2023-08-31T19:03:29.010775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.012026+0000","last_change":"2023-08-31T19:03:29.012026+0000","last_active":"2023-08-31T19:03:29.012026+0000","last_peered":"2023-08-31T19:03:29.012026+0000","last_clean":"2023-08-31T19:03:29.012026+0000","last_became_active":"2023-08-31T19:03:29.011762+0000","last_became_peered":"2023-08-31T19:03:29.011762+0000","last_unstale":"2023-08-31T19:03:29.012026+0000","last_undegraded":"2023-08-31T19:03:29.012026+0000","last_fullsized":"2023-08-31T19:03:29.012026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.979883+0000","last_change":"2023-08-31T19:03:28.536860+0000","last_active":"2023-08-31T19:03:28.979883+0000","last_peered":"2023-08-31T19:03:28.979883+0000","last_clean":"2023-08-31T19:03:28.979883+0000","last_became_active":"2023-08-31T19:03:28.536560+0000","last_became_peered":"2023-08-31T19:03:28.536560+0000","last_unstale":"2023-08-31T19:03:28.979883+0000","last_undegraded":"2023-08-31T19:03:28.979883+0000","last_fullsized":"2023-08-31T19:03:28.979883+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.999781+0000","last_change":"2023-08-31T19:03:28.999781+0000","last_active":"2023-08-31T19:03:28.999781+0000","last_peered":"2023-08-31T19:03:28.999781+0000","last_clean":"2023-08-31T19:03:28.999781+0000","last_became_active":"2023-08-31T19:03:28.999502+0000","last_became_peered":"2023-08-31T19:03:28.999502+0000","last_unstale":"2023-08-31T19:03:28.999781+0000","last_undegraded":"2023-08-31T19:03:28.999781+0000","last_fullsized":"2023-08-31T19:03:28.999781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.527472+0000","last_change":"2023-08-31T19:03:28.524214+0000","last_active":"2023-08-31T19:03:28.527472+0000","last_peered":"2023-08-31T19:03:28.527472+0000","last_clean":"2023-08-31T19:03:28.527472+0000","last_became_active":"2023-08-31T19:03:28.523912+0000","last_became_peered":"2023-08-31T19:03:28.523912+0000","last_unstale":"2023-08-31T19:03:28.527472+0000","last_undegraded":"2023-08-31T19:03:28.527472+0000","last_fullsized":"2023-08-31T19:03:28.527472+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.001471+0000","last_change":"2023-08-31T19:03:29.001471+0000","last_active":"2023-08-31T19:03:29.001471+0000","last_peered":"2023-08-31T19:03:29.001471+0000","last_clean":"2023-08-31T19:03:29.001471+0000","last_became_active":"2023-08-31T19:03:29.000766+0000","last_became_peered":"2023-08-31T19:03:29.000766+0000","last_unstale":"2023-08-31T19:03:29.001471+0000","last_undegraded":"2023-08-31T19:03:29.001471+0000","last_fullsized":"2023-08-31T19:03:29.001471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.528787+0000","last_change":"2023-08-31T19:03:28.526563+0000","last_active":"2023-08-31T19:03:28.528787+0000","last_peered":"2023-08-31T19:03:28.528787+0000","last_clean":"2023-08-31T19:03:28.528787+0000","last_became_active":"2023-08-31T19:03:28.526265+0000","last_became_peered":"2023-08-31T19:03:28.526265+0000","last_unstale":"2023-08-31T19:03:28.528787+0000","last_undegraded":"2023-08-31T19:03:28.528787+0000","last_fullsized":"2023-08-31T19:03:28.528787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.005506+0000","last_change":"2023-08-31T19:03:29.005506+0000","last_active":"2023-08-31T19:03:29.005506+0000","last_peered":"2023-08-31T19:03:29.005506+0000","last_clean":"2023-08-31T19:03:29.005506+0000","last_became_active":"2023-08-31T19:03:29.005169+0000","last_became_peered":"2023-08-31T19:03:29.005169+0000","last_unstale":"2023-08-31T19:03:29.005506+0000","last_undegraded":"2023-08-31T19:03:29.005506+0000","last_fullsized":"2023-08-31T19:03:29.005506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"78'4","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.990985+0000","last_change":"2023-08-31T19:03:28.537253+0000","last_active":"2023-08-31T19:03:28.990985+0000","last_peered":"2023-08-31T19:03:28.990985+0000","last_clean":"2023-08-31T19:03:28.990985+0000","last_became_active":"2023-08-31T19:03:28.536972+0000","last_became_peered":"2023-08-31T19:03:28.536972+0000","last_unstale":"2023-08-31T19:03:28.990985+0000","last_undegraded":"2023-08-31T19:03:28.990985+0000","last_fullsized":"2023-08-31T19:03:28.990985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.995335+0000","last_change":"2023-08-31T19:03:28.995335+0000","last_active":"2023-08-31T19:03:28.995335+0000","last_peered":"2023-08-31T19:03:28.995335+0000","last_clean":"2023-08-31T19:03:28.995335+0000","last_became_active":"2023-08-31T19:03:28.995081+0000","last_became_peered":"2023-08-31T19:03:28.995081+0000","last_unstale":"2023-08-31T19:03:28.995335+0000","last_undegraded":"2023-08-31T19:03:28.995335+0000","last_fullsized":"2023-08-31T19:03:28.995335+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.537615+0000","last_change":"2023-08-31T19:03:28.532839+0000","last_active":"2023-08-31T19:03:28.537615+0000","last_peered":"2023-08-31T19:03:28.537615+0000","last_clean":"2023-08-31T19:03:28.537615+0000","last_became_active":"2023-08-31T19:03:28.532588+0000","last_became_peered":"2023-08-31T19:03:28.532588+0000","last_unstale":"2023-08-31T19:03:28.537615+0000","last_undegraded":"2023-08-31T19:03:28.537615+0000","last_fullsized":"2023-08-31T19:03:28.537615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.000819+0000","last_change":"2023-08-31T19:03:29.000819+0000","last_active":"2023-08-31T19:03:29.000819+0000","last_peered":"2023-08-31T19:03:29.000819+0000","last_clean":"2023-08-31T19:03:29.000819+0000","last_became_active":"2023-08-31T19:03:29.000457+0000","last_became_peered":"2023-08-31T19:03:29.000457+0000","last_unstale":"2023-08-31T19:03:29.000819+0000","last_undegraded":"2023-08-31T19:03:29.000819+0000","last_fullsized":"2023-08-31T19:03:29.000819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.544594+0000","last_change":"2023-08-31T19:03:28.540610+0000","last_active":"2023-08-31T19:03:28.544594+0000","last_peered":"2023-08-31T19:03:28.544594+0000","last_clean":"2023-08-31T19:03:28.544594+0000","last_became_active":"2023-08-31T19:03:28.540310+0000","last_became_peered":"2023-08-31T19:03:28.540310+0000","last_unstale":"2023-08-31T19:03:28.544594+0000","last_undegraded":"2023-08-31T19:03:28.544594+0000","last_fullsized":"2023-08-31T19:03:28.544594+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.998707+0000","last_change":"2023-08-31T19:03:28.998707+0000","last_active":"2023-08-31T19:03:28.998707+0000","last_peered":"2023-08-31T19:03:28.998707+0000","last_clean":"2023-08-31T19:03:28.998707+0000","last_became_active":"2023-08-31T19:03:28.998350+0000","last_became_peered":"2023-08-31T19:03:28.998350+0000","last_unstale":"2023-08-31T19:03:28.998707+0000","last_undegraded":"2023-08-31T19:03:28.998707+0000","last_fullsized":"2023-08-31T19:03:28.998707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.988295+0000","last_change":"2023-08-31T19:03:28.522320+0000","last_active":"2023-08-31T19:03:28.988295+0000","last_peered":"2023-08-31T19:03:28.988295+0000","last_clean":"2023-08-31T19:03:28.988295+0000","last_became_active":"2023-08-31T19:03:28.522025+0000","last_became_peered":"2023-08-31T19:03:28.522025+0000","last_unstale":"2023-08-31T19:03:28.988295+0000","last_undegraded":"2023-08-31T19:03:28.988295+0000","last_fullsized":"2023-08-31T19:03:28.988295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.000398+0000","last_change":"2023-08-31T19:03:29.000398+0000","last_active":"2023-08-31T19:03:29.000398+0000","last_peered":"2023-08-31T19:03:29.000398+0000","last_clean":"2023-08-31T19:03:29.000398+0000","last_became_active":"2023-08-31T19:03:28.999887+0000","last_became_peered":"2023-08-31T19:03:28.999887+0000","last_unstale":"2023-08-31T19:03:29.000398+0000","last_undegraded":"2023-08-31T19:03:29.000398+0000","last_fullsized":"2023-08-31T19:03:29.000398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.543284+0000","last_change":"2023-08-31T19:03:28.539042+0000","last_active":"2023-08-31T19:03:28.543284+0000","last_peered":"2023-08-31T19:03:28.543284+0000","last_clean":"2023-08-31T19:03:28.543284+0000","last_became_active":"2023-08-31T19:03:28.538753+0000","last_became_peered":"2023-08-31T19:03:28.538753+0000","last_unstale":"2023-08-31T19:03:28.543284+0000","last_undegraded":"2023-08-31T19:03:28.543284+0000","last_fullsized":"2023-08-31T19:03:28.543284+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.000956+0000","last_change":"2023-08-31T19:03:29.000956+0000","last_active":"2023-08-31T19:03:29.000956+0000","last_peered":"2023-08-31T19:03:29.000956+0000","last_clean":"2023-08-31T19:03:29.000956+0000","last_became_active":"2023-08-31T19:03:29.000585+0000","last_became_peered":"2023-08-31T19:03:29.000585+0000","last_unstale":"2023-08-31T19:03:29.000956+0000","last_undegraded":"2023-08-31T19:03:29.000956+0000","last_fullsized":"2023-08-31T19:03:29.000956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.981954+0000","last_change":"2023-08-31T19:03:28.535582+0000","last_active":"2023-08-31T19:03:28.981954+0000","last_peered":"2023-08-31T19:03:28.981954+0000","last_clean":"2023-08-31T19:03:28.981954+0000","last_became_active":"2023-08-31T19:03:28.535303+0000","last_became_peered":"2023-08-31T19:03:28.535303+0000","last_unstale":"2023-08-31T19:03:28.981954+0000","last_undegraded":"2023-08-31T19:03:28.981954+0000","last_fullsized":"2023-08-31T19:03:28.981954+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.002218+0000","last_change":"2023-08-31T19:03:29.002218+0000","last_active":"2023-08-31T19:03:29.002218+0000","last_peered":"2023-08-31T19:03:29.002218+0000","last_clean":"2023-08-31T19:03:29.002218+0000","last_became_active":"2023-08-31T19:03:29.001899+0000","last_became_peered":"2023-08-31T19:03:29.001899+0000","last_unstale":"2023-08-31T19:03:29.002218+0000","last_undegraded":"2023-08-31T19:03:29.002218+0000","last_fullsized":"2023-08-31T19:03:29.002218+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.528150+0000","last_change":"2023-08-31T19:03:28.524971+0000","last_active":"2023-08-31T19:03:28.528150+0000","last_peered":"2023-08-31T19:03:28.528150+0000","last_clean":"2023-08-31T19:03:28.528150+0000","last_became_active":"2023-08-31T19:03:28.524637+0000","last_became_peered":"2023-08-31T19:03:28.524637+0000","last_unstale":"2023-08-31T19:03:28.528150+0000","last_undegraded":"2023-08-31T19:03:28.528150+0000","last_fullsized":"2023-08-31T19:03:28.528150+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.999557+0000","last_change":"2023-08-31T19:03:28.999557+0000","last_active":"2023-08-31T19:03:28.999557+0000","last_peered":"2023-08-31T19:03:28.999557+0000","last_clean":"2023-08-31T19:03:28.999557+0000","last_became_active":"2023-08-31T19:03:28.999214+0000","last_became_peered":"2023-08-31T19:03:28.999214+0000","last_unstale":"2023-08-31T19:03:28.999557+0000","last_undegraded":"2023-08-31T19:03:28.999557+0000","last_fullsized":"2023-08-31T19:03:28.999557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.544796+0000","last_change":"2023-08-31T19:03:28.538991+0000","last_active":"2023-08-31T19:03:28.544796+0000","last_peered":"2023-08-31T19:03:28.544796+0000","last_clean":"2023-08-31T19:03:28.544796+0000","last_became_active":"2023-08-31T19:03:28.538354+0000","last_became_peered":"2023-08-31T19:03:28.538354+0000","last_unstale":"2023-08-31T19:03:28.544796+0000","last_undegraded":"2023-08-31T19:03:28.544796+0000","last_fullsized":"2023-08-31T19:03:28.544796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.997498+0000","last_change":"2023-08-31T19:03:28.997498+0000","last_active":"2023-08-31T19:03:28.997498+0000","last_peered":"2023-08-31T19:03:28.997498+0000","last_clean":"2023-08-31T19:03:28.997498+0000","last_became_active":"2023-08-31T19:03:28.997207+0000","last_became_peered":"2023-08-31T19:03:28.997207+0000","last_unstale":"2023-08-31T19:03:28.997498+0000","last_undegraded":"2023-08-31T19:03:28.997498+0000","last_fullsized":"2023-08-31T19:03:28.997498+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.541697+0000","last_change":"2023-08-31T19:03:28.537420+0000","last_active":"2023-08-31T19:03:28.541697+0000","last_peered":"2023-08-31T19:03:28.541697+0000","last_clean":"2023-08-31T19:03:28.541697+0000","last_became_active":"2023-08-31T19:03:28.537145+0000","last_became_peered":"2023-08-31T19:03:28.537145+0000","last_unstale":"2023-08-31T19:03:28.541697+0000","last_undegraded":"2023-08-31T19:03:28.541697+0000","last_fullsized":"2023-08-31T19:03:28.541697+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.993212+0000","last_change":"2023-08-31T19:03:28.993212+0000","last_active":"2023-08-31T19:03:28.993212+0000","last_peered":"2023-08-31T19:03:28.993212+0000","last_clean":"2023-08-31T19:03:28.993212+0000","last_became_active":"2023-08-31T19:03:28.992902+0000","last_became_peered":"2023-08-31T19:03:28.992902+0000","last_unstale":"2023-08-31T19:03:28.993212+0000","last_undegraded":"2023-08-31T19:03:28.993212+0000","last_fullsized":"2023-08-31T19:03:28.993212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.544986+0000","last_change":"2023-08-31T19:03:28.541510+0000","last_active":"2023-08-31T19:03:28.544986+0000","last_peered":"2023-08-31T19:03:28.544986+0000","last_clean":"2023-08-31T19:03:28.544986+0000","last_became_active":"2023-08-31T19:03:28.541239+0000","last_became_peered":"2023-08-31T19:03:28.541239+0000","last_unstale":"2023-08-31T19:03:28.544986+0000","last_undegraded":"2023-08-31T19:03:28.544986+0000","last_fullsized":"2023-08-31T19:03:28.544986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.003597+0000","last_change":"2023-08-31T19:03:29.003597+0000","last_active":"2023-08-31T19:03:29.003597+0000","last_peered":"2023-08-31T19:03:29.003597+0000","last_clean":"2023-08-31T19:03:29.003597+0000","last_became_active":"2023-08-31T19:03:29.003336+0000","last_became_peered":"2023-08-31T19:03:29.003336+0000","last_unstale":"2023-08-31T19:03:29.003597+0000","last_undegraded":"2023-08-31T19:03:29.003597+0000","last_fullsized":"2023-08-31T19:03:29.003597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.533231+0000","last_change":"2023-08-31T19:03:28.530177+0000","last_active":"2023-08-31T19:03:28.533231+0000","last_peered":"2023-08-31T19:03:28.533231+0000","last_clean":"2023-08-31T19:03:28.533231+0000","last_became_active":"2023-08-31T19:03:28.529494+0000","last_became_peered":"2023-08-31T19:03:28.529494+0000","last_unstale":"2023-08-31T19:03:28.533231+0000","last_undegraded":"2023-08-31T19:03:28.533231+0000","last_fullsized":"2023-08-31T19:03:28.533231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.006140+0000","last_change":"2023-08-31T19:03:29.006140+0000","last_active":"2023-08-31T19:03:29.006140+0000","last_peered":"2023-08-31T19:03:29.006140+0000","last_clean":"2023-08-31T19:03:29.006140+0000","last_became_active":"2023-08-31T19:03:29.005728+0000","last_became_peered":"2023-08-31T19:03:29.005728+0000","last_unstale":"2023-08-31T19:03:29.006140+0000","last_undegraded":"2023-08-31T19:03:29.006140+0000","last_fullsized":"2023-08-31T19:03:29.006140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.541433+0000","last_change":"2023-08-31T19:03:28.536952+0000","last_active":"2023-08-31T19:03:28.541433+0000","last_peered":"2023-08-31T19:03:28.541433+0000","last_clean":"2023-08-31T19:03:28.541433+0000","last_became_active":"2023-08-31T19:03:28.536665+0000","last_became_peered":"2023-08-31T19:03:28.536665+0000","last_unstale":"2023-08-31T19:03:28.541433+0000","last_undegraded":"2023-08-31T19:03:28.541433+0000","last_fullsized":"2023-08-31T19:03:28.541433+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.997602+0000","last_change":"2023-08-31T19:03:28.997602+0000","last_active":"2023-08-31T19:03:28.997602+0000","last_peered":"2023-08-31T19:03:28.997602+0000","last_clean":"2023-08-31T19:03:28.997602+0000","last_became_active":"2023-08-31T19:03:28.997231+0000","last_became_peered":"2023-08-31T19:03:28.997231+0000","last_unstale":"2023-08-31T19:03:28.997602+0000","last_undegraded":"2023-08-31T19:03:28.997602+0000","last_fullsized":"2023-08-31T19:03:28.997602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.542376+0000","last_change":"2023-08-31T19:03:28.539039+0000","last_active":"2023-08-31T19:03:28.542376+0000","last_peered":"2023-08-31T19:03:28.542376+0000","last_clean":"2023-08-31T19:03:28.542376+0000","last_became_active":"2023-08-31T19:03:28.538797+0000","last_became_peered":"2023-08-31T19:03:28.538797+0000","last_unstale":"2023-08-31T19:03:28.542376+0000","last_undegraded":"2023-08-31T19:03:28.542376+0000","last_fullsized":"2023-08-31T19:03:28.542376+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.999386+0000","last_change":"2023-08-31T19:03:28.999386+0000","last_active":"2023-08-31T19:03:28.999386+0000","last_peered":"2023-08-31T19:03:28.999386+0000","last_clean":"2023-08-31T19:03:28.999386+0000","last_became_active":"2023-08-31T19:03:28.999105+0000","last_became_peered":"2023-08-31T19:03:28.999105+0000","last_unstale":"2023-08-31T19:03:28.999386+0000","last_undegraded":"2023-08-31T19:03:28.999386+0000","last_fullsized":"2023-08-31T19:03:28.999386+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.537576+0000","last_change":"2023-08-31T19:03:28.533048+0000","last_active":"2023-08-31T19:03:28.537576+0000","last_peered":"2023-08-31T19:03:28.537576+0000","last_clean":"2023-08-31T19:03:28.537576+0000","last_became_active":"2023-08-31T19:03:28.532383+0000","last_became_peered":"2023-08-31T19:03:28.532383+0000","last_unstale":"2023-08-31T19:03:28.537576+0000","last_undegraded":"2023-08-31T19:03:28.537576+0000","last_fullsized":"2023-08-31T19:03:28.537576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.004180+0000","last_change":"2023-08-31T19:03:29.004180+0000","last_active":"2023-08-31T19:03:29.004180+0000","last_peered":"2023-08-31T19:03:29.004180+0000","last_clean":"2023-08-31T19:03:29.004180+0000","last_became_active":"2023-08-31T19:03:29.003876+0000","last_became_peered":"2023-08-31T19:03:29.003876+0000","last_unstale":"2023-08-31T19:03:29.004180+0000","last_undegraded":"2023-08-31T19:03:29.004180+0000","last_fullsized":"2023-08-31T19:03:29.004180+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.543914+0000","last_change":"2023-08-31T19:03:28.537976+0000","last_active":"2023-08-31T19:03:28.543914+0000","last_peered":"2023-08-31T19:03:28.543914+0000","last_clean":"2023-08-31T19:03:28.543914+0000","last_became_active":"2023-08-31T19:03:28.537691+0000","last_became_peered":"2023-08-31T19:03:28.537691+0000","last_unstale":"2023-08-31T19:03:28.543914+0000","last_undegraded":"2023-08-31T19:03:28.543914+0000","last_fullsized":"2023-08-31T19:03:28.543914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.002598+0000","last_change":"2023-08-31T19:03:29.002598+0000","last_active":"2023-08-31T19:03:29.002598+0000","last_peered":"2023-08-31T19:03:29.002598+0000","last_clean":"2023-08-31T19:03:29.002598+0000","last_became_active":"2023-08-31T19:03:29.002205+0000","last_became_peered":"2023-08-31T19:03:29.002205+0000","last_unstale":"2023-08-31T19:03:29.002598+0000","last_undegraded":"2023-08-31T19:03:29.002598+0000","last_fullsized":"2023-08-31T19:03:29.002598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.540155+0000","last_change":"2023-08-31T19:03:28.530945+0000","last_active":"2023-08-31T19:03:28.540155+0000","last_peered":"2023-08-31T19:03:28.540155+0000","last_clean":"2023-08-31T19:03:28.540155+0000","last_became_active":"2023-08-31T19:03:28.528863+0000","last_became_peered":"2023-08-31T19:03:28.528863+0000","last_unstale":"2023-08-31T19:03:28.540155+0000","last_undegraded":"2023-08-31T19:03:28.540155+0000","last_fullsized":"2023-08-31T19:03:28.540155+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.008090+0000","last_change":"2023-08-31T19:03:29.008090+0000","last_active":"2023-08-31T19:03:29.008090+0000","last_peered":"2023-08-31T19:03:29.008090+0000","last_clean":"2023-08-31T19:03:29.008090+0000","last_became_active":"2023-08-31T19:03:29.007764+0000","last_became_peered":"2023-08-31T19:03:29.007764+0000","last_unstale":"2023-08-31T19:03:29.008090+0000","last_undegraded":"2023-08-31T19:03:29.008090+0000","last_fullsized":"2023-08-31T19:03:29.008090+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.537801+0000","last_change":"2023-08-31T19:03:28.535768+0000","last_active":"2023-08-31T19:03:28.537801+0000","last_peered":"2023-08-31T19:03:28.537801+0000","last_clean":"2023-08-31T19:03:28.537801+0000","last_became_active":"2023-08-31T19:03:28.535462+0000","last_became_peered":"2023-08-31T19:03:28.535462+0000","last_unstale":"2023-08-31T19:03:28.537801+0000","last_undegraded":"2023-08-31T19:03:28.537801+0000","last_fullsized":"2023-08-31T19:03:28.537801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.997623+0000","last_change":"2023-08-31T19:03:28.997623+0000","last_active":"2023-08-31T19:03:28.997623+0000","last_peered":"2023-08-31T19:03:28.997623+0000","last_clean":"2023-08-31T19:03:28.997623+0000","last_became_active":"2023-08-31T19:03:28.997147+0000","last_became_peered":"2023-08-31T19:03:28.997147+0000","last_unstale":"2023-08-31T19:03:28.997623+0000","last_undegraded":"2023-08-31T19:03:28.997623+0000","last_fullsized":"2023-08-31T19:03:28.997623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.984265+0000","last_change":"2023-08-31T19:03:28.537655+0000","last_active":"2023-08-31T19:03:28.984265+0000","last_peered":"2023-08-31T19:03:28.984265+0000","last_clean":"2023-08-31T19:03:28.984265+0000","last_became_active":"2023-08-31T19:03:28.537331+0000","last_became_peered":"2023-08-31T19:03:28.537331+0000","last_unstale":"2023-08-31T19:03:28.984265+0000","last_undegraded":"2023-08-31T19:03:28.984265+0000","last_fullsized":"2023-08-31T19:03:28.984265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.003956+0000","last_change":"2023-08-31T19:03:29.003956+0000","last_active":"2023-08-31T19:03:29.003956+0000","last_peered":"2023-08-31T19:03:29.003956+0000","last_clean":"2023-08-31T19:03:29.003956+0000","last_became_active":"2023-08-31T19:03:28.998502+0000","last_became_peered":"2023-08-31T19:03:28.998502+0000","last_unstale":"2023-08-31T19:03:29.003956+0000","last_undegraded":"2023-08-31T19:03:29.003956+0000","last_fullsized":"2023-08-31T19:03:29.003956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.976442+0000","last_change":"2023-08-31T19:03:28.540979+0000","last_active":"2023-08-31T19:03:28.976442+0000","last_peered":"2023-08-31T19:03:28.976442+0000","last_clean":"2023-08-31T19:03:28.976442+0000","last_became_active":"2023-08-31T19:03:28.540719+0000","last_became_peered":"2023-08-31T19:03:28.540719+0000","last_unstale":"2023-08-31T19:03:28.976442+0000","last_undegraded":"2023-08-31T19:03:28.976442+0000","last_fullsized":"2023-08-31T19:03:28.976442+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.997091+0000","last_change":"2023-08-31T19:03:28.997091+0000","last_active":"2023-08-31T19:03:28.997091+0000","last_peered":"2023-08-31T19:03:28.997091+0000","last_clean":"2023-08-31T19:03:28.997091+0000","last_became_active":"2023-08-31T19:03:28.996644+0000","last_became_peered":"2023-08-31T19:03:28.996644+0000","last_unstale":"2023-08-31T19:03:28.997091+0000","last_undegraded":"2023-08-31T19:03:28.997091+0000","last_fullsized":"2023-08-31T19:03:28.997091+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"78'2","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.984017+0000","last_change":"2023-08-31T19:03:28.537180+0000","last_active":"2023-08-31T19:03:28.984017+0000","last_peered":"2023-08-31T19:03:28.984017+0000","last_clean":"2023-08-31T19:03:28.984017+0000","last_became_active":"2023-08-31T19:03:28.536041+0000","last_became_peered":"2023-08-31T19:03:28.536041+0000","last_unstale":"2023-08-31T19:03:28.984017+0000","last_undegraded":"2023-08-31T19:03:28.984017+0000","last_fullsized":"2023-08-31T19:03:28.984017+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.997386+0000","last_change":"2023-08-31T19:03:28.997386+0000","last_active":"2023-08-31T19:03:28.997386+0000","last_peered":"2023-08-31T19:03:28.997386+0000","last_clean":"2023-08-31T19:03:28.997386+0000","last_became_active":"2023-08-31T19:03:28.997067+0000","last_became_peered":"2023-08-31T19:03:28.997067+0000","last_unstale":"2023-08-31T19:03:28.997386+0000","last_undegraded":"2023-08-31T19:03:28.997386+0000","last_fullsized":"2023-08-31T19:03:28.997386+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.544040+0000","last_change":"2023-08-31T19:03:28.539938+0000","last_active":"2023-08-31T19:03:28.544040+0000","last_peered":"2023-08-31T19:03:28.544040+0000","last_clean":"2023-08-31T19:03:28.544040+0000","last_became_active":"2023-08-31T19:03:28.539679+0000","last_became_peered":"2023-08-31T19:03:28.539679+0000","last_unstale":"2023-08-31T19:03:28.544040+0000","last_undegraded":"2023-08-31T19:03:28.544040+0000","last_fullsized":"2023-08-31T19:03:28.544040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.995871+0000","last_change":"2023-08-31T19:03:28.995871+0000","last_active":"2023-08-31T19:03:28.995871+0000","last_peered":"2023-08-31T19:03:28.995871+0000","last_clean":"2023-08-31T19:03:28.995871+0000","last_became_active":"2023-08-31T19:03:28.995570+0000","last_became_peered":"2023-08-31T19:03:28.995570+0000","last_unstale":"2023-08-31T19:03:28.995871+0000","last_undegraded":"2023-08-31T19:03:28.995871+0000","last_fullsized":"2023-08-31T19:03:28.995871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.543052+0000","last_change":"2023-08-31T19:03:28.538771+0000","last_active":"2023-08-31T19:03:28.543052+0000","last_peered":"2023-08-31T19:03:28.543052+0000","last_clean":"2023-08-31T19:03:28.543052+0000","last_became_active":"2023-08-31T19:03:28.538487+0000","last_became_peered":"2023-08-31T19:03:28.538487+0000","last_unstale":"2023-08-31T19:03:28.543052+0000","last_undegraded":"2023-08-31T19:03:28.543052+0000","last_fullsized":"2023-08-31T19:03:28.543052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.003861+0000","last_change":"2023-08-31T19:03:29.003861+0000","last_active":"2023-08-31T19:03:29.003861+0000","last_peered":"2023-08-31T19:03:29.003861+0000","last_clean":"2023-08-31T19:03:29.003861+0000","last_became_active":"2023-08-31T19:03:29.003564+0000","last_became_peered":"2023-08-31T19:03:29.003564+0000","last_unstale":"2023-08-31T19:03:29.003861+0000","last_undegraded":"2023-08-31T19:03:29.003861+0000","last_fullsized":"2023-08-31T19:03:29.003861+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.526329+0000","last_change":"2023-08-31T19:03:28.522759+0000","last_active":"2023-08-31T19:03:28.526329+0000","last_peered":"2023-08-31T19:03:28.526329+0000","last_clean":"2023-08-31T19:03:28.526329+0000","last_became_active":"2023-08-31T19:03:28.522444+0000","last_became_peered":"2023-08-31T19:03:28.522444+0000","last_unstale":"2023-08-31T19:03:28.526329+0000","last_undegraded":"2023-08-31T19:03:28.526329+0000","last_fullsized":"2023-08-31T19:03:28.526329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.991918+0000","last_change":"2023-08-31T19:03:28.991918+0000","last_active":"2023-08-31T19:03:28.991918+0000","last_peered":"2023-08-31T19:03:28.991918+0000","last_clean":"2023-08-31T19:03:28.991918+0000","last_became_active":"2023-08-31T19:03:28.991382+0000","last_became_peered":"2023-08-31T19:03:28.991382+0000","last_unstale":"2023-08-31T19:03:28.991918+0000","last_undegraded":"2023-08-31T19:03:28.991918+0000","last_fullsized":"2023-08-31T19:03:28.991918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.541725+0000","last_change":"2023-08-31T19:03:28.534181+0000","last_active":"2023-08-31T19:03:28.541725+0000","last_peered":"2023-08-31T19:03:28.541725+0000","last_clean":"2023-08-31T19:03:28.541725+0000","last_became_active":"2023-08-31T19:03:28.533723+0000","last_became_peered":"2023-08-31T19:03:28.533723+0000","last_unstale":"2023-08-31T19:03:28.541725+0000","last_undegraded":"2023-08-31T19:03:28.541725+0000","last_fullsized":"2023-08-31T19:03:28.541725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.004785+0000","last_change":"2023-08-31T19:03:29.004785+0000","last_active":"2023-08-31T19:03:29.004785+0000","last_peered":"2023-08-31T19:03:29.004785+0000","last_clean":"2023-08-31T19:03:29.004785+0000","last_became_active":"2023-08-31T19:03:29.004541+0000","last_became_peered":"2023-08-31T19:03:29.004541+0000","last_unstale":"2023-08-31T19:03:29.004785+0000","last_undegraded":"2023-08-31T19:03:29.004785+0000","last_fullsized":"2023-08-31T19:03:29.004785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.541720+0000","last_change":"2023-08-31T19:03:28.539098+0000","last_active":"2023-08-31T19:03:28.541720+0000","last_peered":"2023-08-31T19:03:28.541720+0000","last_clean":"2023-08-31T19:03:28.541720+0000","last_became_active":"2023-08-31T19:03:28.538727+0000","last_became_peered":"2023-08-31T19:03:28.538727+0000","last_unstale":"2023-08-31T19:03:28.541720+0000","last_undegraded":"2023-08-31T19:03:28.541720+0000","last_fullsized":"2023-08-31T19:03:28.541720+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.999924+0000","last_change":"2023-08-31T19:03:28.999924+0000","last_active":"2023-08-31T19:03:28.999924+0000","last_peered":"2023-08-31T19:03:28.999924+0000","last_clean":"2023-08-31T19:03:28.999924+0000","last_became_active":"2023-08-31T19:03:28.999619+0000","last_became_peered":"2023-08-31T19:03:28.999619+0000","last_unstale":"2023-08-31T19:03:28.999924+0000","last_undegraded":"2023-08-31T19:03:28.999924+0000","last_fullsized":"2023-08-31T19:03:28.999924+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.548954+0000","last_change":"2023-08-31T19:03:28.546244+0000","last_active":"2023-08-31T19:03:28.548954+0000","last_peered":"2023-08-31T19:03:28.548954+0000","last_clean":"2023-08-31T19:03:28.548954+0000","last_became_active":"2023-08-31T19:03:28.545917+0000","last_became_peered":"2023-08-31T19:03:28.545917+0000","last_unstale":"2023-08-31T19:03:28.548954+0000","last_undegraded":"2023-08-31T19:03:28.548954+0000","last_fullsized":"2023-08-31T19:03:28.548954+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.008472+0000","last_change":"2023-08-31T19:03:29.008472+0000","last_active":"2023-08-31T19:03:29.008472+0000","last_peered":"2023-08-31T19:03:29.008472+0000","last_clean":"2023-08-31T19:03:29.008472+0000","last_became_active":"2023-08-31T19:03:29.008270+0000","last_became_peered":"2023-08-31T19:03:29.008270+0000","last_unstale":"2023-08-31T19:03:29.008472+0000","last_undegraded":"2023-08-31T19:03:29.008472+0000","last_fullsized":"2023-08-31T19:03:29.008472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.542496+0000","last_change":"2023-08-31T19:03:28.536239+0000","last_active":"2023-08-31T19:03:28.542496+0000","last_peered":"2023-08-31T19:03:28.542496+0000","last_clean":"2023-08-31T19:03:28.542496+0000","last_became_active":"2023-08-31T19:03:28.535930+0000","last_became_peered":"2023-08-31T19:03:28.535930+0000","last_unstale":"2023-08-31T19:03:28.542496+0000","last_undegraded":"2023-08-31T19:03:28.542496+0000","last_fullsized":"2023-08-31T19:03:28.542496+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.008845+0000","last_change":"2023-08-31T19:03:29.008845+0000","last_active":"2023-08-31T19:03:29.008845+0000","last_peered":"2023-08-31T19:03:29.008845+0000","last_clean":"2023-08-31T19:03:29.008845+0000","last_became_active":"2023-08-31T19:03:29.008512+0000","last_became_peered":"2023-08-31T19:03:29.008512+0000","last_unstale":"2023-08-31T19:03:29.008845+0000","last_undegraded":"2023-08-31T19:03:29.008845+0000","last_fullsized":"2023-08-31T19:03:29.008845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"78'3","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.005910+0000","last_change":"2023-08-31T19:03:28.546249+0000","last_active":"2023-08-31T19:03:29.005910+0000","last_peered":"2023-08-31T19:03:29.005910+0000","last_clean":"2023-08-31T19:03:29.005910+0000","last_became_active":"2023-08-31T19:03:28.545914+0000","last_became_peered":"2023-08-31T19:03:28.545914+0000","last_unstale":"2023-08-31T19:03:29.005910+0000","last_undegraded":"2023-08-31T19:03:29.005910+0000","last_fullsized":"2023-08-31T19:03:29.005910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.004632+0000","last_change":"2023-08-31T19:03:29.004632+0000","last_active":"2023-08-31T19:03:29.004632+0000","last_peered":"2023-08-31T19:03:29.004632+0000","last_clean":"2023-08-31T19:03:29.004632+0000","last_became_active":"2023-08-31T19:03:29.004389+0000","last_became_peered":"2023-08-31T19:03:29.004389+0000","last_unstale":"2023-08-31T19:03:29.004632+0000","last_undegraded":"2023-08-31T19:03:29.004632+0000","last_fullsized":"2023-08-31T19:03:29.004632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"78'2","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.006156+0000","last_change":"2023-08-31T19:03:28.531564+0000","last_active":"2023-08-31T19:03:29.006156+0000","last_peered":"2023-08-31T19:03:29.006156+0000","last_clean":"2023-08-31T19:03:29.006156+0000","last_became_active":"2023-08-31T19:03:28.531263+0000","last_became_peered":"2023-08-31T19:03:28.531263+0000","last_unstale":"2023-08-31T19:03:29.006156+0000","last_undegraded":"2023-08-31T19:03:29.006156+0000","last_fullsized":"2023-08-31T19:03:29.006156+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.991603+0000","last_change":"2023-08-31T19:03:28.991603+0000","last_active":"2023-08-31T19:03:28.991603+0000","last_peered":"2023-08-31T19:03:28.991603+0000","last_clean":"2023-08-31T19:03:28.991603+0000","last_became_active":"2023-08-31T19:03:28.991321+0000","last_became_peered":"2023-08-31T19:03:28.991321+0000","last_unstale":"2023-08-31T19:03:28.991603+0000","last_undegraded":"2023-08-31T19:03:28.991603+0000","last_fullsized":"2023-08-31T19:03:28.991603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.982072+0000","last_change":"2023-08-31T19:03:28.537257+0000","last_active":"2023-08-31T19:03:28.982072+0000","last_peered":"2023-08-31T19:03:28.982072+0000","last_clean":"2023-08-31T19:03:28.982072+0000","last_became_active":"2023-08-31T19:03:28.536973+0000","last_became_peered":"2023-08-31T19:03:28.536973+0000","last_unstale":"2023-08-31T19:03:28.982072+0000","last_undegraded":"2023-08-31T19:03:28.982072+0000","last_fullsized":"2023-08-31T19:03:28.982072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.996340+0000","last_change":"2023-08-31T19:03:28.996340+0000","last_active":"2023-08-31T19:03:28.996340+0000","last_peered":"2023-08-31T19:03:28.996340+0000","last_clean":"2023-08-31T19:03:28.996340+0000","last_became_active":"2023-08-31T19:03:28.995702+0000","last_became_peered":"2023-08-31T19:03:28.995702+0000","last_unstale":"2023-08-31T19:03:28.996340+0000","last_undegraded":"2023-08-31T19:03:28.996340+0000","last_fullsized":"2023-08-31T19:03:28.996340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.545066+0000","last_change":"2023-08-31T19:03:28.541807+0000","last_active":"2023-08-31T19:03:28.545066+0000","last_peered":"2023-08-31T19:03:28.545066+0000","last_clean":"2023-08-31T19:03:28.545066+0000","last_became_active":"2023-08-31T19:03:28.541306+0000","last_became_peered":"2023-08-31T19:03:28.541306+0000","last_unstale":"2023-08-31T19:03:28.545066+0000","last_undegraded":"2023-08-31T19:03:28.545066+0000","last_fullsized":"2023-08-31T19:03:28.545066+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.000207+0000","last_change":"2023-08-31T19:03:29.000207+0000","last_active":"2023-08-31T19:03:29.000207+0000","last_peered":"2023-08-31T19:03:29.000207+0000","last_clean":"2023-08-31T19:03:29.000207+0000","last_became_active":"2023-08-31T19:03:28.999917+0000","last_became_peered":"2023-08-31T19:03:28.999917+0000","last_unstale":"2023-08-31T19:03:29.000207+0000","last_undegraded":"2023-08-31T19:03:29.000207+0000","last_fullsized":"2023-08-31T19:03:29.000207+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.544814+0000","last_change":"2023-08-31T19:03:28.539181+0000","last_active":"2023-08-31T19:03:28.544814+0000","last_peered":"2023-08-31T19:03:28.544814+0000","last_clean":"2023-08-31T19:03:28.544814+0000","last_became_active":"2023-08-31T19:03:28.538667+0000","last_became_peered":"2023-08-31T19:03:28.538667+0000","last_unstale":"2023-08-31T19:03:28.544814+0000","last_undegraded":"2023-08-31T19:03:28.544814+0000","last_fullsized":"2023-08-31T19:03:28.544814+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.992072+0000","last_change":"2023-08-31T19:03:28.992072+0000","last_active":"2023-08-31T19:03:28.992072+0000","last_peered":"2023-08-31T19:03:28.992072+0000","last_clean":"2023-08-31T19:03:28.992072+0000","last_became_active":"2023-08-31T19:03:28.991738+0000","last_became_peered":"2023-08-31T19:03:28.991738+0000","last_unstale":"2023-08-31T19:03:28.992072+0000","last_undegraded":"2023-08-31T19:03:28.992072+0000","last_fullsized":"2023-08-31T19:03:28.992072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"78'4","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.011769+0000","last_change":"2023-08-31T19:03:28.535372+0000","last_active":"2023-08-31T19:03:29.011769+0000","last_peered":"2023-08-31T19:03:29.011769+0000","last_clean":"2023-08-31T19:03:29.011769+0000","last_became_active":"2023-08-31T19:03:28.535072+0000","last_became_peered":"2023-08-31T19:03:28.535072+0000","last_unstale":"2023-08-31T19:03:29.011769+0000","last_undegraded":"2023-08-31T19:03:29.011769+0000","last_fullsized":"2023-08-31T19:03:29.011769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.999542+0000","last_change":"2023-08-31T19:03:28.999542+0000","last_active":"2023-08-31T19:03:28.999542+0000","last_peered":"2023-08-31T19:03:28.999542+0000","last_clean":"2023-08-31T19:03:28.999542+0000","last_became_active":"2023-08-31T19:03:28.999155+0000","last_became_peered":"2023-08-31T19:03:28.999155+0000","last_unstale":"2023-08-31T19:03:28.999542+0000","last_undegraded":"2023-08-31T19:03:28.999542+0000","last_fullsized":"2023-08-31T19:03:28.999542+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"78'2","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.010642+0000","last_change":"2023-08-31T19:03:28.537832+0000","last_active":"2023-08-31T19:03:29.010642+0000","last_peered":"2023-08-31T19:03:29.010642+0000","last_clean":"2023-08-31T19:03:29.010642+0000","last_became_active":"2023-08-31T19:03:28.537532+0000","last_became_peered":"2023-08-31T19:03:28.537532+0000","last_unstale":"2023-08-31T19:03:29.010642+0000","last_undegraded":"2023-08-31T19:03:29.010642+0000","last_fullsized":"2023-08-31T19:03:29.010642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.994711+0000","last_change":"2023-08-31T19:03:28.994711+0000","last_active":"2023-08-31T19:03:28.994711+0000","last_peered":"2023-08-31T19:03:28.994711+0000","last_clean":"2023-08-31T19:03:28.994711+0000","last_became_active":"2023-08-31T19:03:28.994369+0000","last_became_peered":"2023-08-31T19:03:28.994369+0000","last_unstale":"2023-08-31T19:03:28.994711+0000","last_undegraded":"2023-08-31T19:03:28.994711+0000","last_fullsized":"2023-08-31T19:03:28.994711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.542182+0000","last_change":"2023-08-31T19:03:28.540072+0000","last_active":"2023-08-31T19:03:28.542182+0000","last_peered":"2023-08-31T19:03:28.542182+0000","last_clean":"2023-08-31T19:03:28.542182+0000","last_became_active":"2023-08-31T19:03:28.539742+0000","last_became_peered":"2023-08-31T19:03:28.539742+0000","last_unstale":"2023-08-31T19:03:28.542182+0000","last_undegraded":"2023-08-31T19:03:28.542182+0000","last_fullsized":"2023-08-31T19:03:28.542182+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.996589+0000","last_change":"2023-08-31T19:03:28.996589+0000","last_active":"2023-08-31T19:03:28.996589+0000","last_peered":"2023-08-31T19:03:28.996589+0000","last_clean":"2023-08-31T19:03:28.996589+0000","last_became_active":"2023-08-31T19:03:28.993627+0000","last_became_peered":"2023-08-31T19:03:28.993627+0000","last_unstale":"2023-08-31T19:03:28.996589+0000","last_undegraded":"2023-08-31T19:03:28.996589+0000","last_fullsized":"2023-08-31T19:03:28.996589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.537771+0000","last_change":"2023-08-31T19:03:28.535756+0000","last_active":"2023-08-31T19:03:28.537771+0000","last_peered":"2023-08-31T19:03:28.537771+0000","last_clean":"2023-08-31T19:03:28.537771+0000","last_became_active":"2023-08-31T19:03:28.535351+0000","last_became_peered":"2023-08-31T19:03:28.535351+0000","last_unstale":"2023-08-31T19:03:28.537771+0000","last_undegraded":"2023-08-31T19:03:28.537771+0000","last_fullsized":"2023-08-31T19:03:28.537771+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.993342+0000","last_change":"2023-08-31T19:03:28.993342+0000","last_active":"2023-08-31T19:03:28.993342+0000","last_peered":"2023-08-31T19:03:28.993342+0000","last_clean":"2023-08-31T19:03:28.993342+0000","last_became_active":"2023-08-31T19:03:28.992898+0000","last_became_peered":"2023-08-31T19:03:28.992898+0000","last_unstale":"2023-08-31T19:03:28.993342+0000","last_undegraded":"2023-08-31T19:03:28.993342+0000","last_fullsized":"2023-08-31T19:03:28.993342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.545777+0000","last_change":"2023-08-31T19:03:28.538609+0000","last_active":"2023-08-31T19:03:28.545777+0000","last_peered":"2023-08-31T19:03:28.545777+0000","last_clean":"2023-08-31T19:03:28.545777+0000","last_became_active":"2023-08-31T19:03:28.538060+0000","last_became_peered":"2023-08-31T19:03:28.538060+0000","last_unstale":"2023-08-31T19:03:28.545777+0000","last_undegraded":"2023-08-31T19:03:28.545777+0000","last_fullsized":"2023-08-31T19:03:28.545777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.994158+0000","last_change":"2023-08-31T19:03:28.994158+0000","last_active":"2023-08-31T19:03:28.994158+0000","last_peered":"2023-08-31T19:03:28.994158+0000","last_clean":"2023-08-31T19:03:28.994158+0000","last_became_active":"2023-08-31T19:03:28.993735+0000","last_became_peered":"2023-08-31T19:03:28.993735+0000","last_unstale":"2023-08-31T19:03:28.994158+0000","last_undegraded":"2023-08-31T19:03:28.994158+0000","last_fullsized":"2023-08-31T19:03:28.994158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.544140+0000","last_change":"2023-08-31T19:03:28.536448+0000","last_active":"2023-08-31T19:03:28.544140+0000","last_peered":"2023-08-31T19:03:28.544140+0000","last_clean":"2023-08-31T19:03:28.544140+0000","last_became_active":"2023-08-31T19:03:28.536158+0000","last_became_peered":"2023-08-31T19:03:28.536158+0000","last_unstale":"2023-08-31T19:03:28.544140+0000","last_undegraded":"2023-08-31T19:03:28.544140+0000","last_fullsized":"2023-08-31T19:03:28.544140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.011827+0000","last_change":"2023-08-31T19:03:29.011827+0000","last_active":"2023-08-31T19:03:29.011827+0000","last_peered":"2023-08-31T19:03:29.011827+0000","last_clean":"2023-08-31T19:03:29.011827+0000","last_became_active":"2023-08-31T19:03:29.011520+0000","last_became_peered":"2023-08-31T19:03:29.011520+0000","last_unstale":"2023-08-31T19:03:29.011827+0000","last_undegraded":"2023-08-31T19:03:29.011827+0000","last_fullsized":"2023-08-31T19:03:29.011827+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.542503+0000","last_change":"2023-08-31T19:03:28.534875+0000","last_active":"2023-08-31T19:03:28.542503+0000","last_peered":"2023-08-31T19:03:28.542503+0000","last_clean":"2023-08-31T19:03:28.542503+0000","last_became_active":"2023-08-31T19:03:28.534615+0000","last_became_peered":"2023-08-31T19:03:28.534615+0000","last_unstale":"2023-08-31T19:03:28.542503+0000","last_undegraded":"2023-08-31T19:03:28.542503+0000","last_fullsized":"2023-08-31T19:03:28.542503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.999389+0000","last_change":"2023-08-31T19:03:28.999389+0000","last_active":"2023-08-31T19:03:28.999389+0000","last_peered":"2023-08-31T19:03:28.999389+0000","last_clean":"2023-08-31T19:03:28.999389+0000","last_became_active":"2023-08-31T19:03:28.998690+0000","last_became_peered":"2023-08-31T19:03:28.998690+0000","last_unstale":"2023-08-31T19:03:28.999389+0000","last_undegraded":"2023-08-31T19:03:28.999389+0000","last_fullsized":"2023-08-31T19:03:28.999389+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.541704+0000","last_change":"2023-08-31T19:03:28.534008+0000","last_active":"2023-08-31T19:03:28.541704+0000","last_peered":"2023-08-31T19:03:28.541704+0000","last_clean":"2023-08-31T19:03:28.541704+0000","last_became_active":"2023-08-31T19:03:28.533407+0000","last_became_peered":"2023-08-31T19:03:28.533407+0000","last_unstale":"2023-08-31T19:03:28.541704+0000","last_undegraded":"2023-08-31T19:03:28.541704+0000","last_fullsized":"2023-08-31T19:03:28.541704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.006570+0000","last_change":"2023-08-31T19:03:29.006570+0000","last_active":"2023-08-31T19:03:29.006570+0000","last_peered":"2023-08-31T19:03:29.006570+0000","last_clean":"2023-08-31T19:03:29.006570+0000","last_became_active":"2023-08-31T19:03:29.006250+0000","last_became_peered":"2023-08-31T19:03:29.006250+0000","last_unstale":"2023-08-31T19:03:29.006570+0000","last_undegraded":"2023-08-31T19:03:29.006570+0000","last_fullsized":"2023-08-31T19:03:29.006570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.545696+0000","last_change":"2023-08-31T19:03:28.537590+0000","last_active":"2023-08-31T19:03:28.545696+0000","last_peered":"2023-08-31T19:03:28.545696+0000","last_clean":"2023-08-31T19:03:28.545696+0000","last_became_active":"2023-08-31T19:03:28.536483+0000","last_became_peered":"2023-08-31T19:03:28.536483+0000","last_unstale":"2023-08-31T19:03:28.545696+0000","last_undegraded":"2023-08-31T19:03:28.545696+0000","last_fullsized":"2023-08-31T19:03:28.545696+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.002180+0000","last_change":"2023-08-31T19:03:29.002180+0000","last_active":"2023-08-31T19:03:29.002180+0000","last_peered":"2023-08-31T19:03:29.002180+0000","last_clean":"2023-08-31T19:03:29.002180+0000","last_became_active":"2023-08-31T19:03:29.000851+0000","last_became_peered":"2023-08-31T19:03:29.000851+0000","last_unstale":"2023-08-31T19:03:29.002180+0000","last_undegraded":"2023-08-31T19:03:29.002180+0000","last_fullsized":"2023-08-31T19:03:29.002180+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.987813+0000","last_change":"2023-08-31T19:03:28.540343+0000","last_active":"2023-08-31T19:03:28.987813+0000","last_peered":"2023-08-31T19:03:28.987813+0000","last_clean":"2023-08-31T19:03:28.987813+0000","last_became_active":"2023-08-31T19:03:28.540022+0000","last_became_peered":"2023-08-31T19:03:28.540022+0000","last_unstale":"2023-08-31T19:03:28.987813+0000","last_undegraded":"2023-08-31T19:03:28.987813+0000","last_fullsized":"2023-08-31T19:03:28.987813+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.530964+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:03:28.530964+0000","last_peered":"2023-08-31T19:03:28.530964+0000","last_clean":"2023-08-31T19:03:28.530964+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:03:28.530964+0000","last_undegraded":"2023-08-31T19:03:28.530964+0000","last_fullsized":"2023-08-31T19:03:28.530964+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.991700+0000","last_change":"2023-08-31T19:03:28.991700+0000","last_active":"2023-08-31T19:03:28.991700+0000","last_peered":"2023-08-31T19:03:28.991700+0000","last_clean":"2023-08-31T19:03:28.991700+0000","last_became_active":"2023-08-31T19:03:28.990956+0000","last_became_peered":"2023-08-31T19:03:28.990956+0000","last_unstale":"2023-08-31T19:03:28.991700+0000","last_undegraded":"2023-08-31T19:03:28.991700+0000","last_fullsized":"2023-08-31T19:03:28.991700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.536053+0000","last_change":"2023-08-31T19:03:28.533737+0000","last_active":"2023-08-31T19:03:28.536053+0000","last_peered":"2023-08-31T19:03:28.536053+0000","last_clean":"2023-08-31T19:03:28.536053+0000","last_became_active":"2023-08-31T19:03:28.533388+0000","last_became_peered":"2023-08-31T19:03:28.533388+0000","last_unstale":"2023-08-31T19:03:28.536053+0000","last_undegraded":"2023-08-31T19:03:28.536053+0000","last_fullsized":"2023-08-31T19:03:28.536053+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.518915+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:03:28.518915+0000","last_peered":"2023-08-31T19:03:28.518915+0000","last_clean":"2023-08-31T19:03:28.518915+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:03:28.518915+0000","last_undegraded":"2023-08-31T19:03:28.518915+0000","last_fullsized":"2023-08-31T19:03:28.518915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.996534+0000","last_change":"2023-08-31T19:03:28.996534+0000","last_active":"2023-08-31T19:03:28.996534+0000","last_peered":"2023-08-31T19:03:28.996534+0000","last_clean":"2023-08-31T19:03:28.996534+0000","last_became_active":"2023-08-31T19:03:28.996068+0000","last_became_peered":"2023-08-31T19:03:28.996068+0000","last_unstale":"2023-08-31T19:03:28.996534+0000","last_undegraded":"2023-08-31T19:03:28.996534+0000","last_fullsized":"2023-08-31T19:03:28.996534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.545047+0000","last_change":"2023-08-31T19:03:28.541597+0000","last_active":"2023-08-31T19:03:28.545047+0000","last_peered":"2023-08-31T19:03:28.545047+0000","last_clean":"2023-08-31T19:03:28.545047+0000","last_became_active":"2023-08-31T19:03:28.540890+0000","last_became_peered":"2023-08-31T19:03:28.540890+0000","last_unstale":"2023-08-31T19:03:28.545047+0000","last_undegraded":"2023-08-31T19:03:28.545047+0000","last_fullsized":"2023-08-31T19:03:28.545047+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.515130+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:03:28.515130+0000","last_peered":"2023-08-31T19:03:28.515130+0000","last_clean":"2023-08-31T19:03:28.515130+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:03:28.515130+0000","last_undegraded":"2023-08-31T19:03:28.515130+0000","last_fullsized":"2023-08-31T19:03:28.515130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.994038+0000","last_change":"2023-08-31T19:03:28.994038+0000","last_active":"2023-08-31T19:03:28.994038+0000","last_peered":"2023-08-31T19:03:28.994038+0000","last_clean":"2023-08-31T19:03:28.994038+0000","last_became_active":"2023-08-31T19:03:28.993698+0000","last_became_peered":"2023-08-31T19:03:28.993698+0000","last_unstale":"2023-08-31T19:03:28.994038+0000","last_undegraded":"2023-08-31T19:03:28.994038+0000","last_fullsized":"2023-08-31T19:03:28.994038+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.543259+0000","last_change":"2023-08-31T19:03:28.538838+0000","last_active":"2023-08-31T19:03:28.543259+0000","last_peered":"2023-08-31T19:03:28.543259+0000","last_clean":"2023-08-31T19:03:28.543259+0000","last_became_active":"2023-08-31T19:03:28.538563+0000","last_became_peered":"2023-08-31T19:03:28.538563+0000","last_unstale":"2023-08-31T19:03:28.543259+0000","last_undegraded":"2023-08-31T19:03:28.543259+0000","last_fullsized":"2023-08-31T19:03:28.543259+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":64,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.520019+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:03:28.520019+0000","last_peered":"2023-08-31T19:03:28.520019+0000","last_clean":"2023-08-31T19:03:28.520019+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:03:28.520019+0000","last_undegraded":"2023-08-31T19:03:28.520019+0000","last_fullsized":"2023-08-31T19:03:28.520019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":64,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.528967+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:03:28.528967+0000","last_peered":"2023-08-31T19:03:28.528967+0000","last_clean":"2023-08-31T19:03:28.528967+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:03:28.528967+0000","last_undegraded":"2023-08-31T19:03:28.528967+0000","last_fullsized":"2023-08-31T19:03:28.528967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.992186+0000","last_change":"2023-08-31T19:03:28.992186+0000","last_active":"2023-08-31T19:03:28.992186+0000","last_peered":"2023-08-31T19:03:28.992186+0000","last_clean":"2023-08-31T19:03:28.992186+0000","last_became_active":"2023-08-31T19:03:28.991738+0000","last_became_peered":"2023-08-31T19:03:28.991738+0000","last_unstale":"2023-08-31T19:03:28.992186+0000","last_undegraded":"2023-08-31T19:03:28.992186+0000","last_fullsized":"2023-08-31T19:03:28.992186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.975970+0000","last_change":"2023-08-31T19:03:28.530669+0000","last_active":"2023-08-31T19:03:28.975970+0000","last_peered":"2023-08-31T19:03:28.975970+0000","last_clean":"2023-08-31T19:03:28.975970+0000","last_became_active":"2023-08-31T19:03:28.530392+0000","last_became_peered":"2023-08-31T19:03:28.530392+0000","last_unstale":"2023-08-31T19:03:28.975970+0000","last_undegraded":"2023-08-31T19:03:28.975970+0000","last_fullsized":"2023-08-31T19:03:28.975970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.529049+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:03:28.529049+0000","last_peered":"2023-08-31T19:03:28.529049+0000","last_clean":"2023-08-31T19:03:28.529049+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:03:28.529049+0000","last_undegraded":"2023-08-31T19:03:28.529049+0000","last_fullsized":"2023-08-31T19:03:28.529049+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.008038+0000","last_change":"2023-08-31T19:03:29.008038+0000","last_active":"2023-08-31T19:03:29.008038+0000","last_peered":"2023-08-31T19:03:29.008038+0000","last_clean":"2023-08-31T19:03:29.008038+0000","last_became_active":"2023-08-31T19:03:29.007678+0000","last_became_peered":"2023-08-31T19:03:29.007678+0000","last_unstale":"2023-08-31T19:03:29.008038+0000","last_undegraded":"2023-08-31T19:03:29.008038+0000","last_fullsized":"2023-08-31T19:03:29.008038+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"78'2","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.007473+0000","last_change":"2023-08-31T19:03:28.536349+0000","last_active":"2023-08-31T19:03:29.007473+0000","last_peered":"2023-08-31T19:03:29.007473+0000","last_clean":"2023-08-31T19:03:29.007473+0000","last_became_active":"2023-08-31T19:03:28.536043+0000","last_became_peered":"2023-08-31T19:03:28.536043+0000","last_unstale":"2023-08-31T19:03:29.007473+0000","last_undegraded":"2023-08-31T19:03:29.007473+0000","last_fullsized":"2023-08-31T19:03:29.007473+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.524827+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:03:28.524827+0000","last_peered":"2023-08-31T19:03:28.524827+0000","last_clean":"2023-08-31T19:03:28.524827+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:03:28.524827+0000","last_undegraded":"2023-08-31T19:03:28.524827+0000","last_fullsized":"2023-08-31T19:03:28.524827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.005233+0000","last_change":"2023-08-31T19:03:29.005233+0000","last_active":"2023-08-31T19:03:29.005233+0000","last_peered":"2023-08-31T19:03:29.005233+0000","last_clean":"2023-08-31T19:03:29.005233+0000","last_became_active":"2023-08-31T19:03:29.004923+0000","last_became_peered":"2023-08-31T19:03:29.004923+0000","last_unstale":"2023-08-31T19:03:29.005233+0000","last_undegraded":"2023-08-31T19:03:29.005233+0000","last_fullsized":"2023-08-31T19:03:29.005233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.546187+0000","last_change":"2023-08-31T19:03:28.544444+0000","last_active":"2023-08-31T19:03:28.546187+0000","last_peered":"2023-08-31T19:03:28.546187+0000","last_clean":"2023-08-31T19:03:28.546187+0000","last_became_active":"2023-08-31T19:03:28.544123+0000","last_became_peered":"2023-08-31T19:03:28.544123+0000","last_unstale":"2023-08-31T19:03:28.546187+0000","last_undegraded":"2023-08-31T19:03:28.546187+0000","last_fullsized":"2023-08-31T19:03:28.546187+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.530879+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:03:28.530879+0000","last_peered":"2023-08-31T19:03:28.530879+0000","last_clean":"2023-08-31T19:03:28.530879+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:03:28.530879+0000","last_undegraded":"2023-08-31T19:03:28.530879+0000","last_fullsized":"2023-08-31T19:03:28.530879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.993172+0000","last_change":"2023-08-31T19:03:28.993172+0000","last_active":"2023-08-31T19:03:28.993172+0000","last_peered":"2023-08-31T19:03:28.993172+0000","last_clean":"2023-08-31T19:03:28.993172+0000","last_became_active":"2023-08-31T19:03:28.992495+0000","last_became_peered":"2023-08-31T19:03:28.992495+0000","last_unstale":"2023-08-31T19:03:28.993172+0000","last_undegraded":"2023-08-31T19:03:28.993172+0000","last_fullsized":"2023-08-31T19:03:28.993172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.534363+0000","last_change":"2023-08-31T19:03:28.526608+0000","last_active":"2023-08-31T19:03:28.534363+0000","last_peered":"2023-08-31T19:03:28.534363+0000","last_clean":"2023-08-31T19:03:28.534363+0000","last_became_active":"2023-08-31T19:03:28.526324+0000","last_became_peered":"2023-08-31T19:03:28.526324+0000","last_unstale":"2023-08-31T19:03:28.534363+0000","last_undegraded":"2023-08-31T19:03:28.534363+0000","last_fullsized":"2023-08-31T19:03:28.534363+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.519518+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:03:28.519518+0000","last_peered":"2023-08-31T19:03:28.519518+0000","last_clean":"2023-08-31T19:03:28.519518+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:03:28.519518+0000","last_undegraded":"2023-08-31T19:03:28.519518+0000","last_fullsized":"2023-08-31T19:03:28.519518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302124,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069716,"statfs":{"total":96636764160,"available":96327389184,"internally_reserved":0,"allocated":954368,"data_stored":481661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.56899999999999995,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.0489999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.53400000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0169999999999999},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67500000000000004,"15min":0.69999999999999996},"min":{"1min":0.48099999999999998,"5min":0.40699999999999997,"15min":0.40000000000000002},"max":{"1min":0.83399999999999996,"5min":0.93000000000000005,"15min":0.97299999999999998},"last":0.748},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.53600000000000003,"5min":0.40500000000000003,"15min":0.36199999999999999},"max":{"1min":0.85899999999999999,"5min":0.93100000000000005,"15min":0.96799999999999997},"last":0.62}]},{"osd":2,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.94199999999999995,"5min":0.97799999999999998,"15min":1.093},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.57599999999999996,"5min":0.49399999999999999,"15min":0.41199999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":1.054},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.51200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.83799999999999997,"5min":1.0229999999999999,"15min":1.1160000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.58899999999999997,"5min":0.52200000000000002,"15min":0.495},"max":{"1min":0.95799999999999996,"5min":0.96399999999999997,"15min":1.0860000000000001},"last":0.85999999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":0.83799999999999997,"15min":0.97899999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97199999999999998,"5min":0.98499999999999999,"15min":1.163},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.41099999999999998,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":1.139,"15min":1.139},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.38500000000000001},"max":{"1min":0.93899999999999995,"5min":0.97699999999999998,"15min":1.353},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.67600000000000005},"min":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.41399999999999998},"max":{"1min":0.88700000000000001,"5min":0.93100000000000005,"15min":1.3999999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68899999999999995,"15min":0.69799999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.91900000000000004,"5min":1.038,"15min":1.462},"last":0.77900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302116,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069724,"statfs":{"total":96636764160,"available":96327397376,"internally_reserved":0,"allocated":946176,"data_stored":480679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68700000000000006,"15min":0.70699999999999996},"min":{"1min":0.65100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90200000000000002,"5min":0.92000000000000004,"15min":1.0189999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68600000000000005,"15min":0.70199999999999996},"min":{"1min":0.57199999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":0.90900000000000003,"15min":0.94499999999999995},"last":0.57199999999999995}]},{"osd":1,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67800000000000005,"15min":0.70099999999999996},"min":{"1min":0.52400000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91100000000000003,"5min":0.92100000000000004,"15min":1.0049999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.54800000000000004,"5min":0.435,"15min":0.435},"max":{"1min":0.86799999999999999,"5min":0.91400000000000003,"15min":0.95999999999999996},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.42099999999999999},"max":{"1min":0.91100000000000003,"5min":0.94999999999999996,"15min":1.129},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.62,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94899999999999995,"5min":0.98899999999999999,"15min":1.3260000000000001},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.60499999999999998,"5min":0.51000000000000001,"15min":0.47499999999999998},"max":{"1min":0.89200000000000002,"5min":0.93200000000000005,"15min":1.0860000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.73499999999999999,"15min":0.75},"min":{"1min":0.63600000000000001,"5min":0.53300000000000003,"15min":0.49399999999999999},"max":{"1min":0.91900000000000004,"5min":0.94799999999999995,"15min":1.052},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.61899999999999999},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.40999999999999998},"max":{"1min":0.88400000000000001,"5min":0.94299999999999995,"15min":0.97799999999999998},"last":0.63},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.63600000000000001},"min":{"1min":0.47599999999999998,"5min":0.39000000000000001,"15min":0.371},"max":{"1min":0.89400000000000002,"5min":1.0880000000000001,"15min":1.091},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.66700000000000004},"min":{"1min":0.5,"5min":0.44400000000000001,"15min":0.39800000000000002},"max":{"1min":0.82999999999999996,"5min":0.96699999999999997,"15min":1.1000000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.55900000000000005,"5min":0.435,"15min":0.435},"max":{"1min":0.80500000000000005,"5min":1.0669999999999999,"15min":1.0700000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54800000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84899999999999998,"5min":1.012,"15min":1.0620000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.54400000000000004,"5min":0.47899999999999998,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":1.0800000000000001,"15min":1.1040000000000001},"last":0.623}]}]},{"osd":1,"up_from":13,"seq":55834575038,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302128,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069712,"statfs":{"total":96636764160,"available":96327385088,"internally_reserved":0,"allocated":958464,"data_stored":481401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.433,"15min":0.443},"min":{"1min":0.28000000000000003,"5min":0.27300000000000002,"15min":0.23300000000000001},"max":{"1min":0.57799999999999996,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.254},"max":{"1min":0.66600000000000004,"5min":0.752,"15min":0.752},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.29099999999999998,"15min":0.28899999999999998},"max":{"1min":0.63900000000000001,"5min":0.78000000000000003,"15min":0.82699999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.754,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.45200000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79000000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.495,"15min":0.51000000000000001},"min":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.32500000000000001},"max":{"1min":0.65000000000000002,"5min":0.67300000000000004,"15min":1.673},"last":0.438}]},{"osd":4,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76300000000000001,"15min":0.78400000000000003},"min":{"1min":0.61199999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96899999999999997,"5min":1.2110000000000001,"15min":1.4119999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80000000000000004,"15min":0.81100000000000005},"min":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.49099999999999999},"max":{"1min":1.111,"5min":1.1799999999999999,"15min":1.3},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.73599999999999999,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.497,"15min":0.46800000000000003},"max":{"1min":0.99299999999999999,"5min":1.052,"15min":1.8540000000000001},"last":0.62},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.54500000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0720000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.751}]},{"osd":6,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51400000000000001},"max":{"1min":0.97299999999999998,"5min":1.1990000000000001,"15min":1.8979999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.56799999999999995,"5min":0.51500000000000001,"15min":0.48999999999999999},"max":{"1min":1.167,"5min":1.2,"15min":1.2629999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.47699999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.113},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.51400000000000001,"15min":0.504},"max":{"1min":1.0429999999999999,"5min":1.1399999999999999,"15min":2.0720000000000001},"last":0.74399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302112,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069728,"statfs":{"total":96636764160,"available":96327401472,"internally_reserved":0,"allocated":942080,"data_stored":480645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44500000000000001,"15min":0.44600000000000001},"min":{"1min":0.31900000000000001,"5min":0.29099999999999998,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.71499999999999997,"15min":0.78400000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.49299999999999999,"15min":0.49099999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.30399999999999999},"max":{"1min":0.72499999999999998,"5min":0.876,"15min":0.876},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.50600000000000001},"min":{"1min":0.41799999999999998,"5min":0.34499999999999997,"15min":0.32900000000000001},"max":{"1min":0.64900000000000002,"5min":0.67900000000000005,"15min":0.74299999999999999},"last":0.496},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53300000000000003,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.77000000000000002,"5min":1.018,"15min":1.018},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":0.67200000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.44400000000000001,"5min":0.39500000000000002,"15min":0.36599999999999999},"max":{"1min":0.71699999999999997,"5min":0.91400000000000003,"15min":1.0509999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.82699999999999996,"15min":0.82199999999999995},"min":{"1min":0.65000000000000002,"5min":0.55000000000000004,"15min":0.53900000000000003},"max":{"1min":1.103,"5min":1.2370000000000001,"15min":1.931},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.63600000000000001,"5min":0.55000000000000004,"15min":0.49399999999999999},"max":{"1min":1.095,"5min":1.1890000000000001,"15min":1.276},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.5,"15min":0.49399999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.3480000000000001},"last":0.873},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76700000000000002,"15min":0.77000000000000002},"min":{"1min":0.58499999999999996,"5min":0.53300000000000003,"15min":0.50700000000000001},"max":{"1min":1.0029999999999999,"5min":1.1950000000000001,"15min":1.9810000000000001},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81499999999999995,"15min":0.81000000000000005},"min":{"1min":0.61099999999999999,"5min":0.52700000000000002,"15min":0.46600000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.3280000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.53500000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.2350000000000001},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83299999999999996,"15min":0.82899999999999996},"min":{"1min":0.623,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1359999999999999,"5min":1.5820000000000001,"15min":2.1760000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.83899999999999997,"15min":0.83699999999999997},"min":{"1min":0.59999999999999998,"5min":0.57399999999999995,"15min":0.52200000000000002},"max":{"1min":1.127,"5min":1.548,"15min":1.548},"last":0.98599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575037,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":950272,"data_stored":481269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45700000000000002,"15min":0.44400000000000001},"min":{"1min":0.29199999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67700000000000005,"5min":0.77600000000000002,"15min":0.90200000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.314,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61299999999999999,"5min":0.70099999999999996,"15min":1.5900000000000001},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.50600000000000001},"min":{"1min":0.38,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67400000000000004,"5min":0.75700000000000001,"15min":0.96599999999999997},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.36499999999999999},"max":{"1min":0.70299999999999996,"5min":0.748,"15min":1.288},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33100000000000002},"max":{"1min":0.66500000000000004,"5min":0.70699999999999996,"15min":1.022},"last":0.376},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55700000000000005},"min":{"1min":0.44500000000000001,"5min":0.36399999999999999,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71599999999999997,"15min":0.97399999999999998},"last":0.442}]},{"osd":4,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.54600000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.173,"5min":1.173,"15min":1.208},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47699999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.464},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2,"5min":1.2,"15min":1.361},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77200000000000002,"15min":0.79300000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.03,"5min":1.1020000000000001,"15min":1.3},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79700000000000004,"15min":0.81100000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.501},"max":{"1min":1.238,"5min":1.238,"15min":1.51},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79300000000000004,"15min":0.80900000000000005},"min":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.48199999999999998},"max":{"1min":1,"5min":1.1579999999999999,"15min":1.4359999999999999},"last":0.77100000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80100000000000005,"15min":0.81699999999999995},"min":{"1min":0.61399999999999999,"5min":0.53700000000000003,"15min":0.51900000000000002},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.55},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80200000000000005,"15min":0.82299999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1160000000000001,"5min":1.1439999999999999,"15min":1.387},"last":0.69699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":950272,"data_stored":481269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.58599999999999997,"15min":0.48199999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55600000000000005,"5min":14.099,"15min":14.099},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.73199999999999998,"15min":0.55900000000000005},"min":{"1min":0.34399999999999997,"5min":0.313,"15min":0.29199999999999998},"max":{"1min":0.65400000000000003,"5min":24.879999999999999,"15min":24.879999999999999},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46500000000000002,"15min":0.45200000000000001},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.254},"max":{"1min":0.56299999999999994,"5min":0.79600000000000004,"15min":0.90700000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.63300000000000001,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.30199999999999999,"15min":0.28799999999999998},"max":{"1min":0.80700000000000005,"5min":14.143000000000001,"15min":14.143000000000001},"last":0.432}]},{"osd":2,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.46400000000000002,"5min":0.39600000000000002,"15min":0.33400000000000002},"max":{"1min":0.76200000000000001,"5min":0.94999999999999996,"15min":1.407},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.72399999999999998,"15min":0.65100000000000002},"min":{"1min":0.48699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70199999999999996,"5min":12.464,"15min":12.464},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.94999999999999996,"15min":0.81799999999999995},"min":{"1min":0.53500000000000003,"5min":0.47999999999999998,"15min":0.47299999999999998},"max":{"1min":1.2250000000000001,"5min":21.475999999999999,"15min":21.475999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77600000000000002,"15min":0.76300000000000001},"min":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.47299999999999998},"max":{"1min":1.0309999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.751,"15min":0.75800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.46600000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.3220000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.86699999999999999,"15min":0.80600000000000005},"min":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.173,"5min":12.509,"15min":12.509},"last":0.624}]},{"osd":6,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.89000000000000001,"15min":0.81899999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.52000000000000002},"max":{"1min":0.96799999999999997,"5min":12.426,"15min":12.426},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":1.022,"15min":0.85799999999999998},"min":{"1min":0.61899999999999999,"5min":0.53200000000000003,"15min":0.50600000000000001},"max":{"1min":1.2010000000000001,"5min":24.920000000000002,"15min":24.920000000000002},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":1.006,"15min":0.85899999999999999},"min":{"1min":0.60099999999999998,"5min":0.51300000000000001,"15min":0.495},"max":{"1min":1.0680000000000001,"5min":21.521000000000001,"15min":21.521000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77900000000000003,"15min":0.78300000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.73499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":950272,"data_stored":481289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.72299999999999998},"min":{"1min":0.54100000000000004,"5min":0.42399999999999999,"15min":0.36799999999999999},"max":{"1min":0.88300000000000001,"5min":0.96499999999999997,"15min":9.6289999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69299999999999995,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.441,"15min":0.42099999999999999},"max":{"1min":0.85499999999999998,"5min":0.92900000000000005,"15min":3.403},"last":0.495}]},{"osd":1,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70499999999999996,"15min":0.74199999999999999},"min":{"1min":0.52100000000000002,"5min":0.44700000000000001,"15min":0.437},"max":{"1min":0.80400000000000005,"5min":0.97199999999999998,"15min":9.8399999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70899999999999996,"15min":0.746},"min":{"1min":0.57199999999999995,"5min":0.47899999999999998,"15min":0.44900000000000001},"max":{"1min":0.92500000000000004,"5min":1.0229999999999999,"15min":9.7569999999999997},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71199999999999997,"15min":0.745},"min":{"1min":0.58299999999999996,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":1.042,"15min":9.7840000000000007},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.76100000000000001},"min":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85099999999999998,"5min":0.98399999999999999,"15min":9.7200000000000006},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.56200000000000006,"5min":0.51100000000000001,"15min":0.48299999999999998},"max":{"1min":0.86899999999999999,"5min":1.01,"15min":5.133},"last":0.443},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74399999999999999,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.439,"15min":0.439},"max":{"1min":0.90900000000000003,"5min":1.012,"15min":12.589},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59199999999999997,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89300000000000002,"5min":1.0800000000000001,"15min":9.6780000000000008},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.441,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":1.0549999999999999,"15min":3.3610000000000002},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66000000000000003,"15min":0.68000000000000005},"min":{"1min":0.47099999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84999999999999998,"5min":1.163,"15min":9.4760000000000009},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69499999999999995,"15min":0.72199999999999998},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":0.93600000000000005,"5min":1.133,"15min":9.8640000000000008},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69699999999999995,"15min":0.70999999999999996},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.98999999999999999,"5min":1.147,"15min":7.1769999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.45200000000000001},"max":{"1min":0.91700000000000004,"5min":1.0980000000000001,"15min":12.634},"last":0.625}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":950272,"data_stored":481559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73899999999999999,"15min":0.72599999999999998},"min":{"1min":0.50700000000000001,"5min":0.47199999999999998,"15min":0.40899999999999997},"max":{"1min":0.93799999999999994,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.75700000000000001,"15min":0.72599999999999998},"min":{"1min":0.56799999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94899999999999995,"5min":3.548,"15min":3.548},"last":0.57199999999999995}]},{"osd":1,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.86299999999999999,"15min":0.76800000000000002},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0149999999999999,"5min":16.744,"15min":16.744},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76000000000000001,"15min":0.74199999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.46300000000000002},"max":{"1min":0.91700000000000004,"5min":3.6299999999999999,"15min":3.6299999999999999},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.71699999999999997},"min":{"1min":0.56100000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0289999999999999,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":0.624},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76700000000000002,"15min":0.75800000000000001},"min":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.45200000000000001},"max":{"1min":0.98399999999999999,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":0.77500000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.54400000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.996,"5min":1.327,"15min":2.0070000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.73399999999999999},"min":{"1min":0.53500000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96799999999999997,"5min":2.823,"15min":2.823},"last":0.751}]},{"osd":4,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67500000000000004,"15min":0.65000000000000002},"min":{"1min":0.47099999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72499999999999998,"5min":7.3739999999999997,"15min":7.3739999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":0.81799999999999995,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67300000000000004,"15min":0.65900000000000003},"min":{"1min":0.53500000000000003,"5min":0.45300000000000001,"15min":0.39100000000000001},"max":{"1min":0.91200000000000003,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76100000000000001,"15min":0.72399999999999998},"min":{"1min":0.57799999999999996,"5min":0.443,"15min":0.441},"max":{"1min":0.83999999999999997,"5min":7.4139999999999997,"15min":7.4139999999999997},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73999999999999999,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.46100000000000002},"max":{"1min":0.95099999999999996,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.73899999999999999,"15min":0.73199999999999998},"min":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.073,"5min":2.786,"15min":2.786},"last":0.80200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:03:33.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:03:33.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.477+0000 7f2cdd3ff700 1 Processor -- start 2023-08-31T19:03:33.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.477+0000 7f2cdd3ff700 1 -- start start 2023-08-31T19:03:33.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.478+0000 7f2cdd3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd80cb9b0 0x7f2cd81583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.478+0000 7f2cdd3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd80c6120 con 0x7f2cd8154060 2023-08-31T19:03:33.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.478+0000 7f2cdd3ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd80c5e10 con 0x7f2cd81588d0 2023-08-31T19:03:33.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.478+0000 7f2cdd3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd80c1380 con 0x7f2cd80cb9b0 2023-08-31T19:03:33.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.478+0000 7f2cd6ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2cd8154060 0x7f2cd8157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50042/0 (socket says 172.21.15.72:50042) 2023-08-31T19:03:33.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.478+0000 7f2cd6ffd700 1 -- 172.21.15.72:0/1667646643 learned_addr learned my addr 172.21.15.72:0/1667646643 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:33.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd67fc700 1 --2- 172.21.15.72:0/1667646643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd80cb9b0 0x7f2cd81583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503827232 0 0) 0x7f2cd80c6120 con 0x7f2cd8154060 2023-08-31T19:03:33.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cc00033f0 con 0x7f2cd8154060 2023-08-31T19:03:33.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337283031 0 0) 0x7f2cd80c5e10 con 0x7f2cd81588d0 2023-08-31T19:03:33.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cd80c6120 con 0x7f2cd81588d0 2023-08-31T19:03:33.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 940459799 0 0) 0x7f2cc00033f0 con 0x7f2cd8154060 2023-08-31T19:03:33.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd80cb9b0 msgr2=0x7f2cd81583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:33.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 --2- 172.21.15.72:0/1667646643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd80cb9b0 0x7f2cd81583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 >> v1:172.21.15.146:6789/0 conn(0x7f2cd81588d0 legacy=0x7f2cd8154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd80c0ae0 con 0x7f2cd8154060 2023-08-31T19:03:33.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f2cc80015f0 con 0x7f2cd8154060 2023-08-31T19:03:33.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 >> v1:172.21.15.72:6789/0 conn(0x7f2cd8154060 legacy=0x7f2cd8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 --2- 172.21.15.72:0/1667646643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd80cb9b0 0x7f2cc0003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 --2- 172.21.15.72:0/1667646643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cc0003fb0 0x7f2cc0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 --2- 172.21.15.72:0/1667646643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0004b80 0x7f2cc0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd80c1380 con 0x7f2cc0004b80 2023-08-31T19:03:33.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc000b990 con 0x7f2cc0003fb0 2023-08-31T19:03:33.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.479+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc000bb50 con 0x7f2cd80cb9b0 2023-08-31T19:03:33.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.480+0000 7f2cd77fe700 1 --2- 172.21.15.72:0/1667646643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0004b80 0x7f2cc0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.480+0000 7f2cd6ffd700 1 --2- 172.21.15.72:0/1667646643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd80cb9b0 0x7f2cc0003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.480+0000 7f2cd67fc700 1 --2- 172.21.15.72:0/1667646643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cc0003fb0 0x7f2cc0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.480+0000 7f2cd77fe700 1 -- 172.21.15.72:0/1667646643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd80cb9b0 msgr2=0x7f2cc0003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:33.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.480+0000 7f2cd77fe700 1 --2- 172.21.15.72:0/1667646643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd80cb9b0 0x7f2cc0003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.480+0000 7f2cd77fe700 1 -- 172.21.15.72:0/1667646643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cc0003fb0 msgr2=0x7f2cc0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:33.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.480+0000 7f2cd77fe700 1 --2- 172.21.15.72:0/1667646643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cc0003fb0 0x7f2cc0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.480+0000 7f2cd77fe700 1 -- 172.21.15.72:0/1667646643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc00033f0 con 0x7f2cc0004b80 2023-08-31T19:03:33.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.480+0000 7f2cd77fe700 1 --2- 172.21.15.72:0/1667646643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0004b80 0x7f2cc0005000 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f2cd8083600 tx=0x7f2cd0007f30).ready entity=mon.0 client_cookie=94d940f2330b41d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.480+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0006a20 con 0x7f2cc0004b80 2023-08-31T19:03:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.480+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd0006b80 con 0x7f2cc0004b80 2023-08-31T19:03:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.480+0000 7f2cd5ffb700 1 -- 172.21.15.72:0/1667646643 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd000c6d0 con 0x7f2cc0004b80 2023-08-31T19:03:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.481+0000 7f2cdd3ff700 1 -- 172.21.15.72:0/1667646643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0004b80 msgr2=0x7f2cc0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.481+0000 7f2cdd3ff700 1 --2- 172.21.15.72:0/1667646643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0004b80 0x7f2cc0005000 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f2cd8083600 tx=0x7f2cd0007f30).stop 2023-08-31T19:03:33.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.481+0000 7f2cd77fe700 1 -- 172.21.15.72:0/1667646643 reap_dead start 2023-08-31T19:03:33.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.481+0000 7f2cdd3ff700 1 -- 172.21.15.72:0/1667646643 shutdown_connections 2023-08-31T19:03:33.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.481+0000 7f2cdd3ff700 1 -- 172.21.15.72:0/1667646643 >> 172.21.15.72:0/1667646643 conn(0x7f2cd805e870 msgr2=0x7f2cd80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:33.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.481+0000 7f2cdd3ff700 1 -- 172.21.15.72:0/1667646643 shutdown_connections 2023-08-31T19:03:33.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.481+0000 7f2cdd3ff700 1 -- 172.21.15.72:0/1667646643 wait complete. 2023-08-31T19:03:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.483+0000 7f2cdd3ff700 1 Processor -- start 2023-08-31T19:03:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.483+0000 7f2cdd3ff700 1 -- start start 2023-08-31T19:03:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cdd3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0004b80 0x7f2cd80c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cdd3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd80c65b0 0x7f2cd81536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cdd3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cd8153bb0 0x7f2cd8151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cdd3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd80c6a30 con 0x7f2cc0004b80 2023-08-31T19:03:33.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cdd3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd80c7c90 con 0x7f2cd8153bb0 2023-08-31T19:03:33.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cdd3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd80c6c40 con 0x7f2cd80c65b0 2023-08-31T19:03:33.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cd6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0004b80 0x7f2cd80c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cd6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0004b80 0x7f2cd80c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59490/0 (socket says 172.21.15.72:59490) 2023-08-31T19:03:33.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cd6ffd700 1 -- 172.21.15.72:0/1031371784 learned_addr learned my addr 172.21.15.72:0/1031371784 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:33.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cd6ffd700 1 -- 172.21.15.72:0/1031371784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd80c65b0 msgr2=0x7f2cd81536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cd77fe700 1 --2- 172.21.15.72:0/1031371784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cd8153bb0 0x7f2cd8151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cd6ffd700 1 --2- 172.21.15.72:0/1031371784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd80c65b0 0x7f2cd81536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cd6ffd700 1 -- 172.21.15.72:0/1031371784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cd8153bb0 msgr2=0x7f2cd8151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cd6ffd700 1 --2- 172.21.15.72:0/1031371784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cd8153bb0 0x7f2cd8151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cd6ffd700 1 -- 172.21.15.72:0/1031371784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd80c6f20 con 0x7f2cc0004b80 2023-08-31T19:03:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cd77fe700 1 --2- 172.21.15.72:0/1031371784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cd8153bb0 0x7f2cd8151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:33.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.484+0000 7f2cd6ffd700 1 --2- 172.21.15.72:0/1031371784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0004b80 0x7f2cd80c81c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f2cc800f880 tx=0x7f2cc8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:33.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.485+0000 7f2cbeffd700 1 -- 172.21.15.72:0/1031371784 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80070d0 con 0x7f2cc0004b80 2023-08-31T19:03:33.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.485+0000 7f2cbeffd700 1 -- 172.21.15.72:0/1031371784 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc8007230 con 0x7f2cc0004b80 2023-08-31T19:03:33.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.485+0000 7f2cbeffd700 1 -- 172.21.15.72:0/1031371784 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8005880 con 0x7f2cc0004b80 2023-08-31T19:03:33.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.485+0000 7f2cdd3ff700 1 -- 172.21.15.72:0/1031371784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd80c7200 con 0x7f2cc0004b80 2023-08-31T19:03:33.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.485+0000 7f2cdd3ff700 1 -- 172.21.15.72:0/1031371784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd80ab180 con 0x7f2cc0004b80 2023-08-31T19:03:33.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.486+0000 7f2cdd3ff700 1 -- 172.21.15.72:0/1031371784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd80aafe0 con 0x7f2cc0004b80 2023-08-31T19:03:33.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.487+0000 7f2cbeffd700 1 -- 172.21.15.72:0/1031371784 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2cc8005bf0 con 0x7f2cc0004b80 2023-08-31T19:03:33.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.487+0000 7f2cbeffd700 1 --2- 172.21.15.72:0/1031371784 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2cc405ef30 0x7f2cc40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.487+0000 7f2cbeffd700 1 -- 172.21.15.72:0/1031371784 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f2cc8079bc0 con 0x7f2cc0004b80 2023-08-31T19:03:33.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.488+0000 7f2cd67fc700 1 --2- 172.21.15.72:0/1031371784 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2cc405ef30 0x7f2cc40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.488+0000 7f2cd67fc700 1 --2- 172.21.15.72:0/1031371784 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2cc405ef30 0x7f2cc40613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2ccc006d30 tx=0x7f2ccc009060).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:33.500 INFO:tasks.ceph.mds.a.smithi072.stderr:2023-08-31T19:03:33.491+0000 7f874e5f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:03:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.492+0000 7f2cbeffd700 1 -- 172.21.15.72:0/1031371784 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2cd80aafe0 con 0x7f2cc0004b80 2023-08-31T19:03:33.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.657+0000 7f2cdd3ff700 1 -- 172.21.15.72:0/1031371784 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2cd80aafe0 con 0x7f2cc405ef30 2023-08-31T19:03:33.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.667+0000 7f2cbeffd700 1 -- 172.21.15.72:0/1031371784 <== mgr.6060 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361008 (secure 0 0 0) 0x7f2cd80aafe0 con 0x7f2cc405ef30 2023-08-31T19:03:33.673 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:33.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.672+0000 7f2cdd3ff700 1 -- 172.21.15.72:0/1031371784 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2cc405ef30 msgr2=0x7f2cc40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.672+0000 7f2cdd3ff700 1 --2- 172.21.15.72:0/1031371784 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2cc405ef30 0x7f2cc40613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2ccc006d30 tx=0x7f2ccc009060).stop 2023-08-31T19:03:33.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.672+0000 7f2cdd3ff700 1 -- 172.21.15.72:0/1031371784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0004b80 msgr2=0x7f2cd80c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.672+0000 7f2cdd3ff700 1 --2- 172.21.15.72:0/1031371784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0004b80 0x7f2cd80c81c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f2cc800f880 tx=0x7f2cc8009040).stop 2023-08-31T19:03:33.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.672+0000 7f2cdd3ff700 1 -- 172.21.15.72:0/1031371784 shutdown_connections 2023-08-31T19:03:33.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.672+0000 7f2cdd3ff700 1 --2- 172.21.15.72:0/1031371784 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2cc405ef30 0x7f2cc40613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.672+0000 7f2cdd3ff700 1 --2- 172.21.15.72:0/1031371784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2cd8153bb0 0x7f2cd8151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.672+0000 7f2cdd3ff700 1 --2- 172.21.15.72:0/1031371784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0004b80 0x7f2cd80c81c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.672+0000 7f2cdd3ff700 1 --2- 172.21.15.72:0/1031371784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2cd80c65b0 0x7f2cd81536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:33.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.672+0000 7f2cdd3ff700 1 -- 172.21.15.72:0/1031371784 >> 172.21.15.72:0/1031371784 conn(0x7f2cd805e870 msgr2=0x7f2cd80642f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:33.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.672+0000 7f2cdd3ff700 1 -- 172.21.15.72:0/1031371784 shutdown_connections 2023-08-31T19:03:33.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.672+0000 7f2cdd3ff700 1 -- 172.21.15.72:0/1031371784 wait complete. 2023-08-31T19:03:33.679 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:03:33.690 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-08-31T19:03:32.950460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2416960,"kb_used_data":7424,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752557760,"statfs":{"total":773094113280,"available":770619146240,"internally_reserved":0,"allocated":7602176,"data_stored":3849772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28925,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-82,"num_write_kb":-67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-34,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.967526"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.002115+0000","last_change":"2023-08-31T19:03:29.002115+0000","last_active":"2023-08-31T19:03:29.002115+0000","last_peered":"2023-08-31T19:03:29.002115+0000","last_clean":"2023-08-31T19:03:29.002115+0000","last_became_active":"2023-08-31T19:03:29.001461+0000","last_became_peered":"2023-08-31T19:03:29.001461+0000","last_unstale":"2023-08-31T19:03:29.002115+0000","last_undegraded":"2023-08-31T19:03:29.002115+0000","last_fullsized":"2023-08-31T19:03:29.002115+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"78'3","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.001482+0000","last_change":"2023-08-31T19:03:28.522928+0000","last_active":"2023-08-31T19:03:29.001482+0000","last_peered":"2023-08-31T19:03:29.001482+0000","last_clean":"2023-08-31T19:03:29.001482+0000","last_became_active":"2023-08-31T19:03:28.522635+0000","last_became_peered":"2023-08-31T19:03:28.522635+0000","last_unstale":"2023-08-31T19:03:29.001482+0000","last_undegraded":"2023-08-31T19:03:29.001482+0000","last_fullsized":"2023-08-31T19:03:29.001482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.001958+0000","last_change":"2023-08-31T19:03:29.001958+0000","last_active":"2023-08-31T19:03:29.001958+0000","last_peered":"2023-08-31T19:03:29.001958+0000","last_clean":"2023-08-31T19:03:29.001958+0000","last_became_active":"2023-08-31T19:03:29.001526+0000","last_became_peered":"2023-08-31T19:03:29.001526+0000","last_unstale":"2023-08-31T19:03:29.001958+0000","last_undegraded":"2023-08-31T19:03:29.001958+0000","last_fullsized":"2023-08-31T19:03:29.001958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.541773+0000","last_change":"2023-08-31T19:03:28.534348+0000","last_active":"2023-08-31T19:03:28.541773+0000","last_peered":"2023-08-31T19:03:28.541773+0000","last_clean":"2023-08-31T19:03:28.541773+0000","last_became_active":"2023-08-31T19:03:28.533643+0000","last_became_peered":"2023-08-31T19:03:28.533643+0000","last_unstale":"2023-08-31T19:03:28.541773+0000","last_undegraded":"2023-08-31T19:03:28.541773+0000","last_fullsized":"2023-08-31T19:03:28.541773+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.992658+0000","last_change":"2023-08-31T19:03:28.992658+0000","last_active":"2023-08-31T19:03:28.992658+0000","last_peered":"2023-08-31T19:03:28.992658+0000","last_clean":"2023-08-31T19:03:28.992658+0000","last_became_active":"2023-08-31T19:03:28.992398+0000","last_became_peered":"2023-08-31T19:03:28.992398+0000","last_unstale":"2023-08-31T19:03:28.992658+0000","last_undegraded":"2023-08-31T19:03:28.992658+0000","last_fullsized":"2023-08-31T19:03:28.992658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.546167+0000","last_change":"2023-08-31T19:03:28.544261+0000","last_active":"2023-08-31T19:03:28.546167+0000","last_peered":"2023-08-31T19:03:28.546167+0000","last_clean":"2023-08-31T19:03:28.546167+0000","last_became_active":"2023-08-31T19:03:28.543964+0000","last_became_peered":"2023-08-31T19:03:28.543964+0000","last_unstale":"2023-08-31T19:03:28.546167+0000","last_undegraded":"2023-08-31T19:03:28.546167+0000","last_fullsized":"2023-08-31T19:03:28.546167+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.006794+0000","last_change":"2023-08-31T19:03:29.006794+0000","last_active":"2023-08-31T19:03:29.006794+0000","last_peered":"2023-08-31T19:03:29.006794+0000","last_clean":"2023-08-31T19:03:29.006794+0000","last_became_active":"2023-08-31T19:03:29.006508+0000","last_became_peered":"2023-08-31T19:03:29.006508+0000","last_unstale":"2023-08-31T19:03:29.006794+0000","last_undegraded":"2023-08-31T19:03:29.006794+0000","last_fullsized":"2023-08-31T19:03:29.006794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"78'2","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.005493+0000","last_change":"2023-08-31T19:03:28.541351+0000","last_active":"2023-08-31T19:03:29.005493+0000","last_peered":"2023-08-31T19:03:29.005493+0000","last_clean":"2023-08-31T19:03:29.005493+0000","last_became_active":"2023-08-31T19:03:28.541034+0000","last_became_peered":"2023-08-31T19:03:28.541034+0000","last_unstale":"2023-08-31T19:03:29.005493+0000","last_undegraded":"2023-08-31T19:03:29.005493+0000","last_fullsized":"2023-08-31T19:03:29.005493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.993395+0000","last_change":"2023-08-31T19:03:28.993395+0000","last_active":"2023-08-31T19:03:28.993395+0000","last_peered":"2023-08-31T19:03:28.993395+0000","last_clean":"2023-08-31T19:03:28.993395+0000","last_became_active":"2023-08-31T19:03:28.993116+0000","last_became_peered":"2023-08-31T19:03:28.993116+0000","last_unstale":"2023-08-31T19:03:28.993395+0000","last_undegraded":"2023-08-31T19:03:28.993395+0000","last_fullsized":"2023-08-31T19:03:28.993395+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.987180+0000","last_change":"2023-08-31T19:03:28.540145+0000","last_active":"2023-08-31T19:03:28.987180+0000","last_peered":"2023-08-31T19:03:28.987180+0000","last_clean":"2023-08-31T19:03:28.987180+0000","last_became_active":"2023-08-31T19:03:28.539867+0000","last_became_peered":"2023-08-31T19:03:28.539867+0000","last_unstale":"2023-08-31T19:03:28.987180+0000","last_undegraded":"2023-08-31T19:03:28.987180+0000","last_fullsized":"2023-08-31T19:03:28.987180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.010254+0000","last_change":"2023-08-31T19:03:29.010254+0000","last_active":"2023-08-31T19:03:29.010254+0000","last_peered":"2023-08-31T19:03:29.010254+0000","last_clean":"2023-08-31T19:03:29.010254+0000","last_became_active":"2023-08-31T19:03:29.009938+0000","last_became_peered":"2023-08-31T19:03:29.009938+0000","last_unstale":"2023-08-31T19:03:29.010254+0000","last_undegraded":"2023-08-31T19:03:29.010254+0000","last_fullsized":"2023-08-31T19:03:29.010254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.976043+0000","last_change":"2023-08-31T19:03:28.523660+0000","last_active":"2023-08-31T19:03:28.976043+0000","last_peered":"2023-08-31T19:03:28.976043+0000","last_clean":"2023-08-31T19:03:28.976043+0000","last_became_active":"2023-08-31T19:03:28.523049+0000","last_became_peered":"2023-08-31T19:03:28.523049+0000","last_unstale":"2023-08-31T19:03:28.976043+0000","last_undegraded":"2023-08-31T19:03:28.976043+0000","last_fullsized":"2023-08-31T19:03:28.976043+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.988202+0000","last_change":"2023-08-31T19:03:28.988202+0000","last_active":"2023-08-31T19:03:28.988202+0000","last_peered":"2023-08-31T19:03:28.988202+0000","last_clean":"2023-08-31T19:03:28.988202+0000","last_became_active":"2023-08-31T19:03:28.987861+0000","last_became_peered":"2023-08-31T19:03:28.987861+0000","last_unstale":"2023-08-31T19:03:28.988202+0000","last_undegraded":"2023-08-31T19:03:28.988202+0000","last_fullsized":"2023-08-31T19:03:28.988202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.535731+0000","last_change":"2023-08-31T19:03:28.533725+0000","last_active":"2023-08-31T19:03:28.535731+0000","last_peered":"2023-08-31T19:03:28.535731+0000","last_clean":"2023-08-31T19:03:28.535731+0000","last_became_active":"2023-08-31T19:03:28.533377+0000","last_became_peered":"2023-08-31T19:03:28.533377+0000","last_unstale":"2023-08-31T19:03:28.535731+0000","last_undegraded":"2023-08-31T19:03:28.535731+0000","last_fullsized":"2023-08-31T19:03:28.535731+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.006741+0000","last_change":"2023-08-31T19:03:29.006741+0000","last_active":"2023-08-31T19:03:29.006741+0000","last_peered":"2023-08-31T19:03:29.006741+0000","last_clean":"2023-08-31T19:03:29.006741+0000","last_became_active":"2023-08-31T19:03:29.006415+0000","last_became_peered":"2023-08-31T19:03:29.006415+0000","last_unstale":"2023-08-31T19:03:29.006741+0000","last_undegraded":"2023-08-31T19:03:29.006741+0000","last_fullsized":"2023-08-31T19:03:29.006741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.533949+0000","last_change":"2023-08-31T19:03:28.526552+0000","last_active":"2023-08-31T19:03:28.533949+0000","last_peered":"2023-08-31T19:03:28.533949+0000","last_clean":"2023-08-31T19:03:28.533949+0000","last_became_active":"2023-08-31T19:03:28.526277+0000","last_became_peered":"2023-08-31T19:03:28.526277+0000","last_unstale":"2023-08-31T19:03:28.533949+0000","last_undegraded":"2023-08-31T19:03:28.533949+0000","last_fullsized":"2023-08-31T19:03:28.533949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.005354+0000","last_change":"2023-08-31T19:03:29.005354+0000","last_active":"2023-08-31T19:03:29.005354+0000","last_peered":"2023-08-31T19:03:29.005354+0000","last_clean":"2023-08-31T19:03:29.005354+0000","last_became_active":"2023-08-31T19:03:29.005032+0000","last_became_peered":"2023-08-31T19:03:29.005032+0000","last_unstale":"2023-08-31T19:03:29.005354+0000","last_undegraded":"2023-08-31T19:03:29.005354+0000","last_fullsized":"2023-08-31T19:03:29.005354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.544882+0000","last_change":"2023-08-31T19:03:28.543593+0000","last_active":"2023-08-31T19:03:28.544882+0000","last_peered":"2023-08-31T19:03:28.544882+0000","last_clean":"2023-08-31T19:03:28.544882+0000","last_became_active":"2023-08-31T19:03:28.543293+0000","last_became_peered":"2023-08-31T19:03:28.543293+0000","last_unstale":"2023-08-31T19:03:28.544882+0000","last_undegraded":"2023-08-31T19:03:28.544882+0000","last_fullsized":"2023-08-31T19:03:28.544882+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.998470+0000","last_change":"2023-08-31T19:03:28.998470+0000","last_active":"2023-08-31T19:03:28.998470+0000","last_peered":"2023-08-31T19:03:28.998470+0000","last_clean":"2023-08-31T19:03:28.998470+0000","last_became_active":"2023-08-31T19:03:28.998106+0000","last_became_peered":"2023-08-31T19:03:28.998106+0000","last_unstale":"2023-08-31T19:03:28.998470+0000","last_undegraded":"2023-08-31T19:03:28.998470+0000","last_fullsized":"2023-08-31T19:03:28.998470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.545648+0000","last_change":"2023-08-31T19:03:28.534470+0000","last_active":"2023-08-31T19:03:28.545648+0000","last_peered":"2023-08-31T19:03:28.545648+0000","last_clean":"2023-08-31T19:03:28.545648+0000","last_became_active":"2023-08-31T19:03:28.534256+0000","last_became_peered":"2023-08-31T19:03:28.534256+0000","last_unstale":"2023-08-31T19:03:28.545648+0000","last_undegraded":"2023-08-31T19:03:28.545648+0000","last_fullsized":"2023-08-31T19:03:28.545648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.993868+0000","last_change":"2023-08-31T19:03:28.993868+0000","last_active":"2023-08-31T19:03:28.993868+0000","last_peered":"2023-08-31T19:03:28.993868+0000","last_clean":"2023-08-31T19:03:28.993868+0000","last_became_active":"2023-08-31T19:03:28.993558+0000","last_became_peered":"2023-08-31T19:03:28.993558+0000","last_unstale":"2023-08-31T19:03:28.993868+0000","last_undegraded":"2023-08-31T19:03:28.993868+0000","last_fullsized":"2023-08-31T19:03:28.993868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.538691+0000","last_change":"2023-08-31T19:03:28.530051+0000","last_active":"2023-08-31T19:03:28.538691+0000","last_peered":"2023-08-31T19:03:28.538691+0000","last_clean":"2023-08-31T19:03:28.538691+0000","last_became_active":"2023-08-31T19:03:28.529764+0000","last_became_peered":"2023-08-31T19:03:28.529764+0000","last_unstale":"2023-08-31T19:03:28.538691+0000","last_undegraded":"2023-08-31T19:03:28.538691+0000","last_fullsized":"2023-08-31T19:03:28.538691+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.006547+0000","last_change":"2023-08-31T19:03:29.006547+0000","last_active":"2023-08-31T19:03:29.006547+0000","last_peered":"2023-08-31T19:03:29.006547+0000","last_clean":"2023-08-31T19:03:29.006547+0000","last_became_active":"2023-08-31T19:03:29.006266+0000","last_became_peered":"2023-08-31T19:03:29.006266+0000","last_unstale":"2023-08-31T19:03:29.006547+0000","last_undegraded":"2023-08-31T19:03:29.006547+0000","last_fullsized":"2023-08-31T19:03:29.006547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"78'4","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.010775+0000","last_change":"2023-08-31T19:03:28.537857+0000","last_active":"2023-08-31T19:03:29.010775+0000","last_peered":"2023-08-31T19:03:29.010775+0000","last_clean":"2023-08-31T19:03:29.010775+0000","last_became_active":"2023-08-31T19:03:28.537602+0000","last_became_peered":"2023-08-31T19:03:28.537602+0000","last_unstale":"2023-08-31T19:03:29.010775+0000","last_undegraded":"2023-08-31T19:03:29.010775+0000","last_fullsized":"2023-08-31T19:03:29.010775+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.012026+0000","last_change":"2023-08-31T19:03:29.012026+0000","last_active":"2023-08-31T19:03:29.012026+0000","last_peered":"2023-08-31T19:03:29.012026+0000","last_clean":"2023-08-31T19:03:29.012026+0000","last_became_active":"2023-08-31T19:03:29.011762+0000","last_became_peered":"2023-08-31T19:03:29.011762+0000","last_unstale":"2023-08-31T19:03:29.012026+0000","last_undegraded":"2023-08-31T19:03:29.012026+0000","last_fullsized":"2023-08-31T19:03:29.012026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.979883+0000","last_change":"2023-08-31T19:03:28.536860+0000","last_active":"2023-08-31T19:03:28.979883+0000","last_peered":"2023-08-31T19:03:28.979883+0000","last_clean":"2023-08-31T19:03:28.979883+0000","last_became_active":"2023-08-31T19:03:28.536560+0000","last_became_peered":"2023-08-31T19:03:28.536560+0000","last_unstale":"2023-08-31T19:03:28.979883+0000","last_undegraded":"2023-08-31T19:03:28.979883+0000","last_fullsized":"2023-08-31T19:03:28.979883+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.999781+0000","last_change":"2023-08-31T19:03:28.999781+0000","last_active":"2023-08-31T19:03:28.999781+0000","last_peered":"2023-08-31T19:03:28.999781+0000","last_clean":"2023-08-31T19:03:28.999781+0000","last_became_active":"2023-08-31T19:03:28.999502+0000","last_became_peered":"2023-08-31T19:03:28.999502+0000","last_unstale":"2023-08-31T19:03:28.999781+0000","last_undegraded":"2023-08-31T19:03:28.999781+0000","last_fullsized":"2023-08-31T19:03:28.999781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.527472+0000","last_change":"2023-08-31T19:03:28.524214+0000","last_active":"2023-08-31T19:03:28.527472+0000","last_peered":"2023-08-31T19:03:28.527472+0000","last_clean":"2023-08-31T19:03:28.527472+0000","last_became_active":"2023-08-31T19:03:28.523912+0000","last_became_peered":"2023-08-31T19:03:28.523912+0000","last_unstale":"2023-08-31T19:03:28.527472+0000","last_undegraded":"2023-08-31T19:03:28.527472+0000","last_fullsized":"2023-08-31T19:03:28.527472+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.001471+0000","last_change":"2023-08-31T19:03:29.001471+0000","last_active":"2023-08-31T19:03:29.001471+0000","last_peered":"2023-08-31T19:03:29.001471+0000","last_clean":"2023-08-31T19:03:29.001471+0000","last_became_active":"2023-08-31T19:03:29.000766+0000","last_became_peered":"2023-08-31T19:03:29.000766+0000","last_unstale":"2023-08-31T19:03:29.001471+0000","last_undegraded":"2023-08-31T19:03:29.001471+0000","last_fullsized":"2023-08-31T19:03:29.001471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.528787+0000","last_change":"2023-08-31T19:03:28.526563+0000","last_active":"2023-08-31T19:03:28.528787+0000","last_peered":"2023-08-31T19:03:28.528787+0000","last_clean":"2023-08-31T19:03:28.528787+0000","last_became_active":"2023-08-31T19:03:28.526265+0000","last_became_peered":"2023-08-31T19:03:28.526265+0000","last_unstale":"2023-08-31T19:03:28.528787+0000","last_undegraded":"2023-08-31T19:03:28.528787+0000","last_fullsized":"2023-08-31T19:03:28.528787+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.005506+0000","last_change":"2023-08-31T19:03:29.005506+0000","last_active":"2023-08-31T19:03:29.005506+0000","last_peered":"2023-08-31T19:03:29.005506+0000","last_clean":"2023-08-31T19:03:29.005506+0000","last_became_active":"2023-08-31T19:03:29.005169+0000","last_became_peered":"2023-08-31T19:03:29.005169+0000","last_unstale":"2023-08-31T19:03:29.005506+0000","last_undegraded":"2023-08-31T19:03:29.005506+0000","last_fullsized":"2023-08-31T19:03:29.005506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"78'4","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.990985+0000","last_change":"2023-08-31T19:03:28.537253+0000","last_active":"2023-08-31T19:03:28.990985+0000","last_peered":"2023-08-31T19:03:28.990985+0000","last_clean":"2023-08-31T19:03:28.990985+0000","last_became_active":"2023-08-31T19:03:28.536972+0000","last_became_peered":"2023-08-31T19:03:28.536972+0000","last_unstale":"2023-08-31T19:03:28.990985+0000","last_undegraded":"2023-08-31T19:03:28.990985+0000","last_fullsized":"2023-08-31T19:03:28.990985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.995335+0000","last_change":"2023-08-31T19:03:28.995335+0000","last_active":"2023-08-31T19:03:28.995335+0000","last_peered":"2023-08-31T19:03:28.995335+0000","last_clean":"2023-08-31T19:03:28.995335+0000","last_became_active":"2023-08-31T19:03:28.995081+0000","last_became_peered":"2023-08-31T19:03:28.995081+0000","last_unstale":"2023-08-31T19:03:28.995335+0000","last_undegraded":"2023-08-31T19:03:28.995335+0000","last_fullsized":"2023-08-31T19:03:28.995335+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.537615+0000","last_change":"2023-08-31T19:03:28.532839+0000","last_active":"2023-08-31T19:03:28.537615+0000","last_peered":"2023-08-31T19:03:28.537615+0000","last_clean":"2023-08-31T19:03:28.537615+0000","last_became_active":"2023-08-31T19:03:28.532588+0000","last_became_peered":"2023-08-31T19:03:28.532588+0000","last_unstale":"2023-08-31T19:03:28.537615+0000","last_undegraded":"2023-08-31T19:03:28.537615+0000","last_fullsized":"2023-08-31T19:03:28.537615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.000819+0000","last_change":"2023-08-31T19:03:29.000819+0000","last_active":"2023-08-31T19:03:29.000819+0000","last_peered":"2023-08-31T19:03:29.000819+0000","last_clean":"2023-08-31T19:03:29.000819+0000","last_became_active":"2023-08-31T19:03:29.000457+0000","last_became_peered":"2023-08-31T19:03:29.000457+0000","last_unstale":"2023-08-31T19:03:29.000819+0000","last_undegraded":"2023-08-31T19:03:29.000819+0000","last_fullsized":"2023-08-31T19:03:29.000819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.544594+0000","last_change":"2023-08-31T19:03:28.540610+0000","last_active":"2023-08-31T19:03:28.544594+0000","last_peered":"2023-08-31T19:03:28.544594+0000","last_clean":"2023-08-31T19:03:28.544594+0000","last_became_active":"2023-08-31T19:03:28.540310+0000","last_became_peered":"2023-08-31T19:03:28.540310+0000","last_unstale":"2023-08-31T19:03:28.544594+0000","last_undegraded":"2023-08-31T19:03:28.544594+0000","last_fullsized":"2023-08-31T19:03:28.544594+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.998707+0000","last_change":"2023-08-31T19:03:28.998707+0000","last_active":"2023-08-31T19:03:28.998707+0000","last_peered":"2023-08-31T19:03:28.998707+0000","last_clean":"2023-08-31T19:03:28.998707+0000","last_became_active":"2023-08-31T19:03:28.998350+0000","last_became_peered":"2023-08-31T19:03:28.998350+0000","last_unstale":"2023-08-31T19:03:28.998707+0000","last_undegraded":"2023-08-31T19:03:28.998707+0000","last_fullsized":"2023-08-31T19:03:28.998707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.988295+0000","last_change":"2023-08-31T19:03:28.522320+0000","last_active":"2023-08-31T19:03:28.988295+0000","last_peered":"2023-08-31T19:03:28.988295+0000","last_clean":"2023-08-31T19:03:28.988295+0000","last_became_active":"2023-08-31T19:03:28.522025+0000","last_became_peered":"2023-08-31T19:03:28.522025+0000","last_unstale":"2023-08-31T19:03:28.988295+0000","last_undegraded":"2023-08-31T19:03:28.988295+0000","last_fullsized":"2023-08-31T19:03:28.988295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.000398+0000","last_change":"2023-08-31T19:03:29.000398+0000","last_active":"2023-08-31T19:03:29.000398+0000","last_peered":"2023-08-31T19:03:29.000398+0000","last_clean":"2023-08-31T19:03:29.000398+0000","last_became_active":"2023-08-31T19:03:28.999887+0000","last_became_peered":"2023-08-31T19:03:28.999887+0000","last_unstale":"2023-08-31T19:03:29.000398+0000","last_undegraded":"2023-08-31T19:03:29.000398+0000","last_fullsized":"2023-08-31T19:03:29.000398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.543284+0000","last_change":"2023-08-31T19:03:28.539042+0000","last_active":"2023-08-31T19:03:28.543284+0000","last_peered":"2023-08-31T19:03:28.543284+0000","last_clean":"2023-08-31T19:03:28.543284+0000","last_became_active":"2023-08-31T19:03:28.538753+0000","last_became_peered":"2023-08-31T19:03:28.538753+0000","last_unstale":"2023-08-31T19:03:28.543284+0000","last_undegraded":"2023-08-31T19:03:28.543284+0000","last_fullsized":"2023-08-31T19:03:28.543284+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.000956+0000","last_change":"2023-08-31T19:03:29.000956+0000","last_active":"2023-08-31T19:03:29.000956+0000","last_peered":"2023-08-31T19:03:29.000956+0000","last_clean":"2023-08-31T19:03:29.000956+0000","last_became_active":"2023-08-31T19:03:29.000585+0000","last_became_peered":"2023-08-31T19:03:29.000585+0000","last_unstale":"2023-08-31T19:03:29.000956+0000","last_undegraded":"2023-08-31T19:03:29.000956+0000","last_fullsized":"2023-08-31T19:03:29.000956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.981954+0000","last_change":"2023-08-31T19:03:28.535582+0000","last_active":"2023-08-31T19:03:28.981954+0000","last_peered":"2023-08-31T19:03:28.981954+0000","last_clean":"2023-08-31T19:03:28.981954+0000","last_became_active":"2023-08-31T19:03:28.535303+0000","last_became_peered":"2023-08-31T19:03:28.535303+0000","last_unstale":"2023-08-31T19:03:28.981954+0000","last_undegraded":"2023-08-31T19:03:28.981954+0000","last_fullsized":"2023-08-31T19:03:28.981954+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.002218+0000","last_change":"2023-08-31T19:03:29.002218+0000","last_active":"2023-08-31T19:03:29.002218+0000","last_peered":"2023-08-31T19:03:29.002218+0000","last_clean":"2023-08-31T19:03:29.002218+0000","last_became_active":"2023-08-31T19:03:29.001899+0000","last_became_peered":"2023-08-31T19:03:29.001899+0000","last_unstale":"2023-08-31T19:03:29.002218+0000","last_undegraded":"2023-08-31T19:03:29.002218+0000","last_fullsized":"2023-08-31T19:03:29.002218+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.528150+0000","last_change":"2023-08-31T19:03:28.524971+0000","last_active":"2023-08-31T19:03:28.528150+0000","last_peered":"2023-08-31T19:03:28.528150+0000","last_clean":"2023-08-31T19:03:28.528150+0000","last_became_active":"2023-08-31T19:03:28.524637+0000","last_became_peered":"2023-08-31T19:03:28.524637+0000","last_unstale":"2023-08-31T19:03:28.528150+0000","last_undegraded":"2023-08-31T19:03:28.528150+0000","last_fullsized":"2023-08-31T19:03:28.528150+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.999557+0000","last_change":"2023-08-31T19:03:28.999557+0000","last_active":"2023-08-31T19:03:28.999557+0000","last_peered":"2023-08-31T19:03:28.999557+0000","last_clean":"2023-08-31T19:03:28.999557+0000","last_became_active":"2023-08-31T19:03:28.999214+0000","last_became_peered":"2023-08-31T19:03:28.999214+0000","last_unstale":"2023-08-31T19:03:28.999557+0000","last_undegraded":"2023-08-31T19:03:28.999557+0000","last_fullsized":"2023-08-31T19:03:28.999557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.544796+0000","last_change":"2023-08-31T19:03:28.538991+0000","last_active":"2023-08-31T19:03:28.544796+0000","last_peered":"2023-08-31T19:03:28.544796+0000","last_clean":"2023-08-31T19:03:28.544796+0000","last_became_active":"2023-08-31T19:03:28.538354+0000","last_became_peered":"2023-08-31T19:03:28.538354+0000","last_unstale":"2023-08-31T19:03:28.544796+0000","last_undegraded":"2023-08-31T19:03:28.544796+0000","last_fullsized":"2023-08-31T19:03:28.544796+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.997498+0000","last_change":"2023-08-31T19:03:28.997498+0000","last_active":"2023-08-31T19:03:28.997498+0000","last_peered":"2023-08-31T19:03:28.997498+0000","last_clean":"2023-08-31T19:03:28.997498+0000","last_became_active":"2023-08-31T19:03:28.997207+0000","last_became_peered":"2023-08-31T19:03:28.997207+0000","last_unstale":"2023-08-31T19:03:28.997498+0000","last_undegraded":"2023-08-31T19:03:28.997498+0000","last_fullsized":"2023-08-31T19:03:28.997498+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.541697+0000","last_change":"2023-08-31T19:03:28.537420+0000","last_active":"2023-08-31T19:03:28.541697+0000","last_peered":"2023-08-31T19:03:28.541697+0000","last_clean":"2023-08-31T19:03:28.541697+0000","last_became_active":"2023-08-31T19:03:28.537145+0000","last_became_peered":"2023-08-31T19:03:28.537145+0000","last_unstale":"2023-08-31T19:03:28.541697+0000","last_undegraded":"2023-08-31T19:03:28.541697+0000","last_fullsized":"2023-08-31T19:03:28.541697+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.993212+0000","last_change":"2023-08-31T19:03:28.993212+0000","last_active":"2023-08-31T19:03:28.993212+0000","last_peered":"2023-08-31T19:03:28.993212+0000","last_clean":"2023-08-31T19:03:28.993212+0000","last_became_active":"2023-08-31T19:03:28.992902+0000","last_became_peered":"2023-08-31T19:03:28.992902+0000","last_unstale":"2023-08-31T19:03:28.993212+0000","last_undegraded":"2023-08-31T19:03:28.993212+0000","last_fullsized":"2023-08-31T19:03:28.993212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.544986+0000","last_change":"2023-08-31T19:03:28.541510+0000","last_active":"2023-08-31T19:03:28.544986+0000","last_peered":"2023-08-31T19:03:28.544986+0000","last_clean":"2023-08-31T19:03:28.544986+0000","last_became_active":"2023-08-31T19:03:28.541239+0000","last_became_peered":"2023-08-31T19:03:28.541239+0000","last_unstale":"2023-08-31T19:03:28.544986+0000","last_undegraded":"2023-08-31T19:03:28.544986+0000","last_fullsized":"2023-08-31T19:03:28.544986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.003597+0000","last_change":"2023-08-31T19:03:29.003597+0000","last_active":"2023-08-31T19:03:29.003597+0000","last_peered":"2023-08-31T19:03:29.003597+0000","last_clean":"2023-08-31T19:03:29.003597+0000","last_became_active":"2023-08-31T19:03:29.003336+0000","last_became_peered":"2023-08-31T19:03:29.003336+0000","last_unstale":"2023-08-31T19:03:29.003597+0000","last_undegraded":"2023-08-31T19:03:29.003597+0000","last_fullsized":"2023-08-31T19:03:29.003597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.533231+0000","last_change":"2023-08-31T19:03:28.530177+0000","last_active":"2023-08-31T19:03:28.533231+0000","last_peered":"2023-08-31T19:03:28.533231+0000","last_clean":"2023-08-31T19:03:28.533231+0000","last_became_active":"2023-08-31T19:03:28.529494+0000","last_became_peered":"2023-08-31T19:03:28.529494+0000","last_unstale":"2023-08-31T19:03:28.533231+0000","last_undegraded":"2023-08-31T19:03:28.533231+0000","last_fullsized":"2023-08-31T19:03:28.533231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.006140+0000","last_change":"2023-08-31T19:03:29.006140+0000","last_active":"2023-08-31T19:03:29.006140+0000","last_peered":"2023-08-31T19:03:29.006140+0000","last_clean":"2023-08-31T19:03:29.006140+0000","last_became_active":"2023-08-31T19:03:29.005728+0000","last_became_peered":"2023-08-31T19:03:29.005728+0000","last_unstale":"2023-08-31T19:03:29.006140+0000","last_undegraded":"2023-08-31T19:03:29.006140+0000","last_fullsized":"2023-08-31T19:03:29.006140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.541433+0000","last_change":"2023-08-31T19:03:28.536952+0000","last_active":"2023-08-31T19:03:28.541433+0000","last_peered":"2023-08-31T19:03:28.541433+0000","last_clean":"2023-08-31T19:03:28.541433+0000","last_became_active":"2023-08-31T19:03:28.536665+0000","last_became_peered":"2023-08-31T19:03:28.536665+0000","last_unstale":"2023-08-31T19:03:28.541433+0000","last_undegraded":"2023-08-31T19:03:28.541433+0000","last_fullsized":"2023-08-31T19:03:28.541433+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.997602+0000","last_change":"2023-08-31T19:03:28.997602+0000","last_active":"2023-08-31T19:03:28.997602+0000","last_peered":"2023-08-31T19:03:28.997602+0000","last_clean":"2023-08-31T19:03:28.997602+0000","last_became_active":"2023-08-31T19:03:28.997231+0000","last_became_peered":"2023-08-31T19:03:28.997231+0000","last_unstale":"2023-08-31T19:03:28.997602+0000","last_undegraded":"2023-08-31T19:03:28.997602+0000","last_fullsized":"2023-08-31T19:03:28.997602+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.542376+0000","last_change":"2023-08-31T19:03:28.539039+0000","last_active":"2023-08-31T19:03:28.542376+0000","last_peered":"2023-08-31T19:03:28.542376+0000","last_clean":"2023-08-31T19:03:28.542376+0000","last_became_active":"2023-08-31T19:03:28.538797+0000","last_became_peered":"2023-08-31T19:03:28.538797+0000","last_unstale":"2023-08-31T19:03:28.542376+0000","last_undegraded":"2023-08-31T19:03:28.542376+0000","last_fullsized":"2023-08-31T19:03:28.542376+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.999386+0000","last_change":"2023-08-31T19:03:28.999386+0000","last_active":"2023-08-31T19:03:28.999386+0000","last_peered":"2023-08-31T19:03:28.999386+0000","last_clean":"2023-08-31T19:03:28.999386+0000","last_became_active":"2023-08-31T19:03:28.999105+0000","last_became_peered":"2023-08-31T19:03:28.999105+0000","last_unstale":"2023-08-31T19:03:28.999386+0000","last_undegraded":"2023-08-31T19:03:28.999386+0000","last_fullsized":"2023-08-31T19:03:28.999386+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.537576+0000","last_change":"2023-08-31T19:03:28.533048+0000","last_active":"2023-08-31T19:03:28.537576+0000","last_peered":"2023-08-31T19:03:28.537576+0000","last_clean":"2023-08-31T19:03:28.537576+0000","last_became_active":"2023-08-31T19:03:28.532383+0000","last_became_peered":"2023-08-31T19:03:28.532383+0000","last_unstale":"2023-08-31T19:03:28.537576+0000","last_undegraded":"2023-08-31T19:03:28.537576+0000","last_fullsized":"2023-08-31T19:03:28.537576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.004180+0000","last_change":"2023-08-31T19:03:29.004180+0000","last_active":"2023-08-31T19:03:29.004180+0000","last_peered":"2023-08-31T19:03:29.004180+0000","last_clean":"2023-08-31T19:03:29.004180+0000","last_became_active":"2023-08-31T19:03:29.003876+0000","last_became_peered":"2023-08-31T19:03:29.003876+0000","last_unstale":"2023-08-31T19:03:29.004180+0000","last_undegraded":"2023-08-31T19:03:29.004180+0000","last_fullsized":"2023-08-31T19:03:29.004180+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.543914+0000","last_change":"2023-08-31T19:03:28.537976+0000","last_active":"2023-08-31T19:03:28.543914+0000","last_peered":"2023-08-31T19:03:28.543914+0000","last_clean":"2023-08-31T19:03:28.543914+0000","last_became_active":"2023-08-31T19:03:28.537691+0000","last_became_peered":"2023-08-31T19:03:28.537691+0000","last_unstale":"2023-08-31T19:03:28.543914+0000","last_undegraded":"2023-08-31T19:03:28.543914+0000","last_fullsized":"2023-08-31T19:03:28.543914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.002598+0000","last_change":"2023-08-31T19:03:29.002598+0000","last_active":"2023-08-31T19:03:29.002598+0000","last_peered":"2023-08-31T19:03:29.002598+0000","last_clean":"2023-08-31T19:03:29.002598+0000","last_became_active":"2023-08-31T19:03:29.002205+0000","last_became_peered":"2023-08-31T19:03:29.002205+0000","last_unstale":"2023-08-31T19:03:29.002598+0000","last_undegraded":"2023-08-31T19:03:29.002598+0000","last_fullsized":"2023-08-31T19:03:29.002598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.540155+0000","last_change":"2023-08-31T19:03:28.530945+0000","last_active":"2023-08-31T19:03:28.540155+0000","last_peered":"2023-08-31T19:03:28.540155+0000","last_clean":"2023-08-31T19:03:28.540155+0000","last_became_active":"2023-08-31T19:03:28.528863+0000","last_became_peered":"2023-08-31T19:03:28.528863+0000","last_unstale":"2023-08-31T19:03:28.540155+0000","last_undegraded":"2023-08-31T19:03:28.540155+0000","last_fullsized":"2023-08-31T19:03:28.540155+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.008090+0000","last_change":"2023-08-31T19:03:29.008090+0000","last_active":"2023-08-31T19:03:29.008090+0000","last_peered":"2023-08-31T19:03:29.008090+0000","last_clean":"2023-08-31T19:03:29.008090+0000","last_became_active":"2023-08-31T19:03:29.007764+0000","last_became_peered":"2023-08-31T19:03:29.007764+0000","last_unstale":"2023-08-31T19:03:29.008090+0000","last_undegraded":"2023-08-31T19:03:29.008090+0000","last_fullsized":"2023-08-31T19:03:29.008090+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.537801+0000","last_change":"2023-08-31T19:03:28.535768+0000","last_active":"2023-08-31T19:03:28.537801+0000","last_peered":"2023-08-31T19:03:28.537801+0000","last_clean":"2023-08-31T19:03:28.537801+0000","last_became_active":"2023-08-31T19:03:28.535462+0000","last_became_peered":"2023-08-31T19:03:28.535462+0000","last_unstale":"2023-08-31T19:03:28.537801+0000","last_undegraded":"2023-08-31T19:03:28.537801+0000","last_fullsized":"2023-08-31T19:03:28.537801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.997623+0000","last_change":"2023-08-31T19:03:28.997623+0000","last_active":"2023-08-31T19:03:28.997623+0000","last_peered":"2023-08-31T19:03:28.997623+0000","last_clean":"2023-08-31T19:03:28.997623+0000","last_became_active":"2023-08-31T19:03:28.997147+0000","last_became_peered":"2023-08-31T19:03:28.997147+0000","last_unstale":"2023-08-31T19:03:28.997623+0000","last_undegraded":"2023-08-31T19:03:28.997623+0000","last_fullsized":"2023-08-31T19:03:28.997623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.984265+0000","last_change":"2023-08-31T19:03:28.537655+0000","last_active":"2023-08-31T19:03:28.984265+0000","last_peered":"2023-08-31T19:03:28.984265+0000","last_clean":"2023-08-31T19:03:28.984265+0000","last_became_active":"2023-08-31T19:03:28.537331+0000","last_became_peered":"2023-08-31T19:03:28.537331+0000","last_unstale":"2023-08-31T19:03:28.984265+0000","last_undegraded":"2023-08-31T19:03:28.984265+0000","last_fullsized":"2023-08-31T19:03:28.984265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.003956+0000","last_change":"2023-08-31T19:03:29.003956+0000","last_active":"2023-08-31T19:03:29.003956+0000","last_peered":"2023-08-31T19:03:29.003956+0000","last_clean":"2023-08-31T19:03:29.003956+0000","last_became_active":"2023-08-31T19:03:28.998502+0000","last_became_peered":"2023-08-31T19:03:28.998502+0000","last_unstale":"2023-08-31T19:03:29.003956+0000","last_undegraded":"2023-08-31T19:03:29.003956+0000","last_fullsized":"2023-08-31T19:03:29.003956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.976442+0000","last_change":"2023-08-31T19:03:28.540979+0000","last_active":"2023-08-31T19:03:28.976442+0000","last_peered":"2023-08-31T19:03:28.976442+0000","last_clean":"2023-08-31T19:03:28.976442+0000","last_became_active":"2023-08-31T19:03:28.540719+0000","last_became_peered":"2023-08-31T19:03:28.540719+0000","last_unstale":"2023-08-31T19:03:28.976442+0000","last_undegraded":"2023-08-31T19:03:28.976442+0000","last_fullsized":"2023-08-31T19:03:28.976442+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.997091+0000","last_change":"2023-08-31T19:03:28.997091+0000","last_active":"2023-08-31T19:03:28.997091+0000","last_peered":"2023-08-31T19:03:28.997091+0000","last_clean":"2023-08-31T19:03:28.997091+0000","last_became_active":"2023-08-31T19:03:28.996644+0000","last_became_peered":"2023-08-31T19:03:28.996644+0000","last_unstale":"2023-08-31T19:03:28.997091+0000","last_undegraded":"2023-08-31T19:03:28.997091+0000","last_fullsized":"2023-08-31T19:03:28.997091+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"78'2","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.984017+0000","last_change":"2023-08-31T19:03:28.537180+0000","last_active":"2023-08-31T19:03:28.984017+0000","last_peered":"2023-08-31T19:03:28.984017+0000","last_clean":"2023-08-31T19:03:28.984017+0000","last_became_active":"2023-08-31T19:03:28.536041+0000","last_became_peered":"2023-08-31T19:03:28.536041+0000","last_unstale":"2023-08-31T19:03:28.984017+0000","last_undegraded":"2023-08-31T19:03:28.984017+0000","last_fullsized":"2023-08-31T19:03:28.984017+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.997386+0000","last_change":"2023-08-31T19:03:28.997386+0000","last_active":"2023-08-31T19:03:28.997386+0000","last_peered":"2023-08-31T19:03:28.997386+0000","last_clean":"2023-08-31T19:03:28.997386+0000","last_became_active":"2023-08-31T19:03:28.997067+0000","last_became_peered":"2023-08-31T19:03:28.997067+0000","last_unstale":"2023-08-31T19:03:28.997386+0000","last_undegraded":"2023-08-31T19:03:28.997386+0000","last_fullsized":"2023-08-31T19:03:28.997386+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.544040+0000","last_change":"2023-08-31T19:03:28.539938+0000","last_active":"2023-08-31T19:03:28.544040+0000","last_peered":"2023-08-31T19:03:28.544040+0000","last_clean":"2023-08-31T19:03:28.544040+0000","last_became_active":"2023-08-31T19:03:28.539679+0000","last_became_peered":"2023-08-31T19:03:28.539679+0000","last_unstale":"2023-08-31T19:03:28.544040+0000","last_undegraded":"2023-08-31T19:03:28.544040+0000","last_fullsized":"2023-08-31T19:03:28.544040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.995871+0000","last_change":"2023-08-31T19:03:28.995871+0000","last_active":"2023-08-31T19:03:28.995871+0000","last_peered":"2023-08-31T19:03:28.995871+0000","last_clean":"2023-08-31T19:03:28.995871+0000","last_became_active":"2023-08-31T19:03:28.995570+0000","last_became_peered":"2023-08-31T19:03:28.995570+0000","last_unstale":"2023-08-31T19:03:28.995871+0000","last_undegraded":"2023-08-31T19:03:28.995871+0000","last_fullsized":"2023-08-31T19:03:28.995871+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.543052+0000","last_change":"2023-08-31T19:03:28.538771+0000","last_active":"2023-08-31T19:03:28.543052+0000","last_peered":"2023-08-31T19:03:28.543052+0000","last_clean":"2023-08-31T19:03:28.543052+0000","last_became_active":"2023-08-31T19:03:28.538487+0000","last_became_peered":"2023-08-31T19:03:28.538487+0000","last_unstale":"2023-08-31T19:03:28.543052+0000","last_undegraded":"2023-08-31T19:03:28.543052+0000","last_fullsized":"2023-08-31T19:03:28.543052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.003861+0000","last_change":"2023-08-31T19:03:29.003861+0000","last_active":"2023-08-31T19:03:29.003861+0000","last_peered":"2023-08-31T19:03:29.003861+0000","last_clean":"2023-08-31T19:03:29.003861+0000","last_became_active":"2023-08-31T19:03:29.003564+0000","last_became_peered":"2023-08-31T19:03:29.003564+0000","last_unstale":"2023-08-31T19:03:29.003861+0000","last_undegraded":"2023-08-31T19:03:29.003861+0000","last_fullsized":"2023-08-31T19:03:29.003861+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.526329+0000","last_change":"2023-08-31T19:03:28.522759+0000","last_active":"2023-08-31T19:03:28.526329+0000","last_peered":"2023-08-31T19:03:28.526329+0000","last_clean":"2023-08-31T19:03:28.526329+0000","last_became_active":"2023-08-31T19:03:28.522444+0000","last_became_peered":"2023-08-31T19:03:28.522444+0000","last_unstale":"2023-08-31T19:03:28.526329+0000","last_undegraded":"2023-08-31T19:03:28.526329+0000","last_fullsized":"2023-08-31T19:03:28.526329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.991918+0000","last_change":"2023-08-31T19:03:28.991918+0000","last_active":"2023-08-31T19:03:28.991918+0000","last_peered":"2023-08-31T19:03:28.991918+0000","last_clean":"2023-08-31T19:03:28.991918+0000","last_became_active":"2023-08-31T19:03:28.991382+0000","last_became_peered":"2023-08-31T19:03:28.991382+0000","last_unstale":"2023-08-31T19:03:28.991918+0000","last_undegraded":"2023-08-31T19:03:28.991918+0000","last_fullsized":"2023-08-31T19:03:28.991918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.541725+0000","last_change":"2023-08-31T19:03:28.534181+0000","last_active":"2023-08-31T19:03:28.541725+0000","last_peered":"2023-08-31T19:03:28.541725+0000","last_clean":"2023-08-31T19:03:28.541725+0000","last_became_active":"2023-08-31T19:03:28.533723+0000","last_became_peered":"2023-08-31T19:03:28.533723+0000","last_unstale":"2023-08-31T19:03:28.541725+0000","last_undegraded":"2023-08-31T19:03:28.541725+0000","last_fullsized":"2023-08-31T19:03:28.541725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.004785+0000","last_change":"2023-08-31T19:03:29.004785+0000","last_active":"2023-08-31T19:03:29.004785+0000","last_peered":"2023-08-31T19:03:29.004785+0000","last_clean":"2023-08-31T19:03:29.004785+0000","last_became_active":"2023-08-31T19:03:29.004541+0000","last_became_peered":"2023-08-31T19:03:29.004541+0000","last_unstale":"2023-08-31T19:03:29.004785+0000","last_undegraded":"2023-08-31T19:03:29.004785+0000","last_fullsized":"2023-08-31T19:03:29.004785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.541720+0000","last_change":"2023-08-31T19:03:28.539098+0000","last_active":"2023-08-31T19:03:28.541720+0000","last_peered":"2023-08-31T19:03:28.541720+0000","last_clean":"2023-08-31T19:03:28.541720+0000","last_became_active":"2023-08-31T19:03:28.538727+0000","last_became_peered":"2023-08-31T19:03:28.538727+0000","last_unstale":"2023-08-31T19:03:28.541720+0000","last_undegraded":"2023-08-31T19:03:28.541720+0000","last_fullsized":"2023-08-31T19:03:28.541720+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.999924+0000","last_change":"2023-08-31T19:03:28.999924+0000","last_active":"2023-08-31T19:03:28.999924+0000","last_peered":"2023-08-31T19:03:28.999924+0000","last_clean":"2023-08-31T19:03:28.999924+0000","last_became_active":"2023-08-31T19:03:28.999619+0000","last_became_peered":"2023-08-31T19:03:28.999619+0000","last_unstale":"2023-08-31T19:03:28.999924+0000","last_undegraded":"2023-08-31T19:03:28.999924+0000","last_fullsized":"2023-08-31T19:03:28.999924+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.548954+0000","last_change":"2023-08-31T19:03:28.546244+0000","last_active":"2023-08-31T19:03:28.548954+0000","last_peered":"2023-08-31T19:03:28.548954+0000","last_clean":"2023-08-31T19:03:28.548954+0000","last_became_active":"2023-08-31T19:03:28.545917+0000","last_became_peered":"2023-08-31T19:03:28.545917+0000","last_unstale":"2023-08-31T19:03:28.548954+0000","last_undegraded":"2023-08-31T19:03:28.548954+0000","last_fullsized":"2023-08-31T19:03:28.548954+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.008472+0000","last_change":"2023-08-31T19:03:29.008472+0000","last_active":"2023-08-31T19:03:29.008472+0000","last_peered":"2023-08-31T19:03:29.008472+0000","last_clean":"2023-08-31T19:03:29.008472+0000","last_became_active":"2023-08-31T19:03:29.008270+0000","last_became_peered":"2023-08-31T19:03:29.008270+0000","last_unstale":"2023-08-31T19:03:29.008472+0000","last_undegraded":"2023-08-31T19:03:29.008472+0000","last_fullsized":"2023-08-31T19:03:29.008472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.542496+0000","last_change":"2023-08-31T19:03:28.536239+0000","last_active":"2023-08-31T19:03:28.542496+0000","last_peered":"2023-08-31T19:03:28.542496+0000","last_clean":"2023-08-31T19:03:28.542496+0000","last_became_active":"2023-08-31T19:03:28.535930+0000","last_became_peered":"2023-08-31T19:03:28.535930+0000","last_unstale":"2023-08-31T19:03:28.542496+0000","last_undegraded":"2023-08-31T19:03:28.542496+0000","last_fullsized":"2023-08-31T19:03:28.542496+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.008845+0000","last_change":"2023-08-31T19:03:29.008845+0000","last_active":"2023-08-31T19:03:29.008845+0000","last_peered":"2023-08-31T19:03:29.008845+0000","last_clean":"2023-08-31T19:03:29.008845+0000","last_became_active":"2023-08-31T19:03:29.008512+0000","last_became_peered":"2023-08-31T19:03:29.008512+0000","last_unstale":"2023-08-31T19:03:29.008845+0000","last_undegraded":"2023-08-31T19:03:29.008845+0000","last_fullsized":"2023-08-31T19:03:29.008845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"78'3","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.005910+0000","last_change":"2023-08-31T19:03:28.546249+0000","last_active":"2023-08-31T19:03:29.005910+0000","last_peered":"2023-08-31T19:03:29.005910+0000","last_clean":"2023-08-31T19:03:29.005910+0000","last_became_active":"2023-08-31T19:03:28.545914+0000","last_became_peered":"2023-08-31T19:03:28.545914+0000","last_unstale":"2023-08-31T19:03:29.005910+0000","last_undegraded":"2023-08-31T19:03:29.005910+0000","last_fullsized":"2023-08-31T19:03:29.005910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.004632+0000","last_change":"2023-08-31T19:03:29.004632+0000","last_active":"2023-08-31T19:03:29.004632+0000","last_peered":"2023-08-31T19:03:29.004632+0000","last_clean":"2023-08-31T19:03:29.004632+0000","last_became_active":"2023-08-31T19:03:29.004389+0000","last_became_peered":"2023-08-31T19:03:29.004389+0000","last_unstale":"2023-08-31T19:03:29.004632+0000","last_undegraded":"2023-08-31T19:03:29.004632+0000","last_fullsized":"2023-08-31T19:03:29.004632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"78'2","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.006156+0000","last_change":"2023-08-31T19:03:28.531564+0000","last_active":"2023-08-31T19:03:29.006156+0000","last_peered":"2023-08-31T19:03:29.006156+0000","last_clean":"2023-08-31T19:03:29.006156+0000","last_became_active":"2023-08-31T19:03:28.531263+0000","last_became_peered":"2023-08-31T19:03:28.531263+0000","last_unstale":"2023-08-31T19:03:29.006156+0000","last_undegraded":"2023-08-31T19:03:29.006156+0000","last_fullsized":"2023-08-31T19:03:29.006156+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.991603+0000","last_change":"2023-08-31T19:03:28.991603+0000","last_active":"2023-08-31T19:03:28.991603+0000","last_peered":"2023-08-31T19:03:28.991603+0000","last_clean":"2023-08-31T19:03:28.991603+0000","last_became_active":"2023-08-31T19:03:28.991321+0000","last_became_peered":"2023-08-31T19:03:28.991321+0000","last_unstale":"2023-08-31T19:03:28.991603+0000","last_undegraded":"2023-08-31T19:03:28.991603+0000","last_fullsized":"2023-08-31T19:03:28.991603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.982072+0000","last_change":"2023-08-31T19:03:28.537257+0000","last_active":"2023-08-31T19:03:28.982072+0000","last_peered":"2023-08-31T19:03:28.982072+0000","last_clean":"2023-08-31T19:03:28.982072+0000","last_became_active":"2023-08-31T19:03:28.536973+0000","last_became_peered":"2023-08-31T19:03:28.536973+0000","last_unstale":"2023-08-31T19:03:28.982072+0000","last_undegraded":"2023-08-31T19:03:28.982072+0000","last_fullsized":"2023-08-31T19:03:28.982072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.996340+0000","last_change":"2023-08-31T19:03:28.996340+0000","last_active":"2023-08-31T19:03:28.996340+0000","last_peered":"2023-08-31T19:03:28.996340+0000","last_clean":"2023-08-31T19:03:28.996340+0000","last_became_active":"2023-08-31T19:03:28.995702+0000","last_became_peered":"2023-08-31T19:03:28.995702+0000","last_unstale":"2023-08-31T19:03:28.996340+0000","last_undegraded":"2023-08-31T19:03:28.996340+0000","last_fullsized":"2023-08-31T19:03:28.996340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.545066+0000","last_change":"2023-08-31T19:03:28.541807+0000","last_active":"2023-08-31T19:03:28.545066+0000","last_peered":"2023-08-31T19:03:28.545066+0000","last_clean":"2023-08-31T19:03:28.545066+0000","last_became_active":"2023-08-31T19:03:28.541306+0000","last_became_peered":"2023-08-31T19:03:28.541306+0000","last_unstale":"2023-08-31T19:03:28.545066+0000","last_undegraded":"2023-08-31T19:03:28.545066+0000","last_fullsized":"2023-08-31T19:03:28.545066+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.000207+0000","last_change":"2023-08-31T19:03:29.000207+0000","last_active":"2023-08-31T19:03:29.000207+0000","last_peered":"2023-08-31T19:03:29.000207+0000","last_clean":"2023-08-31T19:03:29.000207+0000","last_became_active":"2023-08-31T19:03:28.999917+0000","last_became_peered":"2023-08-31T19:03:28.999917+0000","last_unstale":"2023-08-31T19:03:29.000207+0000","last_undegraded":"2023-08-31T19:03:29.000207+0000","last_fullsized":"2023-08-31T19:03:29.000207+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.544814+0000","last_change":"2023-08-31T19:03:28.539181+0000","last_active":"2023-08-31T19:03:28.544814+0000","last_peered":"2023-08-31T19:03:28.544814+0000","last_clean":"2023-08-31T19:03:28.544814+0000","last_became_active":"2023-08-31T19:03:28.538667+0000","last_became_peered":"2023-08-31T19:03:28.538667+0000","last_unstale":"2023-08-31T19:03:28.544814+0000","last_undegraded":"2023-08-31T19:03:28.544814+0000","last_fullsized":"2023-08-31T19:03:28.544814+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.992072+0000","last_change":"2023-08-31T19:03:28.992072+0000","last_active":"2023-08-31T19:03:28.992072+0000","last_peered":"2023-08-31T19:03:28.992072+0000","last_clean":"2023-08-31T19:03:28.992072+0000","last_became_active":"2023-08-31T19:03:28.991738+0000","last_became_peered":"2023-08-31T19:03:28.991738+0000","last_unstale":"2023-08-31T19:03:28.992072+0000","last_undegraded":"2023-08-31T19:03:28.992072+0000","last_fullsized":"2023-08-31T19:03:28.992072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"78'4","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.011769+0000","last_change":"2023-08-31T19:03:28.535372+0000","last_active":"2023-08-31T19:03:29.011769+0000","last_peered":"2023-08-31T19:03:29.011769+0000","last_clean":"2023-08-31T19:03:29.011769+0000","last_became_active":"2023-08-31T19:03:28.535072+0000","last_became_peered":"2023-08-31T19:03:28.535072+0000","last_unstale":"2023-08-31T19:03:29.011769+0000","last_undegraded":"2023-08-31T19:03:29.011769+0000","last_fullsized":"2023-08-31T19:03:29.011769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.999542+0000","last_change":"2023-08-31T19:03:28.999542+0000","last_active":"2023-08-31T19:03:28.999542+0000","last_peered":"2023-08-31T19:03:28.999542+0000","last_clean":"2023-08-31T19:03:28.999542+0000","last_became_active":"2023-08-31T19:03:28.999155+0000","last_became_peered":"2023-08-31T19:03:28.999155+0000","last_unstale":"2023-08-31T19:03:28.999542+0000","last_undegraded":"2023-08-31T19:03:28.999542+0000","last_fullsized":"2023-08-31T19:03:28.999542+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"78'2","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.010642+0000","last_change":"2023-08-31T19:03:28.537832+0000","last_active":"2023-08-31T19:03:29.010642+0000","last_peered":"2023-08-31T19:03:29.010642+0000","last_clean":"2023-08-31T19:03:29.010642+0000","last_became_active":"2023-08-31T19:03:28.537532+0000","last_became_peered":"2023-08-31T19:03:28.537532+0000","last_unstale":"2023-08-31T19:03:29.010642+0000","last_undegraded":"2023-08-31T19:03:29.010642+0000","last_fullsized":"2023-08-31T19:03:29.010642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.994711+0000","last_change":"2023-08-31T19:03:28.994711+0000","last_active":"2023-08-31T19:03:28.994711+0000","last_peered":"2023-08-31T19:03:28.994711+0000","last_clean":"2023-08-31T19:03:28.994711+0000","last_became_active":"2023-08-31T19:03:28.994369+0000","last_became_peered":"2023-08-31T19:03:28.994369+0000","last_unstale":"2023-08-31T19:03:28.994711+0000","last_undegraded":"2023-08-31T19:03:28.994711+0000","last_fullsized":"2023-08-31T19:03:28.994711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.542182+0000","last_change":"2023-08-31T19:03:28.540072+0000","last_active":"2023-08-31T19:03:28.542182+0000","last_peered":"2023-08-31T19:03:28.542182+0000","last_clean":"2023-08-31T19:03:28.542182+0000","last_became_active":"2023-08-31T19:03:28.539742+0000","last_became_peered":"2023-08-31T19:03:28.539742+0000","last_unstale":"2023-08-31T19:03:28.542182+0000","last_undegraded":"2023-08-31T19:03:28.542182+0000","last_fullsized":"2023-08-31T19:03:28.542182+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.996589+0000","last_change":"2023-08-31T19:03:28.996589+0000","last_active":"2023-08-31T19:03:28.996589+0000","last_peered":"2023-08-31T19:03:28.996589+0000","last_clean":"2023-08-31T19:03:28.996589+0000","last_became_active":"2023-08-31T19:03:28.993627+0000","last_became_peered":"2023-08-31T19:03:28.993627+0000","last_unstale":"2023-08-31T19:03:28.996589+0000","last_undegraded":"2023-08-31T19:03:28.996589+0000","last_fullsized":"2023-08-31T19:03:28.996589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.537771+0000","last_change":"2023-08-31T19:03:28.535756+0000","last_active":"2023-08-31T19:03:28.537771+0000","last_peered":"2023-08-31T19:03:28.537771+0000","last_clean":"2023-08-31T19:03:28.537771+0000","last_became_active":"2023-08-31T19:03:28.535351+0000","last_became_peered":"2023-08-31T19:03:28.535351+0000","last_unstale":"2023-08-31T19:03:28.537771+0000","last_undegraded":"2023-08-31T19:03:28.537771+0000","last_fullsized":"2023-08-31T19:03:28.537771+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.993342+0000","last_change":"2023-08-31T19:03:28.993342+0000","last_active":"2023-08-31T19:03:28.993342+0000","last_peered":"2023-08-31T19:03:28.993342+0000","last_clean":"2023-08-31T19:03:28.993342+0000","last_became_active":"2023-08-31T19:03:28.992898+0000","last_became_peered":"2023-08-31T19:03:28.992898+0000","last_unstale":"2023-08-31T19:03:28.993342+0000","last_undegraded":"2023-08-31T19:03:28.993342+0000","last_fullsized":"2023-08-31T19:03:28.993342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.545777+0000","last_change":"2023-08-31T19:03:28.538609+0000","last_active":"2023-08-31T19:03:28.545777+0000","last_peered":"2023-08-31T19:03:28.545777+0000","last_clean":"2023-08-31T19:03:28.545777+0000","last_became_active":"2023-08-31T19:03:28.538060+0000","last_became_peered":"2023-08-31T19:03:28.538060+0000","last_unstale":"2023-08-31T19:03:28.545777+0000","last_undegraded":"2023-08-31T19:03:28.545777+0000","last_fullsized":"2023-08-31T19:03:28.545777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.994158+0000","last_change":"2023-08-31T19:03:28.994158+0000","last_active":"2023-08-31T19:03:28.994158+0000","last_peered":"2023-08-31T19:03:28.994158+0000","last_clean":"2023-08-31T19:03:28.994158+0000","last_became_active":"2023-08-31T19:03:28.993735+0000","last_became_peered":"2023-08-31T19:03:28.993735+0000","last_unstale":"2023-08-31T19:03:28.994158+0000","last_undegraded":"2023-08-31T19:03:28.994158+0000","last_fullsized":"2023-08-31T19:03:28.994158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.544140+0000","last_change":"2023-08-31T19:03:28.536448+0000","last_active":"2023-08-31T19:03:28.544140+0000","last_peered":"2023-08-31T19:03:28.544140+0000","last_clean":"2023-08-31T19:03:28.544140+0000","last_became_active":"2023-08-31T19:03:28.536158+0000","last_became_peered":"2023-08-31T19:03:28.536158+0000","last_unstale":"2023-08-31T19:03:28.544140+0000","last_undegraded":"2023-08-31T19:03:28.544140+0000","last_fullsized":"2023-08-31T19:03:28.544140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.011827+0000","last_change":"2023-08-31T19:03:29.011827+0000","last_active":"2023-08-31T19:03:29.011827+0000","last_peered":"2023-08-31T19:03:29.011827+0000","last_clean":"2023-08-31T19:03:29.011827+0000","last_became_active":"2023-08-31T19:03:29.011520+0000","last_became_peered":"2023-08-31T19:03:29.011520+0000","last_unstale":"2023-08-31T19:03:29.011827+0000","last_undegraded":"2023-08-31T19:03:29.011827+0000","last_fullsized":"2023-08-31T19:03:29.011827+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.542503+0000","last_change":"2023-08-31T19:03:28.534875+0000","last_active":"2023-08-31T19:03:28.542503+0000","last_peered":"2023-08-31T19:03:28.542503+0000","last_clean":"2023-08-31T19:03:28.542503+0000","last_became_active":"2023-08-31T19:03:28.534615+0000","last_became_peered":"2023-08-31T19:03:28.534615+0000","last_unstale":"2023-08-31T19:03:28.542503+0000","last_undegraded":"2023-08-31T19:03:28.542503+0000","last_fullsized":"2023-08-31T19:03:28.542503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.999389+0000","last_change":"2023-08-31T19:03:28.999389+0000","last_active":"2023-08-31T19:03:28.999389+0000","last_peered":"2023-08-31T19:03:28.999389+0000","last_clean":"2023-08-31T19:03:28.999389+0000","last_became_active":"2023-08-31T19:03:28.998690+0000","last_became_peered":"2023-08-31T19:03:28.998690+0000","last_unstale":"2023-08-31T19:03:28.999389+0000","last_undegraded":"2023-08-31T19:03:28.999389+0000","last_fullsized":"2023-08-31T19:03:28.999389+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.541704+0000","last_change":"2023-08-31T19:03:28.534008+0000","last_active":"2023-08-31T19:03:28.541704+0000","last_peered":"2023-08-31T19:03:28.541704+0000","last_clean":"2023-08-31T19:03:28.541704+0000","last_became_active":"2023-08-31T19:03:28.533407+0000","last_became_peered":"2023-08-31T19:03:28.533407+0000","last_unstale":"2023-08-31T19:03:28.541704+0000","last_undegraded":"2023-08-31T19:03:28.541704+0000","last_fullsized":"2023-08-31T19:03:28.541704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.006570+0000","last_change":"2023-08-31T19:03:29.006570+0000","last_active":"2023-08-31T19:03:29.006570+0000","last_peered":"2023-08-31T19:03:29.006570+0000","last_clean":"2023-08-31T19:03:29.006570+0000","last_became_active":"2023-08-31T19:03:29.006250+0000","last_became_peered":"2023-08-31T19:03:29.006250+0000","last_unstale":"2023-08-31T19:03:29.006570+0000","last_undegraded":"2023-08-31T19:03:29.006570+0000","last_fullsized":"2023-08-31T19:03:29.006570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.545696+0000","last_change":"2023-08-31T19:03:28.537590+0000","last_active":"2023-08-31T19:03:28.545696+0000","last_peered":"2023-08-31T19:03:28.545696+0000","last_clean":"2023-08-31T19:03:28.545696+0000","last_became_active":"2023-08-31T19:03:28.536483+0000","last_became_peered":"2023-08-31T19:03:28.536483+0000","last_unstale":"2023-08-31T19:03:28.545696+0000","last_undegraded":"2023-08-31T19:03:28.545696+0000","last_fullsized":"2023-08-31T19:03:28.545696+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.002180+0000","last_change":"2023-08-31T19:03:29.002180+0000","last_active":"2023-08-31T19:03:29.002180+0000","last_peered":"2023-08-31T19:03:29.002180+0000","last_clean":"2023-08-31T19:03:29.002180+0000","last_became_active":"2023-08-31T19:03:29.000851+0000","last_became_peered":"2023-08-31T19:03:29.000851+0000","last_unstale":"2023-08-31T19:03:29.002180+0000","last_undegraded":"2023-08-31T19:03:29.002180+0000","last_fullsized":"2023-08-31T19:03:29.002180+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.987813+0000","last_change":"2023-08-31T19:03:28.540343+0000","last_active":"2023-08-31T19:03:28.987813+0000","last_peered":"2023-08-31T19:03:28.987813+0000","last_clean":"2023-08-31T19:03:28.987813+0000","last_became_active":"2023-08-31T19:03:28.540022+0000","last_became_peered":"2023-08-31T19:03:28.540022+0000","last_unstale":"2023-08-31T19:03:28.987813+0000","last_undegraded":"2023-08-31T19:03:28.987813+0000","last_fullsized":"2023-08-31T19:03:28.987813+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.530964+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:03:28.530964+0000","last_peered":"2023-08-31T19:03:28.530964+0000","last_clean":"2023-08-31T19:03:28.530964+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:03:28.530964+0000","last_undegraded":"2023-08-31T19:03:28.530964+0000","last_fullsized":"2023-08-31T19:03:28.530964+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.991700+0000","last_change":"2023-08-31T19:03:28.991700+0000","last_active":"2023-08-31T19:03:28.991700+0000","last_peered":"2023-08-31T19:03:28.991700+0000","last_clean":"2023-08-31T19:03:28.991700+0000","last_became_active":"2023-08-31T19:03:28.990956+0000","last_became_peered":"2023-08-31T19:03:28.990956+0000","last_unstale":"2023-08-31T19:03:28.991700+0000","last_undegraded":"2023-08-31T19:03:28.991700+0000","last_fullsized":"2023-08-31T19:03:28.991700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.536053+0000","last_change":"2023-08-31T19:03:28.533737+0000","last_active":"2023-08-31T19:03:28.536053+0000","last_peered":"2023-08-31T19:03:28.536053+0000","last_clean":"2023-08-31T19:03:28.536053+0000","last_became_active":"2023-08-31T19:03:28.533388+0000","last_became_peered":"2023-08-31T19:03:28.533388+0000","last_unstale":"2023-08-31T19:03:28.536053+0000","last_undegraded":"2023-08-31T19:03:28.536053+0000","last_fullsized":"2023-08-31T19:03:28.536053+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.518915+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:03:28.518915+0000","last_peered":"2023-08-31T19:03:28.518915+0000","last_clean":"2023-08-31T19:03:28.518915+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:03:28.518915+0000","last_undegraded":"2023-08-31T19:03:28.518915+0000","last_fullsized":"2023-08-31T19:03:28.518915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.996534+0000","last_change":"2023-08-31T19:03:28.996534+0000","last_active":"2023-08-31T19:03:28.996534+0000","last_peered":"2023-08-31T19:03:28.996534+0000","last_clean":"2023-08-31T19:03:28.996534+0000","last_became_active":"2023-08-31T19:03:28.996068+0000","last_became_peered":"2023-08-31T19:03:28.996068+0000","last_unstale":"2023-08-31T19:03:28.996534+0000","last_undegraded":"2023-08-31T19:03:28.996534+0000","last_fullsized":"2023-08-31T19:03:28.996534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.545047+0000","last_change":"2023-08-31T19:03:28.541597+0000","last_active":"2023-08-31T19:03:28.545047+0000","last_peered":"2023-08-31T19:03:28.545047+0000","last_clean":"2023-08-31T19:03:28.545047+0000","last_became_active":"2023-08-31T19:03:28.540890+0000","last_became_peered":"2023-08-31T19:03:28.540890+0000","last_unstale":"2023-08-31T19:03:28.545047+0000","last_undegraded":"2023-08-31T19:03:28.545047+0000","last_fullsized":"2023-08-31T19:03:28.545047+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.515130+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:03:28.515130+0000","last_peered":"2023-08-31T19:03:28.515130+0000","last_clean":"2023-08-31T19:03:28.515130+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:03:28.515130+0000","last_undegraded":"2023-08-31T19:03:28.515130+0000","last_fullsized":"2023-08-31T19:03:28.515130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.994038+0000","last_change":"2023-08-31T19:03:28.994038+0000","last_active":"2023-08-31T19:03:28.994038+0000","last_peered":"2023-08-31T19:03:28.994038+0000","last_clean":"2023-08-31T19:03:28.994038+0000","last_became_active":"2023-08-31T19:03:28.993698+0000","last_became_peered":"2023-08-31T19:03:28.993698+0000","last_unstale":"2023-08-31T19:03:28.994038+0000","last_undegraded":"2023-08-31T19:03:28.994038+0000","last_fullsized":"2023-08-31T19:03:28.994038+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.543259+0000","last_change":"2023-08-31T19:03:28.538838+0000","last_active":"2023-08-31T19:03:28.543259+0000","last_peered":"2023-08-31T19:03:28.543259+0000","last_clean":"2023-08-31T19:03:28.543259+0000","last_became_active":"2023-08-31T19:03:28.538563+0000","last_became_peered":"2023-08-31T19:03:28.538563+0000","last_unstale":"2023-08-31T19:03:28.543259+0000","last_undegraded":"2023-08-31T19:03:28.543259+0000","last_fullsized":"2023-08-31T19:03:28.543259+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":64,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.520019+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:03:28.520019+0000","last_peered":"2023-08-31T19:03:28.520019+0000","last_clean":"2023-08-31T19:03:28.520019+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:03:28.520019+0000","last_undegraded":"2023-08-31T19:03:28.520019+0000","last_fullsized":"2023-08-31T19:03:28.520019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":64,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.528967+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:03:28.528967+0000","last_peered":"2023-08-31T19:03:28.528967+0000","last_clean":"2023-08-31T19:03:28.528967+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:03:28.528967+0000","last_undegraded":"2023-08-31T19:03:28.528967+0000","last_fullsized":"2023-08-31T19:03:28.528967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.992186+0000","last_change":"2023-08-31T19:03:28.992186+0000","last_active":"2023-08-31T19:03:28.992186+0000","last_peered":"2023-08-31T19:03:28.992186+0000","last_clean":"2023-08-31T19:03:28.992186+0000","last_became_active":"2023-08-31T19:03:28.991738+0000","last_became_peered":"2023-08-31T19:03:28.991738+0000","last_unstale":"2023-08-31T19:03:28.992186+0000","last_undegraded":"2023-08-31T19:03:28.992186+0000","last_fullsized":"2023-08-31T19:03:28.992186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"78'1","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.975970+0000","last_change":"2023-08-31T19:03:28.530669+0000","last_active":"2023-08-31T19:03:28.975970+0000","last_peered":"2023-08-31T19:03:28.975970+0000","last_clean":"2023-08-31T19:03:28.975970+0000","last_became_active":"2023-08-31T19:03:28.530392+0000","last_became_peered":"2023-08-31T19:03:28.530392+0000","last_unstale":"2023-08-31T19:03:28.975970+0000","last_undegraded":"2023-08-31T19:03:28.975970+0000","last_fullsized":"2023-08-31T19:03:28.975970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.529049+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:03:28.529049+0000","last_peered":"2023-08-31T19:03:28.529049+0000","last_clean":"2023-08-31T19:03:28.529049+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:03:28.529049+0000","last_undegraded":"2023-08-31T19:03:28.529049+0000","last_fullsized":"2023-08-31T19:03:28.529049+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.008038+0000","last_change":"2023-08-31T19:03:29.008038+0000","last_active":"2023-08-31T19:03:29.008038+0000","last_peered":"2023-08-31T19:03:29.008038+0000","last_clean":"2023-08-31T19:03:29.008038+0000","last_became_active":"2023-08-31T19:03:29.007678+0000","last_became_peered":"2023-08-31T19:03:29.007678+0000","last_unstale":"2023-08-31T19:03:29.008038+0000","last_undegraded":"2023-08-31T19:03:29.008038+0000","last_fullsized":"2023-08-31T19:03:29.008038+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"78'2","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.007473+0000","last_change":"2023-08-31T19:03:28.536349+0000","last_active":"2023-08-31T19:03:29.007473+0000","last_peered":"2023-08-31T19:03:29.007473+0000","last_clean":"2023-08-31T19:03:29.007473+0000","last_became_active":"2023-08-31T19:03:28.536043+0000","last_became_peered":"2023-08-31T19:03:28.536043+0000","last_unstale":"2023-08-31T19:03:29.007473+0000","last_undegraded":"2023-08-31T19:03:29.007473+0000","last_fullsized":"2023-08-31T19:03:29.007473+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.524827+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:03:28.524827+0000","last_peered":"2023-08-31T19:03:28.524827+0000","last_clean":"2023-08-31T19:03:28.524827+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:03:28.524827+0000","last_undegraded":"2023-08-31T19:03:28.524827+0000","last_fullsized":"2023-08-31T19:03:28.524827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:29.005233+0000","last_change":"2023-08-31T19:03:29.005233+0000","last_active":"2023-08-31T19:03:29.005233+0000","last_peered":"2023-08-31T19:03:29.005233+0000","last_clean":"2023-08-31T19:03:29.005233+0000","last_became_active":"2023-08-31T19:03:29.004923+0000","last_became_peered":"2023-08-31T19:03:29.004923+0000","last_unstale":"2023-08-31T19:03:29.005233+0000","last_undegraded":"2023-08-31T19:03:29.005233+0000","last_fullsized":"2023-08-31T19:03:29.005233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.546187+0000","last_change":"2023-08-31T19:03:28.544444+0000","last_active":"2023-08-31T19:03:28.546187+0000","last_peered":"2023-08-31T19:03:28.546187+0000","last_clean":"2023-08-31T19:03:28.546187+0000","last_became_active":"2023-08-31T19:03:28.544123+0000","last_became_peered":"2023-08-31T19:03:28.544123+0000","last_unstale":"2023-08-31T19:03:28.546187+0000","last_undegraded":"2023-08-31T19:03:28.546187+0000","last_fullsized":"2023-08-31T19:03:28.546187+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.530879+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:03:28.530879+0000","last_peered":"2023-08-31T19:03:28.530879+0000","last_clean":"2023-08-31T19:03:28.530879+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:03:28.530879+0000","last_undegraded":"2023-08-31T19:03:28.530879+0000","last_fullsized":"2023-08-31T19:03:28.530879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.993172+0000","last_change":"2023-08-31T19:03:28.993172+0000","last_active":"2023-08-31T19:03:28.993172+0000","last_peered":"2023-08-31T19:03:28.993172+0000","last_clean":"2023-08-31T19:03:28.993172+0000","last_became_active":"2023-08-31T19:03:28.992495+0000","last_became_peered":"2023-08-31T19:03:28.992495+0000","last_unstale":"2023-08-31T19:03:28.993172+0000","last_undegraded":"2023-08-31T19:03:28.993172+0000","last_fullsized":"2023-08-31T19:03:28.993172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:28.505238+0000","last_clean_scrub_stamp":"2023-08-31T19:03:28.505238+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.534363+0000","last_change":"2023-08-31T19:03:28.526608+0000","last_active":"2023-08-31T19:03:28.534363+0000","last_peered":"2023-08-31T19:03:28.534363+0000","last_clean":"2023-08-31T19:03:28.534363+0000","last_became_active":"2023-08-31T19:03:28.526324+0000","last_became_peered":"2023-08-31T19:03:28.526324+0000","last_unstale":"2023-08-31T19:03:28.534363+0000","last_undegraded":"2023-08-31T19:03:28.534363+0000","last_fullsized":"2023-08-31T19:03:28.534363+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:03:27.498805+0000","last_clean_scrub_stamp":"2023-08-31T19:03:27.498805+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-08-31T19:03:28.519518+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:03:28.519518+0000","last_peered":"2023-08-31T19:03:28.519518+0000","last_clean":"2023-08-31T19:03:28.519518+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:03:28.519518+0000","last_undegraded":"2023-08-31T19:03:28.519518+0000","last_fullsized":"2023-08-31T19:03:28.519518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302124,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069716,"statfs":{"total":96636764160,"available":96327389184,"internally_reserved":0,"allocated":954368,"data_stored":481661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.56899999999999995,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.0489999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.53400000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0169999999999999},"last":0.80800000000000005}]},{"osd":1,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67500000000000004,"15min":0.69999999999999996},"min":{"1min":0.48099999999999998,"5min":0.40699999999999997,"15min":0.40000000000000002},"max":{"1min":0.83399999999999996,"5min":0.93000000000000005,"15min":0.97299999999999998},"last":0.748},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.53600000000000003,"5min":0.40500000000000003,"15min":0.36199999999999999},"max":{"1min":0.85899999999999999,"5min":0.93100000000000005,"15min":0.96799999999999997},"last":0.62}]},{"osd":2,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.94199999999999995,"5min":0.97799999999999998,"15min":1.093},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.57599999999999996,"5min":0.49399999999999999,"15min":0.41199999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":1.054},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.51200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.83799999999999997,"5min":1.0229999999999999,"15min":1.1160000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.58899999999999997,"5min":0.52200000000000002,"15min":0.495},"max":{"1min":0.95799999999999996,"5min":0.96399999999999997,"15min":1.0860000000000001},"last":0.85999999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":0.83799999999999997,"15min":0.97899999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97199999999999998,"5min":0.98499999999999999,"15min":1.163},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.41099999999999998,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":1.139,"15min":1.139},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.38500000000000001},"max":{"1min":0.93899999999999995,"5min":0.97699999999999998,"15min":1.353},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.67600000000000005},"min":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.41399999999999998},"max":{"1min":0.88700000000000001,"5min":0.93100000000000005,"15min":1.3999999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68899999999999995,"15min":0.69799999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.91900000000000004,"5min":1.038,"15min":1.462},"last":0.77900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302116,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069724,"statfs":{"total":96636764160,"available":96327397376,"internally_reserved":0,"allocated":946176,"data_stored":480679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68700000000000006,"15min":0.70699999999999996},"min":{"1min":0.65100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90200000000000002,"5min":0.92000000000000004,"15min":1.0189999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68600000000000005,"15min":0.70199999999999996},"min":{"1min":0.57199999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":0.90900000000000003,"15min":0.94499999999999995},"last":0.57199999999999995}]},{"osd":1,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67800000000000005,"15min":0.70099999999999996},"min":{"1min":0.52400000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91100000000000003,"5min":0.92100000000000004,"15min":1.0049999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.54800000000000004,"5min":0.435,"15min":0.435},"max":{"1min":0.86799999999999999,"5min":0.91400000000000003,"15min":0.95999999999999996},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.42099999999999999},"max":{"1min":0.91100000000000003,"5min":0.94999999999999996,"15min":1.129},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.62,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94899999999999995,"5min":0.98899999999999999,"15min":1.3260000000000001},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.60499999999999998,"5min":0.51000000000000001,"15min":0.47499999999999998},"max":{"1min":0.89200000000000002,"5min":0.93200000000000005,"15min":1.0860000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.73499999999999999,"15min":0.75},"min":{"1min":0.63600000000000001,"5min":0.53300000000000003,"15min":0.49399999999999999},"max":{"1min":0.91900000000000004,"5min":0.94799999999999995,"15min":1.052},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.61899999999999999},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.40999999999999998},"max":{"1min":0.88400000000000001,"5min":0.94299999999999995,"15min":0.97799999999999998},"last":0.63},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.63600000000000001},"min":{"1min":0.47599999999999998,"5min":0.39000000000000001,"15min":0.371},"max":{"1min":0.89400000000000002,"5min":1.0880000000000001,"15min":1.091},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.66700000000000004},"min":{"1min":0.5,"5min":0.44400000000000001,"15min":0.39800000000000002},"max":{"1min":0.82999999999999996,"5min":0.96699999999999997,"15min":1.1000000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.55900000000000005,"5min":0.435,"15min":0.435},"max":{"1min":0.80500000000000005,"5min":1.0669999999999999,"15min":1.0700000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54800000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84899999999999998,"5min":1.012,"15min":1.0620000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.54400000000000004,"5min":0.47899999999999998,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":1.0800000000000001,"15min":1.1040000000000001},"last":0.623}]}]},{"osd":1,"up_from":13,"seq":55834575038,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302128,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069712,"statfs":{"total":96636764160,"available":96327385088,"internally_reserved":0,"allocated":958464,"data_stored":481401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.433,"15min":0.443},"min":{"1min":0.28000000000000003,"5min":0.27300000000000002,"15min":0.23300000000000001},"max":{"1min":0.57799999999999996,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.254},"max":{"1min":0.66600000000000004,"5min":0.752,"15min":0.752},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.29099999999999998,"15min":0.28899999999999998},"max":{"1min":0.63900000000000001,"5min":0.78000000000000003,"15min":0.82699999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.754,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.45200000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79000000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.495,"15min":0.51000000000000001},"min":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.32500000000000001},"max":{"1min":0.65000000000000002,"5min":0.67300000000000004,"15min":1.673},"last":0.438}]},{"osd":4,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76300000000000001,"15min":0.78400000000000003},"min":{"1min":0.61199999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96899999999999997,"5min":1.2110000000000001,"15min":1.4119999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80000000000000004,"15min":0.81100000000000005},"min":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.49099999999999999},"max":{"1min":1.111,"5min":1.1799999999999999,"15min":1.3},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.73599999999999999,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.497,"15min":0.46800000000000003},"max":{"1min":0.99299999999999999,"5min":1.052,"15min":1.8540000000000001},"last":0.62},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.54500000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0720000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.751}]},{"osd":6,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51400000000000001},"max":{"1min":0.97299999999999998,"5min":1.1990000000000001,"15min":1.8979999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.56799999999999995,"5min":0.51500000000000001,"15min":0.48999999999999999},"max":{"1min":1.167,"5min":1.2,"15min":1.2629999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.47699999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.113},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.51400000000000001,"15min":0.504},"max":{"1min":1.0429999999999999,"5min":1.1399999999999999,"15min":2.0720000000000001},"last":0.74399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302112,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069728,"statfs":{"total":96636764160,"available":96327401472,"internally_reserved":0,"allocated":942080,"data_stored":480645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44500000000000001,"15min":0.44600000000000001},"min":{"1min":0.31900000000000001,"5min":0.29099999999999998,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.71499999999999997,"15min":0.78400000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.49299999999999999,"15min":0.49099999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.30399999999999999},"max":{"1min":0.72499999999999998,"5min":0.876,"15min":0.876},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.50600000000000001},"min":{"1min":0.41799999999999998,"5min":0.34499999999999997,"15min":0.32900000000000001},"max":{"1min":0.64900000000000002,"5min":0.67900000000000005,"15min":0.74299999999999999},"last":0.496},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53300000000000003,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.77000000000000002,"5min":1.018,"15min":1.018},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":0.67200000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.44400000000000001,"5min":0.39500000000000002,"15min":0.36599999999999999},"max":{"1min":0.71699999999999997,"5min":0.91400000000000003,"15min":1.0509999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.82699999999999996,"15min":0.82199999999999995},"min":{"1min":0.65000000000000002,"5min":0.55000000000000004,"15min":0.53900000000000003},"max":{"1min":1.103,"5min":1.2370000000000001,"15min":1.931},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.63600000000000001,"5min":0.55000000000000004,"15min":0.49399999999999999},"max":{"1min":1.095,"5min":1.1890000000000001,"15min":1.276},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.5,"15min":0.49399999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.3480000000000001},"last":0.873},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76700000000000002,"15min":0.77000000000000002},"min":{"1min":0.58499999999999996,"5min":0.53300000000000003,"15min":0.50700000000000001},"max":{"1min":1.0029999999999999,"5min":1.1950000000000001,"15min":1.9810000000000001},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81499999999999995,"15min":0.81000000000000005},"min":{"1min":0.61099999999999999,"5min":0.52700000000000002,"15min":0.46600000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.3280000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.53500000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.2350000000000001},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83299999999999996,"15min":0.82899999999999996},"min":{"1min":0.623,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1359999999999999,"5min":1.5820000000000001,"15min":2.1760000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.83899999999999997,"15min":0.83699999999999997},"min":{"1min":0.59999999999999998,"5min":0.57399999999999995,"15min":0.52200000000000002},"max":{"1min":1.127,"5min":1.548,"15min":1.548},"last":0.98599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575037,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":950272,"data_stored":481269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45700000000000002,"15min":0.44400000000000001},"min":{"1min":0.29199999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67700000000000005,"5min":0.77600000000000002,"15min":0.90200000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.314,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61299999999999999,"5min":0.70099999999999996,"15min":1.5900000000000001},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.50600000000000001},"min":{"1min":0.38,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67400000000000004,"5min":0.75700000000000001,"15min":0.96599999999999997},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.36499999999999999},"max":{"1min":0.70299999999999996,"5min":0.748,"15min":1.288},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33100000000000002},"max":{"1min":0.66500000000000004,"5min":0.70699999999999996,"15min":1.022},"last":0.376},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55700000000000005},"min":{"1min":0.44500000000000001,"5min":0.36399999999999999,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71599999999999997,"15min":0.97399999999999998},"last":0.442}]},{"osd":4,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.54600000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.173,"5min":1.173,"15min":1.208},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47699999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.464},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2,"5min":1.2,"15min":1.361},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77200000000000002,"15min":0.79300000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.03,"5min":1.1020000000000001,"15min":1.3},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79700000000000004,"15min":0.81100000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.501},"max":{"1min":1.238,"5min":1.238,"15min":1.51},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79300000000000004,"15min":0.80900000000000005},"min":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.48199999999999998},"max":{"1min":1,"5min":1.1579999999999999,"15min":1.4359999999999999},"last":0.77100000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80100000000000005,"15min":0.81699999999999995},"min":{"1min":0.61399999999999999,"5min":0.53700000000000003,"15min":0.51900000000000002},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.55},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80200000000000005,"15min":0.82299999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1160000000000001,"5min":1.1439999999999999,"15min":1.387},"last":0.69699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":950272,"data_stored":481269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.58599999999999997,"15min":0.48199999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55600000000000005,"5min":14.099,"15min":14.099},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.73199999999999998,"15min":0.55900000000000005},"min":{"1min":0.34399999999999997,"5min":0.313,"15min":0.29199999999999998},"max":{"1min":0.65400000000000003,"5min":24.879999999999999,"15min":24.879999999999999},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46500000000000002,"15min":0.45200000000000001},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.254},"max":{"1min":0.56299999999999994,"5min":0.79600000000000004,"15min":0.90700000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.63300000000000001,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.30199999999999999,"15min":0.28799999999999998},"max":{"1min":0.80700000000000005,"5min":14.143000000000001,"15min":14.143000000000001},"last":0.432}]},{"osd":2,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.46400000000000002,"5min":0.39600000000000002,"15min":0.33400000000000002},"max":{"1min":0.76200000000000001,"5min":0.94999999999999996,"15min":1.407},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.72399999999999998,"15min":0.65100000000000002},"min":{"1min":0.48699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70199999999999996,"5min":12.464,"15min":12.464},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.94999999999999996,"15min":0.81799999999999995},"min":{"1min":0.53500000000000003,"5min":0.47999999999999998,"15min":0.47299999999999998},"max":{"1min":1.2250000000000001,"5min":21.475999999999999,"15min":21.475999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77600000000000002,"15min":0.76300000000000001},"min":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.47299999999999998},"max":{"1min":1.0309999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.751,"15min":0.75800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.46600000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.3220000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.86699999999999999,"15min":0.80600000000000005},"min":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.173,"5min":12.509,"15min":12.509},"last":0.624}]},{"osd":6,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.89000000000000001,"15min":0.81899999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.52000000000000002},"max":{"1min":0.96799999999999997,"5min":12.426,"15min":12.426},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":1.022,"15min":0.85799999999999998},"min":{"1min":0.61899999999999999,"5min":0.53200000000000003,"15min":0.50600000000000001},"max":{"1min":1.2010000000000001,"5min":24.920000000000002,"15min":24.920000000000002},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":1.006,"15min":0.85899999999999999},"min":{"1min":0.60099999999999998,"5min":0.51300000000000001,"15min":0.495},"max":{"1min":1.0680000000000001,"5min":21.521000000000001,"15min":21.521000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77900000000000003,"15min":0.78300000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.73499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":950272,"data_stored":481289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.72299999999999998},"min":{"1min":0.54100000000000004,"5min":0.42399999999999999,"15min":0.36799999999999999},"max":{"1min":0.88300000000000001,"5min":0.96499999999999997,"15min":9.6289999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69299999999999995,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.441,"15min":0.42099999999999999},"max":{"1min":0.85499999999999998,"5min":0.92900000000000005,"15min":3.403},"last":0.495}]},{"osd":1,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70499999999999996,"15min":0.74199999999999999},"min":{"1min":0.52100000000000002,"5min":0.44700000000000001,"15min":0.437},"max":{"1min":0.80400000000000005,"5min":0.97199999999999998,"15min":9.8399999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70899999999999996,"15min":0.746},"min":{"1min":0.57199999999999995,"5min":0.47899999999999998,"15min":0.44900000000000001},"max":{"1min":0.92500000000000004,"5min":1.0229999999999999,"15min":9.7569999999999997},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71199999999999997,"15min":0.745},"min":{"1min":0.58299999999999996,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":1.042,"15min":9.7840000000000007},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.76100000000000001},"min":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85099999999999998,"5min":0.98399999999999999,"15min":9.7200000000000006},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.56200000000000006,"5min":0.51100000000000001,"15min":0.48299999999999998},"max":{"1min":0.86899999999999999,"5min":1.01,"15min":5.133},"last":0.443},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74399999999999999,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.439,"15min":0.439},"max":{"1min":0.90900000000000003,"5min":1.012,"15min":12.589},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59199999999999997,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89300000000000002,"5min":1.0800000000000001,"15min":9.6780000000000008},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.441,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":1.0549999999999999,"15min":3.3610000000000002},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66000000000000003,"15min":0.68000000000000005},"min":{"1min":0.47099999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84999999999999998,"5min":1.163,"15min":9.4760000000000009},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69499999999999995,"15min":0.72199999999999998},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":0.93600000000000005,"5min":1.133,"15min":9.8640000000000008},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69699999999999995,"15min":0.70999999999999996},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.98999999999999999,"5min":1.147,"15min":7.1769999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.45200000000000001},"max":{"1min":0.91700000000000004,"5min":1.0980000000000001,"15min":12.634},"last":0.625}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302120,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069720,"statfs":{"total":96636764160,"available":96327393280,"internally_reserved":0,"allocated":950272,"data_stored":481559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73899999999999999,"15min":0.72599999999999998},"min":{"1min":0.50700000000000001,"5min":0.47199999999999998,"15min":0.40899999999999997},"max":{"1min":0.93799999999999994,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.75700000000000001,"15min":0.72599999999999998},"min":{"1min":0.56799999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94899999999999995,"5min":3.548,"15min":3.548},"last":0.57199999999999995}]},{"osd":1,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.86299999999999999,"15min":0.76800000000000002},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0149999999999999,"5min":16.744,"15min":16.744},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76000000000000001,"15min":0.74199999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.46300000000000002},"max":{"1min":0.91700000000000004,"5min":3.6299999999999999,"15min":3.6299999999999999},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.71699999999999997},"min":{"1min":0.56100000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0289999999999999,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":0.624},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76700000000000002,"15min":0.75800000000000001},"min":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.45200000000000001},"max":{"1min":0.98399999999999999,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":0.77500000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.54400000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.996,"5min":1.327,"15min":2.0070000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.73399999999999999},"min":{"1min":0.53500000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96799999999999997,"5min":2.823,"15min":2.823},"last":0.751}]},{"osd":4,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67500000000000004,"15min":0.65000000000000002},"min":{"1min":0.47099999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72499999999999998,"5min":7.3739999999999997,"15min":7.3739999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":0.81799999999999995,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67300000000000004,"15min":0.65900000000000003},"min":{"1min":0.53500000000000003,"5min":0.45300000000000001,"15min":0.39100000000000001},"max":{"1min":0.91200000000000003,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76100000000000001,"15min":0.72399999999999998},"min":{"1min":0.57799999999999996,"5min":0.443,"15min":0.441},"max":{"1min":0.83999999999999997,"5min":7.4139999999999997,"15min":7.4139999999999997},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73999999999999999,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.46100000000000002},"max":{"1min":0.95099999999999996,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.73899999999999999,"15min":0.73199999999999998},"min":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.073,"5min":2.786,"15min":2.786},"last":0.80200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:03:33.697 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T19:03:33.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-31T19:03:33.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.925+0000 7f7f5c7ff700 1 Processor -- start 2023-08-31T19:03:33.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.926+0000 7f7f5c7ff700 1 -- start start 2023-08-31T19:03:33.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.927+0000 7f7f5c7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f540637c0 0x7f7f5415f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.927+0000 7f7f5c7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f540bfd40 con 0x7f7f54153e30 2023-08-31T19:03:33.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.927+0000 7f7f5c7ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f540c6730 con 0x7f7f54154210 2023-08-31T19:03:33.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.927+0000 7f7f5c7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f541546c0 con 0x7f7f540637c0 2023-08-31T19:03:33.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.927+0000 7f7f5a59b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7f54153e30 0x7f7f540c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50048/0 (socket says 172.21.15.72:50048) 2023-08-31T19:03:33.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.927+0000 7f7f5a59b700 1 -- 172.21.15.72:0/1053457222 learned_addr learned my addr 172.21.15.72:0/1053457222 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:33.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59599700 1 -- 172.21.15.72:0/1053457222 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983200430 0 0) 0x7f7f540bfd40 con 0x7f7f54153e30 2023-08-31T19:03:33.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59599700 1 -- 172.21.15.72:0/1053457222 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f400033f0 con 0x7f7f54153e30 2023-08-31T19:03:33.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f5ad9c700 1 --2- 172.21.15.72:0/1053457222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f540637c0 0x7f7f5415f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59599700 1 -- 172.21.15.72:0/1053457222 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3193359464 0 0) 0x7f7f400033f0 con 0x7f7f54153e30 2023-08-31T19:03:33.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59599700 1 -- 172.21.15.72:0/1053457222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f540637c0 msgr2=0x7f7f5415f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:33.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59599700 1 --2- 172.21.15.72:0/1053457222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f540637c0 0x7f7f5415f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59599700 1 -- 172.21.15.72:0/1053457222 >> v1:172.21.15.146:6789/0 conn(0x7f7f54154210 legacy=0x7f7f540630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59599700 1 -- 172.21.15.72:0/1053457222 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f540bffe0 con 0x7f7f54153e30 2023-08-31T19:03:33.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59599700 1 -- 172.21.15.72:0/1053457222 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f7f50001470 con 0x7f7f54153e30 2023-08-31T19:03:33.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59599700 1 -- 172.21.15.72:0/1053457222 >> v1:172.21.15.72:6789/0 conn(0x7f7f54153e30 legacy=0x7f7f540c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59599700 1 --2- 172.21.15.72:0/1053457222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f40003910 0x7f7f40003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59599700 1 --2- 172.21.15.72:0/1053457222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f40004690 0x7f7f40004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59599700 1 --2- 172.21.15.72:0/1053457222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f540637c0 0x7f7f400050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59599700 1 -- 172.21.15.72:0/1053457222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4000b990 con 0x7f7f40004690 2023-08-31T19:03:33.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59599700 1 -- 172.21.15.72:0/1053457222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4000bb00 con 0x7f7f40003910 2023-08-31T19:03:33.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59599700 1 -- 172.21.15.72:0/1053457222 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4000bcc0 con 0x7f7f540637c0 2023-08-31T19:03:33.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f59d9a700 1 --2- 172.21.15.72:0/1053457222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f40004690 0x7f7f40004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.928+0000 7f7f5a59b700 1 --2- 172.21.15.72:0/1053457222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f40003910 0x7f7f40003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.929+0000 7f7f5ad9c700 1 --2- 172.21.15.72:0/1053457222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f540637c0 0x7f7f400050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.929+0000 7f7f59d9a700 1 -- 172.21.15.72:0/1053457222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f540637c0 msgr2=0x7f7f400050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:33.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.929+0000 7f7f59d9a700 1 --2- 172.21.15.72:0/1053457222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f540637c0 0x7f7f400050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.929+0000 7f7f59d9a700 1 -- 172.21.15.72:0/1053457222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f40003910 msgr2=0x7f7f40003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:33.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.929+0000 7f7f59d9a700 1 --2- 172.21.15.72:0/1053457222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f40003910 0x7f7f40003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.929+0000 7f7f59d9a700 1 -- 172.21.15.72:0/1053457222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f400033f0 con 0x7f7f40004690 2023-08-31T19:03:33.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.929+0000 7f7f59d9a700 1 --2- 172.21.15.72:0/1053457222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f40004690 0x7f7f40004b10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f7f44001730 tx=0x7f7f44007bb0).ready entity=mon.0 client_cookie=d5bb75a7b568664a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:33.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.929+0000 7f7f59599700 1 -- 172.21.15.72:0/1053457222 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f44007020 con 0x7f7f40004690 2023-08-31T19:03:33.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.929+0000 7f7f59599700 1 -- 172.21.15.72:0/1053457222 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f44007180 con 0x7f7f40004690 2023-08-31T19:03:33.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.929+0000 7f7f59599700 1 -- 172.21.15.72:0/1053457222 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f44007500 con 0x7f7f40004690 2023-08-31T19:03:33.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.930+0000 7f7f5c7ff700 1 -- 172.21.15.72:0/1053457222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f40004690 msgr2=0x7f7f40004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.930+0000 7f7f5c7ff700 1 --2- 172.21.15.72:0/1053457222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f40004690 0x7f7f40004b10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f7f44001730 tx=0x7f7f44007bb0).stop 2023-08-31T19:03:33.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.930+0000 7f7f5ad9c700 1 -- 172.21.15.72:0/1053457222 reap_dead start 2023-08-31T19:03:33.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.930+0000 7f7f5c7ff700 1 -- 172.21.15.72:0/1053457222 shutdown_connections 2023-08-31T19:03:33.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.930+0000 7f7f5c7ff700 1 -- 172.21.15.72:0/1053457222 >> 172.21.15.72:0/1053457222 conn(0x7f7f5405eb20 msgr2=0x7f7f540cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:33.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.930+0000 7f7f5c7ff700 1 -- 172.21.15.72:0/1053457222 shutdown_connections 2023-08-31T19:03:33.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.930+0000 7f7f5c7ff700 1 -- 172.21.15.72:0/1053457222 wait complete. 2023-08-31T19:03:33.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.931+0000 7f7f5c7ff700 1 Processor -- start 2023-08-31T19:03:33.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.931+0000 7f7f5c7ff700 1 -- start start 2023-08-31T19:03:33.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.932+0000 7f7f5c7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f40004690 0x7f7f5414f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.932+0000 7f7f5c7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540a94b0 0x7f7f540af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.932+0000 7f7f5c7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f541672d0 0x7f7f54167750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.932+0000 7f7f5c7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f540aec80 con 0x7f7f541672d0 2023-08-31T19:03:33.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.932+0000 7f7f5c7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f54167c40 con 0x7f7f540a94b0 2023-08-31T19:03:33.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.932+0000 7f7f5c7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f540add90 con 0x7f7f40004690 2023-08-31T19:03:33.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f5ad9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f541672d0 0x7f7f54167750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f5ad9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f541672d0 0x7f7f54167750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59496/0 (socket says 172.21.15.72:59496) 2023-08-31T19:03:33.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f5ad9c700 1 -- 172.21.15.72:0/500368147 learned_addr learned my addr 172.21.15.72:0/500368147 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:33.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f59d9a700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540a94b0 0x7f7f540af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f5a59b700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f40004690 0x7f7f5414f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f5ad9c700 1 -- 172.21.15.72:0/500368147 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f40004690 msgr2=0x7f7f5414f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f5ad9c700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f40004690 0x7f7f5414f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f5ad9c700 1 -- 172.21.15.72:0/500368147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540a94b0 msgr2=0x7f7f540af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:33.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f5ad9c700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540a94b0 0x7f7f540af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:33.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f5ad9c700 1 -- 172.21.15.72:0/500368147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f540ae070 con 0x7f7f541672d0 2023-08-31T19:03:33.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f5a59b700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f40004690 0x7f7f5414f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:33.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f59d9a700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540a94b0 0x7f7f540af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:33.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f5ad9c700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f541672d0 0x7f7f54167750 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f7f540843c0 tx=0x7f7f4c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:33.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f4a7fc700 1 -- 172.21.15.72:0/500368147 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c00e070 con 0x7f7f541672d0 2023-08-31T19:03:33.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f4a7fc700 1 -- 172.21.15.72:0/500368147 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c011c60 con 0x7f7f541672d0 2023-08-31T19:03:33.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f4a7fc700 1 -- 172.21.15.72:0/500368147 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c016450 con 0x7f7f541672d0 2023-08-31T19:03:33.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.933+0000 7f7f5c7ff700 1 -- 172.21.15.72:0/500368147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f540ae350 con 0x7f7f541672d0 2023-08-31T19:03:33.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.934+0000 7f7f5c7ff700 1 -- 172.21.15.72:0/500368147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f540ae910 con 0x7f7f541672d0 2023-08-31T19:03:33.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.935+0000 7f7f5c7ff700 1 -- 172.21.15.72:0/500368147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5406c6b0 con 0x7f7f541672d0 2023-08-31T19:03:33.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.935+0000 7f7f4a7fc700 1 -- 172.21.15.72:0/500368147 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7f4c01f3b0 con 0x7f7f541672d0 2023-08-31T19:03:33.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.936+0000 7f7f4a7fc700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f3805ef30 0x7f7f380613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:33.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.936+0000 7f7f4a7fc700 1 -- 172.21.15.72:0/500368147 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f7f4c07a860 con 0x7f7f541672d0 2023-08-31T19:03:33.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.936+0000 7f7f5a59b700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f3805ef30 0x7f7f380613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:33.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.937+0000 7f7f5a59b700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f3805ef30 0x7f7f380613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7f50007d20 tx=0x7f7f50009040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:33.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:33.940+0000 7f7f4a7fc700 1 -- 172.21.15.72:0/500368147 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f4c04b7d0 con 0x7f7f541672d0 2023-08-31T19:03:34.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.176+0000 7f7f5c7ff700 1 -- 172.21.15.72:0/500368147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7f54062970 con 0x7f7f541672d0 2023-08-31T19:03:34.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.180+0000 7f7f4a7fc700 1 -- 172.21.15.72:0/500368147 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7f4c04edf0 con 0x7f7f541672d0 2023-08-31T19:03:34.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.182+0000 7f7f5c7ff700 1 -- 172.21.15.72:0/500368147 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f3805ef30 msgr2=0x7f7f380613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:34.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.182+0000 7f7f5c7ff700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f3805ef30 0x7f7f380613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7f50007d20 tx=0x7f7f50009040).stop 2023-08-31T19:03:34.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.182+0000 7f7f5c7ff700 1 -- 172.21.15.72:0/500368147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f541672d0 msgr2=0x7f7f54167750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:34.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.183+0000 7f7f5c7ff700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f541672d0 0x7f7f54167750 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f7f540843c0 tx=0x7f7f4c00b040).stop 2023-08-31T19:03:34.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.183+0000 7f7f5c7ff700 1 -- 172.21.15.72:0/500368147 shutdown_connections 2023-08-31T19:03:34.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.183+0000 7f7f5c7ff700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f541672d0 0x7f7f54167750 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:34.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.183+0000 7f7f5c7ff700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f40004690 0x7f7f5414f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:34.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.183+0000 7f7f5c7ff700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f3805ef30 0x7f7f380613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:34.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.183+0000 7f7f5c7ff700 1 --2- 172.21.15.72:0/500368147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f540a94b0 0x7f7f540af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:34.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.183+0000 7f7f5c7ff700 1 -- 172.21.15.72:0/500368147 >> 172.21.15.72:0/500368147 conn(0x7f7f5405eb20 msgr2=0x7f7f54062fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:34.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.183+0000 7f7f5c7ff700 1 -- 172.21.15.72:0/500368147 shutdown_connections 2023-08-31T19:03:34.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.183+0000 7f7f5c7ff700 1 -- 172.21.15.72:0/500368147 wait complete. 2023-08-31T19:03:34.186 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-08-31T19:03:34.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:03:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.388+0000 7efe793ff700 1 Processor -- start 2023-08-31T19:03:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.389+0000 7efe793ff700 1 -- start start 2023-08-31T19:03:34.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.390+0000 7efe793ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe740a4de0 0x7efe7415eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:34.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.390+0000 7efe793ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe740bcb50 con 0x7efe740a4a00 2023-08-31T19:03:34.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.390+0000 7efe793ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe740c27f0 con 0x7efe740bda40 2023-08-31T19:03:34.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.390+0000 7efe793ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe740a5230 con 0x7efe740a4de0 2023-08-31T19:03:34.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.390+0000 7efe72ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efe740a4a00 0x7efe74064ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50060/0 (socket says 172.21.15.72:50060) 2023-08-31T19:03:34.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.390+0000 7efe72ffd700 1 -- 172.21.15.72:0/2136551615 learned_addr learned my addr 172.21.15.72:0/2136551615 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:34.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.391+0000 7efe737fe700 1 --2- 172.21.15.72:0/2136551615 >> v2:172.21.15.146:3300/0 conn(0x7efe740a4de0 0x7efe7415eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:34.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.391+0000 7efe71ffb700 1 -- 172.21.15.72:0/2136551615 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978525672 0 0) 0x7efe740bcb50 con 0x7efe740a4a00 2023-08-31T19:03:34.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.391+0000 7efe71ffb700 1 -- 172.21.15.72:0/2136551615 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe5c0033f0 con 0x7efe740a4a00 2023-08-31T19:03:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.391+0000 7efe71ffb700 1 -- 172.21.15.72:0/2136551615 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135364041 0 0) 0x7efe740c27f0 con 0x7efe740bda40 2023-08-31T19:03:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.391+0000 7efe71ffb700 1 -- 172.21.15.72:0/2136551615 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe740bcb50 con 0x7efe740bda40 2023-08-31T19:03:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.391+0000 7efe71ffb700 1 -- 172.21.15.72:0/2136551615 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3213082712 0 0) 0x7efe5c0033f0 con 0x7efe740a4a00 2023-08-31T19:03:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.391+0000 7efe737fe700 1 -- 172.21.15.72:0/2136551615 >> v1:172.21.15.146:6789/0 conn(0x7efe740bda40 legacy=0x7efe741574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.391+0000 7efe737fe700 1 -- 172.21.15.72:0/2136551615 >> v1:172.21.15.72:6789/0 conn(0x7efe740a4a00 legacy=0x7efe74064ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.391+0000 7efe737fe700 1 -- 172.21.15.72:0/2136551615 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe740653b0 con 0x7efe740a4de0 2023-08-31T19:03:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.391+0000 7efe737fe700 1 --2- 172.21.15.72:0/2136551615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe740a4de0 0x7efe7415eff0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7efe6c009e60 tx=0x7efe6c009780).ready entity=mon.1 client_cookie=d32acaaaf0177f86 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.392+0000 7efe71ffb700 1 -- 172.21.15.72:0/2136551615 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00e070 con 0x7efe740a4de0 2023-08-31T19:03:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.392+0000 7efe71ffb700 1 -- 172.21.15.72:0/2136551615 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c00b7a0 con 0x7efe740a4de0 2023-08-31T19:03:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.392+0000 7efe71ffb700 1 -- 172.21.15.72:0/2136551615 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64001470 con 0x7efe740a4de0 2023-08-31T19:03:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.392+0000 7efe793ff700 1 -- 172.21.15.72:0/2136551615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe740a4de0 msgr2=0x7efe7415eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.392+0000 7efe793ff700 1 --2- 172.21.15.72:0/2136551615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe740a4de0 0x7efe7415eff0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7efe6c009e60 tx=0x7efe6c009780).stop 2023-08-31T19:03:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.392+0000 7efe793ff700 1 -- 172.21.15.72:0/2136551615 shutdown_connections 2023-08-31T19:03:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.392+0000 7efe793ff700 1 --2- 172.21.15.72:0/2136551615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe740a4de0 0x7efe7415eff0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:34.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.392+0000 7efe793ff700 1 -- 172.21.15.72:0/2136551615 >> 172.21.15.72:0/2136551615 conn(0x7efe74063120 msgr2=0x7efe740c6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:34.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.392+0000 7efe793ff700 1 -- 172.21.15.72:0/2136551615 shutdown_connections 2023-08-31T19:03:34.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.392+0000 7efe793ff700 1 -- 172.21.15.72:0/2136551615 wait complete. 2023-08-31T19:03:34.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.394+0000 7efe793ff700 1 Processor -- start 2023-08-31T19:03:34.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.394+0000 7efe793ff700 1 -- start start 2023-08-31T19:03:34.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe793ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe740a4a00 0x7efe74152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:34.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe793ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe740a4de0 0x7efe740ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:34.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe793ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe740bda40 0x7efe740c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:34.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe793ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe740a77e0 con 0x7efe740a4a00 2023-08-31T19:03:34.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe793ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe740abc60 con 0x7efe740a4de0 2023-08-31T19:03:34.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe793ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe740abf40 con 0x7efe740bda40 2023-08-31T19:03:34.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe72ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe740a4a00 0x7efe74152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:34.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe72ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe740a4a00 0x7efe74152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59512/0 (socket says 172.21.15.72:59512) 2023-08-31T19:03:34.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe72ffd700 1 -- 172.21.15.72:0/320310783 learned_addr learned my addr 172.21.15.72:0/320310783 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:34.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe727fc700 1 --2- 172.21.15.72:0/320310783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe740a4de0 0x7efe740ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:34.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe737fe700 1 --2- 172.21.15.72:0/320310783 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe740bda40 0x7efe740c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:34.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe72ffd700 1 -- 172.21.15.72:0/320310783 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe740bda40 msgr2=0x7efe740c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:34.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe72ffd700 1 --2- 172.21.15.72:0/320310783 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe740bda40 0x7efe740c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:34.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe72ffd700 1 -- 172.21.15.72:0/320310783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe740a4de0 msgr2=0x7efe740ab2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:34.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe72ffd700 1 --2- 172.21.15.72:0/320310783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe740a4de0 0x7efe740ab2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:34.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.395+0000 7efe72ffd700 1 -- 172.21.15.72:0/320310783 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c009a20 con 0x7efe740a4a00 2023-08-31T19:03:34.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.396+0000 7efe72ffd700 1 --2- 172.21.15.72:0/320310783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe740a4a00 0x7efe74152440 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7efe6400c760 tx=0x7efe64001b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:34.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.396+0000 7efe5affd700 1 -- 172.21.15.72:0/320310783 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64007170 con 0x7efe740a4a00 2023-08-31T19:03:34.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.396+0000 7efe5affd700 1 -- 172.21.15.72:0/320310783 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe640072d0 con 0x7efe740a4a00 2023-08-31T19:03:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.396+0000 7efe793ff700 1 -- 172.21.15.72:0/320310783 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe740ac220 con 0x7efe740a4a00 2023-08-31T19:03:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.396+0000 7efe5affd700 1 -- 172.21.15.72:0/320310783 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe640048c0 con 0x7efe740a4a00 2023-08-31T19:03:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.396+0000 7efe793ff700 1 -- 172.21.15.72:0/320310783 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe74152930 con 0x7efe740a4a00 2023-08-31T19:03:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.397+0000 7efe793ff700 1 -- 172.21.15.72:0/320310783 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7406c6b0 con 0x7efe740a4a00 2023-08-31T19:03:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.398+0000 7efe5affd700 1 -- 172.21.15.72:0/320310783 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7efe64004c70 con 0x7efe740a4a00 2023-08-31T19:03:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.399+0000 7efe5affd700 1 --2- 172.21.15.72:0/320310783 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe6005ef30 0x7efe600613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:34.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.399+0000 7efe5affd700 1 -- 172.21.15.72:0/320310783 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7efe64079ec0 con 0x7efe740a4a00 2023-08-31T19:03:34.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.399+0000 7efe727fc700 1 --2- 172.21.15.72:0/320310783 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe6005ef30 0x7efe600613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:34.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.399+0000 7efe727fc700 1 --2- 172.21.15.72:0/320310783 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe6005ef30 0x7efe600613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7efe740acdf0 tx=0x7efe68007bd0).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:34.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.402+0000 7efe5affd700 1 -- 172.21.15.72:0/320310783 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efe6404ae90 con 0x7efe740a4a00 2023-08-31T19:03:34.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.617+0000 7efe793ff700 1 -- 172.21.15.72:0/320310783 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe740bbf40 con 0x7efe740a4a00 2023-08-31T19:03:34.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.617+0000 7efe5affd700 1 -- 172.21.15.72:0/320310783 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4496 (secure 0 0 0) 0x7efe6404e4b0 con 0x7efe740a4a00 2023-08-31T19:03:34.619 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:34.619 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5890,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1362322123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1362322123},{"type":"v1","addr":"172.21.15.146:6834","nonce":1362322123}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5893,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2001208412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2001208412},{"type":"v1","addr":"172.21.15.146:6835","nonce":2001208412}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3154756193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3154756193},{"type":"v1","addr":"172.21.15.72:6835","nonce":3154756193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:03:28.969345+0000","modified":"2023-08-31T19:03:31.984576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6252},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6252":{"gid":6252,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/2633506693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2633506693},{"type":"v1","addr":"172.21.15.72:6837","nonce":2633506693}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-31T19:03:34.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.619+0000 7efe793ff700 1 -- 172.21.15.72:0/320310783 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe6005ef30 msgr2=0x7efe600613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:34.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.619+0000 7efe793ff700 1 --2- 172.21.15.72:0/320310783 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe6005ef30 0x7efe600613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7efe740acdf0 tx=0x7efe68007bd0).stop 2023-08-31T19:03:34.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.619+0000 7efe793ff700 1 -- 172.21.15.72:0/320310783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe740a4a00 msgr2=0x7efe74152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:34.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.619+0000 7efe793ff700 1 --2- 172.21.15.72:0/320310783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe740a4a00 0x7efe74152440 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7efe6400c760 tx=0x7efe64001b00).stop 2023-08-31T19:03:34.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.619+0000 7efe793ff700 1 -- 172.21.15.72:0/320310783 shutdown_connections 2023-08-31T19:03:34.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.620+0000 7efe793ff700 1 --2- 172.21.15.72:0/320310783 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efe740bda40 0x7efe740c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:34.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.620+0000 7efe793ff700 1 --2- 172.21.15.72:0/320310783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe740a4a00 0x7efe74152440 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:34.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.620+0000 7efe793ff700 1 --2- 172.21.15.72:0/320310783 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe6005ef30 0x7efe600613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:34.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.620+0000 7efe793ff700 1 --2- 172.21.15.72:0/320310783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe740a4de0 0x7efe740ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:34.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.620+0000 7efe793ff700 1 -- 172.21.15.72:0/320310783 >> 172.21.15.72:0/320310783 conn(0x7efe74063120 msgr2=0x7efe74068d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:34.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.620+0000 7efe793ff700 1 -- 172.21.15.72:0/320310783 shutdown_connections 2023-08-31T19:03:34.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:34.620+0000 7efe793ff700 1 -- 172.21.15.72:0/320310783 wait complete. 2023-08-31T19:03:34.623 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 32 2023-08-31T19:03:35.040 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T19:03:28.969345+0000', 'modified': '2023-08-31T19:03:31.984576+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6252}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6252': {'gid': 6252, 'name': 'a', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6837/2633506693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6836', 'nonce': 2633506693}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 2633506693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-31T19:03:35.040 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T19:03:35.041 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-31T19:03:35.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.231+0000 7f05c43ff700 1 Processor -- start 2023-08-31T19:03:35.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.231+0000 7f05c43ff700 1 -- start start 2023-08-31T19:03:35.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.232+0000 7f05c43ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05bc1613d0 0x7f05bc082990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.232+0000 7f05c43ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f05bc0bba90 0x7f05bc0bbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.233+0000 7f05c43ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05bc0bc410 con 0x7f05bc160ff0 2023-08-31T19:03:35.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.233+0000 7f05c43ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc065dd0 con 0x7f05bc0bba90 2023-08-31T19:03:35.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.233+0000 7f05c43ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc065530 con 0x7f05bc1613d0 2023-08-31T19:03:35.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.233+0000 7f05c219b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f05bc160ff0 0x7f05bc064d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50064/0 (socket says 172.21.15.72:50064) 2023-08-31T19:03:35.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.233+0000 7f05c219b700 1 -- 172.21.15.72:0/642359796 learned_addr learned my addr 172.21.15.72:0/642359796 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:35.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.233+0000 7f05c1199700 1 -- 172.21.15.72:0/642359796 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297983757 0 0) 0x7f05bc0bc410 con 0x7f05bc160ff0 2023-08-31T19:03:35.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.233+0000 7f05c199a700 1 --2- 172.21.15.72:0/642359796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05bc1613d0 0x7f05bc082990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.233+0000 7f05c299c700 1 --2- 172.21.15.72:0/642359796 >> v2:172.21.15.146:3300/0 conn(0x7f05bc0bba90 0x7f05bc0bbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.233+0000 7f05c1199700 1 -- 172.21.15.72:0/642359796 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05a80033f0 con 0x7f05bc160ff0 2023-08-31T19:03:35.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.314+0000 7f05c1199700 1 -- 172.21.15.72:0/642359796 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1244541898 0 0) 0x7f05a80033f0 con 0x7f05bc160ff0 2023-08-31T19:03:35.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.314+0000 7f05c1199700 1 -- 172.21.15.72:0/642359796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05bc1613d0 msgr2=0x7f05bc082990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:35.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.314+0000 7f05c1199700 1 --2- 172.21.15.72:0/642359796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05bc1613d0 0x7f05bc082990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.314+0000 7f05c1199700 1 -- 172.21.15.72:0/642359796 >> v2:172.21.15.146:3300/0 conn(0x7f05bc0bba90 msgr2=0x7f05bc0bbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:35.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.314+0000 7f05c1199700 1 --2- 172.21.15.72:0/642359796 >> v2:172.21.15.146:3300/0 conn(0x7f05bc0bba90 0x7f05bc0bbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.314+0000 7f05c1199700 1 -- 172.21.15.72:0/642359796 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc065810 con 0x7f05bc160ff0 2023-08-31T19:03:35.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.314+0000 7f05c1199700 1 -- 172.21.15.72:0/642359796 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f05b8001470 con 0x7f05bc160ff0 2023-08-31T19:03:35.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.314+0000 7f05c1199700 1 -- 172.21.15.72:0/642359796 >> v1:172.21.15.72:6789/0 conn(0x7f05bc160ff0 legacy=0x7f05bc064d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.314+0000 7f05c1199700 1 --2- 172.21.15.72:0/642359796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a80038e0 0x7f05a8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.314+0000 7f05c1199700 1 --2- 172.21.15.72:0/642359796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05a8004690 0x7f05a8004ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.314+0000 7f05c1199700 1 --2- 172.21.15.72:0/642359796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05a8004fc0 0x7f05a800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.314+0000 7f05c1199700 1 -- 172.21.15.72:0/642359796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc065dd0 con 0x7f05a80038e0 2023-08-31T19:03:35.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.314+0000 7f05c1199700 1 -- 172.21.15.72:0/642359796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc065530 con 0x7f05a8004fc0 2023-08-31T19:03:35.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.314+0000 7f05c1199700 1 -- 172.21.15.72:0/642359796 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a800bdd0 con 0x7f05a8004690 2023-08-31T19:03:35.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.315+0000 7f05c219b700 1 --2- 172.21.15.72:0/642359796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a80038e0 0x7f05a8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.315+0000 7f05c199a700 1 --2- 172.21.15.72:0/642359796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05a8004690 0x7f05a8004ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.315+0000 7f05c299c700 1 --2- 172.21.15.72:0/642359796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05a8004fc0 0x7f05a800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.315+0000 7f05c219b700 1 -- 172.21.15.72:0/642359796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05a8004690 msgr2=0x7f05a8004ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:35.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.315+0000 7f05c219b700 1 --2- 172.21.15.72:0/642359796 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05a8004690 0x7f05a8004ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.315+0000 7f05c219b700 1 -- 172.21.15.72:0/642359796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05a8004fc0 msgr2=0x7f05a800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:35.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.315+0000 7f05c219b700 1 --2- 172.21.15.72:0/642359796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05a8004fc0 0x7f05a800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.315+0000 7f05c219b700 1 -- 172.21.15.72:0/642359796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a80033f0 con 0x7f05a80038e0 2023-08-31T19:03:35.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.315+0000 7f05c299c700 1 --2- 172.21.15.72:0/642359796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05a8004fc0 0x7f05a800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:35.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.315+0000 7f05c219b700 1 --2- 172.21.15.72:0/642359796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a80038e0 0x7f05a8003d00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f05b800c210 tx=0x7f05b8001e90).ready entity=mon.0 client_cookie=cab5fc7838cfc31b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:35.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.316+0000 7f05c1199700 1 -- 172.21.15.72:0/642359796 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8007a60 con 0x7f05a80038e0 2023-08-31T19:03:35.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.316+0000 7f05c1199700 1 -- 172.21.15.72:0/642359796 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b800cae0 con 0x7f05a80038e0 2023-08-31T19:03:35.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.316+0000 7f05c1199700 1 -- 172.21.15.72:0/642359796 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b800cea0 con 0x7f05a80038e0 2023-08-31T19:03:35.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.316+0000 7f05c43ff700 1 -- 172.21.15.72:0/642359796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a80038e0 msgr2=0x7f05a8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.316+0000 7f05c43ff700 1 --2- 172.21.15.72:0/642359796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05a80038e0 0x7f05a8003d00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f05b800c210 tx=0x7f05b8001e90).stop 2023-08-31T19:03:35.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.316+0000 7f05c299c700 1 -- 172.21.15.72:0/642359796 reap_dead start 2023-08-31T19:03:35.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.316+0000 7f05c43ff700 1 -- 172.21.15.72:0/642359796 shutdown_connections 2023-08-31T19:03:35.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.316+0000 7f05c43ff700 1 -- 172.21.15.72:0/642359796 >> 172.21.15.72:0/642359796 conn(0x7f05bc063150 msgr2=0x7f05bc0c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:35.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.316+0000 7f05c43ff700 1 -- 172.21.15.72:0/642359796 shutdown_connections 2023-08-31T19:03:35.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.316+0000 7f05c43ff700 1 -- 172.21.15.72:0/642359796 wait complete. 2023-08-31T19:03:35.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.318+0000 7f05c43ff700 1 Processor -- start 2023-08-31T19:03:35.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.318+0000 7f05c43ff700 1 -- start start 2023-08-31T19:03:35.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.319+0000 7f05c43ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05a80038e0 0x7f05bc15c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.319+0000 7f05c43ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0a86d0 0x7f05bc0a8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.319+0000 7f05c43ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05bc0abd20 0x7f05bc0ac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.319+0000 7f05c43ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0a9040 con 0x7f05bc0abd20 2023-08-31T19:03:35.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.319+0000 7f05c43ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0bf620 con 0x7f05bc0a86d0 2023-08-31T19:03:35.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.319+0000 7f05c43ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc15cc10 con 0x7f05a80038e0 2023-08-31T19:03:35.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.319+0000 7f05c299c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05bc0abd20 0x7f05bc0ac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.319+0000 7f05c299c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05bc0abd20 0x7f05bc0ac1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59516/0 (socket says 172.21.15.72:59516) 2023-08-31T19:03:35.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.319+0000 7f05c299c700 1 -- 172.21.15.72:0/1859958125 learned_addr learned my addr 172.21.15.72:0/1859958125 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.319+0000 7f05c219b700 1 --2- 172.21.15.72:0/1859958125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05a80038e0 0x7f05bc15c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.319+0000 7f05c199a700 1 --2- 172.21.15.72:0/1859958125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0a86d0 0x7f05bc0a8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.320+0000 7f05c299c700 1 -- 172.21.15.72:0/1859958125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05a80038e0 msgr2=0x7f05bc15c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.320+0000 7f05c299c700 1 --2- 172.21.15.72:0/1859958125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05a80038e0 0x7f05bc15c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.320+0000 7f05c299c700 1 -- 172.21.15.72:0/1859958125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0a86d0 msgr2=0x7f05bc0a8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.320+0000 7f05c299c700 1 --2- 172.21.15.72:0/1859958125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0a86d0 0x7f05bc0a8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.320+0000 7f05c299c700 1 -- 172.21.15.72:0/1859958125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc0be770 con 0x7f05bc0abd20 2023-08-31T19:03:35.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.320+0000 7f05c219b700 1 --2- 172.21.15.72:0/1859958125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05a80038e0 0x7f05bc15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:35.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.320+0000 7f05c299c700 1 --2- 172.21.15.72:0/1859958125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05bc0abd20 0x7f05bc0ac1a0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f05bc0c12c0 tx=0x7f05b400d040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:35.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.320+0000 7f05b27fc700 1 -- 172.21.15.72:0/1859958125 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4013be0 con 0x7f05bc0abd20 2023-08-31T19:03:35.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.320+0000 7f05b27fc700 1 -- 172.21.15.72:0/1859958125 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b4013d40 con 0x7f05bc0abd20 2023-08-31T19:03:35.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.320+0000 7f05c43ff700 1 -- 172.21.15.72:0/1859958125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05bc0bea10 con 0x7f05bc0abd20 2023-08-31T19:03:35.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.320+0000 7f05b27fc700 1 -- 172.21.15.72:0/1859958125 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40196a0 con 0x7f05bc0abd20 2023-08-31T19:03:35.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.320+0000 7f05c43ff700 1 -- 172.21.15.72:0/1859958125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05bc0befd0 con 0x7f05bc0abd20 2023-08-31T19:03:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.322+0000 7f05b27fc700 1 -- 172.21.15.72:0/1859958125 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f05b40183d0 con 0x7f05bc0abd20 2023-08-31T19:03:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.323+0000 7f05b27fc700 1 --2- 172.21.15.72:0/1859958125 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f05a005ef60 0x7f05a0061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.323+0000 7f05b27fc700 1 -- 172.21.15.72:0/1859958125 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f05b407e240 con 0x7f05bc0abd20 2023-08-31T19:03:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.323+0000 7f05c219b700 1 --2- 172.21.15.72:0/1859958125 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f05a005ef60 0x7f05a0061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.324+0000 7f05c219b700 1 --2- 172.21.15.72:0/1859958125 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f05a005ef60 0x7f05a0061420 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f05b8001ed0 tx=0x7f05b8015000).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.325+0000 7f05db770b80 1 Processor -- start 2023-08-31T19:03:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.325+0000 7f05db770b80 1 -- start start 2023-08-31T19:03:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.326+0000 7f05db770b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd52b2c0 0x558efd52b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.326+0000 7f05db770b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd573f60 0x558efd526600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.326+0000 7f05db770b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd526af0 0x558efd526f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.326+0000 7f05db770b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efd467db0 con 0x558efd526af0 2023-08-31T19:03:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.326+0000 7f05db770b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efd47d030 con 0x558efd52b2c0 2023-08-31T19:03:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.326+0000 7f05db770b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x558efd47d170 con 0x558efd573f60 2023-08-31T19:03:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.327+0000 7f05c299c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd526af0 0x558efd526f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.327+0000 7f05c299c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd526af0 0x558efd526f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59520/0 (socket says 172.21.15.72:59520) 2023-08-31T19:03:35.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.327+0000 7f05c299c700 1 -- 172.21.15.72:0/3044505450 learned_addr learned my addr 172.21.15.72:0/3044505450 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:35.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.327+0000 7f05c199a700 1 --2- 172.21.15.72:0/3044505450 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd573f60 0x558efd526600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.327+0000 7f05c219b700 1 --2- 172.21.15.72:0/3044505450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd52b2c0 0x558efd52b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.327+0000 7f05c299c700 1 -- 172.21.15.72:0/3044505450 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd573f60 msgr2=0x558efd526600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:35.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.327+0000 7f05c299c700 1 --2- 172.21.15.72:0/3044505450 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd573f60 0x558efd526600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.327+0000 7f05c299c700 1 -- 172.21.15.72:0/3044505450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd52b2c0 msgr2=0x558efd52b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:35.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.327+0000 7f05c299c700 1 --2- 172.21.15.72:0/3044505450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd52b2c0 0x558efd52b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.327+0000 7f05c299c700 1 -- 172.21.15.72:0/3044505450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558efd44fb00 con 0x558efd526af0 2023-08-31T19:03:35.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.328+0000 7f05c299c700 1 --2- 172.21.15.72:0/3044505450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd526af0 0x558efd526f70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f05b4002230 tx=0x7f05b4016000).ready entity=mon.0 client_cookie=93e2be2946dc97bc server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:35.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.328+0000 7f059f1fe700 1 -- 172.21.15.72:0/3044505450 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4052a60 con 0x558efd526af0 2023-08-31T19:03:35.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.328+0000 7f059f1fe700 1 -- 172.21.15.72:0/3044505450 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b4052880 con 0x558efd526af0 2023-08-31T19:03:35.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.328+0000 7f059f1fe700 1 -- 172.21.15.72:0/3044505450 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40585b0 con 0x558efd526af0 2023-08-31T19:03:35.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.328+0000 7f05db770b80 1 -- 172.21.15.72:0/3044505450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd526af0 msgr2=0x558efd526f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.328+0000 7f05db770b80 1 --2- 172.21.15.72:0/3044505450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd526af0 0x558efd526f70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f05b4002230 tx=0x7f05b4016000).stop 2023-08-31T19:03:35.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.329+0000 7f05db770b80 1 -- 172.21.15.72:0/3044505450 shutdown_connections 2023-08-31T19:03:35.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.329+0000 7f05db770b80 1 --2- 172.21.15.72:0/3044505450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd526af0 0x558efd526f70 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.329+0000 7f05db770b80 1 --2- 172.21.15.72:0/3044505450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd52b2c0 0x558efd52b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.329+0000 7f05db770b80 1 --2- 172.21.15.72:0/3044505450 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd573f60 0x558efd526600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.329+0000 7f05db770b80 1 -- 172.21.15.72:0/3044505450 >> 172.21.15.72:0/3044505450 conn(0x558efd395940 msgr2=0x558efd5743f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:35.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.329+0000 7f05db770b80 1 -- 172.21.15.72:0/3044505450 shutdown_connections 2023-08-31T19:03:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.329+0000 7f05db770b80 1 -- 172.21.15.72:0/3044505450 wait complete. 2023-08-31T19:03:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.329+0000 7f05db770b80 1 -- start start 2023-08-31T19:03:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.330+0000 7f05db770b80 1 Processor -- start 2023-08-31T19:03:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05db770b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd526af0 0x558efd53fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05db770b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd52b2c0 0x558efd556600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05db770b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd573f60 0x558efd526f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05db770b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efd47d3f0 con 0x558efd52b2c0 2023-08-31T19:03:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05db770b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efd448920 con 0x558efd526af0 2023-08-31T19:03:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05db770b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x558efd542110 con 0x558efd573f60 2023-08-31T19:03:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05db770b80 10 client.0 ll_register_callbacks cb 0x558efd41dce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:03:35.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05c199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd52b2c0 0x558efd556600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05c199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd52b2c0 0x558efd556600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59528/0 (socket says 172.21.15.72:59528) 2023-08-31T19:03:35.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05c199a700 1 -- 172.21.15.72:0/343868138 learned_addr learned my addr 172.21.15.72:0/343868138 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:35.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05c219b700 1 --2- 172.21.15.72:0/343868138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd526af0 0x558efd53fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05c299c700 1 --2- 172.21.15.72:0/343868138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd573f60 0x558efd526f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05c199a700 1 -- 172.21.15.72:0/343868138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd573f60 msgr2=0x558efd526f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:35.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05c199a700 1 --2- 172.21.15.72:0/343868138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd573f60 0x558efd526f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05c199a700 1 -- 172.21.15.72:0/343868138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd526af0 msgr2=0x558efd53fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:35.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05c199a700 1 --2- 172.21.15.72:0/343868138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd526af0 0x558efd53fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05c199a700 1 -- 172.21.15.72:0/343868138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05bc0befd0 con 0x558efd52b2c0 2023-08-31T19:03:35.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.331+0000 7f05c199a700 1 --2- 172.21.15.72:0/343868138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd52b2c0 0x558efd556600 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f05ac016de0 tx=0x7f05ac00d040).ready entity=mon.0 client_cookie=b915e2f8b37bd205 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:35.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.332+0000 7f059c9f9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:03:35.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.332+0000 7f059c9f9700 1 -- 172.21.15.72:0/343868138 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac010040 con 0x558efd52b2c0 2023-08-31T19:03:35.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.332+0000 7f059c9f9700 1 -- 172.21.15.72:0/343868138 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f05ac014a70 con 0x558efd52b2c0 2023-08-31T19:03:35.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.332+0000 7f05db770b80 1 -- 172.21.15.72:0/343868138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558efd525aa0 con 0x558efd52b2c0 2023-08-31T19:03:35.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.332+0000 7f059c9f9700 1 -- 172.21.15.72:0/343868138 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05ac014e40 con 0x558efd52b2c0 2023-08-31T19:03:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.332+0000 7f05db770b80 10 client.6390 fetch_fsmap learned FSMap version 32 2023-08-31T19:03:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.332+0000 7f05db770b80 1 -- 172.21.15.72:0/343868138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x558efd475f70 con 0x558efd52b2c0 2023-08-31T19:03:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.332+0000 7f059c9f9700 1 -- 172.21.15.72:0/343868138 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558efd525aa0 con 0x558efd52b2c0 2023-08-31T19:03:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.332+0000 7f059c9f9700 1 -- 172.21.15.72:0/343868138 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f05ac005880 con 0x558efd52b2c0 2023-08-31T19:03:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.332+0000 7f05db770b80 10 client.6390 fetch_fsmap finished waiting for FSMap version 32 2023-08-31T19:03:35.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.332+0000 7f05db770b80 10 client.6390 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:03:35.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.332+0000 7f05db770b80 20 client.6390 populate_metadata read hostname 'smithi072' 2023-08-31T19:03:35.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.332+0000 7f05db770b80 1 --2- 172.21.15.72:0/343868138 >> [v2:172.21.15.72:6836/2633506693,v1:172.21.15.72:6837/2633506693] conn(0x558efd56d7e0 0x558efd56dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.332+0000 7f05db770b80 4 client.6390 mds_command: new command op to 6252 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T19:03:35.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.332+0000 7f05db770b80 1 -- 172.21.15.72:0/343868138 --> [v2:172.21.15.72:6836/2633506693,v1:172.21.15.72:6837/2633506693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558efd2e5ef0 con 0x558efd56d7e0 2023-08-31T19:03:35.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.333+0000 7f05c219b700 1 --2- 172.21.15.72:0/343868138 >> [v2:172.21.15.72:6836/2633506693,v1:172.21.15.72:6837/2633506693] conn(0x558efd56d7e0 0x558efd56dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.333+0000 7f05c219b700 1 --2- 172.21.15.72:0/343868138 >> [v2:172.21.15.72:6836/2633506693,v1:172.21.15.72:6837/2633506693] conn(0x558efd56d7e0 0x558efd56dbc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d77395c9ed1317e1 server_cookie=839ad004c334c156 in_seq=0 out_seq=0 2023-08-31T19:03:35.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.333+0000 7f059c9f9700 10 client.6390 ms_handle_connect on v2:172.21.15.72:6836/2633506693 2023-08-31T19:03:35.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.334+0000 7f059c9f9700 1 -- 172.21.15.72:0/343868138 <== mds.0 v2:172.21.15.72:6836/2633506693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x558efd2e5ef0 con 0x558efd56d7e0 2023-08-31T19:03:35.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.334+0000 7f059c9f9700 10 client.6390 handle_command_reply: tid=0 2023-08-31T19:03:35.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.334+0000 7f05db770b80 1 client.6390 shutdown 2023-08-31T19:03:35.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.334+0000 7f05db770b80 1 -- 172.21.15.72:0/343868138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd52b2c0 msgr2=0x558efd556600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.334+0000 7f05db770b80 1 --2- 172.21.15.72:0/343868138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd52b2c0 0x558efd556600 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f05ac016de0 tx=0x7f05ac00d040).stop 2023-08-31T19:03:35.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.334+0000 7f05db770b80 1 -- 172.21.15.72:0/343868138 shutdown_connections 2023-08-31T19:03:35.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.334+0000 7f05db770b80 1 --2- 172.21.15.72:0/343868138 >> [v2:172.21.15.72:6836/2633506693,v1:172.21.15.72:6837/2633506693] conn(0x558efd56d7e0 0x558efd56dbc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.334+0000 7f05db770b80 1 --2- 172.21.15.72:0/343868138 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd573f60 0x558efd526f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.334+0000 7f05db770b80 1 --2- 172.21.15.72:0/343868138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd526af0 0x558efd53fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.334+0000 7f059c9f9700 0 client.6390 ms_handle_reset on v2:172.21.15.72:6836/2633506693 2023-08-31T19:03:35.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.334+0000 7f05db770b80 1 --2- 172.21.15.72:0/343868138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd52b2c0 0x558efd556600 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.334+0000 7f05db770b80 1 -- 172.21.15.72:0/343868138 >> 172.21.15.72:0/343868138 conn(0x558efd395940 msgr2=0x558efd559480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:35.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.334+0000 7f05db770b80 1 -- 172.21.15.72:0/343868138 shutdown_connections 2023-08-31T19:03:35.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.334+0000 7f05db770b80 1 -- 172.21.15.72:0/343868138 wait complete. 2023-08-31T19:03:35.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.335+0000 7f05db770b80 20 client.6390 trim_cache size 0 max 16384 2023-08-31T19:03:35.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.352+0000 7f05db770b80 1 Processor -- start 2023-08-31T19:03:35.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.352+0000 7f05db770b80 1 -- start start 2023-08-31T19:03:35.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05db770b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd526af0 0x558efd559390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05db770b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd52b2c0 0x558efd52bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05db770b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd573f60 0x558efd53ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05db770b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efd56c5a0 con 0x558efd526af0 2023-08-31T19:03:35.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05db770b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efd570940 con 0x558efd573f60 2023-08-31T19:03:35.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05db770b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x558efd53f720 con 0x558efd52b2c0 2023-08-31T19:03:35.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05c219b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd526af0 0x558efd559390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05c219b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd526af0 0x558efd559390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59534/0 (socket says 172.21.15.72:59534) 2023-08-31T19:03:35.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05c219b700 1 -- 172.21.15.72:0/1492255259 learned_addr learned my addr 172.21.15.72:0/1492255259 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:35.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05c199a700 1 --2- 172.21.15.72:0/1492255259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd52b2c0 0x558efd52bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05c299c700 1 --2- 172.21.15.72:0/1492255259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd573f60 0x558efd53ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05c219b700 1 -- 172.21.15.72:0/1492255259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd52b2c0 msgr2=0x558efd52bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:35.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05c219b700 1 --2- 172.21.15.72:0/1492255259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd52b2c0 0x558efd52bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05c219b700 1 -- 172.21.15.72:0/1492255259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd573f60 msgr2=0x558efd53ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:35.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05c219b700 1 --2- 172.21.15.72:0/1492255259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd573f60 0x558efd53ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.353+0000 7f05c219b700 1 -- 172.21.15.72:0/1492255259 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558efd471580 con 0x558efd526af0 2023-08-31T19:03:35.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.354+0000 7f05c219b700 1 --2- 172.21.15.72:0/1492255259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd526af0 0x558efd559390 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f05b800c800 tx=0x7f05b8024040).ready entity=mon.0 client_cookie=95e62225980174a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:35.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.354+0000 7f059f9ff700 1 -- 172.21.15.72:0/1492255259 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8027040 con 0x558efd526af0 2023-08-31T19:03:35.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.354+0000 7f059f9ff700 1 -- 172.21.15.72:0/1492255259 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b800b030 con 0x558efd526af0 2023-08-31T19:03:35.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.354+0000 7f059f9ff700 1 -- 172.21.15.72:0/1492255259 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8001c50 con 0x558efd526af0 2023-08-31T19:03:35.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.354+0000 7f05db770b80 1 -- 172.21.15.72:0/1492255259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd526af0 msgr2=0x558efd559390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.354+0000 7f05db770b80 1 --2- 172.21.15.72:0/1492255259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd526af0 0x558efd559390 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f05b800c800 tx=0x7f05b8024040).stop 2023-08-31T19:03:35.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.354+0000 7f05db770b80 1 -- 172.21.15.72:0/1492255259 shutdown_connections 2023-08-31T19:03:35.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.354+0000 7f05db770b80 1 --2- 172.21.15.72:0/1492255259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd573f60 0x558efd53ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.354+0000 7f05db770b80 1 --2- 172.21.15.72:0/1492255259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd526af0 0x558efd559390 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.354+0000 7f05db770b80 1 --2- 172.21.15.72:0/1492255259 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd52b2c0 0x558efd52bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.354+0000 7f05db770b80 1 -- 172.21.15.72:0/1492255259 >> 172.21.15.72:0/1492255259 conn(0x558efd395940 msgr2=0x558efd53fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:35.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.354+0000 7f05db770b80 1 -- 172.21.15.72:0/1492255259 shutdown_connections 2023-08-31T19:03:35.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.355+0000 7f05db770b80 1 -- 172.21.15.72:0/1492255259 wait complete. 2023-08-31T19:03:35.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.355+0000 7f05db770b80 1 -- start start 2023-08-31T19:03:35.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.355+0000 7f05db770b80 1 Processor -- start 2023-08-31T19:03:35.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.357+0000 7f05db770b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd526af0 0x558efd5d4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.357+0000 7f05db770b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd52b2c0 0x558efd556290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.357+0000 7f05db770b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd573f60 0x558efd556780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.357+0000 7f05db770b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efd52ccf0 con 0x558efd52b2c0 2023-08-31T19:03:35.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.357+0000 7f05db770b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558efd556c70 con 0x558efd573f60 2023-08-31T19:03:35.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.357+0000 7f05db770b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x558efd553010 con 0x558efd526af0 2023-08-31T19:03:35.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.357+0000 7f05db770b80 10 client.0 ll_register_callbacks cb 0x558efd41dce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:03:35.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.357+0000 7f05c199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd52b2c0 0x558efd556290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.357+0000 7f05c199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd52b2c0 0x558efd556290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59542/0 (socket says 172.21.15.72:59542) 2023-08-31T19:03:35.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.357+0000 7f05c199a700 1 -- 172.21.15.72:0/564180704 learned_addr learned my addr 172.21.15.72:0/564180704 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:35.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f05c219b700 1 --2- 172.21.15.72:0/564180704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd526af0 0x558efd5d4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f05c299c700 1 --2- 172.21.15.72:0/564180704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd573f60 0x558efd556780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f05c199a700 1 -- 172.21.15.72:0/564180704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd526af0 msgr2=0x558efd5d4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:35.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f05c199a700 1 --2- 172.21.15.72:0/564180704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd526af0 0x558efd5d4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f05c199a700 1 -- 172.21.15.72:0/564180704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd573f60 msgr2=0x558efd556780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:35.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f05c199a700 1 --2- 172.21.15.72:0/564180704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd573f60 0x558efd556780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f05c199a700 1 -- 172.21.15.72:0/564180704 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a80033f0 con 0x558efd52b2c0 2023-08-31T19:03:35.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f05c219b700 1 --2- 172.21.15.72:0/564180704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd526af0 0x558efd5d4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:35.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f05c199a700 1 --2- 172.21.15.72:0/564180704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd52b2c0 0x558efd556290 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f05ac018d40 tx=0x7f05ac024000).ready entity=mon.0 client_cookie=e2d97aa9dca5ec52 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:35.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f059c9f9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:03:35.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f059c9f9700 1 -- 172.21.15.72:0/564180704 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac010040 con 0x558efd52b2c0 2023-08-31T19:03:35.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f059c9f9700 1 -- 172.21.15.72:0/564180704 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f05ac014a70 con 0x558efd52b2c0 2023-08-31T19:03:35.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f05db770b80 1 -- 172.21.15.72:0/564180704 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05b4052880 con 0x558efd52b2c0 2023-08-31T19:03:35.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f059c9f9700 1 -- 172.21.15.72:0/564180704 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05ac014860 con 0x558efd52b2c0 2023-08-31T19:03:35.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f05db770b80 10 client.6396 fetch_fsmap learned FSMap version 32 2023-08-31T19:03:35.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.358+0000 7f05db770b80 1 -- 172.21.15.72:0/564180704 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x558efd4712d0 con 0x558efd52b2c0 2023-08-31T19:03:35.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.359+0000 7f059c9f9700 1 -- 172.21.15.72:0/564180704 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b4052880 con 0x558efd52b2c0 2023-08-31T19:03:35.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.359+0000 7f059c9f9700 1 -- 172.21.15.72:0/564180704 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 32) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f05ac021440 con 0x558efd52b2c0 2023-08-31T19:03:35.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.359+0000 7f05db770b80 10 client.6396 fetch_fsmap finished waiting for FSMap version 32 2023-08-31T19:03:35.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.359+0000 7f05db770b80 10 client.6396 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:03:35.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.359+0000 7f05db770b80 20 client.6396 populate_metadata read hostname 'smithi072' 2023-08-31T19:03:35.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.359+0000 7f05db770b80 1 --2- 172.21.15.72:0/564180704 >> [v2:172.21.15.72:6836/2633506693,v1:172.21.15.72:6837/2633506693] conn(0x558efd56ed00 0x558efd56f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.359+0000 7f05db770b80 4 client.6396 mds_command: new command op to 6252 tid=0[{"prefix": "status"}] 2023-08-31T19:03:35.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.359+0000 7f05db770b80 1 -- 172.21.15.72:0/564180704 --> [v2:172.21.15.72:6836/2633506693,v1:172.21.15.72:6837/2633506693] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558efd31b040 con 0x558efd56ed00 2023-08-31T19:03:35.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.359+0000 7f05c219b700 1 --2- 172.21.15.72:0/564180704 >> [v2:172.21.15.72:6836/2633506693,v1:172.21.15.72:6837/2633506693] conn(0x558efd56ed00 0x558efd56f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f059c9f9700 10 client.6396 ms_handle_connect on v2:172.21.15.72:6836/2633506693 2023-08-31T19:03:35.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.359+0000 7f05c219b700 1 --2- 172.21.15.72:0/564180704 >> [v2:172.21.15.72:6836/2633506693,v1:172.21.15.72:6837/2633506693] conn(0x558efd56ed00 0x558efd56f0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5efe22f6015b6525 server_cookie=eb28abd449b2eaa1 in_seq=0 out_seq=0 2023-08-31T19:03:35.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f059c9f9700 1 -- 172.21.15.72:0/564180704 <== mds.0 v2:172.21.15.72:6836/2633506693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x558efd31b040 con 0x558efd56ed00 2023-08-31T19:03:35.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f059c9f9700 10 client.6396 handle_command_reply: tid=0 2023-08-31T19:03:35.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f05db770b80 1 client.6396 shutdown 2023-08-31T19:03:35.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f05db770b80 1 -- 172.21.15.72:0/564180704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd52b2c0 msgr2=0x558efd556290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f05db770b80 1 --2- 172.21.15.72:0/564180704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd52b2c0 0x558efd556290 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7f05ac018d40 tx=0x7f05ac024000).stop 2023-08-31T19:03:35.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f05db770b80 1 -- 172.21.15.72:0/564180704 shutdown_connections 2023-08-31T19:03:35.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f05db770b80 1 --2- 172.21.15.72:0/564180704 >> [v2:172.21.15.72:6836/2633506693,v1:172.21.15.72:6837/2633506693] conn(0x558efd56ed00 0x558efd56f0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f05db770b80 1 --2- 172.21.15.72:0/564180704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558efd573f60 0x558efd556780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f05db770b80 1 --2- 172.21.15.72:0/564180704 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x558efd526af0 0x558efd5d4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f05db770b80 1 --2- 172.21.15.72:0/564180704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558efd52b2c0 0x558efd556290 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f059c9f9700 0 client.6396 ms_handle_reset on v2:172.21.15.72:6836/2633506693 2023-08-31T19:03:35.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f05db770b80 1 -- 172.21.15.72:0/564180704 >> 172.21.15.72:0/564180704 conn(0x558efd395940 msgr2=0x558efd52d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:35.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f05db770b80 1 -- 172.21.15.72:0/564180704 shutdown_connections 2023-08-31T19:03:35.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f05db770b80 1 -- 172.21.15.72:0/564180704 wait complete. 2023-08-31T19:03:35.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.360+0000 7f05db770b80 20 client.6396 trim_cache size 0 max 16384 2023-08-31T19:03:35.381 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:03:35.381 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "acadb8ca-1685-49e1-a73f-5e9d14d95be9", 2023-08-31T19:03:35.381 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-08-31T19:03:35.381 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 6252, 2023-08-31T19:03:35.382 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-08-31T19:03:35.382 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-08-31T19:03:35.382 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-08-31T19:03:35.382 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 6.3893974929999997, 2023-08-31T19:03:35.382 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 32, 2023-08-31T19:03:35.383 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 79, 2023-08-31T19:03:35.383 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 79, 2023-08-31T19:03:35.383 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 12.154832957 2023-08-31T19:03:35.383 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:03:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.361+0000 7f05c43ff700 1 -- 172.21.15.72:0/1859958125 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f05a005ef60 msgr2=0x7f05a0061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.361+0000 7f05c43ff700 1 --2- 172.21.15.72:0/1859958125 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f05a005ef60 0x7f05a0061420 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f05b8001ed0 tx=0x7f05b8015000).stop 2023-08-31T19:03:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.361+0000 7f05c43ff700 1 -- 172.21.15.72:0/1859958125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05bc0abd20 msgr2=0x7f05bc0ac1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.361+0000 7f05c43ff700 1 --2- 172.21.15.72:0/1859958125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05bc0abd20 0x7f05bc0ac1a0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f05bc0c12c0 tx=0x7f05b400d040).stop 2023-08-31T19:03:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.361+0000 7f05c43ff700 1 -- 172.21.15.72:0/1859958125 shutdown_connections 2023-08-31T19:03:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.361+0000 7f05c43ff700 1 --2- 172.21.15.72:0/1859958125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05bc0abd20 0x7f05bc0ac1a0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.361+0000 7f05c43ff700 1 --2- 172.21.15.72:0/1859958125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05a80038e0 0x7f05bc15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.361+0000 7f05c43ff700 1 --2- 172.21.15.72:0/1859958125 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f05a005ef60 0x7f05a0061420 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.361+0000 7f05c43ff700 1 --2- 172.21.15.72:0/1859958125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05bc0a86d0 0x7f05bc0a8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.361+0000 7f05c43ff700 1 -- 172.21.15.72:0/1859958125 >> 172.21.15.72:0/1859958125 conn(0x7f05bc063150 msgr2=0x7f05bc0c5790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:35.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.361+0000 7f05c43ff700 1 -- 172.21.15.72:0/1859958125 shutdown_connections 2023-08-31T19:03:35.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.361+0000 7f05c43ff700 1 -- 172.21.15.72:0/1859958125 wait complete. 2023-08-31T19:03:35.389 DEBUG:teuthology.orchestra.run.smithi072:> ceph fs ls 2023-08-31T19:03:35.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.550+0000 7fdea6dff700 1 Processor -- start 2023-08-31T19:03:35.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.550+0000 7fdea6dff700 1 -- start start 2023-08-31T19:03:35.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.551+0000 7fdea6dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea00ca510 0x7fdea00a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.551+0000 7fdea6dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdea00a7fe0 0x7fdea00c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.551+0000 7fdea6dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea00ca080 con 0x7fdea0154460 2023-08-31T19:03:35.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.551+0000 7fdea6dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea00c72d0 con 0x7fdea00a7fe0 2023-08-31T19:03:35.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.551+0000 7fdea6dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea00c9750 con 0x7fdea00ca510 2023-08-31T19:03:35.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.552+0000 7fdea539c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdea00a7fe0 0x7fdea00c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.552+0000 7fdea539c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdea00a7fe0 0x7fdea00c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59550/0 (socket says 172.21.15.72:59550) 2023-08-31T19:03:35.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.552+0000 7fdea539c700 1 -- 172.21.15.72:0/2788556725 learned_addr learned my addr 172.21.15.72:0/2788556725 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:35.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.552+0000 7fde9ffff700 1 --2- 172.21.15.72:0/2788556725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea00ca510 0x7fdea00a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.552+0000 7fdea539c700 1 -- 172.21.15.72:0/2788556725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea00ca510 msgr2=0x7fdea00a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:35.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.552+0000 7fdea539c700 1 --2- 172.21.15.72:0/2788556725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea00ca510 0x7fdea00a7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.552+0000 7fdea539c700 1 -- 172.21.15.72:0/2788556725 >> v1:172.21.15.146:6789/0 conn(0x7fdea0154460 legacy=0x7fdea00c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.552+0000 7fdea539c700 1 -- 172.21.15.72:0/2788556725 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea00c9a30 con 0x7fdea00a7fe0 2023-08-31T19:03:35.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.552+0000 7fdea539c700 1 --2- 172.21.15.72:0/2788556725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdea00a7fe0 0x7fdea00c5f90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fde98009f20 tx=0x7fde98009840).ready entity=mon.0 client_cookie=670eb6a8d1bab829 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:35.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.552+0000 7fde9f7fe700 1 -- 172.21.15.72:0/2788556725 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9800e070 con 0x7fdea00a7fe0 2023-08-31T19:03:35.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.552+0000 7fde9f7fe700 1 -- 172.21.15.72:0/2788556725 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9800b9d0 con 0x7fdea00a7fe0 2023-08-31T19:03:35.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.552+0000 7fde9f7fe700 1 -- 172.21.15.72:0/2788556725 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9800bd50 con 0x7fdea00a7fe0 2023-08-31T19:03:35.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.553+0000 7fdea6dff700 1 -- 172.21.15.72:0/2788556725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdea00a7fe0 msgr2=0x7fdea00c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.553+0000 7fdea6dff700 1 --2- 172.21.15.72:0/2788556725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdea00a7fe0 0x7fdea00c5f90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fde98009f20 tx=0x7fde98009840).stop 2023-08-31T19:03:35.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.553+0000 7fdea6dff700 1 -- 172.21.15.72:0/2788556725 shutdown_connections 2023-08-31T19:03:35.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.553+0000 7fdea6dff700 1 --2- 172.21.15.72:0/2788556725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdea00a7fe0 0x7fdea00c5f90 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.553+0000 7fdea6dff700 1 --2- 172.21.15.72:0/2788556725 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea00ca510 0x7fdea00a7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.553+0000 7fdea6dff700 1 -- 172.21.15.72:0/2788556725 >> 172.21.15.72:0/2788556725 conn(0x7fdea006a560 msgr2=0x7fdea00cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.553+0000 7fdea6dff700 1 -- 172.21.15.72:0/2788556725 shutdown_connections 2023-08-31T19:03:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.553+0000 7fdea6dff700 1 -- 172.21.15.72:0/2788556725 wait complete. 2023-08-31T19:03:35.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.555+0000 7fdea6dff700 1 Processor -- start 2023-08-31T19:03:35.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.555+0000 7fdea6dff700 1 -- start start 2023-08-31T19:03:35.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fdea6dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea00a7fe0 0x7fdea0152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fdea6dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdea00ca510 0x7fdea00afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fdea6dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea0154460 0x7fdea00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fdea6dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea0152ce0 con 0x7fdea00ca510 2023-08-31T19:03:35.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fdea6dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea00aded0 con 0x7fdea0154460 2023-08-31T19:03:35.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fdea6dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea00ae1b0 con 0x7fdea00a7fe0 2023-08-31T19:03:35.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fde9ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdea00ca510 0x7fdea00afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fde9ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdea00ca510 0x7fdea00afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59558/0 (socket says 172.21.15.72:59558) 2023-08-31T19:03:35.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fde9ffff700 1 -- 172.21.15.72:0/828790616 learned_addr learned my addr 172.21.15.72:0/828790616 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:35.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fdea539c700 1 --2- 172.21.15.72:0/828790616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea0154460 0x7fdea00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fdea4b9b700 1 --2- 172.21.15.72:0/828790616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea00a7fe0 0x7fdea0152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fde9ffff700 1 -- 172.21.15.72:0/828790616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea00a7fe0 msgr2=0x7fdea0152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fde9ffff700 1 --2- 172.21.15.72:0/828790616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea00a7fe0 0x7fdea0152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fde9ffff700 1 -- 172.21.15.72:0/828790616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea0154460 msgr2=0x7fdea00b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fde9ffff700 1 --2- 172.21.15.72:0/828790616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea0154460 0x7fdea00b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fde9ffff700 1 -- 172.21.15.72:0/828790616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98009ae0 con 0x7fdea00ca510 2023-08-31T19:03:35.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.556+0000 7fde9ffff700 1 --2- 172.21.15.72:0/828790616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdea00ca510 0x7fdea00afb80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fde8c00e930 tx=0x7fde8c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:35.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.557+0000 7fde9cff9700 1 -- 172.21.15.72:0/828790616 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c00eed0 con 0x7fdea00ca510 2023-08-31T19:03:35.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.557+0000 7fde9cff9700 1 -- 172.21.15.72:0/828790616 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c00c850 con 0x7fdea00ca510 2023-08-31T19:03:35.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.557+0000 7fde9cff9700 1 -- 172.21.15.72:0/828790616 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c00cbd0 con 0x7fdea00ca510 2023-08-31T19:03:35.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.557+0000 7fdea6dff700 1 -- 172.21.15.72:0/828790616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea00ae490 con 0x7fdea00ca510 2023-08-31T19:03:35.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.557+0000 7fdea6dff700 1 -- 172.21.15.72:0/828790616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea0152680 con 0x7fdea00ca510 2023-08-31T19:03:35.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.558+0000 7fdea6dff700 1 -- 172.21.15.72:0/828790616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea0047480 con 0x7fdea00ca510 2023-08-31T19:03:35.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.558+0000 7fde9cff9700 1 -- 172.21.15.72:0/828790616 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fde8c01b400 con 0x7fdea00ca510 2023-08-31T19:03:35.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.559+0000 7fde9cff9700 1 --2- 172.21.15.72:0/828790616 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fde8405ef30 0x7fde840613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:35.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.560+0000 7fde9cff9700 1 -- 172.21.15.72:0/828790616 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7fde8c07a890 con 0x7fdea00ca510 2023-08-31T19:03:35.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.560+0000 7fdea4b9b700 1 --2- 172.21.15.72:0/828790616 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fde8405ef30 0x7fde840613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:35.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.560+0000 7fdea4b9b700 1 --2- 172.21.15.72:0/828790616 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fde8405ef30 0x7fde840613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fde94003710 tx=0x7fde94009040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:35.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.563+0000 7fde9cff9700 1 -- 172.21.15.72:0/828790616 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fde8c04b800 con 0x7fdea00ca510 2023-08-31T19:03:35.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.775+0000 7fdea6dff700 1 -- 172.21.15.72:0/828790616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdea00c9d10 con 0x7fdea00ca510 2023-08-31T19:03:35.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.776+0000 7fde9cff9700 1 -- 172.21.15.72:0/828790616 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7fde8c04ee20 con 0x7fdea00ca510 2023-08-31T19:03:35.776 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T19:03:35.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.778+0000 7fdea6dff700 1 -- 172.21.15.72:0/828790616 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fde8405ef30 msgr2=0x7fde840613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.778+0000 7fdea6dff700 1 --2- 172.21.15.72:0/828790616 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fde8405ef30 0x7fde840613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fde94003710 tx=0x7fde94009040).stop 2023-08-31T19:03:35.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.778+0000 7fdea6dff700 1 -- 172.21.15.72:0/828790616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdea00ca510 msgr2=0x7fdea00afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:35.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.778+0000 7fdea6dff700 1 --2- 172.21.15.72:0/828790616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdea00ca510 0x7fdea00afb80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fde8c00e930 tx=0x7fde8c009060).stop 2023-08-31T19:03:35.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.778+0000 7fdea6dff700 1 -- 172.21.15.72:0/828790616 shutdown_connections 2023-08-31T19:03:35.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.778+0000 7fdea6dff700 1 --2- 172.21.15.72:0/828790616 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fde8405ef30 0x7fde840613f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.778+0000 7fdea6dff700 1 --2- 172.21.15.72:0/828790616 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdea0154460 0x7fdea00b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.778+0000 7fdea6dff700 1 --2- 172.21.15.72:0/828790616 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdea00a7fe0 0x7fdea0152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.778+0000 7fdea6dff700 1 --2- 172.21.15.72:0/828790616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdea00ca510 0x7fdea00afb80 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:35.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.778+0000 7fdea6dff700 1 -- 172.21.15.72:0/828790616 >> 172.21.15.72:0/828790616 conn(0x7fdea006a560 msgr2=0x7fdea00ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:35.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.778+0000 7fdea6dff700 1 -- 172.21.15.72:0/828790616 shutdown_connections 2023-08-31T19:03:35.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:35.778+0000 7fdea6dff700 1 -- 172.21.15.72:0/828790616 wait complete. 2023-08-31T19:03:35.795 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-31T19:03:35.796 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:03:35.796 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-31T19:03:35.797 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T19:03:35.797 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T19:03:35.797 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-31T19:03:35.798 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-31T19:03:35.798 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:03:35.798 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:03:35.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:03:35.800 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-31T19:03:35.848 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:03:35.848 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:03:35.848 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:03:35.848 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:03:35.849 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-31T19:03:35.849 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:03:35.849 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:03:35.849 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:03:35.849 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-31T19:03:35.850 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:03:35.850 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:03:35.850 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-31T19:03:35.850 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:03:35.851 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:03:35.851 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:03:35.851 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:03:35.851 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:03:35.851 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 37060sec preferred_lft 37060sec 2023-08-31T19:03:35.851 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-31T19:03:35.852 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:03:35.852 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:03:35.852 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff 2023-08-31T19:03:35.852 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T19:03:35.852 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:03:35.853 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::7c68:c9ff:fe82:9771/64 scope link 2023-08-31T19:03:35.853 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:03:35.853 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:03:35.853 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e2:e1:71:f6:f6:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T19:03:35.853 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e0e1:71ff:fef6:f6fa/64 scope link 2023-08-31T19:03:35.854 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:03:35.854 INFO:teuthology.orchestra.run.smithi072.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:03:35.854 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T19:03:35.854 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::38f6:6ff:fe3c:1ef/64 scope link 2023-08-31T19:03:35.854 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:03:35.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:03:35.856 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:03:35.957 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-31T19:03:35.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:03:35.959 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-31T19:03:36.009 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-31T19:03:36.009 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:03:36.010 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:03:36.010 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:03:36.010 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:03:36.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:03:36.011 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T19:03:36.012 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T19:03:36.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:03:36.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:03:36.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:03:36.014 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T19:03:36.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:03:36.185 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T19:03:36.232 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T19:03:36.233 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T19:03:36.233 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:03:36.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:03:36.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-08-31T19:03:36.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:03:36.344 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-31T19:03:36.391 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-31T19:03:36.392 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:03:36.530 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:03:36.530 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:03:36.560 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:03:36.560 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:03:36.563 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-31T19:03:36.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:03:36.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T19:03:36.635 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-31T19:03:36.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.826+0000 7f87b05ff700 1 Processor -- start 2023-08-31T19:03:36.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.826+0000 7f87b05ff700 1 -- start start 2023-08-31T19:03:36.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.827+0000 7f87b05ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a8157c10 0x7f87a80ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:36.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.827+0000 7f87b05ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a80c6130 con 0x7f87a80ad1b0 2023-08-31T19:03:36.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.827+0000 7f87b05ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a81580b0 con 0x7f87a80637c0 2023-08-31T19:03:36.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.827+0000 7f87b05ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80c0350 con 0x7f87a8157c10 2023-08-31T19:03:36.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.828+0000 7f87ae39b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f87a80ad1b0 0x7f87a80630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50072/0 (socket says 172.21.15.72:50072) 2023-08-31T19:03:36.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.828+0000 7f87ae39b700 1 -- 172.21.15.72:0/830495692 learned_addr learned my addr 172.21.15.72:0/830495692 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:36.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.828+0000 7f87adb9a700 1 --2- 172.21.15.72:0/830495692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a8157c10 0x7f87a80ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:36.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.828+0000 7f87ad399700 1 -- 172.21.15.72:0/830495692 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59399990 0 0) 0x7f87a80c6130 con 0x7f87a80ad1b0 2023-08-31T19:03:36.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.828+0000 7f87ad399700 1 -- 172.21.15.72:0/830495692 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87940033f0 con 0x7f87a80ad1b0 2023-08-31T19:03:36.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.828+0000 7f87ad399700 1 -- 172.21.15.72:0/830495692 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3851781553 0 0) 0x7f87940033f0 con 0x7f87a80ad1b0 2023-08-31T19:03:36.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.828+0000 7f87ad399700 1 -- 172.21.15.72:0/830495692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a8157c10 msgr2=0x7f87a80ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:36.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.828+0000 7f87ad399700 1 --2- 172.21.15.72:0/830495692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a8157c10 0x7f87a80ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:36.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.828+0000 7f87ad399700 1 -- 172.21.15.72:0/830495692 >> v1:172.21.15.146:6789/0 conn(0x7f87a80637c0 legacy=0x7f87a80a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:36.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.828+0000 7f87ad399700 1 -- 172.21.15.72:0/830495692 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a8158350 con 0x7f87a80ad1b0 2023-08-31T19:03:36.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.828+0000 7f87ad399700 1 -- 172.21.15.72:0/830495692 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f87a4001470 con 0x7f87a80ad1b0 2023-08-31T19:03:36.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.828+0000 7f87ad399700 1 -- 172.21.15.72:0/830495692 >> v1:172.21.15.72:6789/0 conn(0x7f87a80ad1b0 legacy=0x7f87a80630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:36.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87ad399700 1 --2- 172.21.15.72:0/830495692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a8157c10 0x7f8794003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:36.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87ad399700 1 --2- 172.21.15.72:0/830495692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8794003e40 0x7f8794004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:36.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87ad399700 1 --2- 172.21.15.72:0/830495692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8794004b80 0x7f8794005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:36.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87ad399700 1 -- 172.21.15.72:0/830495692 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80c0350 con 0x7f8794003e40 2023-08-31T19:03:36.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87ad399700 1 -- 172.21.15.72:0/830495692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879400b990 con 0x7f8794004b80 2023-08-31T19:03:36.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87ad399700 1 -- 172.21.15.72:0/830495692 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879400bb50 con 0x7f87a8157c10 2023-08-31T19:03:36.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87adb9a700 1 --2- 172.21.15.72:0/830495692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8794003e40 0x7f8794004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:36.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87ae39b700 1 --2- 172.21.15.72:0/830495692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a8157c10 0x7f8794003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:36.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87aeb9c700 1 --2- 172.21.15.72:0/830495692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8794004b80 0x7f8794005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:36.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87adb9a700 1 -- 172.21.15.72:0/830495692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a8157c10 msgr2=0x7f8794003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:36.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87adb9a700 1 --2- 172.21.15.72:0/830495692 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a8157c10 0x7f8794003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:36.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87adb9a700 1 -- 172.21.15.72:0/830495692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8794004b80 msgr2=0x7f8794005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:36.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87adb9a700 1 --2- 172.21.15.72:0/830495692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8794004b80 0x7f8794005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:36.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87adb9a700 1 -- 172.21.15.72:0/830495692 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87940033f0 con 0x7f8794003e40 2023-08-31T19:03:36.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87aeb9c700 1 --2- 172.21.15.72:0/830495692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8794004b80 0x7f8794005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:36.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.829+0000 7f87adb9a700 1 --2- 172.21.15.72:0/830495692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8794003e40 0x7f8794004690 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f8798009a80 tx=0x7f8798009060).ready entity=mon.0 client_cookie=ee6cd83b1e2078c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.830+0000 7f87ad399700 1 -- 172.21.15.72:0/830495692 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8798009430 con 0x7f8794003e40 2023-08-31T19:03:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.830+0000 7f87ad399700 1 -- 172.21.15.72:0/830495692 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879800e640 con 0x7f8794003e40 2023-08-31T19:03:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.830+0000 7f87ad399700 1 -- 172.21.15.72:0/830495692 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879800e9c0 con 0x7f8794003e40 2023-08-31T19:03:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.830+0000 7f87b05ff700 1 -- 172.21.15.72:0/830495692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8794003e40 msgr2=0x7f8794004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.830+0000 7f87b05ff700 1 --2- 172.21.15.72:0/830495692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8794003e40 0x7f8794004690 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f8798009a80 tx=0x7f8798009060).stop 2023-08-31T19:03:36.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.830+0000 7f87aeb9c700 1 -- 172.21.15.72:0/830495692 reap_dead start 2023-08-31T19:03:36.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.830+0000 7f87b05ff700 1 -- 172.21.15.72:0/830495692 shutdown_connections 2023-08-31T19:03:36.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.830+0000 7f87b05ff700 1 -- 172.21.15.72:0/830495692 >> 172.21.15.72:0/830495692 conn(0x7f87a805eb60 msgr2=0x7f87a80cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:36.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.830+0000 7f87b05ff700 1 -- 172.21.15.72:0/830495692 shutdown_connections 2023-08-31T19:03:36.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.830+0000 7f87b05ff700 1 -- 172.21.15.72:0/830495692 wait complete. 2023-08-31T19:03:36.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.832+0000 7f87b05ff700 1 Processor -- start 2023-08-31T19:03:36.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.832+0000 7f87b05ff700 1 -- start start 2023-08-31T19:03:36.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.833+0000 7f87b05ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8794003e40 0x7f87a8149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:36.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.833+0000 7f87b05ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a8164400 0x7f87a81566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:36.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.833+0000 7f87b05ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87a8156bb0 0x7f87a8167b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:36.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.833+0000 7f87b05ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a81688e0 con 0x7f87a8156bb0 2023-08-31T19:03:36.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.833+0000 7f87b05ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80ae770 con 0x7f8794003e40 2023-08-31T19:03:36.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.833+0000 7f87b05ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a8157030 con 0x7f87a8164400 2023-08-31T19:03:36.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.833+0000 7f87aeb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87a8156bb0 0x7f87a8167b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:36.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.833+0000 7f87aeb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87a8156bb0 0x7f87a8167b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59584/0 (socket says 172.21.15.72:59584) 2023-08-31T19:03:36.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.833+0000 7f87aeb9c700 1 -- 172.21.15.72:0/766163271 learned_addr learned my addr 172.21.15.72:0/766163271 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:36.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.833+0000 7f87ae39b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8794003e40 0x7f87a8149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:36.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.833+0000 7f87adb9a700 1 --2- 172.21.15.72:0/766163271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a8164400 0x7f87a81566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:36.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.834+0000 7f87aeb9c700 1 -- 172.21.15.72:0/766163271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a8164400 msgr2=0x7f87a81566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:36.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.834+0000 7f87aeb9c700 1 --2- 172.21.15.72:0/766163271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a8164400 0x7f87a81566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:36.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.834+0000 7f87aeb9c700 1 -- 172.21.15.72:0/766163271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8794003e40 msgr2=0x7f87a8149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:36.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.834+0000 7f87aeb9c700 1 --2- 172.21.15.72:0/766163271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8794003e40 0x7f87a8149b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:36.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.834+0000 7f87aeb9c700 1 -- 172.21.15.72:0/766163271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a80ade40 con 0x7f87a8156bb0 2023-08-31T19:03:36.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.834+0000 7f87aeb9c700 1 --2- 172.21.15.72:0/766163271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87a8156bb0 0x7f87a8167b60 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f87a80cad20 tx=0x7f87a0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:36.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.834+0000 7f879e7fc700 1 -- 172.21.15.72:0/766163271 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a000dec0 con 0x7f87a8156bb0 2023-08-31T19:03:36.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.834+0000 7f879e7fc700 1 -- 172.21.15.72:0/766163271 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a0002490 con 0x7f87a8156bb0 2023-08-31T19:03:36.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.834+0000 7f87b05ff700 1 -- 172.21.15.72:0/766163271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a80ae120 con 0x7f87a8156bb0 2023-08-31T19:03:36.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.834+0000 7f879e7fc700 1 -- 172.21.15.72:0/766163271 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0002830 con 0x7f87a8156bb0 2023-08-31T19:03:36.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.834+0000 7f87b05ff700 1 -- 172.21.15.72:0/766163271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a814a080 con 0x7f87a8156bb0 2023-08-31T19:03:36.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.835+0000 7f87b05ff700 1 -- 172.21.15.72:0/766163271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a80ae8e0 con 0x7f87a8156bb0 2023-08-31T19:03:36.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.836+0000 7f879e7fc700 1 -- 172.21.15.72:0/766163271 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f87a0003030 con 0x7f87a8156bb0 2023-08-31T19:03:36.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.837+0000 7f879e7fc700 1 --2- 172.21.15.72:0/766163271 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f878c05ef30 0x7f878c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:36.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.837+0000 7f879e7fc700 1 -- 172.21.15.72:0/766163271 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f87a0079ab0 con 0x7f87a8156bb0 2023-08-31T19:03:36.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.837+0000 7f87ae39b700 1 --2- 172.21.15.72:0/766163271 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f878c05ef30 0x7f878c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:36.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.838+0000 7f87ae39b700 1 --2- 172.21.15.72:0/766163271 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f878c05ef30 0x7f878c0613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f87a4001ed0 tx=0x7f87a4007040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:36.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:36.841+0000 7f879e7fc700 1 -- 172.21.15.72:0/766163271 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f87a00488f0 con 0x7f87a8156bb0 2023-08-31T19:03:37.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.045+0000 7f87b05ff700 1 -- 172.21.15.72:0/766163271 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f87a806c6b0 con 0x7f878c05ef30 2023-08-31T19:03:37.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.046+0000 7f879e7fc700 1 -- 172.21.15.72:0/766163271 <== mgr.6060 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f87a806c6b0 con 0x7f878c05ef30 2023-08-31T19:03:37.047 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:03:37.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:03:37.048 INFO:teuthology.orchestra.run.smithi072.stdout: "name": "cephfs" 2023-08-31T19:03:37.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:03:37.048 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:03:37.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.048+0000 7f87b05ff700 1 -- 172.21.15.72:0/766163271 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f878c05ef30 msgr2=0x7f878c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:37.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.048+0000 7f87b05ff700 1 --2- 172.21.15.72:0/766163271 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f878c05ef30 0x7f878c0613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f87a4001ed0 tx=0x7f87a4007040).stop 2023-08-31T19:03:37.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.048+0000 7f87b05ff700 1 -- 172.21.15.72:0/766163271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87a8156bb0 msgr2=0x7f87a8167b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:37.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.048+0000 7f87b05ff700 1 --2- 172.21.15.72:0/766163271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87a8156bb0 0x7f87a8167b60 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f87a80cad20 tx=0x7f87a0009040).stop 2023-08-31T19:03:37.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.048+0000 7f87b05ff700 1 -- 172.21.15.72:0/766163271 shutdown_connections 2023-08-31T19:03:37.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.048+0000 7f87b05ff700 1 --2- 172.21.15.72:0/766163271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87a8156bb0 0x7f87a8167b60 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.048+0000 7f87b05ff700 1 --2- 172.21.15.72:0/766163271 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f878c05ef30 0x7f878c0613f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.048+0000 7f87b05ff700 1 --2- 172.21.15.72:0/766163271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8794003e40 0x7f87a8149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.048+0000 7f87b05ff700 1 --2- 172.21.15.72:0/766163271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87a8164400 0x7f87a81566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.048+0000 7f87b05ff700 1 -- 172.21.15.72:0/766163271 >> 172.21.15.72:0/766163271 conn(0x7f87a805eb60 msgr2=0x7f87a80c5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.049+0000 7f87b05ff700 1 -- 172.21.15.72:0/766163271 shutdown_connections 2023-08-31T19:03:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.049+0000 7f87b05ff700 1 -- 172.21.15.72:0/766163271 wait complete. 2023-08-31T19:03:37.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-31T19:03:37.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.256+0000 7f0aeb3ff700 1 Processor -- start 2023-08-31T19:03:37.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.256+0000 7f0aeb3ff700 1 -- start start 2023-08-31T19:03:37.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.257+0000 7f0aeb3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ae4154210 0x7f0ae40630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:37.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.257+0000 7f0aeb3ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ae40635a0 0x7f0ae40c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:37.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.257+0000 7f0aeb3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae4063a30 con 0x7f0ae4153e30 2023-08-31T19:03:37.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.257+0000 7f0aeb3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae41546c0 con 0x7f0ae4154210 2023-08-31T19:03:37.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.257+0000 7f0aeb3ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae40bfd40 con 0x7f0ae40635a0 2023-08-31T19:03:37.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.258+0000 7f0ae919b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0ae4153e30 0x7f0ae40c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50088/0 (socket says 172.21.15.72:50088) 2023-08-31T19:03:37.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.258+0000 7f0ae919b700 1 -- 172.21.15.72:0/3962620653 learned_addr learned my addr 172.21.15.72:0/3962620653 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:37.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.258+0000 7f0ae899a700 1 --2- 172.21.15.72:0/3962620653 >> v2:172.21.15.72:3300/0 conn(0x7f0ae4154210 0x7f0ae40630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:37.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.258+0000 7f0ae999c700 1 --2- 172.21.15.72:0/3962620653 >> v2:172.21.15.146:3300/0 conn(0x7f0ae40635a0 0x7f0ae40c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:37.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.258+0000 7f0adbfff700 1 -- 172.21.15.72:0/3962620653 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029683789 0 0) 0x7f0ae4063a30 con 0x7f0ae4153e30 2023-08-31T19:03:37.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.258+0000 7f0adbfff700 1 -- 172.21.15.72:0/3962620653 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ad00033f0 con 0x7f0ae4153e30 2023-08-31T19:03:37.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.258+0000 7f0ae899a700 1 -- 172.21.15.72:0/3962620653 >> v2:172.21.15.146:3300/0 conn(0x7f0ae40635a0 msgr2=0x7f0ae40c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:37.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.258+0000 7f0ae899a700 1 --2- 172.21.15.72:0/3962620653 >> v2:172.21.15.146:3300/0 conn(0x7f0ae40635a0 0x7f0ae40c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.258+0000 7f0ae899a700 1 -- 172.21.15.72:0/3962620653 >> v1:172.21.15.72:6789/0 conn(0x7f0ae4153e30 legacy=0x7f0ae40c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:37.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.258+0000 7f0ae899a700 1 -- 172.21.15.72:0/3962620653 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae40c6730 con 0x7f0ae4154210 2023-08-31T19:03:37.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.258+0000 7f0ae899a700 1 --2- 172.21.15.72:0/3962620653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae4154210 0x7f0ae40630b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f0ae4084380 tx=0x7f0ad4009060).ready entity=mon.0 client_cookie=c56d2a56ee3c1d26 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:37.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.259+0000 7f0adbfff700 1 -- 172.21.15.72:0/3962620653 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400d4a0 con 0x7f0ae4154210 2023-08-31T19:03:37.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.259+0000 7f0adbfff700 1 -- 172.21.15.72:0/3962620653 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad400d600 con 0x7f0ae4154210 2023-08-31T19:03:37.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.259+0000 7f0adbfff700 1 -- 172.21.15.72:0/3962620653 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400d980 con 0x7f0ae4154210 2023-08-31T19:03:37.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.259+0000 7f0aeb3ff700 1 -- 172.21.15.72:0/3962620653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae4154210 msgr2=0x7f0ae40630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:37.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.259+0000 7f0aeb3ff700 1 --2- 172.21.15.72:0/3962620653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae4154210 0x7f0ae40630b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f0ae4084380 tx=0x7f0ad4009060).stop 2023-08-31T19:03:37.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.259+0000 7f0aeb3ff700 1 -- 172.21.15.72:0/3962620653 shutdown_connections 2023-08-31T19:03:37.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.259+0000 7f0aeb3ff700 1 --2- 172.21.15.72:0/3962620653 >> v2:172.21.15.146:3300/0 conn(0x7f0ae40635a0 0x7f0ae40c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.259+0000 7f0aeb3ff700 1 --2- 172.21.15.72:0/3962620653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae4154210 0x7f0ae40630b0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.259+0000 7f0aeb3ff700 1 -- 172.21.15.72:0/3962620653 >> 172.21.15.72:0/3962620653 conn(0x7f0ae405eb20 msgr2=0x7f0ae40cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:37.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.259+0000 7f0aeb3ff700 1 -- 172.21.15.72:0/3962620653 shutdown_connections 2023-08-31T19:03:37.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.259+0000 7f0aeb3ff700 1 -- 172.21.15.72:0/3962620653 wait complete. 2023-08-31T19:03:37.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.261+0000 7f0aeb3ff700 1 Processor -- start 2023-08-31T19:03:37.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.261+0000 7f0aeb3ff700 1 -- start start 2023-08-31T19:03:37.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.262+0000 7f0aeb3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ae40635a0 0x7f0ae4147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:37.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.262+0000 7f0aeb3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ae4153e30 0x7f0ae4167a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:37.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.262+0000 7f0aeb3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae4154210 0x7f0ae4167f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:37.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.262+0000 7f0aeb3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4168460 con 0x7f0ae4154210 2023-08-31T19:03:37.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.262+0000 7f0aeb3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4145190 con 0x7f0ae4153e30 2023-08-31T19:03:37.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.262+0000 7f0aeb3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4166160 con 0x7f0ae40635a0 2023-08-31T19:03:37.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.262+0000 7f0ae999c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae4154210 0x7f0ae4167f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:37.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.262+0000 7f0ae999c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae4154210 0x7f0ae4167f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59612/0 (socket says 172.21.15.72:59612) 2023-08-31T19:03:37.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.262+0000 7f0ae999c700 1 -- 172.21.15.72:0/4203743705 learned_addr learned my addr 172.21.15.72:0/4203743705 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:37.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.262+0000 7f0ae899a700 1 --2- 172.21.15.72:0/4203743705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ae4153e30 0x7f0ae4167a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:37.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.262+0000 7f0ae919b700 1 --2- 172.21.15.72:0/4203743705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ae40635a0 0x7f0ae4147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:37.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.262+0000 7f0ae999c700 1 -- 172.21.15.72:0/4203743705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ae40635a0 msgr2=0x7f0ae4147e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.262+0000 7f0ae999c700 1 --2- 172.21.15.72:0/4203743705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ae40635a0 0x7f0ae4147e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.262+0000 7f0ae999c700 1 -- 172.21.15.72:0/4203743705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ae4153e30 msgr2=0x7f0ae4167a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.262+0000 7f0ae999c700 1 --2- 172.21.15.72:0/4203743705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ae4153e30 0x7f0ae4167a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.263+0000 7f0ae999c700 1 -- 172.21.15.72:0/4203743705 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad40092a0 con 0x7f0ae4154210 2023-08-31T19:03:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.263+0000 7f0ae999c700 1 --2- 172.21.15.72:0/4203743705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae4154210 0x7f0ae4167f70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f0adc009e90 tx=0x7f0adc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.263+0000 7f0ad97fa700 1 -- 172.21.15.72:0/4203743705 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc00cc20 con 0x7f0ae4154210 2023-08-31T19:03:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.263+0000 7f0ad97fa700 1 -- 172.21.15.72:0/4203743705 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc00f040 con 0x7f0ae4154210 2023-08-31T19:03:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.263+0000 7f0aeb3ff700 1 -- 172.21.15.72:0/4203743705 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae41655c0 con 0x7f0ae4154210 2023-08-31T19:03:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.263+0000 7f0ad97fa700 1 -- 172.21.15.72:0/4203743705 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc013400 con 0x7f0ae4154210 2023-08-31T19:03:37.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.263+0000 7f0aeb3ff700 1 -- 172.21.15.72:0/4203743705 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae4165b10 con 0x7f0ae4154210 2023-08-31T19:03:37.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.264+0000 7f0aeb3ff700 1 -- 172.21.15.72:0/4203743705 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae406c6b0 con 0x7f0ae4154210 2023-08-31T19:03:37.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.265+0000 7f0ad97fa700 1 -- 172.21.15.72:0/4203743705 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 24) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0adc0137b0 con 0x7f0ae4154210 2023-08-31T19:03:37.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.266+0000 7f0ad97fa700 1 --2- 172.21.15.72:0/4203743705 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0ac805ef30 0x7f0ac80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:37.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.266+0000 7f0ad97fa700 1 -- 172.21.15.72:0/4203743705 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f0adc07ab80 con 0x7f0ae4154210 2023-08-31T19:03:37.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.266+0000 7f0ae919b700 1 --2- 172.21.15.72:0/4203743705 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0ac805ef30 0x7f0ac80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:37.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.267+0000 7f0ae919b700 1 --2- 172.21.15.72:0/4203743705 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0ac805ef30 0x7f0ac80613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0ae0005750 tx=0x7f0ae0009040).ready entity=mgr.6060 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:37.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.270+0000 7f0ad97fa700 1 -- 172.21.15.72:0/4203743705 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0adc04bc10 con 0x7f0ae4154210 2023-08-31T19:03:37.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.480+0000 7f0aeb3ff700 1 -- 172.21.15.72:0/4203743705 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f0ae40629a0 con 0x7f0ae4154210 2023-08-31T19:03:37.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.496+0000 7f0ad97fa700 1 -- 172.21.15.72:0/4203743705 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 25) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f0adc078570 con 0x7f0ae4154210 2023-08-31T19:03:37.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.497+0000 7f0ad97fa700 1 -- 172.21.15.72:0/4203743705 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v25) v1 ==== 92+0+0 (secure 0 0 0) 0x7f0adc071f90 con 0x7f0ae4154210 2023-08-31T19:03:37.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.499+0000 7f0aeb3ff700 1 -- 172.21.15.72:0/4203743705 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0ac805ef30 msgr2=0x7f0ac80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:37.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.499+0000 7f0aeb3ff700 1 --2- 172.21.15.72:0/4203743705 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0ac805ef30 0x7f0ac80613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0ae0005750 tx=0x7f0ae0009040).stop 2023-08-31T19:03:37.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.499+0000 7f0aeb3ff700 1 -- 172.21.15.72:0/4203743705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae4154210 msgr2=0x7f0ae4167f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:37.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.499+0000 7f0aeb3ff700 1 --2- 172.21.15.72:0/4203743705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae4154210 0x7f0ae4167f70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f0adc009e90 tx=0x7f0adc00b040).stop 2023-08-31T19:03:37.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.499+0000 7f0aeb3ff700 1 -- 172.21.15.72:0/4203743705 shutdown_connections 2023-08-31T19:03:37.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.499+0000 7f0aeb3ff700 1 --2- 172.21.15.72:0/4203743705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae4154210 0x7f0ae4167f70 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.499+0000 7f0aeb3ff700 1 --2- 172.21.15.72:0/4203743705 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0ae40635a0 0x7f0ae4147e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.499+0000 7f0aeb3ff700 1 --2- 172.21.15.72:0/4203743705 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0ac805ef30 0x7f0ac80613f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.499+0000 7f0aeb3ff700 1 --2- 172.21.15.72:0/4203743705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ae4153e30 0x7f0ae4167a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.499+0000 7f0aeb3ff700 1 -- 172.21.15.72:0/4203743705 >> 172.21.15.72:0/4203743705 conn(0x7f0ae405eb20 msgr2=0x7f0ae40c5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:37.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.499+0000 7f0aeb3ff700 1 -- 172.21.15.72:0/4203743705 shutdown_connections 2023-08-31T19:03:37.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.499+0000 7f0aeb3ff700 1 -- 172.21.15.72:0/4203743705 wait complete. 2023-08-31T19:03:37.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-31T19:03:37.705 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:37.705+0000 7fede68f4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:03:37.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.721+0000 7f5c80bff700 1 Processor -- start 2023-08-31T19:03:37.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.721+0000 7f5c80bff700 1 -- start start 2023-08-31T19:03:37.722 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:37.721+0000 7eff9fb16680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:03:37.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.722+0000 7f5c80bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c7c154030 0x7f5c7c154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:37.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.722+0000 7f5c80bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5c7c0c7360 0x7f5c7c063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:37.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.722+0000 7f5c80bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7c0c6ed0 con 0x7f5c7c0c06b0 2023-08-31T19:03:37.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.722+0000 7f5c80bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7c0c66e0 con 0x7f5c7c0c7360 2023-08-31T19:03:37.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.722+0000 7f5c80bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7c0c68c0 con 0x7f5c7c154030 2023-08-31T19:03:37.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.722+0000 7f5c7ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5c7c0c7360 0x7f5c7c063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:37.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.722+0000 7f5c79d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5c7c0c06b0 0x7f5c7c0aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50100/0 (socket says 172.21.15.72:50100) 2023-08-31T19:03:37.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.723+0000 7f5c79d9b700 1 -- 172.21.15.72:0/2343937669 learned_addr learned my addr 172.21.15.72:0/2343937669 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:37.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.723+0000 7f5c7a59c700 1 --2- 172.21.15.72:0/2343937669 >> v2:172.21.15.146:3300/0 conn(0x7f5c7c154030 0x7f5c7c154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:37.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.723+0000 7f5c7ad9d700 1 -- 172.21.15.72:0/2343937669 >> v2:172.21.15.146:3300/0 conn(0x7f5c7c154030 msgr2=0x7f5c7c154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:37.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.723+0000 7f5c7ad9d700 1 --2- 172.21.15.72:0/2343937669 >> v2:172.21.15.146:3300/0 conn(0x7f5c7c154030 0x7f5c7c154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.723+0000 7f5c7ad9d700 1 -- 172.21.15.72:0/2343937669 >> v1:172.21.15.72:6789/0 conn(0x7f5c7c0c06b0 legacy=0x7f5c7c0aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:37.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.723+0000 7f5c7ad9d700 1 -- 172.21.15.72:0/2343937669 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c0c0f30 con 0x7f5c7c0c7360 2023-08-31T19:03:37.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.723+0000 7f5c7959a700 1 -- 172.21.15.72:0/2343937669 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554094884 0 0) 0x7f5c7c0c6ed0 con 0x7f5c7c0c06b0 2023-08-31T19:03:37.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.723+0000 7f5c7ad9d700 1 --2- 172.21.15.72:0/2343937669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c7c0c7360 0x7f5c7c063120 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f5c7c0c8bc0 tx=0x7f5c74009780).ready entity=mon.0 client_cookie=76782cdcbdb3d0a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:37.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.723+0000 7f5c7959a700 1 -- 172.21.15.72:0/2343937669 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7400e070 con 0x7f5c7c0c7360 2023-08-31T19:03:37.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.723+0000 7f5c7959a700 1 -- 172.21.15.72:0/2343937669 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7400bb60 con 0x7f5c7c0c7360 2023-08-31T19:03:37.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.724+0000 7f5c7959a700 1 -- 172.21.15.72:0/2343937669 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c74012410 con 0x7f5c7c0c7360 2023-08-31T19:03:37.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.724+0000 7f5c80bff700 1 -- 172.21.15.72:0/2343937669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c7c0c7360 msgr2=0x7f5c7c063120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:37.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.724+0000 7f5c80bff700 1 --2- 172.21.15.72:0/2343937669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c7c0c7360 0x7f5c7c063120 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f5c7c0c8bc0 tx=0x7f5c74009780).stop 2023-08-31T19:03:37.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.724+0000 7f5c80bff700 1 -- 172.21.15.72:0/2343937669 shutdown_connections 2023-08-31T19:03:37.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.724+0000 7f5c80bff700 1 --2- 172.21.15.72:0/2343937669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c7c0c7360 0x7f5c7c063120 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.724+0000 7f5c80bff700 1 --2- 172.21.15.72:0/2343937669 >> v2:172.21.15.146:3300/0 conn(0x7f5c7c154030 0x7f5c7c154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.724+0000 7f5c80bff700 1 -- 172.21.15.72:0/2343937669 >> 172.21.15.72:0/2343937669 conn(0x7f5c7c05eb60 msgr2=0x7f5c7c0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:37.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.724+0000 7f5c80bff700 1 -- 172.21.15.72:0/2343937669 shutdown_connections 2023-08-31T19:03:37.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.724+0000 7f5c80bff700 1 -- 172.21.15.72:0/2343937669 wait complete. 2023-08-31T19:03:37.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.726+0000 7f5c80bff700 1 Processor -- start 2023-08-31T19:03:37.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.726+0000 7f5c80bff700 1 -- start start 2023-08-31T19:03:37.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.727+0000 7f5c80bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c7c0c06b0 0x7f5c7c1662d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:37.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.727+0000 7f5c80bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c7c0c7360 0x7f5c7c0b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:37.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.727+0000 7f5c80bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c7c154030 0x7f5c7c148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:37.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.727+0000 7f5c80bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c1671d0 con 0x7f5c7c0c7360 2023-08-31T19:03:37.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.727+0000 7f5c80bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c166930 con 0x7f5c7c0c06b0 2023-08-31T19:03:37.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.727+0000 7f5c80bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c166c10 con 0x7f5c7c154030 2023-08-31T19:03:37.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.727+0000 7f5c79d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c7c0c7360 0x7f5c7c0b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:37.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.727+0000 7f5c79d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c7c0c7360 0x7f5c7c0b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59650/0 (socket says 172.21.15.72:59650) 2023-08-31T19:03:37.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.727+0000 7f5c79d9b700 1 -- 172.21.15.72:0/597347492 learned_addr learned my addr 172.21.15.72:0/597347492 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:37.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.727+0000 7f5c7a59c700 1 --2- 172.21.15.72:0/597347492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c7c0c06b0 0x7f5c7c1662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:37.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.727+0000 7f5c7ad9d700 1 --2- 172.21.15.72:0/597347492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c7c154030 0x7f5c7c148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:37.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.728+0000 7f5c79d9b700 1 -- 172.21.15.72:0/597347492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c7c154030 msgr2=0x7f5c7c148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:37.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.728+0000 7f5c79d9b700 1 --2- 172.21.15.72:0/597347492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c7c154030 0x7f5c7c148860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.728+0000 7f5c79d9b700 1 -- 172.21.15.72:0/597347492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c7c0c06b0 msgr2=0x7f5c7c1662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:37.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.728+0000 7f5c79d9b700 1 --2- 172.21.15.72:0/597347492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c7c0c06b0 0x7f5c7c1662d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.728+0000 7f5c79d9b700 1 -- 172.21.15.72:0/597347492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c74009a20 con 0x7f5c7c0c7360 2023-08-31T19:03:37.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.728+0000 7f5c79d9b700 1 --2- 172.21.15.72:0/597347492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c7c0c7360 0x7f5c7c0b0980 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f5c7000c4e0 tx=0x7f5c70007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:37.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.728+0000 7f5c6a7fc700 1 -- 172.21.15.72:0/597347492 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7000ce90 con 0x7f5c7c0c7360 2023-08-31T19:03:37.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.728+0000 7f5c6a7fc700 1 -- 172.21.15.72:0/597347492 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c700072e0 con 0x7f5c7c0c7360 2023-08-31T19:03:37.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.728+0000 7f5c80bff700 1 -- 172.21.15.72:0/597347492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7c166ef0 con 0x7f5c7c0c7360 2023-08-31T19:03:37.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.728+0000 7f5c6a7fc700 1 -- 172.21.15.72:0/597347492 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70007660 con 0x7f5c7c0c7360 2023-08-31T19:03:37.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.728+0000 7f5c80bff700 1 -- 172.21.15.72:0/597347492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7c0b0e70 con 0x7f5c7c0c7360 2023-08-31T19:03:37.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.729+0000 7f5c80bff700 1 -- 172.21.15.72:0/597347492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7c06c6b0 con 0x7f5c7c0c7360 2023-08-31T19:03:37.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.730+0000 7f5c6a7fc700 1 -- 172.21.15.72:0/597347492 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f5c700059b0 con 0x7f5c7c0c7360 2023-08-31T19:03:37.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.731+0000 7f5c6a7fc700 1 --2- 172.21.15.72:0/597347492 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5c5c05ef80 0x7f5c5c061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:37.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.731+0000 7f5c7a59c700 1 -- 172.21.15.72:0/597347492 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5c5c05ef80 msgr2=0x7f5c5c061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:37.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.731+0000 7f5c6a7fc700 1 -- 172.21.15.72:0/597347492 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f5c70079b60 con 0x7f5c7c0c7360 2023-08-31T19:03:37.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.731+0000 7f5c7a59c700 1 --2- 172.21.15.72:0/597347492 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5c5c05ef80 0x7f5c5c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:37.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.735+0000 7f5c6a7fc700 1 -- 172.21.15.72:0/597347492 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5c7004ab30 con 0x7f5c7c0c7360 2023-08-31T19:03:37.784 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:37.784+0000 7fede68f4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:03:37.805 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:37.804+0000 7eff9fb16680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:03:37.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.915+0000 7f5c80bff700 1 -- 172.21.15.72:0/597347492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f5c7c0c0c50 con 0x7f5c7c0c7360 2023-08-31T19:03:37.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.920+0000 7f5c6a7fc700 1 -- 172.21.15.72:0/597347492 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5c70018020 con 0x7f5c7c0c7360 2023-08-31T19:03:37.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.922+0000 7f5c80bff700 1 -- 172.21.15.72:0/597347492 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5c5c05ef80 msgr2=0x7f5c5c061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:37.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.922+0000 7f5c80bff700 1 --2- 172.21.15.72:0/597347492 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5c5c05ef80 0x7f5c5c061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:37.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.922+0000 7f5c80bff700 1 -- 172.21.15.72:0/597347492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c7c0c7360 msgr2=0x7f5c7c0b0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:37.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.922+0000 7f5c80bff700 1 --2- 172.21.15.72:0/597347492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c7c0c7360 0x7f5c7c0b0980 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f5c7000c4e0 tx=0x7f5c70007c70).stop 2023-08-31T19:03:37.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.922+0000 7f5c80bff700 1 -- 172.21.15.72:0/597347492 shutdown_connections 2023-08-31T19:03:37.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.922+0000 7f5c80bff700 1 --2- 172.21.15.72:0/597347492 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c7c154030 0x7f5c7c148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.922+0000 7f5c80bff700 1 --2- 172.21.15.72:0/597347492 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5c5c05ef80 0x7f5c5c061440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:37.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.922+0000 7f5c80bff700 1 --2- 172.21.15.72:0/597347492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c7c0c06b0 0x7f5c7c1662d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.922+0000 7f5c80bff700 1 --2- 172.21.15.72:0/597347492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c7c0c7360 0x7f5c7c0b0980 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:37.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.922+0000 7f5c80bff700 1 -- 172.21.15.72:0/597347492 >> 172.21.15.72:0/597347492 conn(0x7f5c7c05eb60 msgr2=0x7f5c7c158aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:37.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.923+0000 7f5c80bff700 1 -- 172.21.15.72:0/597347492 shutdown_connections 2023-08-31T19:03:37.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:37.923+0000 7f5c80bff700 1 -- 172.21.15.72:0/597347492 wait complete. 2023-08-31T19:03:37.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:03:37.941 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-31T19:03:37.995 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-08-31T19:03:38.114 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:38.114+0000 7fede68f4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:03:38.150 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:38.149+0000 7eff9fb16680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:03:38.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.192+0000 7ff9eb9ff700 1 Processor -- start 2023-08-31T19:03:38.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.193+0000 7ff9eb9ff700 1 -- start start 2023-08-31T19:03:38.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.194+0000 7ff9eb9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9e40c4bb0 0x7ff9e40653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:38.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.194+0000 7ff9eb9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e40c4f90 con 0x7ff9e413d960 2023-08-31T19:03:38.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.194+0000 7ff9eb9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e40c6020 con 0x7ff9e40c5aa0 2023-08-31T19:03:38.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.194+0000 7ff9eb9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e41587f0 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.194+0000 7ff9e979b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9e40c4bb0 0x7ff9e40653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:38.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.194+0000 7ff9e8f9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff9e413d960 0x7ff9e40c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50102/0 (socket says 172.21.15.72:50102) 2023-08-31T19:03:38.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.194+0000 7ff9e8f9a700 1 -- 172.21.15.72:0/1804987992 learned_addr learned my addr 172.21.15.72:0/1804987992 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:38.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.195+0000 7ff9dbfff700 1 -- 172.21.15.72:0/1804987992 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641804035 0 0) 0x7ff9e40c4f90 con 0x7ff9e413d960 2023-08-31T19:03:38.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.195+0000 7ff9dbfff700 1 -- 172.21.15.72:0/1804987992 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9d00033f0 con 0x7ff9e413d960 2023-08-31T19:03:38.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.195+0000 7ff9e979b700 1 -- 172.21.15.72:0/1804987992 >> v1:172.21.15.146:6789/0 conn(0x7ff9e40c5aa0 legacy=0x7ff9e4067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:38.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.195+0000 7ff9e979b700 1 -- 172.21.15.72:0/1804987992 >> v1:172.21.15.72:6789/0 conn(0x7ff9e413d960 legacy=0x7ff9e40c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:38.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.195+0000 7ff9e979b700 1 -- 172.21.15.72:0/1804987992 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e4158ad0 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.195+0000 7ff9e979b700 1 --2- 172.21.15.72:0/1804987992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e40c4bb0 0x7ff9e40653d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7ff9e0009760 tx=0x7ff9e0009060).ready entity=mon.0 client_cookie=5e987c1b5f975a14 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:38.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.195+0000 7ff9dbfff700 1 -- 172.21.15.72:0/1804987992 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e000f510 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.195+0000 7ff9dbfff700 1 -- 172.21.15.72:0/1804987992 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e000f670 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.195+0000 7ff9dbfff700 1 -- 172.21.15.72:0/1804987992 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e000f9f0 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.196+0000 7ff9eb9ff700 1 -- 172.21.15.72:0/1804987992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e40c4bb0 msgr2=0x7ff9e40653d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:38.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.196+0000 7ff9eb9ff700 1 --2- 172.21.15.72:0/1804987992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e40c4bb0 0x7ff9e40653d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7ff9e0009760 tx=0x7ff9e0009060).stop 2023-08-31T19:03:38.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.196+0000 7ff9eb9ff700 1 -- 172.21.15.72:0/1804987992 shutdown_connections 2023-08-31T19:03:38.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.196+0000 7ff9eb9ff700 1 --2- 172.21.15.72:0/1804987992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e40c4bb0 0x7ff9e40653d0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:38.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.196+0000 7ff9eb9ff700 1 -- 172.21.15.72:0/1804987992 >> 172.21.15.72:0/1804987992 conn(0x7ff9e4066350 msgr2=0x7ff9e4066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:38.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.196+0000 7ff9eb9ff700 1 -- 172.21.15.72:0/1804987992 shutdown_connections 2023-08-31T19:03:38.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.196+0000 7ff9eb9ff700 1 -- 172.21.15.72:0/1804987992 wait complete. 2023-08-31T19:03:38.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.198+0000 7ff9eb9ff700 1 Processor -- start 2023-08-31T19:03:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.198+0000 7ff9eb9ff700 1 -- start start 2023-08-31T19:03:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.199+0000 7ff9eb9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e40c4bb0 0x7ff9e4139460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.199+0000 7ff9eb9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9e40c5aa0 0x7ff9e40c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.199+0000 7ff9eb9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9e413d960 0x7ff9e4156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.199+0000 7ff9eb9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e413d310 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.199+0000 7ff9eb9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40c0560 con 0x7ff9e40c5aa0 2023-08-31T19:03:38.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.199+0000 7ff9eb9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e41686f0 con 0x7ff9e413d960 2023-08-31T19:03:38.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.199+0000 7ff9e979b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e40c4bb0 0x7ff9e4139460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:38.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.199+0000 7ff9e979b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e40c4bb0 0x7ff9e4139460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59668/0 (socket says 172.21.15.72:59668) 2023-08-31T19:03:38.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.199+0000 7ff9e979b700 1 -- 172.21.15.72:0/2022215598 learned_addr learned my addr 172.21.15.72:0/2022215598 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:38.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.199+0000 7ff9e8f9a700 1 --2- 172.21.15.72:0/2022215598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9e40c5aa0 0x7ff9e40c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:38.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.199+0000 7ff9e9f9c700 1 --2- 172.21.15.72:0/2022215598 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9e413d960 0x7ff9e4156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:38.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.199+0000 7ff9e979b700 1 -- 172.21.15.72:0/2022215598 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9e413d960 msgr2=0x7ff9e4156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:38.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.199+0000 7ff9e979b700 1 --2- 172.21.15.72:0/2022215598 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9e413d960 0x7ff9e4156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:38.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.200+0000 7ff9e979b700 1 -- 172.21.15.72:0/2022215598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9e40c5aa0 msgr2=0x7ff9e40c09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:38.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.200+0000 7ff9e979b700 1 --2- 172.21.15.72:0/2022215598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9e40c5aa0 0x7ff9e40c09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:38.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.200+0000 7ff9e979b700 1 -- 172.21.15.72:0/2022215598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e00092a0 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.200+0000 7ff9e979b700 1 --2- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e40c4bb0 0x7ff9e4139460 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7ff9e0006df0 tx=0x7ff9e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:38.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.200+0000 7ff9d97fa700 1 -- 172.21.15.72:0/2022215598 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e000f7e0 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.200+0000 7ff9d97fa700 1 -- 172.21.15.72:0/2022215598 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e000f940 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.200+0000 7ff9eb9ff700 1 -- 172.21.15.72:0/2022215598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e41689d0 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.200+0000 7ff9d97fa700 1 -- 172.21.15.72:0/2022215598 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e001b670 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.200+0000 7ff9eb9ff700 1 -- 172.21.15.72:0/2022215598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e40c01f0 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.201+0000 7ff9eb9ff700 1 -- 172.21.15.72:0/2022215598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e406c6b0 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.202+0000 7ff9d97fa700 1 -- 172.21.15.72:0/2022215598 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 25) v1 ==== 75391+0+0 (secure 0 0 0) 0x7ff9e001ba60 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.203+0000 7ff9d97fa700 1 --2- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 0x7ff9c8061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:38.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.203+0000 7ff9d97fa700 1 -- 172.21.15.72:0/2022215598 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6721+0+0 (secure 0 0 0) 0x7ff9e007ba70 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.203+0000 7ff9e8f9a700 1 -- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 msgr2=0x7ff9c8061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:38.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.203+0000 7ff9e8f9a700 1 --2- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 0x7ff9c8061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:38.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.207+0000 7ff9d97fa700 1 -- 172.21.15.72:0/2022215598 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff9e004ca40 con 0x7ff9e40c4bb0 2023-08-31T19:03:38.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.404+0000 7ff9e8f9a700 1 -- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 msgr2=0x7ff9c8061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:38.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.404+0000 7ff9e8f9a700 1 --2- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 0x7ff9c8061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:03:38.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.406+0000 7ff9eb9ff700 1 -- 172.21.15.72:0/2022215598 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9e40c19b0 con 0x7ff9c805ef80 2023-08-31T19:03:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.805+0000 7ff9e8f9a700 1 -- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 msgr2=0x7ff9c8061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:38.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:38.805+0000 7ff9e8f9a700 1 --2- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 0x7ff9c8061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-31T19:03:38.858 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:38.858+0000 7fede68f4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:03:38.905 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:38.905+0000 7eff9fb16680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:03:38.940 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:38.940+0000 7fede68f4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:03:38.988 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:38.988+0000 7eff9fb16680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:03:39.170 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:39.170+0000 7fede68f4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:03:39.217 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:39.217+0000 7eff9fb16680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:03:39.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:39.606+0000 7ff9e8f9a700 1 -- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 msgr2=0x7ff9c8061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:39.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:39.606+0000 7ff9e8f9a700 1 --2- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 0x7ff9c8061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-31T19:03:39.678 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:39.678+0000 7fede68f4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:03:39.729 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:39.729+0000 7eff9fb16680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:03:39.803 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:39.803+0000 7fede68f4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:03:39.855 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:39.855+0000 7eff9fb16680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:03:39.986 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:39.986+0000 7fede68f4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:03:40.038 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:40.037+0000 7eff9fb16680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:03:40.079 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:40.079+0000 7fede68f4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:03:40.130 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:40.130+0000 7eff9fb16680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:03:40.163 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:40.163+0000 7fede68f4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:03:40.214 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:40.214+0000 7eff9fb16680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:03:40.472 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:40.472+0000 7fede68f4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:03:40.523 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:40.523+0000 7eff9fb16680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:03:40.694 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:40.694+0000 7fede68f4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:03:40.744 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:40.743+0000 7eff9fb16680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:03:41.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:41.208+0000 7ff9e8f9a700 1 -- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 msgr2=0x7ff9c8061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:41.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:41.208+0000 7ff9e8f9a700 1 --2- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 0x7ff9c8061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-31T19:03:41.491 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:41.491+0000 7fede68f4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:03:41.545 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:41.543+0000 7eff9fb16680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:03:41.577 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:41.577+0000 7fede68f4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:03:41.630 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:41.630+0000 7eff9fb16680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:03:41.670 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:41.670+0000 7fede68f4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:03:41.723 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:41.723+0000 7eff9fb16680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:03:41.852 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:41.852+0000 7fede68f4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:03:41.907 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:41.907+0000 7eff9fb16680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:03:41.941 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:41.941+0000 7fede68f4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:03:41.997 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:41.997+0000 7eff9fb16680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:03:42.081 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:42.080+0000 7fede68f4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:03:42.137 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:42.137+0000 7eff9fb16680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:03:42.210 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:42.210+0000 7fede68f4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:03:42.267 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:42.267+0000 7eff9fb16680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:03:42.556 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:42.556+0000 7fede68f4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:03:42.609 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:42.609+0000 7eff9fb16680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:03:42.644 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:42.644+0000 7fede68f4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:03:42.699 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:42.699+0000 7eff9fb16680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:03:42.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:42.704+0000 7ff9d97fa700 1 -- 172.21.15.72:0/2022215598 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 26) v1 ==== 75391+0+0 (secure 0 0 0) 0x7ff9e00793a0 con 0x7ff9e40c4bb0 2023-08-31T19:03:42.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:42.717+0000 7ff9d97fa700 1 -- 172.21.15.72:0/2022215598 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mgrmap(e 27) v1 ==== 75113+0+0 (secure 0 0 0) 0x7ff9e0075e60 con 0x7ff9e40c4bb0 2023-08-31T19:03:42.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:42.718+0000 7ff9d97fa700 1 -- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 msgr2=0x7ff9c8061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:42.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:42.718+0000 7ff9d97fa700 1 --2- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 0x7ff9c8061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:42.793 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:42.792+0000 7eff155c7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:42.793 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:42.792+0000 7eff155c7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:42.793 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:42.792+0000 7eff155c7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:42.793 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:42.792+0000 7eff155c7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:42.794 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:42.792+0000 7eff155c7700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:42.794 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:42.792+0000 7eff125c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:42.794 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:42.792+0000 7eff125c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:42.794 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:42.792+0000 7eff125c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:42.795 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:42.792+0000 7eff125c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:42.795 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:42.792+0000 7eff125c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:43.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.721+0000 7ff9d97fa700 1 -- 172.21.15.72:0/2022215598 <== mon.0 v2:172.21.15.72:3300/0 9 ==== mgrmap(e 28) v1 ==== 75183+0+0 (secure 0 0 0) 0x7ff9e00759b0 con 0x7ff9e40c4bb0 2023-08-31T19:03:43.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.721+0000 7ff9d97fa700 1 --2- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 0x7ff9c80613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:43.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.721+0000 7ff9d97fa700 1 -- 172.21.15.72:0/2022215598 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9e40c19b0 con 0x7ff9c805ef80 2023-08-31T19:03:43.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.722+0000 7ff9e8f9a700 1 --2- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 0x7ff9c80613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:43.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.726+0000 7ff9e8f9a700 1 --2- 172.21.15.72:0/2022215598 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff9c805ef80 0x7ff9c80613c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff9d4007fd0 tx=0x7ff9d4009040).ready entity=mgr.6435 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:43.729 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:43.729+0000 7eff1ce16700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-08-31T19:03:43.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.729+0000 7ff9d97fa700 1 -- 172.21.15.72:0/2022215598 <== mgr.6435 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7ff9e40c19b0 con 0x7ff9c805ef80 2023-08-31T19:03:43.731 INFO:teuthology.orchestra.run.smithi072.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-08-31T19:03:43.740 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-08-31T19:03:43.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:03:43.742 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-31T19:03:43.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-31T19:03:43.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.984+0000 7ff6e6fff700 1 Processor -- start 2023-08-31T19:03:43.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.984+0000 7ff6e6fff700 1 -- start start 2023-08-31T19:03:43.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.985+0000 7ff6e6fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6e00c38d0 0x7ff6e005e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:43.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.986+0000 7ff6e6fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e00bc4a0 con 0x7ff6e00690e0 2023-08-31T19:03:43.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.986+0000 7ff6e6fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e0069c40 con 0x7ff6e01544e0 2023-08-31T19:03:43.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.986+0000 7ff6e6fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e005e840 con 0x7ff6e00c38d0 2023-08-31T19:03:43.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.986+0000 7ff6dffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff6e00690e0 0x7ff6e00bc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52344/0 (socket says 172.21.15.72:52344) 2023-08-31T19:03:43.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.986+0000 7ff6dffff700 1 -- 172.21.15.72:0/2675978695 learned_addr learned my addr 172.21.15.72:0/2675978695 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:43.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.986+0000 7ff6e559c700 1 --2- 172.21.15.72:0/2675978695 >> v2:172.21.15.146:3300/0 conn(0x7ff6e00c38d0 0x7ff6e005e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:43.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.986+0000 7ff6df7fe700 1 -- 172.21.15.72:0/2675978695 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815323594 0 0) 0x7ff6e00bc4a0 con 0x7ff6e00690e0 2023-08-31T19:03:43.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.986+0000 7ff6df7fe700 1 -- 172.21.15.72:0/2675978695 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6d00033f0 con 0x7ff6e00690e0 2023-08-31T19:03:43.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.986+0000 7ff6e559c700 1 -- 172.21.15.72:0/2675978695 >> v1:172.21.15.146:6789/0 conn(0x7ff6e01544e0 legacy=0x7ff6e00689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:43.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.986+0000 7ff6e559c700 1 -- 172.21.15.72:0/2675978695 >> v1:172.21.15.72:6789/0 conn(0x7ff6e00690e0 legacy=0x7ff6e00bc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:43.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.986+0000 7ff6e559c700 1 -- 172.21.15.72:0/2675978695 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e00c1c30 con 0x7ff6e00c38d0 2023-08-31T19:03:43.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.987+0000 7ff6e559c700 1 --2- 172.21.15.72:0/2675978695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e00c38d0 0x7ff6e005e350 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7ff6d8009e60 tx=0x7ff6d8009780).ready entity=mon.1 client_cookie=de12d4ed546a896f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:43.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.987+0000 7ff6df7fe700 1 -- 172.21.15.72:0/2675978695 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d800e070 con 0x7ff6e00c38d0 2023-08-31T19:03:43.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.987+0000 7ff6df7fe700 1 -- 172.21.15.72:0/2675978695 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d800bb60 con 0x7ff6e00c38d0 2023-08-31T19:03:43.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.987+0000 7ff6df7fe700 1 -- 172.21.15.72:0/2675978695 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8012410 con 0x7ff6e00c38d0 2023-08-31T19:03:43.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.987+0000 7ff6e6fff700 1 -- 172.21.15.72:0/2675978695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e00c38d0 msgr2=0x7ff6e005e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:43.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.987+0000 7ff6e6fff700 1 --2- 172.21.15.72:0/2675978695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e00c38d0 0x7ff6e005e350 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7ff6d8009e60 tx=0x7ff6d8009780).stop 2023-08-31T19:03:43.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.988+0000 7ff6e6fff700 1 -- 172.21.15.72:0/2675978695 shutdown_connections 2023-08-31T19:03:43.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.988+0000 7ff6e6fff700 1 --2- 172.21.15.72:0/2675978695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e00c38d0 0x7ff6e005e350 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:43.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.988+0000 7ff6e6fff700 1 -- 172.21.15.72:0/2675978695 >> 172.21.15.72:0/2675978695 conn(0x7ff6e00c7e00 msgr2=0x7ff6e00c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:43.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.988+0000 7ff6e6fff700 1 -- 172.21.15.72:0/2675978695 shutdown_connections 2023-08-31T19:03:43.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.988+0000 7ff6e6fff700 1 -- 172.21.15.72:0/2675978695 wait complete. 2023-08-31T19:03:43.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.989+0000 7ff6e6fff700 1 Processor -- start 2023-08-31T19:03:43.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.989+0000 7ff6e6fff700 1 -- start start 2023-08-31T19:03:43.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.990+0000 7ff6e6fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e00690e0 0x7ff6e0150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:43.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.990+0000 7ff6e6fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6e00c38d0 0x7ff6e00aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:43.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.990+0000 7ff6e6fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e01544e0 0x7ff6e00ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:43.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.990+0000 7ff6e6fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00bf6c0 con 0x7ff6e01544e0 2023-08-31T19:03:43.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.990+0000 7ff6e6fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00ab720 con 0x7ff6e00690e0 2023-08-31T19:03:43.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.990+0000 7ff6e6fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00aba00 con 0x7ff6e00c38d0 2023-08-31T19:03:43.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.990+0000 7ff6e559c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e01544e0 0x7ff6e00ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:43.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.990+0000 7ff6e559c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e01544e0 0x7ff6e00ac990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43452/0 (socket says 172.21.15.72:43452) 2023-08-31T19:03:43.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.990+0000 7ff6e559c700 1 -- 172.21.15.72:0/3245511165 learned_addr learned my addr 172.21.15.72:0/3245511165 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:43.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.991+0000 7ff6dffff700 1 --2- 172.21.15.72:0/3245511165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6e00c38d0 0x7ff6e00aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:43.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.991+0000 7ff6e4d9b700 1 --2- 172.21.15.72:0/3245511165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e00690e0 0x7ff6e0150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:43.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.991+0000 7ff6e559c700 1 -- 172.21.15.72:0/3245511165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6e00c38d0 msgr2=0x7ff6e00aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:43.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.991+0000 7ff6e559c700 1 --2- 172.21.15.72:0/3245511165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6e00c38d0 0x7ff6e00aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:43.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.991+0000 7ff6e559c700 1 -- 172.21.15.72:0/3245511165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e00690e0 msgr2=0x7ff6e0150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:43.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.991+0000 7ff6e559c700 1 --2- 172.21.15.72:0/3245511165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e00690e0 0x7ff6e0150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:43.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.991+0000 7ff6e559c700 1 -- 172.21.15.72:0/3245511165 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d8009a20 con 0x7ff6e01544e0 2023-08-31T19:03:43.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.991+0000 7ff6e559c700 1 --2- 172.21.15.72:0/3245511165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e01544e0 0x7ff6e00ac990 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7ff6d800b6c0 tx=0x7ff6d8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:43.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.991+0000 7ff6dcff9700 1 -- 172.21.15.72:0/3245511165 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d801c660 con 0x7ff6e01544e0 2023-08-31T19:03:43.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.991+0000 7ff6dcff9700 1 -- 172.21.15.72:0/3245511165 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d801c7e0 con 0x7ff6e01544e0 2023-08-31T19:03:43.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.991+0000 7ff6e6fff700 1 -- 172.21.15.72:0/3245511165 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e00abce0 con 0x7ff6e01544e0 2023-08-31T19:03:43.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.991+0000 7ff6dcff9700 1 -- 172.21.15.72:0/3245511165 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d801cba0 con 0x7ff6e01544e0 2023-08-31T19:03:43.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.991+0000 7ff6e6fff700 1 -- 172.21.15.72:0/3245511165 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e00bf250 con 0x7ff6e01544e0 2023-08-31T19:03:43.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.993+0000 7ff6e6fff700 1 -- 172.21.15.72:0/3245511165 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e00bf830 con 0x7ff6e01544e0 2023-08-31T19:03:43.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.993+0000 7ff6dcff9700 1 -- 172.21.15.72:0/3245511165 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 28) v1 ==== 75183+0+0 (secure 0 0 0) 0x7ff6d8003040 con 0x7ff6e01544e0 2023-08-31T19:03:44.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.995+0000 7ff6dcff9700 1 --2- 172.21.15.72:0/3245511165 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff6c405ed40 0x7ff6c4061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:44.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.995+0000 7ff6dcff9700 1 -- 172.21.15.72:0/3245511165 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6979+0+0 (secure 0 0 0) 0x7ff6d807bf70 con 0x7ff6e01544e0 2023-08-31T19:03:44.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.995+0000 7ff6e4d9b700 1 --2- 172.21.15.72:0/3245511165 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff6c405ed40 0x7ff6c4061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:44.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.996+0000 7ff6e4d9b700 1 --2- 172.21.15.72:0/3245511165 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff6c405ed40 0x7ff6c4061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff6d4003630 tx=0x7ff6d4009040).ready entity=mgr.6435 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:44.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:43.999+0000 7ff6dcff9700 1 -- 172.21.15.72:0/3245511165 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff6d80aa8f0 con 0x7ff6e01544e0 2023-08-31T19:03:44.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:44.208+0000 7ff6e6fff700 1 -- 172.21.15.72:0/3245511165 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7ff6e006c6b0 con 0x7ff6e01544e0 2023-08-31T19:03:44.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:44.727+0000 7ff6dcff9700 1 -- 172.21.15.72:0/3245511165 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 29) v1 ==== 75431+0+0 (secure 0 0 0) 0x7ff6d8079b30 con 0x7ff6e01544e0 2023-08-31T19:03:44.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:44.729+0000 7ff6dcff9700 1 -- 172.21.15.72:0/3245511165 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v29) v1 ==== 93+0+0 (secure 0 0 0) 0x7ff6d8043550 con 0x7ff6e01544e0 2023-08-31T19:03:44.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:44.732+0000 7ff6e6fff700 1 -- 172.21.15.72:0/3245511165 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff6c405ed40 msgr2=0x7ff6c4061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:44.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:44.732+0000 7ff6e6fff700 1 --2- 172.21.15.72:0/3245511165 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff6c405ed40 0x7ff6c4061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff6d4003630 tx=0x7ff6d4009040).stop 2023-08-31T19:03:44.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:44.732+0000 7ff6e6fff700 1 -- 172.21.15.72:0/3245511165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e01544e0 msgr2=0x7ff6e00ac990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:44.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:44.732+0000 7ff6e6fff700 1 --2- 172.21.15.72:0/3245511165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e01544e0 0x7ff6e00ac990 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7ff6d800b6c0 tx=0x7ff6d8009780).stop 2023-08-31T19:03:44.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:44.732+0000 7ff6e6fff700 1 -- 172.21.15.72:0/3245511165 shutdown_connections 2023-08-31T19:03:44.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:44.732+0000 7ff6e6fff700 1 --2- 172.21.15.72:0/3245511165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6e01544e0 0x7ff6e00ac990 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:44.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:44.732+0000 7ff6e6fff700 1 --2- 172.21.15.72:0/3245511165 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff6c405ed40 0x7ff6c4061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:44.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:44.732+0000 7ff6e6fff700 1 --2- 172.21.15.72:0/3245511165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6e00690e0 0x7ff6e0150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:44.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:44.732+0000 7ff6e6fff700 1 --2- 172.21.15.72:0/3245511165 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff6e00c38d0 0x7ff6e00aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:44.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:44.732+0000 7ff6e6fff700 1 -- 172.21.15.72:0/3245511165 >> 172.21.15.72:0/3245511165 conn(0x7ff6e00c7e00 msgr2=0x7ff6e00c5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:44.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:44.732+0000 7ff6e6fff700 1 -- 172.21.15.72:0/3245511165 shutdown_connections 2023-08-31T19:03:44.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:44.732+0000 7ff6e6fff700 1 -- 172.21.15.72:0/3245511165 wait complete. 2023-08-31T19:03:44.758 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:03:44.759 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:03:44.869 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:03:44.948 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:44.948+0000 7f57b780a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:03:44.956 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:44.956+0000 7f6595f04680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:03:44.982 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:03:44.983 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-31T19:03:44.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:03:44.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-31T19:03:45.032 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:45.032+0000 7f57b780a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:03:45.043 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:45.043+0000 7f6595f04680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:03:45.078 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T19:03:45.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:03:45.079 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T19:03:45.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:03:45.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.319+0000 7fb4645ff700 1 Processor -- start 2023-08-31T19:03:45.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.320+0000 7fb4645ff700 1 -- start start 2023-08-31T19:03:45.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.321+0000 7fb4645ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb45c0c9ca0 0x7fb45c1583f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:45.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.321+0000 7fb4645ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c0c7620 con 0x7fb45c1588e0 2023-08-31T19:03:45.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.321+0000 7fb4645ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c0c0830 con 0x7fb45c1575b0 2023-08-31T19:03:45.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.321+0000 7fb4645ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0c0b10 con 0x7fb45c0c9ca0 2023-08-31T19:03:45.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.321+0000 7fb462b9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb45c1588e0 0x7fb45c0c5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52358/0 (socket says 172.21.15.72:52358) 2023-08-31T19:03:45.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.321+0000 7fb462b9c700 1 -- 172.21.15.72:0/399116044 learned_addr learned my addr 172.21.15.72:0/399116044 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:45.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.321+0000 7fb461b9a700 1 --2- 172.21.15.72:0/399116044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb45c0c9ca0 0x7fb45c1583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:45.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.322+0000 7fb461399700 1 -- 172.21.15.72:0/399116044 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426470328 0 0) 0x7fb45c0c7620 con 0x7fb45c1588e0 2023-08-31T19:03:45.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.322+0000 7fb461399700 1 -- 172.21.15.72:0/399116044 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4480033f0 con 0x7fb45c1588e0 2023-08-31T19:03:45.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.322+0000 7fb461399700 1 -- 172.21.15.72:0/399116044 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340699899 0 0) 0x7fb45c0c0830 con 0x7fb45c1575b0 2023-08-31T19:03:45.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.322+0000 7fb461399700 1 -- 172.21.15.72:0/399116044 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb45c0c7620 con 0x7fb45c1575b0 2023-08-31T19:03:45.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.322+0000 7fb461b9a700 1 -- 172.21.15.72:0/399116044 >> v1:172.21.15.146:6789/0 conn(0x7fb45c1575b0 legacy=0x7fb45c157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:45.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.322+0000 7fb461b9a700 1 -- 172.21.15.72:0/399116044 >> v1:172.21.15.72:6789/0 conn(0x7fb45c1588e0 legacy=0x7fb45c0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:45.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.322+0000 7fb461b9a700 1 -- 172.21.15.72:0/399116044 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c0c0df0 con 0x7fb45c0c9ca0 2023-08-31T19:03:45.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.322+0000 7fb461b9a700 1 --2- 172.21.15.72:0/399116044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb45c0c9ca0 0x7fb45c1583f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb44c009790 tx=0x7fb44c009060).ready entity=mon.2 client_cookie=7b882798e1a0842f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:45.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.322+0000 7fb461399700 1 -- 172.21.15.72:0/399116044 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c00f510 con 0x7fb45c0c9ca0 2023-08-31T19:03:45.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.322+0000 7fb461399700 1 -- 172.21.15.72:0/399116044 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c00f670 con 0x7fb45c0c9ca0 2023-08-31T19:03:45.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.322+0000 7fb461399700 1 -- 172.21.15.72:0/399116044 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c00f9f0 con 0x7fb45c0c9ca0 2023-08-31T19:03:45.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.323+0000 7fb4645ff700 1 -- 172.21.15.72:0/399116044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb45c0c9ca0 msgr2=0x7fb45c1583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:45.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.323+0000 7fb4645ff700 1 --2- 172.21.15.72:0/399116044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb45c0c9ca0 0x7fb45c1583f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb44c009790 tx=0x7fb44c009060).stop 2023-08-31T19:03:45.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.323+0000 7fb4645ff700 1 -- 172.21.15.72:0/399116044 shutdown_connections 2023-08-31T19:03:45.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.323+0000 7fb4645ff700 1 --2- 172.21.15.72:0/399116044 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb45c0c9ca0 0x7fb45c1583f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:45.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.323+0000 7fb4645ff700 1 -- 172.21.15.72:0/399116044 >> 172.21.15.72:0/399116044 conn(0x7fb45c05e870 msgr2=0x7fb45c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:45.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.323+0000 7fb4645ff700 1 -- 172.21.15.72:0/399116044 shutdown_connections 2023-08-31T19:03:45.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.323+0000 7fb4645ff700 1 -- 172.21.15.72:0/399116044 wait complete. 2023-08-31T19:03:45.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.325+0000 7fb4645ff700 1 Processor -- start 2023-08-31T19:03:45.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.325+0000 7fb4645ff700 1 -- start start 2023-08-31T19:03:45.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb4645ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb45c0c9ca0 0x7fb45c0c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:45.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb4645ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb45c1575b0 0x7fb45c153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:45.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb4645ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c1588e0 0x7fb45c157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:45.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb4645ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0b0c40 con 0x7fb45c1588e0 2023-08-31T19:03:45.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb4645ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c168300 con 0x7fb45c1575b0 2023-08-31T19:03:45.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb4645ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c1685e0 con 0x7fb45c0c9ca0 2023-08-31T19:03:45.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb462b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c1588e0 0x7fb45c157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:45.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb462b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c1588e0 0x7fb45c157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43484/0 (socket says 172.21.15.72:43484) 2023-08-31T19:03:45.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb462b9c700 1 -- 172.21.15.72:0/3143430391 learned_addr learned my addr 172.21.15.72:0/3143430391 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:45.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb461b9a700 1 --2- 172.21.15.72:0/3143430391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb45c1575b0 0x7fb45c153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:45.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb46239b700 1 --2- 172.21.15.72:0/3143430391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb45c0c9ca0 0x7fb45c0c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:45.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb462b9c700 1 -- 172.21.15.72:0/3143430391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb45c0c9ca0 msgr2=0x7fb45c0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:45.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb462b9c700 1 --2- 172.21.15.72:0/3143430391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb45c0c9ca0 0x7fb45c0c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:45.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb462b9c700 1 -- 172.21.15.72:0/3143430391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb45c1575b0 msgr2=0x7fb45c153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:45.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb462b9c700 1 --2- 172.21.15.72:0/3143430391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb45c1575b0 0x7fb45c153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:45.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.326+0000 7fb462b9c700 1 -- 172.21.15.72:0/3143430391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c0092a0 con 0x7fb45c1588e0 2023-08-31T19:03:45.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.327+0000 7fb462b9c700 1 --2- 172.21.15.72:0/3143430391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c1588e0 0x7fb45c157990 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fb454001560 tx=0x7fb4540015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:45.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.327+0000 7fb4527fc700 1 -- 172.21.15.72:0/3143430391 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454005d30 con 0x7fb45c1588e0 2023-08-31T19:03:45.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.327+0000 7fb4527fc700 1 -- 172.21.15.72:0/3143430391 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb454005e90 con 0x7fb45c1588e0 2023-08-31T19:03:45.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.327+0000 7fb4527fc700 1 -- 172.21.15.72:0/3143430391 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4540072e0 con 0x7fb45c1588e0 2023-08-31T19:03:45.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.327+0000 7fb4645ff700 1 -- 172.21.15.72:0/3143430391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c1688c0 con 0x7fb45c1588e0 2023-08-31T19:03:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.327+0000 7fb4645ff700 1 -- 172.21.15.72:0/3143430391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c0c4c60 con 0x7fb45c1588e0 2023-08-31T19:03:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.328+0000 7fb4645ff700 1 -- 172.21.15.72:0/3143430391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45c06c6b0 con 0x7fb45c1588e0 2023-08-31T19:03:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.329+0000 7fb4527fc700 1 -- 172.21.15.72:0/3143430391 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fb454007650 con 0x7fb45c1588e0 2023-08-31T19:03:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.329+0000 7fb4527fc700 1 --2- 172.21.15.72:0/3143430391 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb44005efc0 0x7fb440061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.330+0000 7fb4527fc700 1 -- 172.21.15.72:0/3143430391 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6979+0+0 (secure 0 0 0) 0x7fb454079e40 con 0x7fb45c1588e0 2023-08-31T19:03:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.330+0000 7fb46239b700 1 -- 172.21.15.72:0/3143430391 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb44005efc0 msgr2=0x7fb440061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:45.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.330+0000 7fb46239b700 1 --2- 172.21.15.72:0/3143430391 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb44005efc0 0x7fb440061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:45.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.334+0000 7fb4527fc700 1 -- 172.21.15.72:0/3143430391 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb45404ac50 con 0x7fb45c1588e0 2023-08-31T19:03:45.363 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:45.363+0000 7f57b780a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:03:45.394 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:45.394+0000 7f6595f04680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:03:45.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.531+0000 7fb46239b700 1 -- 172.21.15.72:0/3143430391 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb44005efc0 msgr2=0x7fb440061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:45.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.531+0000 7fb46239b700 1 --2- 172.21.15.72:0/3143430391 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb44005efc0 0x7fb440061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:03:45.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.552+0000 7fb4645ff700 1 -- 172.21.15.72:0/3143430391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb45c168d60 con 0x7fb45c1588e0 2023-08-31T19:03:45.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.553+0000 7fb4527fc700 1 -- 172.21.15.72:0/3143430391 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4496 (secure 0 0 0) 0x7fb45404e270 con 0x7fb45c1588e0 2023-08-31T19:03:45.553 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:45.553 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5890,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1362322123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1362322123},{"type":"v1","addr":"172.21.15.146:6834","nonce":1362322123}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5893,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2001208412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2001208412},{"type":"v1","addr":"172.21.15.146:6835","nonce":2001208412}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3154756193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3154756193},{"type":"v1","addr":"172.21.15.72:6835","nonce":3154756193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:03:28.969345+0000","modified":"2023-08-31T19:03:31.984576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6252},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6252":{"gid":6252,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/2633506693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2633506693},{"type":"v1","addr":"172.21.15.72:6837","nonce":2633506693}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-31T19:03:45.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.555+0000 7fb4645ff700 1 -- 172.21.15.72:0/3143430391 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb44005efc0 msgr2=0x7fb440061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:45.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.555+0000 7fb4645ff700 1 --2- 172.21.15.72:0/3143430391 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb44005efc0 0x7fb440061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:45.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.555+0000 7fb4645ff700 1 -- 172.21.15.72:0/3143430391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c1588e0 msgr2=0x7fb45c157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:45.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.555+0000 7fb4645ff700 1 --2- 172.21.15.72:0/3143430391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c1588e0 0x7fb45c157990 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fb454001560 tx=0x7fb4540015b0).stop 2023-08-31T19:03:45.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.555+0000 7fb4645ff700 1 -- 172.21.15.72:0/3143430391 shutdown_connections 2023-08-31T19:03:45.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.555+0000 7fb4645ff700 1 --2- 172.21.15.72:0/3143430391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb45c1588e0 0x7fb45c157990 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:45.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.555+0000 7fb4645ff700 1 --2- 172.21.15.72:0/3143430391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb45c0c9ca0 0x7fb45c0c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:45.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.555+0000 7fb4645ff700 1 --2- 172.21.15.72:0/3143430391 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb44005efc0 0x7fb440061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:45.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.555+0000 7fb4645ff700 1 --2- 172.21.15.72:0/3143430391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb45c1575b0 0x7fb45c153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:45.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.555+0000 7fb4645ff700 1 -- 172.21.15.72:0/3143430391 >> 172.21.15.72:0/3143430391 conn(0x7fb45c05e870 msgr2=0x7fb45c1547c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:45.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.555+0000 7fb4645ff700 1 -- 172.21.15.72:0/3143430391 shutdown_connections 2023-08-31T19:03:45.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.555+0000 7fb4645ff700 1 -- 172.21.15.72:0/3143430391 wait complete. 2023-08-31T19:03:45.558 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 32 2023-08-31T19:03:45.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:03:45.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.766+0000 7fafa57ff700 1 Processor -- start 2023-08-31T19:03:45.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.766+0000 7fafa57ff700 1 -- start start 2023-08-31T19:03:45.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.767+0000 7fafa57ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fafa00cb9b0 0x7fafa01583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:45.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.767+0000 7fafa57ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafa01588d0 0x7fafa0154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:45.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.767+0000 7fafa57ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa00c6120 con 0x7fafa0154060 2023-08-31T19:03:45.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.767+0000 7fafa57ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa00c1380 con 0x7fafa00cb9b0 2023-08-31T19:03:45.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.767+0000 7fafa57ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00c5e10 con 0x7fafa01588d0 2023-08-31T19:03:45.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.768+0000 7faf9e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fafa00cb9b0 0x7fafa01583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:45.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.768+0000 7faf9e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fafa00cb9b0 0x7fafa01583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43488/0 (socket says 172.21.15.72:43488) 2023-08-31T19:03:45.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.768+0000 7faf9e7fc700 1 -- 172.21.15.72:0/2246018644 learned_addr learned my addr 172.21.15.72:0/2246018644 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:45.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.768+0000 7faf9effd700 1 --1- 172.21.15.72:0/2246018644 >> v1:172.21.15.72:6789/0 conn(0x7fafa0154060 0x7fafa0157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52374/0 (socket says 172.21.15.72:52374) 2023-08-31T19:03:45.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.768+0000 7faf9f7fe700 1 --2- 172.21.15.72:0/2246018644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafa01588d0 0x7fafa0154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:45.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.768+0000 7faf9e7fc700 1 -- 172.21.15.72:0/2246018644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafa01588d0 msgr2=0x7fafa0154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:45.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.768+0000 7faf9e7fc700 1 --2- 172.21.15.72:0/2246018644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafa01588d0 0x7fafa0154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:45.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.768+0000 7faf9e7fc700 1 -- 172.21.15.72:0/2246018644 >> v1:172.21.15.72:6789/0 conn(0x7fafa0154060 legacy=0x7fafa0157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:45.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.768+0000 7faf9e7fc700 1 -- 172.21.15.72:0/2246018644 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa00c0ae0 con 0x7fafa00cb9b0 2023-08-31T19:03:45.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.768+0000 7faf9f7fe700 1 --2- 172.21.15.72:0/2246018644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafa01588d0 0x7fafa0154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:45.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.768+0000 7faf9e7fc700 1 --2- 172.21.15.72:0/2246018644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa00cb9b0 0x7fafa01583e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7faf94006fd0 tx=0x7faf940090f0).ready entity=mon.0 client_cookie=293d5e2852ec5d29 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:45.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.769+0000 7faf9dffb700 1 -- 172.21.15.72:0/2246018644 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9400b600 con 0x7fafa00cb9b0 2023-08-31T19:03:45.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.769+0000 7faf9dffb700 1 -- 172.21.15.72:0/2246018644 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9400b760 con 0x7fafa00cb9b0 2023-08-31T19:03:45.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.769+0000 7faf9dffb700 1 -- 172.21.15.72:0/2246018644 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9400bae0 con 0x7fafa00cb9b0 2023-08-31T19:03:45.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.769+0000 7fafa57ff700 1 -- 172.21.15.72:0/2246018644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa00cb9b0 msgr2=0x7fafa01583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:45.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.769+0000 7fafa57ff700 1 --2- 172.21.15.72:0/2246018644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa00cb9b0 0x7fafa01583e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7faf94006fd0 tx=0x7faf940090f0).stop 2023-08-31T19:03:45.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.769+0000 7fafa57ff700 1 -- 172.21.15.72:0/2246018644 shutdown_connections 2023-08-31T19:03:45.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.769+0000 7fafa57ff700 1 --2- 172.21.15.72:0/2246018644 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafa01588d0 0x7fafa0154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:45.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.769+0000 7fafa57ff700 1 --2- 172.21.15.72:0/2246018644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa00cb9b0 0x7fafa01583e0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:45.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.769+0000 7fafa57ff700 1 -- 172.21.15.72:0/2246018644 >> 172.21.15.72:0/2246018644 conn(0x7fafa005e870 msgr2=0x7fafa00cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:45.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.769+0000 7fafa57ff700 1 -- 172.21.15.72:0/2246018644 shutdown_connections 2023-08-31T19:03:45.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.769+0000 7fafa57ff700 1 -- 172.21.15.72:0/2246018644 wait complete. 2023-08-31T19:03:45.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.771+0000 7fafa57ff700 1 Processor -- start 2023-08-31T19:03:45.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.771+0000 7fafa57ff700 1 -- start start 2023-08-31T19:03:45.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.772+0000 7fafa57ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa00cb9b0 0x7fafa00ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:45.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.772+0000 7fafa57ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0154060 0x7fafa0164db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:45.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.772+0000 7fafa57ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafa01588d0 0x7fafa01513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:45.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.772+0000 7fafa57ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00aab00 con 0x7fafa0154060 2023-08-31T19:03:45.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.772+0000 7fafa57ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa01652a0 con 0x7fafa00cb9b0 2023-08-31T19:03:45.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.772+0000 7fafa57ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00acd80 con 0x7fafa01588d0 2023-08-31T19:03:45.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.772+0000 7faf9e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0154060 0x7fafa0164db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:45.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.772+0000 7faf9e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0154060 0x7fafa0164db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43500/0 (socket says 172.21.15.72:43500) 2023-08-31T19:03:45.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.772+0000 7faf9e7fc700 1 -- 172.21.15.72:0/3959987960 learned_addr learned my addr 172.21.15.72:0/3959987960 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:45.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.772+0000 7faf9f7fe700 1 --2- 172.21.15.72:0/3959987960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafa01588d0 0x7fafa01513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:45.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.772+0000 7faf9effd700 1 --2- 172.21.15.72:0/3959987960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa00cb9b0 0x7fafa00ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:45.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.773+0000 7faf9e7fc700 1 -- 172.21.15.72:0/3959987960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafa01588d0 msgr2=0x7fafa01513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:45.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.773+0000 7faf9e7fc700 1 --2- 172.21.15.72:0/3959987960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafa01588d0 0x7fafa01513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:45.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.773+0000 7faf9e7fc700 1 -- 172.21.15.72:0/3959987960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa00cb9b0 msgr2=0x7fafa00ac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:45.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.773+0000 7faf9e7fc700 1 --2- 172.21.15.72:0/3959987960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa00cb9b0 0x7fafa00ac7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:45.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.773+0000 7faf9e7fc700 1 -- 172.21.15.72:0/3959987960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf94009370 con 0x7fafa0154060 2023-08-31T19:03:45.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.773+0000 7faf9effd700 1 --2- 172.21.15.72:0/3959987960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa00cb9b0 0x7fafa00ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:45.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.773+0000 7faf9e7fc700 1 --2- 172.21.15.72:0/3959987960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0154060 0x7fafa0164db0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7faf94009f50 tx=0x7faf94017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:45.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.773+0000 7faf86ffd700 1 -- 172.21.15.72:0/3959987960 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9400b8d0 con 0x7fafa0154060 2023-08-31T19:03:45.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.773+0000 7faf86ffd700 1 -- 172.21.15.72:0/3959987960 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9400ba30 con 0x7fafa0154060 2023-08-31T19:03:45.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.773+0000 7fafa57ff700 1 -- 172.21.15.72:0/3959987960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa00ad060 con 0x7fafa0154060 2023-08-31T19:03:45.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.773+0000 7faf86ffd700 1 -- 172.21.15.72:0/3959987960 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9401b660 con 0x7fafa0154060 2023-08-31T19:03:45.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.773+0000 7fafa57ff700 1 -- 172.21.15.72:0/3959987960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa00ad620 con 0x7fafa0154060 2023-08-31T19:03:45.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.775+0000 7fafa57ff700 1 -- 172.21.15.72:0/3959987960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa006c6b0 con 0x7fafa0154060 2023-08-31T19:03:45.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.775+0000 7faf86ffd700 1 -- 172.21.15.72:0/3959987960 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 75431+0+0 (secure 0 0 0) 0x7faf9401ba50 con 0x7fafa0154060 2023-08-31T19:03:45.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.776+0000 7faf86ffd700 1 --2- 172.21.15.72:0/3959987960 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf8c05efc0 0x7faf8c061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:45.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.776+0000 7faf86ffd700 1 -- 172.21.15.72:0/3959987960 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6979+0+0 (secure 0 0 0) 0x7faf9407bf60 con 0x7fafa0154060 2023-08-31T19:03:45.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.776+0000 7faf9effd700 1 -- 172.21.15.72:0/3959987960 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf8c05efc0 msgr2=0x7faf8c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:45.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.776+0000 7faf9effd700 1 --2- 172.21.15.72:0/3959987960 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf8c05efc0 0x7faf8c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:45.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.780+0000 7faf86ffd700 1 -- 172.21.15.72:0/3959987960 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faf9404cd70 con 0x7fafa0154060 2023-08-31T19:03:45.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.960+0000 7fafa57ff700 1 -- 172.21.15.72:0/3959987960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafa00c0dc0 con 0x7fafa0154060 2023-08-31T19:03:45.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.961+0000 7faf86ffd700 1 -- 172.21.15.72:0/3959987960 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18302 (secure 0 0 0) 0x7faf94029030 con 0x7fafa0154060 2023-08-31T19:03:45.962 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:45.962 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":80,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:03:42.707097+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:03:26.723490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-31T19:03:27.961871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6833/143463":"2023-09-01T19:03:42.707063+0000","172.21.15.72:0/4168262345":"2023-09-01T19:03:42.707063+0000","172.21.15.72:6832/143463":"2023-09-01T19:03:42.707063+0000","172.21.15.72:0/2848937816":"2023-09-01T19:03:42.707063+0000","172.21.15.72:0/4145724724":"2023-09-01T19:03:42.707063+0000","172.21.15.72:0/1172218123":"2023-09-01T19:03:42.707063+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:03:45.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.964+0000 7fafa57ff700 1 -- 172.21.15.72:0/3959987960 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf8c05efc0 msgr2=0x7faf8c061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:45.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.964+0000 7fafa57ff700 1 --2- 172.21.15.72:0/3959987960 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf8c05efc0 0x7faf8c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:45.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.964+0000 7fafa57ff700 1 -- 172.21.15.72:0/3959987960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0154060 msgr2=0x7fafa0164db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:45.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.964+0000 7fafa57ff700 1 --2- 172.21.15.72:0/3959987960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0154060 0x7fafa0164db0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7faf94009f50 tx=0x7faf94017000).stop 2023-08-31T19:03:45.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.964+0000 7fafa57ff700 1 -- 172.21.15.72:0/3959987960 shutdown_connections 2023-08-31T19:03:45.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.964+0000 7fafa57ff700 1 --2- 172.21.15.72:0/3959987960 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafa01588d0 0x7fafa01513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:45.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.964+0000 7fafa57ff700 1 --2- 172.21.15.72:0/3959987960 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf8c05efc0 0x7faf8c061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:45.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.964+0000 7fafa57ff700 1 --2- 172.21.15.72:0/3959987960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafa00cb9b0 0x7fafa00ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:45.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.964+0000 7fafa57ff700 1 --2- 172.21.15.72:0/3959987960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0154060 0x7fafa0164db0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:45.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.964+0000 7fafa57ff700 1 -- 172.21.15.72:0/3959987960 >> 172.21.15.72:0/3959987960 conn(0x7fafa005e870 msgr2=0x7fafa0152870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:45.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.964+0000 7fafa57ff700 1 -- 172.21.15.72:0/3959987960 shutdown_connections 2023-08-31T19:03:45.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:45.964+0000 7fafa57ff700 1 -- 172.21.15.72:0/3959987960 wait complete. 2023-08-31T19:03:45.984 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:03:26.723490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:03:27.961871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:03:45.985 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:03:46.107 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:46.107+0000 7f57b780a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:03:46.181 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:46.181+0000 7f6595f04680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:03:46.191 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:46.191+0000 7f57b780a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:03:46.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.209+0000 7f49315ff700 1 Processor -- start 2023-08-31T19:03:46.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.209+0000 7f49315ff700 1 -- start start 2023-08-31T19:03:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.210+0000 7f49315ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f492c154210 0x7f492c0630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.210+0000 7f49315ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492c063a30 con 0x7f492c153e30 2023-08-31T19:03:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.210+0000 7f49315ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492c0bfd40 con 0x7f492c0635a0 2023-08-31T19:03:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.210+0000 7f49315ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492c1546c0 con 0x7f492c154210 2023-08-31T19:03:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.210+0000 7f492a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f492c154210 0x7f492c0630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.210+0000 7f492affd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f492c153e30 0x7f492c0c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52384/0 (socket says 172.21.15.72:52384) 2023-08-31T19:03:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.210+0000 7f492affd700 1 -- 172.21.15.72:0/202368381 learned_addr learned my addr 172.21.15.72:0/202368381 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.211+0000 7f492a7fc700 1 -- 172.21.15.72:0/202368381 >> v1:172.21.15.146:6789/0 conn(0x7f492c0635a0 legacy=0x7f492c0c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.211+0000 7f492a7fc700 1 -- 172.21.15.72:0/202368381 >> v1:172.21.15.72:6789/0 conn(0x7f492c153e30 legacy=0x7f492c0c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.211+0000 7f492a7fc700 1 -- 172.21.15.72:0/202368381 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c0c6730 con 0x7f492c154210 2023-08-31T19:03:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.211+0000 7f492a7fc700 1 --2- 172.21.15.72:0/202368381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c154210 0x7f492c0630b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f4920009760 tx=0x7f4920009060).ready entity=mon.0 client_cookie=60f542b9880def1 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:46.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.211+0000 7f4929ffb700 1 -- 172.21.15.72:0/202368381 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492000b580 con 0x7f492c154210 2023-08-31T19:03:46.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.211+0000 7f4929ffb700 1 -- 172.21.15.72:0/202368381 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492000b6e0 con 0x7f492c154210 2023-08-31T19:03:46.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.211+0000 7f4929ffb700 1 -- 172.21.15.72:0/202368381 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492000ba60 con 0x7f492c154210 2023-08-31T19:03:46.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.212+0000 7f49315ff700 1 -- 172.21.15.72:0/202368381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c154210 msgr2=0x7f492c0630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:46.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.212+0000 7f49315ff700 1 --2- 172.21.15.72:0/202368381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c154210 0x7f492c0630b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f4920009760 tx=0x7f4920009060).stop 2023-08-31T19:03:46.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.212+0000 7f49315ff700 1 -- 172.21.15.72:0/202368381 shutdown_connections 2023-08-31T19:03:46.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.212+0000 7f49315ff700 1 --2- 172.21.15.72:0/202368381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c154210 0x7f492c0630b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:46.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.212+0000 7f49315ff700 1 -- 172.21.15.72:0/202368381 >> 172.21.15.72:0/202368381 conn(0x7f492c05eb20 msgr2=0x7f492c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:46.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.212+0000 7f49315ff700 1 -- 172.21.15.72:0/202368381 shutdown_connections 2023-08-31T19:03:46.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.212+0000 7f49315ff700 1 -- 172.21.15.72:0/202368381 wait complete. 2023-08-31T19:03:46.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.213+0000 7f49315ff700 1 Processor -- start 2023-08-31T19:03:46.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.214+0000 7f49315ff700 1 -- start start 2023-08-31T19:03:46.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.214+0000 7f49315ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c0635a0 0x7f492c0b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:46.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.214+0000 7f49315ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492c153e30 0x7f492c141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:46.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.214+0000 7f49315ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f492c154210 0x7f492c14ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:46.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.214+0000 7f49315ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c0aee40 con 0x7f492c0635a0 2023-08-31T19:03:46.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.214+0000 7f49315ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c14f600 con 0x7f492c153e30 2023-08-31T19:03:46.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.214+0000 7f49315ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c0af950 con 0x7f492c154210 2023-08-31T19:03:46.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.215+0000 7f492affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c0635a0 0x7f492c0b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:46.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.215+0000 7f492affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c0635a0 0x7f492c0b09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43512/0 (socket says 172.21.15.72:43512) 2023-08-31T19:03:46.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.215+0000 7f492affd700 1 -- 172.21.15.72:0/1991027325 learned_addr learned my addr 172.21.15.72:0/1991027325 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:46.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.215+0000 7f492a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492c153e30 0x7f492c141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:46.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.215+0000 7f492b7fe700 1 --2- 172.21.15.72:0/1991027325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f492c154210 0x7f492c14ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:46.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.215+0000 7f492affd700 1 -- 172.21.15.72:0/1991027325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f492c154210 msgr2=0x7f492c14ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:46.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.215+0000 7f492affd700 1 --2- 172.21.15.72:0/1991027325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f492c154210 0x7f492c14ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:46.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.215+0000 7f492affd700 1 -- 172.21.15.72:0/1991027325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492c153e30 msgr2=0x7f492c141a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:46.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.215+0000 7f492affd700 1 --2- 172.21.15.72:0/1991027325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492c153e30 0x7f492c141a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:46.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.215+0000 7f492affd700 1 -- 172.21.15.72:0/1991027325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49200092a0 con 0x7f492c0635a0 2023-08-31T19:03:46.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.215+0000 7f492a7fc700 1 --2- 172.21.15.72:0/1991027325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492c153e30 0x7f492c141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:03:46.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.215+0000 7f492affd700 1 --2- 172.21.15.72:0/1991027325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c0635a0 0x7f492c0b09f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f491c00c4c0 tx=0x7f491c007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:46.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.216+0000 7f4912ffd700 1 -- 172.21.15.72:0/1991027325 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0070d0 con 0x7f492c0635a0 2023-08-31T19:03:46.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.216+0000 7f4912ffd700 1 -- 172.21.15.72:0/1991027325 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c007230 con 0x7f492c0635a0 2023-08-31T19:03:46.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.216+0000 7f4912ffd700 1 -- 172.21.15.72:0/1991027325 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0075b0 con 0x7f492c0635a0 2023-08-31T19:03:46.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.216+0000 7f49315ff700 1 -- 172.21.15.72:0/1991027325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492c141f60 con 0x7f492c0635a0 2023-08-31T19:03:46.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.216+0000 7f49315ff700 1 -- 172.21.15.72:0/1991027325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492c0af020 con 0x7f492c0635a0 2023-08-31T19:03:46.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.217+0000 7f49315ff700 1 -- 172.21.15.72:0/1991027325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492c06c6b0 con 0x7f492c0635a0 2023-08-31T19:03:46.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.218+0000 7f4912ffd700 1 -- 172.21.15.72:0/1991027325 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f491c0059b0 con 0x7f492c0635a0 2023-08-31T19:03:46.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.219+0000 7f4912ffd700 1 --2- 172.21.15.72:0/1991027325 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f491805efc0 0x7f4918061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:46.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.219+0000 7f4912ffd700 1 -- 172.21.15.72:0/1991027325 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f491c079b60 con 0x7f492c0635a0 2023-08-31T19:03:46.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.219+0000 7f492a7fc700 1 -- 172.21.15.72:0/1991027325 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f491805efc0 msgr2=0x7f4918061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:46.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.219+0000 7f492a7fc700 1 --2- 172.21.15.72:0/1991027325 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f491805efc0 0x7f4918061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:46.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.223+0000 7f4912ffd700 1 -- 172.21.15.72:0/1991027325 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f491c04a970 con 0x7f492c0635a0 2023-08-31T19:03:46.270 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:46.270+0000 7f6595f04680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:03:46.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.398+0000 7f49315ff700 1 -- 172.21.15.72:0/1991027325 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f492c0bffe0 con 0x7f492c0635a0 2023-08-31T19:03:46.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.398+0000 7f4912ffd700 1 -- 172.21.15.72:0/1991027325 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v80) v1 ==== 110+0+10 (secure 0 0 0) 0x7f491c04df90 con 0x7f492c0635a0 2023-08-31T19:03:46.399 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:03:46.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.400+0000 7f49315ff700 1 -- 172.21.15.72:0/1991027325 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f491805efc0 msgr2=0x7f4918061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:46.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.400+0000 7f49315ff700 1 --2- 172.21.15.72:0/1991027325 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f491805efc0 0x7f4918061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:46.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.401+0000 7f49315ff700 1 -- 172.21.15.72:0/1991027325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c0635a0 msgr2=0x7f492c0b09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:46.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.401+0000 7f49315ff700 1 --2- 172.21.15.72:0/1991027325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c0635a0 0x7f492c0b09f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f491c00c4c0 tx=0x7f491c007df0).stop 2023-08-31T19:03:46.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.401+0000 7f49315ff700 1 -- 172.21.15.72:0/1991027325 shutdown_connections 2023-08-31T19:03:46.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.401+0000 7f49315ff700 1 --2- 172.21.15.72:0/1991027325 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f492c154210 0x7f492c14ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:46.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.401+0000 7f49315ff700 1 --2- 172.21.15.72:0/1991027325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c0635a0 0x7f492c0b09f0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:46.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.401+0000 7f49315ff700 1 --2- 172.21.15.72:0/1991027325 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f491805efc0 0x7f4918061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:46.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.401+0000 7f49315ff700 1 --2- 172.21.15.72:0/1991027325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f492c153e30 0x7f492c141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:46.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.401+0000 7f49315ff700 1 -- 172.21.15.72:0/1991027325 >> 172.21.15.72:0/1991027325 conn(0x7f492c05eb20 msgr2=0x7f492c0ca390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:46.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.401+0000 7f49315ff700 1 -- 172.21.15.72:0/1991027325 shutdown_connections 2023-08-31T19:03:46.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.401+0000 7f49315ff700 1 -- 172.21.15.72:0/1991027325 wait complete. 2023-08-31T19:03:46.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:03:46.422 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:46.422+0000 7f57b780a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:03:46.510 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:46.510+0000 7f6595f04680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:03:46.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.613+0000 7f28273ff700 1 Processor -- start 2023-08-31T19:03:46.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.613+0000 7f28273ff700 1 -- start start 2023-08-31T19:03:46.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.614+0000 7f28273ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f282014ecd0 0x7f28201556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.614+0000 7f28273ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2820152720 con 0x7f28200c2320 2023-08-31T19:03:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.614+0000 7f28273ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28200c1f20 con 0x7f28200c27a0 2023-08-31T19:03:46.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.614+0000 7f28273ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282006a6b0 con 0x7f282014ecd0 2023-08-31T19:03:46.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.615+0000 7f282499a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f28200c2320 0x7f28200c1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52386/0 (socket says 172.21.15.72:52386) 2023-08-31T19:03:46.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.615+0000 7f282499a700 1 -- 172.21.15.72:0/3292256913 learned_addr learned my addr 172.21.15.72:0/3292256913 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:46.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.615+0000 7f282519b700 1 --2- 172.21.15.72:0/3292256913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f282014ecd0 0x7f28201556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:46.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.615+0000 7f2817fff700 1 -- 172.21.15.72:0/3292256913 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983392567 0 0) 0x7f2820152720 con 0x7f28200c2320 2023-08-31T19:03:46.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.615+0000 7f2817fff700 1 -- 172.21.15.72:0/3292256913 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f280c0033f0 con 0x7f28200c2320 2023-08-31T19:03:46.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.615+0000 7f2817fff700 1 -- 172.21.15.72:0/3292256913 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365834 0 0) 0x7f28200c1f20 con 0x7f28200c27a0 2023-08-31T19:03:46.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.615+0000 7f282519b700 1 -- 172.21.15.72:0/3292256913 >> v1:172.21.15.146:6789/0 conn(0x7f28200c27a0 legacy=0x7f28200c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:46.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.615+0000 7f282519b700 1 -- 172.21.15.72:0/3292256913 >> v1:172.21.15.72:6789/0 conn(0x7f28200c2320 legacy=0x7f28200c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:46.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.615+0000 7f282519b700 1 -- 172.21.15.72:0/3292256913 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28200c2c50 con 0x7f282014ecd0 2023-08-31T19:03:46.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.615+0000 7f282519b700 1 --2- 172.21.15.72:0/3292256913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f282014ecd0 0x7f28201556d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f281c009790 tx=0x7f281c009060).ready entity=mon.2 client_cookie=881ffcda37a4fc30 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.616+0000 7f2817fff700 1 -- 172.21.15.72:0/3292256913 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c00f6b0 con 0x7f282014ecd0 2023-08-31T19:03:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.616+0000 7f2817fff700 1 -- 172.21.15.72:0/3292256913 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c00f810 con 0x7f282014ecd0 2023-08-31T19:03:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.616+0000 7f2817fff700 1 -- 172.21.15.72:0/3292256913 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c00fb90 con 0x7f282014ecd0 2023-08-31T19:03:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.616+0000 7f28273ff700 1 -- 172.21.15.72:0/3292256913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f282014ecd0 msgr2=0x7f28201556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:46.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.616+0000 7f28273ff700 1 --2- 172.21.15.72:0/3292256913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f282014ecd0 0x7f28201556d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f281c009790 tx=0x7f281c009060).stop 2023-08-31T19:03:46.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.616+0000 7f28273ff700 1 -- 172.21.15.72:0/3292256913 shutdown_connections 2023-08-31T19:03:46.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.616+0000 7f28273ff700 1 --2- 172.21.15.72:0/3292256913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f282014ecd0 0x7f28201556d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:46.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.616+0000 7f28273ff700 1 -- 172.21.15.72:0/3292256913 >> 172.21.15.72:0/3292256913 conn(0x7f28200630c0 msgr2=0x7f28200c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:46.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.616+0000 7f28273ff700 1 -- 172.21.15.72:0/3292256913 shutdown_connections 2023-08-31T19:03:46.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.617+0000 7f28273ff700 1 -- 172.21.15.72:0/3292256913 wait complete. 2023-08-31T19:03:46.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.618+0000 7f28273ff700 1 Processor -- start 2023-08-31T19:03:46.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.618+0000 7f28273ff700 1 -- start start 2023-08-31T19:03:46.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.619+0000 7f28273ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28200c2320 0x7f2820163cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:46.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.619+0000 7f28273ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28200c27a0 0x7f282014dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:46.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.619+0000 7f28273ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f282014ecd0 0x7f28200a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:46.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.619+0000 7f28273ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28200a8b30 con 0x7f28200c2320 2023-08-31T19:03:46.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.619+0000 7f28273ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28200a8e10 con 0x7f282014ecd0 2023-08-31T19:03:46.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.619+0000 7f28273ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28200a90f0 con 0x7f28200c27a0 2023-08-31T19:03:46.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.619+0000 7f282519b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28200c2320 0x7f2820163cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:46.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.619+0000 7f282499a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28200c27a0 0x7f282014dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:46.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.619+0000 7f282519b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28200c2320 0x7f2820163cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43528/0 (socket says 172.21.15.72:43528) 2023-08-31T19:03:46.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.619+0000 7f282519b700 1 -- 172.21.15.72:0/3164895244 learned_addr learned my addr 172.21.15.72:0/3164895244 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:46.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.619+0000 7f282599c700 1 --2- 172.21.15.72:0/3164895244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f282014ecd0 0x7f28200a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:46.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.620+0000 7f282519b700 1 -- 172.21.15.72:0/3164895244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28200c27a0 msgr2=0x7f282014dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:46.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.620+0000 7f282519b700 1 --2- 172.21.15.72:0/3164895244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28200c27a0 0x7f282014dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:46.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.620+0000 7f282519b700 1 -- 172.21.15.72:0/3164895244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f282014ecd0 msgr2=0x7f28200a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:46.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.620+0000 7f282519b700 1 --2- 172.21.15.72:0/3164895244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f282014ecd0 0x7f28200a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:46.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.620+0000 7f282519b700 1 -- 172.21.15.72:0/3164895244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c0092a0 con 0x7f28200c2320 2023-08-31T19:03:46.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.620+0000 7f282519b700 1 --2- 172.21.15.72:0/3164895244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28200c2320 0x7f2820163cd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f28200634d0 tx=0x7f281c019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:46.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.620+0000 7f28157fa700 1 -- 172.21.15.72:0/3164895244 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c01f070 con 0x7f28200c2320 2023-08-31T19:03:46.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.620+0000 7f28157fa700 1 -- 172.21.15.72:0/3164895244 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c00f980 con 0x7f28200c2320 2023-08-31T19:03:46.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.620+0000 7f28157fa700 1 -- 172.21.15.72:0/3164895244 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c024690 con 0x7f28200c2320 2023-08-31T19:03:46.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.620+0000 7f28273ff700 1 -- 172.21.15.72:0/3164895244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28200a93d0 con 0x7f28200c2320 2023-08-31T19:03:46.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.621+0000 7f28273ff700 1 -- 172.21.15.72:0/3164895244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28200a86d0 con 0x7f28200c2320 2023-08-31T19:03:46.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.622+0000 7f28273ff700 1 -- 172.21.15.72:0/3164895244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282006c6b0 con 0x7f28200c2320 2023-08-31T19:03:46.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.623+0000 7f28157fa700 1 -- 172.21.15.72:0/3164895244 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f281c024a00 con 0x7f28200c2320 2023-08-31T19:03:46.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.624+0000 7f28157fa700 1 --2- 172.21.15.72:0/3164895244 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f280405efc0 0x7f2804061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:46.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.624+0000 7f28157fa700 1 -- 172.21.15.72:0/3164895244 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f281c07d730 con 0x7f28200c2320 2023-08-31T19:03:46.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.624+0000 7f282499a700 1 -- 172.21.15.72:0/3164895244 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f280405efc0 msgr2=0x7f2804061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:46.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.624+0000 7f282499a700 1 --2- 172.21.15.72:0/3164895244 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f280405efc0 0x7f2804061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:46.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.628+0000 7f28157fa700 1 -- 172.21.15.72:0/3164895244 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f281c04e5e0 con 0x7f28200c2320 2023-08-31T19:03:46.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.801+0000 7f28273ff700 1 -- 172.21.15.72:0/3164895244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f28200c7350 con 0x7f28200c2320 2023-08-31T19:03:46.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.802+0000 7f28157fa700 1 -- 172.21.15.72:0/3164895244 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7f281c0290a0 con 0x7f28200c2320 2023-08-31T19:03:46.802 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:03:46.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.804+0000 7f28273ff700 1 -- 172.21.15.72:0/3164895244 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f280405efc0 msgr2=0x7f2804061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:46.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.804+0000 7f28273ff700 1 --2- 172.21.15.72:0/3164895244 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f280405efc0 0x7f2804061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:46.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.804+0000 7f28273ff700 1 -- 172.21.15.72:0/3164895244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28200c2320 msgr2=0x7f2820163cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:46.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.804+0000 7f28273ff700 1 --2- 172.21.15.72:0/3164895244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28200c2320 0x7f2820163cd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f28200634d0 tx=0x7f281c019000).stop 2023-08-31T19:03:46.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.804+0000 7f28273ff700 1 -- 172.21.15.72:0/3164895244 shutdown_connections 2023-08-31T19:03:46.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.804+0000 7f28273ff700 1 --2- 172.21.15.72:0/3164895244 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f280405efc0 0x7f2804061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:46.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.804+0000 7f28273ff700 1 --2- 172.21.15.72:0/3164895244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f282014ecd0 0x7f28200a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:46.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.804+0000 7f28273ff700 1 --2- 172.21.15.72:0/3164895244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28200c2320 0x7f2820163cd0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:46.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.804+0000 7f28273ff700 1 --2- 172.21.15.72:0/3164895244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28200c27a0 0x7f282014dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:46.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.804+0000 7f28273ff700 1 -- 172.21.15.72:0/3164895244 >> 172.21.15.72:0/3164895244 conn(0x7f28200630c0 msgr2=0x7f28200bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:46.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.804+0000 7f28273ff700 1 -- 172.21.15.72:0/3164895244 shutdown_connections 2023-08-31T19:03:46.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:46.804+0000 7f28273ff700 1 -- 172.21.15.72:0/3164895244 wait complete. 2023-08-31T19:03:46.822 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:03:46.934 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:46.934+0000 7f57b780a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:03:47.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.023+0000 7f64df1ff700 1 Processor -- start 2023-08-31T19:03:47.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.023+0000 7f64df1ff700 1 -- start start 2023-08-31T19:03:47.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.025+0000 7f64df1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f64d8154030 0x7f64d8154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.025+0000 7f64df1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64d80c7360 0x7f64d8063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.025+0000 7f64df1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d80c6ed0 con 0x7f64d80c06b0 2023-08-31T19:03:47.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.025+0000 7f64df1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d80c66e0 con 0x7f64d80c7360 2023-08-31T19:03:47.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.025+0000 7f64df1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d80c68c0 con 0x7f64d8154030 2023-08-31T19:03:47.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.025+0000 7f64dd79c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64d80c7360 0x7f64d8063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:47.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.025+0000 7f64dd79c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64d80c7360 0x7f64d8063120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43542/0 (socket says 172.21.15.72:43542) 2023-08-31T19:03:47.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.025+0000 7f64dd79c700 1 -- 172.21.15.72:0/3652572907 learned_addr learned my addr 172.21.15.72:0/3652572907 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:47.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.025+0000 7f64dcf9b700 1 --2- 172.21.15.72:0/3652572907 >> v2:172.21.15.146:3300/0 conn(0x7f64d8154030 0x7f64d8154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:47.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.025+0000 7f64dd79c700 1 -- 172.21.15.72:0/3652572907 >> v2:172.21.15.146:3300/0 conn(0x7f64d8154030 msgr2=0x7f64d8154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:47.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.025+0000 7f64dd79c700 1 --2- 172.21.15.72:0/3652572907 >> v2:172.21.15.146:3300/0 conn(0x7f64d8154030 0x7f64d8154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.025+0000 7f64dd79c700 1 -- 172.21.15.72:0/3652572907 >> v1:172.21.15.146:6789/0 conn(0x7f64d80c06b0 legacy=0x7f64d80aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:47.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.026+0000 7f64dd79c700 1 -- 172.21.15.72:0/3652572907 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d80c0f30 con 0x7f64d80c7360 2023-08-31T19:03:47.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.026+0000 7f64dd79c700 1 --2- 172.21.15.72:0/3652572907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d80c7360 0x7f64d8063120 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f64d80c8bc0 tx=0x7f64d0009840).ready entity=mon.0 client_cookie=dd17df2a201cb510 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:47.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.026+0000 7f64d77fe700 1 -- 172.21.15.72:0/3652572907 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d000e070 con 0x7f64d80c7360 2023-08-31T19:03:47.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.026+0000 7f64d77fe700 1 -- 172.21.15.72:0/3652572907 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d000ba20 con 0x7f64d80c7360 2023-08-31T19:03:47.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.026+0000 7f64d77fe700 1 -- 172.21.15.72:0/3652572907 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d000bda0 con 0x7f64d80c7360 2023-08-31T19:03:47.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.026+0000 7f64df1ff700 1 -- 172.21.15.72:0/3652572907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d80c7360 msgr2=0x7f64d8063120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:47.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.027+0000 7f64df1ff700 1 --2- 172.21.15.72:0/3652572907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d80c7360 0x7f64d8063120 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f64d80c8bc0 tx=0x7f64d0009840).stop 2023-08-31T19:03:47.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.027+0000 7f64df1ff700 1 -- 172.21.15.72:0/3652572907 shutdown_connections 2023-08-31T19:03:47.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.027+0000 7f64df1ff700 1 --2- 172.21.15.72:0/3652572907 >> v2:172.21.15.146:3300/0 conn(0x7f64d8154030 0x7f64d8154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.027+0000 7f64df1ff700 1 --2- 172.21.15.72:0/3652572907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d80c7360 0x7f64d8063120 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.027+0000 7f64df1ff700 1 -- 172.21.15.72:0/3652572907 >> 172.21.15.72:0/3652572907 conn(0x7f64d805eb60 msgr2=0x7f64d80cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:47.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.027+0000 7f64df1ff700 1 -- 172.21.15.72:0/3652572907 shutdown_connections 2023-08-31T19:03:47.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.027+0000 7f64df1ff700 1 -- 172.21.15.72:0/3652572907 wait complete. 2023-08-31T19:03:47.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.028+0000 7f64df1ff700 1 Processor -- start 2023-08-31T19:03:47.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.028+0000 7f64df1ff700 1 -- start start 2023-08-31T19:03:47.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.029+0000 7f64df1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64d80c06b0 0x7f64d80c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.029+0000 7f64df1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d80c7360 0x7f64d80c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.029+0000 7f64df1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d8154030 0x7f64d8158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.029+0000 7f64df1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d80c3c70 con 0x7f64d80c7360 2023-08-31T19:03:47.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.029+0000 7f64df1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d80c3f50 con 0x7f64d8154030 2023-08-31T19:03:47.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.029+0000 7f64df1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d80c4230 con 0x7f64d80c06b0 2023-08-31T19:03:47.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.030+0000 7f64d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d80c7360 0x7f64d80c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:47.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.030+0000 7f64d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d80c7360 0x7f64d80c3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43548/0 (socket says 172.21.15.72:43548) 2023-08-31T19:03:47.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.030+0000 7f64d7fff700 1 -- 172.21.15.72:0/311168197 learned_addr learned my addr 172.21.15.72:0/311168197 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:47.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.030+0000 7f64dcf9b700 1 --2- 172.21.15.72:0/311168197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64d80c06b0 0x7f64d80c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:47.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.030+0000 7f64dd79c700 1 --2- 172.21.15.72:0/311168197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d8154030 0x7f64d8158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:47.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.030+0000 7f64d7fff700 1 -- 172.21.15.72:0/311168197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64d80c06b0 msgr2=0x7f64d80c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:47.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.030+0000 7f64d7fff700 1 --2- 172.21.15.72:0/311168197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64d80c06b0 0x7f64d80c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.030+0000 7f64d7fff700 1 -- 172.21.15.72:0/311168197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d8154030 msgr2=0x7f64d8158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:47.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.030+0000 7f64d7fff700 1 --2- 172.21.15.72:0/311168197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d8154030 0x7f64d8158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.030+0000 7f64d7fff700 1 -- 172.21.15.72:0/311168197 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d0009ae0 con 0x7f64d80c7360 2023-08-31T19:03:47.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.030+0000 7f64d7fff700 1 --2- 172.21.15.72:0/311168197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d80c7360 0x7f64d80c3430 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f64c400c4c0 tx=0x7f64c4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:47.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.030+0000 7f64d4ff9700 1 -- 172.21.15.72:0/311168197 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c400ce70 con 0x7f64d80c7360 2023-08-31T19:03:47.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.030+0000 7f64d4ff9700 1 -- 172.21.15.72:0/311168197 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c4001e90 con 0x7f64d80c7360 2023-08-31T19:03:47.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.030+0000 7f64d4ff9700 1 -- 172.21.15.72:0/311168197 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4007250 con 0x7f64d80c7360 2023-08-31T19:03:47.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.030+0000 7f64df1ff700 1 -- 172.21.15.72:0/311168197 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d80c4510 con 0x7f64d80c7360 2023-08-31T19:03:47.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.031+0000 7f64df1ff700 1 -- 172.21.15.72:0/311168197 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d813c450 con 0x7f64d80c7360 2023-08-31T19:03:47.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.032+0000 7f64df1ff700 1 -- 172.21.15.72:0/311168197 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d813c6d0 con 0x7f64d80c7360 2023-08-31T19:03:47.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.033+0000 7f64d4ff9700 1 -- 172.21.15.72:0/311168197 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f64c40066a0 con 0x7f64d80c7360 2023-08-31T19:03:47.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.034+0000 7f64d4ff9700 1 --2- 172.21.15.72:0/311168197 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f64bc05efc0 0x7f64bc061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.034+0000 7f64d4ff9700 1 -- 172.21.15.72:0/311168197 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f64c4079c40 con 0x7f64d80c7360 2023-08-31T19:03:47.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.034+0000 7f64dcf9b700 1 -- 172.21.15.72:0/311168197 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f64bc05efc0 msgr2=0x7f64bc061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:47.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.034+0000 7f64dcf9b700 1 --2- 172.21.15.72:0/311168197 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f64bc05efc0 0x7f64bc061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:47.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.037+0000 7f64d4ff9700 1 -- 172.21.15.72:0/311168197 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f64d813c6d0 con 0x7f64d80c7360 2023-08-31T19:03:47.051 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:47.052+0000 7f6595f04680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:03:47.059 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:47.059+0000 7f57b780a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:03:47.181 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:47.181+0000 7f6595f04680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:03:47.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.214+0000 7f64df1ff700 1 -- 172.21.15.72:0/311168197 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64d813c6d0 con 0x7f64d80c7360 2023-08-31T19:03:47.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.214+0000 7f64d4ff9700 1 -- 172.21.15.72:0/311168197 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64d813c6d0 con 0x7f64d80c7360 2023-08-31T19:03:47.215 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:03:47.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.217+0000 7f64df1ff700 1 -- 172.21.15.72:0/311168197 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f64bc05efc0 msgr2=0x7f64bc061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:47.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.217+0000 7f64df1ff700 1 --2- 172.21.15.72:0/311168197 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f64bc05efc0 0x7f64bc061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:47.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.217+0000 7f64df1ff700 1 -- 172.21.15.72:0/311168197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d80c7360 msgr2=0x7f64d80c3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:47.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.217+0000 7f64df1ff700 1 --2- 172.21.15.72:0/311168197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d80c7360 0x7f64d80c3430 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f64c400c4c0 tx=0x7f64c4007e00).stop 2023-08-31T19:03:47.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.217+0000 7f64df1ff700 1 -- 172.21.15.72:0/311168197 shutdown_connections 2023-08-31T19:03:47.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.217+0000 7f64df1ff700 1 --2- 172.21.15.72:0/311168197 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f64bc05efc0 0x7f64bc061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:47.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.217+0000 7f64df1ff700 1 --2- 172.21.15.72:0/311168197 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d8154030 0x7f64d8158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.217+0000 7f64df1ff700 1 --2- 172.21.15.72:0/311168197 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64d80c06b0 0x7f64d80c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.217+0000 7f64df1ff700 1 --2- 172.21.15.72:0/311168197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64d80c7360 0x7f64d80c3430 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.217+0000 7f64df1ff700 1 -- 172.21.15.72:0/311168197 >> 172.21.15.72:0/311168197 conn(0x7f64d805eb60 msgr2=0x7f64d80ac460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:47.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.217+0000 7f64df1ff700 1 -- 172.21.15.72:0/311168197 shutdown_connections 2023-08-31T19:03:47.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.217+0000 7f64df1ff700 1 -- 172.21.15.72:0/311168197 wait complete. 2023-08-31T19:03:47.235 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:03:47.242 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:47.242+0000 7f57b780a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:03:47.336 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:47.335+0000 7f57b780a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:03:47.379 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:47.378+0000 7f6595f04680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:03:47.420 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:47.420+0000 7f57b780a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:03:47.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.439+0000 7f8fc99ff700 1 Processor -- start 2023-08-31T19:03:47.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.439+0000 7f8fc99ff700 1 -- start start 2023-08-31T19:03:47.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.440+0000 7f8fc99ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8fc4063830 0x7f8fc40c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.441+0000 7f8fc99ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc40c6ed0 con 0x7f8fc4154030 2023-08-31T19:03:47.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.441+0000 7f8fc99ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc40c68c0 con 0x7f8fc4154410 2023-08-31T19:03:47.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.441+0000 7f8fc99ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc40c66e0 con 0x7f8fc4063830 2023-08-31T19:03:47.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.441+0000 7f8fc37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8fc4063830 0x7f8fc40c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:47.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.441+0000 7f8fc37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8fc4063830 0x7f8fc40c06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43554/0 (socket says 172.21.15.72:43554) 2023-08-31T19:03:47.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.441+0000 7f8fc37fe700 1 -- 172.21.15.72:0/1702952934 learned_addr learned my addr 172.21.15.72:0/1702952934 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:47.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.441+0000 7f8fc27fc700 1 --1- 172.21.15.72:0/1702952934 >> v1:172.21.15.146:6789/0 conn(0x7f8fc4154410 0x7f8fc4063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:34344/0 (socket says 172.21.15.72:34344) 2023-08-31T19:03:47.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.441+0000 7f8fc2ffd700 1 --1- 172.21.15.72:0/1702952934 >> v1:172.21.15.72:6789/0 conn(0x7f8fc4154030 0x7f8fc40aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52388/0 (socket says 172.21.15.72:52388) 2023-08-31T19:03:47.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.441+0000 7f8fc37fe700 1 -- 172.21.15.72:0/1702952934 >> v1:172.21.15.146:6789/0 conn(0x7f8fc4154410 legacy=0x7f8fc4063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:47.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.441+0000 7f8fc1ffb700 1 -- 172.21.15.72:0/1702952934 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602348647 0 0) 0x7f8fc40c68c0 con 0x7f8fc4154410 2023-08-31T19:03:47.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.441+0000 7f8fc37fe700 1 -- 172.21.15.72:0/1702952934 >> v1:172.21.15.72:6789/0 conn(0x7f8fc4154030 legacy=0x7f8fc40aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:47.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.441+0000 7f8fc37fe700 1 -- 172.21.15.72:0/1702952934 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc40c0f30 con 0x7f8fc4063830 2023-08-31T19:03:47.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.442+0000 7f8fc37fe700 1 --2- 172.21.15.72:0/1702952934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fc4063830 0x7f8fc40c06b0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f8fbc009f20 tx=0x7f8fbc009840).ready entity=mon.0 client_cookie=cdb878e6dd348b48 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:47.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.442+0000 7f8fc1ffb700 1 -- 172.21.15.72:0/1702952934 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc00e070 con 0x7f8fc4063830 2023-08-31T19:03:47.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.442+0000 7f8fc1ffb700 1 -- 172.21.15.72:0/1702952934 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc00ba80 con 0x7f8fc4063830 2023-08-31T19:03:47.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.442+0000 7f8fc1ffb700 1 -- 172.21.15.72:0/1702952934 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc00be00 con 0x7f8fc4063830 2023-08-31T19:03:47.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.442+0000 7f8fc99ff700 1 -- 172.21.15.72:0/1702952934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fc4063830 msgr2=0x7f8fc40c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:47.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.442+0000 7f8fc99ff700 1 --2- 172.21.15.72:0/1702952934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fc4063830 0x7f8fc40c06b0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f8fbc009f20 tx=0x7f8fbc009840).stop 2023-08-31T19:03:47.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.443+0000 7f8fc99ff700 1 -- 172.21.15.72:0/1702952934 shutdown_connections 2023-08-31T19:03:47.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.443+0000 7f8fc99ff700 1 --2- 172.21.15.72:0/1702952934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fc4063830 0x7f8fc40c06b0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.443+0000 7f8fc99ff700 1 -- 172.21.15.72:0/1702952934 >> 172.21.15.72:0/1702952934 conn(0x7f8fc405eb60 msgr2=0x7f8fc40cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:47.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.443+0000 7f8fc99ff700 1 -- 172.21.15.72:0/1702952934 shutdown_connections 2023-08-31T19:03:47.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.443+0000 7f8fc99ff700 1 -- 172.21.15.72:0/1702952934 wait complete. 2023-08-31T19:03:47.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.444+0000 7f8fc99ff700 1 Processor -- start 2023-08-31T19:03:47.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.444+0000 7f8fc99ff700 1 -- start start 2023-08-31T19:03:47.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.445+0000 7f8fc99ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fc4063830 0x7f8fc414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.445+0000 7f8fc99ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fc4154030 0x7f8fc40c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.445+0000 7f8fc99ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fc4154410 0x7f8fc40acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.445+0000 7f8fc99ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40c2720 con 0x7f8fc4154030 2023-08-31T19:03:47.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.445+0000 7f8fc99ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40c2a00 con 0x7f8fc4154410 2023-08-31T19:03:47.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.445+0000 7f8fc99ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40c2ce0 con 0x7f8fc4063830 2023-08-31T19:03:47.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.445+0000 7f8fc27fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fc4154030 0x7f8fc40c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:47.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.445+0000 7f8fc27fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fc4154030 0x7f8fc40c1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43560/0 (socket says 172.21.15.72:43560) 2023-08-31T19:03:47.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.445+0000 7f8fc27fc700 1 -- 172.21.15.72:0/1196923434 learned_addr learned my addr 172.21.15.72:0/1196923434 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:47.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.446+0000 7f8fc37fe700 1 --2- 172.21.15.72:0/1196923434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fc4154410 0x7f8fc40acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:47.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.446+0000 7f8fc2ffd700 1 --2- 172.21.15.72:0/1196923434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fc4063830 0x7f8fc414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:47.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.446+0000 7f8fc27fc700 1 -- 172.21.15.72:0/1196923434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fc4063830 msgr2=0x7f8fc414e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:47.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.446+0000 7f8fc27fc700 1 --2- 172.21.15.72:0/1196923434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fc4063830 0x7f8fc414e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.446+0000 7f8fc27fc700 1 -- 172.21.15.72:0/1196923434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fc4154410 msgr2=0x7f8fc40acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:47.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.446+0000 7f8fc27fc700 1 --2- 172.21.15.72:0/1196923434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fc4154410 0x7f8fc40acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.446+0000 7f8fc27fc700 1 -- 172.21.15.72:0/1196923434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc009ae0 con 0x7f8fc4154030 2023-08-31T19:03:47.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.446+0000 7f8fc27fc700 1 --2- 172.21.15.72:0/1196923434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fc4154030 0x7f8fc40c1e90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f8fb800c490 tx=0x7f8fb8007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:47.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.446+0000 7f8faaffd700 1 -- 172.21.15.72:0/1196923434 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb80070d0 con 0x7f8fc4154030 2023-08-31T19:03:47.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.446+0000 7f8faaffd700 1 -- 172.21.15.72:0/1196923434 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb8007250 con 0x7f8fc4154030 2023-08-31T19:03:47.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.446+0000 7f8fc99ff700 1 -- 172.21.15.72:0/1196923434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc40c2fc0 con 0x7f8fc4154030 2023-08-31T19:03:47.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.446+0000 7f8faaffd700 1 -- 172.21.15.72:0/1196923434 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb80056e0 con 0x7f8fc4154030 2023-08-31T19:03:47.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.447+0000 7f8fc99ff700 1 -- 172.21.15.72:0/1196923434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc40c4860 con 0x7f8fc4154030 2023-08-31T19:03:47.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.448+0000 7f8fc99ff700 1 -- 172.21.15.72:0/1196923434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc406c6b0 con 0x7f8fc4154030 2023-08-31T19:03:47.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.449+0000 7f8faaffd700 1 -- 172.21.15.72:0/1196923434 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f8fb8005ce0 con 0x7f8fc4154030 2023-08-31T19:03:47.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.450+0000 7f8faaffd700 1 --2- 172.21.15.72:0/1196923434 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8fb005ef90 0x7f8fb0061450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.450+0000 7f8faaffd700 1 -- 172.21.15.72:0/1196923434 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f8fb8079c10 con 0x7f8fc4154030 2023-08-31T19:03:47.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.450+0000 7f8fc2ffd700 1 -- 172.21.15.72:0/1196923434 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8fb005ef90 msgr2=0x7f8fb0061450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:47.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.450+0000 7f8fc2ffd700 1 --2- 172.21.15.72:0/1196923434 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8fb005ef90 0x7f8fb0061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:47.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.453+0000 7f8faaffd700 1 -- 172.21.15.72:0/1196923434 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8fb804ab20 con 0x7f8fc4154030 2023-08-31T19:03:47.492 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:47.491+0000 7f6595f04680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:03:47.578 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:47.578+0000 7f6595f04680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:03:47.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.644+0000 7f8fc99ff700 1 -- 172.21.15.72:0/1196923434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8fc40c0c50 con 0x7f8fc4154030 2023-08-31T19:03:47.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.645+0000 7f8faaffd700 1 -- 172.21.15.72:0/1196923434 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8fb804e140 con 0x7f8fc4154030 2023-08-31T19:03:47.646 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:03:47.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.647+0000 7f8fc99ff700 1 -- 172.21.15.72:0/1196923434 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8fb005ef90 msgr2=0x7f8fb0061450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:47.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.647+0000 7f8fc99ff700 1 --2- 172.21.15.72:0/1196923434 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8fb005ef90 0x7f8fb0061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:47.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.647+0000 7f8fc99ff700 1 -- 172.21.15.72:0/1196923434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fc4154030 msgr2=0x7f8fc40c1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:47.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.647+0000 7f8fc99ff700 1 --2- 172.21.15.72:0/1196923434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fc4154030 0x7f8fc40c1e90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f8fb800c490 tx=0x7f8fb8007de0).stop 2023-08-31T19:03:47.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.647+0000 7f8fc99ff700 1 -- 172.21.15.72:0/1196923434 shutdown_connections 2023-08-31T19:03:47.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.647+0000 7f8fc99ff700 1 --2- 172.21.15.72:0/1196923434 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8fb005ef90 0x7f8fb0061450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:47.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.647+0000 7f8fc99ff700 1 --2- 172.21.15.72:0/1196923434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fc4154410 0x7f8fc40acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.647+0000 7f8fc99ff700 1 --2- 172.21.15.72:0/1196923434 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8fc4063830 0x7f8fc414e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.647+0000 7f8fc99ff700 1 --2- 172.21.15.72:0/1196923434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fc4154030 0x7f8fc40c1e90 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.647+0000 7f8fc99ff700 1 -- 172.21.15.72:0/1196923434 >> 172.21.15.72:0/1196923434 conn(0x7f8fc405eb60 msgr2=0x7f8fc40ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:47.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.647+0000 7f8fc99ff700 1 -- 172.21.15.72:0/1196923434 shutdown_connections 2023-08-31T19:03:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.647+0000 7f8fc99ff700 1 -- 172.21.15.72:0/1196923434 wait complete. 2023-08-31T19:03:47.666 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:03:47.733 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:47.733+0000 7f57b780a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:03:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.857+0000 7f510efff700 1 Processor -- start 2023-08-31T19:03:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.858+0000 7f510efff700 1 -- start start 2023-08-31T19:03:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.859+0000 7f510efff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51080a9eb0 0x7f51080aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.859+0000 7f510efff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51081576d0 0x7f51080c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.859+0000 7f510efff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51080bfd00 con 0x7f51080c5bf0 2023-08-31T19:03:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.859+0000 7f510efff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51080c05a0 con 0x7f51081576d0 2023-08-31T19:03:47.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.859+0000 7f510efff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51080aaea0 con 0x7f51080a9eb0 2023-08-31T19:03:47.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.859+0000 7f510d59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51081576d0 0x7f51080c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:47.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.859+0000 7f510d59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51081576d0 0x7f51080c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43564/0 (socket says 172.21.15.72:43564) 2023-08-31T19:03:47.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.859+0000 7f510d59c700 1 -- 172.21.15.72:0/1794655686 learned_addr learned my addr 172.21.15.72:0/1794655686 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:47.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.859+0000 7f5107fff700 1 --1- 172.21.15.72:0/1794655686 >> v1:172.21.15.72:6789/0 conn(0x7f51080c5bf0 0x7f5108156fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52392/0 (socket says 172.21.15.72:52392) 2023-08-31T19:03:47.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.859+0000 7f510cd9b700 1 --2- 172.21.15.72:0/1794655686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51080a9eb0 0x7f51080aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:47.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.860+0000 7f510d59c700 1 -- 172.21.15.72:0/1794655686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51080a9eb0 msgr2=0x7f51080aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:47.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.860+0000 7f510d59c700 1 --2- 172.21.15.72:0/1794655686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51080a9eb0 0x7f51080aa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.860+0000 7f510d59c700 1 -- 172.21.15.72:0/1794655686 >> v1:172.21.15.72:6789/0 conn(0x7f51080c5bf0 legacy=0x7f5108156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:47.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.860+0000 7f51077fe700 1 -- 172.21.15.72:0/1794655686 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415688602 0 0) 0x7f51080bfd00 con 0x7f51080c5bf0 2023-08-31T19:03:47.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.860+0000 7f510d59c700 1 -- 172.21.15.72:0/1794655686 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51080c6670 con 0x7f51081576d0 2023-08-31T19:03:47.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.860+0000 7f510d59c700 1 --2- 172.21.15.72:0/1794655686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51081576d0 0x7f51080c6070 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f5100009f50 tx=0x7f5100009840).ready entity=mon.0 client_cookie=417925576b2199e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:47.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.860+0000 7f51077fe700 1 -- 172.21.15.72:0/1794655686 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510000e070 con 0x7f51081576d0 2023-08-31T19:03:47.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.860+0000 7f51077fe700 1 -- 172.21.15.72:0/1794655686 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510000b9c0 con 0x7f51081576d0 2023-08-31T19:03:47.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.860+0000 7f51077fe700 1 -- 172.21.15.72:0/1794655686 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510000bd40 con 0x7f51081576d0 2023-08-31T19:03:47.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.861+0000 7f510efff700 1 -- 172.21.15.72:0/1794655686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51081576d0 msgr2=0x7f51080c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:47.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.861+0000 7f510efff700 1 --2- 172.21.15.72:0/1794655686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51081576d0 0x7f51080c6070 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f5100009f50 tx=0x7f5100009840).stop 2023-08-31T19:03:47.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.861+0000 7f510efff700 1 -- 172.21.15.72:0/1794655686 shutdown_connections 2023-08-31T19:03:47.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.861+0000 7f510efff700 1 --2- 172.21.15.72:0/1794655686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51081576d0 0x7f51080c6070 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.861+0000 7f510efff700 1 --2- 172.21.15.72:0/1794655686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51080a9eb0 0x7f51080aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.861+0000 7f510efff700 1 -- 172.21.15.72:0/1794655686 >> 172.21.15.72:0/1794655686 conn(0x7f51080c82e0 msgr2=0x7f510805e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:47.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.861+0000 7f510efff700 1 -- 172.21.15.72:0/1794655686 shutdown_connections 2023-08-31T19:03:47.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.861+0000 7f510efff700 1 -- 172.21.15.72:0/1794655686 wait complete. 2023-08-31T19:03:47.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.863+0000 7f510efff700 1 Processor -- start 2023-08-31T19:03:47.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.863+0000 7f510efff700 1 -- start start 2023-08-31T19:03:47.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.864+0000 7f510efff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51080a9eb0 0x7f51080b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.864+0000 7f510efff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51080c5bf0 0x7f5108145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.864+0000 7f510efff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51081576d0 0x7f5108151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.865+0000 7f510efff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51080b06d0 con 0x7f51080c5bf0 2023-08-31T19:03:47.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.865+0000 7f510efff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5108146490 con 0x7f51080a9eb0 2023-08-31T19:03:47.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.865+0000 7f510efff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51080b03f0 con 0x7f51081576d0 2023-08-31T19:03:47.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.865+0000 7f5107fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51080c5bf0 0x7f5108145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:47.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.865+0000 7f5107fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51080c5bf0 0x7f5108145fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43580/0 (socket says 172.21.15.72:43580) 2023-08-31T19:03:47.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.865+0000 7f510cd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51080a9eb0 0x7f51080b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:47.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.865+0000 7f5107fff700 1 -- 172.21.15.72:0/629481494 learned_addr learned my addr 172.21.15.72:0/629481494 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:47.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.865+0000 7f510d59c700 1 --2- 172.21.15.72:0/629481494 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51081576d0 0x7f5108151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:47.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.865+0000 7f5107fff700 1 -- 172.21.15.72:0/629481494 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51081576d0 msgr2=0x7f5108151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:47.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.865+0000 7f5107fff700 1 --2- 172.21.15.72:0/629481494 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51081576d0 0x7f5108151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.865+0000 7f5107fff700 1 -- 172.21.15.72:0/629481494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51080a9eb0 msgr2=0x7f51080b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:47.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.865+0000 7f5107fff700 1 --2- 172.21.15.72:0/629481494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51080a9eb0 0x7f51080b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:47.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.865+0000 7f5107fff700 1 -- 172.21.15.72:0/629481494 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5100009ae0 con 0x7f51080c5bf0 2023-08-31T19:03:47.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.865+0000 7f5107fff700 1 --2- 172.21.15.72:0/629481494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51080c5bf0 0x7f5108145fa0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f50f400c4e0 tx=0x7f50f4007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:47.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.866+0000 7f5104ff9700 1 -- 172.21.15.72:0/629481494 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f400ce50 con 0x7f51080c5bf0 2023-08-31T19:03:47.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.866+0000 7f5104ff9700 1 -- 172.21.15.72:0/629481494 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f40072e0 con 0x7f51080c5bf0 2023-08-31T19:03:47.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.866+0000 7f510efff700 1 -- 172.21.15.72:0/629481494 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51080c1fc0 con 0x7f51080c5bf0 2023-08-31T19:03:47.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.866+0000 7f510efff700 1 -- 172.21.15.72:0/629481494 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51080c2580 con 0x7f51080c5bf0 2023-08-31T19:03:47.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.866+0000 7f5104ff9700 1 -- 172.21.15.72:0/629481494 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f40056e0 con 0x7f51080c5bf0 2023-08-31T19:03:47.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.867+0000 7f510efff700 1 -- 172.21.15.72:0/629481494 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e8005120 con 0x7f51080c5bf0 2023-08-31T19:03:47.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.868+0000 7f5104ff9700 1 -- 172.21.15.72:0/629481494 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f50f4005a90 con 0x7f51080c5bf0 2023-08-31T19:03:47.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.869+0000 7f5104ff9700 1 --2- 172.21.15.72:0/629481494 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f50ec05efc0 0x7f50ec061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:47.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.869+0000 7f5104ff9700 1 -- 172.21.15.72:0/629481494 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f50f4079a30 con 0x7f51080c5bf0 2023-08-31T19:03:47.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.869+0000 7f510cd9b700 1 -- 172.21.15.72:0/629481494 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f50ec05efc0 msgr2=0x7f50ec061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:47.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.869+0000 7f510cd9b700 1 --2- 172.21.15.72:0/629481494 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f50ec05efc0 0x7f50ec061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:47.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:47.877+0000 7f5104ff9700 1 -- 172.21.15.72:0/629481494 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f50f404a940 con 0x7f51080c5bf0 2023-08-31T19:03:47.908 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:47.908+0000 7f6595f04680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:03:47.954 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:47.954+0000 7f57b780a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:03:48.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.070+0000 7f510cd9b700 1 -- 172.21.15.72:0/629481494 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f50ec05efc0 msgr2=0x7f50ec061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:48.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.070+0000 7f510cd9b700 1 --2- 172.21.15.72:0/629481494 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f50ec05efc0 0x7f50ec061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:03:48.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.095+0000 7f510efff700 1 -- 172.21.15.72:0/629481494 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50e80057f0 con 0x7f51080c5bf0 2023-08-31T19:03:48.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.096+0000 7f5104ff9700 1 -- 172.21.15.72:0/629481494 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f50f404df60 con 0x7f51080c5bf0 2023-08-31T19:03:48.097 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:48.097 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5890,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1362322123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1362322123},{"type":"v1","addr":"172.21.15.146:6834","nonce":1362322123}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5893,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2001208412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2001208412},{"type":"v1","addr":"172.21.15.146:6835","nonce":2001208412}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3154756193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3154756193},{"type":"v1","addr":"172.21.15.72:6835","nonce":3154756193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:03:28.969345+0000","modified":"2023-08-31T19:03:31.984576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6252},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6252":{"gid":6252,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/2633506693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2633506693},{"type":"v1","addr":"172.21.15.72:6837","nonce":2633506693}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-31T19:03:48.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.098+0000 7f510efff700 1 -- 172.21.15.72:0/629481494 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f50ec05efc0 msgr2=0x7f50ec061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:48.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.098+0000 7f510efff700 1 --2- 172.21.15.72:0/629481494 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f50ec05efc0 0x7f50ec061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:48.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.098+0000 7f510efff700 1 -- 172.21.15.72:0/629481494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51080c5bf0 msgr2=0x7f5108145fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:48.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.098+0000 7f510efff700 1 --2- 172.21.15.72:0/629481494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51080c5bf0 0x7f5108145fa0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f50f400c4e0 tx=0x7f50f4007c60).stop 2023-08-31T19:03:48.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.098+0000 7f510efff700 1 -- 172.21.15.72:0/629481494 shutdown_connections 2023-08-31T19:03:48.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.098+0000 7f510efff700 1 --2- 172.21.15.72:0/629481494 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51081576d0 0x7f5108151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.098+0000 7f510efff700 1 --2- 172.21.15.72:0/629481494 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f50ec05efc0 0x7f50ec061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:48.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.098+0000 7f510efff700 1 --2- 172.21.15.72:0/629481494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51080a9eb0 0x7f51080b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.098+0000 7f510efff700 1 --2- 172.21.15.72:0/629481494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51080c5bf0 0x7f5108145fa0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.098+0000 7f510efff700 1 -- 172.21.15.72:0/629481494 >> 172.21.15.72:0/629481494 conn(0x7f51080c82e0 msgr2=0x7f5108064660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:48.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.098+0000 7f510efff700 1 -- 172.21.15.72:0/629481494 shutdown_connections 2023-08-31T19:03:48.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.098+0000 7f510efff700 1 -- 172.21.15.72:0/629481494 wait complete. 2023-08-31T19:03:48.106 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 32 2023-08-31T19:03:48.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:03:48.137 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:48.137+0000 7f6595f04680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:03:48.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.316+0000 7f3973bff700 1 Processor -- start 2023-08-31T19:03:48.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.316+0000 7f3973bff700 1 -- start start 2023-08-31T19:03:48.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.317+0000 7f3973bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f396c154060 0x7f396c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:48.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.317+0000 7f3973bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f396c1588d0 0x7f396c154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:48.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.317+0000 7f3973bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396c0c6120 con 0x7f396c0cb9b0 2023-08-31T19:03:48.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.317+0000 7f3973bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f396c0c1380 con 0x7f396c1588d0 2023-08-31T19:03:48.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.317+0000 7f3973bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0c5e10 con 0x7f396c154060 2023-08-31T19:03:48.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.318+0000 7f397219c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f396c1588d0 0x7f396c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:48.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.318+0000 7f397199b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f396c154060 0x7f396c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:48.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.318+0000 7f397219c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f396c1588d0 0x7f396c154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:37102/0 (socket says 172.21.15.72:37102) 2023-08-31T19:03:48.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.318+0000 7f397119a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f396c0cb9b0 0x7f396c1581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:34346/0 (socket says 172.21.15.72:34346) 2023-08-31T19:03:48.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.318+0000 7f397199b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f396c154060 0x7f396c157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:43576/0 (socket says 172.21.15.72:43576) 2023-08-31T19:03:48.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.318+0000 7f397219c700 1 -- 172.21.15.72:0/2658230939 learned_addr learned my addr 172.21.15.72:0/2658230939 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:48.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.318+0000 7f397219c700 1 -- 172.21.15.72:0/2658230939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f396c154060 msgr2=0x7f396c157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:48.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.318+0000 7f397219c700 1 --2- 172.21.15.72:0/2658230939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f396c154060 0x7f396c157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.318+0000 7f397219c700 1 -- 172.21.15.72:0/2658230939 >> v1:172.21.15.146:6789/0 conn(0x7f396c0cb9b0 legacy=0x7f396c1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:48.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.318+0000 7f397219c700 1 -- 172.21.15.72:0/2658230939 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c0c0ae0 con 0x7f396c1588d0 2023-08-31T19:03:48.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.318+0000 7f3970999700 1 -- 172.21.15.72:0/2658230939 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047166790 0 0) 0x7f396c0c6120 con 0x7f396c0cb9b0 2023-08-31T19:03:48.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.318+0000 7f397199b700 1 --2- 172.21.15.72:0/2658230939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f396c154060 0x7f396c157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:03:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.318+0000 7f397219c700 1 --2- 172.21.15.72:0/2658230939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f396c1588d0 0x7f396c154440 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f3964009f20 tx=0x7f3964009840).ready entity=mon.1 client_cookie=3cb85f63e61e0a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.319+0000 7f3970999700 1 -- 172.21.15.72:0/2658230939 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396400e070 con 0x7f396c1588d0 2023-08-31T19:03:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.319+0000 7f3970999700 1 -- 172.21.15.72:0/2658230939 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396400b9d0 con 0x7f396c1588d0 2023-08-31T19:03:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.319+0000 7f3970999700 1 -- 172.21.15.72:0/2658230939 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396400bd50 con 0x7f396c1588d0 2023-08-31T19:03:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.319+0000 7f3973bff700 1 -- 172.21.15.72:0/2658230939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f396c1588d0 msgr2=0x7f396c154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.319+0000 7f3973bff700 1 --2- 172.21.15.72:0/2658230939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f396c1588d0 0x7f396c154440 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f3964009f20 tx=0x7f3964009840).stop 2023-08-31T19:03:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.319+0000 7f3973bff700 1 -- 172.21.15.72:0/2658230939 shutdown_connections 2023-08-31T19:03:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.319+0000 7f3973bff700 1 --2- 172.21.15.72:0/2658230939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f396c1588d0 0x7f396c154440 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.319+0000 7f3973bff700 1 --2- 172.21.15.72:0/2658230939 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f396c154060 0x7f396c157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.319+0000 7f3973bff700 1 -- 172.21.15.72:0/2658230939 >> 172.21.15.72:0/2658230939 conn(0x7f396c05e870 msgr2=0x7f396c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.319+0000 7f3973bff700 1 -- 172.21.15.72:0/2658230939 shutdown_connections 2023-08-31T19:03:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.319+0000 7f3973bff700 1 -- 172.21.15.72:0/2658230939 wait complete. 2023-08-31T19:03:48.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.321+0000 7f3973bff700 1 Processor -- start 2023-08-31T19:03:48.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.321+0000 7f3973bff700 1 -- start start 2023-08-31T19:03:48.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.322+0000 7f3973bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f396c0cb9b0 0x7f396c0aa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:48.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.322+0000 7f3973bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f396c154060 0x7f396c152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:48.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.322+0000 7f3973bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f396c1588d0 0x7f396c0c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:48.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.322+0000 7f3973bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0c3b20 con 0x7f396c154060 2023-08-31T19:03:48.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.322+0000 7f3973bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0c2f10 con 0x7f396c1588d0 2023-08-31T19:03:48.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.322+0000 7f3973bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0c31f0 con 0x7f396c0cb9b0 2023-08-31T19:03:48.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.322+0000 7f397199b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f396c0cb9b0 0x7f396c0aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:48.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.322+0000 7f397199b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f396c0cb9b0 0x7f396c0aa840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:43592/0 (socket says 172.21.15.72:43592) 2023-08-31T19:03:48.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.322+0000 7f397199b700 1 -- 172.21.15.72:0/1857755360 learned_addr learned my addr 172.21.15.72:0/1857755360 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:48.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.322+0000 7f397119a700 1 --2- 172.21.15.72:0/1857755360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f396c154060 0x7f396c152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.322+0000 7f397219c700 1 --2- 172.21.15.72:0/1857755360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f396c1588d0 0x7f396c0c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.323+0000 7f397199b700 1 -- 172.21.15.72:0/1857755360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f396c1588d0 msgr2=0x7f396c0c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.323+0000 7f397199b700 1 --2- 172.21.15.72:0/1857755360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f396c1588d0 0x7f396c0c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.323+0000 7f397199b700 1 -- 172.21.15.72:0/1857755360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f396c154060 msgr2=0x7f396c152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.323+0000 7f397199b700 1 --2- 172.21.15.72:0/1857755360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f396c154060 0x7f396c152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.323+0000 7f397199b700 1 -- 172.21.15.72:0/1857755360 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3968009250 con 0x7f396c0cb9b0 2023-08-31T19:03:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.323+0000 7f397199b700 1 --2- 172.21.15.72:0/1857755360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f396c0cb9b0 0x7f396c0aa840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f396800ec80 tx=0x7f3968006f40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:48.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.323+0000 7f3961ffb700 1 -- 172.21.15.72:0/1857755360 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3968005880 con 0x7f396c0cb9b0 2023-08-31T19:03:48.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.323+0000 7f3961ffb700 1 -- 172.21.15.72:0/1857755360 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39680059e0 con 0x7f396c0cb9b0 2023-08-31T19:03:48.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.323+0000 7f3973bff700 1 -- 172.21.15.72:0/1857755360 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3964009ae0 con 0x7f396c0cb9b0 2023-08-31T19:03:48.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.323+0000 7f3961ffb700 1 -- 172.21.15.72:0/1857755360 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3968005d60 con 0x7f396c0cb9b0 2023-08-31T19:03:48.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.323+0000 7f3973bff700 1 -- 172.21.15.72:0/1857755360 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396c0c37b0 con 0x7f396c0cb9b0 2023-08-31T19:03:48.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.324+0000 7f3973bff700 1 -- 172.21.15.72:0/1857755360 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396c06c6b0 con 0x7f396c0cb9b0 2023-08-31T19:03:48.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.325+0000 7f3961ffb700 1 -- 172.21.15.72:0/1857755360 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 29) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f396800ca60 con 0x7f396c0cb9b0 2023-08-31T19:03:48.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.326+0000 7f3961ffb700 1 --2- 172.21.15.72:0/1857755360 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f395005efc0 0x7f3950061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:48.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.326+0000 7f3961ffb700 1 -- 172.21.15.72:0/1857755360 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f396807a670 con 0x7f396c0cb9b0 2023-08-31T19:03:48.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.326+0000 7f397119a700 1 -- 172.21.15.72:0/1857755360 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f395005efc0 msgr2=0x7f3950061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:48.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.326+0000 7f397119a700 1 --2- 172.21.15.72:0/1857755360 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f395005efc0 0x7f3950061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:48.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.330+0000 7f3961ffb700 1 -- 172.21.15.72:0/1857755360 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f396804b530 con 0x7f396c0cb9b0 2023-08-31T19:03:48.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.507+0000 7f3973bff700 1 -- 172.21.15.72:0/1857755360 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f396c0c0dc0 con 0x7f396c0cb9b0 2023-08-31T19:03:48.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.508+0000 7f3961ffb700 1 -- 172.21.15.72:0/1857755360 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f3968016070 con 0x7f396c0cb9b0 2023-08-31T19:03:48.510 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:48.511 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":80,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:03:42.707097+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:03:26.723490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-31T19:03:27.961871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6833/143463":"2023-09-01T19:03:42.707063+0000","172.21.15.72:0/4168262345":"2023-09-01T19:03:42.707063+0000","172.21.15.72:6832/143463":"2023-09-01T19:03:42.707063+0000","172.21.15.72:0/2848937816":"2023-09-01T19:03:42.707063+0000","172.21.15.72:0/4145724724":"2023-09-01T19:03:42.707063+0000","172.21.15.72:0/1172218123":"2023-09-01T19:03:42.707063+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:03:48.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.512+0000 7f3973bff700 1 -- 172.21.15.72:0/1857755360 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f395005efc0 msgr2=0x7f3950061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:48.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.512+0000 7f3973bff700 1 --2- 172.21.15.72:0/1857755360 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f395005efc0 0x7f3950061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:48.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.512+0000 7f3973bff700 1 -- 172.21.15.72:0/1857755360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f396c0cb9b0 msgr2=0x7f396c0aa840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:48.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.512+0000 7f3973bff700 1 --2- 172.21.15.72:0/1857755360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f396c0cb9b0 0x7f396c0aa840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f396800ec80 tx=0x7f3968006f40).stop 2023-08-31T19:03:48.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.512+0000 7f3973bff700 1 -- 172.21.15.72:0/1857755360 shutdown_connections 2023-08-31T19:03:48.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.512+0000 7f3973bff700 1 --2- 172.21.15.72:0/1857755360 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f395005efc0 0x7f3950061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:48.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.512+0000 7f3973bff700 1 --2- 172.21.15.72:0/1857755360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f396c1588d0 0x7f396c0c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.512+0000 7f3973bff700 1 --2- 172.21.15.72:0/1857755360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f396c0cb9b0 0x7f396c0aa840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.512+0000 7f3973bff700 1 --2- 172.21.15.72:0/1857755360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f396c154060 0x7f396c152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.512+0000 7f3973bff700 1 -- 172.21.15.72:0/1857755360 >> 172.21.15.72:0/1857755360 conn(0x7f396c05e870 msgr2=0x7f396c064670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:48.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.512+0000 7f3973bff700 1 -- 172.21.15.72:0/1857755360 shutdown_connections 2023-08-31T19:03:48.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.512+0000 7f3973bff700 1 -- 172.21.15.72:0/1857755360 wait complete. 2023-08-31T19:03:48.538 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T19:03:48.539 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:03:48.761 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:48.761+0000 7f57b780a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:03:48.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.771+0000 7f21a1dff700 1 Processor -- start 2023-08-31T19:03:48.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.771+0000 7f21a1dff700 1 -- start start 2023-08-31T19:03:48.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.772+0000 7f21a1dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f219c0bba70 0x7f219c0c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:48.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.773+0000 7f21a1dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219c0c26b0 con 0x7f219c135030 2023-08-31T19:03:48.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.773+0000 7f21a1dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219c0bc250 con 0x7f219c156310 2023-08-31T19:03:48.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.773+0000 7f21a1dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f219c0c1e80 con 0x7f219c0bba70 2023-08-31T19:03:48.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.773+0000 7f219b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f219c135030 0x7f219c155c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52406/0 (socket says 172.21.15.72:52406) 2023-08-31T19:03:48.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.773+0000 7f219b7fe700 1 -- 172.21.15.72:0/3101727447 learned_addr learned my addr 172.21.15.72:0/3101727447 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:48.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.773+0000 7f219bfff700 1 --2- 172.21.15.72:0/3101727447 >> v2:172.21.15.146:3300/0 conn(0x7f219c0bba70 0x7f219c0c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:48.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.773+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237163709 0 0) 0x7f219c0c26b0 con 0x7f219c135030 2023-08-31T19:03:48.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.773+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21840033f0 con 0x7f219c135030 2023-08-31T19:03:48.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.773+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391438170 0 0) 0x7f2190001110 con 0x7f219c156310 2023-08-31T19:03:48.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.773+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f219c0c26b0 con 0x7f219c156310 2023-08-31T19:03:48.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2616588395 0 0) 0x7f21840033f0 con 0x7f219c135030 2023-08-31T19:03:48.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 >> v2:172.21.15.146:3300/0 conn(0x7f219c0bba70 msgr2=0x7f219c0c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:48.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219a7fc700 1 --2- 172.21.15.72:0/3101727447 >> v2:172.21.15.146:3300/0 conn(0x7f219c0bba70 0x7f219c0c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 >> v1:172.21.15.146:6789/0 conn(0x7f219c156310 legacy=0x7f219c0641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:48.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c0bbf70 con 0x7f219c135030 2023-08-31T19:03:48.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f218c001470 con 0x7f219c135030 2023-08-31T19:03:48.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219bfff700 1 --2- 172.21.15.72:0/3101727447 >> v2:172.21.15.146:3300/0 conn(0x7f219c0bba70 0x7f219c0c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:03:48.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 >> v1:172.21.15.72:6789/0 conn(0x7f219c135030 legacy=0x7f219c155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:48.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219a7fc700 1 --2- 172.21.15.72:0/3101727447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2184003a70 0x7f2184003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:48.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219a7fc700 1 --2- 172.21.15.72:0/3101727447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2184004690 0x7f2184004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:48.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219a7fc700 1 --2- 172.21.15.72:0/3101727447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2184005000 0x7f218400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:48.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c0c1e80 con 0x7f2184003a70 2023-08-31T19:03:48.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218400bf60 con 0x7f2184005000 2023-08-31T19:03:48.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218400c0d0 con 0x7f2184004690 2023-08-31T19:03:48.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219b7fe700 1 --2- 172.21.15.72:0/3101727447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2184003a70 0x7f2184003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:48.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219bfff700 1 --2- 172.21.15.72:0/3101727447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2184005000 0x7f218400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:48.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.774+0000 7f219affd700 1 --2- 172.21.15.72:0/3101727447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2184004690 0x7f2184004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:48.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.775+0000 7f219b7fe700 1 -- 172.21.15.72:0/3101727447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2184004690 msgr2=0x7f2184004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:48.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.775+0000 7f219b7fe700 1 --2- 172.21.15.72:0/3101727447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2184004690 0x7f2184004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.775+0000 7f219b7fe700 1 -- 172.21.15.72:0/3101727447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2184005000 msgr2=0x7f218400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:48.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.775+0000 7f219b7fe700 1 --2- 172.21.15.72:0/3101727447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2184005000 0x7f218400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.775+0000 7f219b7fe700 1 -- 172.21.15.72:0/3101727447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21840033f0 con 0x7f2184003a70 2023-08-31T19:03:48.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.775+0000 7f219bfff700 1 --2- 172.21.15.72:0/3101727447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2184005000 0x7f218400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:03:48.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.775+0000 7f219bfff700 1 -- 172.21.15.72:0/3101727447 reap_dead start 2023-08-31T19:03:48.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.775+0000 7f219b7fe700 1 --2- 172.21.15.72:0/3101727447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2184003a70 0x7f2184003e70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f218c00c110 tx=0x7f218c001e10).ready entity=mon.0 client_cookie=793ec85a2cadfe46 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:48.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.775+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c00ca40 con 0x7f2184003a70 2023-08-31T19:03:48.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.775+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c00cba0 con 0x7f2184003a70 2023-08-31T19:03:48.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.775+0000 7f219a7fc700 1 -- 172.21.15.72:0/3101727447 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c0070d0 con 0x7f2184003a70 2023-08-31T19:03:48.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.776+0000 7f21a1dff700 1 -- 172.21.15.72:0/3101727447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2184003a70 msgr2=0x7f2184003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:48.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.776+0000 7f21a1dff700 1 --2- 172.21.15.72:0/3101727447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2184003a70 0x7f2184003e70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f218c00c110 tx=0x7f218c001e10).stop 2023-08-31T19:03:48.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.776+0000 7f21a1dff700 1 -- 172.21.15.72:0/3101727447 shutdown_connections 2023-08-31T19:03:48.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.776+0000 7f21a1dff700 1 --2- 172.21.15.72:0/3101727447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2184003a70 0x7f2184003e70 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.776+0000 7f21a1dff700 1 -- 172.21.15.72:0/3101727447 >> 172.21.15.72:0/3101727447 conn(0x7f219c0c6b10 msgr2=0x7f219c0c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:48.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.776+0000 7f21a1dff700 1 -- 172.21.15.72:0/3101727447 shutdown_connections 2023-08-31T19:03:48.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.776+0000 7f21a1dff700 1 -- 172.21.15.72:0/3101727447 wait complete. 2023-08-31T19:03:48.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.777+0000 7f21a1dff700 1 Processor -- start 2023-08-31T19:03:48.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.777+0000 7f21a1dff700 1 -- start start 2023-08-31T19:03:48.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.778+0000 7f21a1dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2184003a70 0x7f219c0647e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:48.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.778+0000 7f21a1dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f219c1356e0 0x7f219c064cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:48.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.778+0000 7f21a1dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f219c138370 0x7f219c068210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:48.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.778+0000 7f21a1dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c0651c0 con 0x7f219c1356e0 2023-08-31T19:03:48.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.778+0000 7f21a1dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219c132e50 con 0x7f219c138370 2023-08-31T19:03:48.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.778+0000 7f21a1dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219c065f20 con 0x7f2184003a70 2023-08-31T19:03:48.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.779+0000 7f219affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f219c1356e0 0x7f219c064cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:48.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.779+0000 7f219b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2184003a70 0x7f219c0647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:48.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.779+0000 7f219affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f219c1356e0 0x7f219c064cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43616/0 (socket says 172.21.15.72:43616) 2023-08-31T19:03:48.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.779+0000 7f219affd700 1 -- 172.21.15.72:0/2948792131 learned_addr learned my addr 172.21.15.72:0/2948792131 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:48.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.779+0000 7f219bfff700 1 --2- 172.21.15.72:0/2948792131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f219c138370 0x7f219c068210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:48.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.779+0000 7f219affd700 1 -- 172.21.15.72:0/2948792131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2184003a70 msgr2=0x7f219c0647e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:48.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.779+0000 7f219affd700 1 --2- 172.21.15.72:0/2948792131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2184003a70 0x7f219c0647e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.779+0000 7f219affd700 1 -- 172.21.15.72:0/2948792131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f219c138370 msgr2=0x7f219c068210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:48.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.779+0000 7f219affd700 1 --2- 172.21.15.72:0/2948792131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f219c138370 0x7f219c068210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:48.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.779+0000 7f219affd700 1 -- 172.21.15.72:0/2948792131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c0bf790 con 0x7f219c1356e0 2023-08-31T19:03:48.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.779+0000 7f219affd700 1 --2- 172.21.15.72:0/2948792131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f219c1356e0 0x7f219c064cd0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f219000f8b0 tx=0x7f2190007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:48.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.780+0000 7f21837fe700 1 -- 172.21.15.72:0/2948792131 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21900114c0 con 0x7f219c1356e0 2023-08-31T19:03:48.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.780+0000 7f21837fe700 1 -- 172.21.15.72:0/2948792131 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2190011620 con 0x7f219c1356e0 2023-08-31T19:03:48.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.780+0000 7f21a1dff700 1 -- 172.21.15.72:0/2948792131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219c068e20 con 0x7f219c1356e0 2023-08-31T19:03:48.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.780+0000 7f21837fe700 1 -- 172.21.15.72:0/2948792131 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21900119c0 con 0x7f219c1356e0 2023-08-31T19:03:48.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.780+0000 7f21a1dff700 1 -- 172.21.15.72:0/2948792131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219c0693e0 con 0x7f219c1356e0 2023-08-31T19:03:48.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.781+0000 7f21a1dff700 1 -- 172.21.15.72:0/2948792131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219c0bf920 con 0x7f219c1356e0 2023-08-31T19:03:48.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.782+0000 7f21837fe700 1 -- 172.21.15.72:0/2948792131 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f2190011d30 con 0x7f219c1356e0 2023-08-31T19:03:48.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.782+0000 7f21837fe700 1 --2- 172.21.15.72:0/2948792131 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f218805efc0 0x7f2188061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:48.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.782+0000 7f21837fe700 1 -- 172.21.15.72:0/2948792131 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f2190079dc0 con 0x7f219c1356e0 2023-08-31T19:03:48.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.782+0000 7f219b7fe700 1 -- 172.21.15.72:0/2948792131 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f218805efc0 msgr2=0x7f2188061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:48.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.783+0000 7f219b7fe700 1 --2- 172.21.15.72:0/2948792131 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f218805efc0 0x7f2188061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:48.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.791+0000 7f21837fe700 1 -- 172.21.15.72:0/2948792131 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f219004abd0 con 0x7f219c1356e0 2023-08-31T19:03:48.849 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:48.849+0000 7f57b780a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:03:48.942 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:48.942+0000 7f57b780a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:03:48.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.984+0000 7f219b7fe700 1 -- 172.21.15.72:0/2948792131 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f218805efc0 msgr2=0x7f2188061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:48.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:48.984+0000 7f219b7fe700 1 --2- 172.21.15.72:0/2948792131 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f218805efc0 0x7f2188061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:03:48.993 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:48.993+0000 7f6595f04680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:03:49.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.007+0000 7f21a1dff700 1 -- 172.21.15.72:0/2948792131 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f219c0bc250 con 0x7f219c1356e0 2023-08-31T19:03:49.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.007+0000 7f21837fe700 1 -- 172.21.15.72:0/2948792131 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f219c0bc250 con 0x7f219c1356e0 2023-08-31T19:03:49.008 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:49.008 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5890,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1362322123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1362322123},{"type":"v1","addr":"172.21.15.146:6834","nonce":1362322123}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5893,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2001208412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2001208412},{"type":"v1","addr":"172.21.15.146:6835","nonce":2001208412}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3154756193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3154756193},{"type":"v1","addr":"172.21.15.72:6835","nonce":3154756193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:03:28.969345+0000","modified":"2023-08-31T19:03:31.984576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6252},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6252":{"gid":6252,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/2633506693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2633506693},{"type":"v1","addr":"172.21.15.72:6837","nonce":2633506693}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-31T19:03:49.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.010+0000 7f21a1dff700 1 -- 172.21.15.72:0/2948792131 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f218805efc0 msgr2=0x7f2188061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:49.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.010+0000 7f21a1dff700 1 --2- 172.21.15.72:0/2948792131 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f218805efc0 0x7f2188061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:49.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.010+0000 7f21a1dff700 1 -- 172.21.15.72:0/2948792131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f219c1356e0 msgr2=0x7f219c064cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:49.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.010+0000 7f21a1dff700 1 --2- 172.21.15.72:0/2948792131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f219c1356e0 0x7f219c064cd0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f219000f8b0 tx=0x7f2190007bb0).stop 2023-08-31T19:03:49.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.010+0000 7f21a1dff700 1 -- 172.21.15.72:0/2948792131 shutdown_connections 2023-08-31T19:03:49.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.010+0000 7f21a1dff700 1 --2- 172.21.15.72:0/2948792131 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f218805efc0 0x7f2188061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:49.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.010+0000 7f21a1dff700 1 --2- 172.21.15.72:0/2948792131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f219c138370 0x7f219c068210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.010+0000 7f21a1dff700 1 --2- 172.21.15.72:0/2948792131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2184003a70 0x7f219c0647e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.010+0000 7f21a1dff700 1 --2- 172.21.15.72:0/2948792131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f219c1356e0 0x7f219c064cd0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.010+0000 7f21a1dff700 1 -- 172.21.15.72:0/2948792131 >> 172.21.15.72:0/2948792131 conn(0x7f219c0c6b10 msgr2=0x7f219c1542e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:49.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.010+0000 7f21a1dff700 1 -- 172.21.15.72:0/2948792131 shutdown_connections 2023-08-31T19:03:49.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.010+0000 7f21a1dff700 1 -- 172.21.15.72:0/2948792131 wait complete. 2023-08-31T19:03:49.013 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 32 2023-08-31T19:03:49.028 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:03:49.091 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:49.091+0000 7f6595f04680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:03:49.125 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:49.124+0000 7f57b780a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:03:49.189 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:49.189+0000 7f6595f04680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:03:49.213 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:49.213+0000 7f57b780a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:03:49.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.226+0000 7fa0b0bff700 1 Processor -- start 2023-08-31T19:03:49.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.227+0000 7fa0b0bff700 1 -- start start 2023-08-31T19:03:49.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.228+0000 7fa0b0bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa0ac0bf3d0 0x7fa0ac0c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:49.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.228+0000 7fa0b0bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa0ac0c5820 0x7fa0ac0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:49.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.228+0000 7fa0b0bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ac0be610 con 0x7fa0ac151eb0 2023-08-31T19:03:49.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.228+0000 7fa0b0bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ac0be8f0 con 0x7fa0ac0bf3d0 2023-08-31T19:03:49.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.228+0000 7fa0b0bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ac0bebd0 con 0x7fa0ac0c5820 2023-08-31T19:03:49.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.229+0000 7fa0a9d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa0ac0bf3d0 0x7fa0ac0c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:49.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.229+0000 7fa0a9d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa0ac0bf3d0 0x7fa0ac0c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43624/0 (socket says 172.21.15.72:43624) 2023-08-31T19:03:49.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.229+0000 7fa0aa59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa0ac151eb0 0x7fa0ac0a7bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52422/0 (socket says 172.21.15.72:52422) 2023-08-31T19:03:49.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.229+0000 7fa0a9d9b700 1 -- 172.21.15.72:0/2993445378 learned_addr learned my addr 172.21.15.72:0/2993445378 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:49.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.229+0000 7fa0aad9d700 1 --2- 172.21.15.72:0/2993445378 >> v2:172.21.15.146:3300/0 conn(0x7fa0ac0c5820 0x7fa0ac0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:49.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.229+0000 7fa0a9d9b700 1 -- 172.21.15.72:0/2993445378 >> v2:172.21.15.146:3300/0 conn(0x7fa0ac0c5820 msgr2=0x7fa0ac0a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:49.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.229+0000 7fa0a9d9b700 1 --2- 172.21.15.72:0/2993445378 >> v2:172.21.15.146:3300/0 conn(0x7fa0ac0c5820 0x7fa0ac0a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.229+0000 7fa0a9d9b700 1 -- 172.21.15.72:0/2993445378 >> v1:172.21.15.72:6789/0 conn(0x7fa0ac151eb0 legacy=0x7fa0ac0a7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:49.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.229+0000 7fa0a9d9b700 1 -- 172.21.15.72:0/2993445378 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac0beeb0 con 0x7fa0ac0bf3d0 2023-08-31T19:03:49.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.229+0000 7fa0a959a700 1 -- 172.21.15.72:0/2993445378 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130817521 0 0) 0x7fa0ac0be610 con 0x7fa0ac151eb0 2023-08-31T19:03:49.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.229+0000 7fa0a9d9b700 1 --2- 172.21.15.72:0/2993445378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ac0bf3d0 0x7fa0ac0c5330 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7fa0ac06a7d0 tx=0x7fa0a00090f0).ready entity=mon.0 client_cookie=b40012249150b1e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:49.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.230+0000 7fa0a959a700 1 -- 172.21.15.72:0/2993445378 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a000b520 con 0x7fa0ac0bf3d0 2023-08-31T19:03:49.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.230+0000 7fa0a959a700 1 -- 172.21.15.72:0/2993445378 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a000b680 con 0x7fa0ac0bf3d0 2023-08-31T19:03:49.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.230+0000 7fa0a959a700 1 -- 172.21.15.72:0/2993445378 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a000ba00 con 0x7fa0ac0bf3d0 2023-08-31T19:03:49.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.230+0000 7fa0b0bff700 1 -- 172.21.15.72:0/2993445378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ac0bf3d0 msgr2=0x7fa0ac0c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:49.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.230+0000 7fa0b0bff700 1 --2- 172.21.15.72:0/2993445378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ac0bf3d0 0x7fa0ac0c5330 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7fa0ac06a7d0 tx=0x7fa0a00090f0).stop 2023-08-31T19:03:49.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.230+0000 7fa0b0bff700 1 -- 172.21.15.72:0/2993445378 shutdown_connections 2023-08-31T19:03:49.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.230+0000 7fa0b0bff700 1 --2- 172.21.15.72:0/2993445378 >> v2:172.21.15.146:3300/0 conn(0x7fa0ac0c5820 0x7fa0ac0a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.230+0000 7fa0b0bff700 1 --2- 172.21.15.72:0/2993445378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ac0bf3d0 0x7fa0ac0c5330 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.230+0000 7fa0b0bff700 1 -- 172.21.15.72:0/2993445378 >> 172.21.15.72:0/2993445378 conn(0x7fa0ac082f60 msgr2=0x7fa0ac05e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:49.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.230+0000 7fa0b0bff700 1 -- 172.21.15.72:0/2993445378 shutdown_connections 2023-08-31T19:03:49.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.230+0000 7fa0b0bff700 1 -- 172.21.15.72:0/2993445378 wait complete. 2023-08-31T19:03:49.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.232+0000 7fa0b0bff700 1 Processor -- start 2023-08-31T19:03:49.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.232+0000 7fa0b0bff700 1 -- start start 2023-08-31T19:03:49.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.233+0000 7fa0b0bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ac0bf3d0 0x7fa0ac164170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:49.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.233+0000 7fa0b0bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ac0c5820 0x7fa0ac14ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:49.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.233+0000 7fa0b0bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ac151eb0 0x7fa0ac0ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:49.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.233+0000 7fa0b0bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac164660 con 0x7fa0ac151eb0 2023-08-31T19:03:49.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.233+0000 7fa0b0bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac165530 con 0x7fa0ac0c5820 2023-08-31T19:03:49.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.233+0000 7fa0b0bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac14e3c0 con 0x7fa0ac0bf3d0 2023-08-31T19:03:49.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.233+0000 7fa0aad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ac151eb0 0x7fa0ac0ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:49.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.233+0000 7fa0aa59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ac0bf3d0 0x7fa0ac164170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:49.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.233+0000 7fa0aad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ac151eb0 0x7fa0ac0ac700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43636/0 (socket says 172.21.15.72:43636) 2023-08-31T19:03:49.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.233+0000 7fa0aad9d700 1 -- 172.21.15.72:0/584288330 learned_addr learned my addr 172.21.15.72:0/584288330 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:49.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.234+0000 7fa0a9d9b700 1 --2- 172.21.15.72:0/584288330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ac0c5820 0x7fa0ac14ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:49.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.234+0000 7fa0aad9d700 1 -- 172.21.15.72:0/584288330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ac0bf3d0 msgr2=0x7fa0ac164170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:49.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.234+0000 7fa0aad9d700 1 --2- 172.21.15.72:0/584288330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ac0bf3d0 0x7fa0ac164170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.234+0000 7fa0aad9d700 1 -- 172.21.15.72:0/584288330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ac0c5820 msgr2=0x7fa0ac14ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:49.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.234+0000 7fa0aad9d700 1 --2- 172.21.15.72:0/584288330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ac0c5820 0x7fa0ac14ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.234+0000 7fa0aad9d700 1 -- 172.21.15.72:0/584288330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a0009370 con 0x7fa0ac151eb0 2023-08-31T19:03:49.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.234+0000 7fa0aad9d700 1 --2- 172.21.15.72:0/584288330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ac151eb0 0x7fa0ac0ac700 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7fa0a4009ec0 tx=0x7fa0a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:49.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.234+0000 7fa09a7fc700 1 -- 172.21.15.72:0/584288330 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4009bf0 con 0x7fa0ac151eb0 2023-08-31T19:03:49.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.234+0000 7fa09a7fc700 1 -- 172.21.15.72:0/584288330 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a400f040 con 0x7fa0ac151eb0 2023-08-31T19:03:49.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.234+0000 7fa0b0bff700 1 -- 172.21.15.72:0/584288330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ac165140 con 0x7fa0ac151eb0 2023-08-31T19:03:49.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.234+0000 7fa09a7fc700 1 -- 172.21.15.72:0/584288330 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a400cd20 con 0x7fa0ac151eb0 2023-08-31T19:03:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.235+0000 7fa0b0bff700 1 -- 172.21.15.72:0/584288330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ac164b80 con 0x7fa0ac151eb0 2023-08-31T19:03:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.236+0000 7fa0b0bff700 1 -- 172.21.15.72:0/584288330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ac1656e0 con 0x7fa0ac151eb0 2023-08-31T19:03:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.236+0000 7fa09a7fc700 1 -- 172.21.15.72:0/584288330 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fa0a4013610 con 0x7fa0ac151eb0 2023-08-31T19:03:49.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.238+0000 7fa09a7fc700 1 --2- 172.21.15.72:0/584288330 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa08c05ef90 0x7fa08c061450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:49.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.238+0000 7fa0aa59c700 1 -- 172.21.15.72:0/584288330 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa08c05ef90 msgr2=0x7fa08c061450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:49.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.238+0000 7fa09a7fc700 1 -- 172.21.15.72:0/584288330 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6979+0+0 (secure 0 0 0) 0x7fa0a407ac90 con 0x7fa0ac151eb0 2023-08-31T19:03:49.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.238+0000 7fa0aa59c700 1 --2- 172.21.15.72:0/584288330 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa08c05ef90 0x7fa08c061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:49.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.241+0000 7fa09a7fc700 1 -- 172.21.15.72:0/584288330 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa0ac1656e0 con 0x7fa0ac151eb0 2023-08-31T19:03:49.354 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:49.354+0000 7f57b780a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:03:49.384 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:49.384+0000 7f6595f04680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:03:49.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.439+0000 7fa0aa59c700 1 -- 172.21.15.72:0/584288330 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa08c05ef90 msgr2=0x7fa08c061450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:49.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.439+0000 7fa0aa59c700 1 --2- 172.21.15.72:0/584288330 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa08c05ef90 0x7fa08c061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:03:49.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.459+0000 7fa0b0bff700 1 -- 172.21.15.72:0/584288330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0ac1656e0 con 0x7fa0ac151eb0 2023-08-31T19:03:49.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.460+0000 7fa09a7fc700 1 -- 172.21.15.72:0/584288330 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4496 (secure 0 0 0) 0x7fa0ac1656e0 con 0x7fa0ac151eb0 2023-08-31T19:03:49.460 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:49.461 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5890,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1362322123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1362322123},{"type":"v1","addr":"172.21.15.146:6834","nonce":1362322123}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5893,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2001208412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2001208412},{"type":"v1","addr":"172.21.15.146:6835","nonce":2001208412}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3154756193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3154756193},{"type":"v1","addr":"172.21.15.72:6835","nonce":3154756193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:03:28.969345+0000","modified":"2023-08-31T19:03:31.984576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6252},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6252":{"gid":6252,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/2633506693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2633506693},{"type":"v1","addr":"172.21.15.72:6837","nonce":2633506693}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-31T19:03:49.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.462+0000 7fa0b0bff700 1 -- 172.21.15.72:0/584288330 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa08c05ef90 msgr2=0x7fa08c061450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:49.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.462+0000 7fa0b0bff700 1 --2- 172.21.15.72:0/584288330 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa08c05ef90 0x7fa08c061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:49.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.462+0000 7fa0b0bff700 1 -- 172.21.15.72:0/584288330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ac151eb0 msgr2=0x7fa0ac0ac700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:49.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.462+0000 7fa0b0bff700 1 --2- 172.21.15.72:0/584288330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ac151eb0 0x7fa0ac0ac700 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7fa0a4009ec0 tx=0x7fa0a400b040).stop 2023-08-31T19:03:49.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.462+0000 7fa0b0bff700 1 -- 172.21.15.72:0/584288330 shutdown_connections 2023-08-31T19:03:49.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.462+0000 7fa0b0bff700 1 --2- 172.21.15.72:0/584288330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0ac151eb0 0x7fa0ac0ac700 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.462+0000 7fa0b0bff700 1 --2- 172.21.15.72:0/584288330 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0ac0bf3d0 0x7fa0ac164170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.462+0000 7fa0b0bff700 1 --2- 172.21.15.72:0/584288330 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa08c05ef90 0x7fa08c061450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:49.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.462+0000 7fa0b0bff700 1 --2- 172.21.15.72:0/584288330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0ac0c5820 0x7fa0ac14ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.462+0000 7fa0b0bff700 1 -- 172.21.15.72:0/584288330 >> 172.21.15.72:0/584288330 conn(0x7fa0ac082f60 msgr2=0x7fa0ac14e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.462+0000 7fa0b0bff700 1 -- 172.21.15.72:0/584288330 shutdown_connections 2023-08-31T19:03:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.462+0000 7fa0b0bff700 1 -- 172.21.15.72:0/584288330 wait complete. 2023-08-31T19:03:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 32 2023-08-31T19:03:49.476 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:49.476+0000 7f6595f04680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:03:49.480 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:03:49.482 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:49.482+0000 7f57b780a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:03:49.629 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:49.629+0000 7f6595f04680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:03:49.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.672+0000 7f99ea79d700 1 Processor -- start 2023-08-31T19:03:49.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.672+0000 7f99ea79d700 1 -- start start 2023-08-31T19:03:49.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.673+0000 7f99ea79d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f99e40c91b0 0x7f99e4068350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:49.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.673+0000 7f99ea79d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e4067ec0 con 0x7f99e40667d0 2023-08-31T19:03:49.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.673+0000 7f99ea79d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e40678e0 con 0x7f99e40663f0 2023-08-31T19:03:49.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.673+0000 7f99ea79d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e40be750 con 0x7f99e40c91b0 2023-08-31T19:03:49.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.674+0000 7f99e9f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f99e40667d0 0x7f99e40be040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52438/0 (socket says 172.21.15.72:52438) 2023-08-31T19:03:49.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.674+0000 7f99e9f9c700 1 -- 172.21.15.72:0/3504749345 learned_addr learned my addr 172.21.15.72:0/3504749345 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:49.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.674+0000 7f99e8f9a700 1 --2- 172.21.15.72:0/3504749345 >> v2:172.21.15.146:3300/0 conn(0x7f99e40c91b0 0x7f99e4068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:49.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.674+0000 7f99dbfff700 1 -- 172.21.15.72:0/3504749345 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507278316 0 0) 0x7f99e4067ec0 con 0x7f99e40667d0 2023-08-31T19:03:49.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.674+0000 7f99dbfff700 1 -- 172.21.15.72:0/3504749345 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99d00033f0 con 0x7f99e40667d0 2023-08-31T19:03:49.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.674+0000 7f99dbfff700 1 -- 172.21.15.72:0/3504749345 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1180336406 0 0) 0x7f99e40678e0 con 0x7f99e40663f0 2023-08-31T19:03:49.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.674+0000 7f99dbfff700 1 -- 172.21.15.72:0/3504749345 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e4067ec0 con 0x7f99e40663f0 2023-08-31T19:03:49.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.674+0000 7f99e8f9a700 1 -- 172.21.15.72:0/3504749345 >> v1:172.21.15.146:6789/0 conn(0x7f99e40663f0 legacy=0x7f99e40bd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:49.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.674+0000 7f99e8f9a700 1 -- 172.21.15.72:0/3504749345 >> v1:172.21.15.72:6789/0 conn(0x7f99e40667d0 legacy=0x7f99e40be040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:49.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.674+0000 7f99e8f9a700 1 -- 172.21.15.72:0/3504749345 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e4063760 con 0x7f99e40c91b0 2023-08-31T19:03:49.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.674+0000 7f99e8f9a700 1 --2- 172.21.15.72:0/3504749345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e40c91b0 0x7f99e4068350 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f99d4009760 tx=0x7f99d4009060).ready entity=mon.1 client_cookie=6e14d7c9fc74778d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:49.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.675+0000 7f99dbfff700 1 -- 172.21.15.72:0/3504749345 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d400d4a0 con 0x7f99e40c91b0 2023-08-31T19:03:49.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.675+0000 7f99dbfff700 1 -- 172.21.15.72:0/3504749345 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d400d600 con 0x7f99e40c91b0 2023-08-31T19:03:49.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.675+0000 7f99dbfff700 1 -- 172.21.15.72:0/3504749345 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d400d980 con 0x7f99e40c91b0 2023-08-31T19:03:49.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.675+0000 7f99ea79d700 1 -- 172.21.15.72:0/3504749345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e40c91b0 msgr2=0x7f99e4068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:49.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.675+0000 7f99ea79d700 1 --2- 172.21.15.72:0/3504749345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e40c91b0 0x7f99e4068350 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f99d4009760 tx=0x7f99d4009060).stop 2023-08-31T19:03:49.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.675+0000 7f99ea79d700 1 -- 172.21.15.72:0/3504749345 shutdown_connections 2023-08-31T19:03:49.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.675+0000 7f99ea79d700 1 --2- 172.21.15.72:0/3504749345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e40c91b0 0x7f99e4068350 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.675+0000 7f99ea79d700 1 -- 172.21.15.72:0/3504749345 >> 172.21.15.72:0/3504749345 conn(0x7f99e405eb30 msgr2=0x7f99e40c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:49.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.675+0000 7f99ea79d700 1 -- 172.21.15.72:0/3504749345 shutdown_connections 2023-08-31T19:03:49.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.675+0000 7f99ea79d700 1 -- 172.21.15.72:0/3504749345 wait complete. 2023-08-31T19:03:49.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.677+0000 7f99ea79d700 1 Processor -- start 2023-08-31T19:03:49.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.677+0000 7f99ea79d700 1 -- start start 2023-08-31T19:03:49.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.678+0000 7f99ea79d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e40663f0 0x7f99e4148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:49.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.678+0000 7f99ea79d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99e40667d0 0x7f99e40c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:49.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.678+0000 7f99ea79d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99e40c91b0 0x7f99e40c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:49.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.678+0000 7f99ea79d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40c7f70 con 0x7f99e40c91b0 2023-08-31T19:03:49.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.678+0000 7f99ea79d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4165a70 con 0x7f99e40663f0 2023-08-31T19:03:49.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.678+0000 7f99ea79d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40c7c90 con 0x7f99e40667d0 2023-08-31T19:03:49.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.678+0000 7f99e9f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99e40c91b0 0x7f99e40c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:49.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.678+0000 7f99e9f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99e40c91b0 0x7f99e40c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43650/0 (socket says 172.21.15.72:43650) 2023-08-31T19:03:49.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.678+0000 7f99e9f9c700 1 -- 172.21.15.72:0/2140427211 learned_addr learned my addr 172.21.15.72:0/2140427211 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:49.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.678+0000 7f99e8f9a700 1 --2- 172.21.15.72:0/2140427211 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99e40667d0 0x7f99e40c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:49.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.678+0000 7f99e979b700 1 --2- 172.21.15.72:0/2140427211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e40663f0 0x7f99e4148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:49.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.679+0000 7f99e9f9c700 1 -- 172.21.15.72:0/2140427211 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99e40667d0 msgr2=0x7f99e40c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:49.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.679+0000 7f99e9f9c700 1 --2- 172.21.15.72:0/2140427211 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99e40667d0 0x7f99e40c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.679+0000 7f99e9f9c700 1 -- 172.21.15.72:0/2140427211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e40663f0 msgr2=0x7f99e4148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:49.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.679+0000 7f99e9f9c700 1 --2- 172.21.15.72:0/2140427211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e40663f0 0x7f99e4148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.679+0000 7f99e9f9c700 1 -- 172.21.15.72:0/2140427211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d40092a0 con 0x7f99e40c91b0 2023-08-31T19:03:49.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.679+0000 7f99e9f9c700 1 --2- 172.21.15.72:0/2140427211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99e40c91b0 0x7f99e40c5940 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f99dc001560 tx=0x7f99dc001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:49.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.679+0000 7f99d97fa700 1 -- 172.21.15.72:0/2140427211 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc005d30 con 0x7f99e40c91b0 2023-08-31T19:03:49.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.679+0000 7f99d97fa700 1 -- 172.21.15.72:0/2140427211 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc005e90 con 0x7f99e40c91b0 2023-08-31T19:03:49.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.679+0000 7f99ea79d700 1 -- 172.21.15.72:0/2140427211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e4165420 con 0x7f99e40c91b0 2023-08-31T19:03:49.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.679+0000 7f99d97fa700 1 -- 172.21.15.72:0/2140427211 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc007340 con 0x7f99e40c91b0 2023-08-31T19:03:49.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.679+0000 7f99ea79d700 1 -- 172.21.15.72:0/2140427211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e4149320 con 0x7f99e40c91b0 2023-08-31T19:03:49.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.681+0000 7f99ea79d700 1 -- 172.21.15.72:0/2140427211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e4165290 con 0x7f99e40c91b0 2023-08-31T19:03:49.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.681+0000 7f99d97fa700 1 -- 172.21.15.72:0/2140427211 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 29) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f99dc0076b0 con 0x7f99e40c91b0 2023-08-31T19:03:49.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.682+0000 7f99d97fa700 1 --2- 172.21.15.72:0/2140427211 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f99c805efc0 0x7f99c8061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:49.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.682+0000 7f99d97fa700 1 -- 172.21.15.72:0/2140427211 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f99dc07a300 con 0x7f99e40c91b0 2023-08-31T19:03:49.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.682+0000 7f99e979b700 1 -- 172.21.15.72:0/2140427211 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f99c805efc0 msgr2=0x7f99c8061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:49.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.682+0000 7f99e979b700 1 --2- 172.21.15.72:0/2140427211 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f99c805efc0 0x7f99c8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:49.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.686+0000 7f99d97fa700 1 -- 172.21.15.72:0/2140427211 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99dc04b1b0 con 0x7f99e40c91b0 2023-08-31T19:03:49.771 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:49.771+0000 7f6595f04680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:03:49.828 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:49.828+0000 7f57b780a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:03:49.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.863+0000 7f99ea79d700 1 -- 172.21.15.72:0/2140427211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99e40c6250 con 0x7f99e40c91b0 2023-08-31T19:03:49.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.864+0000 7f99d97fa700 1 -- 172.21.15.72:0/2140427211 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f99dc04e7d0 con 0x7f99e40c91b0 2023-08-31T19:03:49.864 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:49.865 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":80,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:03:42.707097+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:03:26.723490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-31T19:03:27.961871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6833/143463":"2023-09-01T19:03:42.707063+0000","172.21.15.72:0/4168262345":"2023-09-01T19:03:42.707063+0000","172.21.15.72:6832/143463":"2023-09-01T19:03:42.707063+0000","172.21.15.72:0/2848937816":"2023-09-01T19:03:42.707063+0000","172.21.15.72:0/4145724724":"2023-09-01T19:03:42.707063+0000","172.21.15.72:0/1172218123":"2023-09-01T19:03:42.707063+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:03:49.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.866+0000 7f99ea79d700 1 -- 172.21.15.72:0/2140427211 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f99c805efc0 msgr2=0x7f99c8061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:49.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.866+0000 7f99ea79d700 1 --2- 172.21.15.72:0/2140427211 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f99c805efc0 0x7f99c8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:49.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.866+0000 7f99ea79d700 1 -- 172.21.15.72:0/2140427211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99e40c91b0 msgr2=0x7f99e40c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:49.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.866+0000 7f99ea79d700 1 --2- 172.21.15.72:0/2140427211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99e40c91b0 0x7f99e40c5940 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f99dc001560 tx=0x7f99dc001650).stop 2023-08-31T19:03:49.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.866+0000 7f99ea79d700 1 -- 172.21.15.72:0/2140427211 shutdown_connections 2023-08-31T19:03:49.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.866+0000 7f99ea79d700 1 --2- 172.21.15.72:0/2140427211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99e40c91b0 0x7f99e40c5940 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.866+0000 7f99ea79d700 1 --2- 172.21.15.72:0/2140427211 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f99c805efc0 0x7f99c8061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:49.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.866+0000 7f99ea79d700 1 --2- 172.21.15.72:0/2140427211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99e40663f0 0x7f99e4148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.866+0000 7f99ea79d700 1 --2- 172.21.15.72:0/2140427211 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99e40667d0 0x7f99e40c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:49.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.866+0000 7f99ea79d700 1 -- 172.21.15.72:0/2140427211 >> 172.21.15.72:0/2140427211 conn(0x7f99e405eb30 msgr2=0x7f99e40c13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:49.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.866+0000 7f99ea79d700 1 -- 172.21.15.72:0/2140427211 shutdown_connections 2023-08-31T19:03:49.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:49.866+0000 7f99ea79d700 1 -- 172.21.15.72:0/2140427211 wait complete. 2023-08-31T19:03:49.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T19:03:49.916 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:03:49.916+0000 7f57b780a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:03:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.088+0000 7f45b23ff700 1 Processor -- start 2023-08-31T19:03:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.088+0000 7f45b23ff700 1 -- start start 2023-08-31T19:03:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.089+0000 7f45b23ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45ac0ad1b0 0x7f45ac0ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.089+0000 7f45b23ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ac0637c0 0x7f45ac155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.089+0000 7f45b23ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac0c6130 con 0x7f45ac157c10 2023-08-31T19:03:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.089+0000 7f45b23ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ac0c0350 con 0x7f45ac0ad1b0 2023-08-31T19:03:50.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.089+0000 7f45b23ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac1580b0 con 0x7f45ac0637c0 2023-08-31T19:03:50.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.090+0000 7f45abfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45ac0ad1b0 0x7f45ac0ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:50.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.090+0000 7f45abfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45ac0ad1b0 0x7f45ac0ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43660/0 (socket says 172.21.15.72:43660) 2023-08-31T19:03:50.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.090+0000 7f45abfff700 1 -- 172.21.15.72:0/883503432 learned_addr learned my addr 172.21.15.72:0/883503432 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:50.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.090+0000 7f45ab7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f45ac157c10 0x7f45ac0630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52442/0 (socket says 172.21.15.72:52442) 2023-08-31T19:03:50.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.090+0000 7f45b099c700 1 --2- 172.21.15.72:0/883503432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ac0637c0 0x7f45ac155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:50.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.090+0000 7f45abfff700 1 -- 172.21.15.72:0/883503432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ac0637c0 msgr2=0x7f45ac155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:50.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.090+0000 7f45aaffd700 1 -- 172.21.15.72:0/883503432 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336077137 0 0) 0x7f45ac0c6130 con 0x7f45ac157c10 2023-08-31T19:03:50.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.090+0000 7f45abfff700 1 --2- 172.21.15.72:0/883503432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ac0637c0 0x7f45ac155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:50.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.090+0000 7f45abfff700 1 -- 172.21.15.72:0/883503432 >> v1:172.21.15.72:6789/0 conn(0x7f45ac157c10 legacy=0x7f45ac0630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:50.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.090+0000 7f45abfff700 1 -- 172.21.15.72:0/883503432 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac155560 con 0x7f45ac0ad1b0 2023-08-31T19:03:50.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.090+0000 7f45abfff700 1 --2- 172.21.15.72:0/883503432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ac0ad1b0 0x7f45ac0ad590 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f459c006fd0 tx=0x7f459c0090f0).ready entity=mon.0 client_cookie=d9ca743f0e054719 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:50.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.091+0000 7f45aaffd700 1 -- 172.21.15.72:0/883503432 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c00b580 con 0x7f45ac0ad1b0 2023-08-31T19:03:50.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.091+0000 7f45aaffd700 1 -- 172.21.15.72:0/883503432 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c00b6e0 con 0x7f45ac0ad1b0 2023-08-31T19:03:50.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.091+0000 7f45aaffd700 1 -- 172.21.15.72:0/883503432 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c00ba60 con 0x7f45ac0ad1b0 2023-08-31T19:03:50.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.091+0000 7f45b23ff700 1 -- 172.21.15.72:0/883503432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ac0ad1b0 msgr2=0x7f45ac0ad590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:50.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.091+0000 7f45b23ff700 1 --2- 172.21.15.72:0/883503432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ac0ad1b0 0x7f45ac0ad590 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f459c006fd0 tx=0x7f459c0090f0).stop 2023-08-31T19:03:50.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.091+0000 7f45b23ff700 1 -- 172.21.15.72:0/883503432 shutdown_connections 2023-08-31T19:03:50.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.091+0000 7f45b23ff700 1 --2- 172.21.15.72:0/883503432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ac0ad1b0 0x7f45ac0ad590 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:50.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.091+0000 7f45b23ff700 1 --2- 172.21.15.72:0/883503432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ac0637c0 0x7f45ac155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:50.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.091+0000 7f45b23ff700 1 -- 172.21.15.72:0/883503432 >> 172.21.15.72:0/883503432 conn(0x7f45ac05eb60 msgr2=0x7f45ac0cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:50.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.091+0000 7f45b23ff700 1 -- 172.21.15.72:0/883503432 shutdown_connections 2023-08-31T19:03:50.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.092+0000 7f45b23ff700 1 -- 172.21.15.72:0/883503432 wait complete. 2023-08-31T19:03:50.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.093+0000 7f45b23ff700 1 Processor -- start 2023-08-31T19:03:50.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.093+0000 7f45b23ff700 1 -- start start 2023-08-31T19:03:50.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.094+0000 7f45b23ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45ac0637c0 0x7f45ac14a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:50.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.094+0000 7f45b23ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ac0ad1b0 0x7f45ac0c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:50.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.094+0000 7f45b23ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ac157c10 0x7f45ac0645b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:50.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.094+0000 7f45b23ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0c4ea0 con 0x7f45ac0ad1b0 2023-08-31T19:03:50.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.094+0000 7f45b23ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0ac560 con 0x7f45ac0637c0 2023-08-31T19:03:50.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.094+0000 7f45b23ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0c4bc0 con 0x7f45ac157c10 2023-08-31T19:03:50.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.094+0000 7f45ab7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ac0ad1b0 0x7f45ac0c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:50.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.094+0000 7f45ab7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ac0ad1b0 0x7f45ac0c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43662/0 (socket says 172.21.15.72:43662) 2023-08-31T19:03:50.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.094+0000 7f45ab7fe700 1 -- 172.21.15.72:0/3952925579 learned_addr learned my addr 172.21.15.72:0/3952925579 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:50.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.094+0000 7f45abfff700 1 --2- 172.21.15.72:0/3952925579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45ac0637c0 0x7f45ac14a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:50.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.094+0000 7f45b099c700 1 --2- 172.21.15.72:0/3952925579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ac157c10 0x7f45ac0645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:50.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.095+0000 7f45abfff700 1 -- 172.21.15.72:0/3952925579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ac157c10 msgr2=0x7f45ac0645b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:50.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.095+0000 7f45abfff700 1 --2- 172.21.15.72:0/3952925579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ac157c10 0x7f45ac0645b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:50.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.095+0000 7f45abfff700 1 -- 172.21.15.72:0/3952925579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ac0ad1b0 msgr2=0x7f45ac0c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:50.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.095+0000 7f45abfff700 1 --2- 172.21.15.72:0/3952925579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ac0ad1b0 0x7f45ac0c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:50.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.095+0000 7f45abfff700 1 -- 172.21.15.72:0/3952925579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c009370 con 0x7f45ac0637c0 2023-08-31T19:03:50.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.095+0000 7f45ab7fe700 1 --2- 172.21.15.72:0/3952925579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ac0ad1b0 0x7f45ac0c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:03:50.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.095+0000 7f45abfff700 1 --2- 172.21.15.72:0/3952925579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45ac0637c0 0x7f45ac14a8e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f459c014000 tx=0x7f459c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:50.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.095+0000 7f4593fff700 1 -- 172.21.15.72:0/3952925579 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c000bc0 con 0x7f45ac0637c0 2023-08-31T19:03:50.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.095+0000 7f4593fff700 1 -- 172.21.15.72:0/3952925579 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c00b850 con 0x7f45ac0637c0 2023-08-31T19:03:50.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.095+0000 7f4593fff700 1 -- 172.21.15.72:0/3952925579 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c000d20 con 0x7f45ac0637c0 2023-08-31T19:03:50.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.095+0000 7f45b23ff700 1 -- 172.21.15.72:0/3952925579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ac0abf10 con 0x7f45ac0637c0 2023-08-31T19:03:50.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.096+0000 7f45b23ff700 1 -- 172.21.15.72:0/3952925579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac14add0 con 0x7f45ac0637c0 2023-08-31T19:03:50.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.097+0000 7f45b23ff700 1 -- 172.21.15.72:0/3952925579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ac0abd70 con 0x7f45ac0637c0 2023-08-31T19:03:50.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.097+0000 7f4593fff700 1 -- 172.21.15.72:0/3952925579 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 29) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f459c01cb50 con 0x7f45ac0637c0 2023-08-31T19:03:50.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.098+0000 7f4593fff700 1 --2- 172.21.15.72:0/3952925579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f459805efc0 0x7f4598061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:50.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.098+0000 7f4593fff700 1 -- 172.21.15.72:0/3952925579 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f459c07c140 con 0x7f45ac0637c0 2023-08-31T19:03:50.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.098+0000 7f45ab7fe700 1 -- 172.21.15.72:0/3952925579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f459805efc0 msgr2=0x7f4598061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:03:50.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.098+0000 7f45ab7fe700 1 --2- 172.21.15.72:0/3952925579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f459805efc0 0x7f4598061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:03:50.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.103+0000 7f4593fff700 1 -- 172.21.15.72:0/3952925579 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f45ac0abd70 con 0x7f45ac0637c0 2023-08-31T19:03:50.136 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:50.136+0000 7f6595f04680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:03:50.228 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:50.228+0000 7f6595f04680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:03:50.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.242+0000 7f4593fff700 1 -- 172.21.15.72:0/3952925579 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mgrmap(e 30) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f459c0798f0 con 0x7f45ac0637c0 2023-08-31T19:03:50.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.242+0000 7f4593fff700 1 -- 172.21.15.72:0/3952925579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f459805efc0 msgr2=0x7f4598061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:03:50.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.242+0000 7f4593fff700 1 --2- 172.21.15.72:0/3952925579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f459805efc0 0x7f4598061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:50.309 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:50.309+0000 7f650e20c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:50.309 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:50.309+0000 7f650e20c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:50.310 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:50.309+0000 7f650e20c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:50.310 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:50.309+0000 7f650e20c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:50.310 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:50.309+0000 7f650e20c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:50.311 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:50.310+0000 7f6510210700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:50.311 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:50.310+0000 7f6510210700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:50.311 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:50.310+0000 7f6510210700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:50.311 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:50.310+0000 7f6510210700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:50.312 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:03:50.310+0000 7f6510210700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:03:50.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:50.345+0000 7f45b23ff700 1 -- 172.21.15.72:0/3952925579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f45ac0abd70 con 0x7f45ac0637c0 2023-08-31T19:03:51.233 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-08-31T19:03:51.233+0000 7f89d2ff7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T19:03:51.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.238+0000 7f4593fff700 1 -- 172.21.15.72:0/3952925579 <== mon.1 v2:172.21.15.146:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f45ac0abd70 con 0x7f45ac0637c0 2023-08-31T19:03:51.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.241+0000 7f45b23ff700 1 -- 172.21.15.72:0/3952925579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45ac0637c0 msgr2=0x7f45ac14a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:51.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.241+0000 7f45b23ff700 1 --2- 172.21.15.72:0/3952925579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45ac0637c0 0x7f45ac14a8e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f459c014000 tx=0x7f459c017000).stop 2023-08-31T19:03:51.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.241+0000 7f45b23ff700 1 -- 172.21.15.72:0/3952925579 shutdown_connections 2023-08-31T19:03:51.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.241+0000 7f45b23ff700 1 --2- 172.21.15.72:0/3952925579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45ac157c10 0x7f45ac0645b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:51.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.241+0000 7f45b23ff700 1 --2- 172.21.15.72:0/3952925579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f459805efc0 0x7f4598061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:03:51.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.241+0000 7f45b23ff700 1 --2- 172.21.15.72:0/3952925579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45ac0637c0 0x7f45ac14a8e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:51.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.241+0000 7f45b23ff700 1 --2- 172.21.15.72:0/3952925579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45ac0ad1b0 0x7f45ac0c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:51.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.241+0000 7f45b23ff700 1 -- 172.21.15.72:0/3952925579 >> 172.21.15.72:0/3952925579 conn(0x7f45ac05eb60 msgr2=0x7f45ac152ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:51.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.241+0000 7f45b23ff700 1 -- 172.21.15.72:0/3952925579 shutdown_connections 2023-08-31T19:03:51.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.241+0000 7f45b23ff700 1 -- 172.21.15.72:0/3952925579 wait complete. 2023-08-31T19:03:51.244 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T19:03:51.245 INFO:tasks.ceph.mds.a.smithi072.stderr: -2618> 2023-08-31T19:03:33.491+0000 7f874e5f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:03:51.267 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T19:03:51.293 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T19:03:51.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.459+0000 7f328bbff700 1 Processor -- start 2023-08-31T19:03:51.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.459+0000 7f328bbff700 1 -- start start 2023-08-31T19:03:51.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.460+0000 7f328bbff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3284063830 0x7f32840c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:51.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.460+0000 7f328bbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32840c6ed0 con 0x7f3284154410 2023-08-31T19:03:51.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.460+0000 7f328bbff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32840c68c0 con 0x7f3284154030 2023-08-31T19:03:51.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.460+0000 7f328bbff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32840c66e0 con 0x7f3284063830 2023-08-31T19:03:51.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.461+0000 7f328919a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3284154410 0x7f3284063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52464/0 (socket says 172.21.15.72:52464) 2023-08-31T19:03:51.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.461+0000 7f328919a700 1 -- 172.21.15.72:0/3306622849 learned_addr learned my addr 172.21.15.72:0/3306622849 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:51.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.461+0000 7f328a19c700 1 --2- 172.21.15.72:0/3306622849 >> v2:172.21.15.146:3300/0 conn(0x7f3284063830 0x7f32840c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:51.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.461+0000 7f3288999700 1 -- 172.21.15.72:0/3306622849 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359166348 0 0) 0x7f32840c6ed0 con 0x7f3284154410 2023-08-31T19:03:51.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.461+0000 7f3288999700 1 -- 172.21.15.72:0/3306622849 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32700033f0 con 0x7f3284154410 2023-08-31T19:03:51.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.461+0000 7f328a19c700 1 -- 172.21.15.72:0/3306622849 >> v1:172.21.15.146:6789/0 conn(0x7f3284154030 legacy=0x7f32840aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:51.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.461+0000 7f3288999700 1 -- 172.21.15.72:0/3306622849 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231179145 0 0) 0x7f32840c68c0 con 0x7f3284154030 2023-08-31T19:03:51.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.461+0000 7f328a19c700 1 -- 172.21.15.72:0/3306622849 >> v1:172.21.15.72:6789/0 conn(0x7f3284154410 legacy=0x7f3284063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:51.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.461+0000 7f328a19c700 1 -- 172.21.15.72:0/3306622849 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32840c0f30 con 0x7f3284063830 2023-08-31T19:03:51.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.462+0000 7f328a19c700 1 --2- 172.21.15.72:0/3306622849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3284063830 0x7f32840c06b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f327c009e60 tx=0x7f327c009780).ready entity=mon.1 client_cookie=aa15da00d8e242f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.462+0000 7f3288999700 1 -- 172.21.15.72:0/3306622849 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c00e070 con 0x7f3284063830 2023-08-31T19:03:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.462+0000 7f3288999700 1 -- 172.21.15.72:0/3306622849 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c00bb60 con 0x7f3284063830 2023-08-31T19:03:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.462+0000 7f3288999700 1 -- 172.21.15.72:0/3306622849 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c00bee0 con 0x7f3284063830 2023-08-31T19:03:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.462+0000 7f328bbff700 1 -- 172.21.15.72:0/3306622849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3284063830 msgr2=0x7f32840c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.462+0000 7f328bbff700 1 --2- 172.21.15.72:0/3306622849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3284063830 0x7f32840c06b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f327c009e60 tx=0x7f327c009780).stop 2023-08-31T19:03:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.462+0000 7f328bbff700 1 -- 172.21.15.72:0/3306622849 shutdown_connections 2023-08-31T19:03:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.462+0000 7f328bbff700 1 --2- 172.21.15.72:0/3306622849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3284063830 0x7f32840c06b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.462+0000 7f328bbff700 1 -- 172.21.15.72:0/3306622849 >> 172.21.15.72:0/3306622849 conn(0x7f328405eb60 msgr2=0x7f32840cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.463+0000 7f328bbff700 1 -- 172.21.15.72:0/3306622849 shutdown_connections 2023-08-31T19:03:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.463+0000 7f328bbff700 1 -- 172.21.15.72:0/3306622849 wait complete. 2023-08-31T19:03:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.464+0000 7f328bbff700 1 Processor -- start 2023-08-31T19:03:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.464+0000 7f328bbff700 1 -- start start 2023-08-31T19:03:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.465+0000 7f328bbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3284063830 0x7f3284153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.465+0000 7f328bbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3284154030 0x7f32840b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.465+0000 7f328bbff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3284154410 0x7f32841675c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.465+0000 7f328bbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32840b0b40 con 0x7f3284154030 2023-08-31T19:03:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.465+0000 7f328bbff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32841515f0 con 0x7f3284154410 2023-08-31T19:03:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.465+0000 7f328bbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32840c3ae0 con 0x7f3284063830 2023-08-31T19:03:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.465+0000 7f328919a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3284154030 0x7f32840b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.465+0000 7f328919a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3284154030 0x7f32840b0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43766/0 (socket says 172.21.15.72:43766) 2023-08-31T19:03:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.465+0000 7f328919a700 1 -- 172.21.15.72:0/3473832245 learned_addr learned my addr 172.21.15.72:0/3473832245 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.466+0000 7f328a19c700 1 --2- 172.21.15.72:0/3473832245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3284154410 0x7f32841675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.466+0000 7f328999b700 1 --2- 172.21.15.72:0/3473832245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3284063830 0x7f3284153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.466+0000 7f328919a700 1 -- 172.21.15.72:0/3473832245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3284063830 msgr2=0x7f3284153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.466+0000 7f328919a700 1 --2- 172.21.15.72:0/3473832245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3284063830 0x7f3284153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.466+0000 7f328919a700 1 -- 172.21.15.72:0/3473832245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3284154410 msgr2=0x7f32841675c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.466+0000 7f328919a700 1 --2- 172.21.15.72:0/3473832245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3284154410 0x7f32841675c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.466+0000 7f328919a700 1 -- 172.21.15.72:0/3473832245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c009a20 con 0x7f3284154030 2023-08-31T19:03:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.466+0000 7f328999b700 1 --2- 172.21.15.72:0/3473832245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3284063830 0x7f3284153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.466+0000 7f328919a700 1 --2- 172.21.15.72:0/3473832245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3284154030 0x7f32840b0650 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f327400c410 tx=0x7f3274007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.466+0000 7f3279ffb700 1 -- 172.21.15.72:0/3473832245 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327400ce70 con 0x7f3284154030 2023-08-31T19:03:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.466+0000 7f3279ffb700 1 -- 172.21.15.72:0/3473832245 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32740072e0 con 0x7f3284154030 2023-08-31T19:03:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.466+0000 7f328bbff700 1 -- 172.21.15.72:0/3473832245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32840c3d30 con 0x7f3284154030 2023-08-31T19:03:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.466+0000 7f3279ffb700 1 -- 172.21.15.72:0/3473832245 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32740057a0 con 0x7f3284154030 2023-08-31T19:03:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.466+0000 7f328bbff700 1 -- 172.21.15.72:0/3473832245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32840c42f0 con 0x7f3284154030 2023-08-31T19:03:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.467+0000 7f328bbff700 1 -- 172.21.15.72:0/3473832245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3284151760 con 0x7f3284154030 2023-08-31T19:03:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.468+0000 7f3279ffb700 1 -- 172.21.15.72:0/3473832245 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 31) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f3274005b10 con 0x7f3284154030 2023-08-31T19:03:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.469+0000 7f3279ffb700 1 --2- 172.21.15.72:0/3473832245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f326805ecf0 0x7f32680611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.469+0000 7f3279ffb700 1 -- 172.21.15.72:0/3473832245 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7280+0+0 (secure 0 0 0) 0x7f3274079790 con 0x7f3284154030 2023-08-31T19:03:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.469+0000 7f328999b700 1 --2- 172.21.15.72:0/3473832245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f326805ecf0 0x7f32680611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:51.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.470+0000 7f328999b700 1 --2- 172.21.15.72:0/3473832245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f326805ecf0 0x7f32680611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3280007fd0 tx=0x7f3280009040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:51.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.473+0000 7f3279ffb700 1 -- 172.21.15.72:0/3473832245 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f327404a860 con 0x7f3284154030 2023-08-31T19:03:51.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:51.683+0000 7f328bbff700 1 -- 172.21.15.72:0/3473832245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f32840c0c50 con 0x7f3284154030 2023-08-31T19:03:52.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.247+0000 7f3279ffb700 1 -- 172.21.15.72:0/3473832245 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3274018020 con 0x7f3284154030 2023-08-31T19:03:52.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.250+0000 7f328bbff700 1 -- 172.21.15.72:0/3473832245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f326805ecf0 msgr2=0x7f32680611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:52.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.250+0000 7f328bbff700 1 --2- 172.21.15.72:0/3473832245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f326805ecf0 0x7f32680611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3280007fd0 tx=0x7f3280009040).stop 2023-08-31T19:03:52.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.250+0000 7f328bbff700 1 -- 172.21.15.72:0/3473832245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3284154030 msgr2=0x7f32840b0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:52.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.250+0000 7f328bbff700 1 --2- 172.21.15.72:0/3473832245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3284154030 0x7f32840b0650 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f327400c410 tx=0x7f3274007c70).stop 2023-08-31T19:03:52.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.250+0000 7f328bbff700 1 -- 172.21.15.72:0/3473832245 shutdown_connections 2023-08-31T19:03:52.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.250+0000 7f328bbff700 1 --2- 172.21.15.72:0/3473832245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f326805ecf0 0x7f32680611b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:52.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.250+0000 7f328bbff700 1 --2- 172.21.15.72:0/3473832245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3284154410 0x7f32841675c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:52.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.250+0000 7f328bbff700 1 --2- 172.21.15.72:0/3473832245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3284063830 0x7f3284153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:52.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.250+0000 7f328bbff700 1 --2- 172.21.15.72:0/3473832245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3284154030 0x7f32840b0650 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:52.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.250+0000 7f328bbff700 1 -- 172.21.15.72:0/3473832245 >> 172.21.15.72:0/3473832245 conn(0x7f328405eb60 msgr2=0x7f32840c7890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:52.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.251+0000 7f328bbff700 1 -- 172.21.15.72:0/3473832245 shutdown_connections 2023-08-31T19:03:52.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.251+0000 7f328bbff700 1 -- 172.21.15.72:0/3473832245 wait complete. 2023-08-31T19:03:52.272 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T19:03:52.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.507+0000 7febe8bff700 1 Processor -- start 2023-08-31T19:03:52.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.507+0000 7febe8bff700 1 -- start start 2023-08-31T19:03:52.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.507+0000 7febe8bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7febe40c4bb0 0x7febe40653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:52.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.507+0000 7febe8bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7febe413d960 0x7febe40c5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:52.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.507+0000 7febe8bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe40c5cf0 con 0x7febe40c5880 2023-08-31T19:03:52.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.507+0000 7febe8bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe40c4f90 con 0x7febe413d960 2023-08-31T19:03:52.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.507+0000 7febe8bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe40c6020 con 0x7febe40c4bb0 2023-08-31T19:03:52.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.508+0000 7febe1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7febe413d960 0x7febe40c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:52.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.508+0000 7febe1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7febe413d960 0x7febe40c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43778/0 (socket says 172.21.15.72:43778) 2023-08-31T19:03:52.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.508+0000 7febe1d9b700 1 -- 172.21.15.72:0/767394051 learned_addr learned my addr 172.21.15.72:0/767394051 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:52.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.508+0000 7febe259c700 1 --2- 172.21.15.72:0/767394051 >> v2:172.21.15.146:3300/0 conn(0x7febe40c4bb0 0x7febe40653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:52.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.508+0000 7febe1d9b700 1 -- 172.21.15.72:0/767394051 >> v2:172.21.15.146:3300/0 conn(0x7febe40c4bb0 msgr2=0x7febe40653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:52.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.508+0000 7febe1d9b700 1 --2- 172.21.15.72:0/767394051 >> v2:172.21.15.146:3300/0 conn(0x7febe40c4bb0 0x7febe40653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:52.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.508+0000 7febe1d9b700 1 -- 172.21.15.72:0/767394051 >> v1:172.21.15.146:6789/0 conn(0x7febe40c5880 legacy=0x7febe41546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:52.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.508+0000 7febe1d9b700 1 -- 172.21.15.72:0/767394051 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe41587f0 con 0x7febe413d960 2023-08-31T19:03:52.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.509+0000 7febe1d9b700 1 --2- 172.21.15.72:0/767394051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febe413d960 0x7febe40c5390 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7febe40699f0 tx=0x7febd80090f0).ready entity=mon.0 client_cookie=c6067bd88f42f1b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:52.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.509+0000 7febe159a700 1 -- 172.21.15.72:0/767394051 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd800b520 con 0x7febe413d960 2023-08-31T19:03:52.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.509+0000 7febe159a700 1 -- 172.21.15.72:0/767394051 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd800b680 con 0x7febe413d960 2023-08-31T19:03:52.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.509+0000 7febe159a700 1 -- 172.21.15.72:0/767394051 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd800ba00 con 0x7febe413d960 2023-08-31T19:03:52.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.509+0000 7febe8bff700 1 -- 172.21.15.72:0/767394051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febe413d960 msgr2=0x7febe40c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:52.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.509+0000 7febe8bff700 1 --2- 172.21.15.72:0/767394051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febe413d960 0x7febe40c5390 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7febe40699f0 tx=0x7febd80090f0).stop 2023-08-31T19:03:52.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.509+0000 7febe8bff700 1 -- 172.21.15.72:0/767394051 shutdown_connections 2023-08-31T19:03:52.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.509+0000 7febe8bff700 1 --2- 172.21.15.72:0/767394051 >> v2:172.21.15.146:3300/0 conn(0x7febe40c4bb0 0x7febe40653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:52.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.509+0000 7febe8bff700 1 --2- 172.21.15.72:0/767394051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febe413d960 0x7febe40c5390 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:52.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.509+0000 7febe8bff700 1 -- 172.21.15.72:0/767394051 >> 172.21.15.72:0/767394051 conn(0x7febe4066350 msgr2=0x7febe4066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:52.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.510+0000 7febe8bff700 1 -- 172.21.15.72:0/767394051 shutdown_connections 2023-08-31T19:03:52.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.510+0000 7febe8bff700 1 -- 172.21.15.72:0/767394051 wait complete. 2023-08-31T19:03:52.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.511+0000 7febe8bff700 1 Processor -- start 2023-08-31T19:03:52.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.511+0000 7febe8bff700 1 -- start start 2023-08-31T19:03:52.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.512+0000 7febe8bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe40c4bb0 0x7febe41398d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:52.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.512+0000 7febe8bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febe40c5880 0x7febe40ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:52.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.512+0000 7febe8bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febe413d960 0x7febe40ad510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:52.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.512+0000 7febe8bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe40c1f40 con 0x7febe413d960 2023-08-31T19:03:52.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.512+0000 7febe8bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe4155ce0 con 0x7febe40c4bb0 2023-08-31T19:03:52.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.512+0000 7febe8bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe40c1980 con 0x7febe40c5880 2023-08-31T19:03:52.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.512+0000 7febe2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febe413d960 0x7febe40ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:52.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.513+0000 7febe2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febe413d960 0x7febe40ad510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43784/0 (socket says 172.21.15.72:43784) 2023-08-31T19:03:52.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.513+0000 7febe2d9d700 1 -- 172.21.15.72:0/3533031758 learned_addr learned my addr 172.21.15.72:0/3533031758 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:52.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.513+0000 7febe1d9b700 1 --2- 172.21.15.72:0/3533031758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febe40c5880 0x7febe40ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:52.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.513+0000 7febe259c700 1 --2- 172.21.15.72:0/3533031758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe40c4bb0 0x7febe41398d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:52.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.513+0000 7febe2d9d700 1 -- 172.21.15.72:0/3533031758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febe40c5880 msgr2=0x7febe40ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:52.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.513+0000 7febe2d9d700 1 --2- 172.21.15.72:0/3533031758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febe40c5880 0x7febe40ad020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:52.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.513+0000 7febe2d9d700 1 -- 172.21.15.72:0/3533031758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe40c4bb0 msgr2=0x7febe41398d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:52.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.513+0000 7febe2d9d700 1 --2- 172.21.15.72:0/3533031758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe40c4bb0 0x7febe41398d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:52.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.513+0000 7febe2d9d700 1 -- 172.21.15.72:0/3533031758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd8009370 con 0x7febe413d960 2023-08-31T19:03:52.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.513+0000 7febe2d9d700 1 --2- 172.21.15.72:0/3533031758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febe413d960 0x7febe40ad510 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7febdc00c7f0 tx=0x7febdc001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:52.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.513+0000 7febd27fc700 1 -- 172.21.15.72:0/3533031758 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc00e4a0 con 0x7febe413d960 2023-08-31T19:03:52.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.513+0000 7febd27fc700 1 -- 172.21.15.72:0/3533031758 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc00e600 con 0x7febe413d960 2023-08-31T19:03:52.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.513+0000 7febe8bff700 1 -- 172.21.15.72:0/3533031758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe40c1c60 con 0x7febe413d960 2023-08-31T19:03:52.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.513+0000 7febd27fc700 1 -- 172.21.15.72:0/3533031758 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc00e980 con 0x7febe413d960 2023-08-31T19:03:52.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.514+0000 7febe8bff700 1 -- 172.21.15.72:0/3533031758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe4139dc0 con 0x7febe413d960 2023-08-31T19:03:52.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.515+0000 7febe8bff700 1 -- 172.21.15.72:0/3533031758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe406c6b0 con 0x7febe413d960 2023-08-31T19:03:52.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.515+0000 7febd27fc700 1 -- 172.21.15.72:0/3533031758 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 31) v1 ==== 75166+0+0 (secure 0 0 0) 0x7febdc0123f0 con 0x7febe413d960 2023-08-31T19:03:52.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.516+0000 7febd27fc700 1 --2- 172.21.15.72:0/3533031758 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7febc405ecf0 0x7febc40611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:52.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.516+0000 7febd27fc700 1 -- 172.21.15.72:0/3533031758 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7280+0+0 (secure 0 0 0) 0x7febdc079810 con 0x7febe413d960 2023-08-31T19:03:52.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.516+0000 7febe259c700 1 --2- 172.21.15.72:0/3533031758 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7febc405ecf0 0x7febc40611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:52.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.517+0000 7febe259c700 1 --2- 172.21.15.72:0/3533031758 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7febc405ecf0 0x7febc40611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7febd4009b90 tx=0x7febd4009060).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:52.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.521+0000 7febd27fc700 1 -- 172.21.15.72:0/3533031758 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7febdc0478f0 con 0x7febe413d960 2023-08-31T19:03:52.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.695+0000 7febe8bff700 1 -- 172.21.15.72:0/3533031758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7febe40bf990 con 0x7febe413d960 2023-08-31T19:03:52.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:52.752+0000 7febd27fc700 1 -- 172.21.15.72:0/3533031758 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7febdc077330 con 0x7febe413d960 2023-08-31T19:03:53.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.250+0000 7febd27fc700 1 -- 172.21.15.72:0/3533031758 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) v1 ==== 181+0+0 (secure 0 0 0) 0x7febdc075690 con 0x7febe413d960 2023-08-31T19:03:53.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.254+0000 7febe8bff700 1 -- 172.21.15.72:0/3533031758 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7febc405ecf0 msgr2=0x7febc40611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:53.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.254+0000 7febe8bff700 1 --2- 172.21.15.72:0/3533031758 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7febc405ecf0 0x7febc40611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7febd4009b90 tx=0x7febd4009060).stop 2023-08-31T19:03:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.254+0000 7febe8bff700 1 -- 172.21.15.72:0/3533031758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febe413d960 msgr2=0x7febe40ad510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.254+0000 7febe8bff700 1 --2- 172.21.15.72:0/3533031758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febe413d960 0x7febe40ad510 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7febdc00c7f0 tx=0x7febdc001510).stop 2023-08-31T19:03:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.254+0000 7febe8bff700 1 -- 172.21.15.72:0/3533031758 shutdown_connections 2023-08-31T19:03:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.254+0000 7febe8bff700 1 --2- 172.21.15.72:0/3533031758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febe413d960 0x7febe40ad510 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.254+0000 7febe8bff700 1 --2- 172.21.15.72:0/3533031758 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7febc405ecf0 0x7febc40611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:53.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.254+0000 7febe8bff700 1 --2- 172.21.15.72:0/3533031758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe40c4bb0 0x7febe41398d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:53.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.254+0000 7febe8bff700 1 --2- 172.21.15.72:0/3533031758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febe40c5880 0x7febe40ad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:53.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.254+0000 7febe8bff700 1 -- 172.21.15.72:0/3533031758 >> 172.21.15.72:0/3533031758 conn(0x7febe4066350 msgr2=0x7febe40c3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:53.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.254+0000 7febe8bff700 1 -- 172.21.15.72:0/3533031758 shutdown_connections 2023-08-31T19:03:53.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.254+0000 7febe8bff700 1 -- 172.21.15.72:0/3533031758 wait complete. 2023-08-31T19:03:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-08-31T19:03:53.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T19:03:53.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.472+0000 7f49c35ff700 1 Processor -- start 2023-08-31T19:03:53.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.473+0000 7f49c35ff700 1 -- start start 2023-08-31T19:03:53.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.474+0000 7f49c35ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f49bc064db0 0x7f49bc0a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:53.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.474+0000 7f49c35ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49bc154500 0x7f49bc15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:53.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.474+0000 7f49c35ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49bc0aa620 con 0x7f49bc154120 2023-08-31T19:03:53.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.474+0000 7f49c35ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49bc0aa3a0 con 0x7f49bc064db0 2023-08-31T19:03:53.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.474+0000 7f49c35ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc0c5450 con 0x7f49bc154500 2023-08-31T19:03:53.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.474+0000 7f49c0b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f49bc064db0 0x7f49bc0a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:53.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.474+0000 7f49c0b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f49bc064db0 0x7f49bc0a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34494/0 (socket says 172.21.15.72:34494) 2023-08-31T19:03:53.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.474+0000 7f49c0b9a700 1 -- 172.21.15.72:0/3157261527 learned_addr learned my addr 172.21.15.72:0/3157261527 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:53.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.475+0000 7f49c0b9a700 1 -- 172.21.15.72:0/3157261527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49bc154500 msgr2=0x7f49bc15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:53.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.475+0000 7f49c1b9c700 1 --2- 172.21.15.72:0/3157261527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49bc154500 0x7f49bc15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:53.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.475+0000 7f49c0b9a700 1 --2- 172.21.15.72:0/3157261527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49bc154500 0x7f49bc15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:53.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.475+0000 7f49c0b9a700 1 -- 172.21.15.72:0/3157261527 >> v1:172.21.15.146:6789/0 conn(0x7f49bc154120 legacy=0x7f49bc0646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:53.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.475+0000 7f49c0b9a700 1 -- 172.21.15.72:0/3157261527 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc0c8050 con 0x7f49bc064db0 2023-08-31T19:03:53.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.475+0000 7f49c1b9c700 1 --2- 172.21.15.72:0/3157261527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49bc154500 0x7f49bc15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:53.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.475+0000 7f49c0b9a700 1 --2- 172.21.15.72:0/3157261527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49bc064db0 0x7f49bc0a9eb0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f49ac006fd0 tx=0x7f49ac0090f0).ready entity=mon.0 client_cookie=3d7f3604df6aeed3 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:53.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.475+0000 7f49b3fff700 1 -- 172.21.15.72:0/3157261527 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac00b600 con 0x7f49bc064db0 2023-08-31T19:03:53.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.475+0000 7f49b3fff700 1 -- 172.21.15.72:0/3157261527 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac00b760 con 0x7f49bc064db0 2023-08-31T19:03:53.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.475+0000 7f49b3fff700 1 -- 172.21.15.72:0/3157261527 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac00bae0 con 0x7f49bc064db0 2023-08-31T19:03:53.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.476+0000 7f49c35ff700 1 -- 172.21.15.72:0/3157261527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49bc064db0 msgr2=0x7f49bc0a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:53.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.476+0000 7f49c35ff700 1 --2- 172.21.15.72:0/3157261527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49bc064db0 0x7f49bc0a9eb0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f49ac006fd0 tx=0x7f49ac0090f0).stop 2023-08-31T19:03:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.476+0000 7f49c35ff700 1 -- 172.21.15.72:0/3157261527 shutdown_connections 2023-08-31T19:03:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.476+0000 7f49c35ff700 1 --2- 172.21.15.72:0/3157261527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49bc154500 0x7f49bc15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.476+0000 7f49c35ff700 1 --2- 172.21.15.72:0/3157261527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49bc064db0 0x7f49bc0a9eb0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:53.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.476+0000 7f49c35ff700 1 -- 172.21.15.72:0/3157261527 >> 172.21.15.72:0/3157261527 conn(0x7f49bc0cb7e0 msgr2=0x7f49bc0c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:53.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.476+0000 7f49c35ff700 1 -- 172.21.15.72:0/3157261527 shutdown_connections 2023-08-31T19:03:53.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.476+0000 7f49c35ff700 1 -- 172.21.15.72:0/3157261527 wait complete. 2023-08-31T19:03:53.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.477+0000 7f49c35ff700 1 Processor -- start 2023-08-31T19:03:53.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.477+0000 7f49c35ff700 1 -- start start 2023-08-31T19:03:53.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.478+0000 7f49c35ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49bc064db0 0x7f49bc14cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:53.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.478+0000 7f49c35ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49bc154120 0x7f49bc0add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:53.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.478+0000 7f49c35ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49bc154500 0x7f49bc1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:53.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.478+0000 7f49c35ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc1649c0 con 0x7f49bc064db0 2023-08-31T19:03:53.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.479+0000 7f49c35ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc168c80 con 0x7f49bc154500 2023-08-31T19:03:53.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.479+0000 7f49c35ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc14d1d0 con 0x7f49bc154120 2023-08-31T19:03:53.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.479+0000 7f49c139b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49bc064db0 0x7f49bc14cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:53.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.479+0000 7f49c139b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49bc064db0 0x7f49bc14cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34502/0 (socket says 172.21.15.72:34502) 2023-08-31T19:03:53.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.479+0000 7f49c139b700 1 -- 172.21.15.72:0/3928146312 learned_addr learned my addr 172.21.15.72:0/3928146312 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:53.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.479+0000 7f49c1b9c700 1 --2- 172.21.15.72:0/3928146312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49bc154500 0x7f49bc1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:53.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.479+0000 7f49c0b9a700 1 --2- 172.21.15.72:0/3928146312 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49bc154120 0x7f49bc0add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:53.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.479+0000 7f49c139b700 1 -- 172.21.15.72:0/3928146312 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49bc154120 msgr2=0x7f49bc0add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:53.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.479+0000 7f49c139b700 1 --2- 172.21.15.72:0/3928146312 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49bc154120 0x7f49bc0add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:53.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.479+0000 7f49c139b700 1 -- 172.21.15.72:0/3928146312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49bc154500 msgr2=0x7f49bc1529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:53.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.479+0000 7f49c139b700 1 --2- 172.21.15.72:0/3928146312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49bc154500 0x7f49bc1529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:53.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.479+0000 7f49c139b700 1 -- 172.21.15.72:0/3928146312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac009370 con 0x7f49bc064db0 2023-08-31T19:03:53.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.479+0000 7f49c139b700 1 --2- 172.21.15.72:0/3928146312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49bc064db0 0x7f49bc14cce0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f49b800c440 tx=0x7f49b8007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:53.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.480+0000 7f49b17fa700 1 -- 172.21.15.72:0/3928146312 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b800cea0 con 0x7f49bc064db0 2023-08-31T19:03:53.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.480+0000 7f49b17fa700 1 -- 172.21.15.72:0/3928146312 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b800f470 con 0x7f49bc064db0 2023-08-31T19:03:53.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.480+0000 7f49b17fa700 1 -- 172.21.15.72:0/3928146312 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b800f810 con 0x7f49bc064db0 2023-08-31T19:03:53.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.480+0000 7f49c35ff700 1 -- 172.21.15.72:0/3928146312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49bc168070 con 0x7f49bc064db0 2023-08-31T19:03:53.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.480+0000 7f49c35ff700 1 -- 172.21.15.72:0/3928146312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49bc168630 con 0x7f49bc064db0 2023-08-31T19:03:53.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.481+0000 7f49c35ff700 1 -- 172.21.15.72:0/3928146312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49bc06a090 con 0x7f49bc064db0 2023-08-31T19:03:53.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.482+0000 7f49b17fa700 1 -- 172.21.15.72:0/3928146312 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f49b800fc40 con 0x7f49bc064db0 2023-08-31T19:03:53.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.483+0000 7f49b17fa700 1 --2- 172.21.15.72:0/3928146312 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f49a005ef30 0x7f49a00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:53.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.483+0000 7f49b17fa700 1 -- 172.21.15.72:0/3928146312 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6842+0+0 (secure 0 0 0) 0x7f49b8079790 con 0x7f49bc064db0 2023-08-31T19:03:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.483+0000 7f49c0b9a700 1 --2- 172.21.15.72:0/3928146312 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f49a005ef30 0x7f49a00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.484+0000 7f49c0b9a700 1 --2- 172.21.15.72:0/3928146312 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f49a005ef30 0x7f49a00613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f49ac006fd0 tx=0x7f49ac017000).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:53.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.488+0000 7f49b17fa700 1 -- 172.21.15.72:0/3928146312 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f49b80488f0 con 0x7f49bc064db0 2023-08-31T19:03:53.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:53.659+0000 7f49c35ff700 1 -- 172.21.15.72:0/3928146312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f49bc06a7e0 con 0x7f49bc064db0 2023-08-31T19:03:54.190 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:03:54.196 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:03:54.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.485+0000 7f49b17fa700 1 -- 172.21.15.72:0/3928146312 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) v1 ==== 169+0+0 (secure 0 0 0) 0x7f49b804e290 con 0x7f49bc064db0 2023-08-31T19:03:54.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.488+0000 7f49c35ff700 1 -- 172.21.15.72:0/3928146312 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f49a005ef30 msgr2=0x7f49a00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:54.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.488+0000 7f49c35ff700 1 --2- 172.21.15.72:0/3928146312 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f49a005ef30 0x7f49a00613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f49ac006fd0 tx=0x7f49ac017000).stop 2023-08-31T19:03:54.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.488+0000 7f49c35ff700 1 -- 172.21.15.72:0/3928146312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49bc064db0 msgr2=0x7f49bc14cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:54.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.488+0000 7f49c35ff700 1 --2- 172.21.15.72:0/3928146312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49bc064db0 0x7f49bc14cce0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f49b800c440 tx=0x7f49b8007de0).stop 2023-08-31T19:03:54.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.488+0000 7f49c35ff700 1 -- 172.21.15.72:0/3928146312 shutdown_connections 2023-08-31T19:03:54.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.488+0000 7f49c35ff700 1 --2- 172.21.15.72:0/3928146312 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f49a005ef30 0x7f49a00613f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:54.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.488+0000 7f49c35ff700 1 --2- 172.21.15.72:0/3928146312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49bc154500 0x7f49bc1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:54.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.488+0000 7f49c35ff700 1 --2- 172.21.15.72:0/3928146312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49bc064db0 0x7f49bc14cce0 secure :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0x7f49b800c440 tx=0x7f49b8007de0).stop 2023-08-31T19:03:54.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.488+0000 7f49c35ff700 1 --2- 172.21.15.72:0/3928146312 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49bc154120 0x7f49bc0add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:54.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.488+0000 7f49c35ff700 1 -- 172.21.15.72:0/3928146312 >> 172.21.15.72:0/3928146312 conn(0x7f49bc0cb7e0 msgr2=0x7f49bc0646a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:54.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.490+0000 7f49c35ff700 1 -- 172.21.15.72:0/3928146312 shutdown_connections 2023-08-31T19:03:54.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.491+0000 7f49c35ff700 1 -- 172.21.15.72:0/3928146312 wait complete. 2023-08-31T19:03:54.492 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-08-31T19:03:54.510 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-31T19:03:54.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.704+0000 7ff3303ff700 1 Processor -- start 2023-08-31T19:03:54.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.704+0000 7ff3303ff700 1 -- start start 2023-08-31T19:03:54.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.705+0000 7ff3303ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff328153ed0 0x7ff3281542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:54.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.705+0000 7ff3303ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3280bdb30 0x7ff328155200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:54.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.705+0000 7ff3303ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3280a84b0 con 0x7ff3280663d0 2023-08-31T19:03:54.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.705+0000 7ff3303ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3280c9410 con 0x7ff3280bdb30 2023-08-31T19:03:54.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.705+0000 7ff3303ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3280c5310 con 0x7ff328153ed0 2023-08-31T19:03:54.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.706+0000 7ff32d99a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3280bdb30 0x7ff328155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:54.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.706+0000 7ff32d99a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3280bdb30 0x7ff328155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34504/0 (socket says 172.21.15.72:34504) 2023-08-31T19:03:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.706+0000 7ff32d99a700 1 -- 172.21.15.72:0/83797988 learned_addr learned my addr 172.21.15.72:0/83797988 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.706+0000 7ff32e19b700 1 --2- 172.21.15.72:0/83797988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff328153ed0 0x7ff3281542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.706+0000 7ff32d99a700 1 -- 172.21.15.72:0/83797988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff328153ed0 msgr2=0x7ff3281542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.706+0000 7ff32d99a700 1 --2- 172.21.15.72:0/83797988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff328153ed0 0x7ff3281542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:54.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.706+0000 7ff32d99a700 1 -- 172.21.15.72:0/83797988 >> v1:172.21.15.146:6789/0 conn(0x7ff3280663d0 legacy=0x7ff328067900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:54.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.706+0000 7ff32d99a700 1 -- 172.21.15.72:0/83797988 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3281556f0 con 0x7ff3280bdb30 2023-08-31T19:03:54.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.706+0000 7ff32d99a700 1 --2- 172.21.15.72:0/83797988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3280bdb30 0x7ff328155200 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7ff318006fd0 tx=0x7ff3180090f0).ready entity=mon.0 client_cookie=9a2ea44a6f910d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:54.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.707+0000 7ff32d199700 1 -- 172.21.15.72:0/83797988 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31800b580 con 0x7ff3280bdb30 2023-08-31T19:03:54.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.707+0000 7ff32d199700 1 -- 172.21.15.72:0/83797988 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31800b6e0 con 0x7ff3280bdb30 2023-08-31T19:03:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.707+0000 7ff32d199700 1 -- 172.21.15.72:0/83797988 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31800ba80 con 0x7ff3280bdb30 2023-08-31T19:03:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.707+0000 7ff3303ff700 1 -- 172.21.15.72:0/83797988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3280bdb30 msgr2=0x7ff328155200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.707+0000 7ff3303ff700 1 --2- 172.21.15.72:0/83797988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3280bdb30 0x7ff328155200 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7ff318006fd0 tx=0x7ff3180090f0).stop 2023-08-31T19:03:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.707+0000 7ff3303ff700 1 -- 172.21.15.72:0/83797988 shutdown_connections 2023-08-31T19:03:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.707+0000 7ff3303ff700 1 --2- 172.21.15.72:0/83797988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff328153ed0 0x7ff3281542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.707+0000 7ff3303ff700 1 --2- 172.21.15.72:0/83797988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3280bdb30 0x7ff328155200 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.707+0000 7ff3303ff700 1 -- 172.21.15.72:0/83797988 >> 172.21.15.72:0/83797988 conn(0x7ff32805eb60 msgr2=0x7ff3280c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.707+0000 7ff3303ff700 1 -- 172.21.15.72:0/83797988 shutdown_connections 2023-08-31T19:03:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.707+0000 7ff3303ff700 1 -- 172.21.15.72:0/83797988 wait complete. 2023-08-31T19:03:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.709+0000 7ff3303ff700 1 Processor -- start 2023-08-31T19:03:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.709+0000 7ff3303ff700 1 -- start start 2023-08-31T19:03:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.710+0000 7ff3303ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3280663d0 0x7ff328148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.710+0000 7ff3303ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff328153ed0 0x7ff3281568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.710+0000 7ff3303ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3280c8a40 0x7ff328156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.710+0000 7ff3303ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff328157290 con 0x7ff328153ed0 2023-08-31T19:03:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.710+0000 7ff3303ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3281684d0 con 0x7ff3280c8a40 2023-08-31T19:03:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.710+0000 7ff3303ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3281678c0 con 0x7ff3280663d0 2023-08-31T19:03:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.710+0000 7ff32d99a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff328153ed0 0x7ff3281568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.710+0000 7ff32d99a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff328153ed0 0x7ff3281568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34520/0 (socket says 172.21.15.72:34520) 2023-08-31T19:03:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.710+0000 7ff32d99a700 1 -- 172.21.15.72:0/356444293 learned_addr learned my addr 172.21.15.72:0/356444293 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:54.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.711+0000 7ff32e19b700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3280663d0 0x7ff328148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:54.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.711+0000 7ff32d99a700 1 -- 172.21.15.72:0/356444293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3280663d0 msgr2=0x7ff328148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:54.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.711+0000 7ff32d99a700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3280663d0 0x7ff328148660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:54.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.711+0000 7ff32e99c700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3280c8a40 0x7ff328156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:54.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.711+0000 7ff32d99a700 1 -- 172.21.15.72:0/356444293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3280c8a40 msgr2=0x7ff328156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:54.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.711+0000 7ff32d99a700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3280c8a40 0x7ff328156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:54.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.711+0000 7ff32d99a700 1 -- 172.21.15.72:0/356444293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff318009370 con 0x7ff328153ed0 2023-08-31T19:03:54.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.711+0000 7ff32e19b700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3280663d0 0x7ff328148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:54.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.711+0000 7ff32e99c700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3280c8a40 0x7ff328156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:54.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.711+0000 7ff32d99a700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff328153ed0 0x7ff3281568b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7ff318011000 tx=0x7ff318017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:54.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.711+0000 7ff31e7fc700 1 -- 172.21.15.72:0/356444293 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31800be40 con 0x7ff328153ed0 2023-08-31T19:03:54.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.711+0000 7ff31e7fc700 1 -- 172.21.15.72:0/356444293 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31800b850 con 0x7ff328153ed0 2023-08-31T19:03:54.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.711+0000 7ff3303ff700 1 -- 172.21.15.72:0/356444293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff328167ba0 con 0x7ff328153ed0 2023-08-31T19:03:54.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.711+0000 7ff31e7fc700 1 -- 172.21.15.72:0/356444293 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31801c420 con 0x7ff328153ed0 2023-08-31T19:03:54.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.711+0000 7ff3303ff700 1 -- 172.21.15.72:0/356444293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff328168160 con 0x7ff328153ed0 2023-08-31T19:03:54.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.712+0000 7ff3303ff700 1 -- 172.21.15.72:0/356444293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32806c6b0 con 0x7ff328153ed0 2023-08-31T19:03:54.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.713+0000 7ff31e7fc700 1 -- 172.21.15.72:0/356444293 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff31801c7d0 con 0x7ff328153ed0 2023-08-31T19:03:54.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.714+0000 7ff31e7fc700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff30c05ef30 0x7ff30c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:54.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.714+0000 7ff31e7fc700 1 -- 172.21.15.72:0/356444293 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6428+0+0 (secure 0 0 0) 0x7ff31807bef0 con 0x7ff328153ed0 2023-08-31T19:03:54.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.714+0000 7ff32e19b700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff30c05ef30 0x7ff30c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:54.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.715+0000 7ff32e19b700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff30c05ef30 0x7ff30c0613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff324006d80 tx=0x7ff324008040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:54.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.718+0000 7ff31e7fc700 1 -- 172.21.15.72:0/356444293 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff31804cff0 con 0x7ff328153ed0 2023-08-31T19:03:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.890+0000 7ff3303ff700 1 -- 172.21.15.72:0/356444293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff328067360 con 0x7ff328153ed0 2023-08-31T19:03:54.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.896+0000 7ff31e7fc700 1 -- 172.21.15.72:0/356444293 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v12) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff31802a020 con 0x7ff328153ed0 2023-08-31T19:03:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.898+0000 7ff3303ff700 1 -- 172.21.15.72:0/356444293 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff30c05ef30 msgr2=0x7ff30c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.898+0000 7ff3303ff700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff30c05ef30 0x7ff30c0613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff324006d80 tx=0x7ff324008040).stop 2023-08-31T19:03:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.898+0000 7ff3303ff700 1 -- 172.21.15.72:0/356444293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff328153ed0 msgr2=0x7ff3281568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.898+0000 7ff3303ff700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff328153ed0 0x7ff3281568b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7ff318011000 tx=0x7ff318017000).stop 2023-08-31T19:03:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.898+0000 7ff3303ff700 1 -- 172.21.15.72:0/356444293 shutdown_connections 2023-08-31T19:03:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.898+0000 7ff3303ff700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff30c05ef30 0x7ff30c0613f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.898+0000 7ff3303ff700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3280c8a40 0x7ff328156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.898+0000 7ff3303ff700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3280663d0 0x7ff328148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.898+0000 7ff3303ff700 1 --2- 172.21.15.72:0/356444293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff328153ed0 0x7ff3281568b0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.898+0000 7ff3303ff700 1 -- 172.21.15.72:0/356444293 >> 172.21.15.72:0/356444293 conn(0x7ff32805eb60 msgr2=0x7ff328157ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.898+0000 7ff3303ff700 1 -- 172.21.15.72:0/356444293 shutdown_connections 2023-08-31T19:03:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:54.898+0000 7ff3303ff700 1 -- 172.21.15.72:0/356444293 wait complete. 2023-08-31T19:03:54.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-31T19:03:55.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.113+0000 7f852c1ff700 1 Processor -- start 2023-08-31T19:03:55.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.113+0000 7f852c1ff700 1 -- start start 2023-08-31T19:03:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.115+0000 7f852c1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8524153e30 0x7f8524154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.115+0000 7f852c1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85240637c0 0x7f85240c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.115+0000 7f852c1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85240bfd40 con 0x7f85240c5cb0 2023-08-31T19:03:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.115+0000 7f852c1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85240c6730 con 0x7f85240637c0 2023-08-31T19:03:55.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.115+0000 7f852c1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85240bffe0 con 0x7f8524153e30 2023-08-31T19:03:55.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.115+0000 7f852a79c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85240637c0 0x7f85240c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:55.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.115+0000 7f852a79c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85240637c0 0x7f85240c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34530/0 (socket says 172.21.15.72:34530) 2023-08-31T19:03:55.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.115+0000 7f852a79c700 1 -- 172.21.15.72:0/1160870190 learned_addr learned my addr 172.21.15.72:0/1160870190 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:55.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.115+0000 7f8529f9b700 1 --2- 172.21.15.72:0/1160870190 >> v2:172.21.15.146:3300/0 conn(0x7f8524153e30 0x7f8524154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:55.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.115+0000 7f852a79c700 1 -- 172.21.15.72:0/1160870190 >> v2:172.21.15.146:3300/0 conn(0x7f8524153e30 msgr2=0x7f8524154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:55.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.115+0000 7f852a79c700 1 --2- 172.21.15.72:0/1160870190 >> v2:172.21.15.146:3300/0 conn(0x7f8524153e30 0x7f8524154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:55.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.115+0000 7f852a79c700 1 -- 172.21.15.72:0/1160870190 >> v1:172.21.15.146:6789/0 conn(0x7f85240c5cb0 legacy=0x7f85240630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:55.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.115+0000 7f852a79c700 1 -- 172.21.15.72:0/1160870190 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85240c02c0 con 0x7f85240637c0 2023-08-31T19:03:55.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.116+0000 7f852a79c700 1 --2- 172.21.15.72:0/1160870190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85240637c0 0x7f85240c6160 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f852406aa50 tx=0x7f851c009840).ready entity=mon.0 client_cookie=1f7a6bdebe96ad67 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:55.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.116+0000 7f8528f99700 1 -- 172.21.15.72:0/1160870190 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00e070 con 0x7f85240637c0 2023-08-31T19:03:55.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.116+0000 7f8528f99700 1 -- 172.21.15.72:0/1160870190 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c00ba20 con 0x7f85240637c0 2023-08-31T19:03:55.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.116+0000 7f8528f99700 1 -- 172.21.15.72:0/1160870190 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00bda0 con 0x7f85240637c0 2023-08-31T19:03:55.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.116+0000 7f852c1ff700 1 -- 172.21.15.72:0/1160870190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85240637c0 msgr2=0x7f85240c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:55.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.116+0000 7f852c1ff700 1 --2- 172.21.15.72:0/1160870190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85240637c0 0x7f85240c6160 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f852406aa50 tx=0x7f851c009840).stop 2023-08-31T19:03:55.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.116+0000 7f852c1ff700 1 -- 172.21.15.72:0/1160870190 shutdown_connections 2023-08-31T19:03:55.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.116+0000 7f852c1ff700 1 --2- 172.21.15.72:0/1160870190 >> v2:172.21.15.146:3300/0 conn(0x7f8524153e30 0x7f8524154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:55.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.116+0000 7f852c1ff700 1 --2- 172.21.15.72:0/1160870190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85240637c0 0x7f85240c6160 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.116+0000 7f852c1ff700 1 -- 172.21.15.72:0/1160870190 >> 172.21.15.72:0/1160870190 conn(0x7f852405eb20 msgr2=0x7f85240cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.117+0000 7f852c1ff700 1 -- 172.21.15.72:0/1160870190 shutdown_connections 2023-08-31T19:03:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.117+0000 7f852c1ff700 1 -- 172.21.15.72:0/1160870190 wait complete. 2023-08-31T19:03:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.119+0000 7f852c1ff700 1 Processor -- start 2023-08-31T19:03:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.119+0000 7f852c1ff700 1 -- start start 2023-08-31T19:03:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.120+0000 7f852c1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85240637c0 0x7f852414ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.120+0000 7f852c1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85240c5cb0 0x7f8524158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.120+0000 7f852c1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8524153e30 0x7f85240c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.120+0000 7f852c1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8524157e10 con 0x7f8524153e30 2023-08-31T19:03:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.120+0000 7f852c1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85241580f0 con 0x7f85240637c0 2023-08-31T19:03:55.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.120+0000 7f852c1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85241583d0 con 0x7f85240c5cb0 2023-08-31T19:03:55.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.120+0000 7f852a79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8524153e30 0x7f85240c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:55.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.120+0000 7f852a79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8524153e30 0x7f85240c09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34534/0 (socket says 172.21.15.72:34534) 2023-08-31T19:03:55.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.120+0000 7f852a79c700 1 -- 172.21.15.72:0/3023501307 learned_addr learned my addr 172.21.15.72:0/3023501307 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:55.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.121+0000 7f8529f9b700 1 --2- 172.21.15.72:0/3023501307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85240637c0 0x7f852414ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.121+0000 7f852979a700 1 --2- 172.21.15.72:0/3023501307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85240c5cb0 0x7f8524158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.121+0000 7f852a79c700 1 -- 172.21.15.72:0/3023501307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85240c5cb0 msgr2=0x7f8524158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.121+0000 7f852a79c700 1 --2- 172.21.15.72:0/3023501307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85240c5cb0 0x7f8524158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.121+0000 7f852a79c700 1 -- 172.21.15.72:0/3023501307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85240637c0 msgr2=0x7f852414ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.121+0000 7f852a79c700 1 --2- 172.21.15.72:0/3023501307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85240637c0 0x7f852414ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:55.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.121+0000 7f852a79c700 1 -- 172.21.15.72:0/3023501307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c009ae0 con 0x7f8524153e30 2023-08-31T19:03:55.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.121+0000 7f8529f9b700 1 --2- 172.21.15.72:0/3023501307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85240637c0 0x7f852414ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:55.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.121+0000 7f852a79c700 1 --2- 172.21.15.72:0/3023501307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8524153e30 0x7f85240c09c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f85240aaee0 tx=0x7f851c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:55.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.121+0000 7f8519ffb700 1 -- 172.21.15.72:0/3023501307 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c0092e0 con 0x7f8524153e30 2023-08-31T19:03:55.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.121+0000 7f8519ffb700 1 -- 172.21.15.72:0/3023501307 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c01e470 con 0x7f8524153e30 2023-08-31T19:03:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.121+0000 7f852c1ff700 1 -- 172.21.15.72:0/3023501307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85241586b0 con 0x7f8524153e30 2023-08-31T19:03:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.121+0000 7f8519ffb700 1 -- 172.21.15.72:0/3023501307 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c01e830 con 0x7f8524153e30 2023-08-31T19:03:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.121+0000 7f852c1ff700 1 -- 172.21.15.72:0/3023501307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8524157aa0 con 0x7f8524153e30 2023-08-31T19:03:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.123+0000 7f852c1ff700 1 -- 172.21.15.72:0/3023501307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852406c6b0 con 0x7f8524153e30 2023-08-31T19:03:55.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.123+0000 7f8519ffb700 1 -- 172.21.15.72:0/3023501307 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f851c003040 con 0x7f8524153e30 2023-08-31T19:03:55.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.124+0000 7f8519ffb700 1 --2- 172.21.15.72:0/3023501307 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f850805ef00 0x7f85080613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:55.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.124+0000 7f8519ffb700 1 -- 172.21.15.72:0/3023501307 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f851c07b5c0 con 0x7f8524153e30 2023-08-31T19:03:55.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.124+0000 7f8529f9b700 1 --2- 172.21.15.72:0/3023501307 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f850805ef00 0x7f85080613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:55.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.125+0000 7f8529f9b700 1 --2- 172.21.15.72:0/3023501307 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f850805ef00 0x7f85080613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8524155fc0 tx=0x7f8520008040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:55.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.128+0000 7f8519ffb700 1 -- 172.21.15.72:0/3023501307 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f851c04c830 con 0x7f8524153e30 2023-08-31T19:03:55.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.299+0000 7f852c1ff700 1 -- 172.21.15.72:0/3023501307 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8524150120 con 0x7f8524153e30 2023-08-31T19:03:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.303+0000 7f8519ffb700 1 -- 172.21.15.72:0/3023501307 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f851c0230a0 con 0x7f8524153e30 2023-08-31T19:03:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.305+0000 7f852c1ff700 1 -- 172.21.15.72:0/3023501307 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f850805ef00 msgr2=0x7f85080613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.306+0000 7f852c1ff700 1 --2- 172.21.15.72:0/3023501307 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f850805ef00 0x7f85080613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8524155fc0 tx=0x7f8520008040).stop 2023-08-31T19:03:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.306+0000 7f852c1ff700 1 -- 172.21.15.72:0/3023501307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8524153e30 msgr2=0x7f85240c09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.306+0000 7f852c1ff700 1 --2- 172.21.15.72:0/3023501307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8524153e30 0x7f85240c09c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f85240aaee0 tx=0x7f851c009840).stop 2023-08-31T19:03:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.306+0000 7f852c1ff700 1 -- 172.21.15.72:0/3023501307 shutdown_connections 2023-08-31T19:03:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.306+0000 7f852c1ff700 1 --2- 172.21.15.72:0/3023501307 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8524153e30 0x7f85240c09c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.306+0000 7f852c1ff700 1 --2- 172.21.15.72:0/3023501307 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f850805ef00 0x7f85080613c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.306+0000 7f852c1ff700 1 --2- 172.21.15.72:0/3023501307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85240637c0 0x7f852414ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.306+0000 7f852c1ff700 1 --2- 172.21.15.72:0/3023501307 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f85240c5cb0 0x7f8524158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.306+0000 7f852c1ff700 1 -- 172.21.15.72:0/3023501307 >> 172.21.15.72:0/3023501307 conn(0x7f852405eb20 msgr2=0x7f852414f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.306+0000 7f852c1ff700 1 -- 172.21.15.72:0/3023501307 shutdown_connections 2023-08-31T19:03:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.306+0000 7f852c1ff700 1 -- 172.21.15.72:0/3023501307 wait complete. 2023-08-31T19:03:55.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-08-31T19:03:55.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.515+0000 7fb05d9ff700 1 Processor -- start 2023-08-31T19:03:55.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.515+0000 7fb05d9ff700 1 -- start start 2023-08-31T19:03:55.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.516+0000 7fb05d9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0580c4740 0x7fb058157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:55.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.517+0000 7fb05d9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0581581d0 0x7fb0580c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:55.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.517+0000 7fb05d9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb058063be0 con 0x7fb0580c6c30 2023-08-31T19:03:55.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.517+0000 7fb05d9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0580bca10 con 0x7fb0580c4740 2023-08-31T19:03:55.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.517+0000 7fb05d9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb058063010 con 0x7fb0581581d0 2023-08-31T19:03:55.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.517+0000 7fb056ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb0580c6c30 0x7fb0580bc300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33982/0 (socket says 172.21.15.72:33982) 2023-08-31T19:03:55.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.517+0000 7fb056ffd700 1 -- 172.21.15.72:0/3523945722 learned_addr learned my addr 172.21.15.72:0/3523945722 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:55.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.517+0000 7fb0577fe700 1 --2- 172.21.15.72:0/3523945722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0581581d0 0x7fb0580c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:55.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.517+0000 7fb0567fc700 1 --2- 172.21.15.72:0/3523945722 >> v2:172.21.15.146:3300/0 conn(0x7fb0580c4740 0x7fb058157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.517+0000 7fb055ffb700 1 -- 172.21.15.72:0/3523945722 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747412140 0 0) 0x7fb058063be0 con 0x7fb0580c6c30 2023-08-31T19:03:55.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.517+0000 7fb055ffb700 1 -- 172.21.15.72:0/3523945722 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0400033f0 con 0x7fb0580c6c30 2023-08-31T19:03:55.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb055ffb700 1 -- 172.21.15.72:0/3523945722 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3941683461 0 0) 0x7fb0400033f0 con 0x7fb0580c6c30 2023-08-31T19:03:55.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb055ffb700 1 -- 172.21.15.72:0/3523945722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0581581d0 msgr2=0x7fb0580c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:55.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb055ffb700 1 --2- 172.21.15.72:0/3523945722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0581581d0 0x7fb0580c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:55.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb055ffb700 1 -- 172.21.15.72:0/3523945722 >> v2:172.21.15.146:3300/0 conn(0x7fb0580c4740 msgr2=0x7fb058157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:55.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb055ffb700 1 --2- 172.21.15.72:0/3523945722 >> v2:172.21.15.146:3300/0 conn(0x7fb0580c4740 0x7fb058157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:55.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb055ffb700 1 -- 172.21.15.72:0/3523945722 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb058158610 con 0x7fb0580c6c30 2023-08-31T19:03:55.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb055ffb700 1 -- 172.21.15.72:0/3523945722 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fb048001470 con 0x7fb0580c6c30 2023-08-31T19:03:55.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb055ffb700 1 -- 172.21.15.72:0/3523945722 >> v1:172.21.15.72:6789/0 conn(0x7fb0580c6c30 legacy=0x7fb0580bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:55.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb055ffb700 1 --2- 172.21.15.72:0/3523945722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0400038e0 0x7fb040003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb055ffb700 1 --2- 172.21.15.72:0/3523945722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb040004690 0x7fb040004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb055ffb700 1 --2- 172.21.15.72:0/3523945722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0581581d0 0x7fb040005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb055ffb700 1 -- 172.21.15.72:0/3523945722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb058063010 con 0x7fb0400038e0 2023-08-31T19:03:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb055ffb700 1 -- 172.21.15.72:0/3523945722 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400044b0 con 0x7fb040004690 2023-08-31T19:03:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb055ffb700 1 -- 172.21.15.72:0/3523945722 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04000b910 con 0x7fb0581581d0 2023-08-31T19:03:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb056ffd700 1 --2- 172.21.15.72:0/3523945722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0400038e0 0x7fb040003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:55.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb0567fc700 1 --2- 172.21.15.72:0/3523945722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb040004690 0x7fb040004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:55.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb0577fe700 1 --2- 172.21.15.72:0/3523945722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0581581d0 0x7fb040005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:55.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb056ffd700 1 -- 172.21.15.72:0/3523945722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0581581d0 msgr2=0x7fb040005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:55.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb056ffd700 1 --2- 172.21.15.72:0/3523945722 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0581581d0 0x7fb040005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:55.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb056ffd700 1 -- 172.21.15.72:0/3523945722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb040004690 msgr2=0x7fb040004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:55.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb056ffd700 1 --2- 172.21.15.72:0/3523945722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb040004690 0x7fb040004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:55.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.518+0000 7fb056ffd700 1 -- 172.21.15.72:0/3523945722 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0400033f0 con 0x7fb0400038e0 2023-08-31T19:03:55.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.519+0000 7fb056ffd700 1 --2- 172.21.15.72:0/3523945722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0400038e0 0x7fb040003d00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fb04800c210 tx=0x7fb058155720).ready entity=mon.0 client_cookie=6edaba4af88ff4a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:55.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.519+0000 7fb055ffb700 1 -- 172.21.15.72:0/3523945722 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04800cb30 con 0x7fb0400038e0 2023-08-31T19:03:55.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.519+0000 7fb055ffb700 1 -- 172.21.15.72:0/3523945722 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04800cc90 con 0x7fb0400038e0 2023-08-31T19:03:55.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.519+0000 7fb055ffb700 1 -- 172.21.15.72:0/3523945722 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048007300 con 0x7fb0400038e0 2023-08-31T19:03:55.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.519+0000 7fb05d9ff700 1 -- 172.21.15.72:0/3523945722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0400038e0 msgr2=0x7fb040003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:55.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.519+0000 7fb05d9ff700 1 --2- 172.21.15.72:0/3523945722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0400038e0 0x7fb040003d00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fb04800c210 tx=0x7fb058155720).stop 2023-08-31T19:03:55.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.519+0000 7fb0577fe700 1 -- 172.21.15.72:0/3523945722 reap_dead start 2023-08-31T19:03:55.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.519+0000 7fb05d9ff700 1 -- 172.21.15.72:0/3523945722 shutdown_connections 2023-08-31T19:03:55.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.519+0000 7fb05d9ff700 1 -- 172.21.15.72:0/3523945722 >> 172.21.15.72:0/3523945722 conn(0x7fb0580c7e70 msgr2=0x7fb0580c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:55.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.519+0000 7fb05d9ff700 1 -- 172.21.15.72:0/3523945722 shutdown_connections 2023-08-31T19:03:55.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.519+0000 7fb05d9ff700 1 -- 172.21.15.72:0/3523945722 wait complete. 2023-08-31T19:03:55.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.521+0000 7fb05d9ff700 1 Processor -- start 2023-08-31T19:03:55.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.521+0000 7fb05d9ff700 1 -- start start 2023-08-31T19:03:55.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.522+0000 7fb05d9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0400038e0 0x7fb058136700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:55.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.522+0000 7fb05d9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb058155840 0x7fb0580a8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:55.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.522+0000 7fb05d9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0580a9180 0x7fb0580c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:55.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.522+0000 7fb05d9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0580a8800 con 0x7fb0580a9180 2023-08-31T19:03:55.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.522+0000 7fb05d9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb058155fb0 con 0x7fb058155840 2023-08-31T19:03:55.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.522+0000 7fb05d9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb058156290 con 0x7fb0400038e0 2023-08-31T19:03:55.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.522+0000 7fb0577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0580a9180 0x7fb0580c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:55.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.522+0000 7fb0577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0580a9180 0x7fb0580c51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34546/0 (socket says 172.21.15.72:34546) 2023-08-31T19:03:55.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.522+0000 7fb0577fe700 1 -- 172.21.15.72:0/768714215 learned_addr learned my addr 172.21.15.72:0/768714215 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:55.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.522+0000 7fb056ffd700 1 --2- 172.21.15.72:0/768714215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0400038e0 0x7fb058136700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:55.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.522+0000 7fb0567fc700 1 --2- 172.21.15.72:0/768714215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb058155840 0x7fb0580a8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:55.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.523+0000 7fb0577fe700 1 -- 172.21.15.72:0/768714215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0400038e0 msgr2=0x7fb058136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:55.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.523+0000 7fb0577fe700 1 --2- 172.21.15.72:0/768714215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0400038e0 0x7fb058136700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:55.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.523+0000 7fb0577fe700 1 -- 172.21.15.72:0/768714215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb058155840 msgr2=0x7fb0580a8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:55.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.523+0000 7fb0577fe700 1 --2- 172.21.15.72:0/768714215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb058155840 0x7fb0580a8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:55.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.523+0000 7fb0577fe700 1 -- 172.21.15.72:0/768714215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb058156570 con 0x7fb0580a9180 2023-08-31T19:03:55.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.523+0000 7fb0577fe700 1 --2- 172.21.15.72:0/768714215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0580a9180 0x7fb0580c51b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7fb05805efc0 tx=0x7fb05000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:55.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.523+0000 7fb03effd700 1 -- 172.21.15.72:0/768714215 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05000e070 con 0x7fb0580a9180 2023-08-31T19:03:55.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.523+0000 7fb03effd700 1 -- 172.21.15.72:0/768714215 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb050011c30 con 0x7fb0580a9180 2023-08-31T19:03:55.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.523+0000 7fb03effd700 1 -- 172.21.15.72:0/768714215 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050016450 con 0x7fb0580a9180 2023-08-31T19:03:55.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.523+0000 7fb05d9ff700 1 -- 172.21.15.72:0/768714215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0580a8490 con 0x7fb0580a9180 2023-08-31T19:03:55.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.523+0000 7fb05d9ff700 1 -- 172.21.15.72:0/768714215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb058150c70 con 0x7fb0580a9180 2023-08-31T19:03:55.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.524+0000 7fb05d9ff700 1 -- 172.21.15.72:0/768714215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0580a8970 con 0x7fb0580a9180 2023-08-31T19:03:55.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.525+0000 7fb03effd700 1 -- 172.21.15.72:0/768714215 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb050016800 con 0x7fb0580a9180 2023-08-31T19:03:55.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.526+0000 7fb03effd700 1 --2- 172.21.15.72:0/768714215 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb04405ef30 0x7fb0440613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:55.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.526+0000 7fb03effd700 1 -- 172.21.15.72:0/768714215 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fb05007a6c0 con 0x7fb0580a9180 2023-08-31T19:03:55.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.526+0000 7fb056ffd700 1 --2- 172.21.15.72:0/768714215 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb04405ef30 0x7fb0440613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:55.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.527+0000 7fb056ffd700 1 --2- 172.21.15.72:0/768714215 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb04405ef30 0x7fb0440613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb048008f10 tx=0x7fb048013000).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:55.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.530+0000 7fb03effd700 1 -- 172.21.15.72:0/768714215 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb05004b810 con 0x7fb0580a9180 2023-08-31T19:03:55.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:55.762+0000 7fb05d9ff700 1 -- 172.21.15.72:0/768714215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7fb05806c6b0 con 0x7fb0580a9180 2023-08-31T19:03:56.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.492+0000 7fb03effd700 1 -- 172.21.15.72:0/768714215 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v583) v1 ==== 156+0+0 (secure 0 0 0) 0x7fb05004ee30 con 0x7fb0580a9180 2023-08-31T19:03:56.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.495+0000 7fb05d9ff700 1 -- 172.21.15.72:0/768714215 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb04405ef30 msgr2=0x7fb0440613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:56.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.495+0000 7fb05d9ff700 1 --2- 172.21.15.72:0/768714215 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb04405ef30 0x7fb0440613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb048008f10 tx=0x7fb048013000).stop 2023-08-31T19:03:56.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.495+0000 7fb05d9ff700 1 -- 172.21.15.72:0/768714215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0580a9180 msgr2=0x7fb0580c51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:56.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.495+0000 7fb05d9ff700 1 --2- 172.21.15.72:0/768714215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0580a9180 0x7fb0580c51b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7fb05805efc0 tx=0x7fb05000b040).stop 2023-08-31T19:03:56.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.495+0000 7fb05d9ff700 1 -- 172.21.15.72:0/768714215 shutdown_connections 2023-08-31T19:03:56.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.495+0000 7fb05d9ff700 1 --2- 172.21.15.72:0/768714215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0580a9180 0x7fb0580c51b0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:56.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.495+0000 7fb05d9ff700 1 --2- 172.21.15.72:0/768714215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb0400038e0 0x7fb058136700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:56.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.495+0000 7fb05d9ff700 1 --2- 172.21.15.72:0/768714215 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb04405ef30 0x7fb0440613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:56.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.495+0000 7fb05d9ff700 1 --2- 172.21.15.72:0/768714215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb058155840 0x7fb0580a8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:56.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.495+0000 7fb05d9ff700 1 -- 172.21.15.72:0/768714215 >> 172.21.15.72:0/768714215 conn(0x7fb0580c7e70 msgr2=0x7fb0580a4920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:56.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.495+0000 7fb05d9ff700 1 -- 172.21.15.72:0/768714215 shutdown_connections 2023-08-31T19:03:56.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.495+0000 7fb05d9ff700 1 -- 172.21.15.72:0/768714215 wait complete. 2023-08-31T19:03:56.514 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-08-31T19:03:56.515 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-08-31T19:03:56.515 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-31T19:03:56.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-08-31T19:03:56.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.707+0000 7fa61c1ff700 1 Processor -- start 2023-08-31T19:03:56.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.707+0000 7fa61c1ff700 1 -- start start 2023-08-31T19:03:56.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.709+0000 7fa61c1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6140cb9b0 0x7fa6141583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:56.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.709+0000 7fa61c1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6140c6120 con 0x7fa614154060 2023-08-31T19:03:56.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.709+0000 7fa61c1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6140c5e10 con 0x7fa6141588d0 2023-08-31T19:03:56.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.709+0000 7fa61c1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6140c1380 con 0x7fa6140cb9b0 2023-08-31T19:03:56.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.709+0000 7fa61979a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6140cb9b0 0x7fa6141583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:56.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.709+0000 7fa61979a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6140cb9b0 0x7fa6141583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34556/0 (socket says 172.21.15.72:34556) 2023-08-31T19:03:56.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.709+0000 7fa61979a700 1 -- 172.21.15.72:0/4290174825 learned_addr learned my addr 172.21.15.72:0/4290174825 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:56.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.709+0000 7fa619f9b700 1 --1- 172.21.15.72:0/4290174825 >> v1:172.21.15.72:6789/0 conn(0x7fa614154060 0x7fa614157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33986/0 (socket says 172.21.15.72:33986) 2023-08-31T19:03:56.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.709+0000 7fa61979a700 1 -- 172.21.15.72:0/4290174825 >> v1:172.21.15.146:6789/0 conn(0x7fa6141588d0 legacy=0x7fa614154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:03:56.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.709+0000 7fa61979a700 1 -- 172.21.15.72:0/4290174825 >> v1:172.21.15.72:6789/0 conn(0x7fa614154060 legacy=0x7fa614157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:56.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.709+0000 7fa61979a700 1 -- 172.21.15.72:0/4290174825 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6140c0ae0 con 0x7fa6140cb9b0 2023-08-31T19:03:56.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.709+0000 7fa618f99700 1 -- 172.21.15.72:0/4290174825 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870426538 0 0) 0x7fa6140c6120 con 0x7fa614154060 2023-08-31T19:03:56.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.710+0000 7fa61979a700 1 --2- 172.21.15.72:0/4290174825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140cb9b0 0x7fa6141583e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fa604006fd0 tx=0x7fa6040090f0).ready entity=mon.0 client_cookie=fee33833f374b29e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:56.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.710+0000 7fa618f99700 1 -- 172.21.15.72:0/4290174825 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60400b600 con 0x7fa6140cb9b0 2023-08-31T19:03:56.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.710+0000 7fa618f99700 1 -- 172.21.15.72:0/4290174825 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60400b760 con 0x7fa6140cb9b0 2023-08-31T19:03:56.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.710+0000 7fa618f99700 1 -- 172.21.15.72:0/4290174825 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60400bae0 con 0x7fa6140cb9b0 2023-08-31T19:03:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.710+0000 7fa61c1ff700 1 -- 172.21.15.72:0/4290174825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140cb9b0 msgr2=0x7fa6141583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.710+0000 7fa61c1ff700 1 --2- 172.21.15.72:0/4290174825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140cb9b0 0x7fa6141583e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fa604006fd0 tx=0x7fa6040090f0).stop 2023-08-31T19:03:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.710+0000 7fa61c1ff700 1 -- 172.21.15.72:0/4290174825 shutdown_connections 2023-08-31T19:03:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.710+0000 7fa61c1ff700 1 --2- 172.21.15.72:0/4290174825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140cb9b0 0x7fa6141583e0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:56.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.710+0000 7fa61c1ff700 1 -- 172.21.15.72:0/4290174825 >> 172.21.15.72:0/4290174825 conn(0x7fa61405e870 msgr2=0x7fa6140cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:56.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.710+0000 7fa61c1ff700 1 -- 172.21.15.72:0/4290174825 shutdown_connections 2023-08-31T19:03:56.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.711+0000 7fa61c1ff700 1 -- 172.21.15.72:0/4290174825 wait complete. 2023-08-31T19:03:56.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.712+0000 7fa61c1ff700 1 Processor -- start 2023-08-31T19:03:56.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.712+0000 7fa61c1ff700 1 -- start start 2023-08-31T19:03:56.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.713+0000 7fa61c1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140cb9b0 0x7fa6140b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:56.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.713+0000 7fa61c1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa614154060 0x7fa614141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:56.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.713+0000 7fa61c1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6141588d0 0x7fa6140c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:56.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.713+0000 7fa61c1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140ae1b0 con 0x7fa6140cb9b0 2023-08-31T19:03:56.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.713+0000 7fa61c1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140c3f40 con 0x7fa614154060 2023-08-31T19:03:56.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.713+0000 7fa61c1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140c3330 con 0x7fa6141588d0 2023-08-31T19:03:56.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.713+0000 7fa619f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140cb9b0 0x7fa6140b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:56.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.713+0000 7fa619f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140cb9b0 0x7fa6140b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34562/0 (socket says 172.21.15.72:34562) 2023-08-31T19:03:56.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.713+0000 7fa619f9b700 1 -- 172.21.15.72:0/3495905897 learned_addr learned my addr 172.21.15.72:0/3495905897 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:56.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.714+0000 7fa61979a700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa614154060 0x7fa614141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:56.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.714+0000 7fa61a79c700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6141588d0 0x7fa6140c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:56.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.714+0000 7fa619f9b700 1 -- 172.21.15.72:0/3495905897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6141588d0 msgr2=0x7fa6140c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:56.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.714+0000 7fa619f9b700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6141588d0 0x7fa6140c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:56.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.714+0000 7fa619f9b700 1 -- 172.21.15.72:0/3495905897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa614154060 msgr2=0x7fa614141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:56.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.714+0000 7fa619f9b700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa614154060 0x7fa614141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:56.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.714+0000 7fa619f9b700 1 -- 172.21.15.72:0/3495905897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa604009370 con 0x7fa6140cb9b0 2023-08-31T19:03:56.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.714+0000 7fa61979a700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa614154060 0x7fa614141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:56.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.714+0000 7fa61a79c700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6141588d0 0x7fa6140c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:56.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.714+0000 7fa619f9b700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140cb9b0 0x7fa6140b06f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fa61000c810 tx=0x7fa610007ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:56.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.714+0000 7fa609ffb700 1 -- 172.21.15.72:0/3495905897 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6100072e0 con 0x7fa6140cb9b0 2023-08-31T19:03:56.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.714+0000 7fa609ffb700 1 -- 172.21.15.72:0/3495905897 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa610007440 con 0x7fa6140cb9b0 2023-08-31T19:03:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.714+0000 7fa61c1ff700 1 -- 172.21.15.72:0/3495905897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6140c3610 con 0x7fa6140cb9b0 2023-08-31T19:03:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.714+0000 7fa609ffb700 1 -- 172.21.15.72:0/3495905897 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6100058a0 con 0x7fa6140cb9b0 2023-08-31T19:03:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.714+0000 7fa61c1ff700 1 -- 172.21.15.72:0/3495905897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6140c3bd0 con 0x7fa6140cb9b0 2023-08-31T19:03:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.715+0000 7fa61c1ff700 1 -- 172.21.15.72:0/3495905897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61406c6b0 con 0x7fa6140cb9b0 2023-08-31T19:03:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.716+0000 7fa609ffb700 1 -- 172.21.15.72:0/3495905897 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa610005c50 con 0x7fa6140cb9b0 2023-08-31T19:03:56.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.717+0000 7fa609ffb700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa5f805ef30 0x7fa5f80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:56.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.717+0000 7fa609ffb700 1 -- 172.21.15.72:0/3495905897 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fa6100798f0 con 0x7fa6140cb9b0 2023-08-31T19:03:56.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.717+0000 7fa61979a700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa5f805ef30 0x7fa5f80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:56.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.718+0000 7fa61979a700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa5f805ef30 0x7fa5f80613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa604006df0 tx=0x7fa604017000).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:56.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.721+0000 7fa609ffb700 1 -- 172.21.15.72:0/3495905897 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa61004aab0 con 0x7fa6140cb9b0 2023-08-31T19:03:56.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:56.958+0000 7fa61c1ff700 1 -- 172.21.15.72:0/3495905897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7fa6140c4220 con 0x7fa6140cb9b0 2023-08-31T19:03:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.495+0000 7fa609ffb700 1 -- 172.21.15.72:0/3495905897 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v584) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa61004e0d0 con 0x7fa6140cb9b0 2023-08-31T19:03:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.498+0000 7fa61c1ff700 1 -- 172.21.15.72:0/3495905897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa5f805ef30 msgr2=0x7fa5f80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.498+0000 7fa61c1ff700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa5f805ef30 0x7fa5f80613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa604006df0 tx=0x7fa604017000).stop 2023-08-31T19:03:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.498+0000 7fa61c1ff700 1 -- 172.21.15.72:0/3495905897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140cb9b0 msgr2=0x7fa6140b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.498+0000 7fa61c1ff700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140cb9b0 0x7fa6140b06f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fa61000c810 tx=0x7fa610007ba0).stop 2023-08-31T19:03:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.498+0000 7fa61c1ff700 1 -- 172.21.15.72:0/3495905897 shutdown_connections 2023-08-31T19:03:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.498+0000 7fa61c1ff700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6141588d0 0x7fa6140c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.498+0000 7fa61c1ff700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140cb9b0 0x7fa6140b06f0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.498+0000 7fa61c1ff700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa5f805ef30 0x7fa5f80613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:57.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.498+0000 7fa61c1ff700 1 --2- 172.21.15.72:0/3495905897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa614154060 0x7fa614141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:57.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.498+0000 7fa61c1ff700 1 -- 172.21.15.72:0/3495905897 >> 172.21.15.72:0/3495905897 conn(0x7fa61405e870 msgr2=0x7fa614153630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:57.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.498+0000 7fa61c1ff700 1 -- 172.21.15.72:0/3495905897 shutdown_connections 2023-08-31T19:03:57.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.498+0000 7fa61c1ff700 1 -- 172.21.15.72:0/3495905897 wait complete. 2023-08-31T19:03:57.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-31T19:03:57.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.711+0000 7f7fba7ff700 1 Processor -- start 2023-08-31T19:03:57.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.711+0000 7f7fba7ff700 1 -- start start 2023-08-31T19:03:57.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.713+0000 7f7fba7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7fb4063830 0x7f7fb40c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:57.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.713+0000 7f7fba7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb40c6ed0 con 0x7f7fb4154410 2023-08-31T19:03:57.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.713+0000 7f7fba7ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb40c68c0 con 0x7f7fb4154030 2023-08-31T19:03:57.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.713+0000 7f7fba7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb40c66e0 con 0x7f7fb4063830 2023-08-31T19:03:57.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.713+0000 7f7fb37fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7fb4154410 0x7f7fb4063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33990/0 (socket says 172.21.15.72:33990) 2023-08-31T19:03:57.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.713+0000 7f7fb37fe700 1 -- 172.21.15.72:0/3391636194 learned_addr learned my addr 172.21.15.72:0/3391636194 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:57.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.713+0000 7f7fb8d9c700 1 --2- 172.21.15.72:0/3391636194 >> v2:172.21.15.72:3300/0 conn(0x7f7fb4063830 0x7f7fb40c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:57.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.713+0000 7f7fb2ffd700 1 -- 172.21.15.72:0/3391636194 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506830869 0 0) 0x7f7fb40c6ed0 con 0x7f7fb4154410 2023-08-31T19:03:57.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.713+0000 7f7fb2ffd700 1 -- 172.21.15.72:0/3391636194 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f9c0033f0 con 0x7f7fb4154410 2023-08-31T19:03:57.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.713+0000 7f7fb8d9c700 1 -- 172.21.15.72:0/3391636194 >> v1:172.21.15.146:6789/0 conn(0x7f7fb4154030 legacy=0x7f7fb40aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:57.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.713+0000 7f7fb8d9c700 1 -- 172.21.15.72:0/3391636194 >> v1:172.21.15.72:6789/0 conn(0x7f7fb4154410 legacy=0x7f7fb4063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:57.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.713+0000 7f7fb8d9c700 1 -- 172.21.15.72:0/3391636194 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb40c0f30 con 0x7f7fb4063830 2023-08-31T19:03:57.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.714+0000 7f7fb8d9c700 1 --2- 172.21.15.72:0/3391636194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb4063830 0x7f7fb40c06b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f7fac009e60 tx=0x7f7fac009780).ready entity=mon.0 client_cookie=bbe48fbe45a2d67d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:57.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.714+0000 7f7fb2ffd700 1 -- 172.21.15.72:0/3391636194 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac00e070 con 0x7f7fb4063830 2023-08-31T19:03:57.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.714+0000 7f7fb2ffd700 1 -- 172.21.15.72:0/3391636194 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac00bb60 con 0x7f7fb4063830 2023-08-31T19:03:57.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.714+0000 7f7fb2ffd700 1 -- 172.21.15.72:0/3391636194 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac012410 con 0x7f7fb4063830 2023-08-31T19:03:57.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.714+0000 7f7fba7ff700 1 -- 172.21.15.72:0/3391636194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb4063830 msgr2=0x7f7fb40c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:57.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.714+0000 7f7fba7ff700 1 --2- 172.21.15.72:0/3391636194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb4063830 0x7f7fb40c06b0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f7fac009e60 tx=0x7f7fac009780).stop 2023-08-31T19:03:57.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.714+0000 7f7fba7ff700 1 -- 172.21.15.72:0/3391636194 shutdown_connections 2023-08-31T19:03:57.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.714+0000 7f7fba7ff700 1 --2- 172.21.15.72:0/3391636194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb4063830 0x7f7fb40c06b0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:57.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.714+0000 7f7fba7ff700 1 -- 172.21.15.72:0/3391636194 >> 172.21.15.72:0/3391636194 conn(0x7f7fb405eb60 msgr2=0x7f7fb40cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:57.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.715+0000 7f7fba7ff700 1 -- 172.21.15.72:0/3391636194 shutdown_connections 2023-08-31T19:03:57.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.715+0000 7f7fba7ff700 1 -- 172.21.15.72:0/3391636194 wait complete. 2023-08-31T19:03:57.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.716+0000 7f7fba7ff700 1 Processor -- start 2023-08-31T19:03:57.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.716+0000 7f7fba7ff700 1 -- start start 2023-08-31T19:03:57.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.717+0000 7f7fba7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fb4063830 0x7f7fb41428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:57.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.717+0000 7f7fba7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fb4154030 0x7f7fb40afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:57.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.717+0000 7f7fba7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb4154410 0x7f7fb40affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:57.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.717+0000 7f7fba7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40b0490 con 0x7f7fb4154410 2023-08-31T19:03:57.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.717+0000 7f7fba7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40c1e90 con 0x7f7fb4154030 2023-08-31T19:03:57.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.717+0000 7f7fba7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40c2450 con 0x7f7fb4063830 2023-08-31T19:03:57.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.717+0000 7f7fb8d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb4154410 0x7f7fb40affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:57.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.717+0000 7f7fb8d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb4154410 0x7f7fb40affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34590/0 (socket says 172.21.15.72:34590) 2023-08-31T19:03:57.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.717+0000 7f7fb8d9c700 1 -- 172.21.15.72:0/3868963213 learned_addr learned my addr 172.21.15.72:0/3868963213 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:57.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.718+0000 7f7fb37fe700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fb4154030 0x7f7fb40afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:57.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.718+0000 7f7fb3fff700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fb4063830 0x7f7fb41428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:57.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.718+0000 7f7fb8d9c700 1 -- 172.21.15.72:0/3868963213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fb4063830 msgr2=0x7f7fb41428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:57.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.718+0000 7f7fb8d9c700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fb4063830 0x7f7fb41428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:57.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.718+0000 7f7fb8d9c700 1 -- 172.21.15.72:0/3868963213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fb4154030 msgr2=0x7f7fb40afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:57.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.718+0000 7f7fb8d9c700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fb4154030 0x7f7fb40afab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:57.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.718+0000 7f7fb8d9c700 1 -- 172.21.15.72:0/3868963213 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac009a20 con 0x7f7fb4154410 2023-08-31T19:03:57.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.718+0000 7f7fb3fff700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fb4063830 0x7f7fb41428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:57.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.718+0000 7f7fb37fe700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fb4154030 0x7f7fb40afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:57.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.718+0000 7f7fb8d9c700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb4154410 0x7f7fb40affa0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f7fac011000 tx=0x7f7fb40c6a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:57.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.718+0000 7f7f9bfff700 1 -- 172.21.15.72:0/3868963213 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac01d630 con 0x7f7fb4154410 2023-08-31T19:03:57.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.718+0000 7f7f9bfff700 1 -- 172.21.15.72:0/3868963213 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac01d790 con 0x7f7fb4154410 2023-08-31T19:03:57.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.718+0000 7f7fba7ff700 1 -- 172.21.15.72:0/3868963213 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb4142dc0 con 0x7f7fb4154410 2023-08-31T19:03:57.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.718+0000 7f7f9bfff700 1 -- 172.21.15.72:0/3868963213 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac01db10 con 0x7f7fb4154410 2023-08-31T19:03:57.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.718+0000 7f7fba7ff700 1 -- 172.21.15.72:0/3868963213 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb40aef20 con 0x7f7fb4154410 2023-08-31T19:03:57.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.719+0000 7f7fba7ff700 1 -- 172.21.15.72:0/3868963213 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb40c25c0 con 0x7f7fb4154410 2023-08-31T19:03:57.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.720+0000 7f7f9bfff700 1 -- 172.21.15.72:0/3868963213 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7fac027460 con 0x7f7fb4154410 2023-08-31T19:03:57.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.721+0000 7f7f9bfff700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7fa005ef00 0x7f7fa00613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:57.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.721+0000 7f7f9bfff700 1 -- 172.21.15.72:0/3868963213 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f7fac07bf50 con 0x7f7fb4154410 2023-08-31T19:03:57.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.721+0000 7f7fb3fff700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7fa005ef00 0x7f7fa00613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:57.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.722+0000 7f7fb3fff700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7fa005ef00 0x7f7fa00613c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7fa4001710 tx=0x7f7fa4009040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:57.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.725+0000 7f7f9bfff700 1 -- 172.21.15.72:0/3868963213 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7fac04d0b0 con 0x7f7fb4154410 2023-08-31T19:03:57.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.896+0000 7f7fba7ff700 1 -- 172.21.15.72:0/3868963213 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7fb40c0c50 con 0x7f7fb4154410 2023-08-31T19:03:57.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.900+0000 7f7f9bfff700 1 -- 172.21.15.72:0/3868963213 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7fac0506d0 con 0x7f7fb4154410 2023-08-31T19:03:57.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.903+0000 7f7fba7ff700 1 -- 172.21.15.72:0/3868963213 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7fa005ef00 msgr2=0x7f7fa00613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.903+0000 7f7fba7ff700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7fa005ef00 0x7f7fa00613c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7fa4001710 tx=0x7f7fa4009040).stop 2023-08-31T19:03:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.903+0000 7f7fba7ff700 1 -- 172.21.15.72:0/3868963213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb4154410 msgr2=0x7f7fb40affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.903+0000 7f7fba7ff700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb4154410 0x7f7fb40affa0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f7fac011000 tx=0x7f7fb40c6a50).stop 2023-08-31T19:03:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.903+0000 7f7fba7ff700 1 -- 172.21.15.72:0/3868963213 shutdown_connections 2023-08-31T19:03:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.903+0000 7f7fba7ff700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb4154410 0x7f7fb40affa0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:57.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.903+0000 7f7fba7ff700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7fb4063830 0x7f7fb41428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:57.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.903+0000 7f7fba7ff700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7fa005ef00 0x7f7fa00613c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:57.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.903+0000 7f7fba7ff700 1 --2- 172.21.15.72:0/3868963213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fb4154030 0x7f7fb40afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:57.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.903+0000 7f7fba7ff700 1 -- 172.21.15.72:0/3868963213 >> 172.21.15.72:0/3868963213 conn(0x7f7fb405eb60 msgr2=0x7f7fb406b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:57.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.903+0000 7f7fba7ff700 1 -- 172.21.15.72:0/3868963213 shutdown_connections 2023-08-31T19:03:57.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:57.903+0000 7f7fba7ff700 1 -- 172.21.15.72:0/3868963213 wait complete. 2023-08-31T19:03:57.921 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:03:57.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:03:58.030 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:03:58.139 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:03:58.140 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-31T19:03:58.140 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:03:58.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.331+0000 7f93ef9ff700 1 Processor -- start 2023-08-31T19:03:58.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.331+0000 7f93ef9ff700 1 -- start start 2023-08-31T19:03:58.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.333+0000 7f93ef9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93e815ce50 0x7f93e815f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:58.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.333+0000 7f93ef9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e80c6120 con 0x7f93e80cb9b0 2023-08-31T19:03:58.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.333+0000 7f93ef9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e80c5e10 con 0x7f93e8154060 2023-08-31T19:03:58.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.333+0000 7f93ef9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e80c1380 con 0x7f93e815ce50 2023-08-31T19:03:58.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.333+0000 7f93edf9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93e815ce50 0x7f93e815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:58.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.333+0000 7f93edf9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93e815ce50 0x7f93e815f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34592/0 (socket says 172.21.15.72:34592) 2023-08-31T19:03:58.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.333+0000 7f93edf9c700 1 -- 172.21.15.72:0/669887735 learned_addr learned my addr 172.21.15.72:0/669887735 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:58.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.333+0000 7f93ecf9a700 1 --1- 172.21.15.72:0/669887735 >> v1:172.21.15.72:6789/0 conn(0x7f93e80cb9b0 0x7f93e81583e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34000/0 (socket says 172.21.15.72:34000) 2023-08-31T19:03:58.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.333+0000 7f93edf9c700 1 -- 172.21.15.72:0/669887735 >> v1:172.21.15.146:6789/0 conn(0x7f93e8154060 legacy=0x7f93e8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:58.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.333+0000 7f93edf9c700 1 -- 172.21.15.72:0/669887735 >> v1:172.21.15.72:6789/0 conn(0x7f93e80cb9b0 legacy=0x7f93e81583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:58.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.333+0000 7f93edf9c700 1 -- 172.21.15.72:0/669887735 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e8158af0 con 0x7f93e815ce50 2023-08-31T19:03:58.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.333+0000 7f93dffff700 1 -- 172.21.15.72:0/669887735 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583371275 0 0) 0x7f93e80c6120 con 0x7f93e80cb9b0 2023-08-31T19:03:58.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.334+0000 7f93edf9c700 1 --2- 172.21.15.72:0/669887735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93e815ce50 0x7f93e815f240 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f93e0009f20 tx=0x7f93e0009840).ready entity=mon.0 client_cookie=90474d7cb1457b06 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:58.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.334+0000 7f93dffff700 1 -- 172.21.15.72:0/669887735 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e000e070 con 0x7f93e815ce50 2023-08-31T19:03:58.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.334+0000 7f93dffff700 1 -- 172.21.15.72:0/669887735 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e000ba80 con 0x7f93e815ce50 2023-08-31T19:03:58.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.334+0000 7f93dffff700 1 -- 172.21.15.72:0/669887735 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e000be00 con 0x7f93e815ce50 2023-08-31T19:03:58.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.334+0000 7f93ef9ff700 1 -- 172.21.15.72:0/669887735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93e815ce50 msgr2=0x7f93e815f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:58.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.334+0000 7f93ef9ff700 1 --2- 172.21.15.72:0/669887735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93e815ce50 0x7f93e815f240 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f93e0009f20 tx=0x7f93e0009840).stop 2023-08-31T19:03:58.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.334+0000 7f93ef9ff700 1 -- 172.21.15.72:0/669887735 shutdown_connections 2023-08-31T19:03:58.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.334+0000 7f93ef9ff700 1 --2- 172.21.15.72:0/669887735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93e815ce50 0x7f93e815f240 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:58.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.334+0000 7f93ef9ff700 1 -- 172.21.15.72:0/669887735 >> 172.21.15.72:0/669887735 conn(0x7f93e805e870 msgr2=0x7f93e80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:58.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.335+0000 7f93ef9ff700 1 -- 172.21.15.72:0/669887735 shutdown_connections 2023-08-31T19:03:58.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.335+0000 7f93ef9ff700 1 -- 172.21.15.72:0/669887735 wait complete. 2023-08-31T19:03:58.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.336+0000 7f93ef9ff700 1 Processor -- start 2023-08-31T19:03:58.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.336+0000 7f93ef9ff700 1 -- start start 2023-08-31T19:03:58.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.337+0000 7f93ef9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93e80cb9b0 0x7f93e814ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:58.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.337+0000 7f93ef9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93e8154060 0x7f93e80c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:58.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.337+0000 7f93ef9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93e815ce50 0x7f93e80c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:58.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.337+0000 7f93ef9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80c4cc0 con 0x7f93e8154060 2023-08-31T19:03:58.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.337+0000 7f93ef9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80c31a0 con 0x7f93e80cb9b0 2023-08-31T19:03:58.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.337+0000 7f93ef9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80c28b0 con 0x7f93e815ce50 2023-08-31T19:03:58.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.337+0000 7f93ecf9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93e8154060 0x7f93e80c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:58.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.337+0000 7f93ecf9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93e8154060 0x7f93e80c3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34608/0 (socket says 172.21.15.72:34608) 2023-08-31T19:03:58.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.337+0000 7f93ecf9a700 1 -- 172.21.15.72:0/559852270 learned_addr learned my addr 172.21.15.72:0/559852270 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:58.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.338+0000 7f93edf9c700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93e815ce50 0x7f93e80c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:58.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.338+0000 7f93ed79b700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93e80cb9b0 0x7f93e814ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:58.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.338+0000 7f93ecf9a700 1 -- 172.21.15.72:0/559852270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93e815ce50 msgr2=0x7f93e80c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:58.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.338+0000 7f93ecf9a700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93e815ce50 0x7f93e80c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:58.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.338+0000 7f93ecf9a700 1 -- 172.21.15.72:0/559852270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93e80cb9b0 msgr2=0x7f93e814ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:58.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.338+0000 7f93ecf9a700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93e80cb9b0 0x7f93e814ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:58.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.338+0000 7f93ecf9a700 1 -- 172.21.15.72:0/559852270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e0009ae0 con 0x7f93e8154060 2023-08-31T19:03:58.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.338+0000 7f93edf9c700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93e815ce50 0x7f93e80c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:58.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.338+0000 7f93ed79b700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93e80cb9b0 0x7f93e814ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:03:58.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.338+0000 7f93ecf9a700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93e8154060 0x7f93e80c3630 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f93d800c4c0 tx=0x7f93d8007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:58.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.338+0000 7f93dd7fa700 1 -- 172.21.15.72:0/559852270 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d80072e0 con 0x7f93e8154060 2023-08-31T19:03:58.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.338+0000 7f93dd7fa700 1 -- 172.21.15.72:0/559852270 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d8007440 con 0x7f93e8154060 2023-08-31T19:03:58.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.338+0000 7f93ef9ff700 1 -- 172.21.15.72:0/559852270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e80c49e0 con 0x7f93e8154060 2023-08-31T19:03:58.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.338+0000 7f93dd7fa700 1 -- 172.21.15.72:0/559852270 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8005930 con 0x7f93e8154060 2023-08-31T19:03:58.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.338+0000 7f93ef9ff700 1 -- 172.21.15.72:0/559852270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e80c2e30 con 0x7f93e8154060 2023-08-31T19:03:58.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.340+0000 7f93ef9ff700 1 -- 172.21.15.72:0/559852270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e806acb0 con 0x7f93e8154060 2023-08-31T19:03:58.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.340+0000 7f93dd7fa700 1 -- 172.21.15.72:0/559852270 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f93d8005ca0 con 0x7f93e8154060 2023-08-31T19:03:58.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.341+0000 7f93dd7fa700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f93cc05ef30 0x7f93cc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:58.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.341+0000 7f93dd7fa700 1 -- 172.21.15.72:0/559852270 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f93d80798c0 con 0x7f93e8154060 2023-08-31T19:03:58.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.341+0000 7f93ed79b700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f93cc05ef30 0x7f93cc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:58.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.342+0000 7f93ed79b700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f93cc05ef30 0x7f93cc0613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f93e4007fd0 tx=0x7f93e4009040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:58.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.345+0000 7f93dd7fa700 1 -- 172.21.15.72:0/559852270 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f93e806acb0 con 0x7f93e8154060 2023-08-31T19:03:58.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.561+0000 7f93ef9ff700 1 -- 172.21.15.72:0/559852270 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93e806acb0 con 0x7f93e8154060 2023-08-31T19:03:58.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.562+0000 7f93dd7fa700 1 -- 172.21.15.72:0/559852270 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f93e806acb0 con 0x7f93e8154060 2023-08-31T19:03:58.562 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:03:58.563 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5890,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1362322123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1362322123},{"type":"v1","addr":"172.21.15.146:6834","nonce":1362322123}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5893,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2001208412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2001208412},{"type":"v1","addr":"172.21.15.146:6835","nonce":2001208412}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3154756193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3154756193},{"type":"v1","addr":"172.21.15.72:6835","nonce":3154756193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6618,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3137994259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3137994259},{"type":"v1","addr":"172.21.15.72:6837","nonce":3137994259}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2023-08-31T19:03:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.564+0000 7f93ef9ff700 1 -- 172.21.15.72:0/559852270 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f93cc05ef30 msgr2=0x7f93cc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.564+0000 7f93ef9ff700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f93cc05ef30 0x7f93cc0613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f93e4007fd0 tx=0x7f93e4009040).stop 2023-08-31T19:03:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.564+0000 7f93ef9ff700 1 -- 172.21.15.72:0/559852270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93e8154060 msgr2=0x7f93e80c3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.564+0000 7f93ef9ff700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93e8154060 0x7f93e80c3630 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f93d800c4c0 tx=0x7f93d8007c10).stop 2023-08-31T19:03:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.564+0000 7f93ef9ff700 1 -- 172.21.15.72:0/559852270 shutdown_connections 2023-08-31T19:03:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.564+0000 7f93ef9ff700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93e815ce50 0x7f93e80c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.564+0000 7f93ef9ff700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f93cc05ef30 0x7f93cc0613f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.564+0000 7f93ef9ff700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93e80cb9b0 0x7f93e814ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.564+0000 7f93ef9ff700 1 --2- 172.21.15.72:0/559852270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93e8154060 0x7f93e80c3630 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.564+0000 7f93ef9ff700 1 -- 172.21.15.72:0/559852270 >> 172.21.15.72:0/559852270 conn(0x7f93e805e870 msgr2=0x7f93e80bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:58.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.564+0000 7f93ef9ff700 1 -- 172.21.15.72:0/559852270 shutdown_connections 2023-08-31T19:03:58.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.564+0000 7f93ef9ff700 1 -- 172.21.15.72:0/559852270 wait complete. 2023-08-31T19:03:58.567 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 34 2023-08-31T19:03:58.582 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T19:03:58.582 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-31T19:03:58.582 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T19:03:58.582 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:03:58.583 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T19:03:58.583 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-31T19:03:58.583 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T19:03:58.584 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:03:58.584 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T19:03:58.585 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-31T19:03:58.585 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T19:03:58.585 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:03:58.585 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T19:03:58.586 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-31T19:03:58.586 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T19:03:58.586 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:03:58.596 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T19:03:58.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T19:03:58.598 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T19:03:58.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T19:03:58.600 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T19:03:58.601 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T19:03:58.603 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T19:03:58.603 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T19:03:58.641 INFO:tasks.ceph.mds.a:Started 2023-08-31T19:03:58.642 DEBUG:teuthology.parallel:result is None 2023-08-31T19:03:58.644 INFO:tasks.ceph.mds.c:Started 2023-08-31T19:03:58.644 DEBUG:teuthology.parallel:result is None 2023-08-31T19:03:58.647 INFO:tasks.ceph.mds.b:Started 2023-08-31T19:03:58.648 DEBUG:teuthology.parallel:result is None 2023-08-31T19:03:58.651 INFO:tasks.ceph.mds.d:Started 2023-08-31T19:03:58.651 DEBUG:teuthology.parallel:result is None 2023-08-31T19:03:58.651 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-31T19:03:58.786 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T19:03:58.787 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-31T19:03:58.795 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-08-31T19:03:58.795 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-08-31T19:03:58.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.863+0000 7f4a4c1ff700 1 Processor -- start 2023-08-31T19:03:58.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.863+0000 7f4a4c1ff700 1 -- start start 2023-08-31T19:03:58.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.864+0000 7f4a4c1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a44153ca0 0x7f4a44154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.864+0000 7f4a4c1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a440c9450 con 0x7f4a440ca4f0 2023-08-31T19:03:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.864+0000 7f4a4c1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a440c9730 con 0x7f4a440c8ee0 2023-08-31T19:03:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.864+0000 7f4a4c1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440c9a10 con 0x7f4a44153ca0 2023-08-31T19:03:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.864+0000 7f4a4a79c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4a440ca4f0 0x7f4a44063100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34012/0 (socket says 172.21.15.72:34012) 2023-08-31T19:03:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.864+0000 7f4a4a79c700 1 -- 172.21.15.72:0/1024022236 learned_addr learned my addr 172.21.15.72:0/1024022236 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:03:58.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.864+0000 7f4a49f9b700 1 --2- 172.21.15.72:0/1024022236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a44153ca0 0x7f4a44154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.865+0000 7f4a48f99700 1 -- 172.21.15.72:0/1024022236 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105213850 0 0) 0x7f4a440c9450 con 0x7f4a440ca4f0 2023-08-31T19:03:58.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.865+0000 7f4a48f99700 1 -- 172.21.15.72:0/1024022236 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a300033f0 con 0x7f4a440ca4f0 2023-08-31T19:03:58.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.865+0000 7f4a48f99700 1 -- 172.21.15.72:0/1024022236 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615991079 0 0) 0x7f4a440c9730 con 0x7f4a440c8ee0 2023-08-31T19:03:58.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.865+0000 7f4a48f99700 1 -- 172.21.15.72:0/1024022236 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a440c9450 con 0x7f4a440c8ee0 2023-08-31T19:03:58.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.865+0000 7f4a49f9b700 1 -- 172.21.15.72:0/1024022236 >> v1:172.21.15.146:6789/0 conn(0x7f4a440c8ee0 legacy=0x7f4a44158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:58.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.865+0000 7f4a49f9b700 1 -- 172.21.15.72:0/1024022236 >> v1:172.21.15.72:6789/0 conn(0x7f4a440ca4f0 legacy=0x7f4a44063100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:58.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.865+0000 7f4a49f9b700 1 -- 172.21.15.72:0/1024022236 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a440c9cf0 con 0x7f4a44153ca0 2023-08-31T19:03:58.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.865+0000 7f4a49f9b700 1 --2- 172.21.15.72:0/1024022236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a44153ca0 0x7f4a44154080 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f4a40009790 tx=0x7f4a40009060).ready entity=mon.2 client_cookie=83b29423f36f910a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:58.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.865+0000 7f4a48f99700 1 -- 172.21.15.72:0/1024022236 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4000f510 con 0x7f4a44153ca0 2023-08-31T19:03:58.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.865+0000 7f4a48f99700 1 -- 172.21.15.72:0/1024022236 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4000f670 con 0x7f4a44153ca0 2023-08-31T19:03:58.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.865+0000 7f4a48f99700 1 -- 172.21.15.72:0/1024022236 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4000f9f0 con 0x7f4a44153ca0 2023-08-31T19:03:58.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.866+0000 7f4a4c1ff700 1 -- 172.21.15.72:0/1024022236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a44153ca0 msgr2=0x7f4a44154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:58.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.866+0000 7f4a4c1ff700 1 --2- 172.21.15.72:0/1024022236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a44153ca0 0x7f4a44154080 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f4a40009790 tx=0x7f4a40009060).stop 2023-08-31T19:03:58.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.866+0000 7f4a4c1ff700 1 -- 172.21.15.72:0/1024022236 shutdown_connections 2023-08-31T19:03:58.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.866+0000 7f4a4c1ff700 1 --2- 172.21.15.72:0/1024022236 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a44153ca0 0x7f4a44154080 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.866+0000 7f4a4c1ff700 1 -- 172.21.15.72:0/1024022236 >> 172.21.15.72:0/1024022236 conn(0x7f4a440cadb0 msgr2=0x7f4a440cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.866+0000 7f4a4c1ff700 1 -- 172.21.15.72:0/1024022236 shutdown_connections 2023-08-31T19:03:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.866+0000 7f4a4c1ff700 1 -- 172.21.15.72:0/1024022236 wait complete. 2023-08-31T19:03:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.868+0000 7f4a4c1ff700 1 Processor -- start 2023-08-31T19:03:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.868+0000 7f4a4c1ff700 1 -- start start 2023-08-31T19:03:58.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4c1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a440c8ee0 0x7f4a440c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:58.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4c1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a440ca4f0 0x7f4a441564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:58.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4c1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a44153ca0 0x7f4a4414d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:58.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4c1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44157850 con 0x7f4a440ca4f0 2023-08-31T19:03:58.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4c1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440c47b0 con 0x7f4a44153ca0 2023-08-31T19:03:58.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4c1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44156990 con 0x7f4a440c8ee0 2023-08-31T19:03:58.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4979a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a440ca4f0 0x7f4a441564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:58.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4979a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a440ca4f0 0x7f4a441564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34658/0 (socket says 172.21.15.72:34658) 2023-08-31T19:03:58.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4979a700 1 -- 172.21.15.72:0/501606054 learned_addr learned my addr 172.21.15.72:0/501606054 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:03:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a49f9b700 1 --2- 172.21.15.72:0/501606054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a440c8ee0 0x7f4a440c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4a79c700 1 --2- 172.21.15.72:0/501606054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a44153ca0 0x7f4a4414d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4979a700 1 -- 172.21.15.72:0/501606054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a440c8ee0 msgr2=0x7f4a440c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4979a700 1 --2- 172.21.15.72:0/501606054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a440c8ee0 0x7f4a440c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4979a700 1 -- 172.21.15.72:0/501606054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a44153ca0 msgr2=0x7f4a4414d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:58.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4979a700 1 --2- 172.21.15.72:0/501606054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a44153ca0 0x7f4a4414d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:58.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4979a700 1 -- 172.21.15.72:0/501606054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a400092a0 con 0x7f4a440ca4f0 2023-08-31T19:03:58.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.869+0000 7f4a4a79c700 1 --2- 172.21.15.72:0/501606054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a44153ca0 0x7f4a4414d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:03:58.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.870+0000 7f4a4979a700 1 --2- 172.21.15.72:0/501606054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a440ca4f0 0x7f4a441564a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f4a3400c4c0 tx=0x7f4a34007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:58.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.870+0000 7f4a39ffb700 1 -- 172.21.15.72:0/501606054 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3400f470 con 0x7f4a440ca4f0 2023-08-31T19:03:58.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.870+0000 7f4a39ffb700 1 -- 172.21.15.72:0/501606054 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3400f5d0 con 0x7f4a440ca4f0 2023-08-31T19:03:58.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.870+0000 7f4a4c1ff700 1 -- 172.21.15.72:0/501606054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a44156c40 con 0x7f4a440ca4f0 2023-08-31T19:03:58.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.870+0000 7f4a39ffb700 1 -- 172.21.15.72:0/501606054 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3400f990 con 0x7f4a440ca4f0 2023-08-31T19:03:58.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.870+0000 7f4a4c1ff700 1 -- 172.21.15.72:0/501606054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a44157200 con 0x7f4a440ca4f0 2023-08-31T19:03:58.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.871+0000 7f4a4c1ff700 1 -- 172.21.15.72:0/501606054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a441579c0 con 0x7f4a440ca4f0 2023-08-31T19:03:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.872+0000 7f4a39ffb700 1 -- 172.21.15.72:0/501606054 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4a3401b3b0 con 0x7f4a440ca4f0 2023-08-31T19:03:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.872+0000 7f4a39ffb700 1 --2- 172.21.15.72:0/501606054 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4a2805ef30 0x7f4a280613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:03:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.873+0000 7f4a39ffb700 1 -- 172.21.15.72:0/501606054 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f4a34079520 con 0x7f4a440ca4f0 2023-08-31T19:03:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.873+0000 7f4a49f9b700 1 --2- 172.21.15.72:0/501606054 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4a2805ef30 0x7f4a280613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:03:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.873+0000 7f4a49f9b700 1 --2- 172.21.15.72:0/501606054 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4a2805ef30 0x7f4a280613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4a40009fd0 tx=0x7f4a40017000).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:03:58.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:58.877+0000 7f4a39ffb700 1 -- 172.21.15.72:0/501606054 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4a340488f0 con 0x7f4a440ca4f0 2023-08-31T19:03:59.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:59.061+0000 7f4a4c1ff700 1 -- 172.21.15.72:0/501606054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4a4406c6b0 con 0x7f4a440ca4f0 2023-08-31T19:03:59.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:59.904+0000 7f4a39ffb700 1 -- 172.21.15.72:0/501606054 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v90) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4a3404a6f0 con 0x7f4a440ca4f0 2023-08-31T19:03:59.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:59.906+0000 7f4a4c1ff700 1 -- 172.21.15.72:0/501606054 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4a2805ef30 msgr2=0x7f4a280613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:59.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:59.906+0000 7f4a4c1ff700 1 --2- 172.21.15.72:0/501606054 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4a2805ef30 0x7f4a280613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4a40009fd0 tx=0x7f4a40017000).stop 2023-08-31T19:03:59.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:59.906+0000 7f4a4c1ff700 1 -- 172.21.15.72:0/501606054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a440ca4f0 msgr2=0x7f4a441564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:03:59.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:59.906+0000 7f4a4c1ff700 1 --2- 172.21.15.72:0/501606054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a440ca4f0 0x7f4a441564a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f4a3400c4c0 tx=0x7f4a34007c10).stop 2023-08-31T19:03:59.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:59.907+0000 7f4a4c1ff700 1 -- 172.21.15.72:0/501606054 shutdown_connections 2023-08-31T19:03:59.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:59.907+0000 7f4a4c1ff700 1 --2- 172.21.15.72:0/501606054 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4a2805ef30 0x7f4a280613f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:59.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:59.907+0000 7f4a4c1ff700 1 --2- 172.21.15.72:0/501606054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a44153ca0 0x7f4a4414d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:59.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:59.907+0000 7f4a4c1ff700 1 --2- 172.21.15.72:0/501606054 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a440c8ee0 0x7f4a440c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:59.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:59.907+0000 7f4a4c1ff700 1 --2- 172.21.15.72:0/501606054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a440ca4f0 0x7f4a441564a0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:03:59.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:59.907+0000 7f4a4c1ff700 1 -- 172.21.15.72:0/501606054 >> 172.21.15.72:0/501606054 conn(0x7f4a440cadb0 msgr2=0x7f4a440bfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:03:59.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:59.907+0000 7f4a4c1ff700 1 -- 172.21.15.72:0/501606054 shutdown_connections 2023-08-31T19:03:59.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:03:59.907+0000 7f4a4c1ff700 1 -- 172.21.15.72:0/501606054 wait complete. 2023-08-31T19:03:59.910 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-08-31T19:03:59.926 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-31T19:04:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.115+0000 7f000a1ff700 1 Processor -- start 2023-08-31T19:04:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.115+0000 7f000a1ff700 1 -- start start 2023-08-31T19:04:00.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.116+0000 7f000a1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f00040c5fb0 0x7f00040be370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:00.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.116+0000 7f000a1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00040be860 0x7f00040c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:00.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.116+0000 7f000a1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f00040c44a0 0x7f0004157d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:00.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.116+0000 7f000a1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0004154690 con 0x7f00040c44a0 2023-08-31T19:04:00.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.116+0000 7f000a1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00040bfb20 con 0x7f00040c5fb0 2023-08-31T19:04:00.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.116+0000 7f000a1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040bece0 con 0x7f00040be860 2023-08-31T19:04:00.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.117+0000 7f0003fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f00040c44a0 0x7f0004157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:00.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.117+0000 7f0003fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f00040c44a0 0x7f0004157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34662/0 (socket says 172.21.15.72:34662) 2023-08-31T19:04:00.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.117+0000 7f0003fff700 1 -- 172.21.15.72:0/4243192433 learned_addr learned my addr 172.21.15.72:0/4243192433 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:00.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.117+0000 7f00037fe700 1 --2- 172.21.15.72:0/4243192433 >> v2:172.21.15.146:3300/0 conn(0x7f00040c5fb0 0x7f00040be370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:00.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.117+0000 7f0002ffd700 1 --2- 172.21.15.72:0/4243192433 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00040be860 0x7f00040c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:00.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.117+0000 7f0003fff700 1 -- 172.21.15.72:0/4243192433 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00040be860 msgr2=0x7f00040c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:00.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.117+0000 7f0003fff700 1 --2- 172.21.15.72:0/4243192433 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00040be860 0x7f00040c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.117+0000 7f0003fff700 1 -- 172.21.15.72:0/4243192433 >> v2:172.21.15.146:3300/0 conn(0x7f00040c5fb0 msgr2=0x7f00040be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:00.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.117+0000 7f0003fff700 1 --2- 172.21.15.72:0/4243192433 >> v2:172.21.15.146:3300/0 conn(0x7f00040c5fb0 0x7f00040be370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.117+0000 7f0003fff700 1 -- 172.21.15.72:0/4243192433 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040c4930 con 0x7f00040c44a0 2023-08-31T19:04:00.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.117+0000 7f00037fe700 1 --2- 172.21.15.72:0/4243192433 >> v2:172.21.15.146:3300/0 conn(0x7f00040c5fb0 0x7f00040be370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:00.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.117+0000 7f0003fff700 1 --2- 172.21.15.72:0/4243192433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00040c44a0 0x7f0004157d50 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f00040c37a0 tx=0x7efffc009840).ready entity=mon.0 client_cookie=442110fe9d42718c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:00.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.118+0000 7f00027fc700 1 -- 172.21.15.72:0/4243192433 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc00e070 con 0x7f00040c44a0 2023-08-31T19:04:00.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.118+0000 7f00027fc700 1 -- 172.21.15.72:0/4243192433 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc00ba50 con 0x7f00040c44a0 2023-08-31T19:04:00.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.118+0000 7f00027fc700 1 -- 172.21.15.72:0/4243192433 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc00bdd0 con 0x7f00040c44a0 2023-08-31T19:04:00.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.118+0000 7f000a1ff700 1 -- 172.21.15.72:0/4243192433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00040c44a0 msgr2=0x7f0004157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:00.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.118+0000 7f000a1ff700 1 --2- 172.21.15.72:0/4243192433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00040c44a0 0x7f0004157d50 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f00040c37a0 tx=0x7efffc009840).stop 2023-08-31T19:04:00.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.118+0000 7f000a1ff700 1 -- 172.21.15.72:0/4243192433 shutdown_connections 2023-08-31T19:04:00.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.118+0000 7f000a1ff700 1 --2- 172.21.15.72:0/4243192433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00040c44a0 0x7f0004157d50 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.118+0000 7f000a1ff700 1 --2- 172.21.15.72:0/4243192433 >> v2:172.21.15.146:3300/0 conn(0x7f00040c5fb0 0x7f00040be370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.118+0000 7f000a1ff700 1 --2- 172.21.15.72:0/4243192433 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00040be860 0x7f00040c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.118+0000 7f000a1ff700 1 -- 172.21.15.72:0/4243192433 >> 172.21.15.72:0/4243192433 conn(0x7f0004082f60 msgr2=0x7f000405e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:00.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.118+0000 7f000a1ff700 1 -- 172.21.15.72:0/4243192433 shutdown_connections 2023-08-31T19:04:00.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.118+0000 7f000a1ff700 1 -- 172.21.15.72:0/4243192433 wait complete. 2023-08-31T19:04:00.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.120+0000 7f000a1ff700 1 Processor -- start 2023-08-31T19:04:00.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.120+0000 7f000a1ff700 1 -- start start 2023-08-31T19:04:00.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f000a1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00040be860 0x7f00040c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:00.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f000a1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00040c44a0 0x7f0004152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:00.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f000a1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00040c5fb0 0x7f00040c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:00.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f000a1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040c14d0 con 0x7f00040c5fb0 2023-08-31T19:04:00.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f000a1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040c17b0 con 0x7f00040c44a0 2023-08-31T19:04:00.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f000a1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040c1a90 con 0x7f00040be860 2023-08-31T19:04:00.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f0003fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00040c5fb0 0x7f00040c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:00.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f0003fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00040c5fb0 0x7f00040c2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34678/0 (socket says 172.21.15.72:34678) 2023-08-31T19:04:00.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f0003fff700 1 -- 172.21.15.72:0/3114003022 learned_addr learned my addr 172.21.15.72:0/3114003022 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:00.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f0002ffd700 1 --2- 172.21.15.72:0/3114003022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00040c44a0 0x7f0004152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:00.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f00037fe700 1 --2- 172.21.15.72:0/3114003022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00040be860 0x7f00040c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:00.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f0003fff700 1 -- 172.21.15.72:0/3114003022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00040be860 msgr2=0x7f00040c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:00.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f0003fff700 1 --2- 172.21.15.72:0/3114003022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00040be860 0x7f00040c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f0003fff700 1 -- 172.21.15.72:0/3114003022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00040c44a0 msgr2=0x7f0004152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:00.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f0003fff700 1 --2- 172.21.15.72:0/3114003022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00040c44a0 0x7f0004152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.121+0000 7f0003fff700 1 -- 172.21.15.72:0/3114003022 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc009ae0 con 0x7f00040c5fb0 2023-08-31T19:04:00.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.122+0000 7f0003fff700 1 --2- 172.21.15.72:0/3114003022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00040c5fb0 0x7f00040c2570 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f0004069db0 tx=0x7f00040bfa90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:00.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.122+0000 7effeb7fe700 1 -- 172.21.15.72:0/3114003022 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc0032f0 con 0x7f00040c5fb0 2023-08-31T19:04:00.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.122+0000 7effeb7fe700 1 -- 172.21.15.72:0/3114003022 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc0092e0 con 0x7f00040c5fb0 2023-08-31T19:04:00.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.122+0000 7effeb7fe700 1 -- 172.21.15.72:0/3114003022 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc01e6a0 con 0x7f00040c5fb0 2023-08-31T19:04:00.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.122+0000 7f000a1ff700 1 -- 172.21.15.72:0/3114003022 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00040c1d70 con 0x7f00040c5fb0 2023-08-31T19:04:00.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.122+0000 7f000a1ff700 1 -- 172.21.15.72:0/3114003022 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0004153090 con 0x7f00040c5fb0 2023-08-31T19:04:00.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.123+0000 7f000a1ff700 1 -- 172.21.15.72:0/3114003022 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00040c2290 con 0x7f00040c5fb0 2023-08-31T19:04:00.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.124+0000 7effeb7fe700 1 -- 172.21.15.72:0/3114003022 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7efffc003040 con 0x7f00040c5fb0 2023-08-31T19:04:00.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.125+0000 7effeb7fe700 1 --2- 172.21.15.72:0/3114003022 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efff005ef30 0x7efff00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:00.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.125+0000 7effeb7fe700 1 -- 172.21.15.72:0/3114003022 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5869+0+0 (secure 0 0 0) 0x7efffc07b430 con 0x7f00040c5fb0 2023-08-31T19:04:00.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.125+0000 7f00037fe700 1 --2- 172.21.15.72:0/3114003022 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efff005ef30 0x7efff00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:00.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.125+0000 7f00037fe700 1 --2- 172.21.15.72:0/3114003022 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efff005ef30 0x7efff00613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7efff4006fd0 tx=0x7efff4008040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:00.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.129+0000 7effeb7fe700 1 -- 172.21.15.72:0/3114003022 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f00040c2290 con 0x7f00040c5fb0 2023-08-31T19:04:00.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.365+0000 7f000a1ff700 1 -- 172.21.15.72:0/3114003022 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f00040c2290 con 0x7f00040c5fb0 2023-08-31T19:04:00.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.365+0000 7effeb7fe700 1 -- 172.21.15.72:0/3114003022 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f00040c2290 con 0x7f00040c5fb0 2023-08-31T19:04:00.366 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:00.366 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:04:00.366 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-08-31T19:04:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-08-31T19:04:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkPeqvDBAAA2eEr6xr7iF5PPNT9eehSg==", 2023-08-31T19:04:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.367 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:04:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:04:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-08-31T19:04:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkctxUIxAAufSVXMwPzPA7Gq1s4ukXiQ==", 2023-08-31T19:04:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.369 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:04:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:04:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-08-31T19:04:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkcpLfFxAASIB//h8whjuh6s3YKBVffQ==", 2023-08-31T19:04:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.371 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:04:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:04:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-08-31T19:04:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkC1bbLhAAg/0wct2P0+cyWbZyI2bP/g==", 2023-08-31T19:04:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.373 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:04:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:04:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-08-31T19:04:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAi4PBkvfRJEBAAYQqPldOXrJxXAXnmZhXaBQ==", 2023-08-31T19:04:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:00.376 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-08-31T19:04:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAl4PBkYysSIhAA4nCmskcGV+i4vpH2k/gDBg==", 2023-08-31T19:04:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:00.378 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.379 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-08-31T19:04:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAp4PBkyDgJFxAAPynEKk15yN7+OxQxpzL0UQ==", 2023-08-31T19:04:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:00.380 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-08-31T19:04:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAs4PBkZMD2KBAAoJrO4YjJ4/8MjcPAtgEn1g==", 2023-08-31T19:04:00.381 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-08-31T19:04:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAz4PBkSgAoExAAJ95kdHV47jDTXSj/WSCiLw==", 2023-08-31T19:04:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.383 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.384 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-08-31T19:04:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA24PBkUxpLKBAAAu8d6iKME6wW+Q/6hhFIRQ==", 2023-08-31T19:04:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:00.385 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-08-31T19:04:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA54PBkURHJOhAA3HaPfENVQ4hLIjc/esF0bQ==", 2023-08-31T19:04:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:00.387 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-08-31T19:04:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA94PBkfoqTEBAAQHENgrp5tv1X47Br/dUksQ==", 2023-08-31T19:04:00.388 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-08-31T19:04:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkucWuOBAABLowlGxpCR3GgoOCRmC0FQ==", 2023-08-31T19:04:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:00.390 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow r", 2023-08-31T19:04:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-31T19:04:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.391 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-08-31T19:04:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkVGBPCxAAO4M9u24/yH0xwtV6oSz+JQ==", 2023-08-31T19:04:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:04:00.392 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:04:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:04:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.2", 2023-08-31T19:04:00.393 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkYeIoBBAAjoIzJJ9McIx3rLBSaorTKA==", 2023-08-31T19:04:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:04:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:04:00.394 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:04:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.3", 2023-08-31T19:04:00.395 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkX/V9EhAAqWuBMMhikN/JUQp3v5/ABQ==", 2023-08-31T19:04:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:04:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:04:00.396 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:04:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-08-31T19:04:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkCRlhDhAAxvcGr+KTvLoJmtuZC89Iuw==", 2023-08-31T19:04:00.397 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:04:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:04:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:04:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-08-31T19:04:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkiGBUBRAAwWTFqrz+ELBSwb0Z2T9yhQ==", 2023-08-31T19:04:00.399 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:04:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:04:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-08-31T19:04:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkSWszNRAAdBxrfMEuBRgePfaiPx6kpQ==", 2023-08-31T19:04:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:04:00.401 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:04:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:00.402 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-08-31T19:04:00.403 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:04:00.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.367+0000 7f000a1ff700 1 -- 172.21.15.72:0/3114003022 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efff005ef30 msgr2=0x7efff00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:00.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.367+0000 7f000a1ff700 1 --2- 172.21.15.72:0/3114003022 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efff005ef30 0x7efff00613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7efff4006fd0 tx=0x7efff4008040).stop 2023-08-31T19:04:00.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.367+0000 7f000a1ff700 1 -- 172.21.15.72:0/3114003022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00040c5fb0 msgr2=0x7f00040c2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:00.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.367+0000 7f000a1ff700 1 --2- 172.21.15.72:0/3114003022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00040c5fb0 0x7f00040c2570 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f0004069db0 tx=0x7f00040bfa90).stop 2023-08-31T19:04:00.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.367+0000 7f000a1ff700 1 -- 172.21.15.72:0/3114003022 shutdown_connections 2023-08-31T19:04:00.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.367+0000 7f000a1ff700 1 --2- 172.21.15.72:0/3114003022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00040c5fb0 0x7f00040c2570 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.368+0000 7f000a1ff700 1 --2- 172.21.15.72:0/3114003022 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f00040be860 0x7f00040c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.368+0000 7f000a1ff700 1 --2- 172.21.15.72:0/3114003022 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efff005ef30 0x7efff00613f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.368+0000 7f000a1ff700 1 --2- 172.21.15.72:0/3114003022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00040c44a0 0x7f0004152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.368+0000 7f000a1ff700 1 -- 172.21.15.72:0/3114003022 >> 172.21.15.72:0/3114003022 conn(0x7f0004082f60 msgr2=0x7f00040637f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:00.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.368+0000 7f000a1ff700 1 -- 172.21.15.72:0/3114003022 shutdown_connections 2023-08-31T19:04:00.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.368+0000 7f000a1ff700 1 -- 172.21.15.72:0/3114003022 wait complete. 2023-08-31T19:04:00.407 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:04:00.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.598+0000 7f4f4df9d700 1 Processor -- start 2023-08-31T19:04:00.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.598+0000 7f4f4df9d700 1 -- start start 2023-08-31T19:04:00.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.599+0000 7f4f4df9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4f4814b000 0x7f4f48154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:00.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.599+0000 7f4f4df9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f480bfd50 0x7f4f481582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:00.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.599+0000 7f4f4df9d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f480aa520 con 0x7f4f480c5bc0 2023-08-31T19:04:00.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.599+0000 7f4f4df9d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f48157e30 con 0x7f4f480bfd50 2023-08-31T19:04:00.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.599+0000 7f4f4df9d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4814b3e0 con 0x7f4f4814b000 2023-08-31T19:04:00.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.600+0000 7f4f47fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f480bfd50 0x7f4f481582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:00.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.600+0000 7f4f47fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f480bfd50 0x7f4f481582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34692/0 (socket says 172.21.15.72:34692) 2023-08-31T19:04:00.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.600+0000 7f4f47fff700 1 -- 172.21.15.72:0/1422906289 learned_addr learned my addr 172.21.15.72:0/1422906289 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:00.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.600+0000 7f4f4cf9b700 1 --2- 172.21.15.72:0/1422906289 >> v2:172.21.15.146:3300/0 conn(0x7f4f4814b000 0x7f4f48154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:00.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.600+0000 7f4f47fff700 1 -- 172.21.15.72:0/1422906289 >> v2:172.21.15.146:3300/0 conn(0x7f4f4814b000 msgr2=0x7f4f48154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:00.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.600+0000 7f4f47fff700 1 --2- 172.21.15.72:0/1422906289 >> v2:172.21.15.146:3300/0 conn(0x7f4f4814b000 0x7f4f48154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.600+0000 7f4f47fff700 1 -- 172.21.15.72:0/1422906289 >> v1:172.21.15.146:6789/0 conn(0x7f4f480c5bc0 legacy=0x7f4f480c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:00.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.600+0000 7f4f47fff700 1 -- 172.21.15.72:0/1422906289 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f48157b30 con 0x7f4f480bfd50 2023-08-31T19:04:00.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.600+0000 7f4f4cf9b700 1 --2- 172.21.15.72:0/1422906289 >> v2:172.21.15.146:3300/0 conn(0x7f4f4814b000 0x7f4f48154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:00.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.600+0000 7f4f47fff700 1 --2- 172.21.15.72:0/1422906289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f480bfd50 0x7f4f481582c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f4f4806a890 tx=0x7f4f340090f0).ready entity=mon.0 client_cookie=1784613e8a077157 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:00.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.601+0000 7f4f477fe700 1 -- 172.21.15.72:0/1422906289 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400b600 con 0x7f4f480bfd50 2023-08-31T19:04:00.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.601+0000 7f4f477fe700 1 -- 172.21.15.72:0/1422906289 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3400b760 con 0x7f4f480bfd50 2023-08-31T19:04:00.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.601+0000 7f4f477fe700 1 -- 172.21.15.72:0/1422906289 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400bae0 con 0x7f4f480bfd50 2023-08-31T19:04:00.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.601+0000 7f4f4df9d700 1 -- 172.21.15.72:0/1422906289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f480bfd50 msgr2=0x7f4f481582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:00.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.601+0000 7f4f4df9d700 1 --2- 172.21.15.72:0/1422906289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f480bfd50 0x7f4f481582c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f4f4806a890 tx=0x7f4f340090f0).stop 2023-08-31T19:04:00.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.601+0000 7f4f4df9d700 1 -- 172.21.15.72:0/1422906289 shutdown_connections 2023-08-31T19:04:00.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.601+0000 7f4f4df9d700 1 --2- 172.21.15.72:0/1422906289 >> v2:172.21.15.146:3300/0 conn(0x7f4f4814b000 0x7f4f48154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.601+0000 7f4f4df9d700 1 --2- 172.21.15.72:0/1422906289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f480bfd50 0x7f4f481582c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.601+0000 7f4f4df9d700 1 -- 172.21.15.72:0/1422906289 >> 172.21.15.72:0/1422906289 conn(0x7f4f480cabf0 msgr2=0x7f4f480cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:00.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.601+0000 7f4f4df9d700 1 -- 172.21.15.72:0/1422906289 shutdown_connections 2023-08-31T19:04:00.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.601+0000 7f4f4df9d700 1 -- 172.21.15.72:0/1422906289 wait complete. 2023-08-31T19:04:00.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.603+0000 7f4f4df9d700 1 Processor -- start 2023-08-31T19:04:00.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.603+0000 7f4f4df9d700 1 -- start start 2023-08-31T19:04:00.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.604+0000 7f4f4df9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f480bfd50 0x7f4f4813d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:00.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.604+0000 7f4f4df9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f480c5bc0 0x7f4f4814b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:00.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.604+0000 7f4f4df9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f4814b000 0x7f4f481678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:00.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.604+0000 7f4f4df9d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f480c9410 con 0x7f4f480c5bc0 2023-08-31T19:04:00.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.604+0000 7f4f4df9d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4813daa0 con 0x7f4f4814b000 2023-08-31T19:04:00.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.604+0000 7f4f4df9d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f480c9660 con 0x7f4f480bfd50 2023-08-31T19:04:00.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.604+0000 7f4f47fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f480c5bc0 0x7f4f4814b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:00.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.604+0000 7f4f47fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f480c5bc0 0x7f4f4814b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34700/0 (socket says 172.21.15.72:34700) 2023-08-31T19:04:00.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.604+0000 7f4f47fff700 1 -- 172.21.15.72:0/1425814914 learned_addr learned my addr 172.21.15.72:0/1425814914 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:00.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.604+0000 7f4f47fff700 1 -- 172.21.15.72:0/1425814914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f480bfd50 msgr2=0x7f4f4813d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:00.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.604+0000 7f4f47fff700 1 --2- 172.21.15.72:0/1425814914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f480bfd50 0x7f4f4813d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:00.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.604+0000 7f4f47fff700 1 -- 172.21.15.72:0/1425814914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f4814b000 msgr2=0x7f4f481678a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:00.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.604+0000 7f4f47fff700 1 --2- 172.21.15.72:0/1425814914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f4814b000 0x7f4f481678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:00.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.604+0000 7f4f47fff700 1 -- 172.21.15.72:0/1425814914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f34009370 con 0x7f4f480c5bc0 2023-08-31T19:04:00.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.605+0000 7f4f47fff700 1 --2- 172.21.15.72:0/1425814914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f480c5bc0 0x7f4f4814b5b0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f4f34009fd0 tx=0x7f4f34017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:00.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.605+0000 7f4f44ff9700 1 -- 172.21.15.72:0/1425814914 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400b8d0 con 0x7f4f480c5bc0 2023-08-31T19:04:00.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.605+0000 7f4f44ff9700 1 -- 172.21.15.72:0/1425814914 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3400ba30 con 0x7f4f480c5bc0 2023-08-31T19:04:00.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.605+0000 7f4f44ff9700 1 -- 172.21.15.72:0/1425814914 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3401b690 con 0x7f4f480c5bc0 2023-08-31T19:04:00.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.605+0000 7f4f4df9d700 1 -- 172.21.15.72:0/1425814914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f480c9940 con 0x7f4f480c5bc0 2023-08-31T19:04:00.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.605+0000 7f4f4df9d700 1 -- 172.21.15.72:0/1425814914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f480c9f00 con 0x7f4f480c5bc0 2023-08-31T19:04:00.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.606+0000 7f4f4df9d700 1 -- 172.21.15.72:0/1425814914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f480ca420 con 0x7f4f480c5bc0 2023-08-31T19:04:00.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.607+0000 7f4f44ff9700 1 -- 172.21.15.72:0/1425814914 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4f3401ba40 con 0x7f4f480c5bc0 2023-08-31T19:04:00.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.608+0000 7f4f44ff9700 1 --2- 172.21.15.72:0/1425814914 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f2c05ef30 0x7f4f2c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:00.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.608+0000 7f4f44ff9700 1 -- 172.21.15.72:0/1425814914 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f4f3407b680 con 0x7f4f480c5bc0 2023-08-31T19:04:00.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.608+0000 7f4f4cf9b700 1 --2- 172.21.15.72:0/1425814914 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f2c05ef30 0x7f4f2c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:00.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.608+0000 7f4f4cf9b700 1 --2- 172.21.15.72:0/1425814914 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f2c05ef30 0x7f4f2c0613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f4f3c006d80 tx=0x7f4f3c008040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:00.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.612+0000 7f4f44ff9700 1 -- 172.21.15.72:0/1425814914 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4f3404ca30 con 0x7f4f480c5bc0 2023-08-31T19:04:00.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.781+0000 7f4f4df9d700 1 -- 172.21.15.72:0/1425814914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f480c97a0 con 0x7f4f480c5bc0 2023-08-31T19:04:00.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.782+0000 7f4f44ff9700 1 -- 172.21.15.72:0/1425814914 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+14716 (secure 0 0 0) 0x7f4f480c97a0 con 0x7f4f480c5bc0 2023-08-31T19:04:00.783 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:00.783 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":90,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:03:59.901253+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:04:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.784+0000 7f4f4df9d700 1 -- 172.21.15.72:0/1425814914 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f2c05ef30 msgr2=0x7f4f2c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.784+0000 7f4f4df9d700 1 --2- 172.21.15.72:0/1425814914 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f2c05ef30 0x7f4f2c0613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f4f3c006d80 tx=0x7f4f3c008040).stop 2023-08-31T19:04:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.784+0000 7f4f4df9d700 1 -- 172.21.15.72:0/1425814914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f480c5bc0 msgr2=0x7f4f4814b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.784+0000 7f4f4df9d700 1 --2- 172.21.15.72:0/1425814914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f480c5bc0 0x7f4f4814b5b0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f4f34009fd0 tx=0x7f4f34017000).stop 2023-08-31T19:04:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.784+0000 7f4f4df9d700 1 -- 172.21.15.72:0/1425814914 shutdown_connections 2023-08-31T19:04:00.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.784+0000 7f4f4df9d700 1 --2- 172.21.15.72:0/1425814914 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f2c05ef30 0x7f4f2c0613f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.784+0000 7f4f4df9d700 1 --2- 172.21.15.72:0/1425814914 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f4814b000 0x7f4f481678a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:00.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.784+0000 7f4f4df9d700 1 --2- 172.21.15.72:0/1425814914 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4f480bfd50 0x7f4f4813d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:00.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.784+0000 7f4f4df9d700 1 --2- 172.21.15.72:0/1425814914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f480c5bc0 0x7f4f4814b5b0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:00.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.784+0000 7f4f4df9d700 1 -- 172.21.15.72:0/1425814914 >> 172.21.15.72:0/1425814914 conn(0x7f4f480cabf0 msgr2=0x7f4f48062db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:00.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.784+0000 7f4f4df9d700 1 -- 172.21.15.72:0/1425814914 shutdown_connections 2023-08-31T19:04:00.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.784+0000 7f4f4df9d700 1 -- 172.21.15.72:0/1425814914 wait complete. 2023-08-31T19:04:00.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-31T19:04:00.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:04:00.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.995+0000 7f2b755ff700 1 Processor -- start 2023-08-31T19:04:00.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.995+0000 7f2b755ff700 1 -- start start 2023-08-31T19:04:00.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.996+0000 7f2b755ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b7014ecd0 0x7f2b701556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:00.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.996+0000 7f2b755ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b700c2320 0x7f2b700c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:00.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.996+0000 7f2b755ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b70152720 con 0x7f2b700c1100 2023-08-31T19:04:00.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.996+0000 7f2b755ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b700c2c90 con 0x7f2b7014ecd0 2023-08-31T19:04:00.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.996+0000 7f2b755ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7006a6b0 con 0x7f2b700c2320 2023-08-31T19:04:00.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.997+0000 7f2b6f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2b700c1100 0x7f2b700c1590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34016/0 (socket says 172.21.15.72:34016) 2023-08-31T19:04:00.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.997+0000 7f2b6f7fe700 1 -- 172.21.15.72:0/3786462371 learned_addr learned my addr 172.21.15.72:0/3786462371 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:00.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.997+0000 7f2b6effd700 1 --2- 172.21.15.72:0/3786462371 >> v2:172.21.15.146:3300/0 conn(0x7f2b7014ecd0 0x7f2b701556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:00.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.997+0000 7f2b6e7fc700 1 --2- 172.21.15.72:0/3786462371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b700c2320 0x7f2b700c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:00.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.997+0000 7f2b6dffb700 1 -- 172.21.15.72:0/3786462371 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932542502 0 0) 0x7f2b70152720 con 0x7f2b700c1100 2023-08-31T19:04:00.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.997+0000 7f2b6dffb700 1 -- 172.21.15.72:0/3786462371 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b580033f0 con 0x7f2b700c1100 2023-08-31T19:04:01.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.997+0000 7f2b6e7fc700 1 -- 172.21.15.72:0/3786462371 >> v2:172.21.15.146:3300/0 conn(0x7f2b7014ecd0 msgr2=0x7f2b701556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:01.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.997+0000 7f2b6e7fc700 1 --2- 172.21.15.72:0/3786462371 >> v2:172.21.15.146:3300/0 conn(0x7f2b7014ecd0 0x7f2b701556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.997+0000 7f2b6e7fc700 1 -- 172.21.15.72:0/3786462371 >> v1:172.21.15.72:6789/0 conn(0x7f2b700c1100 legacy=0x7f2b700c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.997+0000 7f2b6e7fc700 1 -- 172.21.15.72:0/3786462371 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b70155bc0 con 0x7f2b700c2320 2023-08-31T19:04:01.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.997+0000 7f2b6effd700 1 --2- 172.21.15.72:0/3786462371 >> v2:172.21.15.146:3300/0 conn(0x7f2b7014ecd0 0x7f2b701556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:04:01.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.997+0000 7f2b6e7fc700 1 --2- 172.21.15.72:0/3786462371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b700c2320 0x7f2b700c27a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f2b64009760 tx=0x7f2b64009060).ready entity=mon.2 client_cookie=aef73eca989c86b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:01.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.998+0000 7f2b6dffb700 1 -- 172.21.15.72:0/3786462371 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400d4a0 con 0x7f2b700c2320 2023-08-31T19:04:01.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.998+0000 7f2b6dffb700 1 -- 172.21.15.72:0/3786462371 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6400d600 con 0x7f2b700c2320 2023-08-31T19:04:01.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.998+0000 7f2b6dffb700 1 -- 172.21.15.72:0/3786462371 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400d980 con 0x7f2b700c2320 2023-08-31T19:04:01.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.998+0000 7f2b755ff700 1 -- 172.21.15.72:0/3786462371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b700c2320 msgr2=0x7f2b700c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.998+0000 7f2b755ff700 1 --2- 172.21.15.72:0/3786462371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b700c2320 0x7f2b700c27a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f2b64009760 tx=0x7f2b64009060).stop 2023-08-31T19:04:01.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.998+0000 7f2b755ff700 1 -- 172.21.15.72:0/3786462371 shutdown_connections 2023-08-31T19:04:01.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.998+0000 7f2b755ff700 1 --2- 172.21.15.72:0/3786462371 >> v2:172.21.15.146:3300/0 conn(0x7f2b7014ecd0 0x7f2b701556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.998+0000 7f2b755ff700 1 --2- 172.21.15.72:0/3786462371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b700c2320 0x7f2b700c27a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.998+0000 7f2b755ff700 1 -- 172.21.15.72:0/3786462371 >> 172.21.15.72:0/3786462371 conn(0x7f2b700630c0 msgr2=0x7f2b700c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:01.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.998+0000 7f2b755ff700 1 -- 172.21.15.72:0/3786462371 shutdown_connections 2023-08-31T19:04:01.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:00.998+0000 7f2b755ff700 1 -- 172.21.15.72:0/3786462371 wait complete. 2023-08-31T19:04:01.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.000+0000 7f2b755ff700 1 Processor -- start 2023-08-31T19:04:01.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.000+0000 7f2b755ff700 1 -- start start 2023-08-31T19:04:01.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.001+0000 7f2b755ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b700c1100 0x7f2b7014dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.001+0000 7f2b755ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b700c2320 0x7f2b700bf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.001+0000 7f2b755ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b7014ecd0 0x7f2b700bfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.001+0000 7f2b755ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700c0290 con 0x7f2b700c2320 2023-08-31T19:04:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.001+0000 7f2b755ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7014f420 con 0x7f2b700c1100 2023-08-31T19:04:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.001+0000 7f2b755ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700bea90 con 0x7f2b7014ecd0 2023-08-31T19:04:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.001+0000 7f2b6e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b700c2320 0x7f2b700bf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.001+0000 7f2b6e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b700c2320 0x7f2b700bf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34706/0 (socket says 172.21.15.72:34706) 2023-08-31T19:04:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.001+0000 7f2b6e7fc700 1 -- 172.21.15.72:0/1710262752 learned_addr learned my addr 172.21.15.72:0/1710262752 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.001+0000 7f2b6effd700 1 --2- 172.21.15.72:0/1710262752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b700c1100 0x7f2b7014dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.001+0000 7f2b6f7fe700 1 --2- 172.21.15.72:0/1710262752 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b7014ecd0 0x7f2b700bfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.002+0000 7f2b6e7fc700 1 -- 172.21.15.72:0/1710262752 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b7014ecd0 msgr2=0x7f2b700bfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.002+0000 7f2b6e7fc700 1 --2- 172.21.15.72:0/1710262752 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b7014ecd0 0x7f2b700bfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.002+0000 7f2b6e7fc700 1 -- 172.21.15.72:0/1710262752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b700c1100 msgr2=0x7f2b7014dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.002+0000 7f2b6e7fc700 1 --2- 172.21.15.72:0/1710262752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b700c1100 0x7f2b7014dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.002+0000 7f2b6e7fc700 1 -- 172.21.15.72:0/1710262752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b600092a0 con 0x7f2b700c2320 2023-08-31T19:04:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.002+0000 7f2b6e7fc700 1 --2- 172.21.15.72:0/1710262752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b700c2320 0x7f2b700bf8b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f2b64009d50 tx=0x7f2b64016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.002+0000 7f2b56ffd700 1 -- 172.21.15.72:0/1710262752 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400dd30 con 0x7f2b700c2320 2023-08-31T19:04:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.002+0000 7f2b56ffd700 1 -- 172.21.15.72:0/1710262752 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6400de90 con 0x7f2b700c2320 2023-08-31T19:04:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.002+0000 7f2b755ff700 1 -- 172.21.15.72:0/1710262752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b640092a0 con 0x7f2b700c2320 2023-08-31T19:04:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.002+0000 7f2b56ffd700 1 -- 172.21.15.72:0/1710262752 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400d9a0 con 0x7f2b700c2320 2023-08-31T19:04:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.002+0000 7f2b755ff700 1 -- 172.21.15.72:0/1710262752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b700bf050 con 0x7f2b700c2320 2023-08-31T19:04:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.003+0000 7f2b755ff700 1 -- 172.21.15.72:0/1710262752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7006c6b0 con 0x7f2b700c2320 2023-08-31T19:04:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.004+0000 7f2b56ffd700 1 -- 172.21.15.72:0/1710262752 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2b6401d640 con 0x7f2b700c2320 2023-08-31T19:04:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.005+0000 7f2b56ffd700 1 --2- 172.21.15.72:0/1710262752 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b5c05ef30 0x7f2b5c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.005+0000 7f2b56ffd700 1 -- 172.21.15.72:0/1710262752 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f2b6407b7e0 con 0x7f2b700c2320 2023-08-31T19:04:01.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.005+0000 7f2b6effd700 1 --2- 172.21.15.72:0/1710262752 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b5c05ef30 0x7f2b5c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.006+0000 7f2b6effd700 1 --2- 172.21.15.72:0/1710262752 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b5c05ef30 0x7f2b5c0613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2b60009d20 tx=0x7f2b60009060).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:01.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.009+0000 7f2b56ffd700 1 -- 172.21.15.72:0/1710262752 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2b6404cb10 con 0x7f2b700c2320 2023-08-31T19:04:01.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.176+0000 7f2b755ff700 1 -- 172.21.15.72:0/1710262752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2b70151b10 con 0x7f2b700c2320 2023-08-31T19:04:01.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.176+0000 7f2b56ffd700 1 -- 172.21.15.72:0/1710262752 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v90) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2b64050130 con 0x7f2b700c2320 2023-08-31T19:04:01.177 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:04:01.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.178+0000 7f2b755ff700 1 -- 172.21.15.72:0/1710262752 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b5c05ef30 msgr2=0x7f2b5c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.178+0000 7f2b755ff700 1 --2- 172.21.15.72:0/1710262752 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b5c05ef30 0x7f2b5c0613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2b60009d20 tx=0x7f2b60009060).stop 2023-08-31T19:04:01.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.178+0000 7f2b755ff700 1 -- 172.21.15.72:0/1710262752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b700c2320 msgr2=0x7f2b700bf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.178+0000 7f2b755ff700 1 --2- 172.21.15.72:0/1710262752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b700c2320 0x7f2b700bf8b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f2b64009d50 tx=0x7f2b64016000).stop 2023-08-31T19:04:01.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.178+0000 7f2b755ff700 1 -- 172.21.15.72:0/1710262752 shutdown_connections 2023-08-31T19:04:01.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.178+0000 7f2b755ff700 1 --2- 172.21.15.72:0/1710262752 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b7014ecd0 0x7f2b700bfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.178+0000 7f2b755ff700 1 --2- 172.21.15.72:0/1710262752 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b5c05ef30 0x7f2b5c0613f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.178+0000 7f2b755ff700 1 --2- 172.21.15.72:0/1710262752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b700c1100 0x7f2b7014dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.178+0000 7f2b755ff700 1 --2- 172.21.15.72:0/1710262752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b700c2320 0x7f2b700bf8b0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.178+0000 7f2b755ff700 1 -- 172.21.15.72:0/1710262752 >> 172.21.15.72:0/1710262752 conn(0x7f2b700630c0 msgr2=0x7f2b700c1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:01.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.178+0000 7f2b755ff700 1 -- 172.21.15.72:0/1710262752 shutdown_connections 2023-08-31T19:04:01.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.178+0000 7f2b755ff700 1 -- 172.21.15.72:0/1710262752 wait complete. 2023-08-31T19:04:01.196 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:04:01.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.390+0000 7f86803ff700 1 Processor -- start 2023-08-31T19:04:01.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.390+0000 7f86803ff700 1 -- start start 2023-08-31T19:04:01.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.391+0000 7f86803ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86780bdb30 0x7f86781542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.391+0000 7f86803ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86780663d0 0x7f8678066860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.391+0000 7f86803ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86780a84b0 con 0x7f8678153ed0 2023-08-31T19:04:01.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.391+0000 7f86803ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86780c9410 con 0x7f86780663d0 2023-08-31T19:04:01.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.391+0000 7f86803ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86780c5310 con 0x7f86780bdb30 2023-08-31T19:04:01.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.392+0000 7f867e99c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86780663d0 0x7f8678066860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.392+0000 7f867e19b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8678153ed0 0x7f8678155200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34026/0 (socket says 172.21.15.72:34026) 2023-08-31T19:04:01.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.392+0000 7f867e99c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86780663d0 0x7f8678066860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34722/0 (socket says 172.21.15.72:34722) 2023-08-31T19:04:01.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.392+0000 7f867e19b700 1 -- 172.21.15.72:0/492172447 learned_addr learned my addr 172.21.15.72:0/492172447 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:01.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.392+0000 7f867d99a700 1 --2- 172.21.15.72:0/492172447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86780bdb30 0x7f86781542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.392+0000 7f867e99c700 1 -- 172.21.15.72:0/492172447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86780bdb30 msgr2=0x7f86781542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:01.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.392+0000 7f867e99c700 1 --2- 172.21.15.72:0/492172447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86780bdb30 0x7f86781542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.392+0000 7f867e99c700 1 -- 172.21.15.72:0/492172447 >> v1:172.21.15.72:6789/0 conn(0x7f8678153ed0 legacy=0x7f8678155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.392+0000 7f867e99c700 1 -- 172.21.15.72:0/492172447 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8678066d50 con 0x7f86780663d0 2023-08-31T19:04:01.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.392+0000 7f867d99a700 1 --2- 172.21.15.72:0/492172447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86780bdb30 0x7f86781542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:01.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.392+0000 7f867d199700 1 -- 172.21.15.72:0/492172447 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630060981 0 0) 0x7f86780a84b0 con 0x7f8678153ed0 2023-08-31T19:04:01.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.392+0000 7f867e99c700 1 --2- 172.21.15.72:0/492172447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86780663d0 0x7f8678066860 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f8670009e60 tx=0x7f8670009780).ready entity=mon.0 client_cookie=60d8492fabfa21d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:01.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.392+0000 7f867d199700 1 -- 172.21.15.72:0/492172447 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867000e070 con 0x7f86780663d0 2023-08-31T19:04:01.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.392+0000 7f867d199700 1 -- 172.21.15.72:0/492172447 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867000bc30 con 0x7f86780663d0 2023-08-31T19:04:01.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.392+0000 7f867d199700 1 -- 172.21.15.72:0/492172447 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670012410 con 0x7f86780663d0 2023-08-31T19:04:01.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.393+0000 7f86803ff700 1 -- 172.21.15.72:0/492172447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86780663d0 msgr2=0x7f8678066860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.393+0000 7f86803ff700 1 --2- 172.21.15.72:0/492172447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86780663d0 0x7f8678066860 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f8670009e60 tx=0x7f8670009780).stop 2023-08-31T19:04:01.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.393+0000 7f86803ff700 1 -- 172.21.15.72:0/492172447 shutdown_connections 2023-08-31T19:04:01.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.393+0000 7f86803ff700 1 --2- 172.21.15.72:0/492172447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86780663d0 0x7f8678066860 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.393+0000 7f86803ff700 1 --2- 172.21.15.72:0/492172447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86780bdb30 0x7f86781542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.393+0000 7f86803ff700 1 -- 172.21.15.72:0/492172447 >> 172.21.15.72:0/492172447 conn(0x7f867805eb60 msgr2=0x7f86780c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:01.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.393+0000 7f86803ff700 1 -- 172.21.15.72:0/492172447 shutdown_connections 2023-08-31T19:04:01.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.393+0000 7f86803ff700 1 -- 172.21.15.72:0/492172447 wait complete. 2023-08-31T19:04:01.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.395+0000 7f86803ff700 1 Processor -- start 2023-08-31T19:04:01.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.395+0000 7f86803ff700 1 -- start start 2023-08-31T19:04:01.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.396+0000 7f86803ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86780663d0 0x7f8678152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.396+0000 7f86803ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8678153ed0 0x7f8678156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.396+0000 7f86803ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8678154830 0x7f86780adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.396+0000 7f86803ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86780a5bb0 con 0x7f86780663d0 2023-08-31T19:04:01.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.396+0000 7f86803ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86780a58b0 con 0x7f8678153ed0 2023-08-31T19:04:01.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.396+0000 7f86803ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8678156560 con 0x7f8678154830 2023-08-31T19:04:01.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.396+0000 7f867e19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86780663d0 0x7f8678152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.396+0000 7f867e19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86780663d0 0x7f8678152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34728/0 (socket says 172.21.15.72:34728) 2023-08-31T19:04:01.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.396+0000 7f867e19b700 1 -- 172.21.15.72:0/4036715801 learned_addr learned my addr 172.21.15.72:0/4036715801 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:01.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.396+0000 7f867e19b700 1 -- 172.21.15.72:0/4036715801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8678154830 msgr2=0x7f86780adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.396+0000 7f867e19b700 1 --2- 172.21.15.72:0/4036715801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8678154830 0x7f86780adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:01.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.396+0000 7f867e19b700 1 -- 172.21.15.72:0/4036715801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8678153ed0 msgr2=0x7f8678156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.396+0000 7f867e19b700 1 --2- 172.21.15.72:0/4036715801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8678153ed0 0x7f8678156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:01.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.396+0000 7f867e19b700 1 -- 172.21.15.72:0/4036715801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8670009a20 con 0x7f86780663d0 2023-08-31T19:04:01.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.396+0000 7f867e19b700 1 --2- 172.21.15.72:0/4036715801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86780663d0 0x7f8678152e60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f867400c460 tx=0x7f8674007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:01.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.397+0000 7f866e7fc700 1 -- 172.21.15.72:0/4036715801 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740072e0 con 0x7f86780663d0 2023-08-31T19:04:01.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.397+0000 7f866e7fc700 1 -- 172.21.15.72:0/4036715801 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674007440 con 0x7f86780663d0 2023-08-31T19:04:01.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.397+0000 7f86803ff700 1 -- 172.21.15.72:0/4036715801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8678155130 con 0x7f86780663d0 2023-08-31T19:04:01.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.397+0000 7f866e7fc700 1 -- 172.21.15.72:0/4036715801 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740057a0 con 0x7f86780663d0 2023-08-31T19:04:01.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.397+0000 7f86803ff700 1 -- 172.21.15.72:0/4036715801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86781556f0 con 0x7f86780663d0 2023-08-31T19:04:01.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.398+0000 7f86803ff700 1 -- 172.21.15.72:0/4036715801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867806c6b0 con 0x7f86780663d0 2023-08-31T19:04:01.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.398+0000 7f866e7fc700 1 -- 172.21.15.72:0/4036715801 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8674005b90 con 0x7f86780663d0 2023-08-31T19:04:01.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.399+0000 7f866e7fc700 1 --2- 172.21.15.72:0/4036715801 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f865c05ef30 0x7f865c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.399+0000 7f866e7fc700 1 -- 172.21.15.72:0/4036715801 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f86740796a0 con 0x7f86780663d0 2023-08-31T19:04:01.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.400+0000 7f867d99a700 1 --2- 172.21.15.72:0/4036715801 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f865c05ef30 0x7f865c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.400+0000 7f867d99a700 1 --2- 172.21.15.72:0/4036715801 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f865c05ef30 0x7f865c0613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8668006d80 tx=0x7f8668008040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:01.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.403+0000 7f866e7fc700 1 -- 172.21.15.72:0/4036715801 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f867404aa90 con 0x7f86780663d0 2023-08-31T19:04:01.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.573+0000 7f86803ff700 1 -- 172.21.15.72:0/4036715801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f86780a7ef0 con 0x7f86780663d0 2023-08-31T19:04:01.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.573+0000 7f866e7fc700 1 -- 172.21.15.72:0/4036715801 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v90) v1 ==== 92+0+10 (secure 0 0 0) 0x7f867404e0b0 con 0x7f86780663d0 2023-08-31T19:04:01.574 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:04:01.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.575+0000 7f86803ff700 1 -- 172.21.15.72:0/4036715801 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f865c05ef30 msgr2=0x7f865c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.575+0000 7f86803ff700 1 --2- 172.21.15.72:0/4036715801 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f865c05ef30 0x7f865c0613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8668006d80 tx=0x7f8668008040).stop 2023-08-31T19:04:01.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.575+0000 7f86803ff700 1 -- 172.21.15.72:0/4036715801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86780663d0 msgr2=0x7f8678152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.575+0000 7f86803ff700 1 --2- 172.21.15.72:0/4036715801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86780663d0 0x7f8678152e60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f867400c460 tx=0x7f8674007e90).stop 2023-08-31T19:04:01.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.575+0000 7f86803ff700 1 -- 172.21.15.72:0/4036715801 shutdown_connections 2023-08-31T19:04:01.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.575+0000 7f86803ff700 1 --2- 172.21.15.72:0/4036715801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8678154830 0x7f86780adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:01.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.575+0000 7f86803ff700 1 --2- 172.21.15.72:0/4036715801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86780663d0 0x7f8678152e60 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.575+0000 7f86803ff700 1 --2- 172.21.15.72:0/4036715801 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f865c05ef30 0x7f865c0613f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.575+0000 7f86803ff700 1 --2- 172.21.15.72:0/4036715801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8678153ed0 0x7f8678156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:01.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.575+0000 7f86803ff700 1 -- 172.21.15.72:0/4036715801 >> 172.21.15.72:0/4036715801 conn(0x7f867805eb60 msgr2=0x7f86780c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:01.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.575+0000 7f86803ff700 1 -- 172.21.15.72:0/4036715801 shutdown_connections 2023-08-31T19:04:01.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.575+0000 7f86803ff700 1 -- 172.21.15.72:0/4036715801 wait complete. 2023-08-31T19:04:01.594 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T19:04:01.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.782+0000 7f7b01bff700 1 Processor -- start 2023-08-31T19:04:01.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.782+0000 7f7b01bff700 1 -- start start 2023-08-31T19:04:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.784+0000 7f7b01bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7afc1583f0 0x7f7afc15ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.784+0000 7f7b01bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7afc063be0 con 0x7f7afc0c6c30 2023-08-31T19:04:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.784+0000 7f7b01bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7afc063010 con 0x7f7afc0c4740 2023-08-31T19:04:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.784+0000 7f7b01bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc0bca10 con 0x7f7afc1583f0 2023-08-31T19:04:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.784+0000 7f7afb7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7afc0c6c30 0x7f7afc0bc300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34028/0 (socket says 172.21.15.72:34028) 2023-08-31T19:04:01.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.784+0000 7f7afb7fe700 1 -- 172.21.15.72:0/1124355559 learned_addr learned my addr 172.21.15.72:0/1124355559 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:01.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.784+0000 7f7afbfff700 1 --2- 172.21.15.72:0/1124355559 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7afc1583f0 0x7f7afc15ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.784+0000 7f7afa7fc700 1 -- 172.21.15.72:0/1124355559 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307199620 0 0) 0x7f7afc063be0 con 0x7f7afc0c6c30 2023-08-31T19:04:01.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.784+0000 7f7afa7fc700 1 -- 172.21.15.72:0/1124355559 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ae40033f0 con 0x7f7afc0c6c30 2023-08-31T19:04:01.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afa7fc700 1 -- 172.21.15.72:0/1124355559 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1000527095 0 0) 0x7f7ae40033f0 con 0x7f7afc0c6c30 2023-08-31T19:04:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afa7fc700 1 -- 172.21.15.72:0/1124355559 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7afc1583f0 msgr2=0x7f7afc15ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afa7fc700 1 --2- 172.21.15.72:0/1124355559 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7afc1583f0 0x7f7afc15ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afa7fc700 1 -- 172.21.15.72:0/1124355559 >> v1:172.21.15.146:6789/0 conn(0x7f7afc0c4740 legacy=0x7f7afc157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afa7fc700 1 -- 172.21.15.72:0/1124355559 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7afc0632b0 con 0x7f7afc0c6c30 2023-08-31T19:04:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afa7fc700 1 -- 172.21.15.72:0/1124355559 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f7aec001470 con 0x7f7afc0c6c30 2023-08-31T19:04:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afa7fc700 1 -- 172.21.15.72:0/1124355559 >> v1:172.21.15.72:6789/0 conn(0x7f7afc0c6c30 legacy=0x7f7afc0bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afa7fc700 1 --2- 172.21.15.72:0/1124355559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ae4003910 0x7f7ae4003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afa7fc700 1 --2- 172.21.15.72:0/1124355559 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7afc1583f0 0x7f7ae4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afa7fc700 1 --2- 172.21.15.72:0/1124355559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae4004b80 0x7f7ae4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afa7fc700 1 -- 172.21.15.72:0/1124355559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae400b8e0 con 0x7f7ae4003910 2023-08-31T19:04:01.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afa7fc700 1 -- 172.21.15.72:0/1124355559 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae400ba20 con 0x7f7ae4004b80 2023-08-31T19:04:01.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afa7fc700 1 -- 172.21.15.72:0/1124355559 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae400bb90 con 0x7f7afc1583f0 2023-08-31T19:04:01.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afb7fe700 1 --2- 172.21.15.72:0/1124355559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ae4003910 0x7f7ae4003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afbfff700 1 --2- 172.21.15.72:0/1124355559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae4004b80 0x7f7ae4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afaffd700 1 --2- 172.21.15.72:0/1124355559 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7afc1583f0 0x7f7ae4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afb7fe700 1 -- 172.21.15.72:0/1124355559 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7afc1583f0 msgr2=0x7f7ae4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:01.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afb7fe700 1 --2- 172.21.15.72:0/1124355559 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7afc1583f0 0x7f7ae4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afb7fe700 1 -- 172.21.15.72:0/1124355559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae4004b80 msgr2=0x7f7ae4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:01.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afb7fe700 1 --2- 172.21.15.72:0/1124355559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae4004b80 0x7f7ae4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.785+0000 7f7afb7fe700 1 -- 172.21.15.72:0/1124355559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae40033f0 con 0x7f7ae4003910 2023-08-31T19:04:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.786+0000 7f7afb7fe700 1 --2- 172.21.15.72:0/1124355559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ae4003910 0x7f7ae4003cf0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f7aec00c1e0 tx=0x7f7afc155720).ready entity=mon.0 client_cookie=a85de1503571cb04 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.786+0000 7f7afa7fc700 1 -- 172.21.15.72:0/1124355559 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec007a60 con 0x7f7ae4003910 2023-08-31T19:04:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.786+0000 7f7afa7fc700 1 -- 172.21.15.72:0/1124355559 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aec00ca50 con 0x7f7ae4003910 2023-08-31T19:04:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.786+0000 7f7afa7fc700 1 -- 172.21.15.72:0/1124355559 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec00ce10 con 0x7f7ae4003910 2023-08-31T19:04:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.786+0000 7f7b01bff700 1 -- 172.21.15.72:0/1124355559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ae4003910 msgr2=0x7f7ae4003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.786+0000 7f7b01bff700 1 --2- 172.21.15.72:0/1124355559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ae4003910 0x7f7ae4003cf0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f7aec00c1e0 tx=0x7f7afc155720).stop 2023-08-31T19:04:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.786+0000 7f7afbfff700 1 -- 172.21.15.72:0/1124355559 reap_dead start 2023-08-31T19:04:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.786+0000 7f7b01bff700 1 -- 172.21.15.72:0/1124355559 shutdown_connections 2023-08-31T19:04:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.786+0000 7f7b01bff700 1 -- 172.21.15.72:0/1124355559 >> 172.21.15.72:0/1124355559 conn(0x7f7afc0c7e70 msgr2=0x7f7afc0c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.787+0000 7f7b01bff700 1 -- 172.21.15.72:0/1124355559 shutdown_connections 2023-08-31T19:04:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.787+0000 7f7b01bff700 1 -- 172.21.15.72:0/1124355559 wait complete. 2023-08-31T19:04:01.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.788+0000 7f7b01bff700 1 Processor -- start 2023-08-31T19:04:01.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.788+0000 7f7b01bff700 1 -- start start 2023-08-31T19:04:01.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.789+0000 7f7b01bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae4003910 0x7f7afc1687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.789+0000 7f7b01bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7afc0a8410 0x7f7afc165090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.789+0000 7f7b01bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc1524a0 0x7f7afc0ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.789+0000 7f7b01bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc165580 con 0x7f7afc1524a0 2023-08-31T19:04:01.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.789+0000 7f7b01bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc0aa610 con 0x7f7afc0a8410 2023-08-31T19:04:01.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.789+0000 7f7b01bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc0a88a0 con 0x7f7ae4003910 2023-08-31T19:04:01.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.789+0000 7f7afbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc1524a0 0x7f7afc0ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.789+0000 7f7afbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc1524a0 0x7f7afc0ab040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34740/0 (socket says 172.21.15.72:34740) 2023-08-31T19:04:01.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.789+0000 7f7afbfff700 1 -- 172.21.15.72:0/1282267866 learned_addr learned my addr 172.21.15.72:0/1282267866 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:01.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.789+0000 7f7afaffd700 1 --2- 172.21.15.72:0/1282267866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7afc0a8410 0x7f7afc165090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.789+0000 7f7afb7fe700 1 --2- 172.21.15.72:0/1282267866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae4003910 0x7f7afc1687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.790+0000 7f7afbfff700 1 -- 172.21.15.72:0/1282267866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae4003910 msgr2=0x7f7afc1687f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.790+0000 7f7afbfff700 1 --2- 172.21.15.72:0/1282267866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae4003910 0x7f7afc1687f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.790+0000 7f7afbfff700 1 -- 172.21.15.72:0/1282267866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7afc0a8410 msgr2=0x7f7afc165090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.790+0000 7f7afbfff700 1 --2- 172.21.15.72:0/1282267866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7afc0a8410 0x7f7afc165090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.790+0000 7f7afbfff700 1 -- 172.21.15.72:0/1282267866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7afc167d10 con 0x7f7afc1524a0 2023-08-31T19:04:01.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.790+0000 7f7afbfff700 1 --2- 172.21.15.72:0/1282267866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc1524a0 0x7f7afc0ab040 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f7af40094d0 tx=0x7f7af400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:01.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.790+0000 7f7ae37fe700 1 -- 172.21.15.72:0/1282267866 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af400e040 con 0x7f7afc1524a0 2023-08-31T19:04:01.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.790+0000 7f7ae37fe700 1 -- 172.21.15.72:0/1282267866 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af400f040 con 0x7f7afc1524a0 2023-08-31T19:04:01.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.790+0000 7f7b01bff700 1 -- 172.21.15.72:0/1282267866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7afc167ff0 con 0x7f7afc1524a0 2023-08-31T19:04:01.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.790+0000 7f7ae37fe700 1 -- 172.21.15.72:0/1282267866 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af400fd70 con 0x7f7afc1524a0 2023-08-31T19:04:01.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.790+0000 7f7b01bff700 1 -- 172.21.15.72:0/1282267866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7afc152920 con 0x7f7afc1524a0 2023-08-31T19:04:01.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.791+0000 7f7b01bff700 1 -- 172.21.15.72:0/1282267866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7afc06c6b0 con 0x7f7afc1524a0 2023-08-31T19:04:01.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.792+0000 7f7ae37fe700 1 -- 172.21.15.72:0/1282267866 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7af4015660 con 0x7f7afc1524a0 2023-08-31T19:04:01.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.793+0000 7f7ae37fe700 1 --2- 172.21.15.72:0/1282267866 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ae805ef30 0x7f7ae80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:01.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.793+0000 7f7ae37fe700 1 -- 172.21.15.72:0/1282267866 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f7af407a910 con 0x7f7afc1524a0 2023-08-31T19:04:01.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.793+0000 7f7afb7fe700 1 --2- 172.21.15.72:0/1282267866 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ae805ef30 0x7f7ae80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:01.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.794+0000 7f7afb7fe700 1 --2- 172.21.15.72:0/1282267866 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ae805ef30 0x7f7ae80613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7aec00ca20 tx=0x7f7aec015000).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:01.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.797+0000 7f7ae37fe700 1 -- 172.21.15.72:0/1282267866 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7af404bc40 con 0x7f7afc1524a0 2023-08-31T19:04:01.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.969+0000 7f7b01bff700 1 -- 172.21.15.72:0/1282267866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7afc0bdfa0 con 0x7f7afc1524a0 2023-08-31T19:04:01.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.969+0000 7f7ae37fe700 1 -- 172.21.15.72:0/1282267866 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v90) v1 ==== 84+0+143 (secure 0 0 0) 0x7f7af404f260 con 0x7f7afc1524a0 2023-08-31T19:04:01.970 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:01.970 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:04:01.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:01.971 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-08-31T19:04:01.971 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "device_health_metrics" 2023-08-31T19:04:01.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:01.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:01.971 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-08-31T19:04:01.972 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-08-31T19:04:01.972 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:01.972 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:04:01.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.971+0000 7f7b01bff700 1 -- 172.21.15.72:0/1282267866 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ae805ef30 msgr2=0x7f7ae80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.971+0000 7f7b01bff700 1 --2- 172.21.15.72:0/1282267866 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ae805ef30 0x7f7ae80613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7aec00ca20 tx=0x7f7aec015000).stop 2023-08-31T19:04:01.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.971+0000 7f7b01bff700 1 -- 172.21.15.72:0/1282267866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc1524a0 msgr2=0x7f7afc0ab040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:01.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.971+0000 7f7b01bff700 1 --2- 172.21.15.72:0/1282267866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc1524a0 0x7f7afc0ab040 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f7af40094d0 tx=0x7f7af400b040).stop 2023-08-31T19:04:01.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.971+0000 7f7b01bff700 1 -- 172.21.15.72:0/1282267866 shutdown_connections 2023-08-31T19:04:01.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.971+0000 7f7b01bff700 1 --2- 172.21.15.72:0/1282267866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc1524a0 0x7f7afc0ab040 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.971+0000 7f7b01bff700 1 --2- 172.21.15.72:0/1282267866 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ae4003910 0x7f7afc1687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.971+0000 7f7b01bff700 1 --2- 172.21.15.72:0/1282267866 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7ae805ef30 0x7f7ae80613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.971+0000 7f7b01bff700 1 --2- 172.21.15.72:0/1282267866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7afc0a8410 0x7f7afc165090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:01.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.971+0000 7f7b01bff700 1 -- 172.21.15.72:0/1282267866 >> 172.21.15.72:0/1282267866 conn(0x7f7afc0c7e70 msgr2=0x7f7afc066200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:01.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.972+0000 7f7b01bff700 1 -- 172.21.15.72:0/1282267866 shutdown_connections 2023-08-31T19:04:01.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:01.972+0000 7f7b01bff700 1 -- 172.21.15.72:0/1282267866 wait complete. 2023-08-31T19:04:01.989 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T19:04:01.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-31T19:04:02.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.181+0000 7fd3a59ff700 1 Processor -- start 2023-08-31T19:04:02.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.182+0000 7fd3a59ff700 1 -- start start 2023-08-31T19:04:02.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.183+0000 7fd3a59ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd3a01373e0 0x7fd3a00c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:02.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.183+0000 7fd3a59ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a00c13e0 con 0x7fd3a01377c0 2023-08-31T19:04:02.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.183+0000 7fd3a59ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a00c19a0 con 0x7fd3a00bb9a0 2023-08-31T19:04:02.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.183+0000 7fd3a59ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a006a1d0 con 0x7fd3a01373e0 2023-08-31T19:04:02.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.183+0000 7fd39e7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd3a01377c0 0x7fd3a0069460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34042/0 (socket says 172.21.15.72:34042) 2023-08-31T19:04:02.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.183+0000 7fd39e7fc700 1 -- 172.21.15.72:0/2912240606 learned_addr learned my addr 172.21.15.72:0/2912240606 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:02.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.183+0000 7fd39effd700 1 --2- 172.21.15.72:0/2912240606 >> v2:172.21.15.146:3300/0 conn(0x7fd3a01373e0 0x7fd3a00c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:02.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.184+0000 7fd39dffb700 1 -- 172.21.15.72:0/2912240606 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055383647 0 0) 0x7fd3a00c13e0 con 0x7fd3a01377c0 2023-08-31T19:04:02.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.184+0000 7fd39dffb700 1 -- 172.21.15.72:0/2912240606 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3880033f0 con 0x7fd3a01377c0 2023-08-31T19:04:02.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.184+0000 7fd39dffb700 1 -- 172.21.15.72:0/2912240606 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767594257 0 0) 0x7fd3a00c19a0 con 0x7fd3a00bb9a0 2023-08-31T19:04:02.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.184+0000 7fd39dffb700 1 -- 172.21.15.72:0/2912240606 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a00c13e0 con 0x7fd3a00bb9a0 2023-08-31T19:04:02.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.184+0000 7fd39effd700 1 -- 172.21.15.72:0/2912240606 >> v1:172.21.15.146:6789/0 conn(0x7fd3a00bb9a0 legacy=0x7fd3a00c1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:02.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.184+0000 7fd39effd700 1 -- 172.21.15.72:0/2912240606 >> v1:172.21.15.72:6789/0 conn(0x7fd3a01377c0 legacy=0x7fd3a0069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:02.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.184+0000 7fd39effd700 1 -- 172.21.15.72:0/2912240606 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a006a4b0 con 0x7fd3a01373e0 2023-08-31T19:04:02.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.184+0000 7fd39effd700 1 --2- 172.21.15.72:0/2912240606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3a01373e0 0x7fd3a00c33b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fd390009760 tx=0x7fd390009060).ready entity=mon.1 client_cookie=4ed0a7f88e460ec6 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:02.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.184+0000 7fd39dffb700 1 -- 172.21.15.72:0/2912240606 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39000d4a0 con 0x7fd3a01373e0 2023-08-31T19:04:02.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.184+0000 7fd39dffb700 1 -- 172.21.15.72:0/2912240606 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39000d600 con 0x7fd3a01373e0 2023-08-31T19:04:02.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.184+0000 7fd39dffb700 1 -- 172.21.15.72:0/2912240606 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39000d980 con 0x7fd3a01373e0 2023-08-31T19:04:02.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.185+0000 7fd3a59ff700 1 -- 172.21.15.72:0/2912240606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3a01373e0 msgr2=0x7fd3a00c33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:02.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.185+0000 7fd3a59ff700 1 --2- 172.21.15.72:0/2912240606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3a01373e0 0x7fd3a00c33b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fd390009760 tx=0x7fd390009060).stop 2023-08-31T19:04:02.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.185+0000 7fd3a59ff700 1 -- 172.21.15.72:0/2912240606 shutdown_connections 2023-08-31T19:04:02.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.185+0000 7fd3a59ff700 1 --2- 172.21.15.72:0/2912240606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3a01373e0 0x7fd3a00c33b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:02.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.185+0000 7fd3a59ff700 1 -- 172.21.15.72:0/2912240606 >> 172.21.15.72:0/2912240606 conn(0x7fd3a0062650 msgr2=0x7fd3a0062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:02.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.185+0000 7fd3a59ff700 1 -- 172.21.15.72:0/2912240606 shutdown_connections 2023-08-31T19:04:02.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.185+0000 7fd3a59ff700 1 -- 172.21.15.72:0/2912240606 wait complete. 2023-08-31T19:04:02.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.186+0000 7fd3a59ff700 1 Processor -- start 2023-08-31T19:04:02.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.186+0000 7fd3a59ff700 1 -- start start 2023-08-31T19:04:02.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.187+0000 7fd3a59ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3a00bb9a0 0x7fd3a01357e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:02.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.187+0000 7fd3a59ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3a01373e0 0x7fd3a00be0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:02.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.187+0000 7fd3a59ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3a01377c0 0x7fd3a00be5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:02.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.187+0000 7fd3a59ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a00beaa0 con 0x7fd3a01377c0 2023-08-31T19:04:02.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.187+0000 7fd3a59ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a00c6120 con 0x7fd3a01373e0 2023-08-31T19:04:02.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.187+0000 7fd3a59ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a014d7e0 con 0x7fd3a00bb9a0 2023-08-31T19:04:02.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.188+0000 7fd39f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3a01377c0 0x7fd3a00be5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:02.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.188+0000 7fd39f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3a01377c0 0x7fd3a00be5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34754/0 (socket says 172.21.15.72:34754) 2023-08-31T19:04:02.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.188+0000 7fd39f7fe700 1 -- 172.21.15.72:0/22525371 learned_addr learned my addr 172.21.15.72:0/22525371 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:02.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.188+0000 7fd39f7fe700 1 -- 172.21.15.72:0/22525371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3a00bb9a0 msgr2=0x7fd3a01357e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:02.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.188+0000 7fd39f7fe700 1 --2- 172.21.15.72:0/22525371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3a00bb9a0 0x7fd3a01357e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:02.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.188+0000 7fd39f7fe700 1 -- 172.21.15.72:0/22525371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3a01373e0 msgr2=0x7fd3a00be0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:02.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.188+0000 7fd39f7fe700 1 --2- 172.21.15.72:0/22525371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3a01373e0 0x7fd3a00be0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:02.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.188+0000 7fd39f7fe700 1 -- 172.21.15.72:0/22525371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900092a0 con 0x7fd3a01377c0 2023-08-31T19:04:02.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.188+0000 7fd39f7fe700 1 --2- 172.21.15.72:0/22525371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3a01377c0 0x7fd3a00be5b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fd39800c7f0 tx=0x7fd398007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:02.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.188+0000 7fd386ffd700 1 -- 172.21.15.72:0/22525371 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39800a520 con 0x7fd3a01377c0 2023-08-31T19:04:02.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.188+0000 7fd386ffd700 1 -- 172.21.15.72:0/22525371 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39800a680 con 0x7fd3a01377c0 2023-08-31T19:04:02.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.188+0000 7fd3a59ff700 1 -- 172.21.15.72:0/22525371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a00c5e40 con 0x7fd3a01377c0 2023-08-31T19:04:02.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.188+0000 7fd386ffd700 1 -- 172.21.15.72:0/22525371 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39800aa20 con 0x7fd3a01377c0 2023-08-31T19:04:02.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.189+0000 7fd3a59ff700 1 -- 172.21.15.72:0/22525371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a014d470 con 0x7fd3a01377c0 2023-08-31T19:04:02.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.190+0000 7fd3a59ff700 1 -- 172.21.15.72:0/22525371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a006c6b0 con 0x7fd3a01377c0 2023-08-31T19:04:02.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.191+0000 7fd386ffd700 1 -- 172.21.15.72:0/22525371 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd39801b400 con 0x7fd3a01377c0 2023-08-31T19:04:02.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.191+0000 7fd386ffd700 1 --2- 172.21.15.72:0/22525371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd38c05ef30 0x7fd38c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:02.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.191+0000 7fd386ffd700 1 -- 172.21.15.72:0/22525371 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5869+0+0 (secure 0 0 0) 0x7fd398079d10 con 0x7fd3a01377c0 2023-08-31T19:04:02.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.192+0000 7fd39effd700 1 --2- 172.21.15.72:0/22525371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd38c05ef30 0x7fd38c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:02.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.192+0000 7fd39effd700 1 --2- 172.21.15.72:0/22525371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd38c05ef30 0x7fd38c0613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd390006e00 tx=0x7fd390016000).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:02.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.196+0000 7fd386ffd700 1 -- 172.21.15.72:0/22525371 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd39804b0a0 con 0x7fd3a01377c0 2023-08-31T19:04:02.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.365+0000 7fd3a59ff700 1 -- 172.21.15.72:0/22525371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fd3a014d920 con 0x7fd3a01377c0 2023-08-31T19:04:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.515+0000 7fd386ffd700 1 -- 172.21.15.72:0/22525371 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v91) v1 ==== 152+0+0 (secure 0 0 0) 0x7fd3a014d920 con 0x7fd3a01377c0 2023-08-31T19:04:02.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.519+0000 7fd3a59ff700 1 -- 172.21.15.72:0/22525371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd38c05ef30 msgr2=0x7fd38c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.519+0000 7fd3a59ff700 1 --2- 172.21.15.72:0/22525371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd38c05ef30 0x7fd38c0613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd390006e00 tx=0x7fd390016000).stop 2023-08-31T19:04:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.519+0000 7fd3a59ff700 1 -- 172.21.15.72:0/22525371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3a01377c0 msgr2=0x7fd3a00be5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.519+0000 7fd3a59ff700 1 --2- 172.21.15.72:0/22525371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3a01377c0 0x7fd3a00be5b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fd39800c7f0 tx=0x7fd398007f50).stop 2023-08-31T19:04:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.519+0000 7fd3a59ff700 1 -- 172.21.15.72:0/22525371 shutdown_connections 2023-08-31T19:04:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.519+0000 7fd3a59ff700 1 --2- 172.21.15.72:0/22525371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3a01377c0 0x7fd3a00be5b0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.519+0000 7fd3a59ff700 1 --2- 172.21.15.72:0/22525371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd3a00bb9a0 0x7fd3a01357e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.519+0000 7fd3a59ff700 1 --2- 172.21.15.72:0/22525371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd38c05ef30 0x7fd38c0613f0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0x7fd390006e00 tx=0x7fd390016000).stop 2023-08-31T19:04:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.519+0000 7fd3a59ff700 1 --2- 172.21.15.72:0/22525371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3a01373e0 0x7fd3a00be0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.519+0000 7fd3a59ff700 1 -- 172.21.15.72:0/22525371 >> 172.21.15.72:0/22525371 conn(0x7fd3a0062650 msgr2=0x7fd3a0151520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.520+0000 7fd3a59ff700 1 -- 172.21.15.72:0/22525371 shutdown_connections 2023-08-31T19:04:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.520+0000 7fd3a59ff700 1 -- 172.21.15.72:0/22525371 wait complete. 2023-08-31T19:04:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-08-31T19:04:02.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T19:04:02.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.737+0000 7fd7e21ff700 1 Processor -- start 2023-08-31T19:04:02.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.737+0000 7fd7e21ff700 1 -- start start 2023-08-31T19:04:02.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.738+0000 7fd7e21ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc14ecd0 0x7fd7dc1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:02.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.739+0000 7fd7e21ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd7dc0c2320 0x7fd7dc0c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:02.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.739+0000 7fd7e21ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7dc152720 con 0x7fd7dc0c1100 2023-08-31T19:04:02.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.739+0000 7fd7e21ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7dc0c2c90 con 0x7fd7dc0c2320 2023-08-31T19:04:02.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.739+0000 7fd7e21ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc06a6b0 con 0x7fd7dc14ecd0 2023-08-31T19:04:02.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.739+0000 7fd7daffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd7dc0c2320 0x7fd7dc0c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:02.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.739+0000 7fd7dbfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd7dc0c1100 0x7fd7dc0c15b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34052/0 (socket says 172.21.15.72:34052) 2023-08-31T19:04:02.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.739+0000 7fd7daffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd7dc0c2320 0x7fd7dc0c27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34770/0 (socket says 172.21.15.72:34770) 2023-08-31T19:04:02.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.739+0000 7fd7dbfff700 1 -- 172.21.15.72:0/1275060210 learned_addr learned my addr 172.21.15.72:0/1275060210 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:02.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.739+0000 7fd7db7fe700 1 --2- 172.21.15.72:0/1275060210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc14ecd0 0x7fd7dc1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:02.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.739+0000 7fd7daffd700 1 -- 172.21.15.72:0/1275060210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc14ecd0 msgr2=0x7fd7dc1556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:02.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.739+0000 7fd7daffd700 1 --2- 172.21.15.72:0/1275060210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc14ecd0 0x7fd7dc1556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:02.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.739+0000 7fd7daffd700 1 -- 172.21.15.72:0/1275060210 >> v1:172.21.15.72:6789/0 conn(0x7fd7dc0c1100 legacy=0x7fd7dc0c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:02.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.739+0000 7fd7daffd700 1 -- 172.21.15.72:0/1275060210 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc155bc0 con 0x7fd7dc0c2320 2023-08-31T19:04:02.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.740+0000 7fd7daffd700 1 --2- 172.21.15.72:0/1275060210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0c2320 0x7fd7dc0c27a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7fd7d0009760 tx=0x7fd7d0009060).ready entity=mon.0 client_cookie=cdf33bc6ffeb8d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:02.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.740+0000 7fd7da7fc700 1 -- 172.21.15.72:0/1275060210 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000b580 con 0x7fd7dc0c2320 2023-08-31T19:04:02.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.740+0000 7fd7da7fc700 1 -- 172.21.15.72:0/1275060210 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d000b6e0 con 0x7fd7dc0c2320 2023-08-31T19:04:02.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.740+0000 7fd7da7fc700 1 -- 172.21.15.72:0/1275060210 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000ba60 con 0x7fd7dc0c2320 2023-08-31T19:04:02.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.740+0000 7fd7e21ff700 1 -- 172.21.15.72:0/1275060210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0c2320 msgr2=0x7fd7dc0c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:02.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.740+0000 7fd7e21ff700 1 --2- 172.21.15.72:0/1275060210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0c2320 0x7fd7dc0c27a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7fd7d0009760 tx=0x7fd7d0009060).stop 2023-08-31T19:04:02.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.740+0000 7fd7e21ff700 1 -- 172.21.15.72:0/1275060210 shutdown_connections 2023-08-31T19:04:02.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.740+0000 7fd7e21ff700 1 --2- 172.21.15.72:0/1275060210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc14ecd0 0x7fd7dc1556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:02.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.740+0000 7fd7e21ff700 1 --2- 172.21.15.72:0/1275060210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0c2320 0x7fd7dc0c27a0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:02.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.740+0000 7fd7e21ff700 1 -- 172.21.15.72:0/1275060210 >> 172.21.15.72:0/1275060210 conn(0x7fd7dc0630c0 msgr2=0x7fd7dc0c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:02.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.741+0000 7fd7e21ff700 1 -- 172.21.15.72:0/1275060210 shutdown_connections 2023-08-31T19:04:02.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.741+0000 7fd7e21ff700 1 -- 172.21.15.72:0/1275060210 wait complete. 2023-08-31T19:04:02.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.743+0000 7fd7e21ff700 1 Processor -- start 2023-08-31T19:04:02.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.743+0000 7fd7e21ff700 1 -- start start 2023-08-31T19:04:02.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.744+0000 7fd7e21ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0c1100 0x7fd7dc0bedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:02.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.744+0000 7fd7e21ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc0c2320 0x7fd7dc0c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:02.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.744+0000 7fd7e21ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7dc14ecd0 0x7fd7dc0a9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:02.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.744+0000 7fd7e21ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc0be920 con 0x7fd7dc0c1100 2023-08-31T19:04:02.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.744+0000 7fd7e21ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc0c60f0 con 0x7fd7dc14ecd0 2023-08-31T19:04:02.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.744+0000 7fd7e21ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc0c63d0 con 0x7fd7dc0c2320 2023-08-31T19:04:02.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.744+0000 7fd7db7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0c1100 0x7fd7dc0bedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:02.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.744+0000 7fd7db7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0c1100 0x7fd7dc0bedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34778/0 (socket says 172.21.15.72:34778) 2023-08-31T19:04:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.744+0000 7fd7db7fe700 1 -- 172.21.15.72:0/3185702193 learned_addr learned my addr 172.21.15.72:0/3185702193 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.745+0000 7fd7dbfff700 1 --2- 172.21.15.72:0/3185702193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7dc14ecd0 0x7fd7dc0a9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.745+0000 7fd7daffd700 1 --2- 172.21.15.72:0/3185702193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc0c2320 0x7fd7dc0c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.745+0000 7fd7db7fe700 1 -- 172.21.15.72:0/3185702193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc0c2320 msgr2=0x7fd7dc0c36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.745+0000 7fd7db7fe700 1 --2- 172.21.15.72:0/3185702193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc0c2320 0x7fd7dc0c36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:02.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.745+0000 7fd7db7fe700 1 -- 172.21.15.72:0/3185702193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7dc14ecd0 msgr2=0x7fd7dc0a9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:02.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.745+0000 7fd7db7fe700 1 --2- 172.21.15.72:0/3185702193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7dc14ecd0 0x7fd7dc0a9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:02.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.745+0000 7fd7db7fe700 1 -- 172.21.15.72:0/3185702193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d00092a0 con 0x7fd7dc0c1100 2023-08-31T19:04:02.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.745+0000 7fd7daffd700 1 --2- 172.21.15.72:0/3185702193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc0c2320 0x7fd7dc0c36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:02.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.745+0000 7fd7db7fe700 1 --2- 172.21.15.72:0/3185702193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0c1100 0x7fd7dc0bedb0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fd7cc00d890 tx=0x7fd7cc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.745+0000 7fd7c37fe700 1 -- 172.21.15.72:0/3185702193 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc0125f0 con 0x7fd7dc0c1100 2023-08-31T19:04:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.745+0000 7fd7c37fe700 1 -- 172.21.15.72:0/3185702193 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc012750 con 0x7fd7dc0c1100 2023-08-31T19:04:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.745+0000 7fd7e21ff700 1 -- 172.21.15.72:0/3185702193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7dc0c66b0 con 0x7fd7dc0c1100 2023-08-31T19:04:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.745+0000 7fd7c37fe700 1 -- 172.21.15.72:0/3185702193 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc012ad0 con 0x7fd7dc0c1100 2023-08-31T19:04:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.745+0000 7fd7e21ff700 1 -- 172.21.15.72:0/3185702193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7dc1484c0 con 0x7fd7dc0c1100 2023-08-31T19:04:02.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.746+0000 7fd7e21ff700 1 -- 172.21.15.72:0/3185702193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7dc0bec00 con 0x7fd7dc0c1100 2023-08-31T19:04:02.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.748+0000 7fd7c37fe700 1 -- 172.21.15.72:0/3185702193 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd7cc013480 con 0x7fd7dc0c1100 2023-08-31T19:04:02.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.749+0000 7fd7c37fe700 1 --2- 172.21.15.72:0/3185702193 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7c805ef30 0x7fd7c80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:02.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.749+0000 7fd7c37fe700 1 -- 172.21.15.72:0/3185702193 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6239+0+0 (secure 0 0 0) 0x7fd7cc07a870 con 0x7fd7dc0c1100 2023-08-31T19:04:02.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.749+0000 7fd7daffd700 1 --2- 172.21.15.72:0/3185702193 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7c805ef30 0x7fd7c80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:02.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.750+0000 7fd7daffd700 1 --2- 172.21.15.72:0/3185702193 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7c805ef30 0x7fd7c80613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd7d0009760 tx=0x7fd7d0017000).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:02.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.753+0000 7fd7c37fe700 1 -- 172.21.15.72:0/3185702193 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd7cc04ba50 con 0x7fd7dc0c1100 2023-08-31T19:04:02.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:02.922+0000 7fd7e21ff700 1 -- 172.21.15.72:0/3185702193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd7dc06c6b0 con 0x7fd7dc0c1100 2023-08-31T19:04:03.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.526+0000 7fd7c37fe700 1 -- 172.21.15.72:0/3185702193 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v92) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd7cc04f070 con 0x7fd7dc0c1100 2023-08-31T19:04:03.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.536+0000 7fd7e21ff700 1 -- 172.21.15.72:0/3185702193 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7c805ef30 msgr2=0x7fd7c80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:03.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.536+0000 7fd7e21ff700 1 --2- 172.21.15.72:0/3185702193 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7c805ef30 0x7fd7c80613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd7d0009760 tx=0x7fd7d0017000).stop 2023-08-31T19:04:03.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.536+0000 7fd7e21ff700 1 -- 172.21.15.72:0/3185702193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0c1100 msgr2=0x7fd7dc0bedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:03.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.536+0000 7fd7e21ff700 1 --2- 172.21.15.72:0/3185702193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0c1100 0x7fd7dc0bedb0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7fd7cc00d890 tx=0x7fd7cc008040).stop 2023-08-31T19:04:03.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.539+0000 7fd7e21ff700 1 -- 172.21.15.72:0/3185702193 shutdown_connections 2023-08-31T19:04:03.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.539+0000 7fd7e21ff700 1 --2- 172.21.15.72:0/3185702193 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7c805ef30 0x7fd7c80613f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:03.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.539+0000 7fd7e21ff700 1 --2- 172.21.15.72:0/3185702193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7dc14ecd0 0x7fd7dc0a9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:03.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.539+0000 7fd7e21ff700 1 --2- 172.21.15.72:0/3185702193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0c1100 0x7fd7dc0bedb0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:03.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.539+0000 7fd7e21ff700 1 --2- 172.21.15.72:0/3185702193 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc0c2320 0x7fd7dc0c36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:03.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.539+0000 7fd7e21ff700 1 -- 172.21.15.72:0/3185702193 >> 172.21.15.72:0/3185702193 conn(0x7fd7dc0630c0 msgr2=0x7fd7dc0bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:03.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.543+0000 7fd7e21ff700 1 -- 172.21.15.72:0/3185702193 shutdown_connections 2023-08-31T19:04:03.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.544+0000 7fd7e21ff700 1 -- 172.21.15.72:0/3185702193 wait complete. 2023-08-31T19:04:03.550 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-08-31T19:04:03.571 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T19:04:03.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.764+0000 7f91b63ff700 1 Processor -- start 2023-08-31T19:04:03.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.764+0000 7f91b63ff700 1 -- start start 2023-08-31T19:04:03.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.765+0000 7f91b63ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91b00aa450 0x7f91b0154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:03.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.765+0000 7f91b63ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b0158a90 con 0x7f91b0063980 2023-08-31T19:04:03.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.765+0000 7f91b63ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b0157e80 con 0x7f91b0153e20 2023-08-31T19:04:03.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.765+0000 7f91b63ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b0157c70 con 0x7f91b00aa450 2023-08-31T19:04:03.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.766+0000 7f91b499c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91b00aa450 0x7f91b0154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:03.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.766+0000 7f91b499c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91b00aa450 0x7f91b0154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54070/0 (socket says 172.21.15.72:54070) 2023-08-31T19:04:03.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.766+0000 7f91b499c700 1 -- 172.21.15.72:0/4198366722 learned_addr learned my addr 172.21.15.72:0/4198366722 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:03.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.766+0000 7f91af7fe700 1 --1- 172.21.15.72:0/4198366722 >> v1:172.21.15.72:6789/0 conn(0x7f91b0063980 0x7f91b00a9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37554/0 (socket says 172.21.15.72:37554) 2023-08-31T19:04:03.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.766+0000 7f91b499c700 1 -- 172.21.15.72:0/4198366722 >> v1:172.21.15.146:6789/0 conn(0x7f91b0153e20 legacy=0x7f91b0063270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:03.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.766+0000 7f91b499c700 1 -- 172.21.15.72:0/4198366722 >> v1:172.21.15.72:6789/0 conn(0x7f91b0063980 legacy=0x7f91b00a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:03.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.766+0000 7f91b499c700 1 -- 172.21.15.72:0/4198366722 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b0158160 con 0x7f91b00aa450 2023-08-31T19:04:03.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.766+0000 7f91aeffd700 1 -- 172.21.15.72:0/4198366722 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491659521 0 0) 0x7f91b0157e80 con 0x7f91b0153e20 2023-08-31T19:04:03.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.766+0000 7f91b499c700 1 --2- 172.21.15.72:0/4198366722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b00aa450 0x7f91b0154200 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f91b0157db0 tx=0x7f91a8009840).ready entity=mon.0 client_cookie=bbf7ed18b401223a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:03.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.767+0000 7f91aeffd700 1 -- 172.21.15.72:0/4198366722 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a800e070 con 0x7f91b00aa450 2023-08-31T19:04:03.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.767+0000 7f91aeffd700 1 -- 172.21.15.72:0/4198366722 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a800ba50 con 0x7f91b00aa450 2023-08-31T19:04:03.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.767+0000 7f91aeffd700 1 -- 172.21.15.72:0/4198366722 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a800bdd0 con 0x7f91b00aa450 2023-08-31T19:04:03.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.767+0000 7f91b63ff700 1 -- 172.21.15.72:0/4198366722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b00aa450 msgr2=0x7f91b0154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:03.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.767+0000 7f91b63ff700 1 --2- 172.21.15.72:0/4198366722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b00aa450 0x7f91b0154200 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f91b0157db0 tx=0x7f91a8009840).stop 2023-08-31T19:04:03.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.767+0000 7f91b63ff700 1 -- 172.21.15.72:0/4198366722 shutdown_connections 2023-08-31T19:04:03.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.767+0000 7f91b63ff700 1 --2- 172.21.15.72:0/4198366722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b00aa450 0x7f91b0154200 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:03.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.767+0000 7f91b63ff700 1 -- 172.21.15.72:0/4198366722 >> 172.21.15.72:0/4198366722 conn(0x7f91b005eb60 msgr2=0x7f91b00cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:03.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.767+0000 7f91b63ff700 1 -- 172.21.15.72:0/4198366722 shutdown_connections 2023-08-31T19:04:03.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.767+0000 7f91b63ff700 1 -- 172.21.15.72:0/4198366722 wait complete. 2023-08-31T19:04:03.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.769+0000 7f91b63ff700 1 Processor -- start 2023-08-31T19:04:03.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.769+0000 7f91b63ff700 1 -- start start 2023-08-31T19:04:03.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.770+0000 7f91b63ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91b0063980 0x7f91b01416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:03.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.770+0000 7f91b63ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b00aa450 0x7f91b00abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:03.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.770+0000 7f91b63ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91b0153e20 0x7f91b00c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:03.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.770+0000 7f91b63ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b0155a00 con 0x7f91b00aa450 2023-08-31T19:04:03.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.770+0000 7f91b63ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00ac600 con 0x7f91b0063980 2023-08-31T19:04:03.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.770+0000 7f91b63ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b00ac8e0 con 0x7f91b0153e20 2023-08-31T19:04:03.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.770+0000 7f91af7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b00aa450 0x7f91b00abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:03.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.770+0000 7f91af7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b00aa450 0x7f91b00abc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54072/0 (socket says 172.21.15.72:54072) 2023-08-31T19:04:03.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.770+0000 7f91af7fe700 1 -- 172.21.15.72:0/3012703805 learned_addr learned my addr 172.21.15.72:0/3012703805 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:03.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.770+0000 7f91b499c700 1 --2- 172.21.15.72:0/3012703805 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91b0153e20 0x7f91b00c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:03.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.770+0000 7f91affff700 1 --2- 172.21.15.72:0/3012703805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91b0063980 0x7f91b01416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:03.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.771+0000 7f91af7fe700 1 -- 172.21.15.72:0/3012703805 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91b0153e20 msgr2=0x7f91b00c0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:03.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.771+0000 7f91af7fe700 1 --2- 172.21.15.72:0/3012703805 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91b0153e20 0x7f91b00c0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:03.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.771+0000 7f91af7fe700 1 -- 172.21.15.72:0/3012703805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91b0063980 msgr2=0x7f91b01416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:03.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.771+0000 7f91af7fe700 1 --2- 172.21.15.72:0/3012703805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91b0063980 0x7f91b01416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.771+0000 7f91af7fe700 1 -- 172.21.15.72:0/3012703805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8009ae0 con 0x7f91b00aa450 2023-08-31T19:04:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.771+0000 7f91af7fe700 1 --2- 172.21.15.72:0/3012703805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b00aa450 0x7f91b00abc90 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f91a400c4c0 tx=0x7f91a4007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.771+0000 7f9197fff700 1 -- 172.21.15.72:0/3012703805 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a400ce10 con 0x7f91b00aa450 2023-08-31T19:04:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.771+0000 7f9197fff700 1 -- 172.21.15.72:0/3012703805 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a40072e0 con 0x7f91b00aa450 2023-08-31T19:04:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.771+0000 7f9197fff700 1 -- 172.21.15.72:0/3012703805 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40056e0 con 0x7f91b00aa450 2023-08-31T19:04:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.771+0000 7f91b63ff700 1 -- 172.21.15.72:0/3012703805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b00acbc0 con 0x7f91b00aa450 2023-08-31T19:04:03.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.771+0000 7f91b63ff700 1 -- 172.21.15.72:0/3012703805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b0141bd0 con 0x7f91b00aa450 2023-08-31T19:04:03.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.772+0000 7f91b63ff700 1 -- 172.21.15.72:0/3012703805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b00cb830 con 0x7f91b00aa450 2023-08-31T19:04:03.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.774+0000 7f9197fff700 1 -- 172.21.15.72:0/3012703805 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f91a4005b10 con 0x7f91b00aa450 2023-08-31T19:04:03.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.775+0000 7f9197fff700 1 --2- 172.21.15.72:0/3012703805 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f919c05ef00 0x7f919c0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:03.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.775+0000 7f9197fff700 1 -- 172.21.15.72:0/3012703805 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6621+0+0 (secure 0 0 0) 0x7f91a4079a00 con 0x7f91b00aa450 2023-08-31T19:04:03.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.775+0000 7f91affff700 1 --2- 172.21.15.72:0/3012703805 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f919c05ef00 0x7f919c0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:03.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.776+0000 7f91affff700 1 --2- 172.21.15.72:0/3012703805 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f919c05ef00 0x7f919c0613c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f91a0003870 tx=0x7f91a0007d20).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:03.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.779+0000 7f9197fff700 1 -- 172.21.15.72:0/3012703805 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f91a404abc0 con 0x7f91b00aa450 2023-08-31T19:04:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.990+0000 7f91b63ff700 1 -- 172.21.15.72:0/3012703805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f91b006c6b0 con 0x7f91b00aa450 2023-08-31T19:04:03.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:03.995+0000 7f9197fff700 1 -- 172.21.15.72:0/3012703805 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7f91a4018030 con 0x7f91b00aa450 2023-08-31T19:04:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.002+0000 7f91b63ff700 1 -- 172.21.15.72:0/3012703805 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f919c05ef00 msgr2=0x7f919c0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.002+0000 7f91b63ff700 1 --2- 172.21.15.72:0/3012703805 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f919c05ef00 0x7f919c0613c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f91a0003870 tx=0x7f91a0007d20).stop 2023-08-31T19:04:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.002+0000 7f91b63ff700 1 -- 172.21.15.72:0/3012703805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b00aa450 msgr2=0x7f91b00abc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.002+0000 7f91b63ff700 1 --2- 172.21.15.72:0/3012703805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b00aa450 0x7f91b00abc90 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f91a400c4c0 tx=0x7f91a4007dc0).stop 2023-08-31T19:04:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.002+0000 7f91b63ff700 1 -- 172.21.15.72:0/3012703805 shutdown_connections 2023-08-31T19:04:04.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.002+0000 7f91b63ff700 1 --2- 172.21.15.72:0/3012703805 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91b0153e20 0x7f91b00c0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.002+0000 7f91b63ff700 1 --2- 172.21.15.72:0/3012703805 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f919c05ef00 0x7f919c0613c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.002+0000 7f91b63ff700 1 --2- 172.21.15.72:0/3012703805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91b0063980 0x7f91b01416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.002+0000 7f91b63ff700 1 --2- 172.21.15.72:0/3012703805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91b00aa450 0x7f91b00abc90 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.002+0000 7f91b63ff700 1 -- 172.21.15.72:0/3012703805 >> 172.21.15.72:0/3012703805 conn(0x7f91b005eb60 msgr2=0x7f91b00aaed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:04.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.004+0000 7f91b63ff700 1 -- 172.21.15.72:0/3012703805 shutdown_connections 2023-08-31T19:04:04.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.004+0000 7f91b63ff700 1 -- 172.21.15.72:0/3012703805 wait complete. 2023-08-31T19:04:04.010 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 11 and data pool 12 2023-08-31T19:04:04.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:04:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.227+0000 7fc981b9d700 1 Processor -- start 2023-08-31T19:04:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.227+0000 7fc981b9d700 1 -- start start 2023-08-31T19:04:04.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.228+0000 7fc981b9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc97c14b000 0x7fc97c154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.228+0000 7fc981b9d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c0aa520 con 0x7fc97c0bfd50 2023-08-31T19:04:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.228+0000 7fc981b9d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97c157e30 con 0x7fc97c0c5bc0 2023-08-31T19:04:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.228+0000 7fc981b9d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97c1589d0 con 0x7fc97c14b000 2023-08-31T19:04:04.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.229+0000 7fc980b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc97c14b000 0x7fc97c154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.229+0000 7fc97bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc97c0bfd50 0x7fc97c1582c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37564/0 (socket says 172.21.15.72:37564) 2023-08-31T19:04:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.229+0000 7fc97bfff700 1 -- 172.21.15.72:0/1949873949 learned_addr learned my addr 172.21.15.72:0/1949873949 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.229+0000 7fc980b9b700 1 -- 172.21.15.72:0/1949873949 >> v1:172.21.15.146:6789/0 conn(0x7fc97c0c5bc0 legacy=0x7fc97c0c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.229+0000 7fc980b9b700 1 -- 172.21.15.72:0/1949873949 >> v1:172.21.15.72:6789/0 conn(0x7fc97c0bfd50 legacy=0x7fc97c1582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.229+0000 7fc97b7fe700 1 -- 172.21.15.72:0/1949873949 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326550718 0 0) 0x7fc97c0aa520 con 0x7fc97c0bfd50 2023-08-31T19:04:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.229+0000 7fc980b9b700 1 -- 172.21.15.72:0/1949873949 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c14b3e0 con 0x7fc97c14b000 2023-08-31T19:04:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.229+0000 7fc980b9b700 1 --2- 172.21.15.72:0/1949873949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc97c14b000 0x7fc97c154470 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fc970009760 tx=0x7fc970009060).ready entity=mon.0 client_cookie=df26299e085798b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.229+0000 7fc97b7fe700 1 -- 172.21.15.72:0/1949873949 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97000b520 con 0x7fc97c14b000 2023-08-31T19:04:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.230+0000 7fc97b7fe700 1 -- 172.21.15.72:0/1949873949 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97000b680 con 0x7fc97c14b000 2023-08-31T19:04:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.230+0000 7fc97b7fe700 1 -- 172.21.15.72:0/1949873949 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97000ba00 con 0x7fc97c14b000 2023-08-31T19:04:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.230+0000 7fc981b9d700 1 -- 172.21.15.72:0/1949873949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc97c14b000 msgr2=0x7fc97c154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:04.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.230+0000 7fc981b9d700 1 --2- 172.21.15.72:0/1949873949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc97c14b000 0x7fc97c154470 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fc970009760 tx=0x7fc970009060).stop 2023-08-31T19:04:04.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.230+0000 7fc981b9d700 1 -- 172.21.15.72:0/1949873949 shutdown_connections 2023-08-31T19:04:04.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.230+0000 7fc981b9d700 1 --2- 172.21.15.72:0/1949873949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc97c14b000 0x7fc97c154470 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.230+0000 7fc981b9d700 1 -- 172.21.15.72:0/1949873949 >> 172.21.15.72:0/1949873949 conn(0x7fc97c0cabf0 msgr2=0x7fc97c0cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:04.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.230+0000 7fc981b9d700 1 -- 172.21.15.72:0/1949873949 shutdown_connections 2023-08-31T19:04:04.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.230+0000 7fc981b9d700 1 -- 172.21.15.72:0/1949873949 wait complete. 2023-08-31T19:04:04.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.232+0000 7fc981b9d700 1 Processor -- start 2023-08-31T19:04:04.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.232+0000 7fc981b9d700 1 -- start start 2023-08-31T19:04:04.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc981b9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc97c0bfd50 0x7fc97c14e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:04.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc981b9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc97c0c5bc0 0x7fc97c0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:04.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc981b9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc97c14b000 0x7fc97c148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:04.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc981b9d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0ae090 con 0x7fc97c0bfd50 2023-08-31T19:04:04.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc981b9d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c168ac0 con 0x7fc97c14b000 2023-08-31T19:04:04.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc981b9d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0ae280 con 0x7fc97c0c5bc0 2023-08-31T19:04:04.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc980b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc97c0bfd50 0x7fc97c14e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:04.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc980b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc97c0bfd50 0x7fc97c14e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54092/0 (socket says 172.21.15.72:54092) 2023-08-31T19:04:04.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc980b9b700 1 -- 172.21.15.72:0/818870471 learned_addr learned my addr 172.21.15.72:0/818870471 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:04.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc97bfff700 1 --2- 172.21.15.72:0/818870471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc97c0c5bc0 0x7fc97c0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:04.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc98139c700 1 --2- 172.21.15.72:0/818870471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc97c14b000 0x7fc97c148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:04.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc980b9b700 1 -- 172.21.15.72:0/818870471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc97c0c5bc0 msgr2=0x7fc97c0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:04.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc980b9b700 1 --2- 172.21.15.72:0/818870471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc97c0c5bc0 0x7fc97c0adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc980b9b700 1 -- 172.21.15.72:0/818870471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc97c14b000 msgr2=0x7fc97c148760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:04.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc980b9b700 1 --2- 172.21.15.72:0/818870471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc97c14b000 0x7fc97c148760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.233+0000 7fc980b9b700 1 -- 172.21.15.72:0/818870471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9700092a0 con 0x7fc97c0bfd50 2023-08-31T19:04:04.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.234+0000 7fc980b9b700 1 --2- 172.21.15.72:0/818870471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc97c0bfd50 0x7fc97c14e550 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fc970006dd0 tx=0x7fc970017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:04.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.234+0000 7fc978ff9700 1 -- 172.21.15.72:0/818870471 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97000b7f0 con 0x7fc97c0bfd50 2023-08-31T19:04:04.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.234+0000 7fc978ff9700 1 -- 172.21.15.72:0/818870471 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97000b950 con 0x7fc97c0bfd50 2023-08-31T19:04:04.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.234+0000 7fc978ff9700 1 -- 172.21.15.72:0/818870471 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97001b690 con 0x7fc97c0bfd50 2023-08-31T19:04:04.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.234+0000 7fc981b9d700 1 -- 172.21.15.72:0/818870471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c0ae560 con 0x7fc97c0bfd50 2023-08-31T19:04:04.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.234+0000 7fc981b9d700 1 -- 172.21.15.72:0/818870471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97c148c50 con 0x7fc97c0bfd50 2023-08-31T19:04:04.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.235+0000 7fc981b9d700 1 -- 172.21.15.72:0/818870471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97c153d90 con 0x7fc97c0bfd50 2023-08-31T19:04:04.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.236+0000 7fc978ff9700 1 -- 172.21.15.72:0/818870471 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc97001ba40 con 0x7fc97c0bfd50 2023-08-31T19:04:04.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.237+0000 7fc978ff9700 1 --2- 172.21.15.72:0/818870471 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc96005ef00 0x7fc9600613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:04.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.237+0000 7fc978ff9700 1 -- 172.21.15.72:0/818870471 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6721+0+0 (secure 0 0 0) 0x7fc97007bbc0 con 0x7fc97c0bfd50 2023-08-31T19:04:04.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.237+0000 7fc97bfff700 1 --2- 172.21.15.72:0/818870471 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc96005ef00 0x7fc9600613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:04.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.238+0000 7fc97bfff700 1 --2- 172.21.15.72:0/818870471 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc96005ef00 0x7fc9600613c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc97c0c4610 tx=0x7fc968009040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:04.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.241+0000 7fc978ff9700 1 -- 172.21.15.72:0/818870471 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc97004cb90 con 0x7fc97c0bfd50 2023-08-31T19:04:04.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.410+0000 7fc981b9d700 1 -- 172.21.15.72:0/818870471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc97c047480 con 0x7fc97c0bfd50 2023-08-31T19:04:04.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.411+0000 7fc978ff9700 1 -- 172.21.15.72:0/818870471 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+17947 (secure 0 0 0) 0x7fc970028020 con 0x7fc97c0bfd50 2023-08-31T19:04:04.412 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:04.412 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":93,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:04:03.992002+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:04:02.410352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-31T19:04:02.966343+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:04:04.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.413+0000 7fc981b9d700 1 -- 172.21.15.72:0/818870471 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc96005ef00 msgr2=0x7fc9600613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:04.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.413+0000 7fc981b9d700 1 --2- 172.21.15.72:0/818870471 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc96005ef00 0x7fc9600613c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc97c0c4610 tx=0x7fc968009040).stop 2023-08-31T19:04:04.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.413+0000 7fc981b9d700 1 -- 172.21.15.72:0/818870471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc97c0bfd50 msgr2=0x7fc97c14e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:04.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.413+0000 7fc981b9d700 1 --2- 172.21.15.72:0/818870471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc97c0bfd50 0x7fc97c14e550 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fc970006dd0 tx=0x7fc970017000).stop 2023-08-31T19:04:04.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.413+0000 7fc981b9d700 1 -- 172.21.15.72:0/818870471 shutdown_connections 2023-08-31T19:04:04.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.413+0000 7fc981b9d700 1 --2- 172.21.15.72:0/818870471 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc96005ef00 0x7fc9600613c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.413+0000 7fc981b9d700 1 --2- 172.21.15.72:0/818870471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc97c14b000 0x7fc97c148760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.413+0000 7fc981b9d700 1 --2- 172.21.15.72:0/818870471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc97c0bfd50 0x7fc97c14e550 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.413+0000 7fc981b9d700 1 --2- 172.21.15.72:0/818870471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc97c0c5bc0 0x7fc97c0adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.413+0000 7fc981b9d700 1 -- 172.21.15.72:0/818870471 >> 172.21.15.72:0/818870471 conn(0x7fc97c0cabf0 msgr2=0x7fc97c149920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:04.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.413+0000 7fc981b9d700 1 -- 172.21.15.72:0/818870471 shutdown_connections 2023-08-31T19:04:04.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.413+0000 7fc981b9d700 1 -- 172.21.15.72:0/818870471 wait complete. 2023-08-31T19:04:04.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:04:04.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.623+0000 7f566c1ff700 1 Processor -- start 2023-08-31T19:04:04.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.623+0000 7f566c1ff700 1 -- start start 2023-08-31T19:04:04.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.625+0000 7f566c1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f566415ce50 0x7f566415f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:04.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.625+0000 7f566c1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56640c8c90 con 0x7f56640cb940 2023-08-31T19:04:04.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.625+0000 7f566c1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5664158af0 con 0x7f5664154220 2023-08-31T19:04:04.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.625+0000 7f566c1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56640aa700 con 0x7f566415ce50 2023-08-31T19:04:04.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.625+0000 7f566979a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f56640cb940 0x7f56641583e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37566/0 (socket says 172.21.15.72:37566) 2023-08-31T19:04:04.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.625+0000 7f566979a700 1 -- 172.21.15.72:0/13073591 learned_addr learned my addr 172.21.15.72:0/13073591 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:04.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.625+0000 7f566a79c700 1 --2- 172.21.15.72:0/13073591 >> v2:172.21.15.72:3300/0 conn(0x7f566415ce50 0x7f566415f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:04.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.625+0000 7f5668f99700 1 -- 172.21.15.72:0/13073591 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186204209 0 0) 0x7f56640c8c90 con 0x7f56640cb940 2023-08-31T19:04:04.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.625+0000 7f5668f99700 1 -- 172.21.15.72:0/13073591 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56500033f0 con 0x7f56640cb940 2023-08-31T19:04:04.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.625+0000 7f566a79c700 1 -- 172.21.15.72:0/13073591 >> v1:172.21.15.146:6789/0 conn(0x7f5664154220 legacy=0x7f5664157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:04.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.625+0000 7f566a79c700 1 -- 172.21.15.72:0/13073591 >> v1:172.21.15.72:6789/0 conn(0x7f56640cb940 legacy=0x7f56641583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:04.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.625+0000 7f566a79c700 1 -- 172.21.15.72:0/13073591 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5664155610 con 0x7f566415ce50 2023-08-31T19:04:04.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.626+0000 7f566a79c700 1 --2- 172.21.15.72:0/13073591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566415ce50 0x7f566415f240 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f565c009e60 tx=0x7f565c009780).ready entity=mon.0 client_cookie=7688564a07945cd server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:04.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.626+0000 7f5668f99700 1 -- 172.21.15.72:0/13073591 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c00e070 con 0x7f566415ce50 2023-08-31T19:04:04.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.626+0000 7f5668f99700 1 -- 172.21.15.72:0/13073591 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c00bb60 con 0x7f566415ce50 2023-08-31T19:04:04.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.626+0000 7f5668f99700 1 -- 172.21.15.72:0/13073591 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c012410 con 0x7f566415ce50 2023-08-31T19:04:04.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.626+0000 7f566c1ff700 1 -- 172.21.15.72:0/13073591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566415ce50 msgr2=0x7f566415f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:04.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.626+0000 7f566c1ff700 1 --2- 172.21.15.72:0/13073591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566415ce50 0x7f566415f240 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f565c009e60 tx=0x7f565c009780).stop 2023-08-31T19:04:04.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.626+0000 7f566c1ff700 1 -- 172.21.15.72:0/13073591 shutdown_connections 2023-08-31T19:04:04.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.626+0000 7f566c1ff700 1 --2- 172.21.15.72:0/13073591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f566415ce50 0x7f566415f240 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.626+0000 7f566c1ff700 1 -- 172.21.15.72:0/13073591 >> 172.21.15.72:0/13073591 conn(0x7f566405e870 msgr2=0x7f56640cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:04.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.626+0000 7f566c1ff700 1 -- 172.21.15.72:0/13073591 shutdown_connections 2023-08-31T19:04:04.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.627+0000 7f566c1ff700 1 -- 172.21.15.72:0/13073591 wait complete. 2023-08-31T19:04:04.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.628+0000 7f566c1ff700 1 Processor -- start 2023-08-31T19:04:04.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.628+0000 7f566c1ff700 1 -- start start 2023-08-31T19:04:04.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.629+0000 7f566c1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56640cb940 0x7f56640ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.629+0000 7f566c1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5664154220 0x7f56640addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.629+0000 7f566c1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f566415ce50 0x7f56640ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.629+0000 7f566c1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5664153570 con 0x7f5664154220 2023-08-31T19:04:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.629+0000 7f566c1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5664152fb0 con 0x7f566415ce50 2023-08-31T19:04:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.629+0000 7f566c1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5664153290 con 0x7f56640cb940 2023-08-31T19:04:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.629+0000 7f566979a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5664154220 0x7f56640addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.629+0000 7f566979a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5664154220 0x7f56640addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54108/0 (socket says 172.21.15.72:54108) 2023-08-31T19:04:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.629+0000 7f566979a700 1 -- 172.21.15.72:0/920390972 learned_addr learned my addr 172.21.15.72:0/920390972 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.629+0000 7f5669f9b700 1 --2- 172.21.15.72:0/920390972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56640cb940 0x7f56640ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.629+0000 7f566a79c700 1 --2- 172.21.15.72:0/920390972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f566415ce50 0x7f56640ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.630+0000 7f566979a700 1 -- 172.21.15.72:0/920390972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56640cb940 msgr2=0x7f56640ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:04.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.630+0000 7f566979a700 1 --2- 172.21.15.72:0/920390972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56640cb940 0x7f56640ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.630+0000 7f566979a700 1 -- 172.21.15.72:0/920390972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f566415ce50 msgr2=0x7f56640ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:04.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.630+0000 7f566979a700 1 --2- 172.21.15.72:0/920390972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f566415ce50 0x7f56640ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.630+0000 7f566979a700 1 -- 172.21.15.72:0/920390972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c009a20 con 0x7f5664154220 2023-08-31T19:04:04.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.630+0000 7f5669f9b700 1 --2- 172.21.15.72:0/920390972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56640cb940 0x7f56640ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:04.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.630+0000 7f566979a700 1 --2- 172.21.15.72:0/920390972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5664154220 0x7f56640addb0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f565400c590 tx=0x7f5654007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:04.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.630+0000 7f5659ffb700 1 -- 172.21.15.72:0/920390972 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654007e40 con 0x7f5664154220 2023-08-31T19:04:04.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.630+0000 7f5659ffb700 1 -- 172.21.15.72:0/920390972 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56540072e0 con 0x7f5664154220 2023-08-31T19:04:04.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.630+0000 7f5659ffb700 1 -- 172.21.15.72:0/920390972 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56540057a0 con 0x7f5664154220 2023-08-31T19:04:04.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.630+0000 7f566c1ff700 1 -- 172.21.15.72:0/920390972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56640aaed0 con 0x7f5664154220 2023-08-31T19:04:04.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.630+0000 7f566c1ff700 1 -- 172.21.15.72:0/920390972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56640afad0 con 0x7f5664154220 2023-08-31T19:04:04.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.631+0000 7f566c1ff700 1 -- 172.21.15.72:0/920390972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56640ab3f0 con 0x7f5664154220 2023-08-31T19:04:04.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.632+0000 7f5659ffb700 1 -- 172.21.15.72:0/920390972 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f5654005bd0 con 0x7f5664154220 2023-08-31T19:04:04.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.633+0000 7f5659ffb700 1 --2- 172.21.15.72:0/920390972 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f564805ef30 0x7f56480613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:04.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.633+0000 7f5659ffb700 1 -- 172.21.15.72:0/920390972 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f5654079aa0 con 0x7f5664154220 2023-08-31T19:04:04.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.633+0000 7f5669f9b700 1 --2- 172.21.15.72:0/920390972 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f564805ef30 0x7f56480613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:04.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.634+0000 7f5669f9b700 1 --2- 172.21.15.72:0/920390972 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f564805ef30 0x7f56480613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5660001780 tx=0x7f5660009040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:04.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.637+0000 7f5659ffb700 1 -- 172.21.15.72:0/920390972 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f56640ab3f0 con 0x7f5664154220 2023-08-31T19:04:04.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.808+0000 7f566c1ff700 1 -- 172.21.15.72:0/920390972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56640ab3f0 con 0x7f5664154220 2023-08-31T19:04:04.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.809+0000 7f5659ffb700 1 -- 172.21.15.72:0/920390972 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+17947 (secure 0 0 0) 0x7f56640ab3f0 con 0x7f5664154220 2023-08-31T19:04:04.809 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:04.810 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":93,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:04:03.992002+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:04:02.410352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-31T19:04:02.966343+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:04:04.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.811+0000 7f566c1ff700 1 -- 172.21.15.72:0/920390972 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f564805ef30 msgr2=0x7f56480613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:04.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.811+0000 7f566c1ff700 1 --2- 172.21.15.72:0/920390972 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f564805ef30 0x7f56480613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5660001780 tx=0x7f5660009040).stop 2023-08-31T19:04:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.811+0000 7f566c1ff700 1 -- 172.21.15.72:0/920390972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5664154220 msgr2=0x7f56640addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.811+0000 7f566c1ff700 1 --2- 172.21.15.72:0/920390972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5664154220 0x7f56640addb0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f565400c590 tx=0x7f5654007c80).stop 2023-08-31T19:04:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.811+0000 7f566c1ff700 1 -- 172.21.15.72:0/920390972 shutdown_connections 2023-08-31T19:04:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.811+0000 7f566c1ff700 1 --2- 172.21.15.72:0/920390972 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f564805ef30 0x7f56480613f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.811+0000 7f566c1ff700 1 --2- 172.21.15.72:0/920390972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f566415ce50 0x7f56640ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.811+0000 7f566c1ff700 1 --2- 172.21.15.72:0/920390972 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56640cb940 0x7f56640ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.811+0000 7f566c1ff700 1 --2- 172.21.15.72:0/920390972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5664154220 0x7f56640addb0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:04.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.811+0000 7f566c1ff700 1 -- 172.21.15.72:0/920390972 >> 172.21.15.72:0/920390972 conn(0x7f566405e870 msgr2=0x7f56640646b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:04.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.811+0000 7f566c1ff700 1 -- 172.21.15.72:0/920390972 shutdown_connections 2023-08-31T19:04:04.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:04.811+0000 7f566c1ff700 1 -- 172.21.15.72:0/920390972 wait complete. 2023-08-31T19:04:04.829 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T19:04:05.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.022+0000 7f12dd1ff700 1 Processor -- start 2023-08-31T19:04:05.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.022+0000 7f12dd1ff700 1 -- start start 2023-08-31T19:04:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.024+0000 7f12dd1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12d8063830 0x7f12d80c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.024+0000 7f12dd1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d80c6ed0 con 0x7f12d8154410 2023-08-31T19:04:05.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.024+0000 7f12dd1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d80c68c0 con 0x7f12d8154030 2023-08-31T19:04:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.024+0000 7f12dd1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80c66e0 con 0x7f12d8063830 2023-08-31T19:04:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.024+0000 7f12d659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f12d8154410 0x7f12d8063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37580/0 (socket says 172.21.15.72:37580) 2023-08-31T19:04:05.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.024+0000 7f12d659c700 1 -- 172.21.15.72:0/536628205 learned_addr learned my addr 172.21.15.72:0/536628205 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:05.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.024+0000 7f12d759e700 1 --2- 172.21.15.72:0/536628205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12d8063830 0x7f12d80c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:05.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.024+0000 7f12d5d9b700 1 -- 172.21.15.72:0/536628205 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624548442 0 0) 0x7f12d80c6ed0 con 0x7f12d8154410 2023-08-31T19:04:05.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.024+0000 7f12d5d9b700 1 -- 172.21.15.72:0/536628205 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c00033f0 con 0x7f12d8154410 2023-08-31T19:04:05.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d5d9b700 1 -- 172.21.15.72:0/536628205 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 195805870 0 0) 0x7f12c00033f0 con 0x7f12d8154410 2023-08-31T19:04:05.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d5d9b700 1 -- 172.21.15.72:0/536628205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12d8063830 msgr2=0x7f12d80c06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:05.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d5d9b700 1 --2- 172.21.15.72:0/536628205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12d8063830 0x7f12d80c06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:05.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d5d9b700 1 -- 172.21.15.72:0/536628205 >> v1:172.21.15.146:6789/0 conn(0x7f12d8154030 legacy=0x7f12d80aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:05.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d5d9b700 1 -- 172.21.15.72:0/536628205 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d80c0f30 con 0x7f12d8154410 2023-08-31T19:04:05.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d5d9b700 1 -- 172.21.15.72:0/536628205 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f12cc001470 con 0x7f12d8154410 2023-08-31T19:04:05.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d5d9b700 1 -- 172.21.15.72:0/536628205 >> v1:172.21.15.72:6789/0 conn(0x7f12d8154410 legacy=0x7f12d8063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:05.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d5d9b700 1 --2- 172.21.15.72:0/536628205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0003910 0x7f12c0003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:05.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d5d9b700 1 --2- 172.21.15.72:0/536628205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12d8063830 0x7f12c0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:05.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d5d9b700 1 --2- 172.21.15.72:0/536628205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12c0004b80 0x7f12c0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:05.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d5d9b700 1 -- 172.21.15.72:0/536628205 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80c66e0 con 0x7f12c0004b80 2023-08-31T19:04:05.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d5d9b700 1 -- 172.21.15.72:0/536628205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c000b8e0 con 0x7f12c0003910 2023-08-31T19:04:05.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d5d9b700 1 -- 172.21.15.72:0/536628205 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c000ba70 con 0x7f12d8063830 2023-08-31T19:04:05.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d659c700 1 --2- 172.21.15.72:0/536628205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12d8063830 0x7f12c0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:05.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d759e700 1 --2- 172.21.15.72:0/536628205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12c0004b80 0x7f12c0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d6d9d700 1 --2- 172.21.15.72:0/536628205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0003910 0x7f12c0003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.025+0000 7f12d759e700 1 -- 172.21.15.72:0/536628205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12d8063830 msgr2=0x7f12c0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.026+0000 7f12d759e700 1 --2- 172.21.15.72:0/536628205 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12d8063830 0x7f12c0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.026+0000 7f12d759e700 1 -- 172.21.15.72:0/536628205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0003910 msgr2=0x7f12c0003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.026+0000 7f12d759e700 1 --2- 172.21.15.72:0/536628205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0003910 0x7f12c0003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.026+0000 7f12d759e700 1 -- 172.21.15.72:0/536628205 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c00033f0 con 0x7f12c0004b80 2023-08-31T19:04:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.026+0000 7f12d759e700 1 --2- 172.21.15.72:0/536628205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12c0004b80 0x7f12c0005000 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f12d8083610 tx=0x7f12d000b040).ready entity=mon.0 client_cookie=47b04094ea003a34 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.026+0000 7f12d5d9b700 1 -- 172.21.15.72:0/536628205 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d0009ac0 con 0x7f12c0004b80 2023-08-31T19:04:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.026+0000 7f12d5d9b700 1 -- 172.21.15.72:0/536628205 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d000f040 con 0x7f12c0004b80 2023-08-31T19:04:05.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.026+0000 7f12d5d9b700 1 -- 172.21.15.72:0/536628205 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d000ec70 con 0x7f12c0004b80 2023-08-31T19:04:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.026+0000 7f12dd1ff700 1 -- 172.21.15.72:0/536628205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12c0004b80 msgr2=0x7f12c0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.026+0000 7f12dd1ff700 1 --2- 172.21.15.72:0/536628205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12c0004b80 0x7f12c0005000 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f12d8083610 tx=0x7f12d000b040).stop 2023-08-31T19:04:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.026+0000 7f12d759e700 1 -- 172.21.15.72:0/536628205 reap_dead start 2023-08-31T19:04:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.027+0000 7f12dd1ff700 1 -- 172.21.15.72:0/536628205 shutdown_connections 2023-08-31T19:04:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.027+0000 7f12dd1ff700 1 -- 172.21.15.72:0/536628205 >> 172.21.15.72:0/536628205 conn(0x7f12d805eb60 msgr2=0x7f12d80cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.027+0000 7f12dd1ff700 1 -- 172.21.15.72:0/536628205 shutdown_connections 2023-08-31T19:04:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.027+0000 7f12dd1ff700 1 -- 172.21.15.72:0/536628205 wait complete. 2023-08-31T19:04:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.028+0000 7f12dd1ff700 1 Processor -- start 2023-08-31T19:04:05.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.028+0000 7f12dd1ff700 1 -- start start 2023-08-31T19:04:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.029+0000 7f12dd1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0004b80 0x7f12d814f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.029+0000 7f12dd1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d8167310 0x7f12d8153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.029+0000 7f12dd1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12d8153500 0x7f12d81489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:05.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.029+0000 7f12dd1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d8167790 con 0x7f12d8167310 2023-08-31T19:04:05.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.029+0000 7f12dd1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d8167a40 con 0x7f12c0004b80 2023-08-31T19:04:05.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.029+0000 7f12dd1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d8167d20 con 0x7f12d8153500 2023-08-31T19:04:05.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12d659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d8167310 0x7f12d8153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:05.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12d659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d8167310 0x7f12d8153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54114/0 (socket says 172.21.15.72:54114) 2023-08-31T19:04:05.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12d659c700 1 -- 172.21.15.72:0/4257090020 learned_addr learned my addr 172.21.15.72:0/4257090020 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:05.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12d6d9d700 1 --2- 172.21.15.72:0/4257090020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0004b80 0x7f12d814f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:05.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12d759e700 1 --2- 172.21.15.72:0/4257090020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12d8153500 0x7f12d81489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:05.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12d659c700 1 -- 172.21.15.72:0/4257090020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12d8153500 msgr2=0x7f12d81489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:05.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12d659c700 1 --2- 172.21.15.72:0/4257090020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12d8153500 0x7f12d81489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:05.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12d659c700 1 -- 172.21.15.72:0/4257090020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0004b80 msgr2=0x7f12d814f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:05.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12d659c700 1 --2- 172.21.15.72:0/4257090020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0004b80 0x7f12d814f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:05.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12d659c700 1 -- 172.21.15.72:0/4257090020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d8168000 con 0x7f12d8167310 2023-08-31T19:04:05.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12d759e700 1 --2- 172.21.15.72:0/4257090020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12d8153500 0x7f12d81489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:05.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12d659c700 1 --2- 172.21.15.72:0/4257090020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d8167310 0x7f12d8153010 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f12cc004a10 tx=0x7f12cc001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:05.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12beffd700 1 -- 172.21.15.72:0/4257090020 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc00f6c0 con 0x7f12d8167310 2023-08-31T19:04:05.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12beffd700 1 -- 172.21.15.72:0/4257090020 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc00f820 con 0x7f12d8167310 2023-08-31T19:04:05.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12beffd700 1 -- 172.21.15.72:0/4257090020 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc00fba0 con 0x7f12d8167310 2023-08-31T19:04:05.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.030+0000 7f12dd1ff700 1 -- 172.21.15.72:0/4257090020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d80af140 con 0x7f12d8167310 2023-08-31T19:04:05.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.031+0000 7f12dd1ff700 1 -- 172.21.15.72:0/4257090020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d80c2e40 con 0x7f12d8167310 2023-08-31T19:04:05.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.032+0000 7f12dd1ff700 1 -- 172.21.15.72:0/4257090020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d80aefa0 con 0x7f12d8167310 2023-08-31T19:04:05.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.033+0000 7f12beffd700 1 -- 172.21.15.72:0/4257090020 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f12cc01c360 con 0x7f12d8167310 2023-08-31T19:04:05.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.033+0000 7f12beffd700 1 --2- 172.21.15.72:0/4257090020 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f12c405ef30 0x7f12c40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:05.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.033+0000 7f12beffd700 1 -- 172.21.15.72:0/4257090020 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f12cc0798f0 con 0x7f12d8167310 2023-08-31T19:04:05.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.034+0000 7f12d6d9d700 1 --2- 172.21.15.72:0/4257090020 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f12c405ef30 0x7f12c40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:05.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.034+0000 7f12d6d9d700 1 --2- 172.21.15.72:0/4257090020 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f12c405ef30 0x7f12c40613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f12c8000f60 tx=0x7f12c8007b90).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:05.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.037+0000 7f12beffd700 1 -- 172.21.15.72:0/4257090020 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f12d80aefa0 con 0x7f12d8167310 2023-08-31T19:04:05.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:05.247+0000 7f12dd1ff700 1 -- 172.21.15.72:0/4257090020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f12d80aefa0 con 0x7f12d8167310 2023-08-31T19:04:06.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.010+0000 7f12beffd700 1 -- 172.21.15.72:0/4257090020 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7f12d80aefa0 con 0x7f12d8167310 2023-08-31T19:04:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.012+0000 7f12dd1ff700 1 -- 172.21.15.72:0/4257090020 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f12c405ef30 msgr2=0x7f12c40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.012+0000 7f12dd1ff700 1 --2- 172.21.15.72:0/4257090020 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f12c405ef30 0x7f12c40613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f12c8000f60 tx=0x7f12c8007b90).stop 2023-08-31T19:04:06.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.012+0000 7f12dd1ff700 1 -- 172.21.15.72:0/4257090020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d8167310 msgr2=0x7f12d8153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:06.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.012+0000 7f12dd1ff700 1 --2- 172.21.15.72:0/4257090020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d8167310 0x7f12d8153010 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f12cc004a10 tx=0x7f12cc001e70).stop 2023-08-31T19:04:06.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.012+0000 7f12dd1ff700 1 -- 172.21.15.72:0/4257090020 shutdown_connections 2023-08-31T19:04:06.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.012+0000 7f12dd1ff700 1 --2- 172.21.15.72:0/4257090020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12d8153500 0x7f12d81489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:06.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.012+0000 7f12dd1ff700 1 --2- 172.21.15.72:0/4257090020 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f12c405ef30 0x7f12c40613f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:06.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.012+0000 7f12dd1ff700 1 --2- 172.21.15.72:0/4257090020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12c0004b80 0x7f12d814f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:06.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.012+0000 7f12dd1ff700 1 --2- 172.21.15.72:0/4257090020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12d8167310 0x7f12d8153010 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:06.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.012+0000 7f12dd1ff700 1 -- 172.21.15.72:0/4257090020 >> 172.21.15.72:0/4257090020 conn(0x7f12d805eb60 msgr2=0x7f12d80ac450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:06.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.013+0000 7f12dd1ff700 1 -- 172.21.15.72:0/4257090020 shutdown_connections 2023-08-31T19:04:06.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.013+0000 7f12dd1ff700 1 -- 172.21.15.72:0/4257090020 wait complete. 2023-08-31T19:04:06.031 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-31T19:04:06.031 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T19:04:06.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.223+0000 7f0c70bff700 1 Processor -- start 2023-08-31T19:04:06.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.224+0000 7f0c70bff700 1 -- start start 2023-08-31T19:04:06.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.225+0000 7f0c70bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c6c0bdb30 0x7f0c6c1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:06.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.225+0000 7f0c70bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6c0a84b0 con 0x7f0c6c153ed0 2023-08-31T19:04:06.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.225+0000 7f0c70bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6c0c9410 con 0x7f0c6c0663d0 2023-08-31T19:04:06.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.225+0000 7f0c70bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0c5310 con 0x7f0c6c0bdb30 2023-08-31T19:04:06.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.225+0000 7f0c6a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0c6c153ed0 0x7f0c6c155200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37594/0 (socket says 172.21.15.72:37594) 2023-08-31T19:04:06.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.225+0000 7f0c6a59c700 1 -- 172.21.15.72:0/3533690340 learned_addr learned my addr 172.21.15.72:0/3533690340 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:06.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.225+0000 7f0c69d9b700 1 --2- 172.21.15.72:0/3533690340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c6c0bdb30 0x7f0c6c1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:06.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316297005 0 0) 0x7f0c6c0a84b0 con 0x7f0c6c153ed0 2023-08-31T19:04:06.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c540033f0 con 0x7f0c6c153ed0 2023-08-31T19:04:06.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820293987 0 0) 0x7f0c6c0c9410 con 0x7f0c6c0663d0 2023-08-31T19:04:06.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c6c0a84b0 con 0x7f0c6c0663d0 2023-08-31T19:04:06.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 565769286 0 0) 0x7f0c540033f0 con 0x7f0c6c153ed0 2023-08-31T19:04:06.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c6c0bdb30 msgr2=0x7f0c6c1542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:06.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 --2- 172.21.15.72:0/3533690340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c6c0bdb30 0x7f0c6c1542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:06.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 >> v1:172.21.15.146:6789/0 conn(0x7f0c6c0663d0 legacy=0x7f0c6c157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:06.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c0a7ef0 con 0x7f0c6c153ed0 2023-08-31T19:04:06.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f0c5c001470 con 0x7f0c6c153ed0 2023-08-31T19:04:06.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 >> v1:172.21.15.72:6789/0 conn(0x7f0c6c153ed0 legacy=0x7f0c6c155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:06.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 --2- 172.21.15.72:0/3533690340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c54003aa0 0x7f0c54003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:06.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 --2- 172.21.15.72:0/3533690340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c54004690 0x7f0c54004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:06.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 --2- 172.21.15.72:0/3533690340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c54005000 0x7f0c5400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:06.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0c5310 con 0x7f0c54003aa0 2023-08-31T19:04:06.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5400bdd0 con 0x7f0c54004690 2023-08-31T19:04:06.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5400bf40 con 0x7f0c54005000 2023-08-31T19:04:06.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6a59c700 1 --2- 172.21.15.72:0/3533690340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c54003aa0 0x7f0c54003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:06.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c69d9b700 1 --2- 172.21.15.72:0/3533690340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c54004690 0x7f0c54004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:06.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.226+0000 7f0c6ad9d700 1 --2- 172.21.15.72:0/3533690340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c54005000 0x7f0c5400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:06.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.227+0000 7f0c6a59c700 1 -- 172.21.15.72:0/3533690340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c54005000 msgr2=0x7f0c5400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:06.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.227+0000 7f0c6a59c700 1 --2- 172.21.15.72:0/3533690340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c54005000 0x7f0c5400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:06.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.227+0000 7f0c6a59c700 1 -- 172.21.15.72:0/3533690340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c54004690 msgr2=0x7f0c54004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:06.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.227+0000 7f0c6a59c700 1 --2- 172.21.15.72:0/3533690340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c54004690 0x7f0c54004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:06.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.227+0000 7f0c6a59c700 1 -- 172.21.15.72:0/3533690340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c540033f0 con 0x7f0c54003aa0 2023-08-31T19:04:06.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.227+0000 7f0c6ad9d700 1 --2- 172.21.15.72:0/3533690340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c54005000 0x7f0c5400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:06.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.227+0000 7f0c6a59c700 1 --2- 172.21.15.72:0/3533690340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c54003aa0 0x7f0c54003ea0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f0c5c00c190 tx=0x7f0c5c001e10).ready entity=mon.0 client_cookie=d4ef3757767b30b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:06.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.227+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c00ca00 con 0x7f0c54003aa0 2023-08-31T19:04:06.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.227+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5c00cb60 con 0x7f0c54003aa0 2023-08-31T19:04:06.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.227+0000 7f0c6959a700 1 -- 172.21.15.72:0/3533690340 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c0070d0 con 0x7f0c54003aa0 2023-08-31T19:04:06.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.228+0000 7f0c70bff700 1 -- 172.21.15.72:0/3533690340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c54003aa0 msgr2=0x7f0c54003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:06.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.228+0000 7f0c70bff700 1 --2- 172.21.15.72:0/3533690340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c54003aa0 0x7f0c54003ea0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f0c5c00c190 tx=0x7f0c5c001e10).stop 2023-08-31T19:04:06.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.228+0000 7f0c6ad9d700 1 -- 172.21.15.72:0/3533690340 reap_dead start 2023-08-31T19:04:06.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.228+0000 7f0c70bff700 1 -- 172.21.15.72:0/3533690340 shutdown_connections 2023-08-31T19:04:06.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.228+0000 7f0c70bff700 1 -- 172.21.15.72:0/3533690340 >> 172.21.15.72:0/3533690340 conn(0x7f0c6c05eb60 msgr2=0x7f0c6c0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:06.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.228+0000 7f0c70bff700 1 -- 172.21.15.72:0/3533690340 shutdown_connections 2023-08-31T19:04:06.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.228+0000 7f0c70bff700 1 -- 172.21.15.72:0/3533690340 wait complete. 2023-08-31T19:04:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.229+0000 7f0c70bff700 1 Processor -- start 2023-08-31T19:04:06.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.229+0000 7f0c70bff700 1 -- start start 2023-08-31T19:04:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.230+0000 7f0c70bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c54003aa0 0x7f0c6c157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.230+0000 7f0c70bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c6c0a9bb0 0x7f0c6c0aa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.230+0000 7f0c70bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6c0c8400 0x7f0c6c0c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.230+0000 7f0c70bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0ab380 con 0x7f0c6c0a9bb0 2023-08-31T19:04:06.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.230+0000 7f0c70bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0aa520 con 0x7f0c6c0c8400 2023-08-31T19:04:06.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.230+0000 7f0c70bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0c8d50 con 0x7f0c54003aa0 2023-08-31T19:04:06.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.230+0000 7f0c69d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c6c0a9bb0 0x7f0c6c0aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:06.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.230+0000 7f0c69d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c6c0a9bb0 0x7f0c6c0aa030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54128/0 (socket says 172.21.15.72:54128) 2023-08-31T19:04:06.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.231+0000 7f0c69d9b700 1 -- 172.21.15.72:0/3396283978 learned_addr learned my addr 172.21.15.72:0/3396283978 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:06.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.231+0000 7f0c6a59c700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c54003aa0 0x7f0c6c157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:06.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.231+0000 7f0c6ad9d700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6c0c8400 0x7f0c6c0c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:06.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.231+0000 7f0c69d9b700 1 -- 172.21.15.72:0/3396283978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c54003aa0 msgr2=0x7f0c6c157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:06.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.231+0000 7f0c69d9b700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c54003aa0 0x7f0c6c157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:06.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.231+0000 7f0c69d9b700 1 -- 172.21.15.72:0/3396283978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6c0c8400 msgr2=0x7f0c6c0c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:06.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.231+0000 7f0c69d9b700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6c0c8400 0x7f0c6c0c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:06.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.231+0000 7f0c69d9b700 1 -- 172.21.15.72:0/3396283978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c157760 con 0x7f0c6c0a9bb0 2023-08-31T19:04:06.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.231+0000 7f0c6ad9d700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6c0c8400 0x7f0c6c0c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:06.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.231+0000 7f0c6a59c700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c54003aa0 0x7f0c6c157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:06.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.231+0000 7f0c69d9b700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c6c0a9bb0 0x7f0c6c0aa030 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f0c60011a20 tx=0x7f0c60009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:06.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.231+0000 7f0c5a7fc700 1 -- 172.21.15.72:0/3396283978 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60009520 con 0x7f0c6c0a9bb0 2023-08-31T19:04:06.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.231+0000 7f0c5a7fc700 1 -- 172.21.15.72:0/3396283978 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6000f940 con 0x7f0c6c0a9bb0 2023-08-31T19:04:06.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.231+0000 7f0c70bff700 1 -- 172.21.15.72:0/3396283978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6c0aa770 con 0x7f0c6c0a9bb0 2023-08-31T19:04:06.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.231+0000 7f0c5a7fc700 1 -- 172.21.15.72:0/3396283978 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6000fcc0 con 0x7f0c6c0a9bb0 2023-08-31T19:04:06.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.232+0000 7f0c70bff700 1 -- 172.21.15.72:0/3396283978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6c0aad30 con 0x7f0c6c0a9bb0 2023-08-31T19:04:06.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.233+0000 7f0c70bff700 1 -- 172.21.15.72:0/3396283978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6c06c6b0 con 0x7f0c6c0a9bb0 2023-08-31T19:04:06.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.233+0000 7f0c5a7fc700 1 -- 172.21.15.72:0/3396283978 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0c60014650 con 0x7f0c6c0a9bb0 2023-08-31T19:04:06.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.234+0000 7f0c5a7fc700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0c4c05ef30 0x7f0c4c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:06.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.234+0000 7f0c5a7fc700 1 -- 172.21.15.72:0/3396283978 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f0c6007ac40 con 0x7f0c6c0a9bb0 2023-08-31T19:04:06.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.234+0000 7f0c6a59c700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0c4c05ef30 0x7f0c4c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:06.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.235+0000 7f0c6a59c700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0c4c05ef30 0x7f0c4c0613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0c5c001e70 tx=0x7f0c5c015000).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:06.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.239+0000 7f0c5a7fc700 1 -- 172.21.15.72:0/3396283978 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0c6004f640 con 0x7f0c6c0a9bb0 2023-08-31T19:04:06.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:06.452+0000 7f0c70bff700 1 -- 172.21.15.72:0/3396283978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0c6c067360 con 0x7f0c6c0a9bb0 2023-08-31T19:04:07.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.018+0000 7f0c5a7fc700 1 -- 172.21.15.72:0/3396283978 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0c60022070 con 0x7f0c6c0a9bb0 2023-08-31T19:04:07.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.020+0000 7f0c70bff700 1 -- 172.21.15.72:0/3396283978 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0c4c05ef30 msgr2=0x7f0c4c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:07.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.020+0000 7f0c70bff700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0c4c05ef30 0x7f0c4c0613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0c5c001e70 tx=0x7f0c5c015000).stop 2023-08-31T19:04:07.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.020+0000 7f0c70bff700 1 -- 172.21.15.72:0/3396283978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c6c0a9bb0 msgr2=0x7f0c6c0aa030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:07.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.020+0000 7f0c70bff700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c6c0a9bb0 0x7f0c6c0aa030 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f0c60011a20 tx=0x7f0c60009060).stop 2023-08-31T19:04:07.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.020+0000 7f0c70bff700 1 -- 172.21.15.72:0/3396283978 shutdown_connections 2023-08-31T19:04:07.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.020+0000 7f0c70bff700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0c4c05ef30 0x7f0c4c0613f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.020+0000 7f0c70bff700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6c0c8400 0x7f0c6c0c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.020+0000 7f0c70bff700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c54003aa0 0x7f0c6c157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.020+0000 7f0c70bff700 1 --2- 172.21.15.72:0/3396283978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c6c0a9bb0 0x7f0c6c0aa030 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.020+0000 7f0c70bff700 1 -- 172.21.15.72:0/3396283978 >> 172.21.15.72:0/3396283978 conn(0x7f0c6c05eb60 msgr2=0x7f0c6c0c6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:07.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.020+0000 7f0c70bff700 1 -- 172.21.15.72:0/3396283978 shutdown_connections 2023-08-31T19:04:07.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.021+0000 7f0c70bff700 1 -- 172.21.15.72:0/3396283978 wait complete. 2023-08-31T19:04:07.040 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T19:04:07.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:04:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.230+0000 7f3dfd9ff700 1 Processor -- start 2023-08-31T19:04:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.231+0000 7f3dfd9ff700 1 -- start start 2023-08-31T19:04:07.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.232+0000 7f3dfd9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8154060 0x7f3df8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:07.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.232+0000 7f3dfd9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3df80cb9b0 0x7f3df81581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:07.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.232+0000 7f3dfd9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3df81586b0 0x7f3df80c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:07.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.232+0000 7f3dfd9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df80c1380 con 0x7f3df81586b0 2023-08-31T19:04:07.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.232+0000 7f3dfd9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df8158b40 con 0x7f3df80cb9b0 2023-08-31T19:04:07.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.232+0000 7f3dfd9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80c6120 con 0x7f3df8154060 2023-08-31T19:04:07.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.232+0000 7f3df77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3df81586b0 0x7f3df80c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.232+0000 7f3df77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3df81586b0 0x7f3df80c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54144/0 (socket says 172.21.15.72:54144) 2023-08-31T19:04:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.232+0000 7f3df77fe700 1 -- 172.21.15.72:0/2841028820 learned_addr learned my addr 172.21.15.72:0/2841028820 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.232+0000 7f3df67fc700 1 --2- 172.21.15.72:0/2841028820 >> v2:172.21.15.146:3300/0 conn(0x7f3df80cb9b0 0x7f3df81581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.233+0000 7f3df77fe700 1 -- 172.21.15.72:0/2841028820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8154060 msgr2=0x7f3df8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:07.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.232+0000 7f3df6ffd700 1 --2- 172.21.15.72:0/2841028820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8154060 0x7f3df8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:07.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.233+0000 7f3df77fe700 1 --2- 172.21.15.72:0/2841028820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8154060 0x7f3df8157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.233+0000 7f3df77fe700 1 -- 172.21.15.72:0/2841028820 >> v2:172.21.15.146:3300/0 conn(0x7f3df80cb9b0 msgr2=0x7f3df81581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:07.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.233+0000 7f3df77fe700 1 --2- 172.21.15.72:0/2841028820 >> v2:172.21.15.146:3300/0 conn(0x7f3df80cb9b0 0x7f3df81581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.233+0000 7f3df77fe700 1 -- 172.21.15.72:0/2841028820 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df80c5e10 con 0x7f3df81586b0 2023-08-31T19:04:07.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.233+0000 7f3df67fc700 1 --2- 172.21.15.72:0/2841028820 >> v2:172.21.15.146:3300/0 conn(0x7f3df80cb9b0 0x7f3df81581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:07.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.233+0000 7f3df6ffd700 1 --2- 172.21.15.72:0/2841028820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8154060 0x7f3df8157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:07.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.233+0000 7f3df77fe700 1 --2- 172.21.15.72:0/2841028820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3df81586b0 0x7f3df80c65b0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f3df80c8840 tx=0x7f3df0009840).ready entity=mon.0 client_cookie=a589829e379952a9 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:07.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.233+0000 7f3df5ffb700 1 -- 172.21.15.72:0/2841028820 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df000e070 con 0x7f3df81586b0 2023-08-31T19:04:07.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.233+0000 7f3df5ffb700 1 -- 172.21.15.72:0/2841028820 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df000ba50 con 0x7f3df81586b0 2023-08-31T19:04:07.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.233+0000 7f3df5ffb700 1 -- 172.21.15.72:0/2841028820 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df000bdd0 con 0x7f3df81586b0 2023-08-31T19:04:07.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.233+0000 7f3dfd9ff700 1 -- 172.21.15.72:0/2841028820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3df81586b0 msgr2=0x7f3df80c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:07.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.233+0000 7f3dfd9ff700 1 --2- 172.21.15.72:0/2841028820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3df81586b0 0x7f3df80c65b0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f3df80c8840 tx=0x7f3df0009840).stop 2023-08-31T19:04:07.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.234+0000 7f3dfd9ff700 1 -- 172.21.15.72:0/2841028820 shutdown_connections 2023-08-31T19:04:07.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.234+0000 7f3dfd9ff700 1 --2- 172.21.15.72:0/2841028820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3df81586b0 0x7f3df80c65b0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.234+0000 7f3dfd9ff700 1 --2- 172.21.15.72:0/2841028820 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8154060 0x7f3df8157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.234+0000 7f3dfd9ff700 1 --2- 172.21.15.72:0/2841028820 >> v2:172.21.15.146:3300/0 conn(0x7f3df80cb9b0 0x7f3df81581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.234+0000 7f3dfd9ff700 1 -- 172.21.15.72:0/2841028820 >> 172.21.15.72:0/2841028820 conn(0x7f3df805e870 msgr2=0x7f3df80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:07.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.234+0000 7f3dfd9ff700 1 -- 172.21.15.72:0/2841028820 shutdown_connections 2023-08-31T19:04:07.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.234+0000 7f3dfd9ff700 1 -- 172.21.15.72:0/2841028820 wait complete. 2023-08-31T19:04:07.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.236+0000 7f3dfd9ff700 1 Processor -- start 2023-08-31T19:04:07.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.236+0000 7f3dfd9ff700 1 -- start start 2023-08-31T19:04:07.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.237+0000 7f3dfd9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df80cb9b0 0x7f3df8157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:07.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.237+0000 7f3dfd9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8154060 0x7f3df80c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:07.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.237+0000 7f3dfd9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3df81586b0 0x7f3df8144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:07.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.237+0000 7f3dfd9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df8156660 con 0x7f3df81586b0 2023-08-31T19:04:07.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.237+0000 7f3dfd9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df8156940 con 0x7f3df80cb9b0 2023-08-31T19:04:07.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.237+0000 7f3dfd9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df8156c20 con 0x7f3df8154060 2023-08-31T19:04:07.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.237+0000 7f3df77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3df81586b0 0x7f3df8144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:07.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.238+0000 7f3df77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3df81586b0 0x7f3df8144420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54148/0 (socket says 172.21.15.72:54148) 2023-08-31T19:04:07.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.238+0000 7f3df77fe700 1 -- 172.21.15.72:0/3414104975 learned_addr learned my addr 172.21.15.72:0/3414104975 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:07.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.238+0000 7f3df67fc700 1 --2- 172.21.15.72:0/3414104975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8154060 0x7f3df80c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:07.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.238+0000 7f3df6ffd700 1 --2- 172.21.15.72:0/3414104975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df80cb9b0 0x7f3df8157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:07.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.238+0000 7f3df77fe700 1 -- 172.21.15.72:0/3414104975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8154060 msgr2=0x7f3df80c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:07.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.238+0000 7f3df77fe700 1 --2- 172.21.15.72:0/3414104975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8154060 0x7f3df80c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.238+0000 7f3df77fe700 1 -- 172.21.15.72:0/3414104975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df80cb9b0 msgr2=0x7f3df8157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:07.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.238+0000 7f3df77fe700 1 --2- 172.21.15.72:0/3414104975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df80cb9b0 0x7f3df8157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.238+0000 7f3df77fe700 1 -- 172.21.15.72:0/3414104975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df0009ae0 con 0x7f3df81586b0 2023-08-31T19:04:07.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.238+0000 7f3df77fe700 1 --2- 172.21.15.72:0/3414104975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3df81586b0 0x7f3df8144420 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f3df0009fd0 tx=0x7f3df0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:07.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.238+0000 7f3ddeffd700 1 -- 172.21.15.72:0/3414104975 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0013e60 con 0x7f3df81586b0 2023-08-31T19:04:07.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.238+0000 7f3ddeffd700 1 -- 172.21.15.72:0/3414104975 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df0007610 con 0x7f3df81586b0 2023-08-31T19:04:07.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.238+0000 7f3dfd9ff700 1 -- 172.21.15.72:0/3414104975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df8156f00 con 0x7f3df81586b0 2023-08-31T19:04:07.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.238+0000 7f3ddeffd700 1 -- 172.21.15.72:0/3414104975 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00079b0 con 0x7f3df81586b0 2023-08-31T19:04:07.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.238+0000 7f3dfd9ff700 1 -- 172.21.15.72:0/3414104975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df8156310 con 0x7f3df81586b0 2023-08-31T19:04:07.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.240+0000 7f3dfd9ff700 1 -- 172.21.15.72:0/3414104975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df806c6b0 con 0x7f3df81586b0 2023-08-31T19:04:07.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.240+0000 7f3ddeffd700 1 -- 172.21.15.72:0/3414104975 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f3df0003040 con 0x7f3df81586b0 2023-08-31T19:04:07.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.242+0000 7f3ddeffd700 1 --2- 172.21.15.72:0/3414104975 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3de405ef30 0x7f3de40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:07.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.242+0000 7f3ddeffd700 1 -- 172.21.15.72:0/3414104975 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f3df007bdb0 con 0x7f3df81586b0 2023-08-31T19:04:07.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.242+0000 7f3df6ffd700 1 --2- 172.21.15.72:0/3414104975 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3de405ef30 0x7f3de40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:07.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.242+0000 7f3df6ffd700 1 --2- 172.21.15.72:0/3414104975 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3de405ef30 0x7f3de40613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3de800aa70 tx=0x7f3de8008040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:07.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.246+0000 7f3ddeffd700 1 -- 172.21.15.72:0/3414104975 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3df004ce40 con 0x7f3df81586b0 2023-08-31T19:04:07.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.455+0000 7f3dfd9ff700 1 -- 172.21.15.72:0/3414104975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3df80c0ae0 con 0x7f3df81586b0 2023-08-31T19:04:07.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.456+0000 7f3ddeffd700 1 -- 172.21.15.72:0/3414104975 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f3df0023030 con 0x7f3df81586b0 2023-08-31T19:04:07.456 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:07.457 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5732,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1777836817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1777836817},{"type":"v1","addr":"172.21.15.146:6834","nonce":1777836817}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5735,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1865290147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1865290147},{"type":"v1","addr":"172.21.15.146:6835","nonce":1865290147}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2552241481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2552241481},{"type":"v1","addr":"172.21.15.72:6836","nonce":2552241481}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:04:03.992354+0000","modified":"2023-08-31T19:04:07.010012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6699":{"gid":6699,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/859098343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":859098343},{"type":"v1","addr":"172.21.15.72:6837","nonce":859098343}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-31T19:04:07.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.458+0000 7f3dfd9ff700 1 -- 172.21.15.72:0/3414104975 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3de405ef30 msgr2=0x7f3de40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:07.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.458+0000 7f3dfd9ff700 1 --2- 172.21.15.72:0/3414104975 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3de405ef30 0x7f3de40613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3de800aa70 tx=0x7f3de8008040).stop 2023-08-31T19:04:07.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.458+0000 7f3dfd9ff700 1 -- 172.21.15.72:0/3414104975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3df81586b0 msgr2=0x7f3df8144420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:07.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.458+0000 7f3dfd9ff700 1 --2- 172.21.15.72:0/3414104975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3df81586b0 0x7f3df8144420 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f3df0009fd0 tx=0x7f3df0009840).stop 2023-08-31T19:04:07.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.458+0000 7f3dfd9ff700 1 -- 172.21.15.72:0/3414104975 shutdown_connections 2023-08-31T19:04:07.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.458+0000 7f3dfd9ff700 1 --2- 172.21.15.72:0/3414104975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3df81586b0 0x7f3df8144420 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.458+0000 7f3dfd9ff700 1 --2- 172.21.15.72:0/3414104975 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3de405ef30 0x7f3de40613f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.458+0000 7f3dfd9ff700 1 --2- 172.21.15.72:0/3414104975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df80cb9b0 0x7f3df8157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.458+0000 7f3dfd9ff700 1 --2- 172.21.15.72:0/3414104975 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3df8154060 0x7f3df80c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.458+0000 7f3dfd9ff700 1 -- 172.21.15.72:0/3414104975 >> 172.21.15.72:0/3414104975 conn(0x7f3df805e870 msgr2=0x7f3df80c7210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:07.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.458+0000 7f3dfd9ff700 1 -- 172.21.15.72:0/3414104975 shutdown_connections 2023-08-31T19:04:07.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.458+0000 7f3dfd9ff700 1 -- 172.21.15.72:0/3414104975 wait complete. 2023-08-31T19:04:07.461 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 40 2023-08-31T19:04:07.476 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:04:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.664+0000 7f17ce3ff700 1 Processor -- start 2023-08-31T19:04:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.665+0000 7f17ce3ff700 1 -- start start 2023-08-31T19:04:07.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.666+0000 7f17ce3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17c80bea80 0x7f17c80c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:07.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.666+0000 7f17ce3ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f17c80c44a0 0x7f17c8063a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:07.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.666+0000 7f17ce3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c80c4950 con 0x7f17c80c5fb0 2023-08-31T19:04:07.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.666+0000 7f17ce3ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c8154690 con 0x7f17c80c44a0 2023-08-31T19:04:07.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.666+0000 7f17ce3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c80bfb20 con 0x7f17c80bea80 2023-08-31T19:04:07.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.666+0000 7f17c7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f17c80c5fb0 0x7f17c80be370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37608/0 (socket says 172.21.15.72:37608) 2023-08-31T19:04:07.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.666+0000 7f17c7fff700 1 -- 172.21.15.72:0/1797608973 learned_addr learned my addr 172.21.15.72:0/1797608973 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:07.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.667+0000 7f17c77fe700 1 --2- 172.21.15.72:0/1797608973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17c80bea80 0x7f17c80c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:07.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.667+0000 7f17cc99c700 1 --2- 172.21.15.72:0/1797608973 >> v2:172.21.15.146:3300/0 conn(0x7f17c80c44a0 0x7f17c8063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:07.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.667+0000 7f17c6ffd700 1 -- 172.21.15.72:0/1797608973 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065833248 0 0) 0x7f17b8001290 con 0x7f17c80c5fb0 2023-08-31T19:04:07.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.667+0000 7f17c6ffd700 1 -- 172.21.15.72:0/1797608973 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17b00033f0 con 0x7f17c80c5fb0 2023-08-31T19:04:07.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.667+0000 7f17c77fe700 1 -- 172.21.15.72:0/1797608973 >> v2:172.21.15.146:3300/0 conn(0x7f17c80c44a0 msgr2=0x7f17c8063a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.667+0000 7f17c77fe700 1 --2- 172.21.15.72:0/1797608973 >> v2:172.21.15.146:3300/0 conn(0x7f17c80c44a0 0x7f17c8063a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.667+0000 7f17c77fe700 1 -- 172.21.15.72:0/1797608973 >> v1:172.21.15.72:6789/0 conn(0x7f17c80c5fb0 legacy=0x7f17c80be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.667+0000 7f17c6ffd700 1 -- 172.21.15.72:0/1797608973 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3821517999 0 0) 0x7f17b00033f0 con 0x7f17c80c5fb0 2023-08-31T19:04:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.667+0000 7f17c77fe700 1 -- 172.21.15.72:0/1797608973 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c80bef10 con 0x7f17c80bea80 2023-08-31T19:04:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.667+0000 7f17cc99c700 1 --2- 172.21.15.72:0/1797608973 >> v2:172.21.15.146:3300/0 conn(0x7f17c80c44a0 0x7f17c8063a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:04:07.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.667+0000 7f17c77fe700 1 --2- 172.21.15.72:0/1797608973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17c80bea80 0x7f17c80c3fb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f17bc009760 tx=0x7f17bc009060).ready entity=mon.2 client_cookie=2d31ce410cf19372 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:07.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.668+0000 7f17c6ffd700 1 -- 172.21.15.72:0/1797608973 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8001780 con 0x7f17c80bea80 2023-08-31T19:04:07.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.668+0000 7f17c6ffd700 1 -- 172.21.15.72:0/1797608973 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc011400 con 0x7f17c80bea80 2023-08-31T19:04:07.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.668+0000 7f17c6ffd700 1 -- 172.21.15.72:0/1797608973 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc011780 con 0x7f17c80bea80 2023-08-31T19:04:07.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.668+0000 7f17ce3ff700 1 -- 172.21.15.72:0/1797608973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17c80bea80 msgr2=0x7f17c80c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:07.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.668+0000 7f17ce3ff700 1 --2- 172.21.15.72:0/1797608973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17c80bea80 0x7f17c80c3fb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f17bc009760 tx=0x7f17bc009060).stop 2023-08-31T19:04:07.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.669+0000 7f17ce3ff700 1 -- 172.21.15.72:0/1797608973 shutdown_connections 2023-08-31T19:04:07.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.669+0000 7f17ce3ff700 1 --2- 172.21.15.72:0/1797608973 >> v2:172.21.15.146:3300/0 conn(0x7f17c80c44a0 0x7f17c8063a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.669+0000 7f17ce3ff700 1 --2- 172.21.15.72:0/1797608973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17c80bea80 0x7f17c80c3fb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.669+0000 7f17ce3ff700 1 -- 172.21.15.72:0/1797608973 >> 172.21.15.72:0/1797608973 conn(0x7f17c8082f60 msgr2=0x7f17c805e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:07.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.669+0000 7f17ce3ff700 1 -- 172.21.15.72:0/1797608973 shutdown_connections 2023-08-31T19:04:07.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.669+0000 7f17ce3ff700 1 -- 172.21.15.72:0/1797608973 wait complete. 2023-08-31T19:04:07.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.670+0000 7f17ce3ff700 1 Processor -- start 2023-08-31T19:04:07.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.670+0000 7f17ce3ff700 1 -- start start 2023-08-31T19:04:07.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.671+0000 7f17ce3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17c80c44a0 0x7f17c80bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:07.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.671+0000 7f17ce3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c80c5fb0 0x7f17c80a8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:07.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.671+0000 7f17ce3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17c80a93f0 0x7f17c80a9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:07.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.671+0000 7f17ce3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c80ad530 con 0x7f17c80c5fb0 2023-08-31T19:04:07.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.671+0000 7f17ce3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c80ae2e0 con 0x7f17c80a93f0 2023-08-31T19:04:07.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.671+0000 7f17ce3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c80ad710 con 0x7f17c80c44a0 2023-08-31T19:04:07.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.671+0000 7f17c77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c80c5fb0 0x7f17c80a8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:07.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.671+0000 7f17c77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c80c5fb0 0x7f17c80a8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54164/0 (socket says 172.21.15.72:54164) 2023-08-31T19:04:07.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.671+0000 7f17c77fe700 1 -- 172.21.15.72:0/1638886569 learned_addr learned my addr 172.21.15.72:0/1638886569 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:07.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.672+0000 7f17cc99c700 1 --2- 172.21.15.72:0/1638886569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17c80a93f0 0x7f17c80a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:07.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.672+0000 7f17c7fff700 1 --2- 172.21.15.72:0/1638886569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17c80c44a0 0x7f17c80bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:07.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.672+0000 7f17c77fe700 1 -- 172.21.15.72:0/1638886569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17c80c44a0 msgr2=0x7f17c80bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.672+0000 7f17c77fe700 1 --2- 172.21.15.72:0/1638886569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17c80c44a0 0x7f17c80bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.672+0000 7f17c77fe700 1 -- 172.21.15.72:0/1638886569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17c80a93f0 msgr2=0x7f17c80a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.672+0000 7f17c77fe700 1 --2- 172.21.15.72:0/1638886569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17c80a93f0 0x7f17c80a9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.672+0000 7f17c77fe700 1 -- 172.21.15.72:0/1638886569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0009a20 con 0x7f17c80c5fb0 2023-08-31T19:04:07.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.672+0000 7f17c77fe700 1 --2- 172.21.15.72:0/1638886569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c80c5fb0 0x7f17c80a8f00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f17c80c3480 tx=0x7f17bc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:07.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.672+0000 7f17affff700 1 -- 172.21.15.72:0/1638886569 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc010870 con 0x7f17c80c5fb0 2023-08-31T19:04:07.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.672+0000 7f17affff700 1 -- 172.21.15.72:0/1638886569 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc0109d0 con 0x7f17c80c5fb0 2023-08-31T19:04:07.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.672+0000 7f17ce3ff700 1 -- 172.21.15.72:0/1638886569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17bc0092a0 con 0x7f17c80c5fb0 2023-08-31T19:04:07.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.672+0000 7f17affff700 1 -- 172.21.15.72:0/1638886569 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc010d90 con 0x7f17c80c5fb0 2023-08-31T19:04:07.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.672+0000 7f17ce3ff700 1 -- 172.21.15.72:0/1638886569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c80adc90 con 0x7f17c80c5fb0 2023-08-31T19:04:07.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.674+0000 7f17ce3ff700 1 -- 172.21.15.72:0/1638886569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c80ae450 con 0x7f17c80c5fb0 2023-08-31T19:04:07.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.674+0000 7f17affff700 1 -- 172.21.15.72:0/1638886569 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f17bc01d640 con 0x7f17c80c5fb0 2023-08-31T19:04:07.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.675+0000 7f17affff700 1 --2- 172.21.15.72:0/1638886569 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f17b405ef30 0x7f17b40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:07.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.675+0000 7f17affff700 1 -- 172.21.15.72:0/1638886569 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f17bc07b7a0 con 0x7f17c80c5fb0 2023-08-31T19:04:07.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.675+0000 7f17c7fff700 1 --2- 172.21.15.72:0/1638886569 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f17b405ef30 0x7f17b40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:07.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.676+0000 7f17c7fff700 1 --2- 172.21.15.72:0/1638886569 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f17b405ef30 0x7f17b40613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f17b80079b0 tx=0x7f17b8009040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:07.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.679+0000 7f17affff700 1 -- 172.21.15.72:0/1638886569 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f17bc04c830 con 0x7f17c80c5fb0 2023-08-31T19:04:07.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.848+0000 7f17ce3ff700 1 -- 172.21.15.72:0/1638886569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17c806c6b0 con 0x7f17c80c5fb0 2023-08-31T19:04:07.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.849+0000 7f17affff700 1 -- 172.21.15.72:0/1638886569 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+17934 (secure 0 0 0) 0x7f17bc04fe50 con 0x7f17c80c5fb0 2023-08-31T19:04:07.850 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:07.850 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":94,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:04:04.994761+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:04:02.410352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-31T19:04:02.966343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:04:07.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.852+0000 7f17ce3ff700 1 -- 172.21.15.72:0/1638886569 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f17b405ef30 msgr2=0x7f17b40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:07.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.852+0000 7f17ce3ff700 1 --2- 172.21.15.72:0/1638886569 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f17b405ef30 0x7f17b40613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f17b80079b0 tx=0x7f17b8009040).stop 2023-08-31T19:04:07.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.852+0000 7f17ce3ff700 1 -- 172.21.15.72:0/1638886569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c80c5fb0 msgr2=0x7f17c80a8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:07.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.852+0000 7f17ce3ff700 1 --2- 172.21.15.72:0/1638886569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c80c5fb0 0x7f17c80a8f00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f17c80c3480 tx=0x7f17bc016000).stop 2023-08-31T19:04:07.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.852+0000 7f17ce3ff700 1 -- 172.21.15.72:0/1638886569 shutdown_connections 2023-08-31T19:04:07.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.852+0000 7f17ce3ff700 1 --2- 172.21.15.72:0/1638886569 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f17b405ef30 0x7f17b40613f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.852+0000 7f17ce3ff700 1 --2- 172.21.15.72:0/1638886569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17c80a93f0 0x7f17c80a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.852+0000 7f17ce3ff700 1 --2- 172.21.15.72:0/1638886569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17c80c44a0 0x7f17c80bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.852+0000 7f17ce3ff700 1 --2- 172.21.15.72:0/1638886569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c80c5fb0 0x7f17c80a8f00 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:07.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.852+0000 7f17ce3ff700 1 -- 172.21.15.72:0/1638886569 >> 172.21.15.72:0/1638886569 conn(0x7f17c8082f60 msgr2=0x7f17c80c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:07.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.852+0000 7f17ce3ff700 1 -- 172.21.15.72:0/1638886569 shutdown_connections 2023-08-31T19:04:07.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:07.852+0000 7f17ce3ff700 1 -- 172.21.15.72:0/1638886569 wait complete. 2023-08-31T19:04:07.869 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T19:04:07.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:04:08.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.059+0000 7f2be3dff700 1 Processor -- start 2023-08-31T19:04:08.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.059+0000 7f2be3dff700 1 -- start start 2023-08-31T19:04:08.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.060+0000 7f2be3dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2bdc154060 0x7f2bdc157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.060+0000 7f2be3dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2bdc0cb9b0 0x7f2bdc1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.060+0000 7f2be3dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bdc0c6120 con 0x7f2bdc1586b0 2023-08-31T19:04:08.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.060+0000 7f2be3dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc0c1380 con 0x7f2bdc154060 2023-08-31T19:04:08.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.060+0000 7f2be3dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc0c5e10 con 0x7f2bdc0cb9b0 2023-08-31T19:04:08.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.061+0000 7f2be1b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2bdc154060 0x7f2bdc157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.061+0000 7f2be1b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2bdc154060 0x7f2bdc157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54176/0 (socket says 172.21.15.72:54176) 2023-08-31T19:04:08.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.061+0000 7f2be239c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2bdc1586b0 0x7f2bdc0c65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37612/0 (socket says 172.21.15.72:37612) 2023-08-31T19:04:08.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.061+0000 7f2be1b9b700 1 -- 172.21.15.72:0/485046938 learned_addr learned my addr 172.21.15.72:0/485046938 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:08.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.061+0000 7f2be139a700 1 --2- 172.21.15.72:0/485046938 >> v2:172.21.15.146:3300/0 conn(0x7f2bdc0cb9b0 0x7f2bdc1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.061+0000 7f2be1b9b700 1 -- 172.21.15.72:0/485046938 >> v2:172.21.15.146:3300/0 conn(0x7f2bdc0cb9b0 msgr2=0x7f2bdc1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:08.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.061+0000 7f2be1b9b700 1 --2- 172.21.15.72:0/485046938 >> v2:172.21.15.146:3300/0 conn(0x7f2bdc0cb9b0 0x7f2bdc1581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.061+0000 7f2be1b9b700 1 -- 172.21.15.72:0/485046938 >> v1:172.21.15.72:6789/0 conn(0x7f2bdc1586b0 legacy=0x7f2bdc0c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.061+0000 7f2be1b9b700 1 -- 172.21.15.72:0/485046938 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc158b00 con 0x7f2bdc154060 2023-08-31T19:04:08.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.061+0000 7f2be1b9b700 1 --2- 172.21.15.72:0/485046938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bdc154060 0x7f2bdc157cd0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f2bdc083190 tx=0x7f2bd80090f0).ready entity=mon.0 client_cookie=9058106349da06de server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:08.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.062+0000 7f2be0b99700 1 -- 172.21.15.72:0/485046938 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd800b600 con 0x7f2bdc154060 2023-08-31T19:04:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.062+0000 7f2be0b99700 1 -- 172.21.15.72:0/485046938 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd800b760 con 0x7f2bdc154060 2023-08-31T19:04:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.062+0000 7f2be0b99700 1 -- 172.21.15.72:0/485046938 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd800bae0 con 0x7f2bdc154060 2023-08-31T19:04:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.062+0000 7f2be3dff700 1 -- 172.21.15.72:0/485046938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bdc154060 msgr2=0x7f2bdc157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.062+0000 7f2be3dff700 1 --2- 172.21.15.72:0/485046938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bdc154060 0x7f2bdc157cd0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f2bdc083190 tx=0x7f2bd80090f0).stop 2023-08-31T19:04:08.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.062+0000 7f2be3dff700 1 -- 172.21.15.72:0/485046938 shutdown_connections 2023-08-31T19:04:08.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.062+0000 7f2be3dff700 1 --2- 172.21.15.72:0/485046938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bdc154060 0x7f2bdc157cd0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.062+0000 7f2be3dff700 1 --2- 172.21.15.72:0/485046938 >> v2:172.21.15.146:3300/0 conn(0x7f2bdc0cb9b0 0x7f2bdc1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.062+0000 7f2be3dff700 1 -- 172.21.15.72:0/485046938 >> 172.21.15.72:0/485046938 conn(0x7f2bdc05e870 msgr2=0x7f2bdc0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:08.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.062+0000 7f2be3dff700 1 -- 172.21.15.72:0/485046938 shutdown_connections 2023-08-31T19:04:08.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.062+0000 7f2be3dff700 1 -- 172.21.15.72:0/485046938 wait complete. 2023-08-31T19:04:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.064+0000 7f2be3dff700 1 Processor -- start 2023-08-31T19:04:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.064+0000 7f2be3dff700 1 -- start start 2023-08-31T19:04:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.065+0000 7f2be3dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bdc0cb9b0 0x7f2bdc1516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.065+0000 7f2be3dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bdc154060 0x7f2bdc156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.065+0000 7f2be3dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bdc1586b0 0x7f2bdc0ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.065+0000 7f2be3dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc151be0 con 0x7f2bdc0cb9b0 2023-08-31T19:04:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.065+0000 7f2be3dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc1577c0 con 0x7f2bdc1586b0 2023-08-31T19:04:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.065+0000 7f2be3dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc156bb0 con 0x7f2bdc154060 2023-08-31T19:04:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.065+0000 7f2be1b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bdc0cb9b0 0x7f2bdc1516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.065+0000 7f2be1b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bdc0cb9b0 0x7f2bdc1516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54180/0 (socket says 172.21.15.72:54180) 2023-08-31T19:04:08.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.065+0000 7f2be1b9b700 1 -- 172.21.15.72:0/2097851656 learned_addr learned my addr 172.21.15.72:0/2097851656 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:08.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.065+0000 7f2be139a700 1 --2- 172.21.15.72:0/2097851656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bdc154060 0x7f2bdc156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.065+0000 7f2be239c700 1 --2- 172.21.15.72:0/2097851656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bdc1586b0 0x7f2bdc0ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.066+0000 7f2be1b9b700 1 -- 172.21.15.72:0/2097851656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bdc154060 msgr2=0x7f2bdc156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.066+0000 7f2be1b9b700 1 --2- 172.21.15.72:0/2097851656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bdc154060 0x7f2bdc156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.066+0000 7f2be1b9b700 1 -- 172.21.15.72:0/2097851656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bdc1586b0 msgr2=0x7f2bdc0ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.066+0000 7f2be1b9b700 1 --2- 172.21.15.72:0/2097851656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bdc1586b0 0x7f2bdc0ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.066+0000 7f2be1b9b700 1 -- 172.21.15.72:0/2097851656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd8009310 con 0x7f2bdc0cb9b0 2023-08-31T19:04:08.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.066+0000 7f2be1b9b700 1 --2- 172.21.15.72:0/2097851656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bdc0cb9b0 0x7f2bdc1516f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f2bdc083570 tx=0x7f2bd8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:08.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.066+0000 7f2bd1ffb700 1 -- 172.21.15.72:0/2097851656 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd800b8d0 con 0x7f2bdc0cb9b0 2023-08-31T19:04:08.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.066+0000 7f2bd1ffb700 1 -- 172.21.15.72:0/2097851656 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd800ba70 con 0x7f2bdc0cb9b0 2023-08-31T19:04:08.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.066+0000 7f2be3dff700 1 -- 172.21.15.72:0/2097851656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc156e90 con 0x7f2bdc0cb9b0 2023-08-31T19:04:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.066+0000 7f2bd1ffb700 1 -- 172.21.15.72:0/2097851656 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd801c670 con 0x7f2bdc0cb9b0 2023-08-31T19:04:08.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.066+0000 7f2be3dff700 1 -- 172.21.15.72:0/2097851656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc157450 con 0x7f2bdc0cb9b0 2023-08-31T19:04:08.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.067+0000 7f2be3dff700 1 -- 172.21.15.72:0/2097851656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc06c6b0 con 0x7f2bdc0cb9b0 2023-08-31T19:04:08.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.068+0000 7f2bd1ffb700 1 -- 172.21.15.72:0/2097851656 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2bd801c9e0 con 0x7f2bdc0cb9b0 2023-08-31T19:04:08.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.069+0000 7f2bd1ffb700 1 --2- 172.21.15.72:0/2097851656 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2bc005ef30 0x7f2bc00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.069+0000 7f2bd1ffb700 1 -- 172.21.15.72:0/2097851656 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f2bd807bfe0 con 0x7f2bdc0cb9b0 2023-08-31T19:04:08.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.069+0000 7f2be139a700 1 --2- 172.21.15.72:0/2097851656 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2bc005ef30 0x7f2bc00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.070+0000 7f2be139a700 1 --2- 172.21.15.72:0/2097851656 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2bc005ef30 0x7f2bc00613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2bdc064410 tx=0x7f2bcc008040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:08.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.073+0000 7f2bd1ffb700 1 -- 172.21.15.72:0/2097851656 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2bd804d070 con 0x7f2bdc0cb9b0 2023-08-31T19:04:08.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.238+0000 7f2be3dff700 1 -- 172.21.15.72:0/2097851656 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2bdc157aa0 con 0x7f2bc005ef30 2023-08-31T19:04:08.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.250+0000 7f2bd1ffb700 1 -- 172.21.15.72:0/2097851656 <== mgr.6501 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+357029 (secure 0 0 0) 0x7f2bcc00b700 con 0x7f2bc005ef30 2023-08-31T19:04:08.252 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:08.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.255+0000 7f2be3dff700 1 -- 172.21.15.72:0/2097851656 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2bc005ef30 msgr2=0x7f2bc00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.255+0000 7f2be3dff700 1 --2- 172.21.15.72:0/2097851656 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2bc005ef30 0x7f2bc00613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f2bdc064410 tx=0x7f2bcc008040).stop 2023-08-31T19:04:08.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.255+0000 7f2be3dff700 1 -- 172.21.15.72:0/2097851656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bdc0cb9b0 msgr2=0x7f2bdc1516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.255+0000 7f2be3dff700 1 --2- 172.21.15.72:0/2097851656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bdc0cb9b0 0x7f2bdc1516f0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f2bdc083570 tx=0x7f2bd8017000).stop 2023-08-31T19:04:08.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.256+0000 7f2be3dff700 1 -- 172.21.15.72:0/2097851656 shutdown_connections 2023-08-31T19:04:08.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.256+0000 7f2be3dff700 1 --2- 172.21.15.72:0/2097851656 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2bc005ef30 0x7f2bc00613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.256+0000 7f2be3dff700 1 --2- 172.21.15.72:0/2097851656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bdc1586b0 0x7f2bdc0ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.256+0000 7f2be3dff700 1 --2- 172.21.15.72:0/2097851656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bdc0cb9b0 0x7f2bdc1516f0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.256+0000 7f2be3dff700 1 --2- 172.21.15.72:0/2097851656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2bdc154060 0x7f2bdc156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.256+0000 7f2be3dff700 1 -- 172.21.15.72:0/2097851656 >> 172.21.15.72:0/2097851656 conn(0x7f2bdc05e870 msgr2=0x7f2bdc0637f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:08.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.256+0000 7f2be3dff700 1 -- 172.21.15.72:0/2097851656 shutdown_connections 2023-08-31T19:04:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.256+0000 7f2be3dff700 1 -- 172.21.15.72:0/2097851656 wait complete. 2023-08-31T19:04:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:04:08.274 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-31T19:04:06.255370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":748,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418344,"kb_used_data":8808,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752556376,"statfs":{"total":773094113280,"available":770617729024,"internally_reserved":0,"allocated":9019392,"data_stored":4653397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11231,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.994492"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.029854+0000","last_change":"2023-08-31T19:04:04.026679+0000","last_active":"2023-08-31T19:04:04.029854+0000","last_peered":"2023-08-31T19:04:04.029854+0000","last_clean":"2023-08-31T19:04:04.029854+0000","last_became_active":"2023-08-31T19:04:04.026200+0000","last_became_peered":"2023-08-31T19:04:04.026200+0000","last_unstale":"2023-08-31T19:04:04.029854+0000","last_undegraded":"2023-08-31T19:04:04.029854+0000","last_fullsized":"2023-08-31T19:04:04.029854+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.998705+0000","last_change":"2023-08-31T19:04:03.553387+0000","last_active":"2023-08-31T19:04:03.998705+0000","last_peered":"2023-08-31T19:04:03.998705+0000","last_clean":"2023-08-31T19:04:03.998705+0000","last_became_active":"2023-08-31T19:04:03.553087+0000","last_became_peered":"2023-08-31T19:04:03.553087+0000","last_unstale":"2023-08-31T19:04:03.998705+0000","last_undegraded":"2023-08-31T19:04:03.998705+0000","last_fullsized":"2023-08-31T19:04:03.998705+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030884+0000","last_change":"2023-08-31T19:04:04.026510+0000","last_active":"2023-08-31T19:04:04.030884+0000","last_peered":"2023-08-31T19:04:04.030884+0000","last_clean":"2023-08-31T19:04:04.030884+0000","last_became_active":"2023-08-31T19:04:04.025804+0000","last_became_peered":"2023-08-31T19:04:04.025804+0000","last_unstale":"2023-08-31T19:04:04.030884+0000","last_undegraded":"2023-08-31T19:04:04.030884+0000","last_fullsized":"2023-08-31T19:04:04.030884+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.006006+0000","last_change":"2023-08-31T19:04:03.550392+0000","last_active":"2023-08-31T19:04:04.006006+0000","last_peered":"2023-08-31T19:04:04.006006+0000","last_clean":"2023-08-31T19:04:04.006006+0000","last_became_active":"2023-08-31T19:04:03.550066+0000","last_became_peered":"2023-08-31T19:04:03.550066+0000","last_unstale":"2023-08-31T19:04:04.006006+0000","last_undegraded":"2023-08-31T19:04:04.006006+0000","last_fullsized":"2023-08-31T19:04:04.006006+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.020930+0000","last_change":"2023-08-31T19:04:04.016510+0000","last_active":"2023-08-31T19:04:04.020930+0000","last_peered":"2023-08-31T19:04:04.020930+0000","last_clean":"2023-08-31T19:04:04.020930+0000","last_became_active":"2023-08-31T19:04:04.016162+0000","last_became_peered":"2023-08-31T19:04:04.016162+0000","last_unstale":"2023-08-31T19:04:04.020930+0000","last_undegraded":"2023-08-31T19:04:04.020930+0000","last_fullsized":"2023-08-31T19:04:04.020930+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.020572+0000","last_change":"2023-08-31T19:04:03.548919+0000","last_active":"2023-08-31T19:04:04.020572+0000","last_peered":"2023-08-31T19:04:04.020572+0000","last_clean":"2023-08-31T19:04:04.020572+0000","last_became_active":"2023-08-31T19:04:03.548556+0000","last_became_peered":"2023-08-31T19:04:03.548556+0000","last_unstale":"2023-08-31T19:04:04.020572+0000","last_undegraded":"2023-08-31T19:04:04.020572+0000","last_fullsized":"2023-08-31T19:04:04.020572+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.032201+0000","last_change":"2023-08-31T19:04:04.032201+0000","last_active":"2023-08-31T19:04:04.032201+0000","last_peered":"2023-08-31T19:04:04.032201+0000","last_clean":"2023-08-31T19:04:04.032201+0000","last_became_active":"2023-08-31T19:04:04.031884+0000","last_became_peered":"2023-08-31T19:04:04.031884+0000","last_unstale":"2023-08-31T19:04:04.032201+0000","last_undegraded":"2023-08-31T19:04:04.032201+0000","last_fullsized":"2023-08-31T19:04:04.032201+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007571+0000","last_change":"2023-08-31T19:04:03.549829+0000","last_active":"2023-08-31T19:04:04.007571+0000","last_peered":"2023-08-31T19:04:04.007571+0000","last_clean":"2023-08-31T19:04:04.007571+0000","last_became_active":"2023-08-31T19:04:03.549240+0000","last_became_peered":"2023-08-31T19:04:03.549240+0000","last_unstale":"2023-08-31T19:04:04.007571+0000","last_undegraded":"2023-08-31T19:04:04.007571+0000","last_fullsized":"2023-08-31T19:04:04.007571+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.997893+0000","last_change":"2023-08-31T19:04:03.550215+0000","last_active":"2023-08-31T19:04:03.997893+0000","last_peered":"2023-08-31T19:04:03.997893+0000","last_clean":"2023-08-31T19:04:03.997893+0000","last_became_active":"2023-08-31T19:04:03.549869+0000","last_became_peered":"2023-08-31T19:04:03.549869+0000","last_unstale":"2023-08-31T19:04:03.997893+0000","last_undegraded":"2023-08-31T19:04:03.997893+0000","last_fullsized":"2023-08-31T19:04:03.997893+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.015962+0000","last_change":"2023-08-31T19:04:04.015962+0000","last_active":"2023-08-31T19:04:04.015962+0000","last_peered":"2023-08-31T19:04:04.015962+0000","last_clean":"2023-08-31T19:04:04.015962+0000","last_became_active":"2023-08-31T19:04:04.015723+0000","last_became_peered":"2023-08-31T19:04:04.015723+0000","last_unstale":"2023-08-31T19:04:04.015962+0000","last_undegraded":"2023-08-31T19:04:04.015962+0000","last_fullsized":"2023-08-31T19:04:04.015962+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.010781+0000","last_change":"2023-08-31T19:04:03.556543+0000","last_active":"2023-08-31T19:04:04.010781+0000","last_peered":"2023-08-31T19:04:04.010781+0000","last_clean":"2023-08-31T19:04:04.010781+0000","last_became_active":"2023-08-31T19:04:03.555895+0000","last_became_peered":"2023-08-31T19:04:03.555895+0000","last_unstale":"2023-08-31T19:04:04.010781+0000","last_undegraded":"2023-08-31T19:04:04.010781+0000","last_fullsized":"2023-08-31T19:04:04.010781+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030865+0000","last_change":"2023-08-31T19:04:04.026343+0000","last_active":"2023-08-31T19:04:04.030865+0000","last_peered":"2023-08-31T19:04:04.030865+0000","last_clean":"2023-08-31T19:04:04.030865+0000","last_became_active":"2023-08-31T19:04:04.025670+0000","last_became_peered":"2023-08-31T19:04:04.025670+0000","last_unstale":"2023-08-31T19:04:04.030865+0000","last_undegraded":"2023-08-31T19:04:04.030865+0000","last_fullsized":"2023-08-31T19:04:04.030865+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.022057+0000","last_change":"2023-08-31T19:04:04.018453+0000","last_active":"2023-08-31T19:04:04.022057+0000","last_peered":"2023-08-31T19:04:04.022057+0000","last_clean":"2023-08-31T19:04:04.022057+0000","last_became_active":"2023-08-31T19:04:04.018135+0000","last_became_peered":"2023-08-31T19:04:04.018135+0000","last_unstale":"2023-08-31T19:04:04.022057+0000","last_undegraded":"2023-08-31T19:04:04.022057+0000","last_fullsized":"2023-08-31T19:04:04.022057+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"93'1","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.000750+0000","last_change":"2023-08-31T19:04:03.543084+0000","last_active":"2023-08-31T19:04:04.000750+0000","last_peered":"2023-08-31T19:04:04.000750+0000","last_clean":"2023-08-31T19:04:04.000750+0000","last_became_active":"2023-08-31T19:04:03.542751+0000","last_became_peered":"2023-08-31T19:04:03.542751+0000","last_unstale":"2023-08-31T19:04:04.000750+0000","last_undegraded":"2023-08-31T19:04:04.000750+0000","last_fullsized":"2023-08-31T19:04:04.000750+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.032238+0000","last_change":"2023-08-31T19:04:04.032238+0000","last_active":"2023-08-31T19:04:04.032238+0000","last_peered":"2023-08-31T19:04:04.032238+0000","last_clean":"2023-08-31T19:04:04.032238+0000","last_became_active":"2023-08-31T19:04:04.031939+0000","last_became_peered":"2023-08-31T19:04:04.031939+0000","last_unstale":"2023-08-31T19:04:04.032238+0000","last_undegraded":"2023-08-31T19:04:04.032238+0000","last_fullsized":"2023-08-31T19:04:04.032238+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.022305+0000","last_change":"2023-08-31T19:04:04.019340+0000","last_active":"2023-08-31T19:04:04.022305+0000","last_peered":"2023-08-31T19:04:04.022305+0000","last_clean":"2023-08-31T19:04:04.022305+0000","last_became_active":"2023-08-31T19:04:04.019064+0000","last_became_peered":"2023-08-31T19:04:04.019064+0000","last_unstale":"2023-08-31T19:04:04.022305+0000","last_undegraded":"2023-08-31T19:04:04.022305+0000","last_fullsized":"2023-08-31T19:04:04.022305+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.553249+0000","last_change":"2023-08-31T19:04:03.544542+0000","last_active":"2023-08-31T19:04:03.553249+0000","last_peered":"2023-08-31T19:04:03.553249+0000","last_clean":"2023-08-31T19:04:03.553249+0000","last_became_active":"2023-08-31T19:04:03.543449+0000","last_became_peered":"2023-08-31T19:04:03.543449+0000","last_unstale":"2023-08-31T19:04:03.553249+0000","last_undegraded":"2023-08-31T19:04:03.553249+0000","last_fullsized":"2023-08-31T19:04:03.553249+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.028504+0000","last_change":"2023-08-31T19:04:04.021422+0000","last_active":"2023-08-31T19:04:04.028504+0000","last_peered":"2023-08-31T19:04:04.028504+0000","last_clean":"2023-08-31T19:04:04.028504+0000","last_became_active":"2023-08-31T19:04:04.020676+0000","last_became_peered":"2023-08-31T19:04:04.020676+0000","last_unstale":"2023-08-31T19:04:04.028504+0000","last_undegraded":"2023-08-31T19:04:04.028504+0000","last_fullsized":"2023-08-31T19:04:04.028504+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.029451+0000","last_change":"2023-08-31T19:04:03.551507+0000","last_active":"2023-08-31T19:04:04.029451+0000","last_peered":"2023-08-31T19:04:04.029451+0000","last_clean":"2023-08-31T19:04:04.029451+0000","last_became_active":"2023-08-31T19:04:03.551202+0000","last_became_peered":"2023-08-31T19:04:03.551202+0000","last_unstale":"2023-08-31T19:04:04.029451+0000","last_undegraded":"2023-08-31T19:04:04.029451+0000","last_fullsized":"2023-08-31T19:04:04.029451+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.015013+0000","last_change":"2023-08-31T19:04:04.015013+0000","last_active":"2023-08-31T19:04:04.015013+0000","last_peered":"2023-08-31T19:04:04.015013+0000","last_clean":"2023-08-31T19:04:04.015013+0000","last_became_active":"2023-08-31T19:04:04.014516+0000","last_became_peered":"2023-08-31T19:04:04.014516+0000","last_unstale":"2023-08-31T19:04:04.015013+0000","last_undegraded":"2023-08-31T19:04:04.015013+0000","last_fullsized":"2023-08-31T19:04:04.015013+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.023198+0000","last_change":"2023-08-31T19:04:04.016425+0000","last_active":"2023-08-31T19:04:04.023198+0000","last_peered":"2023-08-31T19:04:04.023198+0000","last_clean":"2023-08-31T19:04:04.023198+0000","last_became_active":"2023-08-31T19:04:04.015668+0000","last_became_peered":"2023-08-31T19:04:04.015668+0000","last_unstale":"2023-08-31T19:04:04.023198+0000","last_undegraded":"2023-08-31T19:04:04.023198+0000","last_fullsized":"2023-08-31T19:04:04.023198+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.010279+0000","last_change":"2023-08-31T19:04:03.551993+0000","last_active":"2023-08-31T19:04:04.010279+0000","last_peered":"2023-08-31T19:04:04.010279+0000","last_clean":"2023-08-31T19:04:04.010279+0000","last_became_active":"2023-08-31T19:04:03.551653+0000","last_became_peered":"2023-08-31T19:04:03.551653+0000","last_unstale":"2023-08-31T19:04:04.010279+0000","last_undegraded":"2023-08-31T19:04:04.010279+0000","last_fullsized":"2023-08-31T19:04:04.010279+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.031497+0000","last_change":"2023-08-31T19:04:04.029367+0000","last_active":"2023-08-31T19:04:04.031497+0000","last_peered":"2023-08-31T19:04:04.031497+0000","last_clean":"2023-08-31T19:04:04.031497+0000","last_became_active":"2023-08-31T19:04:04.029057+0000","last_became_peered":"2023-08-31T19:04:04.029057+0000","last_unstale":"2023-08-31T19:04:04.031497+0000","last_undegraded":"2023-08-31T19:04:04.031497+0000","last_fullsized":"2023-08-31T19:04:04.031497+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.549994+0000","last_change":"2023-08-31T19:04:03.540309+0000","last_active":"2023-08-31T19:04:03.549994+0000","last_peered":"2023-08-31T19:04:03.549994+0000","last_clean":"2023-08-31T19:04:03.549994+0000","last_became_active":"2023-08-31T19:04:03.539990+0000","last_became_peered":"2023-08-31T19:04:03.539990+0000","last_unstale":"2023-08-31T19:04:03.549994+0000","last_undegraded":"2023-08-31T19:04:03.549994+0000","last_fullsized":"2023-08-31T19:04:03.549994+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.022133+0000","last_change":"2023-08-31T19:04:03.550351+0000","last_active":"2023-08-31T19:04:04.022133+0000","last_peered":"2023-08-31T19:04:04.022133+0000","last_clean":"2023-08-31T19:04:04.022133+0000","last_became_active":"2023-08-31T19:04:03.549924+0000","last_became_peered":"2023-08-31T19:04:03.549924+0000","last_unstale":"2023-08-31T19:04:04.022133+0000","last_undegraded":"2023-08-31T19:04:04.022133+0000","last_fullsized":"2023-08-31T19:04:04.022133+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030921+0000","last_change":"2023-08-31T19:04:04.026808+0000","last_active":"2023-08-31T19:04:04.030921+0000","last_peered":"2023-08-31T19:04:04.030921+0000","last_clean":"2023-08-31T19:04:04.030921+0000","last_became_active":"2023-08-31T19:04:04.025850+0000","last_became_peered":"2023-08-31T19:04:04.025850+0000","last_unstale":"2023-08-31T19:04:04.030921+0000","last_undegraded":"2023-08-31T19:04:04.030921+0000","last_fullsized":"2023-08-31T19:04:04.030921+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.017168+0000","last_change":"2023-08-31T19:04:03.548403+0000","last_active":"2023-08-31T19:04:04.017168+0000","last_peered":"2023-08-31T19:04:04.017168+0000","last_clean":"2023-08-31T19:04:04.017168+0000","last_became_active":"2023-08-31T19:04:03.548040+0000","last_became_peered":"2023-08-31T19:04:03.548040+0000","last_unstale":"2023-08-31T19:04:04.017168+0000","last_undegraded":"2023-08-31T19:04:04.017168+0000","last_fullsized":"2023-08-31T19:04:04.017168+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007848+0000","last_change":"2023-08-31T19:04:03.547131+0000","last_active":"2023-08-31T19:04:04.007848+0000","last_peered":"2023-08-31T19:04:04.007848+0000","last_clean":"2023-08-31T19:04:04.007848+0000","last_became_active":"2023-08-31T19:04:03.546494+0000","last_became_peered":"2023-08-31T19:04:03.546494+0000","last_unstale":"2023-08-31T19:04:04.007848+0000","last_undegraded":"2023-08-31T19:04:04.007848+0000","last_fullsized":"2023-08-31T19:04:04.007848+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.010064+0000","last_change":"2023-08-31T19:04:03.549960+0000","last_active":"2023-08-31T19:04:04.010064+0000","last_peered":"2023-08-31T19:04:04.010064+0000","last_clean":"2023-08-31T19:04:04.010064+0000","last_became_active":"2023-08-31T19:04:03.549611+0000","last_became_peered":"2023-08-31T19:04:03.549611+0000","last_unstale":"2023-08-31T19:04:04.010064+0000","last_undegraded":"2023-08-31T19:04:04.010064+0000","last_fullsized":"2023-08-31T19:04:04.010064+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.006103+0000","last_change":"2023-08-31T19:04:03.552134+0000","last_active":"2023-08-31T19:04:04.006103+0000","last_peered":"2023-08-31T19:04:04.006103+0000","last_clean":"2023-08-31T19:04:04.006103+0000","last_became_active":"2023-08-31T19:04:03.551698+0000","last_became_peered":"2023-08-31T19:04:03.551698+0000","last_unstale":"2023-08-31T19:04:04.006103+0000","last_undegraded":"2023-08-31T19:04:04.006103+0000","last_fullsized":"2023-08-31T19:04:04.006103+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.004443+0000","last_change":"2023-08-31T19:04:04.004443+0000","last_active":"2023-08-31T19:04:04.004443+0000","last_peered":"2023-08-31T19:04:04.004443+0000","last_clean":"2023-08-31T19:04:04.004443+0000","last_became_active":"2023-08-31T19:04:04.004106+0000","last_became_peered":"2023-08-31T19:04:04.004106+0000","last_unstale":"2023-08-31T19:04:04.004443+0000","last_undegraded":"2023-08-31T19:04:04.004443+0000","last_fullsized":"2023-08-31T19:04:04.004443+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007841+0000","last_change":"2023-08-31T19:04:03.548033+0000","last_active":"2023-08-31T19:04:04.007841+0000","last_peered":"2023-08-31T19:04:04.007841+0000","last_clean":"2023-08-31T19:04:04.007841+0000","last_became_active":"2023-08-31T19:04:03.547724+0000","last_became_peered":"2023-08-31T19:04:03.547724+0000","last_unstale":"2023-08-31T19:04:04.007841+0000","last_undegraded":"2023-08-31T19:04:04.007841+0000","last_fullsized":"2023-08-31T19:04:04.007841+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.006472+0000","last_change":"2023-08-31T19:04:03.555057+0000","last_active":"2023-08-31T19:04:04.006472+0000","last_peered":"2023-08-31T19:04:04.006472+0000","last_clean":"2023-08-31T19:04:04.006472+0000","last_became_active":"2023-08-31T19:04:03.554754+0000","last_became_peered":"2023-08-31T19:04:03.554754+0000","last_unstale":"2023-08-31T19:04:04.006472+0000","last_undegraded":"2023-08-31T19:04:04.006472+0000","last_fullsized":"2023-08-31T19:04:04.006472+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007970+0000","last_change":"2023-08-31T19:04:03.555319+0000","last_active":"2023-08-31T19:04:04.007970+0000","last_peered":"2023-08-31T19:04:04.007970+0000","last_clean":"2023-08-31T19:04:04.007970+0000","last_became_active":"2023-08-31T19:04:03.554797+0000","last_became_peered":"2023-08-31T19:04:03.554797+0000","last_unstale":"2023-08-31T19:04:04.007970+0000","last_undegraded":"2023-08-31T19:04:04.007970+0000","last_fullsized":"2023-08-31T19:04:04.007970+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.022552+0000","last_change":"2023-08-31T19:04:04.021453+0000","last_active":"2023-08-31T19:04:04.022552+0000","last_peered":"2023-08-31T19:04:04.022552+0000","last_clean":"2023-08-31T19:04:04.022552+0000","last_became_active":"2023-08-31T19:04:04.021121+0000","last_became_peered":"2023-08-31T19:04:04.021121+0000","last_unstale":"2023-08-31T19:04:04.022552+0000","last_undegraded":"2023-08-31T19:04:04.022552+0000","last_fullsized":"2023-08-31T19:04:04.022552+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007699+0000","last_change":"2023-08-31T19:04:03.549553+0000","last_active":"2023-08-31T19:04:04.007699+0000","last_peered":"2023-08-31T19:04:04.007699+0000","last_clean":"2023-08-31T19:04:04.007699+0000","last_became_active":"2023-08-31T19:04:03.548695+0000","last_became_peered":"2023-08-31T19:04:03.548695+0000","last_unstale":"2023-08-31T19:04:04.007699+0000","last_undegraded":"2023-08-31T19:04:04.007699+0000","last_fullsized":"2023-08-31T19:04:04.007699+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.015865+0000","last_change":"2023-08-31T19:04:04.015865+0000","last_active":"2023-08-31T19:04:04.015865+0000","last_peered":"2023-08-31T19:04:04.015865+0000","last_clean":"2023-08-31T19:04:04.015865+0000","last_became_active":"2023-08-31T19:04:04.015577+0000","last_became_peered":"2023-08-31T19:04:04.015577+0000","last_unstale":"2023-08-31T19:04:04.015865+0000","last_undegraded":"2023-08-31T19:04:04.015865+0000","last_fullsized":"2023-08-31T19:04:04.015865+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.998340+0000","last_change":"2023-08-31T19:04:03.555128+0000","last_active":"2023-08-31T19:04:03.998340+0000","last_peered":"2023-08-31T19:04:03.998340+0000","last_clean":"2023-08-31T19:04:03.998340+0000","last_became_active":"2023-08-31T19:04:03.554296+0000","last_became_peered":"2023-08-31T19:04:03.554296+0000","last_unstale":"2023-08-31T19:04:03.998340+0000","last_undegraded":"2023-08-31T19:04:03.998340+0000","last_fullsized":"2023-08-31T19:04:03.998340+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.014811+0000","last_change":"2023-08-31T19:04:04.014811+0000","last_active":"2023-08-31T19:04:04.014811+0000","last_peered":"2023-08-31T19:04:04.014811+0000","last_clean":"2023-08-31T19:04:04.014811+0000","last_became_active":"2023-08-31T19:04:04.014574+0000","last_became_peered":"2023-08-31T19:04:04.014574+0000","last_unstale":"2023-08-31T19:04:04.014811+0000","last_undegraded":"2023-08-31T19:04:04.014811+0000","last_fullsized":"2023-08-31T19:04:04.014811+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030296+0000","last_change":"2023-08-31T19:04:04.025409+0000","last_active":"2023-08-31T19:04:04.030296+0000","last_peered":"2023-08-31T19:04:04.030296+0000","last_clean":"2023-08-31T19:04:04.030296+0000","last_became_active":"2023-08-31T19:04:04.025053+0000","last_became_peered":"2023-08-31T19:04:04.025053+0000","last_unstale":"2023-08-31T19:04:04.030296+0000","last_undegraded":"2023-08-31T19:04:04.030296+0000","last_fullsized":"2023-08-31T19:04:04.030296+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.031393+0000","last_change":"2023-08-31T19:04:04.029021+0000","last_active":"2023-08-31T19:04:04.031393+0000","last_peered":"2023-08-31T19:04:04.031393+0000","last_clean":"2023-08-31T19:04:04.031393+0000","last_became_active":"2023-08-31T19:04:04.028684+0000","last_became_peered":"2023-08-31T19:04:04.028684+0000","last_unstale":"2023-08-31T19:04:04.031393+0000","last_undegraded":"2023-08-31T19:04:04.031393+0000","last_fullsized":"2023-08-31T19:04:04.031393+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.998279+0000","last_change":"2023-08-31T19:04:03.553676+0000","last_active":"2023-08-31T19:04:03.998279+0000","last_peered":"2023-08-31T19:04:03.998279+0000","last_clean":"2023-08-31T19:04:03.998279+0000","last_became_active":"2023-08-31T19:04:03.553373+0000","last_became_peered":"2023-08-31T19:04:03.553373+0000","last_unstale":"2023-08-31T19:04:03.998279+0000","last_undegraded":"2023-08-31T19:04:03.998279+0000","last_fullsized":"2023-08-31T19:04:03.998279+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.032119+0000","last_change":"2023-08-31T19:04:04.032119+0000","last_active":"2023-08-31T19:04:04.032119+0000","last_peered":"2023-08-31T19:04:04.032119+0000","last_clean":"2023-08-31T19:04:04.032119+0000","last_became_active":"2023-08-31T19:04:04.031832+0000","last_became_peered":"2023-08-31T19:04:04.031832+0000","last_unstale":"2023-08-31T19:04:04.032119+0000","last_undegraded":"2023-08-31T19:04:04.032119+0000","last_fullsized":"2023-08-31T19:04:04.032119+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.008651+0000","last_change":"2023-08-31T19:04:03.544317+0000","last_active":"2023-08-31T19:04:04.008651+0000","last_peered":"2023-08-31T19:04:04.008651+0000","last_clean":"2023-08-31T19:04:04.008651+0000","last_became_active":"2023-08-31T19:04:03.544025+0000","last_became_peered":"2023-08-31T19:04:03.544025+0000","last_unstale":"2023-08-31T19:04:04.008651+0000","last_undegraded":"2023-08-31T19:04:04.008651+0000","last_fullsized":"2023-08-31T19:04:04.008651+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.031185+0000","last_change":"2023-08-31T19:04:04.031185+0000","last_active":"2023-08-31T19:04:04.031185+0000","last_peered":"2023-08-31T19:04:04.031185+0000","last_clean":"2023-08-31T19:04:04.031185+0000","last_became_active":"2023-08-31T19:04:04.030853+0000","last_became_peered":"2023-08-31T19:04:04.030853+0000","last_unstale":"2023-08-31T19:04:04.031185+0000","last_undegraded":"2023-08-31T19:04:04.031185+0000","last_fullsized":"2023-08-31T19:04:04.031185+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007999+0000","last_change":"2023-08-31T19:04:03.555135+0000","last_active":"2023-08-31T19:04:04.007999+0000","last_peered":"2023-08-31T19:04:04.007999+0000","last_clean":"2023-08-31T19:04:04.007999+0000","last_became_active":"2023-08-31T19:04:03.554364+0000","last_became_peered":"2023-08-31T19:04:03.554364+0000","last_unstale":"2023-08-31T19:04:04.007999+0000","last_undegraded":"2023-08-31T19:04:04.007999+0000","last_fullsized":"2023-08-31T19:04:04.007999+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030017+0000","last_change":"2023-08-31T19:04:04.024201+0000","last_active":"2023-08-31T19:04:04.030017+0000","last_peered":"2023-08-31T19:04:04.030017+0000","last_clean":"2023-08-31T19:04:04.030017+0000","last_became_active":"2023-08-31T19:04:04.023899+0000","last_became_peered":"2023-08-31T19:04:04.023899+0000","last_unstale":"2023-08-31T19:04:04.030017+0000","last_undegraded":"2023-08-31T19:04:04.030017+0000","last_fullsized":"2023-08-31T19:04:04.030017+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.537662+0000","last_change":"2023-08-31T19:04:03.535896+0000","last_active":"2023-08-31T19:04:03.537662+0000","last_peered":"2023-08-31T19:04:03.537662+0000","last_clean":"2023-08-31T19:04:03.537662+0000","last_became_active":"2023-08-31T19:04:03.535626+0000","last_became_peered":"2023-08-31T19:04:03.535626+0000","last_unstale":"2023-08-31T19:04:03.537662+0000","last_undegraded":"2023-08-31T19:04:03.537662+0000","last_fullsized":"2023-08-31T19:04:03.537662+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.029906+0000","last_change":"2023-08-31T19:04:04.026220+0000","last_active":"2023-08-31T19:04:04.029906+0000","last_peered":"2023-08-31T19:04:04.029906+0000","last_clean":"2023-08-31T19:04:04.029906+0000","last_became_active":"2023-08-31T19:04:04.025740+0000","last_became_peered":"2023-08-31T19:04:04.025740+0000","last_unstale":"2023-08-31T19:04:04.029906+0000","last_undegraded":"2023-08-31T19:04:04.029906+0000","last_fullsized":"2023-08-31T19:04:04.029906+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.019541+0000","last_change":"2023-08-31T19:04:04.019541+0000","last_active":"2023-08-31T19:04:04.019541+0000","last_peered":"2023-08-31T19:04:04.019541+0000","last_clean":"2023-08-31T19:04:04.019541+0000","last_became_active":"2023-08-31T19:04:04.019284+0000","last_became_peered":"2023-08-31T19:04:04.019284+0000","last_unstale":"2023-08-31T19:04:04.019541+0000","last_undegraded":"2023-08-31T19:04:04.019541+0000","last_fullsized":"2023-08-31T19:04:04.019541+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.029982+0000","last_change":"2023-08-31T19:04:04.027915+0000","last_active":"2023-08-31T19:04:04.029982+0000","last_peered":"2023-08-31T19:04:04.029982+0000","last_clean":"2023-08-31T19:04:04.029982+0000","last_became_active":"2023-08-31T19:04:04.027519+0000","last_became_peered":"2023-08-31T19:04:04.027519+0000","last_unstale":"2023-08-31T19:04:04.029982+0000","last_undegraded":"2023-08-31T19:04:04.029982+0000","last_fullsized":"2023-08-31T19:04:04.029982+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.010096+0000","last_change":"2023-08-31T19:04:03.545387+0000","last_active":"2023-08-31T19:04:04.010096+0000","last_peered":"2023-08-31T19:04:04.010096+0000","last_clean":"2023-08-31T19:04:04.010096+0000","last_became_active":"2023-08-31T19:04:03.545072+0000","last_became_peered":"2023-08-31T19:04:03.545072+0000","last_unstale":"2023-08-31T19:04:04.010096+0000","last_undegraded":"2023-08-31T19:04:04.010096+0000","last_fullsized":"2023-08-31T19:04:04.010096+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.021056+0000","last_change":"2023-08-31T19:04:04.018521+0000","last_active":"2023-08-31T19:04:04.021056+0000","last_peered":"2023-08-31T19:04:04.021056+0000","last_clean":"2023-08-31T19:04:04.021056+0000","last_became_active":"2023-08-31T19:04:04.018253+0000","last_became_peered":"2023-08-31T19:04:04.018253+0000","last_unstale":"2023-08-31T19:04:04.021056+0000","last_undegraded":"2023-08-31T19:04:04.021056+0000","last_fullsized":"2023-08-31T19:04:04.021056+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.021777+0000","last_change":"2023-08-31T19:04:03.551516+0000","last_active":"2023-08-31T19:04:04.021777+0000","last_peered":"2023-08-31T19:04:04.021777+0000","last_clean":"2023-08-31T19:04:04.021777+0000","last_became_active":"2023-08-31T19:04:03.551183+0000","last_became_peered":"2023-08-31T19:04:03.551183+0000","last_unstale":"2023-08-31T19:04:04.021777+0000","last_undegraded":"2023-08-31T19:04:04.021777+0000","last_fullsized":"2023-08-31T19:04:04.021777+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.022078+0000","last_change":"2023-08-31T19:04:04.018546+0000","last_active":"2023-08-31T19:04:04.022078+0000","last_peered":"2023-08-31T19:04:04.022078+0000","last_clean":"2023-08-31T19:04:04.022078+0000","last_became_active":"2023-08-31T19:04:04.018252+0000","last_became_peered":"2023-08-31T19:04:04.018252+0000","last_unstale":"2023-08-31T19:04:04.022078+0000","last_undegraded":"2023-08-31T19:04:04.022078+0000","last_fullsized":"2023-08-31T19:04:04.022078+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.027486+0000","last_change":"2023-08-31T19:04:03.547120+0000","last_active":"2023-08-31T19:04:04.027486+0000","last_peered":"2023-08-31T19:04:04.027486+0000","last_clean":"2023-08-31T19:04:04.027486+0000","last_became_active":"2023-08-31T19:04:03.546820+0000","last_became_peered":"2023-08-31T19:04:03.546820+0000","last_unstale":"2023-08-31T19:04:04.027486+0000","last_undegraded":"2023-08-31T19:04:04.027486+0000","last_fullsized":"2023-08-31T19:04:04.027486+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.019567+0000","last_change":"2023-08-31T19:04:04.014061+0000","last_active":"2023-08-31T19:04:04.019567+0000","last_peered":"2023-08-31T19:04:04.019567+0000","last_clean":"2023-08-31T19:04:04.019567+0000","last_became_active":"2023-08-31T19:04:04.013749+0000","last_became_peered":"2023-08-31T19:04:04.013749+0000","last_unstale":"2023-08-31T19:04:04.019567+0000","last_undegraded":"2023-08-31T19:04:04.019567+0000","last_fullsized":"2023-08-31T19:04:04.019567+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.029958+0000","last_change":"2023-08-31T19:04:04.027745+0000","last_active":"2023-08-31T19:04:04.029958+0000","last_peered":"2023-08-31T19:04:04.029958+0000","last_clean":"2023-08-31T19:04:04.029958+0000","last_became_active":"2023-08-31T19:04:04.027459+0000","last_became_peered":"2023-08-31T19:04:04.027459+0000","last_unstale":"2023-08-31T19:04:04.029958+0000","last_undegraded":"2023-08-31T19:04:04.029958+0000","last_fullsized":"2023-08-31T19:04:04.029958+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.025380+0000","last_change":"2023-08-31T19:04:04.019638+0000","last_active":"2023-08-31T19:04:04.025380+0000","last_peered":"2023-08-31T19:04:04.025380+0000","last_clean":"2023-08-31T19:04:04.025380+0000","last_became_active":"2023-08-31T19:04:04.019295+0000","last_became_peered":"2023-08-31T19:04:04.019295+0000","last_unstale":"2023-08-31T19:04:04.025380+0000","last_undegraded":"2023-08-31T19:04:04.025380+0000","last_fullsized":"2023-08-31T19:04:04.025380+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"93'4","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.019932+0000","last_change":"2023-08-31T19:04:03.543461+0000","last_active":"2023-08-31T19:04:04.019932+0000","last_peered":"2023-08-31T19:04:04.019932+0000","last_clean":"2023-08-31T19:04:04.019932+0000","last_became_active":"2023-08-31T19:04:03.543167+0000","last_became_peered":"2023-08-31T19:04:03.543167+0000","last_unstale":"2023-08-31T19:04:04.019932+0000","last_undegraded":"2023-08-31T19:04:04.019932+0000","last_fullsized":"2023-08-31T19:04:04.019932+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.029780+0000","last_change":"2023-08-31T19:04:04.024304+0000","last_active":"2023-08-31T19:04:04.029780+0000","last_peered":"2023-08-31T19:04:04.029780+0000","last_clean":"2023-08-31T19:04:04.029780+0000","last_became_active":"2023-08-31T19:04:04.023831+0000","last_became_peered":"2023-08-31T19:04:04.023831+0000","last_unstale":"2023-08-31T19:04:04.029780+0000","last_undegraded":"2023-08-31T19:04:04.029780+0000","last_fullsized":"2023-08-31T19:04:04.029780+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.032020+0000","last_change":"2023-08-31T19:04:03.549050+0000","last_active":"2023-08-31T19:04:04.032020+0000","last_peered":"2023-08-31T19:04:04.032020+0000","last_clean":"2023-08-31T19:04:04.032020+0000","last_became_active":"2023-08-31T19:04:03.548729+0000","last_became_peered":"2023-08-31T19:04:03.548729+0000","last_unstale":"2023-08-31T19:04:04.032020+0000","last_undegraded":"2023-08-31T19:04:04.032020+0000","last_fullsized":"2023-08-31T19:04:04.032020+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.021957+0000","last_change":"2023-08-31T19:04:04.018696+0000","last_active":"2023-08-31T19:04:04.021957+0000","last_peered":"2023-08-31T19:04:04.021957+0000","last_clean":"2023-08-31T19:04:04.021957+0000","last_became_active":"2023-08-31T19:04:04.018349+0000","last_became_peered":"2023-08-31T19:04:04.018349+0000","last_unstale":"2023-08-31T19:04:04.021957+0000","last_undegraded":"2023-08-31T19:04:04.021957+0000","last_fullsized":"2023-08-31T19:04:04.021957+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.553548+0000","last_change":"2023-08-31T19:04:03.544163+0000","last_active":"2023-08-31T19:04:03.553548+0000","last_peered":"2023-08-31T19:04:03.553548+0000","last_clean":"2023-08-31T19:04:03.553548+0000","last_became_active":"2023-08-31T19:04:03.543861+0000","last_became_peered":"2023-08-31T19:04:03.543861+0000","last_unstale":"2023-08-31T19:04:03.553548+0000","last_undegraded":"2023-08-31T19:04:03.553548+0000","last_fullsized":"2023-08-31T19:04:03.553548+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.029291+0000","last_change":"2023-08-31T19:04:04.022829+0000","last_active":"2023-08-31T19:04:04.029291+0000","last_peered":"2023-08-31T19:04:04.029291+0000","last_clean":"2023-08-31T19:04:04.029291+0000","last_became_active":"2023-08-31T19:04:04.022479+0000","last_became_peered":"2023-08-31T19:04:04.022479+0000","last_unstale":"2023-08-31T19:04:04.029291+0000","last_undegraded":"2023-08-31T19:04:04.029291+0000","last_fullsized":"2023-08-31T19:04:04.029291+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.018867+0000","last_change":"2023-08-31T19:04:04.018867+0000","last_active":"2023-08-31T19:04:04.018867+0000","last_peered":"2023-08-31T19:04:04.018867+0000","last_clean":"2023-08-31T19:04:04.018867+0000","last_became_active":"2023-08-31T19:04:04.018578+0000","last_became_peered":"2023-08-31T19:04:04.018578+0000","last_unstale":"2023-08-31T19:04:04.018867+0000","last_undegraded":"2023-08-31T19:04:04.018867+0000","last_fullsized":"2023-08-31T19:04:04.018867+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.019542+0000","last_change":"2023-08-31T19:04:04.017172+0000","last_active":"2023-08-31T19:04:04.019542+0000","last_peered":"2023-08-31T19:04:04.019542+0000","last_clean":"2023-08-31T19:04:04.019542+0000","last_became_active":"2023-08-31T19:04:04.016842+0000","last_became_peered":"2023-08-31T19:04:04.016842+0000","last_unstale":"2023-08-31T19:04:04.019542+0000","last_undegraded":"2023-08-31T19:04:04.019542+0000","last_fullsized":"2023-08-31T19:04:04.019542+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.998267+0000","last_change":"2023-08-31T19:04:03.554164+0000","last_active":"2023-08-31T19:04:03.998267+0000","last_peered":"2023-08-31T19:04:03.998267+0000","last_clean":"2023-08-31T19:04:03.998267+0000","last_became_active":"2023-08-31T19:04:03.553621+0000","last_became_peered":"2023-08-31T19:04:03.553621+0000","last_unstale":"2023-08-31T19:04:03.998267+0000","last_undegraded":"2023-08-31T19:04:03.998267+0000","last_fullsized":"2023-08-31T19:04:03.998267+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030184+0000","last_change":"2023-08-31T19:04:04.026207+0000","last_active":"2023-08-31T19:04:04.030184+0000","last_peered":"2023-08-31T19:04:04.030184+0000","last_clean":"2023-08-31T19:04:04.030184+0000","last_became_active":"2023-08-31T19:04:04.025847+0000","last_became_peered":"2023-08-31T19:04:04.025847+0000","last_unstale":"2023-08-31T19:04:04.030184+0000","last_undegraded":"2023-08-31T19:04:04.030184+0000","last_fullsized":"2023-08-31T19:04:04.030184+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.998877+0000","last_change":"2023-08-31T19:04:03.554965+0000","last_active":"2023-08-31T19:04:03.998877+0000","last_peered":"2023-08-31T19:04:03.998877+0000","last_clean":"2023-08-31T19:04:03.998877+0000","last_became_active":"2023-08-31T19:04:03.554591+0000","last_became_peered":"2023-08-31T19:04:03.554591+0000","last_unstale":"2023-08-31T19:04:03.998877+0000","last_undegraded":"2023-08-31T19:04:03.998877+0000","last_fullsized":"2023-08-31T19:04:03.998877+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-31T19:03:59.539772+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:03:59.539772+0000","last_peered":"2023-08-31T19:03:59.539772+0000","last_clean":"2023-08-31T19:03:59.539772+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:03:59.539772+0000","last_undegraded":"2023-08-31T19:03:59.539772+0000","last_fullsized":"2023-08-31T19:03:59.539772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.014510+0000","last_change":"2023-08-31T19:04:04.014510+0000","last_active":"2023-08-31T19:04:04.014510+0000","last_peered":"2023-08-31T19:04:04.014510+0000","last_clean":"2023-08-31T19:04:04.014510+0000","last_became_active":"2023-08-31T19:04:04.014201+0000","last_became_peered":"2023-08-31T19:04:04.014201+0000","last_unstale":"2023-08-31T19:04:04.014510+0000","last_undegraded":"2023-08-31T19:04:04.014510+0000","last_fullsized":"2023-08-31T19:04:04.014510+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.018190+0000","last_change":"2023-08-31T19:04:03.546125+0000","last_active":"2023-08-31T19:04:04.018190+0000","last_peered":"2023-08-31T19:04:04.018190+0000","last_clean":"2023-08-31T19:04:04.018190+0000","last_became_active":"2023-08-31T19:04:03.545801+0000","last_became_peered":"2023-08-31T19:04:03.545801+0000","last_unstale":"2023-08-31T19:04:04.018190+0000","last_undegraded":"2023-08-31T19:04:04.018190+0000","last_fullsized":"2023-08-31T19:04:04.018190+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":77,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.008059+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:04:04.008059+0000","last_peered":"2023-08-31T19:04:04.008059+0000","last_clean":"2023-08-31T19:04:04.008059+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:04:04.008059+0000","last_undegraded":"2023-08-31T19:04:04.008059+0000","last_fullsized":"2023-08-31T19:04:04.008059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.019811+0000","last_change":"2023-08-31T19:04:04.015546+0000","last_active":"2023-08-31T19:04:04.019811+0000","last_peered":"2023-08-31T19:04:04.019811+0000","last_clean":"2023-08-31T19:04:04.019811+0000","last_became_active":"2023-08-31T19:04:04.015267+0000","last_became_peered":"2023-08-31T19:04:04.015267+0000","last_unstale":"2023-08-31T19:04:04.019811+0000","last_undegraded":"2023-08-31T19:04:04.019811+0000","last_fullsized":"2023-08-31T19:04:04.019811+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.006356+0000","last_change":"2023-08-31T19:04:03.555603+0000","last_active":"2023-08-31T19:04:04.006356+0000","last_peered":"2023-08-31T19:04:04.006356+0000","last_clean":"2023-08-31T19:04:04.006356+0000","last_became_active":"2023-08-31T19:04:03.555300+0000","last_became_peered":"2023-08-31T19:04:03.555300+0000","last_unstale":"2023-08-31T19:04:04.006356+0000","last_undegraded":"2023-08-31T19:04:04.006356+0000","last_fullsized":"2023-08-31T19:04:04.006356+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-31T19:03:58.837501+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:03:58.837501+0000","last_peered":"2023-08-31T19:03:58.837501+0000","last_clean":"2023-08-31T19:03:58.837501+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:03:58.837501+0000","last_undegraded":"2023-08-31T19:03:58.837501+0000","last_fullsized":"2023-08-31T19:03:58.837501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007164+0000","last_change":"2023-08-31T19:04:03.556315+0000","last_active":"2023-08-31T19:04:04.007164+0000","last_peered":"2023-08-31T19:04:04.007164+0000","last_clean":"2023-08-31T19:04:04.007164+0000","last_became_active":"2023-08-31T19:04:03.555826+0000","last_became_peered":"2023-08-31T19:04:03.555826+0000","last_unstale":"2023-08-31T19:04:04.007164+0000","last_undegraded":"2023-08-31T19:04:04.007164+0000","last_fullsized":"2023-08-31T19:04:04.007164+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":77,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007670+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:04:04.007670+0000","last_peered":"2023-08-31T19:04:04.007670+0000","last_clean":"2023-08-31T19:04:04.007670+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:04:04.007670+0000","last_undegraded":"2023-08-31T19:04:04.007670+0000","last_fullsized":"2023-08-31T19:04:04.007670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":75,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-31T19:03:59.540382+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:03:59.540382+0000","last_peered":"2023-08-31T19:03:59.540382+0000","last_clean":"2023-08-31T19:03:59.540382+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:03:59.540382+0000","last_undegraded":"2023-08-31T19:03:59.540382+0000","last_fullsized":"2023-08-31T19:03:59.540382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.021319+0000","last_change":"2023-08-31T19:04:04.021319+0000","last_active":"2023-08-31T19:04:04.021319+0000","last_peered":"2023-08-31T19:04:04.021319+0000","last_clean":"2023-08-31T19:04:04.021319+0000","last_became_active":"2023-08-31T19:04:04.021013+0000","last_became_peered":"2023-08-31T19:04:04.021013+0000","last_unstale":"2023-08-31T19:04:04.021319+0000","last_undegraded":"2023-08-31T19:04:04.021319+0000","last_fullsized":"2023-08-31T19:04:04.021319+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.006543+0000","last_change":"2023-08-31T19:04:03.555089+0000","last_active":"2023-08-31T19:04:04.006543+0000","last_peered":"2023-08-31T19:04:04.006543+0000","last_clean":"2023-08-31T19:04:04.006543+0000","last_became_active":"2023-08-31T19:04:03.554782+0000","last_became_peered":"2023-08-31T19:04:03.554782+0000","last_unstale":"2023-08-31T19:04:04.006543+0000","last_undegraded":"2023-08-31T19:04:04.006543+0000","last_fullsized":"2023-08-31T19:04:04.006543+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-31T19:03:59.540385+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:03:59.540385+0000","last_peered":"2023-08-31T19:03:59.540385+0000","last_clean":"2023-08-31T19:03:59.540385+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:03:59.540385+0000","last_undegraded":"2023-08-31T19:03:59.540385+0000","last_fullsized":"2023-08-31T19:03:59.540385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.031537+0000","last_change":"2023-08-31T19:04:04.026571+0000","last_active":"2023-08-31T19:04:04.031537+0000","last_peered":"2023-08-31T19:04:04.031537+0000","last_clean":"2023-08-31T19:04:04.031537+0000","last_became_active":"2023-08-31T19:04:04.026153+0000","last_became_peered":"2023-08-31T19:04:04.026153+0000","last_unstale":"2023-08-31T19:04:04.031537+0000","last_undegraded":"2023-08-31T19:04:04.031537+0000","last_fullsized":"2023-08-31T19:04:04.031537+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-31T19:03:59.540385+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:03:59.540385+0000","last_peered":"2023-08-31T19:03:59.540385+0000","last_clean":"2023-08-31T19:03:59.540385+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:03:59.540385+0000","last_undegraded":"2023-08-31T19:03:59.540385+0000","last_fullsized":"2023-08-31T19:03:59.540385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030948+0000","last_change":"2023-08-31T19:04:04.026465+0000","last_active":"2023-08-31T19:04:04.030948+0000","last_peered":"2023-08-31T19:04:04.030948+0000","last_clean":"2023-08-31T19:04:04.030948+0000","last_became_active":"2023-08-31T19:04:04.026195+0000","last_became_peered":"2023-08-31T19:04:04.026195+0000","last_unstale":"2023-08-31T19:04:04.030948+0000","last_undegraded":"2023-08-31T19:04:04.030948+0000","last_fullsized":"2023-08-31T19:04:04.030948+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:02.506982+0000","last_change":"2023-08-31T19:04:02.506982+0000","last_active":"2023-08-31T19:04:02.506982+0000","last_peered":"2023-08-31T19:04:02.506982+0000","last_clean":"2023-08-31T19:04:02.506982+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:02.506982+0000","last_undegraded":"2023-08-31T19:04:02.506982+0000","last_fullsized":"2023-08-31T19:04:02.506982+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-08-31T19:03:59.539765+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:03:59.539765+0000","last_peered":"2023-08-31T19:03:59.539765+0000","last_clean":"2023-08-31T19:03:59.539765+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:03:59.539765+0000","last_undegraded":"2023-08-31T19:03:59.539765+0000","last_fullsized":"2023-08-31T19:03:59.539765+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:03.514730+0000","last_change":"2023-08-31T19:04:03.514730+0000","last_active":"2023-08-31T19:04:03.514730+0000","last_peered":"2023-08-31T19:04:03.514730+0000","last_clean":"2023-08-31T19:04:03.514730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:03.514730+0000","last_undegraded":"2023-08-31T19:04:03.514730+0000","last_fullsized":"2023-08-31T19:04:03.514730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.032159+0000","last_change":"2023-08-31T19:04:03.557225+0000","last_active":"2023-08-31T19:04:04.032159+0000","last_peered":"2023-08-31T19:04:04.032159+0000","last_clean":"2023-08-31T19:04:04.032159+0000","last_became_active":"2023-08-31T19:04:03.556896+0000","last_became_peered":"2023-08-31T19:04:03.556896+0000","last_unstale":"2023-08-31T19:04:04.032159+0000","last_undegraded":"2023-08-31T19:04:04.032159+0000","last_fullsized":"2023-08-31T19:04:04.032159+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":84,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.999106+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:04:03.999106+0000","last_peered":"2023-08-31T19:04:03.999106+0000","last_clean":"2023-08-31T19:04:03.999106+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:04:03.999106+0000","last_undegraded":"2023-08-31T19:04:03.999106+0000","last_fullsized":"2023-08-31T19:04:03.999106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":5},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":748,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":76,"acting":76,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302264,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":1097728,"data_stored":565996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.56899999999999995,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.0489999999999999},"last":0.623},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.53400000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0169999999999999},"last":0.58399999999999996}]},{"osd":1,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67500000000000004,"15min":0.69999999999999996},"min":{"1min":0.48099999999999998,"5min":0.40699999999999997,"15min":0.40000000000000002},"max":{"1min":0.83399999999999996,"5min":0.93000000000000005,"15min":0.97299999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.53600000000000003,"5min":0.40500000000000003,"15min":0.36199999999999999},"max":{"1min":0.85899999999999999,"5min":0.93100000000000005,"15min":0.96799999999999997},"last":0.503}]},{"osd":2,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.94199999999999995,"5min":0.97799999999999998,"15min":1.093},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.57599999999999996,"5min":0.49399999999999999,"15min":0.41199999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":1.054},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.51200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.83799999999999997,"5min":1.0229999999999999,"15min":1.1160000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.58899999999999997,"5min":0.52200000000000002,"15min":0.495},"max":{"1min":0.95799999999999996,"5min":0.96399999999999997,"15min":1.0860000000000001},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":0.83799999999999997,"15min":0.97899999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97199999999999998,"5min":0.98499999999999999,"15min":1.163},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.41099999999999998,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":1.139,"15min":1.139},"last":0.746},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.38500000000000001},"max":{"1min":0.93899999999999995,"5min":0.97699999999999998,"15min":1.353},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.67600000000000005},"min":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.41399999999999998},"max":{"1min":0.88700000000000001,"5min":0.93100000000000005,"15min":1.3999999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68899999999999995,"15min":0.69799999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.91900000000000004,"5min":1.038,"15min":1.462},"last":0.68899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":1159168,"data_stored":595893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68700000000000006,"15min":0.70699999999999996},"min":{"1min":0.65100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90200000000000002,"5min":0.92000000000000004,"15min":1.0189999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68600000000000005,"15min":0.70199999999999996},"min":{"1min":0.57199999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":0.90900000000000003,"15min":0.94499999999999995},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67800000000000005,"15min":0.70099999999999996},"min":{"1min":0.52400000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91100000000000003,"5min":0.92100000000000004,"15min":1.0049999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.54800000000000004,"5min":0.435,"15min":0.435},"max":{"1min":0.86799999999999999,"5min":0.91400000000000003,"15min":0.95999999999999996},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.42099999999999999},"max":{"1min":0.91100000000000003,"5min":0.94999999999999996,"15min":1.129},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.62,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94899999999999995,"5min":0.98899999999999999,"15min":1.3260000000000001},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.60499999999999998,"5min":0.51000000000000001,"15min":0.47499999999999998},"max":{"1min":0.89200000000000002,"5min":0.93200000000000005,"15min":1.0860000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.73499999999999999,"15min":0.75},"min":{"1min":0.63600000000000001,"5min":0.53300000000000003,"15min":0.49399999999999999},"max":{"1min":0.91900000000000004,"5min":0.94799999999999995,"15min":1.052},"last":0.624}]},{"osd":4,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.61899999999999999},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.40999999999999998},"max":{"1min":0.88400000000000001,"5min":0.94299999999999995,"15min":0.97799999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.63600000000000001},"min":{"1min":0.47599999999999998,"5min":0.39000000000000001,"15min":0.371},"max":{"1min":0.89400000000000002,"5min":1.0880000000000001,"15min":1.091},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.66700000000000004},"min":{"1min":0.5,"5min":0.44400000000000001,"15min":0.39800000000000002},"max":{"1min":0.82999999999999996,"5min":0.96699999999999997,"15min":1.1000000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.55900000000000005,"5min":0.435,"15min":0.435},"max":{"1min":0.80500000000000005,"5min":1.0669999999999999,"15min":1.0700000000000001},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54800000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84899999999999998,"5min":1.012,"15min":1.0620000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.54400000000000004,"5min":0.47899999999999998,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":1.0800000000000001,"15min":1.1040000000000001},"last":0.70599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302264,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":1097728,"data_stored":565996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.433,"15min":0.443},"min":{"1min":0.28000000000000003,"5min":0.27300000000000002,"15min":0.23300000000000001},"max":{"1min":0.57799999999999996,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.254},"max":{"1min":0.66600000000000004,"5min":0.752,"15min":0.752},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.29099999999999998,"15min":0.28899999999999998},"max":{"1min":0.63900000000000001,"5min":0.78000000000000003,"15min":0.82699999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.754,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.45200000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79000000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.495,"15min":0.51000000000000001},"min":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.32500000000000001},"max":{"1min":0.65000000000000002,"5min":0.67300000000000004,"15min":1.673},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76300000000000001,"15min":0.78400000000000003},"min":{"1min":0.61199999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96899999999999997,"5min":1.2110000000000001,"15min":1.4119999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80000000000000004,"15min":0.81100000000000005},"min":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.49099999999999999},"max":{"1min":1.111,"5min":1.1799999999999999,"15min":1.3},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.73599999999999999,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.497,"15min":0.46800000000000003},"max":{"1min":0.99299999999999999,"5min":1.052,"15min":1.8540000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.54500000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0720000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51400000000000001},"max":{"1min":0.97299999999999998,"5min":1.1990000000000001,"15min":1.8979999999999999},"last":0.753},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.56799999999999995,"5min":0.51500000000000001,"15min":0.48999999999999999},"max":{"1min":1.167,"5min":1.2,"15min":1.2629999999999999},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.47699999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.113},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.51400000000000001,"15min":0.504},"max":{"1min":1.0429999999999999,"5min":1.1399999999999999,"15min":2.0720000000000001},"last":0.77500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302300,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069540,"statfs":{"total":96636764160,"available":96327208960,"internally_reserved":0,"allocated":1134592,"data_stored":587875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44500000000000001,"15min":0.44600000000000001},"min":{"1min":0.31900000000000001,"5min":0.29099999999999998,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.71499999999999997,"15min":0.78400000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.49299999999999999,"15min":0.49099999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.30399999999999999},"max":{"1min":0.72499999999999998,"5min":0.876,"15min":0.876},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.50600000000000001},"min":{"1min":0.41799999999999998,"5min":0.34499999999999997,"15min":0.32900000000000001},"max":{"1min":0.64900000000000002,"5min":0.67900000000000005,"15min":0.74299999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53300000000000003,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.77000000000000002,"5min":1.018,"15min":1.018},"last":0.44}]},{"osd":3,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":0.67200000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.44400000000000001,"5min":0.39500000000000002,"15min":0.36599999999999999},"max":{"1min":0.71699999999999997,"5min":0.91400000000000003,"15min":1.0509999999999999},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.82699999999999996,"15min":0.82199999999999995},"min":{"1min":0.65000000000000002,"5min":0.55000000000000004,"15min":0.53900000000000003},"max":{"1min":1.103,"5min":1.2370000000000001,"15min":1.931},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.63600000000000001,"5min":0.55000000000000004,"15min":0.49399999999999999},"max":{"1min":1.095,"5min":1.1890000000000001,"15min":1.276},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.5,"15min":0.49399999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.3480000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76700000000000002,"15min":0.77000000000000002},"min":{"1min":0.58499999999999996,"5min":0.53300000000000003,"15min":0.50700000000000001},"max":{"1min":1.0029999999999999,"5min":1.1950000000000001,"15min":1.9810000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81499999999999995,"15min":0.81000000000000005},"min":{"1min":0.61099999999999999,"5min":0.52700000000000002,"15min":0.46600000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.3280000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.53500000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.2350000000000001},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83299999999999996,"15min":0.82899999999999996},"min":{"1min":0.623,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1359999999999999,"5min":1.5820000000000001,"15min":2.1760000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.83899999999999997,"15min":0.83699999999999997},"min":{"1min":0.59999999999999998,"5min":0.57399999999999995,"15min":0.52200000000000002},"max":{"1min":1.127,"5min":1.548,"15min":1.548},"last":0.74099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302264,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":1097728,"data_stored":565996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45700000000000002,"15min":0.44400000000000001},"min":{"1min":0.29199999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67700000000000005,"5min":0.77600000000000002,"15min":0.90200000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.314,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61299999999999999,"5min":0.70099999999999996,"15min":1.5900000000000001},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.50600000000000001},"min":{"1min":0.38,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67400000000000004,"5min":0.75700000000000001,"15min":0.96599999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.36499999999999999},"max":{"1min":0.70299999999999996,"5min":0.748,"15min":1.288},"last":0.497}]},{"osd":3,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33100000000000002},"max":{"1min":0.66500000000000004,"5min":0.70699999999999996,"15min":1.022},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55700000000000005},"min":{"1min":0.44500000000000001,"5min":0.36399999999999999,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71599999999999997,"15min":0.97399999999999998},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.54600000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.173,"5min":1.173,"15min":1.208},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47699999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.464},"last":0.91300000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2,"5min":1.2,"15min":1.361},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77200000000000002,"15min":0.79300000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.03,"5min":1.1020000000000001,"15min":1.3},"last":1.03}]},{"osd":6,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79700000000000004,"15min":0.81100000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.501},"max":{"1min":1.238,"5min":1.238,"15min":1.51},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79300000000000004,"15min":0.80900000000000005},"min":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.48199999999999998},"max":{"1min":1,"5min":1.1579999999999999,"15min":1.4359999999999999},"last":0.97499999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80100000000000005,"15min":0.81699999999999995},"min":{"1min":0.61399999999999999,"5min":0.53700000000000003,"15min":0.51900000000000002},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.55},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80200000000000005,"15min":0.82299999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1160000000000001,"5min":1.1439999999999999,"15min":1.387},"last":1.018}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302300,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069540,"statfs":{"total":96636764160,"available":96327208960,"internally_reserved":0,"allocated":1134592,"data_stored":587875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.58599999999999997,"15min":0.48199999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55600000000000005,"5min":14.099,"15min":14.099},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.73199999999999998,"15min":0.55900000000000005},"min":{"1min":0.34399999999999997,"5min":0.313,"15min":0.29199999999999998},"max":{"1min":0.65400000000000003,"5min":24.879999999999999,"15min":24.879999999999999},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46500000000000002,"15min":0.45200000000000001},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.254},"max":{"1min":0.56299999999999994,"5min":0.79600000000000004,"15min":0.90700000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.63300000000000001,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.30199999999999999,"15min":0.28799999999999998},"max":{"1min":0.80700000000000005,"5min":14.143000000000001,"15min":14.143000000000001},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.46400000000000002,"5min":0.39600000000000002,"15min":0.33400000000000002},"max":{"1min":0.76200000000000001,"5min":0.94999999999999996,"15min":1.407},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.72399999999999998,"15min":0.65100000000000002},"min":{"1min":0.48699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70199999999999996,"5min":12.464,"15min":12.464},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.94999999999999996,"15min":0.81799999999999995},"min":{"1min":0.53500000000000003,"5min":0.47999999999999998,"15min":0.47299999999999998},"max":{"1min":1.2250000000000001,"5min":21.475999999999999,"15min":21.475999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77600000000000002,"15min":0.76300000000000001},"min":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.47299999999999998},"max":{"1min":1.0309999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.751,"15min":0.75800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.46600000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.3220000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.86699999999999999,"15min":0.80600000000000005},"min":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.173,"5min":12.509,"15min":12.509},"last":0.83399999999999996}]},{"osd":6,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.89000000000000001,"15min":0.81899999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.52000000000000002},"max":{"1min":0.96799999999999997,"5min":12.426,"15min":12.426},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":1.022,"15min":0.85799999999999998},"min":{"1min":0.61899999999999999,"5min":0.53200000000000003,"15min":0.50600000000000001},"max":{"1min":1.2010000000000001,"5min":24.920000000000002,"15min":24.920000000000002},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":1.006,"15min":0.85899999999999999},"min":{"1min":0.60099999999999998,"5min":0.51300000000000001,"15min":0.495},"max":{"1min":1.0680000000000001,"5min":21.521000000000001,"15min":21.521000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77900000000000003,"15min":0.78300000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.65700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":1159168,"data_stored":595857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.72299999999999998},"min":{"1min":0.54100000000000004,"5min":0.42399999999999999,"15min":0.36799999999999999},"max":{"1min":0.88300000000000001,"5min":0.96499999999999997,"15min":9.6289999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69299999999999995,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.441,"15min":0.42099999999999999},"max":{"1min":0.85499999999999998,"5min":0.92900000000000005,"15min":3.403},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70499999999999996,"15min":0.74199999999999999},"min":{"1min":0.52100000000000002,"5min":0.44700000000000001,"15min":0.437},"max":{"1min":0.80400000000000005,"5min":0.97199999999999998,"15min":9.8399999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70899999999999996,"15min":0.746},"min":{"1min":0.57199999999999995,"5min":0.47899999999999998,"15min":0.44900000000000001},"max":{"1min":0.92500000000000004,"5min":1.0229999999999999,"15min":9.7569999999999997},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71199999999999997,"15min":0.745},"min":{"1min":0.58299999999999996,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":1.042,"15min":9.7840000000000007},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.76100000000000001},"min":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85099999999999998,"5min":0.98399999999999999,"15min":9.7200000000000006},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.56200000000000006,"5min":0.51100000000000001,"15min":0.48299999999999998},"max":{"1min":0.86899999999999999,"5min":1.01,"15min":5.133},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74399999999999999,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.439,"15min":0.439},"max":{"1min":0.90900000000000003,"5min":1.012,"15min":12.589},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59199999999999997,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89300000000000002,"5min":1.0800000000000001,"15min":9.6780000000000008},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.441,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":1.0549999999999999,"15min":3.3610000000000002},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66000000000000003,"15min":0.68000000000000005},"min":{"1min":0.47099999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84999999999999998,"5min":1.163,"15min":9.4760000000000009},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69499999999999995,"15min":0.72199999999999998},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":0.93600000000000005,"5min":1.133,"15min":9.8640000000000008},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69699999999999995,"15min":0.70999999999999996},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.98999999999999999,"5min":1.147,"15min":7.1769999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.45200000000000001},"max":{"1min":0.91700000000000004,"5min":1.0980000000000001,"15min":12.634},"last":0.81499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302304,"kb_used_data":1112,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069536,"statfs":{"total":96636764160,"available":96327204864,"internally_reserved":0,"allocated":1138688,"data_stored":587909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73899999999999999,"15min":0.72599999999999998},"min":{"1min":0.50700000000000001,"5min":0.47199999999999998,"15min":0.40899999999999997},"max":{"1min":0.93799999999999994,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.75700000000000001,"15min":0.72599999999999998},"min":{"1min":0.56799999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94899999999999995,"5min":3.548,"15min":3.548},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.86299999999999999,"15min":0.76800000000000002},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0149999999999999,"5min":16.744,"15min":16.744},"last":0.63},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76000000000000001,"15min":0.74199999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.46300000000000002},"max":{"1min":0.91700000000000004,"5min":3.6299999999999999,"15min":3.6299999999999999},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.71699999999999997},"min":{"1min":0.56100000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0289999999999999,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76700000000000002,"15min":0.75800000000000001},"min":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.45200000000000001},"max":{"1min":0.98399999999999999,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":0.75600000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.54400000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.996,"5min":1.327,"15min":2.0070000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.73399999999999999},"min":{"1min":0.53500000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96799999999999997,"5min":2.823,"15min":2.823},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67500000000000004,"15min":0.65000000000000002},"min":{"1min":0.47099999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72499999999999998,"5min":7.3739999999999997,"15min":7.3739999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":0.81799999999999995,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":0.94999999999999996}]},{"osd":6,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67300000000000004,"15min":0.65900000000000003},"min":{"1min":0.53500000000000003,"5min":0.45300000000000001,"15min":0.39100000000000001},"max":{"1min":0.91200000000000003,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76100000000000001,"15min":0.72399999999999998},"min":{"1min":0.57799999999999996,"5min":0.443,"15min":0.441},"max":{"1min":0.83999999999999997,"5min":7.4139999999999997,"15min":7.4139999999999997},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73999999999999999,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.46100000000000002},"max":{"1min":0.95099999999999996,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.73899999999999999,"15min":0.73199999999999998},"min":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.073,"5min":2.786,"15min":2.786},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:04:08.283 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:04:08.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.505+0000 7f86411ff700 1 Processor -- start 2023-08-31T19:04:08.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.505+0000 7f86411ff700 1 -- start start 2023-08-31T19:04:08.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.507+0000 7f86411ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f863c0cb9b0 0x7f863c1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.507+0000 7f86411ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f863c1588d0 0x7f863c154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.507+0000 7f86411ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863c0c6120 con 0x7f863c154060 2023-08-31T19:04:08.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.507+0000 7f86411ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863c0c1380 con 0x7f863c0cb9b0 2023-08-31T19:04:08.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.507+0000 7f86411ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863c0c5e10 con 0x7f863c1588d0 2023-08-31T19:04:08.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.507+0000 7f863a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f863c0cb9b0 0x7f863c1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.507+0000 7f863b59e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f863c1588d0 0x7f863c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.507+0000 7f863ad9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f863c154060 0x7f863c157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:33122/0 (socket says 172.21.15.72:33122) 2023-08-31T19:04:08.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.507+0000 7f863ad9d700 1 -- 172.21.15.72:0/326639775 learned_addr learned my addr 172.21.15.72:0/326639775 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:08.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.507+0000 7f863a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f863c0cb9b0 0x7f863c1583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:58004/0 (socket says 172.21.15.72:58004) 2023-08-31T19:04:08.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.508+0000 7f8639d9b700 1 -- 172.21.15.72:0/326639775 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190906143 0 0) 0x7f863c0c6120 con 0x7f863c154060 2023-08-31T19:04:08.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.508+0000 7f8639d9b700 1 -- 172.21.15.72:0/326639775 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86240033f0 con 0x7f863c154060 2023-08-31T19:04:08.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.508+0000 7f863b59e700 1 -- 172.21.15.72:0/326639775 >> v2:172.21.15.146:3300/0 conn(0x7f863c0cb9b0 msgr2=0x7f863c1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:08.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.508+0000 7f863b59e700 1 --2- 172.21.15.72:0/326639775 >> v2:172.21.15.146:3300/0 conn(0x7f863c0cb9b0 0x7f863c1583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.508+0000 7f863b59e700 1 -- 172.21.15.72:0/326639775 >> v1:172.21.15.146:6789/0 conn(0x7f863c154060 legacy=0x7f863c157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.508+0000 7f863b59e700 1 -- 172.21.15.72:0/326639775 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c0c0ae0 con 0x7f863c1588d0 2023-08-31T19:04:08.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.508+0000 7f863a59c700 1 --2- 172.21.15.72:0/326639775 >> v2:172.21.15.146:3300/0 conn(0x7f863c0cb9b0 0x7f863c1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:04:08.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.508+0000 7f863b59e700 1 --2- 172.21.15.72:0/326639775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f863c1588d0 0x7f863c154440 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f8634009e60 tx=0x7f8634009780).ready entity=mon.2 client_cookie=d88532dfbf8cc356 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:08.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.508+0000 7f8639d9b700 1 -- 172.21.15.72:0/326639775 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863400e070 con 0x7f863c1588d0 2023-08-31T19:04:08.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.509+0000 7f8639d9b700 1 -- 172.21.15.72:0/326639775 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863400bab0 con 0x7f863c1588d0 2023-08-31T19:04:08.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.509+0000 7f8639d9b700 1 -- 172.21.15.72:0/326639775 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863400be30 con 0x7f863c1588d0 2023-08-31T19:04:08.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.509+0000 7f86411ff700 1 -- 172.21.15.72:0/326639775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f863c1588d0 msgr2=0x7f863c154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.509+0000 7f86411ff700 1 --2- 172.21.15.72:0/326639775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f863c1588d0 0x7f863c154440 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f8634009e60 tx=0x7f8634009780).stop 2023-08-31T19:04:08.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.509+0000 7f86411ff700 1 -- 172.21.15.72:0/326639775 shutdown_connections 2023-08-31T19:04:08.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.509+0000 7f86411ff700 1 --2- 172.21.15.72:0/326639775 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f863c1588d0 0x7f863c154440 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.509+0000 7f86411ff700 1 --2- 172.21.15.72:0/326639775 >> v2:172.21.15.146:3300/0 conn(0x7f863c0cb9b0 0x7f863c1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.509+0000 7f86411ff700 1 -- 172.21.15.72:0/326639775 >> 172.21.15.72:0/326639775 conn(0x7f863c05e870 msgr2=0x7f863c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:08.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.509+0000 7f86411ff700 1 -- 172.21.15.72:0/326639775 shutdown_connections 2023-08-31T19:04:08.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.509+0000 7f86411ff700 1 -- 172.21.15.72:0/326639775 wait complete. 2023-08-31T19:04:08.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.511+0000 7f86411ff700 1 Processor -- start 2023-08-31T19:04:08.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.511+0000 7f86411ff700 1 -- start start 2023-08-31T19:04:08.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.512+0000 7f86411ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863c0cb9b0 0x7f863c144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.512+0000 7f86411ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f863c154060 0x7f863c0a8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.512+0000 7f86411ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f863c1588d0 0x7f863c0a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.512+0000 7f86411ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c0aa060 con 0x7f863c0cb9b0 2023-08-31T19:04:08.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.512+0000 7f86411ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c0a9bd0 con 0x7f863c1588d0 2023-08-31T19:04:08.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.512+0000 7f86411ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863c0ad670 con 0x7f863c154060 2023-08-31T19:04:08.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.512+0000 7f863ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863c0cb9b0 0x7f863c144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.512+0000 7f863ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863c0cb9b0 0x7f863c144810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54194/0 (socket says 172.21.15.72:54194) 2023-08-31T19:04:08.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.512+0000 7f863ad9d700 1 -- 172.21.15.72:0/3499772248 learned_addr learned my addr 172.21.15.72:0/3499772248 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:08.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.512+0000 7f863a59c700 1 --2- 172.21.15.72:0/3499772248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f863c154060 0x7f863c0a8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.512+0000 7f863b59e700 1 --2- 172.21.15.72:0/3499772248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f863c1588d0 0x7f863c0a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.513+0000 7f863ad9d700 1 -- 172.21.15.72:0/3499772248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f863c154060 msgr2=0x7f863c0a8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.513+0000 7f863ad9d700 1 --2- 172.21.15.72:0/3499772248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f863c154060 0x7f863c0a8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.513+0000 7f863ad9d700 1 -- 172.21.15.72:0/3499772248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f863c1588d0 msgr2=0x7f863c0a89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.513+0000 7f863ad9d700 1 --2- 172.21.15.72:0/3499772248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f863c1588d0 0x7f863c0a89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.513+0000 7f863ad9d700 1 -- 172.21.15.72:0/3499772248 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86300092a0 con 0x7f863c0cb9b0 2023-08-31T19:04:08.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.513+0000 7f863b59e700 1 --2- 172.21.15.72:0/3499772248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f863c1588d0 0x7f863c0a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:08.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.513+0000 7f863ad9d700 1 --2- 172.21.15.72:0/3499772248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863c0cb9b0 0x7f863c144810 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f862c00c560 tx=0x7f862c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:08.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.513+0000 7f8622ffd700 1 -- 172.21.15.72:0/3499772248 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c0072e0 con 0x7f863c0cb9b0 2023-08-31T19:04:08.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.513+0000 7f8622ffd700 1 -- 172.21.15.72:0/3499772248 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862c007440 con 0x7f863c0cb9b0 2023-08-31T19:04:08.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.513+0000 7f86411ff700 1 -- 172.21.15.72:0/3499772248 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8634009a20 con 0x7f863c0cb9b0 2023-08-31T19:04:08.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.513+0000 7f8622ffd700 1 -- 172.21.15.72:0/3499772248 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c0057f0 con 0x7f863c0cb9b0 2023-08-31T19:04:08.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.513+0000 7f86411ff700 1 -- 172.21.15.72:0/3499772248 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863c0a92a0 con 0x7f863c0cb9b0 2023-08-31T19:04:08.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.514+0000 7f86411ff700 1 -- 172.21.15.72:0/3499772248 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863c06c6b0 con 0x7f863c0cb9b0 2023-08-31T19:04:08.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.515+0000 7f8622ffd700 1 -- 172.21.15.72:0/3499772248 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f862c005ba0 con 0x7f863c0cb9b0 2023-08-31T19:04:08.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.516+0000 7f8622ffd700 1 --2- 172.21.15.72:0/3499772248 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f862805ef30 0x7f86280613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.516+0000 7f8622ffd700 1 -- 172.21.15.72:0/3499772248 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f862c079910 con 0x7f863c0cb9b0 2023-08-31T19:04:08.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.516+0000 7f863a59c700 1 --2- 172.21.15.72:0/3499772248 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f862805ef30 0x7f86280613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.517+0000 7f863a59c700 1 --2- 172.21.15.72:0/3499772248 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f862805ef30 0x7f86280613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f863c152750 tx=0x7f8630009060).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:08.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.520+0000 7f8622ffd700 1 -- 172.21.15.72:0/3499772248 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f862c04a9a0 con 0x7f863c0cb9b0 2023-08-31T19:04:08.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.687+0000 7f86411ff700 1 -- 172.21.15.72:0/3499772248 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f863c0a9d10 con 0x7f862805ef30 2023-08-31T19:04:08.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.697+0000 7f8622ffd700 1 -- 172.21.15.72:0/3499772248 <== mgr.6501 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361285 (secure 0 0 0) 0x7f8630009a00 con 0x7f862805ef30 2023-08-31T19:04:08.702 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:08.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.702+0000 7f86411ff700 1 -- 172.21.15.72:0/3499772248 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f862805ef30 msgr2=0x7f86280613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.702+0000 7f86411ff700 1 --2- 172.21.15.72:0/3499772248 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f862805ef30 0x7f86280613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f863c152750 tx=0x7f8630009060).stop 2023-08-31T19:04:08.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.702+0000 7f86411ff700 1 -- 172.21.15.72:0/3499772248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863c0cb9b0 msgr2=0x7f863c144810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.702+0000 7f86411ff700 1 --2- 172.21.15.72:0/3499772248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863c0cb9b0 0x7f863c144810 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f862c00c560 tx=0x7f862c007c80).stop 2023-08-31T19:04:08.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.702+0000 7f86411ff700 1 -- 172.21.15.72:0/3499772248 shutdown_connections 2023-08-31T19:04:08.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.702+0000 7f86411ff700 1 --2- 172.21.15.72:0/3499772248 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f862805ef30 0x7f86280613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.702+0000 7f86411ff700 1 --2- 172.21.15.72:0/3499772248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f863c1588d0 0x7f863c0a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.702+0000 7f86411ff700 1 --2- 172.21.15.72:0/3499772248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863c0cb9b0 0x7f863c144810 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.702+0000 7f86411ff700 1 --2- 172.21.15.72:0/3499772248 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f863c154060 0x7f863c0a8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.702+0000 7f86411ff700 1 -- 172.21.15.72:0/3499772248 >> 172.21.15.72:0/3499772248 conn(0x7f863c05e870 msgr2=0x7f863c063f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:08.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.702+0000 7f86411ff700 1 -- 172.21.15.72:0/3499772248 shutdown_connections 2023-08-31T19:04:08.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.703+0000 7f86411ff700 1 -- 172.21.15.72:0/3499772248 wait complete. 2023-08-31T19:04:08.707 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:04:08.720 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-31T19:04:08.255763+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418512,"kb_used_data":8976,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752556208,"statfs":{"total":773094113280,"available":770617556992,"internally_reserved":0,"allocated":9191424,"data_stored":4736828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9673,"num_objects":-14,"num_object_clones":0,"num_object_copies":-28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-14,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-45,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.994885"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.024181+0000","last_change":"2023-08-31T19:04:04.024181+0000","last_active":"2023-08-31T19:04:04.024181+0000","last_peered":"2023-08-31T19:04:04.024181+0000","last_clean":"2023-08-31T19:04:04.024181+0000","last_became_active":"2023-08-31T19:04:04.023140+0000","last_became_peered":"2023-08-31T19:04:04.023140+0000","last_unstale":"2023-08-31T19:04:04.024181+0000","last_undegraded":"2023-08-31T19:04:04.024181+0000","last_fullsized":"2023-08-31T19:04:04.024181+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"93'3","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.027071+0000","last_change":"2023-08-31T19:04:03.548495+0000","last_active":"2023-08-31T19:04:04.027071+0000","last_peered":"2023-08-31T19:04:04.027071+0000","last_clean":"2023-08-31T19:04:04.027071+0000","last_became_active":"2023-08-31T19:04:03.548213+0000","last_became_peered":"2023-08-31T19:04:03.548213+0000","last_unstale":"2023-08-31T19:04:04.027071+0000","last_undegraded":"2023-08-31T19:04:04.027071+0000","last_fullsized":"2023-08-31T19:04:04.027071+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.029854+0000","last_change":"2023-08-31T19:04:04.026679+0000","last_active":"2023-08-31T19:04:04.029854+0000","last_peered":"2023-08-31T19:04:04.029854+0000","last_clean":"2023-08-31T19:04:04.029854+0000","last_became_active":"2023-08-31T19:04:04.026200+0000","last_became_peered":"2023-08-31T19:04:04.026200+0000","last_unstale":"2023-08-31T19:04:04.029854+0000","last_undegraded":"2023-08-31T19:04:04.029854+0000","last_fullsized":"2023-08-31T19:04:04.029854+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.998705+0000","last_change":"2023-08-31T19:04:03.553387+0000","last_active":"2023-08-31T19:04:03.998705+0000","last_peered":"2023-08-31T19:04:03.998705+0000","last_clean":"2023-08-31T19:04:03.998705+0000","last_became_active":"2023-08-31T19:04:03.553087+0000","last_became_peered":"2023-08-31T19:04:03.553087+0000","last_unstale":"2023-08-31T19:04:03.998705+0000","last_undegraded":"2023-08-31T19:04:03.998705+0000","last_fullsized":"2023-08-31T19:04:03.998705+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030884+0000","last_change":"2023-08-31T19:04:04.026510+0000","last_active":"2023-08-31T19:04:04.030884+0000","last_peered":"2023-08-31T19:04:04.030884+0000","last_clean":"2023-08-31T19:04:04.030884+0000","last_became_active":"2023-08-31T19:04:04.025804+0000","last_became_peered":"2023-08-31T19:04:04.025804+0000","last_unstale":"2023-08-31T19:04:04.030884+0000","last_undegraded":"2023-08-31T19:04:04.030884+0000","last_fullsized":"2023-08-31T19:04:04.030884+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.006006+0000","last_change":"2023-08-31T19:04:03.550392+0000","last_active":"2023-08-31T19:04:04.006006+0000","last_peered":"2023-08-31T19:04:04.006006+0000","last_clean":"2023-08-31T19:04:04.006006+0000","last_became_active":"2023-08-31T19:04:03.550066+0000","last_became_peered":"2023-08-31T19:04:03.550066+0000","last_unstale":"2023-08-31T19:04:04.006006+0000","last_undegraded":"2023-08-31T19:04:04.006006+0000","last_fullsized":"2023-08-31T19:04:04.006006+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.025151+0000","last_change":"2023-08-31T19:04:04.025151+0000","last_active":"2023-08-31T19:04:04.025151+0000","last_peered":"2023-08-31T19:04:04.025151+0000","last_clean":"2023-08-31T19:04:04.025151+0000","last_became_active":"2023-08-31T19:04:04.024773+0000","last_became_peered":"2023-08-31T19:04:04.024773+0000","last_unstale":"2023-08-31T19:04:04.025151+0000","last_undegraded":"2023-08-31T19:04:04.025151+0000","last_fullsized":"2023-08-31T19:04:04.025151+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.022541+0000","last_change":"2023-08-31T19:04:03.553881+0000","last_active":"2023-08-31T19:04:04.022541+0000","last_peered":"2023-08-31T19:04:04.022541+0000","last_clean":"2023-08-31T19:04:04.022541+0000","last_became_active":"2023-08-31T19:04:03.553588+0000","last_became_peered":"2023-08-31T19:04:03.553588+0000","last_unstale":"2023-08-31T19:04:04.022541+0000","last_undegraded":"2023-08-31T19:04:04.022541+0000","last_fullsized":"2023-08-31T19:04:04.022541+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.020930+0000","last_change":"2023-08-31T19:04:04.016510+0000","last_active":"2023-08-31T19:04:04.020930+0000","last_peered":"2023-08-31T19:04:04.020930+0000","last_clean":"2023-08-31T19:04:04.020930+0000","last_became_active":"2023-08-31T19:04:04.016162+0000","last_became_peered":"2023-08-31T19:04:04.016162+0000","last_unstale":"2023-08-31T19:04:04.020930+0000","last_undegraded":"2023-08-31T19:04:04.020930+0000","last_fullsized":"2023-08-31T19:04:04.020930+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"93'1","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.011598+0000","last_change":"2023-08-31T19:04:03.554081+0000","last_active":"2023-08-31T19:04:04.011598+0000","last_peered":"2023-08-31T19:04:04.011598+0000","last_clean":"2023-08-31T19:04:04.011598+0000","last_became_active":"2023-08-31T19:04:03.553796+0000","last_became_peered":"2023-08-31T19:04:03.553796+0000","last_unstale":"2023-08-31T19:04:04.011598+0000","last_undegraded":"2023-08-31T19:04:04.011598+0000","last_fullsized":"2023-08-31T19:04:04.011598+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.028639+0000","last_change":"2023-08-31T19:04:04.020009+0000","last_active":"2023-08-31T19:04:04.028639+0000","last_peered":"2023-08-31T19:04:04.028639+0000","last_clean":"2023-08-31T19:04:04.028639+0000","last_became_active":"2023-08-31T19:04:04.019671+0000","last_became_peered":"2023-08-31T19:04:04.019671+0000","last_unstale":"2023-08-31T19:04:04.028639+0000","last_undegraded":"2023-08-31T19:04:04.028639+0000","last_fullsized":"2023-08-31T19:04:04.028639+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.020572+0000","last_change":"2023-08-31T19:04:03.548919+0000","last_active":"2023-08-31T19:04:04.020572+0000","last_peered":"2023-08-31T19:04:04.020572+0000","last_clean":"2023-08-31T19:04:04.020572+0000","last_became_active":"2023-08-31T19:04:03.548556+0000","last_became_peered":"2023-08-31T19:04:03.548556+0000","last_unstale":"2023-08-31T19:04:04.020572+0000","last_undegraded":"2023-08-31T19:04:04.020572+0000","last_fullsized":"2023-08-31T19:04:04.020572+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.032201+0000","last_change":"2023-08-31T19:04:04.032201+0000","last_active":"2023-08-31T19:04:04.032201+0000","last_peered":"2023-08-31T19:04:04.032201+0000","last_clean":"2023-08-31T19:04:04.032201+0000","last_became_active":"2023-08-31T19:04:04.031884+0000","last_became_peered":"2023-08-31T19:04:04.031884+0000","last_unstale":"2023-08-31T19:04:04.032201+0000","last_undegraded":"2023-08-31T19:04:04.032201+0000","last_fullsized":"2023-08-31T19:04:04.032201+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007571+0000","last_change":"2023-08-31T19:04:03.549829+0000","last_active":"2023-08-31T19:04:04.007571+0000","last_peered":"2023-08-31T19:04:04.007571+0000","last_clean":"2023-08-31T19:04:04.007571+0000","last_became_active":"2023-08-31T19:04:03.549240+0000","last_became_peered":"2023-08-31T19:04:03.549240+0000","last_unstale":"2023-08-31T19:04:04.007571+0000","last_undegraded":"2023-08-31T19:04:04.007571+0000","last_fullsized":"2023-08-31T19:04:04.007571+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.032326+0000","last_change":"2023-08-31T19:04:04.030823+0000","last_active":"2023-08-31T19:04:04.032326+0000","last_peered":"2023-08-31T19:04:04.032326+0000","last_clean":"2023-08-31T19:04:04.032326+0000","last_became_active":"2023-08-31T19:04:04.030451+0000","last_became_peered":"2023-08-31T19:04:04.030451+0000","last_unstale":"2023-08-31T19:04:04.032326+0000","last_undegraded":"2023-08-31T19:04:04.032326+0000","last_fullsized":"2023-08-31T19:04:04.032326+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.997893+0000","last_change":"2023-08-31T19:04:03.550215+0000","last_active":"2023-08-31T19:04:03.997893+0000","last_peered":"2023-08-31T19:04:03.997893+0000","last_clean":"2023-08-31T19:04:03.997893+0000","last_became_active":"2023-08-31T19:04:03.549869+0000","last_became_peered":"2023-08-31T19:04:03.549869+0000","last_unstale":"2023-08-31T19:04:03.997893+0000","last_undegraded":"2023-08-31T19:04:03.997893+0000","last_fullsized":"2023-08-31T19:04:03.997893+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.028348+0000","last_change":"2023-08-31T19:04:04.023426+0000","last_active":"2023-08-31T19:04:04.028348+0000","last_peered":"2023-08-31T19:04:04.028348+0000","last_clean":"2023-08-31T19:04:04.028348+0000","last_became_active":"2023-08-31T19:04:04.023120+0000","last_became_peered":"2023-08-31T19:04:04.023120+0000","last_unstale":"2023-08-31T19:04:04.028348+0000","last_undegraded":"2023-08-31T19:04:04.028348+0000","last_fullsized":"2023-08-31T19:04:04.028348+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.558251+0000","last_change":"2023-08-31T19:04:03.552440+0000","last_active":"2023-08-31T19:04:03.558251+0000","last_peered":"2023-08-31T19:04:03.558251+0000","last_clean":"2023-08-31T19:04:03.558251+0000","last_became_active":"2023-08-31T19:04:03.552012+0000","last_became_peered":"2023-08-31T19:04:03.552012+0000","last_unstale":"2023-08-31T19:04:03.558251+0000","last_undegraded":"2023-08-31T19:04:03.558251+0000","last_fullsized":"2023-08-31T19:04:03.558251+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.015962+0000","last_change":"2023-08-31T19:04:04.015962+0000","last_active":"2023-08-31T19:04:04.015962+0000","last_peered":"2023-08-31T19:04:04.015962+0000","last_clean":"2023-08-31T19:04:04.015962+0000","last_became_active":"2023-08-31T19:04:04.015723+0000","last_became_peered":"2023-08-31T19:04:04.015723+0000","last_unstale":"2023-08-31T19:04:04.015962+0000","last_undegraded":"2023-08-31T19:04:04.015962+0000","last_fullsized":"2023-08-31T19:04:04.015962+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.010781+0000","last_change":"2023-08-31T19:04:03.556543+0000","last_active":"2023-08-31T19:04:04.010781+0000","last_peered":"2023-08-31T19:04:04.010781+0000","last_clean":"2023-08-31T19:04:04.010781+0000","last_became_active":"2023-08-31T19:04:03.555895+0000","last_became_peered":"2023-08-31T19:04:03.555895+0000","last_unstale":"2023-08-31T19:04:04.010781+0000","last_undegraded":"2023-08-31T19:04:04.010781+0000","last_fullsized":"2023-08-31T19:04:04.010781+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030865+0000","last_change":"2023-08-31T19:04:04.026343+0000","last_active":"2023-08-31T19:04:04.030865+0000","last_peered":"2023-08-31T19:04:04.030865+0000","last_clean":"2023-08-31T19:04:04.030865+0000","last_became_active":"2023-08-31T19:04:04.025670+0000","last_became_peered":"2023-08-31T19:04:04.025670+0000","last_unstale":"2023-08-31T19:04:04.030865+0000","last_undegraded":"2023-08-31T19:04:04.030865+0000","last_fullsized":"2023-08-31T19:04:04.030865+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.012580+0000","last_change":"2023-08-31T19:04:03.546995+0000","last_active":"2023-08-31T19:04:04.012580+0000","last_peered":"2023-08-31T19:04:04.012580+0000","last_clean":"2023-08-31T19:04:04.012580+0000","last_became_active":"2023-08-31T19:04:03.546502+0000","last_became_peered":"2023-08-31T19:04:03.546502+0000","last_unstale":"2023-08-31T19:04:04.012580+0000","last_undegraded":"2023-08-31T19:04:04.012580+0000","last_fullsized":"2023-08-31T19:04:04.012580+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.024654+0000","last_change":"2023-08-31T19:04:04.024654+0000","last_active":"2023-08-31T19:04:04.024654+0000","last_peered":"2023-08-31T19:04:04.024654+0000","last_clean":"2023-08-31T19:04:04.024654+0000","last_became_active":"2023-08-31T19:04:04.024353+0000","last_became_peered":"2023-08-31T19:04:04.024353+0000","last_unstale":"2023-08-31T19:04:04.024654+0000","last_undegraded":"2023-08-31T19:04:04.024654+0000","last_fullsized":"2023-08-31T19:04:04.024654+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.035569+0000","last_change":"2023-08-31T19:04:03.544809+0000","last_active":"2023-08-31T19:04:04.035569+0000","last_peered":"2023-08-31T19:04:04.035569+0000","last_clean":"2023-08-31T19:04:04.035569+0000","last_became_active":"2023-08-31T19:04:03.544547+0000","last_became_peered":"2023-08-31T19:04:03.544547+0000","last_unstale":"2023-08-31T19:04:04.035569+0000","last_undegraded":"2023-08-31T19:04:04.035569+0000","last_fullsized":"2023-08-31T19:04:04.035569+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.022057+0000","last_change":"2023-08-31T19:04:04.018453+0000","last_active":"2023-08-31T19:04:04.022057+0000","last_peered":"2023-08-31T19:04:04.022057+0000","last_clean":"2023-08-31T19:04:04.022057+0000","last_became_active":"2023-08-31T19:04:04.018135+0000","last_became_peered":"2023-08-31T19:04:04.018135+0000","last_unstale":"2023-08-31T19:04:04.022057+0000","last_undegraded":"2023-08-31T19:04:04.022057+0000","last_fullsized":"2023-08-31T19:04:04.022057+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"93'1","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.000750+0000","last_change":"2023-08-31T19:04:03.543084+0000","last_active":"2023-08-31T19:04:04.000750+0000","last_peered":"2023-08-31T19:04:04.000750+0000","last_clean":"2023-08-31T19:04:04.000750+0000","last_became_active":"2023-08-31T19:04:03.542751+0000","last_became_peered":"2023-08-31T19:04:03.542751+0000","last_unstale":"2023-08-31T19:04:04.000750+0000","last_undegraded":"2023-08-31T19:04:04.000750+0000","last_fullsized":"2023-08-31T19:04:04.000750+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.032238+0000","last_change":"2023-08-31T19:04:04.032238+0000","last_active":"2023-08-31T19:04:04.032238+0000","last_peered":"2023-08-31T19:04:04.032238+0000","last_clean":"2023-08-31T19:04:04.032238+0000","last_became_active":"2023-08-31T19:04:04.031939+0000","last_became_peered":"2023-08-31T19:04:04.031939+0000","last_unstale":"2023-08-31T19:04:04.032238+0000","last_undegraded":"2023-08-31T19:04:04.032238+0000","last_fullsized":"2023-08-31T19:04:04.032238+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.563499+0000","last_change":"2023-08-31T19:04:03.558858+0000","last_active":"2023-08-31T19:04:03.563499+0000","last_peered":"2023-08-31T19:04:03.563499+0000","last_clean":"2023-08-31T19:04:03.563499+0000","last_became_active":"2023-08-31T19:04:03.558580+0000","last_became_peered":"2023-08-31T19:04:03.558580+0000","last_unstale":"2023-08-31T19:04:03.563499+0000","last_undegraded":"2023-08-31T19:04:03.563499+0000","last_fullsized":"2023-08-31T19:04:03.563499+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.022305+0000","last_change":"2023-08-31T19:04:04.019340+0000","last_active":"2023-08-31T19:04:04.022305+0000","last_peered":"2023-08-31T19:04:04.022305+0000","last_clean":"2023-08-31T19:04:04.022305+0000","last_became_active":"2023-08-31T19:04:04.019064+0000","last_became_peered":"2023-08-31T19:04:04.019064+0000","last_unstale":"2023-08-31T19:04:04.022305+0000","last_undegraded":"2023-08-31T19:04:04.022305+0000","last_fullsized":"2023-08-31T19:04:04.022305+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.553249+0000","last_change":"2023-08-31T19:04:03.544542+0000","last_active":"2023-08-31T19:04:03.553249+0000","last_peered":"2023-08-31T19:04:03.553249+0000","last_clean":"2023-08-31T19:04:03.553249+0000","last_became_active":"2023-08-31T19:04:03.543449+0000","last_became_peered":"2023-08-31T19:04:03.543449+0000","last_unstale":"2023-08-31T19:04:03.553249+0000","last_undegraded":"2023-08-31T19:04:03.553249+0000","last_fullsized":"2023-08-31T19:04:03.553249+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.028504+0000","last_change":"2023-08-31T19:04:04.021422+0000","last_active":"2023-08-31T19:04:04.028504+0000","last_peered":"2023-08-31T19:04:04.028504+0000","last_clean":"2023-08-31T19:04:04.028504+0000","last_became_active":"2023-08-31T19:04:04.020676+0000","last_became_peered":"2023-08-31T19:04:04.020676+0000","last_unstale":"2023-08-31T19:04:04.028504+0000","last_undegraded":"2023-08-31T19:04:04.028504+0000","last_fullsized":"2023-08-31T19:04:04.028504+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.029451+0000","last_change":"2023-08-31T19:04:03.551507+0000","last_active":"2023-08-31T19:04:04.029451+0000","last_peered":"2023-08-31T19:04:04.029451+0000","last_clean":"2023-08-31T19:04:04.029451+0000","last_became_active":"2023-08-31T19:04:03.551202+0000","last_became_peered":"2023-08-31T19:04:03.551202+0000","last_unstale":"2023-08-31T19:04:04.029451+0000","last_undegraded":"2023-08-31T19:04:04.029451+0000","last_fullsized":"2023-08-31T19:04:04.029451+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.015013+0000","last_change":"2023-08-31T19:04:04.015013+0000","last_active":"2023-08-31T19:04:04.015013+0000","last_peered":"2023-08-31T19:04:04.015013+0000","last_clean":"2023-08-31T19:04:04.015013+0000","last_became_active":"2023-08-31T19:04:04.014516+0000","last_became_peered":"2023-08-31T19:04:04.014516+0000","last_unstale":"2023-08-31T19:04:04.015013+0000","last_undegraded":"2023-08-31T19:04:04.015013+0000","last_fullsized":"2023-08-31T19:04:04.015013+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.558288+0000","last_change":"2023-08-31T19:04:03.553143+0000","last_active":"2023-08-31T19:04:03.558288+0000","last_peered":"2023-08-31T19:04:03.558288+0000","last_clean":"2023-08-31T19:04:03.558288+0000","last_became_active":"2023-08-31T19:04:03.552810+0000","last_became_peered":"2023-08-31T19:04:03.552810+0000","last_unstale":"2023-08-31T19:04:03.558288+0000","last_undegraded":"2023-08-31T19:04:03.558288+0000","last_fullsized":"2023-08-31T19:04:03.558288+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.023198+0000","last_change":"2023-08-31T19:04:04.016425+0000","last_active":"2023-08-31T19:04:04.023198+0000","last_peered":"2023-08-31T19:04:04.023198+0000","last_clean":"2023-08-31T19:04:04.023198+0000","last_became_active":"2023-08-31T19:04:04.015668+0000","last_became_peered":"2023-08-31T19:04:04.015668+0000","last_unstale":"2023-08-31T19:04:04.023198+0000","last_undegraded":"2023-08-31T19:04:04.023198+0000","last_fullsized":"2023-08-31T19:04:04.023198+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.006992+0000","last_change":"2023-08-31T19:04:03.542748+0000","last_active":"2023-08-31T19:04:04.006992+0000","last_peered":"2023-08-31T19:04:04.006992+0000","last_clean":"2023-08-31T19:04:04.006992+0000","last_became_active":"2023-08-31T19:04:03.542481+0000","last_became_peered":"2023-08-31T19:04:03.542481+0000","last_unstale":"2023-08-31T19:04:04.006992+0000","last_undegraded":"2023-08-31T19:04:04.006992+0000","last_fullsized":"2023-08-31T19:04:04.006992+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.023949+0000","last_change":"2023-08-31T19:04:04.023949+0000","last_active":"2023-08-31T19:04:04.023949+0000","last_peered":"2023-08-31T19:04:04.023949+0000","last_clean":"2023-08-31T19:04:04.023949+0000","last_became_active":"2023-08-31T19:04:04.023645+0000","last_became_peered":"2023-08-31T19:04:04.023645+0000","last_unstale":"2023-08-31T19:04:04.023949+0000","last_undegraded":"2023-08-31T19:04:04.023949+0000","last_fullsized":"2023-08-31T19:04:04.023949+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.010279+0000","last_change":"2023-08-31T19:04:03.551993+0000","last_active":"2023-08-31T19:04:04.010279+0000","last_peered":"2023-08-31T19:04:04.010279+0000","last_clean":"2023-08-31T19:04:04.010279+0000","last_became_active":"2023-08-31T19:04:03.551653+0000","last_became_peered":"2023-08-31T19:04:03.551653+0000","last_unstale":"2023-08-31T19:04:04.010279+0000","last_undegraded":"2023-08-31T19:04:04.010279+0000","last_fullsized":"2023-08-31T19:04:04.010279+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.031497+0000","last_change":"2023-08-31T19:04:04.029367+0000","last_active":"2023-08-31T19:04:04.031497+0000","last_peered":"2023-08-31T19:04:04.031497+0000","last_clean":"2023-08-31T19:04:04.031497+0000","last_became_active":"2023-08-31T19:04:04.029057+0000","last_became_peered":"2023-08-31T19:04:04.029057+0000","last_unstale":"2023-08-31T19:04:04.031497+0000","last_undegraded":"2023-08-31T19:04:04.031497+0000","last_fullsized":"2023-08-31T19:04:04.031497+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.549994+0000","last_change":"2023-08-31T19:04:03.540309+0000","last_active":"2023-08-31T19:04:03.549994+0000","last_peered":"2023-08-31T19:04:03.549994+0000","last_clean":"2023-08-31T19:04:03.549994+0000","last_became_active":"2023-08-31T19:04:03.539990+0000","last_became_peered":"2023-08-31T19:04:03.539990+0000","last_unstale":"2023-08-31T19:04:03.549994+0000","last_undegraded":"2023-08-31T19:04:03.549994+0000","last_fullsized":"2023-08-31T19:04:03.549994+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.033474+0000","last_change":"2023-08-31T19:04:04.033474+0000","last_active":"2023-08-31T19:04:04.033474+0000","last_peered":"2023-08-31T19:04:04.033474+0000","last_clean":"2023-08-31T19:04:04.033474+0000","last_became_active":"2023-08-31T19:04:04.033159+0000","last_became_peered":"2023-08-31T19:04:04.033159+0000","last_unstale":"2023-08-31T19:04:04.033474+0000","last_undegraded":"2023-08-31T19:04:04.033474+0000","last_fullsized":"2023-08-31T19:04:04.033474+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.022133+0000","last_change":"2023-08-31T19:04:03.550351+0000","last_active":"2023-08-31T19:04:04.022133+0000","last_peered":"2023-08-31T19:04:04.022133+0000","last_clean":"2023-08-31T19:04:04.022133+0000","last_became_active":"2023-08-31T19:04:03.549924+0000","last_became_peered":"2023-08-31T19:04:03.549924+0000","last_unstale":"2023-08-31T19:04:04.022133+0000","last_undegraded":"2023-08-31T19:04:04.022133+0000","last_fullsized":"2023-08-31T19:04:04.022133+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030921+0000","last_change":"2023-08-31T19:04:04.026808+0000","last_active":"2023-08-31T19:04:04.030921+0000","last_peered":"2023-08-31T19:04:04.030921+0000","last_clean":"2023-08-31T19:04:04.030921+0000","last_became_active":"2023-08-31T19:04:04.025850+0000","last_became_peered":"2023-08-31T19:04:04.025850+0000","last_unstale":"2023-08-31T19:04:04.030921+0000","last_undegraded":"2023-08-31T19:04:04.030921+0000","last_fullsized":"2023-08-31T19:04:04.030921+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.017168+0000","last_change":"2023-08-31T19:04:03.548403+0000","last_active":"2023-08-31T19:04:04.017168+0000","last_peered":"2023-08-31T19:04:04.017168+0000","last_clean":"2023-08-31T19:04:04.017168+0000","last_became_active":"2023-08-31T19:04:03.548040+0000","last_became_peered":"2023-08-31T19:04:03.548040+0000","last_unstale":"2023-08-31T19:04:04.017168+0000","last_undegraded":"2023-08-31T19:04:04.017168+0000","last_fullsized":"2023-08-31T19:04:04.017168+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.031527+0000","last_change":"2023-08-31T19:04:04.028462+0000","last_active":"2023-08-31T19:04:04.031527+0000","last_peered":"2023-08-31T19:04:04.031527+0000","last_clean":"2023-08-31T19:04:04.031527+0000","last_became_active":"2023-08-31T19:04:04.026663+0000","last_became_peered":"2023-08-31T19:04:04.026663+0000","last_unstale":"2023-08-31T19:04:04.031527+0000","last_undegraded":"2023-08-31T19:04:04.031527+0000","last_fullsized":"2023-08-31T19:04:04.031527+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.013002+0000","last_change":"2023-08-31T19:04:03.546175+0000","last_active":"2023-08-31T19:04:04.013002+0000","last_peered":"2023-08-31T19:04:04.013002+0000","last_clean":"2023-08-31T19:04:04.013002+0000","last_became_active":"2023-08-31T19:04:03.545399+0000","last_became_peered":"2023-08-31T19:04:03.545399+0000","last_unstale":"2023-08-31T19:04:04.013002+0000","last_undegraded":"2023-08-31T19:04:04.013002+0000","last_fullsized":"2023-08-31T19:04:04.013002+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.023838+0000","last_change":"2023-08-31T19:04:04.023838+0000","last_active":"2023-08-31T19:04:04.023838+0000","last_peered":"2023-08-31T19:04:04.023838+0000","last_clean":"2023-08-31T19:04:04.023838+0000","last_became_active":"2023-08-31T19:04:04.023464+0000","last_became_peered":"2023-08-31T19:04:04.023464+0000","last_unstale":"2023-08-31T19:04:04.023838+0000","last_undegraded":"2023-08-31T19:04:04.023838+0000","last_fullsized":"2023-08-31T19:04:04.023838+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.011366+0000","last_change":"2023-08-31T19:04:03.543067+0000","last_active":"2023-08-31T19:04:04.011366+0000","last_peered":"2023-08-31T19:04:04.011366+0000","last_clean":"2023-08-31T19:04:04.011366+0000","last_became_active":"2023-08-31T19:04:03.542663+0000","last_became_peered":"2023-08-31T19:04:03.542663+0000","last_unstale":"2023-08-31T19:04:04.011366+0000","last_undegraded":"2023-08-31T19:04:04.011366+0000","last_fullsized":"2023-08-31T19:04:04.011366+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030905+0000","last_change":"2023-08-31T19:04:04.026692+0000","last_active":"2023-08-31T19:04:04.030905+0000","last_peered":"2023-08-31T19:04:04.030905+0000","last_clean":"2023-08-31T19:04:04.030905+0000","last_became_active":"2023-08-31T19:04:04.026325+0000","last_became_peered":"2023-08-31T19:04:04.026325+0000","last_unstale":"2023-08-31T19:04:04.030905+0000","last_undegraded":"2023-08-31T19:04:04.030905+0000","last_fullsized":"2023-08-31T19:04:04.030905+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007848+0000","last_change":"2023-08-31T19:04:03.547131+0000","last_active":"2023-08-31T19:04:04.007848+0000","last_peered":"2023-08-31T19:04:04.007848+0000","last_clean":"2023-08-31T19:04:04.007848+0000","last_became_active":"2023-08-31T19:04:03.546494+0000","last_became_peered":"2023-08-31T19:04:03.546494+0000","last_unstale":"2023-08-31T19:04:04.007848+0000","last_undegraded":"2023-08-31T19:04:04.007848+0000","last_fullsized":"2023-08-31T19:04:04.007848+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.028459+0000","last_change":"2023-08-31T19:04:04.017025+0000","last_active":"2023-08-31T19:04:04.028459+0000","last_peered":"2023-08-31T19:04:04.028459+0000","last_clean":"2023-08-31T19:04:04.028459+0000","last_became_active":"2023-08-31T19:04:04.016717+0000","last_became_peered":"2023-08-31T19:04:04.016717+0000","last_unstale":"2023-08-31T19:04:04.028459+0000","last_undegraded":"2023-08-31T19:04:04.028459+0000","last_fullsized":"2023-08-31T19:04:04.028459+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.010064+0000","last_change":"2023-08-31T19:04:03.549960+0000","last_active":"2023-08-31T19:04:04.010064+0000","last_peered":"2023-08-31T19:04:04.010064+0000","last_clean":"2023-08-31T19:04:04.010064+0000","last_became_active":"2023-08-31T19:04:03.549611+0000","last_became_peered":"2023-08-31T19:04:03.549611+0000","last_unstale":"2023-08-31T19:04:04.010064+0000","last_undegraded":"2023-08-31T19:04:04.010064+0000","last_fullsized":"2023-08-31T19:04:04.010064+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.028382+0000","last_change":"2023-08-31T19:04:04.022836+0000","last_active":"2023-08-31T19:04:04.028382+0000","last_peered":"2023-08-31T19:04:04.028382+0000","last_clean":"2023-08-31T19:04:04.028382+0000","last_became_active":"2023-08-31T19:04:04.022475+0000","last_became_peered":"2023-08-31T19:04:04.022475+0000","last_unstale":"2023-08-31T19:04:04.028382+0000","last_undegraded":"2023-08-31T19:04:04.028382+0000","last_fullsized":"2023-08-31T19:04:04.028382+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.006103+0000","last_change":"2023-08-31T19:04:03.552134+0000","last_active":"2023-08-31T19:04:04.006103+0000","last_peered":"2023-08-31T19:04:04.006103+0000","last_clean":"2023-08-31T19:04:04.006103+0000","last_became_active":"2023-08-31T19:04:03.551698+0000","last_became_peered":"2023-08-31T19:04:03.551698+0000","last_unstale":"2023-08-31T19:04:04.006103+0000","last_undegraded":"2023-08-31T19:04:04.006103+0000","last_fullsized":"2023-08-31T19:04:04.006103+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.004443+0000","last_change":"2023-08-31T19:04:04.004443+0000","last_active":"2023-08-31T19:04:04.004443+0000","last_peered":"2023-08-31T19:04:04.004443+0000","last_clean":"2023-08-31T19:04:04.004443+0000","last_became_active":"2023-08-31T19:04:04.004106+0000","last_became_peered":"2023-08-31T19:04:04.004106+0000","last_unstale":"2023-08-31T19:04:04.004443+0000","last_undegraded":"2023-08-31T19:04:04.004443+0000","last_fullsized":"2023-08-31T19:04:04.004443+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007841+0000","last_change":"2023-08-31T19:04:03.548033+0000","last_active":"2023-08-31T19:04:04.007841+0000","last_peered":"2023-08-31T19:04:04.007841+0000","last_clean":"2023-08-31T19:04:04.007841+0000","last_became_active":"2023-08-31T19:04:03.547724+0000","last_became_peered":"2023-08-31T19:04:03.547724+0000","last_unstale":"2023-08-31T19:04:04.007841+0000","last_undegraded":"2023-08-31T19:04:04.007841+0000","last_fullsized":"2023-08-31T19:04:04.007841+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.024615+0000","last_change":"2023-08-31T19:04:04.024615+0000","last_active":"2023-08-31T19:04:04.024615+0000","last_peered":"2023-08-31T19:04:04.024615+0000","last_clean":"2023-08-31T19:04:04.024615+0000","last_became_active":"2023-08-31T19:04:04.024323+0000","last_became_peered":"2023-08-31T19:04:04.024323+0000","last_unstale":"2023-08-31T19:04:04.024615+0000","last_undegraded":"2023-08-31T19:04:04.024615+0000","last_fullsized":"2023-08-31T19:04:04.024615+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.006472+0000","last_change":"2023-08-31T19:04:03.555057+0000","last_active":"2023-08-31T19:04:04.006472+0000","last_peered":"2023-08-31T19:04:04.006472+0000","last_clean":"2023-08-31T19:04:04.006472+0000","last_became_active":"2023-08-31T19:04:03.554754+0000","last_became_peered":"2023-08-31T19:04:03.554754+0000","last_unstale":"2023-08-31T19:04:04.006472+0000","last_undegraded":"2023-08-31T19:04:04.006472+0000","last_fullsized":"2023-08-31T19:04:04.006472+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.028463+0000","last_change":"2023-08-31T19:04:04.023536+0000","last_active":"2023-08-31T19:04:04.028463+0000","last_peered":"2023-08-31T19:04:04.028463+0000","last_clean":"2023-08-31T19:04:04.028463+0000","last_became_active":"2023-08-31T19:04:04.023241+0000","last_became_peered":"2023-08-31T19:04:04.023241+0000","last_unstale":"2023-08-31T19:04:04.028463+0000","last_undegraded":"2023-08-31T19:04:04.028463+0000","last_fullsized":"2023-08-31T19:04:04.028463+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007970+0000","last_change":"2023-08-31T19:04:03.555319+0000","last_active":"2023-08-31T19:04:04.007970+0000","last_peered":"2023-08-31T19:04:04.007970+0000","last_clean":"2023-08-31T19:04:04.007970+0000","last_became_active":"2023-08-31T19:04:03.554797+0000","last_became_peered":"2023-08-31T19:04:03.554797+0000","last_unstale":"2023-08-31T19:04:04.007970+0000","last_undegraded":"2023-08-31T19:04:04.007970+0000","last_fullsized":"2023-08-31T19:04:04.007970+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.022552+0000","last_change":"2023-08-31T19:04:04.021453+0000","last_active":"2023-08-31T19:04:04.022552+0000","last_peered":"2023-08-31T19:04:04.022552+0000","last_clean":"2023-08-31T19:04:04.022552+0000","last_became_active":"2023-08-31T19:04:04.021121+0000","last_became_peered":"2023-08-31T19:04:04.021121+0000","last_unstale":"2023-08-31T19:04:04.022552+0000","last_undegraded":"2023-08-31T19:04:04.022552+0000","last_fullsized":"2023-08-31T19:04:04.022552+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007699+0000","last_change":"2023-08-31T19:04:03.549553+0000","last_active":"2023-08-31T19:04:04.007699+0000","last_peered":"2023-08-31T19:04:04.007699+0000","last_clean":"2023-08-31T19:04:04.007699+0000","last_became_active":"2023-08-31T19:04:03.548695+0000","last_became_peered":"2023-08-31T19:04:03.548695+0000","last_unstale":"2023-08-31T19:04:04.007699+0000","last_undegraded":"2023-08-31T19:04:04.007699+0000","last_fullsized":"2023-08-31T19:04:04.007699+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.015865+0000","last_change":"2023-08-31T19:04:04.015865+0000","last_active":"2023-08-31T19:04:04.015865+0000","last_peered":"2023-08-31T19:04:04.015865+0000","last_clean":"2023-08-31T19:04:04.015865+0000","last_became_active":"2023-08-31T19:04:04.015577+0000","last_became_peered":"2023-08-31T19:04:04.015577+0000","last_unstale":"2023-08-31T19:04:04.015865+0000","last_undegraded":"2023-08-31T19:04:04.015865+0000","last_fullsized":"2023-08-31T19:04:04.015865+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.998340+0000","last_change":"2023-08-31T19:04:03.555128+0000","last_active":"2023-08-31T19:04:03.998340+0000","last_peered":"2023-08-31T19:04:03.998340+0000","last_clean":"2023-08-31T19:04:03.998340+0000","last_became_active":"2023-08-31T19:04:03.554296+0000","last_became_peered":"2023-08-31T19:04:03.554296+0000","last_unstale":"2023-08-31T19:04:03.998340+0000","last_undegraded":"2023-08-31T19:04:03.998340+0000","last_fullsized":"2023-08-31T19:04:03.998340+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030584+0000","last_change":"2023-08-31T19:04:04.022811+0000","last_active":"2023-08-31T19:04:04.030584+0000","last_peered":"2023-08-31T19:04:04.030584+0000","last_clean":"2023-08-31T19:04:04.030584+0000","last_became_active":"2023-08-31T19:04:04.022552+0000","last_became_peered":"2023-08-31T19:04:04.022552+0000","last_unstale":"2023-08-31T19:04:04.030584+0000","last_undegraded":"2023-08-31T19:04:04.030584+0000","last_fullsized":"2023-08-31T19:04:04.030584+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"93'1","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.013001+0000","last_change":"2023-08-31T19:04:03.553132+0000","last_active":"2023-08-31T19:04:04.013001+0000","last_peered":"2023-08-31T19:04:04.013001+0000","last_clean":"2023-08-31T19:04:04.013001+0000","last_became_active":"2023-08-31T19:04:03.552738+0000","last_became_peered":"2023-08-31T19:04:03.552738+0000","last_unstale":"2023-08-31T19:04:04.013001+0000","last_undegraded":"2023-08-31T19:04:04.013001+0000","last_fullsized":"2023-08-31T19:04:04.013001+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.014811+0000","last_change":"2023-08-31T19:04:04.014811+0000","last_active":"2023-08-31T19:04:04.014811+0000","last_peered":"2023-08-31T19:04:04.014811+0000","last_clean":"2023-08-31T19:04:04.014811+0000","last_became_active":"2023-08-31T19:04:04.014574+0000","last_became_peered":"2023-08-31T19:04:04.014574+0000","last_unstale":"2023-08-31T19:04:04.014811+0000","last_undegraded":"2023-08-31T19:04:04.014811+0000","last_fullsized":"2023-08-31T19:04:04.014811+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.027259+0000","last_change":"2023-08-31T19:04:03.545336+0000","last_active":"2023-08-31T19:04:04.027259+0000","last_peered":"2023-08-31T19:04:04.027259+0000","last_clean":"2023-08-31T19:04:04.027259+0000","last_became_active":"2023-08-31T19:04:03.545028+0000","last_became_peered":"2023-08-31T19:04:03.545028+0000","last_unstale":"2023-08-31T19:04:04.027259+0000","last_undegraded":"2023-08-31T19:04:04.027259+0000","last_fullsized":"2023-08-31T19:04:04.027259+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030296+0000","last_change":"2023-08-31T19:04:04.025409+0000","last_active":"2023-08-31T19:04:04.030296+0000","last_peered":"2023-08-31T19:04:04.030296+0000","last_clean":"2023-08-31T19:04:04.030296+0000","last_became_active":"2023-08-31T19:04:04.025053+0000","last_became_peered":"2023-08-31T19:04:04.025053+0000","last_unstale":"2023-08-31T19:04:04.030296+0000","last_undegraded":"2023-08-31T19:04:04.030296+0000","last_fullsized":"2023-08-31T19:04:04.030296+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.022152+0000","last_change":"2023-08-31T19:04:03.538875+0000","last_active":"2023-08-31T19:04:04.022152+0000","last_peered":"2023-08-31T19:04:04.022152+0000","last_clean":"2023-08-31T19:04:04.022152+0000","last_became_active":"2023-08-31T19:04:03.538538+0000","last_became_peered":"2023-08-31T19:04:03.538538+0000","last_unstale":"2023-08-31T19:04:04.022152+0000","last_undegraded":"2023-08-31T19:04:04.022152+0000","last_fullsized":"2023-08-31T19:04:04.022152+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.031393+0000","last_change":"2023-08-31T19:04:04.029021+0000","last_active":"2023-08-31T19:04:04.031393+0000","last_peered":"2023-08-31T19:04:04.031393+0000","last_clean":"2023-08-31T19:04:04.031393+0000","last_became_active":"2023-08-31T19:04:04.028684+0000","last_became_peered":"2023-08-31T19:04:04.028684+0000","last_unstale":"2023-08-31T19:04:04.031393+0000","last_undegraded":"2023-08-31T19:04:04.031393+0000","last_fullsized":"2023-08-31T19:04:04.031393+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.998279+0000","last_change":"2023-08-31T19:04:03.553676+0000","last_active":"2023-08-31T19:04:03.998279+0000","last_peered":"2023-08-31T19:04:03.998279+0000","last_clean":"2023-08-31T19:04:03.998279+0000","last_became_active":"2023-08-31T19:04:03.553373+0000","last_became_peered":"2023-08-31T19:04:03.553373+0000","last_unstale":"2023-08-31T19:04:03.998279+0000","last_undegraded":"2023-08-31T19:04:03.998279+0000","last_fullsized":"2023-08-31T19:04:03.998279+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.032119+0000","last_change":"2023-08-31T19:04:04.032119+0000","last_active":"2023-08-31T19:04:04.032119+0000","last_peered":"2023-08-31T19:04:04.032119+0000","last_clean":"2023-08-31T19:04:04.032119+0000","last_became_active":"2023-08-31T19:04:04.031832+0000","last_became_peered":"2023-08-31T19:04:04.031832+0000","last_unstale":"2023-08-31T19:04:04.032119+0000","last_undegraded":"2023-08-31T19:04:04.032119+0000","last_fullsized":"2023-08-31T19:04:04.032119+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.008651+0000","last_change":"2023-08-31T19:04:03.544317+0000","last_active":"2023-08-31T19:04:04.008651+0000","last_peered":"2023-08-31T19:04:04.008651+0000","last_clean":"2023-08-31T19:04:04.008651+0000","last_became_active":"2023-08-31T19:04:03.544025+0000","last_became_peered":"2023-08-31T19:04:03.544025+0000","last_unstale":"2023-08-31T19:04:04.008651+0000","last_undegraded":"2023-08-31T19:04:04.008651+0000","last_fullsized":"2023-08-31T19:04:04.008651+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.031185+0000","last_change":"2023-08-31T19:04:04.031185+0000","last_active":"2023-08-31T19:04:04.031185+0000","last_peered":"2023-08-31T19:04:04.031185+0000","last_clean":"2023-08-31T19:04:04.031185+0000","last_became_active":"2023-08-31T19:04:04.030853+0000","last_became_peered":"2023-08-31T19:04:04.030853+0000","last_unstale":"2023-08-31T19:04:04.031185+0000","last_undegraded":"2023-08-31T19:04:04.031185+0000","last_fullsized":"2023-08-31T19:04:04.031185+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007999+0000","last_change":"2023-08-31T19:04:03.555135+0000","last_active":"2023-08-31T19:04:04.007999+0000","last_peered":"2023-08-31T19:04:04.007999+0000","last_clean":"2023-08-31T19:04:04.007999+0000","last_became_active":"2023-08-31T19:04:03.554364+0000","last_became_peered":"2023-08-31T19:04:03.554364+0000","last_unstale":"2023-08-31T19:04:04.007999+0000","last_undegraded":"2023-08-31T19:04:04.007999+0000","last_fullsized":"2023-08-31T19:04:04.007999+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030017+0000","last_change":"2023-08-31T19:04:04.024201+0000","last_active":"2023-08-31T19:04:04.030017+0000","last_peered":"2023-08-31T19:04:04.030017+0000","last_clean":"2023-08-31T19:04:04.030017+0000","last_became_active":"2023-08-31T19:04:04.023899+0000","last_became_peered":"2023-08-31T19:04:04.023899+0000","last_unstale":"2023-08-31T19:04:04.030017+0000","last_undegraded":"2023-08-31T19:04:04.030017+0000","last_fullsized":"2023-08-31T19:04:04.030017+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.537662+0000","last_change":"2023-08-31T19:04:03.535896+0000","last_active":"2023-08-31T19:04:03.537662+0000","last_peered":"2023-08-31T19:04:03.537662+0000","last_clean":"2023-08-31T19:04:03.537662+0000","last_became_active":"2023-08-31T19:04:03.535626+0000","last_became_peered":"2023-08-31T19:04:03.535626+0000","last_unstale":"2023-08-31T19:04:03.537662+0000","last_undegraded":"2023-08-31T19:04:03.537662+0000","last_fullsized":"2023-08-31T19:04:03.537662+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.029906+0000","last_change":"2023-08-31T19:04:04.026220+0000","last_active":"2023-08-31T19:04:04.029906+0000","last_peered":"2023-08-31T19:04:04.029906+0000","last_clean":"2023-08-31T19:04:04.029906+0000","last_became_active":"2023-08-31T19:04:04.025740+0000","last_became_peered":"2023-08-31T19:04:04.025740+0000","last_unstale":"2023-08-31T19:04:04.029906+0000","last_undegraded":"2023-08-31T19:04:04.029906+0000","last_fullsized":"2023-08-31T19:04:04.029906+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.552273+0000","last_change":"2023-08-31T19:04:03.550186+0000","last_active":"2023-08-31T19:04:03.552273+0000","last_peered":"2023-08-31T19:04:03.552273+0000","last_clean":"2023-08-31T19:04:03.552273+0000","last_became_active":"2023-08-31T19:04:03.549840+0000","last_became_peered":"2023-08-31T19:04:03.549840+0000","last_unstale":"2023-08-31T19:04:03.552273+0000","last_undegraded":"2023-08-31T19:04:03.552273+0000","last_fullsized":"2023-08-31T19:04:03.552273+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.019541+0000","last_change":"2023-08-31T19:04:04.019541+0000","last_active":"2023-08-31T19:04:04.019541+0000","last_peered":"2023-08-31T19:04:04.019541+0000","last_clean":"2023-08-31T19:04:04.019541+0000","last_became_active":"2023-08-31T19:04:04.019284+0000","last_became_peered":"2023-08-31T19:04:04.019284+0000","last_unstale":"2023-08-31T19:04:04.019541+0000","last_undegraded":"2023-08-31T19:04:04.019541+0000","last_fullsized":"2023-08-31T19:04:04.019541+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.013615+0000","last_change":"2023-08-31T19:04:03.544087+0000","last_active":"2023-08-31T19:04:04.013615+0000","last_peered":"2023-08-31T19:04:04.013615+0000","last_clean":"2023-08-31T19:04:04.013615+0000","last_became_active":"2023-08-31T19:04:03.543769+0000","last_became_peered":"2023-08-31T19:04:03.543769+0000","last_unstale":"2023-08-31T19:04:04.013615+0000","last_undegraded":"2023-08-31T19:04:04.013615+0000","last_fullsized":"2023-08-31T19:04:04.013615+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.029982+0000","last_change":"2023-08-31T19:04:04.027915+0000","last_active":"2023-08-31T19:04:04.029982+0000","last_peered":"2023-08-31T19:04:04.029982+0000","last_clean":"2023-08-31T19:04:04.029982+0000","last_became_active":"2023-08-31T19:04:04.027519+0000","last_became_peered":"2023-08-31T19:04:04.027519+0000","last_unstale":"2023-08-31T19:04:04.029982+0000","last_undegraded":"2023-08-31T19:04:04.029982+0000","last_fullsized":"2023-08-31T19:04:04.029982+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.010096+0000","last_change":"2023-08-31T19:04:03.545387+0000","last_active":"2023-08-31T19:04:04.010096+0000","last_peered":"2023-08-31T19:04:04.010096+0000","last_clean":"2023-08-31T19:04:04.010096+0000","last_became_active":"2023-08-31T19:04:03.545072+0000","last_became_peered":"2023-08-31T19:04:03.545072+0000","last_unstale":"2023-08-31T19:04:04.010096+0000","last_undegraded":"2023-08-31T19:04:04.010096+0000","last_fullsized":"2023-08-31T19:04:04.010096+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.021056+0000","last_change":"2023-08-31T19:04:04.018521+0000","last_active":"2023-08-31T19:04:04.021056+0000","last_peered":"2023-08-31T19:04:04.021056+0000","last_clean":"2023-08-31T19:04:04.021056+0000","last_became_active":"2023-08-31T19:04:04.018253+0000","last_became_peered":"2023-08-31T19:04:04.018253+0000","last_unstale":"2023-08-31T19:04:04.021056+0000","last_undegraded":"2023-08-31T19:04:04.021056+0000","last_fullsized":"2023-08-31T19:04:04.021056+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"93'3","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.032567+0000","last_change":"2023-08-31T19:04:03.548727+0000","last_active":"2023-08-31T19:04:04.032567+0000","last_peered":"2023-08-31T19:04:04.032567+0000","last_clean":"2023-08-31T19:04:04.032567+0000","last_became_active":"2023-08-31T19:04:03.548391+0000","last_became_peered":"2023-08-31T19:04:03.548391+0000","last_unstale":"2023-08-31T19:04:04.032567+0000","last_undegraded":"2023-08-31T19:04:04.032567+0000","last_fullsized":"2023-08-31T19:04:04.032567+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.028562+0000","last_change":"2023-08-31T19:04:04.019423+0000","last_active":"2023-08-31T19:04:04.028562+0000","last_peered":"2023-08-31T19:04:04.028562+0000","last_clean":"2023-08-31T19:04:04.028562+0000","last_became_active":"2023-08-31T19:04:04.019162+0000","last_became_peered":"2023-08-31T19:04:04.019162+0000","last_unstale":"2023-08-31T19:04:04.028562+0000","last_undegraded":"2023-08-31T19:04:04.028562+0000","last_fullsized":"2023-08-31T19:04:04.028562+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.021777+0000","last_change":"2023-08-31T19:04:03.551516+0000","last_active":"2023-08-31T19:04:04.021777+0000","last_peered":"2023-08-31T19:04:04.021777+0000","last_clean":"2023-08-31T19:04:04.021777+0000","last_became_active":"2023-08-31T19:04:03.551183+0000","last_became_peered":"2023-08-31T19:04:03.551183+0000","last_unstale":"2023-08-31T19:04:04.021777+0000","last_undegraded":"2023-08-31T19:04:04.021777+0000","last_fullsized":"2023-08-31T19:04:04.021777+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.022078+0000","last_change":"2023-08-31T19:04:04.018546+0000","last_active":"2023-08-31T19:04:04.022078+0000","last_peered":"2023-08-31T19:04:04.022078+0000","last_clean":"2023-08-31T19:04:04.022078+0000","last_became_active":"2023-08-31T19:04:04.018252+0000","last_became_peered":"2023-08-31T19:04:04.018252+0000","last_unstale":"2023-08-31T19:04:04.022078+0000","last_undegraded":"2023-08-31T19:04:04.022078+0000","last_fullsized":"2023-08-31T19:04:04.022078+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.027486+0000","last_change":"2023-08-31T19:04:03.547120+0000","last_active":"2023-08-31T19:04:04.027486+0000","last_peered":"2023-08-31T19:04:04.027486+0000","last_clean":"2023-08-31T19:04:04.027486+0000","last_became_active":"2023-08-31T19:04:03.546820+0000","last_became_peered":"2023-08-31T19:04:03.546820+0000","last_unstale":"2023-08-31T19:04:04.027486+0000","last_undegraded":"2023-08-31T19:04:04.027486+0000","last_fullsized":"2023-08-31T19:04:04.027486+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.019567+0000","last_change":"2023-08-31T19:04:04.014061+0000","last_active":"2023-08-31T19:04:04.019567+0000","last_peered":"2023-08-31T19:04:04.019567+0000","last_clean":"2023-08-31T19:04:04.019567+0000","last_became_active":"2023-08-31T19:04:04.013749+0000","last_became_peered":"2023-08-31T19:04:04.013749+0000","last_unstale":"2023-08-31T19:04:04.019567+0000","last_undegraded":"2023-08-31T19:04:04.019567+0000","last_fullsized":"2023-08-31T19:04:04.019567+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.011428+0000","last_change":"2023-08-31T19:04:03.543738+0000","last_active":"2023-08-31T19:04:04.011428+0000","last_peered":"2023-08-31T19:04:04.011428+0000","last_clean":"2023-08-31T19:04:04.011428+0000","last_became_active":"2023-08-31T19:04:03.543408+0000","last_became_peered":"2023-08-31T19:04:03.543408+0000","last_unstale":"2023-08-31T19:04:04.011428+0000","last_undegraded":"2023-08-31T19:04:04.011428+0000","last_fullsized":"2023-08-31T19:04:04.011428+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.029958+0000","last_change":"2023-08-31T19:04:04.027745+0000","last_active":"2023-08-31T19:04:04.029958+0000","last_peered":"2023-08-31T19:04:04.029958+0000","last_clean":"2023-08-31T19:04:04.029958+0000","last_became_active":"2023-08-31T19:04:04.027459+0000","last_became_peered":"2023-08-31T19:04:04.027459+0000","last_unstale":"2023-08-31T19:04:04.029958+0000","last_undegraded":"2023-08-31T19:04:04.029958+0000","last_fullsized":"2023-08-31T19:04:04.029958+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.551070+0000","last_change":"2023-08-31T19:04:03.546962+0000","last_active":"2023-08-31T19:04:03.551070+0000","last_peered":"2023-08-31T19:04:03.551070+0000","last_clean":"2023-08-31T19:04:03.551070+0000","last_became_active":"2023-08-31T19:04:03.546653+0000","last_became_peered":"2023-08-31T19:04:03.546653+0000","last_unstale":"2023-08-31T19:04:03.551070+0000","last_undegraded":"2023-08-31T19:04:03.551070+0000","last_fullsized":"2023-08-31T19:04:03.551070+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.025380+0000","last_change":"2023-08-31T19:04:04.019638+0000","last_active":"2023-08-31T19:04:04.025380+0000","last_peered":"2023-08-31T19:04:04.025380+0000","last_clean":"2023-08-31T19:04:04.025380+0000","last_became_active":"2023-08-31T19:04:04.019295+0000","last_became_peered":"2023-08-31T19:04:04.019295+0000","last_unstale":"2023-08-31T19:04:04.025380+0000","last_undegraded":"2023-08-31T19:04:04.025380+0000","last_fullsized":"2023-08-31T19:04:04.025380+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"93'4","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.019932+0000","last_change":"2023-08-31T19:04:03.543461+0000","last_active":"2023-08-31T19:04:04.019932+0000","last_peered":"2023-08-31T19:04:04.019932+0000","last_clean":"2023-08-31T19:04:04.019932+0000","last_became_active":"2023-08-31T19:04:03.543167+0000","last_became_peered":"2023-08-31T19:04:03.543167+0000","last_unstale":"2023-08-31T19:04:04.019932+0000","last_undegraded":"2023-08-31T19:04:04.019932+0000","last_fullsized":"2023-08-31T19:04:04.019932+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.029780+0000","last_change":"2023-08-31T19:04:04.024304+0000","last_active":"2023-08-31T19:04:04.029780+0000","last_peered":"2023-08-31T19:04:04.029780+0000","last_clean":"2023-08-31T19:04:04.029780+0000","last_became_active":"2023-08-31T19:04:04.023831+0000","last_became_peered":"2023-08-31T19:04:04.023831+0000","last_unstale":"2023-08-31T19:04:04.029780+0000","last_undegraded":"2023-08-31T19:04:04.029780+0000","last_fullsized":"2023-08-31T19:04:04.029780+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.032020+0000","last_change":"2023-08-31T19:04:03.549050+0000","last_active":"2023-08-31T19:04:04.032020+0000","last_peered":"2023-08-31T19:04:04.032020+0000","last_clean":"2023-08-31T19:04:04.032020+0000","last_became_active":"2023-08-31T19:04:03.548729+0000","last_became_peered":"2023-08-31T19:04:03.548729+0000","last_unstale":"2023-08-31T19:04:04.032020+0000","last_undegraded":"2023-08-31T19:04:04.032020+0000","last_fullsized":"2023-08-31T19:04:04.032020+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.021957+0000","last_change":"2023-08-31T19:04:04.018696+0000","last_active":"2023-08-31T19:04:04.021957+0000","last_peered":"2023-08-31T19:04:04.021957+0000","last_clean":"2023-08-31T19:04:04.021957+0000","last_became_active":"2023-08-31T19:04:04.018349+0000","last_became_peered":"2023-08-31T19:04:04.018349+0000","last_unstale":"2023-08-31T19:04:04.021957+0000","last_undegraded":"2023-08-31T19:04:04.021957+0000","last_fullsized":"2023-08-31T19:04:04.021957+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.553548+0000","last_change":"2023-08-31T19:04:03.544163+0000","last_active":"2023-08-31T19:04:03.553548+0000","last_peered":"2023-08-31T19:04:03.553548+0000","last_clean":"2023-08-31T19:04:03.553548+0000","last_became_active":"2023-08-31T19:04:03.543861+0000","last_became_peered":"2023-08-31T19:04:03.543861+0000","last_unstale":"2023-08-31T19:04:03.553548+0000","last_undegraded":"2023-08-31T19:04:03.553548+0000","last_fullsized":"2023-08-31T19:04:03.553548+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.029291+0000","last_change":"2023-08-31T19:04:04.022829+0000","last_active":"2023-08-31T19:04:04.029291+0000","last_peered":"2023-08-31T19:04:04.029291+0000","last_clean":"2023-08-31T19:04:04.029291+0000","last_became_active":"2023-08-31T19:04:04.022479+0000","last_became_peered":"2023-08-31T19:04:04.022479+0000","last_unstale":"2023-08-31T19:04:04.029291+0000","last_undegraded":"2023-08-31T19:04:04.029291+0000","last_fullsized":"2023-08-31T19:04:04.029291+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.012614+0000","last_change":"2023-08-31T19:04:03.541085+0000","last_active":"2023-08-31T19:04:04.012614+0000","last_peered":"2023-08-31T19:04:04.012614+0000","last_clean":"2023-08-31T19:04:04.012614+0000","last_became_active":"2023-08-31T19:04:03.540790+0000","last_became_peered":"2023-08-31T19:04:03.540790+0000","last_unstale":"2023-08-31T19:04:04.012614+0000","last_undegraded":"2023-08-31T19:04:04.012614+0000","last_fullsized":"2023-08-31T19:04:04.012614+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.018867+0000","last_change":"2023-08-31T19:04:04.018867+0000","last_active":"2023-08-31T19:04:04.018867+0000","last_peered":"2023-08-31T19:04:04.018867+0000","last_clean":"2023-08-31T19:04:04.018867+0000","last_became_active":"2023-08-31T19:04:04.018578+0000","last_became_peered":"2023-08-31T19:04:04.018578+0000","last_unstale":"2023-08-31T19:04:04.018867+0000","last_undegraded":"2023-08-31T19:04:04.018867+0000","last_fullsized":"2023-08-31T19:04:04.018867+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.013930+0000","last_change":"2023-08-31T19:04:03.555232+0000","last_active":"2023-08-31T19:04:04.013930+0000","last_peered":"2023-08-31T19:04:04.013930+0000","last_clean":"2023-08-31T19:04:04.013930+0000","last_became_active":"2023-08-31T19:04:03.554658+0000","last_became_peered":"2023-08-31T19:04:03.554658+0000","last_unstale":"2023-08-31T19:04:04.013930+0000","last_undegraded":"2023-08-31T19:04:04.013930+0000","last_fullsized":"2023-08-31T19:04:04.013930+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.019542+0000","last_change":"2023-08-31T19:04:04.017172+0000","last_active":"2023-08-31T19:04:04.019542+0000","last_peered":"2023-08-31T19:04:04.019542+0000","last_clean":"2023-08-31T19:04:04.019542+0000","last_became_active":"2023-08-31T19:04:04.016842+0000","last_became_peered":"2023-08-31T19:04:04.016842+0000","last_unstale":"2023-08-31T19:04:04.019542+0000","last_undegraded":"2023-08-31T19:04:04.019542+0000","last_fullsized":"2023-08-31T19:04:04.019542+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.998267+0000","last_change":"2023-08-31T19:04:03.554164+0000","last_active":"2023-08-31T19:04:03.998267+0000","last_peered":"2023-08-31T19:04:03.998267+0000","last_clean":"2023-08-31T19:04:03.998267+0000","last_became_active":"2023-08-31T19:04:03.553621+0000","last_became_peered":"2023-08-31T19:04:03.553621+0000","last_unstale":"2023-08-31T19:04:03.998267+0000","last_undegraded":"2023-08-31T19:04:03.998267+0000","last_fullsized":"2023-08-31T19:04:03.998267+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030184+0000","last_change":"2023-08-31T19:04:04.026207+0000","last_active":"2023-08-31T19:04:04.030184+0000","last_peered":"2023-08-31T19:04:04.030184+0000","last_clean":"2023-08-31T19:04:04.030184+0000","last_became_active":"2023-08-31T19:04:04.025847+0000","last_became_peered":"2023-08-31T19:04:04.025847+0000","last_unstale":"2023-08-31T19:04:04.030184+0000","last_undegraded":"2023-08-31T19:04:04.030184+0000","last_fullsized":"2023-08-31T19:04:04.030184+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.551087+0000","last_change":"2023-08-31T19:04:03.547190+0000","last_active":"2023-08-31T19:04:03.551087+0000","last_peered":"2023-08-31T19:04:03.551087+0000","last_clean":"2023-08-31T19:04:03.551087+0000","last_became_active":"2023-08-31T19:04:03.546868+0000","last_became_peered":"2023-08-31T19:04:03.546868+0000","last_unstale":"2023-08-31T19:04:03.551087+0000","last_undegraded":"2023-08-31T19:04:03.551087+0000","last_fullsized":"2023-08-31T19:04:03.551087+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.031508+0000","last_change":"2023-08-31T19:04:04.025091+0000","last_active":"2023-08-31T19:04:04.031508+0000","last_peered":"2023-08-31T19:04:04.031508+0000","last_clean":"2023-08-31T19:04:04.031508+0000","last_became_active":"2023-08-31T19:04:04.024803+0000","last_became_peered":"2023-08-31T19:04:04.024803+0000","last_unstale":"2023-08-31T19:04:04.031508+0000","last_undegraded":"2023-08-31T19:04:04.031508+0000","last_fullsized":"2023-08-31T19:04:04.031508+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.998877+0000","last_change":"2023-08-31T19:04:03.554965+0000","last_active":"2023-08-31T19:04:03.998877+0000","last_peered":"2023-08-31T19:04:03.998877+0000","last_clean":"2023-08-31T19:04:03.998877+0000","last_became_active":"2023-08-31T19:04:03.554591+0000","last_became_peered":"2023-08-31T19:04:03.554591+0000","last_unstale":"2023-08-31T19:04:03.998877+0000","last_undegraded":"2023-08-31T19:04:03.998877+0000","last_fullsized":"2023-08-31T19:04:03.998877+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.028621+0000","last_change":"2023-08-31T19:04:04.017674+0000","last_active":"2023-08-31T19:04:04.028621+0000","last_peered":"2023-08-31T19:04:04.028621+0000","last_clean":"2023-08-31T19:04:04.028621+0000","last_became_active":"2023-08-31T19:04:04.017426+0000","last_became_peered":"2023-08-31T19:04:04.017426+0000","last_unstale":"2023-08-31T19:04:04.028621+0000","last_undegraded":"2023-08-31T19:04:04.028621+0000","last_fullsized":"2023-08-31T19:04:04.028621+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.006281+0000","last_change":"2023-08-31T19:04:03.546555+0000","last_active":"2023-08-31T19:04:04.006281+0000","last_peered":"2023-08-31T19:04:04.006281+0000","last_clean":"2023-08-31T19:04:04.006281+0000","last_became_active":"2023-08-31T19:04:03.546173+0000","last_became_peered":"2023-08-31T19:04:03.546173+0000","last_unstale":"2023-08-31T19:04:04.006281+0000","last_undegraded":"2023-08-31T19:04:04.006281+0000","last_fullsized":"2023-08-31T19:04:04.006281+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.023403+0000","last_change":"2023-08-31T19:04:04.023403+0000","last_active":"2023-08-31T19:04:04.023403+0000","last_peered":"2023-08-31T19:04:04.023403+0000","last_clean":"2023-08-31T19:04:04.023403+0000","last_became_active":"2023-08-31T19:04:04.022928+0000","last_became_peered":"2023-08-31T19:04:04.022928+0000","last_unstale":"2023-08-31T19:04:04.023403+0000","last_undegraded":"2023-08-31T19:04:04.023403+0000","last_fullsized":"2023-08-31T19:04:04.023403+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.551058+0000","last_change":"2023-08-31T19:04:03.545965+0000","last_active":"2023-08-31T19:04:03.551058+0000","last_peered":"2023-08-31T19:04:03.551058+0000","last_clean":"2023-08-31T19:04:03.551058+0000","last_became_active":"2023-08-31T19:04:03.545654+0000","last_became_peered":"2023-08-31T19:04:03.545654+0000","last_unstale":"2023-08-31T19:04:03.551058+0000","last_undegraded":"2023-08-31T19:04:03.551058+0000","last_fullsized":"2023-08-31T19:04:03.551058+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":82,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007051+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:04:04.007051+0000","last_peered":"2023-08-31T19:04:04.007051+0000","last_clean":"2023-08-31T19:04:04.007051+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:04:04.007051+0000","last_undegraded":"2023-08-31T19:04:04.007051+0000","last_fullsized":"2023-08-31T19:04:04.007051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.014510+0000","last_change":"2023-08-31T19:04:04.014510+0000","last_active":"2023-08-31T19:04:04.014510+0000","last_peered":"2023-08-31T19:04:04.014510+0000","last_clean":"2023-08-31T19:04:04.014510+0000","last_became_active":"2023-08-31T19:04:04.014201+0000","last_became_peered":"2023-08-31T19:04:04.014201+0000","last_unstale":"2023-08-31T19:04:04.014510+0000","last_undegraded":"2023-08-31T19:04:04.014510+0000","last_fullsized":"2023-08-31T19:04:04.014510+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.018190+0000","last_change":"2023-08-31T19:04:03.546125+0000","last_active":"2023-08-31T19:04:04.018190+0000","last_peered":"2023-08-31T19:04:04.018190+0000","last_clean":"2023-08-31T19:04:04.018190+0000","last_became_active":"2023-08-31T19:04:03.545801+0000","last_became_peered":"2023-08-31T19:04:03.545801+0000","last_unstale":"2023-08-31T19:04:04.018190+0000","last_undegraded":"2023-08-31T19:04:04.018190+0000","last_fullsized":"2023-08-31T19:04:04.018190+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":77,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.008059+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:04:04.008059+0000","last_peered":"2023-08-31T19:04:04.008059+0000","last_clean":"2023-08-31T19:04:04.008059+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:04:04.008059+0000","last_undegraded":"2023-08-31T19:04:04.008059+0000","last_fullsized":"2023-08-31T19:04:04.008059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.019811+0000","last_change":"2023-08-31T19:04:04.015546+0000","last_active":"2023-08-31T19:04:04.019811+0000","last_peered":"2023-08-31T19:04:04.019811+0000","last_clean":"2023-08-31T19:04:04.019811+0000","last_became_active":"2023-08-31T19:04:04.015267+0000","last_became_peered":"2023-08-31T19:04:04.015267+0000","last_unstale":"2023-08-31T19:04:04.019811+0000","last_undegraded":"2023-08-31T19:04:04.019811+0000","last_fullsized":"2023-08-31T19:04:04.019811+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.006356+0000","last_change":"2023-08-31T19:04:03.555603+0000","last_active":"2023-08-31T19:04:04.006356+0000","last_peered":"2023-08-31T19:04:04.006356+0000","last_clean":"2023-08-31T19:04:04.006356+0000","last_became_active":"2023-08-31T19:04:03.555300+0000","last_became_peered":"2023-08-31T19:04:03.555300+0000","last_unstale":"2023-08-31T19:04:04.006356+0000","last_undegraded":"2023-08-31T19:04:04.006356+0000","last_fullsized":"2023-08-31T19:04:04.006356+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":78,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.535206+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:04:03.535206+0000","last_peered":"2023-08-31T19:04:03.535206+0000","last_clean":"2023-08-31T19:04:03.535206+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:04:03.535206+0000","last_undegraded":"2023-08-31T19:04:03.535206+0000","last_fullsized":"2023-08-31T19:04:03.535206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.032344+0000","last_change":"2023-08-31T19:04:04.031224+0000","last_active":"2023-08-31T19:04:04.032344+0000","last_peered":"2023-08-31T19:04:04.032344+0000","last_clean":"2023-08-31T19:04:04.032344+0000","last_became_active":"2023-08-31T19:04:04.030878+0000","last_became_peered":"2023-08-31T19:04:04.030878+0000","last_unstale":"2023-08-31T19:04:04.032344+0000","last_undegraded":"2023-08-31T19:04:04.032344+0000","last_fullsized":"2023-08-31T19:04:04.032344+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007164+0000","last_change":"2023-08-31T19:04:03.556315+0000","last_active":"2023-08-31T19:04:04.007164+0000","last_peered":"2023-08-31T19:04:04.007164+0000","last_clean":"2023-08-31T19:04:04.007164+0000","last_became_active":"2023-08-31T19:04:03.555826+0000","last_became_peered":"2023-08-31T19:04:03.555826+0000","last_unstale":"2023-08-31T19:04:04.007164+0000","last_undegraded":"2023-08-31T19:04:04.007164+0000","last_fullsized":"2023-08-31T19:04:04.007164+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":77,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007670+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:04:04.007670+0000","last_peered":"2023-08-31T19:04:04.007670+0000","last_clean":"2023-08-31T19:04:04.007670+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:04:04.007670+0000","last_undegraded":"2023-08-31T19:04:04.007670+0000","last_fullsized":"2023-08-31T19:04:04.007670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":79,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.011463+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:04:04.011463+0000","last_peered":"2023-08-31T19:04:04.011463+0000","last_clean":"2023-08-31T19:04:04.011463+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:04:04.011463+0000","last_undegraded":"2023-08-31T19:04:04.011463+0000","last_fullsized":"2023-08-31T19:04:04.011463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.021319+0000","last_change":"2023-08-31T19:04:04.021319+0000","last_active":"2023-08-31T19:04:04.021319+0000","last_peered":"2023-08-31T19:04:04.021319+0000","last_clean":"2023-08-31T19:04:04.021319+0000","last_became_active":"2023-08-31T19:04:04.021013+0000","last_became_peered":"2023-08-31T19:04:04.021013+0000","last_unstale":"2023-08-31T19:04:04.021319+0000","last_undegraded":"2023-08-31T19:04:04.021319+0000","last_fullsized":"2023-08-31T19:04:04.021319+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.006543+0000","last_change":"2023-08-31T19:04:03.555089+0000","last_active":"2023-08-31T19:04:04.006543+0000","last_peered":"2023-08-31T19:04:04.006543+0000","last_clean":"2023-08-31T19:04:04.006543+0000","last_became_active":"2023-08-31T19:04:03.554782+0000","last_became_peered":"2023-08-31T19:04:03.554782+0000","last_unstale":"2023-08-31T19:04:04.006543+0000","last_undegraded":"2023-08-31T19:04:04.006543+0000","last_fullsized":"2023-08-31T19:04:04.006543+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":78,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.011552+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:04:04.011552+0000","last_peered":"2023-08-31T19:04:04.011552+0000","last_clean":"2023-08-31T19:04:04.011552+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:04:04.011552+0000","last_undegraded":"2023-08-31T19:04:04.011552+0000","last_fullsized":"2023-08-31T19:04:04.011552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.031537+0000","last_change":"2023-08-31T19:04:04.026571+0000","last_active":"2023-08-31T19:04:04.031537+0000","last_peered":"2023-08-31T19:04:04.031537+0000","last_clean":"2023-08-31T19:04:04.031537+0000","last_became_active":"2023-08-31T19:04:04.026153+0000","last_became_peered":"2023-08-31T19:04:04.026153+0000","last_unstale":"2023-08-31T19:04:04.031537+0000","last_undegraded":"2023-08-31T19:04:04.031537+0000","last_fullsized":"2023-08-31T19:04:04.031537+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.006843+0000","last_change":"2023-08-31T19:04:03.548180+0000","last_active":"2023-08-31T19:04:04.006843+0000","last_peered":"2023-08-31T19:04:04.006843+0000","last_clean":"2023-08-31T19:04:04.006843+0000","last_became_active":"2023-08-31T19:04:03.547896+0000","last_became_peered":"2023-08-31T19:04:03.547896+0000","last_unstale":"2023-08-31T19:04:04.006843+0000","last_undegraded":"2023-08-31T19:04:04.006843+0000","last_fullsized":"2023-08-31T19:04:04.006843+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.012495+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:04:04.012495+0000","last_peered":"2023-08-31T19:04:04.012495+0000","last_clean":"2023-08-31T19:04:04.012495+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:04:04.012495+0000","last_undegraded":"2023-08-31T19:04:04.012495+0000","last_fullsized":"2023-08-31T19:04:04.012495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.030948+0000","last_change":"2023-08-31T19:04:04.026465+0000","last_active":"2023-08-31T19:04:04.030948+0000","last_peered":"2023-08-31T19:04:04.030948+0000","last_clean":"2023-08-31T19:04:04.030948+0000","last_became_active":"2023-08-31T19:04:04.026195+0000","last_became_peered":"2023-08-31T19:04:04.026195+0000","last_unstale":"2023-08-31T19:04:04.030948+0000","last_undegraded":"2023-08-31T19:04:04.030948+0000","last_fullsized":"2023-08-31T19:04:04.030948+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.031036+0000","last_change":"2023-08-31T19:04:03.537423+0000","last_active":"2023-08-31T19:04:04.031036+0000","last_peered":"2023-08-31T19:04:04.031036+0000","last_clean":"2023-08-31T19:04:04.031036+0000","last_became_active":"2023-08-31T19:04:03.537122+0000","last_became_peered":"2023-08-31T19:04:03.537122+0000","last_unstale":"2023-08-31T19:04:04.031036+0000","last_undegraded":"2023-08-31T19:04:04.031036+0000","last_fullsized":"2023-08-31T19:04:04.031036+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":82,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.007081+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:04:04.007081+0000","last_peered":"2023-08-31T19:04:04.007081+0000","last_clean":"2023-08-31T19:04:04.007081+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:04:04.007081+0000","last_undegraded":"2023-08-31T19:04:04.007081+0000","last_fullsized":"2023-08-31T19:04:04.007081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.024016+0000","last_change":"2023-08-31T19:04:04.024016+0000","last_active":"2023-08-31T19:04:04.024016+0000","last_peered":"2023-08-31T19:04:04.024016+0000","last_clean":"2023-08-31T19:04:04.024016+0000","last_became_active":"2023-08-31T19:04:04.023716+0000","last_became_peered":"2023-08-31T19:04:04.023716+0000","last_unstale":"2023-08-31T19:04:04.024016+0000","last_undegraded":"2023-08-31T19:04:04.024016+0000","last_fullsized":"2023-08-31T19:04:04.024016+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:03.514730+0000","last_clean_scrub_stamp":"2023-08-31T19:04:03.514730+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:04.032159+0000","last_change":"2023-08-31T19:04:03.557225+0000","last_active":"2023-08-31T19:04:04.032159+0000","last_peered":"2023-08-31T19:04:04.032159+0000","last_clean":"2023-08-31T19:04:04.032159+0000","last_became_active":"2023-08-31T19:04:03.556896+0000","last_became_peered":"2023-08-31T19:04:03.556896+0000","last_unstale":"2023-08-31T19:04:04.032159+0000","last_undegraded":"2023-08-31T19:04:04.032159+0000","last_fullsized":"2023-08-31T19:04:04.032159+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:02.506982+0000","last_clean_scrub_stamp":"2023-08-31T19:04:02.506982+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":84,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-31T19:04:03.999106+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:04:03.999106+0000","last_peered":"2023-08-31T19:04:03.999106+0000","last_clean":"2023-08-31T19:04:03.999106+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:04:03.999106+0000","last_undegraded":"2023-08-31T19:04:03.999106+0000","last_fullsized":"2023-08-31T19:04:03.999106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575044,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":1155072,"data_stored":595755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.56899999999999995,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.0489999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.53400000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0169999999999999},"last":0.91900000000000004}]},{"osd":1,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67500000000000004,"15min":0.69999999999999996},"min":{"1min":0.48099999999999998,"5min":0.40699999999999997,"15min":0.40000000000000002},"max":{"1min":0.83399999999999996,"5min":0.93000000000000005,"15min":0.97299999999999998},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.53600000000000003,"5min":0.40500000000000003,"15min":0.36199999999999999},"max":{"1min":0.85899999999999999,"5min":0.93100000000000005,"15min":0.96799999999999997},"last":0.83499999999999996}]},{"osd":2,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.496,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":0.94199999999999995,"5min":0.97799999999999998,"15min":1.093},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.73499999999999999,"15min":0.72899999999999998},"min":{"1min":0.57599999999999996,"5min":0.49399999999999999,"15min":0.41199999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":1.054},"last":0.93799999999999994}]},{"osd":3,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70599999999999996,"15min":0.71699999999999997},"min":{"1min":0.51200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.83799999999999997,"5min":1.0229999999999999,"15min":1.1160000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.73399999999999999,"15min":0.73799999999999999},"min":{"1min":0.58899999999999997,"5min":0.52200000000000002,"15min":0.495},"max":{"1min":0.95799999999999996,"5min":0.96399999999999997,"15min":1.0860000000000001},"last":0.89800000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.37,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69899999999999995,"5min":0.83799999999999997,"15min":0.97899999999999998},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.71699999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.97199999999999998,"5min":0.98499999999999999,"15min":1.163},"last":0.98399999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.45200000000000001,"5min":0.41099999999999998,"15min":0.377},"max":{"1min":0.84599999999999997,"5min":1.139,"15min":1.139},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70599999999999996,"15min":0.70699999999999996},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.38500000000000001},"max":{"1min":0.93899999999999995,"5min":0.97699999999999998,"15min":1.353},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.67600000000000005},"min":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.41399999999999998},"max":{"1min":0.88700000000000001,"5min":0.93100000000000005,"15min":1.3999999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68899999999999995,"15min":0.69799999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.91900000000000004,"5min":1.038,"15min":1.462},"last":0.67900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":1159168,"data_stored":595893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68700000000000006,"15min":0.70699999999999996},"min":{"1min":0.65100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90200000000000002,"5min":0.92000000000000004,"15min":1.0189999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68600000000000005,"15min":0.70199999999999996},"min":{"1min":0.57199999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":0.90900000000000003,"15min":0.94499999999999995},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67800000000000005,"15min":0.70099999999999996},"min":{"1min":0.52400000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91100000000000003,"5min":0.92100000000000004,"15min":1.0049999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.54800000000000004,"5min":0.435,"15min":0.435},"max":{"1min":0.86799999999999999,"5min":0.91400000000000003,"15min":0.95999999999999996},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.47099999999999997,"5min":0.46600000000000003,"15min":0.42099999999999999},"max":{"1min":0.91100000000000003,"5min":0.94999999999999996,"15min":1.129},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.62,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94899999999999995,"5min":0.98899999999999999,"15min":1.3260000000000001},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.60499999999999998,"5min":0.51000000000000001,"15min":0.47499999999999998},"max":{"1min":0.89200000000000002,"5min":0.93200000000000005,"15min":1.0860000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.73499999999999999,"15min":0.75},"min":{"1min":0.63600000000000001,"5min":0.53300000000000003,"15min":0.49399999999999999},"max":{"1min":0.91900000000000004,"5min":0.94799999999999995,"15min":1.052},"last":0.624}]},{"osd":4,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61599999999999999,"15min":0.61899999999999999},"min":{"1min":0.501,"5min":0.42799999999999999,"15min":0.40999999999999998},"max":{"1min":0.88400000000000001,"5min":0.94299999999999995,"15min":0.97799999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64300000000000002,"15min":0.63600000000000001},"min":{"1min":0.47599999999999998,"5min":0.39000000000000001,"15min":0.371},"max":{"1min":0.89400000000000002,"5min":1.0880000000000001,"15min":1.091},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.66700000000000004},"min":{"1min":0.5,"5min":0.44400000000000001,"15min":0.39800000000000002},"max":{"1min":0.82999999999999996,"5min":0.96699999999999997,"15min":1.1000000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.55900000000000005,"5min":0.435,"15min":0.435},"max":{"1min":0.80500000000000005,"5min":1.0669999999999999,"15min":1.0700000000000001},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54800000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84899999999999998,"5min":1.012,"15min":1.0620000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.747},"min":{"1min":0.54400000000000004,"5min":0.47899999999999998,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":1.0800000000000001,"15min":1.1040000000000001},"last":0.70599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575044,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302328,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069512,"statfs":{"total":96636764160,"available":96327180288,"internally_reserved":0,"allocated":1163264,"data_stored":596253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.433,"15min":0.443},"min":{"1min":0.28000000000000003,"5min":0.27300000000000002,"15min":0.23300000000000001},"max":{"1min":0.57799999999999996,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.44},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.254},"max":{"1min":0.66600000000000004,"5min":0.752,"15min":0.752},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.499,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.29099999999999998,"15min":0.28899999999999998},"max":{"1min":0.63900000000000001,"5min":0.78000000000000003,"15min":0.82699999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.754,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.45200000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79000000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.495,"15min":0.51000000000000001},"min":{"1min":0.33400000000000002,"5min":0.32800000000000001,"15min":0.32500000000000001},"max":{"1min":0.65000000000000002,"5min":0.67300000000000004,"15min":1.673},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76300000000000001,"15min":0.78400000000000003},"min":{"1min":0.61199999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96899999999999997,"5min":1.2110000000000001,"15min":1.4119999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80000000000000004,"15min":0.81100000000000005},"min":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.49099999999999999},"max":{"1min":1.111,"5min":1.1799999999999999,"15min":1.3},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.73599999999999999,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.497,"15min":0.46800000000000003},"max":{"1min":0.99299999999999999,"5min":1.052,"15min":1.8540000000000001},"last":0.746},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.54500000000000004,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0720000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.63}]},{"osd":6,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51400000000000001},"max":{"1min":0.97299999999999998,"5min":1.1990000000000001,"15min":1.8979999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.56799999999999995,"5min":0.51500000000000001,"15min":0.48999999999999999},"max":{"1min":1.167,"5min":1.2,"15min":1.2629999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.47699999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.113},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.51400000000000001,"15min":0.504},"max":{"1min":1.0429999999999999,"5min":1.1399999999999999,"15min":2.0720000000000001},"last":0.66100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302300,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069540,"statfs":{"total":96636764160,"available":96327208960,"internally_reserved":0,"allocated":1134592,"data_stored":587875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44500000000000001,"15min":0.44600000000000001},"min":{"1min":0.31900000000000001,"5min":0.29099999999999998,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.71499999999999997,"15min":0.78400000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.49299999999999999,"15min":0.49099999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.30399999999999999},"max":{"1min":0.72499999999999998,"5min":0.876,"15min":0.876},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.50600000000000001},"min":{"1min":0.41799999999999998,"5min":0.34499999999999997,"15min":0.32900000000000001},"max":{"1min":0.64900000000000002,"5min":0.67900000000000005,"15min":0.74299999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53300000000000003,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.373,"15min":0.33800000000000002},"max":{"1min":0.77000000000000002,"5min":1.018,"15min":1.018},"last":0.44}]},{"osd":3,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":0.67200000000000004,"5min":0.82799999999999996,"15min":0.83399999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.44400000000000001,"5min":0.39500000000000002,"15min":0.36599999999999999},"max":{"1min":0.71699999999999997,"5min":0.91400000000000003,"15min":1.0509999999999999},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.82699999999999996,"15min":0.82199999999999995},"min":{"1min":0.65000000000000002,"5min":0.55000000000000004,"15min":0.53900000000000003},"max":{"1min":1.103,"5min":1.2370000000000001,"15min":1.931},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.63600000000000001,"5min":0.55000000000000004,"15min":0.49399999999999999},"max":{"1min":1.095,"5min":1.1890000000000001,"15min":1.276},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.5,"15min":0.49399999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.3480000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76700000000000002,"15min":0.77000000000000002},"min":{"1min":0.58499999999999996,"5min":0.53300000000000003,"15min":0.50700000000000001},"max":{"1min":1.0029999999999999,"5min":1.1950000000000001,"15min":1.9810000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81499999999999995,"15min":0.81000000000000005},"min":{"1min":0.61099999999999999,"5min":0.52700000000000002,"15min":0.46600000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.3280000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.53500000000000003},"max":{"1min":1.196,"5min":1.196,"15min":1.2350000000000001},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Aug 31 19:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83299999999999996,"15min":0.82899999999999996},"min":{"1min":0.623,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1359999999999999,"5min":1.5820000000000001,"15min":2.1760000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.83899999999999997,"15min":0.83699999999999997},"min":{"1min":0.59999999999999998,"5min":0.57399999999999995,"15min":0.52200000000000002},"max":{"1min":1.127,"5min":1.548,"15min":1.548},"last":0.74099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":589411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45700000000000002,"15min":0.44400000000000001},"min":{"1min":0.29199999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67700000000000005,"5min":0.77600000000000002,"15min":0.90200000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.314,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.61299999999999999,"5min":0.70099999999999996,"15min":1.5900000000000001},"last":0.35099999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.50600000000000001},"min":{"1min":0.38,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67400000000000004,"5min":0.75700000000000001,"15min":0.96599999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.36499999999999999},"max":{"1min":0.70299999999999996,"5min":0.748,"15min":1.288},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33100000000000002},"max":{"1min":0.66500000000000004,"5min":0.70699999999999996,"15min":1.022},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55700000000000005},"min":{"1min":0.44500000000000001,"5min":0.36399999999999999,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71599999999999997,"15min":0.97399999999999998},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.54600000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.173,"5min":1.173,"15min":1.208},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47699999999999998},"max":{"1min":1.155,"5min":1.155,"15min":1.464},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2,"5min":1.2,"15min":1.361},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77200000000000002,"15min":0.79300000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.03,"5min":1.1020000000000001,"15min":1.3},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79700000000000004,"15min":0.81100000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.501},"max":{"1min":1.238,"5min":1.238,"15min":1.51},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79300000000000004,"15min":0.80900000000000005},"min":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.48199999999999998},"max":{"1min":1,"5min":1.1579999999999999,"15min":1.4359999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80100000000000005,"15min":0.81699999999999995},"min":{"1min":0.61399999999999999,"5min":0.53700000000000003,"15min":0.51900000000000002},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.55},"last":0.749},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.80200000000000005,"15min":0.82299999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1160000000000001,"5min":1.1439999999999999,"15min":1.387},"last":0.67500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302300,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069540,"statfs":{"total":96636764160,"available":96327208960,"internally_reserved":0,"allocated":1134592,"data_stored":587875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.58599999999999997,"15min":0.48199999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55600000000000005,"5min":14.099,"15min":14.099},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.73199999999999998,"15min":0.55900000000000005},"min":{"1min":0.34399999999999997,"5min":0.313,"15min":0.29199999999999998},"max":{"1min":0.65400000000000003,"5min":24.879999999999999,"15min":24.879999999999999},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46500000000000002,"15min":0.45200000000000001},"min":{"1min":0.316,"5min":0.30199999999999999,"15min":0.254},"max":{"1min":0.56299999999999994,"5min":0.79600000000000004,"15min":0.90700000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.63300000000000001,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.30199999999999999,"15min":0.28799999999999998},"max":{"1min":0.80700000000000005,"5min":14.143000000000001,"15min":14.143000000000001},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.46400000000000002,"5min":0.39600000000000002,"15min":0.33400000000000002},"max":{"1min":0.76200000000000001,"5min":0.94999999999999996,"15min":1.407},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.72399999999999998,"15min":0.65100000000000002},"min":{"1min":0.48699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70199999999999996,"5min":12.464,"15min":12.464},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.94999999999999996,"15min":0.81799999999999995},"min":{"1min":0.53500000000000003,"5min":0.47999999999999998,"15min":0.47299999999999998},"max":{"1min":1.2250000000000001,"5min":21.475999999999999,"15min":21.475999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77600000000000002,"15min":0.76300000000000001},"min":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.47299999999999998},"max":{"1min":1.0309999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.751,"15min":0.75800000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.46600000000000003},"max":{"1min":1.139,"5min":1.139,"15min":1.3220000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.86699999999999999,"15min":0.80600000000000005},"min":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.173,"5min":12.509,"15min":12.509},"last":0.83399999999999996}]},{"osd":6,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.89000000000000001,"15min":0.81899999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.52000000000000002},"max":{"1min":0.96799999999999997,"5min":12.426,"15min":12.426},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":1.022,"15min":0.85799999999999998},"min":{"1min":0.61899999999999999,"5min":0.53200000000000003,"15min":0.50600000000000001},"max":{"1min":1.2010000000000001,"5min":24.920000000000002,"15min":24.920000000000002},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":1.006,"15min":0.85899999999999999},"min":{"1min":0.60099999999999998,"5min":0.51300000000000001,"15min":0.495},"max":{"1min":1.0680000000000001,"5min":21.521000000000001,"15min":21.521000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77900000000000003,"15min":0.78300000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.65700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":1159168,"data_stored":595857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69899999999999995,"15min":0.72299999999999998},"min":{"1min":0.54100000000000004,"5min":0.42399999999999999,"15min":0.36799999999999999},"max":{"1min":0.88300000000000001,"5min":0.96499999999999997,"15min":9.6289999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69299999999999995,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.441,"15min":0.42099999999999999},"max":{"1min":0.85499999999999998,"5min":0.92900000000000005,"15min":3.403},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70499999999999996,"15min":0.74199999999999999},"min":{"1min":0.52100000000000002,"5min":0.44700000000000001,"15min":0.437},"max":{"1min":0.80400000000000005,"5min":0.97199999999999998,"15min":9.8399999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70899999999999996,"15min":0.746},"min":{"1min":0.57199999999999995,"5min":0.47899999999999998,"15min":0.44900000000000001},"max":{"1min":0.92500000000000004,"5min":1.0229999999999999,"15min":9.7569999999999997},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.71199999999999997,"15min":0.745},"min":{"1min":0.58299999999999996,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":1.042,"15min":9.7840000000000007},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.76100000000000001},"min":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85099999999999998,"5min":0.98399999999999999,"15min":9.7200000000000006},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.56200000000000006,"5min":0.51100000000000001,"15min":0.48299999999999998},"max":{"1min":0.86899999999999999,"5min":1.01,"15min":5.133},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74399999999999999,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.439,"15min":0.439},"max":{"1min":0.90900000000000003,"5min":1.012,"15min":12.589},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59199999999999997,"15min":0.63400000000000001},"min":{"1min":0.42999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89300000000000002,"5min":1.0800000000000001,"15min":9.6780000000000008},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.624,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.441,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":1.0549999999999999,"15min":3.3610000000000002},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66000000000000003,"15min":0.68000000000000005},"min":{"1min":0.47099999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84999999999999998,"5min":1.163,"15min":9.4760000000000009},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69499999999999995,"15min":0.72199999999999998},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.441},"max":{"1min":0.93600000000000005,"5min":1.133,"15min":9.8640000000000008},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69699999999999995,"15min":0.70999999999999996},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.38600000000000001},"max":{"1min":0.98999999999999999,"5min":1.147,"15min":7.1769999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72599999999999998,"15min":0.76300000000000001},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.45200000000000001},"max":{"1min":0.91700000000000004,"5min":1.0980000000000001,"15min":12.634},"last":0.81499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302304,"kb_used_data":1112,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069536,"statfs":{"total":96636764160,"available":96327204864,"internally_reserved":0,"allocated":1138688,"data_stored":587909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73899999999999999,"15min":0.72599999999999998},"min":{"1min":0.50700000000000001,"5min":0.47199999999999998,"15min":0.40899999999999997},"max":{"1min":0.93799999999999994,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.75700000000000001,"15min":0.72599999999999998},"min":{"1min":0.56799999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94899999999999995,"5min":3.548,"15min":3.548},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.86299999999999999,"15min":0.76800000000000002},"min":{"1min":0.46500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0149999999999999,"5min":16.744,"15min":16.744},"last":0.63},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76000000000000001,"15min":0.74199999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.46300000000000002},"max":{"1min":0.91700000000000004,"5min":3.6299999999999999,"15min":3.6299999999999999},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.71699999999999997},"min":{"1min":0.56100000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0289999999999999,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76700000000000002,"15min":0.75800000000000001},"min":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.45200000000000001},"max":{"1min":0.98399999999999999,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":0.75600000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.54400000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.996,"5min":1.327,"15min":2.0070000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.73399999999999999},"min":{"1min":0.53500000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96799999999999997,"5min":2.823,"15min":2.823},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67500000000000004,"15min":0.65000000000000002},"min":{"1min":0.47099999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72499999999999998,"5min":7.3739999999999997,"15min":7.3739999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":0.81799999999999995,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":0.94999999999999996}]},{"osd":6,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67300000000000004,"15min":0.65900000000000003},"min":{"1min":0.53500000000000003,"5min":0.45300000000000001,"15min":0.39100000000000001},"max":{"1min":0.91200000000000003,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76100000000000001,"15min":0.72399999999999998},"min":{"1min":0.57799999999999996,"5min":0.443,"15min":0.441},"max":{"1min":0.83999999999999997,"5min":7.4139999999999997,"15min":7.4139999999999997},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73999999999999999,"15min":0.72799999999999998},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.46100000000000002},"max":{"1min":0.95099999999999996,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.73899999999999999,"15min":0.73199999999999998},"min":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.073,"5min":2.786,"15min":2.786},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:04:08.728 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T19:04:08.729 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-31T19:04:08.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.954+0000 7f02443ff700 1 Processor -- start 2023-08-31T19:04:08.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.954+0000 7f02443ff700 1 -- start start 2023-08-31T19:04:08.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.956+0000 7f02443ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f023c0c27d0 0x7f023c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.956+0000 7f02443ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023c152720 con 0x7f023c0c2320 2023-08-31T19:04:08.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.956+0000 7f02443ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023c151b10 con 0x7f023c14ecd0 2023-08-31T19:04:08.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.956+0000 7f02443ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023c151df0 con 0x7f023c0c27d0 2023-08-31T19:04:08.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.956+0000 7f024199a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f023c0c2320 0x7f023c0696a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37626/0 (socket says 172.21.15.72:37626) 2023-08-31T19:04:08.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.956+0000 7f024199a700 1 -- 172.21.15.72:0/3295423916 learned_addr learned my addr 172.21.15.72:0/3295423916 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:08.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.956+0000 7f024299c700 1 --2- 172.21.15.72:0/3295423916 >> v2:172.21.15.72:3300/0 conn(0x7f023c0c27d0 0x7f023c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.956+0000 7f0241199700 1 -- 172.21.15.72:0/3295423916 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242090345 0 0) 0x7f023c152720 con 0x7f023c0c2320 2023-08-31T19:04:08.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.956+0000 7f0241199700 1 -- 172.21.15.72:0/3295423916 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02280033f0 con 0x7f023c0c2320 2023-08-31T19:04:08.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.956+0000 7f024299c700 1 -- 172.21.15.72:0/3295423916 >> v1:172.21.15.146:6789/0 conn(0x7f023c14ecd0 legacy=0x7f023c1556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:08.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.956+0000 7f024299c700 1 -- 172.21.15.72:0/3295423916 >> v1:172.21.15.72:6789/0 conn(0x7f023c0c2320 legacy=0x7f023c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.956+0000 7f024299c700 1 -- 172.21.15.72:0/3295423916 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c1520d0 con 0x7f023c0c27d0 2023-08-31T19:04:08.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.957+0000 7f024299c700 1 --2- 172.21.15.72:0/3295423916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f023c0c27d0 0x7f023c069db0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f0234009e60 tx=0x7f0234009780).ready entity=mon.0 client_cookie=93610120bda09942 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:08.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.957+0000 7f0241199700 1 -- 172.21.15.72:0/3295423916 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023400e070 con 0x7f023c0c27d0 2023-08-31T19:04:08.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.957+0000 7f0241199700 1 -- 172.21.15.72:0/3295423916 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023400bb20 con 0x7f023c0c27d0 2023-08-31T19:04:08.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.957+0000 7f0241199700 1 -- 172.21.15.72:0/3295423916 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023400bea0 con 0x7f023c0c27d0 2023-08-31T19:04:08.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.957+0000 7f02443ff700 1 -- 172.21.15.72:0/3295423916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f023c0c27d0 msgr2=0x7f023c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.957+0000 7f02443ff700 1 --2- 172.21.15.72:0/3295423916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f023c0c27d0 0x7f023c069db0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f0234009e60 tx=0x7f0234009780).stop 2023-08-31T19:04:08.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.957+0000 7f02443ff700 1 -- 172.21.15.72:0/3295423916 shutdown_connections 2023-08-31T19:04:08.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.957+0000 7f02443ff700 1 --2- 172.21.15.72:0/3295423916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f023c0c27d0 0x7f023c069db0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.957+0000 7f02443ff700 1 -- 172.21.15.72:0/3295423916 >> 172.21.15.72:0/3295423916 conn(0x7f023c0630c0 msgr2=0x7f023c0c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:08.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.957+0000 7f02443ff700 1 -- 172.21.15.72:0/3295423916 shutdown_connections 2023-08-31T19:04:08.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.958+0000 7f02443ff700 1 -- 172.21.15.72:0/3295423916 wait complete. 2023-08-31T19:04:08.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.959+0000 7f02443ff700 1 Processor -- start 2023-08-31T19:04:08.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.959+0000 7f02443ff700 1 -- start start 2023-08-31T19:04:08.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.960+0000 7f02443ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f023c0c2320 0x7f023c138b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.960+0000 7f02443ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f023c0c27d0 0x7f023c13a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.960+0000 7f02443ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f023c14ecd0 0x7f023c0a7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.960+0000 7f02443ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c138680 con 0x7f023c14ecd0 2023-08-31T19:04:08.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.960+0000 7f02443ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023c0a7bb0 con 0x7f023c0c27d0 2023-08-31T19:04:08.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.960+0000 7f02443ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023c137d50 con 0x7f023c0c2320 2023-08-31T19:04:08.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.960+0000 7f024299c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f023c14ecd0 0x7f023c0a7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.960+0000 7f024299c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f023c14ecd0 0x7f023c0a7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54210/0 (socket says 172.21.15.72:54210) 2023-08-31T19:04:08.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.960+0000 7f024299c700 1 -- 172.21.15.72:0/563381378 learned_addr learned my addr 172.21.15.72:0/563381378 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:08.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.960+0000 7f024199a700 1 --2- 172.21.15.72:0/563381378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f023c0c27d0 0x7f023c13a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.960+0000 7f024219b700 1 --2- 172.21.15.72:0/563381378 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f023c0c2320 0x7f023c138b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.961+0000 7f024299c700 1 -- 172.21.15.72:0/563381378 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f023c0c2320 msgr2=0x7f023c138b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.961+0000 7f024299c700 1 --2- 172.21.15.72:0/563381378 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f023c0c2320 0x7f023c138b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.961+0000 7f024299c700 1 -- 172.21.15.72:0/563381378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f023c0c27d0 msgr2=0x7f023c13a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:08.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.961+0000 7f024299c700 1 --2- 172.21.15.72:0/563381378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f023c0c27d0 0x7f023c13a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:08.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.961+0000 7f024299c700 1 -- 172.21.15.72:0/563381378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0234009a20 con 0x7f023c14ecd0 2023-08-31T19:04:08.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.961+0000 7f024299c700 1 --2- 172.21.15.72:0/563381378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f023c14ecd0 0x7f023c0a7160 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f023400b6c0 tx=0x7f0234009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:08.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.961+0000 7f02327fc700 1 -- 172.21.15.72:0/563381378 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234012e20 con 0x7f023c14ecd0 2023-08-31T19:04:08.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.961+0000 7f02327fc700 1 -- 172.21.15.72:0/563381378 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023401d630 con 0x7f023c14ecd0 2023-08-31T19:04:08.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.961+0000 7f02327fc700 1 -- 172.21.15.72:0/563381378 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023401d9d0 con 0x7f023c14ecd0 2023-08-31T19:04:08.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.961+0000 7f02443ff700 1 -- 172.21.15.72:0/563381378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023c138030 con 0x7f023c14ecd0 2023-08-31T19:04:08.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.961+0000 7f02443ff700 1 -- 172.21.15.72:0/563381378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023c164d90 con 0x7f023c14ecd0 2023-08-31T19:04:08.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.963+0000 7f02443ff700 1 -- 172.21.15.72:0/563381378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023c1387f0 con 0x7f023c14ecd0 2023-08-31T19:04:08.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.963+0000 7f02327fc700 1 -- 172.21.15.72:0/563381378 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0234026410 con 0x7f023c14ecd0 2023-08-31T19:04:08.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.964+0000 7f02327fc700 1 --2- 172.21.15.72:0/563381378 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f022005ef30 0x7f02200613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:08.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.964+0000 7f02327fc700 1 -- 172.21.15.72:0/563381378 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f023407c170 con 0x7f023c14ecd0 2023-08-31T19:04:08.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.964+0000 7f024219b700 1 --2- 172.21.15.72:0/563381378 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f022005ef30 0x7f02200613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:08.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.965+0000 7f024219b700 1 --2- 172.21.15.72:0/563381378 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f022005ef30 0x7f02200613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f023c0c6490 tx=0x7f0238008040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:08.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:08.968+0000 7f02327fc700 1 -- 172.21.15.72:0/563381378 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f023404d160 con 0x7f023c14ecd0 2023-08-31T19:04:09.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.203+0000 7f02443ff700 1 -- 172.21.15.72:0/563381378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f023c06c6b0 con 0x7f023c14ecd0 2023-08-31T19:04:09.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.207+0000 7f02327fc700 1 -- 172.21.15.72:0/563381378 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7f0234050780 con 0x7f023c14ecd0 2023-08-31T19:04:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.210+0000 7f02443ff700 1 -- 172.21.15.72:0/563381378 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f022005ef30 msgr2=0x7f02200613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.210+0000 7f02443ff700 1 --2- 172.21.15.72:0/563381378 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f022005ef30 0x7f02200613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f023c0c6490 tx=0x7f0238008040).stop 2023-08-31T19:04:09.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.210+0000 7f02443ff700 1 -- 172.21.15.72:0/563381378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f023c14ecd0 msgr2=0x7f023c0a7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:09.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.210+0000 7f02443ff700 1 --2- 172.21.15.72:0/563381378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f023c14ecd0 0x7f023c0a7160 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f023400b6c0 tx=0x7f0234009780).stop 2023-08-31T19:04:09.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.210+0000 7f02443ff700 1 -- 172.21.15.72:0/563381378 shutdown_connections 2023-08-31T19:04:09.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.210+0000 7f02443ff700 1 --2- 172.21.15.72:0/563381378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f023c14ecd0 0x7f023c0a7160 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:09.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.210+0000 7f02443ff700 1 --2- 172.21.15.72:0/563381378 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f023c0c2320 0x7f023c138b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:09.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.210+0000 7f02443ff700 1 --2- 172.21.15.72:0/563381378 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f022005ef30 0x7f02200613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:09.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.210+0000 7f02443ff700 1 --2- 172.21.15.72:0/563381378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f023c0c27d0 0x7f023c13a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:09.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.210+0000 7f02443ff700 1 -- 172.21.15.72:0/563381378 >> 172.21.15.72:0/563381378 conn(0x7f023c0630c0 msgr2=0x7f023c0bc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:09.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.210+0000 7f02443ff700 1 -- 172.21.15.72:0/563381378 shutdown_connections 2023-08-31T19:04:09.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.210+0000 7f02443ff700 1 -- 172.21.15.72:0/563381378 wait complete. 2023-08-31T19:04:09.213 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-08-31T19:04:09.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:04:09.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.417+0000 7f65257ff700 1 Processor -- start 2023-08-31T19:04:09.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.417+0000 7f65257ff700 1 -- start start 2023-08-31T19:04:09.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.419+0000 7f65257ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6520154220 0x7f6520157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:09.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.419+0000 7f65257ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f65200cb940 0x7f65201581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:09.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.419+0000 7f65257ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65200c8c90 con 0x7f65201586b0 2023-08-31T19:04:09.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.419+0000 7f65257ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65200aa700 con 0x7f65200cb940 2023-08-31T19:04:09.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.419+0000 7f65257ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65200c5e10 con 0x7f6520154220 2023-08-31T19:04:09.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.419+0000 7f651f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f65201586b0 0x7f6520154600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37628/0 (socket says 172.21.15.72:37628) 2023-08-31T19:04:09.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.419+0000 7f651f7fe700 1 -- 172.21.15.72:0/968847782 learned_addr learned my addr 172.21.15.72:0/968847782 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:09.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.419+0000 7f651effd700 1 --2- 172.21.15.72:0/968847782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6520154220 0x7f6520157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:09.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.419+0000 7f651e7fc700 1 --2- 172.21.15.72:0/968847782 >> v2:172.21.15.146:3300/0 conn(0x7f65200cb940 0x7f65201581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:09.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.419+0000 7f651dffb700 1 -- 172.21.15.72:0/968847782 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856754993 0 0) 0x7f65200c8c90 con 0x7f65201586b0 2023-08-31T19:04:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.419+0000 7f651dffb700 1 -- 172.21.15.72:0/968847782 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65080033f0 con 0x7f65201586b0 2023-08-31T19:04:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651dffb700 1 -- 172.21.15.72:0/968847782 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 461545828 0 0) 0x7f65080033f0 con 0x7f65201586b0 2023-08-31T19:04:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651dffb700 1 -- 172.21.15.72:0/968847782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6520154220 msgr2=0x7f6520157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651dffb700 1 --2- 172.21.15.72:0/968847782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6520154220 0x7f6520157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651dffb700 1 -- 172.21.15.72:0/968847782 >> v2:172.21.15.146:3300/0 conn(0x7f65200cb940 msgr2=0x7f65201581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651dffb700 1 --2- 172.21.15.72:0/968847782 >> v2:172.21.15.146:3300/0 conn(0x7f65200cb940 0x7f65201581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651dffb700 1 -- 172.21.15.72:0/968847782 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65200c0a50 con 0x7f65201586b0 2023-08-31T19:04:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651dffb700 1 -- 172.21.15.72:0/968847782 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f65180017f0 con 0x7f65201586b0 2023-08-31T19:04:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651dffb700 1 -- 172.21.15.72:0/968847782 >> v1:172.21.15.72:6789/0 conn(0x7f65201586b0 legacy=0x7f6520154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651dffb700 1 --2- 172.21.15.72:0/968847782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65080038e0 0x7f6508003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651dffb700 1 --2- 172.21.15.72:0/968847782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6508004690 0x7f6508004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651dffb700 1 --2- 172.21.15.72:0/968847782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6520154220 0x7f6508005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651dffb700 1 -- 172.21.15.72:0/968847782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65200aa700 con 0x7f6508004690 2023-08-31T19:04:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651dffb700 1 -- 172.21.15.72:0/968847782 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65200c5e10 con 0x7f65080038e0 2023-08-31T19:04:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651dffb700 1 -- 172.21.15.72:0/968847782 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650800b8e0 con 0x7f6520154220 2023-08-31T19:04:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651e7fc700 1 --2- 172.21.15.72:0/968847782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6508004690 0x7f6508004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651effd700 1 --2- 172.21.15.72:0/968847782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65080038e0 0x7f6508003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651f7fe700 1 --2- 172.21.15.72:0/968847782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6520154220 0x7f6508005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651e7fc700 1 -- 172.21.15.72:0/968847782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6520154220 msgr2=0x7f6508005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.420+0000 7f651e7fc700 1 --2- 172.21.15.72:0/968847782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6520154220 0x7f6508005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.421+0000 7f651e7fc700 1 -- 172.21.15.72:0/968847782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65080038e0 msgr2=0x7f6508003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.421+0000 7f651e7fc700 1 --2- 172.21.15.72:0/968847782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65080038e0 0x7f6508003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.421+0000 7f651e7fc700 1 -- 172.21.15.72:0/968847782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65080033f0 con 0x7f6508004690 2023-08-31T19:04:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.421+0000 7f651e7fc700 1 --2- 172.21.15.72:0/968847782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6508004690 0x7f6508004b10 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f6520083190 tx=0x7f6514009060).ready entity=mon.0 client_cookie=44475762be57f69b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.421+0000 7f651dffb700 1 -- 172.21.15.72:0/968847782 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6514009e90 con 0x7f6508004690 2023-08-31T19:04:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.421+0000 7f651dffb700 1 -- 172.21.15.72:0/968847782 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6514009430 con 0x7f6508004690 2023-08-31T19:04:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.421+0000 7f651dffb700 1 -- 172.21.15.72:0/968847782 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651400e850 con 0x7f6508004690 2023-08-31T19:04:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.421+0000 7f65257ff700 1 -- 172.21.15.72:0/968847782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6508004690 msgr2=0x7f6508004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.421+0000 7f65257ff700 1 --2- 172.21.15.72:0/968847782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6508004690 0x7f6508004b10 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f6520083190 tx=0x7f6514009060).stop 2023-08-31T19:04:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.421+0000 7f651f7fe700 1 -- 172.21.15.72:0/968847782 reap_dead start 2023-08-31T19:04:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.421+0000 7f65257ff700 1 -- 172.21.15.72:0/968847782 shutdown_connections 2023-08-31T19:04:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.421+0000 7f65257ff700 1 -- 172.21.15.72:0/968847782 >> 172.21.15.72:0/968847782 conn(0x7f652005e870 msgr2=0x7f65200cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.422+0000 7f65257ff700 1 -- 172.21.15.72:0/968847782 shutdown_connections 2023-08-31T19:04:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.422+0000 7f65257ff700 1 -- 172.21.15.72:0/968847782 wait complete. 2023-08-31T19:04:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.423+0000 7f65257ff700 1 Processor -- start 2023-08-31T19:04:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.423+0000 7f65257ff700 1 -- start start 2023-08-31T19:04:09.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.424+0000 7f65257ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6508004690 0x7f65200c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:09.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.424+0000 7f65257ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65200c1e30 0x7f65200b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:09.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.424+0000 7f65257ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65200a8880 0x7f65200a8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:09.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.424+0000 7f65257ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65200ab5b0 con 0x7f65200a8880 2023-08-31T19:04:09.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.424+0000 7f65257ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65200a91f0 con 0x7f6508004690 2023-08-31T19:04:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.424+0000 7f65257ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65200aac80 con 0x7f65200c1e30 2023-08-31T19:04:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.424+0000 7f651f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65200a8880 0x7f65200a8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.424+0000 7f651f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65200a8880 0x7f65200a8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54222/0 (socket says 172.21.15.72:54222) 2023-08-31T19:04:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.424+0000 7f651f7fe700 1 -- 172.21.15.72:0/3646484583 learned_addr learned my addr 172.21.15.72:0/3646484583 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.425+0000 7f651e7fc700 1 --2- 172.21.15.72:0/3646484583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65200c1e30 0x7f65200b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:09.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.425+0000 7f651effd700 1 --2- 172.21.15.72:0/3646484583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6508004690 0x7f65200c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:09.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.425+0000 7f651f7fe700 1 -- 172.21.15.72:0/3646484583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65200c1e30 msgr2=0x7f65200b0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:09.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.425+0000 7f651f7fe700 1 --2- 172.21.15.72:0/3646484583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65200c1e30 0x7f65200b0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:09.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.425+0000 7f651f7fe700 1 -- 172.21.15.72:0/3646484583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6508004690 msgr2=0x7f65200c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:09.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.425+0000 7f651f7fe700 1 --2- 172.21.15.72:0/3646484583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6508004690 0x7f65200c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:09.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.425+0000 7f651f7fe700 1 -- 172.21.15.72:0/3646484583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65200aaf60 con 0x7f65200a8880 2023-08-31T19:04:09.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.425+0000 7f651f7fe700 1 --2- 172.21.15.72:0/3646484583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65200a8880 0x7f65200a8d00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f6520158a90 tx=0x7f6518001330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:09.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.425+0000 7f6506ffd700 1 -- 172.21.15.72:0/3646484583 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651800e830 con 0x7f65200a8880 2023-08-31T19:04:09.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.425+0000 7f6506ffd700 1 -- 172.21.15.72:0/3646484583 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651800e990 con 0x7f65200a8880 2023-08-31T19:04:09.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.425+0000 7f65257ff700 1 -- 172.21.15.72:0/3646484583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65200ab240 con 0x7f65200a8880 2023-08-31T19:04:09.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.425+0000 7f6506ffd700 1 -- 172.21.15.72:0/3646484583 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651800ed30 con 0x7f65200a8880 2023-08-31T19:04:09.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.425+0000 7f65257ff700 1 -- 172.21.15.72:0/3646484583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65200c22b0 con 0x7f65200a8880 2023-08-31T19:04:09.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.426+0000 7f65257ff700 1 -- 172.21.15.72:0/3646484583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652006c6b0 con 0x7f65200a8880 2023-08-31T19:04:09.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.427+0000 7f6506ffd700 1 -- 172.21.15.72:0/3646484583 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6518014640 con 0x7f65200a8880 2023-08-31T19:04:09.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.428+0000 7f6506ffd700 1 --2- 172.21.15.72:0/3646484583 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f650c05ef30 0x7f650c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:09.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.428+0000 7f6506ffd700 1 -- 172.21.15.72:0/3646484583 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f651807a540 con 0x7f65200a8880 2023-08-31T19:04:09.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.428+0000 7f651effd700 1 --2- 172.21.15.72:0/3646484583 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f650c05ef30 0x7f650c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:09.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.429+0000 7f651effd700 1 --2- 172.21.15.72:0/3646484583 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f650c05ef30 0x7f650c0613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6510009220 tx=0x7f6510008040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:09.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.432+0000 7f6506ffd700 1 -- 172.21.15.72:0/3646484583 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f651804b4b0 con 0x7f65200a8880 2023-08-31T19:04:09.504 INFO:tasks.ceph.mds.a.smithi072.stderr:2023-08-31T19:04:09.504+0000 7f255b1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:04:09.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.647+0000 7f65257ff700 1 -- 172.21.15.72:0/3646484583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65200ad870 con 0x7f65200a8880 2023-08-31T19:04:09.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.647+0000 7f6506ffd700 1 -- 172.21.15.72:0/3646484583 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f651804ead0 con 0x7f65200a8880 2023-08-31T19:04:09.648 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:09.648 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5732,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1777836817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1777836817},{"type":"v1","addr":"172.21.15.146:6834","nonce":1777836817}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5735,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1865290147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1865290147},{"type":"v1","addr":"172.21.15.146:6835","nonce":1865290147}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2552241481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2552241481},{"type":"v1","addr":"172.21.15.72:6836","nonce":2552241481}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:04:03.992354+0000","modified":"2023-08-31T19:04:07.010012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6699":{"gid":6699,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/859098343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":859098343},{"type":"v1","addr":"172.21.15.72:6837","nonce":859098343}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-31T19:04:09.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.650+0000 7f65257ff700 1 -- 172.21.15.72:0/3646484583 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f650c05ef30 msgr2=0x7f650c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:09.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.650+0000 7f65257ff700 1 --2- 172.21.15.72:0/3646484583 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f650c05ef30 0x7f650c0613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6510009220 tx=0x7f6510008040).stop 2023-08-31T19:04:09.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.650+0000 7f65257ff700 1 -- 172.21.15.72:0/3646484583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65200a8880 msgr2=0x7f65200a8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:09.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.650+0000 7f65257ff700 1 --2- 172.21.15.72:0/3646484583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65200a8880 0x7f65200a8d00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f6520158a90 tx=0x7f6518001330).stop 2023-08-31T19:04:09.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.650+0000 7f65257ff700 1 -- 172.21.15.72:0/3646484583 shutdown_connections 2023-08-31T19:04:09.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.650+0000 7f65257ff700 1 --2- 172.21.15.72:0/3646484583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65200a8880 0x7f65200a8d00 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:09.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.650+0000 7f65257ff700 1 --2- 172.21.15.72:0/3646484583 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f650c05ef30 0x7f650c0613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:09.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.650+0000 7f65257ff700 1 --2- 172.21.15.72:0/3646484583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6508004690 0x7f65200c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:09.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.650+0000 7f65257ff700 1 --2- 172.21.15.72:0/3646484583 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65200c1e30 0x7f65200b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:09.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.650+0000 7f65257ff700 1 -- 172.21.15.72:0/3646484583 >> 172.21.15.72:0/3646484583 conn(0x7f652005e870 msgr2=0x7f6520063090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:09.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.650+0000 7f65257ff700 1 -- 172.21.15.72:0/3646484583 shutdown_connections 2023-08-31T19:04:09.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:09.650+0000 7f65257ff700 1 -- 172.21.15.72:0/3646484583 wait complete. 2023-08-31T19:04:09.653 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 40 2023-08-31T19:04:10.071 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T19:04:03.992354+0000', 'modified': '2023-08-31T19:04:07.010012+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6699}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6699': {'gid': 6699, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6837/859098343', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6835', 'nonce': 859098343}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 859098343}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-31T19:04:10.072 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T19:04:10.072 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-31T19:04:10.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.264+0000 7f7d3d5ff700 1 Processor -- start 2023-08-31T19:04:10.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.264+0000 7f7d3d5ff700 1 -- start start 2023-08-31T19:04:10.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.265+0000 7f7d3d5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d381558f0 0x7f7d380bba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.265+0000 7f7d3d5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d380bbf80 0x7f7d380a66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.265+0000 7f7d3d5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d380c2d40 con 0x7f7d380a6bd0 2023-08-31T19:04:10.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.265+0000 7f7d3d5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d380bd9c0 con 0x7f7d381558f0 2023-08-31T19:04:10.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.265+0000 7f7d3d5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380c1ea0 con 0x7f7d380bbf80 2023-08-31T19:04:10.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.266+0000 7f7d36ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d381558f0 0x7f7d380bba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.266+0000 7f7d367fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d380bbf80 0x7f7d380a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.266+0000 7f7d377fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7d380a6bd0 0x7f7d380a7080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:33144/0 (socket says 172.21.15.72:33144) 2023-08-31T19:04:10.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.266+0000 7f7d377fe700 1 -- 172.21.15.72:0/2066639539 learned_addr learned my addr 172.21.15.72:0/2066639539 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:10.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.266+0000 7f7d36ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7d381558f0 0x7f7d380bba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:58058/0 (socket says 172.21.15.72:58058) 2023-08-31T19:04:10.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.266+0000 7f7d35ffb700 1 -- 172.21.15.72:0/2066639539 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513187818 0 0) 0x7f7d380c2d40 con 0x7f7d380a6bd0 2023-08-31T19:04:10.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.266+0000 7f7d35ffb700 1 -- 172.21.15.72:0/2066639539 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d200033f0 con 0x7f7d380a6bd0 2023-08-31T19:04:10.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.266+0000 7f7d36ffd700 1 -- 172.21.15.72:0/2066639539 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d380bbf80 msgr2=0x7f7d380a66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:10.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.266+0000 7f7d36ffd700 1 --2- 172.21.15.72:0/2066639539 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d380bbf80 0x7f7d380a66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.266+0000 7f7d36ffd700 1 -- 172.21.15.72:0/2066639539 >> v1:172.21.15.146:6789/0 conn(0x7f7d380a6bd0 legacy=0x7f7d380a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.266+0000 7f7d36ffd700 1 -- 172.21.15.72:0/2066639539 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d38155cd0 con 0x7f7d381558f0 2023-08-31T19:04:10.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.266+0000 7f7d367fc700 1 --2- 172.21.15.72:0/2066639539 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d380bbf80 0x7f7d380a66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:04:10.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.267+0000 7f7d36ffd700 1 --2- 172.21.15.72:0/2066639539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d381558f0 0x7f7d380bba90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f7d28009760 tx=0x7f7d28009060).ready entity=mon.1 client_cookie=282d9d1df496712f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:10.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.267+0000 7f7d35ffb700 1 -- 172.21.15.72:0/2066639539 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2800d4a0 con 0x7f7d381558f0 2023-08-31T19:04:10.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.267+0000 7f7d35ffb700 1 -- 172.21.15.72:0/2066639539 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2800d600 con 0x7f7d381558f0 2023-08-31T19:04:10.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.267+0000 7f7d35ffb700 1 -- 172.21.15.72:0/2066639539 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2800d980 con 0x7f7d381558f0 2023-08-31T19:04:10.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.267+0000 7f7d3d5ff700 1 -- 172.21.15.72:0/2066639539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d381558f0 msgr2=0x7f7d380bba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.267+0000 7f7d3d5ff700 1 --2- 172.21.15.72:0/2066639539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d381558f0 0x7f7d380bba90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f7d28009760 tx=0x7f7d28009060).stop 2023-08-31T19:04:10.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.268+0000 7f7d3d5ff700 1 -- 172.21.15.72:0/2066639539 shutdown_connections 2023-08-31T19:04:10.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.268+0000 7f7d3d5ff700 1 --2- 172.21.15.72:0/2066639539 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d381558f0 0x7f7d380bba90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.268+0000 7f7d3d5ff700 1 --2- 172.21.15.72:0/2066639539 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d380bbf80 0x7f7d380a66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.268+0000 7f7d3d5ff700 1 -- 172.21.15.72:0/2066639539 >> 172.21.15.72:0/2066639539 conn(0x7f7d38063120 msgr2=0x7f7d380c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:10.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.268+0000 7f7d3d5ff700 1 -- 172.21.15.72:0/2066639539 shutdown_connections 2023-08-31T19:04:10.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.268+0000 7f7d3d5ff700 1 -- 172.21.15.72:0/2066639539 wait complete. 2023-08-31T19:04:10.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.269+0000 7f7d3d5ff700 1 Processor -- start 2023-08-31T19:04:10.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.269+0000 7f7d3d5ff700 1 -- start start 2023-08-31T19:04:10.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.270+0000 7f7d3d5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d380a6bd0 0x7f7d38152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.270+0000 7f7d3d5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d380bbf80 0x7f7d38139f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.270+0000 7f7d3d5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d381558f0 0x7f7d380abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.270+0000 7f7d3d5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d38139a70 con 0x7f7d380a6bd0 2023-08-31T19:04:10.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.270+0000 7f7d3d5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3813a3f0 con 0x7f7d381558f0 2023-08-31T19:04:10.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.270+0000 7f7d3d5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d38163880 con 0x7f7d380bbf80 2023-08-31T19:04:10.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.270+0000 7f7d36ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d380a6bd0 0x7f7d38152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.270+0000 7f7d36ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d380a6bd0 0x7f7d38152e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54236/0 (socket says 172.21.15.72:54236) 2023-08-31T19:04:10.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.270+0000 7f7d36ffd700 1 -- 172.21.15.72:0/2466632851 learned_addr learned my addr 172.21.15.72:0/2466632851 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:10.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.271+0000 7f7d377fe700 1 --2- 172.21.15.72:0/2466632851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d381558f0 0x7f7d380abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.271+0000 7f7d367fc700 1 --2- 172.21.15.72:0/2466632851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d380bbf80 0x7f7d38139f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.271+0000 7f7d36ffd700 1 -- 172.21.15.72:0/2466632851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d380bbf80 msgr2=0x7f7d38139f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.271+0000 7f7d36ffd700 1 --2- 172.21.15.72:0/2466632851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d380bbf80 0x7f7d38139f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.271+0000 7f7d36ffd700 1 -- 172.21.15.72:0/2466632851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d381558f0 msgr2=0x7f7d380abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.271+0000 7f7d36ffd700 1 --2- 172.21.15.72:0/2466632851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d381558f0 0x7f7d380abcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.271+0000 7f7d36ffd700 1 -- 172.21.15.72:0/2466632851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c0092a0 con 0x7f7d380a6bd0 2023-08-31T19:04:10.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.271+0000 7f7d36ffd700 1 --2- 172.21.15.72:0/2466632851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d380a6bd0 0x7f7d38152e80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f7d28009d50 tx=0x7f7d28016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:10.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.271+0000 7f7d1effd700 1 -- 172.21.15.72:0/2466632851 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2800dd40 con 0x7f7d380a6bd0 2023-08-31T19:04:10.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.271+0000 7f7d1effd700 1 -- 172.21.15.72:0/2466632851 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2800d770 con 0x7f7d380a6bd0 2023-08-31T19:04:10.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.271+0000 7f7d1effd700 1 -- 172.21.15.72:0/2466632851 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2800dea0 con 0x7f7d380a6bd0 2023-08-31T19:04:10.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.271+0000 7f7d3d5ff700 1 -- 172.21.15.72:0/2466632851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d280092a0 con 0x7f7d380a6bd0 2023-08-31T19:04:10.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.271+0000 7f7d3d5ff700 1 -- 172.21.15.72:0/2466632851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d38139420 con 0x7f7d380a6bd0 2023-08-31T19:04:10.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.273+0000 7f7d1effd700 1 -- 172.21.15.72:0/2466632851 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7d28018070 con 0x7f7d380a6bd0 2023-08-31T19:04:10.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.274+0000 7f7d1effd700 1 --2- 172.21.15.72:0/2466632851 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7d2405ef30 0x7f7d240613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.274+0000 7f7d1effd700 1 -- 172.21.15.72:0/2466632851 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f7d2807bab0 con 0x7f7d380a6bd0 2023-08-31T19:04:10.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.274+0000 7f7d367fc700 1 --2- 172.21.15.72:0/2466632851 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7d2405ef30 0x7f7d240613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.275+0000 7f7d367fc700 1 --2- 172.21.15.72:0/2466632851 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7d2405ef30 0x7f7d240613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7d2c009270 tx=0x7f7d2c008040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.276+0000 7f7d549adb80 1 Processor -- start 2023-08-31T19:04:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.276+0000 7f7d549adb80 1 -- start start 2023-08-31T19:04:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.277+0000 7f7d549adb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceeb72c0 0x5616ceeb76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.277+0000 7f7d549adb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceefff60 0x5616ceeb2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.277+0000 7f7d549adb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616ceeb2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.277+0000 7f7d549adb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616cedf3db0 con 0x5616ceefff60 2023-08-31T19:04:10.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.277+0000 7f7d549adb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616cee09030 con 0x5616ceeb72c0 2023-08-31T19:04:10.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.277+0000 7f7d549adb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616cee09170 con 0x5616ceeb2af0 2023-08-31T19:04:10.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.277+0000 7f7d367fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceefff60 0x5616ceeb2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.277+0000 7f7d367fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceefff60 0x5616ceeb2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54242/0 (socket says 172.21.15.72:54242) 2023-08-31T19:04:10.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.277+0000 7f7d367fc700 1 -- 172.21.15.72:0/1244181444 learned_addr learned my addr 172.21.15.72:0/1244181444 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:10.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.278+0000 7f7d367fc700 1 -- 172.21.15.72:0/1244181444 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 msgr2=0x5616ceeb2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:10.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.278+0000 7f7d367fc700 1 --2- 172.21.15.72:0/1244181444 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616ceeb2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:10.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.278+0000 7f7d367fc700 1 -- 172.21.15.72:0/1244181444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceeb72c0 msgr2=0x5616ceeb76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:10.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.278+0000 7f7d36ffd700 1 --2- 172.21.15.72:0/1244181444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceeb72c0 0x5616ceeb76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.278+0000 7f7d367fc700 1 --2- 172.21.15.72:0/1244181444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceeb72c0 0x5616ceeb76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.278+0000 7f7d367fc700 1 -- 172.21.15.72:0/1244181444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616ceddbb00 con 0x5616ceefff60 2023-08-31T19:04:10.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.278+0000 7f7d367fc700 1 --2- 172.21.15.72:0/1244181444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceefff60 0x5616ceeb2600 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f7d2c011d00 tx=0x7f7d2c016000).ready entity=mon.0 client_cookie=90d0f934cbf046d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:10.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.278+0000 7f7d1c9fe700 1 -- 172.21.15.72:0/1244181444 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c011eb0 con 0x5616ceefff60 2023-08-31T19:04:10.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.278+0000 7f7d1c9fe700 1 -- 172.21.15.72:0/1244181444 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c009900 con 0x5616ceefff60 2023-08-31T19:04:10.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.278+0000 7f7d1c9fe700 1 -- 172.21.15.72:0/1244181444 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c020400 con 0x5616ceefff60 2023-08-31T19:04:10.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.279+0000 7f7d549adb80 1 -- 172.21.15.72:0/1244181444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceefff60 msgr2=0x5616ceeb2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.279+0000 7f7d549adb80 1 --2- 172.21.15.72:0/1244181444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceefff60 0x5616ceeb2600 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f7d2c011d00 tx=0x7f7d2c016000).stop 2023-08-31T19:04:10.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.279+0000 7f7d549adb80 1 -- 172.21.15.72:0/1244181444 shutdown_connections 2023-08-31T19:04:10.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.279+0000 7f7d549adb80 1 --2- 172.21.15.72:0/1244181444 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616ceeb2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:10.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.279+0000 7f7d549adb80 1 --2- 172.21.15.72:0/1244181444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceeb72c0 0x5616ceeb76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.279+0000 7f7d549adb80 1 --2- 172.21.15.72:0/1244181444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceefff60 0x5616ceeb2600 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.279+0000 7f7d549adb80 1 -- 172.21.15.72:0/1244181444 >> 172.21.15.72:0/1244181444 conn(0x5616ced21940 msgr2=0x5616cef003f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:10.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.279+0000 7f7d549adb80 1 -- 172.21.15.72:0/1244181444 shutdown_connections 2023-08-31T19:04:10.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.279+0000 7f7d549adb80 1 -- 172.21.15.72:0/1244181444 wait complete. 2023-08-31T19:04:10.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.280+0000 7f7d549adb80 1 -- start start 2023-08-31T19:04:10.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.280+0000 7f7d549adb80 1 Processor -- start 2023-08-31T19:04:10.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.281+0000 7f7d549adb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616ceee18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.281+0000 7f7d549adb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceeb72c0 0x5616cef0f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.281+0000 7f7d549adb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceefff60 0x5616cef0fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.281+0000 7f7d549adb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616cee093f0 con 0x5616ceeb72c0 2023-08-31T19:04:10.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.281+0000 7f7d549adb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616cedd4920 con 0x5616ceefff60 2023-08-31T19:04:10.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.281+0000 7f7d549adb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616cef0ff00 con 0x5616ceeb2af0 2023-08-31T19:04:10.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.281+0000 7f7d549adb80 10 client.0 ll_register_callbacks cb 0x5616ceda9ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:04:10.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.281+0000 7f7d367fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceeb72c0 0x5616cef0f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.281+0000 7f7d367fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceeb72c0 0x5616cef0f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54246/0 (socket says 172.21.15.72:54246) 2023-08-31T19:04:10.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.281+0000 7f7d367fc700 1 -- 172.21.15.72:0/2757856877 learned_addr learned my addr 172.21.15.72:0/2757856877 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:10.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.282+0000 7f7d377fe700 1 --2- 172.21.15.72:0/2757856877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceefff60 0x5616cef0fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.282+0000 7f7d36ffd700 1 --2- 172.21.15.72:0/2757856877 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616ceee18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.282+0000 7f7d367fc700 1 -- 172.21.15.72:0/2757856877 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 msgr2=0x5616ceee18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:10.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.282+0000 7f7d367fc700 1 --2- 172.21.15.72:0/2757856877 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616ceee18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.282+0000 7f7d367fc700 1 -- 172.21.15.72:0/2757856877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceefff60 msgr2=0x5616cef0fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:10.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.282+0000 7f7d367fc700 1 --2- 172.21.15.72:0/2757856877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceefff60 0x5616cef0fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.282+0000 7f7d367fc700 1 -- 172.21.15.72:0/2757856877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2c0119c0 con 0x5616ceeb72c0 2023-08-31T19:04:10.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.282+0000 7f7d367fc700 1 --2- 172.21.15.72:0/2757856877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceeb72c0 0x5616cef0f520 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f7d2c023040 tx=0x7f7d2c020000).ready entity=mon.0 client_cookie=b2981c5d767ecfe9 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:10.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.282+0000 7f7d157fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:04:10.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.282+0000 7f7d157fa700 1 -- 172.21.15.72:0/2757856877 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c020400 con 0x5616ceeb72c0 2023-08-31T19:04:10.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.282+0000 7f7d549adb80 1 -- 172.21.15.72:0/2757856877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5616ceeb1aa0 con 0x5616ceeb72c0 2023-08-31T19:04:10.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.282+0000 7f7d157fa700 1 -- 172.21.15.72:0/2757856877 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f7d2c029600 con 0x5616ceeb72c0 2023-08-31T19:04:10.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.282+0000 7f7d157fa700 1 -- 172.21.15.72:0/2757856877 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d2c032ea0 con 0x5616ceeb72c0 2023-08-31T19:04:10.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.282+0000 7f7d549adb80 10 client.6846 fetch_fsmap learned FSMap version 40 2023-08-31T19:04:10.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.282+0000 7f7d549adb80 1 -- 172.21.15.72:0/2757856877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x5616cee01f70 con 0x5616ceeb72c0 2023-08-31T19:04:10.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.283+0000 7f7d157fa700 1 -- 172.21.15.72:0/2757856877 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5616ceeb1aa0 con 0x5616ceeb72c0 2023-08-31T19:04:10.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.283+0000 7f7d157fa700 1 -- 172.21.15.72:0/2757856877 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7d2c0299d0 con 0x5616ceeb72c0 2023-08-31T19:04:10.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.283+0000 7f7d549adb80 10 client.6846 fetch_fsmap finished waiting for FSMap version 40 2023-08-31T19:04:10.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.283+0000 7f7d549adb80 10 client.6846 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:04:10.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.283+0000 7f7d549adb80 20 client.6846 populate_metadata read hostname 'smithi072' 2023-08-31T19:04:10.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.283+0000 7f7d549adb80 1 --2- 172.21.15.72:0/2757856877 >> [v2:172.21.15.72:6835/859098343,v1:172.21.15.72:6837/859098343] conn(0x5616ceee5cb0 0x5616ceede030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.283+0000 7f7d549adb80 4 client.6846 mds_command: new command op to 6699 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T19:04:10.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.283+0000 7f7d549adb80 1 -- 172.21.15.72:0/2757856877 --> [v2:172.21.15.72:6835/859098343,v1:172.21.15.72:6837/859098343] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5616cec71ef0 con 0x5616ceee5cb0 2023-08-31T19:04:10.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.283+0000 7f7d36ffd700 1 --2- 172.21.15.72:0/2757856877 >> [v2:172.21.15.72:6835/859098343,v1:172.21.15.72:6837/859098343] conn(0x5616ceee5cb0 0x5616ceede030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.283+0000 7f7d36ffd700 1 --2- 172.21.15.72:0/2757856877 >> [v2:172.21.15.72:6835/859098343,v1:172.21.15.72:6837/859098343] conn(0x5616ceee5cb0 0x5616ceede030 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9c9861073db7df6 server_cookie=994608b7a4b715f4 in_seq=0 out_seq=0 2023-08-31T19:04:10.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.283+0000 7f7d157fa700 10 client.6846 ms_handle_connect on v2:172.21.15.72:6835/859098343 2023-08-31T19:04:10.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.284+0000 7f7d157fa700 1 -- 172.21.15.72:0/2757856877 <== mds.0 v2:172.21.15.72:6835/859098343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5616cec71ef0 con 0x5616ceee5cb0 2023-08-31T19:04:10.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.284+0000 7f7d157fa700 10 client.6846 handle_command_reply: tid=0 2023-08-31T19:04:10.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.284+0000 7f7d549adb80 1 client.6846 shutdown 2023-08-31T19:04:10.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.284+0000 7f7d549adb80 1 -- 172.21.15.72:0/2757856877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceeb72c0 msgr2=0x5616cef0f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.284+0000 7f7d549adb80 1 --2- 172.21.15.72:0/2757856877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceeb72c0 0x5616cef0f520 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7f7d2c023040 tx=0x7f7d2c020000).stop 2023-08-31T19:04:10.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.284+0000 7f7d549adb80 1 -- 172.21.15.72:0/2757856877 shutdown_connections 2023-08-31T19:04:10.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.284+0000 7f7d549adb80 1 --2- 172.21.15.72:0/2757856877 >> [v2:172.21.15.72:6835/859098343,v1:172.21.15.72:6837/859098343] conn(0x5616ceee5cb0 0x5616ceede030 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.285+0000 7f7d549adb80 1 --2- 172.21.15.72:0/2757856877 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceefff60 0x5616cef0fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.285+0000 7f7d549adb80 1 --2- 172.21.15.72:0/2757856877 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616ceee18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.285+0000 7f7d549adb80 1 --2- 172.21.15.72:0/2757856877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceeb72c0 0x5616cef0f520 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.285+0000 7f7d549adb80 1 -- 172.21.15.72:0/2757856877 >> 172.21.15.72:0/2757856877 conn(0x5616ced21940 msgr2=0x5616ceeb5330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:10.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.285+0000 7f7d157fa700 0 client.6846 ms_handle_reset on v2:172.21.15.72:6835/859098343 2023-08-31T19:04:10.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.285+0000 7f7d549adb80 1 -- 172.21.15.72:0/2757856877 shutdown_connections 2023-08-31T19:04:10.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.285+0000 7f7d549adb80 1 -- 172.21.15.72:0/2757856877 wait complete. 2023-08-31T19:04:10.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.285+0000 7f7d549adb80 20 client.6846 trim_cache size 0 max 16384 2023-08-31T19:04:10.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.302+0000 7f7d549adb80 1 Processor -- start 2023-08-31T19:04:10.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.302+0000 7f7d549adb80 1 -- start start 2023-08-31T19:04:10.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d549adb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616ceef9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d549adb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceeb72c0 0x5616ceeb7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d549adb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceefff60 0x5616cef0f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d549adb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ceeb6400 con 0x5616ceefff60 2023-08-31T19:04:10.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d549adb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ceeaf6b0 con 0x5616ceeb72c0 2023-08-31T19:04:10.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d549adb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616ceeb6d90 con 0x5616ceeb2af0 2023-08-31T19:04:10.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d377fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceefff60 0x5616cef0f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d377fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceefff60 0x5616cef0f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54250/0 (socket says 172.21.15.72:54250) 2023-08-31T19:04:10.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d377fe700 1 -- 172.21.15.72:0/1196835383 learned_addr learned my addr 172.21.15.72:0/1196835383 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:10.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d367fc700 1 --2- 172.21.15.72:0/1196835383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceeb72c0 0x5616ceeb7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d36ffd700 1 --2- 172.21.15.72:0/1196835383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616ceef9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d377fe700 1 -- 172.21.15.72:0/1196835383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 msgr2=0x5616ceef9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:10.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d377fe700 1 --2- 172.21.15.72:0/1196835383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616ceef9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d377fe700 1 -- 172.21.15.72:0/1196835383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceeb72c0 msgr2=0x5616ceeb7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:10.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d377fe700 1 --2- 172.21.15.72:0/1196835383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceeb72c0 0x5616ceeb7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d377fe700 1 -- 172.21.15.72:0/1196835383 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d380aa740 con 0x5616ceefff60 2023-08-31T19:04:10.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.303+0000 7f7d36ffd700 1 --2- 172.21.15.72:0/1196835383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616ceef9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:10.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.304+0000 7f7d377fe700 1 --2- 172.21.15.72:0/1196835383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceefff60 0x5616cef0f190 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f7d30007170 tx=0x7f7d30009040).ready entity=mon.0 client_cookie=395feb672b30c092 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:10.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.304+0000 7f7d1d1ff700 1 -- 172.21.15.72:0/1196835383 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30015410 con 0x5616ceefff60 2023-08-31T19:04:10.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.304+0000 7f7d1d1ff700 1 -- 172.21.15.72:0/1196835383 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d30015570 con 0x5616ceefff60 2023-08-31T19:04:10.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.304+0000 7f7d1d1ff700 1 -- 172.21.15.72:0/1196835383 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300158f0 con 0x5616ceefff60 2023-08-31T19:04:10.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.304+0000 7f7d549adb80 1 -- 172.21.15.72:0/1196835383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceefff60 msgr2=0x5616cef0f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.304+0000 7f7d549adb80 1 --2- 172.21.15.72:0/1196835383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceefff60 0x5616cef0f190 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f7d30007170 tx=0x7f7d30009040).stop 2023-08-31T19:04:10.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.304+0000 7f7d549adb80 1 -- 172.21.15.72:0/1196835383 shutdown_connections 2023-08-31T19:04:10.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.304+0000 7f7d549adb80 1 --2- 172.21.15.72:0/1196835383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceefff60 0x5616cef0f190 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.304+0000 7f7d549adb80 1 --2- 172.21.15.72:0/1196835383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616ceef9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.304+0000 7f7d549adb80 1 --2- 172.21.15.72:0/1196835383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceeb72c0 0x5616ceeb7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.304+0000 7f7d549adb80 1 -- 172.21.15.72:0/1196835383 >> 172.21.15.72:0/1196835383 conn(0x5616ced21940 msgr2=0x5616cef003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:10.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.305+0000 7f7d549adb80 1 -- 172.21.15.72:0/1196835383 shutdown_connections 2023-08-31T19:04:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.305+0000 7f7d549adb80 1 -- 172.21.15.72:0/1196835383 wait complete. 2023-08-31T19:04:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.305+0000 7f7d549adb80 1 -- start start 2023-08-31T19:04:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.305+0000 7f7d549adb80 1 Processor -- start 2023-08-31T19:04:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.306+0000 7f7d549adb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616cef653b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.306+0000 7f7d549adb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceeb72c0 0x5616cef00c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.306+0000 7f7d549adb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceefff60 0x5616cef01110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.306+0000 7f7d549adb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616cef01600 con 0x5616ceeb72c0 2023-08-31T19:04:10.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.306+0000 7f7d549adb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616cef66d60 con 0x5616ceefff60 2023-08-31T19:04:10.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.306+0000 7f7d549adb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616cef0f450 con 0x5616ceeb2af0 2023-08-31T19:04:10.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.307+0000 7f7d549adb80 10 client.0 ll_register_callbacks cb 0x5616ceda9ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:04:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.307+0000 7f7d367fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceeb72c0 0x5616cef00c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.307+0000 7f7d367fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceeb72c0 0x5616cef00c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54254/0 (socket says 172.21.15.72:54254) 2023-08-31T19:04:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.307+0000 7f7d367fc700 1 -- 172.21.15.72:0/1304932361 learned_addr learned my addr 172.21.15.72:0/1304932361 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.307+0000 7f7d377fe700 1 --2- 172.21.15.72:0/1304932361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceefff60 0x5616cef01110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.307+0000 7f7d36ffd700 1 --2- 172.21.15.72:0/1304932361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616cef653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.307+0000 7f7d367fc700 1 -- 172.21.15.72:0/1304932361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 msgr2=0x5616cef653b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:10.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.307+0000 7f7d367fc700 1 --2- 172.21.15.72:0/1304932361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616cef653b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.307+0000 7f7d367fc700 1 -- 172.21.15.72:0/1304932361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceefff60 msgr2=0x5616cef01110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:10.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.307+0000 7f7d367fc700 1 --2- 172.21.15.72:0/1304932361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceefff60 0x5616cef01110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.307+0000 7f7d367fc700 1 -- 172.21.15.72:0/1304932361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3000f040 con 0x5616ceeb72c0 2023-08-31T19:04:10.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.307+0000 7f7d36ffd700 1 --2- 172.21.15.72:0/1304932361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616cef653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:10.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.307+0000 7f7d367fc700 1 --2- 172.21.15.72:0/1304932361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceeb72c0 0x5616cef00c20 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x5616ceee2a60 tx=0x7f7d2c028000).ready entity=mon.0 client_cookie=8a6509c0b534aca5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:10.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.307+0000 7f7d157fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:04:10.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.307+0000 7f7d157fa700 1 -- 172.21.15.72:0/1304932361 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c020400 con 0x5616ceeb72c0 2023-08-31T19:04:10.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.308+0000 7f7d157fa700 1 -- 172.21.15.72:0/1304932361 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f7d2c029600 con 0x5616ceeb72c0 2023-08-31T19:04:10.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.308+0000 7f7d549adb80 1 -- 172.21.15.72:0/1304932361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d2c009900 con 0x5616ceeb72c0 2023-08-31T19:04:10.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.308+0000 7f7d157fa700 1 -- 172.21.15.72:0/1304932361 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d2c0299d0 con 0x5616ceeb72c0 2023-08-31T19:04:10.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.308+0000 7f7d549adb80 10 client.6852 fetch_fsmap learned FSMap version 40 2023-08-31T19:04:10.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.308+0000 7f7d549adb80 1 -- 172.21.15.72:0/1304932361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x5616cedfd580 con 0x5616ceeb72c0 2023-08-31T19:04:10.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.308+0000 7f7d157fa700 1 -- 172.21.15.72:0/1304932361 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c009900 con 0x5616ceeb72c0 2023-08-31T19:04:10.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.308+0000 7f7d157fa700 1 -- 172.21.15.72:0/1304932361 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7d2c03b600 con 0x5616ceeb72c0 2023-08-31T19:04:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.308+0000 7f7d549adb80 10 client.6852 fetch_fsmap finished waiting for FSMap version 40 2023-08-31T19:04:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.308+0000 7f7d549adb80 10 client.6852 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:04:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.308+0000 7f7d549adb80 20 client.6852 populate_metadata read hostname 'smithi072' 2023-08-31T19:04:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.308+0000 7f7d549adb80 1 --2- 172.21.15.72:0/1304932361 >> [v2:172.21.15.72:6835/859098343,v1:172.21.15.72:6837/859098343] conn(0x5616cef0d8a0 0x5616cef0dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.308+0000 7f7d549adb80 4 client.6852 mds_command: new command op to 6699 tid=0[{"prefix": "status"}] 2023-08-31T19:04:10.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.308+0000 7f7d549adb80 1 -- 172.21.15.72:0/1304932361 --> [v2:172.21.15.72:6835/859098343,v1:172.21.15.72:6837/859098343] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5616ceca7040 con 0x5616cef0d8a0 2023-08-31T19:04:10.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.308+0000 7f7d36ffd700 1 --2- 172.21.15.72:0/1304932361 >> [v2:172.21.15.72:6835/859098343,v1:172.21.15.72:6837/859098343] conn(0x5616cef0d8a0 0x5616cef0dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d36ffd700 1 --2- 172.21.15.72:0/1304932361 >> [v2:172.21.15.72:6835/859098343,v1:172.21.15.72:6837/859098343] conn(0x5616cef0d8a0 0x5616cef0dc80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2f724049adece5b6 server_cookie=3c145895c7371e49 in_seq=0 out_seq=0 2023-08-31T19:04:10.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d157fa700 10 client.6852 ms_handle_connect on v2:172.21.15.72:6835/859098343 2023-08-31T19:04:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d157fa700 1 -- 172.21.15.72:0/1304932361 <== mds.0 v2:172.21.15.72:6835/859098343 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5616ceca7040 con 0x5616cef0d8a0 2023-08-31T19:04:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d157fa700 10 client.6852 handle_command_reply: tid=0 2023-08-31T19:04:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d549adb80 1 client.6852 shutdown 2023-08-31T19:04:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d549adb80 1 -- 172.21.15.72:0/1304932361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceeb72c0 msgr2=0x5616cef00c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d549adb80 1 --2- 172.21.15.72:0/1304932361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceeb72c0 0x5616cef00c20 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x5616ceee2a60 tx=0x7f7d2c028000).stop 2023-08-31T19:04:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d549adb80 1 -- 172.21.15.72:0/1304932361 shutdown_connections 2023-08-31T19:04:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d549adb80 1 --2- 172.21.15.72:0/1304932361 >> [v2:172.21.15.72:6835/859098343,v1:172.21.15.72:6837/859098343] conn(0x5616cef0d8a0 0x5616cef0dc80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d549adb80 1 --2- 172.21.15.72:0/1304932361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5616ceefff60 0x5616cef01110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d549adb80 1 --2- 172.21.15.72:0/1304932361 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5616ceeb2af0 0x5616cef653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d549adb80 1 --2- 172.21.15.72:0/1304932361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5616ceeb72c0 0x5616cef00c20 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d157fa700 0 client.6852 ms_handle_reset on v2:172.21.15.72:6835/859098343 2023-08-31T19:04:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d549adb80 1 -- 172.21.15.72:0/1304932361 >> 172.21.15.72:0/1304932361 conn(0x5616ced21940 msgr2=0x5616ceee5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d549adb80 1 -- 172.21.15.72:0/1304932361 shutdown_connections 2023-08-31T19:04:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.309+0000 7f7d549adb80 1 -- 172.21.15.72:0/1304932361 wait complete. 2023-08-31T19:04:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.310+0000 7f7d549adb80 20 client.6852 trim_cache size 0 max 16384 2023-08-31T19:04:10.332 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:04:10.332 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "acadb8ca-1685-49e1-a73f-5e9d14d95be9", 2023-08-31T19:04:10.332 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-08-31T19:04:10.333 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 6699, 2023-08-31T19:04:10.333 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-08-31T19:04:10.333 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-08-31T19:04:10.333 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-08-31T19:04:10.333 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 6.3153998869999999, 2023-08-31T19:04:10.334 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 40, 2023-08-31T19:04:10.334 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 94, 2023-08-31T19:04:10.334 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 94, 2023-08-31T19:04:10.334 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 11.516847957 2023-08-31T19:04:10.334 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:04:10.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.310+0000 7f7d3d5ff700 1 -- 172.21.15.72:0/2466632851 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7d2405ef30 msgr2=0x7f7d240613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.310+0000 7f7d3d5ff700 1 --2- 172.21.15.72:0/2466632851 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7d2405ef30 0x7f7d240613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7d2c009270 tx=0x7f7d2c008040).stop 2023-08-31T19:04:10.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.310+0000 7f7d3d5ff700 1 -- 172.21.15.72:0/2466632851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d380a6bd0 msgr2=0x7f7d38152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.310+0000 7f7d3d5ff700 1 --2- 172.21.15.72:0/2466632851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d380a6bd0 0x7f7d38152e80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f7d28009d50 tx=0x7f7d28016000).stop 2023-08-31T19:04:10.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.310+0000 7f7d3d5ff700 1 -- 172.21.15.72:0/2466632851 shutdown_connections 2023-08-31T19:04:10.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.310+0000 7f7d3d5ff700 1 --2- 172.21.15.72:0/2466632851 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7d2405ef30 0x7f7d240613f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.310+0000 7f7d3d5ff700 1 --2- 172.21.15.72:0/2466632851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d381558f0 0x7f7d380abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.310+0000 7f7d3d5ff700 1 --2- 172.21.15.72:0/2466632851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d380a6bd0 0x7f7d38152e80 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.310+0000 7f7d3d5ff700 1 --2- 172.21.15.72:0/2466632851 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7d380bbf80 0x7f7d38139f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.310+0000 7f7d3d5ff700 1 -- 172.21.15.72:0/2466632851 >> 172.21.15.72:0/2466632851 conn(0x7f7d38063120 msgr2=0x7f7d380c6130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:10.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.310+0000 7f7d3d5ff700 1 -- 172.21.15.72:0/2466632851 shutdown_connections 2023-08-31T19:04:10.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.310+0000 7f7d3d5ff700 1 -- 172.21.15.72:0/2466632851 wait complete. 2023-08-31T19:04:10.339 DEBUG:teuthology.orchestra.run.smithi072:> ceph fs ls 2023-08-31T19:04:10.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.497+0000 7fa5bbfff700 1 Processor -- start 2023-08-31T19:04:10.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.498+0000 7fa5bbfff700 1 -- start start 2023-08-31T19:04:10.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.499+0000 7fa5bbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5b40a5b20 0x7fa5b41530a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.499+0000 7fa5bbfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b40bc4a0 con 0x7fa5b4149060 2023-08-31T19:04:10.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.499+0000 7fa5bbfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b4153590 con 0x7fa5b4067fb0 2023-08-31T19:04:10.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.499+0000 7fa5bbfff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b40a5fd0 con 0x7fa5b40a5b20 2023-08-31T19:04:10.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.499+0000 7fa5b9d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa5b4149060 0x7fa5b40640d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37630/0 (socket says 172.21.15.72:37630) 2023-08-31T19:04:10.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.499+0000 7fa5b9d9b700 1 -- 172.21.15.72:0/3789069020 learned_addr learned my addr 172.21.15.72:0/3789069020 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:10.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.499+0000 7fa5b959a700 1 --2- 172.21.15.72:0/3789069020 >> v2:172.21.15.146:3300/0 conn(0x7fa5b40a5b20 0x7fa5b41530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b8d99700 1 -- 172.21.15.72:0/3789069020 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962283806 0 0) 0x7fa5b40bc4a0 con 0x7fa5b4149060 2023-08-31T19:04:10.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b8d99700 1 -- 172.21.15.72:0/3789069020 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a00033f0 con 0x7fa5b4149060 2023-08-31T19:04:10.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b8d99700 1 -- 172.21.15.72:0/3789069020 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1651580003 0 0) 0x7fa5a00033f0 con 0x7fa5b4149060 2023-08-31T19:04:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b8d99700 1 -- 172.21.15.72:0/3789069020 >> v2:172.21.15.146:3300/0 conn(0x7fa5b40a5b20 msgr2=0x7fa5b41530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b8d99700 1 --2- 172.21.15.72:0/3789069020 >> v2:172.21.15.146:3300/0 conn(0x7fa5b40a5b20 0x7fa5b41530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b8d99700 1 -- 172.21.15.72:0/3789069020 >> v1:172.21.15.146:6789/0 conn(0x7fa5b4067fb0 legacy=0x7fa5b40683c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b8d99700 1 -- 172.21.15.72:0/3789069020 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b40a61b0 con 0x7fa5b4149060 2023-08-31T19:04:10.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b8d99700 1 -- 172.21.15.72:0/3789069020 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fa5b0001470 con 0x7fa5b4149060 2023-08-31T19:04:10.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b8d99700 1 -- 172.21.15.72:0/3789069020 >> v1:172.21.15.72:6789/0 conn(0x7fa5b4149060 legacy=0x7fa5b40640d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b8d99700 1 --2- 172.21.15.72:0/3789069020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a00038e0 0x7fa5a0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b8d99700 1 --2- 172.21.15.72:0/3789069020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5a0004690 0x7fa5a0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b8d99700 1 --2- 172.21.15.72:0/3789069020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5a0005000 0x7fa5a000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b8d99700 1 -- 172.21.15.72:0/3789069020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40a5fd0 con 0x7fa5a00038e0 2023-08-31T19:04:10.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b8d99700 1 -- 172.21.15.72:0/3789069020 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a000beb0 con 0x7fa5a0005000 2023-08-31T19:04:10.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b8d99700 1 -- 172.21.15.72:0/3789069020 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a000c070 con 0x7fa5a0004690 2023-08-31T19:04:10.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5b9d9b700 1 --2- 172.21.15.72:0/3789069020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a00038e0 0x7fa5a0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.500+0000 7fa5ba59c700 1 --2- 172.21.15.72:0/3789069020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5a0005000 0x7fa5a000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.501+0000 7fa5b959a700 1 --2- 172.21.15.72:0/3789069020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5a0004690 0x7fa5a0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.501+0000 7fa5b9d9b700 1 -- 172.21.15.72:0/3789069020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5a0004690 msgr2=0x7fa5a0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:10.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.501+0000 7fa5b9d9b700 1 --2- 172.21.15.72:0/3789069020 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5a0004690 0x7fa5a0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.501+0000 7fa5b9d9b700 1 -- 172.21.15.72:0/3789069020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5a0005000 msgr2=0x7fa5a000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:10.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.501+0000 7fa5b9d9b700 1 --2- 172.21.15.72:0/3789069020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5a0005000 0x7fa5a000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.501+0000 7fa5b9d9b700 1 -- 172.21.15.72:0/3789069020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a00033f0 con 0x7fa5a00038e0 2023-08-31T19:04:10.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.501+0000 7fa5ba59c700 1 -- 172.21.15.72:0/3789069020 reap_dead start 2023-08-31T19:04:10.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.501+0000 7fa5b9d9b700 1 --2- 172.21.15.72:0/3789069020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a00038e0 0x7fa5a0003d00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7fa5b000c190 tx=0x7fa5b0001e50).ready entity=mon.0 client_cookie=2281bbb95c90952b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:10.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.501+0000 7fa5b8d99700 1 -- 172.21.15.72:0/3789069020 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0007a20 con 0x7fa5a00038e0 2023-08-31T19:04:10.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.501+0000 7fa5b8d99700 1 -- 172.21.15.72:0/3789069020 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b000cac0 con 0x7fa5a00038e0 2023-08-31T19:04:10.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.501+0000 7fa5b8d99700 1 -- 172.21.15.72:0/3789069020 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000ce40 con 0x7fa5a00038e0 2023-08-31T19:04:10.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.502+0000 7fa5bbfff700 1 -- 172.21.15.72:0/3789069020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a00038e0 msgr2=0x7fa5a0003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.502+0000 7fa5bbfff700 1 --2- 172.21.15.72:0/3789069020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a00038e0 0x7fa5a0003d00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7fa5b000c190 tx=0x7fa5b0001e50).stop 2023-08-31T19:04:10.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.502+0000 7fa5bbfff700 1 -- 172.21.15.72:0/3789069020 shutdown_connections 2023-08-31T19:04:10.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.502+0000 7fa5bbfff700 1 --2- 172.21.15.72:0/3789069020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a00038e0 0x7fa5a0003d00 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.502+0000 7fa5bbfff700 1 -- 172.21.15.72:0/3789069020 >> 172.21.15.72:0/3789069020 conn(0x7fa5b4063120 msgr2=0x7fa5b40c6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:10.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.502+0000 7fa5bbfff700 1 -- 172.21.15.72:0/3789069020 shutdown_connections 2023-08-31T19:04:10.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.502+0000 7fa5bbfff700 1 -- 172.21.15.72:0/3789069020 wait complete. 2023-08-31T19:04:10.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.503+0000 7fa5bbfff700 1 Processor -- start 2023-08-31T19:04:10.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.503+0000 7fa5bbfff700 1 -- start start 2023-08-31T19:04:10.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.504+0000 7fa5bbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a00038e0 0x7fa5b40a9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.504+0000 7fa5bbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5b40c6460 0x7fa5b4146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.504+0000 7fa5bbfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b40a63d0 0x7fa5b41472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.504+0000 7fa5bbfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40a7d30 con 0x7fa5a00038e0 2023-08-31T19:04:10.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.504+0000 7fa5bbfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40a7fb0 con 0x7fa5b40c6460 2023-08-31T19:04:10.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.504+0000 7fa5bbfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40a8290 con 0x7fa5b40a63d0 2023-08-31T19:04:10.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.505+0000 7fa5b9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a00038e0 0x7fa5b40a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.505+0000 7fa5b9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a00038e0 0x7fa5b40a9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54270/0 (socket says 172.21.15.72:54270) 2023-08-31T19:04:10.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.505+0000 7fa5b9d9b700 1 -- 172.21.15.72:0/3026884290 learned_addr learned my addr 172.21.15.72:0/3026884290 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:10.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.505+0000 7fa5b959a700 1 --2- 172.21.15.72:0/3026884290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5b40c6460 0x7fa5b4146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.505+0000 7fa5ba59c700 1 --2- 172.21.15.72:0/3026884290 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b40a63d0 0x7fa5b41472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.505+0000 7fa5b9d9b700 1 -- 172.21.15.72:0/3026884290 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b40a63d0 msgr2=0x7fa5b41472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.505+0000 7fa5b9d9b700 1 --2- 172.21.15.72:0/3026884290 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b40a63d0 0x7fa5b41472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.505+0000 7fa5b9d9b700 1 -- 172.21.15.72:0/3026884290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5b40c6460 msgr2=0x7fa5b4146a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.505+0000 7fa5b9d9b700 1 --2- 172.21.15.72:0/3026884290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5b40c6460 0x7fa5b4146a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.505+0000 7fa5b9d9b700 1 -- 172.21.15.72:0/3026884290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b40a8570 con 0x7fa5a00038e0 2023-08-31T19:04:10.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.505+0000 7fa5b9d9b700 1 --2- 172.21.15.72:0/3026884290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a00038e0 0x7fa5b40a9050 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7fa5a000be80 tx=0x7fa5b0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:10.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.505+0000 7fa5a9ffb700 1 -- 172.21.15.72:0/3026884290 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0007430 con 0x7fa5a00038e0 2023-08-31T19:04:10.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.505+0000 7fa5a9ffb700 1 -- 172.21.15.72:0/3026884290 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b0007590 con 0x7fa5a00038e0 2023-08-31T19:04:10.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.505+0000 7fa5bbfff700 1 -- 172.21.15.72:0/3026884290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b40a8850 con 0x7fa5a00038e0 2023-08-31T19:04:10.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.505+0000 7fa5a9ffb700 1 -- 172.21.15.72:0/3026884290 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00048e0 con 0x7fa5a00038e0 2023-08-31T19:04:10.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.506+0000 7fa5bbfff700 1 -- 172.21.15.72:0/3026884290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b414fa70 con 0x7fa5a00038e0 2023-08-31T19:04:10.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.506+0000 7fa5bbfff700 1 -- 172.21.15.72:0/3026884290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b40a8cf0 con 0x7fa5a00038e0 2023-08-31T19:04:10.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.507+0000 7fa5a9ffb700 1 -- 172.21.15.72:0/3026884290 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa5b001c070 con 0x7fa5a00038e0 2023-08-31T19:04:10.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.508+0000 7fa5a9ffb700 1 --2- 172.21.15.72:0/3026884290 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa59805ef30 0x7fa5980613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:10.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.508+0000 7fa5a9ffb700 1 -- 172.21.15.72:0/3026884290 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7fa5b007aab0 con 0x7fa5a00038e0 2023-08-31T19:04:10.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.508+0000 7fa5b959a700 1 --2- 172.21.15.72:0/3026884290 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa59805ef30 0x7fa5980613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:10.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.509+0000 7fa5b959a700 1 --2- 172.21.15.72:0/3026884290 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa59805ef30 0x7fa5980613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa5b40c0e00 tx=0x7fa5a4008040).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:10.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.512+0000 7fa5a9ffb700 1 -- 172.21.15.72:0/3026884290 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa5b004ba80 con 0x7fa5a00038e0 2023-08-31T19:04:10.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.722+0000 7fa5bbfff700 1 -- 172.21.15.72:0/3026884290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa5b4047480 con 0x7fa5a00038e0 2023-08-31T19:04:10.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.722+0000 7fa5a9ffb700 1 -- 172.21.15.72:0/3026884290 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa5b0024070 con 0x7fa5a00038e0 2023-08-31T19:04:10.723 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T19:04:10.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.724+0000 7fa5bbfff700 1 -- 172.21.15.72:0/3026884290 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa59805ef30 msgr2=0x7fa5980613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.724+0000 7fa5bbfff700 1 --2- 172.21.15.72:0/3026884290 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa59805ef30 0x7fa5980613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa5b40c0e00 tx=0x7fa5a4008040).stop 2023-08-31T19:04:10.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.724+0000 7fa5bbfff700 1 -- 172.21.15.72:0/3026884290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a00038e0 msgr2=0x7fa5b40a9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:10.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.724+0000 7fa5bbfff700 1 --2- 172.21.15.72:0/3026884290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a00038e0 0x7fa5b40a9050 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7fa5a000be80 tx=0x7fa5b0015000).stop 2023-08-31T19:04:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.724+0000 7fa5bbfff700 1 -- 172.21.15.72:0/3026884290 shutdown_connections 2023-08-31T19:04:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.724+0000 7fa5bbfff700 1 --2- 172.21.15.72:0/3026884290 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa5b40a63d0 0x7fa5b41472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.724+0000 7fa5bbfff700 1 --2- 172.21.15.72:0/3026884290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a00038e0 0x7fa5b40a9050 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.724+0000 7fa5bbfff700 1 --2- 172.21.15.72:0/3026884290 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa59805ef30 0x7fa5980613f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.724+0000 7fa5bbfff700 1 --2- 172.21.15.72:0/3026884290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5b40c6460 0x7fa5b4146a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:10.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.724+0000 7fa5bbfff700 1 -- 172.21.15.72:0/3026884290 >> 172.21.15.72:0/3026884290 conn(0x7fa5b4063120 msgr2=0x7fa5b40a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:10.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.724+0000 7fa5bbfff700 1 -- 172.21.15.72:0/3026884290 shutdown_connections 2023-08-31T19:04:10.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:10.725+0000 7fa5bbfff700 1 -- 172.21.15.72:0/3026884290 wait complete. 2023-08-31T19:04:10.739 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-31T19:04:10.740 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:04:10.740 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-31T19:04:10.740 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T19:04:10.740 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T19:04:10.741 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-31T19:04:10.741 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-31T19:04:10.742 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:04:10.742 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:04:10.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:10.743 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-31T19:04:10.790 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:04:10.790 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:04:10.790 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:04:10.791 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:04:10.791 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-31T19:04:10.791 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:04:10.791 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:04:10.791 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:04:10.792 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-31T19:04:10.792 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:04:10.792 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:04:10.792 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-31T19:04:10.792 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:04:10.792 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:04:10.793 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:04:10.793 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:04:10.793 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:04:10.793 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 37026sec preferred_lft 37026sec 2023-08-31T19:04:10.793 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-31T19:04:10.794 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:04:10.794 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:04:10.794 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff 2023-08-31T19:04:10.794 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T19:04:10.794 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:04:10.795 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::7c68:c9ff:fe82:9771/64 scope link 2023-08-31T19:04:10.795 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:04:10.795 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:04:10.795 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e2:e1:71:f6:f6:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T19:04:10.795 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e0e1:71ff:fef6:f6fa/64 scope link 2023-08-31T19:04:10.796 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:04:10.796 INFO:teuthology.orchestra.run.smithi072.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:04:10.796 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T19:04:10.796 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::38f6:6ff:fe3c:1ef/64 scope link 2023-08-31T19:04:10.796 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:04:10.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:10.797 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:04:10.897 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-31T19:04:10.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:10.901 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-31T19:04:10.949 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-31T19:04:10.950 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:04:10.950 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:04:10.950 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:04:10.950 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:04:10.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:10.952 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T19:04:10.952 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T19:04:10.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:04:10.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:04:10.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:04:10.954 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T19:04:11.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:11.123 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T19:04:11.170 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T19:04:11.170 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T19:04:11.171 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:04:11.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:11.172 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-08-31T19:04:11.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:11.243 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-31T19:04:11.290 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-31T19:04:11.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:04:11.429 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:04:11.429 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:04:11.455 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:04:11.455 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:04:11.459 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-31T19:04:11.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:11.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T19:04:11.531 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-31T19:04:11.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.723+0000 7f12481ff700 1 Processor -- start 2023-08-31T19:04:11.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.723+0000 7f12481ff700 1 -- start start 2023-08-31T19:04:11.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.724+0000 7f12481ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12400ad1b0 0x7f12400ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:11.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.724+0000 7f12481ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12400637c0 0x7f1240155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:11.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.724+0000 7f12481ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12400c6130 con 0x7f1240157c10 2023-08-31T19:04:11.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.724+0000 7f12481ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12400c0350 con 0x7f12400ad1b0 2023-08-31T19:04:11.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.724+0000 7f12481ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12401580b0 con 0x7f12400637c0 2023-08-31T19:04:11.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.724+0000 7f1245f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12400ad1b0 0x7f12400ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:11.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.725+0000 7f1245f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12400ad1b0 0x7f12400ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54276/0 (socket says 172.21.15.72:54276) 2023-08-31T19:04:11.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.725+0000 7f1245f9b700 1 -- 172.21.15.72:0/1141388315 learned_addr learned my addr 172.21.15.72:0/1141388315 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:11.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.725+0000 7f124579a700 1 --1- 172.21.15.72:0/1141388315 >> v1:172.21.15.72:6789/0 conn(0x7f1240157c10 0x7f12400630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37642/0 (socket says 172.21.15.72:37642) 2023-08-31T19:04:11.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.725+0000 7f124679c700 1 --2- 172.21.15.72:0/1141388315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12400637c0 0x7f1240155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:11.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.725+0000 7f1245f9b700 1 -- 172.21.15.72:0/1141388315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12400637c0 msgr2=0x7f1240155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:11.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.725+0000 7f1245f9b700 1 --2- 172.21.15.72:0/1141388315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12400637c0 0x7f1240155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:11.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.725+0000 7f1245f9b700 1 -- 172.21.15.72:0/1141388315 >> v1:172.21.15.72:6789/0 conn(0x7f1240157c10 legacy=0x7f12400630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:11.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.725+0000 7f1245f9b700 1 -- 172.21.15.72:0/1141388315 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1240155560 con 0x7f12400ad1b0 2023-08-31T19:04:11.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.725+0000 7f1244f99700 1 -- 172.21.15.72:0/1141388315 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674162735 0 0) 0x7f12400c6130 con 0x7f1240157c10 2023-08-31T19:04:11.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.725+0000 7f1245f9b700 1 --2- 172.21.15.72:0/1141388315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12400ad1b0 0x7f12400ad590 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f123c006fd0 tx=0x7f123c0090f0).ready entity=mon.0 client_cookie=176325177ea418ef server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:11.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.725+0000 7f1244f99700 1 -- 172.21.15.72:0/1141388315 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c00b600 con 0x7f12400ad1b0 2023-08-31T19:04:11.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.725+0000 7f1244f99700 1 -- 172.21.15.72:0/1141388315 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c00b760 con 0x7f12400ad1b0 2023-08-31T19:04:11.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.726+0000 7f1244f99700 1 -- 172.21.15.72:0/1141388315 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c00bae0 con 0x7f12400ad1b0 2023-08-31T19:04:11.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.726+0000 7f12481ff700 1 -- 172.21.15.72:0/1141388315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12400ad1b0 msgr2=0x7f12400ad590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:11.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.726+0000 7f12481ff700 1 --2- 172.21.15.72:0/1141388315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12400ad1b0 0x7f12400ad590 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f123c006fd0 tx=0x7f123c0090f0).stop 2023-08-31T19:04:11.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.726+0000 7f12481ff700 1 -- 172.21.15.72:0/1141388315 shutdown_connections 2023-08-31T19:04:11.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.726+0000 7f12481ff700 1 --2- 172.21.15.72:0/1141388315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12400ad1b0 0x7f12400ad590 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:11.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.726+0000 7f12481ff700 1 --2- 172.21.15.72:0/1141388315 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12400637c0 0x7f1240155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:11.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.726+0000 7f12481ff700 1 -- 172.21.15.72:0/1141388315 >> 172.21.15.72:0/1141388315 conn(0x7f124005eb60 msgr2=0x7f12400cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:11.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.726+0000 7f12481ff700 1 -- 172.21.15.72:0/1141388315 shutdown_connections 2023-08-31T19:04:11.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.726+0000 7f12481ff700 1 -- 172.21.15.72:0/1141388315 wait complete. 2023-08-31T19:04:11.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.728+0000 7f12481ff700 1 Processor -- start 2023-08-31T19:04:11.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.728+0000 7f12481ff700 1 -- start start 2023-08-31T19:04:11.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.729+0000 7f12481ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12400637c0 0x7f124014a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:11.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.729+0000 7f12481ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12400ad1b0 0x7f12400c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:11.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.729+0000 7f12481ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1240157c10 0x7f12400645b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:11.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.729+0000 7f12481ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12400c4ea0 con 0x7f12400637c0 2023-08-31T19:04:11.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.729+0000 7f12481ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12400ac560 con 0x7f1240157c10 2023-08-31T19:04:11.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.729+0000 7f12481ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12400c4bc0 con 0x7f12400ad1b0 2023-08-31T19:04:11.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.729+0000 7f1245f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12400637c0 0x7f124014a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:11.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.729+0000 7f1245f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12400637c0 0x7f124014a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54280/0 (socket says 172.21.15.72:54280) 2023-08-31T19:04:11.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.729+0000 7f1245f9b700 1 -- 172.21.15.72:0/4282104798 learned_addr learned my addr 172.21.15.72:0/4282104798 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:11.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.729+0000 7f1245f9b700 1 -- 172.21.15.72:0/4282104798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12400ad1b0 msgr2=0x7f12400c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:11.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.729+0000 7f1245f9b700 1 --2- 172.21.15.72:0/4282104798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12400ad1b0 0x7f12400c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:11.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.729+0000 7f1245f9b700 1 -- 172.21.15.72:0/4282104798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1240157c10 msgr2=0x7f12400645b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:11.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.729+0000 7f1245f9b700 1 --2- 172.21.15.72:0/4282104798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1240157c10 0x7f12400645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:11.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.729+0000 7f1245f9b700 1 -- 172.21.15.72:0/4282104798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c009370 con 0x7f12400637c0 2023-08-31T19:04:11.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.729+0000 7f1245f9b700 1 --2- 172.21.15.72:0/4282104798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12400637c0 0x7f124014a8e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f12400cad20 tx=0x7f123c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:11.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.730+0000 7f1235ffb700 1 -- 172.21.15.72:0/4282104798 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c00b8d0 con 0x7f12400637c0 2023-08-31T19:04:11.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.730+0000 7f1235ffb700 1 -- 172.21.15.72:0/4282104798 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c00ba30 con 0x7f12400637c0 2023-08-31T19:04:11.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.730+0000 7f12481ff700 1 -- 172.21.15.72:0/4282104798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12400abf10 con 0x7f12400637c0 2023-08-31T19:04:11.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.730+0000 7f1235ffb700 1 -- 172.21.15.72:0/4282104798 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c01c670 con 0x7f12400637c0 2023-08-31T19:04:11.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.730+0000 7f12481ff700 1 -- 172.21.15.72:0/4282104798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124014add0 con 0x7f12400637c0 2023-08-31T19:04:11.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.731+0000 7f12481ff700 1 -- 172.21.15.72:0/4282104798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12400abd70 con 0x7f12400637c0 2023-08-31T19:04:11.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.732+0000 7f1235ffb700 1 -- 172.21.15.72:0/4282104798 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f123c01ca60 con 0x7f12400637c0 2023-08-31T19:04:11.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.732+0000 7f1235ffb700 1 --2- 172.21.15.72:0/4282104798 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f122405ef30 0x7f12240613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:11.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.732+0000 7f1235ffb700 1 -- 172.21.15.72:0/4282104798 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f123c07c180 con 0x7f12400637c0 2023-08-31T19:04:11.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.733+0000 7f124579a700 1 --2- 172.21.15.72:0/4282104798 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f122405ef30 0x7f12240613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:11.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.733+0000 7f124579a700 1 --2- 172.21.15.72:0/4282104798 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f122405ef30 0x7f12240613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f12400a9dc0 tx=0x7f12300079f0).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:11.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.737+0000 7f1235ffb700 1 -- 172.21.15.72:0/4282104798 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f12400abd70 con 0x7f12400637c0 2023-08-31T19:04:11.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.931+0000 7f12481ff700 1 -- 172.21.15.72:0/4282104798 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f12400abd70 con 0x7f122405ef30 2023-08-31T19:04:11.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.932+0000 7f1235ffb700 1 -- 172.21.15.72:0/4282104798 <== mgr.6501 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f12400abd70 con 0x7f122405ef30 2023-08-31T19:04:11.933 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:04:11.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:11.933 INFO:teuthology.orchestra.run.smithi072.stdout: "name": "cephfs" 2023-08-31T19:04:11.933 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:11.934 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:04:11.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.935+0000 7f12481ff700 1 -- 172.21.15.72:0/4282104798 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f122405ef30 msgr2=0x7f12240613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:11.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.935+0000 7f12481ff700 1 --2- 172.21.15.72:0/4282104798 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f122405ef30 0x7f12240613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f12400a9dc0 tx=0x7f12300079f0).stop 2023-08-31T19:04:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.935+0000 7f12481ff700 1 -- 172.21.15.72:0/4282104798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12400637c0 msgr2=0x7f124014a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.935+0000 7f12481ff700 1 --2- 172.21.15.72:0/4282104798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12400637c0 0x7f124014a8e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f12400cad20 tx=0x7f123c017000).stop 2023-08-31T19:04:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.935+0000 7f12481ff700 1 -- 172.21.15.72:0/4282104798 shutdown_connections 2023-08-31T19:04:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.935+0000 7f12481ff700 1 --2- 172.21.15.72:0/4282104798 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f122405ef30 0x7f12240613f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.935+0000 7f12481ff700 1 --2- 172.21.15.72:0/4282104798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1240157c10 0x7f12400645b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.935+0000 7f12481ff700 1 --2- 172.21.15.72:0/4282104798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12400637c0 0x7f124014a8e0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.935+0000 7f12481ff700 1 --2- 172.21.15.72:0/4282104798 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12400ad1b0 0x7f12400c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.935+0000 7f12481ff700 1 -- 172.21.15.72:0/4282104798 >> 172.21.15.72:0/4282104798 conn(0x7f124005eb60 msgr2=0x7f1240152ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.935+0000 7f12481ff700 1 -- 172.21.15.72:0/4282104798 shutdown_connections 2023-08-31T19:04:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:11.935+0000 7f12481ff700 1 -- 172.21.15.72:0/4282104798 wait complete. 2023-08-31T19:04:11.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-31T19:04:12.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.146+0000 7f3d359ff700 1 Processor -- start 2023-08-31T19:04:12.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.146+0000 7f3d359ff700 1 -- start start 2023-08-31T19:04:12.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.147+0000 7f3d359ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d30153ed0 0x7f3d301542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:12.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.147+0000 7f3d359ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3d300bdb30 0x7f3d30155200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:12.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.147+0000 7f3d359ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d300a84b0 con 0x7f3d300663d0 2023-08-31T19:04:12.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.147+0000 7f3d359ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d300c9410 con 0x7f3d300bdb30 2023-08-31T19:04:12.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.147+0000 7f3d359ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d300c5310 con 0x7f3d30153ed0 2023-08-31T19:04:12.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.148+0000 7f3d2f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3d300663d0 0x7f3d30067900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37648/0 (socket says 172.21.15.72:37648) 2023-08-31T19:04:12.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.148+0000 7f3d2f7fe700 1 -- 172.21.15.72:0/1456489335 learned_addr learned my addr 172.21.15.72:0/1456489335 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:12.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.148+0000 7f3d2effd700 1 --2- 172.21.15.72:0/1456489335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d30153ed0 0x7f3d301542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:12.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.148+0000 7f3d2e7fc700 1 --2- 172.21.15.72:0/1456489335 >> v2:172.21.15.146:3300/0 conn(0x7f3d300bdb30 0x7f3d30155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:12.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.148+0000 7f3d2dffb700 1 -- 172.21.15.72:0/1456489335 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721259910 0 0) 0x7f3d300a84b0 con 0x7f3d300663d0 2023-08-31T19:04:12.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.148+0000 7f3d2dffb700 1 -- 172.21.15.72:0/1456489335 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d180033f0 con 0x7f3d300663d0 2023-08-31T19:04:12.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.148+0000 7f3d2effd700 1 -- 172.21.15.72:0/1456489335 >> v2:172.21.15.146:3300/0 conn(0x7f3d300bdb30 msgr2=0x7f3d30155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:12.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.148+0000 7f3d2effd700 1 --2- 172.21.15.72:0/1456489335 >> v2:172.21.15.146:3300/0 conn(0x7f3d300bdb30 0x7f3d30155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.148+0000 7f3d2effd700 1 -- 172.21.15.72:0/1456489335 >> v1:172.21.15.72:6789/0 conn(0x7f3d300663d0 legacy=0x7f3d30067900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:12.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.148+0000 7f3d2dffb700 1 -- 172.21.15.72:0/1456489335 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2047668790 0 0) 0x7f3d180033f0 con 0x7f3d300663d0 2023-08-31T19:04:12.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.148+0000 7f3d2effd700 1 -- 172.21.15.72:0/1456489335 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d301556f0 con 0x7f3d30153ed0 2023-08-31T19:04:12.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.149+0000 7f3d2effd700 1 --2- 172.21.15.72:0/1456489335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d30153ed0 0x7f3d301542b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f3d20009760 tx=0x7f3d20009060).ready entity=mon.2 client_cookie=f57525de66419bbb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.149+0000 7f3d2dffb700 1 -- 172.21.15.72:0/1456489335 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28001840 con 0x7f3d30153ed0 2023-08-31T19:04:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.149+0000 7f3d2dffb700 1 -- 172.21.15.72:0/1456489335 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d200090d0 con 0x7f3d30153ed0 2023-08-31T19:04:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.149+0000 7f3d2dffb700 1 -- 172.21.15.72:0/1456489335 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20011610 con 0x7f3d30153ed0 2023-08-31T19:04:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.149+0000 7f3d359ff700 1 -- 172.21.15.72:0/1456489335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d30153ed0 msgr2=0x7f3d301542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.149+0000 7f3d359ff700 1 --2- 172.21.15.72:0/1456489335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d30153ed0 0x7f3d301542b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f3d20009760 tx=0x7f3d20009060).stop 2023-08-31T19:04:12.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.149+0000 7f3d359ff700 1 -- 172.21.15.72:0/1456489335 shutdown_connections 2023-08-31T19:04:12.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.149+0000 7f3d359ff700 1 --2- 172.21.15.72:0/1456489335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d30153ed0 0x7f3d301542b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.149+0000 7f3d359ff700 1 --2- 172.21.15.72:0/1456489335 >> v2:172.21.15.146:3300/0 conn(0x7f3d300bdb30 0x7f3d30155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.149+0000 7f3d359ff700 1 -- 172.21.15.72:0/1456489335 >> 172.21.15.72:0/1456489335 conn(0x7f3d3005eb60 msgr2=0x7f3d300c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:12.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.150+0000 7f3d359ff700 1 -- 172.21.15.72:0/1456489335 shutdown_connections 2023-08-31T19:04:12.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.150+0000 7f3d359ff700 1 -- 172.21.15.72:0/1456489335 wait complete. 2023-08-31T19:04:12.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.151+0000 7f3d359ff700 1 Processor -- start 2023-08-31T19:04:12.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.151+0000 7f3d359ff700 1 -- start start 2023-08-31T19:04:12.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.152+0000 7f3d359ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d300663d0 0x7f3d30168180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:12.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.152+0000 7f3d359ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d30153ed0 0x7f3d3013ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:12.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.152+0000 7f3d359ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d300a6f90 0x7f3d300c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:12.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.152+0000 7f3d359ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d300bff50 con 0x7f3d300663d0 2023-08-31T19:04:12.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.152+0000 7f3d359ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d30168670 con 0x7f3d30153ed0 2023-08-31T19:04:12.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.152+0000 7f3d359ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d300a74c0 con 0x7f3d300a6f90 2023-08-31T19:04:12.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.152+0000 7f3d2effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d300663d0 0x7f3d30168180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:12.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.152+0000 7f3d2effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d300663d0 0x7f3d30168180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54286/0 (socket says 172.21.15.72:54286) 2023-08-31T19:04:12.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.152+0000 7f3d2effd700 1 -- 172.21.15.72:0/1530453087 learned_addr learned my addr 172.21.15.72:0/1530453087 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:12.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.153+0000 7f3d2e7fc700 1 --2- 172.21.15.72:0/1530453087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d30153ed0 0x7f3d3013ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:12.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.153+0000 7f3d2f7fe700 1 --2- 172.21.15.72:0/1530453087 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d300a6f90 0x7f3d300c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:12.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.153+0000 7f3d2effd700 1 -- 172.21.15.72:0/1530453087 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d300a6f90 msgr2=0x7f3d300c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:12.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.153+0000 7f3d2effd700 1 --2- 172.21.15.72:0/1530453087 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d300a6f90 0x7f3d300c22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.153+0000 7f3d2effd700 1 -- 172.21.15.72:0/1530453087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d30153ed0 msgr2=0x7f3d3013ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:12.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.153+0000 7f3d2effd700 1 --2- 172.21.15.72:0/1530453087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d30153ed0 0x7f3d3013ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.153+0000 7f3d2effd700 1 -- 172.21.15.72:0/1530453087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d200092a0 con 0x7f3d300663d0 2023-08-31T19:04:12.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.153+0000 7f3d2f7fe700 1 --2- 172.21.15.72:0/1530453087 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d300a6f90 0x7f3d300c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:12.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.153+0000 7f3d2effd700 1 --2- 172.21.15.72:0/1530453087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d300663d0 0x7f3d30168180 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f3d20009d50 tx=0x7f3d20016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:12.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.153+0000 7f3d16ffd700 1 -- 172.21.15.72:0/1530453087 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20021070 con 0x7f3d300663d0 2023-08-31T19:04:12.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.153+0000 7f3d16ffd700 1 -- 172.21.15.72:0/1530453087 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d200106c0 con 0x7f3d300663d0 2023-08-31T19:04:12.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.153+0000 7f3d359ff700 1 -- 172.21.15.72:0/1530453087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d300c1800 con 0x7f3d300663d0 2023-08-31T19:04:12.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.153+0000 7f3d16ffd700 1 -- 172.21.15.72:0/1530453087 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20010a40 con 0x7f3d300663d0 2023-08-31T19:04:12.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.153+0000 7f3d359ff700 1 -- 172.21.15.72:0/1530453087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d300c1dc0 con 0x7f3d300663d0 2023-08-31T19:04:12.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.154+0000 7f3d359ff700 1 -- 172.21.15.72:0/1530453087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3006c6b0 con 0x7f3d300663d0 2023-08-31T19:04:12.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.155+0000 7f3d16ffd700 1 -- 172.21.15.72:0/1530453087 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 32) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f3d2001d430 con 0x7f3d300663d0 2023-08-31T19:04:12.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.156+0000 7f3d16ffd700 1 --2- 172.21.15.72:0/1530453087 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3d1c05ef30 0x7f3d1c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:12.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.156+0000 7f3d16ffd700 1 -- 172.21.15.72:0/1530453087 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f3d2007b310 con 0x7f3d300663d0 2023-08-31T19:04:12.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.156+0000 7f3d2e7fc700 1 --2- 172.21.15.72:0/1530453087 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3d1c05ef30 0x7f3d1c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:12.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.157+0000 7f3d2e7fc700 1 --2- 172.21.15.72:0/1530453087 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3d1c05ef30 0x7f3d1c0613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f3d300c8c50 tx=0x7f3d24009060).ready entity=mgr.6501 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:12.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.160+0000 7f3d16ffd700 1 -- 172.21.15.72:0/1530453087 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d2004c280 con 0x7f3d300663d0 2023-08-31T19:04:12.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.374+0000 7f3d359ff700 1 -- 172.21.15.72:0/1530453087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f3d300a7ef0 con 0x7f3d300663d0 2023-08-31T19:04:12.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.503+0000 7f3d16ffd700 1 -- 172.21.15.72:0/1530453087 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 33) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f3d20078c40 con 0x7f3d300663d0 2023-08-31T19:04:12.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.505+0000 7f3d16ffd700 1 -- 172.21.15.72:0/1530453087 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v33) v1 ==== 92+0+0 (secure 0 0 0) 0x7f3d20041760 con 0x7f3d300663d0 2023-08-31T19:04:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.507+0000 7f3d359ff700 1 -- 172.21.15.72:0/1530453087 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3d1c05ef30 msgr2=0x7f3d1c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.507+0000 7f3d359ff700 1 --2- 172.21.15.72:0/1530453087 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3d1c05ef30 0x7f3d1c0613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f3d300c8c50 tx=0x7f3d24009060).stop 2023-08-31T19:04:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.507+0000 7f3d359ff700 1 -- 172.21.15.72:0/1530453087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d300663d0 msgr2=0x7f3d30168180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.507+0000 7f3d359ff700 1 --2- 172.21.15.72:0/1530453087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d300663d0 0x7f3d30168180 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f3d20009d50 tx=0x7f3d20016000).stop 2023-08-31T19:04:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.507+0000 7f3d359ff700 1 -- 172.21.15.72:0/1530453087 shutdown_connections 2023-08-31T19:04:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.507+0000 7f3d359ff700 1 --2- 172.21.15.72:0/1530453087 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3d300a6f90 0x7f3d300c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.507+0000 7f3d359ff700 1 --2- 172.21.15.72:0/1530453087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d300663d0 0x7f3d30168180 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.507+0000 7f3d359ff700 1 --2- 172.21.15.72:0/1530453087 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3d1c05ef30 0x7f3d1c0613f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.507+0000 7f3d359ff700 1 --2- 172.21.15.72:0/1530453087 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d30153ed0 0x7f3d3013ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.507+0000 7f3d359ff700 1 -- 172.21.15.72:0/1530453087 >> 172.21.15.72:0/1530453087 conn(0x7f3d3005eb60 msgr2=0x7f3d30151270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.508+0000 7f3d359ff700 1 -- 172.21.15.72:0/1530453087 shutdown_connections 2023-08-31T19:04:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.508+0000 7f3d359ff700 1 -- 172.21.15.72:0/1530453087 wait complete. 2023-08-31T19:04:12.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-31T19:04:12.713 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:12.712+0000 7f482affc680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:04:12.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.723+0000 7f2e77dff700 1 Processor -- start 2023-08-31T19:04:12.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.723+0000 7f2e77dff700 1 -- start start 2023-08-31T19:04:12.724 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:12.723+0000 7f3ff6b3e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:04:12.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.724+0000 7f2e77dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2e701520e0 0x7f2e700a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:12.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.724+0000 7f2e77dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e700a9440 0x7f2e70068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:12.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.724+0000 7f2e77dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e701524c0 0x7f2e70068980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.724+0000 7f2e77dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e70068e70 con 0x7f2e701524c0 2023-08-31T19:04:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.724+0000 7f2e77dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e70064340 con 0x7f2e701520e0 2023-08-31T19:04:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.724+0000 7f2e77dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700bcd00 con 0x7f2e700a9440 2023-08-31T19:04:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.725+0000 7f2e7639c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e701524c0 0x7f2e70068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.725+0000 7f2e7639c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e701524c0 0x7f2e70068980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54326/0 (socket says 172.21.15.72:54326) 2023-08-31T19:04:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.725+0000 7f2e7639c700 1 -- 172.21.15.72:0/1422712794 learned_addr learned my addr 172.21.15.72:0/1422712794 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.725+0000 7f2e75b9b700 1 --2- 172.21.15.72:0/1422712794 >> v2:172.21.15.146:3300/0 conn(0x7f2e701520e0 0x7f2e700a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.725+0000 7f2e7539a700 1 --2- 172.21.15.72:0/1422712794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e700a9440 0x7f2e70068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.725+0000 7f2e7639c700 1 -- 172.21.15.72:0/1422712794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e700a9440 msgr2=0x7f2e70068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:12.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.725+0000 7f2e7639c700 1 --2- 172.21.15.72:0/1422712794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e700a9440 0x7f2e70068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.725+0000 7f2e7639c700 1 -- 172.21.15.72:0/1422712794 >> v2:172.21.15.146:3300/0 conn(0x7f2e701520e0 msgr2=0x7f2e700a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:12.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.725+0000 7f2e7639c700 1 --2- 172.21.15.72:0/1422712794 >> v2:172.21.15.146:3300/0 conn(0x7f2e701520e0 0x7f2e700a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.725+0000 7f2e7639c700 1 -- 172.21.15.72:0/1422712794 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e700bcfe0 con 0x7f2e701524c0 2023-08-31T19:04:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.725+0000 7f2e7639c700 1 --2- 172.21.15.72:0/1422712794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e701524c0 0x7f2e70068980 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f2e700c4610 tx=0x7f2e68009840).ready entity=mon.0 client_cookie=afd2a48a9d193113 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.726+0000 7f2e74b99700 1 -- 172.21.15.72:0/1422712794 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6800e070 con 0x7f2e701524c0 2023-08-31T19:04:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.726+0000 7f2e74b99700 1 -- 172.21.15.72:0/1422712794 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6800b970 con 0x7f2e701524c0 2023-08-31T19:04:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.726+0000 7f2e74b99700 1 -- 172.21.15.72:0/1422712794 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6800bcf0 con 0x7f2e701524c0 2023-08-31T19:04:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.726+0000 7f2e77dff700 1 -- 172.21.15.72:0/1422712794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e701524c0 msgr2=0x7f2e70068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:12.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.726+0000 7f2e77dff700 1 --2- 172.21.15.72:0/1422712794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e701524c0 0x7f2e70068980 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f2e700c4610 tx=0x7f2e68009840).stop 2023-08-31T19:04:12.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.726+0000 7f2e77dff700 1 -- 172.21.15.72:0/1422712794 shutdown_connections 2023-08-31T19:04:12.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.726+0000 7f2e77dff700 1 --2- 172.21.15.72:0/1422712794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e701524c0 0x7f2e70068980 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.726+0000 7f2e77dff700 1 --2- 172.21.15.72:0/1422712794 >> v2:172.21.15.146:3300/0 conn(0x7f2e701520e0 0x7f2e700a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.726+0000 7f2e77dff700 1 --2- 172.21.15.72:0/1422712794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e700a9440 0x7f2e70068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.726+0000 7f2e77dff700 1 -- 172.21.15.72:0/1422712794 >> 172.21.15.72:0/1422712794 conn(0x7f2e700630c0 msgr2=0x7f2e700c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:12.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.726+0000 7f2e77dff700 1 -- 172.21.15.72:0/1422712794 shutdown_connections 2023-08-31T19:04:12.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.727+0000 7f2e77dff700 1 -- 172.21.15.72:0/1422712794 wait complete. 2023-08-31T19:04:12.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.728+0000 7f2e77dff700 1 Processor -- start 2023-08-31T19:04:12.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.728+0000 7f2e77dff700 1 -- start start 2023-08-31T19:04:12.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.729+0000 7f2e77dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e700a9440 0x7f2e7014aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:12.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.729+0000 7f2e77dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e701520e0 0x7f2e700a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:12.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.729+0000 7f2e77dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e701524c0 0x7f2e700a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:12.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.729+0000 7f2e77dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700a82f0 con 0x7f2e700a9440 2023-08-31T19:04:12.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.729+0000 7f2e77dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7014af40 con 0x7f2e701520e0 2023-08-31T19:04:12.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.729+0000 7f2e77dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e701549c0 con 0x7f2e701524c0 2023-08-31T19:04:12.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.729+0000 7f2e75b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e700a9440 0x7f2e7014aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:12.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.729+0000 7f2e75b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e700a9440 0x7f2e7014aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54334/0 (socket says 172.21.15.72:54334) 2023-08-31T19:04:12.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.729+0000 7f2e75b9b700 1 -- 172.21.15.72:0/2793700210 learned_addr learned my addr 172.21.15.72:0/2793700210 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:12.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.729+0000 7f2e7539a700 1 --2- 172.21.15.72:0/2793700210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e701520e0 0x7f2e700a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:12.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.730+0000 7f2e7639c700 1 --2- 172.21.15.72:0/2793700210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e701524c0 0x7f2e700a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:12.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.730+0000 7f2e75b9b700 1 -- 172.21.15.72:0/2793700210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e701524c0 msgr2=0x7f2e700a7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:12.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.730+0000 7f2e75b9b700 1 --2- 172.21.15.72:0/2793700210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e701524c0 0x7f2e700a7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.730+0000 7f2e75b9b700 1 -- 172.21.15.72:0/2793700210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e701520e0 msgr2=0x7f2e700a7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:12.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.730+0000 7f2e75b9b700 1 --2- 172.21.15.72:0/2793700210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e701520e0 0x7f2e700a7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.730+0000 7f2e75b9b700 1 -- 172.21.15.72:0/2793700210 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e68009ae0 con 0x7f2e700a9440 2023-08-31T19:04:12.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.730+0000 7f2e75b9b700 1 --2- 172.21.15.72:0/2793700210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e700a9440 0x7f2e7014aa50 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f2e6c00e930 tx=0x7f2e6c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:12.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.730+0000 7f2e65ffb700 1 -- 172.21.15.72:0/2793700210 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c012600 con 0x7f2e700a9440 2023-08-31T19:04:12.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.730+0000 7f2e65ffb700 1 -- 172.21.15.72:0/2793700210 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c012760 con 0x7f2e700a9440 2023-08-31T19:04:12.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.730+0000 7f2e65ffb700 1 -- 172.21.15.72:0/2793700210 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c012ae0 con 0x7f2e700a9440 2023-08-31T19:04:12.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.730+0000 7f2e77dff700 1 -- 172.21.15.72:0/2793700210 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e70154ca0 con 0x7f2e700a9440 2023-08-31T19:04:12.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.730+0000 7f2e77dff700 1 -- 172.21.15.72:0/2793700210 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e700be540 con 0x7f2e700a9440 2023-08-31T19:04:12.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.732+0000 7f2e77dff700 1 -- 172.21.15.72:0/2793700210 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7006c6b0 con 0x7f2e700a9440 2023-08-31T19:04:12.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.732+0000 7f2e65ffb700 1 -- 172.21.15.72:0/2793700210 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 33) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f2e6c01b400 con 0x7f2e700a9440 2023-08-31T19:04:12.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.733+0000 7f2e65ffb700 1 --2- 172.21.15.72:0/2793700210 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2e5405ef80 0x7f2e54061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:12.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.733+0000 7f2e65ffb700 1 -- 172.21.15.72:0/2793700210 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f2e6c07a760 con 0x7f2e700a9440 2023-08-31T19:04:12.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.733+0000 7f2e7539a700 1 -- 172.21.15.72:0/2793700210 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2e5405ef80 msgr2=0x7f2e54061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:12.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.733+0000 7f2e7539a700 1 --2- 172.21.15.72:0/2793700210 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2e5405ef80 0x7f2e54061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:12.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.741+0000 7f2e65ffb700 1 -- 172.21.15.72:0/2793700210 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2e6c04b6d0 con 0x7f2e700a9440 2023-08-31T19:04:12.793 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:12.792+0000 7f482affc680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:04:12.808 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:12.808+0000 7f3ff6b3e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:04:12.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.919+0000 7f2e77dff700 1 -- 172.21.15.72:0/2793700210 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f2e700bd2c0 con 0x7f2e700a9440 2023-08-31T19:04:12.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.925+0000 7f2e65ffb700 1 -- 172.21.15.72:0/2793700210 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v15)=0 v15) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2e6c04ecf0 con 0x7f2e700a9440 2023-08-31T19:04:12.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.927+0000 7f2e77dff700 1 -- 172.21.15.72:0/2793700210 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2e5405ef80 msgr2=0x7f2e54061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:12.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.927+0000 7f2e77dff700 1 --2- 172.21.15.72:0/2793700210 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2e5405ef80 0x7f2e54061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:12.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.927+0000 7f2e77dff700 1 -- 172.21.15.72:0/2793700210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e700a9440 msgr2=0x7f2e7014aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:12.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.927+0000 7f2e77dff700 1 --2- 172.21.15.72:0/2793700210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e700a9440 0x7f2e7014aa50 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f2e6c00e930 tx=0x7f2e6c009060).stop 2023-08-31T19:04:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.927+0000 7f2e77dff700 1 -- 172.21.15.72:0/2793700210 shutdown_connections 2023-08-31T19:04:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.927+0000 7f2e77dff700 1 --2- 172.21.15.72:0/2793700210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e701524c0 0x7f2e700a7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.927+0000 7f2e77dff700 1 --2- 172.21.15.72:0/2793700210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e700a9440 0x7f2e7014aa50 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.927+0000 7f2e77dff700 1 --2- 172.21.15.72:0/2793700210 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2e5405ef80 0x7f2e54061440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:12.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.927+0000 7f2e77dff700 1 --2- 172.21.15.72:0/2793700210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e701520e0 0x7f2e700a7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:12.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.927+0000 7f2e77dff700 1 -- 172.21.15.72:0/2793700210 >> 172.21.15.72:0/2793700210 conn(0x7f2e700630c0 msgr2=0x7f2e7014b470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:12.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.928+0000 7f2e77dff700 1 -- 172.21.15.72:0/2793700210 shutdown_connections 2023-08-31T19:04:12.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:12.928+0000 7f2e77dff700 1 -- 172.21.15.72:0/2793700210 wait complete. 2023-08-31T19:04:12.946 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-08-31T19:04:13.122 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:13.121+0000 7f482affc680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:04:13.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.148+0000 7f884d1ff700 1 Processor -- start 2023-08-31T19:04:13.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.148+0000 7f884d1ff700 1 -- start start 2023-08-31T19:04:13.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.149+0000 7f884d1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8848134e00 0x7f8848068350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:13.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.149+0000 7f884d1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f88481351e0 0x7f88480c5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:13.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.149+0000 7f884d1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88480c5d10 0x7f88480bda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:13.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.149+0000 7f884d1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88480c3130 con 0x7f8848134e00 2023-08-31T19:04:13.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.149+0000 7f884d1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88480c4da0 con 0x7f88481351e0 2023-08-31T19:04:13.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.149+0000 7f884d1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88480c3940 con 0x7f88480c5d10 2023-08-31T19:04:13.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.149+0000 7f8846d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8848134e00 0x7f8848068350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:13.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.150+0000 7f8846d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8848134e00 0x7f8848068350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56894/0 (socket says 172.21.15.72:56894) 2023-08-31T19:04:13.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.150+0000 7f8846d9d700 1 -- 172.21.15.72:0/1582879189 learned_addr learned my addr 172.21.15.72:0/1582879189 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:13.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.150+0000 7f884659c700 1 --2- 172.21.15.72:0/1582879189 >> v2:172.21.15.146:3300/0 conn(0x7f88481351e0 0x7f88480c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:13.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.150+0000 7f884759e700 1 --2- 172.21.15.72:0/1582879189 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88480c5d10 0x7f88480bda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:13.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.150+0000 7f8846d9d700 1 -- 172.21.15.72:0/1582879189 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88480c5d10 msgr2=0x7f88480bda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:13.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.150+0000 7f8846d9d700 1 --2- 172.21.15.72:0/1582879189 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88480c5d10 0x7f88480bda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:13.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.150+0000 7f8846d9d700 1 -- 172.21.15.72:0/1582879189 >> v2:172.21.15.146:3300/0 conn(0x7f88481351e0 msgr2=0x7f88480c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:13.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.150+0000 7f8846d9d700 1 --2- 172.21.15.72:0/1582879189 >> v2:172.21.15.146:3300/0 conn(0x7f88481351e0 0x7f88480c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:13.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.150+0000 7f8846d9d700 1 -- 172.21.15.72:0/1582879189 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88480c3380 con 0x7f8848134e00 2023-08-31T19:04:13.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.150+0000 7f8846d9d700 1 --2- 172.21.15.72:0/1582879189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8848134e00 0x7f8848068350 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f8848066070 tx=0x7f88380090f0).ready entity=mon.0 client_cookie=4a395f0fd03bbbb6 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:13.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.150+0000 7f8845d9b700 1 -- 172.21.15.72:0/1582879189 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883800f510 con 0x7f8848134e00 2023-08-31T19:04:13.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.150+0000 7f8845d9b700 1 -- 172.21.15.72:0/1582879189 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883800f670 con 0x7f8848134e00 2023-08-31T19:04:13.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.151+0000 7f8845d9b700 1 -- 172.21.15.72:0/1582879189 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883800f9f0 con 0x7f8848134e00 2023-08-31T19:04:13.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.151+0000 7f884d1ff700 1 -- 172.21.15.72:0/1582879189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8848134e00 msgr2=0x7f8848068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:13.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.151+0000 7f884d1ff700 1 --2- 172.21.15.72:0/1582879189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8848134e00 0x7f8848068350 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f8848066070 tx=0x7f88380090f0).stop 2023-08-31T19:04:13.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.151+0000 7f884d1ff700 1 -- 172.21.15.72:0/1582879189 shutdown_connections 2023-08-31T19:04:13.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.151+0000 7f884d1ff700 1 --2- 172.21.15.72:0/1582879189 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88480c5d10 0x7f88480bda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:13.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.151+0000 7f884d1ff700 1 --2- 172.21.15.72:0/1582879189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8848134e00 0x7f8848068350 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:13.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.151+0000 7f884d1ff700 1 --2- 172.21.15.72:0/1582879189 >> v2:172.21.15.146:3300/0 conn(0x7f88481351e0 0x7f88480c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:13.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.151+0000 7f884d1ff700 1 -- 172.21.15.72:0/1582879189 >> 172.21.15.72:0/1582879189 conn(0x7f8848066350 msgr2=0x7f8848066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:13.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.151+0000 7f884d1ff700 1 -- 172.21.15.72:0/1582879189 shutdown_connections 2023-08-31T19:04:13.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.151+0000 7f884d1ff700 1 -- 172.21.15.72:0/1582879189 wait complete. 2023-08-31T19:04:13.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.153+0000 7f884d1ff700 1 Processor -- start 2023-08-31T19:04:13.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.153+0000 7f884d1ff700 1 -- start start 2023-08-31T19:04:13.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f884d1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88480c5d10 0x7f884814ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:13.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f884d1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8848134e00 0x7f8848064170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:13.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f884d1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88481351e0 0x7f8848164b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:13.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f884d1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884814db50 con 0x7f88480c5d10 2023-08-31T19:04:13.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f884d1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884814de30 con 0x7f88481351e0 2023-08-31T19:04:13.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f884d1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884814e110 con 0x7f8848134e00 2023-08-31T19:04:13.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f8846d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88480c5d10 0x7f884814ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:13.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f8846d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88480c5d10 0x7f884814ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56910/0 (socket says 172.21.15.72:56910) 2023-08-31T19:04:13.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f8846d9d700 1 -- 172.21.15.72:0/191012767 learned_addr learned my addr 172.21.15.72:0/191012767 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:13.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f884659c700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8848134e00 0x7f8848064170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:13.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f884759e700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88481351e0 0x7f8848164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:13.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f8846d9d700 1 -- 172.21.15.72:0/191012767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8848134e00 msgr2=0x7f8848064170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:13.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f8846d9d700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8848134e00 0x7f8848064170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:13.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f8846d9d700 1 -- 172.21.15.72:0/191012767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88481351e0 msgr2=0x7f8848164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:13.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f8846d9d700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88481351e0 0x7f8848164b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:13.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f8846d9d700 1 -- 172.21.15.72:0/191012767 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8838009370 con 0x7f88480c5d10 2023-08-31T19:04:13.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.154+0000 7f884759e700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88481351e0 0x7f8848164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:13.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.155+0000 7f8846d9d700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88480c5d10 0x7f884814ebf0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f8848069cd0 tx=0x7f8838017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:13.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.155+0000 7f882effd700 1 -- 172.21.15.72:0/191012767 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838006a40 con 0x7f88480c5d10 2023-08-31T19:04:13.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.155+0000 7f882effd700 1 -- 172.21.15.72:0/191012767 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883800f7e0 con 0x7f88480c5d10 2023-08-31T19:04:13.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.155+0000 7f884d1ff700 1 -- 172.21.15.72:0/191012767 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884814e3f0 con 0x7f88480c5d10 2023-08-31T19:04:13.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.155+0000 7f882effd700 1 -- 172.21.15.72:0/191012767 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883801b660 con 0x7f88480c5d10 2023-08-31T19:04:13.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.155+0000 7f884d1ff700 1 -- 172.21.15.72:0/191012767 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884814f0e0 con 0x7f88480c5d10 2023-08-31T19:04:13.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.156+0000 7f884d1ff700 1 -- 172.21.15.72:0/191012767 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884806c6b0 con 0x7f88480c5d10 2023-08-31T19:04:13.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.157+0000 7f882effd700 1 -- 172.21.15.72:0/191012767 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 33) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f883801ba50 con 0x7f88480c5d10 2023-08-31T19:04:13.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.158+0000 7f882effd700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 0x7f8834061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:13.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.158+0000 7f882effd700 1 -- 172.21.15.72:0/191012767 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f883807bcb0 con 0x7f88480c5d10 2023-08-31T19:04:13.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.158+0000 7f884659c700 1 -- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 msgr2=0x7f8834061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:13.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.158+0000 7f884659c700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 0x7f8834061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:13.165 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:13.159+0000 7f3ff6b3e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:04:13.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.162+0000 7f882effd700 1 -- 172.21.15.72:0/191012767 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f883804cdf0 con 0x7f88480c5d10 2023-08-31T19:04:13.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.359+0000 7f884659c700 1 -- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 msgr2=0x7f8834061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:13.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.359+0000 7f884659c700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 0x7f8834061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:04:13.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.361+0000 7f884d1ff700 1 -- 172.21.15.72:0/191012767 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f884814dfa0 con 0x7f883405ef80 2023-08-31T19:04:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.760+0000 7f884659c700 1 -- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 msgr2=0x7f8834061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:13.760+0000 7f884659c700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 0x7f8834061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-31T19:04:13.867 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:13.866+0000 7f482affc680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:04:13.908 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:13.908+0000 7f3ff6b3e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:04:13.949 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:13.949+0000 7f482affc680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:04:13.996 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:13.995+0000 7f3ff6b3e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:04:14.179 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:14.178+0000 7f482affc680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:04:14.224 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:14.224+0000 7f3ff6b3e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:04:14.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:14.561+0000 7f884659c700 1 -- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 msgr2=0x7f8834061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:14.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:14.561+0000 7f884659c700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 0x7f8834061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-31T19:04:14.690 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:14.689+0000 7f482affc680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:04:14.731 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:14.731+0000 7f3ff6b3e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:04:14.815 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:14.814+0000 7f482affc680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:04:14.855 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:14.855+0000 7f3ff6b3e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:04:14.999 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:14.999+0000 7f482affc680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:04:15.037 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:15.037+0000 7f3ff6b3e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:04:15.091 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:15.091+0000 7f482affc680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:04:15.129 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:15.129+0000 7f3ff6b3e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:04:15.174 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:15.174+0000 7f482affc680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:04:15.215 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:15.215+0000 7f3ff6b3e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:04:15.482 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:15.482+0000 7f482affc680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:04:15.522 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:15.522+0000 7f3ff6b3e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:04:15.703 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:15.703+0000 7f482affc680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:04:15.742 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:15.742+0000 7f3ff6b3e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:04:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:16.162+0000 7f884659c700 1 -- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 msgr2=0x7f8834061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:16.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:16.163+0000 7f884659c700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 0x7f8834061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-31T19:04:16.502 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:16.502+0000 7f482affc680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:04:16.537 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:16.537+0000 7f3ff6b3e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:04:16.589 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:16.589+0000 7f482affc680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:04:16.624 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:16.624+0000 7f3ff6b3e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:04:16.681 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:16.681+0000 7f482affc680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:04:16.718 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:16.718+0000 7f3ff6b3e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:04:16.864 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:16.863+0000 7f482affc680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:04:16.899 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:16.899+0000 7f3ff6b3e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:04:16.952 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:16.952+0000 7f482affc680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:04:16.987 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:16.987+0000 7f3ff6b3e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:04:17.092 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:17.092+0000 7f482affc680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:04:17.128 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:17.128+0000 7f3ff6b3e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:04:17.221 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:17.221+0000 7f482affc680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:04:17.260 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:17.260+0000 7f3ff6b3e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:04:17.566 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:17.566+0000 7f482affc680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:04:17.602 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:17.601+0000 7f3ff6b3e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:04:17.655 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:17.655+0000 7f482affc680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:04:17.691 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:17.691+0000 7f3ff6b3e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:04:17.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:17.701+0000 7f882effd700 1 -- 172.21.15.72:0/191012767 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 34) v1 ==== 75113+0+0 (secure 0 0 0) 0x7f883801bd00 con 0x7f88480c5d10 2023-08-31T19:04:17.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:17.701+0000 7f882effd700 1 -- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 msgr2=0x7f8834061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:17.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:17.701+0000 7f882effd700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 0x7f8834061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:17.777 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:17.777+0000 7f3f6c607700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:17.777 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:17.777+0000 7f3f6c607700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:17.778 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:17.777+0000 7f3f6c607700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:17.778 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:17.777+0000 7f3f6c607700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:17.778 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:17.777+0000 7f3f6c607700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:17.779 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:17.778+0000 7f3f67dfe700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:17.779 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:17.778+0000 7f3f67dfe700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:17.779 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:17.778+0000 7f3f67dfe700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:17.779 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:17.778+0000 7f3f67dfe700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:17.780 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:17.778+0000 7f3f67dfe700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:18.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.724+0000 7f882effd700 1 -- 172.21.15.72:0/191012767 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mgrmap(e 35) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f8838079a20 con 0x7f88480c5d10 2023-08-31T19:04:18.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.724+0000 7f882effd700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 0x7f88340613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:18.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.724+0000 7f882effd700 1 -- 172.21.15.72:0/191012767 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f884814dfa0 con 0x7f883405ef80 2023-08-31T19:04:18.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.727+0000 7f884659c700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 0x7f88340613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:18.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.730+0000 7f884659c700 1 --2- 172.21.15.72:0/191012767 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f883405ef80 0x7f88340613c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f8848156050 tx=0x7f883c009060).ready entity=mgr.6888 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:18.733 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:18.733+0000 7f3f74657700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-08-31T19:04:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.733+0000 7f882effd700 1 -- 172.21.15.72:0/191012767 <== mgr.6888 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f884814dfa0 con 0x7f883405ef80 2023-08-31T19:04:18.735 INFO:teuthology.orchestra.run.smithi072.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-08-31T19:04:18.744 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-08-31T19:04:18.745 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-31T19:04:18.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.939+0000 7fa20bdff700 1 Processor -- start 2023-08-31T19:04:18.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.939+0000 7fa20bdff700 1 -- start start 2023-08-31T19:04:18.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.940+0000 7fa20bdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa204153e20 0x7fa204154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.940+0000 7fa20bdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa204063270 0x7fa2040636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.940+0000 7fa20bdff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa204158a90 con 0x7fa2040a9d40 2023-08-31T19:04:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.940+0000 7fa20bdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa204157c70 con 0x7fa204063270 2023-08-31T19:04:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.940+0000 7fa20bdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa204063bc0 con 0x7fa204153e20 2023-08-31T19:04:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.940+0000 7fa20939a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa204063270 0x7fa2040636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:18.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.940+0000 7fa20939a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa204063270 0x7fa2040636d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57000/0 (socket says 172.21.15.72:57000) 2023-08-31T19:04:18.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.940+0000 7fa20939a700 1 -- 172.21.15.72:0/605136659 learned_addr learned my addr 172.21.15.72:0/605136659 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:18.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.941+0000 7fa209b9b700 1 --2- 172.21.15.72:0/605136659 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa204153e20 0x7fa204154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:18.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.941+0000 7fa20939a700 1 -- 172.21.15.72:0/605136659 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa204153e20 msgr2=0x7fa204154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:18.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.941+0000 7fa20939a700 1 --2- 172.21.15.72:0/605136659 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa204153e20 0x7fa204154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:18.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.941+0000 7fa20939a700 1 -- 172.21.15.72:0/605136659 >> v1:172.21.15.146:6789/0 conn(0x7fa2040a9d40 legacy=0x7fa204064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:18.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.941+0000 7fa20939a700 1 -- 172.21.15.72:0/605136659 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa204157e80 con 0x7fa204063270 2023-08-31T19:04:18.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.941+0000 7fa209b9b700 1 --2- 172.21.15.72:0/605136659 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa204153e20 0x7fa204154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:18.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.941+0000 7fa20939a700 1 --2- 172.21.15.72:0/605136659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa204063270 0x7fa2040636d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fa1f4006fd0 tx=0x7fa1f40090f0).ready entity=mon.0 client_cookie=794e187d871d1173 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:18.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.941+0000 7fa208b99700 1 -- 172.21.15.72:0/605136659 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f400b600 con 0x7fa204063270 2023-08-31T19:04:18.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.941+0000 7fa208b99700 1 -- 172.21.15.72:0/605136659 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f400b760 con 0x7fa204063270 2023-08-31T19:04:18.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.941+0000 7fa208b99700 1 -- 172.21.15.72:0/605136659 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f400bae0 con 0x7fa204063270 2023-08-31T19:04:18.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.942+0000 7fa20bdff700 1 -- 172.21.15.72:0/605136659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa204063270 msgr2=0x7fa2040636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:18.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.942+0000 7fa20bdff700 1 --2- 172.21.15.72:0/605136659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa204063270 0x7fa2040636d0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fa1f4006fd0 tx=0x7fa1f40090f0).stop 2023-08-31T19:04:18.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.942+0000 7fa20bdff700 1 -- 172.21.15.72:0/605136659 shutdown_connections 2023-08-31T19:04:18.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.942+0000 7fa20bdff700 1 --2- 172.21.15.72:0/605136659 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa204153e20 0x7fa204154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:18.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.942+0000 7fa20bdff700 1 --2- 172.21.15.72:0/605136659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa204063270 0x7fa2040636d0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:18.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.942+0000 7fa20bdff700 1 -- 172.21.15.72:0/605136659 >> 172.21.15.72:0/605136659 conn(0x7fa20405eb60 msgr2=0x7fa2040cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:18.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.942+0000 7fa20bdff700 1 -- 172.21.15.72:0/605136659 shutdown_connections 2023-08-31T19:04:18.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.942+0000 7fa20bdff700 1 -- 172.21.15.72:0/605136659 wait complete. 2023-08-31T19:04:18.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.943+0000 7fa20bdff700 1 Processor -- start 2023-08-31T19:04:18.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.944+0000 7fa20bdff700 1 -- start start 2023-08-31T19:04:18.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.944+0000 7fa20bdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa204063270 0x7fa20414ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:18.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.944+0000 7fa20bdff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2040a9d40 0x7fa2040aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:18.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa20bdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa204153e20 0x7fa2040af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:18.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa20bdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2040c4fb0 con 0x7fa204063270 2023-08-31T19:04:18.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa20bdff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa204155a00 con 0x7fa2040a9d40 2023-08-31T19:04:18.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa20bdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2040c4cd0 con 0x7fa204153e20 2023-08-31T19:04:18.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa209b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa204063270 0x7fa20414ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:18.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa209b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa204063270 0x7fa20414ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57010/0 (socket says 172.21.15.72:57010) 2023-08-31T19:04:18.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa209b9b700 1 -- 172.21.15.72:0/3044475431 learned_addr learned my addr 172.21.15.72:0/3044475431 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:18.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa20939a700 1 --2- 172.21.15.72:0/3044475431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2040a9d40 0x7fa2040aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:18.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa20a39c700 1 --2- 172.21.15.72:0/3044475431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa204153e20 0x7fa2040af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:18.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa209b9b700 1 -- 172.21.15.72:0/3044475431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa204153e20 msgr2=0x7fa2040af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:18.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa209b9b700 1 --2- 172.21.15.72:0/3044475431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa204153e20 0x7fa2040af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:18.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa209b9b700 1 -- 172.21.15.72:0/3044475431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2040a9d40 msgr2=0x7fa2040aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:18.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa209b9b700 1 --2- 172.21.15.72:0/3044475431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2040a9d40 0x7fa2040aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:18.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa209b9b700 1 -- 172.21.15.72:0/3044475431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f4009370 con 0x7fa204063270 2023-08-31T19:04:18.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa209b9b700 1 --2- 172.21.15.72:0/3044475431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa204063270 0x7fa20414ca80 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fa20000d890 tx=0x7fa200008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:18.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.945+0000 7fa1f9ffb700 1 -- 172.21.15.72:0/3044475431 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200011590 con 0x7fa204063270 2023-08-31T19:04:18.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.946+0000 7fa1f9ffb700 1 -- 172.21.15.72:0/3044475431 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2000116f0 con 0x7fa204063270 2023-08-31T19:04:18.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.946+0000 7fa20bdff700 1 -- 172.21.15.72:0/3044475431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2041553b0 con 0x7fa204063270 2023-08-31T19:04:18.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.946+0000 7fa1f9ffb700 1 -- 172.21.15.72:0/3044475431 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200011a70 con 0x7fa204063270 2023-08-31T19:04:18.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.946+0000 7fa20bdff700 1 -- 172.21.15.72:0/3044475431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20414cf70 con 0x7fa204063270 2023-08-31T19:04:18.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.947+0000 7fa20bdff700 1 -- 172.21.15.72:0/3044475431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20406c6b0 con 0x7fa204063270 2023-08-31T19:04:18.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.947+0000 7fa1f9ffb700 1 -- 172.21.15.72:0/3044475431 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 35) v1 ==== 75183+0+0 (secure 0 0 0) 0x7fa20001c460 con 0x7fa204063270 2023-08-31T19:04:18.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.948+0000 7fa1f9ffb700 1 --2- 172.21.15.72:0/3044475431 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa1e805ed10 0x7fa1e80611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:18.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.948+0000 7fa1f9ffb700 1 -- 172.21.15.72:0/3044475431 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6979+0+0 (secure 0 0 0) 0x7fa200079ff0 con 0x7fa204063270 2023-08-31T19:04:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.948+0000 7fa20939a700 1 --2- 172.21.15.72:0/3044475431 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa1e805ed10 0x7fa1e80611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.949+0000 7fa20939a700 1 --2- 172.21.15.72:0/3044475431 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa1e805ed10 0x7fa1e80611d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa1f4006fd0 tx=0x7fa1f4017000).ready entity=mgr.6888 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:18.953+0000 7fa1f9ffb700 1 -- 172.21.15.72:0/3044475431 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa20004b1a0 con 0x7fa204063270 2023-08-31T19:04:19.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:19.164+0000 7fa20bdff700 1 -- 172.21.15.72:0/3044475431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fa204158160 con 0x7fa204063270 2023-08-31T19:04:19.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:19.726+0000 7fa1f9ffb700 1 -- 172.21.15.72:0/3044475431 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 36) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fa200077b60 con 0x7fa204063270 2023-08-31T19:04:19.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:19.727+0000 7fa1f9ffb700 1 -- 172.21.15.72:0/3044475431 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v36) v1 ==== 93+0+0 (secure 0 0 0) 0x7fa2000724d0 con 0x7fa204063270 2023-08-31T19:04:19.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:19.729+0000 7fa20bdff700 1 -- 172.21.15.72:0/3044475431 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa1e805ed10 msgr2=0x7fa1e80611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:19.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:19.729+0000 7fa20bdff700 1 --2- 172.21.15.72:0/3044475431 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa1e805ed10 0x7fa1e80611d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa1f4006fd0 tx=0x7fa1f4017000).stop 2023-08-31T19:04:19.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:19.729+0000 7fa20bdff700 1 -- 172.21.15.72:0/3044475431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa204063270 msgr2=0x7fa20414ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:19.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:19.729+0000 7fa20bdff700 1 --2- 172.21.15.72:0/3044475431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa204063270 0x7fa20414ca80 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fa20000d890 tx=0x7fa200008040).stop 2023-08-31T19:04:19.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:19.729+0000 7fa20bdff700 1 -- 172.21.15.72:0/3044475431 shutdown_connections 2023-08-31T19:04:19.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:19.729+0000 7fa20bdff700 1 --2- 172.21.15.72:0/3044475431 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa204153e20 0x7fa2040af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:19.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:19.729+0000 7fa20bdff700 1 --2- 172.21.15.72:0/3044475431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa204063270 0x7fa20414ca80 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:19.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:19.729+0000 7fa20bdff700 1 --2- 172.21.15.72:0/3044475431 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa1e805ed10 0x7fa1e80611d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:19.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:19.729+0000 7fa20bdff700 1 --2- 172.21.15.72:0/3044475431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2040a9d40 0x7fa2040aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:19.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:19.729+0000 7fa20bdff700 1 -- 172.21.15.72:0/3044475431 >> 172.21.15.72:0/3044475431 conn(0x7fa20405eb60 msgr2=0x7fa20414d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:19.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:19.730+0000 7fa20bdff700 1 -- 172.21.15.72:0/3044475431 shutdown_connections 2023-08-31T19:04:19.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:19.730+0000 7fa20bdff700 1 -- 172.21.15.72:0/3044475431 wait complete. 2023-08-31T19:04:19.749 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:04:19.749 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:04:19.853 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:04:19.945 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:19.945+0000 7f8dd4fe8680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:04:19.947 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:19.947+0000 7fd303f74680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:04:19.957 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:04:19.958 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-31T19:04:19.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:04:19.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-31T19:04:20.029 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:20.029+0000 7f8dd4fe8680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:04:20.031 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:20.031+0000 7fd303f74680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:04:20.050 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T19:04:20.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:20.051 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T19:04:20.098 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:04:20.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.292+0000 7f1cebbff700 1 Processor -- start 2023-08-31T19:04:20.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.292+0000 7f1cebbff700 1 -- start start 2023-08-31T19:04:20.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.293+0000 7f1cebbff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ce4156310 0x7f1ce40c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:20.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.293+0000 7f1cebbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ce40bba70 0x7f1ce40c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:20.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.293+0000 7f1cebbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce40c26b0 con 0x7f1ce4135030 2023-08-31T19:04:20.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.293+0000 7f1cebbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce40c1e80 con 0x7f1ce40bba70 2023-08-31T19:04:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.293+0000 7f1cebbff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce40bc250 con 0x7f1ce4156310 2023-08-31T19:04:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.294+0000 7f1ce999b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1ce4135030 0x7f1ce4155c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44850/0 (socket says 172.21.15.72:44850) 2023-08-31T19:04:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.294+0000 7f1ce999b700 1 -- 172.21.15.72:0/1484071897 learned_addr learned my addr 172.21.15.72:0/1484071897 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.294+0000 7f1cea19c700 1 --2- 172.21.15.72:0/1484071897 >> v2:172.21.15.72:3300/0 conn(0x7f1ce40bba70 0x7f1ce40c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.294+0000 7f1ce919a700 1 --2- 172.21.15.72:0/1484071897 >> v2:172.21.15.146:3300/0 conn(0x7f1ce4156310 0x7f1ce40c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.294+0000 7f1cea19c700 1 -- 172.21.15.72:0/1484071897 >> v2:172.21.15.146:3300/0 conn(0x7f1ce4156310 msgr2=0x7f1ce40c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.294+0000 7f1cea19c700 1 --2- 172.21.15.72:0/1484071897 >> v2:172.21.15.146:3300/0 conn(0x7f1ce4156310 0x7f1ce40c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:20.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.294+0000 7f1cea19c700 1 -- 172.21.15.72:0/1484071897 >> v1:172.21.15.72:6789/0 conn(0x7f1ce4135030 legacy=0x7f1ce4155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:20.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.294+0000 7f1cea19c700 1 -- 172.21.15.72:0/1484071897 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce40bbf70 con 0x7f1ce40bba70 2023-08-31T19:04:20.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.294+0000 7f1ce8999700 1 -- 172.21.15.72:0/1484071897 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028920628 0 0) 0x7f1ce40c26b0 con 0x7f1ce4135030 2023-08-31T19:04:20.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.294+0000 7f1cea19c700 1 --2- 172.21.15.72:0/1484071897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce40bba70 0x7f1ce40c2b40 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f1ce406ab00 tx=0x7f1cdc009780).ready entity=mon.0 client_cookie=a125e3adf8784b23 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:20.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.295+0000 7f1ce8999700 1 -- 172.21.15.72:0/1484071897 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc00e070 con 0x7f1ce40bba70 2023-08-31T19:04:20.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.295+0000 7f1ce8999700 1 -- 172.21.15.72:0/1484071897 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc00bb60 con 0x7f1ce40bba70 2023-08-31T19:04:20.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.295+0000 7f1ce8999700 1 -- 172.21.15.72:0/1484071897 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc012410 con 0x7f1ce40bba70 2023-08-31T19:04:20.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.295+0000 7f1cebbff700 1 -- 172.21.15.72:0/1484071897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce40bba70 msgr2=0x7f1ce40c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:20.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.295+0000 7f1cebbff700 1 --2- 172.21.15.72:0/1484071897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce40bba70 0x7f1ce40c2b40 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f1ce406ab00 tx=0x7f1cdc009780).stop 2023-08-31T19:04:20.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.295+0000 7f1cebbff700 1 -- 172.21.15.72:0/1484071897 shutdown_connections 2023-08-31T19:04:20.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.295+0000 7f1cebbff700 1 --2- 172.21.15.72:0/1484071897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce40bba70 0x7f1ce40c2b40 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:20.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.295+0000 7f1cebbff700 1 --2- 172.21.15.72:0/1484071897 >> v2:172.21.15.146:3300/0 conn(0x7f1ce4156310 0x7f1ce40c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:20.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.295+0000 7f1cebbff700 1 -- 172.21.15.72:0/1484071897 >> 172.21.15.72:0/1484071897 conn(0x7f1ce40c6b10 msgr2=0x7f1ce40c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:20.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.295+0000 7f1cebbff700 1 -- 172.21.15.72:0/1484071897 shutdown_connections 2023-08-31T19:04:20.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.295+0000 7f1cebbff700 1 -- 172.21.15.72:0/1484071897 wait complete. 2023-08-31T19:04:20.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.297+0000 7f1cebbff700 1 Processor -- start 2023-08-31T19:04:20.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.297+0000 7f1cebbff700 1 -- start start 2023-08-31T19:04:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.298+0000 7f1cebbff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce40bba70 0x7f1ce40ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.298+0000 7f1cebbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce4135030 0x7f1ce4134320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.298+0000 7f1cebbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce4156310 0x7f1ce4064d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.298+0000 7f1cebbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40aab90 con 0x7f1ce4156310 2023-08-31T19:04:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.298+0000 7f1cebbff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40ac110 con 0x7f1ce40bba70 2023-08-31T19:04:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.298+0000 7f1cebbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40ab7e0 con 0x7f1ce4135030 2023-08-31T19:04:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.298+0000 7f1cea19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce4156310 0x7f1ce4064d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.298+0000 7f1cea19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce4156310 0x7f1ce4064d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57064/0 (socket says 172.21.15.72:57064) 2023-08-31T19:04:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.298+0000 7f1cea19c700 1 -- 172.21.15.72:0/724187204 learned_addr learned my addr 172.21.15.72:0/724187204 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.298+0000 7f1ce999b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce40bba70 0x7f1ce40ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.298+0000 7f1ce919a700 1 --2- 172.21.15.72:0/724187204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce4135030 0x7f1ce4134320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.299+0000 7f1cea19c700 1 -- 172.21.15.72:0/724187204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce4135030 msgr2=0x7f1ce4134320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.299+0000 7f1cea19c700 1 --2- 172.21.15.72:0/724187204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce4135030 0x7f1ce4134320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.299+0000 7f1cea19c700 1 -- 172.21.15.72:0/724187204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce40bba70 msgr2=0x7f1ce40ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.299+0000 7f1cea19c700 1 --2- 172.21.15.72:0/724187204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce40bba70 0x7f1ce40ac5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.299+0000 7f1cea19c700 1 -- 172.21.15.72:0/724187204 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc009a20 con 0x7f1ce4156310 2023-08-31T19:04:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.299+0000 7f1cea19c700 1 --2- 172.21.15.72:0/724187204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce4156310 0x7f1ce4064d60 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f1ce40c4680 tx=0x7f1cdc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.299+0000 7f1cd9ffb700 1 -- 172.21.15.72:0/724187204 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc009440 con 0x7f1ce4156310 2023-08-31T19:04:20.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.299+0000 7f1cd9ffb700 1 -- 172.21.15.72:0/724187204 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc00b6f0 con 0x7f1ce4156310 2023-08-31T19:04:20.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.299+0000 7f1cd9ffb700 1 -- 172.21.15.72:0/724187204 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc01d860 con 0x7f1ce4156310 2023-08-31T19:04:20.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.299+0000 7f1cebbff700 1 -- 172.21.15.72:0/724187204 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce40abac0 con 0x7f1ce4156310 2023-08-31T19:04:20.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.299+0000 7f1cebbff700 1 -- 172.21.15.72:0/724187204 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce4134810 con 0x7f1ce4156310 2023-08-31T19:04:20.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.301+0000 7f1cebbff700 1 -- 172.21.15.72:0/724187204 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce40ac3f0 con 0x7f1ce4156310 2023-08-31T19:04:20.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.301+0000 7f1cd9ffb700 1 -- 172.21.15.72:0/724187204 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 36) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f1cdc01dc50 con 0x7f1ce4156310 2023-08-31T19:04:20.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.302+0000 7f1cd9ffb700 1 --2- 172.21.15.72:0/724187204 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1cc805efc0 0x7f1cc8061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:20.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.303+0000 7f1cd9ffb700 1 -- 172.21.15.72:0/724187204 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f1cdc07c250 con 0x7f1ce4156310 2023-08-31T19:04:20.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.303+0000 7f1ce999b700 1 -- 172.21.15.72:0/724187204 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1cc805efc0 msgr2=0x7f1cc8061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:20.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.303+0000 7f1ce999b700 1 --2- 172.21.15.72:0/724187204 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1cc805efc0 0x7f1cc8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:20.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.307+0000 7f1cd9ffb700 1 -- 172.21.15.72:0/724187204 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1cdc04d050 con 0x7f1ce4156310 2023-08-31T19:04:20.368 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:20.368+0000 7fd303f74680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:04:20.378 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:20.378+0000 7f8dd4fe8680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:04:20.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.504+0000 7f1ce999b700 1 -- 172.21.15.72:0/724187204 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1cc805efc0 msgr2=0x7f1cc8061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:20.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.504+0000 7f1ce999b700 1 --2- 172.21.15.72:0/724187204 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1cc805efc0 0x7f1cc8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:04:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.526+0000 7f1cebbff700 1 -- 172.21.15.72:0/724187204 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ce406c6b0 con 0x7f1ce4156310 2023-08-31T19:04:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.526+0000 7f1cd9ffb700 1 -- 172.21.15.72:0/724187204 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f1cdc050670 con 0x7f1ce4156310 2023-08-31T19:04:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:20.527 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5732,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1777836817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1777836817},{"type":"v1","addr":"172.21.15.146:6834","nonce":1777836817}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5735,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1865290147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1865290147},{"type":"v1","addr":"172.21.15.146:6835","nonce":1865290147}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2552241481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2552241481},{"type":"v1","addr":"172.21.15.72:6836","nonce":2552241481}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:04:03.992354+0000","modified":"2023-08-31T19:04:07.010012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6699":{"gid":6699,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/859098343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":859098343},{"type":"v1","addr":"172.21.15.72:6837","nonce":859098343}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-31T19:04:20.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.528+0000 7f1cebbff700 1 -- 172.21.15.72:0/724187204 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1cc805efc0 msgr2=0x7f1cc8061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:20.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.528+0000 7f1cebbff700 1 --2- 172.21.15.72:0/724187204 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1cc805efc0 0x7f1cc8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.528+0000 7f1cebbff700 1 -- 172.21.15.72:0/724187204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce4156310 msgr2=0x7f1ce4064d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.528+0000 7f1cebbff700 1 --2- 172.21.15.72:0/724187204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce4156310 0x7f1ce4064d60 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f1ce40c4680 tx=0x7f1cdc009780).stop 2023-08-31T19:04:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.528+0000 7f1cebbff700 1 -- 172.21.15.72:0/724187204 shutdown_connections 2023-08-31T19:04:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.528+0000 7f1cebbff700 1 --2- 172.21.15.72:0/724187204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce4156310 0x7f1ce4064d60 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.528+0000 7f1cebbff700 1 --2- 172.21.15.72:0/724187204 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1cc805efc0 0x7f1cc8061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.528+0000 7f1cebbff700 1 --2- 172.21.15.72:0/724187204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ce40bba70 0x7f1ce40ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.528+0000 7f1cebbff700 1 --2- 172.21.15.72:0/724187204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1ce4135030 0x7f1ce4134320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.528+0000 7f1cebbff700 1 -- 172.21.15.72:0/724187204 >> 172.21.15.72:0/724187204 conn(0x7f1ce40c6b10 msgr2=0x7f1ce40a5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.529+0000 7f1cebbff700 1 -- 172.21.15.72:0/724187204 shutdown_connections 2023-08-31T19:04:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.529+0000 7f1cebbff700 1 -- 172.21.15.72:0/724187204 wait complete. 2023-08-31T19:04:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 40 2023-08-31T19:04:20.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:04:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.741+0000 7f59abdff700 1 Processor -- start 2023-08-31T19:04:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.741+0000 7f59abdff700 1 -- start start 2023-08-31T19:04:20.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.743+0000 7f59abdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59a40cb9b0 0x7f59a41583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:20.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.743+0000 7f59abdff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a40c6120 con 0x7f59a41588d0 2023-08-31T19:04:20.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.743+0000 7f59abdff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a40c5e10 con 0x7f59a4154060 2023-08-31T19:04:20.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.743+0000 7f59abdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a40c1380 con 0x7f59a40cb9b0 2023-08-31T19:04:20.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.744+0000 7f59a939a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59a40cb9b0 0x7f59a41583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:20.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.744+0000 7f59a939a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59a40cb9b0 0x7f59a41583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57070/0 (socket says 172.21.15.72:57070) 2023-08-31T19:04:20.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.744+0000 7f59a939a700 1 -- 172.21.15.72:0/1401486537 learned_addr learned my addr 172.21.15.72:0/1401486537 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:20.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.744+0000 7f59aa39c700 1 --1- 172.21.15.72:0/1401486537 >> v1:172.21.15.72:6789/0 conn(0x7f59a41588d0 0x7f59a4154440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44854/0 (socket says 172.21.15.72:44854) 2023-08-31T19:04:20.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.744+0000 7f59a8b99700 1 -- 172.21.15.72:0/1401486537 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115377811 0 0) 0x7f59a40c5e10 con 0x7f59a4154060 2023-08-31T19:04:20.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.744+0000 7f59a939a700 1 -- 172.21.15.72:0/1401486537 >> v1:172.21.15.146:6789/0 conn(0x7f59a4154060 legacy=0x7f59a4157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:20.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.744+0000 7f59a939a700 1 -- 172.21.15.72:0/1401486537 >> v1:172.21.15.72:6789/0 conn(0x7f59a41588d0 legacy=0x7f59a4154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:20.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.744+0000 7f59a939a700 1 -- 172.21.15.72:0/1401486537 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a40c0ae0 con 0x7f59a40cb9b0 2023-08-31T19:04:20.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.744+0000 7f59a939a700 1 --2- 172.21.15.72:0/1401486537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59a40cb9b0 0x7f59a41583e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f5994006fd0 tx=0x7f59940090f0).ready entity=mon.0 client_cookie=5b700ef8460ee1b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:20.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.745+0000 7f59a8b99700 1 -- 172.21.15.72:0/1401486537 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599400f510 con 0x7f59a40cb9b0 2023-08-31T19:04:20.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.745+0000 7f59a8b99700 1 -- 172.21.15.72:0/1401486537 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599400f670 con 0x7f59a40cb9b0 2023-08-31T19:04:20.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.745+0000 7f59a8b99700 1 -- 172.21.15.72:0/1401486537 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599400f9f0 con 0x7f59a40cb9b0 2023-08-31T19:04:20.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.745+0000 7f59abdff700 1 -- 172.21.15.72:0/1401486537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59a40cb9b0 msgr2=0x7f59a41583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:20.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.745+0000 7f59abdff700 1 --2- 172.21.15.72:0/1401486537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59a40cb9b0 0x7f59a41583e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f5994006fd0 tx=0x7f59940090f0).stop 2023-08-31T19:04:20.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.746+0000 7f59abdff700 1 -- 172.21.15.72:0/1401486537 shutdown_connections 2023-08-31T19:04:20.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.746+0000 7f59abdff700 1 --2- 172.21.15.72:0/1401486537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59a40cb9b0 0x7f59a41583e0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:20.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.746+0000 7f59abdff700 1 -- 172.21.15.72:0/1401486537 >> 172.21.15.72:0/1401486537 conn(0x7f59a405e870 msgr2=0x7f59a40cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:20.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.746+0000 7f59abdff700 1 -- 172.21.15.72:0/1401486537 shutdown_connections 2023-08-31T19:04:20.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.746+0000 7f59abdff700 1 -- 172.21.15.72:0/1401486537 wait complete. 2023-08-31T19:04:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.747+0000 7f59abdff700 1 Processor -- start 2023-08-31T19:04:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.747+0000 7f59abdff700 1 -- start start 2023-08-31T19:04:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.748+0000 7f59abdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59a40cb9b0 0x7f59a40b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.748+0000 7f59abdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a4154060 0x7f59a4155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.748+0000 7f59abdff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a41588d0 0x7f59a4064060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:20.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.748+0000 7f59abdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a40add20 con 0x7f59a40cb9b0 2023-08-31T19:04:20.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.748+0000 7f59abdff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a40c3630 con 0x7f59a41588d0 2023-08-31T19:04:20.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.748+0000 7f59abdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a40b0ce0 con 0x7f59a4154060 2023-08-31T19:04:20.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.748+0000 7f59a9b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59a40cb9b0 0x7f59a40b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:20.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.748+0000 7f59a9b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59a40cb9b0 0x7f59a40b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57072/0 (socket says 172.21.15.72:57072) 2023-08-31T19:04:20.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.748+0000 7f59a9b9b700 1 -- 172.21.15.72:0/64913742 learned_addr learned my addr 172.21.15.72:0/64913742 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:20.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.749+0000 7f59a939a700 1 --2- 172.21.15.72:0/64913742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a4154060 0x7f59a4155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:20.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.749+0000 7f59aa39c700 1 --2- 172.21.15.72:0/64913742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a41588d0 0x7f59a4064060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:20.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.749+0000 7f59a9b9b700 1 -- 172.21.15.72:0/64913742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a4154060 msgr2=0x7f59a4155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:20.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.749+0000 7f59a9b9b700 1 --2- 172.21.15.72:0/64913742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a4154060 0x7f59a4155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:20.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.749+0000 7f59a9b9b700 1 -- 172.21.15.72:0/64913742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a41588d0 msgr2=0x7f59a4064060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:20.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.749+0000 7f59a9b9b700 1 --2- 172.21.15.72:0/64913742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a41588d0 0x7f59a4064060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:20.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.749+0000 7f59a9b9b700 1 -- 172.21.15.72:0/64913742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5994009370 con 0x7f59a40cb9b0 2023-08-31T19:04:20.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.749+0000 7f59a9b9b700 1 --2- 172.21.15.72:0/64913742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59a40cb9b0 0x7f59a40b07f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f59a000c440 tx=0x7f59a0007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:20.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.749+0000 7f5999ffb700 1 -- 172.21.15.72:0/64913742 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a0012400 con 0x7f59a40cb9b0 2023-08-31T19:04:20.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.749+0000 7f5999ffb700 1 -- 172.21.15.72:0/64913742 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a0012580 con 0x7f59a40cb9b0 2023-08-31T19:04:20.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.749+0000 7f5999ffb700 1 -- 172.21.15.72:0/64913742 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a0012940 con 0x7f59a40cb9b0 2023-08-31T19:04:20.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.749+0000 7f59abdff700 1 -- 172.21.15.72:0/64913742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a4156210 con 0x7f59a40cb9b0 2023-08-31T19:04:20.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.750+0000 7f59abdff700 1 -- 172.21.15.72:0/64913742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a41567d0 con 0x7f59a40cb9b0 2023-08-31T19:04:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.751+0000 7f59abdff700 1 -- 172.21.15.72:0/64913742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a406c6b0 con 0x7f59a40cb9b0 2023-08-31T19:04:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.751+0000 7f5999ffb700 1 -- 172.21.15.72:0/64913742 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 36) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f59a001b3b0 con 0x7f59a40cb9b0 2023-08-31T19:04:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.753+0000 7f5999ffb700 1 --2- 172.21.15.72:0/64913742 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f598805efc0 0x7f5988061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.753+0000 7f59a939a700 1 -- 172.21.15.72:0/64913742 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f598805efc0 msgr2=0x7f5988061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.753+0000 7f5999ffb700 1 -- 172.21.15.72:0/64913742 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f59a0079680 con 0x7f59a40cb9b0 2023-08-31T19:04:20.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.753+0000 7f59a939a700 1 --2- 172.21.15.72:0/64913742 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f598805efc0 0x7f5988061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:20.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.756+0000 7f5999ffb700 1 -- 172.21.15.72:0/64913742 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f59a00488f0 con 0x7f59a40cb9b0 2023-08-31T19:04:20.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.946+0000 7f59abdff700 1 -- 172.21.15.72:0/64913742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59a40c0dc0 con 0x7f59a40cb9b0 2023-08-31T19:04:20.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.947+0000 7f5999ffb700 1 -- 172.21.15.72:0/64913742 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f59a004a5e0 con 0x7f59a40cb9b0 2023-08-31T19:04:20.948 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:20.948 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":95,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:04:17.694700+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:04:02.410352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-31T19:04:02.966343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/2262253272":"2023-09-01T19:04:17.694660+0000","172.21.15.72:6833/143463":"2023-09-01T19:04:17.694660+0000","172.21.15.72:6832/143463":"2023-09-01T19:04:17.694660+0000","172.21.15.72:0/404249945":"2023-09-01T19:04:17.694660+0000","172.21.15.72:0/3249564216":"2023-09-01T19:04:17.694660+0000","172.21.15.72:0/4257999405":"2023-09-01T19:04:17.694660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:04:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.949+0000 7f59abdff700 1 -- 172.21.15.72:0/64913742 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f598805efc0 msgr2=0x7f5988061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.949+0000 7f59abdff700 1 --2- 172.21.15.72:0/64913742 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f598805efc0 0x7f5988061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.949+0000 7f59abdff700 1 -- 172.21.15.72:0/64913742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59a40cb9b0 msgr2=0x7f59a40b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.949+0000 7f59abdff700 1 --2- 172.21.15.72:0/64913742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59a40cb9b0 0x7f59a40b07f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f59a000c440 tx=0x7f59a0007bb0).stop 2023-08-31T19:04:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.949+0000 7f59abdff700 1 -- 172.21.15.72:0/64913742 shutdown_connections 2023-08-31T19:04:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.949+0000 7f59abdff700 1 --2- 172.21.15.72:0/64913742 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f598805efc0 0x7f5988061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.949+0000 7f59abdff700 1 --2- 172.21.15.72:0/64913742 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a41588d0 0x7f59a4064060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.949+0000 7f59abdff700 1 --2- 172.21.15.72:0/64913742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59a40cb9b0 0x7f59a40b07f0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.949+0000 7f59abdff700 1 --2- 172.21.15.72:0/64913742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59a4154060 0x7f59a4155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.949+0000 7f59abdff700 1 -- 172.21.15.72:0/64913742 >> 172.21.15.72:0/64913742 conn(0x7f59a405e870 msgr2=0x7f59a4063090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:20.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.949+0000 7f59abdff700 1 -- 172.21.15.72:0/64913742 shutdown_connections 2023-08-31T19:04:20.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:20.949+0000 7f59abdff700 1 -- 172.21.15.72:0/64913742 wait complete. 2023-08-31T19:04:20.967 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:04:02.410352+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:04:02.966343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:04:20.968 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:04:21.124 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:21.124+0000 7fd303f74680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:04:21.189 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:21.189+0000 7f8dd4fe8680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:04:21.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.198+0000 7f7522fff700 1 Processor -- start 2023-08-31T19:04:21.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.198+0000 7f7522fff700 1 -- start start 2023-08-31T19:04:21.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.200+0000 7f7522fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f751c065ae0 0x7f751c0ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:21.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.200+0000 7f7522fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f751c062c30 0x7f751c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:21.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.200+0000 7f7522fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751c063590 con 0x7f751c1523f0 2023-08-31T19:04:21.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.200+0000 7f7522fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751c0c2940 con 0x7f751c062c30 2023-08-31T19:04:21.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.200+0000 7f7522fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751c069d80 con 0x7f751c065ae0 2023-08-31T19:04:21.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.200+0000 7f7520d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f751c1523f0 0x7f751c0c36c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44870/0 (socket says 172.21.15.72:44870) 2023-08-31T19:04:21.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.200+0000 7f7520d9b700 1 -- 172.21.15.72:0/2136887315 learned_addr learned my addr 172.21.15.72:0/2136887315 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:21.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.200+0000 7f752159c700 1 --2- 172.21.15.72:0/2136887315 >> v2:172.21.15.72:3300/0 conn(0x7f751c062c30 0x7f751c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:21.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.200+0000 7f751bfff700 1 --2- 172.21.15.72:0/2136887315 >> v2:172.21.15.146:3300/0 conn(0x7f751c065ae0 0x7f751c0ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:21.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.200+0000 7f751b7fe700 1 -- 172.21.15.72:0/2136887315 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989771689 0 0) 0x7f751c063590 con 0x7f751c1523f0 2023-08-31T19:04:21.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.200+0000 7f751b7fe700 1 -- 172.21.15.72:0/2136887315 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f750c0033f0 con 0x7f751c1523f0 2023-08-31T19:04:21.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.201+0000 7f752159c700 1 -- 172.21.15.72:0/2136887315 >> v2:172.21.15.146:3300/0 conn(0x7f751c065ae0 msgr2=0x7f751c0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:21.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.201+0000 7f752159c700 1 --2- 172.21.15.72:0/2136887315 >> v2:172.21.15.146:3300/0 conn(0x7f751c065ae0 0x7f751c0ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.201+0000 7f752159c700 1 -- 172.21.15.72:0/2136887315 >> v1:172.21.15.72:6789/0 conn(0x7f751c1523f0 legacy=0x7f751c0c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:21.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.201+0000 7f752159c700 1 -- 172.21.15.72:0/2136887315 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c0c4530 con 0x7f751c062c30 2023-08-31T19:04:21.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.201+0000 7f752159c700 1 --2- 172.21.15.72:0/2136887315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c062c30 0x7f751c0630a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f751c05e960 tx=0x7f7514009780).ready entity=mon.0 client_cookie=5d5f5a0fc8a79f00 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:21.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.201+0000 7f751b7fe700 1 -- 172.21.15.72:0/2136887315 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751400e070 con 0x7f751c062c30 2023-08-31T19:04:21.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.201+0000 7f751b7fe700 1 -- 172.21.15.72:0/2136887315 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751400bab0 con 0x7f751c062c30 2023-08-31T19:04:21.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.201+0000 7f751b7fe700 1 -- 172.21.15.72:0/2136887315 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751400be30 con 0x7f751c062c30 2023-08-31T19:04:21.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.202+0000 7f7522fff700 1 -- 172.21.15.72:0/2136887315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c062c30 msgr2=0x7f751c0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:21.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.202+0000 7f7522fff700 1 --2- 172.21.15.72:0/2136887315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c062c30 0x7f751c0630a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f751c05e960 tx=0x7f7514009780).stop 2023-08-31T19:04:21.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.202+0000 7f7522fff700 1 -- 172.21.15.72:0/2136887315 shutdown_connections 2023-08-31T19:04:21.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.202+0000 7f7522fff700 1 --2- 172.21.15.72:0/2136887315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c062c30 0x7f751c0630a0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.202+0000 7f7522fff700 1 --2- 172.21.15.72:0/2136887315 >> v2:172.21.15.146:3300/0 conn(0x7f751c065ae0 0x7f751c0ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.202+0000 7f7522fff700 1 -- 172.21.15.72:0/2136887315 >> 172.21.15.72:0/2136887315 conn(0x7f751c0c7e00 msgr2=0x7f751c0c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:21.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.202+0000 7f7522fff700 1 -- 172.21.15.72:0/2136887315 shutdown_connections 2023-08-31T19:04:21.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.202+0000 7f7522fff700 1 -- 172.21.15.72:0/2136887315 wait complete. 2023-08-31T19:04:21.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.203+0000 7f7522fff700 1 Processor -- start 2023-08-31T19:04:21.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.204+0000 7f7522fff700 1 -- start start 2023-08-31T19:04:21.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.204+0000 7f7522fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f751c062c30 0x7f751c14e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:21.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.204+0000 7f7522fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c065ae0 0x7f751c0a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:21.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.205+0000 7f7522fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c1523f0 0x7f751c0ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:21.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.205+0000 7f7522fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c1659e0 con 0x7f751c1523f0 2023-08-31T19:04:21.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.205+0000 7f7522fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c165cc0 con 0x7f751c065ae0 2023-08-31T19:04:21.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.205+0000 7f7522fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c165fa0 con 0x7f751c062c30 2023-08-31T19:04:21.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.205+0000 7f752159c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c1523f0 0x7f751c0ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:21.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.205+0000 7f751bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c065ae0 0x7f751c0a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:21.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.205+0000 7f752159c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c1523f0 0x7f751c0ab480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57092/0 (socket says 172.21.15.72:57092) 2023-08-31T19:04:21.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.205+0000 7f752159c700 1 -- 172.21.15.72:0/1886002806 learned_addr learned my addr 172.21.15.72:0/1886002806 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:21.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.205+0000 7f7520d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f751c062c30 0x7f751c14e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:21.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.205+0000 7f752159c700 1 -- 172.21.15.72:0/1886002806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f751c062c30 msgr2=0x7f751c14e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:21.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.205+0000 7f752159c700 1 --2- 172.21.15.72:0/1886002806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f751c062c30 0x7f751c14e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.205+0000 7f752159c700 1 -- 172.21.15.72:0/1886002806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c065ae0 msgr2=0x7f751c0a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:21.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.205+0000 7f752159c700 1 --2- 172.21.15.72:0/1886002806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c065ae0 0x7f751c0a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.205+0000 7f752159c700 1 -- 172.21.15.72:0/1886002806 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7514009a20 con 0x7f751c1523f0 2023-08-31T19:04:21.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.205+0000 7f751bfff700 1 --2- 172.21.15.72:0/1886002806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c065ae0 0x7f751c0a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:04:21.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.206+0000 7f752159c700 1 --2- 172.21.15.72:0/1886002806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c1523f0 0x7f751c0ab480 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f751400b610 tx=0x7f7514009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:21.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.206+0000 7f7518ff9700 1 -- 172.21.15.72:0/1886002806 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514009440 con 0x7f751c1523f0 2023-08-31T19:04:21.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.206+0000 7f7518ff9700 1 -- 172.21.15.72:0/1886002806 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751401d630 con 0x7f751c1523f0 2023-08-31T19:04:21.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.206+0000 7f7518ff9700 1 -- 172.21.15.72:0/1886002806 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751401d9d0 con 0x7f751c1523f0 2023-08-31T19:04:21.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.206+0000 7f7522fff700 1 -- 172.21.15.72:0/1886002806 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751c166280 con 0x7f751c1523f0 2023-08-31T19:04:21.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.206+0000 7f7522fff700 1 -- 172.21.15.72:0/1886002806 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751c14e830 con 0x7f751c1523f0 2023-08-31T19:04:21.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.207+0000 7f7522fff700 1 -- 172.21.15.72:0/1886002806 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751c1667a0 con 0x7f751c1523f0 2023-08-31T19:04:21.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.209+0000 7f7518ff9700 1 -- 172.21.15.72:0/1886002806 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 36) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f7514026410 con 0x7f751c1523f0 2023-08-31T19:04:21.215 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:21.208+0000 7fd303f74680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:04:21.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.210+0000 7f7518ff9700 1 --2- 172.21.15.72:0/1886002806 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f750005eff0 0x7f75000614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:21.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.210+0000 7f7518ff9700 1 -- 172.21.15.72:0/1886002806 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f751407c0b0 con 0x7f751c1523f0 2023-08-31T19:04:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.210+0000 7f7520d9b700 1 -- 172.21.15.72:0/1886002806 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f750005eff0 msgr2=0x7f75000614b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.210+0000 7f7520d9b700 1 --2- 172.21.15.72:0/1886002806 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f750005eff0 0x7f75000614b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.214+0000 7f7518ff9700 1 -- 172.21.15.72:0/1886002806 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f751404ce50 con 0x7f751c1523f0 2023-08-31T19:04:21.277 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:21.277+0000 7f8dd4fe8680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:04:21.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.389+0000 7f7522fff700 1 -- 172.21.15.72:0/1886002806 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f751c06c6b0 con 0x7f751c1523f0 2023-08-31T19:04:21.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.390+0000 7f7518ff9700 1 -- 172.21.15.72:0/1886002806 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v95) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7514050470 con 0x7f751c1523f0 2023-08-31T19:04:21.391 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:04:21.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.392+0000 7f7522fff700 1 -- 172.21.15.72:0/1886002806 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f750005eff0 msgr2=0x7f75000614b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:21.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.392+0000 7f7522fff700 1 --2- 172.21.15.72:0/1886002806 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f750005eff0 0x7f75000614b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:21.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.392+0000 7f7522fff700 1 -- 172.21.15.72:0/1886002806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c1523f0 msgr2=0x7f751c0ab480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:21.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.392+0000 7f7522fff700 1 --2- 172.21.15.72:0/1886002806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c1523f0 0x7f751c0ab480 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f751400b610 tx=0x7f7514009780).stop 2023-08-31T19:04:21.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.392+0000 7f7522fff700 1 -- 172.21.15.72:0/1886002806 shutdown_connections 2023-08-31T19:04:21.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.392+0000 7f7522fff700 1 --2- 172.21.15.72:0/1886002806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c1523f0 0x7f751c0ab480 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.392+0000 7f7522fff700 1 --2- 172.21.15.72:0/1886002806 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f751c062c30 0x7f751c14e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.392+0000 7f7522fff700 1 --2- 172.21.15.72:0/1886002806 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f750005eff0 0x7f75000614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:21.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.392+0000 7f7522fff700 1 --2- 172.21.15.72:0/1886002806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f751c065ae0 0x7f751c0a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.392+0000 7f7522fff700 1 -- 172.21.15.72:0/1886002806 >> 172.21.15.72:0/1886002806 conn(0x7f751c0c7e00 msgr2=0x7f751c063010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:21.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.392+0000 7f7522fff700 1 -- 172.21.15.72:0/1886002806 shutdown_connections 2023-08-31T19:04:21.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.392+0000 7f7522fff700 1 -- 172.21.15.72:0/1886002806 wait complete. 2023-08-31T19:04:21.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:04:21.439 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:21.439+0000 7fd303f74680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:04:21.517 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:21.516+0000 7f8dd4fe8680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:04:21.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.606+0000 7f671b9ff700 1 Processor -- start 2023-08-31T19:04:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.606+0000 7f671b9ff700 1 -- start start 2023-08-31T19:04:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.608+0000 7f671b9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67141520e0 0x7f67140a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.608+0000 7f671b9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f67140a9440 0x7f6714068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.608+0000 7f671b9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6714064340 con 0x7f67141524c0 2023-08-31T19:04:21.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.608+0000 7f671b9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67140bcd00 con 0x7f67140a9440 2023-08-31T19:04:21.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.608+0000 7f671b9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67140bcfe0 con 0x7f67141520e0 2023-08-31T19:04:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.608+0000 7f671979b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67141520e0 0x7f67140a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.608+0000 7f6718f9a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f67140a9440 0x7f6714068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.608+0000 7f671979b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67141520e0 0x7f67140a8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:44992/0 (socket says 172.21.15.72:44992) 2023-08-31T19:04:21.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.608+0000 7f6718f9a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f67140a9440 0x7f6714068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:40286/0 (socket says 172.21.15.72:40286) 2023-08-31T19:04:21.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.608+0000 7f671979b700 1 -- 172.21.15.72:0/1849562389 learned_addr learned my addr 172.21.15.72:0/1849562389 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:21.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.608+0000 7f6719f9c700 1 --1- 172.21.15.72:0/1849562389 >> v1:172.21.15.146:6789/0 conn(0x7f67141524c0 0x7f6714155e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:51808/0 (socket says 172.21.15.72:51808) 2023-08-31T19:04:21.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.609+0000 7f671979b700 1 -- 172.21.15.72:0/1849562389 >> v2:172.21.15.146:3300/0 conn(0x7f67140a9440 msgr2=0x7f6714068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:21.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.609+0000 7f671979b700 1 --2- 172.21.15.72:0/1849562389 >> v2:172.21.15.146:3300/0 conn(0x7f67140a9440 0x7f6714068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.609+0000 7f671979b700 1 -- 172.21.15.72:0/1849562389 >> v1:172.21.15.146:6789/0 conn(0x7f67141524c0 legacy=0x7f6714155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:21.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.609+0000 7f671979b700 1 -- 172.21.15.72:0/1849562389 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67140bd2c0 con 0x7f67141520e0 2023-08-31T19:04:21.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.609+0000 7f6718f9a700 1 --2- 172.21.15.72:0/1849562389 >> v2:172.21.15.146:3300/0 conn(0x7f67140a9440 0x7f6714068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:04:21.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.609+0000 7f671979b700 1 --2- 172.21.15.72:0/1849562389 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67141520e0 0x7f67140a8f50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6710006fd0 tx=0x7f67100090f0).ready entity=mon.2 client_cookie=cd325ab414fb33c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:21.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.609+0000 7f670bfff700 1 -- 172.21.15.72:0/1849562389 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671000b580 con 0x7f67141520e0 2023-08-31T19:04:21.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.609+0000 7f670bfff700 1 -- 172.21.15.72:0/1849562389 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671000b6e0 con 0x7f67141520e0 2023-08-31T19:04:21.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.609+0000 7f670bfff700 1 -- 172.21.15.72:0/1849562389 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671000ba60 con 0x7f67141520e0 2023-08-31T19:04:21.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.610+0000 7f671b9ff700 1 -- 172.21.15.72:0/1849562389 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67141520e0 msgr2=0x7f67140a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:21.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.610+0000 7f671b9ff700 1 --2- 172.21.15.72:0/1849562389 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67141520e0 0x7f67140a8f50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6710006fd0 tx=0x7f67100090f0).stop 2023-08-31T19:04:21.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.610+0000 7f671b9ff700 1 -- 172.21.15.72:0/1849562389 shutdown_connections 2023-08-31T19:04:21.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.610+0000 7f671b9ff700 1 --2- 172.21.15.72:0/1849562389 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67141520e0 0x7f67140a8f50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.610+0000 7f671b9ff700 1 --2- 172.21.15.72:0/1849562389 >> v2:172.21.15.146:3300/0 conn(0x7f67140a9440 0x7f6714068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.610+0000 7f671b9ff700 1 -- 172.21.15.72:0/1849562389 >> 172.21.15.72:0/1849562389 conn(0x7f67140630c0 msgr2=0x7f67140c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:21.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.610+0000 7f671b9ff700 1 -- 172.21.15.72:0/1849562389 shutdown_connections 2023-08-31T19:04:21.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.610+0000 7f671b9ff700 1 -- 172.21.15.72:0/1849562389 wait complete. 2023-08-31T19:04:21.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.611+0000 7f671b9ff700 1 Processor -- start 2023-08-31T19:04:21.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.611+0000 7f671b9ff700 1 -- start start 2023-08-31T19:04:21.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.612+0000 7f671b9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67140a9440 0x7f6714159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:21.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.612+0000 7f671b9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67141520e0 0x7f671414af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:21.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.612+0000 7f671b9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67141524c0 0x7f671415a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:21.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.612+0000 7f671b9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67140aaba0 con 0x7f67141524c0 2023-08-31T19:04:21.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.612+0000 7f671b9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67140a9f90 con 0x7f67140a9440 2023-08-31T19:04:21.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.612+0000 7f671b9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67140aa270 con 0x7f67141520e0 2023-08-31T19:04:21.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.613+0000 7f671979b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67140a9440 0x7f6714159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:21.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.613+0000 7f6719f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67141524c0 0x7f671415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:21.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.613+0000 7f6718f9a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67141520e0 0x7f671414af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:21.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.613+0000 7f671979b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67140a9440 0x7f6714159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:40296/0 (socket says 172.21.15.72:40296) 2023-08-31T19:04:21.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.613+0000 7f671979b700 1 -- 172.21.15.72:0/2800548811 learned_addr learned my addr 172.21.15.72:0/2800548811 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:21.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.613+0000 7f671979b700 1 -- 172.21.15.72:0/2800548811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67141520e0 msgr2=0x7f671414af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:21.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.613+0000 7f671979b700 1 --2- 172.21.15.72:0/2800548811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67141520e0 0x7f671414af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.613+0000 7f671979b700 1 -- 172.21.15.72:0/2800548811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67141524c0 msgr2=0x7f671415a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:21.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.613+0000 7f671979b700 1 --2- 172.21.15.72:0/2800548811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67141524c0 0x7f671415a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.613+0000 7f671979b700 1 -- 172.21.15.72:0/2800548811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67040092a0 con 0x7f67140a9440 2023-08-31T19:04:21.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.613+0000 7f6718f9a700 1 --2- 172.21.15.72:0/2800548811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67141520e0 0x7f671414af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:04:21.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.613+0000 7f671979b700 1 --2- 172.21.15.72:0/2800548811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67140a9440 0x7f6714159ac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f6710009fd0 tx=0x7f6710017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:21.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.614+0000 7f67097fa700 1 -- 172.21.15.72:0/2800548811 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710006a40 con 0x7f67140a9440 2023-08-31T19:04:21.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.614+0000 7f67097fa700 1 -- 172.21.15.72:0/2800548811 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6710000bc0 con 0x7f67140a9440 2023-08-31T19:04:21.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.614+0000 7f67097fa700 1 -- 172.21.15.72:0/2800548811 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671001c420 con 0x7f67140a9440 2023-08-31T19:04:21.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.614+0000 7f671b9ff700 1 -- 172.21.15.72:0/2800548811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6710009370 con 0x7f67140a9440 2023-08-31T19:04:21.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.614+0000 7f671b9ff700 1 -- 172.21.15.72:0/2800548811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67140aa830 con 0x7f67140a9440 2023-08-31T19:04:21.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.615+0000 7f671b9ff700 1 -- 172.21.15.72:0/2800548811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671406c6b0 con 0x7f67140a9440 2023-08-31T19:04:21.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.616+0000 7f67097fa700 1 -- 172.21.15.72:0/2800548811 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 36) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f671001ca20 con 0x7f67140a9440 2023-08-31T19:04:21.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.616+0000 7f67097fa700 1 --2- 172.21.15.72:0/2800548811 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f66f805efc0 0x7f66f8061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:21.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.616+0000 7f67097fa700 1 -- 172.21.15.72:0/2800548811 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f671007c330 con 0x7f67140a9440 2023-08-31T19:04:21.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.616+0000 7f6718f9a700 1 -- 172.21.15.72:0/2800548811 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f66f805efc0 msgr2=0x7f66f8061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:21.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.616+0000 7f6718f9a700 1 --2- 172.21.15.72:0/2800548811 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f66f805efc0 0x7f66f8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:21.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.625+0000 7f67097fa700 1 -- 172.21.15.72:0/2800548811 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f671004d140 con 0x7f67140a9440 2023-08-31T19:04:21.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.802+0000 7f671b9ff700 1 -- 172.21.15.72:0/2800548811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f67140bd5a0 con 0x7f67140a9440 2023-08-31T19:04:21.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.803+0000 7f67097fa700 1 -- 172.21.15.72:0/2800548811 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v95) v1 ==== 92+0+10 (secure 0 0 0) 0x7f671002a070 con 0x7f67140a9440 2023-08-31T19:04:21.803 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:04:21.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.805+0000 7f671b9ff700 1 -- 172.21.15.72:0/2800548811 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f66f805efc0 msgr2=0x7f66f8061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:21.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.805+0000 7f671b9ff700 1 --2- 172.21.15.72:0/2800548811 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f66f805efc0 0x7f66f8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:21.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.805+0000 7f671b9ff700 1 -- 172.21.15.72:0/2800548811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67140a9440 msgr2=0x7f6714159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:21.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.805+0000 7f671b9ff700 1 --2- 172.21.15.72:0/2800548811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67140a9440 0x7f6714159ac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f6710009fd0 tx=0x7f6710017000).stop 2023-08-31T19:04:21.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.805+0000 7f671b9ff700 1 -- 172.21.15.72:0/2800548811 shutdown_connections 2023-08-31T19:04:21.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.805+0000 7f671b9ff700 1 --2- 172.21.15.72:0/2800548811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67141524c0 0x7f671415a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.805+0000 7f671b9ff700 1 --2- 172.21.15.72:0/2800548811 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f66f805efc0 0x7f66f8061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.805+0000 7f671b9ff700 1 --2- 172.21.15.72:0/2800548811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67140a9440 0x7f6714159ac0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.805+0000 7f671b9ff700 1 --2- 172.21.15.72:0/2800548811 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f67141520e0 0x7f671414af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.805+0000 7f671b9ff700 1 -- 172.21.15.72:0/2800548811 >> 172.21.15.72:0/2800548811 conn(0x7f67140630c0 msgr2=0x7f67140a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:21.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.805+0000 7f671b9ff700 1 -- 172.21.15.72:0/2800548811 shutdown_connections 2023-08-31T19:04:21.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:21.805+0000 7f671b9ff700 1 -- 172.21.15.72:0/2800548811 wait complete. 2023-08-31T19:04:21.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:04:21.962 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:21.962+0000 7fd303f74680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:04:22.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.018+0000 7f29255ff700 1 Processor -- start 2023-08-31T19:04:22.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.018+0000 7f29255ff700 1 -- start start 2023-08-31T19:04:22.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.019+0000 7f29255ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f29200bdb30 0x7f29201542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.019+0000 7f29255ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f29200663d0 0x7f2920066840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.019+0000 7f29255ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29200a84b0 con 0x7f2920153ed0 2023-08-31T19:04:22.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.019+0000 7f29255ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29200c9410 con 0x7f29200bdb30 2023-08-31T19:04:22.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.019+0000 7f29255ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29200c5310 con 0x7f29200663d0 2023-08-31T19:04:22.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.020+0000 7f291e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f29200bdb30 0x7f29201542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:22.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.020+0000 7f291e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f29200bdb30 0x7f29201542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57106/0 (socket says 172.21.15.72:57106) 2023-08-31T19:04:22.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.020+0000 7f291e7fc700 1 -- 172.21.15.72:0/1492722503 learned_addr learned my addr 172.21.15.72:0/1492722503 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:22.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.020+0000 7f291effd700 1 --1- 172.21.15.72:0/1492722503 >> v1:172.21.15.72:6789/0 conn(0x7f2920153ed0 0x7f2920155200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44884/0 (socket says 172.21.15.72:44884) 2023-08-31T19:04:22.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.020+0000 7f291f7fe700 1 --2- 172.21.15.72:0/1492722503 >> v2:172.21.15.146:3300/0 conn(0x7f29200663d0 0x7f2920066840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.020+0000 7f291e7fc700 1 -- 172.21.15.72:0/1492722503 >> v2:172.21.15.146:3300/0 conn(0x7f29200663d0 msgr2=0x7f2920066840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.020+0000 7f291e7fc700 1 --2- 172.21.15.72:0/1492722503 >> v2:172.21.15.146:3300/0 conn(0x7f29200663d0 0x7f2920066840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.020+0000 7f291e7fc700 1 -- 172.21.15.72:0/1492722503 >> v1:172.21.15.72:6789/0 conn(0x7f2920153ed0 legacy=0x7f2920155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.020+0000 7f291e7fc700 1 -- 172.21.15.72:0/1492722503 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2920066d30 con 0x7f29200bdb30 2023-08-31T19:04:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.020+0000 7f291f7fe700 1 --2- 172.21.15.72:0/1492722503 >> v2:172.21.15.146:3300/0 conn(0x7f29200663d0 0x7f2920066840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.020+0000 7f291dffb700 1 -- 172.21.15.72:0/1492722503 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649146725 0 0) 0x7f29200a84b0 con 0x7f2920153ed0 2023-08-31T19:04:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.020+0000 7f291e7fc700 1 --2- 172.21.15.72:0/1492722503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29200bdb30 0x7f29201542b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f29200be880 tx=0x7f29140090f0).ready entity=mon.0 client_cookie=272cca083e5529cb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.021+0000 7f291dffb700 1 -- 172.21.15.72:0/1492722503 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291400b600 con 0x7f29200bdb30 2023-08-31T19:04:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.021+0000 7f291dffb700 1 -- 172.21.15.72:0/1492722503 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291400b760 con 0x7f29200bdb30 2023-08-31T19:04:22.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.021+0000 7f291dffb700 1 -- 172.21.15.72:0/1492722503 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291400bb00 con 0x7f29200bdb30 2023-08-31T19:04:22.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.021+0000 7f29255ff700 1 -- 172.21.15.72:0/1492722503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29200bdb30 msgr2=0x7f29201542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:22.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.021+0000 7f29255ff700 1 --2- 172.21.15.72:0/1492722503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29200bdb30 0x7f29201542b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f29200be880 tx=0x7f29140090f0).stop 2023-08-31T19:04:22.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.021+0000 7f29255ff700 1 -- 172.21.15.72:0/1492722503 shutdown_connections 2023-08-31T19:04:22.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.021+0000 7f29255ff700 1 --2- 172.21.15.72:0/1492722503 >> v2:172.21.15.146:3300/0 conn(0x7f29200663d0 0x7f2920066840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.021+0000 7f29255ff700 1 --2- 172.21.15.72:0/1492722503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29200bdb30 0x7f29201542b0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.021+0000 7f29255ff700 1 -- 172.21.15.72:0/1492722503 >> 172.21.15.72:0/1492722503 conn(0x7f292005eb60 msgr2=0x7f29200c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:22.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.021+0000 7f29255ff700 1 -- 172.21.15.72:0/1492722503 shutdown_connections 2023-08-31T19:04:22.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.021+0000 7f29255ff700 1 -- 172.21.15.72:0/1492722503 wait complete. 2023-08-31T19:04:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.023+0000 7f29255ff700 1 Processor -- start 2023-08-31T19:04:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.023+0000 7f29255ff700 1 -- start start 2023-08-31T19:04:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.024+0000 7f29255ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29200663d0 0x7f29200c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.024+0000 7f29255ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2920153ed0 0x7f2920152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.024+0000 7f29255ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2920155800 0x7f29201647c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.024+0000 7f29255ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2920152f50 con 0x7f29200663d0 2023-08-31T19:04:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.024+0000 7f29255ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29200a8ac0 con 0x7f2920155800 2023-08-31T19:04:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.024+0000 7f29255ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2920165120 con 0x7f2920153ed0 2023-08-31T19:04:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.024+0000 7f291effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29200663d0 0x7f29200c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.024+0000 7f291effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29200663d0 0x7f29200c2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57118/0 (socket says 172.21.15.72:57118) 2023-08-31T19:04:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.024+0000 7f291effd700 1 -- 172.21.15.72:0/9067253 learned_addr learned my addr 172.21.15.72:0/9067253 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.024+0000 7f291f7fe700 1 --2- 172.21.15.72:0/9067253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2920155800 0x7f29201647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.024+0000 7f291e7fc700 1 --2- 172.21.15.72:0/9067253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2920153ed0 0x7f2920152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.025+0000 7f291effd700 1 -- 172.21.15.72:0/9067253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2920153ed0 msgr2=0x7f2920152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.025+0000 7f291effd700 1 --2- 172.21.15.72:0/9067253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2920153ed0 0x7f2920152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.025+0000 7f291effd700 1 -- 172.21.15.72:0/9067253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2920155800 msgr2=0x7f29201647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.025+0000 7f291effd700 1 --2- 172.21.15.72:0/9067253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2920155800 0x7f29201647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.025+0000 7f291effd700 1 -- 172.21.15.72:0/9067253 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2914009370 con 0x7f29200663d0 2023-08-31T19:04:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.025+0000 7f291e7fc700 1 --2- 172.21.15.72:0/9067253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2920153ed0 0x7f2920152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.025+0000 7f291effd700 1 --2- 172.21.15.72:0/9067253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29200663d0 0x7f29200c2c90 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f291000c440 tx=0x7f2910007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.025+0000 7f2906ffd700 1 -- 172.21.15.72:0/9067253 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291000cea0 con 0x7f29200663d0 2023-08-31T19:04:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.025+0000 7f2906ffd700 1 -- 172.21.15.72:0/9067253 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29100072e0 con 0x7f29200663d0 2023-08-31T19:04:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.025+0000 7f2906ffd700 1 -- 172.21.15.72:0/9067253 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29100056e0 con 0x7f29200663d0 2023-08-31T19:04:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.025+0000 7f29255ff700 1 -- 172.21.15.72:0/9067253 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2920165400 con 0x7f29200663d0 2023-08-31T19:04:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.025+0000 7f29255ff700 1 -- 172.21.15.72:0/9067253 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29200a8750 con 0x7f29200663d0 2023-08-31T19:04:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.026+0000 7f29255ff700 1 -- 172.21.15.72:0/9067253 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292006c6b0 con 0x7f29200663d0 2023-08-31T19:04:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.027+0000 7f2906ffd700 1 -- 172.21.15.72:0/9067253 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 36) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f2910005ad0 con 0x7f29200663d0 2023-08-31T19:04:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.028+0000 7f2906ffd700 1 --2- 172.21.15.72:0/9067253 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f290c05efc0 0x7f290c061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.028+0000 7f2906ffd700 1 -- 172.21.15.72:0/9067253 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f29100799d0 con 0x7f29200663d0 2023-08-31T19:04:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.028+0000 7f291e7fc700 1 -- 172.21.15.72:0/9067253 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f290c05efc0 msgr2=0x7f290c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.028+0000 7f291e7fc700 1 --2- 172.21.15.72:0/9067253 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f290c05efc0 0x7f290c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.031+0000 7f2906ffd700 1 -- 172.21.15.72:0/9067253 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f291004a8e0 con 0x7f29200663d0 2023-08-31T19:04:22.053 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:22.052+0000 7f8dd4fe8680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:04:22.088 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:22.088+0000 7fd303f74680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:04:22.183 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:22.183+0000 7f8dd4fe8680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:04:22.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.207+0000 7f29255ff700 1 -- 172.21.15.72:0/9067253 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2920064850 con 0x7f29200663d0 2023-08-31T19:04:22.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.208+0000 7f2906ffd700 1 -- 172.21.15.72:0/9067253 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2910018020 con 0x7f29200663d0 2023-08-31T19:04:22.209 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:04:22.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.210+0000 7f29255ff700 1 -- 172.21.15.72:0/9067253 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f290c05efc0 msgr2=0x7f290c061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:22.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.210+0000 7f29255ff700 1 --2- 172.21.15.72:0/9067253 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f290c05efc0 0x7f290c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:22.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.210+0000 7f29255ff700 1 -- 172.21.15.72:0/9067253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29200663d0 msgr2=0x7f29200c2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:22.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.210+0000 7f29255ff700 1 --2- 172.21.15.72:0/9067253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29200663d0 0x7f29200c2c90 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f291000c440 tx=0x7f2910007e30).stop 2023-08-31T19:04:22.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.210+0000 7f29255ff700 1 -- 172.21.15.72:0/9067253 shutdown_connections 2023-08-31T19:04:22.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.210+0000 7f29255ff700 1 --2- 172.21.15.72:0/9067253 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f290c05efc0 0x7f290c061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:22.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.210+0000 7f29255ff700 1 --2- 172.21.15.72:0/9067253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2920155800 0x7f29201647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.210+0000 7f29255ff700 1 --2- 172.21.15.72:0/9067253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29200663d0 0x7f29200c2c90 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.210+0000 7f29255ff700 1 --2- 172.21.15.72:0/9067253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2920153ed0 0x7f2920152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.210+0000 7f29255ff700 1 -- 172.21.15.72:0/9067253 >> 172.21.15.72:0/9067253 conn(0x7f292005eb60 msgr2=0x7f2920153510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:22.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.210+0000 7f29255ff700 1 -- 172.21.15.72:0/9067253 shutdown_connections 2023-08-31T19:04:22.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.210+0000 7f29255ff700 1 -- 172.21.15.72:0/9067253 wait complete. 2023-08-31T19:04:22.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:04:22.272 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:22.272+0000 7fd303f74680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:04:22.365 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:22.365+0000 7fd303f74680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:04:22.379 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:22.378+0000 7f8dd4fe8680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:04:22.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.426+0000 7f911e5ff700 1 Processor -- start 2023-08-31T19:04:22.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.426+0000 7f911e5ff700 1 -- start start 2023-08-31T19:04:22.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.428+0000 7f911e5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f91181524c0 0x7f9118068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.428+0000 7f911e5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91180a9660 con 0x7f9118068980 2023-08-31T19:04:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.428+0000 7f911e5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9118068dc0 con 0x7f91181520e0 2023-08-31T19:04:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.428+0000 7f911e5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9118064340 con 0x7f91181524c0 2023-08-31T19:04:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.428+0000 7f911cb9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9118068980 0x7f9118064840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44886/0 (socket says 172.21.15.72:44886) 2023-08-31T19:04:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.428+0000 7f911cb9c700 1 -- 172.21.15.72:0/1075801354 learned_addr learned my addr 172.21.15.72:0/1075801354 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.428+0000 7f91177fe700 1 --2- 172.21.15.72:0/1075801354 >> v2:172.21.15.146:3300/0 conn(0x7f91181524c0 0x7f9118068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:22.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.429+0000 7f9116ffd700 1 -- 172.21.15.72:0/1075801354 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580441242 0 0) 0x7f91180a9660 con 0x7f9118068980 2023-08-31T19:04:22.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.429+0000 7f9116ffd700 1 -- 172.21.15.72:0/1075801354 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91000033f0 con 0x7f9118068980 2023-08-31T19:04:22.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.429+0000 7f91177fe700 1 -- 172.21.15.72:0/1075801354 >> v1:172.21.15.146:6789/0 conn(0x7f91181520e0 legacy=0x7f91180a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:22.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.429+0000 7f91177fe700 1 -- 172.21.15.72:0/1075801354 >> v1:172.21.15.72:6789/0 conn(0x7f9118068980 legacy=0x7f9118064840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:22.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.429+0000 7f91177fe700 1 -- 172.21.15.72:0/1075801354 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91180bcd00 con 0x7f91181524c0 2023-08-31T19:04:22.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.429+0000 7f91177fe700 1 --2- 172.21.15.72:0/1075801354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91181524c0 0x7f9118068490 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f910c009760 tx=0x7f910c009060).ready entity=mon.1 client_cookie=ab36d5a38d2f2893 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:22.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.429+0000 7f9116ffd700 1 -- 172.21.15.72:0/1075801354 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c00f510 con 0x7f91181524c0 2023-08-31T19:04:22.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.429+0000 7f9116ffd700 1 -- 172.21.15.72:0/1075801354 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910c00f670 con 0x7f91181524c0 2023-08-31T19:04:22.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.429+0000 7f9116ffd700 1 -- 172.21.15.72:0/1075801354 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c00f9f0 con 0x7f91181524c0 2023-08-31T19:04:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.430+0000 7f911e5ff700 1 -- 172.21.15.72:0/1075801354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91181524c0 msgr2=0x7f9118068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.430+0000 7f911e5ff700 1 --2- 172.21.15.72:0/1075801354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91181524c0 0x7f9118068490 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f910c009760 tx=0x7f910c009060).stop 2023-08-31T19:04:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.430+0000 7f911e5ff700 1 -- 172.21.15.72:0/1075801354 shutdown_connections 2023-08-31T19:04:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.430+0000 7f911e5ff700 1 --2- 172.21.15.72:0/1075801354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91181524c0 0x7f9118068490 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.430+0000 7f911e5ff700 1 -- 172.21.15.72:0/1075801354 >> 172.21.15.72:0/1075801354 conn(0x7f91180630c0 msgr2=0x7f91180c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.430+0000 7f911e5ff700 1 -- 172.21.15.72:0/1075801354 shutdown_connections 2023-08-31T19:04:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.430+0000 7f911e5ff700 1 -- 172.21.15.72:0/1075801354 wait complete. 2023-08-31T19:04:22.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.432+0000 7f911e5ff700 1 Processor -- start 2023-08-31T19:04:22.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.432+0000 7f911e5ff700 1 -- start start 2023-08-31T19:04:22.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.433+0000 7f911e5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9118068980 0x7f911814aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.433+0000 7f911e5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91181520e0 0x7f91180abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.433+0000 7f911e5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91181524c0 0x7f911814ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.433+0000 7f911e5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91181554c0 con 0x7f91181520e0 2023-08-31T19:04:22.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.433+0000 7f911e5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911814e850 con 0x7f91181524c0 2023-08-31T19:04:22.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.433+0000 7f911e5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911814dc40 con 0x7f9118068980 2023-08-31T19:04:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.433+0000 7f91177fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91181520e0 0x7f91180abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.433+0000 7f91177fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91181520e0 0x7f91180abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57132/0 (socket says 172.21.15.72:57132) 2023-08-31T19:04:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.433+0000 7f91177fe700 1 -- 172.21.15.72:0/1563078832 learned_addr learned my addr 172.21.15.72:0/1563078832 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.433+0000 7f9117fff700 1 --2- 172.21.15.72:0/1563078832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9118068980 0x7f911814aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.433+0000 7f911cb9c700 1 --2- 172.21.15.72:0/1563078832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91181524c0 0x7f911814ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:22.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.434+0000 7f91177fe700 1 -- 172.21.15.72:0/1563078832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9118068980 msgr2=0x7f911814aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:22.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.434+0000 7f91177fe700 1 --2- 172.21.15.72:0/1563078832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9118068980 0x7f911814aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.434+0000 7f91177fe700 1 -- 172.21.15.72:0/1563078832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91181524c0 msgr2=0x7f911814ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:22.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.434+0000 7f91177fe700 1 --2- 172.21.15.72:0/1563078832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91181524c0 0x7f911814ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.434+0000 7f91177fe700 1 -- 172.21.15.72:0/1563078832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c0092a0 con 0x7f91181520e0 2023-08-31T19:04:22.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.434+0000 7f91177fe700 1 --2- 172.21.15.72:0/1563078832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91181520e0 0x7f91180abd20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f91180bbe70 tx=0x7f910c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:22.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.434+0000 7f90fffff700 1 -- 172.21.15.72:0/1563078832 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c00f7e0 con 0x7f91181520e0 2023-08-31T19:04:22.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.434+0000 7f90fffff700 1 -- 172.21.15.72:0/1563078832 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910c00f940 con 0x7f91181520e0 2023-08-31T19:04:22.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.434+0000 7f911e5ff700 1 -- 172.21.15.72:0/1563078832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911814df20 con 0x7f91181520e0 2023-08-31T19:04:22.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.434+0000 7f90fffff700 1 -- 172.21.15.72:0/1563078832 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910c01b690 con 0x7f91181520e0 2023-08-31T19:04:22.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.434+0000 7f911e5ff700 1 -- 172.21.15.72:0/1563078832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911814e4e0 con 0x7f91181520e0 2023-08-31T19:04:22.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.436+0000 7f911e5ff700 1 -- 172.21.15.72:0/1563078832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911806c6b0 con 0x7f91181520e0 2023-08-31T19:04:22.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.437+0000 7f90fffff700 1 -- 172.21.15.72:0/1563078832 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 36) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f910c01ba00 con 0x7f91181520e0 2023-08-31T19:04:22.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.437+0000 7f90fffff700 1 --2- 172.21.15.72:0/1563078832 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f910405efc0 0x7f9104061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.437+0000 7f90fffff700 1 -- 172.21.15.72:0/1563078832 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f910c07b970 con 0x7f91181520e0 2023-08-31T19:04:22.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.438+0000 7f9117fff700 1 -- 172.21.15.72:0/1563078832 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f910405efc0 msgr2=0x7f9104061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:22.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.438+0000 7f9117fff700 1 --2- 172.21.15.72:0/1563078832 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f910405efc0 0x7f9104061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:22.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.442+0000 7f90fffff700 1 -- 172.21.15.72:0/1563078832 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f910c04c880 con 0x7f91181520e0 2023-08-31T19:04:22.451 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:22.451+0000 7fd303f74680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:04:22.478 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:22.478+0000 7f8dd4fe8680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:04:22.566 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:22.565+0000 7f8dd4fe8680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:04:22.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.617+0000 7f911e5ff700 1 -- 172.21.15.72:0/1563078832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91180c7710 con 0x7f91181520e0 2023-08-31T19:04:22.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.618+0000 7f90fffff700 1 -- 172.21.15.72:0/1563078832 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7f910c028020 con 0x7f91181520e0 2023-08-31T19:04:22.619 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:04:22.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.620+0000 7f911e5ff700 1 -- 172.21.15.72:0/1563078832 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f910405efc0 msgr2=0x7f9104061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:22.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.620+0000 7f911e5ff700 1 --2- 172.21.15.72:0/1563078832 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f910405efc0 0x7f9104061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:22.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.620+0000 7f911e5ff700 1 -- 172.21.15.72:0/1563078832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91181520e0 msgr2=0x7f91180abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:22.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.620+0000 7f911e5ff700 1 --2- 172.21.15.72:0/1563078832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91181520e0 0x7f91180abd20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f91180bbe70 tx=0x7f910c017000).stop 2023-08-31T19:04:22.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.620+0000 7f911e5ff700 1 -- 172.21.15.72:0/1563078832 shutdown_connections 2023-08-31T19:04:22.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.620+0000 7f911e5ff700 1 --2- 172.21.15.72:0/1563078832 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f910405efc0 0x7f9104061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:22.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.620+0000 7f911e5ff700 1 --2- 172.21.15.72:0/1563078832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91181524c0 0x7f911814ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.620+0000 7f911e5ff700 1 --2- 172.21.15.72:0/1563078832 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9118068980 0x7f911814aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.620+0000 7f911e5ff700 1 --2- 172.21.15.72:0/1563078832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91181520e0 0x7f91180abd20 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.620+0000 7f911e5ff700 1 -- 172.21.15.72:0/1563078832 >> 172.21.15.72:0/1563078832 conn(0x7f91180630c0 msgr2=0x7f911814b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:22.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.621+0000 7f911e5ff700 1 -- 172.21.15.72:0/1563078832 shutdown_connections 2023-08-31T19:04:22.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.621+0000 7f911e5ff700 1 -- 172.21.15.72:0/1563078832 wait complete. 2023-08-31T19:04:22.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:04:22.766 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:22.766+0000 7fd303f74680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:04:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.838+0000 7f2656fff700 1 Processor -- start 2023-08-31T19:04:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.838+0000 7f2656fff700 1 -- start start 2023-08-31T19:04:22.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.840+0000 7f2656fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f26500c5fb0 0x7f26500be370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.840+0000 7f2656fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f26500c46c0 0x7f2650063a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.840+0000 7f2656fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26500bece0 con 0x7f26500be860 2023-08-31T19:04:22.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.840+0000 7f2656fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2650154690 con 0x7f26500c5fb0 2023-08-31T19:04:22.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.840+0000 7f2656fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26500bfb20 con 0x7f26500c46c0 2023-08-31T19:04:22.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.840+0000 7f2654d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f26500c5fb0 0x7f26500be370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:22.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.840+0000 7f2654d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f26500c5fb0 0x7f26500be370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57144/0 (socket says 172.21.15.72:57144) 2023-08-31T19:04:22.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.840+0000 7f2654d9b700 1 -- 172.21.15.72:0/3787788567 learned_addr learned my addr 172.21.15.72:0/3787788567 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:22.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.840+0000 7f264ffff700 1 --1- 172.21.15.72:0/3787788567 >> v1:172.21.15.72:6789/0 conn(0x7f26500be860 0x7f26500c3fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44888/0 (socket says 172.21.15.72:44888) 2023-08-31T19:04:22.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.840+0000 7f265559c700 1 --2- 172.21.15.72:0/3787788567 >> v2:172.21.15.146:3300/0 conn(0x7f26500c46c0 0x7f2650063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:22.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.841+0000 7f2654d9b700 1 -- 172.21.15.72:0/3787788567 >> v2:172.21.15.146:3300/0 conn(0x7f26500c46c0 msgr2=0x7f2650063a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:22.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.841+0000 7f2654d9b700 1 --2- 172.21.15.72:0/3787788567 >> v2:172.21.15.146:3300/0 conn(0x7f26500c46c0 0x7f2650063a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.841+0000 7f2654d9b700 1 -- 172.21.15.72:0/3787788567 >> v1:172.21.15.72:6789/0 conn(0x7f26500be860 legacy=0x7f26500c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:22.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.841+0000 7f2654d9b700 1 -- 172.21.15.72:0/3787788567 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26500bef10 con 0x7f26500c5fb0 2023-08-31T19:04:22.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.841+0000 7f264f7fe700 1 -- 172.21.15.72:0/3787788567 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500363903 0 0) 0x7f26500bece0 con 0x7f26500be860 2023-08-31T19:04:22.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.841+0000 7f265559c700 1 --2- 172.21.15.72:0/3787788567 >> v2:172.21.15.146:3300/0 conn(0x7f26500c46c0 0x7f2650063a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:22.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.841+0000 7f2654d9b700 1 --2- 172.21.15.72:0/3787788567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26500c5fb0 0x7f26500be370 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7f2650069690 tx=0x7f2644009060).ready entity=mon.0 client_cookie=434d74a61715f59e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:22.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.841+0000 7f264f7fe700 1 -- 172.21.15.72:0/3787788567 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644005880 con 0x7f26500c5fb0 2023-08-31T19:04:22.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.841+0000 7f264f7fe700 1 -- 172.21.15.72:0/3787788567 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26440059e0 con 0x7f26500c5fb0 2023-08-31T19:04:22.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.841+0000 7f264f7fe700 1 -- 172.21.15.72:0/3787788567 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644005d60 con 0x7f26500c5fb0 2023-08-31T19:04:22.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.842+0000 7f2656fff700 1 -- 172.21.15.72:0/3787788567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26500c5fb0 msgr2=0x7f26500be370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:22.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.842+0000 7f2656fff700 1 --2- 172.21.15.72:0/3787788567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26500c5fb0 0x7f26500be370 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7f2650069690 tx=0x7f2644009060).stop 2023-08-31T19:04:22.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.842+0000 7f2656fff700 1 -- 172.21.15.72:0/3787788567 shutdown_connections 2023-08-31T19:04:22.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.842+0000 7f2656fff700 1 --2- 172.21.15.72:0/3787788567 >> v2:172.21.15.146:3300/0 conn(0x7f26500c46c0 0x7f2650063a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.842+0000 7f2656fff700 1 --2- 172.21.15.72:0/3787788567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26500c5fb0 0x7f26500be370 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.842+0000 7f2656fff700 1 -- 172.21.15.72:0/3787788567 >> 172.21.15.72:0/3787788567 conn(0x7f2650082f60 msgr2=0x7f265005e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:22.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.842+0000 7f2656fff700 1 -- 172.21.15.72:0/3787788567 shutdown_connections 2023-08-31T19:04:22.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.842+0000 7f2656fff700 1 -- 172.21.15.72:0/3787788567 wait complete. 2023-08-31T19:04:22.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.843+0000 7f2656fff700 1 Processor -- start 2023-08-31T19:04:22.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.844+0000 7f2656fff700 1 -- start start 2023-08-31T19:04:22.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.844+0000 7f2656fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26500be860 0x7f2650152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.844+0000 7f2656fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26500c46c0 0x7f26500c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.844+0000 7f2656fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26500c5fb0 0x7f26500c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.844+0000 7f2656fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26500c4480 con 0x7f26500c46c0 2023-08-31T19:04:22.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.844+0000 7f2656fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2650159930 con 0x7f26500be860 2023-08-31T19:04:22.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.844+0000 7f2656fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2650158d20 con 0x7f26500c5fb0 2023-08-31T19:04:22.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.845+0000 7f264ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26500c46c0 0x7f26500c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:22.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.845+0000 7f2654d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26500be860 0x7f2650152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:22.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.845+0000 7f2654d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26500be860 0x7f2650152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:40342/0 (socket says 172.21.15.72:40342) 2023-08-31T19:04:22.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.845+0000 7f2654d9b700 1 -- 172.21.15.72:0/3459424993 learned_addr learned my addr 172.21.15.72:0/3459424993 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:22.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.845+0000 7f265559c700 1 --2- 172.21.15.72:0/3459424993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26500c5fb0 0x7f26500c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.845+0000 7f264ffff700 1 -- 172.21.15.72:0/3459424993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26500c5fb0 msgr2=0x7f26500c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.845+0000 7f264ffff700 1 --2- 172.21.15.72:0/3459424993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26500c5fb0 0x7f26500c3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.845+0000 7f264ffff700 1 -- 172.21.15.72:0/3459424993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26500be860 msgr2=0x7f2650152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.845+0000 7f264ffff700 1 --2- 172.21.15.72:0/3459424993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26500be860 0x7f2650152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:22.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.845+0000 7f264ffff700 1 -- 172.21.15.72:0/3459424993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2644009300 con 0x7f26500c46c0 2023-08-31T19:04:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.845+0000 7f2654d9b700 1 --2- 172.21.15.72:0/3459424993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26500be860 0x7f2650152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:04:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.845+0000 7f264ffff700 1 --2- 172.21.15.72:0/3459424993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26500c46c0 0x7f26500c3aa0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f263c00c410 tx=0x7f263c007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.846+0000 7f264cff9700 1 -- 172.21.15.72:0/3459424993 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c0070d0 con 0x7f26500c46c0 2023-08-31T19:04:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.846+0000 7f264cff9700 1 -- 172.21.15.72:0/3459424993 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c007230 con 0x7f26500c46c0 2023-08-31T19:04:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.846+0000 7f2656fff700 1 -- 172.21.15.72:0/3459424993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2650159000 con 0x7f26500c46c0 2023-08-31T19:04:22.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.846+0000 7f264cff9700 1 -- 172.21.15.72:0/3459424993 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c0056e0 con 0x7f26500c46c0 2023-08-31T19:04:22.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.846+0000 7f2656fff700 1 -- 172.21.15.72:0/3459424993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26501595c0 con 0x7f26500c46c0 2023-08-31T19:04:22.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.847+0000 7f2656fff700 1 -- 172.21.15.72:0/3459424993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265006c6b0 con 0x7f26500c46c0 2023-08-31T19:04:22.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.848+0000 7f264cff9700 1 -- 172.21.15.72:0/3459424993 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 36) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f263c005ad0 con 0x7f26500c46c0 2023-08-31T19:04:22.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.849+0000 7f264cff9700 1 --2- 172.21.15.72:0/3459424993 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f263405efc0 0x7f2634061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.849+0000 7f264cff9700 1 -- 172.21.15.72:0/3459424993 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f263c079b50 con 0x7f26500c46c0 2023-08-31T19:04:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.849+0000 7f2654d9b700 1 -- 172.21.15.72:0/3459424993 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f263405efc0 msgr2=0x7f2634061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:22.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.849+0000 7f2654d9b700 1 --2- 172.21.15.72:0/3459424993 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f263405efc0 0x7f2634061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:22.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:22.852+0000 7f264cff9700 1 -- 172.21.15.72:0/3459424993 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f263c04aa60 con 0x7f26500c46c0 2023-08-31T19:04:22.899 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:22.899+0000 7f8dd4fe8680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:04:22.993 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:22.990+0000 7fd303f74680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:04:23.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.050+0000 7f2654d9b700 1 -- 172.21.15.72:0/3459424993 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f263405efc0 msgr2=0x7f2634061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:23.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.050+0000 7f2654d9b700 1 --2- 172.21.15.72:0/3459424993 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f263405efc0 0x7f2634061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:04:23.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.070+0000 7f2656fff700 1 -- 172.21.15.72:0/3459424993 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26500bf1f0 con 0x7f26500c46c0 2023-08-31T19:04:23.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.071+0000 7f264cff9700 1 -- 172.21.15.72:0/3459424993 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f263c018020 con 0x7f26500c46c0 2023-08-31T19:04:23.071 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:23.072 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5732,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1777836817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1777836817},{"type":"v1","addr":"172.21.15.146:6834","nonce":1777836817}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5735,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1865290147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1865290147},{"type":"v1","addr":"172.21.15.146:6835","nonce":1865290147}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2552241481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2552241481},{"type":"v1","addr":"172.21.15.72:6836","nonce":2552241481}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:04:03.992354+0000","modified":"2023-08-31T19:04:07.010012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6699":{"gid":6699,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/859098343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":859098343},{"type":"v1","addr":"172.21.15.72:6837","nonce":859098343}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-31T19:04:23.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.073+0000 7f2656fff700 1 -- 172.21.15.72:0/3459424993 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f263405efc0 msgr2=0x7f2634061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:23.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.073+0000 7f2656fff700 1 --2- 172.21.15.72:0/3459424993 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f263405efc0 0x7f2634061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:23.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.073+0000 7f2656fff700 1 -- 172.21.15.72:0/3459424993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26500c46c0 msgr2=0x7f26500c3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:23.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.073+0000 7f2656fff700 1 --2- 172.21.15.72:0/3459424993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26500c46c0 0x7f26500c3aa0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f263c00c410 tx=0x7f263c007bd0).stop 2023-08-31T19:04:23.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.073+0000 7f2656fff700 1 -- 172.21.15.72:0/3459424993 shutdown_connections 2023-08-31T19:04:23.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.073+0000 7f2656fff700 1 --2- 172.21.15.72:0/3459424993 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26500c5fb0 0x7f26500c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.073+0000 7f2656fff700 1 --2- 172.21.15.72:0/3459424993 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f263405efc0 0x7f2634061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:23.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.073+0000 7f2656fff700 1 --2- 172.21.15.72:0/3459424993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26500be860 0x7f2650152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.073+0000 7f2656fff700 1 --2- 172.21.15.72:0/3459424993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26500c46c0 0x7f26500c3aa0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.073+0000 7f2656fff700 1 -- 172.21.15.72:0/3459424993 >> 172.21.15.72:0/3459424993 conn(0x7f2650082f60 msgr2=0x7f2650067c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:23.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.073+0000 7f2656fff700 1 -- 172.21.15.72:0/3459424993 shutdown_connections 2023-08-31T19:04:23.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.073+0000 7f2656fff700 1 -- 172.21.15.72:0/3459424993 wait complete. 2023-08-31T19:04:23.076 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 40 2023-08-31T19:04:23.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:04:23.127 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:23.127+0000 7f8dd4fe8680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:04:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.285+0000 7f32355ff700 1 Processor -- start 2023-08-31T19:04:23.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.285+0000 7f32355ff700 1 -- start start 2023-08-31T19:04:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.287+0000 7f32355ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f323006a720 0x7f32300c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:23.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.287+0000 7f32355ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f32300a95e0 0x7f32300c2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:23.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.287+0000 7f32355ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32300c4bb0 con 0x7f3230151f10 2023-08-31T19:04:23.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.287+0000 7f32355ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32300c17e0 con 0x7f32300a95e0 2023-08-31T19:04:23.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.287+0000 7f32355ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32300c1da0 con 0x7f323006a720 2023-08-31T19:04:23.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.287+0000 7f322e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f323006a720 0x7f32300c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:23.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.287+0000 7f322f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f32300a95e0 0x7f32300c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:23.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.287+0000 7f322f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f32300a95e0 0x7f32300c2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:50562/0 (socket says 172.21.15.72:50562) 2023-08-31T19:04:23.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.287+0000 7f322f7fe700 1 -- 172.21.15.72:0/951900584 learned_addr learned my addr 172.21.15.72:0/951900584 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:23.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.288+0000 7f322f7fe700 1 -- 172.21.15.72:0/951900584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f323006a720 msgr2=0x7f32300c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:23.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.288+0000 7f322f7fe700 1 --2- 172.21.15.72:0/951900584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f323006a720 0x7f32300c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.288+0000 7f322f7fe700 1 -- 172.21.15.72:0/951900584 >> v1:172.21.15.146:6789/0 conn(0x7f3230151f10 legacy=0x7f32300a8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.288+0000 7f322f7fe700 1 -- 172.21.15.72:0/951900584 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32300bc160 con 0x7f32300a95e0 2023-08-31T19:04:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.288+0000 7f322f7fe700 1 --2- 172.21.15.72:0/951900584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32300a95e0 0x7f32300c2720 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f3228009f20 tx=0x7f3228009840).ready entity=mon.1 client_cookie=f1f4edec46909630 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.288+0000 7f322dffb700 1 -- 172.21.15.72:0/951900584 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322800e070 con 0x7f32300a95e0 2023-08-31T19:04:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.288+0000 7f322dffb700 1 -- 172.21.15.72:0/951900584 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322800b9d0 con 0x7f32300a95e0 2023-08-31T19:04:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.288+0000 7f322dffb700 1 -- 172.21.15.72:0/951900584 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322800bd50 con 0x7f32300a95e0 2023-08-31T19:04:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.289+0000 7f32355ff700 1 -- 172.21.15.72:0/951900584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32300a95e0 msgr2=0x7f32300c2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.289+0000 7f32355ff700 1 --2- 172.21.15.72:0/951900584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32300a95e0 0x7f32300c2720 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f3228009f20 tx=0x7f3228009840).stop 2023-08-31T19:04:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.289+0000 7f32355ff700 1 -- 172.21.15.72:0/951900584 shutdown_connections 2023-08-31T19:04:23.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.289+0000 7f32355ff700 1 --2- 172.21.15.72:0/951900584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32300a95e0 0x7f32300c2720 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.289+0000 7f32355ff700 1 --2- 172.21.15.72:0/951900584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f323006a720 0x7f32300c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.289+0000 7f32355ff700 1 -- 172.21.15.72:0/951900584 >> 172.21.15.72:0/951900584 conn(0x7f3230063120 msgr2=0x7f32300c6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.289+0000 7f32355ff700 1 -- 172.21.15.72:0/951900584 shutdown_connections 2023-08-31T19:04:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.289+0000 7f32355ff700 1 -- 172.21.15.72:0/951900584 wait complete. 2023-08-31T19:04:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.290+0000 7f32355ff700 1 Processor -- start 2023-08-31T19:04:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.291+0000 7f32355ff700 1 -- start start 2023-08-31T19:04:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.291+0000 7f32355ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f323006a720 0x7f323014cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.291+0000 7f32355ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a95e0 0x7f32300c0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.291+0000 7f32355ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3230151f10 0x7f32301502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:23.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.292+0000 7f32355ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32300c0a10 con 0x7f323006a720 2023-08-31T19:04:23.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.292+0000 7f32355ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323014fe20 con 0x7f3230151f10 2023-08-31T19:04:23.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.292+0000 7f32355ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323014d3b0 con 0x7f32300a95e0 2023-08-31T19:04:23.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.292+0000 7f322effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f323006a720 0x7f323014cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:23.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.292+0000 7f322f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3230151f10 0x7f32301502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:23.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.292+0000 7f322e7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a95e0 0x7f32300c0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:23.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.292+0000 7f322effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f323006a720 0x7f323014cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40648/0 (socket says 172.21.15.72:40648) 2023-08-31T19:04:23.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.292+0000 7f322effd700 1 -- 172.21.15.72:0/2012897335 learned_addr learned my addr 172.21.15.72:0/2012897335 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:23.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.292+0000 7f322effd700 1 -- 172.21.15.72:0/2012897335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a95e0 msgr2=0x7f32300c0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:23.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.292+0000 7f322effd700 1 --2- 172.21.15.72:0/2012897335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a95e0 0x7f32300c0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.292+0000 7f322effd700 1 -- 172.21.15.72:0/2012897335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3230151f10 msgr2=0x7f32301502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:23.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.292+0000 7f322effd700 1 --2- 172.21.15.72:0/2012897335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3230151f10 0x7f32301502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.292+0000 7f322effd700 1 -- 172.21.15.72:0/2012897335 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3228009ae0 con 0x7f323006a720 2023-08-31T19:04:23.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.292+0000 7f322effd700 1 --2- 172.21.15.72:0/2012897335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f323006a720 0x7f323014cec0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f322000c4a0 tx=0x7f3220007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:23.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.293+0000 7f3216ffd700 1 -- 172.21.15.72:0/2012897335 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220007020 con 0x7f323006a720 2023-08-31T19:04:23.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.293+0000 7f3216ffd700 1 -- 172.21.15.72:0/2012897335 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3220007180 con 0x7f323006a720 2023-08-31T19:04:23.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.293+0000 7f32355ff700 1 -- 172.21.15.72:0/2012897335 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323014f4f0 con 0x7f323006a720 2023-08-31T19:04:23.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.293+0000 7f3216ffd700 1 -- 172.21.15.72:0/2012897335 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220007520 con 0x7f323006a720 2023-08-31T19:04:23.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.293+0000 7f32355ff700 1 -- 172.21.15.72:0/2012897335 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323014fab0 con 0x7f323006a720 2023-08-31T19:04:23.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.294+0000 7f32355ff700 1 -- 172.21.15.72:0/2012897335 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3230150100 con 0x7f323006a720 2023-08-31T19:04:23.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.295+0000 7f3216ffd700 1 -- 172.21.15.72:0/2012897335 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 36) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f32200068b0 con 0x7f323006a720 2023-08-31T19:04:23.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.295+0000 7f3216ffd700 1 --2- 172.21.15.72:0/2012897335 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f321c05efc0 0x7f321c061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.296+0000 7f3216ffd700 1 -- 172.21.15.72:0/2012897335 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f32200796e0 con 0x7f323006a720 2023-08-31T19:04:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.296+0000 7f322e7fc700 1 -- 172.21.15.72:0/2012897335 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f321c05efc0 msgr2=0x7f321c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:23.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.296+0000 7f322e7fc700 1 --2- 172.21.15.72:0/2012897335 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f321c05efc0 0x7f321c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:23.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.299+0000 7f3216ffd700 1 -- 172.21.15.72:0/2012897335 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f32200478f0 con 0x7f323006a720 2023-08-31T19:04:23.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.478+0000 7f32355ff700 1 -- 172.21.15.72:0/2012897335 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f323006c6b0 con 0x7f323006a720 2023-08-31T19:04:23.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.479+0000 7f3216ffd700 1 -- 172.21.15.72:0/2012897335 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f322004a5f0 con 0x7f323006a720 2023-08-31T19:04:23.480 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:23.480 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":95,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:04:17.694700+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:04:02.410352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-31T19:04:02.966343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/2262253272":"2023-09-01T19:04:17.694660+0000","172.21.15.72:6833/143463":"2023-09-01T19:04:17.694660+0000","172.21.15.72:6832/143463":"2023-09-01T19:04:17.694660+0000","172.21.15.72:0/404249945":"2023-09-01T19:04:17.694660+0000","172.21.15.72:0/3249564216":"2023-09-01T19:04:17.694660+0000","172.21.15.72:0/4257999405":"2023-09-01T19:04:17.694660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:04:23.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.481+0000 7f32355ff700 1 -- 172.21.15.72:0/2012897335 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f321c05efc0 msgr2=0x7f321c061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:23.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.481+0000 7f32355ff700 1 --2- 172.21.15.72:0/2012897335 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f321c05efc0 0x7f321c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:23.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.481+0000 7f32355ff700 1 -- 172.21.15.72:0/2012897335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f323006a720 msgr2=0x7f323014cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:23.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.481+0000 7f32355ff700 1 --2- 172.21.15.72:0/2012897335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f323006a720 0x7f323014cec0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f322000c4a0 tx=0x7f3220007e00).stop 2023-08-31T19:04:23.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.482+0000 7f32355ff700 1 -- 172.21.15.72:0/2012897335 shutdown_connections 2023-08-31T19:04:23.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.482+0000 7f32355ff700 1 --2- 172.21.15.72:0/2012897335 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f321c05efc0 0x7f321c061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:23.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.482+0000 7f32355ff700 1 --2- 172.21.15.72:0/2012897335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3230151f10 0x7f32301502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.482+0000 7f32355ff700 1 --2- 172.21.15.72:0/2012897335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f323006a720 0x7f323014cec0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.482+0000 7f32355ff700 1 --2- 172.21.15.72:0/2012897335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f32300a95e0 0x7f32300c0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.482+0000 7f32355ff700 1 -- 172.21.15.72:0/2012897335 >> 172.21.15.72:0/2012897335 conn(0x7f3230063120 msgr2=0x7f32300c6640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:23.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.482+0000 7f32355ff700 1 -- 172.21.15.72:0/2012897335 shutdown_connections 2023-08-31T19:04:23.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.482+0000 7f32355ff700 1 -- 172.21.15.72:0/2012897335 wait complete. 2023-08-31T19:04:23.500 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T19:04:23.501 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:04:23.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.732+0000 7fcf7adff700 1 Processor -- start 2023-08-31T19:04:23.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.732+0000 7fcf7adff700 1 -- start start 2023-08-31T19:04:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.733+0000 7fcf7adff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcf74135030 0x7fcf740c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.734+0000 7fcf7adff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf74156310 0x7fcf740c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.734+0000 7fcf7adff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf740c26b0 con 0x7fcf740bba70 2023-08-31T19:04:23.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.734+0000 7fcf7adff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf740c1e80 con 0x7fcf74156310 2023-08-31T19:04:23.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.734+0000 7fcf7adff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf740bc250 con 0x7fcf74135030 2023-08-31T19:04:23.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.734+0000 7fcf7939c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf74156310 0x7fcf740c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:23.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.734+0000 7fcf7939c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf74156310 0x7fcf740c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40654/0 (socket says 172.21.15.72:40654) 2023-08-31T19:04:23.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.734+0000 7fcf7939c700 1 -- 172.21.15.72:0/3793537299 learned_addr learned my addr 172.21.15.72:0/3793537299 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:23.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.734+0000 7fcf73fff700 1 --1- 172.21.15.72:0/3793537299 >> v1:172.21.15.72:6789/0 conn(0x7fcf740bba70 0x7fcf74155c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34766/0 (socket says 172.21.15.72:34766) 2023-08-31T19:04:23.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.734+0000 7fcf78b9b700 1 --2- 172.21.15.72:0/3793537299 >> v2:172.21.15.146:3300/0 conn(0x7fcf74135030 0x7fcf740c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:23.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.734+0000 7fcf7939c700 1 -- 172.21.15.72:0/3793537299 >> v2:172.21.15.146:3300/0 conn(0x7fcf74135030 msgr2=0x7fcf740c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:23.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.734+0000 7fcf7939c700 1 --2- 172.21.15.72:0/3793537299 >> v2:172.21.15.146:3300/0 conn(0x7fcf74135030 0x7fcf740c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.734+0000 7fcf7939c700 1 -- 172.21.15.72:0/3793537299 >> v1:172.21.15.72:6789/0 conn(0x7fcf740bba70 legacy=0x7fcf74155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:23.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.734+0000 7fcf7939c700 1 -- 172.21.15.72:0/3793537299 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf740bbf70 con 0x7fcf74156310 2023-08-31T19:04:23.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.734+0000 7fcf737fe700 1 -- 172.21.15.72:0/3793537299 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3894893150 0 0) 0x7fcf740c26b0 con 0x7fcf740bba70 2023-08-31T19:04:23.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.735+0000 7fcf7939c700 1 --2- 172.21.15.72:0/3793537299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf74156310 0x7fcf740c2b40 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fcf74067940 tx=0x7fcf6c009840).ready entity=mon.0 client_cookie=978cf1c3ee7795a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:23.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.735+0000 7fcf737fe700 1 -- 172.21.15.72:0/3793537299 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c00e070 con 0x7fcf74156310 2023-08-31T19:04:23.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.735+0000 7fcf737fe700 1 -- 172.21.15.72:0/3793537299 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c00ba20 con 0x7fcf74156310 2023-08-31T19:04:23.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.735+0000 7fcf737fe700 1 -- 172.21.15.72:0/3793537299 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c00bda0 con 0x7fcf74156310 2023-08-31T19:04:23.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.735+0000 7fcf7adff700 1 -- 172.21.15.72:0/3793537299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf74156310 msgr2=0x7fcf740c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:23.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.735+0000 7fcf7adff700 1 --2- 172.21.15.72:0/3793537299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf74156310 0x7fcf740c2b40 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fcf74067940 tx=0x7fcf6c009840).stop 2023-08-31T19:04:23.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.735+0000 7fcf7adff700 1 -- 172.21.15.72:0/3793537299 shutdown_connections 2023-08-31T19:04:23.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.735+0000 7fcf7adff700 1 --2- 172.21.15.72:0/3793537299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf74156310 0x7fcf740c2b40 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.735+0000 7fcf7adff700 1 --2- 172.21.15.72:0/3793537299 >> v2:172.21.15.146:3300/0 conn(0x7fcf74135030 0x7fcf740c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.735+0000 7fcf7adff700 1 -- 172.21.15.72:0/3793537299 >> 172.21.15.72:0/3793537299 conn(0x7fcf740c6b10 msgr2=0x7fcf740c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:23.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.736+0000 7fcf7adff700 1 -- 172.21.15.72:0/3793537299 shutdown_connections 2023-08-31T19:04:23.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.736+0000 7fcf7adff700 1 -- 172.21.15.72:0/3793537299 wait complete. 2023-08-31T19:04:23.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.737+0000 7fcf7adff700 1 Processor -- start 2023-08-31T19:04:23.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.737+0000 7fcf7adff700 1 -- start start 2023-08-31T19:04:23.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.738+0000 7fcf7adff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740bba70 0x7fcf74168540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:23.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.738+0000 7fcf7adff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf74135030 0x7fcf740a8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:23.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.738+0000 7fcf7adff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf74156310 0x7fcf741644f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:23.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.738+0000 7fcf7adff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7414bca0 con 0x7fcf740bba70 2023-08-31T19:04:23.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.738+0000 7fcf7adff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74167aa0 con 0x7fcf74156310 2023-08-31T19:04:23.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.738+0000 7fcf7adff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74164fe0 con 0x7fcf74135030 2023-08-31T19:04:23.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.738+0000 7fcf78b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740bba70 0x7fcf74168540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:23.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.739+0000 7fcf78b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740bba70 0x7fcf74168540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40670/0 (socket says 172.21.15.72:40670) 2023-08-31T19:04:23.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.739+0000 7fcf78b9b700 1 -- 172.21.15.72:0/101682958 learned_addr learned my addr 172.21.15.72:0/101682958 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:23.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.739+0000 7fcf73fff700 1 --2- 172.21.15.72:0/101682958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf74135030 0x7fcf740a8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:23.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.739+0000 7fcf7939c700 1 --2- 172.21.15.72:0/101682958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf74156310 0x7fcf741644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:23.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.739+0000 7fcf78b9b700 1 -- 172.21.15.72:0/101682958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf74135030 msgr2=0x7fcf740a8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:23.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.739+0000 7fcf78b9b700 1 --2- 172.21.15.72:0/101682958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf74135030 0x7fcf740a8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.739+0000 7fcf78b9b700 1 -- 172.21.15.72:0/101682958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf74156310 msgr2=0x7fcf741644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:23.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.739+0000 7fcf78b9b700 1 --2- 172.21.15.72:0/101682958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf74156310 0x7fcf741644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.739+0000 7fcf78b9b700 1 -- 172.21.15.72:0/101682958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c009ae0 con 0x7fcf740bba70 2023-08-31T19:04:23.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.739+0000 7fcf78b9b700 1 --2- 172.21.15.72:0/101682958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740bba70 0x7fcf74168540 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fcf6800e930 tx=0x7fcf68009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:23.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.741+0000 7fcf70ff9700 1 -- 172.21.15.72:0/101682958 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68012600 con 0x7fcf740bba70 2023-08-31T19:04:23.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.741+0000 7fcf70ff9700 1 -- 172.21.15.72:0/101682958 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf68012760 con 0x7fcf740bba70 2023-08-31T19:04:23.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.741+0000 7fcf7adff700 1 -- 172.21.15.72:0/101682958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf741652c0 con 0x7fcf740bba70 2023-08-31T19:04:23.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.741+0000 7fcf70ff9700 1 -- 172.21.15.72:0/101682958 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68012ae0 con 0x7fcf740bba70 2023-08-31T19:04:23.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.741+0000 7fcf7adff700 1 -- 172.21.15.72:0/101682958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf74168020 con 0x7fcf740bba70 2023-08-31T19:04:23.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.742+0000 7fcf7adff700 1 -- 172.21.15.72:0/101682958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf740c2060 con 0x7fcf740bba70 2023-08-31T19:04:23.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.744+0000 7fcf70ff9700 1 -- 172.21.15.72:0/101682958 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 36) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fcf6801b400 con 0x7fcf740bba70 2023-08-31T19:04:23.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.744+0000 7fcf70ff9700 1 --2- 172.21.15.72:0/101682958 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcf5805efc0 0x7fcf58061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:23.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.745+0000 7fcf70ff9700 1 -- 172.21.15.72:0/101682958 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6979+0+0 (secure 0 0 0) 0x7fcf6807a8b0 con 0x7fcf740bba70 2023-08-31T19:04:23.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.745+0000 7fcf73fff700 1 -- 172.21.15.72:0/101682958 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcf5805efc0 msgr2=0x7fcf58061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:23.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.745+0000 7fcf73fff700 1 --2- 172.21.15.72:0/101682958 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcf5805efc0 0x7fcf58061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:23.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.749+0000 7fcf70ff9700 1 -- 172.21.15.72:0/101682958 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcf6804b760 con 0x7fcf740bba70 2023-08-31T19:04:23.808 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:23.808+0000 7fd303f74680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:04:23.896 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:23.896+0000 7fd303f74680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:04:23.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.946+0000 7fcf73fff700 1 -- 172.21.15.72:0/101682958 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcf5805efc0 msgr2=0x7fcf58061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:23.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.946+0000 7fcf73fff700 1 --2- 172.21.15.72:0/101682958 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcf5805efc0 0x7fcf58061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:04:23.967 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:23.966+0000 7f8dd4fe8680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:04:23.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.970+0000 7fcf7adff700 1 -- 172.21.15.72:0/101682958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf740c3140 con 0x7fcf740bba70 2023-08-31T19:04:23.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.971+0000 7fcf70ff9700 1 -- 172.21.15.72:0/101682958 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fcf6804ed80 con 0x7fcf740bba70 2023-08-31T19:04:23.972 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:23.972 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5732,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1777836817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1777836817},{"type":"v1","addr":"172.21.15.146:6834","nonce":1777836817}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5735,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1865290147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1865290147},{"type":"v1","addr":"172.21.15.146:6835","nonce":1865290147}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2552241481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2552241481},{"type":"v1","addr":"172.21.15.72:6836","nonce":2552241481}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:04:03.992354+0000","modified":"2023-08-31T19:04:07.010012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6699":{"gid":6699,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/859098343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":859098343},{"type":"v1","addr":"172.21.15.72:6837","nonce":859098343}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-31T19:04:23.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.973+0000 7fcf7adff700 1 -- 172.21.15.72:0/101682958 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcf5805efc0 msgr2=0x7fcf58061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:23.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.973+0000 7fcf7adff700 1 --2- 172.21.15.72:0/101682958 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcf5805efc0 0x7fcf58061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:23.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.973+0000 7fcf7adff700 1 -- 172.21.15.72:0/101682958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740bba70 msgr2=0x7fcf74168540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:23.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.973+0000 7fcf7adff700 1 --2- 172.21.15.72:0/101682958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740bba70 0x7fcf74168540 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fcf6800e930 tx=0x7fcf68009060).stop 2023-08-31T19:04:23.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.973+0000 7fcf7adff700 1 -- 172.21.15.72:0/101682958 shutdown_connections 2023-08-31T19:04:23.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.973+0000 7fcf7adff700 1 --2- 172.21.15.72:0/101682958 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcf5805efc0 0x7fcf58061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:23.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.973+0000 7fcf7adff700 1 --2- 172.21.15.72:0/101682958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf74156310 0x7fcf741644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.973+0000 7fcf7adff700 1 --2- 172.21.15.72:0/101682958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740bba70 0x7fcf74168540 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.973+0000 7fcf7adff700 1 --2- 172.21.15.72:0/101682958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcf74135030 0x7fcf740a8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:23.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.973+0000 7fcf7adff700 1 -- 172.21.15.72:0/101682958 >> 172.21.15.72:0/101682958 conn(0x7fcf740c6b10 msgr2=0x7fcf74069b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:23.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.973+0000 7fcf7adff700 1 -- 172.21.15.72:0/101682958 shutdown_connections 2023-08-31T19:04:23.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:23.973+0000 7fcf7adff700 1 -- 172.21.15.72:0/101682958 wait complete. 2023-08-31T19:04:23.976 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 40 2023-08-31T19:04:23.990 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:23.990+0000 7fd303f74680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:04:23.992 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:04:24.060 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:24.059+0000 7f8dd4fe8680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:04:24.156 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:24.156+0000 7f8dd4fe8680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:04:24.178 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:24.176+0000 7fd303f74680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:04:24.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.184+0000 7fe8659ff700 1 Processor -- start 2023-08-31T19:04:24.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.184+0000 7fe8659ff700 1 -- start start 2023-08-31T19:04:24.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.185+0000 7fe8659ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8600a9eb0 0x7fe8600aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:24.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.185+0000 7fe8659ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8601576d0 0x7fe8600c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:24.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.185+0000 7fe8659ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8600bfd00 con 0x7fe8600c5bf0 2023-08-31T19:04:24.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.185+0000 7fe8659ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8600c05a0 con 0x7fe8600a9eb0 2023-08-31T19:04:24.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.185+0000 7fe8659ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8600aaea0 con 0x7fe8601576d0 2023-08-31T19:04:24.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.186+0000 7fe85effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8600a9eb0 0x7fe8600aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:24.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.186+0000 7fe85effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8600a9eb0 0x7fe8600aa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40674/0 (socket says 172.21.15.72:40674) 2023-08-31T19:04:24.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.186+0000 7fe85effd700 1 -- 172.21.15.72:0/3361543179 learned_addr learned my addr 172.21.15.72:0/3361543179 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:24.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.186+0000 7fe85e7fc700 1 --1- 172.21.15.72:0/3361543179 >> v1:172.21.15.72:6789/0 conn(0x7fe8600c5bf0 0x7fe860156fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34780/0 (socket says 172.21.15.72:34780) 2023-08-31T19:04:24.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.186+0000 7fe85f7fe700 1 --2- 172.21.15.72:0/3361543179 >> v2:172.21.15.146:3300/0 conn(0x7fe8601576d0 0x7fe8600c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:24.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.186+0000 7fe85effd700 1 -- 172.21.15.72:0/3361543179 >> v2:172.21.15.146:3300/0 conn(0x7fe8601576d0 msgr2=0x7fe8600c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:24.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.186+0000 7fe85effd700 1 --2- 172.21.15.72:0/3361543179 >> v2:172.21.15.146:3300/0 conn(0x7fe8601576d0 0x7fe8600c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.186+0000 7fe85effd700 1 -- 172.21.15.72:0/3361543179 >> v1:172.21.15.72:6789/0 conn(0x7fe8600c5bf0 legacy=0x7fe860156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:24.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.186+0000 7fe85effd700 1 -- 172.21.15.72:0/3361543179 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8600c6670 con 0x7fe8600a9eb0 2023-08-31T19:04:24.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.186+0000 7fe85effd700 1 --2- 172.21.15.72:0/3361543179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8600a9eb0 0x7fe8600aa290 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7fe850006fd0 tx=0x7fe8500090f0).ready entity=mon.0 client_cookie=2706525c83f9cf91 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:24.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.187+0000 7fe85dffb700 1 -- 172.21.15.72:0/3361543179 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85000b600 con 0x7fe8600a9eb0 2023-08-31T19:04:24.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.187+0000 7fe85dffb700 1 -- 172.21.15.72:0/3361543179 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85000b760 con 0x7fe8600a9eb0 2023-08-31T19:04:24.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.187+0000 7fe85dffb700 1 -- 172.21.15.72:0/3361543179 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85000bae0 con 0x7fe8600a9eb0 2023-08-31T19:04:24.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.187+0000 7fe8659ff700 1 -- 172.21.15.72:0/3361543179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8600a9eb0 msgr2=0x7fe8600aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:24.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.187+0000 7fe8659ff700 1 --2- 172.21.15.72:0/3361543179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8600a9eb0 0x7fe8600aa290 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7fe850006fd0 tx=0x7fe8500090f0).stop 2023-08-31T19:04:24.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.187+0000 7fe8659ff700 1 -- 172.21.15.72:0/3361543179 shutdown_connections 2023-08-31T19:04:24.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.187+0000 7fe8659ff700 1 --2- 172.21.15.72:0/3361543179 >> v2:172.21.15.146:3300/0 conn(0x7fe8601576d0 0x7fe8600c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.187+0000 7fe8659ff700 1 --2- 172.21.15.72:0/3361543179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8600a9eb0 0x7fe8600aa290 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.187+0000 7fe8659ff700 1 -- 172.21.15.72:0/3361543179 >> 172.21.15.72:0/3361543179 conn(0x7fe8600c82e0 msgr2=0x7fe86005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:24.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.187+0000 7fe8659ff700 1 -- 172.21.15.72:0/3361543179 shutdown_connections 2023-08-31T19:04:24.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.187+0000 7fe8659ff700 1 -- 172.21.15.72:0/3361543179 wait complete. 2023-08-31T19:04:24.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.189+0000 7fe8659ff700 1 Processor -- start 2023-08-31T19:04:24.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.189+0000 7fe8659ff700 1 -- start start 2023-08-31T19:04:24.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.190+0000 7fe8659ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8600a9eb0 0x7fe86014c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:24.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.190+0000 7fe8659ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8600c5bf0 0x7fe8601488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:24.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.190+0000 7fe8659ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8601576d0 0x7fe8600ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:24.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.190+0000 7fe8659ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86014b3a0 con 0x7fe8600c5bf0 2023-08-31T19:04:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.190+0000 7fe8659ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86014c1e0 con 0x7fe8601576d0 2023-08-31T19:04:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.190+0000 7fe8659ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86014b5d0 con 0x7fe8600a9eb0 2023-08-31T19:04:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.190+0000 7fe85e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8600c5bf0 0x7fe8601488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.190+0000 7fe85e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8600c5bf0 0x7fe8601488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40682/0 (socket says 172.21.15.72:40682) 2023-08-31T19:04:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.190+0000 7fe85e7fc700 1 -- 172.21.15.72:0/3283830445 learned_addr learned my addr 172.21.15.72:0/3283830445 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.190+0000 7fe85f7fe700 1 --2- 172.21.15.72:0/3283830445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8601576d0 0x7fe8600ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.190+0000 7fe85effd700 1 --2- 172.21.15.72:0/3283830445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8600a9eb0 0x7fe86014c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.191+0000 7fe85e7fc700 1 -- 172.21.15.72:0/3283830445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8600a9eb0 msgr2=0x7fe86014c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.191+0000 7fe85e7fc700 1 --2- 172.21.15.72:0/3283830445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8600a9eb0 0x7fe86014c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.191+0000 7fe85e7fc700 1 -- 172.21.15.72:0/3283830445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8601576d0 msgr2=0x7fe8600ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.191+0000 7fe85e7fc700 1 --2- 172.21.15.72:0/3283830445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8601576d0 0x7fe8600ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.191+0000 7fe85e7fc700 1 -- 172.21.15.72:0/3283830445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe850009370 con 0x7fe8600c5bf0 2023-08-31T19:04:24.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.191+0000 7fe85e7fc700 1 --2- 172.21.15.72:0/3283830445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8600c5bf0 0x7fe8601488e0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7fe854007fd0 tx=0x7fe854007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:24.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.191+0000 7fe846ffd700 1 -- 172.21.15.72:0/3283830445 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85400ce10 con 0x7fe8600c5bf0 2023-08-31T19:04:24.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.191+0000 7fe846ffd700 1 -- 172.21.15.72:0/3283830445 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8540072e0 con 0x7fe8600c5bf0 2023-08-31T19:04:24.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.191+0000 7fe846ffd700 1 -- 172.21.15.72:0/3283830445 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8540056e0 con 0x7fe8600c5bf0 2023-08-31T19:04:24.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.191+0000 7fe8659ff700 1 -- 172.21.15.72:0/3283830445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86014b8b0 con 0x7fe8600c5bf0 2023-08-31T19:04:24.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.191+0000 7fe8659ff700 1 -- 172.21.15.72:0/3283830445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86014be70 con 0x7fe8600c5bf0 2023-08-31T19:04:24.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.193+0000 7fe8659ff700 1 -- 172.21.15.72:0/3283830445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86014c390 con 0x7fe8600c5bf0 2023-08-31T19:04:24.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.193+0000 7fe846ffd700 1 -- 172.21.15.72:0/3283830445 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 36) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fe854005a90 con 0x7fe8600c5bf0 2023-08-31T19:04:24.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.194+0000 7fe846ffd700 1 --2- 172.21.15.72:0/3283830445 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe84c05efc0 0x7fe84c061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:24.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.194+0000 7fe846ffd700 1 -- 172.21.15.72:0/3283830445 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6979+0+0 (secure 0 0 0) 0x7fe8540799d0 con 0x7fe8600c5bf0 2023-08-31T19:04:24.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.194+0000 7fe85effd700 1 -- 172.21.15.72:0/3283830445 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe84c05efc0 msgr2=0x7fe84c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:24.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.194+0000 7fe85effd700 1 --2- 172.21.15.72:0/3283830445 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe84c05efc0 0x7fe84c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:24.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.198+0000 7fe846ffd700 1 -- 172.21.15.72:0/3283830445 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe86014c390 con 0x7fe8600c5bf0 2023-08-31T19:04:24.267 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:24.267+0000 7fd303f74680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:04:24.303 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:04:24.310 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:04:24.347 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:24.347+0000 7f8dd4fe8680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:04:24.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.395+0000 7fe85effd700 1 -- 172.21.15.72:0/3283830445 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe84c05efc0 msgr2=0x7fe84c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:24.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.395+0000 7fe85effd700 1 --2- 172.21.15.72:0/3283830445 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe84c05efc0 0x7fe84c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:04:24.418 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:24.418+0000 7fd303f74680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:04:24.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.425+0000 7fe8659ff700 1 -- 172.21.15.72:0/3283830445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe86014c350 con 0x7fe8600c5bf0 2023-08-31T19:04:24.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.426+0000 7fe846ffd700 1 -- 172.21.15.72:0/3283830445 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fe85404a8e0 con 0x7fe8600c5bf0 2023-08-31T19:04:24.430 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:24.431 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5732,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1777836817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1777836817},{"type":"v1","addr":"172.21.15.146:6834","nonce":1777836817}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5735,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1865290147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1865290147},{"type":"v1","addr":"172.21.15.146:6835","nonce":1865290147}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2552241481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2552241481},{"type":"v1","addr":"172.21.15.72:6836","nonce":2552241481}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:04:03.992354+0000","modified":"2023-08-31T19:04:07.010012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6699},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6699":{"gid":6699,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/859098343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":859098343},{"type":"v1","addr":"172.21.15.72:6837","nonce":859098343}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-31T19:04:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.428+0000 7fe8659ff700 1 -- 172.21.15.72:0/3283830445 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe84c05efc0 msgr2=0x7fe84c061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.428+0000 7fe8659ff700 1 --2- 172.21.15.72:0/3283830445 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe84c05efc0 0x7fe84c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.428+0000 7fe8659ff700 1 -- 172.21.15.72:0/3283830445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8600c5bf0 msgr2=0x7fe8601488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.428+0000 7fe8659ff700 1 --2- 172.21.15.72:0/3283830445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8600c5bf0 0x7fe8601488e0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7fe854007fd0 tx=0x7fe854007df0).stop 2023-08-31T19:04:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.428+0000 7fe8659ff700 1 -- 172.21.15.72:0/3283830445 shutdown_connections 2023-08-31T19:04:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.428+0000 7fe8659ff700 1 --2- 172.21.15.72:0/3283830445 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe84c05efc0 0x7fe84c061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.428+0000 7fe8659ff700 1 --2- 172.21.15.72:0/3283830445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8601576d0 0x7fe8600ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.428+0000 7fe8659ff700 1 --2- 172.21.15.72:0/3283830445 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8600a9eb0 0x7fe86014c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.428+0000 7fe8659ff700 1 --2- 172.21.15.72:0/3283830445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8600c5bf0 0x7fe8601488e0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.428+0000 7fe8659ff700 1 -- 172.21.15.72:0/3283830445 >> 172.21.15.72:0/3283830445 conn(0x7fe8600c82e0 msgr2=0x7fe8600c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.428+0000 7fe8659ff700 1 -- 172.21.15.72:0/3283830445 shutdown_connections 2023-08-31T19:04:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.429+0000 7fe8659ff700 1 -- 172.21.15.72:0/3283830445 wait complete. 2023-08-31T19:04:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 40 2023-08-31T19:04:24.442 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:24.442+0000 7f8dd4fe8680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:04:24.446 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:04:24.550 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:24.550+0000 7fd303f74680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:04:24.591 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:24.591+0000 7f8dd4fe8680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:04:24.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.685+0000 7ff23edff700 1 Processor -- start 2023-08-31T19:04:24.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.685+0000 7ff23edff700 1 -- start start 2023-08-31T19:04:24.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.687+0000 7ff23edff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff2380a9eb0 0x7ff2380aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:24.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.687+0000 7ff23edff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2380c5bf0 0x7ff2380c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:24.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.687+0000 7ff23edff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff238156fc0 0x7ff238157450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:24.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.687+0000 7ff23edff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2380bfd00 con 0x7ff2380a9eb0 2023-08-31T19:04:24.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.687+0000 7ff23edff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2380c05a0 con 0x7ff238156fc0 2023-08-31T19:04:24.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.687+0000 7ff23edff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2380aaea0 con 0x7ff2380c5bf0 2023-08-31T19:04:24.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.687+0000 7ff23cb9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff2380a9eb0 0x7ff2380aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:24.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.687+0000 7ff23cb9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff2380a9eb0 0x7ff2380aa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40686/0 (socket says 172.21.15.72:40686) 2023-08-31T19:04:24.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.687+0000 7ff23cb9b700 1 -- 172.21.15.72:0/2918554979 learned_addr learned my addr 172.21.15.72:0/2918554979 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:24.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.687+0000 7ff237fff700 1 --2- 172.21.15.72:0/2918554979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2380c5bf0 0x7ff2380c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:24.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.687+0000 7ff23d39c700 1 --2- 172.21.15.72:0/2918554979 >> v2:172.21.15.146:3300/0 conn(0x7ff238156fc0 0x7ff238157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:24.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.688+0000 7ff23cb9b700 1 -- 172.21.15.72:0/2918554979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2380c5bf0 msgr2=0x7ff2380c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:24.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.688+0000 7ff23cb9b700 1 --2- 172.21.15.72:0/2918554979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2380c5bf0 0x7ff2380c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.688+0000 7ff23cb9b700 1 -- 172.21.15.72:0/2918554979 >> v2:172.21.15.146:3300/0 conn(0x7ff238156fc0 msgr2=0x7ff238157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:24.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.688+0000 7ff23cb9b700 1 --2- 172.21.15.72:0/2918554979 >> v2:172.21.15.146:3300/0 conn(0x7ff238156fc0 0x7ff238157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.688+0000 7ff23cb9b700 1 -- 172.21.15.72:0/2918554979 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2380c6670 con 0x7ff2380a9eb0 2023-08-31T19:04:24.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.688+0000 7ff237fff700 1 --2- 172.21.15.72:0/2918554979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2380c5bf0 0x7ff2380c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:24.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.688+0000 7ff23d39c700 1 --2- 172.21.15.72:0/2918554979 >> v2:172.21.15.146:3300/0 conn(0x7ff238156fc0 0x7ff238157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:24.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.688+0000 7ff23cb9b700 1 --2- 172.21.15.72:0/2918554979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2380a9eb0 0x7ff2380aa290 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7ff23806a9e0 tx=0x7ff22c0090f0).ready entity=mon.0 client_cookie=e75032f167440db7 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:24.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.688+0000 7ff2377fe700 1 -- 172.21.15.72:0/2918554979 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c00b600 con 0x7ff2380a9eb0 2023-08-31T19:04:24.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.688+0000 7ff2377fe700 1 -- 172.21.15.72:0/2918554979 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c00b760 con 0x7ff2380a9eb0 2023-08-31T19:04:24.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.688+0000 7ff2377fe700 1 -- 172.21.15.72:0/2918554979 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c00bae0 con 0x7ff2380a9eb0 2023-08-31T19:04:24.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.689+0000 7ff23edff700 1 -- 172.21.15.72:0/2918554979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2380a9eb0 msgr2=0x7ff2380aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:24.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.689+0000 7ff23edff700 1 --2- 172.21.15.72:0/2918554979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2380a9eb0 0x7ff2380aa290 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7ff23806a9e0 tx=0x7ff22c0090f0).stop 2023-08-31T19:04:24.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.689+0000 7ff23edff700 1 -- 172.21.15.72:0/2918554979 shutdown_connections 2023-08-31T19:04:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.689+0000 7ff23edff700 1 --2- 172.21.15.72:0/2918554979 >> v2:172.21.15.146:3300/0 conn(0x7ff238156fc0 0x7ff238157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.689+0000 7ff23edff700 1 --2- 172.21.15.72:0/2918554979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2380a9eb0 0x7ff2380aa290 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.689+0000 7ff23edff700 1 --2- 172.21.15.72:0/2918554979 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2380c5bf0 0x7ff2380c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.689+0000 7ff23edff700 1 -- 172.21.15.72:0/2918554979 >> 172.21.15.72:0/2918554979 conn(0x7ff2380c82e0 msgr2=0x7ff23805e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.689+0000 7ff23edff700 1 -- 172.21.15.72:0/2918554979 shutdown_connections 2023-08-31T19:04:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.689+0000 7ff23edff700 1 -- 172.21.15.72:0/2918554979 wait complete. 2023-08-31T19:04:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.690+0000 7ff23edff700 1 Processor -- start 2023-08-31T19:04:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.690+0000 7ff23edff700 1 -- start start 2023-08-31T19:04:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.691+0000 7ff23edff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2380a9eb0 0x7ff238145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.691+0000 7ff23edff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2380c5bf0 0x7ff238167e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:24.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.691+0000 7ff23edff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff238156fc0 0x7ff238168330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:24.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.691+0000 7ff23edff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff238168820 con 0x7ff238156fc0 2023-08-31T19:04:24.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.691+0000 7ff23edff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff238152340 con 0x7ff2380a9eb0 2023-08-31T19:04:24.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.691+0000 7ff23edff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff238145c50 con 0x7ff2380c5bf0 2023-08-31T19:04:24.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.692+0000 7ff23d39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff238156fc0 0x7ff238168330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.692+0000 7ff23d39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff238156fc0 0x7ff238168330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40692/0 (socket says 172.21.15.72:40692) 2023-08-31T19:04:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.692+0000 7ff23d39c700 1 -- 172.21.15.72:0/1492845190 learned_addr learned my addr 172.21.15.72:0/1492845190 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.692+0000 7ff23cb9b700 1 --2- 172.21.15.72:0/1492845190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2380a9eb0 0x7ff238145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.692+0000 7ff237fff700 1 --2- 172.21.15.72:0/1492845190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2380c5bf0 0x7ff238167e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.692+0000 7ff23d39c700 1 -- 172.21.15.72:0/1492845190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2380c5bf0 msgr2=0x7ff238167e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.692+0000 7ff23d39c700 1 --2- 172.21.15.72:0/1492845190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2380c5bf0 0x7ff238167e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.692+0000 7ff23d39c700 1 -- 172.21.15.72:0/1492845190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2380a9eb0 msgr2=0x7ff238145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.692+0000 7ff23d39c700 1 --2- 172.21.15.72:0/1492845190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2380a9eb0 0x7ff238145760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.692+0000 7ff23d39c700 1 -- 172.21.15.72:0/1492845190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c009370 con 0x7ff238156fc0 2023-08-31T19:04:24.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.692+0000 7ff23d39c700 1 --2- 172.21.15.72:0/1492845190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff238156fc0 0x7ff238168330 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7ff230007f30 tx=0x7ff230009930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:24.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.693+0000 7ff234ff9700 1 -- 172.21.15.72:0/1492845190 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23000db80 con 0x7ff238156fc0 2023-08-31T19:04:24.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.693+0000 7ff234ff9700 1 -- 172.21.15.72:0/1492845190 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23000f040 con 0x7ff238156fc0 2023-08-31T19:04:24.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.693+0000 7ff23edff700 1 -- 172.21.15.72:0/1492845190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff238154670 con 0x7ff238156fc0 2023-08-31T19:04:24.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.693+0000 7ff234ff9700 1 -- 172.21.15.72:0/1492845190 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2300133f0 con 0x7ff238156fc0 2023-08-31T19:04:24.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.693+0000 7ff23edff700 1 -- 172.21.15.72:0/1492845190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff238154a00 con 0x7ff238156fc0 2023-08-31T19:04:24.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.694+0000 7ff23edff700 1 -- 172.21.15.72:0/1492845190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23806c6b0 con 0x7ff238156fc0 2023-08-31T19:04:24.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.694+0000 7ff234ff9700 1 -- 172.21.15.72:0/1492845190 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 36) v1 ==== 75431+0+0 (secure 0 0 0) 0x7ff230013760 con 0x7ff238156fc0 2023-08-31T19:04:24.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.695+0000 7ff234ff9700 1 --2- 172.21.15.72:0/1492845190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff21c05efc0 0x7ff21c061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:24.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.696+0000 7ff234ff9700 1 -- 172.21.15.72:0/1492845190 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6979+0+0 (secure 0 0 0) 0x7ff23007aa90 con 0x7ff238156fc0 2023-08-31T19:04:24.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.696+0000 7ff23cb9b700 1 -- 172.21.15.72:0/1492845190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff21c05efc0 msgr2=0x7ff21c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:24.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.696+0000 7ff23cb9b700 1 --2- 172.21.15.72:0/1492845190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff21c05efc0 0x7ff21c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:24.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.699+0000 7ff234ff9700 1 -- 172.21.15.72:0/1492845190 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff23004b730 con 0x7ff238156fc0 2023-08-31T19:04:24.760 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:24.760+0000 7f8dd4fe8680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:04:24.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.897+0000 7ff23cb9b700 1 -- 172.21.15.72:0/1492845190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff21c05efc0 msgr2=0x7ff21c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:24.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.897+0000 7ff23cb9b700 1 --2- 172.21.15.72:0/1492845190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff21c05efc0 0x7ff21c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:04:24.904 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:24.904+0000 7fd303f74680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:04:24.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.909+0000 7ff23edff700 1 -- 172.21.15.72:0/1492845190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff238064f00 con 0x7ff238156fc0 2023-08-31T19:04:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.910+0000 7ff234ff9700 1 -- 172.21.15.72:0/1492845190 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18302 (secure 0 0 0) 0x7ff23004ed50 con 0x7ff238156fc0 2023-08-31T19:04:24.911 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:24.912 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":95,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:04:17.694700+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:04:02.410352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-31T19:04:02.966343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/2262253272":"2023-09-01T19:04:17.694660+0000","172.21.15.72:6833/143463":"2023-09-01T19:04:17.694660+0000","172.21.15.72:6832/143463":"2023-09-01T19:04:17.694660+0000","172.21.15.72:0/404249945":"2023-09-01T19:04:17.694660+0000","172.21.15.72:0/3249564216":"2023-09-01T19:04:17.694660+0000","172.21.15.72:0/4257999405":"2023-09-01T19:04:17.694660+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:04:24.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.913+0000 7ff23edff700 1 -- 172.21.15.72:0/1492845190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff21c05efc0 msgr2=0x7ff21c061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:24.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.913+0000 7ff23edff700 1 --2- 172.21.15.72:0/1492845190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff21c05efc0 0x7ff21c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:24.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.913+0000 7ff23edff700 1 -- 172.21.15.72:0/1492845190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff238156fc0 msgr2=0x7ff238168330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:24.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.913+0000 7ff23edff700 1 --2- 172.21.15.72:0/1492845190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff238156fc0 0x7ff238168330 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7ff230007f30 tx=0x7ff230009930).stop 2023-08-31T19:04:24.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.913+0000 7ff23edff700 1 -- 172.21.15.72:0/1492845190 shutdown_connections 2023-08-31T19:04:24.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.913+0000 7ff23edff700 1 --2- 172.21.15.72:0/1492845190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff238156fc0 0x7ff238168330 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.913+0000 7ff23edff700 1 --2- 172.21.15.72:0/1492845190 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff21c05efc0 0x7ff21c061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:24.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.913+0000 7ff23edff700 1 --2- 172.21.15.72:0/1492845190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2380a9eb0 0x7ff238145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.913+0000 7ff23edff700 1 --2- 172.21.15.72:0/1492845190 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2380c5bf0 0x7ff238167e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:24.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.913+0000 7ff23edff700 1 -- 172.21.15.72:0/1492845190 >> 172.21.15.72:0/1492845190 conn(0x7ff2380c82e0 msgr2=0x7ff2380c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:24.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.913+0000 7ff23edff700 1 -- 172.21.15.72:0/1492845190 shutdown_connections 2023-08-31T19:04:24.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:24.913+0000 7ff23edff700 1 -- 172.21.15.72:0/1492845190 wait complete. 2023-08-31T19:04:24.932 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T19:04:24.994 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:24.994+0000 7fd303f74680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:04:25.125 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:25.125+0000 7f8dd4fe8680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:04:25.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.133+0000 7f9fc5bff700 1 Processor -- start 2023-08-31T19:04:25.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.133+0000 7f9fc5bff700 1 -- start start 2023-08-31T19:04:25.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.134+0000 7f9fc5bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9fc0154450 0x7f9fc00bd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:25.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.134+0000 7f9fc5bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc00bcb90 con 0x7f9fc00a5f70 2023-08-31T19:04:25.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.134+0000 7f9fc5bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc00bbf80 con 0x7f9fc00c1910 2023-08-31T19:04:25.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.134+0000 7f9fc5bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc00bc260 con 0x7f9fc0154450 2023-08-31T19:04:25.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.134+0000 7f9fbeffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9fc00a5f70 0x7f9fc00a5560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34792/0 (socket says 172.21.15.72:34792) 2023-08-31T19:04:25.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.134+0000 7f9fbeffd700 1 -- 172.21.15.72:0/495105173 learned_addr learned my addr 172.21.15.72:0/495105173 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:25.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbf7fe700 1 --2- 172.21.15.72:0/495105173 >> v2:172.21.15.146:3300/0 conn(0x7f9fc0154450 0x7f9fc00bd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:25.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbe7fc700 1 -- 172.21.15.72:0/495105173 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984263579 0 0) 0x7f9fc00bcb90 con 0x7f9fc00a5f70 2023-08-31T19:04:25.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbe7fc700 1 -- 172.21.15.72:0/495105173 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fa80033f0 con 0x7f9fc00a5f70 2023-08-31T19:04:25.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbe7fc700 1 -- 172.21.15.72:0/495105173 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2725366017 0 0) 0x7f9fa80033f0 con 0x7f9fc00a5f70 2023-08-31T19:04:25.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbe7fc700 1 -- 172.21.15.72:0/495105173 >> v2:172.21.15.146:3300/0 conn(0x7f9fc0154450 msgr2=0x7f9fc00bd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:25.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbe7fc700 1 --2- 172.21.15.72:0/495105173 >> v2:172.21.15.146:3300/0 conn(0x7f9fc0154450 0x7f9fc00bd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:25.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbe7fc700 1 -- 172.21.15.72:0/495105173 >> v1:172.21.15.146:6789/0 conn(0x7f9fc00c1910 legacy=0x7f9fc00c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:25.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbe7fc700 1 -- 172.21.15.72:0/495105173 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc00bc540 con 0x7f9fc00a5f70 2023-08-31T19:04:25.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbe7fc700 1 -- 172.21.15.72:0/495105173 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f9fb4001470 con 0x7f9fc00a5f70 2023-08-31T19:04:25.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbf7fe700 1 --2- 172.21.15.72:0/495105173 >> v2:172.21.15.146:3300/0 conn(0x7f9fc0154450 0x7f9fc00bd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:04:25.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbe7fc700 1 -- 172.21.15.72:0/495105173 >> v1:172.21.15.72:6789/0 conn(0x7f9fc00a5f70 legacy=0x7f9fc00a5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:25.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbe7fc700 1 --2- 172.21.15.72:0/495105173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa80038e0 0x7f9fa8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:25.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbe7fc700 1 --2- 172.21.15.72:0/495105173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa8004690 0x7f9fa8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:25.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbe7fc700 1 --2- 172.21.15.72:0/495105173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fa8005000 0x7f9fa800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:25.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbe7fc700 1 -- 172.21.15.72:0/495105173 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc00bc260 con 0x7f9fa80038e0 2023-08-31T19:04:25.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbe7fc700 1 -- 172.21.15.72:0/495105173 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa800bf60 con 0x7f9fa8004690 2023-08-31T19:04:25.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.135+0000 7f9fbe7fc700 1 -- 172.21.15.72:0/495105173 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa800c0f0 con 0x7f9fa8005000 2023-08-31T19:04:25.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.136+0000 7f9fbf7fe700 1 --2- 172.21.15.72:0/495105173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa80038e0 0x7f9fa8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:25.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.136+0000 7f9fbeffd700 1 --2- 172.21.15.72:0/495105173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa8004690 0x7f9fa8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:25.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.136+0000 7f9fbffff700 1 --2- 172.21.15.72:0/495105173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fa8005000 0x7f9fa800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:25.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.136+0000 7f9fbf7fe700 1 -- 172.21.15.72:0/495105173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fa8005000 msgr2=0x7f9fa800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:25.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.136+0000 7f9fbf7fe700 1 --2- 172.21.15.72:0/495105173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fa8005000 0x7f9fa800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:25.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.136+0000 7f9fbf7fe700 1 -- 172.21.15.72:0/495105173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa8004690 msgr2=0x7f9fa8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:25.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.136+0000 7f9fbf7fe700 1 --2- 172.21.15.72:0/495105173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa8004690 0x7f9fa8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:25.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.136+0000 7f9fbf7fe700 1 -- 172.21.15.72:0/495105173 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80033f0 con 0x7f9fa80038e0 2023-08-31T19:04:25.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.136+0000 7f9fbffff700 1 -- 172.21.15.72:0/495105173 reap_dead start 2023-08-31T19:04:25.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.136+0000 7f9fbf7fe700 1 --2- 172.21.15.72:0/495105173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa80038e0 0x7f9fa8003d00 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f9fb0009c70 tx=0x7f9fb0009060).ready entity=mon.0 client_cookie=9c63c56d42e0861d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:25.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.136+0000 7f9fbe7fc700 1 -- 172.21.15.72:0/495105173 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb00095c0 con 0x7f9fa80038e0 2023-08-31T19:04:25.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.136+0000 7f9fbe7fc700 1 -- 172.21.15.72:0/495105173 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb000e6f0 con 0x7f9fa80038e0 2023-08-31T19:04:25.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.136+0000 7f9fbe7fc700 1 -- 172.21.15.72:0/495105173 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000ea70 con 0x7f9fa80038e0 2023-08-31T19:04:25.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.137+0000 7f9fc5bff700 1 -- 172.21.15.72:0/495105173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa80038e0 msgr2=0x7f9fa8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:25.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.137+0000 7f9fc5bff700 1 --2- 172.21.15.72:0/495105173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa80038e0 0x7f9fa8003d00 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f9fb0009c70 tx=0x7f9fb0009060).stop 2023-08-31T19:04:25.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.137+0000 7f9fc5bff700 1 -- 172.21.15.72:0/495105173 shutdown_connections 2023-08-31T19:04:25.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.137+0000 7f9fc5bff700 1 --2- 172.21.15.72:0/495105173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa80038e0 0x7f9fa8003d00 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:25.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.137+0000 7f9fc5bff700 1 -- 172.21.15.72:0/495105173 >> 172.21.15.72:0/495105173 conn(0x7f9fc0063120 msgr2=0x7f9fc00c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:25.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.137+0000 7f9fc5bff700 1 -- 172.21.15.72:0/495105173 shutdown_connections 2023-08-31T19:04:25.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.137+0000 7f9fc5bff700 1 -- 172.21.15.72:0/495105173 wait complete. 2023-08-31T19:04:25.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.139+0000 7f9fc5bff700 1 Processor -- start 2023-08-31T19:04:25.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.139+0000 7f9fc5bff700 1 -- start start 2023-08-31T19:04:25.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.140+0000 7f9fc5bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa80038e0 0x7f9fc01428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:25.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.140+0000 7f9fc5bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fc00ab1c0 0x7f9fc013fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:25.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.140+0000 7f9fc5bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fc01450c0 0x7f9fc0167d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:25.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.140+0000 7f9fc5bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0142d90 con 0x7f9fa80038e0 2023-08-31T19:04:25.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.140+0000 7f9fc5bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0141280 con 0x7f9fc01450c0 2023-08-31T19:04:25.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.140+0000 7f9fc5bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc0140670 con 0x7f9fc00ab1c0 2023-08-31T19:04:25.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.140+0000 7f9fbf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa80038e0 0x7f9fc01428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:25.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.140+0000 7f9fbf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa80038e0 0x7f9fc01428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40714/0 (socket says 172.21.15.72:40714) 2023-08-31T19:04:25.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.140+0000 7f9fbf7fe700 1 -- 172.21.15.72:0/1535272317 learned_addr learned my addr 172.21.15.72:0/1535272317 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:25.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.140+0000 7f9fbffff700 1 --2- 172.21.15.72:0/1535272317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fc01450c0 0x7f9fc0167d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:25.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.140+0000 7f9fbeffd700 1 --2- 172.21.15.72:0/1535272317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fc00ab1c0 0x7f9fc013fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:25.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.141+0000 7f9fbf7fe700 1 -- 172.21.15.72:0/1535272317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fc00ab1c0 msgr2=0x7f9fc013fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:25.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.141+0000 7f9fbf7fe700 1 --2- 172.21.15.72:0/1535272317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fc00ab1c0 0x7f9fc013fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:25.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.141+0000 7f9fbf7fe700 1 -- 172.21.15.72:0/1535272317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fc01450c0 msgr2=0x7f9fc0167d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:25.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.141+0000 7f9fbf7fe700 1 --2- 172.21.15.72:0/1535272317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fc01450c0 0x7f9fc0167d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:25.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.141+0000 7f9fbf7fe700 1 -- 172.21.15.72:0/1535272317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc0140950 con 0x7f9fa80038e0 2023-08-31T19:04:25.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.141+0000 7f9fbffff700 1 --2- 172.21.15.72:0/1535272317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fc01450c0 0x7f9fc0167d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:25.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.141+0000 7f9fbf7fe700 1 --2- 172.21.15.72:0/1535272317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa80038e0 0x7f9fc01428a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f9fb000e4b0 tx=0x7f9fb001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:25.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.141+0000 7f9fa77fe700 1 -- 172.21.15.72:0/1535272317 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000e860 con 0x7f9fa80038e0 2023-08-31T19:04:25.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.141+0000 7f9fa77fe700 1 -- 172.21.15.72:0/1535272317 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb000e9c0 con 0x7f9fa80038e0 2023-08-31T19:04:25.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.141+0000 7f9fc5bff700 1 -- 172.21.15.72:0/1535272317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc0140c30 con 0x7f9fa80038e0 2023-08-31T19:04:25.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.141+0000 7f9fa77fe700 1 -- 172.21.15.72:0/1535272317 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0024600 con 0x7f9fa80038e0 2023-08-31T19:04:25.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.141+0000 7f9fc5bff700 1 -- 172.21.15.72:0/1535272317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc0140310 con 0x7f9fa80038e0 2023-08-31T19:04:25.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.142+0000 7f9fc5bff700 1 -- 172.21.15.72:0/1535272317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc006c6b0 con 0x7f9fa80038e0 2023-08-31T19:04:25.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.143+0000 7f9fa77fe700 1 -- 172.21.15.72:0/1535272317 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 36) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f9fb0024a30 con 0x7f9fa80038e0 2023-08-31T19:04:25.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.144+0000 7f9fa77fe700 1 --2- 172.21.15.72:0/1535272317 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9fac05efc0 0x7f9fac061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:25.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.144+0000 7f9fa77fe700 1 -- 172.21.15.72:0/1535272317 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f9fb007bad0 con 0x7f9fa80038e0 2023-08-31T19:04:25.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.144+0000 7f9fbeffd700 1 -- 172.21.15.72:0/1535272317 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9fac05efc0 msgr2=0x7f9fac061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:25.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.144+0000 7f9fbeffd700 1 --2- 172.21.15.72:0/1535272317 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9fac05efc0 0x7f9fac061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:25.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.148+0000 7f9fa77fe700 1 -- 172.21.15.72:0/1535272317 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9fb004c930 con 0x7f9fa80038e0 2023-08-31T19:04:25.220 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:25.220+0000 7f8dd4fe8680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:04:25.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.231+0000 7f9fa77fe700 1 -- 172.21.15.72:0/1535272317 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 37) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f9fb0024ce0 con 0x7f9fa80038e0 2023-08-31T19:04:25.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.232+0000 7f9fa77fe700 1 -- 172.21.15.72:0/1535272317 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9fac05efc0 msgr2=0x7f9fac061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:25.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.232+0000 7f9fa77fe700 1 --2- 172.21.15.72:0/1535272317 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9fac05efc0 0x7f9fac061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:25.299 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:25.299+0000 7f8d4fb11700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:25.300 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:25.299+0000 7f8d4fb11700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:25.300 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:25.299+0000 7f8d4fb11700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:25.300 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:25.299+0000 7f8d4fb11700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:25.300 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:25.299+0000 7f8d4fb11700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:25.301 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:25.299+0000 7f8d4cacb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:25.301 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:25.299+0000 7f8d4cacb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:25.301 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:25.299+0000 7f8d4cacb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:25.301 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:25.299+0000 7f8d4cacb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:25.301 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:25.299+0000 7f8d4cacb700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:25.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:25.386+0000 7f9fc5bff700 1 -- 172.21.15.72:0/1535272317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9fc00bc820 con 0x7f9fa80038e0 2023-08-31T19:04:26.228 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-08-31T19:04:26.228+0000 7f89d2ff7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T19:04:26.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.232+0000 7f9fa77fe700 1 -- 172.21.15.72:0/1535272317 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9fb0029090 con 0x7f9fa80038e0 2023-08-31T19:04:26.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.235+0000 7f9fc5bff700 1 -- 172.21.15.72:0/1535272317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa80038e0 msgr2=0x7f9fc01428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:26.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.235+0000 7f9fc5bff700 1 --2- 172.21.15.72:0/1535272317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa80038e0 0x7f9fc01428a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f9fb000e4b0 tx=0x7f9fb001a000).stop 2023-08-31T19:04:26.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.235+0000 7f9fc5bff700 1 -- 172.21.15.72:0/1535272317 shutdown_connections 2023-08-31T19:04:26.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.235+0000 7f9fc5bff700 1 --2- 172.21.15.72:0/1535272317 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9fac05efc0 0x7f9fac061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:26.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.235+0000 7f9fc5bff700 1 --2- 172.21.15.72:0/1535272317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fc01450c0 0x7f9fc0167d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:26.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.235+0000 7f9fc5bff700 1 --2- 172.21.15.72:0/1535272317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa80038e0 0x7f9fc01428a0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:26.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.235+0000 7f9fc5bff700 1 --2- 172.21.15.72:0/1535272317 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9fc00ab1c0 0x7f9fc013fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:26.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.235+0000 7f9fc5bff700 1 -- 172.21.15.72:0/1535272317 >> 172.21.15.72:0/1535272317 conn(0x7f9fc0063120 msgr2=0x7f9fc00642f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:26.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.235+0000 7f9fc5bff700 1 -- 172.21.15.72:0/1535272317 shutdown_connections 2023-08-31T19:04:26.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.235+0000 7f9fc5bff700 1 -- 172.21.15.72:0/1535272317 wait complete. 2023-08-31T19:04:26.238 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T19:04:26.238 INFO:tasks.ceph.mds.a.smithi072.stderr: -1378> 2023-08-31T19:04:09.504+0000 7f255b1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:04:26.265 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T19:04:26.285 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T19:04:26.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.465+0000 7f3555fff700 1 Processor -- start 2023-08-31T19:04:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.465+0000 7f3555fff700 1 -- start start 2023-08-31T19:04:26.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.466+0000 7f3555fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f355014ecd0 0x7f35501556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.466+0000 7f3555fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35500c2320 0x7f35500c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.466+0000 7f3555fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3550152720 con 0x7f35500c1100 2023-08-31T19:04:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.466+0000 7f3555fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35500c2c90 con 0x7f35500c2320 2023-08-31T19:04:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.466+0000 7f3555fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355006a6b0 con 0x7f355014ecd0 2023-08-31T19:04:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.467+0000 7f354effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35500c2320 0x7f35500c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.467+0000 7f354effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35500c2320 0x7f35500c27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40808/0 (socket says 172.21.15.72:40808) 2023-08-31T19:04:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.467+0000 7f354effd700 1 -- 172.21.15.72:0/2558258742 learned_addr learned my addr 172.21.15.72:0/2558258742 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.467+0000 7f354f7fe700 1 --2- 172.21.15.72:0/2558258742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f355014ecd0 0x7f35501556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.467+0000 7f354effd700 1 -- 172.21.15.72:0/2558258742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f355014ecd0 msgr2=0x7f35501556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.467+0000 7f354effd700 1 --2- 172.21.15.72:0/2558258742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f355014ecd0 0x7f35501556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.467+0000 7f354effd700 1 -- 172.21.15.72:0/2558258742 >> v1:172.21.15.146:6789/0 conn(0x7f35500c1100 legacy=0x7f35500c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.467+0000 7f354effd700 1 -- 172.21.15.72:0/2558258742 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3550155bc0 con 0x7f35500c2320 2023-08-31T19:04:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.467+0000 7f354effd700 1 --2- 172.21.15.72:0/2558258742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35500c2320 0x7f35500c27a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f3544006fd0 tx=0x7f35440090f0).ready entity=mon.0 client_cookie=f4865e77f13283a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.467+0000 7f354e7fc700 1 -- 172.21.15.72:0/2558258742 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400b600 con 0x7f35500c2320 2023-08-31T19:04:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.467+0000 7f354e7fc700 1 -- 172.21.15.72:0/2558258742 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354400b760 con 0x7f35500c2320 2023-08-31T19:04:26.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.467+0000 7f354e7fc700 1 -- 172.21.15.72:0/2558258742 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400bae0 con 0x7f35500c2320 2023-08-31T19:04:26.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.468+0000 7f3555fff700 1 -- 172.21.15.72:0/2558258742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35500c2320 msgr2=0x7f35500c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:26.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.468+0000 7f3555fff700 1 --2- 172.21.15.72:0/2558258742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35500c2320 0x7f35500c27a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f3544006fd0 tx=0x7f35440090f0).stop 2023-08-31T19:04:26.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.468+0000 7f3555fff700 1 -- 172.21.15.72:0/2558258742 shutdown_connections 2023-08-31T19:04:26.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.468+0000 7f3555fff700 1 --2- 172.21.15.72:0/2558258742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f355014ecd0 0x7f35501556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:26.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.468+0000 7f3555fff700 1 --2- 172.21.15.72:0/2558258742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35500c2320 0x7f35500c27a0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:26.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.468+0000 7f3555fff700 1 -- 172.21.15.72:0/2558258742 >> 172.21.15.72:0/2558258742 conn(0x7f35500630c0 msgr2=0x7f35500c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:26.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.468+0000 7f3555fff700 1 -- 172.21.15.72:0/2558258742 shutdown_connections 2023-08-31T19:04:26.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.468+0000 7f3555fff700 1 -- 172.21.15.72:0/2558258742 wait complete. 2023-08-31T19:04:26.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.470+0000 7f3555fff700 1 Processor -- start 2023-08-31T19:04:26.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.470+0000 7f3555fff700 1 -- start start 2023-08-31T19:04:26.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f3555fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35500c1100 0x7f355014c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:26.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f3555fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35500c2320 0x7f35500c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:26.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f3555fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f355014ecd0 0x7f35500c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:26.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f3555fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355014cbf0 con 0x7f35500c1100 2023-08-31T19:04:26.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f3555fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35500aa540 con 0x7f355014ecd0 2023-08-31T19:04:26.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f3555fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35500a9c10 con 0x7f35500c2320 2023-08-31T19:04:26.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f354f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35500c1100 0x7f355014c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:26.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f354f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35500c1100 0x7f355014c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40818/0 (socket says 172.21.15.72:40818) 2023-08-31T19:04:26.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f354f7fe700 1 -- 172.21.15.72:0/3068101032 learned_addr learned my addr 172.21.15.72:0/3068101032 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:26.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f354f7fe700 1 -- 172.21.15.72:0/3068101032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35500c2320 msgr2=0x7f35500c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:26.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f354effd700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35500c2320 0x7f35500c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:26.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f354ffff700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f355014ecd0 0x7f35500c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:26.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f354f7fe700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35500c2320 0x7f35500c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:26.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f354f7fe700 1 -- 172.21.15.72:0/3068101032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f355014ecd0 msgr2=0x7f35500c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:26.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f354f7fe700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f355014ecd0 0x7f35500c15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:26.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f354f7fe700 1 -- 172.21.15.72:0/3068101032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3544009370 con 0x7f35500c1100 2023-08-31T19:04:26.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f354effd700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35500c2320 0x7f35500c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:26.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f354ffff700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f355014ecd0 0x7f35500c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:26.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.471+0000 7f354f7fe700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35500c1100 0x7f355014c700 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f354000d890 tx=0x7f3540008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:26.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.472+0000 7f35377fe700 1 -- 172.21.15.72:0/3068101032 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35400125f0 con 0x7f35500c1100 2023-08-31T19:04:26.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.472+0000 7f35377fe700 1 -- 172.21.15.72:0/3068101032 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3540012750 con 0x7f35500c1100 2023-08-31T19:04:26.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.472+0000 7f35377fe700 1 -- 172.21.15.72:0/3068101032 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540012ad0 con 0x7f35500c1100 2023-08-31T19:04:26.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.472+0000 7f3555fff700 1 -- 172.21.15.72:0/3068101032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35500a9ef0 con 0x7f35500c1100 2023-08-31T19:04:26.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.472+0000 7f3555fff700 1 -- 172.21.15.72:0/3068101032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35500c5620 con 0x7f35500c1100 2023-08-31T19:04:26.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.473+0000 7f3555fff700 1 -- 172.21.15.72:0/3068101032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355006c6b0 con 0x7f35500c1100 2023-08-31T19:04:26.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.474+0000 7f35377fe700 1 -- 172.21.15.72:0/3068101032 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f3540013480 con 0x7f35500c1100 2023-08-31T19:04:26.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.474+0000 7f35377fe700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f353c05ecf0 0x7f353c0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:26.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.474+0000 7f35377fe700 1 -- 172.21.15.72:0/3068101032 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7280+0+0 (secure 0 0 0) 0x7f354007a150 con 0x7f35500c1100 2023-08-31T19:04:26.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.475+0000 7f354effd700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f353c05ecf0 0x7f353c0611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:26.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.475+0000 7f354effd700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f353c05ecf0 0x7f353c0611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3544006fd0 tx=0x7f3544017000).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:26.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.478+0000 7f35377fe700 1 -- 172.21.15.72:0/3068101032 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f354004b2b0 con 0x7f35500c1100 2023-08-31T19:04:26.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:26.687+0000 7f3555fff700 1 -- 172.21.15.72:0/3068101032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f35500c7350 con 0x7f35500c1100 2023-08-31T19:04:27.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.246+0000 7f35377fe700 1 -- 172.21.15.72:0/3068101032 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7f354004e8d0 con 0x7f35500c1100 2023-08-31T19:04:27.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.249+0000 7f3555fff700 1 -- 172.21.15.72:0/3068101032 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f353c05ecf0 msgr2=0x7f353c0611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:27.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.249+0000 7f3555fff700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f353c05ecf0 0x7f353c0611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3544006fd0 tx=0x7f3544017000).stop 2023-08-31T19:04:27.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.249+0000 7f3555fff700 1 -- 172.21.15.72:0/3068101032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35500c1100 msgr2=0x7f355014c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:27.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.249+0000 7f3555fff700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35500c1100 0x7f355014c700 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f354000d890 tx=0x7f3540008040).stop 2023-08-31T19:04:27.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.249+0000 7f3555fff700 1 -- 172.21.15.72:0/3068101032 shutdown_connections 2023-08-31T19:04:27.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.249+0000 7f3555fff700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f353c05ecf0 0x7f353c0611b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:27.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.249+0000 7f3555fff700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f355014ecd0 0x7f35500c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:27.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.249+0000 7f3555fff700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35500c1100 0x7f355014c700 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:27.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.249+0000 7f3555fff700 1 --2- 172.21.15.72:0/3068101032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f35500c2320 0x7f35500c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:27.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.249+0000 7f3555fff700 1 -- 172.21.15.72:0/3068101032 >> 172.21.15.72:0/3068101032 conn(0x7f35500630c0 msgr2=0x7f35500bbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:27.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.249+0000 7f3555fff700 1 -- 172.21.15.72:0/3068101032 shutdown_connections 2023-08-31T19:04:27.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.249+0000 7f3555fff700 1 -- 172.21.15.72:0/3068101032 wait complete. 2023-08-31T19:04:27.268 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T19:04:27.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.502+0000 7f90b33ff700 1 Processor -- start 2023-08-31T19:04:27.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.502+0000 7f90b33ff700 1 -- start start 2023-08-31T19:04:27.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.503+0000 7f90b33ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90ac064d70 0x7f90ac1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:27.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.503+0000 7f90b33ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f90ac0c5370 0x7f90ac0bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:27.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.503+0000 7f90b33ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ac154f40 con 0x7f90ac151da0 2023-08-31T19:04:27.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.503+0000 7f90b33ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ac0c57e0 con 0x7f90ac0c5370 2023-08-31T19:04:27.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.503+0000 7f90b33ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac154960 con 0x7f90ac064d70 2023-08-31T19:04:27.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.504+0000 7f90b099a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90ac064d70 0x7f90ac1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:27.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.504+0000 7f90b199c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f90ac0c5370 0x7f90ac0bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:27.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.504+0000 7f90b199c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f90ac0c5370 0x7f90ac0bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:50732/0 (socket says 172.21.15.72:50732) 2023-08-31T19:04:27.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.504+0000 7f90b199c700 1 -- 172.21.15.72:0/3416847065 learned_addr learned my addr 172.21.15.72:0/3416847065 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:27.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.505+0000 7f90b199c700 1 -- 172.21.15.72:0/3416847065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90ac064d70 msgr2=0x7f90ac1553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:27.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.505+0000 7f90b199c700 1 --2- 172.21.15.72:0/3416847065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90ac064d70 0x7f90ac1553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:27.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.505+0000 7f90b199c700 1 -- 172.21.15.72:0/3416847065 >> v1:172.21.15.146:6789/0 conn(0x7f90ac151da0 legacy=0x7f90ac064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:27.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.505+0000 7f90b199c700 1 -- 172.21.15.72:0/3416847065 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac0aa2c0 con 0x7f90ac0c5370 2023-08-31T19:04:27.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.505+0000 7f90a3fff700 1 -- 172.21.15.72:0/3416847065 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305552118 0 0) 0x7f90ac154f40 con 0x7f90ac151da0 2023-08-31T19:04:27.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.505+0000 7f90b199c700 1 --2- 172.21.15.72:0/3416847065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90ac0c5370 0x7f90ac0bfcd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f90a4009f20 tx=0x7f90a4009840).ready entity=mon.1 client_cookie=8baff065e8e20a50 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:27.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.505+0000 7f90a3fff700 1 -- 172.21.15.72:0/3416847065 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a400e070 con 0x7f90ac0c5370 2023-08-31T19:04:27.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.505+0000 7f90a3fff700 1 -- 172.21.15.72:0/3416847065 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a400b9d0 con 0x7f90ac0c5370 2023-08-31T19:04:27.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.505+0000 7f90a3fff700 1 -- 172.21.15.72:0/3416847065 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a400bd50 con 0x7f90ac0c5370 2023-08-31T19:04:27.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.506+0000 7f90b33ff700 1 -- 172.21.15.72:0/3416847065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90ac0c5370 msgr2=0x7f90ac0bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:27.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.506+0000 7f90b33ff700 1 --2- 172.21.15.72:0/3416847065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90ac0c5370 0x7f90ac0bfcd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f90a4009f20 tx=0x7f90a4009840).stop 2023-08-31T19:04:27.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.506+0000 7f90b33ff700 1 -- 172.21.15.72:0/3416847065 shutdown_connections 2023-08-31T19:04:27.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.506+0000 7f90b33ff700 1 --2- 172.21.15.72:0/3416847065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90ac0c5370 0x7f90ac0bfcd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:27.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.506+0000 7f90b33ff700 1 --2- 172.21.15.72:0/3416847065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90ac064d70 0x7f90ac1553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:27.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.506+0000 7f90b33ff700 1 -- 172.21.15.72:0/3416847065 >> 172.21.15.72:0/3416847065 conn(0x7f90ac063a90 msgr2=0x7f90ac0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:27.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.506+0000 7f90b33ff700 1 -- 172.21.15.72:0/3416847065 shutdown_connections 2023-08-31T19:04:27.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.506+0000 7f90b33ff700 1 -- 172.21.15.72:0/3416847065 wait complete. 2023-08-31T19:04:27.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.507+0000 7f90b33ff700 1 Processor -- start 2023-08-31T19:04:27.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.507+0000 7f90b33ff700 1 -- start start 2023-08-31T19:04:27.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.508+0000 7f90b33ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90ac064d70 0x7f90ac14ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:27.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.508+0000 7f90b33ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ac0c5370 0x7f90ac140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:27.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.508+0000 7f90b33ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90ac151da0 0x7f90ac156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:27.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.508+0000 7f90b33ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac14f540 con 0x7f90ac0c5370 2023-08-31T19:04:27.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.508+0000 7f90b33ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac158cb0 con 0x7f90ac151da0 2023-08-31T19:04:27.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.508+0000 7f90b33ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac1580a0 con 0x7f90ac064d70 2023-08-31T19:04:27.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.508+0000 7f90b099a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ac0c5370 0x7f90ac140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:27.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.509+0000 7f90b099a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ac0c5370 0x7f90ac140760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40826/0 (socket says 172.21.15.72:40826) 2023-08-31T19:04:27.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.509+0000 7f90b099a700 1 -- 172.21.15.72:0/2520421408 learned_addr learned my addr 172.21.15.72:0/2520421408 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:27.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.509+0000 7f90b199c700 1 --2- 172.21.15.72:0/2520421408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90ac151da0 0x7f90ac156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:27.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.509+0000 7f90b119b700 1 --2- 172.21.15.72:0/2520421408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90ac064d70 0x7f90ac14ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:27.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.509+0000 7f90b099a700 1 -- 172.21.15.72:0/2520421408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90ac064d70 msgr2=0x7f90ac14ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:27.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.509+0000 7f90b099a700 1 --2- 172.21.15.72:0/2520421408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90ac064d70 0x7f90ac14ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:27.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.509+0000 7f90b099a700 1 -- 172.21.15.72:0/2520421408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90ac151da0 msgr2=0x7f90ac156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:27.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.509+0000 7f90b099a700 1 --2- 172.21.15.72:0/2520421408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90ac151da0 0x7f90ac156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:27.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.509+0000 7f90b099a700 1 -- 172.21.15.72:0/2520421408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a4009ae0 con 0x7f90ac0c5370 2023-08-31T19:04:27.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.509+0000 7f90b099a700 1 --2- 172.21.15.72:0/2520421408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ac0c5370 0x7f90ac140760 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f909c00e900 tx=0x7f909c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:27.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.509+0000 7f90a17fa700 1 -- 172.21.15.72:0/2520421408 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c012600 con 0x7f90ac0c5370 2023-08-31T19:04:27.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.509+0000 7f90a17fa700 1 -- 172.21.15.72:0/2520421408 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c012760 con 0x7f90ac0c5370 2023-08-31T19:04:27.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.509+0000 7f90b33ff700 1 -- 172.21.15.72:0/2520421408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ac158380 con 0x7f90ac0c5370 2023-08-31T19:04:27.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.509+0000 7f90a17fa700 1 -- 172.21.15.72:0/2520421408 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c012ae0 con 0x7f90ac0c5370 2023-08-31T19:04:27.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.510+0000 7f90b33ff700 1 -- 172.21.15.72:0/2520421408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ac158940 con 0x7f90ac0c5370 2023-08-31T19:04:27.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.511+0000 7f90b33ff700 1 -- 172.21.15.72:0/2520421408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ac06a7e0 con 0x7f90ac0c5370 2023-08-31T19:04:27.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.511+0000 7f90a17fa700 1 -- 172.21.15.72:0/2520421408 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 38) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f909c01b400 con 0x7f90ac0c5370 2023-08-31T19:04:27.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.512+0000 7f90a17fa700 1 --2- 172.21.15.72:0/2520421408 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f909005ecf0 0x7f90900611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:27.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.512+0000 7f90a17fa700 1 -- 172.21.15.72:0/2520421408 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7280+0+0 (secure 0 0 0) 0x7f909c07a380 con 0x7f90ac0c5370 2023-08-31T19:04:27.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.513+0000 7f90b119b700 1 --2- 172.21.15.72:0/2520421408 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f909005ecf0 0x7f90900611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:27.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.513+0000 7f90b119b700 1 --2- 172.21.15.72:0/2520421408 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f909005ecf0 0x7f90900611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f90a8007fd0 tx=0x7f90a8007bb0).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:27.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.517+0000 7f90a17fa700 1 -- 172.21.15.72:0/2520421408 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f909c04b3f0 con 0x7f90ac0c5370 2023-08-31T19:04:27.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.689+0000 7f90b33ff700 1 -- 172.21.15.72:0/2520421408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f90ac06c6b0 con 0x7f90ac0c5370 2023-08-31T19:04:27.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:27.757+0000 7f90a17fa700 1 -- 172.21.15.72:0/2520421408 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f909c077db0 con 0x7f90ac0c5370 2023-08-31T19:04:28.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.251+0000 7f90a17fa700 1 -- 172.21.15.72:0/2520421408 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v99) v1 ==== 181+0+0 (secure 0 0 0) 0x7f909c070320 con 0x7f90ac0c5370 2023-08-31T19:04:28.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.257+0000 7f90b33ff700 1 -- 172.21.15.72:0/2520421408 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f909005ecf0 msgr2=0x7f90900611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:28.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.257+0000 7f90b33ff700 1 --2- 172.21.15.72:0/2520421408 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f909005ecf0 0x7f90900611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f90a8007fd0 tx=0x7f90a8007bb0).stop 2023-08-31T19:04:28.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.257+0000 7f90b33ff700 1 -- 172.21.15.72:0/2520421408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ac0c5370 msgr2=0x7f90ac140760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:28.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.257+0000 7f90b33ff700 1 --2- 172.21.15.72:0/2520421408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ac0c5370 0x7f90ac140760 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f909c00e900 tx=0x7f909c009060).stop 2023-08-31T19:04:28.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.257+0000 7f90b33ff700 1 -- 172.21.15.72:0/2520421408 shutdown_connections 2023-08-31T19:04:28.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.257+0000 7f90b33ff700 1 --2- 172.21.15.72:0/2520421408 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f909005ecf0 0x7f90900611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:28.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.257+0000 7f90b33ff700 1 --2- 172.21.15.72:0/2520421408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90ac151da0 0x7f90ac156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:28.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.257+0000 7f90b33ff700 1 --2- 172.21.15.72:0/2520421408 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f90ac064d70 0x7f90ac14ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:28.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.257+0000 7f90b33ff700 1 --2- 172.21.15.72:0/2520421408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ac0c5370 0x7f90ac140760 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:28.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.257+0000 7f90b33ff700 1 -- 172.21.15.72:0/2520421408 >> 172.21.15.72:0/2520421408 conn(0x7f90ac063a90 msgr2=0x7f90ac064660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:28.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.257+0000 7f90b33ff700 1 -- 172.21.15.72:0/2520421408 shutdown_connections 2023-08-31T19:04:28.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.258+0000 7f90b33ff700 1 -- 172.21.15.72:0/2520421408 wait complete. 2023-08-31T19:04:28.260 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-08-31T19:04:28.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T19:04:28.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.472+0000 7f05305ff700 1 Processor -- start 2023-08-31T19:04:28.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.472+0000 7f05305ff700 1 -- start start 2023-08-31T19:04:28.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.473+0000 7f05305ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f05280c5aa0 0x7f05280653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:28.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.473+0000 7f05305ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f052813d960 0x7f0528067a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:28.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.473+0000 7f05305ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05280c4f90 con 0x7f05280c4bb0 2023-08-31T19:04:28.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.474+0000 7f05305ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05280c6020 con 0x7f05280c5aa0 2023-08-31T19:04:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.474+0000 7f05305ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05281587f0 con 0x7f052813d960 2023-08-31T19:04:28.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.474+0000 7f052db9a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f05280c5aa0 0x7f05280653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.474+0000 7f052eb9c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f052813d960 0x7f0528067a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.474+0000 7f052db9a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f05280c5aa0 0x7f05280653d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:50754/0 (socket says 172.21.15.72:50754) 2023-08-31T19:04:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.474+0000 7f052e39b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f05280c4bb0 0x7f05280c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:39882/0 (socket says 172.21.15.72:39882) 2023-08-31T19:04:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.474+0000 7f052eb9c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f052813d960 0x7f0528067a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:45122/0 (socket says 172.21.15.72:45122) 2023-08-31T19:04:28.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.474+0000 7f052e39b700 1 -- 172.21.15.72:0/1574028004 learned_addr learned my addr 172.21.15.72:0/1574028004 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.475+0000 7f052db9a700 1 -- 172.21.15.72:0/1574028004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f052813d960 msgr2=0x7f0528067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.475+0000 7f052db9a700 1 --2- 172.21.15.72:0/1574028004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f052813d960 0x7f0528067a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.475+0000 7f052d399700 1 -- 172.21.15.72:0/1574028004 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269577499 0 0) 0x7f05280c4f90 con 0x7f05280c4bb0 2023-08-31T19:04:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.475+0000 7f052db9a700 1 -- 172.21.15.72:0/1574028004 >> v1:172.21.15.146:6789/0 conn(0x7f05280c4bb0 legacy=0x7f05280c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.475+0000 7f052db9a700 1 -- 172.21.15.72:0/1574028004 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528158ad0 con 0x7f05280c5aa0 2023-08-31T19:04:28.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.475+0000 7f052db9a700 1 --2- 172.21.15.72:0/1574028004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05280c5aa0 0x7f05280653d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f0518009760 tx=0x7f0518009060).ready entity=mon.1 client_cookie=77f67cf04f30f251 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:28.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.475+0000 7f052d399700 1 -- 172.21.15.72:0/1574028004 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051800f510 con 0x7f05280c5aa0 2023-08-31T19:04:28.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.475+0000 7f052d399700 1 -- 172.21.15.72:0/1574028004 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051800f670 con 0x7f05280c5aa0 2023-08-31T19:04:28.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.475+0000 7f052d399700 1 -- 172.21.15.72:0/1574028004 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051800f9f0 con 0x7f05280c5aa0 2023-08-31T19:04:28.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.476+0000 7f05305ff700 1 -- 172.21.15.72:0/1574028004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05280c5aa0 msgr2=0x7f05280653d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.476+0000 7f05305ff700 1 --2- 172.21.15.72:0/1574028004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05280c5aa0 0x7f05280653d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f0518009760 tx=0x7f0518009060).stop 2023-08-31T19:04:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.476+0000 7f05305ff700 1 -- 172.21.15.72:0/1574028004 shutdown_connections 2023-08-31T19:04:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.476+0000 7f05305ff700 1 --2- 172.21.15.72:0/1574028004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f052813d960 0x7f0528067a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.476+0000 7f05305ff700 1 --2- 172.21.15.72:0/1574028004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05280c5aa0 0x7f05280653d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.476+0000 7f05305ff700 1 -- 172.21.15.72:0/1574028004 >> 172.21.15.72:0/1574028004 conn(0x7f0528066350 msgr2=0x7f0528066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:28.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.476+0000 7f05305ff700 1 -- 172.21.15.72:0/1574028004 shutdown_connections 2023-08-31T19:04:28.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.476+0000 7f05305ff700 1 -- 172.21.15.72:0/1574028004 wait complete. 2023-08-31T19:04:28.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.478+0000 7f05305ff700 1 Processor -- start 2023-08-31T19:04:28.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.478+0000 7f05305ff700 1 -- start start 2023-08-31T19:04:28.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.479+0000 7f05305ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05280c4bb0 0x7f05280a9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:28.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.479+0000 7f05305ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05280c5aa0 0x7f0528139970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:28.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.479+0000 7f05305ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052813d960 0x7f05280c1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:28.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.479+0000 7f05305ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05280a9a60 con 0x7f052813d960 2023-08-31T19:04:28.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.479+0000 7f05305ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05280aa3e0 con 0x7f05280c4bb0 2023-08-31T19:04:28.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.479+0000 7f05305ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05280c2100 con 0x7f05280c5aa0 2023-08-31T19:04:28.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.479+0000 7f052eb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052813d960 0x7f05280c1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:28.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.479+0000 7f052eb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052813d960 0x7f05280c1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40828/0 (socket says 172.21.15.72:40828) 2023-08-31T19:04:28.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.479+0000 7f052eb9c700 1 -- 172.21.15.72:0/3950530426 learned_addr learned my addr 172.21.15.72:0/3950530426 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:28.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.479+0000 7f052e39b700 1 --2- 172.21.15.72:0/3950530426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05280c4bb0 0x7f05280a9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:28.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.479+0000 7f052db9a700 1 --2- 172.21.15.72:0/3950530426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05280c5aa0 0x7f0528139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:28.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.479+0000 7f052eb9c700 1 -- 172.21.15.72:0/3950530426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05280c5aa0 msgr2=0x7f0528139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:28.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.479+0000 7f052eb9c700 1 --2- 172.21.15.72:0/3950530426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05280c5aa0 0x7f0528139970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:28.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.480+0000 7f052eb9c700 1 -- 172.21.15.72:0/3950530426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05280c4bb0 msgr2=0x7f05280a9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:28.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.480+0000 7f052eb9c700 1 --2- 172.21.15.72:0/3950530426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05280c4bb0 0x7f05280a9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:28.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.480+0000 7f052eb9c700 1 -- 172.21.15.72:0/3950530426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05180092a0 con 0x7f052813d960 2023-08-31T19:04:28.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.480+0000 7f052eb9c700 1 --2- 172.21.15.72:0/3950530426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052813d960 0x7f05280c1660 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f0520009df0 tx=0x7f052000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:28.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.480+0000 7f051e7fc700 1 -- 172.21.15.72:0/3950530426 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052000caa0 con 0x7f052813d960 2023-08-31T19:04:28.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.480+0000 7f051e7fc700 1 -- 172.21.15.72:0/3950530426 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052000f040 con 0x7f052813d960 2023-08-31T19:04:28.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.480+0000 7f051e7fc700 1 -- 172.21.15.72:0/3950530426 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052000ce10 con 0x7f052813d960 2023-08-31T19:04:28.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.480+0000 7f05305ff700 1 -- 172.21.15.72:0/3950530426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05280a9410 con 0x7f052813d960 2023-08-31T19:04:28.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.480+0000 7f05305ff700 1 -- 172.21.15.72:0/3950530426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05280aade0 con 0x7f052813d960 2023-08-31T19:04:28.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.481+0000 7f05305ff700 1 -- 172.21.15.72:0/3950530426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05280a9bd0 con 0x7f052813d960 2023-08-31T19:04:28.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.482+0000 7f051e7fc700 1 -- 172.21.15.72:0/3950530426 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0520013610 con 0x7f052813d960 2023-08-31T19:04:28.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.483+0000 7f051e7fc700 1 --2- 172.21.15.72:0/3950530426 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f050c05ef30 0x7f050c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:28.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.483+0000 7f051e7fc700 1 -- 172.21.15.72:0/3950530426 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6842+0+0 (secure 0 0 0) 0x7f052007aa80 con 0x7f052813d960 2023-08-31T19:04:28.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.484+0000 7f052e39b700 1 --2- 172.21.15.72:0/3950530426 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f050c05ef30 0x7f050c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:28.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.484+0000 7f052e39b700 1 --2- 172.21.15.72:0/3950530426 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f050c05ef30 0x7f050c0613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0524007fd0 tx=0x7f0524007dd0).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:28.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.488+0000 7f051e7fc700 1 -- 172.21.15.72:0/3950530426 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f052004b9e0 con 0x7f052813d960 2023-08-31T19:04:28.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:28.659+0000 7f05305ff700 1 -- 172.21.15.72:0/3950530426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f052806c6b0 con 0x7f052813d960 2023-08-31T19:04:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.495+0000 7f051e7fc700 1 -- 172.21.15.72:0/3950530426 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v100) v1 ==== 169+0+0 (secure 0 0 0) 0x7f052004f000 con 0x7f052813d960 2023-08-31T19:04:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.499+0000 7f05305ff700 1 -- 172.21.15.72:0/3950530426 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f050c05ef30 msgr2=0x7f050c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.499+0000 7f05305ff700 1 --2- 172.21.15.72:0/3950530426 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f050c05ef30 0x7f050c0613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0524007fd0 tx=0x7f0524007dd0).stop 2023-08-31T19:04:29.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.499+0000 7f05305ff700 1 -- 172.21.15.72:0/3950530426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052813d960 msgr2=0x7f05280c1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:29.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.499+0000 7f05305ff700 1 --2- 172.21.15.72:0/3950530426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052813d960 0x7f05280c1660 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f0520009df0 tx=0x7f052000b040).stop 2023-08-31T19:04:29.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.499+0000 7f05305ff700 1 -- 172.21.15.72:0/3950530426 shutdown_connections 2023-08-31T19:04:29.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.499+0000 7f05305ff700 1 --2- 172.21.15.72:0/3950530426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052813d960 0x7f05280c1660 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:29.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.499+0000 7f05305ff700 1 --2- 172.21.15.72:0/3950530426 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f050c05ef30 0x7f050c0613f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:29.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.499+0000 7f05305ff700 1 --2- 172.21.15.72:0/3950530426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f05280c4bb0 0x7f05280a9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:29.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.499+0000 7f05305ff700 1 --2- 172.21.15.72:0/3950530426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f05280c5aa0 0x7f0528139970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:29.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.499+0000 7f05305ff700 1 -- 172.21.15.72:0/3950530426 >> 172.21.15.72:0/3950530426 conn(0x7f0528066350 msgr2=0x7f052813a790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:29.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.500+0000 7f05305ff700 1 -- 172.21.15.72:0/3950530426 shutdown_connections 2023-08-31T19:04:29.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.500+0000 7f05305ff700 1 -- 172.21.15.72:0/3950530426 wait complete. 2023-08-31T19:04:29.502 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-08-31T19:04:29.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-31T19:04:29.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.712+0000 7f750b7ff700 1 Processor -- start 2023-08-31T19:04:29.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.712+0000 7f750b7ff700 1 -- start start 2023-08-31T19:04:29.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.713+0000 7f750b7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75040658d0 0x7f7504065d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:29.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.713+0000 7f750b7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7504158720 con 0x7f7504154520 2023-08-31T19:04:29.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.713+0000 7f750b7ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7504066240 con 0x7f7504154140 2023-08-31T19:04:29.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.713+0000 7f750b7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7504157e30 con 0x7f75040658d0 2023-08-31T19:04:29.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.714+0000 7f7509d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7504154520 0x7f7504154990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34802/0 (socket says 172.21.15.72:34802) 2023-08-31T19:04:29.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.714+0000 7f7508d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75040658d0 0x7f7504065d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:29.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.714+0000 7f7509d9c700 1 -- 172.21.15.72:0/2261134936 learned_addr learned my addr 172.21.15.72:0/2261134936 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:29.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.714+0000 7f74fbfff700 1 -- 172.21.15.72:0/2261134936 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485276274 0 0) 0x7f7504158720 con 0x7f7504154520 2023-08-31T19:04:29.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.714+0000 7f7508d9a700 1 -- 172.21.15.72:0/2261134936 >> v1:172.21.15.146:6789/0 conn(0x7f7504154140 legacy=0x7f75040a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:29.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.714+0000 7f7508d9a700 1 -- 172.21.15.72:0/2261134936 >> v1:172.21.15.72:6789/0 conn(0x7f7504154520 legacy=0x7f7504154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:29.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.714+0000 7f7508d9a700 1 -- 172.21.15.72:0/2261134936 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75040c45f0 con 0x7f75040658d0 2023-08-31T19:04:29.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.714+0000 7f7508d9a700 1 --2- 172.21.15.72:0/2261134936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75040658d0 0x7f7504065d50 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f74f4009760 tx=0x7f74f4009060).ready entity=mon.0 client_cookie=535a1213af4a903b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:29.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.715+0000 7f74fbfff700 1 -- 172.21.15.72:0/2261134936 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f400b580 con 0x7f75040658d0 2023-08-31T19:04:29.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.715+0000 7f74fbfff700 1 -- 172.21.15.72:0/2261134936 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f400b6e0 con 0x7f75040658d0 2023-08-31T19:04:29.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.715+0000 7f74fbfff700 1 -- 172.21.15.72:0/2261134936 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f400ba60 con 0x7f75040658d0 2023-08-31T19:04:29.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.715+0000 7f750b7ff700 1 -- 172.21.15.72:0/2261134936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75040658d0 msgr2=0x7f7504065d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:29.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.715+0000 7f750b7ff700 1 --2- 172.21.15.72:0/2261134936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75040658d0 0x7f7504065d50 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f74f4009760 tx=0x7f74f4009060).stop 2023-08-31T19:04:29.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.715+0000 7f750b7ff700 1 -- 172.21.15.72:0/2261134936 shutdown_connections 2023-08-31T19:04:29.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.715+0000 7f750b7ff700 1 --2- 172.21.15.72:0/2261134936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75040658d0 0x7f7504065d50 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:29.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.715+0000 7f750b7ff700 1 -- 172.21.15.72:0/2261134936 >> 172.21.15.72:0/2261134936 conn(0x7f75040c7910 msgr2=0x7f75040c38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:29.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.715+0000 7f750b7ff700 1 -- 172.21.15.72:0/2261134936 shutdown_connections 2023-08-31T19:04:29.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.715+0000 7f750b7ff700 1 -- 172.21.15.72:0/2261134936 wait complete. 2023-08-31T19:04:29.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.717+0000 7f750b7ff700 1 Processor -- start 2023-08-31T19:04:29.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.717+0000 7f750b7ff700 1 -- start start 2023-08-31T19:04:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f750b7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75040658d0 0x7f75040a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f750b7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7504154140 0x7f75040be980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f750b7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7504154520 0x7f7504068f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f750b7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75040bfc30 con 0x7f7504154520 2023-08-31T19:04:29.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f750b7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75040bf020 con 0x7f75040658d0 2023-08-31T19:04:29.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f750b7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75040bf300 con 0x7f7504154140 2023-08-31T19:04:29.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f7509d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7504154520 0x7f7504068f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:29.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f7509d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7504154520 0x7f7504068f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40846/0 (socket says 172.21.15.72:40846) 2023-08-31T19:04:29.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f7509d9c700 1 -- 172.21.15.72:0/3384240677 learned_addr learned my addr 172.21.15.72:0/3384240677 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f7509d9c700 1 -- 172.21.15.72:0/3384240677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7504154140 msgr2=0x7f75040be980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f7508d9a700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7504154140 0x7f75040be980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f750959b700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75040658d0 0x7f75040a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f7509d9c700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7504154140 0x7f75040be980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f7509d9c700 1 -- 172.21.15.72:0/3384240677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75040658d0 msgr2=0x7f75040a9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f7509d9c700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75040658d0 0x7f75040a9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:29.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f7509d9c700 1 -- 172.21.15.72:0/3384240677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f40092a0 con 0x7f7504154520 2023-08-31T19:04:29.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f7508d9a700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7504154140 0x7f75040be980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:29.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.718+0000 7f750959b700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75040658d0 0x7f75040a9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:29.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.719+0000 7f7509d9c700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7504154520 0x7f7504068f70 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f74fc00c730 tx=0x7f74fc001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:29.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.719+0000 7f74f97fa700 1 -- 172.21.15.72:0/3384240677 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc005d30 con 0x7f7504154520 2023-08-31T19:04:29.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.719+0000 7f74f97fa700 1 -- 172.21.15.72:0/3384240677 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc005e90 con 0x7f7504154520 2023-08-31T19:04:29.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.719+0000 7f750b7ff700 1 -- 172.21.15.72:0/3384240677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75040bf5e0 con 0x7f7504154520 2023-08-31T19:04:29.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.719+0000 7f74f97fa700 1 -- 172.21.15.72:0/3384240677 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc007340 con 0x7f7504154520 2023-08-31T19:04:29.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.719+0000 7f750b7ff700 1 -- 172.21.15.72:0/3384240677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7504069460 con 0x7f7504154520 2023-08-31T19:04:29.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.720+0000 7f750b7ff700 1 -- 172.21.15.72:0/3384240677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750406c6b0 con 0x7f7504154520 2023-08-31T19:04:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.721+0000 7f74f97fa700 1 -- 172.21.15.72:0/3384240677 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f74fc0076f0 con 0x7f7504154520 2023-08-31T19:04:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.722+0000 7f74f97fa700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f74e805ef00 0x7f74e80613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.722+0000 7f74f97fa700 1 -- 172.21.15.72:0/3384240677 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f74fc07a160 con 0x7f7504154520 2023-08-31T19:04:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.722+0000 7f750959b700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f74e805ef00 0x7f74e80613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.723+0000 7f750959b700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f74e805ef00 0x7f74e80613c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7500001710 tx=0x7f7500009040).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.726+0000 7f74f97fa700 1 -- 172.21.15.72:0/3384240677 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f74fc04b260 con 0x7f7504154520 2023-08-31T19:04:29.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.896+0000 7f750b7ff700 1 -- 172.21.15.72:0/3384240677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f75041580d0 con 0x7f7504154520 2023-08-31T19:04:29.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.900+0000 7f74f97fa700 1 -- 172.21.15.72:0/3384240677 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v16) v1 ==== 120+0+0 (secure 0 0 0) 0x7f74fc0079a0 con 0x7f7504154520 2023-08-31T19:04:29.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.903+0000 7f750b7ff700 1 -- 172.21.15.72:0/3384240677 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f74e805ef00 msgr2=0x7f74e80613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:29.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.903+0000 7f750b7ff700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f74e805ef00 0x7f74e80613c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7500001710 tx=0x7f7500009040).stop 2023-08-31T19:04:29.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.903+0000 7f750b7ff700 1 -- 172.21.15.72:0/3384240677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7504154520 msgr2=0x7f7504068f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:29.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.903+0000 7f750b7ff700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7504154520 0x7f7504068f70 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f74fc00c730 tx=0x7f74fc001520).stop 2023-08-31T19:04:29.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.903+0000 7f750b7ff700 1 -- 172.21.15.72:0/3384240677 shutdown_connections 2023-08-31T19:04:29.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.903+0000 7f750b7ff700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7504154520 0x7f7504068f70 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.903+0000 7f750b7ff700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f74e805ef00 0x7f74e80613c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.903+0000 7f750b7ff700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75040658d0 0x7f75040a9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.903+0000 7f750b7ff700 1 --2- 172.21.15.72:0/3384240677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7504154140 0x7f75040be980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.903+0000 7f750b7ff700 1 -- 172.21.15.72:0/3384240677 >> 172.21.15.72:0/3384240677 conn(0x7f75040c7910 msgr2=0x7f75040c5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.903+0000 7f750b7ff700 1 -- 172.21.15.72:0/3384240677 shutdown_connections 2023-08-31T19:04:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:29.903+0000 7f750b7ff700 1 -- 172.21.15.72:0/3384240677 wait complete. 2023-08-31T19:04:29.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-31T19:04:30.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.116+0000 7fb4f03ff700 1 Processor -- start 2023-08-31T19:04:30.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.116+0000 7fb4f03ff700 1 -- start start 2023-08-31T19:04:30.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.117+0000 7fb4f03ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb4e8154210 0x7fb4e80630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:30.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.117+0000 7fb4f03ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb4e80635a0 0x7fb4e80c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:30.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.117+0000 7fb4f03ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e8063a30 con 0x7fb4e8153e30 2023-08-31T19:04:30.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.117+0000 7fb4f03ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e81546c0 con 0x7fb4e8154210 2023-08-31T19:04:30.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.117+0000 7fb4f03ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e80bfd40 con 0x7fb4e80635a0 2023-08-31T19:04:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.117+0000 7fb4ee19b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb4e8153e30 0x7fb4e80c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34814/0 (socket says 172.21.15.72:34814) 2023-08-31T19:04:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.117+0000 7fb4ee19b700 1 -- 172.21.15.72:0/3342741844 learned_addr learned my addr 172.21.15.72:0/3342741844 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.118+0000 7fb4ed99a700 1 --2- 172.21.15.72:0/3342741844 >> v2:172.21.15.72:3300/0 conn(0x7fb4e8154210 0x7fb4e80630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.118+0000 7fb4ee99c700 1 --2- 172.21.15.72:0/3342741844 >> v2:172.21.15.146:3300/0 conn(0x7fb4e80635a0 0x7fb4e80c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.118+0000 7fb4ed99a700 1 -- 172.21.15.72:0/3342741844 >> v2:172.21.15.146:3300/0 conn(0x7fb4e80635a0 msgr2=0x7fb4e80c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:30.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.118+0000 7fb4ed99a700 1 --2- 172.21.15.72:0/3342741844 >> v2:172.21.15.146:3300/0 conn(0x7fb4e80635a0 0x7fb4e80c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:30.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.118+0000 7fb4ed99a700 1 -- 172.21.15.72:0/3342741844 >> v1:172.21.15.72:6789/0 conn(0x7fb4e8153e30 legacy=0x7fb4e80c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:30.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.118+0000 7fb4ed99a700 1 -- 172.21.15.72:0/3342741844 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e80c6730 con 0x7fb4e8154210 2023-08-31T19:04:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.118+0000 7fb4ed199700 1 -- 172.21.15.72:0/3342741844 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657807105 0 0) 0x7fb4e8063a30 con 0x7fb4e8153e30 2023-08-31T19:04:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.118+0000 7fb4ed99a700 1 --2- 172.21.15.72:0/3342741844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e8154210 0x7fb4e80630b0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7fb4e8084380 tx=0x7fb4d8009060).ready entity=mon.0 client_cookie=50881dc7ee974d04 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.118+0000 7fb4ed199700 1 -- 172.21.15.72:0/3342741844 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d800b580 con 0x7fb4e8154210 2023-08-31T19:04:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.118+0000 7fb4ed199700 1 -- 172.21.15.72:0/3342741844 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d800b6e0 con 0x7fb4e8154210 2023-08-31T19:04:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.118+0000 7fb4ed199700 1 -- 172.21.15.72:0/3342741844 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d800ba60 con 0x7fb4e8154210 2023-08-31T19:04:30.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.119+0000 7fb4f03ff700 1 -- 172.21.15.72:0/3342741844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e8154210 msgr2=0x7fb4e80630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.119+0000 7fb4f03ff700 1 --2- 172.21.15.72:0/3342741844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e8154210 0x7fb4e80630b0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7fb4e8084380 tx=0x7fb4d8009060).stop 2023-08-31T19:04:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.119+0000 7fb4f03ff700 1 -- 172.21.15.72:0/3342741844 shutdown_connections 2023-08-31T19:04:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.119+0000 7fb4f03ff700 1 --2- 172.21.15.72:0/3342741844 >> v2:172.21.15.146:3300/0 conn(0x7fb4e80635a0 0x7fb4e80c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:30.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.119+0000 7fb4f03ff700 1 --2- 172.21.15.72:0/3342741844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e8154210 0x7fb4e80630b0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:30.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.119+0000 7fb4f03ff700 1 -- 172.21.15.72:0/3342741844 >> 172.21.15.72:0/3342741844 conn(0x7fb4e805eb20 msgr2=0x7fb4e80cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:30.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.119+0000 7fb4f03ff700 1 -- 172.21.15.72:0/3342741844 shutdown_connections 2023-08-31T19:04:30.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.119+0000 7fb4f03ff700 1 -- 172.21.15.72:0/3342741844 wait complete. 2023-08-31T19:04:30.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.121+0000 7fb4f03ff700 1 Processor -- start 2023-08-31T19:04:30.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.121+0000 7fb4f03ff700 1 -- start start 2023-08-31T19:04:30.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4f03ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e80635a0 0x7fb4e8142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:30.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4f03ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e8153e30 0x7fb4e80a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:30.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4f03ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e8154210 0x7fb4e8167d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:30.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4f03ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80c3b20 con 0x7fb4e80635a0 2023-08-31T19:04:30.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4f03ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80c2f10 con 0x7fb4e8153e30 2023-08-31T19:04:30.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4f03ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80c31f0 con 0x7fb4e8154210 2023-08-31T19:04:30.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4ee19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e80635a0 0x7fb4e8142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:30.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4ee19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e80635a0 0x7fb4e8142390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40862/0 (socket says 172.21.15.72:40862) 2023-08-31T19:04:30.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4ee19b700 1 -- 172.21.15.72:0/1586520018 learned_addr learned my addr 172.21.15.72:0/1586520018 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:30.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4ee99c700 1 --2- 172.21.15.72:0/1586520018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e8154210 0x7fb4e8167d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:30.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4ed99a700 1 --2- 172.21.15.72:0/1586520018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e8153e30 0x7fb4e80a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:30.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4ee19b700 1 -- 172.21.15.72:0/1586520018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e8154210 msgr2=0x7fb4e8167d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:30.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4ee19b700 1 --2- 172.21.15.72:0/1586520018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e8154210 0x7fb4e8167d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:30.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4ee19b700 1 -- 172.21.15.72:0/1586520018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e8153e30 msgr2=0x7fb4e80a1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:30.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4ee19b700 1 --2- 172.21.15.72:0/1586520018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e8153e30 0x7fb4e80a1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:30.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4ee19b700 1 -- 172.21.15.72:0/1586520018 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d80092a0 con 0x7fb4e80635a0 2023-08-31T19:04:30.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.123+0000 7fb4ee19b700 1 --2- 172.21.15.72:0/1586520018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e80635a0 0x7fb4e8142390 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7fb4e400c4e0 tx=0x7fb4e4007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:30.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.124+0000 7fb4de7fc700 1 -- 172.21.15.72:0/1586520018 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40072e0 con 0x7fb4e80635a0 2023-08-31T19:04:30.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.124+0000 7fb4de7fc700 1 -- 172.21.15.72:0/1586520018 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e4007440 con 0x7fb4e80635a0 2023-08-31T19:04:30.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.124+0000 7fb4f03ff700 1 -- 172.21.15.72:0/1586520018 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e80c34d0 con 0x7fb4e80635a0 2023-08-31T19:04:30.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.124+0000 7fb4de7fc700 1 -- 172.21.15.72:0/1586520018 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40057a0 con 0x7fb4e80635a0 2023-08-31T19:04:30.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.124+0000 7fb4f03ff700 1 -- 172.21.15.72:0/1586520018 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e8142880 con 0x7fb4e80635a0 2023-08-31T19:04:30.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.125+0000 7fb4f03ff700 1 -- 172.21.15.72:0/1586520018 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e8142a70 con 0x7fb4e80635a0 2023-08-31T19:04:30.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.126+0000 7fb4de7fc700 1 -- 172.21.15.72:0/1586520018 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb4e4005bd0 con 0x7fb4e80635a0 2023-08-31T19:04:30.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.126+0000 7fb4de7fc700 1 --2- 172.21.15.72:0/1586520018 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4cc05ef30 0x7fb4cc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:30.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.127+0000 7fb4de7fc700 1 -- 172.21.15.72:0/1586520018 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fb4e4079b10 con 0x7fb4e80635a0 2023-08-31T19:04:30.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.127+0000 7fb4ed99a700 1 --2- 172.21.15.72:0/1586520018 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4cc05ef30 0x7fb4cc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:30.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.127+0000 7fb4ed99a700 1 --2- 172.21.15.72:0/1586520018 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4cc05ef30 0x7fb4cc0613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fb4d8009fd0 tx=0x7fb4d8017000).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:30.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.130+0000 7fb4de7fc700 1 -- 172.21.15.72:0/1586520018 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb4e8142a70 con 0x7fb4e80635a0 2023-08-31T19:04:30.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.303+0000 7fb4f03ff700 1 -- 172.21.15.72:0/1586520018 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb4e8142a70 con 0x7fb4e80635a0 2023-08-31T19:04:30.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.306+0000 7fb4de7fc700 1 -- 172.21.15.72:0/1586520018 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb4e8142a70 con 0x7fb4e80635a0 2023-08-31T19:04:30.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.309+0000 7fb4f03ff700 1 -- 172.21.15.72:0/1586520018 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4cc05ef30 msgr2=0x7fb4cc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:30.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.309+0000 7fb4f03ff700 1 --2- 172.21.15.72:0/1586520018 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4cc05ef30 0x7fb4cc0613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fb4d8009fd0 tx=0x7fb4d8017000).stop 2023-08-31T19:04:30.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.309+0000 7fb4f03ff700 1 -- 172.21.15.72:0/1586520018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e80635a0 msgr2=0x7fb4e8142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:30.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.309+0000 7fb4f03ff700 1 --2- 172.21.15.72:0/1586520018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e80635a0 0x7fb4e8142390 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7fb4e400c4e0 tx=0x7fb4e4007c70).stop 2023-08-31T19:04:30.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.309+0000 7fb4f03ff700 1 -- 172.21.15.72:0/1586520018 shutdown_connections 2023-08-31T19:04:30.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.309+0000 7fb4f03ff700 1 --2- 172.21.15.72:0/1586520018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb4e8154210 0x7fb4e8167d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:30.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.309+0000 7fb4f03ff700 1 --2- 172.21.15.72:0/1586520018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4e80635a0 0x7fb4e8142390 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:30.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.309+0000 7fb4f03ff700 1 --2- 172.21.15.72:0/1586520018 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb4cc05ef30 0x7fb4cc0613f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:30.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.309+0000 7fb4f03ff700 1 --2- 172.21.15.72:0/1586520018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e8153e30 0x7fb4e80a1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:30.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.309+0000 7fb4f03ff700 1 -- 172.21.15.72:0/1586520018 >> 172.21.15.72:0/1586520018 conn(0x7fb4e805eb20 msgr2=0x7fb4e80c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:30.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.309+0000 7fb4f03ff700 1 -- 172.21.15.72:0/1586520018 shutdown_connections 2023-08-31T19:04:30.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.309+0000 7fb4f03ff700 1 -- 172.21.15.72:0/1586520018 wait complete. 2023-08-31T19:04:30.327 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-08-31T19:04:30.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.515+0000 7f29c23ff700 1 Processor -- start 2023-08-31T19:04:30.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.515+0000 7f29c23ff700 1 -- start start 2023-08-31T19:04:30.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.517+0000 7f29c23ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f29bc065710 0x7f29bc069c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:30.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.517+0000 7f29c23ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc064270 con 0x7f29bc06a260 2023-08-31T19:04:30.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.517+0000 7f29c23ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc0bcc20 con 0x7f29bc069170 2023-08-31T19:04:30.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.517+0000 7f29c23ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc0bca40 con 0x7f29bc065710 2023-08-31T19:04:30.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.517+0000 7f29c099c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f29bc065710 0x7f29bc069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:30.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.517+0000 7f29bb7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f29bc06a260 0x7f29bc069550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34828/0 (socket says 172.21.15.72:34828) 2023-08-31T19:04:30.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.517+0000 7f29bb7fe700 1 -- 172.21.15.72:0/3834234514 learned_addr learned my addr 172.21.15.72:0/3834234514 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:30.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.518+0000 7f29c099c700 1 -- 172.21.15.72:0/3834234514 >> v1:172.21.15.146:6789/0 conn(0x7f29bc069170 legacy=0x7f29bc0c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:30.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.518+0000 7f29c099c700 1 -- 172.21.15.72:0/3834234514 >> v1:172.21.15.72:6789/0 conn(0x7f29bc06a260 legacy=0x7f29bc069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:30.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.518+0000 7f29c099c700 1 -- 172.21.15.72:0/3834234514 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc154890 con 0x7f29bc065710 2023-08-31T19:04:30.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.518+0000 7f29c099c700 1 --2- 172.21.15.72:0/3834234514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29bc065710 0x7f29bc069c60 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f29bc0c7670 tx=0x7f29b4009780).ready entity=mon.0 client_cookie=40bd0e60750290c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:30.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.518+0000 7f29baffd700 1 -- 172.21.15.72:0/3834234514 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b400bbf0 con 0x7f29bc065710 2023-08-31T19:04:30.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.518+0000 7f29baffd700 1 -- 172.21.15.72:0/3834234514 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b400bd50 con 0x7f29bc065710 2023-08-31T19:04:30.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.518+0000 7f29baffd700 1 -- 172.21.15.72:0/3834234514 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4011690 con 0x7f29bc065710 2023-08-31T19:04:30.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.519+0000 7f29c23ff700 1 -- 172.21.15.72:0/3834234514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29bc065710 msgr2=0x7f29bc069c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:30.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.519+0000 7f29c23ff700 1 --2- 172.21.15.72:0/3834234514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29bc065710 0x7f29bc069c60 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f29bc0c7670 tx=0x7f29b4009780).stop 2023-08-31T19:04:30.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.519+0000 7f29c23ff700 1 -- 172.21.15.72:0/3834234514 shutdown_connections 2023-08-31T19:04:30.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.519+0000 7f29c23ff700 1 --2- 172.21.15.72:0/3834234514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29bc065710 0x7f29bc069c60 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:30.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.519+0000 7f29c23ff700 1 -- 172.21.15.72:0/3834234514 >> 172.21.15.72:0/3834234514 conn(0x7f29bc0c6b10 msgr2=0x7f29bc0c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:30.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.519+0000 7f29c23ff700 1 -- 172.21.15.72:0/3834234514 shutdown_connections 2023-08-31T19:04:30.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.519+0000 7f29c23ff700 1 -- 172.21.15.72:0/3834234514 wait complete. 2023-08-31T19:04:30.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.520+0000 7f29c23ff700 1 Processor -- start 2023-08-31T19:04:30.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.520+0000 7f29c23ff700 1 -- start start 2023-08-31T19:04:30.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.521+0000 7f29c23ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29bc065710 0x7f29bc164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:30.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.521+0000 7f29c23ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29bc069170 0x7f29bc153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:30.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.521+0000 7f29c23ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29bc06a260 0x7f29bc0bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:30.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.521+0000 7f29c23ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0be970 con 0x7f29bc065710 2023-08-31T19:04:30.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.521+0000 7f29c23ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc1653c0 con 0x7f29bc06a260 2023-08-31T19:04:30.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.521+0000 7f29c23ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0bdaa0 con 0x7f29bc069170 2023-08-31T19:04:30.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.521+0000 7f29bbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29bc065710 0x7f29bc164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:30.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29bbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29bc065710 0x7f29bc164ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40880/0 (socket says 172.21.15.72:40880) 2023-08-31T19:04:30.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29bbfff700 1 -- 172.21.15.72:0/2218456664 learned_addr learned my addr 172.21.15.72:0/2218456664 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:30.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29c099c700 1 --2- 172.21.15.72:0/2218456664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29bc06a260 0x7f29bc0bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:30.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29bbfff700 1 -- 172.21.15.72:0/2218456664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29bc069170 msgr2=0x7f29bc153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:30.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29bb7fe700 1 --2- 172.21.15.72:0/2218456664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29bc069170 0x7f29bc153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:30.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29bbfff700 1 --2- 172.21.15.72:0/2218456664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29bc069170 0x7f29bc153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:30.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29bbfff700 1 -- 172.21.15.72:0/2218456664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29bc06a260 msgr2=0x7f29bc0bfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:30.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29bbfff700 1 --2- 172.21.15.72:0/2218456664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29bc06a260 0x7f29bc0bfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:30.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29bbfff700 1 -- 172.21.15.72:0/2218456664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4009a20 con 0x7f29bc065710 2023-08-31T19:04:30.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29bb7fe700 1 --2- 172.21.15.72:0/2218456664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29bc069170 0x7f29bc153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:30.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29bbfff700 1 --2- 172.21.15.72:0/2218456664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29bc065710 0x7f29bc164ed0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f29ac00c440 tx=0x7f29ac007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:30.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29a3fff700 1 -- 172.21.15.72:0/2218456664 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00f470 con 0x7f29bc065710 2023-08-31T19:04:30.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29a3fff700 1 -- 172.21.15.72:0/2218456664 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac00f5f0 con 0x7f29bc065710 2023-08-31T19:04:30.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29c23ff700 1 -- 172.21.15.72:0/2218456664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc0bdd60 con 0x7f29bc065710 2023-08-31T19:04:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29a3fff700 1 -- 172.21.15.72:0/2218456664 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00f9b0 con 0x7f29bc065710 2023-08-31T19:04:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.522+0000 7f29c23ff700 1 -- 172.21.15.72:0/2218456664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc0be320 con 0x7f29bc065710 2023-08-31T19:04:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.524+0000 7f29c23ff700 1 -- 172.21.15.72:0/2218456664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc06c6b0 con 0x7f29bc065710 2023-08-31T19:04:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.524+0000 7f29a3fff700 1 -- 172.21.15.72:0/2218456664 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f29ac012400 con 0x7f29bc065710 2023-08-31T19:04:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.525+0000 7f29a3fff700 1 --2- 172.21.15.72:0/2218456664 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29a805ef30 0x7f29a80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:30.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.525+0000 7f29a3fff700 1 -- 172.21.15.72:0/2218456664 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f29ac079720 con 0x7f29bc065710 2023-08-31T19:04:30.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.525+0000 7f29bb7fe700 1 --2- 172.21.15.72:0/2218456664 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29a805ef30 0x7f29a80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:30.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.526+0000 7f29bb7fe700 1 --2- 172.21.15.72:0/2218456664 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29a805ef30 0x7f29a80613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f29bc0a8110 tx=0x7f29b0009040).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:30.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.529+0000 7f29a3fff700 1 -- 172.21.15.72:0/2218456664 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f29ac0488f0 con 0x7f29bc065710 2023-08-31T19:04:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:30.763+0000 7f29c23ff700 1 -- 172.21.15.72:0/2218456664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f29bc0bcec0 con 0x7f29bc065710 2023-08-31T19:04:31.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.504+0000 7f29a3fff700 1 -- 172.21.15.72:0/2218456664 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v613) v1 ==== 166+0+0 (secure 0 0 0) 0x7f29ac04e2a0 con 0x7f29bc065710 2023-08-31T19:04:31.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.507+0000 7f29c23ff700 1 -- 172.21.15.72:0/2218456664 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29a805ef30 msgr2=0x7f29a80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:31.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.507+0000 7f29c23ff700 1 --2- 172.21.15.72:0/2218456664 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29a805ef30 0x7f29a80613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f29bc0a8110 tx=0x7f29b0009040).stop 2023-08-31T19:04:31.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.507+0000 7f29c23ff700 1 -- 172.21.15.72:0/2218456664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29bc065710 msgr2=0x7f29bc164ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:31.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.507+0000 7f29c23ff700 1 --2- 172.21.15.72:0/2218456664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29bc065710 0x7f29bc164ed0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f29ac00c440 tx=0x7f29ac007de0).stop 2023-08-31T19:04:31.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.507+0000 7f29c23ff700 1 -- 172.21.15.72:0/2218456664 shutdown_connections 2023-08-31T19:04:31.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.507+0000 7f29c23ff700 1 --2- 172.21.15.72:0/2218456664 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29a805ef30 0x7f29a80613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:31.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.507+0000 7f29c23ff700 1 --2- 172.21.15.72:0/2218456664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29bc06a260 0x7f29bc0bfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:31.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.507+0000 7f29c23ff700 1 --2- 172.21.15.72:0/2218456664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29bc065710 0x7f29bc164ed0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:31.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.507+0000 7f29c23ff700 1 --2- 172.21.15.72:0/2218456664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29bc069170 0x7f29bc153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:31.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.507+0000 7f29c23ff700 1 -- 172.21.15.72:0/2218456664 >> 172.21.15.72:0/2218456664 conn(0x7f29bc0c6b10 msgr2=0x7f29bc0c5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:31.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.507+0000 7f29c23ff700 1 -- 172.21.15.72:0/2218456664 shutdown_connections 2023-08-31T19:04:31.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.507+0000 7f29c23ff700 1 -- 172.21.15.72:0/2218456664 wait complete. 2023-08-31T19:04:31.526 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-08-31T19:04:31.527 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that a non-existent path leads to schedule deactivation after a few retries. 2023-08-31T19:04:31.527 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-31T19:04:31.527 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-08-31T19:04:31.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.717+0000 7f99313ff700 1 Processor -- start 2023-08-31T19:04:31.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.718+0000 7f99313ff700 1 -- start start 2023-08-31T19:04:31.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.719+0000 7f99313ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f992c0c6c30 0x7f992c0bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:31.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.719+0000 7f99313ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f992c1583f0 0x7f992c0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:31.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.719+0000 7f99313ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992c063be0 con 0x7f992c0c4740 2023-08-31T19:04:31.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.719+0000 7f99313ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992c063010 con 0x7f992c1583f0 2023-08-31T19:04:31.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.719+0000 7f99313ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c0632b0 con 0x7f992c0c6c30 2023-08-31T19:04:31.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.719+0000 7f992b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f992c1583f0 0x7f992c0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:31.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.719+0000 7f992affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f992c0c6c30 0x7f992c0bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:31.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.720+0000 7f992b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f992c1583f0 0x7f992c0c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:50804/0 (socket says 172.21.15.72:50804) 2023-08-31T19:04:31.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.720+0000 7f992b7fe700 1 -- 172.21.15.72:0/904423437 learned_addr learned my addr 172.21.15.72:0/904423437 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:31.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.720+0000 7f992a7fc700 1 --1- 172.21.15.72:0/904423437 >> v1:172.21.15.146:6789/0 conn(0x7f992c0c4740 0x7f992c157ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:39902/0 (socket says 172.21.15.72:39902) 2023-08-31T19:04:31.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.720+0000 7f992b7fe700 1 -- 172.21.15.72:0/904423437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f992c0c6c30 msgr2=0x7f992c0bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:31.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.720+0000 7f992b7fe700 1 --2- 172.21.15.72:0/904423437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f992c0c6c30 0x7f992c0bc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:31.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.720+0000 7f992b7fe700 1 -- 172.21.15.72:0/904423437 >> v1:172.21.15.146:6789/0 conn(0x7f992c0c4740 legacy=0x7f992c157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:31.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.720+0000 7f992b7fe700 1 -- 172.21.15.72:0/904423437 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c063590 con 0x7f992c1583f0 2023-08-31T19:04:31.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.720+0000 7f992affd700 1 --2- 172.21.15.72:0/904423437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f992c0c6c30 0x7f992c0bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:04:31.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.720+0000 7f992b7fe700 1 --2- 172.21.15.72:0/904423437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f992c1583f0 0x7f992c0c52a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f9924009f20 tx=0x7f9924009840).ready entity=mon.1 client_cookie=84d514da6f462a75 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:31.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.721+0000 7f9929ffb700 1 -- 172.21.15.72:0/904423437 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992400e070 con 0x7f992c1583f0 2023-08-31T19:04:31.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.721+0000 7f9929ffb700 1 -- 172.21.15.72:0/904423437 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992400b9d0 con 0x7f992c1583f0 2023-08-31T19:04:31.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.721+0000 7f9929ffb700 1 -- 172.21.15.72:0/904423437 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992400bd50 con 0x7f992c1583f0 2023-08-31T19:04:31.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.721+0000 7f99313ff700 1 -- 172.21.15.72:0/904423437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f992c1583f0 msgr2=0x7f992c0c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:31.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.721+0000 7f99313ff700 1 --2- 172.21.15.72:0/904423437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f992c1583f0 0x7f992c0c52a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f9924009f20 tx=0x7f9924009840).stop 2023-08-31T19:04:31.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.721+0000 7f99313ff700 1 -- 172.21.15.72:0/904423437 shutdown_connections 2023-08-31T19:04:31.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.721+0000 7f99313ff700 1 --2- 172.21.15.72:0/904423437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f992c1583f0 0x7f992c0c52a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:31.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.721+0000 7f99313ff700 1 --2- 172.21.15.72:0/904423437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f992c0c6c30 0x7f992c0bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:31.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.722+0000 7f99313ff700 1 -- 172.21.15.72:0/904423437 >> 172.21.15.72:0/904423437 conn(0x7f992c0c7e70 msgr2=0x7f992c0c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:31.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.722+0000 7f99313ff700 1 -- 172.21.15.72:0/904423437 shutdown_connections 2023-08-31T19:04:31.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.722+0000 7f99313ff700 1 -- 172.21.15.72:0/904423437 wait complete. 2023-08-31T19:04:31.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.723+0000 7f99313ff700 1 Processor -- start 2023-08-31T19:04:31.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.723+0000 7f99313ff700 1 -- start start 2023-08-31T19:04:31.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.724+0000 7f99313ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f992c0c4740 0x7f992c1526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:31.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.724+0000 7f99313ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f992c0c6c30 0x7f992c0a9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.724+0000 7f99313ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f992c1583f0 0x7f992c1656a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.724+0000 7f99313ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c0a9280 con 0x7f992c1583f0 2023-08-31T19:04:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.724+0000 7f99313ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c152d20 con 0x7f992c0c6c30 2023-08-31T19:04:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.724+0000 7f99313ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c0a8c30 con 0x7f992c0c4740 2023-08-31T19:04:31.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.724+0000 7f992b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f992c1583f0 0x7f992c1656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:31.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.724+0000 7f992b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f992c1583f0 0x7f992c1656a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40896/0 (socket says 172.21.15.72:40896) 2023-08-31T19:04:31.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.724+0000 7f992b7fe700 1 -- 172.21.15.72:0/4255222535 learned_addr learned my addr 172.21.15.72:0/4255222535 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:31.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.724+0000 7f992a7fc700 1 --2- 172.21.15.72:0/4255222535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f992c0c6c30 0x7f992c0a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:31.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.724+0000 7f992affd700 1 --2- 172.21.15.72:0/4255222535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f992c0c4740 0x7f992c1526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:31.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.725+0000 7f992b7fe700 1 -- 172.21.15.72:0/4255222535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f992c0c4740 msgr2=0x7f992c1526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:31.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.725+0000 7f992b7fe700 1 --2- 172.21.15.72:0/4255222535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f992c0c4740 0x7f992c1526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:31.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.725+0000 7f992b7fe700 1 -- 172.21.15.72:0/4255222535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f992c0c6c30 msgr2=0x7f992c0a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:31.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.725+0000 7f992b7fe700 1 --2- 172.21.15.72:0/4255222535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f992c0c6c30 0x7f992c0a9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:31.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.725+0000 7f992b7fe700 1 -- 172.21.15.72:0/4255222535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0092a0 con 0x7f992c1583f0 2023-08-31T19:04:31.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.725+0000 7f992b7fe700 1 --2- 172.21.15.72:0/4255222535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f992c1583f0 0x7f992c1656a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f992c064200 tx=0x7f992c155720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:31.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.725+0000 7f9912ffd700 1 -- 172.21.15.72:0/4255222535 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99240092e0 con 0x7f992c1583f0 2023-08-31T19:04:31.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.725+0000 7f9912ffd700 1 -- 172.21.15.72:0/4255222535 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9924013e30 con 0x7f992c1583f0 2023-08-31T19:04:31.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.725+0000 7f99313ff700 1 -- 172.21.15.72:0/4255222535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9924009ae0 con 0x7f992c1583f0 2023-08-31T19:04:31.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.725+0000 7f9912ffd700 1 -- 172.21.15.72:0/4255222535 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9924007860 con 0x7f992c1583f0 2023-08-31T19:04:31.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.725+0000 7f99313ff700 1 -- 172.21.15.72:0/4255222535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992c0a88e0 con 0x7f992c1583f0 2023-08-31T19:04:31.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.726+0000 7f99313ff700 1 -- 172.21.15.72:0/4255222535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992c0a9430 con 0x7f992c1583f0 2023-08-31T19:04:31.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.727+0000 7f9912ffd700 1 -- 172.21.15.72:0/4255222535 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9924003040 con 0x7f992c1583f0 2023-08-31T19:04:31.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.729+0000 7f9912ffd700 1 --2- 172.21.15.72:0/4255222535 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f991805ef30 0x7f99180613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:31.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.729+0000 7f9912ffd700 1 -- 172.21.15.72:0/4255222535 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f992407b960 con 0x7f992c1583f0 2023-08-31T19:04:31.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.729+0000 7f992affd700 1 --2- 172.21.15.72:0/4255222535 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f991805ef30 0x7f99180613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:31.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.729+0000 7f992affd700 1 --2- 172.21.15.72:0/4255222535 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f991805ef30 0x7f99180613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f991c009dc0 tx=0x7f991c009060).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:31.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.733+0000 7f9912ffd700 1 -- 172.21.15.72:0/4255222535 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f992c0a9430 con 0x7f992c1583f0 2023-08-31T19:04:31.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:31.964+0000 7f99313ff700 1 -- 172.21.15.72:0/4255222535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f992c0a93c0 con 0x7f992c1583f0 2023-08-31T19:04:32.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.507+0000 7f9912ffd700 1 -- 172.21.15.72:0/4255222535 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v614) v1 ==== 186+0+0 (secure 0 0 0) 0x7f9924023070 con 0x7f992c1583f0 2023-08-31T19:04:32.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.510+0000 7f99313ff700 1 -- 172.21.15.72:0/4255222535 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f991805ef30 msgr2=0x7f99180613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:32.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.510+0000 7f99313ff700 1 --2- 172.21.15.72:0/4255222535 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f991805ef30 0x7f99180613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f991c009dc0 tx=0x7f991c009060).stop 2023-08-31T19:04:32.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.510+0000 7f99313ff700 1 -- 172.21.15.72:0/4255222535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f992c1583f0 msgr2=0x7f992c1656a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:32.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.510+0000 7f99313ff700 1 --2- 172.21.15.72:0/4255222535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f992c1583f0 0x7f992c1656a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f992c064200 tx=0x7f992c155720).stop 2023-08-31T19:04:32.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.510+0000 7f99313ff700 1 -- 172.21.15.72:0/4255222535 shutdown_connections 2023-08-31T19:04:32.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.510+0000 7f99313ff700 1 --2- 172.21.15.72:0/4255222535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f992c1583f0 0x7f992c1656a0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:32.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.510+0000 7f99313ff700 1 --2- 172.21.15.72:0/4255222535 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f992c0c4740 0x7f992c1526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:32.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.510+0000 7f99313ff700 1 --2- 172.21.15.72:0/4255222535 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f991805ef30 0x7f99180613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:32.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.510+0000 7f99313ff700 1 --2- 172.21.15.72:0/4255222535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f992c0c6c30 0x7f992c0a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:32.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.510+0000 7f99313ff700 1 -- 172.21.15.72:0/4255222535 >> 172.21.15.72:0/4255222535 conn(0x7f992c0c7e70 msgr2=0x7f992c065d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:32.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.510+0000 7f99313ff700 1 -- 172.21.15.72:0/4255222535 shutdown_connections 2023-08-31T19:04:32.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.510+0000 7f99313ff700 1 -- 172.21.15.72:0/4255222535 wait complete. 2023-08-31T19:04:32.530 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-31T19:04:32.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.725+0000 7f0fd41ff700 1 Processor -- start 2023-08-31T19:04:32.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.725+0000 7f0fd41ff700 1 -- start start 2023-08-31T19:04:32.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.726+0000 7f0fd41ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0fcc0690e0 0x7f0fcc05e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.726+0000 7f0fd41ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fcc0c38d0 0x7f0fcc0bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.726+0000 7f0fd41ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fcc0bc4a0 con 0x7f0fcc1544e0 2023-08-31T19:04:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.726+0000 7f0fd41ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fcc05e840 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.726+0000 7f0fd41ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fcc069c40 con 0x7f0fcc0690e0 2023-08-31T19:04:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.727+0000 7f0fd279c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fcc0c38d0 0x7f0fcc0bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.727+0000 7f0fd279c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fcc0c38d0 0x7f0fcc0bc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40900/0 (socket says 172.21.15.72:40900) 2023-08-31T19:04:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.727+0000 7f0fd279c700 1 -- 172.21.15.72:0/3777387251 learned_addr learned my addr 172.21.15.72:0/3777387251 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.727+0000 7f0fd179a700 1 --2- 172.21.15.72:0/3777387251 >> v2:172.21.15.146:3300/0 conn(0x7f0fcc0690e0 0x7f0fcc05e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.727+0000 7f0fd279c700 1 -- 172.21.15.72:0/3777387251 >> v2:172.21.15.146:3300/0 conn(0x7f0fcc0690e0 msgr2=0x7f0fcc05e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.727+0000 7f0fd279c700 1 --2- 172.21.15.72:0/3777387251 >> v2:172.21.15.146:3300/0 conn(0x7f0fcc0690e0 0x7f0fcc05e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:32.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.727+0000 7f0fd279c700 1 -- 172.21.15.72:0/3777387251 >> v1:172.21.15.146:6789/0 conn(0x7f0fcc1544e0 legacy=0x7f0fcc0689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:32.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.727+0000 7f0fd279c700 1 -- 172.21.15.72:0/3777387251 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc0c1c30 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.727+0000 7f0fd179a700 1 --2- 172.21.15.72:0/3777387251 >> v2:172.21.15.146:3300/0 conn(0x7f0fcc0690e0 0x7f0fcc05e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:32.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.727+0000 7f0fd279c700 1 --2- 172.21.15.72:0/3777387251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fcc0c38d0 0x7f0fcc0bc930 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f0fcc0647d0 tx=0x7f0fc4009840).ready entity=mon.0 client_cookie=b03dd480159faef8 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:32.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.727+0000 7f0fd0f99700 1 -- 172.21.15.72:0/3777387251 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc400e070 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.728+0000 7f0fd0f99700 1 -- 172.21.15.72:0/3777387251 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc400ba10 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.728+0000 7f0fd0f99700 1 -- 172.21.15.72:0/3777387251 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc400bd90 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.728+0000 7f0fd41ff700 1 -- 172.21.15.72:0/3777387251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fcc0c38d0 msgr2=0x7f0fcc0bc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:32.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.728+0000 7f0fd41ff700 1 --2- 172.21.15.72:0/3777387251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fcc0c38d0 0x7f0fcc0bc930 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f0fcc0647d0 tx=0x7f0fc4009840).stop 2023-08-31T19:04:32.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.728+0000 7f0fd41ff700 1 -- 172.21.15.72:0/3777387251 shutdown_connections 2023-08-31T19:04:32.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.728+0000 7f0fd41ff700 1 --2- 172.21.15.72:0/3777387251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fcc0c38d0 0x7f0fcc0bc930 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:32.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.728+0000 7f0fd41ff700 1 --2- 172.21.15.72:0/3777387251 >> v2:172.21.15.146:3300/0 conn(0x7f0fcc0690e0 0x7f0fcc05e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:32.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.728+0000 7f0fd41ff700 1 -- 172.21.15.72:0/3777387251 >> 172.21.15.72:0/3777387251 conn(0x7f0fcc0c7e00 msgr2=0x7f0fcc0c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:32.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.728+0000 7f0fd41ff700 1 -- 172.21.15.72:0/3777387251 shutdown_connections 2023-08-31T19:04:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.728+0000 7f0fd41ff700 1 -- 172.21.15.72:0/3777387251 wait complete. 2023-08-31T19:04:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.730+0000 7f0fd41ff700 1 Processor -- start 2023-08-31T19:04:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.730+0000 7f0fd41ff700 1 -- start start 2023-08-31T19:04:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd41ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fcc0690e0 0x7f0fcc167f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd41ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fcc0c38d0 0x7f0fcc0ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd41ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0fcc1544e0 0x7f0fcc0c0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd41ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc164d40 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd41ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc0acaf0 con 0x7f0fcc0690e0 2023-08-31T19:04:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd41ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc163d50 con 0x7f0fcc1544e0 2023-08-31T19:04:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd179a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fcc0c38d0 0x7f0fcc0ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd179a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fcc0c38d0 0x7f0fcc0ac2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40902/0 (socket says 172.21.15.72:40902) 2023-08-31T19:04:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd179a700 1 -- 172.21.15.72:0/3822525153 learned_addr learned my addr 172.21.15.72:0/3822525153 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd279c700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0fcc1544e0 0x7f0fcc0c0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd179a700 1 -- 172.21.15.72:0/3822525153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0fcc1544e0 msgr2=0x7f0fcc0c0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd179a700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0fcc1544e0 0x7f0fcc0c0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:32.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd179a700 1 -- 172.21.15.72:0/3822525153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fcc0690e0 msgr2=0x7f0fcc167f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:32.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd1f9b700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fcc0690e0 0x7f0fcc167f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:32.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd179a700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fcc0690e0 0x7f0fcc167f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:32.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd179a700 1 -- 172.21.15.72:0/3822525153 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc4009ae0 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd279c700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0fcc1544e0 0x7f0fcc0c0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:32.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.731+0000 7f0fd1f9b700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fcc0690e0 0x7f0fcc167f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:32.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.732+0000 7f0fd179a700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fcc0c38d0 0x7f0fcc0ac2e0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f0fbc00c8b0 tx=0x7f0fbc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:32.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.732+0000 7f0fc1ffb700 1 -- 172.21.15.72:0/3822525153 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc010580 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.732+0000 7f0fc1ffb700 1 -- 172.21.15.72:0/3822525153 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc0106e0 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.732+0000 7f0fc1ffb700 1 -- 172.21.15.72:0/3822525153 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc010a60 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.732+0000 7f0fd41ff700 1 -- 172.21.15.72:0/3822525153 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fcc1648b0 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.732+0000 7f0fd41ff700 1 -- 172.21.15.72:0/3822525153 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fcc164540 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.733+0000 7f0fd41ff700 1 -- 172.21.15.72:0/3822525153 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fcc164a40 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.734+0000 7f0fc1ffb700 1 -- 172.21.15.72:0/3822525153 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0fbc01b460 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.735+0000 7f0fc1ffb700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0fb005ef30 0x7f0fb00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.735+0000 7f0fc1ffb700 1 -- 172.21.15.72:0/3822525153 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f0fbc07a060 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.735+0000 7f0fd1f9b700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0fb005ef30 0x7f0fb00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.735+0000 7f0fd1f9b700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0fb005ef30 0x7f0fb00613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0fcc157b90 tx=0x7f0fc8008040).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.738+0000 7f0fc1ffb700 1 -- 172.21.15.72:0/3822525153 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0fbc04b1a0 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.905+0000 7f0fd41ff700 1 -- 172.21.15.72:0/3822525153 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0fcc06c6b0 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.910+0000 7f0fc1ffb700 1 -- 172.21.15.72:0/3822525153 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0fbc04e7c0 con 0x7f0fcc0c38d0 2023-08-31T19:04:32.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.912+0000 7f0fd41ff700 1 -- 172.21.15.72:0/3822525153 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0fb005ef30 msgr2=0x7f0fb00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:32.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.912+0000 7f0fd41ff700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0fb005ef30 0x7f0fb00613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0fcc157b90 tx=0x7f0fc8008040).stop 2023-08-31T19:04:32.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.912+0000 7f0fd41ff700 1 -- 172.21.15.72:0/3822525153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fcc0c38d0 msgr2=0x7f0fcc0ac2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:32.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.912+0000 7f0fd41ff700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fcc0c38d0 0x7f0fcc0ac2e0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f0fbc00c8b0 tx=0x7f0fbc008040).stop 2023-08-31T19:04:32.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.912+0000 7f0fd41ff700 1 -- 172.21.15.72:0/3822525153 shutdown_connections 2023-08-31T19:04:32.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.912+0000 7f0fd41ff700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0fcc1544e0 0x7f0fcc0c0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:32.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.912+0000 7f0fd41ff700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0fb005ef30 0x7f0fb00613f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:32.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.912+0000 7f0fd41ff700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fcc0690e0 0x7f0fcc167f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:32.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.912+0000 7f0fd41ff700 1 --2- 172.21.15.72:0/3822525153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fcc0c38d0 0x7f0fcc0ac2e0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:32.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.912+0000 7f0fd41ff700 1 -- 172.21.15.72:0/3822525153 >> 172.21.15.72:0/3822525153 conn(0x7f0fcc0c7e00 msgr2=0x7f0fcc0c5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:32.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.912+0000 7f0fd41ff700 1 -- 172.21.15.72:0/3822525153 shutdown_connections 2023-08-31T19:04:32.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:32.912+0000 7f0fd41ff700 1 -- 172.21.15.72:0/3822525153 wait complete. 2023-08-31T19:04:32.929 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:04:32.929 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:04:33.024 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:04:33.135 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:04:33.136 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-31T19:04:33.136 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:04:33.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.324+0000 7ff2895ff700 1 Processor -- start 2023-08-31T19:04:33.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.325+0000 7ff2895ff700 1 -- start start 2023-08-31T19:04:33.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.326+0000 7ff2895ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff284154060 0x7ff284157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:33.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.326+0000 7ff2895ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2841588d0 0x7ff284154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:33.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.326+0000 7ff2895ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2840c6120 con 0x7ff2840cb9b0 2023-08-31T19:04:33.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.326+0000 7ff2895ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2840c1380 con 0x7ff284154060 2023-08-31T19:04:33.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.326+0000 7ff2895ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840c5e10 con 0x7ff2841588d0 2023-08-31T19:04:33.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.326+0000 7ff282ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff284154060 0x7ff284157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:33.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.327+0000 7ff2837fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2841588d0 0x7ff284154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:33.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.327+0000 7ff282ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff284154060 0x7ff284157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:34204/0 (socket says 172.21.15.72:34204) 2023-08-31T19:04:33.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.327+0000 7ff2837fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2841588d0 0x7ff284154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:33616/0 (socket says 172.21.15.72:33616) 2023-08-31T19:04:33.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.327+0000 7ff282ffd700 1 -- 172.21.15.72:0/1371477784 learned_addr learned my addr 172.21.15.72:0/1371477784 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:33.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.327+0000 7ff2827fc700 1 --1- 172.21.15.72:0/1371477784 >> v1:172.21.15.146:6789/0 conn(0x7ff2840cb9b0 0x7ff2841581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:39172/0 (socket says 172.21.15.72:39172) 2023-08-31T19:04:33.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.327+0000 7ff2837fe700 1 -- 172.21.15.72:0/1371477784 >> v2:172.21.15.146:3300/0 conn(0x7ff284154060 msgr2=0x7ff284157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:33.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.327+0000 7ff2837fe700 1 --2- 172.21.15.72:0/1371477784 >> v2:172.21.15.146:3300/0 conn(0x7ff284154060 0x7ff284157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:33.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.327+0000 7ff2837fe700 1 -- 172.21.15.72:0/1371477784 >> v1:172.21.15.146:6789/0 conn(0x7ff2840cb9b0 legacy=0x7ff2841581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:33.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.327+0000 7ff2837fe700 1 -- 172.21.15.72:0/1371477784 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2840c0ae0 con 0x7ff2841588d0 2023-08-31T19:04:33.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.327+0000 7ff282ffd700 1 --2- 172.21.15.72:0/1371477784 >> v2:172.21.15.146:3300/0 conn(0x7ff284154060 0x7ff284157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:04:33.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.327+0000 7ff2837fe700 1 --2- 172.21.15.72:0/1371477784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2841588d0 0x7ff284154440 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7ff27c009e60 tx=0x7ff27c009780).ready entity=mon.2 client_cookie=b1b3920a41a65a01 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:33.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.327+0000 7ff281ffb700 1 -- 172.21.15.72:0/1371477784 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c00e070 con 0x7ff2841588d0 2023-08-31T19:04:33.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.328+0000 7ff281ffb700 1 -- 172.21.15.72:0/1371477784 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c00bb60 con 0x7ff2841588d0 2023-08-31T19:04:33.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.328+0000 7ff281ffb700 1 -- 172.21.15.72:0/1371477784 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c012410 con 0x7ff2841588d0 2023-08-31T19:04:33.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.328+0000 7ff2895ff700 1 -- 172.21.15.72:0/1371477784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2841588d0 msgr2=0x7ff284154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:33.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.328+0000 7ff2895ff700 1 --2- 172.21.15.72:0/1371477784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2841588d0 0x7ff284154440 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7ff27c009e60 tx=0x7ff27c009780).stop 2023-08-31T19:04:33.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.328+0000 7ff2895ff700 1 -- 172.21.15.72:0/1371477784 shutdown_connections 2023-08-31T19:04:33.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.328+0000 7ff2895ff700 1 --2- 172.21.15.72:0/1371477784 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff2841588d0 0x7ff284154440 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:33.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.328+0000 7ff2895ff700 1 --2- 172.21.15.72:0/1371477784 >> v2:172.21.15.146:3300/0 conn(0x7ff284154060 0x7ff284157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:33.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.328+0000 7ff2895ff700 1 -- 172.21.15.72:0/1371477784 >> 172.21.15.72:0/1371477784 conn(0x7ff28405e870 msgr2=0x7ff2840cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:33.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.328+0000 7ff2895ff700 1 -- 172.21.15.72:0/1371477784 shutdown_connections 2023-08-31T19:04:33.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.328+0000 7ff2895ff700 1 -- 172.21.15.72:0/1371477784 wait complete. 2023-08-31T19:04:33.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.330+0000 7ff2895ff700 1 Processor -- start 2023-08-31T19:04:33.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.330+0000 7ff2895ff700 1 -- start start 2023-08-31T19:04:33.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2895ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2840cb9b0 0x7ff2840c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:33.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2895ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff284154060 0x7ff2840c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:33.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2895ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2841588d0 0x7ff284143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:33.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2895ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840aae70 con 0x7ff2841588d0 2023-08-31T19:04:33.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2895ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840a82a0 con 0x7ff2840cb9b0 2023-08-31T19:04:33.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2895ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840c24b0 con 0x7ff284154060 2023-08-31T19:04:33.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2837fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2841588d0 0x7ff284143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:33.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2837fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2841588d0 0x7ff284143710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42616/0 (socket says 172.21.15.72:42616) 2023-08-31T19:04:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2837fe700 1 -- 172.21.15.72:0/658411978 learned_addr learned my addr 172.21.15.72:0/658411978 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2827fc700 1 --2- 172.21.15.72:0/658411978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff284154060 0x7ff2840c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff282ffd700 1 --2- 172.21.15.72:0/658411978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2840cb9b0 0x7ff2840c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2837fe700 1 -- 172.21.15.72:0/658411978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff284154060 msgr2=0x7ff2840c1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2837fe700 1 --2- 172.21.15.72:0/658411978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff284154060 0x7ff2840c1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:33.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2837fe700 1 -- 172.21.15.72:0/658411978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2840cb9b0 msgr2=0x7ff2840c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:33.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2837fe700 1 --2- 172.21.15.72:0/658411978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2840cb9b0 0x7ff2840c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:33.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2837fe700 1 -- 172.21.15.72:0/658411978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff274009300 con 0x7ff2841588d0 2023-08-31T19:04:33.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.331+0000 7ff2837fe700 1 --2- 172.21.15.72:0/658411978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2841588d0 0x7ff284143710 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7ff27c00b6c0 tx=0x7ff27c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:33.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.332+0000 7ff26affd700 1 -- 172.21.15.72:0/658411978 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c009440 con 0x7ff2841588d0 2023-08-31T19:04:33.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.332+0000 7ff26affd700 1 -- 172.21.15.72:0/658411978 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c01d630 con 0x7ff2841588d0 2023-08-31T19:04:33.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.332+0000 7ff2895ff700 1 -- 172.21.15.72:0/658411978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27c009a20 con 0x7ff2841588d0 2023-08-31T19:04:33.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.332+0000 7ff26affd700 1 -- 172.21.15.72:0/658411978 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c01d9b0 con 0x7ff2841588d0 2023-08-31T19:04:33.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.332+0000 7ff2895ff700 1 -- 172.21.15.72:0/658411978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2840a7c50 con 0x7ff2841588d0 2023-08-31T19:04:33.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.333+0000 7ff2895ff700 1 -- 172.21.15.72:0/658411978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2840a8430 con 0x7ff2841588d0 2023-08-31T19:04:33.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.334+0000 7ff26affd700 1 -- 172.21.15.72:0/658411978 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff27c026410 con 0x7ff2841588d0 2023-08-31T19:04:33.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.335+0000 7ff26affd700 1 --2- 172.21.15.72:0/658411978 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff27005ef30 0x7ff2700613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:33.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.335+0000 7ff26affd700 1 -- 172.21.15.72:0/658411978 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6428+0+0 (secure 0 0 0) 0x7ff27c07c080 con 0x7ff2841588d0 2023-08-31T19:04:33.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.335+0000 7ff282ffd700 1 --2- 172.21.15.72:0/658411978 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff27005ef30 0x7ff2700613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:33.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.336+0000 7ff282ffd700 1 --2- 172.21.15.72:0/658411978 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff27005ef30 0x7ff2700613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff2740092d0 tx=0x7ff274008040).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:33.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.339+0000 7ff26affd700 1 -- 172.21.15.72:0/658411978 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff27c0aa8f0 con 0x7ff2841588d0 2023-08-31T19:04:33.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.549+0000 7ff2895ff700 1 -- 172.21.15.72:0/658411978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff28406c6b0 con 0x7ff2841588d0 2023-08-31T19:04:33.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.549+0000 7ff26affd700 1 -- 172.21.15.72:0/658411978 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3535 (secure 0 0 0) 0x7ff27c04d1a0 con 0x7ff2841588d0 2023-08-31T19:04:33.550 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:33.550 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5732,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1777836817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1777836817},{"type":"v1","addr":"172.21.15.146:6834","nonce":1777836817}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5735,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1865290147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1865290147},{"type":"v1","addr":"172.21.15.146:6835","nonce":1865290147}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6690,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2552241481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2552241481},{"type":"v1","addr":"172.21.15.72:6836","nonce":2552241481}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7062,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1435160533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1435160533},{"type":"v1","addr":"172.21.15.72:6837","nonce":1435160533}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[]} 2023-08-31T19:04:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.551+0000 7ff2895ff700 1 -- 172.21.15.72:0/658411978 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff27005ef30 msgr2=0x7ff2700613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.551+0000 7ff2895ff700 1 --2- 172.21.15.72:0/658411978 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff27005ef30 0x7ff2700613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff2740092d0 tx=0x7ff274008040).stop 2023-08-31T19:04:33.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.551+0000 7ff2895ff700 1 -- 172.21.15.72:0/658411978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2841588d0 msgr2=0x7ff284143710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:33.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.551+0000 7ff2895ff700 1 --2- 172.21.15.72:0/658411978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2841588d0 0x7ff284143710 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7ff27c00b6c0 tx=0x7ff27c009780).stop 2023-08-31T19:04:33.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.551+0000 7ff2895ff700 1 -- 172.21.15.72:0/658411978 shutdown_connections 2023-08-31T19:04:33.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.551+0000 7ff2895ff700 1 --2- 172.21.15.72:0/658411978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2841588d0 0x7ff284143710 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:33.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.551+0000 7ff2895ff700 1 --2- 172.21.15.72:0/658411978 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff27005ef30 0x7ff2700613f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:33.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.551+0000 7ff2895ff700 1 --2- 172.21.15.72:0/658411978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2840cb9b0 0x7ff2840c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:33.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.551+0000 7ff2895ff700 1 --2- 172.21.15.72:0/658411978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff284154060 0x7ff2840c1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:33.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.551+0000 7ff2895ff700 1 -- 172.21.15.72:0/658411978 >> 172.21.15.72:0/658411978 conn(0x7ff28405e870 msgr2=0x7ff284152aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:33.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.552+0000 7ff2895ff700 1 -- 172.21.15.72:0/658411978 shutdown_connections 2023-08-31T19:04:33.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.552+0000 7ff2895ff700 1 -- 172.21.15.72:0/658411978 wait complete. 2023-08-31T19:04:33.555 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 42 2023-08-31T19:04:33.570 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T19:04:33.570 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-31T19:04:33.570 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T19:04:33.571 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:04:33.571 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T19:04:33.571 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-31T19:04:33.571 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T19:04:33.572 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:04:33.572 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T19:04:33.572 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-31T19:04:33.572 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T19:04:33.573 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:04:33.573 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T19:04:33.573 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-31T19:04:33.573 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T19:04:33.574 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:04:33.583 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T19:04:33.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T19:04:33.585 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T19:04:33.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T19:04:33.589 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T19:04:33.589 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T19:04:33.590 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T19:04:33.590 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T19:04:33.629 INFO:tasks.ceph.mds.a:Started 2023-08-31T19:04:33.629 DEBUG:teuthology.parallel:result is None 2023-08-31T19:04:33.633 INFO:tasks.ceph.mds.c:Started 2023-08-31T19:04:33.633 DEBUG:teuthology.parallel:result is None 2023-08-31T19:04:33.634 INFO:tasks.ceph.mds.b:Started 2023-08-31T19:04:33.634 DEBUG:teuthology.parallel:result is None 2023-08-31T19:04:33.638 INFO:tasks.ceph.mds.d:Started 2023-08-31T19:04:33.638 DEBUG:teuthology.parallel:result is None 2023-08-31T19:04:33.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-31T19:04:33.772 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T19:04:33.777 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-31T19:04:33.785 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-08-31T19:04:33.785 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-08-31T19:04:33.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.845+0000 7fd4655ff700 1 Processor -- start 2023-08-31T19:04:33.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.846+0000 7fd4655ff700 1 -- start start 2023-08-31T19:04:33.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.847+0000 7fd4655ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4601558f0 0x7fd4600bba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:33.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.847+0000 7fd4655ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd4600bbf80 0x7fd4600a66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:33.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.847+0000 7fd4655ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4600a6bd0 0x7fd4600a7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:33.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.847+0000 7fd4655ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4600c2d40 con 0x7fd4600a6bd0 2023-08-31T19:04:33.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.847+0000 7fd4655ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4600bd9c0 con 0x7fd4600bbf80 2023-08-31T19:04:33.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.847+0000 7fd4655ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4600c1ea0 con 0x7fd4601558f0 2023-08-31T19:04:33.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.847+0000 7fd45f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4600a6bd0 0x7fd4600a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:33.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.847+0000 7fd45f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4600a6bd0 0x7fd4600a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42646/0 (socket says 172.21.15.72:42646) 2023-08-31T19:04:33.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.847+0000 7fd45f7fe700 1 -- 172.21.15.72:0/1827318266 learned_addr learned my addr 172.21.15.72:0/1827318266 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:33.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.847+0000 7fd45f7fe700 1 -- 172.21.15.72:0/1827318266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4601558f0 msgr2=0x7fd4600bba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:33.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.847+0000 7fd45f7fe700 1 --2- 172.21.15.72:0/1827318266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4601558f0 0x7fd4600bba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:33.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.847+0000 7fd45f7fe700 1 -- 172.21.15.72:0/1827318266 >> v2:172.21.15.146:3300/0 conn(0x7fd4600bbf80 msgr2=0x7fd4600a66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:33.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.847+0000 7fd45f7fe700 1 --2- 172.21.15.72:0/1827318266 >> v2:172.21.15.146:3300/0 conn(0x7fd4600bbf80 0x7fd4600a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:33.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.847+0000 7fd45f7fe700 1 -- 172.21.15.72:0/1827318266 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd460155cd0 con 0x7fd4600a6bd0 2023-08-31T19:04:33.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.848+0000 7fd45f7fe700 1 --2- 172.21.15.72:0/1827318266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4600a6bd0 0x7fd4600a7080 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7fd458009f20 tx=0x7fd458009840).ready entity=mon.0 client_cookie=f33d6ce93e80c3a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:33.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.848+0000 7fd45dffb700 1 -- 172.21.15.72:0/1827318266 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45800e070 con 0x7fd4600a6bd0 2023-08-31T19:04:33.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.848+0000 7fd45dffb700 1 -- 172.21.15.72:0/1827318266 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45800ba40 con 0x7fd4600a6bd0 2023-08-31T19:04:33.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.848+0000 7fd45dffb700 1 -- 172.21.15.72:0/1827318266 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45800bdc0 con 0x7fd4600a6bd0 2023-08-31T19:04:33.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.848+0000 7fd4655ff700 1 -- 172.21.15.72:0/1827318266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4600a6bd0 msgr2=0x7fd4600a7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:33.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.848+0000 7fd4655ff700 1 --2- 172.21.15.72:0/1827318266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4600a6bd0 0x7fd4600a7080 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7fd458009f20 tx=0x7fd458009840).stop 2023-08-31T19:04:33.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.848+0000 7fd4655ff700 1 -- 172.21.15.72:0/1827318266 shutdown_connections 2023-08-31T19:04:33.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.848+0000 7fd4655ff700 1 --2- 172.21.15.72:0/1827318266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4600a6bd0 0x7fd4600a7080 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:33.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.848+0000 7fd4655ff700 1 --2- 172.21.15.72:0/1827318266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4601558f0 0x7fd4600bba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:33.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.848+0000 7fd4655ff700 1 --2- 172.21.15.72:0/1827318266 >> v2:172.21.15.146:3300/0 conn(0x7fd4600bbf80 0x7fd4600a66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:33.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.848+0000 7fd4655ff700 1 -- 172.21.15.72:0/1827318266 >> 172.21.15.72:0/1827318266 conn(0x7fd460063120 msgr2=0x7fd4600c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:33.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.849+0000 7fd4655ff700 1 -- 172.21.15.72:0/1827318266 shutdown_connections 2023-08-31T19:04:33.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.849+0000 7fd4655ff700 1 -- 172.21.15.72:0/1827318266 wait complete. 2023-08-31T19:04:33.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.850+0000 7fd4655ff700 1 Processor -- start 2023-08-31T19:04:33.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.850+0000 7fd4655ff700 1 -- start start 2023-08-31T19:04:33.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.851+0000 7fd4655ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4600a6bd0 0x7fd460154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:33.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.851+0000 7fd4655ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4600bbf80 0x7fd4600bf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:33.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.851+0000 7fd4655ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4601558f0 0x7fd4600c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:33.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.851+0000 7fd4655ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd460154a80 con 0x7fd4601558f0 2023-08-31T19:04:33.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.851+0000 7fd4655ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4601390a0 con 0x7fd4600a6bd0 2023-08-31T19:04:33.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.851+0000 7fd4655ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4600c0750 con 0x7fd4600bbf80 2023-08-31T19:04:33.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.851+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4601558f0 0x7fd4600c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:33.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.851+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4601558f0 0x7fd4600c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42650/0 (socket says 172.21.15.72:42650) 2023-08-31T19:04:33.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.851+0000 7fd45f7fe700 1 -- 172.21.15.72:0/2959649312 learned_addr learned my addr 172.21.15.72:0/2959649312 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:33.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.851+0000 7fd45e7fc700 1 --2- 172.21.15.72:0/2959649312 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4600bbf80 0x7fd4600bf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:33.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.851+0000 7fd45effd700 1 --2- 172.21.15.72:0/2959649312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4600a6bd0 0x7fd460154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:33.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.852+0000 7fd45f7fe700 1 -- 172.21.15.72:0/2959649312 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4600bbf80 msgr2=0x7fd4600bf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.852+0000 7fd45f7fe700 1 --2- 172.21.15.72:0/2959649312 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4600bbf80 0x7fd4600bf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.852+0000 7fd45f7fe700 1 -- 172.21.15.72:0/2959649312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4600a6bd0 msgr2=0x7fd460154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.852+0000 7fd45f7fe700 1 --2- 172.21.15.72:0/2959649312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4600a6bd0 0x7fd460154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.852+0000 7fd45f7fe700 1 -- 172.21.15.72:0/2959649312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd458009ae0 con 0x7fd4601558f0 2023-08-31T19:04:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.852+0000 7fd45f7fe700 1 --2- 172.21.15.72:0/2959649312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4601558f0 0x7fd4600c5a20 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7fd460068000 tx=0x7fd458009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.852+0000 7fd446ffd700 1 -- 172.21.15.72:0/2959649312 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45800bdc0 con 0x7fd4601558f0 2023-08-31T19:04:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.852+0000 7fd446ffd700 1 -- 172.21.15.72:0/2959649312 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4580092e0 con 0x7fd4601558f0 2023-08-31T19:04:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.852+0000 7fd4655ff700 1 -- 172.21.15.72:0/2959649312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4600a9ea0 con 0x7fd4601558f0 2023-08-31T19:04:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.852+0000 7fd446ffd700 1 -- 172.21.15.72:0/2959649312 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45801c650 con 0x7fd4601558f0 2023-08-31T19:04:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.853+0000 7fd4655ff700 1 -- 172.21.15.72:0/2959649312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4600aa460 con 0x7fd4601558f0 2023-08-31T19:04:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.854+0000 7fd4655ff700 1 -- 172.21.15.72:0/2959649312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd460139230 con 0x7fd4601558f0 2023-08-31T19:04:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.855+0000 7fd446ffd700 1 -- 172.21.15.72:0/2959649312 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd45801c9c0 con 0x7fd4601558f0 2023-08-31T19:04:33.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.855+0000 7fd446ffd700 1 --2- 172.21.15.72:0/2959649312 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd44c05ef30 0x7fd44c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:33.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.855+0000 7fd446ffd700 1 -- 172.21.15.72:0/2959649312 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fd45807bab0 con 0x7fd4601558f0 2023-08-31T19:04:33.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.856+0000 7fd45effd700 1 --2- 172.21.15.72:0/2959649312 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd44c05ef30 0x7fd44c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:33.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.856+0000 7fd45effd700 1 --2- 172.21.15.72:0/2959649312 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd44c05ef30 0x7fd44c0613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd4500099e0 tx=0x7fd450006f30).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:33.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:33.860+0000 7fd446ffd700 1 -- 172.21.15.72:0/2959649312 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd460139230 con 0x7fd4601558f0 2023-08-31T19:04:34.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:34.044+0000 7fd4655ff700 1 -- 172.21.15.72:0/2959649312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd460139230 con 0x7fd4601558f0 2023-08-31T19:04:34.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:34.916+0000 7fd446ffd700 1 -- 172.21.15.72:0/2959649312 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v105) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd460139230 con 0x7fd4601558f0 2023-08-31T19:04:34.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:34.918+0000 7fd4655ff700 1 -- 172.21.15.72:0/2959649312 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd44c05ef30 msgr2=0x7fd44c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:34.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:34.918+0000 7fd4655ff700 1 --2- 172.21.15.72:0/2959649312 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd44c05ef30 0x7fd44c0613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fd4500099e0 tx=0x7fd450006f30).stop 2023-08-31T19:04:34.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:34.918+0000 7fd4655ff700 1 -- 172.21.15.72:0/2959649312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4601558f0 msgr2=0x7fd4600c5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:34.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:34.918+0000 7fd4655ff700 1 --2- 172.21.15.72:0/2959649312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4601558f0 0x7fd4600c5a20 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7fd460068000 tx=0x7fd458009840).stop 2023-08-31T19:04:34.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:34.919+0000 7fd4655ff700 1 -- 172.21.15.72:0/2959649312 shutdown_connections 2023-08-31T19:04:34.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:34.919+0000 7fd4655ff700 1 --2- 172.21.15.72:0/2959649312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4601558f0 0x7fd4600c5a20 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:34.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:34.919+0000 7fd4655ff700 1 --2- 172.21.15.72:0/2959649312 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd44c05ef30 0x7fd44c0613f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:34.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:34.919+0000 7fd4655ff700 1 --2- 172.21.15.72:0/2959649312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4600a6bd0 0x7fd460154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:34.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:34.919+0000 7fd4655ff700 1 --2- 172.21.15.72:0/2959649312 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4600bbf80 0x7fd4600bf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:34.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:34.919+0000 7fd4655ff700 1 -- 172.21.15.72:0/2959649312 >> 172.21.15.72:0/2959649312 conn(0x7fd460063120 msgr2=0x7fd4600c4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:34.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:34.919+0000 7fd4655ff700 1 -- 172.21.15.72:0/2959649312 shutdown_connections 2023-08-31T19:04:34.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:34.919+0000 7fd4655ff700 1 -- 172.21.15.72:0/2959649312 wait complete. 2023-08-31T19:04:34.921 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-08-31T19:04:34.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-31T19:04:35.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.132+0000 7fc823dff700 1 Processor -- start 2023-08-31T19:04:35.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.132+0000 7fc823dff700 1 -- start start 2023-08-31T19:04:35.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.134+0000 7fc823dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc81c154220 0x7fc81c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:35.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.134+0000 7fc823dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81c1588d0 0x7fc81c0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:35.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.134+0000 7fc823dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81c0c8c90 con 0x7fc81c0cb940 2023-08-31T19:04:35.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.134+0000 7fc823dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81c0aa700 con 0x7fc81c154220 2023-08-31T19:04:35.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.134+0000 7fc823dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0c5e10 con 0x7fc81c1588d0 2023-08-31T19:04:35.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.134+0000 7fc821b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc81c154220 0x7fc81c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:35.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.134+0000 7fc821b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc81c154220 0x7fc81c157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42662/0 (socket says 172.21.15.72:42662) 2023-08-31T19:04:35.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.134+0000 7fc821b9b700 1 -- 172.21.15.72:0/248837855 learned_addr learned my addr 172.21.15.72:0/248837855 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:35.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.134+0000 7fc821b9b700 1 -- 172.21.15.72:0/248837855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81c1588d0 msgr2=0x7fc81c0c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:35.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.134+0000 7fc821b9b700 1 --2- 172.21.15.72:0/248837855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81c1588d0 0x7fc81c0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:35.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.134+0000 7fc821b9b700 1 -- 172.21.15.72:0/248837855 >> v1:172.21.15.146:6789/0 conn(0x7fc81c0cb940 legacy=0x7fc81c1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:35.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.134+0000 7fc821b9b700 1 -- 172.21.15.72:0/248837855 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c155610 con 0x7fc81c154220 2023-08-31T19:04:35.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.134+0000 7fc821b9b700 1 --2- 172.21.15.72:0/248837855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81c154220 0x7fc81c157cd0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7fc818006fd0 tx=0x7fc8180090f0).ready entity=mon.0 client_cookie=ef1cdfbb64d9661b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:35.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.135+0000 7fc820b99700 1 -- 172.21.15.72:0/248837855 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81800b600 con 0x7fc81c154220 2023-08-31T19:04:35.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.135+0000 7fc820b99700 1 -- 172.21.15.72:0/248837855 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81800b760 con 0x7fc81c154220 2023-08-31T19:04:35.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.135+0000 7fc820b99700 1 -- 172.21.15.72:0/248837855 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81800bb00 con 0x7fc81c154220 2023-08-31T19:04:35.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.135+0000 7fc823dff700 1 -- 172.21.15.72:0/248837855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81c154220 msgr2=0x7fc81c157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:35.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.135+0000 7fc823dff700 1 --2- 172.21.15.72:0/248837855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81c154220 0x7fc81c157cd0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7fc818006fd0 tx=0x7fc8180090f0).stop 2023-08-31T19:04:35.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.135+0000 7fc823dff700 1 -- 172.21.15.72:0/248837855 shutdown_connections 2023-08-31T19:04:35.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.135+0000 7fc823dff700 1 --2- 172.21.15.72:0/248837855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81c1588d0 0x7fc81c0c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:35.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.135+0000 7fc823dff700 1 --2- 172.21.15.72:0/248837855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81c154220 0x7fc81c157cd0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.135+0000 7fc823dff700 1 -- 172.21.15.72:0/248837855 >> 172.21.15.72:0/248837855 conn(0x7fc81c05e870 msgr2=0x7fc81c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:35.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.135+0000 7fc823dff700 1 -- 172.21.15.72:0/248837855 shutdown_connections 2023-08-31T19:04:35.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.135+0000 7fc823dff700 1 -- 172.21.15.72:0/248837855 wait complete. 2023-08-31T19:04:35.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.137+0000 7fc823dff700 1 Processor -- start 2023-08-31T19:04:35.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.137+0000 7fc823dff700 1 -- start start 2023-08-31T19:04:35.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.138+0000 7fc823dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81c0cb940 0x7fc81c0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:35.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc823dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81c154220 0x7fc81c0c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:35.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc823dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc81c1588d0 0x7fc81c0a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:35.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc823dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0c3340 con 0x7fc81c154220 2023-08-31T19:04:35.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc823dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0c2730 con 0x7fc81c1588d0 2023-08-31T19:04:35.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc823dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0c2a10 con 0x7fc81c0cb940 2023-08-31T19:04:35.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc82139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81c154220 0x7fc81c0c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:35.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc82139a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81c154220 0x7fc81c0c1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42668/0 (socket says 172.21.15.72:42668) 2023-08-31T19:04:35.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc82139a700 1 -- 172.21.15.72:0/3916085364 learned_addr learned my addr 172.21.15.72:0/3916085364 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:35.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc821b9b700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81c0cb940 0x7fc81c0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:35.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc82239c700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc81c1588d0 0x7fc81c0a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:35.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc82139a700 1 -- 172.21.15.72:0/3916085364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81c0cb940 msgr2=0x7fc81c0b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:35.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc82139a700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81c0cb940 0x7fc81c0b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc82139a700 1 -- 172.21.15.72:0/3916085364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc81c1588d0 msgr2=0x7fc81c0a8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:35.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc82139a700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc81c1588d0 0x7fc81c0a8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc82139a700 1 -- 172.21.15.72:0/3916085364 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc818009310 con 0x7fc81c154220 2023-08-31T19:04:35.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc821b9b700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81c0cb940 0x7fc81c0b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:35.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc82239c700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc81c1588d0 0x7fc81c0a8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:35.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.139+0000 7fc82139a700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81c154220 0x7fc81c0c1e30 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7fc80c00b490 tx=0x7fc80c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:35.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.140+0000 7fc811ffb700 1 -- 172.21.15.72:0/3916085364 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c00d4a0 con 0x7fc81c154220 2023-08-31T19:04:35.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.140+0000 7fc811ffb700 1 -- 172.21.15.72:0/3916085364 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80c00d640 con 0x7fc81c154220 2023-08-31T19:04:35.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.140+0000 7fc823dff700 1 -- 172.21.15.72:0/3916085364 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c0c2cf0 con 0x7fc81c154220 2023-08-31T19:04:35.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.140+0000 7fc811ffb700 1 -- 172.21.15.72:0/3916085364 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c00da00 con 0x7fc81c154220 2023-08-31T19:04:35.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.140+0000 7fc823dff700 1 -- 172.21.15.72:0/3916085364 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81c0b0c40 con 0x7fc81c154220 2023-08-31T19:04:35.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.141+0000 7fc823dff700 1 -- 172.21.15.72:0/3916085364 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81c0ae850 con 0x7fc81c154220 2023-08-31T19:04:35.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.141+0000 7fc811ffb700 1 -- 172.21.15.72:0/3916085364 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc80c012410 con 0x7fc81c154220 2023-08-31T19:04:35.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.142+0000 7fc811ffb700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc80005ef30 0x7fc8000613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:35.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.142+0000 7fc811ffb700 1 -- 172.21.15.72:0/3916085364 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5869+0+0 (secure 0 0 0) 0x7fc80c079e70 con 0x7fc81c154220 2023-08-31T19:04:35.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.142+0000 7fc821b9b700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc80005ef30 0x7fc8000613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:35.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.143+0000 7fc821b9b700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc80005ef30 0x7fc8000613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc818009130 tx=0x7fc818017000).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:35.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.146+0000 7fc811ffb700 1 -- 172.21.15.72:0/3916085364 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc80c04b140 con 0x7fc81c154220 2023-08-31T19:04:35.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.378+0000 7fc823dff700 1 -- 172.21.15.72:0/3916085364 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc81c06c6b0 con 0x7fc81c154220 2023-08-31T19:04:35.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.379+0000 7fc811ffb700 1 -- 172.21.15.72:0/3916085364 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc80c00ddb0 con 0x7fc81c154220 2023-08-31T19:04:35.379 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:35.379 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:04:35.380 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-08-31T19:04:35.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.380 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-08-31T19:04:35.380 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkPeqvDBAAA2eEr6xr7iF5PPNT9eehSg==", 2023-08-31T19:04:35.380 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.381 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:35.381 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:04:35.381 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:04:35.381 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:35.381 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.382 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-08-31T19:04:35.382 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkctxUIxAAufSVXMwPzPA7Gq1s4ukXiQ==", 2023-08-31T19:04:35.382 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.383 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:35.383 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:04:35.383 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:04:35.383 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:35.383 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.384 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-08-31T19:04:35.384 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkcpLfFxAASIB//h8whjuh6s3YKBVffQ==", 2023-08-31T19:04:35.384 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.384 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:35.385 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:04:35.385 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:04:35.385 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:35.385 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.386 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-08-31T19:04:35.386 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkC1bbLhAAg/0wct2P0+cyWbZyI2bP/g==", 2023-08-31T19:04:35.386 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.386 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:35.387 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:04:35.387 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:04:35.387 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:35.387 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.388 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-08-31T19:04:35.388 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAi4PBkvfRJEBAAYQqPldOXrJxXAXnmZhXaBQ==", 2023-08-31T19:04:35.388 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.388 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:35.388 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:35.388 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:35.389 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.389 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-08-31T19:04:35.389 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAl4PBkYysSIhAA4nCmskcGV+i4vpH2k/gDBg==", 2023-08-31T19:04:35.390 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.390 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:35.390 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:35.390 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:35.390 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.391 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-08-31T19:04:35.391 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAp4PBkyDgJFxAAPynEKk15yN7+OxQxpzL0UQ==", 2023-08-31T19:04:35.391 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.391 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:35.392 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:35.392 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:35.392 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.393 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-08-31T19:04:35.393 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAs4PBkZMD2KBAAoJrO4YjJ4/8MjcPAtgEn1g==", 2023-08-31T19:04:35.393 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.393 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:35.393 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:35.393 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:35.394 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.394 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-08-31T19:04:35.394 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAz4PBkSgAoExAAJ95kdHV47jDTXSj/WSCiLw==", 2023-08-31T19:04:35.395 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.395 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:35.395 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:35.395 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:35.395 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.396 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-08-31T19:04:35.396 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA24PBkUxpLKBAAAu8d6iKME6wW+Q/6hhFIRQ==", 2023-08-31T19:04:35.396 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.396 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:35.396 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:35.397 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:35.397 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.397 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-08-31T19:04:35.397 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA54PBkURHJOhAA3HaPfENVQ4hLIjc/esF0bQ==", 2023-08-31T19:04:35.398 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.398 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:35.398 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:35.398 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:35.398 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.399 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-08-31T19:04:35.399 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA94PBkfoqTEBAAQHENgrp5tv1X47Br/dUksQ==", 2023-08-31T19:04:35.399 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.400 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:04:35.400 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:04:35.400 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:35.400 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.401 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-08-31T19:04:35.401 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkucWuOBAABLowlGxpCR3GgoOCRmC0FQ==", 2023-08-31T19:04:35.401 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.401 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:35.401 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow r", 2023-08-31T19:04:35.401 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-31T19:04:35.402 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.402 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-08-31T19:04:35.402 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkVGBPCxAAO4M9u24/yH0xwtV6oSz+JQ==", 2023-08-31T19:04:35.402 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.403 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:35.403 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:04:35.403 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:04:35.403 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:04:35.403 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.404 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.2", 2023-08-31T19:04:35.404 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkYeIoBBAAjoIzJJ9McIx3rLBSaorTKA==", 2023-08-31T19:04:35.404 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.404 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:35.405 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:04:35.405 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:04:35.405 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:04:35.405 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.406 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.3", 2023-08-31T19:04:35.406 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkX/V9EhAAqWuBMMhikN/JUQp3v5/ABQ==", 2023-08-31T19:04:35.406 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.406 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:04:35.407 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:04:35.407 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:04:35.407 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:04:35.407 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.408 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-08-31T19:04:35.408 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkCRlhDhAAxvcGr+KTvLoJmtuZC89Iuw==", 2023-08-31T19:04:35.408 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.408 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:04:35.408 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:04:35.408 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:04:35.409 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:35.409 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.409 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-08-31T19:04:35.409 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkiGBUBRAAwWTFqrz+ELBSwb0Z2T9yhQ==", 2023-08-31T19:04:35.410 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.410 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:04:35.410 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:04:35.410 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:35.410 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:35.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:35.411 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-08-31T19:04:35.411 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkSWszNRAAdBxrfMEuBRgePfaiPx6kpQ==", 2023-08-31T19:04:35.411 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:04:35.411 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:04:35.412 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:04:35.412 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:04:35.412 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.412 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:35.412 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-08-31T19:04:35.412 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:04:35.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.381+0000 7fc823dff700 1 -- 172.21.15.72:0/3916085364 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc80005ef30 msgr2=0x7fc8000613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:35.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.381+0000 7fc823dff700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc80005ef30 0x7fc8000613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc818009130 tx=0x7fc818017000).stop 2023-08-31T19:04:35.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.381+0000 7fc823dff700 1 -- 172.21.15.72:0/3916085364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81c154220 msgr2=0x7fc81c0c1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:35.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.381+0000 7fc823dff700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81c154220 0x7fc81c0c1e30 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7fc80c00b490 tx=0x7fc80c009060).stop 2023-08-31T19:04:35.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.381+0000 7fc823dff700 1 -- 172.21.15.72:0/3916085364 shutdown_connections 2023-08-31T19:04:35.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.381+0000 7fc823dff700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc80005ef30 0x7fc8000613f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.381+0000 7fc823dff700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc81c1588d0 0x7fc81c0a8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.381+0000 7fc823dff700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc81c0cb940 0x7fc81c0b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.381+0000 7fc823dff700 1 --2- 172.21.15.72:0/3916085364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81c154220 0x7fc81c0c1e30 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.381+0000 7fc823dff700 1 -- 172.21.15.72:0/3916085364 >> 172.21.15.72:0/3916085364 conn(0x7fc81c05e870 msgr2=0x7fc81c0a7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:35.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.381+0000 7fc823dff700 1 -- 172.21.15.72:0/3916085364 shutdown_connections 2023-08-31T19:04:35.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.381+0000 7fc823dff700 1 -- 172.21.15.72:0/3916085364 wait complete. 2023-08-31T19:04:35.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:04:35.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.608+0000 7f66cc1ff700 1 Processor -- start 2023-08-31T19:04:35.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.608+0000 7f66cc1ff700 1 -- start start 2023-08-31T19:04:35.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.610+0000 7f66cc1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f66c4154060 0x7f66c4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.610+0000 7f66cc1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f66c40cb9b0 0x7f66c41581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.610+0000 7f66cc1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c40c6120 con 0x7f66c41586b0 2023-08-31T19:04:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.610+0000 7f66cc1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c40c1380 con 0x7f66c4154060 2023-08-31T19:04:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.610+0000 7f66cc1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c40c5e10 con 0x7f66c40cb9b0 2023-08-31T19:04:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.610+0000 7f66c9f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f66c4154060 0x7f66c4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:35.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.610+0000 7f66c9f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f66c4154060 0x7f66c4157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42670/0 (socket says 172.21.15.72:42670) 2023-08-31T19:04:35.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.610+0000 7f66c9f9b700 1 -- 172.21.15.72:0/315918038 learned_addr learned my addr 172.21.15.72:0/315918038 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:35.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.610+0000 7f66c979a700 1 --2- 172.21.15.72:0/315918038 >> v2:172.21.15.146:3300/0 conn(0x7f66c40cb9b0 0x7f66c41581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:35.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.610+0000 7f66c9f9b700 1 -- 172.21.15.72:0/315918038 >> v2:172.21.15.146:3300/0 conn(0x7f66c40cb9b0 msgr2=0x7f66c41581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:35.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.610+0000 7f66c9f9b700 1 --2- 172.21.15.72:0/315918038 >> v2:172.21.15.146:3300/0 conn(0x7f66c40cb9b0 0x7f66c41581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.610+0000 7f66c9f9b700 1 -- 172.21.15.72:0/315918038 >> v1:172.21.15.146:6789/0 conn(0x7f66c41586b0 legacy=0x7f66c40c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:35.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.610+0000 7f66c9f9b700 1 -- 172.21.15.72:0/315918038 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c4158b00 con 0x7f66c4154060 2023-08-31T19:04:35.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.610+0000 7f66c979a700 1 --2- 172.21.15.72:0/315918038 >> v2:172.21.15.146:3300/0 conn(0x7f66c40cb9b0 0x7f66c41581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:35.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.610+0000 7f66c9f9b700 1 --2- 172.21.15.72:0/315918038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66c4154060 0x7f66c4157cd0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f66c4083190 tx=0x7f66c00090f0).ready entity=mon.0 client_cookie=203b2e0c19ac17d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:35.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.611+0000 7f66c8f99700 1 -- 172.21.15.72:0/315918038 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c000b580 con 0x7f66c4154060 2023-08-31T19:04:35.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.611+0000 7f66c8f99700 1 -- 172.21.15.72:0/315918038 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c000b6e0 con 0x7f66c4154060 2023-08-31T19:04:35.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.611+0000 7f66c8f99700 1 -- 172.21.15.72:0/315918038 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c000ba80 con 0x7f66c4154060 2023-08-31T19:04:35.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.611+0000 7f66cc1ff700 1 -- 172.21.15.72:0/315918038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66c4154060 msgr2=0x7f66c4157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:35.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.611+0000 7f66cc1ff700 1 --2- 172.21.15.72:0/315918038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66c4154060 0x7f66c4157cd0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f66c4083190 tx=0x7f66c00090f0).stop 2023-08-31T19:04:35.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.611+0000 7f66cc1ff700 1 -- 172.21.15.72:0/315918038 shutdown_connections 2023-08-31T19:04:35.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.611+0000 7f66cc1ff700 1 --2- 172.21.15.72:0/315918038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66c4154060 0x7f66c4157cd0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.611+0000 7f66cc1ff700 1 --2- 172.21.15.72:0/315918038 >> v2:172.21.15.146:3300/0 conn(0x7f66c40cb9b0 0x7f66c41581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.611+0000 7f66cc1ff700 1 -- 172.21.15.72:0/315918038 >> 172.21.15.72:0/315918038 conn(0x7f66c405e870 msgr2=0x7f66c40cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:35.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.611+0000 7f66cc1ff700 1 -- 172.21.15.72:0/315918038 shutdown_connections 2023-08-31T19:04:35.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.611+0000 7f66cc1ff700 1 -- 172.21.15.72:0/315918038 wait complete. 2023-08-31T19:04:35.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.613+0000 7f66cc1ff700 1 Processor -- start 2023-08-31T19:04:35.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.613+0000 7f66cc1ff700 1 -- start start 2023-08-31T19:04:35.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.614+0000 7f66cc1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66c40cb9b0 0x7f66c4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:35.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.614+0000 7f66cc1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c4154060 0x7f66c4156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:35.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.614+0000 7f66cc1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66c41586b0 0x7f66c4150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:35.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.614+0000 7f66cc1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c4150fd0 con 0x7f66c41586b0 2023-08-31T19:04:35.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.614+0000 7f66cc1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c40ab210 con 0x7f66c40cb9b0 2023-08-31T19:04:35.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.614+0000 7f66cc1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c41565a0 con 0x7f66c4154060 2023-08-31T19:04:35.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.614+0000 7f66ca79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66c41586b0 0x7f66c4150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:35.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.614+0000 7f66ca79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66c41586b0 0x7f66c4150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42680/0 (socket says 172.21.15.72:42680) 2023-08-31T19:04:35.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.614+0000 7f66ca79c700 1 -- 172.21.15.72:0/3438068710 learned_addr learned my addr 172.21.15.72:0/3438068710 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:35.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.614+0000 7f66c9f9b700 1 --2- 172.21.15.72:0/3438068710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66c40cb9b0 0x7f66c4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:35.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.614+0000 7f66c979a700 1 --2- 172.21.15.72:0/3438068710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c4154060 0x7f66c4156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:35.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.615+0000 7f66ca79c700 1 -- 172.21.15.72:0/3438068710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c4154060 msgr2=0x7f66c4156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:35.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.615+0000 7f66ca79c700 1 --2- 172.21.15.72:0/3438068710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c4154060 0x7f66c4156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.615+0000 7f66ca79c700 1 -- 172.21.15.72:0/3438068710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66c40cb9b0 msgr2=0x7f66c4155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:35.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.615+0000 7f66ca79c700 1 --2- 172.21.15.72:0/3438068710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66c40cb9b0 0x7f66c4155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.615+0000 7f66ca79c700 1 -- 172.21.15.72:0/3438068710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c0009310 con 0x7f66c41586b0 2023-08-31T19:04:35.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.615+0000 7f66ca79c700 1 --2- 172.21.15.72:0/3438068710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66c41586b0 0x7f66c4150ae0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f66bc00b810 tx=0x7f66bc009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:35.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.615+0000 7f66b9ffb700 1 -- 172.21.15.72:0/3438068710 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00d4a0 con 0x7f66c41586b0 2023-08-31T19:04:35.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.615+0000 7f66b9ffb700 1 -- 172.21.15.72:0/3438068710 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66bc00d640 con 0x7f66c41586b0 2023-08-31T19:04:35.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.615+0000 7f66cc1ff700 1 -- 172.21.15.72:0/3438068710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c40ab430 con 0x7f66c41586b0 2023-08-31T19:04:35.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.615+0000 7f66b9ffb700 1 -- 172.21.15.72:0/3438068710 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00da00 con 0x7f66c41586b0 2023-08-31T19:04:35.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.615+0000 7f66cc1ff700 1 -- 172.21.15.72:0/3438068710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c40ab9f0 con 0x7f66c41586b0 2023-08-31T19:04:35.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.617+0000 7f66cc1ff700 1 -- 172.21.15.72:0/3438068710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c406c6b0 con 0x7f66c41586b0 2023-08-31T19:04:35.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.617+0000 7f66b9ffb700 1 -- 172.21.15.72:0/3438068710 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f66bc011400 con 0x7f66c41586b0 2023-08-31T19:04:35.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.618+0000 7f66b9ffb700 1 --2- 172.21.15.72:0/3438068710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f66a805ef30 0x7f66a80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:35.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.618+0000 7f66b9ffb700 1 -- 172.21.15.72:0/3438068710 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f66bc079720 con 0x7f66c41586b0 2023-08-31T19:04:35.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.618+0000 7f66c9f9b700 1 --2- 172.21.15.72:0/3438068710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f66a805ef30 0x7f66a80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:35.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.619+0000 7f66c9f9b700 1 --2- 172.21.15.72:0/3438068710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f66a805ef30 0x7f66a80613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f66c0009130 tx=0x7f66c0017000).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:35.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.622+0000 7f66b9ffb700 1 -- 172.21.15.72:0/3438068710 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f66bc0478f0 con 0x7f66c41586b0 2023-08-31T19:04:35.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.792+0000 7f66cc1ff700 1 -- 172.21.15.72:0/3438068710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66c40c0ae0 con 0x7f66c41586b0 2023-08-31T19:04:35.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.793+0000 7f66b9ffb700 1 -- 172.21.15.72:0/3438068710 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+14717 (secure 0 0 0) 0x7f66bc04e4d0 con 0x7f66c41586b0 2023-08-31T19:04:35.793 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:35.793 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":105,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:04:34.911914+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:04:35.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.795+0000 7f66cc1ff700 1 -- 172.21.15.72:0/3438068710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f66a805ef30 msgr2=0x7f66a80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:35.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.795+0000 7f66cc1ff700 1 --2- 172.21.15.72:0/3438068710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f66a805ef30 0x7f66a80613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f66c0009130 tx=0x7f66c0017000).stop 2023-08-31T19:04:35.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.795+0000 7f66cc1ff700 1 -- 172.21.15.72:0/3438068710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66c41586b0 msgr2=0x7f66c4150ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:35.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.795+0000 7f66cc1ff700 1 --2- 172.21.15.72:0/3438068710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66c41586b0 0x7f66c4150ae0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f66bc00b810 tx=0x7f66bc009270).stop 2023-08-31T19:04:35.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.795+0000 7f66cc1ff700 1 -- 172.21.15.72:0/3438068710 shutdown_connections 2023-08-31T19:04:35.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.795+0000 7f66cc1ff700 1 --2- 172.21.15.72:0/3438068710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66c41586b0 0x7f66c4150ae0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.795+0000 7f66cc1ff700 1 --2- 172.21.15.72:0/3438068710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f66a805ef30 0x7f66a80613f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.795+0000 7f66cc1ff700 1 --2- 172.21.15.72:0/3438068710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66c40cb9b0 0x7f66c4155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.795+0000 7f66cc1ff700 1 --2- 172.21.15.72:0/3438068710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66c4154060 0x7f66c4156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:35.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.795+0000 7f66cc1ff700 1 -- 172.21.15.72:0/3438068710 >> 172.21.15.72:0/3438068710 conn(0x7f66c405e870 msgr2=0x7f66c4063090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:35.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.795+0000 7f66cc1ff700 1 -- 172.21.15.72:0/3438068710 shutdown_connections 2023-08-31T19:04:35.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:35.795+0000 7f66cc1ff700 1 -- 172.21.15.72:0/3438068710 wait complete. 2023-08-31T19:04:35.812 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-31T19:04:35.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:04:36.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.004+0000 7fa73f5ff700 1 Processor -- start 2023-08-31T19:04:36.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.005+0000 7fa73f5ff700 1 -- start start 2023-08-31T19:04:36.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.006+0000 7fa73f5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa7380c2320 0x7fa7380c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.006+0000 7fa73f5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7380c2cc0 con 0x7fa73814ecd0 2023-08-31T19:04:36.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.006+0000 7fa73f5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa738152720 con 0x7fa7380696a0 2023-08-31T19:04:36.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.006+0000 7fa73f5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa738151b10 con 0x7fa7380c2320 2023-08-31T19:04:36.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.006+0000 7fa73d39b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa73814ecd0 0x7fa7381556d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33120/0 (socket says 172.21.15.72:33120) 2023-08-31T19:04:36.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.006+0000 7fa73d39b700 1 -- 172.21.15.72:0/1277768451 learned_addr learned my addr 172.21.15.72:0/1277768451 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:36.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.007+0000 7fa73cb9a700 1 --2- 172.21.15.72:0/1277768451 >> v2:172.21.15.146:3300/0 conn(0x7fa7380c2320 0x7fa7380c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:36.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.007+0000 7fa72ffff700 1 -- 172.21.15.72:0/1277768451 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441341383 0 0) 0x7fa734001110 con 0x7fa73814ecd0 2023-08-31T19:04:36.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.007+0000 7fa72ffff700 1 -- 172.21.15.72:0/1277768451 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7240033f0 con 0x7fa73814ecd0 2023-08-31T19:04:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.007+0000 7fa73cb9a700 1 -- 172.21.15.72:0/1277768451 >> v1:172.21.15.146:6789/0 conn(0x7fa7380696a0 legacy=0x7fa738069af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.007+0000 7fa73cb9a700 1 -- 172.21.15.72:0/1277768451 >> v1:172.21.15.72:6789/0 conn(0x7fa73814ecd0 legacy=0x7fa7381556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.007+0000 7fa72ffff700 1 -- 172.21.15.72:0/1277768451 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3931953523 0 0) 0x7fa7240033f0 con 0x7fa73814ecd0 2023-08-31T19:04:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.007+0000 7fa73cb9a700 1 -- 172.21.15.72:0/1277768451 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa738151df0 con 0x7fa7380c2320 2023-08-31T19:04:36.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.007+0000 7fa73cb9a700 1 --2- 172.21.15.72:0/1277768451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7380c2320 0x7fa7380c27d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fa728009760 tx=0x7fa728009060).ready entity=mon.1 client_cookie=6a4aa67decc84fb2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:36.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.008+0000 7fa72ffff700 1 -- 172.21.15.72:0/1277768451 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734001600 con 0x7fa7380c2320 2023-08-31T19:04:36.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.008+0000 7fa72ffff700 1 -- 172.21.15.72:0/1277768451 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa728011400 con 0x7fa7380c2320 2023-08-31T19:04:36.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.008+0000 7fa72ffff700 1 -- 172.21.15.72:0/1277768451 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728011780 con 0x7fa7380c2320 2023-08-31T19:04:36.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.008+0000 7fa73f5ff700 1 -- 172.21.15.72:0/1277768451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7380c2320 msgr2=0x7fa7380c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.008+0000 7fa73f5ff700 1 --2- 172.21.15.72:0/1277768451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7380c2320 0x7fa7380c27d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fa728009760 tx=0x7fa728009060).stop 2023-08-31T19:04:36.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.008+0000 7fa73f5ff700 1 -- 172.21.15.72:0/1277768451 shutdown_connections 2023-08-31T19:04:36.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.008+0000 7fa73f5ff700 1 --2- 172.21.15.72:0/1277768451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7380c2320 0x7fa7380c27d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.008+0000 7fa73f5ff700 1 -- 172.21.15.72:0/1277768451 >> 172.21.15.72:0/1277768451 conn(0x7fa7380630c0 msgr2=0x7fa7380c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:36.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.008+0000 7fa73f5ff700 1 -- 172.21.15.72:0/1277768451 shutdown_connections 2023-08-31T19:04:36.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.008+0000 7fa73f5ff700 1 -- 172.21.15.72:0/1277768451 wait complete. 2023-08-31T19:04:36.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.010+0000 7fa73f5ff700 1 Processor -- start 2023-08-31T19:04:36.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.010+0000 7fa73f5ff700 1 -- start start 2023-08-31T19:04:36.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73f5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7380696a0 0x7fa7380a8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73f5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7380c2320 0x7fa738136540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73f5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73814ecd0 0x7fa7380a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73f5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa738155460 con 0x7fa73814ecd0 2023-08-31T19:04:36.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73f5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa738155d00 con 0x7fa7380696a0 2023-08-31T19:04:36.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73f5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa738136a30 con 0x7fa7380c2320 2023-08-31T19:04:36.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73db9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73814ecd0 0x7fa7380a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:36.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73db9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73814ecd0 0x7fa7380a65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42690/0 (socket says 172.21.15.72:42690) 2023-08-31T19:04:36.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73db9c700 1 -- 172.21.15.72:0/3333861648 learned_addr learned my addr 172.21.15.72:0/3333861648 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:36.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73d39b700 1 --2- 172.21.15.72:0/3333861648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7380696a0 0x7fa7380a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:36.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73cb9a700 1 --2- 172.21.15.72:0/3333861648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7380c2320 0x7fa738136540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:36.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73db9c700 1 -- 172.21.15.72:0/3333861648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7380c2320 msgr2=0x7fa738136540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73db9c700 1 --2- 172.21.15.72:0/3333861648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7380c2320 0x7fa738136540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73db9c700 1 -- 172.21.15.72:0/3333861648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7380696a0 msgr2=0x7fa7380a8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73db9c700 1 --2- 172.21.15.72:0/3333861648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7380696a0 0x7fa7380a8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73db9c700 1 -- 172.21.15.72:0/3333861648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7280092a0 con 0x7fa73814ecd0 2023-08-31T19:04:36.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.012+0000 7fa73cb9a700 1 --2- 172.21.15.72:0/3333861648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7380c2320 0x7fa738136540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:36.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.013+0000 7fa73db9c700 1 --2- 172.21.15.72:0/3333861648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73814ecd0 0x7fa7380a65e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fa730002230 tx=0x7fa7300015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:36.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.013+0000 7fa72d7fa700 1 -- 172.21.15.72:0/3333861648 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730010510 con 0x7fa73814ecd0 2023-08-31T19:04:36.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.013+0000 7fa72d7fa700 1 -- 172.21.15.72:0/3333861648 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa730010670 con 0x7fa73814ecd0 2023-08-31T19:04:36.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.013+0000 7fa73f5ff700 1 -- 172.21.15.72:0/3333861648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7380a8c00 con 0x7fa73814ecd0 2023-08-31T19:04:36.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.013+0000 7fa72d7fa700 1 -- 172.21.15.72:0/3333861648 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300109f0 con 0x7fa73814ecd0 2023-08-31T19:04:36.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.013+0000 7fa73f5ff700 1 -- 172.21.15.72:0/3333861648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa738155990 con 0x7fa73814ecd0 2023-08-31T19:04:36.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.014+0000 7fa73f5ff700 1 -- 172.21.15.72:0/3333861648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7380acb40 con 0x7fa73814ecd0 2023-08-31T19:04:36.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.015+0000 7fa72d7fa700 1 -- 172.21.15.72:0/3333861648 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa73001b400 con 0x7fa73814ecd0 2023-08-31T19:04:36.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.016+0000 7fa72d7fa700 1 --2- 172.21.15.72:0/3333861648 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa71c05ef00 0x7fa71c0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.016+0000 7fa72d7fa700 1 -- 172.21.15.72:0/3333861648 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5869+0+0 (secure 0 0 0) 0x7fa730079c60 con 0x7fa73814ecd0 2023-08-31T19:04:36.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.016+0000 7fa73d39b700 1 --2- 172.21.15.72:0/3333861648 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa71c05ef00 0x7fa71c0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:36.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.017+0000 7fa73d39b700 1 --2- 172.21.15.72:0/3333861648 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa71c05ef00 0x7fa71c0613c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa7381548f0 tx=0x7fa734001240).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:36.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.020+0000 7fa72d7fa700 1 -- 172.21.15.72:0/3333861648 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa73004afb0 con 0x7fa73814ecd0 2023-08-31T19:04:36.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.187+0000 7fa73f5ff700 1 -- 172.21.15.72:0/3333861648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa7381520d0 con 0x7fa73814ecd0 2023-08-31T19:04:36.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.188+0000 7fa72d7fa700 1 -- 172.21.15.72:0/3333861648 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v105) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa73004e5d0 con 0x7fa73814ecd0 2023-08-31T19:04:36.189 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:04:36.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.190+0000 7fa73f5ff700 1 -- 172.21.15.72:0/3333861648 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa71c05ef00 msgr2=0x7fa71c0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.190+0000 7fa73f5ff700 1 --2- 172.21.15.72:0/3333861648 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa71c05ef00 0x7fa71c0613c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa7381548f0 tx=0x7fa734001240).stop 2023-08-31T19:04:36.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.190+0000 7fa73f5ff700 1 -- 172.21.15.72:0/3333861648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73814ecd0 msgr2=0x7fa7380a65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.190+0000 7fa73f5ff700 1 --2- 172.21.15.72:0/3333861648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73814ecd0 0x7fa7380a65e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fa730002230 tx=0x7fa7300015e0).stop 2023-08-31T19:04:36.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.190+0000 7fa73f5ff700 1 -- 172.21.15.72:0/3333861648 shutdown_connections 2023-08-31T19:04:36.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.190+0000 7fa73f5ff700 1 --2- 172.21.15.72:0/3333861648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73814ecd0 0x7fa7380a65e0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.190+0000 7fa73f5ff700 1 --2- 172.21.15.72:0/3333861648 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa71c05ef00 0x7fa71c0613c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.190+0000 7fa73f5ff700 1 --2- 172.21.15.72:0/3333861648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7380696a0 0x7fa7380a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.190+0000 7fa73f5ff700 1 --2- 172.21.15.72:0/3333861648 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa7380c2320 0x7fa738136540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.190+0000 7fa73f5ff700 1 -- 172.21.15.72:0/3333861648 >> 172.21.15.72:0/3333861648 conn(0x7fa7380630c0 msgr2=0x7fa738069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:36.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.190+0000 7fa73f5ff700 1 -- 172.21.15.72:0/3333861648 shutdown_connections 2023-08-31T19:04:36.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.190+0000 7fa73f5ff700 1 -- 172.21.15.72:0/3333861648 wait complete. 2023-08-31T19:04:36.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:04:36.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.399+0000 7f6417dff700 1 Processor -- start 2023-08-31T19:04:36.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.399+0000 7f6417dff700 1 -- start start 2023-08-31T19:04:36.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.400+0000 7f6417dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64100658d0 0x7f6410065d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.400+0000 7f6417dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6410154520 0x7f64101549b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.400+0000 7f6417dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6410158720 con 0x7f6410154140 2023-08-31T19:04:36.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.400+0000 7f6417dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6410066240 con 0x7f6410154520 2023-08-31T19:04:36.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.400+0000 7f6417dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6410157e30 con 0x7f64100658d0 2023-08-31T19:04:36.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.401+0000 7f641639c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6410154520 0x7f64101549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:36.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.401+0000 7f641639c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6410154520 0x7f64101549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42702/0 (socket says 172.21.15.72:42702) 2023-08-31T19:04:36.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.401+0000 7f641639c700 1 -- 172.21.15.72:0/674978310 learned_addr learned my addr 172.21.15.72:0/674978310 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:36.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.401+0000 7f641539a700 1 --2- 172.21.15.72:0/674978310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64100658d0 0x7f6410065d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:36.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.401+0000 7f641639c700 1 -- 172.21.15.72:0/674978310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64100658d0 msgr2=0x7f6410065d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:36.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.401+0000 7f641639c700 1 --2- 172.21.15.72:0/674978310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64100658d0 0x7f6410065d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.401+0000 7f641639c700 1 -- 172.21.15.72:0/674978310 >> v1:172.21.15.72:6789/0 conn(0x7f6410154140 legacy=0x7f64100a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.401+0000 7f641639c700 1 -- 172.21.15.72:0/674978310 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64100c45f0 con 0x7f6410154520 2023-08-31T19:04:36.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.401+0000 7f641539a700 1 --2- 172.21.15.72:0/674978310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64100658d0 0x7f6410065d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:36.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.401+0000 7f6414b99700 1 -- 172.21.15.72:0/674978310 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785822748 0 0) 0x7f6410158720 con 0x7f6410154140 2023-08-31T19:04:36.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.401+0000 7f641639c700 1 --2- 172.21.15.72:0/674978310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6410154520 0x7f64101549b0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f6408009f20 tx=0x7f6408009840).ready entity=mon.0 client_cookie=c6e8b76c9524e762 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:36.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.401+0000 7f6414b99700 1 -- 172.21.15.72:0/674978310 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800e070 con 0x7f6410154520 2023-08-31T19:04:36.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.402+0000 7f6414b99700 1 -- 172.21.15.72:0/674978310 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640800ba80 con 0x7f6410154520 2023-08-31T19:04:36.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.402+0000 7f6414b99700 1 -- 172.21.15.72:0/674978310 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800be00 con 0x7f6410154520 2023-08-31T19:04:36.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.402+0000 7f6417dff700 1 -- 172.21.15.72:0/674978310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6410154520 msgr2=0x7f64101549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.402+0000 7f6417dff700 1 --2- 172.21.15.72:0/674978310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6410154520 0x7f64101549b0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f6408009f20 tx=0x7f6408009840).stop 2023-08-31T19:04:36.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.402+0000 7f6417dff700 1 -- 172.21.15.72:0/674978310 shutdown_connections 2023-08-31T19:04:36.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.402+0000 7f6417dff700 1 --2- 172.21.15.72:0/674978310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6410154520 0x7f64101549b0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.402+0000 7f6417dff700 1 --2- 172.21.15.72:0/674978310 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f64100658d0 0x7f6410065d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.402+0000 7f6417dff700 1 -- 172.21.15.72:0/674978310 >> 172.21.15.72:0/674978310 conn(0x7f64100c7910 msgr2=0x7f64100c38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:36.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.402+0000 7f6417dff700 1 -- 172.21.15.72:0/674978310 shutdown_connections 2023-08-31T19:04:36.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.402+0000 7f6417dff700 1 -- 172.21.15.72:0/674978310 wait complete. 2023-08-31T19:04:36.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.404+0000 7f6417dff700 1 Processor -- start 2023-08-31T19:04:36.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.404+0000 7f6417dff700 1 -- start start 2023-08-31T19:04:36.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f6417dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64100658d0 0x7f6410156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f6417dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6410154140 0x7f6410167920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f6417dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6410154520 0x7f64100c2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f6417dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64101688c0 con 0x7f64100658d0 2023-08-31T19:04:36.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f6417dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6410155e80 con 0x7f6410154520 2023-08-31T19:04:36.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f6417dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6410168300 con 0x7f6410154140 2023-08-31T19:04:36.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f6415b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64100658d0 0x7f6410156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:36.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f6415b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64100658d0 0x7f6410156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42718/0 (socket says 172.21.15.72:42718) 2023-08-31T19:04:36.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f6415b9b700 1 -- 172.21.15.72:0/1865255093 learned_addr learned my addr 172.21.15.72:0/1865255093 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:36.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f641539a700 1 --2- 172.21.15.72:0/1865255093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6410154140 0x7f6410167920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:36.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f641639c700 1 --2- 172.21.15.72:0/1865255093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6410154520 0x7f64100c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:36.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f6415b9b700 1 -- 172.21.15.72:0/1865255093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6410154140 msgr2=0x7f6410167920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f6415b9b700 1 --2- 172.21.15.72:0/1865255093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6410154140 0x7f6410167920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f6415b9b700 1 -- 172.21.15.72:0/1865255093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6410154520 msgr2=0x7f64100c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f6415b9b700 1 --2- 172.21.15.72:0/1865255093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6410154520 0x7f64100c2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.405+0000 7f6415b9b700 1 -- 172.21.15.72:0/1865255093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6408009ae0 con 0x7f64100658d0 2023-08-31T19:04:36.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.406+0000 7f6415b9b700 1 --2- 172.21.15.72:0/1865255093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64100658d0 0x7f6410156310 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f640c001eb0 tx=0x7f640c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:36.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.406+0000 7f6405ffb700 1 -- 172.21.15.72:0/1865255093 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c00ce60 con 0x7f64100658d0 2023-08-31T19:04:36.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.406+0000 7f6405ffb700 1 -- 172.21.15.72:0/1865255093 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640c00f470 con 0x7f64100658d0 2023-08-31T19:04:36.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.406+0000 7f6417dff700 1 -- 172.21.15.72:0/1865255093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64101685e0 con 0x7f64100658d0 2023-08-31T19:04:36.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.406+0000 7f6405ffb700 1 -- 172.21.15.72:0/1865255093 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c00f810 con 0x7f64100658d0 2023-08-31T19:04:36.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.406+0000 7f6417dff700 1 -- 172.21.15.72:0/1865255093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641006a340 con 0x7f64100658d0 2023-08-31T19:04:36.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.407+0000 7f6417dff700 1 -- 172.21.15.72:0/1865255093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6410156160 con 0x7f64100658d0 2023-08-31T19:04:36.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.408+0000 7f6405ffb700 1 -- 172.21.15.72:0/1865255093 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f640c00fb80 con 0x7f64100658d0 2023-08-31T19:04:36.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.408+0000 7f6405ffb700 1 --2- 172.21.15.72:0/1865255093 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63f405ef30 0x7f63f40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.409+0000 7f6405ffb700 1 -- 172.21.15.72:0/1865255093 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f640c0794b0 con 0x7f64100658d0 2023-08-31T19:04:36.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.409+0000 7f641539a700 1 --2- 172.21.15.72:0/1865255093 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63f405ef30 0x7f63f40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:36.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.409+0000 7f641539a700 1 --2- 172.21.15.72:0/1865255093 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63f405ef30 0x7f63f40613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f64100c3160 tx=0x7f6400008040).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:36.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.412+0000 7f6405ffb700 1 -- 172.21.15.72:0/1865255093 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f640c04a7e0 con 0x7f64100658d0 2023-08-31T19:04:36.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.584+0000 7f6417dff700 1 -- 172.21.15.72:0/1865255093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6410155970 con 0x7f64100658d0 2023-08-31T19:04:36.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.584+0000 7f6405ffb700 1 -- 172.21.15.72:0/1865255093 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v105) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6410155970 con 0x7f64100658d0 2023-08-31T19:04:36.585 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:04:36.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.586+0000 7f6417dff700 1 -- 172.21.15.72:0/1865255093 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63f405ef30 msgr2=0x7f63f40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.586+0000 7f6417dff700 1 --2- 172.21.15.72:0/1865255093 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63f405ef30 0x7f63f40613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f64100c3160 tx=0x7f6400008040).stop 2023-08-31T19:04:36.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.586+0000 7f6417dff700 1 -- 172.21.15.72:0/1865255093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64100658d0 msgr2=0x7f6410156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.586+0000 7f6417dff700 1 --2- 172.21.15.72:0/1865255093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64100658d0 0x7f6410156310 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f640c001eb0 tx=0x7f640c007c70).stop 2023-08-31T19:04:36.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.586+0000 7f6417dff700 1 -- 172.21.15.72:0/1865255093 shutdown_connections 2023-08-31T19:04:36.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.586+0000 7f6417dff700 1 --2- 172.21.15.72:0/1865255093 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f63f405ef30 0x7f63f40613f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.586+0000 7f6417dff700 1 --2- 172.21.15.72:0/1865255093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6410154520 0x7f64100c2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.586+0000 7f6417dff700 1 --2- 172.21.15.72:0/1865255093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64100658d0 0x7f6410156310 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.586+0000 7f6417dff700 1 --2- 172.21.15.72:0/1865255093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6410154140 0x7f6410167920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.586+0000 7f6417dff700 1 -- 172.21.15.72:0/1865255093 >> 172.21.15.72:0/1865255093 conn(0x7f64100c7910 msgr2=0x7f6410152ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:36.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.586+0000 7f6417dff700 1 -- 172.21.15.72:0/1865255093 shutdown_connections 2023-08-31T19:04:36.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.586+0000 7f6417dff700 1 -- 172.21.15.72:0/1865255093 wait complete. 2023-08-31T19:04:36.604 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T19:04:36.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.793+0000 7fd9d43ff700 1 Processor -- start 2023-08-31T19:04:36.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.793+0000 7fd9d43ff700 1 -- start start 2023-08-31T19:04:36.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.794+0000 7fd9d43ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd9cc0a9eb0 0x7fd9cc0aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.794+0000 7fd9d43ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9cc0c5bf0 0x7fd9cc0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.794+0000 7fd9d43ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9cc0bfd00 con 0x7fd9cc156fc0 2023-08-31T19:04:36.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.794+0000 7fd9d43ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9cc0c05a0 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.794+0000 7fd9d43ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc0aaea0 con 0x7fd9cc0c5bf0 2023-08-31T19:04:36.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.795+0000 7fd9d219b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd9cc0a9eb0 0x7fd9cc0aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:36.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.795+0000 7fd9d219b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd9cc0a9eb0 0x7fd9cc0aa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42730/0 (socket says 172.21.15.72:42730) 2023-08-31T19:04:36.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.795+0000 7fd9d219b700 1 -- 172.21.15.72:0/1309661849 learned_addr learned my addr 172.21.15.72:0/1309661849 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:36.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.795+0000 7fd9d199a700 1 --2- 172.21.15.72:0/1309661849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9cc0c5bf0 0x7fd9cc0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:36.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.795+0000 7fd9d219b700 1 -- 172.21.15.72:0/1309661849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9cc0c5bf0 msgr2=0x7fd9cc0c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:36.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.795+0000 7fd9d219b700 1 --2- 172.21.15.72:0/1309661849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9cc0c5bf0 0x7fd9cc0c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.795+0000 7fd9d219b700 1 -- 172.21.15.72:0/1309661849 >> v1:172.21.15.72:6789/0 conn(0x7fd9cc156fc0 legacy=0x7fd9cc157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.795+0000 7fd9d219b700 1 -- 172.21.15.72:0/1309661849 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc0c6670 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.795+0000 7fd9d1199700 1 -- 172.21.15.72:0/1309661849 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162789312 0 0) 0x7fd9cc0bfd00 con 0x7fd9cc156fc0 2023-08-31T19:04:36.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.795+0000 7fd9d219b700 1 --2- 172.21.15.72:0/1309661849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9cc0a9eb0 0x7fd9cc0aa290 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7fd9c8006fd0 tx=0x7fd9c80090f0).ready entity=mon.0 client_cookie=acedbce724658e58 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:36.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.795+0000 7fd9d1199700 1 -- 172.21.15.72:0/1309661849 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c800b600 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.795+0000 7fd9d1199700 1 -- 172.21.15.72:0/1309661849 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c800b760 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.796+0000 7fd9d1199700 1 -- 172.21.15.72:0/1309661849 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c800bae0 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.796+0000 7fd9d43ff700 1 -- 172.21.15.72:0/1309661849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9cc0a9eb0 msgr2=0x7fd9cc0aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.796+0000 7fd9d43ff700 1 --2- 172.21.15.72:0/1309661849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9cc0a9eb0 0x7fd9cc0aa290 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7fd9c8006fd0 tx=0x7fd9c80090f0).stop 2023-08-31T19:04:36.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.796+0000 7fd9d43ff700 1 -- 172.21.15.72:0/1309661849 shutdown_connections 2023-08-31T19:04:36.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.796+0000 7fd9d43ff700 1 --2- 172.21.15.72:0/1309661849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9cc0a9eb0 0x7fd9cc0aa290 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.796+0000 7fd9d43ff700 1 --2- 172.21.15.72:0/1309661849 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9cc0c5bf0 0x7fd9cc0c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.796+0000 7fd9d43ff700 1 -- 172.21.15.72:0/1309661849 >> 172.21.15.72:0/1309661849 conn(0x7fd9cc0c82e0 msgr2=0x7fd9cc05e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:36.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.796+0000 7fd9d43ff700 1 -- 172.21.15.72:0/1309661849 shutdown_connections 2023-08-31T19:04:36.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.796+0000 7fd9d43ff700 1 -- 172.21.15.72:0/1309661849 wait complete. 2023-08-31T19:04:36.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.798+0000 7fd9d43ff700 1 Processor -- start 2023-08-31T19:04:36.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.798+0000 7fd9d43ff700 1 -- start start 2023-08-31T19:04:36.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.799+0000 7fd9d43ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9cc0a9eb0 0x7fd9cc155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.799+0000 7fd9d43ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9cc0c5bf0 0x7fd9cc1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.799+0000 7fd9d43ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9cc156fc0 0x7fd9cc154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.799+0000 7fd9d43ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc156590 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.799+0000 7fd9d43ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc0af070 con 0x7fd9cc0c5bf0 2023-08-31T19:04:36.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.799+0000 7fd9d43ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc0af350 con 0x7fd9cc156fc0 2023-08-31T19:04:36.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.799+0000 7fd9d219b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9cc0a9eb0 0x7fd9cc155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:36.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.799+0000 7fd9d219b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9cc0a9eb0 0x7fd9cc155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42744/0 (socket says 172.21.15.72:42744) 2023-08-31T19:04:36.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.799+0000 7fd9d219b700 1 -- 172.21.15.72:0/2294649439 learned_addr learned my addr 172.21.15.72:0/2294649439 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:36.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.799+0000 7fd9d219b700 1 -- 172.21.15.72:0/2294649439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9cc156fc0 msgr2=0x7fd9cc154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.799+0000 7fd9d219b700 1 --2- 172.21.15.72:0/2294649439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9cc156fc0 0x7fd9cc154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:36.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.799+0000 7fd9d219b700 1 -- 172.21.15.72:0/2294649439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9cc0c5bf0 msgr2=0x7fd9cc1560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.799+0000 7fd9d219b700 1 --2- 172.21.15.72:0/2294649439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9cc0c5bf0 0x7fd9cc1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:36.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.799+0000 7fd9d219b700 1 -- 172.21.15.72:0/2294649439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c8009370 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.799+0000 7fd9d219b700 1 --2- 172.21.15.72:0/2294649439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9cc0a9eb0 0x7fd9cc155bb0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fd9cc083960 tx=0x7fd9c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:36.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.800+0000 7fd9c27fc700 1 -- 172.21.15.72:0/2294649439 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c800b8d0 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.800+0000 7fd9c27fc700 1 -- 172.21.15.72:0/2294649439 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c800ba30 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.800+0000 7fd9c27fc700 1 -- 172.21.15.72:0/2294649439 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c801c670 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.800+0000 7fd9d43ff700 1 -- 172.21.15.72:0/2294649439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9cc0af630 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.800+0000 7fd9d43ff700 1 -- 172.21.15.72:0/2294649439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9cc154b30 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.801+0000 7fd9d43ff700 1 -- 172.21.15.72:0/2294649439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9cc06c6b0 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.802+0000 7fd9c27fc700 1 -- 172.21.15.72:0/2294649439 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd9c801ca20 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.802+0000 7fd9c27fc700 1 --2- 172.21.15.72:0/2294649439 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd9b005ef30 0x7fd9b00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:36.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.802+0000 7fd9c27fc700 1 -- 172.21.15.72:0/2294649439 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5869+0+0 (secure 0 0 0) 0x7fd9c807bc00 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.803+0000 7fd9d199a700 1 --2- 172.21.15.72:0/2294649439 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd9b005ef30 0x7fd9b00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:36.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.803+0000 7fd9d199a700 1 --2- 172.21.15.72:0/2294649439 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd9b005ef30 0x7fd9b00613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd9cc0a9930 tx=0x7fd9bc008040).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:36.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.806+0000 7fd9c27fc700 1 -- 172.21.15.72:0/2294649439 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd9c804cff0 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.976+0000 7fd9d43ff700 1 -- 172.21.15.72:0/2294649439 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd9cc0655b0 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.977+0000 7fd9c27fc700 1 -- 172.21.15.72:0/2294649439 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v105) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd9c802a070 con 0x7fd9cc0a9eb0 2023-08-31T19:04:36.977 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:36.978 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:04:36.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:36.978 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-08-31T19:04:36.978 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "device_health_metrics" 2023-08-31T19:04:36.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-08-31T19:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-08-31T19:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:04:36.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.979+0000 7fd9d43ff700 1 -- 172.21.15.72:0/2294649439 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd9b005ef30 msgr2=0x7fd9b00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.979+0000 7fd9d43ff700 1 --2- 172.21.15.72:0/2294649439 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd9b005ef30 0x7fd9b00613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd9cc0a9930 tx=0x7fd9bc008040).stop 2023-08-31T19:04:36.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.979+0000 7fd9d43ff700 1 -- 172.21.15.72:0/2294649439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9cc0a9eb0 msgr2=0x7fd9cc155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:36.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.979+0000 7fd9d43ff700 1 --2- 172.21.15.72:0/2294649439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9cc0a9eb0 0x7fd9cc155bb0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fd9cc083960 tx=0x7fd9c8017000).stop 2023-08-31T19:04:36.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.979+0000 7fd9d43ff700 1 -- 172.21.15.72:0/2294649439 shutdown_connections 2023-08-31T19:04:36.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.979+0000 7fd9d43ff700 1 --2- 172.21.15.72:0/2294649439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd9cc156fc0 0x7fd9cc154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:36.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.979+0000 7fd9d43ff700 1 --2- 172.21.15.72:0/2294649439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9cc0a9eb0 0x7fd9cc155bb0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.979+0000 7fd9d43ff700 1 --2- 172.21.15.72:0/2294649439 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd9b005ef30 0x7fd9b00613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:36.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.979+0000 7fd9d43ff700 1 --2- 172.21.15.72:0/2294649439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9cc0c5bf0 0x7fd9cc1560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:36.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.979+0000 7fd9d43ff700 1 -- 172.21.15.72:0/2294649439 >> 172.21.15.72:0/2294649439 conn(0x7fd9cc0c82e0 msgr2=0x7fd9cc0c1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:36.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.979+0000 7fd9d43ff700 1 -- 172.21.15.72:0/2294649439 shutdown_connections 2023-08-31T19:04:36.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:36.979+0000 7fd9d43ff700 1 -- 172.21.15.72:0/2294649439 wait complete. 2023-08-31T19:04:36.996 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T19:04:36.997 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-31T19:04:37.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.191+0000 7f0b6efff700 1 Processor -- start 2023-08-31T19:04:37.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.191+0000 7f0b6efff700 1 -- start start 2023-08-31T19:04:37.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.192+0000 7f0b6efff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b680c4bb0 0x7f0b680653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:37.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.192+0000 7f0b6efff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b680c5aa0 0x7f0b68067a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:37.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.192+0000 7f0b6efff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b680c4f90 con 0x7f0b6813d960 2023-08-31T19:04:37.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.192+0000 7f0b6efff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b680c6020 con 0x7f0b680c5aa0 2023-08-31T19:04:37.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.192+0000 7f0b6efff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b681587f0 con 0x7f0b680c4bb0 2023-08-31T19:04:37.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.193+0000 7f0b6d59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b680c5aa0 0x7f0b68067a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:37.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.193+0000 7f0b6d59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b680c5aa0 0x7f0b68067a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42750/0 (socket says 172.21.15.72:42750) 2023-08-31T19:04:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.193+0000 7f0b67fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0b6813d960 0x7f0b680c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33158/0 (socket says 172.21.15.72:33158) 2023-08-31T19:04:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.193+0000 7f0b6d59c700 1 -- 172.21.15.72:0/1613304500 learned_addr learned my addr 172.21.15.72:0/1613304500 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.193+0000 7f0b6cd9b700 1 --2- 172.21.15.72:0/1613304500 >> v2:172.21.15.146:3300/0 conn(0x7f0b680c4bb0 0x7f0b680653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.193+0000 7f0b6d59c700 1 -- 172.21.15.72:0/1613304500 >> v2:172.21.15.146:3300/0 conn(0x7f0b680c4bb0 msgr2=0x7f0b680653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.193+0000 7f0b6d59c700 1 --2- 172.21.15.72:0/1613304500 >> v2:172.21.15.146:3300/0 conn(0x7f0b680c4bb0 0x7f0b680653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.193+0000 7f0b6d59c700 1 -- 172.21.15.72:0/1613304500 >> v1:172.21.15.72:6789/0 conn(0x7f0b6813d960 legacy=0x7f0b680c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:37.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.193+0000 7f0b677fe700 1 -- 172.21.15.72:0/1613304500 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970642066 0 0) 0x7f0b680c4f90 con 0x7f0b6813d960 2023-08-31T19:04:37.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.193+0000 7f0b6d59c700 1 -- 172.21.15.72:0/1613304500 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b68158ad0 con 0x7f0b680c5aa0 2023-08-31T19:04:37.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.193+0000 7f0b6d59c700 1 --2- 172.21.15.72:0/1613304500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b680c5aa0 0x7f0b68067a20 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f0b680699f0 tx=0x7f0b60009840).ready entity=mon.0 client_cookie=f23189cb5bd8c1e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:37.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.194+0000 7f0b677fe700 1 -- 172.21.15.72:0/1613304500 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000e070 con 0x7f0b680c5aa0 2023-08-31T19:04:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.194+0000 7f0b677fe700 1 -- 172.21.15.72:0/1613304500 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6000ba20 con 0x7f0b680c5aa0 2023-08-31T19:04:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.194+0000 7f0b677fe700 1 -- 172.21.15.72:0/1613304500 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000bda0 con 0x7f0b680c5aa0 2023-08-31T19:04:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.194+0000 7f0b6efff700 1 -- 172.21.15.72:0/1613304500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b680c5aa0 msgr2=0x7f0b68067a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.194+0000 7f0b6efff700 1 --2- 172.21.15.72:0/1613304500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b680c5aa0 0x7f0b68067a20 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f0b680699f0 tx=0x7f0b60009840).stop 2023-08-31T19:04:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.194+0000 7f0b6efff700 1 -- 172.21.15.72:0/1613304500 shutdown_connections 2023-08-31T19:04:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.194+0000 7f0b6efff700 1 --2- 172.21.15.72:0/1613304500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b680c5aa0 0x7f0b68067a20 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.194+0000 7f0b6efff700 1 --2- 172.21.15.72:0/1613304500 >> v2:172.21.15.146:3300/0 conn(0x7f0b680c4bb0 0x7f0b680653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.194+0000 7f0b6efff700 1 -- 172.21.15.72:0/1613304500 >> 172.21.15.72:0/1613304500 conn(0x7f0b68066350 msgr2=0x7f0b68066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.194+0000 7f0b6efff700 1 -- 172.21.15.72:0/1613304500 shutdown_connections 2023-08-31T19:04:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.194+0000 7f0b6efff700 1 -- 172.21.15.72:0/1613304500 wait complete. 2023-08-31T19:04:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.196+0000 7f0b6efff700 1 Processor -- start 2023-08-31T19:04:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.196+0000 7f0b6efff700 1 -- start start 2023-08-31T19:04:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b6efff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b680c4bb0 0x7f0b681538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b6efff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b680c5aa0 0x7f0b680c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b6efff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b6813d960 0x7f0b680c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b6efff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680bfbd0 con 0x7f0b680c5aa0 2023-08-31T19:04:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b6efff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680bfe70 con 0x7f0b6813d960 2023-08-31T19:04:37.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b6efff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680c0150 con 0x7f0b680c4bb0 2023-08-31T19:04:37.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b67fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b680c5aa0 0x7f0b680c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:37.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b67fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b680c5aa0 0x7f0b680c2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42754/0 (socket says 172.21.15.72:42754) 2023-08-31T19:04:37.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b67fff700 1 -- 172.21.15.72:0/546279082 learned_addr learned my addr 172.21.15.72:0/546279082 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:37.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b6cd9b700 1 --2- 172.21.15.72:0/546279082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b680c4bb0 0x7f0b681538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:37.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b6d59c700 1 --2- 172.21.15.72:0/546279082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b6813d960 0x7f0b680c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:37.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b67fff700 1 -- 172.21.15.72:0/546279082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b680c4bb0 msgr2=0x7f0b681538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:37.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b67fff700 1 --2- 172.21.15.72:0/546279082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b680c4bb0 0x7f0b681538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:37.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b67fff700 1 -- 172.21.15.72:0/546279082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b6813d960 msgr2=0x7f0b680c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:37.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b67fff700 1 --2- 172.21.15.72:0/546279082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b6813d960 0x7f0b680c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:37.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b67fff700 1 -- 172.21.15.72:0/546279082 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60009ae0 con 0x7f0b680c5aa0 2023-08-31T19:04:37.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.197+0000 7f0b6cd9b700 1 --2- 172.21.15.72:0/546279082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b680c4bb0 0x7f0b681538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:37.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.198+0000 7f0b67fff700 1 --2- 172.21.15.72:0/546279082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b680c5aa0 0x7f0b680c2fa0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f0b5400c490 tx=0x7f0b54007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:37.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.198+0000 7f0b64ff9700 1 -- 172.21.15.72:0/546279082 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b540072e0 con 0x7f0b680c5aa0 2023-08-31T19:04:37.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.198+0000 7f0b64ff9700 1 -- 172.21.15.72:0/546279082 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b54007440 con 0x7f0b680c5aa0 2023-08-31T19:04:37.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.198+0000 7f0b64ff9700 1 -- 172.21.15.72:0/546279082 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54005910 con 0x7f0b680c5aa0 2023-08-31T19:04:37.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.198+0000 7f0b6efff700 1 -- 172.21.15.72:0/546279082 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b680c0430 con 0x7f0b680c5aa0 2023-08-31T19:04:37.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.198+0000 7f0b6efff700 1 -- 172.21.15.72:0/546279082 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b680c09f0 con 0x7f0b680c5aa0 2023-08-31T19:04:37.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.199+0000 7f0b6efff700 1 -- 172.21.15.72:0/546279082 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b680a7990 con 0x7f0b680c5aa0 2023-08-31T19:04:37.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.200+0000 7f0b64ff9700 1 -- 172.21.15.72:0/546279082 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0b54005cc0 con 0x7f0b680c5aa0 2023-08-31T19:04:37.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.201+0000 7f0b64ff9700 1 --2- 172.21.15.72:0/546279082 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0b4c05ef30 0x7f0b4c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:37.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.201+0000 7f0b64ff9700 1 -- 172.21.15.72:0/546279082 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f0b54079710 con 0x7f0b680c5aa0 2023-08-31T19:04:37.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.201+0000 7f0b6cd9b700 1 --2- 172.21.15.72:0/546279082 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0b4c05ef30 0x7f0b4c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:37.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.201+0000 7f0b6cd9b700 1 --2- 172.21.15.72:0/546279082 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0b4c05ef30 0x7f0b4c0613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0b5c009b60 tx=0x7f0b5c008040).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:37.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.204+0000 7f0b64ff9700 1 -- 172.21.15.72:0/546279082 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b5404aa40 con 0x7f0b680c5aa0 2023-08-31T19:04:37.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.375+0000 7f0b6efff700 1 -- 172.21.15.72:0/546279082 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f0b6806c6b0 con 0x7f0b680c5aa0 2023-08-31T19:04:37.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.526+0000 7f0b64ff9700 1 -- 172.21.15.72:0/546279082 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v106) v1 ==== 152+0+0 (secure 0 0 0) 0x7f0b5404e060 con 0x7f0b680c5aa0 2023-08-31T19:04:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.530+0000 7f0b6efff700 1 -- 172.21.15.72:0/546279082 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0b4c05ef30 msgr2=0x7f0b4c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.530+0000 7f0b6efff700 1 --2- 172.21.15.72:0/546279082 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0b4c05ef30 0x7f0b4c0613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0b5c009b60 tx=0x7f0b5c008040).stop 2023-08-31T19:04:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.530+0000 7f0b6efff700 1 -- 172.21.15.72:0/546279082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b680c5aa0 msgr2=0x7f0b680c2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:37.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.530+0000 7f0b6efff700 1 --2- 172.21.15.72:0/546279082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b680c5aa0 0x7f0b680c2fa0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f0b5400c490 tx=0x7f0b54007dd0).stop 2023-08-31T19:04:37.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.532+0000 7f0b6efff700 1 -- 172.21.15.72:0/546279082 shutdown_connections 2023-08-31T19:04:37.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.532+0000 7f0b6efff700 1 --2- 172.21.15.72:0/546279082 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0b4c05ef30 0x7f0b4c0613f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:37.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.532+0000 7f0b6efff700 1 --2- 172.21.15.72:0/546279082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b6813d960 0x7f0b680c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:37.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.532+0000 7f0b6efff700 1 --2- 172.21.15.72:0/546279082 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b680c4bb0 0x7f0b681538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:37.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.532+0000 7f0b6efff700 1 --2- 172.21.15.72:0/546279082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b680c5aa0 0x7f0b680c2fa0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:37.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.532+0000 7f0b6efff700 1 -- 172.21.15.72:0/546279082 >> 172.21.15.72:0/546279082 conn(0x7f0b68066350 msgr2=0x7f0b680bdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:37.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.532+0000 7f0b6efff700 1 -- 172.21.15.72:0/546279082 shutdown_connections 2023-08-31T19:04:37.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.532+0000 7f0b6efff700 1 -- 172.21.15.72:0/546279082 wait complete. 2023-08-31T19:04:37.534 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-08-31T19:04:37.552 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T19:04:37.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.747+0000 7f1425bff700 1 Processor -- start 2023-08-31T19:04:37.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.747+0000 7f1425bff700 1 -- start start 2023-08-31T19:04:37.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.749+0000 7f1425bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1420154030 0x7f1420154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:37.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.749+0000 7f1425bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14200c6ed0 con 0x7f14200c7360 2023-08-31T19:04:37.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.749+0000 7f1425bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14200c68c0 con 0x7f14200c06b0 2023-08-31T19:04:37.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.749+0000 7f1425bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14200c66e0 con 0x7f1420154030 2023-08-31T19:04:37.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.749+0000 7f141ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f14200c7360 0x7f1420063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33170/0 (socket says 172.21.15.72:33170) 2023-08-31T19:04:37.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.749+0000 7f141ffff700 1 -- 172.21.15.72:0/2874269631 learned_addr learned my addr 172.21.15.72:0/2874269631 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:37.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.749+0000 7f141f7fe700 1 --2- 172.21.15.72:0/2874269631 >> v2:172.21.15.146:3300/0 conn(0x7f1420154030 0x7f1420154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:37.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.749+0000 7f141e7fc700 1 -- 172.21.15.72:0/2874269631 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105231823 0 0) 0x7f14200c6ed0 con 0x7f14200c7360 2023-08-31T19:04:37.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.749+0000 7f141e7fc700 1 -- 172.21.15.72:0/2874269631 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14080033f0 con 0x7f14200c7360 2023-08-31T19:04:37.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.750+0000 7f141f7fe700 1 -- 172.21.15.72:0/2874269631 >> v1:172.21.15.146:6789/0 conn(0x7f14200c06b0 legacy=0x7f14200aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:37.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.750+0000 7f141f7fe700 1 -- 172.21.15.72:0/2874269631 >> v1:172.21.15.72:6789/0 conn(0x7f14200c7360 legacy=0x7f1420063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:37.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.750+0000 7f141f7fe700 1 -- 172.21.15.72:0/2874269631 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14200c0f30 con 0x7f1420154030 2023-08-31T19:04:37.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.750+0000 7f141f7fe700 1 --2- 172.21.15.72:0/2874269631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1420154030 0x7f1420154410 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f1410009760 tx=0x7f1410009060).ready entity=mon.1 client_cookie=d7d19bfd256d3da5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:37.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.750+0000 7f141e7fc700 1 -- 172.21.15.72:0/2874269631 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410009130 con 0x7f1420154030 2023-08-31T19:04:37.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.751+0000 7f141e7fc700 1 -- 172.21.15.72:0/2874269631 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141000d4a0 con 0x7f1420154030 2023-08-31T19:04:37.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.751+0000 7f141e7fc700 1 -- 172.21.15.72:0/2874269631 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141000d820 con 0x7f1420154030 2023-08-31T19:04:37.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.751+0000 7f1425bff700 1 -- 172.21.15.72:0/2874269631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1420154030 msgr2=0x7f1420154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:37.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.751+0000 7f1425bff700 1 --2- 172.21.15.72:0/2874269631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1420154030 0x7f1420154410 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f1410009760 tx=0x7f1410009060).stop 2023-08-31T19:04:37.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.751+0000 7f1425bff700 1 -- 172.21.15.72:0/2874269631 shutdown_connections 2023-08-31T19:04:37.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.751+0000 7f1425bff700 1 --2- 172.21.15.72:0/2874269631 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1420154030 0x7f1420154410 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:37.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.751+0000 7f1425bff700 1 -- 172.21.15.72:0/2874269631 >> 172.21.15.72:0/2874269631 conn(0x7f142005eb60 msgr2=0x7f14200cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:37.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.751+0000 7f1425bff700 1 -- 172.21.15.72:0/2874269631 shutdown_connections 2023-08-31T19:04:37.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.751+0000 7f1425bff700 1 -- 172.21.15.72:0/2874269631 wait complete. 2023-08-31T19:04:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.753+0000 7f1425bff700 1 Processor -- start 2023-08-31T19:04:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.753+0000 7f1425bff700 1 -- start start 2023-08-31T19:04:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f1425bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14200c06b0 0x7f14200c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f1425bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14200c7360 0x7f14200c2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:37.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f1425bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1420154030 0x7f14200ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:37.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f1425bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14200c2f80 con 0x7f14200c7360 2023-08-31T19:04:37.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f1425bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14200aedb0 con 0x7f14200c06b0 2023-08-31T19:04:37.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f1425bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14200c3170 con 0x7f1420154030 2023-08-31T19:04:37.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f141effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14200c7360 0x7f14200c2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:37.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f141effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14200c7360 0x7f14200c2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42770/0 (socket says 172.21.15.72:42770) 2023-08-31T19:04:37.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f141effd700 1 -- 172.21.15.72:0/3258740103 learned_addr learned my addr 172.21.15.72:0/3258740103 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:37.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f141f7fe700 1 --2- 172.21.15.72:0/3258740103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14200c06b0 0x7f14200c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:37.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f141ffff700 1 --2- 172.21.15.72:0/3258740103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1420154030 0x7f14200ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:37.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f141effd700 1 -- 172.21.15.72:0/3258740103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1420154030 msgr2=0x7f14200ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:37.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f141effd700 1 --2- 172.21.15.72:0/3258740103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1420154030 0x7f14200ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:37.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f141effd700 1 -- 172.21.15.72:0/3258740103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14200c06b0 msgr2=0x7f14200c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:37.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f141effd700 1 --2- 172.21.15.72:0/3258740103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14200c06b0 0x7f14200c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:37.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f141effd700 1 -- 172.21.15.72:0/3258740103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14100092a0 con 0x7f14200c7360 2023-08-31T19:04:37.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.754+0000 7f141ffff700 1 --2- 172.21.15.72:0/3258740103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1420154030 0x7f14200ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:37.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.755+0000 7f141effd700 1 --2- 172.21.15.72:0/3258740103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14200c7360 0x7f14200c2a90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f141400c4f0 tx=0x7f1414007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:37.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.755+0000 7f14077fe700 1 -- 172.21.15.72:0/3258740103 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1414007020 con 0x7f14200c7360 2023-08-31T19:04:37.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.755+0000 7f14077fe700 1 -- 172.21.15.72:0/3258740103 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1414001e90 con 0x7f14200c7360 2023-08-31T19:04:37.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.755+0000 7f14077fe700 1 -- 172.21.15.72:0/3258740103 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14140073b0 con 0x7f14200c7360 2023-08-31T19:04:37.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.755+0000 7f1425bff700 1 -- 172.21.15.72:0/3258740103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14200c3450 con 0x7f14200c7360 2023-08-31T19:04:37.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.755+0000 7f1425bff700 1 -- 172.21.15.72:0/3258740103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14200c3a10 con 0x7f14200c7360 2023-08-31T19:04:37.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.756+0000 7f1425bff700 1 -- 172.21.15.72:0/3258740103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142006c6b0 con 0x7f14200c7360 2023-08-31T19:04:37.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.757+0000 7f14077fe700 1 -- 172.21.15.72:0/3258740103 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f14140068b0 con 0x7f14200c7360 2023-08-31T19:04:37.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.758+0000 7f14077fe700 1 --2- 172.21.15.72:0/3258740103 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f140c05ef00 0x7f140c0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:37.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.758+0000 7f14077fe700 1 -- 172.21.15.72:0/3258740103 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6239+0+0 (secure 0 0 0) 0x7f1414079ff0 con 0x7f14200c7360 2023-08-31T19:04:37.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.758+0000 7f141f7fe700 1 --2- 172.21.15.72:0/3258740103 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f140c05ef00 0x7f140c0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:37.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.759+0000 7f141f7fe700 1 --2- 172.21.15.72:0/3258740103 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f140c05ef00 0x7f140c0613c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f141000d260 tx=0x7f1410014000).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:37.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.761+0000 7f14077fe700 1 -- 172.21.15.72:0/3258740103 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f141404b2b0 con 0x7f14200c7360 2023-08-31T19:04:37.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:37.933+0000 7f1425bff700 1 -- 172.21.15.72:0/3258740103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f14200c4050 con 0x7f14200c7360 2023-08-31T19:04:38.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.528+0000 7f14077fe700 1 -- 172.21.15.72:0/3258740103 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v107) v1 ==== 170+0+0 (secure 0 0 0) 0x7f14200c4050 con 0x7f14200c7360 2023-08-31T19:04:38.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.533+0000 7f1425bff700 1 -- 172.21.15.72:0/3258740103 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f140c05ef00 msgr2=0x7f140c0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:38.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.533+0000 7f1425bff700 1 --2- 172.21.15.72:0/3258740103 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f140c05ef00 0x7f140c0613c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f141000d260 tx=0x7f1410014000).stop 2023-08-31T19:04:38.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.533+0000 7f1425bff700 1 -- 172.21.15.72:0/3258740103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14200c7360 msgr2=0x7f14200c2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:38.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.533+0000 7f1425bff700 1 --2- 172.21.15.72:0/3258740103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14200c7360 0x7f14200c2a90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f141400c4f0 tx=0x7f1414007e00).stop 2023-08-31T19:04:38.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.533+0000 7f1425bff700 1 -- 172.21.15.72:0/3258740103 shutdown_connections 2023-08-31T19:04:38.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.533+0000 7f1425bff700 1 --2- 172.21.15.72:0/3258740103 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1420154030 0x7f14200ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:38.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.533+0000 7f1425bff700 1 --2- 172.21.15.72:0/3258740103 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f140c05ef00 0x7f140c0613c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:38.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.533+0000 7f1425bff700 1 --2- 172.21.15.72:0/3258740103 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14200c06b0 0x7f14200c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:38.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.533+0000 7f1425bff700 1 --2- 172.21.15.72:0/3258740103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14200c7360 0x7f14200c2a90 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:38.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.533+0000 7f1425bff700 1 -- 172.21.15.72:0/3258740103 >> 172.21.15.72:0/3258740103 conn(0x7f142005eb60 msgr2=0x7f14200ace70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:38.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.536+0000 7f1425bff700 1 -- 172.21.15.72:0/3258740103 shutdown_connections 2023-08-31T19:04:38.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.538+0000 7f1425bff700 1 -- 172.21.15.72:0/3258740103 wait complete. 2023-08-31T19:04:38.558 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-08-31T19:04:38.575 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T19:04:38.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.768+0000 7f2858bff700 1 Processor -- start 2023-08-31T19:04:38.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.768+0000 7f2858bff700 1 -- start start 2023-08-31T19:04:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.769+0000 7f2858bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2854153e30 0x7f2854154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.769+0000 7f2858bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28540c5cb0 0x7f28540c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.769+0000 7f2858bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28540bfd40 con 0x7f28540630b0 2023-08-31T19:04:38.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.769+0000 7f2858bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28540c6730 con 0x7f2854153e30 2023-08-31T19:04:38.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.769+0000 7f2858bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28540bffe0 con 0x7f28540c5cb0 2023-08-31T19:04:38.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.770+0000 7f285259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2854153e30 0x7f2854154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:38.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.770+0000 7f285259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2854153e30 0x7f2854154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42786/0 (socket says 172.21.15.72:42786) 2023-08-31T19:04:38.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.770+0000 7f285259c700 1 -- 172.21.15.72:0/4123555658 learned_addr learned my addr 172.21.15.72:0/4123555658 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.770+0000 7f2851d9b700 1 --2- 172.21.15.72:0/4123555658 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28540c5cb0 0x7f28540c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.770+0000 7f285259c700 1 -- 172.21.15.72:0/4123555658 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28540c5cb0 msgr2=0x7f28540c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:38.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.770+0000 7f285259c700 1 --2- 172.21.15.72:0/4123555658 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28540c5cb0 0x7f28540c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:38.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.770+0000 7f285259c700 1 -- 172.21.15.72:0/4123555658 >> v1:172.21.15.146:6789/0 conn(0x7f28540630b0 legacy=0x7f2854157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:38.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.770+0000 7f285259c700 1 -- 172.21.15.72:0/4123555658 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28540c02c0 con 0x7f2854153e30 2023-08-31T19:04:38.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.770+0000 7f285259c700 1 --2- 172.21.15.72:0/4123555658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2854153e30 0x7f2854154210 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f2844006fd0 tx=0x7f28440090f0).ready entity=mon.0 client_cookie=9dd9dc7d1cd0623d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:38.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.771+0000 7f285159a700 1 -- 172.21.15.72:0/4123555658 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284400b600 con 0x7f2854153e30 2023-08-31T19:04:38.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.771+0000 7f285159a700 1 -- 172.21.15.72:0/4123555658 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284400b760 con 0x7f2854153e30 2023-08-31T19:04:38.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.771+0000 7f285159a700 1 -- 172.21.15.72:0/4123555658 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284400bb00 con 0x7f2854153e30 2023-08-31T19:04:38.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.771+0000 7f2858bff700 1 -- 172.21.15.72:0/4123555658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2854153e30 msgr2=0x7f2854154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:38.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.771+0000 7f2858bff700 1 --2- 172.21.15.72:0/4123555658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2854153e30 0x7f2854154210 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f2844006fd0 tx=0x7f28440090f0).stop 2023-08-31T19:04:38.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.771+0000 7f2858bff700 1 -- 172.21.15.72:0/4123555658 shutdown_connections 2023-08-31T19:04:38.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.771+0000 7f2858bff700 1 --2- 172.21.15.72:0/4123555658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2854153e30 0x7f2854154210 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:38.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.771+0000 7f2858bff700 1 --2- 172.21.15.72:0/4123555658 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28540c5cb0 0x7f28540c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:38.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.771+0000 7f2858bff700 1 -- 172.21.15.72:0/4123555658 >> 172.21.15.72:0/4123555658 conn(0x7f285405eb20 msgr2=0x7f28540cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:38.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.771+0000 7f2858bff700 1 -- 172.21.15.72:0/4123555658 shutdown_connections 2023-08-31T19:04:38.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.771+0000 7f2858bff700 1 -- 172.21.15.72:0/4123555658 wait complete. 2023-08-31T19:04:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.773+0000 7f2858bff700 1 Processor -- start 2023-08-31T19:04:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.773+0000 7f2858bff700 1 -- start start 2023-08-31T19:04:38.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f2858bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28540630b0 0x7f28541529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:38.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f2858bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28540c5cb0 0x7f28540a3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:38.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f2858bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2854153e30 0x7f28540a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:38.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f2858bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28540a2d70 con 0x7f2854153e30 2023-08-31T19:04:38.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f2858bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28540a2160 con 0x7f28540c5cb0 2023-08-31T19:04:38.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f2858bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28540a2440 con 0x7f28540630b0 2023-08-31T19:04:38.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f2852d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2854153e30 0x7f28540a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:38.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f2852d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2854153e30 0x7f28540a36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42792/0 (socket says 172.21.15.72:42792) 2023-08-31T19:04:38.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f2852d9d700 1 -- 172.21.15.72:0/516649569 learned_addr learned my addr 172.21.15.72:0/516649569 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:38.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f2851d9b700 1 --2- 172.21.15.72:0/516649569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28540c5cb0 0x7f28540a3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:38.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f285259c700 1 --2- 172.21.15.72:0/516649569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28540630b0 0x7f28541529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:38.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f2852d9d700 1 -- 172.21.15.72:0/516649569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28540630b0 msgr2=0x7f28541529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:38.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f2852d9d700 1 --2- 172.21.15.72:0/516649569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28540630b0 0x7f28541529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:38.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f2852d9d700 1 -- 172.21.15.72:0/516649569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28540c5cb0 msgr2=0x7f28540a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:38.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f2852d9d700 1 --2- 172.21.15.72:0/516649569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28540c5cb0 0x7f28540a3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:38.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.774+0000 7f2852d9d700 1 -- 172.21.15.72:0/516649569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844009370 con 0x7f2854153e30 2023-08-31T19:04:38.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.775+0000 7f2852d9d700 1 --2- 172.21.15.72:0/516649569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2854153e30 0x7f28540a36f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f284c00c7c0 tx=0x7f284c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:38.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.775+0000 7f28427fc700 1 -- 172.21.15.72:0/516649569 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c010510 con 0x7f2854153e30 2023-08-31T19:04:38.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.775+0000 7f28427fc700 1 -- 172.21.15.72:0/516649569 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284c010670 con 0x7f2854153e30 2023-08-31T19:04:38.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.775+0000 7f2858bff700 1 -- 172.21.15.72:0/516649569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28540a2720 con 0x7f2854153e30 2023-08-31T19:04:38.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.775+0000 7f28427fc700 1 -- 172.21.15.72:0/516649569 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c0109f0 con 0x7f2854153e30 2023-08-31T19:04:38.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.775+0000 7f2858bff700 1 -- 172.21.15.72:0/516649569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2854152ed0 con 0x7f2854153e30 2023-08-31T19:04:38.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.776+0000 7f2858bff700 1 -- 172.21.15.72:0/516649569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28540a2f20 con 0x7f2854153e30 2023-08-31T19:04:38.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.777+0000 7f28427fc700 1 -- 172.21.15.72:0/516649569 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f284c01b400 con 0x7f2854153e30 2023-08-31T19:04:38.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.778+0000 7f28427fc700 1 --2- 172.21.15.72:0/516649569 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f283405ef30 0x7f28340613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:38.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.778+0000 7f28427fc700 1 -- 172.21.15.72:0/516649569 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6621+0+0 (secure 0 0 0) 0x7f284c079fc0 con 0x7f2854153e30 2023-08-31T19:04:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.778+0000 7f285259c700 1 --2- 172.21.15.72:0/516649569 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f283405ef30 0x7f28340613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.779+0000 7f285259c700 1 --2- 172.21.15.72:0/516649569 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f283405ef30 0x7f28340613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f284400b3c0 tx=0x7f2844017000).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.783+0000 7f28427fc700 1 -- 172.21.15.72:0/516649569 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f28540a2f20 con 0x7f2854153e30 2023-08-31T19:04:38.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.992+0000 7f2858bff700 1 -- 172.21.15.72:0/516649569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f28540a2eb0 con 0x7f2854153e30 2023-08-31T19:04:38.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:38.999+0000 7f28427fc700 1 -- 172.21.15.72:0/516649569 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7f284c04afa0 con 0x7f2854153e30 2023-08-31T19:04:39.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.009+0000 7f2858bff700 1 -- 172.21.15.72:0/516649569 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f283405ef30 msgr2=0x7f28340613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:39.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.009+0000 7f2858bff700 1 --2- 172.21.15.72:0/516649569 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f283405ef30 0x7f28340613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f284400b3c0 tx=0x7f2844017000).stop 2023-08-31T19:04:39.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.009+0000 7f2858bff700 1 -- 172.21.15.72:0/516649569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2854153e30 msgr2=0x7f28540a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:39.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.009+0000 7f2858bff700 1 --2- 172.21.15.72:0/516649569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2854153e30 0x7f28540a36f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f284c00c7c0 tx=0x7f284c001510).stop 2023-08-31T19:04:39.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.010+0000 7f2858bff700 1 -- 172.21.15.72:0/516649569 shutdown_connections 2023-08-31T19:04:39.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.010+0000 7f2858bff700 1 --2- 172.21.15.72:0/516649569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2854153e30 0x7f28540a36f0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.010+0000 7f2858bff700 1 --2- 172.21.15.72:0/516649569 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f28540630b0 0x7f28541529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.010+0000 7f2858bff700 1 --2- 172.21.15.72:0/516649569 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f283405ef30 0x7f28340613f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.010+0000 7f2858bff700 1 --2- 172.21.15.72:0/516649569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28540c5cb0 0x7f28540a3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.010+0000 7f2858bff700 1 -- 172.21.15.72:0/516649569 >> 172.21.15.72:0/516649569 conn(0x7f285405eb20 msgr2=0x7f28540ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:39.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.010+0000 7f2858bff700 1 -- 172.21.15.72:0/516649569 shutdown_connections 2023-08-31T19:04:39.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.011+0000 7f2858bff700 1 -- 172.21.15.72:0/516649569 wait complete. 2023-08-31T19:04:39.017 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 13 and data pool 14 2023-08-31T19:04:39.041 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:04:39.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.229+0000 7fdd097ff700 1 Processor -- start 2023-08-31T19:04:39.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.229+0000 7fdd097ff700 1 -- start start 2023-08-31T19:04:39.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.230+0000 7fdd097ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd04154060 0x7fdd04157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:39.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.230+0000 7fdd097ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdd041588d0 0x7fdd04154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:39.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.230+0000 7fdd097ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd040c6120 con 0x7fdd040cb9b0 2023-08-31T19:04:39.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.230+0000 7fdd097ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd040c1380 con 0x7fdd041588d0 2023-08-31T19:04:39.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.230+0000 7fdd097ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd040c5e10 con 0x7fdd04154060 2023-08-31T19:04:39.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.230+0000 7fdd037fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdd041588d0 0x7fdd04154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:39.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.230+0000 7fdd037fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdd041588d0 0x7fdd04154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42808/0 (socket says 172.21.15.72:42808) 2023-08-31T19:04:39.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.230+0000 7fdd037fe700 1 -- 172.21.15.72:0/794314204 learned_addr learned my addr 172.21.15.72:0/794314204 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:39.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.231+0000 7fdd02ffd700 1 --2- 172.21.15.72:0/794314204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd04154060 0x7fdd04157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:39.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.231+0000 7fdd037fe700 1 -- 172.21.15.72:0/794314204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd04154060 msgr2=0x7fdd04157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:39.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.231+0000 7fdd037fe700 1 --2- 172.21.15.72:0/794314204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd04154060 0x7fdd04157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.231+0000 7fdd037fe700 1 -- 172.21.15.72:0/794314204 >> v1:172.21.15.146:6789/0 conn(0x7fdd040cb9b0 legacy=0x7fdd041581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:39.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.231+0000 7fdd037fe700 1 -- 172.21.15.72:0/794314204 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd040c0ae0 con 0x7fdd041588d0 2023-08-31T19:04:39.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.231+0000 7fdd037fe700 1 --2- 172.21.15.72:0/794314204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd041588d0 0x7fdd04154440 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fdcfc009f20 tx=0x7fdcfc009840).ready entity=mon.0 client_cookie=e178a1f067c058c9 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.231+0000 7fdd01ffb700 1 -- 172.21.15.72:0/794314204 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc00e070 con 0x7fdd041588d0 2023-08-31T19:04:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.231+0000 7fdd01ffb700 1 -- 172.21.15.72:0/794314204 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc00ba80 con 0x7fdd041588d0 2023-08-31T19:04:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.231+0000 7fdd01ffb700 1 -- 172.21.15.72:0/794314204 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc00be00 con 0x7fdd041588d0 2023-08-31T19:04:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.232+0000 7fdd097ff700 1 -- 172.21.15.72:0/794314204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd041588d0 msgr2=0x7fdd04154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.232+0000 7fdd097ff700 1 --2- 172.21.15.72:0/794314204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd041588d0 0x7fdd04154440 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fdcfc009f20 tx=0x7fdcfc009840).stop 2023-08-31T19:04:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.232+0000 7fdd097ff700 1 -- 172.21.15.72:0/794314204 shutdown_connections 2023-08-31T19:04:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.232+0000 7fdd097ff700 1 --2- 172.21.15.72:0/794314204 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd04154060 0x7fdd04157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.232+0000 7fdd097ff700 1 --2- 172.21.15.72:0/794314204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd041588d0 0x7fdd04154440 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.232+0000 7fdd097ff700 1 -- 172.21.15.72:0/794314204 >> 172.21.15.72:0/794314204 conn(0x7fdd0405e870 msgr2=0x7fdd040cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.232+0000 7fdd097ff700 1 -- 172.21.15.72:0/794314204 shutdown_connections 2023-08-31T19:04:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.232+0000 7fdd097ff700 1 -- 172.21.15.72:0/794314204 wait complete. 2023-08-31T19:04:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.233+0000 7fdd097ff700 1 Processor -- start 2023-08-31T19:04:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.234+0000 7fdd097ff700 1 -- start start 2023-08-31T19:04:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd097ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd040cb9b0 0x7fdd0414dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd097ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd04154060 0x7fdd0414e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd097ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd041588d0 0x7fdd04155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd097ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd04153100 con 0x7fdd04154060 2023-08-31T19:04:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd097ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd041524f0 con 0x7fdd041588d0 2023-08-31T19:04:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd097ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd041527d0 con 0x7fdd040cb9b0 2023-08-31T19:04:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd027fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd04154060 0x7fdd0414e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:39.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd027fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd04154060 0x7fdd0414e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42814/0 (socket says 172.21.15.72:42814) 2023-08-31T19:04:39.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd027fc700 1 -- 172.21.15.72:0/3133257770 learned_addr learned my addr 172.21.15.72:0/3133257770 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:39.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd02ffd700 1 --2- 172.21.15.72:0/3133257770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd040cb9b0 0x7fdd0414dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:39.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd037fe700 1 --2- 172.21.15.72:0/3133257770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd041588d0 0x7fdd04155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:39.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd027fc700 1 -- 172.21.15.72:0/3133257770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd040cb9b0 msgr2=0x7fdd0414dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd027fc700 1 --2- 172.21.15.72:0/3133257770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd040cb9b0 0x7fdd0414dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd027fc700 1 -- 172.21.15.72:0/3133257770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd041588d0 msgr2=0x7fdd04155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd027fc700 1 --2- 172.21.15.72:0/3133257770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd041588d0 0x7fdd04155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd027fc700 1 -- 172.21.15.72:0/3133257770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc009ae0 con 0x7fdd04154060 2023-08-31T19:04:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.235+0000 7fdd027fc700 1 --2- 172.21.15.72:0/3133257770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd04154060 0x7fdd0414e1a0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7fdcf800c440 tx=0x7fdcf8007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.236+0000 7fdceaffd700 1 -- 172.21.15.72:0/3133257770 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf800ce40 con 0x7fdd04154060 2023-08-31T19:04:39.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.236+0000 7fdceaffd700 1 -- 172.21.15.72:0/3133257770 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf8007020 con 0x7fdd04154060 2023-08-31T19:04:39.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.236+0000 7fdceaffd700 1 -- 172.21.15.72:0/3133257770 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf80073c0 con 0x7fdd04154060 2023-08-31T19:04:39.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.236+0000 7fdd097ff700 1 -- 172.21.15.72:0/3133257770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd04152ab0 con 0x7fdd04154060 2023-08-31T19:04:39.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.236+0000 7fdd097ff700 1 -- 172.21.15.72:0/3133257770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd040ad4d0 con 0x7fdd04154060 2023-08-31T19:04:39.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.237+0000 7fdd097ff700 1 -- 172.21.15.72:0/3133257770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0406c6b0 con 0x7fdd04154060 2023-08-31T19:04:39.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.238+0000 7fdceaffd700 1 -- 172.21.15.72:0/3133257770 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fdcf80068b0 con 0x7fdd04154060 2023-08-31T19:04:39.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.238+0000 7fdceaffd700 1 --2- 172.21.15.72:0/3133257770 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdcf005ef30 0x7fdcf00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:39.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.239+0000 7fdceaffd700 1 -- 172.21.15.72:0/3133257770 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6721+0+0 (secure 0 0 0) 0x7fdcf8079d00 con 0x7fdd04154060 2023-08-31T19:04:39.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.239+0000 7fdd02ffd700 1 --2- 172.21.15.72:0/3133257770 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdcf005ef30 0x7fdcf00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:39.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.239+0000 7fdd02ffd700 1 --2- 172.21.15.72:0/3133257770 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdcf005ef30 0x7fdcf00613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdcf4006090 tx=0x7fdcf4008040).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:39.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.243+0000 7fdceaffd700 1 -- 172.21.15.72:0/3133257770 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdcf804acd0 con 0x7fdd04154060 2023-08-31T19:04:39.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.414+0000 7fdd097ff700 1 -- 172.21.15.72:0/3133257770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd0406c6b0 con 0x7fdd04154060 2023-08-31T19:04:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.415+0000 7fdceaffd700 1 -- 172.21.15.72:0/3133257770 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+17958 (secure 0 0 0) 0x7fdcf804e2f0 con 0x7fdd04154060 2023-08-31T19:04:39.416 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:39.417 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":108,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:04:38.994190+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:04:37.420883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-31T19:04:37.977694+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:04:39.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.417+0000 7fdd097ff700 1 -- 172.21.15.72:0/3133257770 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdcf005ef30 msgr2=0x7fdcf00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:39.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.417+0000 7fdd097ff700 1 --2- 172.21.15.72:0/3133257770 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdcf005ef30 0x7fdcf00613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdcf4006090 tx=0x7fdcf4008040).stop 2023-08-31T19:04:39.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.417+0000 7fdd097ff700 1 -- 172.21.15.72:0/3133257770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd04154060 msgr2=0x7fdd0414e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:39.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.417+0000 7fdd097ff700 1 --2- 172.21.15.72:0/3133257770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd04154060 0x7fdd0414e1a0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7fdcf800c440 tx=0x7fdcf8007da0).stop 2023-08-31T19:04:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.417+0000 7fdd097ff700 1 -- 172.21.15.72:0/3133257770 shutdown_connections 2023-08-31T19:04:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.417+0000 7fdd097ff700 1 --2- 172.21.15.72:0/3133257770 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdcf005ef30 0x7fdcf00613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.417+0000 7fdd097ff700 1 --2- 172.21.15.72:0/3133257770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd041588d0 0x7fdd04155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.417+0000 7fdd097ff700 1 --2- 172.21.15.72:0/3133257770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdd040cb9b0 0x7fdd0414dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.417+0000 7fdd097ff700 1 --2- 172.21.15.72:0/3133257770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd04154060 0x7fdd0414e1a0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.417+0000 7fdd097ff700 1 -- 172.21.15.72:0/3133257770 >> 172.21.15.72:0/3133257770 conn(0x7fdd0405e870 msgr2=0x7fdd041591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:39.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.418+0000 7fdd097ff700 1 -- 172.21.15.72:0/3133257770 shutdown_connections 2023-08-31T19:04:39.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.418+0000 7fdd097ff700 1 -- 172.21.15.72:0/3133257770 wait complete. 2023-08-31T19:04:39.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:04:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.626+0000 7fd1bffff700 1 Processor -- start 2023-08-31T19:04:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.626+0000 7fd1bffff700 1 -- start start 2023-08-31T19:04:39.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.627+0000 7fd1bffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd1b815ce50 0x7fd1b815f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:39.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.627+0000 7fd1bffff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b80c8c90 con 0x7fd1b8154220 2023-08-31T19:04:39.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.627+0000 7fd1bffff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b8158af0 con 0x7fd1b80cb940 2023-08-31T19:04:39.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.627+0000 7fd1bffff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b80aa700 con 0x7fd1b815ce50 2023-08-31T19:04:39.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.627+0000 7fd1bdd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd1b8154220 0x7fd1b8157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33178/0 (socket says 172.21.15.72:33178) 2023-08-31T19:04:39.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.627+0000 7fd1bdd9b700 1 -- 172.21.15.72:0/2359434593 learned_addr learned my addr 172.21.15.72:0/2359434593 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:39.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1be59c700 1 --2- 172.21.15.72:0/2359434593 >> v2:172.21.15.146:3300/0 conn(0x7fd1b815ce50 0x7fd1b815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:39.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bcd99700 1 -- 172.21.15.72:0/2359434593 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814328716 0 0) 0x7fd1b80c8c90 con 0x7fd1b8154220 2023-08-31T19:04:39.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bcd99700 1 -- 172.21.15.72:0/2359434593 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a40033f0 con 0x7fd1b8154220 2023-08-31T19:04:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bcd99700 1 -- 172.21.15.72:0/2359434593 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 295528733 0 0) 0x7fd1a40033f0 con 0x7fd1b8154220 2023-08-31T19:04:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bcd99700 1 -- 172.21.15.72:0/2359434593 >> v2:172.21.15.146:3300/0 conn(0x7fd1b815ce50 msgr2=0x7fd1b815f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bcd99700 1 --2- 172.21.15.72:0/2359434593 >> v2:172.21.15.146:3300/0 conn(0x7fd1b815ce50 0x7fd1b815f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bcd99700 1 -- 172.21.15.72:0/2359434593 >> v1:172.21.15.146:6789/0 conn(0x7fd1b80cb940 legacy=0x7fd1b81583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:39.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bcd99700 1 -- 172.21.15.72:0/2359434593 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b8155610 con 0x7fd1b8154220 2023-08-31T19:04:39.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bcd99700 1 -- 172.21.15.72:0/2359434593 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fd1b40015f0 con 0x7fd1b8154220 2023-08-31T19:04:39.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bcd99700 1 -- 172.21.15.72:0/2359434593 >> v1:172.21.15.72:6789/0 conn(0x7fd1b8154220 legacy=0x7fd1b8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:39.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bcd99700 1 --2- 172.21.15.72:0/2359434593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1a40038e0 0x7fd1a4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:39.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bcd99700 1 --2- 172.21.15.72:0/2359434593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a4004690 0x7fd1a4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:39.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bcd99700 1 --2- 172.21.15.72:0/2359434593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1a4005000 0x7fd1a400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:39.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bcd99700 1 -- 172.21.15.72:0/2359434593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80aa700 con 0x7fd1a40038e0 2023-08-31T19:04:39.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bcd99700 1 -- 172.21.15.72:0/2359434593 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a400beb0 con 0x7fd1a4004690 2023-08-31T19:04:39.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bcd99700 1 -- 172.21.15.72:0/2359434593 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a400c070 con 0x7fd1a4005000 2023-08-31T19:04:39.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.628+0000 7fd1bdd9b700 1 --2- 172.21.15.72:0/2359434593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1a40038e0 0x7fd1a4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:39.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.629+0000 7fd1be59c700 1 --2- 172.21.15.72:0/2359434593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1a4005000 0x7fd1a400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:39.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.629+0000 7fd1bd59a700 1 --2- 172.21.15.72:0/2359434593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a4004690 0x7fd1a4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:39.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.629+0000 7fd1bdd9b700 1 -- 172.21.15.72:0/2359434593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1a4005000 msgr2=0x7fd1a400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:39.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.629+0000 7fd1bdd9b700 1 --2- 172.21.15.72:0/2359434593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1a4005000 0x7fd1a400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.629+0000 7fd1bdd9b700 1 -- 172.21.15.72:0/2359434593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a4004690 msgr2=0x7fd1a4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:39.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.629+0000 7fd1bdd9b700 1 --2- 172.21.15.72:0/2359434593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a4004690 0x7fd1a4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.629+0000 7fd1bdd9b700 1 -- 172.21.15.72:0/2359434593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a40033f0 con 0x7fd1a40038e0 2023-08-31T19:04:39.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.629+0000 7fd1be59c700 1 --2- 172.21.15.72:0/2359434593 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1a4005000 0x7fd1a400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:39.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.629+0000 7fd1be59c700 1 -- 172.21.15.72:0/2359434593 reap_dead start 2023-08-31T19:04:39.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.629+0000 7fd1bdd9b700 1 --2- 172.21.15.72:0/2359434593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1a40038e0 0x7fd1a4003d00 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7fd1b400c160 tx=0x7fd1b40077a0).ready entity=mon.0 client_cookie=b2f64449c0246027 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:39.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.629+0000 7fd1bcd99700 1 -- 172.21.15.72:0/2359434593 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40079d0 con 0x7fd1a40038e0 2023-08-31T19:04:39.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.629+0000 7fd1bcd99700 1 -- 172.21.15.72:0/2359434593 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b400ca90 con 0x7fd1a40038e0 2023-08-31T19:04:39.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.629+0000 7fd1bcd99700 1 -- 172.21.15.72:0/2359434593 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400ce10 con 0x7fd1a40038e0 2023-08-31T19:04:39.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.630+0000 7fd1bffff700 1 -- 172.21.15.72:0/2359434593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1a40038e0 msgr2=0x7fd1a4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:39.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.630+0000 7fd1bffff700 1 --2- 172.21.15.72:0/2359434593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1a40038e0 0x7fd1a4003d00 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7fd1b400c160 tx=0x7fd1b40077a0).stop 2023-08-31T19:04:39.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.630+0000 7fd1bffff700 1 -- 172.21.15.72:0/2359434593 shutdown_connections 2023-08-31T19:04:39.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.630+0000 7fd1bffff700 1 --2- 172.21.15.72:0/2359434593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1a40038e0 0x7fd1a4003d00 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.630+0000 7fd1bffff700 1 -- 172.21.15.72:0/2359434593 >> 172.21.15.72:0/2359434593 conn(0x7fd1b805e870 msgr2=0x7fd1b80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:39.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.630+0000 7fd1bffff700 1 -- 172.21.15.72:0/2359434593 shutdown_connections 2023-08-31T19:04:39.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.630+0000 7fd1bffff700 1 -- 172.21.15.72:0/2359434593 wait complete. 2023-08-31T19:04:39.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.632+0000 7fd1bffff700 1 Processor -- start 2023-08-31T19:04:39.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.632+0000 7fd1bffff700 1 -- start start 2023-08-31T19:04:39.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.633+0000 7fd1bffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1a40038e0 0x7fd1b814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:39.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.633+0000 7fd1bffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1b8145010 0x7fd1b8145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:39.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1bffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1b814e830 0x7fd1b814ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:39.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1bffff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8144b80 con 0x7fd1b814e830 2023-08-31T19:04:39.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1bffff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b814f1a0 con 0x7fd1b8145010 2023-08-31T19:04:39.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1bffff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80c8440 con 0x7fd1a40038e0 2023-08-31T19:04:39.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1be59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1b814e830 0x7fd1b814ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:39.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1be59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1b814e830 0x7fd1b814ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42828/0 (socket says 172.21.15.72:42828) 2023-08-31T19:04:39.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1be59c700 1 -- 172.21.15.72:0/3237959219 learned_addr learned my addr 172.21.15.72:0/3237959219 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:39.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1bdd9b700 1 --2- 172.21.15.72:0/3237959219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1a40038e0 0x7fd1b814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:39.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1bd59a700 1 --2- 172.21.15.72:0/3237959219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1b8145010 0x7fd1b8145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:39.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1be59c700 1 -- 172.21.15.72:0/3237959219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1a40038e0 msgr2=0x7fd1b814fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:39.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1be59c700 1 --2- 172.21.15.72:0/3237959219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1a40038e0 0x7fd1b814fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1be59c700 1 -- 172.21.15.72:0/3237959219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1b8145010 msgr2=0x7fd1b8145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:39.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1be59c700 1 --2- 172.21.15.72:0/3237959219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1b8145010 0x7fd1b8145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1be59c700 1 -- 172.21.15.72:0/3237959219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b8145c70 con 0x7fd1b814e830 2023-08-31T19:04:39.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1bd59a700 1 --2- 172.21.15.72:0/3237959219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1b8145010 0x7fd1b8145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:39.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.634+0000 7fd1be59c700 1 --2- 172.21.15.72:0/3237959219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1b814e830 0x7fd1b814ecb0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fd1b80837d0 tx=0x7fd1b000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:39.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.635+0000 7fd1adffb700 1 -- 172.21.15.72:0/3237959219 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b000e030 con 0x7fd1b814e830 2023-08-31T19:04:39.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.635+0000 7fd1adffb700 1 -- 172.21.15.72:0/3237959219 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b000f040 con 0x7fd1b814e830 2023-08-31T19:04:39.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.635+0000 7fd1adffb700 1 -- 172.21.15.72:0/3237959219 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b0010ea0 con 0x7fd1b814e830 2023-08-31T19:04:39.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.635+0000 7fd1bffff700 1 -- 172.21.15.72:0/3237959219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b80c8160 con 0x7fd1b814e830 2023-08-31T19:04:39.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.635+0000 7fd1bffff700 1 -- 172.21.15.72:0/3237959219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b8144810 con 0x7fd1b814e830 2023-08-31T19:04:39.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.636+0000 7fd19b7fe700 1 -- 172.21.15.72:0/3237959219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd194005120 con 0x7fd1b814e830 2023-08-31T19:04:39.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.637+0000 7fd1adffb700 1 -- 172.21.15.72:0/3237959219 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd1b0015690 con 0x7fd1b814e830 2023-08-31T19:04:39.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.637+0000 7fd1adffb700 1 --2- 172.21.15.72:0/3237959219 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd19c05ef30 0x7fd19c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:39.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.637+0000 7fd1adffb700 1 -- 172.21.15.72:0/3237959219 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6721+0+0 (secure 0 0 0) 0x7fd1b007aa30 con 0x7fd1b814e830 2023-08-31T19:04:39.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.638+0000 7fd1bdd9b700 1 --2- 172.21.15.72:0/3237959219 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd19c05ef30 0x7fd19c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:39.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.638+0000 7fd1bdd9b700 1 --2- 172.21.15.72:0/3237959219 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd19c05ef30 0x7fd19c0613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd1b4000ef0 tx=0x7fd1b4015000).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:39.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.641+0000 7fd1adffb700 1 -- 172.21.15.72:0/3237959219 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd1b007ce60 con 0x7fd1b814e830 2023-08-31T19:04:39.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.810+0000 7fd19b7fe700 1 -- 172.21.15.72:0/3237959219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd194005ac0 con 0x7fd1b814e830 2023-08-31T19:04:39.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.811+0000 7fd1adffb700 1 -- 172.21.15.72:0/3237959219 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+17958 (secure 0 0 0) 0x7fd1b004bac0 con 0x7fd1b814e830 2023-08-31T19:04:39.812 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:39.812 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":108,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:04:38.994190+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:04:37.420883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-31T19:04:37.977694+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:04:39.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.813+0000 7fd19b7fe700 1 -- 172.21.15.72:0/3237959219 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd19c05ef30 msgr2=0x7fd19c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:39.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.813+0000 7fd19b7fe700 1 --2- 172.21.15.72:0/3237959219 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd19c05ef30 0x7fd19c0613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd1b4000ef0 tx=0x7fd1b4015000).stop 2023-08-31T19:04:39.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.813+0000 7fd19b7fe700 1 -- 172.21.15.72:0/3237959219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1b814e830 msgr2=0x7fd1b814ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:39.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.813+0000 7fd19b7fe700 1 --2- 172.21.15.72:0/3237959219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1b814e830 0x7fd1b814ecb0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fd1b80837d0 tx=0x7fd1b000b040).stop 2023-08-31T19:04:39.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.813+0000 7fd19b7fe700 1 -- 172.21.15.72:0/3237959219 shutdown_connections 2023-08-31T19:04:39.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.813+0000 7fd19b7fe700 1 --2- 172.21.15.72:0/3237959219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1b814e830 0x7fd1b814ecb0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.813+0000 7fd19b7fe700 1 --2- 172.21.15.72:0/3237959219 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1a40038e0 0x7fd1b814fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.813+0000 7fd19b7fe700 1 --2- 172.21.15.72:0/3237959219 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd19c05ef30 0x7fd19c0613f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.813+0000 7fd19b7fe700 1 --2- 172.21.15.72:0/3237959219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1b8145010 0x7fd1b8145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:39.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.813+0000 7fd19b7fe700 1 -- 172.21.15.72:0/3237959219 >> 172.21.15.72:0/3237959219 conn(0x7fd1b805e870 msgr2=0x7fd1b80648c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:39.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.814+0000 7fd19b7fe700 1 -- 172.21.15.72:0/3237959219 shutdown_connections 2023-08-31T19:04:39.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:39.814+0000 7fd19b7fe700 1 -- 172.21.15.72:0/3237959219 wait complete. 2023-08-31T19:04:39.831 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T19:04:40.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.026+0000 7ff4a1fff700 1 Processor -- start 2023-08-31T19:04:40.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.027+0000 7ff4a1fff700 1 -- start start 2023-08-31T19:04:40.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.028+0000 7ff4a1fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff49c154030 0x7ff49c154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:40.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.028+0000 7ff4a1fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff49c0c06b0 0x7ff49c0c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:40.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.028+0000 7ff4a1fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49c0c6ed0 con 0x7ff49c0aa140 2023-08-31T19:04:40.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.028+0000 7ff4a1fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49c0c66e0 con 0x7ff49c154030 2023-08-31T19:04:40.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.028+0000 7ff4a1fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0c68c0 con 0x7ff49c0c06b0 2023-08-31T19:04:40.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.028+0000 7ff49b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff49c154030 0x7ff49c154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:40.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.028+0000 7ff49bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff49c0aa140 0x7ff49c063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33184/0 (socket says 172.21.15.72:33184) 2023-08-31T19:04:40.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.028+0000 7ff49bfff700 1 -- 172.21.15.72:0/3093597078 learned_addr learned my addr 172.21.15.72:0/3093597078 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:40.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.029+0000 7ff49affd700 1 --2- 172.21.15.72:0/3093597078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff49c0c06b0 0x7ff49c0c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:40.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.029+0000 7ff49b7fe700 1 -- 172.21.15.72:0/3093597078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff49c0c06b0 msgr2=0x7ff49c0c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:40.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.029+0000 7ff49b7fe700 1 --2- 172.21.15.72:0/3093597078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff49c0c06b0 0x7ff49c0c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:40.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.029+0000 7ff49b7fe700 1 -- 172.21.15.72:0/3093597078 >> v1:172.21.15.72:6789/0 conn(0x7ff49c0aa140 legacy=0x7ff49c063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:40.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.029+0000 7ff49b7fe700 1 -- 172.21.15.72:0/3093597078 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c0c0f30 con 0x7ff49c154030 2023-08-31T19:04:40.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.029+0000 7ff49affd700 1 --2- 172.21.15.72:0/3093597078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff49c0c06b0 0x7ff49c0c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:40.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.029+0000 7ff49a7fc700 1 -- 172.21.15.72:0/3093597078 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75006003 0 0) 0x7ff49c0c6ed0 con 0x7ff49c0aa140 2023-08-31T19:04:40.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.029+0000 7ff49b7fe700 1 --2- 172.21.15.72:0/3093597078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff49c154030 0x7ff49c154410 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7ff48c009760 tx=0x7ff48c009060).ready entity=mon.0 client_cookie=e7fbade0d8bde47c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:40.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.029+0000 7ff49a7fc700 1 -- 172.21.15.72:0/3093597078 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c00b580 con 0x7ff49c154030 2023-08-31T19:04:40.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.029+0000 7ff49a7fc700 1 -- 172.21.15.72:0/3093597078 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c00b6e0 con 0x7ff49c154030 2023-08-31T19:04:40.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.029+0000 7ff49a7fc700 1 -- 172.21.15.72:0/3093597078 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c00ba60 con 0x7ff49c154030 2023-08-31T19:04:40.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.030+0000 7ff4a1fff700 1 -- 172.21.15.72:0/3093597078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff49c154030 msgr2=0x7ff49c154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:40.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.030+0000 7ff4a1fff700 1 --2- 172.21.15.72:0/3093597078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff49c154030 0x7ff49c154410 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7ff48c009760 tx=0x7ff48c009060).stop 2023-08-31T19:04:40.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.030+0000 7ff4a1fff700 1 -- 172.21.15.72:0/3093597078 shutdown_connections 2023-08-31T19:04:40.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.030+0000 7ff4a1fff700 1 --2- 172.21.15.72:0/3093597078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff49c154030 0x7ff49c154410 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:40.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.030+0000 7ff4a1fff700 1 --2- 172.21.15.72:0/3093597078 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff49c0c06b0 0x7ff49c0c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:40.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.030+0000 7ff4a1fff700 1 -- 172.21.15.72:0/3093597078 >> 172.21.15.72:0/3093597078 conn(0x7ff49c05eb60 msgr2=0x7ff49c0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.030+0000 7ff4a1fff700 1 -- 172.21.15.72:0/3093597078 shutdown_connections 2023-08-31T19:04:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.030+0000 7ff4a1fff700 1 -- 172.21.15.72:0/3093597078 wait complete. 2023-08-31T19:04:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.031+0000 7ff4a1fff700 1 Processor -- start 2023-08-31T19:04:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.031+0000 7ff4a1fff700 1 -- start start 2023-08-31T19:04:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.032+0000 7ff4a1fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff49c0aa140 0x7ff49c14a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.032+0000 7ff4a1fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff49c0c06b0 0x7ff49c0c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.032+0000 7ff4a1fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff49c154030 0x7ff49c0c35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.032+0000 7ff4a1fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0c3b80 con 0x7ff49c0aa140 2023-08-31T19:04:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.032+0000 7ff4a1fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0c3e60 con 0x7ff49c154030 2023-08-31T19:04:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.032+0000 7ff4a1fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0c4140 con 0x7ff49c0c06b0 2023-08-31T19:04:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.032+0000 7ff49b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff49c0aa140 0x7ff49c14a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.032+0000 7ff49b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff49c0aa140 0x7ff49c14a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42838/0 (socket says 172.21.15.72:42838) 2023-08-31T19:04:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.032+0000 7ff49b7fe700 1 -- 172.21.15.72:0/709037697 learned_addr learned my addr 172.21.15.72:0/709037697 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.033+0000 7ff49affd700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff49c0c06b0 0x7ff49c0c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.033+0000 7ff49b7fe700 1 -- 172.21.15.72:0/709037697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff49c0c06b0 msgr2=0x7ff49c0c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.033+0000 7ff49bfff700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff49c154030 0x7ff49c0c35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.033+0000 7ff49b7fe700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff49c0c06b0 0x7ff49c0c3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.033+0000 7ff49b7fe700 1 -- 172.21.15.72:0/709037697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff49c154030 msgr2=0x7ff49c0c35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:40.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.033+0000 7ff49b7fe700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff49c154030 0x7ff49c0c35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:40.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.033+0000 7ff49b7fe700 1 -- 172.21.15.72:0/709037697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c0092a0 con 0x7ff49c0aa140 2023-08-31T19:04:40.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.033+0000 7ff49affd700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff49c0c06b0 0x7ff49c0c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:40.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.033+0000 7ff49bfff700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff49c154030 0x7ff49c0c35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:40.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.033+0000 7ff49b7fe700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff49c0aa140 0x7ff49c14a1f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7ff48c009eb0 tx=0x7ff48c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:40.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.033+0000 7ff4837fe700 1 -- 172.21.15.72:0/709037697 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c00ba60 con 0x7ff49c0aa140 2023-08-31T19:04:40.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.033+0000 7ff4837fe700 1 -- 172.21.15.72:0/709037697 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c000c90 con 0x7ff49c0aa140 2023-08-31T19:04:40.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.033+0000 7ff4a1fff700 1 -- 172.21.15.72:0/709037697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49c0c4420 con 0x7ff49c0aa140 2023-08-31T19:04:40.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.033+0000 7ff4837fe700 1 -- 172.21.15.72:0/709037697 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c01b650 con 0x7ff49c0aa140 2023-08-31T19:04:40.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.034+0000 7ff4a1fff700 1 -- 172.21.15.72:0/709037697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c0c4c20 con 0x7ff49c0aa140 2023-08-31T19:04:40.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.034+0000 7ff4a1fff700 1 -- 172.21.15.72:0/709037697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49c06c6b0 con 0x7ff49c0aa140 2023-08-31T19:04:40.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.035+0000 7ff4837fe700 1 -- 172.21.15.72:0/709037697 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff48c01ba40 con 0x7ff49c0aa140 2023-08-31T19:04:40.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.036+0000 7ff4837fe700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff48805ef30 0x7ff4880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:40.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.037+0000 7ff4837fe700 1 -- 172.21.15.72:0/709037697 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7ff48c07bb80 con 0x7ff49c0aa140 2023-08-31T19:04:40.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.037+0000 7ff49affd700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff48805ef30 0x7ff4880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:40.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.037+0000 7ff49affd700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff48805ef30 0x7ff4880613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff49c0ad8e0 tx=0x7ff490008040).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:40.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.041+0000 7ff4837fe700 1 -- 172.21.15.72:0/709037697 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff48c04caf0 con 0x7ff49c0aa140 2023-08-31T19:04:40.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:40.252+0000 7ff4a1fff700 1 -- 172.21.15.72:0/709037697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff49c0c0c50 con 0x7ff49c0aa140 2023-08-31T19:04:41.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.018+0000 7ff4837fe700 1 -- 172.21.15.72:0/709037697 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff48c0280b0 con 0x7ff49c0aa140 2023-08-31T19:04:41.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.021+0000 7ff4a1fff700 1 -- 172.21.15.72:0/709037697 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff48805ef30 msgr2=0x7ff4880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:41.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.021+0000 7ff4a1fff700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff48805ef30 0x7ff4880613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff49c0ad8e0 tx=0x7ff490008040).stop 2023-08-31T19:04:41.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.021+0000 7ff4a1fff700 1 -- 172.21.15.72:0/709037697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff49c0aa140 msgr2=0x7ff49c14a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:41.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.021+0000 7ff4a1fff700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff49c0aa140 0x7ff49c14a1f0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7ff48c009eb0 tx=0x7ff48c017000).stop 2023-08-31T19:04:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.021+0000 7ff4a1fff700 1 -- 172.21.15.72:0/709037697 shutdown_connections 2023-08-31T19:04:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.021+0000 7ff4a1fff700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff48805ef30 0x7ff4880613f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.021+0000 7ff4a1fff700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff49c154030 0x7ff49c0c35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.021+0000 7ff4a1fff700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff49c0aa140 0x7ff49c14a1f0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.021+0000 7ff4a1fff700 1 --2- 172.21.15.72:0/709037697 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff49c0c06b0 0x7ff49c0c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.021+0000 7ff4a1fff700 1 -- 172.21.15.72:0/709037697 >> 172.21.15.72:0/709037697 conn(0x7ff49c05eb60 msgr2=0x7ff49c1515f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.021+0000 7ff4a1fff700 1 -- 172.21.15.72:0/709037697 shutdown_connections 2023-08-31T19:04:41.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.021+0000 7ff4a1fff700 1 -- 172.21.15.72:0/709037697 wait complete. 2023-08-31T19:04:41.042 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-31T19:04:41.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T19:04:41.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.239+0000 7f87f8dff700 1 Processor -- start 2023-08-31T19:04:41.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.240+0000 7f87f8dff700 1 -- start start 2023-08-31T19:04:41.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f8dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87f414e3c0 0x7f87f40bc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:41.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f8dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87f40c2110 0x7f87f4064700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:41.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f8dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f406a6c0 con 0x7f87f4150f30 2023-08-31T19:04:41.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f8dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f40bca60 con 0x7f87f414e3c0 2023-08-31T19:04:41.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f8dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40bcd40 con 0x7f87f40c2110 2023-08-31T19:04:41.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87f414e3c0 0x7f87f40bc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:41.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87f414e3c0 0x7f87f40bc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42842/0 (socket says 172.21.15.72:42842) 2023-08-31T19:04:41.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f259c700 1 -- 172.21.15.72:0/1193886388 learned_addr learned my addr 172.21.15.72:0/1193886388 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:41.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f2d9d700 1 --2- 172.21.15.72:0/1193886388 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87f40c2110 0x7f87f4064700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:41.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f259c700 1 -- 172.21.15.72:0/1193886388 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87f40c2110 msgr2=0x7f87f4064700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:41.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f259c700 1 --2- 172.21.15.72:0/1193886388 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87f40c2110 0x7f87f4064700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:41.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f259c700 1 -- 172.21.15.72:0/1193886388 >> v1:172.21.15.146:6789/0 conn(0x7f87f4150f30 legacy=0x7f87f40c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:41.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f259c700 1 -- 172.21.15.72:0/1193886388 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40bd020 con 0x7f87f414e3c0 2023-08-31T19:04:41.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f2d9d700 1 --2- 172.21.15.72:0/1193886388 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87f40c2110 0x7f87f4064700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:41.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f259c700 1 --2- 172.21.15.72:0/1193886388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f414e3c0 0x7f87f40bc180 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f87e4006fd0 tx=0x7f87e400b3b0).ready entity=mon.0 client_cookie=2e727fa004687731 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:41.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f159a700 1 -- 172.21.15.72:0/1193886388 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e400db40 con 0x7f87f414e3c0 2023-08-31T19:04:41.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f159a700 1 -- 172.21.15.72:0/1193886388 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e400dca0 con 0x7f87f414e3c0 2023-08-31T19:04:41.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.242+0000 7f87f159a700 1 -- 172.21.15.72:0/1193886388 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4010680 con 0x7f87f414e3c0 2023-08-31T19:04:41.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.243+0000 7f87f8dff700 1 -- 172.21.15.72:0/1193886388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f414e3c0 msgr2=0x7f87f40bc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:41.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.243+0000 7f87f8dff700 1 --2- 172.21.15.72:0/1193886388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f414e3c0 0x7f87f40bc180 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f87e4006fd0 tx=0x7f87e400b3b0).stop 2023-08-31T19:04:41.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.243+0000 7f87f8dff700 1 -- 172.21.15.72:0/1193886388 shutdown_connections 2023-08-31T19:04:41.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.243+0000 7f87f8dff700 1 --2- 172.21.15.72:0/1193886388 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87f40c2110 0x7f87f4064700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:41.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.243+0000 7f87f8dff700 1 --2- 172.21.15.72:0/1193886388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f414e3c0 0x7f87f40bc180 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:41.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.243+0000 7f87f8dff700 1 -- 172.21.15.72:0/1193886388 >> 172.21.15.72:0/1193886388 conn(0x7f87f40630c0 msgr2=0x7f87f40c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:41.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.243+0000 7f87f8dff700 1 -- 172.21.15.72:0/1193886388 shutdown_connections 2023-08-31T19:04:41.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.243+0000 7f87f8dff700 1 -- 172.21.15.72:0/1193886388 wait complete. 2023-08-31T19:04:41.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.244+0000 7f87f8dff700 1 Processor -- start 2023-08-31T19:04:41.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.244+0000 7f87f8dff700 1 -- start start 2023-08-31T19:04:41.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.245+0000 7f87f8dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f40c2110 0x7f87f4168c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:41.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.245+0000 7f87f8dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87f414e3c0 0x7f87f414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:41.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.245+0000 7f87f8dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87f4150f30 0x7f87f4145840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:41.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.245+0000 7f87f8dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40bdcd0 con 0x7f87f40c2110 2023-08-31T19:04:41.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.245+0000 7f87f8dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4150060 con 0x7f87f414e3c0 2023-08-31T19:04:41.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.245+0000 7f87f8dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f41502e0 con 0x7f87f4150f30 2023-08-31T19:04:41.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.246+0000 7f87f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f40c2110 0x7f87f4168c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:41.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.246+0000 7f87f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f40c2110 0x7f87f4168c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42846/0 (socket says 172.21.15.72:42846) 2023-08-31T19:04:41.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.246+0000 7f87f259c700 1 -- 172.21.15.72:0/2246558371 learned_addr learned my addr 172.21.15.72:0/2246558371 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:41.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.246+0000 7f87f2d9d700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87f4150f30 0x7f87f4145840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:41.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.246+0000 7f87f259c700 1 -- 172.21.15.72:0/2246558371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87f4150f30 msgr2=0x7f87f4145840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:41.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.246+0000 7f87f1d9b700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87f414e3c0 0x7f87f414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:41.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.246+0000 7f87f259c700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87f4150f30 0x7f87f4145840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:41.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.246+0000 7f87f259c700 1 -- 172.21.15.72:0/2246558371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87f414e3c0 msgr2=0x7f87f414fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:41.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.246+0000 7f87f259c700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87f414e3c0 0x7f87f414fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:41.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.246+0000 7f87f259c700 1 -- 172.21.15.72:0/2246558371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e400b610 con 0x7f87f40c2110 2023-08-31T19:04:41.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.246+0000 7f87f2d9d700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87f4150f30 0x7f87f4145840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:41.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.246+0000 7f87f1d9b700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87f414e3c0 0x7f87f414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:41.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.246+0000 7f87f259c700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f40c2110 0x7f87f4168c80 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f87f4065e90 tx=0x7f87e400b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:41.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.247+0000 7f87e27fc700 1 -- 172.21.15.72:0/2246558371 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4010640 con 0x7f87f40c2110 2023-08-31T19:04:41.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.247+0000 7f87e27fc700 1 -- 172.21.15.72:0/2246558371 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e4019660 con 0x7f87f40c2110 2023-08-31T19:04:41.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.247+0000 7f87e27fc700 1 -- 172.21.15.72:0/2246558371 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e40199e0 con 0x7f87f40c2110 2023-08-31T19:04:41.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.247+0000 7f87f8dff700 1 -- 172.21.15.72:0/2246558371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f41505c0 con 0x7f87f40c2110 2023-08-31T19:04:41.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.247+0000 7f87f8dff700 1 -- 172.21.15.72:0/2246558371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f4145d30 con 0x7f87f40c2110 2023-08-31T19:04:41.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.248+0000 7f87f8dff700 1 -- 172.21.15.72:0/2246558371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f406c6b0 con 0x7f87f40c2110 2023-08-31T19:04:41.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.249+0000 7f87e27fc700 1 -- 172.21.15.72:0/2246558371 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f87e4023430 con 0x7f87f40c2110 2023-08-31T19:04:41.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.250+0000 7f87e27fc700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87d405ef00 0x7f87d40613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:41.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.250+0000 7f87e27fc700 1 -- 172.21.15.72:0/2246558371 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f87e407b650 con 0x7f87f40c2110 2023-08-31T19:04:41.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.250+0000 7f87f1d9b700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87d405ef00 0x7f87d40613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:41.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.251+0000 7f87f1d9b700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87d405ef00 0x7f87d40613c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f87f414ee50 tx=0x7f87e8009040).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:41.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.254+0000 7f87e27fc700 1 -- 172.21.15.72:0/2246558371 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f87e404c5c0 con 0x7f87f40c2110 2023-08-31T19:04:41.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:41.466+0000 7f87f8dff700 1 -- 172.21.15.72:0/2246558371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f87f40bd300 con 0x7f87f40c2110 2023-08-31T19:04:42.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.024+0000 7f87e27fc700 1 -- 172.21.15.72:0/2246558371 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7f87e404fbe0 con 0x7f87f40c2110 2023-08-31T19:04:42.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.027+0000 7f87f8dff700 1 -- 172.21.15.72:0/2246558371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87d405ef00 msgr2=0x7f87d40613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:42.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.027+0000 7f87f8dff700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87d405ef00 0x7f87d40613c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f87f414ee50 tx=0x7f87e8009040).stop 2023-08-31T19:04:42.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.027+0000 7f87f8dff700 1 -- 172.21.15.72:0/2246558371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f40c2110 msgr2=0x7f87f4168c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:42.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.027+0000 7f87f8dff700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f40c2110 0x7f87f4168c80 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f87f4065e90 tx=0x7f87e400b3b0).stop 2023-08-31T19:04:42.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.027+0000 7f87f8dff700 1 -- 172.21.15.72:0/2246558371 shutdown_connections 2023-08-31T19:04:42.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.027+0000 7f87f8dff700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f87f4150f30 0x7f87f4145840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.027+0000 7f87f8dff700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87f40c2110 0x7f87f4168c80 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.027+0000 7f87f8dff700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f87d405ef00 0x7f87d40613c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.027+0000 7f87f8dff700 1 --2- 172.21.15.72:0/2246558371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87f414e3c0 0x7f87f414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.027+0000 7f87f8dff700 1 -- 172.21.15.72:0/2246558371 >> 172.21.15.72:0/2246558371 conn(0x7f87f40630c0 msgr2=0x7f87f41513e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:42.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.027+0000 7f87f8dff700 1 -- 172.21.15.72:0/2246558371 shutdown_connections 2023-08-31T19:04:42.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.027+0000 7f87f8dff700 1 -- 172.21.15.72:0/2246558371 wait complete. 2023-08-31T19:04:42.044 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T19:04:42.045 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:04:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.235+0000 7f9a00dff700 1 Processor -- start 2023-08-31T19:04:42.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.235+0000 7f9a00dff700 1 -- start start 2023-08-31T19:04:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.236+0000 7f9a00dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f99fc154220 0x7f99fc157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.236+0000 7f9a00dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99fc0cb940 0x7f99fc1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.236+0000 7f9a00dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f99fc1586b0 0x7f99fc154600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.236+0000 7f9a00dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99fc0aa700 con 0x7f99fc154220 2023-08-31T19:04:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.236+0000 7f9a00dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99fc0c5e10 con 0x7f99fc1586b0 2023-08-31T19:04:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.236+0000 7f9a00dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc158b40 con 0x7f99fc0cb940 2023-08-31T19:04:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.237+0000 7f99fa59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f99fc154220 0x7f99fc157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.237+0000 7f99fa59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f99fc154220 0x7f99fc157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42848/0 (socket says 172.21.15.72:42848) 2023-08-31T19:04:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.237+0000 7f99fa59c700 1 -- 172.21.15.72:0/3580717332 learned_addr learned my addr 172.21.15.72:0/3580717332 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.237+0000 7f99fad9d700 1 --2- 172.21.15.72:0/3580717332 >> v2:172.21.15.146:3300/0 conn(0x7f99fc1586b0 0x7f99fc154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.237+0000 7f99fa59c700 1 -- 172.21.15.72:0/3580717332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99fc0cb940 msgr2=0x7f99fc1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.237+0000 7f99f9d9b700 1 --2- 172.21.15.72:0/3580717332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99fc0cb940 0x7f99fc1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.237+0000 7f99fa59c700 1 --2- 172.21.15.72:0/3580717332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99fc0cb940 0x7f99fc1581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.237+0000 7f99fa59c700 1 -- 172.21.15.72:0/3580717332 >> v2:172.21.15.146:3300/0 conn(0x7f99fc1586b0 msgr2=0x7f99fc154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.237+0000 7f99fa59c700 1 --2- 172.21.15.72:0/3580717332 >> v2:172.21.15.146:3300/0 conn(0x7f99fc1586b0 0x7f99fc154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.237+0000 7f99fa59c700 1 -- 172.21.15.72:0/3580717332 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0c8c90 con 0x7f99fc154220 2023-08-31T19:04:42.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.237+0000 7f99fad9d700 1 --2- 172.21.15.72:0/3580717332 >> v2:172.21.15.146:3300/0 conn(0x7f99fc1586b0 0x7f99fc154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:42.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.237+0000 7f99f9d9b700 1 --2- 172.21.15.72:0/3580717332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99fc0cb940 0x7f99fc1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:42.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.237+0000 7f99fa59c700 1 --2- 172.21.15.72:0/3580717332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc154220 0x7f99fc157cd0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f99ec009810 tx=0x7f99ec009060).ready entity=mon.0 client_cookie=70bd47f9728f43c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:42.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.237+0000 7f99f959a700 1 -- 172.21.15.72:0/3580717332 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec005880 con 0x7f99fc154220 2023-08-31T19:04:42.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.238+0000 7f99f959a700 1 -- 172.21.15.72:0/3580717332 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ec0059e0 con 0x7f99fc154220 2023-08-31T19:04:42.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.238+0000 7f99f959a700 1 -- 172.21.15.72:0/3580717332 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec005d60 con 0x7f99fc154220 2023-08-31T19:04:42.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.238+0000 7f9a00dff700 1 -- 172.21.15.72:0/3580717332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc154220 msgr2=0x7f99fc157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:42.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.238+0000 7f9a00dff700 1 --2- 172.21.15.72:0/3580717332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc154220 0x7f99fc157cd0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f99ec009810 tx=0x7f99ec009060).stop 2023-08-31T19:04:42.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.238+0000 7f9a00dff700 1 -- 172.21.15.72:0/3580717332 shutdown_connections 2023-08-31T19:04:42.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.238+0000 7f9a00dff700 1 --2- 172.21.15.72:0/3580717332 >> v2:172.21.15.146:3300/0 conn(0x7f99fc1586b0 0x7f99fc154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.238+0000 7f9a00dff700 1 --2- 172.21.15.72:0/3580717332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc154220 0x7f99fc157cd0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.238+0000 7f9a00dff700 1 --2- 172.21.15.72:0/3580717332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99fc0cb940 0x7f99fc1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.238+0000 7f9a00dff700 1 -- 172.21.15.72:0/3580717332 >> 172.21.15.72:0/3580717332 conn(0x7f99fc05e870 msgr2=0x7f99fc0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.238+0000 7f9a00dff700 1 -- 172.21.15.72:0/3580717332 shutdown_connections 2023-08-31T19:04:42.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.238+0000 7f9a00dff700 1 -- 172.21.15.72:0/3580717332 wait complete. 2023-08-31T19:04:42.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.240+0000 7f9a00dff700 1 Processor -- start 2023-08-31T19:04:42.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.240+0000 7f9a00dff700 1 -- start start 2023-08-31T19:04:42.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f9a00dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc0cb940 0x7f99fc0ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:42.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f9a00dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99fc154220 0x7f99fc150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:42.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f9a00dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99fc1586b0 0x7f99fc0aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:42.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f9a00dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0af660 con 0x7f99fc0cb940 2023-08-31T19:04:42.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f9a00dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0af940 con 0x7f99fc1586b0 2023-08-31T19:04:42.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f9a00dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0afc20 con 0x7f99fc154220 2023-08-31T19:04:42.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f99fa59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc0cb940 0x7f99fc0ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:42.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f99fa59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc0cb940 0x7f99fc0ad190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42852/0 (socket says 172.21.15.72:42852) 2023-08-31T19:04:42.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f99fa59c700 1 -- 172.21.15.72:0/2819170304 learned_addr learned my addr 172.21.15.72:0/2819170304 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:42.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f99f9d9b700 1 --2- 172.21.15.72:0/2819170304 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99fc154220 0x7f99fc150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:42.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f99fad9d700 1 --2- 172.21.15.72:0/2819170304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99fc1586b0 0x7f99fc0aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:42.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f99fa59c700 1 -- 172.21.15.72:0/2819170304 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99fc154220 msgr2=0x7f99fc150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:42.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f99fa59c700 1 --2- 172.21.15.72:0/2819170304 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99fc154220 0x7f99fc150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f99fa59c700 1 -- 172.21.15.72:0/2819170304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99fc1586b0 msgr2=0x7f99fc0aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:42.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f99fa59c700 1 --2- 172.21.15.72:0/2819170304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99fc1586b0 0x7f99fc0aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.241+0000 7f99fa59c700 1 -- 172.21.15.72:0/2819170304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec009300 con 0x7f99fc0cb940 2023-08-31T19:04:42.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.242+0000 7f99fa59c700 1 --2- 172.21.15.72:0/2819170304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc0cb940 0x7f99fc0ad190 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f99fc083570 tx=0x7f99ec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:42.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.242+0000 7f99ea7fc700 1 -- 172.21.15.72:0/2819170304 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec00b810 con 0x7f99fc0cb940 2023-08-31T19:04:42.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.242+0000 7f99ea7fc700 1 -- 172.21.15.72:0/2819170304 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ec00b970 con 0x7f99fc0cb940 2023-08-31T19:04:42.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.242+0000 7f9a00dff700 1 -- 172.21.15.72:0/2819170304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99fc0aff00 con 0x7f99fc0cb940 2023-08-31T19:04:42.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.242+0000 7f99ea7fc700 1 -- 172.21.15.72:0/2819170304 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec00bd10 con 0x7f99fc0cb940 2023-08-31T19:04:42.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.242+0000 7f9a00dff700 1 -- 172.21.15.72:0/2819170304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc0af200 con 0x7f99fc0cb940 2023-08-31T19:04:42.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.243+0000 7f9a00dff700 1 -- 172.21.15.72:0/2819170304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc06c6b0 con 0x7f99fc0cb940 2023-08-31T19:04:42.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.244+0000 7f99ea7fc700 1 -- 172.21.15.72:0/2819170304 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f99ec018070 con 0x7f99fc0cb940 2023-08-31T19:04:42.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.245+0000 7f99ea7fc700 1 --2- 172.21.15.72:0/2819170304 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f99dc05ef30 0x7f99dc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:42.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.245+0000 7f99ea7fc700 1 -- 172.21.15.72:0/2819170304 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f99ec07b340 con 0x7f99fc0cb940 2023-08-31T19:04:42.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.245+0000 7f99f9d9b700 1 --2- 172.21.15.72:0/2819170304 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f99dc05ef30 0x7f99dc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:42.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.246+0000 7f99f9d9b700 1 --2- 172.21.15.72:0/2819170304 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f99dc05ef30 0x7f99dc0613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f99fc0ad680 tx=0x7f99f0008040).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:42.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.249+0000 7f99ea7fc700 1 -- 172.21.15.72:0/2819170304 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99ec04c310 con 0x7f99fc0cb940 2023-08-31T19:04:42.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.458+0000 7f9a00dff700 1 -- 172.21.15.72:0/2819170304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99fc0b0090 con 0x7f99fc0cb940 2023-08-31T19:04:42.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.459+0000 7f99ea7fc700 1 -- 172.21.15.72:0/2819170304 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f99ec04f930 con 0x7f99fc0cb940 2023-08-31T19:04:42.458 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:42.458 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2894594800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2894594800},{"type":"v1","addr":"172.21.15.146:6834","nonce":2894594800}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2296022003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2296022003},{"type":"v1","addr":"172.21.15.72:6837","nonce":2296022003}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/159383587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":159383587},{"type":"v1","addr":"172.21.15.146:6835","nonce":159383587}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:04:38.994518+0000","modified":"2023-08-31T19:04:42.017973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6835/4088389987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4088389987},{"type":"v1","addr":"172.21.15.72:6835","nonce":4088389987}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-31T19:04:42.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.461+0000 7f9a00dff700 1 -- 172.21.15.72:0/2819170304 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f99dc05ef30 msgr2=0x7f99dc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:42.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.461+0000 7f9a00dff700 1 --2- 172.21.15.72:0/2819170304 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f99dc05ef30 0x7f99dc0613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f99fc0ad680 tx=0x7f99f0008040).stop 2023-08-31T19:04:42.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.461+0000 7f9a00dff700 1 -- 172.21.15.72:0/2819170304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc0cb940 msgr2=0x7f99fc0ad190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:42.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.461+0000 7f9a00dff700 1 --2- 172.21.15.72:0/2819170304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc0cb940 0x7f99fc0ad190 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f99fc083570 tx=0x7f99ec016000).stop 2023-08-31T19:04:42.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.461+0000 7f9a00dff700 1 -- 172.21.15.72:0/2819170304 shutdown_connections 2023-08-31T19:04:42.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.461+0000 7f9a00dff700 1 --2- 172.21.15.72:0/2819170304 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f99dc05ef30 0x7f99dc0613f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.461+0000 7f9a00dff700 1 --2- 172.21.15.72:0/2819170304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99fc1586b0 0x7f99fc0aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.461+0000 7f9a00dff700 1 --2- 172.21.15.72:0/2819170304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc0cb940 0x7f99fc0ad190 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.461+0000 7f9a00dff700 1 --2- 172.21.15.72:0/2819170304 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f99fc154220 0x7f99fc150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.461+0000 7f9a00dff700 1 -- 172.21.15.72:0/2819170304 >> 172.21.15.72:0/2819170304 conn(0x7f99fc05e870 msgr2=0x7f99fc151240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:42.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.461+0000 7f9a00dff700 1 -- 172.21.15.72:0/2819170304 shutdown_connections 2023-08-31T19:04:42.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.461+0000 7f9a00dff700 1 -- 172.21.15.72:0/2819170304 wait complete. 2023-08-31T19:04:42.463 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 48 2023-08-31T19:04:42.477 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:04:42.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.667+0000 7f5fc6fff700 1 Processor -- start 2023-08-31T19:04:42.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.668+0000 7f5fc6fff700 1 -- start start 2023-08-31T19:04:42.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.669+0000 7f5fc6fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5fc00c6c30 0x7f5fc00bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:42.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.669+0000 7f5fc6fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc01583f0 0x7f5fc00c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:42.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.669+0000 7f5fc6fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc0063be0 con 0x7f5fc00c4740 2023-08-31T19:04:42.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.669+0000 7f5fc6fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc0063010 con 0x7f5fc00c6c30 2023-08-31T19:04:42.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.669+0000 7f5fc6fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00632b0 con 0x7f5fc01583f0 2023-08-31T19:04:42.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.669+0000 7f5fc559c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc01583f0 0x7f5fc00c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:42.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.669+0000 7f5fc4d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5fc00c6c30 0x7f5fc00bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:42.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.669+0000 7f5fc559c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc01583f0 0x7f5fc00c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:33900/0 (socket says 172.21.15.72:33900) 2023-08-31T19:04:42.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.669+0000 7f5fc559c700 1 -- 172.21.15.72:0/1769894253 learned_addr learned my addr 172.21.15.72:0/1769894253 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:42.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.670+0000 7f5fc559c700 1 -- 172.21.15.72:0/1769894253 >> v2:172.21.15.146:3300/0 conn(0x7f5fc00c6c30 msgr2=0x7f5fc00bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:42.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.670+0000 7f5fc559c700 1 --2- 172.21.15.72:0/1769894253 >> v2:172.21.15.146:3300/0 conn(0x7f5fc00c6c30 0x7f5fc00bc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.670+0000 7f5fc559c700 1 -- 172.21.15.72:0/1769894253 >> v1:172.21.15.146:6789/0 conn(0x7f5fc00c4740 legacy=0x7f5fc0157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:42.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.670+0000 7f5fc559c700 1 -- 172.21.15.72:0/1769894253 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc0063590 con 0x7f5fc01583f0 2023-08-31T19:04:42.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.670+0000 7f5fc559c700 1 --2- 172.21.15.72:0/1769894253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc01583f0 0x7f5fc00c52a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f5fb8009f20 tx=0x7f5fb8009840).ready entity=mon.2 client_cookie=e88b7d9a199bdd2f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:42.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.670+0000 7f5fbf7fe700 1 -- 172.21.15.72:0/1769894253 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb800e070 con 0x7f5fc01583f0 2023-08-31T19:04:42.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.670+0000 7f5fbf7fe700 1 -- 172.21.15.72:0/1769894253 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb800b9d0 con 0x7f5fc01583f0 2023-08-31T19:04:42.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.670+0000 7f5fbf7fe700 1 -- 172.21.15.72:0/1769894253 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb800bd50 con 0x7f5fc01583f0 2023-08-31T19:04:42.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.671+0000 7f5fc6fff700 1 -- 172.21.15.72:0/1769894253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc01583f0 msgr2=0x7f5fc00c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:42.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.671+0000 7f5fc6fff700 1 --2- 172.21.15.72:0/1769894253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc01583f0 0x7f5fc00c52a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f5fb8009f20 tx=0x7f5fb8009840).stop 2023-08-31T19:04:42.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.671+0000 7f5fc6fff700 1 -- 172.21.15.72:0/1769894253 shutdown_connections 2023-08-31T19:04:42.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.671+0000 7f5fc6fff700 1 --2- 172.21.15.72:0/1769894253 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc01583f0 0x7f5fc00c52a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.671+0000 7f5fc6fff700 1 --2- 172.21.15.72:0/1769894253 >> v2:172.21.15.146:3300/0 conn(0x7f5fc00c6c30 0x7f5fc00bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.671+0000 7f5fc6fff700 1 -- 172.21.15.72:0/1769894253 >> 172.21.15.72:0/1769894253 conn(0x7f5fc00c7e70 msgr2=0x7f5fc00c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:42.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.671+0000 7f5fc6fff700 1 -- 172.21.15.72:0/1769894253 shutdown_connections 2023-08-31T19:04:42.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.671+0000 7f5fc6fff700 1 -- 172.21.15.72:0/1769894253 wait complete. 2023-08-31T19:04:42.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.672+0000 7f5fc6fff700 1 Processor -- start 2023-08-31T19:04:42.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.673+0000 7f5fc6fff700 1 -- start start 2023-08-31T19:04:42.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fc6fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc00c4740 0x7f5fc00a7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:42.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fc6fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00c6c30 0x7f5fc01578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:42.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fc6fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc01583f0 0x7f5fc00a6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:42.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fc6fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00aa830 con 0x7f5fc01583f0 2023-08-31T19:04:42.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fc6fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00aab10 con 0x7f5fc00c4740 2023-08-31T19:04:42.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fc6fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc00aadf0 con 0x7f5fc00c6c30 2023-08-31T19:04:42.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fc559c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc01583f0 0x7f5fc00a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:42.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fc559c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc01583f0 0x7f5fc00a6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42862/0 (socket says 172.21.15.72:42862) 2023-08-31T19:04:42.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fc4d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc00c4740 0x7f5fc00a7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:42.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fc559c700 1 -- 172.21.15.72:0/48075050 learned_addr learned my addr 172.21.15.72:0/48075050 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:42.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fbffff700 1 --2- 172.21.15.72:0/48075050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00c6c30 0x7f5fc01578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:42.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fc559c700 1 -- 172.21.15.72:0/48075050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00c6c30 msgr2=0x7f5fc01578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:42.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fc559c700 1 --2- 172.21.15.72:0/48075050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00c6c30 0x7f5fc01578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fc559c700 1 -- 172.21.15.72:0/48075050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc00c4740 msgr2=0x7f5fc00a7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:42.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fc559c700 1 --2- 172.21.15.72:0/48075050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc00c4740 0x7f5fc00a7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.674+0000 7f5fc559c700 1 -- 172.21.15.72:0/48075050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb8009ae0 con 0x7f5fc01583f0 2023-08-31T19:04:42.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.675+0000 7f5fc559c700 1 --2- 172.21.15.72:0/48075050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc01583f0 0x7f5fc00a6120 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f5fb8010000 tx=0x7f5fc0155720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:42.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.675+0000 7f5fbcff9700 1 -- 172.21.15.72:0/48075050 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb80092e0 con 0x7f5fc01583f0 2023-08-31T19:04:42.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.675+0000 7f5fbcff9700 1 -- 172.21.15.72:0/48075050 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb8013e30 con 0x7f5fc01583f0 2023-08-31T19:04:42.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.675+0000 7f5fc6fff700 1 -- 172.21.15.72:0/48075050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc00ab0d0 con 0x7f5fc01583f0 2023-08-31T19:04:42.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.675+0000 7f5fbcff9700 1 -- 172.21.15.72:0/48075050 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8007860 con 0x7f5fc01583f0 2023-08-31T19:04:42.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.675+0000 7f5fc6fff700 1 -- 172.21.15.72:0/48075050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc0157dd0 con 0x7f5fc01583f0 2023-08-31T19:04:42.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.676+0000 7f5fc6fff700 1 -- 172.21.15.72:0/48075050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc0155840 con 0x7f5fc01583f0 2023-08-31T19:04:42.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.677+0000 7f5fbcff9700 1 -- 172.21.15.72:0/48075050 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f5fb8003040 con 0x7f5fc01583f0 2023-08-31T19:04:42.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.678+0000 7f5fbcff9700 1 --2- 172.21.15.72:0/48075050 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5fa405ef30 0x7f5fa40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:42.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.678+0000 7f5fbcff9700 1 -- 172.21.15.72:0/48075050 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f5fb807bcc0 con 0x7f5fc01583f0 2023-08-31T19:04:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.678+0000 7f5fc4d9b700 1 --2- 172.21.15.72:0/48075050 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5fa405ef30 0x7f5fa40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.678+0000 7f5fc4d9b700 1 --2- 172.21.15.72:0/48075050 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5fa405ef30 0x7f5fa40613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5fb4009c30 tx=0x7f5fb4009060).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:42.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.682+0000 7f5fbcff9700 1 -- 172.21.15.72:0/48075050 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5fc0155840 con 0x7f5fc01583f0 2023-08-31T19:04:42.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.848+0000 7f5fc6fff700 1 -- 172.21.15.72:0/48075050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fc0155840 con 0x7f5fc01583f0 2023-08-31T19:04:42.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.849+0000 7f5fbcff9700 1 -- 172.21.15.72:0/48075050 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+17945 (secure 0 0 0) 0x7f5fc0155840 con 0x7f5fc01583f0 2023-08-31T19:04:42.848 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:42.848 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":109,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:04:39.996984+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:04:37.420883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-31T19:04:37.977694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:04:42.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.850+0000 7f5fc6fff700 1 -- 172.21.15.72:0/48075050 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5fa405ef30 msgr2=0x7f5fa40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:42.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.850+0000 7f5fc6fff700 1 --2- 172.21.15.72:0/48075050 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5fa405ef30 0x7f5fa40613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5fb4009c30 tx=0x7f5fb4009060).stop 2023-08-31T19:04:42.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.850+0000 7f5fc6fff700 1 -- 172.21.15.72:0/48075050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc01583f0 msgr2=0x7f5fc00a6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:42.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.850+0000 7f5fc6fff700 1 --2- 172.21.15.72:0/48075050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc01583f0 0x7f5fc00a6120 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f5fb8010000 tx=0x7f5fc0155720).stop 2023-08-31T19:04:42.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.851+0000 7f5fc6fff700 1 -- 172.21.15.72:0/48075050 shutdown_connections 2023-08-31T19:04:42.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.851+0000 7f5fc6fff700 1 --2- 172.21.15.72:0/48075050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fc01583f0 0x7f5fc00a6120 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.851+0000 7f5fc6fff700 1 --2- 172.21.15.72:0/48075050 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5fa405ef30 0x7f5fa40613f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.851+0000 7f5fc6fff700 1 --2- 172.21.15.72:0/48075050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc00c4740 0x7f5fc00a7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.851+0000 7f5fc6fff700 1 --2- 172.21.15.72:0/48075050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5fc00c6c30 0x7f5fc01578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.851+0000 7f5fc6fff700 1 -- 172.21.15.72:0/48075050 >> 172.21.15.72:0/48075050 conn(0x7f5fc00c7e70 msgr2=0x7f5fc0153820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:42.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.851+0000 7f5fc6fff700 1 -- 172.21.15.72:0/48075050 shutdown_connections 2023-08-31T19:04:42.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:42.851+0000 7f5fc6fff700 1 -- 172.21.15.72:0/48075050 wait complete. 2023-08-31T19:04:42.868 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T19:04:42.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:04:43.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.060+0000 7faf4a1ff700 1 Processor -- start 2023-08-31T19:04:43.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.060+0000 7faf4a1ff700 1 -- start start 2023-08-31T19:04:43.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.061+0000 7faf4a1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faf4415ce50 0x7faf4415f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.061+0000 7faf4a1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf440c6120 con 0x7faf44154060 2023-08-31T19:04:43.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.061+0000 7faf4a1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf440c5e10 con 0x7faf440cb9b0 2023-08-31T19:04:43.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.061+0000 7faf4a1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf440c1380 con 0x7faf4415ce50 2023-08-31T19:04:43.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.061+0000 7faf437fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faf44154060 0x7faf44157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33652/0 (socket says 172.21.15.72:33652) 2023-08-31T19:04:43.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.061+0000 7faf437fe700 1 -- 172.21.15.72:0/3742702091 learned_addr learned my addr 172.21.15.72:0/3742702091 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:43.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.062+0000 7faf43fff700 1 --2- 172.21.15.72:0/3742702091 >> v2:172.21.15.146:3300/0 conn(0x7faf4415ce50 0x7faf4415f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:43.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.062+0000 7faf427fc700 1 -- 172.21.15.72:0/3742702091 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804679217 0 0) 0x7faf440c6120 con 0x7faf44154060 2023-08-31T19:04:43.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.062+0000 7faf427fc700 1 -- 172.21.15.72:0/3742702091 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf2c0033f0 con 0x7faf44154060 2023-08-31T19:04:43.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.062+0000 7faf427fc700 1 -- 172.21.15.72:0/3742702091 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3013065093 0 0) 0x7faf2c0033f0 con 0x7faf44154060 2023-08-31T19:04:43.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.062+0000 7faf43fff700 1 -- 172.21.15.72:0/3742702091 >> v1:172.21.15.146:6789/0 conn(0x7faf440cb9b0 legacy=0x7faf441583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.062+0000 7faf43fff700 1 -- 172.21.15.72:0/3742702091 >> v1:172.21.15.72:6789/0 conn(0x7faf44154060 legacy=0x7faf44157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.062+0000 7faf43fff700 1 -- 172.21.15.72:0/3742702091 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf44158af0 con 0x7faf4415ce50 2023-08-31T19:04:43.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.062+0000 7faf43fff700 1 --2- 172.21.15.72:0/3742702091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf4415ce50 0x7faf4415f240 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7faf3c009e60 tx=0x7faf3c009780).ready entity=mon.1 client_cookie=643d14a9bb3c648f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:43.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.063+0000 7faf427fc700 1 -- 172.21.15.72:0/3742702091 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c00e070 con 0x7faf4415ce50 2023-08-31T19:04:43.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.063+0000 7faf427fc700 1 -- 172.21.15.72:0/3742702091 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c00b850 con 0x7faf4415ce50 2023-08-31T19:04:43.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.063+0000 7faf427fc700 1 -- 172.21.15.72:0/3742702091 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf340015f0 con 0x7faf4415ce50 2023-08-31T19:04:43.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.063+0000 7faf4a1ff700 1 -- 172.21.15.72:0/3742702091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf4415ce50 msgr2=0x7faf4415f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.063+0000 7faf4a1ff700 1 --2- 172.21.15.72:0/3742702091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf4415ce50 0x7faf4415f240 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7faf3c009e60 tx=0x7faf3c009780).stop 2023-08-31T19:04:43.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.063+0000 7faf4a1ff700 1 -- 172.21.15.72:0/3742702091 shutdown_connections 2023-08-31T19:04:43.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.063+0000 7faf4a1ff700 1 --2- 172.21.15.72:0/3742702091 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf4415ce50 0x7faf4415f240 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.063+0000 7faf4a1ff700 1 -- 172.21.15.72:0/3742702091 >> 172.21.15.72:0/3742702091 conn(0x7faf4405e870 msgr2=0x7faf440cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:43.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.063+0000 7faf4a1ff700 1 -- 172.21.15.72:0/3742702091 shutdown_connections 2023-08-31T19:04:43.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.063+0000 7faf4a1ff700 1 -- 172.21.15.72:0/3742702091 wait complete. 2023-08-31T19:04:43.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.065+0000 7faf4a1ff700 1 Processor -- start 2023-08-31T19:04:43.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.065+0000 7faf4a1ff700 1 -- start start 2023-08-31T19:04:43.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.066+0000 7faf4a1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf440cb9b0 0x7faf44143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.066+0000 7faf4a1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf44154060 0x7faf440c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.066+0000 7faf4a1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf4415ce50 0x7faf440c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.066+0000 7faf4a1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf44167db0 con 0x7faf440cb9b0 2023-08-31T19:04:43.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.066+0000 7faf4a1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf440c8590 con 0x7faf44154060 2023-08-31T19:04:43.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.066+0000 7faf4a1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf44167480 con 0x7faf4415ce50 2023-08-31T19:04:43.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.066+0000 7faf437fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf440cb9b0 0x7faf44143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:43.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.066+0000 7faf437fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf440cb9b0 0x7faf44143730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35042/0 (socket says 172.21.15.72:35042) 2023-08-31T19:04:43.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.066+0000 7faf437fe700 1 -- 172.21.15.72:0/3475443642 learned_addr learned my addr 172.21.15.72:0/3475443642 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:43.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.066+0000 7faf437fe700 1 -- 172.21.15.72:0/3475443642 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf4415ce50 msgr2=0x7faf440c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.066+0000 7faf437fe700 1 --2- 172.21.15.72:0/3475443642 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf4415ce50 0x7faf440c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:43.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.066+0000 7faf437fe700 1 -- 172.21.15.72:0/3475443642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf44154060 msgr2=0x7faf440c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.066+0000 7faf437fe700 1 --2- 172.21.15.72:0/3475443642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf44154060 0x7faf440c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:43.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.067+0000 7faf437fe700 1 -- 172.21.15.72:0/3475443642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c009a20 con 0x7faf440cb9b0 2023-08-31T19:04:43.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.067+0000 7faf437fe700 1 --2- 172.21.15.72:0/3475443642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf440cb9b0 0x7faf44143730 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7faf3400c810 tx=0x7faf34002b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:43.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.067+0000 7faf2b7fe700 1 -- 172.21.15.72:0/3475443642 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf34001cd0 con 0x7faf440cb9b0 2023-08-31T19:04:43.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.067+0000 7faf2b7fe700 1 -- 172.21.15.72:0/3475443642 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf34001e50 con 0x7faf440cb9b0 2023-08-31T19:04:43.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.067+0000 7faf4a1ff700 1 -- 172.21.15.72:0/3475443642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf44167760 con 0x7faf440cb9b0 2023-08-31T19:04:43.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.067+0000 7faf2b7fe700 1 -- 172.21.15.72:0/3475443642 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf34007320 con 0x7faf440cb9b0 2023-08-31T19:04:43.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.067+0000 7faf4a1ff700 1 -- 172.21.15.72:0/3475443642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4414d190 con 0x7faf440cb9b0 2023-08-31T19:04:43.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.068+0000 7faf4a1ff700 1 -- 172.21.15.72:0/3475443642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4406c6b0 con 0x7faf440cb9b0 2023-08-31T19:04:43.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.069+0000 7faf2b7fe700 1 -- 172.21.15.72:0/3475443642 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7faf34005670 con 0x7faf440cb9b0 2023-08-31T19:04:43.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.070+0000 7faf2b7fe700 1 --2- 172.21.15.72:0/3475443642 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf3005ef30 0x7faf300613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.070+0000 7faf2b7fe700 1 -- 172.21.15.72:0/3475443642 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7faf34079df0 con 0x7faf440cb9b0 2023-08-31T19:04:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.070+0000 7faf42ffd700 1 --2- 172.21.15.72:0/3475443642 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf3005ef30 0x7faf300613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.071+0000 7faf42ffd700 1 --2- 172.21.15.72:0/3475443642 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf3005ef30 0x7faf300613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7faf44153e40 tx=0x7faf380079a0).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.074+0000 7faf2b7fe700 1 -- 172.21.15.72:0/3475443642 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faf3404adc0 con 0x7faf440cb9b0 2023-08-31T19:04:43.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.240+0000 7faf4a1ff700 1 -- 172.21.15.72:0/3475443642 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf44167ef0 con 0x7faf3005ef30 2023-08-31T19:04:43.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.253+0000 7faf2b7fe700 1 -- 172.21.15.72:0/3475443642 <== mgr.6948 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+349416 (secure 0 0 0) 0x7faf38001220 con 0x7faf3005ef30 2023-08-31T19:04:43.256 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.257+0000 7faf4a1ff700 1 -- 172.21.15.72:0/3475443642 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf3005ef30 msgr2=0x7faf300613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.257+0000 7faf4a1ff700 1 --2- 172.21.15.72:0/3475443642 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf3005ef30 0x7faf300613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7faf44153e40 tx=0x7faf380079a0).stop 2023-08-31T19:04:43.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.257+0000 7faf4a1ff700 1 -- 172.21.15.72:0/3475443642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf440cb9b0 msgr2=0x7faf44143730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.257+0000 7faf4a1ff700 1 --2- 172.21.15.72:0/3475443642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf440cb9b0 0x7faf44143730 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7faf3400c810 tx=0x7faf34002b60).stop 2023-08-31T19:04:43.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.257+0000 7faf4a1ff700 1 -- 172.21.15.72:0/3475443642 shutdown_connections 2023-08-31T19:04:43.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.257+0000 7faf4a1ff700 1 --2- 172.21.15.72:0/3475443642 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf4415ce50 0x7faf440c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:43.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.257+0000 7faf4a1ff700 1 --2- 172.21.15.72:0/3475443642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf440cb9b0 0x7faf44143730 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:43.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.257+0000 7faf4a1ff700 1 --2- 172.21.15.72:0/3475443642 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faf3005ef30 0x7faf300613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:43.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.257+0000 7faf4a1ff700 1 --2- 172.21.15.72:0/3475443642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf44154060 0x7faf440c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:43.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.257+0000 7faf4a1ff700 1 -- 172.21.15.72:0/3475443642 >> 172.21.15.72:0/3475443642 conn(0x7faf4405e870 msgr2=0x7faf440bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:43.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.258+0000 7faf4a1ff700 1 -- 172.21.15.72:0/3475443642 shutdown_connections 2023-08-31T19:04:43.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.258+0000 7faf4a1ff700 1 -- 172.21.15.72:0/3475443642 wait complete. 2023-08-31T19:04:43.262 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:04:43.274 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-31T19:04:41.247464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2419580,"kb_used_data":10044,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752555140,"statfs":{"total":773094113280,"available":770616463360,"internally_reserved":0,"allocated":10285056,"data_stored":5366260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5546,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.996826"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":93,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-31T19:04:34.392262+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:04:34.392262+0000","last_peered":"2023-08-31T19:04:34.392262+0000","last_clean":"2023-08-31T19:04:34.392262+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:04:34.392262+0000","last_undegraded":"2023-08-31T19:04:34.392262+0000","last_fullsized":"2023-08-31T19:04:34.392262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":86,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-31T19:04:34.188526+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:04:34.188526+0000","last_peered":"2023-08-31T19:04:34.188526+0000","last_clean":"2023-08-31T19:04:34.188526+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:04:34.188526+0000","last_undegraded":"2023-08-31T19:04:34.188526+0000","last_fullsized":"2023-08-31T19:04:34.188526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":87,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-31T19:04:33.836793+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:04:33.836793+0000","last_peered":"2023-08-31T19:04:33.836793+0000","last_clean":"2023-08-31T19:04:33.836793+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:04:33.836793+0000","last_undegraded":"2023-08-31T19:04:33.836793+0000","last_fullsized":"2023-08-31T19:04:33.836793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":86,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-31T19:04:34.188529+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:04:34.188529+0000","last_peered":"2023-08-31T19:04:34.188529+0000","last_clean":"2023-08-31T19:04:34.188529+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:04:34.188529+0000","last_undegraded":"2023-08-31T19:04:34.188529+0000","last_fullsized":"2023-08-31T19:04:34.188529+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":87,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-31T19:04:34.040421+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:04:34.040421+0000","last_peered":"2023-08-31T19:04:34.040421+0000","last_clean":"2023-08-31T19:04:34.040421+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:04:34.040421+0000","last_undegraded":"2023-08-31T19:04:34.040421+0000","last_fullsized":"2023-08-31T19:04:34.040421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-31T19:04:34.040448+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:04:34.040448+0000","last_peered":"2023-08-31T19:04:34.040448+0000","last_clean":"2023-08-31T19:04:34.040448+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:04:34.040448+0000","last_undegraded":"2023-08-31T19:04:34.040448+0000","last_fullsized":"2023-08-31T19:04:34.040448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":86,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-31T19:04:34.040447+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:04:34.040447+0000","last_peered":"2023-08-31T19:04:34.040447+0000","last_clean":"2023-08-31T19:04:34.040447+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:04:34.040447+0000","last_undegraded":"2023-08-31T19:04:34.040447+0000","last_fullsized":"2023-08-31T19:04:34.040447+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":93,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-31T19:04:34.392261+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:04:34.392261+0000","last_peered":"2023-08-31T19:04:34.392261+0000","last_clean":"2023-08-31T19:04:34.392261+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:04:34.392261+0000","last_undegraded":"2023-08-31T19:04:34.392261+0000","last_fullsized":"2023-08-31T19:04:34.392261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:38.524800+0000","last_change":"2023-08-31T19:04:38.524800+0000","last_active":"2023-08-31T19:04:38.524800+0000","last_peered":"2023-08-31T19:04:38.524800+0000","last_clean":"2023-08-31T19:04:38.524800+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:38.524800+0000","last_undegraded":"2023-08-31T19:04:38.524800+0000","last_fullsized":"2023-08-31T19:04:38.524800+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:04:37.518762+0000","last_change":"2023-08-31T19:04:37.518762+0000","last_active":"2023-08-31T19:04:37.518762+0000","last_peered":"2023-08-31T19:04:37.518762+0000","last_clean":"2023-08-31T19:04:37.518762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:04:37.518762+0000","last_undegraded":"2023-08-31T19:04:37.518762+0000","last_fullsized":"2023-08-31T19:04:37.518762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-08-31T19:04:33.832993+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:04:33.832993+0000","last_peered":"2023-08-31T19:04:33.832993+0000","last_clean":"2023-08-31T19:04:33.832993+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:04:33.832993+0000","last_undegraded":"2023-08-31T19:04:33.832993+0000","last_fullsized":"2023-08-31T19:04:33.832993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575049,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":673226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:04:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.47799999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.75900000000000001},"min":{"1min":0.439,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.84599999999999997}]},{"osd":1,"last update":"Thu Aug 31 19:04:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67500000000000004,"15min":0.70399999999999996},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40000000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67100000000000004,"15min":0.68400000000000005},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.36199999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Aug 31 19:04:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.70699999999999996},"min":{"1min":0.442,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72799999999999998,"15min":0.73099999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.41199999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.054},"last":0.87}]},{"osd":3,"last update":"Thu Aug 31 19:04:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70099999999999996,"15min":0.71999999999999997},"min":{"1min":0.505,"5min":0.432,"15min":0.432},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.54900000000000004,"5min":0.52200000000000002,"15min":0.51000000000000001},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.82399999999999995}]},{"osd":4,"last update":"Thu Aug 31 19:04:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80400000000000005,"5min":0.83799999999999997,"15min":0.97899999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.56899999999999995,"5min":0.432,"15min":0.432},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.004},"last":0.624}]},{"osd":5,"last update":"Thu Aug 31 19:04:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65900000000000003,"15min":0.66800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90500000000000003,"5min":1.139,"15min":1.139},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.495,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":1.048},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:04:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67200000000000004,"15min":0.67700000000000005},"min":{"1min":0.55400000000000005,"5min":0.46300000000000002,"15min":0.45600000000000002},"max":{"1min":0.85199999999999998,"5min":0.93100000000000005,"15min":1.0740000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69599999999999995,"15min":0.69699999999999995},"min":{"1min":0.52000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.024,"5min":1.038,"15min":1.071},"last":0.67100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575048,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302440,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":1277952,"data_stored":666710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67400000000000004,"15min":0.70699999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86199999999999999,"5min":0.92000000000000004,"15min":1.0189999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67400000000000004,"15min":0.70299999999999996},"min":{"1min":0.434,"5min":0.371,"15min":0.371},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.78700000000000003}]},{"osd":1,"last update":"Thu Aug 31 19:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.66100000000000003,"15min":0.70099999999999996},"min":{"1min":0.47999999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71099999999999997,"15min":0.72299999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.85999999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71099999999999997,"15min":0.73299999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.129},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.498,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95299999999999996,"5min":0.98899999999999999,"15min":1.3260000000000001},"last":0.91300000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.018},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72799999999999998,"15min":0.749},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.49399999999999999},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.622,"15min":0.61699999999999999},"min":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.40999999999999998},"max":{"1min":0.86699999999999999,"5min":0.94299999999999995,"15min":0.96599999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65100000000000002,"15min":0.63500000000000001},"min":{"1min":0.432,"5min":0.39000000000000001,"15min":0.371},"max":{"1min":0.81599999999999995,"5min":1.0880000000000001,"15min":1.091},"last":0.62}]},{"osd":5,"last update":"Thu Aug 31 19:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67200000000000004,"15min":0.66500000000000004},"min":{"1min":0.45900000000000002,"5min":0.44400000000000001,"15min":0.39800000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70099999999999996,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0349999999999999,"5min":1.0669999999999999,"15min":1.0700000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.505,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94099999999999995,"5min":1.012,"15min":1.0620000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.90100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575049,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":673226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:04:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42599999999999999,"15min":0.44500000000000001},"min":{"1min":0.311,"5min":0.27300000000000002,"15min":0.26100000000000001},"max":{"1min":0.503,"5min":0.70999999999999996,"15min":0.81000000000000005},"last":0.498},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46400000000000002,"15min":0.47299999999999998},"min":{"1min":0.36299999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56999999999999995,"5min":0.68000000000000005,"15min":0.752},"last":0.376}]},{"osd":2,"last update":"Thu Aug 31 19:04:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.497,"15min":0.51000000000000001},"min":{"1min":0.36699999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59399999999999997,"5min":0.78000000000000003,"15min":0.82699999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55800000000000005,"15min":0.57599999999999996},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.65500000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:04:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.39100000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77400000000000002,"5min":0.79000000000000004,"15min":0.82199999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.48799999999999999,"15min":0.50900000000000001},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.32500000000000001},"max":{"1min":0.60399999999999998,"5min":0.67300000000000004,"15min":0.72299999999999998},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:04:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.748,"15min":0.78000000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.997,"5min":1.1739999999999999,"15min":1.2110000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.79000000000000004,"15min":0.81200000000000006},"min":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.93600000000000005,"5min":1.1379999999999999,"15min":1.3},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:04:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.76700000000000002},"min":{"1min":0.55200000000000005,"5min":0.497,"15min":0.47299999999999998},"max":{"1min":0.97199999999999998,"5min":1.0309999999999999,"15min":1.4119999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.75700000000000001,"15min":0.77100000000000002},"min":{"1min":0.55400000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85899999999999999,"5min":1.1040000000000001,"15min":1.2310000000000001},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:04:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.76300000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.84299999999999997,"5min":1.1080000000000001,"15min":1.1990000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76900000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.51500000000000001,"15min":0.501},"max":{"1min":0.95399999999999996,"5min":1.167,"15min":1.2629999999999999},"last":0.749}]},{"osd":7,"last update":"Thu Aug 31 19:04:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.58999999999999997,"5min":0.54600000000000004,"15min":0.51900000000000002},"max":{"1min":0.98499999999999999,"5min":1.1120000000000001,"15min":1.113},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.76200000000000001,"15min":0.79000000000000004},"min":{"1min":0.54000000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.878,"5min":1.1000000000000001,"15min":1.3320000000000001},"last":0.86499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575048,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":673226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:04:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.442,"15min":0.442},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.78400000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.48299999999999998,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30399999999999999},"max":{"1min":0.65300000000000002,"5min":0.876,"15min":0.876},"last":0.63700000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:04:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.499,"15min":0.505},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.74299999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.51500000000000001,"15min":0.52800000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.58799999999999997,"5min":1.018,"15min":1.018},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:04:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.63500000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.36599999999999999},"max":{"1min":0.76400000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:04:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.81299999999999994,"15min":0.82099999999999995},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0489999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79900000000000004,"15min":0.81699999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.95599999999999996,"5min":1.1890000000000001,"15min":1.276},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:04:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.503,"5min":0.5,"15min":0.5},"max":{"1min":0.97299999999999998,"5min":1.155,"15min":1.155},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.84399999999999997,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:04:16 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.80500000000000005,"15min":0.80800000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.101,"5min":1.1060000000000001,"15min":1.3280000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.53500000000000003},"max":{"1min":1.032,"5min":1.196,"15min":1.2350000000000001},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Aug 31 19:04:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.81599999999999995,"15min":0.82199999999999995},"min":{"1min":0.58599999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82599999999999996,"15min":0.83599999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0649999999999999,"5min":1.548,"15min":1.548},"last":0.73399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575048,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302440,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":1277952,"data_stored":666710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.27800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53200000000000003,"5min":0.77600000000000002,"15min":0.90200000000000002},"last":0.5},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.47099999999999997,"15min":0.48799999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.55900000000000005,"5min":0.70099999999999996,"15min":1.5900000000000001},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.497,"15min":0.503},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63500000000000001,"5min":0.72199999999999998,"15min":0.96599999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.63100000000000001,"5min":0.748,"15min":1.288},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.49399999999999999,"15min":0.50700000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":1.022},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.53900000000000003,"15min":0.55700000000000005},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.58899999999999997,"5min":0.71199999999999997,"15min":0.97399999999999998},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Aug 31 19:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.755,"15min":0.78500000000000003},"min":{"1min":0.54300000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.93400000000000005,"5min":1.173,"15min":1.208},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.75900000000000001,"15min":0.80000000000000004},"min":{"1min":0.59299999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91300000000000003,"5min":1.155,"15min":1.464},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.50600000000000001,"5min":0.499,"15min":0.499},"max":{"1min":0.96699999999999997,"5min":1.2,"15min":1.361},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.754,"15min":0.79300000000000004},"min":{"1min":0.55900000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.03,"5min":1.1020000000000001,"15min":1.3},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78200000000000003,"15min":0.81200000000000006},"min":{"1min":0.58599999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.95499999999999996,"5min":1.238,"15min":1.51},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.80900000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.97499999999999998,"5min":1.1579999999999999,"15min":1.4359999999999999},"last":0.747}]},{"osd":7,"last update":"Thu Aug 31 19:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77900000000000003,"15min":0.81399999999999995},"min":{"1min":0.55700000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.91400000000000003,"5min":1.3100000000000001,"15min":1.55},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.82399999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.018,"5min":1.1160000000000001,"15min":1.387},"last":0.86299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575048,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":673226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:04:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.57999999999999996,"15min":0.48199999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.60199999999999998,"5min":14.099,"15min":14.099},"last":0.443},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.71799999999999997,"15min":0.56000000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.622,"5min":24.879999999999999,"15min":24.879999999999999},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:04:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46500000000000002,"15min":0.45500000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.76200000000000001,"5min":0.79600000000000004,"15min":0.90700000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.625,"15min":0.54400000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.66500000000000004,"5min":14.143000000000001,"15min":14.143000000000001},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:04:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.56799999999999995,"15min":0.58299999999999996},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.38100000000000001},"max":{"1min":0.69399999999999995,"5min":0.94999999999999996,"15min":1.407},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.70699999999999996,"15min":0.65200000000000002},"min":{"1min":0.437,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71299999999999997,"5min":12.464,"15min":12.464},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:04:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.93700000000000006,"15min":0.81699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.018,"5min":21.475999999999999,"15min":21.475999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.47699999999999998},"max":{"1min":1.0509999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.05}]},{"osd":5,"last update":"Thu Aug 31 19:04:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73499999999999999,"15min":0.75900000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48199999999999998},"max":{"1min":1.109,"5min":1.139,"15min":1.3220000000000001},"last":1.2470000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.85399999999999998,"15min":0.80500000000000005},"min":{"1min":0.55700000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.083,"5min":12.509,"15min":12.509},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:04:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.876,"15min":0.81699999999999995},"min":{"1min":0.54700000000000004,"5min":0.53400000000000003,"15min":0.52000000000000002},"max":{"1min":1.0329999999999999,"5min":12.426,"15min":12.426},"last":0.995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":1.0089999999999999,"15min":0.85799999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.50600000000000001},"max":{"1min":0.95299999999999996,"5min":24.920000000000002,"15min":24.920000000000002},"last":0.93200000000000005}]},{"osd":7,"last update":"Thu Aug 31 19:04:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.995,"15min":0.86099999999999999},"min":{"1min":0.57299999999999995,"5min":0.51300000000000001,"15min":0.495},"max":{"1min":1.0640000000000001,"5min":21.521000000000001,"15min":21.521000000000001},"last":1.01},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1499999999999999,"5min":1.232,"15min":1.232},"last":1.2070000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302440,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":1277952,"data_stored":666710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.67400000000000004,"15min":0.69499999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":0.98499999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.67000000000000004,"15min":0.69899999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80800000000000005,"5min":0.92900000000000005,"15min":0.93400000000000005},"last":0.626}]},{"osd":1,"last update":"Thu Aug 31 19:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69499999999999995,"15min":0.71299999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.006},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.68999999999999995,"15min":0.71399999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83999999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Aug 31 19:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.006,"5min":1.042,"15min":1.044},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85999999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69199999999999995,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83899999999999997,"5min":1.01,"15min":1.01},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.52900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.95799999999999996,"5min":1.012,"15min":1.081},"last":0.88700000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.39800000000000002},"max":{"1min":1.0149999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.624},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86199999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.871}]},{"osd":6,"last update":"Thu Aug 31 19:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.46000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0069999999999999,"5min":1.163,"15min":1.163},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.441},"max":{"1min":0.95599999999999996,"5min":1.133,"15min":1.133},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.50600000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.88600000000000001,"5min":1.147,"15min":1.147},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.73299999999999998,"15min":0.72399999999999998},"min":{"1min":0.48899999999999999,"5min":0.48199999999999998,"15min":0.45200000000000001},"max":{"1min":1.0489999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":1.022}]}]},{"osd":5,"up_from":13,"seq":55834575048,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":673226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:04:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.40899999999999997},"max":{"1min":0.83799999999999997,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80200000000000005,"5min":3.548,"15min":3.548},"last":0.63}]},{"osd":1,"last update":"Thu Aug 31 19:04:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.84899999999999998,"15min":0.76700000000000002},"min":{"1min":0.46100000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78000000000000003,"5min":16.744,"15min":16.744},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86599999999999999,"5min":3.6299999999999999,"15min":3.6299999999999999},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Aug 31 19:04:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98899999999999999,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.745,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.45200000000000001},"max":{"1min":0.85399999999999998,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:04:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88,"5min":1.327,"15min":2.0070000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.48999999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.75600000000000001,"5min":2.823,"15min":2.823},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Aug 31 19:04:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.68700000000000006,"15min":0.64900000000000002},"min":{"1min":0.45300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83299999999999996,"5min":7.3739999999999997,"15min":7.3739999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66500000000000004,"15min":0.65400000000000003},"min":{"1min":0.499,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":0.94999999999999996,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":0.52100000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:04:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.48799999999999999,"5min":0.45300000000000001,"15min":0.39100000000000001},"max":{"1min":0.91100000000000003,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.76600000000000001,"15min":0.72299999999999998},"min":{"1min":0.58099999999999996,"5min":0.443,"15min":0.441},"max":{"1min":0.97199999999999998,"5min":7.4139999999999997,"15min":7.4139999999999997},"last":0.434}]},{"osd":7,"last update":"Thu Aug 31 19:04:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.46100000000000002},"max":{"1min":0.97199999999999998,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.54500000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91700000000000004,"5min":2.786,"15min":2.786},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:04:43.282 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:04:43.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.503+0000 7f109c9ff700 1 Processor -- start 2023-08-31T19:04:43.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.504+0000 7f109c9ff700 1 -- start start 2023-08-31T19:04:43.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.505+0000 7f109c9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1098154060 0x7f1098157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.505+0000 7f109c9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10980cb9b0 0x7f10981581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.505+0000 7f109c9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1098158b40 con 0x7f10981586b0 2023-08-31T19:04:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.505+0000 7f109c9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10980c1380 con 0x7f10980cb9b0 2023-08-31T19:04:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.505+0000 7f109c9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10980c6120 con 0x7f1098154060 2023-08-31T19:04:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.505+0000 7f1095d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10980cb9b0 0x7f10981581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.505+0000 7f1095d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10980cb9b0 0x7f10981581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35044/0 (socket says 172.21.15.72:35044) 2023-08-31T19:04:43.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.505+0000 7f1095d9b700 1 -- 172.21.15.72:0/2270828970 learned_addr learned my addr 172.21.15.72:0/2270828970 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:43.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.506+0000 7f1095d9b700 1 -- 172.21.15.72:0/2270828970 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1098154060 msgr2=0x7f1098157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:43.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.506+0000 7f1095d9b700 1 --2- 172.21.15.72:0/2270828970 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1098154060 0x7f1098157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.506+0000 7f1095d9b700 1 -- 172.21.15.72:0/2270828970 >> v1:172.21.15.72:6789/0 conn(0x7f10981586b0 legacy=0x7f10980c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.506+0000 7f1095d9b700 1 -- 172.21.15.72:0/2270828970 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10980c5e10 con 0x7f10980cb9b0 2023-08-31T19:04:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.506+0000 7f109559a700 1 -- 172.21.15.72:0/2270828970 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404804814 0 0) 0x7f1090001490 con 0x7f10981586b0 2023-08-31T19:04:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.506+0000 7f1095d9b700 1 --2- 172.21.15.72:0/2270828970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10980cb9b0 0x7f10981581c0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f108c006fd0 tx=0x7f108c0090f0).ready entity=mon.0 client_cookie=167ba6b8c60f3531 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.506+0000 7f109559a700 1 -- 172.21.15.72:0/2270828970 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c00b600 con 0x7f10980cb9b0 2023-08-31T19:04:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.506+0000 7f109559a700 1 -- 172.21.15.72:0/2270828970 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c00b760 con 0x7f10980cb9b0 2023-08-31T19:04:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.506+0000 7f109559a700 1 -- 172.21.15.72:0/2270828970 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c00bae0 con 0x7f10980cb9b0 2023-08-31T19:04:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.506+0000 7f109c9ff700 1 -- 172.21.15.72:0/2270828970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10980cb9b0 msgr2=0x7f10981581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.507+0000 7f109c9ff700 1 --2- 172.21.15.72:0/2270828970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10980cb9b0 0x7f10981581c0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f108c006fd0 tx=0x7f108c0090f0).stop 2023-08-31T19:04:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.507+0000 7f109c9ff700 1 -- 172.21.15.72:0/2270828970 shutdown_connections 2023-08-31T19:04:43.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.507+0000 7f109c9ff700 1 --2- 172.21.15.72:0/2270828970 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1098154060 0x7f1098157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:43.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.507+0000 7f109c9ff700 1 --2- 172.21.15.72:0/2270828970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10980cb9b0 0x7f10981581c0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:43.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.507+0000 7f109c9ff700 1 -- 172.21.15.72:0/2270828970 >> 172.21.15.72:0/2270828970 conn(0x7f109805e870 msgr2=0x7f10980cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:43.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.507+0000 7f109c9ff700 1 -- 172.21.15.72:0/2270828970 shutdown_connections 2023-08-31T19:04:43.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.507+0000 7f109c9ff700 1 -- 172.21.15.72:0/2270828970 wait complete. 2023-08-31T19:04:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.508+0000 7f109c9ff700 1 Processor -- start 2023-08-31T19:04:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.508+0000 7f109c9ff700 1 -- start start 2023-08-31T19:04:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.509+0000 7f109c9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10980cb9b0 0x7f10980c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.509+0000 7f109c9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1098154060 0x7f1098150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.509+0000 7f109c9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10981586b0 0x7f1098157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.509+0000 7f109c9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10980c2ae0 con 0x7f10981586b0 2023-08-31T19:04:43.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.509+0000 7f109c9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10980c1ed0 con 0x7f10980cb9b0 2023-08-31T19:04:43.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.509+0000 7f109c9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10980c21b0 con 0x7f1098154060 2023-08-31T19:04:43.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.510+0000 7f1096d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10981586b0 0x7f1098157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:43.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.510+0000 7f1096d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10981586b0 0x7f1098157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35046/0 (socket says 172.21.15.72:35046) 2023-08-31T19:04:43.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.510+0000 7f1096d9d700 1 -- 172.21.15.72:0/509873155 learned_addr learned my addr 172.21.15.72:0/509873155 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:43.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.510+0000 7f1095d9b700 1 --2- 172.21.15.72:0/509873155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1098154060 0x7f1098150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:43.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.510+0000 7f109659c700 1 --2- 172.21.15.72:0/509873155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10980cb9b0 0x7f10980c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:43.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.510+0000 7f1096d9d700 1 -- 172.21.15.72:0/509873155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1098154060 msgr2=0x7f1098150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.510+0000 7f1096d9d700 1 --2- 172.21.15.72:0/509873155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1098154060 0x7f1098150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.510+0000 7f1096d9d700 1 -- 172.21.15.72:0/509873155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10980cb9b0 msgr2=0x7f10980c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.510+0000 7f1096d9d700 1 --2- 172.21.15.72:0/509873155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10980cb9b0 0x7f10980c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.510+0000 7f1096d9d700 1 -- 172.21.15.72:0/509873155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c009370 con 0x7f10981586b0 2023-08-31T19:04:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.510+0000 7f1096d9d700 1 --2- 172.21.15.72:0/509873155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10981586b0 0x7f1098157480 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f109000c810 tx=0x7f1090001500).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:43.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.510+0000 7f10867fc700 1 -- 172.21.15.72:0/509873155 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109000e4a0 con 0x7f10981586b0 2023-08-31T19:04:43.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.510+0000 7f10867fc700 1 -- 172.21.15.72:0/509873155 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109000e600 con 0x7f10981586b0 2023-08-31T19:04:43.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.510+0000 7f10867fc700 1 -- 172.21.15.72:0/509873155 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109000e9a0 con 0x7f10981586b0 2023-08-31T19:04:43.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.511+0000 7f109c9ff700 1 -- 172.21.15.72:0/509873155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10980c2490 con 0x7f10981586b0 2023-08-31T19:04:43.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.511+0000 7f109c9ff700 1 -- 172.21.15.72:0/509873155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1098157970 con 0x7f10981586b0 2023-08-31T19:04:43.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.512+0000 7f109c9ff700 1 -- 172.21.15.72:0/509873155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10980c2c50 con 0x7f10981586b0 2023-08-31T19:04:43.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.512+0000 7f10867fc700 1 -- 172.21.15.72:0/509873155 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f1090012400 con 0x7f10981586b0 2023-08-31T19:04:43.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.514+0000 7f10867fc700 1 --2- 172.21.15.72:0/509873155 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f107805ef30 0x7f10780613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.514+0000 7f10867fc700 1 -- 172.21.15.72:0/509873155 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f10900796e0 con 0x7f10981586b0 2023-08-31T19:04:43.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.514+0000 7f109659c700 1 --2- 172.21.15.72:0/509873155 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f107805ef30 0x7f10780613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:43.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.514+0000 7f109659c700 1 --2- 172.21.15.72:0/509873155 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f107805ef30 0x7f10780613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1088009a50 tx=0x7f1088009060).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:43.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.518+0000 7f10867fc700 1 -- 172.21.15.72:0/509873155 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f10900488f0 con 0x7f10981586b0 2023-08-31T19:04:43.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.683+0000 7f109c9ff700 1 -- 172.21.15.72:0/509873155 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1098158b40 con 0x7f107805ef30 2023-08-31T19:04:43.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.693+0000 7f10867fc700 1 -- 172.21.15.72:0/509873155 <== mgr.6948 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361269 (secure 0 0 0) 0x7f1098158b40 con 0x7f107805ef30 2023-08-31T19:04:43.698 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:43.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.698+0000 7f109c9ff700 1 -- 172.21.15.72:0/509873155 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f107805ef30 msgr2=0x7f10780613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.698+0000 7f109c9ff700 1 --2- 172.21.15.72:0/509873155 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f107805ef30 0x7f10780613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f1088009a50 tx=0x7f1088009060).stop 2023-08-31T19:04:43.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.698+0000 7f109c9ff700 1 -- 172.21.15.72:0/509873155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10981586b0 msgr2=0x7f1098157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.698+0000 7f109c9ff700 1 --2- 172.21.15.72:0/509873155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10981586b0 0x7f1098157480 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f109000c810 tx=0x7f1090001500).stop 2023-08-31T19:04:43.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.698+0000 7f109c9ff700 1 -- 172.21.15.72:0/509873155 shutdown_connections 2023-08-31T19:04:43.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.698+0000 7f109c9ff700 1 --2- 172.21.15.72:0/509873155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10981586b0 0x7f1098157480 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:43.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.698+0000 7f109c9ff700 1 --2- 172.21.15.72:0/509873155 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f107805ef30 0x7f10780613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:43.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.698+0000 7f109c9ff700 1 --2- 172.21.15.72:0/509873155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10980cb9b0 0x7f10980c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:43.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.698+0000 7f109c9ff700 1 --2- 172.21.15.72:0/509873155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1098154060 0x7f1098150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:43.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.698+0000 7f109c9ff700 1 -- 172.21.15.72:0/509873155 >> 172.21.15.72:0/509873155 conn(0x7f109805e870 msgr2=0x7f1098151160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:43.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.698+0000 7f109c9ff700 1 -- 172.21.15.72:0/509873155 shutdown_connections 2023-08-31T19:04:43.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.698+0000 7f109c9ff700 1 -- 172.21.15.72:0/509873155 wait complete. 2023-08-31T19:04:43.703 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:04:43.716 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-31T19:04:43.251999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":233,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2420040,"kb_used_data":10504,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752554680,"statfs":{"total":773094113280,"available":770615992320,"internally_reserved":0,"allocated":10756096,"data_stored":5609276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5546,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.996826"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.026691+0000","last_change":"2023-08-31T19:04:39.020702+0000","last_active":"2023-08-31T19:04:39.026691+0000","last_peered":"2023-08-31T19:04:39.026691+0000","last_clean":"2023-08-31T19:04:39.026691+0000","last_became_active":"2023-08-31T19:04:39.020437+0000","last_became_peered":"2023-08-31T19:04:39.020437+0000","last_unstale":"2023-08-31T19:04:39.026691+0000","last_undegraded":"2023-08-31T19:04:39.026691+0000","last_fullsized":"2023-08-31T19:04:39.026691+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"108'3","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.026150+0000","last_change":"2023-08-31T19:04:38.553252+0000","last_active":"2023-08-31T19:04:39.026150+0000","last_peered":"2023-08-31T19:04:39.026150+0000","last_clean":"2023-08-31T19:04:39.026150+0000","last_became_active":"2023-08-31T19:04:38.552758+0000","last_became_peered":"2023-08-31T19:04:38.552758+0000","last_unstale":"2023-08-31T19:04:39.026150+0000","last_undegraded":"2023-08-31T19:04:39.026150+0000","last_fullsized":"2023-08-31T19:04:39.026150+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.031114+0000","last_change":"2023-08-31T19:04:39.027095+0000","last_active":"2023-08-31T19:04:39.031114+0000","last_peered":"2023-08-31T19:04:39.031114+0000","last_clean":"2023-08-31T19:04:39.031114+0000","last_became_active":"2023-08-31T19:04:39.026744+0000","last_became_peered":"2023-08-31T19:04:39.026744+0000","last_unstale":"2023-08-31T19:04:39.031114+0000","last_undegraded":"2023-08-31T19:04:39.031114+0000","last_fullsized":"2023-08-31T19:04:39.031114+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.006780+0000","last_change":"2023-08-31T19:04:38.550889+0000","last_active":"2023-08-31T19:04:39.006780+0000","last_peered":"2023-08-31T19:04:39.006780+0000","last_clean":"2023-08-31T19:04:39.006780+0000","last_became_active":"2023-08-31T19:04:38.550591+0000","last_became_peered":"2023-08-31T19:04:38.550591+0000","last_unstale":"2023-08-31T19:04:39.006780+0000","last_undegraded":"2023-08-31T19:04:39.006780+0000","last_fullsized":"2023-08-31T19:04:39.006780+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.024363+0000","last_change":"2023-08-31T19:04:39.017397+0000","last_active":"2023-08-31T19:04:39.024363+0000","last_peered":"2023-08-31T19:04:39.024363+0000","last_clean":"2023-08-31T19:04:39.024363+0000","last_became_active":"2023-08-31T19:04:39.016854+0000","last_became_peered":"2023-08-31T19:04:39.016854+0000","last_unstale":"2023-08-31T19:04:39.024363+0000","last_undegraded":"2023-08-31T19:04:39.024363+0000","last_fullsized":"2023-08-31T19:04:39.024363+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.006559+0000","last_change":"2023-08-31T19:04:38.557599+0000","last_active":"2023-08-31T19:04:39.006559+0000","last_peered":"2023-08-31T19:04:39.006559+0000","last_clean":"2023-08-31T19:04:39.006559+0000","last_became_active":"2023-08-31T19:04:38.557315+0000","last_became_peered":"2023-08-31T19:04:38.557315+0000","last_unstale":"2023-08-31T19:04:39.006559+0000","last_undegraded":"2023-08-31T19:04:39.006559+0000","last_fullsized":"2023-08-31T19:04:39.006559+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.028180+0000","last_change":"2023-08-31T19:04:39.023691+0000","last_active":"2023-08-31T19:04:39.028180+0000","last_peered":"2023-08-31T19:04:39.028180+0000","last_clean":"2023-08-31T19:04:39.028180+0000","last_became_active":"2023-08-31T19:04:39.023431+0000","last_became_peered":"2023-08-31T19:04:39.023431+0000","last_unstale":"2023-08-31T19:04:39.028180+0000","last_undegraded":"2023-08-31T19:04:39.028180+0000","last_fullsized":"2023-08-31T19:04:39.028180+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.028627+0000","last_change":"2023-08-31T19:04:38.556539+0000","last_active":"2023-08-31T19:04:39.028627+0000","last_peered":"2023-08-31T19:04:39.028627+0000","last_clean":"2023-08-31T19:04:39.028627+0000","last_became_active":"2023-08-31T19:04:38.556215+0000","last_became_peered":"2023-08-31T19:04:38.556215+0000","last_unstale":"2023-08-31T19:04:39.028627+0000","last_undegraded":"2023-08-31T19:04:39.028627+0000","last_fullsized":"2023-08-31T19:04:39.028627+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.027084+0000","last_change":"2023-08-31T19:04:39.019246+0000","last_active":"2023-08-31T19:04:39.027084+0000","last_peered":"2023-08-31T19:04:39.027084+0000","last_clean":"2023-08-31T19:04:39.027084+0000","last_became_active":"2023-08-31T19:04:39.018790+0000","last_became_peered":"2023-08-31T19:04:39.018790+0000","last_unstale":"2023-08-31T19:04:39.027084+0000","last_undegraded":"2023-08-31T19:04:39.027084+0000","last_fullsized":"2023-08-31T19:04:39.027084+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.032691+0000","last_change":"2023-08-31T19:04:38.551281+0000","last_active":"2023-08-31T19:04:39.032691+0000","last_peered":"2023-08-31T19:04:39.032691+0000","last_clean":"2023-08-31T19:04:39.032691+0000","last_became_active":"2023-08-31T19:04:38.550886+0000","last_became_peered":"2023-08-31T19:04:38.550886+0000","last_unstale":"2023-08-31T19:04:39.032691+0000","last_undegraded":"2023-08-31T19:04:39.032691+0000","last_fullsized":"2023-08-31T19:04:39.032691+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.020094+0000","last_change":"2023-08-31T19:04:39.014221+0000","last_active":"2023-08-31T19:04:39.020094+0000","last_peered":"2023-08-31T19:04:39.020094+0000","last_clean":"2023-08-31T19:04:39.020094+0000","last_became_active":"2023-08-31T19:04:39.013909+0000","last_became_peered":"2023-08-31T19:04:39.013909+0000","last_unstale":"2023-08-31T19:04:39.020094+0000","last_undegraded":"2023-08-31T19:04:39.020094+0000","last_fullsized":"2023-08-31T19:04:39.020094+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.028377+0000","last_change":"2023-08-31T19:04:38.551653+0000","last_active":"2023-08-31T19:04:39.028377+0000","last_peered":"2023-08-31T19:04:39.028377+0000","last_clean":"2023-08-31T19:04:39.028377+0000","last_became_active":"2023-08-31T19:04:38.551374+0000","last_became_peered":"2023-08-31T19:04:38.551374+0000","last_unstale":"2023-08-31T19:04:39.028377+0000","last_undegraded":"2023-08-31T19:04:39.028377+0000","last_fullsized":"2023-08-31T19:04:39.028377+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.035018+0000","last_change":"2023-08-31T19:04:39.030541+0000","last_active":"2023-08-31T19:04:39.035018+0000","last_peered":"2023-08-31T19:04:39.035018+0000","last_clean":"2023-08-31T19:04:39.035018+0000","last_became_active":"2023-08-31T19:04:39.030112+0000","last_became_peered":"2023-08-31T19:04:39.030112+0000","last_unstale":"2023-08-31T19:04:39.035018+0000","last_undegraded":"2023-08-31T19:04:39.035018+0000","last_fullsized":"2023-08-31T19:04:39.035018+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.010990+0000","last_change":"2023-08-31T19:04:38.550527+0000","last_active":"2023-08-31T19:04:39.010990+0000","last_peered":"2023-08-31T19:04:39.010990+0000","last_clean":"2023-08-31T19:04:39.010990+0000","last_became_active":"2023-08-31T19:04:38.550250+0000","last_became_peered":"2023-08-31T19:04:38.550250+0000","last_unstale":"2023-08-31T19:04:39.010990+0000","last_undegraded":"2023-08-31T19:04:39.010990+0000","last_fullsized":"2023-08-31T19:04:39.010990+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.029016+0000","last_change":"2023-08-31T19:04:39.023681+0000","last_active":"2023-08-31T19:04:39.029016+0000","last_peered":"2023-08-31T19:04:39.029016+0000","last_clean":"2023-08-31T19:04:39.029016+0000","last_became_active":"2023-08-31T19:04:39.023298+0000","last_became_peered":"2023-08-31T19:04:39.023298+0000","last_unstale":"2023-08-31T19:04:39.029016+0000","last_undegraded":"2023-08-31T19:04:39.029016+0000","last_fullsized":"2023-08-31T19:04:39.029016+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.009366+0000","last_change":"2023-08-31T19:04:38.559486+0000","last_active":"2023-08-31T19:04:39.009366+0000","last_peered":"2023-08-31T19:04:39.009366+0000","last_clean":"2023-08-31T19:04:39.009366+0000","last_became_active":"2023-08-31T19:04:38.559171+0000","last_became_peered":"2023-08-31T19:04:38.559171+0000","last_unstale":"2023-08-31T19:04:39.009366+0000","last_undegraded":"2023-08-31T19:04:39.009366+0000","last_fullsized":"2023-08-31T19:04:39.009366+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.033933+0000","last_change":"2023-08-31T19:04:39.028770+0000","last_active":"2023-08-31T19:04:39.033933+0000","last_peered":"2023-08-31T19:04:39.033933+0000","last_clean":"2023-08-31T19:04:39.033933+0000","last_became_active":"2023-08-31T19:04:39.028237+0000","last_became_peered":"2023-08-31T19:04:39.028237+0000","last_unstale":"2023-08-31T19:04:39.033933+0000","last_undegraded":"2023-08-31T19:04:39.033933+0000","last_fullsized":"2023-08-31T19:04:39.033933+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.010261+0000","last_change":"2023-08-31T19:04:38.559858+0000","last_active":"2023-08-31T19:04:39.010261+0000","last_peered":"2023-08-31T19:04:39.010261+0000","last_clean":"2023-08-31T19:04:39.010261+0000","last_became_active":"2023-08-31T19:04:38.559580+0000","last_became_peered":"2023-08-31T19:04:38.559580+0000","last_unstale":"2023-08-31T19:04:39.010261+0000","last_undegraded":"2023-08-31T19:04:39.010261+0000","last_fullsized":"2023-08-31T19:04:39.010261+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.034839+0000","last_change":"2023-08-31T19:04:39.030702+0000","last_active":"2023-08-31T19:04:39.034839+0000","last_peered":"2023-08-31T19:04:39.034839+0000","last_clean":"2023-08-31T19:04:39.034839+0000","last_became_active":"2023-08-31T19:04:39.030432+0000","last_became_peered":"2023-08-31T19:04:39.030432+0000","last_unstale":"2023-08-31T19:04:39.034839+0000","last_undegraded":"2023-08-31T19:04:39.034839+0000","last_fullsized":"2023-08-31T19:04:39.034839+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.000995+0000","last_change":"2023-08-31T19:04:38.550822+0000","last_active":"2023-08-31T19:04:39.000995+0000","last_peered":"2023-08-31T19:04:39.000995+0000","last_clean":"2023-08-31T19:04:39.000995+0000","last_became_active":"2023-08-31T19:04:38.550535+0000","last_became_peered":"2023-08-31T19:04:38.550535+0000","last_unstale":"2023-08-31T19:04:39.000995+0000","last_undegraded":"2023-08-31T19:04:39.000995+0000","last_fullsized":"2023-08-31T19:04:39.000995+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.028508+0000","last_change":"2023-08-31T19:04:39.022517+0000","last_active":"2023-08-31T19:04:39.028508+0000","last_peered":"2023-08-31T19:04:39.028508+0000","last_clean":"2023-08-31T19:04:39.028508+0000","last_became_active":"2023-08-31T19:04:39.021784+0000","last_became_peered":"2023-08-31T19:04:39.021784+0000","last_unstale":"2023-08-31T19:04:39.028508+0000","last_undegraded":"2023-08-31T19:04:39.028508+0000","last_fullsized":"2023-08-31T19:04:39.028508+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.006978+0000","last_change":"2023-08-31T19:04:38.549270+0000","last_active":"2023-08-31T19:04:39.006978+0000","last_peered":"2023-08-31T19:04:39.006978+0000","last_clean":"2023-08-31T19:04:39.006978+0000","last_became_active":"2023-08-31T19:04:38.548968+0000","last_became_peered":"2023-08-31T19:04:38.548968+0000","last_unstale":"2023-08-31T19:04:39.006978+0000","last_undegraded":"2023-08-31T19:04:39.006978+0000","last_fullsized":"2023-08-31T19:04:39.006978+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.023170+0000","last_change":"2023-08-31T19:04:39.018100+0000","last_active":"2023-08-31T19:04:39.023170+0000","last_peered":"2023-08-31T19:04:39.023170+0000","last_clean":"2023-08-31T19:04:39.023170+0000","last_became_active":"2023-08-31T19:04:39.017711+0000","last_became_peered":"2023-08-31T19:04:39.017711+0000","last_unstale":"2023-08-31T19:04:39.023170+0000","last_undegraded":"2023-08-31T19:04:39.023170+0000","last_fullsized":"2023-08-31T19:04:39.023170+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"108'4","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.038123+0000","last_change":"2023-08-31T19:04:38.550285+0000","last_active":"2023-08-31T19:04:39.038123+0000","last_peered":"2023-08-31T19:04:39.038123+0000","last_clean":"2023-08-31T19:04:39.038123+0000","last_became_active":"2023-08-31T19:04:38.549962+0000","last_became_peered":"2023-08-31T19:04:38.549962+0000","last_unstale":"2023-08-31T19:04:39.038123+0000","last_undegraded":"2023-08-31T19:04:39.038123+0000","last_fullsized":"2023-08-31T19:04:39.038123+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.031896+0000","last_change":"2023-08-31T19:04:39.021890+0000","last_active":"2023-08-31T19:04:39.031896+0000","last_peered":"2023-08-31T19:04:39.031896+0000","last_clean":"2023-08-31T19:04:39.031896+0000","last_became_active":"2023-08-31T19:04:39.021298+0000","last_became_peered":"2023-08-31T19:04:39.021298+0000","last_unstale":"2023-08-31T19:04:39.031896+0000","last_undegraded":"2023-08-31T19:04:39.031896+0000","last_fullsized":"2023-08-31T19:04:39.031896+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.024560+0000","last_change":"2023-08-31T19:04:38.555614+0000","last_active":"2023-08-31T19:04:39.024560+0000","last_peered":"2023-08-31T19:04:39.024560+0000","last_clean":"2023-08-31T19:04:39.024560+0000","last_became_active":"2023-08-31T19:04:38.555307+0000","last_became_peered":"2023-08-31T19:04:38.555307+0000","last_unstale":"2023-08-31T19:04:39.024560+0000","last_undegraded":"2023-08-31T19:04:39.024560+0000","last_fullsized":"2023-08-31T19:04:39.024560+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.020364+0000","last_change":"2023-08-31T19:04:39.015320+0000","last_active":"2023-08-31T19:04:39.020364+0000","last_peered":"2023-08-31T19:04:39.020364+0000","last_clean":"2023-08-31T19:04:39.020364+0000","last_became_active":"2023-08-31T19:04:39.015025+0000","last_became_peered":"2023-08-31T19:04:39.015025+0000","last_unstale":"2023-08-31T19:04:39.020364+0000","last_undegraded":"2023-08-31T19:04:39.020364+0000","last_fullsized":"2023-08-31T19:04:39.020364+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.009679+0000","last_change":"2023-08-31T19:04:38.556411+0000","last_active":"2023-08-31T19:04:39.009679+0000","last_peered":"2023-08-31T19:04:39.009679+0000","last_clean":"2023-08-31T19:04:39.009679+0000","last_became_active":"2023-08-31T19:04:38.555971+0000","last_became_peered":"2023-08-31T19:04:38.555971+0000","last_unstale":"2023-08-31T19:04:39.009679+0000","last_undegraded":"2023-08-31T19:04:39.009679+0000","last_fullsized":"2023-08-31T19:04:39.009679+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.032353+0000","last_change":"2023-08-31T19:04:39.028118+0000","last_active":"2023-08-31T19:04:39.032353+0000","last_peered":"2023-08-31T19:04:39.032353+0000","last_clean":"2023-08-31T19:04:39.032353+0000","last_became_active":"2023-08-31T19:04:39.027736+0000","last_became_peered":"2023-08-31T19:04:39.027736+0000","last_unstale":"2023-08-31T19:04:39.032353+0000","last_undegraded":"2023-08-31T19:04:39.032353+0000","last_fullsized":"2023-08-31T19:04:39.032353+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.003334+0000","last_change":"2023-08-31T19:04:38.556060+0000","last_active":"2023-08-31T19:04:39.003334+0000","last_peered":"2023-08-31T19:04:39.003334+0000","last_clean":"2023-08-31T19:04:39.003334+0000","last_became_active":"2023-08-31T19:04:38.555788+0000","last_became_peered":"2023-08-31T19:04:38.555788+0000","last_unstale":"2023-08-31T19:04:39.003334+0000","last_undegraded":"2023-08-31T19:04:39.003334+0000","last_fullsized":"2023-08-31T19:04:39.003334+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.026202+0000","last_change":"2023-08-31T19:04:39.020139+0000","last_active":"2023-08-31T19:04:39.026202+0000","last_peered":"2023-08-31T19:04:39.026202+0000","last_clean":"2023-08-31T19:04:39.026202+0000","last_became_active":"2023-08-31T19:04:39.019810+0000","last_became_peered":"2023-08-31T19:04:39.019810+0000","last_unstale":"2023-08-31T19:04:39.026202+0000","last_undegraded":"2023-08-31T19:04:39.026202+0000","last_fullsized":"2023-08-31T19:04:39.026202+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"108'4","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.025892+0000","last_change":"2023-08-31T19:04:38.550274+0000","last_active":"2023-08-31T19:04:39.025892+0000","last_peered":"2023-08-31T19:04:39.025892+0000","last_clean":"2023-08-31T19:04:39.025892+0000","last_became_active":"2023-08-31T19:04:38.549934+0000","last_became_peered":"2023-08-31T19:04:38.549934+0000","last_unstale":"2023-08-31T19:04:39.025892+0000","last_undegraded":"2023-08-31T19:04:39.025892+0000","last_fullsized":"2023-08-31T19:04:39.025892+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.026601+0000","last_change":"2023-08-31T19:04:39.015939+0000","last_active":"2023-08-31T19:04:39.026601+0000","last_peered":"2023-08-31T19:04:39.026601+0000","last_clean":"2023-08-31T19:04:39.026601+0000","last_became_active":"2023-08-31T19:04:39.015614+0000","last_became_peered":"2023-08-31T19:04:39.015614+0000","last_unstale":"2023-08-31T19:04:39.026601+0000","last_undegraded":"2023-08-31T19:04:39.026601+0000","last_fullsized":"2023-08-31T19:04:39.026601+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.006694+0000","last_change":"2023-08-31T19:04:38.551051+0000","last_active":"2023-08-31T19:04:39.006694+0000","last_peered":"2023-08-31T19:04:39.006694+0000","last_clean":"2023-08-31T19:04:39.006694+0000","last_became_active":"2023-08-31T19:04:38.550664+0000","last_became_peered":"2023-08-31T19:04:38.550664+0000","last_unstale":"2023-08-31T19:04:39.006694+0000","last_undegraded":"2023-08-31T19:04:39.006694+0000","last_fullsized":"2023-08-31T19:04:39.006694+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.032383+0000","last_change":"2023-08-31T19:04:39.028378+0000","last_active":"2023-08-31T19:04:39.032383+0000","last_peered":"2023-08-31T19:04:39.032383+0000","last_clean":"2023-08-31T19:04:39.032383+0000","last_became_active":"2023-08-31T19:04:39.028011+0000","last_became_peered":"2023-08-31T19:04:39.028011+0000","last_unstale":"2023-08-31T19:04:39.032383+0000","last_undegraded":"2023-08-31T19:04:39.032383+0000","last_fullsized":"2023-08-31T19:04:39.032383+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.010936+0000","last_change":"2023-08-31T19:04:38.558995+0000","last_active":"2023-08-31T19:04:39.010936+0000","last_peered":"2023-08-31T19:04:39.010936+0000","last_clean":"2023-08-31T19:04:39.010936+0000","last_became_active":"2023-08-31T19:04:38.558709+0000","last_became_peered":"2023-08-31T19:04:38.558709+0000","last_unstale":"2023-08-31T19:04:39.010936+0000","last_undegraded":"2023-08-31T19:04:39.010936+0000","last_fullsized":"2023-08-31T19:04:39.010936+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.016411+0000","last_change":"2023-08-31T19:04:39.013889+0000","last_active":"2023-08-31T19:04:39.016411+0000","last_peered":"2023-08-31T19:04:39.016411+0000","last_clean":"2023-08-31T19:04:39.016411+0000","last_became_active":"2023-08-31T19:04:39.013605+0000","last_became_peered":"2023-08-31T19:04:39.013605+0000","last_unstale":"2023-08-31T19:04:39.016411+0000","last_undegraded":"2023-08-31T19:04:39.016411+0000","last_fullsized":"2023-08-31T19:04:39.016411+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.032286+0000","last_change":"2023-08-31T19:04:38.554966+0000","last_active":"2023-08-31T19:04:39.032286+0000","last_peered":"2023-08-31T19:04:39.032286+0000","last_clean":"2023-08-31T19:04:39.032286+0000","last_became_active":"2023-08-31T19:04:38.554700+0000","last_became_peered":"2023-08-31T19:04:38.554700+0000","last_unstale":"2023-08-31T19:04:39.032286+0000","last_undegraded":"2023-08-31T19:04:39.032286+0000","last_fullsized":"2023-08-31T19:04:39.032286+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.031920+0000","last_change":"2023-08-31T19:04:39.016308+0000","last_active":"2023-08-31T19:04:39.031920+0000","last_peered":"2023-08-31T19:04:39.031920+0000","last_clean":"2023-08-31T19:04:39.031920+0000","last_became_active":"2023-08-31T19:04:39.016057+0000","last_became_peered":"2023-08-31T19:04:39.016057+0000","last_unstale":"2023-08-31T19:04:39.031920+0000","last_undegraded":"2023-08-31T19:04:39.031920+0000","last_fullsized":"2023-08-31T19:04:39.031920+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.015345+0000","last_change":"2023-08-31T19:04:38.558876+0000","last_active":"2023-08-31T19:04:39.015345+0000","last_peered":"2023-08-31T19:04:39.015345+0000","last_clean":"2023-08-31T19:04:39.015345+0000","last_became_active":"2023-08-31T19:04:38.558614+0000","last_became_peered":"2023-08-31T19:04:38.558614+0000","last_unstale":"2023-08-31T19:04:39.015345+0000","last_undegraded":"2023-08-31T19:04:39.015345+0000","last_fullsized":"2023-08-31T19:04:39.015345+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.031158+0000","last_change":"2023-08-31T19:04:39.027866+0000","last_active":"2023-08-31T19:04:39.031158+0000","last_peered":"2023-08-31T19:04:39.031158+0000","last_clean":"2023-08-31T19:04:39.031158+0000","last_became_active":"2023-08-31T19:04:39.027555+0000","last_became_peered":"2023-08-31T19:04:39.027555+0000","last_unstale":"2023-08-31T19:04:39.031158+0000","last_undegraded":"2023-08-31T19:04:39.031158+0000","last_fullsized":"2023-08-31T19:04:39.031158+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.033044+0000","last_change":"2023-08-31T19:04:38.558634+0000","last_active":"2023-08-31T19:04:39.033044+0000","last_peered":"2023-08-31T19:04:39.033044+0000","last_clean":"2023-08-31T19:04:39.033044+0000","last_became_active":"2023-08-31T19:04:38.558212+0000","last_became_peered":"2023-08-31T19:04:38.558212+0000","last_unstale":"2023-08-31T19:04:39.033044+0000","last_undegraded":"2023-08-31T19:04:39.033044+0000","last_fullsized":"2023-08-31T19:04:39.033044+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.030272+0000","last_change":"2023-08-31T19:04:39.026443+0000","last_active":"2023-08-31T19:04:39.030272+0000","last_peered":"2023-08-31T19:04:39.030272+0000","last_clean":"2023-08-31T19:04:39.030272+0000","last_became_active":"2023-08-31T19:04:39.026160+0000","last_became_peered":"2023-08-31T19:04:39.026160+0000","last_unstale":"2023-08-31T19:04:39.030272+0000","last_undegraded":"2023-08-31T19:04:39.030272+0000","last_fullsized":"2023-08-31T19:04:39.030272+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.008001+0000","last_change":"2023-08-31T19:04:38.556794+0000","last_active":"2023-08-31T19:04:39.008001+0000","last_peered":"2023-08-31T19:04:39.008001+0000","last_clean":"2023-08-31T19:04:39.008001+0000","last_became_active":"2023-08-31T19:04:38.554935+0000","last_became_peered":"2023-08-31T19:04:38.554935+0000","last_unstale":"2023-08-31T19:04:39.008001+0000","last_undegraded":"2023-08-31T19:04:39.008001+0000","last_fullsized":"2023-08-31T19:04:39.008001+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.032328+0000","last_change":"2023-08-31T19:04:39.027824+0000","last_active":"2023-08-31T19:04:39.032328+0000","last_peered":"2023-08-31T19:04:39.032328+0000","last_clean":"2023-08-31T19:04:39.032328+0000","last_became_active":"2023-08-31T19:04:39.027326+0000","last_became_peered":"2023-08-31T19:04:39.027326+0000","last_unstale":"2023-08-31T19:04:39.032328+0000","last_undegraded":"2023-08-31T19:04:39.032328+0000","last_fullsized":"2023-08-31T19:04:39.032328+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.001536+0000","last_change":"2023-08-31T19:04:38.555721+0000","last_active":"2023-08-31T19:04:39.001536+0000","last_peered":"2023-08-31T19:04:39.001536+0000","last_clean":"2023-08-31T19:04:39.001536+0000","last_became_active":"2023-08-31T19:04:38.555305+0000","last_became_peered":"2023-08-31T19:04:38.555305+0000","last_unstale":"2023-08-31T19:04:39.001536+0000","last_undegraded":"2023-08-31T19:04:39.001536+0000","last_fullsized":"2023-08-31T19:04:39.001536+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.030004+0000","last_change":"2023-08-31T19:04:39.023683+0000","last_active":"2023-08-31T19:04:39.030004+0000","last_peered":"2023-08-31T19:04:39.030004+0000","last_clean":"2023-08-31T19:04:39.030004+0000","last_became_active":"2023-08-31T19:04:39.023325+0000","last_became_peered":"2023-08-31T19:04:39.023325+0000","last_unstale":"2023-08-31T19:04:39.030004+0000","last_undegraded":"2023-08-31T19:04:39.030004+0000","last_fullsized":"2023-08-31T19:04:39.030004+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.009270+0000","last_change":"2023-08-31T19:04:38.555510+0000","last_active":"2023-08-31T19:04:39.009270+0000","last_peered":"2023-08-31T19:04:39.009270+0000","last_clean":"2023-08-31T19:04:39.009270+0000","last_became_active":"2023-08-31T19:04:38.555228+0000","last_became_peered":"2023-08-31T19:04:38.555228+0000","last_unstale":"2023-08-31T19:04:39.009270+0000","last_undegraded":"2023-08-31T19:04:39.009270+0000","last_fullsized":"2023-08-31T19:04:39.009270+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.032368+0000","last_change":"2023-08-31T19:04:39.026825+0000","last_active":"2023-08-31T19:04:39.032368+0000","last_peered":"2023-08-31T19:04:39.032368+0000","last_clean":"2023-08-31T19:04:39.032368+0000","last_became_active":"2023-08-31T19:04:39.026394+0000","last_became_peered":"2023-08-31T19:04:39.026394+0000","last_unstale":"2023-08-31T19:04:39.032368+0000","last_undegraded":"2023-08-31T19:04:39.032368+0000","last_fullsized":"2023-08-31T19:04:39.032368+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.007462+0000","last_change":"2023-08-31T19:04:38.550908+0000","last_active":"2023-08-31T19:04:39.007462+0000","last_peered":"2023-08-31T19:04:39.007462+0000","last_clean":"2023-08-31T19:04:39.007462+0000","last_became_active":"2023-08-31T19:04:38.550665+0000","last_became_peered":"2023-08-31T19:04:38.550665+0000","last_unstale":"2023-08-31T19:04:39.007462+0000","last_undegraded":"2023-08-31T19:04:39.007462+0000","last_fullsized":"2023-08-31T19:04:39.007462+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.028881+0000","last_change":"2023-08-31T19:04:39.023675+0000","last_active":"2023-08-31T19:04:39.028881+0000","last_peered":"2023-08-31T19:04:39.028881+0000","last_clean":"2023-08-31T19:04:39.028881+0000","last_became_active":"2023-08-31T19:04:39.023410+0000","last_became_peered":"2023-08-31T19:04:39.023410+0000","last_unstale":"2023-08-31T19:04:39.028881+0000","last_undegraded":"2023-08-31T19:04:39.028881+0000","last_fullsized":"2023-08-31T19:04:39.028881+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.006442+0000","last_change":"2023-08-31T19:04:38.556026+0000","last_active":"2023-08-31T19:04:39.006442+0000","last_peered":"2023-08-31T19:04:39.006442+0000","last_clean":"2023-08-31T19:04:39.006442+0000","last_became_active":"2023-08-31T19:04:38.555694+0000","last_became_peered":"2023-08-31T19:04:38.555694+0000","last_unstale":"2023-08-31T19:04:39.006442+0000","last_undegraded":"2023-08-31T19:04:39.006442+0000","last_fullsized":"2023-08-31T19:04:39.006442+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.032296+0000","last_change":"2023-08-31T19:04:39.027480+0000","last_active":"2023-08-31T19:04:39.032296+0000","last_peered":"2023-08-31T19:04:39.032296+0000","last_clean":"2023-08-31T19:04:39.032296+0000","last_became_active":"2023-08-31T19:04:39.027182+0000","last_became_peered":"2023-08-31T19:04:39.027182+0000","last_unstale":"2023-08-31T19:04:39.032296+0000","last_undegraded":"2023-08-31T19:04:39.032296+0000","last_fullsized":"2023-08-31T19:04:39.032296+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.006694+0000","last_change":"2023-08-31T19:04:38.557251+0000","last_active":"2023-08-31T19:04:39.006694+0000","last_peered":"2023-08-31T19:04:39.006694+0000","last_clean":"2023-08-31T19:04:39.006694+0000","last_became_active":"2023-08-31T19:04:38.556726+0000","last_became_peered":"2023-08-31T19:04:38.556726+0000","last_unstale":"2023-08-31T19:04:39.006694+0000","last_undegraded":"2023-08-31T19:04:39.006694+0000","last_fullsized":"2023-08-31T19:04:39.006694+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.022370+0000","last_change":"2023-08-31T19:04:39.012901+0000","last_active":"2023-08-31T19:04:39.022370+0000","last_peered":"2023-08-31T19:04:39.022370+0000","last_clean":"2023-08-31T19:04:39.022370+0000","last_became_active":"2023-08-31T19:04:39.012575+0000","last_became_peered":"2023-08-31T19:04:39.012575+0000","last_unstale":"2023-08-31T19:04:39.022370+0000","last_undegraded":"2023-08-31T19:04:39.022370+0000","last_fullsized":"2023-08-31T19:04:39.022370+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.001200+0000","last_change":"2023-08-31T19:04:38.542262+0000","last_active":"2023-08-31T19:04:39.001200+0000","last_peered":"2023-08-31T19:04:39.001200+0000","last_clean":"2023-08-31T19:04:39.001200+0000","last_became_active":"2023-08-31T19:04:38.541962+0000","last_became_peered":"2023-08-31T19:04:38.541962+0000","last_unstale":"2023-08-31T19:04:39.001200+0000","last_undegraded":"2023-08-31T19:04:39.001200+0000","last_fullsized":"2023-08-31T19:04:39.001200+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.031915+0000","last_change":"2023-08-31T19:04:39.022073+0000","last_active":"2023-08-31T19:04:39.031915+0000","last_peered":"2023-08-31T19:04:39.031915+0000","last_clean":"2023-08-31T19:04:39.031915+0000","last_became_active":"2023-08-31T19:04:39.021630+0000","last_became_peered":"2023-08-31T19:04:39.021630+0000","last_unstale":"2023-08-31T19:04:39.031915+0000","last_undegraded":"2023-08-31T19:04:39.031915+0000","last_fullsized":"2023-08-31T19:04:39.031915+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.005766+0000","last_change":"2023-08-31T19:04:38.549335+0000","last_active":"2023-08-31T19:04:39.005766+0000","last_peered":"2023-08-31T19:04:39.005766+0000","last_clean":"2023-08-31T19:04:39.005766+0000","last_became_active":"2023-08-31T19:04:38.549000+0000","last_became_peered":"2023-08-31T19:04:38.549000+0000","last_unstale":"2023-08-31T19:04:39.005766+0000","last_undegraded":"2023-08-31T19:04:39.005766+0000","last_fullsized":"2023-08-31T19:04:39.005766+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.031560+0000","last_change":"2023-08-31T19:04:39.026781+0000","last_active":"2023-08-31T19:04:39.031560+0000","last_peered":"2023-08-31T19:04:39.031560+0000","last_clean":"2023-08-31T19:04:39.031560+0000","last_became_active":"2023-08-31T19:04:39.026435+0000","last_became_peered":"2023-08-31T19:04:39.026435+0000","last_unstale":"2023-08-31T19:04:39.031560+0000","last_undegraded":"2023-08-31T19:04:39.031560+0000","last_fullsized":"2023-08-31T19:04:39.031560+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.008106+0000","last_change":"2023-08-31T19:04:38.548375+0000","last_active":"2023-08-31T19:04:39.008106+0000","last_peered":"2023-08-31T19:04:39.008106+0000","last_clean":"2023-08-31T19:04:39.008106+0000","last_became_active":"2023-08-31T19:04:38.548062+0000","last_became_peered":"2023-08-31T19:04:38.548062+0000","last_unstale":"2023-08-31T19:04:39.008106+0000","last_undegraded":"2023-08-31T19:04:39.008106+0000","last_fullsized":"2023-08-31T19:04:39.008106+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.025141+0000","last_change":"2023-08-31T19:04:39.020452+0000","last_active":"2023-08-31T19:04:39.025141+0000","last_peered":"2023-08-31T19:04:39.025141+0000","last_clean":"2023-08-31T19:04:39.025141+0000","last_became_active":"2023-08-31T19:04:39.020130+0000","last_became_peered":"2023-08-31T19:04:39.020130+0000","last_unstale":"2023-08-31T19:04:39.025141+0000","last_undegraded":"2023-08-31T19:04:39.025141+0000","last_fullsized":"2023-08-31T19:04:39.025141+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.005045+0000","last_change":"2023-08-31T19:04:38.555607+0000","last_active":"2023-08-31T19:04:39.005045+0000","last_peered":"2023-08-31T19:04:39.005045+0000","last_clean":"2023-08-31T19:04:39.005045+0000","last_became_active":"2023-08-31T19:04:38.555345+0000","last_became_peered":"2023-08-31T19:04:38.555345+0000","last_unstale":"2023-08-31T19:04:39.005045+0000","last_undegraded":"2023-08-31T19:04:39.005045+0000","last_fullsized":"2023-08-31T19:04:39.005045+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.032244+0000","last_change":"2023-08-31T19:04:39.029858+0000","last_active":"2023-08-31T19:04:39.032244+0000","last_peered":"2023-08-31T19:04:39.032244+0000","last_clean":"2023-08-31T19:04:39.032244+0000","last_became_active":"2023-08-31T19:04:39.029530+0000","last_became_peered":"2023-08-31T19:04:39.029530+0000","last_unstale":"2023-08-31T19:04:39.032244+0000","last_undegraded":"2023-08-31T19:04:39.032244+0000","last_fullsized":"2023-08-31T19:04:39.032244+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.000544+0000","last_change":"2023-08-31T19:04:38.546014+0000","last_active":"2023-08-31T19:04:39.000544+0000","last_peered":"2023-08-31T19:04:39.000544+0000","last_clean":"2023-08-31T19:04:39.000544+0000","last_became_active":"2023-08-31T19:04:38.545702+0000","last_became_peered":"2023-08-31T19:04:38.545702+0000","last_unstale":"2023-08-31T19:04:39.000544+0000","last_undegraded":"2023-08-31T19:04:39.000544+0000","last_fullsized":"2023-08-31T19:04:39.000544+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.032196+0000","last_change":"2023-08-31T19:04:39.025947+0000","last_active":"2023-08-31T19:04:39.032196+0000","last_peered":"2023-08-31T19:04:39.032196+0000","last_clean":"2023-08-31T19:04:39.032196+0000","last_became_active":"2023-08-31T19:04:39.025315+0000","last_became_peered":"2023-08-31T19:04:39.025315+0000","last_unstale":"2023-08-31T19:04:39.032196+0000","last_undegraded":"2023-08-31T19:04:39.032196+0000","last_fullsized":"2023-08-31T19:04:39.032196+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.034285+0000","last_change":"2023-08-31T19:04:38.556158+0000","last_active":"2023-08-31T19:04:39.034285+0000","last_peered":"2023-08-31T19:04:39.034285+0000","last_clean":"2023-08-31T19:04:39.034285+0000","last_became_active":"2023-08-31T19:04:38.555786+0000","last_became_peered":"2023-08-31T19:04:38.555786+0000","last_unstale":"2023-08-31T19:04:39.034285+0000","last_undegraded":"2023-08-31T19:04:39.034285+0000","last_fullsized":"2023-08-31T19:04:39.034285+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.037674+0000","last_change":"2023-08-31T19:04:39.032096+0000","last_active":"2023-08-31T19:04:39.037674+0000","last_peered":"2023-08-31T19:04:39.037674+0000","last_clean":"2023-08-31T19:04:39.037674+0000","last_became_active":"2023-08-31T19:04:39.031794+0000","last_became_peered":"2023-08-31T19:04:39.031794+0000","last_unstale":"2023-08-31T19:04:39.037674+0000","last_undegraded":"2023-08-31T19:04:39.037674+0000","last_fullsized":"2023-08-31T19:04:39.037674+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.025185+0000","last_change":"2023-08-31T19:04:38.554536+0000","last_active":"2023-08-31T19:04:39.025185+0000","last_peered":"2023-08-31T19:04:39.025185+0000","last_clean":"2023-08-31T19:04:39.025185+0000","last_became_active":"2023-08-31T19:04:38.554211+0000","last_became_peered":"2023-08-31T19:04:38.554211+0000","last_unstale":"2023-08-31T19:04:39.025185+0000","last_undegraded":"2023-08-31T19:04:39.025185+0000","last_fullsized":"2023-08-31T19:04:39.025185+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.027597+0000","last_change":"2023-08-31T19:04:39.019712+0000","last_active":"2023-08-31T19:04:39.027597+0000","last_peered":"2023-08-31T19:04:39.027597+0000","last_clean":"2023-08-31T19:04:39.027597+0000","last_became_active":"2023-08-31T19:04:39.019413+0000","last_became_peered":"2023-08-31T19:04:39.019413+0000","last_unstale":"2023-08-31T19:04:39.027597+0000","last_undegraded":"2023-08-31T19:04:39.027597+0000","last_fullsized":"2023-08-31T19:04:39.027597+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.029779+0000","last_change":"2023-08-31T19:04:38.551314+0000","last_active":"2023-08-31T19:04:39.029779+0000","last_peered":"2023-08-31T19:04:39.029779+0000","last_clean":"2023-08-31T19:04:39.029779+0000","last_became_active":"2023-08-31T19:04:38.550989+0000","last_became_peered":"2023-08-31T19:04:38.550989+0000","last_unstale":"2023-08-31T19:04:39.029779+0000","last_undegraded":"2023-08-31T19:04:39.029779+0000","last_fullsized":"2023-08-31T19:04:39.029779+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.031940+0000","last_change":"2023-08-31T19:04:39.018304+0000","last_active":"2023-08-31T19:04:39.031940+0000","last_peered":"2023-08-31T19:04:39.031940+0000","last_clean":"2023-08-31T19:04:39.031940+0000","last_became_active":"2023-08-31T19:04:39.018021+0000","last_became_peered":"2023-08-31T19:04:39.018021+0000","last_unstale":"2023-08-31T19:04:39.031940+0000","last_undegraded":"2023-08-31T19:04:39.031940+0000","last_fullsized":"2023-08-31T19:04:39.031940+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.000820+0000","last_change":"2023-08-31T19:04:38.543501+0000","last_active":"2023-08-31T19:04:39.000820+0000","last_peered":"2023-08-31T19:04:39.000820+0000","last_clean":"2023-08-31T19:04:39.000820+0000","last_became_active":"2023-08-31T19:04:38.543161+0000","last_became_peered":"2023-08-31T19:04:38.543161+0000","last_unstale":"2023-08-31T19:04:39.000820+0000","last_undegraded":"2023-08-31T19:04:39.000820+0000","last_fullsized":"2023-08-31T19:04:39.000820+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.020406+0000","last_change":"2023-08-31T19:04:39.015331+0000","last_active":"2023-08-31T19:04:39.020406+0000","last_peered":"2023-08-31T19:04:39.020406+0000","last_clean":"2023-08-31T19:04:39.020406+0000","last_became_active":"2023-08-31T19:04:39.015010+0000","last_became_peered":"2023-08-31T19:04:39.015010+0000","last_unstale":"2023-08-31T19:04:39.020406+0000","last_undegraded":"2023-08-31T19:04:39.020406+0000","last_fullsized":"2023-08-31T19:04:39.020406+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.008752+0000","last_change":"2023-08-31T19:04:38.551658+0000","last_active":"2023-08-31T19:04:39.008752+0000","last_peered":"2023-08-31T19:04:39.008752+0000","last_clean":"2023-08-31T19:04:39.008752+0000","last_became_active":"2023-08-31T19:04:38.550696+0000","last_became_peered":"2023-08-31T19:04:38.550696+0000","last_unstale":"2023-08-31T19:04:39.008752+0000","last_undegraded":"2023-08-31T19:04:39.008752+0000","last_fullsized":"2023-08-31T19:04:39.008752+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.023240+0000","last_change":"2023-08-31T19:04:39.017728+0000","last_active":"2023-08-31T19:04:39.023240+0000","last_peered":"2023-08-31T19:04:39.023240+0000","last_clean":"2023-08-31T19:04:39.023240+0000","last_became_active":"2023-08-31T19:04:39.017423+0000","last_became_peered":"2023-08-31T19:04:39.017423+0000","last_unstale":"2023-08-31T19:04:39.023240+0000","last_undegraded":"2023-08-31T19:04:39.023240+0000","last_fullsized":"2023-08-31T19:04:39.023240+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.008198+0000","last_change":"2023-08-31T19:04:38.547916+0000","last_active":"2023-08-31T19:04:39.008198+0000","last_peered":"2023-08-31T19:04:39.008198+0000","last_clean":"2023-08-31T19:04:39.008198+0000","last_became_active":"2023-08-31T19:04:38.547627+0000","last_became_peered":"2023-08-31T19:04:38.547627+0000","last_unstale":"2023-08-31T19:04:39.008198+0000","last_undegraded":"2023-08-31T19:04:39.008198+0000","last_fullsized":"2023-08-31T19:04:39.008198+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.034999+0000","last_change":"2023-08-31T19:04:39.030367+0000","last_active":"2023-08-31T19:04:39.034999+0000","last_peered":"2023-08-31T19:04:39.034999+0000","last_clean":"2023-08-31T19:04:39.034999+0000","last_became_active":"2023-08-31T19:04:39.029809+0000","last_became_peered":"2023-08-31T19:04:39.029809+0000","last_unstale":"2023-08-31T19:04:39.034999+0000","last_undegraded":"2023-08-31T19:04:39.034999+0000","last_fullsized":"2023-08-31T19:04:39.034999+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.003423+0000","last_change":"2023-08-31T19:04:38.556619+0000","last_active":"2023-08-31T19:04:39.003423+0000","last_peered":"2023-08-31T19:04:39.003423+0000","last_clean":"2023-08-31T19:04:39.003423+0000","last_became_active":"2023-08-31T19:04:38.556281+0000","last_became_peered":"2023-08-31T19:04:38.556281+0000","last_unstale":"2023-08-31T19:04:39.003423+0000","last_undegraded":"2023-08-31T19:04:39.003423+0000","last_fullsized":"2023-08-31T19:04:39.003423+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.026180+0000","last_change":"2023-08-31T19:04:39.015764+0000","last_active":"2023-08-31T19:04:39.026180+0000","last_peered":"2023-08-31T19:04:39.026180+0000","last_clean":"2023-08-31T19:04:39.026180+0000","last_became_active":"2023-08-31T19:04:39.015473+0000","last_became_peered":"2023-08-31T19:04:39.015473+0000","last_unstale":"2023-08-31T19:04:39.026180+0000","last_undegraded":"2023-08-31T19:04:39.026180+0000","last_fullsized":"2023-08-31T19:04:39.026180+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.005858+0000","last_change":"2023-08-31T19:04:38.558707+0000","last_active":"2023-08-31T19:04:39.005858+0000","last_peered":"2023-08-31T19:04:39.005858+0000","last_clean":"2023-08-31T19:04:39.005858+0000","last_became_active":"2023-08-31T19:04:38.558426+0000","last_became_peered":"2023-08-31T19:04:38.558426+0000","last_unstale":"2023-08-31T19:04:39.005858+0000","last_undegraded":"2023-08-31T19:04:39.005858+0000","last_fullsized":"2023-08-31T19:04:39.005858+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.023931+0000","last_change":"2023-08-31T19:04:39.018231+0000","last_active":"2023-08-31T19:04:39.023931+0000","last_peered":"2023-08-31T19:04:39.023931+0000","last_clean":"2023-08-31T19:04:39.023931+0000","last_became_active":"2023-08-31T19:04:39.017673+0000","last_became_peered":"2023-08-31T19:04:39.017673+0000","last_unstale":"2023-08-31T19:04:39.023931+0000","last_undegraded":"2023-08-31T19:04:39.023931+0000","last_fullsized":"2023-08-31T19:04:39.023931+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.010381+0000","last_change":"2023-08-31T19:04:38.548743+0000","last_active":"2023-08-31T19:04:39.010381+0000","last_peered":"2023-08-31T19:04:39.010381+0000","last_clean":"2023-08-31T19:04:39.010381+0000","last_became_active":"2023-08-31T19:04:38.548443+0000","last_became_peered":"2023-08-31T19:04:38.548443+0000","last_unstale":"2023-08-31T19:04:39.010381+0000","last_undegraded":"2023-08-31T19:04:39.010381+0000","last_fullsized":"2023-08-31T19:04:39.010381+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.029754+0000","last_change":"2023-08-31T19:04:39.025595+0000","last_active":"2023-08-31T19:04:39.029754+0000","last_peered":"2023-08-31T19:04:39.029754+0000","last_clean":"2023-08-31T19:04:39.029754+0000","last_became_active":"2023-08-31T19:04:39.025261+0000","last_became_peered":"2023-08-31T19:04:39.025261+0000","last_unstale":"2023-08-31T19:04:39.029754+0000","last_undegraded":"2023-08-31T19:04:39.029754+0000","last_fullsized":"2023-08-31T19:04:39.029754+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.003811+0000","last_change":"2023-08-31T19:04:38.556526+0000","last_active":"2023-08-31T19:04:39.003811+0000","last_peered":"2023-08-31T19:04:39.003811+0000","last_clean":"2023-08-31T19:04:39.003811+0000","last_became_active":"2023-08-31T19:04:38.556204+0000","last_became_peered":"2023-08-31T19:04:38.556204+0000","last_unstale":"2023-08-31T19:04:39.003811+0000","last_undegraded":"2023-08-31T19:04:39.003811+0000","last_fullsized":"2023-08-31T19:04:39.003811+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.026056+0000","last_change":"2023-08-31T19:04:39.023305+0000","last_active":"2023-08-31T19:04:39.026056+0000","last_peered":"2023-08-31T19:04:39.026056+0000","last_clean":"2023-08-31T19:04:39.026056+0000","last_became_active":"2023-08-31T19:04:39.023062+0000","last_became_peered":"2023-08-31T19:04:39.023062+0000","last_unstale":"2023-08-31T19:04:39.026056+0000","last_undegraded":"2023-08-31T19:04:39.026056+0000","last_fullsized":"2023-08-31T19:04:39.026056+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"108'3","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.033171+0000","last_change":"2023-08-31T19:04:38.557041+0000","last_active":"2023-08-31T19:04:39.033171+0000","last_peered":"2023-08-31T19:04:39.033171+0000","last_clean":"2023-08-31T19:04:39.033171+0000","last_became_active":"2023-08-31T19:04:38.556382+0000","last_became_peered":"2023-08-31T19:04:38.556382+0000","last_unstale":"2023-08-31T19:04:39.033171+0000","last_undegraded":"2023-08-31T19:04:39.033171+0000","last_fullsized":"2023-08-31T19:04:39.033171+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.032485+0000","last_change":"2023-08-31T19:04:39.026635+0000","last_active":"2023-08-31T19:04:39.032485+0000","last_peered":"2023-08-31T19:04:39.032485+0000","last_clean":"2023-08-31T19:04:39.032485+0000","last_became_active":"2023-08-31T19:04:39.026273+0000","last_became_peered":"2023-08-31T19:04:39.026273+0000","last_unstale":"2023-08-31T19:04:39.032485+0000","last_undegraded":"2023-08-31T19:04:39.032485+0000","last_fullsized":"2023-08-31T19:04:39.032485+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.029760+0000","last_change":"2023-08-31T19:04:38.558412+0000","last_active":"2023-08-31T19:04:39.029760+0000","last_peered":"2023-08-31T19:04:39.029760+0000","last_clean":"2023-08-31T19:04:39.029760+0000","last_became_active":"2023-08-31T19:04:38.558096+0000","last_became_peered":"2023-08-31T19:04:38.558096+0000","last_unstale":"2023-08-31T19:04:39.029760+0000","last_undegraded":"2023-08-31T19:04:39.029760+0000","last_fullsized":"2023-08-31T19:04:39.029760+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.027060+0000","last_change":"2023-08-31T19:04:39.019056+0000","last_active":"2023-08-31T19:04:39.027060+0000","last_peered":"2023-08-31T19:04:39.027060+0000","last_clean":"2023-08-31T19:04:39.027060+0000","last_became_active":"2023-08-31T19:04:39.018452+0000","last_became_peered":"2023-08-31T19:04:39.018452+0000","last_unstale":"2023-08-31T19:04:39.027060+0000","last_undegraded":"2023-08-31T19:04:39.027060+0000","last_fullsized":"2023-08-31T19:04:39.027060+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.034341+0000","last_change":"2023-08-31T19:04:38.557778+0000","last_active":"2023-08-31T19:04:39.034341+0000","last_peered":"2023-08-31T19:04:39.034341+0000","last_clean":"2023-08-31T19:04:39.034341+0000","last_became_active":"2023-08-31T19:04:38.557476+0000","last_became_peered":"2023-08-31T19:04:38.557476+0000","last_unstale":"2023-08-31T19:04:39.034341+0000","last_undegraded":"2023-08-31T19:04:39.034341+0000","last_fullsized":"2023-08-31T19:04:39.034341+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.023239+0000","last_change":"2023-08-31T19:04:39.017463+0000","last_active":"2023-08-31T19:04:39.023239+0000","last_peered":"2023-08-31T19:04:39.023239+0000","last_clean":"2023-08-31T19:04:39.023239+0000","last_became_active":"2023-08-31T19:04:39.017160+0000","last_became_peered":"2023-08-31T19:04:39.017160+0000","last_unstale":"2023-08-31T19:04:39.023239+0000","last_undegraded":"2023-08-31T19:04:39.023239+0000","last_fullsized":"2023-08-31T19:04:39.023239+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.009176+0000","last_change":"2023-08-31T19:04:38.554242+0000","last_active":"2023-08-31T19:04:39.009176+0000","last_peered":"2023-08-31T19:04:39.009176+0000","last_clean":"2023-08-31T19:04:39.009176+0000","last_became_active":"2023-08-31T19:04:38.553920+0000","last_became_peered":"2023-08-31T19:04:38.553920+0000","last_unstale":"2023-08-31T19:04:39.009176+0000","last_undegraded":"2023-08-31T19:04:39.009176+0000","last_fullsized":"2023-08-31T19:04:39.009176+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.028560+0000","last_change":"2023-08-31T19:04:39.022344+0000","last_active":"2023-08-31T19:04:39.028560+0000","last_peered":"2023-08-31T19:04:39.028560+0000","last_clean":"2023-08-31T19:04:39.028560+0000","last_became_active":"2023-08-31T19:04:39.022063+0000","last_became_peered":"2023-08-31T19:04:39.022063+0000","last_unstale":"2023-08-31T19:04:39.028560+0000","last_undegraded":"2023-08-31T19:04:39.028560+0000","last_fullsized":"2023-08-31T19:04:39.028560+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.011732+0000","last_change":"2023-08-31T19:04:38.551403+0000","last_active":"2023-08-31T19:04:39.011732+0000","last_peered":"2023-08-31T19:04:39.011732+0000","last_clean":"2023-08-31T19:04:39.011732+0000","last_became_active":"2023-08-31T19:04:38.551155+0000","last_became_peered":"2023-08-31T19:04:38.551155+0000","last_unstale":"2023-08-31T19:04:39.011732+0000","last_undegraded":"2023-08-31T19:04:39.011732+0000","last_fullsized":"2023-08-31T19:04:39.011732+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.032174+0000","last_change":"2023-08-31T19:04:39.026111+0000","last_active":"2023-08-31T19:04:39.032174+0000","last_peered":"2023-08-31T19:04:39.032174+0000","last_clean":"2023-08-31T19:04:39.032174+0000","last_became_active":"2023-08-31T19:04:39.025840+0000","last_became_peered":"2023-08-31T19:04:39.025840+0000","last_unstale":"2023-08-31T19:04:39.032174+0000","last_undegraded":"2023-08-31T19:04:39.032174+0000","last_fullsized":"2023-08-31T19:04:39.032174+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"108'4","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.033761+0000","last_change":"2023-08-31T19:04:38.547849+0000","last_active":"2023-08-31T19:04:39.033761+0000","last_peered":"2023-08-31T19:04:39.033761+0000","last_clean":"2023-08-31T19:04:39.033761+0000","last_became_active":"2023-08-31T19:04:38.547562+0000","last_became_peered":"2023-08-31T19:04:38.547562+0000","last_unstale":"2023-08-31T19:04:39.033761+0000","last_undegraded":"2023-08-31T19:04:39.033761+0000","last_fullsized":"2023-08-31T19:04:39.033761+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.022068+0000","last_change":"2023-08-31T19:04:39.015576+0000","last_active":"2023-08-31T19:04:39.022068+0000","last_peered":"2023-08-31T19:04:39.022068+0000","last_clean":"2023-08-31T19:04:39.022068+0000","last_became_active":"2023-08-31T19:04:39.015188+0000","last_became_peered":"2023-08-31T19:04:39.015188+0000","last_unstale":"2023-08-31T19:04:39.022068+0000","last_undegraded":"2023-08-31T19:04:39.022068+0000","last_fullsized":"2023-08-31T19:04:39.022068+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.024324+0000","last_change":"2023-08-31T19:04:38.557661+0000","last_active":"2023-08-31T19:04:39.024324+0000","last_peered":"2023-08-31T19:04:39.024324+0000","last_clean":"2023-08-31T19:04:39.024324+0000","last_became_active":"2023-08-31T19:04:38.557364+0000","last_became_peered":"2023-08-31T19:04:38.557364+0000","last_unstale":"2023-08-31T19:04:39.024324+0000","last_undegraded":"2023-08-31T19:04:39.024324+0000","last_fullsized":"2023-08-31T19:04:39.024324+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.034940+0000","last_change":"2023-08-31T19:04:39.029862+0000","last_active":"2023-08-31T19:04:39.034940+0000","last_peered":"2023-08-31T19:04:39.034940+0000","last_clean":"2023-08-31T19:04:39.034940+0000","last_became_active":"2023-08-31T19:04:39.029398+0000","last_became_peered":"2023-08-31T19:04:39.029398+0000","last_unstale":"2023-08-31T19:04:39.034940+0000","last_undegraded":"2023-08-31T19:04:39.034940+0000","last_fullsized":"2023-08-31T19:04:39.034940+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.007792+0000","last_change":"2023-08-31T19:04:38.551682+0000","last_active":"2023-08-31T19:04:39.007792+0000","last_peered":"2023-08-31T19:04:39.007792+0000","last_clean":"2023-08-31T19:04:39.007792+0000","last_became_active":"2023-08-31T19:04:38.551374+0000","last_became_peered":"2023-08-31T19:04:38.551374+0000","last_unstale":"2023-08-31T19:04:39.007792+0000","last_undegraded":"2023-08-31T19:04:39.007792+0000","last_fullsized":"2023-08-31T19:04:39.007792+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.031720+0000","last_change":"2023-08-31T19:04:39.025157+0000","last_active":"2023-08-31T19:04:39.031720+0000","last_peered":"2023-08-31T19:04:39.031720+0000","last_clean":"2023-08-31T19:04:39.031720+0000","last_became_active":"2023-08-31T19:04:39.024865+0000","last_became_peered":"2023-08-31T19:04:39.024865+0000","last_unstale":"2023-08-31T19:04:39.031720+0000","last_undegraded":"2023-08-31T19:04:39.031720+0000","last_fullsized":"2023-08-31T19:04:39.031720+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.006581+0000","last_change":"2023-08-31T19:04:38.557448+0000","last_active":"2023-08-31T19:04:39.006581+0000","last_peered":"2023-08-31T19:04:39.006581+0000","last_clean":"2023-08-31T19:04:39.006581+0000","last_became_active":"2023-08-31T19:04:38.555969+0000","last_became_peered":"2023-08-31T19:04:38.555969+0000","last_unstale":"2023-08-31T19:04:39.006581+0000","last_undegraded":"2023-08-31T19:04:39.006581+0000","last_fullsized":"2023-08-31T19:04:39.006581+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.024398+0000","last_change":"2023-08-31T19:04:39.021409+0000","last_active":"2023-08-31T19:04:39.024398+0000","last_peered":"2023-08-31T19:04:39.024398+0000","last_clean":"2023-08-31T19:04:39.024398+0000","last_became_active":"2023-08-31T19:04:39.020983+0000","last_became_peered":"2023-08-31T19:04:39.020983+0000","last_unstale":"2023-08-31T19:04:39.024398+0000","last_undegraded":"2023-08-31T19:04:39.024398+0000","last_fullsized":"2023-08-31T19:04:39.024398+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.001065+0000","last_change":"2023-08-31T19:04:38.548784+0000","last_active":"2023-08-31T19:04:39.001065+0000","last_peered":"2023-08-31T19:04:39.001065+0000","last_clean":"2023-08-31T19:04:39.001065+0000","last_became_active":"2023-08-31T19:04:38.548515+0000","last_became_peered":"2023-08-31T19:04:38.548515+0000","last_unstale":"2023-08-31T19:04:39.001065+0000","last_undegraded":"2023-08-31T19:04:39.001065+0000","last_fullsized":"2023-08-31T19:04:39.001065+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.035392+0000","last_change":"2023-08-31T19:04:39.032895+0000","last_active":"2023-08-31T19:04:39.035392+0000","last_peered":"2023-08-31T19:04:39.035392+0000","last_clean":"2023-08-31T19:04:39.035392+0000","last_became_active":"2023-08-31T19:04:39.032665+0000","last_became_peered":"2023-08-31T19:04:39.032665+0000","last_unstale":"2023-08-31T19:04:39.035392+0000","last_undegraded":"2023-08-31T19:04:39.035392+0000","last_fullsized":"2023-08-31T19:04:39.035392+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.006778+0000","last_change":"2023-08-31T19:04:38.556107+0000","last_active":"2023-08-31T19:04:39.006778+0000","last_peered":"2023-08-31T19:04:39.006778+0000","last_clean":"2023-08-31T19:04:39.006778+0000","last_became_active":"2023-08-31T19:04:38.555807+0000","last_became_peered":"2023-08-31T19:04:38.555807+0000","last_unstale":"2023-08-31T19:04:39.006778+0000","last_undegraded":"2023-08-31T19:04:39.006778+0000","last_fullsized":"2023-08-31T19:04:39.006778+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.031191+0000","last_change":"2023-08-31T19:04:39.028679+0000","last_active":"2023-08-31T19:04:39.031191+0000","last_peered":"2023-08-31T19:04:39.031191+0000","last_clean":"2023-08-31T19:04:39.031191+0000","last_became_active":"2023-08-31T19:04:39.028123+0000","last_became_peered":"2023-08-31T19:04:39.028123+0000","last_unstale":"2023-08-31T19:04:39.031191+0000","last_undegraded":"2023-08-31T19:04:39.031191+0000","last_fullsized":"2023-08-31T19:04:39.031191+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.009331+0000","last_change":"2023-08-31T19:04:38.560862+0000","last_active":"2023-08-31T19:04:39.009331+0000","last_peered":"2023-08-31T19:04:39.009331+0000","last_clean":"2023-08-31T19:04:39.009331+0000","last_became_active":"2023-08-31T19:04:38.560518+0000","last_became_peered":"2023-08-31T19:04:38.560518+0000","last_unstale":"2023-08-31T19:04:39.009331+0000","last_undegraded":"2023-08-31T19:04:39.009331+0000","last_fullsized":"2023-08-31T19:04:39.009331+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.030407+0000","last_change":"2023-08-31T19:04:39.026966+0000","last_active":"2023-08-31T19:04:39.030407+0000","last_peered":"2023-08-31T19:04:39.030407+0000","last_clean":"2023-08-31T19:04:39.030407+0000","last_became_active":"2023-08-31T19:04:39.026667+0000","last_became_peered":"2023-08-31T19:04:39.026667+0000","last_unstale":"2023-08-31T19:04:39.030407+0000","last_undegraded":"2023-08-31T19:04:39.030407+0000","last_fullsized":"2023-08-31T19:04:39.030407+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.001687+0000","last_change":"2023-08-31T19:04:38.549262+0000","last_active":"2023-08-31T19:04:39.001687+0000","last_peered":"2023-08-31T19:04:39.001687+0000","last_clean":"2023-08-31T19:04:39.001687+0000","last_became_active":"2023-08-31T19:04:38.548986+0000","last_became_peered":"2023-08-31T19:04:38.548986+0000","last_unstale":"2023-08-31T19:04:39.001687+0000","last_undegraded":"2023-08-31T19:04:39.001687+0000","last_fullsized":"2023-08-31T19:04:39.001687+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.031826+0000","last_change":"2023-08-31T19:04:39.015824+0000","last_active":"2023-08-31T19:04:39.031826+0000","last_peered":"2023-08-31T19:04:39.031826+0000","last_clean":"2023-08-31T19:04:39.031826+0000","last_became_active":"2023-08-31T19:04:39.015530+0000","last_became_peered":"2023-08-31T19:04:39.015530+0000","last_unstale":"2023-08-31T19:04:39.031826+0000","last_undegraded":"2023-08-31T19:04:39.031826+0000","last_fullsized":"2023-08-31T19:04:39.031826+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.005975+0000","last_change":"2023-08-31T19:04:38.556863+0000","last_active":"2023-08-31T19:04:39.005975+0000","last_peered":"2023-08-31T19:04:39.005975+0000","last_clean":"2023-08-31T19:04:39.005975+0000","last_became_active":"2023-08-31T19:04:38.556547+0000","last_became_peered":"2023-08-31T19:04:38.556547+0000","last_unstale":"2023-08-31T19:04:39.005975+0000","last_undegraded":"2023-08-31T19:04:39.005975+0000","last_fullsized":"2023-08-31T19:04:39.005975+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.031872+0000","last_change":"2023-08-31T19:04:39.019573+0000","last_active":"2023-08-31T19:04:39.031872+0000","last_peered":"2023-08-31T19:04:39.031872+0000","last_clean":"2023-08-31T19:04:39.031872+0000","last_became_active":"2023-08-31T19:04:39.019260+0000","last_became_peered":"2023-08-31T19:04:39.019260+0000","last_unstale":"2023-08-31T19:04:39.031872+0000","last_undegraded":"2023-08-31T19:04:39.031872+0000","last_fullsized":"2023-08-31T19:04:39.031872+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.022592+0000","last_change":"2023-08-31T19:04:38.560196+0000","last_active":"2023-08-31T19:04:39.022592+0000","last_peered":"2023-08-31T19:04:39.022592+0000","last_clean":"2023-08-31T19:04:39.022592+0000","last_became_active":"2023-08-31T19:04:38.559886+0000","last_became_peered":"2023-08-31T19:04:38.559886+0000","last_unstale":"2023-08-31T19:04:39.022592+0000","last_undegraded":"2023-08-31T19:04:39.022592+0000","last_fullsized":"2023-08-31T19:04:39.022592+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.007880+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:04:39.007880+0000","last_peered":"2023-08-31T19:04:39.007880+0000","last_clean":"2023-08-31T19:04:39.007880+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:04:39.007880+0000","last_undegraded":"2023-08-31T19:04:39.007880+0000","last_fullsized":"2023-08-31T19:04:39.007880+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.034796+0000","last_change":"2023-08-31T19:04:39.029535+0000","last_active":"2023-08-31T19:04:39.034796+0000","last_peered":"2023-08-31T19:04:39.034796+0000","last_clean":"2023-08-31T19:04:39.034796+0000","last_became_active":"2023-08-31T19:04:39.028723+0000","last_became_peered":"2023-08-31T19:04:39.028723+0000","last_unstale":"2023-08-31T19:04:39.034796+0000","last_undegraded":"2023-08-31T19:04:39.034796+0000","last_fullsized":"2023-08-31T19:04:39.034796+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.006363+0000","last_change":"2023-08-31T19:04:38.544720+0000","last_active":"2023-08-31T19:04:39.006363+0000","last_peered":"2023-08-31T19:04:39.006363+0000","last_clean":"2023-08-31T19:04:39.006363+0000","last_became_active":"2023-08-31T19:04:38.544388+0000","last_became_peered":"2023-08-31T19:04:38.544388+0000","last_unstale":"2023-08-31T19:04:39.006363+0000","last_undegraded":"2023-08-31T19:04:39.006363+0000","last_fullsized":"2023-08-31T19:04:39.006363+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":90,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.009422+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:04:39.009422+0000","last_peered":"2023-08-31T19:04:39.009422+0000","last_clean":"2023-08-31T19:04:39.009422+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:04:39.009422+0000","last_undegraded":"2023-08-31T19:04:39.009422+0000","last_fullsized":"2023-08-31T19:04:39.009422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.019125+0000","last_change":"2023-08-31T19:04:39.014163+0000","last_active":"2023-08-31T19:04:39.019125+0000","last_peered":"2023-08-31T19:04:39.019125+0000","last_clean":"2023-08-31T19:04:39.019125+0000","last_became_active":"2023-08-31T19:04:39.013800+0000","last_became_peered":"2023-08-31T19:04:39.013800+0000","last_unstale":"2023-08-31T19:04:39.019125+0000","last_undegraded":"2023-08-31T19:04:39.019125+0000","last_fullsized":"2023-08-31T19:04:39.019125+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"108'2","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.023397+0000","last_change":"2023-08-31T19:04:38.553087+0000","last_active":"2023-08-31T19:04:39.023397+0000","last_peered":"2023-08-31T19:04:39.023397+0000","last_clean":"2023-08-31T19:04:39.023397+0000","last_became_active":"2023-08-31T19:04:38.552745+0000","last_became_peered":"2023-08-31T19:04:38.552745+0000","last_unstale":"2023-08-31T19:04:39.023397+0000","last_undegraded":"2023-08-31T19:04:39.023397+0000","last_fullsized":"2023-08-31T19:04:39.023397+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.011076+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:04:39.011076+0000","last_peered":"2023-08-31T19:04:39.011076+0000","last_clean":"2023-08-31T19:04:39.011076+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:04:39.011076+0000","last_undegraded":"2023-08-31T19:04:39.011076+0000","last_fullsized":"2023-08-31T19:04:39.011076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.022720+0000","last_change":"2023-08-31T19:04:39.018109+0000","last_active":"2023-08-31T19:04:39.022720+0000","last_peered":"2023-08-31T19:04:39.022720+0000","last_clean":"2023-08-31T19:04:39.022720+0000","last_became_active":"2023-08-31T19:04:39.017740+0000","last_became_peered":"2023-08-31T19:04:39.017740+0000","last_unstale":"2023-08-31T19:04:39.022720+0000","last_undegraded":"2023-08-31T19:04:39.022720+0000","last_fullsized":"2023-08-31T19:04:39.022720+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.007799+0000","last_change":"2023-08-31T19:04:38.548724+0000","last_active":"2023-08-31T19:04:39.007799+0000","last_peered":"2023-08-31T19:04:39.007799+0000","last_clean":"2023-08-31T19:04:39.007799+0000","last_became_active":"2023-08-31T19:04:38.548460+0000","last_became_peered":"2023-08-31T19:04:38.548460+0000","last_unstale":"2023-08-31T19:04:39.007799+0000","last_undegraded":"2023-08-31T19:04:39.007799+0000","last_fullsized":"2023-08-31T19:04:39.007799+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.009621+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:04:39.009621+0000","last_peered":"2023-08-31T19:04:39.009621+0000","last_clean":"2023-08-31T19:04:39.009621+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:04:39.009621+0000","last_undegraded":"2023-08-31T19:04:39.009621+0000","last_fullsized":"2023-08-31T19:04:39.009621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":91,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.005968+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:04:39.005968+0000","last_peered":"2023-08-31T19:04:39.005968+0000","last_clean":"2023-08-31T19:04:39.005968+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:04:39.005968+0000","last_undegraded":"2023-08-31T19:04:39.005968+0000","last_fullsized":"2023-08-31T19:04:39.005968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.032217+0000","last_change":"2023-08-31T19:04:39.026127+0000","last_active":"2023-08-31T19:04:39.032217+0000","last_peered":"2023-08-31T19:04:39.032217+0000","last_clean":"2023-08-31T19:04:39.032217+0000","last_became_active":"2023-08-31T19:04:39.025699+0000","last_became_peered":"2023-08-31T19:04:39.025699+0000","last_unstale":"2023-08-31T19:04:39.032217+0000","last_undegraded":"2023-08-31T19:04:39.032217+0000","last_fullsized":"2023-08-31T19:04:39.032217+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"108'1","reported_seq":11,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.023486+0000","last_change":"2023-08-31T19:04:38.554306+0000","last_active":"2023-08-31T19:04:39.023486+0000","last_peered":"2023-08-31T19:04:39.023486+0000","last_clean":"2023-08-31T19:04:39.023486+0000","last_became_active":"2023-08-31T19:04:38.553934+0000","last_became_peered":"2023-08-31T19:04:38.553934+0000","last_unstale":"2023-08-31T19:04:39.023486+0000","last_undegraded":"2023-08-31T19:04:39.023486+0000","last_fullsized":"2023-08-31T19:04:39.023486+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.006064+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:04:39.006064+0000","last_peered":"2023-08-31T19:04:39.006064+0000","last_clean":"2023-08-31T19:04:39.006064+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:04:39.006064+0000","last_undegraded":"2023-08-31T19:04:39.006064+0000","last_fullsized":"2023-08-31T19:04:39.006064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.022489+0000","last_change":"2023-08-31T19:04:39.012080+0000","last_active":"2023-08-31T19:04:39.022489+0000","last_peered":"2023-08-31T19:04:39.022489+0000","last_clean":"2023-08-31T19:04:39.022489+0000","last_became_active":"2023-08-31T19:04:39.011767+0000","last_became_peered":"2023-08-31T19:04:39.011767+0000","last_unstale":"2023-08-31T19:04:39.022489+0000","last_undegraded":"2023-08-31T19:04:39.022489+0000","last_fullsized":"2023-08-31T19:04:39.022489+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.009767+0000","last_change":"2023-08-31T19:04:38.556242+0000","last_active":"2023-08-31T19:04:39.009767+0000","last_peered":"2023-08-31T19:04:39.009767+0000","last_clean":"2023-08-31T19:04:39.009767+0000","last_became_active":"2023-08-31T19:04:38.555643+0000","last_became_peered":"2023-08-31T19:04:38.555643+0000","last_unstale":"2023-08-31T19:04:39.009767+0000","last_undegraded":"2023-08-31T19:04:39.009767+0000","last_fullsized":"2023-08-31T19:04:39.009767+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":90,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.006736+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:04:39.006736+0000","last_peered":"2023-08-31T19:04:39.006736+0000","last_clean":"2023-08-31T19:04:39.006736+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:04:39.006736+0000","last_undegraded":"2023-08-31T19:04:39.006736+0000","last_fullsized":"2023-08-31T19:04:39.006736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.031550+0000","last_change":"2023-08-31T19:04:39.026455+0000","last_active":"2023-08-31T19:04:39.031550+0000","last_peered":"2023-08-31T19:04:39.031550+0000","last_clean":"2023-08-31T19:04:39.031550+0000","last_became_active":"2023-08-31T19:04:39.026139+0000","last_became_peered":"2023-08-31T19:04:39.026139+0000","last_unstale":"2023-08-31T19:04:39.031550+0000","last_undegraded":"2023-08-31T19:04:39.031550+0000","last_fullsized":"2023-08-31T19:04:39.031550+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.010291+0000","last_change":"2023-08-31T19:04:38.559534+0000","last_active":"2023-08-31T19:04:39.010291+0000","last_peered":"2023-08-31T19:04:39.010291+0000","last_clean":"2023-08-31T19:04:39.010291+0000","last_became_active":"2023-08-31T19:04:38.559240+0000","last_became_peered":"2023-08-31T19:04:38.559240+0000","last_unstale":"2023-08-31T19:04:39.010291+0000","last_undegraded":"2023-08-31T19:04:39.010291+0000","last_fullsized":"2023-08-31T19:04:39.010291+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.006675+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:04:39.006675+0000","last_peered":"2023-08-31T19:04:39.006675+0000","last_clean":"2023-08-31T19:04:39.006675+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:04:39.006675+0000","last_undegraded":"2023-08-31T19:04:39.006675+0000","last_fullsized":"2023-08-31T19:04:39.006675+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.031889+0000","last_change":"2023-08-31T19:04:39.025149+0000","last_active":"2023-08-31T19:04:39.031889+0000","last_peered":"2023-08-31T19:04:39.031889+0000","last_clean":"2023-08-31T19:04:39.031889+0000","last_became_active":"2023-08-31T19:04:39.024812+0000","last_became_peered":"2023-08-31T19:04:39.024812+0000","last_unstale":"2023-08-31T19:04:39.031889+0000","last_undegraded":"2023-08-31T19:04:39.031889+0000","last_fullsized":"2023-08-31T19:04:39.031889+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:38.524800+0000","last_clean_scrub_stamp":"2023-08-31T19:04:38.524800+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.009367+0000","last_change":"2023-08-31T19:04:38.549288+0000","last_active":"2023-08-31T19:04:39.009367+0000","last_peered":"2023-08-31T19:04:39.009367+0000","last_clean":"2023-08-31T19:04:39.009367+0000","last_became_active":"2023-08-31T19:04:38.549003+0000","last_became_peered":"2023-08-31T19:04:38.549003+0000","last_unstale":"2023-08-31T19:04:39.009367+0000","last_undegraded":"2023-08-31T19:04:39.009367+0000","last_fullsized":"2023-08-31T19:04:39.009367+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:04:37.518762+0000","last_clean_scrub_stamp":"2023-08-31T19:04:37.518762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":108,"state":"active+clean","last_fresh":"2023-08-31T19:04:39.001420+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:04:39.001420+0000","last_peered":"2023-08-31T19:04:39.001420+0000","last_clean":"2023-08-31T19:04:39.001420+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:04:39.001420+0000","last_undegraded":"2023-08-31T19:04:39.001420+0000","last_fullsized":"2023-08-31T19:04:39.001420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575050,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302508,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069332,"statfs":{"total":96636764160,"available":96326995968,"internally_reserved":0,"allocated":1347584,"data_stored":702465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:04:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.47799999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.75900000000000001},"min":{"1min":0.439,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:04:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67500000000000004,"15min":0.70399999999999996},"min":{"1min":0.42499999999999999,"5min":0.40699999999999997,"15min":0.40000000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67100000000000004,"15min":0.68400000000000005},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.36199999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:04:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.70699999999999996},"min":{"1min":0.442,"5min":0.39600000000000002,"15min":0.39300000000000002},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72799999999999998,"15min":0.73099999999999998},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.41199999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.054},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:04:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70099999999999996,"15min":0.71999999999999997},"min":{"1min":0.505,"5min":0.432,"15min":0.432},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.54900000000000004,"5min":0.52200000000000002,"15min":0.51000000000000001},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:04:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.40600000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80400000000000005,"5min":0.83799999999999997,"15min":0.97899999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.56899999999999995,"5min":0.432,"15min":0.432},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.004},"last":0.746}]},{"osd":5,"last update":"Thu Aug 31 19:04:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65900000000000003,"15min":0.66800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90500000000000003,"5min":1.139,"15min":1.139},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.495,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":1.048},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:04:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67200000000000004,"15min":0.67700000000000005},"min":{"1min":0.55400000000000005,"5min":0.46300000000000002,"15min":0.45600000000000002},"max":{"1min":0.85199999999999998,"5min":0.93100000000000005,"15min":1.0740000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69599999999999995,"15min":0.69699999999999995},"min":{"1min":0.52000000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.024,"5min":1.038,"15min":1.071},"last":0.78500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575049,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302520,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069320,"statfs":{"total":96636764160,"available":96326983680,"internally_reserved":0,"allocated":1359872,"data_stored":704521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67400000000000004,"15min":0.70699999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86199999999999999,"5min":0.92000000000000004,"15min":1.0189999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67400000000000004,"15min":0.70299999999999996},"min":{"1min":0.434,"5min":0.371,"15min":0.371},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.66100000000000003,"15min":0.70099999999999996},"min":{"1min":0.47999999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71099999999999997,"15min":0.72299999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.71099999999999997,"15min":0.73299999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.129},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.498,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95299999999999996,"5min":0.98899999999999999,"15min":1.3260000000000001},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69799999999999995,"15min":0.71299999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.018},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72799999999999998,"15min":0.749},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.49399999999999999},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Aug 31 19:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.622,"15min":0.61699999999999999},"min":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.40999999999999998},"max":{"1min":0.86699999999999999,"5min":0.94299999999999995,"15min":0.96599999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65100000000000002,"15min":0.63500000000000001},"min":{"1min":0.432,"5min":0.39000000000000001,"15min":0.371},"max":{"1min":0.81599999999999995,"5min":1.0880000000000001,"15min":1.091},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67200000000000004,"15min":0.66500000000000004},"min":{"1min":0.45900000000000002,"5min":0.44400000000000001,"15min":0.39800000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70099999999999996,"15min":0.70699999999999996},"min":{"1min":0.47499999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0349999999999999,"5min":1.0669999999999999,"15min":1.0700000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.69899999999999995},"min":{"1min":0.505,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94099999999999995,"5min":1.012,"15min":1.0620000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.74399999999999999,"15min":0.746},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.80400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575050,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":702409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:04:22 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42599999999999999,"15min":0.44500000000000001},"min":{"1min":0.311,"5min":0.27300000000000002,"15min":0.26100000000000001},"max":{"1min":0.503,"5min":0.70999999999999996,"15min":0.81000000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.46400000000000002,"15min":0.47299999999999998},"min":{"1min":0.36299999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56999999999999995,"5min":0.68000000000000005,"15min":0.752},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Aug 31 19:04:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.497,"15min":0.51000000000000001},"min":{"1min":0.36699999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59399999999999997,"5min":0.78000000000000003,"15min":0.82699999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55800000000000005,"15min":0.57599999999999996},"min":{"1min":0.40699999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.65500000000000003,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63}]},{"osd":3,"last update":"Thu Aug 31 19:04:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53800000000000003,"15min":0.55400000000000005},"min":{"1min":0.39100000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77400000000000002,"5min":0.79000000000000004,"15min":0.82199999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.48799999999999999,"15min":0.50900000000000001},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.32500000000000001},"max":{"1min":0.60399999999999998,"5min":0.67300000000000004,"15min":0.72299999999999998},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:04:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.748,"15min":0.78000000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.997,"5min":1.1739999999999999,"15min":1.2110000000000001},"last":1.028},{"interface":"front","average":{"1min":0.755,"5min":0.79000000000000004,"15min":0.81200000000000006},"min":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.93600000000000005,"5min":1.1379999999999999,"15min":1.3},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:04:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72899999999999998,"15min":0.76700000000000002},"min":{"1min":0.55200000000000005,"5min":0.497,"15min":0.47299999999999998},"max":{"1min":0.97199999999999998,"5min":1.0309999999999999,"15min":1.4119999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.75700000000000001,"15min":0.77100000000000002},"min":{"1min":0.55400000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85899999999999999,"5min":1.1040000000000001,"15min":1.2310000000000001},"last":1.123}]},{"osd":6,"last update":"Thu Aug 31 19:04:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72799999999999998,"15min":0.76300000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.84299999999999997,"5min":1.1080000000000001,"15min":1.1990000000000001},"last":0.752},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76900000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.51500000000000001,"15min":0.501},"max":{"1min":0.95399999999999996,"5min":1.167,"15min":1.2629999999999999},"last":1.0820000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:04:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.58999999999999997,"5min":0.54600000000000004,"15min":0.51900000000000002},"max":{"1min":0.98499999999999999,"5min":1.1120000000000001,"15min":1.113},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.76200000000000001,"15min":0.79000000000000004},"min":{"1min":0.54000000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.878,"5min":1.1000000000000001,"15min":1.3320000000000001},"last":0.83499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575049,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302508,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069332,"statfs":{"total":96636764160,"available":96326995968,"internally_reserved":0,"allocated":1347584,"data_stored":695943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:04:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.442,"15min":0.442},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.78400000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.48299999999999998,"15min":0.49099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30399999999999999},"max":{"1min":0.65300000000000002,"5min":0.876,"15min":0.876},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:04:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.499,"15min":0.505},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.74299999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.51500000000000001,"15min":0.52800000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.58799999999999997,"5min":1.018,"15min":1.018},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:04:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.63500000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.36599999999999999},"max":{"1min":0.76400000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:04:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.81299999999999994,"15min":0.82099999999999995},"min":{"1min":0.56299999999999994,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0489999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.5},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79900000000000004,"15min":0.81699999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.95599999999999996,"5min":1.1890000000000001,"15min":1.276},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:04:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74399999999999999,"15min":0.753},"min":{"1min":0.503,"5min":0.5,"15min":0.5},"max":{"1min":0.97299999999999998,"5min":1.155,"15min":1.155},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.84399999999999997,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:04:16 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.80500000000000005,"15min":0.80800000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.101,"5min":1.1060000000000001,"15min":1.3280000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.53500000000000003},"max":{"1min":1.032,"5min":1.196,"15min":1.2350000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:04:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.81599999999999995,"15min":0.82199999999999995},"min":{"1min":0.58599999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95599999999999996,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82599999999999996,"15min":0.83599999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0649999999999999,"5min":1.548,"15min":1.548},"last":0.67000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575049,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":702409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.27800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.53200000000000003,"5min":0.77600000000000002,"15min":0.90200000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.47099999999999997,"15min":0.48799999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.55900000000000005,"5min":0.70099999999999996,"15min":1.5900000000000001},"last":0.438}]},{"osd":1,"last update":"Thu Aug 31 19:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.497,"15min":0.503},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.63500000000000001,"5min":0.72199999999999998,"15min":0.96599999999999997},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.52200000000000002,"15min":0.53500000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.63100000000000001,"5min":0.748,"15min":1.288},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.49399999999999999,"15min":0.50700000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":1.022},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.53900000000000003,"15min":0.55700000000000005},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.58899999999999997,"5min":0.71199999999999997,"15min":0.97399999999999998},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Aug 31 19:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.755,"15min":0.78500000000000003},"min":{"1min":0.54300000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.93400000000000005,"5min":1.173,"15min":1.208},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.75900000000000001,"15min":0.80000000000000004},"min":{"1min":0.59299999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.91300000000000003,"5min":1.155,"15min":1.464},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.50600000000000001,"5min":0.499,"15min":0.499},"max":{"1min":0.96699999999999997,"5min":1.2,"15min":1.361},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.754,"15min":0.79300000000000004},"min":{"1min":0.55900000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.03,"5min":1.1020000000000001,"15min":1.3},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78200000000000003,"15min":0.81200000000000006},"min":{"1min":0.58599999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.95499999999999996,"5min":1.238,"15min":1.51},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77500000000000002,"15min":0.80900000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.97499999999999998,"5min":1.1579999999999999,"15min":1.4359999999999999},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77900000000000003,"15min":0.81399999999999995},"min":{"1min":0.55700000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.91400000000000003,"5min":1.3100000000000001,"15min":1.55},"last":0.746},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.82399999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.018,"5min":1.1160000000000001,"15min":1.387},"last":0.67900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575049,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302508,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069332,"statfs":{"total":96636764160,"available":96326995968,"internally_reserved":0,"allocated":1347584,"data_stored":703371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:04:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.57999999999999996,"15min":0.48199999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.60199999999999998,"5min":14.099,"15min":14.099},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.71799999999999997,"15min":0.56000000000000005},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.622,"5min":24.879999999999999,"15min":24.879999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:04:14 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46500000000000002,"15min":0.45500000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.76200000000000001,"5min":0.79600000000000004,"15min":0.90700000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.625,"15min":0.54400000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28799999999999998},"max":{"1min":0.66500000000000004,"5min":14.143000000000001,"15min":14.143000000000001},"last":0.432}]},{"osd":2,"last update":"Thu Aug 31 19:04:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.56799999999999995,"15min":0.58299999999999996},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.38100000000000001},"max":{"1min":0.69399999999999995,"5min":0.94999999999999996,"15min":1.407},"last":0.496},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.70699999999999996,"15min":0.65200000000000002},"min":{"1min":0.437,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71299999999999997,"5min":12.464,"15min":12.464},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:04:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.93700000000000006,"15min":0.81699999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.018,"5min":21.475999999999999,"15min":21.475999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.47699999999999998},"max":{"1min":1.0509999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:04:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73499999999999999,"15min":0.75900000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48199999999999998},"max":{"1min":1.109,"5min":1.139,"15min":1.3220000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.85399999999999998,"15min":0.80500000000000005},"min":{"1min":0.55700000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.083,"5min":12.509,"15min":12.509},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Aug 31 19:04:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.876,"15min":0.81699999999999995},"min":{"1min":0.54700000000000004,"5min":0.53400000000000003,"15min":0.52000000000000002},"max":{"1min":1.0329999999999999,"5min":12.426,"15min":12.426},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":1.0089999999999999,"15min":0.85799999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.50600000000000001},"max":{"1min":0.95299999999999996,"5min":24.920000000000002,"15min":24.920000000000002},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:04:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.995,"15min":0.86099999999999999},"min":{"1min":0.57299999999999995,"5min":0.51300000000000001,"15min":0.495},"max":{"1min":1.0640000000000001,"5min":21.521000000000001,"15min":21.521000000000001},"last":0.625},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.1499999999999999,"5min":1.232,"15min":1.232},"last":0.61399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575049,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302496,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069344,"statfs":{"total":96636764160,"available":96327008256,"internally_reserved":0,"allocated":1335296,"data_stored":695749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.67400000000000004,"15min":0.69499999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":0.98499999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.67000000000000004,"15min":0.69899999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.80800000000000005,"5min":0.92900000000000005,"15min":0.93400000000000005},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69499999999999995,"15min":0.71299999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.006},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.68999999999999995,"15min":0.71399999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83999999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Aug 31 19:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.006,"5min":1.042,"15min":1.044},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.72799999999999998},"min":{"1min":0.49399999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85999999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.69199999999999995,"15min":0.71399999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83899999999999997,"5min":1.01,"15min":1.01},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.52900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.95799999999999996,"5min":1.012,"15min":1.081},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.39800000000000002},"max":{"1min":1.0149999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.624},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86199999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.46000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0069999999999999,"5min":1.163,"15min":1.163},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69699999999999995,"15min":0.68899999999999995},"min":{"1min":0.50800000000000001,"5min":0.47599999999999998,"15min":0.441},"max":{"1min":0.95599999999999996,"5min":1.133,"15min":1.133},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.50600000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.88600000000000001,"5min":1.147,"15min":1.147},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.73299999999999998,"15min":0.72399999999999998},"min":{"1min":0.48899999999999999,"5min":0.48199999999999998,"15min":0.45200000000000001},"max":{"1min":1.0489999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575049,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1339392,"data_stored":702409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:04:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.40899999999999997},"max":{"1min":0.83799999999999997,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.80200000000000005,"5min":3.548,"15min":3.548},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:04:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.84899999999999998,"15min":0.76700000000000002},"min":{"1min":0.46100000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78000000000000003,"5min":16.744,"15min":16.744},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86599999999999999,"5min":3.6299999999999999,"15min":3.6299999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:04:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98899999999999999,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.745,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.45200000000000001},"max":{"1min":0.85399999999999998,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":0.73799999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:04:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88,"5min":1.327,"15min":2.0070000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.48999999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.75600000000000001,"5min":2.823,"15min":2.823},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:04:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.68700000000000006,"15min":0.64900000000000002},"min":{"1min":0.45300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83299999999999996,"5min":7.3739999999999997,"15min":7.3739999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66500000000000004,"15min":0.65400000000000003},"min":{"1min":0.499,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":0.94999999999999996,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Aug 31 19:04:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66800000000000004,"15min":0.65800000000000003},"min":{"1min":0.48799999999999999,"5min":0.45300000000000001,"15min":0.39100000000000001},"max":{"1min":0.91100000000000003,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.76600000000000001,"15min":0.72299999999999998},"min":{"1min":0.58099999999999996,"5min":0.443,"15min":0.441},"max":{"1min":0.97199999999999998,"5min":7.4139999999999997,"15min":7.4139999999999997},"last":0.81200000000000006}]},{"osd":7,"last update":"Thu Aug 31 19:04:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.46100000000000002},"max":{"1min":0.97199999999999998,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":0.627},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.72899999999999998},"min":{"1min":0.54500000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91700000000000004,"5min":2.786,"15min":2.786},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:04:43.724 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T19:04:43.724 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-31T19:04:43.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.952+0000 7ff7f69ff700 1 Processor -- start 2023-08-31T19:04:43.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.952+0000 7ff7f69ff700 1 -- start start 2023-08-31T19:04:43.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.953+0000 7ff7f69ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7f00aa450 0x7ff7f0154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.953+0000 7ff7f69ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f0158a90 con 0x7ff7f0153e20 2023-08-31T19:04:43.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.953+0000 7ff7f69ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f0157e80 con 0x7ff7f0063980 2023-08-31T19:04:43.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.953+0000 7ff7f69ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f0157c70 con 0x7ff7f00aa450 2023-08-31T19:04:43.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.953+0000 7ff7f4f9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7f00aa450 0x7ff7f0154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:43.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.953+0000 7ff7effff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff7f0153e20 0x7ff7f0063270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33670/0 (socket says 172.21.15.72:33670) 2023-08-31T19:04:43.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.954+0000 7ff7effff700 1 -- 172.21.15.72:0/3547021947 learned_addr learned my addr 172.21.15.72:0/3547021947 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:43.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.954+0000 7ff7f4f9c700 1 -- 172.21.15.72:0/3547021947 >> v1:172.21.15.146:6789/0 conn(0x7ff7f0063980 legacy=0x7ff7f00a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.954+0000 7ff7f4f9c700 1 -- 172.21.15.72:0/3547021947 >> v1:172.21.15.72:6789/0 conn(0x7ff7f0153e20 legacy=0x7ff7f0063270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.954+0000 7ff7f4f9c700 1 -- 172.21.15.72:0/3547021947 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0158160 con 0x7ff7f00aa450 2023-08-31T19:04:43.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.954+0000 7ff7eeffd700 1 -- 172.21.15.72:0/3547021947 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593144972 0 0) 0x7ff7f0158a90 con 0x7ff7f0153e20 2023-08-31T19:04:43.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.954+0000 7ff7f4f9c700 1 --2- 172.21.15.72:0/3547021947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f00aa450 0x7ff7f0154200 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7ff7f0157db0 tx=0x7ff7e8009780).ready entity=mon.0 client_cookie=7f6427e793610bfb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:43.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.954+0000 7ff7eeffd700 1 -- 172.21.15.72:0/3547021947 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e800e070 con 0x7ff7f00aa450 2023-08-31T19:04:43.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.954+0000 7ff7eeffd700 1 -- 172.21.15.72:0/3547021947 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e800bc30 con 0x7ff7f00aa450 2023-08-31T19:04:43.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.954+0000 7ff7eeffd700 1 -- 172.21.15.72:0/3547021947 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8012410 con 0x7ff7f00aa450 2023-08-31T19:04:43.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.955+0000 7ff7f69ff700 1 -- 172.21.15.72:0/3547021947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f00aa450 msgr2=0x7ff7f0154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.955+0000 7ff7f69ff700 1 --2- 172.21.15.72:0/3547021947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f00aa450 0x7ff7f0154200 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7ff7f0157db0 tx=0x7ff7e8009780).stop 2023-08-31T19:04:43.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.955+0000 7ff7f69ff700 1 -- 172.21.15.72:0/3547021947 shutdown_connections 2023-08-31T19:04:43.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.955+0000 7ff7f69ff700 1 --2- 172.21.15.72:0/3547021947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f00aa450 0x7ff7f0154200 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:43.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.955+0000 7ff7f69ff700 1 -- 172.21.15.72:0/3547021947 >> 172.21.15.72:0/3547021947 conn(0x7ff7f005eb60 msgr2=0x7ff7f00cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:43.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.955+0000 7ff7f69ff700 1 -- 172.21.15.72:0/3547021947 shutdown_connections 2023-08-31T19:04:43.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.955+0000 7ff7f69ff700 1 -- 172.21.15.72:0/3547021947 wait complete. 2023-08-31T19:04:43.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.956+0000 7ff7f69ff700 1 Processor -- start 2023-08-31T19:04:43.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.957+0000 7ff7f69ff700 1 -- start start 2023-08-31T19:04:43.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7f69ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f0063980 0x7ff7f0151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7f69ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7f00aa450 0x7ff7f014e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7f69ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7f0153e20 0x7ff7f0064670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7f69ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f0152b20 con 0x7ff7f0063980 2023-08-31T19:04:43.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7f69ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f0151320 con 0x7ff7f0153e20 2023-08-31T19:04:43.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7f69ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f0150710 con 0x7ff7f00aa450 2023-08-31T19:04:43.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7effff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f0063980 0x7ff7f0151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:43.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7effff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f0063980 0x7ff7f0151f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35070/0 (socket says 172.21.15.72:35070) 2023-08-31T19:04:43.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7effff700 1 -- 172.21.15.72:0/2459345524 learned_addr learned my addr 172.21.15.72:0/2459345524 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:43.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7f4f9c700 1 --2- 172.21.15.72:0/2459345524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7f0153e20 0x7ff7f0064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:43.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7ef7fe700 1 --2- 172.21.15.72:0/2459345524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7f00aa450 0x7ff7f014e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:43.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7effff700 1 -- 172.21.15.72:0/2459345524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7f00aa450 msgr2=0x7ff7f014e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7effff700 1 --2- 172.21.15.72:0/2459345524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7f00aa450 0x7ff7f014e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:43.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7effff700 1 -- 172.21.15.72:0/2459345524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7f0153e20 msgr2=0x7ff7f0064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:43.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7effff700 1 --2- 172.21.15.72:0/2459345524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7f0153e20 0x7ff7f0064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:43.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7effff700 1 -- 172.21.15.72:0/2459345524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8009a20 con 0x7ff7f0063980 2023-08-31T19:04:43.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.958+0000 7ff7effff700 1 --2- 172.21.15.72:0/2459345524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f0063980 0x7ff7f0151f60 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7ff7e000c490 tx=0x7ff7e0007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:43.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.959+0000 7ff7d7fff700 1 -- 172.21.15.72:0/2459345524 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00070d0 con 0x7ff7f0063980 2023-08-31T19:04:43.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.959+0000 7ff7d7fff700 1 -- 172.21.15.72:0/2459345524 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e0007230 con 0x7ff7f0063980 2023-08-31T19:04:43.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.959+0000 7ff7d7fff700 1 -- 172.21.15.72:0/2459345524 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00075f0 con 0x7ff7f0063980 2023-08-31T19:04:43.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.959+0000 7ff7f69ff700 1 -- 172.21.15.72:0/2459345524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f01509f0 con 0x7ff7f0063980 2023-08-31T19:04:43.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.959+0000 7ff7f69ff700 1 -- 172.21.15.72:0/2459345524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f0150fb0 con 0x7ff7f0063980 2023-08-31T19:04:43.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.960+0000 7ff7f69ff700 1 -- 172.21.15.72:0/2459345524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f01641e0 con 0x7ff7f0063980 2023-08-31T19:04:43.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.961+0000 7ff7d7fff700 1 -- 172.21.15.72:0/2459345524 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff7e0005bc0 con 0x7ff7f0063980 2023-08-31T19:04:43.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.961+0000 7ff7d7fff700 1 --2- 172.21.15.72:0/2459345524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff7dc05ef30 0x7ff7dc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:43.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.962+0000 7ff7d7fff700 1 -- 172.21.15.72:0/2459345524 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7ff7e0079a70 con 0x7ff7f0063980 2023-08-31T19:04:43.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.962+0000 7ff7ef7fe700 1 --2- 172.21.15.72:0/2459345524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff7dc05ef30 0x7ff7dc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:43.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.962+0000 7ff7ef7fe700 1 --2- 172.21.15.72:0/2459345524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff7dc05ef30 0x7ff7dc0613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff7f014f6a0 tx=0x7ff7e4007d40).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:43.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:43.965+0000 7ff7d7fff700 1 -- 172.21.15.72:0/2459345524 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff7e004aa80 con 0x7ff7f0063980 2023-08-31T19:04:44.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.198+0000 7ff7f69ff700 1 -- 172.21.15.72:0/2459345524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff7f006c6b0 con 0x7ff7f0063980 2023-08-31T19:04:44.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.204+0000 7ff7d7fff700 1 -- 172.21.15.72:0/2459345524 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff7e004e0a0 con 0x7ff7f0063980 2023-08-31T19:04:44.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.206+0000 7ff7f69ff700 1 -- 172.21.15.72:0/2459345524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff7dc05ef30 msgr2=0x7ff7dc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:44.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.206+0000 7ff7f69ff700 1 --2- 172.21.15.72:0/2459345524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff7dc05ef30 0x7ff7dc0613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff7f014f6a0 tx=0x7ff7e4007d40).stop 2023-08-31T19:04:44.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.206+0000 7ff7f69ff700 1 -- 172.21.15.72:0/2459345524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f0063980 msgr2=0x7ff7f0151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:44.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.206+0000 7ff7f69ff700 1 --2- 172.21.15.72:0/2459345524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f0063980 0x7ff7f0151f60 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7ff7e000c490 tx=0x7ff7e0007e40).stop 2023-08-31T19:04:44.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.206+0000 7ff7f69ff700 1 -- 172.21.15.72:0/2459345524 shutdown_connections 2023-08-31T19:04:44.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.206+0000 7ff7f69ff700 1 --2- 172.21.15.72:0/2459345524 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff7dc05ef30 0x7ff7dc0613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:44.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.206+0000 7ff7f69ff700 1 --2- 172.21.15.72:0/2459345524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7f0153e20 0x7ff7f0064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:44.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.206+0000 7ff7f69ff700 1 --2- 172.21.15.72:0/2459345524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7f0063980 0x7ff7f0151f60 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:44.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.206+0000 7ff7f69ff700 1 --2- 172.21.15.72:0/2459345524 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff7f00aa450 0x7ff7f014e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:44.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.206+0000 7ff7f69ff700 1 -- 172.21.15.72:0/2459345524 >> 172.21.15.72:0/2459345524 conn(0x7ff7f005eb60 msgr2=0x7ff7f00ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:44.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.206+0000 7ff7f69ff700 1 -- 172.21.15.72:0/2459345524 shutdown_connections 2023-08-31T19:04:44.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.206+0000 7ff7f69ff700 1 -- 172.21.15.72:0/2459345524 wait complete. 2023-08-31T19:04:44.209 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-08-31T19:04:44.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:04:44.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.411+0000 7fef6a3ff700 1 Processor -- start 2023-08-31T19:04:44.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.411+0000 7fef6a3ff700 1 -- start start 2023-08-31T19:04:44.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.413+0000 7fef6a3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef64154060 0x7fef64157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:44.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.413+0000 7fef6a3ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef641588d0 0x7fef64154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:44.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.413+0000 7fef6a3ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef640c6120 con 0x7fef640cb9b0 2023-08-31T19:04:44.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.413+0000 7fef6a3ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef640c1380 con 0x7fef641588d0 2023-08-31T19:04:44.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.413+0000 7fef6a3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef640c5e10 con 0x7fef64154060 2023-08-31T19:04:44.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.414+0000 7fef6899c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fef641588d0 0x7fef64154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:44.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.414+0000 7fef63fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef64154060 0x7fef64157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:44.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.414+0000 7fef63fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef64154060 0x7fef64157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:48288/0 (socket says 172.21.15.72:48288) 2023-08-31T19:04:44.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.414+0000 7fef63fff700 1 -- 172.21.15.72:0/3977166478 learned_addr learned my addr 172.21.15.72:0/3977166478 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:44.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.414+0000 7fef63fff700 1 -- 172.21.15.72:0/3977166478 >> v2:172.21.15.146:3300/0 conn(0x7fef641588d0 msgr2=0x7fef64154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:44.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.414+0000 7fef63fff700 1 --2- 172.21.15.72:0/3977166478 >> v2:172.21.15.146:3300/0 conn(0x7fef641588d0 0x7fef64154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:44.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.414+0000 7fef63fff700 1 -- 172.21.15.72:0/3977166478 >> v1:172.21.15.146:6789/0 conn(0x7fef640cb9b0 legacy=0x7fef641581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:44.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.414+0000 7fef63fff700 1 -- 172.21.15.72:0/3977166478 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef640c0ae0 con 0x7fef64154060 2023-08-31T19:04:44.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.414+0000 7fef6899c700 1 --2- 172.21.15.72:0/3977166478 >> v2:172.21.15.146:3300/0 conn(0x7fef641588d0 0x7fef64154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:04:44.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.414+0000 7fef63fff700 1 --2- 172.21.15.72:0/3977166478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef64154060 0x7fef64157cd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fef54009810 tx=0x7fef54009060).ready entity=mon.2 client_cookie=7e6a0e09cfd8f6ce server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:44.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.415+0000 7fef62ffd700 1 -- 172.21.15.72:0/3977166478 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54005880 con 0x7fef64154060 2023-08-31T19:04:44.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.415+0000 7fef62ffd700 1 -- 172.21.15.72:0/3977166478 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef540059e0 con 0x7fef64154060 2023-08-31T19:04:44.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.415+0000 7fef62ffd700 1 -- 172.21.15.72:0/3977166478 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54005d60 con 0x7fef64154060 2023-08-31T19:04:44.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.415+0000 7fef6a3ff700 1 -- 172.21.15.72:0/3977166478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef64154060 msgr2=0x7fef64157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:44.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.415+0000 7fef6a3ff700 1 --2- 172.21.15.72:0/3977166478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef64154060 0x7fef64157cd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fef54009810 tx=0x7fef54009060).stop 2023-08-31T19:04:44.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.415+0000 7fef6a3ff700 1 -- 172.21.15.72:0/3977166478 shutdown_connections 2023-08-31T19:04:44.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.415+0000 7fef6a3ff700 1 --2- 172.21.15.72:0/3977166478 >> v2:172.21.15.146:3300/0 conn(0x7fef641588d0 0x7fef64154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:44.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.415+0000 7fef6a3ff700 1 --2- 172.21.15.72:0/3977166478 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef64154060 0x7fef64157cd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:44.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.415+0000 7fef6a3ff700 1 -- 172.21.15.72:0/3977166478 >> 172.21.15.72:0/3977166478 conn(0x7fef6405e870 msgr2=0x7fef640cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:44.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.415+0000 7fef6a3ff700 1 -- 172.21.15.72:0/3977166478 shutdown_connections 2023-08-31T19:04:44.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.415+0000 7fef6a3ff700 1 -- 172.21.15.72:0/3977166478 wait complete. 2023-08-31T19:04:44.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.417+0000 7fef6a3ff700 1 Processor -- start 2023-08-31T19:04:44.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.417+0000 7fef6a3ff700 1 -- start start 2023-08-31T19:04:44.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef6a3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef640cb9b0 0x7fef64150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:44.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef6a3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef64154060 0x7fef640c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:44.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef6a3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef641588d0 0x7fef64151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:44.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef6a3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef640c3990 con 0x7fef640cb9b0 2023-08-31T19:04:44.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef6a3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef640c2b20 con 0x7fef64154060 2023-08-31T19:04:44.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef6a3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef640c2dc0 con 0x7fef641588d0 2023-08-31T19:04:44.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef63fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef640cb9b0 0x7fef64150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:44.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef63fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef640cb9b0 0x7fef64150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35082/0 (socket says 172.21.15.72:35082) 2023-08-31T19:04:44.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef63fff700 1 -- 172.21.15.72:0/1547942698 learned_addr learned my addr 172.21.15.72:0/1547942698 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:44.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef6899c700 1 --2- 172.21.15.72:0/1547942698 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef641588d0 0x7fef64151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:44.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef637fe700 1 --2- 172.21.15.72:0/1547942698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef64154060 0x7fef640c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:44.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef63fff700 1 -- 172.21.15.72:0/1547942698 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef641588d0 msgr2=0x7fef64151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:44.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef63fff700 1 --2- 172.21.15.72:0/1547942698 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef641588d0 0x7fef64151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:44.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef63fff700 1 -- 172.21.15.72:0/1547942698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef64154060 msgr2=0x7fef640c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:44.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef63fff700 1 --2- 172.21.15.72:0/1547942698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef64154060 0x7fef640c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:44.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.418+0000 7fef63fff700 1 -- 172.21.15.72:0/1547942698 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c009a20 con 0x7fef640cb9b0 2023-08-31T19:04:44.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.419+0000 7fef63fff700 1 --2- 172.21.15.72:0/1547942698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef640cb9b0 0x7fef64150300 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7fef54009eb0 tx=0x7fef54016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:44.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.419+0000 7fef4bfff700 1 -- 172.21.15.72:0/1547942698 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef54005880 con 0x7fef640cb9b0 2023-08-31T19:04:44.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.419+0000 7fef4bfff700 1 -- 172.21.15.72:0/1547942698 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5400b790 con 0x7fef640cb9b0 2023-08-31T19:04:44.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.419+0000 7fef6a3ff700 1 -- 172.21.15.72:0/1547942698 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef54009300 con 0x7fef640cb9b0 2023-08-31T19:04:44.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.419+0000 7fef4bfff700 1 -- 172.21.15.72:0/1547942698 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5400bb30 con 0x7fef640cb9b0 2023-08-31T19:04:44.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.419+0000 7fef6a3ff700 1 -- 172.21.15.72:0/1547942698 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef640c3340 con 0x7fef640cb9b0 2023-08-31T19:04:44.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.420+0000 7fef6a3ff700 1 -- 172.21.15.72:0/1547942698 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6406c6b0 con 0x7fef640cb9b0 2023-08-31T19:04:44.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.421+0000 7fef4bfff700 1 -- 172.21.15.72:0/1547942698 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fef54018070 con 0x7fef640cb9b0 2023-08-31T19:04:44.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.422+0000 7fef4bfff700 1 --2- 172.21.15.72:0/1547942698 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fef5005ef30 0x7fef500613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:44.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.422+0000 7fef4bfff700 1 -- 172.21.15.72:0/1547942698 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7fef5407b2c0 con 0x7fef640cb9b0 2023-08-31T19:04:44.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.422+0000 7fef637fe700 1 --2- 172.21.15.72:0/1547942698 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fef5005ef30 0x7fef500613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:44.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.422+0000 7fef637fe700 1 --2- 172.21.15.72:0/1547942698 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fef5005ef30 0x7fef500613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fef640a99e0 tx=0x7fef58007d40).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:44.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.426+0000 7fef4bfff700 1 -- 172.21.15.72:0/1547942698 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fef5404c230 con 0x7fef640cb9b0 2023-08-31T19:04:44.519 INFO:tasks.ceph.mds.a.smithi072.stderr:2023-08-31T19:04:44.519+0000 7facadbf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:04:44.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.637+0000 7fef6a3ff700 1 -- 172.21.15.72:0/1547942698 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef640c0dc0 con 0x7fef640cb9b0 2023-08-31T19:04:44.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.637+0000 7fef4bfff700 1 -- 172.21.15.72:0/1547942698 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fef5404f850 con 0x7fef640cb9b0 2023-08-31T19:04:44.638 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:44.638 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2894594800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2894594800},{"type":"v1","addr":"172.21.15.146:6834","nonce":2894594800}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2296022003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2296022003},{"type":"v1","addr":"172.21.15.72:6837","nonce":2296022003}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/159383587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":159383587},{"type":"v1","addr":"172.21.15.146:6835","nonce":159383587}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:04:38.994518+0000","modified":"2023-08-31T19:04:42.017973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6835/4088389987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4088389987},{"type":"v1","addr":"172.21.15.72:6835","nonce":4088389987}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-31T19:04:44.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.639+0000 7fef6a3ff700 1 -- 172.21.15.72:0/1547942698 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fef5005ef30 msgr2=0x7fef500613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:44.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.639+0000 7fef6a3ff700 1 --2- 172.21.15.72:0/1547942698 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fef5005ef30 0x7fef500613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fef640a99e0 tx=0x7fef58007d40).stop 2023-08-31T19:04:44.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.639+0000 7fef6a3ff700 1 -- 172.21.15.72:0/1547942698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef640cb9b0 msgr2=0x7fef64150300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:44.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.639+0000 7fef6a3ff700 1 --2- 172.21.15.72:0/1547942698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef640cb9b0 0x7fef64150300 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7fef54009eb0 tx=0x7fef54016000).stop 2023-08-31T19:04:44.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.640+0000 7fef6a3ff700 1 -- 172.21.15.72:0/1547942698 shutdown_connections 2023-08-31T19:04:44.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.640+0000 7fef6a3ff700 1 --2- 172.21.15.72:0/1547942698 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fef641588d0 0x7fef64151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:44.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.640+0000 7fef6a3ff700 1 --2- 172.21.15.72:0/1547942698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef640cb9b0 0x7fef64150300 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:44.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.640+0000 7fef6a3ff700 1 --2- 172.21.15.72:0/1547942698 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fef5005ef30 0x7fef500613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:44.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.640+0000 7fef6a3ff700 1 --2- 172.21.15.72:0/1547942698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fef64154060 0x7fef640c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:44.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.640+0000 7fef6a3ff700 1 -- 172.21.15.72:0/1547942698 >> 172.21.15.72:0/1547942698 conn(0x7fef6405e870 msgr2=0x7fef640bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:44.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.640+0000 7fef6a3ff700 1 -- 172.21.15.72:0/1547942698 shutdown_connections 2023-08-31T19:04:44.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:44.640+0000 7fef6a3ff700 1 -- 172.21.15.72:0/1547942698 wait complete. 2023-08-31T19:04:44.643 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 48 2023-08-31T19:04:45.060 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T19:04:38.994518+0000', 'modified': '2023-08-31T19:04:42.017973+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7122}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7122': {'gid': 7122, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6835/4088389987', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6834', 'nonce': 4088389987}, {'type': 'v1', 'addr': '172.21.15.72:6835', 'nonce': 4088389987}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-31T19:04:45.060 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T19:04:45.061 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-31T19:04:45.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.252+0000 7ffaefbff700 1 Processor -- start 2023-08-31T19:04:45.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.252+0000 7ffaefbff700 1 -- start start 2023-08-31T19:04:45.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.253+0000 7ffaefbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffae81378e0 0x7ffae8152230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.253+0000 7ffaefbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae806a390 con 0x7ffae80bd3c0 2023-08-31T19:04:45.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.253+0000 7ffaefbff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae8137cc0 con 0x7ffae8065720 2023-08-31T19:04:45.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.253+0000 7ffaefbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae8069780 con 0x7ffae81378e0 2023-08-31T19:04:45.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.253+0000 7ffaed99b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffae81378e0 0x7ffae8152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.253+0000 7ffaee19c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffae80bd3c0 0x7ffae80c14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33672/0 (socket says 172.21.15.72:33672) 2023-08-31T19:04:45.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.253+0000 7ffaee19c700 1 -- 172.21.15.72:0/3485463452 learned_addr learned my addr 172.21.15.72:0/3485463452 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:45.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.254+0000 7ffaed99b700 1 -- 172.21.15.72:0/3485463452 >> v1:172.21.15.146:6789/0 conn(0x7ffae8065720 legacy=0x7ffae80bccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.254+0000 7ffaed99b700 1 -- 172.21.15.72:0/3485463452 >> v1:172.21.15.72:6789/0 conn(0x7ffae80bd3c0 legacy=0x7ffae80c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.254+0000 7ffaed99b700 1 -- 172.21.15.72:0/3485463452 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae8069a60 con 0x7ffae81378e0 2023-08-31T19:04:45.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.254+0000 7ffaec999700 1 -- 172.21.15.72:0/3485463452 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138612276 0 0) 0x7ffae806a390 con 0x7ffae80bd3c0 2023-08-31T19:04:45.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.254+0000 7ffaed99b700 1 --2- 172.21.15.72:0/3485463452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffae81378e0 0x7ffae8152230 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7ffae4009760 tx=0x7ffae4009060).ready entity=mon.0 client_cookie=ebec1f640655030a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:45.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.254+0000 7ffaec999700 1 -- 172.21.15.72:0/3485463452 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae400b580 con 0x7ffae81378e0 2023-08-31T19:04:45.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.254+0000 7ffaec999700 1 -- 172.21.15.72:0/3485463452 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae400b6e0 con 0x7ffae81378e0 2023-08-31T19:04:45.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.254+0000 7ffaec999700 1 -- 172.21.15.72:0/3485463452 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae400ba60 con 0x7ffae81378e0 2023-08-31T19:04:45.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.255+0000 7ffaefbff700 1 -- 172.21.15.72:0/3485463452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffae81378e0 msgr2=0x7ffae8152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.255+0000 7ffaefbff700 1 --2- 172.21.15.72:0/3485463452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffae81378e0 0x7ffae8152230 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7ffae4009760 tx=0x7ffae4009060).stop 2023-08-31T19:04:45.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.255+0000 7ffaefbff700 1 -- 172.21.15.72:0/3485463452 shutdown_connections 2023-08-31T19:04:45.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.255+0000 7ffaefbff700 1 --2- 172.21.15.72:0/3485463452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffae81378e0 0x7ffae8152230 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.255+0000 7ffaefbff700 1 -- 172.21.15.72:0/3485463452 >> 172.21.15.72:0/3485463452 conn(0x7ffae8063120 msgr2=0x7ffae80c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:45.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.255+0000 7ffaefbff700 1 -- 172.21.15.72:0/3485463452 shutdown_connections 2023-08-31T19:04:45.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.255+0000 7ffaefbff700 1 -- 172.21.15.72:0/3485463452 wait complete. 2023-08-31T19:04:45.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.256+0000 7ffaefbff700 1 Processor -- start 2023-08-31T19:04:45.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.257+0000 7ffaefbff700 1 -- start start 2023-08-31T19:04:45.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.257+0000 7ffaefbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffae8065720 0x7ffae8136c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.257+0000 7ffaefbff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffae80bd3c0 0x7ffae81484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.257+0000 7ffaefbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffae81378e0 0x7ffae81489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.257+0000 7ffaefbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8148eb0 con 0x7ffae8065720 2023-08-31T19:04:45.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.257+0000 7ffaefbff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8164470 con 0x7ffae80bd3c0 2023-08-31T19:04:45.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.257+0000 7ffaefbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8164d10 con 0x7ffae81378e0 2023-08-31T19:04:45.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.258+0000 7ffaed99b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffae8065720 0x7ffae8136c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.258+0000 7ffaed99b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffae8065720 0x7ffae8136c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35096/0 (socket says 172.21.15.72:35096) 2023-08-31T19:04:45.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.258+0000 7ffaed99b700 1 -- 172.21.15.72:0/2820489769 learned_addr learned my addr 172.21.15.72:0/2820489769 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:45.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.258+0000 7ffaee19c700 1 --2- 172.21.15.72:0/2820489769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffae81378e0 0x7ffae81489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.258+0000 7ffaed19a700 1 --2- 172.21.15.72:0/2820489769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffae80bd3c0 0x7ffae81484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.258+0000 7ffaed99b700 1 -- 172.21.15.72:0/2820489769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffae81378e0 msgr2=0x7ffae81489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.258+0000 7ffaed99b700 1 --2- 172.21.15.72:0/2820489769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffae81378e0 0x7ffae81489c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.258+0000 7ffaed99b700 1 -- 172.21.15.72:0/2820489769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffae80bd3c0 msgr2=0x7ffae81484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.258+0000 7ffaed99b700 1 --2- 172.21.15.72:0/2820489769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffae80bd3c0 0x7ffae81484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.258+0000 7ffaed99b700 1 -- 172.21.15.72:0/2820489769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae40092a0 con 0x7ffae8065720 2023-08-31T19:04:45.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.258+0000 7ffaed99b700 1 --2- 172.21.15.72:0/2820489769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffae8065720 0x7ffae8136c40 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7ffae4006e00 tx=0x7ffae4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:45.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.258+0000 7ffaddffb700 1 -- 172.21.15.72:0/2820489769 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae400ba60 con 0x7ffae8065720 2023-08-31T19:04:45.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.259+0000 7ffaddffb700 1 -- 172.21.15.72:0/2820489769 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4000c90 con 0x7ffae8065720 2023-08-31T19:04:45.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.259+0000 7ffaefbff700 1 -- 172.21.15.72:0/2820489769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae8168770 con 0x7ffae8065720 2023-08-31T19:04:45.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.259+0000 7ffaddffb700 1 -- 172.21.15.72:0/2820489769 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae401b690 con 0x7ffae8065720 2023-08-31T19:04:45.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.259+0000 7ffaefbff700 1 -- 172.21.15.72:0/2820489769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae81649a0 con 0x7ffae8065720 2023-08-31T19:04:45.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.260+0000 7ffaddffb700 1 -- 172.21.15.72:0/2820489769 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ffae401ba40 con 0x7ffae8065720 2023-08-31T19:04:45.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.261+0000 7ffaddffb700 1 --2- 172.21.15.72:0/2820489769 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ffacc05ef00 0x7ffacc0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.261+0000 7ffaddffb700 1 -- 172.21.15.72:0/2820489769 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7ffae407bb40 con 0x7ffae8065720 2023-08-31T19:04:45.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.261+0000 7ffaed19a700 1 --2- 172.21.15.72:0/2820489769 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ffacc05ef00 0x7ffacc0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.262+0000 7ffaed19a700 1 --2- 172.21.15.72:0/2820489769 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ffacc05ef00 0x7ffacc0613c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ffae8150160 tx=0x7ffad8009040).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:45.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.263+0000 7ffb06e71b80 1 Processor -- start 2023-08-31T19:04:45.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.264+0000 7ffb06e71b80 1 -- start start 2023-08-31T19:04:45.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffb06e71b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c792652c0 0x556c792656a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffb06e71b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792adf60 0x556c79260600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffb06e71b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c79260af0 0x556c79260f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffb06e71b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c791a1db0 con 0x556c792adf60 2023-08-31T19:04:45.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffb06e71b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c791b7030 con 0x556c79260af0 2023-08-31T19:04:45.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffb06e71b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c791b7170 con 0x556c792652c0 2023-08-31T19:04:45.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffaed19a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792adf60 0x556c79260600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffaed19a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792adf60 0x556c79260600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35100/0 (socket says 172.21.15.72:35100) 2023-08-31T19:04:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffaed19a700 1 -- 172.21.15.72:0/1503366226 learned_addr learned my addr 172.21.15.72:0/1503366226 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffaed99b700 1 --2- 172.21.15.72:0/1503366226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c792652c0 0x556c792656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffaee19c700 1 --2- 172.21.15.72:0/1503366226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c79260af0 0x556c79260f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffaed19a700 1 -- 172.21.15.72:0/1503366226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c792652c0 msgr2=0x556c792656a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffaed19a700 1 --2- 172.21.15.72:0/1503366226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c792652c0 0x556c792656a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffaed19a700 1 -- 172.21.15.72:0/1503366226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c79260af0 msgr2=0x556c79260f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffaed19a700 1 --2- 172.21.15.72:0/1503366226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c79260af0 0x556c79260f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffaed19a700 1 -- 172.21.15.72:0/1503366226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c79189b00 con 0x556c792adf60 2023-08-31T19:04:45.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffaed99b700 1 --2- 172.21.15.72:0/1503366226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c792652c0 0x556c792656a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:45.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffaed19a700 1 --2- 172.21.15.72:0/1503366226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792adf60 0x556c79260600 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7ffad8017600 tx=0x7ffad8012000).ready entity=mon.0 client_cookie=5545ebbf6dda81ec server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:45.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.265+0000 7ffad29fe700 1 -- 172.21.15.72:0/1503366226 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad801c070 con 0x556c792adf60 2023-08-31T19:04:45.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.266+0000 7ffad29fe700 1 -- 172.21.15.72:0/1503366226 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad8017320 con 0x556c792adf60 2023-08-31T19:04:45.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.266+0000 7ffad29fe700 1 -- 172.21.15.72:0/1503366226 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad800e4e0 con 0x556c792adf60 2023-08-31T19:04:45.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.266+0000 7ffb06e71b80 1 -- 172.21.15.72:0/1503366226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792adf60 msgr2=0x556c79260600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.266+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/1503366226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792adf60 0x556c79260600 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7ffad8017600 tx=0x7ffad8012000).stop 2023-08-31T19:04:45.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.266+0000 7ffb06e71b80 1 -- 172.21.15.72:0/1503366226 shutdown_connections 2023-08-31T19:04:45.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.266+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/1503366226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c79260af0 0x556c79260f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.266+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/1503366226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c792652c0 0x556c792656a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.266+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/1503366226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792adf60 0x556c79260600 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.266+0000 7ffb06e71b80 1 -- 172.21.15.72:0/1503366226 >> 172.21.15.72:0/1503366226 conn(0x556c790cf940 msgr2=0x556c792ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:45.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.266+0000 7ffb06e71b80 1 -- 172.21.15.72:0/1503366226 shutdown_connections 2023-08-31T19:04:45.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.266+0000 7ffb06e71b80 1 -- 172.21.15.72:0/1503366226 wait complete. 2023-08-31T19:04:45.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.267+0000 7ffb06e71b80 1 -- start start 2023-08-31T19:04:45.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.267+0000 7ffb06e71b80 1 Processor -- start 2023-08-31T19:04:45.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.268+0000 7ffb06e71b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 0x556c792906c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.268+0000 7ffb06e71b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792652c0 0x556c79292440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.268+0000 7ffb06e71b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792adf60 0x556c792a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.268+0000 7ffb06e71b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c791b73f0 con 0x556c792652c0 2023-08-31T19:04:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.268+0000 7ffb06e71b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c79182920 con 0x556c792adf60 2023-08-31T19:04:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.268+0000 7ffb06e71b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c79292d40 con 0x556c79260af0 2023-08-31T19:04:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.268+0000 7ffb06e71b80 10 client.0 ll_register_callbacks cb 0x556c79157ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:04:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.269+0000 7ffaed19a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792652c0 0x556c79292440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.269+0000 7ffaed19a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792652c0 0x556c79292440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35106/0 (socket says 172.21.15.72:35106) 2023-08-31T19:04:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.269+0000 7ffaed19a700 1 -- 172.21.15.72:0/2824817572 learned_addr learned my addr 172.21.15.72:0/2824817572 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.269+0000 7ffaee19c700 1 --2- 172.21.15.72:0/2824817572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792adf60 0x556c792a78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.269+0000 7ffaed99b700 1 --2- 172.21.15.72:0/2824817572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 0x556c792906c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.269+0000 7ffaed19a700 1 -- 172.21.15.72:0/2824817572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 msgr2=0x556c792906c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.269+0000 7ffaed19a700 1 --2- 172.21.15.72:0/2824817572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 0x556c792906c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.269+0000 7ffaed19a700 1 -- 172.21.15.72:0/2824817572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792adf60 msgr2=0x556c792a78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:45.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.269+0000 7ffaed19a700 1 --2- 172.21.15.72:0/2824817572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792adf60 0x556c792a78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.269+0000 7ffaed19a700 1 -- 172.21.15.72:0/2824817572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad800f040 con 0x556c792652c0 2023-08-31T19:04:45.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.269+0000 7ffaed19a700 1 --2- 172.21.15.72:0/2824817572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792652c0 0x556c79292440 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x556c792ae3c0 tx=0x7ffad8017000).ready entity=mon.0 client_cookie=afa4c79e17ca4f07 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:45.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.269+0000 7ffac7fff700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:04:45.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.269+0000 7ffac7fff700 1 -- 172.21.15.72:0/2824817572 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8029070 con 0x556c792652c0 2023-08-31T19:04:45.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.269+0000 7ffac7fff700 1 -- 172.21.15.72:0/2824817572 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7ffad8014480 con 0x556c792652c0 2023-08-31T19:04:45.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.269+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2824817572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c7925faa0 con 0x556c792652c0 2023-08-31T19:04:45.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.270+0000 7ffac7fff700 1 -- 172.21.15.72:0/2824817572 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffad800e4e0 con 0x556c792652c0 2023-08-31T19:04:45.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.270+0000 7ffb06e71b80 10 client.7281 fetch_fsmap learned FSMap version 48 2023-08-31T19:04:45.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.270+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2824817572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x556c791aff70 con 0x556c792652c0 2023-08-31T19:04:45.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.270+0000 7ffac7fff700 1 -- 172.21.15.72:0/2824817572 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c7925faa0 con 0x556c792652c0 2023-08-31T19:04:45.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.270+0000 7ffac7fff700 1 -- 172.21.15.72:0/2824817572 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 48) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffad8014850 con 0x556c792652c0 2023-08-31T19:04:45.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.270+0000 7ffb06e71b80 10 client.7281 fetch_fsmap finished waiting for FSMap version 48 2023-08-31T19:04:45.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.270+0000 7ffb06e71b80 10 client.7281 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:04:45.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.270+0000 7ffb06e71b80 20 client.7281 populate_metadata read hostname 'smithi072' 2023-08-31T19:04:45.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.270+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/2824817572 >> [v2:172.21.15.72:6834/4088389987,v1:172.21.15.72:6835/4088389987] conn(0x556c7928ecb0 0x556c7928f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.270+0000 7ffb06e71b80 4 client.7281 mds_command: new command op to 7122 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T19:04:45.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.270+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2824817572 --> [v2:172.21.15.72:6834/4088389987,v1:172.21.15.72:6835/4088389987] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c7901fef0 con 0x556c7928ecb0 2023-08-31T19:04:45.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.270+0000 7ffaed99b700 1 --2- 172.21.15.72:0/2824817572 >> [v2:172.21.15.72:6834/4088389987,v1:172.21.15.72:6835/4088389987] conn(0x556c7928ecb0 0x556c7928f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.271+0000 7ffac7fff700 10 client.7281 ms_handle_connect on v2:172.21.15.72:6834/4088389987 2023-08-31T19:04:45.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.271+0000 7ffaed99b700 1 --2- 172.21.15.72:0/2824817572 >> [v2:172.21.15.72:6834/4088389987,v1:172.21.15.72:6835/4088389987] conn(0x556c7928ecb0 0x556c7928f090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3af7f596ee5a026f server_cookie=5496120f3ea08458 in_seq=0 out_seq=0 2023-08-31T19:04:45.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.271+0000 7ffac7fff700 1 -- 172.21.15.72:0/2824817572 <== mds.0 v2:172.21.15.72:6834/4088389987 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x556c7901fef0 con 0x556c7928ecb0 2023-08-31T19:04:45.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.271+0000 7ffac7fff700 10 client.7281 handle_command_reply: tid=0 2023-08-31T19:04:45.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.271+0000 7ffb06e71b80 1 client.7281 shutdown 2023-08-31T19:04:45.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.272+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2824817572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792652c0 msgr2=0x556c79292440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.272+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/2824817572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792652c0 0x556c79292440 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x556c792ae3c0 tx=0x7ffad8017000).stop 2023-08-31T19:04:45.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.272+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2824817572 shutdown_connections 2023-08-31T19:04:45.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.272+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/2824817572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792adf60 0x556c792a78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.272+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/2824817572 >> [v2:172.21.15.72:6834/4088389987,v1:172.21.15.72:6835/4088389987] conn(0x556c7928ecb0 0x556c7928f090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.272+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/2824817572 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 0x556c792906c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.272+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/2824817572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792652c0 0x556c79292440 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.272+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2824817572 >> 172.21.15.72:0/2824817572 conn(0x556c790cf940 msgr2=0x556c792a9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:45.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.272+0000 7ffac7fff700 0 client.7281 ms_handle_reset on v2:172.21.15.72:6834/4088389987 2023-08-31T19:04:45.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.272+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2824817572 shutdown_connections 2023-08-31T19:04:45.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.272+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2824817572 wait complete. 2023-08-31T19:04:45.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.272+0000 7ffb06e71b80 20 client.7281 trim_cache size 0 max 16384 2023-08-31T19:04:45.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.289+0000 7ffb06e71b80 1 Processor -- start 2023-08-31T19:04:45.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.289+0000 7ffb06e71b80 1 -- start start 2023-08-31T19:04:45.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.290+0000 7ffb06e71b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 0x556c792a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.290+0000 7ffb06e71b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792652c0 0x556c79266250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.290+0000 7ffb06e71b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792adf60 0x556c7925bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.290+0000 7ffb06e71b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c79264f80 con 0x556c792652c0 2023-08-31T19:04:45.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.290+0000 7ffb06e71b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7928dd20 con 0x556c792adf60 2023-08-31T19:04:45.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.290+0000 7ffb06e71b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c792645d0 con 0x556c79260af0 2023-08-31T19:04:45.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.290+0000 7ffaed19a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792652c0 0x556c79266250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.290+0000 7ffaed19a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792652c0 0x556c79266250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35122/0 (socket says 172.21.15.72:35122) 2023-08-31T19:04:45.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.290+0000 7ffaed19a700 1 -- 172.21.15.72:0/1311747829 learned_addr learned my addr 172.21.15.72:0/1311747829 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:45.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.290+0000 7ffaee19c700 1 --2- 172.21.15.72:0/1311747829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792adf60 0x556c7925bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.290+0000 7ffaed99b700 1 --2- 172.21.15.72:0/1311747829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 0x556c792a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.291+0000 7ffaed19a700 1 -- 172.21.15.72:0/1311747829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 msgr2=0x556c792a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:45.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.291+0000 7ffaed19a700 1 --2- 172.21.15.72:0/1311747829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 0x556c792a5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.291+0000 7ffaed19a700 1 -- 172.21.15.72:0/1311747829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792adf60 msgr2=0x556c7925bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:45.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.291+0000 7ffaed19a700 1 --2- 172.21.15.72:0/1311747829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792adf60 0x556c7925bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.291+0000 7ffaed19a700 1 -- 172.21.15.72:0/1311747829 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c792a65f0 con 0x556c792652c0 2023-08-31T19:04:45.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.291+0000 7ffaed19a700 1 --2- 172.21.15.72:0/1311747829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792652c0 0x556c79266250 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7ffad8014c70 tx=0x7ffad8029000).ready entity=mon.0 client_cookie=56fd5e294c6dd453 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:45.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.291+0000 7ffad31ff700 1 -- 172.21.15.72:0/1311747829 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8003560 con 0x556c792652c0 2023-08-31T19:04:45.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.291+0000 7ffad31ff700 1 -- 172.21.15.72:0/1311747829 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad800eb80 con 0x556c792652c0 2023-08-31T19:04:45.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.291+0000 7ffad31ff700 1 -- 172.21.15.72:0/1311747829 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8014480 con 0x556c792652c0 2023-08-31T19:04:45.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.292+0000 7ffb06e71b80 1 -- 172.21.15.72:0/1311747829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792652c0 msgr2=0x556c79266250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.292+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/1311747829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792652c0 0x556c79266250 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7ffad8014c70 tx=0x7ffad8029000).stop 2023-08-31T19:04:45.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.292+0000 7ffb06e71b80 1 -- 172.21.15.72:0/1311747829 shutdown_connections 2023-08-31T19:04:45.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.292+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/1311747829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792adf60 0x556c7925bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.292+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/1311747829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 0x556c792a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.292+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/1311747829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792652c0 0x556c79266250 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.292+0000 7ffb06e71b80 1 -- 172.21.15.72:0/1311747829 >> 172.21.15.72:0/1311747829 conn(0x556c790cf940 msgr2=0x556c792ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:45.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.292+0000 7ffb06e71b80 1 -- 172.21.15.72:0/1311747829 shutdown_connections 2023-08-31T19:04:45.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.292+0000 7ffb06e71b80 1 -- 172.21.15.72:0/1311747829 wait complete. 2023-08-31T19:04:45.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.292+0000 7ffb06e71b80 1 -- start start 2023-08-31T19:04:45.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.293+0000 7ffb06e71b80 1 Processor -- start 2023-08-31T19:04:45.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffb06e71b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 0x556c792f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffb06e71b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792652c0 0x556c792f6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffb06e71b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792adf60 0x556c792f6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffb06e71b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7925c250 con 0x556c792adf60 2023-08-31T19:04:45.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffb06e71b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c792bbfe0 con 0x556c792652c0 2023-08-31T19:04:45.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffb06e71b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x556c792f7310 con 0x556c79260af0 2023-08-31T19:04:45.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffb06e71b80 10 client.0 ll_register_callbacks cb 0x556c79157ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:04:45.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffaee19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792adf60 0x556c792f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffaee19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792adf60 0x556c792f6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35132/0 (socket says 172.21.15.72:35132) 2023-08-31T19:04:45.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffaee19c700 1 -- 172.21.15.72:0/2608280023 learned_addr learned my addr 172.21.15.72:0/2608280023 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:45.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffaed19a700 1 --2- 172.21.15.72:0/2608280023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792652c0 0x556c792f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffaed99b700 1 --2- 172.21.15.72:0/2608280023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 0x556c792f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffaee19c700 1 -- 172.21.15.72:0/2608280023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 msgr2=0x556c792f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:45.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffaee19c700 1 --2- 172.21.15.72:0/2608280023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 0x556c792f58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffaee19c700 1 -- 172.21.15.72:0/2608280023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792652c0 msgr2=0x556c792f6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:45.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffaee19c700 1 --2- 172.21.15.72:0/2608280023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792652c0 0x556c792f6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffaee19c700 1 -- 172.21.15.72:0/2608280023 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c791aff70 con 0x556c792adf60 2023-08-31T19:04:45.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffaed19a700 1 --2- 172.21.15.72:0/2608280023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792652c0 0x556c792f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:45.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffaed99b700 1 --2- 172.21.15.72:0/2608280023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 0x556c792f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:45.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffaee19c700 1 --2- 172.21.15.72:0/2608280023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792adf60 0x556c792f6760 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7ffae00078b0 tx=0x7ffae0009040).ready entity=mon.0 client_cookie=cd3306bfed379679 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:45.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.294+0000 7ffac7fff700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:04:45.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.295+0000 7ffac7fff700 1 -- 172.21.15.72:0/2608280023 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae001c070 con 0x556c792adf60 2023-08-31T19:04:45.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.295+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2608280023 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c79055040 con 0x556c792adf60 2023-08-31T19:04:45.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.295+0000 7ffac7fff700 1 -- 172.21.15.72:0/2608280023 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7ffae00020c0 con 0x556c792adf60 2023-08-31T19:04:45.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.295+0000 7ffac7fff700 1 -- 172.21.15.72:0/2608280023 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffae0007e40 con 0x556c792adf60 2023-08-31T19:04:45.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.295+0000 7ffb06e71b80 10 client.7287 fetch_fsmap learned FSMap version 48 2023-08-31T19:04:45.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.295+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2608280023 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x556c791ab580 con 0x556c792adf60 2023-08-31T19:04:45.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.295+0000 7ffac7fff700 1 -- 172.21.15.72:0/2608280023 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556c79055040 con 0x556c792adf60 2023-08-31T19:04:45.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.295+0000 7ffac7fff700 1 -- 172.21.15.72:0/2608280023 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 48) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffae001f020 con 0x556c792adf60 2023-08-31T19:04:45.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.295+0000 7ffb06e71b80 10 client.7287 fetch_fsmap finished waiting for FSMap version 48 2023-08-31T19:04:45.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.295+0000 7ffb06e71b80 10 client.7287 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:04:45.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.295+0000 7ffb06e71b80 20 client.7287 populate_metadata read hostname 'smithi072' 2023-08-31T19:04:45.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.295+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/2608280023 >> [v2:172.21.15.72:6834/4088389987,v1:172.21.15.72:6835/4088389987] conn(0x556c79291850 0x556c79291c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.295+0000 7ffb06e71b80 4 client.7287 mds_command: new command op to 7122 tid=0[{"prefix": "status"}] 2023-08-31T19:04:45.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.295+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2608280023 --> [v2:172.21.15.72:6834/4088389987,v1:172.21.15.72:6835/4088389987] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556c790460c0 con 0x556c79291850 2023-08-31T19:04:45.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.296+0000 7ffaed99b700 1 --2- 172.21.15.72:0/2608280023 >> [v2:172.21.15.72:6834/4088389987,v1:172.21.15.72:6835/4088389987] conn(0x556c79291850 0x556c79291c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.296+0000 7ffac7fff700 10 client.7287 ms_handle_connect on v2:172.21.15.72:6834/4088389987 2023-08-31T19:04:45.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.296+0000 7ffaed99b700 1 --2- 172.21.15.72:0/2608280023 >> [v2:172.21.15.72:6834/4088389987,v1:172.21.15.72:6835/4088389987] conn(0x556c79291850 0x556c79291c30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1167e42c31cacc39 server_cookie=81c58125942fd5ff in_seq=0 out_seq=0 2023-08-31T19:04:45.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.296+0000 7ffac7fff700 1 -- 172.21.15.72:0/2608280023 <== mds.0 v2:172.21.15.72:6834/4088389987 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x556c790460c0 con 0x556c79291850 2023-08-31T19:04:45.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.296+0000 7ffac7fff700 10 client.7287 handle_command_reply: tid=0 2023-08-31T19:04:45.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.296+0000 7ffb06e71b80 1 client.7287 shutdown 2023-08-31T19:04:45.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.296+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2608280023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792adf60 msgr2=0x556c792f6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.296+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/2608280023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792adf60 0x556c792f6760 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7ffae00078b0 tx=0x7ffae0009040).stop 2023-08-31T19:04:45.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2608280023 shutdown_connections 2023-08-31T19:04:45.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/2608280023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x556c792adf60 0x556c792f6760 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/2608280023 >> [v2:172.21.15.72:6834/4088389987,v1:172.21.15.72:6835/4088389987] conn(0x556c79291850 0x556c79291c30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/2608280023 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x556c79260af0 0x556c792f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffb06e71b80 1 --2- 172.21.15.72:0/2608280023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556c792652c0 0x556c792f6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffac7fff700 0 client.7287 ms_handle_reset on v2:172.21.15.72:6834/4088389987 2023-08-31T19:04:45.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2608280023 >> 172.21.15.72:0/2608280023 conn(0x556c790cf940 msgr2=0x556c79266250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:45.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2608280023 shutdown_connections 2023-08-31T19:04:45.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffb06e71b80 1 -- 172.21.15.72:0/2608280023 wait complete. 2023-08-31T19:04:45.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffb06e71b80 20 client.7287 trim_cache size 0 max 16384 2023-08-31T19:04:45.314 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:04:45.314 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "acadb8ca-1685-49e1-a73f-5e9d14d95be9", 2023-08-31T19:04:45.314 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-08-31T19:04:45.315 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 7122, 2023-08-31T19:04:45.315 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-08-31T19:04:45.315 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-08-31T19:04:45.315 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-08-31T19:04:45.315 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 6.3004527829999999, 2023-08-31T19:04:45.316 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 48, 2023-08-31T19:04:45.316 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 109, 2023-08-31T19:04:45.316 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 109, 2023-08-31T19:04:45.316 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 11.519260983000001 2023-08-31T19:04:45.316 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:04:45.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffaefbff700 1 -- 172.21.15.72:0/2820489769 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ffacc05ef00 msgr2=0x7ffacc0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffaefbff700 1 --2- 172.21.15.72:0/2820489769 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ffacc05ef00 0x7ffacc0613c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ffae8150160 tx=0x7ffad8009040).stop 2023-08-31T19:04:45.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffaefbff700 1 -- 172.21.15.72:0/2820489769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffae8065720 msgr2=0x7ffae8136c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffaefbff700 1 --2- 172.21.15.72:0/2820489769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffae8065720 0x7ffae8136c40 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7ffae4006e00 tx=0x7ffae4017000).stop 2023-08-31T19:04:45.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffaefbff700 1 -- 172.21.15.72:0/2820489769 shutdown_connections 2023-08-31T19:04:45.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffaefbff700 1 --2- 172.21.15.72:0/2820489769 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffae81378e0 0x7ffae81489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.297+0000 7ffaefbff700 1 --2- 172.21.15.72:0/2820489769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffae8065720 0x7ffae8136c40 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.298+0000 7ffaefbff700 1 --2- 172.21.15.72:0/2820489769 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ffacc05ef00 0x7ffacc0613c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.298+0000 7ffaefbff700 1 --2- 172.21.15.72:0/2820489769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffae80bd3c0 0x7ffae81484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.298+0000 7ffaefbff700 1 -- 172.21.15.72:0/2820489769 >> 172.21.15.72:0/2820489769 conn(0x7ffae8063120 msgr2=0x7ffae80bc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:45.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.298+0000 7ffaefbff700 1 -- 172.21.15.72:0/2820489769 shutdown_connections 2023-08-31T19:04:45.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.298+0000 7ffaefbff700 1 -- 172.21.15.72:0/2820489769 wait complete. 2023-08-31T19:04:45.320 DEBUG:teuthology.orchestra.run.smithi072:> ceph fs ls 2023-08-31T19:04:45.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.479+0000 7fb8c81ff700 1 Processor -- start 2023-08-31T19:04:45.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.479+0000 7fb8c81ff700 1 -- start start 2023-08-31T19:04:45.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.480+0000 7fb8c81ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c0157720 0x7fb8c00c1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c81ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8c0157b00 0x7fb8c00c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c81ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8c00a9d30 0x7fb8c00aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c81ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c00aa6d0 con 0x7fb8c0157b00 2023-08-31T19:04:45.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c81ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c00bfd10 con 0x7fb8c00a9d30 2023-08-31T19:04:45.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c81ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00c0b70 con 0x7fb8c0157720 2023-08-31T19:04:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c579a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8c0157b00 0x7fb8c00c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c579a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8c0157b00 0x7fb8c00c7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35134/0 (socket says 172.21.15.72:35134) 2023-08-31T19:04:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c579a700 1 -- 172.21.15.72:0/3792255891 learned_addr learned my addr 172.21.15.72:0/3792255891 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c5f9b700 1 --2- 172.21.15.72:0/3792255891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c0157720 0x7fb8c00c1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c679c700 1 --2- 172.21.15.72:0/3792255891 >> v2:172.21.15.146:3300/0 conn(0x7fb8c00a9d30 0x7fb8c00aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c579a700 1 -- 172.21.15.72:0/3792255891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c0157720 msgr2=0x7fb8c00c1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c579a700 1 --2- 172.21.15.72:0/3792255891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c0157720 0x7fb8c00c1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c579a700 1 -- 172.21.15.72:0/3792255891 >> v2:172.21.15.146:3300/0 conn(0x7fb8c00a9d30 msgr2=0x7fb8c00aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c579a700 1 --2- 172.21.15.72:0/3792255891 >> v2:172.21.15.146:3300/0 conn(0x7fb8c00a9d30 0x7fb8c00aa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c579a700 1 -- 172.21.15.72:0/3792255891 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c00bff60 con 0x7fb8c0157b00 2023-08-31T19:04:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.481+0000 7fb8c579a700 1 --2- 172.21.15.72:0/3792255891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c0157b00 0x7fb8c00c7040 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fb8c00cbd30 tx=0x7fb8b00090f0).ready entity=mon.0 client_cookie=4ab7a0e6906bc95e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.482+0000 7fb8c4f99700 1 -- 172.21.15.72:0/3792255891 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b000b600 con 0x7fb8c0157b00 2023-08-31T19:04:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.482+0000 7fb8c4f99700 1 -- 172.21.15.72:0/3792255891 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b000b760 con 0x7fb8c0157b00 2023-08-31T19:04:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.482+0000 7fb8c4f99700 1 -- 172.21.15.72:0/3792255891 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b000bae0 con 0x7fb8c0157b00 2023-08-31T19:04:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.482+0000 7fb8c81ff700 1 -- 172.21.15.72:0/3792255891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c0157b00 msgr2=0x7fb8c00c7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.482+0000 7fb8c81ff700 1 --2- 172.21.15.72:0/3792255891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c0157b00 0x7fb8c00c7040 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fb8c00cbd30 tx=0x7fb8b00090f0).stop 2023-08-31T19:04:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.482+0000 7fb8c81ff700 1 -- 172.21.15.72:0/3792255891 shutdown_connections 2023-08-31T19:04:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.482+0000 7fb8c81ff700 1 --2- 172.21.15.72:0/3792255891 >> v2:172.21.15.146:3300/0 conn(0x7fb8c00a9d30 0x7fb8c00aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.482+0000 7fb8c81ff700 1 --2- 172.21.15.72:0/3792255891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c0157720 0x7fb8c00c1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.482+0000 7fb8c81ff700 1 --2- 172.21.15.72:0/3792255891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c0157b00 0x7fb8c00c7040 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.482+0000 7fb8c81ff700 1 -- 172.21.15.72:0/3792255891 >> 172.21.15.72:0/3792255891 conn(0x7fb8c006a560 msgr2=0x7fb8c00cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.482+0000 7fb8c81ff700 1 -- 172.21.15.72:0/3792255891 shutdown_connections 2023-08-31T19:04:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.482+0000 7fb8c81ff700 1 -- 172.21.15.72:0/3792255891 wait complete. 2023-08-31T19:04:45.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.484+0000 7fb8c81ff700 1 Processor -- start 2023-08-31T19:04:45.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.484+0000 7fb8c81ff700 1 -- start start 2023-08-31T19:04:45.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.485+0000 7fb8c81ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c00a9d30 0x7fb8c0156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.485+0000 7fb8c81ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0157720 0x7fb8c0138de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.485+0000 7fb8c81ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c0157b00 0x7fb8c0167e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.485+0000 7fb8c81ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00c2820 con 0x7fb8c00a9d30 2023-08-31T19:04:45.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.485+0000 7fb8c81ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00c8f60 con 0x7fb8c0157720 2023-08-31T19:04:45.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.485+0000 7fb8c81ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c0168c00 con 0x7fb8c0157b00 2023-08-31T19:04:45.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.485+0000 7fb8c5f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c00a9d30 0x7fb8c0156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.485+0000 7fb8c5f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c00a9d30 0x7fb8c0156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35150/0 (socket says 172.21.15.72:35150) 2023-08-31T19:04:45.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.485+0000 7fb8c5f9b700 1 -- 172.21.15.72:0/2883311456 learned_addr learned my addr 172.21.15.72:0/2883311456 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:45.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.486+0000 7fb8c579a700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0157720 0x7fb8c0138de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.486+0000 7fb8c679c700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c0157b00 0x7fb8c0167e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.486+0000 7fb8c5f9b700 1 -- 172.21.15.72:0/2883311456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c0157b00 msgr2=0x7fb8c0167e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.486+0000 7fb8c5f9b700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c0157b00 0x7fb8c0167e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.486+0000 7fb8c5f9b700 1 -- 172.21.15.72:0/2883311456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0157720 msgr2=0x7fb8c0138de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.486+0000 7fb8c5f9b700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0157720 0x7fb8c0138de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.486+0000 7fb8c5f9b700 1 -- 172.21.15.72:0/2883311456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b0009370 con 0x7fb8c00a9d30 2023-08-31T19:04:45.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.486+0000 7fb8c579a700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0157720 0x7fb8c0138de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:45.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.486+0000 7fb8c679c700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c0157b00 0x7fb8c0167e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:04:45.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.486+0000 7fb8c5f9b700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c00a9d30 0x7fb8c0156660 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7fb8bc00d890 tx=0x7fb8bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:45.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.486+0000 7fb8b5ffb700 1 -- 172.21.15.72:0/2883311456 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc0125f0 con 0x7fb8c00a9d30 2023-08-31T19:04:45.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.486+0000 7fb8b5ffb700 1 -- 172.21.15.72:0/2883311456 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8bc012750 con 0x7fb8c00a9d30 2023-08-31T19:04:45.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.486+0000 7fb8b5ffb700 1 -- 172.21.15.72:0/2883311456 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc012ad0 con 0x7fb8c00a9d30 2023-08-31T19:04:45.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.486+0000 7fb8c81ff700 1 -- 172.21.15.72:0/2883311456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c00c2a00 con 0x7fb8c00a9d30 2023-08-31T19:04:45.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.486+0000 7fb8c81ff700 1 -- 172.21.15.72:0/2883311456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c00c2fc0 con 0x7fb8c00a9d30 2023-08-31T19:04:45.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.487+0000 7fb8c81ff700 1 -- 172.21.15.72:0/2883311456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c0083290 con 0x7fb8c00a9d30 2023-08-31T19:04:45.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.488+0000 7fb8b5ffb700 1 -- 172.21.15.72:0/2883311456 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb8bc013480 con 0x7fb8c00a9d30 2023-08-31T19:04:45.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.489+0000 7fb8b5ffb700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb8a405ef30 0x7fb8a40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:45.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.489+0000 7fb8b5ffb700 1 -- 172.21.15.72:0/2883311456 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7fb8bc079fe0 con 0x7fb8c00a9d30 2023-08-31T19:04:45.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.489+0000 7fb8c579a700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb8a405ef30 0x7fb8a40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:45.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.490+0000 7fb8c579a700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb8a405ef30 0x7fb8a40613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb8c00cbd30 tx=0x7fb8b0017000).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:45.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.493+0000 7fb8b5ffb700 1 -- 172.21.15.72:0/2883311456 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb8bc04afb0 con 0x7fb8c00a9d30 2023-08-31T19:04:45.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.707+0000 7fb8c81ff700 1 -- 172.21.15.72:0/2883311456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb8c0047480 con 0x7fb8c00a9d30 2023-08-31T19:04:45.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.708+0000 7fb8b5ffb700 1 -- 172.21.15.72:0/2883311456 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb8bc04e5d0 con 0x7fb8c00a9d30 2023-08-31T19:04:45.708 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T19:04:45.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.710+0000 7fb8c81ff700 1 -- 172.21.15.72:0/2883311456 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb8a405ef30 msgr2=0x7fb8a40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.710+0000 7fb8c81ff700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb8a405ef30 0x7fb8a40613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb8c00cbd30 tx=0x7fb8b0017000).stop 2023-08-31T19:04:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.710+0000 7fb8c81ff700 1 -- 172.21.15.72:0/2883311456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c00a9d30 msgr2=0x7fb8c0156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.710+0000 7fb8c81ff700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c00a9d30 0x7fb8c0156660 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7fb8bc00d890 tx=0x7fb8bc008040).stop 2023-08-31T19:04:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.710+0000 7fb8c81ff700 1 -- 172.21.15.72:0/2883311456 shutdown_connections 2023-08-31T19:04:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.710+0000 7fb8c81ff700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8c0157b00 0x7fb8c0167e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.710+0000 7fb8c81ff700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8c00a9d30 0x7fb8c0156660 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.710+0000 7fb8c81ff700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb8a405ef30 0x7fb8a40613f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.710+0000 7fb8c81ff700 1 --2- 172.21.15.72:0/2883311456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0157720 0x7fb8c0138de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:45.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.710+0000 7fb8c81ff700 1 -- 172.21.15.72:0/2883311456 >> 172.21.15.72:0/2883311456 conn(0x7fb8c006a560 msgr2=0x7fb8c00cafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:45.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.710+0000 7fb8c81ff700 1 -- 172.21.15.72:0/2883311456 shutdown_connections 2023-08-31T19:04:45.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:45.710+0000 7fb8c81ff700 1 -- 172.21.15.72:0/2883311456 wait complete. 2023-08-31T19:04:45.725 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-31T19:04:45.725 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:04:45.726 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-31T19:04:45.726 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T19:04:45.726 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T19:04:45.727 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-31T19:04:45.728 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-31T19:04:45.729 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:04:45.729 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:04:45.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:45.730 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-31T19:04:45.778 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:04:45.778 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:04:45.778 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:04:45.778 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:04:45.779 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-31T19:04:45.779 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:04:45.779 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:04:45.779 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:04:45.779 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-31T19:04:45.780 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:04:45.780 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:04:45.780 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-31T19:04:45.780 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:04:45.780 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:04:45.780 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:04:45.781 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:04:45.781 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:04:45.781 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 36991sec preferred_lft 36991sec 2023-08-31T19:04:45.781 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-31T19:04:45.781 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:04:45.782 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:04:45.782 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff 2023-08-31T19:04:45.782 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T19:04:45.782 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:04:45.782 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::7c68:c9ff:fe82:9771/64 scope link 2023-08-31T19:04:45.782 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:04:45.783 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:04:45.783 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e2:e1:71:f6:f6:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T19:04:45.783 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e0e1:71ff:fef6:f6fa/64 scope link 2023-08-31T19:04:45.783 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:04:45.783 INFO:teuthology.orchestra.run.smithi072.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:04:45.784 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T19:04:45.784 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::38f6:6ff:fe3c:1ef/64 scope link 2023-08-31T19:04:45.784 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:04:45.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:45.785 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:04:45.852 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-31T19:04:45.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:45.856 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-31T19:04:45.905 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-31T19:04:45.905 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:04:45.905 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:04:45.906 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:04:45.906 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:04:45.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:45.907 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T19:04:45.907 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T19:04:45.907 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:04:45.908 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:04:45.908 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:04:45.908 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T19:04:46.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:46.078 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T19:04:46.125 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T19:04:46.125 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T19:04:46.125 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:04:46.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:46.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-08-31T19:04:46.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:46.198 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-31T19:04:46.245 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-31T19:04:46.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:04:46.384 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:04:46.384 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:04:46.411 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:04:46.411 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:04:46.415 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-31T19:04:46.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:04:46.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T19:04:46.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-31T19:04:46.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.679+0000 7f1dfd1ff700 1 Processor -- start 2023-08-31T19:04:46.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.680+0000 7f1dfd1ff700 1 -- start start 2023-08-31T19:04:46.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.681+0000 7f1dfd1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1df8157c10 0x7f1df80ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:46.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.681+0000 7f1dfd1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df80c6130 con 0x7f1df80637c0 2023-08-31T19:04:46.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.681+0000 7f1dfd1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df81580b0 con 0x7f1df80ad1b0 2023-08-31T19:04:46.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.681+0000 7f1dfd1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df80c0350 con 0x7f1df8157c10 2023-08-31T19:04:46.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.681+0000 7f1df659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1df8157c10 0x7f1df80ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:46.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.681+0000 7f1df659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1df8157c10 0x7f1df80ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35162/0 (socket says 172.21.15.72:35162) 2023-08-31T19:04:46.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.681+0000 7f1df659c700 1 -- 172.21.15.72:0/2231868434 learned_addr learned my addr 172.21.15.72:0/2231868434 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.682+0000 7f1df659c700 1 -- 172.21.15.72:0/2231868434 >> v1:172.21.15.146:6789/0 conn(0x7f1df80ad1b0 legacy=0x7f1df80630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.682+0000 7f1df659c700 1 -- 172.21.15.72:0/2231868434 >> v1:172.21.15.72:6789/0 conn(0x7f1df80637c0 legacy=0x7f1df80a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.682+0000 7f1df659c700 1 -- 172.21.15.72:0/2231868434 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df8158350 con 0x7f1df8157c10 2023-08-31T19:04:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.682+0000 7f1df5d9b700 1 -- 172.21.15.72:0/2231868434 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331384920 0 0) 0x7f1df80c6130 con 0x7f1df80637c0 2023-08-31T19:04:46.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.682+0000 7f1df659c700 1 --2- 172.21.15.72:0/2231868434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df8157c10 0x7f1df80ad590 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f1dec006fd0 tx=0x7f1dec0090f0).ready entity=mon.0 client_cookie=8fdd25173fe9dcc2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:46.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.682+0000 7f1df5d9b700 1 -- 172.21.15.72:0/2231868434 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec00b600 con 0x7f1df8157c10 2023-08-31T19:04:46.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.682+0000 7f1df5d9b700 1 -- 172.21.15.72:0/2231868434 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec00b760 con 0x7f1df8157c10 2023-08-31T19:04:46.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.682+0000 7f1df5d9b700 1 -- 172.21.15.72:0/2231868434 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec00bae0 con 0x7f1df8157c10 2023-08-31T19:04:46.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.683+0000 7f1dfd1ff700 1 -- 172.21.15.72:0/2231868434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df8157c10 msgr2=0x7f1df80ad590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:46.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.683+0000 7f1dfd1ff700 1 --2- 172.21.15.72:0/2231868434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df8157c10 0x7f1df80ad590 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f1dec006fd0 tx=0x7f1dec0090f0).stop 2023-08-31T19:04:46.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.683+0000 7f1dfd1ff700 1 -- 172.21.15.72:0/2231868434 shutdown_connections 2023-08-31T19:04:46.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.683+0000 7f1dfd1ff700 1 --2- 172.21.15.72:0/2231868434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df8157c10 0x7f1df80ad590 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:46.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.683+0000 7f1dfd1ff700 1 -- 172.21.15.72:0/2231868434 >> 172.21.15.72:0/2231868434 conn(0x7f1df805eb60 msgr2=0x7f1df80cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:46.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.683+0000 7f1dfd1ff700 1 -- 172.21.15.72:0/2231868434 shutdown_connections 2023-08-31T19:04:46.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.683+0000 7f1dfd1ff700 1 -- 172.21.15.72:0/2231868434 wait complete. 2023-08-31T19:04:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.684+0000 7f1dfd1ff700 1 Processor -- start 2023-08-31T19:04:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.684+0000 7f1dfd1ff700 1 -- start start 2023-08-31T19:04:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.685+0000 7f1dfd1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80637c0 0x7f1df8150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.685+0000 7f1dfd1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df80ad1b0 0x7f1df814a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.685+0000 7f1dfd1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df8157c10 0x7f1df80b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:46.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.685+0000 7f1dfd1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df8150af0 con 0x7f1df8157c10 2023-08-31T19:04:46.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.685+0000 7f1dfd1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df80b0d50 con 0x7f1df80ad1b0 2023-08-31T19:04:46.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.685+0000 7f1dfd1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df81501c0 con 0x7f1df80637c0 2023-08-31T19:04:46.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.685+0000 7f1df759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df8157c10 0x7f1df80b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:46.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.686+0000 7f1df759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df8157c10 0x7f1df80b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35166/0 (socket says 172.21.15.72:35166) 2023-08-31T19:04:46.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.686+0000 7f1df759e700 1 -- 172.21.15.72:0/2687151922 learned_addr learned my addr 172.21.15.72:0/2687151922 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:46.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.686+0000 7f1df659c700 1 --2- 172.21.15.72:0/2687151922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df80ad1b0 0x7f1df814a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:46.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.686+0000 7f1df6d9d700 1 --2- 172.21.15.72:0/2687151922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80637c0 0x7f1df8150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:46.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.686+0000 7f1df759e700 1 -- 172.21.15.72:0/2687151922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80637c0 msgr2=0x7f1df8150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.686+0000 7f1df759e700 1 --2- 172.21.15.72:0/2687151922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80637c0 0x7f1df8150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.686+0000 7f1df759e700 1 -- 172.21.15.72:0/2687151922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df80ad1b0 msgr2=0x7f1df814a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.686+0000 7f1df759e700 1 --2- 172.21.15.72:0/2687151922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df80ad1b0 0x7f1df814a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.686+0000 7f1df759e700 1 -- 172.21.15.72:0/2687151922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec009370 con 0x7f1df8157c10 2023-08-31T19:04:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.686+0000 7f1df759e700 1 --2- 172.21.15.72:0/2687151922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df8157c10 0x7f1df80b0370 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f1df000c810 tx=0x7f1df0007ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:46.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.686+0000 7f1ddeffd700 1 -- 172.21.15.72:0/2687151922 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df000e4a0 con 0x7f1df8157c10 2023-08-31T19:04:46.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.686+0000 7f1ddeffd700 1 -- 172.21.15.72:0/2687151922 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df000e620 con 0x7f1df8157c10 2023-08-31T19:04:46.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.686+0000 7f1dfd1ff700 1 -- 172.21.15.72:0/2687151922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df81504a0 con 0x7f1df8157c10 2023-08-31T19:04:46.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.686+0000 7f1ddeffd700 1 -- 172.21.15.72:0/2687151922 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df000e9e0 con 0x7f1df8157c10 2023-08-31T19:04:46.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.687+0000 7f1dfd1ff700 1 -- 172.21.15.72:0/2687151922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df814ad20 con 0x7f1df8157c10 2023-08-31T19:04:46.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.688+0000 7f1dfd1ff700 1 -- 172.21.15.72:0/2687151922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df8150c60 con 0x7f1df8157c10 2023-08-31T19:04:46.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.688+0000 7f1ddeffd700 1 -- 172.21.15.72:0/2687151922 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f1df0012400 con 0x7f1df8157c10 2023-08-31T19:04:46.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.689+0000 7f1ddeffd700 1 --2- 172.21.15.72:0/2687151922 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1de405ef30 0x7f1de40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:46.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.689+0000 7f1ddeffd700 1 -- 172.21.15.72:0/2687151922 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f1df0079c40 con 0x7f1df8157c10 2023-08-31T19:04:46.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.690+0000 7f1df6d9d700 1 --2- 172.21.15.72:0/2687151922 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1de405ef30 0x7f1de40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:46.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.690+0000 7f1df6d9d700 1 --2- 172.21.15.72:0/2687151922 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1de405ef30 0x7f1de40613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1df8151b50 tx=0x7f1de8007d20).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:46.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.693+0000 7f1ddeffd700 1 -- 172.21.15.72:0/2687151922 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1df007f020 con 0x7f1df8157c10 2023-08-31T19:04:46.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.887+0000 7f1dfd1ff700 1 -- 172.21.15.72:0/2687151922 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1df806c6b0 con 0x7f1de405ef30 2023-08-31T19:04:46.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.888+0000 7f1ddeffd700 1 -- 172.21.15.72:0/2687151922 <== mgr.6948 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f1df806c6b0 con 0x7f1de405ef30 2023-08-31T19:04:46.889 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:04:46.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:04:46.889 INFO:teuthology.orchestra.run.smithi072.stdout: "name": "cephfs" 2023-08-31T19:04:46.889 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:04:46.890 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:04:46.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.890+0000 7f1dfd1ff700 1 -- 172.21.15.72:0/2687151922 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1de405ef30 msgr2=0x7f1de40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:46.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.890+0000 7f1dfd1ff700 1 --2- 172.21.15.72:0/2687151922 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1de405ef30 0x7f1de40613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1df8151b50 tx=0x7f1de8007d20).stop 2023-08-31T19:04:46.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.890+0000 7f1dfd1ff700 1 -- 172.21.15.72:0/2687151922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df8157c10 msgr2=0x7f1df80b0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:46.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.890+0000 7f1dfd1ff700 1 --2- 172.21.15.72:0/2687151922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df8157c10 0x7f1df80b0370 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f1df000c810 tx=0x7f1df0007ee0).stop 2023-08-31T19:04:46.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.890+0000 7f1dfd1ff700 1 -- 172.21.15.72:0/2687151922 shutdown_connections 2023-08-31T19:04:46.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.890+0000 7f1dfd1ff700 1 --2- 172.21.15.72:0/2687151922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df8157c10 0x7f1df80b0370 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:46.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.890+0000 7f1dfd1ff700 1 --2- 172.21.15.72:0/2687151922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1df80637c0 0x7f1df8150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:46.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.890+0000 7f1dfd1ff700 1 --2- 172.21.15.72:0/2687151922 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1de405ef30 0x7f1de40613f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:46.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.890+0000 7f1dfd1ff700 1 --2- 172.21.15.72:0/2687151922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1df80ad1b0 0x7f1df814a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:46.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.890+0000 7f1dfd1ff700 1 -- 172.21.15.72:0/2687151922 >> 172.21.15.72:0/2687151922 conn(0x7f1df805eb60 msgr2=0x7f1df8062fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:46.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.891+0000 7f1dfd1ff700 1 -- 172.21.15.72:0/2687151922 shutdown_connections 2023-08-31T19:04:46.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:46.891+0000 7f1dfd1ff700 1 -- 172.21.15.72:0/2687151922 wait complete. 2023-08-31T19:04:46.909 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-31T19:04:47.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.103+0000 7efeb29ff700 1 Processor -- start 2023-08-31T19:04:47.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.103+0000 7efeb29ff700 1 -- start start 2023-08-31T19:04:47.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.104+0000 7efeb29ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efeac153e30 0x7efeac154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:47.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.104+0000 7efeb29ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeac0bfd40 con 0x7efeac0637c0 2023-08-31T19:04:47.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.104+0000 7efeb29ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeac0c6730 con 0x7efeac0c5cb0 2023-08-31T19:04:47.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.104+0000 7efeb29ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac0bffe0 con 0x7efeac153e30 2023-08-31T19:04:47.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.105+0000 7efeb0f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efeac0637c0 0x7efeac0c0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33694/0 (socket says 172.21.15.72:33694) 2023-08-31T19:04:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.105+0000 7efeb0f9c700 1 -- 172.21.15.72:0/2757283785 learned_addr learned my addr 172.21.15.72:0/2757283785 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.105+0000 7efeabfff700 1 --2- 172.21.15.72:0/2757283785 >> v2:172.21.15.146:3300/0 conn(0x7efeac153e30 0x7efeac154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:47.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.105+0000 7efeaaffd700 1 -- 172.21.15.72:0/2757283785 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936659947 0 0) 0x7efeac0bfd40 con 0x7efeac0637c0 2023-08-31T19:04:47.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.105+0000 7efeaaffd700 1 -- 172.21.15.72:0/2757283785 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe940033f0 con 0x7efeac0637c0 2023-08-31T19:04:47.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.105+0000 7efeabfff700 1 -- 172.21.15.72:0/2757283785 >> v1:172.21.15.146:6789/0 conn(0x7efeac0c5cb0 legacy=0x7efeac0630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:47.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.105+0000 7efeaaffd700 1 -- 172.21.15.72:0/2757283785 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453848690 0 0) 0x7efeac0c6730 con 0x7efeac0c5cb0 2023-08-31T19:04:47.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.105+0000 7efeabfff700 1 -- 172.21.15.72:0/2757283785 >> v1:172.21.15.72:6789/0 conn(0x7efeac0637c0 legacy=0x7efeac0c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:47.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.105+0000 7efeabfff700 1 -- 172.21.15.72:0/2757283785 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac0c02c0 con 0x7efeac153e30 2023-08-31T19:04:47.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.106+0000 7efeabfff700 1 --2- 172.21.15.72:0/2757283785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeac153e30 0x7efeac154210 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7efe9c009760 tx=0x7efe9c009060).ready entity=mon.1 client_cookie=9d84e2cd087ae360 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:47.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.106+0000 7efeaaffd700 1 -- 172.21.15.72:0/2757283785 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4001770 con 0x7efeac153e30 2023-08-31T19:04:47.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.106+0000 7efeaaffd700 1 -- 172.21.15.72:0/2757283785 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c012410 con 0x7efeac153e30 2023-08-31T19:04:47.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.106+0000 7efeaaffd700 1 -- 172.21.15.72:0/2757283785 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c012790 con 0x7efeac153e30 2023-08-31T19:04:47.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.106+0000 7efeb29ff700 1 -- 172.21.15.72:0/2757283785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeac153e30 msgr2=0x7efeac154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.106+0000 7efeb29ff700 1 --2- 172.21.15.72:0/2757283785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeac153e30 0x7efeac154210 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7efe9c009760 tx=0x7efe9c009060).stop 2023-08-31T19:04:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.106+0000 7efeb29ff700 1 -- 172.21.15.72:0/2757283785 shutdown_connections 2023-08-31T19:04:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.106+0000 7efeb29ff700 1 --2- 172.21.15.72:0/2757283785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeac153e30 0x7efeac154210 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.106+0000 7efeb29ff700 1 -- 172.21.15.72:0/2757283785 >> 172.21.15.72:0/2757283785 conn(0x7efeac05eb20 msgr2=0x7efeac0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.107+0000 7efeb29ff700 1 -- 172.21.15.72:0/2757283785 shutdown_connections 2023-08-31T19:04:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.107+0000 7efeb29ff700 1 -- 172.21.15.72:0/2757283785 wait complete. 2023-08-31T19:04:47.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.108+0000 7efeb29ff700 1 Processor -- start 2023-08-31T19:04:47.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.108+0000 7efeb29ff700 1 -- start start 2023-08-31T19:04:47.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.109+0000 7efeb29ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeac0637c0 0x7efeac153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.109+0000 7efeb29ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeac0c5cb0 0x7efeac0c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.109+0000 7efeb29ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeac153e30 0x7efeac165190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.109+0000 7efeb29ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0c2cb0 con 0x7efeac0c5cb0 2023-08-31T19:04:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.109+0000 7efeb29ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac165680 con 0x7efeac153e30 2023-08-31T19:04:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.109+0000 7efeb29ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0af7c0 con 0x7efeac0637c0 2023-08-31T19:04:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.109+0000 7efeab7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeac0c5cb0 0x7efeac0c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.109+0000 7efeab7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeac0c5cb0 0x7efeac0c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35178/0 (socket says 172.21.15.72:35178) 2023-08-31T19:04:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.109+0000 7efeab7fe700 1 -- 172.21.15.72:0/364194366 learned_addr learned my addr 172.21.15.72:0/364194366 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.110+0000 7efeabfff700 1 --2- 172.21.15.72:0/364194366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeac0637c0 0x7efeac153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.110+0000 7efeb0f9c700 1 --2- 172.21.15.72:0/364194366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeac153e30 0x7efeac165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.110+0000 7efeab7fe700 1 -- 172.21.15.72:0/364194366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeac0637c0 msgr2=0x7efeac153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:47.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.110+0000 7efeab7fe700 1 --2- 172.21.15.72:0/364194366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeac0637c0 0x7efeac153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:47.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.110+0000 7efeab7fe700 1 -- 172.21.15.72:0/364194366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeac153e30 msgr2=0x7efeac165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:47.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.110+0000 7efeab7fe700 1 --2- 172.21.15.72:0/364194366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeac153e30 0x7efeac165190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:47.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.110+0000 7efeab7fe700 1 -- 172.21.15.72:0/364194366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c0092a0 con 0x7efeac0c5cb0 2023-08-31T19:04:47.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.110+0000 7efeab7fe700 1 --2- 172.21.15.72:0/364194366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeac0c5cb0 0x7efeac0c27c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7efea000c410 tx=0x7efea0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:47.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.110+0000 7efe93fff700 1 -- 172.21.15.72:0/364194366 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0007020 con 0x7efeac0c5cb0 2023-08-31T19:04:47.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.110+0000 7efe93fff700 1 -- 172.21.15.72:0/364194366 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea00071a0 con 0x7efeac0c5cb0 2023-08-31T19:04:47.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.110+0000 7efeb29ff700 1 -- 172.21.15.72:0/364194366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeac168190 con 0x7efeac0c5cb0 2023-08-31T19:04:47.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.110+0000 7efe93fff700 1 -- 172.21.15.72:0/364194366 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0007560 con 0x7efeac0c5cb0 2023-08-31T19:04:47.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.110+0000 7efeb29ff700 1 -- 172.21.15.72:0/364194366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeac168750 con 0x7efeac0c5cb0 2023-08-31T19:04:47.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.111+0000 7efeb29ff700 1 -- 172.21.15.72:0/364194366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeac153760 con 0x7efeac0c5cb0 2023-08-31T19:04:47.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.112+0000 7efe93fff700 1 -- 172.21.15.72:0/364194366 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 39) v1 ==== 75374+0+0 (secure 0 0 0) 0x7efea00068b0 con 0x7efeac0c5cb0 2023-08-31T19:04:47.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.113+0000 7efe93fff700 1 --2- 172.21.15.72:0/364194366 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe9805ef00 0x7efe980613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:47.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.113+0000 7efe93fff700 1 -- 172.21.15.72:0/364194366 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7efea0079730 con 0x7efeac0c5cb0 2023-08-31T19:04:47.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.113+0000 7efeabfff700 1 --2- 172.21.15.72:0/364194366 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe9805ef00 0x7efe980613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:47.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.114+0000 7efeabfff700 1 --2- 172.21.15.72:0/364194366 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe9805ef00 0x7efe980613c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7efe9c009760 tx=0x7efe9c015000).ready entity=mgr.6948 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:47.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.117+0000 7efe93fff700 1 -- 172.21.15.72:0/364194366 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efea00478f0 con 0x7efeac0c5cb0 2023-08-31T19:04:47.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.333+0000 7efeb29ff700 1 -- 172.21.15.72:0/364194366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7efeac0cbae0 con 0x7efeac0c5cb0 2023-08-31T19:04:47.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.521+0000 7efe93fff700 1 -- 172.21.15.72:0/364194366 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 40) v1 ==== 75391+0+0 (secure 0 0 0) 0x7efea0077060 con 0x7efeac0c5cb0 2023-08-31T19:04:47.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.522+0000 7efe93fff700 1 -- 172.21.15.72:0/364194366 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v40) v1 ==== 92+0+0 (secure 0 0 0) 0x7efea0074a60 con 0x7efeac0c5cb0 2023-08-31T19:04:47.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.524+0000 7efeb29ff700 1 -- 172.21.15.72:0/364194366 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe9805ef00 msgr2=0x7efe980613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:47.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.524+0000 7efeb29ff700 1 --2- 172.21.15.72:0/364194366 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe9805ef00 0x7efe980613c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7efe9c009760 tx=0x7efe9c015000).stop 2023-08-31T19:04:47.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.524+0000 7efeb29ff700 1 -- 172.21.15.72:0/364194366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeac0c5cb0 msgr2=0x7efeac0c27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:47.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.524+0000 7efeb29ff700 1 --2- 172.21.15.72:0/364194366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeac0c5cb0 0x7efeac0c27c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7efea000c410 tx=0x7efea0007e00).stop 2023-08-31T19:04:47.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.524+0000 7efeb29ff700 1 -- 172.21.15.72:0/364194366 shutdown_connections 2023-08-31T19:04:47.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.524+0000 7efeb29ff700 1 --2- 172.21.15.72:0/364194366 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe9805ef00 0x7efe980613c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:47.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.524+0000 7efeb29ff700 1 --2- 172.21.15.72:0/364194366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efeac153e30 0x7efeac165190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:47.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.524+0000 7efeb29ff700 1 --2- 172.21.15.72:0/364194366 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efeac0637c0 0x7efeac153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:47.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.524+0000 7efeb29ff700 1 --2- 172.21.15.72:0/364194366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efeac0c5cb0 0x7efeac0c27c0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:47.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.524+0000 7efeb29ff700 1 -- 172.21.15.72:0/364194366 >> 172.21.15.72:0/364194366 conn(0x7efeac05eb20 msgr2=0x7efeac0ab7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:47.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.524+0000 7efeb29ff700 1 -- 172.21.15.72:0/364194366 shutdown_connections 2023-08-31T19:04:47.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.524+0000 7efeb29ff700 1 -- 172.21.15.72:0/364194366 wait complete. 2023-08-31T19:04:47.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-31T19:04:47.730 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:47.730+0000 7fd2b7622680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:04:47.737 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:47.737+0000 7fe24efef680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:04:47.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.740+0000 7f413e9ff700 1 Processor -- start 2023-08-31T19:04:47.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.740+0000 7f413e9ff700 1 -- start start 2023-08-31T19:04:47.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.742+0000 7f413e9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4138154030 0x7f4138154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:47.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.742+0000 7f413e9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41380c7360 0x7f4138063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:47.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.742+0000 7f413e9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41380c6ed0 con 0x7f41380c06b0 2023-08-31T19:04:47.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.742+0000 7f413e9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41380c66e0 con 0x7f41380c7360 2023-08-31T19:04:47.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.742+0000 7f413e9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41380c68c0 con 0x7f4138154030 2023-08-31T19:04:47.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.742+0000 7f413cf9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41380c7360 0x7f4138063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:47.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.742+0000 7f413cf9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41380c7360 0x7f4138063120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35192/0 (socket says 172.21.15.72:35192) 2023-08-31T19:04:47.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.742+0000 7f413cf9c700 1 -- 172.21.15.72:0/2628651017 learned_addr learned my addr 172.21.15.72:0/2628651017 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:47.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.742+0000 7f41377fe700 1 --1- 172.21.15.72:0/2628651017 >> v1:172.21.15.72:6789/0 conn(0x7f41380c06b0 0x7f41380aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33714/0 (socket says 172.21.15.72:33714) 2023-08-31T19:04:47.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.742+0000 7f4137fff700 1 --2- 172.21.15.72:0/2628651017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4138154030 0x7f4138154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.742+0000 7f413cf9c700 1 -- 172.21.15.72:0/2628651017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4138154030 msgr2=0x7f4138154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.742+0000 7f413cf9c700 1 --2- 172.21.15.72:0/2628651017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4138154030 0x7f4138154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.742+0000 7f413cf9c700 1 -- 172.21.15.72:0/2628651017 >> v1:172.21.15.72:6789/0 conn(0x7f41380c06b0 legacy=0x7f41380aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.743+0000 7f413cf9c700 1 -- 172.21.15.72:0/2628651017 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41380c0f30 con 0x7f41380c7360 2023-08-31T19:04:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.742+0000 7f4136ffd700 1 -- 172.21.15.72:0/2628651017 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862831874 0 0) 0x7f41380c6ed0 con 0x7f41380c06b0 2023-08-31T19:04:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.743+0000 7f413cf9c700 1 --2- 172.21.15.72:0/2628651017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41380c7360 0x7f4138063120 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f4130009f20 tx=0x7f4130009840).ready entity=mon.0 client_cookie=f1e1dff480ebb84 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.743+0000 7f4136ffd700 1 -- 172.21.15.72:0/2628651017 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413000e070 con 0x7f41380c7360 2023-08-31T19:04:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.743+0000 7f4136ffd700 1 -- 172.21.15.72:0/2628651017 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413000b9d0 con 0x7f41380c7360 2023-08-31T19:04:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.743+0000 7f4136ffd700 1 -- 172.21.15.72:0/2628651017 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413000bd50 con 0x7f41380c7360 2023-08-31T19:04:47.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.743+0000 7f413e9ff700 1 -- 172.21.15.72:0/2628651017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41380c7360 msgr2=0x7f4138063120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:47.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.743+0000 7f413e9ff700 1 --2- 172.21.15.72:0/2628651017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41380c7360 0x7f4138063120 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f4130009f20 tx=0x7f4130009840).stop 2023-08-31T19:04:47.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.744+0000 7f413e9ff700 1 -- 172.21.15.72:0/2628651017 shutdown_connections 2023-08-31T19:04:47.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.744+0000 7f413e9ff700 1 --2- 172.21.15.72:0/2628651017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41380c7360 0x7f4138063120 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:47.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.744+0000 7f413e9ff700 1 --2- 172.21.15.72:0/2628651017 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4138154030 0x7f4138154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.744+0000 7f413e9ff700 1 -- 172.21.15.72:0/2628651017 >> 172.21.15.72:0/2628651017 conn(0x7f413805eb60 msgr2=0x7f41380cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.744+0000 7f413e9ff700 1 -- 172.21.15.72:0/2628651017 shutdown_connections 2023-08-31T19:04:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.744+0000 7f413e9ff700 1 -- 172.21.15.72:0/2628651017 wait complete. 2023-08-31T19:04:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.745+0000 7f413e9ff700 1 Processor -- start 2023-08-31T19:04:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.745+0000 7f413e9ff700 1 -- start start 2023-08-31T19:04:47.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.746+0000 7f413e9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41380c06b0 0x7f41380b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.746+0000 7f413e9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41380c7360 0x7f413814f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.746+0000 7f413e9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4138154030 0x7f413814fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.746+0000 7f413e9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41381579c0 con 0x7f41380c06b0 2023-08-31T19:04:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.746+0000 7f413e9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4138156db0 con 0x7f4138154030 2023-08-31T19:04:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.746+0000 7f413e9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4138157090 con 0x7f41380c7360 2023-08-31T19:04:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.746+0000 7f4137fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41380c06b0 0x7f41380b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.747+0000 7f4137fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41380c06b0 0x7f41380b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35204/0 (socket says 172.21.15.72:35204) 2023-08-31T19:04:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.747+0000 7f4137fff700 1 -- 172.21.15.72:0/1178757238 learned_addr learned my addr 172.21.15.72:0/1178757238 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.747+0000 7f413cf9c700 1 --2- 172.21.15.72:0/1178757238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4138154030 0x7f413814fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:47.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.747+0000 7f41377fe700 1 --2- 172.21.15.72:0/1178757238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41380c7360 0x7f413814f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.747+0000 7f4137fff700 1 -- 172.21.15.72:0/1178757238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41380c7360 msgr2=0x7f413814f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.747+0000 7f4137fff700 1 --2- 172.21.15.72:0/1178757238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41380c7360 0x7f413814f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.747+0000 7f4137fff700 1 -- 172.21.15.72:0/1178757238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4138154030 msgr2=0x7f413814fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.747+0000 7f4137fff700 1 --2- 172.21.15.72:0/1178757238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4138154030 0x7f413814fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:47.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.747+0000 7f4137fff700 1 -- 172.21.15.72:0/1178757238 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4130009ae0 con 0x7f41380c06b0 2023-08-31T19:04:47.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.747+0000 7f41377fe700 1 --2- 172.21.15.72:0/1178757238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41380c7360 0x7f413814f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:04:47.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.747+0000 7f4137fff700 1 --2- 172.21.15.72:0/1178757238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41380c06b0 0x7f41380b02c0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f412800e900 tx=0x7f4128009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:47.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.747+0000 7f411ffff700 1 -- 172.21.15.72:0/1178757238 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4128012600 con 0x7f41380c06b0 2023-08-31T19:04:47.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.747+0000 7f411ffff700 1 -- 172.21.15.72:0/1178757238 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4128012760 con 0x7f41380c06b0 2023-08-31T19:04:47.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.747+0000 7f411ffff700 1 -- 172.21.15.72:0/1178757238 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4128012ae0 con 0x7f41380c06b0 2023-08-31T19:04:47.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.747+0000 7f413e9ff700 1 -- 172.21.15.72:0/1178757238 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4138157370 con 0x7f41380c06b0 2023-08-31T19:04:47.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.748+0000 7f413e9ff700 1 -- 172.21.15.72:0/1178757238 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4138156a60 con 0x7f41380c06b0 2023-08-31T19:04:47.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.749+0000 7f413e9ff700 1 -- 172.21.15.72:0/1178757238 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4138157ca0 con 0x7f41380c06b0 2023-08-31T19:04:47.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.749+0000 7f411ffff700 1 -- 172.21.15.72:0/1178757238 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 40) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f412801b400 con 0x7f41380c06b0 2023-08-31T19:04:47.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.750+0000 7f411ffff700 1 --2- 172.21.15.72:0/1178757238 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f412405ef50 0x7f4124061410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:47.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.750+0000 7f411ffff700 1 -- 172.21.15.72:0/1178757238 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f412807a5f0 con 0x7f41380c06b0 2023-08-31T19:04:47.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.750+0000 7f41377fe700 1 -- 172.21.15.72:0/1178757238 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f412405ef50 msgr2=0x7f4124061410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:47.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.750+0000 7f41377fe700 1 --2- 172.21.15.72:0/1178757238 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f412405ef50 0x7f4124061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:47.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.754+0000 7f411ffff700 1 -- 172.21.15.72:0/1178757238 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f412804b620 con 0x7f41380c06b0 2023-08-31T19:04:47.809 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:47.808+0000 7fd2b7622680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:04:47.826 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:47.826+0000 7fe24efef680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:04:47.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.940+0000 7f413e9ff700 1 -- 172.21.15.72:0/1178757238 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f41380c0c50 con 0x7f41380c06b0 2023-08-31T19:04:47.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.944+0000 7f411ffff700 1 -- 172.21.15.72:0/1178757238 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v19)=0 v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f412804ec40 con 0x7f41380c06b0 2023-08-31T19:04:47.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.946+0000 7f413e9ff700 1 -- 172.21.15.72:0/1178757238 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f412405ef50 msgr2=0x7f4124061410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:47.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.946+0000 7f413e9ff700 1 --2- 172.21.15.72:0/1178757238 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f412405ef50 0x7f4124061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:47.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.946+0000 7f413e9ff700 1 -- 172.21.15.72:0/1178757238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41380c06b0 msgr2=0x7f41380b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:47.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.946+0000 7f413e9ff700 1 --2- 172.21.15.72:0/1178757238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41380c06b0 0x7f41380b02c0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f412800e900 tx=0x7f4128009060).stop 2023-08-31T19:04:47.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.947+0000 7f413e9ff700 1 -- 172.21.15.72:0/1178757238 shutdown_connections 2023-08-31T19:04:47.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.947+0000 7f413e9ff700 1 --2- 172.21.15.72:0/1178757238 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f412405ef50 0x7f4124061410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:47.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.947+0000 7f413e9ff700 1 --2- 172.21.15.72:0/1178757238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4138154030 0x7f413814fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.947+0000 7f413e9ff700 1 --2- 172.21.15.72:0/1178757238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41380c06b0 0x7f41380b02c0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.947+0000 7f413e9ff700 1 --2- 172.21.15.72:0/1178757238 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41380c7360 0x7f413814f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.947+0000 7f413e9ff700 1 -- 172.21.15.72:0/1178757238 >> 172.21.15.72:0/1178757238 conn(0x7f413805eb60 msgr2=0x7f41380c9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.947+0000 7f413e9ff700 1 -- 172.21.15.72:0/1178757238 shutdown_connections 2023-08-31T19:04:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:47.947+0000 7f413e9ff700 1 -- 172.21.15.72:0/1178757238 wait complete. 2023-08-31T19:04:47.965 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-08-31T19:04:48.135 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:48.135+0000 7fd2b7622680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:04:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.161+0000 7fc22e9ff700 1 Processor -- start 2023-08-31T19:04:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.161+0000 7fc22e9ff700 1 -- start start 2023-08-31T19:04:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.162+0000 7fc22e9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc2281351e0 0x7fc2280c5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.162+0000 7fc22e9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2280c5d10 0x7fc2280bda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.163+0000 7fc22e9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2280c3130 con 0x7fc228134e00 2023-08-31T19:04:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.163+0000 7fc22e9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2280c4da0 con 0x7fc2281351e0 2023-08-31T19:04:48.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.163+0000 7fc22e9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280c3940 con 0x7fc2280c5d10 2023-08-31T19:04:48.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.163+0000 7fc2277fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc2281351e0 0x7fc2280c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:48.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.163+0000 7fc22cf9c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2280c5d10 0x7fc2280bda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:48.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.163+0000 7fc227fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc228134e00 0x7fc228068350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:45360/0 (socket says 172.21.15.72:45360) 2023-08-31T19:04:48.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.163+0000 7fc227fff700 1 -- 172.21.15.72:0/3489834200 learned_addr learned my addr 172.21.15.72:0/3489834200 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:48.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.163+0000 7fc22cf9c700 1 -- 172.21.15.72:0/3489834200 >> v2:172.21.15.146:3300/0 conn(0x7fc2281351e0 msgr2=0x7fc2280c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:48.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.163+0000 7fc22cf9c700 1 --2- 172.21.15.72:0/3489834200 >> v2:172.21.15.146:3300/0 conn(0x7fc2281351e0 0x7fc2280c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:48.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.164+0000 7fc22cf9c700 1 -- 172.21.15.72:0/3489834200 >> v1:172.21.15.146:6789/0 conn(0x7fc228134e00 legacy=0x7fc228068350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:48.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.164+0000 7fc22cf9c700 1 -- 172.21.15.72:0/3489834200 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2280c3380 con 0x7fc2280c5d10 2023-08-31T19:04:48.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.164+0000 7fc22cf9c700 1 --2- 172.21.15.72:0/3489834200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2280c5d10 0x7fc2280bda90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc220009e60 tx=0x7fc220009780).ready entity=mon.2 client_cookie=ea68c781e064f429 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:48.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.164+0000 7fc226ffd700 1 -- 172.21.15.72:0/3489834200 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22000e070 con 0x7fc2280c5d10 2023-08-31T19:04:48.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.164+0000 7fc226ffd700 1 -- 172.21.15.72:0/3489834200 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22000bb60 con 0x7fc2280c5d10 2023-08-31T19:04:48.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.164+0000 7fc226ffd700 1 -- 172.21.15.72:0/3489834200 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220012410 con 0x7fc2280c5d10 2023-08-31T19:04:48.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.165+0000 7fc22e9ff700 1 -- 172.21.15.72:0/3489834200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2280c5d10 msgr2=0x7fc2280bda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:48.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.165+0000 7fc22e9ff700 1 --2- 172.21.15.72:0/3489834200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2280c5d10 0x7fc2280bda90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc220009e60 tx=0x7fc220009780).stop 2023-08-31T19:04:48.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.165+0000 7fc22e9ff700 1 -- 172.21.15.72:0/3489834200 shutdown_connections 2023-08-31T19:04:48.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.165+0000 7fc22e9ff700 1 --2- 172.21.15.72:0/3489834200 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc2280c5d10 0x7fc2280bda90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:48.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.165+0000 7fc22e9ff700 1 --2- 172.21.15.72:0/3489834200 >> v2:172.21.15.146:3300/0 conn(0x7fc2281351e0 0x7fc2280c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:48.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.165+0000 7fc22e9ff700 1 -- 172.21.15.72:0/3489834200 >> 172.21.15.72:0/3489834200 conn(0x7fc228066350 msgr2=0x7fc228066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:48.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.165+0000 7fc22e9ff700 1 -- 172.21.15.72:0/3489834200 shutdown_connections 2023-08-31T19:04:48.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.165+0000 7fc22e9ff700 1 -- 172.21.15.72:0/3489834200 wait complete. 2023-08-31T19:04:48.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.166+0000 7fc22e9ff700 1 Processor -- start 2023-08-31T19:04:48.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.166+0000 7fc22e9ff700 1 -- start start 2023-08-31T19:04:48.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.167+0000 7fc22e9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2280c5d10 0x7fc2280a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:48.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.167+0000 7fc22e9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc228134e00 0x7fc2280c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:48.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.167+0000 7fc22e9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2281351e0 0x7fc2280c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:48.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.167+0000 7fc22e9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280c0860 con 0x7fc2281351e0 2023-08-31T19:04:48.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.167+0000 7fc22e9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280c2070 con 0x7fc2280c5d10 2023-08-31T19:04:48.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.167+0000 7fc22e9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2281394d0 con 0x7fc228134e00 2023-08-31T19:04:48.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.168+0000 7fc22cf9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2281351e0 0x7fc2280c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:48.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.168+0000 7fc227fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2280c5d10 0x7fc2280a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:48.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.168+0000 7fc22cf9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2281351e0 0x7fc2280c18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35210/0 (socket says 172.21.15.72:35210) 2023-08-31T19:04:48.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.168+0000 7fc22cf9c700 1 -- 172.21.15.72:0/1116200843 learned_addr learned my addr 172.21.15.72:0/1116200843 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:48.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.168+0000 7fc2277fe700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc228134e00 0x7fc2280c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:48.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.168+0000 7fc22cf9c700 1 -- 172.21.15.72:0/1116200843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc228134e00 msgr2=0x7fc2280c13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:48.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.168+0000 7fc22cf9c700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc228134e00 0x7fc2280c13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:48.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.168+0000 7fc22cf9c700 1 -- 172.21.15.72:0/1116200843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2280c5d10 msgr2=0x7fc2280a7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:48.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.168+0000 7fc22cf9c700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2280c5d10 0x7fc2280a7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:48.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.168+0000 7fc22cf9c700 1 -- 172.21.15.72:0/1116200843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc220009a20 con 0x7fc2281351e0 2023-08-31T19:04:48.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.168+0000 7fc227fff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2280c5d10 0x7fc2280a7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:04:48.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.168+0000 7fc22cf9c700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2281351e0 0x7fc2280c18d0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7fc22000b6c0 tx=0x7fc220009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:48.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.169+0000 7fc20ffff700 1 -- 172.21.15.72:0/1116200843 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220012410 con 0x7fc2281351e0 2023-08-31T19:04:48.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.169+0000 7fc20ffff700 1 -- 172.21.15.72:0/1116200843 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22001d630 con 0x7fc2281351e0 2023-08-31T19:04:48.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.169+0000 7fc22e9ff700 1 -- 172.21.15.72:0/1116200843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2280c1dc0 con 0x7fc2281351e0 2023-08-31T19:04:48.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.169+0000 7fc20ffff700 1 -- 172.21.15.72:0/1116200843 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22001d9f0 con 0x7fc2281351e0 2023-08-31T19:04:48.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.169+0000 7fc22e9ff700 1 -- 172.21.15.72:0/1116200843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc228138e80 con 0x7fc2281351e0 2023-08-31T19:04:48.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.170+0000 7fc22e9ff700 1 -- 172.21.15.72:0/1116200843 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc228139640 con 0x7fc2281351e0 2023-08-31T19:04:48.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.170+0000 7fc20ffff700 1 -- 172.21.15.72:0/1116200843 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 40) v1 ==== 75391+0+0 (secure 0 0 0) 0x7fc220003040 con 0x7fc2281351e0 2023-08-31T19:04:48.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.171+0000 7fc20ffff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 0x7fc214061410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:48.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.171+0000 7fc20ffff700 1 -- 172.21.15.72:0/1116200843 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6721+0+0 (secure 0 0 0) 0x7fc22007c150 con 0x7fc2281351e0 2023-08-31T19:04:48.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.171+0000 7fc227fff700 1 -- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 msgr2=0x7fc214061410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:48.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.171+0000 7fc227fff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 0x7fc214061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:04:48.177 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:48.173+0000 7fe24efef680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:04:48.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.175+0000 7fc20ffff700 1 -- 172.21.15.72:0/1116200843 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc22004d120 con 0x7fc2281351e0 2023-08-31T19:04:48.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.372+0000 7fc227fff700 1 -- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 msgr2=0x7fc214061410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:48.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.372+0000 7fc22e9ff700 1 -- 172.21.15.72:0/1116200843 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc22806c6b0 con 0x7fc21405ef50 2023-08-31T19:04:48.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.372+0000 7fc227fff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 0x7fc214061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:04:48.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.773+0000 7fc227fff700 1 -- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 msgr2=0x7fc214061410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:48.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:48.773+0000 7fc227fff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 0x7fc214061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-31T19:04:48.881 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:48.881+0000 7fd2b7622680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:04:48.919 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:48.919+0000 7fe24efef680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:04:48.963 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:48.963+0000 7fd2b7622680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:04:49.002 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:49.002+0000 7fe24efef680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:04:49.194 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:49.194+0000 7fd2b7622680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:04:49.233 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:49.232+0000 7fe24efef680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:04:49.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:49.574+0000 7fc227fff700 1 -- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 msgr2=0x7fc214061410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:49.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:49.574+0000 7fc227fff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 0x7fc214061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-31T19:04:49.704 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:49.703+0000 7fd2b7622680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:04:49.741 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:49.740+0000 7fe24efef680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:04:49.830 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:49.829+0000 7fd2b7622680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:04:49.867 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:49.867+0000 7fe24efef680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:04:50.015 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:50.015+0000 7fd2b7622680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:04:50.052 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:50.052+0000 7fe24efef680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:04:50.107 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:50.107+0000 7fd2b7622680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:04:50.144 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:50.144+0000 7fe24efef680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:04:50.191 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:50.190+0000 7fd2b7622680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:04:50.228 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:50.228+0000 7fe24efef680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:04:50.499 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:50.499+0000 7fd2b7622680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:04:50.536 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:50.535+0000 7fe24efef680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:04:50.721 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:50.721+0000 7fd2b7622680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:04:50.757 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:50.756+0000 7fe24efef680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:04:51.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:51.175+0000 7fc227fff700 1 -- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 msgr2=0x7fc214061410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:04:51.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:51.175+0000 7fc227fff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 0x7fc214061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-31T19:04:51.519 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:51.519+0000 7fd2b7622680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:04:51.553 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:51.553+0000 7fe24efef680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:04:51.605 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:51.605+0000 7fd2b7622680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:04:51.640 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:51.640+0000 7fe24efef680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:04:51.699 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:51.698+0000 7fd2b7622680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:04:51.734 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:51.734+0000 7fe24efef680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:04:51.880 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:51.880+0000 7fd2b7622680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:04:51.923 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:51.923+0000 7fe24efef680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:04:51.971 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:51.971+0000 7fd2b7622680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:04:52.013 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:52.013+0000 7fe24efef680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:04:52.111 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:52.110+0000 7fd2b7622680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:04:52.155 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:52.155+0000 7fe24efef680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:04:52.240 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:52.240+0000 7fd2b7622680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:04:52.286 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:52.286+0000 7fe24efef680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:04:52.585 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:52.585+0000 7fd2b7622680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:04:52.631 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:52.631+0000 7fe24efef680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:04:52.673 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:04:52.673+0000 7fd2b7622680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:04:52.721 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:52.721+0000 7fe24efef680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:04:52.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:52.729+0000 7fc20ffff700 1 -- 172.21.15.72:0/1116200843 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 41) v1 ==== 75113+0+0 (secure 0 0 0) 0x7fc220079a80 con 0x7fc2281351e0 2023-08-31T19:04:52.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:52.729+0000 7fc20ffff700 1 -- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 msgr2=0x7fc214061410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:04:52.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:52.729+0000 7fc20ffff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 0x7fc214061410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:04:52.802 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:52.801+0000 7fe1c3ac5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:52.802 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:52.801+0000 7fe1c3ac5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:52.802 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:52.801+0000 7fe1c3ac5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:52.802 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:52.801+0000 7fe1c3ac5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:52.803 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:52.801+0000 7fe1c3ac5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:52.803 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:52.801+0000 7fe1c0abf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:52.803 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:52.801+0000 7fe1c0abf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:52.803 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:52.801+0000 7fe1c0abf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:52.803 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:52.801+0000 7fe1c0abf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:52.804 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:04:52.801+0000 7fe1c0abf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:04:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.746+0000 7fc20ffff700 1 -- 172.21.15.72:0/1116200843 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mgrmap(e 42) v1 ==== 75183+0+0 (secure 0 0 0) 0x7fc220079e00 con 0x7fc2281351e0 2023-08-31T19:04:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.747+0000 7fc20ffff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 0x7fc214061390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.747+0000 7fc20ffff700 1 -- 172.21.15.72:0/1116200843 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc22806c6b0 con 0x7fc21405ef50 2023-08-31T19:04:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.748+0000 7fc227fff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 0x7fc214061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:53.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.749+0000 7fc227fff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 0x7fc214061390 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fc218007fd0 tx=0x7fc218007d90).ready entity=mgr.7323 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:53.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.759+0000 7fc20ffff700 1 -- 172.21.15.72:0/1116200843 <== mgr.7323 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fc22806c6b0 con 0x7fc21405ef50 2023-08-31T19:04:53.759 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path /bad-path 2023-08-31T19:04:53.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.761+0000 7fc22e9ff700 1 -- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 msgr2=0x7fc214061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:53.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.761+0000 7fc22e9ff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 0x7fc214061390 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fc218007fd0 tx=0x7fc218007d90).stop 2023-08-31T19:04:53.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.761+0000 7fc22e9ff700 1 -- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2281351e0 msgr2=0x7fc2280c18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:53.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.761+0000 7fc22e9ff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2281351e0 0x7fc2280c18d0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7fc22000b6c0 tx=0x7fc220009780).stop 2023-08-31T19:04:53.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.761+0000 7fc22e9ff700 1 -- 172.21.15.72:0/1116200843 shutdown_connections 2023-08-31T19:04:53.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.761+0000 7fc22e9ff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2281351e0 0x7fc2280c18d0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:53.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.761+0000 7fc22e9ff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc21405ef50 0x7fc214061390 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:53.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.761+0000 7fc22e9ff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc2280c5d10 0x7fc2280a7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:53.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.761+0000 7fc22e9ff700 1 --2- 172.21.15.72:0/1116200843 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc228134e00 0x7fc2280c13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:53.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.761+0000 7fc22e9ff700 1 -- 172.21.15.72:0/1116200843 >> 172.21.15.72:0/1116200843 conn(0x7fc228066350 msgr2=0x7fc228066b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:53.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.761+0000 7fc22e9ff700 1 -- 172.21.15.72:0/1116200843 shutdown_connections 2023-08-31T19:04:53.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.761+0000 7fc22e9ff700 1 -- 172.21.15.72:0/1116200843 wait complete. 2023-08-31T19:04:53.781 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-08-31T19:04:53.782 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-08-31T19:04:53.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.978+0000 7f9874bff700 1 Processor -- start 2023-08-31T19:04:53.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.979+0000 7f9874bff700 1 -- start start 2023-08-31T19:04:53.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.980+0000 7f9874bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9870064db0 0x7f98700a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:53.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.980+0000 7f9874bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98700aa620 con 0x7f9870154120 2023-08-31T19:04:53.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.980+0000 7f9874bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98700aa3a0 con 0x7f9870154500 2023-08-31T19:04:53.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.980+0000 7f9874bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98700c5450 con 0x7f9870064db0 2023-08-31T19:04:53.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.980+0000 7f986e59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9870154120 0x7f98700646a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:46028/0 (socket says 172.21.15.72:46028) 2023-08-31T19:04:53.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.980+0000 7f986e59c700 1 -- 172.21.15.72:0/3950793437 learned_addr learned my addr 172.21.15.72:0/3950793437 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:04:53.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.980+0000 7f986dd9b700 1 --2- 172.21.15.72:0/3950793437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9870064db0 0x7f98700a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:53.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.980+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672540972 0 0) 0x7f98700aa620 con 0x7f9870154120 2023-08-31T19:04:53.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98580033f0 con 0x7f9870154120 2023-08-31T19:04:53.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833066902 0 0) 0x7f98700aa3a0 con 0x7f9870154500 2023-08-31T19:04:53.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98700aa620 con 0x7f9870154500 2023-08-31T19:04:53.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3353494755 0 0) 0x7f98580033f0 con 0x7f9870154120 2023-08-31T19:04:53.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9870064db0 msgr2=0x7f98700a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:53.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 --2- 172.21.15.72:0/3950793437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9870064db0 0x7f98700a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:53.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 >> v1:172.21.15.146:6789/0 conn(0x7f9870154500 legacy=0x7f987015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:53.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98700c8050 con 0x7f9870154120 2023-08-31T19:04:53.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f9860001470 con 0x7f9870154120 2023-08-31T19:04:53.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 >> v1:172.21.15.72:6789/0 conn(0x7f9870154120 legacy=0x7f98700646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:53.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 --2- 172.21.15.72:0/3950793437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9870064db0 0x7f9858003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:53.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 --2- 172.21.15.72:0/3950793437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9858003fb0 0x7f9858004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:53.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 --2- 172.21.15.72:0/3950793437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9858004b80 0x7f9858005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:53.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98700c5450 con 0x7f9858004b80 2023-08-31T19:04:53.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985800b990 con 0x7f9858003fb0 2023-08-31T19:04:53.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985800bb50 con 0x7f9870064db0 2023-08-31T19:04:53.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986ed9d700 1 --2- 172.21.15.72:0/3950793437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9858004b80 0x7f9858005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:53.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986dd9b700 1 --2- 172.21.15.72:0/3950793437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9858003fb0 0x7f9858004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:53.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.981+0000 7f986e59c700 1 --2- 172.21.15.72:0/3950793437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9870064db0 0x7f9858003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:53.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.982+0000 7f986ed9d700 1 -- 172.21.15.72:0/3950793437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9870064db0 msgr2=0x7f9858003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:53.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.982+0000 7f986ed9d700 1 --2- 172.21.15.72:0/3950793437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9870064db0 0x7f9858003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:53.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.982+0000 7f986ed9d700 1 -- 172.21.15.72:0/3950793437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9858003fb0 msgr2=0x7f9858004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:04:53.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.982+0000 7f986ed9d700 1 --2- 172.21.15.72:0/3950793437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9858003fb0 0x7f9858004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:53.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.982+0000 7f986ed9d700 1 -- 172.21.15.72:0/3950793437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98580033f0 con 0x7f9858004b80 2023-08-31T19:04:53.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.982+0000 7f986ed9d700 1 --2- 172.21.15.72:0/3950793437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9858004b80 0x7f9858005000 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f9870065340 tx=0x7f9868007f30).ready entity=mon.0 client_cookie=c101c0e43039c45f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:53.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.982+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9868006a20 con 0x7f9858004b80 2023-08-31T19:04:53.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.982+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9868006b80 con 0x7f9858004b80 2023-08-31T19:04:53.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.982+0000 7f986d59a700 1 -- 172.21.15.72:0/3950793437 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986800c700 con 0x7f9858004b80 2023-08-31T19:04:53.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.983+0000 7f9874bff700 1 -- 172.21.15.72:0/3950793437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9858004b80 msgr2=0x7f9858005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:53.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.983+0000 7f9874bff700 1 --2- 172.21.15.72:0/3950793437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9858004b80 0x7f9858005000 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f9870065340 tx=0x7f9868007f30).stop 2023-08-31T19:04:53.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.983+0000 7f986ed9d700 1 -- 172.21.15.72:0/3950793437 reap_dead start 2023-08-31T19:04:53.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.983+0000 7f9874bff700 1 -- 172.21.15.72:0/3950793437 shutdown_connections 2023-08-31T19:04:53.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.983+0000 7f9874bff700 1 -- 172.21.15.72:0/3950793437 >> 172.21.15.72:0/3950793437 conn(0x7f98700cb7e0 msgr2=0x7f98700c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:53.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.983+0000 7f9874bff700 1 -- 172.21.15.72:0/3950793437 shutdown_connections 2023-08-31T19:04:53.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.983+0000 7f9874bff700 1 -- 172.21.15.72:0/3950793437 wait complete. 2023-08-31T19:04:53.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.985+0000 7f9874bff700 1 Processor -- start 2023-08-31T19:04:53.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.985+0000 7f9874bff700 1 -- start start 2023-08-31T19:04:53.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.986+0000 7f9874bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9858004b80 0x7f987014eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:53.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.986+0000 7f9874bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98700c4500 0x7f9870062cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:53.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.986+0000 7f9874bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98700c4980 0x7f98700631e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:53.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.986+0000 7f9874bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98700636d0 con 0x7f98700c4980 2023-08-31T19:04:53.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.986+0000 7f9874bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9870169a00 con 0x7f98700c4500 2023-08-31T19:04:53.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.986+0000 7f9874bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9870168e80 con 0x7f9858004b80 2023-08-31T19:04:53.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.987+0000 7f986ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98700c4980 0x7f98700631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:53.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.987+0000 7f986ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98700c4980 0x7f98700631e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41012/0 (socket says 172.21.15.72:41012) 2023-08-31T19:04:53.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.987+0000 7f986ed9d700 1 -- 172.21.15.72:0/1863986656 learned_addr learned my addr 172.21.15.72:0/1863986656 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:04:53.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.987+0000 7f986dd9b700 1 --2- 172.21.15.72:0/1863986656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98700c4500 0x7f9870062cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:53.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.987+0000 7f986e59c700 1 --2- 172.21.15.72:0/1863986656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9858004b80 0x7f987014eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:53.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.987+0000 7f986ed9d700 1 -- 172.21.15.72:0/1863986656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9858004b80 msgr2=0x7f987014eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:53.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.987+0000 7f986ed9d700 1 --2- 172.21.15.72:0/1863986656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9858004b80 0x7f987014eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:53.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.987+0000 7f986ed9d700 1 -- 172.21.15.72:0/1863986656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98700c4500 msgr2=0x7f9870062cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:53.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.987+0000 7f986ed9d700 1 --2- 172.21.15.72:0/1863986656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98700c4500 0x7f9870062cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:53.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.987+0000 7f986ed9d700 1 -- 172.21.15.72:0/1863986656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9870169160 con 0x7f98700c4980 2023-08-31T19:04:53.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.987+0000 7f986ed9d700 1 --2- 172.21.15.72:0/1863986656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98700c4980 0x7f98700631e0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f9868011000 tx=0x7f9868016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:53.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.987+0000 7f985e7fc700 1 -- 172.21.15.72:0/1863986656 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9868006a20 con 0x7f98700c4980 2023-08-31T19:04:53.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.987+0000 7f985e7fc700 1 -- 172.21.15.72:0/1863986656 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986800c700 con 0x7f98700c4980 2023-08-31T19:04:53.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.987+0000 7f9874bff700 1 -- 172.21.15.72:0/1863986656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9870169440 con 0x7f98700c4980 2023-08-31T19:04:53.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.987+0000 7f985e7fc700 1 -- 172.21.15.72:0/1863986656 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9868012860 con 0x7f98700c4980 2023-08-31T19:04:53.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.988+0000 7f9874bff700 1 -- 172.21.15.72:0/1863986656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987014f060 con 0x7f98700c4980 2023-08-31T19:04:53.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.989+0000 7f9874bff700 1 -- 172.21.15.72:0/1863986656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98700addb0 con 0x7f98700c4980 2023-08-31T19:04:53.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.989+0000 7f985e7fc700 1 -- 172.21.15.72:0/1863986656 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 42) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f9868012bd0 con 0x7f98700c4980 2023-08-31T19:04:53.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.990+0000 7f985e7fc700 1 --2- 172.21.15.72:0/1863986656 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f985005ed40 0x7f9850061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:04:53.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.990+0000 7f985e7fc700 1 -- 172.21.15.72:0/1863986656 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f986807aea0 con 0x7f98700c4980 2023-08-31T19:04:54.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.991+0000 7f986e59c700 1 --2- 172.21.15.72:0/1863986656 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f985005ed40 0x7f9850061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:04:54.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.991+0000 7f986e59c700 1 --2- 172.21.15.72:0/1863986656 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f985005ed40 0x7f9850061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9860001200 tx=0x7f9860001df0).ready entity=mgr.7323 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:04:54.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:53.995+0000 7f985e7fc700 1 -- 172.21.15.72:0/1863986656 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f98700addb0 con 0x7f98700c4980 2023-08-31T19:04:54.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:54.187+0000 7f9874bff700 1 -- 172.21.15.72:0/1863986656 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98700addb0 con 0x7f985005ed40 2023-08-31T19:04:54.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:54.190+0000 7f985e7fc700 1 -- 172.21.15.72:0/1863986656 <== mgr.7323 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7f98700addb0 con 0x7f985005ed40 2023-08-31T19:04:54.190 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:04:54.190 INFO:teuthology.orchestra.run.smithi072.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T19:04:53", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-08-31T19:04:54.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:54.192+0000 7f9874bff700 1 -- 172.21.15.72:0/1863986656 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f985005ed40 msgr2=0x7f9850061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:54.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:54.192+0000 7f9874bff700 1 --2- 172.21.15.72:0/1863986656 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f985005ed40 0x7f9850061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9860001200 tx=0x7f9860001df0).stop 2023-08-31T19:04:54.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:54.192+0000 7f9874bff700 1 -- 172.21.15.72:0/1863986656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98700c4980 msgr2=0x7f98700631e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:04:54.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:54.192+0000 7f9874bff700 1 --2- 172.21.15.72:0/1863986656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98700c4980 0x7f98700631e0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f9868011000 tx=0x7f9868016000).stop 2023-08-31T19:04:54.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:54.192+0000 7f9874bff700 1 -- 172.21.15.72:0/1863986656 shutdown_connections 2023-08-31T19:04:54.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:54.192+0000 7f9874bff700 1 --2- 172.21.15.72:0/1863986656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98700c4980 0x7f98700631e0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:54.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:54.192+0000 7f9874bff700 1 --2- 172.21.15.72:0/1863986656 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9858004b80 0x7f987014eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:54.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:54.192+0000 7f9874bff700 1 --2- 172.21.15.72:0/1863986656 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f985005ed40 0x7f9850061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:54.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:54.192+0000 7f9874bff700 1 --2- 172.21.15.72:0/1863986656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98700c4500 0x7f9870062cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:04:54.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:54.192+0000 7f9874bff700 1 -- 172.21.15.72:0/1863986656 >> 172.21.15.72:0/1863986656 conn(0x7f98700cb7e0 msgr2=0x7f98700c8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:04:54.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:54.192+0000 7f9874bff700 1 -- 172.21.15.72:0/1863986656 shutdown_connections 2023-08-31T19:04:54.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:04:54.192+0000 7f9874bff700 1 -- 172.21.15.72:0/1863986656 wait complete. 2023-08-31T19:04:54.210 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T19:04:53", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-08-31T19:04:54.493 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:04:54.498 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:05:00.765 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:00.765+0000 7fe1b42a6700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:05:00.766 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:00.765+0000 7fe1b42a6700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:05:00.766 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:00.765+0000 7fe1b42a6700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:05:00.766 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:00.765+0000 7fe1b42a6700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:05:00.766 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:00.765+0000 7fe1b42a6700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:05:24.705 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:05:24.711 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:05:54.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-08-31T19:05:54.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.414+0000 7f76d47ff700 1 Processor -- start 2023-08-31T19:05:54.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.414+0000 7f76d47ff700 1 -- start start 2023-08-31T19:05:54.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.415+0000 7f76d47ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f76cc0c4bb0 0x7f76cc0653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:54.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.415+0000 7f76d47ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76cc13d960 0x7f76cc0c5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:54.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.415+0000 7f76d47ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76cc0c5d10 con 0x7f76cc0c5880 2023-08-31T19:05:54.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.415+0000 7f76d47ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76cc0c4f90 con 0x7f76cc0c4bb0 2023-08-31T19:05:54.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.415+0000 7f76d47ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0c6020 con 0x7f76cc13d960 2023-08-31T19:05:54.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.416+0000 7f76d2d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f76cc0c5880 0x7f76cc1546b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51474/0 (socket says 172.21.15.72:51474) 2023-08-31T19:05:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.416+0000 7f76d2d9c700 1 -- 172.21.15.72:0/1262600985 learned_addr learned my addr 172.21.15.72:0/1262600985 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:05:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.416+0000 7f76d1d9a700 1 --2- 172.21.15.72:0/1262600985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76cc13d960 0x7f76cc0c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.416+0000 7f76d1599700 1 -- 172.21.15.72:0/1262600985 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424487246 0 0) 0x7f76cc0c5d10 con 0x7f76cc0c5880 2023-08-31T19:05:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.416+0000 7f76d259b700 1 --2- 172.21.15.72:0/1262600985 >> v2:172.21.15.146:3300/0 conn(0x7f76cc0c4bb0 0x7f76cc0653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:54.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.416+0000 7f76d1599700 1 -- 172.21.15.72:0/1262600985 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76b80033f0 con 0x7f76cc0c5880 2023-08-31T19:05:54.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.416+0000 7f76d1599700 1 -- 172.21.15.72:0/1262600985 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 830535562 0 0) 0x7f76b80033f0 con 0x7f76cc0c5880 2023-08-31T19:05:54.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.416+0000 7f76d1599700 1 -- 172.21.15.72:0/1262600985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76cc13d960 msgr2=0x7f76cc0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:54.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.416+0000 7f76d1599700 1 --2- 172.21.15.72:0/1262600985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76cc13d960 0x7f76cc0c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:54.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.416+0000 7f76d1599700 1 -- 172.21.15.72:0/1262600985 >> v2:172.21.15.146:3300/0 conn(0x7f76cc0c4bb0 msgr2=0x7f76cc0653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:54.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.416+0000 7f76d1599700 1 --2- 172.21.15.72:0/1262600985 >> v2:172.21.15.146:3300/0 conn(0x7f76cc0c4bb0 0x7f76cc0653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:54.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.416+0000 7f76d1599700 1 -- 172.21.15.72:0/1262600985 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc1587f0 con 0x7f76cc0c5880 2023-08-31T19:05:54.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.416+0000 7f76d1599700 1 -- 172.21.15.72:0/1262600985 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f76c40017f0 con 0x7f76cc0c5880 2023-08-31T19:05:54.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.416+0000 7f76d1599700 1 -- 172.21.15.72:0/1262600985 >> v1:172.21.15.72:6789/0 conn(0x7f76cc0c5880 legacy=0x7f76cc1546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:54.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.417+0000 7f76d1599700 1 --2- 172.21.15.72:0/1262600985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76b80038e0 0x7f76b8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:54.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.417+0000 7f76d1599700 1 --2- 172.21.15.72:0/1262600985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b8004690 0x7f76b8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:54.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.417+0000 7f76d1599700 1 --2- 172.21.15.72:0/1262600985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76cc13d960 0x7f76b8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:54.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.417+0000 7f76d1599700 1 -- 172.21.15.72:0/1262600985 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0c4f90 con 0x7f76b8004690 2023-08-31T19:05:54.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.417+0000 7f76d1599700 1 -- 172.21.15.72:0/1262600985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0c6020 con 0x7f76b80038e0 2023-08-31T19:05:54.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.417+0000 7f76d1599700 1 -- 172.21.15.72:0/1262600985 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b800b8e0 con 0x7f76cc13d960 2023-08-31T19:05:54.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.417+0000 7f76d1d9a700 1 --2- 172.21.15.72:0/1262600985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b8004690 0x7f76b8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:54.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.417+0000 7f76d259b700 1 --2- 172.21.15.72:0/1262600985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76b80038e0 0x7f76b8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:54.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.417+0000 7f76d2d9c700 1 --2- 172.21.15.72:0/1262600985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76cc13d960 0x7f76b8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:54.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.417+0000 7f76d1d9a700 1 -- 172.21.15.72:0/1262600985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76cc13d960 msgr2=0x7f76b8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.417+0000 7f76d1d9a700 1 --2- 172.21.15.72:0/1262600985 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76cc13d960 0x7f76b8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.417+0000 7f76d1d9a700 1 -- 172.21.15.72:0/1262600985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76b80038e0 msgr2=0x7f76b8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.417+0000 7f76d1d9a700 1 --2- 172.21.15.72:0/1262600985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76b80038e0 0x7f76b8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.417+0000 7f76d1d9a700 1 -- 172.21.15.72:0/1262600985 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b80033f0 con 0x7f76b8004690 2023-08-31T19:05:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.417+0000 7f76d1d9a700 1 --2- 172.21.15.72:0/1262600985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b8004690 0x7f76b8004b10 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f76cc13ddc0 tx=0x7f76bc009060).ready entity=mon.0 client_cookie=d2c2133d3bf570f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.418+0000 7f76d1599700 1 -- 172.21.15.72:0/1262600985 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc009e90 con 0x7f76b8004690 2023-08-31T19:05:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.418+0000 7f76d1599700 1 -- 172.21.15.72:0/1262600985 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc009430 con 0x7f76b8004690 2023-08-31T19:05:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.418+0000 7f76d1599700 1 -- 172.21.15.72:0/1262600985 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc00e850 con 0x7f76b8004690 2023-08-31T19:05:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.418+0000 7f76d47ff700 1 -- 172.21.15.72:0/1262600985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b8004690 msgr2=0x7f76b8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.418+0000 7f76d47ff700 1 --2- 172.21.15.72:0/1262600985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b8004690 0x7f76b8004b10 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f76cc13ddc0 tx=0x7f76bc009060).stop 2023-08-31T19:05:54.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.418+0000 7f76d2d9c700 1 -- 172.21.15.72:0/1262600985 reap_dead start 2023-08-31T19:05:54.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.418+0000 7f76d47ff700 1 -- 172.21.15.72:0/1262600985 shutdown_connections 2023-08-31T19:05:54.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.418+0000 7f76d47ff700 1 -- 172.21.15.72:0/1262600985 >> 172.21.15.72:0/1262600985 conn(0x7f76cc066350 msgr2=0x7f76cc066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:54.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.418+0000 7f76d47ff700 1 -- 172.21.15.72:0/1262600985 shutdown_connections 2023-08-31T19:05:54.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.418+0000 7f76d47ff700 1 -- 172.21.15.72:0/1262600985 wait complete. 2023-08-31T19:05:54.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.420+0000 7f76d47ff700 1 Processor -- start 2023-08-31T19:05:54.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.420+0000 7f76d47ff700 1 -- start start 2023-08-31T19:05:54.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d47ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76b8004690 0x7f76cc156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:54.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d47ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76cc13a150 0x7f76cc13a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:54.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d47ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76cc167600 0x7f76cc167a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:54.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d47ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0c1b20 con 0x7f76cc167600 2023-08-31T19:05:54.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d47ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc1571e0 con 0x7f76cc13a150 2023-08-31T19:05:54.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d47ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc1574c0 con 0x7f76b8004690 2023-08-31T19:05:54.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d2d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76cc167600 0x7f76cc167a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:54.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d2d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76cc167600 0x7f76cc167a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51320/0 (socket says 172.21.15.72:51320) 2023-08-31T19:05:54.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d2d9c700 1 -- 172.21.15.72:0/1210065528 learned_addr learned my addr 172.21.15.72:0/1210065528 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:54.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d259b700 1 --2- 172.21.15.72:0/1210065528 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76b8004690 0x7f76cc156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:54.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d1d9a700 1 --2- 172.21.15.72:0/1210065528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76cc13a150 0x7f76cc13a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:54.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d2d9c700 1 -- 172.21.15.72:0/1210065528 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76b8004690 msgr2=0x7f76cc156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:54.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d2d9c700 1 --2- 172.21.15.72:0/1210065528 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76b8004690 0x7f76cc156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:54.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d2d9c700 1 -- 172.21.15.72:0/1210065528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76cc13a150 msgr2=0x7f76cc13a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:54.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d2d9c700 1 --2- 172.21.15.72:0/1210065528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76cc13a150 0x7f76cc13a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:54.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d2d9c700 1 -- 172.21.15.72:0/1210065528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc1577a0 con 0x7f76cc167600 2023-08-31T19:05:54.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d1d9a700 1 --2- 172.21.15.72:0/1210065528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76cc13a150 0x7f76cc13a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:05:54.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.421+0000 7f76d2d9c700 1 --2- 172.21.15.72:0/1210065528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76cc167600 0x7f76cc167a60 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f76cc0658c0 tx=0x7f76c4002210).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.422+0000 7f76c27fc700 1 -- 172.21.15.72:0/1210065528 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4001f50 con 0x7f76cc167600 2023-08-31T19:05:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.422+0000 7f76c27fc700 1 -- 172.21.15.72:0/1210065528 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c40017b0 con 0x7f76cc167600 2023-08-31T19:05:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.422+0000 7f76c27fc700 1 -- 172.21.15.72:0/1210065528 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c400fc30 con 0x7f76cc167600 2023-08-31T19:05:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.422+0000 7f76d47ff700 1 -- 172.21.15.72:0/1210065528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc13aeb0 con 0x7f76cc167600 2023-08-31T19:05:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.422+0000 7f76d47ff700 1 -- 172.21.15.72:0/1210065528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc13aaa0 con 0x7f76cc167600 2023-08-31T19:05:54.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.423+0000 7f76d47ff700 1 -- 172.21.15.72:0/1210065528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76cc13b3d0 con 0x7f76cc167600 2023-08-31T19:05:54.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.423+0000 7f76c27fc700 1 -- 172.21.15.72:0/1210065528 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 44) v1 ==== 75505+0+0 (secure 0 0 0) 0x7f76c401c360 con 0x7f76cc167600 2023-08-31T19:05:54.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.424+0000 7f76c27fc700 1 --2- 172.21.15.72:0/1210065528 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f76b005f070 0x7f76b0061530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:54.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.424+0000 7f76c27fc700 1 -- 172.21.15.72:0/1210065528 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7124+0+0 (secure 0 0 0) 0x7f76c4079d70 con 0x7f76cc167600 2023-08-31T19:05:54.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.425+0000 7f76d259b700 1 --2- 172.21.15.72:0/1210065528 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f76b005f070 0x7f76b0061530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:54.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.425+0000 7f76d259b700 1 --2- 172.21.15.72:0/1210065528 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f76b005f070 0x7f76b0061530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f76c8006d80 tx=0x7f76c8009060).ready entity=mgr.7323 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:54.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.428+0000 7f76c27fc700 1 -- 172.21.15.72:0/1210065528 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f76c40498f0 con 0x7f76cc167600 2023-08-31T19:05:54.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.622+0000 7f76d47ff700 1 -- 172.21.15.72:0/1210065528 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76cc06c6b0 con 0x7f76b005f070 2023-08-31T19:05:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.624+0000 7f76c27fc700 1 -- 172.21.15.72:0/1210065528 <== mgr.7323 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7f76cc06c6b0 con 0x7f76b005f070 2023-08-31T19:05:54.625 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:05:54.625 INFO:teuthology.orchestra.run.smithi072.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T19:04:53", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-08-31T19:05:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.627+0000 7f76d47ff700 1 -- 172.21.15.72:0/1210065528 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f76b005f070 msgr2=0x7f76b0061530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:54.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.627+0000 7f76d47ff700 1 --2- 172.21.15.72:0/1210065528 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f76b005f070 0x7f76b0061530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f76c8006d80 tx=0x7f76c8009060).stop 2023-08-31T19:05:54.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.627+0000 7f76d47ff700 1 -- 172.21.15.72:0/1210065528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76cc167600 msgr2=0x7f76cc167a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:54.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.627+0000 7f76d47ff700 1 --2- 172.21.15.72:0/1210065528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76cc167600 0x7f76cc167a60 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f76cc0658c0 tx=0x7f76c4002210).stop 2023-08-31T19:05:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.627+0000 7f76d47ff700 1 -- 172.21.15.72:0/1210065528 shutdown_connections 2023-08-31T19:05:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.627+0000 7f76d47ff700 1 --2- 172.21.15.72:0/1210065528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76cc167600 0x7f76cc167a60 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.627+0000 7f76d47ff700 1 --2- 172.21.15.72:0/1210065528 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76b8004690 0x7f76cc156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.627+0000 7f76d47ff700 1 --2- 172.21.15.72:0/1210065528 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f76b005f070 0x7f76b0061530 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.627+0000 7f76d47ff700 1 --2- 172.21.15.72:0/1210065528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76cc13a150 0x7f76cc13a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.627+0000 7f76d47ff700 1 -- 172.21.15.72:0/1210065528 >> 172.21.15.72:0/1210065528 conn(0x7f76cc066350 msgr2=0x7f76cc066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.627+0000 7f76d47ff700 1 -- 172.21.15.72:0/1210065528 shutdown_connections 2023-08-31T19:05:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.627+0000 7f76d47ff700 1 -- 172.21.15.72:0/1210065528 wait complete. 2023-08-31T19:05:54.644 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T19:04:53", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-08-31T19:05:54.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-08-31T19:05:54.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.838+0000 7f05123ff700 1 Processor -- start 2023-08-31T19:05:54.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.838+0000 7f05123ff700 1 -- start start 2023-08-31T19:05:54.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.840+0000 7f05123ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f050c154120 0x7f050c0a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:54.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.840+0000 7f05123ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050c154500 0x7f050c0646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:54.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.840+0000 7f05123ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c0aa620 con 0x7f050c064b90 2023-08-31T19:05:54.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.840+0000 7f05123ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050c0aa3a0 con 0x7f050c154120 2023-08-31T19:05:54.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.840+0000 7f05123ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c064ff0 con 0x7f050c154500 2023-08-31T19:05:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.840+0000 7f050bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f050c154120 0x7f050c0a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.840+0000 7f050bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f050c154120 0x7f050c0a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51326/0 (socket says 172.21.15.72:51326) 2023-08-31T19:05:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.840+0000 7f050bfff700 1 -- 172.21.15.72:0/4260503509 learned_addr learned my addr 172.21.15.72:0/4260503509 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.840+0000 7f050b7fe700 1 --2- 172.21.15.72:0/4260503509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050c154500 0x7f050c0646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.841+0000 7f050bfff700 1 -- 172.21.15.72:0/4260503509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050c154500 msgr2=0x7f050c0646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.841+0000 7f050bfff700 1 --2- 172.21.15.72:0/4260503509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050c154500 0x7f050c0646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.841+0000 7f050bfff700 1 -- 172.21.15.72:0/4260503509 >> v1:172.21.15.146:6789/0 conn(0x7f050c064b90 legacy=0x7f050c0c0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.841+0000 7f050bfff700 1 -- 172.21.15.72:0/4260503509 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c0c5450 con 0x7f050c154120 2023-08-31T19:05:54.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.841+0000 7f050bfff700 1 --2- 172.21.15.72:0/4260503509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050c154120 0x7f050c0a9eb0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f04fc006fd0 tx=0x7f04fc0090f0).ready entity=mon.0 client_cookie=bb55f00520acff71 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:54.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.841+0000 7f050affd700 1 -- 172.21.15.72:0/4260503509 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc00b600 con 0x7f050c154120 2023-08-31T19:05:54.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.841+0000 7f050affd700 1 -- 172.21.15.72:0/4260503509 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc00b760 con 0x7f050c154120 2023-08-31T19:05:54.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.841+0000 7f050affd700 1 -- 172.21.15.72:0/4260503509 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc00bae0 con 0x7f050c154120 2023-08-31T19:05:54.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.842+0000 7f05123ff700 1 -- 172.21.15.72:0/4260503509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050c154120 msgr2=0x7f050c0a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.842+0000 7f05123ff700 1 --2- 172.21.15.72:0/4260503509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050c154120 0x7f050c0a9eb0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f04fc006fd0 tx=0x7f04fc0090f0).stop 2023-08-31T19:05:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.842+0000 7f05123ff700 1 -- 172.21.15.72:0/4260503509 shutdown_connections 2023-08-31T19:05:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.842+0000 7f05123ff700 1 --2- 172.21.15.72:0/4260503509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050c154120 0x7f050c0a9eb0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.842+0000 7f05123ff700 1 --2- 172.21.15.72:0/4260503509 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050c154500 0x7f050c0646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.842+0000 7f05123ff700 1 -- 172.21.15.72:0/4260503509 >> 172.21.15.72:0/4260503509 conn(0x7f050c0cb7e0 msgr2=0x7f050c0c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.842+0000 7f05123ff700 1 -- 172.21.15.72:0/4260503509 shutdown_connections 2023-08-31T19:05:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.842+0000 7f05123ff700 1 -- 172.21.15.72:0/4260503509 wait complete. 2023-08-31T19:05:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.843+0000 7f05123ff700 1 Processor -- start 2023-08-31T19:05:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.843+0000 7f05123ff700 1 -- start start 2023-08-31T19:05:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.844+0000 7f05123ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f050c064b90 0x7f050c144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.844+0000 7f05123ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050c154120 0x7f050c167a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.844+0000 7f05123ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050c154500 0x7f050c167f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.844+0000 7f05123ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c168410 con 0x7f050c154500 2023-08-31T19:05:54.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.844+0000 7f05123ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c165ec0 con 0x7f050c064b90 2023-08-31T19:05:54.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.844+0000 7f05123ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c144e00 con 0x7f050c154120 2023-08-31T19:05:54.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.845+0000 7f051099c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050c154500 0x7f050c167f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:54.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.845+0000 7f051099c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050c154500 0x7f050c167f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51338/0 (socket says 172.21.15.72:51338) 2023-08-31T19:05:54.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.845+0000 7f051099c700 1 -- 172.21.15.72:0/3358129245 learned_addr learned my addr 172.21.15.72:0/3358129245 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.845+0000 7f050bfff700 1 --2- 172.21.15.72:0/3358129245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f050c064b90 0x7f050c144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.845+0000 7f050b7fe700 1 --2- 172.21.15.72:0/3358129245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050c154120 0x7f050c167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.845+0000 7f051099c700 1 -- 172.21.15.72:0/3358129245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050c154120 msgr2=0x7f050c167a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:54.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.845+0000 7f051099c700 1 --2- 172.21.15.72:0/3358129245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050c154120 0x7f050c167a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:54.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.845+0000 7f051099c700 1 -- 172.21.15.72:0/3358129245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f050c064b90 msgr2=0x7f050c144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:54.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.845+0000 7f051099c700 1 --2- 172.21.15.72:0/3358129245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f050c064b90 0x7f050c144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:54.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.845+0000 7f051099c700 1 -- 172.21.15.72:0/3358129245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc009370 con 0x7f050c154500 2023-08-31T19:05:54.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.845+0000 7f051099c700 1 --2- 172.21.15.72:0/3358129245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050c154500 0x7f050c167f20 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f050400c810 tx=0x7f0504002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:54.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.845+0000 7f04f3fff700 1 -- 172.21.15.72:0/3358129245 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504010510 con 0x7f050c154500 2023-08-31T19:05:54.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.845+0000 7f04f3fff700 1 -- 172.21.15.72:0/3358129245 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0504010690 con 0x7f050c154500 2023-08-31T19:05:54.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.845+0000 7f04f3fff700 1 -- 172.21.15.72:0/3358129245 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504010a50 con 0x7f050c154500 2023-08-31T19:05:54.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.845+0000 7f05123ff700 1 -- 172.21.15.72:0/3358129245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050c0b05a0 con 0x7f050c154500 2023-08-31T19:05:54.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.846+0000 7f05123ff700 1 -- 172.21.15.72:0/3358129245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050c165b50 con 0x7f050c154500 2023-08-31T19:05:54.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.847+0000 7f05123ff700 1 -- 172.21.15.72:0/3358129245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050c06a7e0 con 0x7f050c154500 2023-08-31T19:05:54.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.847+0000 7f04f3fff700 1 -- 172.21.15.72:0/3358129245 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 44) v1 ==== 75505+0+0 (secure 0 0 0) 0x7f050401b400 con 0x7f050c154500 2023-08-31T19:05:54.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.848+0000 7f04f3fff700 1 --2- 172.21.15.72:0/3358129245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f04f805f0a0 0x7f04f8061560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:54.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.849+0000 7f04f3fff700 1 -- 172.21.15.72:0/3358129245 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7124+0+0 (secure 0 0 0) 0x7f050407a550 con 0x7f050c154500 2023-08-31T19:05:54.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.849+0000 7f050bfff700 1 --2- 172.21.15.72:0/3358129245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f04f805f0a0 0x7f04f8061560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:54.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.849+0000 7f050bfff700 1 --2- 172.21.15.72:0/3358129245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f04f805f0a0 0x7f04f8061560 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f04fc009130 tx=0x7f04fc017000).ready entity=mgr.7323 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:54.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:54.853+0000 7f04f3fff700 1 -- 172.21.15.72:0/3358129245 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f050404b270 con 0x7f050c154500 2023-08-31T19:05:54.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:05:54.889 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:05:55.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.058+0000 7f05123ff700 1 -- 172.21.15.72:0/3358129245 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7f050c166050 con 0x7f04f805f0a0 2023-08-31T19:05:55.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.062+0000 7f04f3fff700 1 -- 172.21.15.72:0/3358129245 <== mgr.7323 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7f050c166050 con 0x7f04f805f0a0 2023-08-31T19:05:55.063 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path /bad-path 2023-08-31T19:05:55.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.064+0000 7f05123ff700 1 -- 172.21.15.72:0/3358129245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f04f805f0a0 msgr2=0x7f04f8061560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:55.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.064+0000 7f05123ff700 1 --2- 172.21.15.72:0/3358129245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f04f805f0a0 0x7f04f8061560 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f04fc009130 tx=0x7f04fc017000).stop 2023-08-31T19:05:55.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.064+0000 7f05123ff700 1 -- 172.21.15.72:0/3358129245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050c154500 msgr2=0x7f050c167f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:55.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.064+0000 7f05123ff700 1 --2- 172.21.15.72:0/3358129245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050c154500 0x7f050c167f20 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f050400c810 tx=0x7f0504002560).stop 2023-08-31T19:05:55.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.064+0000 7f05123ff700 1 -- 172.21.15.72:0/3358129245 shutdown_connections 2023-08-31T19:05:55.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.064+0000 7f05123ff700 1 --2- 172.21.15.72:0/3358129245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050c154500 0x7f050c167f20 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:55.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.065+0000 7f05123ff700 1 --2- 172.21.15.72:0/3358129245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f04f805f0a0 0x7f04f8061560 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:55.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.065+0000 7f05123ff700 1 --2- 172.21.15.72:0/3358129245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f050c064b90 0x7f050c144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:55.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.065+0000 7f05123ff700 1 --2- 172.21.15.72:0/3358129245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f050c154120 0x7f050c167a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:55.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.065+0000 7f05123ff700 1 -- 172.21.15.72:0/3358129245 >> 172.21.15.72:0/3358129245 conn(0x7f050c0cb7e0 msgr2=0x7f050c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:55.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.065+0000 7f05123ff700 1 -- 172.21.15.72:0/3358129245 shutdown_connections 2023-08-31T19:05:55.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.065+0000 7f05123ff700 1 -- 172.21.15.72:0/3358129245 wait complete. 2023-08-31T19:05:55.082 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-08-31T19:05:55.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-31T19:05:55.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.273+0000 7efea4bff700 1 Processor -- start 2023-08-31T19:05:55.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.274+0000 7efea4bff700 1 -- start start 2023-08-31T19:05:55.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.275+0000 7efea4bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efea0154030 0x7efea0154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:55.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.275+0000 7efea4bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efea00c06b0 0x7efea00c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:55.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.275+0000 7efea4bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea00c6ed0 con 0x7efea00aa140 2023-08-31T19:05:55.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.275+0000 7efea4bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea00c66e0 con 0x7efea0154030 2023-08-31T19:05:55.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.275+0000 7efea4bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea00c68c0 con 0x7efea00c06b0 2023-08-31T19:05:55.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.275+0000 7efe9e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efea0154030 0x7efea0154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:55.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.275+0000 7efe9e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efea0154030 0x7efea0154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51340/0 (socket says 172.21.15.72:51340) 2023-08-31T19:05:55.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.275+0000 7efe9e59c700 1 -- 172.21.15.72:0/3863375836 learned_addr learned my addr 172.21.15.72:0/3863375836 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:55.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.275+0000 7efe9dd9b700 1 --2- 172.21.15.72:0/3863375836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efea00c06b0 0x7efea00c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:55.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.276+0000 7efe9e59c700 1 -- 172.21.15.72:0/3863375836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efea00c06b0 msgr2=0x7efea00c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:55.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.276+0000 7efe9e59c700 1 --2- 172.21.15.72:0/3863375836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efea00c06b0 0x7efea00c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:55.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.276+0000 7efe9e59c700 1 -- 172.21.15.72:0/3863375836 >> v1:172.21.15.146:6789/0 conn(0x7efea00aa140 legacy=0x7efea0063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:55.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.276+0000 7efe9e59c700 1 -- 172.21.15.72:0/3863375836 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea00c0f30 con 0x7efea0154030 2023-08-31T19:05:55.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.276+0000 7efe9e59c700 1 --2- 172.21.15.72:0/3863375836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efea0154030 0x7efea0154410 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7efe90006fd0 tx=0x7efe900090f0).ready entity=mon.0 client_cookie=8112a3ba592dd1b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:55.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.276+0000 7efe9d59a700 1 -- 172.21.15.72:0/3863375836 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9000b600 con 0x7efea0154030 2023-08-31T19:05:55.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.276+0000 7efe9d59a700 1 -- 172.21.15.72:0/3863375836 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9000b760 con 0x7efea0154030 2023-08-31T19:05:55.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.276+0000 7efe9d59a700 1 -- 172.21.15.72:0/3863375836 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9000bae0 con 0x7efea0154030 2023-08-31T19:05:55.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.277+0000 7efea4bff700 1 -- 172.21.15.72:0/3863375836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efea0154030 msgr2=0x7efea0154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:55.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.277+0000 7efea4bff700 1 --2- 172.21.15.72:0/3863375836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efea0154030 0x7efea0154410 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7efe90006fd0 tx=0x7efe900090f0).stop 2023-08-31T19:05:55.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.277+0000 7efea4bff700 1 -- 172.21.15.72:0/3863375836 shutdown_connections 2023-08-31T19:05:55.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.277+0000 7efea4bff700 1 --2- 172.21.15.72:0/3863375836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efea0154030 0x7efea0154410 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:55.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.277+0000 7efea4bff700 1 --2- 172.21.15.72:0/3863375836 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efea00c06b0 0x7efea00c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:55.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.277+0000 7efea4bff700 1 -- 172.21.15.72:0/3863375836 >> 172.21.15.72:0/3863375836 conn(0x7efea005eb60 msgr2=0x7efea00cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:55.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.277+0000 7efea4bff700 1 -- 172.21.15.72:0/3863375836 shutdown_connections 2023-08-31T19:05:55.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.277+0000 7efea4bff700 1 -- 172.21.15.72:0/3863375836 wait complete. 2023-08-31T19:05:55.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.278+0000 7efea4bff700 1 Processor -- start 2023-08-31T19:05:55.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.278+0000 7efea4bff700 1 -- start start 2023-08-31T19:05:55.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.279+0000 7efea4bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efea00aa140 0x7efea01683f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:55.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.279+0000 7efea4bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efea00c06b0 0x7efea00add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:55.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.279+0000 7efea4bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efea0154030 0x7efea013c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:55.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.279+0000 7efea4bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea00ae5d0 con 0x7efea00c06b0 2023-08-31T19:05:55.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.279+0000 7efea4bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea00b0630 con 0x7efea0154030 2023-08-31T19:05:55.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.279+0000 7efea4bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea00afa60 con 0x7efea00aa140 2023-08-31T19:05:55.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.279+0000 7efe9dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efea00c06b0 0x7efea00add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:55.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.279+0000 7efe9dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efea00c06b0 0x7efea00add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51356/0 (socket says 172.21.15.72:51356) 2023-08-31T19:05:55.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.279+0000 7efe9dd9b700 1 -- 172.21.15.72:0/2120008790 learned_addr learned my addr 172.21.15.72:0/2120008790 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:55.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.280+0000 7efe9e59c700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efea00aa140 0x7efea01683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:55.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.280+0000 7efe9ed9d700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efea0154030 0x7efea013c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:55.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.280+0000 7efe9dd9b700 1 -- 172.21.15.72:0/2120008790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efea00aa140 msgr2=0x7efea01683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:55.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.280+0000 7efe9dd9b700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efea00aa140 0x7efea01683f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:55.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.280+0000 7efe9dd9b700 1 -- 172.21.15.72:0/2120008790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efea0154030 msgr2=0x7efea013c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:55.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.280+0000 7efe9dd9b700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efea0154030 0x7efea013c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:55.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.280+0000 7efe9dd9b700 1 -- 172.21.15.72:0/2120008790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe90009370 con 0x7efea00c06b0 2023-08-31T19:05:55.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.280+0000 7efe9e59c700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efea00aa140 0x7efea01683f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:05:55.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.280+0000 7efe9ed9d700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efea0154030 0x7efea013c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:05:55.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.280+0000 7efe9dd9b700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efea00c06b0 0x7efea00add80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7efe9400d890 tx=0x7efe94008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:55.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.280+0000 7efe8e7fc700 1 -- 172.21.15.72:0/2120008790 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe940125f0 con 0x7efea00c06b0 2023-08-31T19:05:55.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.280+0000 7efe8e7fc700 1 -- 172.21.15.72:0/2120008790 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe94012750 con 0x7efea00c06b0 2023-08-31T19:05:55.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.280+0000 7efea4bff700 1 -- 172.21.15.72:0/2120008790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea00afd00 con 0x7efea00c06b0 2023-08-31T19:05:55.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.280+0000 7efe8e7fc700 1 -- 172.21.15.72:0/2120008790 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94012ad0 con 0x7efea00c06b0 2023-08-31T19:05:55.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.280+0000 7efea4bff700 1 -- 172.21.15.72:0/2120008790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea00b0340 con 0x7efea00c06b0 2023-08-31T19:05:55.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.282+0000 7efea4bff700 1 -- 172.21.15.72:0/2120008790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea00b07c0 con 0x7efea00c06b0 2023-08-31T19:05:55.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.282+0000 7efe8e7fc700 1 -- 172.21.15.72:0/2120008790 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 44) v1 ==== 75505+0+0 (secure 0 0 0) 0x7efe94013480 con 0x7efea00c06b0 2023-08-31T19:05:55.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.283+0000 7efe8e7fc700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe8005f0a0 0x7efe80061560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:55.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.283+0000 7efe8e7fc700 1 -- 172.21.15.72:0/2120008790 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7124+0+0 (secure 0 0 0) 0x7efe9407a790 con 0x7efea00c06b0 2023-08-31T19:05:55.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.283+0000 7efe9e59c700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe8005f0a0 0x7efe80061560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:55.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.284+0000 7efe9e59c700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe8005f0a0 0x7efe80061560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7efe9000b3c0 tx=0x7efe90017000).ready entity=mgr.7323 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:55.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.287+0000 7efe8e7fc700 1 -- 172.21.15.72:0/2120008790 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efe9404b4b0 con 0x7efea00c06b0 2023-08-31T19:05:55.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.498+0000 7efea4bff700 1 -- 172.21.15.72:0/2120008790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7efea006c6b0 con 0x7efea00c06b0 2023-08-31T19:05:55.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.846+0000 7efe8e7fc700 1 -- 172.21.15.72:0/2120008790 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 45) v1 ==== 75488+0+0 (secure 0 0 0) 0x7efe94077e70 con 0x7efea00c06b0 2023-08-31T19:05:55.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.847+0000 7efe8e7fc700 1 -- 172.21.15.72:0/2120008790 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v45) v1 ==== 93+0+0 (secure 0 0 0) 0x7efe94047880 con 0x7efea00c06b0 2023-08-31T19:05:55.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.850+0000 7efea4bff700 1 -- 172.21.15.72:0/2120008790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe8005f0a0 msgr2=0x7efe80061560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:55.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.850+0000 7efea4bff700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe8005f0a0 0x7efe80061560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7efe9000b3c0 tx=0x7efe90017000).stop 2023-08-31T19:05:55.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.850+0000 7efea4bff700 1 -- 172.21.15.72:0/2120008790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efea00c06b0 msgr2=0x7efea00add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:55.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.850+0000 7efea4bff700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efea00c06b0 0x7efea00add80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7efe9400d890 tx=0x7efe94008040).stop 2023-08-31T19:05:55.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.850+0000 7efea4bff700 1 -- 172.21.15.72:0/2120008790 shutdown_connections 2023-08-31T19:05:55.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.850+0000 7efea4bff700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efe8005f0a0 0x7efe80061560 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:55.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.850+0000 7efea4bff700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efea0154030 0x7efea013c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:55.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.850+0000 7efea4bff700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efea00aa140 0x7efea01683f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:55.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.850+0000 7efea4bff700 1 --2- 172.21.15.72:0/2120008790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efea00c06b0 0x7efea00add80 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:55.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.850+0000 7efea4bff700 1 -- 172.21.15.72:0/2120008790 >> 172.21.15.72:0/2120008790 conn(0x7efea005eb60 msgr2=0x7efea0152ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:55.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.850+0000 7efea4bff700 1 -- 172.21.15.72:0/2120008790 shutdown_connections 2023-08-31T19:05:55.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:55.850+0000 7efea4bff700 1 -- 172.21.15.72:0/2120008790 wait complete. 2023-08-31T19:05:55.870 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:05:55.871 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:05:55.978 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:05:56.064 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:05:56.063+0000 7fde5519a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:05:56.065 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:56.065+0000 7ff54ef97680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:05:56.077 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:05:56.078 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-31T19:05:56.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:05:56.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-31T19:05:56.144 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:05:56.144+0000 7fde5519a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:05:56.146 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:56.145+0000 7ff54ef97680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:05:56.171 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T19:05:56.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:05:56.171 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T19:05:56.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:05:56.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.411+0000 7f50821ff700 1 Processor -- start 2023-08-31T19:05:56.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.412+0000 7f50821ff700 1 -- start start 2023-08-31T19:05:56.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.413+0000 7f50821ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f507c154060 0x7f507c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:56.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.413+0000 7f50821ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f507c0cb9b0 0x7f507c1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:56.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.413+0000 7f50821ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507c0c6120 con 0x7f507c1586b0 2023-08-31T19:05:56.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.413+0000 7f50821ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507c0c1380 con 0x7f507c154060 2023-08-31T19:05:56.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.413+0000 7f50821ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507c158b60 con 0x7f507c0cb9b0 2023-08-31T19:05:56.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.413+0000 7f507b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f507c154060 0x7f507c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:56.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.413+0000 7f507b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f507c154060 0x7f507c157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51378/0 (socket says 172.21.15.72:51378) 2023-08-31T19:05:56.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.413+0000 7f507b7fe700 1 -- 172.21.15.72:0/1015425487 learned_addr learned my addr 172.21.15.72:0/1015425487 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:56.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.413+0000 7f507bfff700 1 --1- 172.21.15.72:0/1015425487 >> v1:172.21.15.72:6789/0 conn(0x7f507c1586b0 0x7f507c0c65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51496/0 (socket says 172.21.15.72:51496) 2023-08-31T19:05:56.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.413+0000 7f507affd700 1 --2- 172.21.15.72:0/1015425487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f507c0cb9b0 0x7f507c1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:56.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.414+0000 7f507a7fc700 1 -- 172.21.15.72:0/1015425487 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036451933 0 0) 0x7f507c0c6120 con 0x7f507c1586b0 2023-08-31T19:05:56.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.414+0000 7f507b7fe700 1 -- 172.21.15.72:0/1015425487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f507c0cb9b0 msgr2=0x7f507c1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:56.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.414+0000 7f507b7fe700 1 --2- 172.21.15.72:0/1015425487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f507c0cb9b0 0x7f507c1581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:56.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.414+0000 7f507b7fe700 1 -- 172.21.15.72:0/1015425487 >> v1:172.21.15.72:6789/0 conn(0x7f507c1586b0 legacy=0x7f507c0c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:56.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.414+0000 7f507b7fe700 1 -- 172.21.15.72:0/1015425487 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c0c5e10 con 0x7f507c154060 2023-08-31T19:05:56.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.414+0000 7f507b7fe700 1 --2- 172.21.15.72:0/1015425487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507c154060 0x7f507c157cd0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f506c009840 tx=0x7f506c009060).ready entity=mon.0 client_cookie=cd469d1378cdc530 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:56.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.414+0000 7f507a7fc700 1 -- 172.21.15.72:0/1015425487 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c005880 con 0x7f507c154060 2023-08-31T19:05:56.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.414+0000 7f507a7fc700 1 -- 172.21.15.72:0/1015425487 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c0059e0 con 0x7f507c154060 2023-08-31T19:05:56.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.414+0000 7f507a7fc700 1 -- 172.21.15.72:0/1015425487 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c005d60 con 0x7f507c154060 2023-08-31T19:05:56.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.415+0000 7f50821ff700 1 -- 172.21.15.72:0/1015425487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507c154060 msgr2=0x7f507c157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:56.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.415+0000 7f50821ff700 1 --2- 172.21.15.72:0/1015425487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507c154060 0x7f507c157cd0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f506c009840 tx=0x7f506c009060).stop 2023-08-31T19:05:56.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.415+0000 7f50821ff700 1 -- 172.21.15.72:0/1015425487 shutdown_connections 2023-08-31T19:05:56.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.415+0000 7f50821ff700 1 --2- 172.21.15.72:0/1015425487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507c154060 0x7f507c157cd0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:56.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.415+0000 7f50821ff700 1 --2- 172.21.15.72:0/1015425487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f507c0cb9b0 0x7f507c1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:56.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.415+0000 7f50821ff700 1 -- 172.21.15.72:0/1015425487 >> 172.21.15.72:0/1015425487 conn(0x7f507c05e870 msgr2=0x7f507c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:56.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.415+0000 7f50821ff700 1 -- 172.21.15.72:0/1015425487 shutdown_connections 2023-08-31T19:05:56.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.415+0000 7f50821ff700 1 -- 172.21.15.72:0/1015425487 wait complete. 2023-08-31T19:05:56.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.417+0000 7f50821ff700 1 Processor -- start 2023-08-31T19:05:56.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.417+0000 7f50821ff700 1 -- start start 2023-08-31T19:05:56.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f50821ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f507c0cb9b0 0x7f507c0c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:56.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f50821ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507c154060 0x7f507c13c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:56.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f50821ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f507c1586b0 0x7f507c152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:56.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f50821ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c0c3ce0 con 0x7f507c154060 2023-08-31T19:05:56.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f50821ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c0c2e30 con 0x7f507c0cb9b0 2023-08-31T19:05:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f50821ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507c0c30d0 con 0x7f507c1586b0 2023-08-31T19:05:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f507affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507c154060 0x7f507c13c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f507affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507c154060 0x7f507c13c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51380/0 (socket says 172.21.15.72:51380) 2023-08-31T19:05:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f507b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f507c0cb9b0 0x7f507c0c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f507affd700 1 -- 172.21.15.72:0/1628808112 learned_addr learned my addr 172.21.15.72:0/1628808112 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:56.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f507bfff700 1 --2- 172.21.15.72:0/1628808112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f507c1586b0 0x7f507c152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:56.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f507affd700 1 -- 172.21.15.72:0/1628808112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f507c1586b0 msgr2=0x7f507c152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:56.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f507affd700 1 --2- 172.21.15.72:0/1628808112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f507c1586b0 0x7f507c152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:56.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f507affd700 1 -- 172.21.15.72:0/1628808112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f507c0cb9b0 msgr2=0x7f507c0c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:56.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f507affd700 1 --2- 172.21.15.72:0/1628808112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f507c0cb9b0 0x7f507c0c4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:56.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.419+0000 7f507affd700 1 -- 172.21.15.72:0/1628808112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c009300 con 0x7f507c154060 2023-08-31T19:05:56.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.420+0000 7f507affd700 1 --2- 172.21.15.72:0/1628808112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507c154060 0x7f507c13c5d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f507000e930 tx=0x7f5070009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:56.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.420+0000 7f50637fe700 1 -- 172.21.15.72:0/1628808112 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070012600 con 0x7f507c154060 2023-08-31T19:05:56.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.420+0000 7f50637fe700 1 -- 172.21.15.72:0/1628808112 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5070012760 con 0x7f507c154060 2023-08-31T19:05:56.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.420+0000 7f50821ff700 1 -- 172.21.15.72:0/1628808112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507c0c33b0 con 0x7f507c154060 2023-08-31T19:05:56.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.420+0000 7f50637fe700 1 -- 172.21.15.72:0/1628808112 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070012ae0 con 0x7f507c154060 2023-08-31T19:05:56.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.420+0000 7f50821ff700 1 -- 172.21.15.72:0/1628808112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507c0c3970 con 0x7f507c154060 2023-08-31T19:05:56.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.421+0000 7f50821ff700 1 -- 172.21.15.72:0/1628808112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507c06c6b0 con 0x7f507c154060 2023-08-31T19:05:56.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.422+0000 7f50637fe700 1 -- 172.21.15.72:0/1628808112 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 45) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f507001b400 con 0x7f507c154060 2023-08-31T19:05:56.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.423+0000 7f50637fe700 1 --2- 172.21.15.72:0/1628808112 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f506805f020 0x7f50680614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:56.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.423+0000 7f50637fe700 1 -- 172.21.15.72:0/1628808112 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7124+0+0 (secure 0 0 0) 0x7f507007aac0 con 0x7f507c154060 2023-08-31T19:05:56.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.423+0000 7f507b7fe700 1 -- 172.21.15.72:0/1628808112 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f506805f020 msgr2=0x7f50680614e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:05:56.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.423+0000 7f507b7fe700 1 --2- 172.21.15.72:0/1628808112 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f506805f020 0x7f50680614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:05:56.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.431+0000 7f50637fe700 1 -- 172.21.15.72:0/1628808112 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f507004b720 con 0x7f507c154060 2023-08-31T19:05:56.471 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:05:56.471+0000 7fde5519a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:05:56.503 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:56.503+0000 7ff54ef97680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:05:56.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.624+0000 7f507b7fe700 1 -- 172.21.15.72:0/1628808112 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f506805f020 msgr2=0x7f50680614e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:05:56.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.624+0000 7f507b7fe700 1 --2- 172.21.15.72:0/1628808112 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f506805f020 0x7f50680614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:05:56.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.651+0000 7f50821ff700 1 -- 172.21.15.72:0/1628808112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f507c0ad870 con 0x7f507c154060 2023-08-31T19:05:56.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.652+0000 7f50637fe700 1 -- 172.21.15.72:0/1628808112 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f507004ed40 con 0x7f507c154060 2023-08-31T19:05:56.652 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:05:56.653 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2894594800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2894594800},{"type":"v1","addr":"172.21.15.146:6834","nonce":2894594800}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2296022003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2296022003},{"type":"v1","addr":"172.21.15.72:6837","nonce":2296022003}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/159383587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":159383587},{"type":"v1","addr":"172.21.15.146:6835","nonce":159383587}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:04:38.994518+0000","modified":"2023-08-31T19:04:42.017973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6835/4088389987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4088389987},{"type":"v1","addr":"172.21.15.72:6835","nonce":4088389987}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-31T19:05:56.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.654+0000 7f50821ff700 1 -- 172.21.15.72:0/1628808112 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f506805f020 msgr2=0x7f50680614e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:05:56.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.654+0000 7f50821ff700 1 --2- 172.21.15.72:0/1628808112 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f506805f020 0x7f50680614e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:56.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.654+0000 7f50821ff700 1 -- 172.21.15.72:0/1628808112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507c154060 msgr2=0x7f507c13c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:56.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.654+0000 7f50821ff700 1 --2- 172.21.15.72:0/1628808112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507c154060 0x7f507c13c5d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f507000e930 tx=0x7f5070009060).stop 2023-08-31T19:05:56.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.654+0000 7f50821ff700 1 -- 172.21.15.72:0/1628808112 shutdown_connections 2023-08-31T19:05:56.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.654+0000 7f50821ff700 1 --2- 172.21.15.72:0/1628808112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f507c1586b0 0x7f507c152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:56.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.654+0000 7f50821ff700 1 --2- 172.21.15.72:0/1628808112 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f506805f020 0x7f50680614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:56.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.654+0000 7f50821ff700 1 --2- 172.21.15.72:0/1628808112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f507c0cb9b0 0x7f507c0c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:56.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.654+0000 7f50821ff700 1 --2- 172.21.15.72:0/1628808112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507c154060 0x7f507c13c5d0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:56.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.654+0000 7f50821ff700 1 -- 172.21.15.72:0/1628808112 >> 172.21.15.72:0/1628808112 conn(0x7f507c05e870 msgr2=0x7f507c0c8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:56.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.654+0000 7f50821ff700 1 -- 172.21.15.72:0/1628808112 shutdown_connections 2023-08-31T19:05:56.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.654+0000 7f50821ff700 1 -- 172.21.15.72:0/1628808112 wait complete. 2023-08-31T19:05:56.660 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 48 2023-08-31T19:05:56.673 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:05:56.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.871+0000 7f17865ff700 1 Processor -- start 2023-08-31T19:05:56.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.871+0000 7f17865ff700 1 -- start start 2023-08-31T19:05:56.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.873+0000 7f17865ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17800aa290 0x7f1780156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:56.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.873+0000 7f17865ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f17801574b0 0x7f17800c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:56.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.873+0000 7f17865ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17800bfd00 con 0x7f17800a9eb0 2023-08-31T19:05:56.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.873+0000 7f17865ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17800c05a0 con 0x7f17801574b0 2023-08-31T19:05:56.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.873+0000 7f17865ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17800aaea0 con 0x7f17800aa290 2023-08-31T19:05:56.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.873+0000 7f177ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f17800a9eb0 0x7f17800c5bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51500/0 (socket says 172.21.15.72:51500) 2023-08-31T19:05:56.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.873+0000 7f177ffff700 1 -- 172.21.15.72:0/2141466448 learned_addr learned my addr 172.21.15.72:0/2141466448 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:05:56.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.873+0000 7f177f7fe700 1 --2- 172.21.15.72:0/2141466448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17800aa290 0x7f1780156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:56.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.873+0000 7f1784b9c700 1 --2- 172.21.15.72:0/2141466448 >> v2:172.21.15.146:3300/0 conn(0x7f17801574b0 0x7f17800c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:56.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.873+0000 7f177effd700 1 -- 172.21.15.72:0/2141466448 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232485725 0 0) 0x7f17800bfd00 con 0x7f17800a9eb0 2023-08-31T19:05:56.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.873+0000 7f177effd700 1 -- 172.21.15.72:0/2141466448 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17680033f0 con 0x7f17800a9eb0 2023-08-31T19:05:56.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.874+0000 7f177f7fe700 1 -- 172.21.15.72:0/2141466448 >> v2:172.21.15.146:3300/0 conn(0x7f17801574b0 msgr2=0x7f17800c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:56.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.874+0000 7f177f7fe700 1 --2- 172.21.15.72:0/2141466448 >> v2:172.21.15.146:3300/0 conn(0x7f17801574b0 0x7f17800c0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:56.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.874+0000 7f177f7fe700 1 -- 172.21.15.72:0/2141466448 >> v1:172.21.15.72:6789/0 conn(0x7f17800a9eb0 legacy=0x7f17800c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:56.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.874+0000 7f177f7fe700 1 -- 172.21.15.72:0/2141466448 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17800c6670 con 0x7f17800aa290 2023-08-31T19:05:56.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.874+0000 7f177f7fe700 1 --2- 172.21.15.72:0/2141466448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17800aa290 0x7f1780156fc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f1774009760 tx=0x7f1774009060).ready entity=mon.2 client_cookie=1489bbd3eaee1e00 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:56.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.874+0000 7f177effd700 1 -- 172.21.15.72:0/2141466448 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177400d4a0 con 0x7f17800aa290 2023-08-31T19:05:56.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.874+0000 7f177effd700 1 -- 172.21.15.72:0/2141466448 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177400d600 con 0x7f17800aa290 2023-08-31T19:05:56.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.874+0000 7f177effd700 1 -- 172.21.15.72:0/2141466448 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177400d980 con 0x7f17800aa290 2023-08-31T19:05:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.875+0000 7f17865ff700 1 -- 172.21.15.72:0/2141466448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17800aa290 msgr2=0x7f1780156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.875+0000 7f17865ff700 1 --2- 172.21.15.72:0/2141466448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17800aa290 0x7f1780156fc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f1774009760 tx=0x7f1774009060).stop 2023-08-31T19:05:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.875+0000 7f17865ff700 1 -- 172.21.15.72:0/2141466448 shutdown_connections 2023-08-31T19:05:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.875+0000 7f17865ff700 1 --2- 172.21.15.72:0/2141466448 >> v2:172.21.15.146:3300/0 conn(0x7f17801574b0 0x7f17800c0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.875+0000 7f17865ff700 1 --2- 172.21.15.72:0/2141466448 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17800aa290 0x7f1780156fc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.875+0000 7f17865ff700 1 -- 172.21.15.72:0/2141466448 >> 172.21.15.72:0/2141466448 conn(0x7f17800c82e0 msgr2=0x7f178005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.875+0000 7f17865ff700 1 -- 172.21.15.72:0/2141466448 shutdown_connections 2023-08-31T19:05:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.875+0000 7f17865ff700 1 -- 172.21.15.72:0/2141466448 wait complete. 2023-08-31T19:05:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.876+0000 7f17865ff700 1 Processor -- start 2023-08-31T19:05:56.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.877+0000 7f17865ff700 1 -- start start 2023-08-31T19:05:56.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.877+0000 7f17865ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17800a9eb0 0x7f1780152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:56.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.877+0000 7f17865ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17800aa290 0x7f1780154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:56.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.877+0000 7f17865ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17801574b0 0x7f1780154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:56.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.877+0000 7f17865ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17800c45d0 con 0x7f17801574b0 2023-08-31T19:05:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.877+0000 7f17865ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17800c3950 con 0x7f17800aa290 2023-08-31T19:05:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.877+0000 7f17865ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17800c3c30 con 0x7f17800a9eb0 2023-08-31T19:05:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.878+0000 7f177ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17800a9eb0 0x7f1780152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.878+0000 7f1784b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17801574b0 0x7f1780154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.878+0000 7f177ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17800a9eb0 0x7f1780152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:44684/0 (socket says 172.21.15.72:44684) 2023-08-31T19:05:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.878+0000 7f177ffff700 1 -- 172.21.15.72:0/2360588812 learned_addr learned my addr 172.21.15.72:0/2360588812 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.878+0000 7f177f7fe700 1 --2- 172.21.15.72:0/2360588812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17800aa290 0x7f1780154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.878+0000 7f177ffff700 1 -- 172.21.15.72:0/2360588812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17800aa290 msgr2=0x7f1780154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:56.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.878+0000 7f177ffff700 1 --2- 172.21.15.72:0/2360588812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17800aa290 0x7f1780154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.878+0000 7f177ffff700 1 -- 172.21.15.72:0/2360588812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17801574b0 msgr2=0x7f1780154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.878+0000 7f177ffff700 1 --2- 172.21.15.72:0/2360588812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17801574b0 0x7f1780154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.878+0000 7f177ffff700 1 -- 172.21.15.72:0/2360588812 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17740092a0 con 0x7f17800a9eb0 2023-08-31T19:05:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.878+0000 7f1784b9c700 1 --2- 172.21.15.72:0/2360588812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17801574b0 0x7f1780154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:05:56.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.878+0000 7f177ffff700 1 --2- 172.21.15.72:0/2360588812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17800a9eb0 0x7f1780152e10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f177000c590 tx=0x7f1770007c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.879+0000 7f1767fff700 1 -- 172.21.15.72:0/2360588812 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17700072e0 con 0x7f17800a9eb0 2023-08-31T19:05:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.879+0000 7f1767fff700 1 -- 172.21.15.72:0/2360588812 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1770007440 con 0x7f17800a9eb0 2023-08-31T19:05:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.879+0000 7f17865ff700 1 -- 172.21.15.72:0/2360588812 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17800c3f10 con 0x7f17800a9eb0 2023-08-31T19:05:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.879+0000 7f1767fff700 1 -- 172.21.15.72:0/2360588812 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17700057a0 con 0x7f17800a9eb0 2023-08-31T19:05:56.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.879+0000 7f17865ff700 1 -- 172.21.15.72:0/2360588812 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1780155ce0 con 0x7f17800a9eb0 2023-08-31T19:05:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.880+0000 7f17865ff700 1 -- 172.21.15.72:0/2360588812 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178006c6b0 con 0x7f17800a9eb0 2023-08-31T19:05:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.881+0000 7f1767fff700 1 -- 172.21.15.72:0/2360588812 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 45) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f1770005bd0 con 0x7f17800a9eb0 2023-08-31T19:05:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.881+0000 7f1767fff700 1 --2- 172.21.15.72:0/2360588812 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f176c05f050 0x7f176c061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:56.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.881+0000 7f1767fff700 1 -- 172.21.15.72:0/2360588812 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7124+0+0 (secure 0 0 0) 0x7f1770079d70 con 0x7f17800a9eb0 2023-08-31T19:05:56.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.881+0000 7f177f7fe700 1 -- 172.21.15.72:0/2360588812 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f176c05f050 msgr2=0x7f176c061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:05:56.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.882+0000 7f177f7fe700 1 --2- 172.21.15.72:0/2360588812 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f176c05f050 0x7f176c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:05:56.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:56.886+0000 7f1767fff700 1 -- 172.21.15.72:0/2360588812 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f177004aa30 con 0x7f17800a9eb0 2023-08-31T19:05:57.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.061+0000 7f17865ff700 1 -- 172.21.15.72:0/2360588812 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17800c3d70 con 0x7f17800a9eb0 2023-08-31T19:05:57.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.063+0000 7f1767fff700 1 -- 172.21.15.72:0/2360588812 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+18556 (secure 0 0 0) 0x7f17800c3d70 con 0x7f17800a9eb0 2023-08-31T19:05:57.063 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:05:57.064 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":112,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:05:53.820146+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:04:37.420883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-31T19:04:37.977694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.27","mappings":[{"from":1,"to":3}]},{"pgid":"14.1","mappings":[{"from":1,"to":7}]},{"pgid":"14.12","mappings":[{"from":1,"to":5}]},{"pgid":"14.1e","mappings":[{"from":1,"to":2}]},{"pgid":"14.2a","mappings":[{"from":1,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/3487659764":"2023-09-01T19:04:52.723748+0000","172.21.15.72:0/2285609943":"2023-09-01T19:04:52.723748+0000","172.21.15.72:0/3191150215":"2023-09-01T19:04:52.723748+0000","172.21.15.72:6833/143463":"2023-09-01T19:04:52.723748+0000","172.21.15.72:6832/143463":"2023-09-01T19:04:52.723748+0000","172.21.15.72:0/1578696960":"2023-09-01T19:04:52.723748+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:05:57.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.065+0000 7f17865ff700 1 -- 172.21.15.72:0/2360588812 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f176c05f050 msgr2=0x7f176c061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:05:57.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.065+0000 7f17865ff700 1 --2- 172.21.15.72:0/2360588812 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f176c05f050 0x7f176c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:57.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.065+0000 7f17865ff700 1 -- 172.21.15.72:0/2360588812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17800a9eb0 msgr2=0x7f1780152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:57.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.065+0000 7f17865ff700 1 --2- 172.21.15.72:0/2360588812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17800a9eb0 0x7f1780152e10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f177000c590 tx=0x7f1770007c80).stop 2023-08-31T19:05:57.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.065+0000 7f17865ff700 1 -- 172.21.15.72:0/2360588812 shutdown_connections 2023-08-31T19:05:57.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.065+0000 7f17865ff700 1 --2- 172.21.15.72:0/2360588812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17801574b0 0x7f1780154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.065+0000 7f17865ff700 1 --2- 172.21.15.72:0/2360588812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f17800a9eb0 0x7f1780152e10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.065+0000 7f17865ff700 1 --2- 172.21.15.72:0/2360588812 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f176c05f050 0x7f176c061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:57.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.065+0000 7f17865ff700 1 --2- 172.21.15.72:0/2360588812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17800aa290 0x7f1780154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.065+0000 7f17865ff700 1 -- 172.21.15.72:0/2360588812 >> 172.21.15.72:0/2360588812 conn(0x7f17800c82e0 msgr2=0x7f17800c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:57.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.065+0000 7f17865ff700 1 -- 172.21.15.72:0/2360588812 shutdown_connections 2023-08-31T19:05:57.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.065+0000 7f17865ff700 1 -- 172.21.15.72:0/2360588812 wait complete. 2023-08-31T19:05:57.083 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:04:37.420883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:04:37.977694+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:05:57.084 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:05:57.220 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:05:57.219+0000 7fde5519a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:05:57.294 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:57.294+0000 7ff54ef97680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:05:57.302 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:05:57.301+0000 7fde5519a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:05:57.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.307+0000 7fb2867ff700 1 Processor -- start 2023-08-31T19:05:57.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.307+0000 7fb2867ff700 1 -- start start 2023-08-31T19:05:57.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.309+0000 7fb2867ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2800637c0 0x7fb28015f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:57.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.309+0000 7fb2867ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2800bfd40 con 0x7fb280154210 2023-08-31T19:05:57.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.309+0000 7fb2867ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2800c6730 con 0x7fb280153e30 2023-08-31T19:05:57.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.309+0000 7fb2867ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2801546c0 con 0x7fb2800637c0 2023-08-31T19:05:57.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.309+0000 7fb27f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb280154210 0x7fb2800630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51510/0 (socket says 172.21.15.72:51510) 2023-08-31T19:05:57.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.309+0000 7fb27f7fe700 1 -- 172.21.15.72:0/440677032 learned_addr learned my addr 172.21.15.72:0/440677032 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:05:57.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.309+0000 7fb284d9c700 1 --2- 172.21.15.72:0/440677032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2800637c0 0x7fb28015f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:57.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.309+0000 7fb27effd700 1 -- 172.21.15.72:0/440677032 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605669774 0 0) 0x7fb2800bfd40 con 0x7fb280154210 2023-08-31T19:05:57.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.309+0000 7fb27effd700 1 -- 172.21.15.72:0/440677032 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2680033f0 con 0x7fb280154210 2023-08-31T19:05:57.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.310+0000 7fb27effd700 1 -- 172.21.15.72:0/440677032 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496579719 0 0) 0x7fb2800c6730 con 0x7fb280153e30 2023-08-31T19:05:57.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.310+0000 7fb27effd700 1 -- 172.21.15.72:0/440677032 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2800bfd40 con 0x7fb280153e30 2023-08-31T19:05:57.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.310+0000 7fb284d9c700 1 -- 172.21.15.72:0/440677032 >> v1:172.21.15.146:6789/0 conn(0x7fb280153e30 legacy=0x7fb2800c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:57.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.310+0000 7fb27effd700 1 -- 172.21.15.72:0/440677032 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1358066414 0 0) 0x7fb2680033f0 con 0x7fb280154210 2023-08-31T19:05:57.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.310+0000 7fb284d9c700 1 -- 172.21.15.72:0/440677032 >> v1:172.21.15.72:6789/0 conn(0x7fb280154210 legacy=0x7fb2800630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:57.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.310+0000 7fb284d9c700 1 -- 172.21.15.72:0/440677032 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2800bffe0 con 0x7fb2800637c0 2023-08-31T19:05:57.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.310+0000 7fb284d9c700 1 --2- 172.21.15.72:0/440677032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2800637c0 0x7fb28015f0b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fb278009e90 tx=0x7fb278009780).ready entity=mon.2 client_cookie=1c5c3707e2d15f0e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:57.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.310+0000 7fb27effd700 1 -- 172.21.15.72:0/440677032 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27800e070 con 0x7fb2800637c0 2023-08-31T19:05:57.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.310+0000 7fb27effd700 1 -- 172.21.15.72:0/440677032 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27800b7a0 con 0x7fb2800637c0 2023-08-31T19:05:57.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.310+0000 7fb27effd700 1 -- 172.21.15.72:0/440677032 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274001470 con 0x7fb2800637c0 2023-08-31T19:05:57.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.311+0000 7fb2867ff700 1 -- 172.21.15.72:0/440677032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2800637c0 msgr2=0x7fb28015f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:57.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.311+0000 7fb2867ff700 1 --2- 172.21.15.72:0/440677032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2800637c0 0x7fb28015f0b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fb278009e90 tx=0x7fb278009780).stop 2023-08-31T19:05:57.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.311+0000 7fb2867ff700 1 -- 172.21.15.72:0/440677032 shutdown_connections 2023-08-31T19:05:57.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.311+0000 7fb2867ff700 1 --2- 172.21.15.72:0/440677032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2800637c0 0x7fb28015f0b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.311+0000 7fb2867ff700 1 -- 172.21.15.72:0/440677032 >> 172.21.15.72:0/440677032 conn(0x7fb28005eb20 msgr2=0x7fb2800cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:57.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.311+0000 7fb2867ff700 1 -- 172.21.15.72:0/440677032 shutdown_connections 2023-08-31T19:05:57.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.311+0000 7fb2867ff700 1 -- 172.21.15.72:0/440677032 wait complete. 2023-08-31T19:05:57.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.312+0000 7fb2867ff700 1 Processor -- start 2023-08-31T19:05:57.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.313+0000 7fb2867ff700 1 -- start start 2023-08-31T19:05:57.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.313+0000 7fb2867ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800637c0 0x7fb2800add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:57.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.313+0000 7fb2867ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb280153e30 0x7fb2800c3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.313+0000 7fb2867ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb280154210 0x7fb28014d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.313+0000 7fb2867ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2800aecd0 con 0x7fb2800637c0 2023-08-31T19:05:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.314+0000 7fb2867ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2800c3d50 con 0x7fb280154210 2023-08-31T19:05:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.314+0000 7fb2867ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2800ae430 con 0x7fb280153e30 2023-08-31T19:05:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.314+0000 7fb27ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800637c0 0x7fb2800add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.314+0000 7fb27ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800637c0 0x7fb2800add90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51410/0 (socket says 172.21.15.72:51410) 2023-08-31T19:05:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.314+0000 7fb27ffff700 1 -- 172.21.15.72:0/2560354016 learned_addr learned my addr 172.21.15.72:0/2560354016 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.314+0000 7fb27f7fe700 1 --2- 172.21.15.72:0/2560354016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb280153e30 0x7fb2800c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.314+0000 7fb284d9c700 1 --2- 172.21.15.72:0/2560354016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb280154210 0x7fb28014d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.314+0000 7fb27ffff700 1 -- 172.21.15.72:0/2560354016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb280153e30 msgr2=0x7fb2800c3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.314+0000 7fb27ffff700 1 --2- 172.21.15.72:0/2560354016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb280153e30 0x7fb2800c3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.314+0000 7fb27ffff700 1 -- 172.21.15.72:0/2560354016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb280154210 msgr2=0x7fb28014d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.314+0000 7fb27ffff700 1 --2- 172.21.15.72:0/2560354016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb280154210 0x7fb28014d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.314+0000 7fb27ffff700 1 -- 172.21.15.72:0/2560354016 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb278009a20 con 0x7fb2800637c0 2023-08-31T19:05:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.314+0000 7fb284d9c700 1 --2- 172.21.15.72:0/2560354016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb280154210 0x7fb28014d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:05:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.314+0000 7fb27ffff700 1 --2- 172.21.15.72:0/2560354016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800637c0 0x7fb2800add90 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7fb27000c490 tx=0x7fb270007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:57.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.315+0000 7fb267fff700 1 -- 172.21.15.72:0/2560354016 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27000f470 con 0x7fb2800637c0 2023-08-31T19:05:57.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.315+0000 7fb267fff700 1 -- 172.21.15.72:0/2560354016 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27000f5d0 con 0x7fb2800637c0 2023-08-31T19:05:57.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.315+0000 7fb2867ff700 1 -- 172.21.15.72:0/2560354016 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2800ae710 con 0x7fb2800637c0 2023-08-31T19:05:57.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.315+0000 7fb267fff700 1 -- 172.21.15.72:0/2560354016 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27000f970 con 0x7fb2800637c0 2023-08-31T19:05:57.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.315+0000 7fb2867ff700 1 -- 172.21.15.72:0/2560354016 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb280167c20 con 0x7fb2800637c0 2023-08-31T19:05:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.316+0000 7fb2867ff700 1 -- 172.21.15.72:0/2560354016 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2800b0e30 con 0x7fb2800637c0 2023-08-31T19:05:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.317+0000 7fb267fff700 1 -- 172.21.15.72:0/2560354016 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 45) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fb27000fd20 con 0x7fb2800637c0 2023-08-31T19:05:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.318+0000 7fb267fff700 1 --2- 172.21.15.72:0/2560354016 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb26c05f050 0x7fb26c061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.318+0000 7fb267fff700 1 -- 172.21.15.72:0/2560354016 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7124+0+0 (secure 0 0 0) 0x7fb270079be0 con 0x7fb2800637c0 2023-08-31T19:05:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.318+0000 7fb27f7fe700 1 -- 172.21.15.72:0/2560354016 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb26c05f050 msgr2=0x7fb26c061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:05:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.318+0000 7fb27f7fe700 1 --2- 172.21.15.72:0/2560354016 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb26c05f050 0x7fb26c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:05:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.322+0000 7fb267fff700 1 -- 172.21.15.72:0/2560354016 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb27004a8a0 con 0x7fb2800637c0 2023-08-31T19:05:57.382 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:57.382+0000 7ff54ef97680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:05:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.493+0000 7fb2867ff700 1 -- 172.21.15.72:0/2560354016 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb28006c6b0 con 0x7fb2800637c0 2023-08-31T19:05:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.493+0000 7fb267fff700 1 -- 172.21.15.72:0/2560354016 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v112) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb27004dec0 con 0x7fb2800637c0 2023-08-31T19:05:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:05:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.495+0000 7fb2867ff700 1 -- 172.21.15.72:0/2560354016 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb26c05f050 msgr2=0x7fb26c061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:05:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.495+0000 7fb2867ff700 1 --2- 172.21.15.72:0/2560354016 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb26c05f050 0x7fb26c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.495+0000 7fb2867ff700 1 -- 172.21.15.72:0/2560354016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800637c0 msgr2=0x7fb2800add90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.495+0000 7fb2867ff700 1 --2- 172.21.15.72:0/2560354016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800637c0 0x7fb2800add90 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7fb27000c490 tx=0x7fb270007c90).stop 2023-08-31T19:05:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.495+0000 7fb2867ff700 1 -- 172.21.15.72:0/2560354016 shutdown_connections 2023-08-31T19:05:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.495+0000 7fb2867ff700 1 --2- 172.21.15.72:0/2560354016 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb26c05f050 0x7fb26c061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.495+0000 7fb2867ff700 1 --2- 172.21.15.72:0/2560354016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb280154210 0x7fb28014d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.495+0000 7fb2867ff700 1 --2- 172.21.15.72:0/2560354016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800637c0 0x7fb2800add90 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.495+0000 7fb2867ff700 1 --2- 172.21.15.72:0/2560354016 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb280153e30 0x7fb2800c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.495+0000 7fb2867ff700 1 -- 172.21.15.72:0/2560354016 >> 172.21.15.72:0/2560354016 conn(0x7fb28005eb20 msgr2=0x7fb280151ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.496+0000 7fb2867ff700 1 -- 172.21.15.72:0/2560354016 shutdown_connections 2023-08-31T19:05:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.496+0000 7fb2867ff700 1 -- 172.21.15.72:0/2560354016 wait complete. 2023-08-31T19:05:57.514 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:05:57.533 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:05:57.533+0000 7fde5519a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:05:57.624 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:57.624+0000 7ff54ef97680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:05:57.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.710+0000 7f7411fff700 1 Processor -- start 2023-08-31T19:05:57.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.710+0000 7f7411fff700 1 -- start start 2023-08-31T19:05:57.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.711+0000 7f7411fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f740c153e30 0x7f740c154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:57.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.711+0000 7f7411fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f740c0637c0 0x7f740c0c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:57.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.711+0000 7f7411fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740c0bfd40 con 0x7f740c0c5cb0 2023-08-31T19:05:57.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.711+0000 7f7411fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740c0c6730 con 0x7f740c0637c0 2023-08-31T19:05:57.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.711+0000 7f7411fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0bffe0 con 0x7f740c153e30 2023-08-31T19:05:57.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.712+0000 7f740bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f740c0637c0 0x7f740c0c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:57.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.712+0000 7f740b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f740c153e30 0x7f740c154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:57.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.712+0000 7f740bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f740c0637c0 0x7f740c0c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:35614/0 (socket says 172.21.15.72:35614) 2023-08-31T19:05:57.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.712+0000 7f740bfff700 1 -- 172.21.15.72:0/2963379271 learned_addr learned my addr 172.21.15.72:0/2963379271 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:57.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.712+0000 7f740bfff700 1 -- 172.21.15.72:0/2963379271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f740c153e30 msgr2=0x7f740c154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:57.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.712+0000 7f740bfff700 1 --2- 172.21.15.72:0/2963379271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f740c153e30 0x7f740c154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.712+0000 7f740bfff700 1 -- 172.21.15.72:0/2963379271 >> v1:172.21.15.146:6789/0 conn(0x7f740c0c5cb0 legacy=0x7f740c0630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:57.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.712+0000 7f740bfff700 1 -- 172.21.15.72:0/2963379271 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c0c02c0 con 0x7f740c0637c0 2023-08-31T19:05:57.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.712+0000 7f740bfff700 1 --2- 172.21.15.72:0/2963379271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f740c0637c0 0x7f740c0c6130 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f7404009f20 tx=0x7f7404009840).ready entity=mon.1 client_cookie=4245ebf8eff7a9e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:57.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.713+0000 7f740a7fc700 1 -- 172.21.15.72:0/2963379271 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400e070 con 0x7f740c0637c0 2023-08-31T19:05:57.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.713+0000 7f740a7fc700 1 -- 172.21.15.72:0/2963379271 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740400b9d0 con 0x7f740c0637c0 2023-08-31T19:05:57.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.713+0000 7f740a7fc700 1 -- 172.21.15.72:0/2963379271 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400bd50 con 0x7f740c0637c0 2023-08-31T19:05:57.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.713+0000 7f7411fff700 1 -- 172.21.15.72:0/2963379271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f740c0637c0 msgr2=0x7f740c0c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:57.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.713+0000 7f7411fff700 1 --2- 172.21.15.72:0/2963379271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f740c0637c0 0x7f740c0c6130 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f7404009f20 tx=0x7f7404009840).stop 2023-08-31T19:05:57.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.713+0000 7f7411fff700 1 -- 172.21.15.72:0/2963379271 shutdown_connections 2023-08-31T19:05:57.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.713+0000 7f7411fff700 1 --2- 172.21.15.72:0/2963379271 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f740c0637c0 0x7f740c0c6130 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.713+0000 7f7411fff700 1 --2- 172.21.15.72:0/2963379271 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f740c153e30 0x7f740c154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.713+0000 7f7411fff700 1 -- 172.21.15.72:0/2963379271 >> 172.21.15.72:0/2963379271 conn(0x7f740c05eb20 msgr2=0x7f740c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:57.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.713+0000 7f7411fff700 1 -- 172.21.15.72:0/2963379271 shutdown_connections 2023-08-31T19:05:57.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.714+0000 7f7411fff700 1 -- 172.21.15.72:0/2963379271 wait complete. 2023-08-31T19:05:57.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.715+0000 7f7411fff700 1 Processor -- start 2023-08-31T19:05:57.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.715+0000 7f7411fff700 1 -- start start 2023-08-31T19:05:57.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.716+0000 7f7411fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f740c0637c0 0x7f740c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:57.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.716+0000 7f7411fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f740c0c5cb0 0x7f740c0c2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:57.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.716+0000 7f7411fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f740c153e30 0x7f740c14d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:57.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.716+0000 7f7411fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0add90 con 0x7f740c153e30 2023-08-31T19:05:57.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.716+0000 7f7411fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0ae910 con 0x7f740c0c5cb0 2023-08-31T19:05:57.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.716+0000 7f7411fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0adfe0 con 0x7f740c0637c0 2023-08-31T19:05:57.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.716+0000 7f740b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f740c0637c0 0x7f740c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:57.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.716+0000 7f740bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f740c153e30 0x7f740c14d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:57.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.716+0000 7f740bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f740c153e30 0x7f740c14d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51418/0 (socket says 172.21.15.72:51418) 2023-08-31T19:05:57.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.716+0000 7f740b7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f740c0637c0 0x7f740c0b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:44726/0 (socket says 172.21.15.72:44726) 2023-08-31T19:05:57.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.716+0000 7f740affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f740c0c5cb0 0x7f740c0c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:57.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.716+0000 7f740bfff700 1 -- 172.21.15.72:0/3780328285 learned_addr learned my addr 172.21.15.72:0/3780328285 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:57.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.717+0000 7f740b7fe700 1 -- 172.21.15.72:0/3780328285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f740c0c5cb0 msgr2=0x7f740c0c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:57.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.717+0000 7f740b7fe700 1 --2- 172.21.15.72:0/3780328285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f740c0c5cb0 0x7f740c0c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.717+0000 7f740b7fe700 1 -- 172.21.15.72:0/3780328285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f740c153e30 msgr2=0x7f740c14d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:57.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.717+0000 7f740b7fe700 1 --2- 172.21.15.72:0/3780328285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f740c153e30 0x7f740c14d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.717+0000 7f740b7fe700 1 -- 172.21.15.72:0/3780328285 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7404009ae0 con 0x7f740c0637c0 2023-08-31T19:05:57.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.717+0000 7f740bfff700 1 --2- 172.21.15.72:0/3780328285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f740c153e30 0x7f740c14d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:05:57.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.717+0000 7f740b7fe700 1 --2- 172.21.15.72:0/3780328285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f740c0637c0 0x7f740c0b0a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f73fc00e720 tx=0x7f73fc009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:57.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.717+0000 7f73f37fe700 1 -- 172.21.15.72:0/3780328285 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc012600 con 0x7f740c0637c0 2023-08-31T19:05:57.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.717+0000 7f73f37fe700 1 -- 172.21.15.72:0/3780328285 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc012760 con 0x7f740c0637c0 2023-08-31T19:05:57.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.717+0000 7f7411fff700 1 -- 172.21.15.72:0/3780328285 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740c0ae2c0 con 0x7f740c0637c0 2023-08-31T19:05:57.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.717+0000 7f73f37fe700 1 -- 172.21.15.72:0/3780328285 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc012ae0 con 0x7f740c0637c0 2023-08-31T19:05:57.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.717+0000 7f7411fff700 1 -- 172.21.15.72:0/3780328285 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740c0c2d50 con 0x7f740c0637c0 2023-08-31T19:05:57.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.719+0000 7f7411fff700 1 -- 172.21.15.72:0/3780328285 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740c0aebf0 con 0x7f740c0637c0 2023-08-31T19:05:57.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.719+0000 7f73f37fe700 1 -- 172.21.15.72:0/3780328285 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 45) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f73fc01b400 con 0x7f740c0637c0 2023-08-31T19:05:57.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.720+0000 7f73f37fe700 1 --2- 172.21.15.72:0/3780328285 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f73f805f050 0x7f73f8061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:57.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.720+0000 7f73f37fe700 1 -- 172.21.15.72:0/3780328285 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7124+0+0 (secure 0 0 0) 0x7f73fc07a7e0 con 0x7f740c0637c0 2023-08-31T19:05:57.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.724+0000 7f740affd700 1 -- 172.21.15.72:0/3780328285 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f73f805f050 msgr2=0x7f73f8061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:05:57.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.724+0000 7f740affd700 1 --2- 172.21.15.72:0/3780328285 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f73f805f050 0x7f73f8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:05:57.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.724+0000 7f73f37fe700 1 -- 172.21.15.72:0/3780328285 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f73fc04b440 con 0x7f740c0637c0 2023-08-31T19:05:57.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.903+0000 7f7411fff700 1 -- 172.21.15.72:0/3780328285 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f740c06c6b0 con 0x7f740c0637c0 2023-08-31T19:05:57.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.904+0000 7f73f37fe700 1 -- 172.21.15.72:0/3780328285 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v112) v1 ==== 92+0+10 (secure 0 0 0) 0x7f73fc04ea60 con 0x7f740c0637c0 2023-08-31T19:05:57.905 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:05:57.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.906+0000 7f7411fff700 1 -- 172.21.15.72:0/3780328285 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f73f805f050 msgr2=0x7f73f8061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:05:57.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.906+0000 7f7411fff700 1 --2- 172.21.15.72:0/3780328285 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f73f805f050 0x7f73f8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:57.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.906+0000 7f7411fff700 1 -- 172.21.15.72:0/3780328285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f740c0637c0 msgr2=0x7f740c0b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:57.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.906+0000 7f7411fff700 1 --2- 172.21.15.72:0/3780328285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f740c0637c0 0x7f740c0b0a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f73fc00e720 tx=0x7f73fc009060).stop 2023-08-31T19:05:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.906+0000 7f7411fff700 1 -- 172.21.15.72:0/3780328285 shutdown_connections 2023-08-31T19:05:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.906+0000 7f7411fff700 1 --2- 172.21.15.72:0/3780328285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f740c153e30 0x7f740c14d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.906+0000 7f7411fff700 1 --2- 172.21.15.72:0/3780328285 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f740c0637c0 0x7f740c0b0a70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.906+0000 7f7411fff700 1 --2- 172.21.15.72:0/3780328285 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f73f805f050 0x7f73f8061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:57.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.906+0000 7f7411fff700 1 --2- 172.21.15.72:0/3780328285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f740c0c5cb0 0x7f740c0c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:57.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.906+0000 7f7411fff700 1 -- 172.21.15.72:0/3780328285 >> 172.21.15.72:0/3780328285 conn(0x7f740c05eb20 msgr2=0x7f740c0c7620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:57.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.906+0000 7f7411fff700 1 -- 172.21.15.72:0/3780328285 shutdown_connections 2023-08-31T19:05:57.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:57.906+0000 7f7411fff700 1 -- 172.21.15.72:0/3780328285 wait complete. 2023-08-31T19:05:57.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:05:58.046 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:05:58.046+0000 7fde5519a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:05:58.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.126+0000 7f5f7b7ff700 1 Processor -- start 2023-08-31T19:05:58.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.127+0000 7f5f7b7ff700 1 -- start start 2023-08-31T19:05:58.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.128+0000 7f5f7b7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f741520e0 0x7f5f740a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.128+0000 7f5f7b7ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f74068ba0 0x7f5f74064840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.128+0000 7f5f7b7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f74064340 con 0x7f5f740a9440 2023-08-31T19:05:58.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.128+0000 7f5f7b7ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f740bcd00 con 0x7f5f74068ba0 2023-08-31T19:05:58.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.128+0000 7f5f7b7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f740bcfe0 con 0x7f5f741520e0 2023-08-31T19:05:58.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.128+0000 7f5f78d9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5f740a9440 0x7f5f74068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51522/0 (socket says 172.21.15.72:51522) 2023-08-31T19:05:58.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.128+0000 7f5f78d9a700 1 -- 172.21.15.72:0/3980294173 learned_addr learned my addr 172.21.15.72:0/3980294173 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:05:58.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.128+0000 7f5f7959b700 1 --2- 172.21.15.72:0/3980294173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f741520e0 0x7f5f740a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:58.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.128+0000 7f5f79d9c700 1 --2- 172.21.15.72:0/3980294173 >> v2:172.21.15.146:3300/0 conn(0x7f5f74068ba0 0x7f5f74064840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:58.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.129+0000 7f5f6bfff700 1 -- 172.21.15.72:0/3980294173 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714827905 0 0) 0x7f5f74064340 con 0x7f5f740a9440 2023-08-31T19:05:58.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.129+0000 7f5f6bfff700 1 -- 172.21.15.72:0/3980294173 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f600033f0 con 0x7f5f740a9440 2023-08-31T19:05:58.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.129+0000 7f5f7959b700 1 -- 172.21.15.72:0/3980294173 >> v2:172.21.15.146:3300/0 conn(0x7f5f74068ba0 msgr2=0x7f5f74064840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:58.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.129+0000 7f5f7959b700 1 --2- 172.21.15.72:0/3980294173 >> v2:172.21.15.146:3300/0 conn(0x7f5f74068ba0 0x7f5f74064840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.129+0000 7f5f7959b700 1 -- 172.21.15.72:0/3980294173 >> v1:172.21.15.72:6789/0 conn(0x7f5f740a9440 legacy=0x7f5f74068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:58.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.129+0000 7f5f7959b700 1 -- 172.21.15.72:0/3980294173 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f740bd2c0 con 0x7f5f741520e0 2023-08-31T19:05:58.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.129+0000 7f5f7959b700 1 --2- 172.21.15.72:0/3980294173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f741520e0 0x7f5f740a8f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f5f70009760 tx=0x7f5f70009060).ready entity=mon.2 client_cookie=7dc80363b58ef02c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:58.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.129+0000 7f5f6bfff700 1 -- 172.21.15.72:0/3980294173 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000d4a0 con 0x7f5f741520e0 2023-08-31T19:05:58.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.129+0000 7f5f6bfff700 1 -- 172.21.15.72:0/3980294173 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7000d600 con 0x7f5f741520e0 2023-08-31T19:05:58.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.129+0000 7f5f6bfff700 1 -- 172.21.15.72:0/3980294173 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000d980 con 0x7f5f741520e0 2023-08-31T19:05:58.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.130+0000 7f5f7b7ff700 1 -- 172.21.15.72:0/3980294173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f741520e0 msgr2=0x7f5f740a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:58.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.130+0000 7f5f7b7ff700 1 --2- 172.21.15.72:0/3980294173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f741520e0 0x7f5f740a8f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f5f70009760 tx=0x7f5f70009060).stop 2023-08-31T19:05:58.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.130+0000 7f5f7b7ff700 1 -- 172.21.15.72:0/3980294173 shutdown_connections 2023-08-31T19:05:58.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.130+0000 7f5f7b7ff700 1 --2- 172.21.15.72:0/3980294173 >> v2:172.21.15.146:3300/0 conn(0x7f5f74068ba0 0x7f5f74064840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.130+0000 7f5f7b7ff700 1 --2- 172.21.15.72:0/3980294173 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f741520e0 0x7f5f740a8f50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.130+0000 7f5f7b7ff700 1 -- 172.21.15.72:0/3980294173 >> 172.21.15.72:0/3980294173 conn(0x7f5f740630c0 msgr2=0x7f5f740c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:58.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.130+0000 7f5f7b7ff700 1 -- 172.21.15.72:0/3980294173 shutdown_connections 2023-08-31T19:05:58.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.130+0000 7f5f7b7ff700 1 -- 172.21.15.72:0/3980294173 wait complete. 2023-08-31T19:05:58.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.131+0000 7f5f7b7ff700 1 Processor -- start 2023-08-31T19:05:58.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.132+0000 7f5f7b7ff700 1 -- start start 2023-08-31T19:05:58.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f7b7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f74068ba0 0x7f5f740bde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f7b7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f740a9440 0x7f5f74167e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f7b7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f741520e0 0x7f5f7414b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f7b7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f740a9ea0 con 0x7f5f74068ba0 2023-08-31T19:05:58.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f7b7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f740a7c80 con 0x7f5f740a9440 2023-08-31T19:05:58.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f7b7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f740a7f20 con 0x7f5f741520e0 2023-08-31T19:05:58.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f7959b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f74068ba0 0x7f5f740bde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:58.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f7959b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f74068ba0 0x7f5f740bde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51424/0 (socket says 172.21.15.72:51424) 2023-08-31T19:05:58.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f7959b700 1 -- 172.21.15.72:0/1522608384 learned_addr learned my addr 172.21.15.72:0/1522608384 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:58.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f78d9a700 1 --2- 172.21.15.72:0/1522608384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f740a9440 0x7f5f74167e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f79d9c700 1 --2- 172.21.15.72:0/1522608384 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f741520e0 0x7f5f7414b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f7959b700 1 -- 172.21.15.72:0/1522608384 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f741520e0 msgr2=0x7f5f7414b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f7959b700 1 --2- 172.21.15.72:0/1522608384 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f741520e0 0x7f5f7414b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f7959b700 1 -- 172.21.15.72:0/1522608384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f740a9440 msgr2=0x7f5f74167e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:58.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f7959b700 1 --2- 172.21.15.72:0/1522608384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f740a9440 0x7f5f74167e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f7959b700 1 -- 172.21.15.72:0/1522608384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f700092a0 con 0x7f5f74068ba0 2023-08-31T19:05:58.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f79d9c700 1 --2- 172.21.15.72:0/1522608384 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f741520e0 0x7f5f7414b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:05:58.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f78d9a700 1 --2- 172.21.15.72:0/1522608384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f740a9440 0x7f5f74167e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:05:58.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.133+0000 7f5f7959b700 1 --2- 172.21.15.72:0/1522608384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f74068ba0 0x7f5f740bde40 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f5f70009d50 tx=0x7f5f70016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:58.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.134+0000 7f5f697fa700 1 -- 172.21.15.72:0/1522608384 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70000c90 con 0x7f5f74068ba0 2023-08-31T19:05:58.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.134+0000 7f5f697fa700 1 -- 172.21.15.72:0/1522608384 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7000d770 con 0x7f5f74068ba0 2023-08-31T19:05:58.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.134+0000 7f5f697fa700 1 -- 172.21.15.72:0/1522608384 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7001d640 con 0x7f5f74068ba0 2023-08-31T19:05:58.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.134+0000 7f5f7b7ff700 1 -- 172.21.15.72:0/1522608384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f740a8200 con 0x7f5f74068ba0 2023-08-31T19:05:58.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.134+0000 7f5f7b7ff700 1 -- 172.21.15.72:0/1522608384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f740be330 con 0x7f5f74068ba0 2023-08-31T19:05:58.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.135+0000 7f5f7b7ff700 1 -- 172.21.15.72:0/1522608384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f740aa210 con 0x7f5f74068ba0 2023-08-31T19:05:58.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.136+0000 7f5f697fa700 1 -- 172.21.15.72:0/1522608384 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 45) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f5f7001da70 con 0x7f5f74068ba0 2023-08-31T19:05:58.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.137+0000 7f5f697fa700 1 --2- 172.21.15.72:0/1522608384 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5f5805f050 0x7f5f58061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.138+0000 7f5f697fa700 1 -- 172.21.15.72:0/1522608384 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7124+0+0 (secure 0 0 0) 0x7f5f7007bd30 con 0x7f5f74068ba0 2023-08-31T19:05:58.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.140+0000 7f5f78d9a700 1 -- 172.21.15.72:0/1522608384 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5f5805f050 msgr2=0x7f5f58061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:05:58.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.140+0000 7f5f78d9a700 1 --2- 172.21.15.72:0/1522608384 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5f5805f050 0x7f5f58061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:05:58.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.142+0000 7f5f697fa700 1 -- 172.21.15.72:0/1522608384 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5f7004cb70 con 0x7f5f74068ba0 2023-08-31T19:05:58.166 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:58.166+0000 7ff54ef97680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:05:58.171 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:05:58.171+0000 7fde5519a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:05:58.297 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:58.296+0000 7ff54ef97680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:05:58.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.316+0000 7f5f7b7ff700 1 -- 172.21.15.72:0/1522608384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f7406c6b0 con 0x7f5f74068ba0 2023-08-31T19:05:58.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.316+0000 7f5f697fa700 1 -- 172.21.15.72:0/1522608384 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f70050190 con 0x7f5f74068ba0 2023-08-31T19:05:58.317 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:05:58.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.318+0000 7f5f7b7ff700 1 -- 172.21.15.72:0/1522608384 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5f5805f050 msgr2=0x7f5f58061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:05:58.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.318+0000 7f5f7b7ff700 1 --2- 172.21.15.72:0/1522608384 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5f5805f050 0x7f5f58061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:58.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.318+0000 7f5f7b7ff700 1 -- 172.21.15.72:0/1522608384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f74068ba0 msgr2=0x7f5f740bde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:58.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.318+0000 7f5f7b7ff700 1 --2- 172.21.15.72:0/1522608384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f74068ba0 0x7f5f740bde40 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f5f70009d50 tx=0x7f5f70016000).stop 2023-08-31T19:05:58.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.318+0000 7f5f7b7ff700 1 -- 172.21.15.72:0/1522608384 shutdown_connections 2023-08-31T19:05:58.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.318+0000 7f5f7b7ff700 1 --2- 172.21.15.72:0/1522608384 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5f741520e0 0x7f5f7414b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.318+0000 7f5f7b7ff700 1 --2- 172.21.15.72:0/1522608384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f74068ba0 0x7f5f740bde40 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.318+0000 7f5f7b7ff700 1 --2- 172.21.15.72:0/1522608384 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f5f5805f050 0x7f5f58061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:58.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.318+0000 7f5f7b7ff700 1 --2- 172.21.15.72:0/1522608384 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f740a9440 0x7f5f74167e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.318+0000 7f5f7b7ff700 1 -- 172.21.15.72:0/1522608384 >> 172.21.15.72:0/1522608384 conn(0x7f5f740630c0 msgr2=0x7f5f74155db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:58.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.318+0000 7f5f7b7ff700 1 -- 172.21.15.72:0/1522608384 shutdown_connections 2023-08-31T19:05:58.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.318+0000 7f5f7b7ff700 1 -- 172.21.15.72:0/1522608384 wait complete. 2023-08-31T19:05:58.336 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:05:58.355 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:05:58.355+0000 7fde5519a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:05:58.448 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:05:58.448+0000 7fde5519a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:05:58.493 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:58.493+0000 7ff54ef97680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:05:58.534 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:05:58.534+0000 7fde5519a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:05:58.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.535+0000 7f882b5ff700 1 Processor -- start 2023-08-31T19:05:58.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.535+0000 7f882b5ff700 1 -- start start 2023-08-31T19:05:58.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.536+0000 7f882b5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88240bdb30 0x7f88241542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.536+0000 7f882b5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88240a84b0 con 0x7f88240663d0 2023-08-31T19:05:58.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.536+0000 7f882b5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88240c9410 con 0x7f8824153ed0 2023-08-31T19:05:58.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.536+0000 7f882b5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88240c5310 con 0x7f88240bdb30 2023-08-31T19:05:58.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.537+0000 7f882939b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8824153ed0 0x7f8824155200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:56694/0 (socket says 172.21.15.72:56694) 2023-08-31T19:05:58.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.537+0000 7f8828b9a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88240bdb30 0x7f88241542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:58.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.537+0000 7f882939b700 1 -- 172.21.15.72:0/740234584 learned_addr learned my addr 172.21.15.72:0/740234584 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:05:58.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.537+0000 7f881bfff700 1 -- 172.21.15.72:0/740234584 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214967167 0 0) 0x7f88240c9410 con 0x7f8824153ed0 2023-08-31T19:05:58.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.537+0000 7f881bfff700 1 -- 172.21.15.72:0/740234584 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88100033f0 con 0x7f8824153ed0 2023-08-31T19:05:58.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.537+0000 7f8828b9a700 1 -- 172.21.15.72:0/740234584 >> v1:172.21.15.146:6789/0 conn(0x7f8824153ed0 legacy=0x7f8824155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:58.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.537+0000 7f8828b9a700 1 -- 172.21.15.72:0/740234584 >> v1:172.21.15.72:6789/0 conn(0x7f88240663d0 legacy=0x7f8824157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:58.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.537+0000 7f8828b9a700 1 -- 172.21.15.72:0/740234584 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88240a7ef0 con 0x7f88240bdb30 2023-08-31T19:05:58.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.537+0000 7f8828b9a700 1 --2- 172.21.15.72:0/740234584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88240bdb30 0x7f88241542b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f8814009790 tx=0x7f8814009060).ready entity=mon.2 client_cookie=92089045984fa5ed server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:58.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.538+0000 7f881bfff700 1 -- 172.21.15.72:0/740234584 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140090d0 con 0x7f88240bdb30 2023-08-31T19:05:58.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.538+0000 7f881bfff700 1 -- 172.21.15.72:0/740234584 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881400f510 con 0x7f88240bdb30 2023-08-31T19:05:58.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.538+0000 7f881bfff700 1 -- 172.21.15.72:0/740234584 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881400f890 con 0x7f88240bdb30 2023-08-31T19:05:58.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.538+0000 7f882b5ff700 1 -- 172.21.15.72:0/740234584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88240bdb30 msgr2=0x7f88241542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:58.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.538+0000 7f882b5ff700 1 --2- 172.21.15.72:0/740234584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88240bdb30 0x7f88241542b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f8814009790 tx=0x7f8814009060).stop 2023-08-31T19:05:58.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.538+0000 7f882b5ff700 1 -- 172.21.15.72:0/740234584 shutdown_connections 2023-08-31T19:05:58.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.538+0000 7f882b5ff700 1 --2- 172.21.15.72:0/740234584 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88240bdb30 0x7f88241542b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.538+0000 7f882b5ff700 1 -- 172.21.15.72:0/740234584 >> 172.21.15.72:0/740234584 conn(0x7f882405eb60 msgr2=0x7f88240c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:58.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.538+0000 7f882b5ff700 1 -- 172.21.15.72:0/740234584 shutdown_connections 2023-08-31T19:05:58.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.539+0000 7f882b5ff700 1 -- 172.21.15.72:0/740234584 wait complete. 2023-08-31T19:05:58.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.540+0000 7f882b5ff700 1 Processor -- start 2023-08-31T19:05:58.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.540+0000 7f882b5ff700 1 -- start start 2023-08-31T19:05:58.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.541+0000 7f882b5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88240663d0 0x7f8824154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.541+0000 7f882b5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8824153ed0 0x7f88241647e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.541+0000 7f882b5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8824154d20 0x7f88240adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.541+0000 7f882b5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88240a9780 con 0x7f88240663d0 2023-08-31T19:05:58.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.541+0000 7f882b5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88240a9910 con 0x7f8824154d20 2023-08-31T19:05:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.541+0000 7f882b5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88241551a0 con 0x7f8824153ed0 2023-08-31T19:05:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.541+0000 7f882939b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88240663d0 0x7f8824154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.541+0000 7f882939b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88240663d0 0x7f8824154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51428/0 (socket says 172.21.15.72:51428) 2023-08-31T19:05:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.541+0000 7f882939b700 1 -- 172.21.15.72:0/3264942226 learned_addr learned my addr 172.21.15.72:0/3264942226 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.541+0000 7f8828b9a700 1 --2- 172.21.15.72:0/3264942226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8824153ed0 0x7f88241647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.541+0000 7f8829b9c700 1 --2- 172.21.15.72:0/3264942226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8824154d20 0x7f88240adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.542+0000 7f882939b700 1 -- 172.21.15.72:0/3264942226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8824153ed0 msgr2=0x7f88241647e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.542+0000 7f882939b700 1 --2- 172.21.15.72:0/3264942226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8824153ed0 0x7f88241647e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.542+0000 7f882939b700 1 -- 172.21.15.72:0/3264942226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8824154d20 msgr2=0x7f88240adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:58.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.542+0000 7f882939b700 1 --2- 172.21.15.72:0/3264942226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8824154d20 0x7f88240adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.542+0000 7f882939b700 1 -- 172.21.15.72:0/3264942226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88140092a0 con 0x7f88240663d0 2023-08-31T19:05:58.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.542+0000 7f882939b700 1 --2- 172.21.15.72:0/3264942226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88240663d0 0x7f8824154830 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f882000c420 tx=0x7f8820007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:58.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.542+0000 7f88197fa700 1 -- 172.21.15.72:0/3264942226 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88200070d0 con 0x7f88240663d0 2023-08-31T19:05:58.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.542+0000 7f88197fa700 1 -- 172.21.15.72:0/3264942226 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8820007230 con 0x7f88240663d0 2023-08-31T19:05:58.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.542+0000 7f88197fa700 1 -- 172.21.15.72:0/3264942226 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88200075b0 con 0x7f88240663d0 2023-08-31T19:05:58.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.542+0000 7f882b5ff700 1 -- 172.21.15.72:0/3264942226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8824155480 con 0x7f88240663d0 2023-08-31T19:05:58.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.542+0000 7f882b5ff700 1 -- 172.21.15.72:0/3264942226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8824155a40 con 0x7f88240663d0 2023-08-31T19:05:58.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.544+0000 7f882b5ff700 1 -- 172.21.15.72:0/3264942226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882406c6b0 con 0x7f88240663d0 2023-08-31T19:05:58.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.544+0000 7f88197fa700 1 -- 172.21.15.72:0/3264942226 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 45) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f88200059b0 con 0x7f88240663d0 2023-08-31T19:05:58.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.545+0000 7f88197fa700 1 --2- 172.21.15.72:0/3264942226 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f880805f050 0x7f8808061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.545+0000 7f88197fa700 1 -- 172.21.15.72:0/3264942226 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7124+0+0 (secure 0 0 0) 0x7f8820079d00 con 0x7f88240663d0 2023-08-31T19:05:58.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.545+0000 7f8828b9a700 1 -- 172.21.15.72:0/3264942226 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f880805f050 msgr2=0x7f8808061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:05:58.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.546+0000 7f8828b9a700 1 --2- 172.21.15.72:0/3264942226 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f880805f050 0x7f8808061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:05:58.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.550+0000 7f88197fa700 1 -- 172.21.15.72:0/3264942226 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f882004a9c0 con 0x7f88240663d0 2023-08-31T19:05:58.597 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:58.596+0000 7ff54ef97680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:05:58.684 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:58.683+0000 7ff54ef97680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:05:58.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.727+0000 7f882b5ff700 1 -- 172.21.15.72:0/3264942226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8824067360 con 0x7f88240663d0 2023-08-31T19:05:58.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.728+0000 7f88197fa700 1 -- 172.21.15.72:0/3264942226 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+11 (secure 0 0 0) 0x7f882004dfe0 con 0x7f88240663d0 2023-08-31T19:05:58.729 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:05:58.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.730+0000 7f882b5ff700 1 -- 172.21.15.72:0/3264942226 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f880805f050 msgr2=0x7f8808061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:05:58.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.730+0000 7f882b5ff700 1 --2- 172.21.15.72:0/3264942226 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f880805f050 0x7f8808061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:58.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.730+0000 7f882b5ff700 1 -- 172.21.15.72:0/3264942226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88240663d0 msgr2=0x7f8824154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:58.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.730+0000 7f882b5ff700 1 --2- 172.21.15.72:0/3264942226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88240663d0 0x7f8824154830 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f882000c420 tx=0x7f8820007c80).stop 2023-08-31T19:05:58.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.730+0000 7f882b5ff700 1 -- 172.21.15.72:0/3264942226 shutdown_connections 2023-08-31T19:05:58.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.730+0000 7f882b5ff700 1 --2- 172.21.15.72:0/3264942226 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f880805f050 0x7f8808061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:58.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.730+0000 7f882b5ff700 1 --2- 172.21.15.72:0/3264942226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8824154d20 0x7f88240adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.730+0000 7f882b5ff700 1 --2- 172.21.15.72:0/3264942226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88240663d0 0x7f8824154830 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.730+0000 7f882b5ff700 1 --2- 172.21.15.72:0/3264942226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8824153ed0 0x7f88241647e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.730+0000 7f882b5ff700 1 -- 172.21.15.72:0/3264942226 >> 172.21.15.72:0/3264942226 conn(0x7f882405eb60 msgr2=0x7f88240c7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:58.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.730+0000 7f882b5ff700 1 -- 172.21.15.72:0/3264942226 shutdown_connections 2023-08-31T19:05:58.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.730+0000 7f882b5ff700 1 -- 172.21.15.72:0/3264942226 wait complete. 2023-08-31T19:05:58.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:05:58.847 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:05:58.847+0000 7fde5519a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:05:58.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.940+0000 7f1f491ff700 1 Processor -- start 2023-08-31T19:05:58.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.940+0000 7f1f491ff700 1 -- start start 2023-08-31T19:05:58.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.942+0000 7f1f491ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f440cb9b0 0x7f1f441583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.942+0000 7f1f491ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f441588d0 0x7f1f44154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.942+0000 7f1f491ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f440c6120 con 0x7f1f44154060 2023-08-31T19:05:58.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.942+0000 7f1f491ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f440c1380 con 0x7f1f441588d0 2023-08-31T19:05:58.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.942+0000 7f1f491ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f440c5e10 con 0x7f1f440cb9b0 2023-08-31T19:05:58.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.942+0000 7f1f4359e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f441588d0 0x7f1f44154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:58.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.942+0000 7f1f4359e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f441588d0 0x7f1f44154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51430/0 (socket says 172.21.15.72:51430) 2023-08-31T19:05:58.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.942+0000 7f1f4359e700 1 -- 172.21.15.72:0/1860832662 learned_addr learned my addr 172.21.15.72:0/1860832662 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:58.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.942+0000 7f1f42d9d700 1 --1- 172.21.15.72:0/1860832662 >> v1:172.21.15.72:6789/0 conn(0x7f1f44154060 0x7f1f44157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51530/0 (socket says 172.21.15.72:51530) 2023-08-31T19:05:58.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.942+0000 7f1f4259c700 1 --2- 172.21.15.72:0/1860832662 >> v2:172.21.15.146:3300/0 conn(0x7f1f440cb9b0 0x7f1f441583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:58.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.942+0000 7f1f4359e700 1 -- 172.21.15.72:0/1860832662 >> v2:172.21.15.146:3300/0 conn(0x7f1f440cb9b0 msgr2=0x7f1f441583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:58.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.942+0000 7f1f4359e700 1 --2- 172.21.15.72:0/1860832662 >> v2:172.21.15.146:3300/0 conn(0x7f1f440cb9b0 0x7f1f441583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.942+0000 7f1f4359e700 1 -- 172.21.15.72:0/1860832662 >> v1:172.21.15.72:6789/0 conn(0x7f1f44154060 legacy=0x7f1f44157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:58.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.942+0000 7f1f4359e700 1 -- 172.21.15.72:0/1860832662 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f440c0ae0 con 0x7f1f441588d0 2023-08-31T19:05:58.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.943+0000 7f1f4359e700 1 --2- 172.21.15.72:0/1860832662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f441588d0 0x7f1f44154440 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f1f44083190 tx=0x7f1f3c009840).ready entity=mon.0 client_cookie=4128b4ac2a398727 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.943+0000 7f1f41d9b700 1 -- 172.21.15.72:0/1860832662 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00e070 con 0x7f1f441588d0 2023-08-31T19:05:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.943+0000 7f1f41d9b700 1 -- 172.21.15.72:0/1860832662 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c00ba20 con 0x7f1f441588d0 2023-08-31T19:05:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.943+0000 7f1f41d9b700 1 -- 172.21.15.72:0/1860832662 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00bda0 con 0x7f1f441588d0 2023-08-31T19:05:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.943+0000 7f1f491ff700 1 -- 172.21.15.72:0/1860832662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f441588d0 msgr2=0x7f1f44154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.943+0000 7f1f491ff700 1 --2- 172.21.15.72:0/1860832662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f441588d0 0x7f1f44154440 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f1f44083190 tx=0x7f1f3c009840).stop 2023-08-31T19:05:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.944+0000 7f1f491ff700 1 -- 172.21.15.72:0/1860832662 shutdown_connections 2023-08-31T19:05:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.944+0000 7f1f491ff700 1 --2- 172.21.15.72:0/1860832662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f441588d0 0x7f1f44154440 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.944+0000 7f1f491ff700 1 --2- 172.21.15.72:0/1860832662 >> v2:172.21.15.146:3300/0 conn(0x7f1f440cb9b0 0x7f1f441583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.944+0000 7f1f491ff700 1 -- 172.21.15.72:0/1860832662 >> 172.21.15.72:0/1860832662 conn(0x7f1f4405e870 msgr2=0x7f1f440cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.944+0000 7f1f491ff700 1 -- 172.21.15.72:0/1860832662 shutdown_connections 2023-08-31T19:05:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.944+0000 7f1f491ff700 1 -- 172.21.15.72:0/1860832662 wait complete. 2023-08-31T19:05:58.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.945+0000 7f1f491ff700 1 Processor -- start 2023-08-31T19:05:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.945+0000 7f1f491ff700 1 -- start start 2023-08-31T19:05:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.946+0000 7f1f491ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f440cb9b0 0x7f1f44152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.946+0000 7f1f491ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f44154060 0x7f1f44163cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.946+0000 7f1f491ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f441588d0 0x7f1f440ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.946+0000 7f1f491ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f44158de0 con 0x7f1f44154060 2023-08-31T19:05:58.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.946+0000 7f1f491ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f44164590 con 0x7f1f441588d0 2023-08-31T19:05:58.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.946+0000 7f1f491ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f44164870 con 0x7f1f440cb9b0 2023-08-31T19:05:58.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.947+0000 7f1f4259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f44154060 0x7f1f44163cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:58.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.947+0000 7f1f4259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f44154060 0x7f1f44163cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51432/0 (socket says 172.21.15.72:51432) 2023-08-31T19:05:58.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.947+0000 7f1f4259c700 1 -- 172.21.15.72:0/3458180371 learned_addr learned my addr 172.21.15.72:0/3458180371 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:58.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.947+0000 7f1f42d9d700 1 --2- 172.21.15.72:0/3458180371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f440cb9b0 0x7f1f44152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:58.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.947+0000 7f1f4359e700 1 --2- 172.21.15.72:0/3458180371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f441588d0 0x7f1f440ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:58.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.947+0000 7f1f4259c700 1 -- 172.21.15.72:0/3458180371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f440cb9b0 msgr2=0x7f1f44152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:58.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.947+0000 7f1f4259c700 1 --2- 172.21.15.72:0/3458180371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f440cb9b0 0x7f1f44152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.947+0000 7f1f4259c700 1 -- 172.21.15.72:0/3458180371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f441588d0 msgr2=0x7f1f440ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:58.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.947+0000 7f1f4259c700 1 --2- 172.21.15.72:0/3458180371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f441588d0 0x7f1f440ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:58.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.947+0000 7f1f4259c700 1 -- 172.21.15.72:0/3458180371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c009ae0 con 0x7f1f44154060 2023-08-31T19:05:58.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.947+0000 7f1f4259c700 1 --2- 172.21.15.72:0/3458180371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f44154060 0x7f1f44163cc0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f1f3800e900 tx=0x7f1f38009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:58.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.947+0000 7f1f2affd700 1 -- 172.21.15.72:0/3458180371 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f38012600 con 0x7f1f44154060 2023-08-31T19:05:58.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.948+0000 7f1f2affd700 1 -- 172.21.15.72:0/3458180371 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f38012760 con 0x7f1f44154060 2023-08-31T19:05:58.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.948+0000 7f1f491ff700 1 -- 172.21.15.72:0/3458180371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f44164b50 con 0x7f1f44154060 2023-08-31T19:05:58.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.948+0000 7f1f2affd700 1 -- 172.21.15.72:0/3458180371 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f38012ae0 con 0x7f1f44154060 2023-08-31T19:05:58.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.948+0000 7f1f491ff700 1 -- 172.21.15.72:0/3458180371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f44152b30 con 0x7f1f44154060 2023-08-31T19:05:58.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.949+0000 7f1f491ff700 1 -- 172.21.15.72:0/3458180371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4406c6b0 con 0x7f1f44154060 2023-08-31T19:05:58.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.950+0000 7f1f2affd700 1 -- 172.21.15.72:0/3458180371 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 45) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f1f3801b400 con 0x7f1f44154060 2023-08-31T19:05:58.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.950+0000 7f1f2affd700 1 --2- 172.21.15.72:0/3458180371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1f3005f050 0x7f1f30061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:58.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.951+0000 7f1f2affd700 1 -- 172.21.15.72:0/3458180371 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7124+0+0 (secure 0 0 0) 0x7f1f3807a8e0 con 0x7f1f44154060 2023-08-31T19:05:58.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.951+0000 7f1f42d9d700 1 -- 172.21.15.72:0/3458180371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1f3005f050 msgr2=0x7f1f30061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:05:58.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.951+0000 7f1f42d9d700 1 --2- 172.21.15.72:0/3458180371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1f3005f050 0x7f1f30061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:05:58.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:58.955+0000 7f1f2affd700 1 -- 172.21.15.72:0/3458180371 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1f3804b5c0 con 0x7f1f44154060 2023-08-31T19:05:59.009 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:59.009+0000 7ff54ef97680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:05:59.073 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:05:59.073+0000 7fde5519a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:05:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.152+0000 7f1f42d9d700 1 -- 172.21.15.72:0/3458180371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1f3005f050 msgr2=0x7f1f30061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:05:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.152+0000 7f1f42d9d700 1 --2- 172.21.15.72:0/3458180371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1f3005f050 0x7f1f30061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:05:59.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.179+0000 7f1f491ff700 1 -- 172.21.15.72:0/3458180371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f440c0dc0 con 0x7f1f44154060 2023-08-31T19:05:59.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.179+0000 7f1f2affd700 1 -- 172.21.15.72:0/3458180371 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f1f3804ebe0 con 0x7f1f44154060 2023-08-31T19:05:59.180 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:05:59.180 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2894594800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2894594800},{"type":"v1","addr":"172.21.15.146:6834","nonce":2894594800}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2296022003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2296022003},{"type":"v1","addr":"172.21.15.72:6837","nonce":2296022003}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/159383587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":159383587},{"type":"v1","addr":"172.21.15.146:6835","nonce":159383587}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:04:38.994518+0000","modified":"2023-08-31T19:04:42.017973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6835/4088389987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4088389987},{"type":"v1","addr":"172.21.15.72:6835","nonce":4088389987}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-31T19:05:59.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.182+0000 7f1f491ff700 1 -- 172.21.15.72:0/3458180371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1f3005f050 msgr2=0x7f1f30061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:05:59.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.182+0000 7f1f491ff700 1 --2- 172.21.15.72:0/3458180371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1f3005f050 0x7f1f30061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:59.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.182+0000 7f1f491ff700 1 -- 172.21.15.72:0/3458180371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f44154060 msgr2=0x7f1f44163cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:59.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.182+0000 7f1f491ff700 1 --2- 172.21.15.72:0/3458180371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f44154060 0x7f1f44163cc0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f1f3800e900 tx=0x7f1f38009060).stop 2023-08-31T19:05:59.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.182+0000 7f1f491ff700 1 -- 172.21.15.72:0/3458180371 shutdown_connections 2023-08-31T19:05:59.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.182+0000 7f1f491ff700 1 --2- 172.21.15.72:0/3458180371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1f3005f050 0x7f1f30061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:59.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.182+0000 7f1f491ff700 1 --2- 172.21.15.72:0/3458180371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f441588d0 0x7f1f440ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.182+0000 7f1f491ff700 1 --2- 172.21.15.72:0/3458180371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f440cb9b0 0x7f1f44152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.182+0000 7f1f491ff700 1 --2- 172.21.15.72:0/3458180371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f44154060 0x7f1f44163cc0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.182+0000 7f1f491ff700 1 -- 172.21.15.72:0/3458180371 >> 172.21.15.72:0/3458180371 conn(0x7f1f4405e870 msgr2=0x7f1f440bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:59.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.182+0000 7f1f491ff700 1 -- 172.21.15.72:0/3458180371 shutdown_connections 2023-08-31T19:05:59.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.182+0000 7f1f491ff700 1 -- 172.21.15.72:0/3458180371 wait complete. 2023-08-31T19:05:59.185 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 48 2023-08-31T19:05:59.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:05:59.242 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:05:59.242+0000 7ff54ef97680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:05:59.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.395+0000 7f52759ff700 1 Processor -- start 2023-08-31T19:05:59.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.395+0000 7f52759ff700 1 -- start start 2023-08-31T19:05:59.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f52759ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5270154220 0x7f5270157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:59.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f52759ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f52700cb940 0x7f52701581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f52759ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52701586b0 0x7f5270154600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f52759ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52700aa700 con 0x7f5270154220 2023-08-31T19:05:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f52759ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52700c5e10 con 0x7f52700cb940 2023-08-31T19:05:59.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f52759ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5270158b40 con 0x7f52701586b0 2023-08-31T19:05:59.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f526effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5270154220 0x7f5270157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:59.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f526effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5270154220 0x7f5270157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51434/0 (socket says 172.21.15.72:51434) 2023-08-31T19:05:59.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f526effd700 1 -- 172.21.15.72:0/1595388156 learned_addr learned my addr 172.21.15.72:0/1595388156 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:59.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f526f7fe700 1 --2- 172.21.15.72:0/1595388156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52701586b0 0x7f5270154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:59.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f526e7fc700 1 --2- 172.21.15.72:0/1595388156 >> v2:172.21.15.146:3300/0 conn(0x7f52700cb940 0x7f52701581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:59.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f526effd700 1 -- 172.21.15.72:0/1595388156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52701586b0 msgr2=0x7f5270154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:59.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f526effd700 1 --2- 172.21.15.72:0/1595388156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52701586b0 0x7f5270154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f526effd700 1 -- 172.21.15.72:0/1595388156 >> v2:172.21.15.146:3300/0 conn(0x7f52700cb940 msgr2=0x7f52701581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:59.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f526effd700 1 --2- 172.21.15.72:0/1595388156 >> v2:172.21.15.146:3300/0 conn(0x7f52700cb940 0x7f52701581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f526effd700 1 -- 172.21.15.72:0/1595388156 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52700c8c90 con 0x7f5270154220 2023-08-31T19:05:59.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f526f7fe700 1 --2- 172.21.15.72:0/1595388156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52701586b0 0x7f5270154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:05:59.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.397+0000 7f526e7fc700 1 --2- 172.21.15.72:0/1595388156 >> v2:172.21.15.146:3300/0 conn(0x7f52700cb940 0x7f52701581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:05:59.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.398+0000 7f526effd700 1 --2- 172.21.15.72:0/1595388156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5270154220 0x7f5270157cd0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f5270083c70 tx=0x7f5260009060).ready entity=mon.0 client_cookie=a5553dc4e9421f14 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:59.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.398+0000 7f526dffb700 1 -- 172.21.15.72:0/1595388156 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260005880 con 0x7f5270154220 2023-08-31T19:05:59.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.398+0000 7f526dffb700 1 -- 172.21.15.72:0/1595388156 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52600059e0 con 0x7f5270154220 2023-08-31T19:05:59.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.398+0000 7f526dffb700 1 -- 172.21.15.72:0/1595388156 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260005d60 con 0x7f5270154220 2023-08-31T19:05:59.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.398+0000 7f52759ff700 1 -- 172.21.15.72:0/1595388156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5270154220 msgr2=0x7f5270157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:59.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.398+0000 7f52759ff700 1 --2- 172.21.15.72:0/1595388156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5270154220 0x7f5270157cd0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f5270083c70 tx=0x7f5260009060).stop 2023-08-31T19:05:59.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.398+0000 7f52759ff700 1 -- 172.21.15.72:0/1595388156 shutdown_connections 2023-08-31T19:05:59.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.398+0000 7f52759ff700 1 --2- 172.21.15.72:0/1595388156 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52701586b0 0x7f5270154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.398+0000 7f52759ff700 1 --2- 172.21.15.72:0/1595388156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5270154220 0x7f5270157cd0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.398+0000 7f52759ff700 1 --2- 172.21.15.72:0/1595388156 >> v2:172.21.15.146:3300/0 conn(0x7f52700cb940 0x7f52701581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.399+0000 7f52759ff700 1 -- 172.21.15.72:0/1595388156 >> 172.21.15.72:0/1595388156 conn(0x7f527005e870 msgr2=0x7f52700cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:59.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.399+0000 7f52759ff700 1 -- 172.21.15.72:0/1595388156 shutdown_connections 2023-08-31T19:05:59.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.399+0000 7f52759ff700 1 -- 172.21.15.72:0/1595388156 wait complete. 2023-08-31T19:05:59.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.400+0000 7f52759ff700 1 Processor -- start 2023-08-31T19:05:59.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.400+0000 7f52759ff700 1 -- start start 2023-08-31T19:05:59.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.401+0000 7f52759ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52700cb940 0x7f527014f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:59.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.401+0000 7f52759ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5270154220 0x7f52700ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:59.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.401+0000 7f52759ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52701586b0 0x7f52700a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:59.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.401+0000 7f52759ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52700ac350 con 0x7f5270154220 2023-08-31T19:05:59.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.401+0000 7f52759ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527014f800 con 0x7f52700cb940 2023-08-31T19:05:59.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.401+0000 7f52759ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52700ab930 con 0x7f52701586b0 2023-08-31T19:05:59.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.401+0000 7f526e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5270154220 0x7f52700ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:59.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.401+0000 7f526e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5270154220 0x7f52700ab440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51442/0 (socket says 172.21.15.72:51442) 2023-08-31T19:05:59.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.401+0000 7f526e7fc700 1 -- 172.21.15.72:0/2901857462 learned_addr learned my addr 172.21.15.72:0/2901857462 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:59.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.401+0000 7f526f7fe700 1 --2- 172.21.15.72:0/2901857462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52701586b0 0x7f52700a7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:59.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.401+0000 7f526effd700 1 --2- 172.21.15.72:0/2901857462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52700cb940 0x7f527014f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:59.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.402+0000 7f526e7fc700 1 -- 172.21.15.72:0/2901857462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52701586b0 msgr2=0x7f52700a7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:59.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.402+0000 7f526e7fc700 1 --2- 172.21.15.72:0/2901857462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52701586b0 0x7f52700a7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.402+0000 7f526e7fc700 1 -- 172.21.15.72:0/2901857462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52700cb940 msgr2=0x7f527014f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:59.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.402+0000 7f526e7fc700 1 --2- 172.21.15.72:0/2901857462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52700cb940 0x7f527014f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.402+0000 7f526e7fc700 1 -- 172.21.15.72:0/2901857462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5260009300 con 0x7f5270154220 2023-08-31T19:05:59.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.402+0000 7f526e7fc700 1 --2- 172.21.15.72:0/2901857462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5270154220 0x7f52700ab440 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f526400d860 tx=0x7f5264008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:59.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.402+0000 7f5256ffd700 1 -- 172.21.15.72:0/2901857462 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526400f520 con 0x7f5270154220 2023-08-31T19:05:59.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.402+0000 7f5256ffd700 1 -- 172.21.15.72:0/2901857462 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526400f680 con 0x7f5270154220 2023-08-31T19:05:59.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.402+0000 7f52759ff700 1 -- 172.21.15.72:0/2901857462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52700aeb30 con 0x7f5270154220 2023-08-31T19:05:59.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.402+0000 7f5256ffd700 1 -- 172.21.15.72:0/2901857462 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526400fa00 con 0x7f5270154220 2023-08-31T19:05:59.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.402+0000 7f52759ff700 1 -- 172.21.15.72:0/2901857462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52700abfe0 con 0x7f5270154220 2023-08-31T19:05:59.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.404+0000 7f52759ff700 1 -- 172.21.15.72:0/2901857462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52700abb60 con 0x7f5270154220 2023-08-31T19:05:59.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.404+0000 7f5256ffd700 1 -- 172.21.15.72:0/2901857462 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 45) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f52640123e0 con 0x7f5270154220 2023-08-31T19:05:59.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.405+0000 7f5256ffd700 1 --2- 172.21.15.72:0/2901857462 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f525c05f050 0x7f525c061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:59.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.405+0000 7f5256ffd700 1 -- 172.21.15.72:0/2901857462 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7124+0+0 (secure 0 0 0) 0x7f526407a1f0 con 0x7f5270154220 2023-08-31T19:05:59.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.405+0000 7f526effd700 1 -- 172.21.15.72:0/2901857462 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f525c05f050 msgr2=0x7f525c061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:05:59.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.405+0000 7f526effd700 1 --2- 172.21.15.72:0/2901857462 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f525c05f050 0x7f525c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:05:59.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.409+0000 7f5256ffd700 1 -- 172.21.15.72:0/2901857462 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f52700abb60 con 0x7f5270154220 2023-08-31T19:05:59.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.586+0000 7f52759ff700 1 -- 172.21.15.72:0/2901857462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52700abb60 con 0x7f5270154220 2023-08-31T19:05:59.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.587+0000 7f5256ffd700 1 -- 172.21.15.72:0/2901857462 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+18556 (secure 0 0 0) 0x7f52700abb60 con 0x7f5270154220 2023-08-31T19:05:59.588 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:05:59.588 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":112,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:05:53.820146+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:04:37.420883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-31T19:04:37.977694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.27","mappings":[{"from":1,"to":3}]},{"pgid":"14.1","mappings":[{"from":1,"to":7}]},{"pgid":"14.12","mappings":[{"from":1,"to":5}]},{"pgid":"14.1e","mappings":[{"from":1,"to":2}]},{"pgid":"14.2a","mappings":[{"from":1,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/3487659764":"2023-09-01T19:04:52.723748+0000","172.21.15.72:0/2285609943":"2023-09-01T19:04:52.723748+0000","172.21.15.72:0/3191150215":"2023-09-01T19:04:52.723748+0000","172.21.15.72:6833/143463":"2023-09-01T19:04:52.723748+0000","172.21.15.72:6832/143463":"2023-09-01T19:04:52.723748+0000","172.21.15.72:0/1578696960":"2023-09-01T19:04:52.723748+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:05:59.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.589+0000 7f52759ff700 1 -- 172.21.15.72:0/2901857462 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f525c05f050 msgr2=0x7f525c061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:05:59.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.589+0000 7f52759ff700 1 --2- 172.21.15.72:0/2901857462 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f525c05f050 0x7f525c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:59.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.589+0000 7f52759ff700 1 -- 172.21.15.72:0/2901857462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5270154220 msgr2=0x7f52700ab440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:59.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.589+0000 7f52759ff700 1 --2- 172.21.15.72:0/2901857462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5270154220 0x7f52700ab440 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f526400d860 tx=0x7f5264008040).stop 2023-08-31T19:05:59.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.590+0000 7f52759ff700 1 -- 172.21.15.72:0/2901857462 shutdown_connections 2023-08-31T19:05:59.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.590+0000 7f52759ff700 1 --2- 172.21.15.72:0/2901857462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f52701586b0 0x7f52700a7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.590+0000 7f52759ff700 1 --2- 172.21.15.72:0/2901857462 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f525c05f050 0x7f525c061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:05:59.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.590+0000 7f52759ff700 1 --2- 172.21.15.72:0/2901857462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52700cb940 0x7f527014f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.590+0000 7f52759ff700 1 --2- 172.21.15.72:0/2901857462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5270154220 0x7f52700ab440 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.590+0000 7f52759ff700 1 -- 172.21.15.72:0/2901857462 >> 172.21.15.72:0/2901857462 conn(0x7f527005e870 msgr2=0x7f52700a88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:59.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.590+0000 7f52759ff700 1 -- 172.21.15.72:0/2901857462 shutdown_connections 2023-08-31T19:05:59.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.590+0000 7f52759ff700 1 -- 172.21.15.72:0/2901857462 wait complete. 2023-08-31T19:05:59.608 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T19:05:59.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:05:59.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.840+0000 7fc9e69ff700 1 Processor -- start 2023-08-31T19:05:59.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.840+0000 7fc9e69ff700 1 -- start start 2023-08-31T19:05:59.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.842+0000 7fc9e69ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e00aa290 0x7fc9e0156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:59.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.842+0000 7fc9e69ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e00bfd00 con 0x7fc9e00a9eb0 2023-08-31T19:05:59.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.842+0000 7fc9e69ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e00c05a0 con 0x7fc9e01574b0 2023-08-31T19:05:59.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.842+0000 7fc9e69ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e00aaea0 con 0x7fc9e00aa290 2023-08-31T19:05:59.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.842+0000 7fc9dffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc9e00a9eb0 0x7fc9e00c5bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51538/0 (socket says 172.21.15.72:51538) 2023-08-31T19:05:59.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.842+0000 7fc9dffff700 1 -- 172.21.15.72:0/2199653978 learned_addr learned my addr 172.21.15.72:0/2199653978 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:05:59.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.842+0000 7fc9df7fe700 1 --2- 172.21.15.72:0/2199653978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e00aa290 0x7fc9e0156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:59.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675482177 0 0) 0x7fc9e00bfd00 con 0x7fc9e00a9eb0 2023-08-31T19:05:59.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9c80033f0 con 0x7fc9e00a9eb0 2023-08-31T19:05:59.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982635676 0 0) 0x7fc9e00c05a0 con 0x7fc9e01574b0 2023-08-31T19:05:59.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9e00bfd00 con 0x7fc9e01574b0 2023-08-31T19:05:59.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 608093847 0 0) 0x7fc9c80033f0 con 0x7fc9e00a9eb0 2023-08-31T19:05:59.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e00aa290 msgr2=0x7fc9e0156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:59.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 --2- 172.21.15.72:0/2199653978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e00aa290 0x7fc9e0156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 >> v1:172.21.15.146:6789/0 conn(0x7fc9e01574b0 legacy=0x7fc9e00c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:59.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e00c6670 con 0x7fc9e00a9eb0 2023-08-31T19:05:59.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fc9d0001470 con 0x7fc9e00a9eb0 2023-08-31T19:05:59.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 >> v1:172.21.15.72:6789/0 conn(0x7fc9e00a9eb0 legacy=0x7fc9e00c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:59.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 --2- 172.21.15.72:0/2199653978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e00aa290 0x7fc9c8003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:59.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 --2- 172.21.15.72:0/2199653978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9c8004000 0x7fc9c8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:59.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 --2- 172.21.15.72:0/2199653978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c8004b80 0x7fc9c8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:59.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e00aaea0 con 0x7fc9c8004000 2023-08-31T19:05:59.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c800b9c0 con 0x7fc9c8004b80 2023-08-31T19:05:59.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c800bb80 con 0x7fc9e00aa290 2023-08-31T19:05:59.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.843+0000 7fc9df7fe700 1 --2- 172.21.15.72:0/2199653978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9c8004000 0x7fc9c8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:59.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.844+0000 7fc9e4f9c700 1 --2- 172.21.15.72:0/2199653978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c8004b80 0x7fc9c8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:59.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.844+0000 7fc9dffff700 1 --2- 172.21.15.72:0/2199653978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e00aa290 0x7fc9c8003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:59.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.844+0000 7fc9df7fe700 1 -- 172.21.15.72:0/2199653978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e00aa290 msgr2=0x7fc9c8003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:59.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.844+0000 7fc9df7fe700 1 --2- 172.21.15.72:0/2199653978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e00aa290 0x7fc9c8003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.844+0000 7fc9df7fe700 1 -- 172.21.15.72:0/2199653978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c8004b80 msgr2=0x7fc9c8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:05:59.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.844+0000 7fc9df7fe700 1 --2- 172.21.15.72:0/2199653978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c8004b80 0x7fc9c8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.844+0000 7fc9df7fe700 1 -- 172.21.15.72:0/2199653978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c80033f0 con 0x7fc9c8004000 2023-08-31T19:05:59.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.844+0000 7fc9dffff700 1 --2- 172.21.15.72:0/2199653978 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e00aa290 0x7fc9c8003aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:05:59.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.844+0000 7fc9df7fe700 1 --2- 172.21.15.72:0/2199653978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9c8004000 0x7fc9c8004690 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7fc9d4006d80 tx=0x7fc9d4009060).ready entity=mon.0 client_cookie=e83fe300d3a4a002 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:59.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.844+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4009e90 con 0x7fc9c8004000 2023-08-31T19:05:59.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.844+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d4009430 con 0x7fc9c8004000 2023-08-31T19:05:59.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.844+0000 7fc9deffd700 1 -- 172.21.15.72:0/2199653978 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d400e850 con 0x7fc9c8004000 2023-08-31T19:05:59.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.845+0000 7fc9e69ff700 1 -- 172.21.15.72:0/2199653978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9c8004000 msgr2=0x7fc9c8004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:59.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.845+0000 7fc9e69ff700 1 --2- 172.21.15.72:0/2199653978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9c8004000 0x7fc9c8004690 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7fc9d4006d80 tx=0x7fc9d4009060).stop 2023-08-31T19:05:59.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.845+0000 7fc9e4f9c700 1 -- 172.21.15.72:0/2199653978 reap_dead start 2023-08-31T19:05:59.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.845+0000 7fc9e69ff700 1 -- 172.21.15.72:0/2199653978 shutdown_connections 2023-08-31T19:05:59.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.845+0000 7fc9e69ff700 1 -- 172.21.15.72:0/2199653978 >> 172.21.15.72:0/2199653978 conn(0x7fc9e00c82e0 msgr2=0x7fc9e005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:05:59.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.845+0000 7fc9e69ff700 1 -- 172.21.15.72:0/2199653978 shutdown_connections 2023-08-31T19:05:59.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.845+0000 7fc9e69ff700 1 -- 172.21.15.72:0/2199653978 wait complete. 2023-08-31T19:05:59.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.847+0000 7fc9e69ff700 1 Processor -- start 2023-08-31T19:05:59.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.847+0000 7fc9e69ff700 1 -- start start 2023-08-31T19:05:59.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.848+0000 7fc9e69ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c8004000 0x7fc9e0153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:59.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.848+0000 7fc9e69ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e01537f0 0x7fc9e0164420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:59.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.848+0000 7fc9e69ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9e0164910 0x7fc9e0164d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:59.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.848+0000 7fc9e69ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e00ae010 con 0x7fc9e0164910 2023-08-31T19:05:59.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.848+0000 7fc9e69ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e01540b0 con 0x7fc9c8004000 2023-08-31T19:05:59.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.848+0000 7fc9e69ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e0154390 con 0x7fc9e01537f0 2023-08-31T19:05:59.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.848+0000 7fc9e4f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9e0164910 0x7fc9e0164d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:59.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.848+0000 7fc9dffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c8004000 0x7fc9e0153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:59.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.848+0000 7fc9df7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e01537f0 0x7fc9e0164420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:05:59.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.848+0000 7fc9e4f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9e0164910 0x7fc9e0164d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51458/0 (socket says 172.21.15.72:51458) 2023-08-31T19:05:59.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.848+0000 7fc9dffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c8004000 0x7fc9e0153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:35710/0 (socket says 172.21.15.72:35710) 2023-08-31T19:05:59.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.848+0000 7fc9e4f9c700 1 -- 172.21.15.72:0/1020139088 learned_addr learned my addr 172.21.15.72:0/1020139088 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:05:59.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.849+0000 7fc9e4f9c700 1 -- 172.21.15.72:0/1020139088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e01537f0 msgr2=0x7fc9e0164420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:59.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.849+0000 7fc9e4f9c700 1 --2- 172.21.15.72:0/1020139088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e01537f0 0x7fc9e0164420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.849+0000 7fc9e4f9c700 1 -- 172.21.15.72:0/1020139088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c8004000 msgr2=0x7fc9e0153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:05:59.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.849+0000 7fc9e4f9c700 1 --2- 172.21.15.72:0/1020139088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c8004000 0x7fc9e0153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:05:59.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.849+0000 7fc9e4f9c700 1 -- 172.21.15.72:0/1020139088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e0154670 con 0x7fc9e0164910 2023-08-31T19:05:59.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.849+0000 7fc9e4f9c700 1 --2- 172.21.15.72:0/1020139088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9e0164910 0x7fc9e0164d90 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7fc9c8003a70 tx=0x7fc9d8007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:05:59.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.850+0000 7fc9c7fff700 1 -- 172.21.15.72:0/1020139088 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d800ee40 con 0x7fc9e0164910 2023-08-31T19:05:59.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.850+0000 7fc9e69ff700 1 -- 172.21.15.72:0/1020139088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e0154950 con 0x7fc9e0164910 2023-08-31T19:05:59.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.850+0000 7fc9c7fff700 1 -- 172.21.15.72:0/1020139088 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d800c7b0 con 0x7fc9e0164910 2023-08-31T19:05:59.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.850+0000 7fc9c7fff700 1 -- 172.21.15.72:0/1020139088 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d800cb70 con 0x7fc9e0164910 2023-08-31T19:05:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.850+0000 7fc9e69ff700 1 -- 172.21.15.72:0/1020139088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e0165280 con 0x7fc9e0164910 2023-08-31T19:05:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.851+0000 7fc9e69ff700 1 -- 172.21.15.72:0/1020139088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e006c6b0 con 0x7fc9e0164910 2023-08-31T19:05:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.852+0000 7fc9c7fff700 1 -- 172.21.15.72:0/1020139088 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 45) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fc9d80133e0 con 0x7fc9e0164910 2023-08-31T19:05:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.853+0000 7fc9c7fff700 1 --2- 172.21.15.72:0/1020139088 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc9cc05f050 0x7fc9cc061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:05:59.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.853+0000 7fc9c7fff700 1 -- 172.21.15.72:0/1020139088 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7124+0+0 (secure 0 0 0) 0x7fc9d8079fe0 con 0x7fc9e0164910 2023-08-31T19:05:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.853+0000 7fc9dffff700 1 -- 172.21.15.72:0/1020139088 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc9cc05f050 msgr2=0x7fc9cc061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:05:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.853+0000 7fc9dffff700 1 --2- 172.21.15.72:0/1020139088 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc9cc05f050 0x7fc9cc061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:05:59.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:05:59.857+0000 7fc9c7fff700 1 -- 172.21.15.72:0/1020139088 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc9d804acc0 con 0x7fc9e0164910 2023-08-31T19:05:59.878 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:05:59.878+0000 7fde5519a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:05:59.966 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:05:59.966+0000 7fde5519a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:06:00.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.054+0000 7fc9dffff700 1 -- 172.21.15.72:0/1020139088 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc9cc05f050 msgr2=0x7fc9cc061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:06:00.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.054+0000 7fc9dffff700 1 --2- 172.21.15.72:0/1020139088 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc9cc05f050 0x7fc9cc061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:06:00.059 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:00.059+0000 7fde5519a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:06:00.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.075+0000 7fc9e69ff700 1 -- 172.21.15.72:0/1020139088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9e00c6a70 con 0x7fc9e0164910 2023-08-31T19:06:00.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.076+0000 7fc9c7fff700 1 -- 172.21.15.72:0/1020139088 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fc9d8019070 con 0x7fc9e0164910 2023-08-31T19:06:00.076 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:06:00.077 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2894594800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2894594800},{"type":"v1","addr":"172.21.15.146:6834","nonce":2894594800}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2296022003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2296022003},{"type":"v1","addr":"172.21.15.72:6837","nonce":2296022003}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/159383587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":159383587},{"type":"v1","addr":"172.21.15.146:6835","nonce":159383587}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:04:38.994518+0000","modified":"2023-08-31T19:04:42.017973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6835/4088389987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4088389987},{"type":"v1","addr":"172.21.15.72:6835","nonce":4088389987}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-31T19:06:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.078+0000 7fc9e69ff700 1 -- 172.21.15.72:0/1020139088 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc9cc05f050 msgr2=0x7fc9cc061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:06:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.078+0000 7fc9e69ff700 1 --2- 172.21.15.72:0/1020139088 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc9cc05f050 0x7fc9cc061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.078+0000 7fc9e69ff700 1 -- 172.21.15.72:0/1020139088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9e0164910 msgr2=0x7fc9e0164d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.078+0000 7fc9e69ff700 1 --2- 172.21.15.72:0/1020139088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9e0164910 0x7fc9e0164d90 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7fc9c8003a70 tx=0x7fc9d8007f30).stop 2023-08-31T19:06:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.078+0000 7fc9e69ff700 1 -- 172.21.15.72:0/1020139088 shutdown_connections 2023-08-31T19:06:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.078+0000 7fc9e69ff700 1 --2- 172.21.15.72:0/1020139088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9e0164910 0x7fc9e0164d90 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.078+0000 7fc9e69ff700 1 --2- 172.21.15.72:0/1020139088 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc9cc05f050 0x7fc9cc061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.078+0000 7fc9e69ff700 1 --2- 172.21.15.72:0/1020139088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9c8004000 0x7fc9e0153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.078+0000 7fc9e69ff700 1 --2- 172.21.15.72:0/1020139088 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9e01537f0 0x7fc9e0164420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.078+0000 7fc9e69ff700 1 -- 172.21.15.72:0/1020139088 >> 172.21.15.72:0/1020139088 conn(0x7fc9e00c82e0 msgr2=0x7fc9e00c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.078+0000 7fc9e69ff700 1 -- 172.21.15.72:0/1020139088 shutdown_connections 2023-08-31T19:06:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.079+0000 7fc9e69ff700 1 -- 172.21.15.72:0/1020139088 wait complete. 2023-08-31T19:06:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 48 2023-08-31T19:06:00.089 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:00.089+0000 7ff54ef97680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:06:00.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:06:00.186 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:00.186+0000 7ff54ef97680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:06:00.243 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:00.243+0000 7fde5519a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:06:00.285 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:00.285+0000 7ff54ef97680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:06:00.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.288+0000 7fc94bbff700 1 Processor -- start 2023-08-31T19:06:00.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.288+0000 7fc94bbff700 1 -- start start 2023-08-31T19:06:00.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.289+0000 7fc94bbff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc9440a9eb0 0x7fc9440aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:00.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.289+0000 7fc94bbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9440c5bf0 0x7fc9440c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:00.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.289+0000 7fc94bbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc944156fc0 0x7fc944157450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:00.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.289+0000 7fc94bbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9440bfd00 con 0x7fc944156fc0 2023-08-31T19:06:00.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.289+0000 7fc94bbff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9440c05a0 con 0x7fc9440a9eb0 2023-08-31T19:06:00.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.289+0000 7fc94bbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9440aaea0 con 0x7fc9440c5bf0 2023-08-31T19:06:00.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.289+0000 7fc94a19c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc944156fc0 0x7fc944157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:00.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.289+0000 7fc94a19c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc944156fc0 0x7fc944157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51462/0 (socket says 172.21.15.72:51462) 2023-08-31T19:06:00.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.289+0000 7fc94a19c700 1 -- 172.21.15.72:0/480635636 learned_addr learned my addr 172.21.15.72:0/480635636 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:00.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.290+0000 7fc94999b700 1 --2- 172.21.15.72:0/480635636 >> v2:172.21.15.146:3300/0 conn(0x7fc9440a9eb0 0x7fc9440aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:00.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.290+0000 7fc94919a700 1 --2- 172.21.15.72:0/480635636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9440c5bf0 0x7fc9440c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:00.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.290+0000 7fc94a19c700 1 -- 172.21.15.72:0/480635636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9440c5bf0 msgr2=0x7fc9440c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:00.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.290+0000 7fc94a19c700 1 --2- 172.21.15.72:0/480635636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9440c5bf0 0x7fc9440c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.290+0000 7fc94a19c700 1 -- 172.21.15.72:0/480635636 >> v2:172.21.15.146:3300/0 conn(0x7fc9440a9eb0 msgr2=0x7fc9440aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:00.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.290+0000 7fc94a19c700 1 --2- 172.21.15.72:0/480635636 >> v2:172.21.15.146:3300/0 conn(0x7fc9440a9eb0 0x7fc9440aa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.290+0000 7fc94a19c700 1 -- 172.21.15.72:0/480635636 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9440c6670 con 0x7fc944156fc0 2023-08-31T19:06:00.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.290+0000 7fc94a19c700 1 --2- 172.21.15.72:0/480635636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc944156fc0 0x7fc944157450 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7fc944064400 tx=0x7fc93c009840).ready entity=mon.0 client_cookie=ca14859f6a529e61 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:00.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.290+0000 7fc948999700 1 -- 172.21.15.72:0/480635636 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c00e070 con 0x7fc944156fc0 2023-08-31T19:06:00.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.291+0000 7fc948999700 1 -- 172.21.15.72:0/480635636 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c00b970 con 0x7fc944156fc0 2023-08-31T19:06:00.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.291+0000 7fc948999700 1 -- 172.21.15.72:0/480635636 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c00bcf0 con 0x7fc944156fc0 2023-08-31T19:06:00.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.291+0000 7fc94bbff700 1 -- 172.21.15.72:0/480635636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc944156fc0 msgr2=0x7fc944157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.291+0000 7fc94bbff700 1 --2- 172.21.15.72:0/480635636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc944156fc0 0x7fc944157450 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7fc944064400 tx=0x7fc93c009840).stop 2023-08-31T19:06:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.291+0000 7fc94bbff700 1 -- 172.21.15.72:0/480635636 shutdown_connections 2023-08-31T19:06:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.291+0000 7fc94bbff700 1 --2- 172.21.15.72:0/480635636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc944156fc0 0x7fc944157450 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.291+0000 7fc94bbff700 1 --2- 172.21.15.72:0/480635636 >> v2:172.21.15.146:3300/0 conn(0x7fc9440a9eb0 0x7fc9440aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.291+0000 7fc94bbff700 1 --2- 172.21.15.72:0/480635636 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9440c5bf0 0x7fc9440c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.291+0000 7fc94bbff700 1 -- 172.21.15.72:0/480635636 >> 172.21.15.72:0/480635636 conn(0x7fc9440c82e0 msgr2=0x7fc94405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.292+0000 7fc94bbff700 1 -- 172.21.15.72:0/480635636 shutdown_connections 2023-08-31T19:06:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.292+0000 7fc94bbff700 1 -- 172.21.15.72:0/480635636 wait complete. 2023-08-31T19:06:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.294+0000 7fc94bbff700 1 Processor -- start 2023-08-31T19:06:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.294+0000 7fc94bbff700 1 -- start start 2023-08-31T19:06:00.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94bbff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9440a9eb0 0x7fc94414e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94bbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9440c5bf0 0x7fc94414c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94bbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc944156fc0 0x7fc9440af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94bbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc944150460 con 0x7fc944156fc0 2023-08-31T19:06:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94bbff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9440c3d80 con 0x7fc9440a9eb0 2023-08-31T19:06:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94bbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9440c4060 con 0x7fc9440c5bf0 2023-08-31T19:06:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94a19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc944156fc0 0x7fc9440af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94a19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc944156fc0 0x7fc9440af120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51464/0 (socket says 172.21.15.72:51464) 2023-08-31T19:06:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94a19c700 1 -- 172.21.15.72:0/1664998887 learned_addr learned my addr 172.21.15.72:0/1664998887 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94919a700 1 --2- 172.21.15.72:0/1664998887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9440c5bf0 0x7fc94414c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94999b700 1 --2- 172.21.15.72:0/1664998887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9440a9eb0 0x7fc94414e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:00.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94a19c700 1 -- 172.21.15.72:0/1664998887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9440c5bf0 msgr2=0x7fc94414c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:00.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94a19c700 1 --2- 172.21.15.72:0/1664998887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9440c5bf0 0x7fc94414c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94a19c700 1 -- 172.21.15.72:0/1664998887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9440a9eb0 msgr2=0x7fc94414e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:00.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94a19c700 1 --2- 172.21.15.72:0/1664998887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9440a9eb0 0x7fc94414e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.296+0000 7fc94a19c700 1 -- 172.21.15.72:0/1664998887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c009ae0 con 0x7fc944156fc0 2023-08-31T19:06:00.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.297+0000 7fc94a19c700 1 --2- 172.21.15.72:0/1664998887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc944156fc0 0x7fc9440af120 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7fc93c00b610 tx=0x7fc93c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:00.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.297+0000 7fc939ffb700 1 -- 172.21.15.72:0/1664998887 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c00bee0 con 0x7fc944156fc0 2023-08-31T19:06:00.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.297+0000 7fc939ffb700 1 -- 172.21.15.72:0/1664998887 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c013e60 con 0x7fc944156fc0 2023-08-31T19:06:00.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.297+0000 7fc939ffb700 1 -- 172.21.15.72:0/1664998887 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c007860 con 0x7fc944156fc0 2023-08-31T19:06:00.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.297+0000 7fc94bbff700 1 -- 172.21.15.72:0/1664998887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9440c4340 con 0x7fc944156fc0 2023-08-31T19:06:00.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.297+0000 7fc94bbff700 1 -- 172.21.15.72:0/1664998887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9440c4900 con 0x7fc944156fc0 2023-08-31T19:06:00.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.298+0000 7fc94bbff700 1 -- 172.21.15.72:0/1664998887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9440c4a90 con 0x7fc944156fc0 2023-08-31T19:06:00.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.299+0000 7fc939ffb700 1 -- 172.21.15.72:0/1664998887 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 45) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fc93c003040 con 0x7fc944156fc0 2023-08-31T19:06:00.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.300+0000 7fc939ffb700 1 --2- 172.21.15.72:0/1664998887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc92805f050 0x7fc928061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:00.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.300+0000 7fc939ffb700 1 -- 172.21.15.72:0/1664998887 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7124+0+0 (secure 0 0 0) 0x7fc93c07bec0 con 0x7fc944156fc0 2023-08-31T19:06:00.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.300+0000 7fc94999b700 1 -- 172.21.15.72:0/1664998887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc92805f050 msgr2=0x7fc928061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:06:00.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.301+0000 7fc94999b700 1 --2- 172.21.15.72:0/1664998887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc92805f050 0x7fc928061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:06:00.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.304+0000 7fc939ffb700 1 -- 172.21.15.72:0/1664998887 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc93c04cb20 con 0x7fc944156fc0 2023-08-31T19:06:00.333 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:00.334+0000 7fde5519a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:06:00.476 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:00.475+0000 7fde5519a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:06:00.482 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:00.482+0000 7ff54ef97680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:06:00.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.502+0000 7fc94999b700 1 -- 172.21.15.72:0/1664998887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc92805f050 msgr2=0x7fc928061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:06:00.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.502+0000 7fc94999b700 1 --2- 172.21.15.72:0/1664998887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc92805f050 0x7fc928061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:06:00.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.523+0000 7fc94bbff700 1 -- 172.21.15.72:0/1664998887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc94406c6b0 con 0x7fc944156fc0 2023-08-31T19:06:00.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.523+0000 7fc939ffb700 1 -- 172.21.15.72:0/1664998887 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fc93c023030 con 0x7fc944156fc0 2023-08-31T19:06:00.524 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:06:00.524 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2894594800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2894594800},{"type":"v1","addr":"172.21.15.146:6834","nonce":2894594800}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2296022003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2296022003},{"type":"v1","addr":"172.21.15.72:6837","nonce":2296022003}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/159383587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":159383587},{"type":"v1","addr":"172.21.15.146:6835","nonce":159383587}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:04:38.994518+0000","modified":"2023-08-31T19:04:42.017973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7122":{"gid":7122,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6835/4088389987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4088389987},{"type":"v1","addr":"172.21.15.72:6835","nonce":4088389987}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-31T19:06:00.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.525+0000 7fc94bbff700 1 -- 172.21.15.72:0/1664998887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc92805f050 msgr2=0x7fc928061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:06:00.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.525+0000 7fc94bbff700 1 --2- 172.21.15.72:0/1664998887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc92805f050 0x7fc928061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:00.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.525+0000 7fc94bbff700 1 -- 172.21.15.72:0/1664998887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc944156fc0 msgr2=0x7fc9440af120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.525+0000 7fc94bbff700 1 --2- 172.21.15.72:0/1664998887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc944156fc0 0x7fc9440af120 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7fc93c00b610 tx=0x7fc93c009840).stop 2023-08-31T19:06:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.525+0000 7fc94bbff700 1 -- 172.21.15.72:0/1664998887 shutdown_connections 2023-08-31T19:06:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.526+0000 7fc94bbff700 1 --2- 172.21.15.72:0/1664998887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc944156fc0 0x7fc9440af120 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.526+0000 7fc94bbff700 1 --2- 172.21.15.72:0/1664998887 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc92805f050 0x7fc928061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:00.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.526+0000 7fc94bbff700 1 --2- 172.21.15.72:0/1664998887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9440a9eb0 0x7fc94414e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.526+0000 7fc94bbff700 1 --2- 172.21.15.72:0/1664998887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc9440c5bf0 0x7fc94414c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.526+0000 7fc94bbff700 1 -- 172.21.15.72:0/1664998887 >> 172.21.15.72:0/1664998887 conn(0x7fc9440c82e0 msgr2=0x7fc9440c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:00.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.526+0000 7fc94bbff700 1 -- 172.21.15.72:0/1664998887 shutdown_connections 2023-08-31T19:06:00.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.526+0000 7fc94bbff700 1 -- 172.21.15.72:0/1664998887 wait complete. 2023-08-31T19:06:00.529 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 48 2023-08-31T19:06:00.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:06:00.578 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:00.578+0000 7ff54ef97680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:06:00.607 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:00.607+0000 7fde5519a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:06:00.727 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:00.727+0000 7ff54ef97680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:06:00.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.737+0000 7f2f051ff700 1 Processor -- start 2023-08-31T19:06:00.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.737+0000 7f2f051ff700 1 -- start start 2023-08-31T19:06:00.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.738+0000 7f2f051ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f000bda40 0x7f2f000a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.738+0000 7f2f051ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f001574f0 0x7f2f00157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.739+0000 7f2f051ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f000bcb50 con 0x7f2f000a4a00 2023-08-31T19:06:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.739+0000 7f2f051ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f000c27f0 con 0x7f2f000bda40 2023-08-31T19:06:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.739+0000 7f2f051ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f000653b0 con 0x7f2f001574f0 2023-08-31T19:06:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.739+0000 7f2efed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2f000a4a00 0x7f2f00064ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51548/0 (socket says 172.21.15.72:51548) 2023-08-31T19:06:00.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.739+0000 7f2efed9d700 1 -- 172.21.15.72:0/875286028 learned_addr learned my addr 172.21.15.72:0/875286028 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:00.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.739+0000 7f2efe59c700 1 --2- 172.21.15.72:0/875286028 >> v2:172.21.15.146:3300/0 conn(0x7f2f000bda40 0x7f2f000a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:00.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.739+0000 7f2eff59e700 1 --2- 172.21.15.72:0/875286028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f001574f0 0x7f2f00157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:00.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.739+0000 7f2efdd9b700 1 -- 172.21.15.72:0/875286028 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803936904 0 0) 0x7f2f000bcb50 con 0x7f2f000a4a00 2023-08-31T19:06:00.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.739+0000 7f2efdd9b700 1 -- 172.21.15.72:0/875286028 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ee80033f0 con 0x7f2f000a4a00 2023-08-31T19:06:00.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.739+0000 7f2efe59c700 1 -- 172.21.15.72:0/875286028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f001574f0 msgr2=0x7f2f00157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:00.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.739+0000 7f2efe59c700 1 --2- 172.21.15.72:0/875286028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f001574f0 0x7f2f00157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.739+0000 7f2efe59c700 1 -- 172.21.15.72:0/875286028 >> v1:172.21.15.72:6789/0 conn(0x7f2f000a4a00 legacy=0x7f2f00064ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:00.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.739+0000 7f2efe59c700 1 -- 172.21.15.72:0/875286028 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f000bbf40 con 0x7f2f000bda40 2023-08-31T19:06:00.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.740+0000 7f2efe59c700 1 --2- 172.21.15.72:0/875286028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f000bda40 0x7f2f000a4de0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f2ef4009760 tx=0x7f2ef4009060).ready entity=mon.1 client_cookie=a5803173f05f5e7c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:00.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.740+0000 7f2efdd9b700 1 -- 172.21.15.72:0/875286028 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef40090d0 con 0x7f2f000bda40 2023-08-31T19:06:00.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.740+0000 7f2efdd9b700 1 -- 172.21.15.72:0/875286028 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef400d4a0 con 0x7f2f000bda40 2023-08-31T19:06:00.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.740+0000 7f2efdd9b700 1 -- 172.21.15.72:0/875286028 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400d820 con 0x7f2f000bda40 2023-08-31T19:06:00.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.740+0000 7f2f051ff700 1 -- 172.21.15.72:0/875286028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f000bda40 msgr2=0x7f2f000a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:00.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.740+0000 7f2f051ff700 1 --2- 172.21.15.72:0/875286028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f000bda40 0x7f2f000a4de0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f2ef4009760 tx=0x7f2ef4009060).stop 2023-08-31T19:06:00.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.741+0000 7f2f051ff700 1 -- 172.21.15.72:0/875286028 shutdown_connections 2023-08-31T19:06:00.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.741+0000 7f2f051ff700 1 --2- 172.21.15.72:0/875286028 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f001574f0 0x7f2f00157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.741+0000 7f2f051ff700 1 --2- 172.21.15.72:0/875286028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f000bda40 0x7f2f000a4de0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.741+0000 7f2f051ff700 1 -- 172.21.15.72:0/875286028 >> 172.21.15.72:0/875286028 conn(0x7f2f00063120 msgr2=0x7f2f000c6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:00.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.741+0000 7f2f051ff700 1 -- 172.21.15.72:0/875286028 shutdown_connections 2023-08-31T19:06:00.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.741+0000 7f2f051ff700 1 -- 172.21.15.72:0/875286028 wait complete. 2023-08-31T19:06:00.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.743+0000 7f2f051ff700 1 Processor -- start 2023-08-31T19:06:00.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.743+0000 7f2f051ff700 1 -- start start 2023-08-31T19:06:00.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.744+0000 7f2f051ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f000a4a00 0x7f2f000a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:00.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.744+0000 7f2f051ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f000bda40 0x7f2f000aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:00.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.744+0000 7f2f051ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f001574f0 0x7f2f00158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:00.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.744+0000 7f2f051ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f000aa2c0 con 0x7f2f000a4a00 2023-08-31T19:06:00.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.744+0000 7f2f051ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f00168d70 con 0x7f2f000bda40 2023-08-31T19:06:00.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.744+0000 7f2f051ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f00168160 con 0x7f2f001574f0 2023-08-31T19:06:00.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.744+0000 7f2efed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f000a4a00 0x7f2f000a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:00.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.745+0000 7f2efed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f000a4a00 0x7f2f000a9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51470/0 (socket says 172.21.15.72:51470) 2023-08-31T19:06:00.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.745+0000 7f2efed9d700 1 -- 172.21.15.72:0/1334180834 learned_addr learned my addr 172.21.15.72:0/1334180834 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:00.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.745+0000 7f2efe59c700 1 --2- 172.21.15.72:0/1334180834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f000bda40 0x7f2f000aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:00.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.745+0000 7f2eff59e700 1 --2- 172.21.15.72:0/1334180834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f001574f0 0x7f2f00158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:00.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.745+0000 7f2efed9d700 1 -- 172.21.15.72:0/1334180834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f001574f0 msgr2=0x7f2f00158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:00.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.745+0000 7f2efed9d700 1 --2- 172.21.15.72:0/1334180834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f001574f0 0x7f2f00158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.745+0000 7f2efed9d700 1 -- 172.21.15.72:0/1334180834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f000bda40 msgr2=0x7f2f000aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:00.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.745+0000 7f2efed9d700 1 --2- 172.21.15.72:0/1334180834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f000bda40 0x7f2f000aabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.745+0000 7f2efed9d700 1 -- 172.21.15.72:0/1334180834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef40092a0 con 0x7f2f000a4a00 2023-08-31T19:06:00.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.745+0000 7f2efed9d700 1 --2- 172.21.15.72:0/1334180834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f000a4a00 0x7f2f000a9dd0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f2ef0001ed0 tx=0x7f2ef0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:00.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.745+0000 7f2ee6ffd700 1 -- 172.21.15.72:0/1334180834 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000ce10 con 0x7f2f000a4a00 2023-08-31T19:06:00.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.745+0000 7f2ee6ffd700 1 -- 172.21.15.72:0/1334180834 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef00072e0 con 0x7f2f000a4a00 2023-08-31T19:06:00.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.745+0000 7f2f051ff700 1 -- 172.21.15.72:0/1334180834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f00168440 con 0x7f2f000a4a00 2023-08-31T19:06:00.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.745+0000 7f2ee6ffd700 1 -- 172.21.15.72:0/1334180834 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef00057a0 con 0x7f2f000a4a00 2023-08-31T19:06:00.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.746+0000 7f2f051ff700 1 -- 172.21.15.72:0/1334180834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f00168a00 con 0x7f2f000a4a00 2023-08-31T19:06:00.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.747+0000 7f2f051ff700 1 -- 172.21.15.72:0/1334180834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f00164810 con 0x7f2f000a4a00 2023-08-31T19:06:00.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.747+0000 7f2ee6ffd700 1 -- 172.21.15.72:0/1334180834 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 45) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f2ef0005b50 con 0x7f2f000a4a00 2023-08-31T19:06:00.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.748+0000 7f2ee6ffd700 1 --2- 172.21.15.72:0/1334180834 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2eec05f050 0x7f2eec061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:00.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.748+0000 7f2ee6ffd700 1 -- 172.21.15.72:0/1334180834 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7124+0+0 (secure 0 0 0) 0x7f2ef0079c10 con 0x7f2f000a4a00 2023-08-31T19:06:00.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.748+0000 7f2efe59c700 1 -- 172.21.15.72:0/1334180834 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2eec05f050 msgr2=0x7f2eec061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:06:00.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.748+0000 7f2efe59c700 1 --2- 172.21.15.72:0/1334180834 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2eec05f050 0x7f2eec061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:06:00.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.756+0000 7f2ee6ffd700 1 -- 172.21.15.72:0/1334180834 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2ef004a8d0 con 0x7f2f000a4a00 2023-08-31T19:06:00.868 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:00.868+0000 7ff54ef97680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:06:00.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.935+0000 7f2f051ff700 1 -- 172.21.15.72:0/1334180834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f0006c6b0 con 0x7f2f000a4a00 2023-08-31T19:06:00.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.936+0000 7f2ee6ffd700 1 -- 172.21.15.72:0/1334180834 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+18556 (secure 0 0 0) 0x7f2ef0018070 con 0x7f2f000a4a00 2023-08-31T19:06:00.937 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:06:00.937 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":112,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:05:53.820146+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:04:37.420883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-31T19:04:37.977694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.27","mappings":[{"from":1,"to":3}]},{"pgid":"14.1","mappings":[{"from":1,"to":7}]},{"pgid":"14.12","mappings":[{"from":1,"to":5}]},{"pgid":"14.1e","mappings":[{"from":1,"to":2}]},{"pgid":"14.2a","mappings":[{"from":1,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/3487659764":"2023-09-01T19:04:52.723748+0000","172.21.15.72:0/2285609943":"2023-09-01T19:04:52.723748+0000","172.21.15.72:0/3191150215":"2023-09-01T19:04:52.723748+0000","172.21.15.72:6833/143463":"2023-09-01T19:04:52.723748+0000","172.21.15.72:6832/143463":"2023-09-01T19:04:52.723748+0000","172.21.15.72:0/1578696960":"2023-09-01T19:04:52.723748+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:06:00.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.938+0000 7f2f051ff700 1 -- 172.21.15.72:0/1334180834 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2eec05f050 msgr2=0x7f2eec061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:06:00.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.938+0000 7f2f051ff700 1 --2- 172.21.15.72:0/1334180834 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2eec05f050 0x7f2eec061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:00.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.939+0000 7f2f051ff700 1 -- 172.21.15.72:0/1334180834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f000a4a00 msgr2=0x7f2f000a9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:00.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.939+0000 7f2f051ff700 1 --2- 172.21.15.72:0/1334180834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f000a4a00 0x7f2f000a9dd0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f2ef0001ed0 tx=0x7f2ef0007c70).stop 2023-08-31T19:06:00.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.939+0000 7f2f051ff700 1 -- 172.21.15.72:0/1334180834 shutdown_connections 2023-08-31T19:06:00.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.939+0000 7f2f051ff700 1 --2- 172.21.15.72:0/1334180834 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2f001574f0 0x7f2f00158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.939+0000 7f2f051ff700 1 --2- 172.21.15.72:0/1334180834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f000a4a00 0x7f2f000a9dd0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.939+0000 7f2f051ff700 1 --2- 172.21.15.72:0/1334180834 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2eec05f050 0x7f2eec061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:00.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.939+0000 7f2f051ff700 1 --2- 172.21.15.72:0/1334180834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f000bda40 0x7f2f000aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:00.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.939+0000 7f2f051ff700 1 -- 172.21.15.72:0/1334180834 >> 172.21.15.72:0/1334180834 conn(0x7f2f00063120 msgr2=0x7f2f001545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:00.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.939+0000 7f2f051ff700 1 -- 172.21.15.72:0/1334180834 shutdown_connections 2023-08-31T19:06:00.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:00.939+0000 7f2f051ff700 1 -- 172.21.15.72:0/1334180834 wait complete. 2023-08-31T19:06:00.954 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:00.954+0000 7fde5519a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:06:00.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T19:06:01.043 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:01.042+0000 7fde5519a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:06:01.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.195+0000 7f9ef29ff700 1 Processor -- start 2023-08-31T19:06:01.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.195+0000 7f9ef29ff700 1 -- start start 2023-08-31T19:06:01.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.197+0000 7f9ef29ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9eec157c10 0x7f9eec0ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:01.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.197+0000 7f9ef29ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9eec0637c0 0x7f9eec155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:01.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.197+0000 7f9ef29ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eec0c6130 con 0x7f9eec0ad1b0 2023-08-31T19:06:01.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.197+0000 7f9ef29ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eec0c0350 con 0x7f9eec157c10 2023-08-31T19:06:01.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.197+0000 7f9ef29ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec1580b0 con 0x7f9eec0637c0 2023-08-31T19:06:01.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.197+0000 7f9eeb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9eec157c10 0x7f9eec0ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:01.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.197+0000 7f9eeb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9eec157c10 0x7f9eec0ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51484/0 (socket says 172.21.15.72:51484) 2023-08-31T19:06:01.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.197+0000 7f9eeb7fe700 1 -- 172.21.15.72:0/101648159 learned_addr learned my addr 172.21.15.72:0/101648159 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:01.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.197+0000 7f9eebfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9eec0ad1b0 0x7f9eec0630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51564/0 (socket says 172.21.15.72:51564) 2023-08-31T19:06:01.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.197+0000 7f9ef0f9c700 1 --2- 172.21.15.72:0/101648159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9eec0637c0 0x7f9eec155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:01.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.198+0000 7f9eeb7fe700 1 -- 172.21.15.72:0/101648159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9eec0637c0 msgr2=0x7f9eec155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:01.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.198+0000 7f9eeb7fe700 1 --2- 172.21.15.72:0/101648159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9eec0637c0 0x7f9eec155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:01.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.198+0000 7f9eeb7fe700 1 -- 172.21.15.72:0/101648159 >> v1:172.21.15.72:6789/0 conn(0x7f9eec0ad1b0 legacy=0x7f9eec0630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.198+0000 7f9eeb7fe700 1 -- 172.21.15.72:0/101648159 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec155560 con 0x7f9eec157c10 2023-08-31T19:06:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.198+0000 7f9eeaffd700 1 -- 172.21.15.72:0/101648159 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944474662 0 0) 0x7f9eec0c6130 con 0x7f9eec0ad1b0 2023-08-31T19:06:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.198+0000 7f9eeb7fe700 1 --2- 172.21.15.72:0/101648159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9eec157c10 0x7f9eec0ad590 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f9ee0006fd0 tx=0x7f9ee00090f0).ready entity=mon.0 client_cookie=4e5ba02d0974aafb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.198+0000 7f9eeaffd700 1 -- 172.21.15.72:0/101648159 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000b580 con 0x7f9eec157c10 2023-08-31T19:06:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.198+0000 7f9eeaffd700 1 -- 172.21.15.72:0/101648159 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee000b6e0 con 0x7f9eec157c10 2023-08-31T19:06:01.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.198+0000 7f9eeaffd700 1 -- 172.21.15.72:0/101648159 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000ba60 con 0x7f9eec157c10 2023-08-31T19:06:01.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.199+0000 7f9ef29ff700 1 -- 172.21.15.72:0/101648159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9eec157c10 msgr2=0x7f9eec0ad590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:01.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.199+0000 7f9ef29ff700 1 --2- 172.21.15.72:0/101648159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9eec157c10 0x7f9eec0ad590 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f9ee0006fd0 tx=0x7f9ee00090f0).stop 2023-08-31T19:06:01.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.199+0000 7f9ef29ff700 1 -- 172.21.15.72:0/101648159 shutdown_connections 2023-08-31T19:06:01.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.199+0000 7f9ef29ff700 1 --2- 172.21.15.72:0/101648159 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9eec0637c0 0x7f9eec155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:01.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.199+0000 7f9ef29ff700 1 --2- 172.21.15.72:0/101648159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9eec157c10 0x7f9eec0ad590 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:01.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.199+0000 7f9ef29ff700 1 -- 172.21.15.72:0/101648159 >> 172.21.15.72:0/101648159 conn(0x7f9eec05eb60 msgr2=0x7f9eec0cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:01.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.199+0000 7f9ef29ff700 1 -- 172.21.15.72:0/101648159 shutdown_connections 2023-08-31T19:06:01.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.199+0000 7f9ef29ff700 1 -- 172.21.15.72:0/101648159 wait complete. 2023-08-31T19:06:01.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.200+0000 7f9ef29ff700 1 Processor -- start 2023-08-31T19:06:01.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.200+0000 7f9ef29ff700 1 -- start start 2023-08-31T19:06:01.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.201+0000 7f9ef29ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eec0637c0 0x7f9eec14a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:01.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.201+0000 7f9ef29ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9eec0ad1b0 0x7f9eec0af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:01.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.201+0000 7f9ef29ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9eec157c10 0x7f9eec0ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:01.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.201+0000 7f9ef29ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0adda0 con 0x7f9eec157c10 2023-08-31T19:06:01.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.201+0000 7f9ef29ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0ae080 con 0x7f9eec0637c0 2023-08-31T19:06:01.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.201+0000 7f9ef29ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec0ae360 con 0x7f9eec0ad1b0 2023-08-31T19:06:01.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.202+0000 7f9ef0f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9eec157c10 0x7f9eec0ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:01.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.202+0000 7f9ef0f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9eec157c10 0x7f9eec0ac140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51500/0 (socket says 172.21.15.72:51500) 2023-08-31T19:06:01.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.202+0000 7f9ef0f9c700 1 -- 172.21.15.72:0/378218357 learned_addr learned my addr 172.21.15.72:0/378218357 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.202+0000 7f9eeb7fe700 1 --2- 172.21.15.72:0/378218357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9eec0ad1b0 0x7f9eec0af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.202+0000 7f9eebfff700 1 --2- 172.21.15.72:0/378218357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eec0637c0 0x7f9eec14a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.202+0000 7f9ef0f9c700 1 -- 172.21.15.72:0/378218357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9eec0ad1b0 msgr2=0x7f9eec0af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.202+0000 7f9ef0f9c700 1 --2- 172.21.15.72:0/378218357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9eec0ad1b0 0x7f9eec0af120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.202+0000 7f9ef0f9c700 1 -- 172.21.15.72:0/378218357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eec0637c0 msgr2=0x7f9eec14a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:01.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.202+0000 7f9ef0f9c700 1 --2- 172.21.15.72:0/378218357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eec0637c0 0x7f9eec14a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:01.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.202+0000 7f9ef0f9c700 1 -- 172.21.15.72:0/378218357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee0009370 con 0x7f9eec157c10 2023-08-31T19:06:01.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.202+0000 7f9ef0f9c700 1 --2- 172.21.15.72:0/378218357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9eec157c10 0x7f9eec0ac140 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f9ee4009ef0 tx=0x7f9ee400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:01.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.202+0000 7f9ed3fff700 1 -- 172.21.15.72:0/378218357 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee400cb70 con 0x7f9eec157c10 2023-08-31T19:06:01.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.203+0000 7f9ed3fff700 1 -- 172.21.15.72:0/378218357 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee400f040 con 0x7f9eec157c10 2023-08-31T19:06:01.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.203+0000 7f9ed3fff700 1 -- 172.21.15.72:0/378218357 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4013400 con 0x7f9eec157c10 2023-08-31T19:06:01.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.203+0000 7f9ef29ff700 1 -- 172.21.15.72:0/378218357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eec0ae640 con 0x7f9eec157c10 2023-08-31T19:06:01.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.203+0000 7f9ef29ff700 1 -- 172.21.15.72:0/378218357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec0aec00 con 0x7f9eec157c10 2023-08-31T19:06:01.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.204+0000 7f9ef29ff700 1 -- 172.21.15.72:0/378218357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eec0aedf0 con 0x7f9eec157c10 2023-08-31T19:06:01.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.204+0000 7f9ed3fff700 1 -- 172.21.15.72:0/378218357 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 45) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f9ee40137b0 con 0x7f9eec157c10 2023-08-31T19:06:01.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.205+0000 7f9ed3fff700 1 --2- 172.21.15.72:0/378218357 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ed805f080 0x7f9ed8061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:01.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.205+0000 7f9ed3fff700 1 -- 172.21.15.72:0/378218357 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7124+0+0 (secure 0 0 0) 0x7f9ee407afb0 con 0x7f9eec157c10 2023-08-31T19:06:01.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.205+0000 7f9eebfff700 1 -- 172.21.15.72:0/378218357 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ed805f080 msgr2=0x7f9ed8061540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:06:01.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.205+0000 7f9eebfff700 1 --2- 172.21.15.72:0/378218357 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ed805f080 0x7f9ed8061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:06:01.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.209+0000 7f9ed3fff700 1 -- 172.21.15.72:0/378218357 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ee404bb60 con 0x7f9eec157c10 2023-08-31T19:06:01.245 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:01.245+0000 7ff54ef97680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:06:01.378 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:01.337+0000 7ff54ef97680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:06:01.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.347+0000 7f9ed3fff700 1 -- 172.21.15.72:0/378218357 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 46) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f9ee40784c0 con 0x7f9eec157c10 2023-08-31T19:06:01.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.347+0000 7f9ed3fff700 1 -- 172.21.15.72:0/378218357 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ed805f080 msgr2=0x7f9ed8061540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:06:01.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.347+0000 7f9ed3fff700 1 --2- 172.21.15.72:0/378218357 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ed805f080 0x7f9ed8061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:01.418 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:01.418+0000 7ff4c728c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:01.418 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:01.418+0000 7ff4c728c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:01.418 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:01.418+0000 7ff4c728c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:01.419 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:01.418+0000 7ff4c728c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:01.419 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:01.418+0000 7ff4c728c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:01.419 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:01.418+0000 7ff4caa93700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:01.420 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:01.418+0000 7ff4caa93700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:01.420 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:01.418+0000 7ff4caa93700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:01.420 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:01.418+0000 7ff4caa93700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:01.420 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:01.418+0000 7ff4caa93700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:01.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:01.458+0000 7f9ef29ff700 1 -- 172.21.15.72:0/378218357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9eec0aca50 con 0x7f9eec157c10 2023-08-31T19:06:02.343 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-08-31T19:06:02.343+0000 7f89d2ff7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T19:06:02.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.347+0000 7f9ed3fff700 1 -- 172.21.15.72:0/378218357 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9eec0aca50 con 0x7f9eec157c10 2023-08-31T19:06:02.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.350+0000 7f9ef29ff700 1 -- 172.21.15.72:0/378218357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9eec157c10 msgr2=0x7f9eec0ac140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:02.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.350+0000 7f9ef29ff700 1 --2- 172.21.15.72:0/378218357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9eec157c10 0x7f9eec0ac140 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f9ee4009ef0 tx=0x7f9ee400b040).stop 2023-08-31T19:06:02.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.350+0000 7f9ef29ff700 1 -- 172.21.15.72:0/378218357 shutdown_connections 2023-08-31T19:06:02.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.350+0000 7f9ef29ff700 1 --2- 172.21.15.72:0/378218357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9eec157c10 0x7f9eec0ac140 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:02.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.350+0000 7f9ef29ff700 1 --2- 172.21.15.72:0/378218357 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ed805f080 0x7f9ed8061540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:02.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.350+0000 7f9ef29ff700 1 --2- 172.21.15.72:0/378218357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9eec0637c0 0x7f9eec14a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:02.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.350+0000 7f9ef29ff700 1 --2- 172.21.15.72:0/378218357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9eec0ad1b0 0x7f9eec0af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:02.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.350+0000 7f9ef29ff700 1 -- 172.21.15.72:0/378218357 >> 172.21.15.72:0/378218357 conn(0x7f9eec05eb60 msgr2=0x7f9eec06b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:02.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.350+0000 7f9ef29ff700 1 -- 172.21.15.72:0/378218357 shutdown_connections 2023-08-31T19:06:02.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.351+0000 7f9ef29ff700 1 -- 172.21.15.72:0/378218357 wait complete. 2023-08-31T19:06:02.354 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T19:06:02.363 INFO:tasks.ceph.mds.a.smithi072.stderr: -6199> 2023-08-31T19:04:44.519+0000 7facadbf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:06:02.377 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T19:06:02.409 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T19:06:02.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.573+0000 7f04c97ff700 1 Processor -- start 2023-08-31T19:06:02.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.573+0000 7f04c97ff700 1 -- start start 2023-08-31T19:06:02.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.574+0000 7f04c97ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f04c4154030 0x7f04c4154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:02.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.574+0000 7f04c97ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f04c40c7360 0x7f04c4063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:02.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.574+0000 7f04c97ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c40c6ed0 con 0x7f04c40c06b0 2023-08-31T19:06:02.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.574+0000 7f04c97ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c40c66e0 con 0x7f04c4154030 2023-08-31T19:06:02.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.574+0000 7f04c97ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c40c68c0 con 0x7f04c40c7360 2023-08-31T19:06:02.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.575+0000 7f04c2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f04c4154030 0x7f04c4154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:02.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.575+0000 7f04c2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f04c4154030 0x7f04c4154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51614/0 (socket says 172.21.15.72:51614) 2023-08-31T19:06:02.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.575+0000 7f04c2ffd700 1 -- 172.21.15.72:0/3905326153 learned_addr learned my addr 172.21.15.72:0/3905326153 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:02.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.575+0000 7f04c37fe700 1 --2- 172.21.15.72:0/3905326153 >> v2:172.21.15.146:3300/0 conn(0x7f04c40c7360 0x7f04c4063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:02.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.575+0000 7f04c2ffd700 1 -- 172.21.15.72:0/3905326153 >> v2:172.21.15.146:3300/0 conn(0x7f04c40c7360 msgr2=0x7f04c4063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:02.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.575+0000 7f04c2ffd700 1 --2- 172.21.15.72:0/3905326153 >> v2:172.21.15.146:3300/0 conn(0x7f04c40c7360 0x7f04c4063120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:02.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.575+0000 7f04c2ffd700 1 -- 172.21.15.72:0/3905326153 >> v1:172.21.15.146:6789/0 conn(0x7f04c40c06b0 legacy=0x7f04c40aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:02.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.575+0000 7f04c2ffd700 1 -- 172.21.15.72:0/3905326153 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c40c0f30 con 0x7f04c4154030 2023-08-31T19:06:02.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.575+0000 7f04c37fe700 1 --2- 172.21.15.72:0/3905326153 >> v2:172.21.15.146:3300/0 conn(0x7f04c40c7360 0x7f04c4063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:02.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.575+0000 7f04c2ffd700 1 --2- 172.21.15.72:0/3905326153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04c4154030 0x7f04c4154410 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7f04c40aad30 tx=0x7f04b40090f0).ready entity=mon.0 client_cookie=cceaa35c4d6ef0ec server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:02.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.576+0000 7f04c27fc700 1 -- 172.21.15.72:0/3905326153 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b400b600 con 0x7f04c4154030 2023-08-31T19:06:02.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.576+0000 7f04c27fc700 1 -- 172.21.15.72:0/3905326153 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b400b760 con 0x7f04c4154030 2023-08-31T19:06:02.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.576+0000 7f04c27fc700 1 -- 172.21.15.72:0/3905326153 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b400bb00 con 0x7f04c4154030 2023-08-31T19:06:02.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.576+0000 7f04c97ff700 1 -- 172.21.15.72:0/3905326153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04c4154030 msgr2=0x7f04c4154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:02.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.576+0000 7f04c97ff700 1 --2- 172.21.15.72:0/3905326153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04c4154030 0x7f04c4154410 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7f04c40aad30 tx=0x7f04b40090f0).stop 2023-08-31T19:06:02.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.576+0000 7f04c97ff700 1 -- 172.21.15.72:0/3905326153 shutdown_connections 2023-08-31T19:06:02.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.576+0000 7f04c97ff700 1 --2- 172.21.15.72:0/3905326153 >> v2:172.21.15.146:3300/0 conn(0x7f04c40c7360 0x7f04c4063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:02.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.576+0000 7f04c97ff700 1 --2- 172.21.15.72:0/3905326153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04c4154030 0x7f04c4154410 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:02.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.576+0000 7f04c97ff700 1 -- 172.21.15.72:0/3905326153 >> 172.21.15.72:0/3905326153 conn(0x7f04c405eb60 msgr2=0x7f04c40cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:02.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.576+0000 7f04c97ff700 1 -- 172.21.15.72:0/3905326153 shutdown_connections 2023-08-31T19:06:02.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.576+0000 7f04c97ff700 1 -- 172.21.15.72:0/3905326153 wait complete. 2023-08-31T19:06:02.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.578+0000 7f04c97ff700 1 Processor -- start 2023-08-31T19:06:02.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.578+0000 7f04c97ff700 1 -- start start 2023-08-31T19:06:02.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.579+0000 7f04c97ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04c40c06b0 0x7f04c40add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:02.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.579+0000 7f04c97ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04c40c7360 0x7f04c40c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:02.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.579+0000 7f04c97ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04c4154030 0x7f04c41646e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:02.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.579+0000 7f04c97ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40ae620 con 0x7f04c40c06b0 2023-08-31T19:06:02.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.579+0000 7f04c97ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40b0d40 con 0x7f04c4154030 2023-08-31T19:06:02.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.579+0000 7f04c97ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40b04b0 con 0x7f04c40c7360 2023-08-31T19:06:02.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.579+0000 7f04c2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04c40c06b0 0x7f04c40add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:02.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.579+0000 7f04c2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04c40c06b0 0x7f04c40add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51620/0 (socket says 172.21.15.72:51620) 2023-08-31T19:06:02.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.579+0000 7f04c2ffd700 1 -- 172.21.15.72:0/2248395544 learned_addr learned my addr 172.21.15.72:0/2248395544 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:02.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.579+0000 7f04c2ffd700 1 -- 172.21.15.72:0/2248395544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04c40c7360 msgr2=0x7f04c40c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:02.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.579+0000 7f04c2ffd700 1 --2- 172.21.15.72:0/2248395544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04c40c7360 0x7f04c40c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:02.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.579+0000 7f04c2ffd700 1 -- 172.21.15.72:0/2248395544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04c4154030 msgr2=0x7f04c41646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:02.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.579+0000 7f04c2ffd700 1 --2- 172.21.15.72:0/2248395544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04c4154030 0x7f04c41646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:02.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.579+0000 7f04c2ffd700 1 -- 172.21.15.72:0/2248395544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b4009370 con 0x7f04c40c06b0 2023-08-31T19:06:02.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.580+0000 7f04c2ffd700 1 --2- 172.21.15.72:0/2248395544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04c40c06b0 0x7f04c40add80 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f04b4006fd0 tx=0x7f04b4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:02.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.580+0000 7f04baffd700 1 -- 172.21.15.72:0/2248395544 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b400b8d0 con 0x7f04c40c06b0 2023-08-31T19:06:02.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.580+0000 7f04baffd700 1 -- 172.21.15.72:0/2248395544 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b400ba30 con 0x7f04c40c06b0 2023-08-31T19:06:02.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.580+0000 7f04c97ff700 1 -- 172.21.15.72:0/2248395544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c414a6b0 con 0x7f04c40c06b0 2023-08-31T19:06:02.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.580+0000 7f04baffd700 1 -- 172.21.15.72:0/2248395544 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b401c630 con 0x7f04c40c06b0 2023-08-31T19:06:02.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.580+0000 7f04c97ff700 1 -- 172.21.15.72:0/2248395544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c40b06f0 con 0x7f04c40c06b0 2023-08-31T19:06:02.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.581+0000 7f04c97ff700 1 -- 172.21.15.72:0/2248395544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c406c6b0 con 0x7f04c40c06b0 2023-08-31T19:06:02.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.582+0000 7f04baffd700 1 -- 172.21.15.72:0/2248395544 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 47) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f04b401c9a0 con 0x7f04c40c06b0 2023-08-31T19:06:02.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.582+0000 7f04baffd700 1 --2- 172.21.15.72:0/2248395544 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f04a405ecf0 0x7f04a40611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:02.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.583+0000 7f04baffd700 1 -- 172.21.15.72:0/2248395544 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 7468+0+0 (secure 0 0 0) 0x7f04b407bb20 con 0x7f04c40c06b0 2023-08-31T19:06:02.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.583+0000 7f04bbfff700 1 --2- 172.21.15.72:0/2248395544 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f04a405ecf0 0x7f04a40611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:02.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.583+0000 7f04bbfff700 1 --2- 172.21.15.72:0/2248395544 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f04a405ecf0 0x7f04a40611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f04ac001050 tx=0x7f04ac0079c0).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:02.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.587+0000 7f04baffd700 1 -- 172.21.15.72:0/2248395544 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f04b404cb10 con 0x7f04c40c06b0 2023-08-31T19:06:02.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:02.796+0000 7f04c97ff700 1 -- 172.21.15.72:0/2248395544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f04c406aac0 con 0x7f04c40c06b0 2023-08-31T19:06:03.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.358+0000 7f04baffd700 1 -- 172.21.15.72:0/2248395544 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v50) v1 ==== 104+0+0 (secure 0 0 0) 0x7f04b4050130 con 0x7f04c40c06b0 2023-08-31T19:06:03.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.361+0000 7f04c97ff700 1 -- 172.21.15.72:0/2248395544 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f04a405ecf0 msgr2=0x7f04a40611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:03.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.361+0000 7f04c97ff700 1 --2- 172.21.15.72:0/2248395544 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f04a405ecf0 0x7f04a40611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f04ac001050 tx=0x7f04ac0079c0).stop 2023-08-31T19:06:03.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.361+0000 7f04c97ff700 1 -- 172.21.15.72:0/2248395544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04c40c06b0 msgr2=0x7f04c40add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:03.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.361+0000 7f04c97ff700 1 --2- 172.21.15.72:0/2248395544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04c40c06b0 0x7f04c40add80 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f04b4006fd0 tx=0x7f04b4017000).stop 2023-08-31T19:06:03.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.361+0000 7f04c97ff700 1 -- 172.21.15.72:0/2248395544 shutdown_connections 2023-08-31T19:06:03.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.361+0000 7f04c97ff700 1 --2- 172.21.15.72:0/2248395544 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f04a405ecf0 0x7f04a40611b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:03.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.361+0000 7f04c97ff700 1 --2- 172.21.15.72:0/2248395544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04c4154030 0x7f04c41646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:03.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.361+0000 7f04c97ff700 1 --2- 172.21.15.72:0/2248395544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04c40c06b0 0x7f04c40add80 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:03.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.361+0000 7f04c97ff700 1 --2- 172.21.15.72:0/2248395544 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04c40c7360 0x7f04c40c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:03.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.361+0000 7f04c97ff700 1 -- 172.21.15.72:0/2248395544 >> 172.21.15.72:0/2248395544 conn(0x7f04c405eb60 msgr2=0x7f04c40c8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:03.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.361+0000 7f04c97ff700 1 -- 172.21.15.72:0/2248395544 shutdown_connections 2023-08-31T19:06:03.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.361+0000 7f04c97ff700 1 -- 172.21.15.72:0/2248395544 wait complete. 2023-08-31T19:06:03.380 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T19:06:03.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.614+0000 7f4fa91ff700 1 Processor -- start 2023-08-31T19:06:03.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.614+0000 7f4fa91ff700 1 -- start start 2023-08-31T19:06:03.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.616+0000 7f4fa91ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4fa4064d70 0x7f4fa41553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:03.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.616+0000 7f4fa91ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fa40c5370 0x7f4fa40bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:03.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.616+0000 7f4fa91ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa4154f40 con 0x7f4fa4151da0 2023-08-31T19:06:03.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.616+0000 7f4fa91ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa40c57c0 con 0x7f4fa4064d70 2023-08-31T19:06:03.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.616+0000 7f4fa91ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa4154960 con 0x7f4fa40c5370 2023-08-31T19:06:03.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.616+0000 7f4fa259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4fa4064d70 0x7f4fa41553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:03.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.616+0000 7f4fa259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4fa4064d70 0x7f4fa41553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48026/0 (socket says 172.21.15.72:48026) 2023-08-31T19:06:03.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.616+0000 7f4fa259c700 1 -- 172.21.15.72:0/697215980 learned_addr learned my addr 172.21.15.72:0/697215980 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:03.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.616+0000 7f4fa359e700 1 --2- 172.21.15.72:0/697215980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fa40c5370 0x7f4fa40bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:03.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.616+0000 7f4fa259c700 1 -- 172.21.15.72:0/697215980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fa40c5370 msgr2=0x7f4fa40bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:03.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.616+0000 7f4fa259c700 1 --2- 172.21.15.72:0/697215980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fa40c5370 0x7f4fa40bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:03.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.616+0000 7f4fa259c700 1 -- 172.21.15.72:0/697215980 >> v1:172.21.15.146:6789/0 conn(0x7f4fa4151da0 legacy=0x7f4fa4064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:03.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.616+0000 7f4fa259c700 1 -- 172.21.15.72:0/697215980 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa40aa2c0 con 0x7f4fa4064d70 2023-08-31T19:06:03.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.617+0000 7f4fa259c700 1 --2- 172.21.15.72:0/697215980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fa4064d70 0x7f4fa41553d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f4f98006fd0 tx=0x7f4f980090f0).ready entity=mon.0 client_cookie=b2285411a2b0057e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:03.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.617+0000 7f4fa1d9b700 1 -- 172.21.15.72:0/697215980 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9800b600 con 0x7f4fa4064d70 2023-08-31T19:06:03.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.617+0000 7f4fa1d9b700 1 -- 172.21.15.72:0/697215980 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9800b760 con 0x7f4fa4064d70 2023-08-31T19:06:03.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.617+0000 7f4fa1d9b700 1 -- 172.21.15.72:0/697215980 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9800bae0 con 0x7f4fa4064d70 2023-08-31T19:06:03.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.617+0000 7f4fa91ff700 1 -- 172.21.15.72:0/697215980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fa4064d70 msgr2=0x7f4fa41553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:03.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.617+0000 7f4fa91ff700 1 --2- 172.21.15.72:0/697215980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fa4064d70 0x7f4fa41553d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f4f98006fd0 tx=0x7f4f980090f0).stop 2023-08-31T19:06:03.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.618+0000 7f4fa91ff700 1 -- 172.21.15.72:0/697215980 shutdown_connections 2023-08-31T19:06:03.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.618+0000 7f4fa91ff700 1 --2- 172.21.15.72:0/697215980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fa40c5370 0x7f4fa40bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:03.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.618+0000 7f4fa91ff700 1 --2- 172.21.15.72:0/697215980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fa4064d70 0x7f4fa41553d0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:03.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.618+0000 7f4fa91ff700 1 -- 172.21.15.72:0/697215980 >> 172.21.15.72:0/697215980 conn(0x7f4fa4063a90 msgr2=0x7f4fa40cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:03.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.618+0000 7f4fa91ff700 1 -- 172.21.15.72:0/697215980 shutdown_connections 2023-08-31T19:06:03.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.618+0000 7f4fa91ff700 1 -- 172.21.15.72:0/697215980 wait complete. 2023-08-31T19:06:03.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.619+0000 7f4fa91ff700 1 Processor -- start 2023-08-31T19:06:03.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.619+0000 7f4fa91ff700 1 -- start start 2023-08-31T19:06:03.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.620+0000 7f4fa91ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fa4064d70 0x7f4fa4164b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:03.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.620+0000 7f4fa91ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa40c5370 0x7f4fa4165040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:03.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.620+0000 7f4fa91ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fa4151da0 0x7f4fa40c0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:03.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.620+0000 7f4fa91ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa4165530 con 0x7f4fa4151da0 2023-08-31T19:06:03.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.620+0000 7f4fa91ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa40b0c90 con 0x7f4fa40c5370 2023-08-31T19:06:03.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.620+0000 7f4fa91ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa40c36d0 con 0x7f4fa4064d70 2023-08-31T19:06:03.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.620+0000 7f4fa359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fa4151da0 0x7f4fa40c0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:03.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.620+0000 7f4fa359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fa4151da0 0x7f4fa40c0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48032/0 (socket says 172.21.15.72:48032) 2023-08-31T19:06:03.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.620+0000 7f4fa359e700 1 -- 172.21.15.72:0/1446961412 learned_addr learned my addr 172.21.15.72:0/1446961412 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:03.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.621+0000 7f4fa259c700 1 --2- 172.21.15.72:0/1446961412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa40c5370 0x7f4fa4165040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:03.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.621+0000 7f4fa2d9d700 1 --2- 172.21.15.72:0/1446961412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fa4064d70 0x7f4fa4164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:03.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.621+0000 7f4fa359e700 1 -- 172.21.15.72:0/1446961412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fa4064d70 msgr2=0x7f4fa4164b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:03.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.621+0000 7f4fa359e700 1 --2- 172.21.15.72:0/1446961412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fa4064d70 0x7f4fa4164b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:03.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.621+0000 7f4fa359e700 1 -- 172.21.15.72:0/1446961412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa40c5370 msgr2=0x7f4fa4165040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:03.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.621+0000 7f4fa359e700 1 --2- 172.21.15.72:0/1446961412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa40c5370 0x7f4fa4165040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:03.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.621+0000 7f4fa359e700 1 -- 172.21.15.72:0/1446961412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f98009370 con 0x7f4fa4151da0 2023-08-31T19:06:03.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.621+0000 7f4fa2d9d700 1 --2- 172.21.15.72:0/1446961412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fa4064d70 0x7f4fa4164b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:03.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.621+0000 7f4fa359e700 1 --2- 172.21.15.72:0/1446961412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fa4151da0 0x7f4fa40c0b30 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f4f9c007f20 tx=0x7f4f9c009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:03.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.621+0000 7f4f8affd700 1 -- 172.21.15.72:0/1446961412 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00ebf0 con 0x7f4fa4151da0 2023-08-31T19:06:03.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.621+0000 7f4f8affd700 1 -- 172.21.15.72:0/1446961412 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c00ed50 con 0x7f4fa4151da0 2023-08-31T19:06:03.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.621+0000 7f4fa91ff700 1 -- 172.21.15.72:0/1446961412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa4165d20 con 0x7f4fa4151da0 2023-08-31T19:06:03.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.621+0000 7f4f8affd700 1 -- 172.21.15.72:0/1446961412 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c014610 con 0x7f4fa4151da0 2023-08-31T19:06:03.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.621+0000 7f4fa91ff700 1 -- 172.21.15.72:0/1446961412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa4165a10 con 0x7f4fa4151da0 2023-08-31T19:06:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.622+0000 7f4fa91ff700 1 -- 172.21.15.72:0/1446961412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa406c6b0 con 0x7f4fa4151da0 2023-08-31T19:06:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.623+0000 7f4f8affd700 1 -- 172.21.15.72:0/1446961412 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 47) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f4f9c014980 con 0x7f4fa4151da0 2023-08-31T19:06:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.624+0000 7f4f8affd700 1 --2- 172.21.15.72:0/1446961412 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f9005ecf0 0x7f4f900611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.624+0000 7f4f8affd700 1 -- 172.21.15.72:0/1446961412 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 7468+0+0 (secure 0 0 0) 0x7f4f9c07a5b0 con 0x7f4fa4151da0 2023-08-31T19:06:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.624+0000 7f4fa2d9d700 1 --2- 172.21.15.72:0/1446961412 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f9005ecf0 0x7f4f900611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:03.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.625+0000 7f4fa2d9d700 1 --2- 172.21.15.72:0/1446961412 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f9005ecf0 0x7f4f900611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f4f94002780 tx=0x7f4f94009040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:03.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.628+0000 7f4f8affd700 1 -- 172.21.15.72:0/1446961412 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4f9c04b6b0 con 0x7f4fa4151da0 2023-08-31T19:06:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.800+0000 7f4fa91ff700 1 -- 172.21.15.72:0/1446961412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4fa40c34a0 con 0x7f4fa4151da0 2023-08-31T19:06:03.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:03.867+0000 7f4f8affd700 1 -- 172.21.15.72:0/1446961412 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4f9c078010 con 0x7f4fa4151da0 2023-08-31T19:06:04.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.519+0000 7f4f8affd700 1 -- 172.21.15.72:0/1446961412 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v116) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4f9c073430 con 0x7f4fa4151da0 2023-08-31T19:06:04.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.522+0000 7f4fa91ff700 1 -- 172.21.15.72:0/1446961412 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f9005ecf0 msgr2=0x7f4f900611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:04.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.522+0000 7f4fa91ff700 1 --2- 172.21.15.72:0/1446961412 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f9005ecf0 0x7f4f900611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f4f94002780 tx=0x7f4f94009040).stop 2023-08-31T19:06:04.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.522+0000 7f4fa91ff700 1 -- 172.21.15.72:0/1446961412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fa4151da0 msgr2=0x7f4fa40c0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.522+0000 7f4fa91ff700 1 --2- 172.21.15.72:0/1446961412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fa4151da0 0x7f4fa40c0b30 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7f4f9c007f20 tx=0x7f4f9c009860).stop 2023-08-31T19:06:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.522+0000 7f4fa91ff700 1 -- 172.21.15.72:0/1446961412 shutdown_connections 2023-08-31T19:06:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.522+0000 7f4fa91ff700 1 --2- 172.21.15.72:0/1446961412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fa4151da0 0x7f4fa40c0b30 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:04.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.522+0000 7f4fa91ff700 1 --2- 172.21.15.72:0/1446961412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4fa4064d70 0x7f4fa4164b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:04.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.522+0000 7f4fa91ff700 1 --2- 172.21.15.72:0/1446961412 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4f9005ecf0 0x7f4f900611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:04.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.522+0000 7f4fa91ff700 1 --2- 172.21.15.72:0/1446961412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4fa40c5370 0x7f4fa4165040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.522+0000 7f4fa91ff700 1 -- 172.21.15.72:0/1446961412 >> 172.21.15.72:0/1446961412 conn(0x7f4fa4063a90 msgr2=0x7f4fa40cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.522+0000 7f4fa91ff700 1 -- 172.21.15.72:0/1446961412 shutdown_connections 2023-08-31T19:06:04.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.522+0000 7f4fa91ff700 1 -- 172.21.15.72:0/1446961412 wait complete. 2023-08-31T19:06:04.527 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-08-31T19:06:04.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T19:06:04.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.750+0000 7fd7f9bff700 1 Processor -- start 2023-08-31T19:06:04.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.750+0000 7fd7f9bff700 1 -- start start 2023-08-31T19:06:04.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.752+0000 7fd7f9bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd7f4151da0 0x7fd7f41553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:04.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.752+0000 7fd7f9bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7f4064d70 0x7fd7f40bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:04.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.752+0000 7fd7f9bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f4154f40 con 0x7fd7f40c5370 2023-08-31T19:06:04.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.752+0000 7fd7f9bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f4154960 con 0x7fd7f4151da0 2023-08-31T19:06:04.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.752+0000 7fd7f9bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f40aa2c0 con 0x7fd7f4064d70 2023-08-31T19:06:04.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.752+0000 7fd7f2ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd7f40c5370 0x7fd7f4064660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57720/0 (socket says 172.21.15.72:57720) 2023-08-31T19:06:04.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.752+0000 7fd7f2ffd700 1 -- 172.21.15.72:0/3584808230 learned_addr learned my addr 172.21.15.72:0/3584808230 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:04.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.752+0000 7fd7f37fe700 1 --2- 172.21.15.72:0/3584808230 >> v2:172.21.15.146:3300/0 conn(0x7fd7f4151da0 0x7fd7f41553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:04.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.752+0000 7fd7f3fff700 1 --2- 172.21.15.72:0/3584808230 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7f4064d70 0x7fd7f40bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:04.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.752+0000 7fd7f27fc700 1 -- 172.21.15.72:0/3584808230 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301326440 0 0) 0x7fd7f4154f40 con 0x7fd7f40c5370 2023-08-31T19:06:04.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f27fc700 1 -- 172.21.15.72:0/3584808230 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7dc0033f0 con 0x7fd7f40c5370 2023-08-31T19:06:04.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f27fc700 1 -- 172.21.15.72:0/3584808230 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3772912214 0 0) 0x7fd7dc0033f0 con 0x7fd7f40c5370 2023-08-31T19:06:04.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f27fc700 1 -- 172.21.15.72:0/3584808230 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7f4064d70 msgr2=0x7fd7f40bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:04.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f27fc700 1 --2- 172.21.15.72:0/3584808230 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7f4064d70 0x7fd7f40bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:04.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f27fc700 1 -- 172.21.15.72:0/3584808230 >> v2:172.21.15.146:3300/0 conn(0x7fd7f4151da0 msgr2=0x7fd7f41553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:04.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f27fc700 1 --2- 172.21.15.72:0/3584808230 >> v2:172.21.15.146:3300/0 conn(0x7fd7f4151da0 0x7fd7f41553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:04.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f27fc700 1 -- 172.21.15.72:0/3584808230 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f4154bd0 con 0x7fd7f40c5370 2023-08-31T19:06:04.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f27fc700 1 -- 172.21.15.72:0/3584808230 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fd7e8001470 con 0x7fd7f40c5370 2023-08-31T19:06:04.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f37fe700 1 --2- 172.21.15.72:0/3584808230 >> v2:172.21.15.146:3300/0 conn(0x7fd7f4151da0 0x7fd7f41553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:06:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f27fc700 1 -- 172.21.15.72:0/3584808230 >> v1:172.21.15.72:6789/0 conn(0x7fd7f40c5370 legacy=0x7fd7f4064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f27fc700 1 --2- 172.21.15.72:0/3584808230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0038e0 0x7fd7dc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f27fc700 1 --2- 172.21.15.72:0/3584808230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7dc004690 0x7fd7dc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f27fc700 1 --2- 172.21.15.72:0/3584808230 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7f4064d70 0x7fd7dc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f27fc700 1 -- 172.21.15.72:0/3584808230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f4154960 con 0x7fd7dc0038e0 2023-08-31T19:06:04.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f27fc700 1 -- 172.21.15.72:0/3584808230 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f40aa2c0 con 0x7fd7dc004690 2023-08-31T19:06:04.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f27fc700 1 -- 172.21.15.72:0/3584808230 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc00b8e0 con 0x7fd7f4064d70 2023-08-31T19:06:04.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f37fe700 1 --2- 172.21.15.72:0/3584808230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0038e0 0x7fd7dc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:04.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f3fff700 1 --2- 172.21.15.72:0/3584808230 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7f4064d70 0x7fd7dc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:04.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.753+0000 7fd7f2ffd700 1 --2- 172.21.15.72:0/3584808230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7dc004690 0x7fd7dc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:04.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.754+0000 7fd7f37fe700 1 -- 172.21.15.72:0/3584808230 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7f4064d70 msgr2=0x7fd7dc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:04.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.754+0000 7fd7f37fe700 1 --2- 172.21.15.72:0/3584808230 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7f4064d70 0x7fd7dc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:04.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.754+0000 7fd7f37fe700 1 -- 172.21.15.72:0/3584808230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7dc004690 msgr2=0x7fd7dc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:04.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.754+0000 7fd7f37fe700 1 --2- 172.21.15.72:0/3584808230 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7dc004690 0x7fd7dc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:04.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.754+0000 7fd7f37fe700 1 -- 172.21.15.72:0/3584808230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc0033f0 con 0x7fd7dc0038e0 2023-08-31T19:06:04.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.754+0000 7fd7f37fe700 1 --2- 172.21.15.72:0/3584808230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0038e0 0x7fd7dc003d00 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fd7e4009c70 tx=0x7fd7e4009060).ready entity=mon.0 client_cookie=42ac4a3befcb32af server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:04.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.754+0000 7fd7f27fc700 1 -- 172.21.15.72:0/3584808230 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40095c0 con 0x7fd7dc0038e0 2023-08-31T19:06:04.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.754+0000 7fd7f27fc700 1 -- 172.21.15.72:0/3584808230 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e400e6f0 con 0x7fd7dc0038e0 2023-08-31T19:06:04.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.754+0000 7fd7f27fc700 1 -- 172.21.15.72:0/3584808230 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e400ea70 con 0x7fd7dc0038e0 2023-08-31T19:06:04.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.754+0000 7fd7f9bff700 1 -- 172.21.15.72:0/3584808230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0038e0 msgr2=0x7fd7dc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:04.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.754+0000 7fd7f9bff700 1 --2- 172.21.15.72:0/3584808230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7dc0038e0 0x7fd7dc003d00 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fd7e4009c70 tx=0x7fd7e4009060).stop 2023-08-31T19:06:04.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.754+0000 7fd7f3fff700 1 -- 172.21.15.72:0/3584808230 reap_dead start 2023-08-31T19:06:04.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.755+0000 7fd7f9bff700 1 -- 172.21.15.72:0/3584808230 shutdown_connections 2023-08-31T19:06:04.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.755+0000 7fd7f9bff700 1 -- 172.21.15.72:0/3584808230 >> 172.21.15.72:0/3584808230 conn(0x7fd7f4063a90 msgr2=0x7fd7f40cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:04.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.755+0000 7fd7f9bff700 1 -- 172.21.15.72:0/3584808230 shutdown_connections 2023-08-31T19:06:04.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.755+0000 7fd7f9bff700 1 -- 172.21.15.72:0/3584808230 wait complete. 2023-08-31T19:06:04.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.756+0000 7fd7f9bff700 1 Processor -- start 2023-08-31T19:06:04.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.756+0000 7fd7f9bff700 1 -- start start 2023-08-31T19:06:04.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.757+0000 7fd7f9bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc0038e0 0x7fd7f4145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:04.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.757+0000 7fd7f9bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7f40c23c0 0x7fd7f4168530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:04.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.757+0000 7fd7f9bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7f414fca0 0x7fd7f4150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:04.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.757+0000 7fd7f9bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f4145e10 con 0x7fd7f40c23c0 2023-08-31T19:06:04.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.757+0000 7fd7f9bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f40c34e0 con 0x7fd7f414fca0 2023-08-31T19:06:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.757+0000 7fd7f9bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f414e580 con 0x7fd7dc0038e0 2023-08-31T19:06:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7f2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7f40c23c0 0x7fd7f4168530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7f2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7f40c23c0 0x7fd7f4168530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48052/0 (socket says 172.21.15.72:48052) 2023-08-31T19:06:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7f2ffd700 1 -- 172.21.15.72:0/2845197298 learned_addr learned my addr 172.21.15.72:0/2845197298 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:04.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7f3fff700 1 --2- 172.21.15.72:0/2845197298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7f414fca0 0x7fd7f4150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:04.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7f37fe700 1 --2- 172.21.15.72:0/2845197298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc0038e0 0x7fd7f4145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:04.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7f2ffd700 1 -- 172.21.15.72:0/2845197298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc0038e0 msgr2=0x7fd7f4145920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:04.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7f2ffd700 1 --2- 172.21.15.72:0/2845197298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc0038e0 0x7fd7f4145920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:04.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7f2ffd700 1 -- 172.21.15.72:0/2845197298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7f414fca0 msgr2=0x7fd7f4150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:04.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7f2ffd700 1 --2- 172.21.15.72:0/2845197298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7f414fca0 0x7fd7f4150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:04.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7f2ffd700 1 -- 172.21.15.72:0/2845197298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f4168a20 con 0x7fd7f40c23c0 2023-08-31T19:06:04.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7f3fff700 1 --2- 172.21.15.72:0/2845197298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7f414fca0 0x7fd7f4150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:04.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7f2ffd700 1 --2- 172.21.15.72:0/2845197298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7f40c23c0 0x7fd7f4168530 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fd7e8001050 tx=0x7fd7e8001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:04.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7db7fe700 1 -- 172.21.15.72:0/2845197298 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8010520 con 0x7fd7f40c23c0 2023-08-31T19:06:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7db7fe700 1 -- 172.21.15.72:0/2845197298 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e8010680 con 0x7fd7f40c23c0 2023-08-31T19:06:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7db7fe700 1 -- 172.21.15.72:0/2845197298 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8010a20 con 0x7fd7f40c23c0 2023-08-31T19:06:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.758+0000 7fd7f9bff700 1 -- 172.21.15.72:0/2845197298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f40c2850 con 0x7fd7f40c23c0 2023-08-31T19:06:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.759+0000 7fd7f9bff700 1 -- 172.21.15.72:0/2845197298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f40c2e90 con 0x7fd7f40c23c0 2023-08-31T19:06:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.760+0000 7fd7f9bff700 1 -- 172.21.15.72:0/2845197298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f40657e0 con 0x7fd7f40c23c0 2023-08-31T19:06:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.760+0000 7fd7db7fe700 1 -- 172.21.15.72:0/2845197298 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd7e8014430 con 0x7fd7f40c23c0 2023-08-31T19:06:04.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.761+0000 7fd7db7fe700 1 --2- 172.21.15.72:0/2845197298 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7e005ef30 0x7fd7e00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:04.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.761+0000 7fd7db7fe700 1 -- 172.21.15.72:0/2845197298 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 7001+0+0 (secure 0 0 0) 0x7fd7e8079f80 con 0x7fd7f40c23c0 2023-08-31T19:06:04.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.761+0000 7fd7f37fe700 1 --2- 172.21.15.72:0/2845197298 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7e005ef30 0x7fd7e00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:04.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.762+0000 7fd7f37fe700 1 --2- 172.21.15.72:0/2845197298 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7e005ef30 0x7fd7e00613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd7e4006d50 tx=0x7fd7e401a000).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:04.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.765+0000 7fd7db7fe700 1 -- 172.21.15.72:0/2845197298 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd7e80498f0 con 0x7fd7f40c23c0 2023-08-31T19:06:04.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:04.935+0000 7fd7f9bff700 1 -- 172.21.15.72:0/2845197298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd7f406a7e0 con 0x7fd7f40c23c0 2023-08-31T19:06:05.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:05.876+0000 7fd7db7fe700 1 -- 172.21.15.72:0/2845197298 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v117) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd7e804ade0 con 0x7fd7f40c23c0 2023-08-31T19:06:05.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:05.882+0000 7fd7f9bff700 1 -- 172.21.15.72:0/2845197298 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7e005ef30 msgr2=0x7fd7e00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:05.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:05.882+0000 7fd7f9bff700 1 --2- 172.21.15.72:0/2845197298 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7e005ef30 0x7fd7e00613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd7e4006d50 tx=0x7fd7e401a000).stop 2023-08-31T19:06:05.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:05.882+0000 7fd7f9bff700 1 -- 172.21.15.72:0/2845197298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7f40c23c0 msgr2=0x7fd7f4168530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:05.882+0000 7fd7f9bff700 1 --2- 172.21.15.72:0/2845197298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7f40c23c0 0x7fd7f4168530 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fd7e8001050 tx=0x7fd7e8001df0).stop 2023-08-31T19:06:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:05.882+0000 7fd7f9bff700 1 -- 172.21.15.72:0/2845197298 shutdown_connections 2023-08-31T19:06:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:05.882+0000 7fd7f9bff700 1 --2- 172.21.15.72:0/2845197298 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7e005ef30 0x7fd7e00613f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:05.882+0000 7fd7f9bff700 1 --2- 172.21.15.72:0/2845197298 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7f414fca0 0x7fd7f4150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:05.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:05.882+0000 7fd7f9bff700 1 --2- 172.21.15.72:0/2845197298 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7dc0038e0 0x7fd7f4145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:05.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:05.882+0000 7fd7f9bff700 1 --2- 172.21.15.72:0/2845197298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7f40c23c0 0x7fd7f4168530 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:05.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:05.882+0000 7fd7f9bff700 1 -- 172.21.15.72:0/2845197298 >> 172.21.15.72:0/2845197298 conn(0x7fd7f4063a90 msgr2=0x7fd7f4064660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:05.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:05.883+0000 7fd7f9bff700 1 -- 172.21.15.72:0/2845197298 shutdown_connections 2023-08-31T19:06:05.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:05.883+0000 7fd7f9bff700 1 -- 172.21.15.72:0/2845197298 wait complete. 2023-08-31T19:06:05.885 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-08-31T19:06:05.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-31T19:06:06.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.096+0000 7ff40dbff700 1 Processor -- start 2023-08-31T19:06:06.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.096+0000 7ff40dbff700 1 -- start start 2023-08-31T19:06:06.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.097+0000 7ff40dbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff408154030 0x7ff408154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.097+0000 7ff40dbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4080c7360 0x7ff408063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.097+0000 7ff40dbff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4080c6ed0 con 0x7ff4080c06b0 2023-08-31T19:06:06.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.097+0000 7ff40dbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4080c66e0 con 0x7ff4080c7360 2023-08-31T19:06:06.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.097+0000 7ff40dbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080c68c0 con 0x7ff408154030 2023-08-31T19:06:06.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.098+0000 7ff407fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4080c7360 0x7ff408063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.098+0000 7ff407fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4080c7360 0x7ff408063120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48068/0 (socket says 172.21.15.72:48068) 2023-08-31T19:06:06.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.098+0000 7ff407fff700 1 -- 172.21.15.72:0/1875463089 learned_addr learned my addr 172.21.15.72:0/1875463089 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:06.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.098+0000 7ff4077fe700 1 --2- 172.21.15.72:0/1875463089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff408154030 0x7ff408154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.098+0000 7ff407fff700 1 -- 172.21.15.72:0/1875463089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff408154030 msgr2=0x7ff408154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.098+0000 7ff407fff700 1 --2- 172.21.15.72:0/1875463089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff408154030 0x7ff408154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.098+0000 7ff407fff700 1 -- 172.21.15.72:0/1875463089 >> v1:172.21.15.146:6789/0 conn(0x7ff4080c06b0 legacy=0x7ff4080aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.098+0000 7ff407fff700 1 -- 172.21.15.72:0/1875463089 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080c0f30 con 0x7ff4080c7360 2023-08-31T19:06:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.098+0000 7ff407fff700 1 --2- 172.21.15.72:0/1875463089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4080c7360 0x7ff408063120 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7ff400009f20 tx=0x7ff400009840).ready entity=mon.0 client_cookie=362f23b3c8e628e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:06.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.099+0000 7ff4067fc700 1 -- 172.21.15.72:0/1875463089 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000e070 con 0x7ff4080c7360 2023-08-31T19:06:06.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.099+0000 7ff4067fc700 1 -- 172.21.15.72:0/1875463089 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40000ba40 con 0x7ff4080c7360 2023-08-31T19:06:06.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.099+0000 7ff4067fc700 1 -- 172.21.15.72:0/1875463089 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000bdc0 con 0x7ff4080c7360 2023-08-31T19:06:06.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.099+0000 7ff40dbff700 1 -- 172.21.15.72:0/1875463089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4080c7360 msgr2=0x7ff408063120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.099+0000 7ff40dbff700 1 --2- 172.21.15.72:0/1875463089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4080c7360 0x7ff408063120 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7ff400009f20 tx=0x7ff400009840).stop 2023-08-31T19:06:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.099+0000 7ff40dbff700 1 -- 172.21.15.72:0/1875463089 shutdown_connections 2023-08-31T19:06:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.099+0000 7ff40dbff700 1 --2- 172.21.15.72:0/1875463089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff408154030 0x7ff408154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.099+0000 7ff40dbff700 1 --2- 172.21.15.72:0/1875463089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4080c7360 0x7ff408063120 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.099+0000 7ff40dbff700 1 -- 172.21.15.72:0/1875463089 >> 172.21.15.72:0/1875463089 conn(0x7ff40805eb60 msgr2=0x7ff4080cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:06.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.099+0000 7ff40dbff700 1 -- 172.21.15.72:0/1875463089 shutdown_connections 2023-08-31T19:06:06.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.099+0000 7ff40dbff700 1 -- 172.21.15.72:0/1875463089 wait complete. 2023-08-31T19:06:06.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.101+0000 7ff40dbff700 1 Processor -- start 2023-08-31T19:06:06.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.101+0000 7ff40dbff700 1 -- start start 2023-08-31T19:06:06.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.102+0000 7ff40dbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4080c06b0 0x7ff408155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.102+0000 7ff40dbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4080c7360 0x7ff40814ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.102+0000 7ff40dbff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff408154030 0x7ff408158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.102+0000 7ff40dbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4081552c0 con 0x7ff4080c7360 2023-08-31T19:06:06.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.102+0000 7ff40dbff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff408154410 con 0x7ff408154030 2023-08-31T19:06:06.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.102+0000 7ff40dbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4081546b0 con 0x7ff4080c06b0 2023-08-31T19:06:06.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.102+0000 7ff406ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4080c7360 0x7ff40814ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.102+0000 7ff406ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4080c7360 0x7ff40814ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48082/0 (socket says 172.21.15.72:48082) 2023-08-31T19:06:06.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.102+0000 7ff406ffd700 1 -- 172.21.15.72:0/2828405047 learned_addr learned my addr 172.21.15.72:0/2828405047 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:06.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.102+0000 7ff407fff700 1 --2- 172.21.15.72:0/2828405047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff408154030 0x7ff408158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.102+0000 7ff4077fe700 1 --2- 172.21.15.72:0/2828405047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4080c06b0 0x7ff408155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.102+0000 7ff406ffd700 1 -- 172.21.15.72:0/2828405047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4080c06b0 msgr2=0x7ff408155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:06.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.103+0000 7ff406ffd700 1 --2- 172.21.15.72:0/2828405047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4080c06b0 0x7ff408155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.103+0000 7ff406ffd700 1 -- 172.21.15.72:0/2828405047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff408154030 msgr2=0x7ff408158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:06.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.103+0000 7ff406ffd700 1 --2- 172.21.15.72:0/2828405047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff408154030 0x7ff408158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.103+0000 7ff406ffd700 1 -- 172.21.15.72:0/2828405047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400009ae0 con 0x7ff4080c7360 2023-08-31T19:06:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.103+0000 7ff407fff700 1 --2- 172.21.15.72:0/2828405047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff408154030 0x7ff408158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.103+0000 7ff406ffd700 1 --2- 172.21.15.72:0/2828405047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4080c7360 0x7ff40814ebc0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7ff3fc00c490 tx=0x7ff3fc007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.103+0000 7ff3ef7fe700 1 -- 172.21.15.72:0/2828405047 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc00ce90 con 0x7ff4080c7360 2023-08-31T19:06:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.103+0000 7ff3ef7fe700 1 -- 172.21.15.72:0/2828405047 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc00f470 con 0x7ff4080c7360 2023-08-31T19:06:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.103+0000 7ff3ef7fe700 1 -- 172.21.15.72:0/2828405047 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc00f810 con 0x7ff4080c7360 2023-08-31T19:06:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.103+0000 7ff40dbff700 1 -- 172.21.15.72:0/2828405047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff408154990 con 0x7ff4080c7360 2023-08-31T19:06:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.103+0000 7ff40dbff700 1 -- 172.21.15.72:0/2828405047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff408154f50 con 0x7ff4080c7360 2023-08-31T19:06:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.104+0000 7ff40dbff700 1 -- 172.21.15.72:0/2828405047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40806c6b0 con 0x7ff4080c7360 2023-08-31T19:06:06.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.105+0000 7ff3ef7fe700 1 -- 172.21.15.72:0/2828405047 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff3fc00fc40 con 0x7ff4080c7360 2023-08-31T19:06:06.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.106+0000 7ff3ef7fe700 1 --2- 172.21.15.72:0/2828405047 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3f405ef30 0x7ff3f40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.106+0000 7ff3ef7fe700 1 -- 172.21.15.72:0/2828405047 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6471+0+0 (secure 0 0 0) 0x7ff3fc079540 con 0x7ff4080c7360 2023-08-31T19:06:06.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.106+0000 7ff4077fe700 1 --2- 172.21.15.72:0/2828405047 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3f405ef30 0x7ff3f40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.107+0000 7ff4077fe700 1 --2- 172.21.15.72:0/2828405047 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3f405ef30 0x7ff3f40613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff3f800bb10 tx=0x7ff3f8008040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:06.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.110+0000 7ff3ef7fe700 1 -- 172.21.15.72:0/2828405047 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3fc0488f0 con 0x7ff4080c7360 2023-08-31T19:06:06.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.279+0000 7ff40dbff700 1 -- 172.21.15.72:0/2828405047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff4080c0c50 con 0x7ff4080c7360 2023-08-31T19:06:06.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.285+0000 7ff3ef7fe700 1 -- 172.21.15.72:0/2828405047 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v20) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff3fc0170b0 con 0x7ff4080c7360 2023-08-31T19:06:06.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.288+0000 7ff40dbff700 1 -- 172.21.15.72:0/2828405047 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3f405ef30 msgr2=0x7ff3f40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:06.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.288+0000 7ff40dbff700 1 --2- 172.21.15.72:0/2828405047 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3f405ef30 0x7ff3f40613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff3f800bb10 tx=0x7ff3f8008040).stop 2023-08-31T19:06:06.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.288+0000 7ff40dbff700 1 -- 172.21.15.72:0/2828405047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4080c7360 msgr2=0x7ff40814ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:06.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.288+0000 7ff40dbff700 1 --2- 172.21.15.72:0/2828405047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4080c7360 0x7ff40814ebc0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7ff3fc00c490 tx=0x7ff3fc007db0).stop 2023-08-31T19:06:06.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.288+0000 7ff40dbff700 1 -- 172.21.15.72:0/2828405047 shutdown_connections 2023-08-31T19:06:06.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.288+0000 7ff40dbff700 1 --2- 172.21.15.72:0/2828405047 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3f405ef30 0x7ff3f40613f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.288+0000 7ff40dbff700 1 --2- 172.21.15.72:0/2828405047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff408154030 0x7ff408158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.288+0000 7ff40dbff700 1 --2- 172.21.15.72:0/2828405047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4080c06b0 0x7ff408155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.288+0000 7ff40dbff700 1 --2- 172.21.15.72:0/2828405047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4080c7360 0x7ff40814ebc0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.288+0000 7ff40dbff700 1 -- 172.21.15.72:0/2828405047 >> 172.21.15.72:0/2828405047 conn(0x7ff40805eb60 msgr2=0x7ff4080cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.288+0000 7ff40dbff700 1 -- 172.21.15.72:0/2828405047 shutdown_connections 2023-08-31T19:06:06.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.288+0000 7ff40dbff700 1 -- 172.21.15.72:0/2828405047 wait complete. 2023-08-31T19:06:06.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-31T19:06:06.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.496+0000 7f27a27ff700 1 Processor -- start 2023-08-31T19:06:06.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.497+0000 7f27a27ff700 1 -- start start 2023-08-31T19:06:06.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.498+0000 7f27a27ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c153ed0 0x7f279c1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.498+0000 7f27a27ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f279c0663d0 0x7f279c066820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.498+0000 7f27a27ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f279c0a84b0 con 0x7f279c0bdb30 2023-08-31T19:06:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.498+0000 7f27a27ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279c0c9410 con 0x7f279c0663d0 2023-08-31T19:06:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.498+0000 7f27a27ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0c5310 con 0x7f279c153ed0 2023-08-31T19:06:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.498+0000 7f27a0d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f279c0663d0 0x7f279c066820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.498+0000 7f27a0d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f279c0663d0 0x7f279c066820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48098/0 (socket says 172.21.15.72:48098) 2023-08-31T19:06:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.498+0000 7f27a0d9c700 1 -- 172.21.15.72:0/900590026 learned_addr learned my addr 172.21.15.72:0/900590026 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.499+0000 7f279bfff700 1 --2- 172.21.15.72:0/900590026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c153ed0 0x7f279c1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.499+0000 7f27a0d9c700 1 -- 172.21.15.72:0/900590026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c153ed0 msgr2=0x7f279c1542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.499+0000 7f27a0d9c700 1 --2- 172.21.15.72:0/900590026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c153ed0 0x7f279c1542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.499+0000 7f27a0d9c700 1 -- 172.21.15.72:0/900590026 >> v1:172.21.15.146:6789/0 conn(0x7f279c0bdb30 legacy=0x7f279c155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.499+0000 7f27a0d9c700 1 -- 172.21.15.72:0/900590026 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c066d10 con 0x7f279c0663d0 2023-08-31T19:06:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.499+0000 7f279bfff700 1 --2- 172.21.15.72:0/900590026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c153ed0 0x7f279c1542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.499+0000 7f27a0d9c700 1 --2- 172.21.15.72:0/900590026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c0663d0 0x7f279c066820 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f2794009f20 tx=0x7f2794009840).ready entity=mon.0 client_cookie=94d3b703dbdc575c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.499+0000 7f279affd700 1 -- 172.21.15.72:0/900590026 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279400e070 con 0x7f279c0663d0 2023-08-31T19:06:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.499+0000 7f279affd700 1 -- 172.21.15.72:0/900590026 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279400ba80 con 0x7f279c0663d0 2023-08-31T19:06:06.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.499+0000 7f279affd700 1 -- 172.21.15.72:0/900590026 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279400be00 con 0x7f279c0663d0 2023-08-31T19:06:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.500+0000 7f27a27ff700 1 -- 172.21.15.72:0/900590026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c0663d0 msgr2=0x7f279c066820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.500+0000 7f27a27ff700 1 --2- 172.21.15.72:0/900590026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c0663d0 0x7f279c066820 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f2794009f20 tx=0x7f2794009840).stop 2023-08-31T19:06:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.500+0000 7f27a27ff700 1 -- 172.21.15.72:0/900590026 shutdown_connections 2023-08-31T19:06:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.500+0000 7f27a27ff700 1 --2- 172.21.15.72:0/900590026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c153ed0 0x7f279c1542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.500+0000 7f27a27ff700 1 --2- 172.21.15.72:0/900590026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c0663d0 0x7f279c066820 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.500+0000 7f27a27ff700 1 -- 172.21.15.72:0/900590026 >> 172.21.15.72:0/900590026 conn(0x7f279c05eb60 msgr2=0x7f279c0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:06.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.500+0000 7f27a27ff700 1 -- 172.21.15.72:0/900590026 shutdown_connections 2023-08-31T19:06:06.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.500+0000 7f27a27ff700 1 -- 172.21.15.72:0/900590026 wait complete. 2023-08-31T19:06:06.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.501+0000 7f27a27ff700 1 Processor -- start 2023-08-31T19:06:06.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.501+0000 7f27a27ff700 1 -- start start 2023-08-31T19:06:06.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.502+0000 7f27a27ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c0663d0 0x7f279c0aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.502+0000 7f27a27ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f279c153ed0 0x7f279c151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.502+0000 7f27a27ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c151610 0x7f279c0c1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.502+0000 7f27a27ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0ab300 con 0x7f279c0663d0 2023-08-31T19:06:06.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.502+0000 7f27a27ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0ab5e0 con 0x7f279c153ed0 2023-08-31T19:06:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.502+0000 7f27a27ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0a86b0 con 0x7f279c151610 2023-08-31T19:06:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.503+0000 7f279bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c0663d0 0x7f279c0aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.503+0000 7f279bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c0663d0 0x7f279c0aad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48114/0 (socket says 172.21.15.72:48114) 2023-08-31T19:06:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.503+0000 7f279bfff700 1 -- 172.21.15.72:0/2063550220 learned_addr learned my addr 172.21.15.72:0/2063550220 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.503+0000 7f27a0d9c700 1 --2- 172.21.15.72:0/2063550220 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c151610 0x7f279c0c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.503+0000 7f279b7fe700 1 --2- 172.21.15.72:0/2063550220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f279c153ed0 0x7f279c151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.503+0000 7f279bfff700 1 -- 172.21.15.72:0/2063550220 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c151610 msgr2=0x7f279c0c1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.503+0000 7f279bfff700 1 --2- 172.21.15.72:0/2063550220 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c151610 0x7f279c0c1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.503+0000 7f279bfff700 1 -- 172.21.15.72:0/2063550220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f279c153ed0 msgr2=0x7f279c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.503+0000 7f279bfff700 1 --2- 172.21.15.72:0/2063550220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f279c153ed0 0x7f279c151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.503+0000 7f279bfff700 1 -- 172.21.15.72:0/2063550220 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2794009ae0 con 0x7f279c0663d0 2023-08-31T19:06:06.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.503+0000 7f279bfff700 1 --2- 172.21.15.72:0/2063550220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c0663d0 0x7f279c0aad20 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f278c00d890 tx=0x7f278c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:06.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.503+0000 7f2783fff700 1 -- 172.21.15.72:0/2063550220 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c0125f0 con 0x7f279c0663d0 2023-08-31T19:06:06.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.503+0000 7f2783fff700 1 -- 172.21.15.72:0/2063550220 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c012750 con 0x7f279c0663d0 2023-08-31T19:06:06.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.503+0000 7f2783fff700 1 -- 172.21.15.72:0/2063550220 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c012ad0 con 0x7f279c0663d0 2023-08-31T19:06:06.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.504+0000 7f27a27ff700 1 -- 172.21.15.72:0/2063550220 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c0a8990 con 0x7f279c0663d0 2023-08-31T19:06:06.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.504+0000 7f27a27ff700 1 -- 172.21.15.72:0/2063550220 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279c151cf0 con 0x7f279c0663d0 2023-08-31T19:06:06.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.505+0000 7f27a27ff700 1 -- 172.21.15.72:0/2063550220 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279c0c5f60 con 0x7f279c0663d0 2023-08-31T19:06:06.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.505+0000 7f2783fff700 1 -- 172.21.15.72:0/2063550220 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f278c013480 con 0x7f279c0663d0 2023-08-31T19:06:06.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.506+0000 7f2783fff700 1 --2- 172.21.15.72:0/2063550220 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f278805ef30 0x7f27880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.506+0000 7f2783fff700 1 -- 172.21.15.72:0/2063550220 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6471+0+0 (secure 0 0 0) 0x7f278c079fa0 con 0x7f279c0663d0 2023-08-31T19:06:06.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.506+0000 7f279b7fe700 1 --2- 172.21.15.72:0/2063550220 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f278805ef30 0x7f27880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.507+0000 7f279b7fe700 1 --2- 172.21.15.72:0/2063550220 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f278805ef30 0x7f27880613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f279c0ab230 tx=0x7f2790009040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:06.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.510+0000 7f2783fff700 1 -- 172.21.15.72:0/2063550220 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f278c04b010 con 0x7f279c0663d0 2023-08-31T19:06:06.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.681+0000 7f27a27ff700 1 -- 172.21.15.72:0/2063550220 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f279c0a8fe0 con 0x7f279c0663d0 2023-08-31T19:06:06.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.687+0000 7f2783fff700 1 -- 172.21.15.72:0/2063550220 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f278c04e630 con 0x7f279c0663d0 2023-08-31T19:06:06.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.689+0000 7f27a27ff700 1 -- 172.21.15.72:0/2063550220 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f278805ef30 msgr2=0x7f27880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:06.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.689+0000 7f27a27ff700 1 --2- 172.21.15.72:0/2063550220 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f278805ef30 0x7f27880613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f279c0ab230 tx=0x7f2790009040).stop 2023-08-31T19:06:06.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.689+0000 7f27a27ff700 1 -- 172.21.15.72:0/2063550220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c0663d0 msgr2=0x7f279c0aad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:06.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.689+0000 7f27a27ff700 1 --2- 172.21.15.72:0/2063550220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c0663d0 0x7f279c0aad20 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f278c00d890 tx=0x7f278c008040).stop 2023-08-31T19:06:06.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.689+0000 7f27a27ff700 1 -- 172.21.15.72:0/2063550220 shutdown_connections 2023-08-31T19:06:06.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.689+0000 7f27a27ff700 1 --2- 172.21.15.72:0/2063550220 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c151610 0x7f279c0c1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.689+0000 7f27a27ff700 1 --2- 172.21.15.72:0/2063550220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c0663d0 0x7f279c0aad20 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.689+0000 7f27a27ff700 1 --2- 172.21.15.72:0/2063550220 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f278805ef30 0x7f27880613f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.689+0000 7f27a27ff700 1 --2- 172.21.15.72:0/2063550220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f279c153ed0 0x7f279c151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.689+0000 7f27a27ff700 1 -- 172.21.15.72:0/2063550220 >> 172.21.15.72:0/2063550220 conn(0x7f279c05eb60 msgr2=0x7f279c0c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:06.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.689+0000 7f27a27ff700 1 -- 172.21.15.72:0/2063550220 shutdown_connections 2023-08-31T19:06:06.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.689+0000 7f27a27ff700 1 -- 172.21.15.72:0/2063550220 wait complete. 2023-08-31T19:06:06.706 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-08-31T19:06:06.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.895+0000 7fab417ff700 1 Processor -- start 2023-08-31T19:06:06.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.896+0000 7fab417ff700 1 -- start start 2023-08-31T19:06:06.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.897+0000 7fab417ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab3c069170 0x7fab3c0c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.897+0000 7fab417ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c065710 0x7fab3c069c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.897+0000 7fab417ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3c064270 con 0x7fab3c06a260 2023-08-31T19:06:06.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.897+0000 7fab417ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab3c0bca40 con 0x7fab3c069170 2023-08-31T19:06:06.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.897+0000 7fab417ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c0bcc20 con 0x7fab3c065710 2023-08-31T19:06:06.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.897+0000 7fab3affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab3c069170 0x7fab3c0c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.897+0000 7fab3a7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fab3c06a260 0x7fab3c069550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57726/0 (socket says 172.21.15.72:57726) 2023-08-31T19:06:06.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.897+0000 7fab3a7fc700 1 -- 172.21.15.72:0/2978112070 learned_addr learned my addr 172.21.15.72:0/2978112070 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:06.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.898+0000 7fab3b7fe700 1 --2- 172.21.15.72:0/2978112070 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c065710 0x7fab3c069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.898+0000 7fab3affd700 1 -- 172.21.15.72:0/2978112070 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c065710 msgr2=0x7fab3c069c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:06.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.898+0000 7fab3affd700 1 --2- 172.21.15.72:0/2978112070 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c065710 0x7fab3c069c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.898+0000 7fab3affd700 1 -- 172.21.15.72:0/2978112070 >> v1:172.21.15.72:6789/0 conn(0x7fab3c06a260 legacy=0x7fab3c069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:06.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.898+0000 7fab3affd700 1 -- 172.21.15.72:0/2978112070 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c154890 con 0x7fab3c069170 2023-08-31T19:06:06.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.898+0000 7fab39ffb700 1 -- 172.21.15.72:0/2978112070 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497431904 0 0) 0x7fab3c064270 con 0x7fab3c06a260 2023-08-31T19:06:06.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.898+0000 7fab3affd700 1 --2- 172.21.15.72:0/2978112070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c069170 0x7fab3c0c2e50 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fab2c00ba00 tx=0x7fab2c00b300).ready entity=mon.0 client_cookie=6b0ca33d69315e54 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:06.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.898+0000 7fab39ffb700 1 -- 172.21.15.72:0/2978112070 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c00da70 con 0x7fab3c069170 2023-08-31T19:06:06.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.899+0000 7fab39ffb700 1 -- 172.21.15.72:0/2978112070 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c00dbd0 con 0x7fab3c069170 2023-08-31T19:06:06.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.899+0000 7fab39ffb700 1 -- 172.21.15.72:0/2978112070 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c010470 con 0x7fab3c069170 2023-08-31T19:06:06.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.899+0000 7fab417ff700 1 -- 172.21.15.72:0/2978112070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c069170 msgr2=0x7fab3c0c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:06.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.899+0000 7fab417ff700 1 --2- 172.21.15.72:0/2978112070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c069170 0x7fab3c0c2e50 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fab2c00ba00 tx=0x7fab2c00b300).stop 2023-08-31T19:06:06.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.899+0000 7fab417ff700 1 -- 172.21.15.72:0/2978112070 shutdown_connections 2023-08-31T19:06:06.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.899+0000 7fab417ff700 1 --2- 172.21.15.72:0/2978112070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c069170 0x7fab3c0c2e50 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.899+0000 7fab417ff700 1 --2- 172.21.15.72:0/2978112070 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c065710 0x7fab3c069c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.899+0000 7fab417ff700 1 -- 172.21.15.72:0/2978112070 >> 172.21.15.72:0/2978112070 conn(0x7fab3c0c6b10 msgr2=0x7fab3c0c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.899+0000 7fab417ff700 1 -- 172.21.15.72:0/2978112070 shutdown_connections 2023-08-31T19:06:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.899+0000 7fab417ff700 1 -- 172.21.15.72:0/2978112070 wait complete. 2023-08-31T19:06:06.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.902+0000 7fab417ff700 1 Processor -- start 2023-08-31T19:06:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.902+0000 7fab417ff700 1 -- start start 2023-08-31T19:06:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.903+0000 7fab417ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab3c065710 0x7fab3c16bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.903+0000 7fab417ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c069170 0x7fab3c16c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.903+0000 7fab417ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c06a260 0x7fab3c0ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.903+0000 7fab417ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c16c790 con 0x7fab3c06a260 2023-08-31T19:06:06.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.903+0000 7fab417ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c151f80 con 0x7fab3c065710 2023-08-31T19:06:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.903+0000 7fab417ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c148930 con 0x7fab3c069170 2023-08-31T19:06:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.904+0000 7fab3a7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c069170 0x7fab3c16c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.904+0000 7fab3affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab3c065710 0x7fab3c16bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.904+0000 7fab3affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab3c065710 0x7fab3c16bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:51404/0 (socket says 172.21.15.72:51404) 2023-08-31T19:06:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.904+0000 7fab3a7fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c069170 0x7fab3c16c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:36410/0 (socket says 172.21.15.72:36410) 2023-08-31T19:06:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.904+0000 7fab3affd700 1 -- 172.21.15.72:0/1924209986 learned_addr learned my addr 172.21.15.72:0/1924209986 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.904+0000 7fab3b7fe700 1 --2- 172.21.15.72:0/1924209986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c06a260 0x7fab3c0ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.905+0000 7fab3affd700 1 -- 172.21.15.72:0/1924209986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c069170 msgr2=0x7fab3c16c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:06.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.905+0000 7fab3affd700 1 --2- 172.21.15.72:0/1924209986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c069170 0x7fab3c16c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.905+0000 7fab3affd700 1 -- 172.21.15.72:0/1924209986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c06a260 msgr2=0x7fab3c0ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:06.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.905+0000 7fab3affd700 1 --2- 172.21.15.72:0/1924209986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c06a260 0x7fab3c0ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:06.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.905+0000 7fab3affd700 1 -- 172.21.15.72:0/1924209986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c00b540 con 0x7fab3c065710 2023-08-31T19:06:06.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.905+0000 7fab3affd700 1 --2- 172.21.15.72:0/1924209986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab3c065710 0x7fab3c16bdb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fab2c00da70 tx=0x7fab2c00b300).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:06.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.906+0000 7fab22ffd700 1 -- 172.21.15.72:0/1924209986 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c019450 con 0x7fab3c065710 2023-08-31T19:06:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.906+0000 7fab22ffd700 1 -- 172.21.15.72:0/1924209986 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c0195b0 con 0x7fab3c065710 2023-08-31T19:06:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.906+0000 7fab22ffd700 1 -- 172.21.15.72:0/1924209986 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c019970 con 0x7fab3c065710 2023-08-31T19:06:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.906+0000 7fab417ff700 1 -- 172.21.15.72:0/1924209986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3c152800 con 0x7fab3c065710 2023-08-31T19:06:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.906+0000 7fab417ff700 1 -- 172.21.15.72:0/1924209986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3c0ac280 con 0x7fab3c065710 2023-08-31T19:06:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.908+0000 7fab417ff700 1 -- 172.21.15.72:0/1924209986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3c06c6b0 con 0x7fab3c065710 2023-08-31T19:06:06.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.909+0000 7fab22ffd700 1 -- 172.21.15.72:0/1924209986 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fab2c019ce0 con 0x7fab3c065710 2023-08-31T19:06:06.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.910+0000 7fab22ffd700 1 --2- 172.21.15.72:0/1924209986 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fab2805ef30 0x7fab280613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:06.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.910+0000 7fab22ffd700 1 -- 172.21.15.72:0/1924209986 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6471+0+0 (secure 0 0 0) 0x7fab2c07b940 con 0x7fab3c065710 2023-08-31T19:06:06.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.910+0000 7fab3a7fc700 1 --2- 172.21.15.72:0/1924209986 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fab2805ef30 0x7fab280613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:06.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.910+0000 7fab3a7fc700 1 --2- 172.21.15.72:0/1924209986 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fab2805ef30 0x7fab280613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fab3c166400 tx=0x7fab30007dd0).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:06.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:06.915+0000 7fab22ffd700 1 -- 172.21.15.72:0/1924209986 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fab2c04ca10 con 0x7fab3c065710 2023-08-31T19:06:07.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:07.147+0000 7fab417ff700 1 -- 172.21.15.72:0/1924209986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7fab3c152ae0 con 0x7fab3c065710 2023-08-31T19:06:07.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:07.883+0000 7fab22ffd700 1 -- 172.21.15.72:0/1924209986 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v677) v1 ==== 183+0+0 (secure 0 0 0) 0x7fab2c028070 con 0x7fab3c065710 2023-08-31T19:06:07.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:07.886+0000 7fab417ff700 1 -- 172.21.15.72:0/1924209986 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fab2805ef30 msgr2=0x7fab280613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:07.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:07.886+0000 7fab417ff700 1 --2- 172.21.15.72:0/1924209986 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fab2805ef30 0x7fab280613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fab3c166400 tx=0x7fab30007dd0).stop 2023-08-31T19:06:07.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:07.886+0000 7fab417ff700 1 -- 172.21.15.72:0/1924209986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab3c065710 msgr2=0x7fab3c16bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:07.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:07.886+0000 7fab417ff700 1 --2- 172.21.15.72:0/1924209986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab3c065710 0x7fab3c16bdb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fab2c00da70 tx=0x7fab2c00b300).stop 2023-08-31T19:06:07.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:07.886+0000 7fab417ff700 1 -- 172.21.15.72:0/1924209986 shutdown_connections 2023-08-31T19:06:07.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:07.886+0000 7fab417ff700 1 --2- 172.21.15.72:0/1924209986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c06a260 0x7fab3c0ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:07.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:07.886+0000 7fab417ff700 1 --2- 172.21.15.72:0/1924209986 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fab2805ef30 0x7fab280613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:07.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:07.886+0000 7fab417ff700 1 --2- 172.21.15.72:0/1924209986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab3c065710 0x7fab3c16bdb0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:07.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:07.886+0000 7fab417ff700 1 --2- 172.21.15.72:0/1924209986 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fab3c069170 0x7fab3c16c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:07.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:07.886+0000 7fab417ff700 1 -- 172.21.15.72:0/1924209986 >> 172.21.15.72:0/1924209986 conn(0x7fab3c0c6b10 msgr2=0x7fab3c14f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:07.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:07.886+0000 7fab417ff700 1 -- 172.21.15.72:0/1924209986 shutdown_connections 2023-08-31T19:06:07.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:07.886+0000 7fab417ff700 1 -- 172.21.15.72:0/1924209986 wait complete. 2023-08-31T19:06:07.905 INFO:tasks.cephfs_test_runner:Test that a non-existent path leads to schedule deactivation after a few retries. ... ok 2023-08-31T19:06:07.906 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-08-31T19:06:07.906 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-31T19:06:07.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-08-31T19:06:08.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.097+0000 7f7169fff700 1 Processor -- start 2023-08-31T19:06:08.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.097+0000 7f7169fff700 1 -- start start 2023-08-31T19:06:08.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.098+0000 7f7169fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71640cb9b0 0x7f71641583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:08.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.098+0000 7f7169fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71641588d0 0x7f7164154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:08.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.098+0000 7f7169fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71640c6120 con 0x7f7164154060 2023-08-31T19:06:08.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.098+0000 7f7169fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71640c1380 con 0x7f71641588d0 2023-08-31T19:06:08.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.098+0000 7f7169fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71640c5e10 con 0x7f71640cb9b0 2023-08-31T19:06:08.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.099+0000 7f71637fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7164154060 0x7f7164157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:51046/0 (socket says 172.21.15.72:51046) 2023-08-31T19:06:08.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.099+0000 7f71637fe700 1 -- 172.21.15.72:0/365289071 learned_addr learned my addr 172.21.15.72:0/365289071 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:08.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.099+0000 7f7163fff700 1 --2- 172.21.15.72:0/365289071 >> v2:172.21.15.146:3300/0 conn(0x7f71641588d0 0x7f7164154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:08.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.099+0000 7f7162ffd700 1 --2- 172.21.15.72:0/365289071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71640cb9b0 0x7f71641583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:08.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.099+0000 7f71627fc700 1 -- 172.21.15.72:0/365289071 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326590369 0 0) 0x7f71640c6120 con 0x7f7164154060 2023-08-31T19:06:08.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.099+0000 7f71627fc700 1 -- 172.21.15.72:0/365289071 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f714c0033f0 con 0x7f7164154060 2023-08-31T19:06:08.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.099+0000 7f7163fff700 1 -- 172.21.15.72:0/365289071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71640cb9b0 msgr2=0x7f71641583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:08.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.099+0000 7f7163fff700 1 --2- 172.21.15.72:0/365289071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71640cb9b0 0x7f71641583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:08.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.099+0000 7f7163fff700 1 -- 172.21.15.72:0/365289071 >> v1:172.21.15.146:6789/0 conn(0x7f7164154060 legacy=0x7f7164157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:08.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.099+0000 7f7163fff700 1 -- 172.21.15.72:0/365289071 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71640c0ae0 con 0x7f71641588d0 2023-08-31T19:06:08.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.100+0000 7f7163fff700 1 --2- 172.21.15.72:0/365289071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641588d0 0x7f7164154440 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f715c009e60 tx=0x7f715c009780).ready entity=mon.1 client_cookie=35bc04603e975fd0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:08.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.100+0000 7f71627fc700 1 -- 172.21.15.72:0/365289071 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c00e070 con 0x7f71641588d0 2023-08-31T19:06:08.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.100+0000 7f71627fc700 1 -- 172.21.15.72:0/365289071 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c00bab0 con 0x7f71641588d0 2023-08-31T19:06:08.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.100+0000 7f71627fc700 1 -- 172.21.15.72:0/365289071 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c00be30 con 0x7f71641588d0 2023-08-31T19:06:08.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.100+0000 7f7169fff700 1 -- 172.21.15.72:0/365289071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641588d0 msgr2=0x7f7164154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:08.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.100+0000 7f7169fff700 1 --2- 172.21.15.72:0/365289071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641588d0 0x7f7164154440 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f715c009e60 tx=0x7f715c009780).stop 2023-08-31T19:06:08.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.100+0000 7f7169fff700 1 -- 172.21.15.72:0/365289071 shutdown_connections 2023-08-31T19:06:08.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.101+0000 7f7169fff700 1 --2- 172.21.15.72:0/365289071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641588d0 0x7f7164154440 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:08.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.101+0000 7f7169fff700 1 --2- 172.21.15.72:0/365289071 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71640cb9b0 0x7f71641583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:08.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.101+0000 7f7169fff700 1 -- 172.21.15.72:0/365289071 >> 172.21.15.72:0/365289071 conn(0x7f716405e870 msgr2=0x7f71640cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:08.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.101+0000 7f7169fff700 1 -- 172.21.15.72:0/365289071 shutdown_connections 2023-08-31T19:06:08.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.101+0000 7f7169fff700 1 -- 172.21.15.72:0/365289071 wait complete. 2023-08-31T19:06:08.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.102+0000 7f7169fff700 1 Processor -- start 2023-08-31T19:06:08.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.102+0000 7f7169fff700 1 -- start start 2023-08-31T19:06:08.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.103+0000 7f7169fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71640cb9b0 0x7f71640c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:08.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.103+0000 7f7169fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7164154060 0x7f7164155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:08.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.103+0000 7f7169fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641588d0 0x7f71640aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:08.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.103+0000 7f7169fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7164150680 con 0x7f7164154060 2023-08-31T19:06:08.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.103+0000 7f7169fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71641508d0 con 0x7f71641588d0 2023-08-31T19:06:08.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.103+0000 7f7169fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7164150bb0 con 0x7f71640cb9b0 2023-08-31T19:06:08.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.103+0000 7f7162ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7164154060 0x7f7164155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:08.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.104+0000 7f7162ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7164154060 0x7f7164155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48142/0 (socket says 172.21.15.72:48142) 2023-08-31T19:06:08.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.104+0000 7f7162ffd700 1 -- 172.21.15.72:0/1969925614 learned_addr learned my addr 172.21.15.72:0/1969925614 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:08.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.104+0000 7f7163fff700 1 --2- 172.21.15.72:0/1969925614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641588d0 0x7f71640aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:08.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.104+0000 7f71637fe700 1 --2- 172.21.15.72:0/1969925614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71640cb9b0 0x7f71640c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:08.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.104+0000 7f7162ffd700 1 -- 172.21.15.72:0/1969925614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71640cb9b0 msgr2=0x7f71640c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:08.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.104+0000 7f7162ffd700 1 --2- 172.21.15.72:0/1969925614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71640cb9b0 0x7f71640c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:08.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.104+0000 7f7162ffd700 1 -- 172.21.15.72:0/1969925614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641588d0 msgr2=0x7f71640aac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:08.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.104+0000 7f7162ffd700 1 --2- 172.21.15.72:0/1969925614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641588d0 0x7f71640aac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:08.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.104+0000 7f7162ffd700 1 -- 172.21.15.72:0/1969925614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c009a20 con 0x7f7164154060 2023-08-31T19:06:08.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.104+0000 7f7162ffd700 1 --2- 172.21.15.72:0/1969925614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7164154060 0x7f7164155830 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f715800e900 tx=0x7f7158009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.104+0000 7f714b7fe700 1 -- 172.21.15.72:0/1969925614 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158009390 con 0x7f7164154060 2023-08-31T19:06:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.104+0000 7f714b7fe700 1 -- 172.21.15.72:0/1969925614 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715800c640 con 0x7f7164154060 2023-08-31T19:06:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.104+0000 7f7169fff700 1 -- 172.21.15.72:0/1969925614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7164150e90 con 0x7f7164154060 2023-08-31T19:06:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.104+0000 7f714b7fe700 1 -- 172.21.15.72:0/1969925614 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715800c9c0 con 0x7f7164154060 2023-08-31T19:06:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.105+0000 7f7169fff700 1 -- 172.21.15.72:0/1969925614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71640c4860 con 0x7f7164154060 2023-08-31T19:06:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.106+0000 7f7169fff700 1 -- 172.21.15.72:0/1969925614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71641513b0 con 0x7f7164154060 2023-08-31T19:06:08.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.106+0000 7f714b7fe700 1 -- 172.21.15.72:0/1969925614 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f715801b400 con 0x7f7164154060 2023-08-31T19:06:08.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.107+0000 7f714b7fe700 1 --2- 172.21.15.72:0/1969925614 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f715005ef30 0x7f71500613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:08.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.107+0000 7f714b7fe700 1 -- 172.21.15.72:0/1969925614 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6471+0+0 (secure 0 0 0) 0x7f715807a570 con 0x7f7164154060 2023-08-31T19:06:08.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.108+0000 7f71637fe700 1 --2- 172.21.15.72:0/1969925614 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f715005ef30 0x7f71500613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:08.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.108+0000 7f71637fe700 1 --2- 172.21.15.72:0/1969925614 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f715005ef30 0x7f71500613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f71540057a0 tx=0x7f7154009040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:08.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.111+0000 7f714b7fe700 1 -- 172.21.15.72:0/1969925614 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f71641513b0 con 0x7f7164154060 2023-08-31T19:06:08.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.342+0000 7f7169fff700 1 -- 172.21.15.72:0/1969925614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f71641513b0 con 0x7f7164154060 2023-08-31T19:06:08.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.885+0000 7f714b7fe700 1 -- 172.21.15.72:0/1969925614 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v678) v1 ==== 151+0+0 (secure 0 0 0) 0x7f71641513b0 con 0x7f7164154060 2023-08-31T19:06:08.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.887+0000 7f7169fff700 1 -- 172.21.15.72:0/1969925614 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f715005ef30 msgr2=0x7f71500613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:08.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.887+0000 7f7169fff700 1 --2- 172.21.15.72:0/1969925614 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f715005ef30 0x7f71500613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f71540057a0 tx=0x7f7154009040).stop 2023-08-31T19:06:08.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.887+0000 7f7169fff700 1 -- 172.21.15.72:0/1969925614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7164154060 msgr2=0x7f7164155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:08.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.887+0000 7f7169fff700 1 --2- 172.21.15.72:0/1969925614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7164154060 0x7f7164155830 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f715800e900 tx=0x7f7158009060).stop 2023-08-31T19:06:08.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.888+0000 7f7169fff700 1 -- 172.21.15.72:0/1969925614 shutdown_connections 2023-08-31T19:06:08.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.888+0000 7f7169fff700 1 --2- 172.21.15.72:0/1969925614 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f715005ef30 0x7f71500613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:08.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.888+0000 7f7169fff700 1 --2- 172.21.15.72:0/1969925614 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71641588d0 0x7f71640aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:08.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.888+0000 7f7169fff700 1 --2- 172.21.15.72:0/1969925614 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71640cb9b0 0x7f71640c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:08.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.888+0000 7f7169fff700 1 --2- 172.21.15.72:0/1969925614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7164154060 0x7f7164155830 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:08.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.888+0000 7f7169fff700 1 -- 172.21.15.72:0/1969925614 >> 172.21.15.72:0/1969925614 conn(0x7f716405e870 msgr2=0x7f71640bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:08.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.888+0000 7f7169fff700 1 -- 172.21.15.72:0/1969925614 shutdown_connections 2023-08-31T19:06:08.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:08.888+0000 7f7169fff700 1 -- 172.21.15.72:0/1969925614 wait complete. 2023-08-31T19:06:08.907 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-31T19:06:09.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.099+0000 7f8ecc7ff700 1 Processor -- start 2023-08-31T19:06:09.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.099+0000 7f8ecc7ff700 1 -- start start 2023-08-31T19:06:09.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.100+0000 7f8ecc7ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ec41520e0 0x7f8ec40a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.100+0000 7f8ecc7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec40a9440 0x7f8ec4068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.100+0000 7f8ecc7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec4064340 con 0x7f8ec41524c0 2023-08-31T19:06:09.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.100+0000 7f8ecc7ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec40bcd00 con 0x7f8ec41520e0 2023-08-31T19:06:09.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.100+0000 7f8ecc7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40bcfe0 con 0x7f8ec40a9440 2023-08-31T19:06:09.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.101+0000 7f8ecad9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8ec41524c0 0x7f8ec4155e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57742/0 (socket says 172.21.15.72:57742) 2023-08-31T19:06:09.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.101+0000 7f8ecad9c700 1 -- 172.21.15.72:0/1682752141 learned_addr learned my addr 172.21.15.72:0/1682752141 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:09.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.101+0000 7f8ec9d9a700 1 --2- 172.21.15.72:0/1682752141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec40a9440 0x7f8ec4068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.101+0000 7f8eca59b700 1 --2- 172.21.15.72:0/1682752141 >> v2:172.21.15.146:3300/0 conn(0x7f8ec41520e0 0x7f8ec40a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.101+0000 7f8ec9599700 1 -- 172.21.15.72:0/1682752141 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752674081 0 0) 0x7f8ec4064340 con 0x7f8ec41524c0 2023-08-31T19:06:09.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.101+0000 7f8ec9599700 1 -- 172.21.15.72:0/1682752141 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eb00033f0 con 0x7f8ec41524c0 2023-08-31T19:06:09.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.101+0000 7f8ec9599700 1 -- 172.21.15.72:0/1682752141 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 474706833 0 0) 0x7f8eb00033f0 con 0x7f8ec41524c0 2023-08-31T19:06:09.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.101+0000 7f8ec9599700 1 -- 172.21.15.72:0/1682752141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec40a9440 msgr2=0x7f8ec4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:09.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.101+0000 7f8ec9599700 1 --2- 172.21.15.72:0/1682752141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec40a9440 0x7f8ec4068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.101+0000 7f8ec9599700 1 -- 172.21.15.72:0/1682752141 >> v2:172.21.15.146:3300/0 conn(0x7f8ec41520e0 msgr2=0x7f8ec40a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:09.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.101+0000 7f8ec9599700 1 --2- 172.21.15.72:0/1682752141 >> v2:172.21.15.146:3300/0 conn(0x7f8ec41520e0 0x7f8ec40a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.101+0000 7f8ec9599700 1 -- 172.21.15.72:0/1682752141 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec40bd2c0 con 0x7f8ec41524c0 2023-08-31T19:06:09.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.101+0000 7f8ec9599700 1 -- 172.21.15.72:0/1682752141 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f8ebc0017f0 con 0x7f8ec41524c0 2023-08-31T19:06:09.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.101+0000 7f8ec9599700 1 -- 172.21.15.72:0/1682752141 >> v1:172.21.15.72:6789/0 conn(0x7f8ec41524c0 legacy=0x7f8ec4155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:09.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.101+0000 7f8ec9599700 1 --2- 172.21.15.72:0/1682752141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec40a9440 0x7f8eb00038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8ec9599700 1 --2- 172.21.15.72:0/1682752141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb0003e10 0x7f8eb0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8ec9599700 1 --2- 172.21.15.72:0/1682752141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eb0004b80 0x7f8eb0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8ec9599700 1 -- 172.21.15.72:0/1682752141 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40bcd00 con 0x7f8eb0003e10 2023-08-31T19:06:09.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8ec9599700 1 -- 172.21.15.72:0/1682752141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40bcfe0 con 0x7f8eb0004b80 2023-08-31T19:06:09.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8ec9599700 1 -- 172.21.15.72:0/1682752141 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb000fcf0 con 0x7f8ec40a9440 2023-08-31T19:06:09.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8ec9d9a700 1 --2- 172.21.15.72:0/1682752141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb0003e10 0x7f8eb0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8ecad9c700 1 --2- 172.21.15.72:0/1682752141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eb0004b80 0x7f8eb0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8eca59b700 1 --2- 172.21.15.72:0/1682752141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec40a9440 0x7f8eb00038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8ec9d9a700 1 -- 172.21.15.72:0/1682752141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec40a9440 msgr2=0x7f8eb00038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:09.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8ec9d9a700 1 --2- 172.21.15.72:0/1682752141 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ec40a9440 0x7f8eb00038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8ec9d9a700 1 -- 172.21.15.72:0/1682752141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eb0004b80 msgr2=0x7f8eb0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:09.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8ec9d9a700 1 --2- 172.21.15.72:0/1682752141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eb0004b80 0x7f8eb0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8ec9d9a700 1 -- 172.21.15.72:0/1682752141 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb00033f0 con 0x7f8eb0003e10 2023-08-31T19:06:09.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8ecad9c700 1 --2- 172.21.15.72:0/1682752141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eb0004b80 0x7f8eb0005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:09.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8ec9d9a700 1 --2- 172.21.15.72:0/1682752141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb0003e10 0x7f8eb0004690 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f8eb4009ab0 tx=0x7f8eb4009060).ready entity=mon.0 client_cookie=d159e65e04e21867 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:09.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.102+0000 7f8ec9599700 1 -- 172.21.15.72:0/1682752141 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4009430 con 0x7f8eb0003e10 2023-08-31T19:06:09.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.103+0000 7f8ec9599700 1 -- 172.21.15.72:0/1682752141 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb400e640 con 0x7f8eb0003e10 2023-08-31T19:06:09.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.103+0000 7f8ec9599700 1 -- 172.21.15.72:0/1682752141 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb400e9c0 con 0x7f8eb0003e10 2023-08-31T19:06:09.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.103+0000 7f8ecc7ff700 1 -- 172.21.15.72:0/1682752141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb0003e10 msgr2=0x7f8eb0004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:09.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.103+0000 7f8ecc7ff700 1 --2- 172.21.15.72:0/1682752141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8eb0003e10 0x7f8eb0004690 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f8eb4009ab0 tx=0x7f8eb4009060).stop 2023-08-31T19:06:09.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.103+0000 7f8ecad9c700 1 -- 172.21.15.72:0/1682752141 reap_dead start 2023-08-31T19:06:09.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.103+0000 7f8ecc7ff700 1 -- 172.21.15.72:0/1682752141 shutdown_connections 2023-08-31T19:06:09.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.103+0000 7f8ecc7ff700 1 -- 172.21.15.72:0/1682752141 >> 172.21.15.72:0/1682752141 conn(0x7f8ec40630c0 msgr2=0x7f8ec40c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:09.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.103+0000 7f8ecc7ff700 1 -- 172.21.15.72:0/1682752141 shutdown_connections 2023-08-31T19:06:09.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.103+0000 7f8ecc7ff700 1 -- 172.21.15.72:0/1682752141 wait complete. 2023-08-31T19:06:09.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.105+0000 7f8ecc7ff700 1 Processor -- start 2023-08-31T19:06:09.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.105+0000 7f8ecc7ff700 1 -- start start 2023-08-31T19:06:09.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ecc7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8eb0003e10 0x7f8ec41550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ecc7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40abfc0 0x7f8ec40ac440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ecc7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec40c4910 0x7f8ec40c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ecc7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec414a130 con 0x7f8ec40c4910 2023-08-31T19:06:09.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ecc7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4154c40 con 0x7f8ec40abfc0 2023-08-31T19:06:09.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ecc7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4154310 con 0x7f8eb0003e10 2023-08-31T19:06:09.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ecad9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec40c4910 0x7f8ec40c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ecad9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec40c4910 0x7f8ec40c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48164/0 (socket says 172.21.15.72:48164) 2023-08-31T19:06:09.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ecad9c700 1 -- 172.21.15.72:0/2402247710 learned_addr learned my addr 172.21.15.72:0/2402247710 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:09.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ec9d9a700 1 --2- 172.21.15.72:0/2402247710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40abfc0 0x7f8ec40ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8eca59b700 1 --2- 172.21.15.72:0/2402247710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8eb0003e10 0x7f8ec41550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ecad9c700 1 -- 172.21.15.72:0/2402247710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8eb0003e10 msgr2=0x7f8ec41550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:09.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ecad9c700 1 --2- 172.21.15.72:0/2402247710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8eb0003e10 0x7f8ec41550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ecad9c700 1 -- 172.21.15.72:0/2402247710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40abfc0 msgr2=0x7f8ec40ac440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:09.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ecad9c700 1 --2- 172.21.15.72:0/2402247710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40abfc0 0x7f8ec40ac440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ecad9c700 1 -- 172.21.15.72:0/2402247710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec41545f0 con 0x7f8ec40c4910 2023-08-31T19:06:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ec9d9a700 1 --2- 172.21.15.72:0/2402247710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40abfc0 0x7f8ec40ac440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.106+0000 7f8ecad9c700 1 --2- 172.21.15.72:0/2402247710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec40c4910 0x7f8ec40c4d90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f8ec406bf00 tx=0x7f8ebc002150).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.107+0000 7f8eba7fc700 1 -- 172.21.15.72:0/2402247710 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc00c750 con 0x7f8ec40c4910 2023-08-31T19:06:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.107+0000 7f8eba7fc700 1 -- 172.21.15.72:0/2402247710 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc00c8d0 con 0x7f8ec40c4910 2023-08-31T19:06:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.107+0000 7f8ecc7ff700 1 -- 172.21.15.72:0/2402247710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec41548d0 con 0x7f8ec40c4910 2023-08-31T19:06:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.107+0000 7f8eba7fc700 1 -- 172.21.15.72:0/2402247710 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc00cc90 con 0x7f8ec40c4910 2023-08-31T19:06:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.107+0000 7f8ecc7ff700 1 -- 172.21.15.72:0/2402247710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec40ac930 con 0x7f8ec40c4910 2023-08-31T19:06:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.108+0000 7f8ecc7ff700 1 -- 172.21.15.72:0/2402247710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec4154df0 con 0x7f8ec40c4910 2023-08-31T19:06:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.109+0000 7f8eba7fc700 1 -- 172.21.15.72:0/2402247710 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8ebc014640 con 0x7f8ec40c4910 2023-08-31T19:06:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.109+0000 7f8eba7fc700 1 --2- 172.21.15.72:0/2402247710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8ea805ef30 0x7f8ea80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.109+0000 7f8eba7fc700 1 -- 172.21.15.72:0/2402247710 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6471+0+0 (secure 0 0 0) 0x7f8ebc079d30 con 0x7f8ec40c4910 2023-08-31T19:06:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.110+0000 7f8eca59b700 1 --2- 172.21.15.72:0/2402247710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8ea805ef30 0x7f8ea80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.110+0000 7f8eca59b700 1 --2- 172.21.15.72:0/2402247710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8ea805ef30 0x7f8ea80613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8ec0009cc0 tx=0x7f8ec0008040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.114+0000 7f8eba7fc700 1 -- 172.21.15.72:0/2402247710 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ebc0498f0 con 0x7f8ec40c4910 2023-08-31T19:06:09.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.281+0000 7f8ecc7ff700 1 -- 172.21.15.72:0/2402247710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8ec406c6b0 con 0x7f8ec40c4910 2023-08-31T19:06:09.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.287+0000 7f8eba7fc700 1 -- 172.21.15.72:0/2402247710 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8ec4154df0 con 0x7f8ec40c4910 2023-08-31T19:06:09.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.289+0000 7f8ecc7ff700 1 -- 172.21.15.72:0/2402247710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8ea805ef30 msgr2=0x7f8ea80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:09.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.289+0000 7f8ecc7ff700 1 --2- 172.21.15.72:0/2402247710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8ea805ef30 0x7f8ea80613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8ec0009cc0 tx=0x7f8ec0008040).stop 2023-08-31T19:06:09.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.290+0000 7f8ecc7ff700 1 -- 172.21.15.72:0/2402247710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec40c4910 msgr2=0x7f8ec40c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:09.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.290+0000 7f8ecc7ff700 1 --2- 172.21.15.72:0/2402247710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec40c4910 0x7f8ec40c4d90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f8ec406bf00 tx=0x7f8ebc002150).stop 2023-08-31T19:06:09.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.290+0000 7f8ecc7ff700 1 -- 172.21.15.72:0/2402247710 shutdown_connections 2023-08-31T19:06:09.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.290+0000 7f8ecc7ff700 1 --2- 172.21.15.72:0/2402247710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec40c4910 0x7f8ec40c4d90 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.290+0000 7f8ecc7ff700 1 --2- 172.21.15.72:0/2402247710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8eb0003e10 0x7f8ec41550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.290+0000 7f8ecc7ff700 1 --2- 172.21.15.72:0/2402247710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f8ea805ef30 0x7f8ea80613f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.290+0000 7f8ecc7ff700 1 --2- 172.21.15.72:0/2402247710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40abfc0 0x7f8ec40ac440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.290+0000 7f8ecc7ff700 1 -- 172.21.15.72:0/2402247710 >> 172.21.15.72:0/2402247710 conn(0x7f8ec40630c0 msgr2=0x7f8ec40c10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:09.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.290+0000 7f8ecc7ff700 1 -- 172.21.15.72:0/2402247710 shutdown_connections 2023-08-31T19:06:09.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.290+0000 7f8ecc7ff700 1 -- 172.21.15.72:0/2402247710 wait complete. 2023-08-31T19:06:09.308 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:06:09.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:06:09.404 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:06:09.512 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:06:09.513 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-31T19:06:09.513 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:06:09.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.701+0000 7fc7635ff700 1 Processor -- start 2023-08-31T19:06:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.702+0000 7fc7635ff700 1 -- start start 2023-08-31T19:06:09.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.703+0000 7fc7635ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc75c154060 0x7fc75c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.703+0000 7fc7635ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c0c6120 con 0x7fc75c0cb9b0 2023-08-31T19:06:09.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.703+0000 7fc7635ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c0c5e10 con 0x7fc75c1588d0 2023-08-31T19:06:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.703+0000 7fc7635ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0c1380 con 0x7fc75c154060 2023-08-31T19:06:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.703+0000 7fc760b9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc75c0cb9b0 0x7fc75c1581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57754/0 (socket says 172.21.15.72:57754) 2023-08-31T19:06:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.703+0000 7fc760b9a700 1 -- 172.21.15.72:0/1048789932 learned_addr learned my addr 172.21.15.72:0/1048789932 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.703+0000 7fc76139b700 1 --2- 172.21.15.72:0/1048789932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc75c154060 0x7fc75c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.703+0000 7fc753fff700 1 -- 172.21.15.72:0/1048789932 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066000095 0 0) 0x7fc75c0c6120 con 0x7fc75c0cb9b0 2023-08-31T19:06:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc753fff700 1 -- 172.21.15.72:0/1048789932 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7480033f0 con 0x7fc75c0cb9b0 2023-08-31T19:06:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc753fff700 1 -- 172.21.15.72:0/1048789932 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 398931899 0 0) 0x7fc7480033f0 con 0x7fc75c0cb9b0 2023-08-31T19:06:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc753fff700 1 -- 172.21.15.72:0/1048789932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc75c154060 msgr2=0x7fc75c157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:09.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc753fff700 1 --2- 172.21.15.72:0/1048789932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc75c154060 0x7fc75c157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc753fff700 1 -- 172.21.15.72:0/1048789932 >> v1:172.21.15.146:6789/0 conn(0x7fc75c1588d0 legacy=0x7fc75c154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:09.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc753fff700 1 -- 172.21.15.72:0/1048789932 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c0c0ae0 con 0x7fc75c0cb9b0 2023-08-31T19:06:09.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc753fff700 1 -- 172.21.15.72:0/1048789932 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fc74c001470 con 0x7fc75c0cb9b0 2023-08-31T19:06:09.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc753fff700 1 -- 172.21.15.72:0/1048789932 >> v1:172.21.15.72:6789/0 conn(0x7fc75c0cb9b0 legacy=0x7fc75c1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:09.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc753fff700 1 --2- 172.21.15.72:0/1048789932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc748003910 0x7fc748003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc753fff700 1 --2- 172.21.15.72:0/1048789932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc748004690 0x7fc748004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc753fff700 1 --2- 172.21.15.72:0/1048789932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc75c154060 0x7fc748005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc753fff700 1 -- 172.21.15.72:0/1048789932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0c1380 con 0x7fc748004690 2023-08-31T19:06:09.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc753fff700 1 -- 172.21.15.72:0/1048789932 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74800b8e0 con 0x7fc748003910 2023-08-31T19:06:09.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc753fff700 1 -- 172.21.15.72:0/1048789932 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74800ba50 con 0x7fc75c154060 2023-08-31T19:06:09.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc760b9a700 1 --2- 172.21.15.72:0/1048789932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc748004690 0x7fc748004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc76139b700 1 --2- 172.21.15.72:0/1048789932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc748003910 0x7fc748003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.704+0000 7fc761b9c700 1 --2- 172.21.15.72:0/1048789932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc75c154060 0x7fc748005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.705+0000 7fc760b9a700 1 -- 172.21.15.72:0/1048789932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc75c154060 msgr2=0x7fc748005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:09.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.705+0000 7fc760b9a700 1 --2- 172.21.15.72:0/1048789932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc75c154060 0x7fc748005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.705+0000 7fc760b9a700 1 -- 172.21.15.72:0/1048789932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc748003910 msgr2=0x7fc748003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:09.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.705+0000 7fc760b9a700 1 --2- 172.21.15.72:0/1048789932 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc748003910 0x7fc748003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.705+0000 7fc760b9a700 1 -- 172.21.15.72:0/1048789932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7480033f0 con 0x7fc748004690 2023-08-31T19:06:09.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.705+0000 7fc760b9a700 1 --2- 172.21.15.72:0/1048789932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc748004690 0x7fc748004b10 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fc75c083c70 tx=0x7fc74c001df0).ready entity=mon.0 client_cookie=1c3cbb2f3d57c8d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:09.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.705+0000 7fc753fff700 1 -- 172.21.15.72:0/1048789932 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00c980 con 0x7fc748004690 2023-08-31T19:06:09.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.705+0000 7fc753fff700 1 -- 172.21.15.72:0/1048789932 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c00cae0 con 0x7fc748004690 2023-08-31T19:06:09.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.705+0000 7fc753fff700 1 -- 172.21.15.72:0/1048789932 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00cea0 con 0x7fc748004690 2023-08-31T19:06:09.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.706+0000 7fc7635ff700 1 -- 172.21.15.72:0/1048789932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc748004690 msgr2=0x7fc748004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:09.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.706+0000 7fc7635ff700 1 --2- 172.21.15.72:0/1048789932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc748004690 0x7fc748004b10 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7fc75c083c70 tx=0x7fc74c001df0).stop 2023-08-31T19:06:09.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.706+0000 7fc761b9c700 1 -- 172.21.15.72:0/1048789932 reap_dead start 2023-08-31T19:06:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.706+0000 7fc7635ff700 1 -- 172.21.15.72:0/1048789932 shutdown_connections 2023-08-31T19:06:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.706+0000 7fc7635ff700 1 -- 172.21.15.72:0/1048789932 >> 172.21.15.72:0/1048789932 conn(0x7fc75c05e870 msgr2=0x7fc75c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.706+0000 7fc7635ff700 1 -- 172.21.15.72:0/1048789932 shutdown_connections 2023-08-31T19:06:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.706+0000 7fc7635ff700 1 -- 172.21.15.72:0/1048789932 wait complete. 2023-08-31T19:06:09.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.707+0000 7fc7635ff700 1 Processor -- start 2023-08-31T19:06:09.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.707+0000 7fc7635ff700 1 -- start start 2023-08-31T19:06:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.708+0000 7fc7635ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc748004690 0x7fc75c142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.708+0000 7fc7635ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75c0b0930 0x7fc75c0ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.708+0000 7fc7635ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc75c0abe90 0x7fc75c0add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.708+0000 7fc7635ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0acfe0 con 0x7fc75c0b0930 2023-08-31T19:06:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.708+0000 7fc7635ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0ac3d0 con 0x7fc748004690 2023-08-31T19:06:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.708+0000 7fc7635ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0ac6b0 con 0x7fc75c0abe90 2023-08-31T19:06:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.708+0000 7fc760b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75c0b0930 0x7fc75c0ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.709+0000 7fc760b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75c0b0930 0x7fc75c0ab9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48190/0 (socket says 172.21.15.72:48190) 2023-08-31T19:06:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.709+0000 7fc760b9a700 1 -- 172.21.15.72:0/4091584452 learned_addr learned my addr 172.21.15.72:0/4091584452 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:09.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.709+0000 7fc76139b700 1 --2- 172.21.15.72:0/4091584452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc748004690 0x7fc75c142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.709+0000 7fc761b9c700 1 --2- 172.21.15.72:0/4091584452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc75c0abe90 0x7fc75c0add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.709+0000 7fc760b9a700 1 -- 172.21.15.72:0/4091584452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc75c0abe90 msgr2=0x7fc75c0add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:09.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.709+0000 7fc760b9a700 1 --2- 172.21.15.72:0/4091584452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc75c0abe90 0x7fc75c0add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.709+0000 7fc760b9a700 1 -- 172.21.15.72:0/4091584452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc748004690 msgr2=0x7fc75c142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.709+0000 7fc760b9a700 1 --2- 172.21.15.72:0/4091584452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc748004690 0x7fc75c142720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.709+0000 7fc760b9a700 1 -- 172.21.15.72:0/4091584452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c0ac990 con 0x7fc75c0b0930 2023-08-31T19:06:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.709+0000 7fc760b9a700 1 --2- 172.21.15.72:0/4091584452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75c0b0930 0x7fc75c0ab9a0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7fc74c00c6a0 tx=0x7fc74c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.709+0000 7fc7517fa700 1 -- 172.21.15.72:0/4091584452 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c001650 con 0x7fc75c0b0930 2023-08-31T19:06:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.709+0000 7fc7517fa700 1 -- 172.21.15.72:0/4091584452 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c0046b0 con 0x7fc75c0b0930 2023-08-31T19:06:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.709+0000 7fc7635ff700 1 -- 172.21.15.72:0/4091584452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c0acc70 con 0x7fc75c0b0930 2023-08-31T19:06:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.709+0000 7fc7517fa700 1 -- 172.21.15.72:0/4091584452 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c004a30 con 0x7fc75c0b0930 2023-08-31T19:06:09.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.710+0000 7fc7635ff700 1 -- 172.21.15.72:0/4091584452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75c0ae230 con 0x7fc75c0b0930 2023-08-31T19:06:09.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.711+0000 7fc7635ff700 1 -- 172.21.15.72:0/4091584452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75c06c6b0 con 0x7fc75c0b0930 2023-08-31T19:06:09.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.711+0000 7fc7517fa700 1 -- 172.21.15.72:0/4091584452 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc74c013450 con 0x7fc75c0b0930 2023-08-31T19:06:09.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.713+0000 7fc7517fa700 1 --2- 172.21.15.72:0/4091584452 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc74005ef30 0x7fc7400613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.713+0000 7fc7517fa700 1 -- 172.21.15.72:0/4091584452 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6471+0+0 (secure 0 0 0) 0x7fc74c07ac60 con 0x7fc75c0b0930 2023-08-31T19:06:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.713+0000 7fc76139b700 1 --2- 172.21.15.72:0/4091584452 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc74005ef30 0x7fc7400613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.714+0000 7fc76139b700 1 --2- 172.21.15.72:0/4091584452 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc74005ef30 0x7fc7400613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc758006d20 tx=0x7fc758006f40).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.717+0000 7fc7517fa700 1 -- 172.21.15.72:0/4091584452 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc74c04be40 con 0x7fc75c0b0930 2023-08-31T19:06:09.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.927+0000 7fc7635ff700 1 -- 172.21.15.72:0/4091584452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc75c0c0dc0 con 0x7fc75c0b0930 2023-08-31T19:06:09.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.927+0000 7fc7517fa700 1 -- 172.21.15.72:0/4091584452 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fc74c025de0 con 0x7fc75c0b0930 2023-08-31T19:06:09.928 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:06:09.928 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":50,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2894594800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2894594800},{"type":"v1","addr":"172.21.15.146:6834","nonce":2894594800}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2296022003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2296022003},{"type":"v1","addr":"172.21.15.72:6837","nonce":2296022003}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/159383587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":159383587},{"type":"v1","addr":"172.21.15.146:6835","nonce":159383587}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7521,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3062935311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3062935311},{"type":"v1","addr":"172.21.15.72:6835","nonce":3062935311}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[]} 2023-08-31T19:06:09.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.929+0000 7fc7635ff700 1 -- 172.21.15.72:0/4091584452 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc74005ef30 msgr2=0x7fc7400613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:09.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.929+0000 7fc7635ff700 1 --2- 172.21.15.72:0/4091584452 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc74005ef30 0x7fc7400613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc758006d20 tx=0x7fc758006f40).stop 2023-08-31T19:06:09.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.929+0000 7fc7635ff700 1 -- 172.21.15.72:0/4091584452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75c0b0930 msgr2=0x7fc75c0ab9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:09.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.929+0000 7fc7635ff700 1 --2- 172.21.15.72:0/4091584452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75c0b0930 0x7fc75c0ab9a0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7fc74c00c6a0 tx=0x7fc74c015000).stop 2023-08-31T19:06:09.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.929+0000 7fc7635ff700 1 -- 172.21.15.72:0/4091584452 shutdown_connections 2023-08-31T19:06:09.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.929+0000 7fc7635ff700 1 --2- 172.21.15.72:0/4091584452 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc75c0abe90 0x7fc75c0add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.929+0000 7fc7635ff700 1 --2- 172.21.15.72:0/4091584452 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc74005ef30 0x7fc7400613f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.929+0000 7fc7635ff700 1 --2- 172.21.15.72:0/4091584452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc748004690 0x7fc75c142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.929+0000 7fc7635ff700 1 --2- 172.21.15.72:0/4091584452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc75c0b0930 0x7fc75c0ab9a0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:09.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.929+0000 7fc7635ff700 1 -- 172.21.15.72:0/4091584452 >> 172.21.15.72:0/4091584452 conn(0x7fc75c05e870 msgr2=0x7fc75c0645f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:09.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.929+0000 7fc7635ff700 1 -- 172.21.15.72:0/4091584452 shutdown_connections 2023-08-31T19:06:09.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:09.930+0000 7fc7635ff700 1 -- 172.21.15.72:0/4091584452 wait complete. 2023-08-31T19:06:09.933 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 50 2023-08-31T19:06:09.947 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T19:06:09.948 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-31T19:06:09.948 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T19:06:09.949 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:06:09.949 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T19:06:09.949 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-31T19:06:09.950 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T19:06:09.950 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:06:09.950 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T19:06:09.950 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-31T19:06:09.951 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T19:06:09.951 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:06:09.951 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T19:06:09.952 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-31T19:06:09.952 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T19:06:09.952 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:06:09.963 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T19:06:09.963 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T19:06:09.964 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T19:06:09.965 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T19:06:09.966 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T19:06:09.966 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T19:06:09.967 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T19:06:09.967 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T19:06:10.007 INFO:tasks.ceph.mds.a:Started 2023-08-31T19:06:10.008 DEBUG:teuthology.parallel:result is None 2023-08-31T19:06:10.011 INFO:tasks.ceph.mds.b:Started 2023-08-31T19:06:10.011 DEBUG:teuthology.parallel:result is None 2023-08-31T19:06:10.012 INFO:tasks.ceph.mds.c:Started 2023-08-31T19:06:10.012 DEBUG:teuthology.parallel:result is None 2023-08-31T19:06:10.013 INFO:tasks.ceph.mds.d:Started 2023-08-31T19:06:10.014 DEBUG:teuthology.parallel:result is None 2023-08-31T19:06:10.014 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-31T19:06:10.152 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T19:06:10.155 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-08-31T19:06:10.156 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-31T19:06:10.156 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-08-31T19:06:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.222+0000 7f0e19bff700 1 Processor -- start 2023-08-31T19:06:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.222+0000 7f0e19bff700 1 -- start start 2023-08-31T19:06:10.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.224+0000 7f0e19bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0e14066d30 0x7f0e140c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:10.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.224+0000 7f0e19bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e141588b0 con 0x7f0e140c25e0 2023-08-31T19:06:10.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.224+0000 7f0e19bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e140c2a70 con 0x7f0e14154370 2023-08-31T19:06:10.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.224+0000 7f0e19bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e140c2d50 con 0x7f0e14066d30 2023-08-31T19:06:10.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.224+0000 7f0e13fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0e14066d30 0x7f0e140c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:10.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.224+0000 7f0e13fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0e14066d30 0x7f0e140c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48240/0 (socket says 172.21.15.72:48240) 2023-08-31T19:06:10.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.224+0000 7f0e13fff700 1 -- 172.21.15.72:0/2462964476 learned_addr learned my addr 172.21.15.72:0/2462964476 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:10.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.224+0000 7f0e12ffd700 1 --1- 172.21.15.72:0/2462964476 >> v1:172.21.15.72:6789/0 conn(0x7f0e140c25e0 0x7f0e14065470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57772/0 (socket says 172.21.15.72:57772) 2023-08-31T19:06:10.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.224+0000 7f0e13fff700 1 -- 172.21.15.72:0/2462964476 >> v1:172.21.15.146:6789/0 conn(0x7f0e14154370 legacy=0x7f0e14062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:10.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.224+0000 7f0e13fff700 1 -- 172.21.15.72:0/2462964476 >> v1:172.21.15.72:6789/0 conn(0x7f0e140c25e0 legacy=0x7f0e14065470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.224+0000 7f0e13fff700 1 -- 172.21.15.72:0/2462964476 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e14158260 con 0x7f0e14066d30 2023-08-31T19:06:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.225+0000 7f0e13fff700 1 --2- 172.21.15.72:0/2462964476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e14066d30 0x7f0e140c8350 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f0e0c009f20 tx=0x7f0e0c009840).ready entity=mon.0 client_cookie=d5cc6e7669a1fd8c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.225+0000 7f0e127fc700 1 -- 172.21.15.72:0/2462964476 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c00e070 con 0x7f0e14066d30 2023-08-31T19:06:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.225+0000 7f0e127fc700 1 -- 172.21.15.72:0/2462964476 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c00ba40 con 0x7f0e14066d30 2023-08-31T19:06:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.225+0000 7f0e127fc700 1 -- 172.21.15.72:0/2462964476 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c00bdc0 con 0x7f0e14066d30 2023-08-31T19:06:10.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.225+0000 7f0e19bff700 1 -- 172.21.15.72:0/2462964476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e14066d30 msgr2=0x7f0e140c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:10.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.225+0000 7f0e19bff700 1 --2- 172.21.15.72:0/2462964476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e14066d30 0x7f0e140c8350 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f0e0c009f20 tx=0x7f0e0c009840).stop 2023-08-31T19:06:10.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.225+0000 7f0e19bff700 1 -- 172.21.15.72:0/2462964476 shutdown_connections 2023-08-31T19:06:10.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.225+0000 7f0e19bff700 1 --2- 172.21.15.72:0/2462964476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e14066d30 0x7f0e140c8350 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:10.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.225+0000 7f0e19bff700 1 -- 172.21.15.72:0/2462964476 >> 172.21.15.72:0/2462964476 conn(0x7f0e14064230 msgr2=0x7f0e140c7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:10.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.225+0000 7f0e19bff700 1 -- 172.21.15.72:0/2462964476 shutdown_connections 2023-08-31T19:06:10.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.225+0000 7f0e19bff700 1 -- 172.21.15.72:0/2462964476 wait complete. 2023-08-31T19:06:10.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.227+0000 7f0e19bff700 1 Processor -- start 2023-08-31T19:06:10.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.227+0000 7f0e19bff700 1 -- start start 2023-08-31T19:06:10.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.228+0000 7f0e19bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e14066d30 0x7f0e140bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:10.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.228+0000 7f0e19bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e14154370 0x7f0e140c0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:10.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.228+0000 7f0e19bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e140a9810 0x7f0e140a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:10.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.228+0000 7f0e19bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e140aa180 con 0x7f0e14154370 2023-08-31T19:06:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.228+0000 7f0e19bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e140aa3d0 con 0x7f0e14066d30 2023-08-31T19:06:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.228+0000 7f0e19bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e140a8a10 con 0x7f0e140a9810 2023-08-31T19:06:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.228+0000 7f0e12ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e14154370 0x7f0e140c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.228+0000 7f0e12ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e14154370 0x7f0e140c0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48252/0 (socket says 172.21.15.72:48252) 2023-08-31T19:06:10.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.228+0000 7f0e12ffd700 1 -- 172.21.15.72:0/2525623770 learned_addr learned my addr 172.21.15.72:0/2525623770 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:10.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.228+0000 7f0e13fff700 1 --2- 172.21.15.72:0/2525623770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e140a9810 0x7f0e140a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:10.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.228+0000 7f0e137fe700 1 --2- 172.21.15.72:0/2525623770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e14066d30 0x7f0e140bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:10.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.228+0000 7f0e12ffd700 1 -- 172.21.15.72:0/2525623770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e140a9810 msgr2=0x7f0e140a9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.229+0000 7f0e12ffd700 1 --2- 172.21.15.72:0/2525623770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e140a9810 0x7f0e140a9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.229+0000 7f0e12ffd700 1 -- 172.21.15.72:0/2525623770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e14066d30 msgr2=0x7f0e140bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.229+0000 7f0e12ffd700 1 --2- 172.21.15.72:0/2525623770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e14066d30 0x7f0e140bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.229+0000 7f0e12ffd700 1 -- 172.21.15.72:0/2525623770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c009ae0 con 0x7f0e14154370 2023-08-31T19:06:10.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.229+0000 7f0e12ffd700 1 --2- 172.21.15.72:0/2525623770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e14154370 0x7f0e140c0170 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f0e0800c4f0 tx=0x7f0e08007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:10.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.229+0000 7f0dfb7fe700 1 -- 172.21.15.72:0/2525623770 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e080072e0 con 0x7f0e14154370 2023-08-31T19:06:10.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.229+0000 7f0dfb7fe700 1 -- 172.21.15.72:0/2525623770 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e08007440 con 0x7f0e14154370 2023-08-31T19:06:10.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.229+0000 7f0dfb7fe700 1 -- 172.21.15.72:0/2525623770 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e080058f0 con 0x7f0e14154370 2023-08-31T19:06:10.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.229+0000 7f0e19bff700 1 -- 172.21.15.72:0/2525623770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e140aad70 con 0x7f0e14154370 2023-08-31T19:06:10.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.229+0000 7f0e19bff700 1 -- 172.21.15.72:0/2525623770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e140ab330 con 0x7f0e14154370 2023-08-31T19:06:10.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.230+0000 7f0e19bff700 1 -- 172.21.15.72:0/2525623770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1406c6b0 con 0x7f0e14154370 2023-08-31T19:06:10.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.231+0000 7f0dfb7fe700 1 -- 172.21.15.72:0/2525623770 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0e08005d20 con 0x7f0e14154370 2023-08-31T19:06:10.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.231+0000 7f0dfb7fe700 1 --2- 172.21.15.72:0/2525623770 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0e0005ef30 0x7f0e000613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:10.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.232+0000 7f0dfb7fe700 1 -- 172.21.15.72:0/2525623770 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6471+0+0 (secure 0 0 0) 0x7f0e08079870 con 0x7f0e14154370 2023-08-31T19:06:10.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.232+0000 7f0e137fe700 1 --2- 172.21.15.72:0/2525623770 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0e0005ef30 0x7f0e000613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:10.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.232+0000 7f0e137fe700 1 --2- 172.21.15.72:0/2525623770 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0e0005ef30 0x7f0e000613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f0e0400b7f0 tx=0x7f0e04008040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:10.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.235+0000 7f0dfb7fe700 1 -- 172.21.15.72:0/2525623770 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0e0804a940 con 0x7f0e14154370 2023-08-31T19:06:10.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:10.423+0000 7f0e19bff700 1 -- 172.21.15.72:0/2525623770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0e14158540 con 0x7f0e14154370 2023-08-31T19:06:11.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.293+0000 7f0dfb7fe700 1 -- 172.21.15.72:0/2525623770 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v122) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0e08018020 con 0x7f0e14154370 2023-08-31T19:06:11.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.296+0000 7f0e19bff700 1 -- 172.21.15.72:0/2525623770 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0e0005ef30 msgr2=0x7f0e000613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:11.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.296+0000 7f0e19bff700 1 --2- 172.21.15.72:0/2525623770 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0e0005ef30 0x7f0e000613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f0e0400b7f0 tx=0x7f0e04008040).stop 2023-08-31T19:06:11.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.296+0000 7f0e19bff700 1 -- 172.21.15.72:0/2525623770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e14154370 msgr2=0x7f0e140c0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:11.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.296+0000 7f0e19bff700 1 --2- 172.21.15.72:0/2525623770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e14154370 0x7f0e140c0170 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f0e0800c4f0 tx=0x7f0e08007dc0).stop 2023-08-31T19:06:11.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.296+0000 7f0e19bff700 1 -- 172.21.15.72:0/2525623770 shutdown_connections 2023-08-31T19:06:11.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.296+0000 7f0e19bff700 1 --2- 172.21.15.72:0/2525623770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0e140a9810 0x7f0e140a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:11.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.296+0000 7f0e19bff700 1 --2- 172.21.15.72:0/2525623770 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f0e0005ef30 0x7f0e000613f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:11.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.296+0000 7f0e19bff700 1 --2- 172.21.15.72:0/2525623770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e14066d30 0x7f0e140bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:11.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.296+0000 7f0e19bff700 1 --2- 172.21.15.72:0/2525623770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e14154370 0x7f0e140c0170 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:11.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.296+0000 7f0e19bff700 1 -- 172.21.15.72:0/2525623770 >> 172.21.15.72:0/2525623770 conn(0x7f0e14064230 msgr2=0x7f0e14062650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:11.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.297+0000 7f0e19bff700 1 -- 172.21.15.72:0/2525623770 shutdown_connections 2023-08-31T19:06:11.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.297+0000 7f0e19bff700 1 -- 172.21.15.72:0/2525623770 wait complete. 2023-08-31T19:06:11.299 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-08-31T19:06:11.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-31T19:06:11.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.511+0000 7fca15bff700 1 Processor -- start 2023-08-31T19:06:11.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.511+0000 7fca15bff700 1 -- start start 2023-08-31T19:06:11.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.512+0000 7fca15bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca100a9eb0 0x7fca100aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:11.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.512+0000 7fca15bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca101576d0 0x7fca100c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:11.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.512+0000 7fca15bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca100bfd00 con 0x7fca100c5bf0 2023-08-31T19:06:11.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.512+0000 7fca15bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca100c05a0 con 0x7fca100a9eb0 2023-08-31T19:06:11.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.512+0000 7fca15bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca100aaea0 con 0x7fca101576d0 2023-08-31T19:06:11.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.512+0000 7fca0f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca100a9eb0 0x7fca100aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:11.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.512+0000 7fca0effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fca100c5bf0 0x7fca10156fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57780/0 (socket says 172.21.15.72:57780) 2023-08-31T19:06:11.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.512+0000 7fca0effd700 1 -- 172.21.15.72:0/4272838996 learned_addr learned my addr 172.21.15.72:0/4272838996 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:11.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.513+0000 7fca0ffff700 1 --2- 172.21.15.72:0/4272838996 >> v2:172.21.15.146:3300/0 conn(0x7fca101576d0 0x7fca100c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:11.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.513+0000 7fca0f7fe700 1 -- 172.21.15.72:0/4272838996 >> v2:172.21.15.146:3300/0 conn(0x7fca101576d0 msgr2=0x7fca100c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:11.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.513+0000 7fca0f7fe700 1 --2- 172.21.15.72:0/4272838996 >> v2:172.21.15.146:3300/0 conn(0x7fca101576d0 0x7fca100c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:11.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.513+0000 7fca0f7fe700 1 -- 172.21.15.72:0/4272838996 >> v1:172.21.15.72:6789/0 conn(0x7fca100c5bf0 legacy=0x7fca10156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:11.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.513+0000 7fca0f7fe700 1 -- 172.21.15.72:0/4272838996 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca100c6670 con 0x7fca100a9eb0 2023-08-31T19:06:11.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.513+0000 7fca0f7fe700 1 --2- 172.21.15.72:0/4272838996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca100a9eb0 0x7fca100aa290 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fca00009760 tx=0x7fca00009060).ready entity=mon.0 client_cookie=fddf3f239fdb82f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:11.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.513+0000 7fca0e7fc700 1 -- 172.21.15.72:0/4272838996 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0000b520 con 0x7fca100a9eb0 2023-08-31T19:06:11.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.513+0000 7fca0e7fc700 1 -- 172.21.15.72:0/4272838996 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0000b680 con 0x7fca100a9eb0 2023-08-31T19:06:11.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.513+0000 7fca0e7fc700 1 -- 172.21.15.72:0/4272838996 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0000ba00 con 0x7fca100a9eb0 2023-08-31T19:06:11.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.514+0000 7fca15bff700 1 -- 172.21.15.72:0/4272838996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca100a9eb0 msgr2=0x7fca100aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:11.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.514+0000 7fca15bff700 1 --2- 172.21.15.72:0/4272838996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca100a9eb0 0x7fca100aa290 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fca00009760 tx=0x7fca00009060).stop 2023-08-31T19:06:11.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.514+0000 7fca15bff700 1 -- 172.21.15.72:0/4272838996 shutdown_connections 2023-08-31T19:06:11.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.514+0000 7fca15bff700 1 --2- 172.21.15.72:0/4272838996 >> v2:172.21.15.146:3300/0 conn(0x7fca101576d0 0x7fca100c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:11.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.514+0000 7fca15bff700 1 --2- 172.21.15.72:0/4272838996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca100a9eb0 0x7fca100aa290 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:11.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.514+0000 7fca15bff700 1 -- 172.21.15.72:0/4272838996 >> 172.21.15.72:0/4272838996 conn(0x7fca100c82e0 msgr2=0x7fca1005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:11.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.514+0000 7fca15bff700 1 -- 172.21.15.72:0/4272838996 shutdown_connections 2023-08-31T19:06:11.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.514+0000 7fca15bff700 1 -- 172.21.15.72:0/4272838996 wait complete. 2023-08-31T19:06:11.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.516+0000 7fca15bff700 1 Processor -- start 2023-08-31T19:06:11.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.516+0000 7fca15bff700 1 -- start start 2023-08-31T19:06:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca15bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca100a9eb0 0x7fca1014c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca15bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca100c5bf0 0x7fca101488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca15bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca101576d0 0x7fca100ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca15bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1014b3a0 con 0x7fca100a9eb0 2023-08-31T19:06:11.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca15bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1014c1e0 con 0x7fca100c5bf0 2023-08-31T19:06:11.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca15bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1014b5d0 con 0x7fca101576d0 2023-08-31T19:06:11.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca0f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca100a9eb0 0x7fca1014c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:11.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca0f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca100a9eb0 0x7fca1014c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48272/0 (socket says 172.21.15.72:48272) 2023-08-31T19:06:11.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca0f7fe700 1 -- 172.21.15.72:0/4177858918 learned_addr learned my addr 172.21.15.72:0/4177858918 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca0effd700 1 --2- 172.21.15.72:0/4177858918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca100c5bf0 0x7fca101488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca0ffff700 1 --2- 172.21.15.72:0/4177858918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca101576d0 0x7fca100ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca0f7fe700 1 -- 172.21.15.72:0/4177858918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca101576d0 msgr2=0x7fca100ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca0f7fe700 1 --2- 172.21.15.72:0/4177858918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca101576d0 0x7fca100ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca0f7fe700 1 -- 172.21.15.72:0/4177858918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca100c5bf0 msgr2=0x7fca101488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca0f7fe700 1 --2- 172.21.15.72:0/4177858918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca100c5bf0 0x7fca101488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca0f7fe700 1 -- 172.21.15.72:0/4177858918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca000092a0 con 0x7fca100a9eb0 2023-08-31T19:06:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca0ffff700 1 --2- 172.21.15.72:0/4177858918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca101576d0 0x7fca100ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.518+0000 7fca0f7fe700 1 --2- 172.21.15.72:0/4177858918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca100a9eb0 0x7fca1014c670 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fca00009eb0 tx=0x7fca00017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.519+0000 7fc9f77fe700 1 -- 172.21.15.72:0/4177858918 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0000b7f0 con 0x7fca100a9eb0 2023-08-31T19:06:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.519+0000 7fc9f77fe700 1 -- 172.21.15.72:0/4177858918 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0000b950 con 0x7fca100a9eb0 2023-08-31T19:06:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.519+0000 7fca15bff700 1 -- 172.21.15.72:0/4177858918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1014b8b0 con 0x7fca100a9eb0 2023-08-31T19:06:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.519+0000 7fc9f77fe700 1 -- 172.21.15.72:0/4177858918 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0001b690 con 0x7fca100a9eb0 2023-08-31T19:06:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.519+0000 7fca15bff700 1 -- 172.21.15.72:0/4177858918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1014be70 con 0x7fca100a9eb0 2023-08-31T19:06:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.520+0000 7fca15bff700 1 -- 172.21.15.72:0/4177858918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1006c6b0 con 0x7fca100a9eb0 2023-08-31T19:06:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.521+0000 7fc9f77fe700 1 -- 172.21.15.72:0/4177858918 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fca0001ba40 con 0x7fca100a9eb0 2023-08-31T19:06:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.521+0000 7fc9f77fe700 1 --2- 172.21.15.72:0/4177858918 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc9fc05ef30 0x7fc9fc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.522+0000 7fc9f77fe700 1 -- 172.21.15.72:0/4177858918 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5869+0+0 (secure 0 0 0) 0x7fca0007b850 con 0x7fca100a9eb0 2023-08-31T19:06:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.522+0000 7fca0effd700 1 --2- 172.21.15.72:0/4177858918 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc9fc05ef30 0x7fc9fc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.522+0000 7fca0effd700 1 --2- 172.21.15.72:0/4177858918 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc9fc05ef30 0x7fc9fc0613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fca100c5100 tx=0x7fca04009040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.526+0000 7fc9f77fe700 1 -- 172.21.15.72:0/4177858918 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fca0004ccf0 con 0x7fca100a9eb0 2023-08-31T19:06:11.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.758+0000 7fca15bff700 1 -- 172.21.15.72:0/4177858918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fca100655b0 con 0x7fca100a9eb0 2023-08-31T19:06:11.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.759+0000 7fc9f77fe700 1 -- 172.21.15.72:0/4177858918 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fca00050310 con 0x7fca100a9eb0 2023-08-31T19:06:11.759 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:06:11.760 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:06:11.760 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-08-31T19:06:11.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.760 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-08-31T19:06:11.760 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkPeqvDBAAA2eEr6xr7iF5PPNT9eehSg==", 2023-08-31T19:06:11.761 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.761 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:06:11.761 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:06:11.761 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:06:11.761 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:06:11.762 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.762 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-08-31T19:06:11.763 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkctxUIxAAufSVXMwPzPA7Gq1s4ukXiQ==", 2023-08-31T19:06:11.763 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.763 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:06:11.763 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:06:11.763 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:06:11.764 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:06:11.764 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.765 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-08-31T19:06:11.765 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkcpLfFxAASIB//h8whjuh6s3YKBVffQ==", 2023-08-31T19:06:11.765 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.765 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:06:11.765 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:06:11.766 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:06:11.766 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:06:11.766 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.767 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-08-31T19:06:11.767 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkC1bbLhAAg/0wct2P0+cyWbZyI2bP/g==", 2023-08-31T19:06:11.767 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.767 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:06:11.767 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:06:11.767 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:06:11.768 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:06:11.768 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.768 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-08-31T19:06:11.769 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAi4PBkvfRJEBAAYQqPldOXrJxXAXnmZhXaBQ==", 2023-08-31T19:06:11.769 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.769 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:06:11.769 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:06:11.769 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:06:11.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.770 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-08-31T19:06:11.771 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAl4PBkYysSIhAA4nCmskcGV+i4vpH2k/gDBg==", 2023-08-31T19:06:11.771 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.771 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:06:11.771 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:06:11.771 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:06:11.771 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.772 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-08-31T19:06:11.772 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAp4PBkyDgJFxAAPynEKk15yN7+OxQxpzL0UQ==", 2023-08-31T19:06:11.772 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.773 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:06:11.773 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:06:11.773 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:06:11.773 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.774 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-08-31T19:06:11.774 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAs4PBkZMD2KBAAoJrO4YjJ4/8MjcPAtgEn1g==", 2023-08-31T19:06:11.774 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.774 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:06:11.774 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:06:11.775 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:06:11.775 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.775 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-08-31T19:06:11.776 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAz4PBkSgAoExAAJ95kdHV47jDTXSj/WSCiLw==", 2023-08-31T19:06:11.776 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.776 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:06:11.776 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:06:11.776 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:06:11.777 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.777 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-08-31T19:06:11.777 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA24PBkUxpLKBAAAu8d6iKME6wW+Q/6hhFIRQ==", 2023-08-31T19:06:11.778 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.778 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:06:11.778 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:06:11.778 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:06:11.778 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.779 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-08-31T19:06:11.779 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA54PBkURHJOhAA3HaPfENVQ4hLIjc/esF0bQ==", 2023-08-31T19:06:11.779 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.780 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:06:11.780 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:06:11.780 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:06:11.780 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.781 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-08-31T19:06:11.781 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA94PBkfoqTEBAAQHENgrp5tv1X47Br/dUksQ==", 2023-08-31T19:06:11.781 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.781 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:06:11.781 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:06:11.782 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:06:11.782 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.783 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-08-31T19:06:11.783 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkucWuOBAABLowlGxpCR3GgoOCRmC0FQ==", 2023-08-31T19:06:11.783 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.783 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:06:11.784 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow r", 2023-08-31T19:06:11.784 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-31T19:06:11.784 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.785 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-08-31T19:06:11.785 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkVGBPCxAAO4M9u24/yH0xwtV6oSz+JQ==", 2023-08-31T19:06:11.785 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.785 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:06:11.786 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:06:11.786 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:06:11.786 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:06:11.786 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.787 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.2", 2023-08-31T19:06:11.787 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkYeIoBBAAjoIzJJ9McIx3rLBSaorTKA==", 2023-08-31T19:06:11.787 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.787 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:06:11.787 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:06:11.788 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:06:11.788 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:06:11.788 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.789 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.3", 2023-08-31T19:06:11.789 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkX/V9EhAAqWuBMMhikN/JUQp3v5/ABQ==", 2023-08-31T19:06:11.789 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.789 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:06:11.789 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:06:11.789 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:06:11.790 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:06:11.790 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.790 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-08-31T19:06:11.791 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkCRlhDhAAxvcGr+KTvLoJmtuZC89Iuw==", 2023-08-31T19:06:11.791 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.791 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:06:11.791 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:06:11.791 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:06:11.791 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:06:11.792 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.792 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-08-31T19:06:11.792 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkiGBUBRAAwWTFqrz+ELBSwb0Z2T9yhQ==", 2023-08-31T19:06:11.793 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.793 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:06:11.793 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:06:11.793 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:06:11.793 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:11.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:11.794 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-08-31T19:06:11.794 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkSWszNRAAdBxrfMEuBRgePfaiPx6kpQ==", 2023-08-31T19:06:11.794 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:06:11.794 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:06:11.795 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:06:11.795 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:06:11.795 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.795 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:11.795 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-08-31T19:06:11.796 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:06:11.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.761+0000 7fca15bff700 1 -- 172.21.15.72:0/4177858918 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc9fc05ef30 msgr2=0x7fc9fc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:11.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.761+0000 7fca15bff700 1 --2- 172.21.15.72:0/4177858918 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc9fc05ef30 0x7fc9fc0613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fca100c5100 tx=0x7fca04009040).stop 2023-08-31T19:06:11.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.761+0000 7fca15bff700 1 -- 172.21.15.72:0/4177858918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca100a9eb0 msgr2=0x7fca1014c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:11.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.761+0000 7fca15bff700 1 --2- 172.21.15.72:0/4177858918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca100a9eb0 0x7fca1014c670 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fca00009eb0 tx=0x7fca00017000).stop 2023-08-31T19:06:11.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.761+0000 7fca15bff700 1 -- 172.21.15.72:0/4177858918 shutdown_connections 2023-08-31T19:06:11.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.761+0000 7fca15bff700 1 --2- 172.21.15.72:0/4177858918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca101576d0 0x7fca100ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:11.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.761+0000 7fca15bff700 1 --2- 172.21.15.72:0/4177858918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca100a9eb0 0x7fca1014c670 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:11.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.761+0000 7fca15bff700 1 --2- 172.21.15.72:0/4177858918 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc9fc05ef30 0x7fc9fc0613f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:11.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.761+0000 7fca15bff700 1 --2- 172.21.15.72:0/4177858918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca100c5bf0 0x7fca101488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:11.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.761+0000 7fca15bff700 1 -- 172.21.15.72:0/4177858918 >> 172.21.15.72:0/4177858918 conn(0x7fca100c82e0 msgr2=0x7fca100c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:11.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.761+0000 7fca15bff700 1 -- 172.21.15.72:0/4177858918 shutdown_connections 2023-08-31T19:06:11.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.761+0000 7fca15bff700 1 -- 172.21.15.72:0/4177858918 wait complete. 2023-08-31T19:06:11.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:06:11.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.989+0000 7f1b103ff700 1 Processor -- start 2023-08-31T19:06:11.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.990+0000 7f1b103ff700 1 -- start start 2023-08-31T19:06:11.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.991+0000 7f1b103ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b08069170 0x7f1b080c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:11.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.991+0000 7f1b103ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b08065710 0x7f1b08069c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:11.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.991+0000 7f1b103ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b08064270 con 0x7f1b0806a260 2023-08-31T19:06:11.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.991+0000 7f1b103ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b080bca40 con 0x7f1b08065710 2023-08-31T19:06:11.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.991+0000 7f1b103ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080bcc20 con 0x7f1b08069170 2023-08-31T19:06:11.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.991+0000 7f1b0e99c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b08065710 0x7f1b08069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:11.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.991+0000 7f1b0e99c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b08065710 0x7f1b08069c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48288/0 (socket says 172.21.15.72:48288) 2023-08-31T19:06:11.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.991+0000 7f1b0e99c700 1 -- 172.21.15.72:0/581156125 learned_addr learned my addr 172.21.15.72:0/581156125 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:11.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.991+0000 7f1b0e19b700 1 --2- 172.21.15.72:0/581156125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b08069170 0x7f1b080c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:11.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.992+0000 7f1b0e99c700 1 -- 172.21.15.72:0/581156125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b08069170 msgr2=0x7f1b080c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:11.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.992+0000 7f1b0e99c700 1 --2- 172.21.15.72:0/581156125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b08069170 0x7f1b080c2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:11.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.992+0000 7f1b0e99c700 1 -- 172.21.15.72:0/581156125 >> v1:172.21.15.146:6789/0 conn(0x7f1b0806a260 legacy=0x7f1b08069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:11.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.992+0000 7f1b0e99c700 1 -- 172.21.15.72:0/581156125 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b08154890 con 0x7f1b08065710 2023-08-31T19:06:11.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.992+0000 7f1b0e19b700 1 --2- 172.21.15.72:0/581156125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b08069170 0x7f1b080c2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:11.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.992+0000 7f1b0e99c700 1 --2- 172.21.15.72:0/581156125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b08065710 0x7f1b08069c60 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f1b00009f20 tx=0x7f1b00009840).ready entity=mon.0 client_cookie=a0488b53f446b23c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.992+0000 7f1b0d199700 1 -- 172.21.15.72:0/581156125 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0000e070 con 0x7f1b08065710 2023-08-31T19:06:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.992+0000 7f1b0d199700 1 -- 172.21.15.72:0/581156125 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0000ba80 con 0x7f1b08065710 2023-08-31T19:06:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.992+0000 7f1b0d199700 1 -- 172.21.15.72:0/581156125 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0000be00 con 0x7f1b08065710 2023-08-31T19:06:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.993+0000 7f1b103ff700 1 -- 172.21.15.72:0/581156125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b08065710 msgr2=0x7f1b08069c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.993+0000 7f1b103ff700 1 --2- 172.21.15.72:0/581156125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b08065710 0x7f1b08069c60 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f1b00009f20 tx=0x7f1b00009840).stop 2023-08-31T19:06:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.993+0000 7f1b103ff700 1 -- 172.21.15.72:0/581156125 shutdown_connections 2023-08-31T19:06:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.993+0000 7f1b103ff700 1 --2- 172.21.15.72:0/581156125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b08069170 0x7f1b080c2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.993+0000 7f1b103ff700 1 --2- 172.21.15.72:0/581156125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b08065710 0x7f1b08069c60 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.993+0000 7f1b103ff700 1 -- 172.21.15.72:0/581156125 >> 172.21.15.72:0/581156125 conn(0x7f1b080c6b10 msgr2=0x7f1b080c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.993+0000 7f1b103ff700 1 -- 172.21.15.72:0/581156125 shutdown_connections 2023-08-31T19:06:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.993+0000 7f1b103ff700 1 -- 172.21.15.72:0/581156125 wait complete. 2023-08-31T19:06:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.994+0000 7f1b103ff700 1 Processor -- start 2023-08-31T19:06:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.994+0000 7f1b103ff700 1 -- start start 2023-08-31T19:06:12.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.995+0000 7f1b103ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b08065710 0x7f1b080a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.995+0000 7f1b103ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b08069170 0x7f1b08142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.995+0000 7f1b103ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b0806a260 0x7f1b080abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.995+0000 7f1b103ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080a52a0 con 0x7f1b0806a260 2023-08-31T19:06:12.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.995+0000 7f1b103ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080a95b0 con 0x7f1b08065710 2023-08-31T19:06:12.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.995+0000 7f1b103ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080a4970 con 0x7f1b08069170 2023-08-31T19:06:12.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.996+0000 7f1b0e99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b0806a260 0x7f1b080abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.996+0000 7f1b0e99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b0806a260 0x7f1b080abca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48294/0 (socket says 172.21.15.72:48294) 2023-08-31T19:06:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.996+0000 7f1b0e99c700 1 -- 172.21.15.72:0/3626335496 learned_addr learned my addr 172.21.15.72:0/3626335496 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.996+0000 7f1b0e19b700 1 --2- 172.21.15.72:0/3626335496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b08065710 0x7f1b080a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.996+0000 7f1b0d99a700 1 --2- 172.21.15.72:0/3626335496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b08069170 0x7f1b08142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.996+0000 7f1b0e99c700 1 -- 172.21.15.72:0/3626335496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b08069170 msgr2=0x7f1b08142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.996+0000 7f1b0e99c700 1 --2- 172.21.15.72:0/3626335496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b08069170 0x7f1b08142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.996+0000 7f1b0e99c700 1 -- 172.21.15.72:0/3626335496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b08065710 msgr2=0x7f1b080a8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.996+0000 7f1b0e99c700 1 --2- 172.21.15.72:0/3626335496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b08065710 0x7f1b080a8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.996+0000 7f1b0e99c700 1 -- 172.21.15.72:0/3626335496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b00009ae0 con 0x7f1b0806a260 2023-08-31T19:06:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.996+0000 7f1b0e99c700 1 --2- 172.21.15.72:0/3626335496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b0806a260 0x7f1b080abca0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f1b08067940 tx=0x7f1b080c7630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.997+0000 7f1afe7fc700 1 -- 172.21.15.72:0/3626335496 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00013e30 con 0x7f1b0806a260 2023-08-31T19:06:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.997+0000 7f1afe7fc700 1 -- 172.21.15.72:0/3626335496 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0001e470 con 0x7f1b0806a260 2023-08-31T19:06:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.997+0000 7f1afe7fc700 1 -- 172.21.15.72:0/3626335496 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0001e830 con 0x7f1b0806a260 2023-08-31T19:06:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.997+0000 7f1b103ff700 1 -- 172.21.15.72:0/3626335496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b080a4c50 con 0x7f1b0806a260 2023-08-31T19:06:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.997+0000 7f1b103ff700 1 -- 172.21.15.72:0/3626335496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b08147a80 con 0x7f1b0806a260 2023-08-31T19:06:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.998+0000 7f1b103ff700 1 -- 172.21.15.72:0/3626335496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0806c6b0 con 0x7f1b0806a260 2023-08-31T19:06:12.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.999+0000 7f1afe7fc700 1 -- 172.21.15.72:0/3626335496 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f1b00003040 con 0x7f1b0806a260 2023-08-31T19:06:12.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.999+0000 7f1afe7fc700 1 --2- 172.21.15.72:0/3626335496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1aec05ef30 0x7f1aec0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:11.999+0000 7f1afe7fc700 1 -- 172.21.15.72:0/3626335496 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f1b0007b3e0 con 0x7f1b0806a260 2023-08-31T19:06:12.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.000+0000 7f1b0e19b700 1 --2- 172.21.15.72:0/3626335496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1aec05ef30 0x7f1aec0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.000+0000 7f1b0e19b700 1 --2- 172.21.15.72:0/3626335496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1aec05ef30 0x7f1aec0613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1b0400abd0 tx=0x7f1b04008040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:12.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.004+0000 7f1afe7fc700 1 -- 172.21.15.72:0/3626335496 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1b0004c880 con 0x7f1b0806a260 2023-08-31T19:06:12.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.176+0000 7f1b103ff700 1 -- 172.21.15.72:0/3626335496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b080bcec0 con 0x7f1b0806a260 2023-08-31T19:06:12.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.178+0000 7f1afe7fc700 1 -- 172.21.15.72:0/3626335496 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+14726 (secure 0 0 0) 0x7f1b00023020 con 0x7f1b0806a260 2023-08-31T19:06:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:06:12.178 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":122,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:06:11.288010+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:06:12.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.180+0000 7f1b103ff700 1 -- 172.21.15.72:0/3626335496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1aec05ef30 msgr2=0x7f1aec0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.180+0000 7f1b103ff700 1 --2- 172.21.15.72:0/3626335496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1aec05ef30 0x7f1aec0613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1b0400abd0 tx=0x7f1b04008040).stop 2023-08-31T19:06:12.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.180+0000 7f1b103ff700 1 -- 172.21.15.72:0/3626335496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b0806a260 msgr2=0x7f1b080abca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.180+0000 7f1b103ff700 1 --2- 172.21.15.72:0/3626335496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b0806a260 0x7f1b080abca0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f1b08067940 tx=0x7f1b080c7630).stop 2023-08-31T19:06:12.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.180+0000 7f1b103ff700 1 -- 172.21.15.72:0/3626335496 shutdown_connections 2023-08-31T19:06:12.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.180+0000 7f1b103ff700 1 --2- 172.21.15.72:0/3626335496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b0806a260 0x7f1b080abca0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.180+0000 7f1b103ff700 1 --2- 172.21.15.72:0/3626335496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1aec05ef30 0x7f1aec0613f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.180+0000 7f1b103ff700 1 --2- 172.21.15.72:0/3626335496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b08065710 0x7f1b080a8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.180+0000 7f1b103ff700 1 --2- 172.21.15.72:0/3626335496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b08069170 0x7f1b08142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.180+0000 7f1b103ff700 1 -- 172.21.15.72:0/3626335496 >> 172.21.15.72:0/3626335496 conn(0x7f1b080c6b10 msgr2=0x7f1b080c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.180+0000 7f1b103ff700 1 -- 172.21.15.72:0/3626335496 shutdown_connections 2023-08-31T19:06:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.180+0000 7f1b103ff700 1 -- 172.21.15.72:0/3626335496 wait complete. 2023-08-31T19:06:12.198 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-31T19:06:12.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:06:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.392+0000 7f7f9f5ff700 1 Processor -- start 2023-08-31T19:06:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.392+0000 7f7f9f5ff700 1 -- start start 2023-08-31T19:06:12.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.393+0000 7f7f9f5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f981544e0 0x7f7f9805e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.393+0000 7f7f9f5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f980690e0 0x7f7f980bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.394+0000 7f7f9f5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f980bc4a0 con 0x7f7f980c38d0 2023-08-31T19:06:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.394+0000 7f7f9f5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f9805e840 con 0x7f7f980690e0 2023-08-31T19:06:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.394+0000 7f7f9f5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f98069c40 con 0x7f7f981544e0 2023-08-31T19:06:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.394+0000 7f7f9d39b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f981544e0 0x7f7f9805e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.394+0000 7f7f9d39b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f981544e0 0x7f7f9805e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:36560/0 (socket says 172.21.15.72:36560) 2023-08-31T19:06:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.394+0000 7f7f9d39b700 1 -- 172.21.15.72:0/4125391941 learned_addr learned my addr 172.21.15.72:0/4125391941 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.394+0000 7f7f9db9c700 1 --2- 172.21.15.72:0/4125391941 >> v2:172.21.15.146:3300/0 conn(0x7f7f980690e0 0x7f7f980bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.394+0000 7f7f9cb9a700 1 --1- 172.21.15.72:0/4125391941 >> v1:172.21.15.146:6789/0 conn(0x7f7f980c38d0 0x7f7f980689d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:51074/0 (socket says 172.21.15.72:51074) 2023-08-31T19:06:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.394+0000 7f7f9d39b700 1 -- 172.21.15.72:0/4125391941 >> v2:172.21.15.146:3300/0 conn(0x7f7f980690e0 msgr2=0x7f7f980bc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.394+0000 7f7f9d39b700 1 --2- 172.21.15.72:0/4125391941 >> v2:172.21.15.146:3300/0 conn(0x7f7f980690e0 0x7f7f980bc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.394+0000 7f7f9d39b700 1 -- 172.21.15.72:0/4125391941 >> v1:172.21.15.146:6789/0 conn(0x7f7f980c38d0 legacy=0x7f7f980689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.394+0000 7f7f9d39b700 1 -- 172.21.15.72:0/4125391941 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f980c1c30 con 0x7f7f981544e0 2023-08-31T19:06:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.395+0000 7f7f9d39b700 1 --2- 172.21.15.72:0/4125391941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f981544e0 0x7f7f9805e350 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f7f94006fd0 tx=0x7f7f940090f0).ready entity=mon.2 client_cookie=73627b48bf8fbcb4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.395+0000 7f7f8ffff700 1 -- 172.21.15.72:0/4125391941 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9400b580 con 0x7f7f981544e0 2023-08-31T19:06:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.395+0000 7f7f8ffff700 1 -- 172.21.15.72:0/4125391941 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9400b6e0 con 0x7f7f981544e0 2023-08-31T19:06:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.395+0000 7f7f8ffff700 1 -- 172.21.15.72:0/4125391941 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9400ba60 con 0x7f7f981544e0 2023-08-31T19:06:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.395+0000 7f7f9f5ff700 1 -- 172.21.15.72:0/4125391941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f981544e0 msgr2=0x7f7f9805e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.395+0000 7f7f9f5ff700 1 --2- 172.21.15.72:0/4125391941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f981544e0 0x7f7f9805e350 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f7f94006fd0 tx=0x7f7f940090f0).stop 2023-08-31T19:06:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.396+0000 7f7f9f5ff700 1 -- 172.21.15.72:0/4125391941 shutdown_connections 2023-08-31T19:06:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.396+0000 7f7f9f5ff700 1 --2- 172.21.15.72:0/4125391941 >> v2:172.21.15.146:3300/0 conn(0x7f7f980690e0 0x7f7f980bc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.396+0000 7f7f9f5ff700 1 --2- 172.21.15.72:0/4125391941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f981544e0 0x7f7f9805e350 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.396+0000 7f7f9f5ff700 1 -- 172.21.15.72:0/4125391941 >> 172.21.15.72:0/4125391941 conn(0x7f7f980c7e00 msgr2=0x7f7f980c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.396+0000 7f7f9f5ff700 1 -- 172.21.15.72:0/4125391941 shutdown_connections 2023-08-31T19:06:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.396+0000 7f7f9f5ff700 1 -- 172.21.15.72:0/4125391941 wait complete. 2023-08-31T19:06:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.398+0000 7f7f9f5ff700 1 Processor -- start 2023-08-31T19:06:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.398+0000 7f7f9f5ff700 1 -- start start 2023-08-31T19:06:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.399+0000 7f7f9f5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f980690e0 0x7f7f980be6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.399+0000 7f7f9f5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f980c38d0 0x7f7f980ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.399+0000 7f7f9f5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f981544e0 0x7f7f98150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.399+0000 7f7f9f5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980bf8c0 con 0x7f7f980690e0 2023-08-31T19:06:12.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.399+0000 7f7f9f5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980aca80 con 0x7f7f980c38d0 2023-08-31T19:06:12.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.399+0000 7f7f9f5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980becb0 con 0x7f7f981544e0 2023-08-31T19:06:12.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.399+0000 7f7f9d39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f980690e0 0x7f7f980be6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.399+0000 7f7f9d39b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f980690e0 0x7f7f980be6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48302/0 (socket says 172.21.15.72:48302) 2023-08-31T19:06:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.399+0000 7f7f9d39b700 1 -- 172.21.15.72:0/3062351790 learned_addr learned my addr 172.21.15.72:0/3062351790 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.400+0000 7f7f9db9c700 1 --2- 172.21.15.72:0/3062351790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f981544e0 0x7f7f98150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.400+0000 7f7f9cb9a700 1 --2- 172.21.15.72:0/3062351790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f980c38d0 0x7f7f980ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.400+0000 7f7f9d39b700 1 -- 172.21.15.72:0/3062351790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f981544e0 msgr2=0x7f7f98150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.400+0000 7f7f9d39b700 1 --2- 172.21.15.72:0/3062351790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f981544e0 0x7f7f98150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.400+0000 7f7f9d39b700 1 -- 172.21.15.72:0/3062351790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f980c38d0 msgr2=0x7f7f980ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.400+0000 7f7f9d39b700 1 --2- 172.21.15.72:0/3062351790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f980c38d0 0x7f7f980ac590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.400+0000 7f7f9d39b700 1 -- 172.21.15.72:0/3062351790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f94009370 con 0x7f7f980690e0 2023-08-31T19:06:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.400+0000 7f7f9d39b700 1 --2- 172.21.15.72:0/3062351790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f980690e0 0x7f7f980be6d0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f7f98069d80 tx=0x7f7f94017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.400+0000 7f7f8d7fa700 1 -- 172.21.15.72:0/3062351790 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f94006950 con 0x7f7f980690e0 2023-08-31T19:06:12.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.400+0000 7f7f8d7fa700 1 -- 172.21.15.72:0/3062351790 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9400bea0 con 0x7f7f980690e0 2023-08-31T19:06:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.400+0000 7f7f9f5ff700 1 -- 172.21.15.72:0/3062351790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f980bef90 con 0x7f7f980690e0 2023-08-31T19:06:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.400+0000 7f7f8d7fa700 1 -- 172.21.15.72:0/3062351790 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9400ba60 con 0x7f7f980690e0 2023-08-31T19:06:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.400+0000 7f7f9f5ff700 1 -- 172.21.15.72:0/3062351790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f980bf550 con 0x7f7f980690e0 2023-08-31T19:06:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.401+0000 7f7f9f5ff700 1 -- 172.21.15.72:0/3062351790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f980bf6e0 con 0x7f7f980690e0 2023-08-31T19:06:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.402+0000 7f7f8d7fa700 1 -- 172.21.15.72:0/3062351790 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7f9401c630 con 0x7f7f980690e0 2023-08-31T19:06:12.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.403+0000 7f7f8d7fa700 1 --2- 172.21.15.72:0/3062351790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f7c05ef30 0x7f7f7c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.403+0000 7f7f8d7fa700 1 -- 172.21.15.72:0/3062351790 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f7f9407b950 con 0x7f7f980690e0 2023-08-31T19:06:12.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.403+0000 7f7f9cb9a700 1 --2- 172.21.15.72:0/3062351790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f7c05ef30 0x7f7f7c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.404+0000 7f7f9cb9a700 1 --2- 172.21.15.72:0/3062351790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f7c05ef30 0x7f7f7c0613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f7f980c6cc0 tx=0x7f7f88007bf0).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:12.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.407+0000 7f7f8d7fa700 1 -- 172.21.15.72:0/3062351790 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f9404cd40 con 0x7f7f980690e0 2023-08-31T19:06:12.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.576+0000 7f7f9f5ff700 1 -- 172.21.15.72:0/3062351790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7f9806c6b0 con 0x7f7f980690e0 2023-08-31T19:06:12.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.577+0000 7f7f8d7fa700 1 -- 172.21.15.72:0/3062351790 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v122) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7f94020030 con 0x7f7f980690e0 2023-08-31T19:06:12.577 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:06:12.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.579+0000 7f7f9f5ff700 1 -- 172.21.15.72:0/3062351790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f7c05ef30 msgr2=0x7f7f7c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.579+0000 7f7f9f5ff700 1 --2- 172.21.15.72:0/3062351790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f7c05ef30 0x7f7f7c0613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f7f980c6cc0 tx=0x7f7f88007bf0).stop 2023-08-31T19:06:12.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.579+0000 7f7f9f5ff700 1 -- 172.21.15.72:0/3062351790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f980690e0 msgr2=0x7f7f980be6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.579+0000 7f7f9f5ff700 1 --2- 172.21.15.72:0/3062351790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f980690e0 0x7f7f980be6d0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f7f98069d80 tx=0x7f7f94017000).stop 2023-08-31T19:06:12.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.579+0000 7f7f9f5ff700 1 -- 172.21.15.72:0/3062351790 shutdown_connections 2023-08-31T19:06:12.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.579+0000 7f7f9f5ff700 1 --2- 172.21.15.72:0/3062351790 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f981544e0 0x7f7f98150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.579+0000 7f7f9f5ff700 1 --2- 172.21.15.72:0/3062351790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f980690e0 0x7f7f980be6d0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.579+0000 7f7f9f5ff700 1 --2- 172.21.15.72:0/3062351790 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7f7c05ef30 0x7f7f7c0613f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.579+0000 7f7f9f5ff700 1 --2- 172.21.15.72:0/3062351790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f980c38d0 0x7f7f980ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.579+0000 7f7f9f5ff700 1 -- 172.21.15.72:0/3062351790 >> 172.21.15.72:0/3062351790 conn(0x7f7f980c7e00 msgr2=0x7f7f980bc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:12.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.579+0000 7f7f9f5ff700 1 -- 172.21.15.72:0/3062351790 shutdown_connections 2023-08-31T19:06:12.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.579+0000 7f7f9f5ff700 1 -- 172.21.15.72:0/3062351790 wait complete. 2023-08-31T19:06:12.596 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:06:12.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.788+0000 7fe3b4fff700 1 Processor -- start 2023-08-31T19:06:12.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.788+0000 7fe3b4fff700 1 -- start start 2023-08-31T19:06:12.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.789+0000 7fe3b4fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3b0153e30 0x7fe3b0154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.789+0000 7fe3b4fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3b00c5cb0 0x7fe3b00c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.789+0000 7fe3b4fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b00bfd40 con 0x7fe3b00630b0 2023-08-31T19:06:12.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.789+0000 7fe3b4fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b00c6730 con 0x7fe3b0153e30 2023-08-31T19:06:12.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.789+0000 7fe3b4fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b00bffe0 con 0x7fe3b00c5cb0 2023-08-31T19:06:12.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.790+0000 7fe3add9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3b00c5cb0 0x7fe3b00c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.790+0000 7fe3add9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3b00c5cb0 0x7fe3b00c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:36568/0 (socket says 172.21.15.72:36568) 2023-08-31T19:06:12.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.790+0000 7fe3ae59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3b0153e30 0x7fe3b0154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.790+0000 7fe3add9b700 1 -- 172.21.15.72:0/699671072 learned_addr learned my addr 172.21.15.72:0/699671072 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:12.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.790+0000 7fe3aed9d700 1 --1- 172.21.15.72:0/699671072 >> v1:172.21.15.146:6789/0 conn(0x7fe3b00630b0 0x7fe3b0157d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:51088/0 (socket says 172.21.15.72:51088) 2023-08-31T19:06:12.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.790+0000 7fe3ad59a700 1 -- 172.21.15.72:0/699671072 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286655421 0 0) 0x7fe3b00bfd40 con 0x7fe3b00630b0 2023-08-31T19:06:12.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.791+0000 7fe3ad59a700 1 -- 172.21.15.72:0/699671072 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3980033f0 con 0x7fe3b00630b0 2023-08-31T19:06:12.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.791+0000 7fe3ae59c700 1 -- 172.21.15.72:0/699671072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3b00c5cb0 msgr2=0x7fe3b00c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:12.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.791+0000 7fe3ae59c700 1 --2- 172.21.15.72:0/699671072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3b00c5cb0 0x7fe3b00c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.791+0000 7fe3ae59c700 1 -- 172.21.15.72:0/699671072 >> v1:172.21.15.146:6789/0 conn(0x7fe3b00630b0 legacy=0x7fe3b0157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.791+0000 7fe3ae59c700 1 -- 172.21.15.72:0/699671072 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b00c02c0 con 0x7fe3b0153e30 2023-08-31T19:06:12.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.791+0000 7fe3add9b700 1 --2- 172.21.15.72:0/699671072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3b00c5cb0 0x7fe3b00c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:06:12.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.791+0000 7fe3ae59c700 1 --2- 172.21.15.72:0/699671072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3b0153e30 0x7fe3b0154210 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fe3a0009760 tx=0x7fe3a0009060).ready entity=mon.1 client_cookie=1fc6038b830fd85 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:12.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.791+0000 7fe3ad59a700 1 -- 172.21.15.72:0/699671072 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00090d0 con 0x7fe3b0153e30 2023-08-31T19:06:12.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.791+0000 7fe3ad59a700 1 -- 172.21.15.72:0/699671072 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a000d4a0 con 0x7fe3b0153e30 2023-08-31T19:06:12.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.791+0000 7fe3ad59a700 1 -- 172.21.15.72:0/699671072 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a000d820 con 0x7fe3b0153e30 2023-08-31T19:06:12.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.791+0000 7fe3b4fff700 1 -- 172.21.15.72:0/699671072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3b0153e30 msgr2=0x7fe3b0154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.791+0000 7fe3b4fff700 1 --2- 172.21.15.72:0/699671072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3b0153e30 0x7fe3b0154210 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fe3a0009760 tx=0x7fe3a0009060).stop 2023-08-31T19:06:12.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.792+0000 7fe3b4fff700 1 -- 172.21.15.72:0/699671072 shutdown_connections 2023-08-31T19:06:12.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.792+0000 7fe3b4fff700 1 --2- 172.21.15.72:0/699671072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3b0153e30 0x7fe3b0154210 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.792+0000 7fe3b4fff700 1 --2- 172.21.15.72:0/699671072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3b00c5cb0 0x7fe3b00c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.792+0000 7fe3b4fff700 1 -- 172.21.15.72:0/699671072 >> 172.21.15.72:0/699671072 conn(0x7fe3b005eb20 msgr2=0x7fe3b00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:12.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.792+0000 7fe3b4fff700 1 -- 172.21.15.72:0/699671072 shutdown_connections 2023-08-31T19:06:12.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.792+0000 7fe3b4fff700 1 -- 172.21.15.72:0/699671072 wait complete. 2023-08-31T19:06:12.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.793+0000 7fe3b4fff700 1 Processor -- start 2023-08-31T19:06:12.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.793+0000 7fe3b4fff700 1 -- start start 2023-08-31T19:06:12.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.794+0000 7fe3b4fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3b00630b0 0x7fe3b0152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.794+0000 7fe3b4fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3b00c5cb0 0x7fe3b00c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.794+0000 7fe3b4fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3b0153e30 0x7fe3b00c3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.794+0000 7fe3b4fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b00c38f0 con 0x7fe3b00630b0 2023-08-31T19:06:12.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.794+0000 7fe3b4fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b00c3bd0 con 0x7fe3b00c5cb0 2023-08-31T19:06:12.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.794+0000 7fe3b4fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b00c3eb0 con 0x7fe3b0153e30 2023-08-31T19:06:12.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.794+0000 7fe3ae59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3b00630b0 0x7fe3b0152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.794+0000 7fe3ae59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3b00630b0 0x7fe3b0152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48310/0 (socket says 172.21.15.72:48310) 2023-08-31T19:06:12.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.794+0000 7fe3ae59c700 1 -- 172.21.15.72:0/500473373 learned_addr learned my addr 172.21.15.72:0/500473373 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:12.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.795+0000 7fe3add9b700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3b00c5cb0 0x7fe3b00c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.795+0000 7fe3aed9d700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3b0153e30 0x7fe3b00c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.795+0000 7fe3ae59c700 1 -- 172.21.15.72:0/500473373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3b0153e30 msgr2=0x7fe3b00c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.795+0000 7fe3ae59c700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3b0153e30 0x7fe3b00c3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.795+0000 7fe3ae59c700 1 -- 172.21.15.72:0/500473373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3b00c5cb0 msgr2=0x7fe3b00c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.795+0000 7fe3ae59c700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3b00c5cb0 0x7fe3b00c2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.795+0000 7fe3ae59c700 1 -- 172.21.15.72:0/500473373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a4009370 con 0x7fe3b00630b0 2023-08-31T19:06:12.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.795+0000 7fe3add9b700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3b00c5cb0 0x7fe3b00c2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:12.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.795+0000 7fe3aed9d700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3b0153e30 0x7fe3b00c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:12.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.795+0000 7fe3ae59c700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3b00630b0 0x7fe3b0152930 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7fe3a0009d50 tx=0x7fe3a0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:12.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.795+0000 7fe39e7fc700 1 -- 172.21.15.72:0/500473373 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0012a00 con 0x7fe3b00630b0 2023-08-31T19:06:12.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.795+0000 7fe39e7fc700 1 -- 172.21.15.72:0/500473373 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a0012b60 con 0x7fe3b00630b0 2023-08-31T19:06:12.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.795+0000 7fe3b4fff700 1 -- 172.21.15.72:0/500473373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a00092a0 con 0x7fe3b00630b0 2023-08-31T19:06:12.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.795+0000 7fe39e7fc700 1 -- 172.21.15.72:0/500473373 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a001c420 con 0x7fe3b00630b0 2023-08-31T19:06:12.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.795+0000 7fe3b4fff700 1 -- 172.21.15.72:0/500473373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b00c4470 con 0x7fe3b00630b0 2023-08-31T19:06:12.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.797+0000 7fe3b4fff700 1 -- 172.21.15.72:0/500473373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b00c4600 con 0x7fe3b00630b0 2023-08-31T19:06:12.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.797+0000 7fe39e7fc700 1 -- 172.21.15.72:0/500473373 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe3a001c810 con 0x7fe3b00630b0 2023-08-31T19:06:12.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.798+0000 7fe39e7fc700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe39005ef30 0x7fe3900613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:12.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.798+0000 7fe39e7fc700 1 -- 172.21.15.72:0/500473373 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5869+0+0 (secure 0 0 0) 0x7fe3a007b460 con 0x7fe3b00630b0 2023-08-31T19:06:12.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.798+0000 7fe3add9b700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe39005ef30 0x7fe3900613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:12.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.799+0000 7fe3add9b700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe39005ef30 0x7fe3900613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe3b00aa240 tx=0x7fe3a4008040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:12.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.802+0000 7fe39e7fc700 1 -- 172.21.15.72:0/500473373 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe3a004c7d0 con 0x7fe3b00630b0 2023-08-31T19:06:12.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.970+0000 7fe3b4fff700 1 -- 172.21.15.72:0/500473373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe3b0062970 con 0x7fe3b00630b0 2023-08-31T19:06:12.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.971+0000 7fe39e7fc700 1 -- 172.21.15.72:0/500473373 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v122) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe3a004fdf0 con 0x7fe3b00630b0 2023-08-31T19:06:12.972 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:06:12.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.973+0000 7fe3b4fff700 1 -- 172.21.15.72:0/500473373 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe39005ef30 msgr2=0x7fe3900613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.973+0000 7fe3b4fff700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe39005ef30 0x7fe3900613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe3b00aa240 tx=0x7fe3a4008040).stop 2023-08-31T19:06:12.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.973+0000 7fe3b4fff700 1 -- 172.21.15.72:0/500473373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3b00630b0 msgr2=0x7fe3b0152930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:12.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.973+0000 7fe3b4fff700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3b00630b0 0x7fe3b0152930 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7fe3a0009d50 tx=0x7fe3a0016000).stop 2023-08-31T19:06:12.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.973+0000 7fe3b4fff700 1 -- 172.21.15.72:0/500473373 shutdown_connections 2023-08-31T19:06:12.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.973+0000 7fe3b4fff700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3b0153e30 0x7fe3b00c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.973+0000 7fe3b4fff700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3b00630b0 0x7fe3b0152930 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.973+0000 7fe3b4fff700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe39005ef30 0x7fe3900613f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.973+0000 7fe3b4fff700 1 --2- 172.21.15.72:0/500473373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3b00c5cb0 0x7fe3b00c2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:12.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.973+0000 7fe3b4fff700 1 -- 172.21.15.72:0/500473373 >> 172.21.15.72:0/500473373 conn(0x7fe3b005eb20 msgr2=0x7fe3b00c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:12.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.973+0000 7fe3b4fff700 1 -- 172.21.15.72:0/500473373 shutdown_connections 2023-08-31T19:06:12.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:12.973+0000 7fe3b4fff700 1 -- 172.21.15.72:0/500473373 wait complete. 2023-08-31T19:06:12.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T19:06:13.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.179+0000 7eff885ff700 1 Processor -- start 2023-08-31T19:06:13.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.179+0000 7eff885ff700 1 -- start start 2023-08-31T19:06:13.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.180+0000 7eff885ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff8006a260 0x7eff80069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:13.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.180+0000 7eff885ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff80064270 con 0x7eff80069170 2023-08-31T19:06:13.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.180+0000 7eff885ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff800bcc20 con 0x7eff80065710 2023-08-31T19:06:13.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.180+0000 7eff885ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff800bca40 con 0x7eff8006a260 2023-08-31T19:06:13.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.180+0000 7eff85b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff8006a260 0x7eff80069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:13.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.181+0000 7eff85b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff8006a260 0x7eff80069550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58360/0 (socket says 172.21.15.72:58360) 2023-08-31T19:06:13.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.181+0000 7eff85b9a700 1 -- 172.21.15.72:0/683026781 learned_addr learned my addr 172.21.15.72:0/683026781 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:13.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.181+0000 7eff8639b700 1 --1- 172.21.15.72:0/683026781 >> v1:172.21.15.72:6789/0 conn(0x7eff80069170 0x7eff800c2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50034/0 (socket says 172.21.15.72:50034) 2023-08-31T19:06:13.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.181+0000 7eff85b9a700 1 -- 172.21.15.72:0/683026781 >> v1:172.21.15.146:6789/0 conn(0x7eff80065710 legacy=0x7eff80069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:13.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.181+0000 7eff85b9a700 1 -- 172.21.15.72:0/683026781 >> v1:172.21.15.72:6789/0 conn(0x7eff80069170 legacy=0x7eff800c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:13.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.181+0000 7eff85b9a700 1 -- 172.21.15.72:0/683026781 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff80154890 con 0x7eff8006a260 2023-08-31T19:06:13.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.181+0000 7eff85399700 1 -- 172.21.15.72:0/683026781 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265396643 0 0) 0x7eff80064270 con 0x7eff80069170 2023-08-31T19:06:13.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.181+0000 7eff85b9a700 1 --2- 172.21.15.72:0/683026781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8006a260 0x7eff80069550 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7eff800c7670 tx=0x7eff700090f0).ready entity=mon.0 client_cookie=fe5fbfdc86df63f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:13.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.181+0000 7eff85399700 1 -- 172.21.15.72:0/683026781 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7000b600 con 0x7eff8006a260 2023-08-31T19:06:13.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.181+0000 7eff85399700 1 -- 172.21.15.72:0/683026781 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7000b760 con 0x7eff8006a260 2023-08-31T19:06:13.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.181+0000 7eff85399700 1 -- 172.21.15.72:0/683026781 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7000bae0 con 0x7eff8006a260 2023-08-31T19:06:13.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.182+0000 7eff885ff700 1 -- 172.21.15.72:0/683026781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8006a260 msgr2=0x7eff80069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:13.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.182+0000 7eff885ff700 1 --2- 172.21.15.72:0/683026781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8006a260 0x7eff80069550 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7eff800c7670 tx=0x7eff700090f0).stop 2023-08-31T19:06:13.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.182+0000 7eff885ff700 1 -- 172.21.15.72:0/683026781 shutdown_connections 2023-08-31T19:06:13.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.182+0000 7eff885ff700 1 --2- 172.21.15.72:0/683026781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8006a260 0x7eff80069550 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:13.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.182+0000 7eff885ff700 1 -- 172.21.15.72:0/683026781 >> 172.21.15.72:0/683026781 conn(0x7eff800c6b10 msgr2=0x7eff800c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:13.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.182+0000 7eff885ff700 1 -- 172.21.15.72:0/683026781 shutdown_connections 2023-08-31T19:06:13.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.182+0000 7eff885ff700 1 -- 172.21.15.72:0/683026781 wait complete. 2023-08-31T19:06:13.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.183+0000 7eff885ff700 1 Processor -- start 2023-08-31T19:06:13.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.184+0000 7eff885ff700 1 -- start start 2023-08-31T19:06:13.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.184+0000 7eff885ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff80065710 0x7eff8014b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:13.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.184+0000 7eff885ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff80069170 0x7eff80144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:13.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.184+0000 7eff885ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff8006a260 0x7eff80165de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:13.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.184+0000 7eff885ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800a82e0 con 0x7eff80065710 2023-08-31T19:06:13.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.184+0000 7eff885ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800befc0 con 0x7eff8006a260 2023-08-31T19:06:13.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.184+0000 7eff885ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff801443c0 con 0x7eff80069170 2023-08-31T19:06:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.185+0000 7eff8639b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff80065710 0x7eff8014b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.185+0000 7eff8639b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff80065710 0x7eff8014b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58374/0 (socket says 172.21.15.72:58374) 2023-08-31T19:06:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.185+0000 7eff8639b700 1 -- 172.21.15.72:0/220057406 learned_addr learned my addr 172.21.15.72:0/220057406 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.185+0000 7eff85b9a700 1 --2- 172.21.15.72:0/220057406 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff80069170 0x7eff80144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.185+0000 7eff86b9c700 1 --2- 172.21.15.72:0/220057406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff8006a260 0x7eff80165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:13.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.185+0000 7eff8639b700 1 -- 172.21.15.72:0/220057406 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff80069170 msgr2=0x7eff80144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.185+0000 7eff8639b700 1 --2- 172.21.15.72:0/220057406 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff80069170 0x7eff80144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.185+0000 7eff8639b700 1 -- 172.21.15.72:0/220057406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff8006a260 msgr2=0x7eff80165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.185+0000 7eff8639b700 1 --2- 172.21.15.72:0/220057406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff8006a260 0x7eff80165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.185+0000 7eff8639b700 1 -- 172.21.15.72:0/220057406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff70009370 con 0x7eff80065710 2023-08-31T19:06:13.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.185+0000 7eff85b9a700 1 --2- 172.21.15.72:0/220057406 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff80069170 0x7eff80144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:13.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.185+0000 7eff8639b700 1 --2- 172.21.15.72:0/220057406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff80065710 0x7eff8014b900 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7eff7c00c4c0 tx=0x7eff7c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:13.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.186+0000 7eff767fc700 1 -- 172.21.15.72:0/220057406 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0072e0 con 0x7eff80065710 2023-08-31T19:06:13.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.186+0000 7eff767fc700 1 -- 172.21.15.72:0/220057406 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c007440 con 0x7eff80065710 2023-08-31T19:06:13.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.186+0000 7eff885ff700 1 -- 172.21.15.72:0/220057406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff801446a0 con 0x7eff80065710 2023-08-31T19:06:13.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.186+0000 7eff767fc700 1 -- 172.21.15.72:0/220057406 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c005930 con 0x7eff80065710 2023-08-31T19:06:13.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.186+0000 7eff885ff700 1 -- 172.21.15.72:0/220057406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff800a7f70 con 0x7eff80065710 2023-08-31T19:06:13.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.187+0000 7eff885ff700 1 -- 172.21.15.72:0/220057406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff8006c6b0 con 0x7eff80065710 2023-08-31T19:06:13.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.188+0000 7eff767fc700 1 -- 172.21.15.72:0/220057406 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7eff7c005ce0 con 0x7eff80065710 2023-08-31T19:06:13.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.188+0000 7eff767fc700 1 --2- 172.21.15.72:0/220057406 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7eff6405ef30 0x7eff640613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:13.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.188+0000 7eff767fc700 1 -- 172.21.15.72:0/220057406 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5869+0+0 (secure 0 0 0) 0x7eff7c0797c0 con 0x7eff80065710 2023-08-31T19:06:13.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.189+0000 7eff85b9a700 1 --2- 172.21.15.72:0/220057406 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7eff6405ef30 0x7eff640613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:13.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.189+0000 7eff85b9a700 1 --2- 172.21.15.72:0/220057406 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7eff6405ef30 0x7eff640613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7eff8006a6c0 tx=0x7eff70017000).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:13.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.192+0000 7eff767fc700 1 -- 172.21.15.72:0/220057406 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7eff7c04abb0 con 0x7eff80065710 2023-08-31T19:06:13.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.363+0000 7eff885ff700 1 -- 172.21.15.72:0/220057406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7eff800bcec0 con 0x7eff80065710 2023-08-31T19:06:13.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.363+0000 7eff767fc700 1 -- 172.21.15.72:0/220057406 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v122) v1 ==== 84+0+143 (secure 0 0 0) 0x7eff7c018030 con 0x7eff80065710 2023-08-31T19:06:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:06:13.364 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:06:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-08-31T19:06:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "device_health_metrics" 2023-08-31T19:06:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:06:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-08-31T19:06:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-08-31T19:06:13.366 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:13.366 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:06:13.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.365+0000 7eff885ff700 1 -- 172.21.15.72:0/220057406 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7eff6405ef30 msgr2=0x7eff640613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:13.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.365+0000 7eff885ff700 1 --2- 172.21.15.72:0/220057406 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7eff6405ef30 0x7eff640613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7eff8006a6c0 tx=0x7eff70017000).stop 2023-08-31T19:06:13.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.365+0000 7eff885ff700 1 -- 172.21.15.72:0/220057406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff80065710 msgr2=0x7eff8014b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:13.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.365+0000 7eff885ff700 1 --2- 172.21.15.72:0/220057406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff80065710 0x7eff8014b900 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7eff7c00c4c0 tx=0x7eff7c007c10).stop 2023-08-31T19:06:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.365+0000 7eff885ff700 1 -- 172.21.15.72:0/220057406 shutdown_connections 2023-08-31T19:06:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.365+0000 7eff885ff700 1 --2- 172.21.15.72:0/220057406 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7eff6405ef30 0x7eff640613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.365+0000 7eff885ff700 1 --2- 172.21.15.72:0/220057406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff8006a260 0x7eff80165de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.365+0000 7eff885ff700 1 --2- 172.21.15.72:0/220057406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff80065710 0x7eff8014b900 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.365+0000 7eff885ff700 1 --2- 172.21.15.72:0/220057406 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7eff80069170 0x7eff80144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.365+0000 7eff885ff700 1 -- 172.21.15.72:0/220057406 >> 172.21.15.72:0/220057406 conn(0x7eff800c6b10 msgr2=0x7eff800c5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.365+0000 7eff885ff700 1 -- 172.21.15.72:0/220057406 shutdown_connections 2023-08-31T19:06:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.365+0000 7eff885ff700 1 -- 172.21.15.72:0/220057406 wait complete. 2023-08-31T19:06:13.382 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T19:06:13.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-31T19:06:13.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.577+0000 7f22c61ff700 1 Processor -- start 2023-08-31T19:06:13.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.577+0000 7f22c61ff700 1 -- start start 2023-08-31T19:06:13.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.579+0000 7f22c61ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22c0157710 0x7f22c0069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:13.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.579+0000 7f22c61ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c00c2260 con 0x7f22c0062650 2023-08-31T19:06:13.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.579+0000 7f22c61ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c0062b80 con 0x7f22c0068c20 2023-08-31T19:06:13.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.579+0000 7f22c61ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c0062e60 con 0x7f22c0157710 2023-08-31T19:06:13.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.579+0000 7f22beffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f22c0062650 0x7f22c0157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50040/0 (socket says 172.21.15.72:50040) 2023-08-31T19:06:13.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.579+0000 7f22beffd700 1 -- 172.21.15.72:0/1810825895 learned_addr learned my addr 172.21.15.72:0/1810825895 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:13.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.579+0000 7f22bffff700 1 --2- 172.21.15.72:0/1810825895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22c0157710 0x7f22c0069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:13.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.579+0000 7f22be7fc700 1 -- 172.21.15.72:0/1810825895 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852216675 0 0) 0x7f22c00c2260 con 0x7f22c0062650 2023-08-31T19:06:13.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.579+0000 7f22be7fc700 1 -- 172.21.15.72:0/1810825895 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22a80033f0 con 0x7f22c0062650 2023-08-31T19:06:13.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.580+0000 7f22be7fc700 1 -- 172.21.15.72:0/1810825895 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020229177 0 0) 0x7f22c0062b80 con 0x7f22c0068c20 2023-08-31T19:06:13.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.580+0000 7f22be7fc700 1 -- 172.21.15.72:0/1810825895 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22c00c2260 con 0x7f22c0068c20 2023-08-31T19:06:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.580+0000 7f22bffff700 1 -- 172.21.15.72:0/1810825895 >> v1:172.21.15.146:6789/0 conn(0x7f22c0068c20 legacy=0x7f22c00c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.580+0000 7f22bffff700 1 -- 172.21.15.72:0/1810825895 >> v1:172.21.15.72:6789/0 conn(0x7f22c0062650 legacy=0x7f22c0157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.580+0000 7f22bffff700 1 -- 172.21.15.72:0/1810825895 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c0063140 con 0x7f22c0157710 2023-08-31T19:06:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.580+0000 7f22bffff700 1 --2- 172.21.15.72:0/1810825895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22c0157710 0x7f22c0069000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f22b8009e90 tx=0x7f22b8009780).ready entity=mon.2 client_cookie=d791422624da403d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:13.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.580+0000 7f22be7fc700 1 -- 172.21.15.72:0/1810825895 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b800e070 con 0x7f22c0157710 2023-08-31T19:06:13.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.580+0000 7f22be7fc700 1 -- 172.21.15.72:0/1810825895 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b800bab0 con 0x7f22c0157710 2023-08-31T19:06:13.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.580+0000 7f22be7fc700 1 -- 172.21.15.72:0/1810825895 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b800be30 con 0x7f22c0157710 2023-08-31T19:06:13.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.581+0000 7f22c61ff700 1 -- 172.21.15.72:0/1810825895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22c0157710 msgr2=0x7f22c0069000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:13.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.581+0000 7f22c61ff700 1 --2- 172.21.15.72:0/1810825895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22c0157710 0x7f22c0069000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f22b8009e90 tx=0x7f22b8009780).stop 2023-08-31T19:06:13.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.581+0000 7f22c61ff700 1 -- 172.21.15.72:0/1810825895 shutdown_connections 2023-08-31T19:06:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.581+0000 7f22c61ff700 1 --2- 172.21.15.72:0/1810825895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22c0157710 0x7f22c0069000 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.581+0000 7f22c61ff700 1 -- 172.21.15.72:0/1810825895 >> 172.21.15.72:0/1810825895 conn(0x7f22c00c72f0 msgr2=0x7f22c00c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.581+0000 7f22c61ff700 1 -- 172.21.15.72:0/1810825895 shutdown_connections 2023-08-31T19:06:13.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.581+0000 7f22c61ff700 1 -- 172.21.15.72:0/1810825895 wait complete. 2023-08-31T19:06:13.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.582+0000 7f22c61ff700 1 Processor -- start 2023-08-31T19:06:13.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.582+0000 7f22c61ff700 1 -- start start 2023-08-31T19:06:13.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.583+0000 7f22c61ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22c0062650 0x7f22c00a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:13.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.583+0000 7f22c61ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22c0068c20 0x7f22c00a86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.583+0000 7f22c61ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22c0157710 0x7f22c00a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.583+0000 7f22c61ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c00a9860 con 0x7f22c0068c20 2023-08-31T19:06:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.583+0000 7f22c61ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c00a8c50 con 0x7f22c0157710 2023-08-31T19:06:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.583+0000 7f22c61ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c00a8f30 con 0x7f22c0062650 2023-08-31T19:06:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22beffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22c0068c20 0x7f22c00a86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:13.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22beffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22c0068c20 0x7f22c00a86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58376/0 (socket says 172.21.15.72:58376) 2023-08-31T19:06:13.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22beffd700 1 -- 172.21.15.72:0/2833333588 learned_addr learned my addr 172.21.15.72:0/2833333588 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:13.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22bffff700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22c0157710 0x7f22c00a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:13.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22bf7fe700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22c0062650 0x7f22c00a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:13.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22beffd700 1 -- 172.21.15.72:0/2833333588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22c0062650 msgr2=0x7f22c00a81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:13.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22beffd700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22c0062650 0x7f22c00a81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22beffd700 1 -- 172.21.15.72:0/2833333588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22c0157710 msgr2=0x7f22c00a5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22beffd700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22c0157710 0x7f22c00a5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22beffd700 1 -- 172.21.15.72:0/2833333588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b8009a20 con 0x7f22c0068c20 2023-08-31T19:06:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22bffff700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22c0157710 0x7f22c00a5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:13.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22bf7fe700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22c0062650 0x7f22c00a81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22beffd700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22c0068c20 0x7f22c00a86b0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f22b400c560 tx=0x7f22b4007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22a77fe700 1 -- 172.21.15.72:0/2833333588 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40072e0 con 0x7f22c0068c20 2023-08-31T19:06:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22a77fe700 1 -- 172.21.15.72:0/2833333588 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b4007440 con 0x7f22c0068c20 2023-08-31T19:06:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22c61ff700 1 -- 172.21.15.72:0/2833333588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c00a9210 con 0x7f22c0068c20 2023-08-31T19:06:13.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.584+0000 7f22a77fe700 1 -- 172.21.15.72:0/2833333588 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40057a0 con 0x7f22c0068c20 2023-08-31T19:06:13.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.585+0000 7f22c61ff700 1 -- 172.21.15.72:0/2833333588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c00a74a0 con 0x7f22c0068c20 2023-08-31T19:06:13.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.586+0000 7f22c61ff700 1 -- 172.21.15.72:0/2833333588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c006c6b0 con 0x7f22c0068c20 2023-08-31T19:06:13.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.586+0000 7f22a77fe700 1 -- 172.21.15.72:0/2833333588 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f22b4005bd0 con 0x7f22c0068c20 2023-08-31T19:06:13.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.587+0000 7f22a77fe700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f22ac05ef30 0x7f22ac0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:13.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.587+0000 7f22a77fe700 1 -- 172.21.15.72:0/2833333588 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f22b4079890 con 0x7f22c0068c20 2023-08-31T19:06:13.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.587+0000 7f22bf7fe700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f22ac05ef30 0x7f22ac0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:13.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.588+0000 7f22bf7fe700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f22ac05ef30 0x7f22ac0613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f22b0002750 tx=0x7f22b0009040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:13.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.591+0000 7f22a77fe700 1 -- 172.21.15.72:0/2833333588 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f22b404ac80 con 0x7f22c0068c20 2023-08-31T19:06:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:13.764+0000 7f22c61ff700 1 -- 172.21.15.72:0/2833333588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f22c01544d0 con 0x7f22c0068c20 2023-08-31T19:06:14.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.522+0000 7f22a77fe700 1 -- 172.21.15.72:0/2833333588 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v123) v1 ==== 152+0+0 (secure 0 0 0) 0x7f22b4018070 con 0x7f22c0068c20 2023-08-31T19:06:14.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.526+0000 7f22c61ff700 1 -- 172.21.15.72:0/2833333588 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f22ac05ef30 msgr2=0x7f22ac0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:14.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.526+0000 7f22c61ff700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f22ac05ef30 0x7f22ac0613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f22b0002750 tx=0x7f22b0009040).stop 2023-08-31T19:06:14.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.526+0000 7f22c61ff700 1 -- 172.21.15.72:0/2833333588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22c0068c20 msgr2=0x7f22c00a86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:14.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.526+0000 7f22c61ff700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22c0068c20 0x7f22c00a86b0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f22b400c560 tx=0x7f22b4007d20).stop 2023-08-31T19:06:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.529+0000 7f22c61ff700 1 -- 172.21.15.72:0/2833333588 shutdown_connections 2023-08-31T19:06:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.529+0000 7f22c61ff700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f22ac05ef30 0x7f22ac0613f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.529+0000 7f22c61ff700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22c0157710 0x7f22c00a5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.529+0000 7f22c61ff700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f22c0062650 0x7f22c00a81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:14.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.529+0000 7f22c61ff700 1 --2- 172.21.15.72:0/2833333588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22c0068c20 0x7f22c00a86b0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:14.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.530+0000 7f22c61ff700 1 -- 172.21.15.72:0/2833333588 >> 172.21.15.72:0/2833333588 conn(0x7f22c00c72f0 msgr2=0x7f22c01529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:14.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.532+0000 7f22c61ff700 1 -- 172.21.15.72:0/2833333588 shutdown_connections 2023-08-31T19:06:14.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.532+0000 7f22c61ff700 1 -- 172.21.15.72:0/2833333588 wait complete. 2023-08-31T19:06:14.534 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-08-31T19:06:14.552 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T19:06:14.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.748+0000 7ff83b5ff700 1 Processor -- start 2023-08-31T19:06:14.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.749+0000 7ff83b5ff700 1 -- start start 2023-08-31T19:06:14.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.750+0000 7ff83b5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff834154030 0x7ff834154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:14.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.750+0000 7ff83b5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff8340c06b0 0x7ff8340c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:14.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.750+0000 7ff83b5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8340c6ed0 con 0x7ff8340aa140 2023-08-31T19:06:14.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.750+0000 7ff83b5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8340c66e0 con 0x7ff8340c06b0 2023-08-31T19:06:14.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.750+0000 7ff83b5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8340c68c0 con 0x7ff834154030 2023-08-31T19:06:14.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.750+0000 7ff838b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff8340c06b0 0x7ff8340c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:14.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.750+0000 7ff839b9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff8340aa140 0x7ff834063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50042/0 (socket says 172.21.15.72:50042) 2023-08-31T19:06:14.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.750+0000 7ff838b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff8340c06b0 0x7ff8340c7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58380/0 (socket says 172.21.15.72:58380) 2023-08-31T19:06:14.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.750+0000 7ff839b9c700 1 -- 172.21.15.72:0/90088327 learned_addr learned my addr 172.21.15.72:0/90088327 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:14.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.750+0000 7ff83939b700 1 --2- 172.21.15.72:0/90088327 >> v2:172.21.15.146:3300/0 conn(0x7ff834154030 0x7ff834154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:14.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.751+0000 7ff838b9a700 1 -- 172.21.15.72:0/90088327 >> v2:172.21.15.146:3300/0 conn(0x7ff834154030 msgr2=0x7ff834154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:14.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.751+0000 7ff838b9a700 1 --2- 172.21.15.72:0/90088327 >> v2:172.21.15.146:3300/0 conn(0x7ff834154030 0x7ff834154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:14.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.751+0000 7ff838b9a700 1 -- 172.21.15.72:0/90088327 >> v1:172.21.15.72:6789/0 conn(0x7ff8340aa140 legacy=0x7ff834063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:14.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.751+0000 7ff838b9a700 1 -- 172.21.15.72:0/90088327 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8340c0f30 con 0x7ff8340c06b0 2023-08-31T19:06:14.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.751+0000 7ff838b9a700 1 --2- 172.21.15.72:0/90088327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8340c06b0 0x7ff8340c7360 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7ff8340c8bc0 tx=0x7ff824009060).ready entity=mon.0 client_cookie=9ef0e3eab6459182 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:14.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.751+0000 7ff82bfff700 1 -- 172.21.15.72:0/90088327 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82400f510 con 0x7ff8340c06b0 2023-08-31T19:06:14.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.751+0000 7ff82bfff700 1 -- 172.21.15.72:0/90088327 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82400f670 con 0x7ff8340c06b0 2023-08-31T19:06:14.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.751+0000 7ff82bfff700 1 -- 172.21.15.72:0/90088327 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82400f9f0 con 0x7ff8340c06b0 2023-08-31T19:06:14.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.752+0000 7ff83b5ff700 1 -- 172.21.15.72:0/90088327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8340c06b0 msgr2=0x7ff8340c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:14.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.752+0000 7ff83b5ff700 1 --2- 172.21.15.72:0/90088327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8340c06b0 0x7ff8340c7360 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7ff8340c8bc0 tx=0x7ff824009060).stop 2023-08-31T19:06:14.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.752+0000 7ff83b5ff700 1 -- 172.21.15.72:0/90088327 shutdown_connections 2023-08-31T19:06:14.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.752+0000 7ff83b5ff700 1 --2- 172.21.15.72:0/90088327 >> v2:172.21.15.146:3300/0 conn(0x7ff834154030 0x7ff834154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:14.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.752+0000 7ff83b5ff700 1 --2- 172.21.15.72:0/90088327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8340c06b0 0x7ff8340c7360 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:14.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.752+0000 7ff83b5ff700 1 -- 172.21.15.72:0/90088327 >> 172.21.15.72:0/90088327 conn(0x7ff83405eb60 msgr2=0x7ff8340cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:14.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.752+0000 7ff83b5ff700 1 -- 172.21.15.72:0/90088327 shutdown_connections 2023-08-31T19:06:14.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.752+0000 7ff83b5ff700 1 -- 172.21.15.72:0/90088327 wait complete. 2023-08-31T19:06:14.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.753+0000 7ff83b5ff700 1 Processor -- start 2023-08-31T19:06:14.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.753+0000 7ff83b5ff700 1 -- start start 2023-08-31T19:06:14.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.754+0000 7ff83b5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8340aa140 0x7ff83414ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:14.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.754+0000 7ff83b5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8340c06b0 0x7ff834165690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:14.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.754+0000 7ff83b5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff834154030 0x7ff8340c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:14.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.754+0000 7ff83b5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340c1e90 con 0x7ff8340aa140 2023-08-31T19:06:14.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.754+0000 7ff83b5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340c2a10 con 0x7ff8340c06b0 2023-08-31T19:06:14.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.754+0000 7ff83b5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83414b000 con 0x7ff834154030 2023-08-31T19:06:14.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff83939b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8340aa140 0x7ff83414ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:14.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff83939b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8340aa140 0x7ff83414ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58386/0 (socket says 172.21.15.72:58386) 2023-08-31T19:06:14.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff83939b700 1 -- 172.21.15.72:0/1225826412 learned_addr learned my addr 172.21.15.72:0/1225826412 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:14.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff838b9a700 1 --2- 172.21.15.72:0/1225826412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8340c06b0 0x7ff834165690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:14.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff839b9c700 1 --2- 172.21.15.72:0/1225826412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff834154030 0x7ff8340c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:14.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff83939b700 1 -- 172.21.15.72:0/1225826412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff834154030 msgr2=0x7ff8340c2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:14.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff83939b700 1 --2- 172.21.15.72:0/1225826412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff834154030 0x7ff8340c2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:14.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff83939b700 1 -- 172.21.15.72:0/1225826412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8340c06b0 msgr2=0x7ff834165690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:14.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff83939b700 1 --2- 172.21.15.72:0/1225826412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8340c06b0 0x7ff834165690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:14.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff83939b700 1 -- 172.21.15.72:0/1225826412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8240092a0 con 0x7ff8340aa140 2023-08-31T19:06:14.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff838b9a700 1 --2- 172.21.15.72:0/1225826412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8340c06b0 0x7ff834165690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:14.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff83939b700 1 --2- 172.21.15.72:0/1225826412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8340aa140 0x7ff83414ab10 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7ff83000e930 tx=0x7ff830009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:14.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff8297fa700 1 -- 172.21.15.72:0/1225826412 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83000c640 con 0x7ff8340aa140 2023-08-31T19:06:14.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff8297fa700 1 -- 172.21.15.72:0/1225826412 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83000c7a0 con 0x7ff8340aa140 2023-08-31T19:06:14.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff8297fa700 1 -- 172.21.15.72:0/1225826412 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83000cb20 con 0x7ff8340aa140 2023-08-31T19:06:14.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.755+0000 7ff83b5ff700 1 -- 172.21.15.72:0/1225826412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8340c20e0 con 0x7ff8340aa140 2023-08-31T19:06:14.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.756+0000 7ff83b5ff700 1 -- 172.21.15.72:0/1225826412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8340c26a0 con 0x7ff8340aa140 2023-08-31T19:06:14.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.756+0000 7ff83b5ff700 1 -- 172.21.15.72:0/1225826412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8340c2cf0 con 0x7ff8340aa140 2023-08-31T19:06:14.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.758+0000 7ff8297fa700 1 -- 172.21.15.72:0/1225826412 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff83001b400 con 0x7ff8340aa140 2023-08-31T19:06:14.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.759+0000 7ff8297fa700 1 --2- 172.21.15.72:0/1225826412 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff81805ef30 0x7ff8180613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:14.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.759+0000 7ff8297fa700 1 -- 172.21.15.72:0/1225826412 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6239+0+0 (secure 0 0 0) 0x7ff83007aa80 con 0x7ff8340aa140 2023-08-31T19:06:14.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.759+0000 7ff838b9a700 1 --2- 172.21.15.72:0/1225826412 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff81805ef30 0x7ff8180613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:14.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.759+0000 7ff838b9a700 1 --2- 172.21.15.72:0/1225826412 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff81805ef30 0x7ff8180613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff8340ad360 tx=0x7ff824017000).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:14.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.762+0000 7ff8297fa700 1 -- 172.21.15.72:0/1225826412 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff83004bca0 con 0x7ff8340aa140 2023-08-31T19:06:14.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:14.933+0000 7ff83b5ff700 1 -- 172.21.15.72:0/1225826412 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff83406c6b0 con 0x7ff8340aa140 2023-08-31T19:06:15.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.527+0000 7ff8297fa700 1 -- 172.21.15.72:0/1225826412 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v124) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff8300160d0 con 0x7ff8340aa140 2023-08-31T19:06:15.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.535+0000 7ff83b5ff700 1 -- 172.21.15.72:0/1225826412 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff81805ef30 msgr2=0x7ff8180613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:15.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.535+0000 7ff83b5ff700 1 --2- 172.21.15.72:0/1225826412 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff81805ef30 0x7ff8180613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff8340ad360 tx=0x7ff824017000).stop 2023-08-31T19:06:15.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.535+0000 7ff83b5ff700 1 -- 172.21.15.72:0/1225826412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8340aa140 msgr2=0x7ff83414ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:15.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.535+0000 7ff83b5ff700 1 --2- 172.21.15.72:0/1225826412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8340aa140 0x7ff83414ab10 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7ff83000e930 tx=0x7ff830009060).stop 2023-08-31T19:06:15.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.541+0000 7ff83b5ff700 1 -- 172.21.15.72:0/1225826412 shutdown_connections 2023-08-31T19:06:15.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.541+0000 7ff83b5ff700 1 --2- 172.21.15.72:0/1225826412 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff834154030 0x7ff8340c2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:15.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.541+0000 7ff83b5ff700 1 --2- 172.21.15.72:0/1225826412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8340aa140 0x7ff83414ab10 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:15.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.541+0000 7ff83b5ff700 1 --2- 172.21.15.72:0/1225826412 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff81805ef30 0x7ff8180613f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:15.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.541+0000 7ff83b5ff700 1 --2- 172.21.15.72:0/1225826412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8340c06b0 0x7ff834165690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:15.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.541+0000 7ff83b5ff700 1 -- 172.21.15.72:0/1225826412 >> 172.21.15.72:0/1225826412 conn(0x7ff83405eb60 msgr2=0x7ff8340c7260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:15.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.542+0000 7ff83b5ff700 1 -- 172.21.15.72:0/1225826412 shutdown_connections 2023-08-31T19:06:15.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.542+0000 7ff83b5ff700 1 -- 172.21.15.72:0/1225826412 wait complete. 2023-08-31T19:06:15.556 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-08-31T19:06:15.571 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T19:06:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.762+0000 7f183fdff700 1 Processor -- start 2023-08-31T19:06:15.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.763+0000 7f183fdff700 1 -- start start 2023-08-31T19:06:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.764+0000 7f183fdff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1838153e30 0x7f1838154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:15.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.764+0000 7f183fdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18380c5cb0 0x7f18380c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.764+0000 7f183fdff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18380bfd40 con 0x7f18380630b0 2023-08-31T19:06:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.764+0000 7f183fdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18380c6730 con 0x7f18380c5cb0 2023-08-31T19:06:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.764+0000 7f183fdff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18380bffe0 con 0x7f1838153e30 2023-08-31T19:06:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.764+0000 7f183d39a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18380c5cb0 0x7f18380c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:15.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.764+0000 7f183d39a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18380c5cb0 0x7f18380c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58400/0 (socket says 172.21.15.72:58400) 2023-08-31T19:06:15.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.764+0000 7f183d39a700 1 -- 172.21.15.72:0/117784201 learned_addr learned my addr 172.21.15.72:0/117784201 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:15.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.765+0000 7f183d39a700 1 -- 172.21.15.72:0/117784201 >> v2:172.21.15.146:3300/0 conn(0x7f1838153e30 msgr2=0x7f1838154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:15.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.765+0000 7f183db9b700 1 --2- 172.21.15.72:0/117784201 >> v2:172.21.15.146:3300/0 conn(0x7f1838153e30 0x7f1838154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:15.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.765+0000 7f183d39a700 1 --2- 172.21.15.72:0/117784201 >> v2:172.21.15.146:3300/0 conn(0x7f1838153e30 0x7f1838154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:15.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.765+0000 7f183d39a700 1 -- 172.21.15.72:0/117784201 >> v1:172.21.15.146:6789/0 conn(0x7f18380630b0 legacy=0x7f1838157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:15.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.765+0000 7f183d39a700 1 -- 172.21.15.72:0/117784201 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18380c02c0 con 0x7f18380c5cb0 2023-08-31T19:06:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.765+0000 7f183db9b700 1 --2- 172.21.15.72:0/117784201 >> v2:172.21.15.146:3300/0 conn(0x7f1838153e30 0x7f1838154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.765+0000 7f183d39a700 1 --2- 172.21.15.72:0/117784201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18380c5cb0 0x7f18380c6160 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f183806aa50 tx=0x7f18280090f0).ready entity=mon.0 client_cookie=5fb605ce4f97c1f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.765+0000 7f183cb99700 1 -- 172.21.15.72:0/117784201 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182800b5a0 con 0x7f18380c5cb0 2023-08-31T19:06:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.765+0000 7f183cb99700 1 -- 172.21.15.72:0/117784201 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182800b700 con 0x7f18380c5cb0 2023-08-31T19:06:15.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.765+0000 7f183cb99700 1 -- 172.21.15.72:0/117784201 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182800baa0 con 0x7f18380c5cb0 2023-08-31T19:06:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.766+0000 7f183fdff700 1 -- 172.21.15.72:0/117784201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18380c5cb0 msgr2=0x7f18380c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.766+0000 7f183fdff700 1 --2- 172.21.15.72:0/117784201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18380c5cb0 0x7f18380c6160 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f183806aa50 tx=0x7f18280090f0).stop 2023-08-31T19:06:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.766+0000 7f183fdff700 1 -- 172.21.15.72:0/117784201 shutdown_connections 2023-08-31T19:06:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.766+0000 7f183fdff700 1 --2- 172.21.15.72:0/117784201 >> v2:172.21.15.146:3300/0 conn(0x7f1838153e30 0x7f1838154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:15.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.766+0000 7f183fdff700 1 --2- 172.21.15.72:0/117784201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18380c5cb0 0x7f18380c6160 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.766+0000 7f183fdff700 1 -- 172.21.15.72:0/117784201 >> 172.21.15.72:0/117784201 conn(0x7f183805eb20 msgr2=0x7f18380cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.766+0000 7f183fdff700 1 -- 172.21.15.72:0/117784201 shutdown_connections 2023-08-31T19:06:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.766+0000 7f183fdff700 1 -- 172.21.15.72:0/117784201 wait complete. 2023-08-31T19:06:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.767+0000 7f183fdff700 1 Processor -- start 2023-08-31T19:06:15.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.767+0000 7f183fdff700 1 -- start start 2023-08-31T19:06:15.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.768+0000 7f183fdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18380630b0 0x7f18380aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:15.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.768+0000 7f183fdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18380c5cb0 0x7f183814dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:15.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.768+0000 7f183fdff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1838153e30 0x7f18381476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:15.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.768+0000 7f183fdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18380aea40 con 0x7f18380630b0 2023-08-31T19:06:15.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.768+0000 7f183fdff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18380ade30 con 0x7f1838153e30 2023-08-31T19:06:15.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.768+0000 7f183fdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18380ae110 con 0x7f18380c5cb0 2023-08-31T19:06:15.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.768+0000 7f183db9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18380630b0 0x7f18380aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:15.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.768+0000 7f183db9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18380630b0 0x7f18380aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58404/0 (socket says 172.21.15.72:58404) 2023-08-31T19:06:15.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.768+0000 7f183db9b700 1 -- 172.21.15.72:0/1267093377 learned_addr learned my addr 172.21.15.72:0/1267093377 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:15.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.769+0000 7f183d39a700 1 --2- 172.21.15.72:0/1267093377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18380c5cb0 0x7f183814dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:15.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.769+0000 7f183e39c700 1 --2- 172.21.15.72:0/1267093377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1838153e30 0x7f18381476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:15.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.769+0000 7f183db9b700 1 -- 172.21.15.72:0/1267093377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18380c5cb0 msgr2=0x7f183814dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:15.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.769+0000 7f183db9b700 1 --2- 172.21.15.72:0/1267093377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18380c5cb0 0x7f183814dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.769+0000 7f183db9b700 1 -- 172.21.15.72:0/1267093377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1838153e30 msgr2=0x7f18381476e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.769+0000 7f183db9b700 1 --2- 172.21.15.72:0/1267093377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1838153e30 0x7f18381476e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.769+0000 7f183db9b700 1 -- 172.21.15.72:0/1267093377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1828009370 con 0x7f18380630b0 2023-08-31T19:06:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.769+0000 7f183e39c700 1 --2- 172.21.15.72:0/1267093377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1838153e30 0x7f18381476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.769+0000 7f183db9b700 1 --2- 172.21.15.72:0/1267093377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18380630b0 0x7f18380aeed0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f183400c880 tx=0x7f1834008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.769+0000 7f182dffb700 1 -- 172.21.15.72:0/1267093377 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834010580 con 0x7f18380630b0 2023-08-31T19:06:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.769+0000 7f182dffb700 1 -- 172.21.15.72:0/1267093377 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18340106e0 con 0x7f18380630b0 2023-08-31T19:06:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.769+0000 7f183fdff700 1 -- 172.21.15.72:0/1267093377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18380ae3f0 con 0x7f18380630b0 2023-08-31T19:06:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.769+0000 7f182dffb700 1 -- 172.21.15.72:0/1267093377 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834010a80 con 0x7f18380630b0 2023-08-31T19:06:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.769+0000 7f183fdff700 1 -- 172.21.15.72:0/1267093377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183814e120 con 0x7f18380630b0 2023-08-31T19:06:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.771+0000 7f183fdff700 1 -- 172.21.15.72:0/1267093377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183814e370 con 0x7f18380630b0 2023-08-31T19:06:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.771+0000 7f182dffb700 1 -- 172.21.15.72:0/1267093377 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f183401b460 con 0x7f18380630b0 2023-08-31T19:06:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.772+0000 7f182dffb700 1 --2- 172.21.15.72:0/1267093377 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f181c05ef30 0x7f181c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.772+0000 7f182dffb700 1 -- 172.21.15.72:0/1267093377 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6621+0+0 (secure 0 0 0) 0x7f183407a100 con 0x7f18380630b0 2023-08-31T19:06:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.773+0000 7f183d39a700 1 --2- 172.21.15.72:0/1267093377 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f181c05ef30 0x7f181c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.773+0000 7f183d39a700 1 --2- 172.21.15.72:0/1267093377 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f181c05ef30 0x7f181c0613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1828009130 tx=0x7f1828015000).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.777+0000 7f182dffb700 1 -- 172.21.15.72:0/1267093377 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f183404b1a0 con 0x7f18380630b0 2023-08-31T19:06:15.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.990+0000 7f183fdff700 1 -- 172.21.15.72:0/1267093377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f18380aa290 con 0x7f18380630b0 2023-08-31T19:06:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:15.996+0000 7f182dffb700 1 -- 172.21.15.72:0/1267093377 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v52) v1 ==== 174+0+0 (secure 0 0 0) 0x7f183404e7c0 con 0x7f18380630b0 2023-08-31T19:06:16.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.000+0000 7f183fdff700 1 -- 172.21.15.72:0/1267093377 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f181c05ef30 msgr2=0x7f181c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:16.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.000+0000 7f183fdff700 1 --2- 172.21.15.72:0/1267093377 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f181c05ef30 0x7f181c0613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1828009130 tx=0x7f1828015000).stop 2023-08-31T19:06:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.000+0000 7f183fdff700 1 -- 172.21.15.72:0/1267093377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18380630b0 msgr2=0x7f18380aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.000+0000 7f183fdff700 1 --2- 172.21.15.72:0/1267093377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18380630b0 0x7f18380aeed0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f183400c880 tx=0x7f1834008040).stop 2023-08-31T19:06:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.001+0000 7f183fdff700 1 -- 172.21.15.72:0/1267093377 shutdown_connections 2023-08-31T19:06:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.001+0000 7f183fdff700 1 --2- 172.21.15.72:0/1267093377 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f181c05ef30 0x7f181c0613f0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0x7f1828009130 tx=0x7f1828015000).stop 2023-08-31T19:06:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.001+0000 7f183fdff700 1 --2- 172.21.15.72:0/1267093377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1838153e30 0x7f18381476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.001+0000 7f183fdff700 1 --2- 172.21.15.72:0/1267093377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18380630b0 0x7f18380aeed0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.001+0000 7f183fdff700 1 --2- 172.21.15.72:0/1267093377 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18380c5cb0 0x7f183814dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.001+0000 7f183fdff700 1 -- 172.21.15.72:0/1267093377 >> 172.21.15.72:0/1267093377 conn(0x7f183805eb20 msgr2=0x7f1838151ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:16.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.004+0000 7f183fdff700 1 -- 172.21.15.72:0/1267093377 shutdown_connections 2023-08-31T19:06:16.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.005+0000 7f183fdff700 1 -- 172.21.15.72:0/1267093377 wait complete. 2023-08-31T19:06:16.013 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 15 and data pool 16 2023-08-31T19:06:16.036 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:06:16.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.226+0000 7fd8309ff700 1 Processor -- start 2023-08-31T19:06:16.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.226+0000 7fd8309ff700 1 -- start start 2023-08-31T19:06:16.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.227+0000 7fd8309ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd82c0cb9b0 0x7fd82c1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:16.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.227+0000 7fd8309ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd82c1588d0 0x7fd82c154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:16.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.227+0000 7fd8309ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82c0c6120 con 0x7fd82c154060 2023-08-31T19:06:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.227+0000 7fd8309ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82c0c1380 con 0x7fd82c0cb9b0 2023-08-31T19:06:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.227+0000 7fd8309ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82c0c5e10 con 0x7fd82c1588d0 2023-08-31T19:06:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.227+0000 7fd829d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd82c0cb9b0 0x7fd82c1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.227+0000 7fd829d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd82c0cb9b0 0x7fd82c1583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58412/0 (socket says 172.21.15.72:58412) 2023-08-31T19:06:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.228+0000 7fd829d9b700 1 -- 172.21.15.72:0/1774591667 learned_addr learned my addr 172.21.15.72:0/1774591667 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:16.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.228+0000 7fd82ad9d700 1 --2- 172.21.15.72:0/1774591667 >> v2:172.21.15.146:3300/0 conn(0x7fd82c1588d0 0x7fd82c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:16.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.228+0000 7fd829d9b700 1 -- 172.21.15.72:0/1774591667 >> v2:172.21.15.146:3300/0 conn(0x7fd82c1588d0 msgr2=0x7fd82c154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:16.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.228+0000 7fd829d9b700 1 --2- 172.21.15.72:0/1774591667 >> v2:172.21.15.146:3300/0 conn(0x7fd82c1588d0 0x7fd82c154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.228+0000 7fd829d9b700 1 -- 172.21.15.72:0/1774591667 >> v1:172.21.15.146:6789/0 conn(0x7fd82c154060 legacy=0x7fd82c157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:16.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.228+0000 7fd829d9b700 1 -- 172.21.15.72:0/1774591667 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c0c0ae0 con 0x7fd82c0cb9b0 2023-08-31T19:06:16.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.228+0000 7fd829d9b700 1 --2- 172.21.15.72:0/1774591667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd82c0cb9b0 0x7fd82c1583e0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7fd82c0844d0 tx=0x7fd8200090f0).ready entity=mon.0 client_cookie=eb0783b9489781b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.228+0000 7fd82959a700 1 -- 172.21.15.72:0/1774591667 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000b600 con 0x7fd82c0cb9b0 2023-08-31T19:06:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.228+0000 7fd82959a700 1 -- 172.21.15.72:0/1774591667 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82000b760 con 0x7fd82c0cb9b0 2023-08-31T19:06:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.228+0000 7fd82959a700 1 -- 172.21.15.72:0/1774591667 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000bae0 con 0x7fd82c0cb9b0 2023-08-31T19:06:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.229+0000 7fd8309ff700 1 -- 172.21.15.72:0/1774591667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd82c0cb9b0 msgr2=0x7fd82c1583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.229+0000 7fd8309ff700 1 --2- 172.21.15.72:0/1774591667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd82c0cb9b0 0x7fd82c1583e0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7fd82c0844d0 tx=0x7fd8200090f0).stop 2023-08-31T19:06:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.229+0000 7fd8309ff700 1 -- 172.21.15.72:0/1774591667 shutdown_connections 2023-08-31T19:06:16.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.229+0000 7fd8309ff700 1 --2- 172.21.15.72:0/1774591667 >> v2:172.21.15.146:3300/0 conn(0x7fd82c1588d0 0x7fd82c154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.229+0000 7fd8309ff700 1 --2- 172.21.15.72:0/1774591667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd82c0cb9b0 0x7fd82c1583e0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.229+0000 7fd8309ff700 1 -- 172.21.15.72:0/1774591667 >> 172.21.15.72:0/1774591667 conn(0x7fd82c05e870 msgr2=0x7fd82c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:16.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.229+0000 7fd8309ff700 1 -- 172.21.15.72:0/1774591667 shutdown_connections 2023-08-31T19:06:16.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.229+0000 7fd8309ff700 1 -- 172.21.15.72:0/1774591667 wait complete. 2023-08-31T19:06:16.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.231+0000 7fd8309ff700 1 Processor -- start 2023-08-31T19:06:16.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.231+0000 7fd8309ff700 1 -- start start 2023-08-31T19:06:16.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd8309ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd82c0cb9b0 0x7fd82c1517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:16.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd8309ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd82c154060 0x7fd82c14b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:16.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd8309ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd82c1588d0 0x7fd82c14fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:16.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd8309ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c0b0d00 con 0x7fd82c154060 2023-08-31T19:06:16.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd8309ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c150200 con 0x7fd82c1588d0 2023-08-31T19:06:16.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd8309ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c150d80 con 0x7fd82c0cb9b0 2023-08-31T19:06:16.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd829d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd82c154060 0x7fd82c14b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:16.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd829d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd82c154060 0x7fd82c14b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58420/0 (socket says 172.21.15.72:58420) 2023-08-31T19:06:16.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd829d9b700 1 -- 172.21.15.72:0/4287445898 learned_addr learned my addr 172.21.15.72:0/4287445898 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:16.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd82a59c700 1 --2- 172.21.15.72:0/4287445898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd82c0cb9b0 0x7fd82c1517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:16.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd82ad9d700 1 --2- 172.21.15.72:0/4287445898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd82c1588d0 0x7fd82c14fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:16.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd829d9b700 1 -- 172.21.15.72:0/4287445898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd82c0cb9b0 msgr2=0x7fd82c1517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:16.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd829d9b700 1 --2- 172.21.15.72:0/4287445898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd82c0cb9b0 0x7fd82c1517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd829d9b700 1 -- 172.21.15.72:0/4287445898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd82c1588d0 msgr2=0x7fd82c14fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:16.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd829d9b700 1 --2- 172.21.15.72:0/4287445898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd82c1588d0 0x7fd82c14fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd829d9b700 1 -- 172.21.15.72:0/4287445898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd820009370 con 0x7fd82c154060 2023-08-31T19:06:16.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.232+0000 7fd82a59c700 1 --2- 172.21.15.72:0/4287445898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd82c0cb9b0 0x7fd82c1517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:16.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.233+0000 7fd829d9b700 1 --2- 172.21.15.72:0/4287445898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd82c154060 0x7fd82c14b190 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7fd82c083570 tx=0x7fd820017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:16.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.233+0000 7fd81a7fc700 1 -- 172.21.15.72:0/4287445898 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000b8d0 con 0x7fd82c154060 2023-08-31T19:06:16.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.233+0000 7fd81a7fc700 1 -- 172.21.15.72:0/4287445898 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82000ba30 con 0x7fd82c154060 2023-08-31T19:06:16.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.233+0000 7fd81a7fc700 1 -- 172.21.15.72:0/4287445898 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82001b660 con 0x7fd82c154060 2023-08-31T19:06:16.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.233+0000 7fd8309ff700 1 -- 172.21.15.72:0/4287445898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82c14bfc0 con 0x7fd82c154060 2023-08-31T19:06:16.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.233+0000 7fd8309ff700 1 -- 172.21.15.72:0/4287445898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82c150730 con 0x7fd82c154060 2023-08-31T19:06:16.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.234+0000 7fd8309ff700 1 -- 172.21.15.72:0/4287445898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82c06c6b0 con 0x7fd82c154060 2023-08-31T19:06:16.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.235+0000 7fd81a7fc700 1 -- 172.21.15.72:0/4287445898 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd82001ba10 con 0x7fd82c154060 2023-08-31T19:06:16.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.236+0000 7fd81a7fc700 1 --2- 172.21.15.72:0/4287445898 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd80c05ef30 0x7fd80c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:16.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.236+0000 7fd81a7fc700 1 -- 172.21.15.72:0/4287445898 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6721+0+0 (secure 0 0 0) 0x7fd82007bd00 con 0x7fd82c154060 2023-08-31T19:06:16.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.236+0000 7fd82a59c700 1 --2- 172.21.15.72:0/4287445898 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd80c05ef30 0x7fd80c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:16.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.236+0000 7fd82a59c700 1 --2- 172.21.15.72:0/4287445898 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd80c05ef30 0x7fd80c0613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd81c001780 tx=0x7fd81c009040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:16.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.240+0000 7fd81a7fc700 1 -- 172.21.15.72:0/4287445898 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd82004ccd0 con 0x7fd82c154060 2023-08-31T19:06:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.410+0000 7fd8309ff700 1 -- 172.21.15.72:0/4287445898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd82c0c0dc0 con 0x7fd82c154060 2023-08-31T19:06:16.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.411+0000 7fd81a7fc700 1 -- 172.21.15.72:0/4287445898 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+17959 (secure 0 0 0) 0x7fd82001f020 con 0x7fd82c154060 2023-08-31T19:06:16.412 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:06:16.412 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":125,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:06:15.991849+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:06:13.809620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-31T19:06:14.978639+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:06:16.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.413+0000 7fd8309ff700 1 -- 172.21.15.72:0/4287445898 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd80c05ef30 msgr2=0x7fd80c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:16.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.413+0000 7fd8309ff700 1 --2- 172.21.15.72:0/4287445898 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd80c05ef30 0x7fd80c0613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd81c001780 tx=0x7fd81c009040).stop 2023-08-31T19:06:16.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.413+0000 7fd8309ff700 1 -- 172.21.15.72:0/4287445898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd82c154060 msgr2=0x7fd82c14b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:16.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.413+0000 7fd8309ff700 1 --2- 172.21.15.72:0/4287445898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd82c154060 0x7fd82c14b190 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7fd82c083570 tx=0x7fd820017000).stop 2023-08-31T19:06:16.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.413+0000 7fd8309ff700 1 -- 172.21.15.72:0/4287445898 shutdown_connections 2023-08-31T19:06:16.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.413+0000 7fd8309ff700 1 --2- 172.21.15.72:0/4287445898 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd80c05ef30 0x7fd80c0613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.413+0000 7fd8309ff700 1 --2- 172.21.15.72:0/4287445898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd82c1588d0 0x7fd82c14fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.413+0000 7fd8309ff700 1 --2- 172.21.15.72:0/4287445898 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd82c0cb9b0 0x7fd82c1517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.413+0000 7fd8309ff700 1 --2- 172.21.15.72:0/4287445898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd82c154060 0x7fd82c14b190 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.413+0000 7fd8309ff700 1 -- 172.21.15.72:0/4287445898 >> 172.21.15.72:0/4287445898 conn(0x7fd82c05e870 msgr2=0x7fd82c0c6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:16.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.413+0000 7fd8309ff700 1 -- 172.21.15.72:0/4287445898 shutdown_connections 2023-08-31T19:06:16.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.413+0000 7fd8309ff700 1 -- 172.21.15.72:0/4287445898 wait complete. 2023-08-31T19:06:16.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:06:16.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.619+0000 7f95d6fff700 1 Processor -- start 2023-08-31T19:06:16.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.619+0000 7f95d6fff700 1 -- start start 2023-08-31T19:06:16.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.620+0000 7f95d6fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95d0154060 0x7f95d0157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:16.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.620+0000 7f95d6fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f95d00cb9b0 0x7f95d01581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:16.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.620+0000 7f95d6fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d0158b40 con 0x7f95d01586b0 2023-08-31T19:06:16.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.620+0000 7f95d6fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d00c1380 con 0x7f95d00cb9b0 2023-08-31T19:06:16.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.620+0000 7f95d6fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00c6120 con 0x7f95d0154060 2023-08-31T19:06:16.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.621+0000 7f95d4d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95d0154060 0x7f95d0157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:16.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.621+0000 7f95d559c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f95d01586b0 0x7f95d00c65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:40682/0 (socket says 172.21.15.72:40682) 2023-08-31T19:06:16.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.621+0000 7f95d4d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95d0154060 0x7f95d0157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:60734/0 (socket says 172.21.15.72:60734) 2023-08-31T19:06:16.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.621+0000 7f95d559c700 1 -- 172.21.15.72:0/655389171 learned_addr learned my addr 172.21.15.72:0/655389171 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:16.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.621+0000 7f95cffff700 1 --2- 172.21.15.72:0/655389171 >> v2:172.21.15.146:3300/0 conn(0x7f95d00cb9b0 0x7f95d01581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:16.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.622+0000 7f95cf7fe700 1 -- 172.21.15.72:0/655389171 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239401840 0 0) 0x7f95c8001490 con 0x7f95d01586b0 2023-08-31T19:06:16.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.622+0000 7f95cf7fe700 1 -- 172.21.15.72:0/655389171 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95c00033f0 con 0x7f95d01586b0 2023-08-31T19:06:16.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.622+0000 7f95d4d9b700 1 -- 172.21.15.72:0/655389171 >> v2:172.21.15.146:3300/0 conn(0x7f95d00cb9b0 msgr2=0x7f95d01581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:16.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.622+0000 7f95d4d9b700 1 --2- 172.21.15.72:0/655389171 >> v2:172.21.15.146:3300/0 conn(0x7f95d00cb9b0 0x7f95d01581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.622+0000 7f95d4d9b700 1 -- 172.21.15.72:0/655389171 >> v1:172.21.15.146:6789/0 conn(0x7f95d01586b0 legacy=0x7f95d00c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:16.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.622+0000 7f95d4d9b700 1 -- 172.21.15.72:0/655389171 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d00c5e10 con 0x7f95d0154060 2023-08-31T19:06:16.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.622+0000 7f95cffff700 1 --2- 172.21.15.72:0/655389171 >> v2:172.21.15.146:3300/0 conn(0x7f95d00cb9b0 0x7f95d01581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:06:16.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.622+0000 7f95d4d9b700 1 --2- 172.21.15.72:0/655389171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95d0154060 0x7f95d0157cd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f95c4006fd0 tx=0x7f95c4006f40).ready entity=mon.2 client_cookie=50f2122bc5471e59 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:16.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.622+0000 7f95cf7fe700 1 -- 172.21.15.72:0/655389171 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4005880 con 0x7f95d0154060 2023-08-31T19:06:16.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.622+0000 7f95cf7fe700 1 -- 172.21.15.72:0/655389171 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c40059e0 con 0x7f95d0154060 2023-08-31T19:06:16.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.622+0000 7f95cf7fe700 1 -- 172.21.15.72:0/655389171 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4005d60 con 0x7f95d0154060 2023-08-31T19:06:16.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.623+0000 7f95d6fff700 1 -- 172.21.15.72:0/655389171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95d0154060 msgr2=0x7f95d0157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:16.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.623+0000 7f95d6fff700 1 --2- 172.21.15.72:0/655389171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95d0154060 0x7f95d0157cd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f95c4006fd0 tx=0x7f95c4006f40).stop 2023-08-31T19:06:16.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.623+0000 7f95d6fff700 1 -- 172.21.15.72:0/655389171 shutdown_connections 2023-08-31T19:06:16.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.623+0000 7f95d6fff700 1 --2- 172.21.15.72:0/655389171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95d0154060 0x7f95d0157cd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.623+0000 7f95d6fff700 1 --2- 172.21.15.72:0/655389171 >> v2:172.21.15.146:3300/0 conn(0x7f95d00cb9b0 0x7f95d01581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.623+0000 7f95d6fff700 1 -- 172.21.15.72:0/655389171 >> 172.21.15.72:0/655389171 conn(0x7f95d005e870 msgr2=0x7f95d00cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:16.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.623+0000 7f95d6fff700 1 -- 172.21.15.72:0/655389171 shutdown_connections 2023-08-31T19:06:16.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.623+0000 7f95d6fff700 1 -- 172.21.15.72:0/655389171 wait complete. 2023-08-31T19:06:16.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.624+0000 7f95d6fff700 1 Processor -- start 2023-08-31T19:06:16.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.624+0000 7f95d6fff700 1 -- start start 2023-08-31T19:06:16.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.625+0000 7f95d6fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95d00cb9b0 0x7f95d0165260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:16.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.625+0000 7f95d6fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d0154060 0x7f95d00afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:16.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.625+0000 7f95d6fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d01586b0 0x7f95d013ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:16.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.625+0000 7f95d6fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00b0ca0 con 0x7f95d0154060 2023-08-31T19:06:16.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.625+0000 7f95d6fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d0165a30 con 0x7f95d01586b0 2023-08-31T19:06:16.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.625+0000 7f95d6fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00b0400 con 0x7f95d00cb9b0 2023-08-31T19:06:16.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.626+0000 7f95cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d0154060 0x7f95d00afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:16.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.626+0000 7f95cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d0154060 0x7f95d00afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58434/0 (socket says 172.21.15.72:58434) 2023-08-31T19:06:16.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.626+0000 7f95cffff700 1 -- 172.21.15.72:0/2583599274 learned_addr learned my addr 172.21.15.72:0/2583599274 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:16.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.626+0000 7f95d4d9b700 1 --2- 172.21.15.72:0/2583599274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95d00cb9b0 0x7f95d0165260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:16.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.626+0000 7f95d559c700 1 --2- 172.21.15.72:0/2583599274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d01586b0 0x7f95d013ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:16.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.626+0000 7f95cffff700 1 -- 172.21.15.72:0/2583599274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95d00cb9b0 msgr2=0x7f95d0165260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:16.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.626+0000 7f95cffff700 1 --2- 172.21.15.72:0/2583599274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95d00cb9b0 0x7f95d0165260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.626+0000 7f95cffff700 1 -- 172.21.15.72:0/2583599274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d01586b0 msgr2=0x7f95d013ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.626+0000 7f95cffff700 1 --2- 172.21.15.72:0/2583599274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d01586b0 0x7f95d013ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.626+0000 7f95cffff700 1 -- 172.21.15.72:0/2583599274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc0092a0 con 0x7f95d0154060 2023-08-31T19:06:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.626+0000 7f95cffff700 1 --2- 172.21.15.72:0/2583599274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d0154060 0x7f95d00afb40 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f95bc00ea50 tx=0x7f95bc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.626+0000 7f95ccff9700 1 -- 172.21.15.72:0/2583599274 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00c640 con 0x7f95d0154060 2023-08-31T19:06:16.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.626+0000 7f95ccff9700 1 -- 172.21.15.72:0/2583599274 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc00c7a0 con 0x7f95d0154060 2023-08-31T19:06:16.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.626+0000 7f95ccff9700 1 -- 172.21.15.72:0/2583599274 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00cb20 con 0x7f95d0154060 2023-08-31T19:06:16.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.626+0000 7f95d6fff700 1 -- 172.21.15.72:0/2583599274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c4009250 con 0x7f95d0154060 2023-08-31T19:06:16.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.627+0000 7f95d6fff700 1 -- 172.21.15.72:0/2583599274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d00b09c0 con 0x7f95d0154060 2023-08-31T19:06:16.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.628+0000 7f95d6fff700 1 -- 172.21.15.72:0/2583599274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d006c6b0 con 0x7f95d0154060 2023-08-31T19:06:16.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.628+0000 7f95ccff9700 1 -- 172.21.15.72:0/2583599274 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f95bc0123f0 con 0x7f95d0154060 2023-08-31T19:06:16.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.629+0000 7f95ccff9700 1 --2- 172.21.15.72:0/2583599274 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f95b405ef30 0x7f95b40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:16.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.629+0000 7f95ccff9700 1 -- 172.21.15.72:0/2583599274 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f95bc07a0c0 con 0x7f95d0154060 2023-08-31T19:06:16.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.630+0000 7f95d4d9b700 1 --2- 172.21.15.72:0/2583599274 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f95b405ef30 0x7f95b40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:16.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.630+0000 7f95d4d9b700 1 --2- 172.21.15.72:0/2583599274 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f95b405ef30 0x7f95b40613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f95c4005fd0 tx=0x7f95c4015000).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:16.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.633+0000 7f95ccff9700 1 -- 172.21.15.72:0/2583599274 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f95bc04b0f0 con 0x7f95d0154060 2023-08-31T19:06:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.802+0000 7f95d6fff700 1 -- 172.21.15.72:0/2583599274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95d00c0ae0 con 0x7f95d0154060 2023-08-31T19:06:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.803+0000 7f95ccff9700 1 -- 172.21.15.72:0/2583599274 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+17959 (secure 0 0 0) 0x7f95bc04e710 con 0x7f95d0154060 2023-08-31T19:06:16.804 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:06:16.804 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":125,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:06:15.991849+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:06:13.809620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-31T19:06:14.978639+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:06:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.805+0000 7f95d6fff700 1 -- 172.21.15.72:0/2583599274 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f95b405ef30 msgr2=0x7f95b40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.805+0000 7f95d6fff700 1 --2- 172.21.15.72:0/2583599274 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f95b405ef30 0x7f95b40613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f95c4005fd0 tx=0x7f95c4015000).stop 2023-08-31T19:06:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.805+0000 7f95d6fff700 1 -- 172.21.15.72:0/2583599274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d0154060 msgr2=0x7f95d00afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.805+0000 7f95d6fff700 1 --2- 172.21.15.72:0/2583599274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d0154060 0x7f95d00afb40 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f95bc00ea50 tx=0x7f95bc009060).stop 2023-08-31T19:06:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.805+0000 7f95d6fff700 1 -- 172.21.15.72:0/2583599274 shutdown_connections 2023-08-31T19:06:16.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.805+0000 7f95d6fff700 1 --2- 172.21.15.72:0/2583599274 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f95b405ef30 0x7f95b40613f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.805+0000 7f95d6fff700 1 --2- 172.21.15.72:0/2583599274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d01586b0 0x7f95d013ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.805+0000 7f95d6fff700 1 --2- 172.21.15.72:0/2583599274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f95d00cb9b0 0x7f95d0165260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.805+0000 7f95d6fff700 1 --2- 172.21.15.72:0/2583599274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d0154060 0x7f95d00afb40 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:16.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.805+0000 7f95d6fff700 1 -- 172.21.15.72:0/2583599274 >> 172.21.15.72:0/2583599274 conn(0x7f95d005e870 msgr2=0x7f95d0063090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:16.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.805+0000 7f95d6fff700 1 -- 172.21.15.72:0/2583599274 shutdown_connections 2023-08-31T19:06:16.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:16.805+0000 7f95d6fff700 1 -- 172.21.15.72:0/2583599274 wait complete. 2023-08-31T19:06:16.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T19:06:17.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.017+0000 7f536d3ff700 1 Processor -- start 2023-08-31T19:06:17.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.017+0000 7f536d3ff700 1 -- start start 2023-08-31T19:06:17.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.018+0000 7f536d3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5368138350 0x7f53680c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:17.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.018+0000 7f536d3ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5368138730 0x7f53680c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:17.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.018+0000 7f536d3ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53680c1f80 con 0x7f53680c2a20 2023-08-31T19:06:17.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.018+0000 7f536d3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53680c2600 con 0x7f5368138350 2023-08-31T19:06:17.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.018+0000 7f536d3ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53680c3eb0 con 0x7f5368138730 2023-08-31T19:06:17.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.018+0000 7f5366ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5368138350 0x7f53680c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:17.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.018+0000 7f5366ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5368138350 0x7f53680c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58448/0 (socket says 172.21.15.72:58448) 2023-08-31T19:06:17.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.018+0000 7f5366ffd700 1 -- 172.21.15.72:0/2698328558 learned_addr learned my addr 172.21.15.72:0/2698328558 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:17.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.019+0000 7f53677fe700 1 --2- 172.21.15.72:0/2698328558 >> v2:172.21.15.146:3300/0 conn(0x7f5368138730 0x7f53680c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.019+0000 7f5366ffd700 1 -- 172.21.15.72:0/2698328558 >> v2:172.21.15.146:3300/0 conn(0x7f5368138730 msgr2=0x7f53680c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.019+0000 7f5366ffd700 1 --2- 172.21.15.72:0/2698328558 >> v2:172.21.15.146:3300/0 conn(0x7f5368138730 0x7f53680c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.019+0000 7f5366ffd700 1 -- 172.21.15.72:0/2698328558 >> v1:172.21.15.146:6789/0 conn(0x7f53680c2a20 legacy=0x7f53680bdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.019+0000 7f5366ffd700 1 -- 172.21.15.72:0/2698328558 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53680bbd70 con 0x7f5368138350 2023-08-31T19:06:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.019+0000 7f5366ffd700 1 --2- 172.21.15.72:0/2698328558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368138350 0x7f53680c34d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f53680bc520 tx=0x7f53580090f0).ready entity=mon.0 client_cookie=d50392c0e72499c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.019+0000 7f5365ffb700 1 -- 172.21.15.72:0/2698328558 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535800b520 con 0x7f5368138350 2023-08-31T19:06:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.019+0000 7f5365ffb700 1 -- 172.21.15.72:0/2698328558 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535800b680 con 0x7f5368138350 2023-08-31T19:06:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.019+0000 7f5365ffb700 1 -- 172.21.15.72:0/2698328558 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535800ba20 con 0x7f5368138350 2023-08-31T19:06:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.020+0000 7f536d3ff700 1 -- 172.21.15.72:0/2698328558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368138350 msgr2=0x7f53680c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.020+0000 7f536d3ff700 1 --2- 172.21.15.72:0/2698328558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368138350 0x7f53680c34d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f53680bc520 tx=0x7f53580090f0).stop 2023-08-31T19:06:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.020+0000 7f536d3ff700 1 -- 172.21.15.72:0/2698328558 shutdown_connections 2023-08-31T19:06:17.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.020+0000 7f536d3ff700 1 --2- 172.21.15.72:0/2698328558 >> v2:172.21.15.146:3300/0 conn(0x7f5368138730 0x7f53680c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.020+0000 7f536d3ff700 1 --2- 172.21.15.72:0/2698328558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368138350 0x7f53680c34d0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.020+0000 7f536d3ff700 1 -- 172.21.15.72:0/2698328558 >> 172.21.15.72:0/2698328558 conn(0x7f536805eb60 msgr2=0x7f5368062650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.020+0000 7f536d3ff700 1 -- 172.21.15.72:0/2698328558 shutdown_connections 2023-08-31T19:06:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.020+0000 7f536d3ff700 1 -- 172.21.15.72:0/2698328558 wait complete. 2023-08-31T19:06:17.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.022+0000 7f536d3ff700 1 Processor -- start 2023-08-31T19:06:17.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.022+0000 7f536d3ff700 1 -- start start 2023-08-31T19:06:17.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f536d3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5368138730 0x7f53681533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:17.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f536d3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5368136500 0x7f5368154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:17.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f536d3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368136980 0x7f5368154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:17.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f536d3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5368155020 con 0x7f5368136980 2023-08-31T19:06:17.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f536d3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53681526f0 con 0x7f5368136500 2023-08-31T19:06:17.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f536d3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5368152f50 con 0x7f5368138730 2023-08-31T19:06:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f53677fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368136980 0x7f5368154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f53677fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368136980 0x7f5368154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58454/0 (socket says 172.21.15.72:58454) 2023-08-31T19:06:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f53677fe700 1 -- 172.21.15.72:0/3469437254 learned_addr learned my addr 172.21.15.72:0/3469437254 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f5366ffd700 1 --2- 172.21.15.72:0/3469437254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5368138730 0x7f53681533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:17.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f53667fc700 1 --2- 172.21.15.72:0/3469437254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5368136500 0x7f5368154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:17.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f53677fe700 1 -- 172.21.15.72:0/3469437254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5368138730 msgr2=0x7f53681533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:17.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f53677fe700 1 --2- 172.21.15.72:0/3469437254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5368138730 0x7f53681533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:17.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f53677fe700 1 -- 172.21.15.72:0/3469437254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5368136500 msgr2=0x7f5368154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:17.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f53677fe700 1 --2- 172.21.15.72:0/3469437254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5368136500 0x7f5368154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:17.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f53677fe700 1 -- 172.21.15.72:0/3469437254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5358009370 con 0x7f5368136980 2023-08-31T19:06:17.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f53667fc700 1 --2- 172.21.15.72:0/3469437254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5368136500 0x7f5368154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:17.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.023+0000 7f53677fe700 1 --2- 172.21.15.72:0/3469437254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368136980 0x7f5368154770 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f5360009d70 tx=0x7f536000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:17.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.024+0000 7f534effd700 1 -- 172.21.15.72:0/3469437254 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536000cb50 con 0x7f5368136980 2023-08-31T19:06:17.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.024+0000 7f534effd700 1 -- 172.21.15.72:0/3469437254 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536000f040 con 0x7f5368136980 2023-08-31T19:06:17.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.024+0000 7f534effd700 1 -- 172.21.15.72:0/3469437254 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5360013400 con 0x7f5368136980 2023-08-31T19:06:17.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.024+0000 7f536d3ff700 1 -- 172.21.15.72:0/3469437254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53681538d0 con 0x7f5368136980 2023-08-31T19:06:17.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.024+0000 7f536d3ff700 1 -- 172.21.15.72:0/3469437254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5368152900 con 0x7f5368136980 2023-08-31T19:06:17.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.025+0000 7f536d3ff700 1 -- 172.21.15.72:0/3469437254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53681530c0 con 0x7f5368136980 2023-08-31T19:06:17.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.026+0000 7f534effd700 1 -- 172.21.15.72:0/3469437254 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f53600137b0 con 0x7f5368136980 2023-08-31T19:06:17.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.027+0000 7f534effd700 1 --2- 172.21.15.72:0/3469437254 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f535405ef00 0x7f53540613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:17.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.027+0000 7f534effd700 1 -- 172.21.15.72:0/3469437254 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f536007a9c0 con 0x7f5368136980 2023-08-31T19:06:17.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.027+0000 7f5366ffd700 1 --2- 172.21.15.72:0/3469437254 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f535405ef00 0x7f53540613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:17.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.028+0000 7f5366ffd700 1 --2- 172.21.15.72:0/3469437254 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f535405ef00 0x7f53540613c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f535800b2e0 tx=0x7f5358017000).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:17.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.031+0000 7f534effd700 1 -- 172.21.15.72:0/3469437254 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f536004ba50 con 0x7f5368136980 2023-08-31T19:06:17.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:17.242+0000 7f536d3ff700 1 -- 172.21.15.72:0/3469437254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f536806c6b0 con 0x7f5368136980 2023-08-31T19:06:18.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.009+0000 7f534effd700 1 -- 172.21.15.72:0/3469437254 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) v1 ==== 118+0+0 (secure 0 0 0) 0x7f536004f070 con 0x7f5368136980 2023-08-31T19:06:18.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.013+0000 7f536d3ff700 1 -- 172.21.15.72:0/3469437254 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f535405ef00 msgr2=0x7f53540613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:18.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.013+0000 7f536d3ff700 1 --2- 172.21.15.72:0/3469437254 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f535405ef00 0x7f53540613c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f535800b2e0 tx=0x7f5358017000).stop 2023-08-31T19:06:18.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.013+0000 7f536d3ff700 1 -- 172.21.15.72:0/3469437254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368136980 msgr2=0x7f5368154770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:18.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.013+0000 7f536d3ff700 1 --2- 172.21.15.72:0/3469437254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368136980 0x7f5368154770 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f5360009d70 tx=0x7f536000b040).stop 2023-08-31T19:06:18.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.013+0000 7f536d3ff700 1 -- 172.21.15.72:0/3469437254 shutdown_connections 2023-08-31T19:06:18.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.013+0000 7f536d3ff700 1 --2- 172.21.15.72:0/3469437254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5368136980 0x7f5368154770 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:18.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.013+0000 7f536d3ff700 1 --2- 172.21.15.72:0/3469437254 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5368138730 0x7f53681533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:18.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.013+0000 7f536d3ff700 1 --2- 172.21.15.72:0/3469437254 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f535405ef00 0x7f53540613c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:18.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.013+0000 7f536d3ff700 1 --2- 172.21.15.72:0/3469437254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5368136500 0x7f5368154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:18.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.013+0000 7f536d3ff700 1 -- 172.21.15.72:0/3469437254 >> 172.21.15.72:0/3469437254 conn(0x7f5368138350 msgr2=0x7f5368062650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:18.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.013+0000 7f536d3ff700 1 -- 172.21.15.72:0/3469437254 shutdown_connections 2023-08-31T19:06:18.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.013+0000 7f536d3ff700 1 -- 172.21.15.72:0/3469437254 wait complete. 2023-08-31T19:06:18.033 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-31T19:06:18.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T19:06:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.227+0000 7f89811ff700 1 Processor -- start 2023-08-31T19:06:18.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.227+0000 7f89811ff700 1 -- start start 2023-08-31T19:06:18.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.228+0000 7f89811ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f897c0c2320 0x7f897c0c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:18.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.228+0000 7f89811ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f897c0696a0 0x7f897c069b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:18.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.228+0000 7f89811ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f897c152720 con 0x7f897c14ecd0 2023-08-31T19:06:18.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.228+0000 7f89811ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897c0c2c90 con 0x7f897c0696a0 2023-08-31T19:06:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.228+0000 7f89811ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c151b10 con 0x7f897c0c2320 2023-08-31T19:06:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.229+0000 7f897b59e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f897c0696a0 0x7f897c069b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.229+0000 7f897b59e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f897c0696a0 0x7f897c069b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58470/0 (socket says 172.21.15.72:58470) 2023-08-31T19:06:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.229+0000 7f897b59e700 1 -- 172.21.15.72:0/2845262968 learned_addr learned my addr 172.21.15.72:0/2845262968 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.229+0000 7f897a59c700 1 --2- 172.21.15.72:0/2845262968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f897c0c2320 0x7f897c0c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:18.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.229+0000 7f897b59e700 1 -- 172.21.15.72:0/2845262968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f897c0c2320 msgr2=0x7f897c0c27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:18.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.229+0000 7f897b59e700 1 --2- 172.21.15.72:0/2845262968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f897c0c2320 0x7f897c0c27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:18.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.229+0000 7f897b59e700 1 -- 172.21.15.72:0/2845262968 >> v1:172.21.15.146:6789/0 conn(0x7f897c14ecd0 legacy=0x7f897c1556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:18.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.229+0000 7f8979d9b700 1 -- 172.21.15.72:0/2845262968 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734455803 0 0) 0x7f897c152720 con 0x7f897c14ecd0 2023-08-31T19:06:18.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.229+0000 7f897b59e700 1 -- 172.21.15.72:0/2845262968 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c151df0 con 0x7f897c0696a0 2023-08-31T19:06:18.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.229+0000 7f897b59e700 1 --2- 172.21.15.72:0/2845262968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c0696a0 0x7f897c069b30 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f897400d1a0 tx=0x7f897400ba50).ready entity=mon.0 client_cookie=e5668188c3ee0866 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:18.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.230+0000 7f8979d9b700 1 -- 172.21.15.72:0/2845262968 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974010070 con 0x7f897c0696a0 2023-08-31T19:06:18.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.230+0000 7f8979d9b700 1 -- 172.21.15.72:0/2845262968 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897400de10 con 0x7f897c0696a0 2023-08-31T19:06:18.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.230+0000 7f8979d9b700 1 -- 172.21.15.72:0/2845262968 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897400b2e0 con 0x7f897c0696a0 2023-08-31T19:06:18.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.230+0000 7f89811ff700 1 -- 172.21.15.72:0/2845262968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c0696a0 msgr2=0x7f897c069b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:18.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.230+0000 7f89811ff700 1 --2- 172.21.15.72:0/2845262968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c0696a0 0x7f897c069b30 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f897400d1a0 tx=0x7f897400ba50).stop 2023-08-31T19:06:18.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.230+0000 7f89811ff700 1 -- 172.21.15.72:0/2845262968 shutdown_connections 2023-08-31T19:06:18.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.230+0000 7f89811ff700 1 --2- 172.21.15.72:0/2845262968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c0696a0 0x7f897c069b30 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.230+0000 7f89811ff700 1 --2- 172.21.15.72:0/2845262968 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f897c0c2320 0x7f897c0c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.230+0000 7f89811ff700 1 -- 172.21.15.72:0/2845262968 >> 172.21.15.72:0/2845262968 conn(0x7f897c0630c0 msgr2=0x7f897c0c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.230+0000 7f89811ff700 1 -- 172.21.15.72:0/2845262968 shutdown_connections 2023-08-31T19:06:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.230+0000 7f89811ff700 1 -- 172.21.15.72:0/2845262968 wait complete. 2023-08-31T19:06:18.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.232+0000 7f89811ff700 1 Processor -- start 2023-08-31T19:06:18.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.232+0000 7f89811ff700 1 -- start start 2023-08-31T19:06:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.233+0000 7f89811ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f897c0696a0 0x7f897c0ac400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.233+0000 7f89811ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f897c0c2320 0x7f897c137250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.233+0000 7f89811ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c14ecd0 0x7f897c0a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.233+0000 7f89811ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c137740 con 0x7f897c14ecd0 2023-08-31T19:06:18.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.233+0000 7f89811ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c0abf70 con 0x7f897c0696a0 2023-08-31T19:06:18.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.233+0000 7f89811ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c164040 con 0x7f897c0c2320 2023-08-31T19:06:18.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.233+0000 7f897b59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c14ecd0 0x7f897c0a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:18.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.233+0000 7f897b59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c14ecd0 0x7f897c0a9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58482/0 (socket says 172.21.15.72:58482) 2023-08-31T19:06:18.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.233+0000 7f897b59e700 1 -- 172.21.15.72:0/2536179650 learned_addr learned my addr 172.21.15.72:0/2536179650 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:18.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.234+0000 7f897a59c700 1 --2- 172.21.15.72:0/2536179650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f897c0c2320 0x7f897c137250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.234+0000 7f897ad9d700 1 --2- 172.21.15.72:0/2536179650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f897c0696a0 0x7f897c0ac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.234+0000 7f897b59e700 1 -- 172.21.15.72:0/2536179650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f897c0c2320 msgr2=0x7f897c137250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.234+0000 7f897b59e700 1 --2- 172.21.15.72:0/2536179650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f897c0c2320 0x7f897c137250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.234+0000 7f897b59e700 1 -- 172.21.15.72:0/2536179650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f897c0696a0 msgr2=0x7f897c0ac400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.234+0000 7f897b59e700 1 --2- 172.21.15.72:0/2536179650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f897c0696a0 0x7f897c0ac400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:18.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.234+0000 7f897b59e700 1 -- 172.21.15.72:0/2536179650 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897400bcf0 con 0x7f897c14ecd0 2023-08-31T19:06:18.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.234+0000 7f897ad9d700 1 --2- 172.21.15.72:0/2536179650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f897c0696a0 0x7f897c0ac400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:18.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.234+0000 7f897b59e700 1 --2- 172.21.15.72:0/2536179650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c14ecd0 0x7f897c0a9f60 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f897c0634d0 tx=0x7f897400ba50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:18.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.234+0000 7f8962ffd700 1 -- 172.21.15.72:0/2536179650 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897400b1a0 con 0x7f897c14ecd0 2023-08-31T19:06:18.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.234+0000 7f8962ffd700 1 -- 172.21.15.72:0/2536179650 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8974015420 con 0x7f897c14ecd0 2023-08-31T19:06:18.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.234+0000 7f89811ff700 1 -- 172.21.15.72:0/2536179650 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897c0ab360 con 0x7f897c14ecd0 2023-08-31T19:06:18.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.234+0000 7f8962ffd700 1 -- 172.21.15.72:0/2536179650 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89740157c0 con 0x7f897c14ecd0 2023-08-31T19:06:18.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.234+0000 7f89811ff700 1 -- 172.21.15.72:0/2536179650 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897c0ab920 con 0x7f897c14ecd0 2023-08-31T19:06:18.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.235+0000 7f89811ff700 1 -- 172.21.15.72:0/2536179650 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897c0c0d20 con 0x7f897c14ecd0 2023-08-31T19:06:18.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.236+0000 7f8962ffd700 1 -- 172.21.15.72:0/2536179650 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8974015b30 con 0x7f897c14ecd0 2023-08-31T19:06:18.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.237+0000 7f8962ffd700 1 --2- 172.21.15.72:0/2536179650 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f896805ef30 0x7f89680613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:18.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.237+0000 7f8962ffd700 1 -- 172.21.15.72:0/2536179650 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f897407b6f0 con 0x7f897c14ecd0 2023-08-31T19:06:18.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.237+0000 7f897ad9d700 1 --2- 172.21.15.72:0/2536179650 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f896805ef30 0x7f89680613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:18.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.238+0000 7f897ad9d700 1 --2- 172.21.15.72:0/2536179650 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f896805ef30 0x7f89680613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f896c0016f0 tx=0x7f896c009040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:18.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.241+0000 7f8962ffd700 1 -- 172.21.15.72:0/2536179650 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f897404c770 con 0x7f897c14ecd0 2023-08-31T19:06:18.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:18.451+0000 7f89811ff700 1 -- 172.21.15.72:0/2536179650 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f897c1520d0 con 0x7f897c14ecd0 2023-08-31T19:06:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.013+0000 7f8962ffd700 1 -- 172.21.15.72:0/2536179650 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8974023020 con 0x7f897c14ecd0 2023-08-31T19:06:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.015+0000 7f89811ff700 1 -- 172.21.15.72:0/2536179650 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f896805ef30 msgr2=0x7f89680613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.015+0000 7f89811ff700 1 --2- 172.21.15.72:0/2536179650 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f896805ef30 0x7f89680613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f896c0016f0 tx=0x7f896c009040).stop 2023-08-31T19:06:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.015+0000 7f89811ff700 1 -- 172.21.15.72:0/2536179650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c14ecd0 msgr2=0x7f897c0a9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.015+0000 7f89811ff700 1 --2- 172.21.15.72:0/2536179650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c14ecd0 0x7f897c0a9f60 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7f897c0634d0 tx=0x7f897400ba50).stop 2023-08-31T19:06:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.015+0000 7f89811ff700 1 -- 172.21.15.72:0/2536179650 shutdown_connections 2023-08-31T19:06:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.015+0000 7f89811ff700 1 --2- 172.21.15.72:0/2536179650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f897c14ecd0 0x7f897c0a9f60 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.015+0000 7f89811ff700 1 --2- 172.21.15.72:0/2536179650 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f896805ef30 0x7f89680613f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.015+0000 7f89811ff700 1 --2- 172.21.15.72:0/2536179650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f897c0696a0 0x7f897c0ac400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.015+0000 7f89811ff700 1 --2- 172.21.15.72:0/2536179650 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f897c0c2320 0x7f897c137250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.015+0000 7f89811ff700 1 -- 172.21.15.72:0/2536179650 >> 172.21.15.72:0/2536179650 conn(0x7f897c0630c0 msgr2=0x7f897c069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.015+0000 7f89811ff700 1 -- 172.21.15.72:0/2536179650 shutdown_connections 2023-08-31T19:06:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.015+0000 7f89811ff700 1 -- 172.21.15.72:0/2536179650 wait complete. 2023-08-31T19:06:19.034 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T19:06:19.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:06:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.222+0000 7f58771ff700 1 Processor -- start 2023-08-31T19:06:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.224+0000 7f58771ff700 1 -- start start 2023-08-31T19:06:19.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.225+0000 7f58771ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5870154060 0x7f5870157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:19.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.225+0000 7f58771ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f58700cb9b0 0x7f58701581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:19.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.225+0000 7f58771ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58700c6120 con 0x7f58701586b0 2023-08-31T19:06:19.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.225+0000 7f58771ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58700c1380 con 0x7f5870154060 2023-08-31T19:06:19.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.225+0000 7f58771ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58700c5e10 con 0x7f58700cb9b0 2023-08-31T19:06:19.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.225+0000 7f5874f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5870154060 0x7f5870157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.225+0000 7f5874f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5870154060 0x7f5870157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58494/0 (socket says 172.21.15.72:58494) 2023-08-31T19:06:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.225+0000 7f5874f9b700 1 -- 172.21.15.72:0/1382069208 learned_addr learned my addr 172.21.15.72:0/1382069208 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f586ffff700 1 --2- 172.21.15.72:0/1382069208 >> v2:172.21.15.146:3300/0 conn(0x7f58700cb9b0 0x7f58701581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f5874f9b700 1 -- 172.21.15.72:0/1382069208 >> v2:172.21.15.146:3300/0 conn(0x7f58700cb9b0 msgr2=0x7f58701581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f5874f9b700 1 --2- 172.21.15.72:0/1382069208 >> v2:172.21.15.146:3300/0 conn(0x7f58700cb9b0 0x7f58701581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f5874f9b700 1 -- 172.21.15.72:0/1382069208 >> v1:172.21.15.146:6789/0 conn(0x7f58701586b0 legacy=0x7f58700c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f5874f9b700 1 -- 172.21.15.72:0/1382069208 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5870158b00 con 0x7f5870154060 2023-08-31T19:06:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f586ffff700 1 --2- 172.21.15.72:0/1382069208 >> v2:172.21.15.146:3300/0 conn(0x7f58700cb9b0 0x7f58701581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f5874f9b700 1 --2- 172.21.15.72:0/1382069208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5870154060 0x7f5870157cd0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f5870083190 tx=0x7f5864009060).ready entity=mon.0 client_cookie=521b2a05225c0f43 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f586f7fe700 1 -- 172.21.15.72:0/1382069208 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864005880 con 0x7f5870154060 2023-08-31T19:06:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f586f7fe700 1 -- 172.21.15.72:0/1382069208 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58640059e0 con 0x7f5870154060 2023-08-31T19:06:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f586f7fe700 1 -- 172.21.15.72:0/1382069208 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864005d60 con 0x7f5870154060 2023-08-31T19:06:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f58771ff700 1 -- 172.21.15.72:0/1382069208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5870154060 msgr2=0x7f5870157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f58771ff700 1 --2- 172.21.15.72:0/1382069208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5870154060 0x7f5870157cd0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f5870083190 tx=0x7f5864009060).stop 2023-08-31T19:06:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f58771ff700 1 -- 172.21.15.72:0/1382069208 shutdown_connections 2023-08-31T19:06:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f58771ff700 1 --2- 172.21.15.72:0/1382069208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5870154060 0x7f5870157cd0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f58771ff700 1 --2- 172.21.15.72:0/1382069208 >> v2:172.21.15.146:3300/0 conn(0x7f58700cb9b0 0x7f58701581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f58771ff700 1 -- 172.21.15.72:0/1382069208 >> 172.21.15.72:0/1382069208 conn(0x7f587005e870 msgr2=0x7f58700cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f58771ff700 1 -- 172.21.15.72:0/1382069208 shutdown_connections 2023-08-31T19:06:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.226+0000 7f58771ff700 1 -- 172.21.15.72:0/1382069208 wait complete. 2023-08-31T19:06:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.228+0000 7f58771ff700 1 Processor -- start 2023-08-31T19:06:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.228+0000 7f58771ff700 1 -- start start 2023-08-31T19:06:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.229+0000 7f58771ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58700cb9b0 0x7f58700ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.229+0000 7f58771ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5870154060 0x7f5870155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.229+0000 7f58771ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58701586b0 0x7f58701510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.229+0000 7f58771ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58700ae5b0 con 0x7f58701586b0 2023-08-31T19:06:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.229+0000 7f58771ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58701519b0 con 0x7f5870154060 2023-08-31T19:06:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.229+0000 7f58771ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5870151c90 con 0x7f58700cb9b0 2023-08-31T19:06:19.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.230+0000 7f587579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58701586b0 0x7f58701510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:19.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.230+0000 7f587579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58701586b0 0x7f58701510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58504/0 (socket says 172.21.15.72:58504) 2023-08-31T19:06:19.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.230+0000 7f586ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5870154060 0x7f5870155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:19.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.230+0000 7f587579c700 1 -- 172.21.15.72:0/3640980687 learned_addr learned my addr 172.21.15.72:0/3640980687 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:19.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.230+0000 7f5874f9b700 1 --2- 172.21.15.72:0/3640980687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58700cb9b0 0x7f58700ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:19.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.230+0000 7f587579c700 1 -- 172.21.15.72:0/3640980687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58700cb9b0 msgr2=0x7f58700ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:19.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.230+0000 7f587579c700 1 --2- 172.21.15.72:0/3640980687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58700cb9b0 0x7f58700ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.230+0000 7f587579c700 1 -- 172.21.15.72:0/3640980687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5870154060 msgr2=0x7f5870155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:19.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.230+0000 7f587579c700 1 --2- 172.21.15.72:0/3640980687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5870154060 0x7f5870155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.230+0000 7f587579c700 1 -- 172.21.15.72:0/3640980687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5864009300 con 0x7f58701586b0 2023-08-31T19:06:19.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.230+0000 7f587579c700 1 --2- 172.21.15.72:0/3640980687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58701586b0 0x7f58701510a0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f586800b810 tx=0x7f5868009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:19.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.231+0000 7f586cff9700 1 -- 172.21.15.72:0/3640980687 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586800d4a0 con 0x7f58701586b0 2023-08-31T19:06:19.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.231+0000 7f586cff9700 1 -- 172.21.15.72:0/3640980687 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586800d600 con 0x7f58701586b0 2023-08-31T19:06:19.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.231+0000 7f58771ff700 1 -- 172.21.15.72:0/3640980687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5870151f70 con 0x7f58701586b0 2023-08-31T19:06:19.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.231+0000 7f586cff9700 1 -- 172.21.15.72:0/3640980687 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586800d9c0 con 0x7f58701586b0 2023-08-31T19:06:19.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.231+0000 7f58771ff700 1 -- 172.21.15.72:0/3640980687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58700aab20 con 0x7f58701586b0 2023-08-31T19:06:19.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.232+0000 7f58771ff700 1 -- 172.21.15.72:0/3640980687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58700af1d0 con 0x7f58701586b0 2023-08-31T19:06:19.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.234+0000 7f586cff9700 1 -- 172.21.15.72:0/3640980687 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f5868011400 con 0x7f58701586b0 2023-08-31T19:06:19.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.234+0000 7f586cff9700 1 --2- 172.21.15.72:0/3640980687 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f585405ef30 0x7f58540613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:19.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.234+0000 7f586cff9700 1 -- 172.21.15.72:0/3640980687 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f58680799d0 con 0x7f58701586b0 2023-08-31T19:06:19.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.234+0000 7f5874f9b700 1 --2- 172.21.15.72:0/3640980687 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f585405ef30 0x7f58540613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.234+0000 7f5874f9b700 1 --2- 172.21.15.72:0/3640980687 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f585405ef30 0x7f58540613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f586400b360 tx=0x7f5864016000).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.239+0000 7f586cff9700 1 -- 172.21.15.72:0/3640980687 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f58680478f0 con 0x7f58701586b0 2023-08-31T19:06:19.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.452+0000 7f58771ff700 1 -- 172.21.15.72:0/3640980687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f587006c6b0 con 0x7f58701586b0 2023-08-31T19:06:19.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.452+0000 7f586cff9700 1 -- 172.21.15.72:0/3640980687 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f586804aab0 con 0x7f58701586b0 2023-08-31T19:06:19.452 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:06:19.452 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2018270382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2018270382},{"type":"v1","addr":"172.21.15.72:6837","nonce":2018270382}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2754540175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2754540175},{"type":"v1","addr":"172.21.15.146:6835","nonce":2754540175}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":7042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/488665385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":488665385},{"type":"v1","addr":"172.21.15.146:6834","nonce":488665385}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:06:15.992239+0000","modified":"2023-08-31T19:06:19.009090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7590},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7590":{"gid":7590,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6835/2456627257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2456627257},{"type":"v1","addr":"172.21.15.72:6835","nonce":2456627257}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-31T19:06:19.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.454+0000 7f58771ff700 1 -- 172.21.15.72:0/3640980687 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f585405ef30 msgr2=0x7f58540613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:19.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.454+0000 7f58771ff700 1 --2- 172.21.15.72:0/3640980687 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f585405ef30 0x7f58540613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f586400b360 tx=0x7f5864016000).stop 2023-08-31T19:06:19.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.454+0000 7f58771ff700 1 -- 172.21.15.72:0/3640980687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58701586b0 msgr2=0x7f58701510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:19.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.454+0000 7f58771ff700 1 --2- 172.21.15.72:0/3640980687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58701586b0 0x7f58701510a0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f586800b810 tx=0x7f5868009290).stop 2023-08-31T19:06:19.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.454+0000 7f58771ff700 1 -- 172.21.15.72:0/3640980687 shutdown_connections 2023-08-31T19:06:19.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.454+0000 7f58771ff700 1 --2- 172.21.15.72:0/3640980687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58701586b0 0x7f58701510a0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.455+0000 7f58771ff700 1 --2- 172.21.15.72:0/3640980687 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58700cb9b0 0x7f58700ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.455+0000 7f58771ff700 1 --2- 172.21.15.72:0/3640980687 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f585405ef30 0x7f58540613f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.455+0000 7f58771ff700 1 --2- 172.21.15.72:0/3640980687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5870154060 0x7f5870155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.455+0000 7f58771ff700 1 -- 172.21.15.72:0/3640980687 >> 172.21.15.72:0/3640980687 conn(0x7f587005e870 msgr2=0x7f58701528e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:19.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.455+0000 7f58771ff700 1 -- 172.21.15.72:0/3640980687 shutdown_connections 2023-08-31T19:06:19.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.455+0000 7f58771ff700 1 -- 172.21.15.72:0/3640980687 wait complete. 2023-08-31T19:06:19.457 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 56 2023-08-31T19:06:19.471 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:06:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.660+0000 7f47a0dff700 1 Processor -- start 2023-08-31T19:06:19.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.661+0000 7f47a0dff700 1 -- start start 2023-08-31T19:06:19.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.662+0000 7f47a0dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c1505b0 0x7f479c0c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:19.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.663+0000 7f47a0dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c0641e0 con 0x7f479c0c2b10 2023-08-31T19:06:19.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.663+0000 7f47a0dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c068b90 con 0x7f479c1510a0 2023-08-31T19:06:19.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.663+0000 7f47a0dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c151580 con 0x7f479c1505b0 2023-08-31T19:06:19.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.663+0000 7f4799d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f479c0c2b10 0x7f479c150990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50050/0 (socket says 172.21.15.72:50050) 2023-08-31T19:06:19.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.663+0000 7f4799d9b700 1 -- 172.21.15.72:0/533829695 learned_addr learned my addr 172.21.15.72:0/533829695 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:19.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.663+0000 7f479a59c700 1 --2- 172.21.15.72:0/533829695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c1505b0 0x7f479c0c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:19.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.663+0000 7f479959a700 1 -- 172.21.15.72:0/533829695 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923824920 0 0) 0x7f479c0641e0 con 0x7f479c0c2b10 2023-08-31T19:06:19.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.663+0000 7f479959a700 1 -- 172.21.15.72:0/533829695 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47840033f0 con 0x7f479c0c2b10 2023-08-31T19:06:19.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.663+0000 7f479959a700 1 -- 172.21.15.72:0/533829695 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1346796479 0 0) 0x7f47840033f0 con 0x7f479c0c2b10 2023-08-31T19:06:19.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.663+0000 7f479959a700 1 -- 172.21.15.72:0/533829695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c1505b0 msgr2=0x7f479c0c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:19.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.663+0000 7f479959a700 1 --2- 172.21.15.72:0/533829695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c1505b0 0x7f479c0c1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.663+0000 7f479959a700 1 -- 172.21.15.72:0/533829695 >> v1:172.21.15.146:6789/0 conn(0x7f479c1510a0 legacy=0x7f479c069020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:19.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.663+0000 7f479959a700 1 -- 172.21.15.72:0/533829695 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c151860 con 0x7f479c0c2b10 2023-08-31T19:06:19.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f479959a700 1 -- 172.21.15.72:0/533829695 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f4790001470 con 0x7f479c0c2b10 2023-08-31T19:06:19.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f479959a700 1 -- 172.21.15.72:0/533829695 >> v1:172.21.15.72:6789/0 conn(0x7f479c0c2b10 legacy=0x7f479c150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:19.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f479959a700 1 --2- 172.21.15.72:0/533829695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4784003910 0x7f4784003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:19.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f479959a700 1 --2- 172.21.15.72:0/533829695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4784004690 0x7f4784004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:19.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f479959a700 1 --2- 172.21.15.72:0/533829695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c1505b0 0x7f4784005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:19.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f479959a700 1 -- 172.21.15.72:0/533829695 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c151580 con 0x7f4784003910 2023-08-31T19:06:19.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f479959a700 1 -- 172.21.15.72:0/533829695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478400b8e0 con 0x7f4784004690 2023-08-31T19:06:19.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f479959a700 1 -- 172.21.15.72:0/533829695 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478400dc60 con 0x7f479c1505b0 2023-08-31T19:06:19.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f479a59c700 1 --2- 172.21.15.72:0/533829695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4784003910 0x7f4784003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:19.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f4799d9b700 1 --2- 172.21.15.72:0/533829695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4784004690 0x7f4784004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:19.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f479ad9d700 1 --2- 172.21.15.72:0/533829695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c1505b0 0x7f4784005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:19.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f479a59c700 1 -- 172.21.15.72:0/533829695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c1505b0 msgr2=0x7f4784005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:19.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f479a59c700 1 --2- 172.21.15.72:0/533829695 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c1505b0 0x7f4784005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f479a59c700 1 -- 172.21.15.72:0/533829695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4784004690 msgr2=0x7f4784004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:19.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f479a59c700 1 --2- 172.21.15.72:0/533829695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4784004690 0x7f4784004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.664+0000 7f479a59c700 1 -- 172.21.15.72:0/533829695 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47840033f0 con 0x7f4784003910 2023-08-31T19:06:19.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.665+0000 7f479a59c700 1 --2- 172.21.15.72:0/533829695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4784003910 0x7f4784003cf0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f478c009a80 tx=0x7f478c009060).ready entity=mon.0 client_cookie=b747ce7fb96ffa31 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:19.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.665+0000 7f479959a700 1 -- 172.21.15.72:0/533829695 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c009430 con 0x7f4784003910 2023-08-31T19:06:19.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.665+0000 7f479959a700 1 -- 172.21.15.72:0/533829695 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c00e5e0 con 0x7f4784003910 2023-08-31T19:06:19.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.665+0000 7f479959a700 1 -- 172.21.15.72:0/533829695 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00e960 con 0x7f4784003910 2023-08-31T19:06:19.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.665+0000 7f47a0dff700 1 -- 172.21.15.72:0/533829695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4784003910 msgr2=0x7f4784003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:19.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.665+0000 7f47a0dff700 1 --2- 172.21.15.72:0/533829695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4784003910 0x7f4784003cf0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f478c009a80 tx=0x7f478c009060).stop 2023-08-31T19:06:19.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.665+0000 7f479ad9d700 1 -- 172.21.15.72:0/533829695 reap_dead start 2023-08-31T19:06:19.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.665+0000 7f47a0dff700 1 -- 172.21.15.72:0/533829695 shutdown_connections 2023-08-31T19:06:19.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.665+0000 7f47a0dff700 1 -- 172.21.15.72:0/533829695 >> 172.21.15.72:0/533829695 conn(0x7f479c0c6b10 msgr2=0x7f479c0c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:19.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.665+0000 7f47a0dff700 1 -- 172.21.15.72:0/533829695 shutdown_connections 2023-08-31T19:06:19.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.665+0000 7f47a0dff700 1 -- 172.21.15.72:0/533829695 wait complete. 2023-08-31T19:06:19.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.667+0000 7f47a0dff700 1 Processor -- start 2023-08-31T19:06:19.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.667+0000 7f47a0dff700 1 -- start start 2023-08-31T19:06:19.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.668+0000 7f47a0dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4784003910 0x7f479c154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:19.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.668+0000 7f47a0dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c14c960 0x7f479c0ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:19.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.668+0000 7f47a0dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f479c1524c0 0x7f479c152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:19.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.668+0000 7f47a0dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0abcb0 con 0x7f479c1524c0 2023-08-31T19:06:19.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.668+0000 7f47a0dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c152e30 con 0x7f4784003910 2023-08-31T19:06:19.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.668+0000 7f47a0dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c155190 con 0x7f479c14c960 2023-08-31T19:06:19.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.668+0000 7f479ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f479c1524c0 0x7f479c152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:19.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.668+0000 7f479ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f479c1524c0 0x7f479c152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58528/0 (socket says 172.21.15.72:58528) 2023-08-31T19:06:19.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.668+0000 7f479ad9d700 1 -- 172.21.15.72:0/2382153815 learned_addr learned my addr 172.21.15.72:0/2382153815 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:19.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.669+0000 7f479a59c700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4784003910 0x7f479c154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:19.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.669+0000 7f4799d9b700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c14c960 0x7f479c0ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:19.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.669+0000 7f479ad9d700 1 -- 172.21.15.72:0/2382153815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c14c960 msgr2=0x7f479c0ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:19.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.669+0000 7f479ad9d700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c14c960 0x7f479c0ac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.669+0000 7f479ad9d700 1 -- 172.21.15.72:0/2382153815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4784003910 msgr2=0x7f479c154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.669+0000 7f479ad9d700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4784003910 0x7f479c154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.669+0000 7f479ad9d700 1 -- 172.21.15.72:0/2382153815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c0ab0a0 con 0x7f479c1524c0 2023-08-31T19:06:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.669+0000 7f479a59c700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4784003910 0x7f479c154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:19.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.669+0000 7f4799d9b700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c14c960 0x7f479c0ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.669+0000 7f479ad9d700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f479c1524c0 0x7f479c152940 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f479c1514b0 tx=0x7f4794009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.669+0000 7f478a7fc700 1 -- 172.21.15.72:0/2382153815 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794003280 con 0x7f479c1524c0 2023-08-31T19:06:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.669+0000 7f478a7fc700 1 -- 172.21.15.72:0/2382153815 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47940033e0 con 0x7f479c1524c0 2023-08-31T19:06:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.669+0000 7f47a0dff700 1 -- 172.21.15.72:0/2382153815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c0ab380 con 0x7f479c1524c0 2023-08-31T19:06:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.669+0000 7f478a7fc700 1 -- 172.21.15.72:0/2382153815 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794001850 con 0x7f479c1524c0 2023-08-31T19:06:19.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.669+0000 7f47a0dff700 1 -- 172.21.15.72:0/2382153815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c0ab940 con 0x7f479c1524c0 2023-08-31T19:06:19.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.670+0000 7f47a0dff700 1 -- 172.21.15.72:0/2382153815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c06c6b0 con 0x7f479c1524c0 2023-08-31T19:06:19.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.671+0000 7f478a7fc700 1 -- 172.21.15.72:0/2382153815 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4794001c00 con 0x7f479c1524c0 2023-08-31T19:06:19.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.672+0000 7f478a7fc700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f477c05ef30 0x7f477c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:19.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.672+0000 7f478a7fc700 1 -- 172.21.15.72:0/2382153815 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f4794079c50 con 0x7f479c1524c0 2023-08-31T19:06:19.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.672+0000 7f479a59c700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f477c05ef30 0x7f477c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:19.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.673+0000 7f479a59c700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f477c05ef30 0x7f477c0613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f478c006be0 tx=0x7f478c01a000).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:19.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.676+0000 7f478a7fc700 1 -- 172.21.15.72:0/2382153815 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f47940498f0 con 0x7f479c1524c0 2023-08-31T19:06:19.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.845+0000 7f47a0dff700 1 -- 172.21.15.72:0/2382153815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f479c0c2880 con 0x7f479c1524c0 2023-08-31T19:06:19.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.846+0000 7f478a7fc700 1 -- 172.21.15.72:0/2382153815 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+17946 (secure 0 0 0) 0x7f479404ace0 con 0x7f479c1524c0 2023-08-31T19:06:19.845 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:06:19.846 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":126,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:06:16.994561+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:06:13.809620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-31T19:06:14.978639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:06:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.848+0000 7f47a0dff700 1 -- 172.21.15.72:0/2382153815 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f477c05ef30 msgr2=0x7f477c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.848+0000 7f47a0dff700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f477c05ef30 0x7f477c0613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f478c006be0 tx=0x7f478c01a000).stop 2023-08-31T19:06:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.848+0000 7f47a0dff700 1 -- 172.21.15.72:0/2382153815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f479c1524c0 msgr2=0x7f479c152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:19.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.848+0000 7f47a0dff700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f479c1524c0 0x7f479c152940 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f479c1514b0 tx=0x7f4794009040).stop 2023-08-31T19:06:19.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.848+0000 7f47a0dff700 1 -- 172.21.15.72:0/2382153815 shutdown_connections 2023-08-31T19:06:19.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.848+0000 7f47a0dff700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f479c1524c0 0x7f479c152940 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.848+0000 7f47a0dff700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f477c05ef30 0x7f477c0613f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.848+0000 7f47a0dff700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4784003910 0x7f479c154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.848+0000 7f47a0dff700 1 --2- 172.21.15.72:0/2382153815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f479c14c960 0x7f479c0ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:19.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.848+0000 7f47a0dff700 1 -- 172.21.15.72:0/2382153815 >> 172.21.15.72:0/2382153815 conn(0x7f479c0c6b10 msgr2=0x7f479c0654a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:19.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.848+0000 7f47a0dff700 1 -- 172.21.15.72:0/2382153815 shutdown_connections 2023-08-31T19:06:19.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:19.848+0000 7f47a0dff700 1 -- 172.21.15.72:0/2382153815 wait complete. 2023-08-31T19:06:19.865 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T19:06:19.866 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:06:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.059+0000 7f0135fff700 1 Processor -- start 2023-08-31T19:06:20.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.059+0000 7f0135fff700 1 -- start start 2023-08-31T19:06:20.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.061+0000 7f0135fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01300c5fb0 0x7f01300be370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.061+0000 7f0135fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01300c46c0 0x7f0130063a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.061+0000 7f0135fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01300bece0 con 0x7f01300be860 2023-08-31T19:06:20.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.061+0000 7f0135fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0130154690 con 0x7f01300c5fb0 2023-08-31T19:06:20.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.061+0000 7f0135fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01300bfb20 con 0x7f01300c46c0 2023-08-31T19:06:20.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.061+0000 7f012f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01300c5fb0 0x7f01300be370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.061+0000 7f012f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01300c5fb0 0x7f01300be370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58538/0 (socket says 172.21.15.72:58538) 2023-08-31T19:06:20.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.061+0000 7f012f7fe700 1 -- 172.21.15.72:0/4141588932 learned_addr learned my addr 172.21.15.72:0/4141588932 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:20.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.061+0000 7f012ffff700 1 --2- 172.21.15.72:0/4141588932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01300c46c0 0x7f0130063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.061+0000 7f012f7fe700 1 -- 172.21.15.72:0/4141588932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01300c46c0 msgr2=0x7f0130063a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:20.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.061+0000 7f012f7fe700 1 --2- 172.21.15.72:0/4141588932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01300c46c0 0x7f0130063a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.061+0000 7f012f7fe700 1 -- 172.21.15.72:0/4141588932 >> v1:172.21.15.146:6789/0 conn(0x7f01300be860 legacy=0x7f01300c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:20.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.061+0000 7f012f7fe700 1 -- 172.21.15.72:0/4141588932 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01300bef10 con 0x7f01300c5fb0 2023-08-31T19:06:20.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.062+0000 7f012f7fe700 1 --2- 172.21.15.72:0/4141588932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01300c5fb0 0x7f01300be370 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f0120009810 tx=0x7f0120009060).ready entity=mon.0 client_cookie=a76afd9224b1bb1f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:20.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.062+0000 7f012e7fc700 1 -- 172.21.15.72:0/4141588932 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120005880 con 0x7f01300c5fb0 2023-08-31T19:06:20.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.062+0000 7f012e7fc700 1 -- 172.21.15.72:0/4141588932 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01200059e0 con 0x7f01300c5fb0 2023-08-31T19:06:20.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.062+0000 7f012e7fc700 1 -- 172.21.15.72:0/4141588932 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120005d60 con 0x7f01300c5fb0 2023-08-31T19:06:20.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.062+0000 7f0135fff700 1 -- 172.21.15.72:0/4141588932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01300c5fb0 msgr2=0x7f01300be370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:20.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.062+0000 7f0135fff700 1 --2- 172.21.15.72:0/4141588932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01300c5fb0 0x7f01300be370 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f0120009810 tx=0x7f0120009060).stop 2023-08-31T19:06:20.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.062+0000 7f0135fff700 1 -- 172.21.15.72:0/4141588932 shutdown_connections 2023-08-31T19:06:20.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.062+0000 7f0135fff700 1 --2- 172.21.15.72:0/4141588932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01300c46c0 0x7f0130063a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.062+0000 7f0135fff700 1 --2- 172.21.15.72:0/4141588932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01300c5fb0 0x7f01300be370 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.062+0000 7f0135fff700 1 -- 172.21.15.72:0/4141588932 >> 172.21.15.72:0/4141588932 conn(0x7f0130082f60 msgr2=0x7f013005e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:20.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.062+0000 7f0135fff700 1 -- 172.21.15.72:0/4141588932 shutdown_connections 2023-08-31T19:06:20.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.062+0000 7f0135fff700 1 -- 172.21.15.72:0/4141588932 wait complete. 2023-08-31T19:06:20.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.064+0000 7f0135fff700 1 Processor -- start 2023-08-31T19:06:20.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.064+0000 7f0135fff700 1 -- start start 2023-08-31T19:06:20.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.065+0000 7f0135fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01300be860 0x7f01300c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.065+0000 7f0135fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01300c46c0 0x7f0130167890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.065+0000 7f0135fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01300c5fb0 0x7f0130167d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.065+0000 7f0135fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0130168270 con 0x7f01300c5fb0 2023-08-31T19:06:20.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.065+0000 7f0135fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01300aa1b0 con 0x7f01300be860 2023-08-31T19:06:20.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.065+0000 7f0135fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01300a95a0 con 0x7f01300c46c0 2023-08-31T19:06:20.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.065+0000 7f012ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01300c5fb0 0x7f0130167d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.065+0000 7f012ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01300c5fb0 0x7f0130167d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58548/0 (socket says 172.21.15.72:58548) 2023-08-31T19:06:20.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.065+0000 7f012ffff700 1 -- 172.21.15.72:0/207076691 learned_addr learned my addr 172.21.15.72:0/207076691 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:20.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.066+0000 7f012f7fe700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01300be860 0x7f01300c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.066+0000 7f012effd700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01300c46c0 0x7f0130167890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.066+0000 7f012ffff700 1 -- 172.21.15.72:0/207076691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01300c46c0 msgr2=0x7f0130167890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:20.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.066+0000 7f012ffff700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01300c46c0 0x7f0130167890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.066+0000 7f012ffff700 1 -- 172.21.15.72:0/207076691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01300be860 msgr2=0x7f01300c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:20.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.066+0000 7f012ffff700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01300be860 0x7f01300c14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.066+0000 7f012ffff700 1 -- 172.21.15.72:0/207076691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0120009300 con 0x7f01300c5fb0 2023-08-31T19:06:20.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.066+0000 7f012f7fe700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01300be860 0x7f01300c14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:20.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.066+0000 7f012effd700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01300c46c0 0x7f0130167890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:20.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.066+0000 7f012ffff700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01300c5fb0 0x7f0130167d80 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f0128007f20 tx=0x7f01280098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:20.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.066+0000 7f01177fe700 1 -- 172.21.15.72:0/207076691 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012800eca0 con 0x7f01300c5fb0 2023-08-31T19:06:20.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.066+0000 7f01177fe700 1 -- 172.21.15.72:0/207076691 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012800ee00 con 0x7f01300c5fb0 2023-08-31T19:06:20.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.066+0000 7f0135fff700 1 -- 172.21.15.72:0/207076691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01300a9880 con 0x7f01300c5fb0 2023-08-31T19:06:20.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.066+0000 7f01177fe700 1 -- 172.21.15.72:0/207076691 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128014610 con 0x7f01300c5fb0 2023-08-31T19:06:20.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.066+0000 7f0135fff700 1 -- 172.21.15.72:0/207076691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01300a9e40 con 0x7f01300c5fb0 2023-08-31T19:06:20.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.067+0000 7f0135fff700 1 -- 172.21.15.72:0/207076691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01300aa320 con 0x7f01300c5fb0 2023-08-31T19:06:20.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.068+0000 7f01177fe700 1 -- 172.21.15.72:0/207076691 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f01280149c0 con 0x7f01300c5fb0 2023-08-31T19:06:20.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.069+0000 7f01177fe700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f011c05ef30 0x7f011c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.069+0000 7f01177fe700 1 -- 172.21.15.72:0/207076691 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f012807a7a0 con 0x7f01300c5fb0 2023-08-31T19:06:20.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.069+0000 7f012f7fe700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f011c05ef30 0x7f011c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.069+0000 7f012f7fe700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f011c05ef30 0x7f011c0613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f012000b400 tx=0x7f0120016000).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:20.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.073+0000 7f01177fe700 1 -- 172.21.15.72:0/207076691 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f012804f200 con 0x7f01300c5fb0 2023-08-31T19:06:20.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.239+0000 7f0135fff700 1 -- 172.21.15.72:0/207076691 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f013006c6b0 con 0x7f011c05ef30 2023-08-31T19:06:20.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.252+0000 7f01177fe700 1 -- 172.21.15.72:0/207076691 <== mgr.7410 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361074 (secure 0 0 0) 0x7f013006c6b0 con 0x7f011c05ef30 2023-08-31T19:06:20.257 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:06:20.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.256+0000 7f0135fff700 1 -- 172.21.15.72:0/207076691 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f011c05ef30 msgr2=0x7f011c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:20.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.256+0000 7f0135fff700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f011c05ef30 0x7f011c0613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f012000b400 tx=0x7f0120016000).stop 2023-08-31T19:06:20.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.256+0000 7f0135fff700 1 -- 172.21.15.72:0/207076691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01300c5fb0 msgr2=0x7f0130167d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:20.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.256+0000 7f0135fff700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01300c5fb0 0x7f0130167d80 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f0128007f20 tx=0x7f01280098a0).stop 2023-08-31T19:06:20.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.256+0000 7f0135fff700 1 -- 172.21.15.72:0/207076691 shutdown_connections 2023-08-31T19:06:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.256+0000 7f0135fff700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01300c5fb0 0x7f0130167d80 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.256+0000 7f0135fff700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f011c05ef30 0x7f011c0613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.256+0000 7f0135fff700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01300be860 0x7f01300c14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.256+0000 7f0135fff700 1 --2- 172.21.15.72:0/207076691 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01300c46c0 0x7f0130167890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.257+0000 7f0135fff700 1 -- 172.21.15.72:0/207076691 >> 172.21.15.72:0/207076691 conn(0x7f0130082f60 msgr2=0x7f0130063a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:20.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.257+0000 7f0135fff700 1 -- 172.21.15.72:0/207076691 shutdown_connections 2023-08-31T19:06:20.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.257+0000 7f0135fff700 1 -- 172.21.15.72:0/207076691 wait complete. 2023-08-31T19:06:20.265 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:06:20.273 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-31T19:06:19.365310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2421676,"kb_used_data":12140,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752553044,"statfs":{"total":773094113280,"available":770614317056,"internally_reserved":0,"allocated":12431360,"data_stored":6560940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5828,"num_objects":-12,"num_object_clones":0,"num_object_copies":-24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-33,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.151667"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.019745+0000","last_change":"2023-08-31T19:06:16.015398+0000","last_active":"2023-08-31T19:06:16.019745+0000","last_peered":"2023-08-31T19:06:16.019745+0000","last_clean":"2023-08-31T19:06:16.019745+0000","last_became_active":"2023-08-31T19:06:16.015153+0000","last_became_peered":"2023-08-31T19:06:16.015153+0000","last_unstale":"2023-08-31T19:06:16.019745+0000","last_undegraded":"2023-08-31T19:06:16.019745+0000","last_fullsized":"2023-08-31T19:06:16.019745+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.027060+0000","last_change":"2023-08-31T19:06:15.541021+0000","last_active":"2023-08-31T19:06:16.027060+0000","last_peered":"2023-08-31T19:06:16.027060+0000","last_clean":"2023-08-31T19:06:16.027060+0000","last_became_active":"2023-08-31T19:06:15.540746+0000","last_became_peered":"2023-08-31T19:06:15.540746+0000","last_unstale":"2023-08-31T19:06:16.027060+0000","last_undegraded":"2023-08-31T19:06:16.027060+0000","last_fullsized":"2023-08-31T19:06:16.027060+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.041043+0000","last_change":"2023-08-31T19:06:16.032960+0000","last_active":"2023-08-31T19:06:16.041043+0000","last_peered":"2023-08-31T19:06:16.041043+0000","last_clean":"2023-08-31T19:06:16.041043+0000","last_became_active":"2023-08-31T19:06:16.032695+0000","last_became_peered":"2023-08-31T19:06:16.032695+0000","last_unstale":"2023-08-31T19:06:16.041043+0000","last_undegraded":"2023-08-31T19:06:16.041043+0000","last_fullsized":"2023-08-31T19:06:16.041043+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.011722+0000","last_change":"2023-08-31T19:06:15.549520+0000","last_active":"2023-08-31T19:06:16.011722+0000","last_peered":"2023-08-31T19:06:16.011722+0000","last_clean":"2023-08-31T19:06:16.011722+0000","last_became_active":"2023-08-31T19:06:15.549241+0000","last_became_peered":"2023-08-31T19:06:15.549241+0000","last_unstale":"2023-08-31T19:06:16.011722+0000","last_undegraded":"2023-08-31T19:06:16.011722+0000","last_fullsized":"2023-08-31T19:06:16.011722+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023120+0000","last_change":"2023-08-31T19:06:16.017090+0000","last_active":"2023-08-31T19:06:16.023120+0000","last_peered":"2023-08-31T19:06:16.023120+0000","last_clean":"2023-08-31T19:06:16.023120+0000","last_became_active":"2023-08-31T19:06:16.016806+0000","last_became_peered":"2023-08-31T19:06:16.016806+0000","last_unstale":"2023-08-31T19:06:16.023120+0000","last_undegraded":"2023-08-31T19:06:16.023120+0000","last_fullsized":"2023-08-31T19:06:16.023120+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.013256+0000","last_change":"2023-08-31T19:06:15.535658+0000","last_active":"2023-08-31T19:06:16.013256+0000","last_peered":"2023-08-31T19:06:16.013256+0000","last_clean":"2023-08-31T19:06:16.013256+0000","last_became_active":"2023-08-31T19:06:15.535393+0000","last_became_peered":"2023-08-31T19:06:15.535393+0000","last_unstale":"2023-08-31T19:06:16.013256+0000","last_undegraded":"2023-08-31T19:06:16.013256+0000","last_fullsized":"2023-08-31T19:06:16.013256+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023602+0000","last_change":"2023-08-31T19:06:16.019327+0000","last_active":"2023-08-31T19:06:16.023602+0000","last_peered":"2023-08-31T19:06:16.023602+0000","last_clean":"2023-08-31T19:06:16.023602+0000","last_became_active":"2023-08-31T19:06:16.019005+0000","last_became_peered":"2023-08-31T19:06:16.019005+0000","last_unstale":"2023-08-31T19:06:16.023602+0000","last_undegraded":"2023-08-31T19:06:16.023602+0000","last_fullsized":"2023-08-31T19:06:16.023602+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.016270+0000","last_change":"2023-08-31T19:06:15.553408+0000","last_active":"2023-08-31T19:06:16.016270+0000","last_peered":"2023-08-31T19:06:16.016270+0000","last_clean":"2023-08-31T19:06:16.016270+0000","last_became_active":"2023-08-31T19:06:15.553151+0000","last_became_peered":"2023-08-31T19:06:15.553151+0000","last_unstale":"2023-08-31T19:06:16.016270+0000","last_undegraded":"2023-08-31T19:06:16.016270+0000","last_fullsized":"2023-08-31T19:06:16.016270+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.018593+0000","last_change":"2023-08-31T19:06:16.008147+0000","last_active":"2023-08-31T19:06:16.018593+0000","last_peered":"2023-08-31T19:06:16.018593+0000","last_clean":"2023-08-31T19:06:16.018593+0000","last_became_active":"2023-08-31T19:06:16.007807+0000","last_became_peered":"2023-08-31T19:06:16.007807+0000","last_unstale":"2023-08-31T19:06:16.018593+0000","last_undegraded":"2023-08-31T19:06:16.018593+0000","last_fullsized":"2023-08-31T19:06:16.018593+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.018559+0000","last_change":"2023-08-31T19:06:15.546018+0000","last_active":"2023-08-31T19:06:16.018559+0000","last_peered":"2023-08-31T19:06:16.018559+0000","last_clean":"2023-08-31T19:06:16.018559+0000","last_became_active":"2023-08-31T19:06:15.543735+0000","last_became_peered":"2023-08-31T19:06:15.543735+0000","last_unstale":"2023-08-31T19:06:16.018559+0000","last_undegraded":"2023-08-31T19:06:16.018559+0000","last_fullsized":"2023-08-31T19:06:16.018559+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.024787+0000","last_change":"2023-08-31T19:06:16.021948+0000","last_active":"2023-08-31T19:06:16.024787+0000","last_peered":"2023-08-31T19:06:16.024787+0000","last_clean":"2023-08-31T19:06:16.024787+0000","last_became_active":"2023-08-31T19:06:16.021563+0000","last_became_peered":"2023-08-31T19:06:16.021563+0000","last_unstale":"2023-08-31T19:06:16.024787+0000","last_undegraded":"2023-08-31T19:06:16.024787+0000","last_fullsized":"2023-08-31T19:06:16.024787+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.020206+0000","last_change":"2023-08-31T19:06:15.553189+0000","last_active":"2023-08-31T19:06:16.020206+0000","last_peered":"2023-08-31T19:06:16.020206+0000","last_clean":"2023-08-31T19:06:16.020206+0000","last_became_active":"2023-08-31T19:06:15.552813+0000","last_became_peered":"2023-08-31T19:06:15.552813+0000","last_unstale":"2023-08-31T19:06:16.020206+0000","last_undegraded":"2023-08-31T19:06:16.020206+0000","last_fullsized":"2023-08-31T19:06:16.020206+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.025880+0000","last_change":"2023-08-31T19:06:16.020043+0000","last_active":"2023-08-31T19:06:16.025880+0000","last_peered":"2023-08-31T19:06:16.025880+0000","last_clean":"2023-08-31T19:06:16.025880+0000","last_became_active":"2023-08-31T19:06:16.019743+0000","last_became_peered":"2023-08-31T19:06:16.019743+0000","last_unstale":"2023-08-31T19:06:16.025880+0000","last_undegraded":"2023-08-31T19:06:16.025880+0000","last_fullsized":"2023-08-31T19:06:16.025880+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.006225+0000","last_change":"2023-08-31T19:06:15.553788+0000","last_active":"2023-08-31T19:06:16.006225+0000","last_peered":"2023-08-31T19:06:16.006225+0000","last_clean":"2023-08-31T19:06:16.006225+0000","last_became_active":"2023-08-31T19:06:15.553475+0000","last_became_peered":"2023-08-31T19:06:15.553475+0000","last_unstale":"2023-08-31T19:06:16.006225+0000","last_undegraded":"2023-08-31T19:06:16.006225+0000","last_fullsized":"2023-08-31T19:06:16.006225+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.026026+0000","last_change":"2023-08-31T19:06:16.020641+0000","last_active":"2023-08-31T19:06:16.026026+0000","last_peered":"2023-08-31T19:06:16.026026+0000","last_clean":"2023-08-31T19:06:16.026026+0000","last_became_active":"2023-08-31T19:06:16.020362+0000","last_became_peered":"2023-08-31T19:06:16.020362+0000","last_unstale":"2023-08-31T19:06:16.026026+0000","last_undegraded":"2023-08-31T19:06:16.026026+0000","last_fullsized":"2023-08-31T19:06:16.026026+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.015685+0000","last_change":"2023-08-31T19:06:15.552233+0000","last_active":"2023-08-31T19:06:16.015685+0000","last_peered":"2023-08-31T19:06:16.015685+0000","last_clean":"2023-08-31T19:06:16.015685+0000","last_became_active":"2023-08-31T19:06:15.551915+0000","last_became_peered":"2023-08-31T19:06:15.551915+0000","last_unstale":"2023-08-31T19:06:16.015685+0000","last_undegraded":"2023-08-31T19:06:16.015685+0000","last_fullsized":"2023-08-31T19:06:16.015685+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.033095+0000","last_change":"2023-08-31T19:06:16.027207+0000","last_active":"2023-08-31T19:06:16.033095+0000","last_peered":"2023-08-31T19:06:16.033095+0000","last_clean":"2023-08-31T19:06:16.033095+0000","last_became_active":"2023-08-31T19:06:16.026921+0000","last_became_peered":"2023-08-31T19:06:16.026921+0000","last_unstale":"2023-08-31T19:06:16.033095+0000","last_undegraded":"2023-08-31T19:06:16.033095+0000","last_fullsized":"2023-08-31T19:06:16.033095+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.003675+0000","last_change":"2023-08-31T19:06:15.542543+0000","last_active":"2023-08-31T19:06:16.003675+0000","last_peered":"2023-08-31T19:06:16.003675+0000","last_clean":"2023-08-31T19:06:16.003675+0000","last_became_active":"2023-08-31T19:06:15.542170+0000","last_became_peered":"2023-08-31T19:06:15.542170+0000","last_unstale":"2023-08-31T19:06:16.003675+0000","last_undegraded":"2023-08-31T19:06:16.003675+0000","last_fullsized":"2023-08-31T19:06:16.003675+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.034963+0000","last_change":"2023-08-31T19:06:16.030947+0000","last_active":"2023-08-31T19:06:16.034963+0000","last_peered":"2023-08-31T19:06:16.034963+0000","last_clean":"2023-08-31T19:06:16.034963+0000","last_became_active":"2023-08-31T19:06:16.030645+0000","last_became_peered":"2023-08-31T19:06:16.030645+0000","last_unstale":"2023-08-31T19:06:16.034963+0000","last_undegraded":"2023-08-31T19:06:16.034963+0000","last_fullsized":"2023-08-31T19:06:16.034963+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:15.999103+0000","last_change":"2023-08-31T19:06:15.547074+0000","last_active":"2023-08-31T19:06:15.999103+0000","last_peered":"2023-08-31T19:06:15.999103+0000","last_clean":"2023-08-31T19:06:15.999103+0000","last_became_active":"2023-08-31T19:06:15.546731+0000","last_became_peered":"2023-08-31T19:06:15.546731+0000","last_unstale":"2023-08-31T19:06:15.999103+0000","last_undegraded":"2023-08-31T19:06:15.999103+0000","last_fullsized":"2023-08-31T19:06:15.999103+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021468+0000","last_change":"2023-08-31T19:06:16.016660+0000","last_active":"2023-08-31T19:06:16.021468+0000","last_peered":"2023-08-31T19:06:16.021468+0000","last_clean":"2023-08-31T19:06:16.021468+0000","last_became_active":"2023-08-31T19:06:16.016426+0000","last_became_peered":"2023-08-31T19:06:16.016426+0000","last_unstale":"2023-08-31T19:06:16.021468+0000","last_undegraded":"2023-08-31T19:06:16.021468+0000","last_fullsized":"2023-08-31T19:06:16.021468+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.008573+0000","last_change":"2023-08-31T19:06:15.553731+0000","last_active":"2023-08-31T19:06:16.008573+0000","last_peered":"2023-08-31T19:06:16.008573+0000","last_clean":"2023-08-31T19:06:16.008573+0000","last_became_active":"2023-08-31T19:06:15.553409+0000","last_became_peered":"2023-08-31T19:06:15.553409+0000","last_unstale":"2023-08-31T19:06:16.008573+0000","last_undegraded":"2023-08-31T19:06:16.008573+0000","last_fullsized":"2023-08-31T19:06:16.008573+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.012869+0000","last_change":"2023-08-31T19:06:16.008782+0000","last_active":"2023-08-31T19:06:16.012869+0000","last_peered":"2023-08-31T19:06:16.012869+0000","last_clean":"2023-08-31T19:06:16.012869+0000","last_became_active":"2023-08-31T19:06:16.007867+0000","last_became_peered":"2023-08-31T19:06:16.007867+0000","last_unstale":"2023-08-31T19:06:16.012869+0000","last_undegraded":"2023-08-31T19:06:16.012869+0000","last_fullsized":"2023-08-31T19:06:16.012869+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.035097+0000","last_change":"2023-08-31T19:06:15.543776+0000","last_active":"2023-08-31T19:06:16.035097+0000","last_peered":"2023-08-31T19:06:16.035097+0000","last_clean":"2023-08-31T19:06:16.035097+0000","last_became_active":"2023-08-31T19:06:15.543415+0000","last_became_peered":"2023-08-31T19:06:15.543415+0000","last_unstale":"2023-08-31T19:06:16.035097+0000","last_undegraded":"2023-08-31T19:06:16.035097+0000","last_fullsized":"2023-08-31T19:06:16.035097+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.026013+0000","last_change":"2023-08-31T19:06:16.021508+0000","last_active":"2023-08-31T19:06:16.026013+0000","last_peered":"2023-08-31T19:06:16.026013+0000","last_clean":"2023-08-31T19:06:16.026013+0000","last_became_active":"2023-08-31T19:06:16.021236+0000","last_became_peered":"2023-08-31T19:06:16.021236+0000","last_unstale":"2023-08-31T19:06:16.026013+0000","last_undegraded":"2023-08-31T19:06:16.026013+0000","last_fullsized":"2023-08-31T19:06:16.026013+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.016512+0000","last_change":"2023-08-31T19:06:15.542622+0000","last_active":"2023-08-31T19:06:16.016512+0000","last_peered":"2023-08-31T19:06:16.016512+0000","last_clean":"2023-08-31T19:06:16.016512+0000","last_became_active":"2023-08-31T19:06:15.542333+0000","last_became_peered":"2023-08-31T19:06:15.542333+0000","last_unstale":"2023-08-31T19:06:16.016512+0000","last_undegraded":"2023-08-31T19:06:16.016512+0000","last_fullsized":"2023-08-31T19:06:16.016512+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.035007+0000","last_change":"2023-08-31T19:06:16.031070+0000","last_active":"2023-08-31T19:06:16.035007+0000","last_peered":"2023-08-31T19:06:16.035007+0000","last_clean":"2023-08-31T19:06:16.035007+0000","last_became_active":"2023-08-31T19:06:16.030214+0000","last_became_peered":"2023-08-31T19:06:16.030214+0000","last_unstale":"2023-08-31T19:06:16.035007+0000","last_undegraded":"2023-08-31T19:06:16.035007+0000","last_fullsized":"2023-08-31T19:06:16.035007+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.001143+0000","last_change":"2023-08-31T19:06:15.552822+0000","last_active":"2023-08-31T19:06:16.001143+0000","last_peered":"2023-08-31T19:06:16.001143+0000","last_clean":"2023-08-31T19:06:16.001143+0000","last_became_active":"2023-08-31T19:06:15.552121+0000","last_became_peered":"2023-08-31T19:06:15.552121+0000","last_unstale":"2023-08-31T19:06:16.001143+0000","last_undegraded":"2023-08-31T19:06:16.001143+0000","last_fullsized":"2023-08-31T19:06:16.001143+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021946+0000","last_change":"2023-08-31T19:06:16.017662+0000","last_active":"2023-08-31T19:06:16.021946+0000","last_peered":"2023-08-31T19:06:16.021946+0000","last_clean":"2023-08-31T19:06:16.021946+0000","last_became_active":"2023-08-31T19:06:16.016781+0000","last_became_peered":"2023-08-31T19:06:16.016781+0000","last_unstale":"2023-08-31T19:06:16.021946+0000","last_undegraded":"2023-08-31T19:06:16.021946+0000","last_fullsized":"2023-08-31T19:06:16.021946+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002396+0000","last_change":"2023-08-31T19:06:15.545759+0000","last_active":"2023-08-31T19:06:16.002396+0000","last_peered":"2023-08-31T19:06:16.002396+0000","last_clean":"2023-08-31T19:06:16.002396+0000","last_became_active":"2023-08-31T19:06:15.545457+0000","last_became_peered":"2023-08-31T19:06:15.545457+0000","last_unstale":"2023-08-31T19:06:16.002396+0000","last_undegraded":"2023-08-31T19:06:16.002396+0000","last_fullsized":"2023-08-31T19:06:16.002396+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.035038+0000","last_change":"2023-08-31T19:06:16.031294+0000","last_active":"2023-08-31T19:06:16.035038+0000","last_peered":"2023-08-31T19:06:16.035038+0000","last_clean":"2023-08-31T19:06:16.035038+0000","last_became_active":"2023-08-31T19:06:16.029582+0000","last_became_peered":"2023-08-31T19:06:16.029582+0000","last_unstale":"2023-08-31T19:06:16.035038+0000","last_undegraded":"2023-08-31T19:06:16.035038+0000","last_fullsized":"2023-08-31T19:06:16.035038+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.032684+0000","last_change":"2023-08-31T19:06:15.555851+0000","last_active":"2023-08-31T19:06:16.032684+0000","last_peered":"2023-08-31T19:06:16.032684+0000","last_clean":"2023-08-31T19:06:16.032684+0000","last_became_active":"2023-08-31T19:06:15.555549+0000","last_became_peered":"2023-08-31T19:06:15.555549+0000","last_unstale":"2023-08-31T19:06:16.032684+0000","last_undegraded":"2023-08-31T19:06:16.032684+0000","last_fullsized":"2023-08-31T19:06:16.032684+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023905+0000","last_change":"2023-08-31T19:06:16.020768+0000","last_active":"2023-08-31T19:06:16.023905+0000","last_peered":"2023-08-31T19:06:16.023905+0000","last_clean":"2023-08-31T19:06:16.023905+0000","last_became_active":"2023-08-31T19:06:16.020490+0000","last_became_peered":"2023-08-31T19:06:16.020490+0000","last_unstale":"2023-08-31T19:06:16.023905+0000","last_undegraded":"2023-08-31T19:06:16.023905+0000","last_fullsized":"2023-08-31T19:06:16.023905+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014703+0000","last_change":"2023-08-31T19:06:15.551795+0000","last_active":"2023-08-31T19:06:16.014703+0000","last_peered":"2023-08-31T19:06:16.014703+0000","last_clean":"2023-08-31T19:06:16.014703+0000","last_became_active":"2023-08-31T19:06:15.551508+0000","last_became_peered":"2023-08-31T19:06:15.551508+0000","last_unstale":"2023-08-31T19:06:16.014703+0000","last_undegraded":"2023-08-31T19:06:16.014703+0000","last_fullsized":"2023-08-31T19:06:16.014703+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023828+0000","last_change":"2023-08-31T19:06:16.021132+0000","last_active":"2023-08-31T19:06:16.023828+0000","last_peered":"2023-08-31T19:06:16.023828+0000","last_clean":"2023-08-31T19:06:16.023828+0000","last_became_active":"2023-08-31T19:06:16.020804+0000","last_became_peered":"2023-08-31T19:06:16.020804+0000","last_unstale":"2023-08-31T19:06:16.023828+0000","last_undegraded":"2023-08-31T19:06:16.023828+0000","last_fullsized":"2023-08-31T19:06:16.023828+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.001025+0000","last_change":"2023-08-31T19:06:15.554279+0000","last_active":"2023-08-31T19:06:16.001025+0000","last_peered":"2023-08-31T19:06:16.001025+0000","last_clean":"2023-08-31T19:06:16.001025+0000","last_became_active":"2023-08-31T19:06:15.553976+0000","last_became_peered":"2023-08-31T19:06:15.553976+0000","last_unstale":"2023-08-31T19:06:16.001025+0000","last_undegraded":"2023-08-31T19:06:16.001025+0000","last_fullsized":"2023-08-31T19:06:16.001025+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023650+0000","last_change":"2023-08-31T19:06:16.020652+0000","last_active":"2023-08-31T19:06:16.023650+0000","last_peered":"2023-08-31T19:06:16.023650+0000","last_clean":"2023-08-31T19:06:16.023650+0000","last_became_active":"2023-08-31T19:06:16.020347+0000","last_became_peered":"2023-08-31T19:06:16.020347+0000","last_unstale":"2023-08-31T19:06:16.023650+0000","last_undegraded":"2023-08-31T19:06:16.023650+0000","last_fullsized":"2023-08-31T19:06:16.023650+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023781+0000","last_change":"2023-08-31T19:06:15.551665+0000","last_active":"2023-08-31T19:06:16.023781+0000","last_peered":"2023-08-31T19:06:16.023781+0000","last_clean":"2023-08-31T19:06:16.023781+0000","last_became_active":"2023-08-31T19:06:15.551291+0000","last_became_peered":"2023-08-31T19:06:15.551291+0000","last_unstale":"2023-08-31T19:06:16.023781+0000","last_undegraded":"2023-08-31T19:06:16.023781+0000","last_fullsized":"2023-08-31T19:06:16.023781+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.015626+0000","last_change":"2023-08-31T19:06:16.012268+0000","last_active":"2023-08-31T19:06:16.015626+0000","last_peered":"2023-08-31T19:06:16.015626+0000","last_clean":"2023-08-31T19:06:16.015626+0000","last_became_active":"2023-08-31T19:06:16.011614+0000","last_became_peered":"2023-08-31T19:06:16.011614+0000","last_unstale":"2023-08-31T19:06:16.015626+0000","last_undegraded":"2023-08-31T19:06:16.015626+0000","last_fullsized":"2023-08-31T19:06:16.015626+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.005183+0000","last_change":"2023-08-31T19:06:15.548386+0000","last_active":"2023-08-31T19:06:16.005183+0000","last_peered":"2023-08-31T19:06:16.005183+0000","last_clean":"2023-08-31T19:06:16.005183+0000","last_became_active":"2023-08-31T19:06:15.548082+0000","last_became_peered":"2023-08-31T19:06:15.548082+0000","last_unstale":"2023-08-31T19:06:16.005183+0000","last_undegraded":"2023-08-31T19:06:16.005183+0000","last_fullsized":"2023-08-31T19:06:16.005183+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021750+0000","last_change":"2023-08-31T19:06:16.015504+0000","last_active":"2023-08-31T19:06:16.021750+0000","last_peered":"2023-08-31T19:06:16.021750+0000","last_clean":"2023-08-31T19:06:16.021750+0000","last_became_active":"2023-08-31T19:06:16.015160+0000","last_became_peered":"2023-08-31T19:06:16.015160+0000","last_unstale":"2023-08-31T19:06:16.021750+0000","last_undegraded":"2023-08-31T19:06:16.021750+0000","last_fullsized":"2023-08-31T19:06:16.021750+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.020193+0000","last_change":"2023-08-31T19:06:15.559486+0000","last_active":"2023-08-31T19:06:16.020193+0000","last_peered":"2023-08-31T19:06:16.020193+0000","last_clean":"2023-08-31T19:06:16.020193+0000","last_became_active":"2023-08-31T19:06:15.558718+0000","last_became_peered":"2023-08-31T19:06:15.558718+0000","last_unstale":"2023-08-31T19:06:16.020193+0000","last_undegraded":"2023-08-31T19:06:16.020193+0000","last_fullsized":"2023-08-31T19:06:16.020193+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.024768+0000","last_change":"2023-08-31T19:06:16.021832+0000","last_active":"2023-08-31T19:06:16.024768+0000","last_peered":"2023-08-31T19:06:16.024768+0000","last_clean":"2023-08-31T19:06:16.024768+0000","last_became_active":"2023-08-31T19:06:16.021167+0000","last_became_peered":"2023-08-31T19:06:16.021167+0000","last_unstale":"2023-08-31T19:06:16.024768+0000","last_undegraded":"2023-08-31T19:06:16.024768+0000","last_fullsized":"2023-08-31T19:06:16.024768+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014331+0000","last_change":"2023-08-31T19:06:15.548960+0000","last_active":"2023-08-31T19:06:16.014331+0000","last_peered":"2023-08-31T19:06:16.014331+0000","last_clean":"2023-08-31T19:06:16.014331+0000","last_became_active":"2023-08-31T19:06:15.548678+0000","last_became_peered":"2023-08-31T19:06:15.548678+0000","last_unstale":"2023-08-31T19:06:16.014331+0000","last_undegraded":"2023-08-31T19:06:16.014331+0000","last_fullsized":"2023-08-31T19:06:16.014331+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.031111+0000","last_change":"2023-08-31T19:06:16.023409+0000","last_active":"2023-08-31T19:06:16.031111+0000","last_peered":"2023-08-31T19:06:16.031111+0000","last_clean":"2023-08-31T19:06:16.031111+0000","last_became_active":"2023-08-31T19:06:16.023101+0000","last_became_peered":"2023-08-31T19:06:16.023101+0000","last_unstale":"2023-08-31T19:06:16.031111+0000","last_undegraded":"2023-08-31T19:06:16.031111+0000","last_fullsized":"2023-08-31T19:06:16.031111+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014474+0000","last_change":"2023-08-31T19:06:15.548844+0000","last_active":"2023-08-31T19:06:16.014474+0000","last_peered":"2023-08-31T19:06:16.014474+0000","last_clean":"2023-08-31T19:06:16.014474+0000","last_became_active":"2023-08-31T19:06:15.548554+0000","last_became_peered":"2023-08-31T19:06:15.548554+0000","last_unstale":"2023-08-31T19:06:16.014474+0000","last_undegraded":"2023-08-31T19:06:16.014474+0000","last_fullsized":"2023-08-31T19:06:16.014474+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021057+0000","last_change":"2023-08-31T19:06:16.014650+0000","last_active":"2023-08-31T19:06:16.021057+0000","last_peered":"2023-08-31T19:06:16.021057+0000","last_clean":"2023-08-31T19:06:16.021057+0000","last_became_active":"2023-08-31T19:06:16.014343+0000","last_became_peered":"2023-08-31T19:06:16.014343+0000","last_unstale":"2023-08-31T19:06:16.021057+0000","last_undegraded":"2023-08-31T19:06:16.021057+0000","last_fullsized":"2023-08-31T19:06:16.021057+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.006450+0000","last_change":"2023-08-31T19:06:15.551765+0000","last_active":"2023-08-31T19:06:16.006450+0000","last_peered":"2023-08-31T19:06:16.006450+0000","last_clean":"2023-08-31T19:06:16.006450+0000","last_became_active":"2023-08-31T19:06:15.551361+0000","last_became_peered":"2023-08-31T19:06:15.551361+0000","last_unstale":"2023-08-31T19:06:16.006450+0000","last_undegraded":"2023-08-31T19:06:16.006450+0000","last_fullsized":"2023-08-31T19:06:16.006450+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.028332+0000","last_change":"2023-08-31T19:06:16.023945+0000","last_active":"2023-08-31T19:06:16.028332+0000","last_peered":"2023-08-31T19:06:16.028332+0000","last_clean":"2023-08-31T19:06:16.028332+0000","last_became_active":"2023-08-31T19:06:16.023664+0000","last_became_peered":"2023-08-31T19:06:16.023664+0000","last_unstale":"2023-08-31T19:06:16.028332+0000","last_undegraded":"2023-08-31T19:06:16.028332+0000","last_fullsized":"2023-08-31T19:06:16.028332+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:15.998306+0000","last_change":"2023-08-31T19:06:15.552754+0000","last_active":"2023-08-31T19:06:15.998306+0000","last_peered":"2023-08-31T19:06:15.998306+0000","last_clean":"2023-08-31T19:06:15.998306+0000","last_became_active":"2023-08-31T19:06:15.552473+0000","last_became_peered":"2023-08-31T19:06:15.552473+0000","last_unstale":"2023-08-31T19:06:15.998306+0000","last_undegraded":"2023-08-31T19:06:15.998306+0000","last_fullsized":"2023-08-31T19:06:15.998306+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.018670+0000","last_change":"2023-08-31T19:06:16.007199+0000","last_active":"2023-08-31T19:06:16.018670+0000","last_peered":"2023-08-31T19:06:16.018670+0000","last_clean":"2023-08-31T19:06:16.018670+0000","last_became_active":"2023-08-31T19:06:16.006882+0000","last_became_peered":"2023-08-31T19:06:16.006882+0000","last_unstale":"2023-08-31T19:06:16.018670+0000","last_undegraded":"2023-08-31T19:06:16.018670+0000","last_fullsized":"2023-08-31T19:06:16.018670+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.011836+0000","last_change":"2023-08-31T19:06:15.547449+0000","last_active":"2023-08-31T19:06:16.011836+0000","last_peered":"2023-08-31T19:06:16.011836+0000","last_clean":"2023-08-31T19:06:16.011836+0000","last_became_active":"2023-08-31T19:06:15.547081+0000","last_became_peered":"2023-08-31T19:06:15.547081+0000","last_unstale":"2023-08-31T19:06:16.011836+0000","last_undegraded":"2023-08-31T19:06:16.011836+0000","last_fullsized":"2023-08-31T19:06:16.011836+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021880+0000","last_change":"2023-08-31T19:06:16.017465+0000","last_active":"2023-08-31T19:06:16.021880+0000","last_peered":"2023-08-31T19:06:16.021880+0000","last_clean":"2023-08-31T19:06:16.021880+0000","last_became_active":"2023-08-31T19:06:16.017189+0000","last_became_peered":"2023-08-31T19:06:16.017189+0000","last_unstale":"2023-08-31T19:06:16.021880+0000","last_undegraded":"2023-08-31T19:06:16.021880+0000","last_fullsized":"2023-08-31T19:06:16.021880+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.008328+0000","last_change":"2023-08-31T19:06:15.555111+0000","last_active":"2023-08-31T19:06:16.008328+0000","last_peered":"2023-08-31T19:06:16.008328+0000","last_clean":"2023-08-31T19:06:16.008328+0000","last_became_active":"2023-08-31T19:06:15.554805+0000","last_became_peered":"2023-08-31T19:06:15.554805+0000","last_unstale":"2023-08-31T19:06:16.008328+0000","last_undegraded":"2023-08-31T19:06:16.008328+0000","last_fullsized":"2023-08-31T19:06:16.008328+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.027072+0000","last_change":"2023-08-31T19:06:16.018597+0000","last_active":"2023-08-31T19:06:16.027072+0000","last_peered":"2023-08-31T19:06:16.027072+0000","last_clean":"2023-08-31T19:06:16.027072+0000","last_became_active":"2023-08-31T19:06:16.017801+0000","last_became_peered":"2023-08-31T19:06:16.017801+0000","last_unstale":"2023-08-31T19:06:16.027072+0000","last_undegraded":"2023-08-31T19:06:16.027072+0000","last_fullsized":"2023-08-31T19:06:16.027072+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:15.998516+0000","last_change":"2023-08-31T19:06:15.544004+0000","last_active":"2023-08-31T19:06:15.998516+0000","last_peered":"2023-08-31T19:06:15.998516+0000","last_clean":"2023-08-31T19:06:15.998516+0000","last_became_active":"2023-08-31T19:06:15.543708+0000","last_became_peered":"2023-08-31T19:06:15.543708+0000","last_unstale":"2023-08-31T19:06:15.998516+0000","last_undegraded":"2023-08-31T19:06:15.998516+0000","last_fullsized":"2023-08-31T19:06:15.998516+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023651+0000","last_change":"2023-08-31T19:06:16.014845+0000","last_active":"2023-08-31T19:06:16.023651+0000","last_peered":"2023-08-31T19:06:16.023651+0000","last_clean":"2023-08-31T19:06:16.023651+0000","last_became_active":"2023-08-31T19:06:16.014620+0000","last_became_peered":"2023-08-31T19:06:16.014620+0000","last_unstale":"2023-08-31T19:06:16.023651+0000","last_undegraded":"2023-08-31T19:06:16.023651+0000","last_fullsized":"2023-08-31T19:06:16.023651+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014191+0000","last_change":"2023-08-31T19:06:15.545893+0000","last_active":"2023-08-31T19:06:16.014191+0000","last_peered":"2023-08-31T19:06:16.014191+0000","last_clean":"2023-08-31T19:06:16.014191+0000","last_became_active":"2023-08-31T19:06:15.545608+0000","last_became_peered":"2023-08-31T19:06:15.545608+0000","last_unstale":"2023-08-31T19:06:16.014191+0000","last_undegraded":"2023-08-31T19:06:16.014191+0000","last_fullsized":"2023-08-31T19:06:16.014191+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.035036+0000","last_change":"2023-08-31T19:06:16.031239+0000","last_active":"2023-08-31T19:06:16.035036+0000","last_peered":"2023-08-31T19:06:16.035036+0000","last_clean":"2023-08-31T19:06:16.035036+0000","last_became_active":"2023-08-31T19:06:16.030783+0000","last_became_peered":"2023-08-31T19:06:16.030783+0000","last_unstale":"2023-08-31T19:06:16.035036+0000","last_undegraded":"2023-08-31T19:06:16.035036+0000","last_fullsized":"2023-08-31T19:06:16.035036+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.001101+0000","last_change":"2023-08-31T19:06:15.554018+0000","last_active":"2023-08-31T19:06:16.001101+0000","last_peered":"2023-08-31T19:06:16.001101+0000","last_clean":"2023-08-31T19:06:16.001101+0000","last_became_active":"2023-08-31T19:06:15.552451+0000","last_became_peered":"2023-08-31T19:06:15.552451+0000","last_unstale":"2023-08-31T19:06:16.001101+0000","last_undegraded":"2023-08-31T19:06:16.001101+0000","last_fullsized":"2023-08-31T19:06:16.001101+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021920+0000","last_change":"2023-08-31T19:06:16.016561+0000","last_active":"2023-08-31T19:06:16.021920+0000","last_peered":"2023-08-31T19:06:16.021920+0000","last_clean":"2023-08-31T19:06:16.021920+0000","last_became_active":"2023-08-31T19:06:16.016226+0000","last_became_peered":"2023-08-31T19:06:16.016226+0000","last_unstale":"2023-08-31T19:06:16.021920+0000","last_undegraded":"2023-08-31T19:06:16.021920+0000","last_fullsized":"2023-08-31T19:06:16.021920+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002439+0000","last_change":"2023-08-31T19:06:15.551424+0000","last_active":"2023-08-31T19:06:16.002439+0000","last_peered":"2023-08-31T19:06:16.002439+0000","last_clean":"2023-08-31T19:06:16.002439+0000","last_became_active":"2023-08-31T19:06:15.551066+0000","last_became_peered":"2023-08-31T19:06:15.551066+0000","last_unstale":"2023-08-31T19:06:16.002439+0000","last_undegraded":"2023-08-31T19:06:16.002439+0000","last_fullsized":"2023-08-31T19:06:16.002439+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.035009+0000","last_change":"2023-08-31T19:06:16.031266+0000","last_active":"2023-08-31T19:06:16.035009+0000","last_peered":"2023-08-31T19:06:16.035009+0000","last_clean":"2023-08-31T19:06:16.035009+0000","last_became_active":"2023-08-31T19:06:16.029715+0000","last_became_peered":"2023-08-31T19:06:16.029715+0000","last_unstale":"2023-08-31T19:06:16.035009+0000","last_undegraded":"2023-08-31T19:06:16.035009+0000","last_fullsized":"2023-08-31T19:06:16.035009+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.009764+0000","last_change":"2023-08-31T19:06:15.549762+0000","last_active":"2023-08-31T19:06:16.009764+0000","last_peered":"2023-08-31T19:06:16.009764+0000","last_clean":"2023-08-31T19:06:16.009764+0000","last_became_active":"2023-08-31T19:06:15.549499+0000","last_became_peered":"2023-08-31T19:06:15.549499+0000","last_unstale":"2023-08-31T19:06:16.009764+0000","last_undegraded":"2023-08-31T19:06:16.009764+0000","last_fullsized":"2023-08-31T19:06:16.009764+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.034975+0000","last_change":"2023-08-31T19:06:16.030369+0000","last_active":"2023-08-31T19:06:16.034975+0000","last_peered":"2023-08-31T19:06:16.034975+0000","last_clean":"2023-08-31T19:06:16.034975+0000","last_became_active":"2023-08-31T19:06:16.030126+0000","last_became_peered":"2023-08-31T19:06:16.030126+0000","last_unstale":"2023-08-31T19:06:16.034975+0000","last_undegraded":"2023-08-31T19:06:16.034975+0000","last_fullsized":"2023-08-31T19:06:16.034975+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021311+0000","last_change":"2023-08-31T19:06:15.543757+0000","last_active":"2023-08-31T19:06:16.021311+0000","last_peered":"2023-08-31T19:06:16.021311+0000","last_clean":"2023-08-31T19:06:16.021311+0000","last_became_active":"2023-08-31T19:06:15.543477+0000","last_became_peered":"2023-08-31T19:06:15.543477+0000","last_unstale":"2023-08-31T19:06:16.021311+0000","last_undegraded":"2023-08-31T19:06:16.021311+0000","last_fullsized":"2023-08-31T19:06:16.021311+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023573+0000","last_change":"2023-08-31T19:06:16.019413+0000","last_active":"2023-08-31T19:06:16.023573+0000","last_peered":"2023-08-31T19:06:16.023573+0000","last_clean":"2023-08-31T19:06:16.023573+0000","last_became_active":"2023-08-31T19:06:16.019152+0000","last_became_peered":"2023-08-31T19:06:16.019152+0000","last_unstale":"2023-08-31T19:06:16.023573+0000","last_undegraded":"2023-08-31T19:06:16.023573+0000","last_fullsized":"2023-08-31T19:06:16.023573+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021467+0000","last_change":"2023-08-31T19:06:15.553717+0000","last_active":"2023-08-31T19:06:16.021467+0000","last_peered":"2023-08-31T19:06:16.021467+0000","last_clean":"2023-08-31T19:06:16.021467+0000","last_became_active":"2023-08-31T19:06:15.553388+0000","last_became_peered":"2023-08-31T19:06:15.553388+0000","last_unstale":"2023-08-31T19:06:16.021467+0000","last_undegraded":"2023-08-31T19:06:16.021467+0000","last_fullsized":"2023-08-31T19:06:16.021467+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.026119+0000","last_change":"2023-08-31T19:06:16.023016+0000","last_active":"2023-08-31T19:06:16.026119+0000","last_peered":"2023-08-31T19:06:16.026119+0000","last_clean":"2023-08-31T19:06:16.026119+0000","last_became_active":"2023-08-31T19:06:16.022706+0000","last_became_peered":"2023-08-31T19:06:16.022706+0000","last_unstale":"2023-08-31T19:06:16.026119+0000","last_undegraded":"2023-08-31T19:06:16.026119+0000","last_fullsized":"2023-08-31T19:06:16.026119+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.025415+0000","last_change":"2023-08-31T19:06:15.549188+0000","last_active":"2023-08-31T19:06:16.025415+0000","last_peered":"2023-08-31T19:06:16.025415+0000","last_clean":"2023-08-31T19:06:16.025415+0000","last_became_active":"2023-08-31T19:06:15.547890+0000","last_became_peered":"2023-08-31T19:06:15.547890+0000","last_unstale":"2023-08-31T19:06:16.025415+0000","last_undegraded":"2023-08-31T19:06:16.025415+0000","last_fullsized":"2023-08-31T19:06:16.025415+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023240+0000","last_change":"2023-08-31T19:06:16.015424+0000","last_active":"2023-08-31T19:06:16.023240+0000","last_peered":"2023-08-31T19:06:16.023240+0000","last_clean":"2023-08-31T19:06:16.023240+0000","last_became_active":"2023-08-31T19:06:16.015111+0000","last_became_peered":"2023-08-31T19:06:16.015111+0000","last_unstale":"2023-08-31T19:06:16.023240+0000","last_undegraded":"2023-08-31T19:06:16.023240+0000","last_fullsized":"2023-08-31T19:06:16.023240+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014024+0000","last_change":"2023-08-31T19:06:15.542317+0000","last_active":"2023-08-31T19:06:16.014024+0000","last_peered":"2023-08-31T19:06:16.014024+0000","last_clean":"2023-08-31T19:06:16.014024+0000","last_became_active":"2023-08-31T19:06:15.542041+0000","last_became_peered":"2023-08-31T19:06:15.542041+0000","last_unstale":"2023-08-31T19:06:16.014024+0000","last_undegraded":"2023-08-31T19:06:16.014024+0000","last_fullsized":"2023-08-31T19:06:16.014024+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023668+0000","last_change":"2023-08-31T19:06:16.021138+0000","last_active":"2023-08-31T19:06:16.023668+0000","last_peered":"2023-08-31T19:06:16.023668+0000","last_clean":"2023-08-31T19:06:16.023668+0000","last_became_active":"2023-08-31T19:06:16.020855+0000","last_became_peered":"2023-08-31T19:06:16.020855+0000","last_unstale":"2023-08-31T19:06:16.023668+0000","last_undegraded":"2023-08-31T19:06:16.023668+0000","last_fullsized":"2023-08-31T19:06:16.023668+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.008217+0000","last_change":"2023-08-31T19:06:15.551995+0000","last_active":"2023-08-31T19:06:16.008217+0000","last_peered":"2023-08-31T19:06:16.008217+0000","last_clean":"2023-08-31T19:06:16.008217+0000","last_became_active":"2023-08-31T19:06:15.551702+0000","last_became_peered":"2023-08-31T19:06:15.551702+0000","last_unstale":"2023-08-31T19:06:16.008217+0000","last_undegraded":"2023-08-31T19:06:16.008217+0000","last_fullsized":"2023-08-31T19:06:16.008217+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.034961+0000","last_change":"2023-08-31T19:06:16.030459+0000","last_active":"2023-08-31T19:06:16.034961+0000","last_peered":"2023-08-31T19:06:16.034961+0000","last_clean":"2023-08-31T19:06:16.034961+0000","last_became_active":"2023-08-31T19:06:16.029604+0000","last_became_peered":"2023-08-31T19:06:16.029604+0000","last_unstale":"2023-08-31T19:06:16.034961+0000","last_undegraded":"2023-08-31T19:06:16.034961+0000","last_fullsized":"2023-08-31T19:06:16.034961+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002583+0000","last_change":"2023-08-31T19:06:15.547212+0000","last_active":"2023-08-31T19:06:16.002583+0000","last_peered":"2023-08-31T19:06:16.002583+0000","last_clean":"2023-08-31T19:06:16.002583+0000","last_became_active":"2023-08-31T19:06:15.546451+0000","last_became_peered":"2023-08-31T19:06:15.546451+0000","last_unstale":"2023-08-31T19:06:16.002583+0000","last_undegraded":"2023-08-31T19:06:16.002583+0000","last_fullsized":"2023-08-31T19:06:16.002583+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.018998+0000","last_change":"2023-08-31T19:06:16.008984+0000","last_active":"2023-08-31T19:06:16.018998+0000","last_peered":"2023-08-31T19:06:16.018998+0000","last_clean":"2023-08-31T19:06:16.018998+0000","last_became_active":"2023-08-31T19:06:16.008647+0000","last_became_peered":"2023-08-31T19:06:16.008647+0000","last_unstale":"2023-08-31T19:06:16.018998+0000","last_undegraded":"2023-08-31T19:06:16.018998+0000","last_fullsized":"2023-08-31T19:06:16.018998+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.004097+0000","last_change":"2023-08-31T19:06:15.550610+0000","last_active":"2023-08-31T19:06:16.004097+0000","last_peered":"2023-08-31T19:06:16.004097+0000","last_clean":"2023-08-31T19:06:16.004097+0000","last_became_active":"2023-08-31T19:06:15.550313+0000","last_became_peered":"2023-08-31T19:06:15.550313+0000","last_unstale":"2023-08-31T19:06:16.004097+0000","last_undegraded":"2023-08-31T19:06:16.004097+0000","last_fullsized":"2023-08-31T19:06:16.004097+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.034901+0000","last_change":"2023-08-31T19:06:16.030531+0000","last_active":"2023-08-31T19:06:16.034901+0000","last_peered":"2023-08-31T19:06:16.034901+0000","last_clean":"2023-08-31T19:06:16.034901+0000","last_became_active":"2023-08-31T19:06:16.029986+0000","last_became_peered":"2023-08-31T19:06:16.029986+0000","last_unstale":"2023-08-31T19:06:16.034901+0000","last_undegraded":"2023-08-31T19:06:16.034901+0000","last_fullsized":"2023-08-31T19:06:16.034901+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002233+0000","last_change":"2023-08-31T19:06:15.546077+0000","last_active":"2023-08-31T19:06:16.002233+0000","last_peered":"2023-08-31T19:06:16.002233+0000","last_clean":"2023-08-31T19:06:16.002233+0000","last_became_active":"2023-08-31T19:06:15.545819+0000","last_became_peered":"2023-08-31T19:06:15.545819+0000","last_unstale":"2023-08-31T19:06:16.002233+0000","last_undegraded":"2023-08-31T19:06:16.002233+0000","last_fullsized":"2023-08-31T19:06:16.002233+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.032835+0000","last_change":"2023-08-31T19:06:16.026347+0000","last_active":"2023-08-31T19:06:16.032835+0000","last_peered":"2023-08-31T19:06:16.032835+0000","last_clean":"2023-08-31T19:06:16.032835+0000","last_became_active":"2023-08-31T19:06:16.026076+0000","last_became_peered":"2023-08-31T19:06:16.026076+0000","last_unstale":"2023-08-31T19:06:16.032835+0000","last_undegraded":"2023-08-31T19:06:16.032835+0000","last_fullsized":"2023-08-31T19:06:16.032835+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.003787+0000","last_change":"2023-08-31T19:06:15.545448+0000","last_active":"2023-08-31T19:06:16.003787+0000","last_peered":"2023-08-31T19:06:16.003787+0000","last_clean":"2023-08-31T19:06:16.003787+0000","last_became_active":"2023-08-31T19:06:15.545159+0000","last_became_peered":"2023-08-31T19:06:15.545159+0000","last_unstale":"2023-08-31T19:06:16.003787+0000","last_undegraded":"2023-08-31T19:06:16.003787+0000","last_fullsized":"2023-08-31T19:06:16.003787+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.026850+0000","last_change":"2023-08-31T19:06:16.018004+0000","last_active":"2023-08-31T19:06:16.026850+0000","last_peered":"2023-08-31T19:06:16.026850+0000","last_clean":"2023-08-31T19:06:16.026850+0000","last_became_active":"2023-08-31T19:06:16.017709+0000","last_became_peered":"2023-08-31T19:06:16.017709+0000","last_unstale":"2023-08-31T19:06:16.026850+0000","last_undegraded":"2023-08-31T19:06:16.026850+0000","last_fullsized":"2023-08-31T19:06:16.026850+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.011932+0000","last_change":"2023-08-31T19:06:15.547344+0000","last_active":"2023-08-31T19:06:16.011932+0000","last_peered":"2023-08-31T19:06:16.011932+0000","last_clean":"2023-08-31T19:06:16.011932+0000","last_became_active":"2023-08-31T19:06:15.546879+0000","last_became_peered":"2023-08-31T19:06:15.546879+0000","last_unstale":"2023-08-31T19:06:16.011932+0000","last_undegraded":"2023-08-31T19:06:16.011932+0000","last_fullsized":"2023-08-31T19:06:16.011932+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.028021+0000","last_change":"2023-08-31T19:06:16.021881+0000","last_active":"2023-08-31T19:06:16.028021+0000","last_peered":"2023-08-31T19:06:16.028021+0000","last_clean":"2023-08-31T19:06:16.028021+0000","last_became_active":"2023-08-31T19:06:16.021621+0000","last_became_peered":"2023-08-31T19:06:16.021621+0000","last_unstale":"2023-08-31T19:06:16.028021+0000","last_undegraded":"2023-08-31T19:06:16.028021+0000","last_fullsized":"2023-08-31T19:06:16.028021+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.032300+0000","last_change":"2023-08-31T19:06:15.557356+0000","last_active":"2023-08-31T19:06:16.032300+0000","last_peered":"2023-08-31T19:06:16.032300+0000","last_clean":"2023-08-31T19:06:16.032300+0000","last_became_active":"2023-08-31T19:06:15.557040+0000","last_became_peered":"2023-08-31T19:06:15.557040+0000","last_unstale":"2023-08-31T19:06:16.032300+0000","last_undegraded":"2023-08-31T19:06:16.032300+0000","last_fullsized":"2023-08-31T19:06:16.032300+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.027051+0000","last_change":"2023-08-31T19:06:16.018582+0000","last_active":"2023-08-31T19:06:16.027051+0000","last_peered":"2023-08-31T19:06:16.027051+0000","last_clean":"2023-08-31T19:06:16.027051+0000","last_became_active":"2023-08-31T19:06:16.018318+0000","last_became_peered":"2023-08-31T19:06:16.018318+0000","last_unstale":"2023-08-31T19:06:16.027051+0000","last_undegraded":"2023-08-31T19:06:16.027051+0000","last_fullsized":"2023-08-31T19:06:16.027051+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.032446+0000","last_change":"2023-08-31T19:06:15.549282+0000","last_active":"2023-08-31T19:06:16.032446+0000","last_peered":"2023-08-31T19:06:16.032446+0000","last_clean":"2023-08-31T19:06:16.032446+0000","last_became_active":"2023-08-31T19:06:15.548922+0000","last_became_peered":"2023-08-31T19:06:15.548922+0000","last_unstale":"2023-08-31T19:06:16.032446+0000","last_undegraded":"2023-08-31T19:06:16.032446+0000","last_fullsized":"2023-08-31T19:06:16.032446+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.029563+0000","last_change":"2023-08-31T19:06:16.026549+0000","last_active":"2023-08-31T19:06:16.029563+0000","last_peered":"2023-08-31T19:06:16.029563+0000","last_clean":"2023-08-31T19:06:16.029563+0000","last_became_active":"2023-08-31T19:06:16.026278+0000","last_became_peered":"2023-08-31T19:06:16.026278+0000","last_unstale":"2023-08-31T19:06:16.029563+0000","last_undegraded":"2023-08-31T19:06:16.029563+0000","last_fullsized":"2023-08-31T19:06:16.029563+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.028180+0000","last_change":"2023-08-31T19:06:15.554352+0000","last_active":"2023-08-31T19:06:16.028180+0000","last_peered":"2023-08-31T19:06:16.028180+0000","last_clean":"2023-08-31T19:06:16.028180+0000","last_became_active":"2023-08-31T19:06:15.554026+0000","last_became_peered":"2023-08-31T19:06:15.554026+0000","last_unstale":"2023-08-31T19:06:16.028180+0000","last_undegraded":"2023-08-31T19:06:16.028180+0000","last_fullsized":"2023-08-31T19:06:16.028180+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021356+0000","last_change":"2023-08-31T19:06:16.014500+0000","last_active":"2023-08-31T19:06:16.021356+0000","last_peered":"2023-08-31T19:06:16.021356+0000","last_clean":"2023-08-31T19:06:16.021356+0000","last_became_active":"2023-08-31T19:06:16.014202+0000","last_became_peered":"2023-08-31T19:06:16.014202+0000","last_unstale":"2023-08-31T19:06:16.021356+0000","last_undegraded":"2023-08-31T19:06:16.021356+0000","last_fullsized":"2023-08-31T19:06:16.021356+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.003404+0000","last_change":"2023-08-31T19:06:15.554421+0000","last_active":"2023-08-31T19:06:16.003404+0000","last_peered":"2023-08-31T19:06:16.003404+0000","last_clean":"2023-08-31T19:06:16.003404+0000","last_became_active":"2023-08-31T19:06:15.553612+0000","last_became_peered":"2023-08-31T19:06:15.553612+0000","last_unstale":"2023-08-31T19:06:16.003404+0000","last_undegraded":"2023-08-31T19:06:16.003404+0000","last_fullsized":"2023-08-31T19:06:16.003404+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021562+0000","last_change":"2023-08-31T19:06:16.015813+0000","last_active":"2023-08-31T19:06:16.021562+0000","last_peered":"2023-08-31T19:06:16.021562+0000","last_clean":"2023-08-31T19:06:16.021562+0000","last_became_active":"2023-08-31T19:06:16.015528+0000","last_became_peered":"2023-08-31T19:06:16.015528+0000","last_unstale":"2023-08-31T19:06:16.021562+0000","last_undegraded":"2023-08-31T19:06:16.021562+0000","last_fullsized":"2023-08-31T19:06:16.021562+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.000135+0000","last_change":"2023-08-31T19:06:15.552202+0000","last_active":"2023-08-31T19:06:16.000135+0000","last_peered":"2023-08-31T19:06:16.000135+0000","last_clean":"2023-08-31T19:06:16.000135+0000","last_became_active":"2023-08-31T19:06:15.551898+0000","last_became_peered":"2023-08-31T19:06:15.551898+0000","last_unstale":"2023-08-31T19:06:16.000135+0000","last_undegraded":"2023-08-31T19:06:16.000135+0000","last_fullsized":"2023-08-31T19:06:16.000135+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.035056+0000","last_change":"2023-08-31T19:06:16.031914+0000","last_active":"2023-08-31T19:06:16.035056+0000","last_peered":"2023-08-31T19:06:16.035056+0000","last_clean":"2023-08-31T19:06:16.035056+0000","last_became_active":"2023-08-31T19:06:16.031663+0000","last_became_peered":"2023-08-31T19:06:16.031663+0000","last_unstale":"2023-08-31T19:06:16.035056+0000","last_undegraded":"2023-08-31T19:06:16.035056+0000","last_fullsized":"2023-08-31T19:06:16.035056+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.025281+0000","last_change":"2023-08-31T19:06:15.544835+0000","last_active":"2023-08-31T19:06:16.025281+0000","last_peered":"2023-08-31T19:06:16.025281+0000","last_clean":"2023-08-31T19:06:16.025281+0000","last_became_active":"2023-08-31T19:06:15.544534+0000","last_became_peered":"2023-08-31T19:06:15.544534+0000","last_unstale":"2023-08-31T19:06:16.025281+0000","last_undegraded":"2023-08-31T19:06:16.025281+0000","last_fullsized":"2023-08-31T19:06:16.025281+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.034865+0000","last_change":"2023-08-31T19:06:16.029770+0000","last_active":"2023-08-31T19:06:16.034865+0000","last_peered":"2023-08-31T19:06:16.034865+0000","last_clean":"2023-08-31T19:06:16.034865+0000","last_became_active":"2023-08-31T19:06:16.029479+0000","last_became_peered":"2023-08-31T19:06:16.029479+0000","last_unstale":"2023-08-31T19:06:16.034865+0000","last_undegraded":"2023-08-31T19:06:16.034865+0000","last_fullsized":"2023-08-31T19:06:16.034865+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.022463+0000","last_change":"2023-08-31T19:06:15.554370+0000","last_active":"2023-08-31T19:06:16.022463+0000","last_peered":"2023-08-31T19:06:16.022463+0000","last_clean":"2023-08-31T19:06:16.022463+0000","last_became_active":"2023-08-31T19:06:15.554084+0000","last_became_peered":"2023-08-31T19:06:15.554084+0000","last_unstale":"2023-08-31T19:06:16.022463+0000","last_undegraded":"2023-08-31T19:06:16.022463+0000","last_fullsized":"2023-08-31T19:06:16.022463+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.019964+0000","last_change":"2023-08-31T19:06:16.015558+0000","last_active":"2023-08-31T19:06:16.019964+0000","last_peered":"2023-08-31T19:06:16.019964+0000","last_clean":"2023-08-31T19:06:16.019964+0000","last_became_active":"2023-08-31T19:06:16.015250+0000","last_became_peered":"2023-08-31T19:06:16.015250+0000","last_unstale":"2023-08-31T19:06:16.019964+0000","last_undegraded":"2023-08-31T19:06:16.019964+0000","last_fullsized":"2023-08-31T19:06:16.019964+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.011957+0000","last_change":"2023-08-31T19:06:15.547273+0000","last_active":"2023-08-31T19:06:16.011957+0000","last_peered":"2023-08-31T19:06:16.011957+0000","last_clean":"2023-08-31T19:06:16.011957+0000","last_became_active":"2023-08-31T19:06:15.546763+0000","last_became_peered":"2023-08-31T19:06:15.546763+0000","last_unstale":"2023-08-31T19:06:16.011957+0000","last_undegraded":"2023-08-31T19:06:16.011957+0000","last_fullsized":"2023-08-31T19:06:16.011957+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023619+0000","last_change":"2023-08-31T19:06:16.017094+0000","last_active":"2023-08-31T19:06:16.023619+0000","last_peered":"2023-08-31T19:06:16.023619+0000","last_clean":"2023-08-31T19:06:16.023619+0000","last_became_active":"2023-08-31T19:06:16.016785+0000","last_became_peered":"2023-08-31T19:06:16.016785+0000","last_unstale":"2023-08-31T19:06:16.023619+0000","last_undegraded":"2023-08-31T19:06:16.023619+0000","last_fullsized":"2023-08-31T19:06:16.023619+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:15.997981+0000","last_change":"2023-08-31T19:06:15.543511+0000","last_active":"2023-08-31T19:06:15.997981+0000","last_peered":"2023-08-31T19:06:15.997981+0000","last_clean":"2023-08-31T19:06:15.997981+0000","last_became_active":"2023-08-31T19:06:15.543199+0000","last_became_peered":"2023-08-31T19:06:15.543199+0000","last_unstale":"2023-08-31T19:06:15.997981+0000","last_undegraded":"2023-08-31T19:06:15.997981+0000","last_fullsized":"2023-08-31T19:06:15.997981+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023261+0000","last_change":"2023-08-31T19:06:16.016915+0000","last_active":"2023-08-31T19:06:16.023261+0000","last_peered":"2023-08-31T19:06:16.023261+0000","last_clean":"2023-08-31T19:06:16.023261+0000","last_became_active":"2023-08-31T19:06:16.016616+0000","last_became_peered":"2023-08-31T19:06:16.016616+0000","last_unstale":"2023-08-31T19:06:16.023261+0000","last_undegraded":"2023-08-31T19:06:16.023261+0000","last_fullsized":"2023-08-31T19:06:16.023261+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014128+0000","last_change":"2023-08-31T19:06:15.538576+0000","last_active":"2023-08-31T19:06:16.014128+0000","last_peered":"2023-08-31T19:06:16.014128+0000","last_clean":"2023-08-31T19:06:16.014128+0000","last_became_active":"2023-08-31T19:06:15.538271+0000","last_became_peered":"2023-08-31T19:06:15.538271+0000","last_unstale":"2023-08-31T19:06:16.014128+0000","last_undegraded":"2023-08-31T19:06:16.014128+0000","last_fullsized":"2023-08-31T19:06:16.014128+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.027953+0000","last_change":"2023-08-31T19:06:16.021302+0000","last_active":"2023-08-31T19:06:16.027953+0000","last_peered":"2023-08-31T19:06:16.027953+0000","last_clean":"2023-08-31T19:06:16.027953+0000","last_became_active":"2023-08-31T19:06:16.021036+0000","last_became_peered":"2023-08-31T19:06:16.021036+0000","last_unstale":"2023-08-31T19:06:16.027953+0000","last_undegraded":"2023-08-31T19:06:16.027953+0000","last_fullsized":"2023-08-31T19:06:16.027953+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.004296+0000","last_change":"2023-08-31T19:06:15.540194+0000","last_active":"2023-08-31T19:06:16.004296+0000","last_peered":"2023-08-31T19:06:16.004296+0000","last_clean":"2023-08-31T19:06:16.004296+0000","last_became_active":"2023-08-31T19:06:15.539895+0000","last_became_peered":"2023-08-31T19:06:15.539895+0000","last_unstale":"2023-08-31T19:06:16.004296+0000","last_undegraded":"2023-08-31T19:06:16.004296+0000","last_fullsized":"2023-08-31T19:06:16.004296+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.028057+0000","last_change":"2023-08-31T19:06:16.022109+0000","last_active":"2023-08-31T19:06:16.028057+0000","last_peered":"2023-08-31T19:06:16.028057+0000","last_clean":"2023-08-31T19:06:16.028057+0000","last_became_active":"2023-08-31T19:06:16.021818+0000","last_became_peered":"2023-08-31T19:06:16.021818+0000","last_unstale":"2023-08-31T19:06:16.028057+0000","last_undegraded":"2023-08-31T19:06:16.028057+0000","last_fullsized":"2023-08-31T19:06:16.028057+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.001229+0000","last_change":"2023-08-31T19:06:15.552423+0000","last_active":"2023-08-31T19:06:16.001229+0000","last_peered":"2023-08-31T19:06:16.001229+0000","last_clean":"2023-08-31T19:06:16.001229+0000","last_became_active":"2023-08-31T19:06:15.551428+0000","last_became_peered":"2023-08-31T19:06:15.551428+0000","last_unstale":"2023-08-31T19:06:16.001229+0000","last_undegraded":"2023-08-31T19:06:16.001229+0000","last_fullsized":"2023-08-31T19:06:16.001229+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023587+0000","last_change":"2023-08-31T19:06:16.020165+0000","last_active":"2023-08-31T19:06:16.023587+0000","last_peered":"2023-08-31T19:06:16.023587+0000","last_clean":"2023-08-31T19:06:16.023587+0000","last_became_active":"2023-08-31T19:06:16.019847+0000","last_became_peered":"2023-08-31T19:06:16.019847+0000","last_unstale":"2023-08-31T19:06:16.023587+0000","last_undegraded":"2023-08-31T19:06:16.023587+0000","last_fullsized":"2023-08-31T19:06:16.023587+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:15.997997+0000","last_change":"2023-08-31T19:06:15.543608+0000","last_active":"2023-08-31T19:06:15.997997+0000","last_peered":"2023-08-31T19:06:15.997997+0000","last_clean":"2023-08-31T19:06:15.997997+0000","last_became_active":"2023-08-31T19:06:15.543269+0000","last_became_peered":"2023-08-31T19:06:15.543269+0000","last_unstale":"2023-08-31T19:06:15.997997+0000","last_undegraded":"2023-08-31T19:06:15.997997+0000","last_fullsized":"2023-08-31T19:06:15.997997+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.025735+0000","last_change":"2023-08-31T19:06:16.022947+0000","last_active":"2023-08-31T19:06:16.025735+0000","last_peered":"2023-08-31T19:06:16.025735+0000","last_clean":"2023-08-31T19:06:16.025735+0000","last_became_active":"2023-08-31T19:06:16.021610+0000","last_became_peered":"2023-08-31T19:06:16.021610+0000","last_unstale":"2023-08-31T19:06:16.025735+0000","last_undegraded":"2023-08-31T19:06:16.025735+0000","last_fullsized":"2023-08-31T19:06:16.025735+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002688+0000","last_change":"2023-08-31T19:06:15.552870+0000","last_active":"2023-08-31T19:06:16.002688+0000","last_peered":"2023-08-31T19:06:16.002688+0000","last_clean":"2023-08-31T19:06:16.002688+0000","last_became_active":"2023-08-31T19:06:15.552566+0000","last_became_peered":"2023-08-31T19:06:15.552566+0000","last_unstale":"2023-08-31T19:06:16.002688+0000","last_undegraded":"2023-08-31T19:06:16.002688+0000","last_fullsized":"2023-08-31T19:06:16.002688+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.024229+0000","last_change":"2023-08-31T19:06:16.014290+0000","last_active":"2023-08-31T19:06:16.024229+0000","last_peered":"2023-08-31T19:06:16.024229+0000","last_clean":"2023-08-31T19:06:16.024229+0000","last_became_active":"2023-08-31T19:06:16.013968+0000","last_became_peered":"2023-08-31T19:06:16.013968+0000","last_unstale":"2023-08-31T19:06:16.024229+0000","last_undegraded":"2023-08-31T19:06:16.024229+0000","last_fullsized":"2023-08-31T19:06:16.024229+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:15.997570+0000","last_change":"2023-08-31T19:06:15.545083+0000","last_active":"2023-08-31T19:06:15.997570+0000","last_peered":"2023-08-31T19:06:15.997570+0000","last_clean":"2023-08-31T19:06:15.997570+0000","last_became_active":"2023-08-31T19:06:15.544796+0000","last_became_peered":"2023-08-31T19:06:15.544796+0000","last_unstale":"2023-08-31T19:06:15.997570+0000","last_undegraded":"2023-08-31T19:06:15.997570+0000","last_fullsized":"2023-08-31T19:06:15.997570+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014202+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:06:16.014202+0000","last_peered":"2023-08-31T19:06:16.014202+0000","last_clean":"2023-08-31T19:06:16.014202+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:06:16.014202+0000","last_undegraded":"2023-08-31T19:06:16.014202+0000","last_fullsized":"2023-08-31T19:06:16.014202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.033811+0000","last_change":"2023-08-31T19:06:16.032568+0000","last_active":"2023-08-31T19:06:16.033811+0000","last_peered":"2023-08-31T19:06:16.033811+0000","last_clean":"2023-08-31T19:06:16.033811+0000","last_became_active":"2023-08-31T19:06:16.032301+0000","last_became_peered":"2023-08-31T19:06:16.032301+0000","last_unstale":"2023-08-31T19:06:16.033811+0000","last_undegraded":"2023-08-31T19:06:16.033811+0000","last_fullsized":"2023-08-31T19:06:16.033811+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.020999+0000","last_change":"2023-08-31T19:06:15.544175+0000","last_active":"2023-08-31T19:06:16.020999+0000","last_peered":"2023-08-31T19:06:16.020999+0000","last_clean":"2023-08-31T19:06:16.020999+0000","last_became_active":"2023-08-31T19:06:15.543850+0000","last_became_peered":"2023-08-31T19:06:15.543850+0000","last_unstale":"2023-08-31T19:06:16.020999+0000","last_undegraded":"2023-08-31T19:06:16.020999+0000","last_fullsized":"2023-08-31T19:06:16.020999+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":105,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002718+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:06:16.002718+0000","last_peered":"2023-08-31T19:06:16.002718+0000","last_clean":"2023-08-31T19:06:16.002718+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:06:16.002718+0000","last_undegraded":"2023-08-31T19:06:16.002718+0000","last_fullsized":"2023-08-31T19:06:16.002718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.031687+0000","last_change":"2023-08-31T19:06:16.023128+0000","last_active":"2023-08-31T19:06:16.031687+0000","last_peered":"2023-08-31T19:06:16.031687+0000","last_clean":"2023-08-31T19:06:16.031687+0000","last_became_active":"2023-08-31T19:06:16.022796+0000","last_became_peered":"2023-08-31T19:06:16.022796+0000","last_unstale":"2023-08-31T19:06:16.031687+0000","last_undegraded":"2023-08-31T19:06:16.031687+0000","last_fullsized":"2023-08-31T19:06:16.031687+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.004900+0000","last_change":"2023-08-31T19:06:15.541317+0000","last_active":"2023-08-31T19:06:16.004900+0000","last_peered":"2023-08-31T19:06:16.004900+0000","last_clean":"2023-08-31T19:06:16.004900+0000","last_became_active":"2023-08-31T19:06:15.536730+0000","last_became_peered":"2023-08-31T19:06:15.536730+0000","last_unstale":"2023-08-31T19:06:16.004900+0000","last_undegraded":"2023-08-31T19:06:16.004900+0000","last_fullsized":"2023-08-31T19:06:16.004900+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.000230+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:06:16.000230+0000","last_peered":"2023-08-31T19:06:16.000230+0000","last_clean":"2023-08-31T19:06:16.000230+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:06:16.000230+0000","last_undegraded":"2023-08-31T19:06:16.000230+0000","last_fullsized":"2023-08-31T19:06:16.000230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.035072+0000","last_change":"2023-08-31T19:06:16.031933+0000","last_active":"2023-08-31T19:06:16.035072+0000","last_peered":"2023-08-31T19:06:16.035072+0000","last_clean":"2023-08-31T19:06:16.035072+0000","last_became_active":"2023-08-31T19:06:16.031411+0000","last_became_peered":"2023-08-31T19:06:16.031411+0000","last_unstale":"2023-08-31T19:06:16.035072+0000","last_undegraded":"2023-08-31T19:06:16.035072+0000","last_fullsized":"2023-08-31T19:06:16.035072+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.016143+0000","last_change":"2023-08-31T19:06:15.553106+0000","last_active":"2023-08-31T19:06:16.016143+0000","last_peered":"2023-08-31T19:06:16.016143+0000","last_clean":"2023-08-31T19:06:16.016143+0000","last_became_active":"2023-08-31T19:06:15.551497+0000","last_became_peered":"2023-08-31T19:06:15.551497+0000","last_unstale":"2023-08-31T19:06:16.016143+0000","last_undegraded":"2023-08-31T19:06:16.016143+0000","last_fullsized":"2023-08-31T19:06:16.016143+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":105,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002823+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:06:16.002823+0000","last_peered":"2023-08-31T19:06:16.002823+0000","last_clean":"2023-08-31T19:06:16.002823+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:06:16.002823+0000","last_undegraded":"2023-08-31T19:06:16.002823+0000","last_fullsized":"2023-08-31T19:06:16.002823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":106,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.006531+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:06:16.006531+0000","last_peered":"2023-08-31T19:06:16.006531+0000","last_clean":"2023-08-31T19:06:16.006531+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:06:16.006531+0000","last_undegraded":"2023-08-31T19:06:16.006531+0000","last_fullsized":"2023-08-31T19:06:16.006531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.028760+0000","last_change":"2023-08-31T19:06:16.027164+0000","last_active":"2023-08-31T19:06:16.028760+0000","last_peered":"2023-08-31T19:06:16.028760+0000","last_clean":"2023-08-31T19:06:16.028760+0000","last_became_active":"2023-08-31T19:06:16.026922+0000","last_became_peered":"2023-08-31T19:06:16.026922+0000","last_unstale":"2023-08-31T19:06:16.028760+0000","last_undegraded":"2023-08-31T19:06:16.028760+0000","last_fullsized":"2023-08-31T19:06:16.028760+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.008452+0000","last_change":"2023-08-31T19:06:15.553350+0000","last_active":"2023-08-31T19:06:16.008452+0000","last_peered":"2023-08-31T19:06:16.008452+0000","last_clean":"2023-08-31T19:06:16.008452+0000","last_became_active":"2023-08-31T19:06:15.553088+0000","last_became_peered":"2023-08-31T19:06:15.553088+0000","last_unstale":"2023-08-31T19:06:16.008452+0000","last_undegraded":"2023-08-31T19:06:16.008452+0000","last_fullsized":"2023-08-31T19:06:16.008452+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":105,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.008796+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:06:16.008796+0000","last_peered":"2023-08-31T19:06:16.008796+0000","last_clean":"2023-08-31T19:06:16.008796+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:06:16.008796+0000","last_undegraded":"2023-08-31T19:06:16.008796+0000","last_fullsized":"2023-08-31T19:06:16.008796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023617+0000","last_change":"2023-08-31T19:06:16.019514+0000","last_active":"2023-08-31T19:06:16.023617+0000","last_peered":"2023-08-31T19:06:16.023617+0000","last_clean":"2023-08-31T19:06:16.023617+0000","last_became_active":"2023-08-31T19:06:16.019240+0000","last_became_peered":"2023-08-31T19:06:16.019240+0000","last_unstale":"2023-08-31T19:06:16.023617+0000","last_undegraded":"2023-08-31T19:06:16.023617+0000","last_fullsized":"2023-08-31T19:06:16.023617+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002601+0000","last_change":"2023-08-31T19:06:15.560000+0000","last_active":"2023-08-31T19:06:16.002601+0000","last_peered":"2023-08-31T19:06:16.002601+0000","last_clean":"2023-08-31T19:06:16.002601+0000","last_became_active":"2023-08-31T19:06:15.558979+0000","last_became_peered":"2023-08-31T19:06:15.558979+0000","last_unstale":"2023-08-31T19:06:16.002601+0000","last_undegraded":"2023-08-31T19:06:16.002601+0000","last_fullsized":"2023-08-31T19:06:16.002601+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":105,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.008697+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:06:16.008697+0000","last_peered":"2023-08-31T19:06:16.008697+0000","last_clean":"2023-08-31T19:06:16.008697+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:06:16.008697+0000","last_undegraded":"2023-08-31T19:06:16.008697+0000","last_fullsized":"2023-08-31T19:06:16.008697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.032592+0000","last_change":"2023-08-31T19:06:16.025898+0000","last_active":"2023-08-31T19:06:16.032592+0000","last_peered":"2023-08-31T19:06:16.032592+0000","last_clean":"2023-08-31T19:06:16.032592+0000","last_became_active":"2023-08-31T19:06:16.025512+0000","last_became_peered":"2023-08-31T19:06:16.025512+0000","last_unstale":"2023-08-31T19:06:16.032592+0000","last_undegraded":"2023-08-31T19:06:16.032592+0000","last_fullsized":"2023-08-31T19:06:16.032592+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.032236+0000","last_change":"2023-08-31T19:06:15.559986+0000","last_active":"2023-08-31T19:06:16.032236+0000","last_peered":"2023-08-31T19:06:16.032236+0000","last_clean":"2023-08-31T19:06:16.032236+0000","last_became_active":"2023-08-31T19:06:15.559698+0000","last_became_peered":"2023-08-31T19:06:15.559698+0000","last_unstale":"2023-08-31T19:06:16.032236+0000","last_undegraded":"2023-08-31T19:06:16.032236+0000","last_fullsized":"2023-08-31T19:06:16.032236+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":112,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014659+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:06:16.014659+0000","last_peered":"2023-08-31T19:06:16.014659+0000","last_clean":"2023-08-31T19:06:16.014659+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:06:16.014659+0000","last_undegraded":"2023-08-31T19:06:16.014659+0000","last_fullsized":"2023-08-31T19:06:16.014659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.034985+0000","last_change":"2023-08-31T19:06:16.030608+0000","last_active":"2023-08-31T19:06:16.034985+0000","last_peered":"2023-08-31T19:06:16.034985+0000","last_clean":"2023-08-31T19:06:16.034985+0000","last_became_active":"2023-08-31T19:06:16.029888+0000","last_became_peered":"2023-08-31T19:06:16.029888+0000","last_unstale":"2023-08-31T19:06:16.034985+0000","last_undegraded":"2023-08-31T19:06:16.034985+0000","last_fullsized":"2023-08-31T19:06:16.034985+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.001192+0000","last_change":"2023-08-31T19:06:15.552643+0000","last_active":"2023-08-31T19:06:16.001192+0000","last_peered":"2023-08-31T19:06:16.001192+0000","last_clean":"2023-08-31T19:06:16.001192+0000","last_became_active":"2023-08-31T19:06:15.551765+0000","last_became_peered":"2023-08-31T19:06:15.551765+0000","last_unstale":"2023-08-31T19:06:16.001192+0000","last_undegraded":"2023-08-31T19:06:16.001192+0000","last_fullsized":"2023-08-31T19:06:16.001192+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":115,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:15.998810+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:06:15.998810+0000","last_peered":"2023-08-31T19:06:15.998810+0000","last_clean":"2023-08-31T19:06:15.998810+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:06:15.998810+0000","last_undegraded":"2023-08-31T19:06:15.998810+0000","last_fullsized":"2023-08-31T19:06:15.998810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575068,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302716,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069124,"statfs":{"total":96636764160,"available":96326782976,"internally_reserved":0,"allocated":1560576,"data_stored":826022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71499999999999997,"15min":0.74399999999999999},"min":{"1min":0.432,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.92100000000000004,"5min":1.175,"15min":1.175},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.76100000000000001},"min":{"1min":0.54300000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97599999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.88900000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66700000000000004,"15min":0.70399999999999996},"min":{"1min":0.436,"5min":0.40699999999999997,"15min":0.40000000000000002},"max":{"1min":1.0009999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66300000000000003,"15min":0.68899999999999995},"min":{"1min":0.48499999999999999,"5min":0.40500000000000003,"15min":0.36199999999999999},"max":{"1min":0.93600000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67600000000000005,"15min":0.70499999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.98599999999999999,"5min":1.163,"15min":1.163},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95299999999999996,"5min":0.98499999999999999,"15min":1.054},"last":0.751}]},{"osd":3,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69699999999999995,"15min":0.72099999999999997},"min":{"1min":0.498,"5min":0.432,"15min":0.432},"max":{"1min":0.94299999999999995,"5min":1.107,"15min":1.107},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.51000000000000001},"max":{"1min":0.873,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.84799999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.46700000000000003,"5min":0.37,"15min":0.33900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.97899999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":0.71199999999999997},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.89800000000000002,"5min":0.98399999999999999,"15min":1.004},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.47799999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0229999999999999,"5min":1.139,"15min":1.139},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.52400000000000002,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":0.91900000000000004,"5min":0.93899999999999995,"15min":1.048},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.55200000000000005,"5min":0.47099999999999997,"15min":0.45600000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.0740000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69699999999999995},"min":{"1min":0.51000000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95599999999999996,"5min":1.038,"15min":1.071},"last":0.63500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575067,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302712,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069128,"statfs":{"total":96636764160,"available":96326787072,"internally_reserved":0,"allocated":1556480,"data_stored":819294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67400000000000004,"15min":0.70799999999999996},"min":{"1min":0.53300000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81799999999999995,"5min":0.92000000000000004,"15min":1.0189999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66500000000000004,"15min":0.70299999999999996},"min":{"1min":0.45400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.86799999999999999,"5min":1.069,"15min":1.069},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Aug 31 19:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.70199999999999996},"min":{"1min":0.51900000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92500000000000004,"5min":1.014,"15min":1.014},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.72299999999999998},"min":{"1min":0.495,"5min":0.434,"15min":0.434},"max":{"1min":0.94399999999999995,"5min":1.216,"15min":1.216},"last":0.90000000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70499999999999996,"15min":0.73299999999999998},"min":{"1min":0.46999999999999997,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":0.96799999999999997,"5min":1.0840000000000001,"15min":1.129},"last":0.879},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.57799999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":1.3260000000000001},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70299999999999996,"15min":0.71499999999999997},"min":{"1min":0.56100000000000005,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.871,"5min":0.96599999999999997,"15min":1.006},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72799999999999998,"15min":0.752},"min":{"1min":0.54400000000000004,"5min":0.53000000000000003,"15min":0.52500000000000002},"max":{"1min":0.88700000000000001,"5min":1.087,"15min":1.087},"last":0.79400000000000004}]},{"osd":4,"last update":"Thu Aug 31 19:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63300000000000001,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":0.90900000000000003,"5min":0.94299999999999995,"15min":0.96599999999999997},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65300000000000002,"15min":0.63200000000000001},"min":{"1min":0.44600000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86499999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68200000000000005,"15min":0.66700000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.39800000000000002},"max":{"1min":0.97899999999999998,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.53600000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.98599999999999999,"5min":1.0669999999999999,"15min":1.0700000000000001},"last":1.0669999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.71199999999999997,"15min":0.70099999999999996},"min":{"1min":0.52300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96599999999999997,"5min":1.012,"15min":1.012},"last":0.871},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.754,"15min":0.749},"min":{"1min":0.56699999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0620000000000001,"5min":1.161,"15min":1.161},"last":0.96799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575068,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302716,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069124,"statfs":{"total":96636764160,"available":96326782976,"internally_reserved":0,"allocated":1560576,"data_stored":820178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42099999999999999,"15min":0.44400000000000001},"min":{"1min":0.314,"5min":0.27300000000000002,"15min":0.26100000000000001},"max":{"1min":0.69499999999999995,"5min":0.70999999999999996,"15min":0.81000000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.46400000000000002,"15min":0.47399999999999998},"min":{"1min":0.34999999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.752},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48799999999999999,"15min":0.51000000000000001},"min":{"1min":0.35399999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70599999999999996,"5min":0.752,"15min":0.82699999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55000000000000004,"15min":0.57499999999999996},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.70199999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52800000000000002,"15min":0.55200000000000005},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66000000000000003,"5min":0.79000000000000004,"15min":0.82199999999999995},"last":0.501},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.50800000000000001},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.78000000000000003},"min":{"1min":0.53200000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.2110000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.77100000000000002,"15min":0.81000000000000005},"min":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.97099999999999997,"5min":1.111,"15min":1.3},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71499999999999997,"15min":0.76600000000000001},"min":{"1min":0.56200000000000006,"5min":0.497,"15min":0.497},"max":{"1min":1.02,"5min":1.02,"15min":1.4119999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75,"15min":0.77300000000000002},"min":{"1min":0.55900000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.2310000000000001},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Aug 31 19:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71599999999999997,"15min":0.76100000000000001},"min":{"1min":0.503,"5min":0.501,"15min":0.501},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.1990000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76200000000000001,"15min":0.79700000000000004},"min":{"1min":0.57199999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0820000000000001,"5min":1.167,"15min":1.2629999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75,"15min":0.78000000000000003},"min":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97099999999999997,"5min":1.1120000000000001,"15min":1.113},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.748,"15min":0.78800000000000003},"min":{"1min":0.57599999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99199999999999999,"5min":1.0429999999999999,"15min":1.3320000000000001},"last":0.60499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575067,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302712,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069128,"statfs":{"total":96636764160,"available":96326787072,"internally_reserved":0,"allocated":1556480,"data_stored":819362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.438,"15min":0.441},"min":{"1min":0.30499999999999999,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.66300000000000003,"5min":0.73399999999999999,"15min":0.78400000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30399999999999999},"max":{"1min":0.65900000000000003,"5min":0.876,"15min":0.876},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.495,"15min":0.50600000000000001},"min":{"1min":0.38700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66000000000000003,"5min":0.71899999999999997,"15min":0.74299999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.50900000000000001,"15min":0.52800000000000002},"min":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82499999999999996,"5min":1.018,"15min":1.018},"last":0.379}]},{"osd":3,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69099999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.36599999999999999},"max":{"1min":0.72499999999999998,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.79400000000000004,"15min":0.81999999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.103,"15min":1.2370000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78600000000000003,"15min":0.81699999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0349999999999999,"5min":1.105,"15min":1.276},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97399999999999998,"5min":1.155,"15min":1.155},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.54300000000000004,"5min":0.498,"15min":0.498},"max":{"1min":0.94599999999999995,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.52400000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1000000000000001,"5min":1.1060000000000001,"15min":1.3280000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.83599999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.53500000000000003},"max":{"1min":1.048,"5min":1.196,"15min":1.2350000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.53700000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.018,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81299999999999994,"15min":0.83499999999999996},"min":{"1min":0.57599999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0389999999999999,"5min":1.548,"15min":1.548},"last":0.79100000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575067,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302708,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069132,"statfs":{"total":96636764160,"available":96326791168,"internally_reserved":0,"allocated":1552384,"data_stored":818732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:05:16 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.55700000000000005,"15min":0.48299999999999998},"min":{"1min":0.32400000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":14.09,"5min":14.09,"15min":14.09},"last":2.004},{"interface":"front","average":{"1min":0.626,"5min":0.497,"15min":0.499},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":2.3679999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":5.0810000000000004,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":1.625},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.37,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":4.375,"5min":4.375,"15min":4.375},"last":2.4119999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.33300000000000002,"5min":0.316,"15min":0.316},"max":{"1min":5.7649999999999997,"5min":5.7649999999999997,"15min":5.7649999999999997},"last":2.4220000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.9729999999999999,"5min":5.9729999999999999,"15min":5.9729999999999999},"last":1.6839999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.77800000000000002,"15min":0.79600000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":4.9960000000000004,"5min":4.9960000000000004,"15min":4.9960000000000004},"last":0.997},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.55000000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.4119999999999999,"5min":4.4119999999999999,"15min":4.4119999999999999},"last":1.036}]},{"osd":5,"last update":"Thu Aug 31 19:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.745,"15min":0.78900000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":1.2,"15min":1.361},"last":2.3540000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.77900000000000003,"15min":0.80200000000000005},"min":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.0449999999999999,"5min":5.0449999999999999,"15min":5.0449999999999999},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.79300000000000004,"15min":0.81699999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":4.2649999999999997,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":1.103},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":2.383}]},{"osd":7,"last update":"Thu Aug 31 19:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76600000000000001,"15min":0.80800000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.161},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77500000000000002,"15min":0.81899999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.97499999999999998,"5min":1.1160000000000001,"15min":1.387},"last":2.403}]}]},{"osd":3,"up_from":13,"seq":55834575067,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1544192,"data_stored":818628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.57899999999999996,"15min":0.48699999999999999},"min":{"1min":0.314,"5min":0.223,"15min":0.223},"max":{"1min":0.88300000000000001,"5min":14.099,"15min":14.099},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.71399999999999997,"15min":0.56100000000000005},"min":{"1min":0.34999999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66200000000000003,"5min":24.879999999999999,"15min":24.879999999999999},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.33500000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.64000000000000001,"5min":0.79600000000000004,"15min":0.90700000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.626,"15min":0.54700000000000004},"min":{"1min":0.39600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65900000000000003,"5min":14.143000000000001,"15min":14.143000000000001},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72199999999999998,"5min":0.94999999999999996,"15min":1.407},"last":0.628},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.70999999999999996,"15min":0.65500000000000003},"min":{"1min":0.46800000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78400000000000003,"5min":12.464,"15min":12.464},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.93300000000000005,"15min":0.81899999999999995},"min":{"1min":0.52500000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.0820000000000001,"5min":21.475999999999999,"15min":21.475999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.52200000000000002,"5min":0.52100000000000002,"15min":0.47699999999999998},"max":{"1min":1.05,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73199999999999998,"15min":0.76200000000000001},"min":{"1min":0.54800000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.3220000000000001},"last":0.878},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.84599999999999997,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.94299999999999995,"5min":12.509,"15min":12.509},"last":0.88800000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.86799999999999999,"15min":0.81999999999999995},"min":{"1min":0.56799999999999995,"5min":0.53400000000000003,"15min":0.52000000000000002},"max":{"1min":0.995,"5min":12.426,"15min":12.426},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.99399999999999999,"15min":0.85799999999999998},"min":{"1min":0.57899999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0189999999999999,"5min":24.920000000000002,"15min":24.920000000000002},"last":0.98599999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.97899999999999998,"15min":0.86199999999999999},"min":{"1min":0.60299999999999998,"5min":0.51300000000000001,"15min":0.495},"max":{"1min":1.01,"5min":21.521000000000001,"15min":21.521000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.755,"15min":0.78300000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2070000000000001,"5min":1.232,"15min":1.232},"last":0.95999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575067,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302708,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069132,"statfs":{"total":96636764160,"available":96326791168,"internally_reserved":0,"allocated":1552384,"data_stored":819542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.69299999999999995},"min":{"1min":0.41799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":1.103},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.64100000000000001,"15min":0.69199999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79000000000000004,"5min":0.92900000000000005,"15min":0.93400000000000005},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Aug 31 19:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67300000000000004,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.97299999999999998,"5min":0.98399999999999999,"15min":1.006},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66600000000000004,"15min":0.70899999999999996},"min":{"1min":0.48099999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90000000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":1.1899999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68000000000000005,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0089999999999999,"5min":1.042,"15min":1.044},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.68500000000000005,"15min":0.72399999999999998},"min":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.95199999999999996,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.999}]},{"osd":3,"last update":"Thu Aug 31 19:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67500000000000004,"15min":0.71099999999999997},"min":{"1min":0.499,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88300000000000001,"5min":1.01,"15min":1.01},"last":0.75},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70799999999999996,"15min":0.73799999999999999},"min":{"1min":0.54500000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.91100000000000003,"5min":1.012,"15min":1.081},"last":1.0389999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":0.78400000000000003,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.62,"15min":0.621},"min":{"1min":0.40400000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.871,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.99099999999999999,"5min":1.163,"15min":1.163},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69299999999999995,"15min":0.68700000000000006},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.441},"max":{"1min":0.90400000000000003,"5min":1.133,"15min":1.133},"last":1.1519999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68899999999999995,"15min":0.68200000000000005},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.96099999999999997,"5min":1.147,"15min":1.147},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.50800000000000001,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":1.022,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":1.165}]}]},{"osd":5,"up_from":13,"seq":55834575067,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302704,"kb_used_data":1512,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069136,"statfs":{"total":96636764160,"available":96326795264,"internally_reserved":0,"allocated":1548288,"data_stored":819182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.69499999999999995,"15min":0.71899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.41299999999999998},"max":{"1min":0.877,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.51700000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88800000000000001,"5min":3.548,"15min":3.548},"last":0.61599999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.82799999999999996,"15min":0.76300000000000001},"min":{"1min":0.53700000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81999999999999995,"5min":16.744,"15min":16.744},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71299999999999997,"15min":0.73599999999999999},"min":{"1min":0.47099999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92300000000000004,"5min":3.6299999999999999,"15min":3.6299999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69699999999999995,"15min":0.71199999999999997},"min":{"1min":0.44400000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89200000000000002,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92900000000000005,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68999999999999995,"15min":0.73399999999999999},"min":{"1min":0.51600000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86699999999999999,"5min":1.327,"15min":1.327},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84599999999999997,"5min":2.823,"15min":2.823},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Aug 31 19:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.67800000000000005,"15min":0.64600000000000002},"min":{"1min":0.435,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79600000000000004,"5min":7.3739999999999997,"15min":7.3739999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.49299999999999999,"5min":0.44800000000000001,"15min":0.41499999999999998},"max":{"1min":0.91900000000000004,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":0.65800000000000003},"min":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.76200000000000001,"15min":0.72299999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85499999999999998,"5min":7.4139999999999997,"15min":7.4139999999999997},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":0.89400000000000002,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.54900000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92600000000000005,"5min":2.786,"15min":2.786},"last":0.71999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:06:20.282 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:06:20.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.501+0000 7f4124dff700 1 Processor -- start 2023-08-31T19:06:20.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.501+0000 7f4124dff700 1 -- start start 2023-08-31T19:06:20.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.502+0000 7f4124dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41200bda40 0x7f41200a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.502+0000 7f4124dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41201574f0 0x7f4120157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.502+0000 7f4124dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41200bcb50 con 0x7f41200a4a00 2023-08-31T19:06:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.502+0000 7f4124dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41200c27f0 con 0x7f41200bda40 2023-08-31T19:06:20.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.502+0000 7f4124dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41200653b0 con 0x7f41201574f0 2023-08-31T19:06:20.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.502+0000 7f411dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41200bda40 0x7f41200a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.502+0000 7f411dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41200bda40 0x7f41200a4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58564/0 (socket says 172.21.15.72:58564) 2023-08-31T19:06:20.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.502+0000 7f411dd9b700 1 -- 172.21.15.72:0/598112615 learned_addr learned my addr 172.21.15.72:0/598112615 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:20.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.503+0000 7f411dd9b700 1 -- 172.21.15.72:0/598112615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41201574f0 msgr2=0x7f4120157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:20.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.503+0000 7f411ed9d700 1 --2- 172.21.15.72:0/598112615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41201574f0 0x7f4120157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.503+0000 7f411dd9b700 1 --2- 172.21.15.72:0/598112615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41201574f0 0x7f4120157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.503+0000 7f411dd9b700 1 -- 172.21.15.72:0/598112615 >> v1:172.21.15.146:6789/0 conn(0x7f41200a4a00 legacy=0x7f4120064ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:20.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.503+0000 7f411dd9b700 1 -- 172.21.15.72:0/598112615 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41200bbf40 con 0x7f41200bda40 2023-08-31T19:06:20.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.503+0000 7f411ed9d700 1 --2- 172.21.15.72:0/598112615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41201574f0 0x7f4120157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:20.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.503+0000 7f411dd9b700 1 --2- 172.21.15.72:0/598112615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41200bda40 0x7f41200a4de0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f4114006fd0 tx=0x7f41140090f0).ready entity=mon.0 client_cookie=11aea8d87ce3ebdf server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:20.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.503+0000 7f411d59a700 1 -- 172.21.15.72:0/598112615 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411400b600 con 0x7f41200bda40 2023-08-31T19:06:20.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.503+0000 7f411d59a700 1 -- 172.21.15.72:0/598112615 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411400b760 con 0x7f41200bda40 2023-08-31T19:06:20.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.503+0000 7f411d59a700 1 -- 172.21.15.72:0/598112615 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411400bb00 con 0x7f41200bda40 2023-08-31T19:06:20.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.504+0000 7f4124dff700 1 -- 172.21.15.72:0/598112615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41200bda40 msgr2=0x7f41200a4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:20.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.504+0000 7f4124dff700 1 --2- 172.21.15.72:0/598112615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41200bda40 0x7f41200a4de0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f4114006fd0 tx=0x7f41140090f0).stop 2023-08-31T19:06:20.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.504+0000 7f4124dff700 1 -- 172.21.15.72:0/598112615 shutdown_connections 2023-08-31T19:06:20.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.504+0000 7f4124dff700 1 --2- 172.21.15.72:0/598112615 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41201574f0 0x7f4120157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.504+0000 7f4124dff700 1 --2- 172.21.15.72:0/598112615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41200bda40 0x7f41200a4de0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.504+0000 7f4124dff700 1 -- 172.21.15.72:0/598112615 >> 172.21.15.72:0/598112615 conn(0x7f4120063120 msgr2=0x7f41200c6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:20.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.504+0000 7f4124dff700 1 -- 172.21.15.72:0/598112615 shutdown_connections 2023-08-31T19:06:20.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.504+0000 7f4124dff700 1 -- 172.21.15.72:0/598112615 wait complete. 2023-08-31T19:06:20.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.506+0000 7f4124dff700 1 Processor -- start 2023-08-31T19:06:20.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.506+0000 7f4124dff700 1 -- start start 2023-08-31T19:06:20.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f4124dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41200a4a00 0x7f41200a8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f4124dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41200bda40 0x7f4120153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f4124dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41201574f0 0x7f41200c01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f4124dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41200a76a0 con 0x7f41201574f0 2023-08-31T19:06:20.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f4124dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41200a81e0 con 0x7f41200a4a00 2023-08-31T19:06:20.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f4124dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41200c0d40 con 0x7f41200bda40 2023-08-31T19:06:20.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f411ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41201574f0 0x7f41200c01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f411ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41201574f0 0x7f41200c01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58566/0 (socket says 172.21.15.72:58566) 2023-08-31T19:06:20.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f411ed9d700 1 -- 172.21.15.72:0/1309826818 learned_addr learned my addr 172.21.15.72:0/1309826818 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:20.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f411dd9b700 1 --2- 172.21.15.72:0/1309826818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41200bda40 0x7f4120153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f411e59c700 1 --2- 172.21.15.72:0/1309826818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41200a4a00 0x7f41200a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f411ed9d700 1 -- 172.21.15.72:0/1309826818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41200bda40 msgr2=0x7f4120153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:20.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f411ed9d700 1 --2- 172.21.15.72:0/1309826818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41200bda40 0x7f4120153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f411ed9d700 1 -- 172.21.15.72:0/1309826818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41200a4a00 msgr2=0x7f41200a8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:20.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f411ed9d700 1 --2- 172.21.15.72:0/1309826818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41200a4a00 0x7f41200a8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f411ed9d700 1 -- 172.21.15.72:0/1309826818 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4114009370 con 0x7f41201574f0 2023-08-31T19:06:20.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.507+0000 7f411e59c700 1 --2- 172.21.15.72:0/1309826818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41200a4a00 0x7f41200a8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:20.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.508+0000 7f411ed9d700 1 --2- 172.21.15.72:0/1309826818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41201574f0 0x7f41200c01d0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f411800cf20 tx=0x7f4118007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:20.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.508+0000 7f410e7fc700 1 -- 172.21.15.72:0/1309826818 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411800adf0 con 0x7f41201574f0 2023-08-31T19:06:20.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.508+0000 7f410e7fc700 1 -- 172.21.15.72:0/1309826818 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4118016400 con 0x7f41201574f0 2023-08-31T19:06:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.508+0000 7f410e7fc700 1 -- 172.21.15.72:0/1309826818 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4118016780 con 0x7f41201574f0 2023-08-31T19:06:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.508+0000 7f4124dff700 1 -- 172.21.15.72:0/1309826818 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41200a95c0 con 0x7f41201574f0 2023-08-31T19:06:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.508+0000 7f4124dff700 1 -- 172.21.15.72:0/1309826818 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41200a7b90 con 0x7f41201574f0 2023-08-31T19:06:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.509+0000 7f4124dff700 1 -- 172.21.15.72:0/1309826818 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41200a8390 con 0x7f41201574f0 2023-08-31T19:06:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.510+0000 7f410e7fc700 1 -- 172.21.15.72:0/1309826818 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f41180203f0 con 0x7f41201574f0 2023-08-31T19:06:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.510+0000 7f410e7fc700 1 --2- 172.21.15.72:0/1309826818 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f410005ef00 0x7f41000613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.511+0000 7f410e7fc700 1 -- 172.21.15.72:0/1309826818 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f411807ad00 con 0x7f41201574f0 2023-08-31T19:06:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.511+0000 7f411e59c700 1 --2- 172.21.15.72:0/1309826818 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f410005ef00 0x7f41000613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.511+0000 7f411e59c700 1 --2- 172.21.15.72:0/1309826818 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f410005ef00 0x7f41000613c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f41100026f0 tx=0x7f4110009040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.514+0000 7f410e7fc700 1 -- 172.21.15.72:0/1309826818 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f41200a8390 con 0x7f41201574f0 2023-08-31T19:06:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.679+0000 7f4124dff700 1 -- 172.21.15.72:0/1309826818 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41200a8390 con 0x7f410005ef00 2023-08-31T19:06:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.689+0000 7f410e7fc700 1 -- 172.21.15.72:0/1309826818 <== mgr.7410 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361074 (secure 0 0 0) 0x7f41200a8390 con 0x7f410005ef00 2023-08-31T19:06:20.693 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:06:20.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.694+0000 7f4124dff700 1 -- 172.21.15.72:0/1309826818 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f410005ef00 msgr2=0x7f41000613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:20.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.694+0000 7f4124dff700 1 --2- 172.21.15.72:0/1309826818 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f410005ef00 0x7f41000613c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f41100026f0 tx=0x7f4110009040).stop 2023-08-31T19:06:20.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.694+0000 7f4124dff700 1 -- 172.21.15.72:0/1309826818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41201574f0 msgr2=0x7f41200c01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:20.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.694+0000 7f4124dff700 1 --2- 172.21.15.72:0/1309826818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41201574f0 0x7f41200c01d0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f411800cf20 tx=0x7f4118007860).stop 2023-08-31T19:06:20.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.694+0000 7f4124dff700 1 -- 172.21.15.72:0/1309826818 shutdown_connections 2023-08-31T19:06:20.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.694+0000 7f4124dff700 1 --2- 172.21.15.72:0/1309826818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41201574f0 0x7f41200c01d0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.694+0000 7f4124dff700 1 --2- 172.21.15.72:0/1309826818 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f410005ef00 0x7f41000613c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.694+0000 7f4124dff700 1 --2- 172.21.15.72:0/1309826818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41200a4a00 0x7f41200a8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.694+0000 7f4124dff700 1 --2- 172.21.15.72:0/1309826818 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41200bda40 0x7f4120153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.694+0000 7f4124dff700 1 -- 172.21.15.72:0/1309826818 >> 172.21.15.72:0/1309826818 conn(0x7f4120063120 msgr2=0x7f41201546b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:20.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.694+0000 7f4124dff700 1 -- 172.21.15.72:0/1309826818 shutdown_connections 2023-08-31T19:06:20.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.694+0000 7f4124dff700 1 -- 172.21.15.72:0/1309826818 wait complete. 2023-08-31T19:06:20.698 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:06:20.710 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-31T19:06:19.365310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2421676,"kb_used_data":12140,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752553044,"statfs":{"total":773094113280,"available":770614317056,"internally_reserved":0,"allocated":12431360,"data_stored":6560940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5828,"num_objects":-12,"num_object_clones":0,"num_object_copies":-24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-33,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.151667"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.019745+0000","last_change":"2023-08-31T19:06:16.015398+0000","last_active":"2023-08-31T19:06:16.019745+0000","last_peered":"2023-08-31T19:06:16.019745+0000","last_clean":"2023-08-31T19:06:16.019745+0000","last_became_active":"2023-08-31T19:06:16.015153+0000","last_became_peered":"2023-08-31T19:06:16.015153+0000","last_unstale":"2023-08-31T19:06:16.019745+0000","last_undegraded":"2023-08-31T19:06:16.019745+0000","last_fullsized":"2023-08-31T19:06:16.019745+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.027060+0000","last_change":"2023-08-31T19:06:15.541021+0000","last_active":"2023-08-31T19:06:16.027060+0000","last_peered":"2023-08-31T19:06:16.027060+0000","last_clean":"2023-08-31T19:06:16.027060+0000","last_became_active":"2023-08-31T19:06:15.540746+0000","last_became_peered":"2023-08-31T19:06:15.540746+0000","last_unstale":"2023-08-31T19:06:16.027060+0000","last_undegraded":"2023-08-31T19:06:16.027060+0000","last_fullsized":"2023-08-31T19:06:16.027060+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.041043+0000","last_change":"2023-08-31T19:06:16.032960+0000","last_active":"2023-08-31T19:06:16.041043+0000","last_peered":"2023-08-31T19:06:16.041043+0000","last_clean":"2023-08-31T19:06:16.041043+0000","last_became_active":"2023-08-31T19:06:16.032695+0000","last_became_peered":"2023-08-31T19:06:16.032695+0000","last_unstale":"2023-08-31T19:06:16.041043+0000","last_undegraded":"2023-08-31T19:06:16.041043+0000","last_fullsized":"2023-08-31T19:06:16.041043+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.011722+0000","last_change":"2023-08-31T19:06:15.549520+0000","last_active":"2023-08-31T19:06:16.011722+0000","last_peered":"2023-08-31T19:06:16.011722+0000","last_clean":"2023-08-31T19:06:16.011722+0000","last_became_active":"2023-08-31T19:06:15.549241+0000","last_became_peered":"2023-08-31T19:06:15.549241+0000","last_unstale":"2023-08-31T19:06:16.011722+0000","last_undegraded":"2023-08-31T19:06:16.011722+0000","last_fullsized":"2023-08-31T19:06:16.011722+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023120+0000","last_change":"2023-08-31T19:06:16.017090+0000","last_active":"2023-08-31T19:06:16.023120+0000","last_peered":"2023-08-31T19:06:16.023120+0000","last_clean":"2023-08-31T19:06:16.023120+0000","last_became_active":"2023-08-31T19:06:16.016806+0000","last_became_peered":"2023-08-31T19:06:16.016806+0000","last_unstale":"2023-08-31T19:06:16.023120+0000","last_undegraded":"2023-08-31T19:06:16.023120+0000","last_fullsized":"2023-08-31T19:06:16.023120+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.013256+0000","last_change":"2023-08-31T19:06:15.535658+0000","last_active":"2023-08-31T19:06:16.013256+0000","last_peered":"2023-08-31T19:06:16.013256+0000","last_clean":"2023-08-31T19:06:16.013256+0000","last_became_active":"2023-08-31T19:06:15.535393+0000","last_became_peered":"2023-08-31T19:06:15.535393+0000","last_unstale":"2023-08-31T19:06:16.013256+0000","last_undegraded":"2023-08-31T19:06:16.013256+0000","last_fullsized":"2023-08-31T19:06:16.013256+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023602+0000","last_change":"2023-08-31T19:06:16.019327+0000","last_active":"2023-08-31T19:06:16.023602+0000","last_peered":"2023-08-31T19:06:16.023602+0000","last_clean":"2023-08-31T19:06:16.023602+0000","last_became_active":"2023-08-31T19:06:16.019005+0000","last_became_peered":"2023-08-31T19:06:16.019005+0000","last_unstale":"2023-08-31T19:06:16.023602+0000","last_undegraded":"2023-08-31T19:06:16.023602+0000","last_fullsized":"2023-08-31T19:06:16.023602+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.016270+0000","last_change":"2023-08-31T19:06:15.553408+0000","last_active":"2023-08-31T19:06:16.016270+0000","last_peered":"2023-08-31T19:06:16.016270+0000","last_clean":"2023-08-31T19:06:16.016270+0000","last_became_active":"2023-08-31T19:06:15.553151+0000","last_became_peered":"2023-08-31T19:06:15.553151+0000","last_unstale":"2023-08-31T19:06:16.016270+0000","last_undegraded":"2023-08-31T19:06:16.016270+0000","last_fullsized":"2023-08-31T19:06:16.016270+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.018593+0000","last_change":"2023-08-31T19:06:16.008147+0000","last_active":"2023-08-31T19:06:16.018593+0000","last_peered":"2023-08-31T19:06:16.018593+0000","last_clean":"2023-08-31T19:06:16.018593+0000","last_became_active":"2023-08-31T19:06:16.007807+0000","last_became_peered":"2023-08-31T19:06:16.007807+0000","last_unstale":"2023-08-31T19:06:16.018593+0000","last_undegraded":"2023-08-31T19:06:16.018593+0000","last_fullsized":"2023-08-31T19:06:16.018593+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.018559+0000","last_change":"2023-08-31T19:06:15.546018+0000","last_active":"2023-08-31T19:06:16.018559+0000","last_peered":"2023-08-31T19:06:16.018559+0000","last_clean":"2023-08-31T19:06:16.018559+0000","last_became_active":"2023-08-31T19:06:15.543735+0000","last_became_peered":"2023-08-31T19:06:15.543735+0000","last_unstale":"2023-08-31T19:06:16.018559+0000","last_undegraded":"2023-08-31T19:06:16.018559+0000","last_fullsized":"2023-08-31T19:06:16.018559+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.024787+0000","last_change":"2023-08-31T19:06:16.021948+0000","last_active":"2023-08-31T19:06:16.024787+0000","last_peered":"2023-08-31T19:06:16.024787+0000","last_clean":"2023-08-31T19:06:16.024787+0000","last_became_active":"2023-08-31T19:06:16.021563+0000","last_became_peered":"2023-08-31T19:06:16.021563+0000","last_unstale":"2023-08-31T19:06:16.024787+0000","last_undegraded":"2023-08-31T19:06:16.024787+0000","last_fullsized":"2023-08-31T19:06:16.024787+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.020206+0000","last_change":"2023-08-31T19:06:15.553189+0000","last_active":"2023-08-31T19:06:16.020206+0000","last_peered":"2023-08-31T19:06:16.020206+0000","last_clean":"2023-08-31T19:06:16.020206+0000","last_became_active":"2023-08-31T19:06:15.552813+0000","last_became_peered":"2023-08-31T19:06:15.552813+0000","last_unstale":"2023-08-31T19:06:16.020206+0000","last_undegraded":"2023-08-31T19:06:16.020206+0000","last_fullsized":"2023-08-31T19:06:16.020206+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.025880+0000","last_change":"2023-08-31T19:06:16.020043+0000","last_active":"2023-08-31T19:06:16.025880+0000","last_peered":"2023-08-31T19:06:16.025880+0000","last_clean":"2023-08-31T19:06:16.025880+0000","last_became_active":"2023-08-31T19:06:16.019743+0000","last_became_peered":"2023-08-31T19:06:16.019743+0000","last_unstale":"2023-08-31T19:06:16.025880+0000","last_undegraded":"2023-08-31T19:06:16.025880+0000","last_fullsized":"2023-08-31T19:06:16.025880+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.006225+0000","last_change":"2023-08-31T19:06:15.553788+0000","last_active":"2023-08-31T19:06:16.006225+0000","last_peered":"2023-08-31T19:06:16.006225+0000","last_clean":"2023-08-31T19:06:16.006225+0000","last_became_active":"2023-08-31T19:06:15.553475+0000","last_became_peered":"2023-08-31T19:06:15.553475+0000","last_unstale":"2023-08-31T19:06:16.006225+0000","last_undegraded":"2023-08-31T19:06:16.006225+0000","last_fullsized":"2023-08-31T19:06:16.006225+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.026026+0000","last_change":"2023-08-31T19:06:16.020641+0000","last_active":"2023-08-31T19:06:16.026026+0000","last_peered":"2023-08-31T19:06:16.026026+0000","last_clean":"2023-08-31T19:06:16.026026+0000","last_became_active":"2023-08-31T19:06:16.020362+0000","last_became_peered":"2023-08-31T19:06:16.020362+0000","last_unstale":"2023-08-31T19:06:16.026026+0000","last_undegraded":"2023-08-31T19:06:16.026026+0000","last_fullsized":"2023-08-31T19:06:16.026026+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.015685+0000","last_change":"2023-08-31T19:06:15.552233+0000","last_active":"2023-08-31T19:06:16.015685+0000","last_peered":"2023-08-31T19:06:16.015685+0000","last_clean":"2023-08-31T19:06:16.015685+0000","last_became_active":"2023-08-31T19:06:15.551915+0000","last_became_peered":"2023-08-31T19:06:15.551915+0000","last_unstale":"2023-08-31T19:06:16.015685+0000","last_undegraded":"2023-08-31T19:06:16.015685+0000","last_fullsized":"2023-08-31T19:06:16.015685+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.033095+0000","last_change":"2023-08-31T19:06:16.027207+0000","last_active":"2023-08-31T19:06:16.033095+0000","last_peered":"2023-08-31T19:06:16.033095+0000","last_clean":"2023-08-31T19:06:16.033095+0000","last_became_active":"2023-08-31T19:06:16.026921+0000","last_became_peered":"2023-08-31T19:06:16.026921+0000","last_unstale":"2023-08-31T19:06:16.033095+0000","last_undegraded":"2023-08-31T19:06:16.033095+0000","last_fullsized":"2023-08-31T19:06:16.033095+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.003675+0000","last_change":"2023-08-31T19:06:15.542543+0000","last_active":"2023-08-31T19:06:16.003675+0000","last_peered":"2023-08-31T19:06:16.003675+0000","last_clean":"2023-08-31T19:06:16.003675+0000","last_became_active":"2023-08-31T19:06:15.542170+0000","last_became_peered":"2023-08-31T19:06:15.542170+0000","last_unstale":"2023-08-31T19:06:16.003675+0000","last_undegraded":"2023-08-31T19:06:16.003675+0000","last_fullsized":"2023-08-31T19:06:16.003675+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.034963+0000","last_change":"2023-08-31T19:06:16.030947+0000","last_active":"2023-08-31T19:06:16.034963+0000","last_peered":"2023-08-31T19:06:16.034963+0000","last_clean":"2023-08-31T19:06:16.034963+0000","last_became_active":"2023-08-31T19:06:16.030645+0000","last_became_peered":"2023-08-31T19:06:16.030645+0000","last_unstale":"2023-08-31T19:06:16.034963+0000","last_undegraded":"2023-08-31T19:06:16.034963+0000","last_fullsized":"2023-08-31T19:06:16.034963+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:15.999103+0000","last_change":"2023-08-31T19:06:15.547074+0000","last_active":"2023-08-31T19:06:15.999103+0000","last_peered":"2023-08-31T19:06:15.999103+0000","last_clean":"2023-08-31T19:06:15.999103+0000","last_became_active":"2023-08-31T19:06:15.546731+0000","last_became_peered":"2023-08-31T19:06:15.546731+0000","last_unstale":"2023-08-31T19:06:15.999103+0000","last_undegraded":"2023-08-31T19:06:15.999103+0000","last_fullsized":"2023-08-31T19:06:15.999103+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021468+0000","last_change":"2023-08-31T19:06:16.016660+0000","last_active":"2023-08-31T19:06:16.021468+0000","last_peered":"2023-08-31T19:06:16.021468+0000","last_clean":"2023-08-31T19:06:16.021468+0000","last_became_active":"2023-08-31T19:06:16.016426+0000","last_became_peered":"2023-08-31T19:06:16.016426+0000","last_unstale":"2023-08-31T19:06:16.021468+0000","last_undegraded":"2023-08-31T19:06:16.021468+0000","last_fullsized":"2023-08-31T19:06:16.021468+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.008573+0000","last_change":"2023-08-31T19:06:15.553731+0000","last_active":"2023-08-31T19:06:16.008573+0000","last_peered":"2023-08-31T19:06:16.008573+0000","last_clean":"2023-08-31T19:06:16.008573+0000","last_became_active":"2023-08-31T19:06:15.553409+0000","last_became_peered":"2023-08-31T19:06:15.553409+0000","last_unstale":"2023-08-31T19:06:16.008573+0000","last_undegraded":"2023-08-31T19:06:16.008573+0000","last_fullsized":"2023-08-31T19:06:16.008573+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.012869+0000","last_change":"2023-08-31T19:06:16.008782+0000","last_active":"2023-08-31T19:06:16.012869+0000","last_peered":"2023-08-31T19:06:16.012869+0000","last_clean":"2023-08-31T19:06:16.012869+0000","last_became_active":"2023-08-31T19:06:16.007867+0000","last_became_peered":"2023-08-31T19:06:16.007867+0000","last_unstale":"2023-08-31T19:06:16.012869+0000","last_undegraded":"2023-08-31T19:06:16.012869+0000","last_fullsized":"2023-08-31T19:06:16.012869+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.035097+0000","last_change":"2023-08-31T19:06:15.543776+0000","last_active":"2023-08-31T19:06:16.035097+0000","last_peered":"2023-08-31T19:06:16.035097+0000","last_clean":"2023-08-31T19:06:16.035097+0000","last_became_active":"2023-08-31T19:06:15.543415+0000","last_became_peered":"2023-08-31T19:06:15.543415+0000","last_unstale":"2023-08-31T19:06:16.035097+0000","last_undegraded":"2023-08-31T19:06:16.035097+0000","last_fullsized":"2023-08-31T19:06:16.035097+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.026013+0000","last_change":"2023-08-31T19:06:16.021508+0000","last_active":"2023-08-31T19:06:16.026013+0000","last_peered":"2023-08-31T19:06:16.026013+0000","last_clean":"2023-08-31T19:06:16.026013+0000","last_became_active":"2023-08-31T19:06:16.021236+0000","last_became_peered":"2023-08-31T19:06:16.021236+0000","last_unstale":"2023-08-31T19:06:16.026013+0000","last_undegraded":"2023-08-31T19:06:16.026013+0000","last_fullsized":"2023-08-31T19:06:16.026013+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.016512+0000","last_change":"2023-08-31T19:06:15.542622+0000","last_active":"2023-08-31T19:06:16.016512+0000","last_peered":"2023-08-31T19:06:16.016512+0000","last_clean":"2023-08-31T19:06:16.016512+0000","last_became_active":"2023-08-31T19:06:15.542333+0000","last_became_peered":"2023-08-31T19:06:15.542333+0000","last_unstale":"2023-08-31T19:06:16.016512+0000","last_undegraded":"2023-08-31T19:06:16.016512+0000","last_fullsized":"2023-08-31T19:06:16.016512+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.035007+0000","last_change":"2023-08-31T19:06:16.031070+0000","last_active":"2023-08-31T19:06:16.035007+0000","last_peered":"2023-08-31T19:06:16.035007+0000","last_clean":"2023-08-31T19:06:16.035007+0000","last_became_active":"2023-08-31T19:06:16.030214+0000","last_became_peered":"2023-08-31T19:06:16.030214+0000","last_unstale":"2023-08-31T19:06:16.035007+0000","last_undegraded":"2023-08-31T19:06:16.035007+0000","last_fullsized":"2023-08-31T19:06:16.035007+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.001143+0000","last_change":"2023-08-31T19:06:15.552822+0000","last_active":"2023-08-31T19:06:16.001143+0000","last_peered":"2023-08-31T19:06:16.001143+0000","last_clean":"2023-08-31T19:06:16.001143+0000","last_became_active":"2023-08-31T19:06:15.552121+0000","last_became_peered":"2023-08-31T19:06:15.552121+0000","last_unstale":"2023-08-31T19:06:16.001143+0000","last_undegraded":"2023-08-31T19:06:16.001143+0000","last_fullsized":"2023-08-31T19:06:16.001143+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021946+0000","last_change":"2023-08-31T19:06:16.017662+0000","last_active":"2023-08-31T19:06:16.021946+0000","last_peered":"2023-08-31T19:06:16.021946+0000","last_clean":"2023-08-31T19:06:16.021946+0000","last_became_active":"2023-08-31T19:06:16.016781+0000","last_became_peered":"2023-08-31T19:06:16.016781+0000","last_unstale":"2023-08-31T19:06:16.021946+0000","last_undegraded":"2023-08-31T19:06:16.021946+0000","last_fullsized":"2023-08-31T19:06:16.021946+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002396+0000","last_change":"2023-08-31T19:06:15.545759+0000","last_active":"2023-08-31T19:06:16.002396+0000","last_peered":"2023-08-31T19:06:16.002396+0000","last_clean":"2023-08-31T19:06:16.002396+0000","last_became_active":"2023-08-31T19:06:15.545457+0000","last_became_peered":"2023-08-31T19:06:15.545457+0000","last_unstale":"2023-08-31T19:06:16.002396+0000","last_undegraded":"2023-08-31T19:06:16.002396+0000","last_fullsized":"2023-08-31T19:06:16.002396+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.035038+0000","last_change":"2023-08-31T19:06:16.031294+0000","last_active":"2023-08-31T19:06:16.035038+0000","last_peered":"2023-08-31T19:06:16.035038+0000","last_clean":"2023-08-31T19:06:16.035038+0000","last_became_active":"2023-08-31T19:06:16.029582+0000","last_became_peered":"2023-08-31T19:06:16.029582+0000","last_unstale":"2023-08-31T19:06:16.035038+0000","last_undegraded":"2023-08-31T19:06:16.035038+0000","last_fullsized":"2023-08-31T19:06:16.035038+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.032684+0000","last_change":"2023-08-31T19:06:15.555851+0000","last_active":"2023-08-31T19:06:16.032684+0000","last_peered":"2023-08-31T19:06:16.032684+0000","last_clean":"2023-08-31T19:06:16.032684+0000","last_became_active":"2023-08-31T19:06:15.555549+0000","last_became_peered":"2023-08-31T19:06:15.555549+0000","last_unstale":"2023-08-31T19:06:16.032684+0000","last_undegraded":"2023-08-31T19:06:16.032684+0000","last_fullsized":"2023-08-31T19:06:16.032684+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023905+0000","last_change":"2023-08-31T19:06:16.020768+0000","last_active":"2023-08-31T19:06:16.023905+0000","last_peered":"2023-08-31T19:06:16.023905+0000","last_clean":"2023-08-31T19:06:16.023905+0000","last_became_active":"2023-08-31T19:06:16.020490+0000","last_became_peered":"2023-08-31T19:06:16.020490+0000","last_unstale":"2023-08-31T19:06:16.023905+0000","last_undegraded":"2023-08-31T19:06:16.023905+0000","last_fullsized":"2023-08-31T19:06:16.023905+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014703+0000","last_change":"2023-08-31T19:06:15.551795+0000","last_active":"2023-08-31T19:06:16.014703+0000","last_peered":"2023-08-31T19:06:16.014703+0000","last_clean":"2023-08-31T19:06:16.014703+0000","last_became_active":"2023-08-31T19:06:15.551508+0000","last_became_peered":"2023-08-31T19:06:15.551508+0000","last_unstale":"2023-08-31T19:06:16.014703+0000","last_undegraded":"2023-08-31T19:06:16.014703+0000","last_fullsized":"2023-08-31T19:06:16.014703+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023828+0000","last_change":"2023-08-31T19:06:16.021132+0000","last_active":"2023-08-31T19:06:16.023828+0000","last_peered":"2023-08-31T19:06:16.023828+0000","last_clean":"2023-08-31T19:06:16.023828+0000","last_became_active":"2023-08-31T19:06:16.020804+0000","last_became_peered":"2023-08-31T19:06:16.020804+0000","last_unstale":"2023-08-31T19:06:16.023828+0000","last_undegraded":"2023-08-31T19:06:16.023828+0000","last_fullsized":"2023-08-31T19:06:16.023828+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.001025+0000","last_change":"2023-08-31T19:06:15.554279+0000","last_active":"2023-08-31T19:06:16.001025+0000","last_peered":"2023-08-31T19:06:16.001025+0000","last_clean":"2023-08-31T19:06:16.001025+0000","last_became_active":"2023-08-31T19:06:15.553976+0000","last_became_peered":"2023-08-31T19:06:15.553976+0000","last_unstale":"2023-08-31T19:06:16.001025+0000","last_undegraded":"2023-08-31T19:06:16.001025+0000","last_fullsized":"2023-08-31T19:06:16.001025+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023650+0000","last_change":"2023-08-31T19:06:16.020652+0000","last_active":"2023-08-31T19:06:16.023650+0000","last_peered":"2023-08-31T19:06:16.023650+0000","last_clean":"2023-08-31T19:06:16.023650+0000","last_became_active":"2023-08-31T19:06:16.020347+0000","last_became_peered":"2023-08-31T19:06:16.020347+0000","last_unstale":"2023-08-31T19:06:16.023650+0000","last_undegraded":"2023-08-31T19:06:16.023650+0000","last_fullsized":"2023-08-31T19:06:16.023650+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023781+0000","last_change":"2023-08-31T19:06:15.551665+0000","last_active":"2023-08-31T19:06:16.023781+0000","last_peered":"2023-08-31T19:06:16.023781+0000","last_clean":"2023-08-31T19:06:16.023781+0000","last_became_active":"2023-08-31T19:06:15.551291+0000","last_became_peered":"2023-08-31T19:06:15.551291+0000","last_unstale":"2023-08-31T19:06:16.023781+0000","last_undegraded":"2023-08-31T19:06:16.023781+0000","last_fullsized":"2023-08-31T19:06:16.023781+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.015626+0000","last_change":"2023-08-31T19:06:16.012268+0000","last_active":"2023-08-31T19:06:16.015626+0000","last_peered":"2023-08-31T19:06:16.015626+0000","last_clean":"2023-08-31T19:06:16.015626+0000","last_became_active":"2023-08-31T19:06:16.011614+0000","last_became_peered":"2023-08-31T19:06:16.011614+0000","last_unstale":"2023-08-31T19:06:16.015626+0000","last_undegraded":"2023-08-31T19:06:16.015626+0000","last_fullsized":"2023-08-31T19:06:16.015626+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.005183+0000","last_change":"2023-08-31T19:06:15.548386+0000","last_active":"2023-08-31T19:06:16.005183+0000","last_peered":"2023-08-31T19:06:16.005183+0000","last_clean":"2023-08-31T19:06:16.005183+0000","last_became_active":"2023-08-31T19:06:15.548082+0000","last_became_peered":"2023-08-31T19:06:15.548082+0000","last_unstale":"2023-08-31T19:06:16.005183+0000","last_undegraded":"2023-08-31T19:06:16.005183+0000","last_fullsized":"2023-08-31T19:06:16.005183+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021750+0000","last_change":"2023-08-31T19:06:16.015504+0000","last_active":"2023-08-31T19:06:16.021750+0000","last_peered":"2023-08-31T19:06:16.021750+0000","last_clean":"2023-08-31T19:06:16.021750+0000","last_became_active":"2023-08-31T19:06:16.015160+0000","last_became_peered":"2023-08-31T19:06:16.015160+0000","last_unstale":"2023-08-31T19:06:16.021750+0000","last_undegraded":"2023-08-31T19:06:16.021750+0000","last_fullsized":"2023-08-31T19:06:16.021750+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.020193+0000","last_change":"2023-08-31T19:06:15.559486+0000","last_active":"2023-08-31T19:06:16.020193+0000","last_peered":"2023-08-31T19:06:16.020193+0000","last_clean":"2023-08-31T19:06:16.020193+0000","last_became_active":"2023-08-31T19:06:15.558718+0000","last_became_peered":"2023-08-31T19:06:15.558718+0000","last_unstale":"2023-08-31T19:06:16.020193+0000","last_undegraded":"2023-08-31T19:06:16.020193+0000","last_fullsized":"2023-08-31T19:06:16.020193+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.024768+0000","last_change":"2023-08-31T19:06:16.021832+0000","last_active":"2023-08-31T19:06:16.024768+0000","last_peered":"2023-08-31T19:06:16.024768+0000","last_clean":"2023-08-31T19:06:16.024768+0000","last_became_active":"2023-08-31T19:06:16.021167+0000","last_became_peered":"2023-08-31T19:06:16.021167+0000","last_unstale":"2023-08-31T19:06:16.024768+0000","last_undegraded":"2023-08-31T19:06:16.024768+0000","last_fullsized":"2023-08-31T19:06:16.024768+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014331+0000","last_change":"2023-08-31T19:06:15.548960+0000","last_active":"2023-08-31T19:06:16.014331+0000","last_peered":"2023-08-31T19:06:16.014331+0000","last_clean":"2023-08-31T19:06:16.014331+0000","last_became_active":"2023-08-31T19:06:15.548678+0000","last_became_peered":"2023-08-31T19:06:15.548678+0000","last_unstale":"2023-08-31T19:06:16.014331+0000","last_undegraded":"2023-08-31T19:06:16.014331+0000","last_fullsized":"2023-08-31T19:06:16.014331+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.031111+0000","last_change":"2023-08-31T19:06:16.023409+0000","last_active":"2023-08-31T19:06:16.031111+0000","last_peered":"2023-08-31T19:06:16.031111+0000","last_clean":"2023-08-31T19:06:16.031111+0000","last_became_active":"2023-08-31T19:06:16.023101+0000","last_became_peered":"2023-08-31T19:06:16.023101+0000","last_unstale":"2023-08-31T19:06:16.031111+0000","last_undegraded":"2023-08-31T19:06:16.031111+0000","last_fullsized":"2023-08-31T19:06:16.031111+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014474+0000","last_change":"2023-08-31T19:06:15.548844+0000","last_active":"2023-08-31T19:06:16.014474+0000","last_peered":"2023-08-31T19:06:16.014474+0000","last_clean":"2023-08-31T19:06:16.014474+0000","last_became_active":"2023-08-31T19:06:15.548554+0000","last_became_peered":"2023-08-31T19:06:15.548554+0000","last_unstale":"2023-08-31T19:06:16.014474+0000","last_undegraded":"2023-08-31T19:06:16.014474+0000","last_fullsized":"2023-08-31T19:06:16.014474+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021057+0000","last_change":"2023-08-31T19:06:16.014650+0000","last_active":"2023-08-31T19:06:16.021057+0000","last_peered":"2023-08-31T19:06:16.021057+0000","last_clean":"2023-08-31T19:06:16.021057+0000","last_became_active":"2023-08-31T19:06:16.014343+0000","last_became_peered":"2023-08-31T19:06:16.014343+0000","last_unstale":"2023-08-31T19:06:16.021057+0000","last_undegraded":"2023-08-31T19:06:16.021057+0000","last_fullsized":"2023-08-31T19:06:16.021057+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.006450+0000","last_change":"2023-08-31T19:06:15.551765+0000","last_active":"2023-08-31T19:06:16.006450+0000","last_peered":"2023-08-31T19:06:16.006450+0000","last_clean":"2023-08-31T19:06:16.006450+0000","last_became_active":"2023-08-31T19:06:15.551361+0000","last_became_peered":"2023-08-31T19:06:15.551361+0000","last_unstale":"2023-08-31T19:06:16.006450+0000","last_undegraded":"2023-08-31T19:06:16.006450+0000","last_fullsized":"2023-08-31T19:06:16.006450+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.028332+0000","last_change":"2023-08-31T19:06:16.023945+0000","last_active":"2023-08-31T19:06:16.028332+0000","last_peered":"2023-08-31T19:06:16.028332+0000","last_clean":"2023-08-31T19:06:16.028332+0000","last_became_active":"2023-08-31T19:06:16.023664+0000","last_became_peered":"2023-08-31T19:06:16.023664+0000","last_unstale":"2023-08-31T19:06:16.028332+0000","last_undegraded":"2023-08-31T19:06:16.028332+0000","last_fullsized":"2023-08-31T19:06:16.028332+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:15.998306+0000","last_change":"2023-08-31T19:06:15.552754+0000","last_active":"2023-08-31T19:06:15.998306+0000","last_peered":"2023-08-31T19:06:15.998306+0000","last_clean":"2023-08-31T19:06:15.998306+0000","last_became_active":"2023-08-31T19:06:15.552473+0000","last_became_peered":"2023-08-31T19:06:15.552473+0000","last_unstale":"2023-08-31T19:06:15.998306+0000","last_undegraded":"2023-08-31T19:06:15.998306+0000","last_fullsized":"2023-08-31T19:06:15.998306+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.018670+0000","last_change":"2023-08-31T19:06:16.007199+0000","last_active":"2023-08-31T19:06:16.018670+0000","last_peered":"2023-08-31T19:06:16.018670+0000","last_clean":"2023-08-31T19:06:16.018670+0000","last_became_active":"2023-08-31T19:06:16.006882+0000","last_became_peered":"2023-08-31T19:06:16.006882+0000","last_unstale":"2023-08-31T19:06:16.018670+0000","last_undegraded":"2023-08-31T19:06:16.018670+0000","last_fullsized":"2023-08-31T19:06:16.018670+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.011836+0000","last_change":"2023-08-31T19:06:15.547449+0000","last_active":"2023-08-31T19:06:16.011836+0000","last_peered":"2023-08-31T19:06:16.011836+0000","last_clean":"2023-08-31T19:06:16.011836+0000","last_became_active":"2023-08-31T19:06:15.547081+0000","last_became_peered":"2023-08-31T19:06:15.547081+0000","last_unstale":"2023-08-31T19:06:16.011836+0000","last_undegraded":"2023-08-31T19:06:16.011836+0000","last_fullsized":"2023-08-31T19:06:16.011836+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021880+0000","last_change":"2023-08-31T19:06:16.017465+0000","last_active":"2023-08-31T19:06:16.021880+0000","last_peered":"2023-08-31T19:06:16.021880+0000","last_clean":"2023-08-31T19:06:16.021880+0000","last_became_active":"2023-08-31T19:06:16.017189+0000","last_became_peered":"2023-08-31T19:06:16.017189+0000","last_unstale":"2023-08-31T19:06:16.021880+0000","last_undegraded":"2023-08-31T19:06:16.021880+0000","last_fullsized":"2023-08-31T19:06:16.021880+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.008328+0000","last_change":"2023-08-31T19:06:15.555111+0000","last_active":"2023-08-31T19:06:16.008328+0000","last_peered":"2023-08-31T19:06:16.008328+0000","last_clean":"2023-08-31T19:06:16.008328+0000","last_became_active":"2023-08-31T19:06:15.554805+0000","last_became_peered":"2023-08-31T19:06:15.554805+0000","last_unstale":"2023-08-31T19:06:16.008328+0000","last_undegraded":"2023-08-31T19:06:16.008328+0000","last_fullsized":"2023-08-31T19:06:16.008328+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.027072+0000","last_change":"2023-08-31T19:06:16.018597+0000","last_active":"2023-08-31T19:06:16.027072+0000","last_peered":"2023-08-31T19:06:16.027072+0000","last_clean":"2023-08-31T19:06:16.027072+0000","last_became_active":"2023-08-31T19:06:16.017801+0000","last_became_peered":"2023-08-31T19:06:16.017801+0000","last_unstale":"2023-08-31T19:06:16.027072+0000","last_undegraded":"2023-08-31T19:06:16.027072+0000","last_fullsized":"2023-08-31T19:06:16.027072+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:15.998516+0000","last_change":"2023-08-31T19:06:15.544004+0000","last_active":"2023-08-31T19:06:15.998516+0000","last_peered":"2023-08-31T19:06:15.998516+0000","last_clean":"2023-08-31T19:06:15.998516+0000","last_became_active":"2023-08-31T19:06:15.543708+0000","last_became_peered":"2023-08-31T19:06:15.543708+0000","last_unstale":"2023-08-31T19:06:15.998516+0000","last_undegraded":"2023-08-31T19:06:15.998516+0000","last_fullsized":"2023-08-31T19:06:15.998516+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023651+0000","last_change":"2023-08-31T19:06:16.014845+0000","last_active":"2023-08-31T19:06:16.023651+0000","last_peered":"2023-08-31T19:06:16.023651+0000","last_clean":"2023-08-31T19:06:16.023651+0000","last_became_active":"2023-08-31T19:06:16.014620+0000","last_became_peered":"2023-08-31T19:06:16.014620+0000","last_unstale":"2023-08-31T19:06:16.023651+0000","last_undegraded":"2023-08-31T19:06:16.023651+0000","last_fullsized":"2023-08-31T19:06:16.023651+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014191+0000","last_change":"2023-08-31T19:06:15.545893+0000","last_active":"2023-08-31T19:06:16.014191+0000","last_peered":"2023-08-31T19:06:16.014191+0000","last_clean":"2023-08-31T19:06:16.014191+0000","last_became_active":"2023-08-31T19:06:15.545608+0000","last_became_peered":"2023-08-31T19:06:15.545608+0000","last_unstale":"2023-08-31T19:06:16.014191+0000","last_undegraded":"2023-08-31T19:06:16.014191+0000","last_fullsized":"2023-08-31T19:06:16.014191+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.035036+0000","last_change":"2023-08-31T19:06:16.031239+0000","last_active":"2023-08-31T19:06:16.035036+0000","last_peered":"2023-08-31T19:06:16.035036+0000","last_clean":"2023-08-31T19:06:16.035036+0000","last_became_active":"2023-08-31T19:06:16.030783+0000","last_became_peered":"2023-08-31T19:06:16.030783+0000","last_unstale":"2023-08-31T19:06:16.035036+0000","last_undegraded":"2023-08-31T19:06:16.035036+0000","last_fullsized":"2023-08-31T19:06:16.035036+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.001101+0000","last_change":"2023-08-31T19:06:15.554018+0000","last_active":"2023-08-31T19:06:16.001101+0000","last_peered":"2023-08-31T19:06:16.001101+0000","last_clean":"2023-08-31T19:06:16.001101+0000","last_became_active":"2023-08-31T19:06:15.552451+0000","last_became_peered":"2023-08-31T19:06:15.552451+0000","last_unstale":"2023-08-31T19:06:16.001101+0000","last_undegraded":"2023-08-31T19:06:16.001101+0000","last_fullsized":"2023-08-31T19:06:16.001101+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021920+0000","last_change":"2023-08-31T19:06:16.016561+0000","last_active":"2023-08-31T19:06:16.021920+0000","last_peered":"2023-08-31T19:06:16.021920+0000","last_clean":"2023-08-31T19:06:16.021920+0000","last_became_active":"2023-08-31T19:06:16.016226+0000","last_became_peered":"2023-08-31T19:06:16.016226+0000","last_unstale":"2023-08-31T19:06:16.021920+0000","last_undegraded":"2023-08-31T19:06:16.021920+0000","last_fullsized":"2023-08-31T19:06:16.021920+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002439+0000","last_change":"2023-08-31T19:06:15.551424+0000","last_active":"2023-08-31T19:06:16.002439+0000","last_peered":"2023-08-31T19:06:16.002439+0000","last_clean":"2023-08-31T19:06:16.002439+0000","last_became_active":"2023-08-31T19:06:15.551066+0000","last_became_peered":"2023-08-31T19:06:15.551066+0000","last_unstale":"2023-08-31T19:06:16.002439+0000","last_undegraded":"2023-08-31T19:06:16.002439+0000","last_fullsized":"2023-08-31T19:06:16.002439+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.035009+0000","last_change":"2023-08-31T19:06:16.031266+0000","last_active":"2023-08-31T19:06:16.035009+0000","last_peered":"2023-08-31T19:06:16.035009+0000","last_clean":"2023-08-31T19:06:16.035009+0000","last_became_active":"2023-08-31T19:06:16.029715+0000","last_became_peered":"2023-08-31T19:06:16.029715+0000","last_unstale":"2023-08-31T19:06:16.035009+0000","last_undegraded":"2023-08-31T19:06:16.035009+0000","last_fullsized":"2023-08-31T19:06:16.035009+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.009764+0000","last_change":"2023-08-31T19:06:15.549762+0000","last_active":"2023-08-31T19:06:16.009764+0000","last_peered":"2023-08-31T19:06:16.009764+0000","last_clean":"2023-08-31T19:06:16.009764+0000","last_became_active":"2023-08-31T19:06:15.549499+0000","last_became_peered":"2023-08-31T19:06:15.549499+0000","last_unstale":"2023-08-31T19:06:16.009764+0000","last_undegraded":"2023-08-31T19:06:16.009764+0000","last_fullsized":"2023-08-31T19:06:16.009764+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.034975+0000","last_change":"2023-08-31T19:06:16.030369+0000","last_active":"2023-08-31T19:06:16.034975+0000","last_peered":"2023-08-31T19:06:16.034975+0000","last_clean":"2023-08-31T19:06:16.034975+0000","last_became_active":"2023-08-31T19:06:16.030126+0000","last_became_peered":"2023-08-31T19:06:16.030126+0000","last_unstale":"2023-08-31T19:06:16.034975+0000","last_undegraded":"2023-08-31T19:06:16.034975+0000","last_fullsized":"2023-08-31T19:06:16.034975+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021311+0000","last_change":"2023-08-31T19:06:15.543757+0000","last_active":"2023-08-31T19:06:16.021311+0000","last_peered":"2023-08-31T19:06:16.021311+0000","last_clean":"2023-08-31T19:06:16.021311+0000","last_became_active":"2023-08-31T19:06:15.543477+0000","last_became_peered":"2023-08-31T19:06:15.543477+0000","last_unstale":"2023-08-31T19:06:16.021311+0000","last_undegraded":"2023-08-31T19:06:16.021311+0000","last_fullsized":"2023-08-31T19:06:16.021311+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023573+0000","last_change":"2023-08-31T19:06:16.019413+0000","last_active":"2023-08-31T19:06:16.023573+0000","last_peered":"2023-08-31T19:06:16.023573+0000","last_clean":"2023-08-31T19:06:16.023573+0000","last_became_active":"2023-08-31T19:06:16.019152+0000","last_became_peered":"2023-08-31T19:06:16.019152+0000","last_unstale":"2023-08-31T19:06:16.023573+0000","last_undegraded":"2023-08-31T19:06:16.023573+0000","last_fullsized":"2023-08-31T19:06:16.023573+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021467+0000","last_change":"2023-08-31T19:06:15.553717+0000","last_active":"2023-08-31T19:06:16.021467+0000","last_peered":"2023-08-31T19:06:16.021467+0000","last_clean":"2023-08-31T19:06:16.021467+0000","last_became_active":"2023-08-31T19:06:15.553388+0000","last_became_peered":"2023-08-31T19:06:15.553388+0000","last_unstale":"2023-08-31T19:06:16.021467+0000","last_undegraded":"2023-08-31T19:06:16.021467+0000","last_fullsized":"2023-08-31T19:06:16.021467+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.026119+0000","last_change":"2023-08-31T19:06:16.023016+0000","last_active":"2023-08-31T19:06:16.026119+0000","last_peered":"2023-08-31T19:06:16.026119+0000","last_clean":"2023-08-31T19:06:16.026119+0000","last_became_active":"2023-08-31T19:06:16.022706+0000","last_became_peered":"2023-08-31T19:06:16.022706+0000","last_unstale":"2023-08-31T19:06:16.026119+0000","last_undegraded":"2023-08-31T19:06:16.026119+0000","last_fullsized":"2023-08-31T19:06:16.026119+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.025415+0000","last_change":"2023-08-31T19:06:15.549188+0000","last_active":"2023-08-31T19:06:16.025415+0000","last_peered":"2023-08-31T19:06:16.025415+0000","last_clean":"2023-08-31T19:06:16.025415+0000","last_became_active":"2023-08-31T19:06:15.547890+0000","last_became_peered":"2023-08-31T19:06:15.547890+0000","last_unstale":"2023-08-31T19:06:16.025415+0000","last_undegraded":"2023-08-31T19:06:16.025415+0000","last_fullsized":"2023-08-31T19:06:16.025415+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023240+0000","last_change":"2023-08-31T19:06:16.015424+0000","last_active":"2023-08-31T19:06:16.023240+0000","last_peered":"2023-08-31T19:06:16.023240+0000","last_clean":"2023-08-31T19:06:16.023240+0000","last_became_active":"2023-08-31T19:06:16.015111+0000","last_became_peered":"2023-08-31T19:06:16.015111+0000","last_unstale":"2023-08-31T19:06:16.023240+0000","last_undegraded":"2023-08-31T19:06:16.023240+0000","last_fullsized":"2023-08-31T19:06:16.023240+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014024+0000","last_change":"2023-08-31T19:06:15.542317+0000","last_active":"2023-08-31T19:06:16.014024+0000","last_peered":"2023-08-31T19:06:16.014024+0000","last_clean":"2023-08-31T19:06:16.014024+0000","last_became_active":"2023-08-31T19:06:15.542041+0000","last_became_peered":"2023-08-31T19:06:15.542041+0000","last_unstale":"2023-08-31T19:06:16.014024+0000","last_undegraded":"2023-08-31T19:06:16.014024+0000","last_fullsized":"2023-08-31T19:06:16.014024+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023668+0000","last_change":"2023-08-31T19:06:16.021138+0000","last_active":"2023-08-31T19:06:16.023668+0000","last_peered":"2023-08-31T19:06:16.023668+0000","last_clean":"2023-08-31T19:06:16.023668+0000","last_became_active":"2023-08-31T19:06:16.020855+0000","last_became_peered":"2023-08-31T19:06:16.020855+0000","last_unstale":"2023-08-31T19:06:16.023668+0000","last_undegraded":"2023-08-31T19:06:16.023668+0000","last_fullsized":"2023-08-31T19:06:16.023668+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.008217+0000","last_change":"2023-08-31T19:06:15.551995+0000","last_active":"2023-08-31T19:06:16.008217+0000","last_peered":"2023-08-31T19:06:16.008217+0000","last_clean":"2023-08-31T19:06:16.008217+0000","last_became_active":"2023-08-31T19:06:15.551702+0000","last_became_peered":"2023-08-31T19:06:15.551702+0000","last_unstale":"2023-08-31T19:06:16.008217+0000","last_undegraded":"2023-08-31T19:06:16.008217+0000","last_fullsized":"2023-08-31T19:06:16.008217+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.034961+0000","last_change":"2023-08-31T19:06:16.030459+0000","last_active":"2023-08-31T19:06:16.034961+0000","last_peered":"2023-08-31T19:06:16.034961+0000","last_clean":"2023-08-31T19:06:16.034961+0000","last_became_active":"2023-08-31T19:06:16.029604+0000","last_became_peered":"2023-08-31T19:06:16.029604+0000","last_unstale":"2023-08-31T19:06:16.034961+0000","last_undegraded":"2023-08-31T19:06:16.034961+0000","last_fullsized":"2023-08-31T19:06:16.034961+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002583+0000","last_change":"2023-08-31T19:06:15.547212+0000","last_active":"2023-08-31T19:06:16.002583+0000","last_peered":"2023-08-31T19:06:16.002583+0000","last_clean":"2023-08-31T19:06:16.002583+0000","last_became_active":"2023-08-31T19:06:15.546451+0000","last_became_peered":"2023-08-31T19:06:15.546451+0000","last_unstale":"2023-08-31T19:06:16.002583+0000","last_undegraded":"2023-08-31T19:06:16.002583+0000","last_fullsized":"2023-08-31T19:06:16.002583+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.018998+0000","last_change":"2023-08-31T19:06:16.008984+0000","last_active":"2023-08-31T19:06:16.018998+0000","last_peered":"2023-08-31T19:06:16.018998+0000","last_clean":"2023-08-31T19:06:16.018998+0000","last_became_active":"2023-08-31T19:06:16.008647+0000","last_became_peered":"2023-08-31T19:06:16.008647+0000","last_unstale":"2023-08-31T19:06:16.018998+0000","last_undegraded":"2023-08-31T19:06:16.018998+0000","last_fullsized":"2023-08-31T19:06:16.018998+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.004097+0000","last_change":"2023-08-31T19:06:15.550610+0000","last_active":"2023-08-31T19:06:16.004097+0000","last_peered":"2023-08-31T19:06:16.004097+0000","last_clean":"2023-08-31T19:06:16.004097+0000","last_became_active":"2023-08-31T19:06:15.550313+0000","last_became_peered":"2023-08-31T19:06:15.550313+0000","last_unstale":"2023-08-31T19:06:16.004097+0000","last_undegraded":"2023-08-31T19:06:16.004097+0000","last_fullsized":"2023-08-31T19:06:16.004097+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.034901+0000","last_change":"2023-08-31T19:06:16.030531+0000","last_active":"2023-08-31T19:06:16.034901+0000","last_peered":"2023-08-31T19:06:16.034901+0000","last_clean":"2023-08-31T19:06:16.034901+0000","last_became_active":"2023-08-31T19:06:16.029986+0000","last_became_peered":"2023-08-31T19:06:16.029986+0000","last_unstale":"2023-08-31T19:06:16.034901+0000","last_undegraded":"2023-08-31T19:06:16.034901+0000","last_fullsized":"2023-08-31T19:06:16.034901+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002233+0000","last_change":"2023-08-31T19:06:15.546077+0000","last_active":"2023-08-31T19:06:16.002233+0000","last_peered":"2023-08-31T19:06:16.002233+0000","last_clean":"2023-08-31T19:06:16.002233+0000","last_became_active":"2023-08-31T19:06:15.545819+0000","last_became_peered":"2023-08-31T19:06:15.545819+0000","last_unstale":"2023-08-31T19:06:16.002233+0000","last_undegraded":"2023-08-31T19:06:16.002233+0000","last_fullsized":"2023-08-31T19:06:16.002233+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.032835+0000","last_change":"2023-08-31T19:06:16.026347+0000","last_active":"2023-08-31T19:06:16.032835+0000","last_peered":"2023-08-31T19:06:16.032835+0000","last_clean":"2023-08-31T19:06:16.032835+0000","last_became_active":"2023-08-31T19:06:16.026076+0000","last_became_peered":"2023-08-31T19:06:16.026076+0000","last_unstale":"2023-08-31T19:06:16.032835+0000","last_undegraded":"2023-08-31T19:06:16.032835+0000","last_fullsized":"2023-08-31T19:06:16.032835+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.003787+0000","last_change":"2023-08-31T19:06:15.545448+0000","last_active":"2023-08-31T19:06:16.003787+0000","last_peered":"2023-08-31T19:06:16.003787+0000","last_clean":"2023-08-31T19:06:16.003787+0000","last_became_active":"2023-08-31T19:06:15.545159+0000","last_became_peered":"2023-08-31T19:06:15.545159+0000","last_unstale":"2023-08-31T19:06:16.003787+0000","last_undegraded":"2023-08-31T19:06:16.003787+0000","last_fullsized":"2023-08-31T19:06:16.003787+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.026850+0000","last_change":"2023-08-31T19:06:16.018004+0000","last_active":"2023-08-31T19:06:16.026850+0000","last_peered":"2023-08-31T19:06:16.026850+0000","last_clean":"2023-08-31T19:06:16.026850+0000","last_became_active":"2023-08-31T19:06:16.017709+0000","last_became_peered":"2023-08-31T19:06:16.017709+0000","last_unstale":"2023-08-31T19:06:16.026850+0000","last_undegraded":"2023-08-31T19:06:16.026850+0000","last_fullsized":"2023-08-31T19:06:16.026850+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.011932+0000","last_change":"2023-08-31T19:06:15.547344+0000","last_active":"2023-08-31T19:06:16.011932+0000","last_peered":"2023-08-31T19:06:16.011932+0000","last_clean":"2023-08-31T19:06:16.011932+0000","last_became_active":"2023-08-31T19:06:15.546879+0000","last_became_peered":"2023-08-31T19:06:15.546879+0000","last_unstale":"2023-08-31T19:06:16.011932+0000","last_undegraded":"2023-08-31T19:06:16.011932+0000","last_fullsized":"2023-08-31T19:06:16.011932+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.028021+0000","last_change":"2023-08-31T19:06:16.021881+0000","last_active":"2023-08-31T19:06:16.028021+0000","last_peered":"2023-08-31T19:06:16.028021+0000","last_clean":"2023-08-31T19:06:16.028021+0000","last_became_active":"2023-08-31T19:06:16.021621+0000","last_became_peered":"2023-08-31T19:06:16.021621+0000","last_unstale":"2023-08-31T19:06:16.028021+0000","last_undegraded":"2023-08-31T19:06:16.028021+0000","last_fullsized":"2023-08-31T19:06:16.028021+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.032300+0000","last_change":"2023-08-31T19:06:15.557356+0000","last_active":"2023-08-31T19:06:16.032300+0000","last_peered":"2023-08-31T19:06:16.032300+0000","last_clean":"2023-08-31T19:06:16.032300+0000","last_became_active":"2023-08-31T19:06:15.557040+0000","last_became_peered":"2023-08-31T19:06:15.557040+0000","last_unstale":"2023-08-31T19:06:16.032300+0000","last_undegraded":"2023-08-31T19:06:16.032300+0000","last_fullsized":"2023-08-31T19:06:16.032300+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.027051+0000","last_change":"2023-08-31T19:06:16.018582+0000","last_active":"2023-08-31T19:06:16.027051+0000","last_peered":"2023-08-31T19:06:16.027051+0000","last_clean":"2023-08-31T19:06:16.027051+0000","last_became_active":"2023-08-31T19:06:16.018318+0000","last_became_peered":"2023-08-31T19:06:16.018318+0000","last_unstale":"2023-08-31T19:06:16.027051+0000","last_undegraded":"2023-08-31T19:06:16.027051+0000","last_fullsized":"2023-08-31T19:06:16.027051+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.032446+0000","last_change":"2023-08-31T19:06:15.549282+0000","last_active":"2023-08-31T19:06:16.032446+0000","last_peered":"2023-08-31T19:06:16.032446+0000","last_clean":"2023-08-31T19:06:16.032446+0000","last_became_active":"2023-08-31T19:06:15.548922+0000","last_became_peered":"2023-08-31T19:06:15.548922+0000","last_unstale":"2023-08-31T19:06:16.032446+0000","last_undegraded":"2023-08-31T19:06:16.032446+0000","last_fullsized":"2023-08-31T19:06:16.032446+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.029563+0000","last_change":"2023-08-31T19:06:16.026549+0000","last_active":"2023-08-31T19:06:16.029563+0000","last_peered":"2023-08-31T19:06:16.029563+0000","last_clean":"2023-08-31T19:06:16.029563+0000","last_became_active":"2023-08-31T19:06:16.026278+0000","last_became_peered":"2023-08-31T19:06:16.026278+0000","last_unstale":"2023-08-31T19:06:16.029563+0000","last_undegraded":"2023-08-31T19:06:16.029563+0000","last_fullsized":"2023-08-31T19:06:16.029563+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.028180+0000","last_change":"2023-08-31T19:06:15.554352+0000","last_active":"2023-08-31T19:06:16.028180+0000","last_peered":"2023-08-31T19:06:16.028180+0000","last_clean":"2023-08-31T19:06:16.028180+0000","last_became_active":"2023-08-31T19:06:15.554026+0000","last_became_peered":"2023-08-31T19:06:15.554026+0000","last_unstale":"2023-08-31T19:06:16.028180+0000","last_undegraded":"2023-08-31T19:06:16.028180+0000","last_fullsized":"2023-08-31T19:06:16.028180+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021356+0000","last_change":"2023-08-31T19:06:16.014500+0000","last_active":"2023-08-31T19:06:16.021356+0000","last_peered":"2023-08-31T19:06:16.021356+0000","last_clean":"2023-08-31T19:06:16.021356+0000","last_became_active":"2023-08-31T19:06:16.014202+0000","last_became_peered":"2023-08-31T19:06:16.014202+0000","last_unstale":"2023-08-31T19:06:16.021356+0000","last_undegraded":"2023-08-31T19:06:16.021356+0000","last_fullsized":"2023-08-31T19:06:16.021356+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.003404+0000","last_change":"2023-08-31T19:06:15.554421+0000","last_active":"2023-08-31T19:06:16.003404+0000","last_peered":"2023-08-31T19:06:16.003404+0000","last_clean":"2023-08-31T19:06:16.003404+0000","last_became_active":"2023-08-31T19:06:15.553612+0000","last_became_peered":"2023-08-31T19:06:15.553612+0000","last_unstale":"2023-08-31T19:06:16.003404+0000","last_undegraded":"2023-08-31T19:06:16.003404+0000","last_fullsized":"2023-08-31T19:06:16.003404+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.021562+0000","last_change":"2023-08-31T19:06:16.015813+0000","last_active":"2023-08-31T19:06:16.021562+0000","last_peered":"2023-08-31T19:06:16.021562+0000","last_clean":"2023-08-31T19:06:16.021562+0000","last_became_active":"2023-08-31T19:06:16.015528+0000","last_became_peered":"2023-08-31T19:06:16.015528+0000","last_unstale":"2023-08-31T19:06:16.021562+0000","last_undegraded":"2023-08-31T19:06:16.021562+0000","last_fullsized":"2023-08-31T19:06:16.021562+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.000135+0000","last_change":"2023-08-31T19:06:15.552202+0000","last_active":"2023-08-31T19:06:16.000135+0000","last_peered":"2023-08-31T19:06:16.000135+0000","last_clean":"2023-08-31T19:06:16.000135+0000","last_became_active":"2023-08-31T19:06:15.551898+0000","last_became_peered":"2023-08-31T19:06:15.551898+0000","last_unstale":"2023-08-31T19:06:16.000135+0000","last_undegraded":"2023-08-31T19:06:16.000135+0000","last_fullsized":"2023-08-31T19:06:16.000135+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.035056+0000","last_change":"2023-08-31T19:06:16.031914+0000","last_active":"2023-08-31T19:06:16.035056+0000","last_peered":"2023-08-31T19:06:16.035056+0000","last_clean":"2023-08-31T19:06:16.035056+0000","last_became_active":"2023-08-31T19:06:16.031663+0000","last_became_peered":"2023-08-31T19:06:16.031663+0000","last_unstale":"2023-08-31T19:06:16.035056+0000","last_undegraded":"2023-08-31T19:06:16.035056+0000","last_fullsized":"2023-08-31T19:06:16.035056+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.025281+0000","last_change":"2023-08-31T19:06:15.544835+0000","last_active":"2023-08-31T19:06:16.025281+0000","last_peered":"2023-08-31T19:06:16.025281+0000","last_clean":"2023-08-31T19:06:16.025281+0000","last_became_active":"2023-08-31T19:06:15.544534+0000","last_became_peered":"2023-08-31T19:06:15.544534+0000","last_unstale":"2023-08-31T19:06:16.025281+0000","last_undegraded":"2023-08-31T19:06:16.025281+0000","last_fullsized":"2023-08-31T19:06:16.025281+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.034865+0000","last_change":"2023-08-31T19:06:16.029770+0000","last_active":"2023-08-31T19:06:16.034865+0000","last_peered":"2023-08-31T19:06:16.034865+0000","last_clean":"2023-08-31T19:06:16.034865+0000","last_became_active":"2023-08-31T19:06:16.029479+0000","last_became_peered":"2023-08-31T19:06:16.029479+0000","last_unstale":"2023-08-31T19:06:16.034865+0000","last_undegraded":"2023-08-31T19:06:16.034865+0000","last_fullsized":"2023-08-31T19:06:16.034865+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.022463+0000","last_change":"2023-08-31T19:06:15.554370+0000","last_active":"2023-08-31T19:06:16.022463+0000","last_peered":"2023-08-31T19:06:16.022463+0000","last_clean":"2023-08-31T19:06:16.022463+0000","last_became_active":"2023-08-31T19:06:15.554084+0000","last_became_peered":"2023-08-31T19:06:15.554084+0000","last_unstale":"2023-08-31T19:06:16.022463+0000","last_undegraded":"2023-08-31T19:06:16.022463+0000","last_fullsized":"2023-08-31T19:06:16.022463+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.019964+0000","last_change":"2023-08-31T19:06:16.015558+0000","last_active":"2023-08-31T19:06:16.019964+0000","last_peered":"2023-08-31T19:06:16.019964+0000","last_clean":"2023-08-31T19:06:16.019964+0000","last_became_active":"2023-08-31T19:06:16.015250+0000","last_became_peered":"2023-08-31T19:06:16.015250+0000","last_unstale":"2023-08-31T19:06:16.019964+0000","last_undegraded":"2023-08-31T19:06:16.019964+0000","last_fullsized":"2023-08-31T19:06:16.019964+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.011957+0000","last_change":"2023-08-31T19:06:15.547273+0000","last_active":"2023-08-31T19:06:16.011957+0000","last_peered":"2023-08-31T19:06:16.011957+0000","last_clean":"2023-08-31T19:06:16.011957+0000","last_became_active":"2023-08-31T19:06:15.546763+0000","last_became_peered":"2023-08-31T19:06:15.546763+0000","last_unstale":"2023-08-31T19:06:16.011957+0000","last_undegraded":"2023-08-31T19:06:16.011957+0000","last_fullsized":"2023-08-31T19:06:16.011957+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023619+0000","last_change":"2023-08-31T19:06:16.017094+0000","last_active":"2023-08-31T19:06:16.023619+0000","last_peered":"2023-08-31T19:06:16.023619+0000","last_clean":"2023-08-31T19:06:16.023619+0000","last_became_active":"2023-08-31T19:06:16.016785+0000","last_became_peered":"2023-08-31T19:06:16.016785+0000","last_unstale":"2023-08-31T19:06:16.023619+0000","last_undegraded":"2023-08-31T19:06:16.023619+0000","last_fullsized":"2023-08-31T19:06:16.023619+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:15.997981+0000","last_change":"2023-08-31T19:06:15.543511+0000","last_active":"2023-08-31T19:06:15.997981+0000","last_peered":"2023-08-31T19:06:15.997981+0000","last_clean":"2023-08-31T19:06:15.997981+0000","last_became_active":"2023-08-31T19:06:15.543199+0000","last_became_peered":"2023-08-31T19:06:15.543199+0000","last_unstale":"2023-08-31T19:06:15.997981+0000","last_undegraded":"2023-08-31T19:06:15.997981+0000","last_fullsized":"2023-08-31T19:06:15.997981+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023261+0000","last_change":"2023-08-31T19:06:16.016915+0000","last_active":"2023-08-31T19:06:16.023261+0000","last_peered":"2023-08-31T19:06:16.023261+0000","last_clean":"2023-08-31T19:06:16.023261+0000","last_became_active":"2023-08-31T19:06:16.016616+0000","last_became_peered":"2023-08-31T19:06:16.016616+0000","last_unstale":"2023-08-31T19:06:16.023261+0000","last_undegraded":"2023-08-31T19:06:16.023261+0000","last_fullsized":"2023-08-31T19:06:16.023261+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014128+0000","last_change":"2023-08-31T19:06:15.538576+0000","last_active":"2023-08-31T19:06:16.014128+0000","last_peered":"2023-08-31T19:06:16.014128+0000","last_clean":"2023-08-31T19:06:16.014128+0000","last_became_active":"2023-08-31T19:06:15.538271+0000","last_became_peered":"2023-08-31T19:06:15.538271+0000","last_unstale":"2023-08-31T19:06:16.014128+0000","last_undegraded":"2023-08-31T19:06:16.014128+0000","last_fullsized":"2023-08-31T19:06:16.014128+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.027953+0000","last_change":"2023-08-31T19:06:16.021302+0000","last_active":"2023-08-31T19:06:16.027953+0000","last_peered":"2023-08-31T19:06:16.027953+0000","last_clean":"2023-08-31T19:06:16.027953+0000","last_became_active":"2023-08-31T19:06:16.021036+0000","last_became_peered":"2023-08-31T19:06:16.021036+0000","last_unstale":"2023-08-31T19:06:16.027953+0000","last_undegraded":"2023-08-31T19:06:16.027953+0000","last_fullsized":"2023-08-31T19:06:16.027953+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.004296+0000","last_change":"2023-08-31T19:06:15.540194+0000","last_active":"2023-08-31T19:06:16.004296+0000","last_peered":"2023-08-31T19:06:16.004296+0000","last_clean":"2023-08-31T19:06:16.004296+0000","last_became_active":"2023-08-31T19:06:15.539895+0000","last_became_peered":"2023-08-31T19:06:15.539895+0000","last_unstale":"2023-08-31T19:06:16.004296+0000","last_undegraded":"2023-08-31T19:06:16.004296+0000","last_fullsized":"2023-08-31T19:06:16.004296+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.028057+0000","last_change":"2023-08-31T19:06:16.022109+0000","last_active":"2023-08-31T19:06:16.028057+0000","last_peered":"2023-08-31T19:06:16.028057+0000","last_clean":"2023-08-31T19:06:16.028057+0000","last_became_active":"2023-08-31T19:06:16.021818+0000","last_became_peered":"2023-08-31T19:06:16.021818+0000","last_unstale":"2023-08-31T19:06:16.028057+0000","last_undegraded":"2023-08-31T19:06:16.028057+0000","last_fullsized":"2023-08-31T19:06:16.028057+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.001229+0000","last_change":"2023-08-31T19:06:15.552423+0000","last_active":"2023-08-31T19:06:16.001229+0000","last_peered":"2023-08-31T19:06:16.001229+0000","last_clean":"2023-08-31T19:06:16.001229+0000","last_became_active":"2023-08-31T19:06:15.551428+0000","last_became_peered":"2023-08-31T19:06:15.551428+0000","last_unstale":"2023-08-31T19:06:16.001229+0000","last_undegraded":"2023-08-31T19:06:16.001229+0000","last_fullsized":"2023-08-31T19:06:16.001229+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023587+0000","last_change":"2023-08-31T19:06:16.020165+0000","last_active":"2023-08-31T19:06:16.023587+0000","last_peered":"2023-08-31T19:06:16.023587+0000","last_clean":"2023-08-31T19:06:16.023587+0000","last_became_active":"2023-08-31T19:06:16.019847+0000","last_became_peered":"2023-08-31T19:06:16.019847+0000","last_unstale":"2023-08-31T19:06:16.023587+0000","last_undegraded":"2023-08-31T19:06:16.023587+0000","last_fullsized":"2023-08-31T19:06:16.023587+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:15.997997+0000","last_change":"2023-08-31T19:06:15.543608+0000","last_active":"2023-08-31T19:06:15.997997+0000","last_peered":"2023-08-31T19:06:15.997997+0000","last_clean":"2023-08-31T19:06:15.997997+0000","last_became_active":"2023-08-31T19:06:15.543269+0000","last_became_peered":"2023-08-31T19:06:15.543269+0000","last_unstale":"2023-08-31T19:06:15.997997+0000","last_undegraded":"2023-08-31T19:06:15.997997+0000","last_fullsized":"2023-08-31T19:06:15.997997+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.025735+0000","last_change":"2023-08-31T19:06:16.022947+0000","last_active":"2023-08-31T19:06:16.025735+0000","last_peered":"2023-08-31T19:06:16.025735+0000","last_clean":"2023-08-31T19:06:16.025735+0000","last_became_active":"2023-08-31T19:06:16.021610+0000","last_became_peered":"2023-08-31T19:06:16.021610+0000","last_unstale":"2023-08-31T19:06:16.025735+0000","last_undegraded":"2023-08-31T19:06:16.025735+0000","last_fullsized":"2023-08-31T19:06:16.025735+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002688+0000","last_change":"2023-08-31T19:06:15.552870+0000","last_active":"2023-08-31T19:06:16.002688+0000","last_peered":"2023-08-31T19:06:16.002688+0000","last_clean":"2023-08-31T19:06:16.002688+0000","last_became_active":"2023-08-31T19:06:15.552566+0000","last_became_peered":"2023-08-31T19:06:15.552566+0000","last_unstale":"2023-08-31T19:06:16.002688+0000","last_undegraded":"2023-08-31T19:06:16.002688+0000","last_fullsized":"2023-08-31T19:06:16.002688+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.024229+0000","last_change":"2023-08-31T19:06:16.014290+0000","last_active":"2023-08-31T19:06:16.024229+0000","last_peered":"2023-08-31T19:06:16.024229+0000","last_clean":"2023-08-31T19:06:16.024229+0000","last_became_active":"2023-08-31T19:06:16.013968+0000","last_became_peered":"2023-08-31T19:06:16.013968+0000","last_unstale":"2023-08-31T19:06:16.024229+0000","last_undegraded":"2023-08-31T19:06:16.024229+0000","last_fullsized":"2023-08-31T19:06:16.024229+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:15.997570+0000","last_change":"2023-08-31T19:06:15.545083+0000","last_active":"2023-08-31T19:06:15.997570+0000","last_peered":"2023-08-31T19:06:15.997570+0000","last_clean":"2023-08-31T19:06:15.997570+0000","last_became_active":"2023-08-31T19:06:15.544796+0000","last_became_peered":"2023-08-31T19:06:15.544796+0000","last_unstale":"2023-08-31T19:06:15.997570+0000","last_undegraded":"2023-08-31T19:06:15.997570+0000","last_fullsized":"2023-08-31T19:06:15.997570+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014202+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:06:16.014202+0000","last_peered":"2023-08-31T19:06:16.014202+0000","last_clean":"2023-08-31T19:06:16.014202+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:06:16.014202+0000","last_undegraded":"2023-08-31T19:06:16.014202+0000","last_fullsized":"2023-08-31T19:06:16.014202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.033811+0000","last_change":"2023-08-31T19:06:16.032568+0000","last_active":"2023-08-31T19:06:16.033811+0000","last_peered":"2023-08-31T19:06:16.033811+0000","last_clean":"2023-08-31T19:06:16.033811+0000","last_became_active":"2023-08-31T19:06:16.032301+0000","last_became_peered":"2023-08-31T19:06:16.032301+0000","last_unstale":"2023-08-31T19:06:16.033811+0000","last_undegraded":"2023-08-31T19:06:16.033811+0000","last_fullsized":"2023-08-31T19:06:16.033811+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.020999+0000","last_change":"2023-08-31T19:06:15.544175+0000","last_active":"2023-08-31T19:06:16.020999+0000","last_peered":"2023-08-31T19:06:16.020999+0000","last_clean":"2023-08-31T19:06:16.020999+0000","last_became_active":"2023-08-31T19:06:15.543850+0000","last_became_peered":"2023-08-31T19:06:15.543850+0000","last_unstale":"2023-08-31T19:06:16.020999+0000","last_undegraded":"2023-08-31T19:06:16.020999+0000","last_fullsized":"2023-08-31T19:06:16.020999+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":105,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002718+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:06:16.002718+0000","last_peered":"2023-08-31T19:06:16.002718+0000","last_clean":"2023-08-31T19:06:16.002718+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:06:16.002718+0000","last_undegraded":"2023-08-31T19:06:16.002718+0000","last_fullsized":"2023-08-31T19:06:16.002718+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.031687+0000","last_change":"2023-08-31T19:06:16.023128+0000","last_active":"2023-08-31T19:06:16.031687+0000","last_peered":"2023-08-31T19:06:16.031687+0000","last_clean":"2023-08-31T19:06:16.031687+0000","last_became_active":"2023-08-31T19:06:16.022796+0000","last_became_peered":"2023-08-31T19:06:16.022796+0000","last_unstale":"2023-08-31T19:06:16.031687+0000","last_undegraded":"2023-08-31T19:06:16.031687+0000","last_fullsized":"2023-08-31T19:06:16.031687+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.004900+0000","last_change":"2023-08-31T19:06:15.541317+0000","last_active":"2023-08-31T19:06:16.004900+0000","last_peered":"2023-08-31T19:06:16.004900+0000","last_clean":"2023-08-31T19:06:16.004900+0000","last_became_active":"2023-08-31T19:06:15.536730+0000","last_became_peered":"2023-08-31T19:06:15.536730+0000","last_unstale":"2023-08-31T19:06:16.004900+0000","last_undegraded":"2023-08-31T19:06:16.004900+0000","last_fullsized":"2023-08-31T19:06:16.004900+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.000230+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:06:16.000230+0000","last_peered":"2023-08-31T19:06:16.000230+0000","last_clean":"2023-08-31T19:06:16.000230+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:06:16.000230+0000","last_undegraded":"2023-08-31T19:06:16.000230+0000","last_fullsized":"2023-08-31T19:06:16.000230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.035072+0000","last_change":"2023-08-31T19:06:16.031933+0000","last_active":"2023-08-31T19:06:16.035072+0000","last_peered":"2023-08-31T19:06:16.035072+0000","last_clean":"2023-08-31T19:06:16.035072+0000","last_became_active":"2023-08-31T19:06:16.031411+0000","last_became_peered":"2023-08-31T19:06:16.031411+0000","last_unstale":"2023-08-31T19:06:16.035072+0000","last_undegraded":"2023-08-31T19:06:16.035072+0000","last_fullsized":"2023-08-31T19:06:16.035072+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.016143+0000","last_change":"2023-08-31T19:06:15.553106+0000","last_active":"2023-08-31T19:06:16.016143+0000","last_peered":"2023-08-31T19:06:16.016143+0000","last_clean":"2023-08-31T19:06:16.016143+0000","last_became_active":"2023-08-31T19:06:15.551497+0000","last_became_peered":"2023-08-31T19:06:15.551497+0000","last_unstale":"2023-08-31T19:06:16.016143+0000","last_undegraded":"2023-08-31T19:06:16.016143+0000","last_fullsized":"2023-08-31T19:06:16.016143+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":105,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002823+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:06:16.002823+0000","last_peered":"2023-08-31T19:06:16.002823+0000","last_clean":"2023-08-31T19:06:16.002823+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:06:16.002823+0000","last_undegraded":"2023-08-31T19:06:16.002823+0000","last_fullsized":"2023-08-31T19:06:16.002823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":106,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.006531+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:06:16.006531+0000","last_peered":"2023-08-31T19:06:16.006531+0000","last_clean":"2023-08-31T19:06:16.006531+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:06:16.006531+0000","last_undegraded":"2023-08-31T19:06:16.006531+0000","last_fullsized":"2023-08-31T19:06:16.006531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.028760+0000","last_change":"2023-08-31T19:06:16.027164+0000","last_active":"2023-08-31T19:06:16.028760+0000","last_peered":"2023-08-31T19:06:16.028760+0000","last_clean":"2023-08-31T19:06:16.028760+0000","last_became_active":"2023-08-31T19:06:16.026922+0000","last_became_peered":"2023-08-31T19:06:16.026922+0000","last_unstale":"2023-08-31T19:06:16.028760+0000","last_undegraded":"2023-08-31T19:06:16.028760+0000","last_fullsized":"2023-08-31T19:06:16.028760+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.008452+0000","last_change":"2023-08-31T19:06:15.553350+0000","last_active":"2023-08-31T19:06:16.008452+0000","last_peered":"2023-08-31T19:06:16.008452+0000","last_clean":"2023-08-31T19:06:16.008452+0000","last_became_active":"2023-08-31T19:06:15.553088+0000","last_became_peered":"2023-08-31T19:06:15.553088+0000","last_unstale":"2023-08-31T19:06:16.008452+0000","last_undegraded":"2023-08-31T19:06:16.008452+0000","last_fullsized":"2023-08-31T19:06:16.008452+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":105,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.008796+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:06:16.008796+0000","last_peered":"2023-08-31T19:06:16.008796+0000","last_clean":"2023-08-31T19:06:16.008796+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:06:16.008796+0000","last_undegraded":"2023-08-31T19:06:16.008796+0000","last_fullsized":"2023-08-31T19:06:16.008796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.023617+0000","last_change":"2023-08-31T19:06:16.019514+0000","last_active":"2023-08-31T19:06:16.023617+0000","last_peered":"2023-08-31T19:06:16.023617+0000","last_clean":"2023-08-31T19:06:16.023617+0000","last_became_active":"2023-08-31T19:06:16.019240+0000","last_became_peered":"2023-08-31T19:06:16.019240+0000","last_unstale":"2023-08-31T19:06:16.023617+0000","last_undegraded":"2023-08-31T19:06:16.023617+0000","last_fullsized":"2023-08-31T19:06:16.023617+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.002601+0000","last_change":"2023-08-31T19:06:15.560000+0000","last_active":"2023-08-31T19:06:16.002601+0000","last_peered":"2023-08-31T19:06:16.002601+0000","last_clean":"2023-08-31T19:06:16.002601+0000","last_became_active":"2023-08-31T19:06:15.558979+0000","last_became_peered":"2023-08-31T19:06:15.558979+0000","last_unstale":"2023-08-31T19:06:16.002601+0000","last_undegraded":"2023-08-31T19:06:16.002601+0000","last_fullsized":"2023-08-31T19:06:16.002601+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":105,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.008697+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:06:16.008697+0000","last_peered":"2023-08-31T19:06:16.008697+0000","last_clean":"2023-08-31T19:06:16.008697+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:06:16.008697+0000","last_undegraded":"2023-08-31T19:06:16.008697+0000","last_fullsized":"2023-08-31T19:06:16.008697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.032592+0000","last_change":"2023-08-31T19:06:16.025898+0000","last_active":"2023-08-31T19:06:16.032592+0000","last_peered":"2023-08-31T19:06:16.032592+0000","last_clean":"2023-08-31T19:06:16.032592+0000","last_became_active":"2023-08-31T19:06:16.025512+0000","last_became_peered":"2023-08-31T19:06:16.025512+0000","last_unstale":"2023-08-31T19:06:16.032592+0000","last_undegraded":"2023-08-31T19:06:16.032592+0000","last_fullsized":"2023-08-31T19:06:16.032592+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.032236+0000","last_change":"2023-08-31T19:06:15.559986+0000","last_active":"2023-08-31T19:06:16.032236+0000","last_peered":"2023-08-31T19:06:16.032236+0000","last_clean":"2023-08-31T19:06:16.032236+0000","last_became_active":"2023-08-31T19:06:15.559698+0000","last_became_peered":"2023-08-31T19:06:15.559698+0000","last_unstale":"2023-08-31T19:06:16.032236+0000","last_undegraded":"2023-08-31T19:06:16.032236+0000","last_fullsized":"2023-08-31T19:06:16.032236+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":112,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.014659+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:06:16.014659+0000","last_peered":"2023-08-31T19:06:16.014659+0000","last_clean":"2023-08-31T19:06:16.014659+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:06:16.014659+0000","last_undegraded":"2023-08-31T19:06:16.014659+0000","last_fullsized":"2023-08-31T19:06:16.014659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.034985+0000","last_change":"2023-08-31T19:06:16.030608+0000","last_active":"2023-08-31T19:06:16.034985+0000","last_peered":"2023-08-31T19:06:16.034985+0000","last_clean":"2023-08-31T19:06:16.034985+0000","last_became_active":"2023-08-31T19:06:16.029888+0000","last_became_peered":"2023-08-31T19:06:16.029888+0000","last_unstale":"2023-08-31T19:06:16.034985+0000","last_undegraded":"2023-08-31T19:06:16.034985+0000","last_fullsized":"2023-08-31T19:06:16.034985+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:15.520578+0000","last_clean_scrub_stamp":"2023-08-31T19:06:15.520578+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:16.001192+0000","last_change":"2023-08-31T19:06:15.552643+0000","last_active":"2023-08-31T19:06:16.001192+0000","last_peered":"2023-08-31T19:06:16.001192+0000","last_clean":"2023-08-31T19:06:16.001192+0000","last_became_active":"2023-08-31T19:06:15.551765+0000","last_became_peered":"2023-08-31T19:06:15.551765+0000","last_unstale":"2023-08-31T19:06:16.001192+0000","last_undegraded":"2023-08-31T19:06:16.001192+0000","last_fullsized":"2023-08-31T19:06:16.001192+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:06:14.517929+0000","last_clean_scrub_stamp":"2023-08-31T19:06:14.517929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":115,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-31T19:06:15.998810+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:06:15.998810+0000","last_peered":"2023-08-31T19:06:15.998810+0000","last_clean":"2023-08-31T19:06:15.998810+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:06:15.998810+0000","last_undegraded":"2023-08-31T19:06:15.998810+0000","last_fullsized":"2023-08-31T19:06:15.998810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575068,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302716,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069124,"statfs":{"total":96636764160,"available":96326782976,"internally_reserved":0,"allocated":1560576,"data_stored":826022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71499999999999997,"15min":0.74399999999999999},"min":{"1min":0.432,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.92100000000000004,"5min":1.175,"15min":1.175},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73999999999999999,"15min":0.76100000000000001},"min":{"1min":0.54300000000000004,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97599999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.88900000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66700000000000004,"15min":0.70399999999999996},"min":{"1min":0.436,"5min":0.40699999999999997,"15min":0.40000000000000002},"max":{"1min":1.0009999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66300000000000003,"15min":0.68899999999999995},"min":{"1min":0.48499999999999999,"5min":0.40500000000000003,"15min":0.36199999999999999},"max":{"1min":0.93600000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67600000000000005,"15min":0.70499999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.98599999999999999,"5min":1.163,"15min":1.163},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95299999999999996,"5min":0.98499999999999999,"15min":1.054},"last":0.751}]},{"osd":3,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69699999999999995,"15min":0.72099999999999997},"min":{"1min":0.498,"5min":0.432,"15min":0.432},"max":{"1min":0.94299999999999995,"5min":1.107,"15min":1.107},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.51000000000000001},"max":{"1min":0.873,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.84799999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.46700000000000003,"5min":0.37,"15min":0.33900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.97899999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":0.71199999999999997},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.89800000000000002,"5min":0.98399999999999999,"15min":1.004},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.47799999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0229999999999999,"5min":1.139,"15min":1.139},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.52400000000000002,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":0.91900000000000004,"5min":0.93899999999999995,"15min":1.048},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.55200000000000005,"5min":0.47099999999999997,"15min":0.45600000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.0740000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69599999999999995,"15min":0.69699999999999995},"min":{"1min":0.51000000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95599999999999996,"5min":1.038,"15min":1.071},"last":0.63500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575067,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302712,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069128,"statfs":{"total":96636764160,"available":96326787072,"internally_reserved":0,"allocated":1556480,"data_stored":819294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67400000000000004,"15min":0.70799999999999996},"min":{"1min":0.53300000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81799999999999995,"5min":0.92000000000000004,"15min":1.0189999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66500000000000004,"15min":0.70299999999999996},"min":{"1min":0.45400000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.86799999999999999,"5min":1.069,"15min":1.069},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Aug 31 19:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65900000000000003,"15min":0.70199999999999996},"min":{"1min":0.51900000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.92500000000000004,"5min":1.014,"15min":1.014},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.72299999999999998},"min":{"1min":0.495,"5min":0.434,"15min":0.434},"max":{"1min":0.94399999999999995,"5min":1.216,"15min":1.216},"last":0.90000000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70499999999999996,"15min":0.73299999999999998},"min":{"1min":0.46999999999999997,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":0.96799999999999997,"5min":1.0840000000000001,"15min":1.129},"last":0.879},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72099999999999997,"15min":0.74299999999999999},"min":{"1min":0.57799999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91300000000000003,"5min":0.98899999999999999,"15min":1.3260000000000001},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70299999999999996,"15min":0.71499999999999997},"min":{"1min":0.56100000000000005,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.871,"5min":0.96599999999999997,"15min":1.006},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72799999999999998,"15min":0.752},"min":{"1min":0.54400000000000004,"5min":0.53000000000000003,"15min":0.52500000000000002},"max":{"1min":0.88700000000000001,"5min":1.087,"15min":1.087},"last":0.79400000000000004}]},{"osd":4,"last update":"Thu Aug 31 19:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63300000000000001,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":0.90900000000000003,"5min":0.94299999999999995,"15min":0.96599999999999997},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65300000000000002,"15min":0.63200000000000001},"min":{"1min":0.44600000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86499999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68200000000000005,"15min":0.66700000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.39800000000000002},"max":{"1min":0.97899999999999998,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.53600000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.98599999999999999,"5min":1.0669999999999999,"15min":1.0700000000000001},"last":1.0669999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.71199999999999997,"15min":0.70099999999999996},"min":{"1min":0.52300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96599999999999997,"5min":1.012,"15min":1.012},"last":0.871},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.754,"15min":0.749},"min":{"1min":0.56699999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0620000000000001,"5min":1.161,"15min":1.161},"last":0.96799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575068,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302716,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069124,"statfs":{"total":96636764160,"available":96326782976,"internally_reserved":0,"allocated":1560576,"data_stored":820178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42099999999999999,"15min":0.44400000000000001},"min":{"1min":0.314,"5min":0.27300000000000002,"15min":0.26100000000000001},"max":{"1min":0.69499999999999995,"5min":0.70999999999999996,"15min":0.81000000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.46400000000000002,"15min":0.47399999999999998},"min":{"1min":0.34999999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.752},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48799999999999999,"15min":0.51000000000000001},"min":{"1min":0.35399999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70599999999999996,"5min":0.752,"15min":0.82699999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55000000000000004,"15min":0.57499999999999996},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.70199999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52800000000000002,"15min":0.55200000000000005},"min":{"1min":0.40300000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66000000000000003,"5min":0.79000000000000004,"15min":0.82199999999999995},"last":0.501},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.50800000000000001},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73899999999999999,"15min":0.78000000000000003},"min":{"1min":0.53200000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.2110000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.77100000000000002,"15min":0.81000000000000005},"min":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.97099999999999997,"5min":1.111,"15min":1.3},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71499999999999997,"15min":0.76600000000000001},"min":{"1min":0.56200000000000006,"5min":0.497,"15min":0.497},"max":{"1min":1.02,"5min":1.02,"15min":1.4119999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75,"15min":0.77300000000000002},"min":{"1min":0.55900000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.123,"5min":1.123,"15min":1.2310000000000001},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Aug 31 19:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.71599999999999997,"15min":0.76100000000000001},"min":{"1min":0.503,"5min":0.501,"15min":0.501},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.1990000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76200000000000001,"15min":0.79700000000000004},"min":{"1min":0.57199999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0820000000000001,"5min":1.167,"15min":1.2629999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:05:23 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75,"15min":0.78000000000000003},"min":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97099999999999997,"5min":1.1120000000000001,"15min":1.113},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.748,"15min":0.78800000000000003},"min":{"1min":0.57599999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.99199999999999999,"5min":1.0429999999999999,"15min":1.3320000000000001},"last":0.60499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575067,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302712,"kb_used_data":1520,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069128,"statfs":{"total":96636764160,"available":96326787072,"internally_reserved":0,"allocated":1556480,"data_stored":819362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.438,"15min":0.441},"min":{"1min":0.30499999999999999,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.66300000000000003,"5min":0.73399999999999999,"15min":0.78400000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30399999999999999},"max":{"1min":0.65900000000000003,"5min":0.876,"15min":0.876},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.495,"15min":0.50600000000000001},"min":{"1min":0.38700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.66000000000000003,"5min":0.71899999999999997,"15min":0.74299999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.50900000000000001,"15min":0.52800000000000002},"min":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.82499999999999996,"5min":1.018,"15min":1.018},"last":0.379}]},{"osd":3,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.499,"15min":0.51500000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.69099999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55300000000000005,"15min":0.56799999999999995},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.36599999999999999},"max":{"1min":0.72499999999999998,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.79400000000000004,"15min":0.81999999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0029999999999999,"5min":1.103,"15min":1.2370000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78600000000000003,"15min":0.81699999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0349999999999999,"5min":1.105,"15min":1.276},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97399999999999998,"5min":1.155,"15min":1.155},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74399999999999999,"15min":0.76800000000000002},"min":{"1min":0.54300000000000004,"5min":0.498,"15min":0.498},"max":{"1min":0.94599999999999995,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.52400000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1000000000000001,"5min":1.1060000000000001,"15min":1.3280000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.83599999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.53500000000000003},"max":{"1min":1.048,"5min":1.196,"15min":1.2350000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.53700000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.018,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81299999999999994,"15min":0.83499999999999996},"min":{"1min":0.57599999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0389999999999999,"5min":1.548,"15min":1.548},"last":0.79100000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575067,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302708,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069132,"statfs":{"total":96636764160,"available":96326791168,"internally_reserved":0,"allocated":1552384,"data_stored":818732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:05:16 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.55700000000000005,"15min":0.48299999999999998},"min":{"1min":0.32400000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":14.09,"5min":14.09,"15min":14.09},"last":2.004},{"interface":"front","average":{"1min":0.626,"5min":0.497,"15min":0.499},"min":{"1min":0.32900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":2.3679999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.53300000000000003,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":5.0810000000000004,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":1.625},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.37,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":4.375,"5min":4.375,"15min":4.375},"last":2.4119999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.33300000000000002,"5min":0.316,"15min":0.316},"max":{"1min":5.7649999999999997,"5min":5.7649999999999997,"15min":5.7649999999999997},"last":2.4220000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.9729999999999999,"5min":5.9729999999999999,"15min":5.9729999999999999},"last":1.6839999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.77800000000000002,"15min":0.79600000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":4.9960000000000004,"5min":4.9960000000000004,"15min":4.9960000000000004},"last":0.997},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.55000000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":4.4119999999999999,"5min":4.4119999999999999,"15min":4.4119999999999999},"last":1.036}]},{"osd":5,"last update":"Thu Aug 31 19:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.745,"15min":0.78900000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95499999999999996,"5min":1.2,"15min":1.361},"last":2.3540000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.77900000000000003,"15min":0.80200000000000005},"min":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":5.0449999999999999,"5min":5.0449999999999999,"15min":5.0449999999999999},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.79300000000000004,"15min":0.81699999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":4.2649999999999997,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":1.103},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":2.383}]},{"osd":7,"last update":"Thu Aug 31 19:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76600000000000001,"15min":0.80800000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.161},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77500000000000002,"15min":0.81899999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.97499999999999998,"5min":1.1160000000000001,"15min":1.387},"last":2.403}]}]},{"osd":3,"up_from":13,"seq":55834575067,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302700,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069140,"statfs":{"total":96636764160,"available":96326799360,"internally_reserved":0,"allocated":1544192,"data_stored":818628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.57899999999999996,"15min":0.48699999999999999},"min":{"1min":0.314,"5min":0.223,"15min":0.223},"max":{"1min":0.88300000000000001,"5min":14.099,"15min":14.099},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.71399999999999997,"15min":0.56100000000000005},"min":{"1min":0.34999999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66200000000000003,"5min":24.879999999999999,"15min":24.879999999999999},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.33500000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.64000000000000001,"5min":0.79600000000000004,"15min":0.90700000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.626,"15min":0.54700000000000004},"min":{"1min":0.39600000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65900000000000003,"5min":14.143000000000001,"15min":14.143000000000001},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72199999999999998,"5min":0.94999999999999996,"15min":1.407},"last":0.628},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.70999999999999996,"15min":0.65500000000000003},"min":{"1min":0.46800000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78400000000000003,"5min":12.464,"15min":12.464},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.93300000000000005,"15min":0.81899999999999995},"min":{"1min":0.52500000000000002,"5min":0.439,"15min":0.439},"max":{"1min":1.0820000000000001,"5min":21.475999999999999,"15min":21.475999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.52200000000000002,"5min":0.52100000000000002,"15min":0.47699999999999998},"max":{"1min":1.05,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73199999999999998,"15min":0.76200000000000001},"min":{"1min":0.54800000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.3220000000000001},"last":0.878},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.84599999999999997,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.94299999999999995,"5min":12.509,"15min":12.509},"last":0.88800000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.86799999999999999,"15min":0.81999999999999995},"min":{"1min":0.56799999999999995,"5min":0.53400000000000003,"15min":0.52000000000000002},"max":{"1min":0.995,"5min":12.426,"15min":12.426},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.99399999999999999,"15min":0.85799999999999998},"min":{"1min":0.57899999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0189999999999999,"5min":24.920000000000002,"15min":24.920000000000002},"last":0.98599999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.97899999999999998,"15min":0.86199999999999999},"min":{"1min":0.60299999999999998,"5min":0.51300000000000001,"15min":0.495},"max":{"1min":1.01,"5min":21.521000000000001,"15min":21.521000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.755,"15min":0.78300000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2070000000000001,"5min":1.232,"15min":1.232},"last":0.95999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575067,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302708,"kb_used_data":1516,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069132,"statfs":{"total":96636764160,"available":96326791168,"internally_reserved":0,"allocated":1552384,"data_stored":819542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65100000000000002,"15min":0.69299999999999995},"min":{"1min":0.41799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":1.103},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.64100000000000001,"15min":0.69199999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79000000000000004,"5min":0.92900000000000005,"15min":0.93400000000000005},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Aug 31 19:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67300000000000004,"15min":0.71099999999999997},"min":{"1min":0.48799999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.97299999999999998,"5min":0.98399999999999999,"15min":1.006},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66600000000000004,"15min":0.70899999999999996},"min":{"1min":0.48099999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90000000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":1.1899999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68000000000000005,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0089999999999999,"5min":1.042,"15min":1.044},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.68500000000000005,"15min":0.72399999999999998},"min":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.95199999999999996,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.999}]},{"osd":3,"last update":"Thu Aug 31 19:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67500000000000004,"15min":0.71099999999999997},"min":{"1min":0.499,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88300000000000001,"5min":1.01,"15min":1.01},"last":0.75},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70799999999999996,"15min":0.73799999999999999},"min":{"1min":0.54500000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.91100000000000003,"5min":1.012,"15min":1.081},"last":1.0389999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":0.78400000000000003,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.62,"15min":0.621},"min":{"1min":0.40400000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.871,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.99099999999999999,"5min":1.163,"15min":1.163},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69299999999999995,"15min":0.68700000000000006},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.441},"max":{"1min":0.90400000000000003,"5min":1.133,"15min":1.133},"last":1.1519999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68899999999999995,"15min":0.68200000000000005},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.96099999999999997,"5min":1.147,"15min":1.147},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.50800000000000001,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":1.022,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":1.165}]}]},{"osd":5,"up_from":13,"seq":55834575067,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302704,"kb_used_data":1512,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069136,"statfs":{"total":96636764160,"available":96326795264,"internally_reserved":0,"allocated":1548288,"data_stored":819182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.69499999999999995,"15min":0.71899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.41299999999999998},"max":{"1min":0.877,"5min":4.2119999999999997,"15min":4.2119999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.51700000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88800000000000001,"5min":3.548,"15min":3.548},"last":0.61599999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.82799999999999996,"15min":0.76300000000000001},"min":{"1min":0.53700000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81999999999999995,"5min":16.744,"15min":16.744},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71299999999999997,"15min":0.73599999999999999},"min":{"1min":0.47099999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92300000000000004,"5min":3.6299999999999999,"15min":3.6299999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69699999999999995,"15min":0.71199999999999997},"min":{"1min":0.44400000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89200000000000002,"5min":3.4430000000000001,"15min":3.4430000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92900000000000005,"5min":4.1740000000000004,"15min":4.1740000000000004},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68999999999999995,"15min":0.73399999999999999},"min":{"1min":0.51600000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86699999999999999,"5min":1.327,"15min":1.327},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.70899999999999996,"15min":0.72799999999999998},"min":{"1min":0.52700000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84599999999999997,"5min":2.823,"15min":2.823},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Aug 31 19:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.67800000000000005,"15min":0.64600000000000002},"min":{"1min":0.435,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79600000000000004,"5min":7.3739999999999997,"15min":7.3739999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.49299999999999999,"5min":0.44800000000000001,"15min":0.41499999999999998},"max":{"1min":0.91900000000000004,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67000000000000004,"15min":0.65800000000000003},"min":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.76200000000000001,"15min":0.72299999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.85499999999999998,"5min":7.4139999999999997,"15min":7.4139999999999997},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":0.89400000000000002,"5min":3.5960000000000001,"15min":3.5960000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.54900000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92600000000000005,"5min":2.786,"15min":2.786},"last":0.71999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:06:20.718 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T19:06:20.719 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-31T19:06:20.899 INFO:tasks.ceph.mds.a.smithi072.stderr:2023-08-31T19:06:20.899+0000 7fd5641f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:06:20.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.946+0000 7fb8bd9ff700 1 Processor -- start 2023-08-31T19:06:20.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.946+0000 7fb8bd9ff700 1 -- start start 2023-08-31T19:06:20.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.948+0000 7fb8bd9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8b8066ae0 0x7fb8b81542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.948+0000 7fb8bd9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b80a84b0 con 0x7fb8b8153ed0 2023-08-31T19:06:20.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.948+0000 7fb8bd9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b80c9410 con 0x7fb8b80bdb30 2023-08-31T19:06:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.948+0000 7fb8bd9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b80c5310 con 0x7fb8b8066ae0 2023-08-31T19:06:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.948+0000 7fb8b6ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb8b8153ed0 0x7fb8b8155200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50054/0 (socket says 172.21.15.72:50054) 2023-08-31T19:06:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.948+0000 7fb8b6ffd700 1 -- 172.21.15.72:0/1675876719 learned_addr learned my addr 172.21.15.72:0/1675876719 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.948+0000 7fb8b77fe700 1 --2- 172.21.15.72:0/1675876719 >> v2:172.21.15.72:3300/0 conn(0x7fb8b8066ae0 0x7fb8b81542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.948+0000 7fb8b67fc700 1 -- 172.21.15.72:0/1675876719 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273862993 0 0) 0x7fb8b80a84b0 con 0x7fb8b8153ed0 2023-08-31T19:06:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.948+0000 7fb8b67fc700 1 -- 172.21.15.72:0/1675876719 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8a40033f0 con 0x7fb8b8153ed0 2023-08-31T19:06:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.948+0000 7fb8b67fc700 1 -- 172.21.15.72:0/1675876719 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257003207 0 0) 0x7fb8b80c9410 con 0x7fb8b80bdb30 2023-08-31T19:06:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.948+0000 7fb8b67fc700 1 -- 172.21.15.72:0/1675876719 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b80a84b0 con 0x7fb8b80bdb30 2023-08-31T19:06:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.948+0000 7fb8b77fe700 1 -- 172.21.15.72:0/1675876719 >> v1:172.21.15.146:6789/0 conn(0x7fb8b80bdb30 legacy=0x7fb8b80663d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:20.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.948+0000 7fb8b77fe700 1 -- 172.21.15.72:0/1675876719 >> v1:172.21.15.72:6789/0 conn(0x7fb8b8153ed0 legacy=0x7fb8b8155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:20.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.948+0000 7fb8b77fe700 1 -- 172.21.15.72:0/1675876719 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b80a7ef0 con 0x7fb8b8066ae0 2023-08-31T19:06:20.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.949+0000 7fb8b77fe700 1 --2- 172.21.15.72:0/1675876719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b8066ae0 0x7fb8b81542b0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7fb8b0009e60 tx=0x7fb8b0009780).ready entity=mon.0 client_cookie=69d83b61bee5c37f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:20.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.949+0000 7fb8b67fc700 1 -- 172.21.15.72:0/1675876719 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b000e070 con 0x7fb8b8066ae0 2023-08-31T19:06:20.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.949+0000 7fb8b67fc700 1 -- 172.21.15.72:0/1675876719 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b000bab0 con 0x7fb8b8066ae0 2023-08-31T19:06:20.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.949+0000 7fb8b67fc700 1 -- 172.21.15.72:0/1675876719 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b000be30 con 0x7fb8b8066ae0 2023-08-31T19:06:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.949+0000 7fb8bd9ff700 1 -- 172.21.15.72:0/1675876719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b8066ae0 msgr2=0x7fb8b81542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.949+0000 7fb8bd9ff700 1 --2- 172.21.15.72:0/1675876719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b8066ae0 0x7fb8b81542b0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7fb8b0009e60 tx=0x7fb8b0009780).stop 2023-08-31T19:06:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.949+0000 7fb8bd9ff700 1 -- 172.21.15.72:0/1675876719 shutdown_connections 2023-08-31T19:06:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.949+0000 7fb8bd9ff700 1 --2- 172.21.15.72:0/1675876719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b8066ae0 0x7fb8b81542b0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.949+0000 7fb8bd9ff700 1 -- 172.21.15.72:0/1675876719 >> 172.21.15.72:0/1675876719 conn(0x7fb8b805eb60 msgr2=0x7fb8b80c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:20.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.950+0000 7fb8bd9ff700 1 -- 172.21.15.72:0/1675876719 shutdown_connections 2023-08-31T19:06:20.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.950+0000 7fb8bd9ff700 1 -- 172.21.15.72:0/1675876719 wait complete. 2023-08-31T19:06:20.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.951+0000 7fb8bd9ff700 1 Processor -- start 2023-08-31T19:06:20.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.951+0000 7fb8bd9ff700 1 -- start start 2023-08-31T19:06:20.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.952+0000 7fb8bd9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8b8066ae0 0x7fb8b81505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.952+0000 7fb8bd9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8b8153ed0 0x7fb8b80acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.952+0000 7fb8bd9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b8150ad0 0x7fb8b80ad100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.952+0000 7fb8bd9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b80c1ed0 con 0x7fb8b8150ad0 2023-08-31T19:06:20.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.952+0000 7fb8bd9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b80c21b0 con 0x7fb8b8066ae0 2023-08-31T19:06:20.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.952+0000 7fb8bd9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b80c2490 con 0x7fb8b8153ed0 2023-08-31T19:06:20.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.952+0000 7fb8b77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b8150ad0 0x7fb8b80ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.952+0000 7fb8b77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b8150ad0 0x7fb8b80ad100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58578/0 (socket says 172.21.15.72:58578) 2023-08-31T19:06:20.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.952+0000 7fb8b77fe700 1 -- 172.21.15.72:0/1996972764 learned_addr learned my addr 172.21.15.72:0/1996972764 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:20.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.953+0000 7fb8ae7fc700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8b8153ed0 0x7fb8b80acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.953+0000 7fb8b6ffd700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8b8066ae0 0x7fb8b81505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.953+0000 7fb8b77fe700 1 -- 172.21.15.72:0/1996972764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8b8153ed0 msgr2=0x7fb8b80acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:20.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.953+0000 7fb8b77fe700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8b8153ed0 0x7fb8b80acc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.953+0000 7fb8b77fe700 1 -- 172.21.15.72:0/1996972764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8b8066ae0 msgr2=0x7fb8b81505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:20.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.953+0000 7fb8b77fe700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8b8066ae0 0x7fb8b81505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:20.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.953+0000 7fb8b77fe700 1 -- 172.21.15.72:0/1996972764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b0009a20 con 0x7fb8b8150ad0 2023-08-31T19:06:20.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.953+0000 7fb8ae7fc700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8b8153ed0 0x7fb8b80acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:20.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.953+0000 7fb8b6ffd700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8b8066ae0 0x7fb8b81505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:20.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.953+0000 7fb8b77fe700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b8150ad0 0x7fb8b80ad100 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7fb8b80c3470 tx=0x7fb8b0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:20.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.953+0000 7fb8af7fe700 1 -- 172.21.15.72:0/1996972764 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b001d630 con 0x7fb8b8150ad0 2023-08-31T19:06:20.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.953+0000 7fb8af7fe700 1 -- 172.21.15.72:0/1996972764 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b001d790 con 0x7fb8b8150ad0 2023-08-31T19:06:20.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.953+0000 7fb8bd9ff700 1 -- 172.21.15.72:0/1996972764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b80c2770 con 0x7fb8b8150ad0 2023-08-31T19:06:20.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.953+0000 7fb8af7fe700 1 -- 172.21.15.72:0/1996972764 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b001db10 con 0x7fb8b8150ad0 2023-08-31T19:06:20.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.953+0000 7fb8bd9ff700 1 -- 172.21.15.72:0/1996972764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b80c1c60 con 0x7fb8b8150ad0 2023-08-31T19:06:20.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.955+0000 7fb8bd9ff700 1 -- 172.21.15.72:0/1996972764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b80c2ae0 con 0x7fb8b8150ad0 2023-08-31T19:06:20.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.955+0000 7fb8af7fe700 1 -- 172.21.15.72:0/1996972764 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb8b0026410 con 0x7fb8b8150ad0 2023-08-31T19:06:20.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.956+0000 7fb8af7fe700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb89805ef30 0x7fb8980613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:20.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.956+0000 7fb8af7fe700 1 -- 172.21.15.72:0/1996972764 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7fb8b007bfd0 con 0x7fb8b8150ad0 2023-08-31T19:06:20.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.956+0000 7fb8b6ffd700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb89805ef30 0x7fb8980613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:20.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.957+0000 7fb8b6ffd700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb89805ef30 0x7fb8980613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb8a8005750 tx=0x7fb8a8009040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:20.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:20.960+0000 7fb8af7fe700 1 -- 172.21.15.72:0/1996972764 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb8b004cf40 con 0x7fb8b8150ad0 2023-08-31T19:06:21.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.203+0000 7fb8bd9ff700 1 -- 172.21.15.72:0/1996972764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb8b8154800 con 0x7fb8b8150ad0 2023-08-31T19:06:21.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.207+0000 7fb8af7fe700 1 -- 172.21.15.72:0/1996972764 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb8b8154800 con 0x7fb8b8150ad0 2023-08-31T19:06:21.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.209+0000 7fb8bd9ff700 1 -- 172.21.15.72:0/1996972764 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb89805ef30 msgr2=0x7fb8980613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:21.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.209+0000 7fb8bd9ff700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb89805ef30 0x7fb8980613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb8a8005750 tx=0x7fb8a8009040).stop 2023-08-31T19:06:21.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.209+0000 7fb8bd9ff700 1 -- 172.21.15.72:0/1996972764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b8150ad0 msgr2=0x7fb8b80ad100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:21.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.209+0000 7fb8bd9ff700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b8150ad0 0x7fb8b80ad100 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7fb8b80c3470 tx=0x7fb8b0009780).stop 2023-08-31T19:06:21.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.209+0000 7fb8bd9ff700 1 -- 172.21.15.72:0/1996972764 shutdown_connections 2023-08-31T19:06:21.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.209+0000 7fb8bd9ff700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8b8150ad0 0x7fb8b80ad100 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:21.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.209+0000 7fb8bd9ff700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb89805ef30 0x7fb8980613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:21.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.209+0000 7fb8bd9ff700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8b8066ae0 0x7fb8b81505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:21.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.209+0000 7fb8bd9ff700 1 --2- 172.21.15.72:0/1996972764 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb8b8153ed0 0x7fb8b80acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:21.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.209+0000 7fb8bd9ff700 1 -- 172.21.15.72:0/1996972764 >> 172.21.15.72:0/1996972764 conn(0x7fb8b805eb60 msgr2=0x7fb8b815a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:21.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.209+0000 7fb8bd9ff700 1 -- 172.21.15.72:0/1996972764 shutdown_connections 2023-08-31T19:06:21.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.210+0000 7fb8bd9ff700 1 -- 172.21.15.72:0/1996972764 wait complete. 2023-08-31T19:06:21.213 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-08-31T19:06:21.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:06:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.415+0000 7f1338dff700 1 Processor -- start 2023-08-31T19:06:21.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.416+0000 7f1338dff700 1 -- start start 2023-08-31T19:06:21.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.417+0000 7f1338dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1334154220 0x7f1334157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:21.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.417+0000 7f1338dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13341588d0 0x7f13340c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.417+0000 7f1338dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13340c8c90 con 0x7f13340cb940 2023-08-31T19:06:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.417+0000 7f1338dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13340aa700 con 0x7f1334154220 2023-08-31T19:06:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.417+0000 7f1338dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13340c5e10 con 0x7f13341588d0 2023-08-31T19:06:21.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.417+0000 7f133259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1334154220 0x7f1334157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:21.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.417+0000 7f133259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1334154220 0x7f1334157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58592/0 (socket says 172.21.15.72:58592) 2023-08-31T19:06:21.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.417+0000 7f1331d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f13340cb940 0x7f13341581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50060/0 (socket says 172.21.15.72:50060) 2023-08-31T19:06:21.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.417+0000 7f133259c700 1 -- 172.21.15.72:0/1547868443 learned_addr learned my addr 172.21.15.72:0/1547868443 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:21.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.417+0000 7f1332d9d700 1 --2- 172.21.15.72:0/1547868443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13341588d0 0x7f13340c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:21.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.418+0000 7f133259c700 1 -- 172.21.15.72:0/1547868443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13341588d0 msgr2=0x7f13340c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:21.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.418+0000 7f133259c700 1 --2- 172.21.15.72:0/1547868443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13341588d0 0x7f13340c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:21.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.418+0000 7f133259c700 1 -- 172.21.15.72:0/1547868443 >> v1:172.21.15.72:6789/0 conn(0x7f13340cb940 legacy=0x7f13341581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:21.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.418+0000 7f133159a700 1 -- 172.21.15.72:0/1547868443 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917992267 0 0) 0x7f13340c8c90 con 0x7f13340cb940 2023-08-31T19:06:21.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.418+0000 7f133259c700 1 -- 172.21.15.72:0/1547868443 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1334155610 con 0x7f1334154220 2023-08-31T19:06:21.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.418+0000 7f133259c700 1 --2- 172.21.15.72:0/1547868443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1334154220 0x7f1334157cd0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f1324009810 tx=0x7f1324009060).ready entity=mon.0 client_cookie=1295af76f80ef21d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:21.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.418+0000 7f133159a700 1 -- 172.21.15.72:0/1547868443 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324005880 con 0x7f1334154220 2023-08-31T19:06:21.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.418+0000 7f133159a700 1 -- 172.21.15.72:0/1547868443 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13240059e0 con 0x7f1334154220 2023-08-31T19:06:21.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.418+0000 7f133159a700 1 -- 172.21.15.72:0/1547868443 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324005d60 con 0x7f1334154220 2023-08-31T19:06:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.419+0000 7f1338dff700 1 -- 172.21.15.72:0/1547868443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1334154220 msgr2=0x7f1334157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.419+0000 7f1338dff700 1 --2- 172.21.15.72:0/1547868443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1334154220 0x7f1334157cd0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f1324009810 tx=0x7f1324009060).stop 2023-08-31T19:06:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.419+0000 7f1338dff700 1 -- 172.21.15.72:0/1547868443 shutdown_connections 2023-08-31T19:06:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.419+0000 7f1338dff700 1 --2- 172.21.15.72:0/1547868443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1334154220 0x7f1334157cd0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.419+0000 7f1338dff700 1 --2- 172.21.15.72:0/1547868443 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13341588d0 0x7f13340c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.419+0000 7f1338dff700 1 -- 172.21.15.72:0/1547868443 >> 172.21.15.72:0/1547868443 conn(0x7f133405e870 msgr2=0x7f13340cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.419+0000 7f1338dff700 1 -- 172.21.15.72:0/1547868443 shutdown_connections 2023-08-31T19:06:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.419+0000 7f1338dff700 1 -- 172.21.15.72:0/1547868443 wait complete. 2023-08-31T19:06:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.420+0000 7f1338dff700 1 Processor -- start 2023-08-31T19:06:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.420+0000 7f1338dff700 1 -- start start 2023-08-31T19:06:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.421+0000 7f1338dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13340cb940 0x7f13340aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.421+0000 7f1338dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1334154220 0x7f13340ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.421+0000 7f1338dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13341588d0 0x7f133414fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:21.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.421+0000 7f1338dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13340aae10 con 0x7f13341588d0 2023-08-31T19:06:21.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.421+0000 7f1338dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13340ab0f0 con 0x7f13340cb940 2023-08-31T19:06:21.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.421+0000 7f1338dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13340ab3d0 con 0x7f1334154220 2023-08-31T19:06:21.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.421+0000 7f1332d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13341588d0 0x7f133414fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:21.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.422+0000 7f1332d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13341588d0 0x7f133414fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58598/0 (socket says 172.21.15.72:58598) 2023-08-31T19:06:21.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.422+0000 7f1332d9d700 1 -- 172.21.15.72:0/2838379520 learned_addr learned my addr 172.21.15.72:0/2838379520 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:21.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.422+0000 7f1331d9b700 1 --2- 172.21.15.72:0/2838379520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1334154220 0x7f13340ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:21.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.422+0000 7f133259c700 1 --2- 172.21.15.72:0/2838379520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13340cb940 0x7f13340aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:21.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.422+0000 7f1332d9d700 1 -- 172.21.15.72:0/2838379520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1334154220 msgr2=0x7f13340ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:21.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.422+0000 7f1332d9d700 1 --2- 172.21.15.72:0/2838379520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1334154220 0x7f13340ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:21.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.422+0000 7f1332d9d700 1 -- 172.21.15.72:0/2838379520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13340cb940 msgr2=0x7f13340aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:21.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.422+0000 7f1332d9d700 1 --2- 172.21.15.72:0/2838379520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13340cb940 0x7f13340aa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:21.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.422+0000 7f1332d9d700 1 -- 172.21.15.72:0/2838379520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1324009300 con 0x7f13341588d0 2023-08-31T19:06:21.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.422+0000 7f133259c700 1 --2- 172.21.15.72:0/2838379520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13340cb940 0x7f13340aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:21.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.422+0000 7f1332d9d700 1 --2- 172.21.15.72:0/2838379520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13341588d0 0x7f133414fdf0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f132c007f20 tx=0x7f132c009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:21.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.422+0000 7f13227fc700 1 -- 172.21.15.72:0/2838379520 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c00eca0 con 0x7f13341588d0 2023-08-31T19:06:21.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.422+0000 7f13227fc700 1 -- 172.21.15.72:0/2838379520 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c00ee00 con 0x7f13341588d0 2023-08-31T19:06:21.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.422+0000 7f13227fc700 1 -- 172.21.15.72:0/2838379520 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c014610 con 0x7f13341588d0 2023-08-31T19:06:21.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.422+0000 7f1338dff700 1 -- 172.21.15.72:0/2838379520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13340ab6b0 con 0x7f13341588d0 2023-08-31T19:06:21.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.423+0000 7f1338dff700 1 -- 172.21.15.72:0/2838379520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13340ad640 con 0x7f13341588d0 2023-08-31T19:06:21.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.423+0000 7f1338dff700 1 -- 172.21.15.72:0/2838379520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13340abbd0 con 0x7f13341588d0 2023-08-31T19:06:21.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.424+0000 7f13227fc700 1 -- 172.21.15.72:0/2838379520 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f132c014980 con 0x7f13341588d0 2023-08-31T19:06:21.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.425+0000 7f13227fc700 1 --2- 172.21.15.72:0/2838379520 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f131405ef30 0x7f13140613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:21.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.425+0000 7f13227fc700 1 -- 172.21.15.72:0/2838379520 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f132c07a7b0 con 0x7f13341588d0 2023-08-31T19:06:21.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.425+0000 7f133259c700 1 --2- 172.21.15.72:0/2838379520 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f131405ef30 0x7f13140613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:21.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.426+0000 7f133259c700 1 --2- 172.21.15.72:0/2838379520 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f131405ef30 0x7f13140613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1334152e60 tx=0x7f1324016000).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:21.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.429+0000 7f13227fc700 1 -- 172.21.15.72:0/2838379520 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f13340abbd0 con 0x7f13341588d0 2023-08-31T19:06:21.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.635+0000 7f1338dff700 1 -- 172.21.15.72:0/2838379520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13340abbd0 con 0x7f13341588d0 2023-08-31T19:06:21.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.636+0000 7f13227fc700 1 -- 172.21.15.72:0/2838379520 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f13340abbd0 con 0x7f13341588d0 2023-08-31T19:06:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:06:21.637 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2018270382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2018270382},{"type":"v1","addr":"172.21.15.72:6837","nonce":2018270382}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2754540175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2754540175},{"type":"v1","addr":"172.21.15.146:6835","nonce":2754540175}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":7042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/488665385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":488665385},{"type":"v1","addr":"172.21.15.146:6834","nonce":488665385}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:06:15.992239+0000","modified":"2023-08-31T19:06:19.009090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7590},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7590":{"gid":7590,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6835/2456627257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2456627257},{"type":"v1","addr":"172.21.15.72:6835","nonce":2456627257}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-31T19:06:21.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.638+0000 7f1338dff700 1 -- 172.21.15.72:0/2838379520 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f131405ef30 msgr2=0x7f13140613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:21.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.638+0000 7f1338dff700 1 --2- 172.21.15.72:0/2838379520 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f131405ef30 0x7f13140613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1334152e60 tx=0x7f1324016000).stop 2023-08-31T19:06:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.638+0000 7f1338dff700 1 -- 172.21.15.72:0/2838379520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13341588d0 msgr2=0x7f133414fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.638+0000 7f1338dff700 1 --2- 172.21.15.72:0/2838379520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13341588d0 0x7f133414fdf0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f132c007f20 tx=0x7f132c009860).stop 2023-08-31T19:06:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.638+0000 7f1338dff700 1 -- 172.21.15.72:0/2838379520 shutdown_connections 2023-08-31T19:06:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.638+0000 7f1338dff700 1 --2- 172.21.15.72:0/2838379520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13341588d0 0x7f133414fdf0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:21.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.638+0000 7f1338dff700 1 --2- 172.21.15.72:0/2838379520 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f131405ef30 0x7f13140613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.638+0000 7f1338dff700 1 --2- 172.21.15.72:0/2838379520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13340cb940 0x7f13340aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.638+0000 7f1338dff700 1 --2- 172.21.15.72:0/2838379520 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1334154220 0x7f13340ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.638+0000 7f1338dff700 1 -- 172.21.15.72:0/2838379520 >> 172.21.15.72:0/2838379520 conn(0x7f133405e870 msgr2=0x7f13340a7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.638+0000 7f1338dff700 1 -- 172.21.15.72:0/2838379520 shutdown_connections 2023-08-31T19:06:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:21.638+0000 7f1338dff700 1 -- 172.21.15.72:0/2838379520 wait complete. 2023-08-31T19:06:21.641 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 56 2023-08-31T19:06:22.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T19:06:15.992239+0000', 'modified': '2023-08-31T19:06:19.009090+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7590}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7590': {'gid': 7590, 'name': 'a', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6835/2456627257', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6834', 'nonce': 2456627257}, {'type': 'v1', 'addr': '172.21.15.72:6835', 'nonce': 2456627257}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-31T19:06:22.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T19:06:22.060 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-31T19:06:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.250+0000 7f9d097ff700 1 Processor -- start 2023-08-31T19:06:22.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.250+0000 7f9d097ff700 1 -- start start 2023-08-31T19:06:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.251+0000 7f9d097ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d040ad510 0x7f9d040c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.251+0000 7f9d097ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d040c6220 0x7f9d040c09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.251+0000 7f9d097ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9d040c0ea0 0x7f9d04064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.251+0000 7f9d097ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d04154530 con 0x7f9d040c6220 2023-08-31T19:06:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.251+0000 7f9d097ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d040ab290 con 0x7f9d040c0ea0 2023-08-31T19:06:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.251+0000 7f9d097ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040c1680 con 0x7f9d040ad510 2023-08-31T19:06:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.252+0000 7f9d027fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d040c6220 0x7f9d040c09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.252+0000 7f9d027fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d040c6220 0x7f9d040c09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58614/0 (socket says 172.21.15.72:58614) 2023-08-31T19:06:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.252+0000 7f9d027fc700 1 -- 172.21.15.72:0/2781966332 learned_addr learned my addr 172.21.15.72:0/2781966332 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.252+0000 7f9d02ffd700 1 --2- 172.21.15.72:0/2781966332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d040ad510 0x7f9d040c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.252+0000 7f9d037fe700 1 --2- 172.21.15.72:0/2781966332 >> v2:172.21.15.146:3300/0 conn(0x7f9d040c0ea0 0x7f9d04064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.252+0000 7f9d027fc700 1 -- 172.21.15.72:0/2781966332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d040ad510 msgr2=0x7f9d040c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.252+0000 7f9d027fc700 1 --2- 172.21.15.72:0/2781966332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d040ad510 0x7f9d040c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.252+0000 7f9d027fc700 1 -- 172.21.15.72:0/2781966332 >> v2:172.21.15.146:3300/0 conn(0x7f9d040c0ea0 msgr2=0x7f9d04064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.252+0000 7f9d027fc700 1 --2- 172.21.15.72:0/2781966332 >> v2:172.21.15.146:3300/0 conn(0x7f9d040c0ea0 0x7f9d04064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.252+0000 7f9d027fc700 1 -- 172.21.15.72:0/2781966332 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d040c1c20 con 0x7f9d040c6220 2023-08-31T19:06:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.252+0000 7f9d027fc700 1 --2- 172.21.15.72:0/2781966332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d040c6220 0x7f9d040c09b0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f9d04084570 tx=0x7f9cf80090f0).ready entity=mon.0 client_cookie=e3156d0a1b015df5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.253+0000 7f9d01ffb700 1 -- 172.21.15.72:0/2781966332 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800b600 con 0x7f9d040c6220 2023-08-31T19:06:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.253+0000 7f9d01ffb700 1 -- 172.21.15.72:0/2781966332 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf800b760 con 0x7f9d040c6220 2023-08-31T19:06:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.253+0000 7f9d01ffb700 1 -- 172.21.15.72:0/2781966332 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800bae0 con 0x7f9d040c6220 2023-08-31T19:06:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.253+0000 7f9d097ff700 1 -- 172.21.15.72:0/2781966332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d040c6220 msgr2=0x7f9d040c09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.253+0000 7f9d097ff700 1 --2- 172.21.15.72:0/2781966332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d040c6220 0x7f9d040c09b0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f9d04084570 tx=0x7f9cf80090f0).stop 2023-08-31T19:06:22.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.253+0000 7f9d097ff700 1 -- 172.21.15.72:0/2781966332 shutdown_connections 2023-08-31T19:06:22.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.253+0000 7f9d097ff700 1 --2- 172.21.15.72:0/2781966332 >> v2:172.21.15.146:3300/0 conn(0x7f9d040c0ea0 0x7f9d04064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.253+0000 7f9d097ff700 1 --2- 172.21.15.72:0/2781966332 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d040ad510 0x7f9d040c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.253+0000 7f9d097ff700 1 --2- 172.21.15.72:0/2781966332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d040c6220 0x7f9d040c09b0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.253+0000 7f9d097ff700 1 -- 172.21.15.72:0/2781966332 >> 172.21.15.72:0/2781966332 conn(0x7f9d0405eb60 msgr2=0x7f9d040cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:22.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.253+0000 7f9d097ff700 1 -- 172.21.15.72:0/2781966332 shutdown_connections 2023-08-31T19:06:22.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.253+0000 7f9d097ff700 1 -- 172.21.15.72:0/2781966332 wait complete. 2023-08-31T19:06:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.255+0000 7f9d097ff700 1 Processor -- start 2023-08-31T19:06:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.255+0000 7f9d097ff700 1 -- start start 2023-08-31T19:06:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.256+0000 7f9d097ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d040ad510 0x7f9d04152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.256+0000 7f9d097ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d040c0ea0 0x7f9d040b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.256+0000 7f9d097ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d040c6220 0x7f9d040b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.256+0000 7f9d097ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040aeba0 con 0x7f9d040c0ea0 2023-08-31T19:06:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.256+0000 7f9d097ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040b0a40 con 0x7f9d040ad510 2023-08-31T19:06:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.256+0000 7f9d097ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d04152cf0 con 0x7f9d040c6220 2023-08-31T19:06:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.256+0000 7f9d027fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d040c0ea0 0x7f9d040b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.256+0000 7f9d027fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d040c0ea0 0x7f9d040b0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58618/0 (socket says 172.21.15.72:58618) 2023-08-31T19:06:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.256+0000 7f9d027fc700 1 -- 172.21.15.72:0/2775654710 learned_addr learned my addr 172.21.15.72:0/2775654710 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.256+0000 7f9d02ffd700 1 --2- 172.21.15.72:0/2775654710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d040ad510 0x7f9d04152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.256+0000 7f9d037fe700 1 --2- 172.21.15.72:0/2775654710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d040c6220 0x7f9d040b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.257+0000 7f9d027fc700 1 -- 172.21.15.72:0/2775654710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d040c6220 msgr2=0x7f9d040b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.257+0000 7f9d027fc700 1 --2- 172.21.15.72:0/2775654710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d040c6220 0x7f9d040b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.257+0000 7f9d027fc700 1 -- 172.21.15.72:0/2775654710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d040ad510 msgr2=0x7f9d04152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.257+0000 7f9d027fc700 1 --2- 172.21.15.72:0/2775654710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d040ad510 0x7f9d04152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.257+0000 7f9d027fc700 1 -- 172.21.15.72:0/2775654710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf8009370 con 0x7f9d040c0ea0 2023-08-31T19:06:22.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.257+0000 7f9d027fc700 1 --2- 172.21.15.72:0/2775654710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d040c0ea0 0x7f9d040b0060 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f9cf8009130 tx=0x7f9cf8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:22.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.257+0000 7f9ceaffd700 1 -- 172.21.15.72:0/2775654710 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800bea0 con 0x7f9d040c0ea0 2023-08-31T19:06:22.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.257+0000 7f9ceaffd700 1 -- 172.21.15.72:0/2775654710 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf800b8d0 con 0x7f9d040c0ea0 2023-08-31T19:06:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.257+0000 7f9ceaffd700 1 -- 172.21.15.72:0/2775654710 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf801c670 con 0x7f9d040c0ea0 2023-08-31T19:06:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.257+0000 7f9d097ff700 1 -- 172.21.15.72:0/2775654710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d040adf20 con 0x7f9d040c0ea0 2023-08-31T19:06:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.257+0000 7f9d097ff700 1 -- 172.21.15.72:0/2775654710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d040ae4e0 con 0x7f9d040c0ea0 2023-08-31T19:06:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.259+0000 7f9ceaffd700 1 -- 172.21.15.72:0/2775654710 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9cf801c9e0 con 0x7f9d040c0ea0 2023-08-31T19:06:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.260+0000 7f9ceaffd700 1 --2- 172.21.15.72:0/2775654710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cf005ef30 0x7f9cf00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.260+0000 7f9ceaffd700 1 -- 172.21.15.72:0/2775654710 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f9cf807bf90 con 0x7f9d040c0ea0 2023-08-31T19:06:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.260+0000 7f9d02ffd700 1 --2- 172.21.15.72:0/2775654710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cf005ef30 0x7f9cf00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.261+0000 7f9d02ffd700 1 --2- 172.21.15.72:0/2775654710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cf005ef30 0x7f9cf00613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f9cf400bb10 tx=0x7f9cf4008040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:22.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.262+0000 7f9d20b15b80 1 Processor -- start 2023-08-31T19:06:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.262+0000 7f9d20b15b80 1 -- start start 2023-08-31T19:06:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.263+0000 7f9d20b15b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2f682c0 0x557ad2f686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.263+0000 7f9d20b15b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2fb0f60 0x557ad2f63600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.263+0000 7f9d20b15b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f63af0 0x557ad2f63f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.263+0000 7f9d20b15b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ad2ea4db0 con 0x557ad2f63af0 2023-08-31T19:06:22.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.263+0000 7f9d20b15b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ad2eba030 con 0x557ad2f682c0 2023-08-31T19:06:22.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.263+0000 7f9d20b15b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ad2eba170 con 0x557ad2fb0f60 2023-08-31T19:06:22.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.264+0000 7f9d037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f63af0 0x557ad2f63f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.264+0000 7f9d037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f63af0 0x557ad2f63f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58624/0 (socket says 172.21.15.72:58624) 2023-08-31T19:06:22.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.264+0000 7f9d037fe700 1 -- 172.21.15.72:0/2692186477 learned_addr learned my addr 172.21.15.72:0/2692186477 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:22.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.264+0000 7f9d027fc700 1 --2- 172.21.15.72:0/2692186477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2fb0f60 0x557ad2f63600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.264+0000 7f9d02ffd700 1 --2- 172.21.15.72:0/2692186477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2f682c0 0x557ad2f686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.264+0000 7f9d037fe700 1 -- 172.21.15.72:0/2692186477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2fb0f60 msgr2=0x557ad2f63600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:22.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.264+0000 7f9d037fe700 1 --2- 172.21.15.72:0/2692186477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2fb0f60 0x557ad2f63600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.264+0000 7f9d037fe700 1 -- 172.21.15.72:0/2692186477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2f682c0 msgr2=0x557ad2f686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:22.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.264+0000 7f9d037fe700 1 --2- 172.21.15.72:0/2692186477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2f682c0 0x557ad2f686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.264+0000 7f9d037fe700 1 -- 172.21.15.72:0/2692186477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ad2e8cb00 con 0x557ad2f63af0 2023-08-31T19:06:22.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.264+0000 7f9d037fe700 1 --2- 172.21.15.72:0/2692186477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f63af0 0x557ad2f63f70 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f9cfc007370 tx=0x7f9cfc0097b0).ready entity=mon.0 client_cookie=5a903588f915f818 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:22.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.264+0000 7f9ce3fff700 1 -- 172.21.15.72:0/2692186477 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc009cc0 con 0x557ad2f63af0 2023-08-31T19:06:22.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.264+0000 7f9ce3fff700 1 -- 172.21.15.72:0/2692186477 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc016430 con 0x557ad2f63af0 2023-08-31T19:06:22.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.264+0000 7f9ce3fff700 1 -- 172.21.15.72:0/2692186477 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0167b0 con 0x557ad2f63af0 2023-08-31T19:06:22.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.265+0000 7f9d20b15b80 1 -- 172.21.15.72:0/2692186477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f63af0 msgr2=0x557ad2f63f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.265+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/2692186477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f63af0 0x557ad2f63f70 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f9cfc007370 tx=0x7f9cfc0097b0).stop 2023-08-31T19:06:22.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.265+0000 7f9d20b15b80 1 -- 172.21.15.72:0/2692186477 shutdown_connections 2023-08-31T19:06:22.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.265+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/2692186477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f63af0 0x557ad2f63f70 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.265+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/2692186477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2f682c0 0x557ad2f686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.265+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/2692186477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2fb0f60 0x557ad2f63600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.265+0000 7f9d20b15b80 1 -- 172.21.15.72:0/2692186477 >> 172.21.15.72:0/2692186477 conn(0x557ad2dd2940 msgr2=0x557ad2fb13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:22.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.265+0000 7f9d20b15b80 1 -- 172.21.15.72:0/2692186477 shutdown_connections 2023-08-31T19:06:22.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.265+0000 7f9d20b15b80 1 -- 172.21.15.72:0/2692186477 wait complete. 2023-08-31T19:06:22.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.266+0000 7f9d20b15b80 1 -- start start 2023-08-31T19:06:22.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.266+0000 7f9d20b15b80 1 Processor -- start 2023-08-31T19:06:22.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.267+0000 7f9d20b15b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2f63af0 0x557ad2f943a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.267+0000 7f9d20b15b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f682c0 0x557ad2fbcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.267+0000 7f9d20b15b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2fb0f60 0x557ad2fbd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.267+0000 7f9d20b15b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ad2eba3f0 con 0x557ad2f682c0 2023-08-31T19:06:22.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.267+0000 7f9d20b15b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ad2e85920 con 0x557ad2f63af0 2023-08-31T19:06:22.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.267+0000 7f9d20b15b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ad2f974b0 con 0x557ad2fb0f60 2023-08-31T19:06:22.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.267+0000 7f9d20b15b80 10 client.0 ll_register_callbacks cb 0x557ad2e5ace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:06:22.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.267+0000 7f9d027fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f682c0 0x557ad2fbcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.267+0000 7f9d027fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f682c0 0x557ad2fbcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58638/0 (socket says 172.21.15.72:58638) 2023-08-31T19:06:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.268+0000 7f9d027fc700 1 -- 172.21.15.72:0/1335773657 learned_addr learned my addr 172.21.15.72:0/1335773657 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.268+0000 7f9d027fc700 1 -- 172.21.15.72:0/1335773657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2fb0f60 msgr2=0x557ad2fbd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.268+0000 7f9d027fc700 1 --2- 172.21.15.72:0/1335773657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2fb0f60 0x557ad2fbd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:22.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.268+0000 7f9d027fc700 1 -- 172.21.15.72:0/1335773657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2f63af0 msgr2=0x557ad2f943a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:22.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.268+0000 7f9d027fc700 1 --2- 172.21.15.72:0/1335773657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2f63af0 0x557ad2f943a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:22.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.268+0000 7f9d027fc700 1 -- 172.21.15.72:0/1335773657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc011040 con 0x557ad2f682c0 2023-08-31T19:06:22.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.268+0000 7f9d027fc700 1 --2- 172.21.15.72:0/1335773657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f682c0 0x557ad2fbcf30 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f9cf804d120 tx=0x7f9cf800e000).ready entity=mon.0 client_cookie=31925d43ba0977ce server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:22.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.268+0000 7f9ce17fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:06:22.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.268+0000 7f9ce17fa700 1 -- 172.21.15.72:0/1335773657 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80562f0 con 0x557ad2f682c0 2023-08-31T19:06:22.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.268+0000 7f9ce17fa700 1 -- 172.21.15.72:0/1335773657 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f9cf804d330 con 0x557ad2f682c0 2023-08-31T19:06:22.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.268+0000 7f9d20b15b80 1 -- 172.21.15.72:0/1335773657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ad2f62aa0 con 0x557ad2f682c0 2023-08-31T19:06:22.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.268+0000 7f9ce17fa700 1 -- 172.21.15.72:0/1335773657 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cf801cea0 con 0x557ad2f682c0 2023-08-31T19:06:22.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.268+0000 7f9d20b15b80 10 client.7734 fetch_fsmap learned FSMap version 56 2023-08-31T19:06:22.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.268+0000 7f9d20b15b80 1 -- 172.21.15.72:0/1335773657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x557ad2eb2f70 con 0x557ad2f682c0 2023-08-31T19:06:22.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.269+0000 7f9ce17fa700 1 -- 172.21.15.72:0/1335773657 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ad2f62aa0 con 0x557ad2f682c0 2023-08-31T19:06:22.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.269+0000 7f9ce17fa700 1 -- 172.21.15.72:0/1335773657 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9cf8050110 con 0x557ad2f682c0 2023-08-31T19:06:22.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.269+0000 7f9d20b15b80 10 client.7734 fetch_fsmap finished waiting for FSMap version 56 2023-08-31T19:06:22.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.269+0000 7f9d20b15b80 10 client.7734 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:06:22.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.269+0000 7f9d20b15b80 20 client.7734 populate_metadata read hostname 'smithi072' 2023-08-31T19:06:22.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.269+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/1335773657 >> [v2:172.21.15.72:6834/2456627257,v1:172.21.15.72:6835/2456627257] conn(0x557ad2fc09d0 0x557ad2fc0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.269+0000 7f9d20b15b80 4 client.7734 mds_command: new command op to 7590 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T19:06:22.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.269+0000 7f9d20b15b80 1 -- 172.21.15.72:0/1335773657 --> [v2:172.21.15.72:6834/2456627257,v1:172.21.15.72:6835/2456627257] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ad2d22ef0 con 0x557ad2fc09d0 2023-08-31T19:06:22.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.269+0000 7f9d02ffd700 1 --2- 172.21.15.72:0/1335773657 >> [v2:172.21.15.72:6834/2456627257,v1:172.21.15.72:6835/2456627257] conn(0x557ad2fc09d0 0x557ad2fc0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.269+0000 7f9ce17fa700 10 client.7734 ms_handle_connect on v2:172.21.15.72:6834/2456627257 2023-08-31T19:06:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.269+0000 7f9d02ffd700 1 --2- 172.21.15.72:0/1335773657 >> [v2:172.21.15.72:6834/2456627257,v1:172.21.15.72:6835/2456627257] conn(0x557ad2fc09d0 0x557ad2fc0db0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c04bf4da7443aac0 server_cookie=bc4fb6ffb9b2b45a in_seq=0 out_seq=0 2023-08-31T19:06:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.270+0000 7f9ce17fa700 1 -- 172.21.15.72:0/1335773657 <== mds.0 v2:172.21.15.72:6834/2456627257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x557ad2d22ef0 con 0x557ad2fc09d0 2023-08-31T19:06:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.270+0000 7f9ce17fa700 10 client.7734 handle_command_reply: tid=0 2023-08-31T19:06:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.270+0000 7f9d20b15b80 1 client.7734 shutdown 2023-08-31T19:06:22.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.271+0000 7f9d20b15b80 1 -- 172.21.15.72:0/1335773657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f682c0 msgr2=0x557ad2fbcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.271+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/1335773657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f682c0 0x557ad2fbcf30 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f9cf804d120 tx=0x7f9cf800e000).stop 2023-08-31T19:06:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.271+0000 7f9d20b15b80 1 -- 172.21.15.72:0/1335773657 shutdown_connections 2023-08-31T19:06:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.271+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/1335773657 >> [v2:172.21.15.72:6834/2456627257,v1:172.21.15.72:6835/2456627257] conn(0x557ad2fc09d0 0x557ad2fc0db0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.271+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/1335773657 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2fb0f60 0x557ad2fbd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:22.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.271+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/1335773657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2f63af0 0x557ad2f943a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.271+0000 7f9ce17fa700 0 client.7734 ms_handle_reset on v2:172.21.15.72:6834/2456627257 2023-08-31T19:06:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.271+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/1335773657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f682c0 0x557ad2fbcf30 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.271+0000 7f9d20b15b80 1 -- 172.21.15.72:0/1335773657 >> 172.21.15.72:0/1335773657 conn(0x557ad2dd2940 msgr2=0x557ad2f66330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.271+0000 7f9d20b15b80 1 -- 172.21.15.72:0/1335773657 shutdown_connections 2023-08-31T19:06:22.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.271+0000 7f9d20b15b80 1 -- 172.21.15.72:0/1335773657 wait complete. 2023-08-31T19:06:22.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.271+0000 7f9d20b15b80 20 client.7734 trim_cache size 0 max 16384 2023-08-31T19:06:22.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.288+0000 7f9d20b15b80 1 Processor -- start 2023-08-31T19:06:22.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.288+0000 7f9d20b15b80 1 -- start start 2023-08-31T19:06:22.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.289+0000 7f9d20b15b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2f63af0 0x557ad2fa7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.289+0000 7f9d20b15b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2f682c0 0x557ad2f686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.289+0000 7f9d20b15b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2fb0f60 0x557ad2f68b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.289+0000 7f9d20b15b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ad2f6af50 con 0x557ad2fb0f60 2023-08-31T19:06:22.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.289+0000 7f9d20b15b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ad2f69080 con 0x557ad2f682c0 2023-08-31T19:06:22.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.289+0000 7f9d20b15b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ad2f6a760 con 0x557ad2f63af0 2023-08-31T19:06:22.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.290+0000 7f9d037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2fb0f60 0x557ad2f68b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.290+0000 7f9d037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2fb0f60 0x557ad2f68b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58640/0 (socket says 172.21.15.72:58640) 2023-08-31T19:06:22.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.290+0000 7f9d037fe700 1 -- 172.21.15.72:0/543174554 learned_addr learned my addr 172.21.15.72:0/543174554 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:22.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.290+0000 7f9d02ffd700 1 --2- 172.21.15.72:0/543174554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2f63af0 0x557ad2fa7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.290+0000 7f9d027fc700 1 --2- 172.21.15.72:0/543174554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2f682c0 0x557ad2f686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.290+0000 7f9d037fe700 1 -- 172.21.15.72:0/543174554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2f63af0 msgr2=0x557ad2fa7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:22.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.290+0000 7f9d037fe700 1 --2- 172.21.15.72:0/543174554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2f63af0 0x557ad2fa7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.290+0000 7f9d037fe700 1 -- 172.21.15.72:0/543174554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2f682c0 msgr2=0x557ad2f686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:22.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.290+0000 7f9d037fe700 1 --2- 172.21.15.72:0/543174554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2f682c0 0x557ad2f686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.290+0000 7f9d037fe700 1 -- 172.21.15.72:0/543174554 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ad2eae580 con 0x557ad2fb0f60 2023-08-31T19:06:22.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.290+0000 7f9d02ffd700 1 --2- 172.21.15.72:0/543174554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2f63af0 0x557ad2fa7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:22.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.290+0000 7f9d037fe700 1 --2- 172.21.15.72:0/543174554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2fb0f60 0x557ad2f68b90 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x557ad2fb13c0 tx=0x7f9cfc01a000).ready entity=mon.0 client_cookie=d75897d595519198 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:22.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.290+0000 7f9ce8ff9700 1 -- 172.21.15.72:0/543174554 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc000f40 con 0x557ad2fb0f60 2023-08-31T19:06:22.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.290+0000 7f9ce8ff9700 1 -- 172.21.15.72:0/543174554 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc00d070 con 0x557ad2fb0f60 2023-08-31T19:06:22.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.290+0000 7f9ce8ff9700 1 -- 172.21.15.72:0/543174554 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc016b20 con 0x557ad2fb0f60 2023-08-31T19:06:22.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.291+0000 7f9d20b15b80 1 -- 172.21.15.72:0/543174554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2fb0f60 msgr2=0x557ad2f68b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.291+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/543174554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2fb0f60 0x557ad2f68b90 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x557ad2fb13c0 tx=0x7f9cfc01a000).stop 2023-08-31T19:06:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.291+0000 7f9d20b15b80 1 -- 172.21.15.72:0/543174554 shutdown_connections 2023-08-31T19:06:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.291+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/543174554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2fb0f60 0x557ad2f68b90 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.291+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/543174554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2f63af0 0x557ad2fa7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.291+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/543174554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2f682c0 0x557ad2f686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.291+0000 7f9d20b15b80 1 -- 172.21.15.72:0/543174554 >> 172.21.15.72:0/543174554 conn(0x557ad2dd2940 msgr2=0x557ad2fc6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.291+0000 7f9d20b15b80 1 -- 172.21.15.72:0/543174554 shutdown_connections 2023-08-31T19:06:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.291+0000 7f9d20b15b80 1 -- 172.21.15.72:0/543174554 wait complete. 2023-08-31T19:06:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.292+0000 7f9d20b15b80 1 -- start start 2023-08-31T19:06:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.292+0000 7f9d20b15b80 1 Processor -- start 2023-08-31T19:06:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d20b15b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2f63af0 0x557ad300fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d20b15b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f682c0 0x557ad2fac200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d20b15b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2fb0f60 0x557ad2fac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d20b15b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ad30131b0 con 0x557ad2f682c0 2023-08-31T19:06:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d20b15b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ad2fabce0 con 0x557ad2fb0f60 2023-08-31T19:06:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d20b15b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ad3013680 con 0x557ad2f63af0 2023-08-31T19:06:22.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d20b15b80 10 client.0 ll_register_callbacks cb 0x557ad2e5ace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:06:22.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d027fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f682c0 0x557ad2fac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d027fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f682c0 0x557ad2fac200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58656/0 (socket says 172.21.15.72:58656) 2023-08-31T19:06:22.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d027fc700 1 -- 172.21.15.72:0/2898419049 learned_addr learned my addr 172.21.15.72:0/2898419049 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:22.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d02ffd700 1 --2- 172.21.15.72:0/2898419049 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2f63af0 0x557ad300fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d027fc700 1 -- 172.21.15.72:0/2898419049 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2f63af0 msgr2=0x557ad300fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:22.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d027fc700 1 --2- 172.21.15.72:0/2898419049 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2f63af0 0x557ad300fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d027fc700 1 -- 172.21.15.72:0/2898419049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2fb0f60 msgr2=0x557ad2fac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:22.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d027fc700 1 --2- 172.21.15.72:0/2898419049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2fb0f60 0x557ad2fac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:22.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.293+0000 7f9d027fc700 1 -- 172.21.15.72:0/2898419049 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ad2e8cb00 con 0x557ad2f682c0 2023-08-31T19:06:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9d02ffd700 1 --2- 172.21.15.72:0/2898419049 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2f63af0 0x557ad300fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9d027fc700 1 --2- 172.21.15.72:0/2898419049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f682c0 0x557ad2fac200 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f9cf8050920 tx=0x7f9cf8031000).ready entity=mon.0 client_cookie=643e4be35ad8c7af server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9ce17fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:06:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9ce17fa700 1 -- 172.21.15.72:0/2898419049 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8050760 con 0x557ad2f682c0 2023-08-31T19:06:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9ce17fa700 1 -- 172.21.15.72:0/2898419049 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f9cf800ba40 con 0x557ad2f682c0 2023-08-31T19:06:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9d20b15b80 1 -- 172.21.15.72:0/2898419049 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9cfc016430 con 0x557ad2f682c0 2023-08-31T19:06:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9ce17fa700 1 -- 172.21.15.72:0/2898419049 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cf80562f0 con 0x557ad2f682c0 2023-08-31T19:06:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9d20b15b80 10 client.7740 fetch_fsmap learned FSMap version 56 2023-08-31T19:06:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9d20b15b80 1 -- 172.21.15.72:0/2898419049 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x557ad2eae2d0 con 0x557ad2f682c0 2023-08-31T19:06:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9ce17fa700 1 -- 172.21.15.72:0/2898419049 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc016430 con 0x557ad2f682c0 2023-08-31T19:06:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9ce17fa700 1 -- 172.21.15.72:0/2898419049 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9cf8050110 con 0x557ad2f682c0 2023-08-31T19:06:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9d20b15b80 10 client.7740 fetch_fsmap finished waiting for FSMap version 56 2023-08-31T19:06:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9d20b15b80 10 client.7740 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:06:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9d20b15b80 20 client.7740 populate_metadata read hostname 'smithi072' 2023-08-31T19:06:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/2898419049 >> [v2:172.21.15.72:6834/2456627257,v1:172.21.15.72:6835/2456627257] conn(0x557ad2fc9e20 0x557ad2f5ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9d20b15b80 4 client.7740 mds_command: new command op to 7590 tid=0[{"prefix": "status"}] 2023-08-31T19:06:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.294+0000 7f9d20b15b80 1 -- 172.21.15.72:0/2898419049 --> [v2:172.21.15.72:6834/2456627257,v1:172.21.15.72:6835/2456627257] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557ad2d58040 con 0x557ad2fc9e20 2023-08-31T19:06:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.295+0000 7f9d02ffd700 1 --2- 172.21.15.72:0/2898419049 >> [v2:172.21.15.72:6834/2456627257,v1:172.21.15.72:6835/2456627257] conn(0x557ad2fc9e20 0x557ad2f5ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.295+0000 7f9d02ffd700 1 --2- 172.21.15.72:0/2898419049 >> [v2:172.21.15.72:6834/2456627257,v1:172.21.15.72:6835/2456627257] conn(0x557ad2fc9e20 0x557ad2f5ecd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b3bfcd139b6507b4 server_cookie=d0aed3e348fa10cf in_seq=0 out_seq=0 2023-08-31T19:06:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.295+0000 7f9ce17fa700 10 client.7740 ms_handle_connect on v2:172.21.15.72:6834/2456627257 2023-08-31T19:06:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.295+0000 7f9ce17fa700 1 -- 172.21.15.72:0/2898419049 <== mds.0 v2:172.21.15.72:6834/2456627257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x557ad2d58040 con 0x557ad2fc9e20 2023-08-31T19:06:22.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.295+0000 7f9ce17fa700 10 client.7740 handle_command_reply: tid=0 2023-08-31T19:06:22.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.295+0000 7f9d20b15b80 1 client.7740 shutdown 2023-08-31T19:06:22.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.295+0000 7f9d20b15b80 1 -- 172.21.15.72:0/2898419049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f682c0 msgr2=0x557ad2fac200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.295+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/2898419049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f682c0 0x557ad2fac200 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f9cf8050920 tx=0x7f9cf8031000).stop 2023-08-31T19:06:22.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.295+0000 7f9d20b15b80 1 -- 172.21.15.72:0/2898419049 shutdown_connections 2023-08-31T19:06:22.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.295+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/2898419049 >> [v2:172.21.15.72:6834/2456627257,v1:172.21.15.72:6835/2456627257] conn(0x557ad2fc9e20 0x557ad2f5ecd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.295+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/2898419049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557ad2fb0f60 0x557ad2fac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:22.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.295+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/2898419049 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557ad2f63af0 0x557ad300fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.295+0000 7f9ce17fa700 0 client.7740 ms_handle_reset on v2:172.21.15.72:6834/2456627257 2023-08-31T19:06:22.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.295+0000 7f9d20b15b80 1 --2- 172.21.15.72:0/2898419049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ad2f682c0 0x557ad2fac200 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.295+0000 7f9d20b15b80 1 -- 172.21.15.72:0/2898419049 >> 172.21.15.72:0/2898419049 conn(0x557ad2dd2940 msgr2=0x557ad2f96390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:22.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.296+0000 7f9d20b15b80 1 -- 172.21.15.72:0/2898419049 shutdown_connections 2023-08-31T19:06:22.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.296+0000 7f9d20b15b80 1 -- 172.21.15.72:0/2898419049 wait complete. 2023-08-31T19:06:22.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.296+0000 7f9d20b15b80 20 client.7740 trim_cache size 0 max 16384 2023-08-31T19:06:22.315 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:06:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "acadb8ca-1685-49e1-a73f-5e9d14d95be9", 2023-08-31T19:06:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-08-31T19:06:22.315 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 7590, 2023-08-31T19:06:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-08-31T19:06:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-08-31T19:06:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-08-31T19:06:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 6.3017967050000001, 2023-08-31T19:06:22.316 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 56, 2023-08-31T19:06:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 126, 2023-08-31T19:06:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 126, 2023-08-31T19:06:22.317 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 12.137984526 2023-08-31T19:06:22.317 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:06:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.296+0000 7f9d097ff700 1 -- 172.21.15.72:0/2775654710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cf005ef30 msgr2=0x7f9cf00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.296+0000 7f9d097ff700 1 --2- 172.21.15.72:0/2775654710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cf005ef30 0x7f9cf00613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f9cf400bb10 tx=0x7f9cf4008040).stop 2023-08-31T19:06:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.296+0000 7f9d097ff700 1 -- 172.21.15.72:0/2775654710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d040c0ea0 msgr2=0x7f9d040b0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.296+0000 7f9d097ff700 1 --2- 172.21.15.72:0/2775654710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d040c0ea0 0x7f9d040b0060 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f9cf8009130 tx=0x7f9cf8017000).stop 2023-08-31T19:06:22.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.296+0000 7f9d097ff700 1 -- 172.21.15.72:0/2775654710 shutdown_connections 2023-08-31T19:06:22.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.296+0000 7f9d097ff700 1 --2- 172.21.15.72:0/2775654710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d040c6220 0x7f9d040b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.296+0000 7f9d097ff700 1 --2- 172.21.15.72:0/2775654710 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cf005ef30 0x7f9cf00613f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.296+0000 7f9d097ff700 1 --2- 172.21.15.72:0/2775654710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d040ad510 0x7f9d04152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.296+0000 7f9d097ff700 1 --2- 172.21.15.72:0/2775654710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d040c0ea0 0x7f9d040b0060 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.296+0000 7f9d097ff700 1 -- 172.21.15.72:0/2775654710 >> 172.21.15.72:0/2775654710 conn(0x7f9d0405eb60 msgr2=0x7f9d04152ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:22.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.297+0000 7f9d097ff700 1 -- 172.21.15.72:0/2775654710 shutdown_connections 2023-08-31T19:06:22.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.297+0000 7f9d097ff700 1 -- 172.21.15.72:0/2775654710 wait complete. 2023-08-31T19:06:22.321 DEBUG:teuthology.orchestra.run.smithi072:> ceph fs ls 2023-08-31T19:06:22.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.481+0000 7fe1647ff700 1 Processor -- start 2023-08-31T19:06:22.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.481+0000 7fe1647ff700 1 -- start start 2023-08-31T19:06:22.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.482+0000 7fe1647ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe15c154460 0x7fe15c0c1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.482+0000 7fe1647ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15c0ca080 con 0x7fe15c0ca510 2023-08-31T19:06:22.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.482+0000 7fe1647ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15c0c72d0 con 0x7fe15c0a8200 2023-08-31T19:06:22.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.482+0000 7fe1647ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15c0c9750 con 0x7fe15c154460 2023-08-31T19:06:22.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.482+0000 7fe16259b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe15c154460 0x7fe15c0c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.483+0000 7fe161d9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe15c0ca510 0x7fe15c0a7af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50066/0 (socket says 172.21.15.72:50066) 2023-08-31T19:06:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.483+0000 7fe161d9a700 1 -- 172.21.15.72:0/1061168283 learned_addr learned my addr 172.21.15.72:0/1061168283 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:22.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.483+0000 7fe16259b700 1 -- 172.21.15.72:0/1061168283 >> v1:172.21.15.146:6789/0 conn(0x7fe15c0a8200 legacy=0x7fe15c0c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.483+0000 7fe16259b700 1 -- 172.21.15.72:0/1061168283 >> v1:172.21.15.72:6789/0 conn(0x7fe15c0ca510 legacy=0x7fe15c0a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.483+0000 7fe16259b700 1 -- 172.21.15.72:0/1061168283 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c0c9a30 con 0x7fe15c154460 2023-08-31T19:06:22.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.483+0000 7fe161599700 1 -- 172.21.15.72:0/1061168283 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272965239 0 0) 0x7fe15c0ca080 con 0x7fe15c0ca510 2023-08-31T19:06:22.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.483+0000 7fe16259b700 1 --2- 172.21.15.72:0/1061168283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe15c154460 0x7fe15c0c1070 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7fe158006fd0 tx=0x7fe158006f40).ready entity=mon.0 client_cookie=b4a50ea2ae366a9b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.483+0000 7fe161599700 1 -- 172.21.15.72:0/1061168283 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158005880 con 0x7fe15c154460 2023-08-31T19:06:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.483+0000 7fe161599700 1 -- 172.21.15.72:0/1061168283 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1580059e0 con 0x7fe15c154460 2023-08-31T19:06:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.483+0000 7fe161599700 1 -- 172.21.15.72:0/1061168283 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158005d60 con 0x7fe15c154460 2023-08-31T19:06:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.484+0000 7fe1647ff700 1 -- 172.21.15.72:0/1061168283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe15c154460 msgr2=0x7fe15c0c1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.484+0000 7fe1647ff700 1 --2- 172.21.15.72:0/1061168283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe15c154460 0x7fe15c0c1070 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7fe158006fd0 tx=0x7fe158006f40).stop 2023-08-31T19:06:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.484+0000 7fe1647ff700 1 -- 172.21.15.72:0/1061168283 shutdown_connections 2023-08-31T19:06:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.484+0000 7fe1647ff700 1 --2- 172.21.15.72:0/1061168283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe15c154460 0x7fe15c0c1070 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.484+0000 7fe1647ff700 1 -- 172.21.15.72:0/1061168283 >> 172.21.15.72:0/1061168283 conn(0x7fe15c06a560 msgr2=0x7fe15c0cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:22.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.484+0000 7fe1647ff700 1 -- 172.21.15.72:0/1061168283 shutdown_connections 2023-08-31T19:06:22.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.484+0000 7fe1647ff700 1 -- 172.21.15.72:0/1061168283 wait complete. 2023-08-31T19:06:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.486+0000 7fe1647ff700 1 Processor -- start 2023-08-31T19:06:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.486+0000 7fe1647ff700 1 -- start start 2023-08-31T19:06:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.487+0000 7fe1647ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe15c0a8200 0x7fe15c150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.487+0000 7fe1647ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe15c0ca510 0x7fe15c1538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.487+0000 7fe1647ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe15c154460 0x7fe15c14bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.487+0000 7fe1647ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0abb00 con 0x7fe15c0ca510 2023-08-31T19:06:22.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.487+0000 7fe1647ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c1507d0 con 0x7fe15c0a8200 2023-08-31T19:06:22.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.487+0000 7fe1647ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c150ab0 con 0x7fe15c154460 2023-08-31T19:06:22.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.488+0000 7fe161d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe15c0ca510 0x7fe15c1538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.488+0000 7fe161d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe15c0ca510 0x7fe15c1538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58682/0 (socket says 172.21.15.72:58682) 2023-08-31T19:06:22.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.488+0000 7fe161d9a700 1 -- 172.21.15.72:0/241697642 learned_addr learned my addr 172.21.15.72:0/241697642 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:22.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.488+0000 7fe16259b700 1 --2- 172.21.15.72:0/241697642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe15c0a8200 0x7fe15c150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.488+0000 7fe161d9a700 1 -- 172.21.15.72:0/241697642 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe15c154460 msgr2=0x7fe15c14bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.488+0000 7fe161d9a700 1 --2- 172.21.15.72:0/241697642 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe15c154460 0x7fe15c14bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:22.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.488+0000 7fe161d9a700 1 -- 172.21.15.72:0/241697642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe15c0a8200 msgr2=0x7fe15c150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.488+0000 7fe161d9a700 1 --2- 172.21.15.72:0/241697642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe15c0a8200 0x7fe15c150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.488+0000 7fe161d9a700 1 -- 172.21.15.72:0/241697642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe158009250 con 0x7fe15c0ca510 2023-08-31T19:06:22.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.488+0000 7fe161d9a700 1 --2- 172.21.15.72:0/241697642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe15c0ca510 0x7fe15c1538c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7fe14c00c4c0 tx=0x7fe14c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:22.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.488+0000 7fe1527fc700 1 -- 172.21.15.72:0/241697642 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0072e0 con 0x7fe15c0ca510 2023-08-31T19:06:22.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.489+0000 7fe1527fc700 1 -- 172.21.15.72:0/241697642 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c007440 con 0x7fe15c0ca510 2023-08-31T19:06:22.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.489+0000 7fe1527fc700 1 -- 172.21.15.72:0/241697642 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0057a0 con 0x7fe15c0ca510 2023-08-31T19:06:22.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.489+0000 7fe1647ff700 1 -- 172.21.15.72:0/241697642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15c150d90 con 0x7fe15c0ca510 2023-08-31T19:06:22.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.489+0000 7fe1647ff700 1 -- 172.21.15.72:0/241697642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15c0c2ea0 con 0x7fe15c0ca510 2023-08-31T19:06:22.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.490+0000 7fe1647ff700 1 -- 172.21.15.72:0/241697642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15c047480 con 0x7fe15c0ca510 2023-08-31T19:06:22.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.490+0000 7fe1527fc700 1 -- 172.21.15.72:0/241697642 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe14c005b90 con 0x7fe15c0ca510 2023-08-31T19:06:22.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.492+0000 7fe1527fc700 1 --2- 172.21.15.72:0/241697642 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe14005ef30 0x7fe1400613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:22.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.492+0000 7fe1527fc700 1 -- 172.21.15.72:0/241697642 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7fe14c079a00 con 0x7fe15c0ca510 2023-08-31T19:06:22.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.492+0000 7fe16259b700 1 --2- 172.21.15.72:0/241697642 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe14005ef30 0x7fe1400613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:22.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.492+0000 7fe16259b700 1 --2- 172.21.15.72:0/241697642 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe14005ef30 0x7fe1400613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe158006fa0 tx=0x7fe158016000).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:22.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.496+0000 7fe1527fc700 1 -- 172.21.15.72:0/241697642 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe14c04a9d0 con 0x7fe15c0ca510 2023-08-31T19:06:22.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.708+0000 7fe1647ff700 1 -- 172.21.15.72:0/241697642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe15c0c9d10 con 0x7fe15c0ca510 2023-08-31T19:06:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.708+0000 7fe1527fc700 1 -- 172.21.15.72:0/241697642 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe14c04dff0 con 0x7fe15c0ca510 2023-08-31T19:06:22.709 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T19:06:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.710+0000 7fe1647ff700 1 -- 172.21.15.72:0/241697642 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe14005ef30 msgr2=0x7fe1400613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.710+0000 7fe1647ff700 1 --2- 172.21.15.72:0/241697642 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe14005ef30 0x7fe1400613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe158006fa0 tx=0x7fe158016000).stop 2023-08-31T19:06:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.710+0000 7fe1647ff700 1 -- 172.21.15.72:0/241697642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe15c0ca510 msgr2=0x7fe15c1538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.710+0000 7fe1647ff700 1 --2- 172.21.15.72:0/241697642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe15c0ca510 0x7fe15c1538c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7fe14c00c4c0 tx=0x7fe14c007c10).stop 2023-08-31T19:06:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.711+0000 7fe1647ff700 1 -- 172.21.15.72:0/241697642 shutdown_connections 2023-08-31T19:06:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.711+0000 7fe1647ff700 1 --2- 172.21.15.72:0/241697642 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe15c154460 0x7fe15c14bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.711+0000 7fe1647ff700 1 --2- 172.21.15.72:0/241697642 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe14005ef30 0x7fe1400613f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.711+0000 7fe1647ff700 1 --2- 172.21.15.72:0/241697642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe15c0a8200 0x7fe15c150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.711+0000 7fe1647ff700 1 --2- 172.21.15.72:0/241697642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe15c0ca510 0x7fe15c1538c0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.711+0000 7fe1647ff700 1 -- 172.21.15.72:0/241697642 >> 172.21.15.72:0/241697642 conn(0x7fe15c06a560 msgr2=0x7fe15c063440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.711+0000 7fe1647ff700 1 -- 172.21.15.72:0/241697642 shutdown_connections 2023-08-31T19:06:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:22.711+0000 7fe1647ff700 1 -- 172.21.15.72:0/241697642 wait complete. 2023-08-31T19:06:22.725 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-31T19:06:22.726 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:06:22.726 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-31T19:06:22.726 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T19:06:22.727 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T19:06:22.727 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-31T19:06:22.727 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-31T19:06:22.728 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:06:22.728 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:06:22.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:06:22.729 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-31T19:06:22.777 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:06:22.777 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:06:22.777 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:06:22.777 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:06:22.777 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-31T19:06:22.778 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:06:22.778 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:06:22.778 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:06:22.778 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-31T19:06:22.779 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:06:22.779 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:06:22.779 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-31T19:06:22.779 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:06:22.779 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:06:22.779 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:06:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:06:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:06:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 36894sec preferred_lft 36894sec 2023-08-31T19:06:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-31T19:06:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:06:22.781 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:06:22.781 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff 2023-08-31T19:06:22.781 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T19:06:22.781 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:06:22.781 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::7c68:c9ff:fe82:9771/64 scope link 2023-08-31T19:06:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:06:22.782 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:06:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e2:e1:71:f6:f6:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T19:06:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e0e1:71ff:fef6:f6fa/64 scope link 2023-08-31T19:06:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:06:22.783 INFO:teuthology.orchestra.run.smithi072.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:06:22.783 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T19:06:22.783 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::38f6:6ff:fe3c:1ef/64 scope link 2023-08-31T19:06:22.783 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:06:22.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:06:22.784 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:06:22.885 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-31T19:06:22.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:06:22.888 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-31T19:06:22.936 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-31T19:06:22.937 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:06:22.937 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:06:22.937 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:06:22.937 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:06:22.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:06:22.939 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T19:06:22.939 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T19:06:22.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:06:22.940 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:06:22.940 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:06:22.941 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T19:06:23.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:06:23.112 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T19:06:23.159 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T19:06:23.160 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T19:06:23.160 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:06:23.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:06:23.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-08-31T19:06:23.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:06:23.234 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-31T19:06:23.281 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-31T19:06:23.282 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:06:23.380 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:06:23.380 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:06:23.406 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:06:23.406 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:06:23.411 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-31T19:06:23.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:06:23.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T19:06:23.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-31T19:06:23.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.673+0000 7fe06c5ff700 1 Processor -- start 2023-08-31T19:06:23.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.673+0000 7fe06c5ff700 1 -- start start 2023-08-31T19:06:23.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe06c5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe064153ca0 0x7fe064154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:23.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe06c5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0640c8ee0 0x7fe064158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:23.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe06c5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0640ca4f0 0x7fe064063100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:23.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe06c5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0640c9450 con 0x7fe064153ca0 2023-08-31T19:06:23.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe06c5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0640c9730 con 0x7fe0640c8ee0 2023-08-31T19:06:23.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe06c5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640c9a10 con 0x7fe0640ca4f0 2023-08-31T19:06:23.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe06a39b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe064153ca0 0x7fe064154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:23.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe06a39b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe064153ca0 0x7fe064154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35858/0 (socket says 172.21.15.72:35858) 2023-08-31T19:06:23.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe06a39b700 1 -- 172.21.15.72:0/2469595912 learned_addr learned my addr 172.21.15.72:0/2469595912 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:23.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe06ab9c700 1 --2- 172.21.15.72:0/2469595912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0640ca4f0 0x7fe064063100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:23.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe06a39b700 1 -- 172.21.15.72:0/2469595912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0640ca4f0 msgr2=0x7fe064063100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:23.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe06a39b700 1 --2- 172.21.15.72:0/2469595912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0640ca4f0 0x7fe064063100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:23.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe069b9a700 1 --2- 172.21.15.72:0/2469595912 >> v2:172.21.15.146:3300/0 conn(0x7fe0640c8ee0 0x7fe064158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:23.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe06a39b700 1 -- 172.21.15.72:0/2469595912 >> v2:172.21.15.146:3300/0 conn(0x7fe0640c8ee0 msgr2=0x7fe064158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:23.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe06a39b700 1 --2- 172.21.15.72:0/2469595912 >> v2:172.21.15.146:3300/0 conn(0x7fe0640c8ee0 0x7fe064158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:23.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.675+0000 7fe06a39b700 1 -- 172.21.15.72:0/2469595912 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0640c9cf0 con 0x7fe064153ca0 2023-08-31T19:06:23.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.676+0000 7fe069b9a700 1 --2- 172.21.15.72:0/2469595912 >> v2:172.21.15.146:3300/0 conn(0x7fe0640c8ee0 0x7fe064158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:06:23.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.676+0000 7fe06a39b700 1 --2- 172.21.15.72:0/2469595912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe064153ca0 0x7fe064154080 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fe064065940 tx=0x7fe0600090f0).ready entity=mon.0 client_cookie=9ea67a3c8caefaea server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:23.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.676+0000 7fe069399700 1 -- 172.21.15.72:0/2469595912 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06000b600 con 0x7fe064153ca0 2023-08-31T19:06:23.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.676+0000 7fe069399700 1 -- 172.21.15.72:0/2469595912 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06000b760 con 0x7fe064153ca0 2023-08-31T19:06:23.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.676+0000 7fe069399700 1 -- 172.21.15.72:0/2469595912 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06000bae0 con 0x7fe064153ca0 2023-08-31T19:06:23.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.676+0000 7fe06c5ff700 1 -- 172.21.15.72:0/2469595912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe064153ca0 msgr2=0x7fe064154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:23.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.676+0000 7fe06c5ff700 1 --2- 172.21.15.72:0/2469595912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe064153ca0 0x7fe064154080 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fe064065940 tx=0x7fe0600090f0).stop 2023-08-31T19:06:23.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.676+0000 7fe06c5ff700 1 -- 172.21.15.72:0/2469595912 shutdown_connections 2023-08-31T19:06:23.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.676+0000 7fe06c5ff700 1 --2- 172.21.15.72:0/2469595912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe0640ca4f0 0x7fe064063100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:23.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.676+0000 7fe06c5ff700 1 --2- 172.21.15.72:0/2469595912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe064153ca0 0x7fe064154080 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:23.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.676+0000 7fe06c5ff700 1 --2- 172.21.15.72:0/2469595912 >> v2:172.21.15.146:3300/0 conn(0x7fe0640c8ee0 0x7fe064158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:23.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.676+0000 7fe06c5ff700 1 -- 172.21.15.72:0/2469595912 >> 172.21.15.72:0/2469595912 conn(0x7fe0640cadb0 msgr2=0x7fe0640cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:23.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.677+0000 7fe06c5ff700 1 -- 172.21.15.72:0/2469595912 shutdown_connections 2023-08-31T19:06:23.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.677+0000 7fe06c5ff700 1 -- 172.21.15.72:0/2469595912 wait complete. 2023-08-31T19:06:23.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.678+0000 7fe06c5ff700 1 Processor -- start 2023-08-31T19:06:23.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.678+0000 7fe06c5ff700 1 -- start start 2023-08-31T19:06:23.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.679+0000 7fe06c5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0640c8ee0 0x7fe064164a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:23.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.679+0000 7fe06c5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0640ca4f0 0x7fe0640c3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:23.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.679+0000 7fe06c5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe064153ca0 0x7fe0640af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:23.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.679+0000 7fe06c5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe064167670 con 0x7fe0640ca4f0 2023-08-31T19:06:23.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.679+0000 7fe06c5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe064164f40 con 0x7fe0640c8ee0 2023-08-31T19:06:23.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.679+0000 7fe06c5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640c4a80 con 0x7fe064153ca0 2023-08-31T19:06:23.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.679+0000 7fe069b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0640ca4f0 0x7fe0640c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:23.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.679+0000 7fe069b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0640ca4f0 0x7fe0640c3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35860/0 (socket says 172.21.15.72:35860) 2023-08-31T19:06:23.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.679+0000 7fe069b9a700 1 -- 172.21.15.72:0/2366280550 learned_addr learned my addr 172.21.15.72:0/2366280550 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:23.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.680+0000 7fe06ab9c700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe064153ca0 0x7fe0640af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:23.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.680+0000 7fe06a39b700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0640c8ee0 0x7fe064164a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:23.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.680+0000 7fe069b9a700 1 -- 172.21.15.72:0/2366280550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe064153ca0 msgr2=0x7fe0640af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:23.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.680+0000 7fe069b9a700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe064153ca0 0x7fe0640af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:23.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.680+0000 7fe069b9a700 1 -- 172.21.15.72:0/2366280550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0640c8ee0 msgr2=0x7fe064164a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:23.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.680+0000 7fe069b9a700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0640c8ee0 0x7fe064164a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:23.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.680+0000 7fe069b9a700 1 -- 172.21.15.72:0/2366280550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe060009370 con 0x7fe0640ca4f0 2023-08-31T19:06:23.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.680+0000 7fe06a39b700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0640c8ee0 0x7fe064164a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:23.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.680+0000 7fe06ab9c700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe064153ca0 0x7fe0640af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:23.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.680+0000 7fe069b9a700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0640ca4f0 0x7fe0640c3560 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7fe05400c880 tx=0x7fe054008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:23.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.680+0000 7fe05a7fc700 1 -- 172.21.15.72:0/2366280550 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054010580 con 0x7fe0640ca4f0 2023-08-31T19:06:23.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.680+0000 7fe05a7fc700 1 -- 172.21.15.72:0/2366280550 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0540106e0 con 0x7fe0640ca4f0 2023-08-31T19:06:23.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.680+0000 7fe06c5ff700 1 -- 172.21.15.72:0/2366280550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0640adf20 con 0x7fe0640ca4f0 2023-08-31T19:06:23.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.680+0000 7fe05a7fc700 1 -- 172.21.15.72:0/2366280550 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054010a60 con 0x7fe0640ca4f0 2023-08-31T19:06:23.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.680+0000 7fe06c5ff700 1 -- 172.21.15.72:0/2366280550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0640c4730 con 0x7fe0640ca4f0 2023-08-31T19:06:23.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.681+0000 7fe06c5ff700 1 -- 172.21.15.72:0/2366280550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0640add60 con 0x7fe0640ca4f0 2023-08-31T19:06:23.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.682+0000 7fe05a7fc700 1 -- 172.21.15.72:0/2366280550 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe05401b460 con 0x7fe0640ca4f0 2023-08-31T19:06:23.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.683+0000 7fe05a7fc700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe04805ef30 0x7fe0480613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:23.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.683+0000 7fe05a7fc700 1 -- 172.21.15.72:0/2366280550 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7fe05407a2c0 con 0x7fe0640ca4f0 2023-08-31T19:06:23.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.683+0000 7fe06a39b700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe04805ef30 0x7fe0480613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:23.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.684+0000 7fe06a39b700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe04805ef30 0x7fe0480613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe060009130 tx=0x7fe060017000).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:23.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.687+0000 7fe05a7fc700 1 -- 172.21.15.72:0/2366280550 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe05404b2f0 con 0x7fe0640ca4f0 2023-08-31T19:06:23.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.883+0000 7fe06c5ff700 1 -- 172.21.15.72:0/2366280550 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe06406c6b0 con 0x7fe04805ef30 2023-08-31T19:06:23.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.884+0000 7fe05a7fc700 1 -- 172.21.15.72:0/2366280550 <== mgr.7410 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe06406c6b0 con 0x7fe04805ef30 2023-08-31T19:06:23.885 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:06:23.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:06:23.885 INFO:teuthology.orchestra.run.smithi072.stdout: "name": "cephfs" 2023-08-31T19:06:23.885 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:06:23.886 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:06:23.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.886+0000 7fe06c5ff700 1 -- 172.21.15.72:0/2366280550 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe04805ef30 msgr2=0x7fe0480613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:23.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.886+0000 7fe06c5ff700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe04805ef30 0x7fe0480613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe060009130 tx=0x7fe060017000).stop 2023-08-31T19:06:23.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.886+0000 7fe06c5ff700 1 -- 172.21.15.72:0/2366280550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0640ca4f0 msgr2=0x7fe0640c3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:23.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.886+0000 7fe06c5ff700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0640ca4f0 0x7fe0640c3560 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7fe05400c880 tx=0x7fe054008040).stop 2023-08-31T19:06:23.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.887+0000 7fe06c5ff700 1 -- 172.21.15.72:0/2366280550 shutdown_connections 2023-08-31T19:06:23.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.887+0000 7fe06c5ff700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe064153ca0 0x7fe0640af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:23.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.887+0000 7fe06c5ff700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe04805ef30 0x7fe0480613f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:23.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.887+0000 7fe06c5ff700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0640c8ee0 0x7fe064164a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:23.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.887+0000 7fe06c5ff700 1 --2- 172.21.15.72:0/2366280550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0640ca4f0 0x7fe0640c3560 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:23.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.887+0000 7fe06c5ff700 1 -- 172.21.15.72:0/2366280550 >> 172.21.15.72:0/2366280550 conn(0x7fe0640cadb0 msgr2=0x7fe064159d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:23.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.887+0000 7fe06c5ff700 1 -- 172.21.15.72:0/2366280550 shutdown_connections 2023-08-31T19:06:23.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:23.887+0000 7fe06c5ff700 1 -- 172.21.15.72:0/2366280550 wait complete. 2023-08-31T19:06:23.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-31T19:06:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.100+0000 7f053e3ff700 1 Processor -- start 2023-08-31T19:06:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.100+0000 7f053e3ff700 1 -- start start 2023-08-31T19:06:24.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.101+0000 7f053e3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0538154410 0x7f05380c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:24.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.101+0000 7f053e3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05380c7360 0x7f0538063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:24.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.101+0000 7f053e3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05380c6ed0 con 0x7f0538154030 2023-08-31T19:06:24.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.101+0000 7f053e3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05380c66e0 con 0x7f05380c7360 2023-08-31T19:06:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.101+0000 7f053e3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05380c68c0 con 0x7f0538154410 2023-08-31T19:06:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.102+0000 7f053c99c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05380c7360 0x7f0538063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.102+0000 7f0537fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0538154030 0x7f05380aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51258/0 (socket says 172.21.15.72:51258) 2023-08-31T19:06:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.102+0000 7f053c99c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05380c7360 0x7f0538063120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35874/0 (socket says 172.21.15.72:35874) 2023-08-31T19:06:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.102+0000 7f0537fff700 1 -- 172.21.15.72:0/2594908980 learned_addr learned my addr 172.21.15.72:0/2594908980 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.102+0000 7f05377fe700 1 --2- 172.21.15.72:0/2594908980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0538154410 0x7f05380c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.102+0000 7f053c99c700 1 -- 172.21.15.72:0/2594908980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0538154410 msgr2=0x7f05380c06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.102+0000 7f053c99c700 1 --2- 172.21.15.72:0/2594908980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0538154410 0x7f05380c06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.102+0000 7f053c99c700 1 -- 172.21.15.72:0/2594908980 >> v1:172.21.15.72:6789/0 conn(0x7f0538154030 legacy=0x7f05380aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.102+0000 7f053c99c700 1 -- 172.21.15.72:0/2594908980 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05380c0f30 con 0x7f05380c7360 2023-08-31T19:06:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.102+0000 7f0536ffd700 1 -- 172.21.15.72:0/2594908980 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524679322 0 0) 0x7f05380c6ed0 con 0x7f0538154030 2023-08-31T19:06:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.102+0000 7f053c99c700 1 --2- 172.21.15.72:0/2594908980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05380c7360 0x7f0538063120 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f0530009e60 tx=0x7f0530009780).ready entity=mon.0 client_cookie=6cdbcc1070f7262d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.103+0000 7f0536ffd700 1 -- 172.21.15.72:0/2594908980 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053000e070 con 0x7f05380c7360 2023-08-31T19:06:24.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.103+0000 7f0536ffd700 1 -- 172.21.15.72:0/2594908980 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053000bc30 con 0x7f05380c7360 2023-08-31T19:06:24.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.103+0000 7f0536ffd700 1 -- 172.21.15.72:0/2594908980 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530012410 con 0x7f05380c7360 2023-08-31T19:06:24.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.103+0000 7f053e3ff700 1 -- 172.21.15.72:0/2594908980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05380c7360 msgr2=0x7f0538063120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:24.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.103+0000 7f053e3ff700 1 --2- 172.21.15.72:0/2594908980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05380c7360 0x7f0538063120 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f0530009e60 tx=0x7f0530009780).stop 2023-08-31T19:06:24.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.103+0000 7f053e3ff700 1 -- 172.21.15.72:0/2594908980 shutdown_connections 2023-08-31T19:06:24.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.103+0000 7f053e3ff700 1 --2- 172.21.15.72:0/2594908980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05380c7360 0x7f0538063120 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:24.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.103+0000 7f053e3ff700 1 --2- 172.21.15.72:0/2594908980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0538154410 0x7f05380c06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:24.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.103+0000 7f053e3ff700 1 -- 172.21.15.72:0/2594908980 >> 172.21.15.72:0/2594908980 conn(0x7f053805eb60 msgr2=0x7f05380cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:24.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.103+0000 7f053e3ff700 1 -- 172.21.15.72:0/2594908980 shutdown_connections 2023-08-31T19:06:24.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.103+0000 7f053e3ff700 1 -- 172.21.15.72:0/2594908980 wait complete. 2023-08-31T19:06:24.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.105+0000 7f053e3ff700 1 Processor -- start 2023-08-31T19:06:24.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.106+0000 7f053e3ff700 1 -- start start 2023-08-31T19:06:24.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.107+0000 7f053e3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05380c7360 0x7f05380ac550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:24.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.107+0000 7f053e3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0538154030 0x7f05380afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:24.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.107+0000 7f053e3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0538154410 0x7f0538164060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:24.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.107+0000 7f053e3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05380c2fd0 con 0x7f05380c7360 2023-08-31T19:06:24.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.107+0000 7f053e3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05380c23c0 con 0x7f0538154030 2023-08-31T19:06:24.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.107+0000 7f053e3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05380c26a0 con 0x7f0538154410 2023-08-31T19:06:24.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.107+0000 7f0537fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05380c7360 0x7f05380ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:24.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.107+0000 7f0537fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05380c7360 0x7f05380ac550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35882/0 (socket says 172.21.15.72:35882) 2023-08-31T19:06:24.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.107+0000 7f0537fff700 1 -- 172.21.15.72:0/1262777275 learned_addr learned my addr 172.21.15.72:0/1262777275 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:24.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.107+0000 7f0537fff700 1 -- 172.21.15.72:0/1262777275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0538154410 msgr2=0x7f0538164060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:24.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.107+0000 7f0537fff700 1 --2- 172.21.15.72:0/1262777275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0538154410 0x7f0538164060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:24.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.108+0000 7f0537fff700 1 -- 172.21.15.72:0/1262777275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0538154030 msgr2=0x7f05380afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:24.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.108+0000 7f0537fff700 1 --2- 172.21.15.72:0/1262777275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0538154030 0x7f05380afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:24.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.108+0000 7f0537fff700 1 -- 172.21.15.72:0/1262777275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0530009a20 con 0x7f05380c7360 2023-08-31T19:06:24.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.108+0000 7f0537fff700 1 --2- 172.21.15.72:0/1262777275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05380c7360 0x7f05380ac550 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f052800c4e0 tx=0x7f0528007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:24.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.108+0000 7f051ffff700 1 -- 172.21.15.72:0/1262777275 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05280072e0 con 0x7f05380c7360 2023-08-31T19:06:24.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.108+0000 7f051ffff700 1 -- 172.21.15.72:0/1262777275 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0528007440 con 0x7f05380c7360 2023-08-31T19:06:24.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.108+0000 7f053e3ff700 1 -- 172.21.15.72:0/1262777275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05380c2980 con 0x7f05380c7360 2023-08-31T19:06:24.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.108+0000 7f051ffff700 1 -- 172.21.15.72:0/1262777275 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05280057a0 con 0x7f05380c7360 2023-08-31T19:06:24.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.108+0000 7f053e3ff700 1 -- 172.21.15.72:0/1262777275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05380aca40 con 0x7f05380c7360 2023-08-31T19:06:24.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.109+0000 7f053e3ff700 1 -- 172.21.15.72:0/1262777275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053806c6b0 con 0x7f05380c7360 2023-08-31T19:06:24.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.110+0000 7f051ffff700 1 -- 172.21.15.72:0/1262777275 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 48) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0528005bd0 con 0x7f05380c7360 2023-08-31T19:06:24.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.111+0000 7f051ffff700 1 --2- 172.21.15.72:0/1262777275 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f052405ef00 0x7f05240613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:24.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.111+0000 7f051ffff700 1 -- 172.21.15.72:0/1262777275 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f0528079d20 con 0x7f05380c7360 2023-08-31T19:06:24.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.111+0000 7f05377fe700 1 --2- 172.21.15.72:0/1262777275 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f052405ef00 0x7f05240613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:24.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.111+0000 7f05377fe700 1 --2- 172.21.15.72:0/1262777275 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f052405ef00 0x7f05240613c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0538168720 tx=0x7f052c008040).ready entity=mgr.7410 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:24.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.115+0000 7f051ffff700 1 -- 172.21.15.72:0/1262777275 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f052804acf0 con 0x7f05380c7360 2023-08-31T19:06:24.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:24.325+0000 7f053e3ff700 1 -- 172.21.15.72:0/1262777275 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f05380c0c50 con 0x7f05380c7360 2023-08-31T19:06:24.998 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:06:25.004 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:06:25.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.220+0000 7f051ffff700 1 -- 172.21.15.72:0/1262777275 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 49) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f0528077650 con 0x7f05380c7360 2023-08-31T19:06:25.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.220+0000 7f051ffff700 1 -- 172.21.15.72:0/1262777275 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v49) v1 ==== 92+0+0 (secure 0 0 0) 0x7f0528074b70 con 0x7f05380c7360 2023-08-31T19:06:25.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.223+0000 7f053e3ff700 1 -- 172.21.15.72:0/1262777275 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f052405ef00 msgr2=0x7f05240613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:25.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.223+0000 7f053e3ff700 1 --2- 172.21.15.72:0/1262777275 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f052405ef00 0x7f05240613c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0538168720 tx=0x7f052c008040).stop 2023-08-31T19:06:25.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.223+0000 7f053e3ff700 1 -- 172.21.15.72:0/1262777275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05380c7360 msgr2=0x7f05380ac550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:25.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.223+0000 7f053e3ff700 1 --2- 172.21.15.72:0/1262777275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05380c7360 0x7f05380ac550 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f052800c4e0 tx=0x7f0528007c70).stop 2023-08-31T19:06:25.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.223+0000 7f053e3ff700 1 -- 172.21.15.72:0/1262777275 shutdown_connections 2023-08-31T19:06:25.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.223+0000 7f053e3ff700 1 --2- 172.21.15.72:0/1262777275 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0538154410 0x7f0538164060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:25.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.223+0000 7f053e3ff700 1 --2- 172.21.15.72:0/1262777275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05380c7360 0x7f05380ac550 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:25.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.223+0000 7f053e3ff700 1 --2- 172.21.15.72:0/1262777275 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f052405ef00 0x7f05240613c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:25.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.223+0000 7f053e3ff700 1 --2- 172.21.15.72:0/1262777275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0538154030 0x7f05380afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:25.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.223+0000 7f053e3ff700 1 -- 172.21.15.72:0/1262777275 >> 172.21.15.72:0/1262777275 conn(0x7f053805eb60 msgr2=0x7f0538150700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:25.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.223+0000 7f053e3ff700 1 -- 172.21.15.72:0/1262777275 shutdown_connections 2023-08-31T19:06:25.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.223+0000 7f053e3ff700 1 -- 172.21.15.72:0/1262777275 wait complete. 2023-08-31T19:06:25.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-31T19:06:25.426 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:25.425+0000 7f066b3aa680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:06:25.440 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:25.440+0000 7f7823860680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:06:25.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.445+0000 7f19103ff700 1 Processor -- start 2023-08-31T19:06:25.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.445+0000 7f19103ff700 1 -- start start 2023-08-31T19:06:25.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.446+0000 7f19103ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1908066590 0x7f1908138f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:25.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.446+0000 7f19103ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1908066970 0x7f1908156710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:25.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.446+0000 7f19103ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19080bdb30 0x7f19081381d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:25.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.446+0000 7f19103ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19080c3570 con 0x7f1908066970 2023-08-31T19:06:25.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.446+0000 7f19103ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19080c3850 con 0x7f1908066590 2023-08-31T19:06:25.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.446+0000 7f19103ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19080c9380 con 0x7f19080bdb30 2023-08-31T19:06:25.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.446+0000 7f190d99a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1908066970 0x7f1908156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:25.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.446+0000 7f190d99a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1908066970 0x7f1908156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35912/0 (socket says 172.21.15.72:35912) 2023-08-31T19:06:25.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.447+0000 7f190d99a700 1 -- 172.21.15.72:0/3685821568 learned_addr learned my addr 172.21.15.72:0/3685821568 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:25.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.447+0000 7f190e99c700 1 --2- 172.21.15.72:0/3685821568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19080bdb30 0x7f19081381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:25.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.447+0000 7f190e19b700 1 --2- 172.21.15.72:0/3685821568 >> v2:172.21.15.146:3300/0 conn(0x7f1908066590 0x7f1908138f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:25.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.447+0000 7f190d99a700 1 -- 172.21.15.72:0/3685821568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19080bdb30 msgr2=0x7f19081381d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:25.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.447+0000 7f190d99a700 1 --2- 172.21.15.72:0/3685821568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19080bdb30 0x7f19081381d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:25.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.447+0000 7f190d99a700 1 -- 172.21.15.72:0/3685821568 >> v2:172.21.15.146:3300/0 conn(0x7f1908066590 msgr2=0x7f1908138f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:25.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.447+0000 7f190d99a700 1 --2- 172.21.15.72:0/3685821568 >> v2:172.21.15.146:3300/0 conn(0x7f1908066590 0x7f1908138f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:25.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.447+0000 7f190d99a700 1 -- 172.21.15.72:0/3685821568 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19080c9660 con 0x7f1908066970 2023-08-31T19:06:25.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.447+0000 7f190d99a700 1 --2- 172.21.15.72:0/3685821568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1908066970 0x7f1908156710 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f190805f090 tx=0x7f18f80090f0).ready entity=mon.0 client_cookie=4c3a6936ecbae3b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:25.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.447+0000 7f190d199700 1 -- 172.21.15.72:0/3685821568 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f800f510 con 0x7f1908066970 2023-08-31T19:06:25.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.448+0000 7f190d199700 1 -- 172.21.15.72:0/3685821568 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f800f670 con 0x7f1908066970 2023-08-31T19:06:25.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.448+0000 7f190d199700 1 -- 172.21.15.72:0/3685821568 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f800fa10 con 0x7f1908066970 2023-08-31T19:06:25.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.448+0000 7f19103ff700 1 -- 172.21.15.72:0/3685821568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1908066970 msgr2=0x7f1908156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:25.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.448+0000 7f19103ff700 1 --2- 172.21.15.72:0/3685821568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1908066970 0x7f1908156710 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f190805f090 tx=0x7f18f80090f0).stop 2023-08-31T19:06:25.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.448+0000 7f19103ff700 1 -- 172.21.15.72:0/3685821568 shutdown_connections 2023-08-31T19:06:25.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.448+0000 7f19103ff700 1 --2- 172.21.15.72:0/3685821568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f19080bdb30 0x7f19081381d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:25.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.448+0000 7f19103ff700 1 --2- 172.21.15.72:0/3685821568 >> v2:172.21.15.146:3300/0 conn(0x7f1908066590 0x7f1908138f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:25.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.448+0000 7f19103ff700 1 --2- 172.21.15.72:0/3685821568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1908066970 0x7f1908156710 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:25.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.448+0000 7f19103ff700 1 -- 172.21.15.72:0/3685821568 >> 172.21.15.72:0/3685821568 conn(0x7f190805eb60 msgr2=0x7f19080c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:25.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.448+0000 7f19103ff700 1 -- 172.21.15.72:0/3685821568 shutdown_connections 2023-08-31T19:06:25.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.448+0000 7f19103ff700 1 -- 172.21.15.72:0/3685821568 wait complete. 2023-08-31T19:06:25.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.450+0000 7f19103ff700 1 Processor -- start 2023-08-31T19:06:25.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.450+0000 7f19103ff700 1 -- start start 2023-08-31T19:06:25.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.451+0000 7f19103ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1908066590 0x7f1908165d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:25.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.451+0000 7f19103ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1908066970 0x7f1908154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:25.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.451+0000 7f19103ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19080bdb30 0x7f19081374e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:25.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.451+0000 7f19103ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1908166200 con 0x7f19080bdb30 2023-08-31T19:06:25.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.451+0000 7f19103ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19080ac910 con 0x7f1908066590 2023-08-31T19:06:25.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.451+0000 7f19103ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19080abd00 con 0x7f1908066970 2023-08-31T19:06:25.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.451+0000 7f190e99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19080bdb30 0x7f19081374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:25.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.451+0000 7f190e99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19080bdb30 0x7f19081374e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35918/0 (socket says 172.21.15.72:35918) 2023-08-31T19:06:25.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.451+0000 7f190d99a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1908066970 0x7f1908154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:25.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.451+0000 7f190e99c700 1 -- 172.21.15.72:0/1832392019 learned_addr learned my addr 172.21.15.72:0/1832392019 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:25.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.451+0000 7f190e19b700 1 --2- 172.21.15.72:0/1832392019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1908066590 0x7f1908165d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:25.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.451+0000 7f190e99c700 1 -- 172.21.15.72:0/1832392019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1908066970 msgr2=0x7f1908154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:25.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.452+0000 7f190e99c700 1 --2- 172.21.15.72:0/1832392019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1908066970 0x7f1908154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:25.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.452+0000 7f190e99c700 1 -- 172.21.15.72:0/1832392019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1908066590 msgr2=0x7f1908165d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:25.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.452+0000 7f190e99c700 1 --2- 172.21.15.72:0/1832392019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1908066590 0x7f1908165d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:25.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.452+0000 7f190e99c700 1 -- 172.21.15.72:0/1832392019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f8009370 con 0x7f19080bdb30 2023-08-31T19:06:25.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.452+0000 7f190e99c700 1 --2- 172.21.15.72:0/1832392019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19080bdb30 0x7f19081374e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f1900009df0 tx=0x7f190000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:25.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.452+0000 7f18fe7fc700 1 -- 172.21.15.72:0/1832392019 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190000caa0 con 0x7f19080bdb30 2023-08-31T19:06:25.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.452+0000 7f18fe7fc700 1 -- 172.21.15.72:0/1832392019 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190000f040 con 0x7f19080bdb30 2023-08-31T19:06:25.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.452+0000 7f19103ff700 1 -- 172.21.15.72:0/1832392019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19080abfe0 con 0x7f19080bdb30 2023-08-31T19:06:25.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.452+0000 7f18fe7fc700 1 -- 172.21.15.72:0/1832392019 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190000ce10 con 0x7f19080bdb30 2023-08-31T19:06:25.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.452+0000 7f19103ff700 1 -- 172.21.15.72:0/1832392019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19080ac5a0 con 0x7f19080bdb30 2023-08-31T19:06:25.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.453+0000 7f19103ff700 1 -- 172.21.15.72:0/1832392019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f190806c6b0 con 0x7f19080bdb30 2023-08-31T19:06:25.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.455+0000 7f18fe7fc700 1 -- 172.21.15.72:0/1832392019 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 49) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f1900013610 con 0x7f19080bdb30 2023-08-31T19:06:25.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.455+0000 7f18fe7fc700 1 --2- 172.21.15.72:0/1832392019 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f18ec05ef80 0x7f18ec061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:25.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.456+0000 7f18fe7fc700 1 -- 172.21.15.72:0/1832392019 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f190007a960 con 0x7f19080bdb30 2023-08-31T19:06:25.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.456+0000 7f190e19b700 1 -- 172.21.15.72:0/1832392019 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f18ec05ef80 msgr2=0x7f18ec061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:06:25.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.456+0000 7f190e19b700 1 --2- 172.21.15.72:0/1832392019 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f18ec05ef80 0x7f18ec061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:06:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.460+0000 7f18fe7fc700 1 -- 172.21.15.72:0/1832392019 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f190004b9f0 con 0x7f19080bdb30 2023-08-31T19:06:25.504 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:25.504+0000 7f066b3aa680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:06:25.523 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:25.523+0000 7f7823860680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:06:25.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.636+0000 7f19103ff700 1 -- 172.21.15.72:0/1832392019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f1908067360 con 0x7f19080bdb30 2023-08-31T19:06:25.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.640+0000 7f18fe7fc700 1 -- 172.21.15.72:0/1832392019 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f190004f010 con 0x7f19080bdb30 2023-08-31T19:06:25.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.642+0000 7f19103ff700 1 -- 172.21.15.72:0/1832392019 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f18ec05ef80 msgr2=0x7f18ec061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:06:25.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.642+0000 7f19103ff700 1 --2- 172.21.15.72:0/1832392019 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f18ec05ef80 0x7f18ec061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:25.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.642+0000 7f19103ff700 1 -- 172.21.15.72:0/1832392019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19080bdb30 msgr2=0x7f19081374e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:25.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.642+0000 7f19103ff700 1 --2- 172.21.15.72:0/1832392019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19080bdb30 0x7f19081374e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f1900009df0 tx=0x7f190000b040).stop 2023-08-31T19:06:25.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.643+0000 7f19103ff700 1 -- 172.21.15.72:0/1832392019 shutdown_connections 2023-08-31T19:06:25.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.643+0000 7f19103ff700 1 --2- 172.21.15.72:0/1832392019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19080bdb30 0x7f19081374e0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:25.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.643+0000 7f19103ff700 1 --2- 172.21.15.72:0/1832392019 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f18ec05ef80 0x7f18ec061440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:25.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.643+0000 7f19103ff700 1 --2- 172.21.15.72:0/1832392019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1908066590 0x7f1908165d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:25.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.643+0000 7f19103ff700 1 --2- 172.21.15.72:0/1832392019 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1908066970 0x7f1908154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:25.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.643+0000 7f19103ff700 1 -- 172.21.15.72:0/1832392019 >> 172.21.15.72:0/1832392019 conn(0x7f190805eb60 msgr2=0x7f1908064c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:25.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.643+0000 7f19103ff700 1 -- 172.21.15.72:0/1832392019 shutdown_connections 2023-08-31T19:06:25.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.643+0000 7f19103ff700 1 -- 172.21.15.72:0/1832392019 wait complete. 2023-08-31T19:06:25.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:25.662 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-31T19:06:25.713 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-31T19:06:25.831 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:25.831+0000 7f066b3aa680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:06:25.871 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:25.870+0000 7f7823860680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:06:25.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.910+0000 7f4721fff700 1 Processor -- start 2023-08-31T19:06:25.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.911+0000 7f4721fff700 1 -- start start 2023-08-31T19:06:25.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.912+0000 7f4721fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f471c064d70 0x7f471c1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.912+0000 7f4721fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471c154f40 con 0x7f471c0c5370 2023-08-31T19:06:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.912+0000 7f4721fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471c0c5780 con 0x7f471c151da0 2023-08-31T19:06:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.912+0000 7f4721fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f471c154960 con 0x7f471c064d70 2023-08-31T19:06:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.912+0000 7f471bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f471c0c5370 0x7f471c0bfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51276/0 (socket says 172.21.15.72:51276) 2023-08-31T19:06:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.912+0000 7f471bfff700 1 -- 172.21.15.72:0/1317720241 learned_addr learned my addr 172.21.15.72:0/1317720241 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:25.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.912+0000 7f471affd700 1 --2- 172.21.15.72:0/1317720241 >> v2:172.21.15.146:3300/0 conn(0x7f471c064d70 0x7f471c1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:25.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.913+0000 7f471a7fc700 1 -- 172.21.15.72:0/1317720241 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329975079 0 0) 0x7f471c154f40 con 0x7f471c0c5370 2023-08-31T19:06:25.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.913+0000 7f471a7fc700 1 -- 172.21.15.72:0/1317720241 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47040033f0 con 0x7f471c0c5370 2023-08-31T19:06:25.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.913+0000 7f471a7fc700 1 -- 172.21.15.72:0/1317720241 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813632620 0 0) 0x7f471c0c5780 con 0x7f471c151da0 2023-08-31T19:06:25.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.913+0000 7f471a7fc700 1 -- 172.21.15.72:0/1317720241 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f471c154f40 con 0x7f471c151da0 2023-08-31T19:06:25.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.913+0000 7f471affd700 1 -- 172.21.15.72:0/1317720241 >> v1:172.21.15.146:6789/0 conn(0x7f471c151da0 legacy=0x7f471c064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:25.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.913+0000 7f471affd700 1 -- 172.21.15.72:0/1317720241 >> v1:172.21.15.72:6789/0 conn(0x7f471c0c5370 legacy=0x7f471c0bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:25.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.913+0000 7f471affd700 1 -- 172.21.15.72:0/1317720241 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c0aa2c0 con 0x7f471c064d70 2023-08-31T19:06:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.913+0000 7f471affd700 1 --2- 172.21.15.72:0/1317720241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471c064d70 0x7f471c1553d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f4710009760 tx=0x7f4710009060).ready entity=mon.1 client_cookie=ae56be8f48994400 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.913+0000 7f471a7fc700 1 -- 172.21.15.72:0/1317720241 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471000d4a0 con 0x7f471c064d70 2023-08-31T19:06:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.913+0000 7f471a7fc700 1 -- 172.21.15.72:0/1317720241 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471000d600 con 0x7f471c064d70 2023-08-31T19:06:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.913+0000 7f471a7fc700 1 -- 172.21.15.72:0/1317720241 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471000d980 con 0x7f471c064d70 2023-08-31T19:06:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.914+0000 7f4721fff700 1 -- 172.21.15.72:0/1317720241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471c064d70 msgr2=0x7f471c1553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.914+0000 7f4721fff700 1 --2- 172.21.15.72:0/1317720241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471c064d70 0x7f471c1553d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f4710009760 tx=0x7f4710009060).stop 2023-08-31T19:06:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.914+0000 7f4721fff700 1 -- 172.21.15.72:0/1317720241 shutdown_connections 2023-08-31T19:06:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.914+0000 7f4721fff700 1 --2- 172.21.15.72:0/1317720241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471c064d70 0x7f471c1553d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.914+0000 7f4721fff700 1 -- 172.21.15.72:0/1317720241 >> 172.21.15.72:0/1317720241 conn(0x7f471c063a90 msgr2=0x7f471c0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.914+0000 7f4721fff700 1 -- 172.21.15.72:0/1317720241 shutdown_connections 2023-08-31T19:06:25.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.914+0000 7f4721fff700 1 -- 172.21.15.72:0/1317720241 wait complete. 2023-08-31T19:06:25.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.916+0000 7f4721fff700 1 Processor -- start 2023-08-31T19:06:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.916+0000 7f4721fff700 1 -- start start 2023-08-31T19:06:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f4721fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471c064d70 0x7f471c0add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f4721fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f471c0c5370 0x7f471c0b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f4721fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f471c151da0 0x7f471c1457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f4721fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471c0ae210 con 0x7f471c151da0 2023-08-31T19:06:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f4721fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471c14e2b0 con 0x7f471c064d70 2023-08-31T19:06:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f4721fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471c150590 con 0x7f471c0c5370 2023-08-31T19:06:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f471bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f471c151da0 0x7f471c1457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f471b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471c064d70 0x7f471c0add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f471b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471c064d70 0x7f471c0add20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:37656/0 (socket says 172.21.15.72:37656) 2023-08-31T19:06:25.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f471bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f471c151da0 0x7f471c1457b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35928/0 (socket says 172.21.15.72:35928) 2023-08-31T19:06:25.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f471b7fe700 1 -- 172.21.15.72:0/3238655560 learned_addr learned my addr 172.21.15.72:0/3238655560 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:25.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f471affd700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f471c0c5370 0x7f471c0b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:25.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f471b7fe700 1 -- 172.21.15.72:0/3238655560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f471c0c5370 msgr2=0x7f471c0b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:25.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f471b7fe700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f471c0c5370 0x7f471c0b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:25.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f471b7fe700 1 -- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f471c151da0 msgr2=0x7f471c1457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:25.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.917+0000 7f471b7fe700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f471c151da0 0x7f471c1457b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:25.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.918+0000 7f471b7fe700 1 -- 172.21.15.72:0/3238655560 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47100092a0 con 0x7f471c064d70 2023-08-31T19:06:25.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.918+0000 7f471bfff700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f471c151da0 0x7f471c1457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:06:25.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.918+0000 7f471b7fe700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471c064d70 0x7f471c0add20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f470c00c470 tx=0x7f470c007c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:25.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.918+0000 7f47037fe700 1 -- 172.21.15.72:0/3238655560 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c012400 con 0x7f471c064d70 2023-08-31T19:06:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.918+0000 7f47037fe700 1 -- 172.21.15.72:0/3238655560 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470c012560 con 0x7f471c064d70 2023-08-31T19:06:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.918+0000 7f4721fff700 1 -- 172.21.15.72:0/3238655560 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f471c0b0e00 con 0x7f471c064d70 2023-08-31T19:06:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.918+0000 7f47037fe700 1 -- 172.21.15.72:0/3238655560 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c012920 con 0x7f471c064d70 2023-08-31T19:06:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.918+0000 7f4721fff700 1 -- 172.21.15.72:0/3238655560 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471c14e7e0 con 0x7f471c064d70 2023-08-31T19:06:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.919+0000 7f4721fff700 1 -- 172.21.15.72:0/3238655560 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471c06a7e0 con 0x7f471c064d70 2023-08-31T19:06:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.920+0000 7f47037fe700 1 -- 172.21.15.72:0/3238655560 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 49) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f470c01b3b0 con 0x7f471c064d70 2023-08-31T19:06:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.921+0000 7f47037fe700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 0x7f4708061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.921+0000 7f47037fe700 1 -- 172.21.15.72:0/3238655560 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6721+0+0 (secure 0 0 0) 0x7f470c0798e0 con 0x7f471c064d70 2023-08-31T19:06:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.921+0000 7f471affd700 1 -- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 msgr2=0x7f4708061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:06:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.921+0000 7f471affd700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 0x7f4708061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:06:25.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:25.925+0000 7f47037fe700 1 -- 172.21.15.72:0/3238655560 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f470c0488f0 con 0x7f471c064d70 2023-08-31T19:06:26.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:26.122+0000 7f471affd700 1 -- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 msgr2=0x7f4708061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:06:26.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:26.122+0000 7f471affd700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 0x7f4708061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:06:26.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:26.128+0000 7f4721fff700 1 -- 172.21.15.72:0/3238655560 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f471c1506d0 con 0x7f470805ef80 2023-08-31T19:06:26.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:26.523+0000 7f471affd700 1 -- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 msgr2=0x7f4708061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:06:26.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:26.523+0000 7f471affd700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 0x7f4708061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-31T19:06:26.573 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:26.573+0000 7f066b3aa680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:06:26.621 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:26.620+0000 7f7823860680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:06:26.658 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:26.658+0000 7f066b3aa680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:06:26.703 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:26.703+0000 7f7823860680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:06:26.888 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:26.888+0000 7f066b3aa680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:06:26.931 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:26.931+0000 7f7823860680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:06:27.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:27.324+0000 7f471affd700 1 -- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 msgr2=0x7f4708061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:06:27.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:27.324+0000 7f471affd700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 0x7f4708061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-31T19:06:27.398 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:27.398+0000 7f066b3aa680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:06:27.441 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:27.440+0000 7f7823860680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:06:27.523 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:27.523+0000 7f066b3aa680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:06:27.566 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:27.566+0000 7f7823860680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:06:27.707 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:27.707+0000 7f066b3aa680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:06:27.749 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:27.749+0000 7f7823860680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:06:27.800 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:27.799+0000 7f066b3aa680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:06:27.841 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:27.841+0000 7f7823860680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:06:27.885 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:27.885+0000 7f066b3aa680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:06:27.926 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:27.926+0000 7f7823860680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:06:28.194 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:28.193+0000 7f066b3aa680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:06:28.234 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:28.234+0000 7f7823860680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:06:28.417 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:28.416+0000 7f066b3aa680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:06:28.456 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:28.455+0000 7f7823860680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:06:28.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:28.926+0000 7f471affd700 1 -- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 msgr2=0x7f4708061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:06:28.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:28.926+0000 7f471affd700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 0x7f4708061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-31T19:06:29.216 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:29.216+0000 7f066b3aa680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:06:29.254 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:29.253+0000 7f7823860680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:06:29.302 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:29.302+0000 7f066b3aa680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:06:29.341 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:29.341+0000 7f7823860680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:06:29.396 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:29.395+0000 7f066b3aa680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:06:29.435 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:29.435+0000 7f7823860680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:06:29.577 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:29.577+0000 7f066b3aa680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:06:29.619 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:29.619+0000 7f7823860680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:06:29.666 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:29.666+0000 7f066b3aa680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:06:29.708 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:29.707+0000 7f7823860680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:06:29.806 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:29.806+0000 7f066b3aa680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:06:29.848 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:29.848+0000 7f7823860680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:06:29.936 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:29.936+0000 7f066b3aa680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:06:29.979 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:29.979+0000 7f7823860680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:06:30.281 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:30.281+0000 7f066b3aa680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:06:30.322 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:30.321+0000 7f7823860680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:06:30.369 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:06:30.369+0000 7f066b3aa680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:06:30.410 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:30.410+0000 7f7823860680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:06:30.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:30.422+0000 7f47037fe700 1 -- 172.21.15.72:0/3238655560 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mgrmap(e 50) v1 ==== 75113+0+0 (secure 0 0 0) 0x7f470c077210 con 0x7f471c064d70 2023-08-31T19:06:30.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:30.422+0000 7f47037fe700 1 -- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 msgr2=0x7f4708061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:06:30.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:30.422+0000 7f47037fe700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 0x7f4708061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:30.497 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:30.496+0000 7f7799347700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:30.497 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:30.496+0000 7f7799347700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:30.497 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:30.496+0000 7f7799347700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:30.498 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:30.496+0000 7f7799347700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:30.498 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:30.496+0000 7f7799347700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:30.498 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:30.497+0000 7f7796341700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:30.498 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:30.497+0000 7f7796341700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:30.499 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:30.497+0000 7f7796341700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:30.499 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:30.497+0000 7f7796341700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:30.499 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:06:30.497+0000 7f7796341700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:06:31.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.435+0000 7f47037fe700 1 -- 172.21.15.72:0/3238655560 <== mon.1 v2:172.21.15.146:3300/0 8 ==== mgrmap(e 51) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f470c077590 con 0x7f471c064d70 2023-08-31T19:06:31.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.436+0000 7f47037fe700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 0x7f47080613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:31.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.436+0000 7f47037fe700 1 -- 172.21.15.72:0/3238655560 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4708065510 con 0x7f470805ef80 2023-08-31T19:06:31.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.437+0000 7f471affd700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 0x7f47080613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:31.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.441+0000 7f471affd700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 0x7f47080613c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f4710009760 tx=0x7f4710016000).ready entity=mgr.7168 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:31.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.449+0000 7f47037fe700 1 -- 172.21.15.72:0/3238655560 <== mgr.7168 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4708065510 con 0x7f470805ef80 2023-08-31T19:06:31.450 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path snap_test_dir1 2023-08-31T19:06:31.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.451+0000 7f4721fff700 1 -- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 msgr2=0x7f47080613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:31.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.451+0000 7f4721fff700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 0x7f47080613c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f4710009760 tx=0x7f4710016000).stop 2023-08-31T19:06:31.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.452+0000 7f4721fff700 1 -- 172.21.15.72:0/3238655560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471c064d70 msgr2=0x7f471c0add20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:31.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.452+0000 7f4721fff700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471c064d70 0x7f471c0add20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f470c00c470 tx=0x7f470c007c90).stop 2023-08-31T19:06:31.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.452+0000 7f4721fff700 1 -- 172.21.15.72:0/3238655560 shutdown_connections 2023-08-31T19:06:31.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.452+0000 7f4721fff700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f471c151da0 0x7f471c1457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:31.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.452+0000 7f4721fff700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f470805ef80 0x7f47080613c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:31.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.452+0000 7f4721fff700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f471c064d70 0x7f471c0add20 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:31.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.452+0000 7f4721fff700 1 --2- 172.21.15.72:0/3238655560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f471c0c5370 0x7f471c0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:31.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.452+0000 7f4721fff700 1 -- 172.21.15.72:0/3238655560 >> 172.21.15.72:0/3238655560 conn(0x7f471c063a90 msgr2=0x7f471c0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:31.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.452+0000 7f4721fff700 1 -- 172.21.15.72:0/3238655560 shutdown_connections 2023-08-31T19:06:31.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.452+0000 7f4721fff700 1 -- 172.21.15.72:0/3238655560 wait complete. 2023-08-31T19:06:31.472 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-31T19:06:31.473 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-31-19_07_00 in ~29s... 2023-08-31T19:06:31.473 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-08-31T19:06:31.473 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-31T19:06:31.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.670+0000 7fb6cd39d700 1 Processor -- start 2023-08-31T19:06:31.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.671+0000 7fb6cd39d700 1 -- start start 2023-08-31T19:06:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.672+0000 7fb6cd39d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6c8150450 0x7fb6c80bcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:31.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.672+0000 7fb6cd39d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6c80c1730 0x7fb6c80c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:31.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.672+0000 7fb6cd39d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c80bca30 con 0x7fb6c8150830 2023-08-31T19:06:31.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.672+0000 7fb6cd39d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c80c2050 con 0x7fb6c80c1730 2023-08-31T19:06:31.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.672+0000 7fb6cd39d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80bc100 con 0x7fb6c8150450 2023-08-31T19:06:31.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.672+0000 7fb6ccb9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6c80c1730 0x7fb6c80c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:31.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.672+0000 7fb6c77fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb6c8150830 0x7fb6c8068ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51284/0 (socket says 172.21.15.72:51284) 2023-08-31T19:06:31.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.673+0000 7fb6ccb9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6c80c1730 0x7fb6c80c1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36052/0 (socket says 172.21.15.72:36052) 2023-08-31T19:06:31.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.673+0000 7fb6c77fe700 1 -- 172.21.15.72:0/3135867466 learned_addr learned my addr 172.21.15.72:0/3135867466 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:06:31.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.673+0000 7fb6c7fff700 1 --2- 172.21.15.72:0/3135867466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6c8150450 0x7fb6c80bcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.673+0000 7fb6ccb9c700 1 -- 172.21.15.72:0/3135867466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6c8150450 msgr2=0x7fb6c80bcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:06:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.673+0000 7fb6ccb9c700 1 --2- 172.21.15.72:0/3135867466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6c8150450 0x7fb6c80bcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.673+0000 7fb6ccb9c700 1 -- 172.21.15.72:0/3135867466 >> v1:172.21.15.72:6789/0 conn(0x7fb6c8150830 legacy=0x7fb6c8068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.673+0000 7fb6ccb9c700 1 -- 172.21.15.72:0/3135867466 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c80bc3e0 con 0x7fb6c80c1730 2023-08-31T19:06:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.673+0000 7fb6c7fff700 1 --2- 172.21.15.72:0/3135867466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6c8150450 0x7fb6c80bcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:06:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.673+0000 7fb6c6ffd700 1 -- 172.21.15.72:0/3135867466 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779031326 0 0) 0x7fb6c80bca30 con 0x7fb6c8150830 2023-08-31T19:06:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.673+0000 7fb6ccb9c700 1 --2- 172.21.15.72:0/3135867466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c80c1730 0x7fb6c80c1b60 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7fb6c000d0d0 tx=0x7fb6c000b990).ready entity=mon.0 client_cookie=ece620343d03b02a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.673+0000 7fb6c6ffd700 1 -- 172.21.15.72:0/3135867466 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0010070 con 0x7fb6c80c1730 2023-08-31T19:06:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.673+0000 7fb6c6ffd700 1 -- 172.21.15.72:0/3135867466 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c000ddf0 con 0x7fb6c80c1730 2023-08-31T19:06:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.673+0000 7fb6c6ffd700 1 -- 172.21.15.72:0/3135867466 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c000b2e0 con 0x7fb6c80c1730 2023-08-31T19:06:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.674+0000 7fb6cd39d700 1 -- 172.21.15.72:0/3135867466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c80c1730 msgr2=0x7fb6c80c1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.674+0000 7fb6cd39d700 1 --2- 172.21.15.72:0/3135867466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c80c1730 0x7fb6c80c1b60 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7fb6c000d0d0 tx=0x7fb6c000b990).stop 2023-08-31T19:06:31.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.674+0000 7fb6cd39d700 1 -- 172.21.15.72:0/3135867466 shutdown_connections 2023-08-31T19:06:31.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.674+0000 7fb6cd39d700 1 --2- 172.21.15.72:0/3135867466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c80c1730 0x7fb6c80c1b60 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:31.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.674+0000 7fb6cd39d700 1 --2- 172.21.15.72:0/3135867466 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6c8150450 0x7fb6c80bcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:31.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.674+0000 7fb6cd39d700 1 -- 172.21.15.72:0/3135867466 >> 172.21.15.72:0/3135867466 conn(0x7fb6c80c71f0 msgr2=0x7fb6c80c3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:31.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.674+0000 7fb6cd39d700 1 -- 172.21.15.72:0/3135867466 shutdown_connections 2023-08-31T19:06:31.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.674+0000 7fb6cd39d700 1 -- 172.21.15.72:0/3135867466 wait complete. 2023-08-31T19:06:31.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.676+0000 7fb6cd39d700 1 Processor -- start 2023-08-31T19:06:31.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.676+0000 7fb6cd39d700 1 -- start start 2023-08-31T19:06:31.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.677+0000 7fb6cd39d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6c80c1730 0x7fb6c80c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:31.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.678+0000 7fb6cd39d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6c8150450 0x7fb6c80a9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:31.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.678+0000 7fb6cd39d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c8150830 0x7fb6c80aa110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:31.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.678+0000 7fb6cd39d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80ac5f0 con 0x7fb6c8150830 2023-08-31T19:06:31.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.678+0000 7fb6cd39d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c8151a20 con 0x7fb6c8150450 2023-08-31T19:06:31.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.678+0000 7fb6cd39d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c8151d00 con 0x7fb6c80c1730 2023-08-31T19:06:31.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.678+0000 7fb6ccb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c8150830 0x7fb6c80aa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:31.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.678+0000 7fb6ccb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c8150830 0x7fb6c80aa110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36058/0 (socket says 172.21.15.72:36058) 2023-08-31T19:06:31.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.678+0000 7fb6ccb9c700 1 -- 172.21.15.72:0/3690697938 learned_addr learned my addr 172.21.15.72:0/3690697938 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:06:31.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.678+0000 7fb6c77fe700 1 --2- 172.21.15.72:0/3690697938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6c8150450 0x7fb6c80a9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:31.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.678+0000 7fb6ccb9c700 1 -- 172.21.15.72:0/3690697938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6c80c1730 msgr2=0x7fb6c80c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:31.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.678+0000 7fb6ccb9c700 1 --2- 172.21.15.72:0/3690697938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6c80c1730 0x7fb6c80c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:31.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.678+0000 7fb6ccb9c700 1 -- 172.21.15.72:0/3690697938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6c8150450 msgr2=0x7fb6c80a9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:31.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.678+0000 7fb6ccb9c700 1 --2- 172.21.15.72:0/3690697938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6c8150450 0x7fb6c80a9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:31.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.678+0000 7fb6ccb9c700 1 -- 172.21.15.72:0/3690697938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c000bc30 con 0x7fb6c8150830 2023-08-31T19:06:31.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.678+0000 7fb6ccb9c700 1 --2- 172.21.15.72:0/3690697938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c8150830 0x7fb6c80aa110 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7fb6c8067bc0 tx=0x7fb6c000b990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:31.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.679+0000 7fb6affff700 1 -- 172.21.15.72:0/3690697938 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0015420 con 0x7fb6c8150830 2023-08-31T19:06:31.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.679+0000 7fb6affff700 1 -- 172.21.15.72:0/3690697938 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c0015580 con 0x7fb6c8150830 2023-08-31T19:06:31.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.679+0000 7fb6affff700 1 -- 172.21.15.72:0/3690697938 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0015900 con 0x7fb6c8150830 2023-08-31T19:06:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.679+0000 7fb6cd39d700 1 -- 172.21.15.72:0/3690697938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c8151fe0 con 0x7fb6c8150830 2023-08-31T19:06:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.679+0000 7fb6cd39d700 1 -- 172.21.15.72:0/3690697938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c81525a0 con 0x7fb6c8150830 2023-08-31T19:06:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.680+0000 7fb6cd39d700 1 -- 172.21.15.72:0/3690697938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c81527c0 con 0x7fb6c8150830 2023-08-31T19:06:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.681+0000 7fb6affff700 1 -- 172.21.15.72:0/3690697938 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 51) v1 ==== 75183+0+0 (secure 0 0 0) 0x7fb6c0003040 con 0x7fb6c8150830 2023-08-31T19:06:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.681+0000 7fb6affff700 1 --2- 172.21.15.72:0/3690697938 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb6b405ed40 0x7fb6b4061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:06:31.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.681+0000 7fb6affff700 1 -- 172.21.15.72:0/3690697938 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6979+0+0 (secure 0 0 0) 0x7fb6c007de00 con 0x7fb6c8150830 2023-08-31T19:06:31.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.682+0000 7fb6c7fff700 1 --2- 172.21.15.72:0/3690697938 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb6b405ed40 0x7fb6b4061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:06:31.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.682+0000 7fb6c7fff700 1 --2- 172.21.15.72:0/3690697938 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb6b405ed40 0x7fb6b4061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb6b8006d80 tx=0x7fb6b8008040).ready entity=mgr.7168 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:06:31.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.686+0000 7fb6affff700 1 -- 172.21.15.72:0/3690697938 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb6c004f120 con 0x7fb6c8150830 2023-08-31T19:06:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.878+0000 7fb6cd39d700 1 -- 172.21.15.72:0/3690697938 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6c8047480 con 0x7fb6b405ed40 2023-08-31T19:06:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.881+0000 7fb6affff700 1 -- 172.21.15.72:0/3690697938 <== mgr.7168 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7fb6c8047480 con 0x7fb6b405ed40 2023-08-31T19:06:31.881 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:06:31.882 INFO:teuthology.orchestra.run.smithi072.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-08-31T19:06:31.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.883+0000 7fb6cd39d700 1 -- 172.21.15.72:0/3690697938 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb6b405ed40 msgr2=0x7fb6b4061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:31.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.883+0000 7fb6cd39d700 1 --2- 172.21.15.72:0/3690697938 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb6b405ed40 0x7fb6b4061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb6b8006d80 tx=0x7fb6b8008040).stop 2023-08-31T19:06:31.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.883+0000 7fb6cd39d700 1 -- 172.21.15.72:0/3690697938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c8150830 msgr2=0x7fb6c80aa110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:06:31.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.883+0000 7fb6cd39d700 1 --2- 172.21.15.72:0/3690697938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c8150830 0x7fb6c80aa110 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7fb6c8067bc0 tx=0x7fb6c000b990).stop 2023-08-31T19:06:31.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.883+0000 7fb6cd39d700 1 -- 172.21.15.72:0/3690697938 shutdown_connections 2023-08-31T19:06:31.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.883+0000 7fb6cd39d700 1 --2- 172.21.15.72:0/3690697938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c8150830 0x7fb6c80aa110 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.883+0000 7fb6cd39d700 1 --2- 172.21.15.72:0/3690697938 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6c80c1730 0x7fb6c80c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:06:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.883+0000 7fb6cd39d700 1 --2- 172.21.15.72:0/3690697938 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb6b405ed40 0x7fb6b4061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.883+0000 7fb6cd39d700 1 --2- 172.21.15.72:0/3690697938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6c8150450 0x7fb6c80a9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:06:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.883+0000 7fb6cd39d700 1 -- 172.21.15.72:0/3690697938 >> 172.21.15.72:0/3690697938 conn(0x7fb6c80c71f0 msgr2=0x7fb6c80648c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:06:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.883+0000 7fb6cd39d700 1 -- 172.21.15.72:0/3690697938 shutdown_connections 2023-08-31T19:06:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:06:31.883+0000 7fb6cd39d700 1 -- 172.21.15.72:0/3690697938 wait complete. 2023-08-31T19:06:31.900 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-08-31T19:06:31.901 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-08-31T19:06:31.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:31.901 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:32.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:32.951 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:34.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:34.006 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:35.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:35.061 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:36.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:36.115 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:37.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:37.215 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:38.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:38.270 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:39.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:39.325 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:40.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:40.380 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:41.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:41.436 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:42.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:42.492 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:43.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:43.547 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:44.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:44.602 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:45.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:45.657 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:46.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:46.712 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:47.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:47.766 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:48.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:48.821 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:49.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:49.875 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:50.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:50.931 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:51.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:51.988 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:53.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:53.043 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:54.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:54.098 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:55.112 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:06:55.117 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:06:55.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:55.154 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:56.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:56.211 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:57.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:57.266 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:58.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:58.321 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:06:59.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:06:59.377 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:07:00.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:07:00.432 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:07:00.455 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:00.455+0000 7f7788b26700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:00.456 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:00.455+0000 7f7788b26700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:00.456 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:00.455+0000 7f7788b26700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:00.456 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:00.455+0000 7f7788b26700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:00.456 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:00.455+0000 7f7788b26700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:00.489 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_07_00_UTC 2023-08-31T19:07:00.490 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-31-19_07_00_UTC'] 2023-08-31T19:07:00.490 DEBUG:tasks.cephfs.test_snap_schedules:exec=1693508791.4731183, now = 1693508820.4908473, timo = 29 2023-08-31T19:07:01.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-31T19:07:01.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.694+0000 7f56a0bff700 1 Processor -- start 2023-08-31T19:07:01.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.695+0000 7f56a0bff700 1 -- start start 2023-08-31T19:07:01.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.696+0000 7f56a0bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f569c151da0 0x7f569c1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:01.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.696+0000 7f56a0bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f569c0c5370 0x7f569c064660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:01.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.696+0000 7f56a0bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c154f40 con 0x7f569c064b50 2023-08-31T19:07:01.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.696+0000 7f56a0bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c154960 con 0x7f569c0c5370 2023-08-31T19:07:01.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.696+0000 7f56a0bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c064f80 con 0x7f569c151da0 2023-08-31T19:07:01.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.696+0000 7f5699d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f569c0c5370 0x7f569c064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.696+0000 7f5699d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f569c0c5370 0x7f569c064660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33354/0 (socket says 172.21.15.72:33354) 2023-08-31T19:07:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.696+0000 7f5699d9b700 1 -- 172.21.15.72:0/1733297665 learned_addr learned my addr 172.21.15.72:0/1733297665 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.696+0000 7f569ad9d700 1 --1- 172.21.15.72:0/1733297665 >> v1:172.21.15.72:6789/0 conn(0x7f569c064b50 0x7f569c0bfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57658/0 (socket says 172.21.15.72:57658) 2023-08-31T19:07:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.696+0000 7f569a59c700 1 --2- 172.21.15.72:0/1733297665 >> v2:172.21.15.146:3300/0 conn(0x7f569c151da0 0x7f569c1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:01.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.697+0000 7f5699d9b700 1 -- 172.21.15.72:0/1733297665 >> v2:172.21.15.146:3300/0 conn(0x7f569c151da0 msgr2=0x7f569c1553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:01.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.697+0000 7f5699d9b700 1 --2- 172.21.15.72:0/1733297665 >> v2:172.21.15.146:3300/0 conn(0x7f569c151da0 0x7f569c1553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:01.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.697+0000 7f5699d9b700 1 -- 172.21.15.72:0/1733297665 >> v1:172.21.15.72:6789/0 conn(0x7f569c064b50 legacy=0x7f569c0bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:01.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.697+0000 7f5699d9b700 1 -- 172.21.15.72:0/1733297665 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c0aa2c0 con 0x7f569c0c5370 2023-08-31T19:07:01.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.697+0000 7f569959a700 1 -- 172.21.15.72:0/1733297665 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013841284 0 0) 0x7f569c154f40 con 0x7f569c064b50 2023-08-31T19:07:01.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.697+0000 7f5699d9b700 1 --2- 172.21.15.72:0/1733297665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f569c0c5370 0x7f569c064660 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f569c061630 tx=0x7f56900090f0).ready entity=mon.0 client_cookie=d476ab76a40e9e2d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:01.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.697+0000 7f569959a700 1 -- 172.21.15.72:0/1733297665 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569000b600 con 0x7f569c0c5370 2023-08-31T19:07:01.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.697+0000 7f569959a700 1 -- 172.21.15.72:0/1733297665 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569000b760 con 0x7f569c0c5370 2023-08-31T19:07:01.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.697+0000 7f569959a700 1 -- 172.21.15.72:0/1733297665 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569000bae0 con 0x7f569c0c5370 2023-08-31T19:07:01.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.697+0000 7f56a0bff700 1 -- 172.21.15.72:0/1733297665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f569c0c5370 msgr2=0x7f569c064660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:01.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.697+0000 7f56a0bff700 1 --2- 172.21.15.72:0/1733297665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f569c0c5370 0x7f569c064660 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f569c061630 tx=0x7f56900090f0).stop 2023-08-31T19:07:01.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.698+0000 7f56a0bff700 1 -- 172.21.15.72:0/1733297665 shutdown_connections 2023-08-31T19:07:01.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.698+0000 7f56a0bff700 1 --2- 172.21.15.72:0/1733297665 >> v2:172.21.15.146:3300/0 conn(0x7f569c151da0 0x7f569c1553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:01.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.698+0000 7f56a0bff700 1 --2- 172.21.15.72:0/1733297665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f569c0c5370 0x7f569c064660 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:01.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.698+0000 7f56a0bff700 1 -- 172.21.15.72:0/1733297665 >> 172.21.15.72:0/1733297665 conn(0x7f569c063a90 msgr2=0x7f569c0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:01.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.698+0000 7f56a0bff700 1 -- 172.21.15.72:0/1733297665 shutdown_connections 2023-08-31T19:07:01.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.698+0000 7f56a0bff700 1 -- 172.21.15.72:0/1733297665 wait complete. 2023-08-31T19:07:01.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.699+0000 7f56a0bff700 1 Processor -- start 2023-08-31T19:07:01.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.699+0000 7f56a0bff700 1 -- start start 2023-08-31T19:07:01.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.700+0000 7f56a0bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f569c064b50 0x7f569c0c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:01.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.700+0000 7f56a0bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f569c0c5370 0x7f569c0c2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:01.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.700+0000 7f56a0bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f569c151da0 0x7f569c14d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:01.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.700+0000 7f56a0bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c0c2530 con 0x7f569c151da0 2023-08-31T19:07:01.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.700+0000 7f56a0bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c0c3160 con 0x7f569c064b50 2023-08-31T19:07:01.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.700+0000 7f56a0bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c14d690 con 0x7f569c0c5370 2023-08-31T19:07:01.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.700+0000 7f569ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f569c151da0 0x7f569c14d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:01.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.700+0000 7f569ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f569c151da0 0x7f569c14d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33356/0 (socket says 172.21.15.72:33356) 2023-08-31T19:07:01.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.700+0000 7f569ad9d700 1 -- 172.21.15.72:0/2910716098 learned_addr learned my addr 172.21.15.72:0/2910716098 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:01.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.701+0000 7f5699d9b700 1 --2- 172.21.15.72:0/2910716098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f569c0c5370 0x7f569c0c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:01.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.701+0000 7f569ad9d700 1 -- 172.21.15.72:0/2910716098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f569c0c5370 msgr2=0x7f569c0c2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:01.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.701+0000 7f569ad9d700 1 --2- 172.21.15.72:0/2910716098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f569c0c5370 0x7f569c0c2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:01.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.701+0000 7f569ad9d700 1 -- 172.21.15.72:0/2910716098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f569c064b50 msgr2=0x7f569c0c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:01.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.701+0000 7f569ad9d700 1 --2- 172.21.15.72:0/2910716098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f569c064b50 0x7f569c0c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:01.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.701+0000 7f569ad9d700 1 -- 172.21.15.72:0/2910716098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5690009370 con 0x7f569c151da0 2023-08-31T19:07:01.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.701+0000 7f569ad9d700 1 --2- 172.21.15.72:0/2910716098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f569c151da0 0x7f569c14d1a0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f569400c730 tx=0x7f5694001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:01.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.701+0000 7f568a7fc700 1 -- 172.21.15.72:0/2910716098 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694005c70 con 0x7f569c151da0 2023-08-31T19:07:01.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.701+0000 7f568a7fc700 1 -- 172.21.15.72:0/2910716098 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5694005dd0 con 0x7f569c151da0 2023-08-31T19:07:01.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.701+0000 7f568a7fc700 1 -- 172.21.15.72:0/2910716098 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694007340 con 0x7f569c151da0 2023-08-31T19:07:01.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.701+0000 7f56a0bff700 1 -- 172.21.15.72:0/2910716098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c0c4e00 con 0x7f569c151da0 2023-08-31T19:07:01.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.701+0000 7f56a0bff700 1 -- 172.21.15.72:0/2910716098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c0c36e0 con 0x7f569c151da0 2023-08-31T19:07:01.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.702+0000 7f56a0bff700 1 -- 172.21.15.72:0/2910716098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569c06a7e0 con 0x7f569c151da0 2023-08-31T19:07:01.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.703+0000 7f568a7fc700 1 -- 172.21.15.72:0/2910716098 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 52) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f56940076f0 con 0x7f569c151da0 2023-08-31T19:07:01.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.704+0000 7f568a7fc700 1 --2- 172.21.15.72:0/2910716098 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f567c05f010 0x7f567c0614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:01.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.704+0000 7f568a7fc700 1 -- 172.21.15.72:0/2910716098 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f569407a4f0 con 0x7f569c151da0 2023-08-31T19:07:01.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.704+0000 7f569a59c700 1 --2- 172.21.15.72:0/2910716098 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f567c05f010 0x7f567c0614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:01.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.705+0000 7f569a59c700 1 --2- 172.21.15.72:0/2910716098 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f567c05f010 0x7f567c0614d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f568c00b8f0 tx=0x7f568c008040).ready entity=mgr.7168 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:01.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.708+0000 7f568a7fc700 1 -- 172.21.15.72:0/2910716098 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f569404b300 con 0x7f569c151da0 2023-08-31T19:07:01.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.902+0000 7f56a0bff700 1 -- 172.21.15.72:0/2910716098 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f569c06c6b0 con 0x7f567c05f010 2023-08-31T19:07:01.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.907+0000 7f568a7fc700 1 -- 172.21.15.72:0/2910716098 <== mgr.7168 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f569c06c6b0 con 0x7f567c05f010 2023-08-31T19:07:01.907 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path snap_test_dir1 2023-08-31T19:07:01.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.908+0000 7f56a0bff700 1 -- 172.21.15.72:0/2910716098 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f567c05f010 msgr2=0x7f567c0614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:01.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.908+0000 7f56a0bff700 1 --2- 172.21.15.72:0/2910716098 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f567c05f010 0x7f567c0614d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f568c00b8f0 tx=0x7f568c008040).stop 2023-08-31T19:07:01.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.909+0000 7f56a0bff700 1 -- 172.21.15.72:0/2910716098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f569c151da0 msgr2=0x7f569c14d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:01.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.909+0000 7f56a0bff700 1 --2- 172.21.15.72:0/2910716098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f569c151da0 0x7f569c14d1a0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f569400c730 tx=0x7f5694001520).stop 2023-08-31T19:07:01.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.909+0000 7f56a0bff700 1 -- 172.21.15.72:0/2910716098 shutdown_connections 2023-08-31T19:07:01.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.909+0000 7f56a0bff700 1 --2- 172.21.15.72:0/2910716098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f569c151da0 0x7f569c14d1a0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:01.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.909+0000 7f56a0bff700 1 --2- 172.21.15.72:0/2910716098 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f567c05f010 0x7f567c0614d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:01.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.909+0000 7f56a0bff700 1 --2- 172.21.15.72:0/2910716098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f569c064b50 0x7f569c0c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:01.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.909+0000 7f56a0bff700 1 --2- 172.21.15.72:0/2910716098 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f569c0c5370 0x7f569c0c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:01.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.909+0000 7f56a0bff700 1 -- 172.21.15.72:0/2910716098 >> 172.21.15.72:0/2910716098 conn(0x7f569c063a90 msgr2=0x7f569c0c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:01.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.909+0000 7f56a0bff700 1 -- 172.21.15.72:0/2910716098 shutdown_connections 2023-08-31T19:07:01.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:01.909+0000 7f56a0bff700 1 -- 172.21.15.72:0/2910716098 wait complete. 2023-08-31T19:07:01.926 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-31T19:07:01.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:07:01.927 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:07:01.975 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_07_00_UTC 2023-08-31T19:07:01.977 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-31-19_07_00_UTC 2023-08-31T19:07:01.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:07:01.978 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-31-19_07_00_UTC) 2023-08-31T19:07:02.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:07:02.031 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-31T19:07:02.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-31T19:07:02.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.271+0000 7f3a8d7ff700 1 Processor -- start 2023-08-31T19:07:02.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.271+0000 7f3a8d7ff700 1 -- start start 2023-08-31T19:07:02.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.273+0000 7f3a8d7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a88154410 0x7f3a880c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:02.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.273+0000 7f3a8d7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a880c6ed0 con 0x7f3a880c7360 2023-08-31T19:07:02.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.273+0000 7f3a8d7ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a880c68c0 con 0x7f3a88154030 2023-08-31T19:07:02.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.273+0000 7f3a8d7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880c66e0 con 0x7f3a88154410 2023-08-31T19:07:02.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.273+0000 7f3a877fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3a880c7360 0x7f3a88063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57666/0 (socket says 172.21.15.72:57666) 2023-08-31T19:07:02.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.273+0000 7f3a877fe700 1 -- 172.21.15.72:0/1864175216 learned_addr learned my addr 172.21.15.72:0/1864175216 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:02.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.273+0000 7f3a867fc700 1 --2- 172.21.15.72:0/1864175216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a88154410 0x7f3a880c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:02.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.273+0000 7f3a85ffb700 1 -- 172.21.15.72:0/1864175216 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466577448 0 0) 0x7f3a880c6ed0 con 0x7f3a880c7360 2023-08-31T19:07:02.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.273+0000 7f3a85ffb700 1 -- 172.21.15.72:0/1864175216 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a700033f0 con 0x7f3a880c7360 2023-08-31T19:07:02.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.274+0000 7f3a85ffb700 1 -- 172.21.15.72:0/1864175216 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610042044 0 0) 0x7f3a880c68c0 con 0x7f3a88154030 2023-08-31T19:07:02.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.274+0000 7f3a85ffb700 1 -- 172.21.15.72:0/1864175216 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a880c6ed0 con 0x7f3a88154030 2023-08-31T19:07:02.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.274+0000 7f3a85ffb700 1 -- 172.21.15.72:0/1864175216 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1365686948 0 0) 0x7f3a700033f0 con 0x7f3a880c7360 2023-08-31T19:07:02.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.274+0000 7f3a867fc700 1 -- 172.21.15.72:0/1864175216 >> v1:172.21.15.146:6789/0 conn(0x7f3a88154030 legacy=0x7f3a880aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:02.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.274+0000 7f3a867fc700 1 -- 172.21.15.72:0/1864175216 >> v1:172.21.15.72:6789/0 conn(0x7f3a880c7360 legacy=0x7f3a88063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:02.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.274+0000 7f3a867fc700 1 -- 172.21.15.72:0/1864175216 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a880c0f30 con 0x7f3a88154410 2023-08-31T19:07:02.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.274+0000 7f3a867fc700 1 --2- 172.21.15.72:0/1864175216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a88154410 0x7f3a880c06b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3a7c009790 tx=0x7f3a7c009060).ready entity=mon.2 client_cookie=e1b186bc1546dffc server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:02.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.274+0000 7f3a85ffb700 1 -- 172.21.15.72:0/1864175216 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a800017f0 con 0x7f3a88154410 2023-08-31T19:07:02.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.274+0000 7f3a85ffb700 1 -- 172.21.15.72:0/1864175216 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c011400 con 0x7f3a88154410 2023-08-31T19:07:02.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.274+0000 7f3a85ffb700 1 -- 172.21.15.72:0/1864175216 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c011780 con 0x7f3a88154410 2023-08-31T19:07:02.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.275+0000 7f3a8d7ff700 1 -- 172.21.15.72:0/1864175216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a88154410 msgr2=0x7f3a880c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:02.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.275+0000 7f3a8d7ff700 1 --2- 172.21.15.72:0/1864175216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a88154410 0x7f3a880c06b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3a7c009790 tx=0x7f3a7c009060).stop 2023-08-31T19:07:02.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.275+0000 7f3a8d7ff700 1 -- 172.21.15.72:0/1864175216 shutdown_connections 2023-08-31T19:07:02.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.275+0000 7f3a8d7ff700 1 --2- 172.21.15.72:0/1864175216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a88154410 0x7f3a880c06b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:02.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.275+0000 7f3a8d7ff700 1 -- 172.21.15.72:0/1864175216 >> 172.21.15.72:0/1864175216 conn(0x7f3a8805eb60 msgr2=0x7f3a880cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:02.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.275+0000 7f3a8d7ff700 1 -- 172.21.15.72:0/1864175216 shutdown_connections 2023-08-31T19:07:02.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.275+0000 7f3a8d7ff700 1 -- 172.21.15.72:0/1864175216 wait complete. 2023-08-31T19:07:02.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.276+0000 7f3a8d7ff700 1 Processor -- start 2023-08-31T19:07:02.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.276+0000 7f3a8d7ff700 1 -- start start 2023-08-31T19:07:02.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.277+0000 7f3a8d7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a880c7360 0x7f3a88153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:02.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.277+0000 7f3a8d7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a88154030 0x7f3a8814db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:02.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.277+0000 7f3a8d7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a88154410 0x7f3a880c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:02.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.277+0000 7f3a8d7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880c4770 con 0x7f3a880c7360 2023-08-31T19:07:02.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.277+0000 7f3a8d7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8814e010 con 0x7f3a88154410 2023-08-31T19:07:02.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.277+0000 7f3a8d7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880aeca0 con 0x7f3a88154030 2023-08-31T19:07:02.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a86ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a880c7360 0x7f3a88153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:02.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a86ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a880c7360 0x7f3a88153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33372/0 (socket says 172.21.15.72:33372) 2023-08-31T19:07:02.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a86ffd700 1 -- 172.21.15.72:0/959623892 learned_addr learned my addr 172.21.15.72:0/959623892 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:02.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a867fc700 1 --2- 172.21.15.72:0/959623892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a88154030 0x7f3a8814db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:02.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a877fe700 1 --2- 172.21.15.72:0/959623892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a88154410 0x7f3a880c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:02.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a86ffd700 1 -- 172.21.15.72:0/959623892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a88154030 msgr2=0x7f3a8814db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:02.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a86ffd700 1 --2- 172.21.15.72:0/959623892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a88154030 0x7f3a8814db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:02.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a86ffd700 1 -- 172.21.15.72:0/959623892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a88154410 msgr2=0x7f3a880c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:02.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a86ffd700 1 --2- 172.21.15.72:0/959623892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a88154410 0x7f3a880c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:02.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a86ffd700 1 -- 172.21.15.72:0/959623892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c0092a0 con 0x7f3a880c7360 2023-08-31T19:07:02.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a867fc700 1 --2- 172.21.15.72:0/959623892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a88154030 0x7f3a8814db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:02.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a86ffd700 1 --2- 172.21.15.72:0/959623892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a880c7360 0x7f3a88153210 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f3a7800c490 tx=0x7f3a78007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:02.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a6effd700 1 -- 172.21.15.72:0/959623892 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7800f470 con 0x7f3a880c7360 2023-08-31T19:07:02.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a6effd700 1 -- 172.21.15.72:0/959623892 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7800f5d0 con 0x7f3a880c7360 2023-08-31T19:07:02.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a8d7ff700 1 -- 172.21.15.72:0/959623892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a880ae970 con 0x7f3a880c7360 2023-08-31T19:07:02.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.278+0000 7f3a6effd700 1 -- 172.21.15.72:0/959623892 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7800f970 con 0x7f3a880c7360 2023-08-31T19:07:02.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.279+0000 7f3a8d7ff700 1 -- 172.21.15.72:0/959623892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a880c29c0 con 0x7f3a880c7360 2023-08-31T19:07:02.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.280+0000 7f3a8d7ff700 1 -- 172.21.15.72:0/959623892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8806c6b0 con 0x7f3a880c7360 2023-08-31T19:07:02.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.280+0000 7f3a6effd700 1 -- 172.21.15.72:0/959623892 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 52) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f3a7800fd20 con 0x7f3a880c7360 2023-08-31T19:07:02.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.281+0000 7f3a6effd700 1 --2- 172.21.15.72:0/959623892 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3a7405f010 0x7f3a740614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:02.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.281+0000 7f3a6effd700 1 -- 172.21.15.72:0/959623892 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f3a78079a50 con 0x7f3a880c7360 2023-08-31T19:07:02.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.281+0000 7f3a867fc700 1 --2- 172.21.15.72:0/959623892 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3a7405f010 0x7f3a740614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:02.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.282+0000 7f3a867fc700 1 --2- 172.21.15.72:0/959623892 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3a7405f010 0x7f3a740614d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3a7c0096e0 tx=0x7f3a7c016000).ready entity=mgr.7168 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:02.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.285+0000 7f3a6effd700 1 -- 172.21.15.72:0/959623892 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3a7804a960 con 0x7f3a880c7360 2023-08-31T19:07:02.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.502+0000 7f3a8d7ff700 1 -- 172.21.15.72:0/959623892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f3a880c0c50 con 0x7f3a880c7360 2023-08-31T19:07:02.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.594+0000 7f3a6effd700 1 -- 172.21.15.72:0/959623892 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 53) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f3a780772c0 con 0x7f3a880c7360 2023-08-31T19:07:02.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.595+0000 7f3a6effd700 1 -- 172.21.15.72:0/959623892 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v53) v1 ==== 93+0+0 (secure 0 0 0) 0x7f3a78072c70 con 0x7f3a880c7360 2023-08-31T19:07:02.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.598+0000 7f3a8d7ff700 1 -- 172.21.15.72:0/959623892 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3a7405f010 msgr2=0x7f3a740614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:02.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.598+0000 7f3a8d7ff700 1 --2- 172.21.15.72:0/959623892 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3a7405f010 0x7f3a740614d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3a7c0096e0 tx=0x7f3a7c016000).stop 2023-08-31T19:07:02.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.598+0000 7f3a8d7ff700 1 -- 172.21.15.72:0/959623892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a880c7360 msgr2=0x7f3a88153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:02.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.598+0000 7f3a8d7ff700 1 --2- 172.21.15.72:0/959623892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a880c7360 0x7f3a88153210 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f3a7800c490 tx=0x7f3a78007c90).stop 2023-08-31T19:07:02.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.598+0000 7f3a8d7ff700 1 -- 172.21.15.72:0/959623892 shutdown_connections 2023-08-31T19:07:02.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.598+0000 7f3a8d7ff700 1 --2- 172.21.15.72:0/959623892 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3a7405f010 0x7f3a740614d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:02.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.598+0000 7f3a8d7ff700 1 --2- 172.21.15.72:0/959623892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a88154410 0x7f3a880c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:02.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.598+0000 7f3a8d7ff700 1 --2- 172.21.15.72:0/959623892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a880c7360 0x7f3a88153210 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:02.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.598+0000 7f3a8d7ff700 1 --2- 172.21.15.72:0/959623892 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3a88154030 0x7f3a8814db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:02.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.598+0000 7f3a8d7ff700 1 -- 172.21.15.72:0/959623892 >> 172.21.15.72:0/959623892 conn(0x7f3a8805eb60 msgr2=0x7f3a88150550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:02.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.598+0000 7f3a8d7ff700 1 -- 172.21.15.72:0/959623892 shutdown_connections 2023-08-31T19:07:02.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:02.598+0000 7f3a8d7ff700 1 -- 172.21.15.72:0/959623892 wait complete. 2023-08-31T19:07:02.616 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:07:02.617 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:07:02.726 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:07:02.807 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:02.806+0000 7f3d69e1b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:07:02.811 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:02.810+0000 7f0af00b6680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:07:02.821 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:07:02.822 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-31T19:07:02.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:07:02.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-31T19:07:02.886 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:02.886+0000 7f3d69e1b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:07:02.898 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:02.897+0000 7f0af00b6680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:07:02.923 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T19:07:02.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:07:02.924 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T19:07:02.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:07:03.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.203+0000 7f1b999ff700 1 Processor -- start 2023-08-31T19:07:03.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.203+0000 7f1b999ff700 1 -- start start 2023-08-31T19:07:03.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.204+0000 7f1b999ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b94153ff0 0x7f1b940bcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:03.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.204+0000 7f1b999ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b941543d0 0x7f1b940643f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:03.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.204+0000 7f1b999ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b940bc920 con 0x7f1b940648e0 2023-08-31T19:07:03.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.204+0000 7f1b999ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b94064d70 con 0x7f1b94153ff0 2023-08-31T19:07:03.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.204+0000 7f1b999ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b940bbff0 con 0x7f1b941543d0 2023-08-31T19:07:03.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.205+0000 7f1b92ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b94153ff0 0x7f1b940bcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:03.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.205+0000 7f1b92ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b94153ff0 0x7f1b940bcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46288/0 (socket says 172.21.15.72:46288) 2023-08-31T19:07:03.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.205+0000 7f1b92ffd700 1 -- 172.21.15.72:0/4035669755 learned_addr learned my addr 172.21.15.72:0/4035669755 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:03.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.205+0000 7f1b937fe700 1 --1- 172.21.15.72:0/4035669755 >> v1:172.21.15.72:6789/0 conn(0x7f1b940648e0 0x7f1b940c1e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54660/0 (socket says 172.21.15.72:54660) 2023-08-31T19:07:03.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.205+0000 7f1b927fc700 1 --2- 172.21.15.72:0/4035669755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b941543d0 0x7f1b940643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:03.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.205+0000 7f1b92ffd700 1 -- 172.21.15.72:0/4035669755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b941543d0 msgr2=0x7f1b940643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:03.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.205+0000 7f1b92ffd700 1 --2- 172.21.15.72:0/4035669755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b941543d0 0x7f1b940643f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:03.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.205+0000 7f1b92ffd700 1 -- 172.21.15.72:0/4035669755 >> v1:172.21.15.72:6789/0 conn(0x7f1b940648e0 legacy=0x7f1b940c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:03.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.205+0000 7f1b92ffd700 1 -- 172.21.15.72:0/4035669755 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b940bc2d0 con 0x7f1b94153ff0 2023-08-31T19:07:03.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.205+0000 7f1b92ffd700 1 --2- 172.21.15.72:0/4035669755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b94153ff0 0x7f1b940bcdb0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f1b84006fd0 tx=0x7f1b840090f0).ready entity=mon.0 client_cookie=f621f49885fe8c30 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:03.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.205+0000 7f1b91ffb700 1 -- 172.21.15.72:0/4035669755 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8400b690 con 0x7f1b94153ff0 2023-08-31T19:07:03.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.206+0000 7f1b91ffb700 1 -- 172.21.15.72:0/4035669755 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8400b7f0 con 0x7f1b94153ff0 2023-08-31T19:07:03.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.206+0000 7f1b91ffb700 1 -- 172.21.15.72:0/4035669755 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8400bb70 con 0x7f1b94153ff0 2023-08-31T19:07:03.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.206+0000 7f1b999ff700 1 -- 172.21.15.72:0/4035669755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b94153ff0 msgr2=0x7f1b940bcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:03.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.206+0000 7f1b999ff700 1 --2- 172.21.15.72:0/4035669755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b94153ff0 0x7f1b940bcdb0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f1b84006fd0 tx=0x7f1b840090f0).stop 2023-08-31T19:07:03.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.206+0000 7f1b999ff700 1 -- 172.21.15.72:0/4035669755 shutdown_connections 2023-08-31T19:07:03.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.206+0000 7f1b999ff700 1 --2- 172.21.15.72:0/4035669755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b94153ff0 0x7f1b940bcdb0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:03.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.206+0000 7f1b999ff700 1 --2- 172.21.15.72:0/4035669755 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b941543d0 0x7f1b940643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:03.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.206+0000 7f1b999ff700 1 -- 172.21.15.72:0/4035669755 >> 172.21.15.72:0/4035669755 conn(0x7f1b940c6b10 msgr2=0x7f1b940c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:03.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.206+0000 7f1b999ff700 1 -- 172.21.15.72:0/4035669755 shutdown_connections 2023-08-31T19:07:03.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.206+0000 7f1b999ff700 1 -- 172.21.15.72:0/4035669755 wait complete. 2023-08-31T19:07:03.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.209+0000 7f1b999ff700 1 Processor -- start 2023-08-31T19:07:03.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.209+0000 7f1b999ff700 1 -- start start 2023-08-31T19:07:03.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.210+0000 7f1b999ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b940648e0 0x7f1b94151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:03.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.210+0000 7f1b999ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b94153ff0 0x7f1b940a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:03.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.210+0000 7f1b999ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b941543d0 0x7f1b940bfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:03.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.210+0000 7f1b999ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b940a9010 con 0x7f1b941543d0 2023-08-31T19:07:03.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.210+0000 7f1b999ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b940a7700 con 0x7f1b940648e0 2023-08-31T19:07:03.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.210+0000 7f1b999ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b94152290 con 0x7f1b94153ff0 2023-08-31T19:07:03.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.211+0000 7f1b937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b941543d0 0x7f1b940bfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:03.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.211+0000 7f1b937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b941543d0 0x7f1b940bfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46298/0 (socket says 172.21.15.72:46298) 2023-08-31T19:07:03.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.211+0000 7f1b92ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b940648e0 0x7f1b94151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:03.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.211+0000 7f1b937fe700 1 -- 172.21.15.72:0/928275449 learned_addr learned my addr 172.21.15.72:0/928275449 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:03.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.211+0000 7f1b927fc700 1 --2- 172.21.15.72:0/928275449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b94153ff0 0x7f1b940a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:03.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.211+0000 7f1b937fe700 1 -- 172.21.15.72:0/928275449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b94153ff0 msgr2=0x7f1b940a7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:03.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.211+0000 7f1b937fe700 1 --2- 172.21.15.72:0/928275449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b94153ff0 0x7f1b940a7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:03.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.211+0000 7f1b937fe700 1 -- 172.21.15.72:0/928275449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b940648e0 msgr2=0x7f1b94151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:03.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.211+0000 7f1b937fe700 1 --2- 172.21.15.72:0/928275449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b940648e0 0x7f1b94151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:03.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.211+0000 7f1b937fe700 1 -- 172.21.15.72:0/928275449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b84009370 con 0x7f1b941543d0 2023-08-31T19:07:03.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.211+0000 7f1b937fe700 1 --2- 172.21.15.72:0/928275449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b941543d0 0x7f1b940bfc30 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f1b8c00c7c0 tx=0x7f1b8c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:03.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.212+0000 7f1b7affd700 1 -- 172.21.15.72:0/928275449 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c005c70 con 0x7f1b941543d0 2023-08-31T19:07:03.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.212+0000 7f1b7affd700 1 -- 172.21.15.72:0/928275449 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c005dd0 con 0x7f1b941543d0 2023-08-31T19:07:03.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.212+0000 7f1b7affd700 1 -- 172.21.15.72:0/928275449 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c0072e0 con 0x7f1b941543d0 2023-08-31T19:07:03.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.212+0000 7f1b999ff700 1 -- 172.21.15.72:0/928275449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b940a6af0 con 0x7f1b941543d0 2023-08-31T19:07:03.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.212+0000 7f1b999ff700 1 -- 172.21.15.72:0/928275449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b940a7130 con 0x7f1b941543d0 2023-08-31T19:07:03.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.213+0000 7f1b999ff700 1 -- 172.21.15.72:0/928275449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9406c6b0 con 0x7f1b941543d0 2023-08-31T19:07:03.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.214+0000 7f1b7affd700 1 -- 172.21.15.72:0/928275449 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 53) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f1b8c007690 con 0x7f1b941543d0 2023-08-31T19:07:03.219 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:03.216+0000 7f3d69e1b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:07:03.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.215+0000 7f1b7affd700 1 --2- 172.21.15.72:0/928275449 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1b8005f050 0x7f1b80061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:03.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.215+0000 7f1b7affd700 1 -- 172.21.15.72:0/928275449 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f1b8c079f20 con 0x7f1b941543d0 2023-08-31T19:07:03.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.215+0000 7f1b92ffd700 1 -- 172.21.15.72:0/928275449 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1b8005f050 msgr2=0x7f1b80061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:03.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.215+0000 7f1b92ffd700 1 --2- 172.21.15.72:0/928275449 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1b8005f050 0x7f1b80061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:03.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.219+0000 7f1b7affd700 1 -- 172.21.15.72:0/928275449 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1b8c04ac70 con 0x7f1b941543d0 2023-08-31T19:07:03.251 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:03.251+0000 7f0af00b6680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:07:03.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.416+0000 7f1b92ffd700 1 -- 172.21.15.72:0/928275449 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1b8005f050 msgr2=0x7f1b80061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:03.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.416+0000 7f1b92ffd700 1 --2- 172.21.15.72:0/928275449 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1b8005f050 0x7f1b80061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:07:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.434+0000 7f1b999ff700 1 -- 172.21.15.72:0/928275449 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b94153c10 con 0x7f1b941543d0 2023-08-31T19:07:03.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.435+0000 7f1b7affd700 1 -- 172.21.15.72:0/928275449 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f1b8c04e290 con 0x7f1b941543d0 2023-08-31T19:07:03.435 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:03.436 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2018270382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2018270382},{"type":"v1","addr":"172.21.15.72:6837","nonce":2018270382}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2754540175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2754540175},{"type":"v1","addr":"172.21.15.146:6835","nonce":2754540175}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":7042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/488665385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":488665385},{"type":"v1","addr":"172.21.15.146:6834","nonce":488665385}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:06:15.992239+0000","modified":"2023-08-31T19:06:19.009090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7590},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7590":{"gid":7590,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6835/2456627257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2456627257},{"type":"v1","addr":"172.21.15.72:6835","nonce":2456627257}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-31T19:07:03.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.437+0000 7f1b999ff700 1 -- 172.21.15.72:0/928275449 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1b8005f050 msgr2=0x7f1b80061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:03.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.437+0000 7f1b999ff700 1 --2- 172.21.15.72:0/928275449 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1b8005f050 0x7f1b80061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:03.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.437+0000 7f1b999ff700 1 -- 172.21.15.72:0/928275449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b941543d0 msgr2=0x7f1b940bfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:03.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.437+0000 7f1b999ff700 1 --2- 172.21.15.72:0/928275449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b941543d0 0x7f1b940bfc30 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f1b8c00c7c0 tx=0x7f1b8c0015e0).stop 2023-08-31T19:07:03.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.437+0000 7f1b999ff700 1 -- 172.21.15.72:0/928275449 shutdown_connections 2023-08-31T19:07:03.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.437+0000 7f1b999ff700 1 --2- 172.21.15.72:0/928275449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b941543d0 0x7f1b940bfc30 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:03.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.437+0000 7f1b999ff700 1 --2- 172.21.15.72:0/928275449 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1b8005f050 0x7f1b80061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:03.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.437+0000 7f1b999ff700 1 --2- 172.21.15.72:0/928275449 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b940648e0 0x7f1b94151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:03.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.437+0000 7f1b999ff700 1 --2- 172.21.15.72:0/928275449 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b94153ff0 0x7f1b940a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:03.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.437+0000 7f1b999ff700 1 -- 172.21.15.72:0/928275449 >> 172.21.15.72:0/928275449 conn(0x7f1b940c6b10 msgr2=0x7f1b940c13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:03.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.437+0000 7f1b999ff700 1 -- 172.21.15.72:0/928275449 shutdown_connections 2023-08-31T19:07:03.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.437+0000 7f1b999ff700 1 -- 172.21.15.72:0/928275449 wait complete. 2023-08-31T19:07:03.440 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 56 2023-08-31T19:07:03.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:07:03.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.650+0000 7fb98f9ff700 1 Processor -- start 2023-08-31T19:07:03.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.650+0000 7fb98f9ff700 1 -- start start 2023-08-31T19:07:03.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.652+0000 7fb98f9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9881583f0 0x7fb98815ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:03.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.652+0000 7fb98f9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb988063be0 con 0x7fb9880c4740 2023-08-31T19:07:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.652+0000 7fb98f9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb988063010 con 0x7fb9880c6c30 2023-08-31T19:07:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.652+0000 7fb98f9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9880bca10 con 0x7fb9881583f0 2023-08-31T19:07:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.652+0000 7fb98cf9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb9880c4740 0x7fb988157ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54676/0 (socket says 172.21.15.72:54676) 2023-08-31T19:07:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.652+0000 7fb98cf9a700 1 -- 172.21.15.72:0/4281775081 learned_addr learned my addr 172.21.15.72:0/4281775081 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:03.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.652+0000 7fb98df9c700 1 --2- 172.21.15.72:0/4281775081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9881583f0 0x7fb98815ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.652+0000 7fb97ffff700 1 -- 172.21.15.72:0/4281775081 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781977603 0 0) 0x7fb988063be0 con 0x7fb9880c4740 2023-08-31T19:07:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.652+0000 7fb97ffff700 1 -- 172.21.15.72:0/4281775081 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9740033f0 con 0x7fb9880c4740 2023-08-31T19:07:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.653+0000 7fb97ffff700 1 -- 172.21.15.72:0/4281775081 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826638086 0 0) 0x7fb988063010 con 0x7fb9880c6c30 2023-08-31T19:07:03.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.653+0000 7fb97ffff700 1 -- 172.21.15.72:0/4281775081 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb988063be0 con 0x7fb9880c6c30 2023-08-31T19:07:03.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.653+0000 7fb97ffff700 1 -- 172.21.15.72:0/4281775081 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1251713225 0 0) 0x7fb9740033f0 con 0x7fb9880c4740 2023-08-31T19:07:03.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.653+0000 7fb98df9c700 1 -- 172.21.15.72:0/4281775081 >> v1:172.21.15.146:6789/0 conn(0x7fb9880c6c30 legacy=0x7fb9880bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:03.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.653+0000 7fb98df9c700 1 -- 172.21.15.72:0/4281775081 >> v1:172.21.15.72:6789/0 conn(0x7fb9880c4740 legacy=0x7fb988157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:03.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.653+0000 7fb98df9c700 1 -- 172.21.15.72:0/4281775081 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9880632b0 con 0x7fb9881583f0 2023-08-31T19:07:03.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.653+0000 7fb98df9c700 1 --2- 172.21.15.72:0/4281775081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9881583f0 0x7fb98815ee70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb980009e90 tx=0x7fb980009780).ready entity=mon.2 client_cookie=4cb4032bc9a98259 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.653+0000 7fb97ffff700 1 -- 172.21.15.72:0/4281775081 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98000e070 con 0x7fb9881583f0 2023-08-31T19:07:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.653+0000 7fb97ffff700 1 -- 172.21.15.72:0/4281775081 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98000b7a0 con 0x7fb9881583f0 2023-08-31T19:07:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.653+0000 7fb97ffff700 1 -- 172.21.15.72:0/4281775081 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978001470 con 0x7fb9881583f0 2023-08-31T19:07:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.654+0000 7fb98f9ff700 1 -- 172.21.15.72:0/4281775081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9881583f0 msgr2=0x7fb98815ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:03.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.654+0000 7fb98f9ff700 1 --2- 172.21.15.72:0/4281775081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9881583f0 0x7fb98815ee70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb980009e90 tx=0x7fb980009780).stop 2023-08-31T19:07:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.654+0000 7fb98f9ff700 1 -- 172.21.15.72:0/4281775081 shutdown_connections 2023-08-31T19:07:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.654+0000 7fb98f9ff700 1 --2- 172.21.15.72:0/4281775081 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9881583f0 0x7fb98815ee70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.654+0000 7fb98f9ff700 1 -- 172.21.15.72:0/4281775081 >> 172.21.15.72:0/4281775081 conn(0x7fb9880c7e70 msgr2=0x7fb9880c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:03.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.654+0000 7fb98f9ff700 1 -- 172.21.15.72:0/4281775081 shutdown_connections 2023-08-31T19:07:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.654+0000 7fb98f9ff700 1 -- 172.21.15.72:0/4281775081 wait complete. 2023-08-31T19:07:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.656+0000 7fb98f9ff700 1 Processor -- start 2023-08-31T19:07:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.656+0000 7fb98f9ff700 1 -- start start 2023-08-31T19:07:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98f9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9880c4740 0x7fb9880a9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:03.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98f9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9880c6c30 0x7fb988150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:03.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98f9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9881583f0 0x7fb9880a89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:03.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98f9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9880ab8b0 con 0x7fb9881583f0 2023-08-31T19:07:03.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98f9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9880aaca0 con 0x7fb9880c4740 2023-08-31T19:07:03.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98f9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9880aaf80 con 0x7fb9880c6c30 2023-08-31T19:07:03.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98df9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9881583f0 0x7fb9880a89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98df9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9881583f0 0x7fb9880a89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46304/0 (socket says 172.21.15.72:46304) 2023-08-31T19:07:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98df9c700 1 -- 172.21.15.72:0/2714843436 learned_addr learned my addr 172.21.15.72:0/2714843436 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98d79b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9880c4740 0x7fb9880a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98cf9a700 1 --2- 172.21.15.72:0/2714843436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9880c6c30 0x7fb988150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:03.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98df9c700 1 -- 172.21.15.72:0/2714843436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9880c6c30 msgr2=0x7fb988150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98df9c700 1 --2- 172.21.15.72:0/2714843436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9880c6c30 0x7fb988150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98df9c700 1 -- 172.21.15.72:0/2714843436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9880c4740 msgr2=0x7fb9880a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98df9c700 1 --2- 172.21.15.72:0/2714843436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9880c4740 0x7fb9880a9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98df9c700 1 -- 172.21.15.72:0/2714843436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb980009a20 con 0x7fb9881583f0 2023-08-31T19:07:03.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.657+0000 7fb98d79b700 1 --2- 172.21.15.72:0/2714843436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9880c4740 0x7fb9880a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:07:03.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.658+0000 7fb98df9c700 1 --2- 172.21.15.72:0/2714843436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9881583f0 0x7fb9880a89e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fb980011000 tx=0x7fb988155720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:03.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.658+0000 7fb97d7fa700 1 -- 172.21.15.72:0/2714843436 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98001d440 con 0x7fb9881583f0 2023-08-31T19:07:03.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.658+0000 7fb97d7fa700 1 -- 172.21.15.72:0/2714843436 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98001d5a0 con 0x7fb9881583f0 2023-08-31T19:07:03.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.658+0000 7fb98f9ff700 1 -- 172.21.15.72:0/2714843436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9880ab260 con 0x7fb9881583f0 2023-08-31T19:07:03.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.658+0000 7fb97d7fa700 1 -- 172.21.15.72:0/2714843436 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98001d940 con 0x7fb9881583f0 2023-08-31T19:07:03.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.658+0000 7fb98f9ff700 1 -- 172.21.15.72:0/2714843436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9880a9d40 con 0x7fb9881583f0 2023-08-31T19:07:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.659+0000 7fb98f9ff700 1 -- 172.21.15.72:0/2714843436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9880aba20 con 0x7fb9881583f0 2023-08-31T19:07:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.660+0000 7fb97d7fa700 1 -- 172.21.15.72:0/2714843436 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 53) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fb98001dcf0 con 0x7fb9881583f0 2023-08-31T19:07:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.661+0000 7fb97d7fa700 1 --2- 172.21.15.72:0/2714843436 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb96c05f050 0x7fb96c061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.661+0000 7fb97d7fa700 1 -- 172.21.15.72:0/2714843436 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6979+0+0 (secure 0 0 0) 0x7fb98007c6a0 con 0x7fb9881583f0 2023-08-31T19:07:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.661+0000 7fb98d79b700 1 -- 172.21.15.72:0/2714843436 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb96c05f050 msgr2=0x7fb96c061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.661+0000 7fb98d79b700 1 --2- 172.21.15.72:0/2714843436 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb96c05f050 0x7fb96c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:03.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.665+0000 7fb97d7fa700 1 -- 172.21.15.72:0/2714843436 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb98004d2e0 con 0x7fb9881583f0 2023-08-31T19:07:03.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.838+0000 7fb98f9ff700 1 -- 172.21.15.72:0/2714843436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9880c5ca0 con 0x7fb9881583f0 2023-08-31T19:07:03.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.839+0000 7fb97d7fa700 1 -- 172.21.15.72:0/2714843436 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+18313 (secure 0 0 0) 0x7fb980050900 con 0x7fb9881583f0 2023-08-31T19:07:03.843 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:03.843 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":127,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:06:30.413886+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:06:13.809620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-31T19:06:14.978639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/753946871":"2023-09-01T19:06:30.413851+0000","172.21.15.72:0/1048677090":"2023-09-01T19:06:30.413851+0000","172.21.15.72:6833/143463":"2023-09-01T19:06:30.413851+0000","172.21.15.72:6832/143463":"2023-09-01T19:06:30.413851+0000","172.21.15.72:0/1676737569":"2023-09-01T19:06:30.413851+0000","172.21.15.72:0/458944015":"2023-09-01T19:06:30.413851+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:07:03.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.841+0000 7fb98f9ff700 1 -- 172.21.15.72:0/2714843436 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb96c05f050 msgr2=0x7fb96c061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:03.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.841+0000 7fb98f9ff700 1 --2- 172.21.15.72:0/2714843436 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb96c05f050 0x7fb96c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:03.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.841+0000 7fb98f9ff700 1 -- 172.21.15.72:0/2714843436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9881583f0 msgr2=0x7fb9880a89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:03.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.841+0000 7fb98f9ff700 1 --2- 172.21.15.72:0/2714843436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9881583f0 0x7fb9880a89e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fb980011000 tx=0x7fb988155720).stop 2023-08-31T19:07:03.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.841+0000 7fb98f9ff700 1 -- 172.21.15.72:0/2714843436 shutdown_connections 2023-08-31T19:07:03.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.841+0000 7fb98f9ff700 1 --2- 172.21.15.72:0/2714843436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9881583f0 0x7fb9880a89e0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:03.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.841+0000 7fb98f9ff700 1 --2- 172.21.15.72:0/2714843436 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb96c05f050 0x7fb96c061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:03.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.841+0000 7fb98f9ff700 1 --2- 172.21.15.72:0/2714843436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9880c4740 0x7fb9880a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:03.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.841+0000 7fb98f9ff700 1 --2- 172.21.15.72:0/2714843436 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb9880c6c30 0x7fb988150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:03.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.841+0000 7fb98f9ff700 1 -- 172.21.15.72:0/2714843436 >> 172.21.15.72:0/2714843436 conn(0x7fb9880c7e70 msgr2=0x7fb988064b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:03.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.842+0000 7fb98f9ff700 1 -- 172.21.15.72:0/2714843436 shutdown_connections 2023-08-31T19:07:03.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:03.842+0000 7fb98f9ff700 1 -- 172.21.15.72:0/2714843436 wait complete. 2023-08-31T19:07:03.860 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:06:13.809620+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:06:14.978639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:07:03.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:07:03.961 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:03.961+0000 7f3d69e1b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:07:04.039 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:04.039+0000 7f0af00b6680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:07:04.046 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:04.046+0000 7f3d69e1b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:07:04.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.086+0000 7f29e47ff700 1 Processor -- start 2023-08-31T19:07:04.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.087+0000 7f29e47ff700 1 -- start start 2023-08-31T19:07:04.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.088+0000 7f29e47ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f29dc154030 0x7f29dc154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.088+0000 7f29e47ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f29dc0c06b0 0x7f29dc0c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.088+0000 7f29e47ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc0c6ed0 con 0x7f29dc0aa140 2023-08-31T19:07:04.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.088+0000 7f29e47ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29dc0c66e0 con 0x7f29dc0c06b0 2023-08-31T19:07:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.088+0000 7f29e47ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29dc0c68c0 con 0x7f29dc154030 2023-08-31T19:07:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.088+0000 7f29e1d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f29dc0c06b0 0x7f29dc0c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.088+0000 7f29e1d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f29dc0c06b0 0x7f29dc0c7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46314/0 (socket says 172.21.15.72:46314) 2023-08-31T19:07:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.088+0000 7f29e1d9a700 1 -- 172.21.15.72:0/2808411091 learned_addr learned my addr 172.21.15.72:0/2808411091 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:04.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.089+0000 7f29e259b700 1 --2- 172.21.15.72:0/2808411091 >> v2:172.21.15.146:3300/0 conn(0x7f29dc154030 0x7f29dc154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:04.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.089+0000 7f29e1d9a700 1 -- 172.21.15.72:0/2808411091 >> v2:172.21.15.146:3300/0 conn(0x7f29dc154030 msgr2=0x7f29dc154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:04.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.089+0000 7f29e1d9a700 1 --2- 172.21.15.72:0/2808411091 >> v2:172.21.15.146:3300/0 conn(0x7f29dc154030 0x7f29dc154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.089+0000 7f29e1d9a700 1 -- 172.21.15.72:0/2808411091 >> v1:172.21.15.146:6789/0 conn(0x7f29dc0aa140 legacy=0x7f29dc063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:04.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.089+0000 7f29e1d9a700 1 -- 172.21.15.72:0/2808411091 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc0c0f30 con 0x7f29dc0c06b0 2023-08-31T19:07:04.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.089+0000 7f29e1d9a700 1 --2- 172.21.15.72:0/2808411091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29dc0c06b0 0x7f29dc0c7360 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f29dc0c8bc0 tx=0x7f29cc0090f0).ready entity=mon.0 client_cookie=47a4d1a38cec93d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:04.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.089+0000 7f29e1599700 1 -- 172.21.15.72:0/2808411091 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc00b600 con 0x7f29dc0c06b0 2023-08-31T19:07:04.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.089+0000 7f29e1599700 1 -- 172.21.15.72:0/2808411091 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc00b760 con 0x7f29dc0c06b0 2023-08-31T19:07:04.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.089+0000 7f29e1599700 1 -- 172.21.15.72:0/2808411091 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc00bae0 con 0x7f29dc0c06b0 2023-08-31T19:07:04.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.090+0000 7f29e47ff700 1 -- 172.21.15.72:0/2808411091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29dc0c06b0 msgr2=0x7f29dc0c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:04.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.090+0000 7f29e47ff700 1 --2- 172.21.15.72:0/2808411091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29dc0c06b0 0x7f29dc0c7360 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f29dc0c8bc0 tx=0x7f29cc0090f0).stop 2023-08-31T19:07:04.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.090+0000 7f29e47ff700 1 -- 172.21.15.72:0/2808411091 shutdown_connections 2023-08-31T19:07:04.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.090+0000 7f29e47ff700 1 --2- 172.21.15.72:0/2808411091 >> v2:172.21.15.146:3300/0 conn(0x7f29dc154030 0x7f29dc154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.090+0000 7f29e47ff700 1 --2- 172.21.15.72:0/2808411091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29dc0c06b0 0x7f29dc0c7360 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.090+0000 7f29e47ff700 1 -- 172.21.15.72:0/2808411091 >> 172.21.15.72:0/2808411091 conn(0x7f29dc05eb60 msgr2=0x7f29dc0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:04.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.090+0000 7f29e47ff700 1 -- 172.21.15.72:0/2808411091 shutdown_connections 2023-08-31T19:07:04.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.090+0000 7f29e47ff700 1 -- 172.21.15.72:0/2808411091 wait complete. 2023-08-31T19:07:04.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.091+0000 7f29e47ff700 1 Processor -- start 2023-08-31T19:07:04.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.092+0000 7f29e47ff700 1 -- start start 2023-08-31T19:07:04.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.092+0000 7f29e47ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29dc0aa140 0x7f29dc149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.093+0000 7f29e47ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29dc0c06b0 0x7f29dc0c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.093+0000 7f29e47ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29dc154030 0x7f29dc0c2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.093+0000 7f29e47ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc164280 con 0x7f29dc154030 2023-08-31T19:07:04.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.093+0000 7f29e47ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0c3030 con 0x7f29dc0aa140 2023-08-31T19:07:04.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.093+0000 7f29e47ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0c35f0 con 0x7f29dc0c06b0 2023-08-31T19:07:04.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.093+0000 7f29e2d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29dc154030 0x7f29dc0c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:04.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.093+0000 7f29e2d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29dc154030 0x7f29dc0c2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46320/0 (socket says 172.21.15.72:46320) 2023-08-31T19:07:04.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.093+0000 7f29e2d9c700 1 -- 172.21.15.72:0/1535679651 learned_addr learned my addr 172.21.15.72:0/1535679651 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:04.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.093+0000 7f29e259b700 1 --2- 172.21.15.72:0/1535679651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29dc0aa140 0x7f29dc149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:04.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.093+0000 7f29e1d9a700 1 --2- 172.21.15.72:0/1535679651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29dc0c06b0 0x7f29dc0c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:04.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.093+0000 7f29e2d9c700 1 -- 172.21.15.72:0/1535679651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29dc0c06b0 msgr2=0x7f29dc0c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:04.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.093+0000 7f29e2d9c700 1 --2- 172.21.15.72:0/1535679651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29dc0c06b0 0x7f29dc0c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.093+0000 7f29e2d9c700 1 -- 172.21.15.72:0/1535679651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29dc0aa140 msgr2=0x7f29dc149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:04.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.093+0000 7f29e2d9c700 1 --2- 172.21.15.72:0/1535679651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29dc0aa140 0x7f29dc149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.093+0000 7f29e2d9c700 1 -- 172.21.15.72:0/1535679651 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc009370 con 0x7f29dc154030 2023-08-31T19:07:04.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.094+0000 7f29e2d9c700 1 --2- 172.21.15.72:0/1535679651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29dc154030 0x7f29dc0c2380 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f29d400c790 tx=0x7f29d40015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:04.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.094+0000 7f29d27fc700 1 -- 172.21.15.72:0/1535679651 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4010510 con 0x7f29dc154030 2023-08-31T19:07:04.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.094+0000 7f29d27fc700 1 -- 172.21.15.72:0/1535679651 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d4010670 con 0x7f29dc154030 2023-08-31T19:07:04.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.094+0000 7f29e47ff700 1 -- 172.21.15.72:0/1535679651 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29dc0c2990 con 0x7f29dc154030 2023-08-31T19:07:04.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.094+0000 7f29d27fc700 1 -- 172.21.15.72:0/1535679651 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d40109f0 con 0x7f29dc154030 2023-08-31T19:07:04.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.094+0000 7f29e47ff700 1 -- 172.21.15.72:0/1535679651 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc0c3280 con 0x7f29dc154030 2023-08-31T19:07:04.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.095+0000 7f29e47ff700 1 -- 172.21.15.72:0/1535679651 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29dc06c6b0 con 0x7f29dc154030 2023-08-31T19:07:04.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.096+0000 7f29d27fc700 1 -- 172.21.15.72:0/1535679651 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 53) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f29d401b400 con 0x7f29dc154030 2023-08-31T19:07:04.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.097+0000 7f29d27fc700 1 --2- 172.21.15.72:0/1535679651 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29c005f050 0x7f29c0061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.097+0000 7f29d27fc700 1 -- 172.21.15.72:0/1535679651 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f29d407a350 con 0x7f29dc154030 2023-08-31T19:07:04.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.097+0000 7f29e259b700 1 -- 172.21.15.72:0/1535679651 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29c005f050 msgr2=0x7f29c0061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:04.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.097+0000 7f29e259b700 1 --2- 172.21.15.72:0/1535679651 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29c005f050 0x7f29c0061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:04.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.101+0000 7f29d27fc700 1 -- 172.21.15.72:0/1535679651 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f29d404b040 con 0x7f29dc154030 2023-08-31T19:07:04.128 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:04.127+0000 7f0af00b6680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:07:04.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.277+0000 7f29e47ff700 1 -- 172.21.15.72:0/1535679651 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f29dc06aac0 con 0x7f29dc154030 2023-08-31T19:07:04.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.278+0000 7f29d27fc700 1 -- 172.21.15.72:0/1535679651 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v127) v1 ==== 110+0+10 (secure 0 0 0) 0x7f29d404e660 con 0x7f29dc154030 2023-08-31T19:07:04.279 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:07:04.279 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:04.279+0000 7f3d69e1b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:07:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.280+0000 7f29e47ff700 1 -- 172.21.15.72:0/1535679651 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29c005f050 msgr2=0x7f29c0061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.280+0000 7f29e47ff700 1 --2- 172.21.15.72:0/1535679651 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29c005f050 0x7f29c0061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.280+0000 7f29e47ff700 1 -- 172.21.15.72:0/1535679651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29dc154030 msgr2=0x7f29dc0c2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.280+0000 7f29e47ff700 1 --2- 172.21.15.72:0/1535679651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29dc154030 0x7f29dc0c2380 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f29d400c790 tx=0x7f29d40015e0).stop 2023-08-31T19:07:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.280+0000 7f29e47ff700 1 -- 172.21.15.72:0/1535679651 shutdown_connections 2023-08-31T19:07:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.280+0000 7f29e47ff700 1 --2- 172.21.15.72:0/1535679651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29dc154030 0x7f29dc0c2380 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.280+0000 7f29e47ff700 1 --2- 172.21.15.72:0/1535679651 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f29c005f050 0x7f29c0061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.280+0000 7f29e47ff700 1 --2- 172.21.15.72:0/1535679651 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29dc0aa140 0x7f29dc149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.280+0000 7f29e47ff700 1 --2- 172.21.15.72:0/1535679651 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f29dc0c06b0 0x7f29dc0c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.280+0000 7f29e47ff700 1 -- 172.21.15.72:0/1535679651 >> 172.21.15.72:0/1535679651 conn(0x7f29dc05eb60 msgr2=0x7f29dc0c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:04.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.280+0000 7f29e47ff700 1 -- 172.21.15.72:0/1535679651 shutdown_connections 2023-08-31T19:07:04.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.280+0000 7f29e47ff700 1 -- 172.21.15.72:0/1535679651 wait complete. 2023-08-31T19:07:04.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:07:04.367 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:04.367+0000 7f0af00b6680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:07:04.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.497+0000 7f59e33ff700 1 Processor -- start 2023-08-31T19:07:04.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.498+0000 7f59e33ff700 1 -- start start 2023-08-31T19:07:04.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.499+0000 7f59e33ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59dc1545d0 0x7f59dc0c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.499+0000 7f59e33ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc0bc470 con 0x7f59dc1541f0 2023-08-31T19:07:04.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.499+0000 7f59e33ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc0651f0 con 0x7f59dc158020 2023-08-31T19:07:04.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.499+0000 7f59e33ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc0bc6c0 con 0x7f59dc1545d0 2023-08-31T19:07:04.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.499+0000 7f59e099a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59dc1545d0 0x7f59dc0c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:04.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.499+0000 7f59e099a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59dc1545d0 0x7f59dc0c26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46334/0 (socket says 172.21.15.72:46334) 2023-08-31T19:07:04.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.499+0000 7f59e099a700 1 -- 172.21.15.72:0/2202571213 learned_addr learned my addr 172.21.15.72:0/2202571213 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:04.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.499+0000 7f59e119b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f59dc1541f0 0x7f59dc065680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54682/0 (socket says 172.21.15.72:54682) 2023-08-31T19:07:04.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.500+0000 7f59e099a700 1 -- 172.21.15.72:0/2202571213 >> v1:172.21.15.146:6789/0 conn(0x7f59dc158020 legacy=0x7f59dc158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:04.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.500+0000 7f59e099a700 1 -- 172.21.15.72:0/2202571213 >> v1:172.21.15.72:6789/0 conn(0x7f59dc1541f0 legacy=0x7f59dc065680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:04.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.500+0000 7f59d3fff700 1 -- 172.21.15.72:0/2202571213 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80109020 0 0) 0x7f59dc0bc470 con 0x7f59dc1541f0 2023-08-31T19:07:04.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.500+0000 7f59e099a700 1 -- 172.21.15.72:0/2202571213 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc0bc9a0 con 0x7f59dc1545d0 2023-08-31T19:07:04.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.500+0000 7f59e099a700 1 --2- 172.21.15.72:0/2202571213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc1545d0 0x7f59dc0c26d0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f59cc006fd0 tx=0x7f59cc0090f0).ready entity=mon.0 client_cookie=d670fb0acd229ea2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:04.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.500+0000 7f59d3fff700 1 -- 172.21.15.72:0/2202571213 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc00b600 con 0x7f59dc1545d0 2023-08-31T19:07:04.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.500+0000 7f59d3fff700 1 -- 172.21.15.72:0/2202571213 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc00b760 con 0x7f59dc1545d0 2023-08-31T19:07:04.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.500+0000 7f59d3fff700 1 -- 172.21.15.72:0/2202571213 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc00bb00 con 0x7f59dc1545d0 2023-08-31T19:07:04.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.501+0000 7f59e33ff700 1 -- 172.21.15.72:0/2202571213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc1545d0 msgr2=0x7f59dc0c26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:04.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.501+0000 7f59e33ff700 1 --2- 172.21.15.72:0/2202571213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc1545d0 0x7f59dc0c26d0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f59cc006fd0 tx=0x7f59cc0090f0).stop 2023-08-31T19:07:04.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.501+0000 7f59e33ff700 1 -- 172.21.15.72:0/2202571213 shutdown_connections 2023-08-31T19:07:04.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.501+0000 7f59e33ff700 1 --2- 172.21.15.72:0/2202571213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc1545d0 0x7f59dc0c26d0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.501+0000 7f59e33ff700 1 -- 172.21.15.72:0/2202571213 >> 172.21.15.72:0/2202571213 conn(0x7f59dc0630c0 msgr2=0x7f59dc0c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:04.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.501+0000 7f59e33ff700 1 -- 172.21.15.72:0/2202571213 shutdown_connections 2023-08-31T19:07:04.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.501+0000 7f59e33ff700 1 -- 172.21.15.72:0/2202571213 wait complete. 2023-08-31T19:07:04.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.502+0000 7f59e33ff700 1 Processor -- start 2023-08-31T19:07:04.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.503+0000 7f59e33ff700 1 -- start start 2023-08-31T19:07:04.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.503+0000 7f59e33ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc1541f0 0x7f59dc1510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e33ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59dc1545d0 0x7f59dc0ac060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e33ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59dc158020 0x7f59dc0aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e33ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0aa920 con 0x7f59dc1541f0 2023-08-31T19:07:04.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e33ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0a9ff0 con 0x7f59dc1545d0 2023-08-31T19:07:04.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e33ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0aa2d0 con 0x7f59dc158020 2023-08-31T19:07:04.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e119b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc1541f0 0x7f59dc1510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:04.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e119b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc1541f0 0x7f59dc1510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46348/0 (socket says 172.21.15.72:46348) 2023-08-31T19:07:04.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e119b700 1 -- 172.21.15.72:0/497130334 learned_addr learned my addr 172.21.15.72:0/497130334 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:04.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e099a700 1 --2- 172.21.15.72:0/497130334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59dc1545d0 0x7f59dc0ac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:04.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e199c700 1 --2- 172.21.15.72:0/497130334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59dc158020 0x7f59dc0aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:04.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e119b700 1 -- 172.21.15.72:0/497130334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59dc158020 msgr2=0x7f59dc0aadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:04.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e119b700 1 --2- 172.21.15.72:0/497130334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59dc158020 0x7f59dc0aadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e119b700 1 -- 172.21.15.72:0/497130334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59dc1545d0 msgr2=0x7f59dc0ac060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:04.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e119b700 1 --2- 172.21.15.72:0/497130334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59dc1545d0 0x7f59dc0ac060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e119b700 1 -- 172.21.15.72:0/497130334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc009370 con 0x7f59dc1541f0 2023-08-31T19:07:04.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.504+0000 7f59e119b700 1 --2- 172.21.15.72:0/497130334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc1541f0 0x7f59dc1510b0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f59d800c4c0 tx=0x7f59d8007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:04.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.505+0000 7f59d17fa700 1 -- 172.21.15.72:0/497130334 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d80072e0 con 0x7f59dc1541f0 2023-08-31T19:07:04.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.505+0000 7f59d17fa700 1 -- 172.21.15.72:0/497130334 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d8007440 con 0x7f59dc1541f0 2023-08-31T19:07:04.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.505+0000 7f59d17fa700 1 -- 172.21.15.72:0/497130334 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d8005930 con 0x7f59dc1541f0 2023-08-31T19:07:04.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.505+0000 7f59e33ff700 1 -- 172.21.15.72:0/497130334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59dc0aa5b0 con 0x7f59dc1541f0 2023-08-31T19:07:04.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.505+0000 7f59e33ff700 1 -- 172.21.15.72:0/497130334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc1515a0 con 0x7f59dc1541f0 2023-08-31T19:07:04.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.506+0000 7f59e33ff700 1 -- 172.21.15.72:0/497130334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59dc06c6b0 con 0x7f59dc1541f0 2023-08-31T19:07:04.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.507+0000 7f59d17fa700 1 -- 172.21.15.72:0/497130334 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 53) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f59d8005ce0 con 0x7f59dc1541f0 2023-08-31T19:07:04.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.508+0000 7f59d17fa700 1 --2- 172.21.15.72:0/497130334 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f59c005f080 0x7f59c0061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.508+0000 7f59d17fa700 1 -- 172.21.15.72:0/497130334 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6979+0+0 (secure 0 0 0) 0x7f59d8079ce0 con 0x7f59dc1541f0 2023-08-31T19:07:04.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.508+0000 7f59e099a700 1 -- 172.21.15.72:0/497130334 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f59c005f080 msgr2=0x7f59c0061540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:04.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.508+0000 7f59e099a700 1 --2- 172.21.15.72:0/497130334 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f59c005f080 0x7f59c0061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:04.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.515+0000 7f59d17fa700 1 -- 172.21.15.72:0/497130334 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f59d804aa30 con 0x7f59dc1541f0 2023-08-31T19:07:04.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.692+0000 7f59e33ff700 1 -- 172.21.15.72:0/497130334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59dc064e80 con 0x7f59dc1541f0 2023-08-31T19:07:04.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.692+0000 7f59d17fa700 1 -- 172.21.15.72:0/497130334 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v127) v1 ==== 92+0+10 (secure 0 0 0) 0x7f59d8007d50 con 0x7f59dc1541f0 2023-08-31T19:07:04.693 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:07:04.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.694+0000 7f59e33ff700 1 -- 172.21.15.72:0/497130334 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f59c005f080 msgr2=0x7f59c0061540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:04.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.694+0000 7f59e33ff700 1 --2- 172.21.15.72:0/497130334 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f59c005f080 0x7f59c0061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:04.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.695+0000 7f59e33ff700 1 -- 172.21.15.72:0/497130334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc1541f0 msgr2=0x7f59dc1510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:04.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.695+0000 7f59e33ff700 1 --2- 172.21.15.72:0/497130334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc1541f0 0x7f59dc1510b0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f59d800c4c0 tx=0x7f59d8007c10).stop 2023-08-31T19:07:04.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.695+0000 7f59e33ff700 1 -- 172.21.15.72:0/497130334 shutdown_connections 2023-08-31T19:07:04.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.695+0000 7f59e33ff700 1 --2- 172.21.15.72:0/497130334 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f59dc158020 0x7f59dc0aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.695+0000 7f59e33ff700 1 --2- 172.21.15.72:0/497130334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc1541f0 0x7f59dc1510b0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.695+0000 7f59e33ff700 1 --2- 172.21.15.72:0/497130334 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f59c005f080 0x7f59c0061540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:04.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.695+0000 7f59e33ff700 1 --2- 172.21.15.72:0/497130334 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59dc1545d0 0x7f59dc0ac060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.695+0000 7f59e33ff700 1 -- 172.21.15.72:0/497130334 >> 172.21.15.72:0/497130334 conn(0x7f59dc0630c0 msgr2=0x7f59dc06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:04.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.695+0000 7f59e33ff700 1 -- 172.21.15.72:0/497130334 shutdown_connections 2023-08-31T19:07:04.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.695+0000 7f59e33ff700 1 -- 172.21.15.72:0/497130334 wait complete. 2023-08-31T19:07:04.715 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:07:04.798 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:04.798+0000 7f3d69e1b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:07:04.907 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:04.907+0000 7f0af00b6680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:07:04.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.912+0000 7fb2e6dff700 1 Processor -- start 2023-08-31T19:07:04.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.912+0000 7fb2e6dff700 1 -- start start 2023-08-31T19:07:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.913+0000 7fb2e6dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2e0154410 0x7fb2e00c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2e6dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2e00c7360 0x7fb2e0063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2e6dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e00c6ed0 con 0x7fb2e0154030 2023-08-31T19:07:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2e6dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e00c66e0 con 0x7fb2e0154410 2023-08-31T19:07:04.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2e6dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e00c68c0 con 0x7fb2e00c7360 2023-08-31T19:07:04.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2dffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2e0154410 0x7fb2e00c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:04.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2dffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2e0154410 0x7fb2e00c06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46358/0 (socket says 172.21.15.72:46358) 2023-08-31T19:07:04.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2e539c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2e00c7360 0x7fb2e0063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:04.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2dffff700 1 -- 172.21.15.72:0/2229353831 learned_addr learned my addr 172.21.15.72:0/2229353831 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:04.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2e4b9b700 1 --1- 172.21.15.72:0/2229353831 >> v1:172.21.15.146:6789/0 conn(0x7fb2e0154030 0x7fb2e00aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:44532/0 (socket says 172.21.15.72:44532) 2023-08-31T19:07:04.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2df7fe700 1 -- 172.21.15.72:0/2229353831 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189642899 0 0) 0x7fb2e00c6ed0 con 0x7fb2e0154030 2023-08-31T19:07:04.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2df7fe700 1 -- 172.21.15.72:0/2229353831 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d00033f0 con 0x7fb2e0154030 2023-08-31T19:07:04.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2e539c700 1 -- 172.21.15.72:0/2229353831 >> v2:172.21.15.72:3300/0 conn(0x7fb2e0154410 msgr2=0x7fb2e00c06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2e539c700 1 --2- 172.21.15.72:0/2229353831 >> v2:172.21.15.72:3300/0 conn(0x7fb2e0154410 0x7fb2e00c06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2e539c700 1 -- 172.21.15.72:0/2229353831 >> v1:172.21.15.146:6789/0 conn(0x7fb2e0154030 legacy=0x7fb2e00aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2e539c700 1 -- 172.21.15.72:0/2229353831 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e00c0f30 con 0x7fb2e00c7360 2023-08-31T19:07:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.914+0000 7fb2dffff700 1 --2- 172.21.15.72:0/2229353831 >> v2:172.21.15.72:3300/0 conn(0x7fb2e0154410 0x7fb2e00c06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:07:04.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.915+0000 7fb2e539c700 1 --2- 172.21.15.72:0/2229353831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e00c7360 0x7fb2e0063120 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fb2e00aad30 tx=0x7fb2d8009780).ready entity=mon.1 client_cookie=3ae5bbae15734ba8 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:04.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.915+0000 7fb2df7fe700 1 -- 172.21.15.72:0/2229353831 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800e070 con 0x7fb2e00c7360 2023-08-31T19:07:04.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.915+0000 7fb2df7fe700 1 -- 172.21.15.72:0/2229353831 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d800bab0 con 0x7fb2e00c7360 2023-08-31T19:07:04.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.915+0000 7fb2df7fe700 1 -- 172.21.15.72:0/2229353831 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800be30 con 0x7fb2e00c7360 2023-08-31T19:07:04.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.915+0000 7fb2e6dff700 1 -- 172.21.15.72:0/2229353831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e00c7360 msgr2=0x7fb2e0063120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:04.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.915+0000 7fb2e6dff700 1 --2- 172.21.15.72:0/2229353831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e00c7360 0x7fb2e0063120 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fb2e00aad30 tx=0x7fb2d8009780).stop 2023-08-31T19:07:04.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.916+0000 7fb2e6dff700 1 -- 172.21.15.72:0/2229353831 shutdown_connections 2023-08-31T19:07:04.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.916+0000 7fb2e6dff700 1 --2- 172.21.15.72:0/2229353831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e00c7360 0x7fb2e0063120 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.916+0000 7fb2e6dff700 1 --2- 172.21.15.72:0/2229353831 >> v2:172.21.15.72:3300/0 conn(0x7fb2e0154410 0x7fb2e00c06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.916+0000 7fb2e6dff700 1 -- 172.21.15.72:0/2229353831 >> 172.21.15.72:0/2229353831 conn(0x7fb2e005eb60 msgr2=0x7fb2e00cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:04.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.916+0000 7fb2e6dff700 1 -- 172.21.15.72:0/2229353831 shutdown_connections 2023-08-31T19:07:04.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.916+0000 7fb2e6dff700 1 -- 172.21.15.72:0/2229353831 wait complete. 2023-08-31T19:07:04.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.917+0000 7fb2e6dff700 1 Processor -- start 2023-08-31T19:07:04.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.917+0000 7fb2e6dff700 1 -- start start 2023-08-31T19:07:04.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.918+0000 7fb2e6dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e00c7360 0x7fb2e00b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.918+0000 7fb2e6dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2e0154030 0x7fb2e00c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.918+0000 7fb2e6dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e0154410 0x7fb2e00c2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.918+0000 7fb2e6dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e00c2950 con 0x7fb2e00c7360 2023-08-31T19:07:04.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.918+0000 7fb2e6dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e00c2c30 con 0x7fb2e0154410 2023-08-31T19:07:04.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.918+0000 7fb2e6dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e00c2f10 con 0x7fb2e0154030 2023-08-31T19:07:04.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.918+0000 7fb2e4b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e00c7360 0x7fb2e00b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:04.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.919+0000 7fb2e4b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e00c7360 0x7fb2e00b02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46374/0 (socket says 172.21.15.72:46374) 2023-08-31T19:07:04.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.919+0000 7fb2e4b9b700 1 -- 172.21.15.72:0/485019329 learned_addr learned my addr 172.21.15.72:0/485019329 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:04.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.919+0000 7fb2e539c700 1 --2- 172.21.15.72:0/485019329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e0154410 0x7fb2e00c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:04.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.919+0000 7fb2dffff700 1 --2- 172.21.15.72:0/485019329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2e0154030 0x7fb2e00c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:04.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.919+0000 7fb2e4b9b700 1 -- 172.21.15.72:0/485019329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2e0154030 msgr2=0x7fb2e00c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:04.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.919+0000 7fb2e4b9b700 1 --2- 172.21.15.72:0/485019329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2e0154030 0x7fb2e00c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.919+0000 7fb2e4b9b700 1 -- 172.21.15.72:0/485019329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e0154410 msgr2=0x7fb2e00c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:04.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.919+0000 7fb2e4b9b700 1 --2- 172.21.15.72:0/485019329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e0154410 0x7fb2e00c2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:04.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.919+0000 7fb2e4b9b700 1 -- 172.21.15.72:0/485019329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc009370 con 0x7fb2e00c7360 2023-08-31T19:07:04.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.919+0000 7fb2e4b9b700 1 --2- 172.21.15.72:0/485019329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e00c7360 0x7fb2e00b02f0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7fb2d400c590 tx=0x7fb2d4007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:04.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.919+0000 7fb2dcff9700 1 -- 172.21.15.72:0/485019329 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d40072e0 con 0x7fb2e00c7360 2023-08-31T19:07:04.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.919+0000 7fb2dcff9700 1 -- 172.21.15.72:0/485019329 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d4007440 con 0x7fb2e00c7360 2023-08-31T19:07:04.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.919+0000 7fb2dcff9700 1 -- 172.21.15.72:0/485019329 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4005910 con 0x7fb2e00c7360 2023-08-31T19:07:04.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.919+0000 7fb2e6dff700 1 -- 172.21.15.72:0/485019329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d8009a20 con 0x7fb2e00c7360 2023-08-31T19:07:04.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.920+0000 7fb2e6dff700 1 -- 172.21.15.72:0/485019329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e00c34d0 con 0x7fb2e00c7360 2023-08-31T19:07:04.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.921+0000 7fb2e6dff700 1 -- 172.21.15.72:0/485019329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e006c6b0 con 0x7fb2e00c7360 2023-08-31T19:07:04.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.921+0000 7fb2dcff9700 1 -- 172.21.15.72:0/485019329 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 53) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fb2d4005d40 con 0x7fb2e00c7360 2023-08-31T19:07:04.929 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:04.923+0000 7f3d69e1b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:07:04.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.923+0000 7fb2dcff9700 1 --2- 172.21.15.72:0/485019329 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb2c405f050 0x7fb2c4061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:04.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.923+0000 7fb2dffff700 1 -- 172.21.15.72:0/485019329 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb2c405f050 msgr2=0x7fb2c4061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:04.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.923+0000 7fb2dcff9700 1 -- 172.21.15.72:0/485019329 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6979+0+0 (secure 0 0 0) 0x7fb2d4079d30 con 0x7fb2e00c7360 2023-08-31T19:07:04.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.923+0000 7fb2dffff700 1 --2- 172.21.15.72:0/485019329 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb2c405f050 0x7fb2c4061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:04.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:04.927+0000 7fb2dcff9700 1 -- 172.21.15.72:0/485019329 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2d404aa80 con 0x7fb2e00c7360 2023-08-31T19:07:05.039 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:05.039+0000 7f0af00b6680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:07:05.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.104+0000 7fb2e6dff700 1 -- 172.21.15.72:0/485019329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2e00c0c50 con 0x7fb2e00c7360 2023-08-31T19:07:05.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.105+0000 7fb2dcff9700 1 -- 172.21.15.72:0/485019329 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v127) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb2d404e0a0 con 0x7fb2e00c7360 2023-08-31T19:07:05.106 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:07:05.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.107+0000 7fb2e6dff700 1 -- 172.21.15.72:0/485019329 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb2c405f050 msgr2=0x7fb2c4061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:05.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.107+0000 7fb2e6dff700 1 --2- 172.21.15.72:0/485019329 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb2c405f050 0x7fb2c4061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:05.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.107+0000 7fb2e6dff700 1 -- 172.21.15.72:0/485019329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e00c7360 msgr2=0x7fb2e00b02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:05.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.107+0000 7fb2e6dff700 1 --2- 172.21.15.72:0/485019329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e00c7360 0x7fb2e00b02f0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7fb2d400c590 tx=0x7fb2d4007c80).stop 2023-08-31T19:07:05.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.107+0000 7fb2e6dff700 1 -- 172.21.15.72:0/485019329 shutdown_connections 2023-08-31T19:07:05.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.107+0000 7fb2e6dff700 1 --2- 172.21.15.72:0/485019329 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb2c405f050 0x7fb2c4061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:05.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.107+0000 7fb2e6dff700 1 --2- 172.21.15.72:0/485019329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e0154410 0x7fb2e00c2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.107+0000 7fb2e6dff700 1 --2- 172.21.15.72:0/485019329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e00c7360 0x7fb2e00b02f0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.107+0000 7fb2e6dff700 1 --2- 172.21.15.72:0/485019329 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb2e0154030 0x7fb2e00c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.107+0000 7fb2e6dff700 1 -- 172.21.15.72:0/485019329 >> 172.21.15.72:0/485019329 conn(0x7fb2e005eb60 msgr2=0x7fb2e00cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:05.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.107+0000 7fb2e6dff700 1 -- 172.21.15.72:0/485019329 shutdown_connections 2023-08-31T19:07:05.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.108+0000 7fb2e6dff700 1 -- 172.21.15.72:0/485019329 wait complete. 2023-08-31T19:07:05.111 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:05.108+0000 7f3d69e1b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:07:05.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:07:05.201 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:05.201+0000 7f3d69e1b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:07:05.230 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:05.230+0000 7f0af00b6680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:07:05.286 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:05.286+0000 7f3d69e1b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:07:05.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.325+0000 7fdb87dff700 1 Processor -- start 2023-08-31T19:07:05.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.325+0000 7fdb87dff700 1 -- start start 2023-08-31T19:07:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.326+0000 7fdb87dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb80066590 0x7fdb80138f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.326+0000 7fdb87dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb80156710 0x7fdb801381d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:05.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.326+0000 7fdb87dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb800c3570 con 0x7fdb80066970 2023-08-31T19:07:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.326+0000 7fdb87dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb800c3850 con 0x7fdb80066590 2023-08-31T19:07:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.326+0000 7fdb87dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800c9380 con 0x7fdb80156710 2023-08-31T19:07:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.327+0000 7fdb85b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb80066590 0x7fdb80138f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.327+0000 7fdb85b9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb80066590 0x7fdb80138f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46380/0 (socket says 172.21.15.72:46380) 2023-08-31T19:07:05.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.327+0000 7fdb85b9b700 1 -- 172.21.15.72:0/116550096 learned_addr learned my addr 172.21.15.72:0/116550096 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:05.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.327+0000 7fdb8639c700 1 --2- 172.21.15.72:0/116550096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb80156710 0x7fdb801381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:05.329 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:05.327+0000 7f0af00b6680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:07:05.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.327+0000 7fdb85b9b700 1 -- 172.21.15.72:0/116550096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb80156710 msgr2=0x7fdb801381d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:05.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.327+0000 7fdb85b9b700 1 --2- 172.21.15.72:0/116550096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb80156710 0x7fdb801381d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.327+0000 7fdb85b9b700 1 -- 172.21.15.72:0/116550096 >> v1:172.21.15.146:6789/0 conn(0x7fdb80066970 legacy=0x7fdb800bdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:05.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.327+0000 7fdb85b9b700 1 -- 172.21.15.72:0/116550096 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb800c9660 con 0x7fdb80066590 2023-08-31T19:07:05.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.327+0000 7fdb85b9b700 1 --2- 172.21.15.72:0/116550096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb80066590 0x7fdb80138f30 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7fdb7c006fd0 tx=0x7fdb7c0090f0).ready entity=mon.0 client_cookie=7f3925250488b816 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:05.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.327+0000 7fdb84b99700 1 -- 172.21.15.72:0/116550096 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c00b580 con 0x7fdb80066590 2023-08-31T19:07:05.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.328+0000 7fdb84b99700 1 -- 172.21.15.72:0/116550096 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7c00b6e0 con 0x7fdb80066590 2023-08-31T19:07:05.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.328+0000 7fdb84b99700 1 -- 172.21.15.72:0/116550096 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c00ba80 con 0x7fdb80066590 2023-08-31T19:07:05.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.328+0000 7fdb87dff700 1 -- 172.21.15.72:0/116550096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb80066590 msgr2=0x7fdb80138f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:05.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.328+0000 7fdb87dff700 1 --2- 172.21.15.72:0/116550096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb80066590 0x7fdb80138f30 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7fdb7c006fd0 tx=0x7fdb7c0090f0).stop 2023-08-31T19:07:05.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.328+0000 7fdb87dff700 1 -- 172.21.15.72:0/116550096 shutdown_connections 2023-08-31T19:07:05.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.328+0000 7fdb87dff700 1 --2- 172.21.15.72:0/116550096 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb80156710 0x7fdb801381d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.328+0000 7fdb87dff700 1 --2- 172.21.15.72:0/116550096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb80066590 0x7fdb80138f30 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.328+0000 7fdb87dff700 1 -- 172.21.15.72:0/116550096 >> 172.21.15.72:0/116550096 conn(0x7fdb8005eb60 msgr2=0x7fdb800c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:05.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.328+0000 7fdb87dff700 1 -- 172.21.15.72:0/116550096 shutdown_connections 2023-08-31T19:07:05.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.328+0000 7fdb87dff700 1 -- 172.21.15.72:0/116550096 wait complete. 2023-08-31T19:07:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.330+0000 7fdb87dff700 1 Processor -- start 2023-08-31T19:07:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.330+0000 7fdb87dff700 1 -- start start 2023-08-31T19:07:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.331+0000 7fdb87dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb80066590 0x7fdb80154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.331+0000 7fdb87dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb80066970 0x7fdb80153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.331+0000 7fdb87dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb80156710 0x7fdb80154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.331+0000 7fdb87dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb801551c0 con 0x7fdb80066590 2023-08-31T19:07:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.331+0000 7fdb87dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb80064650 con 0x7fdb80156710 2023-08-31T19:07:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.331+0000 7fdb87dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb80064930 con 0x7fdb80066970 2023-08-31T19:07:05.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.331+0000 7fdb85b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb80066590 0x7fdb80154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.331+0000 7fdb85b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb80066590 0x7fdb80154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46396/0 (socket says 172.21.15.72:46396) 2023-08-31T19:07:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.331+0000 7fdb85b9b700 1 -- 172.21.15.72:0/2280446062 learned_addr learned my addr 172.21.15.72:0/2280446062 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.331+0000 7fdb8639c700 1 --2- 172.21.15.72:0/2280446062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb80156710 0x7fdb80154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.331+0000 7fdb8539a700 1 --2- 172.21.15.72:0/2280446062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb80066970 0x7fdb80153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.332+0000 7fdb85b9b700 1 -- 172.21.15.72:0/2280446062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb80066970 msgr2=0x7fdb80153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.332+0000 7fdb85b9b700 1 --2- 172.21.15.72:0/2280446062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb80066970 0x7fdb80153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.332+0000 7fdb85b9b700 1 -- 172.21.15.72:0/2280446062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb80156710 msgr2=0x7fdb80154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.332+0000 7fdb85b9b700 1 --2- 172.21.15.72:0/2280446062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb80156710 0x7fdb80154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.332+0000 7fdb85b9b700 1 -- 172.21.15.72:0/2280446062 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c009370 con 0x7fdb80066590 2023-08-31T19:07:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.332+0000 7fdb8539a700 1 --2- 172.21.15.72:0/2280446062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb80066970 0x7fdb80153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.332+0000 7fdb85b9b700 1 --2- 172.21.15.72:0/2280446062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb80066590 0x7fdb80154cd0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7fdb7c009ea0 tx=0x7fdb7c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.332+0000 7fdb75ffb700 1 -- 172.21.15.72:0/2280446062 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c00be40 con 0x7fdb80066590 2023-08-31T19:07:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.332+0000 7fdb75ffb700 1 -- 172.21.15.72:0/2280446062 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7c00b850 con 0x7fdb80066590 2023-08-31T19:07:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.332+0000 7fdb75ffb700 1 -- 172.21.15.72:0/2280446062 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c01c420 con 0x7fdb80066590 2023-08-31T19:07:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.332+0000 7fdb87dff700 1 -- 172.21.15.72:0/2280446062 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb800c0c40 con 0x7fdb80066590 2023-08-31T19:07:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.332+0000 7fdb87dff700 1 -- 172.21.15.72:0/2280446062 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb800c1200 con 0x7fdb80066590 2023-08-31T19:07:05.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.334+0000 7fdb87dff700 1 -- 172.21.15.72:0/2280446062 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8006c6b0 con 0x7fdb80066590 2023-08-31T19:07:05.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.334+0000 7fdb75ffb700 1 -- 172.21.15.72:0/2280446062 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 53) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fdb7c01c810 con 0x7fdb80066590 2023-08-31T19:07:05.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.335+0000 7fdb75ffb700 1 --2- 172.21.15.72:0/2280446062 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdb6405f050 0x7fdb64061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:05.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.335+0000 7fdb75ffb700 1 -- 172.21.15.72:0/2280446062 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6979+0+0 (secure 0 0 0) 0x7fdb7c07c120 con 0x7fdb80066590 2023-08-31T19:07:05.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.335+0000 7fdb8539a700 1 -- 172.21.15.72:0/2280446062 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdb6405f050 msgr2=0x7fdb64061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:05.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.335+0000 7fdb8539a700 1 --2- 172.21.15.72:0/2280446062 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdb6405f050 0x7fdb64061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:05.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.339+0000 7fdb75ffb700 1 -- 172.21.15.72:0/2280446062 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdb7c04ce70 con 0x7fdb80066590 2023-08-31T19:07:05.417 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:05.417+0000 7f0af00b6680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:07:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.517+0000 7fdb87dff700 1 -- 172.21.15.72:0/2280446062 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdb80067360 con 0x7fdb80066590 2023-08-31T19:07:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.518+0000 7fdb75ffb700 1 -- 172.21.15.72:0/2280446062 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v127) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdb7c02a0a0 con 0x7fdb80066590 2023-08-31T19:07:05.519 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:07:05.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.520+0000 7fdb87dff700 1 -- 172.21.15.72:0/2280446062 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdb6405f050 msgr2=0x7fdb64061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:05.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.520+0000 7fdb87dff700 1 --2- 172.21.15.72:0/2280446062 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdb6405f050 0x7fdb64061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:05.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.520+0000 7fdb87dff700 1 -- 172.21.15.72:0/2280446062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb80066590 msgr2=0x7fdb80154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:05.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.520+0000 7fdb87dff700 1 --2- 172.21.15.72:0/2280446062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb80066590 0x7fdb80154cd0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7fdb7c009ea0 tx=0x7fdb7c017000).stop 2023-08-31T19:07:05.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.520+0000 7fdb87dff700 1 -- 172.21.15.72:0/2280446062 shutdown_connections 2023-08-31T19:07:05.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.520+0000 7fdb87dff700 1 --2- 172.21.15.72:0/2280446062 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdb6405f050 0x7fdb64061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:05.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.520+0000 7fdb87dff700 1 --2- 172.21.15.72:0/2280446062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb80156710 0x7fdb80154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.520+0000 7fdb87dff700 1 --2- 172.21.15.72:0/2280446062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb80066590 0x7fdb80154cd0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.520+0000 7fdb87dff700 1 --2- 172.21.15.72:0/2280446062 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb80066970 0x7fdb80153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.520+0000 7fdb87dff700 1 -- 172.21.15.72:0/2280446062 >> 172.21.15.72:0/2280446062 conn(0x7fdb8005eb60 msgr2=0x7fdb800c8780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.520+0000 7fdb87dff700 1 -- 172.21.15.72:0/2280446062 shutdown_connections 2023-08-31T19:07:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.520+0000 7fdb87dff700 1 -- 172.21.15.72:0/2280446062 wait complete. 2023-08-31T19:07:05.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:07:05.597 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:05.597+0000 7f3d69e1b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:07:05.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.737+0000 7f82f65ff700 1 Processor -- start 2023-08-31T19:07:05.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.737+0000 7f82f65ff700 1 -- start start 2023-08-31T19:07:05.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.739+0000 7f82f65ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f82f00c6c30 0x7f82f00bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:05.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.739+0000 7f82f65ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f82f00c4740 0x7f82f0157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:05.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.739+0000 7f82f65ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f0063be0 con 0x7f82f01581d0 2023-08-31T19:07:05.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.739+0000 7f82f65ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f0158640 con 0x7f82f00c6c30 2023-08-31T19:07:05.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.739+0000 7f82f65ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f0063010 con 0x7f82f00c4740 2023-08-31T19:07:05.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.739+0000 7f82effff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f82f00c6c30 0x7f82f00bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:05.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.739+0000 7f82effff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f82f00c6c30 0x7f82f00bc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46398/0 (socket says 172.21.15.72:46398) 2023-08-31T19:07:05.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.739+0000 7f82effff700 1 -- 172.21.15.72:0/4264160058 learned_addr learned my addr 172.21.15.72:0/4264160058 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:05.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.739+0000 7f82ef7fe700 1 --2- 172.21.15.72:0/4264160058 >> v2:172.21.15.146:3300/0 conn(0x7f82f00c4740 0x7f82f0157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:05.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.739+0000 7f82effff700 1 -- 172.21.15.72:0/4264160058 >> v2:172.21.15.146:3300/0 conn(0x7f82f00c4740 msgr2=0x7f82f0157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:05.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.739+0000 7f82effff700 1 --2- 172.21.15.72:0/4264160058 >> v2:172.21.15.146:3300/0 conn(0x7f82f00c4740 0x7f82f0157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.739+0000 7f82effff700 1 -- 172.21.15.72:0/4264160058 >> v1:172.21.15.146:6789/0 conn(0x7f82f01581d0 legacy=0x7f82f0154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:05.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.739+0000 7f82effff700 1 -- 172.21.15.72:0/4264160058 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f00632b0 con 0x7f82f00c6c30 2023-08-31T19:07:05.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.740+0000 7f82effff700 1 --2- 172.21.15.72:0/4264160058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f00c6c30 0x7f82f00bc300 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f82f00c4e60 tx=0x7f82e00090f0).ready entity=mon.0 client_cookie=f6a31172bd14b35e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:05.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.740+0000 7f82eeffd700 1 -- 172.21.15.72:0/4264160058 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000b600 con 0x7f82f00c6c30 2023-08-31T19:07:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.740+0000 7f82eeffd700 1 -- 172.21.15.72:0/4264160058 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e000b760 con 0x7f82f00c6c30 2023-08-31T19:07:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.740+0000 7f82eeffd700 1 -- 172.21.15.72:0/4264160058 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000bae0 con 0x7f82f00c6c30 2023-08-31T19:07:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.740+0000 7f82f65ff700 1 -- 172.21.15.72:0/4264160058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f00c6c30 msgr2=0x7f82f00bc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:05.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.740+0000 7f82f65ff700 1 --2- 172.21.15.72:0/4264160058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f00c6c30 0x7f82f00bc300 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f82f00c4e60 tx=0x7f82e00090f0).stop 2023-08-31T19:07:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.741+0000 7f82f65ff700 1 -- 172.21.15.72:0/4264160058 shutdown_connections 2023-08-31T19:07:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.741+0000 7f82f65ff700 1 --2- 172.21.15.72:0/4264160058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f00c6c30 0x7f82f00bc300 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.741+0000 7f82f65ff700 1 --2- 172.21.15.72:0/4264160058 >> v2:172.21.15.146:3300/0 conn(0x7f82f00c4740 0x7f82f0157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.741+0000 7f82f65ff700 1 -- 172.21.15.72:0/4264160058 >> 172.21.15.72:0/4264160058 conn(0x7f82f00c7e70 msgr2=0x7f82f00c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:05.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.741+0000 7f82f65ff700 1 -- 172.21.15.72:0/4264160058 shutdown_connections 2023-08-31T19:07:05.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.741+0000 7f82f65ff700 1 -- 172.21.15.72:0/4264160058 wait complete. 2023-08-31T19:07:05.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.742+0000 7f82f65ff700 1 Processor -- start 2023-08-31T19:07:05.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.742+0000 7f82f65ff700 1 -- start start 2023-08-31T19:07:05.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.743+0000 7f82f65ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f00c4740 0x7f82f00a7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:05.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.743+0000 7f82f65ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f00c6c30 0x7f82f0129b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:05.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.743+0000 7f82f65ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82f01581d0 0x7f82f00651d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:05.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.743+0000 7f82f65ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f01565f0 con 0x7f82f00c4740 2023-08-31T19:07:05.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.743+0000 7f82f65ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00a7a30 con 0x7f82f00c6c30 2023-08-31T19:07:05.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.743+0000 7f82f65ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f01559e0 con 0x7f82f01581d0 2023-08-31T19:07:05.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.743+0000 7f82effff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f00c4740 0x7f82f00a7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:05.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.743+0000 7f82effff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f00c4740 0x7f82f00a7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46406/0 (socket says 172.21.15.72:46406) 2023-08-31T19:07:05.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.743+0000 7f82effff700 1 -- 172.21.15.72:0/3111741844 learned_addr learned my addr 172.21.15.72:0/3111741844 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:05.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.744+0000 7f82ef7fe700 1 --2- 172.21.15.72:0/3111741844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f00c6c30 0x7f82f0129b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:05.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.744+0000 7f82f4b9c700 1 --2- 172.21.15.72:0/3111741844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82f01581d0 0x7f82f00651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:05.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.744+0000 7f82effff700 1 -- 172.21.15.72:0/3111741844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82f01581d0 msgr2=0x7f82f00651d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:05.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.744+0000 7f82effff700 1 --2- 172.21.15.72:0/3111741844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82f01581d0 0x7f82f00651d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.744+0000 7f82effff700 1 -- 172.21.15.72:0/3111741844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f00c6c30 msgr2=0x7f82f0129b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:05.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.744+0000 7f82effff700 1 --2- 172.21.15.72:0/3111741844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f00c6c30 0x7f82f0129b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.744+0000 7f82effff700 1 -- 172.21.15.72:0/3111741844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e0009370 con 0x7f82f00c4740 2023-08-31T19:07:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.744+0000 7f82effff700 1 --2- 172.21.15.72:0/3111741844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f00c4740 0x7f82f00a7540 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f82f0064200 tx=0x7f82e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.744+0000 7f82d7fff700 1 -- 172.21.15.72:0/3111741844 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000b8d0 con 0x7f82f00c4740 2023-08-31T19:07:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.744+0000 7f82d7fff700 1 -- 172.21.15.72:0/3111741844 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e000ba30 con 0x7f82f00c4740 2023-08-31T19:07:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.744+0000 7f82f65ff700 1 -- 172.21.15.72:0/3111741844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f0155cc0 con 0x7f82f00c4740 2023-08-31T19:07:05.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.744+0000 7f82d7fff700 1 -- 172.21.15.72:0/3111741844 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e001c650 con 0x7f82f00c4740 2023-08-31T19:07:05.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.745+0000 7f82f65ff700 1 -- 172.21.15.72:0/3111741844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f0156280 con 0x7f82f00c4740 2023-08-31T19:07:05.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.746+0000 7f82f65ff700 1 -- 172.21.15.72:0/3111741844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f006c6b0 con 0x7f82f00c4740 2023-08-31T19:07:05.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.746+0000 7f82d7fff700 1 -- 172.21.15.72:0/3111741844 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 53) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f82e001ca40 con 0x7f82f00c4740 2023-08-31T19:07:05.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.748+0000 7f82d7fff700 1 --2- 172.21.15.72:0/3111741844 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f82dc05f050 0x7f82dc061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:05.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.748+0000 7f82ef7fe700 1 -- 172.21.15.72:0/3111741844 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f82dc05f050 msgr2=0x7f82dc061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:05.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.748+0000 7f82d7fff700 1 -- 172.21.15.72:0/3111741844 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f82e007bcf0 con 0x7f82f00c4740 2023-08-31T19:07:05.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.748+0000 7f82ef7fe700 1 --2- 172.21.15.72:0/3111741844 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f82dc05f050 0x7f82dc061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:05.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.752+0000 7f82d7fff700 1 -- 172.21.15.72:0/3111741844 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f82e004cac0 con 0x7f82f00c4740 2023-08-31T19:07:05.759 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:05.753+0000 7f0af00b6680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:07:05.826 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:05.825+0000 7f3d69e1b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:07:05.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.949+0000 7f82ef7fe700 1 -- 172.21.15.72:0/3111741844 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f82dc05f050 msgr2=0x7f82dc061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:05.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.949+0000 7f82ef7fe700 1 --2- 172.21.15.72:0/3111741844 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f82dc05f050 0x7f82dc061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:07:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.974+0000 7f82f65ff700 1 -- 172.21.15.72:0/3111741844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82f0153f20 con 0x7f82f00c4740 2023-08-31T19:07:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.974+0000 7f82d7fff700 1 -- 172.21.15.72:0/3111741844 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f82e0020020 con 0x7f82f00c4740 2023-08-31T19:07:05.975 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:05.975 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2018270382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2018270382},{"type":"v1","addr":"172.21.15.72:6837","nonce":2018270382}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2754540175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2754540175},{"type":"v1","addr":"172.21.15.146:6835","nonce":2754540175}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":7042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/488665385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":488665385},{"type":"v1","addr":"172.21.15.146:6834","nonce":488665385}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:06:15.992239+0000","modified":"2023-08-31T19:06:19.009090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7590},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7590":{"gid":7590,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6835/2456627257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2456627257},{"type":"v1","addr":"172.21.15.72:6835","nonce":2456627257}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-31T19:07:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.976+0000 7f82f65ff700 1 -- 172.21.15.72:0/3111741844 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f82dc05f050 msgr2=0x7f82dc061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.976+0000 7f82f65ff700 1 --2- 172.21.15.72:0/3111741844 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f82dc05f050 0x7f82dc061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.976+0000 7f82f65ff700 1 -- 172.21.15.72:0/3111741844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f00c4740 msgr2=0x7f82f00a7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.976+0000 7f82f65ff700 1 --2- 172.21.15.72:0/3111741844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f00c4740 0x7f82f00a7540 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f82f0064200 tx=0x7f82e0017000).stop 2023-08-31T19:07:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.976+0000 7f82f65ff700 1 -- 172.21.15.72:0/3111741844 shutdown_connections 2023-08-31T19:07:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.976+0000 7f82f65ff700 1 --2- 172.21.15.72:0/3111741844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f82f01581d0 0x7f82f00651d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.976+0000 7f82f65ff700 1 --2- 172.21.15.72:0/3111741844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f00c4740 0x7f82f00a7540 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.976+0000 7f82f65ff700 1 --2- 172.21.15.72:0/3111741844 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f82dc05f050 0x7f82dc061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:05.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.976+0000 7f82f65ff700 1 --2- 172.21.15.72:0/3111741844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f00c6c30 0x7f82f0129b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:05.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.976+0000 7f82f65ff700 1 -- 172.21.15.72:0/3111741844 >> 172.21.15.72:0/3111741844 conn(0x7f82f00c7e70 msgr2=0x7f82f00a4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:05.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.976+0000 7f82f65ff700 1 -- 172.21.15.72:0/3111741844 shutdown_connections 2023-08-31T19:07:05.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:05.977+0000 7f82f65ff700 1 -- 172.21.15.72:0/3111741844 wait complete. 2023-08-31T19:07:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 56 2023-08-31T19:07:05.983 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:05.983+0000 7f0af00b6680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:07:05.995 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:07:06.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.189+0000 7f6c10fff700 1 Processor -- start 2023-08-31T19:07:06.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.189+0000 7f6c10fff700 1 -- start start 2023-08-31T19:07:06.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.190+0000 7f6c10fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c0c0a9eb0 0x7f6c0c0aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:06.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.190+0000 7f6c10fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0c0c5bf0 0x7f6c0c0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:06.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.190+0000 7f6c10fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0c0bfd00 con 0x7f6c0c156fc0 2023-08-31T19:07:06.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.190+0000 7f6c10fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0c0c05a0 con 0x7f6c0c0a9eb0 2023-08-31T19:07:06.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.190+0000 7f6c10fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c0aaea0 con 0x7f6c0c0c5bf0 2023-08-31T19:07:06.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.190+0000 7f6c0a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c0c0a9eb0 0x7f6c0c0aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:06.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.190+0000 7f6c0a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c0c0a9eb0 0x7f6c0c0aa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46412/0 (socket says 172.21.15.72:46412) 2023-08-31T19:07:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.190+0000 7f6c0a59c700 1 -- 172.21.15.72:0/862869982 learned_addr learned my addr 172.21.15.72:0/862869982 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.190+0000 7f6c09d9b700 1 --2- 172.21.15.72:0/862869982 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0c0c5bf0 0x7f6c0c0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.191+0000 7f6c0a59c700 1 -- 172.21.15.72:0/862869982 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0c0c5bf0 msgr2=0x7f6c0c0c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.191+0000 7f6c0a59c700 1 --2- 172.21.15.72:0/862869982 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0c0c5bf0 0x7f6c0c0c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.191+0000 7f6c0a59c700 1 -- 172.21.15.72:0/862869982 >> v1:172.21.15.146:6789/0 conn(0x7f6c0c156fc0 legacy=0x7f6c0c157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.191+0000 7f6c0a59c700 1 -- 172.21.15.72:0/862869982 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0c6670 con 0x7f6c0c0a9eb0 2023-08-31T19:07:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.191+0000 7f6c0a59c700 1 --2- 172.21.15.72:0/862869982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c0a9eb0 0x7f6c0c0aa290 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f6bfc006fd0 tx=0x7f6bfc0090f0).ready entity=mon.0 client_cookie=9797ff3a998d1d73 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.191+0000 7f6c0959a700 1 -- 172.21.15.72:0/862869982 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc00b580 con 0x7f6c0c0a9eb0 2023-08-31T19:07:06.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.191+0000 7f6c0959a700 1 -- 172.21.15.72:0/862869982 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc00b6e0 con 0x7f6c0c0a9eb0 2023-08-31T19:07:06.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.191+0000 7f6c0959a700 1 -- 172.21.15.72:0/862869982 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc00ba60 con 0x7f6c0c0a9eb0 2023-08-31T19:07:06.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.192+0000 7f6c10fff700 1 -- 172.21.15.72:0/862869982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c0a9eb0 msgr2=0x7f6c0c0aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:06.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.192+0000 7f6c10fff700 1 --2- 172.21.15.72:0/862869982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c0a9eb0 0x7f6c0c0aa290 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f6bfc006fd0 tx=0x7f6bfc0090f0).stop 2023-08-31T19:07:06.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.192+0000 7f6c10fff700 1 -- 172.21.15.72:0/862869982 shutdown_connections 2023-08-31T19:07:06.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.192+0000 7f6c10fff700 1 --2- 172.21.15.72:0/862869982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c0a9eb0 0x7f6c0c0aa290 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:06.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.192+0000 7f6c10fff700 1 --2- 172.21.15.72:0/862869982 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0c0c5bf0 0x7f6c0c0c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:06.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.192+0000 7f6c10fff700 1 -- 172.21.15.72:0/862869982 >> 172.21.15.72:0/862869982 conn(0x7f6c0c0c82e0 msgr2=0x7f6c0c05e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:06.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.192+0000 7f6c10fff700 1 -- 172.21.15.72:0/862869982 shutdown_connections 2023-08-31T19:07:06.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.192+0000 7f6c10fff700 1 -- 172.21.15.72:0/862869982 wait complete. 2023-08-31T19:07:06.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.193+0000 7f6c10fff700 1 Processor -- start 2023-08-31T19:07:06.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.194+0000 7f6c10fff700 1 -- start start 2023-08-31T19:07:06.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.194+0000 7f6c10fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0c0a9eb0 0x7f6c0c13e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:06.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c10fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0c0c5bf0 0x7f6c0c157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:06.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c10fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c156fc0 0x7f6c0c157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:06.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c10fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c157e10 con 0x7f6c0c156fc0 2023-08-31T19:07:06.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c10fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c0b0640 con 0x7f6c0c0c5bf0 2023-08-31T19:07:06.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c10fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c154b60 con 0x7f6c0c0a9eb0 2023-08-31T19:07:06.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c0a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0c0a9eb0 0x7f6c0c13e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:06.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c0ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c156fc0 0x7f6c0c157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:06.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c0a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0c0a9eb0 0x7f6c0c13e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:55046/0 (socket says 172.21.15.72:55046) 2023-08-31T19:07:06.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c0a59c700 1 -- 172.21.15.72:0/1062395721 learned_addr learned my addr 172.21.15.72:0/1062395721 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:06.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c09d9b700 1 --2- 172.21.15.72:0/1062395721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0c0c5bf0 0x7f6c0c157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:06.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c0ad9d700 1 -- 172.21.15.72:0/1062395721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0c0a9eb0 msgr2=0x7f6c0c13e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:06.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c0ad9d700 1 --2- 172.21.15.72:0/1062395721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0c0a9eb0 0x7f6c0c13e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:06.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c0ad9d700 1 -- 172.21.15.72:0/1062395721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0c0c5bf0 msgr2=0x7f6c0c157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:06.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c0ad9d700 1 --2- 172.21.15.72:0/1062395721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0c0c5bf0 0x7f6c0c157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:06.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c0ad9d700 1 -- 172.21.15.72:0/1062395721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc009370 con 0x7f6c0c156fc0 2023-08-31T19:07:06.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.195+0000 7f6c0ad9d700 1 --2- 172.21.15.72:0/1062395721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c156fc0 0x7f6c0c157920 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f6c0400c790 tx=0x7f6c04001460).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:06.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.196+0000 7f6bfa7fc700 1 -- 172.21.15.72:0/1062395721 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0400f470 con 0x7f6c0c156fc0 2023-08-31T19:07:06.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.196+0000 7f6bfa7fc700 1 -- 172.21.15.72:0/1062395721 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0400f5d0 con 0x7f6c0c156fc0 2023-08-31T19:07:06.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.196+0000 7f6c10fff700 1 -- 172.21.15.72:0/1062395721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0c154230 con 0x7f6c0c156fc0 2023-08-31T19:07:06.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.196+0000 7f6bfa7fc700 1 -- 172.21.15.72:0/1062395721 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0400f950 con 0x7f6c0c156fc0 2023-08-31T19:07:06.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.196+0000 7f6c10fff700 1 -- 172.21.15.72:0/1062395721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0c1547f0 con 0x7f6c0c156fc0 2023-08-31T19:07:06.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.197+0000 7f6c10fff700 1 -- 172.21.15.72:0/1062395721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0c154d10 con 0x7f6c0c156fc0 2023-08-31T19:07:06.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.198+0000 7f6bfa7fc700 1 -- 172.21.15.72:0/1062395721 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 53) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f6c0400fd40 con 0x7f6c0c156fc0 2023-08-31T19:07:06.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.199+0000 7f6bfa7fc700 1 --2- 172.21.15.72:0/1062395721 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6bec05f050 0x7f6bec061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:06.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.199+0000 7f6c0a59c700 1 -- 172.21.15.72:0/1062395721 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6bec05f050 msgr2=0x7f6bec061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:06.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.199+0000 7f6bfa7fc700 1 -- 172.21.15.72:0/1062395721 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f6c04079a00 con 0x7f6c0c156fc0 2023-08-31T19:07:06.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.199+0000 7f6c0a59c700 1 --2- 172.21.15.72:0/1062395721 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6bec05f050 0x7f6bec061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:06.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.203+0000 7f6bfa7fc700 1 -- 172.21.15.72:0/1062395721 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6c040488f0 con 0x7f6c0c156fc0 2023-08-31T19:07:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.376+0000 7f6c10fff700 1 -- 172.21.15.72:0/1062395721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c0c06c6b0 con 0x7f6c0c156fc0 2023-08-31T19:07:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.377+0000 7f6bfa7fc700 1 -- 172.21.15.72:0/1062395721 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+18425 (secure 0 0 0) 0x7f6c0c154d10 con 0x7f6c0c156fc0 2023-08-31T19:07:06.378 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:06.379 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":128,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:07:05.594661+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:06:13.809620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-31T19:06:14.978639+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":128,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/753946871":"2023-09-01T19:06:30.413851+0000","172.21.15.72:0/1048677090":"2023-09-01T19:06:30.413851+0000","172.21.15.72:6833/143463":"2023-09-01T19:06:30.413851+0000","172.21.15.72:6832/143463":"2023-09-01T19:06:30.413851+0000","172.21.15.72:0/1676737569":"2023-09-01T19:06:30.413851+0000","172.21.15.72:0/458944015":"2023-09-01T19:06:30.413851+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:07:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.379+0000 7f6c10fff700 1 -- 172.21.15.72:0/1062395721 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6bec05f050 msgr2=0x7f6bec061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.379+0000 7f6c10fff700 1 --2- 172.21.15.72:0/1062395721 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6bec05f050 0x7f6bec061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.379+0000 7f6c10fff700 1 -- 172.21.15.72:0/1062395721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c156fc0 msgr2=0x7f6c0c157920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.379+0000 7f6c10fff700 1 --2- 172.21.15.72:0/1062395721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c156fc0 0x7f6c0c157920 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f6c0400c790 tx=0x7f6c04001460).stop 2023-08-31T19:07:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.379+0000 7f6c10fff700 1 -- 172.21.15.72:0/1062395721 shutdown_connections 2023-08-31T19:07:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.379+0000 7f6c10fff700 1 --2- 172.21.15.72:0/1062395721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0c156fc0 0x7f6c0c157920 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.379+0000 7f6c10fff700 1 --2- 172.21.15.72:0/1062395721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6c0c0a9eb0 0x7f6c0c13e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.379+0000 7f6c10fff700 1 --2- 172.21.15.72:0/1062395721 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6bec05f050 0x7f6bec061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.379+0000 7f6c10fff700 1 --2- 172.21.15.72:0/1062395721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c0c0c5bf0 0x7f6c0c157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.379+0000 7f6c10fff700 1 -- 172.21.15.72:0/1062395721 >> 172.21.15.72:0/1062395721 conn(0x7f6c0c0c82e0 msgr2=0x7f6c0c0ca230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:06.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.379+0000 7f6c10fff700 1 -- 172.21.15.72:0/1062395721 shutdown_connections 2023-08-31T19:07:06.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.380+0000 7f6c10fff700 1 -- 172.21.15.72:0/1062395721 wait complete. 2023-08-31T19:07:06.397 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T19:07:06.398 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:07:06.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.593+0000 7f3f1dfff700 1 Processor -- start 2023-08-31T19:07:06.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.593+0000 7f3f1dfff700 1 -- start start 2023-08-31T19:07:06.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.594+0000 7f3f1dfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f1815ce50 0x7f3f1815f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:06.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.594+0000 7f3f1dfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f180c8c90 con 0x7f3f180cb940 2023-08-31T19:07:06.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.594+0000 7f3f1dfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f18158af0 con 0x7f3f18154220 2023-08-31T19:07:06.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.594+0000 7f3f1dfff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f180aa700 con 0x7f3f1815ce50 2023-08-31T19:07:06.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.595+0000 7f3f16ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3f180cb940 0x7f3f181583e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54690/0 (socket says 172.21.15.72:54690) 2023-08-31T19:07:06.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.595+0000 7f3f16ffd700 1 -- 172.21.15.72:0/389370874 learned_addr learned my addr 172.21.15.72:0/389370874 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:06.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.595+0000 7f3f17fff700 1 --2- 172.21.15.72:0/389370874 >> v2:172.21.15.146:3300/0 conn(0x7f3f1815ce50 0x7f3f1815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:06.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.595+0000 7f3f167fc700 1 -- 172.21.15.72:0/389370874 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523478929 0 0) 0x7f3f180c8c90 con 0x7f3f180cb940 2023-08-31T19:07:06.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.595+0000 7f3f167fc700 1 -- 172.21.15.72:0/389370874 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f000033f0 con 0x7f3f180cb940 2023-08-31T19:07:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.595+0000 7f3f167fc700 1 -- 172.21.15.72:0/389370874 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275239318 0 0) 0x7f3f18158af0 con 0x7f3f18154220 2023-08-31T19:07:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.595+0000 7f3f167fc700 1 -- 172.21.15.72:0/389370874 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f180c8c90 con 0x7f3f18154220 2023-08-31T19:07:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.595+0000 7f3f17fff700 1 -- 172.21.15.72:0/389370874 >> v1:172.21.15.146:6789/0 conn(0x7f3f18154220 legacy=0x7f3f18157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.595+0000 7f3f17fff700 1 -- 172.21.15.72:0/389370874 >> v1:172.21.15.72:6789/0 conn(0x7f3f180cb940 legacy=0x7f3f181583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:06.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.595+0000 7f3f17fff700 1 -- 172.21.15.72:0/389370874 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f18155610 con 0x7f3f1815ce50 2023-08-31T19:07:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.596+0000 7f3f17fff700 1 --2- 172.21.15.72:0/389370874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f1815ce50 0x7f3f1815f240 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f3f10009e60 tx=0x7f3f10009780).ready entity=mon.1 client_cookie=642eefeafa5849f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.596+0000 7f3f167fc700 1 -- 172.21.15.72:0/389370874 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1000e070 con 0x7f3f1815ce50 2023-08-31T19:07:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.596+0000 7f3f167fc700 1 -- 172.21.15.72:0/389370874 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1000bab0 con 0x7f3f1815ce50 2023-08-31T19:07:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.596+0000 7f3f167fc700 1 -- 172.21.15.72:0/389370874 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1000be30 con 0x7f3f1815ce50 2023-08-31T19:07:06.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.596+0000 7f3f1dfff700 1 -- 172.21.15.72:0/389370874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f1815ce50 msgr2=0x7f3f1815f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:06.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.596+0000 7f3f1dfff700 1 --2- 172.21.15.72:0/389370874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f1815ce50 0x7f3f1815f240 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f3f10009e60 tx=0x7f3f10009780).stop 2023-08-31T19:07:06.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.596+0000 7f3f1dfff700 1 -- 172.21.15.72:0/389370874 shutdown_connections 2023-08-31T19:07:06.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.596+0000 7f3f1dfff700 1 --2- 172.21.15.72:0/389370874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f1815ce50 0x7f3f1815f240 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:06.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.596+0000 7f3f1dfff700 1 -- 172.21.15.72:0/389370874 >> 172.21.15.72:0/389370874 conn(0x7f3f1805e870 msgr2=0x7f3f180cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:06.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.597+0000 7f3f1dfff700 1 -- 172.21.15.72:0/389370874 shutdown_connections 2023-08-31T19:07:06.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.597+0000 7f3f1dfff700 1 -- 172.21.15.72:0/389370874 wait complete. 2023-08-31T19:07:06.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.598+0000 7f3f1dfff700 1 Processor -- start 2023-08-31T19:07:06.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.598+0000 7f3f1dfff700 1 -- start start 2023-08-31T19:07:06.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.599+0000 7f3f1dfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f180cb940 0x7f3f180b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:06.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.599+0000 7f3f1dfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f18154220 0x7f3f18152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:06.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.599+0000 7f3f1dfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f1815ce50 0x7f3f180aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:06.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.599+0000 7f3f1dfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f180ae750 con 0x7f3f180cb940 2023-08-31T19:07:06.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.599+0000 7f3f1dfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f18152c10 con 0x7f3f18154220 2023-08-31T19:07:06.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.599+0000 7f3f1dfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f180abf50 con 0x7f3f1815ce50 2023-08-31T19:07:06.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.599+0000 7f3f177fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f180cb940 0x7f3f180b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:06.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.600+0000 7f3f177fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f180cb940 0x7f3f180b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46438/0 (socket says 172.21.15.72:46438) 2023-08-31T19:07:06.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.600+0000 7f3f177fe700 1 -- 172.21.15.72:0/313701119 learned_addr learned my addr 172.21.15.72:0/313701119 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:06.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.600+0000 7f3f16ffd700 1 --2- 172.21.15.72:0/313701119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f18154220 0x7f3f18152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:06.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.600+0000 7f3f17fff700 1 --2- 172.21.15.72:0/313701119 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f1815ce50 0x7f3f180aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:06.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.600+0000 7f3f177fe700 1 -- 172.21.15.72:0/313701119 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f1815ce50 msgr2=0x7f3f180aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:06.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.600+0000 7f3f177fe700 1 --2- 172.21.15.72:0/313701119 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f1815ce50 0x7f3f180aba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:06.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.600+0000 7f3f177fe700 1 -- 172.21.15.72:0/313701119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f18154220 msgr2=0x7f3f18152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:06.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.600+0000 7f3f177fe700 1 --2- 172.21.15.72:0/313701119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f18154220 0x7f3f18152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:06.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.600+0000 7f3f177fe700 1 -- 172.21.15.72:0/313701119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f10009a20 con 0x7f3f180cb940 2023-08-31T19:07:06.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.600+0000 7f3f177fe700 1 --2- 172.21.15.72:0/313701119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f180cb940 0x7f3f180b0790 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f3f0800c4c0 tx=0x7f3f08007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:06.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.600+0000 7f3eff7fe700 1 -- 172.21.15.72:0/313701119 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0800f470 con 0x7f3f180cb940 2023-08-31T19:07:06.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.600+0000 7f3eff7fe700 1 -- 172.21.15.72:0/313701119 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0800f5d0 con 0x7f3f180cb940 2023-08-31T19:07:06.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.600+0000 7f3eff7fe700 1 -- 172.21.15.72:0/313701119 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0800f970 con 0x7f3f180cb940 2023-08-31T19:07:06.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.601+0000 7f3f1dfff700 1 -- 172.21.15.72:0/313701119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f180ac1b0 con 0x7f3f180cb940 2023-08-31T19:07:06.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.601+0000 7f3f1dfff700 1 -- 172.21.15.72:0/313701119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f180ac770 con 0x7f3f180cb940 2023-08-31T19:07:06.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.602+0000 7f3f1dfff700 1 -- 172.21.15.72:0/313701119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1806c6b0 con 0x7f3f180cb940 2023-08-31T19:07:06.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.602+0000 7f3eff7fe700 1 -- 172.21.15.72:0/313701119 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 53) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f3f0800fd20 con 0x7f3f180cb940 2023-08-31T19:07:06.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.603+0000 7f3eff7fe700 1 --2- 172.21.15.72:0/313701119 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f0405f080 0x7f3f04061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:06.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.603+0000 7f3eff7fe700 1 -- 172.21.15.72:0/313701119 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f3f08079c00 con 0x7f3f180cb940 2023-08-31T19:07:06.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.603+0000 7f3f16ffd700 1 -- 172.21.15.72:0/313701119 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f0405f080 msgr2=0x7f3f04061540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:06.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.603+0000 7f3f16ffd700 1 --2- 172.21.15.72:0/313701119 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f0405f080 0x7f3f04061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:06.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.607+0000 7f3eff7fe700 1 -- 172.21.15.72:0/313701119 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3f0804a920 con 0x7f3f180cb940 2023-08-31T19:07:06.641 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:06.641+0000 7f3d69e1b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:07:06.730 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:06.730+0000 7f3d69e1b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:07:06.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.804+0000 7f3f16ffd700 1 -- 172.21.15.72:0/313701119 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f0405f080 msgr2=0x7f3f04061540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:06.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.804+0000 7f3f16ffd700 1 --2- 172.21.15.72:0/313701119 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f0405f080 0x7f3f04061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:07:06.823 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:06.823+0000 7f3d69e1b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:07:06.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.825+0000 7f3f1dfff700 1 -- 172.21.15.72:0/313701119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f1814ae40 con 0x7f3f180cb940 2023-08-31T19:07:06.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.825+0000 7f3eff7fe700 1 -- 172.21.15.72:0/313701119 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f3f0804df40 con 0x7f3f180cb940 2023-08-31T19:07:06.826 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:06.826 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2018270382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2018270382},{"type":"v1","addr":"172.21.15.72:6837","nonce":2018270382}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2754540175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2754540175},{"type":"v1","addr":"172.21.15.146:6835","nonce":2754540175}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":7042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/488665385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":488665385},{"type":"v1","addr":"172.21.15.146:6834","nonce":488665385}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:06:15.992239+0000","modified":"2023-08-31T19:06:19.009090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7590},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7590":{"gid":7590,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6835/2456627257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2456627257},{"type":"v1","addr":"172.21.15.72:6835","nonce":2456627257}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-31T19:07:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.827+0000 7f3f1dfff700 1 -- 172.21.15.72:0/313701119 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f0405f080 msgr2=0x7f3f04061540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.827+0000 7f3f1dfff700 1 --2- 172.21.15.72:0/313701119 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f0405f080 0x7f3f04061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.827+0000 7f3f1dfff700 1 -- 172.21.15.72:0/313701119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f180cb940 msgr2=0x7f3f180b0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.827+0000 7f3f1dfff700 1 --2- 172.21.15.72:0/313701119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f180cb940 0x7f3f180b0790 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f3f0800c4c0 tx=0x7f3f08007c80).stop 2023-08-31T19:07:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.828+0000 7f3f1dfff700 1 -- 172.21.15.72:0/313701119 shutdown_connections 2023-08-31T19:07:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.828+0000 7f3f1dfff700 1 --2- 172.21.15.72:0/313701119 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3f1815ce50 0x7f3f180aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.828+0000 7f3f1dfff700 1 --2- 172.21.15.72:0/313701119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f180cb940 0x7f3f180b0790 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:06.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.828+0000 7f3f1dfff700 1 --2- 172.21.15.72:0/313701119 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f3f0405f080 0x7f3f04061540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:06.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.828+0000 7f3f1dfff700 1 --2- 172.21.15.72:0/313701119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f18154220 0x7f3f18152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:06.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.828+0000 7f3f1dfff700 1 -- 172.21.15.72:0/313701119 >> 172.21.15.72:0/313701119 conn(0x7f3f1805e870 msgr2=0x7f3f18064610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:06.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.828+0000 7f3f1dfff700 1 -- 172.21.15.72:0/313701119 shutdown_connections 2023-08-31T19:07:06.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:06.828+0000 7f3f1dfff700 1 -- 172.21.15.72:0/313701119 wait complete. 2023-08-31T19:07:06.831 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:06.828+0000 7f0af00b6680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:07:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 56 2023-08-31T19:07:06.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:07:06.926 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:06.926+0000 7f0af00b6680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:07:07.006 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:07.006+0000 7f3d69e1b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:07:07.023 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:07.023+0000 7f0af00b6680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:07:07.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.041+0000 7fd898fff700 1 Processor -- start 2023-08-31T19:07:07.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.041+0000 7fd898fff700 1 -- start start 2023-08-31T19:07:07.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.043+0000 7fd898fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8941541a0 0x7fd8940c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.043+0000 7fd898fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd8940c4520 0x7fd8940a6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.043+0000 7fd898fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8940c5950 con 0x7fd8940bf460 2023-08-31T19:07:07.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.043+0000 7fd898fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8940c5c30 con 0x7fd8940c4520 2023-08-31T19:07:07.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.043+0000 7fd898fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8940c5f10 con 0x7fd8941541a0 2023-08-31T19:07:07.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.043+0000 7fd891d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd8940bf460 0x7fd8940c3e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54700/0 (socket says 172.21.15.72:54700) 2023-08-31T19:07:07.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.043+0000 7fd891d9b700 1 -- 172.21.15.72:0/683492168 learned_addr learned my addr 172.21.15.72:0/683492168 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:07.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.043+0000 7fd89259c700 1 --2- 172.21.15.72:0/683492168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8941541a0 0x7fd8940c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:07.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.043+0000 7fd892d9d700 1 --2- 172.21.15.72:0/683492168 >> v2:172.21.15.146:3300/0 conn(0x7fd8940c4520 0x7fd8940a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:07.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.043+0000 7fd89159a700 1 -- 172.21.15.72:0/683492168 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899755141 0 0) 0x7fd8940c5950 con 0x7fd8940bf460 2023-08-31T19:07:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.044+0000 7fd89159a700 1 -- 172.21.15.72:0/683492168 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd87c0033f0 con 0x7fd8940bf460 2023-08-31T19:07:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.044+0000 7fd892d9d700 1 -- 172.21.15.72:0/683492168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8941541a0 msgr2=0x7fd8940c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.044+0000 7fd892d9d700 1 --2- 172.21.15.72:0/683492168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8941541a0 0x7fd8940c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.044+0000 7fd892d9d700 1 -- 172.21.15.72:0/683492168 >> v1:172.21.15.72:6789/0 conn(0x7fd8940bf460 legacy=0x7fd8940c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:07.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.044+0000 7fd892d9d700 1 -- 172.21.15.72:0/683492168 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8940a5a30 con 0x7fd8940c4520 2023-08-31T19:07:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.044+0000 7fd89259c700 1 --2- 172.21.15.72:0/683492168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8941541a0 0x7fd8940c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:07:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.044+0000 7fd892d9d700 1 --2- 172.21.15.72:0/683492168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8940c4520 0x7fd8940a6230 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fd88c009e60 tx=0x7fd88c009780).ready entity=mon.1 client_cookie=e185e25cb38c7db4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.044+0000 7fd89159a700 1 -- 172.21.15.72:0/683492168 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c00e070 con 0x7fd8940c4520 2023-08-31T19:07:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.044+0000 7fd89159a700 1 -- 172.21.15.72:0/683492168 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c00bab0 con 0x7fd8940c4520 2023-08-31T19:07:07.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.044+0000 7fd89159a700 1 -- 172.21.15.72:0/683492168 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c00be30 con 0x7fd8940c4520 2023-08-31T19:07:07.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.045+0000 7fd898fff700 1 -- 172.21.15.72:0/683492168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8940c4520 msgr2=0x7fd8940a6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:07.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.045+0000 7fd898fff700 1 --2- 172.21.15.72:0/683492168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8940c4520 0x7fd8940a6230 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fd88c009e60 tx=0x7fd88c009780).stop 2023-08-31T19:07:07.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.045+0000 7fd898fff700 1 -- 172.21.15.72:0/683492168 shutdown_connections 2023-08-31T19:07:07.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.045+0000 7fd898fff700 1 --2- 172.21.15.72:0/683492168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8940c4520 0x7fd8940a6230 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.045+0000 7fd898fff700 1 --2- 172.21.15.72:0/683492168 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8941541a0 0x7fd8940c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.045+0000 7fd898fff700 1 -- 172.21.15.72:0/683492168 >> 172.21.15.72:0/683492168 conn(0x7fd894082f60 msgr2=0x7fd89405e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.045+0000 7fd898fff700 1 -- 172.21.15.72:0/683492168 shutdown_connections 2023-08-31T19:07:07.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.045+0000 7fd898fff700 1 -- 172.21.15.72:0/683492168 wait complete. 2023-08-31T19:07:07.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.047+0000 7fd898fff700 1 Processor -- start 2023-08-31T19:07:07.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.047+0000 7fd898fff700 1 -- start start 2023-08-31T19:07:07.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.048+0000 7fd898fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8940bf460 0x7fd8941681b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.048+0000 7fd898fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8940c4520 0x7fd8940c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.048+0000 7fd898fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8941541a0 0x7fd8940c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.048+0000 7fd898fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8940c98d0 con 0x7fd8941541a0 2023-08-31T19:07:07.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.048+0000 7fd898fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8941686a0 con 0x7fd8940c4520 2023-08-31T19:07:07.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.048+0000 7fd898fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8940a9e50 con 0x7fd8940bf460 2023-08-31T19:07:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.049+0000 7fd892d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8941541a0 0x7fd8940c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.049+0000 7fd891d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8940c4520 0x7fd8940c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.049+0000 7fd892d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8941541a0 0x7fd8940c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46450/0 (socket says 172.21.15.72:46450) 2023-08-31T19:07:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.049+0000 7fd89259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8940bf460 0x7fd8941681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.049+0000 7fd892d9d700 1 -- 172.21.15.72:0/2761212675 learned_addr learned my addr 172.21.15.72:0/2761212675 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.049+0000 7fd891d9b700 1 -- 172.21.15.72:0/2761212675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8940bf460 msgr2=0x7fd8941681b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.049+0000 7fd891d9b700 1 --2- 172.21.15.72:0/2761212675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8940bf460 0x7fd8941681b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.049+0000 7fd891d9b700 1 -- 172.21.15.72:0/2761212675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8941541a0 msgr2=0x7fd8940c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.049+0000 7fd891d9b700 1 --2- 172.21.15.72:0/2761212675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8941541a0 0x7fd8940c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.049+0000 7fd891d9b700 1 -- 172.21.15.72:0/2761212675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8840092a0 con 0x7fd8940c4520 2023-08-31T19:07:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.049+0000 7fd891d9b700 1 --2- 172.21.15.72:0/2761212675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8940c4520 0x7fd8940c8800 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fd8940be0b0 tx=0x7fd888007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.050+0000 7fd8827fc700 1 -- 172.21.15.72:0/2761212675 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8880070d0 con 0x7fd8940c4520 2023-08-31T19:07:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.050+0000 7fd8827fc700 1 -- 172.21.15.72:0/2761212675 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd888007230 con 0x7fd8940c4520 2023-08-31T19:07:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.050+0000 7fd8827fc700 1 -- 172.21.15.72:0/2761212675 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8880075f0 con 0x7fd8940c4520 2023-08-31T19:07:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.050+0000 7fd898fff700 1 -- 172.21.15.72:0/2761212675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88c009a20 con 0x7fd8940c4520 2023-08-31T19:07:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.050+0000 7fd898fff700 1 -- 172.21.15.72:0/2761212675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8940c95f0 con 0x7fd8940c4520 2023-08-31T19:07:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.051+0000 7fd898fff700 1 -- 172.21.15.72:0/2761212675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8940aa740 con 0x7fd8940c4520 2023-08-31T19:07:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.052+0000 7fd8827fc700 1 -- 172.21.15.72:0/2761212675 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 53) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fd8880059b0 con 0x7fd8940c4520 2023-08-31T19:07:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.053+0000 7fd8827fc700 1 --2- 172.21.15.72:0/2761212675 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd87405f050 0x7fd874061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.053+0000 7fd8827fc700 1 -- 172.21.15.72:0/2761212675 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 7035+0+0 (secure 0 0 0) 0x7fd888079bc0 con 0x7fd8940c4520 2023-08-31T19:07:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.053+0000 7fd89259c700 1 -- 172.21.15.72:0/2761212675 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd87405f050 msgr2=0x7fd874061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.053+0000 7fd89259c700 1 --2- 172.21.15.72:0/2761212675 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd87405f050 0x7fd874061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:07.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.062+0000 7fd8827fc700 1 -- 172.21.15.72:0/2761212675 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd88804a940 con 0x7fd8940c4520 2023-08-31T19:07:07.101 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:07.100+0000 7f3d69e1b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:07:07.216 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:07.216+0000 7f0af00b6680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:07:07.241 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:07.241+0000 7f3d69e1b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:07:07.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.254+0000 7fd89259c700 1 -- 172.21.15.72:0/2761212675 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd87405f050 msgr2=0x7fd874061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:07.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.254+0000 7fd89259c700 1 --2- 172.21.15.72:0/2761212675 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd87405f050 0x7fd874061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:07:07.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.280+0000 7fd898fff700 1 -- 172.21.15.72:0/2761212675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd89406c6b0 con 0x7fd8940c4520 2023-08-31T19:07:07.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.281+0000 7fd8827fc700 1 -- 172.21.15.72:0/2761212675 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fd88804df60 con 0x7fd8940c4520 2023-08-31T19:07:07.281 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:07.282 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":56,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2018270382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2018270382},{"type":"v1","addr":"172.21.15.72:6837","nonce":2018270382}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2754540175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2754540175},{"type":"v1","addr":"172.21.15.146:6835","nonce":2754540175}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":7042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/488665385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":488665385},{"type":"v1","addr":"172.21.15.146:6834","nonce":488665385}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:06:15.992239+0000","modified":"2023-08-31T19:06:19.009090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7590},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7590":{"gid":7590,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6835/2456627257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2456627257},{"type":"v1","addr":"172.21.15.72:6835","nonce":2456627257}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-31T19:07:07.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.283+0000 7fd898fff700 1 -- 172.21.15.72:0/2761212675 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd87405f050 msgr2=0x7fd874061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.283+0000 7fd898fff700 1 --2- 172.21.15.72:0/2761212675 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd87405f050 0x7fd874061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.283+0000 7fd898fff700 1 -- 172.21.15.72:0/2761212675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8940c4520 msgr2=0x7fd8940c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.283+0000 7fd898fff700 1 --2- 172.21.15.72:0/2761212675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8940c4520 0x7fd8940c8800 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fd8940be0b0 tx=0x7fd888007bd0).stop 2023-08-31T19:07:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.283+0000 7fd898fff700 1 -- 172.21.15.72:0/2761212675 shutdown_connections 2023-08-31T19:07:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.283+0000 7fd898fff700 1 --2- 172.21.15.72:0/2761212675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8941541a0 0x7fd8940c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.283+0000 7fd898fff700 1 --2- 172.21.15.72:0/2761212675 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd8940bf460 0x7fd8941681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.283+0000 7fd898fff700 1 --2- 172.21.15.72:0/2761212675 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd87405f050 0x7fd874061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.283+0000 7fd898fff700 1 --2- 172.21.15.72:0/2761212675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8940c4520 0x7fd8940c8800 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.283+0000 7fd898fff700 1 -- 172.21.15.72:0/2761212675 >> 172.21.15.72:0/2761212675 conn(0x7fd894082f60 msgr2=0x7fd894152870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:07.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.283+0000 7fd898fff700 1 -- 172.21.15.72:0/2761212675 shutdown_connections 2023-08-31T19:07:07.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.283+0000 7fd898fff700 1 -- 172.21.15.72:0/2761212675 wait complete. 2023-08-31T19:07:07.286 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 56 2023-08-31T19:07:07.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:07:07.309 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:07.309+0000 7f0af00b6680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:07:07.372 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:07.372+0000 7f3d69e1b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:07:07.463 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:07.463+0000 7f0af00b6680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:07:07.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.499+0000 7fcc96fff700 1 Processor -- start 2023-08-31T19:07:07.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.500+0000 7fcc96fff700 1 -- start start 2023-08-31T19:07:07.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.501+0000 7fcc96fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc900aa290 0x7fcc90156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.501+0000 7fcc96fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc900bfd00 con 0x7fcc901574b0 2023-08-31T19:07:07.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.501+0000 7fcc96fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc900c05a0 con 0x7fcc900a9eb0 2023-08-31T19:07:07.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.501+0000 7fcc96fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc900aaea0 con 0x7fcc900aa290 2023-08-31T19:07:07.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.501+0000 7fcc9559c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcc901574b0 0x7fcc900c0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54716/0 (socket says 172.21.15.72:54716) 2023-08-31T19:07:07.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.501+0000 7fcc9559c700 1 -- 172.21.15.72:0/696878611 learned_addr learned my addr 172.21.15.72:0/696878611 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:07.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.501+0000 7fcc8ffff700 1 --2- 172.21.15.72:0/696878611 >> v2:172.21.15.146:3300/0 conn(0x7fcc900aa290 0x7fcc90156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:07.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.502+0000 7fcc8f7fe700 1 -- 172.21.15.72:0/696878611 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267912339 0 0) 0x7fcc900bfd00 con 0x7fcc901574b0 2023-08-31T19:07:07.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.502+0000 7fcc8f7fe700 1 -- 172.21.15.72:0/696878611 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc800033f0 con 0x7fcc901574b0 2023-08-31T19:07:07.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.502+0000 7fcc8ffff700 1 -- 172.21.15.72:0/696878611 >> v1:172.21.15.146:6789/0 conn(0x7fcc900a9eb0 legacy=0x7fcc900c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:07.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.502+0000 7fcc8ffff700 1 -- 172.21.15.72:0/696878611 >> v1:172.21.15.72:6789/0 conn(0x7fcc901574b0 legacy=0x7fcc900c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:07.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.502+0000 7fcc8ffff700 1 -- 172.21.15.72:0/696878611 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc900c6670 con 0x7fcc900aa290 2023-08-31T19:07:07.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.502+0000 7fcc8ffff700 1 --2- 172.21.15.72:0/696878611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc900aa290 0x7fcc90156fc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fcc7c009760 tx=0x7fcc7c009060).ready entity=mon.1 client_cookie=99f2464179fe3ce3 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:07.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.502+0000 7fcc8f7fe700 1 -- 172.21.15.72:0/696878611 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c00f510 con 0x7fcc900aa290 2023-08-31T19:07:07.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.502+0000 7fcc8f7fe700 1 -- 172.21.15.72:0/696878611 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c00f670 con 0x7fcc900aa290 2023-08-31T19:07:07.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.502+0000 7fcc8f7fe700 1 -- 172.21.15.72:0/696878611 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c00f9f0 con 0x7fcc900aa290 2023-08-31T19:07:07.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.503+0000 7fcc96fff700 1 -- 172.21.15.72:0/696878611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc900aa290 msgr2=0x7fcc90156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:07.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.503+0000 7fcc96fff700 1 --2- 172.21.15.72:0/696878611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc900aa290 0x7fcc90156fc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fcc7c009760 tx=0x7fcc7c009060).stop 2023-08-31T19:07:07.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.503+0000 7fcc96fff700 1 -- 172.21.15.72:0/696878611 shutdown_connections 2023-08-31T19:07:07.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.503+0000 7fcc96fff700 1 --2- 172.21.15.72:0/696878611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc900aa290 0x7fcc90156fc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.503+0000 7fcc96fff700 1 -- 172.21.15.72:0/696878611 >> 172.21.15.72:0/696878611 conn(0x7fcc900c82e0 msgr2=0x7fcc9005e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:07.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.503+0000 7fcc96fff700 1 -- 172.21.15.72:0/696878611 shutdown_connections 2023-08-31T19:07:07.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.503+0000 7fcc96fff700 1 -- 172.21.15.72:0/696878611 wait complete. 2023-08-31T19:07:07.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.505+0000 7fcc96fff700 1 Processor -- start 2023-08-31T19:07:07.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.505+0000 7fcc96fff700 1 -- start start 2023-08-31T19:07:07.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.506+0000 7fcc96fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc900a9eb0 0x7fcc9014cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.506+0000 7fcc96fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc900aa290 0x7fcc900c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.506+0000 7fcc96fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc901574b0 0x7fcc900c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.506+0000 7fcc96fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc900c4d40 con 0x7fcc900aa290 2023-08-31T19:07:07.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.506+0000 7fcc96fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9014df10 con 0x7fcc901574b0 2023-08-31T19:07:07.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.506+0000 7fcc96fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9014d670 con 0x7fcc900a9eb0 2023-08-31T19:07:07.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.506+0000 7fcc8ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc900aa290 0x7fcc900c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:07.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.506+0000 7fcc8ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc900aa290 0x7fcc900c4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46466/0 (socket says 172.21.15.72:46466) 2023-08-31T19:07:07.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.506+0000 7fcc8ffff700 1 -- 172.21.15.72:0/2279344290 learned_addr learned my addr 172.21.15.72:0/2279344290 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:07.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.506+0000 7fcc9559c700 1 --2- 172.21.15.72:0/2279344290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc901574b0 0x7fcc900c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:07.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.506+0000 7fcc94d9b700 1 --2- 172.21.15.72:0/2279344290 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc900a9eb0 0x7fcc9014cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:07.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.507+0000 7fcc8ffff700 1 -- 172.21.15.72:0/2279344290 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc900a9eb0 msgr2=0x7fcc9014cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:07.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.507+0000 7fcc8ffff700 1 --2- 172.21.15.72:0/2279344290 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc900a9eb0 0x7fcc9014cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.507+0000 7fcc8ffff700 1 -- 172.21.15.72:0/2279344290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc901574b0 msgr2=0x7fcc900c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:07.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.507+0000 7fcc8ffff700 1 --2- 172.21.15.72:0/2279344290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc901574b0 0x7fcc900c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.507+0000 7fcc8ffff700 1 -- 172.21.15.72:0/2279344290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c0092a0 con 0x7fcc900aa290 2023-08-31T19:07:07.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.507+0000 7fcc8ffff700 1 --2- 172.21.15.72:0/2279344290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc900aa290 0x7fcc900c4360 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7fcc7c009e30 tx=0x7fcc7c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:07.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.507+0000 7fcc8cff9700 1 -- 172.21.15.72:0/2279344290 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c00f7e0 con 0x7fcc900aa290 2023-08-31T19:07:07.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.507+0000 7fcc8cff9700 1 -- 172.21.15.72:0/2279344290 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c00f940 con 0x7fcc900aa290 2023-08-31T19:07:07.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.507+0000 7fcc8cff9700 1 -- 172.21.15.72:0/2279344290 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c01b660 con 0x7fcc900aa290 2023-08-31T19:07:07.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.507+0000 7fcc96fff700 1 -- 172.21.15.72:0/2279344290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc900aeaf0 con 0x7fcc900aa290 2023-08-31T19:07:07.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.508+0000 7fcc96fff700 1 -- 172.21.15.72:0/2279344290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9014dba0 con 0x7fcc900aa290 2023-08-31T19:07:07.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.509+0000 7fcc96fff700 1 -- 172.21.15.72:0/2279344290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9014e0c0 con 0x7fcc900aa290 2023-08-31T19:07:07.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.509+0000 7fcc8cff9700 1 -- 172.21.15.72:0/2279344290 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 53) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fcc7c01ba10 con 0x7fcc900aa290 2023-08-31T19:07:07.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.510+0000 7fcc8cff9700 1 --2- 172.21.15.72:0/2279344290 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcc7405f050 0x7fcc74061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.510+0000 7fcc8cff9700 1 -- 172.21.15.72:0/2279344290 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 7035+0+0 (secure 0 0 0) 0x7fcc7c07bf90 con 0x7fcc900aa290 2023-08-31T19:07:07.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.510+0000 7fcc94d9b700 1 -- 172.21.15.72:0/2279344290 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcc7405f050 msgr2=0x7fcc74061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:07.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.510+0000 7fcc94d9b700 1 --2- 172.21.15.72:0/2279344290 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcc7405f050 0x7fcc74061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:07.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.514+0000 7fcc8cff9700 1 -- 172.21.15.72:0/2279344290 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcc9014e0c0 con 0x7fcc900aa290 2023-08-31T19:07:07.618 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:07.618+0000 7f0af00b6680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:07:07.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.711+0000 7fcc96fff700 1 -- 172.21.15.72:0/2279344290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc9014e0c0 con 0x7fcc900aa290 2023-08-31T19:07:07.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.712+0000 7fcc8cff9700 1 -- 172.21.15.72:0/2279344290 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+18425 (secure 0 0 0) 0x7fcc9014e0c0 con 0x7fcc900aa290 2023-08-31T19:07:07.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.712+0000 7fcc94d9b700 1 -- 172.21.15.72:0/2279344290 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcc7405f050 msgr2=0x7fcc74061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:07.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.712+0000 7fcc94d9b700 1 --2- 172.21.15.72:0/2279344290 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcc7405f050 0x7fcc74061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:07:07.713 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:07.713 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":128,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:07:05.594661+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:06:13.809620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-31T19:06:14.978639+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":128,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/753946871":"2023-09-01T19:06:30.413851+0000","172.21.15.72:0/1048677090":"2023-09-01T19:06:30.413851+0000","172.21.15.72:6833/143463":"2023-09-01T19:06:30.413851+0000","172.21.15.72:6832/143463":"2023-09-01T19:06:30.413851+0000","172.21.15.72:0/1676737569":"2023-09-01T19:06:30.413851+0000","172.21.15.72:0/458944015":"2023-09-01T19:06:30.413851+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:07:07.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.714+0000 7fcc96fff700 1 -- 172.21.15.72:0/2279344290 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcc7405f050 msgr2=0x7fcc74061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:07.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.714+0000 7fcc96fff700 1 --2- 172.21.15.72:0/2279344290 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcc7405f050 0x7fcc74061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:07.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.714+0000 7fcc96fff700 1 -- 172.21.15.72:0/2279344290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc900aa290 msgr2=0x7fcc900c4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:07.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.714+0000 7fcc96fff700 1 --2- 172.21.15.72:0/2279344290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc900aa290 0x7fcc900c4360 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7fcc7c009e30 tx=0x7fcc7c017000).stop 2023-08-31T19:07:07.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.714+0000 7fcc96fff700 1 -- 172.21.15.72:0/2279344290 shutdown_connections 2023-08-31T19:07:07.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.714+0000 7fcc96fff700 1 --2- 172.21.15.72:0/2279344290 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcc7405f050 0x7fcc74061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:07.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.714+0000 7fcc96fff700 1 --2- 172.21.15.72:0/2279344290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc901574b0 0x7fcc900c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.714+0000 7fcc96fff700 1 --2- 172.21.15.72:0/2279344290 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcc900a9eb0 0x7fcc9014cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.714+0000 7fcc96fff700 1 --2- 172.21.15.72:0/2279344290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc900aa290 0x7fcc900c4360 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.714+0000 7fcc96fff700 1 -- 172.21.15.72:0/2279344290 >> 172.21.15.72:0/2279344290 conn(0x7fcc900c82e0 msgr2=0x7fcc900c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:07.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.714+0000 7fcc96fff700 1 -- 172.21.15.72:0/2279344290 shutdown_connections 2023-08-31T19:07:07.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.714+0000 7fcc96fff700 1 -- 172.21.15.72:0/2279344290 wait complete. 2023-08-31T19:07:07.721 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:07.721+0000 7f3d69e1b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:07:07.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T19:07:07.810 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:07.810+0000 7f3d69e1b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:07:07.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.970+0000 7f8408dff700 1 Processor -- start 2023-08-31T19:07:07.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.970+0000 7f8408dff700 1 -- start start 2023-08-31T19:07:07.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.971+0000 7f8408dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8404151f20 0x7f8404067f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.971+0000 7f8408dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f84040c5090 0x7f84041551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.971+0000 7f8408dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84040a81b0 con 0x7f8404067b30 2023-08-31T19:07:07.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.971+0000 7f8408dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84041556e0 con 0x7f8404151f20 2023-08-31T19:07:07.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.971+0000 7f8408dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8404068750 con 0x7f84040c5090 2023-08-31T19:07:07.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.972+0000 7f8401d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8404151f20 0x7f8404067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:07.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.972+0000 7f8401d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8404151f20 0x7f8404067f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46468/0 (socket says 172.21.15.72:46468) 2023-08-31T19:07:07.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.972+0000 7f8401d9b700 1 -- 172.21.15.72:0/1148186819 learned_addr learned my addr 172.21.15.72:0/1148186819 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:07.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.972+0000 7f840259c700 1 --1- 172.21.15.72:0/1148186819 >> v1:172.21.15.72:6789/0 conn(0x7f8404067b30 0x7f8404151810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54722/0 (socket says 172.21.15.72:54722) 2023-08-31T19:07:07.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.972+0000 7f8402d9d700 1 --2- 172.21.15.72:0/1148186819 >> v2:172.21.15.146:3300/0 conn(0x7f84040c5090 0x7f84041551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:07.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.972+0000 7f840159a700 1 -- 172.21.15.72:0/1148186819 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590849869 0 0) 0x7f84040a81b0 con 0x7f8404067b30 2023-08-31T19:07:07.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.972+0000 7f840159a700 1 -- 172.21.15.72:0/1148186819 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83ec0033f0 con 0x7f8404067b30 2023-08-31T19:07:07.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.972+0000 7f8401d9b700 1 -- 172.21.15.72:0/1148186819 >> v2:172.21.15.146:3300/0 conn(0x7f84040c5090 msgr2=0x7f84041551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:07.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.972+0000 7f8401d9b700 1 --2- 172.21.15.72:0/1148186819 >> v2:172.21.15.146:3300/0 conn(0x7f84040c5090 0x7f84041551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.972+0000 7f8401d9b700 1 -- 172.21.15.72:0/1148186819 >> v1:172.21.15.72:6789/0 conn(0x7f8404067b30 legacy=0x7f8404151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:07.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.972+0000 7f8401d9b700 1 -- 172.21.15.72:0/1148186819 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84040a7e80 con 0x7f8404151f20 2023-08-31T19:07:07.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.973+0000 7f8401d9b700 1 --2- 172.21.15.72:0/1148186819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8404151f20 0x7f8404067f10 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f84040c5500 tx=0x7f83f80090f0).ready entity=mon.0 client_cookie=4f6313dc25cea99f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:07.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.973+0000 7f840159a700 1 -- 172.21.15.72:0/1148186819 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f800f510 con 0x7f8404151f20 2023-08-31T19:07:07.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.973+0000 7f840159a700 1 -- 172.21.15.72:0/1148186819 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f800f670 con 0x7f8404151f20 2023-08-31T19:07:07.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.973+0000 7f840159a700 1 -- 172.21.15.72:0/1148186819 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f800f9f0 con 0x7f8404151f20 2023-08-31T19:07:07.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.973+0000 7f8408dff700 1 -- 172.21.15.72:0/1148186819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8404151f20 msgr2=0x7f8404067f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:07.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.973+0000 7f8408dff700 1 --2- 172.21.15.72:0/1148186819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8404151f20 0x7f8404067f10 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f84040c5500 tx=0x7f83f80090f0).stop 2023-08-31T19:07:07.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.973+0000 7f8408dff700 1 -- 172.21.15.72:0/1148186819 shutdown_connections 2023-08-31T19:07:07.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.973+0000 7f8408dff700 1 --2- 172.21.15.72:0/1148186819 >> v2:172.21.15.146:3300/0 conn(0x7f84040c5090 0x7f84041551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.973+0000 7f8408dff700 1 --2- 172.21.15.72:0/1148186819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8404151f20 0x7f8404067f10 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.973+0000 7f8408dff700 1 -- 172.21.15.72:0/1148186819 >> 172.21.15.72:0/1148186819 conn(0x7f84040c8c20 msgr2=0x7f84040c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:07.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.974+0000 7f8408dff700 1 -- 172.21.15.72:0/1148186819 shutdown_connections 2023-08-31T19:07:07.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.974+0000 7f8408dff700 1 -- 172.21.15.72:0/1148186819 wait complete. 2023-08-31T19:07:07.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.975+0000 7f8408dff700 1 Processor -- start 2023-08-31T19:07:07.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.975+0000 7f8408dff700 1 -- start start 2023-08-31T19:07:07.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.976+0000 7f8408dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8404067b30 0x7f840414ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.976+0000 7f8408dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84040c5090 0x7f84041685f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.976+0000 7f8408dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8404151f20 0x7f84040ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.976+0000 7f8408dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840414b060 con 0x7f8404067b30 2023-08-31T19:07:07.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.976+0000 7f8408dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84040adec0 con 0x7f84040c5090 2023-08-31T19:07:07.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.976+0000 7f8408dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8404168ae0 con 0x7f8404151f20 2023-08-31T19:07:07.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.976+0000 7f840259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8404067b30 0x7f840414ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:07.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.977+0000 7f840259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8404067b30 0x7f840414ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46480/0 (socket says 172.21.15.72:46480) 2023-08-31T19:07:07.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.977+0000 7f840259c700 1 -- 172.21.15.72:0/1716644001 learned_addr learned my addr 172.21.15.72:0/1716644001 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:07.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.977+0000 7f8401d9b700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84040c5090 0x7f84041685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:07.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.977+0000 7f8402d9d700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8404151f20 0x7f84040ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:07.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.977+0000 7f840259c700 1 -- 172.21.15.72:0/1716644001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8404151f20 msgr2=0x7f84040ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:07.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.977+0000 7f840259c700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8404151f20 0x7f84040ae350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.977+0000 7f840259c700 1 -- 172.21.15.72:0/1716644001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84040c5090 msgr2=0x7f84041685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:07.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.977+0000 7f840259c700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84040c5090 0x7f84041685f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:07.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.977+0000 7f840259c700 1 -- 172.21.15.72:0/1716644001 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8009370 con 0x7f8404067b30 2023-08-31T19:07:07.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.977+0000 7f8401d9b700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84040c5090 0x7f84041685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:07:07.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.977+0000 7f840259c700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8404067b30 0x7f840414ab70 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f83f400c7c0 tx=0x7f83f4007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:07.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.977+0000 7f83f27fc700 1 -- 172.21.15.72:0/1716644001 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f40072e0 con 0x7f8404067b30 2023-08-31T19:07:07.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.977+0000 7f83f27fc700 1 -- 172.21.15.72:0/1716644001 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f4007440 con 0x7f8404067b30 2023-08-31T19:07:07.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.977+0000 7f8408dff700 1 -- 172.21.15.72:0/1716644001 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84040abbb0 con 0x7f8404067b30 2023-08-31T19:07:07.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.977+0000 7f83f27fc700 1 -- 172.21.15.72:0/1716644001 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4005880 con 0x7f8404067b30 2023-08-31T19:07:07.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.978+0000 7f8408dff700 1 -- 172.21.15.72:0/1716644001 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84040ad870 con 0x7f8404067b30 2023-08-31T19:07:07.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.979+0000 7f8408dff700 1 -- 172.21.15.72:0/1716644001 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84040ad6d0 con 0x7f8404067b30 2023-08-31T19:07:07.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.979+0000 7f83f27fc700 1 -- 172.21.15.72:0/1716644001 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 53) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f83f4005c70 con 0x7f8404067b30 2023-08-31T19:07:07.987 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:07.980+0000 7f0af00b6680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:07:07.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.980+0000 7f83f27fc700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f83e405f050 0x7f83e4061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:07.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.980+0000 7f83f27fc700 1 -- 172.21.15.72:0/1716644001 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f83f4079d20 con 0x7f8404067b30 2023-08-31T19:07:07.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.980+0000 7f8401d9b700 1 -- 172.21.15.72:0/1716644001 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f83e405f050 msgr2=0x7f83e4061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:07.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.980+0000 7f8401d9b700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f83e405f050 0x7f83e4061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:07.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:07.984+0000 7f83f27fc700 1 -- 172.21.15.72:0/1716644001 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f84040ad6d0 con 0x7f8404067b30 2023-08-31T19:07:08.075 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:08.075+0000 7f0af00b6680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:07:08.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:08.085+0000 7f83f27fc700 1 -- 172.21.15.72:0/1716644001 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 54) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f83f4077460 con 0x7f8404067b30 2023-08-31T19:07:08.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:08.085+0000 7f83f27fc700 1 -- 172.21.15.72:0/1716644001 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f83e405f050 msgr2=0x7f83e4061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:08.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:08.085+0000 7f83f27fc700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f83e405f050 0x7f83e4061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:08.154 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:08.152+0000 7f0a67b8b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:08.155 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:08.152+0000 7f0a67b8b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:08.155 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:08.152+0000 7f0a67b8b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:08.156 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:08.152+0000 7f0a67b8b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:08.156 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:08.152+0000 7f0a67b8b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:08.156 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:08.152+0000 7f0a6bb93700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:08.156 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:08.152+0000 7f0a6bb93700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:08.157 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:08.152+0000 7f0a6bb93700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:08.157 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:08.152+0000 7f0a6bb93700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:08.157 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:08.152+0000 7f0a6bb93700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:08.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:08.224+0000 7f8408dff700 1 -- 172.21.15.72:0/1716644001 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f84040ad6d0 con 0x7f8404067b30 2023-08-31T19:07:09.082 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-08-31T19:07:09.082+0000 7f89d2ff7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T19:07:09.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.087+0000 7f83f27fc700 1 -- 172.21.15.72:0/1716644001 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mgrmap(e 55) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f83f40777e0 con 0x7f8404067b30 2023-08-31T19:07:09.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.088+0000 7f83f27fc700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f83e405f050 0x7f83e4061490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:09.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.089+0000 7f8401d9b700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f83e405f050 0x7f83e4061490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:09.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.091+0000 7f8401d9b700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f83e405f050 0x7f83e4061490 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f84040c5500 tx=0x7f83f8017000).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:09.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.097+0000 7f83f27fc700 1 -- 172.21.15.72:0/1716644001 <== mon.0 v2:172.21.15.72:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) v1 ==== 161+0+0 (secure 0 0 0) 0x7f83f404bb10 con 0x7f8404067b30 2023-08-31T19:07:09.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.100+0000 7f8408dff700 1 -- 172.21.15.72:0/1716644001 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f83e405f050 msgr2=0x7f83e4061490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:09.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.100+0000 7f8408dff700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f83e405f050 0x7f83e4061490 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f84040c5500 tx=0x7f83f8017000).stop 2023-08-31T19:07:09.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.100+0000 7f8408dff700 1 -- 172.21.15.72:0/1716644001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8404067b30 msgr2=0x7f840414ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:09.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.100+0000 7f8408dff700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8404067b30 0x7f840414ab70 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f83f400c7c0 tx=0x7f83f4007bb0).stop 2023-08-31T19:07:09.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.100+0000 7f8408dff700 1 -- 172.21.15.72:0/1716644001 shutdown_connections 2023-08-31T19:07:09.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.100+0000 7f8408dff700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8404151f20 0x7f84040ae350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:09.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.100+0000 7f8408dff700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8404067b30 0x7f840414ab70 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:09.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.100+0000 7f8408dff700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f83e405f050 0x7f83e4061490 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:09.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.100+0000 7f8408dff700 1 --2- 172.21.15.72:0/1716644001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84040c5090 0x7f84041685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:09.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.100+0000 7f8408dff700 1 -- 172.21.15.72:0/1716644001 >> 172.21.15.72:0/1716644001 conn(0x7f84040c8c20 msgr2=0x7f8404064cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:09.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.100+0000 7f8408dff700 1 -- 172.21.15.72:0/1716644001 shutdown_connections 2023-08-31T19:07:09.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.100+0000 7f8408dff700 1 -- 172.21.15.72:0/1716644001 wait complete. 2023-08-31T19:07:09.102 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T19:07:09.107 INFO:tasks.ceph.mds.a.smithi072.stderr: -6486> 2023-08-31T19:06:20.899+0000 7fd5641f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:07:09.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T19:07:09.154 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T19:07:09.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.313+0000 7fc8d85ff700 1 Processor -- start 2023-08-31T19:07:09.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.314+0000 7fc8d85ff700 1 -- start start 2023-08-31T19:07:09.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.315+0000 7fc8d85ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8d00bdb30 0x7fc8d01542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:09.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.315+0000 7fc8d85ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d00a84b0 con 0x7fc8d00663d0 2023-08-31T19:07:09.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.315+0000 7fc8d85ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d00c9410 con 0x7fc8d0153ed0 2023-08-31T19:07:09.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.315+0000 7fc8d85ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d00c5310 con 0x7fc8d00bdb30 2023-08-31T19:07:09.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.315+0000 7fc8d5b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8d00bdb30 0x7fc8d01542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:09.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.315+0000 7fc8d6b9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc8d00663d0 0x7fc8d0157d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54728/0 (socket says 172.21.15.72:54728) 2023-08-31T19:07:09.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.315+0000 7fc8d5b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8d00bdb30 0x7fc8d01542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46578/0 (socket says 172.21.15.72:46578) 2023-08-31T19:07:09.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.315+0000 7fc8d6b9c700 1 -- 172.21.15.72:0/1776508086 learned_addr learned my addr 172.21.15.72:0/1776508086 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:09.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.316+0000 7fc8d5b9a700 1 -- 172.21.15.72:0/1776508086 >> v1:172.21.15.146:6789/0 conn(0x7fc8d0153ed0 legacy=0x7fc8d0155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:09.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.316+0000 7fc8d5b9a700 1 -- 172.21.15.72:0/1776508086 >> v1:172.21.15.72:6789/0 conn(0x7fc8d00663d0 legacy=0x7fc8d0157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:09.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.316+0000 7fc8d5b9a700 1 -- 172.21.15.72:0/1776508086 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d00a7ef0 con 0x7fc8d00bdb30 2023-08-31T19:07:09.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.316+0000 7fc8d5399700 1 -- 172.21.15.72:0/1776508086 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137684535 0 0) 0x7fc8d00a84b0 con 0x7fc8d00663d0 2023-08-31T19:07:09.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.316+0000 7fc8d5b9a700 1 --2- 172.21.15.72:0/1776508086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8d00bdb30 0x7fc8d01542b0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7fc8c0009760 tx=0x7fc8c0009060).ready entity=mon.0 client_cookie=355c7712bda9de87 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:09.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.316+0000 7fc8d5399700 1 -- 172.21.15.72:0/1776508086 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0009120 con 0x7fc8d00bdb30 2023-08-31T19:07:09.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.316+0000 7fc8d5399700 1 -- 172.21.15.72:0/1776508086 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c000b580 con 0x7fc8d00bdb30 2023-08-31T19:07:09.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.316+0000 7fc8d5399700 1 -- 172.21.15.72:0/1776508086 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c000b900 con 0x7fc8d00bdb30 2023-08-31T19:07:09.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.316+0000 7fc8d85ff700 1 -- 172.21.15.72:0/1776508086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8d00bdb30 msgr2=0x7fc8d01542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:09.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.316+0000 7fc8d85ff700 1 --2- 172.21.15.72:0/1776508086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8d00bdb30 0x7fc8d01542b0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7fc8c0009760 tx=0x7fc8c0009060).stop 2023-08-31T19:07:09.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.317+0000 7fc8d85ff700 1 -- 172.21.15.72:0/1776508086 shutdown_connections 2023-08-31T19:07:09.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.317+0000 7fc8d85ff700 1 --2- 172.21.15.72:0/1776508086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8d00bdb30 0x7fc8d01542b0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:09.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.317+0000 7fc8d85ff700 1 -- 172.21.15.72:0/1776508086 >> 172.21.15.72:0/1776508086 conn(0x7fc8d005eb60 msgr2=0x7fc8d00c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:09.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.317+0000 7fc8d85ff700 1 -- 172.21.15.72:0/1776508086 shutdown_connections 2023-08-31T19:07:09.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.317+0000 7fc8d85ff700 1 -- 172.21.15.72:0/1776508086 wait complete. 2023-08-31T19:07:09.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.318+0000 7fc8d85ff700 1 Processor -- start 2023-08-31T19:07:09.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.318+0000 7fc8d85ff700 1 -- start start 2023-08-31T19:07:09.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.319+0000 7fc8d85ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8d00663d0 0x7fc8d01506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:09.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.319+0000 7fc8d85ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8d0153ed0 0x7fc8d01679d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:09.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.319+0000 7fc8d85ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8d0167ec0 0x7fc8d0155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:09.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.319+0000 7fc8d85ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d0156700 con 0x7fc8d0167ec0 2023-08-31T19:07:09.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.319+0000 7fc8d85ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d00a8900 con 0x7fc8d0153ed0 2023-08-31T19:07:09.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.319+0000 7fc8d85ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d00ac5c0 con 0x7fc8d00663d0 2023-08-31T19:07:09.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.319+0000 7fc8d6b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8d0167ec0 0x7fc8d0155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:09.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.319+0000 7fc8d6b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8d0167ec0 0x7fc8d0155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46592/0 (socket says 172.21.15.72:46592) 2023-08-31T19:07:09.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.319+0000 7fc8d6b9c700 1 -- 172.21.15.72:0/1050612737 learned_addr learned my addr 172.21.15.72:0/1050612737 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:09.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.320+0000 7fc8d5b9a700 1 --2- 172.21.15.72:0/1050612737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8d0153ed0 0x7fc8d01679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:09.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.320+0000 7fc8d639b700 1 --2- 172.21.15.72:0/1050612737 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8d00663d0 0x7fc8d01506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:09.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.320+0000 7fc8d6b9c700 1 -- 172.21.15.72:0/1050612737 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8d00663d0 msgr2=0x7fc8d01506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:09.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.320+0000 7fc8d6b9c700 1 --2- 172.21.15.72:0/1050612737 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8d00663d0 0x7fc8d01506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:09.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.320+0000 7fc8d6b9c700 1 -- 172.21.15.72:0/1050612737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8d0153ed0 msgr2=0x7fc8d01679d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:09.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.320+0000 7fc8d6b9c700 1 --2- 172.21.15.72:0/1050612737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8d0153ed0 0x7fc8d01679d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:09.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.320+0000 7fc8d6b9c700 1 -- 172.21.15.72:0/1050612737 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c00092a0 con 0x7fc8d0167ec0 2023-08-31T19:07:09.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.320+0000 7fc8d6b9c700 1 --2- 172.21.15.72:0/1050612737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8d0167ec0 0x7fc8d0155940 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7fc8c800c810 tx=0x7fc8c8007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:09.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.320+0000 7fc8c67fc700 1 -- 172.21.15.72:0/1050612737 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8005d80 con 0x7fc8d0167ec0 2023-08-31T19:07:09.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.320+0000 7fc8c67fc700 1 -- 172.21.15.72:0/1050612737 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c80070d0 con 0x7fc8d0167ec0 2023-08-31T19:07:09.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.320+0000 7fc8d85ff700 1 -- 172.21.15.72:0/1050612737 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d0168340 con 0x7fc8d0167ec0 2023-08-31T19:07:09.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.320+0000 7fc8c67fc700 1 -- 172.21.15.72:0/1050612737 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8007490 con 0x7fc8d0167ec0 2023-08-31T19:07:09.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.320+0000 7fc8d85ff700 1 -- 172.21.15.72:0/1050612737 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d00abf70 con 0x7fc8d0167ec0 2023-08-31T19:07:09.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.321+0000 7fc8d85ff700 1 -- 172.21.15.72:0/1050612737 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d00c6880 con 0x7fc8d0167ec0 2023-08-31T19:07:09.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.322+0000 7fc8c67fc700 1 -- 172.21.15.72:0/1050612737 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 55) v1 ==== 75166+0+0 (secure 0 0 0) 0x7fc8c80078c0 con 0x7fc8d0167ec0 2023-08-31T19:07:09.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.323+0000 7fc8c67fc700 1 --2- 172.21.15.72:0/1050612737 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc8b405ecf0 0x7fc8b40611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:09.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.323+0000 7fc8c67fc700 1 -- 172.21.15.72:0/1050612737 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 7351+0+0 (secure 0 0 0) 0x7fc8c8079a70 con 0x7fc8d0167ec0 2023-08-31T19:07:09.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.323+0000 7fc8d639b700 1 --2- 172.21.15.72:0/1050612737 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc8b405ecf0 0x7fc8b40611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:09.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.324+0000 7fc8d639b700 1 --2- 172.21.15.72:0/1050612737 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc8b405ecf0 0x7fc8b40611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc8d00c8ec0 tx=0x7fc8cc009040).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:09.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.327+0000 7fc8c67fc700 1 -- 172.21.15.72:0/1050612737 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc8c804aad0 con 0x7fc8d0167ec0 2023-08-31T19:07:09.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:09.539+0000 7fc8d85ff700 1 -- 172.21.15.72:0/1050612737 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc8d00a81d0 con 0x7fc8d0167ec0 2023-08-31T19:07:10.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.097+0000 7fc8c67fc700 1 -- 172.21.15.72:0/1050612737 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc8c8018020 con 0x7fc8d0167ec0 2023-08-31T19:07:10.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.100+0000 7fc8d85ff700 1 -- 172.21.15.72:0/1050612737 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc8b405ecf0 msgr2=0x7fc8b40611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:10.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.100+0000 7fc8d85ff700 1 --2- 172.21.15.72:0/1050612737 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc8b405ecf0 0x7fc8b40611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc8d00c8ec0 tx=0x7fc8cc009040).stop 2023-08-31T19:07:10.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.100+0000 7fc8d85ff700 1 -- 172.21.15.72:0/1050612737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8d0167ec0 msgr2=0x7fc8d0155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:10.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.100+0000 7fc8d85ff700 1 --2- 172.21.15.72:0/1050612737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8d0167ec0 0x7fc8d0155940 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7fc8c800c810 tx=0x7fc8c8007f60).stop 2023-08-31T19:07:10.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.100+0000 7fc8d85ff700 1 -- 172.21.15.72:0/1050612737 shutdown_connections 2023-08-31T19:07:10.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.100+0000 7fc8d85ff700 1 --2- 172.21.15.72:0/1050612737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8d0167ec0 0x7fc8d0155940 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:10.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.100+0000 7fc8d85ff700 1 --2- 172.21.15.72:0/1050612737 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8d00663d0 0x7fc8d01506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:10.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.100+0000 7fc8d85ff700 1 --2- 172.21.15.72:0/1050612737 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc8b405ecf0 0x7fc8b40611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:10.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.100+0000 7fc8d85ff700 1 --2- 172.21.15.72:0/1050612737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8d0153ed0 0x7fc8d01679d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:10.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.100+0000 7fc8d85ff700 1 -- 172.21.15.72:0/1050612737 >> 172.21.15.72:0/1050612737 conn(0x7fc8d005eb60 msgr2=0x7fc8d00c7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:10.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.101+0000 7fc8d85ff700 1 -- 172.21.15.72:0/1050612737 shutdown_connections 2023-08-31T19:07:10.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.101+0000 7fc8d85ff700 1 -- 172.21.15.72:0/1050612737 wait complete. 2023-08-31T19:07:10.120 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T19:07:10.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.355+0000 7fec015ff700 1 Processor -- start 2023-08-31T19:07:10.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.356+0000 7fec015ff700 1 -- start start 2023-08-31T19:07:10.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.357+0000 7fec015ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7febfc151da0 0x7febfc1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:10.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.357+0000 7fec015ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7febfc064d70 0x7febfc0bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:10.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.357+0000 7fec015ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febfc154f40 con 0x7febfc0c5370 2023-08-31T19:07:10.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.357+0000 7fec015ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febfc154960 con 0x7febfc064d70 2023-08-31T19:07:10.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.357+0000 7fec015ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febfc0aa2c0 con 0x7febfc151da0 2023-08-31T19:07:10.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.357+0000 7febfb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7febfc064d70 0x7febfc0bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:10.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.357+0000 7febfb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7febfc064d70 0x7febfc0bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46606/0 (socket says 172.21.15.72:46606) 2023-08-31T19:07:10.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.357+0000 7febfb7fe700 1 -- 172.21.15.72:0/1691675791 learned_addr learned my addr 172.21.15.72:0/1691675791 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:10.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.357+0000 7febfa7fc700 1 --1- 172.21.15.72:0/1691675791 >> v1:172.21.15.72:6789/0 conn(0x7febfc0c5370 0x7febfc064660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54744/0 (socket says 172.21.15.72:54744) 2023-08-31T19:07:10.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.357+0000 7febfaffd700 1 --2- 172.21.15.72:0/1691675791 >> v2:172.21.15.146:3300/0 conn(0x7febfc151da0 0x7febfc1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:10.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.358+0000 7febfb7fe700 1 -- 172.21.15.72:0/1691675791 >> v2:172.21.15.146:3300/0 conn(0x7febfc151da0 msgr2=0x7febfc1553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:10.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.358+0000 7febfb7fe700 1 --2- 172.21.15.72:0/1691675791 >> v2:172.21.15.146:3300/0 conn(0x7febfc151da0 0x7febfc1553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:10.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.358+0000 7febfb7fe700 1 -- 172.21.15.72:0/1691675791 >> v1:172.21.15.72:6789/0 conn(0x7febfc0c5370 legacy=0x7febfc064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:10.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.358+0000 7febfb7fe700 1 -- 172.21.15.72:0/1691675791 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc154bd0 con 0x7febfc064d70 2023-08-31T19:07:10.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.358+0000 7febf9ffb700 1 -- 172.21.15.72:0/1691675791 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088347497 0 0) 0x7febfc154f40 con 0x7febfc0c5370 2023-08-31T19:07:10.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.358+0000 7febfb7fe700 1 --2- 172.21.15.72:0/1691675791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc064d70 0x7febfc0bfcd0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7febfc061630 tx=0x7febf4009840).ready entity=mon.0 client_cookie=378ea11f0bae2c3f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:10.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.358+0000 7febf9ffb700 1 -- 172.21.15.72:0/1691675791 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf400e070 con 0x7febfc064d70 2023-08-31T19:07:10.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.358+0000 7febf9ffb700 1 -- 172.21.15.72:0/1691675791 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf400ba50 con 0x7febfc064d70 2023-08-31T19:07:10.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.358+0000 7febf9ffb700 1 -- 172.21.15.72:0/1691675791 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf400bdd0 con 0x7febfc064d70 2023-08-31T19:07:10.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.359+0000 7fec015ff700 1 -- 172.21.15.72:0/1691675791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc064d70 msgr2=0x7febfc0bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:10.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.359+0000 7fec015ff700 1 --2- 172.21.15.72:0/1691675791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc064d70 0x7febfc0bfcd0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7febfc061630 tx=0x7febf4009840).stop 2023-08-31T19:07:10.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.359+0000 7fec015ff700 1 -- 172.21.15.72:0/1691675791 shutdown_connections 2023-08-31T19:07:10.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.359+0000 7fec015ff700 1 --2- 172.21.15.72:0/1691675791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc064d70 0x7febfc0bfcd0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:10.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.359+0000 7fec015ff700 1 --2- 172.21.15.72:0/1691675791 >> v2:172.21.15.146:3300/0 conn(0x7febfc151da0 0x7febfc1553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:10.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.359+0000 7fec015ff700 1 -- 172.21.15.72:0/1691675791 >> 172.21.15.72:0/1691675791 conn(0x7febfc063a90 msgr2=0x7febfc0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:10.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.359+0000 7fec015ff700 1 -- 172.21.15.72:0/1691675791 shutdown_connections 2023-08-31T19:07:10.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.359+0000 7fec015ff700 1 -- 172.21.15.72:0/1691675791 wait complete. 2023-08-31T19:07:10.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.360+0000 7fec015ff700 1 Processor -- start 2023-08-31T19:07:10.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.361+0000 7fec015ff700 1 -- start start 2023-08-31T19:07:10.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.361+0000 7fec015ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc064d70 0x7febfc0c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:10.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.361+0000 7fec015ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc0c5370 0x7febfc0c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:10.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.361+0000 7fec015ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febfc151da0 0x7febfc0add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:10.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.361+0000 7fec015ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc1572d0 con 0x7febfc0c5370 2023-08-31T19:07:10.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.361+0000 7fec015ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc165020 con 0x7febfc064d70 2023-08-31T19:07:10.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.361+0000 7fec015ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc156a30 con 0x7febfc151da0 2023-08-31T19:07:10.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7febfa7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc0c5370 0x7febfc0c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:10.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7febfa7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc0c5370 0x7febfc0c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46622/0 (socket says 172.21.15.72:46622) 2023-08-31T19:07:10.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7febfa7fc700 1 -- 172.21.15.72:0/1662179961 learned_addr learned my addr 172.21.15.72:0/1662179961 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:10.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7febfaffd700 1 --2- 172.21.15.72:0/1662179961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc064d70 0x7febfc0c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:10.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7febfb7fe700 1 --2- 172.21.15.72:0/1662179961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febfc151da0 0x7febfc0add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:10.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7febfa7fc700 1 -- 172.21.15.72:0/1662179961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febfc151da0 msgr2=0x7febfc0add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7febfa7fc700 1 --2- 172.21.15.72:0/1662179961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febfc151da0 0x7febfc0add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7febfa7fc700 1 -- 172.21.15.72:0/1662179961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc064d70 msgr2=0x7febfc0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7febfa7fc700 1 --2- 172.21.15.72:0/1662179961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc064d70 0x7febfc0c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7febfa7fc700 1 -- 172.21.15.72:0/1662179961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf4009ae0 con 0x7febfc0c5370 2023-08-31T19:07:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7febfaffd700 1 --2- 172.21.15.72:0/1662179961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc064d70 0x7febfc0c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:10.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7febfa7fc700 1 --2- 172.21.15.72:0/1662179961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc0c5370 0x7febfc0c4910 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7febf000c590 tx=0x7febf0007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:10.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7febe2ffd700 1 -- 172.21.15.72:0/1662179961 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf00072e0 con 0x7febfc0c5370 2023-08-31T19:07:10.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7febe2ffd700 1 -- 172.21.15.72:0/1662179961 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf0007440 con 0x7febfc0c5370 2023-08-31T19:07:10.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7febe2ffd700 1 -- 172.21.15.72:0/1662179961 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf00058f0 con 0x7febfc0c5370 2023-08-31T19:07:10.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.362+0000 7fec015ff700 1 -- 172.21.15.72:0/1662179961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febfc156d10 con 0x7febfc0c5370 2023-08-31T19:07:10.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.363+0000 7fec015ff700 1 -- 172.21.15.72:0/1662179961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febfc151320 con 0x7febfc0c5370 2023-08-31T19:07:10.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.364+0000 7fec015ff700 1 -- 172.21.15.72:0/1662179961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febfc06a7e0 con 0x7febfc0c5370 2023-08-31T19:07:10.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.364+0000 7febe2ffd700 1 -- 172.21.15.72:0/1662179961 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 55) v1 ==== 75166+0+0 (secure 0 0 0) 0x7febf0005ce0 con 0x7febfc0c5370 2023-08-31T19:07:10.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.365+0000 7febe2ffd700 1 --2- 172.21.15.72:0/1662179961 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7febe805ecf0 0x7febe80611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:10.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.365+0000 7febe2ffd700 1 -- 172.21.15.72:0/1662179961 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 7351+0+0 (secure 0 0 0) 0x7febf00798b0 con 0x7febfc0c5370 2023-08-31T19:07:10.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.365+0000 7febfaffd700 1 --2- 172.21.15.72:0/1662179961 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7febe805ecf0 0x7febe80611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:10.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.366+0000 7febfaffd700 1 --2- 172.21.15.72:0/1662179961 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7febe805ecf0 0x7febe80611b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7febec00bb60 tx=0x7febec008040).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:10.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.369+0000 7febe2ffd700 1 -- 172.21.15.72:0/1662179961 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7febf004aa20 con 0x7febfc0c5370 2023-08-31T19:07:10.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.541+0000 7fec015ff700 1 -- 172.21.15.72:0/1662179961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7febfc1651b0 con 0x7febfc0c5370 2023-08-31T19:07:10.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:10.627+0000 7febe2ffd700 1 -- 172.21.15.72:0/1662179961 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7febf0077380 con 0x7febfc0c5370 2023-08-31T19:07:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.115+0000 7febe2ffd700 1 -- 172.21.15.72:0/1662179961 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v132) v1 ==== 181+0+0 (secure 0 0 0) 0x7febf00763e0 con 0x7febfc0c5370 2023-08-31T19:07:11.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.119+0000 7fec015ff700 1 -- 172.21.15.72:0/1662179961 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7febe805ecf0 msgr2=0x7febe80611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:11.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.119+0000 7fec015ff700 1 --2- 172.21.15.72:0/1662179961 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7febe805ecf0 0x7febe80611b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7febec00bb60 tx=0x7febec008040).stop 2023-08-31T19:07:11.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.120+0000 7fec015ff700 1 -- 172.21.15.72:0/1662179961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc0c5370 msgr2=0x7febfc0c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:11.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.120+0000 7fec015ff700 1 --2- 172.21.15.72:0/1662179961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc0c5370 0x7febfc0c4910 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7febf000c590 tx=0x7febf0007c90).stop 2023-08-31T19:07:11.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.120+0000 7fec015ff700 1 -- 172.21.15.72:0/1662179961 shutdown_connections 2023-08-31T19:07:11.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.120+0000 7fec015ff700 1 --2- 172.21.15.72:0/1662179961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7febfc151da0 0x7febfc0add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:11.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.120+0000 7fec015ff700 1 --2- 172.21.15.72:0/1662179961 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7febe805ecf0 0x7febe80611b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:11.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.120+0000 7fec015ff700 1 --2- 172.21.15.72:0/1662179961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febfc064d70 0x7febfc0c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:11.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.120+0000 7fec015ff700 1 --2- 172.21.15.72:0/1662179961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc0c5370 0x7febfc0c4910 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:11.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.120+0000 7fec015ff700 1 -- 172.21.15.72:0/1662179961 >> 172.21.15.72:0/1662179961 conn(0x7febfc063a90 msgr2=0x7febfc0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:11.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.120+0000 7fec015ff700 1 -- 172.21.15.72:0/1662179961 shutdown_connections 2023-08-31T19:07:11.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.120+0000 7fec015ff700 1 -- 172.21.15.72:0/1662179961 wait complete. 2023-08-31T19:07:11.123 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-08-31T19:07:11.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T19:07:11.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.334+0000 7fbefd1ff700 1 Processor -- start 2023-08-31T19:07:11.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.334+0000 7fbefd1ff700 1 -- start start 2023-08-31T19:07:11.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.335+0000 7fbefd1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbef8154120 0x7fbef80a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:11.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.336+0000 7fbefd1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbef8064db0 0x7fbef815dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:11.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.336+0000 7fbefd1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef80aa620 con 0x7fbef8154500 2023-08-31T19:07:11.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.336+0000 7fbefd1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef80aa3a0 con 0x7fbef8064db0 2023-08-31T19:07:11.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.336+0000 7fbefd1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef80c5450 con 0x7fbef8154120 2023-08-31T19:07:11.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.336+0000 7fbeeffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbef8154500 0x7fbef80646a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54748/0 (socket says 172.21.15.72:54748) 2023-08-31T19:07:11.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.336+0000 7fbeeffff700 1 -- 172.21.15.72:0/72123662 learned_addr learned my addr 172.21.15.72:0/72123662 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:11.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.336+0000 7fbef759e700 1 --2- 172.21.15.72:0/72123662 >> v2:172.21.15.72:3300/0 conn(0x7fbef8064db0 0x7fbef815dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:11.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.336+0000 7fbef6d9d700 1 --2- 172.21.15.72:0/72123662 >> v2:172.21.15.146:3300/0 conn(0x7fbef8154120 0x7fbef80a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:11.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.336+0000 7fbef759e700 1 -- 172.21.15.72:0/72123662 >> v2:172.21.15.146:3300/0 conn(0x7fbef8154120 msgr2=0x7fbef80a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:11.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.336+0000 7fbef759e700 1 --2- 172.21.15.72:0/72123662 >> v2:172.21.15.146:3300/0 conn(0x7fbef8154120 0x7fbef80a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:11.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.336+0000 7fbef759e700 1 -- 172.21.15.72:0/72123662 >> v1:172.21.15.72:6789/0 conn(0x7fbef8154500 legacy=0x7fbef80646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:11.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.336+0000 7fbef659c700 1 -- 172.21.15.72:0/72123662 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542963208 0 0) 0x7fbef80aa620 con 0x7fbef8154500 2023-08-31T19:07:11.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.336+0000 7fbef759e700 1 -- 172.21.15.72:0/72123662 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef80c8050 con 0x7fbef8064db0 2023-08-31T19:07:11.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.336+0000 7fbef759e700 1 --2- 172.21.15.72:0/72123662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef8064db0 0x7fbef815dec0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fbef80643c0 tx=0x7fbef0009780).ready entity=mon.0 client_cookie=2991a8aa0d6a6d14 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:11.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.337+0000 7fbef659c700 1 -- 172.21.15.72:0/72123662 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000e070 con 0x7fbef8064db0 2023-08-31T19:07:11.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.337+0000 7fbef659c700 1 -- 172.21.15.72:0/72123662 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef000bc30 con 0x7fbef8064db0 2023-08-31T19:07:11.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.337+0000 7fbef659c700 1 -- 172.21.15.72:0/72123662 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0012410 con 0x7fbef8064db0 2023-08-31T19:07:11.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.337+0000 7fbefd1ff700 1 -- 172.21.15.72:0/72123662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef8064db0 msgr2=0x7fbef815dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:11.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.337+0000 7fbefd1ff700 1 --2- 172.21.15.72:0/72123662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef8064db0 0x7fbef815dec0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fbef80643c0 tx=0x7fbef0009780).stop 2023-08-31T19:07:11.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.337+0000 7fbefd1ff700 1 -- 172.21.15.72:0/72123662 shutdown_connections 2023-08-31T19:07:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.337+0000 7fbefd1ff700 1 --2- 172.21.15.72:0/72123662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef8064db0 0x7fbef815dec0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.337+0000 7fbefd1ff700 1 --2- 172.21.15.72:0/72123662 >> v2:172.21.15.146:3300/0 conn(0x7fbef8154120 0x7fbef80a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.337+0000 7fbefd1ff700 1 -- 172.21.15.72:0/72123662 >> 172.21.15.72:0/72123662 conn(0x7fbef80cb7e0 msgr2=0x7fbef80c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.337+0000 7fbefd1ff700 1 -- 172.21.15.72:0/72123662 shutdown_connections 2023-08-31T19:07:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.337+0000 7fbefd1ff700 1 -- 172.21.15.72:0/72123662 wait complete. 2023-08-31T19:07:11.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.339+0000 7fbefd1ff700 1 Processor -- start 2023-08-31T19:07:11.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.339+0000 7fbefd1ff700 1 -- start start 2023-08-31T19:07:11.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.340+0000 7fbefd1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbef8064db0 0x7fbef80c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:11.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.340+0000 7fbefd1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef8154120 0x7fbef813f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:11.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.340+0000 7fbefd1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef8154500 0x7fbef80c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:11.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.340+0000 7fbefd1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef814b910 con 0x7fbef8154120 2023-08-31T19:07:11.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.340+0000 7fbefd1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8156650 con 0x7fbef8154500 2023-08-31T19:07:11.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.340+0000 7fbefd1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8155320 con 0x7fbef8064db0 2023-08-31T19:07:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.340+0000 7fbeeffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef8154120 0x7fbef813f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.340+0000 7fbeeffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef8154120 0x7fbef813f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46646/0 (socket says 172.21.15.72:46646) 2023-08-31T19:07:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.340+0000 7fbeeffff700 1 -- 172.21.15.72:0/231478032 learned_addr learned my addr 172.21.15.72:0/231478032 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.340+0000 7fbef759e700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef8154500 0x7fbef80c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:11.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.341+0000 7fbef6d9d700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbef8064db0 0x7fbef80c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:11.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.341+0000 7fbeeffff700 1 -- 172.21.15.72:0/231478032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbef8064db0 msgr2=0x7fbef80c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:11.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.341+0000 7fbeeffff700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbef8064db0 0x7fbef80c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:11.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.341+0000 7fbeeffff700 1 -- 172.21.15.72:0/231478032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef8154500 msgr2=0x7fbef80c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:11.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.341+0000 7fbeeffff700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef8154500 0x7fbef80c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:11.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.341+0000 7fbeeffff700 1 -- 172.21.15.72:0/231478032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef0009a20 con 0x7fbef8154120 2023-08-31T19:07:11.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.341+0000 7fbef6d9d700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbef8064db0 0x7fbef80c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:11.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.341+0000 7fbef759e700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef8154500 0x7fbef80c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:11.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.341+0000 7fbeeffff700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef8154120 0x7fbef813f750 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fbee000c490 tx=0x7fbee0007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:11.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.341+0000 7fbeeeffd700 1 -- 172.21.15.72:0/231478032 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee00072e0 con 0x7fbef8154120 2023-08-31T19:07:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.341+0000 7fbeeeffd700 1 -- 172.21.15.72:0/231478032 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee0007440 con 0x7fbef8154120 2023-08-31T19:07:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.341+0000 7fbeeeffd700 1 -- 172.21.15.72:0/231478032 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee00057a0 con 0x7fbef8154120 2023-08-31T19:07:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.341+0000 7fbefd1ff700 1 -- 172.21.15.72:0/231478032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef8155600 con 0x7fbef8154120 2023-08-31T19:07:11.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.341+0000 7fbefd1ff700 1 -- 172.21.15.72:0/231478032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef80c2300 con 0x7fbef8154120 2023-08-31T19:07:11.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.342+0000 7fbefd1ff700 1 -- 172.21.15.72:0/231478032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef806a7e0 con 0x7fbef8154120 2023-08-31T19:07:11.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.343+0000 7fbeeeffd700 1 -- 172.21.15.72:0/231478032 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fbee0005bd0 con 0x7fbef8154120 2023-08-31T19:07:11.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.344+0000 7fbeeeffd700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbed805ef30 0x7fbed80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:11.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.344+0000 7fbeeeffd700 1 -- 172.21.15.72:0/231478032 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6913+0+0 (secure 0 0 0) 0x7fbee0079a60 con 0x7fbef8154120 2023-08-31T19:07:11.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.344+0000 7fbef6d9d700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbed805ef30 0x7fbed80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:11.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.345+0000 7fbef6d9d700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbed805ef30 0x7fbed80613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fbee800bb60 tx=0x7fbee8008040).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:11.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.348+0000 7fbeeeffd700 1 -- 172.21.15.72:0/231478032 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbee004aa30 con 0x7fbef8154120 2023-08-31T19:07:11.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:11.520+0000 7fbefd1ff700 1 -- 172.21.15.72:0/231478032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbef806c6b0 con 0x7fbef8154120 2023-08-31T19:07:12.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.112+0000 7fbeeeffd700 1 -- 172.21.15.72:0/231478032 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v133) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbee004e050 con 0x7fbef8154120 2023-08-31T19:07:12.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.115+0000 7fbefd1ff700 1 -- 172.21.15.72:0/231478032 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbed805ef30 msgr2=0x7fbed80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:12.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.115+0000 7fbefd1ff700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbed805ef30 0x7fbed80613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fbee800bb60 tx=0x7fbee8008040).stop 2023-08-31T19:07:12.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.115+0000 7fbefd1ff700 1 -- 172.21.15.72:0/231478032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef8154120 msgr2=0x7fbef813f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:12.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.115+0000 7fbefd1ff700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef8154120 0x7fbef813f750 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fbee000c490 tx=0x7fbee0007e60).stop 2023-08-31T19:07:12.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.119+0000 7fbefd1ff700 1 -- 172.21.15.72:0/231478032 shutdown_connections 2023-08-31T19:07:12.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.119+0000 7fbefd1ff700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbed805ef30 0x7fbed80613f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.119+0000 7fbefd1ff700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbef8154500 0x7fbef80c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.119+0000 7fbefd1ff700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbef8064db0 0x7fbef80c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.119+0000 7fbefd1ff700 1 --2- 172.21.15.72:0/231478032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef8154120 0x7fbef813f750 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.119+0000 7fbefd1ff700 1 -- 172.21.15.72:0/231478032 >> 172.21.15.72:0/231478032 conn(0x7fbef80cb7e0 msgr2=0x7fbef80ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:12.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.119+0000 7fbefd1ff700 1 -- 172.21.15.72:0/231478032 shutdown_connections 2023-08-31T19:07:12.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.120+0000 7fbefd1ff700 1 -- 172.21.15.72:0/231478032 wait complete. 2023-08-31T19:07:12.123 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-08-31T19:07:12.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-31T19:07:12.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.332+0000 7fafd9fff700 1 Processor -- start 2023-08-31T19:07:12.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.332+0000 7fafd9fff700 1 -- start start 2023-08-31T19:07:12.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.334+0000 7fafd9fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fafd4153e30 0x7fafd4154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:12.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.334+0000 7fafd9fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fafd40637c0 0x7fafd40c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:12.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.334+0000 7fafd9fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd40bfd40 con 0x7fafd40c5cb0 2023-08-31T19:07:12.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.334+0000 7fafd9fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd40c6730 con 0x7fafd4153e30 2023-08-31T19:07:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.334+0000 7fafd9fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd40bffe0 con 0x7fafd40637c0 2023-08-31T19:07:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.334+0000 7fafd37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fafd4153e30 0x7fafd4154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.334+0000 7fafd37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fafd4153e30 0x7fafd4154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46658/0 (socket says 172.21.15.72:46658) 2023-08-31T19:07:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.334+0000 7fafd37fe700 1 -- 172.21.15.72:0/319241146 learned_addr learned my addr 172.21.15.72:0/319241146 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.334+0000 7fafd3fff700 1 --2- 172.21.15.72:0/319241146 >> v2:172.21.15.146:3300/0 conn(0x7fafd40637c0 0x7fafd40c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.334+0000 7fafd37fe700 1 -- 172.21.15.72:0/319241146 >> v2:172.21.15.146:3300/0 conn(0x7fafd40637c0 msgr2=0x7fafd40c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.334+0000 7fafd37fe700 1 --2- 172.21.15.72:0/319241146 >> v2:172.21.15.146:3300/0 conn(0x7fafd40637c0 0x7fafd40c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.334+0000 7fafd37fe700 1 -- 172.21.15.72:0/319241146 >> v1:172.21.15.146:6789/0 conn(0x7fafd40c5cb0 legacy=0x7fafd40630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.334+0000 7fafd37fe700 1 -- 172.21.15.72:0/319241146 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd40c02c0 con 0x7fafd4153e30 2023-08-31T19:07:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.334+0000 7fafd3fff700 1 --2- 172.21.15.72:0/319241146 >> v2:172.21.15.146:3300/0 conn(0x7fafd40637c0 0x7fafd40c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.335+0000 7fafd37fe700 1 --2- 172.21.15.72:0/319241146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd4153e30 0x7fafd4154210 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fafd4084380 tx=0x7fafc40090f0).ready entity=mon.0 client_cookie=97ca4d796621f8dd server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.335+0000 7fafd27fc700 1 -- 172.21.15.72:0/319241146 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc400b600 con 0x7fafd4153e30 2023-08-31T19:07:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.335+0000 7fafd27fc700 1 -- 172.21.15.72:0/319241146 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc400b760 con 0x7fafd4153e30 2023-08-31T19:07:12.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.335+0000 7fafd27fc700 1 -- 172.21.15.72:0/319241146 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc400bae0 con 0x7fafd4153e30 2023-08-31T19:07:12.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.335+0000 7fafd9fff700 1 -- 172.21.15.72:0/319241146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd4153e30 msgr2=0x7fafd4154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:12.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.335+0000 7fafd9fff700 1 --2- 172.21.15.72:0/319241146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd4153e30 0x7fafd4154210 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fafd4084380 tx=0x7fafc40090f0).stop 2023-08-31T19:07:12.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.335+0000 7fafd9fff700 1 -- 172.21.15.72:0/319241146 shutdown_connections 2023-08-31T19:07:12.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.335+0000 7fafd9fff700 1 --2- 172.21.15.72:0/319241146 >> v2:172.21.15.146:3300/0 conn(0x7fafd40637c0 0x7fafd40c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.335+0000 7fafd9fff700 1 --2- 172.21.15.72:0/319241146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd4153e30 0x7fafd4154210 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.335+0000 7fafd9fff700 1 -- 172.21.15.72:0/319241146 >> 172.21.15.72:0/319241146 conn(0x7fafd405eb20 msgr2=0x7fafd40cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:12.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.335+0000 7fafd9fff700 1 -- 172.21.15.72:0/319241146 shutdown_connections 2023-08-31T19:07:12.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.336+0000 7fafd9fff700 1 -- 172.21.15.72:0/319241146 wait complete. 2023-08-31T19:07:12.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.337+0000 7fafd9fff700 1 Processor -- start 2023-08-31T19:07:12.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.337+0000 7fafd9fff700 1 -- start start 2023-08-31T19:07:12.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.338+0000 7fafd9fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafd40637c0 0x7fafd40a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:12.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.338+0000 7fafd9fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd40c5cb0 0x7fafd40aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:12.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.338+0000 7fafd9fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafd4153e30 0x7fafd40acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:12.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.338+0000 7fafd9fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40ad3e0 con 0x7fafd40c5cb0 2023-08-31T19:07:12.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.338+0000 7fafd9fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40a3180 con 0x7fafd40637c0 2023-08-31T19:07:12.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.338+0000 7fafd9fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd40a3460 con 0x7fafd4153e30 2023-08-31T19:07:12.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.338+0000 7fafd2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd40c5cb0 0x7fafd40aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:12.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.338+0000 7fafd2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd40c5cb0 0x7fafd40aca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46666/0 (socket says 172.21.15.72:46666) 2023-08-31T19:07:12.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.338+0000 7fafd2ffd700 1 -- 172.21.15.72:0/3156867545 learned_addr learned my addr 172.21.15.72:0/3156867545 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:12.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.339+0000 7fafd37fe700 1 --2- 172.21.15.72:0/3156867545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafd40637c0 0x7fafd40a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:12.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.339+0000 7fafd3fff700 1 --2- 172.21.15.72:0/3156867545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafd4153e30 0x7fafd40acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:12.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.339+0000 7fafd2ffd700 1 -- 172.21.15.72:0/3156867545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafd4153e30 msgr2=0x7fafd40acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:12.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.339+0000 7fafd2ffd700 1 --2- 172.21.15.72:0/3156867545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafd4153e30 0x7fafd40acef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.339+0000 7fafd2ffd700 1 -- 172.21.15.72:0/3156867545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafd40637c0 msgr2=0x7fafd40a4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:12.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.339+0000 7fafd2ffd700 1 --2- 172.21.15.72:0/3156867545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafd40637c0 0x7fafd40a4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.339+0000 7fafd2ffd700 1 -- 172.21.15.72:0/3156867545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009370 con 0x7fafd40c5cb0 2023-08-31T19:07:12.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.339+0000 7fafd2ffd700 1 --2- 172.21.15.72:0/3156867545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd40c5cb0 0x7fafd40aca00 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fafc800c4c0 tx=0x7fafc8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:12.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.339+0000 7fafbb7fe700 1 -- 172.21.15.72:0/3156867545 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8007020 con 0x7fafd40c5cb0 2023-08-31T19:07:12.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.339+0000 7fafbb7fe700 1 -- 172.21.15.72:0/3156867545 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc8001e90 con 0x7fafd40c5cb0 2023-08-31T19:07:12.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.339+0000 7fafbb7fe700 1 -- 172.21.15.72:0/3156867545 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc80073b0 con 0x7fafd40c5cb0 2023-08-31T19:07:12.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.339+0000 7fafd9fff700 1 -- 172.21.15.72:0/3156867545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd40a3740 con 0x7fafd40c5cb0 2023-08-31T19:07:12.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.339+0000 7fafd9fff700 1 -- 172.21.15.72:0/3156867545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd40a3d00 con 0x7fafd40c5cb0 2023-08-31T19:07:12.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.340+0000 7fafd9fff700 1 -- 172.21.15.72:0/3156867545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd406c6b0 con 0x7fafd40c5cb0 2023-08-31T19:07:12.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.341+0000 7fafbb7fe700 1 -- 172.21.15.72:0/3156867545 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fafc80068b0 con 0x7fafd40c5cb0 2023-08-31T19:07:12.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.342+0000 7fafbb7fe700 1 --2- 172.21.15.72:0/3156867545 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fafc005ef30 0x7fafc00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:12.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.342+0000 7fafbb7fe700 1 -- 172.21.15.72:0/3156867545 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6499+0+0 (secure 0 0 0) 0x7fafc8079a40 con 0x7fafd40c5cb0 2023-08-31T19:07:12.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.342+0000 7fafd37fe700 1 --2- 172.21.15.72:0/3156867545 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fafc005ef30 0x7fafc00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:12.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.343+0000 7fafd37fe700 1 --2- 172.21.15.72:0/3156867545 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fafc005ef30 0x7fafc00613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fafc4009fd0 tx=0x7fafc4017000).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:12.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.346+0000 7fafbb7fe700 1 -- 172.21.15.72:0/3156867545 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fafc804abb0 con 0x7fafd40c5cb0 2023-08-31T19:07:12.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.520+0000 7fafd9fff700 1 -- 172.21.15.72:0/3156867545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fafd4062970 con 0x7fafd40c5cb0 2023-08-31T19:07:12.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.524+0000 7fafbb7fe700 1 -- 172.21.15.72:0/3156867545 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v24) v1 ==== 120+0+0 (secure 0 0 0) 0x7fafc804e1d0 con 0x7fafd40c5cb0 2023-08-31T19:07:12.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.526+0000 7fafd9fff700 1 -- 172.21.15.72:0/3156867545 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fafc005ef30 msgr2=0x7fafc00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:12.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.526+0000 7fafd9fff700 1 --2- 172.21.15.72:0/3156867545 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fafc005ef30 0x7fafc00613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fafc4009fd0 tx=0x7fafc4017000).stop 2023-08-31T19:07:12.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.526+0000 7fafd9fff700 1 -- 172.21.15.72:0/3156867545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd40c5cb0 msgr2=0x7fafd40aca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:12.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.526+0000 7fafd9fff700 1 --2- 172.21.15.72:0/3156867545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd40c5cb0 0x7fafd40aca00 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fafc800c4c0 tx=0x7fafc8007e00).stop 2023-08-31T19:07:12.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.526+0000 7fafd9fff700 1 -- 172.21.15.72:0/3156867545 shutdown_connections 2023-08-31T19:07:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.526+0000 7fafd9fff700 1 --2- 172.21.15.72:0/3156867545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fafd4153e30 0x7fafd40acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.526+0000 7fafd9fff700 1 --2- 172.21.15.72:0/3156867545 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fafc005ef30 0x7fafc00613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.526+0000 7fafd9fff700 1 --2- 172.21.15.72:0/3156867545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafd40637c0 0x7fafd40a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.526+0000 7fafd9fff700 1 --2- 172.21.15.72:0/3156867545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafd40c5cb0 0x7fafd40aca00 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.526+0000 7fafd9fff700 1 -- 172.21.15.72:0/3156867545 >> 172.21.15.72:0/3156867545 conn(0x7fafd405eb20 msgr2=0x7fafd40abd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:12.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.526+0000 7fafd9fff700 1 -- 172.21.15.72:0/3156867545 shutdown_connections 2023-08-31T19:07:12.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.526+0000 7fafd9fff700 1 -- 172.21.15.72:0/3156867545 wait complete. 2023-08-31T19:07:12.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-31T19:07:12.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.739+0000 7f1d5a7ff700 1 Processor -- start 2023-08-31T19:07:12.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.739+0000 7f1d5a7ff700 1 -- start start 2023-08-31T19:07:12.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.741+0000 7f1d5a7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d54065720 0x7f1d540c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:12.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.741+0000 7f1d5a7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d540bd500 0x7f1d540bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.741+0000 7f1d5a7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d540c20d0 con 0x7f1d54164bc0 2023-08-31T19:07:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.741+0000 7f1d5a7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d540c2ff0 con 0x7f1d54065720 2023-08-31T19:07:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.741+0000 7f1d5a7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d54068230 con 0x7f1d540bd500 2023-08-31T19:07:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.741+0000 7f1d53fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d54065720 0x7f1d540c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:12.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.741+0000 7f1d53fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d54065720 0x7f1d540c1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46674/0 (socket says 172.21.15.72:46674) 2023-08-31T19:07:12.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.741+0000 7f1d53fff700 1 -- 172.21.15.72:0/3212179956 learned_addr learned my addr 172.21.15.72:0/3212179956 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:12.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.741+0000 7f1d58d9c700 1 --1- 172.21.15.72:0/3212179956 >> v1:172.21.15.72:6789/0 conn(0x7f1d54164bc0 0x7f1d54164ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54754/0 (socket says 172.21.15.72:54754) 2023-08-31T19:07:12.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.741+0000 7f1d537fe700 1 --2- 172.21.15.72:0/3212179956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d540bd500 0x7f1d540bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:12.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.741+0000 7f1d52ffd700 1 -- 172.21.15.72:0/3212179956 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011376465 0 0) 0x7f1d540c20d0 con 0x7f1d54164bc0 2023-08-31T19:07:12.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.889+0000 7f1d52ffd700 1 -- 172.21.15.72:0/3212179956 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d3c0033f0 con 0x7f1d54164bc0 2023-08-31T19:07:12.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.889+0000 7f1d53fff700 1 -- 172.21.15.72:0/3212179956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d540bd500 msgr2=0x7f1d540bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:12.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.889+0000 7f1d53fff700 1 --2- 172.21.15.72:0/3212179956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d540bd500 0x7f1d540bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.889+0000 7f1d53fff700 1 -- 172.21.15.72:0/3212179956 >> v1:172.21.15.72:6789/0 conn(0x7f1d54164bc0 legacy=0x7f1d54164ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:12.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.889+0000 7f1d53fff700 1 -- 172.21.15.72:0/3212179956 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d54165a70 con 0x7f1d54065720 2023-08-31T19:07:12.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.889+0000 7f1d53fff700 1 --2- 172.21.15.72:0/3212179956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d54065720 0x7f1d540c1af0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f1d44006fd0 tx=0x7f1d440090f0).ready entity=mon.0 client_cookie=b3906244ca087c53 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:12.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.889+0000 7f1d52ffd700 1 -- 172.21.15.72:0/3212179956 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4400d540 con 0x7f1d54065720 2023-08-31T19:07:12.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.889+0000 7f1d52ffd700 1 -- 172.21.15.72:0/3212179956 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4400c030 con 0x7f1d54065720 2023-08-31T19:07:12.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.889+0000 7f1d52ffd700 1 -- 172.21.15.72:0/3212179956 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4400d8d0 con 0x7f1d54065720 2023-08-31T19:07:12.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.890+0000 7f1d5a7ff700 1 -- 172.21.15.72:0/3212179956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d54065720 msgr2=0x7f1d540c1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:12.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.890+0000 7f1d5a7ff700 1 --2- 172.21.15.72:0/3212179956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d54065720 0x7f1d540c1af0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f1d44006fd0 tx=0x7f1d440090f0).stop 2023-08-31T19:07:12.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.890+0000 7f1d5a7ff700 1 -- 172.21.15.72:0/3212179956 shutdown_connections 2023-08-31T19:07:12.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.890+0000 7f1d5a7ff700 1 --2- 172.21.15.72:0/3212179956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d54065720 0x7f1d540c1af0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.890+0000 7f1d5a7ff700 1 --2- 172.21.15.72:0/3212179956 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d540bd500 0x7f1d540bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.890+0000 7f1d5a7ff700 1 -- 172.21.15.72:0/3212179956 >> 172.21.15.72:0/3212179956 conn(0x7f1d54063160 msgr2=0x7f1d540c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:12.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.890+0000 7f1d5a7ff700 1 -- 172.21.15.72:0/3212179956 shutdown_connections 2023-08-31T19:07:12.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.890+0000 7f1d5a7ff700 1 -- 172.21.15.72:0/3212179956 wait complete. 2023-08-31T19:07:12.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.891+0000 7f1d5a7ff700 1 Processor -- start 2023-08-31T19:07:12.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.892+0000 7f1d5a7ff700 1 -- start start 2023-08-31T19:07:12.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d5a7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d54065720 0x7f1d540ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:12.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d5a7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d540bd500 0x7f1d540ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:12.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d5a7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d54164bc0 0x7f1d5415d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:12.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d5a7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d54171350 con 0x7f1d54164bc0 2023-08-31T19:07:12.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d5a7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540ab660 con 0x7f1d540bd500 2023-08-31T19:07:12.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d5a7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540abf00 con 0x7f1d54065720 2023-08-31T19:07:12.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d58d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d54164bc0 0x7f1d5415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:12.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d58d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d54164bc0 0x7f1d5415d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37248/0 (socket says 172.21.15.72:37248) 2023-08-31T19:07:12.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d58d9c700 1 -- 172.21.15.72:0/719389174 learned_addr learned my addr 172.21.15.72:0/719389174 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:12.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d53fff700 1 --2- 172.21.15.72:0/719389174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d54065720 0x7f1d540ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:12.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d537fe700 1 --2- 172.21.15.72:0/719389174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d540bd500 0x7f1d540ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:12.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d58d9c700 1 -- 172.21.15.72:0/719389174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d54065720 msgr2=0x7f1d540ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:12.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d58d9c700 1 --2- 172.21.15.72:0/719389174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d54065720 0x7f1d540ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d58d9c700 1 -- 172.21.15.72:0/719389174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d540bd500 msgr2=0x7f1d540ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:12.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d58d9c700 1 --2- 172.21.15.72:0/719389174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d540bd500 0x7f1d540ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:12.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d58d9c700 1 -- 172.21.15.72:0/719389174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d440092d0 con 0x7f1d54164bc0 2023-08-31T19:07:12.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d537fe700 1 --2- 172.21.15.72:0/719389174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d540bd500 0x7f1d540ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:12.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.893+0000 7f1d58d9c700 1 --2- 172.21.15.72:0/719389174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d54164bc0 0x7f1d5415d690 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f1d4c00c7c0 tx=0x7f1d4c007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:12.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.894+0000 7f1d3bfff700 1 -- 172.21.15.72:0/719389174 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c005c70 con 0x7f1d54164bc0 2023-08-31T19:07:12.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.894+0000 7f1d3bfff700 1 -- 172.21.15.72:0/719389174 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4c005dd0 con 0x7f1d54164bc0 2023-08-31T19:07:12.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.894+0000 7f1d3bfff700 1 -- 172.21.15.72:0/719389174 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c007320 con 0x7f1d54164bc0 2023-08-31T19:07:12.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.894+0000 7f1d5a7ff700 1 -- 172.21.15.72:0/719389174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d540ac1e0 con 0x7f1d54164bc0 2023-08-31T19:07:12.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.894+0000 7f1d5a7ff700 1 -- 172.21.15.72:0/719389174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d540ac7a0 con 0x7f1d54164bc0 2023-08-31T19:07:12.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.895+0000 7f1d5a7ff700 1 -- 172.21.15.72:0/719389174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5406c6b0 con 0x7f1d54164bc0 2023-08-31T19:07:12.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.896+0000 7f1d3bfff700 1 -- 172.21.15.72:0/719389174 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f1d4c007750 con 0x7f1d54164bc0 2023-08-31T19:07:12.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.896+0000 7f1d3bfff700 1 --2- 172.21.15.72:0/719389174 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1d4005ef30 0x7f1d400613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:12.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.896+0000 7f1d3bfff700 1 -- 172.21.15.72:0/719389174 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6499+0+0 (secure 0 0 0) 0x7f1d4c07a120 con 0x7f1d54164bc0 2023-08-31T19:07:12.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.897+0000 7f1d53fff700 1 --2- 172.21.15.72:0/719389174 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1d4005ef30 0x7f1d400613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:12.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.897+0000 7f1d53fff700 1 --2- 172.21.15.72:0/719389174 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1d4005ef30 0x7f1d400613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f1d44009130 tx=0x7f1d44016000).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:12.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:12.900+0000 7f1d3bfff700 1 -- 172.21.15.72:0/719389174 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d4c04b290 con 0x7f1d54164bc0 2023-08-31T19:07:13.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.070+0000 7f1d5a7ff700 1 -- 172.21.15.72:0/719389174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1d540c78d0 con 0x7f1d54164bc0 2023-08-31T19:07:13.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.074+0000 7f1d3bfff700 1 -- 172.21.15.72:0/719389174 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1d4c04e8b0 con 0x7f1d54164bc0 2023-08-31T19:07:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.076+0000 7f1d5a7ff700 1 -- 172.21.15.72:0/719389174 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1d4005ef30 msgr2=0x7f1d400613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.076+0000 7f1d5a7ff700 1 --2- 172.21.15.72:0/719389174 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1d4005ef30 0x7f1d400613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f1d44009130 tx=0x7f1d44016000).stop 2023-08-31T19:07:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.076+0000 7f1d5a7ff700 1 -- 172.21.15.72:0/719389174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d54164bc0 msgr2=0x7f1d5415d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.076+0000 7f1d5a7ff700 1 --2- 172.21.15.72:0/719389174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d54164bc0 0x7f1d5415d690 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f1d4c00c7c0 tx=0x7f1d4c007f90).stop 2023-08-31T19:07:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.077+0000 7f1d5a7ff700 1 -- 172.21.15.72:0/719389174 shutdown_connections 2023-08-31T19:07:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.077+0000 7f1d5a7ff700 1 --2- 172.21.15.72:0/719389174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d54164bc0 0x7f1d5415d690 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.077+0000 7f1d5a7ff700 1 --2- 172.21.15.72:0/719389174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1d54065720 0x7f1d540ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.077+0000 7f1d5a7ff700 1 --2- 172.21.15.72:0/719389174 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f1d4005ef30 0x7f1d400613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.077+0000 7f1d5a7ff700 1 --2- 172.21.15.72:0/719389174 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d540bd500 0x7f1d540ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.077+0000 7f1d5a7ff700 1 -- 172.21.15.72:0/719389174 >> 172.21.15.72:0/719389174 conn(0x7f1d54063160 msgr2=0x7f1d540821c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.077+0000 7f1d5a7ff700 1 -- 172.21.15.72:0/719389174 shutdown_connections 2023-08-31T19:07:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.077+0000 7f1d5a7ff700 1 -- 172.21.15.72:0/719389174 wait complete. 2023-08-31T19:07:13.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-08-31T19:07:13.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.282+0000 7f9c24dff700 1 Processor -- start 2023-08-31T19:07:13.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.283+0000 7f9c24dff700 1 -- start start 2023-08-31T19:07:13.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.284+0000 7f9c24dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c200c6c30 0x7f9c200bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:13.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.284+0000 7f9c24dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c201583f0 0x7f9c200c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:13.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.284+0000 7f9c24dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c20063be0 con 0x7f9c200c4740 2023-08-31T19:07:13.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.284+0000 7f9c24dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c20063010 con 0x7f9c201583f0 2023-08-31T19:07:13.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.284+0000 7f9c24dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c200632b0 con 0x7f9c200c6c30 2023-08-31T19:07:13.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.284+0000 7f9c1ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c201583f0 0x7f9c200c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:13.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.284+0000 7f9c1ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c201583f0 0x7f9c200c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37258/0 (socket says 172.21.15.72:37258) 2023-08-31T19:07:13.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.284+0000 7f9c1ed9d700 1 -- 172.21.15.72:0/2210516932 learned_addr learned my addr 172.21.15.72:0/2210516932 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:13.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.284+0000 7f9c1e59c700 1 --2- 172.21.15.72:0/2210516932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c200c6c30 0x7f9c200bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:13.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.285+0000 7f9c1ed9d700 1 -- 172.21.15.72:0/2210516932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c200c6c30 msgr2=0x7f9c200bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:13.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.285+0000 7f9c1ed9d700 1 --2- 172.21.15.72:0/2210516932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c200c6c30 0x7f9c200bc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:13.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.285+0000 7f9c1ed9d700 1 -- 172.21.15.72:0/2210516932 >> v1:172.21.15.146:6789/0 conn(0x7f9c200c4740 legacy=0x7f9c20157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:13.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.285+0000 7f9c1ed9d700 1 -- 172.21.15.72:0/2210516932 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c20063590 con 0x7f9c201583f0 2023-08-31T19:07:13.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.285+0000 7f9c1ed9d700 1 --2- 172.21.15.72:0/2210516932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c201583f0 0x7f9c200c52a0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f9c18009f20 tx=0x7f9c18009840).ready entity=mon.0 client_cookie=ded91c45043cf005 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:13.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.285+0000 7f9c1d59a700 1 -- 172.21.15.72:0/2210516932 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800e070 con 0x7f9c201583f0 2023-08-31T19:07:13.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.285+0000 7f9c1d59a700 1 -- 172.21.15.72:0/2210516932 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1800ba80 con 0x7f9c201583f0 2023-08-31T19:07:13.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.285+0000 7f9c1d59a700 1 -- 172.21.15.72:0/2210516932 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800be00 con 0x7f9c201583f0 2023-08-31T19:07:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.286+0000 7f9c24dff700 1 -- 172.21.15.72:0/2210516932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c201583f0 msgr2=0x7f9c200c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.286+0000 7f9c24dff700 1 --2- 172.21.15.72:0/2210516932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c201583f0 0x7f9c200c52a0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f9c18009f20 tx=0x7f9c18009840).stop 2023-08-31T19:07:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.286+0000 7f9c24dff700 1 -- 172.21.15.72:0/2210516932 shutdown_connections 2023-08-31T19:07:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.286+0000 7f9c24dff700 1 --2- 172.21.15.72:0/2210516932 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c200c6c30 0x7f9c200bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.286+0000 7f9c24dff700 1 --2- 172.21.15.72:0/2210516932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c201583f0 0x7f9c200c52a0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.286+0000 7f9c24dff700 1 -- 172.21.15.72:0/2210516932 >> 172.21.15.72:0/2210516932 conn(0x7f9c200c7e70 msgr2=0x7f9c200c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.286+0000 7f9c24dff700 1 -- 172.21.15.72:0/2210516932 shutdown_connections 2023-08-31T19:07:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.286+0000 7f9c24dff700 1 -- 172.21.15.72:0/2210516932 wait complete. 2023-08-31T19:07:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.287+0000 7f9c24dff700 1 Processor -- start 2023-08-31T19:07:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.288+0000 7f9c24dff700 1 -- start start 2023-08-31T19:07:13.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.288+0000 7f9c24dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c200c4740 0x7f9c20151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:13.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.288+0000 7f9c24dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c200c6c30 0x7f9c2013a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:13.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.288+0000 7f9c24dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c201583f0 0x7f9c201537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:13.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.289+0000 7f9c24dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c20136fa0 con 0x7f9c200c4740 2023-08-31T19:07:13.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.289+0000 7f9c24dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c200ab290 con 0x7f9c200c6c30 2023-08-31T19:07:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.289+0000 7f9c24dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c200aa680 con 0x7f9c201583f0 2023-08-31T19:07:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.289+0000 7f9c1e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c200c4740 0x7f9c20151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.289+0000 7f9c1e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c200c4740 0x7f9c20151990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37266/0 (socket says 172.21.15.72:37266) 2023-08-31T19:07:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.289+0000 7f9c1e59c700 1 -- 172.21.15.72:0/2336042214 learned_addr learned my addr 172.21.15.72:0/2336042214 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.289+0000 7f9c1dd9b700 1 --2- 172.21.15.72:0/2336042214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c200c6c30 0x7f9c2013a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:13.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.289+0000 7f9c1ed9d700 1 --2- 172.21.15.72:0/2336042214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c201583f0 0x7f9c201537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:13.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.289+0000 7f9c1e59c700 1 -- 172.21.15.72:0/2336042214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c201583f0 msgr2=0x7f9c201537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:13.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.289+0000 7f9c1e59c700 1 --2- 172.21.15.72:0/2336042214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c201583f0 0x7f9c201537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:13.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.289+0000 7f9c1e59c700 1 -- 172.21.15.72:0/2336042214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c200c6c30 msgr2=0x7f9c2013a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:13.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.289+0000 7f9c1e59c700 1 --2- 172.21.15.72:0/2336042214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c200c6c30 0x7f9c2013a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:13.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.289+0000 7f9c1e59c700 1 -- 172.21.15.72:0/2336042214 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c18009ae0 con 0x7f9c200c4740 2023-08-31T19:07:13.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.289+0000 7f9c1e59c700 1 --2- 172.21.15.72:0/2336042214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c200c4740 0x7f9c20151990 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f9c1000d890 tx=0x7f9c10008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:13.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.290+0000 7f9c0e7fc700 1 -- 172.21.15.72:0/2336042214 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10011590 con 0x7f9c200c4740 2023-08-31T19:07:13.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.290+0000 7f9c0e7fc700 1 -- 172.21.15.72:0/2336042214 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c100116f0 con 0x7f9c200c4740 2023-08-31T19:07:13.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.290+0000 7f9c24dff700 1 -- 172.21.15.72:0/2336042214 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c200aa960 con 0x7f9c200c4740 2023-08-31T19:07:13.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.290+0000 7f9c0e7fc700 1 -- 172.21.15.72:0/2336042214 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10011a70 con 0x7f9c200c4740 2023-08-31T19:07:13.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.290+0000 7f9c24dff700 1 -- 172.21.15.72:0/2336042214 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c200aaf20 con 0x7f9c200c4740 2023-08-31T19:07:13.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.291+0000 7f9c24dff700 1 -- 172.21.15.72:0/2336042214 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2006c6b0 con 0x7f9c200c4740 2023-08-31T19:07:13.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.292+0000 7f9c0e7fc700 1 -- 172.21.15.72:0/2336042214 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9c10012420 con 0x7f9c200c4740 2023-08-31T19:07:13.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.292+0000 7f9c0e7fc700 1 --2- 172.21.15.72:0/2336042214 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9c0005ef30 0x7f9c000613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:13.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.293+0000 7f9c0e7fc700 1 -- 172.21.15.72:0/2336042214 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6499+0+0 (secure 0 0 0) 0x7f9c10079b30 con 0x7f9c200c4740 2023-08-31T19:07:13.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.293+0000 7f9c1dd9b700 1 --2- 172.21.15.72:0/2336042214 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9c0005ef30 0x7f9c000613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:13.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.293+0000 7f9c1dd9b700 1 --2- 172.21.15.72:0/2336042214 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9c0005ef30 0x7f9c000613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f9c200bd670 tx=0x7f9c14007d40).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:13.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.296+0000 7f9c0e7fc700 1 -- 172.21.15.72:0/2336042214 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9c1004ac40 con 0x7f9c200c4740 2023-08-31T19:07:13.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:13.528+0000 7f9c24dff700 1 -- 172.21.15.72:0/2336042214 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f9c20151e80 con 0x7f9c200c4740 2023-08-31T19:07:14.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.116+0000 7f9c0e7fc700 1 -- 172.21.15.72:0/2336042214 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v724) v1 ==== 148+0+0 (secure 0 0 0) 0x7f9c1004e260 con 0x7f9c200c4740 2023-08-31T19:07:14.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.118+0000 7f9c24dff700 1 -- 172.21.15.72:0/2336042214 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9c0005ef30 msgr2=0x7f9c000613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:14.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.118+0000 7f9c24dff700 1 --2- 172.21.15.72:0/2336042214 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9c0005ef30 0x7f9c000613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f9c200bd670 tx=0x7f9c14007d40).stop 2023-08-31T19:07:14.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.118+0000 7f9c24dff700 1 -- 172.21.15.72:0/2336042214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c200c4740 msgr2=0x7f9c20151990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:14.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.118+0000 7f9c24dff700 1 --2- 172.21.15.72:0/2336042214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c200c4740 0x7f9c20151990 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f9c1000d890 tx=0x7f9c10008040).stop 2023-08-31T19:07:14.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.118+0000 7f9c24dff700 1 -- 172.21.15.72:0/2336042214 shutdown_connections 2023-08-31T19:07:14.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.118+0000 7f9c24dff700 1 --2- 172.21.15.72:0/2336042214 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9c201583f0 0x7f9c201537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:14.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.118+0000 7f9c24dff700 1 --2- 172.21.15.72:0/2336042214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c200c4740 0x7f9c20151990 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:14.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.118+0000 7f9c24dff700 1 --2- 172.21.15.72:0/2336042214 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9c0005ef30 0x7f9c000613f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:14.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.118+0000 7f9c24dff700 1 --2- 172.21.15.72:0/2336042214 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c200c6c30 0x7f9c2013a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:14.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.118+0000 7f9c24dff700 1 -- 172.21.15.72:0/2336042214 >> 172.21.15.72:0/2336042214 conn(0x7f9c200c7e70 msgr2=0x7f9c201527f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:14.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.119+0000 7f9c24dff700 1 -- 172.21.15.72:0/2336042214 shutdown_connections 2023-08-31T19:07:14.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.119+0000 7f9c24dff700 1 -- 172.21.15.72:0/2336042214 wait complete. 2023-08-31T19:07:14.137 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-08-31T19:07:14.138 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-08-31T19:07:14.138 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-31T19:07:14.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-08-31T19:07:14.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.329+0000 7fa529fff700 1 Processor -- start 2023-08-31T19:07:14.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.330+0000 7fa529fff700 1 -- start start 2023-08-31T19:07:14.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.331+0000 7fa529fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa524154060 0x7fa524157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:14.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.331+0000 7fa529fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa5241588d0 0x7fa524154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:14.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.331+0000 7fa529fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5240c6120 con 0x7fa5240cb9b0 2023-08-31T19:07:14.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.331+0000 7fa529fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5240c1380 con 0x7fa5241588d0 2023-08-31T19:07:14.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.331+0000 7fa529fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240c5e10 con 0x7fa524154060 2023-08-31T19:07:14.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.331+0000 7fa523fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa5241588d0 0x7fa524154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:14.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.331+0000 7fa523fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa5241588d0 0x7fa524154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37274/0 (socket says 172.21.15.72:37274) 2023-08-31T19:07:14.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.331+0000 7fa523fff700 1 -- 172.21.15.72:0/734219859 learned_addr learned my addr 172.21.15.72:0/734219859 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:14.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.331+0000 7fa5237fe700 1 --2- 172.21.15.72:0/734219859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa524154060 0x7fa524157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:14.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.332+0000 7fa523fff700 1 -- 172.21.15.72:0/734219859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa524154060 msgr2=0x7fa524157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:14.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.332+0000 7fa523fff700 1 --2- 172.21.15.72:0/734219859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa524154060 0x7fa524157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:14.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.332+0000 7fa523fff700 1 -- 172.21.15.72:0/734219859 >> v1:172.21.15.146:6789/0 conn(0x7fa5240cb9b0 legacy=0x7fa5241581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:14.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.332+0000 7fa523fff700 1 -- 172.21.15.72:0/734219859 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5240c0ae0 con 0x7fa5241588d0 2023-08-31T19:07:14.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.332+0000 7fa5237fe700 1 --2- 172.21.15.72:0/734219859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa524154060 0x7fa524157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:14.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.332+0000 7fa523fff700 1 --2- 172.21.15.72:0/734219859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5241588d0 0x7fa524154440 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fa51c009f20 tx=0x7fa51c009840).ready entity=mon.0 client_cookie=555a1b0747e204d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:14.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.332+0000 7fa5227fc700 1 -- 172.21.15.72:0/734219859 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c00e070 con 0x7fa5241588d0 2023-08-31T19:07:14.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.332+0000 7fa5227fc700 1 -- 172.21.15.72:0/734219859 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c00ba80 con 0x7fa5241588d0 2023-08-31T19:07:14.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.332+0000 7fa5227fc700 1 -- 172.21.15.72:0/734219859 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c00be00 con 0x7fa5241588d0 2023-08-31T19:07:14.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.333+0000 7fa529fff700 1 -- 172.21.15.72:0/734219859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5241588d0 msgr2=0x7fa524154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:14.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.333+0000 7fa529fff700 1 --2- 172.21.15.72:0/734219859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5241588d0 0x7fa524154440 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fa51c009f20 tx=0x7fa51c009840).stop 2023-08-31T19:07:14.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.333+0000 7fa529fff700 1 -- 172.21.15.72:0/734219859 shutdown_connections 2023-08-31T19:07:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.333+0000 7fa529fff700 1 --2- 172.21.15.72:0/734219859 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa524154060 0x7fa524157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.333+0000 7fa529fff700 1 --2- 172.21.15.72:0/734219859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5241588d0 0x7fa524154440 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.333+0000 7fa529fff700 1 -- 172.21.15.72:0/734219859 >> 172.21.15.72:0/734219859 conn(0x7fa52405e870 msgr2=0x7fa5240cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:14.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.333+0000 7fa529fff700 1 -- 172.21.15.72:0/734219859 shutdown_connections 2023-08-31T19:07:14.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.333+0000 7fa529fff700 1 -- 172.21.15.72:0/734219859 wait complete. 2023-08-31T19:07:14.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.334+0000 7fa529fff700 1 Processor -- start 2023-08-31T19:07:14.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.334+0000 7fa529fff700 1 -- start start 2023-08-31T19:07:14.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.335+0000 7fa529fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5240cb9b0 0x7fa5240aa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:14.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.335+0000 7fa529fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa524154060 0x7fa524157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:14.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.335+0000 7fa529fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5241588d0 0x7fa52414ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:14.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.335+0000 7fa529fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5241686b0 con 0x7fa5240cb9b0 2023-08-31T19:07:14.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.335+0000 7fa529fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa524168220 con 0x7fa5241588d0 2023-08-31T19:07:14.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.335+0000 7fa529fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5241678f0 con 0x7fa524154060 2023-08-31T19:07:14.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.336+0000 7fa5237fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5240cb9b0 0x7fa5240aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:14.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.336+0000 7fa5237fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5240cb9b0 0x7fa5240aa840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37286/0 (socket says 172.21.15.72:37286) 2023-08-31T19:07:14.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.336+0000 7fa5237fe700 1 -- 172.21.15.72:0/738004782 learned_addr learned my addr 172.21.15.72:0/738004782 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:14.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.336+0000 7fa523fff700 1 --2- 172.21.15.72:0/738004782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5241588d0 0x7fa52414ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:14.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.336+0000 7fa5237fe700 1 -- 172.21.15.72:0/738004782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa524154060 msgr2=0x7fa524157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:14.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.336+0000 7fa5237fe700 1 --2- 172.21.15.72:0/738004782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa524154060 0x7fa524157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:14.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.336+0000 7fa5237fe700 1 -- 172.21.15.72:0/738004782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5241588d0 msgr2=0x7fa52414ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:14.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.336+0000 7fa5237fe700 1 --2- 172.21.15.72:0/738004782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5241588d0 0x7fa52414ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:14.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.336+0000 7fa5237fe700 1 -- 172.21.15.72:0/738004782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c009ae0 con 0x7fa5240cb9b0 2023-08-31T19:07:14.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.336+0000 7fa523fff700 1 --2- 172.21.15.72:0/738004782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5241588d0 0x7fa52414ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:14.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.336+0000 7fa5237fe700 1 --2- 172.21.15.72:0/738004782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5240cb9b0 0x7fa5240aa840 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fa51400d890 tx=0x7fa514008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:14.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.336+0000 7fa50b7fe700 1 -- 172.21.15.72:0/738004782 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514017070 con 0x7fa5240cb9b0 2023-08-31T19:07:14.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.336+0000 7fa50b7fe700 1 -- 172.21.15.72:0/738004782 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa514005880 con 0x7fa5240cb9b0 2023-08-31T19:07:14.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.336+0000 7fa529fff700 1 -- 172.21.15.72:0/738004782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa524167bd0 con 0x7fa5240cb9b0 2023-08-31T19:07:14.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.336+0000 7fa50b7fe700 1 -- 172.21.15.72:0/738004782 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514005c00 con 0x7fa5240cb9b0 2023-08-31T19:07:14.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.337+0000 7fa529fff700 1 -- 172.21.15.72:0/738004782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5241584e0 con 0x7fa5240cb9b0 2023-08-31T19:07:14.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.338+0000 7fa529fff700 1 -- 172.21.15.72:0/738004782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa524168500 con 0x7fa5240cb9b0 2023-08-31T19:07:14.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.338+0000 7fa50b7fe700 1 -- 172.21.15.72:0/738004782 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa514006020 con 0x7fa5240cb9b0 2023-08-31T19:07:14.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.339+0000 7fa50b7fe700 1 --2- 172.21.15.72:0/738004782 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa51005ef60 0x7fa510061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:14.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.339+0000 7fa50b7fe700 1 -- 172.21.15.72:0/738004782 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6499+0+0 (secure 0 0 0) 0x7fa51407a150 con 0x7fa5240cb9b0 2023-08-31T19:07:14.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.340+0000 7fa522ffd700 1 --2- 172.21.15.72:0/738004782 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa51005ef60 0x7fa510061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:14.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.340+0000 7fa522ffd700 1 --2- 172.21.15.72:0/738004782 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa51005ef60 0x7fa510061420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa5240c33f0 tx=0x7fa5180079c0).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:14.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.343+0000 7fa50b7fe700 1 -- 172.21.15.72:0/738004782 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa51404b2c0 con 0x7fa5240cb9b0 2023-08-31T19:07:14.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:14.580+0000 7fa529fff700 1 -- 172.21.15.72:0/738004782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7fa5240c5a70 con 0x7fa5240cb9b0 2023-08-31T19:07:15.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.118+0000 7fa50b7fe700 1 -- 172.21.15.72:0/738004782 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v725) v1 ==== 177+0+0 (secure 0 0 0) 0x7fa51404e8e0 con 0x7fa5240cb9b0 2023-08-31T19:07:15.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.121+0000 7fa529fff700 1 -- 172.21.15.72:0/738004782 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa51005ef60 msgr2=0x7fa510061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:15.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.121+0000 7fa529fff700 1 --2- 172.21.15.72:0/738004782 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa51005ef60 0x7fa510061420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa5240c33f0 tx=0x7fa5180079c0).stop 2023-08-31T19:07:15.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.121+0000 7fa529fff700 1 -- 172.21.15.72:0/738004782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5240cb9b0 msgr2=0x7fa5240aa840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:15.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.121+0000 7fa529fff700 1 --2- 172.21.15.72:0/738004782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5240cb9b0 0x7fa5240aa840 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fa51400d890 tx=0x7fa514008040).stop 2023-08-31T19:07:15.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.121+0000 7fa529fff700 1 -- 172.21.15.72:0/738004782 shutdown_connections 2023-08-31T19:07:15.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.121+0000 7fa529fff700 1 --2- 172.21.15.72:0/738004782 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa51005ef60 0x7fa510061420 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.121+0000 7fa529fff700 1 --2- 172.21.15.72:0/738004782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5241588d0 0x7fa52414ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.121+0000 7fa529fff700 1 --2- 172.21.15.72:0/738004782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5240cb9b0 0x7fa5240aa840 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.121+0000 7fa529fff700 1 --2- 172.21.15.72:0/738004782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa524154060 0x7fa524157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.121+0000 7fa529fff700 1 -- 172.21.15.72:0/738004782 >> 172.21.15.72:0/738004782 conn(0x7fa52405e870 msgr2=0x7fa5240bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.121+0000 7fa529fff700 1 -- 172.21.15.72:0/738004782 shutdown_connections 2023-08-31T19:07:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.121+0000 7fa529fff700 1 -- 172.21.15.72:0/738004782 wait complete. 2023-08-31T19:07:15.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-31T19:07:15.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.335+0000 7fa792fff700 1 Processor -- start 2023-08-31T19:07:15.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.335+0000 7fa792fff700 1 -- start start 2023-08-31T19:07:15.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.336+0000 7fa792fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa78c068ba0 0x7fa78c15d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:15.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.336+0000 7fa792fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78c0a9660 con 0x7fa78c1524c0 2023-08-31T19:07:15.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.336+0000 7fa792fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78c064340 con 0x7fa78c1520e0 2023-08-31T19:07:15.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.336+0000 7fa792fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78c0bcd00 con 0x7fa78c068ba0 2023-08-31T19:07:15.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.336+0000 7fa78bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa78c1524c0 0x7fa78c068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59380/0 (socket says 172.21.15.72:59380) 2023-08-31T19:07:15.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.336+0000 7fa78bfff700 1 -- 172.21.15.72:0/673334013 learned_addr learned my addr 172.21.15.72:0/673334013 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:15.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.336+0000 7fa79159c700 1 --2- 172.21.15.72:0/673334013 >> v2:172.21.15.72:3300/0 conn(0x7fa78c068ba0 0x7fa78c15d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:15.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.337+0000 7fa78b7fe700 1 -- 172.21.15.72:0/673334013 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398263475 0 0) 0x7fa78c0a9660 con 0x7fa78c1524c0 2023-08-31T19:07:15.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.337+0000 7fa78b7fe700 1 -- 172.21.15.72:0/673334013 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa77c0033f0 con 0x7fa78c1524c0 2023-08-31T19:07:15.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.337+0000 7fa79159c700 1 -- 172.21.15.72:0/673334013 >> v1:172.21.15.146:6789/0 conn(0x7fa78c1520e0 legacy=0x7fa78c0a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:15.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.337+0000 7fa79159c700 1 -- 172.21.15.72:0/673334013 >> v1:172.21.15.72:6789/0 conn(0x7fa78c1524c0 legacy=0x7fa78c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:15.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.337+0000 7fa79159c700 1 -- 172.21.15.72:0/673334013 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c0bcfe0 con 0x7fa78c068ba0 2023-08-31T19:07:15.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.337+0000 7fa79159c700 1 --2- 172.21.15.72:0/673334013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa78c068ba0 0x7fa78c15d1c0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7fa784009e60 tx=0x7fa784009780).ready entity=mon.0 client_cookie=de8dac2ad4113a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:15.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.337+0000 7fa78b7fe700 1 -- 172.21.15.72:0/673334013 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78400e070 con 0x7fa78c068ba0 2023-08-31T19:07:15.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.337+0000 7fa78b7fe700 1 -- 172.21.15.72:0/673334013 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78400bb60 con 0x7fa78c068ba0 2023-08-31T19:07:15.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.337+0000 7fa78b7fe700 1 -- 172.21.15.72:0/673334013 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa784012410 con 0x7fa78c068ba0 2023-08-31T19:07:15.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.338+0000 7fa792fff700 1 -- 172.21.15.72:0/673334013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa78c068ba0 msgr2=0x7fa78c15d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:15.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.338+0000 7fa792fff700 1 --2- 172.21.15.72:0/673334013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa78c068ba0 0x7fa78c15d1c0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7fa784009e60 tx=0x7fa784009780).stop 2023-08-31T19:07:15.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.338+0000 7fa792fff700 1 -- 172.21.15.72:0/673334013 shutdown_connections 2023-08-31T19:07:15.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.338+0000 7fa792fff700 1 --2- 172.21.15.72:0/673334013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa78c068ba0 0x7fa78c15d1c0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.338+0000 7fa792fff700 1 -- 172.21.15.72:0/673334013 >> 172.21.15.72:0/673334013 conn(0x7fa78c0630c0 msgr2=0x7fa78c0c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:15.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.338+0000 7fa792fff700 1 -- 172.21.15.72:0/673334013 shutdown_connections 2023-08-31T19:07:15.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.338+0000 7fa792fff700 1 -- 172.21.15.72:0/673334013 wait complete. 2023-08-31T19:07:15.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.340+0000 7fa792fff700 1 Processor -- start 2023-08-31T19:07:15.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.340+0000 7fa792fff700 1 -- start start 2023-08-31T19:07:15.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.341+0000 7fa792fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78c068ba0 0x7fa78c16c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:15.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.341+0000 7fa792fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa78c1520e0 0x7fa78c14a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:15.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.341+0000 7fa792fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa78c1524c0 0x7fa78c168890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:15.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.341+0000 7fa792fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c1698d0 con 0x7fa78c1524c0 2023-08-31T19:07:15.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.341+0000 7fa792fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c16c010 con 0x7fa78c1520e0 2023-08-31T19:07:15.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.341+0000 7fa792fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c169310 con 0x7fa78c068ba0 2023-08-31T19:07:15.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.341+0000 7fa79159c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa78c1524c0 0x7fa78c168890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:15.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.341+0000 7fa79159c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa78c1524c0 0x7fa78c168890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37290/0 (socket says 172.21.15.72:37290) 2023-08-31T19:07:15.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.341+0000 7fa79159c700 1 -- 172.21.15.72:0/31934163 learned_addr learned my addr 172.21.15.72:0/31934163 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:15.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.341+0000 7fa78bfff700 1 --2- 172.21.15.72:0/31934163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa78c1520e0 0x7fa78c14a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:15.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.341+0000 7fa790d9b700 1 --2- 172.21.15.72:0/31934163 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78c068ba0 0x7fa78c16c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:15.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.342+0000 7fa79159c700 1 -- 172.21.15.72:0/31934163 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78c068ba0 msgr2=0x7fa78c16c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:15.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.342+0000 7fa79159c700 1 --2- 172.21.15.72:0/31934163 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78c068ba0 0x7fa78c16c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.342+0000 7fa79159c700 1 -- 172.21.15.72:0/31934163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa78c1520e0 msgr2=0x7fa78c14a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:15.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.342+0000 7fa79159c700 1 --2- 172.21.15.72:0/31934163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa78c1520e0 0x7fa78c14a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.342+0000 7fa79159c700 1 -- 172.21.15.72:0/31934163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa784009a20 con 0x7fa78c1524c0 2023-08-31T19:07:15.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.342+0000 7fa790d9b700 1 --2- 172.21.15.72:0/31934163 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78c068ba0 0x7fa78c16c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:15.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.342+0000 7fa79159c700 1 --2- 172.21.15.72:0/31934163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa78c1524c0 0x7fa78c168890 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7fa784011000 tx=0x7fa78c0a97f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:15.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.342+0000 7fa788ff9700 1 -- 172.21.15.72:0/31934163 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78401d630 con 0x7fa78c1524c0 2023-08-31T19:07:15.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.342+0000 7fa788ff9700 1 -- 172.21.15.72:0/31934163 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78401d790 con 0x7fa78c1524c0 2023-08-31T19:07:15.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.342+0000 7fa788ff9700 1 -- 172.21.15.72:0/31934163 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78401db10 con 0x7fa78c1524c0 2023-08-31T19:07:15.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.342+0000 7fa792fff700 1 -- 172.21.15.72:0/31934163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78c1695f0 con 0x7fa78c1524c0 2023-08-31T19:07:15.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.342+0000 7fa792fff700 1 -- 172.21.15.72:0/31934163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78c16ccc0 con 0x7fa78c1524c0 2023-08-31T19:07:15.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.343+0000 7fa792fff700 1 -- 172.21.15.72:0/31934163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78c16be70 con 0x7fa78c1524c0 2023-08-31T19:07:15.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.344+0000 7fa788ff9700 1 -- 172.21.15.72:0/31934163 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa784027460 con 0x7fa78c1524c0 2023-08-31T19:07:15.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.345+0000 7fa788ff9700 1 --2- 172.21.15.72:0/31934163 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa77005ef30 0x7fa7700613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:15.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.345+0000 7fa788ff9700 1 -- 172.21.15.72:0/31934163 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6499+0+0 (secure 0 0 0) 0x7fa78407bfe0 con 0x7fa78c1524c0 2023-08-31T19:07:15.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.345+0000 7fa790d9b700 1 --2- 172.21.15.72:0/31934163 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa77005ef30 0x7fa7700613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:15.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.346+0000 7fa790d9b700 1 --2- 172.21.15.72:0/31934163 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa77005ef30 0x7fa7700613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa780001710 tx=0x7fa780009040).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:15.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.349+0000 7fa788ff9700 1 -- 172.21.15.72:0/31934163 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa78c16be70 con 0x7fa78c1524c0 2023-08-31T19:07:15.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.518+0000 7fa792fff700 1 -- 172.21.15.72:0/31934163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa78c06c6b0 con 0x7fa78c1524c0 2023-08-31T19:07:15.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.522+0000 7fa788ff9700 1 -- 172.21.15.72:0/31934163 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa78404d090 con 0x7fa78c1524c0 2023-08-31T19:07:15.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.524+0000 7fa792fff700 1 -- 172.21.15.72:0/31934163 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa77005ef30 msgr2=0x7fa7700613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:15.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.524+0000 7fa792fff700 1 --2- 172.21.15.72:0/31934163 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa77005ef30 0x7fa7700613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa780001710 tx=0x7fa780009040).stop 2023-08-31T19:07:15.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.524+0000 7fa792fff700 1 -- 172.21.15.72:0/31934163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa78c1524c0 msgr2=0x7fa78c168890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:15.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.524+0000 7fa792fff700 1 --2- 172.21.15.72:0/31934163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa78c1524c0 0x7fa78c168890 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7fa784011000 tx=0x7fa78c0a97f0).stop 2023-08-31T19:07:15.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.524+0000 7fa792fff700 1 -- 172.21.15.72:0/31934163 shutdown_connections 2023-08-31T19:07:15.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.524+0000 7fa792fff700 1 --2- 172.21.15.72:0/31934163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa78c1524c0 0x7fa78c168890 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.524+0000 7fa792fff700 1 --2- 172.21.15.72:0/31934163 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa78c068ba0 0x7fa78c16c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.524+0000 7fa792fff700 1 --2- 172.21.15.72:0/31934163 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa77005ef30 0x7fa7700613f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.524+0000 7fa792fff700 1 --2- 172.21.15.72:0/31934163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa78c1520e0 0x7fa78c14a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.524+0000 7fa792fff700 1 -- 172.21.15.72:0/31934163 >> 172.21.15.72:0/31934163 conn(0x7fa78c0630c0 msgr2=0x7fa78c0657a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:15.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.524+0000 7fa792fff700 1 -- 172.21.15.72:0/31934163 shutdown_connections 2023-08-31T19:07:15.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.524+0000 7fa792fff700 1 -- 172.21.15.72:0/31934163 wait complete. 2023-08-31T19:07:15.542 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:07:15.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:07:15.649 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:07:15.764 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:07:15.765 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-31T19:07:15.765 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:07:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.955+0000 7f96921ff700 1 Processor -- start 2023-08-31T19:07:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.956+0000 7f96921ff700 1 -- start start 2023-08-31T19:07:15.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.957+0000 7f96921ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f968c0c6c30 0x7f968c0bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.957+0000 7f96921ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c0c4740 0x7f968c157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.957+0000 7f96921ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f968c1581d0 0x7f968c154710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.957+0000 7f96921ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c063be0 con 0x7f968c1581d0 2023-08-31T19:07:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.957+0000 7f96921ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c063010 con 0x7f968c0c6c30 2023-08-31T19:07:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.957+0000 7f96921ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c158600 con 0x7f968c0c4740 2023-08-31T19:07:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.957+0000 7f968bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f968c1581d0 0x7f968c154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.957+0000 7f968bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f968c1581d0 0x7f968c154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37306/0 (socket says 172.21.15.72:37306) 2023-08-31T19:07:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.957+0000 7f968bfff700 1 -- 172.21.15.72:0/4020825889 learned_addr learned my addr 172.21.15.72:0/4020825889 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.957+0000 7f968b7fe700 1 --2- 172.21.15.72:0/4020825889 >> v2:172.21.15.146:3300/0 conn(0x7f968c0c6c30 0x7f968c0bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.957+0000 7f968affd700 1 --2- 172.21.15.72:0/4020825889 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c0c4740 0x7f968c157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:15.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.958+0000 7f968bfff700 1 -- 172.21.15.72:0/4020825889 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c0c4740 msgr2=0x7f968c157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:15.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.958+0000 7f968bfff700 1 --2- 172.21.15.72:0/4020825889 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c0c4740 0x7f968c157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.958+0000 7f968bfff700 1 -- 172.21.15.72:0/4020825889 >> v2:172.21.15.146:3300/0 conn(0x7f968c0c6c30 msgr2=0x7f968c0bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:15.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.958+0000 7f968bfff700 1 --2- 172.21.15.72:0/4020825889 >> v2:172.21.15.146:3300/0 conn(0x7f968c0c6c30 0x7f968c0bc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.958+0000 7f968bfff700 1 -- 172.21.15.72:0/4020825889 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c0632b0 con 0x7f968c1581d0 2023-08-31T19:07:15.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.958+0000 7f968b7fe700 1 --2- 172.21.15.72:0/4020825889 >> v2:172.21.15.146:3300/0 conn(0x7f968c0c6c30 0x7f968c0bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:15.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.958+0000 7f968affd700 1 --2- 172.21.15.72:0/4020825889 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c0c4740 0x7f968c157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:15.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.958+0000 7f968bfff700 1 --2- 172.21.15.72:0/4020825889 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c1581d0 0x7f968c154710 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f968c067bf0 tx=0x7f9684009840).ready entity=mon.0 client_cookie=ca1c85618482d27d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:15.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.958+0000 7f968a7fc700 1 -- 172.21.15.72:0/4020825889 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400e070 con 0x7f968c1581d0 2023-08-31T19:07:15.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.958+0000 7f968a7fc700 1 -- 172.21.15.72:0/4020825889 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968400ba50 con 0x7f968c1581d0 2023-08-31T19:07:15.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.958+0000 7f968a7fc700 1 -- 172.21.15.72:0/4020825889 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400bdd0 con 0x7f968c1581d0 2023-08-31T19:07:15.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.959+0000 7f96921ff700 1 -- 172.21.15.72:0/4020825889 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c1581d0 msgr2=0x7f968c154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.959+0000 7f96921ff700 1 --2- 172.21.15.72:0/4020825889 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c1581d0 0x7f968c154710 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f968c067bf0 tx=0x7f9684009840).stop 2023-08-31T19:07:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.959+0000 7f96921ff700 1 -- 172.21.15.72:0/4020825889 shutdown_connections 2023-08-31T19:07:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.959+0000 7f96921ff700 1 --2- 172.21.15.72:0/4020825889 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c1581d0 0x7f968c154710 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.959+0000 7f96921ff700 1 --2- 172.21.15.72:0/4020825889 >> v2:172.21.15.146:3300/0 conn(0x7f968c0c6c30 0x7f968c0bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.959+0000 7f96921ff700 1 --2- 172.21.15.72:0/4020825889 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c0c4740 0x7f968c157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.959+0000 7f96921ff700 1 -- 172.21.15.72:0/4020825889 >> 172.21.15.72:0/4020825889 conn(0x7f968c0c7e70 msgr2=0x7f968c0c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.959+0000 7f96921ff700 1 -- 172.21.15.72:0/4020825889 shutdown_connections 2023-08-31T19:07:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.959+0000 7f96921ff700 1 -- 172.21.15.72:0/4020825889 wait complete. 2023-08-31T19:07:15.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.960+0000 7f96921ff700 1 Processor -- start 2023-08-31T19:07:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.960+0000 7f96921ff700 1 -- start start 2023-08-31T19:07:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.961+0000 7f96921ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c0c4740 0x7f968c136d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.961+0000 7f96921ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968c0c6c30 0x7f968c1679f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.961+0000 7f96921ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c1581d0 0x7f968c167ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:15.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.961+0000 7f96921ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c1683d0 con 0x7f968c0c4740 2023-08-31T19:07:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.961+0000 7f96921ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0aa330 con 0x7f968c0c6c30 2023-08-31T19:07:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.961+0000 7f96921ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0a72a0 con 0x7f968c1581d0 2023-08-31T19:07:15.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f968b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c0c4740 0x7f968c136d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f968b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c0c4740 0x7f968c136d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37312/0 (socket says 172.21.15.72:37312) 2023-08-31T19:07:15.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f968b7fe700 1 -- 172.21.15.72:0/699123221 learned_addr learned my addr 172.21.15.72:0/699123221 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f968affd700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968c0c6c30 0x7f968c1679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f968bfff700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c1581d0 0x7f968c167ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f968b7fe700 1 -- 172.21.15.72:0/699123221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c1581d0 msgr2=0x7f968c167ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f968b7fe700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c1581d0 0x7f968c167ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f968b7fe700 1 -- 172.21.15.72:0/699123221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968c0c6c30 msgr2=0x7f968c1679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f968b7fe700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968c0c6c30 0x7f968c1679f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f968b7fe700 1 -- 172.21.15.72:0/699123221 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684009ae0 con 0x7f968c0c4740 2023-08-31T19:07:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f968affd700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968c0c6c30 0x7f968c1679f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f968bfff700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c1581d0 0x7f968c167ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:15.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f968b7fe700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c0c4740 0x7f968c136d30 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f967c00d860 tx=0x7f967c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f96737fe700 1 -- 172.21.15.72:0/699123221 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c0125f0 con 0x7f968c0c4740 2023-08-31T19:07:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f96737fe700 1 -- 172.21.15.72:0/699123221 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967c012750 con 0x7f968c0c4740 2023-08-31T19:07:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f96737fe700 1 -- 172.21.15.72:0/699123221 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c012ad0 con 0x7f968c0c4740 2023-08-31T19:07:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.962+0000 7f96921ff700 1 -- 172.21.15.72:0/699123221 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968c0a68b0 con 0x7f968c0c4740 2023-08-31T19:07:15.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.963+0000 7f96921ff700 1 -- 172.21.15.72:0/699123221 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c0aa860 con 0x7f968c0c4740 2023-08-31T19:07:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.964+0000 7f96921ff700 1 -- 172.21.15.72:0/699123221 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968c06c6b0 con 0x7f968c0c4740 2023-08-31T19:07:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.964+0000 7f96737fe700 1 -- 172.21.15.72:0/699123221 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f967c013480 con 0x7f968c0c4740 2023-08-31T19:07:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.965+0000 7f96737fe700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f967805ef30 0x7f96780613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.965+0000 7f96737fe700 1 -- 172.21.15.72:0/699123221 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6499+0+0 (secure 0 0 0) 0x7f967c079f60 con 0x7f968c0c4740 2023-08-31T19:07:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.965+0000 7f968affd700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f967805ef30 0x7f96780613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:15.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.966+0000 7f968affd700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f967805ef30 0x7f96780613f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f968c156810 tx=0x7f9680008040).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:15.969+0000 7f96737fe700 1 -- 172.21.15.72:0/699123221 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f967c0a88f0 con 0x7f968c0c4740 2023-08-31T19:07:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.181+0000 7f96921ff700 1 -- 172.21.15.72:0/699123221 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f968c0aaeb0 con 0x7f968c0c4740 2023-08-31T19:07:16.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.181+0000 7f96737fe700 1 -- 172.21.15.72:0/699123221 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f967c04b070 con 0x7f968c0c4740 2023-08-31T19:07:16.182 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:16.183 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":58,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6344,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2018270382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":2018270382},{"type":"v1","addr":"172.21.15.72:6837","nonce":2018270382}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2754540175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2754540175},{"type":"v1","addr":"172.21.15.146:6835","nonce":2754540175}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":7042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/488665385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":488665385},{"type":"v1","addr":"172.21.15.146:6834","nonce":488665385}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":7971,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3121835325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3121835325},{"type":"v1","addr":"172.21.15.72:6835","nonce":3121835325}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[]} 2023-08-31T19:07:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.184+0000 7f96921ff700 1 -- 172.21.15.72:0/699123221 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f967805ef30 msgr2=0x7f96780613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:16.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.184+0000 7f96921ff700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f967805ef30 0x7f96780613f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f968c156810 tx=0x7f9680008040).stop 2023-08-31T19:07:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.184+0000 7f96921ff700 1 -- 172.21.15.72:0/699123221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c0c4740 msgr2=0x7f968c136d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.184+0000 7f96921ff700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c0c4740 0x7f968c136d30 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f967c00d860 tx=0x7f967c008040).stop 2023-08-31T19:07:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.184+0000 7f96921ff700 1 -- 172.21.15.72:0/699123221 shutdown_connections 2023-08-31T19:07:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.184+0000 7f96921ff700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f968c1581d0 0x7f968c167ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:16.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.184+0000 7f96921ff700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968c0c4740 0x7f968c136d30 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.184+0000 7f96921ff700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f967805ef30 0x7f96780613f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.184+0000 7f96921ff700 1 --2- 172.21.15.72:0/699123221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f968c0c6c30 0x7f968c1679f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.184+0000 7f96921ff700 1 -- 172.21.15.72:0/699123221 >> 172.21.15.72:0/699123221 conn(0x7f968c0c7e70 msgr2=0x7f968c0693a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.184+0000 7f96921ff700 1 -- 172.21.15.72:0/699123221 shutdown_connections 2023-08-31T19:07:16.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.184+0000 7f96921ff700 1 -- 172.21.15.72:0/699123221 wait complete. 2023-08-31T19:07:16.187 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 58 2023-08-31T19:07:16.202 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T19:07:16.202 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-31T19:07:16.202 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T19:07:16.203 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:07:16.203 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T19:07:16.203 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-31T19:07:16.204 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T19:07:16.204 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:07:16.204 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T19:07:16.205 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-31T19:07:16.205 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T19:07:16.205 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:07:16.206 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T19:07:16.206 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-31T19:07:16.206 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T19:07:16.207 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:07:16.216 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T19:07:16.216 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T19:07:16.217 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T19:07:16.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T19:07:16.222 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T19:07:16.222 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T19:07:16.223 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T19:07:16.224 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T19:07:16.261 INFO:tasks.ceph.mds.a:Started 2023-08-31T19:07:16.262 DEBUG:teuthology.parallel:result is None 2023-08-31T19:07:16.265 INFO:tasks.ceph.mds.c:Started 2023-08-31T19:07:16.265 DEBUG:teuthology.parallel:result is None 2023-08-31T19:07:16.266 INFO:tasks.ceph.mds.b:Started 2023-08-31T19:07:16.267 DEBUG:teuthology.parallel:result is None 2023-08-31T19:07:16.269 INFO:tasks.ceph.mds.d:Started 2023-08-31T19:07:16.269 DEBUG:teuthology.parallel:result is None 2023-08-31T19:07:16.270 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-31T19:07:16.405 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T19:07:16.406 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-31T19:07:16.415 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-08-31T19:07:16.415 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-08-31T19:07:16.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.476+0000 7efc069ff700 1 Processor -- start 2023-08-31T19:07:16.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.477+0000 7efc069ff700 1 -- start start 2023-08-31T19:07:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.478+0000 7efc069ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efc00067b30 0x7efc00067f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.478+0000 7efc069ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc00151f20 0x7efc001551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.478+0000 7efc069ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc000a81b0 con 0x7efc000c5090 2023-08-31T19:07:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.478+0000 7efc069ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc001556e0 con 0x7efc00067b30 2023-08-31T19:07:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.478+0000 7efc069ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc00068750 con 0x7efc00151f20 2023-08-31T19:07:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.479+0000 7efbfffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efc00067b30 0x7efc00067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.479+0000 7efc04f9c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc00151f20 0x7efc001551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.479+0000 7efc04f9c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc00151f20 0x7efc001551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:35820/0 (socket says 172.21.15.72:35820) 2023-08-31T19:07:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.479+0000 7efc04f9c700 1 -- 172.21.15.72:0/3715441689 learned_addr learned my addr 172.21.15.72:0/3715441689 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.479+0000 7efbff7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efc000c5090 0x7efc00151810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:56006/0 (socket says 172.21.15.72:56006) 2023-08-31T19:07:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.479+0000 7efbfeffd700 1 -- 172.21.15.72:0/3715441689 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728950675 0 0) 0x7efc000a81b0 con 0x7efc000c5090 2023-08-31T19:07:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.479+0000 7efbfeffd700 1 -- 172.21.15.72:0/3715441689 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbe80033f0 con 0x7efc000c5090 2023-08-31T19:07:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.479+0000 7efc04f9c700 1 -- 172.21.15.72:0/3715441689 >> v2:172.21.15.146:3300/0 conn(0x7efc00067b30 msgr2=0x7efc00067f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.479+0000 7efc04f9c700 1 --2- 172.21.15.72:0/3715441689 >> v2:172.21.15.146:3300/0 conn(0x7efc00067b30 0x7efc00067f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.479+0000 7efc04f9c700 1 -- 172.21.15.72:0/3715441689 >> v1:172.21.15.146:6789/0 conn(0x7efc000c5090 legacy=0x7efc00151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.479+0000 7efc04f9c700 1 -- 172.21.15.72:0/3715441689 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc000a7e80 con 0x7efc00151f20 2023-08-31T19:07:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.479+0000 7efc04f9c700 1 --2- 172.21.15.72:0/3715441689 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc00151f20 0x7efc001551f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7efbf8009f20 tx=0x7efbf8009840).ready entity=mon.2 client_cookie=c226e1ec04dc69dc server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.480+0000 7efbfeffd700 1 -- 172.21.15.72:0/3715441689 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf800e070 con 0x7efc00151f20 2023-08-31T19:07:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.480+0000 7efbfeffd700 1 -- 172.21.15.72:0/3715441689 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf800b970 con 0x7efc00151f20 2023-08-31T19:07:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.480+0000 7efbfeffd700 1 -- 172.21.15.72:0/3715441689 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf800bcf0 con 0x7efc00151f20 2023-08-31T19:07:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.480+0000 7efc069ff700 1 -- 172.21.15.72:0/3715441689 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc00151f20 msgr2=0x7efc001551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.480+0000 7efc069ff700 1 --2- 172.21.15.72:0/3715441689 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc00151f20 0x7efc001551f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7efbf8009f20 tx=0x7efbf8009840).stop 2023-08-31T19:07:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.480+0000 7efc069ff700 1 -- 172.21.15.72:0/3715441689 shutdown_connections 2023-08-31T19:07:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.480+0000 7efc069ff700 1 --2- 172.21.15.72:0/3715441689 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc00151f20 0x7efc001551f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.480+0000 7efc069ff700 1 --2- 172.21.15.72:0/3715441689 >> v2:172.21.15.146:3300/0 conn(0x7efc00067b30 0x7efc00067f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.480+0000 7efc069ff700 1 -- 172.21.15.72:0/3715441689 >> 172.21.15.72:0/3715441689 conn(0x7efc000c8c20 msgr2=0x7efc000c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.480+0000 7efc069ff700 1 -- 172.21.15.72:0/3715441689 shutdown_connections 2023-08-31T19:07:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.480+0000 7efc069ff700 1 -- 172.21.15.72:0/3715441689 wait complete. 2023-08-31T19:07:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.482+0000 7efc069ff700 1 Processor -- start 2023-08-31T19:07:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.482+0000 7efc069ff700 1 -- start start 2023-08-31T19:07:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.483+0000 7efc069ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc00067b30 0x7efc00145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.483+0000 7efc069ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc000c5090 0x7efc000ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.483+0000 7efc069ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc00151f20 0x7efc00157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.483+0000 7efc069ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc00145d70 con 0x7efc00151f20 2023-08-31T19:07:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.483+0000 7efc069ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc000acc60 con 0x7efc000c5090 2023-08-31T19:07:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.483+0000 7efc069ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc000aced0 con 0x7efc00067b30 2023-08-31T19:07:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.483+0000 7efc04f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc00151f20 0x7efc00157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.483+0000 7efc04f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc00151f20 0x7efc00157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37342/0 (socket says 172.21.15.72:37342) 2023-08-31T19:07:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.483+0000 7efc04f9c700 1 -- 172.21.15.72:0/3202504050 learned_addr learned my addr 172.21.15.72:0/3202504050 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.484+0000 7efbfffff700 1 --2- 172.21.15.72:0/3202504050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc00067b30 0x7efc00145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.484+0000 7efbff7fe700 1 --2- 172.21.15.72:0/3202504050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc000c5090 0x7efc000ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:16.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.484+0000 7efc04f9c700 1 -- 172.21.15.72:0/3202504050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc00067b30 msgr2=0x7efc00145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.484+0000 7efc04f9c700 1 --2- 172.21.15.72:0/3202504050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc00067b30 0x7efc00145880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.484+0000 7efc04f9c700 1 -- 172.21.15.72:0/3202504050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc000c5090 msgr2=0x7efc000ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.484+0000 7efc04f9c700 1 --2- 172.21.15.72:0/3202504050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc000c5090 0x7efc000ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.484+0000 7efc04f9c700 1 -- 172.21.15.72:0/3202504050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf8009ae0 con 0x7efc00151f20 2023-08-31T19:07:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.484+0000 7efbff7fe700 1 --2- 172.21.15.72:0/3202504050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc000c5090 0x7efc000ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:16.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.484+0000 7efc04f9c700 1 --2- 172.21.15.72:0/3202504050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc00151f20 0x7efc00157bc0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7efbf800b610 tx=0x7efc000a8120).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:16.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.484+0000 7efbe7fff700 1 -- 172.21.15.72:0/3202504050 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf800bee0 con 0x7efc00151f20 2023-08-31T19:07:16.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.484+0000 7efbe7fff700 1 -- 172.21.15.72:0/3202504050 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf80092e0 con 0x7efc00151f20 2023-08-31T19:07:16.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.484+0000 7efbe7fff700 1 -- 172.21.15.72:0/3202504050 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf8007860 con 0x7efc00151f20 2023-08-31T19:07:16.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.484+0000 7efc069ff700 1 -- 172.21.15.72:0/3202504050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc000ad1b0 con 0x7efc00151f20 2023-08-31T19:07:16.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.484+0000 7efc069ff700 1 -- 172.21.15.72:0/3202504050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc00158780 con 0x7efc00151f20 2023-08-31T19:07:16.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.485+0000 7efbe5ffb700 1 -- 172.21.15.72:0/3202504050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc000ad6d0 con 0x7efc00151f20 2023-08-31T19:07:16.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.486+0000 7efbe7fff700 1 -- 172.21.15.72:0/3202504050 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7efbf8003040 con 0x7efc00151f20 2023-08-31T19:07:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.487+0000 7efbe7fff700 1 --2- 172.21.15.72:0/3202504050 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efbec05ef30 0x7efbec0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.487+0000 7efbe7fff700 1 -- 172.21.15.72:0/3202504050 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6499+0+0 (secure 0 0 0) 0x7efbf807bc10 con 0x7efc00151f20 2023-08-31T19:07:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.487+0000 7efbfffff700 1 --2- 172.21.15.72:0/3202504050 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efbec05ef30 0x7efbec0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.488+0000 7efbfffff700 1 --2- 172.21.15.72:0/3202504050 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efbec05ef30 0x7efbec0613f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7efbf0009200 tx=0x7efbf0008040).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.491+0000 7efbe7fff700 1 -- 172.21.15.72:0/3202504050 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efc000ad6d0 con 0x7efc00151f20 2023-08-31T19:07:16.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:16.676+0000 7efbe5ffb700 1 -- 172.21.15.72:0/3202504050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7efc000ad6d0 con 0x7efc00151f20 2023-08-31T19:07:17.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.526+0000 7efbe7fff700 1 -- 172.21.15.72:0/3202504050 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v138) v1 ==== 97+0+0 (secure 0 0 0) 0x7efc000ad6d0 con 0x7efc00151f20 2023-08-31T19:07:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.528+0000 7efbe5ffb700 1 -- 172.21.15.72:0/3202504050 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efbec05ef30 msgr2=0x7efbec0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:17.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.528+0000 7efbe5ffb700 1 --2- 172.21.15.72:0/3202504050 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efbec05ef30 0x7efbec0613f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7efbf0009200 tx=0x7efbf0008040).stop 2023-08-31T19:07:17.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.528+0000 7efbe5ffb700 1 -- 172.21.15.72:0/3202504050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc00151f20 msgr2=0x7efc00157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:17.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.528+0000 7efbe5ffb700 1 --2- 172.21.15.72:0/3202504050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc00151f20 0x7efc00157bc0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7efbf800b610 tx=0x7efc000a8120).stop 2023-08-31T19:07:17.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.528+0000 7efbe5ffb700 1 -- 172.21.15.72:0/3202504050 shutdown_connections 2023-08-31T19:07:17.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.528+0000 7efbe5ffb700 1 --2- 172.21.15.72:0/3202504050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc00151f20 0x7efc00157bc0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:17.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.528+0000 7efbe5ffb700 1 --2- 172.21.15.72:0/3202504050 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc00067b30 0x7efc00145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:17.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.528+0000 7efbe5ffb700 1 --2- 172.21.15.72:0/3202504050 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efbec05ef30 0x7efbec0613f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:17.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.528+0000 7efbe5ffb700 1 --2- 172.21.15.72:0/3202504050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc000c5090 0x7efc000ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:17.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.528+0000 7efbe5ffb700 1 -- 172.21.15.72:0/3202504050 >> 172.21.15.72:0/3202504050 conn(0x7efc000c8c20 msgr2=0x7efc00066450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:17.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.528+0000 7efbe5ffb700 1 -- 172.21.15.72:0/3202504050 shutdown_connections 2023-08-31T19:07:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.528+0000 7efbe5ffb700 1 -- 172.21.15.72:0/3202504050 wait complete. 2023-08-31T19:07:17.531 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-08-31T19:07:17.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-31T19:07:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.736+0000 7f78bcfff700 1 Processor -- start 2023-08-31T19:07:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.736+0000 7f78bcfff700 1 -- start start 2023-08-31T19:07:17.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.737+0000 7f78bcfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78b8154220 0x7f78b8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:17.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.737+0000 7f78bcfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78b81588d0 0x7f78b80c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:17.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.738+0000 7f78bcfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b80c8c90 con 0x7f78b80cb940 2023-08-31T19:07:17.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.738+0000 7f78bcfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b80aa700 con 0x7f78b8154220 2023-08-31T19:07:17.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.738+0000 7f78bcfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b80c5e10 con 0x7f78b81588d0 2023-08-31T19:07:17.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.738+0000 7f78b659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78b8154220 0x7f78b8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:17.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.738+0000 7f78b659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78b8154220 0x7f78b8157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37344/0 (socket says 172.21.15.72:37344) 2023-08-31T19:07:17.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.738+0000 7f78b659c700 1 -- 172.21.15.72:0/2612971643 learned_addr learned my addr 172.21.15.72:0/2612971643 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:17.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.738+0000 7f78b6d9d700 1 --2- 172.21.15.72:0/2612971643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78b81588d0 0x7f78b80c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:17.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.738+0000 7f78b659c700 1 -- 172.21.15.72:0/2612971643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78b81588d0 msgr2=0x7f78b80c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:17.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.738+0000 7f78b659c700 1 --2- 172.21.15.72:0/2612971643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78b81588d0 0x7f78b80c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:17.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.738+0000 7f78b659c700 1 -- 172.21.15.72:0/2612971643 >> v1:172.21.15.146:6789/0 conn(0x7f78b80cb940 legacy=0x7f78b81581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:17.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.738+0000 7f78b659c700 1 -- 172.21.15.72:0/2612971643 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b8155610 con 0x7f78b8154220 2023-08-31T19:07:17.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.739+0000 7f78b659c700 1 --2- 172.21.15.72:0/2612971643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b8154220 0x7f78b8157cd0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f78a8009810 tx=0x7f78a8009060).ready entity=mon.0 client_cookie=fb33c5a51b1ea626 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:17.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.739+0000 7f78b559a700 1 -- 172.21.15.72:0/2612971643 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8005880 con 0x7f78b8154220 2023-08-31T19:07:17.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.739+0000 7f78b559a700 1 -- 172.21.15.72:0/2612971643 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a80059e0 con 0x7f78b8154220 2023-08-31T19:07:17.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.739+0000 7f78b559a700 1 -- 172.21.15.72:0/2612971643 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8005d60 con 0x7f78b8154220 2023-08-31T19:07:17.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.739+0000 7f78bcfff700 1 -- 172.21.15.72:0/2612971643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b8154220 msgr2=0x7f78b8157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:17.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.739+0000 7f78bcfff700 1 --2- 172.21.15.72:0/2612971643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b8154220 0x7f78b8157cd0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f78a8009810 tx=0x7f78a8009060).stop 2023-08-31T19:07:17.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.739+0000 7f78bcfff700 1 -- 172.21.15.72:0/2612971643 shutdown_connections 2023-08-31T19:07:17.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.739+0000 7f78bcfff700 1 --2- 172.21.15.72:0/2612971643 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78b81588d0 0x7f78b80c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:17.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.739+0000 7f78bcfff700 1 --2- 172.21.15.72:0/2612971643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b8154220 0x7f78b8157cd0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:17.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.739+0000 7f78bcfff700 1 -- 172.21.15.72:0/2612971643 >> 172.21.15.72:0/2612971643 conn(0x7f78b805e870 msgr2=0x7f78b80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:17.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.739+0000 7f78bcfff700 1 -- 172.21.15.72:0/2612971643 shutdown_connections 2023-08-31T19:07:17.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.739+0000 7f78bcfff700 1 -- 172.21.15.72:0/2612971643 wait complete. 2023-08-31T19:07:17.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.741+0000 7f78bcfff700 1 Processor -- start 2023-08-31T19:07:17.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.741+0000 7f78bcfff700 1 -- start start 2023-08-31T19:07:17.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.742+0000 7f78bcfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78b80cb940 0x7f78b81653b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:17.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.742+0000 7f78bcfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78b8154220 0x7f78b80c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:17.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.742+0000 7f78bcfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b81588d0 0x7f78b8157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:17.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.742+0000 7f78bcfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b8156d00 con 0x7f78b81588d0 2023-08-31T19:07:17.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.742+0000 7f78bcfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b81658a0 con 0x7f78b8154220 2023-08-31T19:07:17.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.742+0000 7f78bcfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b80c8200 con 0x7f78b80cb940 2023-08-31T19:07:17.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.742+0000 7f78b6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b81588d0 0x7f78b8157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:17.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.742+0000 7f78b6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b81588d0 0x7f78b8157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37354/0 (socket says 172.21.15.72:37354) 2023-08-31T19:07:17.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.742+0000 7f78b6d9d700 1 -- 172.21.15.72:0/2422869375 learned_addr learned my addr 172.21.15.72:0/2422869375 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:17.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.742+0000 7f78b659c700 1 --2- 172.21.15.72:0/2422869375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78b80cb940 0x7f78b81653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:17.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.742+0000 7f78b5d9b700 1 --2- 172.21.15.72:0/2422869375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78b8154220 0x7f78b80c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:17.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.743+0000 7f78b6d9d700 1 -- 172.21.15.72:0/2422869375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78b80cb940 msgr2=0x7f78b81653b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:17.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.743+0000 7f78b6d9d700 1 --2- 172.21.15.72:0/2422869375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78b80cb940 0x7f78b81653b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:17.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.743+0000 7f78b6d9d700 1 -- 172.21.15.72:0/2422869375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78b8154220 msgr2=0x7f78b80c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:17.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.743+0000 7f78b6d9d700 1 --2- 172.21.15.72:0/2422869375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78b8154220 0x7f78b80c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:17.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.743+0000 7f78b6d9d700 1 -- 172.21.15.72:0/2422869375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a8009300 con 0x7f78b81588d0 2023-08-31T19:07:17.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.743+0000 7f78b6d9d700 1 --2- 172.21.15.72:0/2422869375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b81588d0 0x7f78b8157be0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f78b0007f20 tx=0x7f78b0009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:17.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.743+0000 7f78a67fc700 1 -- 172.21.15.72:0/2422869375 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b000eca0 con 0x7f78b81588d0 2023-08-31T19:07:17.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.743+0000 7f78a67fc700 1 -- 172.21.15.72:0/2422869375 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b000ee00 con 0x7f78b81588d0 2023-08-31T19:07:17.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.743+0000 7f78bcfff700 1 -- 172.21.15.72:0/2422869375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b81560f0 con 0x7f78b81588d0 2023-08-31T19:07:17.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.743+0000 7f78a67fc700 1 -- 172.21.15.72:0/2422869375 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0014610 con 0x7f78b81588d0 2023-08-31T19:07:17.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.743+0000 7f78bcfff700 1 -- 172.21.15.72:0/2422869375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b81566b0 con 0x7f78b81588d0 2023-08-31T19:07:17.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.744+0000 7f78bcfff700 1 -- 172.21.15.72:0/2422869375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b8157090 con 0x7f78b81588d0 2023-08-31T19:07:17.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.745+0000 7f78a67fc700 1 -- 172.21.15.72:0/2422869375 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f78b0014980 con 0x7f78b81588d0 2023-08-31T19:07:17.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.746+0000 7f78a67fc700 1 --2- 172.21.15.72:0/2422869375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f789805ef30 0x7f78980613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:17.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.746+0000 7f78a67fc700 1 -- 172.21.15.72:0/2422869375 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5897+0+0 (secure 0 0 0) 0x7f78b007a490 con 0x7f78b81588d0 2023-08-31T19:07:17.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.746+0000 7f78b659c700 1 --2- 172.21.15.72:0/2422869375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f789805ef30 0x7f78980613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:17.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.746+0000 7f78b659c700 1 --2- 172.21.15.72:0/2422869375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f789805ef30 0x7f78980613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f78a8009fd0 tx=0x7f78a8016000).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:17.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.750+0000 7f78a67fc700 1 -- 172.21.15.72:0/2422869375 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78b004b7a0 con 0x7f78b81588d0 2023-08-31T19:07:17.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.983+0000 7f78bcfff700 1 -- 172.21.15.72:0/2422869375 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f78b806c6b0 con 0x7f78b81588d0 2023-08-31T19:07:17.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.983+0000 7f78a67fc700 1 -- 172.21.15.72:0/2422869375 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f78b004edc0 con 0x7f78b81588d0 2023-08-31T19:07:17.984 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:17.984 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:07:17.984 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-08-31T19:07:17.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:17.985 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-08-31T19:07:17.985 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkPeqvDBAAA2eEr6xr7iF5PPNT9eehSg==", 2023-08-31T19:07:17.985 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:17.985 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:17.986 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:07:17.986 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:07:17.986 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:17.986 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:17.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:17.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:17.987 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-08-31T19:07:17.987 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkctxUIxAAufSVXMwPzPA7Gq1s4ukXiQ==", 2023-08-31T19:07:17.987 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:17.987 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:17.988 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:07:17.988 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:07:17.988 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:17.988 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:17.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:17.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:17.989 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-08-31T19:07:17.989 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkcpLfFxAASIB//h8whjuh6s3YKBVffQ==", 2023-08-31T19:07:17.989 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:17.989 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:17.990 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:07:17.990 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:07:17.990 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:17.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:17.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:17.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:17.991 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-08-31T19:07:17.991 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkC1bbLhAAg/0wct2P0+cyWbZyI2bP/g==", 2023-08-31T19:07:17.991 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:17.991 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:17.992 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:07:17.992 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:07:17.992 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:17.992 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:17.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:17.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:17.993 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-08-31T19:07:17.993 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAi4PBkvfRJEBAAYQqPldOXrJxXAXnmZhXaBQ==", 2023-08-31T19:07:17.993 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:17.993 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:17.993 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:17.994 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:17.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:17.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:17.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:17.994 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-08-31T19:07:17.995 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAl4PBkYysSIhAA4nCmskcGV+i4vpH2k/gDBg==", 2023-08-31T19:07:17.995 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:17.995 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:17.995 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:17.996 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:17.996 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:17.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:17.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:17.996 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-08-31T19:07:17.997 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAp4PBkyDgJFxAAPynEKk15yN7+OxQxpzL0UQ==", 2023-08-31T19:07:17.997 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:17.997 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:17.997 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:17.997 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:17.998 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:17.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:17.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:17.998 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-08-31T19:07:17.998 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAs4PBkZMD2KBAAoJrO4YjJ4/8MjcPAtgEn1g==", 2023-08-31T19:07:17.999 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:17.999 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:17.999 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:17.999 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:17.999 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:18.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:18.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:18.000 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-08-31T19:07:18.000 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAz4PBkSgAoExAAJ95kdHV47jDTXSj/WSCiLw==", 2023-08-31T19:07:18.000 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:18.001 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:18.001 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:18.001 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:18.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:18.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:18.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:18.002 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-08-31T19:07:18.002 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA24PBkUxpLKBAAAu8d6iKME6wW+Q/6hhFIRQ==", 2023-08-31T19:07:18.002 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:18.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-08-31T19:07:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA54PBkURHJOhAA3HaPfENVQ4hLIjc/esF0bQ==", 2023-08-31T19:07:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:18.004 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:18.005 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-08-31T19:07:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA94PBkfoqTEBAAQHENgrp5tv1X47Br/dUksQ==", 2023-08-31T19:07:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:18.006 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:18.007 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:18.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:18.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:18.007 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-08-31T19:07:18.007 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkucWuOBAABLowlGxpCR3GgoOCRmC0FQ==", 2023-08-31T19:07:18.008 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:18.008 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:18.008 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow r", 2023-08-31T19:07:18.008 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-31T19:07:18.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:18.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:18.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:18.009 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-08-31T19:07:18.009 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkVGBPCxAAO4M9u24/yH0xwtV6oSz+JQ==", 2023-08-31T19:07:18.009 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:18.010 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:18.010 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:07:18.010 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:07:18.010 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:07:18.011 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:18.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:18.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:18.011 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.2", 2023-08-31T19:07:18.011 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkYeIoBBAAjoIzJJ9McIx3rLBSaorTKA==", 2023-08-31T19:07:18.011 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:18.012 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:18.012 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:07:18.012 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:07:18.012 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:07:18.012 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:18.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:18.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:18.013 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.3", 2023-08-31T19:07:18.013 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkX/V9EhAAqWuBMMhikN/JUQp3v5/ABQ==", 2023-08-31T19:07:18.013 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:18.014 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:18.014 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:07:18.014 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:07:18.014 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:07:18.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:18.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:18.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:18.015 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-08-31T19:07:18.015 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkCRlhDhAAxvcGr+KTvLoJmtuZC89Iuw==", 2023-08-31T19:07:18.015 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:18.015 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:07:18.016 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:07:18.016 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:07:18.016 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:18.016 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:18.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:18.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:18.017 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-08-31T19:07:18.017 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkiGBUBRAAwWTFqrz+ELBSwb0Z2T9yhQ==", 2023-08-31T19:07:18.017 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:18.017 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:07:18.018 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:07:18.018 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:18.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:18.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:18.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:18.019 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-08-31T19:07:18.019 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkSWszNRAAdBxrfMEuBRgePfaiPx6kpQ==", 2023-08-31T19:07:18.019 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:18.019 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:07:18.019 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:07:18.020 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:18.020 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:18.020 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:18.020 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-08-31T19:07:18.020 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:07:18.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.985+0000 7f78bcfff700 1 -- 172.21.15.72:0/2422869375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f789805ef30 msgr2=0x7f78980613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:18.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.985+0000 7f78bcfff700 1 --2- 172.21.15.72:0/2422869375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f789805ef30 0x7f78980613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f78a8009fd0 tx=0x7f78a8016000).stop 2023-08-31T19:07:18.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.985+0000 7f78bcfff700 1 -- 172.21.15.72:0/2422869375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b81588d0 msgr2=0x7f78b8157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:18.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.985+0000 7f78bcfff700 1 --2- 172.21.15.72:0/2422869375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b81588d0 0x7f78b8157be0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f78b0007f20 tx=0x7f78b0009860).stop 2023-08-31T19:07:18.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.985+0000 7f78bcfff700 1 -- 172.21.15.72:0/2422869375 shutdown_connections 2023-08-31T19:07:18.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.985+0000 7f78bcfff700 1 --2- 172.21.15.72:0/2422869375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78b81588d0 0x7f78b8157be0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.985+0000 7f78bcfff700 1 --2- 172.21.15.72:0/2422869375 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78b80cb940 0x7f78b81653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.985+0000 7f78bcfff700 1 --2- 172.21.15.72:0/2422869375 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f789805ef30 0x7f78980613f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.985+0000 7f78bcfff700 1 --2- 172.21.15.72:0/2422869375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78b8154220 0x7f78b80c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.985+0000 7f78bcfff700 1 -- 172.21.15.72:0/2422869375 >> 172.21.15.72:0/2422869375 conn(0x7f78b805e870 msgr2=0x7f78b814b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:18.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.985+0000 7f78bcfff700 1 -- 172.21.15.72:0/2422869375 shutdown_connections 2023-08-31T19:07:18.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:17.985+0000 7f78bcfff700 1 -- 172.21.15.72:0/2422869375 wait complete. 2023-08-31T19:07:18.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:07:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.216+0000 7fcba01ff700 1 Processor -- start 2023-08-31T19:07:18.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.216+0000 7fcba01ff700 1 -- start start 2023-08-31T19:07:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.217+0000 7fcba01ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb980c6c30 0x7fcb980bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:18.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.217+0000 7fcba01ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb980c4740 0x7fcb98157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:18.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.217+0000 7fcba01ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb98063be0 con 0x7fcb981581d0 2023-08-31T19:07:18.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.217+0000 7fcba01ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb98063010 con 0x7fcb980c6c30 2023-08-31T19:07:18.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.217+0000 7fcba01ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb98158600 con 0x7fcb980c4740 2023-08-31T19:07:18.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.217+0000 7fcb9df9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb980c6c30 0x7fcb980bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:18.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.217+0000 7fcb9e79c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcb981581d0 0x7fcb98154710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59402/0 (socket says 172.21.15.72:59402) 2023-08-31T19:07:18.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.217+0000 7fcb9e79c700 1 -- 172.21.15.72:0/3151850213 learned_addr learned my addr 172.21.15.72:0/3151850213 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:18.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.218+0000 7fcb9d79a700 1 --2- 172.21.15.72:0/3151850213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb980c4740 0x7fcb98157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:18.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.218+0000 7fcb9df9b700 1 -- 172.21.15.72:0/3151850213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb980c4740 msgr2=0x7fcb98157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:18.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.218+0000 7fcb9df9b700 1 --2- 172.21.15.72:0/3151850213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb980c4740 0x7fcb98157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.218+0000 7fcb9df9b700 1 -- 172.21.15.72:0/3151850213 >> v1:172.21.15.72:6789/0 conn(0x7fcb981581d0 legacy=0x7fcb98154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:18.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.218+0000 7fcb9df9b700 1 -- 172.21.15.72:0/3151850213 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb980632b0 con 0x7fcb980c6c30 2023-08-31T19:07:18.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.218+0000 7fcb9df9b700 1 --2- 172.21.15.72:0/3151850213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb980c6c30 0x7fcb980bc300 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fcb94009760 tx=0x7fcb94009060).ready entity=mon.0 client_cookie=da174a86f5e21038 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:18.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.218+0000 7fcb9cf99700 1 -- 172.21.15.72:0/3151850213 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9400b580 con 0x7fcb980c6c30 2023-08-31T19:07:18.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.218+0000 7fcb9cf99700 1 -- 172.21.15.72:0/3151850213 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9400b6e0 con 0x7fcb980c6c30 2023-08-31T19:07:18.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.218+0000 7fcb9cf99700 1 -- 172.21.15.72:0/3151850213 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9400ba60 con 0x7fcb980c6c30 2023-08-31T19:07:18.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.219+0000 7fcba01ff700 1 -- 172.21.15.72:0/3151850213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb980c6c30 msgr2=0x7fcb980bc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.219+0000 7fcba01ff700 1 --2- 172.21.15.72:0/3151850213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb980c6c30 0x7fcb980bc300 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fcb94009760 tx=0x7fcb94009060).stop 2023-08-31T19:07:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.219+0000 7fcba01ff700 1 -- 172.21.15.72:0/3151850213 shutdown_connections 2023-08-31T19:07:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.219+0000 7fcba01ff700 1 --2- 172.21.15.72:0/3151850213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb980c6c30 0x7fcb980bc300 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.219+0000 7fcba01ff700 1 --2- 172.21.15.72:0/3151850213 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb980c4740 0x7fcb98157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.219+0000 7fcba01ff700 1 -- 172.21.15.72:0/3151850213 >> 172.21.15.72:0/3151850213 conn(0x7fcb980c7e70 msgr2=0x7fcb980c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.219+0000 7fcba01ff700 1 -- 172.21.15.72:0/3151850213 shutdown_connections 2023-08-31T19:07:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.219+0000 7fcba01ff700 1 -- 172.21.15.72:0/3151850213 wait complete. 2023-08-31T19:07:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.220+0000 7fcba01ff700 1 Processor -- start 2023-08-31T19:07:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.220+0000 7fcba01ff700 1 -- start start 2023-08-31T19:07:18.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.221+0000 7fcba01ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb980c4740 0x7fcb9814e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.221+0000 7fcba01ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb980c6c30 0x7fcb980aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.221+0000 7fcba01ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb981581d0 0x7fcb98167f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.221+0000 7fcba01ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980ab300 con 0x7fcb981581d0 2023-08-31T19:07:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.221+0000 7fcba01ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980aa6f0 con 0x7fcb980c6c30 2023-08-31T19:07:18.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.221+0000 7fcba01ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980aa9d0 con 0x7fcb980c4740 2023-08-31T19:07:18.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.222+0000 7fcb9e79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb981581d0 0x7fcb98167f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:18.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.222+0000 7fcb9e79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb981581d0 0x7fcb98167f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37368/0 (socket says 172.21.15.72:37368) 2023-08-31T19:07:18.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.222+0000 7fcb9e79c700 1 -- 172.21.15.72:0/3611912482 learned_addr learned my addr 172.21.15.72:0/3611912482 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:18.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.222+0000 7fcb9d79a700 1 --2- 172.21.15.72:0/3611912482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb980c6c30 0x7fcb980aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:18.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.222+0000 7fcb9df9b700 1 --2- 172.21.15.72:0/3611912482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb980c4740 0x7fcb9814e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:18.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.222+0000 7fcb9e79c700 1 -- 172.21.15.72:0/3611912482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb980c4740 msgr2=0x7fcb9814e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:18.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.222+0000 7fcb9e79c700 1 --2- 172.21.15.72:0/3611912482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb980c4740 0x7fcb9814e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.222+0000 7fcb9e79c700 1 -- 172.21.15.72:0/3611912482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb980c6c30 msgr2=0x7fcb980aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:18.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.222+0000 7fcb9e79c700 1 --2- 172.21.15.72:0/3611912482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb980c6c30 0x7fcb980aca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.222+0000 7fcb9e79c700 1 -- 172.21.15.72:0/3611912482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb940092a0 con 0x7fcb981581d0 2023-08-31T19:07:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.222+0000 7fcb9e79c700 1 --2- 172.21.15.72:0/3611912482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb981581d0 0x7fcb98167f90 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7fcb9000c790 tx=0x7fcb900015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.222+0000 7fcb8dffb700 1 -- 172.21.15.72:0/3611912482 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90005d30 con 0x7fcb981581d0 2023-08-31T19:07:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.223+0000 7fcb8dffb700 1 -- 172.21.15.72:0/3611912482 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb90005e90 con 0x7fcb981581d0 2023-08-31T19:07:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.223+0000 7fcba01ff700 1 -- 172.21.15.72:0/3611912482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb980aacb0 con 0x7fcb981581d0 2023-08-31T19:07:18.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.223+0000 7fcb8dffb700 1 -- 172.21.15.72:0/3611912482 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90007320 con 0x7fcb981581d0 2023-08-31T19:07:18.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.223+0000 7fcba01ff700 1 -- 172.21.15.72:0/3611912482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb980aa330 con 0x7fcb981581d0 2023-08-31T19:07:18.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.224+0000 7fcba01ff700 1 -- 172.21.15.72:0/3611912482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9806c6b0 con 0x7fcb981581d0 2023-08-31T19:07:18.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.224+0000 7fcb8dffb700 1 -- 172.21.15.72:0/3611912482 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fcb900076d0 con 0x7fcb981581d0 2023-08-31T19:07:18.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.225+0000 7fcb8dffb700 1 --2- 172.21.15.72:0/3611912482 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb7c05ef30 0x7fcb7c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:18.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.225+0000 7fcb8dffb700 1 -- 172.21.15.72:0/3611912482 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5897+0+0 (secure 0 0 0) 0x7fcb90079e00 con 0x7fcb981581d0 2023-08-31T19:07:18.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.225+0000 7fcb9df9b700 1 --2- 172.21.15.72:0/3611912482 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb7c05ef30 0x7fcb7c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:18.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.226+0000 7fcb9df9b700 1 --2- 172.21.15.72:0/3611912482 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb7c05ef30 0x7fcb7c0613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fcb9400b340 tx=0x7fcb94017000).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:18.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.229+0000 7fcb8dffb700 1 -- 172.21.15.72:0/3611912482 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcb9004b110 con 0x7fcb981581d0 2023-08-31T19:07:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.398+0000 7fcba01ff700 1 -- 172.21.15.72:0/3611912482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb980be000 con 0x7fcb981581d0 2023-08-31T19:07:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.399+0000 7fcb8dffb700 1 -- 172.21.15.72:0/3611912482 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+14771 (secure 0 0 0) 0x7fcb9004e730 con 0x7fcb981581d0 2023-08-31T19:07:18.399 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:18.400 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":138,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:07:17.522446+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:07:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.401+0000 7fcba01ff700 1 -- 172.21.15.72:0/3611912482 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb7c05ef30 msgr2=0x7fcb7c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.401+0000 7fcba01ff700 1 --2- 172.21.15.72:0/3611912482 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb7c05ef30 0x7fcb7c0613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fcb9400b340 tx=0x7fcb94017000).stop 2023-08-31T19:07:18.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.401+0000 7fcba01ff700 1 -- 172.21.15.72:0/3611912482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb981581d0 msgr2=0x7fcb98167f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:18.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.401+0000 7fcba01ff700 1 --2- 172.21.15.72:0/3611912482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb981581d0 0x7fcb98167f90 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7fcb9000c790 tx=0x7fcb900015e0).stop 2023-08-31T19:07:18.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.401+0000 7fcba01ff700 1 -- 172.21.15.72:0/3611912482 shutdown_connections 2023-08-31T19:07:18.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.401+0000 7fcba01ff700 1 --2- 172.21.15.72:0/3611912482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb981581d0 0x7fcb98167f90 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.401+0000 7fcba01ff700 1 --2- 172.21.15.72:0/3611912482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb980c4740 0x7fcb9814e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.401+0000 7fcba01ff700 1 --2- 172.21.15.72:0/3611912482 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb7c05ef30 0x7fcb7c0613f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.401+0000 7fcba01ff700 1 --2- 172.21.15.72:0/3611912482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb980c6c30 0x7fcb980aca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.401+0000 7fcba01ff700 1 -- 172.21.15.72:0/3611912482 >> 172.21.15.72:0/3611912482 conn(0x7fcb980c7e70 msgr2=0x7fcb980662d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:18.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.401+0000 7fcba01ff700 1 -- 172.21.15.72:0/3611912482 shutdown_connections 2023-08-31T19:07:18.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.401+0000 7fcba01ff700 1 -- 172.21.15.72:0/3611912482 wait complete. 2023-08-31T19:07:18.419 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-31T19:07:18.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:07:18.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.613+0000 7fb7e5dff700 1 Processor -- start 2023-08-31T19:07:18.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.613+0000 7fb7e5dff700 1 -- start start 2023-08-31T19:07:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.615+0000 7fb7e5dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7e0153e20 0x7fb7e0154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.615+0000 7fb7e5dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e0158a90 con 0x7fb7e0063270 2023-08-31T19:07:18.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.615+0000 7fb7e5dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e0157e80 con 0x7fb7e00aa450 2023-08-31T19:07:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.615+0000 7fb7e5dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e0157c70 con 0x7fb7e0153e20 2023-08-31T19:07:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.615+0000 7fb7df7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7e0153e20 0x7fb7e0154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.615+0000 7fb7deffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb7e0063270 0x7fb7e00a9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59408/0 (socket says 172.21.15.72:59408) 2023-08-31T19:07:18.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.615+0000 7fb7deffd700 1 -- 172.21.15.72:0/3445116873 learned_addr learned my addr 172.21.15.72:0/3445116873 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:18.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.615+0000 7fb7df7fe700 1 -- 172.21.15.72:0/3445116873 >> v1:172.21.15.146:6789/0 conn(0x7fb7e00aa450 legacy=0x7fb7e00c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:18.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.615+0000 7fb7df7fe700 1 -- 172.21.15.72:0/3445116873 >> v1:172.21.15.72:6789/0 conn(0x7fb7e0063270 legacy=0x7fb7e00a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:18.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.615+0000 7fb7df7fe700 1 -- 172.21.15.72:0/3445116873 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e0158160 con 0x7fb7e0153e20 2023-08-31T19:07:18.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.615+0000 7fb7de7fc700 1 -- 172.21.15.72:0/3445116873 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646633342 0 0) 0x7fb7e0158a90 con 0x7fb7e0063270 2023-08-31T19:07:18.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.616+0000 7fb7df7fe700 1 --2- 172.21.15.72:0/3445116873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7e0153e20 0x7fb7e0154200 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fb7e0157db0 tx=0x7fb7d0009060).ready entity=mon.0 client_cookie=4cde3857ef12a6e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:18.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.616+0000 7fb7de7fc700 1 -- 172.21.15.72:0/3445116873 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d000b580 con 0x7fb7e0153e20 2023-08-31T19:07:18.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.616+0000 7fb7de7fc700 1 -- 172.21.15.72:0/3445116873 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d000b6e0 con 0x7fb7e0153e20 2023-08-31T19:07:18.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.616+0000 7fb7de7fc700 1 -- 172.21.15.72:0/3445116873 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d000ba60 con 0x7fb7e0153e20 2023-08-31T19:07:18.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.616+0000 7fb7e5dff700 1 -- 172.21.15.72:0/3445116873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7e0153e20 msgr2=0x7fb7e0154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:18.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.616+0000 7fb7e5dff700 1 --2- 172.21.15.72:0/3445116873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7e0153e20 0x7fb7e0154200 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fb7e0157db0 tx=0x7fb7d0009060).stop 2023-08-31T19:07:18.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.616+0000 7fb7e5dff700 1 -- 172.21.15.72:0/3445116873 shutdown_connections 2023-08-31T19:07:18.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.616+0000 7fb7e5dff700 1 --2- 172.21.15.72:0/3445116873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7e0153e20 0x7fb7e0154200 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.616+0000 7fb7e5dff700 1 -- 172.21.15.72:0/3445116873 >> 172.21.15.72:0/3445116873 conn(0x7fb7e005eb60 msgr2=0x7fb7e00cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:18.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.617+0000 7fb7e5dff700 1 -- 172.21.15.72:0/3445116873 shutdown_connections 2023-08-31T19:07:18.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.617+0000 7fb7e5dff700 1 -- 172.21.15.72:0/3445116873 wait complete. 2023-08-31T19:07:18.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.618+0000 7fb7e5dff700 1 Processor -- start 2023-08-31T19:07:18.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.618+0000 7fb7e5dff700 1 -- start start 2023-08-31T19:07:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.619+0000 7fb7e5dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7e0063270 0x7fb7e01427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.619+0000 7fb7e5dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7e00aa450 0x7fb7e00c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.619+0000 7fb7e5dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7e0153e20 0x7fb7e00c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.619+0000 7fb7e5dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00c36b0 con 0x7fb7e0153e20 2023-08-31T19:07:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.619+0000 7fb7e5dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0164430 con 0x7fb7e00aa450 2023-08-31T19:07:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.619+0000 7fb7e5dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e00c28c0 con 0x7fb7e0063270 2023-08-31T19:07:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.619+0000 7fb7dffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7e0153e20 0x7fb7e00c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.619+0000 7fb7dffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7e0153e20 0x7fb7e00c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37372/0 (socket says 172.21.15.72:37372) 2023-08-31T19:07:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.619+0000 7fb7dffff700 1 -- 172.21.15.72:0/1145624787 learned_addr learned my addr 172.21.15.72:0/1145624787 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.620+0000 7fb7df7fe700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7e0063270 0x7fb7e01427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.620+0000 7fb7deffd700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7e00aa450 0x7fb7e00c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.620+0000 7fb7dffff700 1 -- 172.21.15.72:0/1145624787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7e0063270 msgr2=0x7fb7e01427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:18.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.620+0000 7fb7dffff700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7e0063270 0x7fb7e01427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.620+0000 7fb7dffff700 1 -- 172.21.15.72:0/1145624787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7e00aa450 msgr2=0x7fb7e00c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:18.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.620+0000 7fb7dffff700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7e00aa450 0x7fb7e00c1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.620+0000 7fb7dffff700 1 -- 172.21.15.72:0/1145624787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d00092a0 con 0x7fb7e0153e20 2023-08-31T19:07:18.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.620+0000 7fb7df7fe700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7e0063270 0x7fb7e01427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.620+0000 7fb7deffd700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7e00aa450 0x7fb7e00c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.620+0000 7fb7dffff700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7e0153e20 0x7fb7e00c9660 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fb7d800c7c0 tx=0x7fb7d8001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.620+0000 7fb7c77fe700 1 -- 172.21.15.72:0/1145624787 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8010510 con 0x7fb7e0153e20 2023-08-31T19:07:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.620+0000 7fb7c77fe700 1 -- 172.21.15.72:0/1145624787 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d8010670 con 0x7fb7e0153e20 2023-08-31T19:07:18.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.620+0000 7fb7e5dff700 1 -- 172.21.15.72:0/1145624787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e00c2ba0 con 0x7fb7e0153e20 2023-08-31T19:07:18.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.620+0000 7fb7c77fe700 1 -- 172.21.15.72:0/1145624787 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80109f0 con 0x7fb7e0153e20 2023-08-31T19:07:18.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.620+0000 7fb7e5dff700 1 -- 172.21.15.72:0/1145624787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e0142cd0 con 0x7fb7e0153e20 2023-08-31T19:07:18.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.621+0000 7fb7e5dff700 1 -- 172.21.15.72:0/1145624787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e00c31a0 con 0x7fb7e0153e20 2023-08-31T19:07:18.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.622+0000 7fb7c77fe700 1 -- 172.21.15.72:0/1145624787 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb7d801b3b0 con 0x7fb7e0153e20 2023-08-31T19:07:18.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.623+0000 7fb7c77fe700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb7cc05ef30 0x7fb7cc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:18.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.623+0000 7fb7c77fe700 1 -- 172.21.15.72:0/1145624787 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5897+0+0 (secure 0 0 0) 0x7fb7d80797d0 con 0x7fb7e0153e20 2023-08-31T19:07:18.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.623+0000 7fb7df7fe700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb7cc05ef30 0x7fb7cc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:18.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.623+0000 7fb7df7fe700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb7cc05ef30 0x7fb7cc0613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb7d000b340 tx=0x7fb7d0017000).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:18.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.627+0000 7fb7c77fe700 1 -- 172.21.15.72:0/1145624787 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb7d80488f0 con 0x7fb7e0153e20 2023-08-31T19:07:18.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.794+0000 7fb7e5dff700 1 -- 172.21.15.72:0/1145624787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb7e00c2d90 con 0x7fb7e0153e20 2023-08-31T19:07:18.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.794+0000 7fb7c77fe700 1 -- 172.21.15.72:0/1145624787 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v138) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb7e00c31a0 con 0x7fb7e0153e20 2023-08-31T19:07:18.795 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:07:18.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.796+0000 7fb7e5dff700 1 -- 172.21.15.72:0/1145624787 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb7cc05ef30 msgr2=0x7fb7cc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:18.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.796+0000 7fb7e5dff700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb7cc05ef30 0x7fb7cc0613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb7d000b340 tx=0x7fb7d0017000).stop 2023-08-31T19:07:18.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.796+0000 7fb7e5dff700 1 -- 172.21.15.72:0/1145624787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7e0153e20 msgr2=0x7fb7e00c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:18.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.796+0000 7fb7e5dff700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7e0153e20 0x7fb7e00c9660 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fb7d800c7c0 tx=0x7fb7d8001530).stop 2023-08-31T19:07:18.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.796+0000 7fb7e5dff700 1 -- 172.21.15.72:0/1145624787 shutdown_connections 2023-08-31T19:07:18.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.796+0000 7fb7e5dff700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7e0153e20 0x7fb7e00c9660 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.796+0000 7fb7e5dff700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7e0063270 0x7fb7e01427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.796+0000 7fb7e5dff700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb7cc05ef30 0x7fb7cc0613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.796+0000 7fb7e5dff700 1 --2- 172.21.15.72:0/1145624787 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7e00aa450 0x7fb7e00c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:18.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.796+0000 7fb7e5dff700 1 -- 172.21.15.72:0/1145624787 >> 172.21.15.72:0/1145624787 conn(0x7fb7e005eb60 msgr2=0x7fb7e00ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:18.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.796+0000 7fb7e5dff700 1 -- 172.21.15.72:0/1145624787 shutdown_connections 2023-08-31T19:07:18.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:18.797+0000 7fb7e5dff700 1 -- 172.21.15.72:0/1145624787 wait complete. 2023-08-31T19:07:18.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:07:19.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.005+0000 7f658f1ff700 1 Processor -- start 2023-08-31T19:07:19.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.006+0000 7f658f1ff700 1 -- start start 2023-08-31T19:07:19.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.007+0000 7f658f1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6588154030 0x7f6588154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.007+0000 7f658f1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65880c6ed0 con 0x7f65880c7360 2023-08-31T19:07:19.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.007+0000 7f658f1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65880c68c0 con 0x7f65880c06b0 2023-08-31T19:07:19.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.007+0000 7f658f1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65880c66e0 con 0x7f6588154030 2023-08-31T19:07:19.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.007+0000 7f658d79c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f65880c7360 0x7f6588063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59410/0 (socket says 172.21.15.72:59410) 2023-08-31T19:07:19.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.007+0000 7f658d79c700 1 -- 172.21.15.72:0/1268182860 learned_addr learned my addr 172.21.15.72:0/1268182860 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:19.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.007+0000 7f658cf9b700 1 --2- 172.21.15.72:0/1268182860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6588154030 0x7f6588154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388282433 0 0) 0x7f65880c6ed0 con 0x7f65880c7360 2023-08-31T19:07:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65780033f0 con 0x7f65880c7360 2023-08-31T19:07:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927767992 0 0) 0x7f65880c68c0 con 0x7f65880c06b0 2023-08-31T19:07:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65880c6ed0 con 0x7f65880c06b0 2023-08-31T19:07:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3690656497 0 0) 0x7f65780033f0 con 0x7f65880c7360 2023-08-31T19:07:19.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6588154030 msgr2=0x7f6588154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 --2- 172.21.15.72:0/1268182860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6588154030 0x7f6588154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 >> v1:172.21.15.146:6789/0 conn(0x7f65880c06b0 legacy=0x7f65880aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65880c0f30 con 0x7f65880c7360 2023-08-31T19:07:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f65800017f0 con 0x7f65880c7360 2023-08-31T19:07:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 >> v1:172.21.15.72:6789/0 conn(0x7f65880c7360 legacy=0x7f6588063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 --2- 172.21.15.72:0/1268182860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6578003aa0 0x7f6578003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 --2- 172.21.15.72:0/1268182860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6588154030 0x7f6578004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 --2- 172.21.15.72:0/1268182860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6578004b80 0x7f6578005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65880c66e0 con 0x7f6578004b80 2023-08-31T19:07:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657800b910 con 0x7f6578003aa0 2023-08-31T19:07:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657800bad0 con 0x7f6588154030 2023-08-31T19:07:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f658d79c700 1 --2- 172.21.15.72:0/1268182860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6578004b80 0x7f6578005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f658cf9b700 1 --2- 172.21.15.72:0/1268182860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6578003aa0 0x7f6578003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.008+0000 7f6587fff700 1 --2- 172.21.15.72:0/1268182860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6588154030 0x7f6578004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.009+0000 7f658d79c700 1 -- 172.21.15.72:0/1268182860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6588154030 msgr2=0x7f6578004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.009+0000 7f658d79c700 1 --2- 172.21.15.72:0/1268182860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6588154030 0x7f6578004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.009+0000 7f658d79c700 1 -- 172.21.15.72:0/1268182860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6578003aa0 msgr2=0x7f6578003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.009+0000 7f658d79c700 1 --2- 172.21.15.72:0/1268182860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6578003aa0 0x7f6578003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.009+0000 7f658d79c700 1 -- 172.21.15.72:0/1268182860 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65780033f0 con 0x7f6578004b80 2023-08-31T19:07:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.009+0000 7f658d79c700 1 --2- 172.21.15.72:0/1268182860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6578004b80 0x7f6578005000 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f658000c5f0 tx=0x7f65880c6a50).ready entity=mon.0 client_cookie=a02efbc0586ab6ff server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.009+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658000cdf0 con 0x7f6578004b80 2023-08-31T19:07:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.009+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6580005b20 con 0x7f6578004b80 2023-08-31T19:07:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.009+0000 7f65877fe700 1 -- 172.21.15.72:0/1268182860 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800070d0 con 0x7f6578004b80 2023-08-31T19:07:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.010+0000 7f658f1ff700 1 -- 172.21.15.72:0/1268182860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6578004b80 msgr2=0x7f6578005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.010+0000 7f658f1ff700 1 --2- 172.21.15.72:0/1268182860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6578004b80 0x7f6578005000 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f658000c5f0 tx=0x7f65880c6a50).stop 2023-08-31T19:07:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.010+0000 7f658d79c700 1 -- 172.21.15.72:0/1268182860 reap_dead start 2023-08-31T19:07:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.010+0000 7f658f1ff700 1 -- 172.21.15.72:0/1268182860 shutdown_connections 2023-08-31T19:07:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.010+0000 7f658f1ff700 1 -- 172.21.15.72:0/1268182860 >> 172.21.15.72:0/1268182860 conn(0x7f658805eb60 msgr2=0x7f65880cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.010+0000 7f658f1ff700 1 -- 172.21.15.72:0/1268182860 shutdown_connections 2023-08-31T19:07:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.010+0000 7f658f1ff700 1 -- 172.21.15.72:0/1268182860 wait complete. 2023-08-31T19:07:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.011+0000 7f658f1ff700 1 Processor -- start 2023-08-31T19:07:19.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.011+0000 7f658f1ff700 1 -- start start 2023-08-31T19:07:19.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.012+0000 7f658f1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6578004b80 0x7f65880b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.012+0000 7f658f1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65880c1e90 0x7f6588146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.012+0000 7f658f1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65880aea50 0x7f65880add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.012+0000 7f658f1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6588155b40 con 0x7f6578004b80 2023-08-31T19:07:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.012+0000 7f658f1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65880b0ee0 con 0x7f65880c1e90 2023-08-31T19:07:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.012+0000 7f658f1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65880b0c00 con 0x7f65880aea50 2023-08-31T19:07:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.012+0000 7f658cf9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6578004b80 0x7f65880b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.012+0000 7f658cf9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6578004b80 0x7f65880b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37376/0 (socket says 172.21.15.72:37376) 2023-08-31T19:07:19.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.012+0000 7f658cf9b700 1 -- 172.21.15.72:0/426144263 learned_addr learned my addr 172.21.15.72:0/426144263 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.013+0000 7f658cf9b700 1 -- 172.21.15.72:0/426144263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65880aea50 msgr2=0x7f65880add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.013+0000 7f658cf9b700 1 --2- 172.21.15.72:0/426144263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65880aea50 0x7f65880add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.013+0000 7f658cf9b700 1 -- 172.21.15.72:0/426144263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65880c1e90 msgr2=0x7f6588146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.013+0000 7f658cf9b700 1 --2- 172.21.15.72:0/426144263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65880c1e90 0x7f6588146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:19.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.013+0000 7f658cf9b700 1 -- 172.21.15.72:0/426144263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65881554f0 con 0x7f6578004b80 2023-08-31T19:07:19.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.013+0000 7f658cf9b700 1 --2- 172.21.15.72:0/426144263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6578004b80 0x7f65880b0590 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f657c0119c0 tx=0x7f657c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:19.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.013+0000 7f6584ff9700 1 -- 172.21.15.72:0/426144263 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c00f8e0 con 0x7f6578004b80 2023-08-31T19:07:19.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.013+0000 7f6584ff9700 1 -- 172.21.15.72:0/426144263 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657c00fa40 con 0x7f6578004b80 2023-08-31T19:07:19.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.013+0000 7f6584ff9700 1 -- 172.21.15.72:0/426144263 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c00fdc0 con 0x7f6578004b80 2023-08-31T19:07:19.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.013+0000 7f658f1ff700 1 -- 172.21.15.72:0/426144263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65881557d0 con 0x7f6578004b80 2023-08-31T19:07:19.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.013+0000 7f658f1ff700 1 -- 172.21.15.72:0/426144263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65880aeeb0 con 0x7f6578004b80 2023-08-31T19:07:19.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.014+0000 7f658f1ff700 1 -- 172.21.15.72:0/426144263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6588155350 con 0x7f6578004b80 2023-08-31T19:07:19.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.015+0000 7f6584ff9700 1 -- 172.21.15.72:0/426144263 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f657c014650 con 0x7f6578004b80 2023-08-31T19:07:19.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.016+0000 7f6584ff9700 1 --2- 172.21.15.72:0/426144263 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f656c05ef30 0x7f656c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.016+0000 7f6584ff9700 1 -- 172.21.15.72:0/426144263 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5897+0+0 (secure 0 0 0) 0x7f657c07aae0 con 0x7f6578004b80 2023-08-31T19:07:19.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.016+0000 7f6587fff700 1 --2- 172.21.15.72:0/426144263 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f656c05ef30 0x7f656c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.017+0000 7f6587fff700 1 --2- 172.21.15.72:0/426144263 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f656c05ef30 0x7f656c0613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6574007a40 tx=0x7f6574007bb0).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:19.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.020+0000 7f6584ff9700 1 -- 172.21.15.72:0/426144263 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6588155350 con 0x7f6578004b80 2023-08-31T19:07:19.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.191+0000 7f658f1ff700 1 -- 172.21.15.72:0/426144263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6588155e20 con 0x7f6578004b80 2023-08-31T19:07:19.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.192+0000 7f6584ff9700 1 -- 172.21.15.72:0/426144263 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v138) v1 ==== 92+0+10 (secure 0 0 0) 0x7f657c04beb0 con 0x7f6578004b80 2023-08-31T19:07:19.193 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:07:19.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.194+0000 7f658f1ff700 1 -- 172.21.15.72:0/426144263 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f656c05ef30 msgr2=0x7f656c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.194+0000 7f658f1ff700 1 --2- 172.21.15.72:0/426144263 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f656c05ef30 0x7f656c0613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f6574007a40 tx=0x7f6574007bb0).stop 2023-08-31T19:07:19.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.194+0000 7f658f1ff700 1 -- 172.21.15.72:0/426144263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6578004b80 msgr2=0x7f65880b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.194+0000 7f658f1ff700 1 --2- 172.21.15.72:0/426144263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6578004b80 0x7f65880b0590 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f657c0119c0 tx=0x7f657c009060).stop 2023-08-31T19:07:19.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.194+0000 7f658f1ff700 1 -- 172.21.15.72:0/426144263 shutdown_connections 2023-08-31T19:07:19.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.194+0000 7f658f1ff700 1 --2- 172.21.15.72:0/426144263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f65880aea50 0x7f65880add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:19.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.194+0000 7f658f1ff700 1 --2- 172.21.15.72:0/426144263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6578004b80 0x7f65880b0590 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.194+0000 7f658f1ff700 1 --2- 172.21.15.72:0/426144263 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f656c05ef30 0x7f656c0613f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.194+0000 7f658f1ff700 1 --2- 172.21.15.72:0/426144263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65880c1e90 0x7f6588146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:19.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.194+0000 7f658f1ff700 1 -- 172.21.15.72:0/426144263 >> 172.21.15.72:0/426144263 conn(0x7f658805eb60 msgr2=0x7f65880c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:19.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.194+0000 7f658f1ff700 1 -- 172.21.15.72:0/426144263 shutdown_connections 2023-08-31T19:07:19.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.194+0000 7f658f1ff700 1 -- 172.21.15.72:0/426144263 wait complete. 2023-08-31T19:07:19.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T19:07:19.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.400+0000 7fd7df1ff700 1 Processor -- start 2023-08-31T19:07:19.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.401+0000 7fd7df1ff700 1 -- start start 2023-08-31T19:07:19.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.402+0000 7fd7df1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7d8154060 0x7fd7d8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.402+0000 7fd7df1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d80c6120 con 0x7fd7d81588d0 2023-08-31T19:07:19.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.402+0000 7fd7df1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d80c5e10 con 0x7fd7d80cb9b0 2023-08-31T19:07:19.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.402+0000 7fd7df1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80c1380 con 0x7fd7d8154060 2023-08-31T19:07:19.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.402+0000 7fd7dd79c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd7d81588d0 0x7fd7d8154440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59416/0 (socket says 172.21.15.72:59416) 2023-08-31T19:07:19.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.402+0000 7fd7dd79c700 1 -- 172.21.15.72:0/2042717861 learned_addr learned my addr 172.21.15.72:0/2042717861 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7dcf9b700 1 --2- 172.21.15.72:0/2042717861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7d8154060 0x7fd7d8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7d77fe700 1 -- 172.21.15.72:0/2042717861 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153015062 0 0) 0x7fd7d80c6120 con 0x7fd7d81588d0 2023-08-31T19:07:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7d77fe700 1 -- 172.21.15.72:0/2042717861 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7c80033f0 con 0x7fd7d81588d0 2023-08-31T19:07:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7d77fe700 1 -- 172.21.15.72:0/2042717861 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2007780144 0 0) 0x7fd7c80033f0 con 0x7fd7d81588d0 2023-08-31T19:07:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7d77fe700 1 -- 172.21.15.72:0/2042717861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7d8154060 msgr2=0x7fd7d8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7d77fe700 1 --2- 172.21.15.72:0/2042717861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7d8154060 0x7fd7d8157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7d77fe700 1 -- 172.21.15.72:0/2042717861 >> v1:172.21.15.146:6789/0 conn(0x7fd7d80cb9b0 legacy=0x7fd7d81581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7d77fe700 1 -- 172.21.15.72:0/2042717861 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d80c0ae0 con 0x7fd7d81588d0 2023-08-31T19:07:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7d77fe700 1 -- 172.21.15.72:0/2042717861 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fd7d00017f0 con 0x7fd7d81588d0 2023-08-31T19:07:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7d77fe700 1 -- 172.21.15.72:0/2042717861 >> v1:172.21.15.72:6789/0 conn(0x7fd7d81588d0 legacy=0x7fd7d8154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7d77fe700 1 --2- 172.21.15.72:0/2042717861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c8003910 0x7fd7c8003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7d77fe700 1 --2- 172.21.15.72:0/2042717861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7d8154060 0x7fd7c8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7d77fe700 1 --2- 172.21.15.72:0/2042717861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7c8004b80 0x7fd7c8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7d77fe700 1 -- 172.21.15.72:0/2042717861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80c1380 con 0x7fd7c8004b80 2023-08-31T19:07:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7d77fe700 1 -- 172.21.15.72:0/2042717861 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c800b8e0 con 0x7fd7c8003910 2023-08-31T19:07:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.403+0000 7fd7d77fe700 1 -- 172.21.15.72:0/2042717861 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c800ba50 con 0x7fd7d8154060 2023-08-31T19:07:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.404+0000 7fd7dd79c700 1 --2- 172.21.15.72:0/2042717861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7c8004b80 0x7fd7c8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.404+0000 7fd7dcf9b700 1 --2- 172.21.15.72:0/2042717861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c8003910 0x7fd7c8003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.404+0000 7fd7d7fff700 1 --2- 172.21.15.72:0/2042717861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7d8154060 0x7fd7c8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.404+0000 7fd7dd79c700 1 -- 172.21.15.72:0/2042717861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7d8154060 msgr2=0x7fd7c8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.404+0000 7fd7dd79c700 1 --2- 172.21.15.72:0/2042717861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7d8154060 0x7fd7c8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.404+0000 7fd7dd79c700 1 -- 172.21.15.72:0/2042717861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c8003910 msgr2=0x7fd7c8003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.404+0000 7fd7dd79c700 1 --2- 172.21.15.72:0/2042717861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c8003910 0x7fd7c8003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.404+0000 7fd7dd79c700 1 -- 172.21.15.72:0/2042717861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c80033f0 con 0x7fd7c8004b80 2023-08-31T19:07:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.404+0000 7fd7d7fff700 1 --2- 172.21.15.72:0/2042717861 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7d8154060 0x7fd7c8004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.404+0000 7fd7dd79c700 1 --2- 172.21.15.72:0/2042717861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7c8004b80 0x7fd7c8005000 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7fd7d80c8b90 tx=0x7fd7d0001d90).ready entity=mon.0 client_cookie=c13bccc775165d38 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.404+0000 7fd7d77fe700 1 -- 172.21.15.72:0/2042717861 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0001fc0 con 0x7fd7c8004b80 2023-08-31T19:07:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.404+0000 7fd7d77fe700 1 -- 172.21.15.72:0/2042717861 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d000ce00 con 0x7fd7c8004b80 2023-08-31T19:07:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.404+0000 7fd7d77fe700 1 -- 172.21.15.72:0/2042717861 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0005d70 con 0x7fd7c8004b80 2023-08-31T19:07:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.405+0000 7fd7df1ff700 1 -- 172.21.15.72:0/2042717861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7c8004b80 msgr2=0x7fd7c8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.405+0000 7fd7df1ff700 1 --2- 172.21.15.72:0/2042717861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7c8004b80 0x7fd7c8005000 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7fd7d80c8b90 tx=0x7fd7d0001d90).stop 2023-08-31T19:07:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.405+0000 7fd7dd79c700 1 -- 172.21.15.72:0/2042717861 reap_dead start 2023-08-31T19:07:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.405+0000 7fd7df1ff700 1 -- 172.21.15.72:0/2042717861 shutdown_connections 2023-08-31T19:07:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.405+0000 7fd7df1ff700 1 -- 172.21.15.72:0/2042717861 >> 172.21.15.72:0/2042717861 conn(0x7fd7d805e870 msgr2=0x7fd7d80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.405+0000 7fd7df1ff700 1 -- 172.21.15.72:0/2042717861 shutdown_connections 2023-08-31T19:07:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.405+0000 7fd7df1ff700 1 -- 172.21.15.72:0/2042717861 wait complete. 2023-08-31T19:07:19.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.407+0000 7fd7df1ff700 1 Processor -- start 2023-08-31T19:07:19.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.407+0000 7fd7df1ff700 1 -- start start 2023-08-31T19:07:19.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.408+0000 7fd7df1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c8004b80 0x7fd7d80b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.408+0000 7fd7df1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7d80c1e30 0x7fd7d81530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.409+0000 7fd7df1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7d81535e0 0x7fd7d814f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.409+0000 7fd7df1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80c22b0 con 0x7fd7d80c1e30 2023-08-31T19:07:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.409+0000 7fd7df1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80aaff0 con 0x7fd7c8004b80 2023-08-31T19:07:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.409+0000 7fd7df1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80c2530 con 0x7fd7d81535e0 2023-08-31T19:07:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.409+0000 7fd7d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7d80c1e30 0x7fd7d81530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.409+0000 7fd7d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7d80c1e30 0x7fd7d81530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37392/0 (socket says 172.21.15.72:37392) 2023-08-31T19:07:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.409+0000 7fd7d7fff700 1 -- 172.21.15.72:0/2058150221 learned_addr learned my addr 172.21.15.72:0/2058150221 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:19.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.409+0000 7fd7dcf9b700 1 --2- 172.21.15.72:0/2058150221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c8004b80 0x7fd7d80b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.409+0000 7fd7dd79c700 1 --2- 172.21.15.72:0/2058150221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7d81535e0 0x7fd7d814f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.409+0000 7fd7d7fff700 1 -- 172.21.15.72:0/2058150221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7d81535e0 msgr2=0x7fd7d814f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.409+0000 7fd7d7fff700 1 --2- 172.21.15.72:0/2058150221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7d81535e0 0x7fd7d814f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.409+0000 7fd7d7fff700 1 -- 172.21.15.72:0/2058150221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c8004b80 msgr2=0x7fd7d80b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.409+0000 7fd7d7fff700 1 --2- 172.21.15.72:0/2058150221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c8004b80 0x7fd7d80b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.409+0000 7fd7d7fff700 1 -- 172.21.15.72:0/2058150221 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d80c2810 con 0x7fd7d80c1e30 2023-08-31T19:07:19.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.409+0000 7fd7d7fff700 1 --2- 172.21.15.72:0/2058150221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7d80c1e30 0x7fd7d81530f0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7fd7c400e5a0 tx=0x7fd7c4009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:19.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.410+0000 7fd7d4ff9700 1 -- 172.21.15.72:0/2058150221 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4015440 con 0x7fd7d80c1e30 2023-08-31T19:07:19.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.410+0000 7fd7d4ff9700 1 -- 172.21.15.72:0/2058150221 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c4010040 con 0x7fd7d80c1e30 2023-08-31T19:07:19.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.410+0000 7fd7df1ff700 1 -- 172.21.15.72:0/2058150221 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d80c2af0 con 0x7fd7d80c1e30 2023-08-31T19:07:19.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.410+0000 7fd7d4ff9700 1 -- 172.21.15.72:0/2058150221 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c40157b0 con 0x7fd7d80c1e30 2023-08-31T19:07:19.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.410+0000 7fd7df1ff700 1 -- 172.21.15.72:0/2058150221 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d814fb90 con 0x7fd7d80c1e30 2023-08-31T19:07:19.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.411+0000 7fd7df1ff700 1 -- 172.21.15.72:0/2058150221 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d80c2d30 con 0x7fd7d80c1e30 2023-08-31T19:07:19.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.412+0000 7fd7d4ff9700 1 -- 172.21.15.72:0/2058150221 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd7c401f440 con 0x7fd7d80c1e30 2023-08-31T19:07:19.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.413+0000 7fd7d4ff9700 1 --2- 172.21.15.72:0/2058150221 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7bc05ef30 0x7fd7bc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.413+0000 7fd7d4ff9700 1 -- 172.21.15.72:0/2058150221 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5897+0+0 (secure 0 0 0) 0x7fd7c4079870 con 0x7fd7d80c1e30 2023-08-31T19:07:19.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.413+0000 7fd7dcf9b700 1 --2- 172.21.15.72:0/2058150221 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7bc05ef30 0x7fd7bc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.413+0000 7fd7dcf9b700 1 --2- 172.21.15.72:0/2058150221 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7bc05ef30 0x7fd7bc0613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd7cc006cf0 tx=0x7fd7cc006f40).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:19.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.416+0000 7fd7d4ff9700 1 -- 172.21.15.72:0/2058150221 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd7d80c2d30 con 0x7fd7d80c1e30 2023-08-31T19:07:19.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.587+0000 7fd7df1ff700 1 -- 172.21.15.72:0/2058150221 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd7d80c2d30 con 0x7fd7d80c1e30 2023-08-31T19:07:19.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.587+0000 7fd7d4ff9700 1 -- 172.21.15.72:0/2058150221 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v138) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd7d80c2d30 con 0x7fd7d80c1e30 2023-08-31T19:07:19.588 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:19.588 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:07:19.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:19.588 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-08-31T19:07:19.589 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "device_health_metrics" 2023-08-31T19:07:19.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:19.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:19.589 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-08-31T19:07:19.589 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-08-31T19:07:19.590 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:19.590 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:07:19.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.589+0000 7fd7df1ff700 1 -- 172.21.15.72:0/2058150221 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7bc05ef30 msgr2=0x7fd7bc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.589+0000 7fd7df1ff700 1 --2- 172.21.15.72:0/2058150221 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7bc05ef30 0x7fd7bc0613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd7cc006cf0 tx=0x7fd7cc006f40).stop 2023-08-31T19:07:19.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.589+0000 7fd7df1ff700 1 -- 172.21.15.72:0/2058150221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7d80c1e30 msgr2=0x7fd7d81530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.589+0000 7fd7df1ff700 1 --2- 172.21.15.72:0/2058150221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7d80c1e30 0x7fd7d81530f0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7fd7c400e5a0 tx=0x7fd7c4009040).stop 2023-08-31T19:07:19.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.589+0000 7fd7df1ff700 1 -- 172.21.15.72:0/2058150221 shutdown_connections 2023-08-31T19:07:19.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.589+0000 7fd7df1ff700 1 --2- 172.21.15.72:0/2058150221 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7d81535e0 0x7fd7d814f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.589+0000 7fd7df1ff700 1 --2- 172.21.15.72:0/2058150221 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd7bc05ef30 0x7fd7bc0613f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.589+0000 7fd7df1ff700 1 --2- 172.21.15.72:0/2058150221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7c8004b80 0x7fd7d80b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.589+0000 7fd7df1ff700 1 --2- 172.21.15.72:0/2058150221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7d80c1e30 0x7fd7d81530f0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.589+0000 7fd7df1ff700 1 -- 172.21.15.72:0/2058150221 >> 172.21.15.72:0/2058150221 conn(0x7fd7d805e870 msgr2=0x7fd7d80c64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:19.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.589+0000 7fd7df1ff700 1 -- 172.21.15.72:0/2058150221 shutdown_connections 2023-08-31T19:07:19.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.589+0000 7fd7df1ff700 1 -- 172.21.15.72:0/2058150221 wait complete. 2023-08-31T19:07:19.607 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T19:07:19.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-31T19:07:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.800+0000 7fabef3ff700 1 Processor -- start 2023-08-31T19:07:19.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.801+0000 7fabef3ff700 1 -- start start 2023-08-31T19:07:19.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.802+0000 7fabef3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fabe80c3ac0 0x7fabe8069b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.802+0000 7fabef3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe80c13e0 con 0x7fabe81377c0 2023-08-31T19:07:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.802+0000 7fabef3ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe80c19a0 con 0x7fabe81373e0 2023-08-31T19:07:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.802+0000 7fabef3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe806a1d0 con 0x7fabe80c3ac0 2023-08-31T19:07:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.802+0000 7fabed99c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fabe80c3ac0 0x7fabe8069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.802+0000 7fabec99a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fabe81377c0 0x7fabe8069460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59430/0 (socket says 172.21.15.72:59430) 2023-08-31T19:07:19.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.802+0000 7fabec99a700 1 -- 172.21.15.72:0/4176317971 learned_addr learned my addr 172.21.15.72:0/4176317971 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:19.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.803+0000 7fabed99c700 1 -- 172.21.15.72:0/4176317971 >> v1:172.21.15.146:6789/0 conn(0x7fabe81373e0 legacy=0x7fabe80c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.803+0000 7fabed99c700 1 -- 172.21.15.72:0/4176317971 >> v1:172.21.15.72:6789/0 conn(0x7fabe81377c0 legacy=0x7fabe8069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.803+0000 7fabed99c700 1 -- 172.21.15.72:0/4176317971 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe806a4b0 con 0x7fabe80c3ac0 2023-08-31T19:07:19.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.803+0000 7fabdffff700 1 -- 172.21.15.72:0/4176317971 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615875695 0 0) 0x7fabe80c13e0 con 0x7fabe81377c0 2023-08-31T19:07:19.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.803+0000 7fabed99c700 1 --2- 172.21.15.72:0/4176317971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabe80c3ac0 0x7fabe8069b70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7fabe0009e60 tx=0x7fabe0009780).ready entity=mon.0 client_cookie=fe3018d1169e37ee server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:19.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.803+0000 7fabdffff700 1 -- 172.21.15.72:0/4176317971 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe000bc30 con 0x7fabe80c3ac0 2023-08-31T19:07:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.803+0000 7fabdffff700 1 -- 172.21.15.72:0/4176317971 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe000bd90 con 0x7fabe80c3ac0 2023-08-31T19:07:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.803+0000 7fabdffff700 1 -- 172.21.15.72:0/4176317971 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0011690 con 0x7fabe80c3ac0 2023-08-31T19:07:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.804+0000 7fabef3ff700 1 -- 172.21.15.72:0/4176317971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabe80c3ac0 msgr2=0x7fabe8069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.804+0000 7fabef3ff700 1 --2- 172.21.15.72:0/4176317971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabe80c3ac0 0x7fabe8069b70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7fabe0009e60 tx=0x7fabe0009780).stop 2023-08-31T19:07:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.804+0000 7fabef3ff700 1 -- 172.21.15.72:0/4176317971 shutdown_connections 2023-08-31T19:07:19.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.804+0000 7fabef3ff700 1 --2- 172.21.15.72:0/4176317971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabe80c3ac0 0x7fabe8069b70 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.804+0000 7fabef3ff700 1 -- 172.21.15.72:0/4176317971 >> 172.21.15.72:0/4176317971 conn(0x7fabe8062650 msgr2=0x7fabe8062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:19.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.804+0000 7fabef3ff700 1 -- 172.21.15.72:0/4176317971 shutdown_connections 2023-08-31T19:07:19.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.804+0000 7fabef3ff700 1 -- 172.21.15.72:0/4176317971 wait complete. 2023-08-31T19:07:19.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.805+0000 7fabef3ff700 1 Processor -- start 2023-08-31T19:07:19.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.805+0000 7fabef3ff700 1 -- start start 2023-08-31T19:07:19.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.806+0000 7fabef3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabe80c3ac0 0x7fabe80c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.806+0000 7fabef3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabe81373e0 0x7fabe80c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.806+0000 7fabef3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabe81377c0 0x7fabe80c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.806+0000 7fabef3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80c6c80 con 0x7fabe81373e0 2023-08-31T19:07:19.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.806+0000 7fabef3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80c5e10 con 0x7fabe80c3ac0 2023-08-31T19:07:19.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.806+0000 7fabef3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80c0990 con 0x7fabe81377c0 2023-08-31T19:07:19.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabec99a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabe81373e0 0x7fabe80c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabec99a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabe81373e0 0x7fabe80c5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37410/0 (socket says 172.21.15.72:37410) 2023-08-31T19:07:19.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabec99a700 1 -- 172.21.15.72:0/4293031497 learned_addr learned my addr 172.21.15.72:0/4293031497 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:19.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabed19b700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabe80c3ac0 0x7fabe80c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabed99c700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabe81377c0 0x7fabe80c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabec99a700 1 -- 172.21.15.72:0/4293031497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabe81377c0 msgr2=0x7fabe80c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabec99a700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabe81377c0 0x7fabe80c04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabec99a700 1 -- 172.21.15.72:0/4293031497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabe80c3ac0 msgr2=0x7fabe80c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabec99a700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabe80c3ac0 0x7fabe80c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabec99a700 1 -- 172.21.15.72:0/4293031497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe0009a20 con 0x7fabe81373e0 2023-08-31T19:07:19.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabed99c700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabe81377c0 0x7fabe80c04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:19.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabed19b700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabe80c3ac0 0x7fabe80c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabec99a700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabe81373e0 0x7fabe80c5920 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fabd800c460 tx=0x7fabd8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabdd7fa700 1 -- 172.21.15.72:0/4293031497 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80072e0 con 0x7fabe81373e0 2023-08-31T19:07:19.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabdd7fa700 1 -- 172.21.15.72:0/4293031497 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd8007440 con 0x7fabe81373e0 2023-08-31T19:07:19.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabef3ff700 1 -- 172.21.15.72:0/4293031497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe80c6070 con 0x7fabe81373e0 2023-08-31T19:07:19.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.807+0000 7fabdd7fa700 1 -- 172.21.15.72:0/4293031497 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80057a0 con 0x7fabe81373e0 2023-08-31T19:07:19.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.808+0000 7fabef3ff700 1 -- 172.21.15.72:0/4293031497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe80c6630 con 0x7fabe81373e0 2023-08-31T19:07:19.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.809+0000 7fabef3ff700 1 -- 172.21.15.72:0/4293031497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe806c6b0 con 0x7fabe81373e0 2023-08-31T19:07:19.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.809+0000 7fabdd7fa700 1 -- 172.21.15.72:0/4293031497 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fabd8005b90 con 0x7fabe81373e0 2023-08-31T19:07:19.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.811+0000 7fabdd7fa700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fabcc05ef30 0x7fabcc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:19.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.811+0000 7fabdd7fa700 1 -- 172.21.15.72:0/4293031497 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5897+0+0 (secure 0 0 0) 0x7fabd8079740 con 0x7fabe81373e0 2023-08-31T19:07:19.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.811+0000 7fabed19b700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fabcc05ef30 0x7fabcc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:19.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.812+0000 7fabed19b700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fabcc05ef30 0x7fabcc0613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fabe4001710 tx=0x7fabe4009040).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:19.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.815+0000 7fabdd7fa700 1 -- 172.21.15.72:0/4293031497 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fabd804ab10 con 0x7fabe81373e0 2023-08-31T19:07:19.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:19.985+0000 7fabef3ff700 1 -- 172.21.15.72:0/4293031497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fabe80c6dc0 con 0x7fabe81373e0 2023-08-31T19:07:20.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.136+0000 7fabdd7fa700 1 -- 172.21.15.72:0/4293031497 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v139) v1 ==== 152+0+0 (secure 0 0 0) 0x7fabd8018020 con 0x7fabe81373e0 2023-08-31T19:07:20.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.139+0000 7fabef3ff700 1 -- 172.21.15.72:0/4293031497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fabcc05ef30 msgr2=0x7fabcc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:20.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.139+0000 7fabef3ff700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fabcc05ef30 0x7fabcc0613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fabe4001710 tx=0x7fabe4009040).stop 2023-08-31T19:07:20.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.139+0000 7fabef3ff700 1 -- 172.21.15.72:0/4293031497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabe81373e0 msgr2=0x7fabe80c5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:20.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.139+0000 7fabef3ff700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabe81373e0 0x7fabe80c5920 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fabd800c460 tx=0x7fabd8007e10).stop 2023-08-31T19:07:20.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.139+0000 7fabef3ff700 1 -- 172.21.15.72:0/4293031497 shutdown_connections 2023-08-31T19:07:20.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.139+0000 7fabef3ff700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fabe81377c0 0x7fabe80c04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:20.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.139+0000 7fabef3ff700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fabcc05ef30 0x7fabcc0613f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:20.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.139+0000 7fabef3ff700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fabe80c3ac0 0x7fabe80c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:20.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.139+0000 7fabef3ff700 1 --2- 172.21.15.72:0/4293031497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabe81373e0 0x7fabe80c5920 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:20.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.139+0000 7fabef3ff700 1 -- 172.21.15.72:0/4293031497 >> 172.21.15.72:0/4293031497 conn(0x7fabe8062650 msgr2=0x7fabe8151810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:20.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.139+0000 7fabef3ff700 1 -- 172.21.15.72:0/4293031497 shutdown_connections 2023-08-31T19:07:20.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.140+0000 7fabef3ff700 1 -- 172.21.15.72:0/4293031497 wait complete. 2023-08-31T19:07:20.142 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-08-31T19:07:20.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T19:07:20.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.358+0000 7f49bf3ff700 1 Processor -- start 2023-08-31T19:07:20.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.358+0000 7f49bf3ff700 1 -- start start 2023-08-31T19:07:20.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.359+0000 7f49bf3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49b80c38d0 0x7f49b805e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:20.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.359+0000 7f49bf3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b80bc4a0 con 0x7f49b81544e0 2023-08-31T19:07:20.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.359+0000 7f49bf3ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b8069c40 con 0x7f49b80690e0 2023-08-31T19:07:20.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.359+0000 7f49bf3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b805e840 con 0x7f49b80c38d0 2023-08-31T19:07:20.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49bd19b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f49b81544e0 0x7f49b80689d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59444/0 (socket says 172.21.15.72:59444) 2023-08-31T19:07:20.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49bd19b700 1 -- 172.21.15.72:0/145377426 learned_addr learned my addr 172.21.15.72:0/145377426 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:20.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49bd99c700 1 --2- 172.21.15.72:0/145377426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49b80c38d0 0x7f49b805e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:20.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292432340 0 0) 0x7f49b80bc4a0 con 0x7f49b81544e0 2023-08-31T19:07:20.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49a40033f0 con 0x7f49b81544e0 2023-08-31T19:07:20.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546040112 0 0) 0x7f49b8069c40 con 0x7f49b80690e0 2023-08-31T19:07:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49b80bc4a0 con 0x7f49b80690e0 2023-08-31T19:07:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1650342876 0 0) 0x7f49a40033f0 con 0x7f49b81544e0 2023-08-31T19:07:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49b80c38d0 msgr2=0x7f49b805e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:20.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49affff700 1 --2- 172.21.15.72:0/145377426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49b80c38d0 0x7f49b805e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 >> v1:172.21.15.146:6789/0 conn(0x7f49b80690e0 legacy=0x7f49b80bc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b80c1c30 con 0x7f49b81544e0 2023-08-31T19:07:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f49b4001470 con 0x7f49b81544e0 2023-08-31T19:07:20.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 >> v1:172.21.15.72:6789/0 conn(0x7f49b81544e0 legacy=0x7f49b80689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:20.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49affff700 1 --2- 172.21.15.72:0/145377426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49a4003aa0 0x7f49a4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:20.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49affff700 1 --2- 172.21.15.72:0/145377426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49b80c38d0 0x7f49a4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:20.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49affff700 1 --2- 172.21.15.72:0/145377426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4004b80 0x7f49a4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:20.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.360+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a400b990 con 0x7f49a4004b80 2023-08-31T19:07:20.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.361+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a400bad0 con 0x7f49a4003aa0 2023-08-31T19:07:20.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.361+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a400bc90 con 0x7f49b80c38d0 2023-08-31T19:07:20.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.361+0000 7f49bd99c700 1 --2- 172.21.15.72:0/145377426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4004b80 0x7f49a4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:20.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.361+0000 7f49bd19b700 1 --2- 172.21.15.72:0/145377426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49a4003aa0 0x7f49a4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:20.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.361+0000 7f49bc99a700 1 --2- 172.21.15.72:0/145377426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49b80c38d0 0x7f49a4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:20.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.361+0000 7f49bd99c700 1 -- 172.21.15.72:0/145377426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49b80c38d0 msgr2=0x7f49a4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:20.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.361+0000 7f49bd99c700 1 --2- 172.21.15.72:0/145377426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49b80c38d0 0x7f49a4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:20.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.361+0000 7f49bd99c700 1 -- 172.21.15.72:0/145377426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49a4003aa0 msgr2=0x7f49a4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:20.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.361+0000 7f49bd99c700 1 --2- 172.21.15.72:0/145377426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49a4003aa0 0x7f49a4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:20.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.361+0000 7f49bd99c700 1 -- 172.21.15.72:0/145377426 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a40033f0 con 0x7f49a4004b80 2023-08-31T19:07:20.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.361+0000 7f49bd99c700 1 --2- 172.21.15.72:0/145377426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4004b80 0x7f49a4005000 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f49b80c3d00 tx=0x7f49b000b040).ready entity=mon.0 client_cookie=48dd94bc732ac554 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:20.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.362+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b0009ac0 con 0x7f49a4004b80 2023-08-31T19:07:20.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.362+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b000f040 con 0x7f49a4004b80 2023-08-31T19:07:20.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.362+0000 7f49affff700 1 -- 172.21.15.72:0/145377426 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b000eca0 con 0x7f49a4004b80 2023-08-31T19:07:20.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.362+0000 7f49bf3ff700 1 -- 172.21.15.72:0/145377426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4004b80 msgr2=0x7f49a4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:20.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.362+0000 7f49bf3ff700 1 --2- 172.21.15.72:0/145377426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4004b80 0x7f49a4005000 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f49b80c3d00 tx=0x7f49b000b040).stop 2023-08-31T19:07:20.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.362+0000 7f49bd99c700 1 -- 172.21.15.72:0/145377426 reap_dead start 2023-08-31T19:07:20.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.362+0000 7f49bf3ff700 1 -- 172.21.15.72:0/145377426 shutdown_connections 2023-08-31T19:07:20.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.362+0000 7f49bf3ff700 1 -- 172.21.15.72:0/145377426 >> 172.21.15.72:0/145377426 conn(0x7f49b80c7e00 msgr2=0x7f49b80c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:20.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.362+0000 7f49bf3ff700 1 -- 172.21.15.72:0/145377426 shutdown_connections 2023-08-31T19:07:20.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.362+0000 7f49bf3ff700 1 -- 172.21.15.72:0/145377426 wait complete. 2023-08-31T19:07:20.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.364+0000 7f49bf3ff700 1 Processor -- start 2023-08-31T19:07:20.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.364+0000 7f49bf3ff700 1 -- start start 2023-08-31T19:07:20.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bf3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4004b80 0x7f49b8164c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:20.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bf3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49b8156230 0x7f49b8163770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:20.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bf3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49b8163c60 0x7f49b8152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:20.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bf3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b8156a40 con 0x7f49a4004b80 2023-08-31T19:07:20.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bf3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b81557b0 con 0x7f49b8163c60 2023-08-31T19:07:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bf3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b81549f0 con 0x7f49b8156230 2023-08-31T19:07:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bd19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4004b80 0x7f49b8164c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bd19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4004b80 0x7f49b8164c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37428/0 (socket says 172.21.15.72:37428) 2023-08-31T19:07:20.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bd19b700 1 -- 172.21.15.72:0/2746594371 learned_addr learned my addr 172.21.15.72:0/2746594371 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:20.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bd99c700 1 --2- 172.21.15.72:0/2746594371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49b8163c60 0x7f49b8152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:20.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bc99a700 1 --2- 172.21.15.72:0/2746594371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49b8156230 0x7f49b8163770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:20.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bd19b700 1 -- 172.21.15.72:0/2746594371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49b8156230 msgr2=0x7f49b8163770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:20.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bd19b700 1 --2- 172.21.15.72:0/2746594371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49b8156230 0x7f49b8163770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:20.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bd19b700 1 -- 172.21.15.72:0/2746594371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49b8163c60 msgr2=0x7f49b8152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:20.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bd19b700 1 --2- 172.21.15.72:0/2746594371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49b8163c60 0x7f49b8152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:20.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.365+0000 7f49bd19b700 1 -- 172.21.15.72:0/2746594371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b8154cd0 con 0x7f49a4004b80 2023-08-31T19:07:20.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.366+0000 7f49bd19b700 1 --2- 172.21.15.72:0/2746594371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4004b80 0x7f49b8164c80 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f49b4004a10 tx=0x7f49b4001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.366+0000 7f49ad7fa700 1 -- 172.21.15.72:0/2746594371 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4001030 con 0x7f49a4004b80 2023-08-31T19:07:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.366+0000 7f49ad7fa700 1 -- 172.21.15.72:0/2746594371 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b400f8d0 con 0x7f49a4004b80 2023-08-31T19:07:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.366+0000 7f49bf3ff700 1 -- 172.21.15.72:0/2746594371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b8154fb0 con 0x7f49a4004b80 2023-08-31T19:07:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.366+0000 7f49ad7fa700 1 -- 172.21.15.72:0/2746594371 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b400fc50 con 0x7f49a4004b80 2023-08-31T19:07:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.366+0000 7f49bf3ff700 1 -- 172.21.15.72:0/2746594371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b81566b0 con 0x7f49a4004b80 2023-08-31T19:07:20.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.367+0000 7f49bf3ff700 1 -- 172.21.15.72:0/2746594371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b8157ee0 con 0x7f49a4004b80 2023-08-31T19:07:20.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.368+0000 7f49ad7fa700 1 -- 172.21.15.72:0/2746594371 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f49b4015410 con 0x7f49a4004b80 2023-08-31T19:07:20.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.369+0000 7f49ad7fa700 1 --2- 172.21.15.72:0/2746594371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f499c05ef30 0x7f499c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.369+0000 7f49ad7fa700 1 -- 172.21.15.72:0/2746594371 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6267+0+0 (secure 0 0 0) 0x7f49b407a470 con 0x7f49a4004b80 2023-08-31T19:07:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.369+0000 7f49bc99a700 1 --2- 172.21.15.72:0/2746594371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f499c05ef30 0x7f499c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.370+0000 7f49bc99a700 1 --2- 172.21.15.72:0/2746594371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f499c05ef30 0x7f499c0613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f49a8007fd0 tx=0x7f49a8009040).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.373+0000 7f49ad7fa700 1 -- 172.21.15.72:0/2746594371 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f49b404b5b0 con 0x7f49a4004b80 2023-08-31T19:07:20.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:20.543+0000 7f49bf3ff700 1 -- 172.21.15.72:0/2746594371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f49b8065960 con 0x7f49a4004b80 2023-08-31T19:07:21.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.141+0000 7f49ad7fa700 1 -- 172.21.15.72:0/2746594371 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v140) v1 ==== 170+0+0 (secure 0 0 0) 0x7f49b404ebd0 con 0x7f49a4004b80 2023-08-31T19:07:21.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.147+0000 7f49bf3ff700 1 -- 172.21.15.72:0/2746594371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f499c05ef30 msgr2=0x7f499c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:21.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.147+0000 7f49bf3ff700 1 --2- 172.21.15.72:0/2746594371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f499c05ef30 0x7f499c0613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f49a8007fd0 tx=0x7f49a8009040).stop 2023-08-31T19:07:21.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.147+0000 7f49bf3ff700 1 -- 172.21.15.72:0/2746594371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4004b80 msgr2=0x7f49b8164c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:21.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.147+0000 7f49bf3ff700 1 --2- 172.21.15.72:0/2746594371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4004b80 0x7f49b8164c80 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f49b4004a10 tx=0x7f49b4001e10).stop 2023-08-31T19:07:21.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.149+0000 7f49bf3ff700 1 -- 172.21.15.72:0/2746594371 shutdown_connections 2023-08-31T19:07:21.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.149+0000 7f49bf3ff700 1 --2- 172.21.15.72:0/2746594371 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f499c05ef30 0x7f499c0613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.149+0000 7f49bf3ff700 1 --2- 172.21.15.72:0/2746594371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49b8163c60 0x7f49b8152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.149+0000 7f49bf3ff700 1 --2- 172.21.15.72:0/2746594371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4004b80 0x7f49b8164c80 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.149+0000 7f49bf3ff700 1 --2- 172.21.15.72:0/2746594371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f49b8156230 0x7f49b8163770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.149+0000 7f49bf3ff700 1 -- 172.21.15.72:0/2746594371 >> 172.21.15.72:0/2746594371 conn(0x7f49b80c7e00 msgr2=0x7f49b80bc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:21.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.153+0000 7f49bf3ff700 1 -- 172.21.15.72:0/2746594371 shutdown_connections 2023-08-31T19:07:21.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.153+0000 7f49bf3ff700 1 -- 172.21.15.72:0/2746594371 wait complete. 2023-08-31T19:07:21.157 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-08-31T19:07:21.184 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T19:07:21.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.377+0000 7fe2319ff700 1 Processor -- start 2023-08-31T19:07:21.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.377+0000 7fe2319ff700 1 -- start start 2023-08-31T19:07:21.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.378+0000 7fe2319ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe22c154030 0x7fe22c154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:21.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.379+0000 7fe2319ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe22c0c06b0 0x7fe22c0c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:21.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.379+0000 7fe2319ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c0c6ed0 con 0x7fe22c0aa140 2023-08-31T19:07:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.379+0000 7fe2319ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22c0c66e0 con 0x7fe22c154030 2023-08-31T19:07:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.379+0000 7fe2319ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0c68c0 con 0x7fe22c0c06b0 2023-08-31T19:07:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.379+0000 7fe22b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe22c0aa140 0x7fe22c063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59446/0 (socket says 172.21.15.72:59446) 2023-08-31T19:07:21.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.379+0000 7fe22b7fe700 1 -- 172.21.15.72:0/3329155306 learned_addr learned my addr 172.21.15.72:0/3329155306 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:21.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.379+0000 7fe22affd700 1 --2- 172.21.15.72:0/3329155306 >> v2:172.21.15.146:3300/0 conn(0x7fe22c154030 0x7fe22c154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:21.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.379+0000 7fe22a7fc700 1 --2- 172.21.15.72:0/3329155306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe22c0c06b0 0x7fe22c0c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:21.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.379+0000 7fe229ffb700 1 -- 172.21.15.72:0/3329155306 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739510208 0 0) 0x7fe22c0c6ed0 con 0x7fe22c0aa140 2023-08-31T19:07:21.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.379+0000 7fe229ffb700 1 -- 172.21.15.72:0/3329155306 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2140033f0 con 0x7fe22c0aa140 2023-08-31T19:07:21.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe229ffb700 1 -- 172.21.15.72:0/3329155306 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2329343830 0 0) 0x7fe2140033f0 con 0x7fe22c0aa140 2023-08-31T19:07:21.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe229ffb700 1 -- 172.21.15.72:0/3329155306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe22c0c06b0 msgr2=0x7fe22c0c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:21.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe229ffb700 1 --2- 172.21.15.72:0/3329155306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe22c0c06b0 0x7fe22c0c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe229ffb700 1 -- 172.21.15.72:0/3329155306 >> v2:172.21.15.146:3300/0 conn(0x7fe22c154030 msgr2=0x7fe22c154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe229ffb700 1 --2- 172.21.15.72:0/3329155306 >> v2:172.21.15.146:3300/0 conn(0x7fe22c154030 0x7fe22c154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe229ffb700 1 -- 172.21.15.72:0/3329155306 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c0c0f30 con 0x7fe22c0aa140 2023-08-31T19:07:21.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe229ffb700 1 -- 172.21.15.72:0/3329155306 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fe2240017f0 con 0x7fe22c0aa140 2023-08-31T19:07:21.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe229ffb700 1 -- 172.21.15.72:0/3329155306 >> v1:172.21.15.72:6789/0 conn(0x7fe22c0aa140 legacy=0x7fe22c063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:21.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe229ffb700 1 --2- 172.21.15.72:0/3329155306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe22c0c06b0 0x7fe2140038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:21.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe229ffb700 1 --2- 172.21.15.72:0/3329155306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe214003e10 0x7fe214004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:21.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe229ffb700 1 --2- 172.21.15.72:0/3329155306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe214004b80 0x7fe214005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:21.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe229ffb700 1 -- 172.21.15.72:0/3329155306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0c66e0 con 0x7fe214004b80 2023-08-31T19:07:21.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe229ffb700 1 -- 172.21.15.72:0/3329155306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0c68c0 con 0x7fe214003e10 2023-08-31T19:07:21.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe229ffb700 1 -- 172.21.15.72:0/3329155306 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21400b8e0 con 0x7fe22c0c06b0 2023-08-31T19:07:21.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe22b7fe700 1 --2- 172.21.15.72:0/3329155306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe214004b80 0x7fe214005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe22a7fc700 1 --2- 172.21.15.72:0/3329155306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe214003e10 0x7fe214004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe22affd700 1 --2- 172.21.15.72:0/3329155306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe22c0c06b0 0x7fe2140038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe22b7fe700 1 -- 172.21.15.72:0/3329155306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe22c0c06b0 msgr2=0x7fe2140038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe22b7fe700 1 --2- 172.21.15.72:0/3329155306 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe22c0c06b0 0x7fe2140038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe22b7fe700 1 -- 172.21.15.72:0/3329155306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe214003e10 msgr2=0x7fe214004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:21.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe22b7fe700 1 --2- 172.21.15.72:0/3329155306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe214003e10 0x7fe214004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.380+0000 7fe22b7fe700 1 -- 172.21.15.72:0/3329155306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2140033f0 con 0x7fe214004b80 2023-08-31T19:07:21.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.381+0000 7fe22b7fe700 1 --2- 172.21.15.72:0/3329155306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe214004b80 0x7fe214005000 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7fe22400c560 tx=0x7fe224002210).ready entity=mon.0 client_cookie=6a0dd9fbbe8e6a3a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:21.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.381+0000 7fe229ffb700 1 -- 172.21.15.72:0/3329155306 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224007de0 con 0x7fe214004b80 2023-08-31T19:07:21.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.381+0000 7fe229ffb700 1 -- 172.21.15.72:0/3329155306 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22400ce50 con 0x7fe214004b80 2023-08-31T19:07:21.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.381+0000 7fe229ffb700 1 -- 172.21.15.72:0/3329155306 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe224005d50 con 0x7fe214004b80 2023-08-31T19:07:21.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.381+0000 7fe2319ff700 1 -- 172.21.15.72:0/3329155306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe214004b80 msgr2=0x7fe214005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:21.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.381+0000 7fe2319ff700 1 --2- 172.21.15.72:0/3329155306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe214004b80 0x7fe214005000 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7fe22400c560 tx=0x7fe224002210).stop 2023-08-31T19:07:21.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.381+0000 7fe22b7fe700 1 -- 172.21.15.72:0/3329155306 reap_dead start 2023-08-31T19:07:21.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.382+0000 7fe2319ff700 1 -- 172.21.15.72:0/3329155306 shutdown_connections 2023-08-31T19:07:21.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.382+0000 7fe2319ff700 1 -- 172.21.15.72:0/3329155306 >> 172.21.15.72:0/3329155306 conn(0x7fe22c05eb60 msgr2=0x7fe22c0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:21.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.382+0000 7fe2319ff700 1 -- 172.21.15.72:0/3329155306 shutdown_connections 2023-08-31T19:07:21.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.382+0000 7fe2319ff700 1 -- 172.21.15.72:0/3329155306 wait complete. 2023-08-31T19:07:21.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.383+0000 7fe2319ff700 1 Processor -- start 2023-08-31T19:07:21.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.383+0000 7fe2319ff700 1 -- start start 2023-08-31T19:07:21.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.384+0000 7fe2319ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe214004b80 0x7fe22c133880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.384+0000 7fe2319ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe22c157790 0x7fe22c157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.384+0000 7fe2319ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe22c139a70 0x7fe22c139ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.384+0000 7fe2319ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c156c70 con 0x7fe214004b80 2023-08-31T19:07:21.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.384+0000 7fe2319ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c13a3c0 con 0x7fe22c139a70 2023-08-31T19:07:21.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.384+0000 7fe2319ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0c8bf0 con 0x7fe22c157790 2023-08-31T19:07:21.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.384+0000 7fe22affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe214004b80 0x7fe22c133880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:21.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe22affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe214004b80 0x7fe22c133880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37446/0 (socket says 172.21.15.72:37446) 2023-08-31T19:07:21.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe22affd700 1 -- 172.21.15.72:0/774422267 learned_addr learned my addr 172.21.15.72:0/774422267 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:21.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe22a7fc700 1 --2- 172.21.15.72:0/774422267 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe22c157790 0x7fe22c157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:21.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe22b7fe700 1 --2- 172.21.15.72:0/774422267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe22c139a70 0x7fe22c139ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:21.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe22affd700 1 -- 172.21.15.72:0/774422267 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe22c157790 msgr2=0x7fe22c157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:21.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe22affd700 1 --2- 172.21.15.72:0/774422267 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe22c157790 0x7fe22c157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe22affd700 1 -- 172.21.15.72:0/774422267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe22c139a70 msgr2=0x7fe22c139ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:21.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe22affd700 1 --2- 172.21.15.72:0/774422267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe22c139a70 0x7fe22c139ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe22affd700 1 -- 172.21.15.72:0/774422267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c0c8ed0 con 0x7fe214004b80 2023-08-31T19:07:21.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe22b7fe700 1 --2- 172.21.15.72:0/774422267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe22c139a70 0x7fe22c139ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:21.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe22affd700 1 --2- 172.21.15.72:0/774422267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe214004b80 0x7fe22c133880 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7fe21c0119c0 tx=0x7fe21c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:21.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe212ffd700 1 -- 172.21.15.72:0/774422267 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c011e50 con 0x7fe214004b80 2023-08-31T19:07:21.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe212ffd700 1 -- 172.21.15.72:0/774422267 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c00f940 con 0x7fe214004b80 2023-08-31T19:07:21.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe212ffd700 1 -- 172.21.15.72:0/774422267 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00fcc0 con 0x7fe214004b80 2023-08-31T19:07:21.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe2319ff700 1 -- 172.21.15.72:0/774422267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c0c91b0 con 0x7fe214004b80 2023-08-31T19:07:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.385+0000 7fe2319ff700 1 -- 172.21.15.72:0/774422267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c0c9770 con 0x7fe214004b80 2023-08-31T19:07:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.386+0000 7fe2319ff700 1 -- 172.21.15.72:0/774422267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c06c6b0 con 0x7fe214004b80 2023-08-31T19:07:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.388+0000 7fe212ffd700 1 -- 172.21.15.72:0/774422267 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe21c014650 con 0x7fe214004b80 2023-08-31T19:07:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.388+0000 7fe212ffd700 1 --2- 172.21.15.72:0/774422267 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe21805ef30 0x7fe2180613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:21.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.389+0000 7fe212ffd700 1 -- 172.21.15.72:0/774422267 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6649+0+0 (secure 0 0 0) 0x7fe21c07b220 con 0x7fe214004b80 2023-08-31T19:07:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.389+0000 7fe22a7fc700 1 --2- 172.21.15.72:0/774422267 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe21805ef30 0x7fe2180613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.389+0000 7fe22a7fc700 1 --2- 172.21.15.72:0/774422267 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe21805ef30 0x7fe2180613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe220006d80 tx=0x7fe220009060).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:21.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.392+0000 7fe212ffd700 1 -- 172.21.15.72:0/774422267 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe21c04c3c0 con 0x7fe214004b80 2023-08-31T19:07:21.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.606+0000 7fe2319ff700 1 -- 172.21.15.72:0/774422267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe22c0c0c50 con 0x7fe214004b80 2023-08-31T19:07:21.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.615+0000 7fe212ffd700 1 -- 172.21.15.72:0/774422267 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v60) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe21c04f9e0 con 0x7fe214004b80 2023-08-31T19:07:21.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.622+0000 7fe2319ff700 1 -- 172.21.15.72:0/774422267 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe21805ef30 msgr2=0x7fe2180613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:21.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.622+0000 7fe2319ff700 1 --2- 172.21.15.72:0/774422267 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe21805ef30 0x7fe2180613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe220006d80 tx=0x7fe220009060).stop 2023-08-31T19:07:21.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.622+0000 7fe2319ff700 1 -- 172.21.15.72:0/774422267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe214004b80 msgr2=0x7fe22c133880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:21.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.622+0000 7fe2319ff700 1 --2- 172.21.15.72:0/774422267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe214004b80 0x7fe22c133880 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7fe21c0119c0 tx=0x7fe21c009060).stop 2023-08-31T19:07:21.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.623+0000 7fe2319ff700 1 -- 172.21.15.72:0/774422267 shutdown_connections 2023-08-31T19:07:21.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.623+0000 7fe2319ff700 1 --2- 172.21.15.72:0/774422267 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe21805ef30 0x7fe2180613f0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0x7fe220006d80 tx=0x7fe220009060).stop 2023-08-31T19:07:21.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.623+0000 7fe2319ff700 1 --2- 172.21.15.72:0/774422267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe22c139a70 0x7fe22c139ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.623+0000 7fe2319ff700 1 --2- 172.21.15.72:0/774422267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe214004b80 0x7fe22c133880 secure :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0x7fe21c0119c0 tx=0x7fe21c009060).stop 2023-08-31T19:07:21.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.623+0000 7fe2319ff700 1 --2- 172.21.15.72:0/774422267 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe22c157790 0x7fe22c157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.623+0000 7fe2319ff700 1 -- 172.21.15.72:0/774422267 >> 172.21.15.72:0/774422267 conn(0x7fe22c05eb60 msgr2=0x7fe22c064c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:21.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.625+0000 7fe2319ff700 1 -- 172.21.15.72:0/774422267 shutdown_connections 2023-08-31T19:07:21.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.627+0000 7fe2319ff700 1 -- 172.21.15.72:0/774422267 wait complete. 2023-08-31T19:07:21.635 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 17 and data pool 18 2023-08-31T19:07:21.657 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:07:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.846+0000 7f9742fff700 1 Processor -- start 2023-08-31T19:07:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.846+0000 7f9742fff700 1 -- start start 2023-08-31T19:07:21.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.848+0000 7f9742fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973c0c6c30 0x7f973c0bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:21.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.848+0000 7f9742fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f973c1583f0 0x7f973c0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:21.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.848+0000 7f9742fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c063be0 con 0x7f973c0c4740 2023-08-31T19:07:21.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.848+0000 7f9742fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973c063010 con 0x7f973c1583f0 2023-08-31T19:07:21.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.848+0000 7f9742fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0632b0 con 0x7f973c0c6c30 2023-08-31T19:07:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.848+0000 7f9740d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973c0c6c30 0x7f973c0bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:21.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.848+0000 7f974159c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f973c1583f0 0x7f973c0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:21.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.848+0000 7f9740d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973c0c6c30 0x7f973c0bc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:36026/0 (socket says 172.21.15.72:36026) 2023-08-31T19:07:21.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.848+0000 7f9740d9b700 1 -- 172.21.15.72:0/2298837335 learned_addr learned my addr 172.21.15.72:0/2298837335 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:21.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.849+0000 7f9740d9b700 1 -- 172.21.15.72:0/2298837335 >> v2:172.21.15.146:3300/0 conn(0x7f973c1583f0 msgr2=0x7f973c0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:21.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.849+0000 7f9740d9b700 1 --2- 172.21.15.72:0/2298837335 >> v2:172.21.15.146:3300/0 conn(0x7f973c1583f0 0x7f973c0c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.849+0000 7f9740d9b700 1 -- 172.21.15.72:0/2298837335 >> v1:172.21.15.146:6789/0 conn(0x7f973c0c4740 legacy=0x7f973c157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:21.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.849+0000 7f9740d9b700 1 -- 172.21.15.72:0/2298837335 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c063590 con 0x7f973c0c6c30 2023-08-31T19:07:21.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.849+0000 7f974159c700 1 --2- 172.21.15.72:0/2298837335 >> v2:172.21.15.146:3300/0 conn(0x7f973c1583f0 0x7f973c0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:07:21.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.849+0000 7f9740d9b700 1 --2- 172.21.15.72:0/2298837335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973c0c6c30 0x7f973c0bc300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f9730006fd0 tx=0x7f97300090f0).ready entity=mon.2 client_cookie=5ab7f6165c1bc81 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:21.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.849+0000 7f973b7fe700 1 -- 172.21.15.72:0/2298837335 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973000b580 con 0x7f973c0c6c30 2023-08-31T19:07:21.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.849+0000 7f973b7fe700 1 -- 172.21.15.72:0/2298837335 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973000b6e0 con 0x7f973c0c6c30 2023-08-31T19:07:21.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.849+0000 7f973b7fe700 1 -- 172.21.15.72:0/2298837335 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973000ba60 con 0x7f973c0c6c30 2023-08-31T19:07:21.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.850+0000 7f9742fff700 1 -- 172.21.15.72:0/2298837335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973c0c6c30 msgr2=0x7f973c0bc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:21.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.850+0000 7f9742fff700 1 --2- 172.21.15.72:0/2298837335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973c0c6c30 0x7f973c0bc300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f9730006fd0 tx=0x7f97300090f0).stop 2023-08-31T19:07:21.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.850+0000 7f9742fff700 1 -- 172.21.15.72:0/2298837335 shutdown_connections 2023-08-31T19:07:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.850+0000 7f9742fff700 1 --2- 172.21.15.72:0/2298837335 >> v2:172.21.15.146:3300/0 conn(0x7f973c1583f0 0x7f973c0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.850+0000 7f9742fff700 1 --2- 172.21.15.72:0/2298837335 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973c0c6c30 0x7f973c0bc300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.850+0000 7f9742fff700 1 -- 172.21.15.72:0/2298837335 >> 172.21.15.72:0/2298837335 conn(0x7f973c0c7e70 msgr2=0x7f973c0c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.850+0000 7f9742fff700 1 -- 172.21.15.72:0/2298837335 shutdown_connections 2023-08-31T19:07:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.850+0000 7f9742fff700 1 -- 172.21.15.72:0/2298837335 wait complete. 2023-08-31T19:07:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.851+0000 7f9742fff700 1 Processor -- start 2023-08-31T19:07:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.852+0000 7f9742fff700 1 -- start start 2023-08-31T19:07:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.852+0000 7f9742fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973c0c4740 0x7f973c0a7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f9742fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973c0c6c30 0x7f973c1523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f9742fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f973c1583f0 0x7f973c1528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f9742fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c152db0 con 0x7f973c1583f0 2023-08-31T19:07:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f9742fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c167ae0 con 0x7f973c0c4740 2023-08-31T19:07:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f9742fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c167dc0 con 0x7f973c0c6c30 2023-08-31T19:07:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f974159c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f973c1583f0 0x7f973c1528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:21.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f974159c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f973c1583f0 0x7f973c1528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37456/0 (socket says 172.21.15.72:37456) 2023-08-31T19:07:21.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f974159c700 1 -- 172.21.15.72:0/1306039485 learned_addr learned my addr 172.21.15.72:0/1306039485 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:21.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f9740d9b700 1 --2- 172.21.15.72:0/1306039485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973c0c4740 0x7f973c0a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:21.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f973bfff700 1 --2- 172.21.15.72:0/1306039485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973c0c6c30 0x7f973c1523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:21.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f974159c700 1 -- 172.21.15.72:0/1306039485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973c0c6c30 msgr2=0x7f973c1523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:21.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f974159c700 1 --2- 172.21.15.72:0/1306039485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973c0c6c30 0x7f973c1523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f974159c700 1 -- 172.21.15.72:0/1306039485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973c0c4740 msgr2=0x7f973c0a7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:21.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f974159c700 1 --2- 172.21.15.72:0/1306039485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973c0c4740 0x7f973c0a7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:21.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f974159c700 1 -- 172.21.15.72:0/1306039485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9734009a20 con 0x7f973c1583f0 2023-08-31T19:07:21.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f973bfff700 1 --2- 172.21.15.72:0/1306039485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973c0c6c30 0x7f973c1523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:21.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.853+0000 7f974159c700 1 --2- 172.21.15.72:0/1306039485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f973c1583f0 0x7f973c1528c0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f9734009fc0 tx=0x7f973400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:21.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.854+0000 7f9738ff9700 1 -- 172.21.15.72:0/1306039485 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973400cc80 con 0x7f973c1583f0 2023-08-31T19:07:21.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.854+0000 7f9738ff9700 1 -- 172.21.15.72:0/1306039485 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973400f040 con 0x7f973c1583f0 2023-08-31T19:07:21.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.854+0000 7f9742fff700 1 -- 172.21.15.72:0/1306039485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9730009370 con 0x7f973c1583f0 2023-08-31T19:07:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.854+0000 7f9738ff9700 1 -- 172.21.15.72:0/1306039485 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734013400 con 0x7f973c1583f0 2023-08-31T19:07:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.854+0000 7f9742fff700 1 -- 172.21.15.72:0/1306039485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973c168380 con 0x7f973c1583f0 2023-08-31T19:07:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.855+0000 7f9742fff700 1 -- 172.21.15.72:0/1306039485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973c1685a0 con 0x7f973c1583f0 2023-08-31T19:07:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.856+0000 7f9738ff9700 1 -- 172.21.15.72:0/1306039485 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f97340137f0 con 0x7f973c1583f0 2023-08-31T19:07:21.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.857+0000 7f9738ff9700 1 --2- 172.21.15.72:0/1306039485 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f972005ef30 0x7f97200613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:21.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.857+0000 7f9738ff9700 1 -- 172.21.15.72:0/1306039485 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f973407ad70 con 0x7f973c1583f0 2023-08-31T19:07:21.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.857+0000 7f9740d9b700 1 --2- 172.21.15.72:0/1306039485 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f972005ef30 0x7f97200613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:21.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.858+0000 7f9740d9b700 1 --2- 172.21.15.72:0/1306039485 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f972005ef30 0x7f97200613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9730009130 tx=0x7f9730017000).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:21.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:21.861+0000 7f9738ff9700 1 -- 172.21.15.72:0/1306039485 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f973404bd30 con 0x7f973c1583f0 2023-08-31T19:07:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.032+0000 7f9742fff700 1 -- 172.21.15.72:0/1306039485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f973c06c6b0 con 0x7f973c1583f0 2023-08-31T19:07:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.033+0000 7f9738ff9700 1 -- 172.21.15.72:0/1306039485 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+18004 (secure 0 0 0) 0x7f973404f350 con 0x7f973c1583f0 2023-08-31T19:07:22.034 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:22.034 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":141,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:07:21.607660+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:07:20.032158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-31T19:07:20.589299+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:07:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.035+0000 7f9742fff700 1 -- 172.21.15.72:0/1306039485 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f972005ef30 msgr2=0x7f97200613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.035+0000 7f9742fff700 1 --2- 172.21.15.72:0/1306039485 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f972005ef30 0x7f97200613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9730009130 tx=0x7f9730017000).stop 2023-08-31T19:07:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.035+0000 7f9742fff700 1 -- 172.21.15.72:0/1306039485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f973c1583f0 msgr2=0x7f973c1528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.035+0000 7f9742fff700 1 --2- 172.21.15.72:0/1306039485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f973c1583f0 0x7f973c1528c0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f9734009fc0 tx=0x7f973400b040).stop 2023-08-31T19:07:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.036+0000 7f9742fff700 1 -- 172.21.15.72:0/1306039485 shutdown_connections 2023-08-31T19:07:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.036+0000 7f9742fff700 1 --2- 172.21.15.72:0/1306039485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f973c1583f0 0x7f973c1528c0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.036+0000 7f9742fff700 1 --2- 172.21.15.72:0/1306039485 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f972005ef30 0x7f97200613f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.036+0000 7f9742fff700 1 --2- 172.21.15.72:0/1306039485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f973c0c4740 0x7f973c0a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.036+0000 7f9742fff700 1 --2- 172.21.15.72:0/1306039485 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f973c0c6c30 0x7f973c1523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.036+0000 7f9742fff700 1 -- 172.21.15.72:0/1306039485 >> 172.21.15.72:0/1306039485 conn(0x7f973c0c7e70 msgr2=0x7f973c0a6550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.036+0000 7f9742fff700 1 -- 172.21.15.72:0/1306039485 shutdown_connections 2023-08-31T19:07:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.036+0000 7f9742fff700 1 -- 172.21.15.72:0/1306039485 wait complete. 2023-08-31T19:07:22.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:07:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.244+0000 7fca561ff700 1 Processor -- start 2023-08-31T19:07:22.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.244+0000 7fca561ff700 1 -- start start 2023-08-31T19:07:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.245+0000 7fca561ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca5015ce50 0x7fca5015f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.245+0000 7fca561ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca500c6120 con 0x7fca500cb9b0 2023-08-31T19:07:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.245+0000 7fca561ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca500c5e10 con 0x7fca50154060 2023-08-31T19:07:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.245+0000 7fca561ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca500c1380 con 0x7fca5015ce50 2023-08-31T19:07:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.246+0000 7fca4effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fca500cb9b0 0x7fca501583e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59448/0 (socket says 172.21.15.72:59448) 2023-08-31T19:07:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.246+0000 7fca4effd700 1 -- 172.21.15.72:0/774654428 learned_addr learned my addr 172.21.15.72:0/774654428 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.246+0000 7fca4ffff700 1 --2- 172.21.15.72:0/774654428 >> v2:172.21.15.146:3300/0 conn(0x7fca5015ce50 0x7fca5015f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.246+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741731338 0 0) 0x7fca500c6120 con 0x7fca500cb9b0 2023-08-31T19:07:22.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.246+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca380033f0 con 0x7fca500cb9b0 2023-08-31T19:07:22.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.246+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746334479 0 0) 0x7fca500c5e10 con 0x7fca50154060 2023-08-31T19:07:22.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.246+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca500c6120 con 0x7fca50154060 2023-08-31T19:07:22.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.246+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 898070441 0 0) 0x7fca380033f0 con 0x7fca500cb9b0 2023-08-31T19:07:22.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.246+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 >> v2:172.21.15.146:3300/0 conn(0x7fca5015ce50 msgr2=0x7fca5015f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:22.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.246+0000 7fca4e7fc700 1 --2- 172.21.15.72:0/774654428 >> v2:172.21.15.146:3300/0 conn(0x7fca5015ce50 0x7fca5015f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.246+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 >> v1:172.21.15.146:6789/0 conn(0x7fca50154060 legacy=0x7fca50157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:22.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.246+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca50158af0 con 0x7fca500cb9b0 2023-08-31T19:07:22.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fca44001470 con 0x7fca500cb9b0 2023-08-31T19:07:22.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 >> v1:172.21.15.72:6789/0 conn(0x7fca500cb9b0 legacy=0x7fca501583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4e7fc700 1 --2- 172.21.15.72:0/774654428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca38003a70 0x7fca38003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4e7fc700 1 --2- 172.21.15.72:0/774654428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca38004690 0x7fca38004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4e7fc700 1 --2- 172.21.15.72:0/774654428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca38005000 0x7fca3800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca500c1380 con 0x7fca38004690 2023-08-31T19:07:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3800be80 con 0x7fca38003a70 2023-08-31T19:07:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3800c040 con 0x7fca38005000 2023-08-31T19:07:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4ffff700 1 --2- 172.21.15.72:0/774654428 >> v2:172.21.15.146:3300/0 conn(0x7fca5015ce50 0x7fca5015f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:07:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4effd700 1 --2- 172.21.15.72:0/774654428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca38004690 0x7fca38004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4f7fe700 1 --2- 172.21.15.72:0/774654428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca38003a70 0x7fca38003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4ffff700 1 --2- 172.21.15.72:0/774654428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca38005000 0x7fca3800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4effd700 1 -- 172.21.15.72:0/774654428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca38005000 msgr2=0x7fca3800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4effd700 1 --2- 172.21.15.72:0/774654428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca38005000 0x7fca3800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4effd700 1 -- 172.21.15.72:0/774654428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca38003a70 msgr2=0x7fca38003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4effd700 1 --2- 172.21.15.72:0/774654428 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca38003a70 0x7fca38003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4effd700 1 -- 172.21.15.72:0/774654428 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca380033f0 con 0x7fca38004690 2023-08-31T19:07:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4ffff700 1 --2- 172.21.15.72:0/774654428 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca38005000 0x7fca3800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.247+0000 7fca4ffff700 1 -- 172.21.15.72:0/774654428 reap_dead start 2023-08-31T19:07:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.248+0000 7fca4effd700 1 --2- 172.21.15.72:0/774654428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca38004690 0x7fca38004b10 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7fca4400c0e0 tx=0x7fca44001e10).ready entity=mon.0 client_cookie=c923089f118d39c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.248+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400ca10 con 0x7fca38004690 2023-08-31T19:07:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.248+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4400cb70 con 0x7fca38004690 2023-08-31T19:07:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.248+0000 7fca4e7fc700 1 -- 172.21.15.72:0/774654428 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca440070d0 con 0x7fca38004690 2023-08-31T19:07:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.248+0000 7fca561ff700 1 -- 172.21.15.72:0/774654428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca38004690 msgr2=0x7fca38004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.248+0000 7fca561ff700 1 --2- 172.21.15.72:0/774654428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca38004690 0x7fca38004b10 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7fca4400c0e0 tx=0x7fca44001e10).stop 2023-08-31T19:07:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.248+0000 7fca561ff700 1 -- 172.21.15.72:0/774654428 shutdown_connections 2023-08-31T19:07:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.248+0000 7fca561ff700 1 --2- 172.21.15.72:0/774654428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca38004690 0x7fca38004b10 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.248+0000 7fca561ff700 1 -- 172.21.15.72:0/774654428 >> 172.21.15.72:0/774654428 conn(0x7fca5005e870 msgr2=0x7fca500cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:22.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.248+0000 7fca561ff700 1 -- 172.21.15.72:0/774654428 shutdown_connections 2023-08-31T19:07:22.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.248+0000 7fca561ff700 1 -- 172.21.15.72:0/774654428 wait complete. 2023-08-31T19:07:22.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.250+0000 7fca561ff700 1 Processor -- start 2023-08-31T19:07:22.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.250+0000 7fca561ff700 1 -- start start 2023-08-31T19:07:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.251+0000 7fca561ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca38004690 0x7fca5014a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.251+0000 7fca561ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5014aed0 0x7fca50148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.251+0000 7fca561ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca500c76d0 0x7fca5014b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.251+0000 7fca561ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca500c7240 con 0x7fca5014aed0 2023-08-31T19:07:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.251+0000 7fca561ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca50148d40 con 0x7fca500c76d0 2023-08-31T19:07:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.251+0000 7fca561ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca50168110 con 0x7fca38004690 2023-08-31T19:07:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.251+0000 7fca4effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5014aed0 0x7fca50148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.251+0000 7fca4effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5014aed0 0x7fca50148850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37462/0 (socket says 172.21.15.72:37462) 2023-08-31T19:07:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.251+0000 7fca4effd700 1 -- 172.21.15.72:0/316836579 learned_addr learned my addr 172.21.15.72:0/316836579 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.251+0000 7fca4ffff700 1 --2- 172.21.15.72:0/316836579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca500c76d0 0x7fca5014b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.251+0000 7fca4f7fe700 1 --2- 172.21.15.72:0/316836579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca38004690 0x7fca5014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.251+0000 7fca4effd700 1 -- 172.21.15.72:0/316836579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca38004690 msgr2=0x7fca5014a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.251+0000 7fca4effd700 1 --2- 172.21.15.72:0/316836579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca38004690 0x7fca5014a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.251+0000 7fca4effd700 1 -- 172.21.15.72:0/316836579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca500c76d0 msgr2=0x7fca5014b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.251+0000 7fca4effd700 1 --2- 172.21.15.72:0/316836579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca500c76d0 0x7fca5014b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.252+0000 7fca4effd700 1 -- 172.21.15.72:0/316836579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca500c6910 con 0x7fca5014aed0 2023-08-31T19:07:22.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.252+0000 7fca4ffff700 1 --2- 172.21.15.72:0/316836579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca500c76d0 0x7fca5014b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.252+0000 7fca4effd700 1 --2- 172.21.15.72:0/316836579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5014aed0 0x7fca50148850 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7fca4400c6d0 tx=0x7fca44015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.252+0000 7fca377fe700 1 -- 172.21.15.72:0/316836579 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44001580 con 0x7fca5014aed0 2023-08-31T19:07:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.252+0000 7fca377fe700 1 -- 172.21.15.72:0/316836579 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca440016e0 con 0x7fca5014aed0 2023-08-31T19:07:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.252+0000 7fca561ff700 1 -- 172.21.15.72:0/316836579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca500c6bf0 con 0x7fca5014aed0 2023-08-31T19:07:22.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.252+0000 7fca377fe700 1 -- 172.21.15.72:0/316836579 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca440048e0 con 0x7fca5014aed0 2023-08-31T19:07:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.252+0000 7fca561ff700 1 -- 172.21.15.72:0/316836579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca50167d50 con 0x7fca5014aed0 2023-08-31T19:07:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.253+0000 7fca561ff700 1 -- 172.21.15.72:0/316836579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5006c6b0 con 0x7fca5014aed0 2023-08-31T19:07:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.254+0000 7fca377fe700 1 -- 172.21.15.72:0/316836579 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fca44004cd0 con 0x7fca5014aed0 2023-08-31T19:07:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.255+0000 7fca377fe700 1 --2- 172.21.15.72:0/316836579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fca3c05ef30 0x7fca3c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.255+0000 7fca377fe700 1 -- 172.21.15.72:0/316836579 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fca4407ad70 con 0x7fca5014aed0 2023-08-31T19:07:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.255+0000 7fca4f7fe700 1 --2- 172.21.15.72:0/316836579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fca3c05ef30 0x7fca3c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.255+0000 7fca4f7fe700 1 --2- 172.21.15.72:0/316836579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fca3c05ef30 0x7fca3c0613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fca500a93e0 tx=0x7fca40009040).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.259+0000 7fca377fe700 1 -- 172.21.15.72:0/316836579 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fca4404bdf0 con 0x7fca5014aed0 2023-08-31T19:07:22.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.430+0000 7fca561ff700 1 -- 172.21.15.72:0/316836579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca500c7380 con 0x7fca5014aed0 2023-08-31T19:07:22.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.431+0000 7fca377fe700 1 -- 172.21.15.72:0/316836579 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+18004 (secure 0 0 0) 0x7fca44024030 con 0x7fca5014aed0 2023-08-31T19:07:22.432 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:22.432 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":141,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:07:21.607660+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:07:20.032158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-31T19:07:20.589299+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:07:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.433+0000 7fca561ff700 1 -- 172.21.15.72:0/316836579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fca3c05ef30 msgr2=0x7fca3c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.433+0000 7fca561ff700 1 --2- 172.21.15.72:0/316836579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fca3c05ef30 0x7fca3c0613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fca500a93e0 tx=0x7fca40009040).stop 2023-08-31T19:07:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.433+0000 7fca561ff700 1 -- 172.21.15.72:0/316836579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5014aed0 msgr2=0x7fca50148850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:22.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.433+0000 7fca561ff700 1 --2- 172.21.15.72:0/316836579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5014aed0 0x7fca50148850 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7fca4400c6d0 tx=0x7fca44015000).stop 2023-08-31T19:07:22.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.434+0000 7fca561ff700 1 -- 172.21.15.72:0/316836579 shutdown_connections 2023-08-31T19:07:22.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.434+0000 7fca561ff700 1 --2- 172.21.15.72:0/316836579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fca3c05ef30 0x7fca3c0613f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.434+0000 7fca561ff700 1 --2- 172.21.15.72:0/316836579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca500c76d0 0x7fca5014b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.434+0000 7fca561ff700 1 --2- 172.21.15.72:0/316836579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca38004690 0x7fca5014a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.434+0000 7fca561ff700 1 --2- 172.21.15.72:0/316836579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5014aed0 0x7fca50148850 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.434+0000 7fca561ff700 1 -- 172.21.15.72:0/316836579 >> 172.21.15.72:0/316836579 conn(0x7fca5005e870 msgr2=0x7fca501547c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:22.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.434+0000 7fca561ff700 1 -- 172.21.15.72:0/316836579 shutdown_connections 2023-08-31T19:07:22.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.434+0000 7fca561ff700 1 -- 172.21.15.72:0/316836579 wait complete. 2023-08-31T19:07:22.451 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T19:07:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.647+0000 7f0212dff700 1 Processor -- start 2023-08-31T19:07:22.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.647+0000 7f0212dff700 1 -- start start 2023-08-31T19:07:22.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.648+0000 7f0212dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f020c063830 0x7f020c0c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:22.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.648+0000 7f0212dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c0c6ed0 con 0x7f020c154410 2023-08-31T19:07:22.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.648+0000 7f0212dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c0c68c0 con 0x7f020c154030 2023-08-31T19:07:22.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.648+0000 7f0212dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c0c66e0 con 0x7f020c063830 2023-08-31T19:07:22.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.648+0000 7f020bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f020c154410 0x7f020c063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59456/0 (socket says 172.21.15.72:59456) 2023-08-31T19:07:22.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.648+0000 7f020bfff700 1 -- 172.21.15.72:0/3060177482 learned_addr learned my addr 172.21.15.72:0/3060177482 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:22.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.649+0000 7f021139c700 1 --2- 172.21.15.72:0/3060177482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f020c063830 0x7f020c0c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:22.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.649+0000 7f020b7fe700 1 -- 172.21.15.72:0/3060177482 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785264898 0 0) 0x7f020c0c6ed0 con 0x7f020c154410 2023-08-31T19:07:22.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.649+0000 7f020b7fe700 1 -- 172.21.15.72:0/3060177482 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01fc0033f0 con 0x7f020c154410 2023-08-31T19:07:22.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.649+0000 7f020b7fe700 1 -- 172.21.15.72:0/3060177482 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705493311 0 0) 0x7f020c0c68c0 con 0x7f020c154030 2023-08-31T19:07:22.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.649+0000 7f020b7fe700 1 -- 172.21.15.72:0/3060177482 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f020c0c6ed0 con 0x7f020c154030 2023-08-31T19:07:22.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.649+0000 7f020b7fe700 1 -- 172.21.15.72:0/3060177482 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 244005328 0 0) 0x7f01fc0033f0 con 0x7f020c154410 2023-08-31T19:07:22.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.649+0000 7f021139c700 1 -- 172.21.15.72:0/3060177482 >> v1:172.21.15.146:6789/0 conn(0x7f020c154030 legacy=0x7f020c0aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:22.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.649+0000 7f021139c700 1 -- 172.21.15.72:0/3060177482 >> v1:172.21.15.72:6789/0 conn(0x7f020c154410 legacy=0x7f020c063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.649+0000 7f021139c700 1 -- 172.21.15.72:0/3060177482 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c0c0f30 con 0x7f020c063830 2023-08-31T19:07:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.649+0000 7f021139c700 1 --2- 172.21.15.72:0/3060177482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f020c063830 0x7f020c0c06b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0204009e90 tx=0x7f0204009780).ready entity=mon.2 client_cookie=21ab63876f797fdb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.650+0000 7f020b7fe700 1 -- 172.21.15.72:0/3060177482 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020400e070 con 0x7f020c063830 2023-08-31T19:07:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.650+0000 7f020b7fe700 1 -- 172.21.15.72:0/3060177482 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020400b7a0 con 0x7f020c063830 2023-08-31T19:07:22.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.650+0000 7f020b7fe700 1 -- 172.21.15.72:0/3060177482 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8001470 con 0x7f020c063830 2023-08-31T19:07:22.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.650+0000 7f0212dff700 1 -- 172.21.15.72:0/3060177482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f020c063830 msgr2=0x7f020c0c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:22.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.650+0000 7f0212dff700 1 --2- 172.21.15.72:0/3060177482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f020c063830 0x7f020c0c06b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0204009e90 tx=0x7f0204009780).stop 2023-08-31T19:07:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.650+0000 7f0212dff700 1 -- 172.21.15.72:0/3060177482 shutdown_connections 2023-08-31T19:07:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.650+0000 7f0212dff700 1 --2- 172.21.15.72:0/3060177482 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f020c063830 0x7f020c0c06b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.650+0000 7f0212dff700 1 -- 172.21.15.72:0/3060177482 >> 172.21.15.72:0/3060177482 conn(0x7f020c05eb60 msgr2=0x7f020c0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.650+0000 7f0212dff700 1 -- 172.21.15.72:0/3060177482 shutdown_connections 2023-08-31T19:07:22.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.650+0000 7f0212dff700 1 -- 172.21.15.72:0/3060177482 wait complete. 2023-08-31T19:07:22.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.652+0000 7f0212dff700 1 Processor -- start 2023-08-31T19:07:22.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.652+0000 7f0212dff700 1 -- start start 2023-08-31T19:07:22.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.653+0000 7f0212dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f020c063830 0x7f020c1428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:22.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.653+0000 7f0212dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c154030 0x7f020c0b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:22.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.653+0000 7f0212dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f020c154410 0x7f020c0c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:22.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.653+0000 7f0212dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c1514b0 con 0x7f020c063830 2023-08-31T19:07:22.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.653+0000 7f0212dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c1508a0 con 0x7f020c154030 2023-08-31T19:07:22.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.653+0000 7f0212dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c150b80 con 0x7f020c154410 2023-08-31T19:07:22.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.653+0000 7f0210b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f020c063830 0x7f020c1428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:22.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.653+0000 7f0210b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f020c063830 0x7f020c1428d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37476/0 (socket says 172.21.15.72:37476) 2023-08-31T19:07:22.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.653+0000 7f0210b9b700 1 -- 172.21.15.72:0/4281608946 learned_addr learned my addr 172.21.15.72:0/4281608946 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:22.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.653+0000 7f020bfff700 1 --2- 172.21.15.72:0/4281608946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c154030 0x7f020c0b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:22.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.653+0000 7f021139c700 1 --2- 172.21.15.72:0/4281608946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f020c154410 0x7f020c0c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:22.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.654+0000 7f0210b9b700 1 -- 172.21.15.72:0/4281608946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f020c154410 msgr2=0x7f020c0c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:22.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.654+0000 7f0210b9b700 1 --2- 172.21.15.72:0/4281608946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f020c154410 0x7f020c0c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.654+0000 7f0210b9b700 1 -- 172.21.15.72:0/4281608946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c154030 msgr2=0x7f020c0b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.654+0000 7f0210b9b700 1 --2- 172.21.15.72:0/4281608946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c154030 0x7f020c0b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.654+0000 7f0210b9b700 1 -- 172.21.15.72:0/4281608946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0204009a20 con 0x7f020c063830 2023-08-31T19:07:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.654+0000 7f0210b9b700 1 --2- 172.21.15.72:0/4281608946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f020c063830 0x7f020c1428d0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f020000c490 tx=0x7f0200007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.654+0000 7f0208ff9700 1 -- 172.21.15.72:0/4281608946 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020000ce40 con 0x7f020c063830 2023-08-31T19:07:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.654+0000 7f0208ff9700 1 -- 172.21.15.72:0/4281608946 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020000f470 con 0x7f020c063830 2023-08-31T19:07:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.654+0000 7f0208ff9700 1 -- 172.21.15.72:0/4281608946 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020000f810 con 0x7f020c063830 2023-08-31T19:07:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.654+0000 7f0212dff700 1 -- 172.21.15.72:0/4281608946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020c150e60 con 0x7f020c063830 2023-08-31T19:07:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.654+0000 7f0212dff700 1 -- 172.21.15.72:0/4281608946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c142dc0 con 0x7f020c063830 2023-08-31T19:07:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.655+0000 7f0212dff700 1 -- 172.21.15.72:0/4281608946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020c0c08c0 con 0x7f020c063830 2023-08-31T19:07:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.656+0000 7f0208ff9700 1 -- 172.21.15.72:0/4281608946 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f020000fbc0 con 0x7f020c063830 2023-08-31T19:07:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.657+0000 7f0208ff9700 1 --2- 172.21.15.72:0/4281608946 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f01f005ef30 0x7f01f00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:22.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.657+0000 7f0208ff9700 1 -- 172.21.15.72:0/4281608946 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f0200079810 con 0x7f020c063830 2023-08-31T19:07:22.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.657+0000 7f020bfff700 1 --2- 172.21.15.72:0/4281608946 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f01f005ef30 0x7f01f00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:22.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.658+0000 7f020bfff700 1 --2- 172.21.15.72:0/4281608946 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f01f005ef30 0x7f01f00613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f020c159cd0 tx=0x7f01f8000bc0).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:22.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.661+0000 7f0208ff9700 1 -- 172.21.15.72:0/4281608946 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f020004a7d0 con 0x7f020c063830 2023-08-31T19:07:22.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:22.873+0000 7f0212dff700 1 -- 172.21.15.72:0/4281608946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f020c06c6b0 con 0x7f020c063830 2023-08-31T19:07:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.626+0000 7f0208ff9700 1 -- 172.21.15.72:0/4281608946 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v63) v1 ==== 118+0+0 (secure 0 0 0) 0x7f020004ddf0 con 0x7f020c063830 2023-08-31T19:07:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.628+0000 7f0212dff700 1 -- 172.21.15.72:0/4281608946 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f01f005ef30 msgr2=0x7f01f00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.628+0000 7f0212dff700 1 --2- 172.21.15.72:0/4281608946 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f01f005ef30 0x7f01f00613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f020c159cd0 tx=0x7f01f8000bc0).stop 2023-08-31T19:07:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.628+0000 7f0212dff700 1 -- 172.21.15.72:0/4281608946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f020c063830 msgr2=0x7f020c1428d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.628+0000 7f0212dff700 1 --2- 172.21.15.72:0/4281608946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f020c063830 0x7f020c1428d0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f020000c490 tx=0x7f0200007c90).stop 2023-08-31T19:07:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.629+0000 7f0212dff700 1 -- 172.21.15.72:0/4281608946 shutdown_connections 2023-08-31T19:07:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.629+0000 7f0212dff700 1 --2- 172.21.15.72:0/4281608946 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f020c154410 0x7f020c0c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.629+0000 7f0212dff700 1 --2- 172.21.15.72:0/4281608946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f020c063830 0x7f020c1428d0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:23.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.629+0000 7f0212dff700 1 --2- 172.21.15.72:0/4281608946 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f01f005ef30 0x7f01f00613f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:23.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.629+0000 7f0212dff700 1 --2- 172.21.15.72:0/4281608946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f020c154030 0x7f020c0b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:23.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.629+0000 7f0212dff700 1 -- 172.21.15.72:0/4281608946 >> 172.21.15.72:0/4281608946 conn(0x7f020c05eb60 msgr2=0x7f020c0ac080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:23.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.629+0000 7f0212dff700 1 -- 172.21.15.72:0/4281608946 shutdown_connections 2023-08-31T19:07:23.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.629+0000 7f0212dff700 1 -- 172.21.15.72:0/4281608946 wait complete. 2023-08-31T19:07:23.650 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-31T19:07:23.650 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T19:07:23.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.844+0000 7fd14bfff700 1 Processor -- start 2023-08-31T19:07:23.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.844+0000 7fd14bfff700 1 -- start start 2023-08-31T19:07:23.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.845+0000 7fd14bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1440aa450 0x7fd144154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:23.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.845+0000 7fd14bfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd144158a90 con 0x7fd144063980 2023-08-31T19:07:23.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.845+0000 7fd14bfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd144157e80 con 0x7fd144153e20 2023-08-31T19:07:23.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.845+0000 7fd14bfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd144157c70 con 0x7fd1440aa450 2023-08-31T19:07:23.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.845+0000 7fd14959a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd144063980 0x7fd1440a9d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39078/0 (socket says 172.21.15.72:39078) 2023-08-31T19:07:23.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.845+0000 7fd14959a700 1 -- 172.21.15.72:0/532215994 learned_addr learned my addr 172.21.15.72:0/532215994 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:23.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd14a59c700 1 --2- 172.21.15.72:0/532215994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1440aa450 0x7fd144154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:23.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd148d99700 1 -- 172.21.15.72:0/532215994 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893535122 0 0) 0x7fd144158a90 con 0x7fd144063980 2023-08-31T19:07:23.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd148d99700 1 -- 172.21.15.72:0/532215994 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1300033f0 con 0x7fd144063980 2023-08-31T19:07:23.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd148d99700 1 -- 172.21.15.72:0/532215994 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1305098372 0 0) 0x7fd1300033f0 con 0x7fd144063980 2023-08-31T19:07:23.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd148d99700 1 -- 172.21.15.72:0/532215994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1440aa450 msgr2=0x7fd144154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:23.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd148d99700 1 --2- 172.21.15.72:0/532215994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1440aa450 0x7fd144154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:23.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd148d99700 1 -- 172.21.15.72:0/532215994 >> v1:172.21.15.146:6789/0 conn(0x7fd144153e20 legacy=0x7fd144063270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:23.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd148d99700 1 -- 172.21.15.72:0/532215994 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd144158160 con 0x7fd144063980 2023-08-31T19:07:23.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd148d99700 1 -- 172.21.15.72:0/532215994 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fd134001470 con 0x7fd144063980 2023-08-31T19:07:23.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd148d99700 1 -- 172.21.15.72:0/532215994 >> v1:172.21.15.72:6789/0 conn(0x7fd144063980 legacy=0x7fd1440a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:23.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd148d99700 1 --2- 172.21.15.72:0/532215994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd130003910 0x7fd130003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:23.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd148d99700 1 --2- 172.21.15.72:0/532215994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1440aa450 0x7fd130004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:23.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd148d99700 1 --2- 172.21.15.72:0/532215994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd130004b80 0x7fd130005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:23.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd148d99700 1 -- 172.21.15.72:0/532215994 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd144157c70 con 0x7fd130003910 2023-08-31T19:07:23.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd148d99700 1 -- 172.21.15.72:0/532215994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13000b940 con 0x7fd130004b80 2023-08-31T19:07:23.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd148d99700 1 -- 172.21.15.72:0/532215994 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13000bb00 con 0x7fd1440aa450 2023-08-31T19:07:23.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.846+0000 7fd149d9b700 1 --2- 172.21.15.72:0/532215994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd130003910 0x7fd130003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:23.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.847+0000 7fd14959a700 1 --2- 172.21.15.72:0/532215994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1440aa450 0x7fd130004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:23.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.847+0000 7fd14a59c700 1 --2- 172.21.15.72:0/532215994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd130004b80 0x7fd130005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:23.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.847+0000 7fd149d9b700 1 -- 172.21.15.72:0/532215994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1440aa450 msgr2=0x7fd130004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:23.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.847+0000 7fd149d9b700 1 --2- 172.21.15.72:0/532215994 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1440aa450 0x7fd130004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:23.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.847+0000 7fd149d9b700 1 -- 172.21.15.72:0/532215994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd130004b80 msgr2=0x7fd130005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:23.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.847+0000 7fd149d9b700 1 --2- 172.21.15.72:0/532215994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd130004b80 0x7fd130005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:23.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.847+0000 7fd149d9b700 1 -- 172.21.15.72:0/532215994 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1300033f0 con 0x7fd130003910 2023-08-31T19:07:23.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.847+0000 7fd149d9b700 1 --2- 172.21.15.72:0/532215994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd130003910 0x7fd130003d30 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7fd140001730 tx=0x7fd140007bb0).ready entity=mon.0 client_cookie=ba0f3f6f15e0ef20 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:23.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.847+0000 7fd148d99700 1 -- 172.21.15.72:0/532215994 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd140007020 con 0x7fd130003910 2023-08-31T19:07:23.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.847+0000 7fd148d99700 1 -- 172.21.15.72:0/532215994 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd140007180 con 0x7fd130003910 2023-08-31T19:07:23.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.847+0000 7fd148d99700 1 -- 172.21.15.72:0/532215994 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd140007500 con 0x7fd130003910 2023-08-31T19:07:23.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.848+0000 7fd14bfff700 1 -- 172.21.15.72:0/532215994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd130003910 msgr2=0x7fd130003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:23.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.848+0000 7fd14bfff700 1 --2- 172.21.15.72:0/532215994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd130003910 0x7fd130003d30 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7fd140001730 tx=0x7fd140007bb0).stop 2023-08-31T19:07:23.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.848+0000 7fd14a59c700 1 -- 172.21.15.72:0/532215994 reap_dead start 2023-08-31T19:07:23.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.848+0000 7fd14bfff700 1 -- 172.21.15.72:0/532215994 shutdown_connections 2023-08-31T19:07:23.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.848+0000 7fd14bfff700 1 -- 172.21.15.72:0/532215994 >> 172.21.15.72:0/532215994 conn(0x7fd14405eb60 msgr2=0x7fd1440cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:23.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.848+0000 7fd14bfff700 1 -- 172.21.15.72:0/532215994 shutdown_connections 2023-08-31T19:07:23.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.848+0000 7fd14bfff700 1 -- 172.21.15.72:0/532215994 wait complete. 2023-08-31T19:07:23.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.849+0000 7fd14bfff700 1 Processor -- start 2023-08-31T19:07:23.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.849+0000 7fd14bfff700 1 -- start start 2023-08-31T19:07:23.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.850+0000 7fd14bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd130003910 0x7fd144164730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:23.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.850+0000 7fd14bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1441550f0 0x7fd14414e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:23.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.850+0000 7fd14bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1440ab860 0x7fd1440abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:23.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.850+0000 7fd14bfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440c3ed0 con 0x7fd1440ab860 2023-08-31T19:07:23.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.850+0000 7fd14bfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1441558b0 con 0x7fd130003910 2023-08-31T19:07:23.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.850+0000 7fd14bfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440ac1b0 con 0x7fd1441550f0 2023-08-31T19:07:23.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.851+0000 7fd14a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1440ab860 0x7fd1440abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:23.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.851+0000 7fd14a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1440ab860 0x7fd1440abcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45368/0 (socket says 172.21.15.72:45368) 2023-08-31T19:07:23.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.851+0000 7fd14a59c700 1 -- 172.21.15.72:0/2340946026 learned_addr learned my addr 172.21.15.72:0/2340946026 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:23.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.851+0000 7fd14959a700 1 --2- 172.21.15.72:0/2340946026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1441550f0 0x7fd14414e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:23.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.851+0000 7fd149d9b700 1 --2- 172.21.15.72:0/2340946026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd130003910 0x7fd144164730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:23.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.851+0000 7fd14a59c700 1 -- 172.21.15.72:0/2340946026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1441550f0 msgr2=0x7fd14414e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:23.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.851+0000 7fd14a59c700 1 --2- 172.21.15.72:0/2340946026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1441550f0 0x7fd14414e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:23.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.851+0000 7fd14a59c700 1 -- 172.21.15.72:0/2340946026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd130003910 msgr2=0x7fd144164730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:23.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.851+0000 7fd14a59c700 1 --2- 172.21.15.72:0/2340946026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd130003910 0x7fd144164730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:23.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.851+0000 7fd14a59c700 1 -- 172.21.15.72:0/2340946026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1441555d0 con 0x7fd1440ab860 2023-08-31T19:07:23.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.851+0000 7fd14a59c700 1 --2- 172.21.15.72:0/2340946026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1440ab860 0x7fd1440abcc0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7fd1440c7840 tx=0x7fd13c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:23.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.851+0000 7fd139ffb700 1 -- 172.21.15.72:0/2340946026 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c00e040 con 0x7fd1440ab860 2023-08-31T19:07:23.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.851+0000 7fd139ffb700 1 -- 172.21.15.72:0/2340946026 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c00f040 con 0x7fd1440ab860 2023-08-31T19:07:23.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.851+0000 7fd14bfff700 1 -- 172.21.15.72:0/2340946026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1440c3880 con 0x7fd1440ab860 2023-08-31T19:07:23.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.852+0000 7fd139ffb700 1 -- 172.21.15.72:0/2340946026 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c00fd70 con 0x7fd1440ab860 2023-08-31T19:07:23.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.852+0000 7fd14bfff700 1 -- 172.21.15.72:0/2340946026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd144164c20 con 0x7fd1440ab860 2023-08-31T19:07:23.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.853+0000 7fd14bfff700 1 -- 172.21.15.72:0/2340946026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1440c36e0 con 0x7fd1440ab860 2023-08-31T19:07:23.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.853+0000 7fd139ffb700 1 -- 172.21.15.72:0/2340946026 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd13c015660 con 0x7fd1440ab860 2023-08-31T19:07:23.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.854+0000 7fd139ffb700 1 --2- 172.21.15.72:0/2340946026 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd12805ef30 0x7fd1280613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:23.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.854+0000 7fd139ffb700 1 -- 172.21.15.72:0/2340946026 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fd13c07ad10 con 0x7fd1440ab860 2023-08-31T19:07:23.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.854+0000 7fd149d9b700 1 --2- 172.21.15.72:0/2340946026 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd12805ef30 0x7fd1280613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:23.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.855+0000 7fd149d9b700 1 --2- 172.21.15.72:0/2340946026 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd12805ef30 0x7fd1280613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd140001010 tx=0x7fd140015000).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:23.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:23.858+0000 7fd139ffb700 1 -- 172.21.15.72:0/2340946026 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd1440c36e0 con 0x7fd1440ab860 2023-08-31T19:07:24.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.068+0000 7fd14bfff700 1 -- 172.21.15.72:0/2340946026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd1440c36e0 con 0x7fd1440ab860 2023-08-31T19:07:24.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.632+0000 7fd139ffb700 1 -- 172.21.15.72:0/2340946026 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd1440c36e0 con 0x7fd1440ab860 2023-08-31T19:07:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.634+0000 7fd14bfff700 1 -- 172.21.15.72:0/2340946026 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd12805ef30 msgr2=0x7fd1280613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.634+0000 7fd14bfff700 1 --2- 172.21.15.72:0/2340946026 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd12805ef30 0x7fd1280613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd140001010 tx=0x7fd140015000).stop 2023-08-31T19:07:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.634+0000 7fd14bfff700 1 -- 172.21.15.72:0/2340946026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1440ab860 msgr2=0x7fd1440abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.634+0000 7fd14bfff700 1 --2- 172.21.15.72:0/2340946026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1440ab860 0x7fd1440abcc0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7fd1440c7840 tx=0x7fd13c00b040).stop 2023-08-31T19:07:24.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.634+0000 7fd14bfff700 1 -- 172.21.15.72:0/2340946026 shutdown_connections 2023-08-31T19:07:24.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.634+0000 7fd14bfff700 1 --2- 172.21.15.72:0/2340946026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1440ab860 0x7fd1440abcc0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:24.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.634+0000 7fd14bfff700 1 --2- 172.21.15.72:0/2340946026 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd12805ef30 0x7fd1280613f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:24.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.634+0000 7fd14bfff700 1 --2- 172.21.15.72:0/2340946026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd130003910 0x7fd144164730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:24.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.634+0000 7fd14bfff700 1 --2- 172.21.15.72:0/2340946026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd1441550f0 0x7fd14414e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:24.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.634+0000 7fd14bfff700 1 -- 172.21.15.72:0/2340946026 >> 172.21.15.72:0/2340946026 conn(0x7fd14405eb60 msgr2=0x7fd1440ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:24.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.634+0000 7fd14bfff700 1 -- 172.21.15.72:0/2340946026 shutdown_connections 2023-08-31T19:07:24.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.634+0000 7fd14bfff700 1 -- 172.21.15.72:0/2340946026 wait complete. 2023-08-31T19:07:24.653 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T19:07:24.653 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:07:24.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.844+0000 7f6dd45ff700 1 Processor -- start 2023-08-31T19:07:24.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.844+0000 7f6dd45ff700 1 -- start start 2023-08-31T19:07:24.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.845+0000 7f6dd45ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0cb9b0 0x7f6dcc1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:24.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.845+0000 7f6dd45ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc0c6120 con 0x7f6dcc1588d0 2023-08-31T19:07:24.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.845+0000 7f6dd45ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc0c5e10 con 0x7f6dcc154060 2023-08-31T19:07:24.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.845+0000 7f6dd45ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0c1380 con 0x7f6dcc0cb9b0 2023-08-31T19:07:24.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.846+0000 7f6dd2b9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6dcc1588d0 0x7f6dcc154440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39092/0 (socket says 172.21.15.72:39092) 2023-08-31T19:07:24.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.846+0000 7f6dd2b9c700 1 -- 172.21.15.72:0/3417050712 learned_addr learned my addr 172.21.15.72:0/3417050712 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:24.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.846+0000 7f6dd1b9a700 1 --2- 172.21.15.72:0/3417050712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0cb9b0 0x7f6dcc1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:24.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.846+0000 7f6dd1399700 1 -- 172.21.15.72:0/3417050712 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188472323 0 0) 0x7f6dcc0c6120 con 0x7f6dcc1588d0 2023-08-31T19:07:24.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.846+0000 7f6dd1399700 1 -- 172.21.15.72:0/3417050712 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6db80033f0 con 0x7f6dcc1588d0 2023-08-31T19:07:24.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.846+0000 7f6dd1399700 1 -- 172.21.15.72:0/3417050712 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 817587051 0 0) 0x7f6db80033f0 con 0x7f6dcc1588d0 2023-08-31T19:07:24.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.846+0000 7f6dd1399700 1 -- 172.21.15.72:0/3417050712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0cb9b0 msgr2=0x7f6dcc1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:24.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.846+0000 7f6dd1399700 1 --2- 172.21.15.72:0/3417050712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0cb9b0 0x7f6dcc1583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:24.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.846+0000 7f6dd1399700 1 -- 172.21.15.72:0/3417050712 >> v1:172.21.15.146:6789/0 conn(0x7f6dcc154060 legacy=0x7f6dcc157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:24.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.846+0000 7f6dd1399700 1 -- 172.21.15.72:0/3417050712 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc0c0ae0 con 0x7f6dcc1588d0 2023-08-31T19:07:24.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.846+0000 7f6dd1399700 1 -- 172.21.15.72:0/3417050712 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f6dc40017f0 con 0x7f6dcc1588d0 2023-08-31T19:07:24.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.846+0000 7f6dd1399700 1 -- 172.21.15.72:0/3417050712 >> v1:172.21.15.72:6789/0 conn(0x7f6dcc1588d0 legacy=0x7f6dcc154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:24.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.847+0000 7f6dd1399700 1 --2- 172.21.15.72:0/3417050712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db8003910 0x7f6db8003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:24.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.847+0000 7f6dd1399700 1 --2- 172.21.15.72:0/3417050712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6db8004690 0x7f6db8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:24.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.847+0000 7f6dd1399700 1 --2- 172.21.15.72:0/3417050712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0cb9b0 0x7f6db8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:24.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.847+0000 7f6dd1399700 1 -- 172.21.15.72:0/3417050712 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0c1380 con 0x7f6db8003910 2023-08-31T19:07:24.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.847+0000 7f6dd1399700 1 -- 172.21.15.72:0/3417050712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db800b8e0 con 0x7f6db8004690 2023-08-31T19:07:24.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.847+0000 7f6dd1399700 1 -- 172.21.15.72:0/3417050712 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db800ba20 con 0x7f6dcc0cb9b0 2023-08-31T19:07:24.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.847+0000 7f6dd239b700 1 --2- 172.21.15.72:0/3417050712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db8003910 0x7f6db8003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:24.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.847+0000 7f6dd1b9a700 1 --2- 172.21.15.72:0/3417050712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6db8004690 0x7f6db8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:24.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.847+0000 7f6dd2b9c700 1 --2- 172.21.15.72:0/3417050712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0cb9b0 0x7f6db8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:24.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.847+0000 7f6dd239b700 1 -- 172.21.15.72:0/3417050712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0cb9b0 msgr2=0x7f6db8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:24.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.847+0000 7f6dd239b700 1 --2- 172.21.15.72:0/3417050712 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0cb9b0 0x7f6db8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:24.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.847+0000 7f6dd239b700 1 -- 172.21.15.72:0/3417050712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6db8004690 msgr2=0x7f6db8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:24.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.847+0000 7f6dd239b700 1 --2- 172.21.15.72:0/3417050712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6db8004690 0x7f6db8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:24.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.847+0000 7f6dd239b700 1 -- 172.21.15.72:0/3417050712 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db80033f0 con 0x7f6db8003910 2023-08-31T19:07:24.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.847+0000 7f6dd239b700 1 --2- 172.21.15.72:0/3417050712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db8003910 0x7f6db8003cf0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f6dc8001870 tx=0x7f6dc8007be0).ready entity=mon.0 client_cookie=fd2cc7c0992d569f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:24.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.848+0000 7f6dd1399700 1 -- 172.21.15.72:0/3417050712 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8012400 con 0x7f6db8003910 2023-08-31T19:07:24.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.848+0000 7f6dd1399700 1 -- 172.21.15.72:0/3417050712 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc8012560 con 0x7f6db8003910 2023-08-31T19:07:24.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.848+0000 7f6dd1399700 1 -- 172.21.15.72:0/3417050712 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8012920 con 0x7f6db8003910 2023-08-31T19:07:24.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.848+0000 7f6dd45ff700 1 -- 172.21.15.72:0/3417050712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db8003910 msgr2=0x7f6db8003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:24.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.848+0000 7f6dd45ff700 1 --2- 172.21.15.72:0/3417050712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db8003910 0x7f6db8003cf0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f6dc8001870 tx=0x7f6dc8007be0).stop 2023-08-31T19:07:24.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.848+0000 7f6dd2b9c700 1 -- 172.21.15.72:0/3417050712 reap_dead start 2023-08-31T19:07:24.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.848+0000 7f6dd45ff700 1 -- 172.21.15.72:0/3417050712 shutdown_connections 2023-08-31T19:07:24.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.848+0000 7f6dd45ff700 1 -- 172.21.15.72:0/3417050712 >> 172.21.15.72:0/3417050712 conn(0x7f6dcc05e870 msgr2=0x7f6dcc0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:24.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.848+0000 7f6dd45ff700 1 -- 172.21.15.72:0/3417050712 shutdown_connections 2023-08-31T19:07:24.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.848+0000 7f6dd45ff700 1 -- 172.21.15.72:0/3417050712 wait complete. 2023-08-31T19:07:24.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.850+0000 7f6dd45ff700 1 Processor -- start 2023-08-31T19:07:24.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.850+0000 7f6dd45ff700 1 -- start start 2023-08-31T19:07:24.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.851+0000 7f6dd45ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6db8003910 0x7f6dcc0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:24.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.851+0000 7f6dd45ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc164290 0x7f6dcc152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:24.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.851+0000 7f6dd45ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dcc0ab3d0 0x7f6dcc0ab850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:24.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.851+0000 7f6dd45ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc1529d0 con 0x7f6dcc164290 2023-08-31T19:07:24.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.851+0000 7f6dd45ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc1592f0 con 0x7f6dcc0ab3d0 2023-08-31T19:07:24.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.851+0000 7f6dd45ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0abd40 con 0x7f6db8003910 2023-08-31T19:07:24.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.851+0000 7f6dd1b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc164290 0x7f6dcc152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:24.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.851+0000 7f6dd1b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc164290 0x7f6dcc152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45392/0 (socket says 172.21.15.72:45392) 2023-08-31T19:07:24.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.851+0000 7f6dd1b9a700 1 -- 172.21.15.72:0/2427223092 learned_addr learned my addr 172.21.15.72:0/2427223092 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:24.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.851+0000 7f6dd239b700 1 --2- 172.21.15.72:0/2427223092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6db8003910 0x7f6dcc0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:24.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.851+0000 7f6dd2b9c700 1 --2- 172.21.15.72:0/2427223092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dcc0ab3d0 0x7f6dcc0ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:24.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.851+0000 7f6dd1b9a700 1 -- 172.21.15.72:0/2427223092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6db8003910 msgr2=0x7f6dcc0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:24.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.852+0000 7f6dd1b9a700 1 --2- 172.21.15.72:0/2427223092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6db8003910 0x7f6dcc0b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:24.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.852+0000 7f6dd1b9a700 1 -- 172.21.15.72:0/2427223092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dcc0ab3d0 msgr2=0x7f6dcc0ab850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:24.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.852+0000 7f6dd1b9a700 1 --2- 172.21.15.72:0/2427223092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dcc0ab3d0 0x7f6dcc0ab850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:24.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.852+0000 7f6dd1b9a700 1 -- 172.21.15.72:0/2427223092 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc0b0790 con 0x7f6dcc164290 2023-08-31T19:07:24.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.852+0000 7f6dd1b9a700 1 --2- 172.21.15.72:0/2427223092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc164290 0x7f6dcc152040 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f6dbc011a50 tx=0x7f6dbc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:24.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.852+0000 7f6dc27fc700 1 -- 172.21.15.72:0/2427223092 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00f940 con 0x7f6dcc164290 2023-08-31T19:07:24.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.852+0000 7f6dc27fc700 1 -- 172.21.15.72:0/2427223092 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc00faa0 con 0x7f6dcc164290 2023-08-31T19:07:24.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.852+0000 7f6dd45ff700 1 -- 172.21.15.72:0/2427223092 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dcc0b0a70 con 0x7f6dcc164290 2023-08-31T19:07:24.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.852+0000 7f6dc27fc700 1 -- 172.21.15.72:0/2427223092 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00fe20 con 0x7f6dcc164290 2023-08-31T19:07:24.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.852+0000 7f6dd45ff700 1 -- 172.21.15.72:0/2427223092 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc152530 con 0x7f6dcc164290 2023-08-31T19:07:24.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.853+0000 7f6dd45ff700 1 -- 172.21.15.72:0/2427223092 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dcc0b0cb0 con 0x7f6dcc164290 2023-08-31T19:07:24.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.854+0000 7f6dc27fc700 1 -- 172.21.15.72:0/2427223092 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6dbc014650 con 0x7f6dcc164290 2023-08-31T19:07:24.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.855+0000 7f6dc27fc700 1 --2- 172.21.15.72:0/2427223092 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6db005ef30 0x7f6db00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:24.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.855+0000 7f6dc27fc700 1 -- 172.21.15.72:0/2427223092 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f6dbc07ae90 con 0x7f6dcc164290 2023-08-31T19:07:24.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.855+0000 7f6dd239b700 1 --2- 172.21.15.72:0/2427223092 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6db005ef30 0x7f6db00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:24.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.855+0000 7f6dd239b700 1 --2- 172.21.15.72:0/2427223092 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6db005ef30 0x7f6db00613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6dc8001870 tx=0x7f6dc8016000).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:24.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:24.859+0000 7f6dc27fc700 1 -- 172.21.15.72:0/2427223092 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6dcc0b0cb0 con 0x7f6dcc164290 2023-08-31T19:07:25.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.068+0000 7f6dd45ff700 1 -- 172.21.15.72:0/2427223092 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6dcc158de0 con 0x7f6dcc164290 2023-08-31T19:07:25.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.069+0000 7f6dc27fc700 1 -- 172.21.15.72:0/2427223092 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f6dcc158de0 con 0x7f6dcc164290 2023-08-31T19:07:25.069 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:25.070 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6623,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2723616156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2723616156},{"type":"v1","addr":"172.21.15.72:6836","nonce":2723616156}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1506898460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1506898460},{"type":"v1","addr":"172.21.15.146:6834","nonce":1506898460}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1176286638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1176286638},{"type":"v1","addr":"172.21.15.146:6835","nonce":1176286638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:07:21.608188+0000","modified":"2023-08-31T19:07:24.626195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8058},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8058":{"gid":8058,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/1400178853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1400178853},{"type":"v1","addr":"172.21.15.72:6837","nonce":1400178853}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-31T19:07:25.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.071+0000 7f6dd45ff700 1 -- 172.21.15.72:0/2427223092 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6db005ef30 msgr2=0x7f6db00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:25.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.071+0000 7f6dd45ff700 1 --2- 172.21.15.72:0/2427223092 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6db005ef30 0x7f6db00613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6dc8001870 tx=0x7f6dc8016000).stop 2023-08-31T19:07:25.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.071+0000 7f6dd45ff700 1 -- 172.21.15.72:0/2427223092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc164290 msgr2=0x7f6dcc152040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:25.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.071+0000 7f6dd45ff700 1 --2- 172.21.15.72:0/2427223092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc164290 0x7f6dcc152040 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f6dbc011a50 tx=0x7f6dbc009060).stop 2023-08-31T19:07:25.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.071+0000 7f6dd45ff700 1 -- 172.21.15.72:0/2427223092 shutdown_connections 2023-08-31T19:07:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.071+0000 7f6dd45ff700 1 --2- 172.21.15.72:0/2427223092 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6db005ef30 0x7f6db00613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.071+0000 7f6dd45ff700 1 --2- 172.21.15.72:0/2427223092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dcc0ab3d0 0x7f6dcc0ab850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.071+0000 7f6dd45ff700 1 --2- 172.21.15.72:0/2427223092 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6db8003910 0x7f6dcc0b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.071+0000 7f6dd45ff700 1 --2- 172.21.15.72:0/2427223092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc164290 0x7f6dcc152040 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.071+0000 7f6dd45ff700 1 -- 172.21.15.72:0/2427223092 >> 172.21.15.72:0/2427223092 conn(0x7f6dcc05e870 msgr2=0x7f6dcc0bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.071+0000 7f6dd45ff700 1 -- 172.21.15.72:0/2427223092 shutdown_connections 2023-08-31T19:07:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.071+0000 7f6dd45ff700 1 -- 172.21.15.72:0/2427223092 wait complete. 2023-08-31T19:07:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 64 2023-08-31T19:07:25.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:07:25.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.277+0000 7ff77f5ff700 1 Processor -- start 2023-08-31T19:07:25.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.277+0000 7ff77f5ff700 1 -- start start 2023-08-31T19:07:25.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.279+0000 7ff77f5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff77806a260 0x7ff778069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:25.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.279+0000 7ff77f5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff778064270 con 0x7ff778069170 2023-08-31T19:07:25.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.279+0000 7ff77f5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7780bcc20 con 0x7ff778065710 2023-08-31T19:07:25.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.279+0000 7ff77f5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7780bca40 con 0x7ff77806a260 2023-08-31T19:07:25.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.279+0000 7ff77d39b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff778069170 0x7ff7780c2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39100/0 (socket says 172.21.15.72:39100) 2023-08-31T19:07:25.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.279+0000 7ff77d39b700 1 -- 172.21.15.72:0/1990510279 learned_addr learned my addr 172.21.15.72:0/1990510279 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:25.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.279+0000 7ff77cb9a700 1 --2- 172.21.15.72:0/1990510279 >> v2:172.21.15.146:3300/0 conn(0x7ff77806a260 0x7ff778069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:25.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.280+0000 7ff76ffff700 1 -- 172.21.15.72:0/1990510279 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449786878 0 0) 0x7ff778064270 con 0x7ff778069170 2023-08-31T19:07:25.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.280+0000 7ff76ffff700 1 -- 172.21.15.72:0/1990510279 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7640033f0 con 0x7ff778069170 2023-08-31T19:07:25.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.280+0000 7ff77cb9a700 1 -- 172.21.15.72:0/1990510279 >> v1:172.21.15.146:6789/0 conn(0x7ff778065710 legacy=0x7ff778069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:25.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.280+0000 7ff77cb9a700 1 -- 172.21.15.72:0/1990510279 >> v1:172.21.15.72:6789/0 conn(0x7ff778069170 legacy=0x7ff7780c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:25.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.280+0000 7ff77cb9a700 1 -- 172.21.15.72:0/1990510279 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff778154890 con 0x7ff77806a260 2023-08-31T19:07:25.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.280+0000 7ff77cb9a700 1 --2- 172.21.15.72:0/1990510279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff77806a260 0x7ff778069550 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7ff7780c7670 tx=0x7ff768009060).ready entity=mon.1 client_cookie=1cfba80fa7bf2402 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:25.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.280+0000 7ff76ffff700 1 -- 172.21.15.72:0/1990510279 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76800f510 con 0x7ff77806a260 2023-08-31T19:07:25.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.280+0000 7ff76ffff700 1 -- 172.21.15.72:0/1990510279 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76800f670 con 0x7ff77806a260 2023-08-31T19:07:25.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.280+0000 7ff76ffff700 1 -- 172.21.15.72:0/1990510279 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76800f9f0 con 0x7ff77806a260 2023-08-31T19:07:25.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.281+0000 7ff77f5ff700 1 -- 172.21.15.72:0/1990510279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff77806a260 msgr2=0x7ff778069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:25.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.281+0000 7ff77f5ff700 1 --2- 172.21.15.72:0/1990510279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff77806a260 0x7ff778069550 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7ff7780c7670 tx=0x7ff768009060).stop 2023-08-31T19:07:25.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.281+0000 7ff77f5ff700 1 -- 172.21.15.72:0/1990510279 shutdown_connections 2023-08-31T19:07:25.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.281+0000 7ff77f5ff700 1 --2- 172.21.15.72:0/1990510279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff77806a260 0x7ff778069550 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.281+0000 7ff77f5ff700 1 -- 172.21.15.72:0/1990510279 >> 172.21.15.72:0/1990510279 conn(0x7ff7780c6b10 msgr2=0x7ff7780c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:25.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.281+0000 7ff77f5ff700 1 -- 172.21.15.72:0/1990510279 shutdown_connections 2023-08-31T19:07:25.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.281+0000 7ff77f5ff700 1 -- 172.21.15.72:0/1990510279 wait complete. 2023-08-31T19:07:25.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.283+0000 7ff77f5ff700 1 Processor -- start 2023-08-31T19:07:25.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.283+0000 7ff77f5ff700 1 -- start start 2023-08-31T19:07:25.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77f5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff778065710 0x7ff7781673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:25.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77f5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff778069170 0x7ff7780a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:25.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77f5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff77806a260 0x7ff7780a91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:25.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77f5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff778164690 con 0x7ff77806a260 2023-08-31T19:07:25.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77f5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff778164910 con 0x7ff778069170 2023-08-31T19:07:25.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77f5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff778164bf0 con 0x7ff778065710 2023-08-31T19:07:25.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77db9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff77806a260 0x7ff7780a91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:25.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77db9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff77806a260 0x7ff7780a91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45400/0 (socket says 172.21.15.72:45400) 2023-08-31T19:07:25.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77db9c700 1 -- 172.21.15.72:0/2548532171 learned_addr learned my addr 172.21.15.72:0/2548532171 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:25.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77d39b700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff778065710 0x7ff7781673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:25.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77cb9a700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff778069170 0x7ff7780a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:25.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77db9c700 1 -- 172.21.15.72:0/2548532171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff778065710 msgr2=0x7ff7781673b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:25.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77db9c700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff778065710 0x7ff7781673b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77db9c700 1 -- 172.21.15.72:0/2548532171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff778069170 msgr2=0x7ff7780a8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:25.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77db9c700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff778069170 0x7ff7780a8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77db9c700 1 -- 172.21.15.72:0/2548532171 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7680092a0 con 0x7ff77806a260 2023-08-31T19:07:25.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77cb9a700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff778069170 0x7ff7780a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:25.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.284+0000 7ff77d39b700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff778065710 0x7ff7781673b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:25.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.285+0000 7ff77db9c700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff77806a260 0x7ff7780a91d0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7ff77000c7c0 tx=0x7ff770001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:25.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.285+0000 7ff76d7fa700 1 -- 172.21.15.72:0/2548532171 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff770010510 con 0x7ff77806a260 2023-08-31T19:07:25.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.285+0000 7ff76d7fa700 1 -- 172.21.15.72:0/2548532171 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff770010670 con 0x7ff77806a260 2023-08-31T19:07:25.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.285+0000 7ff76d7fa700 1 -- 172.21.15.72:0/2548532171 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7700109f0 con 0x7ff77806a260 2023-08-31T19:07:25.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.285+0000 7ff77f5ff700 1 -- 172.21.15.72:0/2548532171 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff778164ed0 con 0x7ff77806a260 2023-08-31T19:07:25.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.285+0000 7ff77f5ff700 1 -- 172.21.15.72:0/2548532171 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7781678a0 con 0x7ff77806a260 2023-08-31T19:07:25.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.286+0000 7ff77f5ff700 1 -- 172.21.15.72:0/2548532171 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77806c6b0 con 0x7ff77806a260 2023-08-31T19:07:25.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.287+0000 7ff76d7fa700 1 -- 172.21.15.72:0/2548532171 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7ff77001b400 con 0x7ff77806a260 2023-08-31T19:07:25.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.288+0000 7ff76d7fa700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff75c05ef30 0x7ff75c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:25.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.288+0000 7ff76d7fa700 1 -- 172.21.15.72:0/2548532171 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7ff77007a0f0 con 0x7ff77806a260 2023-08-31T19:07:25.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.288+0000 7ff77d39b700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff75c05ef30 0x7ff75c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:25.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.289+0000 7ff77d39b700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff75c05ef30 0x7ff75c0613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff778153da0 tx=0x7ff774009040).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:25.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.292+0000 7ff76d7fa700 1 -- 172.21.15.72:0/2548532171 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff77004b110 con 0x7ff77806a260 2023-08-31T19:07:25.309 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:07:25.314 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:07:25.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.470+0000 7ff77f5ff700 1 -- 172.21.15.72:0/2548532171 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7780bcec0 con 0x7ff77806a260 2023-08-31T19:07:25.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.471+0000 7ff76d7fa700 1 -- 172.21.15.72:0/2548532171 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+17991 (secure 0 0 0) 0x7ff77004e730 con 0x7ff77806a260 2023-08-31T19:07:25.472 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:25.472 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":142,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:07:22.610815+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:07:20.032158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-31T19:07:20.589299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:07:25.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.473+0000 7ff77f5ff700 1 -- 172.21.15.72:0/2548532171 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff75c05ef30 msgr2=0x7ff75c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:25.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.473+0000 7ff77f5ff700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff75c05ef30 0x7ff75c0613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff778153da0 tx=0x7ff774009040).stop 2023-08-31T19:07:25.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.473+0000 7ff77f5ff700 1 -- 172.21.15.72:0/2548532171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff77806a260 msgr2=0x7ff7780a91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.473+0000 7ff77f5ff700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff77806a260 0x7ff7780a91d0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7ff77000c7c0 tx=0x7ff770001560).stop 2023-08-31T19:07:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.474+0000 7ff77f5ff700 1 -- 172.21.15.72:0/2548532171 shutdown_connections 2023-08-31T19:07:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.474+0000 7ff77f5ff700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff77806a260 0x7ff7780a91d0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.474+0000 7ff77f5ff700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff778065710 0x7ff7781673b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.474+0000 7ff77f5ff700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff75c05ef30 0x7ff75c0613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.474+0000 7ff77f5ff700 1 --2- 172.21.15.72:0/2548532171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff778069170 0x7ff7780a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.474+0000 7ff77f5ff700 1 -- 172.21.15.72:0/2548532171 >> 172.21.15.72:0/2548532171 conn(0x7ff7780c6b10 msgr2=0x7ff7780c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.474+0000 7ff77f5ff700 1 -- 172.21.15.72:0/2548532171 shutdown_connections 2023-08-31T19:07:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.474+0000 7ff77f5ff700 1 -- 172.21.15.72:0/2548532171 wait complete. 2023-08-31T19:07:25.492 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T19:07:25.493 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:07:25.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.685+0000 7f2ee9fff700 1 Processor -- start 2023-08-31T19:07:25.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.685+0000 7f2ee9fff700 1 -- start start 2023-08-31T19:07:25.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.686+0000 7f2ee9fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee4156310 0x7f2ee40c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:25.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.686+0000 7f2ee9fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2ee40bba70 0x7f2ee40c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:25.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.686+0000 7f2ee9fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee40c26b0 con 0x7f2ee4135030 2023-08-31T19:07:25.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.686+0000 7f2ee9fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee40c1e80 con 0x7f2ee40bba70 2023-08-31T19:07:25.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.686+0000 7f2ee9fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40bc250 con 0x7f2ee4156310 2023-08-31T19:07:25.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.687+0000 7f2ee3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2ee40bba70 0x7f2ee40c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:25.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.687+0000 7f2ee3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2ee40bba70 0x7f2ee40c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45406/0 (socket says 172.21.15.72:45406) 2023-08-31T19:07:25.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.687+0000 7f2ee3fff700 1 -- 172.21.15.72:0/804035826 learned_addr learned my addr 172.21.15.72:0/804035826 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:25.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.687+0000 7f2ee2ffd700 1 --2- 172.21.15.72:0/804035826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee4156310 0x7f2ee40c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:25.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.687+0000 7f2ee3fff700 1 -- 172.21.15.72:0/804035826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee4156310 msgr2=0x7f2ee40c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:25.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.687+0000 7f2ee3fff700 1 --2- 172.21.15.72:0/804035826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee4156310 0x7f2ee40c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.687+0000 7f2ee3fff700 1 -- 172.21.15.72:0/804035826 >> v1:172.21.15.146:6789/0 conn(0x7f2ee4135030 legacy=0x7f2ee4155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:25.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.687+0000 7f2ee3fff700 1 -- 172.21.15.72:0/804035826 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40bbf70 con 0x7f2ee40bba70 2023-08-31T19:07:25.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.687+0000 7f2ee3fff700 1 --2- 172.21.15.72:0/804035826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ee40bba70 0x7f2ee40c2b40 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f2edc009f20 tx=0x7f2edc009840).ready entity=mon.0 client_cookie=6c8a161c893cb151 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:25.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.688+0000 7f2ee27fc700 1 -- 172.21.15.72:0/804035826 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc00e070 con 0x7f2ee40bba70 2023-08-31T19:07:25.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.688+0000 7f2ee27fc700 1 -- 172.21.15.72:0/804035826 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc00b9d0 con 0x7f2ee40bba70 2023-08-31T19:07:25.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.688+0000 7f2ee27fc700 1 -- 172.21.15.72:0/804035826 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc00bd50 con 0x7f2ee40bba70 2023-08-31T19:07:25.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.688+0000 7f2ee9fff700 1 -- 172.21.15.72:0/804035826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ee40bba70 msgr2=0x7f2ee40c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:25.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.688+0000 7f2ee9fff700 1 --2- 172.21.15.72:0/804035826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ee40bba70 0x7f2ee40c2b40 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f2edc009f20 tx=0x7f2edc009840).stop 2023-08-31T19:07:25.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.688+0000 7f2ee9fff700 1 -- 172.21.15.72:0/804035826 shutdown_connections 2023-08-31T19:07:25.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.688+0000 7f2ee9fff700 1 --2- 172.21.15.72:0/804035826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ee40bba70 0x7f2ee40c2b40 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.688+0000 7f2ee9fff700 1 --2- 172.21.15.72:0/804035826 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee4156310 0x7f2ee40c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.688+0000 7f2ee9fff700 1 -- 172.21.15.72:0/804035826 >> 172.21.15.72:0/804035826 conn(0x7f2ee40c6b10 msgr2=0x7f2ee40c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:25.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.688+0000 7f2ee9fff700 1 -- 172.21.15.72:0/804035826 shutdown_connections 2023-08-31T19:07:25.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.688+0000 7f2ee9fff700 1 -- 172.21.15.72:0/804035826 wait complete. 2023-08-31T19:07:25.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.690+0000 7f2ee9fff700 1 Processor -- start 2023-08-31T19:07:25.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.690+0000 7f2ee9fff700 1 -- start start 2023-08-31T19:07:25.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.691+0000 7f2ee9fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee40bba70 0x7f2ee4134780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:25.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.691+0000 7f2ee9fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee4135030 0x7f2ee40a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:25.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.691+0000 7f2ee9fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ee4156310 0x7f2ee4135ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:25.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.691+0000 7f2ee9fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40ab0a0 con 0x7f2ee4156310 2023-08-31T19:07:25.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.691+0000 7f2ee9fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40ab380 con 0x7f2ee4135030 2023-08-31T19:07:25.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.691+0000 7f2ee9fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40a5170 con 0x7f2ee40bba70 2023-08-31T19:07:25.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.691+0000 7f2ee3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ee4156310 0x7f2ee4135ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:25.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.691+0000 7f2ee3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ee4156310 0x7f2ee4135ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45412/0 (socket says 172.21.15.72:45412) 2023-08-31T19:07:25.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.691+0000 7f2ee3fff700 1 -- 172.21.15.72:0/3351431229 learned_addr learned my addr 172.21.15.72:0/3351431229 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:25.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.691+0000 7f2ee37fe700 1 --2- 172.21.15.72:0/3351431229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee40bba70 0x7f2ee4134780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:25.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.691+0000 7f2ee2ffd700 1 --2- 172.21.15.72:0/3351431229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee4135030 0x7f2ee40a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:25.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.692+0000 7f2ee3fff700 1 -- 172.21.15.72:0/3351431229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee40bba70 msgr2=0x7f2ee4134780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:25.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.692+0000 7f2ee3fff700 1 --2- 172.21.15.72:0/3351431229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee40bba70 0x7f2ee4134780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.692+0000 7f2ee3fff700 1 -- 172.21.15.72:0/3351431229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee4135030 msgr2=0x7f2ee40a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:25.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.692+0000 7f2ee3fff700 1 --2- 172.21.15.72:0/3351431229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee4135030 0x7f2ee40a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.692+0000 7f2ee3fff700 1 -- 172.21.15.72:0/3351431229 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc009ae0 con 0x7f2ee4156310 2023-08-31T19:07:25.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.692+0000 7f2ee3fff700 1 --2- 172.21.15.72:0/3351431229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ee4156310 0x7f2ee4135ca0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f2edc00b610 tx=0x7f2edc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:25.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.692+0000 7f2ecb7fe700 1 -- 172.21.15.72:0/3351431229 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc0092e0 con 0x7f2ee4156310 2023-08-31T19:07:25.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.692+0000 7f2ecb7fe700 1 -- 172.21.15.72:0/3351431229 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc01e470 con 0x7f2ee4156310 2023-08-31T19:07:25.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.692+0000 7f2ecb7fe700 1 -- 172.21.15.72:0/3351431229 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc01e830 con 0x7f2ee4156310 2023-08-31T19:07:25.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.692+0000 7f2ee9fff700 1 -- 172.21.15.72:0/3351431229 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee40a5450 con 0x7f2ee4156310 2023-08-31T19:07:25.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.692+0000 7f2ee9fff700 1 -- 172.21.15.72:0/3351431229 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee40a4d30 con 0x7f2ee4156310 2023-08-31T19:07:25.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.693+0000 7f2ee9fff700 1 -- 172.21.15.72:0/3351431229 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee40ab510 con 0x7f2ee4156310 2023-08-31T19:07:25.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.694+0000 7f2ecb7fe700 1 -- 172.21.15.72:0/3351431229 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2edc003040 con 0x7f2ee4156310 2023-08-31T19:07:25.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.695+0000 7f2ecb7fe700 1 --2- 172.21.15.72:0/3351431229 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2ed005ef30 0x7f2ed00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:25.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.695+0000 7f2ecb7fe700 1 -- 172.21.15.72:0/3351431229 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f2edc07b510 con 0x7f2ee4156310 2023-08-31T19:07:25.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.695+0000 7f2ee37fe700 1 --2- 172.21.15.72:0/3351431229 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2ed005ef30 0x7f2ed00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:25.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.696+0000 7f2ee37fe700 1 --2- 172.21.15.72:0/3351431229 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2ed005ef30 0x7f2ed00613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2ed4003900 tx=0x7f2ed4007d40).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:25.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.699+0000 7f2ecb7fe700 1 -- 172.21.15.72:0/3351431229 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2edc04c640 con 0x7f2ee4156310 2023-08-31T19:07:25.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.864+0000 7f2ee9fff700 1 -- 172.21.15.72:0/3351431229 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ee40c2060 con 0x7f2ed005ef30 2023-08-31T19:07:25.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.877+0000 7f2ecb7fe700 1 -- 172.21.15.72:0/3351431229 <== mgr.7857 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361737 (secure 0 0 0) 0x7f2ee40c2060 con 0x7f2ed005ef30 2023-08-31T19:07:25.881 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:25.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.881+0000 7f2ee9fff700 1 -- 172.21.15.72:0/3351431229 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2ed005ef30 msgr2=0x7f2ed00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:25.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.881+0000 7f2ee9fff700 1 --2- 172.21.15.72:0/3351431229 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2ed005ef30 0x7f2ed00613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2ed4003900 tx=0x7f2ed4007d40).stop 2023-08-31T19:07:25.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.881+0000 7f2ee9fff700 1 -- 172.21.15.72:0/3351431229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ee4156310 msgr2=0x7f2ee4135ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:25.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.881+0000 7f2ee9fff700 1 --2- 172.21.15.72:0/3351431229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ee4156310 0x7f2ee4135ca0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f2edc00b610 tx=0x7f2edc009840).stop 2023-08-31T19:07:25.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.881+0000 7f2ee9fff700 1 -- 172.21.15.72:0/3351431229 shutdown_connections 2023-08-31T19:07:25.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.881+0000 7f2ee9fff700 1 --2- 172.21.15.72:0/3351431229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ee4156310 0x7f2ee4135ca0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.881+0000 7f2ee9fff700 1 --2- 172.21.15.72:0/3351431229 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2ee40bba70 0x7f2ee4134780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.881+0000 7f2ee9fff700 1 --2- 172.21.15.72:0/3351431229 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2ed005ef30 0x7f2ed00613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.881+0000 7f2ee9fff700 1 --2- 172.21.15.72:0/3351431229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee4135030 0x7f2ee40a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:25.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.881+0000 7f2ee9fff700 1 -- 172.21.15.72:0/3351431229 >> 172.21.15.72:0/3351431229 conn(0x7f2ee40c6b10 msgr2=0x7f2ee40c6330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:25.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.882+0000 7f2ee9fff700 1 -- 172.21.15.72:0/3351431229 shutdown_connections 2023-08-31T19:07:25.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:25.882+0000 7f2ee9fff700 1 -- 172.21.15.72:0/3351431229 wait complete. 2023-08-31T19:07:25.887 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:07:25.899 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-31T19:07:24.104083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":220,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2423360,"kb_used_data":13824,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752551360,"statfs":{"total":773094113280,"available":770612592640,"internally_reserved":0,"allocated":14155776,"data_stored":7537932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20932,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-72,"num_write_kb":-47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.014396"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.638695+0000","last_change":"2023-08-31T19:07:21.630196+0000","last_active":"2023-08-31T19:07:21.638695+0000","last_peered":"2023-08-31T19:07:21.638695+0000","last_clean":"2023-08-31T19:07:21.638695+0000","last_became_active":"2023-08-31T19:07:21.629874+0000","last_became_peered":"2023-08-31T19:07:21.629874+0000","last_unstale":"2023-08-31T19:07:21.638695+0000","last_undegraded":"2023-08-31T19:07:21.638695+0000","last_fullsized":"2023-08-31T19:07:21.638695+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"141'3","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.644313+0000","last_change":"2023-08-31T19:07:21.156879+0000","last_active":"2023-08-31T19:07:21.644313+0000","last_peered":"2023-08-31T19:07:21.644313+0000","last_clean":"2023-08-31T19:07:21.644313+0000","last_became_active":"2023-08-31T19:07:21.156438+0000","last_became_peered":"2023-08-31T19:07:21.156438+0000","last_unstale":"2023-08-31T19:07:21.644313+0000","last_undegraded":"2023-08-31T19:07:21.644313+0000","last_fullsized":"2023-08-31T19:07:21.644313+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.644857+0000","last_change":"2023-08-31T19:07:21.636089+0000","last_active":"2023-08-31T19:07:21.644857+0000","last_peered":"2023-08-31T19:07:21.644857+0000","last_clean":"2023-08-31T19:07:21.644857+0000","last_became_active":"2023-08-31T19:07:21.632549+0000","last_became_peered":"2023-08-31T19:07:21.632549+0000","last_unstale":"2023-08-31T19:07:21.644857+0000","last_undegraded":"2023-08-31T19:07:21.644857+0000","last_fullsized":"2023-08-31T19:07:21.644857+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622019+0000","last_change":"2023-08-31T19:07:21.172314+0000","last_active":"2023-08-31T19:07:21.622019+0000","last_peered":"2023-08-31T19:07:21.622019+0000","last_clean":"2023-08-31T19:07:21.622019+0000","last_became_active":"2023-08-31T19:07:21.171887+0000","last_became_peered":"2023-08-31T19:07:21.171887+0000","last_unstale":"2023-08-31T19:07:21.622019+0000","last_undegraded":"2023-08-31T19:07:21.622019+0000","last_fullsized":"2023-08-31T19:07:21.622019+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649620+0000","last_change":"2023-08-31T19:07:21.647425+0000","last_active":"2023-08-31T19:07:21.649620+0000","last_peered":"2023-08-31T19:07:21.649620+0000","last_clean":"2023-08-31T19:07:21.649620+0000","last_became_active":"2023-08-31T19:07:21.647169+0000","last_became_peered":"2023-08-31T19:07:21.647169+0000","last_unstale":"2023-08-31T19:07:21.649620+0000","last_undegraded":"2023-08-31T19:07:21.649620+0000","last_fullsized":"2023-08-31T19:07:21.649620+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615685+0000","last_change":"2023-08-31T19:07:21.169128+0000","last_active":"2023-08-31T19:07:21.615685+0000","last_peered":"2023-08-31T19:07:21.615685+0000","last_clean":"2023-08-31T19:07:21.615685+0000","last_became_active":"2023-08-31T19:07:21.168760+0000","last_became_peered":"2023-08-31T19:07:21.168760+0000","last_unstale":"2023-08-31T19:07:21.615685+0000","last_undegraded":"2023-08-31T19:07:21.615685+0000","last_fullsized":"2023-08-31T19:07:21.615685+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.641533+0000","last_change":"2023-08-31T19:07:21.633311+0000","last_active":"2023-08-31T19:07:21.641533+0000","last_peered":"2023-08-31T19:07:21.641533+0000","last_clean":"2023-08-31T19:07:21.641533+0000","last_became_active":"2023-08-31T19:07:21.632905+0000","last_became_peered":"2023-08-31T19:07:21.632905+0000","last_unstale":"2023-08-31T19:07:21.641533+0000","last_undegraded":"2023-08-31T19:07:21.641533+0000","last_fullsized":"2023-08-31T19:07:21.641533+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643590+0000","last_change":"2023-08-31T19:07:21.166414+0000","last_active":"2023-08-31T19:07:21.643590+0000","last_peered":"2023-08-31T19:07:21.643590+0000","last_clean":"2023-08-31T19:07:21.643590+0000","last_became_active":"2023-08-31T19:07:21.165148+0000","last_became_peered":"2023-08-31T19:07:21.165148+0000","last_unstale":"2023-08-31T19:07:21.643590+0000","last_undegraded":"2023-08-31T19:07:21.643590+0000","last_fullsized":"2023-08-31T19:07:21.643590+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643884+0000","last_change":"2023-08-31T19:07:21.636343+0000","last_active":"2023-08-31T19:07:21.643884+0000","last_peered":"2023-08-31T19:07:21.643884+0000","last_clean":"2023-08-31T19:07:21.643884+0000","last_became_active":"2023-08-31T19:07:21.632431+0000","last_became_peered":"2023-08-31T19:07:21.632431+0000","last_unstale":"2023-08-31T19:07:21.643884+0000","last_undegraded":"2023-08-31T19:07:21.643884+0000","last_fullsized":"2023-08-31T19:07:21.643884+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645689+0000","last_change":"2023-08-31T19:07:21.172616+0000","last_active":"2023-08-31T19:07:21.645689+0000","last_peered":"2023-08-31T19:07:21.645689+0000","last_clean":"2023-08-31T19:07:21.645689+0000","last_became_active":"2023-08-31T19:07:21.172344+0000","last_became_peered":"2023-08-31T19:07:21.172344+0000","last_unstale":"2023-08-31T19:07:21.645689+0000","last_undegraded":"2023-08-31T19:07:21.645689+0000","last_fullsized":"2023-08-31T19:07:21.645689+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643690+0000","last_change":"2023-08-31T19:07:21.638605+0000","last_active":"2023-08-31T19:07:21.643690+0000","last_peered":"2023-08-31T19:07:21.643690+0000","last_clean":"2023-08-31T19:07:21.643690+0000","last_became_active":"2023-08-31T19:07:21.638353+0000","last_became_peered":"2023-08-31T19:07:21.638353+0000","last_unstale":"2023-08-31T19:07:21.643690+0000","last_undegraded":"2023-08-31T19:07:21.643690+0000","last_fullsized":"2023-08-31T19:07:21.643690+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.638829+0000","last_change":"2023-08-31T19:07:21.173912+0000","last_active":"2023-08-31T19:07:21.638829+0000","last_peered":"2023-08-31T19:07:21.638829+0000","last_clean":"2023-08-31T19:07:21.638829+0000","last_became_active":"2023-08-31T19:07:21.173600+0000","last_became_peered":"2023-08-31T19:07:21.173600+0000","last_unstale":"2023-08-31T19:07:21.638829+0000","last_undegraded":"2023-08-31T19:07:21.638829+0000","last_fullsized":"2023-08-31T19:07:21.638829+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643930+0000","last_change":"2023-08-31T19:07:21.639051+0000","last_active":"2023-08-31T19:07:21.643930+0000","last_peered":"2023-08-31T19:07:21.643930+0000","last_clean":"2023-08-31T19:07:21.643930+0000","last_became_active":"2023-08-31T19:07:21.638770+0000","last_became_peered":"2023-08-31T19:07:21.638770+0000","last_unstale":"2023-08-31T19:07:21.643930+0000","last_undegraded":"2023-08-31T19:07:21.643930+0000","last_fullsized":"2023-08-31T19:07:21.643930+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.621154+0000","last_change":"2023-08-31T19:07:21.164518+0000","last_active":"2023-08-31T19:07:21.621154+0000","last_peered":"2023-08-31T19:07:21.621154+0000","last_clean":"2023-08-31T19:07:21.621154+0000","last_became_active":"2023-08-31T19:07:21.164225+0000","last_became_peered":"2023-08-31T19:07:21.164225+0000","last_unstale":"2023-08-31T19:07:21.621154+0000","last_undegraded":"2023-08-31T19:07:21.621154+0000","last_fullsized":"2023-08-31T19:07:21.621154+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637836+0000","last_change":"2023-08-31T19:07:21.633041+0000","last_active":"2023-08-31T19:07:21.637836+0000","last_peered":"2023-08-31T19:07:21.637836+0000","last_clean":"2023-08-31T19:07:21.637836+0000","last_became_active":"2023-08-31T19:07:21.632737+0000","last_became_peered":"2023-08-31T19:07:21.632737+0000","last_unstale":"2023-08-31T19:07:21.637836+0000","last_undegraded":"2023-08-31T19:07:21.637836+0000","last_fullsized":"2023-08-31T19:07:21.637836+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615117+0000","last_change":"2023-08-31T19:07:21.174602+0000","last_active":"2023-08-31T19:07:21.615117+0000","last_peered":"2023-08-31T19:07:21.615117+0000","last_clean":"2023-08-31T19:07:21.615117+0000","last_became_active":"2023-08-31T19:07:21.174266+0000","last_became_peered":"2023-08-31T19:07:21.174266+0000","last_unstale":"2023-08-31T19:07:21.615117+0000","last_undegraded":"2023-08-31T19:07:21.615117+0000","last_fullsized":"2023-08-31T19:07:21.615117+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643972+0000","last_change":"2023-08-31T19:07:21.639840+0000","last_active":"2023-08-31T19:07:21.643972+0000","last_peered":"2023-08-31T19:07:21.643972+0000","last_clean":"2023-08-31T19:07:21.643972+0000","last_became_active":"2023-08-31T19:07:21.639556+0000","last_became_peered":"2023-08-31T19:07:21.639556+0000","last_unstale":"2023-08-31T19:07:21.643972+0000","last_undegraded":"2023-08-31T19:07:21.643972+0000","last_fullsized":"2023-08-31T19:07:21.643972+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.623093+0000","last_change":"2023-08-31T19:07:21.178091+0000","last_active":"2023-08-31T19:07:21.623093+0000","last_peered":"2023-08-31T19:07:21.623093+0000","last_clean":"2023-08-31T19:07:21.623093+0000","last_became_active":"2023-08-31T19:07:21.177755+0000","last_became_peered":"2023-08-31T19:07:21.177755+0000","last_unstale":"2023-08-31T19:07:21.623093+0000","last_undegraded":"2023-08-31T19:07:21.623093+0000","last_fullsized":"2023-08-31T19:07:21.623093+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637982+0000","last_change":"2023-08-31T19:07:21.632821+0000","last_active":"2023-08-31T19:07:21.637982+0000","last_peered":"2023-08-31T19:07:21.637982+0000","last_clean":"2023-08-31T19:07:21.637982+0000","last_became_active":"2023-08-31T19:07:21.632514+0000","last_became_peered":"2023-08-31T19:07:21.632514+0000","last_unstale":"2023-08-31T19:07:21.637982+0000","last_undegraded":"2023-08-31T19:07:21.637982+0000","last_fullsized":"2023-08-31T19:07:21.637982+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.623990+0000","last_change":"2023-08-31T19:07:21.176372+0000","last_active":"2023-08-31T19:07:21.623990+0000","last_peered":"2023-08-31T19:07:21.623990+0000","last_clean":"2023-08-31T19:07:21.623990+0000","last_became_active":"2023-08-31T19:07:21.176059+0000","last_became_peered":"2023-08-31T19:07:21.176059+0000","last_unstale":"2023-08-31T19:07:21.623990+0000","last_undegraded":"2023-08-31T19:07:21.623990+0000","last_fullsized":"2023-08-31T19:07:21.623990+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649511+0000","last_change":"2023-08-31T19:07:21.637747+0000","last_active":"2023-08-31T19:07:21.649511+0000","last_peered":"2023-08-31T19:07:21.649511+0000","last_clean":"2023-08-31T19:07:21.649511+0000","last_became_active":"2023-08-31T19:07:21.636963+0000","last_became_peered":"2023-08-31T19:07:21.636963+0000","last_unstale":"2023-08-31T19:07:21.649511+0000","last_undegraded":"2023-08-31T19:07:21.649511+0000","last_fullsized":"2023-08-31T19:07:21.649511+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622778+0000","last_change":"2023-08-31T19:07:21.164335+0000","last_active":"2023-08-31T19:07:21.622778+0000","last_peered":"2023-08-31T19:07:21.622778+0000","last_clean":"2023-08-31T19:07:21.622778+0000","last_became_active":"2023-08-31T19:07:21.164038+0000","last_became_peered":"2023-08-31T19:07:21.164038+0000","last_unstale":"2023-08-31T19:07:21.622778+0000","last_undegraded":"2023-08-31T19:07:21.622778+0000","last_fullsized":"2023-08-31T19:07:21.622778+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.646648+0000","last_change":"2023-08-31T19:07:21.645153+0000","last_active":"2023-08-31T19:07:21.646648+0000","last_peered":"2023-08-31T19:07:21.646648+0000","last_clean":"2023-08-31T19:07:21.646648+0000","last_became_active":"2023-08-31T19:07:21.644848+0000","last_became_peered":"2023-08-31T19:07:21.644848+0000","last_unstale":"2023-08-31T19:07:21.646648+0000","last_undegraded":"2023-08-31T19:07:21.646648+0000","last_fullsized":"2023-08-31T19:07:21.646648+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"141'4","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.652288+0000","last_change":"2023-08-31T19:07:21.168414+0000","last_active":"2023-08-31T19:07:21.652288+0000","last_peered":"2023-08-31T19:07:21.652288+0000","last_clean":"2023-08-31T19:07:21.652288+0000","last_became_active":"2023-08-31T19:07:21.168112+0000","last_became_peered":"2023-08-31T19:07:21.168112+0000","last_unstale":"2023-08-31T19:07:21.652288+0000","last_undegraded":"2023-08-31T19:07:21.652288+0000","last_fullsized":"2023-08-31T19:07:21.652288+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649782+0000","last_change":"2023-08-31T19:07:21.646415+0000","last_active":"2023-08-31T19:07:21.649782+0000","last_peered":"2023-08-31T19:07:21.649782+0000","last_clean":"2023-08-31T19:07:21.649782+0000","last_became_active":"2023-08-31T19:07:21.646128+0000","last_became_peered":"2023-08-31T19:07:21.646128+0000","last_unstale":"2023-08-31T19:07:21.649782+0000","last_undegraded":"2023-08-31T19:07:21.649782+0000","last_fullsized":"2023-08-31T19:07:21.649782+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.646212+0000","last_change":"2023-08-31T19:07:21.173914+0000","last_active":"2023-08-31T19:07:21.646212+0000","last_peered":"2023-08-31T19:07:21.646212+0000","last_clean":"2023-08-31T19:07:21.646212+0000","last_became_active":"2023-08-31T19:07:21.173632+0000","last_became_peered":"2023-08-31T19:07:21.173632+0000","last_unstale":"2023-08-31T19:07:21.646212+0000","last_undegraded":"2023-08-31T19:07:21.646212+0000","last_fullsized":"2023-08-31T19:07:21.646212+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637644+0000","last_change":"2023-08-31T19:07:21.633427+0000","last_active":"2023-08-31T19:07:21.637644+0000","last_peered":"2023-08-31T19:07:21.637644+0000","last_clean":"2023-08-31T19:07:21.637644+0000","last_became_active":"2023-08-31T19:07:21.633123+0000","last_became_peered":"2023-08-31T19:07:21.633123+0000","last_unstale":"2023-08-31T19:07:21.637644+0000","last_undegraded":"2023-08-31T19:07:21.637644+0000","last_fullsized":"2023-08-31T19:07:21.637644+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615184+0000","last_change":"2023-08-31T19:07:21.166995+0000","last_active":"2023-08-31T19:07:21.615184+0000","last_peered":"2023-08-31T19:07:21.615184+0000","last_clean":"2023-08-31T19:07:21.615184+0000","last_became_active":"2023-08-31T19:07:21.166211+0000","last_became_peered":"2023-08-31T19:07:21.166211+0000","last_unstale":"2023-08-31T19:07:21.615184+0000","last_undegraded":"2023-08-31T19:07:21.615184+0000","last_fullsized":"2023-08-31T19:07:21.615184+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643909+0000","last_change":"2023-08-31T19:07:21.636049+0000","last_active":"2023-08-31T19:07:21.643909+0000","last_peered":"2023-08-31T19:07:21.643909+0000","last_clean":"2023-08-31T19:07:21.643909+0000","last_became_active":"2023-08-31T19:07:21.634974+0000","last_became_peered":"2023-08-31T19:07:21.634974+0000","last_unstale":"2023-08-31T19:07:21.643909+0000","last_undegraded":"2023-08-31T19:07:21.643909+0000","last_fullsized":"2023-08-31T19:07:21.643909+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.616087+0000","last_change":"2023-08-31T19:07:21.170102+0000","last_active":"2023-08-31T19:07:21.616087+0000","last_peered":"2023-08-31T19:07:21.616087+0000","last_clean":"2023-08-31T19:07:21.616087+0000","last_became_active":"2023-08-31T19:07:21.169819+0000","last_became_peered":"2023-08-31T19:07:21.169819+0000","last_unstale":"2023-08-31T19:07:21.616087+0000","last_undegraded":"2023-08-31T19:07:21.616087+0000","last_fullsized":"2023-08-31T19:07:21.616087+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637101+0000","last_change":"2023-08-31T19:07:21.630346+0000","last_active":"2023-08-31T19:07:21.637101+0000","last_peered":"2023-08-31T19:07:21.637101+0000","last_clean":"2023-08-31T19:07:21.637101+0000","last_became_active":"2023-08-31T19:07:21.630044+0000","last_became_peered":"2023-08-31T19:07:21.630044+0000","last_unstale":"2023-08-31T19:07:21.637101+0000","last_undegraded":"2023-08-31T19:07:21.637101+0000","last_fullsized":"2023-08-31T19:07:21.637101+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"141'4","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.641739+0000","last_change":"2023-08-31T19:07:21.162089+0000","last_active":"2023-08-31T19:07:21.641739+0000","last_peered":"2023-08-31T19:07:21.641739+0000","last_clean":"2023-08-31T19:07:21.641739+0000","last_became_active":"2023-08-31T19:07:21.161799+0000","last_became_peered":"2023-08-31T19:07:21.161799+0000","last_unstale":"2023-08-31T19:07:21.641739+0000","last_undegraded":"2023-08-31T19:07:21.641739+0000","last_fullsized":"2023-08-31T19:07:21.641739+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649418+0000","last_change":"2023-08-31T19:07:21.641005+0000","last_active":"2023-08-31T19:07:21.649418+0000","last_peered":"2023-08-31T19:07:21.649418+0000","last_clean":"2023-08-31T19:07:21.649418+0000","last_became_active":"2023-08-31T19:07:21.640759+0000","last_became_peered":"2023-08-31T19:07:21.640759+0000","last_unstale":"2023-08-31T19:07:21.649418+0000","last_undegraded":"2023-08-31T19:07:21.649418+0000","last_fullsized":"2023-08-31T19:07:21.649418+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.623008+0000","last_change":"2023-08-31T19:07:21.164495+0000","last_active":"2023-08-31T19:07:21.623008+0000","last_peered":"2023-08-31T19:07:21.623008+0000","last_clean":"2023-08-31T19:07:21.623008+0000","last_became_active":"2023-08-31T19:07:21.163815+0000","last_became_peered":"2023-08-31T19:07:21.163815+0000","last_unstale":"2023-08-31T19:07:21.623008+0000","last_undegraded":"2023-08-31T19:07:21.623008+0000","last_fullsized":"2023-08-31T19:07:21.623008+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.642926+0000","last_change":"2023-08-31T19:07:21.640822+0000","last_active":"2023-08-31T19:07:21.642926+0000","last_peered":"2023-08-31T19:07:21.642926+0000","last_clean":"2023-08-31T19:07:21.642926+0000","last_became_active":"2023-08-31T19:07:21.640513+0000","last_became_peered":"2023-08-31T19:07:21.640513+0000","last_unstale":"2023-08-31T19:07:21.642926+0000","last_undegraded":"2023-08-31T19:07:21.642926+0000","last_fullsized":"2023-08-31T19:07:21.642926+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.618250+0000","last_change":"2023-08-31T19:07:21.163286+0000","last_active":"2023-08-31T19:07:21.618250+0000","last_peered":"2023-08-31T19:07:21.618250+0000","last_clean":"2023-08-31T19:07:21.618250+0000","last_became_active":"2023-08-31T19:07:21.162987+0000","last_became_peered":"2023-08-31T19:07:21.162987+0000","last_unstale":"2023-08-31T19:07:21.618250+0000","last_undegraded":"2023-08-31T19:07:21.618250+0000","last_fullsized":"2023-08-31T19:07:21.618250+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649602+0000","last_change":"2023-08-31T19:07:21.647155+0000","last_active":"2023-08-31T19:07:21.649602+0000","last_peered":"2023-08-31T19:07:21.649602+0000","last_clean":"2023-08-31T19:07:21.649602+0000","last_became_active":"2023-08-31T19:07:21.646833+0000","last_became_peered":"2023-08-31T19:07:21.646833+0000","last_unstale":"2023-08-31T19:07:21.649602+0000","last_undegraded":"2023-08-31T19:07:21.649602+0000","last_fullsized":"2023-08-31T19:07:21.649602+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.646202+0000","last_change":"2023-08-31T19:07:21.172345+0000","last_active":"2023-08-31T19:07:21.646202+0000","last_peered":"2023-08-31T19:07:21.646202+0000","last_clean":"2023-08-31T19:07:21.646202+0000","last_became_active":"2023-08-31T19:07:21.171916+0000","last_became_peered":"2023-08-31T19:07:21.171916+0000","last_unstale":"2023-08-31T19:07:21.646202+0000","last_undegraded":"2023-08-31T19:07:21.646202+0000","last_fullsized":"2023-08-31T19:07:21.646202+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637097+0000","last_change":"2023-08-31T19:07:21.630623+0000","last_active":"2023-08-31T19:07:21.637097+0000","last_peered":"2023-08-31T19:07:21.637097+0000","last_clean":"2023-08-31T19:07:21.637097+0000","last_became_active":"2023-08-31T19:07:21.629915+0000","last_became_peered":"2023-08-31T19:07:21.629915+0000","last_unstale":"2023-08-31T19:07:21.637097+0000","last_undegraded":"2023-08-31T19:07:21.637097+0000","last_fullsized":"2023-08-31T19:07:21.637097+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.621725+0000","last_change":"2023-08-31T19:07:21.173368+0000","last_active":"2023-08-31T19:07:21.621725+0000","last_peered":"2023-08-31T19:07:21.621725+0000","last_clean":"2023-08-31T19:07:21.621725+0000","last_became_active":"2023-08-31T19:07:21.172980+0000","last_became_peered":"2023-08-31T19:07:21.172980+0000","last_unstale":"2023-08-31T19:07:21.621725+0000","last_undegraded":"2023-08-31T19:07:21.621725+0000","last_fullsized":"2023-08-31T19:07:21.621725+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645146+0000","last_change":"2023-08-31T19:07:21.635147+0000","last_active":"2023-08-31T19:07:21.645146+0000","last_peered":"2023-08-31T19:07:21.645146+0000","last_clean":"2023-08-31T19:07:21.645146+0000","last_became_active":"2023-08-31T19:07:21.634692+0000","last_became_peered":"2023-08-31T19:07:21.634692+0000","last_unstale":"2023-08-31T19:07:21.645146+0000","last_undegraded":"2023-08-31T19:07:21.645146+0000","last_fullsized":"2023-08-31T19:07:21.645146+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645414+0000","last_change":"2023-08-31T19:07:21.170290+0000","last_active":"2023-08-31T19:07:21.645414+0000","last_peered":"2023-08-31T19:07:21.645414+0000","last_clean":"2023-08-31T19:07:21.645414+0000","last_became_active":"2023-08-31T19:07:21.170017+0000","last_became_peered":"2023-08-31T19:07:21.170017+0000","last_unstale":"2023-08-31T19:07:21.645414+0000","last_undegraded":"2023-08-31T19:07:21.645414+0000","last_fullsized":"2023-08-31T19:07:21.645414+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.647021+0000","last_change":"2023-08-31T19:07:21.646027+0000","last_active":"2023-08-31T19:07:21.647021+0000","last_peered":"2023-08-31T19:07:21.647021+0000","last_clean":"2023-08-31T19:07:21.647021+0000","last_became_active":"2023-08-31T19:07:21.645711+0000","last_became_peered":"2023-08-31T19:07:21.645711+0000","last_unstale":"2023-08-31T19:07:21.647021+0000","last_undegraded":"2023-08-31T19:07:21.647021+0000","last_fullsized":"2023-08-31T19:07:21.647021+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622267+0000","last_change":"2023-08-31T19:07:21.170789+0000","last_active":"2023-08-31T19:07:21.622267+0000","last_peered":"2023-08-31T19:07:21.622267+0000","last_clean":"2023-08-31T19:07:21.622267+0000","last_became_active":"2023-08-31T19:07:21.170457+0000","last_became_peered":"2023-08-31T19:07:21.170457+0000","last_unstale":"2023-08-31T19:07:21.622267+0000","last_undegraded":"2023-08-31T19:07:21.622267+0000","last_fullsized":"2023-08-31T19:07:21.622267+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.641911+0000","last_change":"2023-08-31T19:07:21.638789+0000","last_active":"2023-08-31T19:07:21.641911+0000","last_peered":"2023-08-31T19:07:21.641911+0000","last_clean":"2023-08-31T19:07:21.641911+0000","last_became_active":"2023-08-31T19:07:21.638428+0000","last_became_peered":"2023-08-31T19:07:21.638428+0000","last_unstale":"2023-08-31T19:07:21.641911+0000","last_undegraded":"2023-08-31T19:07:21.641911+0000","last_fullsized":"2023-08-31T19:07:21.641911+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.623097+0000","last_change":"2023-08-31T19:07:21.168504+0000","last_active":"2023-08-31T19:07:21.623097+0000","last_peered":"2023-08-31T19:07:21.623097+0000","last_clean":"2023-08-31T19:07:21.623097+0000","last_became_active":"2023-08-31T19:07:21.168204+0000","last_became_peered":"2023-08-31T19:07:21.168204+0000","last_unstale":"2023-08-31T19:07:21.623097+0000","last_undegraded":"2023-08-31T19:07:21.623097+0000","last_fullsized":"2023-08-31T19:07:21.623097+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637210+0000","last_change":"2023-08-31T19:07:21.626012+0000","last_active":"2023-08-31T19:07:21.637210+0000","last_peered":"2023-08-31T19:07:21.637210+0000","last_clean":"2023-08-31T19:07:21.637210+0000","last_became_active":"2023-08-31T19:07:21.625699+0000","last_became_peered":"2023-08-31T19:07:21.625699+0000","last_unstale":"2023-08-31T19:07:21.637210+0000","last_undegraded":"2023-08-31T19:07:21.637210+0000","last_fullsized":"2023-08-31T19:07:21.637210+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.621858+0000","last_change":"2023-08-31T19:07:21.175304+0000","last_active":"2023-08-31T19:07:21.621858+0000","last_peered":"2023-08-31T19:07:21.621858+0000","last_clean":"2023-08-31T19:07:21.621858+0000","last_became_active":"2023-08-31T19:07:21.174885+0000","last_became_peered":"2023-08-31T19:07:21.174885+0000","last_unstale":"2023-08-31T19:07:21.621858+0000","last_undegraded":"2023-08-31T19:07:21.621858+0000","last_fullsized":"2023-08-31T19:07:21.621858+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643638+0000","last_change":"2023-08-31T19:07:21.638603+0000","last_active":"2023-08-31T19:07:21.643638+0000","last_peered":"2023-08-31T19:07:21.643638+0000","last_clean":"2023-08-31T19:07:21.643638+0000","last_became_active":"2023-08-31T19:07:21.637923+0000","last_became_peered":"2023-08-31T19:07:21.637923+0000","last_unstale":"2023-08-31T19:07:21.643638+0000","last_undegraded":"2023-08-31T19:07:21.643638+0000","last_fullsized":"2023-08-31T19:07:21.643638+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622885+0000","last_change":"2023-08-31T19:07:21.164549+0000","last_active":"2023-08-31T19:07:21.622885+0000","last_peered":"2023-08-31T19:07:21.622885+0000","last_clean":"2023-08-31T19:07:21.622885+0000","last_became_active":"2023-08-31T19:07:21.164212+0000","last_became_peered":"2023-08-31T19:07:21.164212+0000","last_unstale":"2023-08-31T19:07:21.622885+0000","last_undegraded":"2023-08-31T19:07:21.622885+0000","last_fullsized":"2023-08-31T19:07:21.622885+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.642966+0000","last_change":"2023-08-31T19:07:21.640858+0000","last_active":"2023-08-31T19:07:21.642966+0000","last_peered":"2023-08-31T19:07:21.642966+0000","last_clean":"2023-08-31T19:07:21.642966+0000","last_became_active":"2023-08-31T19:07:21.640579+0000","last_became_peered":"2023-08-31T19:07:21.640579+0000","last_unstale":"2023-08-31T19:07:21.642966+0000","last_undegraded":"2023-08-31T19:07:21.642966+0000","last_fullsized":"2023-08-31T19:07:21.642966+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.624903+0000","last_change":"2023-08-31T19:07:21.159656+0000","last_active":"2023-08-31T19:07:21.624903+0000","last_peered":"2023-08-31T19:07:21.624903+0000","last_clean":"2023-08-31T19:07:21.624903+0000","last_became_active":"2023-08-31T19:07:21.159374+0000","last_became_peered":"2023-08-31T19:07:21.159374+0000","last_unstale":"2023-08-31T19:07:21.624903+0000","last_undegraded":"2023-08-31T19:07:21.624903+0000","last_fullsized":"2023-08-31T19:07:21.624903+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.636683+0000","last_change":"2023-08-31T19:07:21.629580+0000","last_active":"2023-08-31T19:07:21.636683+0000","last_peered":"2023-08-31T19:07:21.636683+0000","last_clean":"2023-08-31T19:07:21.636683+0000","last_became_active":"2023-08-31T19:07:21.629316+0000","last_became_peered":"2023-08-31T19:07:21.629316+0000","last_unstale":"2023-08-31T19:07:21.636683+0000","last_undegraded":"2023-08-31T19:07:21.636683+0000","last_fullsized":"2023-08-31T19:07:21.636683+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615456+0000","last_change":"2023-08-31T19:07:21.167337+0000","last_active":"2023-08-31T19:07:21.615456+0000","last_peered":"2023-08-31T19:07:21.615456+0000","last_clean":"2023-08-31T19:07:21.615456+0000","last_became_active":"2023-08-31T19:07:21.167025+0000","last_became_peered":"2023-08-31T19:07:21.167025+0000","last_unstale":"2023-08-31T19:07:21.615456+0000","last_undegraded":"2023-08-31T19:07:21.615456+0000","last_fullsized":"2023-08-31T19:07:21.615456+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.646453+0000","last_change":"2023-08-31T19:07:21.643574+0000","last_active":"2023-08-31T19:07:21.646453+0000","last_peered":"2023-08-31T19:07:21.646453+0000","last_clean":"2023-08-31T19:07:21.646453+0000","last_became_active":"2023-08-31T19:07:21.643252+0000","last_became_peered":"2023-08-31T19:07:21.643252+0000","last_unstale":"2023-08-31T19:07:21.646453+0000","last_undegraded":"2023-08-31T19:07:21.646453+0000","last_fullsized":"2023-08-31T19:07:21.646453+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.621611+0000","last_change":"2023-08-31T19:07:21.174944+0000","last_active":"2023-08-31T19:07:21.621611+0000","last_peered":"2023-08-31T19:07:21.621611+0000","last_clean":"2023-08-31T19:07:21.621611+0000","last_became_active":"2023-08-31T19:07:21.174606+0000","last_became_peered":"2023-08-31T19:07:21.174606+0000","last_unstale":"2023-08-31T19:07:21.621611+0000","last_undegraded":"2023-08-31T19:07:21.621611+0000","last_fullsized":"2023-08-31T19:07:21.621611+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645123+0000","last_change":"2023-08-31T19:07:21.634968+0000","last_active":"2023-08-31T19:07:21.645123+0000","last_peered":"2023-08-31T19:07:21.645123+0000","last_clean":"2023-08-31T19:07:21.645123+0000","last_became_active":"2023-08-31T19:07:21.634325+0000","last_became_peered":"2023-08-31T19:07:21.634325+0000","last_unstale":"2023-08-31T19:07:21.645123+0000","last_undegraded":"2023-08-31T19:07:21.645123+0000","last_fullsized":"2023-08-31T19:07:21.645123+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.624207+0000","last_change":"2023-08-31T19:07:21.168791+0000","last_active":"2023-08-31T19:07:21.624207+0000","last_peered":"2023-08-31T19:07:21.624207+0000","last_clean":"2023-08-31T19:07:21.624207+0000","last_became_active":"2023-08-31T19:07:21.167795+0000","last_became_peered":"2023-08-31T19:07:21.167795+0000","last_unstale":"2023-08-31T19:07:21.624207+0000","last_undegraded":"2023-08-31T19:07:21.624207+0000","last_fullsized":"2023-08-31T19:07:21.624207+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.644998+0000","last_change":"2023-08-31T19:07:21.634207+0000","last_active":"2023-08-31T19:07:21.644998+0000","last_peered":"2023-08-31T19:07:21.644998+0000","last_clean":"2023-08-31T19:07:21.644998+0000","last_became_active":"2023-08-31T19:07:21.633877+0000","last_became_peered":"2023-08-31T19:07:21.633877+0000","last_unstale":"2023-08-31T19:07:21.644998+0000","last_undegraded":"2023-08-31T19:07:21.644998+0000","last_fullsized":"2023-08-31T19:07:21.644998+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622693+0000","last_change":"2023-08-31T19:07:21.172120+0000","last_active":"2023-08-31T19:07:21.622693+0000","last_peered":"2023-08-31T19:07:21.622693+0000","last_clean":"2023-08-31T19:07:21.622693+0000","last_became_active":"2023-08-31T19:07:21.171710+0000","last_became_peered":"2023-08-31T19:07:21.171710+0000","last_unstale":"2023-08-31T19:07:21.622693+0000","last_undegraded":"2023-08-31T19:07:21.622693+0000","last_fullsized":"2023-08-31T19:07:21.622693+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643891+0000","last_change":"2023-08-31T19:07:21.635788+0000","last_active":"2023-08-31T19:07:21.643891+0000","last_peered":"2023-08-31T19:07:21.643891+0000","last_clean":"2023-08-31T19:07:21.643891+0000","last_became_active":"2023-08-31T19:07:21.634663+0000","last_became_peered":"2023-08-31T19:07:21.634663+0000","last_unstale":"2023-08-31T19:07:21.643891+0000","last_undegraded":"2023-08-31T19:07:21.643891+0000","last_fullsized":"2023-08-31T19:07:21.643891+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.623859+0000","last_change":"2023-08-31T19:07:21.160639+0000","last_active":"2023-08-31T19:07:21.623859+0000","last_peered":"2023-08-31T19:07:21.623859+0000","last_clean":"2023-08-31T19:07:21.623859+0000","last_became_active":"2023-08-31T19:07:21.160360+0000","last_became_peered":"2023-08-31T19:07:21.160360+0000","last_unstale":"2023-08-31T19:07:21.623859+0000","last_undegraded":"2023-08-31T19:07:21.623859+0000","last_fullsized":"2023-08-31T19:07:21.623859+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649336+0000","last_change":"2023-08-31T19:07:21.639760+0000","last_active":"2023-08-31T19:07:21.649336+0000","last_peered":"2023-08-31T19:07:21.649336+0000","last_clean":"2023-08-31T19:07:21.649336+0000","last_became_active":"2023-08-31T19:07:21.639485+0000","last_became_peered":"2023-08-31T19:07:21.639485+0000","last_unstale":"2023-08-31T19:07:21.649336+0000","last_undegraded":"2023-08-31T19:07:21.649336+0000","last_fullsized":"2023-08-31T19:07:21.649336+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615647+0000","last_change":"2023-08-31T19:07:21.170254+0000","last_active":"2023-08-31T19:07:21.615647+0000","last_peered":"2023-08-31T19:07:21.615647+0000","last_clean":"2023-08-31T19:07:21.615647+0000","last_became_active":"2023-08-31T19:07:21.169983+0000","last_became_peered":"2023-08-31T19:07:21.169983+0000","last_unstale":"2023-08-31T19:07:21.615647+0000","last_undegraded":"2023-08-31T19:07:21.615647+0000","last_fullsized":"2023-08-31T19:07:21.615647+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649755+0000","last_change":"2023-08-31T19:07:21.642018+0000","last_active":"2023-08-31T19:07:21.649755+0000","last_peered":"2023-08-31T19:07:21.649755+0000","last_clean":"2023-08-31T19:07:21.649755+0000","last_became_active":"2023-08-31T19:07:21.641669+0000","last_became_peered":"2023-08-31T19:07:21.641669+0000","last_unstale":"2023-08-31T19:07:21.649755+0000","last_undegraded":"2023-08-31T19:07:21.649755+0000","last_fullsized":"2023-08-31T19:07:21.649755+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.640283+0000","last_change":"2023-08-31T19:07:21.167435+0000","last_active":"2023-08-31T19:07:21.640283+0000","last_peered":"2023-08-31T19:07:21.640283+0000","last_clean":"2023-08-31T19:07:21.640283+0000","last_became_active":"2023-08-31T19:07:21.167056+0000","last_became_peered":"2023-08-31T19:07:21.167056+0000","last_unstale":"2023-08-31T19:07:21.640283+0000","last_undegraded":"2023-08-31T19:07:21.640283+0000","last_fullsized":"2023-08-31T19:07:21.640283+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.644681+0000","last_change":"2023-08-31T19:07:21.639021+0000","last_active":"2023-08-31T19:07:21.644681+0000","last_peered":"2023-08-31T19:07:21.644681+0000","last_clean":"2023-08-31T19:07:21.644681+0000","last_became_active":"2023-08-31T19:07:21.638744+0000","last_became_peered":"2023-08-31T19:07:21.638744+0000","last_unstale":"2023-08-31T19:07:21.644681+0000","last_undegraded":"2023-08-31T19:07:21.644681+0000","last_fullsized":"2023-08-31T19:07:21.644681+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.640360+0000","last_change":"2023-08-31T19:07:21.173109+0000","last_active":"2023-08-31T19:07:21.640360+0000","last_peered":"2023-08-31T19:07:21.640360+0000","last_clean":"2023-08-31T19:07:21.640360+0000","last_became_active":"2023-08-31T19:07:21.172466+0000","last_became_peered":"2023-08-31T19:07:21.172466+0000","last_unstale":"2023-08-31T19:07:21.640360+0000","last_undegraded":"2023-08-31T19:07:21.640360+0000","last_fullsized":"2023-08-31T19:07:21.640360+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645374+0000","last_change":"2023-08-31T19:07:21.637333+0000","last_active":"2023-08-31T19:07:21.645374+0000","last_peered":"2023-08-31T19:07:21.645374+0000","last_clean":"2023-08-31T19:07:21.645374+0000","last_became_active":"2023-08-31T19:07:21.637026+0000","last_became_peered":"2023-08-31T19:07:21.637026+0000","last_unstale":"2023-08-31T19:07:21.645374+0000","last_undegraded":"2023-08-31T19:07:21.645374+0000","last_fullsized":"2023-08-31T19:07:21.645374+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649775+0000","last_change":"2023-08-31T19:07:21.172258+0000","last_active":"2023-08-31T19:07:21.649775+0000","last_peered":"2023-08-31T19:07:21.649775+0000","last_clean":"2023-08-31T19:07:21.649775+0000","last_became_active":"2023-08-31T19:07:21.171932+0000","last_became_peered":"2023-08-31T19:07:21.171932+0000","last_unstale":"2023-08-31T19:07:21.649775+0000","last_undegraded":"2023-08-31T19:07:21.649775+0000","last_fullsized":"2023-08-31T19:07:21.649775+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.638575+0000","last_change":"2023-08-31T19:07:21.626012+0000","last_active":"2023-08-31T19:07:21.638575+0000","last_peered":"2023-08-31T19:07:21.638575+0000","last_clean":"2023-08-31T19:07:21.638575+0000","last_became_active":"2023-08-31T19:07:21.625588+0000","last_became_peered":"2023-08-31T19:07:21.625588+0000","last_unstale":"2023-08-31T19:07:21.638575+0000","last_undegraded":"2023-08-31T19:07:21.638575+0000","last_fullsized":"2023-08-31T19:07:21.638575+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615505+0000","last_change":"2023-08-31T19:07:21.170586+0000","last_active":"2023-08-31T19:07:21.615505+0000","last_peered":"2023-08-31T19:07:21.615505+0000","last_clean":"2023-08-31T19:07:21.615505+0000","last_became_active":"2023-08-31T19:07:21.170332+0000","last_became_peered":"2023-08-31T19:07:21.170332+0000","last_unstale":"2023-08-31T19:07:21.615505+0000","last_undegraded":"2023-08-31T19:07:21.615505+0000","last_fullsized":"2023-08-31T19:07:21.615505+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.629530+0000","last_change":"2023-08-31T19:07:21.623116+0000","last_active":"2023-08-31T19:07:21.629530+0000","last_peered":"2023-08-31T19:07:21.629530+0000","last_clean":"2023-08-31T19:07:21.629530+0000","last_became_active":"2023-08-31T19:07:21.622801+0000","last_became_peered":"2023-08-31T19:07:21.622801+0000","last_unstale":"2023-08-31T19:07:21.629530+0000","last_undegraded":"2023-08-31T19:07:21.629530+0000","last_fullsized":"2023-08-31T19:07:21.629530+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.624307+0000","last_change":"2023-08-31T19:07:21.172261+0000","last_active":"2023-08-31T19:07:21.624307+0000","last_peered":"2023-08-31T19:07:21.624307+0000","last_clean":"2023-08-31T19:07:21.624307+0000","last_became_active":"2023-08-31T19:07:21.171927+0000","last_became_peered":"2023-08-31T19:07:21.171927+0000","last_unstale":"2023-08-31T19:07:21.624307+0000","last_undegraded":"2023-08-31T19:07:21.624307+0000","last_fullsized":"2023-08-31T19:07:21.624307+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.641076+0000","last_change":"2023-08-31T19:07:21.636518+0000","last_active":"2023-08-31T19:07:21.641076+0000","last_peered":"2023-08-31T19:07:21.641076+0000","last_clean":"2023-08-31T19:07:21.641076+0000","last_became_active":"2023-08-31T19:07:21.636156+0000","last_became_peered":"2023-08-31T19:07:21.636156+0000","last_unstale":"2023-08-31T19:07:21.641076+0000","last_undegraded":"2023-08-31T19:07:21.641076+0000","last_fullsized":"2023-08-31T19:07:21.641076+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.624220+0000","last_change":"2023-08-31T19:07:21.178298+0000","last_active":"2023-08-31T19:07:21.624220+0000","last_peered":"2023-08-31T19:07:21.624220+0000","last_clean":"2023-08-31T19:07:21.624220+0000","last_became_active":"2023-08-31T19:07:21.177826+0000","last_became_peered":"2023-08-31T19:07:21.177826+0000","last_unstale":"2023-08-31T19:07:21.624220+0000","last_undegraded":"2023-08-31T19:07:21.624220+0000","last_fullsized":"2023-08-31T19:07:21.624220+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643864+0000","last_change":"2023-08-31T19:07:21.635549+0000","last_active":"2023-08-31T19:07:21.643864+0000","last_peered":"2023-08-31T19:07:21.643864+0000","last_clean":"2023-08-31T19:07:21.643864+0000","last_became_active":"2023-08-31T19:07:21.634353+0000","last_became_peered":"2023-08-31T19:07:21.634353+0000","last_unstale":"2023-08-31T19:07:21.643864+0000","last_undegraded":"2023-08-31T19:07:21.643864+0000","last_fullsized":"2023-08-31T19:07:21.643864+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.621271+0000","last_change":"2023-08-31T19:07:21.164387+0000","last_active":"2023-08-31T19:07:21.621271+0000","last_peered":"2023-08-31T19:07:21.621271+0000","last_clean":"2023-08-31T19:07:21.621271+0000","last_became_active":"2023-08-31T19:07:21.164093+0000","last_became_peered":"2023-08-31T19:07:21.164093+0000","last_unstale":"2023-08-31T19:07:21.621271+0000","last_undegraded":"2023-08-31T19:07:21.621271+0000","last_fullsized":"2023-08-31T19:07:21.621271+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649503+0000","last_change":"2023-08-31T19:07:21.635446+0000","last_active":"2023-08-31T19:07:21.649503+0000","last_peered":"2023-08-31T19:07:21.649503+0000","last_clean":"2023-08-31T19:07:21.649503+0000","last_became_active":"2023-08-31T19:07:21.635155+0000","last_became_peered":"2023-08-31T19:07:21.635155+0000","last_unstale":"2023-08-31T19:07:21.649503+0000","last_undegraded":"2023-08-31T19:07:21.649503+0000","last_fullsized":"2023-08-31T19:07:21.649503+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.626665+0000","last_change":"2023-08-31T19:07:21.165918+0000","last_active":"2023-08-31T19:07:21.626665+0000","last_peered":"2023-08-31T19:07:21.626665+0000","last_clean":"2023-08-31T19:07:21.626665+0000","last_became_active":"2023-08-31T19:07:21.165607+0000","last_became_peered":"2023-08-31T19:07:21.165607+0000","last_unstale":"2023-08-31T19:07:21.626665+0000","last_undegraded":"2023-08-31T19:07:21.626665+0000","last_fullsized":"2023-08-31T19:07:21.626665+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.647096+0000","last_change":"2023-08-31T19:07:21.644853+0000","last_active":"2023-08-31T19:07:21.647096+0000","last_peered":"2023-08-31T19:07:21.647096+0000","last_clean":"2023-08-31T19:07:21.647096+0000","last_became_active":"2023-08-31T19:07:21.644447+0000","last_became_peered":"2023-08-31T19:07:21.644447+0000","last_unstale":"2023-08-31T19:07:21.647096+0000","last_undegraded":"2023-08-31T19:07:21.647096+0000","last_fullsized":"2023-08-31T19:07:21.647096+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.638706+0000","last_change":"2023-08-31T19:07:21.166415+0000","last_active":"2023-08-31T19:07:21.638706+0000","last_peered":"2023-08-31T19:07:21.638706+0000","last_clean":"2023-08-31T19:07:21.638706+0000","last_became_active":"2023-08-31T19:07:21.166154+0000","last_became_peered":"2023-08-31T19:07:21.166154+0000","last_unstale":"2023-08-31T19:07:21.638706+0000","last_undegraded":"2023-08-31T19:07:21.638706+0000","last_fullsized":"2023-08-31T19:07:21.638706+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.641946+0000","last_change":"2023-08-31T19:07:21.639139+0000","last_active":"2023-08-31T19:07:21.641946+0000","last_peered":"2023-08-31T19:07:21.641946+0000","last_clean":"2023-08-31T19:07:21.641946+0000","last_became_active":"2023-08-31T19:07:21.638770+0000","last_became_peered":"2023-08-31T19:07:21.638770+0000","last_unstale":"2023-08-31T19:07:21.641946+0000","last_undegraded":"2023-08-31T19:07:21.641946+0000","last_fullsized":"2023-08-31T19:07:21.641946+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.641298+0000","last_change":"2023-08-31T19:07:21.179331+0000","last_active":"2023-08-31T19:07:21.641298+0000","last_peered":"2023-08-31T19:07:21.641298+0000","last_clean":"2023-08-31T19:07:21.641298+0000","last_became_active":"2023-08-31T19:07:21.178965+0000","last_became_peered":"2023-08-31T19:07:21.178965+0000","last_unstale":"2023-08-31T19:07:21.641298+0000","last_undegraded":"2023-08-31T19:07:21.641298+0000","last_fullsized":"2023-08-31T19:07:21.641298+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.642661+0000","last_change":"2023-08-31T19:07:21.636857+0000","last_active":"2023-08-31T19:07:21.642661+0000","last_peered":"2023-08-31T19:07:21.642661+0000","last_clean":"2023-08-31T19:07:21.642661+0000","last_became_active":"2023-08-31T19:07:21.636342+0000","last_became_peered":"2023-08-31T19:07:21.636342+0000","last_unstale":"2023-08-31T19:07:21.642661+0000","last_undegraded":"2023-08-31T19:07:21.642661+0000","last_fullsized":"2023-08-31T19:07:21.642661+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.616085+0000","last_change":"2023-08-31T19:07:21.169429+0000","last_active":"2023-08-31T19:07:21.616085+0000","last_peered":"2023-08-31T19:07:21.616085+0000","last_clean":"2023-08-31T19:07:21.616085+0000","last_became_active":"2023-08-31T19:07:21.169032+0000","last_became_peered":"2023-08-31T19:07:21.169032+0000","last_unstale":"2023-08-31T19:07:21.616085+0000","last_undegraded":"2023-08-31T19:07:21.616085+0000","last_fullsized":"2023-08-31T19:07:21.616085+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.647110+0000","last_change":"2023-08-31T19:07:21.646272+0000","last_active":"2023-08-31T19:07:21.647110+0000","last_peered":"2023-08-31T19:07:21.647110+0000","last_clean":"2023-08-31T19:07:21.647110+0000","last_became_active":"2023-08-31T19:07:21.645993+0000","last_became_peered":"2023-08-31T19:07:21.645993+0000","last_unstale":"2023-08-31T19:07:21.647110+0000","last_undegraded":"2023-08-31T19:07:21.647110+0000","last_fullsized":"2023-08-31T19:07:21.647110+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615950+0000","last_change":"2023-08-31T19:07:21.166038+0000","last_active":"2023-08-31T19:07:21.615950+0000","last_peered":"2023-08-31T19:07:21.615950+0000","last_clean":"2023-08-31T19:07:21.615950+0000","last_became_active":"2023-08-31T19:07:21.165742+0000","last_became_peered":"2023-08-31T19:07:21.165742+0000","last_unstale":"2023-08-31T19:07:21.615950+0000","last_undegraded":"2023-08-31T19:07:21.615950+0000","last_fullsized":"2023-08-31T19:07:21.615950+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.644012+0000","last_change":"2023-08-31T19:07:21.639386+0000","last_active":"2023-08-31T19:07:21.644012+0000","last_peered":"2023-08-31T19:07:21.644012+0000","last_clean":"2023-08-31T19:07:21.644012+0000","last_became_active":"2023-08-31T19:07:21.639126+0000","last_became_peered":"2023-08-31T19:07:21.639126+0000","last_unstale":"2023-08-31T19:07:21.644012+0000","last_undegraded":"2023-08-31T19:07:21.644012+0000","last_fullsized":"2023-08-31T19:07:21.644012+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.641061+0000","last_change":"2023-08-31T19:07:21.172278+0000","last_active":"2023-08-31T19:07:21.641061+0000","last_peered":"2023-08-31T19:07:21.641061+0000","last_clean":"2023-08-31T19:07:21.641061+0000","last_became_active":"2023-08-31T19:07:21.171988+0000","last_became_peered":"2023-08-31T19:07:21.171988+0000","last_unstale":"2023-08-31T19:07:21.641061+0000","last_undegraded":"2023-08-31T19:07:21.641061+0000","last_fullsized":"2023-08-31T19:07:21.641061+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.642914+0000","last_change":"2023-08-31T19:07:21.633570+0000","last_active":"2023-08-31T19:07:21.642914+0000","last_peered":"2023-08-31T19:07:21.642914+0000","last_clean":"2023-08-31T19:07:21.642914+0000","last_became_active":"2023-08-31T19:07:21.632447+0000","last_became_peered":"2023-08-31T19:07:21.632447+0000","last_unstale":"2023-08-31T19:07:21.642914+0000","last_undegraded":"2023-08-31T19:07:21.642914+0000","last_fullsized":"2023-08-31T19:07:21.642914+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615308+0000","last_change":"2023-08-31T19:07:21.167197+0000","last_active":"2023-08-31T19:07:21.615308+0000","last_peered":"2023-08-31T19:07:21.615308+0000","last_clean":"2023-08-31T19:07:21.615308+0000","last_became_active":"2023-08-31T19:07:21.166724+0000","last_became_peered":"2023-08-31T19:07:21.166724+0000","last_unstale":"2023-08-31T19:07:21.615308+0000","last_undegraded":"2023-08-31T19:07:21.615308+0000","last_fullsized":"2023-08-31T19:07:21.615308+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643927+0000","last_change":"2023-08-31T19:07:21.636245+0000","last_active":"2023-08-31T19:07:21.643927+0000","last_peered":"2023-08-31T19:07:21.643927+0000","last_clean":"2023-08-31T19:07:21.643927+0000","last_became_active":"2023-08-31T19:07:21.635294+0000","last_became_peered":"2023-08-31T19:07:21.635294+0000","last_unstale":"2023-08-31T19:07:21.643927+0000","last_undegraded":"2023-08-31T19:07:21.643927+0000","last_fullsized":"2023-08-31T19:07:21.643927+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.621532+0000","last_change":"2023-08-31T19:07:21.175963+0000","last_active":"2023-08-31T19:07:21.621532+0000","last_peered":"2023-08-31T19:07:21.621532+0000","last_clean":"2023-08-31T19:07:21.621532+0000","last_became_active":"2023-08-31T19:07:21.175606+0000","last_became_peered":"2023-08-31T19:07:21.175606+0000","last_unstale":"2023-08-31T19:07:21.621532+0000","last_undegraded":"2023-08-31T19:07:21.621532+0000","last_fullsized":"2023-08-31T19:07:21.621532+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645368+0000","last_change":"2023-08-31T19:07:21.635953+0000","last_active":"2023-08-31T19:07:21.645368+0000","last_peered":"2023-08-31T19:07:21.645368+0000","last_clean":"2023-08-31T19:07:21.645368+0000","last_became_active":"2023-08-31T19:07:21.635447+0000","last_became_peered":"2023-08-31T19:07:21.635447+0000","last_unstale":"2023-08-31T19:07:21.645368+0000","last_undegraded":"2023-08-31T19:07:21.645368+0000","last_fullsized":"2023-08-31T19:07:21.645368+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615261+0000","last_change":"2023-08-31T19:07:21.174879+0000","last_active":"2023-08-31T19:07:21.615261+0000","last_peered":"2023-08-31T19:07:21.615261+0000","last_clean":"2023-08-31T19:07:21.615261+0000","last_became_active":"2023-08-31T19:07:21.174596+0000","last_became_peered":"2023-08-31T19:07:21.174596+0000","last_unstale":"2023-08-31T19:07:21.615261+0000","last_undegraded":"2023-08-31T19:07:21.615261+0000","last_fullsized":"2023-08-31T19:07:21.615261+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643656+0000","last_change":"2023-08-31T19:07:21.638772+0000","last_active":"2023-08-31T19:07:21.643656+0000","last_peered":"2023-08-31T19:07:21.643656+0000","last_clean":"2023-08-31T19:07:21.643656+0000","last_became_active":"2023-08-31T19:07:21.638273+0000","last_became_peered":"2023-08-31T19:07:21.638273+0000","last_unstale":"2023-08-31T19:07:21.643656+0000","last_undegraded":"2023-08-31T19:07:21.643656+0000","last_fullsized":"2023-08-31T19:07:21.643656+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.644076+0000","last_change":"2023-08-31T19:07:21.164933+0000","last_active":"2023-08-31T19:07:21.644076+0000","last_peered":"2023-08-31T19:07:21.644076+0000","last_clean":"2023-08-31T19:07:21.644076+0000","last_became_active":"2023-08-31T19:07:21.164612+0000","last_became_peered":"2023-08-31T19:07:21.164612+0000","last_unstale":"2023-08-31T19:07:21.644076+0000","last_undegraded":"2023-08-31T19:07:21.644076+0000","last_fullsized":"2023-08-31T19:07:21.644076+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.636984+0000","last_change":"2023-08-31T19:07:21.628489+0000","last_active":"2023-08-31T19:07:21.636984+0000","last_peered":"2023-08-31T19:07:21.636984+0000","last_clean":"2023-08-31T19:07:21.636984+0000","last_became_active":"2023-08-31T19:07:21.628071+0000","last_became_peered":"2023-08-31T19:07:21.628071+0000","last_unstale":"2023-08-31T19:07:21.636984+0000","last_undegraded":"2023-08-31T19:07:21.636984+0000","last_fullsized":"2023-08-31T19:07:21.636984+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.618131+0000","last_change":"2023-08-31T19:07:21.157544+0000","last_active":"2023-08-31T19:07:21.618131+0000","last_peered":"2023-08-31T19:07:21.618131+0000","last_clean":"2023-08-31T19:07:21.618131+0000","last_became_active":"2023-08-31T19:07:21.157031+0000","last_became_peered":"2023-08-31T19:07:21.157031+0000","last_unstale":"2023-08-31T19:07:21.618131+0000","last_undegraded":"2023-08-31T19:07:21.618131+0000","last_fullsized":"2023-08-31T19:07:21.618131+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637860+0000","last_change":"2023-08-31T19:07:21.630580+0000","last_active":"2023-08-31T19:07:21.637860+0000","last_peered":"2023-08-31T19:07:21.637860+0000","last_clean":"2023-08-31T19:07:21.637860+0000","last_became_active":"2023-08-31T19:07:21.630226+0000","last_became_peered":"2023-08-31T19:07:21.630226+0000","last_unstale":"2023-08-31T19:07:21.637860+0000","last_undegraded":"2023-08-31T19:07:21.637860+0000","last_fullsized":"2023-08-31T19:07:21.637860+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.619516+0000","last_change":"2023-08-31T19:07:21.159213+0000","last_active":"2023-08-31T19:07:21.619516+0000","last_peered":"2023-08-31T19:07:21.619516+0000","last_clean":"2023-08-31T19:07:21.619516+0000","last_became_active":"2023-08-31T19:07:21.158863+0000","last_became_peered":"2023-08-31T19:07:21.158863+0000","last_unstale":"2023-08-31T19:07:21.619516+0000","last_undegraded":"2023-08-31T19:07:21.619516+0000","last_fullsized":"2023-08-31T19:07:21.619516+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.632357+0000","last_change":"2023-08-31T19:07:21.630190+0000","last_active":"2023-08-31T19:07:21.632357+0000","last_peered":"2023-08-31T19:07:21.632357+0000","last_clean":"2023-08-31T19:07:21.632357+0000","last_became_active":"2023-08-31T19:07:21.629865+0000","last_became_peered":"2023-08-31T19:07:21.629865+0000","last_unstale":"2023-08-31T19:07:21.632357+0000","last_undegraded":"2023-08-31T19:07:21.632357+0000","last_fullsized":"2023-08-31T19:07:21.632357+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.629638+0000","last_change":"2023-08-31T19:07:21.166225+0000","last_active":"2023-08-31T19:07:21.629638+0000","last_peered":"2023-08-31T19:07:21.629638+0000","last_clean":"2023-08-31T19:07:21.629638+0000","last_became_active":"2023-08-31T19:07:21.164139+0000","last_became_peered":"2023-08-31T19:07:21.164139+0000","last_unstale":"2023-08-31T19:07:21.629638+0000","last_undegraded":"2023-08-31T19:07:21.629638+0000","last_fullsized":"2023-08-31T19:07:21.629638+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645144+0000","last_change":"2023-08-31T19:07:21.642501+0000","last_active":"2023-08-31T19:07:21.645144+0000","last_peered":"2023-08-31T19:07:21.645144+0000","last_clean":"2023-08-31T19:07:21.645144+0000","last_became_active":"2023-08-31T19:07:21.640112+0000","last_became_peered":"2023-08-31T19:07:21.640112+0000","last_unstale":"2023-08-31T19:07:21.645144+0000","last_undegraded":"2023-08-31T19:07:21.645144+0000","last_fullsized":"2023-08-31T19:07:21.645144+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.624418+0000","last_change":"2023-08-31T19:07:21.169747+0000","last_active":"2023-08-31T19:07:21.624418+0000","last_peered":"2023-08-31T19:07:21.624418+0000","last_clean":"2023-08-31T19:07:21.624418+0000","last_became_active":"2023-08-31T19:07:21.169478+0000","last_became_peered":"2023-08-31T19:07:21.169478+0000","last_unstale":"2023-08-31T19:07:21.624418+0000","last_undegraded":"2023-08-31T19:07:21.624418+0000","last_fullsized":"2023-08-31T19:07:21.624418+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.642895+0000","last_change":"2023-08-31T19:07:21.633394+0000","last_active":"2023-08-31T19:07:21.642895+0000","last_peered":"2023-08-31T19:07:21.642895+0000","last_clean":"2023-08-31T19:07:21.642895+0000","last_became_active":"2023-08-31T19:07:21.632836+0000","last_became_peered":"2023-08-31T19:07:21.632836+0000","last_unstale":"2023-08-31T19:07:21.642895+0000","last_undegraded":"2023-08-31T19:07:21.642895+0000","last_fullsized":"2023-08-31T19:07:21.642895+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622062+0000","last_change":"2023-08-31T19:07:21.170517+0000","last_active":"2023-08-31T19:07:21.622062+0000","last_peered":"2023-08-31T19:07:21.622062+0000","last_clean":"2023-08-31T19:07:21.622062+0000","last_became_active":"2023-08-31T19:07:21.170258+0000","last_became_peered":"2023-08-31T19:07:21.170258+0000","last_unstale":"2023-08-31T19:07:21.622062+0000","last_undegraded":"2023-08-31T19:07:21.622062+0000","last_fullsized":"2023-08-31T19:07:21.622062+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645481+0000","last_change":"2023-08-31T19:07:21.643018+0000","last_active":"2023-08-31T19:07:21.645481+0000","last_peered":"2023-08-31T19:07:21.645481+0000","last_clean":"2023-08-31T19:07:21.645481+0000","last_became_active":"2023-08-31T19:07:21.642673+0000","last_became_peered":"2023-08-31T19:07:21.642673+0000","last_unstale":"2023-08-31T19:07:21.645481+0000","last_undegraded":"2023-08-31T19:07:21.645481+0000","last_fullsized":"2023-08-31T19:07:21.645481+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.623967+0000","last_change":"2023-08-31T19:07:21.166014+0000","last_active":"2023-08-31T19:07:21.623967+0000","last_peered":"2023-08-31T19:07:21.623967+0000","last_clean":"2023-08-31T19:07:21.623967+0000","last_became_active":"2023-08-31T19:07:21.165743+0000","last_became_peered":"2023-08-31T19:07:21.165743+0000","last_unstale":"2023-08-31T19:07:21.623967+0000","last_undegraded":"2023-08-31T19:07:21.623967+0000","last_fullsized":"2023-08-31T19:07:21.623967+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.631550+0000","last_change":"2023-08-31T19:07:21.626438+0000","last_active":"2023-08-31T19:07:21.631550+0000","last_peered":"2023-08-31T19:07:21.631550+0000","last_clean":"2023-08-31T19:07:21.631550+0000","last_became_active":"2023-08-31T19:07:21.626161+0000","last_became_peered":"2023-08-31T19:07:21.626161+0000","last_unstale":"2023-08-31T19:07:21.631550+0000","last_undegraded":"2023-08-31T19:07:21.631550+0000","last_fullsized":"2023-08-31T19:07:21.631550+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.616276+0000","last_change":"2023-08-31T19:07:21.166722+0000","last_active":"2023-08-31T19:07:21.616276+0000","last_peered":"2023-08-31T19:07:21.616276+0000","last_clean":"2023-08-31T19:07:21.616276+0000","last_became_active":"2023-08-31T19:07:21.166463+0000","last_became_peered":"2023-08-31T19:07:21.166463+0000","last_unstale":"2023-08-31T19:07:21.616276+0000","last_undegraded":"2023-08-31T19:07:21.616276+0000","last_fullsized":"2023-08-31T19:07:21.616276+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.639687+0000","last_change":"2023-08-31T19:07:21.635226+0000","last_active":"2023-08-31T19:07:21.639687+0000","last_peered":"2023-08-31T19:07:21.639687+0000","last_clean":"2023-08-31T19:07:21.639687+0000","last_became_active":"2023-08-31T19:07:21.634908+0000","last_became_peered":"2023-08-31T19:07:21.634908+0000","last_unstale":"2023-08-31T19:07:21.639687+0000","last_undegraded":"2023-08-31T19:07:21.639687+0000","last_fullsized":"2023-08-31T19:07:21.639687+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.618716+0000","last_change":"2023-08-31T19:07:21.158571+0000","last_active":"2023-08-31T19:07:21.618716+0000","last_peered":"2023-08-31T19:07:21.618716+0000","last_clean":"2023-08-31T19:07:21.618716+0000","last_became_active":"2023-08-31T19:07:21.158124+0000","last_became_peered":"2023-08-31T19:07:21.158124+0000","last_unstale":"2023-08-31T19:07:21.618716+0000","last_undegraded":"2023-08-31T19:07:21.618716+0000","last_fullsized":"2023-08-31T19:07:21.618716+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":128,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615593+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:07:21.615593+0000","last_peered":"2023-08-31T19:07:21.615593+0000","last_clean":"2023-08-31T19:07:21.615593+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:07:21.615593+0000","last_undegraded":"2023-08-31T19:07:21.615593+0000","last_fullsized":"2023-08-31T19:07:21.615593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637250+0000","last_change":"2023-08-31T19:07:21.633563+0000","last_active":"2023-08-31T19:07:21.637250+0000","last_peered":"2023-08-31T19:07:21.637250+0000","last_clean":"2023-08-31T19:07:21.637250+0000","last_became_active":"2023-08-31T19:07:21.633299+0000","last_became_peered":"2023-08-31T19:07:21.633299+0000","last_unstale":"2023-08-31T19:07:21.637250+0000","last_undegraded":"2023-08-31T19:07:21.637250+0000","last_fullsized":"2023-08-31T19:07:21.637250+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.621432+0000","last_change":"2023-08-31T19:07:21.170192+0000","last_active":"2023-08-31T19:07:21.621432+0000","last_peered":"2023-08-31T19:07:21.621432+0000","last_clean":"2023-08-31T19:07:21.621432+0000","last_became_active":"2023-08-31T19:07:21.169893+0000","last_became_peered":"2023-08-31T19:07:21.169893+0000","last_unstale":"2023-08-31T19:07:21.621432+0000","last_undegraded":"2023-08-31T19:07:21.621432+0000","last_fullsized":"2023-08-31T19:07:21.621432+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":119,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622781+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:07:21.622781+0000","last_peered":"2023-08-31T19:07:21.622781+0000","last_clean":"2023-08-31T19:07:21.622781+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:07:21.622781+0000","last_undegraded":"2023-08-31T19:07:21.622781+0000","last_fullsized":"2023-08-31T19:07:21.622781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.647209+0000","last_change":"2023-08-31T19:07:21.631301+0000","last_active":"2023-08-31T19:07:21.647209+0000","last_peered":"2023-08-31T19:07:21.647209+0000","last_clean":"2023-08-31T19:07:21.647209+0000","last_became_active":"2023-08-31T19:07:21.630965+0000","last_became_peered":"2023-08-31T19:07:21.630965+0000","last_unstale":"2023-08-31T19:07:21.647209+0000","last_undegraded":"2023-08-31T19:07:21.647209+0000","last_fullsized":"2023-08-31T19:07:21.647209+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622364+0000","last_change":"2023-08-31T19:07:21.171627+0000","last_active":"2023-08-31T19:07:21.622364+0000","last_peered":"2023-08-31T19:07:21.622364+0000","last_clean":"2023-08-31T19:07:21.622364+0000","last_became_active":"2023-08-31T19:07:21.171340+0000","last_became_peered":"2023-08-31T19:07:21.171340+0000","last_unstale":"2023-08-31T19:07:21.622364+0000","last_undegraded":"2023-08-31T19:07:21.622364+0000","last_fullsized":"2023-08-31T19:07:21.622364+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":120,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.619660+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:07:21.619660+0000","last_peered":"2023-08-31T19:07:21.619660+0000","last_clean":"2023-08-31T19:07:21.619660+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:07:21.619660+0000","last_undegraded":"2023-08-31T19:07:21.619660+0000","last_fullsized":"2023-08-31T19:07:21.619660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637232+0000","last_change":"2023-08-31T19:07:21.626510+0000","last_active":"2023-08-31T19:07:21.637232+0000","last_peered":"2023-08-31T19:07:21.637232+0000","last_clean":"2023-08-31T19:07:21.637232+0000","last_became_active":"2023-08-31T19:07:21.626200+0000","last_became_peered":"2023-08-31T19:07:21.626200+0000","last_unstale":"2023-08-31T19:07:21.637232+0000","last_undegraded":"2023-08-31T19:07:21.637232+0000","last_fullsized":"2023-08-31T19:07:21.637232+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"141'4","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.646691+0000","last_change":"2023-08-31T19:07:21.175141+0000","last_active":"2023-08-31T19:07:21.646691+0000","last_peered":"2023-08-31T19:07:21.646691+0000","last_clean":"2023-08-31T19:07:21.646691+0000","last_became_active":"2023-08-31T19:07:21.174549+0000","last_became_peered":"2023-08-31T19:07:21.174549+0000","last_unstale":"2023-08-31T19:07:21.646691+0000","last_undegraded":"2023-08-31T19:07:21.646691+0000","last_fullsized":"2023-08-31T19:07:21.646691+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":119,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622843+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:07:21.622843+0000","last_peered":"2023-08-31T19:07:21.622843+0000","last_clean":"2023-08-31T19:07:21.622843+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:07:21.622843+0000","last_undegraded":"2023-08-31T19:07:21.622843+0000","last_fullsized":"2023-08-31T19:07:21.622843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":119,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.616363+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:07:21.616363+0000","last_peered":"2023-08-31T19:07:21.616363+0000","last_clean":"2023-08-31T19:07:21.616363+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:07:21.616363+0000","last_undegraded":"2023-08-31T19:07:21.616363+0000","last_fullsized":"2023-08-31T19:07:21.616363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.639754+0000","last_change":"2023-08-31T19:07:21.635567+0000","last_active":"2023-08-31T19:07:21.639754+0000","last_peered":"2023-08-31T19:07:21.639754+0000","last_clean":"2023-08-31T19:07:21.639754+0000","last_became_active":"2023-08-31T19:07:21.634827+0000","last_became_peered":"2023-08-31T19:07:21.634827+0000","last_unstale":"2023-08-31T19:07:21.639754+0000","last_undegraded":"2023-08-31T19:07:21.639754+0000","last_fullsized":"2023-08-31T19:07:21.639754+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.646124+0000","last_change":"2023-08-31T19:07:21.175852+0000","last_active":"2023-08-31T19:07:21.646124+0000","last_peered":"2023-08-31T19:07:21.646124+0000","last_clean":"2023-08-31T19:07:21.646124+0000","last_became_active":"2023-08-31T19:07:21.175574+0000","last_became_peered":"2023-08-31T19:07:21.175574+0000","last_unstale":"2023-08-31T19:07:21.646124+0000","last_undegraded":"2023-08-31T19:07:21.646124+0000","last_fullsized":"2023-08-31T19:07:21.646124+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.616380+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:07:21.616380+0000","last_peered":"2023-08-31T19:07:21.616380+0000","last_clean":"2023-08-31T19:07:21.616380+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:07:21.616380+0000","last_undegraded":"2023-08-31T19:07:21.616380+0000","last_fullsized":"2023-08-31T19:07:21.616380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645451+0000","last_change":"2023-08-31T19:07:21.638373+0000","last_active":"2023-08-31T19:07:21.645451+0000","last_peered":"2023-08-31T19:07:21.645451+0000","last_clean":"2023-08-31T19:07:21.645451+0000","last_became_active":"2023-08-31T19:07:21.637990+0000","last_became_peered":"2023-08-31T19:07:21.637990+0000","last_unstale":"2023-08-31T19:07:21.645451+0000","last_undegraded":"2023-08-31T19:07:21.645451+0000","last_fullsized":"2023-08-31T19:07:21.645451+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622394+0000","last_change":"2023-08-31T19:07:21.174703+0000","last_active":"2023-08-31T19:07:21.622394+0000","last_peered":"2023-08-31T19:07:21.622394+0000","last_clean":"2023-08-31T19:07:21.622394+0000","last_became_active":"2023-08-31T19:07:21.174425+0000","last_became_peered":"2023-08-31T19:07:21.174425+0000","last_unstale":"2023-08-31T19:07:21.622394+0000","last_undegraded":"2023-08-31T19:07:21.622394+0000","last_fullsized":"2023-08-31T19:07:21.622394+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":118,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.616108+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:07:21.616108+0000","last_peered":"2023-08-31T19:07:21.616108+0000","last_clean":"2023-08-31T19:07:21.616108+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:07:21.616108+0000","last_undegraded":"2023-08-31T19:07:21.616108+0000","last_fullsized":"2023-08-31T19:07:21.616108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.644897+0000","last_change":"2023-08-31T19:07:21.633827+0000","last_active":"2023-08-31T19:07:21.644897+0000","last_peered":"2023-08-31T19:07:21.644897+0000","last_clean":"2023-08-31T19:07:21.644897+0000","last_became_active":"2023-08-31T19:07:21.633547+0000","last_became_peered":"2023-08-31T19:07:21.633547+0000","last_unstale":"2023-08-31T19:07:21.644897+0000","last_undegraded":"2023-08-31T19:07:21.644897+0000","last_fullsized":"2023-08-31T19:07:21.644897+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"141'3","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.646218+0000","last_change":"2023-08-31T19:07:21.170492+0000","last_active":"2023-08-31T19:07:21.646218+0000","last_peered":"2023-08-31T19:07:21.646218+0000","last_clean":"2023-08-31T19:07:21.646218+0000","last_became_active":"2023-08-31T19:07:21.170171+0000","last_became_peered":"2023-08-31T19:07:21.170171+0000","last_unstale":"2023-08-31T19:07:21.646218+0000","last_undegraded":"2023-08-31T19:07:21.646218+0000","last_fullsized":"2023-08-31T19:07:21.646218+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":128,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615593+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:07:21.615593+0000","last_peered":"2023-08-31T19:07:21.615593+0000","last_clean":"2023-08-31T19:07:21.615593+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:07:21.615593+0000","last_undegraded":"2023-08-31T19:07:21.615593+0000","last_fullsized":"2023-08-31T19:07:21.615593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645319+0000","last_change":"2023-08-31T19:07:21.636555+0000","last_active":"2023-08-31T19:07:21.645319+0000","last_peered":"2023-08-31T19:07:21.645319+0000","last_clean":"2023-08-31T19:07:21.645319+0000","last_became_active":"2023-08-31T19:07:21.636096+0000","last_became_peered":"2023-08-31T19:07:21.636096+0000","last_unstale":"2023-08-31T19:07:21.645319+0000","last_undegraded":"2023-08-31T19:07:21.645319+0000","last_fullsized":"2023-08-31T19:07:21.645319+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.640699+0000","last_change":"2023-08-31T19:07:21.170731+0000","last_active":"2023-08-31T19:07:21.640699+0000","last_peered":"2023-08-31T19:07:21.640699+0000","last_clean":"2023-08-31T19:07:21.640699+0000","last_became_active":"2023-08-31T19:07:21.170441+0000","last_became_peered":"2023-08-31T19:07:21.170441+0000","last_unstale":"2023-08-31T19:07:21.640699+0000","last_undegraded":"2023-08-31T19:07:21.640699+0000","last_fullsized":"2023-08-31T19:07:21.640699+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":131,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.618845+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:07:21.618845+0000","last_peered":"2023-08-31T19:07:21.618845+0000","last_clean":"2023-08-31T19:07:21.618845+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:07:21.618845+0000","last_undegraded":"2023-08-31T19:07:21.618845+0000","last_fullsized":"2023-08-31T19:07:21.618845+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575080,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302924,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068916,"statfs":{"total":96636764160,"available":96326569984,"internally_reserved":0,"allocated":1773568,"data_stored":941859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69899999999999995,"15min":0.72999999999999998},"min":{"1min":0.41799999999999998,"5min":0.38500000000000001,"15min":0.32100000000000001},"max":{"1min":0.89900000000000002,"5min":1.175,"15min":1.175},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.51300000000000001,"5min":0.439,"15min":0.39800000000000002},"max":{"1min":0.80900000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.51000000000000001,"5min":0.42499999999999999,"15min":0.40000000000000002},"max":{"1min":0.90100000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.67200000000000004,"15min":0.68200000000000005},"min":{"1min":0.47899999999999998,"5min":0.41999999999999998,"15min":0.36199999999999999},"max":{"1min":0.82699999999999996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.503}]},{"osd":2,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.47699999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90800000000000003,"5min":1.163,"15min":1.163},"last":0.622},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0309999999999999,"15min":1.054},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70899999999999996,"15min":0.71499999999999997},"min":{"1min":0.55500000000000005,"5min":0.498,"15min":0.432},"max":{"1min":0.84499999999999997,"5min":1.107,"15min":1.107},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.74399999999999999,"15min":0.74299999999999999},"min":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.92000000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.35199999999999998,"15min":0.33900000000000002},"max":{"1min":0.81799999999999995,"5min":0.84499999999999997,"15min":0.97899999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.55600000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95899999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.46400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93200000000000005,"5min":1.0229999999999999,"15min":1.139},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.70699999999999996},"min":{"1min":0.45000000000000001,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.048},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.45600000000000002},"max":{"1min":0.89800000000000002,"5min":0.92400000000000004,"15min":1.0740000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.48699999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95399999999999996,"5min":1.069,"15min":1.069},"last":0.88500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575079,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302916,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068924,"statfs":{"total":96636764160,"available":96326578176,"internally_reserved":0,"allocated":1765376,"data_stored":942219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:06:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69199999999999995,"15min":0.70399999999999996},"min":{"1min":0.51000000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.0189999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67600000000000005,"15min":0.69699999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.371},"max":{"1min":0.89500000000000002,"5min":1.069,"15min":1.069},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Aug 31 19:06:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68000000000000005,"15min":0.69799999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.93899999999999995,"5min":1.014,"15min":1.014},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71099999999999997,"15min":0.71899999999999997},"min":{"1min":0.45800000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.90700000000000003,"5min":1.216,"15min":1.216},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:06:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.55100000000000005,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":0.879,"5min":1.0840000000000001,"15min":1.129},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.57899999999999996,"5min":0.498,"15min":0.46600000000000003},"max":{"1min":0.84399999999999997,"5min":0.98899999999999999,"15min":1.3260000000000001},"last":0.749}]},{"osd":3,"last update":"Thu Aug 31 19:06:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.49399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89000000000000001,"5min":0.96599999999999997,"15min":1.006},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95399999999999996,"5min":1.087,"15min":1.087},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:06:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.61499999999999999},"min":{"1min":0.443,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.96599999999999997},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.47199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.0880000000000001},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:06:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68100000000000005,"15min":0.67000000000000004},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.39800000000000002},"max":{"1min":0.92100000000000004,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.50700000000000001,"5min":0.437,"15min":0.435},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0700000000000001},"last":0.876}]},{"osd":7,"last update":"Thu Aug 31 19:06:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70499999999999996,"15min":0.69999999999999996},"min":{"1min":0.52400000000000002,"5min":0.44900000000000001,"15min":0.41899999999999998},"max":{"1min":0.93200000000000005,"5min":0.96599999999999997,"15min":1.012},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.753,"15min":0.75},"min":{"1min":0.53900000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1200000000000001,"5min":1.161,"15min":1.161},"last":1.012}]}]},{"osd":1,"up_from":13,"seq":55834575080,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302916,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068924,"statfs":{"total":96636764160,"available":96326578176,"internally_reserved":0,"allocated":1765376,"data_stored":941687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42699999999999999,"15min":0.442},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.26100000000000001},"max":{"1min":0.53100000000000003,"5min":0.70999999999999996,"15min":0.81000000000000005},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.34000000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61899999999999999,"5min":0.67100000000000004,"15min":0.752},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.496,"15min":0.50900000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.29099999999999998},"max":{"1min":0.61899999999999999,"5min":0.72799999999999998,"15min":0.82699999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.38},"max":{"1min":0.67700000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.46800000000000003,"5min":0.39100000000000001,"15min":0.35599999999999998},"max":{"1min":0.71799999999999997,"5min":0.79000000000000004,"15min":0.82199999999999995},"last":0.44},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.49399999999999999,"15min":0.50600000000000001},"min":{"1min":0.43099999999999999,"5min":0.33400000000000002,"15min":0.32800000000000001},"max":{"1min":0.72299999999999998,"5min":0.754,"15min":0.754},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.76500000000000001,"15min":0.78400000000000003},"min":{"1min":0.60399999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.2110000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.79500000000000004,"15min":0.81200000000000006},"min":{"1min":0.65600000000000003,"5min":0.56799999999999995,"15min":0.56000000000000005},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.745,"15min":0.76700000000000002},"min":{"1min":0.59499999999999997,"5min":0.53800000000000003,"15min":0.497},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.78400000000000003,"15min":0.78100000000000003},"min":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.46999999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.2310000000000001},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.74399999999999999,"15min":0.76400000000000001},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.117,"5min":1.117,"15min":1.1990000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.78700000000000003,"15min":0.79700000000000004},"min":{"1min":0.66400000000000003,"5min":0.56799999999999995,"15min":0.51500000000000001},"max":{"1min":1.075,"5min":1.167,"15min":1.2},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.77300000000000002,"15min":0.78300000000000003},"min":{"1min":0.59199999999999997,"5min":0.55400000000000005,"15min":0.54600000000000004},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.60499999999999998,"5min":0.54000000000000004,"15min":0.51400000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.54700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575079,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302924,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068916,"statfs":{"total":96636764160,"available":96326569984,"internally_reserved":0,"allocated":1773568,"data_stored":943133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.436,"15min":0.439},"min":{"1min":0.30399999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63500000000000001,"5min":0.73399999999999999,"15min":0.78400000000000003},"last":0.374},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47999999999999998,"15min":0.49099999999999999},"min":{"1min":0.33300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67700000000000005,"5min":0.72499999999999998,"15min":0.876},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48099999999999998,"15min":0.498},"min":{"1min":0.35099999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65100000000000002,"5min":0.71899999999999997,"15min":0.74299999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.49299999999999999,"15min":0.52200000000000002},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59899999999999998,"5min":0.82499999999999996,"15min":1.018},"last":0.442}]},{"osd":3,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.498,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.64600000000000002,"5min":0.69099999999999995,"15min":0.82799999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.36599999999999999},"max":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.91400000000000003},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77800000000000002,"15min":0.81399999999999995},"min":{"1min":0.54900000000000004,"5min":0.5,"15min":0.5},"max":{"1min":0.95199999999999996,"5min":1.103,"15min":1.2370000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77200000000000002,"15min":0.80900000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94299999999999995,"5min":1.1579999999999999,"15min":1.276},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72699999999999998,"15min":0.748},"min":{"1min":0.53600000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.83699999999999997,"5min":1.155,"15min":1.155},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.51200000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.92200000000000004,"5min":1.123,"15min":1.1950000000000001},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77700000000000002,"15min":0.80300000000000005},"min":{"1min":0.48999999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97399999999999998,"5min":1.3080000000000001,"15min":1.3280000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.82899999999999996},"min":{"1min":0.57299999999999995,"5min":0.55400000000000005,"15min":0.53500000000000003},"max":{"1min":0.96699999999999997,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.58399999999999996,"5min":0.53700000000000003,"15min":0.51800000000000002},"max":{"1min":0.95099999999999996,"5min":1.1359999999999999,"15min":1.5820000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.79300000000000004,"15min":0.82699999999999996},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.997,"5min":1.127,"15min":1.548},"last":0.70799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302920,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068920,"statfs":{"total":96636764160,"available":96326574080,"internally_reserved":0,"allocated":1769472,"data_stored":942627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.57299999999999995,"15min":0.48699999999999999},"min":{"1min":0.37,"5min":0.27800000000000002,"15min":0.27000000000000002},"max":{"1min":0.72999999999999998,"5min":14.09,"15min":14.09},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69599999999999995,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54500000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.65600000000000003,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":0.432},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64900000000000002,"5min":4.375,"15min":4.375},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.55500000000000005,"15min":0.52500000000000002},"min":{"1min":0.42199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.70799999999999996,"5min":5.7649999999999997,"15min":5.7649999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.36399999999999999},"max":{"1min":0.70699999999999996,"5min":5.9729999999999999,"15min":5.9729999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.52500000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86599999999999999,"5min":4.9960000000000004,"15min":4.9960000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.59099999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88600000000000001,"5min":4.4119999999999999,"15min":4.4119999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.752,"15min":0.78100000000000003},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91200000000000003,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.77700000000000002,"15min":0.79100000000000004},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.876,"5min":5.0449999999999999,"15min":5.0449999999999999},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.60899999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97299999999999998,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.78200000000000003,"15min":0.80100000000000005},"min":{"1min":0.57599999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.89500000000000002,"5min":2.383,"15min":2.383},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76700000000000002,"15min":0.79700000000000004},"min":{"1min":0.56699999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0569999999999999,"5min":1.869,"15min":1.869},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":0.81200000000000006},"min":{"1min":0.60099999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.96499999999999997,"5min":2.403,"15min":2.403},"last":0.60099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575079,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302924,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068916,"statfs":{"total":96636764160,"available":96326569984,"internally_reserved":0,"allocated":1773568,"data_stored":942343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41599999999999998,"15min":0.47999999999999998},"min":{"1min":0.27900000000000003,"5min":0.223,"15min":0.223},"max":{"1min":0.54700000000000004,"5min":0.88300000000000001,"15min":14.099},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.55500000000000005},"min":{"1min":0.33400000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63300000000000001,"5min":0.72299999999999998,"15min":24.879999999999999},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.35899999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63700000000000001,"5min":0.76200000000000001,"15min":0.79600000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48099999999999998,"15min":0.54100000000000004},"min":{"1min":0.31900000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60899999999999999,"5min":0.80700000000000005,"15min":14.143000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.74099999999999999,"5min":0.76200000000000001,"15min":1.0640000000000001},"last":0.439},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.64600000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.32000000000000001},"max":{"1min":0.68899999999999995,"5min":0.78400000000000003,"15min":12.464},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73299999999999998,"15min":0.81699999999999995},"min":{"1min":0.47699999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.04,"5min":1.298,"15min":21.475999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74299999999999999,"15min":0.76200000000000001},"min":{"1min":0.57499999999999996,"5min":0.52100000000000002,"15min":0.47699999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.8149999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.751,"15min":0.76000000000000001},"min":{"1min":0.60899999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1120000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.752,"15min":0.80800000000000005},"min":{"1min":0.59199999999999997,"5min":0.52700000000000002,"15min":0.50600000000000001},"max":{"1min":1.101,"5min":1.2809999999999999,"15min":12.509},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76900000000000002,"15min":0.82099999999999995},"min":{"1min":0.61299999999999999,"5min":0.53400000000000003,"15min":0.52000000000000002},"max":{"1min":1.0980000000000001,"5min":1.3320000000000001,"15min":12.426},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76400000000000001,"15min":0.85799999999999998},"min":{"1min":0.66200000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.98999999999999999,"5min":1.2010000000000001,"15min":24.920000000000002},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.77900000000000003,"15min":0.86599999999999999},"min":{"1min":0.65200000000000002,"5min":0.52300000000000002,"15min":0.495},"max":{"1min":1.0860000000000001,"5min":1.347,"15min":21.521000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.59399999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2929999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575079,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302920,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068920,"statfs":{"total":96636764160,"available":96326574080,"internally_reserved":0,"allocated":1769472,"data_stored":942309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65600000000000003,"15min":0.68899999999999995},"min":{"1min":0.48599999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68899999999999995,"15min":0.70999999999999996},"min":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.68799999999999994,"15min":0.70699999999999996},"min":{"1min":0.45100000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.52600000000000002,"5min":0.46300000000000002,"15min":0.40600000000000003},"max":{"1min":0.96799999999999997,"5min":1.042,"15min":1.044},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69299999999999995,"15min":0.72099999999999997},"min":{"1min":0.53500000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68200000000000005,"15min":0.70899999999999996},"min":{"1min":0.51700000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.73699999999999999},"min":{"1min":0.56499999999999995,"5min":0.52900000000000003,"15min":0.439},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.081},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59999999999999998,"15min":0.60499999999999998},"min":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61199999999999999,"15min":0.622},"min":{"1min":0.47799999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.48999999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.163},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.68400000000000005,"15min":0.69099999999999995},"min":{"1min":0.504,"5min":0.44800000000000001,"15min":0.441},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68100000000000005,"15min":0.68500000000000005},"min":{"1min":0.47499999999999998,"5min":0.46500000000000002,"15min":0.433},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72899999999999998,"15min":0.72699999999999998},"min":{"1min":0.55000000000000004,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302916,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068924,"statfs":{"total":96636764160,"available":96326578176,"internally_reserved":0,"allocated":1765376,"data_stored":941755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66900000000000004,"15min":0.71699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.87,"5min":0.93799999999999994,"15min":4.2119999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68500000000000005,"15min":0.71999999999999997},"min":{"1min":0.57099999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91000000000000003,"5min":0.94899999999999995,"15min":3.548},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Aug 31 19:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68899999999999995,"15min":0.76100000000000001},"min":{"1min":0.50600000000000001,"5min":0.46100000000000002,"15min":0.45000000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":16.744},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69899999999999995,"15min":0.73499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.196,"5min":1.196,"15min":3.6299999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Aug 31 19:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.70999999999999996},"min":{"1min":0.54200000000000004,"5min":0.44400000000000001,"15min":0.41899999999999998},"max":{"1min":0.85299999999999998,"5min":1.0289999999999999,"15min":3.4430000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.72099999999999997,"15min":0.751},"min":{"1min":0.56100000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.94699999999999995,"5min":0.98399999999999999,"15min":4.1740000000000004},"last":0.63900000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.70299999999999996,"15min":0.73399999999999999},"min":{"1min":0.56200000000000006,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98899999999999999,"5min":0.996,"15min":1.327},"last":0.754},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69299999999999995,"15min":0.72299999999999998},"min":{"1min":0.57999999999999996,"5min":0.48999999999999999,"15min":0.47699999999999998},"max":{"1min":0.86399999999999999,"5min":0.96799999999999997,"15min":2.823},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Aug 31 19:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.627,"15min":0.64600000000000002},"min":{"1min":0.47499999999999998,"5min":0.40200000000000002,"15min":0.34999999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":7.3739999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.42299999999999999},"max":{"1min":0.85999999999999999,"5min":0.94999999999999996,"15min":3.6680000000000001},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65600000000000003,"15min":0.65700000000000003},"min":{"1min":0.5,"5min":0.47499999999999998,"15min":0.39100000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":3.4780000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.56399999999999995,"5min":0.434,"15min":0.434},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":7.4139999999999997},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.71399999999999997,"15min":0.72199999999999998},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":3.5960000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73399999999999999,"15min":0.72899999999999998},"min":{"1min":0.61099999999999999,"5min":0.47399999999999998,"15min":0.45300000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":2.786},"last":0.77100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:07:25.907 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:07:26.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.126+0000 7f88b9bff700 1 Processor -- start 2023-08-31T19:07:26.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.126+0000 7f88b9bff700 1 -- start start 2023-08-31T19:07:26.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.127+0000 7f88b9bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b40c6c30 0x7f88b40bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:26.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.127+0000 7f88b9bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b4063be0 con 0x7f88b40c4740 2023-08-31T19:07:26.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.127+0000 7f88b9bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b4063010 con 0x7f88b41583f0 2023-08-31T19:07:26.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.128+0000 7f88b9bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b40632b0 con 0x7f88b40c6c30 2023-08-31T19:07:26.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.128+0000 7f88b2ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f88b40c4740 0x7f88b4157ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39114/0 (socket says 172.21.15.72:39114) 2023-08-31T19:07:26.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.128+0000 7f88b2ffd700 1 -- 172.21.15.72:0/3986368555 learned_addr learned my addr 172.21.15.72:0/3986368555 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:26.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.128+0000 7f88b37fe700 1 --2- 172.21.15.72:0/3986368555 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b40c6c30 0x7f88b40bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:26.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.128+0000 7f88b27fc700 1 -- 172.21.15.72:0/3986368555 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345087815 0 0) 0x7f88b4063be0 con 0x7f88b40c4740 2023-08-31T19:07:26.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.128+0000 7f88b27fc700 1 -- 172.21.15.72:0/3986368555 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f889c0033f0 con 0x7f88b40c4740 2023-08-31T19:07:26.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.128+0000 7f88b27fc700 1 -- 172.21.15.72:0/3986368555 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3213036012 0 0) 0x7f88b4063010 con 0x7f88b41583f0 2023-08-31T19:07:26.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.128+0000 7f88b37fe700 1 -- 172.21.15.72:0/3986368555 >> v1:172.21.15.146:6789/0 conn(0x7f88b41583f0 legacy=0x7f88b40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:26.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.128+0000 7f88b37fe700 1 -- 172.21.15.72:0/3986368555 >> v1:172.21.15.72:6789/0 conn(0x7f88b40c4740 legacy=0x7f88b4157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:26.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.128+0000 7f88b37fe700 1 -- 172.21.15.72:0/3986368555 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4063590 con 0x7f88b40c6c30 2023-08-31T19:07:26.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.129+0000 7f88b37fe700 1 --2- 172.21.15.72:0/3986368555 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b40c6c30 0x7f88b40bc300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f88a4009790 tx=0x7f88a4009060).ready entity=mon.2 client_cookie=732a2b39de50eb24 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:26.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.129+0000 7f88b27fc700 1 -- 172.21.15.72:0/3986368555 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8001470 con 0x7f88b40c6c30 2023-08-31T19:07:26.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.129+0000 7f88b27fc700 1 -- 172.21.15.72:0/3986368555 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a4012410 con 0x7f88b40c6c30 2023-08-31T19:07:26.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.129+0000 7f88b27fc700 1 -- 172.21.15.72:0/3986368555 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a4012790 con 0x7f88b40c6c30 2023-08-31T19:07:26.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.129+0000 7f88b9bff700 1 -- 172.21.15.72:0/3986368555 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b40c6c30 msgr2=0x7f88b40bc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:26.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.129+0000 7f88b9bff700 1 --2- 172.21.15.72:0/3986368555 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b40c6c30 0x7f88b40bc300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f88a4009790 tx=0x7f88a4009060).stop 2023-08-31T19:07:26.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.130+0000 7f88b9bff700 1 -- 172.21.15.72:0/3986368555 shutdown_connections 2023-08-31T19:07:26.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.130+0000 7f88b9bff700 1 --2- 172.21.15.72:0/3986368555 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b40c6c30 0x7f88b40bc300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:26.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.130+0000 7f88b9bff700 1 -- 172.21.15.72:0/3986368555 >> 172.21.15.72:0/3986368555 conn(0x7f88b40c7e70 msgr2=0x7f88b40c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:26.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.130+0000 7f88b9bff700 1 -- 172.21.15.72:0/3986368555 shutdown_connections 2023-08-31T19:07:26.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.130+0000 7f88b9bff700 1 -- 172.21.15.72:0/3986368555 wait complete. 2023-08-31T19:07:26.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.131+0000 7f88b9bff700 1 Processor -- start 2023-08-31T19:07:26.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.131+0000 7f88b9bff700 1 -- start start 2023-08-31T19:07:26.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.132+0000 7f88b9bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b40c4740 0x7f88b41684d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:26.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.132+0000 7f88b9bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88b40c6c30 0x7f88b40a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:26.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.132+0000 7f88b9bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b41583f0 0x7f88b4157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:26.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.132+0000 7f88b9bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b413a530 con 0x7f88b40c4740 2023-08-31T19:07:26.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.132+0000 7f88b9bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b4138a40 con 0x7f88b40c6c30 2023-08-31T19:07:26.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.132+0000 7f88b9bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b41689c0 con 0x7f88b41583f0 2023-08-31T19:07:26.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.132+0000 7f88b37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b40c4740 0x7f88b41684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:26.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.132+0000 7f88b37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b40c4740 0x7f88b41684d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45418/0 (socket says 172.21.15.72:45418) 2023-08-31T19:07:26.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.132+0000 7f88b37fe700 1 -- 172.21.15.72:0/2970214055 learned_addr learned my addr 172.21.15.72:0/2970214055 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:26.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.133+0000 7f88b2ffd700 1 --2- 172.21.15.72:0/2970214055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88b40c6c30 0x7f88b40a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:26.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.133+0000 7f88b3fff700 1 --2- 172.21.15.72:0/2970214055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b41583f0 0x7f88b4157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:26.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.133+0000 7f88b37fe700 1 -- 172.21.15.72:0/2970214055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b41583f0 msgr2=0x7f88b4157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:26.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.133+0000 7f88b37fe700 1 --2- 172.21.15.72:0/2970214055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b41583f0 0x7f88b4157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:26.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.133+0000 7f88b37fe700 1 -- 172.21.15.72:0/2970214055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88b40c6c30 msgr2=0x7f88b40a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:26.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.133+0000 7f88b37fe700 1 --2- 172.21.15.72:0/2970214055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88b40c6c30 0x7f88b40a9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:26.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.133+0000 7f88b37fe700 1 -- 172.21.15.72:0/2970214055 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a40092a0 con 0x7f88b40c4740 2023-08-31T19:07:26.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.133+0000 7f88b3fff700 1 --2- 172.21.15.72:0/2970214055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b41583f0 0x7f88b4157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:26.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.133+0000 7f88b37fe700 1 --2- 172.21.15.72:0/2970214055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b40c4740 0x7f88b41684d0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f88a40114b0 tx=0x7f88b40631a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:26.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.133+0000 7f889b7fe700 1 -- 172.21.15.72:0/2970214055 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a4021070 con 0x7f88b40c4740 2023-08-31T19:07:26.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.133+0000 7f889b7fe700 1 -- 172.21.15.72:0/2970214055 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a4011b10 con 0x7f88b40c4740 2023-08-31T19:07:26.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.133+0000 7f88b9bff700 1 -- 172.21.15.72:0/2970214055 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b4137e30 con 0x7f88b40c4740 2023-08-31T19:07:26.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.133+0000 7f889b7fe700 1 -- 172.21.15.72:0/2970214055 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a4011e90 con 0x7f88b40c4740 2023-08-31T19:07:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.133+0000 7f88b9bff700 1 -- 172.21.15.72:0/2970214055 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b41383f0 con 0x7f88b40c4740 2023-08-31T19:07:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.135+0000 7f88b9bff700 1 -- 172.21.15.72:0/2970214055 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b406c6b0 con 0x7f88b40c4740 2023-08-31T19:07:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.135+0000 7f889b7fe700 1 -- 172.21.15.72:0/2970214055 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f88a401d600 con 0x7f88b40c4740 2023-08-31T19:07:26.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.136+0000 7f889b7fe700 1 --2- 172.21.15.72:0/2970214055 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f88a005ef30 0x7f88a00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:26.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.136+0000 7f889b7fe700 1 -- 172.21.15.72:0/2970214055 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f88a407b7b0 con 0x7f88b40c4740 2023-08-31T19:07:26.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.136+0000 7f88b2ffd700 1 --2- 172.21.15.72:0/2970214055 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f88a005ef30 0x7f88a00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:26.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.137+0000 7f88b2ffd700 1 --2- 172.21.15.72:0/2970214055 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f88a005ef30 0x7f88a00613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f88b413adb0 tx=0x7f88a8001940).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:26.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.140+0000 7f889b7fe700 1 -- 172.21.15.72:0/2970214055 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f88a404c830 con 0x7f88b40c4740 2023-08-31T19:07:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.305+0000 7f88b9bff700 1 -- 172.21.15.72:0/2970214055 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88b406c6b0 con 0x7f88a005ef30 2023-08-31T19:07:26.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.316+0000 7f889b7fe700 1 -- 172.21.15.72:0/2970214055 <== mgr.7857 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361737 (secure 0 0 0) 0x7f88b406c6b0 con 0x7f88a005ef30 2023-08-31T19:07:26.320 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.320+0000 7f88b9bff700 1 -- 172.21.15.72:0/2970214055 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f88a005ef30 msgr2=0x7f88a00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.320+0000 7f88b9bff700 1 --2- 172.21.15.72:0/2970214055 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f88a005ef30 0x7f88a00613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f88b413adb0 tx=0x7f88a8001940).stop 2023-08-31T19:07:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.320+0000 7f88b9bff700 1 -- 172.21.15.72:0/2970214055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b40c4740 msgr2=0x7f88b41684d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.320+0000 7f88b9bff700 1 --2- 172.21.15.72:0/2970214055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b40c4740 0x7f88b41684d0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f88a40114b0 tx=0x7f88b40631a0).stop 2023-08-31T19:07:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.320+0000 7f88b9bff700 1 -- 172.21.15.72:0/2970214055 shutdown_connections 2023-08-31T19:07:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.320+0000 7f88b9bff700 1 --2- 172.21.15.72:0/2970214055 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f88b41583f0 0x7f88b4157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.320+0000 7f88b9bff700 1 --2- 172.21.15.72:0/2970214055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b40c4740 0x7f88b41684d0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.320+0000 7f88b9bff700 1 --2- 172.21.15.72:0/2970214055 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f88a005ef30 0x7f88a00613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.320+0000 7f88b9bff700 1 --2- 172.21.15.72:0/2970214055 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88b40c6c30 0x7f88b40a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.320+0000 7f88b9bff700 1 -- 172.21.15.72:0/2970214055 >> 172.21.15.72:0/2970214055 conn(0x7f88b40c7e70 msgr2=0x7f88b4151810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:26.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.320+0000 7f88b9bff700 1 -- 172.21.15.72:0/2970214055 shutdown_connections 2023-08-31T19:07:26.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.320+0000 7f88b9bff700 1 -- 172.21.15.72:0/2970214055 wait complete. 2023-08-31T19:07:26.326 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:07:26.338 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-31T19:07:26.104534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":220,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2423360,"kb_used_data":13824,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752551360,"statfs":{"total":773094113280,"available":770612592640,"internally_reserved":0,"allocated":14155776,"data_stored":7537932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20932,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-72,"num_write_kb":-47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.014847"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.638695+0000","last_change":"2023-08-31T19:07:21.630196+0000","last_active":"2023-08-31T19:07:21.638695+0000","last_peered":"2023-08-31T19:07:21.638695+0000","last_clean":"2023-08-31T19:07:21.638695+0000","last_became_active":"2023-08-31T19:07:21.629874+0000","last_became_peered":"2023-08-31T19:07:21.629874+0000","last_unstale":"2023-08-31T19:07:21.638695+0000","last_undegraded":"2023-08-31T19:07:21.638695+0000","last_fullsized":"2023-08-31T19:07:21.638695+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"141'3","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.644313+0000","last_change":"2023-08-31T19:07:21.156879+0000","last_active":"2023-08-31T19:07:21.644313+0000","last_peered":"2023-08-31T19:07:21.644313+0000","last_clean":"2023-08-31T19:07:21.644313+0000","last_became_active":"2023-08-31T19:07:21.156438+0000","last_became_peered":"2023-08-31T19:07:21.156438+0000","last_unstale":"2023-08-31T19:07:21.644313+0000","last_undegraded":"2023-08-31T19:07:21.644313+0000","last_fullsized":"2023-08-31T19:07:21.644313+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.644857+0000","last_change":"2023-08-31T19:07:21.636089+0000","last_active":"2023-08-31T19:07:21.644857+0000","last_peered":"2023-08-31T19:07:21.644857+0000","last_clean":"2023-08-31T19:07:21.644857+0000","last_became_active":"2023-08-31T19:07:21.632549+0000","last_became_peered":"2023-08-31T19:07:21.632549+0000","last_unstale":"2023-08-31T19:07:21.644857+0000","last_undegraded":"2023-08-31T19:07:21.644857+0000","last_fullsized":"2023-08-31T19:07:21.644857+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622019+0000","last_change":"2023-08-31T19:07:21.172314+0000","last_active":"2023-08-31T19:07:21.622019+0000","last_peered":"2023-08-31T19:07:21.622019+0000","last_clean":"2023-08-31T19:07:21.622019+0000","last_became_active":"2023-08-31T19:07:21.171887+0000","last_became_peered":"2023-08-31T19:07:21.171887+0000","last_unstale":"2023-08-31T19:07:21.622019+0000","last_undegraded":"2023-08-31T19:07:21.622019+0000","last_fullsized":"2023-08-31T19:07:21.622019+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649620+0000","last_change":"2023-08-31T19:07:21.647425+0000","last_active":"2023-08-31T19:07:21.649620+0000","last_peered":"2023-08-31T19:07:21.649620+0000","last_clean":"2023-08-31T19:07:21.649620+0000","last_became_active":"2023-08-31T19:07:21.647169+0000","last_became_peered":"2023-08-31T19:07:21.647169+0000","last_unstale":"2023-08-31T19:07:21.649620+0000","last_undegraded":"2023-08-31T19:07:21.649620+0000","last_fullsized":"2023-08-31T19:07:21.649620+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615685+0000","last_change":"2023-08-31T19:07:21.169128+0000","last_active":"2023-08-31T19:07:21.615685+0000","last_peered":"2023-08-31T19:07:21.615685+0000","last_clean":"2023-08-31T19:07:21.615685+0000","last_became_active":"2023-08-31T19:07:21.168760+0000","last_became_peered":"2023-08-31T19:07:21.168760+0000","last_unstale":"2023-08-31T19:07:21.615685+0000","last_undegraded":"2023-08-31T19:07:21.615685+0000","last_fullsized":"2023-08-31T19:07:21.615685+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.641533+0000","last_change":"2023-08-31T19:07:21.633311+0000","last_active":"2023-08-31T19:07:21.641533+0000","last_peered":"2023-08-31T19:07:21.641533+0000","last_clean":"2023-08-31T19:07:21.641533+0000","last_became_active":"2023-08-31T19:07:21.632905+0000","last_became_peered":"2023-08-31T19:07:21.632905+0000","last_unstale":"2023-08-31T19:07:21.641533+0000","last_undegraded":"2023-08-31T19:07:21.641533+0000","last_fullsized":"2023-08-31T19:07:21.641533+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643590+0000","last_change":"2023-08-31T19:07:21.166414+0000","last_active":"2023-08-31T19:07:21.643590+0000","last_peered":"2023-08-31T19:07:21.643590+0000","last_clean":"2023-08-31T19:07:21.643590+0000","last_became_active":"2023-08-31T19:07:21.165148+0000","last_became_peered":"2023-08-31T19:07:21.165148+0000","last_unstale":"2023-08-31T19:07:21.643590+0000","last_undegraded":"2023-08-31T19:07:21.643590+0000","last_fullsized":"2023-08-31T19:07:21.643590+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643884+0000","last_change":"2023-08-31T19:07:21.636343+0000","last_active":"2023-08-31T19:07:21.643884+0000","last_peered":"2023-08-31T19:07:21.643884+0000","last_clean":"2023-08-31T19:07:21.643884+0000","last_became_active":"2023-08-31T19:07:21.632431+0000","last_became_peered":"2023-08-31T19:07:21.632431+0000","last_unstale":"2023-08-31T19:07:21.643884+0000","last_undegraded":"2023-08-31T19:07:21.643884+0000","last_fullsized":"2023-08-31T19:07:21.643884+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645689+0000","last_change":"2023-08-31T19:07:21.172616+0000","last_active":"2023-08-31T19:07:21.645689+0000","last_peered":"2023-08-31T19:07:21.645689+0000","last_clean":"2023-08-31T19:07:21.645689+0000","last_became_active":"2023-08-31T19:07:21.172344+0000","last_became_peered":"2023-08-31T19:07:21.172344+0000","last_unstale":"2023-08-31T19:07:21.645689+0000","last_undegraded":"2023-08-31T19:07:21.645689+0000","last_fullsized":"2023-08-31T19:07:21.645689+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643690+0000","last_change":"2023-08-31T19:07:21.638605+0000","last_active":"2023-08-31T19:07:21.643690+0000","last_peered":"2023-08-31T19:07:21.643690+0000","last_clean":"2023-08-31T19:07:21.643690+0000","last_became_active":"2023-08-31T19:07:21.638353+0000","last_became_peered":"2023-08-31T19:07:21.638353+0000","last_unstale":"2023-08-31T19:07:21.643690+0000","last_undegraded":"2023-08-31T19:07:21.643690+0000","last_fullsized":"2023-08-31T19:07:21.643690+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.638829+0000","last_change":"2023-08-31T19:07:21.173912+0000","last_active":"2023-08-31T19:07:21.638829+0000","last_peered":"2023-08-31T19:07:21.638829+0000","last_clean":"2023-08-31T19:07:21.638829+0000","last_became_active":"2023-08-31T19:07:21.173600+0000","last_became_peered":"2023-08-31T19:07:21.173600+0000","last_unstale":"2023-08-31T19:07:21.638829+0000","last_undegraded":"2023-08-31T19:07:21.638829+0000","last_fullsized":"2023-08-31T19:07:21.638829+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643930+0000","last_change":"2023-08-31T19:07:21.639051+0000","last_active":"2023-08-31T19:07:21.643930+0000","last_peered":"2023-08-31T19:07:21.643930+0000","last_clean":"2023-08-31T19:07:21.643930+0000","last_became_active":"2023-08-31T19:07:21.638770+0000","last_became_peered":"2023-08-31T19:07:21.638770+0000","last_unstale":"2023-08-31T19:07:21.643930+0000","last_undegraded":"2023-08-31T19:07:21.643930+0000","last_fullsized":"2023-08-31T19:07:21.643930+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.621154+0000","last_change":"2023-08-31T19:07:21.164518+0000","last_active":"2023-08-31T19:07:21.621154+0000","last_peered":"2023-08-31T19:07:21.621154+0000","last_clean":"2023-08-31T19:07:21.621154+0000","last_became_active":"2023-08-31T19:07:21.164225+0000","last_became_peered":"2023-08-31T19:07:21.164225+0000","last_unstale":"2023-08-31T19:07:21.621154+0000","last_undegraded":"2023-08-31T19:07:21.621154+0000","last_fullsized":"2023-08-31T19:07:21.621154+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637836+0000","last_change":"2023-08-31T19:07:21.633041+0000","last_active":"2023-08-31T19:07:21.637836+0000","last_peered":"2023-08-31T19:07:21.637836+0000","last_clean":"2023-08-31T19:07:21.637836+0000","last_became_active":"2023-08-31T19:07:21.632737+0000","last_became_peered":"2023-08-31T19:07:21.632737+0000","last_unstale":"2023-08-31T19:07:21.637836+0000","last_undegraded":"2023-08-31T19:07:21.637836+0000","last_fullsized":"2023-08-31T19:07:21.637836+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615117+0000","last_change":"2023-08-31T19:07:21.174602+0000","last_active":"2023-08-31T19:07:21.615117+0000","last_peered":"2023-08-31T19:07:21.615117+0000","last_clean":"2023-08-31T19:07:21.615117+0000","last_became_active":"2023-08-31T19:07:21.174266+0000","last_became_peered":"2023-08-31T19:07:21.174266+0000","last_unstale":"2023-08-31T19:07:21.615117+0000","last_undegraded":"2023-08-31T19:07:21.615117+0000","last_fullsized":"2023-08-31T19:07:21.615117+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643972+0000","last_change":"2023-08-31T19:07:21.639840+0000","last_active":"2023-08-31T19:07:21.643972+0000","last_peered":"2023-08-31T19:07:21.643972+0000","last_clean":"2023-08-31T19:07:21.643972+0000","last_became_active":"2023-08-31T19:07:21.639556+0000","last_became_peered":"2023-08-31T19:07:21.639556+0000","last_unstale":"2023-08-31T19:07:21.643972+0000","last_undegraded":"2023-08-31T19:07:21.643972+0000","last_fullsized":"2023-08-31T19:07:21.643972+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.623093+0000","last_change":"2023-08-31T19:07:21.178091+0000","last_active":"2023-08-31T19:07:21.623093+0000","last_peered":"2023-08-31T19:07:21.623093+0000","last_clean":"2023-08-31T19:07:21.623093+0000","last_became_active":"2023-08-31T19:07:21.177755+0000","last_became_peered":"2023-08-31T19:07:21.177755+0000","last_unstale":"2023-08-31T19:07:21.623093+0000","last_undegraded":"2023-08-31T19:07:21.623093+0000","last_fullsized":"2023-08-31T19:07:21.623093+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637982+0000","last_change":"2023-08-31T19:07:21.632821+0000","last_active":"2023-08-31T19:07:21.637982+0000","last_peered":"2023-08-31T19:07:21.637982+0000","last_clean":"2023-08-31T19:07:21.637982+0000","last_became_active":"2023-08-31T19:07:21.632514+0000","last_became_peered":"2023-08-31T19:07:21.632514+0000","last_unstale":"2023-08-31T19:07:21.637982+0000","last_undegraded":"2023-08-31T19:07:21.637982+0000","last_fullsized":"2023-08-31T19:07:21.637982+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.623990+0000","last_change":"2023-08-31T19:07:21.176372+0000","last_active":"2023-08-31T19:07:21.623990+0000","last_peered":"2023-08-31T19:07:21.623990+0000","last_clean":"2023-08-31T19:07:21.623990+0000","last_became_active":"2023-08-31T19:07:21.176059+0000","last_became_peered":"2023-08-31T19:07:21.176059+0000","last_unstale":"2023-08-31T19:07:21.623990+0000","last_undegraded":"2023-08-31T19:07:21.623990+0000","last_fullsized":"2023-08-31T19:07:21.623990+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649511+0000","last_change":"2023-08-31T19:07:21.637747+0000","last_active":"2023-08-31T19:07:21.649511+0000","last_peered":"2023-08-31T19:07:21.649511+0000","last_clean":"2023-08-31T19:07:21.649511+0000","last_became_active":"2023-08-31T19:07:21.636963+0000","last_became_peered":"2023-08-31T19:07:21.636963+0000","last_unstale":"2023-08-31T19:07:21.649511+0000","last_undegraded":"2023-08-31T19:07:21.649511+0000","last_fullsized":"2023-08-31T19:07:21.649511+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622778+0000","last_change":"2023-08-31T19:07:21.164335+0000","last_active":"2023-08-31T19:07:21.622778+0000","last_peered":"2023-08-31T19:07:21.622778+0000","last_clean":"2023-08-31T19:07:21.622778+0000","last_became_active":"2023-08-31T19:07:21.164038+0000","last_became_peered":"2023-08-31T19:07:21.164038+0000","last_unstale":"2023-08-31T19:07:21.622778+0000","last_undegraded":"2023-08-31T19:07:21.622778+0000","last_fullsized":"2023-08-31T19:07:21.622778+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.646648+0000","last_change":"2023-08-31T19:07:21.645153+0000","last_active":"2023-08-31T19:07:21.646648+0000","last_peered":"2023-08-31T19:07:21.646648+0000","last_clean":"2023-08-31T19:07:21.646648+0000","last_became_active":"2023-08-31T19:07:21.644848+0000","last_became_peered":"2023-08-31T19:07:21.644848+0000","last_unstale":"2023-08-31T19:07:21.646648+0000","last_undegraded":"2023-08-31T19:07:21.646648+0000","last_fullsized":"2023-08-31T19:07:21.646648+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"141'4","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.652288+0000","last_change":"2023-08-31T19:07:21.168414+0000","last_active":"2023-08-31T19:07:21.652288+0000","last_peered":"2023-08-31T19:07:21.652288+0000","last_clean":"2023-08-31T19:07:21.652288+0000","last_became_active":"2023-08-31T19:07:21.168112+0000","last_became_peered":"2023-08-31T19:07:21.168112+0000","last_unstale":"2023-08-31T19:07:21.652288+0000","last_undegraded":"2023-08-31T19:07:21.652288+0000","last_fullsized":"2023-08-31T19:07:21.652288+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649782+0000","last_change":"2023-08-31T19:07:21.646415+0000","last_active":"2023-08-31T19:07:21.649782+0000","last_peered":"2023-08-31T19:07:21.649782+0000","last_clean":"2023-08-31T19:07:21.649782+0000","last_became_active":"2023-08-31T19:07:21.646128+0000","last_became_peered":"2023-08-31T19:07:21.646128+0000","last_unstale":"2023-08-31T19:07:21.649782+0000","last_undegraded":"2023-08-31T19:07:21.649782+0000","last_fullsized":"2023-08-31T19:07:21.649782+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.646212+0000","last_change":"2023-08-31T19:07:21.173914+0000","last_active":"2023-08-31T19:07:21.646212+0000","last_peered":"2023-08-31T19:07:21.646212+0000","last_clean":"2023-08-31T19:07:21.646212+0000","last_became_active":"2023-08-31T19:07:21.173632+0000","last_became_peered":"2023-08-31T19:07:21.173632+0000","last_unstale":"2023-08-31T19:07:21.646212+0000","last_undegraded":"2023-08-31T19:07:21.646212+0000","last_fullsized":"2023-08-31T19:07:21.646212+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637644+0000","last_change":"2023-08-31T19:07:21.633427+0000","last_active":"2023-08-31T19:07:21.637644+0000","last_peered":"2023-08-31T19:07:21.637644+0000","last_clean":"2023-08-31T19:07:21.637644+0000","last_became_active":"2023-08-31T19:07:21.633123+0000","last_became_peered":"2023-08-31T19:07:21.633123+0000","last_unstale":"2023-08-31T19:07:21.637644+0000","last_undegraded":"2023-08-31T19:07:21.637644+0000","last_fullsized":"2023-08-31T19:07:21.637644+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615184+0000","last_change":"2023-08-31T19:07:21.166995+0000","last_active":"2023-08-31T19:07:21.615184+0000","last_peered":"2023-08-31T19:07:21.615184+0000","last_clean":"2023-08-31T19:07:21.615184+0000","last_became_active":"2023-08-31T19:07:21.166211+0000","last_became_peered":"2023-08-31T19:07:21.166211+0000","last_unstale":"2023-08-31T19:07:21.615184+0000","last_undegraded":"2023-08-31T19:07:21.615184+0000","last_fullsized":"2023-08-31T19:07:21.615184+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643909+0000","last_change":"2023-08-31T19:07:21.636049+0000","last_active":"2023-08-31T19:07:21.643909+0000","last_peered":"2023-08-31T19:07:21.643909+0000","last_clean":"2023-08-31T19:07:21.643909+0000","last_became_active":"2023-08-31T19:07:21.634974+0000","last_became_peered":"2023-08-31T19:07:21.634974+0000","last_unstale":"2023-08-31T19:07:21.643909+0000","last_undegraded":"2023-08-31T19:07:21.643909+0000","last_fullsized":"2023-08-31T19:07:21.643909+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.616087+0000","last_change":"2023-08-31T19:07:21.170102+0000","last_active":"2023-08-31T19:07:21.616087+0000","last_peered":"2023-08-31T19:07:21.616087+0000","last_clean":"2023-08-31T19:07:21.616087+0000","last_became_active":"2023-08-31T19:07:21.169819+0000","last_became_peered":"2023-08-31T19:07:21.169819+0000","last_unstale":"2023-08-31T19:07:21.616087+0000","last_undegraded":"2023-08-31T19:07:21.616087+0000","last_fullsized":"2023-08-31T19:07:21.616087+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637101+0000","last_change":"2023-08-31T19:07:21.630346+0000","last_active":"2023-08-31T19:07:21.637101+0000","last_peered":"2023-08-31T19:07:21.637101+0000","last_clean":"2023-08-31T19:07:21.637101+0000","last_became_active":"2023-08-31T19:07:21.630044+0000","last_became_peered":"2023-08-31T19:07:21.630044+0000","last_unstale":"2023-08-31T19:07:21.637101+0000","last_undegraded":"2023-08-31T19:07:21.637101+0000","last_fullsized":"2023-08-31T19:07:21.637101+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"141'4","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.641739+0000","last_change":"2023-08-31T19:07:21.162089+0000","last_active":"2023-08-31T19:07:21.641739+0000","last_peered":"2023-08-31T19:07:21.641739+0000","last_clean":"2023-08-31T19:07:21.641739+0000","last_became_active":"2023-08-31T19:07:21.161799+0000","last_became_peered":"2023-08-31T19:07:21.161799+0000","last_unstale":"2023-08-31T19:07:21.641739+0000","last_undegraded":"2023-08-31T19:07:21.641739+0000","last_fullsized":"2023-08-31T19:07:21.641739+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649418+0000","last_change":"2023-08-31T19:07:21.641005+0000","last_active":"2023-08-31T19:07:21.649418+0000","last_peered":"2023-08-31T19:07:21.649418+0000","last_clean":"2023-08-31T19:07:21.649418+0000","last_became_active":"2023-08-31T19:07:21.640759+0000","last_became_peered":"2023-08-31T19:07:21.640759+0000","last_unstale":"2023-08-31T19:07:21.649418+0000","last_undegraded":"2023-08-31T19:07:21.649418+0000","last_fullsized":"2023-08-31T19:07:21.649418+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.623008+0000","last_change":"2023-08-31T19:07:21.164495+0000","last_active":"2023-08-31T19:07:21.623008+0000","last_peered":"2023-08-31T19:07:21.623008+0000","last_clean":"2023-08-31T19:07:21.623008+0000","last_became_active":"2023-08-31T19:07:21.163815+0000","last_became_peered":"2023-08-31T19:07:21.163815+0000","last_unstale":"2023-08-31T19:07:21.623008+0000","last_undegraded":"2023-08-31T19:07:21.623008+0000","last_fullsized":"2023-08-31T19:07:21.623008+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.642926+0000","last_change":"2023-08-31T19:07:21.640822+0000","last_active":"2023-08-31T19:07:21.642926+0000","last_peered":"2023-08-31T19:07:21.642926+0000","last_clean":"2023-08-31T19:07:21.642926+0000","last_became_active":"2023-08-31T19:07:21.640513+0000","last_became_peered":"2023-08-31T19:07:21.640513+0000","last_unstale":"2023-08-31T19:07:21.642926+0000","last_undegraded":"2023-08-31T19:07:21.642926+0000","last_fullsized":"2023-08-31T19:07:21.642926+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.618250+0000","last_change":"2023-08-31T19:07:21.163286+0000","last_active":"2023-08-31T19:07:21.618250+0000","last_peered":"2023-08-31T19:07:21.618250+0000","last_clean":"2023-08-31T19:07:21.618250+0000","last_became_active":"2023-08-31T19:07:21.162987+0000","last_became_peered":"2023-08-31T19:07:21.162987+0000","last_unstale":"2023-08-31T19:07:21.618250+0000","last_undegraded":"2023-08-31T19:07:21.618250+0000","last_fullsized":"2023-08-31T19:07:21.618250+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649602+0000","last_change":"2023-08-31T19:07:21.647155+0000","last_active":"2023-08-31T19:07:21.649602+0000","last_peered":"2023-08-31T19:07:21.649602+0000","last_clean":"2023-08-31T19:07:21.649602+0000","last_became_active":"2023-08-31T19:07:21.646833+0000","last_became_peered":"2023-08-31T19:07:21.646833+0000","last_unstale":"2023-08-31T19:07:21.649602+0000","last_undegraded":"2023-08-31T19:07:21.649602+0000","last_fullsized":"2023-08-31T19:07:21.649602+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.646202+0000","last_change":"2023-08-31T19:07:21.172345+0000","last_active":"2023-08-31T19:07:21.646202+0000","last_peered":"2023-08-31T19:07:21.646202+0000","last_clean":"2023-08-31T19:07:21.646202+0000","last_became_active":"2023-08-31T19:07:21.171916+0000","last_became_peered":"2023-08-31T19:07:21.171916+0000","last_unstale":"2023-08-31T19:07:21.646202+0000","last_undegraded":"2023-08-31T19:07:21.646202+0000","last_fullsized":"2023-08-31T19:07:21.646202+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637097+0000","last_change":"2023-08-31T19:07:21.630623+0000","last_active":"2023-08-31T19:07:21.637097+0000","last_peered":"2023-08-31T19:07:21.637097+0000","last_clean":"2023-08-31T19:07:21.637097+0000","last_became_active":"2023-08-31T19:07:21.629915+0000","last_became_peered":"2023-08-31T19:07:21.629915+0000","last_unstale":"2023-08-31T19:07:21.637097+0000","last_undegraded":"2023-08-31T19:07:21.637097+0000","last_fullsized":"2023-08-31T19:07:21.637097+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.621725+0000","last_change":"2023-08-31T19:07:21.173368+0000","last_active":"2023-08-31T19:07:21.621725+0000","last_peered":"2023-08-31T19:07:21.621725+0000","last_clean":"2023-08-31T19:07:21.621725+0000","last_became_active":"2023-08-31T19:07:21.172980+0000","last_became_peered":"2023-08-31T19:07:21.172980+0000","last_unstale":"2023-08-31T19:07:21.621725+0000","last_undegraded":"2023-08-31T19:07:21.621725+0000","last_fullsized":"2023-08-31T19:07:21.621725+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645146+0000","last_change":"2023-08-31T19:07:21.635147+0000","last_active":"2023-08-31T19:07:21.645146+0000","last_peered":"2023-08-31T19:07:21.645146+0000","last_clean":"2023-08-31T19:07:21.645146+0000","last_became_active":"2023-08-31T19:07:21.634692+0000","last_became_peered":"2023-08-31T19:07:21.634692+0000","last_unstale":"2023-08-31T19:07:21.645146+0000","last_undegraded":"2023-08-31T19:07:21.645146+0000","last_fullsized":"2023-08-31T19:07:21.645146+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645414+0000","last_change":"2023-08-31T19:07:21.170290+0000","last_active":"2023-08-31T19:07:21.645414+0000","last_peered":"2023-08-31T19:07:21.645414+0000","last_clean":"2023-08-31T19:07:21.645414+0000","last_became_active":"2023-08-31T19:07:21.170017+0000","last_became_peered":"2023-08-31T19:07:21.170017+0000","last_unstale":"2023-08-31T19:07:21.645414+0000","last_undegraded":"2023-08-31T19:07:21.645414+0000","last_fullsized":"2023-08-31T19:07:21.645414+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.647021+0000","last_change":"2023-08-31T19:07:21.646027+0000","last_active":"2023-08-31T19:07:21.647021+0000","last_peered":"2023-08-31T19:07:21.647021+0000","last_clean":"2023-08-31T19:07:21.647021+0000","last_became_active":"2023-08-31T19:07:21.645711+0000","last_became_peered":"2023-08-31T19:07:21.645711+0000","last_unstale":"2023-08-31T19:07:21.647021+0000","last_undegraded":"2023-08-31T19:07:21.647021+0000","last_fullsized":"2023-08-31T19:07:21.647021+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622267+0000","last_change":"2023-08-31T19:07:21.170789+0000","last_active":"2023-08-31T19:07:21.622267+0000","last_peered":"2023-08-31T19:07:21.622267+0000","last_clean":"2023-08-31T19:07:21.622267+0000","last_became_active":"2023-08-31T19:07:21.170457+0000","last_became_peered":"2023-08-31T19:07:21.170457+0000","last_unstale":"2023-08-31T19:07:21.622267+0000","last_undegraded":"2023-08-31T19:07:21.622267+0000","last_fullsized":"2023-08-31T19:07:21.622267+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.641911+0000","last_change":"2023-08-31T19:07:21.638789+0000","last_active":"2023-08-31T19:07:21.641911+0000","last_peered":"2023-08-31T19:07:21.641911+0000","last_clean":"2023-08-31T19:07:21.641911+0000","last_became_active":"2023-08-31T19:07:21.638428+0000","last_became_peered":"2023-08-31T19:07:21.638428+0000","last_unstale":"2023-08-31T19:07:21.641911+0000","last_undegraded":"2023-08-31T19:07:21.641911+0000","last_fullsized":"2023-08-31T19:07:21.641911+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.623097+0000","last_change":"2023-08-31T19:07:21.168504+0000","last_active":"2023-08-31T19:07:21.623097+0000","last_peered":"2023-08-31T19:07:21.623097+0000","last_clean":"2023-08-31T19:07:21.623097+0000","last_became_active":"2023-08-31T19:07:21.168204+0000","last_became_peered":"2023-08-31T19:07:21.168204+0000","last_unstale":"2023-08-31T19:07:21.623097+0000","last_undegraded":"2023-08-31T19:07:21.623097+0000","last_fullsized":"2023-08-31T19:07:21.623097+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637210+0000","last_change":"2023-08-31T19:07:21.626012+0000","last_active":"2023-08-31T19:07:21.637210+0000","last_peered":"2023-08-31T19:07:21.637210+0000","last_clean":"2023-08-31T19:07:21.637210+0000","last_became_active":"2023-08-31T19:07:21.625699+0000","last_became_peered":"2023-08-31T19:07:21.625699+0000","last_unstale":"2023-08-31T19:07:21.637210+0000","last_undegraded":"2023-08-31T19:07:21.637210+0000","last_fullsized":"2023-08-31T19:07:21.637210+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.621858+0000","last_change":"2023-08-31T19:07:21.175304+0000","last_active":"2023-08-31T19:07:21.621858+0000","last_peered":"2023-08-31T19:07:21.621858+0000","last_clean":"2023-08-31T19:07:21.621858+0000","last_became_active":"2023-08-31T19:07:21.174885+0000","last_became_peered":"2023-08-31T19:07:21.174885+0000","last_unstale":"2023-08-31T19:07:21.621858+0000","last_undegraded":"2023-08-31T19:07:21.621858+0000","last_fullsized":"2023-08-31T19:07:21.621858+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643638+0000","last_change":"2023-08-31T19:07:21.638603+0000","last_active":"2023-08-31T19:07:21.643638+0000","last_peered":"2023-08-31T19:07:21.643638+0000","last_clean":"2023-08-31T19:07:21.643638+0000","last_became_active":"2023-08-31T19:07:21.637923+0000","last_became_peered":"2023-08-31T19:07:21.637923+0000","last_unstale":"2023-08-31T19:07:21.643638+0000","last_undegraded":"2023-08-31T19:07:21.643638+0000","last_fullsized":"2023-08-31T19:07:21.643638+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622885+0000","last_change":"2023-08-31T19:07:21.164549+0000","last_active":"2023-08-31T19:07:21.622885+0000","last_peered":"2023-08-31T19:07:21.622885+0000","last_clean":"2023-08-31T19:07:21.622885+0000","last_became_active":"2023-08-31T19:07:21.164212+0000","last_became_peered":"2023-08-31T19:07:21.164212+0000","last_unstale":"2023-08-31T19:07:21.622885+0000","last_undegraded":"2023-08-31T19:07:21.622885+0000","last_fullsized":"2023-08-31T19:07:21.622885+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.642966+0000","last_change":"2023-08-31T19:07:21.640858+0000","last_active":"2023-08-31T19:07:21.642966+0000","last_peered":"2023-08-31T19:07:21.642966+0000","last_clean":"2023-08-31T19:07:21.642966+0000","last_became_active":"2023-08-31T19:07:21.640579+0000","last_became_peered":"2023-08-31T19:07:21.640579+0000","last_unstale":"2023-08-31T19:07:21.642966+0000","last_undegraded":"2023-08-31T19:07:21.642966+0000","last_fullsized":"2023-08-31T19:07:21.642966+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.624903+0000","last_change":"2023-08-31T19:07:21.159656+0000","last_active":"2023-08-31T19:07:21.624903+0000","last_peered":"2023-08-31T19:07:21.624903+0000","last_clean":"2023-08-31T19:07:21.624903+0000","last_became_active":"2023-08-31T19:07:21.159374+0000","last_became_peered":"2023-08-31T19:07:21.159374+0000","last_unstale":"2023-08-31T19:07:21.624903+0000","last_undegraded":"2023-08-31T19:07:21.624903+0000","last_fullsized":"2023-08-31T19:07:21.624903+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.636683+0000","last_change":"2023-08-31T19:07:21.629580+0000","last_active":"2023-08-31T19:07:21.636683+0000","last_peered":"2023-08-31T19:07:21.636683+0000","last_clean":"2023-08-31T19:07:21.636683+0000","last_became_active":"2023-08-31T19:07:21.629316+0000","last_became_peered":"2023-08-31T19:07:21.629316+0000","last_unstale":"2023-08-31T19:07:21.636683+0000","last_undegraded":"2023-08-31T19:07:21.636683+0000","last_fullsized":"2023-08-31T19:07:21.636683+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615456+0000","last_change":"2023-08-31T19:07:21.167337+0000","last_active":"2023-08-31T19:07:21.615456+0000","last_peered":"2023-08-31T19:07:21.615456+0000","last_clean":"2023-08-31T19:07:21.615456+0000","last_became_active":"2023-08-31T19:07:21.167025+0000","last_became_peered":"2023-08-31T19:07:21.167025+0000","last_unstale":"2023-08-31T19:07:21.615456+0000","last_undegraded":"2023-08-31T19:07:21.615456+0000","last_fullsized":"2023-08-31T19:07:21.615456+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.646453+0000","last_change":"2023-08-31T19:07:21.643574+0000","last_active":"2023-08-31T19:07:21.646453+0000","last_peered":"2023-08-31T19:07:21.646453+0000","last_clean":"2023-08-31T19:07:21.646453+0000","last_became_active":"2023-08-31T19:07:21.643252+0000","last_became_peered":"2023-08-31T19:07:21.643252+0000","last_unstale":"2023-08-31T19:07:21.646453+0000","last_undegraded":"2023-08-31T19:07:21.646453+0000","last_fullsized":"2023-08-31T19:07:21.646453+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.621611+0000","last_change":"2023-08-31T19:07:21.174944+0000","last_active":"2023-08-31T19:07:21.621611+0000","last_peered":"2023-08-31T19:07:21.621611+0000","last_clean":"2023-08-31T19:07:21.621611+0000","last_became_active":"2023-08-31T19:07:21.174606+0000","last_became_peered":"2023-08-31T19:07:21.174606+0000","last_unstale":"2023-08-31T19:07:21.621611+0000","last_undegraded":"2023-08-31T19:07:21.621611+0000","last_fullsized":"2023-08-31T19:07:21.621611+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645123+0000","last_change":"2023-08-31T19:07:21.634968+0000","last_active":"2023-08-31T19:07:21.645123+0000","last_peered":"2023-08-31T19:07:21.645123+0000","last_clean":"2023-08-31T19:07:21.645123+0000","last_became_active":"2023-08-31T19:07:21.634325+0000","last_became_peered":"2023-08-31T19:07:21.634325+0000","last_unstale":"2023-08-31T19:07:21.645123+0000","last_undegraded":"2023-08-31T19:07:21.645123+0000","last_fullsized":"2023-08-31T19:07:21.645123+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.624207+0000","last_change":"2023-08-31T19:07:21.168791+0000","last_active":"2023-08-31T19:07:21.624207+0000","last_peered":"2023-08-31T19:07:21.624207+0000","last_clean":"2023-08-31T19:07:21.624207+0000","last_became_active":"2023-08-31T19:07:21.167795+0000","last_became_peered":"2023-08-31T19:07:21.167795+0000","last_unstale":"2023-08-31T19:07:21.624207+0000","last_undegraded":"2023-08-31T19:07:21.624207+0000","last_fullsized":"2023-08-31T19:07:21.624207+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.644998+0000","last_change":"2023-08-31T19:07:21.634207+0000","last_active":"2023-08-31T19:07:21.644998+0000","last_peered":"2023-08-31T19:07:21.644998+0000","last_clean":"2023-08-31T19:07:21.644998+0000","last_became_active":"2023-08-31T19:07:21.633877+0000","last_became_peered":"2023-08-31T19:07:21.633877+0000","last_unstale":"2023-08-31T19:07:21.644998+0000","last_undegraded":"2023-08-31T19:07:21.644998+0000","last_fullsized":"2023-08-31T19:07:21.644998+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622693+0000","last_change":"2023-08-31T19:07:21.172120+0000","last_active":"2023-08-31T19:07:21.622693+0000","last_peered":"2023-08-31T19:07:21.622693+0000","last_clean":"2023-08-31T19:07:21.622693+0000","last_became_active":"2023-08-31T19:07:21.171710+0000","last_became_peered":"2023-08-31T19:07:21.171710+0000","last_unstale":"2023-08-31T19:07:21.622693+0000","last_undegraded":"2023-08-31T19:07:21.622693+0000","last_fullsized":"2023-08-31T19:07:21.622693+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643891+0000","last_change":"2023-08-31T19:07:21.635788+0000","last_active":"2023-08-31T19:07:21.643891+0000","last_peered":"2023-08-31T19:07:21.643891+0000","last_clean":"2023-08-31T19:07:21.643891+0000","last_became_active":"2023-08-31T19:07:21.634663+0000","last_became_peered":"2023-08-31T19:07:21.634663+0000","last_unstale":"2023-08-31T19:07:21.643891+0000","last_undegraded":"2023-08-31T19:07:21.643891+0000","last_fullsized":"2023-08-31T19:07:21.643891+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.623859+0000","last_change":"2023-08-31T19:07:21.160639+0000","last_active":"2023-08-31T19:07:21.623859+0000","last_peered":"2023-08-31T19:07:21.623859+0000","last_clean":"2023-08-31T19:07:21.623859+0000","last_became_active":"2023-08-31T19:07:21.160360+0000","last_became_peered":"2023-08-31T19:07:21.160360+0000","last_unstale":"2023-08-31T19:07:21.623859+0000","last_undegraded":"2023-08-31T19:07:21.623859+0000","last_fullsized":"2023-08-31T19:07:21.623859+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649336+0000","last_change":"2023-08-31T19:07:21.639760+0000","last_active":"2023-08-31T19:07:21.649336+0000","last_peered":"2023-08-31T19:07:21.649336+0000","last_clean":"2023-08-31T19:07:21.649336+0000","last_became_active":"2023-08-31T19:07:21.639485+0000","last_became_peered":"2023-08-31T19:07:21.639485+0000","last_unstale":"2023-08-31T19:07:21.649336+0000","last_undegraded":"2023-08-31T19:07:21.649336+0000","last_fullsized":"2023-08-31T19:07:21.649336+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615647+0000","last_change":"2023-08-31T19:07:21.170254+0000","last_active":"2023-08-31T19:07:21.615647+0000","last_peered":"2023-08-31T19:07:21.615647+0000","last_clean":"2023-08-31T19:07:21.615647+0000","last_became_active":"2023-08-31T19:07:21.169983+0000","last_became_peered":"2023-08-31T19:07:21.169983+0000","last_unstale":"2023-08-31T19:07:21.615647+0000","last_undegraded":"2023-08-31T19:07:21.615647+0000","last_fullsized":"2023-08-31T19:07:21.615647+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649755+0000","last_change":"2023-08-31T19:07:21.642018+0000","last_active":"2023-08-31T19:07:21.649755+0000","last_peered":"2023-08-31T19:07:21.649755+0000","last_clean":"2023-08-31T19:07:21.649755+0000","last_became_active":"2023-08-31T19:07:21.641669+0000","last_became_peered":"2023-08-31T19:07:21.641669+0000","last_unstale":"2023-08-31T19:07:21.649755+0000","last_undegraded":"2023-08-31T19:07:21.649755+0000","last_fullsized":"2023-08-31T19:07:21.649755+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.640283+0000","last_change":"2023-08-31T19:07:21.167435+0000","last_active":"2023-08-31T19:07:21.640283+0000","last_peered":"2023-08-31T19:07:21.640283+0000","last_clean":"2023-08-31T19:07:21.640283+0000","last_became_active":"2023-08-31T19:07:21.167056+0000","last_became_peered":"2023-08-31T19:07:21.167056+0000","last_unstale":"2023-08-31T19:07:21.640283+0000","last_undegraded":"2023-08-31T19:07:21.640283+0000","last_fullsized":"2023-08-31T19:07:21.640283+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.644681+0000","last_change":"2023-08-31T19:07:21.639021+0000","last_active":"2023-08-31T19:07:21.644681+0000","last_peered":"2023-08-31T19:07:21.644681+0000","last_clean":"2023-08-31T19:07:21.644681+0000","last_became_active":"2023-08-31T19:07:21.638744+0000","last_became_peered":"2023-08-31T19:07:21.638744+0000","last_unstale":"2023-08-31T19:07:21.644681+0000","last_undegraded":"2023-08-31T19:07:21.644681+0000","last_fullsized":"2023-08-31T19:07:21.644681+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.640360+0000","last_change":"2023-08-31T19:07:21.173109+0000","last_active":"2023-08-31T19:07:21.640360+0000","last_peered":"2023-08-31T19:07:21.640360+0000","last_clean":"2023-08-31T19:07:21.640360+0000","last_became_active":"2023-08-31T19:07:21.172466+0000","last_became_peered":"2023-08-31T19:07:21.172466+0000","last_unstale":"2023-08-31T19:07:21.640360+0000","last_undegraded":"2023-08-31T19:07:21.640360+0000","last_fullsized":"2023-08-31T19:07:21.640360+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645374+0000","last_change":"2023-08-31T19:07:21.637333+0000","last_active":"2023-08-31T19:07:21.645374+0000","last_peered":"2023-08-31T19:07:21.645374+0000","last_clean":"2023-08-31T19:07:21.645374+0000","last_became_active":"2023-08-31T19:07:21.637026+0000","last_became_peered":"2023-08-31T19:07:21.637026+0000","last_unstale":"2023-08-31T19:07:21.645374+0000","last_undegraded":"2023-08-31T19:07:21.645374+0000","last_fullsized":"2023-08-31T19:07:21.645374+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649775+0000","last_change":"2023-08-31T19:07:21.172258+0000","last_active":"2023-08-31T19:07:21.649775+0000","last_peered":"2023-08-31T19:07:21.649775+0000","last_clean":"2023-08-31T19:07:21.649775+0000","last_became_active":"2023-08-31T19:07:21.171932+0000","last_became_peered":"2023-08-31T19:07:21.171932+0000","last_unstale":"2023-08-31T19:07:21.649775+0000","last_undegraded":"2023-08-31T19:07:21.649775+0000","last_fullsized":"2023-08-31T19:07:21.649775+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.638575+0000","last_change":"2023-08-31T19:07:21.626012+0000","last_active":"2023-08-31T19:07:21.638575+0000","last_peered":"2023-08-31T19:07:21.638575+0000","last_clean":"2023-08-31T19:07:21.638575+0000","last_became_active":"2023-08-31T19:07:21.625588+0000","last_became_peered":"2023-08-31T19:07:21.625588+0000","last_unstale":"2023-08-31T19:07:21.638575+0000","last_undegraded":"2023-08-31T19:07:21.638575+0000","last_fullsized":"2023-08-31T19:07:21.638575+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615505+0000","last_change":"2023-08-31T19:07:21.170586+0000","last_active":"2023-08-31T19:07:21.615505+0000","last_peered":"2023-08-31T19:07:21.615505+0000","last_clean":"2023-08-31T19:07:21.615505+0000","last_became_active":"2023-08-31T19:07:21.170332+0000","last_became_peered":"2023-08-31T19:07:21.170332+0000","last_unstale":"2023-08-31T19:07:21.615505+0000","last_undegraded":"2023-08-31T19:07:21.615505+0000","last_fullsized":"2023-08-31T19:07:21.615505+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.629530+0000","last_change":"2023-08-31T19:07:21.623116+0000","last_active":"2023-08-31T19:07:21.629530+0000","last_peered":"2023-08-31T19:07:21.629530+0000","last_clean":"2023-08-31T19:07:21.629530+0000","last_became_active":"2023-08-31T19:07:21.622801+0000","last_became_peered":"2023-08-31T19:07:21.622801+0000","last_unstale":"2023-08-31T19:07:21.629530+0000","last_undegraded":"2023-08-31T19:07:21.629530+0000","last_fullsized":"2023-08-31T19:07:21.629530+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.624307+0000","last_change":"2023-08-31T19:07:21.172261+0000","last_active":"2023-08-31T19:07:21.624307+0000","last_peered":"2023-08-31T19:07:21.624307+0000","last_clean":"2023-08-31T19:07:21.624307+0000","last_became_active":"2023-08-31T19:07:21.171927+0000","last_became_peered":"2023-08-31T19:07:21.171927+0000","last_unstale":"2023-08-31T19:07:21.624307+0000","last_undegraded":"2023-08-31T19:07:21.624307+0000","last_fullsized":"2023-08-31T19:07:21.624307+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.641076+0000","last_change":"2023-08-31T19:07:21.636518+0000","last_active":"2023-08-31T19:07:21.641076+0000","last_peered":"2023-08-31T19:07:21.641076+0000","last_clean":"2023-08-31T19:07:21.641076+0000","last_became_active":"2023-08-31T19:07:21.636156+0000","last_became_peered":"2023-08-31T19:07:21.636156+0000","last_unstale":"2023-08-31T19:07:21.641076+0000","last_undegraded":"2023-08-31T19:07:21.641076+0000","last_fullsized":"2023-08-31T19:07:21.641076+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.624220+0000","last_change":"2023-08-31T19:07:21.178298+0000","last_active":"2023-08-31T19:07:21.624220+0000","last_peered":"2023-08-31T19:07:21.624220+0000","last_clean":"2023-08-31T19:07:21.624220+0000","last_became_active":"2023-08-31T19:07:21.177826+0000","last_became_peered":"2023-08-31T19:07:21.177826+0000","last_unstale":"2023-08-31T19:07:21.624220+0000","last_undegraded":"2023-08-31T19:07:21.624220+0000","last_fullsized":"2023-08-31T19:07:21.624220+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643864+0000","last_change":"2023-08-31T19:07:21.635549+0000","last_active":"2023-08-31T19:07:21.643864+0000","last_peered":"2023-08-31T19:07:21.643864+0000","last_clean":"2023-08-31T19:07:21.643864+0000","last_became_active":"2023-08-31T19:07:21.634353+0000","last_became_peered":"2023-08-31T19:07:21.634353+0000","last_unstale":"2023-08-31T19:07:21.643864+0000","last_undegraded":"2023-08-31T19:07:21.643864+0000","last_fullsized":"2023-08-31T19:07:21.643864+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.621271+0000","last_change":"2023-08-31T19:07:21.164387+0000","last_active":"2023-08-31T19:07:21.621271+0000","last_peered":"2023-08-31T19:07:21.621271+0000","last_clean":"2023-08-31T19:07:21.621271+0000","last_became_active":"2023-08-31T19:07:21.164093+0000","last_became_peered":"2023-08-31T19:07:21.164093+0000","last_unstale":"2023-08-31T19:07:21.621271+0000","last_undegraded":"2023-08-31T19:07:21.621271+0000","last_fullsized":"2023-08-31T19:07:21.621271+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.649503+0000","last_change":"2023-08-31T19:07:21.635446+0000","last_active":"2023-08-31T19:07:21.649503+0000","last_peered":"2023-08-31T19:07:21.649503+0000","last_clean":"2023-08-31T19:07:21.649503+0000","last_became_active":"2023-08-31T19:07:21.635155+0000","last_became_peered":"2023-08-31T19:07:21.635155+0000","last_unstale":"2023-08-31T19:07:21.649503+0000","last_undegraded":"2023-08-31T19:07:21.649503+0000","last_fullsized":"2023-08-31T19:07:21.649503+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.626665+0000","last_change":"2023-08-31T19:07:21.165918+0000","last_active":"2023-08-31T19:07:21.626665+0000","last_peered":"2023-08-31T19:07:21.626665+0000","last_clean":"2023-08-31T19:07:21.626665+0000","last_became_active":"2023-08-31T19:07:21.165607+0000","last_became_peered":"2023-08-31T19:07:21.165607+0000","last_unstale":"2023-08-31T19:07:21.626665+0000","last_undegraded":"2023-08-31T19:07:21.626665+0000","last_fullsized":"2023-08-31T19:07:21.626665+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.647096+0000","last_change":"2023-08-31T19:07:21.644853+0000","last_active":"2023-08-31T19:07:21.647096+0000","last_peered":"2023-08-31T19:07:21.647096+0000","last_clean":"2023-08-31T19:07:21.647096+0000","last_became_active":"2023-08-31T19:07:21.644447+0000","last_became_peered":"2023-08-31T19:07:21.644447+0000","last_unstale":"2023-08-31T19:07:21.647096+0000","last_undegraded":"2023-08-31T19:07:21.647096+0000","last_fullsized":"2023-08-31T19:07:21.647096+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.638706+0000","last_change":"2023-08-31T19:07:21.166415+0000","last_active":"2023-08-31T19:07:21.638706+0000","last_peered":"2023-08-31T19:07:21.638706+0000","last_clean":"2023-08-31T19:07:21.638706+0000","last_became_active":"2023-08-31T19:07:21.166154+0000","last_became_peered":"2023-08-31T19:07:21.166154+0000","last_unstale":"2023-08-31T19:07:21.638706+0000","last_undegraded":"2023-08-31T19:07:21.638706+0000","last_fullsized":"2023-08-31T19:07:21.638706+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.641946+0000","last_change":"2023-08-31T19:07:21.639139+0000","last_active":"2023-08-31T19:07:21.641946+0000","last_peered":"2023-08-31T19:07:21.641946+0000","last_clean":"2023-08-31T19:07:21.641946+0000","last_became_active":"2023-08-31T19:07:21.638770+0000","last_became_peered":"2023-08-31T19:07:21.638770+0000","last_unstale":"2023-08-31T19:07:21.641946+0000","last_undegraded":"2023-08-31T19:07:21.641946+0000","last_fullsized":"2023-08-31T19:07:21.641946+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.641298+0000","last_change":"2023-08-31T19:07:21.179331+0000","last_active":"2023-08-31T19:07:21.641298+0000","last_peered":"2023-08-31T19:07:21.641298+0000","last_clean":"2023-08-31T19:07:21.641298+0000","last_became_active":"2023-08-31T19:07:21.178965+0000","last_became_peered":"2023-08-31T19:07:21.178965+0000","last_unstale":"2023-08-31T19:07:21.641298+0000","last_undegraded":"2023-08-31T19:07:21.641298+0000","last_fullsized":"2023-08-31T19:07:21.641298+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.642661+0000","last_change":"2023-08-31T19:07:21.636857+0000","last_active":"2023-08-31T19:07:21.642661+0000","last_peered":"2023-08-31T19:07:21.642661+0000","last_clean":"2023-08-31T19:07:21.642661+0000","last_became_active":"2023-08-31T19:07:21.636342+0000","last_became_peered":"2023-08-31T19:07:21.636342+0000","last_unstale":"2023-08-31T19:07:21.642661+0000","last_undegraded":"2023-08-31T19:07:21.642661+0000","last_fullsized":"2023-08-31T19:07:21.642661+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.616085+0000","last_change":"2023-08-31T19:07:21.169429+0000","last_active":"2023-08-31T19:07:21.616085+0000","last_peered":"2023-08-31T19:07:21.616085+0000","last_clean":"2023-08-31T19:07:21.616085+0000","last_became_active":"2023-08-31T19:07:21.169032+0000","last_became_peered":"2023-08-31T19:07:21.169032+0000","last_unstale":"2023-08-31T19:07:21.616085+0000","last_undegraded":"2023-08-31T19:07:21.616085+0000","last_fullsized":"2023-08-31T19:07:21.616085+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.647110+0000","last_change":"2023-08-31T19:07:21.646272+0000","last_active":"2023-08-31T19:07:21.647110+0000","last_peered":"2023-08-31T19:07:21.647110+0000","last_clean":"2023-08-31T19:07:21.647110+0000","last_became_active":"2023-08-31T19:07:21.645993+0000","last_became_peered":"2023-08-31T19:07:21.645993+0000","last_unstale":"2023-08-31T19:07:21.647110+0000","last_undegraded":"2023-08-31T19:07:21.647110+0000","last_fullsized":"2023-08-31T19:07:21.647110+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615950+0000","last_change":"2023-08-31T19:07:21.166038+0000","last_active":"2023-08-31T19:07:21.615950+0000","last_peered":"2023-08-31T19:07:21.615950+0000","last_clean":"2023-08-31T19:07:21.615950+0000","last_became_active":"2023-08-31T19:07:21.165742+0000","last_became_peered":"2023-08-31T19:07:21.165742+0000","last_unstale":"2023-08-31T19:07:21.615950+0000","last_undegraded":"2023-08-31T19:07:21.615950+0000","last_fullsized":"2023-08-31T19:07:21.615950+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.644012+0000","last_change":"2023-08-31T19:07:21.639386+0000","last_active":"2023-08-31T19:07:21.644012+0000","last_peered":"2023-08-31T19:07:21.644012+0000","last_clean":"2023-08-31T19:07:21.644012+0000","last_became_active":"2023-08-31T19:07:21.639126+0000","last_became_peered":"2023-08-31T19:07:21.639126+0000","last_unstale":"2023-08-31T19:07:21.644012+0000","last_undegraded":"2023-08-31T19:07:21.644012+0000","last_fullsized":"2023-08-31T19:07:21.644012+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.641061+0000","last_change":"2023-08-31T19:07:21.172278+0000","last_active":"2023-08-31T19:07:21.641061+0000","last_peered":"2023-08-31T19:07:21.641061+0000","last_clean":"2023-08-31T19:07:21.641061+0000","last_became_active":"2023-08-31T19:07:21.171988+0000","last_became_peered":"2023-08-31T19:07:21.171988+0000","last_unstale":"2023-08-31T19:07:21.641061+0000","last_undegraded":"2023-08-31T19:07:21.641061+0000","last_fullsized":"2023-08-31T19:07:21.641061+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.642914+0000","last_change":"2023-08-31T19:07:21.633570+0000","last_active":"2023-08-31T19:07:21.642914+0000","last_peered":"2023-08-31T19:07:21.642914+0000","last_clean":"2023-08-31T19:07:21.642914+0000","last_became_active":"2023-08-31T19:07:21.632447+0000","last_became_peered":"2023-08-31T19:07:21.632447+0000","last_unstale":"2023-08-31T19:07:21.642914+0000","last_undegraded":"2023-08-31T19:07:21.642914+0000","last_fullsized":"2023-08-31T19:07:21.642914+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615308+0000","last_change":"2023-08-31T19:07:21.167197+0000","last_active":"2023-08-31T19:07:21.615308+0000","last_peered":"2023-08-31T19:07:21.615308+0000","last_clean":"2023-08-31T19:07:21.615308+0000","last_became_active":"2023-08-31T19:07:21.166724+0000","last_became_peered":"2023-08-31T19:07:21.166724+0000","last_unstale":"2023-08-31T19:07:21.615308+0000","last_undegraded":"2023-08-31T19:07:21.615308+0000","last_fullsized":"2023-08-31T19:07:21.615308+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643927+0000","last_change":"2023-08-31T19:07:21.636245+0000","last_active":"2023-08-31T19:07:21.643927+0000","last_peered":"2023-08-31T19:07:21.643927+0000","last_clean":"2023-08-31T19:07:21.643927+0000","last_became_active":"2023-08-31T19:07:21.635294+0000","last_became_peered":"2023-08-31T19:07:21.635294+0000","last_unstale":"2023-08-31T19:07:21.643927+0000","last_undegraded":"2023-08-31T19:07:21.643927+0000","last_fullsized":"2023-08-31T19:07:21.643927+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.621532+0000","last_change":"2023-08-31T19:07:21.175963+0000","last_active":"2023-08-31T19:07:21.621532+0000","last_peered":"2023-08-31T19:07:21.621532+0000","last_clean":"2023-08-31T19:07:21.621532+0000","last_became_active":"2023-08-31T19:07:21.175606+0000","last_became_peered":"2023-08-31T19:07:21.175606+0000","last_unstale":"2023-08-31T19:07:21.621532+0000","last_undegraded":"2023-08-31T19:07:21.621532+0000","last_fullsized":"2023-08-31T19:07:21.621532+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645368+0000","last_change":"2023-08-31T19:07:21.635953+0000","last_active":"2023-08-31T19:07:21.645368+0000","last_peered":"2023-08-31T19:07:21.645368+0000","last_clean":"2023-08-31T19:07:21.645368+0000","last_became_active":"2023-08-31T19:07:21.635447+0000","last_became_peered":"2023-08-31T19:07:21.635447+0000","last_unstale":"2023-08-31T19:07:21.645368+0000","last_undegraded":"2023-08-31T19:07:21.645368+0000","last_fullsized":"2023-08-31T19:07:21.645368+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615261+0000","last_change":"2023-08-31T19:07:21.174879+0000","last_active":"2023-08-31T19:07:21.615261+0000","last_peered":"2023-08-31T19:07:21.615261+0000","last_clean":"2023-08-31T19:07:21.615261+0000","last_became_active":"2023-08-31T19:07:21.174596+0000","last_became_peered":"2023-08-31T19:07:21.174596+0000","last_unstale":"2023-08-31T19:07:21.615261+0000","last_undegraded":"2023-08-31T19:07:21.615261+0000","last_fullsized":"2023-08-31T19:07:21.615261+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.643656+0000","last_change":"2023-08-31T19:07:21.638772+0000","last_active":"2023-08-31T19:07:21.643656+0000","last_peered":"2023-08-31T19:07:21.643656+0000","last_clean":"2023-08-31T19:07:21.643656+0000","last_became_active":"2023-08-31T19:07:21.638273+0000","last_became_peered":"2023-08-31T19:07:21.638273+0000","last_unstale":"2023-08-31T19:07:21.643656+0000","last_undegraded":"2023-08-31T19:07:21.643656+0000","last_fullsized":"2023-08-31T19:07:21.643656+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.644076+0000","last_change":"2023-08-31T19:07:21.164933+0000","last_active":"2023-08-31T19:07:21.644076+0000","last_peered":"2023-08-31T19:07:21.644076+0000","last_clean":"2023-08-31T19:07:21.644076+0000","last_became_active":"2023-08-31T19:07:21.164612+0000","last_became_peered":"2023-08-31T19:07:21.164612+0000","last_unstale":"2023-08-31T19:07:21.644076+0000","last_undegraded":"2023-08-31T19:07:21.644076+0000","last_fullsized":"2023-08-31T19:07:21.644076+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.636984+0000","last_change":"2023-08-31T19:07:21.628489+0000","last_active":"2023-08-31T19:07:21.636984+0000","last_peered":"2023-08-31T19:07:21.636984+0000","last_clean":"2023-08-31T19:07:21.636984+0000","last_became_active":"2023-08-31T19:07:21.628071+0000","last_became_peered":"2023-08-31T19:07:21.628071+0000","last_unstale":"2023-08-31T19:07:21.636984+0000","last_undegraded":"2023-08-31T19:07:21.636984+0000","last_fullsized":"2023-08-31T19:07:21.636984+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.618131+0000","last_change":"2023-08-31T19:07:21.157544+0000","last_active":"2023-08-31T19:07:21.618131+0000","last_peered":"2023-08-31T19:07:21.618131+0000","last_clean":"2023-08-31T19:07:21.618131+0000","last_became_active":"2023-08-31T19:07:21.157031+0000","last_became_peered":"2023-08-31T19:07:21.157031+0000","last_unstale":"2023-08-31T19:07:21.618131+0000","last_undegraded":"2023-08-31T19:07:21.618131+0000","last_fullsized":"2023-08-31T19:07:21.618131+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637860+0000","last_change":"2023-08-31T19:07:21.630580+0000","last_active":"2023-08-31T19:07:21.637860+0000","last_peered":"2023-08-31T19:07:21.637860+0000","last_clean":"2023-08-31T19:07:21.637860+0000","last_became_active":"2023-08-31T19:07:21.630226+0000","last_became_peered":"2023-08-31T19:07:21.630226+0000","last_unstale":"2023-08-31T19:07:21.637860+0000","last_undegraded":"2023-08-31T19:07:21.637860+0000","last_fullsized":"2023-08-31T19:07:21.637860+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.619516+0000","last_change":"2023-08-31T19:07:21.159213+0000","last_active":"2023-08-31T19:07:21.619516+0000","last_peered":"2023-08-31T19:07:21.619516+0000","last_clean":"2023-08-31T19:07:21.619516+0000","last_became_active":"2023-08-31T19:07:21.158863+0000","last_became_peered":"2023-08-31T19:07:21.158863+0000","last_unstale":"2023-08-31T19:07:21.619516+0000","last_undegraded":"2023-08-31T19:07:21.619516+0000","last_fullsized":"2023-08-31T19:07:21.619516+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.632357+0000","last_change":"2023-08-31T19:07:21.630190+0000","last_active":"2023-08-31T19:07:21.632357+0000","last_peered":"2023-08-31T19:07:21.632357+0000","last_clean":"2023-08-31T19:07:21.632357+0000","last_became_active":"2023-08-31T19:07:21.629865+0000","last_became_peered":"2023-08-31T19:07:21.629865+0000","last_unstale":"2023-08-31T19:07:21.632357+0000","last_undegraded":"2023-08-31T19:07:21.632357+0000","last_fullsized":"2023-08-31T19:07:21.632357+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.629638+0000","last_change":"2023-08-31T19:07:21.166225+0000","last_active":"2023-08-31T19:07:21.629638+0000","last_peered":"2023-08-31T19:07:21.629638+0000","last_clean":"2023-08-31T19:07:21.629638+0000","last_became_active":"2023-08-31T19:07:21.164139+0000","last_became_peered":"2023-08-31T19:07:21.164139+0000","last_unstale":"2023-08-31T19:07:21.629638+0000","last_undegraded":"2023-08-31T19:07:21.629638+0000","last_fullsized":"2023-08-31T19:07:21.629638+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645144+0000","last_change":"2023-08-31T19:07:21.642501+0000","last_active":"2023-08-31T19:07:21.645144+0000","last_peered":"2023-08-31T19:07:21.645144+0000","last_clean":"2023-08-31T19:07:21.645144+0000","last_became_active":"2023-08-31T19:07:21.640112+0000","last_became_peered":"2023-08-31T19:07:21.640112+0000","last_unstale":"2023-08-31T19:07:21.645144+0000","last_undegraded":"2023-08-31T19:07:21.645144+0000","last_fullsized":"2023-08-31T19:07:21.645144+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.624418+0000","last_change":"2023-08-31T19:07:21.169747+0000","last_active":"2023-08-31T19:07:21.624418+0000","last_peered":"2023-08-31T19:07:21.624418+0000","last_clean":"2023-08-31T19:07:21.624418+0000","last_became_active":"2023-08-31T19:07:21.169478+0000","last_became_peered":"2023-08-31T19:07:21.169478+0000","last_unstale":"2023-08-31T19:07:21.624418+0000","last_undegraded":"2023-08-31T19:07:21.624418+0000","last_fullsized":"2023-08-31T19:07:21.624418+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.642895+0000","last_change":"2023-08-31T19:07:21.633394+0000","last_active":"2023-08-31T19:07:21.642895+0000","last_peered":"2023-08-31T19:07:21.642895+0000","last_clean":"2023-08-31T19:07:21.642895+0000","last_became_active":"2023-08-31T19:07:21.632836+0000","last_became_peered":"2023-08-31T19:07:21.632836+0000","last_unstale":"2023-08-31T19:07:21.642895+0000","last_undegraded":"2023-08-31T19:07:21.642895+0000","last_fullsized":"2023-08-31T19:07:21.642895+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622062+0000","last_change":"2023-08-31T19:07:21.170517+0000","last_active":"2023-08-31T19:07:21.622062+0000","last_peered":"2023-08-31T19:07:21.622062+0000","last_clean":"2023-08-31T19:07:21.622062+0000","last_became_active":"2023-08-31T19:07:21.170258+0000","last_became_peered":"2023-08-31T19:07:21.170258+0000","last_unstale":"2023-08-31T19:07:21.622062+0000","last_undegraded":"2023-08-31T19:07:21.622062+0000","last_fullsized":"2023-08-31T19:07:21.622062+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645481+0000","last_change":"2023-08-31T19:07:21.643018+0000","last_active":"2023-08-31T19:07:21.645481+0000","last_peered":"2023-08-31T19:07:21.645481+0000","last_clean":"2023-08-31T19:07:21.645481+0000","last_became_active":"2023-08-31T19:07:21.642673+0000","last_became_peered":"2023-08-31T19:07:21.642673+0000","last_unstale":"2023-08-31T19:07:21.645481+0000","last_undegraded":"2023-08-31T19:07:21.645481+0000","last_fullsized":"2023-08-31T19:07:21.645481+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.623967+0000","last_change":"2023-08-31T19:07:21.166014+0000","last_active":"2023-08-31T19:07:21.623967+0000","last_peered":"2023-08-31T19:07:21.623967+0000","last_clean":"2023-08-31T19:07:21.623967+0000","last_became_active":"2023-08-31T19:07:21.165743+0000","last_became_peered":"2023-08-31T19:07:21.165743+0000","last_unstale":"2023-08-31T19:07:21.623967+0000","last_undegraded":"2023-08-31T19:07:21.623967+0000","last_fullsized":"2023-08-31T19:07:21.623967+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.631550+0000","last_change":"2023-08-31T19:07:21.626438+0000","last_active":"2023-08-31T19:07:21.631550+0000","last_peered":"2023-08-31T19:07:21.631550+0000","last_clean":"2023-08-31T19:07:21.631550+0000","last_became_active":"2023-08-31T19:07:21.626161+0000","last_became_peered":"2023-08-31T19:07:21.626161+0000","last_unstale":"2023-08-31T19:07:21.631550+0000","last_undegraded":"2023-08-31T19:07:21.631550+0000","last_fullsized":"2023-08-31T19:07:21.631550+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.616276+0000","last_change":"2023-08-31T19:07:21.166722+0000","last_active":"2023-08-31T19:07:21.616276+0000","last_peered":"2023-08-31T19:07:21.616276+0000","last_clean":"2023-08-31T19:07:21.616276+0000","last_became_active":"2023-08-31T19:07:21.166463+0000","last_became_peered":"2023-08-31T19:07:21.166463+0000","last_unstale":"2023-08-31T19:07:21.616276+0000","last_undegraded":"2023-08-31T19:07:21.616276+0000","last_fullsized":"2023-08-31T19:07:21.616276+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.639687+0000","last_change":"2023-08-31T19:07:21.635226+0000","last_active":"2023-08-31T19:07:21.639687+0000","last_peered":"2023-08-31T19:07:21.639687+0000","last_clean":"2023-08-31T19:07:21.639687+0000","last_became_active":"2023-08-31T19:07:21.634908+0000","last_became_peered":"2023-08-31T19:07:21.634908+0000","last_unstale":"2023-08-31T19:07:21.639687+0000","last_undegraded":"2023-08-31T19:07:21.639687+0000","last_fullsized":"2023-08-31T19:07:21.639687+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.618716+0000","last_change":"2023-08-31T19:07:21.158571+0000","last_active":"2023-08-31T19:07:21.618716+0000","last_peered":"2023-08-31T19:07:21.618716+0000","last_clean":"2023-08-31T19:07:21.618716+0000","last_became_active":"2023-08-31T19:07:21.158124+0000","last_became_peered":"2023-08-31T19:07:21.158124+0000","last_unstale":"2023-08-31T19:07:21.618716+0000","last_undegraded":"2023-08-31T19:07:21.618716+0000","last_fullsized":"2023-08-31T19:07:21.618716+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":128,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615593+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:07:21.615593+0000","last_peered":"2023-08-31T19:07:21.615593+0000","last_clean":"2023-08-31T19:07:21.615593+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:07:21.615593+0000","last_undegraded":"2023-08-31T19:07:21.615593+0000","last_fullsized":"2023-08-31T19:07:21.615593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637250+0000","last_change":"2023-08-31T19:07:21.633563+0000","last_active":"2023-08-31T19:07:21.637250+0000","last_peered":"2023-08-31T19:07:21.637250+0000","last_clean":"2023-08-31T19:07:21.637250+0000","last_became_active":"2023-08-31T19:07:21.633299+0000","last_became_peered":"2023-08-31T19:07:21.633299+0000","last_unstale":"2023-08-31T19:07:21.637250+0000","last_undegraded":"2023-08-31T19:07:21.637250+0000","last_fullsized":"2023-08-31T19:07:21.637250+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.621432+0000","last_change":"2023-08-31T19:07:21.170192+0000","last_active":"2023-08-31T19:07:21.621432+0000","last_peered":"2023-08-31T19:07:21.621432+0000","last_clean":"2023-08-31T19:07:21.621432+0000","last_became_active":"2023-08-31T19:07:21.169893+0000","last_became_peered":"2023-08-31T19:07:21.169893+0000","last_unstale":"2023-08-31T19:07:21.621432+0000","last_undegraded":"2023-08-31T19:07:21.621432+0000","last_fullsized":"2023-08-31T19:07:21.621432+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":119,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622781+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:07:21.622781+0000","last_peered":"2023-08-31T19:07:21.622781+0000","last_clean":"2023-08-31T19:07:21.622781+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:07:21.622781+0000","last_undegraded":"2023-08-31T19:07:21.622781+0000","last_fullsized":"2023-08-31T19:07:21.622781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.647209+0000","last_change":"2023-08-31T19:07:21.631301+0000","last_active":"2023-08-31T19:07:21.647209+0000","last_peered":"2023-08-31T19:07:21.647209+0000","last_clean":"2023-08-31T19:07:21.647209+0000","last_became_active":"2023-08-31T19:07:21.630965+0000","last_became_peered":"2023-08-31T19:07:21.630965+0000","last_unstale":"2023-08-31T19:07:21.647209+0000","last_undegraded":"2023-08-31T19:07:21.647209+0000","last_fullsized":"2023-08-31T19:07:21.647209+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622364+0000","last_change":"2023-08-31T19:07:21.171627+0000","last_active":"2023-08-31T19:07:21.622364+0000","last_peered":"2023-08-31T19:07:21.622364+0000","last_clean":"2023-08-31T19:07:21.622364+0000","last_became_active":"2023-08-31T19:07:21.171340+0000","last_became_peered":"2023-08-31T19:07:21.171340+0000","last_unstale":"2023-08-31T19:07:21.622364+0000","last_undegraded":"2023-08-31T19:07:21.622364+0000","last_fullsized":"2023-08-31T19:07:21.622364+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":120,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.619660+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:07:21.619660+0000","last_peered":"2023-08-31T19:07:21.619660+0000","last_clean":"2023-08-31T19:07:21.619660+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:07:21.619660+0000","last_undegraded":"2023-08-31T19:07:21.619660+0000","last_fullsized":"2023-08-31T19:07:21.619660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.637232+0000","last_change":"2023-08-31T19:07:21.626510+0000","last_active":"2023-08-31T19:07:21.637232+0000","last_peered":"2023-08-31T19:07:21.637232+0000","last_clean":"2023-08-31T19:07:21.637232+0000","last_became_active":"2023-08-31T19:07:21.626200+0000","last_became_peered":"2023-08-31T19:07:21.626200+0000","last_unstale":"2023-08-31T19:07:21.637232+0000","last_undegraded":"2023-08-31T19:07:21.637232+0000","last_fullsized":"2023-08-31T19:07:21.637232+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"141'4","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.646691+0000","last_change":"2023-08-31T19:07:21.175141+0000","last_active":"2023-08-31T19:07:21.646691+0000","last_peered":"2023-08-31T19:07:21.646691+0000","last_clean":"2023-08-31T19:07:21.646691+0000","last_became_active":"2023-08-31T19:07:21.174549+0000","last_became_peered":"2023-08-31T19:07:21.174549+0000","last_unstale":"2023-08-31T19:07:21.646691+0000","last_undegraded":"2023-08-31T19:07:21.646691+0000","last_fullsized":"2023-08-31T19:07:21.646691+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":119,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622843+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:07:21.622843+0000","last_peered":"2023-08-31T19:07:21.622843+0000","last_clean":"2023-08-31T19:07:21.622843+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:07:21.622843+0000","last_undegraded":"2023-08-31T19:07:21.622843+0000","last_fullsized":"2023-08-31T19:07:21.622843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":119,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.616363+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:07:21.616363+0000","last_peered":"2023-08-31T19:07:21.616363+0000","last_clean":"2023-08-31T19:07:21.616363+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:07:21.616363+0000","last_undegraded":"2023-08-31T19:07:21.616363+0000","last_fullsized":"2023-08-31T19:07:21.616363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.639754+0000","last_change":"2023-08-31T19:07:21.635567+0000","last_active":"2023-08-31T19:07:21.639754+0000","last_peered":"2023-08-31T19:07:21.639754+0000","last_clean":"2023-08-31T19:07:21.639754+0000","last_became_active":"2023-08-31T19:07:21.634827+0000","last_became_peered":"2023-08-31T19:07:21.634827+0000","last_unstale":"2023-08-31T19:07:21.639754+0000","last_undegraded":"2023-08-31T19:07:21.639754+0000","last_fullsized":"2023-08-31T19:07:21.639754+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"141'1","reported_seq":11,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.646124+0000","last_change":"2023-08-31T19:07:21.175852+0000","last_active":"2023-08-31T19:07:21.646124+0000","last_peered":"2023-08-31T19:07:21.646124+0000","last_clean":"2023-08-31T19:07:21.646124+0000","last_became_active":"2023-08-31T19:07:21.175574+0000","last_became_peered":"2023-08-31T19:07:21.175574+0000","last_unstale":"2023-08-31T19:07:21.646124+0000","last_undegraded":"2023-08-31T19:07:21.646124+0000","last_fullsized":"2023-08-31T19:07:21.646124+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.616380+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:07:21.616380+0000","last_peered":"2023-08-31T19:07:21.616380+0000","last_clean":"2023-08-31T19:07:21.616380+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:07:21.616380+0000","last_undegraded":"2023-08-31T19:07:21.616380+0000","last_fullsized":"2023-08-31T19:07:21.616380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645451+0000","last_change":"2023-08-31T19:07:21.638373+0000","last_active":"2023-08-31T19:07:21.645451+0000","last_peered":"2023-08-31T19:07:21.645451+0000","last_clean":"2023-08-31T19:07:21.645451+0000","last_became_active":"2023-08-31T19:07:21.637990+0000","last_became_peered":"2023-08-31T19:07:21.637990+0000","last_unstale":"2023-08-31T19:07:21.645451+0000","last_undegraded":"2023-08-31T19:07:21.645451+0000","last_fullsized":"2023-08-31T19:07:21.645451+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.622394+0000","last_change":"2023-08-31T19:07:21.174703+0000","last_active":"2023-08-31T19:07:21.622394+0000","last_peered":"2023-08-31T19:07:21.622394+0000","last_clean":"2023-08-31T19:07:21.622394+0000","last_became_active":"2023-08-31T19:07:21.174425+0000","last_became_peered":"2023-08-31T19:07:21.174425+0000","last_unstale":"2023-08-31T19:07:21.622394+0000","last_undegraded":"2023-08-31T19:07:21.622394+0000","last_fullsized":"2023-08-31T19:07:21.622394+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":118,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.616108+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:07:21.616108+0000","last_peered":"2023-08-31T19:07:21.616108+0000","last_clean":"2023-08-31T19:07:21.616108+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:07:21.616108+0000","last_undegraded":"2023-08-31T19:07:21.616108+0000","last_fullsized":"2023-08-31T19:07:21.616108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.644897+0000","last_change":"2023-08-31T19:07:21.633827+0000","last_active":"2023-08-31T19:07:21.644897+0000","last_peered":"2023-08-31T19:07:21.644897+0000","last_clean":"2023-08-31T19:07:21.644897+0000","last_became_active":"2023-08-31T19:07:21.633547+0000","last_became_peered":"2023-08-31T19:07:21.633547+0000","last_unstale":"2023-08-31T19:07:21.644897+0000","last_undegraded":"2023-08-31T19:07:21.644897+0000","last_fullsized":"2023-08-31T19:07:21.644897+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"141'3","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.646218+0000","last_change":"2023-08-31T19:07:21.170492+0000","last_active":"2023-08-31T19:07:21.646218+0000","last_peered":"2023-08-31T19:07:21.646218+0000","last_clean":"2023-08-31T19:07:21.646218+0000","last_became_active":"2023-08-31T19:07:21.170171+0000","last_became_peered":"2023-08-31T19:07:21.170171+0000","last_unstale":"2023-08-31T19:07:21.646218+0000","last_undegraded":"2023-08-31T19:07:21.646218+0000","last_fullsized":"2023-08-31T19:07:21.646218+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":128,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.615593+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:07:21.615593+0000","last_peered":"2023-08-31T19:07:21.615593+0000","last_clean":"2023-08-31T19:07:21.615593+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:07:21.615593+0000","last_undegraded":"2023-08-31T19:07:21.615593+0000","last_fullsized":"2023-08-31T19:07:21.615593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.645319+0000","last_change":"2023-08-31T19:07:21.636555+0000","last_active":"2023-08-31T19:07:21.645319+0000","last_peered":"2023-08-31T19:07:21.645319+0000","last_clean":"2023-08-31T19:07:21.645319+0000","last_became_active":"2023-08-31T19:07:21.636096+0000","last_became_peered":"2023-08-31T19:07:21.636096+0000","last_unstale":"2023-08-31T19:07:21.645319+0000","last_undegraded":"2023-08-31T19:07:21.645319+0000","last_fullsized":"2023-08-31T19:07:21.645319+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:21.135086+0000","last_clean_scrub_stamp":"2023-08-31T19:07:21.135086+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"141'2","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.640699+0000","last_change":"2023-08-31T19:07:21.170731+0000","last_active":"2023-08-31T19:07:21.640699+0000","last_peered":"2023-08-31T19:07:21.640699+0000","last_clean":"2023-08-31T19:07:21.640699+0000","last_became_active":"2023-08-31T19:07:21.170441+0000","last_became_peered":"2023-08-31T19:07:21.170441+0000","last_unstale":"2023-08-31T19:07:21.640699+0000","last_undegraded":"2023-08-31T19:07:21.640699+0000","last_fullsized":"2023-08-31T19:07:21.640699+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:20.129792+0000","last_clean_scrub_stamp":"2023-08-31T19:07:20.129792+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":131,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-08-31T19:07:21.618845+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:07:21.618845+0000","last_peered":"2023-08-31T19:07:21.618845+0000","last_clean":"2023-08-31T19:07:21.618845+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:07:21.618845+0000","last_undegraded":"2023-08-31T19:07:21.618845+0000","last_fullsized":"2023-08-31T19:07:21.618845+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575080,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302924,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068916,"statfs":{"total":96636764160,"available":96326569984,"internally_reserved":0,"allocated":1773568,"data_stored":941859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69899999999999995,"15min":0.72999999999999998},"min":{"1min":0.41799999999999998,"5min":0.38500000000000001,"15min":0.32100000000000001},"max":{"1min":0.89900000000000002,"5min":1.175,"15min":1.175},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.51300000000000001,"5min":0.439,"15min":0.39800000000000002},"max":{"1min":0.80900000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.51000000000000001,"5min":0.42499999999999999,"15min":0.40000000000000002},"max":{"1min":0.90100000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.67200000000000004,"15min":0.68200000000000005},"min":{"1min":0.47899999999999998,"5min":0.41999999999999998,"15min":0.36199999999999999},"max":{"1min":0.82699999999999996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.503}]},{"osd":2,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.47699999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90800000000000003,"5min":1.163,"15min":1.163},"last":0.622},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0309999999999999,"15min":1.054},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70899999999999996,"15min":0.71499999999999997},"min":{"1min":0.55500000000000005,"5min":0.498,"15min":0.432},"max":{"1min":0.84499999999999997,"5min":1.107,"15min":1.107},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.74399999999999999,"15min":0.74299999999999999},"min":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.92000000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.35199999999999998,"15min":0.33900000000000002},"max":{"1min":0.81799999999999995,"5min":0.84499999999999997,"15min":0.97899999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.55600000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95899999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.46400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93200000000000005,"5min":1.0229999999999999,"15min":1.139},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.70699999999999996},"min":{"1min":0.45000000000000001,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.048},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.45600000000000002},"max":{"1min":0.89800000000000002,"5min":0.92400000000000004,"15min":1.0740000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.48699999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95399999999999996,"5min":1.069,"15min":1.069},"last":0.88500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575079,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302916,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068924,"statfs":{"total":96636764160,"available":96326578176,"internally_reserved":0,"allocated":1765376,"data_stored":942219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:06:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69199999999999995,"15min":0.70399999999999996},"min":{"1min":0.51000000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.0189999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67600000000000005,"15min":0.69699999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.371},"max":{"1min":0.89500000000000002,"5min":1.069,"15min":1.069},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Aug 31 19:06:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68000000000000005,"15min":0.69799999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.93899999999999995,"5min":1.014,"15min":1.014},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71099999999999997,"15min":0.71899999999999997},"min":{"1min":0.45800000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.90700000000000003,"5min":1.216,"15min":1.216},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:06:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.55100000000000005,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":0.879,"5min":1.0840000000000001,"15min":1.129},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.57899999999999996,"5min":0.498,"15min":0.46600000000000003},"max":{"1min":0.84399999999999997,"5min":0.98899999999999999,"15min":1.3260000000000001},"last":0.749}]},{"osd":3,"last update":"Thu Aug 31 19:06:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.71099999999999997},"min":{"1min":0.49399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89000000000000001,"5min":0.96599999999999997,"15min":1.006},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95399999999999996,"5min":1.087,"15min":1.087},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:06:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.61499999999999999},"min":{"1min":0.443,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.96599999999999997},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.47199999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":1.0880000000000001},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:06:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68100000000000005,"15min":0.67000000000000004},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.39800000000000002},"max":{"1min":0.92100000000000004,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.50700000000000001,"5min":0.437,"15min":0.435},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0700000000000001},"last":0.876}]},{"osd":7,"last update":"Thu Aug 31 19:06:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70499999999999996,"15min":0.69999999999999996},"min":{"1min":0.52400000000000002,"5min":0.44900000000000001,"15min":0.41899999999999998},"max":{"1min":0.93200000000000005,"5min":0.96599999999999997,"15min":1.012},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.753,"15min":0.75},"min":{"1min":0.53900000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1200000000000001,"5min":1.161,"15min":1.161},"last":1.012}]}]},{"osd":1,"up_from":13,"seq":55834575080,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302916,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068924,"statfs":{"total":96636764160,"available":96326578176,"internally_reserved":0,"allocated":1765376,"data_stored":941687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.42699999999999999,"15min":0.442},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.26100000000000001},"max":{"1min":0.53100000000000003,"5min":0.70999999999999996,"15min":0.81000000000000005},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.34000000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61899999999999999,"5min":0.67100000000000004,"15min":0.752},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.496,"15min":0.50900000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.29099999999999998},"max":{"1min":0.61899999999999999,"5min":0.72799999999999998,"15min":0.82699999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.38},"max":{"1min":0.67700000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.46800000000000003,"5min":0.39100000000000001,"15min":0.35599999999999998},"max":{"1min":0.71799999999999997,"5min":0.79000000000000004,"15min":0.82199999999999995},"last":0.44},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.49399999999999999,"15min":0.50600000000000001},"min":{"1min":0.43099999999999999,"5min":0.33400000000000002,"15min":0.32800000000000001},"max":{"1min":0.72299999999999998,"5min":0.754,"15min":0.754},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.76500000000000001,"15min":0.78400000000000003},"min":{"1min":0.60399999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.2110000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.79500000000000004,"15min":0.81200000000000006},"min":{"1min":0.65600000000000003,"5min":0.56799999999999995,"15min":0.56000000000000005},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.745,"15min":0.76700000000000002},"min":{"1min":0.59499999999999997,"5min":0.53800000000000003,"15min":0.497},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.78400000000000003,"15min":0.78100000000000003},"min":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.46999999999999997},"max":{"1min":1.153,"5min":1.153,"15min":1.2310000000000001},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.74399999999999999,"15min":0.76400000000000001},"min":{"1min":0.57099999999999995,"5min":0.501,"15min":0.501},"max":{"1min":1.117,"5min":1.117,"15min":1.1990000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.78700000000000003,"15min":0.79700000000000004},"min":{"1min":0.66400000000000003,"5min":0.56799999999999995,"15min":0.51500000000000001},"max":{"1min":1.075,"5min":1.167,"15min":1.2},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.77300000000000002,"15min":0.78300000000000003},"min":{"1min":0.59199999999999997,"5min":0.55400000000000005,"15min":0.54600000000000004},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.60499999999999998,"5min":0.54000000000000004,"15min":0.51400000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.54700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575079,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302924,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068916,"statfs":{"total":96636764160,"available":96326569984,"internally_reserved":0,"allocated":1773568,"data_stored":943133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.436,"15min":0.439},"min":{"1min":0.30399999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63500000000000001,"5min":0.73399999999999999,"15min":0.78400000000000003},"last":0.374},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47999999999999998,"15min":0.49099999999999999},"min":{"1min":0.33300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67700000000000005,"5min":0.72499999999999998,"15min":0.876},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48099999999999998,"15min":0.498},"min":{"1min":0.35099999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65100000000000002,"5min":0.71899999999999997,"15min":0.74299999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.49299999999999999,"15min":0.52200000000000002},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59899999999999998,"5min":0.82499999999999996,"15min":1.018},"last":0.442}]},{"osd":3,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.498,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.64600000000000002,"5min":0.69099999999999995,"15min":0.82799999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.36599999999999999},"max":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.91400000000000003},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77800000000000002,"15min":0.81399999999999995},"min":{"1min":0.54900000000000004,"5min":0.5,"15min":0.5},"max":{"1min":0.95199999999999996,"5min":1.103,"15min":1.2370000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77200000000000002,"15min":0.80900000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94299999999999995,"5min":1.1579999999999999,"15min":1.276},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72699999999999998,"15min":0.748},"min":{"1min":0.53600000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.83699999999999997,"5min":1.155,"15min":1.155},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.51200000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.92200000000000004,"5min":1.123,"15min":1.1950000000000001},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77700000000000002,"15min":0.80300000000000005},"min":{"1min":0.48999999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97399999999999998,"5min":1.3080000000000001,"15min":1.3280000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.82899999999999996},"min":{"1min":0.57299999999999995,"5min":0.55400000000000005,"15min":0.53500000000000003},"max":{"1min":0.96699999999999997,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.58399999999999996,"5min":0.53700000000000003,"15min":0.51800000000000002},"max":{"1min":0.95099999999999996,"5min":1.1359999999999999,"15min":1.5820000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.79300000000000004,"15min":0.82699999999999996},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.997,"5min":1.127,"15min":1.548},"last":0.70799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302920,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068920,"statfs":{"total":96636764160,"available":96326574080,"internally_reserved":0,"allocated":1769472,"data_stored":942627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.57299999999999995,"15min":0.48699999999999999},"min":{"1min":0.37,"5min":0.27800000000000002,"15min":0.27000000000000002},"max":{"1min":0.72999999999999998,"5min":14.09,"15min":14.09},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69599999999999995,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54500000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.65600000000000003,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":0.432},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64900000000000002,"5min":4.375,"15min":4.375},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.55500000000000005,"15min":0.52500000000000002},"min":{"1min":0.42199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.70799999999999996,"5min":5.7649999999999997,"15min":5.7649999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.36399999999999999},"max":{"1min":0.70699999999999996,"5min":5.9729999999999999,"15min":5.9729999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.52500000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86599999999999999,"5min":4.9960000000000004,"15min":4.9960000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.59099999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88600000000000001,"5min":4.4119999999999999,"15min":4.4119999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.752,"15min":0.78100000000000003},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91200000000000003,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.77700000000000002,"15min":0.79100000000000004},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.876,"5min":5.0449999999999999,"15min":5.0449999999999999},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.60899999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97299999999999998,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.78200000000000003,"15min":0.80100000000000005},"min":{"1min":0.57599999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.89500000000000002,"5min":2.383,"15min":2.383},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76700000000000002,"15min":0.79700000000000004},"min":{"1min":0.56699999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0569999999999999,"5min":1.869,"15min":1.869},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":0.81200000000000006},"min":{"1min":0.60099999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.96499999999999997,"5min":2.403,"15min":2.403},"last":0.60099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575079,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302924,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068916,"statfs":{"total":96636764160,"available":96326569984,"internally_reserved":0,"allocated":1773568,"data_stored":942343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41599999999999998,"15min":0.47999999999999998},"min":{"1min":0.27900000000000003,"5min":0.223,"15min":0.223},"max":{"1min":0.54700000000000004,"5min":0.88300000000000001,"15min":14.099},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.55500000000000005},"min":{"1min":0.33400000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63300000000000001,"5min":0.72299999999999998,"15min":24.879999999999999},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.35899999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63700000000000001,"5min":0.76200000000000001,"15min":0.79600000000000004},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48099999999999998,"15min":0.54100000000000004},"min":{"1min":0.31900000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60899999999999999,"5min":0.80700000000000005,"15min":14.143000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.74099999999999999,"5min":0.76200000000000001,"15min":1.0640000000000001},"last":0.439},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.64600000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.32000000000000001},"max":{"1min":0.68899999999999995,"5min":0.78400000000000003,"15min":12.464},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73299999999999998,"15min":0.81699999999999995},"min":{"1min":0.47699999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.04,"5min":1.298,"15min":21.475999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74299999999999999,"15min":0.76200000000000001},"min":{"1min":0.57499999999999996,"5min":0.52100000000000002,"15min":0.47699999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.8149999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.751,"15min":0.76000000000000001},"min":{"1min":0.60899999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1120000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.752,"15min":0.80800000000000005},"min":{"1min":0.59199999999999997,"5min":0.52700000000000002,"15min":0.50600000000000001},"max":{"1min":1.101,"5min":1.2809999999999999,"15min":12.509},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76900000000000002,"15min":0.82099999999999995},"min":{"1min":0.61299999999999999,"5min":0.53400000000000003,"15min":0.52000000000000002},"max":{"1min":1.0980000000000001,"5min":1.3320000000000001,"15min":12.426},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76400000000000001,"15min":0.85799999999999998},"min":{"1min":0.66200000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.98999999999999999,"5min":1.2010000000000001,"15min":24.920000000000002},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.77900000000000003,"15min":0.86599999999999999},"min":{"1min":0.65200000000000002,"5min":0.52300000000000002,"15min":0.495},"max":{"1min":1.0860000000000001,"5min":1.347,"15min":21.521000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.59399999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2929999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575079,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302920,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068920,"statfs":{"total":96636764160,"available":96326574080,"internally_reserved":0,"allocated":1769472,"data_stored":942309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65600000000000003,"15min":0.68899999999999995},"min":{"1min":0.48599999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68899999999999995,"15min":0.70999999999999996},"min":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.68799999999999994,"15min":0.70699999999999996},"min":{"1min":0.45100000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70099999999999996,"15min":0.71199999999999997},"min":{"1min":0.52600000000000002,"5min":0.46300000000000002,"15min":0.40600000000000003},"max":{"1min":0.96799999999999997,"5min":1.042,"15min":1.044},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69299999999999995,"15min":0.72099999999999997},"min":{"1min":0.53500000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68200000000000005,"15min":0.70899999999999996},"min":{"1min":0.51700000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.73699999999999999},"min":{"1min":0.56499999999999995,"5min":0.52900000000000003,"15min":0.439},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.081},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59999999999999998,"15min":0.60499999999999998},"min":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61199999999999999,"15min":0.622},"min":{"1min":0.47799999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.65500000000000003},"min":{"1min":0.48999999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.163},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.68400000000000005,"15min":0.69099999999999995},"min":{"1min":0.504,"5min":0.44800000000000001,"15min":0.441},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Aug 31 19:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.68100000000000005,"15min":0.68500000000000005},"min":{"1min":0.47499999999999998,"5min":0.46500000000000002,"15min":0.433},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72899999999999998,"15min":0.72699999999999998},"min":{"1min":0.55000000000000004,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575079,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302916,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068924,"statfs":{"total":96636764160,"available":96326578176,"internally_reserved":0,"allocated":1765376,"data_stored":941755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66900000000000004,"15min":0.71699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.87,"5min":0.93799999999999994,"15min":4.2119999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68500000000000005,"15min":0.71999999999999997},"min":{"1min":0.57099999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91000000000000003,"5min":0.94899999999999995,"15min":3.548},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Aug 31 19:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68899999999999995,"15min":0.76100000000000001},"min":{"1min":0.50600000000000001,"5min":0.46100000000000002,"15min":0.45000000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":16.744},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69899999999999995,"15min":0.73499999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.196,"5min":1.196,"15min":3.6299999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Aug 31 19:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.70999999999999996},"min":{"1min":0.54200000000000004,"5min":0.44400000000000001,"15min":0.41899999999999998},"max":{"1min":0.85299999999999998,"5min":1.0289999999999999,"15min":3.4430000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.72099999999999997,"15min":0.751},"min":{"1min":0.56100000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.94699999999999995,"5min":0.98399999999999999,"15min":4.1740000000000004},"last":0.63900000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.70299999999999996,"15min":0.73399999999999999},"min":{"1min":0.56200000000000006,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98899999999999999,"5min":0.996,"15min":1.327},"last":0.754},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69299999999999995,"15min":0.72299999999999998},"min":{"1min":0.57999999999999996,"5min":0.48999999999999999,"15min":0.47699999999999998},"max":{"1min":0.86399999999999999,"5min":0.96799999999999997,"15min":2.823},"last":0.68799999999999994}]},{"osd":4,"last update":"Thu Aug 31 19:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.627,"15min":0.64600000000000002},"min":{"1min":0.47499999999999998,"5min":0.40200000000000002,"15min":0.34999999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":7.3739999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.42299999999999999},"max":{"1min":0.85999999999999999,"5min":0.94999999999999996,"15min":3.6680000000000001},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65600000000000003,"15min":0.65700000000000003},"min":{"1min":0.5,"5min":0.47499999999999998,"15min":0.39100000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":3.4780000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71999999999999997,"15min":0.72599999999999998},"min":{"1min":0.56399999999999995,"5min":0.434,"15min":0.434},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":7.4139999999999997},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.71399999999999997,"15min":0.72199999999999998},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":3.5960000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73399999999999999,"15min":0.72899999999999998},"min":{"1min":0.61099999999999999,"5min":0.47399999999999998,"15min":0.45300000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":2.786},"last":0.77100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:07:26.345 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T19:07:26.346 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-31T19:07:26.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.573+0000 7fd235bff700 1 Processor -- start 2023-08-31T19:07:26.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.573+0000 7fd235bff700 1 -- start start 2023-08-31T19:07:26.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.575+0000 7fd235bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd230153e30 0x7fd230154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:26.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.575+0000 7fd235bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2300bfd40 con 0x7fd2300c5cb0 2023-08-31T19:07:26.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.575+0000 7fd235bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2300c6730 con 0x7fd2300637c0 2023-08-31T19:07:26.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.575+0000 7fd235bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2300bffe0 con 0x7fd230153e30 2023-08-31T19:07:26.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.575+0000 7fd22f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd230153e30 0x7fd230154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:26.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.575+0000 7fd22effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd2300c5cb0 0x7fd2300630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39124/0 (socket says 172.21.15.72:39124) 2023-08-31T19:07:26.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.575+0000 7fd22effd700 1 -- 172.21.15.72:0/2846128196 learned_addr learned my addr 172.21.15.72:0/2846128196 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:26.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.575+0000 7fd22f7fe700 1 -- 172.21.15.72:0/2846128196 >> v1:172.21.15.146:6789/0 conn(0x7fd2300637c0 legacy=0x7fd2300c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:26.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.575+0000 7fd22f7fe700 1 -- 172.21.15.72:0/2846128196 >> v1:172.21.15.72:6789/0 conn(0x7fd2300c5cb0 legacy=0x7fd2300630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:26.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.576+0000 7fd22f7fe700 1 -- 172.21.15.72:0/2846128196 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300c02c0 con 0x7fd230153e30 2023-08-31T19:07:26.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.576+0000 7fd22e7fc700 1 -- 172.21.15.72:0/2846128196 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196958723 0 0) 0x7fd2300bfd40 con 0x7fd2300c5cb0 2023-08-31T19:07:26.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.576+0000 7fd22f7fe700 1 --2- 172.21.15.72:0/2846128196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd230153e30 0x7fd230154210 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fd220009760 tx=0x7fd220009060).ready entity=mon.0 client_cookie=a337b6e5b0b50373 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:26.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.576+0000 7fd22e7fc700 1 -- 172.21.15.72:0/2846128196 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000b520 con 0x7fd230153e30 2023-08-31T19:07:26.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.576+0000 7fd22e7fc700 1 -- 172.21.15.72:0/2846128196 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22000b680 con 0x7fd230153e30 2023-08-31T19:07:26.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.576+0000 7fd22e7fc700 1 -- 172.21.15.72:0/2846128196 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000ba00 con 0x7fd230153e30 2023-08-31T19:07:26.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.576+0000 7fd235bff700 1 -- 172.21.15.72:0/2846128196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd230153e30 msgr2=0x7fd230154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:26.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.576+0000 7fd235bff700 1 --2- 172.21.15.72:0/2846128196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd230153e30 0x7fd230154210 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fd220009760 tx=0x7fd220009060).stop 2023-08-31T19:07:26.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.577+0000 7fd235bff700 1 -- 172.21.15.72:0/2846128196 shutdown_connections 2023-08-31T19:07:26.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.577+0000 7fd235bff700 1 --2- 172.21.15.72:0/2846128196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd230153e30 0x7fd230154210 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:26.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.577+0000 7fd235bff700 1 -- 172.21.15.72:0/2846128196 >> 172.21.15.72:0/2846128196 conn(0x7fd23005eb20 msgr2=0x7fd2300cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:26.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.577+0000 7fd235bff700 1 -- 172.21.15.72:0/2846128196 shutdown_connections 2023-08-31T19:07:26.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.577+0000 7fd235bff700 1 -- 172.21.15.72:0/2846128196 wait complete. 2023-08-31T19:07:26.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.579+0000 7fd235bff700 1 Processor -- start 2023-08-31T19:07:26.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.579+0000 7fd235bff700 1 -- start start 2023-08-31T19:07:26.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.580+0000 7fd235bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300637c0 0x7fd230164f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:26.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.580+0000 7fd235bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2300c5cb0 0x7fd230152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:26.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.580+0000 7fd235bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd230153e30 0x7fd230153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:26.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.580+0000 7fd235bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd230153770 con 0x7fd2300637c0 2023-08-31T19:07:26.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.580+0000 7fd235bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300c4800 con 0x7fd230153e30 2023-08-31T19:07:26.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.580+0000 7fd235bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300c3bf0 con 0x7fd2300c5cb0 2023-08-31T19:07:26.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.580+0000 7fd22f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300637c0 0x7fd230164f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:26.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.580+0000 7fd22f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300637c0 0x7fd230164f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45444/0 (socket says 172.21.15.72:45444) 2023-08-31T19:07:26.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.580+0000 7fd22f7fe700 1 -- 172.21.15.72:0/981965950 learned_addr learned my addr 172.21.15.72:0/981965950 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:26.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.581+0000 7fd22ffff700 1 --2- 172.21.15.72:0/981965950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd230153e30 0x7fd230153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:26.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.581+0000 7fd22effd700 1 --2- 172.21.15.72:0/981965950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2300c5cb0 0x7fd230152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:26.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.581+0000 7fd22f7fe700 1 -- 172.21.15.72:0/981965950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2300c5cb0 msgr2=0x7fd230152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:26.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.581+0000 7fd22f7fe700 1 --2- 172.21.15.72:0/981965950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2300c5cb0 0x7fd230152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:26.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.581+0000 7fd22f7fe700 1 -- 172.21.15.72:0/981965950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd230153e30 msgr2=0x7fd230153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:26.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.581+0000 7fd22f7fe700 1 --2- 172.21.15.72:0/981965950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd230153e30 0x7fd230153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:26.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.581+0000 7fd22f7fe700 1 -- 172.21.15.72:0/981965950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2200092a0 con 0x7fd2300637c0 2023-08-31T19:07:26.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.581+0000 7fd22ffff700 1 --2- 172.21.15.72:0/981965950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd230153e30 0x7fd230153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:26.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.581+0000 7fd22f7fe700 1 --2- 172.21.15.72:0/981965950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300637c0 0x7fd230164f80 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7fd220009eb0 tx=0x7fd220017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:26.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.581+0000 7fd2177fe700 1 -- 172.21.15.72:0/981965950 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000b7f0 con 0x7fd2300637c0 2023-08-31T19:07:26.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.581+0000 7fd2177fe700 1 -- 172.21.15.72:0/981965950 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22000b950 con 0x7fd2300637c0 2023-08-31T19:07:26.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.581+0000 7fd235bff700 1 -- 172.21.15.72:0/981965950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2300c3ed0 con 0x7fd2300637c0 2023-08-31T19:07:26.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.581+0000 7fd2177fe700 1 -- 172.21.15.72:0/981965950 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22001b620 con 0x7fd2300637c0 2023-08-31T19:07:26.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.581+0000 7fd235bff700 1 -- 172.21.15.72:0/981965950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2300c4490 con 0x7fd2300637c0 2023-08-31T19:07:26.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.582+0000 7fd235bff700 1 -- 172.21.15.72:0/981965950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23006c6b0 con 0x7fd2300637c0 2023-08-31T19:07:26.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.583+0000 7fd2177fe700 1 -- 172.21.15.72:0/981965950 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd22001b9d0 con 0x7fd2300637c0 2023-08-31T19:07:26.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.584+0000 7fd2177fe700 1 --2- 172.21.15.72:0/981965950 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd21c05ef30 0x7fd21c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:26.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.584+0000 7fd2177fe700 1 -- 172.21.15.72:0/981965950 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fd22007bf90 con 0x7fd2300637c0 2023-08-31T19:07:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.584+0000 7fd22effd700 1 --2- 172.21.15.72:0/981965950 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd21c05ef30 0x7fd21c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.585+0000 7fd22effd700 1 --2- 172.21.15.72:0/981965950 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd21c05ef30 0x7fd21c0613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd2300ab400 tx=0x7fd224009040).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.588+0000 7fd2177fe700 1 -- 172.21.15.72:0/981965950 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd22004d010 con 0x7fd2300637c0 2023-08-31T19:07:26.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.824+0000 7fd235bff700 1 -- 172.21.15.72:0/981965950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd23006aac0 con 0x7fd2300637c0 2023-08-31T19:07:26.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.828+0000 7fd2177fe700 1 -- 172.21.15.72:0/981965950 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd220050630 con 0x7fd2300637c0 2023-08-31T19:07:26.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.830+0000 7fd235bff700 1 -- 172.21.15.72:0/981965950 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd21c05ef30 msgr2=0x7fd21c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:26.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.830+0000 7fd235bff700 1 --2- 172.21.15.72:0/981965950 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd21c05ef30 0x7fd21c0613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd2300ab400 tx=0x7fd224009040).stop 2023-08-31T19:07:26.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.830+0000 7fd235bff700 1 -- 172.21.15.72:0/981965950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300637c0 msgr2=0x7fd230164f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:26.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.830+0000 7fd235bff700 1 --2- 172.21.15.72:0/981965950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300637c0 0x7fd230164f80 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7fd220009eb0 tx=0x7fd220017000).stop 2023-08-31T19:07:26.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.830+0000 7fd235bff700 1 -- 172.21.15.72:0/981965950 shutdown_connections 2023-08-31T19:07:26.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.830+0000 7fd235bff700 1 --2- 172.21.15.72:0/981965950 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd21c05ef30 0x7fd21c0613f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:26.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.830+0000 7fd235bff700 1 --2- 172.21.15.72:0/981965950 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd230153e30 0x7fd230153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:26.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.830+0000 7fd235bff700 1 --2- 172.21.15.72:0/981965950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300637c0 0x7fd230164f80 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.830+0000 7fd235bff700 1 --2- 172.21.15.72:0/981965950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd2300c5cb0 0x7fd230152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.830+0000 7fd235bff700 1 -- 172.21.15.72:0/981965950 >> 172.21.15.72:0/981965950 conn(0x7fd23005eb20 msgr2=0x7fd2300afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.830+0000 7fd235bff700 1 -- 172.21.15.72:0/981965950 shutdown_connections 2023-08-31T19:07:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:26.830+0000 7fd235bff700 1 -- 172.21.15.72:0/981965950 wait complete. 2023-08-31T19:07:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-08-31T19:07:26.848 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:07:27.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.036+0000 7fa0ef9ff700 1 Processor -- start 2023-08-31T19:07:27.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.036+0000 7fa0ef9ff700 1 -- start start 2023-08-31T19:07:27.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.037+0000 7fa0ef9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa0e8154220 0x7fa0e8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.037+0000 7fa0ef9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e81588d0 0x7fa0e80c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.037+0000 7fa0ef9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e80c8c90 con 0x7fa0e80cb940 2023-08-31T19:07:27.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.037+0000 7fa0ef9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e80aa700 con 0x7fa0e8154220 2023-08-31T19:07:27.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.037+0000 7fa0ef9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80c5e10 con 0x7fa0e81588d0 2023-08-31T19:07:27.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.038+0000 7fa0ed79b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa0e8154220 0x7fa0e8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.038+0000 7fa0ecf9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa0e80cb940 0x7fa0e81581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39126/0 (socket says 172.21.15.72:39126) 2023-08-31T19:07:27.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.038+0000 7fa0ecf9a700 1 -- 172.21.15.72:0/2599619278 learned_addr learned my addr 172.21.15.72:0/2599619278 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:27.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.038+0000 7fa0edf9c700 1 --2- 172.21.15.72:0/2599619278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e81588d0 0x7fa0e80c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.038+0000 7fa0ed79b700 1 -- 172.21.15.72:0/2599619278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e81588d0 msgr2=0x7fa0e80c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:27.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.038+0000 7fa0ed79b700 1 --2- 172.21.15.72:0/2599619278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e81588d0 0x7fa0e80c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.038+0000 7fa0ed79b700 1 -- 172.21.15.72:0/2599619278 >> v1:172.21.15.72:6789/0 conn(0x7fa0e80cb940 legacy=0x7fa0e81581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.038+0000 7fa0ed79b700 1 -- 172.21.15.72:0/2599619278 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e8155610 con 0x7fa0e8154220 2023-08-31T19:07:27.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.038+0000 7fa0dffff700 1 -- 172.21.15.72:0/2599619278 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223557468 0 0) 0x7fa0e80c8c90 con 0x7fa0e80cb940 2023-08-31T19:07:27.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.038+0000 7fa0ed79b700 1 --2- 172.21.15.72:0/2599619278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0e8154220 0x7fa0e8157cd0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fa0e4006fd0 tx=0x7fa0e4006f40).ready entity=mon.0 client_cookie=cc6fab3a3ce98ef4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:27.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.039+0000 7fa0dffff700 1 -- 172.21.15.72:0/2599619278 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4005880 con 0x7fa0e8154220 2023-08-31T19:07:27.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.039+0000 7fa0dffff700 1 -- 172.21.15.72:0/2599619278 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e40059e0 con 0x7fa0e8154220 2023-08-31T19:07:27.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.039+0000 7fa0dffff700 1 -- 172.21.15.72:0/2599619278 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4005d60 con 0x7fa0e8154220 2023-08-31T19:07:27.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.039+0000 7fa0ef9ff700 1 -- 172.21.15.72:0/2599619278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0e8154220 msgr2=0x7fa0e8157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.039+0000 7fa0ef9ff700 1 --2- 172.21.15.72:0/2599619278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0e8154220 0x7fa0e8157cd0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fa0e4006fd0 tx=0x7fa0e4006f40).stop 2023-08-31T19:07:27.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.039+0000 7fa0ef9ff700 1 -- 172.21.15.72:0/2599619278 shutdown_connections 2023-08-31T19:07:27.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.039+0000 7fa0ef9ff700 1 --2- 172.21.15.72:0/2599619278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0e8154220 0x7fa0e8157cd0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.039+0000 7fa0ef9ff700 1 --2- 172.21.15.72:0/2599619278 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e81588d0 0x7fa0e80c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.039+0000 7fa0ef9ff700 1 -- 172.21.15.72:0/2599619278 >> 172.21.15.72:0/2599619278 conn(0x7fa0e805e870 msgr2=0x7fa0e80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:27.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.039+0000 7fa0ef9ff700 1 -- 172.21.15.72:0/2599619278 shutdown_connections 2023-08-31T19:07:27.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.039+0000 7fa0ef9ff700 1 -- 172.21.15.72:0/2599619278 wait complete. 2023-08-31T19:07:27.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.041+0000 7fa0ef9ff700 1 Processor -- start 2023-08-31T19:07:27.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.041+0000 7fa0ef9ff700 1 -- start start 2023-08-31T19:07:27.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.042+0000 7fa0ef9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0e80cb940 0x7fa0e80aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.042+0000 7fa0ef9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0e8154220 0x7fa0e80ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.042+0000 7fa0ef9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e81588d0 0x7fa0e814fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.042+0000 7fa0ef9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80aae10 con 0x7fa0e8154220 2023-08-31T19:07:27.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.042+0000 7fa0ef9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80ab0f0 con 0x7fa0e80cb940 2023-08-31T19:07:27.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.042+0000 7fa0ef9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80ab3d0 con 0x7fa0e81588d0 2023-08-31T19:07:27.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.042+0000 7fa0ecf9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0e8154220 0x7fa0e80ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.042+0000 7fa0ecf9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0e8154220 0x7fa0e80ad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45464/0 (socket says 172.21.15.72:45464) 2023-08-31T19:07:27.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.042+0000 7fa0ecf9a700 1 -- 172.21.15.72:0/28325954 learned_addr learned my addr 172.21.15.72:0/28325954 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:27.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.043+0000 7fa0edf9c700 1 --2- 172.21.15.72:0/28325954 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e81588d0 0x7fa0e814fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.043+0000 7fa0ed79b700 1 --2- 172.21.15.72:0/28325954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0e80cb940 0x7fa0e80aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.043+0000 7fa0ecf9a700 1 -- 172.21.15.72:0/28325954 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e81588d0 msgr2=0x7fa0e814fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.043+0000 7fa0ecf9a700 1 --2- 172.21.15.72:0/28325954 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e81588d0 0x7fa0e814fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.043+0000 7fa0ecf9a700 1 -- 172.21.15.72:0/28325954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0e80cb940 msgr2=0x7fa0e80aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.043+0000 7fa0ecf9a700 1 --2- 172.21.15.72:0/28325954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0e80cb940 0x7fa0e80aa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.043+0000 7fa0ecf9a700 1 -- 172.21.15.72:0/28325954 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e4009250 con 0x7fa0e8154220 2023-08-31T19:07:27.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.043+0000 7fa0ed79b700 1 --2- 172.21.15.72:0/28325954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0e80cb940 0x7fa0e80aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:27.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.043+0000 7fa0ecf9a700 1 --2- 172.21.15.72:0/28325954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0e8154220 0x7fa0e80ad150 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7fa0d800c4e0 tx=0x7fa0d8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:27.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.043+0000 7fa0dd7fa700 1 -- 172.21.15.72:0/28325954 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d80072e0 con 0x7fa0e8154220 2023-08-31T19:07:27.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.043+0000 7fa0dd7fa700 1 -- 172.21.15.72:0/28325954 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d8007440 con 0x7fa0e8154220 2023-08-31T19:07:27.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.043+0000 7fa0dd7fa700 1 -- 172.21.15.72:0/28325954 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d80057a0 con 0x7fa0e8154220 2023-08-31T19:07:27.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.043+0000 7fa0ef9ff700 1 -- 172.21.15.72:0/28325954 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e80ab6b0 con 0x7fa0e8154220 2023-08-31T19:07:27.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.043+0000 7fa0ef9ff700 1 -- 172.21.15.72:0/28325954 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e80ad640 con 0x7fa0e8154220 2023-08-31T19:07:27.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.044+0000 7fa0ef9ff700 1 -- 172.21.15.72:0/28325954 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e80abbd0 con 0x7fa0e8154220 2023-08-31T19:07:27.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.045+0000 7fa0dd7fa700 1 -- 172.21.15.72:0/28325954 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa0d8005bd0 con 0x7fa0e8154220 2023-08-31T19:07:27.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.046+0000 7fa0dd7fa700 1 --2- 172.21.15.72:0/28325954 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa0cc05ef30 0x7fa0cc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.046+0000 7fa0dd7fa700 1 -- 172.21.15.72:0/28325954 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fa0d8079b90 con 0x7fa0e8154220 2023-08-31T19:07:27.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.046+0000 7fa0ed79b700 1 --2- 172.21.15.72:0/28325954 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa0cc05ef30 0x7fa0cc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.047+0000 7fa0ed79b700 1 --2- 172.21.15.72:0/28325954 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa0cc05ef30 0x7fa0cc0613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa0e8152e60 tx=0x7fa0e4016000).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:27.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.050+0000 7fa0dd7fa700 1 -- 172.21.15.72:0/28325954 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa0e80abbd0 con 0x7fa0e8154220 2023-08-31T19:07:27.130 INFO:tasks.ceph.mds.a.smithi072.stderr:2023-08-31T19:07:27.130+0000 7fe7693f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:07:27.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.261+0000 7fa0ef9ff700 1 -- 172.21.15.72:0/28325954 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0e80abbd0 con 0x7fa0e8154220 2023-08-31T19:07:27.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.262+0000 7fa0dd7fa700 1 -- 172.21.15.72:0/28325954 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fa0e80abbd0 con 0x7fa0e8154220 2023-08-31T19:07:27.262 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:27.263 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6623,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2723616156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2723616156},{"type":"v1","addr":"172.21.15.72:6836","nonce":2723616156}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1506898460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1506898460},{"type":"v1","addr":"172.21.15.146:6834","nonce":1506898460}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1176286638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1176286638},{"type":"v1","addr":"172.21.15.146:6835","nonce":1176286638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:07:21.608188+0000","modified":"2023-08-31T19:07:24.626195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8058},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8058":{"gid":8058,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/1400178853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1400178853},{"type":"v1","addr":"172.21.15.72:6837","nonce":1400178853}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-31T19:07:27.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.264+0000 7fa0ef9ff700 1 -- 172.21.15.72:0/28325954 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa0cc05ef30 msgr2=0x7fa0cc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.264+0000 7fa0ef9ff700 1 --2- 172.21.15.72:0/28325954 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa0cc05ef30 0x7fa0cc0613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa0e8152e60 tx=0x7fa0e4016000).stop 2023-08-31T19:07:27.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.264+0000 7fa0ef9ff700 1 -- 172.21.15.72:0/28325954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0e8154220 msgr2=0x7fa0e80ad150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.264+0000 7fa0ef9ff700 1 --2- 172.21.15.72:0/28325954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0e8154220 0x7fa0e80ad150 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7fa0d800c4e0 tx=0x7fa0d8007c70).stop 2023-08-31T19:07:27.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.264+0000 7fa0ef9ff700 1 -- 172.21.15.72:0/28325954 shutdown_connections 2023-08-31T19:07:27.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.264+0000 7fa0ef9ff700 1 --2- 172.21.15.72:0/28325954 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa0e81588d0 0x7fa0e814fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.264+0000 7fa0ef9ff700 1 --2- 172.21.15.72:0/28325954 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa0cc05ef30 0x7fa0cc0613f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.264+0000 7fa0ef9ff700 1 --2- 172.21.15.72:0/28325954 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa0e80cb940 0x7fa0e80aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.264+0000 7fa0ef9ff700 1 --2- 172.21.15.72:0/28325954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0e8154220 0x7fa0e80ad150 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.264+0000 7fa0ef9ff700 1 -- 172.21.15.72:0/28325954 >> 172.21.15.72:0/28325954 conn(0x7fa0e805e870 msgr2=0x7fa0e80a7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:27.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.264+0000 7fa0ef9ff700 1 -- 172.21.15.72:0/28325954 shutdown_connections 2023-08-31T19:07:27.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.264+0000 7fa0ef9ff700 1 -- 172.21.15.72:0/28325954 wait complete. 2023-08-31T19:07:27.267 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 64 2023-08-31T19:07:27.684 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T19:07:21.608188+0000', 'modified': '2023-08-31T19:07:24.626195+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8058}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8058': {'gid': 8058, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6837/1400178853', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6835', 'nonce': 1400178853}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 1400178853}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-31T19:07:27.685 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T19:07:27.685 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-31T19:07:27.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.874+0000 7f515d7ff700 1 Processor -- start 2023-08-31T19:07:27.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.875+0000 7f515d7ff700 1 -- start start 2023-08-31T19:07:27.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.876+0000 7f515d7ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5158157c10 0x7f51580ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.876+0000 7f515d7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51580637c0 0x7f5158155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.876+0000 7f515d7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51580c6130 con 0x7f51580ad1b0 2023-08-31T19:07:27.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.876+0000 7f515d7ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51580c0350 con 0x7f5158157c10 2023-08-31T19:07:27.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.876+0000 7f515d7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51581580b0 con 0x7f51580637c0 2023-08-31T19:07:27.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.876+0000 7f5156ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f51580ad1b0 0x7f51580630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39142/0 (socket says 172.21.15.72:39142) 2023-08-31T19:07:27.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.876+0000 7f5156ffd700 1 -- 172.21.15.72:0/1452412354 learned_addr learned my addr 172.21.15.72:0/1452412354 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:27.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.876+0000 7f51577fe700 1 --2- 172.21.15.72:0/1452412354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51580637c0 0x7f5158155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.876+0000 7f51567fc700 1 --2- 172.21.15.72:0/1452412354 >> v2:172.21.15.146:3300/0 conn(0x7f5158157c10 0x7f51580ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.876+0000 7f5155ffb700 1 -- 172.21.15.72:0/1452412354 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764244454 0 0) 0x7f51580c6130 con 0x7f51580ad1b0 2023-08-31T19:07:27.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5155ffb700 1 -- 172.21.15.72:0/1452412354 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51400033f0 con 0x7f51580ad1b0 2023-08-31T19:07:27.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5155ffb700 1 -- 172.21.15.72:0/1452412354 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4222054480 0 0) 0x7f51400033f0 con 0x7f51580ad1b0 2023-08-31T19:07:27.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5155ffb700 1 -- 172.21.15.72:0/1452412354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51580637c0 msgr2=0x7f5158155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:27.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5155ffb700 1 --2- 172.21.15.72:0/1452412354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51580637c0 0x7f5158155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5155ffb700 1 -- 172.21.15.72:0/1452412354 >> v2:172.21.15.146:3300/0 conn(0x7f5158157c10 msgr2=0x7f51580ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:27.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5155ffb700 1 --2- 172.21.15.72:0/1452412354 >> v2:172.21.15.146:3300/0 conn(0x7f5158157c10 0x7f51580ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5155ffb700 1 -- 172.21.15.72:0/1452412354 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5158155560 con 0x7f51580ad1b0 2023-08-31T19:07:27.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5155ffb700 1 -- 172.21.15.72:0/1452412354 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f5148001470 con 0x7f51580ad1b0 2023-08-31T19:07:27.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5155ffb700 1 -- 172.21.15.72:0/1452412354 >> v1:172.21.15.72:6789/0 conn(0x7f51580ad1b0 legacy=0x7f51580630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5155ffb700 1 --2- 172.21.15.72:0/1452412354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51400038e0 0x7f5140003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5155ffb700 1 --2- 172.21.15.72:0/1452412354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51580637c0 0x7f5140004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5155ffb700 1 --2- 172.21.15.72:0/1452412354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5140004b80 0x7f5140005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5155ffb700 1 -- 172.21.15.72:0/1452412354 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51580c0350 con 0x7f5140004b80 2023-08-31T19:07:27.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5155ffb700 1 -- 172.21.15.72:0/1452412354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51581580b0 con 0x7f51400038e0 2023-08-31T19:07:27.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5155ffb700 1 -- 172.21.15.72:0/1452412354 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51400044b0 con 0x7f51580637c0 2023-08-31T19:07:27.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f51577fe700 1 --2- 172.21.15.72:0/1452412354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5140004b80 0x7f5140005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f5156ffd700 1 --2- 172.21.15.72:0/1452412354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51400038e0 0x7f5140003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.877+0000 7f51567fc700 1 --2- 172.21.15.72:0/1452412354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51580637c0 0x7f5140004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.878+0000 7f51577fe700 1 -- 172.21.15.72:0/1452412354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51580637c0 msgr2=0x7f5140004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:27.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.878+0000 7f51577fe700 1 --2- 172.21.15.72:0/1452412354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51580637c0 0x7f5140004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.878+0000 7f51577fe700 1 -- 172.21.15.72:0/1452412354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51400038e0 msgr2=0x7f5140003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:27.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.878+0000 7f51577fe700 1 --2- 172.21.15.72:0/1452412354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51400038e0 0x7f5140003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.878+0000 7f51577fe700 1 -- 172.21.15.72:0/1452412354 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51400033f0 con 0x7f5140004b80 2023-08-31T19:07:27.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.878+0000 7f51567fc700 1 --2- 172.21.15.72:0/1452412354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f51580637c0 0x7f5140004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:27.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.878+0000 7f51577fe700 1 --2- 172.21.15.72:0/1452412354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5140004b80 0x7f5140005000 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f5158063bc0 tx=0x7f515000b040).ready entity=mon.0 client_cookie=e492a1021aca4d2c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:27.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.878+0000 7f5155ffb700 1 -- 172.21.15.72:0/1452412354 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150009ac0 con 0x7f5140004b80 2023-08-31T19:07:27.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.878+0000 7f5155ffb700 1 -- 172.21.15.72:0/1452412354 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515000f040 con 0x7f5140004b80 2023-08-31T19:07:27.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.878+0000 7f5155ffb700 1 -- 172.21.15.72:0/1452412354 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515000eca0 con 0x7f5140004b80 2023-08-31T19:07:27.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.879+0000 7f515d7ff700 1 -- 172.21.15.72:0/1452412354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5140004b80 msgr2=0x7f5140005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.879+0000 7f515d7ff700 1 --2- 172.21.15.72:0/1452412354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5140004b80 0x7f5140005000 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f5158063bc0 tx=0x7f515000b040).stop 2023-08-31T19:07:27.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.879+0000 7f51577fe700 1 -- 172.21.15.72:0/1452412354 reap_dead start 2023-08-31T19:07:27.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.879+0000 7f515d7ff700 1 -- 172.21.15.72:0/1452412354 shutdown_connections 2023-08-31T19:07:27.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.879+0000 7f515d7ff700 1 -- 172.21.15.72:0/1452412354 >> 172.21.15.72:0/1452412354 conn(0x7f515805eb60 msgr2=0x7f51580cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:27.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.879+0000 7f515d7ff700 1 -- 172.21.15.72:0/1452412354 shutdown_connections 2023-08-31T19:07:27.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.879+0000 7f515d7ff700 1 -- 172.21.15.72:0/1452412354 wait complete. 2023-08-31T19:07:27.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.880+0000 7f515d7ff700 1 Processor -- start 2023-08-31T19:07:27.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.880+0000 7f515d7ff700 1 -- start start 2023-08-31T19:07:27.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.881+0000 7f515d7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f515814a780 0x7f51580ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.881+0000 7f515d7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51580ae010 0x7f515814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.881+0000 7f515d7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f515814ab60 0x7f51580642a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.881+0000 7f515d7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51580c2880 con 0x7f51580ae010 2023-08-31T19:07:27.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.881+0000 7f515d7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51580c1f50 con 0x7f515814a780 2023-08-31T19:07:27.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.881+0000 7f515d7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51580c2230 con 0x7f515814ab60 2023-08-31T19:07:27.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.882+0000 7f51567fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51580ae010 0x7f515814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.882+0000 7f51567fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51580ae010 0x7f515814d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45476/0 (socket says 172.21.15.72:45476) 2023-08-31T19:07:27.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.882+0000 7f51567fc700 1 -- 172.21.15.72:0/2513811554 learned_addr learned my addr 172.21.15.72:0/2513811554 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:27.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.882+0000 7f5156ffd700 1 --2- 172.21.15.72:0/2513811554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f515814a780 0x7f51580ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.882+0000 7f51577fe700 1 --2- 172.21.15.72:0/2513811554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f515814ab60 0x7f51580642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.882+0000 7f51567fc700 1 -- 172.21.15.72:0/2513811554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f515814ab60 msgr2=0x7f51580642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.882+0000 7f51567fc700 1 --2- 172.21.15.72:0/2513811554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f515814ab60 0x7f51580642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.882+0000 7f51567fc700 1 -- 172.21.15.72:0/2513811554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f515814a780 msgr2=0x7f51580ac210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.882+0000 7f51567fc700 1 --2- 172.21.15.72:0/2513811554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f515814a780 0x7f51580ac210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.882+0000 7f51567fc700 1 -- 172.21.15.72:0/2513811554 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51580c2510 con 0x7f51580ae010 2023-08-31T19:07:27.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.882+0000 7f51577fe700 1 --2- 172.21.15.72:0/2513811554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f515814ab60 0x7f51580642a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:27.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.882+0000 7f51567fc700 1 --2- 172.21.15.72:0/2513811554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51580ae010 0x7f515814d0f0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f514c011690 tx=0x7f514c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:27.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.882+0000 7f513effd700 1 -- 172.21.15.72:0/2513811554 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c013620 con 0x7f51580ae010 2023-08-31T19:07:27.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.882+0000 7f513effd700 1 -- 172.21.15.72:0/2513811554 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c013780 con 0x7f51580ae010 2023-08-31T19:07:27.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.883+0000 7f515d7ff700 1 -- 172.21.15.72:0/2513811554 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515814d920 con 0x7f51580ae010 2023-08-31T19:07:27.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.883+0000 7f513effd700 1 -- 172.21.15.72:0/2513811554 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c013b00 con 0x7f51580ae010 2023-08-31T19:07:27.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.883+0000 7f515d7ff700 1 -- 172.21.15.72:0/2513811554 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5158064790 con 0x7f51580ae010 2023-08-31T19:07:27.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.884+0000 7f513effd700 1 -- 172.21.15.72:0/2513811554 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f514c015480 con 0x7f51580ae010 2023-08-31T19:07:27.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.885+0000 7f513effd700 1 --2- 172.21.15.72:0/2513811554 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f514405ef30 0x7f51440613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.885+0000 7f513effd700 1 -- 172.21.15.72:0/2513811554 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f514c07a9b0 con 0x7f51580ae010 2023-08-31T19:07:27.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.885+0000 7f5156ffd700 1 --2- 172.21.15.72:0/2513811554 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f514405ef30 0x7f51440613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.886+0000 7f5156ffd700 1 --2- 172.21.15.72:0/2513811554 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f514405ef30 0x7f51440613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f5148008c20 tx=0x7f5158158bd0).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:27.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.888+0000 7f5174b0fb80 1 Processor -- start 2023-08-31T19:07:27.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.888+0000 7f5174b0fb80 1 -- start start 2023-08-31T19:07:27.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f5174b0fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a401782c0 0x557a401786a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f5174b0fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401c0f60 0x557a40173600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f5174b0fb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a40173af0 0x557a40173f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f5174b0fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a400b4db0 con 0x557a401782c0 2023-08-31T19:07:27.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f5174b0fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a400ca030 con 0x557a401c0f60 2023-08-31T19:07:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f5174b0fb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a400ca170 con 0x557a40173af0 2023-08-31T19:07:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f5156ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a401782c0 0x557a401786a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f5156ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a401782c0 0x557a401786a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45490/0 (socket says 172.21.15.72:45490) 2023-08-31T19:07:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f5156ffd700 1 -- 172.21.15.72:0/2602032035 learned_addr learned my addr 172.21.15.72:0/2602032035 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:27.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f51567fc700 1 --2- 172.21.15.72:0/2602032035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401c0f60 0x557a40173600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f51577fe700 1 --2- 172.21.15.72:0/2602032035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a40173af0 0x557a40173f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f5156ffd700 1 -- 172.21.15.72:0/2602032035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a40173af0 msgr2=0x557a40173f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:27.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f5156ffd700 1 --2- 172.21.15.72:0/2602032035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a40173af0 0x557a40173f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f5156ffd700 1 -- 172.21.15.72:0/2602032035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401c0f60 msgr2=0x557a40173600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:27.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f5156ffd700 1 --2- 172.21.15.72:0/2602032035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401c0f60 0x557a40173600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f5156ffd700 1 -- 172.21.15.72:0/2602032035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a4009cb00 con 0x557a401782c0 2023-08-31T19:07:27.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.889+0000 7f5156ffd700 1 --2- 172.21.15.72:0/2602032035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a401782c0 0x557a401786a0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f5148001500 tx=0x7f5148006000).ready entity=mon.0 client_cookie=ba361e31051a995c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:27.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.890+0000 7f5137fff700 1 -- 172.21.15.72:0/2602032035 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514801e070 con 0x557a401782c0 2023-08-31T19:07:27.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.890+0000 7f5137fff700 1 -- 172.21.15.72:0/2602032035 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5148008620 con 0x557a401782c0 2023-08-31T19:07:27.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.890+0000 7f5137fff700 1 -- 172.21.15.72:0/2602032035 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51480192e0 con 0x557a401782c0 2023-08-31T19:07:27.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.890+0000 7f5174b0fb80 1 -- 172.21.15.72:0/2602032035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a401782c0 msgr2=0x557a401786a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.890+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/2602032035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a401782c0 0x557a401786a0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f5148001500 tx=0x7f5148006000).stop 2023-08-31T19:07:27.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.890+0000 7f5174b0fb80 1 -- 172.21.15.72:0/2602032035 shutdown_connections 2023-08-31T19:07:27.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.890+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/2602032035 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a40173af0 0x557a40173f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.890+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/2602032035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a401782c0 0x557a401786a0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.890+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/2602032035 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401c0f60 0x557a40173600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.890+0000 7f5174b0fb80 1 -- 172.21.15.72:0/2602032035 >> 172.21.15.72:0/2602032035 conn(0x557a3ffe2940 msgr2=0x557a401c13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:27.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.890+0000 7f5174b0fb80 1 -- 172.21.15.72:0/2602032035 shutdown_connections 2023-08-31T19:07:27.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.890+0000 7f5174b0fb80 1 -- 172.21.15.72:0/2602032035 wait complete. 2023-08-31T19:07:27.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.891+0000 7f5174b0fb80 1 -- start start 2023-08-31T19:07:27.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.891+0000 7f5174b0fb80 1 Processor -- start 2023-08-31T19:07:27.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.892+0000 7f5174b0fb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a40173af0 0x557a401a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.892+0000 7f5174b0fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a401782c0 0x557a401a6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.892+0000 7f5174b0fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401c0f60 0x557a401d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.892+0000 7f5174b0fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a400ca3f0 con 0x557a401782c0 2023-08-31T19:07:27.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.892+0000 7f5174b0fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a40095920 con 0x557a401c0f60 2023-08-31T19:07:27.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.892+0000 7f5174b0fb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a40174ba0 con 0x557a40173af0 2023-08-31T19:07:27.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.892+0000 7f5174b0fb80 10 client.0 ll_register_callbacks cb 0x557a4006ace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:07:27.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.893+0000 7f51567fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a401782c0 0x557a401a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.893+0000 7f51567fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a401782c0 0x557a401a6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45504/0 (socket says 172.21.15.72:45504) 2023-08-31T19:07:27.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.893+0000 7f51567fc700 1 -- 172.21.15.72:0/4035938541 learned_addr learned my addr 172.21.15.72:0/4035938541 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:27.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.893+0000 7f5156ffd700 1 --2- 172.21.15.72:0/4035938541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a40173af0 0x557a401a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.893+0000 7f51577fe700 1 --2- 172.21.15.72:0/4035938541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401c0f60 0x557a401d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.893+0000 7f51567fc700 1 -- 172.21.15.72:0/4035938541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a40173af0 msgr2=0x557a401a5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:27.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.893+0000 7f51567fc700 1 --2- 172.21.15.72:0/4035938541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a40173af0 0x557a401a5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.893+0000 7f51567fc700 1 -- 172.21.15.72:0/4035938541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401c0f60 msgr2=0x557a401d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:27.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.893+0000 7f51567fc700 1 --2- 172.21.15.72:0/4035938541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401c0f60 0x557a401d0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.893+0000 7f51567fc700 1 -- 172.21.15.72:0/4035938541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5148010040 con 0x557a401782c0 2023-08-31T19:07:27.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.893+0000 7f51567fc700 1 --2- 172.21.15.72:0/4035938541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a401782c0 0x557a401a6300 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f514c078a00 tx=0x7f514c009060).ready entity=mon.0 client_cookie=19af52e0a417740a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:27.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.893+0000 7f51357fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:07:27.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.893+0000 7f51357fa700 1 -- 172.21.15.72:0/4035938541 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c054070 con 0x557a401782c0 2023-08-31T19:07:27.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.893+0000 7f51357fa700 1 -- 172.21.15.72:0/4035938541 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f514c04d9d0 con 0x557a401782c0 2023-08-31T19:07:27.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.893+0000 7f5174b0fb80 1 -- 172.21.15.72:0/4035938541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a40172aa0 con 0x557a401782c0 2023-08-31T19:07:27.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.894+0000 7f51357fa700 1 -- 172.21.15.72:0/4035938541 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f514c04ed30 con 0x557a401782c0 2023-08-31T19:07:27.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.894+0000 7f5174b0fb80 10 client.8199 fetch_fsmap learned FSMap version 64 2023-08-31T19:07:27.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.894+0000 7f5174b0fb80 1 -- 172.21.15.72:0/4035938541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x557a400c2f70 con 0x557a401782c0 2023-08-31T19:07:27.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.894+0000 7f51357fa700 1 -- 172.21.15.72:0/4035938541 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557a40172aa0 con 0x557a401782c0 2023-08-31T19:07:27.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.894+0000 7f51357fa700 1 -- 172.21.15.72:0/4035938541 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 64) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f514c04b420 con 0x557a401782c0 2023-08-31T19:07:27.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.894+0000 7f5174b0fb80 10 client.8199 fetch_fsmap finished waiting for FSMap version 64 2023-08-31T19:07:27.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.894+0000 7f5174b0fb80 10 client.8199 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:07:27.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.894+0000 7f5174b0fb80 20 client.8199 populate_metadata read hostname 'smithi072' 2023-08-31T19:07:27.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.894+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/4035938541 >> [v2:172.21.15.72:6835/1400178853,v1:172.21.15.72:6837/1400178853] conn(0x557a4019fd60 0x557a401c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.894+0000 7f5174b0fb80 4 client.8199 mds_command: new command op to 8058 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T19:07:27.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.894+0000 7f5174b0fb80 1 -- 172.21.15.72:0/4035938541 --> [v2:172.21.15.72:6835/1400178853,v1:172.21.15.72:6837/1400178853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a3ff32ef0 con 0x557a4019fd60 2023-08-31T19:07:27.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.894+0000 7f5156ffd700 1 --2- 172.21.15.72:0/4035938541 >> [v2:172.21.15.72:6835/1400178853,v1:172.21.15.72:6837/1400178853] conn(0x557a4019fd60 0x557a401c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.895+0000 7f5156ffd700 1 --2- 172.21.15.72:0/4035938541 >> [v2:172.21.15.72:6835/1400178853,v1:172.21.15.72:6837/1400178853] conn(0x557a4019fd60 0x557a401c40d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3a94653c5eb3f860 server_cookie=bc884fa7c02ccd24 in_seq=0 out_seq=0 2023-08-31T19:07:27.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.895+0000 7f51357fa700 10 client.8199 ms_handle_connect on v2:172.21.15.72:6835/1400178853 2023-08-31T19:07:27.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.895+0000 7f51357fa700 1 -- 172.21.15.72:0/4035938541 <== mds.0 v2:172.21.15.72:6835/1400178853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x557a3ff32ef0 con 0x557a4019fd60 2023-08-31T19:07:27.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.895+0000 7f51357fa700 10 client.8199 handle_command_reply: tid=0 2023-08-31T19:07:27.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.895+0000 7f5174b0fb80 1 client.8199 shutdown 2023-08-31T19:07:27.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.896+0000 7f5174b0fb80 1 -- 172.21.15.72:0/4035938541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a401782c0 msgr2=0x557a401a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.896+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/4035938541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a401782c0 0x557a401a6300 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f514c078a00 tx=0x7f514c009060).stop 2023-08-31T19:07:27.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.896+0000 7f5174b0fb80 1 -- 172.21.15.72:0/4035938541 shutdown_connections 2023-08-31T19:07:27.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.896+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/4035938541 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401c0f60 0x557a401d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.896+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/4035938541 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a40173af0 0x557a401a5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.896+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/4035938541 >> [v2:172.21.15.72:6835/1400178853,v1:172.21.15.72:6837/1400178853] conn(0x557a4019fd60 0x557a401c40d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.896+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/4035938541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a401782c0 0x557a401a6300 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.896+0000 7f5174b0fb80 1 -- 172.21.15.72:0/4035938541 >> 172.21.15.72:0/4035938541 conn(0x557a3ffe2940 msgr2=0x557a40176330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:27.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.896+0000 7f51357fa700 0 client.8199 ms_handle_reset on v2:172.21.15.72:6835/1400178853 2023-08-31T19:07:27.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.896+0000 7f5174b0fb80 1 -- 172.21.15.72:0/4035938541 shutdown_connections 2023-08-31T19:07:27.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.896+0000 7f5174b0fb80 1 -- 172.21.15.72:0/4035938541 wait complete. 2023-08-31T19:07:27.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.896+0000 7f5174b0fb80 20 client.8199 trim_cache size 0 max 16384 2023-08-31T19:07:27.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.913+0000 7f5174b0fb80 1 Processor -- start 2023-08-31T19:07:27.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.913+0000 7f5174b0fb80 1 -- start start 2023-08-31T19:07:27.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f5174b0fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a40173af0 0x557a401c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f5174b0fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401782c0 0x557a401c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f5174b0fb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a401c0f60 0x557a4016ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f5174b0fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a401a0540 con 0x557a40173af0 2023-08-31T19:07:27.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f5174b0fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a401bcad0 con 0x557a401782c0 2023-08-31T19:07:27.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f5174b0fb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a4016cd90 con 0x557a401c0f60 2023-08-31T19:07:27.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f5156ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a40173af0 0x557a401c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f5156ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a40173af0 0x557a401c29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45508/0 (socket says 172.21.15.72:45508) 2023-08-31T19:07:27.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f5156ffd700 1 -- 172.21.15.72:0/783490850 learned_addr learned my addr 172.21.15.72:0/783490850 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:27.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f5156ffd700 1 -- 172.21.15.72:0/783490850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a401c0f60 msgr2=0x557a4016ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:27.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f5156ffd700 1 --2- 172.21.15.72:0/783490850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a401c0f60 0x557a4016ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:27.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f51567fc700 1 --2- 172.21.15.72:0/783490850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401782c0 0x557a401c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f5156ffd700 1 -- 172.21.15.72:0/783490850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401782c0 msgr2=0x557a401c2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:27.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f5156ffd700 1 --2- 172.21.15.72:0/783490850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401782c0 0x557a401c2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f5156ffd700 1 -- 172.21.15.72:0/783490850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a401a6660 con 0x557a40173af0 2023-08-31T19:07:27.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.914+0000 7f5156ffd700 1 --2- 172.21.15.72:0/783490850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a40173af0 0x557a401c29b0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f5148018000 tx=0x7f5148027040).ready entity=mon.0 client_cookie=c86a104034fcd090 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:27.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.915+0000 7f513cff9700 1 -- 172.21.15.72:0/783490850 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514802a070 con 0x557a40173af0 2023-08-31T19:07:27.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.915+0000 7f513cff9700 1 -- 172.21.15.72:0/783490850 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514802b040 con 0x557a40173af0 2023-08-31T19:07:27.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.915+0000 7f513cff9700 1 -- 172.21.15.72:0/783490850 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148001710 con 0x557a40173af0 2023-08-31T19:07:27.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.915+0000 7f5174b0fb80 1 -- 172.21.15.72:0/783490850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a40173af0 msgr2=0x557a401c29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.915+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/783490850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a40173af0 0x557a401c29b0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f5148018000 tx=0x7f5148027040).stop 2023-08-31T19:07:27.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.915+0000 7f5174b0fb80 1 -- 172.21.15.72:0/783490850 shutdown_connections 2023-08-31T19:07:27.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.915+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/783490850 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a401c0f60 0x557a4016ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:27.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.915+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/783490850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a40173af0 0x557a401c29b0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.915+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/783490850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401782c0 0x557a401c2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.915+0000 7f5174b0fb80 1 -- 172.21.15.72:0/783490850 >> 172.21.15.72:0/783490850 conn(0x557a3ffe2940 msgr2=0x557a401c13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:27.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.915+0000 7f5174b0fb80 1 -- 172.21.15.72:0/783490850 shutdown_connections 2023-08-31T19:07:27.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.915+0000 7f5174b0fb80 1 -- 172.21.15.72:0/783490850 wait complete. 2023-08-31T19:07:27.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.916+0000 7f5174b0fb80 1 -- start start 2023-08-31T19:07:27.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.916+0000 7f5174b0fb80 1 Processor -- start 2023-08-31T19:07:27.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.917+0000 7f5174b0fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a40173af0 0x557a40221d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.917+0000 7f5174b0fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401782c0 0x557a401c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.917+0000 7f5174b0fb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a401c0f60 0x557a401c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.917+0000 7f5174b0fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a401cffe0 con 0x557a40173af0 2023-08-31T19:07:27.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.917+0000 7f5174b0fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a401c32d0 con 0x557a401782c0 2023-08-31T19:07:27.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.917+0000 7f5174b0fb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a40223920 con 0x557a401c0f60 2023-08-31T19:07:27.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.917+0000 7f5174b0fb80 10 client.0 ll_register_callbacks cb 0x557a4006ace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:07:27.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.917+0000 7f5156ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a40173af0 0x557a40221d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.917+0000 7f5156ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a40173af0 0x557a40221d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45514/0 (socket says 172.21.15.72:45514) 2023-08-31T19:07:27.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.917+0000 7f5156ffd700 1 -- 172.21.15.72:0/2900525747 learned_addr learned my addr 172.21.15.72:0/2900525747 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:27.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f51577fe700 1 --2- 172.21.15.72:0/2900525747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a401c0f60 0x557a401c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f51567fc700 1 --2- 172.21.15.72:0/2900525747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401782c0 0x557a401c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f5156ffd700 1 -- 172.21.15.72:0/2900525747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a401c0f60 msgr2=0x557a401c2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:27.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f5156ffd700 1 --2- 172.21.15.72:0/2900525747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a401c0f60 0x557a401c2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f5156ffd700 1 -- 172.21.15.72:0/2900525747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401782c0 msgr2=0x557a401c28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:27.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f5156ffd700 1 --2- 172.21.15.72:0/2900525747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401782c0 0x557a401c28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f5156ffd700 1 -- 172.21.15.72:0/2900525747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a4009cb00 con 0x557a40173af0 2023-08-31T19:07:27.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f51567fc700 1 --2- 172.21.15.72:0/2900525747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401782c0 0x557a401c28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f51577fe700 1 --2- 172.21.15.72:0/2900525747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a401c0f60 0x557a401c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f5156ffd700 1 --2- 172.21.15.72:0/2900525747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a40173af0 0x557a40221d50 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f5148001500 tx=0x7f514802f000).ready entity=mon.0 client_cookie=d79571c4ca6e1f92 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f51357fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:07:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f51357fa700 1 -- 172.21.15.72:0/2900525747 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514802a070 con 0x557a40173af0 2023-08-31T19:07:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f51357fa700 1 -- 172.21.15.72:0/2900525747 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f5148017870 con 0x557a40173af0 2023-08-31T19:07:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f5174b0fb80 1 -- 172.21.15.72:0/2900525747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5148008620 con 0x557a40173af0 2023-08-31T19:07:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f51357fa700 1 -- 172.21.15.72:0/2900525747 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5148017c40 con 0x557a40173af0 2023-08-31T19:07:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f5174b0fb80 10 client.8205 fetch_fsmap learned FSMap version 64 2023-08-31T19:07:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.918+0000 7f5174b0fb80 1 -- 172.21.15.72:0/2900525747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x557a400be580 con 0x557a40173af0 2023-08-31T19:07:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.919+0000 7f51357fa700 1 -- 172.21.15.72:0/2900525747 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5148008620 con 0x557a40173af0 2023-08-31T19:07:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.919+0000 7f51357fa700 1 -- 172.21.15.72:0/2900525747 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 64) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5148039070 con 0x557a40173af0 2023-08-31T19:07:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.919+0000 7f5174b0fb80 10 client.8205 fetch_fsmap finished waiting for FSMap version 64 2023-08-31T19:07:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.919+0000 7f5174b0fb80 10 client.8205 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:07:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.919+0000 7f5174b0fb80 20 client.8205 populate_metadata read hostname 'smithi072' 2023-08-31T19:07:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.919+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/2900525747 >> [v2:172.21.15.72:6835/1400178853,v1:172.21.15.72:6837/1400178853] conn(0x557a401b9970 0x557a401b9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.919+0000 7f5174b0fb80 4 client.8205 mds_command: new command op to 8058 tid=0[{"prefix": "status"}] 2023-08-31T19:07:27.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.919+0000 7f5174b0fb80 1 -- 172.21.15.72:0/2900525747 --> [v2:172.21.15.72:6835/1400178853,v1:172.21.15.72:6837/1400178853] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557a3ff68040 con 0x557a401b9970 2023-08-31T19:07:27.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.919+0000 7f51567fc700 1 --2- 172.21.15.72:0/2900525747 >> [v2:172.21.15.72:6835/1400178853,v1:172.21.15.72:6837/1400178853] conn(0x557a401b9970 0x557a401b9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:27.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.919+0000 7f51357fa700 10 client.8205 ms_handle_connect on v2:172.21.15.72:6835/1400178853 2023-08-31T19:07:27.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.919+0000 7f51567fc700 1 --2- 172.21.15.72:0/2900525747 >> [v2:172.21.15.72:6835/1400178853,v1:172.21.15.72:6837/1400178853] conn(0x557a401b9970 0x557a401b9d50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=33e79ca5061c6f3c server_cookie=677bde03cc6ba9e7 in_seq=0 out_seq=0 2023-08-31T19:07:27.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.920+0000 7f51357fa700 1 -- 172.21.15.72:0/2900525747 <== mds.0 v2:172.21.15.72:6835/1400178853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x557a3ff68040 con 0x557a401b9970 2023-08-31T19:07:27.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.920+0000 7f51357fa700 10 client.8205 handle_command_reply: tid=0 2023-08-31T19:07:27.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.920+0000 7f5174b0fb80 1 client.8205 shutdown 2023-08-31T19:07:27.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.920+0000 7f5174b0fb80 1 -- 172.21.15.72:0/2900525747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a40173af0 msgr2=0x557a40221d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.920+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/2900525747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a40173af0 0x557a40221d50 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f5148001500 tx=0x7f514802f000).stop 2023-08-31T19:07:27.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.920+0000 7f5174b0fb80 1 -- 172.21.15.72:0/2900525747 shutdown_connections 2023-08-31T19:07:27.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.920+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/2900525747 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x557a401c0f60 0x557a401c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.920+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/2900525747 >> [v2:172.21.15.72:6835/1400178853,v1:172.21.15.72:6837/1400178853] conn(0x557a401b9970 0x557a401b9d50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.920+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/2900525747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557a40173af0 0x557a40221d50 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.920+0000 7f5174b0fb80 1 --2- 172.21.15.72:0/2900525747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557a401782c0 0x557a401c28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.920+0000 7f51357fa700 0 client.8205 ms_handle_reset on v2:172.21.15.72:6835/1400178853 2023-08-31T19:07:27.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.920+0000 7f5174b0fb80 1 -- 172.21.15.72:0/2900525747 >> 172.21.15.72:0/2900525747 conn(0x557a3ffe2940 msgr2=0x557a4017a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:27.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.920+0000 7f5174b0fb80 1 -- 172.21.15.72:0/2900525747 shutdown_connections 2023-08-31T19:07:27.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.920+0000 7f5174b0fb80 1 -- 172.21.15.72:0/2900525747 wait complete. 2023-08-31T19:07:27.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.920+0000 7f5174b0fb80 20 client.8205 trim_cache size 0 max 16384 2023-08-31T19:07:27.951 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:07:27.952 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "acadb8ca-1685-49e1-a73f-5e9d14d95be9", 2023-08-31T19:07:27.952 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-08-31T19:07:27.952 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 8058, 2023-08-31T19:07:27.952 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-08-31T19:07:27.953 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-08-31T19:07:27.953 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-08-31T19:07:27.953 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 6.3100032879999999, 2023-08-31T19:07:27.953 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 64, 2023-08-31T19:07:27.953 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 142, 2023-08-31T19:07:27.953 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 142, 2023-08-31T19:07:27.954 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 11.508397656 2023-08-31T19:07:27.954 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:07:27.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.921+0000 7f515d7ff700 1 -- 172.21.15.72:0/2513811554 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f514405ef30 msgr2=0x7f51440613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.921+0000 7f515d7ff700 1 --2- 172.21.15.72:0/2513811554 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f514405ef30 0x7f51440613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f5148008c20 tx=0x7f5158158bd0).stop 2023-08-31T19:07:27.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.921+0000 7f515d7ff700 1 -- 172.21.15.72:0/2513811554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51580ae010 msgr2=0x7f515814d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:27.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.921+0000 7f515d7ff700 1 --2- 172.21.15.72:0/2513811554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51580ae010 0x7f515814d0f0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f514c011690 tx=0x7f514c008040).stop 2023-08-31T19:07:27.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.921+0000 7f515d7ff700 1 -- 172.21.15.72:0/2513811554 shutdown_connections 2023-08-31T19:07:27.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.921+0000 7f515d7ff700 1 --2- 172.21.15.72:0/2513811554 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f515814ab60 0x7f51580642a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.921+0000 7f515d7ff700 1 --2- 172.21.15.72:0/2513811554 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f514405ef30 0x7f51440613f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.921+0000 7f515d7ff700 1 --2- 172.21.15.72:0/2513811554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f515814a780 0x7f51580ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.921+0000 7f515d7ff700 1 --2- 172.21.15.72:0/2513811554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51580ae010 0x7f515814d0f0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:27.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.921+0000 7f515d7ff700 1 -- 172.21.15.72:0/2513811554 >> 172.21.15.72:0/2513811554 conn(0x7f515805eb60 msgr2=0x7f51580cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:27.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.921+0000 7f515d7ff700 1 -- 172.21.15.72:0/2513811554 shutdown_connections 2023-08-31T19:07:27.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:27.921+0000 7f515d7ff700 1 -- 172.21.15.72:0/2513811554 wait complete. 2023-08-31T19:07:27.958 DEBUG:teuthology.orchestra.run.smithi072:> ceph fs ls 2023-08-31T19:07:28.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.116+0000 7fac4bbff700 1 Processor -- start 2023-08-31T19:07:28.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.116+0000 7fac4bbff700 1 -- start start 2023-08-31T19:07:28.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.118+0000 7fac4bbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac440a7f70 0x7fac440c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:28.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.118+0000 7fac4bbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac440c9810 0x7fac440c8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:28.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.118+0000 7fac4bbff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac440c31f0 0x7fac440c3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:28.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.118+0000 7fac4bbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac440c7ae0 con 0x7fac440c9810 2023-08-31T19:07:28.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.118+0000 7fac4bbff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac440c6ed0 con 0x7fac440c31f0 2023-08-31T19:07:28.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.118+0000 7fac4bbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac440c71b0 con 0x7fac440a7f70 2023-08-31T19:07:28.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.118+0000 7fac4919a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac440c9810 0x7fac440c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:28.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.118+0000 7fac4919a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac440c9810 0x7fac440c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45518/0 (socket says 172.21.15.72:45518) 2023-08-31T19:07:28.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.118+0000 7fac4919a700 1 -- 172.21.15.72:0/1373923439 learned_addr learned my addr 172.21.15.72:0/1373923439 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:28.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.119+0000 7fac4a19c700 1 --2- 172.21.15.72:0/1373923439 >> v2:172.21.15.146:3300/0 conn(0x7fac440c31f0 0x7fac440c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:28.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.119+0000 7fac4999b700 1 --2- 172.21.15.72:0/1373923439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac440a7f70 0x7fac440c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:28.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.119+0000 7fac4919a700 1 -- 172.21.15.72:0/1373923439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac440a7f70 msgr2=0x7fac440c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:28.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.119+0000 7fac4919a700 1 --2- 172.21.15.72:0/1373923439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac440a7f70 0x7fac440c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:28.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.119+0000 7fac4919a700 1 -- 172.21.15.72:0/1373923439 >> v2:172.21.15.146:3300/0 conn(0x7fac440c31f0 msgr2=0x7fac440c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:28.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.119+0000 7fac4919a700 1 --2- 172.21.15.72:0/1373923439 >> v2:172.21.15.146:3300/0 conn(0x7fac440c31f0 0x7fac440c3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:28.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.119+0000 7fac4919a700 1 -- 172.21.15.72:0/1373923439 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac440c7490 con 0x7fac440c9810 2023-08-31T19:07:28.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.119+0000 7fac4a19c700 1 --2- 172.21.15.72:0/1373923439 >> v2:172.21.15.146:3300/0 conn(0x7fac440c31f0 0x7fac440c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:28.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.119+0000 7fac4919a700 1 --2- 172.21.15.72:0/1373923439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac440c9810 0x7fac440c8460 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fac4406a210 tx=0x7fac340090f0).ready entity=mon.0 client_cookie=afd3169ad7989b59 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:28.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.119+0000 7fac48999700 1 -- 172.21.15.72:0/1373923439 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3400b600 con 0x7fac440c9810 2023-08-31T19:07:28.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.119+0000 7fac48999700 1 -- 172.21.15.72:0/1373923439 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3400b760 con 0x7fac440c9810 2023-08-31T19:07:28.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.119+0000 7fac48999700 1 -- 172.21.15.72:0/1373923439 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3400bae0 con 0x7fac440c9810 2023-08-31T19:07:28.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.120+0000 7fac4bbff700 1 -- 172.21.15.72:0/1373923439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac440c9810 msgr2=0x7fac440c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:28.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.120+0000 7fac4bbff700 1 --2- 172.21.15.72:0/1373923439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac440c9810 0x7fac440c8460 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fac4406a210 tx=0x7fac340090f0).stop 2023-08-31T19:07:28.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.120+0000 7fac4bbff700 1 -- 172.21.15.72:0/1373923439 shutdown_connections 2023-08-31T19:07:28.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.120+0000 7fac4bbff700 1 --2- 172.21.15.72:0/1373923439 >> v2:172.21.15.146:3300/0 conn(0x7fac440c31f0 0x7fac440c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:28.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.120+0000 7fac4bbff700 1 --2- 172.21.15.72:0/1373923439 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac440a7f70 0x7fac440c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:28.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.120+0000 7fac4bbff700 1 --2- 172.21.15.72:0/1373923439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac440c9810 0x7fac440c8460 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:28.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.120+0000 7fac4bbff700 1 -- 172.21.15.72:0/1373923439 >> 172.21.15.72:0/1373923439 conn(0x7fac44062e30 msgr2=0x7fac440c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:28.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.120+0000 7fac4bbff700 1 -- 172.21.15.72:0/1373923439 shutdown_connections 2023-08-31T19:07:28.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.120+0000 7fac4bbff700 1 -- 172.21.15.72:0/1373923439 wait complete. 2023-08-31T19:07:28.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.121+0000 7fac4bbff700 1 Processor -- start 2023-08-31T19:07:28.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.122+0000 7fac4bbff700 1 -- start start 2023-08-31T19:07:28.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.122+0000 7fac4bbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac440a7f70 0x7fac440a8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:28.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.122+0000 7fac4bbff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac440c31f0 0x7fac440c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:28.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.122+0000 7fac4bbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac440c9810 0x7fac440c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:28.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.123+0000 7fac4bbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac440c5630 con 0x7fac440a7f70 2023-08-31T19:07:28.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.123+0000 7fac4bbff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac440a9870 con 0x7fac440c31f0 2023-08-31T19:07:28.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.123+0000 7fac4bbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac440a8d30 con 0x7fac440c9810 2023-08-31T19:07:28.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.123+0000 7fac4999b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac440a7f70 0x7fac440a8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:28.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.123+0000 7fac4999b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac440a7f70 0x7fac440a8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45532/0 (socket says 172.21.15.72:45532) 2023-08-31T19:07:28.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.123+0000 7fac4999b700 1 -- 172.21.15.72:0/2091721865 learned_addr learned my addr 172.21.15.72:0/2091721865 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:28.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.123+0000 7fac4919a700 1 --2- 172.21.15.72:0/2091721865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac440c31f0 0x7fac440c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:28.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.123+0000 7fac4a19c700 1 --2- 172.21.15.72:0/2091721865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac440c9810 0x7fac440c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:28.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.123+0000 7fac4999b700 1 -- 172.21.15.72:0/2091721865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac440c9810 msgr2=0x7fac440c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:28.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.123+0000 7fac4999b700 1 --2- 172.21.15.72:0/2091721865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac440c9810 0x7fac440c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:28.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.123+0000 7fac4999b700 1 -- 172.21.15.72:0/2091721865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac440c31f0 msgr2=0x7fac440c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:28.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.123+0000 7fac4999b700 1 --2- 172.21.15.72:0/2091721865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac440c31f0 0x7fac440c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:28.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.123+0000 7fac4999b700 1 -- 172.21.15.72:0/2091721865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac34009370 con 0x7fac440a7f70 2023-08-31T19:07:28.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.123+0000 7fac4999b700 1 --2- 172.21.15.72:0/2091721865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac440a7f70 0x7fac440a8350 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fac4000d890 tx=0x7fac40008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:28.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.124+0000 7fac39ffb700 1 -- 172.21.15.72:0/2091721865 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac400125f0 con 0x7fac440a7f70 2023-08-31T19:07:28.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.124+0000 7fac39ffb700 1 -- 172.21.15.72:0/2091721865 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac40012750 con 0x7fac440a7f70 2023-08-31T19:07:28.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.124+0000 7fac39ffb700 1 -- 172.21.15.72:0/2091721865 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40012ad0 con 0x7fac440a7f70 2023-08-31T19:07:28.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.124+0000 7fac4bbff700 1 -- 172.21.15.72:0/2091721865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac440a9010 con 0x7fac440a7f70 2023-08-31T19:07:28.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.124+0000 7fac4bbff700 1 -- 172.21.15.72:0/2091721865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac440a9ac0 con 0x7fac440a7f70 2023-08-31T19:07:28.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.125+0000 7fac4bbff700 1 -- 172.21.15.72:0/2091721865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac440a9c80 con 0x7fac440a7f70 2023-08-31T19:07:28.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.125+0000 7fac39ffb700 1 -- 172.21.15.72:0/2091721865 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fac40013480 con 0x7fac440a7f70 2023-08-31T19:07:28.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.126+0000 7fac39ffb700 1 --2- 172.21.15.72:0/2091721865 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fac2805ef30 0x7fac280613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:28.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.126+0000 7fac39ffb700 1 -- 172.21.15.72:0/2091721865 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fac4007a050 con 0x7fac440a7f70 2023-08-31T19:07:28.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.126+0000 7fac4919a700 1 --2- 172.21.15.72:0/2091721865 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fac2805ef30 0x7fac280613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:28.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.127+0000 7fac4919a700 1 --2- 172.21.15.72:0/2091721865 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fac2805ef30 0x7fac280613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fac4406a210 tx=0x7fac34017000).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:28.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.131+0000 7fac39ffb700 1 -- 172.21.15.72:0/2091721865 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fac4004b070 con 0x7fac440a7f70 2023-08-31T19:07:28.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.342+0000 7fac4bbff700 1 -- 172.21.15.72:0/2091721865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fac440a9e30 con 0x7fac440a7f70 2023-08-31T19:07:28.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.342+0000 7fac39ffb700 1 -- 172.21.15.72:0/2091721865 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v64) v1 ==== 53+0+73 (secure 0 0 0) 0x7fac4004e690 con 0x7fac440a7f70 2023-08-31T19:07:28.343 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T19:07:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.344+0000 7fac4bbff700 1 -- 172.21.15.72:0/2091721865 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fac2805ef30 msgr2=0x7fac280613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.344+0000 7fac4bbff700 1 --2- 172.21.15.72:0/2091721865 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fac2805ef30 0x7fac280613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fac4406a210 tx=0x7fac34017000).stop 2023-08-31T19:07:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.344+0000 7fac4bbff700 1 -- 172.21.15.72:0/2091721865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac440a7f70 msgr2=0x7fac440a8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.344+0000 7fac4bbff700 1 --2- 172.21.15.72:0/2091721865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac440a7f70 0x7fac440a8350 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fac4000d890 tx=0x7fac40008040).stop 2023-08-31T19:07:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.344+0000 7fac4bbff700 1 -- 172.21.15.72:0/2091721865 shutdown_connections 2023-08-31T19:07:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.344+0000 7fac4bbff700 1 --2- 172.21.15.72:0/2091721865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac440c9810 0x7fac440c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.344+0000 7fac4bbff700 1 --2- 172.21.15.72:0/2091721865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac440a7f70 0x7fac440a8350 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.344+0000 7fac4bbff700 1 --2- 172.21.15.72:0/2091721865 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fac2805ef30 0x7fac280613f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.344+0000 7fac4bbff700 1 --2- 172.21.15.72:0/2091721865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac440c31f0 0x7fac440c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:28.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.344+0000 7fac4bbff700 1 -- 172.21.15.72:0/2091721865 >> 172.21.15.72:0/2091721865 conn(0x7fac44062e30 msgr2=0x7fac440679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:28.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.344+0000 7fac4bbff700 1 -- 172.21.15.72:0/2091721865 shutdown_connections 2023-08-31T19:07:28.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:28.345+0000 7fac4bbff700 1 -- 172.21.15.72:0/2091721865 wait complete. 2023-08-31T19:07:28.359 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-31T19:07:28.360 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:07:28.360 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-31T19:07:28.360 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T19:07:28.361 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T19:07:28.361 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-31T19:07:28.361 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-31T19:07:28.362 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:07:28.362 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:07:28.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:07:28.363 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-31T19:07:28.411 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:07:28.411 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:07:28.412 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:07:28.412 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:07:28.413 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-31T19:07:28.413 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:07:28.413 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:07:28.414 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:07:28.414 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-31T19:07:28.414 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:07:28.415 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:07:28.415 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-31T19:07:28.415 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:07:28.416 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:07:28.416 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:07:28.416 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:07:28.417 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:07:28.417 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 36828sec preferred_lft 36828sec 2023-08-31T19:07:28.417 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-31T19:07:28.418 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:07:28.418 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:07:28.418 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff 2023-08-31T19:07:28.419 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T19:07:28.419 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:07:28.419 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::7c68:c9ff:fe82:9771/64 scope link 2023-08-31T19:07:28.420 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:07:28.420 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:07:28.420 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e2:e1:71:f6:f6:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T19:07:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e0e1:71ff:fef6:f6fa/64 scope link 2023-08-31T19:07:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:07:28.421 INFO:teuthology.orchestra.run.smithi072.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:07:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T19:07:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::38f6:6ff:fe3c:1ef/64 scope link 2023-08-31T19:07:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:07:28.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:07:28.424 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:07:28.492 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-31T19:07:28.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:07:28.495 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-31T19:07:28.543 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-31T19:07:28.544 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:07:28.544 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:07:28.544 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:07:28.544 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:07:28.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:07:28.546 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T19:07:28.546 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T19:07:28.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:07:28.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:07:28.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:07:28.548 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T19:07:28.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:07:28.720 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T19:07:28.766 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T19:07:28.766 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T19:07:28.767 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:07:28.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:07:28.768 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-08-31T19:07:28.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:07:28.879 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-31T19:07:28.925 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-31T19:07:28.926 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:07:29.063 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:07:29.063 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:07:29.088 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:07:29.089 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:07:29.093 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-31T19:07:29.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:07:29.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T19:07:29.166 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-31T19:07:29.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.355+0000 7f94d71ff700 1 Processor -- start 2023-08-31T19:07:29.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.356+0000 7f94d71ff700 1 -- start start 2023-08-31T19:07:29.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.357+0000 7f94d71ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94d00ad1b0 0x7f94d00ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:29.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.357+0000 7f94d71ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f94d00637c0 0x7f94d0155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:29.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.357+0000 7f94d71ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d00c6130 con 0x7f94d0157c10 2023-08-31T19:07:29.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.357+0000 7f94d71ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d00c0350 con 0x7f94d00ad1b0 2023-08-31T19:07:29.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.357+0000 7f94d71ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d01580b0 con 0x7f94d00637c0 2023-08-31T19:07:29.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.357+0000 7f94d4f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94d00ad1b0 0x7f94d00ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:29.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.357+0000 7f94d4f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94d00ad1b0 0x7f94d00ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45544/0 (socket says 172.21.15.72:45544) 2023-08-31T19:07:29.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.357+0000 7f94d4f9b700 1 -- 172.21.15.72:0/714873463 learned_addr learned my addr 172.21.15.72:0/714873463 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:29.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.357+0000 7f94cffff700 1 --1- 172.21.15.72:0/714873463 >> v1:172.21.15.72:6789/0 conn(0x7f94d0157c10 0x7f94d00630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39158/0 (socket says 172.21.15.72:39158) 2023-08-31T19:07:29.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.358+0000 7f94d4f9b700 1 -- 172.21.15.72:0/714873463 >> v2:172.21.15.146:3300/0 conn(0x7f94d00637c0 msgr2=0x7f94d0155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:29.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.358+0000 7f94d579c700 1 --2- 172.21.15.72:0/714873463 >> v2:172.21.15.146:3300/0 conn(0x7f94d00637c0 0x7f94d0155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:29.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.358+0000 7f94d4f9b700 1 --2- 172.21.15.72:0/714873463 >> v2:172.21.15.146:3300/0 conn(0x7f94d00637c0 0x7f94d0155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:29.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.358+0000 7f94d4f9b700 1 -- 172.21.15.72:0/714873463 >> v1:172.21.15.72:6789/0 conn(0x7f94d0157c10 legacy=0x7f94d00630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:29.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.358+0000 7f94cf7fe700 1 -- 172.21.15.72:0/714873463 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063242407 0 0) 0x7f94d00c6130 con 0x7f94d0157c10 2023-08-31T19:07:29.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.358+0000 7f94d4f9b700 1 -- 172.21.15.72:0/714873463 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0155560 con 0x7f94d00ad1b0 2023-08-31T19:07:29.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.358+0000 7f94d579c700 1 --2- 172.21.15.72:0/714873463 >> v2:172.21.15.146:3300/0 conn(0x7f94d00637c0 0x7f94d0155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:29.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.358+0000 7f94d4f9b700 1 --2- 172.21.15.72:0/714873463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00ad1b0 0x7f94d00ad590 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f94d014ec50 tx=0x7f94c40090f0).ready entity=mon.0 client_cookie=969084e979cc4dfb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:29.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.358+0000 7f94cf7fe700 1 -- 172.21.15.72:0/714873463 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c400b600 con 0x7f94d00ad1b0 2023-08-31T19:07:29.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.358+0000 7f94cf7fe700 1 -- 172.21.15.72:0/714873463 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c400b760 con 0x7f94d00ad1b0 2023-08-31T19:07:29.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.358+0000 7f94cf7fe700 1 -- 172.21.15.72:0/714873463 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c400bae0 con 0x7f94d00ad1b0 2023-08-31T19:07:29.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.359+0000 7f94d71ff700 1 -- 172.21.15.72:0/714873463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00ad1b0 msgr2=0x7f94d00ad590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:29.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.359+0000 7f94d71ff700 1 --2- 172.21.15.72:0/714873463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00ad1b0 0x7f94d00ad590 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f94d014ec50 tx=0x7f94c40090f0).stop 2023-08-31T19:07:29.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.359+0000 7f94d71ff700 1 -- 172.21.15.72:0/714873463 shutdown_connections 2023-08-31T19:07:29.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.359+0000 7f94d71ff700 1 --2- 172.21.15.72:0/714873463 >> v2:172.21.15.146:3300/0 conn(0x7f94d00637c0 0x7f94d0155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:29.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.359+0000 7f94d71ff700 1 --2- 172.21.15.72:0/714873463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00ad1b0 0x7f94d00ad590 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:29.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.359+0000 7f94d71ff700 1 -- 172.21.15.72:0/714873463 >> 172.21.15.72:0/714873463 conn(0x7f94d005eb60 msgr2=0x7f94d00cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:29.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.359+0000 7f94d71ff700 1 -- 172.21.15.72:0/714873463 shutdown_connections 2023-08-31T19:07:29.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.359+0000 7f94d71ff700 1 -- 172.21.15.72:0/714873463 wait complete. 2023-08-31T19:07:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.360+0000 7f94d71ff700 1 Processor -- start 2023-08-31T19:07:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.361+0000 7f94d71ff700 1 -- start start 2023-08-31T19:07:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.361+0000 7f94d71ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d00637c0 0x7f94d014a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94d71ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00ad1b0 0x7f94d0159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94d71ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d0157c10 0x7f94d0159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:29.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94d71ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d0159ff0 con 0x7f94d00ad1b0 2023-08-31T19:07:29.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94d71ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00ab660 con 0x7f94d00637c0 2023-08-31T19:07:29.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94d71ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d00c2460 con 0x7f94d0157c10 2023-08-31T19:07:29.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00ad1b0 0x7f94d0159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:29.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00ad1b0 0x7f94d0159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45554/0 (socket says 172.21.15.72:45554) 2023-08-31T19:07:29.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94cffff700 1 -- 172.21.15.72:0/1107940451 learned_addr learned my addr 172.21.15.72:0/1107940451 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:29.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94d4f9b700 1 --2- 172.21.15.72:0/1107940451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d00637c0 0x7f94d014a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:29.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94d579c700 1 --2- 172.21.15.72:0/1107940451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d0157c10 0x7f94d0159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:29.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94cffff700 1 -- 172.21.15.72:0/1107940451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d0157c10 msgr2=0x7f94d0159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:29.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94cffff700 1 --2- 172.21.15.72:0/1107940451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d0157c10 0x7f94d0159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:29.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94cffff700 1 -- 172.21.15.72:0/1107940451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d00637c0 msgr2=0x7f94d014a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94cffff700 1 --2- 172.21.15.72:0/1107940451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d00637c0 0x7f94d014a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94cffff700 1 -- 172.21.15.72:0/1107940451 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c4009370 con 0x7f94d00ad1b0 2023-08-31T19:07:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94d579c700 1 --2- 172.21.15.72:0/1107940451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d0157c10 0x7f94d0159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.362+0000 7f94cffff700 1 --2- 172.21.15.72:0/1107940451 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00ad1b0 0x7f94d0159610 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f94bc00c440 tx=0x7f94bc007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.363+0000 7f94ccff9700 1 -- 172.21.15.72:0/1107940451 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0072e0 con 0x7f94d00ad1b0 2023-08-31T19:07:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.363+0000 7f94ccff9700 1 -- 172.21.15.72:0/1107940451 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc007440 con 0x7f94d00ad1b0 2023-08-31T19:07:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.363+0000 7f94d71ff700 1 -- 172.21.15.72:0/1107940451 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d015a230 con 0x7f94d00ad1b0 2023-08-31T19:07:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.363+0000 7f94ccff9700 1 -- 172.21.15.72:0/1107940451 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc005910 con 0x7f94d00ad1b0 2023-08-31T19:07:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.363+0000 7f94d71ff700 1 -- 172.21.15.72:0/1107940451 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d015a7f0 con 0x7f94d00ad1b0 2023-08-31T19:07:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.364+0000 7f94d71ff700 1 -- 172.21.15.72:0/1107940451 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d006c6b0 con 0x7f94d00ad1b0 2023-08-31T19:07:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.364+0000 7f94ccff9700 1 -- 172.21.15.72:0/1107940451 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f94bc005d00 con 0x7f94d00ad1b0 2023-08-31T19:07:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.365+0000 7f94ccff9700 1 --2- 172.21.15.72:0/1107940451 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94b405ef30 0x7f94b40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:29.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.366+0000 7f94ccff9700 1 -- 172.21.15.72:0/1107940451 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f94bc079980 con 0x7f94d00ad1b0 2023-08-31T19:07:29.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.366+0000 7f94d4f9b700 1 --2- 172.21.15.72:0/1107940451 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94b405ef30 0x7f94b40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:29.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.366+0000 7f94d4f9b700 1 --2- 172.21.15.72:0/1107940451 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94b405ef30 0x7f94b40613f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f94d0152d80 tx=0x7f94c4017000).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:29.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.369+0000 7f94ccff9700 1 -- 172.21.15.72:0/1107940451 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f94bc04a940 con 0x7f94d00ad1b0 2023-08-31T19:07:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.563+0000 7f94d71ff700 1 -- 172.21.15.72:0/1107940451 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f94d00ab7a0 con 0x7f94b405ef30 2023-08-31T19:07:29.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.564+0000 7f94ccff9700 1 -- 172.21.15.72:0/1107940451 <== mgr.7857 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f94d00ab7a0 con 0x7f94b405ef30 2023-08-31T19:07:29.565 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:07:29.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:29.565 INFO:teuthology.orchestra.run.smithi072.stdout: "name": "cephfs" 2023-08-31T19:07:29.566 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:29.566 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:07:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.566+0000 7f94d71ff700 1 -- 172.21.15.72:0/1107940451 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94b405ef30 msgr2=0x7f94b40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.566+0000 7f94d71ff700 1 --2- 172.21.15.72:0/1107940451 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94b405ef30 0x7f94b40613f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f94d0152d80 tx=0x7f94c4017000).stop 2023-08-31T19:07:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.566+0000 7f94d71ff700 1 -- 172.21.15.72:0/1107940451 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00ad1b0 msgr2=0x7f94d0159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.566+0000 7f94d71ff700 1 --2- 172.21.15.72:0/1107940451 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00ad1b0 0x7f94d0159610 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f94bc00c440 tx=0x7f94bc007e30).stop 2023-08-31T19:07:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.566+0000 7f94d71ff700 1 -- 172.21.15.72:0/1107940451 shutdown_connections 2023-08-31T19:07:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.567+0000 7f94d71ff700 1 --2- 172.21.15.72:0/1107940451 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f94d0157c10 0x7f94d0159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.567+0000 7f94d71ff700 1 --2- 172.21.15.72:0/1107940451 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f94b405ef30 0x7f94b40613f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.567+0000 7f94d71ff700 1 --2- 172.21.15.72:0/1107940451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94d00637c0 0x7f94d014a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.567+0000 7f94d71ff700 1 --2- 172.21.15.72:0/1107940451 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94d00ad1b0 0x7f94d0159610 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.567+0000 7f94d71ff700 1 -- 172.21.15.72:0/1107940451 >> 172.21.15.72:0/1107940451 conn(0x7f94d005eb60 msgr2=0x7f94d0154de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.567+0000 7f94d71ff700 1 -- 172.21.15.72:0/1107940451 shutdown_connections 2023-08-31T19:07:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.567+0000 7f94d71ff700 1 -- 172.21.15.72:0/1107940451 wait complete. 2023-08-31T19:07:29.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-31T19:07:29.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.778+0000 7fc4163ff700 1 Processor -- start 2023-08-31T19:07:29.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.778+0000 7fc4163ff700 1 -- start start 2023-08-31T19:07:29.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.780+0000 7fc4163ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc4100690e0 0x7fc41005e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:29.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.780+0000 7fc4163ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4100bc4a0 con 0x7fc4100c38d0 2023-08-31T19:07:29.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.780+0000 7fc4163ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc410069c40 con 0x7fc4101544e0 2023-08-31T19:07:29.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.780+0000 7fc4163ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41005e840 con 0x7fc4100690e0 2023-08-31T19:07:29.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.780+0000 7fc41499c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc4100c38d0 0x7fc4100bc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39174/0 (socket says 172.21.15.72:39174) 2023-08-31T19:07:29.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.780+0000 7fc41499c700 1 -- 172.21.15.72:0/2318671562 learned_addr learned my addr 172.21.15.72:0/2318671562 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:29.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.780+0000 7fc40f7fe700 1 --2- 172.21.15.72:0/2318671562 >> v2:172.21.15.146:3300/0 conn(0x7fc4100690e0 0x7fc41005e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.780+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383084330 0 0) 0x7fc4100bc4a0 con 0x7fc4100c38d0 2023-08-31T19:07:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.780+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3f80033f0 con 0x7fc4100c38d0 2023-08-31T19:07:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502285130 0 0) 0x7fc410069c40 con 0x7fc4101544e0 2023-08-31T19:07:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4100bc4a0 con 0x7fc4101544e0 2023-08-31T19:07:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1803797679 0 0) 0x7fc3f80033f0 con 0x7fc4100c38d0 2023-08-31T19:07:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 >> v2:172.21.15.146:3300/0 conn(0x7fc4100690e0 msgr2=0x7fc41005e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40effd700 1 --2- 172.21.15.72:0/2318671562 >> v2:172.21.15.146:3300/0 conn(0x7fc4100690e0 0x7fc41005e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 >> v1:172.21.15.146:6789/0 conn(0x7fc4101544e0 legacy=0x7fc4100689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4100c1c30 con 0x7fc4100c38d0 2023-08-31T19:07:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fc4080017f0 con 0x7fc4100c38d0 2023-08-31T19:07:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 >> v1:172.21.15.72:6789/0 conn(0x7fc4100c38d0 legacy=0x7fc4100bc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40effd700 1 --2- 172.21.15.72:0/2318671562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3f8003ac0 0x7fc3f8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40effd700 1 --2- 172.21.15.72:0/2318671562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f8004690 0x7fc3f8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40effd700 1 --2- 172.21.15.72:0/2318671562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3f8005070 0x7fc3f800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f800bfe0 con 0x7fc3f8004690 2023-08-31T19:07:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f800c150 con 0x7fc3f8005070 2023-08-31T19:07:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f800c310 con 0x7fc3f8003ac0 2023-08-31T19:07:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40f7fe700 1 --2- 172.21.15.72:0/2318671562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f8004690 0x7fc3f8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc41499c700 1 --2- 172.21.15.72:0/2318671562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3f8005070 0x7fc3f800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.781+0000 7fc40ffff700 1 --2- 172.21.15.72:0/2318671562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3f8003ac0 0x7fc3f8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:29.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.782+0000 7fc40f7fe700 1 -- 172.21.15.72:0/2318671562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3f8003ac0 msgr2=0x7fc3f8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:29.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.782+0000 7fc40f7fe700 1 --2- 172.21.15.72:0/2318671562 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3f8003ac0 0x7fc3f8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:29.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.782+0000 7fc40f7fe700 1 -- 172.21.15.72:0/2318671562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3f8005070 msgr2=0x7fc3f800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:29.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.782+0000 7fc40f7fe700 1 --2- 172.21.15.72:0/2318671562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3f8005070 0x7fc3f800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:29.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.782+0000 7fc40f7fe700 1 -- 172.21.15.72:0/2318671562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f80033f0 con 0x7fc3f8004690 2023-08-31T19:07:29.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.782+0000 7fc41499c700 1 -- 172.21.15.72:0/2318671562 reap_dead start 2023-08-31T19:07:29.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.782+0000 7fc40f7fe700 1 --2- 172.21.15.72:0/2318671562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f8004690 0x7fc3f8004b10 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7fc41005f060 tx=0x7fc404009060).ready entity=mon.0 client_cookie=54e6183748e8c43a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:29.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.782+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404009e90 con 0x7fc3f8004690 2023-08-31T19:07:29.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.782+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc404009430 con 0x7fc3f8004690 2023-08-31T19:07:29.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.782+0000 7fc40effd700 1 -- 172.21.15.72:0/2318671562 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40400e850 con 0x7fc3f8004690 2023-08-31T19:07:29.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.783+0000 7fc4163ff700 1 -- 172.21.15.72:0/2318671562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f8004690 msgr2=0x7fc3f8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:29.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.783+0000 7fc4163ff700 1 --2- 172.21.15.72:0/2318671562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f8004690 0x7fc3f8004b10 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7fc41005f060 tx=0x7fc404009060).stop 2023-08-31T19:07:29.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.783+0000 7fc4163ff700 1 -- 172.21.15.72:0/2318671562 shutdown_connections 2023-08-31T19:07:29.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.783+0000 7fc4163ff700 1 --2- 172.21.15.72:0/2318671562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3f8004690 0x7fc3f8004b10 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:29.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.783+0000 7fc4163ff700 1 -- 172.21.15.72:0/2318671562 >> 172.21.15.72:0/2318671562 conn(0x7fc4100c7e00 msgr2=0x7fc4100c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:29.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.783+0000 7fc4163ff700 1 -- 172.21.15.72:0/2318671562 shutdown_connections 2023-08-31T19:07:29.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.783+0000 7fc4163ff700 1 -- 172.21.15.72:0/2318671562 wait complete. 2023-08-31T19:07:29.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.784+0000 7fc4163ff700 1 Processor -- start 2023-08-31T19:07:29.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.784+0000 7fc4163ff700 1 -- start start 2023-08-31T19:07:29.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.785+0000 7fc4163ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3f8004690 0x7fc410157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:29.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.785+0000 7fc4163ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc41013ed20 0x7fc41013f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:29.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.785+0000 7fc4163ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc410156400 0x7fc410156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:29.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.785+0000 7fc4163ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc410155740 con 0x7fc410156400 2023-08-31T19:07:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.785+0000 7fc4163ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc410155f70 con 0x7fc41013ed20 2023-08-31T19:07:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.785+0000 7fc4163ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4101586b0 con 0x7fc3f8004690 2023-08-31T19:07:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.786+0000 7fc41499c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc410156400 0x7fc410156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.786+0000 7fc41499c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc410156400 0x7fc410156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45564/0 (socket says 172.21.15.72:45564) 2023-08-31T19:07:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.786+0000 7fc41499c700 1 -- 172.21.15.72:0/3194091527 learned_addr learned my addr 172.21.15.72:0/3194091527 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:29.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.786+0000 7fc40ffff700 1 --2- 172.21.15.72:0/3194091527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3f8004690 0x7fc410157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:29.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.786+0000 7fc40f7fe700 1 --2- 172.21.15.72:0/3194091527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc41013ed20 0x7fc41013f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:29.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.786+0000 7fc41499c700 1 -- 172.21.15.72:0/3194091527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3f8004690 msgr2=0x7fc410157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:29.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.786+0000 7fc41499c700 1 --2- 172.21.15.72:0/3194091527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3f8004690 0x7fc410157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:29.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.786+0000 7fc41499c700 1 -- 172.21.15.72:0/3194091527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc41013ed20 msgr2=0x7fc41013f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:29.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.786+0000 7fc41499c700 1 --2- 172.21.15.72:0/3194091527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc41013ed20 0x7fc41013f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:29.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.786+0000 7fc41499c700 1 -- 172.21.15.72:0/3194091527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4101583d0 con 0x7fc410156400 2023-08-31T19:07:29.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.786+0000 7fc41499c700 1 --2- 172.21.15.72:0/3194091527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc410156400 0x7fc410156880 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7fc410065f60 tx=0x7fc408007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:29.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.787+0000 7fc3f7fff700 1 -- 172.21.15.72:0/3194091527 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40800f8a0 con 0x7fc410156400 2023-08-31T19:07:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.787+0000 7fc3f7fff700 1 -- 172.21.15.72:0/3194091527 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40800fa00 con 0x7fc410156400 2023-08-31T19:07:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.787+0000 7fc4163ff700 1 -- 172.21.15.72:0/3194091527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc410155920 con 0x7fc410156400 2023-08-31T19:07:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.787+0000 7fc3f7fff700 1 -- 172.21.15.72:0/3194091527 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40800fda0 con 0x7fc410156400 2023-08-31T19:07:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.787+0000 7fc4163ff700 1 -- 172.21.15.72:0/3194091527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc410156d70 con 0x7fc410156400 2023-08-31T19:07:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.788+0000 7fc4163ff700 1 -- 172.21.15.72:0/3194091527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc410156100 con 0x7fc410156400 2023-08-31T19:07:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.789+0000 7fc3f7fff700 1 -- 172.21.15.72:0/3194091527 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 56) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc408012560 con 0x7fc410156400 2023-08-31T19:07:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.789+0000 7fc3f7fff700 1 --2- 172.21.15.72:0/3194091527 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc3fc05ef30 0x7fc3fc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.789+0000 7fc3f7fff700 1 -- 172.21.15.72:0/3194091527 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fc408079f80 con 0x7fc410156400 2023-08-31T19:07:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.790+0000 7fc40ffff700 1 --2- 172.21.15.72:0/3194091527 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc3fc05ef30 0x7fc3fc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:29.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.790+0000 7fc40ffff700 1 --2- 172.21.15.72:0/3194091527 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc3fc05ef30 0x7fc3fc0613f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc410159910 tx=0x7fc400007bb0).ready entity=mgr.7857 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:29.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:29.794+0000 7fc3f7fff700 1 -- 172.21.15.72:0/3194091527 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc40804af40 con 0x7fc410156400 2023-08-31T19:07:30.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.004+0000 7fc4163ff700 1 -- 172.21.15.72:0/3194091527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fc41006c6b0 con 0x7fc410156400 2023-08-31T19:07:30.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.653+0000 7fc3f7fff700 1 -- 172.21.15.72:0/3194091527 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 57) v1 ==== 75391+0+0 (secure 0 0 0) 0x7fc4080778a0 con 0x7fc410156400 2023-08-31T19:07:30.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.656+0000 7fc3f7fff700 1 -- 172.21.15.72:0/3194091527 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v57) v1 ==== 92+0+0 (secure 0 0 0) 0x7fc4080727d0 con 0x7fc410156400 2023-08-31T19:07:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.658+0000 7fc4163ff700 1 -- 172.21.15.72:0/3194091527 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc3fc05ef30 msgr2=0x7fc3fc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.658+0000 7fc4163ff700 1 --2- 172.21.15.72:0/3194091527 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc3fc05ef30 0x7fc3fc0613f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc410159910 tx=0x7fc400007bb0).stop 2023-08-31T19:07:30.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.658+0000 7fc4163ff700 1 -- 172.21.15.72:0/3194091527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc410156400 msgr2=0x7fc410156880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:30.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.658+0000 7fc4163ff700 1 --2- 172.21.15.72:0/3194091527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc410156400 0x7fc410156880 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7fc410065f60 tx=0x7fc408007f20).stop 2023-08-31T19:07:30.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.659+0000 7fc4163ff700 1 -- 172.21.15.72:0/3194091527 shutdown_connections 2023-08-31T19:07:30.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.659+0000 7fc4163ff700 1 --2- 172.21.15.72:0/3194091527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc410156400 0x7fc410156880 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:30.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.659+0000 7fc4163ff700 1 --2- 172.21.15.72:0/3194091527 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc3f8004690 0x7fc410157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:30.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.659+0000 7fc4163ff700 1 --2- 172.21.15.72:0/3194091527 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc3fc05ef30 0x7fc3fc0613f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:30.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.659+0000 7fc4163ff700 1 --2- 172.21.15.72:0/3194091527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc41013ed20 0x7fc41013f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:30.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.659+0000 7fc4163ff700 1 -- 172.21.15.72:0/3194091527 >> 172.21.15.72:0/3194091527 conn(0x7fc4100c7e00 msgr2=0x7fc4100bc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:30.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.659+0000 7fc4163ff700 1 -- 172.21.15.72:0/3194091527 shutdown_connections 2023-08-31T19:07:30.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.659+0000 7fc4163ff700 1 -- 172.21.15.72:0/3194091527 wait complete. 2023-08-31T19:07:30.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-31T19:07:30.864 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:30.864+0000 7f85724b4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:07:30.876 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:30.876+0000 7f5bfd678680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:07:30.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.879+0000 7f2b32fff700 1 Processor -- start 2023-08-31T19:07:30.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.879+0000 7f2b32fff700 1 -- start start 2023-08-31T19:07:30.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.880+0000 7f2b32fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b2c154030 0x7f2b2c154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:30.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.880+0000 7f2b32fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b2c0c7360 0x7f2b2c063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:30.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.880+0000 7f2b32fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2c0c6ed0 con 0x7f2b2c0c06b0 2023-08-31T19:07:30.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.880+0000 7f2b32fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2c0c66e0 con 0x7f2b2c154030 2023-08-31T19:07:30.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.880+0000 7f2b32fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c0c68c0 con 0x7f2b2c0c7360 2023-08-31T19:07:30.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.881+0000 7f2b30d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b2c154030 0x7f2b2c154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:30.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.881+0000 7f2b30d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b2c154030 0x7f2b2c154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:55282/0 (socket says 172.21.15.72:55282) 2023-08-31T19:07:30.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.881+0000 7f2b30d9b700 1 -- 172.21.15.72:0/3471479546 learned_addr learned my addr 172.21.15.72:0/3471479546 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:30.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.881+0000 7f2b2bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2b2c0c06b0 0x7f2b2c0aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:51056/0 (socket says 172.21.15.72:51056) 2023-08-31T19:07:30.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.881+0000 7f2b3159c700 1 --2- 172.21.15.72:0/3471479546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b2c0c7360 0x7f2b2c063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:30.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.881+0000 7f2b30d9b700 1 -- 172.21.15.72:0/3471479546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b2c0c7360 msgr2=0x7f2b2c063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:30.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.881+0000 7f2b30d9b700 1 --2- 172.21.15.72:0/3471479546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b2c0c7360 0x7f2b2c063120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.881+0000 7f2b30d9b700 1 -- 172.21.15.72:0/3471479546 >> v1:172.21.15.146:6789/0 conn(0x7f2b2c0c06b0 legacy=0x7f2b2c0aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.881+0000 7f2b30d9b700 1 -- 172.21.15.72:0/3471479546 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c0c0f30 con 0x7f2b2c154030 2023-08-31T19:07:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.882+0000 7f2b30d9b700 1 --2- 172.21.15.72:0/3471479546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b2c154030 0x7f2b2c154410 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f2b20006fd0 tx=0x7f2b200090f0).ready entity=mon.1 client_cookie=f68ea795c5020267 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.882+0000 7f2b2b7fe700 1 -- 172.21.15.72:0/3471479546 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000b580 con 0x7f2b2c154030 2023-08-31T19:07:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.882+0000 7f2b2b7fe700 1 -- 172.21.15.72:0/3471479546 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2000b6e0 con 0x7f2b2c154030 2023-08-31T19:07:30.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.882+0000 7f2b2b7fe700 1 -- 172.21.15.72:0/3471479546 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000ba60 con 0x7f2b2c154030 2023-08-31T19:07:30.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.882+0000 7f2b32fff700 1 -- 172.21.15.72:0/3471479546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b2c154030 msgr2=0x7f2b2c154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:30.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.882+0000 7f2b32fff700 1 --2- 172.21.15.72:0/3471479546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b2c154030 0x7f2b2c154410 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f2b20006fd0 tx=0x7f2b200090f0).stop 2023-08-31T19:07:30.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.882+0000 7f2b32fff700 1 -- 172.21.15.72:0/3471479546 shutdown_connections 2023-08-31T19:07:30.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.882+0000 7f2b32fff700 1 --2- 172.21.15.72:0/3471479546 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b2c0c7360 0x7f2b2c063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:30.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.882+0000 7f2b32fff700 1 --2- 172.21.15.72:0/3471479546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b2c154030 0x7f2b2c154410 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:30.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.883+0000 7f2b32fff700 1 -- 172.21.15.72:0/3471479546 >> 172.21.15.72:0/3471479546 conn(0x7f2b2c05eb60 msgr2=0x7f2b2c0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:30.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.883+0000 7f2b32fff700 1 -- 172.21.15.72:0/3471479546 shutdown_connections 2023-08-31T19:07:30.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.883+0000 7f2b32fff700 1 -- 172.21.15.72:0/3471479546 wait complete. 2023-08-31T19:07:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.884+0000 7f2b32fff700 1 Processor -- start 2023-08-31T19:07:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.884+0000 7f2b32fff700 1 -- start start 2023-08-31T19:07:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.885+0000 7f2b32fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b2c0c06b0 0x7f2b2c0b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.885+0000 7f2b32fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2c0c7360 0x7f2b2c155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.885+0000 7f2b32fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b2c154030 0x7f2b2c13f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.885+0000 7f2b32fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c0b0d10 con 0x7f2b2c0c7360 2023-08-31T19:07:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.885+0000 7f2b32fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c155490 con 0x7f2b2c0c06b0 2023-08-31T19:07:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.885+0000 7f2b32fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c155e10 con 0x7f2b2c154030 2023-08-31T19:07:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.886+0000 7f2b2bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2c0c7360 0x7f2b2c155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:30.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.886+0000 7f2b2bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2c0c7360 0x7f2b2c155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45596/0 (socket says 172.21.15.72:45596) 2023-08-31T19:07:30.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.886+0000 7f2b2bfff700 1 -- 172.21.15.72:0/2727998223 learned_addr learned my addr 172.21.15.72:0/2727998223 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:30.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.886+0000 7f2b30d9b700 1 --2- 172.21.15.72:0/2727998223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b2c0c06b0 0x7f2b2c0b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:30.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.886+0000 7f2b3159c700 1 --2- 172.21.15.72:0/2727998223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b2c154030 0x7f2b2c13f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:30.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.886+0000 7f2b30d9b700 1 -- 172.21.15.72:0/2727998223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b2c154030 msgr2=0x7f2b2c13f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:30.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.886+0000 7f2b30d9b700 1 --2- 172.21.15.72:0/2727998223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b2c154030 0x7f2b2c13f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:30.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.886+0000 7f2b30d9b700 1 -- 172.21.15.72:0/2727998223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2c0c7360 msgr2=0x7f2b2c155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:30.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.886+0000 7f2b30d9b700 1 --2- 172.21.15.72:0/2727998223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2c0c7360 0x7f2b2c155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:30.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.886+0000 7f2b30d9b700 1 -- 172.21.15.72:0/2727998223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b20009370 con 0x7f2b2c0c06b0 2023-08-31T19:07:30.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.886+0000 7f2b2bfff700 1 --2- 172.21.15.72:0/2727998223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2c0c7360 0x7f2b2c155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:07:30.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.886+0000 7f2b30d9b700 1 --2- 172.21.15.72:0/2727998223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b2c0c06b0 0x7f2b2c0b0820 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f2b2c0cb6d0 tx=0x7f2b20017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:30.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.887+0000 7f2b28ff9700 1 -- 172.21.15.72:0/2727998223 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b20000bc0 con 0x7f2b2c0c06b0 2023-08-31T19:07:30.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.887+0000 7f2b28ff9700 1 -- 172.21.15.72:0/2727998223 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2000b850 con 0x7f2b2c0c06b0 2023-08-31T19:07:30.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.887+0000 7f2b28ff9700 1 -- 172.21.15.72:0/2727998223 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b20000d20 con 0x7f2b2c0c06b0 2023-08-31T19:07:30.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.887+0000 7f2b32fff700 1 -- 172.21.15.72:0/2727998223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2c154880 con 0x7f2b2c0c06b0 2023-08-31T19:07:30.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.887+0000 7f2b32fff700 1 -- 172.21.15.72:0/2727998223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2c154e40 con 0x7f2b2c0c06b0 2023-08-31T19:07:30.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.888+0000 7f2b32fff700 1 -- 172.21.15.72:0/2727998223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2c06c6b0 con 0x7f2b2c0c06b0 2023-08-31T19:07:30.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.889+0000 7f2b28ff9700 1 -- 172.21.15.72:0/2727998223 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 57) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f2b2001cb10 con 0x7f2b2c0c06b0 2023-08-31T19:07:30.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.890+0000 7f2b28ff9700 1 --2- 172.21.15.72:0/2727998223 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b1005ef80 0x7f2b10061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:30.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.890+0000 7f2b28ff9700 1 -- 172.21.15.72:0/2727998223 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f2b2007bbb0 con 0x7f2b2c0c06b0 2023-08-31T19:07:30.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.890+0000 7f2b2bfff700 1 -- 172.21.15.72:0/2727998223 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b1005ef80 msgr2=0x7f2b10061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:30.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.890+0000 7f2b2bfff700 1 --2- 172.21.15.72:0/2727998223 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b1005ef80 0x7f2b10061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:30.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:30.894+0000 7f2b28ff9700 1 -- 172.21.15.72:0/2727998223 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2b2004cb70 con 0x7f2b2c0c06b0 2023-08-31T19:07:30.944 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:30.944+0000 7f85724b4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:07:30.958 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:30.958+0000 7f5bfd678680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:07:31.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.068+0000 7f2b32fff700 1 -- 172.21.15.72:0/2727998223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f2b2c0c0c50 con 0x7f2b2c0c06b0 2023-08-31T19:07:31.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.074+0000 7f2b28ff9700 1 -- 172.21.15.72:0/2727998223 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v27)=0 v27) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2b20020070 con 0x7f2b2c0c06b0 2023-08-31T19:07:31.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.076+0000 7f2b32fff700 1 -- 172.21.15.72:0/2727998223 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b1005ef80 msgr2=0x7f2b10061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:31.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.076+0000 7f2b32fff700 1 --2- 172.21.15.72:0/2727998223 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b1005ef80 0x7f2b10061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:31.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.077+0000 7f2b32fff700 1 -- 172.21.15.72:0/2727998223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b2c0c06b0 msgr2=0x7f2b2c0b0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:31.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.077+0000 7f2b32fff700 1 --2- 172.21.15.72:0/2727998223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b2c0c06b0 0x7f2b2c0b0820 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f2b2c0cb6d0 tx=0x7f2b20017000).stop 2023-08-31T19:07:31.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.077+0000 7f2b32fff700 1 -- 172.21.15.72:0/2727998223 shutdown_connections 2023-08-31T19:07:31.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.077+0000 7f2b32fff700 1 --2- 172.21.15.72:0/2727998223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2b2c154030 0x7f2b2c13f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:31.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.077+0000 7f2b32fff700 1 --2- 172.21.15.72:0/2727998223 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2b1005ef80 0x7f2b10061440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:31.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.077+0000 7f2b32fff700 1 --2- 172.21.15.72:0/2727998223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b2c0c06b0 0x7f2b2c0b0820 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:31.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.077+0000 7f2b32fff700 1 --2- 172.21.15.72:0/2727998223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b2c0c7360 0x7f2b2c155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:31.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.077+0000 7f2b32fff700 1 -- 172.21.15.72:0/2727998223 >> 172.21.15.72:0/2727998223 conn(0x7f2b2c05eb60 msgr2=0x7f2b2c0c9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:31.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.077+0000 7f2b32fff700 1 -- 172.21.15.72:0/2727998223 shutdown_connections 2023-08-31T19:07:31.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.077+0000 7f2b32fff700 1 -- 172.21.15.72:0/2727998223 wait complete. 2023-08-31T19:07:31.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:07:31.095 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-31T19:07:31.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-08-31T19:07:31.270 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:31.270+0000 7f85724b4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:07:31.306 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:31.306+0000 7f5bfd678680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:07:31.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.347+0000 7f817cfff700 1 Processor -- start 2023-08-31T19:07:31.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.347+0000 7f817cfff700 1 -- start start 2023-08-31T19:07:31.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.348+0000 7f817cfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8178151da0 0x7f81781553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:31.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.348+0000 7f817cfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8178064d70 0x7f81780bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:31.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.348+0000 7f817cfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8178154f40 con 0x7f81780c5370 2023-08-31T19:07:31.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.348+0000 7f817cfff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81780c57f0 con 0x7f8178064d70 2023-08-31T19:07:31.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.348+0000 7f817cfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8178154960 con 0x7f8178151da0 2023-08-31T19:07:31.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.349+0000 7f817659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8178151da0 0x7f81781553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:31.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.349+0000 7f817659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8178151da0 0x7f81781553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:40632/0 (socket says 172.21.15.72:40632) 2023-08-31T19:07:31.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.349+0000 7f817659c700 1 -- 172.21.15.72:0/560734594 learned_addr learned my addr 172.21.15.72:0/560734594 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:31.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.349+0000 7f8176d9d700 1 --2- 172.21.15.72:0/560734594 >> v2:172.21.15.146:3300/0 conn(0x7f8178064d70 0x7f81780bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:31.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.349+0000 7f817659c700 1 -- 172.21.15.72:0/560734594 >> v2:172.21.15.146:3300/0 conn(0x7f8178064d70 msgr2=0x7f81780bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:31.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.349+0000 7f817659c700 1 --2- 172.21.15.72:0/560734594 >> v2:172.21.15.146:3300/0 conn(0x7f8178064d70 0x7f81780bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:31.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.349+0000 7f817659c700 1 -- 172.21.15.72:0/560734594 >> v1:172.21.15.72:6789/0 conn(0x7f81780c5370 legacy=0x7f8178064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:31.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.349+0000 7f817659c700 1 -- 172.21.15.72:0/560734594 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81780aa2c0 con 0x7f8178151da0 2023-08-31T19:07:31.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.349+0000 7f817559a700 1 -- 172.21.15.72:0/560734594 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271653718 0 0) 0x7f8178154f40 con 0x7f81780c5370 2023-08-31T19:07:31.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.349+0000 7f8176d9d700 1 --2- 172.21.15.72:0/560734594 >> v2:172.21.15.146:3300/0 conn(0x7f8178064d70 0x7f81780bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:31.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.349+0000 7f817659c700 1 --2- 172.21.15.72:0/560734594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8178151da0 0x7f81781553d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f8168006fd0 tx=0x7f81680090f0).ready entity=mon.2 client_cookie=44015dbddb5e5da1 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:31.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.350+0000 7f817559a700 1 -- 172.21.15.72:0/560734594 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816800b600 con 0x7f8178151da0 2023-08-31T19:07:31.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.350+0000 7f817559a700 1 -- 172.21.15.72:0/560734594 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816800b760 con 0x7f8178151da0 2023-08-31T19:07:31.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.350+0000 7f817559a700 1 -- 172.21.15.72:0/560734594 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816800bae0 con 0x7f8178151da0 2023-08-31T19:07:31.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.350+0000 7f817cfff700 1 -- 172.21.15.72:0/560734594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8178151da0 msgr2=0x7f81781553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:31.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.350+0000 7f817cfff700 1 --2- 172.21.15.72:0/560734594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8178151da0 0x7f81781553d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f8168006fd0 tx=0x7f81680090f0).stop 2023-08-31T19:07:31.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.350+0000 7f817cfff700 1 -- 172.21.15.72:0/560734594 shutdown_connections 2023-08-31T19:07:31.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.350+0000 7f817cfff700 1 --2- 172.21.15.72:0/560734594 >> v2:172.21.15.146:3300/0 conn(0x7f8178064d70 0x7f81780bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:31.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.350+0000 7f817cfff700 1 --2- 172.21.15.72:0/560734594 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8178151da0 0x7f81781553d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:31.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.350+0000 7f817cfff700 1 -- 172.21.15.72:0/560734594 >> 172.21.15.72:0/560734594 conn(0x7f8178063a90 msgr2=0x7f81780cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:31.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.350+0000 7f817cfff700 1 -- 172.21.15.72:0/560734594 shutdown_connections 2023-08-31T19:07:31.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.350+0000 7f817cfff700 1 -- 172.21.15.72:0/560734594 wait complete. 2023-08-31T19:07:31.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.352+0000 7f817cfff700 1 Processor -- start 2023-08-31T19:07:31.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.352+0000 7f817cfff700 1 -- start start 2023-08-31T19:07:31.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.353+0000 7f817cfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8178064d70 0x7f817814cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:31.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.353+0000 7f817cfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81780c5370 0x7f81780c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:31.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.353+0000 7f817cfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8178151da0 0x7f817814f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:31.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.353+0000 7f817cfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81780af900 con 0x7f8178151da0 2023-08-31T19:07:31.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.353+0000 7f817cfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81780aecf0 con 0x7f8178064d70 2023-08-31T19:07:31.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.353+0000 7f817cfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81780aefd0 con 0x7f81780c5370 2023-08-31T19:07:31.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.353+0000 7f8176d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8178151da0 0x7f817814f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:31.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.353+0000 7f8176d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8178151da0 0x7f817814f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45598/0 (socket says 172.21.15.72:45598) 2023-08-31T19:07:31.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.353+0000 7f817659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8178064d70 0x7f817814cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.353+0000 7f8176d9d700 1 -- 172.21.15.72:0/2215428341 learned_addr learned my addr 172.21.15.72:0/2215428341 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.353+0000 7f8175d9b700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81780c5370 0x7f81780c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.354+0000 7f8176d9d700 1 -- 172.21.15.72:0/2215428341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81780c5370 msgr2=0x7f81780c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.354+0000 7f8176d9d700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81780c5370 0x7f81780c2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.354+0000 7f8176d9d700 1 -- 172.21.15.72:0/2215428341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8178064d70 msgr2=0x7f817814cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.354+0000 7f8176d9d700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8178064d70 0x7f817814cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.354+0000 7f8176d9d700 1 -- 172.21.15.72:0/2215428341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8168009370 con 0x7f8178151da0 2023-08-31T19:07:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.354+0000 7f8176d9d700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8178151da0 0x7f817814f660 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f8170009f70 tx=0x7f81700099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.354+0000 7f81667fc700 1 -- 172.21.15.72:0/2215428341 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817000db80 con 0x7f8178151da0 2023-08-31T19:07:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.354+0000 7f81667fc700 1 -- 172.21.15.72:0/2215428341 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817000f040 con 0x7f8178151da0 2023-08-31T19:07:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.354+0000 7f81667fc700 1 -- 172.21.15.72:0/2215428341 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81700133f0 con 0x7f8178151da0 2023-08-31T19:07:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.354+0000 7f817cfff700 1 -- 172.21.15.72:0/2215428341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81780af2b0 con 0x7f8178151da0 2023-08-31T19:07:31.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.354+0000 7f817cfff700 1 -- 172.21.15.72:0/2215428341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817814d280 con 0x7f8178151da0 2023-08-31T19:07:31.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.356+0000 7f817cfff700 1 -- 172.21.15.72:0/2215428341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81780c5050 con 0x7f8178151da0 2023-08-31T19:07:31.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.356+0000 7f81667fc700 1 -- 172.21.15.72:0/2215428341 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 57) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f81700137e0 con 0x7f8178151da0 2023-08-31T19:07:31.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.357+0000 7f81667fc700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 0x7f8158061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:31.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.357+0000 7f81667fc700 1 -- 172.21.15.72:0/2215428341 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f817007a8b0 con 0x7f8178151da0 2023-08-31T19:07:31.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.357+0000 7f817659c700 1 -- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 msgr2=0x7f8158061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:31.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.357+0000 7f817659c700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 0x7f8158061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:31.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.361+0000 7f81667fc700 1 -- 172.21.15.72:0/2215428341 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f817004b810 con 0x7f8178151da0 2023-08-31T19:07:31.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.558+0000 7f817659c700 1 -- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 msgr2=0x7f8158061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:31.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.558+0000 7f817659c700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 0x7f8158061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:07:31.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.562+0000 7f817cfff700 1 -- 172.21.15.72:0/2215428341 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f81780af140 con 0x7f815805ef80 2023-08-31T19:07:31.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.959+0000 7f817659c700 1 -- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 msgr2=0x7f8158061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:31.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:31.959+0000 7f817659c700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 0x7f8158061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-31T19:07:32.015 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:32.014+0000 7f85724b4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:07:32.058 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:32.057+0000 7f5bfd678680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:07:32.097 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:32.097+0000 7f85724b4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:07:32.140 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:32.139+0000 7f5bfd678680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:07:32.335 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:32.335+0000 7f85724b4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:07:32.369 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:32.369+0000 7f5bfd678680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:07:32.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:32.760+0000 7f817659c700 1 -- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 msgr2=0x7f8158061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:32.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:32.760+0000 7f817659c700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 0x7f8158061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-31T19:07:32.845 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:32.845+0000 7f85724b4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:07:32.879 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:32.879+0000 7f5bfd678680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:07:32.969 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:32.969+0000 7f85724b4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:07:33.001 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:33.001+0000 7f5bfd678680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:07:33.152 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:33.152+0000 7f85724b4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:07:33.184 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:33.184+0000 7f5bfd678680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:07:33.245 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:33.244+0000 7f85724b4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:07:33.277 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:33.276+0000 7f5bfd678680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:07:33.329 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:33.329+0000 7f85724b4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:07:33.361 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:33.361+0000 7f5bfd678680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:07:33.638 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:33.638+0000 7f85724b4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:07:33.669 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:33.669+0000 7f5bfd678680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:07:33.858 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:33.858+0000 7f85724b4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:07:33.891 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:33.891+0000 7f5bfd678680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:07:34.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:34.362+0000 7f817659c700 1 -- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 msgr2=0x7f8158061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:34.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:34.362+0000 7f817659c700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 0x7f8158061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-31T19:07:34.657 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:34.657+0000 7f85724b4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:07:34.688 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:34.688+0000 7f5bfd678680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:07:34.745 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:34.745+0000 7f85724b4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:07:34.775 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:34.775+0000 7f5bfd678680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:07:34.838 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:34.838+0000 7f85724b4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:07:34.869 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:34.869+0000 7f5bfd678680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:07:35.021 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:35.021+0000 7f85724b4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:07:35.052 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.052+0000 7f5bfd678680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:07:35.109 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:35.108+0000 7f85724b4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:07:35.141 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.140+0000 7f5bfd678680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:07:35.247 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:35.247+0000 7f85724b4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:07:35.280 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.280+0000 7f5bfd678680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:07:35.376 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:35.376+0000 7f85724b4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:07:35.410 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.409+0000 7f5bfd678680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:07:35.719 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:35.719+0000 7f85724b4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:07:35.757 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.757+0000 7f5bfd678680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:07:35.809 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:35.809+0000 7f85724b4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:07:35.847 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.847+0000 7f5bfd678680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:07:35.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:35.859+0000 7f81667fc700 1 -- 172.21.15.72:0/2215428341 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 58) v1 ==== 75113+0+0 (secure 0 0 0) 0x7f81700781d0 con 0x7f8178151da0 2023-08-31T19:07:35.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:35.859+0000 7f81667fc700 1 -- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 msgr2=0x7f8158061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:35.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:35.859+0000 7f81667fc700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 0x7f8158061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:35.927 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.927+0000 7f5b73147700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:35.928 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.927+0000 7f5b73147700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:35.928 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.927+0000 7f5b73147700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:35.928 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.927+0000 7f5b73147700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:35.928 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.927+0000 7f5b73147700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:35.930 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.927+0000 7f5b6f940700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:35.930 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.927+0000 7f5b6f940700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:35.930 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.927+0000 7f5b6f940700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:35.930 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.927+0000 7f5b6f940700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:35.930 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:35.927+0000 7f5b6f940700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:36.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.878+0000 7f81667fc700 1 -- 172.21.15.72:0/2215428341 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mgrmap(e 59) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f8170078550 con 0x7f8178151da0 2023-08-31T19:07:36.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.878+0000 7f81667fc700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 0x7f8158061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:36.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.878+0000 7f81667fc700 1 -- 172.21.15.72:0/2215428341 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f81780af140 con 0x7f815805ef80 2023-08-31T19:07:36.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.881+0000 7f817659c700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 0x7f8158061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:36.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.883+0000 7f817659c700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 0x7f8158061440 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f8168009130 tx=0x7f8168017000).ready entity=mgr.8241 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:36.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.892+0000 7f81667fc700 1 -- 172.21.15.72:0/2215428341 <== mgr.8241 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f81780af140 con 0x7f815805ef80 2023-08-31T19:07:36.893 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path snap_test_dir1 2023-08-31T19:07:36.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.894+0000 7f817cfff700 1 -- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 msgr2=0x7f8158061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:36.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.894+0000 7f817cfff700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 0x7f8158061440 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f8168009130 tx=0x7f8168017000).stop 2023-08-31T19:07:36.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.894+0000 7f817cfff700 1 -- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8178151da0 msgr2=0x7f817814f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.894+0000 7f817cfff700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8178151da0 0x7f817814f660 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f8170009f70 tx=0x7f81700099b0).stop 2023-08-31T19:07:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.894+0000 7f817cfff700 1 -- 172.21.15.72:0/2215428341 shutdown_connections 2023-08-31T19:07:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.894+0000 7f817cfff700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8178151da0 0x7f817814f660 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.894+0000 7f817cfff700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f815805ef80 0x7f8158061440 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:36.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.894+0000 7f817cfff700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8178064d70 0x7f817814cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:36.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.894+0000 7f817cfff700 1 --2- 172.21.15.72:0/2215428341 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81780c5370 0x7f81780c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:36.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.894+0000 7f817cfff700 1 -- 172.21.15.72:0/2215428341 >> 172.21.15.72:0/2215428341 conn(0x7f8178063a90 msgr2=0x7f8178064660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:36.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.895+0000 7f817cfff700 1 -- 172.21.15.72:0/2215428341 shutdown_connections 2023-08-31T19:07:36.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:36.895+0000 7f817cfff700 1 -- 172.21.15.72:0/2215428341 wait complete. 2023-08-31T19:07:36.915 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-31T19:07:36.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-31T19:07:37.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.110+0000 7fd7683ff700 1 Processor -- start 2023-08-31T19:07:37.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.111+0000 7fd7683ff700 1 -- start start 2023-08-31T19:07:37.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.112+0000 7fd7683ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7600c5aa0 0x7fd7600653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.112+0000 7fd7683ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd76013d960 0x7fd760067a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.112+0000 7fd7683ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7600c4f90 con 0x7fd7600c4bb0 2023-08-31T19:07:37.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.112+0000 7fd7683ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7600c6020 con 0x7fd76013d960 2023-08-31T19:07:37.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.112+0000 7fd7683ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7601587f0 con 0x7fd7600c5aa0 2023-08-31T19:07:37.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.112+0000 7fd76619b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd7600c4bb0 0x7fd7600c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58762/0 (socket says 172.21.15.72:58762) 2023-08-31T19:07:37.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.112+0000 7fd76619b700 1 -- 172.21.15.72:0/431524605 learned_addr learned my addr 172.21.15.72:0/431524605 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:37.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd76699c700 1 --2- 172.21.15.72:0/431524605 >> v2:172.21.15.146:3300/0 conn(0x7fd76013d960 0x7fd760067a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:37.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd76599a700 1 --2- 172.21.15.72:0/431524605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7600c5aa0 0x7fd7600653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:37.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 -- 172.21.15.72:0/431524605 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735962618 0 0) 0x7fd7600c4f90 con 0x7fd7600c4bb0 2023-08-31T19:07:37.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 -- 172.21.15.72:0/431524605 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd74c0033f0 con 0x7fd7600c4bb0 2023-08-31T19:07:37.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 -- 172.21.15.72:0/431524605 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1331474121 0 0) 0x7fd74c0033f0 con 0x7fd7600c4bb0 2023-08-31T19:07:37.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 -- 172.21.15.72:0/431524605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7600c5aa0 msgr2=0x7fd7600653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:37.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 --2- 172.21.15.72:0/431524605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7600c5aa0 0x7fd7600653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:37.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 -- 172.21.15.72:0/431524605 >> v2:172.21.15.146:3300/0 conn(0x7fd76013d960 msgr2=0x7fd760067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:37.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 --2- 172.21.15.72:0/431524605 >> v2:172.21.15.146:3300/0 conn(0x7fd76013d960 0x7fd760067a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:37.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 -- 172.21.15.72:0/431524605 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760158ad0 con 0x7fd7600c4bb0 2023-08-31T19:07:37.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 -- 172.21.15.72:0/431524605 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fd75c001470 con 0x7fd7600c4bb0 2023-08-31T19:07:37.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 -- 172.21.15.72:0/431524605 >> v1:172.21.15.72:6789/0 conn(0x7fd7600c4bb0 legacy=0x7fd7600c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:37.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 --2- 172.21.15.72:0/431524605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd74c0038e0 0x7fd74c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 --2- 172.21.15.72:0/431524605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7600c5aa0 0x7fd74c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 --2- 172.21.15.72:0/431524605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74c004b80 0x7fd74c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 -- 172.21.15.72:0/431524605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600c6020 con 0x7fd74c004b80 2023-08-31T19:07:37.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 -- 172.21.15.72:0/431524605 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7601587f0 con 0x7fd74c0038e0 2023-08-31T19:07:37.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.113+0000 7fd765199700 1 -- 172.21.15.72:0/431524605 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c00b8e0 con 0x7fd7600c5aa0 2023-08-31T19:07:37.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.114+0000 7fd76699c700 1 --2- 172.21.15.72:0/431524605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74c004b80 0x7fd74c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:37.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.114+0000 7fd76619b700 1 --2- 172.21.15.72:0/431524605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd74c0038e0 0x7fd74c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:37.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.114+0000 7fd76599a700 1 --2- 172.21.15.72:0/431524605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7600c5aa0 0x7fd74c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:37.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.114+0000 7fd76699c700 1 -- 172.21.15.72:0/431524605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7600c5aa0 msgr2=0x7fd74c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:37.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.114+0000 7fd76699c700 1 --2- 172.21.15.72:0/431524605 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7600c5aa0 0x7fd74c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:37.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.114+0000 7fd76699c700 1 -- 172.21.15.72:0/431524605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd74c0038e0 msgr2=0x7fd74c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:37.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.114+0000 7fd76699c700 1 --2- 172.21.15.72:0/431524605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd74c0038e0 0x7fd74c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:37.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.114+0000 7fd76699c700 1 -- 172.21.15.72:0/431524605 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c0033f0 con 0x7fd74c004b80 2023-08-31T19:07:37.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.114+0000 7fd76699c700 1 --2- 172.21.15.72:0/431524605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74c004b80 0x7fd74c005000 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7fd760061690 tx=0x7fd75800b040).ready entity=mon.0 client_cookie=c040c8b93974062b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:37.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.114+0000 7fd765199700 1 -- 172.21.15.72:0/431524605 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758009ac0 con 0x7fd74c004b80 2023-08-31T19:07:37.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.114+0000 7fd765199700 1 -- 172.21.15.72:0/431524605 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75800f040 con 0x7fd74c004b80 2023-08-31T19:07:37.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.114+0000 7fd765199700 1 -- 172.21.15.72:0/431524605 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75800eca0 con 0x7fd74c004b80 2023-08-31T19:07:37.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.115+0000 7fd7683ff700 1 -- 172.21.15.72:0/431524605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74c004b80 msgr2=0x7fd74c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:37.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.115+0000 7fd7683ff700 1 --2- 172.21.15.72:0/431524605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74c004b80 0x7fd74c005000 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7fd760061690 tx=0x7fd75800b040).stop 2023-08-31T19:07:37.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.115+0000 7fd76699c700 1 -- 172.21.15.72:0/431524605 reap_dead start 2023-08-31T19:07:37.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.115+0000 7fd7683ff700 1 -- 172.21.15.72:0/431524605 shutdown_connections 2023-08-31T19:07:37.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.115+0000 7fd7683ff700 1 -- 172.21.15.72:0/431524605 >> 172.21.15.72:0/431524605 conn(0x7fd760066350 msgr2=0x7fd760066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:37.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.115+0000 7fd7683ff700 1 -- 172.21.15.72:0/431524605 shutdown_connections 2023-08-31T19:07:37.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.115+0000 7fd7683ff700 1 -- 172.21.15.72:0/431524605 wait complete. 2023-08-31T19:07:37.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.116+0000 7fd7683ff700 1 Processor -- start 2023-08-31T19:07:37.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.117+0000 7fd7683ff700 1 -- start start 2023-08-31T19:07:37.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd7683ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74c004b80 0x7fd7601398a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd7683ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600a4840 0x7fd7600c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd7683ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7600c2740 0x7fd7600c0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd7683ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd760139d90 con 0x7fd74c004b80 2023-08-31T19:07:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd7683ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76013c3c0 con 0x7fd7600a4840 2023-08-31T19:07:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd7683ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76013b7b0 con 0x7fd7600c2740 2023-08-31T19:07:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd76619b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74c004b80 0x7fd7601398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:37.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd76619b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74c004b80 0x7fd7601398a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48128/0 (socket says 172.21.15.72:48128) 2023-08-31T19:07:37.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd76619b700 1 -- 172.21.15.72:0/3570143281 learned_addr learned my addr 172.21.15.72:0/3570143281 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:37.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd76599a700 1 --2- 172.21.15.72:0/3570143281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600a4840 0x7fd7600c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:37.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd76699c700 1 --2- 172.21.15.72:0/3570143281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7600c2740 0x7fd7600c0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:37.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd76619b700 1 -- 172.21.15.72:0/3570143281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7600c2740 msgr2=0x7fd7600c0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:37.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd76619b700 1 --2- 172.21.15.72:0/3570143281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7600c2740 0x7fd7600c0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:37.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd76619b700 1 -- 172.21.15.72:0/3570143281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600a4840 msgr2=0x7fd7600c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:37.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd76619b700 1 --2- 172.21.15.72:0/3570143281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600a4840 0x7fd7600c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:37.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd76619b700 1 -- 172.21.15.72:0/3570143281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76013ba90 con 0x7fd74c004b80 2023-08-31T19:07:37.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd76699c700 1 --2- 172.21.15.72:0/3570143281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7600c2740 0x7fd7600c0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:37.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.118+0000 7fd76619b700 1 --2- 172.21.15.72:0/3570143281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74c004b80 0x7fd7601398a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7fd75c0047b0 tx=0x7fd75c001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:37.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.119+0000 7fd7567fc700 1 -- 172.21.15.72:0/3570143281 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c00f610 con 0x7fd74c004b80 2023-08-31T19:07:37.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.119+0000 7fd7567fc700 1 -- 172.21.15.72:0/3570143281 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c00f770 con 0x7fd74c004b80 2023-08-31T19:07:37.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.119+0000 7fd7683ff700 1 -- 172.21.15.72:0/3570143281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76013bd70 con 0x7fd74c004b80 2023-08-31T19:07:37.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.119+0000 7fd7567fc700 1 -- 172.21.15.72:0/3570143281 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c00faf0 con 0x7fd74c004b80 2023-08-31T19:07:37.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.119+0000 7fd7683ff700 1 -- 172.21.15.72:0/3570143281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7600a4cc0 con 0x7fd74c004b80 2023-08-31T19:07:37.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.120+0000 7fd7683ff700 1 -- 172.21.15.72:0/3570143281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76006c6b0 con 0x7fd74c004b80 2023-08-31T19:07:37.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.121+0000 7fd7567fc700 1 -- 172.21.15.72:0/3570143281 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 59) v1 ==== 75183+0+0 (secure 0 0 0) 0x7fd75c01d3b0 con 0x7fd74c004b80 2023-08-31T19:07:37.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.121+0000 7fd7567fc700 1 --2- 172.21.15.72:0/3570143281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd74405ed40 0x7fd744061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.122+0000 7fd7567fc700 1 -- 172.21.15.72:0/3570143281 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fd75c0798e0 con 0x7fd74c004b80 2023-08-31T19:07:37.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.122+0000 7fd76599a700 1 --2- 172.21.15.72:0/3570143281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd74405ed40 0x7fd744061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:37.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.122+0000 7fd76599a700 1 --2- 172.21.15.72:0/3570143281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd74405ed40 0x7fd744061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd760157530 tx=0x7fd750008040).ready entity=mgr.8241 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:37.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.126+0000 7fd7567fc700 1 -- 172.21.15.72:0/3570143281 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd75c04ac00 con 0x7fd74c004b80 2023-08-31T19:07:37.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.323+0000 7fd7683ff700 1 -- 172.21.15.72:0/3570143281 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd76013c500 con 0x7fd74405ed40 2023-08-31T19:07:37.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.327+0000 7fd7567fc700 1 -- 172.21.15.72:0/3570143281 <== mgr.8241 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd750009e70 con 0x7fd74405ed40 2023-08-31T19:07:37.328 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path snap_test_dir1 2023-08-31T19:07:37.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.329+0000 7fd7683ff700 1 -- 172.21.15.72:0/3570143281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd74405ed40 msgr2=0x7fd744061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:37.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.329+0000 7fd7683ff700 1 --2- 172.21.15.72:0/3570143281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd74405ed40 0x7fd744061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd760157530 tx=0x7fd750008040).stop 2023-08-31T19:07:37.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.329+0000 7fd7683ff700 1 -- 172.21.15.72:0/3570143281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74c004b80 msgr2=0x7fd7601398a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.329+0000 7fd7683ff700 1 --2- 172.21.15.72:0/3570143281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74c004b80 0x7fd7601398a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7fd75c0047b0 tx=0x7fd75c001e90).stop 2023-08-31T19:07:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.330+0000 7fd7683ff700 1 -- 172.21.15.72:0/3570143281 shutdown_connections 2023-08-31T19:07:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.330+0000 7fd7683ff700 1 --2- 172.21.15.72:0/3570143281 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd7600c2740 0x7fd7600c0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.330+0000 7fd7683ff700 1 --2- 172.21.15.72:0/3570143281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd74c004b80 0x7fd7601398a0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.330+0000 7fd7683ff700 1 --2- 172.21.15.72:0/3570143281 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd74405ed40 0x7fd744061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.330+0000 7fd7683ff700 1 --2- 172.21.15.72:0/3570143281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600a4840 0x7fd7600c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.330+0000 7fd7683ff700 1 -- 172.21.15.72:0/3570143281 >> 172.21.15.72:0/3570143281 conn(0x7fd760066350 msgr2=0x7fd7600bef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.330+0000 7fd7683ff700 1 -- 172.21.15.72:0/3570143281 shutdown_connections 2023-08-31T19:07:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.330+0000 7fd7683ff700 1 -- 172.21.15.72:0/3570143281 wait complete. 2023-08-31T19:07:37.347 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-31T19:07:37.348 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-08-31T19:07:37.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.540+0000 7f7e85fff700 1 Processor -- start 2023-08-31T19:07:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.540+0000 7f7e85fff700 1 -- start start 2023-08-31T19:07:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.541+0000 7f7e85fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7e80157710 0x7f7e80069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.541+0000 7f7e85fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e800c2260 con 0x7f7e80062650 2023-08-31T19:07:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.541+0000 7f7e85fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e80062b80 con 0x7f7e80068c20 2023-08-31T19:07:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.541+0000 7f7e85fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e80062e60 con 0x7f7e80157710 2023-08-31T19:07:37.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.542+0000 7f7e7effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7e80062650 0x7f7e80157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58764/0 (socket says 172.21.15.72:58764) 2023-08-31T19:07:37.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.542+0000 7f7e7effd700 1 -- 172.21.15.72:0/778421812 learned_addr learned my addr 172.21.15.72:0/778421812 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:37.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.542+0000 7f7e7ffff700 1 --2- 172.21.15.72:0/778421812 >> v2:172.21.15.146:3300/0 conn(0x7f7e80157710 0x7f7e80069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:37.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.542+0000 7f7e7e7fc700 1 -- 172.21.15.72:0/778421812 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482863302 0 0) 0x7f7e800c2260 con 0x7f7e80062650 2023-08-31T19:07:37.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.542+0000 7f7e7e7fc700 1 -- 172.21.15.72:0/778421812 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e680033f0 con 0x7f7e80062650 2023-08-31T19:07:37.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.542+0000 7f7e7e7fc700 1 -- 172.21.15.72:0/778421812 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4062317294 0 0) 0x7f7e680033f0 con 0x7f7e80062650 2023-08-31T19:07:37.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.542+0000 7f7e7e7fc700 1 -- 172.21.15.72:0/778421812 >> v2:172.21.15.146:3300/0 conn(0x7f7e80157710 msgr2=0x7f7e80069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:37.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.542+0000 7f7e7e7fc700 1 --2- 172.21.15.72:0/778421812 >> v2:172.21.15.146:3300/0 conn(0x7f7e80157710 0x7f7e80069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:37.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.542+0000 7f7e7e7fc700 1 -- 172.21.15.72:0/778421812 >> v1:172.21.15.146:6789/0 conn(0x7f7e80068c20 legacy=0x7f7e800c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:37.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.542+0000 7f7e7e7fc700 1 -- 172.21.15.72:0/778421812 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e80063140 con 0x7f7e80062650 2023-08-31T19:07:37.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.542+0000 7f7e7e7fc700 1 -- 172.21.15.72:0/778421812 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f7e74001470 con 0x7f7e80062650 2023-08-31T19:07:37.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.542+0000 7f7e7e7fc700 1 -- 172.21.15.72:0/778421812 >> v1:172.21.15.72:6789/0 conn(0x7f7e80062650 legacy=0x7f7e80157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:37.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7e7fc700 1 --2- 172.21.15.72:0/778421812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e680038e0 0x7f7e68003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7e7fc700 1 --2- 172.21.15.72:0/778421812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e68004690 0x7f7e68004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7e7fc700 1 --2- 172.21.15.72:0/778421812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e68005000 0x7f7e6800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7e7fc700 1 -- 172.21.15.72:0/778421812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80062e60 con 0x7f7e68005000 2023-08-31T19:07:37.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7e7fc700 1 -- 172.21.15.72:0/778421812 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6800beb0 con 0x7f7e68004690 2023-08-31T19:07:37.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7e7fc700 1 -- 172.21.15.72:0/778421812 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6800c070 con 0x7f7e680038e0 2023-08-31T19:07:37.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7ffff700 1 --2- 172.21.15.72:0/778421812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e68005000 0x7f7e6800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:37.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7f7fe700 1 --2- 172.21.15.72:0/778421812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e680038e0 0x7f7e68003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:37.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7effd700 1 --2- 172.21.15.72:0/778421812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e68004690 0x7f7e68004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:37.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7ffff700 1 -- 172.21.15.72:0/778421812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e680038e0 msgr2=0x7f7e68003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:37.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7ffff700 1 --2- 172.21.15.72:0/778421812 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e680038e0 0x7f7e68003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:37.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7ffff700 1 -- 172.21.15.72:0/778421812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e68004690 msgr2=0x7f7e68004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:37.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7ffff700 1 --2- 172.21.15.72:0/778421812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e68004690 0x7f7e68004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:37.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7ffff700 1 -- 172.21.15.72:0/778421812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e680033f0 con 0x7f7e68005000 2023-08-31T19:07:37.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7ffff700 1 -- 172.21.15.72:0/778421812 reap_dead start 2023-08-31T19:07:37.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7ffff700 1 --2- 172.21.15.72:0/778421812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e68005000 0x7f7e6800b8e0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f7e80157b70 tx=0x7f7e7800b040).ready entity=mon.0 client_cookie=f7bfff985d4ebbd9 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:37.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.543+0000 7f7e7e7fc700 1 -- 172.21.15.72:0/778421812 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e78017070 con 0x7f7e68005000 2023-08-31T19:07:37.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.544+0000 7f7e7e7fc700 1 -- 172.21.15.72:0/778421812 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7800f040 con 0x7f7e68005000 2023-08-31T19:07:37.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.544+0000 7f7e7e7fc700 1 -- 172.21.15.72:0/778421812 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7800eca0 con 0x7f7e68005000 2023-08-31T19:07:37.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.544+0000 7f7e85fff700 1 -- 172.21.15.72:0/778421812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e68005000 msgr2=0x7f7e6800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:37.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.544+0000 7f7e85fff700 1 --2- 172.21.15.72:0/778421812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e68005000 0x7f7e6800b8e0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f7e80157b70 tx=0x7f7e7800b040).stop 2023-08-31T19:07:37.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.544+0000 7f7e85fff700 1 -- 172.21.15.72:0/778421812 shutdown_connections 2023-08-31T19:07:37.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.544+0000 7f7e85fff700 1 --2- 172.21.15.72:0/778421812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e68005000 0x7f7e6800b8e0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:37.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.544+0000 7f7e85fff700 1 -- 172.21.15.72:0/778421812 >> 172.21.15.72:0/778421812 conn(0x7f7e800c72f0 msgr2=0x7f7e800c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:37.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.544+0000 7f7e85fff700 1 -- 172.21.15.72:0/778421812 shutdown_connections 2023-08-31T19:07:37.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.544+0000 7f7e85fff700 1 -- 172.21.15.72:0/778421812 wait complete. 2023-08-31T19:07:37.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.546+0000 7f7e85fff700 1 Processor -- start 2023-08-31T19:07:37.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.546+0000 7f7e85fff700 1 -- start start 2023-08-31T19:07:37.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.548+0000 7f7e85fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e68005000 0x7f7e80147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.548+0000 7f7e85fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e801509e0 0x7f7e8014cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.548+0000 7f7e85fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8014cfc0 0x7f7e800c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.548+0000 7f7e85fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8014e090 con 0x7f7e801509e0 2023-08-31T19:07:37.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.548+0000 7f7e85fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80148120 con 0x7f7e8014cfc0 2023-08-31T19:07:37.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.548+0000 7f7e85fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8014d480 con 0x7f7e68005000 2023-08-31T19:07:37.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.548+0000 7f7e7effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e801509e0 0x7f7e8014cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:37.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.548+0000 7f7e7effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e801509e0 0x7f7e8014cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48140/0 (socket says 172.21.15.72:48140) 2023-08-31T19:07:37.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.548+0000 7f7e7effd700 1 -- 172.21.15.72:0/1033856770 learned_addr learned my addr 172.21.15.72:0/1033856770 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:37.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.548+0000 7f7e7effd700 1 -- 172.21.15.72:0/1033856770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e68005000 msgr2=0x7f7e80147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:37.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.548+0000 7f7e7effd700 1 --2- 172.21.15.72:0/1033856770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e68005000 0x7f7e80147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:37.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.548+0000 7f7e7effd700 1 -- 172.21.15.72:0/1033856770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8014cfc0 msgr2=0x7f7e800c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:37.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.548+0000 7f7e7effd700 1 --2- 172.21.15.72:0/1033856770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8014cfc0 0x7f7e800c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:37.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.548+0000 7f7e7effd700 1 -- 172.21.15.72:0/1033856770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8014d760 con 0x7f7e801509e0 2023-08-31T19:07:37.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.549+0000 7f7e7effd700 1 --2- 172.21.15.72:0/1033856770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e801509e0 0x7f7e8014cad0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f7e7400e780 tx=0x7f7e74000cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:37.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.549+0000 7f7e677fe700 1 -- 172.21.15.72:0/1033856770 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74010490 con 0x7f7e801509e0 2023-08-31T19:07:37.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.549+0000 7f7e677fe700 1 -- 172.21.15.72:0/1033856770 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e74010040 con 0x7f7e801509e0 2023-08-31T19:07:37.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.549+0000 7f7e85fff700 1 -- 172.21.15.72:0/1033856770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8014da40 con 0x7f7e801509e0 2023-08-31T19:07:37.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.549+0000 7f7e677fe700 1 -- 172.21.15.72:0/1033856770 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74010800 con 0x7f7e801509e0 2023-08-31T19:07:37.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.549+0000 7f7e85fff700 1 -- 172.21.15.72:0/1033856770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e800c5b00 con 0x7f7e801509e0 2023-08-31T19:07:37.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.550+0000 7f7e85fff700 1 -- 172.21.15.72:0/1033856770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8014e400 con 0x7f7e801509e0 2023-08-31T19:07:37.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.551+0000 7f7e677fe700 1 -- 172.21.15.72:0/1033856770 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 59) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f7e74010bb0 con 0x7f7e801509e0 2023-08-31T19:07:37.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.551+0000 7f7e677fe700 1 --2- 172.21.15.72:0/1033856770 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7e6c05ed40 0x7f7e6c061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:37.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.552+0000 7f7e677fe700 1 -- 172.21.15.72:0/1033856770 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f7e74079720 con 0x7f7e801509e0 2023-08-31T19:07:37.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.552+0000 7f7e7f7fe700 1 --2- 172.21.15.72:0/1033856770 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7e6c05ed40 0x7f7e6c061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:37.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.552+0000 7f7e7f7fe700 1 --2- 172.21.15.72:0/1033856770 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7e6c05ed40 0x7f7e6c061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7e70007fd0 tx=0x7f7e70009040).ready entity=mgr.8241 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:37.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.555+0000 7f7e677fe700 1 -- 172.21.15.72:0/1033856770 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7e7404a9f0 con 0x7f7e801509e0 2023-08-31T19:07:37.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.755+0000 7f7e85fff700 1 -- 172.21.15.72:0/1033856770 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e8014e1d0 con 0x7f7e6c05ed40 2023-08-31T19:07:37.757 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:37.757+0000 7f5b7a956700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-08-31T19:07:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:37.757+0000 7f7e677fe700 1 -- 172.21.15.72:0/1033856770 <== mgr.8241 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f7e8014e1d0 con 0x7f7e6c05ed40 2023-08-31T19:07:37.758 INFO:teuthology.orchestra.run.smithi072.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-08-31T19:07:37.766 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-08-31T19:07:37.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:07:37.768 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-31T19:07:37.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-31T19:07:38.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.010+0000 7feeaa5ff700 1 Processor -- start 2023-08-31T19:07:38.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.010+0000 7feeaa5ff700 1 -- start start 2023-08-31T19:07:38.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.011+0000 7feeaa5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feea4154030 0x7feea4154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:38.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.011+0000 7feeaa5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea40c6ed0 con 0x7feea40c06b0 2023-08-31T19:07:38.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.011+0000 7feeaa5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea40c68c0 con 0x7feea40c7360 2023-08-31T19:07:38.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.011+0000 7feeaa5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea40c66e0 con 0x7feea4154030 2023-08-31T19:07:38.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.012+0000 7feea3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feea4154030 0x7feea4154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:38.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.012+0000 7feea3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feea4154030 0x7feea4154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48144/0 (socket says 172.21.15.72:48144) 2023-08-31T19:07:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.012+0000 7feea3fff700 1 -- 172.21.15.72:0/527916606 learned_addr learned my addr 172.21.15.72:0/527916606 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.012+0000 7feea37fe700 1 --1- 172.21.15.72:0/527916606 >> v1:172.21.15.72:6789/0 conn(0x7feea40c06b0 0x7feea40aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58780/0 (socket says 172.21.15.72:58780) 2023-08-31T19:07:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.012+0000 7feea3fff700 1 -- 172.21.15.72:0/527916606 >> v1:172.21.15.146:6789/0 conn(0x7feea40c7360 legacy=0x7feea4063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.012+0000 7feea3fff700 1 -- 172.21.15.72:0/527916606 >> v1:172.21.15.72:6789/0 conn(0x7feea40c06b0 legacy=0x7feea40aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.012+0000 7feea2ffd700 1 -- 172.21.15.72:0/527916606 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059404528 0 0) 0x7feea40c6ed0 con 0x7feea40c06b0 2023-08-31T19:07:38.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.012+0000 7feea3fff700 1 -- 172.21.15.72:0/527916606 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40c0f30 con 0x7feea4154030 2023-08-31T19:07:38.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.012+0000 7feea3fff700 1 --2- 172.21.15.72:0/527916606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea4154030 0x7feea4154410 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fee94006fd0 tx=0x7fee940090f0).ready entity=mon.0 client_cookie=699bec3950f776f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:38.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.012+0000 7feea2ffd700 1 -- 172.21.15.72:0/527916606 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9400b600 con 0x7feea4154030 2023-08-31T19:07:38.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.013+0000 7feea2ffd700 1 -- 172.21.15.72:0/527916606 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9400b760 con 0x7feea4154030 2023-08-31T19:07:38.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.013+0000 7feea2ffd700 1 -- 172.21.15.72:0/527916606 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9400bb00 con 0x7feea4154030 2023-08-31T19:07:38.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.013+0000 7feeaa5ff700 1 -- 172.21.15.72:0/527916606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea4154030 msgr2=0x7feea4154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:38.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.013+0000 7feeaa5ff700 1 --2- 172.21.15.72:0/527916606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea4154030 0x7feea4154410 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7fee94006fd0 tx=0x7fee940090f0).stop 2023-08-31T19:07:38.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.013+0000 7feeaa5ff700 1 -- 172.21.15.72:0/527916606 shutdown_connections 2023-08-31T19:07:38.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.013+0000 7feeaa5ff700 1 --2- 172.21.15.72:0/527916606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea4154030 0x7feea4154410 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:38.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.013+0000 7feeaa5ff700 1 -- 172.21.15.72:0/527916606 >> 172.21.15.72:0/527916606 conn(0x7feea405eb60 msgr2=0x7feea40cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:38.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.013+0000 7feeaa5ff700 1 -- 172.21.15.72:0/527916606 shutdown_connections 2023-08-31T19:07:38.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.013+0000 7feeaa5ff700 1 -- 172.21.15.72:0/527916606 wait complete. 2023-08-31T19:07:38.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.015+0000 7feeaa5ff700 1 Processor -- start 2023-08-31T19:07:38.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.015+0000 7feeaa5ff700 1 -- start start 2023-08-31T19:07:38.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feeaa5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feea40c06b0 0x7feea4164c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:38.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feeaa5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feea40c7360 0x7feea40c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:38.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feeaa5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea4154030 0x7feea40aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feeaa5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea40ae620 con 0x7feea4154030 2023-08-31T19:07:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feeaa5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea40add80 con 0x7feea40c7360 2023-08-31T19:07:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feeaa5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea40afd90 con 0x7feea40c06b0 2023-08-31T19:07:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feea8b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea4154030 0x7feea40aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feea8b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea4154030 0x7feea40aeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48152/0 (socket says 172.21.15.72:48152) 2023-08-31T19:07:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feea8b9c700 1 -- 172.21.15.72:0/1267582075 learned_addr learned my addr 172.21.15.72:0/1267582075 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feea3fff700 1 --2- 172.21.15.72:0/1267582075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feea40c06b0 0x7feea4164c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feea37fe700 1 --2- 172.21.15.72:0/1267582075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feea40c7360 0x7feea40c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feea8b9c700 1 -- 172.21.15.72:0/1267582075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feea40c06b0 msgr2=0x7feea4164c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feea8b9c700 1 --2- 172.21.15.72:0/1267582075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feea40c06b0 0x7feea4164c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:38.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feea8b9c700 1 -- 172.21.15.72:0/1267582075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feea40c7360 msgr2=0x7feea40c32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:38.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feea8b9c700 1 --2- 172.21.15.72:0/1267582075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feea40c7360 0x7feea40c32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:38.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.016+0000 7feea8b9c700 1 -- 172.21.15.72:0/1267582075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94009370 con 0x7feea4154030 2023-08-31T19:07:38.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.017+0000 7feea3fff700 1 --2- 172.21.15.72:0/1267582075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feea40c06b0 0x7feea4164c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:38.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.017+0000 7feea8b9c700 1 --2- 172.21.15.72:0/1267582075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea4154030 0x7feea40aeab0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fee9c00c810 tx=0x7fee9c002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:38.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.017+0000 7fee8bfff700 1 -- 172.21.15.72:0/1267582075 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c010510 con 0x7feea4154030 2023-08-31T19:07:38.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.017+0000 7fee8bfff700 1 -- 172.21.15.72:0/1267582075 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c010690 con 0x7feea4154030 2023-08-31T19:07:38.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.017+0000 7feeaa5ff700 1 -- 172.21.15.72:0/1267582075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea40adfd0 con 0x7feea4154030 2023-08-31T19:07:38.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.017+0000 7fee8bfff700 1 -- 172.21.15.72:0/1267582075 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c010a50 con 0x7feea4154030 2023-08-31T19:07:38.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.017+0000 7feeaa5ff700 1 -- 172.21.15.72:0/1267582075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea4165130 con 0x7feea4154030 2023-08-31T19:07:38.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.018+0000 7feeaa5ff700 1 -- 172.21.15.72:0/1267582075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea40ae7d0 con 0x7feea4154030 2023-08-31T19:07:38.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.019+0000 7fee8bfff700 1 -- 172.21.15.72:0/1267582075 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 60) v1 ==== 75448+0+0 (secure 0 0 0) 0x7fee9c01b400 con 0x7feea4154030 2023-08-31T19:07:38.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.019+0000 7fee8bfff700 1 --2- 172.21.15.72:0/1267582075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fee9005f010 0x7fee900614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:38.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.020+0000 7fee8bfff700 1 -- 172.21.15.72:0/1267582075 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fee9c07a4d0 con 0x7feea4154030 2023-08-31T19:07:38.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.020+0000 7feea3fff700 1 --2- 172.21.15.72:0/1267582075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fee9005f010 0x7fee900614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:38.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.020+0000 7feea3fff700 1 --2- 172.21.15.72:0/1267582075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fee9005f010 0x7fee900614d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fee94006fd0 tx=0x7fee94017000).ready entity=mgr.8241 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:38.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.024+0000 7fee8bfff700 1 -- 172.21.15.72:0/1267582075 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feea40ae7d0 con 0x7feea4154030 2023-08-31T19:07:38.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.235+0000 7feeaa5ff700 1 -- 172.21.15.72:0/1267582075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7feea40ae7d0 con 0x7feea4154030 2023-08-31T19:07:38.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.892+0000 7fee8bfff700 1 -- 172.21.15.72:0/1267582075 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 61) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fee9c077c30 con 0x7feea4154030 2023-08-31T19:07:38.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.893+0000 7fee8bfff700 1 -- 172.21.15.72:0/1267582075 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v61) v1 ==== 93+0+0 (secure 0 0 0) 0x7fee9c072060 con 0x7feea4154030 2023-08-31T19:07:38.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.897+0000 7feeaa5ff700 1 -- 172.21.15.72:0/1267582075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fee9005f010 msgr2=0x7fee900614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:38.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.897+0000 7feeaa5ff700 1 --2- 172.21.15.72:0/1267582075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fee9005f010 0x7fee900614d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fee94006fd0 tx=0x7fee94017000).stop 2023-08-31T19:07:38.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.897+0000 7feeaa5ff700 1 -- 172.21.15.72:0/1267582075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea4154030 msgr2=0x7feea40aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:38.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.897+0000 7feeaa5ff700 1 --2- 172.21.15.72:0/1267582075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea4154030 0x7feea40aeab0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7fee9c00c810 tx=0x7fee9c002560).stop 2023-08-31T19:07:38.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.897+0000 7feeaa5ff700 1 -- 172.21.15.72:0/1267582075 shutdown_connections 2023-08-31T19:07:38.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.897+0000 7feeaa5ff700 1 --2- 172.21.15.72:0/1267582075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feea4154030 0x7feea40aeab0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:38.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.897+0000 7feeaa5ff700 1 --2- 172.21.15.72:0/1267582075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7feea40c06b0 0x7feea4164c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:38.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.897+0000 7feeaa5ff700 1 --2- 172.21.15.72:0/1267582075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fee9005f010 0x7fee900614d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:38.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.897+0000 7feeaa5ff700 1 --2- 172.21.15.72:0/1267582075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feea40c7360 0x7feea40c32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:38.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.897+0000 7feeaa5ff700 1 -- 172.21.15.72:0/1267582075 >> 172.21.15.72:0/1267582075 conn(0x7feea405eb60 msgr2=0x7feea40ad450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:38.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.897+0000 7feeaa5ff700 1 -- 172.21.15.72:0/1267582075 shutdown_connections 2023-08-31T19:07:38.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:38.897+0000 7feeaa5ff700 1 -- 172.21.15.72:0/1267582075 wait complete. 2023-08-31T19:07:38.924 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:07:38.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:07:39.047 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:07:39.108 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:39.107+0000 7f6a3ad07680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:07:39.127 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:39.126+0000 7f3321a65680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:07:39.144 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:07:39.145 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-31T19:07:39.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:07:39.145 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-31T19:07:39.189 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:39.189+0000 7f6a3ad07680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:07:39.207 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:39.207+0000 7f3321a65680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:07:39.237 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T19:07:39.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:07:39.238 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T19:07:39.286 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:07:39.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.480+0000 7ff19cfff700 1 Processor -- start 2023-08-31T19:07:39.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.480+0000 7ff19cfff700 1 -- start start 2023-08-31T19:07:39.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.482+0000 7ff19cfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff19815ad40 0x7ff19815d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:39.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.482+0000 7ff19cfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1980c5c70 con 0x7ff1981523a0 2023-08-31T19:07:39.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.482+0000 7ff19cfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff198063470 con 0x7ff1980bc300 2023-08-31T19:07:39.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.482+0000 7ff19cfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980be1c0 con 0x7ff19815ad40 2023-08-31T19:07:39.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.482+0000 7ff19659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff1981523a0 0x7ff198062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58802/0 (socket says 172.21.15.72:58802) 2023-08-31T19:07:39.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.482+0000 7ff19659c700 1 -- 172.21.15.72:0/2555458814 learned_addr learned my addr 172.21.15.72:0/2555458814 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:39.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.482+0000 7ff196d9d700 1 --2- 172.21.15.72:0/2555458814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff19815ad40 0x7ff19815d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:39.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.482+0000 7ff19559a700 1 -- 172.21.15.72:0/2555458814 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671574192 0 0) 0x7ff1980c5c70 con 0x7ff1981523a0 2023-08-31T19:07:39.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.482+0000 7ff19559a700 1 -- 172.21.15.72:0/2555458814 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1800033f0 con 0x7ff1981523a0 2023-08-31T19:07:39.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.482+0000 7ff19559a700 1 -- 172.21.15.72:0/2555458814 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412570931 0 0) 0x7ff198063470 con 0x7ff1980bc300 2023-08-31T19:07:39.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.483+0000 7ff19559a700 1 -- 172.21.15.72:0/2555458814 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1980c5c70 con 0x7ff1980bc300 2023-08-31T19:07:39.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.483+0000 7ff196d9d700 1 -- 172.21.15.72:0/2555458814 >> v1:172.21.15.146:6789/0 conn(0x7ff1980bc300 legacy=0x7ff198062d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:39.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.483+0000 7ff196d9d700 1 -- 172.21.15.72:0/2555458814 >> v1:172.21.15.72:6789/0 conn(0x7ff1981523a0 legacy=0x7ff198062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:39.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.483+0000 7ff196d9d700 1 -- 172.21.15.72:0/2555458814 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1980c7110 con 0x7ff19815ad40 2023-08-31T19:07:39.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.483+0000 7ff196d9d700 1 --2- 172.21.15.72:0/2555458814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff19815ad40 0x7ff19815d130 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7ff190009e90 tx=0x7ff190009780).ready entity=mon.2 client_cookie=6d4ed1626defa657 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:39.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.483+0000 7ff19559a700 1 -- 172.21.15.72:0/2555458814 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19000e070 con 0x7ff19815ad40 2023-08-31T19:07:39.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.483+0000 7ff19559a700 1 -- 172.21.15.72:0/2555458814 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19000bab0 con 0x7ff19815ad40 2023-08-31T19:07:39.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.483+0000 7ff19559a700 1 -- 172.21.15.72:0/2555458814 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19000be30 con 0x7ff19815ad40 2023-08-31T19:07:39.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.484+0000 7ff19cfff700 1 -- 172.21.15.72:0/2555458814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff19815ad40 msgr2=0x7ff19815d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:39.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.484+0000 7ff19cfff700 1 --2- 172.21.15.72:0/2555458814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff19815ad40 0x7ff19815d130 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7ff190009e90 tx=0x7ff190009780).stop 2023-08-31T19:07:39.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.484+0000 7ff19cfff700 1 -- 172.21.15.72:0/2555458814 shutdown_connections 2023-08-31T19:07:39.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.484+0000 7ff19cfff700 1 --2- 172.21.15.72:0/2555458814 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff19815ad40 0x7ff19815d130 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:39.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.484+0000 7ff19cfff700 1 -- 172.21.15.72:0/2555458814 >> 172.21.15.72:0/2555458814 conn(0x7ff1980c7e70 msgr2=0x7ff1980c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:39.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.484+0000 7ff19cfff700 1 -- 172.21.15.72:0/2555458814 shutdown_connections 2023-08-31T19:07:39.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.484+0000 7ff19cfff700 1 -- 172.21.15.72:0/2555458814 wait complete. 2023-08-31T19:07:39.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.485+0000 7ff19cfff700 1 Processor -- start 2023-08-31T19:07:39.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.486+0000 7ff19cfff700 1 -- start start 2023-08-31T19:07:39.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.486+0000 7ff19cfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1980bc300 0x7ff19813fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:39.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.486+0000 7ff19cfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1981523a0 0x7ff1980be440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:39.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.487+0000 7ff19cfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff19815ad40 0x7ff1980abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:39.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.487+0000 7ff19cfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980bf9c0 con 0x7ff19815ad40 2023-08-31T19:07:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.487+0000 7ff19cfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980bfe50 con 0x7ff1981523a0 2023-08-31T19:07:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.487+0000 7ff19cfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980bedb0 con 0x7ff1980bc300 2023-08-31T19:07:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.487+0000 7ff19659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1980bc300 0x7ff19813fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.487+0000 7ff196d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff19815ad40 0x7ff1980abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:39.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.487+0000 7ff19659c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1980bc300 0x7ff19813fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:37370/0 (socket says 172.21.15.72:37370) 2023-08-31T19:07:39.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.487+0000 7ff19659c700 1 -- 172.21.15.72:0/122528284 learned_addr learned my addr 172.21.15.72:0/122528284 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:39.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.487+0000 7ff195d9b700 1 --2- 172.21.15.72:0/122528284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1981523a0 0x7ff1980be440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:39.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.487+0000 7ff196d9d700 1 -- 172.21.15.72:0/122528284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1980bc300 msgr2=0x7ff19813fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:39.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.487+0000 7ff196d9d700 1 --2- 172.21.15.72:0/122528284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1980bc300 0x7ff19813fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:39.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.487+0000 7ff196d9d700 1 -- 172.21.15.72:0/122528284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1981523a0 msgr2=0x7ff1980be440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:39.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.487+0000 7ff196d9d700 1 --2- 172.21.15.72:0/122528284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1981523a0 0x7ff1980be440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:39.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.487+0000 7ff196d9d700 1 -- 172.21.15.72:0/122528284 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff190009a20 con 0x7ff19815ad40 2023-08-31T19:07:39.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.487+0000 7ff196d9d700 1 --2- 172.21.15.72:0/122528284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff19815ad40 0x7ff1980abcf0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7ff190014000 tx=0x7ff1980c72a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:39.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.488+0000 7ff1867fc700 1 -- 172.21.15.72:0/122528284 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190021070 con 0x7ff19815ad40 2023-08-31T19:07:39.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.488+0000 7ff1867fc700 1 -- 172.21.15.72:0/122528284 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff190013e80 con 0x7ff19815ad40 2023-08-31T19:07:39.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.488+0000 7ff1867fc700 1 -- 172.21.15.72:0/122528284 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19001d880 con 0x7ff19815ad40 2023-08-31T19:07:39.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.488+0000 7ff19cfff700 1 -- 172.21.15.72:0/122528284 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1980bf090 con 0x7ff19815ad40 2023-08-31T19:07:39.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.488+0000 7ff19cfff700 1 -- 172.21.15.72:0/122528284 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1980bf650 con 0x7ff19815ad40 2023-08-31T19:07:39.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.489+0000 7ff19cfff700 1 -- 172.21.15.72:0/122528284 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1980bfb30 con 0x7ff19815ad40 2023-08-31T19:07:39.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.490+0000 7ff1867fc700 1 -- 172.21.15.72:0/122528284 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 61) v1 ==== 75431+0+0 (secure 0 0 0) 0x7ff190003040 con 0x7ff19815ad40 2023-08-31T19:07:39.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.490+0000 7ff1867fc700 1 --2- 172.21.15.72:0/122528284 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff17805efc0 0x7ff178061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:39.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.490+0000 7ff19659c700 1 -- 172.21.15.72:0/122528284 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff17805efc0 msgr2=0x7ff178061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:39.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.490+0000 7ff1867fc700 1 -- 172.21.15.72:0/122528284 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7007+0+0 (secure 0 0 0) 0x7ff19007b8d0 con 0x7ff19815ad40 2023-08-31T19:07:39.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.491+0000 7ff19659c700 1 --2- 172.21.15.72:0/122528284 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff17805efc0 0x7ff178061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:39.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.495+0000 7ff1867fc700 1 -- 172.21.15.72:0/122528284 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff19004c5c0 con 0x7ff19815ad40 2023-08-31T19:07:39.517 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:39.517+0000 7f6a3ad07680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:07:39.555 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:39.555+0000 7f3321a65680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:07:39.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.692+0000 7ff19659c700 1 -- 172.21.15.72:0/122528284 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff17805efc0 msgr2=0x7ff178061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:39.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.692+0000 7ff19659c700 1 --2- 172.21.15.72:0/122528284 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff17805efc0 0x7ff178061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:07:39.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.712+0000 7ff19cfff700 1 -- 172.21.15.72:0/122528284 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1980bca70 con 0x7ff19815ad40 2023-08-31T19:07:39.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.712+0000 7ff1867fc700 1 -- 172.21.15.72:0/122528284 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4497 (secure 0 0 0) 0x7ff19004fbe0 con 0x7ff19815ad40 2023-08-31T19:07:39.713 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:39.713 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6623,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2723616156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2723616156},{"type":"v1","addr":"172.21.15.72:6836","nonce":2723616156}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1506898460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1506898460},{"type":"v1","addr":"172.21.15.146:6834","nonce":1506898460}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1176286638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1176286638},{"type":"v1","addr":"172.21.15.146:6835","nonce":1176286638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:07:21.608188+0000","modified":"2023-08-31T19:07:24.626195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8058},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8058":{"gid":8058,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/1400178853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1400178853},{"type":"v1","addr":"172.21.15.72:6837","nonce":1400178853}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-31T19:07:39.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.714+0000 7ff19cfff700 1 -- 172.21.15.72:0/122528284 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff17805efc0 msgr2=0x7ff178061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:39.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.714+0000 7ff19cfff700 1 --2- 172.21.15.72:0/122528284 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff17805efc0 0x7ff178061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:39.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.714+0000 7ff19cfff700 1 -- 172.21.15.72:0/122528284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff19815ad40 msgr2=0x7ff1980abcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:39.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.714+0000 7ff19cfff700 1 --2- 172.21.15.72:0/122528284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff19815ad40 0x7ff1980abcf0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7ff190014000 tx=0x7ff1980c72a0).stop 2023-08-31T19:07:39.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.714+0000 7ff19cfff700 1 -- 172.21.15.72:0/122528284 shutdown_connections 2023-08-31T19:07:39.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.714+0000 7ff19cfff700 1 --2- 172.21.15.72:0/122528284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff19815ad40 0x7ff1980abcf0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:39.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.714+0000 7ff19cfff700 1 --2- 172.21.15.72:0/122528284 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff1980bc300 0x7ff19813fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:39.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.714+0000 7ff19cfff700 1 --2- 172.21.15.72:0/122528284 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff17805efc0 0x7ff178061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:39.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.714+0000 7ff19cfff700 1 --2- 172.21.15.72:0/122528284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1981523a0 0x7ff1980be440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:39.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.714+0000 7ff19cfff700 1 -- 172.21.15.72:0/122528284 >> 172.21.15.72:0/122528284 conn(0x7ff1980c7e70 msgr2=0x7ff198150ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:39.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.715+0000 7ff19cfff700 1 -- 172.21.15.72:0/122528284 shutdown_connections 2023-08-31T19:07:39.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.715+0000 7ff19cfff700 1 -- 172.21.15.72:0/122528284 wait complete. 2023-08-31T19:07:39.718 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 64 2023-08-31T19:07:39.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:07:39.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.925+0000 7f78933ff700 1 Processor -- start 2023-08-31T19:07:39.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.926+0000 7f78933ff700 1 -- start start 2023-08-31T19:07:39.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.927+0000 7f78933ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f788c153ff0 0x7f788c0bcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:39.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.927+0000 7f78933ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788c0bc920 con 0x7f788c064b00 2023-08-31T19:07:39.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.927+0000 7f78933ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788c0bbff0 con 0x7f788c1543d0 2023-08-31T19:07:39.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.927+0000 7f78933ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788c0bc2d0 con 0x7f788c153ff0 2023-08-31T19:07:39.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.927+0000 7f789119b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f788c153ff0 0x7f788c0bcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:39.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.927+0000 7f789199c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f788c064b00 0x7f788c0c1e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58818/0 (socket says 172.21.15.72:58818) 2023-08-31T19:07:39.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.927+0000 7f789199c700 1 -- 172.21.15.72:0/671236925 learned_addr learned my addr 172.21.15.72:0/671236925 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:39.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.927+0000 7f789119b700 1 --2- 172.21.15.72:0/671236925 >> v2:172.21.15.72:3300/0 conn(0x7f788c153ff0 0x7f788c0bcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48180/0 (socket says 172.21.15.72:48180) 2023-08-31T19:07:39.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.928+0000 7f789119b700 1 -- 172.21.15.72:0/671236925 >> v1:172.21.15.146:6789/0 conn(0x7f788c1543d0 legacy=0x7f788c0643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:39.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.928+0000 7f789119b700 1 -- 172.21.15.72:0/671236925 >> v1:172.21.15.72:6789/0 conn(0x7f788c064b00 legacy=0x7f788c0c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:39.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.928+0000 7f789119b700 1 -- 172.21.15.72:0/671236925 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c0bc5b0 con 0x7f788c153ff0 2023-08-31T19:07:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.928+0000 7f789119b700 1 --2- 172.21.15.72:0/671236925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c153ff0 0x7f788c0bcdb0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f7888009760 tx=0x7f7888009060).ready entity=mon.0 client_cookie=7494dba3df6e293c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.928+0000 7f7883fff700 1 -- 172.21.15.72:0/671236925 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788800b610 con 0x7f788c153ff0 2023-08-31T19:07:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.928+0000 7f7883fff700 1 -- 172.21.15.72:0/671236925 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788800b770 con 0x7f788c153ff0 2023-08-31T19:07:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.928+0000 7f7883fff700 1 -- 172.21.15.72:0/671236925 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788800baf0 con 0x7f788c153ff0 2023-08-31T19:07:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.929+0000 7f78933ff700 1 -- 172.21.15.72:0/671236925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c153ff0 msgr2=0x7f788c0bcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.929+0000 7f78933ff700 1 --2- 172.21.15.72:0/671236925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c153ff0 0x7f788c0bcdb0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f7888009760 tx=0x7f7888009060).stop 2023-08-31T19:07:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.929+0000 7f78933ff700 1 -- 172.21.15.72:0/671236925 shutdown_connections 2023-08-31T19:07:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.929+0000 7f78933ff700 1 --2- 172.21.15.72:0/671236925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c153ff0 0x7f788c0bcdb0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.929+0000 7f78933ff700 1 -- 172.21.15.72:0/671236925 >> 172.21.15.72:0/671236925 conn(0x7f788c0c6b10 msgr2=0x7f788c0c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.929+0000 7f78933ff700 1 -- 172.21.15.72:0/671236925 shutdown_connections 2023-08-31T19:07:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.929+0000 7f78933ff700 1 -- 172.21.15.72:0/671236925 wait complete. 2023-08-31T19:07:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.930+0000 7f78933ff700 1 Processor -- start 2023-08-31T19:07:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.931+0000 7f78933ff700 1 -- start start 2023-08-31T19:07:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.931+0000 7f78933ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c064b00 0x7f788c0bdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.931+0000 7f78933ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f788c153ff0 0x7f788c143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.931+0000 7f78933ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c1543d0 0x7f788c0abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.931+0000 7f78933ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0a7600 con 0x7f788c064b00 2023-08-31T19:07:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.931+0000 7f78933ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0a65f0 con 0x7f788c1543d0 2023-08-31T19:07:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.931+0000 7f78933ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0a6840 con 0x7f788c153ff0 2023-08-31T19:07:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.932+0000 7f789119b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c064b00 0x7f788c0bdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.932+0000 7f789119b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c064b00 0x7f788c0bdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48194/0 (socket says 172.21.15.72:48194) 2023-08-31T19:07:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.932+0000 7f789119b700 1 -- 172.21.15.72:0/2396065517 learned_addr learned my addr 172.21.15.72:0/2396065517 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.932+0000 7f789199c700 1 --2- 172.21.15.72:0/2396065517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c1543d0 0x7f788c0abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:39.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.932+0000 7f789099a700 1 --2- 172.21.15.72:0/2396065517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f788c153ff0 0x7f788c143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:39.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.932+0000 7f789119b700 1 -- 172.21.15.72:0/2396065517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f788c153ff0 msgr2=0x7f788c143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:39.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.932+0000 7f789119b700 1 --2- 172.21.15.72:0/2396065517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f788c153ff0 0x7f788c143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:39.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.932+0000 7f789119b700 1 -- 172.21.15.72:0/2396065517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c1543d0 msgr2=0x7f788c0abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:39.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.932+0000 7f789119b700 1 --2- 172.21.15.72:0/2396065517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c1543d0 0x7f788c0abbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:39.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.932+0000 7f789119b700 1 -- 172.21.15.72:0/2396065517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78880092a0 con 0x7f788c064b00 2023-08-31T19:07:39.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.932+0000 7f789099a700 1 --2- 172.21.15.72:0/2396065517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f788c153ff0 0x7f788c143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:39.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.932+0000 7f789119b700 1 --2- 172.21.15.72:0/2396065517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c064b00 0x7f788c0bdbb0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f7888009eb0 tx=0x7f7888017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:39.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.932+0000 7f78817fa700 1 -- 172.21.15.72:0/2396065517 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788800baf0 con 0x7f788c064b00 2023-08-31T19:07:39.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.933+0000 7f78817fa700 1 -- 172.21.15.72:0/2396065517 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7888000c90 con 0x7f788c064b00 2023-08-31T19:07:39.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.933+0000 7f78933ff700 1 -- 172.21.15.72:0/2396065517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788c0a6b20 con 0x7f788c064b00 2023-08-31T19:07:39.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.933+0000 7f78817fa700 1 -- 172.21.15.72:0/2396065517 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788801b620 con 0x7f788c064b00 2023-08-31T19:07:39.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.933+0000 7f78933ff700 1 -- 172.21.15.72:0/2396065517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788c0a70e0 con 0x7f788c064b00 2023-08-31T19:07:39.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.934+0000 7f78933ff700 1 -- 172.21.15.72:0/2396065517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f788c06c6b0 con 0x7f788c064b00 2023-08-31T19:07:39.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.934+0000 7f78817fa700 1 -- 172.21.15.72:0/2396065517 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 61) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f788801b9d0 con 0x7f788c064b00 2023-08-31T19:07:39.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.935+0000 7f78817fa700 1 --2- 172.21.15.72:0/2396065517 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f787005efc0 0x7f7870061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:39.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.935+0000 7f78817fa700 1 -- 172.21.15.72:0/2396065517 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f788807bfc0 con 0x7f788c064b00 2023-08-31T19:07:39.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.935+0000 7f789099a700 1 -- 172.21.15.72:0/2396065517 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f787005efc0 msgr2=0x7f7870061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:39.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.935+0000 7f789099a700 1 --2- 172.21.15.72:0/2396065517 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f787005efc0 0x7f7870061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:39.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:39.939+0000 7f78817fa700 1 -- 172.21.15.72:0/2396065517 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f788804cf70 con 0x7f788c064b00 2023-08-31T19:07:40.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.115+0000 7f78933ff700 1 -- 172.21.15.72:0/2396065517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f788c0bce50 con 0x7f788c064b00 2023-08-31T19:07:40.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.116+0000 7f78817fa700 1 -- 172.21.15.72:0/2396065517 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f7888006c70 con 0x7f788c064b00 2023-08-31T19:07:40.117 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:40.117 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":143,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:07:35.849624+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:07:20.032158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-31T19:07:20.589299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/688771534":"2023-09-01T19:07:35.849574+0000","172.21.15.72:0/2702061734":"2023-09-01T19:07:35.849574+0000","172.21.15.72:0/496703134":"2023-09-01T19:07:35.849574+0000","172.21.15.72:6833/143463":"2023-09-01T19:07:35.849574+0000","172.21.15.72:6832/143463":"2023-09-01T19:07:35.849574+0000","172.21.15.72:0/2921401112":"2023-09-01T19:07:35.849574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:07:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.118+0000 7f78933ff700 1 -- 172.21.15.72:0/2396065517 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f787005efc0 msgr2=0x7f7870061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.118+0000 7f78933ff700 1 --2- 172.21.15.72:0/2396065517 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f787005efc0 0x7f7870061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.118+0000 7f78933ff700 1 -- 172.21.15.72:0/2396065517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c064b00 msgr2=0x7f788c0bdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.118+0000 7f78933ff700 1 --2- 172.21.15.72:0/2396065517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c064b00 0x7f788c0bdbb0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f7888009eb0 tx=0x7f7888017000).stop 2023-08-31T19:07:40.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.118+0000 7f78933ff700 1 -- 172.21.15.72:0/2396065517 shutdown_connections 2023-08-31T19:07:40.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.118+0000 7f78933ff700 1 --2- 172.21.15.72:0/2396065517 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f787005efc0 0x7f7870061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:40.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.118+0000 7f78933ff700 1 --2- 172.21.15.72:0/2396065517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c1543d0 0x7f788c0abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:40.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.118+0000 7f78933ff700 1 --2- 172.21.15.72:0/2396065517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c064b00 0x7f788c0bdbb0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:40.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.118+0000 7f78933ff700 1 --2- 172.21.15.72:0/2396065517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f788c153ff0 0x7f788c143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:40.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.118+0000 7f78933ff700 1 -- 172.21.15.72:0/2396065517 >> 172.21.15.72:0/2396065517 conn(0x7f788c0c6b10 msgr2=0x7f788c152990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:40.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.118+0000 7f78933ff700 1 -- 172.21.15.72:0/2396065517 shutdown_connections 2023-08-31T19:07:40.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.118+0000 7f78933ff700 1 -- 172.21.15.72:0/2396065517 wait complete. 2023-08-31T19:07:40.138 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:07:20.032158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:07:20.589299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:07:40.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:07:40.258 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:40.258+0000 7f6a3ad07680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:07:40.338 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:40.338+0000 7f3321a65680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:07:40.340 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:40.340+0000 7f6a3ad07680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:07:40.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.363+0000 7f2dcb9ff700 1 Processor -- start 2023-08-31T19:07:40.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.363+0000 7f2dcb9ff700 1 -- start start 2023-08-31T19:07:40.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.364+0000 7f2dcb9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2dc4153ed0 0x7f2dc41542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:40.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.365+0000 7f2dcb9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc40a84b0 con 0x7f2dc40663d0 2023-08-31T19:07:40.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.365+0000 7f2dcb9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc40c9410 con 0x7f2dc40bdb30 2023-08-31T19:07:40.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.365+0000 7f2dcb9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40c5310 con 0x7f2dc4153ed0 2023-08-31T19:07:40.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.365+0000 7f2dc9f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2dc40663d0 0x7f2dc4157d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58826/0 (socket says 172.21.15.72:58826) 2023-08-31T19:07:40.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.365+0000 7f2dc9f9c700 1 -- 172.21.15.72:0/4277868303 learned_addr learned my addr 172.21.15.72:0/4277868303 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:40.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.365+0000 7f2dc979b700 1 --2- 172.21.15.72:0/4277868303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2dc4153ed0 0x7f2dc41542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:40.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.365+0000 7f2dbbfff700 1 -- 172.21.15.72:0/4277868303 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966863564 0 0) 0x7f2dc40a84b0 con 0x7f2dc40663d0 2023-08-31T19:07:40.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.365+0000 7f2dc979b700 1 -- 172.21.15.72:0/4277868303 >> v1:172.21.15.146:6789/0 conn(0x7f2dc40bdb30 legacy=0x7f2dc4155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:40.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.365+0000 7f2dc979b700 1 -- 172.21.15.72:0/4277868303 >> v1:172.21.15.72:6789/0 conn(0x7f2dc40663d0 legacy=0x7f2dc4157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:40.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.365+0000 7f2dc979b700 1 -- 172.21.15.72:0/4277868303 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc40a7ef0 con 0x7f2dc4153ed0 2023-08-31T19:07:40.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.366+0000 7f2dc979b700 1 --2- 172.21.15.72:0/4277868303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2dc4153ed0 0x7f2dc41542b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2dc0009790 tx=0x7f2dc0009060).ready entity=mon.2 client_cookie=51b694380ca0da9a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:40.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.366+0000 7f2dbbfff700 1 -- 172.21.15.72:0/4277868303 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0009130 con 0x7f2dc4153ed0 2023-08-31T19:07:40.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.366+0000 7f2dbbfff700 1 -- 172.21.15.72:0/4277868303 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc000b5a0 con 0x7f2dc4153ed0 2023-08-31T19:07:40.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.366+0000 7f2dbbfff700 1 -- 172.21.15.72:0/4277868303 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc000b920 con 0x7f2dc4153ed0 2023-08-31T19:07:40.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.366+0000 7f2dcb9ff700 1 -- 172.21.15.72:0/4277868303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2dc4153ed0 msgr2=0x7f2dc41542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:40.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.366+0000 7f2dcb9ff700 1 --2- 172.21.15.72:0/4277868303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2dc4153ed0 0x7f2dc41542b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2dc0009790 tx=0x7f2dc0009060).stop 2023-08-31T19:07:40.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.366+0000 7f2dcb9ff700 1 -- 172.21.15.72:0/4277868303 shutdown_connections 2023-08-31T19:07:40.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.366+0000 7f2dcb9ff700 1 --2- 172.21.15.72:0/4277868303 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2dc4153ed0 0x7f2dc41542b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:40.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.366+0000 7f2dcb9ff700 1 -- 172.21.15.72:0/4277868303 >> 172.21.15.72:0/4277868303 conn(0x7f2dc405eb60 msgr2=0x7f2dc40c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:40.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.366+0000 7f2dcb9ff700 1 -- 172.21.15.72:0/4277868303 shutdown_connections 2023-08-31T19:07:40.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.367+0000 7f2dcb9ff700 1 -- 172.21.15.72:0/4277868303 wait complete. 2023-08-31T19:07:40.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.368+0000 7f2dcb9ff700 1 Processor -- start 2023-08-31T19:07:40.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.368+0000 7f2dcb9ff700 1 -- start start 2023-08-31T19:07:40.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.369+0000 7f2dcb9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2dc40663d0 0x7f2dc40ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:40.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.369+0000 7f2dcb9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc4153ed0 0x7f2dc4164710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:40.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.369+0000 7f2dcb9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc4154830 0x7f2dc41569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:40.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.369+0000 7f2dcb9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc4155c90 con 0x7f2dc4154830 2023-08-31T19:07:40.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.369+0000 7f2dcb9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc4152280 con 0x7f2dc4153ed0 2023-08-31T19:07:40.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.369+0000 7f2dcb9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc4155080 con 0x7f2dc40663d0 2023-08-31T19:07:40.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.369+0000 7f2dc9f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc4154830 0x7f2dc41569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:40.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.369+0000 7f2dc979b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2dc40663d0 0x7f2dc40ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:40.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.370+0000 7f2dc979b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2dc40663d0 0x7f2dc40ae7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:37392/0 (socket says 172.21.15.72:37392) 2023-08-31T19:07:40.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.370+0000 7f2dc979b700 1 -- 172.21.15.72:0/133477264 learned_addr learned my addr 172.21.15.72:0/133477264 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:40.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.370+0000 7f2dc8f9a700 1 --2- 172.21.15.72:0/133477264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc4153ed0 0x7f2dc4164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:40.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.370+0000 7f2dc9f9c700 1 -- 172.21.15.72:0/133477264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2dc40663d0 msgr2=0x7f2dc40ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:40.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.370+0000 7f2dc9f9c700 1 --2- 172.21.15.72:0/133477264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2dc40663d0 0x7f2dc40ae7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:40.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.370+0000 7f2dc9f9c700 1 -- 172.21.15.72:0/133477264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc4153ed0 msgr2=0x7f2dc4164710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:40.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.370+0000 7f2dc9f9c700 1 --2- 172.21.15.72:0/133477264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc4153ed0 0x7f2dc4164710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:40.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.370+0000 7f2dc9f9c700 1 -- 172.21.15.72:0/133477264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc00092a0 con 0x7f2dc4154830 2023-08-31T19:07:40.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.370+0000 7f2dc8f9a700 1 --2- 172.21.15.72:0/133477264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc4153ed0 0x7f2dc4164710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:40.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.370+0000 7f2dc9f9c700 1 --2- 172.21.15.72:0/133477264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc4154830 0x7f2dc41569d0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f2dbc00c7c0 tx=0x7f2dbc007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:40.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.370+0000 7f2db97fa700 1 -- 172.21.15.72:0/133477264 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc005d80 con 0x7f2dc4154830 2023-08-31T19:07:40.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.370+0000 7f2db97fa700 1 -- 172.21.15.72:0/133477264 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc0070d0 con 0x7f2dc4154830 2023-08-31T19:07:40.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.370+0000 7f2db97fa700 1 -- 172.21.15.72:0/133477264 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc007490 con 0x7f2dc4154830 2023-08-31T19:07:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.370+0000 7f2dcb9ff700 1 -- 172.21.15.72:0/133477264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc4155360 con 0x7f2dc4154830 2023-08-31T19:07:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.371+0000 7f2dcb9ff700 1 -- 172.21.15.72:0/133477264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc4155920 con 0x7f2dc4154830 2023-08-31T19:07:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.372+0000 7f2dcb9ff700 1 -- 172.21.15.72:0/133477264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc4155e40 con 0x7f2dc4154830 2023-08-31T19:07:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.372+0000 7f2db97fa700 1 -- 172.21.15.72:0/133477264 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 61) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f2dbc007880 con 0x7f2dc4154830 2023-08-31T19:07:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.373+0000 7f2db97fa700 1 --2- 172.21.15.72:0/133477264 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2da805efc0 0x7f2da8061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:40.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.373+0000 7f2db97fa700 1 -- 172.21.15.72:0/133477264 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f2dbc079de0 con 0x7f2dc4154830 2023-08-31T19:07:40.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.373+0000 7f2dc979b700 1 -- 172.21.15.72:0/133477264 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2da805efc0 msgr2=0x7f2da8061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:40.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.373+0000 7f2dc979b700 1 --2- 172.21.15.72:0/133477264 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2da805efc0 0x7f2da8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:40.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.377+0000 7f2db97fa700 1 -- 172.21.15.72:0/133477264 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2dc4155e40 con 0x7f2dc4154830 2023-08-31T19:07:40.425 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:40.425+0000 7f3321a65680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:07:40.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.553+0000 7f2dcb9ff700 1 -- 172.21.15.72:0/133477264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2dc4155e40 con 0x7f2dc4154830 2023-08-31T19:07:40.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.554+0000 7f2db97fa700 1 -- 172.21.15.72:0/133477264 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v143) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2dc4155e40 con 0x7f2dc4154830 2023-08-31T19:07:40.555 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:07:40.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.556+0000 7f2dcb9ff700 1 -- 172.21.15.72:0/133477264 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2da805efc0 msgr2=0x7f2da8061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:40.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.556+0000 7f2dcb9ff700 1 --2- 172.21.15.72:0/133477264 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2da805efc0 0x7f2da8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:40.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.556+0000 7f2dcb9ff700 1 -- 172.21.15.72:0/133477264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc4154830 msgr2=0x7f2dc41569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:40.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.556+0000 7f2dcb9ff700 1 --2- 172.21.15.72:0/133477264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc4154830 0x7f2dc41569d0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f2dbc00c7c0 tx=0x7f2dbc007e60).stop 2023-08-31T19:07:40.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.556+0000 7f2dcb9ff700 1 -- 172.21.15.72:0/133477264 shutdown_connections 2023-08-31T19:07:40.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.556+0000 7f2dcb9ff700 1 --2- 172.21.15.72:0/133477264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc4154830 0x7f2dc41569d0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:40.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.556+0000 7f2dcb9ff700 1 --2- 172.21.15.72:0/133477264 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2dc40663d0 0x7f2dc40ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:40.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.556+0000 7f2dcb9ff700 1 --2- 172.21.15.72:0/133477264 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f2da805efc0 0x7f2da8061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:40.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.556+0000 7f2dcb9ff700 1 --2- 172.21.15.72:0/133477264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dc4153ed0 0x7f2dc4164710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:40.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.556+0000 7f2dcb9ff700 1 -- 172.21.15.72:0/133477264 >> 172.21.15.72:0/133477264 conn(0x7f2dc405eb60 msgr2=0x7f2dc40c8620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:40.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.556+0000 7f2dcb9ff700 1 -- 172.21.15.72:0/133477264 shutdown_connections 2023-08-31T19:07:40.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.556+0000 7f2dcb9ff700 1 -- 172.21.15.72:0/133477264 wait complete. 2023-08-31T19:07:40.572 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:40.572+0000 7f6a3ad07680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:07:40.575 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:07:40.667 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:40.667+0000 7f3321a65680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:07:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.771+0000 7ff3c6fff700 1 Processor -- start 2023-08-31T19:07:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.771+0000 7ff3c6fff700 1 -- start start 2023-08-31T19:07:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.772+0000 7ff3c6fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff3c0153e30 0x7ff3c0154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.772+0000 7ff3c6fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c00c5cb0 0x7ff3c00c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.772+0000 7ff3c6fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3c00630b0 0x7ff3c0063510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.772+0000 7ff3c6fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c0063a00 con 0x7ff3c00630b0 2023-08-31T19:07:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.772+0000 7ff3c6fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c00bfd40 con 0x7ff3c0153e30 2023-08-31T19:07:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.772+0000 7ff3c6fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c00c6730 con 0x7ff3c00c5cb0 2023-08-31T19:07:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.773+0000 7ff3c559c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3c00630b0 0x7ff3c0063510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.773+0000 7ff3c559c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3c00630b0 0x7ff3c0063510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48208/0 (socket says 172.21.15.72:48208) 2023-08-31T19:07:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.773+0000 7ff3c4d9b700 1 --2- 172.21.15.72:0/1292600258 >> v2:172.21.15.146:3300/0 conn(0x7ff3c0153e30 0x7ff3c0154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.773+0000 7ff3c559c700 1 -- 172.21.15.72:0/1292600258 learned_addr learned my addr 172.21.15.72:0/1292600258 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.773+0000 7ff3c4d9b700 1 -- 172.21.15.72:0/1292600258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c00c5cb0 msgr2=0x7ff3c00c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.773+0000 7ff3c4d9b700 1 --2- 172.21.15.72:0/1292600258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c00c5cb0 0x7ff3c00c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.773+0000 7ff3c4d9b700 1 -- 172.21.15.72:0/1292600258 >> v2:172.21.15.72:3300/0 conn(0x7ff3c00630b0 msgr2=0x7ff3c0063510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.773+0000 7ff3c4d9b700 1 --2- 172.21.15.72:0/1292600258 >> v2:172.21.15.72:3300/0 conn(0x7ff3c00630b0 0x7ff3c0063510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.773+0000 7ff3c4d9b700 1 -- 172.21.15.72:0/1292600258 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c00bffe0 con 0x7ff3c0153e30 2023-08-31T19:07:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.773+0000 7ff3c559c700 1 --2- 172.21.15.72:0/1292600258 >> v2:172.21.15.72:3300/0 conn(0x7ff3c00630b0 0x7ff3c0063510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:07:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.773+0000 7ff3c4d9b700 1 --2- 172.21.15.72:0/1292600258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c0153e30 0x7ff3c0154210 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7ff3c006aa50 tx=0x7ff3b4009060).ready entity=mon.1 client_cookie=13d07e1a6acc5923 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.774+0000 7ff3bf7fe700 1 -- 172.21.15.72:0/1292600258 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40090d0 con 0x7ff3c0153e30 2023-08-31T19:07:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.774+0000 7ff3bf7fe700 1 -- 172.21.15.72:0/1292600258 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b400f510 con 0x7ff3c0153e30 2023-08-31T19:07:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.774+0000 7ff3bf7fe700 1 -- 172.21.15.72:0/1292600258 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b400f890 con 0x7ff3c0153e30 2023-08-31T19:07:40.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.774+0000 7ff3c6fff700 1 -- 172.21.15.72:0/1292600258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c0153e30 msgr2=0x7ff3c0154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:40.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.774+0000 7ff3c6fff700 1 --2- 172.21.15.72:0/1292600258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c0153e30 0x7ff3c0154210 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7ff3c006aa50 tx=0x7ff3b4009060).stop 2023-08-31T19:07:40.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.774+0000 7ff3c6fff700 1 -- 172.21.15.72:0/1292600258 shutdown_connections 2023-08-31T19:07:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.774+0000 7ff3c6fff700 1 --2- 172.21.15.72:0/1292600258 >> v2:172.21.15.72:3300/0 conn(0x7ff3c00630b0 0x7ff3c0063510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.774+0000 7ff3c6fff700 1 --2- 172.21.15.72:0/1292600258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c0153e30 0x7ff3c0154210 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.774+0000 7ff3c6fff700 1 --2- 172.21.15.72:0/1292600258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c00c5cb0 0x7ff3c00c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.774+0000 7ff3c6fff700 1 -- 172.21.15.72:0/1292600258 >> 172.21.15.72:0/1292600258 conn(0x7ff3c005eb20 msgr2=0x7ff3c00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.774+0000 7ff3c6fff700 1 -- 172.21.15.72:0/1292600258 shutdown_connections 2023-08-31T19:07:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.774+0000 7ff3c6fff700 1 -- 172.21.15.72:0/1292600258 wait complete. 2023-08-31T19:07:40.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.776+0000 7ff3c6fff700 1 Processor -- start 2023-08-31T19:07:40.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.776+0000 7ff3c6fff700 1 -- start start 2023-08-31T19:07:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.777+0000 7ff3c6fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c00630b0 0x7ff3c00a3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:40.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.777+0000 7ff3c6fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c00c5cb0 0x7ff3c0151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:40.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.777+0000 7ff3c6fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c0153e30 0x7ff3c00a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:40.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.777+0000 7ff3c6fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c00c2e50 con 0x7ff3c0153e30 2023-08-31T19:07:40.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.777+0000 7ff3c6fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c01527e0 con 0x7ff3c00630b0 2023-08-31T19:07:40.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.777+0000 7ff3c6fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c00a2a30 con 0x7ff3c00c5cb0 2023-08-31T19:07:40.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.777+0000 7ff3c559c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c0153e30 0x7ff3c00a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:40.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.777+0000 7ff3c559c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c0153e30 0x7ff3c00a45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48212/0 (socket says 172.21.15.72:48212) 2023-08-31T19:07:40.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.777+0000 7ff3c559c700 1 -- 172.21.15.72:0/1417055223 learned_addr learned my addr 172.21.15.72:0/1417055223 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:40.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.777+0000 7ff3c559c700 1 -- 172.21.15.72:0/1417055223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c00c5cb0 msgr2=0x7ff3c0151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:40.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.777+0000 7ff3c559c700 1 --2- 172.21.15.72:0/1417055223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c00c5cb0 0x7ff3c0151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:40.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.777+0000 7ff3c559c700 1 -- 172.21.15.72:0/1417055223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c00630b0 msgr2=0x7ff3c00a3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:40.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.777+0000 7ff3c559c700 1 --2- 172.21.15.72:0/1417055223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c00630b0 0x7ff3c00a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:40.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.777+0000 7ff3c559c700 1 -- 172.21.15.72:0/1417055223 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b8009ae0 con 0x7ff3c0153e30 2023-08-31T19:07:40.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.778+0000 7ff3c559c700 1 --2- 172.21.15.72:0/1417055223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c0153e30 0x7ff3c00a45f0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7ff3b8009f30 tx=0x7ff3b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:40.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.778+0000 7ff3bcff9700 1 -- 172.21.15.72:0/1417055223 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80092e0 con 0x7ff3c0153e30 2023-08-31T19:07:40.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.778+0000 7ff3bcff9700 1 -- 172.21.15.72:0/1417055223 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b800f040 con 0x7ff3c0153e30 2023-08-31T19:07:40.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.778+0000 7ff3c6fff700 1 -- 172.21.15.72:0/1417055223 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b40092a0 con 0x7ff3c0153e30 2023-08-31T19:07:40.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.778+0000 7ff3bcff9700 1 -- 172.21.15.72:0/1417055223 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b800ccd0 con 0x7ff3c0153e30 2023-08-31T19:07:40.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.778+0000 7ff3c6fff700 1 -- 172.21.15.72:0/1417055223 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c00a2ff0 con 0x7ff3c0153e30 2023-08-31T19:07:40.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.779+0000 7ff3c6fff700 1 -- 172.21.15.72:0/1417055223 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c00c2f90 con 0x7ff3c0153e30 2023-08-31T19:07:40.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.780+0000 7ff3bcff9700 1 -- 172.21.15.72:0/1417055223 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 61) v1 ==== 75431+0+0 (secure 0 0 0) 0x7ff3b8007400 con 0x7ff3c0153e30 2023-08-31T19:07:40.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.781+0000 7ff3bcff9700 1 --2- 172.21.15.72:0/1417055223 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3a405efc0 0x7ff3a4061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:40.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.781+0000 7ff3bcff9700 1 -- 172.21.15.72:0/1417055223 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7007+0+0 (secure 0 0 0) 0x7ff3b807a660 con 0x7ff3c0153e30 2023-08-31T19:07:40.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.781+0000 7ff3c4d9b700 1 -- 172.21.15.72:0/1417055223 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3a405efc0 msgr2=0x7ff3a4061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:40.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.781+0000 7ff3c4d9b700 1 --2- 172.21.15.72:0/1417055223 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3a405efc0 0x7ff3a4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:40.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.784+0000 7ff3bcff9700 1 -- 172.21.15.72:0/1417055223 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3b804a8f0 con 0x7ff3c0153e30 2023-08-31T19:07:40.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.961+0000 7ff3c6fff700 1 -- 172.21.15.72:0/1417055223 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff3c0062970 con 0x7ff3c0153e30 2023-08-31T19:07:40.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.962+0000 7ff3bcff9700 1 -- 172.21.15.72:0/1417055223 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v143) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff3b804b3a0 con 0x7ff3c0153e30 2023-08-31T19:07:40.962 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:07:40.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.964+0000 7ff3c6fff700 1 -- 172.21.15.72:0/1417055223 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3a405efc0 msgr2=0x7ff3a4061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:40.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.964+0000 7ff3c6fff700 1 --2- 172.21.15.72:0/1417055223 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3a405efc0 0x7ff3a4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:40.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.964+0000 7ff3c6fff700 1 -- 172.21.15.72:0/1417055223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c0153e30 msgr2=0x7ff3c00a45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:40.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.964+0000 7ff3c6fff700 1 --2- 172.21.15.72:0/1417055223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c0153e30 0x7ff3c00a45f0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7ff3b8009f30 tx=0x7ff3b800b040).stop 2023-08-31T19:07:40.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.964+0000 7ff3c6fff700 1 -- 172.21.15.72:0/1417055223 shutdown_connections 2023-08-31T19:07:40.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.964+0000 7ff3c6fff700 1 --2- 172.21.15.72:0/1417055223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3c0153e30 0x7ff3c00a45f0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:40.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.964+0000 7ff3c6fff700 1 --2- 172.21.15.72:0/1417055223 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff3a405efc0 0x7ff3a4061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:40.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.964+0000 7ff3c6fff700 1 --2- 172.21.15.72:0/1417055223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c00630b0 0x7ff3c00a3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:40.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.964+0000 7ff3c6fff700 1 --2- 172.21.15.72:0/1417055223 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff3c00c5cb0 0x7ff3c0151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:40.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.964+0000 7ff3c6fff700 1 -- 172.21.15.72:0/1417055223 >> 172.21.15.72:0/1417055223 conn(0x7ff3c005eb20 msgr2=0x7ff3c00ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:40.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.964+0000 7ff3c6fff700 1 -- 172.21.15.72:0/1417055223 shutdown_connections 2023-08-31T19:07:40.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:40.964+0000 7ff3c6fff700 1 -- 172.21.15.72:0/1417055223 wait complete. 2023-08-31T19:07:40.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:07:41.082 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:41.082+0000 7f6a3ad07680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:07:41.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.177+0000 7f27c1fff700 1 Processor -- start 2023-08-31T19:07:41.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.177+0000 7f27c1fff700 1 -- start start 2023-08-31T19:07:41.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.179+0000 7f27c1fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f27bc153ed0 0x7f27bc1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:41.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.179+0000 7f27c1fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27bc0bdb30 0x7f27bc155200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:41.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.179+0000 7f27c1fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27bc0663d0 0x7f27bc066840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:41.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.179+0000 7f27c1fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc0a84b0 con 0x7f27bc0bdb30 2023-08-31T19:07:41.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.179+0000 7f27c1fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc0c9410 con 0x7f27bc153ed0 2023-08-31T19:07:41.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.179+0000 7f27c1fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0c5310 con 0x7f27bc0663d0 2023-08-31T19:07:41.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.179+0000 7f27baffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27bc0bdb30 0x7f27bc155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:41.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.179+0000 7f27baffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27bc0bdb30 0x7f27bc155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48222/0 (socket says 172.21.15.72:48222) 2023-08-31T19:07:41.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.179+0000 7f27baffd700 1 -- 172.21.15.72:0/1478759545 learned_addr learned my addr 172.21.15.72:0/1478759545 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:41.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.179+0000 7f27bbfff700 1 --2- 172.21.15.72:0/1478759545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27bc0663d0 0x7f27bc066840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:41.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.179+0000 7f27bb7fe700 1 --2- 172.21.15.72:0/1478759545 >> v2:172.21.15.146:3300/0 conn(0x7f27bc153ed0 0x7f27bc1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:41.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.180+0000 7f27baffd700 1 -- 172.21.15.72:0/1478759545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27bc0663d0 msgr2=0x7f27bc066840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:41.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.180+0000 7f27baffd700 1 --2- 172.21.15.72:0/1478759545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27bc0663d0 0x7f27bc066840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.180+0000 7f27baffd700 1 -- 172.21.15.72:0/1478759545 >> v2:172.21.15.146:3300/0 conn(0x7f27bc153ed0 msgr2=0x7f27bc1542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:41.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.180+0000 7f27baffd700 1 --2- 172.21.15.72:0/1478759545 >> v2:172.21.15.146:3300/0 conn(0x7f27bc153ed0 0x7f27bc1542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.180+0000 7f27baffd700 1 -- 172.21.15.72:0/1478759545 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc066d30 con 0x7f27bc0bdb30 2023-08-31T19:07:41.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.180+0000 7f27baffd700 1 --2- 172.21.15.72:0/1478759545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27bc0bdb30 0x7f27bc155200 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f27bc0c66e0 tx=0x7f27b00090f0).ready entity=mon.0 client_cookie=aec6e2314b3f7747 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:41.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.180+0000 7f27ba7fc700 1 -- 172.21.15.72:0/1478759545 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b000f510 con 0x7f27bc0bdb30 2023-08-31T19:07:41.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.180+0000 7f27ba7fc700 1 -- 172.21.15.72:0/1478759545 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b000f670 con 0x7f27bc0bdb30 2023-08-31T19:07:41.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.180+0000 7f27ba7fc700 1 -- 172.21.15.72:0/1478759545 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b000fa10 con 0x7f27bc0bdb30 2023-08-31T19:07:41.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.181+0000 7f27c1fff700 1 -- 172.21.15.72:0/1478759545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27bc0bdb30 msgr2=0x7f27bc155200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:41.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.181+0000 7f27c1fff700 1 --2- 172.21.15.72:0/1478759545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27bc0bdb30 0x7f27bc155200 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f27bc0c66e0 tx=0x7f27b00090f0).stop 2023-08-31T19:07:41.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.181+0000 7f27c1fff700 1 -- 172.21.15.72:0/1478759545 shutdown_connections 2023-08-31T19:07:41.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.181+0000 7f27c1fff700 1 --2- 172.21.15.72:0/1478759545 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27bc0663d0 0x7f27bc066840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.181+0000 7f27c1fff700 1 --2- 172.21.15.72:0/1478759545 >> v2:172.21.15.146:3300/0 conn(0x7f27bc153ed0 0x7f27bc1542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.181+0000 7f27c1fff700 1 --2- 172.21.15.72:0/1478759545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27bc0bdb30 0x7f27bc155200 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.181+0000 7f27c1fff700 1 -- 172.21.15.72:0/1478759545 >> 172.21.15.72:0/1478759545 conn(0x7f27bc05eb60 msgr2=0x7f27bc0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:41.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.181+0000 7f27c1fff700 1 -- 172.21.15.72:0/1478759545 shutdown_connections 2023-08-31T19:07:41.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.181+0000 7f27c1fff700 1 -- 172.21.15.72:0/1478759545 wait complete. 2023-08-31T19:07:41.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.183+0000 7f27c1fff700 1 Processor -- start 2023-08-31T19:07:41.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.183+0000 7f27c1fff700 1 -- start start 2023-08-31T19:07:41.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27c1fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27bc0663d0 0x7f27bc0c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:41.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27c1fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27bc153ed0 0x7f27bc0c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:41.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27c1fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27bc167870 0x7f27bc167cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:41.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27c1fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0ad040 con 0x7f27bc167870 2023-08-31T19:07:41.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27c1fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0a8990 con 0x7f27bc153ed0 2023-08-31T19:07:41.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27c1fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0a8d40 con 0x7f27bc0663d0 2023-08-31T19:07:41.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27bbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27bc167870 0x7f27bc167cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:41.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27baffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27bc153ed0 0x7f27bc0c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:41.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27bb7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27bc0663d0 0x7f27bc0c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:41.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27bbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27bc167870 0x7f27bc167cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48226/0 (socket says 172.21.15.72:48226) 2023-08-31T19:07:41.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27baffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27bc153ed0 0x7f27bc0c20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:58432/0 (socket says 172.21.15.72:58432) 2023-08-31T19:07:41.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27bbfff700 1 -- 172.21.15.72:0/342455966 learned_addr learned my addr 172.21.15.72:0/342455966 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:41.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27bb7fe700 1 -- 172.21.15.72:0/342455966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27bc153ed0 msgr2=0x7f27bc0c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:41.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27bb7fe700 1 --2- 172.21.15.72:0/342455966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27bc153ed0 0x7f27bc0c20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27bb7fe700 1 -- 172.21.15.72:0/342455966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27bc167870 msgr2=0x7f27bc167cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:41.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27bb7fe700 1 --2- 172.21.15.72:0/342455966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27bc167870 0x7f27bc167cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27bb7fe700 1 -- 172.21.15.72:0/342455966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b0009370 con 0x7f27bc0663d0 2023-08-31T19:07:41.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27baffd700 1 --2- 172.21.15.72:0/342455966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27bc153ed0 0x7f27bc0c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:07:41.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.185+0000 7f27bbfff700 1 --2- 172.21.15.72:0/342455966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27bc167870 0x7f27bc167cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:07:41.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.186+0000 7f27bb7fe700 1 --2- 172.21.15.72:0/342455966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27bc0663d0 0x7f27bc0c1bd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f27ac00e6f0 tx=0x7f27ac009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:41.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.186+0000 7f27a37fe700 1 -- 172.21.15.72:0/342455966 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac012600 con 0x7f27bc0663d0 2023-08-31T19:07:41.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.186+0000 7f27a37fe700 1 -- 172.21.15.72:0/342455966 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac012760 con 0x7f27bc0663d0 2023-08-31T19:07:41.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.186+0000 7f27a37fe700 1 -- 172.21.15.72:0/342455966 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac012ae0 con 0x7f27bc0663d0 2023-08-31T19:07:41.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.186+0000 7f27c1fff700 1 -- 172.21.15.72:0/342455966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27bc0c2760 con 0x7f27bc0663d0 2023-08-31T19:07:41.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.186+0000 7f27c1fff700 1 -- 172.21.15.72:0/342455966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27bc0accd0 con 0x7f27bc0663d0 2023-08-31T19:07:41.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.187+0000 7f27c1fff700 1 -- 172.21.15.72:0/342455966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27bc0c2c80 con 0x7f27bc0663d0 2023-08-31T19:07:41.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.189+0000 7f27a37fe700 1 -- 172.21.15.72:0/342455966 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 61) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f27ac01b400 con 0x7f27bc0663d0 2023-08-31T19:07:41.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.189+0000 7f27a37fe700 1 --2- 172.21.15.72:0/342455966 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f27a805eff0 0x7f27a80614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:41.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.189+0000 7f27a37fe700 1 -- 172.21.15.72:0/342455966 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f27ac07a600 con 0x7f27bc0663d0 2023-08-31T19:07:41.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.190+0000 7f27baffd700 1 -- 172.21.15.72:0/342455966 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f27a805eff0 msgr2=0x7f27a80614b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:41.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.190+0000 7f27baffd700 1 --2- 172.21.15.72:0/342455966 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f27a805eff0 0x7f27a80614b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:41.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.194+0000 7f27a37fe700 1 -- 172.21.15.72:0/342455966 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f27bc0c2c80 con 0x7f27bc0663d0 2023-08-31T19:07:41.200 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:41.200+0000 7f3321a65680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:07:41.207 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:41.207+0000 7f6a3ad07680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:07:41.328 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:41.327+0000 7f3321a65680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:07:41.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.371+0000 7f27c1fff700 1 -- 172.21.15.72:0/342455966 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27bc0acb30 con 0x7f27bc0663d0 2023-08-31T19:07:41.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.371+0000 7f27a37fe700 1 -- 172.21.15.72:0/342455966 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v143) v1 ==== 104+0+11 (secure 0 0 0) 0x7f27bc0acb30 con 0x7f27bc0663d0 2023-08-31T19:07:41.372 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:07:41.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.374+0000 7f27c1fff700 1 -- 172.21.15.72:0/342455966 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f27a805eff0 msgr2=0x7f27a80614b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:41.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.374+0000 7f27c1fff700 1 --2- 172.21.15.72:0/342455966 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f27a805eff0 0x7f27a80614b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.374+0000 7f27c1fff700 1 -- 172.21.15.72:0/342455966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27bc0663d0 msgr2=0x7f27bc0c1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.374+0000 7f27c1fff700 1 --2- 172.21.15.72:0/342455966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27bc0663d0 0x7f27bc0c1bd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f27ac00e6f0 tx=0x7f27ac009060).stop 2023-08-31T19:07:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.374+0000 7f27c1fff700 1 -- 172.21.15.72:0/342455966 shutdown_connections 2023-08-31T19:07:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.374+0000 7f27c1fff700 1 --2- 172.21.15.72:0/342455966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27bc167870 0x7f27bc167cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.374+0000 7f27c1fff700 1 --2- 172.21.15.72:0/342455966 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27bc0663d0 0x7f27bc0c1bd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.374+0000 7f27c1fff700 1 --2- 172.21.15.72:0/342455966 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f27a805eff0 0x7f27a80614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:41.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.374+0000 7f27c1fff700 1 --2- 172.21.15.72:0/342455966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27bc153ed0 0x7f27bc0c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.374+0000 7f27c1fff700 1 -- 172.21.15.72:0/342455966 >> 172.21.15.72:0/342455966 conn(0x7f27bc05eb60 msgr2=0x7f27bc0c8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:41.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.374+0000 7f27c1fff700 1 -- 172.21.15.72:0/342455966 shutdown_connections 2023-08-31T19:07:41.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.374+0000 7f27c1fff700 1 -- 172.21.15.72:0/342455966 wait complete. 2023-08-31T19:07:41.392 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:07:41.393 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:41.392+0000 7f6a3ad07680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:07:41.484 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:41.484+0000 7f6a3ad07680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:07:41.526 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:41.526+0000 7f3321a65680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:07:41.568 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:41.568+0000 7f6a3ad07680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:07:41.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.596+0000 7f430ebff700 1 Processor -- start 2023-08-31T19:07:41.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.596+0000 7f430ebff700 1 -- start start 2023-08-31T19:07:41.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.598+0000 7f430ebff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4308153ed0 0x7f43081542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:41.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.598+0000 7f430ebff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43080663d0 0x7f4308066840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:41.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.598+0000 7f430ebff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43080a84b0 con 0x7f43080bdb30 2023-08-31T19:07:41.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.598+0000 7f430ebff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43080c9410 con 0x7f4308153ed0 2023-08-31T19:07:41.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.598+0000 7f430ebff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43080c5310 con 0x7f43080663d0 2023-08-31T19:07:41.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.598+0000 7f430c99b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4308153ed0 0x7f43081542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:41.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.598+0000 7f430c99b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4308153ed0 0x7f43081542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48242/0 (socket says 172.21.15.72:48242) 2023-08-31T19:07:41.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.598+0000 7f430c99b700 1 -- 172.21.15.72:0/2134344750 learned_addr learned my addr 172.21.15.72:0/2134344750 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:41.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.598+0000 7f430d19c700 1 --2- 172.21.15.72:0/2134344750 >> v2:172.21.15.146:3300/0 conn(0x7f43080663d0 0x7f4308066840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:41.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.599+0000 7f430c99b700 1 -- 172.21.15.72:0/2134344750 >> v2:172.21.15.146:3300/0 conn(0x7f43080663d0 msgr2=0x7f4308066840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:41.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.599+0000 7f430c99b700 1 --2- 172.21.15.72:0/2134344750 >> v2:172.21.15.146:3300/0 conn(0x7f43080663d0 0x7f4308066840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.599+0000 7f430c99b700 1 -- 172.21.15.72:0/2134344750 >> v1:172.21.15.146:6789/0 conn(0x7f43080bdb30 legacy=0x7f4308155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:41.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.599+0000 7f430c99b700 1 -- 172.21.15.72:0/2134344750 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4308066d30 con 0x7f4308153ed0 2023-08-31T19:07:41.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.599+0000 7f430c99b700 1 --2- 172.21.15.72:0/2134344750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308153ed0 0x7f43081542b0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f43080be880 tx=0x7f42fc0090f0).ready entity=mon.0 client_cookie=aa9ac4d78379e8fb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:41.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.599+0000 7f43077fe700 1 -- 172.21.15.72:0/2134344750 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc00b520 con 0x7f4308153ed0 2023-08-31T19:07:41.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.599+0000 7f43077fe700 1 -- 172.21.15.72:0/2134344750 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42fc00b680 con 0x7f4308153ed0 2023-08-31T19:07:41.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.599+0000 7f43077fe700 1 -- 172.21.15.72:0/2134344750 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc00ba20 con 0x7f4308153ed0 2023-08-31T19:07:41.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.600+0000 7f430ebff700 1 -- 172.21.15.72:0/2134344750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308153ed0 msgr2=0x7f43081542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:41.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.600+0000 7f430ebff700 1 --2- 172.21.15.72:0/2134344750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308153ed0 0x7f43081542b0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f43080be880 tx=0x7f42fc0090f0).stop 2023-08-31T19:07:41.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.600+0000 7f430ebff700 1 -- 172.21.15.72:0/2134344750 shutdown_connections 2023-08-31T19:07:41.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.600+0000 7f430ebff700 1 --2- 172.21.15.72:0/2134344750 >> v2:172.21.15.146:3300/0 conn(0x7f43080663d0 0x7f4308066840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.600+0000 7f430ebff700 1 --2- 172.21.15.72:0/2134344750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308153ed0 0x7f43081542b0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.600+0000 7f430ebff700 1 -- 172.21.15.72:0/2134344750 >> 172.21.15.72:0/2134344750 conn(0x7f430805eb60 msgr2=0x7f43080c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:41.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.600+0000 7f430ebff700 1 -- 172.21.15.72:0/2134344750 shutdown_connections 2023-08-31T19:07:41.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.600+0000 7f430ebff700 1 -- 172.21.15.72:0/2134344750 wait complete. 2023-08-31T19:07:41.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.602+0000 7f430ebff700 1 Processor -- start 2023-08-31T19:07:41.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.602+0000 7f430ebff700 1 -- start start 2023-08-31T19:07:41.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f430ebff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43080663d0 0x7f4308151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:41.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f430ebff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4308153ed0 0x7f43080c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:41.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f430ebff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43080c2450 0x7f43080a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:41.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f430ebff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43080a6850 con 0x7f43080663d0 2023-08-31T19:07:41.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f430ebff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43080c1ad0 con 0x7f43080c2450 2023-08-31T19:07:41.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f430ebff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43080a6290 con 0x7f4308153ed0 2023-08-31T19:07:41.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f430c99b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43080663d0 0x7f4308151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:41.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f430c99b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43080663d0 0x7f4308151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48248/0 (socket says 172.21.15.72:48248) 2023-08-31T19:07:41.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f430c99b700 1 -- 172.21.15.72:0/402372093 learned_addr learned my addr 172.21.15.72:0/402372093 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:41.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f430d19c700 1 --2- 172.21.15.72:0/402372093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43080c2450 0x7f43080a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:41.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f4307fff700 1 --2- 172.21.15.72:0/402372093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4308153ed0 0x7f43080c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:41.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f430c99b700 1 -- 172.21.15.72:0/402372093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4308153ed0 msgr2=0x7f43080c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:41.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f430c99b700 1 --2- 172.21.15.72:0/402372093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4308153ed0 0x7f43080c1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f430c99b700 1 -- 172.21.15.72:0/402372093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43080c2450 msgr2=0x7f43080a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:41.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f430c99b700 1 --2- 172.21.15.72:0/402372093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43080c2450 0x7f43080a5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.603+0000 7f430c99b700 1 -- 172.21.15.72:0/402372093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42fc009370 con 0x7f43080663d0 2023-08-31T19:07:41.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.604+0000 7f430c99b700 1 --2- 172.21.15.72:0/402372093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43080663d0 0x7f4308151e30 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f42fc006fd0 tx=0x7f42fc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:41.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.604+0000 7f4304ff9700 1 -- 172.21.15.72:0/402372093 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc006d90 con 0x7f43080663d0 2023-08-31T19:07:41.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.604+0000 7f4304ff9700 1 -- 172.21.15.72:0/402372093 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42fc006990 con 0x7f43080663d0 2023-08-31T19:07:41.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.604+0000 7f430ebff700 1 -- 172.21.15.72:0/402372093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43080a6570 con 0x7f43080663d0 2023-08-31T19:07:41.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.604+0000 7f4304ff9700 1 -- 172.21.15.72:0/402372093 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc00b7f0 con 0x7f43080663d0 2023-08-31T19:07:41.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.604+0000 7f430ebff700 1 -- 172.21.15.72:0/402372093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43080a7080 con 0x7f43080663d0 2023-08-31T19:07:41.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.605+0000 7f430ebff700 1 -- 172.21.15.72:0/402372093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43080c15c0 con 0x7f43080663d0 2023-08-31T19:07:41.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.607+0000 7f4304ff9700 1 -- 172.21.15.72:0/402372093 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 61) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f42fc01c630 con 0x7f43080663d0 2023-08-31T19:07:41.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.608+0000 7f4304ff9700 1 --2- 172.21.15.72:0/402372093 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f42ec05efc0 0x7f42ec061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:41.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.608+0000 7f4304ff9700 1 -- 172.21.15.72:0/402372093 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f42fc07bd30 con 0x7f43080663d0 2023-08-31T19:07:41.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.608+0000 7f4307fff700 1 -- 172.21.15.72:0/402372093 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f42ec05efc0 msgr2=0x7f42ec061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:41.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.608+0000 7f4307fff700 1 --2- 172.21.15.72:0/402372093 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f42ec05efc0 0x7f42ec061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:41.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.612+0000 7f4304ff9700 1 -- 172.21.15.72:0/402372093 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f43080c15c0 con 0x7f43080663d0 2023-08-31T19:07:41.624 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:41.624+0000 7f3321a65680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:07:41.712 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:41.712+0000 7f3321a65680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:07:41.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.789+0000 7f430ebff700 1 -- 172.21.15.72:0/402372093 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f43080c15c0 con 0x7f43080663d0 2023-08-31T19:07:41.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.790+0000 7f4304ff9700 1 -- 172.21.15.72:0/402372093 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v143) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43080c15c0 con 0x7f43080663d0 2023-08-31T19:07:41.790 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:07:41.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.792+0000 7f430ebff700 1 -- 172.21.15.72:0/402372093 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f42ec05efc0 msgr2=0x7f42ec061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:41.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.792+0000 7f430ebff700 1 --2- 172.21.15.72:0/402372093 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f42ec05efc0 0x7f42ec061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:41.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.792+0000 7f430ebff700 1 -- 172.21.15.72:0/402372093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43080663d0 msgr2=0x7f4308151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:41.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.792+0000 7f430ebff700 1 --2- 172.21.15.72:0/402372093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43080663d0 0x7f4308151e30 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f42fc006fd0 tx=0x7f42fc017000).stop 2023-08-31T19:07:41.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.792+0000 7f430ebff700 1 -- 172.21.15.72:0/402372093 shutdown_connections 2023-08-31T19:07:41.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.792+0000 7f430ebff700 1 --2- 172.21.15.72:0/402372093 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f42ec05efc0 0x7f42ec061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:41.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.792+0000 7f430ebff700 1 --2- 172.21.15.72:0/402372093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43080c2450 0x7f43080a5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.792+0000 7f430ebff700 1 --2- 172.21.15.72:0/402372093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43080663d0 0x7f4308151e30 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.792+0000 7f430ebff700 1 --2- 172.21.15.72:0/402372093 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4308153ed0 0x7f43080c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:41.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.792+0000 7f430ebff700 1 -- 172.21.15.72:0/402372093 >> 172.21.15.72:0/402372093 conn(0x7f430805eb60 msgr2=0x7f43080c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:41.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.792+0000 7f430ebff700 1 -- 172.21.15.72:0/402372093 shutdown_connections 2023-08-31T19:07:41.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:41.792+0000 7f430ebff700 1 -- 172.21.15.72:0/402372093 wait complete. 2023-08-31T19:07:41.811 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:07:41.876 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:41.876+0000 7f6a3ad07680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:07:42.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.003+0000 7fe68c1ff700 1 Processor -- start 2023-08-31T19:07:42.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.003+0000 7fe68c1ff700 1 -- start start 2023-08-31T19:07:42.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.005+0000 7fe68c1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6840aa290 0x7fe684156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.005+0000 7fe68c1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6841574b0 0x7fe6840c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.005+0000 7fe68c1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6840bfd00 con 0x7fe6840a9eb0 2023-08-31T19:07:42.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.005+0000 7fe68c1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6840c05a0 con 0x7fe6841574b0 2023-08-31T19:07:42.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.005+0000 7fe68c1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6840aaea0 con 0x7fe6840aa290 2023-08-31T19:07:42.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.005+0000 7fe68a79c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6841574b0 0x7fe6840c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:42.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.005+0000 7fe68979a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6840aa290 0x7fe684156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:42.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.005+0000 7fe68a79c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6841574b0 0x7fe6840c0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48254/0 (socket says 172.21.15.72:48254) 2023-08-31T19:07:42.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.005+0000 7fe68a79c700 1 -- 172.21.15.72:0/841755194 learned_addr learned my addr 172.21.15.72:0/841755194 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:42.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.005+0000 7fe68a79c700 1 -- 172.21.15.72:0/841755194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6840aa290 msgr2=0x7fe684156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:42.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.005+0000 7fe68a79c700 1 --2- 172.21.15.72:0/841755194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6840aa290 0x7fe684156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.005+0000 7fe68a79c700 1 -- 172.21.15.72:0/841755194 >> v1:172.21.15.146:6789/0 conn(0x7fe6840a9eb0 legacy=0x7fe6840c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:42.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.005+0000 7fe68a79c700 1 -- 172.21.15.72:0/841755194 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6840c6670 con 0x7fe6841574b0 2023-08-31T19:07:42.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.006+0000 7fe68a79c700 1 --2- 172.21.15.72:0/841755194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6841574b0 0x7fe6840c0a30 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7fe67c009f20 tx=0x7fe67c009840).ready entity=mon.0 client_cookie=aefa7fffc3eb7f07 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:42.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.006+0000 7fe688f99700 1 -- 172.21.15.72:0/841755194 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c00e070 con 0x7fe6841574b0 2023-08-31T19:07:42.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.006+0000 7fe688f99700 1 -- 172.21.15.72:0/841755194 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67c00b990 con 0x7fe6841574b0 2023-08-31T19:07:42.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.006+0000 7fe688f99700 1 -- 172.21.15.72:0/841755194 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c00bd10 con 0x7fe6841574b0 2023-08-31T19:07:42.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.007+0000 7fe68c1ff700 1 -- 172.21.15.72:0/841755194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6841574b0 msgr2=0x7fe6840c0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:42.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.007+0000 7fe68c1ff700 1 --2- 172.21.15.72:0/841755194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6841574b0 0x7fe6840c0a30 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7fe67c009f20 tx=0x7fe67c009840).stop 2023-08-31T19:07:42.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.007+0000 7fe68c1ff700 1 -- 172.21.15.72:0/841755194 shutdown_connections 2023-08-31T19:07:42.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.007+0000 7fe68c1ff700 1 --2- 172.21.15.72:0/841755194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6841574b0 0x7fe6840c0a30 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.007+0000 7fe68c1ff700 1 --2- 172.21.15.72:0/841755194 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6840aa290 0x7fe684156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.007+0000 7fe68c1ff700 1 -- 172.21.15.72:0/841755194 >> 172.21.15.72:0/841755194 conn(0x7fe6840c82e0 msgr2=0x7fe68405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:42.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.007+0000 7fe68c1ff700 1 -- 172.21.15.72:0/841755194 shutdown_connections 2023-08-31T19:07:42.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.007+0000 7fe68c1ff700 1 -- 172.21.15.72:0/841755194 wait complete. 2023-08-31T19:07:42.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.008+0000 7fe68c1ff700 1 Processor -- start 2023-08-31T19:07:42.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.008+0000 7fe68c1ff700 1 -- start start 2023-08-31T19:07:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.009+0000 7fe68c1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6840a9eb0 0x7fe684165240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.009+0000 7fe68c1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6840aa290 0x7fe684155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.009+0000 7fe68c1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6841574b0 0x7fe684155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.009+0000 7fe68c1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe684155d00 con 0x7fe6840a9eb0 2023-08-31T19:07:42.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.009+0000 7fe68c1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe684153cc0 con 0x7fe6841574b0 2023-08-31T19:07:42.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.009+0000 7fe68c1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6841530b0 con 0x7fe6840aa290 2023-08-31T19:07:42.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.009+0000 7fe689f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6840a9eb0 0x7fe684165240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:42.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.010+0000 7fe689f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6840a9eb0 0x7fe684165240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48266/0 (socket says 172.21.15.72:48266) 2023-08-31T19:07:42.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.010+0000 7fe689f9b700 1 -- 172.21.15.72:0/2277410837 learned_addr learned my addr 172.21.15.72:0/2277410837 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:42.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.010+0000 7fe68979a700 1 --2- 172.21.15.72:0/2277410837 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6840aa290 0x7fe684155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:42.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.010+0000 7fe68a79c700 1 --2- 172.21.15.72:0/2277410837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6841574b0 0x7fe684155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:42.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.010+0000 7fe689f9b700 1 -- 172.21.15.72:0/2277410837 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6840aa290 msgr2=0x7fe684155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.010+0000 7fe689f9b700 1 --2- 172.21.15.72:0/2277410837 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6840aa290 0x7fe684155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.010+0000 7fe689f9b700 1 -- 172.21.15.72:0/2277410837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6841574b0 msgr2=0x7fe684155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.010+0000 7fe689f9b700 1 --2- 172.21.15.72:0/2277410837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6841574b0 0x7fe684155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.010+0000 7fe689f9b700 1 -- 172.21.15.72:0/2277410837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c009ae0 con 0x7fe6840a9eb0 2023-08-31T19:07:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.010+0000 7fe689f9b700 1 --2- 172.21.15.72:0/2277410837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6840a9eb0 0x7fe684165240 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7fe68000b490 tx=0x7fe680009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:42.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.010+0000 7fe679ffb700 1 -- 172.21.15.72:0/2277410837 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68000be40 con 0x7fe6840a9eb0 2023-08-31T19:07:42.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.010+0000 7fe679ffb700 1 -- 172.21.15.72:0/2277410837 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6800090d0 con 0x7fe6840a9eb0 2023-08-31T19:07:42.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.010+0000 7fe68c1ff700 1 -- 172.21.15.72:0/2277410837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe684153390 con 0x7fe6840a9eb0 2023-08-31T19:07:42.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.011+0000 7fe679ffb700 1 -- 172.21.15.72:0/2277410837 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe680012640 con 0x7fe6840a9eb0 2023-08-31T19:07:42.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.011+0000 7fe68c1ff700 1 -- 172.21.15.72:0/2277410837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe684153950 con 0x7fe6840a9eb0 2023-08-31T19:07:42.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.012+0000 7fe68c1ff700 1 -- 172.21.15.72:0/2277410837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe68406c6b0 con 0x7fe6840a9eb0 2023-08-31T19:07:42.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.012+0000 7fe679ffb700 1 -- 172.21.15.72:0/2277410837 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 61) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fe6800129f0 con 0x7fe6840a9eb0 2023-08-31T19:07:42.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.013+0000 7fe679ffb700 1 --2- 172.21.15.72:0/2277410837 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe66805efc0 0x7fe668061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.013+0000 7fe679ffb700 1 -- 172.21.15.72:0/2277410837 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fe680079f90 con 0x7fe6840a9eb0 2023-08-31T19:07:42.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.013+0000 7fe68979a700 1 -- 172.21.15.72:0/2277410837 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe66805efc0 msgr2=0x7fe668061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:42.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.013+0000 7fe68979a700 1 --2- 172.21.15.72:0/2277410837 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe66805efc0 0x7fe668061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.017+0000 7fe679ffb700 1 -- 172.21.15.72:0/2277410837 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe68004ae90 con 0x7fe6840a9eb0 2023-08-31T19:07:42.038 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:42.038+0000 7f3321a65680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:07:42.101 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:42.101+0000 7f6a3ad07680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:07:42.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.214+0000 7fe68979a700 1 -- 172.21.15.72:0/2277410837 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe66805efc0 msgr2=0x7fe668061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:42.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.214+0000 7fe68979a700 1 --2- 172.21.15.72:0/2277410837 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe66805efc0 0x7fe668061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:07:42.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.230+0000 7fe68c1ff700 1 -- 172.21.15.72:0/2277410837 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6840655b0 con 0x7fe6840a9eb0 2023-08-31T19:07:42.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.230+0000 7fe679ffb700 1 -- 172.21.15.72:0/2277410837 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fe68004e4b0 con 0x7fe6840a9eb0 2023-08-31T19:07:42.231 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:42.231 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6623,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2723616156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2723616156},{"type":"v1","addr":"172.21.15.72:6836","nonce":2723616156}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1506898460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1506898460},{"type":"v1","addr":"172.21.15.146:6834","nonce":1506898460}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1176286638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1176286638},{"type":"v1","addr":"172.21.15.146:6835","nonce":1176286638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:07:21.608188+0000","modified":"2023-08-31T19:07:24.626195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8058},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8058":{"gid":8058,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/1400178853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1400178853},{"type":"v1","addr":"172.21.15.72:6837","nonce":1400178853}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-31T19:07:42.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.232+0000 7fe68c1ff700 1 -- 172.21.15.72:0/2277410837 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe66805efc0 msgr2=0x7fe668061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:42.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.232+0000 7fe68c1ff700 1 --2- 172.21.15.72:0/2277410837 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe66805efc0 0x7fe668061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:42.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.232+0000 7fe68c1ff700 1 -- 172.21.15.72:0/2277410837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6840a9eb0 msgr2=0x7fe684165240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.232+0000 7fe68c1ff700 1 --2- 172.21.15.72:0/2277410837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6840a9eb0 0x7fe684165240 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7fe68000b490 tx=0x7fe680009060).stop 2023-08-31T19:07:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.232+0000 7fe68c1ff700 1 -- 172.21.15.72:0/2277410837 shutdown_connections 2023-08-31T19:07:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.232+0000 7fe68c1ff700 1 --2- 172.21.15.72:0/2277410837 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fe66805efc0 0x7fe668061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.232+0000 7fe68c1ff700 1 --2- 172.21.15.72:0/2277410837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6841574b0 0x7fe684155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.232+0000 7fe68c1ff700 1 --2- 172.21.15.72:0/2277410837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6840a9eb0 0x7fe684165240 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.232+0000 7fe68c1ff700 1 --2- 172.21.15.72:0/2277410837 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6840aa290 0x7fe684155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.232+0000 7fe68c1ff700 1 -- 172.21.15.72:0/2277410837 >> 172.21.15.72:0/2277410837 conn(0x7fe6840c82e0 msgr2=0x7fe6840c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:42.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.233+0000 7fe68c1ff700 1 -- 172.21.15.72:0/2277410837 shutdown_connections 2023-08-31T19:07:42.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.233+0000 7fe68c1ff700 1 -- 172.21.15.72:0/2277410837 wait complete. 2023-08-31T19:07:42.236 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 64 2023-08-31T19:07:42.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:07:42.263 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:42.263+0000 7f3321a65680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:07:42.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.442+0000 7f34561ff700 1 Processor -- start 2023-08-31T19:07:42.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.442+0000 7f34561ff700 1 -- start start 2023-08-31T19:07:42.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.444+0000 7f34561ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34501510a0 0x7f345015b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.444+0000 7f34561ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34500641e0 con 0x7f34501505b0 2023-08-31T19:07:42.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.444+0000 7f34561ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3450068b90 con 0x7f34500c2450 2023-08-31T19:07:42.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.444+0000 7f34561ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3450151580 con 0x7f34501510a0 2023-08-31T19:07:42.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.445+0000 7f344ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34501510a0 0x7f345015b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:42.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.445+0000 7f344f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f34501505b0 0x7f34500c1d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58834/0 (socket says 172.21.15.72:58834) 2023-08-31T19:07:42.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.445+0000 7f344f7fe700 1 -- 172.21.15.72:0/2552937527 learned_addr learned my addr 172.21.15.72:0/2552937527 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:42.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.445+0000 7f344e7fc700 1 -- 172.21.15.72:0/2552937527 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126427233 0 0) 0x7f3450068b90 con 0x7f34500c2450 2023-08-31T19:07:42.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.445+0000 7f344ffff700 1 -- 172.21.15.72:0/2552937527 >> v1:172.21.15.146:6789/0 conn(0x7f34500c2450 legacy=0x7f3450150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:42.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.445+0000 7f344ffff700 1 -- 172.21.15.72:0/2552937527 >> v1:172.21.15.72:6789/0 conn(0x7f34501505b0 legacy=0x7f34500c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:42.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.445+0000 7f344ffff700 1 -- 172.21.15.72:0/2552937527 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3450151860 con 0x7f34501510a0 2023-08-31T19:07:42.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.445+0000 7f344ffff700 1 --2- 172.21.15.72:0/2552937527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34501510a0 0x7f345015b630 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f3448009e60 tx=0x7f3448009780).ready entity=mon.0 client_cookie=6ad93185872156ef server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:42.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.445+0000 7f344e7fc700 1 -- 172.21.15.72:0/2552937527 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344800e070 con 0x7f34501510a0 2023-08-31T19:07:42.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.446+0000 7f344e7fc700 1 -- 172.21.15.72:0/2552937527 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344800bb30 con 0x7f34501510a0 2023-08-31T19:07:42.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.446+0000 7f344e7fc700 1 -- 172.21.15.72:0/2552937527 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344800beb0 con 0x7f34501510a0 2023-08-31T19:07:42.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.446+0000 7f34561ff700 1 -- 172.21.15.72:0/2552937527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34501510a0 msgr2=0x7f345015b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:42.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.446+0000 7f34561ff700 1 --2- 172.21.15.72:0/2552937527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34501510a0 0x7f345015b630 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f3448009e60 tx=0x7f3448009780).stop 2023-08-31T19:07:42.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.446+0000 7f34561ff700 1 -- 172.21.15.72:0/2552937527 shutdown_connections 2023-08-31T19:07:42.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.446+0000 7f34561ff700 1 --2- 172.21.15.72:0/2552937527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34501510a0 0x7f345015b630 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.446+0000 7f34561ff700 1 -- 172.21.15.72:0/2552937527 >> 172.21.15.72:0/2552937527 conn(0x7f34500c6b10 msgr2=0x7f34500c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:42.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.446+0000 7f34561ff700 1 -- 172.21.15.72:0/2552937527 shutdown_connections 2023-08-31T19:07:42.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.446+0000 7f34561ff700 1 -- 172.21.15.72:0/2552937527 wait complete. 2023-08-31T19:07:42.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.449+0000 7f34561ff700 1 Processor -- start 2023-08-31T19:07:42.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.449+0000 7f34561ff700 1 -- start start 2023-08-31T19:07:42.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.450+0000 7f34561ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34500c2450 0x7f3450164f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.450+0000 7f34561ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34501505b0 0x7f345014b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.451+0000 7f34561ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34501510a0 0x7f34500c0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.451+0000 7f34561ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34500c0a10 con 0x7f34501505b0 2023-08-31T19:07:42.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.451+0000 7f34561ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34500c0cf0 con 0x7f34500c2450 2023-08-31T19:07:42.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.451+0000 7f34561ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3450164700 con 0x7f34501510a0 2023-08-31T19:07:42.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.451+0000 7f344effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34501505b0 0x7f345014b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:42.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.451+0000 7f344f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34500c2450 0x7f3450164f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:42.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.451+0000 7f344effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34501505b0 0x7f345014b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48282/0 (socket says 172.21.15.72:48282) 2023-08-31T19:07:42.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.451+0000 7f344effd700 1 -- 172.21.15.72:0/641123745 learned_addr learned my addr 172.21.15.72:0/641123745 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:42.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.451+0000 7f344ffff700 1 --2- 172.21.15.72:0/641123745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34501510a0 0x7f34500c0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:42.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.451+0000 7f344effd700 1 -- 172.21.15.72:0/641123745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34501510a0 msgr2=0x7f34500c0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:42.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.451+0000 7f344effd700 1 --2- 172.21.15.72:0/641123745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34501510a0 0x7f34500c0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.451+0000 7f344effd700 1 -- 172.21.15.72:0/641123745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34500c2450 msgr2=0x7f3450164f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:42.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.451+0000 7f344effd700 1 --2- 172.21.15.72:0/641123745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34500c2450 0x7f3450164f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.451+0000 7f344effd700 1 -- 172.21.15.72:0/641123745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3448009a20 con 0x7f34501505b0 2023-08-31T19:07:42.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.451+0000 7f344f7fe700 1 --2- 172.21.15.72:0/641123745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34500c2450 0x7f3450164f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:07:42.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.452+0000 7f344effd700 1 --2- 172.21.15.72:0/641123745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34501505b0 0x7f345014b8b0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f3444001eb0 tx=0x7f3444007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:42.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.452+0000 7f34377fe700 1 -- 172.21.15.72:0/641123745 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344400ce30 con 0x7f34501505b0 2023-08-31T19:07:42.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.452+0000 7f34377fe700 1 -- 172.21.15.72:0/641123745 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344400f470 con 0x7f34501505b0 2023-08-31T19:07:42.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.452+0000 7f34377fe700 1 -- 172.21.15.72:0/641123745 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344400f830 con 0x7f34501505b0 2023-08-31T19:07:42.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.452+0000 7f34561ff700 1 -- 172.21.15.72:0/641123745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34501649e0 con 0x7f34501505b0 2023-08-31T19:07:42.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.452+0000 7f34561ff700 1 -- 172.21.15.72:0/641123745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345014bda0 con 0x7f34501505b0 2023-08-31T19:07:42.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.453+0000 7f34561ff700 1 -- 172.21.15.72:0/641123745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345006c6b0 con 0x7f34501505b0 2023-08-31T19:07:42.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.454+0000 7f34377fe700 1 -- 172.21.15.72:0/641123745 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 61) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f344400fba0 con 0x7f34501505b0 2023-08-31T19:07:42.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.455+0000 7f34377fe700 1 --2- 172.21.15.72:0/641123745 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f343c05efc0 0x7f343c061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.455+0000 7f34377fe700 1 -- 172.21.15.72:0/641123745 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f3444079a00 con 0x7f34501505b0 2023-08-31T19:07:42.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.455+0000 7f344f7fe700 1 -- 172.21.15.72:0/641123745 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f343c05efc0 msgr2=0x7f343c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:42.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.455+0000 7f344f7fe700 1 --2- 172.21.15.72:0/641123745 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f343c05efc0 0x7f343c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:42.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.458+0000 7f34377fe700 1 -- 172.21.15.72:0/641123745 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f344404a800 con 0x7f34501505b0 2023-08-31T19:07:42.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.650+0000 7f34561ff700 1 -- 172.21.15.72:0/641123745 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f345014fac0 con 0x7f34501505b0 2023-08-31T19:07:42.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.651+0000 7f34377fe700 1 -- 172.21.15.72:0/641123745 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f344404de20 con 0x7f34501505b0 2023-08-31T19:07:42.652 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:42.652 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":143,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:07:35.849624+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:07:20.032158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-31T19:07:20.589299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/688771534":"2023-09-01T19:07:35.849574+0000","172.21.15.72:0/2702061734":"2023-09-01T19:07:35.849574+0000","172.21.15.72:0/496703134":"2023-09-01T19:07:35.849574+0000","172.21.15.72:6833/143463":"2023-09-01T19:07:35.849574+0000","172.21.15.72:6832/143463":"2023-09-01T19:07:35.849574+0000","172.21.15.72:0/2921401112":"2023-09-01T19:07:35.849574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:07:42.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.653+0000 7f34561ff700 1 -- 172.21.15.72:0/641123745 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f343c05efc0 msgr2=0x7f343c061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:42.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.653+0000 7f34561ff700 1 --2- 172.21.15.72:0/641123745 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f343c05efc0 0x7f343c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:42.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.653+0000 7f34561ff700 1 -- 172.21.15.72:0/641123745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34501505b0 msgr2=0x7f345014b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:42.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.653+0000 7f34561ff700 1 --2- 172.21.15.72:0/641123745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34501505b0 0x7f345014b8b0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f3444001eb0 tx=0x7f3444007c40).stop 2023-08-31T19:07:42.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.653+0000 7f34561ff700 1 -- 172.21.15.72:0/641123745 shutdown_connections 2023-08-31T19:07:42.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.653+0000 7f34561ff700 1 --2- 172.21.15.72:0/641123745 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34501510a0 0x7f34500c0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.653+0000 7f34561ff700 1 --2- 172.21.15.72:0/641123745 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f343c05efc0 0x7f343c061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:42.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.653+0000 7f34561ff700 1 --2- 172.21.15.72:0/641123745 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34500c2450 0x7f3450164f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.653+0000 7f34561ff700 1 --2- 172.21.15.72:0/641123745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34501505b0 0x7f345014b8b0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.653+0000 7f34561ff700 1 -- 172.21.15.72:0/641123745 >> 172.21.15.72:0/641123745 conn(0x7f34500c6b10 msgr2=0x7f34500c1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:42.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.654+0000 7f34561ff700 1 -- 172.21.15.72:0/641123745 shutdown_connections 2023-08-31T19:07:42.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.654+0000 7f34561ff700 1 -- 172.21.15.72:0/641123745 wait complete. 2023-08-31T19:07:42.673 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T19:07:42.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:07:42.898 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:42.898+0000 7f6a3ad07680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:07:42.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.904+0000 7f124e3ff700 1 Processor -- start 2023-08-31T19:07:42.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.905+0000 7f124e3ff700 1 -- start start 2023-08-31T19:07:42.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.906+0000 7f124e3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f124806a260 0x7f1248069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.906+0000 7f124e3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1248064270 con 0x7f1248065710 2023-08-31T19:07:42.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.906+0000 7f124e3ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12480bcc20 con 0x7f1248069170 2023-08-31T19:07:42.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.906+0000 7f124e3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12480bca40 con 0x7f124806a260 2023-08-31T19:07:42.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.907+0000 7f12477fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f124806a260 0x7f1248069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:42.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.907+0000 7f124c99c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1248065710 0x7f1248069a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55490/0 (socket says 172.21.15.72:55490) 2023-08-31T19:07:42.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.907+0000 7f124c99c700 1 -- 172.21.15.72:0/2710295361 learned_addr learned my addr 172.21.15.72:0/2710295361 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:42.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.907+0000 7f12477fe700 1 -- 172.21.15.72:0/2710295361 >> v1:172.21.15.146:6789/0 conn(0x7f1248069170 legacy=0x7f12480c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:42.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.907+0000 7f12477fe700 1 -- 172.21.15.72:0/2710295361 >> v1:172.21.15.72:6789/0 conn(0x7f1248065710 legacy=0x7f1248069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:42.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.907+0000 7f12477fe700 1 -- 172.21.15.72:0/2710295361 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1248154890 con 0x7f124806a260 2023-08-31T19:07:42.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.907+0000 7f1246ffd700 1 -- 172.21.15.72:0/2710295361 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052704019 0 0) 0x7f1248064270 con 0x7f1248065710 2023-08-31T19:07:42.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.907+0000 7f12477fe700 1 --2- 172.21.15.72:0/2710295361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f124806a260 0x7f1248069550 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f12480c7670 tx=0x7f123c009060).ready entity=mon.0 client_cookie=3064e55f1e8a9f66 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:42.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.908+0000 7f1246ffd700 1 -- 172.21.15.72:0/2710295361 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c00b580 con 0x7f124806a260 2023-08-31T19:07:42.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.908+0000 7f1246ffd700 1 -- 172.21.15.72:0/2710295361 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c00b6e0 con 0x7f124806a260 2023-08-31T19:07:42.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.908+0000 7f1246ffd700 1 -- 172.21.15.72:0/2710295361 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c00ba60 con 0x7f124806a260 2023-08-31T19:07:42.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.909+0000 7f124e3ff700 1 -- 172.21.15.72:0/2710295361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f124806a260 msgr2=0x7f1248069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:42.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.909+0000 7f124e3ff700 1 --2- 172.21.15.72:0/2710295361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f124806a260 0x7f1248069550 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f12480c7670 tx=0x7f123c009060).stop 2023-08-31T19:07:42.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.909+0000 7f124e3ff700 1 -- 172.21.15.72:0/2710295361 shutdown_connections 2023-08-31T19:07:42.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.909+0000 7f124e3ff700 1 --2- 172.21.15.72:0/2710295361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f124806a260 0x7f1248069550 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.909+0000 7f124e3ff700 1 -- 172.21.15.72:0/2710295361 >> 172.21.15.72:0/2710295361 conn(0x7f12480c6b10 msgr2=0x7f12480c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:42.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.909+0000 7f124e3ff700 1 -- 172.21.15.72:0/2710295361 shutdown_connections 2023-08-31T19:07:42.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.909+0000 7f124e3ff700 1 -- 172.21.15.72:0/2710295361 wait complete. 2023-08-31T19:07:42.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.910+0000 7f124e3ff700 1 Processor -- start 2023-08-31T19:07:42.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.910+0000 7f124e3ff700 1 -- start start 2023-08-31T19:07:42.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.911+0000 7f124e3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1248065710 0x7f12480a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.911+0000 7f124e3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1248069170 0x7f12480a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.911+0000 7f124e3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f124806a260 0x7f1248164540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.911+0000 7f124e3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1248154030 con 0x7f1248069170 2023-08-31T19:07:42.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.911+0000 7f124e3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12480a5220 con 0x7f1248065710 2023-08-31T19:07:42.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.911+0000 7f124e3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12480a6010 con 0x7f124806a260 2023-08-31T19:07:42.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.912+0000 7f12477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1248069170 0x7f12480a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:42.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.912+0000 7f1247fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1248065710 0x7f12480a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:42.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.912+0000 7f12477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1248069170 0x7f12480a4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49926/0 (socket says 172.21.15.72:49926) 2023-08-31T19:07:42.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.912+0000 7f12477fe700 1 -- 172.21.15.72:0/435663530 learned_addr learned my addr 172.21.15.72:0/435663530 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:42.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.912+0000 7f124c99c700 1 --2- 172.21.15.72:0/435663530 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f124806a260 0x7f1248164540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:42.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.912+0000 7f12477fe700 1 -- 172.21.15.72:0/435663530 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f124806a260 msgr2=0x7f1248164540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:42.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.912+0000 7f12477fe700 1 --2- 172.21.15.72:0/435663530 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f124806a260 0x7f1248164540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.912+0000 7f12477fe700 1 -- 172.21.15.72:0/435663530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1248065710 msgr2=0x7f12480a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:42.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.912+0000 7f12477fe700 1 --2- 172.21.15.72:0/435663530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1248065710 0x7f12480a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:42.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.912+0000 7f12477fe700 1 -- 172.21.15.72:0/435663530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c0092a0 con 0x7f1248069170 2023-08-31T19:07:42.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.912+0000 7f12477fe700 1 --2- 172.21.15.72:0/435663530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1248069170 0x7f12480a4d30 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7f123c009e80 tx=0x7f123c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:42.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.913+0000 7f122ffff700 1 -- 172.21.15.72:0/435663530 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c00b850 con 0x7f1248069170 2023-08-31T19:07:42.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.913+0000 7f122ffff700 1 -- 172.21.15.72:0/435663530 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c00b9b0 con 0x7f1248069170 2023-08-31T19:07:42.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.913+0000 7f122ffff700 1 -- 172.21.15.72:0/435663530 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c01b670 con 0x7f1248069170 2023-08-31T19:07:42.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.913+0000 7f124e3ff700 1 -- 172.21.15.72:0/435663530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1248165370 con 0x7f1248069170 2023-08-31T19:07:42.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.913+0000 7f124e3ff700 1 -- 172.21.15.72:0/435663530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12480a56e0 con 0x7f1248069170 2023-08-31T19:07:42.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.914+0000 7f124e3ff700 1 -- 172.21.15.72:0/435663530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124806c6b0 con 0x7f1248069170 2023-08-31T19:07:42.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.915+0000 7f122ffff700 1 -- 172.21.15.72:0/435663530 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 61) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f123c01ba60 con 0x7f1248069170 2023-08-31T19:07:42.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.915+0000 7f122ffff700 1 --2- 172.21.15.72:0/435663530 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f123405efc0 0x7f1234061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:42.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.916+0000 7f122ffff700 1 -- 172.21.15.72:0/435663530 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f123c07bb60 con 0x7f1248069170 2023-08-31T19:07:42.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.916+0000 7f1247fff700 1 -- 172.21.15.72:0/435663530 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f123405efc0 msgr2=0x7f1234061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:42.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.916+0000 7f1247fff700 1 --2- 172.21.15.72:0/435663530 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f123405efc0 0x7f1234061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:42.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:42.920+0000 7f122ffff700 1 -- 172.21.15.72:0/435663530 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f123c04c960 con 0x7f1248069170 2023-08-31T19:07:42.986 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:42.986+0000 7f6a3ad07680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:07:43.079 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:43.079+0000 7f6a3ad07680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:07:43.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.117+0000 7f1247fff700 1 -- 172.21.15.72:0/435663530 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f123405efc0 msgr2=0x7f1234061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:43.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.117+0000 7f1247fff700 1 --2- 172.21.15.72:0/435663530 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f123405efc0 0x7f1234061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:07:43.126 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:43.126+0000 7f3321a65680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:07:43.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.135+0000 7f124e3ff700 1 -- 172.21.15.72:0/435663530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12480a6150 con 0x7f1248069170 2023-08-31T19:07:43.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.136+0000 7f122ffff700 1 -- 172.21.15.72:0/435663530 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f123c028070 con 0x7f1248069170 2023-08-31T19:07:43.137 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:43.137 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6623,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2723616156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2723616156},{"type":"v1","addr":"172.21.15.72:6836","nonce":2723616156}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1506898460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1506898460},{"type":"v1","addr":"172.21.15.146:6834","nonce":1506898460}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1176286638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1176286638},{"type":"v1","addr":"172.21.15.146:6835","nonce":1176286638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:07:21.608188+0000","modified":"2023-08-31T19:07:24.626195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8058},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8058":{"gid":8058,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/1400178853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1400178853},{"type":"v1","addr":"172.21.15.72:6837","nonce":1400178853}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-31T19:07:43.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.140+0000 7f124e3ff700 1 -- 172.21.15.72:0/435663530 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f123405efc0 msgr2=0x7f1234061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:43.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.140+0000 7f124e3ff700 1 --2- 172.21.15.72:0/435663530 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f123405efc0 0x7f1234061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:43.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.140+0000 7f124e3ff700 1 -- 172.21.15.72:0/435663530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1248069170 msgr2=0x7f12480a4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:43.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.140+0000 7f124e3ff700 1 --2- 172.21.15.72:0/435663530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1248069170 0x7f12480a4d30 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7f123c009e80 tx=0x7f123c017000).stop 2023-08-31T19:07:43.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.140+0000 7f124e3ff700 1 -- 172.21.15.72:0/435663530 shutdown_connections 2023-08-31T19:07:43.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.140+0000 7f124e3ff700 1 --2- 172.21.15.72:0/435663530 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f124806a260 0x7f1248164540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.140+0000 7f124e3ff700 1 --2- 172.21.15.72:0/435663530 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f123405efc0 0x7f1234061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:43.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.140+0000 7f124e3ff700 1 --2- 172.21.15.72:0/435663530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1248065710 0x7f12480a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.140+0000 7f124e3ff700 1 --2- 172.21.15.72:0/435663530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1248069170 0x7f12480a4d30 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.140+0000 7f124e3ff700 1 -- 172.21.15.72:0/435663530 >> 172.21.15.72:0/435663530 conn(0x7f12480c6b10 msgr2=0x7f12480abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:43.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.140+0000 7f124e3ff700 1 -- 172.21.15.72:0/435663530 shutdown_connections 2023-08-31T19:07:43.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.140+0000 7f124e3ff700 1 -- 172.21.15.72:0/435663530 wait complete. 2023-08-31T19:07:43.143 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 64 2023-08-31T19:07:43.165 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:07:43.227 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:43.227+0000 7f3321a65680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:07:43.262 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:43.262+0000 7f6a3ad07680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:07:43.325 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:43.325+0000 7f3321a65680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:07:43.350 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:43.350+0000 7f6a3ad07680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:07:43.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.358+0000 7ff48f1ff700 1 Processor -- start 2023-08-31T19:07:43.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.358+0000 7ff48f1ff700 1 -- start start 2023-08-31T19:07:43.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.359+0000 7ff48f1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff488135030 0x7ff4880c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:43.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.359+0000 7ff48f1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff4880bba70 0x7ff4880c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:43.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.359+0000 7ff48f1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4880c26b0 con 0x7ff488155c00 2023-08-31T19:07:43.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.359+0000 7ff48f1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4880c1e80 con 0x7ff488135030 2023-08-31T19:07:43.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.359+0000 7ff48f1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4880bc250 con 0x7ff4880bba70 2023-08-31T19:07:43.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.359+0000 7ff48cf9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff488135030 0x7ff4880c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:43.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.359+0000 7ff48cf9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff488135030 0x7ff4880c7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49930/0 (socket says 172.21.15.72:49930) 2023-08-31T19:07:43.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.359+0000 7ff48cf9b700 1 -- 172.21.15.72:0/3982244104 learned_addr learned my addr 172.21.15.72:0/3982244104 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:43.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.360+0000 7ff487fff700 1 --2- 172.21.15.72:0/3982244104 >> v2:172.21.15.146:3300/0 conn(0x7ff4880bba70 0x7ff4880c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:43.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.360+0000 7ff48cf9b700 1 -- 172.21.15.72:0/3982244104 >> v2:172.21.15.146:3300/0 conn(0x7ff4880bba70 msgr2=0x7ff4880c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:43.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.360+0000 7ff48cf9b700 1 --2- 172.21.15.72:0/3982244104 >> v2:172.21.15.146:3300/0 conn(0x7ff4880bba70 0x7ff4880c2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.360+0000 7ff48cf9b700 1 -- 172.21.15.72:0/3982244104 >> v1:172.21.15.146:6789/0 conn(0x7ff488155c00 legacy=0x7ff4880641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:43.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.360+0000 7ff48cf9b700 1 -- 172.21.15.72:0/3982244104 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880bbf70 con 0x7ff488135030 2023-08-31T19:07:43.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.360+0000 7ff487fff700 1 --2- 172.21.15.72:0/3982244104 >> v2:172.21.15.146:3300/0 conn(0x7ff4880bba70 0x7ff4880c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:43.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.360+0000 7ff48cf9b700 1 --2- 172.21.15.72:0/3982244104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff488135030 0x7ff4880c7630 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7ff48806ab00 tx=0x7ff47c0090f0).ready entity=mon.0 client_cookie=b800b3cb0c37a39c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:43.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.360+0000 7ff4877fe700 1 -- 172.21.15.72:0/3982244104 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00b5a0 con 0x7ff488135030 2023-08-31T19:07:43.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.360+0000 7ff4877fe700 1 -- 172.21.15.72:0/3982244104 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c00b700 con 0x7ff488135030 2023-08-31T19:07:43.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.360+0000 7ff4877fe700 1 -- 172.21.15.72:0/3982244104 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00ba80 con 0x7ff488135030 2023-08-31T19:07:43.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.361+0000 7ff48f1ff700 1 -- 172.21.15.72:0/3982244104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff488135030 msgr2=0x7ff4880c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:43.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.361+0000 7ff48f1ff700 1 --2- 172.21.15.72:0/3982244104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff488135030 0x7ff4880c7630 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7ff48806ab00 tx=0x7ff47c0090f0).stop 2023-08-31T19:07:43.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.361+0000 7ff48f1ff700 1 -- 172.21.15.72:0/3982244104 shutdown_connections 2023-08-31T19:07:43.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.361+0000 7ff48f1ff700 1 --2- 172.21.15.72:0/3982244104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff488135030 0x7ff4880c7630 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.361+0000 7ff48f1ff700 1 --2- 172.21.15.72:0/3982244104 >> v2:172.21.15.146:3300/0 conn(0x7ff4880bba70 0x7ff4880c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.361+0000 7ff48f1ff700 1 -- 172.21.15.72:0/3982244104 >> 172.21.15.72:0/3982244104 conn(0x7ff4880c6b10 msgr2=0x7ff4880c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:43.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.361+0000 7ff48f1ff700 1 -- 172.21.15.72:0/3982244104 shutdown_connections 2023-08-31T19:07:43.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.361+0000 7ff48f1ff700 1 -- 172.21.15.72:0/3982244104 wait complete. 2023-08-31T19:07:43.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.363+0000 7ff48f1ff700 1 Processor -- start 2023-08-31T19:07:43.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.363+0000 7ff48f1ff700 1 -- start start 2023-08-31T19:07:43.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff48f1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4880bba70 0x7ff4881684d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:43.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff48f1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff488135030 0x7ff4880ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:43.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff48f1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff488155c00 0x7ff48814bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:43.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff48f1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48806a2d0 con 0x7ff488135030 2023-08-31T19:07:43.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff48f1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880abef0 con 0x7ff488155c00 2023-08-31T19:07:43.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff48f1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880ab600 con 0x7ff4880bba70 2023-08-31T19:07:43.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff487fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff488135030 0x7ff4880ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:43.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff487fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff488135030 0x7ff4880ac380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49932/0 (socket says 172.21.15.72:49932) 2023-08-31T19:07:43.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff487fff700 1 -- 172.21.15.72:0/4285036143 learned_addr learned my addr 172.21.15.72:0/4285036143 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:43.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff48cf9b700 1 --2- 172.21.15.72:0/4285036143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4880bba70 0x7ff4881684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:43.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff48d79c700 1 --2- 172.21.15.72:0/4285036143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff488155c00 0x7ff48814bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:43.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff487fff700 1 -- 172.21.15.72:0/4285036143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4880bba70 msgr2=0x7ff4881684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:43.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff487fff700 1 --2- 172.21.15.72:0/4285036143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4880bba70 0x7ff4881684d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff487fff700 1 -- 172.21.15.72:0/4285036143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff488155c00 msgr2=0x7ff48814bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:43.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff487fff700 1 --2- 172.21.15.72:0/4285036143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff488155c00 0x7ff48814bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.364+0000 7ff487fff700 1 -- 172.21.15.72:0/4285036143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c009370 con 0x7ff488135030 2023-08-31T19:07:43.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.365+0000 7ff487fff700 1 --2- 172.21.15.72:0/4285036143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff488135030 0x7ff4880ac380 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7ff47400d860 tx=0x7ff474008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:43.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.365+0000 7ff484ff9700 1 -- 172.21.15.72:0/4285036143 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47400f520 con 0x7ff488135030 2023-08-31T19:07:43.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.365+0000 7ff484ff9700 1 -- 172.21.15.72:0/4285036143 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47400f680 con 0x7ff488135030 2023-08-31T19:07:43.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.365+0000 7ff484ff9700 1 -- 172.21.15.72:0/4285036143 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47400fa20 con 0x7ff488135030 2023-08-31T19:07:43.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.365+0000 7ff48f1ff700 1 -- 172.21.15.72:0/4285036143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff488069ff0 con 0x7ff488135030 2023-08-31T19:07:43.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.365+0000 7ff48f1ff700 1 -- 172.21.15.72:0/4285036143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4880abb80 con 0x7ff488135030 2023-08-31T19:07:43.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.367+0000 7ff48f1ff700 1 -- 172.21.15.72:0/4285036143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4880ac080 con 0x7ff488135030 2023-08-31T19:07:43.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.367+0000 7ff484ff9700 1 -- 172.21.15.72:0/4285036143 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 61) v1 ==== 75431+0+0 (secure 0 0 0) 0x7ff474013480 con 0x7ff488135030 2023-08-31T19:07:43.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.368+0000 7ff484ff9700 1 --2- 172.21.15.72:0/4285036143 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff46c05efc0 0x7ff46c061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:43.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.368+0000 7ff484ff9700 1 -- 172.21.15.72:0/4285036143 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7007+0+0 (secure 0 0 0) 0x7ff474079f80 con 0x7ff488135030 2023-08-31T19:07:43.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.368+0000 7ff48cf9b700 1 -- 172.21.15.72:0/4285036143 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff46c05efc0 msgr2=0x7ff46c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:43.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.368+0000 7ff48cf9b700 1 --2- 172.21.15.72:0/4285036143 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff46c05efc0 0x7ff46c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:43.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.371+0000 7ff484ff9700 1 -- 172.21.15.72:0/4285036143 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff47404ad20 con 0x7ff488135030 2023-08-31T19:07:43.492 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:43.492+0000 7f6a3ad07680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:07:43.518 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:43.518+0000 7f3321a65680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:07:43.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.569+0000 7ff48cf9b700 1 -- 172.21.15.72:0/4285036143 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff46c05efc0 msgr2=0x7ff46c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:43.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.569+0000 7ff48cf9b700 1 --2- 172.21.15.72:0/4285036143 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff46c05efc0 0x7ff46c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:07:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.592+0000 7ff48f1ff700 1 -- 172.21.15.72:0/4285036143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4880c2060 con 0x7ff488135030 2023-08-31T19:07:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.593+0000 7ff484ff9700 1 -- 172.21.15.72:0/4285036143 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4497 (secure 0 0 0) 0x7ff47404e340 con 0x7ff488135030 2023-08-31T19:07:43.594 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:43.594 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":64,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6623,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2723616156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2723616156},{"type":"v1","addr":"172.21.15.72:6836","nonce":2723616156}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1506898460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1506898460},{"type":"v1","addr":"172.21.15.146:6834","nonce":1506898460}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1176286638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1176286638},{"type":"v1","addr":"172.21.15.146:6835","nonce":1176286638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:07:21.608188+0000","modified":"2023-08-31T19:07:24.626195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8058},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8058":{"gid":8058,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/1400178853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1400178853},{"type":"v1","addr":"172.21.15.72:6837","nonce":1400178853}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-31T19:07:43.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.595+0000 7ff48f1ff700 1 -- 172.21.15.72:0/4285036143 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff46c05efc0 msgr2=0x7ff46c061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:43.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.595+0000 7ff48f1ff700 1 --2- 172.21.15.72:0/4285036143 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff46c05efc0 0x7ff46c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.595+0000 7ff48f1ff700 1 -- 172.21.15.72:0/4285036143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff488135030 msgr2=0x7ff4880ac380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.595+0000 7ff48f1ff700 1 --2- 172.21.15.72:0/4285036143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff488135030 0x7ff4880ac380 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7ff47400d860 tx=0x7ff474008040).stop 2023-08-31T19:07:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.595+0000 7ff48f1ff700 1 -- 172.21.15.72:0/4285036143 shutdown_connections 2023-08-31T19:07:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.595+0000 7ff48f1ff700 1 --2- 172.21.15.72:0/4285036143 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7ff46c05efc0 0x7ff46c061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.595+0000 7ff48f1ff700 1 --2- 172.21.15.72:0/4285036143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff488155c00 0x7ff48814bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.595+0000 7ff48f1ff700 1 --2- 172.21.15.72:0/4285036143 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4880bba70 0x7ff4881684d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.595+0000 7ff48f1ff700 1 --2- 172.21.15.72:0/4285036143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff488135030 0x7ff4880ac380 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.595+0000 7ff48f1ff700 1 -- 172.21.15.72:0/4285036143 >> 172.21.15.72:0/4285036143 conn(0x7ff4880c6b10 msgr2=0x7ff4880c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.595+0000 7ff48f1ff700 1 -- 172.21.15.72:0/4285036143 shutdown_connections 2023-08-31T19:07:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.595+0000 7ff48f1ff700 1 -- 172.21.15.72:0/4285036143 wait complete. 2023-08-31T19:07:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 64 2023-08-31T19:07:43.610 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:43.610+0000 7f3321a65680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:07:43.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:07:43.623 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:43.623+0000 7f6a3ad07680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:07:43.760 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:43.759+0000 7f3321a65680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:07:43.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.805+0000 7fb36e5ff700 1 Processor -- start 2023-08-31T19:07:43.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.805+0000 7fb36e5ff700 1 -- start start 2023-08-31T19:07:43.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.806+0000 7fb36e5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb368153ff0 0x7fb3680bcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:43.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.806+0000 7fb36e5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3681543d0 0x7fb3680643f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:43.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.807+0000 7fb36e5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb3680648e0 0x7fb3680c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:43.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.807+0000 7fb36e5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3680bc920 con 0x7fb3680648e0 2023-08-31T19:07:43.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.807+0000 7fb36e5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb368064d70 con 0x7fb368153ff0 2023-08-31T19:07:43.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.807+0000 7fb36e5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680bbff0 con 0x7fb3681543d0 2023-08-31T19:07:43.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.807+0000 7fb36cb9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb3680648e0 0x7fb3680c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:43.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.807+0000 7fb36cb9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb3680648e0 0x7fb3680c1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49938/0 (socket says 172.21.15.72:49938) 2023-08-31T19:07:43.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.807+0000 7fb36cb9c700 1 -- 172.21.15.72:0/1335582047 learned_addr learned my addr 172.21.15.72:0/1335582047 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:43.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.807+0000 7fb3677fe700 1 --2- 172.21.15.72:0/1335582047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3681543d0 0x7fb3680643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:43.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.807+0000 7fb367fff700 1 --2- 172.21.15.72:0/1335582047 >> v2:172.21.15.146:3300/0 conn(0x7fb368153ff0 0x7fb3680bcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:43.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.807+0000 7fb36cb9c700 1 -- 172.21.15.72:0/1335582047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3681543d0 msgr2=0x7fb3680643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:43.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.807+0000 7fb36cb9c700 1 --2- 172.21.15.72:0/1335582047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3681543d0 0x7fb3680643f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.807+0000 7fb36cb9c700 1 -- 172.21.15.72:0/1335582047 >> v2:172.21.15.146:3300/0 conn(0x7fb368153ff0 msgr2=0x7fb3680bcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:43.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.807+0000 7fb36cb9c700 1 --2- 172.21.15.72:0/1335582047 >> v2:172.21.15.146:3300/0 conn(0x7fb368153ff0 0x7fb3680bcdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.807+0000 7fb36cb9c700 1 -- 172.21.15.72:0/1335582047 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3680bc2d0 con 0x7fb3680648e0 2023-08-31T19:07:43.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.808+0000 7fb36cb9c700 1 --2- 172.21.15.72:0/1335582047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3680648e0 0x7fb3680c1e80 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7fb3680c4910 tx=0x7fb360009840).ready entity=mon.0 client_cookie=95755e86c34ecce0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:43.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.808+0000 7fb366ffd700 1 -- 172.21.15.72:0/1335582047 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36000e070 con 0x7fb3680648e0 2023-08-31T19:07:43.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.808+0000 7fb366ffd700 1 -- 172.21.15.72:0/1335582047 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36000ba00 con 0x7fb3680648e0 2023-08-31T19:07:43.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.808+0000 7fb366ffd700 1 -- 172.21.15.72:0/1335582047 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36000bd80 con 0x7fb3680648e0 2023-08-31T19:07:43.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.808+0000 7fb36e5ff700 1 -- 172.21.15.72:0/1335582047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3680648e0 msgr2=0x7fb3680c1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:43.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.808+0000 7fb36e5ff700 1 --2- 172.21.15.72:0/1335582047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3680648e0 0x7fb3680c1e80 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7fb3680c4910 tx=0x7fb360009840).stop 2023-08-31T19:07:43.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.808+0000 7fb36e5ff700 1 -- 172.21.15.72:0/1335582047 shutdown_connections 2023-08-31T19:07:43.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.808+0000 7fb36e5ff700 1 --2- 172.21.15.72:0/1335582047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3680648e0 0x7fb3680c1e80 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.808+0000 7fb36e5ff700 1 --2- 172.21.15.72:0/1335582047 >> v2:172.21.15.146:3300/0 conn(0x7fb368153ff0 0x7fb3680bcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.808+0000 7fb36e5ff700 1 --2- 172.21.15.72:0/1335582047 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3681543d0 0x7fb3680643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.808+0000 7fb36e5ff700 1 -- 172.21.15.72:0/1335582047 >> 172.21.15.72:0/1335582047 conn(0x7fb3680c6b10 msgr2=0x7fb3680c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:43.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.809+0000 7fb36e5ff700 1 -- 172.21.15.72:0/1335582047 shutdown_connections 2023-08-31T19:07:43.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.809+0000 7fb36e5ff700 1 -- 172.21.15.72:0/1335582047 wait complete. 2023-08-31T19:07:43.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.810+0000 7fb36e5ff700 1 Processor -- start 2023-08-31T19:07:43.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.810+0000 7fb36e5ff700 1 -- start start 2023-08-31T19:07:43.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.811+0000 7fb36e5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3680648e0 0x7fb3681681d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:43.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.811+0000 7fb36e5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb368153ff0 0x7fb3680bdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:43.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.811+0000 7fb36e5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3681543d0 0x7fb36814af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:43.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.811+0000 7fb36e5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680bebf0 con 0x7fb3680648e0 2023-08-31T19:07:43.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.811+0000 7fb36e5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680bf210 con 0x7fb368153ff0 2023-08-31T19:07:43.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.811+0000 7fb36e5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680be0a0 con 0x7fb3681543d0 2023-08-31T19:07:43.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.811+0000 7fb367fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3680648e0 0x7fb3681681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:43.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.811+0000 7fb367fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3680648e0 0x7fb3681681d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49954/0 (socket says 172.21.15.72:49954) 2023-08-31T19:07:43.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.811+0000 7fb367fff700 1 -- 172.21.15.72:0/2498190063 learned_addr learned my addr 172.21.15.72:0/2498190063 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:43.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.812+0000 7fb36cb9c700 1 --2- 172.21.15.72:0/2498190063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3681543d0 0x7fb36814af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:43.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.812+0000 7fb3677fe700 1 --2- 172.21.15.72:0/2498190063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb368153ff0 0x7fb3680bdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:43.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.812+0000 7fb367fff700 1 -- 172.21.15.72:0/2498190063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3681543d0 msgr2=0x7fb36814af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:43.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.812+0000 7fb367fff700 1 --2- 172.21.15.72:0/2498190063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3681543d0 0x7fb36814af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.812+0000 7fb367fff700 1 -- 172.21.15.72:0/2498190063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb368153ff0 msgr2=0x7fb3680bdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:43.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.812+0000 7fb367fff700 1 --2- 172.21.15.72:0/2498190063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb368153ff0 0x7fb3680bdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:43.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.812+0000 7fb367fff700 1 -- 172.21.15.72:0/2498190063 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb360009ae0 con 0x7fb3680648e0 2023-08-31T19:07:43.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.812+0000 7fb367fff700 1 --2- 172.21.15.72:0/2498190063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3680648e0 0x7fb3681681d0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fb35800e930 tx=0x7fb358009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:43.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.812+0000 7fb34ffff700 1 -- 172.21.15.72:0/2498190063 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358012600 con 0x7fb3680648e0 2023-08-31T19:07:43.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.812+0000 7fb34ffff700 1 -- 172.21.15.72:0/2498190063 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358012760 con 0x7fb3680648e0 2023-08-31T19:07:43.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.812+0000 7fb36e5ff700 1 -- 172.21.15.72:0/2498190063 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3680be350 con 0x7fb3680648e0 2023-08-31T19:07:43.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.812+0000 7fb34ffff700 1 -- 172.21.15.72:0/2498190063 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358012ae0 con 0x7fb3680648e0 2023-08-31T19:07:43.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.813+0000 7fb36e5ff700 1 -- 172.21.15.72:0/2498190063 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3680be910 con 0x7fb3680648e0 2023-08-31T19:07:43.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.814+0000 7fb36e5ff700 1 -- 172.21.15.72:0/2498190063 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3680bf4f0 con 0x7fb3680648e0 2023-08-31T19:07:43.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.814+0000 7fb34ffff700 1 -- 172.21.15.72:0/2498190063 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 61) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fb35801b400 con 0x7fb3680648e0 2023-08-31T19:07:43.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.815+0000 7fb34ffff700 1 --2- 172.21.15.72:0/2498190063 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb35405efc0 0x7fb354061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:43.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.815+0000 7fb34ffff700 1 -- 172.21.15.72:0/2498190063 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fb35807a850 con 0x7fb3680648e0 2023-08-31T19:07:43.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.815+0000 7fb3677fe700 1 -- 172.21.15.72:0/2498190063 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb35405efc0 msgr2=0x7fb354061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:43.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.815+0000 7fb3677fe700 1 --2- 172.21.15.72:0/2498190063 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb35405efc0 0x7fb354061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:43.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.820+0000 7fb34ffff700 1 -- 172.21.15.72:0/2498190063 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb35804b6f0 con 0x7fb3680648e0 2023-08-31T19:07:43.898 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:43.898+0000 7f3321a65680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:07:43.972 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:43.972+0000 7f6a3ad07680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:07:43.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.997+0000 7fb36e5ff700 1 -- 172.21.15.72:0/2498190063 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3680befe0 con 0x7fb3680648e0 2023-08-31T19:07:43.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:43.998+0000 7fb34ffff700 1 -- 172.21.15.72:0/2498190063 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fb35804ed10 con 0x7fb3680648e0 2023-08-31T19:07:43.999 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:44.000 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":143,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:07:35.849624+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:07:20.032158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-31T19:07:20.589299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/688771534":"2023-09-01T19:07:35.849574+0000","172.21.15.72:0/2702061734":"2023-09-01T19:07:35.849574+0000","172.21.15.72:0/496703134":"2023-09-01T19:07:35.849574+0000","172.21.15.72:6833/143463":"2023-09-01T19:07:35.849574+0000","172.21.15.72:6832/143463":"2023-09-01T19:07:35.849574+0000","172.21.15.72:0/2921401112":"2023-09-01T19:07:35.849574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:07:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.000+0000 7fb36e5ff700 1 -- 172.21.15.72:0/2498190063 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb35405efc0 msgr2=0x7fb354061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.000+0000 7fb36e5ff700 1 --2- 172.21.15.72:0/2498190063 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb35405efc0 0x7fb354061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.000+0000 7fb36e5ff700 1 -- 172.21.15.72:0/2498190063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3680648e0 msgr2=0x7fb3681681d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.000+0000 7fb36e5ff700 1 --2- 172.21.15.72:0/2498190063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3680648e0 0x7fb3681681d0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fb35800e930 tx=0x7fb358009060).stop 2023-08-31T19:07:44.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.000+0000 7fb36e5ff700 1 -- 172.21.15.72:0/2498190063 shutdown_connections 2023-08-31T19:07:44.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.000+0000 7fb36e5ff700 1 --2- 172.21.15.72:0/2498190063 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb3681543d0 0x7fb36814af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:44.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.000+0000 7fb36e5ff700 1 --2- 172.21.15.72:0/2498190063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3680648e0 0x7fb3681681d0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:44.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.000+0000 7fb36e5ff700 1 --2- 172.21.15.72:0/2498190063 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb35405efc0 0x7fb354061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:44.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.001+0000 7fb36e5ff700 1 --2- 172.21.15.72:0/2498190063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb368153ff0 0x7fb3680bdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:44.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.001+0000 7fb36e5ff700 1 -- 172.21.15.72:0/2498190063 >> 172.21.15.72:0/2498190063 conn(0x7fb3680c6b10 msgr2=0x7fb36814cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:44.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.001+0000 7fb36e5ff700 1 -- 172.21.15.72:0/2498190063 shutdown_connections 2023-08-31T19:07:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.001+0000 7fb36e5ff700 1 -- 172.21.15.72:0/2498190063 wait complete. 2023-08-31T19:07:44.019 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T19:07:44.061 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:07:44.061+0000 7f6a3ad07680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:07:44.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.218+0000 7f9cc6dff700 1 Processor -- start 2023-08-31T19:07:44.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.218+0000 7f9cc6dff700 1 -- start start 2023-08-31T19:07:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.219+0000 7f9cc6dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cc0157c10 0x7f9cc00ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.219+0000 7f9cc6dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cc00637c0 0x7f9cc0155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.219+0000 7f9cc6dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc00c6130 con 0x7f9cc00ad1b0 2023-08-31T19:07:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.219+0000 7f9cc6dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc00c0350 con 0x7f9cc00637c0 2023-08-31T19:07:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.219+0000 7f9cc6dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc01580b0 con 0x7f9cc0157c10 2023-08-31T19:07:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.219+0000 7f9cc4b9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9cc00ad1b0 0x7f9cc00630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55492/0 (socket says 172.21.15.72:55492) 2023-08-31T19:07:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.219+0000 7f9cc4b9b700 1 -- 172.21.15.72:0/3898761464 learned_addr learned my addr 172.21.15.72:0/3898761464 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.220+0000 7f9cc539c700 1 --2- 172.21.15.72:0/3898761464 >> v2:172.21.15.72:3300/0 conn(0x7f9cc00637c0 0x7f9cc0155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.220+0000 7f9cbffff700 1 --2- 172.21.15.72:0/3898761464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cc0157c10 0x7f9cc00ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:44.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.220+0000 7f9cbf7fe700 1 -- 172.21.15.72:0/3898761464 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569001926 0 0) 0x7f9cc00c6130 con 0x7f9cc00ad1b0 2023-08-31T19:07:44.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.220+0000 7f9cbf7fe700 1 -- 172.21.15.72:0/3898761464 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cb00033f0 con 0x7f9cc00ad1b0 2023-08-31T19:07:44.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.220+0000 7f9cc539c700 1 -- 172.21.15.72:0/3898761464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cc0157c10 msgr2=0x7f9cc00ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:44.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.220+0000 7f9cc539c700 1 --2- 172.21.15.72:0/3898761464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cc0157c10 0x7f9cc00ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:44.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.220+0000 7f9cc539c700 1 -- 172.21.15.72:0/3898761464 >> v1:172.21.15.72:6789/0 conn(0x7f9cc00ad1b0 legacy=0x7f9cc00630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:44.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.220+0000 7f9cc539c700 1 -- 172.21.15.72:0/3898761464 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc0155560 con 0x7f9cc00637c0 2023-08-31T19:07:44.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.220+0000 7f9cc539c700 1 --2- 172.21.15.72:0/3898761464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc00637c0 0x7f9cc0155070 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f9cb8009e60 tx=0x7f9cb8009780).ready entity=mon.0 client_cookie=9bbd50e6e524d54 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:44.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.221+0000 7f9cbf7fe700 1 -- 172.21.15.72:0/3898761464 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb800e070 con 0x7f9cc00637c0 2023-08-31T19:07:44.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.221+0000 7f9cbf7fe700 1 -- 172.21.15.72:0/3898761464 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb800bab0 con 0x7f9cc00637c0 2023-08-31T19:07:44.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.221+0000 7f9cbf7fe700 1 -- 172.21.15.72:0/3898761464 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb800be30 con 0x7f9cc00637c0 2023-08-31T19:07:44.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.221+0000 7f9cc6dff700 1 -- 172.21.15.72:0/3898761464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc00637c0 msgr2=0x7f9cc0155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:44.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.221+0000 7f9cc6dff700 1 --2- 172.21.15.72:0/3898761464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc00637c0 0x7f9cc0155070 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f9cb8009e60 tx=0x7f9cb8009780).stop 2023-08-31T19:07:44.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.221+0000 7f9cc6dff700 1 -- 172.21.15.72:0/3898761464 shutdown_connections 2023-08-31T19:07:44.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.221+0000 7f9cc6dff700 1 --2- 172.21.15.72:0/3898761464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc00637c0 0x7f9cc0155070 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:44.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.221+0000 7f9cc6dff700 1 --2- 172.21.15.72:0/3898761464 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cc0157c10 0x7f9cc00ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:44.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.221+0000 7f9cc6dff700 1 -- 172.21.15.72:0/3898761464 >> 172.21.15.72:0/3898761464 conn(0x7f9cc005eb60 msgr2=0x7f9cc00cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:44.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.221+0000 7f9cc6dff700 1 -- 172.21.15.72:0/3898761464 shutdown_connections 2023-08-31T19:07:44.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.221+0000 7f9cc6dff700 1 -- 172.21.15.72:0/3898761464 wait complete. 2023-08-31T19:07:44.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.223+0000 7f9cc6dff700 1 Processor -- start 2023-08-31T19:07:44.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.223+0000 7f9cc6dff700 1 -- start start 2023-08-31T19:07:44.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.224+0000 7f9cc6dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc00637c0 0x7f9cc0156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:44.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.224+0000 7f9cc6dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cc00ad1b0 0x7f9cc0149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:44.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.224+0000 7f9cc6dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc0157c10 0x7f9cc00b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:44.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.224+0000 7f9cc6dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc0157890 con 0x7f9cc00637c0 2023-08-31T19:07:44.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.224+0000 7f9cc6dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc014a970 con 0x7f9cc0157c10 2023-08-31T19:07:44.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.224+0000 7f9cc6dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc01575b0 con 0x7f9cc00ad1b0 2023-08-31T19:07:44.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.224+0000 7f9cc4b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc00637c0 0x7f9cc0156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:44.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.224+0000 7f9cc4b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc00637c0 0x7f9cc0156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49968/0 (socket says 172.21.15.72:49968) 2023-08-31T19:07:44.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.224+0000 7f9cc4b9b700 1 -- 172.21.15.72:0/1933773532 learned_addr learned my addr 172.21.15.72:0/1933773532 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:44.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.225+0000 7f9cc4b9b700 1 -- 172.21.15.72:0/1933773532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cc00ad1b0 msgr2=0x7f9cc0149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:44.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.225+0000 7f9cbffff700 1 --2- 172.21.15.72:0/1933773532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cc00ad1b0 0x7f9cc0149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:44.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.225+0000 7f9cc539c700 1 --2- 172.21.15.72:0/1933773532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc0157c10 0x7f9cc00b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:44.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.225+0000 7f9cc4b9b700 1 --2- 172.21.15.72:0/1933773532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cc00ad1b0 0x7f9cc0149a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:44.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.225+0000 7f9cc4b9b700 1 -- 172.21.15.72:0/1933773532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc0157c10 msgr2=0x7f9cc00b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:44.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.225+0000 7f9cc4b9b700 1 --2- 172.21.15.72:0/1933773532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc0157c10 0x7f9cc00b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:44.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.225+0000 7f9cc4b9b700 1 -- 172.21.15.72:0/1933773532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8009a20 con 0x7f9cc00637c0 2023-08-31T19:07:44.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.225+0000 7f9cbffff700 1 --2- 172.21.15.72:0/1933773532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cc00ad1b0 0x7f9cc0149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:44.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.225+0000 7f9cc539c700 1 --2- 172.21.15.72:0/1933773532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc0157c10 0x7f9cc00b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:44.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.225+0000 7f9cc4b9b700 1 --2- 172.21.15.72:0/1933773532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc00637c0 0x7f9cc0156360 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f9cb400c590 tx=0x7f9cb4007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:44.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.225+0000 7f9cbcff9700 1 -- 172.21.15.72:0/1933773532 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4007e40 con 0x7f9cc00637c0 2023-08-31T19:07:44.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.225+0000 7f9cbcff9700 1 -- 172.21.15.72:0/1933773532 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb40072e0 con 0x7f9cc00637c0 2023-08-31T19:07:44.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.225+0000 7f9cc6dff700 1 -- 172.21.15.72:0/1933773532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc0155880 con 0x7f9cc00637c0 2023-08-31T19:07:44.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.225+0000 7f9cbcff9700 1 -- 172.21.15.72:0/1933773532 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40057a0 con 0x7f9cc00637c0 2023-08-31T19:07:44.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.225+0000 7f9cc6dff700 1 -- 172.21.15.72:0/1933773532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc0155e40 con 0x7f9cc00637c0 2023-08-31T19:07:44.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.227+0000 7f9cc6dff700 1 -- 172.21.15.72:0/1933773532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc0156000 con 0x7f9cc00637c0 2023-08-31T19:07:44.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.227+0000 7f9cbcff9700 1 -- 172.21.15.72:0/1933773532 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 61) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f9cb4005bd0 con 0x7f9cc00637c0 2023-08-31T19:07:44.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.228+0000 7f9cbcff9700 1 --2- 172.21.15.72:0/1933773532 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ca405efc0 0x7f9ca4061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:44.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.228+0000 7f9cbcff9700 1 -- 172.21.15.72:0/1933773532 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f9cb4079cb0 con 0x7f9cc00637c0 2023-08-31T19:07:44.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.228+0000 7f9cbffff700 1 -- 172.21.15.72:0/1933773532 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ca405efc0 msgr2=0x7f9ca4061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:07:44.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.228+0000 7f9cbffff700 1 --2- 172.21.15.72:0/1933773532 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ca405efc0 0x7f9ca4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:07:44.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.232+0000 7f9cbcff9700 1 -- 172.21.15.72:0/1933773532 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9cb404abb0 con 0x7f9cc00637c0 2023-08-31T19:07:44.261 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:44.260+0000 7f3321a65680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:07:44.352 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:44.352+0000 7f3321a65680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:07:44.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.360+0000 7f9cbcff9700 1 -- 172.21.15.72:0/1933773532 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 62) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f9cb4077510 con 0x7f9cc00637c0 2023-08-31T19:07:44.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.360+0000 7f9cbcff9700 1 -- 172.21.15.72:0/1933773532 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ca405efc0 msgr2=0x7f9ca4061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:07:44.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.360+0000 7f9cbcff9700 1 --2- 172.21.15.72:0/1933773532 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ca405efc0 0x7f9ca4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:44.432 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:44.431+0000 7f329d553700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:44.432 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:44.431+0000 7f329d553700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:44.432 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:44.431+0000 7f329d553700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:44.433 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:44.431+0000 7f329d553700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:44.433 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:44.431+0000 7f329d553700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:44.434 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:44.432+0000 7f329a54d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:44.434 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:44.432+0000 7f329a54d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:44.434 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:44.432+0000 7f329a54d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:44.434 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:44.432+0000 7f329a54d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:44.434 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:07:44.432+0000 7f329a54d700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:07:44.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:44.479+0000 7f9cc6dff700 1 -- 172.21.15.72:0/1933773532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9cc00ad7a0 con 0x7f9cc00637c0 2023-08-31T19:07:45.357 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-08-31T19:07:45.357+0000 7f89d2ff7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T19:07:45.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.361+0000 7f9cbcff9700 1 -- 172.21.15.72:0/1933773532 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v65) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9cb4071740 con 0x7f9cc00637c0 2023-08-31T19:07:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.364+0000 7f9cc6dff700 1 -- 172.21.15.72:0/1933773532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc00637c0 msgr2=0x7f9cc0156360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.364+0000 7f9cc6dff700 1 --2- 172.21.15.72:0/1933773532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc00637c0 0x7f9cc0156360 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f9cb400c590 tx=0x7f9cb4007c80).stop 2023-08-31T19:07:45.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.364+0000 7f9cc6dff700 1 -- 172.21.15.72:0/1933773532 shutdown_connections 2023-08-31T19:07:45.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.364+0000 7f9cc6dff700 1 --2- 172.21.15.72:0/1933773532 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9ca405efc0 0x7f9ca4061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:45.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.364+0000 7f9cc6dff700 1 --2- 172.21.15.72:0/1933773532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc0157c10 0x7f9cc00b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:45.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.364+0000 7f9cc6dff700 1 --2- 172.21.15.72:0/1933773532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc00637c0 0x7f9cc0156360 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:45.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.364+0000 7f9cc6dff700 1 --2- 172.21.15.72:0/1933773532 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9cc00ad1b0 0x7f9cc0149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:45.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.364+0000 7f9cc6dff700 1 -- 172.21.15.72:0/1933773532 >> 172.21.15.72:0/1933773532 conn(0x7f9cc005eb60 msgr2=0x7f9cc00ca240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:45.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.365+0000 7f9cc6dff700 1 -- 172.21.15.72:0/1933773532 shutdown_connections 2023-08-31T19:07:45.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.365+0000 7f9cc6dff700 1 -- 172.21.15.72:0/1933773532 wait complete. 2023-08-31T19:07:45.368 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T19:07:45.371 INFO:tasks.ceph.mds.a.smithi072.stderr: -2679> 2023-08-31T19:07:27.130+0000 7fe7693f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:07:45.392 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T19:07:45.417 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T19:07:45.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.590+0000 7f7c079ff700 1 Processor -- start 2023-08-31T19:07:45.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.590+0000 7f7c079ff700 1 -- start start 2023-08-31T19:07:45.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.591+0000 7f7c079ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c000bdb30 0x7f7c001542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:45.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.591+0000 7f7c079ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c000a84b0 con 0x7f7c000663d0 2023-08-31T19:07:45.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.591+0000 7f7c079ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c000c9410 con 0x7f7c00153ed0 2023-08-31T19:07:45.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.591+0000 7f7c079ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000c5310 con 0x7f7c000bdb30 2023-08-31T19:07:45.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.591+0000 7f7c05f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7c000663d0 0x7f7c00157d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55512/0 (socket says 172.21.15.72:55512) 2023-08-31T19:07:45.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.591+0000 7f7c05f9c700 1 -- 172.21.15.72:0/3117700888 learned_addr learned my addr 172.21.15.72:0/3117700888 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:45.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.592+0000 7f7c04f9a700 1 --2- 172.21.15.72:0/3117700888 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c000bdb30 0x7f7c001542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:45.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.592+0000 7f7bf7fff700 1 -- 172.21.15.72:0/3117700888 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506820382 0 0) 0x7f7c000a84b0 con 0x7f7c000663d0 2023-08-31T19:07:45.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.592+0000 7f7bf7fff700 1 -- 172.21.15.72:0/3117700888 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bec0033f0 con 0x7f7c000663d0 2023-08-31T19:07:45.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.592+0000 7f7bf7fff700 1 -- 172.21.15.72:0/3117700888 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821569214 0 0) 0x7f7c000c9410 con 0x7f7c00153ed0 2023-08-31T19:07:45.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.592+0000 7f7bf7fff700 1 -- 172.21.15.72:0/3117700888 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c000a84b0 con 0x7f7c00153ed0 2023-08-31T19:07:45.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.592+0000 7f7bf7fff700 1 -- 172.21.15.72:0/3117700888 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 741657261 0 0) 0x7f7bec0033f0 con 0x7f7c000663d0 2023-08-31T19:07:45.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.592+0000 7f7c04f9a700 1 -- 172.21.15.72:0/3117700888 >> v1:172.21.15.146:6789/0 conn(0x7f7c00153ed0 legacy=0x7f7c00155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.592+0000 7f7c04f9a700 1 -- 172.21.15.72:0/3117700888 >> v1:172.21.15.72:6789/0 conn(0x7f7c000663d0 legacy=0x7f7c00157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.592+0000 7f7c04f9a700 1 -- 172.21.15.72:0/3117700888 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c000a7ef0 con 0x7f7c000bdb30 2023-08-31T19:07:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.592+0000 7f7c04f9a700 1 --2- 172.21.15.72:0/3117700888 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c000bdb30 0x7f7c001542b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f7bf0009790 tx=0x7f7bf0009060).ready entity=mon.2 client_cookie=6bb95f877f79aa69 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.593+0000 7f7bf7fff700 1 -- 172.21.15.72:0/3117700888 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8001840 con 0x7f7c000bdb30 2023-08-31T19:07:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.593+0000 7f7bf7fff700 1 -- 172.21.15.72:0/3117700888 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf00090d0 con 0x7f7c000bdb30 2023-08-31T19:07:45.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.593+0000 7f7bf7fff700 1 -- 172.21.15.72:0/3117700888 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0011610 con 0x7f7c000bdb30 2023-08-31T19:07:45.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.593+0000 7f7c079ff700 1 -- 172.21.15.72:0/3117700888 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c000bdb30 msgr2=0x7f7c001542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:45.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.593+0000 7f7c079ff700 1 --2- 172.21.15.72:0/3117700888 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c000bdb30 0x7f7c001542b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f7bf0009790 tx=0x7f7bf0009060).stop 2023-08-31T19:07:45.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.593+0000 7f7c079ff700 1 -- 172.21.15.72:0/3117700888 shutdown_connections 2023-08-31T19:07:45.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.593+0000 7f7c079ff700 1 --2- 172.21.15.72:0/3117700888 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c000bdb30 0x7f7c001542b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:45.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.593+0000 7f7c079ff700 1 -- 172.21.15.72:0/3117700888 >> 172.21.15.72:0/3117700888 conn(0x7f7c0005eb60 msgr2=0x7f7c000c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:45.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.593+0000 7f7c079ff700 1 -- 172.21.15.72:0/3117700888 shutdown_connections 2023-08-31T19:07:45.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.593+0000 7f7c079ff700 1 -- 172.21.15.72:0/3117700888 wait complete. 2023-08-31T19:07:45.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.595+0000 7f7c079ff700 1 Processor -- start 2023-08-31T19:07:45.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.595+0000 7f7c079ff700 1 -- start start 2023-08-31T19:07:45.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.596+0000 7f7c079ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c000663d0 0x7f7c00155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:45.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.596+0000 7f7c079ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c00153ed0 0x7f7c00155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:45.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.596+0000 7f7c079ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c000a78e0 0x7f7c000a6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:45.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.596+0000 7f7c079ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c00155c70 con 0x7f7c000663d0 2023-08-31T19:07:45.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.596+0000 7f7c079ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c00155f40 con 0x7f7c00153ed0 2023-08-31T19:07:45.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.596+0000 7f7c079ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c00156220 con 0x7f7c000a78e0 2023-08-31T19:07:45.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.596+0000 7f7c0579b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c000663d0 0x7f7c00155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:45.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.596+0000 7f7c0579b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c000663d0 0x7f7c00155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50050/0 (socket says 172.21.15.72:50050) 2023-08-31T19:07:45.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.596+0000 7f7c0579b700 1 -- 172.21.15.72:0/1494098754 learned_addr learned my addr 172.21.15.72:0/1494098754 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:45.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.596+0000 7f7c0579b700 1 -- 172.21.15.72:0/1494098754 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c000a78e0 msgr2=0x7f7c000a6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:45.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.596+0000 7f7c0579b700 1 --2- 172.21.15.72:0/1494098754 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c000a78e0 0x7f7c000a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:45.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.596+0000 7f7c0579b700 1 -- 172.21.15.72:0/1494098754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c00153ed0 msgr2=0x7f7c00155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:45.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.596+0000 7f7c0579b700 1 --2- 172.21.15.72:0/1494098754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c00153ed0 0x7f7c00155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:45.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.596+0000 7f7c0579b700 1 -- 172.21.15.72:0/1494098754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf00092a0 con 0x7f7c000663d0 2023-08-31T19:07:45.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.597+0000 7f7c0579b700 1 --2- 172.21.15.72:0/1494098754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c000663d0 0x7f7c00155290 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f7bfc00c440 tx=0x7f7bfc007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:45.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.597+0000 7f7bf57fa700 1 -- 172.21.15.72:0/1494098754 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00f470 con 0x7f7c000663d0 2023-08-31T19:07:45.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.597+0000 7f7bf57fa700 1 -- 172.21.15.72:0/1494098754 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc00f5d0 con 0x7f7c000663d0 2023-08-31T19:07:45.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.597+0000 7f7c079ff700 1 -- 172.21.15.72:0/1494098754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c00156500 con 0x7f7c000663d0 2023-08-31T19:07:45.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.597+0000 7f7bf57fa700 1 -- 172.21.15.72:0/1494098754 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00f990 con 0x7f7c000663d0 2023-08-31T19:07:45.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.597+0000 7f7c079ff700 1 -- 172.21.15.72:0/1494098754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c000a8ab0 con 0x7f7c000663d0 2023-08-31T19:07:45.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.598+0000 7f7c079ff700 1 -- 172.21.15.72:0/1494098754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c000a8ca0 con 0x7f7c000663d0 2023-08-31T19:07:45.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.599+0000 7f7bf57fa700 1 -- 172.21.15.72:0/1494098754 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 63) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f7bfc00fd40 con 0x7f7c000663d0 2023-08-31T19:07:45.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.600+0000 7f7bf57fa700 1 --2- 172.21.15.72:0/1494098754 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7be405ecf0 0x7f7be40611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:45.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.600+0000 7f7bf57fa700 1 -- 172.21.15.72:0/1494098754 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 7308+0+0 (secure 0 0 0) 0x7f7bfc079750 con 0x7f7c000663d0 2023-08-31T19:07:45.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.600+0000 7f7c04f9a700 1 --2- 172.21.15.72:0/1494098754 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7be405ecf0 0x7f7be40611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:45.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.600+0000 7f7c04f9a700 1 --2- 172.21.15.72:0/1494098754 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7be405ecf0 0x7f7be40611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f7bf0009790 tx=0x7f7bf0016000).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:45.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.604+0000 7f7bf57fa700 1 -- 172.21.15.72:0/1494098754 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7bfc04a7e0 con 0x7f7c000663d0 2023-08-31T19:07:45.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:45.818+0000 7f7c079ff700 1 -- 172.21.15.72:0/1494098754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7c0006c6b0 con 0x7f7c000663d0 2023-08-31T19:07:46.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.370+0000 7f7bf57fa700 1 -- 172.21.15.72:0/1494098754 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v66) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7bfc04de00 con 0x7f7c000663d0 2023-08-31T19:07:46.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.372+0000 7f7c079ff700 1 -- 172.21.15.72:0/1494098754 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7be405ecf0 msgr2=0x7f7be40611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:46.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.372+0000 7f7c079ff700 1 --2- 172.21.15.72:0/1494098754 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7be405ecf0 0x7f7be40611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f7bf0009790 tx=0x7f7bf0016000).stop 2023-08-31T19:07:46.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.372+0000 7f7c079ff700 1 -- 172.21.15.72:0/1494098754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c000663d0 msgr2=0x7f7c00155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:46.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.372+0000 7f7c079ff700 1 --2- 172.21.15.72:0/1494098754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c000663d0 0x7f7c00155290 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f7bfc00c440 tx=0x7f7bfc007c90).stop 2023-08-31T19:07:46.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.373+0000 7f7c079ff700 1 -- 172.21.15.72:0/1494098754 shutdown_connections 2023-08-31T19:07:46.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.373+0000 7f7c079ff700 1 --2- 172.21.15.72:0/1494098754 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7c000a78e0 0x7f7c000a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:46.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.373+0000 7f7c079ff700 1 --2- 172.21.15.72:0/1494098754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c000663d0 0x7f7c00155290 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:46.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.373+0000 7f7c079ff700 1 --2- 172.21.15.72:0/1494098754 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7be405ecf0 0x7f7be40611b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:46.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.373+0000 7f7c079ff700 1 --2- 172.21.15.72:0/1494098754 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c00153ed0 0x7f7c00155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:46.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.373+0000 7f7c079ff700 1 -- 172.21.15.72:0/1494098754 >> 172.21.15.72:0/1494098754 conn(0x7f7c0005eb60 msgr2=0x7f7c000c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:46.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.373+0000 7f7c079ff700 1 -- 172.21.15.72:0/1494098754 shutdown_connections 2023-08-31T19:07:46.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.373+0000 7f7c079ff700 1 -- 172.21.15.72:0/1494098754 wait complete. 2023-08-31T19:07:46.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T19:07:46.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.629+0000 7fbd829ff700 1 Processor -- start 2023-08-31T19:07:46.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.629+0000 7fbd829ff700 1 -- start start 2023-08-31T19:07:46.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.630+0000 7fbd829ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd7c151da0 0x7fbd7c1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:46.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.630+0000 7fbd829ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7c154f40 con 0x7fbd7c0c5370 2023-08-31T19:07:46.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.630+0000 7fbd829ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7c154960 con 0x7fbd7c064d70 2023-08-31T19:07:46.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.630+0000 7fbd829ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7c0aa2c0 con 0x7fbd7c151da0 2023-08-31T19:07:46.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.630+0000 7fbd7b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbd7c0c5370 0x7fbd7c064660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55516/0 (socket says 172.21.15.72:55516) 2023-08-31T19:07:46.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.630+0000 7fbd7b7fe700 1 -- 172.21.15.72:0/3490686567 learned_addr learned my addr 172.21.15.72:0/3490686567 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:46.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.631+0000 7fbd7bfff700 1 --2- 172.21.15.72:0/3490686567 >> v2:172.21.15.146:3300/0 conn(0x7fbd7c151da0 0x7fbd7c1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:46.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.631+0000 7fbd7affd700 1 -- 172.21.15.72:0/3490686567 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150984119 0 0) 0x7fbd7c154f40 con 0x7fbd7c0c5370 2023-08-31T19:07:46.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.631+0000 7fbd7affd700 1 -- 172.21.15.72:0/3490686567 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd640033f0 con 0x7fbd7c0c5370 2023-08-31T19:07:46.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.631+0000 7fbd7affd700 1 -- 172.21.15.72:0/3490686567 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331598167 0 0) 0x7fbd7c154960 con 0x7fbd7c064d70 2023-08-31T19:07:46.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.631+0000 7fbd7affd700 1 -- 172.21.15.72:0/3490686567 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd7c154f40 con 0x7fbd7c064d70 2023-08-31T19:07:46.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.631+0000 7fbd7bfff700 1 -- 172.21.15.72:0/3490686567 >> v1:172.21.15.146:6789/0 conn(0x7fbd7c064d70 legacy=0x7fbd7c0bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:46.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.631+0000 7fbd7bfff700 1 -- 172.21.15.72:0/3490686567 >> v1:172.21.15.72:6789/0 conn(0x7fbd7c0c5370 legacy=0x7fbd7c064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:46.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.631+0000 7fbd7bfff700 1 -- 172.21.15.72:0/3490686567 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c154bd0 con 0x7fbd7c151da0 2023-08-31T19:07:46.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.631+0000 7fbd7bfff700 1 --2- 172.21.15.72:0/3490686567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c151da0 0x7fbd7c1553d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fbd6c009760 tx=0x7fbd6c009060).ready entity=mon.1 client_cookie=a571d3841226670d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:46.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.632+0000 7fbd7affd700 1 -- 172.21.15.72:0/3490686567 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00d4a0 con 0x7fbd7c151da0 2023-08-31T19:07:46.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.632+0000 7fbd7affd700 1 -- 172.21.15.72:0/3490686567 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c00d600 con 0x7fbd7c151da0 2023-08-31T19:07:46.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.632+0000 7fbd7affd700 1 -- 172.21.15.72:0/3490686567 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00d980 con 0x7fbd7c151da0 2023-08-31T19:07:46.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.632+0000 7fbd829ff700 1 -- 172.21.15.72:0/3490686567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c151da0 msgr2=0x7fbd7c1553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:46.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.632+0000 7fbd829ff700 1 --2- 172.21.15.72:0/3490686567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c151da0 0x7fbd7c1553d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fbd6c009760 tx=0x7fbd6c009060).stop 2023-08-31T19:07:46.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.632+0000 7fbd829ff700 1 -- 172.21.15.72:0/3490686567 shutdown_connections 2023-08-31T19:07:46.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.632+0000 7fbd829ff700 1 --2- 172.21.15.72:0/3490686567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c151da0 0x7fbd7c1553d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:46.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.632+0000 7fbd829ff700 1 -- 172.21.15.72:0/3490686567 >> 172.21.15.72:0/3490686567 conn(0x7fbd7c063a90 msgr2=0x7fbd7c0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:46.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.632+0000 7fbd829ff700 1 -- 172.21.15.72:0/3490686567 shutdown_connections 2023-08-31T19:07:46.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.632+0000 7fbd829ff700 1 -- 172.21.15.72:0/3490686567 wait complete. 2023-08-31T19:07:46.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.634+0000 7fbd829ff700 1 Processor -- start 2023-08-31T19:07:46.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.634+0000 7fbd829ff700 1 -- start start 2023-08-31T19:07:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.635+0000 7fbd829ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd7c064d70 0x7fbd7c0c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.635+0000 7fbd829ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd7c0c5370 0x7fbd7c0ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.635+0000 7fbd829ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c151da0 0x7fbd7c0ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:46.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.635+0000 7fbd829ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c0aee80 con 0x7fbd7c064d70 2023-08-31T19:07:46.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.635+0000 7fbd829ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c0c2870 con 0x7fbd7c151da0 2023-08-31T19:07:46.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.635+0000 7fbd829ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c0aec00 con 0x7fbd7c0c5370 2023-08-31T19:07:46.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.635+0000 7fbd7bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd7c064d70 0x7fbd7c0c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:46.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.635+0000 7fbd7bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd7c064d70 0x7fbd7c0c2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50056/0 (socket says 172.21.15.72:50056) 2023-08-31T19:07:46.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.635+0000 7fbd7bfff700 1 -- 172.21.15.72:0/2669297012 learned_addr learned my addr 172.21.15.72:0/2669297012 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:46.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.636+0000 7fbd7bfff700 1 -- 172.21.15.72:0/2669297012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd7c0c5370 msgr2=0x7fbd7c0ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:46.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.636+0000 7fbd7b7fe700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd7c0c5370 0x7fbd7c0ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:46.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.636+0000 7fbd80f9c700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c151da0 0x7fbd7c0ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:46.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.636+0000 7fbd7bfff700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd7c0c5370 0x7fbd7c0ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:46.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.636+0000 7fbd7bfff700 1 -- 172.21.15.72:0/2669297012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c151da0 msgr2=0x7fbd7c0ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:46.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.636+0000 7fbd7bfff700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c151da0 0x7fbd7c0ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:46.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.636+0000 7fbd7bfff700 1 -- 172.21.15.72:0/2669297012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c0092a0 con 0x7fbd7c064d70 2023-08-31T19:07:46.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.636+0000 7fbd80f9c700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c151da0 0x7fbd7c0ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:46.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.636+0000 7fbd7b7fe700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd7c0c5370 0x7fbd7c0ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:46.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.636+0000 7fbd7bfff700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd7c064d70 0x7fbd7c0c2d00 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fbd6c009d50 tx=0x7fbd6c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.636+0000 7fbd63fff700 1 -- 172.21.15.72:0/2669297012 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00d770 con 0x7fbd7c064d70 2023-08-31T19:07:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.636+0000 7fbd63fff700 1 -- 172.21.15.72:0/2669297012 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c00d8d0 con 0x7fbd7c064d70 2023-08-31T19:07:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.636+0000 7fbd63fff700 1 -- 172.21.15.72:0/2669297012 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c01d660 con 0x7fbd7c064d70 2023-08-31T19:07:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.636+0000 7fbd829ff700 1 -- 172.21.15.72:0/2669297012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7c0c1f40 con 0x7fbd7c064d70 2023-08-31T19:07:46.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.636+0000 7fbd829ff700 1 -- 172.21.15.72:0/2669297012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7c0c2500 con 0x7fbd7c064d70 2023-08-31T19:07:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.637+0000 7fbd829ff700 1 -- 172.21.15.72:0/2669297012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7c0c2b50 con 0x7fbd7c064d70 2023-08-31T19:07:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.638+0000 7fbd63fff700 1 -- 172.21.15.72:0/2669297012 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 63) v1 ==== 75166+0+0 (secure 0 0 0) 0x7fbd6c01da90 con 0x7fbd7c064d70 2023-08-31T19:07:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.639+0000 7fbd63fff700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbd6805ecf0 0x7fbd680611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.639+0000 7fbd63fff700 1 -- 172.21.15.72:0/2669297012 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 7308+0+0 (secure 0 0 0) 0x7fbd6c07b8d0 con 0x7fbd7c064d70 2023-08-31T19:07:46.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.639+0000 7fbd7b7fe700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbd6805ecf0 0x7fbd680611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.640+0000 7fbd7b7fe700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbd6805ecf0 0x7fbd680611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fbd7c167c70 tx=0x7fbd70009040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:46.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.643+0000 7fbd63fff700 1 -- 172.21.15.72:0/2669297012 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbd6c04c960 con 0x7fbd7c064d70 2023-08-31T19:07:46.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.815+0000 7fbd829ff700 1 -- 172.21.15.72:0/2669297012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbd7c06a7e0 con 0x7fbd7c064d70 2023-08-31T19:07:46.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:46.921+0000 7fbd63fff700 1 -- 172.21.15.72:0/2669297012 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fbd6c0792c0 con 0x7fbd7c064d70 2023-08-31T19:07:47.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.379+0000 7fbd63fff700 1 -- 172.21.15.72:0/2669297012 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v147) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbd6c042fe0 con 0x7fbd7c064d70 2023-08-31T19:07:47.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.384+0000 7fbd829ff700 1 -- 172.21.15.72:0/2669297012 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbd6805ecf0 msgr2=0x7fbd680611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:47.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.384+0000 7fbd829ff700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbd6805ecf0 0x7fbd680611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fbd7c167c70 tx=0x7fbd70009040).stop 2023-08-31T19:07:47.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.384+0000 7fbd829ff700 1 -- 172.21.15.72:0/2669297012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd7c064d70 msgr2=0x7fbd7c0c2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:47.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.384+0000 7fbd829ff700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd7c064d70 0x7fbd7c0c2d00 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fbd6c009d50 tx=0x7fbd6c016000).stop 2023-08-31T19:07:47.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.384+0000 7fbd829ff700 1 -- 172.21.15.72:0/2669297012 shutdown_connections 2023-08-31T19:07:47.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.384+0000 7fbd829ff700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fbd6805ecf0 0x7fbd680611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:47.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.384+0000 7fbd829ff700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd7c151da0 0x7fbd7c0ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:47.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.384+0000 7fbd829ff700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd7c064d70 0x7fbd7c0c2d00 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:47.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.384+0000 7fbd829ff700 1 --2- 172.21.15.72:0/2669297012 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd7c0c5370 0x7fbd7c0ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:47.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.384+0000 7fbd829ff700 1 -- 172.21.15.72:0/2669297012 >> 172.21.15.72:0/2669297012 conn(0x7fbd7c063a90 msgr2=0x7fbd7c064660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:47.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.385+0000 7fbd829ff700 1 -- 172.21.15.72:0/2669297012 shutdown_connections 2023-08-31T19:07:47.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.385+0000 7fbd829ff700 1 -- 172.21.15.72:0/2669297012 wait complete. 2023-08-31T19:07:47.390 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-08-31T19:07:47.407 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T19:07:47.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.601+0000 7fdc6f1ff700 1 Processor -- start 2023-08-31T19:07:47.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.601+0000 7fdc6f1ff700 1 -- start start 2023-08-31T19:07:47.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.603+0000 7fdc6f1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc68154120 0x7fdc680a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:47.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.603+0000 7fdc6f1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc68154500 0x7fdc680646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:47.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.603+0000 7fdc6f1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc680aa620 con 0x7fdc68064b90 2023-08-31T19:07:47.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.603+0000 7fdc6f1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc68065020 con 0x7fdc68154500 2023-08-31T19:07:47.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.603+0000 7fdc6f1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680aa3a0 con 0x7fdc68154120 2023-08-31T19:07:47.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.603+0000 7fdc67fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc68154500 0x7fdc680646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:47.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.603+0000 7fdc6d79c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdc68064b90 0x7fdc680c0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55530/0 (socket says 172.21.15.72:55530) 2023-08-31T19:07:47.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.603+0000 7fdc6d79c700 1 -- 172.21.15.72:0/2599597786 learned_addr learned my addr 172.21.15.72:0/2599597786 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:47.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.603+0000 7fdc6cf9b700 1 --2- 172.21.15.72:0/2599597786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc68154120 0x7fdc680a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:47.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.603+0000 7fdc67fff700 1 -- 172.21.15.72:0/2599597786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc68154120 msgr2=0x7fdc680a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:47.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.603+0000 7fdc67fff700 1 --2- 172.21.15.72:0/2599597786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc68154120 0x7fdc680a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:47.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.603+0000 7fdc67fff700 1 -- 172.21.15.72:0/2599597786 >> v1:172.21.15.72:6789/0 conn(0x7fdc68064b90 legacy=0x7fdc680c0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:47.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.604+0000 7fdc67fff700 1 -- 172.21.15.72:0/2599597786 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc680c5450 con 0x7fdc68154500 2023-08-31T19:07:47.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.604+0000 7fdc677fe700 1 -- 172.21.15.72:0/2599597786 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787511079 0 0) 0x7fdc680aa620 con 0x7fdc68064b90 2023-08-31T19:07:47.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.604+0000 7fdc67fff700 1 --2- 172.21.15.72:0/2599597786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc68154500 0x7fdc680646a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7fdc54009760 tx=0x7fdc54009060).ready entity=mon.0 client_cookie=c215f083d46e2815 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:47.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.604+0000 7fdc677fe700 1 -- 172.21.15.72:0/2599597786 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5400b580 con 0x7fdc68154500 2023-08-31T19:07:47.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.604+0000 7fdc677fe700 1 -- 172.21.15.72:0/2599597786 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5400b6e0 con 0x7fdc68154500 2023-08-31T19:07:47.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.604+0000 7fdc677fe700 1 -- 172.21.15.72:0/2599597786 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5400ba60 con 0x7fdc68154500 2023-08-31T19:07:47.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.604+0000 7fdc6f1ff700 1 -- 172.21.15.72:0/2599597786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc68154500 msgr2=0x7fdc680646a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:47.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.604+0000 7fdc6f1ff700 1 --2- 172.21.15.72:0/2599597786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc68154500 0x7fdc680646a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7fdc54009760 tx=0x7fdc54009060).stop 2023-08-31T19:07:47.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.605+0000 7fdc6f1ff700 1 -- 172.21.15.72:0/2599597786 shutdown_connections 2023-08-31T19:07:47.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.605+0000 7fdc6f1ff700 1 --2- 172.21.15.72:0/2599597786 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc68154120 0x7fdc680a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:47.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.605+0000 7fdc6f1ff700 1 --2- 172.21.15.72:0/2599597786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc68154500 0x7fdc680646a0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:47.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.605+0000 7fdc6f1ff700 1 -- 172.21.15.72:0/2599597786 >> 172.21.15.72:0/2599597786 conn(0x7fdc680cb7e0 msgr2=0x7fdc680c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:47.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.605+0000 7fdc6f1ff700 1 -- 172.21.15.72:0/2599597786 shutdown_connections 2023-08-31T19:07:47.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.605+0000 7fdc6f1ff700 1 -- 172.21.15.72:0/2599597786 wait complete. 2023-08-31T19:07:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.606+0000 7fdc6f1ff700 1 Processor -- start 2023-08-31T19:07:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.606+0000 7fdc6f1ff700 1 -- start start 2023-08-31T19:07:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.607+0000 7fdc6f1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc68064b90 0x7fdc680c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.607+0000 7fdc6f1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc68154120 0x7fdc680abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:47.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.607+0000 7fdc6f1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc68154500 0x7fdc68168670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:47.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.607+0000 7fdc6f1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680c2fe0 con 0x7fdc68064b90 2023-08-31T19:07:47.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.607+0000 7fdc6f1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc680ac2a0 con 0x7fdc68154500 2023-08-31T19:07:47.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.607+0000 7fdc6f1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc68167c20 con 0x7fdc68154120 2023-08-31T19:07:47.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.607+0000 7fdc6cf9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc68064b90 0x7fdc680c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.607+0000 7fdc6cf9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc68064b90 0x7fdc680c2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50076/0 (socket says 172.21.15.72:50076) 2023-08-31T19:07:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.607+0000 7fdc6cf9b700 1 -- 172.21.15.72:0/813440579 learned_addr learned my addr 172.21.15.72:0/813440579 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.608+0000 7fdc67fff700 1 --2- 172.21.15.72:0/813440579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc68154120 0x7fdc680abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.608+0000 7fdc6d79c700 1 --2- 172.21.15.72:0/813440579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc68154500 0x7fdc68168670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.608+0000 7fdc6cf9b700 1 -- 172.21.15.72:0/813440579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc68154120 msgr2=0x7fdc680abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.608+0000 7fdc6cf9b700 1 --2- 172.21.15.72:0/813440579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc68154120 0x7fdc680abdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.608+0000 7fdc6cf9b700 1 -- 172.21.15.72:0/813440579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc68154500 msgr2=0x7fdc68168670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.608+0000 7fdc6cf9b700 1 --2- 172.21.15.72:0/813440579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc68154500 0x7fdc68168670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.608+0000 7fdc6cf9b700 1 -- 172.21.15.72:0/813440579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc540092a0 con 0x7fdc68064b90 2023-08-31T19:07:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.608+0000 7fdc6cf9b700 1 --2- 172.21.15.72:0/813440579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc68064b90 0x7fdc680c2af0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7fdc5c00d890 tx=0x7fdc5c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.608+0000 7fdc64ff9700 1 -- 172.21.15.72:0/813440579 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c0125f0 con 0x7fdc68064b90 2023-08-31T19:07:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.608+0000 7fdc64ff9700 1 -- 172.21.15.72:0/813440579 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c012750 con 0x7fdc68064b90 2023-08-31T19:07:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.608+0000 7fdc6f1ff700 1 -- 172.21.15.72:0/813440579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc681681e0 con 0x7fdc68064b90 2023-08-31T19:07:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.608+0000 7fdc64ff9700 1 -- 172.21.15.72:0/813440579 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c012ad0 con 0x7fdc68064b90 2023-08-31T19:07:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.608+0000 7fdc6f1ff700 1 -- 172.21.15.72:0/813440579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc680c31f0 con 0x7fdc68064b90 2023-08-31T19:07:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.610+0000 7fdc6f1ff700 1 -- 172.21.15.72:0/813440579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc681684c0 con 0x7fdc68064b90 2023-08-31T19:07:47.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.610+0000 7fdc64ff9700 1 -- 172.21.15.72:0/813440579 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fdc5c013480 con 0x7fdc68064b90 2023-08-31T19:07:47.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.611+0000 7fdc64ff9700 1 --2- 172.21.15.72:0/813440579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdc4c05ef30 0x7fdc4c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:47.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.611+0000 7fdc64ff9700 1 -- 172.21.15.72:0/813440579 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6870+0+0 (secure 0 0 0) 0x7fdc5c07a460 con 0x7fdc68064b90 2023-08-31T19:07:47.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.611+0000 7fdc67fff700 1 --2- 172.21.15.72:0/813440579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdc4c05ef30 0x7fdc4c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:47.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.612+0000 7fdc67fff700 1 --2- 172.21.15.72:0/813440579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdc4c05ef30 0x7fdc4c0613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fdc680c8b70 tx=0x7fdc54017000).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:47.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.615+0000 7fdc64ff9700 1 -- 172.21.15.72:0/813440579 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdc5c04b400 con 0x7fdc68064b90 2023-08-31T19:07:47.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:47.786+0000 7fdc6f1ff700 1 -- 172.21.15.72:0/813440579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdc6806a7e0 con 0x7fdc68064b90 2023-08-31T19:07:48.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.382+0000 7fdc64ff9700 1 -- 172.21.15.72:0/813440579 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v148) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdc5c04ea20 con 0x7fdc68064b90 2023-08-31T19:07:48.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.385+0000 7fdc6f1ff700 1 -- 172.21.15.72:0/813440579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdc4c05ef30 msgr2=0x7fdc4c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:48.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.385+0000 7fdc6f1ff700 1 --2- 172.21.15.72:0/813440579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdc4c05ef30 0x7fdc4c0613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fdc680c8b70 tx=0x7fdc54017000).stop 2023-08-31T19:07:48.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.385+0000 7fdc6f1ff700 1 -- 172.21.15.72:0/813440579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc68064b90 msgr2=0x7fdc680c2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:48.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.385+0000 7fdc6f1ff700 1 --2- 172.21.15.72:0/813440579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc68064b90 0x7fdc680c2af0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7fdc5c00d890 tx=0x7fdc5c008040).stop 2023-08-31T19:07:48.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.385+0000 7fdc6f1ff700 1 -- 172.21.15.72:0/813440579 shutdown_connections 2023-08-31T19:07:48.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.385+0000 7fdc6f1ff700 1 --2- 172.21.15.72:0/813440579 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fdc4c05ef30 0x7fdc4c0613f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:48.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.385+0000 7fdc6f1ff700 1 --2- 172.21.15.72:0/813440579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc68154500 0x7fdc68168670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:48.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.385+0000 7fdc6f1ff700 1 --2- 172.21.15.72:0/813440579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc68064b90 0x7fdc680c2af0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:48.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.385+0000 7fdc6f1ff700 1 --2- 172.21.15.72:0/813440579 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdc68154120 0x7fdc680abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:48.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.385+0000 7fdc6f1ff700 1 -- 172.21.15.72:0/813440579 >> 172.21.15.72:0/813440579 conn(0x7fdc680cb7e0 msgr2=0x7fdc68062ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:48.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.386+0000 7fdc6f1ff700 1 -- 172.21.15.72:0/813440579 shutdown_connections 2023-08-31T19:07:48.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.386+0000 7fdc6f1ff700 1 -- 172.21.15.72:0/813440579 wait complete. 2023-08-31T19:07:48.389 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-08-31T19:07:48.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-31T19:07:48.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.609+0000 7f6dd0bff700 1 Processor -- start 2023-08-31T19:07:48.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.609+0000 7f6dd0bff700 1 -- start start 2023-08-31T19:07:48.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.610+0000 7f6dd0bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6dcc1520e0 0x7f6dcc0a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:48.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.610+0000 7f6dd0bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0a9440 0x7f6dcc068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:48.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.610+0000 7f6dd0bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6dcc1524c0 0x7f6dcc068980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:48.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.610+0000 7f6dd0bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dcc068e70 con 0x7f6dcc1520e0 2023-08-31T19:07:48.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.610+0000 7f6dd0bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dcc064340 con 0x7f6dcc1524c0 2023-08-31T19:07:48.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.610+0000 7f6dd0bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0bcd00 con 0x7f6dcc0a9440 2023-08-31T19:07:48.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.610+0000 7f6dca59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6dcc1520e0 0x7f6dcc0a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:48.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.611+0000 7f6dca59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6dcc1520e0 0x7f6dcc0a8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50092/0 (socket says 172.21.15.72:50092) 2023-08-31T19:07:48.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.611+0000 7f6dca59c700 1 -- 172.21.15.72:0/898605210 learned_addr learned my addr 172.21.15.72:0/898605210 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:48.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.611+0000 7f6dc9d9b700 1 --2- 172.21.15.72:0/898605210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0a9440 0x7f6dcc068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:48.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.611+0000 7f6dcad9d700 1 --2- 172.21.15.72:0/898605210 >> v2:172.21.15.146:3300/0 conn(0x7f6dcc1524c0 0x7f6dcc068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:48.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.611+0000 7f6dca59c700 1 -- 172.21.15.72:0/898605210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0a9440 msgr2=0x7f6dcc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:48.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.611+0000 7f6dca59c700 1 --2- 172.21.15.72:0/898605210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0a9440 0x7f6dcc068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:48.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.611+0000 7f6dca59c700 1 -- 172.21.15.72:0/898605210 >> v2:172.21.15.146:3300/0 conn(0x7f6dcc1524c0 msgr2=0x7f6dcc068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:48.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.611+0000 7f6dca59c700 1 --2- 172.21.15.72:0/898605210 >> v2:172.21.15.146:3300/0 conn(0x7f6dcc1524c0 0x7f6dcc068980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:48.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.611+0000 7f6dca59c700 1 -- 172.21.15.72:0/898605210 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc0bcfe0 con 0x7f6dcc1520e0 2023-08-31T19:07:48.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.611+0000 7f6dca59c700 1 --2- 172.21.15.72:0/898605210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc1520e0 0x7f6dcc0a8f50 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f6dcc06bed0 tx=0x7f6dbc0090f0).ready entity=mon.0 client_cookie=18f8194e2caad775 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:48.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.611+0000 7f6dc959a700 1 -- 172.21.15.72:0/898605210 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00b600 con 0x7f6dcc1520e0 2023-08-31T19:07:48.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.611+0000 7f6dc959a700 1 -- 172.21.15.72:0/898605210 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc00b760 con 0x7f6dcc1520e0 2023-08-31T19:07:48.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.611+0000 7f6dc959a700 1 -- 172.21.15.72:0/898605210 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00bae0 con 0x7f6dcc1520e0 2023-08-31T19:07:48.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.612+0000 7f6dd0bff700 1 -- 172.21.15.72:0/898605210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc1520e0 msgr2=0x7f6dcc0a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:48.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.612+0000 7f6dd0bff700 1 --2- 172.21.15.72:0/898605210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc1520e0 0x7f6dcc0a8f50 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f6dcc06bed0 tx=0x7f6dbc0090f0).stop 2023-08-31T19:07:48.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.612+0000 7f6dd0bff700 1 -- 172.21.15.72:0/898605210 shutdown_connections 2023-08-31T19:07:48.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.612+0000 7f6dd0bff700 1 --2- 172.21.15.72:0/898605210 >> v2:172.21.15.146:3300/0 conn(0x7f6dcc1524c0 0x7f6dcc068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:48.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.612+0000 7f6dd0bff700 1 --2- 172.21.15.72:0/898605210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc1520e0 0x7f6dcc0a8f50 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:48.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.612+0000 7f6dd0bff700 1 --2- 172.21.15.72:0/898605210 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0a9440 0x7f6dcc068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:48.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.612+0000 7f6dd0bff700 1 -- 172.21.15.72:0/898605210 >> 172.21.15.72:0/898605210 conn(0x7f6dcc0630c0 msgr2=0x7f6dcc0c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:48.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.612+0000 7f6dd0bff700 1 -- 172.21.15.72:0/898605210 shutdown_connections 2023-08-31T19:07:48.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.612+0000 7f6dd0bff700 1 -- 172.21.15.72:0/898605210 wait complete. 2023-08-31T19:07:48.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.614+0000 7f6dd0bff700 1 Processor -- start 2023-08-31T19:07:48.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.614+0000 7f6dd0bff700 1 -- start start 2023-08-31T19:07:48.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.615+0000 7f6dd0bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0a9440 0x7f6dcc0a6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:48.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.615+0000 7f6dd0bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc1520e0 0x7f6dcc0a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:48.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.615+0000 7f6dd0bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dcc1524c0 0x7f6dcc14aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:48.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.615+0000 7f6dd0bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0ab1c0 con 0x7f6dcc1520e0 2023-08-31T19:07:48.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.615+0000 7f6dd0bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0a4d30 con 0x7f6dcc1524c0 2023-08-31T19:07:48.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.615+0000 7f6dd0bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0a4f90 con 0x7f6dcc0a9440 2023-08-31T19:07:48.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.615+0000 7f6dc9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc1520e0 0x7f6dcc0a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:48.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.615+0000 7f6dc9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc1520e0 0x7f6dcc0a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50098/0 (socket says 172.21.15.72:50098) 2023-08-31T19:07:48.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.615+0000 7f6dc9d9b700 1 -- 172.21.15.72:0/3639026065 learned_addr learned my addr 172.21.15.72:0/3639026065 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:48.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.615+0000 7f6dcad9d700 1 --2- 172.21.15.72:0/3639026065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dcc1524c0 0x7f6dcc14aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:48.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.615+0000 7f6dca59c700 1 --2- 172.21.15.72:0/3639026065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0a9440 0x7f6dcc0a6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:48.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.616+0000 7f6dc9d9b700 1 -- 172.21.15.72:0/3639026065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0a9440 msgr2=0x7f6dcc0a6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:48.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.616+0000 7f6dc9d9b700 1 --2- 172.21.15.72:0/3639026065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0a9440 0x7f6dcc0a6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:48.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.616+0000 7f6dc9d9b700 1 -- 172.21.15.72:0/3639026065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dcc1524c0 msgr2=0x7f6dcc14aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:48.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.616+0000 7f6dc9d9b700 1 --2- 172.21.15.72:0/3639026065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dcc1524c0 0x7f6dcc14aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:48.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.616+0000 7f6dc9d9b700 1 -- 172.21.15.72:0/3639026065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc009370 con 0x7f6dcc1520e0 2023-08-31T19:07:48.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.616+0000 7f6dca59c700 1 --2- 172.21.15.72:0/3639026065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0a9440 0x7f6dcc0a6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:48.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.616+0000 7f6dc9d9b700 1 --2- 172.21.15.72:0/3639026065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc1520e0 0x7f6dcc0a4840 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f6dc000d890 tx=0x7f6dc0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:48.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.616+0000 7f6dba7fc700 1 -- 172.21.15.72:0/3639026065 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc00125f0 con 0x7f6dcc1520e0 2023-08-31T19:07:48.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.616+0000 7f6dba7fc700 1 -- 172.21.15.72:0/3639026065 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc0012750 con 0x7f6dcc1520e0 2023-08-31T19:07:48.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.616+0000 7f6dd0bff700 1 -- 172.21.15.72:0/3639026065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dcc0a5270 con 0x7f6dcc1520e0 2023-08-31T19:07:48.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.616+0000 7f6dba7fc700 1 -- 172.21.15.72:0/3639026065 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0012ad0 con 0x7f6dcc1520e0 2023-08-31T19:07:48.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.616+0000 7f6dd0bff700 1 -- 172.21.15.72:0/3639026065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc0a5830 con 0x7f6dcc1520e0 2023-08-31T19:07:48.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.617+0000 7f6dd0bff700 1 -- 172.21.15.72:0/3639026065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dcc0aaf90 con 0x7f6dcc1520e0 2023-08-31T19:07:48.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.618+0000 7f6dba7fc700 1 -- 172.21.15.72:0/3639026065 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6dc0013480 con 0x7f6dcc1520e0 2023-08-31T19:07:48.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.619+0000 7f6dba7fc700 1 --2- 172.21.15.72:0/3639026065 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6dac05ef30 0x7f6dac0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:48.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.619+0000 7f6dba7fc700 1 -- 172.21.15.72:0/3639026065 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f6dc007a2d0 con 0x7f6dcc1520e0 2023-08-31T19:07:48.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.619+0000 7f6dca59c700 1 --2- 172.21.15.72:0/3639026065 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6dac05ef30 0x7f6dac0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:48.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.620+0000 7f6dca59c700 1 --2- 172.21.15.72:0/3639026065 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6dac05ef30 0x7f6dac0613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6dbc009130 tx=0x7f6dbc017000).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:48.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.627+0000 7f6dba7fc700 1 -- 172.21.15.72:0/3639026065 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6dcc0aaf90 con 0x7f6dcc1520e0 2023-08-31T19:07:48.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.799+0000 7f6dd0bff700 1 -- 172.21.15.72:0/3639026065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f6dcc0aaf90 con 0x7f6dcc1520e0 2023-08-31T19:07:48.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.802+0000 7f6dba7fc700 1 -- 172.21.15.72:0/3639026065 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v28) v1 ==== 120+0+0 (secure 0 0 0) 0x7f6dcc0aaf90 con 0x7f6dcc1520e0 2023-08-31T19:07:48.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.805+0000 7f6dd0bff700 1 -- 172.21.15.72:0/3639026065 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6dac05ef30 msgr2=0x7f6dac0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:48.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.805+0000 7f6dd0bff700 1 --2- 172.21.15.72:0/3639026065 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6dac05ef30 0x7f6dac0613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6dbc009130 tx=0x7f6dbc017000).stop 2023-08-31T19:07:48.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.805+0000 7f6dd0bff700 1 -- 172.21.15.72:0/3639026065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc1520e0 msgr2=0x7f6dcc0a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:48.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.805+0000 7f6dd0bff700 1 --2- 172.21.15.72:0/3639026065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc1520e0 0x7f6dcc0a4840 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f6dc000d890 tx=0x7f6dc0008040).stop 2023-08-31T19:07:48.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.805+0000 7f6dd0bff700 1 -- 172.21.15.72:0/3639026065 shutdown_connections 2023-08-31T19:07:48.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.805+0000 7f6dd0bff700 1 --2- 172.21.15.72:0/3639026065 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6dac05ef30 0x7f6dac0613f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:48.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.805+0000 7f6dd0bff700 1 --2- 172.21.15.72:0/3639026065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dcc1524c0 0x7f6dcc14aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:48.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.805+0000 7f6dd0bff700 1 --2- 172.21.15.72:0/3639026065 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6dcc0a9440 0x7f6dcc0a6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:48.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.805+0000 7f6dd0bff700 1 --2- 172.21.15.72:0/3639026065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dcc1520e0 0x7f6dcc0a4840 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:48.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.805+0000 7f6dd0bff700 1 -- 172.21.15.72:0/3639026065 >> 172.21.15.72:0/3639026065 conn(0x7f6dcc0630c0 msgr2=0x7f6dcc14b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:48.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.805+0000 7f6dd0bff700 1 -- 172.21.15.72:0/3639026065 shutdown_connections 2023-08-31T19:07:48.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:48.805+0000 7f6dd0bff700 1 -- 172.21.15.72:0/3639026065 wait complete. 2023-08-31T19:07:48.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-31T19:07:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.020+0000 7f77b17ff700 1 Processor -- start 2023-08-31T19:07:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.020+0000 7f77b17ff700 1 -- start start 2023-08-31T19:07:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.021+0000 7f77b17ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77ac1544e0 0x7f77ac05e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.021+0000 7f77b17ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f77ac0c38d0 0x7f77ac0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.021+0000 7f77b17ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77ac0bc4a0 con 0x7f77ac068ec0 2023-08-31T19:07:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.021+0000 7f77b17ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77ac05e840 con 0x7f77ac0c38d0 2023-08-31T19:07:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.021+0000 7f77b17ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac069310 con 0x7f77ac1544e0 2023-08-31T19:07:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.021+0000 7f77ab7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f77ac068ec0 0x7f77ac062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55538/0 (socket says 172.21.15.72:55538) 2023-08-31T19:07:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.021+0000 7f77ab7fe700 1 -- 172.21.15.72:0/3837317357 learned_addr learned my addr 172.21.15.72:0/3837317357 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.022+0000 7f77aaffd700 1 --2- 172.21.15.72:0/3837317357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77ac1544e0 0x7f77ac05e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.022+0000 7f77aa7fc700 1 --2- 172.21.15.72:0/3837317357 >> v2:172.21.15.146:3300/0 conn(0x7f77ac0c38d0 0x7f77ac0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.022+0000 7f77a9ffb700 1 -- 172.21.15.72:0/3837317357 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584284839 0 0) 0x7f77ac0bc4a0 con 0x7f77ac068ec0 2023-08-31T19:07:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.022+0000 7f77a9ffb700 1 -- 172.21.15.72:0/3837317357 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77940033f0 con 0x7f77ac068ec0 2023-08-31T19:07:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.022+0000 7f77aaffd700 1 -- 172.21.15.72:0/3837317357 >> v2:172.21.15.146:3300/0 conn(0x7f77ac0c38d0 msgr2=0x7f77ac0689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.022+0000 7f77aaffd700 1 --2- 172.21.15.72:0/3837317357 >> v2:172.21.15.146:3300/0 conn(0x7f77ac0c38d0 0x7f77ac0689d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.022+0000 7f77aaffd700 1 -- 172.21.15.72:0/3837317357 >> v1:172.21.15.72:6789/0 conn(0x7f77ac068ec0 legacy=0x7f77ac062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.022+0000 7f77aaffd700 1 -- 172.21.15.72:0/3837317357 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac069c40 con 0x7f77ac1544e0 2023-08-31T19:07:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.022+0000 7f77aaffd700 1 --2- 172.21.15.72:0/3837317357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77ac1544e0 0x7f77ac05e350 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f779c009760 tx=0x7f779c009060).ready entity=mon.2 client_cookie=4063c14128bb686f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.022+0000 7f77a9ffb700 1 -- 172.21.15.72:0/3837317357 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c0090d0 con 0x7f77ac1544e0 2023-08-31T19:07:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.022+0000 7f77a9ffb700 1 -- 172.21.15.72:0/3837317357 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c00d4a0 con 0x7f77ac1544e0 2023-08-31T19:07:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.023+0000 7f77a9ffb700 1 -- 172.21.15.72:0/3837317357 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c00d820 con 0x7f77ac1544e0 2023-08-31T19:07:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.023+0000 7f77b17ff700 1 -- 172.21.15.72:0/3837317357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77ac1544e0 msgr2=0x7f77ac05e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.023+0000 7f77b17ff700 1 --2- 172.21.15.72:0/3837317357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77ac1544e0 0x7f77ac05e350 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f779c009760 tx=0x7f779c009060).stop 2023-08-31T19:07:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.023+0000 7f77b17ff700 1 -- 172.21.15.72:0/3837317357 shutdown_connections 2023-08-31T19:07:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.023+0000 7f77b17ff700 1 --2- 172.21.15.72:0/3837317357 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77ac1544e0 0x7f77ac05e350 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.023+0000 7f77b17ff700 1 --2- 172.21.15.72:0/3837317357 >> v2:172.21.15.146:3300/0 conn(0x7f77ac0c38d0 0x7f77ac0689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.023+0000 7f77b17ff700 1 -- 172.21.15.72:0/3837317357 >> 172.21.15.72:0/3837317357 conn(0x7f77ac0c7e00 msgr2=0x7f77ac0c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.023+0000 7f77b17ff700 1 -- 172.21.15.72:0/3837317357 shutdown_connections 2023-08-31T19:07:49.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.023+0000 7f77b17ff700 1 -- 172.21.15.72:0/3837317357 wait complete. 2023-08-31T19:07:49.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.025+0000 7f77b17ff700 1 Processor -- start 2023-08-31T19:07:49.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.025+0000 7f77b17ff700 1 -- start start 2023-08-31T19:07:49.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77b17ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77ac068ec0 0x7f77ac13e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77b17ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77ac0c38d0 0x7f77ac0c1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77b17ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77ac1544e0 0x7f77ac159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77b17ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac158ee0 con 0x7f77ac068ec0 2023-08-31T19:07:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77b17ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac1582f0 con 0x7f77ac1544e0 2023-08-31T19:07:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77b17ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac1585b0 con 0x7f77ac0c38d0 2023-08-31T19:07:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77aaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77ac068ec0 0x7f77ac13e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77aaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77ac068ec0 0x7f77ac13e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50104/0 (socket says 172.21.15.72:50104) 2023-08-31T19:07:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77aaffd700 1 -- 172.21.15.72:0/1312844991 learned_addr learned my addr 172.21.15.72:0/1312844991 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77aaffd700 1 -- 172.21.15.72:0/1312844991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77ac0c38d0 msgr2=0x7f77ac0c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:49.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77aaffd700 1 --2- 172.21.15.72:0/1312844991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77ac0c38d0 0x7f77ac0c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:49.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77aaffd700 1 -- 172.21.15.72:0/1312844991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77ac1544e0 msgr2=0x7f77ac159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:49.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77ab7fe700 1 --2- 172.21.15.72:0/1312844991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77ac1544e0 0x7f77ac159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:49.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77aaffd700 1 --2- 172.21.15.72:0/1312844991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77ac1544e0 0x7f77ac159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:49.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77aaffd700 1 -- 172.21.15.72:0/1312844991 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c0092a0 con 0x7f77ac068ec0 2023-08-31T19:07:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77ab7fe700 1 --2- 172.21.15.72:0/1312844991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77ac1544e0 0x7f77ac159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.026+0000 7f77aaffd700 1 --2- 172.21.15.72:0/1312844991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77ac068ec0 0x7f77ac13e700 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f779c00d260 tx=0x7f779c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.027+0000 7f7792ffd700 1 -- 172.21.15.72:0/1312844991 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c012870 con 0x7f77ac068ec0 2023-08-31T19:07:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.027+0000 7f7792ffd700 1 -- 172.21.15.72:0/1312844991 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c0129d0 con 0x7f77ac068ec0 2023-08-31T19:07:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.027+0000 7f7792ffd700 1 -- 172.21.15.72:0/1312844991 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c012d50 con 0x7f77ac068ec0 2023-08-31T19:07:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.027+0000 7f77b17ff700 1 -- 172.21.15.72:0/1312844991 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ac158890 con 0x7f77ac068ec0 2023-08-31T19:07:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.027+0000 7f77b17ff700 1 -- 172.21.15.72:0/1312844991 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ac13ebf0 con 0x7f77ac068ec0 2023-08-31T19:07:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.028+0000 7f77b17ff700 1 -- 172.21.15.72:0/1312844991 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ac06c6b0 con 0x7f77ac068ec0 2023-08-31T19:07:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.029+0000 7f7792ffd700 1 -- 172.21.15.72:0/1312844991 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f779c01c630 con 0x7f77ac068ec0 2023-08-31T19:07:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.029+0000 7f7792ffd700 1 --2- 172.21.15.72:0/1312844991 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f779805ef30 0x7f77980613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.029+0000 7f7792ffd700 1 -- 172.21.15.72:0/1312844991 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f779c07b5b0 con 0x7f77ac068ec0 2023-08-31T19:07:49.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.030+0000 7f77aa7fc700 1 --2- 172.21.15.72:0/1312844991 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f779805ef30 0x7f77980613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:49.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.030+0000 7f77aa7fc700 1 --2- 172.21.15.72:0/1312844991 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f779805ef30 0x7f77980613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f77ac069f70 tx=0x7f77a0009060).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:49.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.034+0000 7f7792ffd700 1 -- 172.21.15.72:0/1312844991 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f779c04c750 con 0x7f77ac068ec0 2023-08-31T19:07:49.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.204+0000 7f77b17ff700 1 -- 172.21.15.72:0/1312844991 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f77ac0c1c30 con 0x7f77ac068ec0 2023-08-31T19:07:49.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.208+0000 7f7792ffd700 1 -- 172.21.15.72:0/1312844991 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f779c04fd70 con 0x7f77ac068ec0 2023-08-31T19:07:49.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.210+0000 7f77b17ff700 1 -- 172.21.15.72:0/1312844991 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f779805ef30 msgr2=0x7f77980613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:49.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.210+0000 7f77b17ff700 1 --2- 172.21.15.72:0/1312844991 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f779805ef30 0x7f77980613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f77ac069f70 tx=0x7f77a0009060).stop 2023-08-31T19:07:49.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.210+0000 7f77b17ff700 1 -- 172.21.15.72:0/1312844991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77ac068ec0 msgr2=0x7f77ac13e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:49.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.211+0000 7f77b17ff700 1 --2- 172.21.15.72:0/1312844991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77ac068ec0 0x7f77ac13e700 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f779c00d260 tx=0x7f779c016000).stop 2023-08-31T19:07:49.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.211+0000 7f77b17ff700 1 -- 172.21.15.72:0/1312844991 shutdown_connections 2023-08-31T19:07:49.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.211+0000 7f77b17ff700 1 --2- 172.21.15.72:0/1312844991 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f779805ef30 0x7f77980613f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:49.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.211+0000 7f77b17ff700 1 --2- 172.21.15.72:0/1312844991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77ac1544e0 0x7f77ac159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:49.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.211+0000 7f77b17ff700 1 --2- 172.21.15.72:0/1312844991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77ac068ec0 0x7f77ac13e700 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:49.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.211+0000 7f77b17ff700 1 --2- 172.21.15.72:0/1312844991 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f77ac0c38d0 0x7f77ac0c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:49.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.211+0000 7f77b17ff700 1 -- 172.21.15.72:0/1312844991 >> 172.21.15.72:0/1312844991 conn(0x7f77ac0c7e00 msgr2=0x7f77ac0c5980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:49.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.211+0000 7f77b17ff700 1 -- 172.21.15.72:0/1312844991 shutdown_connections 2023-08-31T19:07:49.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.211+0000 7f77b17ff700 1 -- 172.21.15.72:0/1312844991 wait complete. 2023-08-31T19:07:49.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-08-31T19:07:49.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.417+0000 7f12c45ff700 1 Processor -- start 2023-08-31T19:07:49.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.418+0000 7f12c45ff700 1 -- start start 2023-08-31T19:07:49.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.419+0000 7f12c45ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f12bc0a9eb0 0x7f12bc0aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:49.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.419+0000 7f12c45ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12bc0c5bf0 0x7f12bc0c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:49.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.419+0000 7f12c45ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc156fc0 0x7f12bc157450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:49.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.419+0000 7f12c45ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12bc0bfd00 con 0x7f12bc0c5bf0 2023-08-31T19:07:49.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.419+0000 7f12c45ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12bc0c05a0 con 0x7f12bc0a9eb0 2023-08-31T19:07:49.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.419+0000 7f12c45ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0aaea0 con 0x7f12bc156fc0 2023-08-31T19:07:49.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.419+0000 7f12c1b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12bc0c5bf0 0x7f12bc0c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:49.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.419+0000 7f12c1b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12bc0c5bf0 0x7f12bc0c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50120/0 (socket says 172.21.15.72:50120) 2023-08-31T19:07:49.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.419+0000 7f12c1b9a700 1 -- 172.21.15.72:0/956396234 learned_addr learned my addr 172.21.15.72:0/956396234 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:49.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.420+0000 7f12c239b700 1 --2- 172.21.15.72:0/956396234 >> v2:172.21.15.146:3300/0 conn(0x7f12bc0a9eb0 0x7f12bc0aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:49.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.420+0000 7f12c2b9c700 1 --2- 172.21.15.72:0/956396234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc156fc0 0x7f12bc157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:49.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.420+0000 7f12c1b9a700 1 -- 172.21.15.72:0/956396234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc156fc0 msgr2=0x7f12bc157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:49.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.420+0000 7f12c1b9a700 1 --2- 172.21.15.72:0/956396234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc156fc0 0x7f12bc157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:49.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.420+0000 7f12c1b9a700 1 -- 172.21.15.72:0/956396234 >> v2:172.21.15.146:3300/0 conn(0x7f12bc0a9eb0 msgr2=0x7f12bc0aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:49.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.420+0000 7f12c1b9a700 1 --2- 172.21.15.72:0/956396234 >> v2:172.21.15.146:3300/0 conn(0x7f12bc0a9eb0 0x7f12bc0aa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:49.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.420+0000 7f12c1b9a700 1 -- 172.21.15.72:0/956396234 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc0c6670 con 0x7f12bc0c5bf0 2023-08-31T19:07:49.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.420+0000 7f12c239b700 1 --2- 172.21.15.72:0/956396234 >> v2:172.21.15.146:3300/0 conn(0x7f12bc0a9eb0 0x7f12bc0aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:49.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.420+0000 7f12c1b9a700 1 --2- 172.21.15.72:0/956396234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12bc0c5bf0 0x7f12bc0c6070 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f12bc064400 tx=0x7f12ac0090f0).ready entity=mon.0 client_cookie=28216224aee100d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:49.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.420+0000 7f12c1399700 1 -- 172.21.15.72:0/956396234 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac00b600 con 0x7f12bc0c5bf0 2023-08-31T19:07:49.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.420+0000 7f12c1399700 1 -- 172.21.15.72:0/956396234 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac00b760 con 0x7f12bc0c5bf0 2023-08-31T19:07:49.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.420+0000 7f12c1399700 1 -- 172.21.15.72:0/956396234 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac00bae0 con 0x7f12bc0c5bf0 2023-08-31T19:07:49.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.421+0000 7f12c45ff700 1 -- 172.21.15.72:0/956396234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12bc0c5bf0 msgr2=0x7f12bc0c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:49.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.421+0000 7f12c45ff700 1 --2- 172.21.15.72:0/956396234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12bc0c5bf0 0x7f12bc0c6070 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f12bc064400 tx=0x7f12ac0090f0).stop 2023-08-31T19:07:49.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.421+0000 7f12c45ff700 1 -- 172.21.15.72:0/956396234 shutdown_connections 2023-08-31T19:07:49.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.421+0000 7f12c45ff700 1 --2- 172.21.15.72:0/956396234 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc156fc0 0x7f12bc157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:49.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.421+0000 7f12c45ff700 1 --2- 172.21.15.72:0/956396234 >> v2:172.21.15.146:3300/0 conn(0x7f12bc0a9eb0 0x7f12bc0aa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:49.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.421+0000 7f12c45ff700 1 --2- 172.21.15.72:0/956396234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12bc0c5bf0 0x7f12bc0c6070 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:49.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.421+0000 7f12c45ff700 1 -- 172.21.15.72:0/956396234 >> 172.21.15.72:0/956396234 conn(0x7f12bc0c82e0 msgr2=0x7f12bc05e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:49.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.421+0000 7f12c45ff700 1 -- 172.21.15.72:0/956396234 shutdown_connections 2023-08-31T19:07:49.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.421+0000 7f12c45ff700 1 -- 172.21.15.72:0/956396234 wait complete. 2023-08-31T19:07:49.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.422+0000 7f12c45ff700 1 Processor -- start 2023-08-31T19:07:49.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.423+0000 7f12c45ff700 1 -- start start 2023-08-31T19:07:49.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.423+0000 7f12c45ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12bc0a9eb0 0x7f12bc142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:49.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.423+0000 7f12c45ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc0c5bf0 0x7f12bc0afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:49.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.423+0000 7f12c45ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12bc156fc0 0x7f12bc0b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:49.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.423+0000 7f12c45ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc154480 con 0x7f12bc0a9eb0 2023-08-31T19:07:49.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.423+0000 7f12c45ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc1641c0 con 0x7f12bc156fc0 2023-08-31T19:07:49.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.423+0000 7f12c45ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc1535d0 con 0x7f12bc0c5bf0 2023-08-31T19:07:49.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.424+0000 7f12c239b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12bc0a9eb0 0x7f12bc142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:49.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.424+0000 7f12c239b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12bc0a9eb0 0x7f12bc142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50130/0 (socket says 172.21.15.72:50130) 2023-08-31T19:07:49.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.424+0000 7f12c239b700 1 -- 172.21.15.72:0/3778840610 learned_addr learned my addr 172.21.15.72:0/3778840610 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:49.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.424+0000 7f12c1b9a700 1 --2- 172.21.15.72:0/3778840610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc0c5bf0 0x7f12bc0afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:49.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.424+0000 7f12c2b9c700 1 --2- 172.21.15.72:0/3778840610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12bc156fc0 0x7f12bc0b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:49.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.424+0000 7f12c239b700 1 -- 172.21.15.72:0/3778840610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc0c5bf0 msgr2=0x7f12bc0afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:49.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.424+0000 7f12c239b700 1 --2- 172.21.15.72:0/3778840610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc0c5bf0 0x7f12bc0afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:49.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.424+0000 7f12c239b700 1 -- 172.21.15.72:0/3778840610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12bc156fc0 msgr2=0x7f12bc0b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:49.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.424+0000 7f12c239b700 1 --2- 172.21.15.72:0/3778840610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12bc156fc0 0x7f12bc0b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:49.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.424+0000 7f12c239b700 1 -- 172.21.15.72:0/3778840610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac009370 con 0x7f12bc0a9eb0 2023-08-31T19:07:49.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.424+0000 7f12c2b9c700 1 --2- 172.21.15.72:0/3778840610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12bc156fc0 0x7f12bc0b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:49.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.424+0000 7f12c239b700 1 --2- 172.21.15.72:0/3778840610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12bc0a9eb0 0x7f12bc142120 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f12b800d860 tx=0x7f12b8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:49.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.424+0000 7f12b27fc700 1 -- 172.21.15.72:0/3778840610 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8011590 con 0x7f12bc0a9eb0 2023-08-31T19:07:49.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.425+0000 7f12b27fc700 1 -- 172.21.15.72:0/3778840610 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b80116f0 con 0x7f12bc0a9eb0 2023-08-31T19:07:49.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.425+0000 7f12c45ff700 1 -- 172.21.15.72:0/3778840610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12bc153870 con 0x7f12bc0a9eb0 2023-08-31T19:07:49.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.425+0000 7f12b27fc700 1 -- 172.21.15.72:0/3778840610 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8011a70 con 0x7f12bc0a9eb0 2023-08-31T19:07:49.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.425+0000 7f12c45ff700 1 -- 172.21.15.72:0/3778840610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12bc153e30 con 0x7f12bc0a9eb0 2023-08-31T19:07:49.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.426+0000 7f12c45ff700 1 -- 172.21.15.72:0/3778840610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12bc154760 con 0x7f12bc0a9eb0 2023-08-31T19:07:49.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.426+0000 7f12b27fc700 1 -- 172.21.15.72:0/3778840610 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f12b8012420 con 0x7f12bc0a9eb0 2023-08-31T19:07:49.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.427+0000 7f12b27fc700 1 --2- 172.21.15.72:0/3778840610 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f12a005ef30 0x7f12a00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:49.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.427+0000 7f12b27fc700 1 -- 172.21.15.72:0/3778840610 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f12b8079ca0 con 0x7f12bc0a9eb0 2023-08-31T19:07:49.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.427+0000 7f12c1b9a700 1 --2- 172.21.15.72:0/3778840610 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f12a005ef30 0x7f12a00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:49.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.428+0000 7f12c1b9a700 1 --2- 172.21.15.72:0/3778840610 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f12a005ef30 0x7f12a00613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f12ac009130 tx=0x7f12ac017000).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:49.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.431+0000 7f12b27fc700 1 -- 172.21.15.72:0/3778840610 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f12b804ade0 con 0x7f12bc0a9eb0 2023-08-31T19:07:49.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:49.660+0000 7f12c45ff700 1 -- 172.21.15.72:0/3778840610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f12bc06c6b0 con 0x7f12bc0a9eb0 2023-08-31T19:07:50.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.390+0000 7f12b27fc700 1 -- 172.21.15.72:0/3778840610 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v755) v1 ==== 174+0+0 (secure 0 0 0) 0x7f12b804e400 con 0x7f12bc0a9eb0 2023-08-31T19:07:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.392+0000 7f12c45ff700 1 -- 172.21.15.72:0/3778840610 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f12a005ef30 msgr2=0x7f12a00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.392+0000 7f12c45ff700 1 --2- 172.21.15.72:0/3778840610 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f12a005ef30 0x7f12a00613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f12ac009130 tx=0x7f12ac017000).stop 2023-08-31T19:07:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.392+0000 7f12c45ff700 1 -- 172.21.15.72:0/3778840610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12bc0a9eb0 msgr2=0x7f12bc142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.392+0000 7f12c45ff700 1 --2- 172.21.15.72:0/3778840610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12bc0a9eb0 0x7f12bc142120 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f12b800d860 tx=0x7f12b8008040).stop 2023-08-31T19:07:50.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.392+0000 7f12c45ff700 1 -- 172.21.15.72:0/3778840610 shutdown_connections 2023-08-31T19:07:50.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.392+0000 7f12c45ff700 1 --2- 172.21.15.72:0/3778840610 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f12a005ef30 0x7f12a00613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:50.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.392+0000 7f12c45ff700 1 --2- 172.21.15.72:0/3778840610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12bc156fc0 0x7f12bc0b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:50.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.392+0000 7f12c45ff700 1 --2- 172.21.15.72:0/3778840610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12bc0a9eb0 0x7f12bc142120 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:50.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.392+0000 7f12c45ff700 1 --2- 172.21.15.72:0/3778840610 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12bc0c5bf0 0x7f12bc0afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.392+0000 7f12c45ff700 1 -- 172.21.15.72:0/3778840610 >> 172.21.15.72:0/3778840610 conn(0x7f12bc0c82e0 msgr2=0x7f12bc0ab670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.392+0000 7f12c45ff700 1 -- 172.21.15.72:0/3778840610 shutdown_connections 2023-08-31T19:07:50.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.392+0000 7f12c45ff700 1 -- 172.21.15.72:0/3778840610 wait complete. 2023-08-31T19:07:50.412 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-08-31T19:07:50.412 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-08-31T19:07:50.413 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-31T19:07:50.413 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-08-31T19:07:50.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.602+0000 7f25247ff700 1 Processor -- start 2023-08-31T19:07:50.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.603+0000 7f25247ff700 1 -- start start 2023-08-31T19:07:50.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.604+0000 7f25247ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f251c154060 0x7f251c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:50.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.604+0000 7f25247ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251c0cb9b0 0x7f251c1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:50.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.604+0000 7f25247ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c0c6120 con 0x7f251c1586b0 2023-08-31T19:07:50.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.604+0000 7f25247ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251c0c1380 con 0x7f251c154060 2023-08-31T19:07:50.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.604+0000 7f25247ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c158b60 con 0x7f251c0cb9b0 2023-08-31T19:07:50.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.605+0000 7f2521d9a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251c0cb9b0 0x7f251c1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:50.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.605+0000 7f252259b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f251c154060 0x7f251c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:50.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.605+0000 7f252259b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f251c154060 0x7f251c157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:58228/0 (socket says 172.21.15.72:58228) 2023-08-31T19:07:50.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.605+0000 7f2522d9c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f251c1586b0 0x7f251c0c65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:50250/0 (socket says 172.21.15.72:50250) 2023-08-31T19:07:50.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.605+0000 7f252259b700 1 -- 172.21.15.72:0/3803543528 learned_addr learned my addr 172.21.15.72:0/3803543528 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:50.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.605+0000 7f2521d9a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251c0cb9b0 0x7f251c1581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:48986/0 (socket says 172.21.15.72:48986) 2023-08-31T19:07:50.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.605+0000 7f2521599700 1 -- 172.21.15.72:0/3803543528 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019361010 0 0) 0x7f251c0c6120 con 0x7f251c1586b0 2023-08-31T19:07:50.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.605+0000 7f2521599700 1 -- 172.21.15.72:0/3803543528 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25080033f0 con 0x7f251c1586b0 2023-08-31T19:07:50.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.605+0000 7f2521d9a700 1 -- 172.21.15.72:0/3803543528 >> v2:172.21.15.146:3300/0 conn(0x7f251c154060 msgr2=0x7f251c157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:50.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.605+0000 7f2521d9a700 1 --2- 172.21.15.72:0/3803543528 >> v2:172.21.15.146:3300/0 conn(0x7f251c154060 0x7f251c157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:50.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.605+0000 7f2521d9a700 1 -- 172.21.15.72:0/3803543528 >> v1:172.21.15.146:6789/0 conn(0x7f251c1586b0 legacy=0x7f251c0c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:50.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.605+0000 7f2521d9a700 1 -- 172.21.15.72:0/3803543528 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c0c5e10 con 0x7f251c0cb9b0 2023-08-31T19:07:50.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.605+0000 7f252259b700 1 --2- 172.21.15.72:0/3803543528 >> v2:172.21.15.146:3300/0 conn(0x7f251c154060 0x7f251c157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:07:50.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.605+0000 7f2521d9a700 1 --2- 172.21.15.72:0/3803543528 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251c0cb9b0 0x7f251c1581c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f250c009760 tx=0x7f250c009060).ready entity=mon.2 client_cookie=5b707e577f2cb02f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:50.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.606+0000 7f2521599700 1 -- 172.21.15.72:0/3803543528 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c00d4a0 con 0x7f251c0cb9b0 2023-08-31T19:07:50.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.606+0000 7f2521599700 1 -- 172.21.15.72:0/3803543528 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c00d600 con 0x7f251c0cb9b0 2023-08-31T19:07:50.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.606+0000 7f2521599700 1 -- 172.21.15.72:0/3803543528 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c00d980 con 0x7f251c0cb9b0 2023-08-31T19:07:50.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.606+0000 7f25247ff700 1 -- 172.21.15.72:0/3803543528 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251c0cb9b0 msgr2=0x7f251c1581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:50.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.606+0000 7f25247ff700 1 --2- 172.21.15.72:0/3803543528 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251c0cb9b0 0x7f251c1581c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f250c009760 tx=0x7f250c009060).stop 2023-08-31T19:07:50.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.606+0000 7f25247ff700 1 -- 172.21.15.72:0/3803543528 shutdown_connections 2023-08-31T19:07:50.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.606+0000 7f25247ff700 1 --2- 172.21.15.72:0/3803543528 >> v2:172.21.15.146:3300/0 conn(0x7f251c154060 0x7f251c157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:50.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.606+0000 7f25247ff700 1 --2- 172.21.15.72:0/3803543528 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251c0cb9b0 0x7f251c1581c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:50.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.606+0000 7f25247ff700 1 -- 172.21.15.72:0/3803543528 >> 172.21.15.72:0/3803543528 conn(0x7f251c05e870 msgr2=0x7f251c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:50.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.606+0000 7f25247ff700 1 -- 172.21.15.72:0/3803543528 shutdown_connections 2023-08-31T19:07:50.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.606+0000 7f25247ff700 1 -- 172.21.15.72:0/3803543528 wait complete. 2023-08-31T19:07:50.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.608+0000 7f25247ff700 1 Processor -- start 2023-08-31T19:07:50.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.608+0000 7f25247ff700 1 -- start start 2023-08-31T19:07:50.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.609+0000 7f25247ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f251c0cb9b0 0x7f251c0a92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:50.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.609+0000 7f25247ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f251c154060 0x7f251c0ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:50.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.609+0000 7f25247ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251c1586b0 0x7f251c167160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:50.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.609+0000 7f25247ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0ab430 con 0x7f251c154060 2023-08-31T19:07:50.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.609+0000 7f25247ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0ad680 con 0x7f251c0cb9b0 2023-08-31T19:07:50.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.609+0000 7f25247ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0abc90 con 0x7f251c1586b0 2023-08-31T19:07:50.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.609+0000 7f2521d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f251c154060 0x7f251c0ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:50.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.609+0000 7f2521d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f251c154060 0x7f251c0ac120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50142/0 (socket says 172.21.15.72:50142) 2023-08-31T19:07:50.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.609+0000 7f2521d9a700 1 -- 172.21.15.72:0/1132492276 learned_addr learned my addr 172.21.15.72:0/1132492276 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:50.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.609+0000 7f252259b700 1 --2- 172.21.15.72:0/1132492276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f251c0cb9b0 0x7f251c0a92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:50.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.609+0000 7f2522d9c700 1 --2- 172.21.15.72:0/1132492276 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251c1586b0 0x7f251c167160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:50.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.610+0000 7f2521d9a700 1 -- 172.21.15.72:0/1132492276 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251c1586b0 msgr2=0x7f251c167160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:50.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.610+0000 7f2521d9a700 1 --2- 172.21.15.72:0/1132492276 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251c1586b0 0x7f251c167160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:50.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.610+0000 7f2521d9a700 1 -- 172.21.15.72:0/1132492276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f251c0cb9b0 msgr2=0x7f251c0a92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:50.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.610+0000 7f2521d9a700 1 --2- 172.21.15.72:0/1132492276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f251c0cb9b0 0x7f251c0a92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:50.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.610+0000 7f2521d9a700 1 -- 172.21.15.72:0/1132492276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518009300 con 0x7f251c154060 2023-08-31T19:07:50.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.610+0000 7f2521d9a700 1 --2- 172.21.15.72:0/1132492276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f251c154060 0x7f251c0ac120 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f250c00d260 tx=0x7f250c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:50.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.610+0000 7f25127fc700 1 -- 172.21.15.72:0/1132492276 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c00dcf0 con 0x7f251c154060 2023-08-31T19:07:50.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.610+0000 7f25127fc700 1 -- 172.21.15.72:0/1132492276 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c00de50 con 0x7f251c154060 2023-08-31T19:07:50.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.610+0000 7f25247ff700 1 -- 172.21.15.72:0/1132492276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250c0092a0 con 0x7f251c154060 2023-08-31T19:07:50.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.610+0000 7f25127fc700 1 -- 172.21.15.72:0/1132492276 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c01d430 con 0x7f251c154060 2023-08-31T19:07:50.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.610+0000 7f25247ff700 1 -- 172.21.15.72:0/1132492276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c0ab920 con 0x7f251c154060 2023-08-31T19:07:50.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.611+0000 7f25247ff700 1 -- 172.21.15.72:0/1132492276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c06c6b0 con 0x7f251c154060 2023-08-31T19:07:50.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.612+0000 7f25127fc700 1 -- 172.21.15.72:0/1132492276 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f250c01d7a0 con 0x7f251c154060 2023-08-31T19:07:50.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.613+0000 7f25127fc700 1 --2- 172.21.15.72:0/1132492276 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f250005ef60 0x7f2500061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:50.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.613+0000 7f25127fc700 1 -- 172.21.15.72:0/1132492276 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f250c07b910 con 0x7f251c154060 2023-08-31T19:07:50.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.613+0000 7f252259b700 1 --2- 172.21.15.72:0/1132492276 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f250005ef60 0x7f2500061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:50.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.613+0000 7f252259b700 1 --2- 172.21.15.72:0/1132492276 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f250005ef60 0x7f2500061420 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2518006b40 tx=0x7f2518009060).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:50.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.617+0000 7f25127fc700 1 -- 172.21.15.72:0/1132492276 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f250c04c9f0 con 0x7f251c154060 2023-08-31T19:07:50.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:50.850+0000 7f25247ff700 1 -- 172.21.15.72:0/1132492276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f251c0c0ae0 con 0x7f251c154060 2023-08-31T19:07:51.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.392+0000 7f25127fc700 1 -- 172.21.15.72:0/1132492276 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v756) v1 ==== 168+0+0 (secure 0 0 0) 0x7f250c050010 con 0x7f251c154060 2023-08-31T19:07:51.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.395+0000 7f25247ff700 1 -- 172.21.15.72:0/1132492276 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f250005ef60 msgr2=0x7f2500061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:51.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.395+0000 7f25247ff700 1 --2- 172.21.15.72:0/1132492276 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f250005ef60 0x7f2500061420 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2518006b40 tx=0x7f2518009060).stop 2023-08-31T19:07:51.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.395+0000 7f25247ff700 1 -- 172.21.15.72:0/1132492276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f251c154060 msgr2=0x7f251c0ac120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:51.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.395+0000 7f25247ff700 1 --2- 172.21.15.72:0/1132492276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f251c154060 0x7f251c0ac120 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f250c00d260 tx=0x7f250c016000).stop 2023-08-31T19:07:51.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.395+0000 7f25247ff700 1 -- 172.21.15.72:0/1132492276 shutdown_connections 2023-08-31T19:07:51.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.395+0000 7f25247ff700 1 --2- 172.21.15.72:0/1132492276 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f251c1586b0 0x7f251c167160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:51.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.395+0000 7f25247ff700 1 --2- 172.21.15.72:0/1132492276 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f250005ef60 0x7f2500061420 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:51.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.395+0000 7f25247ff700 1 --2- 172.21.15.72:0/1132492276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f251c0cb9b0 0x7f251c0a92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:51.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.395+0000 7f25247ff700 1 --2- 172.21.15.72:0/1132492276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f251c154060 0x7f251c0ac120 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:51.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.395+0000 7f25247ff700 1 -- 172.21.15.72:0/1132492276 >> 172.21.15.72:0/1132492276 conn(0x7f251c05e870 msgr2=0x7f251c0c8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:51.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.395+0000 7f25247ff700 1 -- 172.21.15.72:0/1132492276 shutdown_connections 2023-08-31T19:07:51.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.395+0000 7f25247ff700 1 -- 172.21.15.72:0/1132492276 wait complete. 2023-08-31T19:07:51.414 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-31T19:07:51.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.607+0000 7f0476fff700 1 Processor -- start 2023-08-31T19:07:51.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.607+0000 7f0476fff700 1 -- start start 2023-08-31T19:07:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.609+0000 7f0476fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04701520e0 0x7f04700a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.609+0000 7f0476fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0470064340 con 0x7f0470068ba0 2023-08-31T19:07:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.609+0000 7f0476fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04700bcd00 con 0x7f04700a9440 2023-08-31T19:07:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.609+0000 7f0476fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04700bcfe0 con 0x7f04701520e0 2023-08-31T19:07:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.609+0000 7f047559c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0470068ba0 0x7f0470064840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55540/0 (socket says 172.21.15.72:55540) 2023-08-31T19:07:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.609+0000 7f047559c700 1 -- 172.21.15.72:0/617525501 learned_addr learned my addr 172.21.15.72:0/617525501 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:51.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.609+0000 7f0474d9b700 1 --2- 172.21.15.72:0/617525501 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04701520e0 0x7f04700a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:51.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.609+0000 7f046f7fe700 1 -- 172.21.15.72:0/617525501 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489852195 0 0) 0x7f0470064340 con 0x7f0470068ba0 2023-08-31T19:07:51.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.609+0000 7f046f7fe700 1 -- 172.21.15.72:0/617525501 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04600033f0 con 0x7f0470068ba0 2023-08-31T19:07:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f046f7fe700 1 -- 172.21.15.72:0/617525501 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2347827973 0 0) 0x7f04600033f0 con 0x7f0470068ba0 2023-08-31T19:07:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f046f7fe700 1 -- 172.21.15.72:0/617525501 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04701520e0 msgr2=0x7f04700a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f046f7fe700 1 --2- 172.21.15.72:0/617525501 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04701520e0 0x7f04700a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f046f7fe700 1 -- 172.21.15.72:0/617525501 >> v1:172.21.15.146:6789/0 conn(0x7f04700a9440 legacy=0x7f0470068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f046f7fe700 1 -- 172.21.15.72:0/617525501 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04700bd2c0 con 0x7f0470068ba0 2023-08-31T19:07:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f046f7fe700 1 -- 172.21.15.72:0/617525501 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f04680017f0 con 0x7f0470068ba0 2023-08-31T19:07:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f046f7fe700 1 -- 172.21.15.72:0/617525501 >> v1:172.21.15.72:6789/0 conn(0x7f0470068ba0 legacy=0x7f0470064840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f046f7fe700 1 --2- 172.21.15.72:0/617525501 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04701520e0 0x7f0460003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f046f7fe700 1 --2- 172.21.15.72:0/617525501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0460003e00 0x7f0460004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f046f7fe700 1 --2- 172.21.15.72:0/617525501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0460004b80 0x7f0460005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f046f7fe700 1 -- 172.21.15.72:0/617525501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04700bcfe0 con 0x7f0460003e00 2023-08-31T19:07:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f046f7fe700 1 -- 172.21.15.72:0/617525501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046000b8e0 con 0x7f0460004b80 2023-08-31T19:07:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f046f7fe700 1 -- 172.21.15.72:0/617525501 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046000baa0 con 0x7f04701520e0 2023-08-31T19:07:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f046ffff700 1 --2- 172.21.15.72:0/617525501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0460003e00 0x7f0460004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f0474d9b700 1 --2- 172.21.15.72:0/617525501 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04701520e0 0x7f0460003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:51.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.610+0000 7f047559c700 1 --2- 172.21.15.72:0/617525501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0460004b80 0x7f0460005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:51.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.611+0000 7f046ffff700 1 -- 172.21.15.72:0/617525501 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04701520e0 msgr2=0x7f0460003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:51.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.611+0000 7f046ffff700 1 --2- 172.21.15.72:0/617525501 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f04701520e0 0x7f0460003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:51.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.611+0000 7f046ffff700 1 -- 172.21.15.72:0/617525501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0460004b80 msgr2=0x7f0460005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:51.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.611+0000 7f046ffff700 1 --2- 172.21.15.72:0/617525501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0460004b80 0x7f0460005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:51.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.611+0000 7f046ffff700 1 -- 172.21.15.72:0/617525501 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04600033f0 con 0x7f0460003e00 2023-08-31T19:07:51.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.611+0000 7f046ffff700 1 --2- 172.21.15.72:0/617525501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0460003e00 0x7f0460004690 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f045c0018e0 tx=0x7f045c007bb0).ready entity=mon.0 client_cookie=ff8e4d89b0d3e02a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:51.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.611+0000 7f046f7fe700 1 -- 172.21.15.72:0/617525501 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c012400 con 0x7f0460003e00 2023-08-31T19:07:51.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.611+0000 7f046f7fe700 1 -- 172.21.15.72:0/617525501 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045c012560 con 0x7f0460003e00 2023-08-31T19:07:51.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.611+0000 7f046f7fe700 1 -- 172.21.15.72:0/617525501 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c012920 con 0x7f0460003e00 2023-08-31T19:07:51.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.611+0000 7f0476fff700 1 -- 172.21.15.72:0/617525501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0460003e00 msgr2=0x7f0460004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:51.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.611+0000 7f0476fff700 1 --2- 172.21.15.72:0/617525501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0460003e00 0x7f0460004690 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f045c0018e0 tx=0x7f045c007bb0).stop 2023-08-31T19:07:51.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.611+0000 7f047559c700 1 -- 172.21.15.72:0/617525501 reap_dead start 2023-08-31T19:07:51.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.612+0000 7f0476fff700 1 -- 172.21.15.72:0/617525501 shutdown_connections 2023-08-31T19:07:51.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.612+0000 7f0476fff700 1 -- 172.21.15.72:0/617525501 >> 172.21.15.72:0/617525501 conn(0x7f04700630c0 msgr2=0x7f04700c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:51.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.612+0000 7f0476fff700 1 -- 172.21.15.72:0/617525501 shutdown_connections 2023-08-31T19:07:51.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.612+0000 7f0476fff700 1 -- 172.21.15.72:0/617525501 wait complete. 2023-08-31T19:07:51.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.613+0000 7f0476fff700 1 Processor -- start 2023-08-31T19:07:51.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.613+0000 7f0476fff700 1 -- start start 2023-08-31T19:07:51.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.614+0000 7f0476fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0460003e00 0x7f0470151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:51.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.614+0000 7f0476fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f047014ef30 0x7f047014bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:51.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.614+0000 7f0476fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f047014c3c0 0x7f0470149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:51.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.614+0000 7f0476fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047014ff00 con 0x7f047014ef30 2023-08-31T19:07:51.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.614+0000 7f0476fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0470151860 con 0x7f047014c3c0 2023-08-31T19:07:51.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.614+0000 7f0476fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047014f3b0 con 0x7f0460003e00 2023-08-31T19:07:51.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.614+0000 7f046ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f047014ef30 0x7f047014bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:51.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.614+0000 7f046ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f047014ef30 0x7f047014bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50156/0 (socket says 172.21.15.72:50156) 2023-08-31T19:07:51.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.614+0000 7f046ffff700 1 -- 172.21.15.72:0/3367855245 learned_addr learned my addr 172.21.15.72:0/3367855245 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:51.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.615+0000 7f046ffff700 1 -- 172.21.15.72:0/3367855245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0460003e00 msgr2=0x7f0470151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:51.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.615+0000 7f046ffff700 1 --2- 172.21.15.72:0/3367855245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0460003e00 0x7f0470151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:51.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.615+0000 7f046ffff700 1 -- 172.21.15.72:0/3367855245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f047014c3c0 msgr2=0x7f0470149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:51.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.615+0000 7f046ffff700 1 --2- 172.21.15.72:0/3367855245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f047014c3c0 0x7f0470149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:51.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.615+0000 7f046ffff700 1 -- 172.21.15.72:0/3367855245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047014f660 con 0x7f047014ef30 2023-08-31T19:07:51.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.615+0000 7f046ffff700 1 --2- 172.21.15.72:0/3367855245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f047014ef30 0x7f047014bed0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f045c00c0e0 tx=0x7f045c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:51.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.615+0000 7f046cff9700 1 -- 172.21.15.72:0/3367855245 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c012400 con 0x7f047014ef30 2023-08-31T19:07:51.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.615+0000 7f046cff9700 1 -- 172.21.15.72:0/3367855245 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045c0128e0 con 0x7f047014ef30 2023-08-31T19:07:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.615+0000 7f0476fff700 1 -- 172.21.15.72:0/3367855245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047014f940 con 0x7f047014ef30 2023-08-31T19:07:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.615+0000 7f046cff9700 1 -- 172.21.15.72:0/3367855245 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c006b00 con 0x7f047014ef30 2023-08-31T19:07:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.615+0000 7f0476fff700 1 -- 172.21.15.72:0/3367855245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0470160450 con 0x7f047014ef30 2023-08-31T19:07:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.616+0000 7f0476fff700 1 -- 172.21.15.72:0/3367855245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04701602b0 con 0x7f047014ef30 2023-08-31T19:07:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.617+0000 7f046cff9700 1 -- 172.21.15.72:0/3367855245 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f045c019070 con 0x7f047014ef30 2023-08-31T19:07:51.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.619+0000 7f046cff9700 1 --2- 172.21.15.72:0/3367855245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f045405eea0 0x7f0454061360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:51.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.619+0000 7f046cff9700 1 -- 172.21.15.72:0/3367855245 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f045c07b2a0 con 0x7f047014ef30 2023-08-31T19:07:51.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.619+0000 7f0474d9b700 1 --2- 172.21.15.72:0/3367855245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f045405eea0 0x7f0454061360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:51.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.619+0000 7f0474d9b700 1 --2- 172.21.15.72:0/3367855245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f045405eea0 0x7f0454061360 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0464006d80 tx=0x7f0464012040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:51.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.623+0000 7f046cff9700 1 -- 172.21.15.72:0/3367855245 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f04701602b0 con 0x7f047014ef30 2023-08-31T19:07:51.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.793+0000 7f0476fff700 1 -- 172.21.15.72:0/3367855245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f04701602b0 con 0x7f047014ef30 2023-08-31T19:07:51.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.799+0000 7f046cff9700 1 -- 172.21.15.72:0/3367855245 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f04701602b0 con 0x7f047014ef30 2023-08-31T19:07:51.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.801+0000 7f0476fff700 1 -- 172.21.15.72:0/3367855245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f045405eea0 msgr2=0x7f0454061360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:51.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.801+0000 7f0476fff700 1 --2- 172.21.15.72:0/3367855245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f045405eea0 0x7f0454061360 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0464006d80 tx=0x7f0464012040).stop 2023-08-31T19:07:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.801+0000 7f0476fff700 1 -- 172.21.15.72:0/3367855245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f047014ef30 msgr2=0x7f047014bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.801+0000 7f0476fff700 1 --2- 172.21.15.72:0/3367855245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f047014ef30 0x7f047014bed0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f045c00c0e0 tx=0x7f045c017000).stop 2023-08-31T19:07:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.801+0000 7f0476fff700 1 -- 172.21.15.72:0/3367855245 shutdown_connections 2023-08-31T19:07:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.801+0000 7f0476fff700 1 --2- 172.21.15.72:0/3367855245 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f045405eea0 0x7f0454061360 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.801+0000 7f0476fff700 1 --2- 172.21.15.72:0/3367855245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f047014c3c0 0x7f0470149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:51.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.801+0000 7f0476fff700 1 --2- 172.21.15.72:0/3367855245 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0460003e00 0x7f0470151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:51.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.801+0000 7f0476fff700 1 --2- 172.21.15.72:0/3367855245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f047014ef30 0x7f047014bed0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:51.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.801+0000 7f0476fff700 1 -- 172.21.15.72:0/3367855245 >> 172.21.15.72:0/3367855245 conn(0x7f04700630c0 msgr2=0x7f0470064740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:51.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.801+0000 7f0476fff700 1 -- 172.21.15.72:0/3367855245 shutdown_connections 2023-08-31T19:07:51.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:51.801+0000 7f0476fff700 1 -- 172.21.15.72:0/3367855245 wait complete. 2023-08-31T19:07:51.819 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:07:51.819 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:07:51.917 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:07:52.021 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:07:52.022 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-31T19:07:52.022 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:07:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.210+0000 7f83223ff700 1 Processor -- start 2023-08-31T19:07:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.211+0000 7f83223ff700 1 -- start start 2023-08-31T19:07:52.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.212+0000 7f83223ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f831c0cb9b0 0x7f831c1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:52.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.212+0000 7f83223ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831c0c6120 con 0x7f831c1588d0 2023-08-31T19:07:52.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.212+0000 7f83223ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831c0c5e10 con 0x7f831c154060 2023-08-31T19:07:52.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.212+0000 7f83223ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c0c1380 con 0x7f831c0cb9b0 2023-08-31T19:07:52.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.212+0000 7f832099c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f831c1588d0 0x7f831c154440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55542/0 (socket says 172.21.15.72:55542) 2023-08-31T19:07:52.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.212+0000 7f832099c700 1 -- 172.21.15.72:0/3262717756 learned_addr learned my addr 172.21.15.72:0/3262717756 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:52.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.212+0000 7f831b7fe700 1 --2- 172.21.15.72:0/3262717756 >> v2:172.21.15.146:3300/0 conn(0x7f831c0cb9b0 0x7f831c1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:52.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.213+0000 7f831affd700 1 -- 172.21.15.72:0/3262717756 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709424809 0 0) 0x7f831c0c6120 con 0x7f831c1588d0 2023-08-31T19:07:52.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.213+0000 7f831affd700 1 -- 172.21.15.72:0/3262717756 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83040033f0 con 0x7f831c1588d0 2023-08-31T19:07:52.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.213+0000 7f831affd700 1 -- 172.21.15.72:0/3262717756 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996702595 0 0) 0x7f831c0c5e10 con 0x7f831c154060 2023-08-31T19:07:52.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.213+0000 7f831affd700 1 -- 172.21.15.72:0/3262717756 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f831c0c6120 con 0x7f831c154060 2023-08-31T19:07:52.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.213+0000 7f831b7fe700 1 -- 172.21.15.72:0/3262717756 >> v1:172.21.15.146:6789/0 conn(0x7f831c154060 legacy=0x7f831c157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:52.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.213+0000 7f831b7fe700 1 -- 172.21.15.72:0/3262717756 >> v1:172.21.15.72:6789/0 conn(0x7f831c1588d0 legacy=0x7f831c154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:52.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.213+0000 7f831affd700 1 -- 172.21.15.72:0/3262717756 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3497793167 0 0) 0x7f83040033f0 con 0x7f831c1588d0 2023-08-31T19:07:52.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.213+0000 7f831b7fe700 1 -- 172.21.15.72:0/3262717756 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c0c0ae0 con 0x7f831c0cb9b0 2023-08-31T19:07:52.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.213+0000 7f831b7fe700 1 --2- 172.21.15.72:0/3262717756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c0cb9b0 0x7f831c1583e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f8310009760 tx=0x7f8310009060).ready entity=mon.1 client_cookie=d8fab98c056fb586 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:52.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.213+0000 7f831affd700 1 -- 172.21.15.72:0/3262717756 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83140017f0 con 0x7f831c0cb9b0 2023-08-31T19:07:52.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.214+0000 7f831affd700 1 -- 172.21.15.72:0/3262717756 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310011400 con 0x7f831c0cb9b0 2023-08-31T19:07:52.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.214+0000 7f831affd700 1 -- 172.21.15.72:0/3262717756 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310011780 con 0x7f831c0cb9b0 2023-08-31T19:07:52.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.214+0000 7f83223ff700 1 -- 172.21.15.72:0/3262717756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c0cb9b0 msgr2=0x7f831c1583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:52.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.214+0000 7f83223ff700 1 --2- 172.21.15.72:0/3262717756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c0cb9b0 0x7f831c1583e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f8310009760 tx=0x7f8310009060).stop 2023-08-31T19:07:52.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.214+0000 7f83223ff700 1 -- 172.21.15.72:0/3262717756 shutdown_connections 2023-08-31T19:07:52.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.214+0000 7f83223ff700 1 --2- 172.21.15.72:0/3262717756 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c0cb9b0 0x7f831c1583e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:52.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.214+0000 7f83223ff700 1 -- 172.21.15.72:0/3262717756 >> 172.21.15.72:0/3262717756 conn(0x7f831c05e870 msgr2=0x7f831c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:52.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.214+0000 7f83223ff700 1 -- 172.21.15.72:0/3262717756 shutdown_connections 2023-08-31T19:07:52.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.214+0000 7f83223ff700 1 -- 172.21.15.72:0/3262717756 wait complete. 2023-08-31T19:07:52.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.216+0000 7f83223ff700 1 Processor -- start 2023-08-31T19:07:52.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.216+0000 7f83223ff700 1 -- start start 2023-08-31T19:07:52.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f83223ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c0cb9b0 0x7f831c1565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:52.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f83223ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f831c154060 0x7f831c151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:52.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f83223ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c1588d0 0x7f831c0c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:52.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f83223ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c157780 con 0x7f831c154060 2023-08-31T19:07:52.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f83223ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c0c7890 con 0x7f831c1588d0 2023-08-31T19:07:52.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f83223ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c0c7aa0 con 0x7f831c0cb9b0 2023-08-31T19:07:52.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f831b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f831c154060 0x7f831c151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:52.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f831b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f831c154060 0x7f831c151800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50166/0 (socket says 172.21.15.72:50166) 2023-08-31T19:07:52.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f831b7fe700 1 -- 172.21.15.72:0/4218943262 learned_addr learned my addr 172.21.15.72:0/4218943262 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f832099c700 1 --2- 172.21.15.72:0/4218943262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c1588d0 0x7f831c0c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f831bfff700 1 --2- 172.21.15.72:0/4218943262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c0cb9b0 0x7f831c1565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f831b7fe700 1 -- 172.21.15.72:0/4218943262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c0cb9b0 msgr2=0x7f831c1565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f831b7fe700 1 --2- 172.21.15.72:0/4218943262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c0cb9b0 0x7f831c1565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f831b7fe700 1 -- 172.21.15.72:0/4218943262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c1588d0 msgr2=0x7f831c0c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:52.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f831b7fe700 1 --2- 172.21.15.72:0/4218943262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c1588d0 0x7f831c0c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.217+0000 7f831b7fe700 1 -- 172.21.15.72:0/4218943262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100092a0 con 0x7f831c154060 2023-08-31T19:07:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.218+0000 7f831b7fe700 1 --2- 172.21.15.72:0/4218943262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f831c154060 0x7f831c151800 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f8310009d50 tx=0x7f8310016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.218+0000 7f8303fff700 1 -- 172.21.15.72:0/4218943262 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100108e0 con 0x7f831c154060 2023-08-31T19:07:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.218+0000 7f8303fff700 1 -- 172.21.15.72:0/4218943262 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310010a40 con 0x7f831c154060 2023-08-31T19:07:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.218+0000 7f8303fff700 1 -- 172.21.15.72:0/4218943262 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310010dc0 con 0x7f831c154060 2023-08-31T19:07:52.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.218+0000 7f83223ff700 1 -- 172.21.15.72:0/4218943262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831c0c7d80 con 0x7f831c154060 2023-08-31T19:07:52.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.218+0000 7f83223ff700 1 -- 172.21.15.72:0/4218943262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c0c8340 con 0x7f831c154060 2023-08-31T19:07:52.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.219+0000 7f83223ff700 1 -- 172.21.15.72:0/4218943262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831c06c6b0 con 0x7f831c154060 2023-08-31T19:07:52.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.220+0000 7f8303fff700 1 -- 172.21.15.72:0/4218943262 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f831001d640 con 0x7f831c154060 2023-08-31T19:07:52.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.220+0000 7f8303fff700 1 --2- 172.21.15.72:0/4218943262 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f830805ef30 0x7f83080613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:52.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.221+0000 7f8303fff700 1 -- 172.21.15.72:0/4218943262 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f831007b7c0 con 0x7f831c154060 2023-08-31T19:07:52.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.221+0000 7f831bfff700 1 --2- 172.21.15.72:0/4218943262 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f830805ef30 0x7f83080613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:52.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.221+0000 7f831bfff700 1 --2- 172.21.15.72:0/4218943262 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f830805ef30 0x7f83080613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f830c001170 tx=0x7f830c009040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:52.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.224+0000 7f8303fff700 1 -- 172.21.15.72:0/4218943262 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f831004c8a0 con 0x7f831c154060 2023-08-31T19:07:52.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.436+0000 7f83223ff700 1 -- 172.21.15.72:0/4218943262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f831c0c0dc0 con 0x7f831c154060 2023-08-31T19:07:52.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.437+0000 7f8303fff700 1 -- 172.21.15.72:0/4218943262 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f831004fec0 con 0x7f831c154060 2023-08-31T19:07:52.438 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:52.438 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":66,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6623,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2723616156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2723616156},{"type":"v1","addr":"172.21.15.72:6836","nonce":2723616156}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6629,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/1506898460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1506898460},{"type":"v1","addr":"172.21.15.146:6834","nonce":1506898460}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6632,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/1176286638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":1176286638},{"type":"v1","addr":"172.21.15.146:6835","nonce":1176286638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":8427,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1377399593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1377399593},{"type":"v1","addr":"172.21.15.72:6837","nonce":1377399593}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[]} 2023-08-31T19:07:52.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.439+0000 7f83223ff700 1 -- 172.21.15.72:0/4218943262 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f830805ef30 msgr2=0x7f83080613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:52.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.439+0000 7f83223ff700 1 --2- 172.21.15.72:0/4218943262 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f830805ef30 0x7f83080613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f830c001170 tx=0x7f830c009040).stop 2023-08-31T19:07:52.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.439+0000 7f83223ff700 1 -- 172.21.15.72:0/4218943262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f831c154060 msgr2=0x7f831c151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:52.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.439+0000 7f83223ff700 1 --2- 172.21.15.72:0/4218943262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f831c154060 0x7f831c151800 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f8310009d50 tx=0x7f8310016000).stop 2023-08-31T19:07:52.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.439+0000 7f83223ff700 1 -- 172.21.15.72:0/4218943262 shutdown_connections 2023-08-31T19:07:52.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.439+0000 7f83223ff700 1 --2- 172.21.15.72:0/4218943262 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f830805ef30 0x7f83080613f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:52.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.439+0000 7f83223ff700 1 --2- 172.21.15.72:0/4218943262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f831c1588d0 0x7f831c0c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:52.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.439+0000 7f83223ff700 1 --2- 172.21.15.72:0/4218943262 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f831c0cb9b0 0x7f831c1565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:52.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.439+0000 7f83223ff700 1 --2- 172.21.15.72:0/4218943262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f831c154060 0x7f831c151800 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:52.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.439+0000 7f83223ff700 1 -- 172.21.15.72:0/4218943262 >> 172.21.15.72:0/4218943262 conn(0x7f831c05e870 msgr2=0x7f831c1536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:52.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.439+0000 7f83223ff700 1 -- 172.21.15.72:0/4218943262 shutdown_connections 2023-08-31T19:07:52.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.439+0000 7f83223ff700 1 -- 172.21.15.72:0/4218943262 wait complete. 2023-08-31T19:07:52.442 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 66 2023-08-31T19:07:52.456 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T19:07:52.457 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-31T19:07:52.457 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T19:07:52.457 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:07:52.458 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T19:07:52.458 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-31T19:07:52.458 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T19:07:52.459 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:07:52.459 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T19:07:52.459 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-31T19:07:52.460 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T19:07:52.460 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:07:52.460 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T19:07:52.460 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-31T19:07:52.461 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T19:07:52.461 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:07:52.471 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T19:07:52.471 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T19:07:52.472 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T19:07:52.473 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T19:07:52.475 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T19:07:52.476 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T19:07:52.477 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T19:07:52.477 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T19:07:52.517 INFO:tasks.ceph.mds.a:Started 2023-08-31T19:07:52.518 DEBUG:teuthology.parallel:result is None 2023-08-31T19:07:52.521 INFO:tasks.ceph.mds.b:Started 2023-08-31T19:07:52.522 DEBUG:teuthology.parallel:result is None 2023-08-31T19:07:52.523 INFO:tasks.ceph.mds.c:Started 2023-08-31T19:07:52.523 DEBUG:teuthology.parallel:result is None 2023-08-31T19:07:52.525 INFO:tasks.ceph.mds.d:Started 2023-08-31T19:07:52.525 DEBUG:teuthology.parallel:result is None 2023-08-31T19:07:52.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-31T19:07:52.664 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T19:07:52.665 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-31T19:07:52.673 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-08-31T19:07:52.674 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-08-31T19:07:52.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.735+0000 7f91479ff700 1 Processor -- start 2023-08-31T19:07:52.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.735+0000 7f91479ff700 1 -- start start 2023-08-31T19:07:52.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.736+0000 7f91479ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9140157c10 0x7f91400ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:52.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.736+0000 7f91479ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91400637c0 0x7f9140155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:52.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.736+0000 7f91479ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91400c6130 con 0x7f91400ad1b0 2023-08-31T19:07:52.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.736+0000 7f91479ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91400c0350 con 0x7f91400637c0 2023-08-31T19:07:52.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.736+0000 7f91479ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91401580b0 con 0x7f9140157c10 2023-08-31T19:07:52.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.737+0000 7f9145f9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91400637c0 0x7f9140155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:52.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.737+0000 7f9145f9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91400637c0 0x7f9140155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50204/0 (socket says 172.21.15.72:50204) 2023-08-31T19:07:52.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.737+0000 7f9145f9c700 1 -- 172.21.15.72:0/1926951584 learned_addr learned my addr 172.21.15.72:0/1926951584 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:52.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.737+0000 7f9144f9a700 1 --2- 172.21.15.72:0/1926951584 >> v2:172.21.15.146:3300/0 conn(0x7f9140157c10 0x7f91400ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:52.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.737+0000 7f9145f9c700 1 -- 172.21.15.72:0/1926951584 >> v2:172.21.15.146:3300/0 conn(0x7f9140157c10 msgr2=0x7f91400ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:52.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.737+0000 7f9145f9c700 1 --2- 172.21.15.72:0/1926951584 >> v2:172.21.15.146:3300/0 conn(0x7f9140157c10 0x7f91400ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:52.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.737+0000 7f9145f9c700 1 -- 172.21.15.72:0/1926951584 >> v1:172.21.15.146:6789/0 conn(0x7f91400ad1b0 legacy=0x7f91400630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:52.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.737+0000 7f9145f9c700 1 -- 172.21.15.72:0/1926951584 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9140155560 con 0x7f91400637c0 2023-08-31T19:07:52.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.737+0000 7f9145f9c700 1 --2- 172.21.15.72:0/1926951584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91400637c0 0x7f9140155070 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f91400642a0 tx=0x7f9138009840).ready entity=mon.0 client_cookie=e301dd8d12ececbf server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:52.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.738+0000 7f9137fff700 1 -- 172.21.15.72:0/1926951584 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913800e070 con 0x7f91400637c0 2023-08-31T19:07:52.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.738+0000 7f9137fff700 1 -- 172.21.15.72:0/1926951584 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913800ba20 con 0x7f91400637c0 2023-08-31T19:07:52.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.738+0000 7f9137fff700 1 -- 172.21.15.72:0/1926951584 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913800bda0 con 0x7f91400637c0 2023-08-31T19:07:52.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.738+0000 7f91479ff700 1 -- 172.21.15.72:0/1926951584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91400637c0 msgr2=0x7f9140155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:52.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.738+0000 7f91479ff700 1 --2- 172.21.15.72:0/1926951584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91400637c0 0x7f9140155070 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f91400642a0 tx=0x7f9138009840).stop 2023-08-31T19:07:52.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.738+0000 7f91479ff700 1 -- 172.21.15.72:0/1926951584 shutdown_connections 2023-08-31T19:07:52.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.738+0000 7f91479ff700 1 --2- 172.21.15.72:0/1926951584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91400637c0 0x7f9140155070 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:52.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.738+0000 7f91479ff700 1 --2- 172.21.15.72:0/1926951584 >> v2:172.21.15.146:3300/0 conn(0x7f9140157c10 0x7f91400ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:52.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.738+0000 7f91479ff700 1 -- 172.21.15.72:0/1926951584 >> 172.21.15.72:0/1926951584 conn(0x7f914005eb60 msgr2=0x7f91400cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:52.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.738+0000 7f91479ff700 1 -- 172.21.15.72:0/1926951584 shutdown_connections 2023-08-31T19:07:52.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.738+0000 7f91479ff700 1 -- 172.21.15.72:0/1926951584 wait complete. 2023-08-31T19:07:52.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.740+0000 7f91479ff700 1 Processor -- start 2023-08-31T19:07:52.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.740+0000 7f91479ff700 1 -- start start 2023-08-31T19:07:52.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f91479ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91400637c0 0x7f9140138eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:52.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f91479ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91400ad1b0 0x7f91400a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:52.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f91479ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9140157c10 0x7f91400aa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:52.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f91479ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91400aa740 con 0x7f91400637c0 2023-08-31T19:07:52.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f91479ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91401684c0 con 0x7f9140157c10 2023-08-31T19:07:52.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f91479ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91401678b0 con 0x7f91400ad1b0 2023-08-31T19:07:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f914579b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91400637c0 0x7f9140138eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f914579b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91400637c0 0x7f9140138eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50218/0 (socket says 172.21.15.72:50218) 2023-08-31T19:07:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f914579b700 1 -- 172.21.15.72:0/4088970206 learned_addr learned my addr 172.21.15.72:0/4088970206 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f9145f9c700 1 --2- 172.21.15.72:0/4088970206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9140157c10 0x7f91400aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:52.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f9144f9a700 1 --2- 172.21.15.72:0/4088970206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91400ad1b0 0x7f91400a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:52.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f914579b700 1 -- 172.21.15.72:0/4088970206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91400ad1b0 msgr2=0x7f91400a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:52.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f914579b700 1 --2- 172.21.15.72:0/4088970206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91400ad1b0 0x7f91400a9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:52.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f914579b700 1 -- 172.21.15.72:0/4088970206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9140157c10 msgr2=0x7f91400aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:52.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f914579b700 1 --2- 172.21.15.72:0/4088970206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9140157c10 0x7f91400aa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:52.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f914579b700 1 -- 172.21.15.72:0/4088970206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9138009ae0 con 0x7f91400637c0 2023-08-31T19:07:52.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f9145f9c700 1 --2- 172.21.15.72:0/4088970206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9140157c10 0x7f91400aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:52.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.741+0000 7f914579b700 1 --2- 172.21.15.72:0/4088970206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91400637c0 0x7f9140138eb0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f913c00c4c0 tx=0x7f913c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:52.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.742+0000 7f91357fa700 1 -- 172.21.15.72:0/4088970206 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c007020 con 0x7f91400637c0 2023-08-31T19:07:52.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.742+0000 7f91357fa700 1 -- 172.21.15.72:0/4088970206 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c001e90 con 0x7f91400637c0 2023-08-31T19:07:52.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.742+0000 7f91357fa700 1 -- 172.21.15.72:0/4088970206 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0073d0 con 0x7f91400637c0 2023-08-31T19:07:52.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.742+0000 7f91479ff700 1 -- 172.21.15.72:0/4088970206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9140167b90 con 0x7f91400637c0 2023-08-31T19:07:52.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.742+0000 7f91479ff700 1 -- 172.21.15.72:0/4088970206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9140168150 con 0x7f91400637c0 2023-08-31T19:07:52.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.743+0000 7f91479ff700 1 -- 172.21.15.72:0/4088970206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914006c6b0 con 0x7f91400637c0 2023-08-31T19:07:52.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.744+0000 7f91357fa700 1 -- 172.21.15.72:0/4088970206 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f913c0068b0 con 0x7f91400637c0 2023-08-31T19:07:52.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.745+0000 7f91357fa700 1 --2- 172.21.15.72:0/4088970206 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f912405ef30 0x7f91240613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:52.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.745+0000 7f91357fa700 1 -- 172.21.15.72:0/4088970206 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f913c079ae0 con 0x7f91400637c0 2023-08-31T19:07:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.745+0000 7f9144f9a700 1 --2- 172.21.15.72:0/4088970206 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f912405ef30 0x7f91240613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.746+0000 7f9144f9a700 1 --2- 172.21.15.72:0/4088970206 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f912405ef30 0x7f91240613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f91400c4e10 tx=0x7f9130008040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:52.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.749+0000 7f91357fa700 1 -- 172.21.15.72:0/4088970206 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f913c04abc0 con 0x7f91400637c0 2023-08-31T19:07:52.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:52.933+0000 7f91479ff700 1 -- 172.21.15.72:0/4088970206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9140158350 con 0x7f91400637c0 2023-08-31T19:07:53.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:53.803+0000 7f91357fa700 1 -- 172.21.15.72:0/4088970206 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v153) v1 ==== 97+0+0 (secure 0 0 0) 0x7f913c04e1e0 con 0x7f91400637c0 2023-08-31T19:07:53.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:53.806+0000 7f91479ff700 1 -- 172.21.15.72:0/4088970206 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f912405ef30 msgr2=0x7f91240613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:53.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:53.806+0000 7f91479ff700 1 --2- 172.21.15.72:0/4088970206 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f912405ef30 0x7f91240613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f91400c4e10 tx=0x7f9130008040).stop 2023-08-31T19:07:53.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:53.806+0000 7f91479ff700 1 -- 172.21.15.72:0/4088970206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91400637c0 msgr2=0x7f9140138eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:53.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:53.806+0000 7f91479ff700 1 --2- 172.21.15.72:0/4088970206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91400637c0 0x7f9140138eb0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f913c00c4c0 tx=0x7f913c007e00).stop 2023-08-31T19:07:53.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:53.806+0000 7f91479ff700 1 -- 172.21.15.72:0/4088970206 shutdown_connections 2023-08-31T19:07:53.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:53.806+0000 7f91479ff700 1 --2- 172.21.15.72:0/4088970206 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f912405ef30 0x7f91240613f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:53.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:53.806+0000 7f91479ff700 1 --2- 172.21.15.72:0/4088970206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9140157c10 0x7f91400aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:53.806+0000 7f91479ff700 1 --2- 172.21.15.72:0/4088970206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91400637c0 0x7f9140138eb0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:53.806+0000 7f91479ff700 1 --2- 172.21.15.72:0/4088970206 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f91400ad1b0 0x7f91400a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:53.806+0000 7f91479ff700 1 -- 172.21.15.72:0/4088970206 >> 172.21.15.72:0/4088970206 conn(0x7f914005eb60 msgr2=0x7f9140152920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:53.806+0000 7f91479ff700 1 -- 172.21.15.72:0/4088970206 shutdown_connections 2023-08-31T19:07:53.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:53.806+0000 7f91479ff700 1 -- 172.21.15.72:0/4088970206 wait complete. 2023-08-31T19:07:53.809 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-08-31T19:07:53.827 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-31T19:07:54.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.017+0000 7f834d1ff700 1 Processor -- start 2023-08-31T19:07:54.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.017+0000 7f834d1ff700 1 -- start start 2023-08-31T19:07:54.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.019+0000 7f834d1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83480bea80 0x7f83480c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.019+0000 7f834d1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83480c44a0 0x7f8348063a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.019+0000 7f834d1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83480c4950 con 0x7f83480c5fb0 2023-08-31T19:07:54.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.019+0000 7f834d1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8348154690 con 0x7f83480c44a0 2023-08-31T19:07:54.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.019+0000 7f834d1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83480bfb20 con 0x7f83480bea80 2023-08-31T19:07:54.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.019+0000 7f8346d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f83480c5fb0 0x7f83480be370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52738/0 (socket says 172.21.15.72:52738) 2023-08-31T19:07:54.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.019+0000 7f8346d9d700 1 -- 172.21.15.72:0/2464169534 learned_addr learned my addr 172.21.15.72:0/2464169534 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:54.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.019+0000 7f834759e700 1 --2- 172.21.15.72:0/2464169534 >> v2:172.21.15.72:3300/0 conn(0x7f83480c44a0 0x7f8348063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:54.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.019+0000 7f834659c700 1 --2- 172.21.15.72:0/2464169534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83480bea80 0x7f83480c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:54.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.019+0000 7f834759e700 1 -- 172.21.15.72:0/2464169534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83480bea80 msgr2=0x7f83480c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:54.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.019+0000 7f834759e700 1 --2- 172.21.15.72:0/2464169534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83480bea80 0x7f83480c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.019+0000 7f834759e700 1 -- 172.21.15.72:0/2464169534 >> v1:172.21.15.72:6789/0 conn(0x7f83480c5fb0 legacy=0x7f83480be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.019+0000 7f834759e700 1 -- 172.21.15.72:0/2464169534 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83480bef10 con 0x7f83480c44a0 2023-08-31T19:07:54.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.019+0000 7f8345d9b700 1 -- 172.21.15.72:0/2464169534 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634194814 0 0) 0x7f8338001290 con 0x7f83480c5fb0 2023-08-31T19:07:54.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.020+0000 7f834759e700 1 --2- 172.21.15.72:0/2464169534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480c44a0 0x7f8348063a90 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f8340009e60 tx=0x7f8340009780).ready entity=mon.0 client_cookie=2537d8fad62d9162 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:54.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.020+0000 7f8345d9b700 1 -- 172.21.15.72:0/2464169534 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834000e070 con 0x7f83480c44a0 2023-08-31T19:07:54.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.020+0000 7f8345d9b700 1 -- 172.21.15.72:0/2464169534 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834000bc30 con 0x7f83480c44a0 2023-08-31T19:07:54.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.020+0000 7f8345d9b700 1 -- 172.21.15.72:0/2464169534 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340012410 con 0x7f83480c44a0 2023-08-31T19:07:54.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.020+0000 7f834d1ff700 1 -- 172.21.15.72:0/2464169534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480c44a0 msgr2=0x7f8348063a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.020+0000 7f834d1ff700 1 --2- 172.21.15.72:0/2464169534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480c44a0 0x7f8348063a90 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f8340009e60 tx=0x7f8340009780).stop 2023-08-31T19:07:54.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.020+0000 7f834d1ff700 1 -- 172.21.15.72:0/2464169534 shutdown_connections 2023-08-31T19:07:54.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.020+0000 7f834d1ff700 1 --2- 172.21.15.72:0/2464169534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480c44a0 0x7f8348063a90 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.020+0000 7f834d1ff700 1 --2- 172.21.15.72:0/2464169534 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83480bea80 0x7f83480c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.020+0000 7f834d1ff700 1 -- 172.21.15.72:0/2464169534 >> 172.21.15.72:0/2464169534 conn(0x7f8348082f60 msgr2=0x7f834805e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:54.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.021+0000 7f834d1ff700 1 -- 172.21.15.72:0/2464169534 shutdown_connections 2023-08-31T19:07:54.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.021+0000 7f834d1ff700 1 -- 172.21.15.72:0/2464169534 wait complete. 2023-08-31T19:07:54.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.022+0000 7f834d1ff700 1 Processor -- start 2023-08-31T19:07:54.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.022+0000 7f834d1ff700 1 -- start start 2023-08-31T19:07:54.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.023+0000 7f834d1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480c44a0 0x7f8348157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.023+0000 7f834d1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83480c5fb0 0x7f83481594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.023+0000 7f834d1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83480677d0 0x7f8348067c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.023+0000 7f834d1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8348159c10 con 0x7f83480c44a0 2023-08-31T19:07:54.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.023+0000 7f834d1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8348150050 con 0x7f83480c5fb0 2023-08-31T19:07:54.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.023+0000 7f834d1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8348159990 con 0x7f83480677d0 2023-08-31T19:07:54.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.023+0000 7f8346d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480c44a0 0x7f8348157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:54.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.023+0000 7f8346d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480c44a0 0x7f8348157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60364/0 (socket says 172.21.15.72:60364) 2023-08-31T19:07:54.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.023+0000 7f8346d9d700 1 -- 172.21.15.72:0/841851454 learned_addr learned my addr 172.21.15.72:0/841851454 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:54.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.024+0000 7f8346d9d700 1 -- 172.21.15.72:0/841851454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83480677d0 msgr2=0x7f8348067c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.024+0000 7f8346d9d700 1 --2- 172.21.15.72:0/841851454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83480677d0 0x7f8348067c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:54.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.024+0000 7f8346d9d700 1 -- 172.21.15.72:0/841851454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83480c5fb0 msgr2=0x7f83481594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.024+0000 7f8346d9d700 1 --2- 172.21.15.72:0/841851454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83480c5fb0 0x7f83481594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:54.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.024+0000 7f8346d9d700 1 -- 172.21.15.72:0/841851454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8340009a20 con 0x7f83480c44a0 2023-08-31T19:07:54.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.024+0000 7f8346d9d700 1 --2- 172.21.15.72:0/841851454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480c44a0 0x7f8348157240 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f833800c4a0 tx=0x7f8338007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:54.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.024+0000 7f832effd700 1 -- 172.21.15.72:0/841851454 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83380072e0 con 0x7f83480c44a0 2023-08-31T19:07:54.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.024+0000 7f832effd700 1 -- 172.21.15.72:0/841851454 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8338001e90 con 0x7f83480c44a0 2023-08-31T19:07:54.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.024+0000 7f832effd700 1 -- 172.21.15.72:0/841851454 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338005670 con 0x7f83480c44a0 2023-08-31T19:07:54.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.024+0000 7f834d1ff700 1 -- 172.21.15.72:0/841851454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8348068120 con 0x7f83480c44a0 2023-08-31T19:07:54.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.024+0000 7f834d1ff700 1 -- 172.21.15.72:0/841851454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8348154b50 con 0x7f83480c44a0 2023-08-31T19:07:54.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.025+0000 7f834d1ff700 1 -- 172.21.15.72:0/841851454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834806c6b0 con 0x7f83480c44a0 2023-08-31T19:07:54.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.026+0000 7f832effd700 1 -- 172.21.15.72:0/841851454 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8338005a60 con 0x7f83480c44a0 2023-08-31T19:07:54.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.027+0000 7f832effd700 1 --2- 172.21.15.72:0/841851454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f833405ef00 0x7f83340613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.027+0000 7f832effd700 1 -- 172.21.15.72:0/841851454 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5897+0+0 (secure 0 0 0) 0x7f83380794f0 con 0x7f83480c44a0 2023-08-31T19:07:54.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.027+0000 7f834659c700 1 --2- 172.21.15.72:0/841851454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f833405ef00 0x7f83340613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:54.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.028+0000 7f834659c700 1 --2- 172.21.15.72:0/841851454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f833405ef00 0x7f83340613c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8348159410 tx=0x7f833c008040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:54.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.031+0000 7f832effd700 1 -- 172.21.15.72:0/841851454 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f833804a800 con 0x7f83480c44a0 2023-08-31T19:07:54.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.267+0000 7f834d1ff700 1 -- 172.21.15.72:0/841851454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f83480c4950 con 0x7f83480c44a0 2023-08-31T19:07:54.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.267+0000 7f832effd700 1 -- 172.21.15.72:0/841851454 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f83480c4950 con 0x7f83480c44a0 2023-08-31T19:07:54.268 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:54.268 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:07:54.268 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-08-31T19:07:54.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.269 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-08-31T19:07:54.269 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkPeqvDBAAA2eEr6xr7iF5PPNT9eehSg==", 2023-08-31T19:07:54.269 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.269 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:54.269 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:07:54.270 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:07:54.270 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:54.270 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.271 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-08-31T19:07:54.271 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkctxUIxAAufSVXMwPzPA7Gq1s4ukXiQ==", 2023-08-31T19:07:54.271 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.271 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:54.272 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:07:54.272 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:07:54.272 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:54.272 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.273 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-08-31T19:07:54.273 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkcpLfFxAASIB//h8whjuh6s3YKBVffQ==", 2023-08-31T19:07:54.273 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.273 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:54.273 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:07:54.274 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:07:54.274 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:54.274 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.274 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-08-31T19:07:54.275 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkC1bbLhAAg/0wct2P0+cyWbZyI2bP/g==", 2023-08-31T19:07:54.275 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.275 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:54.275 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:07:54.275 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:07:54.276 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:54.276 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.276 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-08-31T19:07:54.276 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAi4PBkvfRJEBAAYQqPldOXrJxXAXnmZhXaBQ==", 2023-08-31T19:07:54.277 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.277 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:54.277 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:54.277 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:54.277 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.278 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-08-31T19:07:54.278 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAl4PBkYysSIhAA4nCmskcGV+i4vpH2k/gDBg==", 2023-08-31T19:07:54.278 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.279 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:54.279 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:54.279 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:54.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.280 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-08-31T19:07:54.280 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAp4PBkyDgJFxAAPynEKk15yN7+OxQxpzL0UQ==", 2023-08-31T19:07:54.280 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.280 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:54.280 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:54.281 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:54.281 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.281 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-08-31T19:07:54.281 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAs4PBkZMD2KBAAoJrO4YjJ4/8MjcPAtgEn1g==", 2023-08-31T19:07:54.282 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.282 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:54.282 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:54.282 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:54.282 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.283 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-08-31T19:07:54.283 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAz4PBkSgAoExAAJ95kdHV47jDTXSj/WSCiLw==", 2023-08-31T19:07:54.283 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.283 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:54.284 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:54.284 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:54.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.284 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-08-31T19:07:54.285 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA24PBkUxpLKBAAAu8d6iKME6wW+Q/6hhFIRQ==", 2023-08-31T19:07:54.285 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.285 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:54.285 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:54.285 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:54.286 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.286 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-08-31T19:07:54.286 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA54PBkURHJOhAA3HaPfENVQ4hLIjc/esF0bQ==", 2023-08-31T19:07:54.287 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.287 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:54.287 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:54.287 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:54.287 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.288 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-08-31T19:07:54.288 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA94PBkfoqTEBAAQHENgrp5tv1X47Br/dUksQ==", 2023-08-31T19:07:54.288 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.289 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:07:54.289 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:07:54.289 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:54.289 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.290 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-08-31T19:07:54.290 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkucWuOBAABLowlGxpCR3GgoOCRmC0FQ==", 2023-08-31T19:07:54.290 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.290 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:54.291 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow r", 2023-08-31T19:07:54.291 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-31T19:07:54.291 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.291 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-08-31T19:07:54.292 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkVGBPCxAAO4M9u24/yH0xwtV6oSz+JQ==", 2023-08-31T19:07:54.292 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.292 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:54.292 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:07:54.292 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:07:54.293 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:07:54.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.293 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.2", 2023-08-31T19:07:54.294 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkYeIoBBAAjoIzJJ9McIx3rLBSaorTKA==", 2023-08-31T19:07:54.294 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.294 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:54.294 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:07:54.294 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:07:54.295 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:07:54.295 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.295 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.3", 2023-08-31T19:07:54.296 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkX/V9EhAAqWuBMMhikN/JUQp3v5/ABQ==", 2023-08-31T19:07:54.296 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.296 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:07:54.296 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:07:54.296 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:07:54.297 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:07:54.297 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.297 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-08-31T19:07:54.298 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkCRlhDhAAxvcGr+KTvLoJmtuZC89Iuw==", 2023-08-31T19:07:54.298 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.298 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:07:54.298 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:07:54.298 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:07:54.299 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:54.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.299 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-08-31T19:07:54.299 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkiGBUBRAAwWTFqrz+ELBSwb0Z2T9yhQ==", 2023-08-31T19:07:54.300 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.300 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:07:54.300 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:07:54.300 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:54.300 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:54.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:54.301 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-08-31T19:07:54.301 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkSWszNRAAdBxrfMEuBRgePfaiPx6kpQ==", 2023-08-31T19:07:54.301 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:07:54.301 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:07:54.302 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:07:54.302 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:07:54.302 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.302 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:54.302 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-08-31T19:07:54.302 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:07:54.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.269+0000 7f834d1ff700 1 -- 172.21.15.72:0/841851454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f833405ef00 msgr2=0x7f83340613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.269+0000 7f834d1ff700 1 --2- 172.21.15.72:0/841851454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f833405ef00 0x7f83340613c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8348159410 tx=0x7f833c008040).stop 2023-08-31T19:07:54.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.269+0000 7f834d1ff700 1 -- 172.21.15.72:0/841851454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480c44a0 msgr2=0x7f8348157240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.269+0000 7f834d1ff700 1 --2- 172.21.15.72:0/841851454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480c44a0 0x7f8348157240 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f833800c4a0 tx=0x7f8338007cc0).stop 2023-08-31T19:07:54.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.269+0000 7f834d1ff700 1 -- 172.21.15.72:0/841851454 shutdown_connections 2023-08-31T19:07:54.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.269+0000 7f834d1ff700 1 --2- 172.21.15.72:0/841851454 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83480677d0 0x7f8348067c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:54.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.269+0000 7f834d1ff700 1 --2- 172.21.15.72:0/841851454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83480c44a0 0x7f8348157240 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.269+0000 7f834d1ff700 1 --2- 172.21.15.72:0/841851454 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f833405ef00 0x7f83340613c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.269+0000 7f834d1ff700 1 --2- 172.21.15.72:0/841851454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83480c5fb0 0x7f83481594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:54.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.269+0000 7f834d1ff700 1 -- 172.21.15.72:0/841851454 >> 172.21.15.72:0/841851454 conn(0x7f8348082f60 msgr2=0x7f8348153890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:54.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.270+0000 7f834d1ff700 1 -- 172.21.15.72:0/841851454 shutdown_connections 2023-08-31T19:07:54.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.270+0000 7f834d1ff700 1 -- 172.21.15.72:0/841851454 wait complete. 2023-08-31T19:07:54.307 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:07:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.497+0000 7fc84b1ff700 1 Processor -- start 2023-08-31T19:07:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.497+0000 7fc84b1ff700 1 -- start start 2023-08-31T19:07:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.498+0000 7fc84b1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8440aa290 0x7fc844156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.498+0000 7fc84b1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8440bfd00 con 0x7fc8440a9eb0 2023-08-31T19:07:54.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.498+0000 7fc84b1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8440c05a0 con 0x7fc8441574b0 2023-08-31T19:07:54.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.498+0000 7fc84b1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8440aaea0 con 0x7fc8440aa290 2023-08-31T19:07:54.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.498+0000 7fc843fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8440aa290 0x7fc844156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:54.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.498+0000 7fc843fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8440aa290 0x7fc844156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60374/0 (socket says 172.21.15.72:60374) 2023-08-31T19:07:54.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.498+0000 7fc843fff700 1 -- 172.21.15.72:0/1692356226 learned_addr learned my addr 172.21.15.72:0/1692356226 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:54.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.498+0000 7fc848f9b700 1 --1- 172.21.15.72:0/1692356226 >> v1:172.21.15.72:6789/0 conn(0x7fc8440a9eb0 0x7fc8440c5bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52752/0 (socket says 172.21.15.72:52752) 2023-08-31T19:07:54.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.499+0000 7fc843fff700 1 -- 172.21.15.72:0/1692356226 >> v1:172.21.15.146:6789/0 conn(0x7fc8441574b0 legacy=0x7fc8440c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.499+0000 7fc843fff700 1 -- 172.21.15.72:0/1692356226 >> v1:172.21.15.72:6789/0 conn(0x7fc8440a9eb0 legacy=0x7fc8440c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.499+0000 7fc8437fe700 1 -- 172.21.15.72:0/1692356226 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815100322 0 0) 0x7fc8440bfd00 con 0x7fc8440a9eb0 2023-08-31T19:07:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.499+0000 7fc843fff700 1 -- 172.21.15.72:0/1692356226 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8440c6670 con 0x7fc8440aa290 2023-08-31T19:07:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.499+0000 7fc843fff700 1 --2- 172.21.15.72:0/1692356226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8440aa290 0x7fc844156fc0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7fc830006fd0 tx=0x7fc8300090f0).ready entity=mon.0 client_cookie=e7acd58fe9422b67 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.499+0000 7fc8437fe700 1 -- 172.21.15.72:0/1692356226 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000b600 con 0x7fc8440aa290 2023-08-31T19:07:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.499+0000 7fc8437fe700 1 -- 172.21.15.72:0/1692356226 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83000b760 con 0x7fc8440aa290 2023-08-31T19:07:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.499+0000 7fc8437fe700 1 -- 172.21.15.72:0/1692356226 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000bae0 con 0x7fc8440aa290 2023-08-31T19:07:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.500+0000 7fc84b1ff700 1 -- 172.21.15.72:0/1692356226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8440aa290 msgr2=0x7fc844156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.500+0000 7fc84b1ff700 1 --2- 172.21.15.72:0/1692356226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8440aa290 0x7fc844156fc0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7fc830006fd0 tx=0x7fc8300090f0).stop 2023-08-31T19:07:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.500+0000 7fc84b1ff700 1 -- 172.21.15.72:0/1692356226 shutdown_connections 2023-08-31T19:07:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.500+0000 7fc84b1ff700 1 --2- 172.21.15.72:0/1692356226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8440aa290 0x7fc844156fc0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.500+0000 7fc84b1ff700 1 -- 172.21.15.72:0/1692356226 >> 172.21.15.72:0/1692356226 conn(0x7fc8440c82e0 msgr2=0x7fc84405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.500+0000 7fc84b1ff700 1 -- 172.21.15.72:0/1692356226 shutdown_connections 2023-08-31T19:07:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.500+0000 7fc84b1ff700 1 -- 172.21.15.72:0/1692356226 wait complete. 2023-08-31T19:07:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.501+0000 7fc84b1ff700 1 Processor -- start 2023-08-31T19:07:54.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.501+0000 7fc84b1ff700 1 -- start start 2023-08-31T19:07:54.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.502+0000 7fc84b1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8440a9eb0 0x7fc8441497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.502+0000 7fc84b1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8440aa290 0x7fc8440c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.502+0000 7fc84b1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8441574b0 0x7fc8440c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.502+0000 7fc84b1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440ca1d0 con 0x7fc8440aa290 2023-08-31T19:07:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.502+0000 7fc84b1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84414f170 con 0x7fc8440a9eb0 2023-08-31T19:07:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.502+0000 7fc84b1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440ade80 con 0x7fc8441574b0 2023-08-31T19:07:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.503+0000 7fc843fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8440aa290 0x7fc8440c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.503+0000 7fc843fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8440aa290 0x7fc8440c97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60386/0 (socket says 172.21.15.72:60386) 2023-08-31T19:07:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.503+0000 7fc843fff700 1 -- 172.21.15.72:0/2370482496 learned_addr learned my addr 172.21.15.72:0/2370482496 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.503+0000 7fc848f9b700 1 --2- 172.21.15.72:0/2370482496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8440a9eb0 0x7fc8441497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.503+0000 7fc84979c700 1 --2- 172.21.15.72:0/2370482496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8441574b0 0x7fc8440c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.503+0000 7fc843fff700 1 -- 172.21.15.72:0/2370482496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8441574b0 msgr2=0x7fc8440c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.503+0000 7fc843fff700 1 --2- 172.21.15.72:0/2370482496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8441574b0 0x7fc8440c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.503+0000 7fc843fff700 1 -- 172.21.15.72:0/2370482496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8440a9eb0 msgr2=0x7fc8441497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.503+0000 7fc843fff700 1 --2- 172.21.15.72:0/2370482496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8440a9eb0 0x7fc8441497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.503+0000 7fc843fff700 1 -- 172.21.15.72:0/2370482496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc830009370 con 0x7fc8440aa290 2023-08-31T19:07:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.503+0000 7fc843fff700 1 --2- 172.21.15.72:0/2370482496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8440aa290 0x7fc8440c97f0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7fc844083960 tx=0x7fc830017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.503+0000 7fc840ff9700 1 -- 172.21.15.72:0/2370482496 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000b8d0 con 0x7fc8440aa290 2023-08-31T19:07:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.503+0000 7fc840ff9700 1 -- 172.21.15.72:0/2370482496 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83000ba30 con 0x7fc8440aa290 2023-08-31T19:07:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.503+0000 7fc84b1ff700 1 -- 172.21.15.72:0/2370482496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8440ae160 con 0x7fc8440aa290 2023-08-31T19:07:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.503+0000 7fc840ff9700 1 -- 172.21.15.72:0/2370482496 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83001a430 con 0x7fc8440aa290 2023-08-31T19:07:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.504+0000 7fc84b1ff700 1 -- 172.21.15.72:0/2370482496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8440ae720 con 0x7fc8440aa290 2023-08-31T19:07:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.505+0000 7fc84b1ff700 1 -- 172.21.15.72:0/2370482496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8440aea90 con 0x7fc8440aa290 2023-08-31T19:07:54.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.505+0000 7fc840ff9700 1 -- 172.21.15.72:0/2370482496 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc830021020 con 0x7fc8440aa290 2023-08-31T19:07:54.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.506+0000 7fc840ff9700 1 --2- 172.21.15.72:0/2370482496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc82805ef30 0x7fc8280613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.507+0000 7fc840ff9700 1 -- 172.21.15.72:0/2370482496 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5897+0+0 (secure 0 0 0) 0x7fc83007b620 con 0x7fc8440aa290 2023-08-31T19:07:54.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.507+0000 7fc848f9b700 1 --2- 172.21.15.72:0/2370482496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc82805ef30 0x7fc8280613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:54.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.507+0000 7fc848f9b700 1 --2- 172.21.15.72:0/2370482496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc82805ef30 0x7fc8280613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc8380011e0 tx=0x7fc838007180).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:54.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.511+0000 7fc840ff9700 1 -- 172.21.15.72:0/2370482496 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc83004c930 con 0x7fc8440aa290 2023-08-31T19:07:54.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.681+0000 7fc84b1ff700 1 -- 172.21.15.72:0/2370482496 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8440ae8b0 con 0x7fc8440aa290 2023-08-31T19:07:54.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.682+0000 7fc840ff9700 1 -- 172.21.15.72:0/2370482496 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+14771 (secure 0 0 0) 0x7fc830029020 con 0x7fc8440aa290 2023-08-31T19:07:54.682 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:54.682 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":153,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:07:53.799172+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:07:54.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.683+0000 7fc84b1ff700 1 -- 172.21.15.72:0/2370482496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc82805ef30 msgr2=0x7fc8280613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.683+0000 7fc84b1ff700 1 --2- 172.21.15.72:0/2370482496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc82805ef30 0x7fc8280613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fc8380011e0 tx=0x7fc838007180).stop 2023-08-31T19:07:54.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.683+0000 7fc84b1ff700 1 -- 172.21.15.72:0/2370482496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8440aa290 msgr2=0x7fc8440c97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.683+0000 7fc84b1ff700 1 --2- 172.21.15.72:0/2370482496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8440aa290 0x7fc8440c97f0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7fc844083960 tx=0x7fc830017000).stop 2023-08-31T19:07:54.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.684+0000 7fc84b1ff700 1 -- 172.21.15.72:0/2370482496 shutdown_connections 2023-08-31T19:07:54.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.684+0000 7fc84b1ff700 1 --2- 172.21.15.72:0/2370482496 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8441574b0 0x7fc8440c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.684+0000 7fc84b1ff700 1 --2- 172.21.15.72:0/2370482496 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc82805ef30 0x7fc8280613f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.684+0000 7fc84b1ff700 1 --2- 172.21.15.72:0/2370482496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8440a9eb0 0x7fc8441497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.684+0000 7fc84b1ff700 1 --2- 172.21.15.72:0/2370482496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8440aa290 0x7fc8440c97f0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.684+0000 7fc84b1ff700 1 -- 172.21.15.72:0/2370482496 >> 172.21.15.72:0/2370482496 conn(0x7fc8440c82e0 msgr2=0x7fc8440abb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:54.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.684+0000 7fc84b1ff700 1 -- 172.21.15.72:0/2370482496 shutdown_connections 2023-08-31T19:07:54.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.684+0000 7fc84b1ff700 1 -- 172.21.15.72:0/2370482496 wait complete. 2023-08-31T19:07:54.701 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-31T19:07:54.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:07:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.895+0000 7fc77d1ff700 1 Processor -- start 2023-08-31T19:07:54.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.895+0000 7fc77d1ff700 1 -- start start 2023-08-31T19:07:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.896+0000 7fc77d1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc778154030 0x7fc778154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.896+0000 7fc77d1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc7780c7360 0x7fc778063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.896+0000 7fc77d1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7780c6ed0 con 0x7fc7780c06b0 2023-08-31T19:07:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.896+0000 7fc77d1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7780c66e0 con 0x7fc778154030 2023-08-31T19:07:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.896+0000 7fc77d1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7780c68c0 con 0x7fc7780c7360 2023-08-31T19:07:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.897+0000 7fc776d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc778154030 0x7fc778154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.897+0000 7fc776d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc778154030 0x7fc778154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60388/0 (socket says 172.21.15.72:60388) 2023-08-31T19:07:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.897+0000 7fc776d9d700 1 -- 172.21.15.72:0/1783312765 learned_addr learned my addr 172.21.15.72:0/1783312765 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.897+0000 7fc77659c700 1 --1- 172.21.15.72:0/1783312765 >> v1:172.21.15.72:6789/0 conn(0x7fc7780c06b0 0x7fc7780aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52756/0 (socket says 172.21.15.72:52756) 2023-08-31T19:07:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.897+0000 7fc77759e700 1 --2- 172.21.15.72:0/1783312765 >> v2:172.21.15.146:3300/0 conn(0x7fc7780c7360 0x7fc778063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.897+0000 7fc776d9d700 1 -- 172.21.15.72:0/1783312765 >> v2:172.21.15.146:3300/0 conn(0x7fc7780c7360 msgr2=0x7fc778063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.897+0000 7fc776d9d700 1 --2- 172.21.15.72:0/1783312765 >> v2:172.21.15.146:3300/0 conn(0x7fc7780c7360 0x7fc778063120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.897+0000 7fc776d9d700 1 -- 172.21.15.72:0/1783312765 >> v1:172.21.15.72:6789/0 conn(0x7fc7780c06b0 legacy=0x7fc7780aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.897+0000 7fc776d9d700 1 -- 172.21.15.72:0/1783312765 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7780c0f30 con 0x7fc778154030 2023-08-31T19:07:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.897+0000 7fc775d9b700 1 -- 172.21.15.72:0/1783312765 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611963606 0 0) 0x7fc7780c6ed0 con 0x7fc7780c06b0 2023-08-31T19:07:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.897+0000 7fc776d9d700 1 --2- 172.21.15.72:0/1783312765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc778154030 0x7fc778154410 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fc7780aad30 tx=0x7fc7680090f0).ready entity=mon.0 client_cookie=20adc0f25bf8d15 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.897+0000 7fc775d9b700 1 -- 172.21.15.72:0/1783312765 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76800b520 con 0x7fc778154030 2023-08-31T19:07:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.897+0000 7fc775d9b700 1 -- 172.21.15.72:0/1783312765 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76800b680 con 0x7fc778154030 2023-08-31T19:07:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.897+0000 7fc775d9b700 1 -- 172.21.15.72:0/1783312765 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76800ba20 con 0x7fc778154030 2023-08-31T19:07:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.898+0000 7fc77d1ff700 1 -- 172.21.15.72:0/1783312765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc778154030 msgr2=0x7fc778154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.898+0000 7fc77d1ff700 1 --2- 172.21.15.72:0/1783312765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc778154030 0x7fc778154410 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fc7780aad30 tx=0x7fc7680090f0).stop 2023-08-31T19:07:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.898+0000 7fc77d1ff700 1 -- 172.21.15.72:0/1783312765 shutdown_connections 2023-08-31T19:07:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.898+0000 7fc77d1ff700 1 --2- 172.21.15.72:0/1783312765 >> v2:172.21.15.146:3300/0 conn(0x7fc7780c7360 0x7fc778063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.898+0000 7fc77d1ff700 1 --2- 172.21.15.72:0/1783312765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc778154030 0x7fc778154410 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.898+0000 7fc77d1ff700 1 -- 172.21.15.72:0/1783312765 >> 172.21.15.72:0/1783312765 conn(0x7fc77805eb60 msgr2=0x7fc7780cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:54.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.898+0000 7fc77d1ff700 1 -- 172.21.15.72:0/1783312765 shutdown_connections 2023-08-31T19:07:54.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.898+0000 7fc77d1ff700 1 -- 172.21.15.72:0/1783312765 wait complete. 2023-08-31T19:07:54.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.900+0000 7fc77d1ff700 1 Processor -- start 2023-08-31T19:07:54.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.900+0000 7fc77d1ff700 1 -- start start 2023-08-31T19:07:54.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc77d1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7780c06b0 0x7fc7780c3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc77d1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7780c7360 0x7fc778150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc77d1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc778154030 0x7fc7780c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc77d1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780ae0f0 con 0x7fc7780c06b0 2023-08-31T19:07:54.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc77d1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780c43f0 con 0x7fc7780c7360 2023-08-31T19:07:54.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc77d1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780c37e0 con 0x7fc778154030 2023-08-31T19:07:54.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc776d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7780c06b0 0x7fc7780c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:54.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc776d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7780c06b0 0x7fc7780c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60392/0 (socket says 172.21.15.72:60392) 2023-08-31T19:07:54.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc776d9d700 1 -- 172.21.15.72:0/1119990629 learned_addr learned my addr 172.21.15.72:0/1119990629 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:54.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc77759e700 1 --2- 172.21.15.72:0/1119990629 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc778154030 0x7fc7780c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:54.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc77659c700 1 --2- 172.21.15.72:0/1119990629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7780c7360 0x7fc778150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:54.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc776d9d700 1 -- 172.21.15.72:0/1119990629 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc778154030 msgr2=0x7fc7780c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc776d9d700 1 --2- 172.21.15.72:0/1119990629 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc778154030 0x7fc7780c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc776d9d700 1 -- 172.21.15.72:0/1119990629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7780c7360 msgr2=0x7fc778150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:54.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc776d9d700 1 --2- 172.21.15.72:0/1119990629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7780c7360 0x7fc778150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:54.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc776d9d700 1 -- 172.21.15.72:0/1119990629 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc768009370 con 0x7fc7780c06b0 2023-08-31T19:07:54.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.901+0000 7fc776d9d700 1 --2- 172.21.15.72:0/1119990629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7780c06b0 0x7fc7780c3220 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7fc7780c8900 tx=0x7fc768017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:54.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.902+0000 7fc75effd700 1 -- 172.21.15.72:0/1119990629 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768000bc0 con 0x7fc7780c06b0 2023-08-31T19:07:54.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.902+0000 7fc75effd700 1 -- 172.21.15.72:0/1119990629 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76800b7f0 con 0x7fc7780c06b0 2023-08-31T19:07:54.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.902+0000 7fc75effd700 1 -- 172.21.15.72:0/1119990629 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768000d20 con 0x7fc7780c06b0 2023-08-31T19:07:54.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.902+0000 7fc77d1ff700 1 -- 172.21.15.72:0/1119990629 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7780c3ac0 con 0x7fc7780c06b0 2023-08-31T19:07:54.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.902+0000 7fc77d1ff700 1 -- 172.21.15.72:0/1119990629 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7780c4080 con 0x7fc7780c06b0 2023-08-31T19:07:54.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.903+0000 7fc77d1ff700 1 -- 172.21.15.72:0/1119990629 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7780c46d0 con 0x7fc7780c06b0 2023-08-31T19:07:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.904+0000 7fc75effd700 1 -- 172.21.15.72:0/1119990629 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc76801d640 con 0x7fc7780c06b0 2023-08-31T19:07:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.905+0000 7fc75effd700 1 --2- 172.21.15.72:0/1119990629 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc76405ef30 0x7fc7640613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.905+0000 7fc75effd700 1 -- 172.21.15.72:0/1119990629 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5897+0+0 (secure 0 0 0) 0x7fc76807bb60 con 0x7fc7780c06b0 2023-08-31T19:07:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.906+0000 7fc77659c700 1 --2- 172.21.15.72:0/1119990629 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc76405ef30 0x7fc7640613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.906+0000 7fc77659c700 1 --2- 172.21.15.72:0/1119990629 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc76405ef30 0x7fc7640613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc7780c3710 tx=0x7fc76c007180).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:54.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:54.910+0000 7fc75effd700 1 -- 172.21.15.72:0/1119990629 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc76804ce70 con 0x7fc7780c06b0 2023-08-31T19:07:55.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.079+0000 7fc77d1ff700 1 -- 172.21.15.72:0/1119990629 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc77806c6b0 con 0x7fc7780c06b0 2023-08-31T19:07:55.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.079+0000 7fc75effd700 1 -- 172.21.15.72:0/1119990629 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v153) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc768021070 con 0x7fc7780c06b0 2023-08-31T19:07:55.080 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:07:55.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.081+0000 7fc77d1ff700 1 -- 172.21.15.72:0/1119990629 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc76405ef30 msgr2=0x7fc7640613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:55.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.081+0000 7fc77d1ff700 1 --2- 172.21.15.72:0/1119990629 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc76405ef30 0x7fc7640613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc7780c3710 tx=0x7fc76c007180).stop 2023-08-31T19:07:55.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.081+0000 7fc77d1ff700 1 -- 172.21.15.72:0/1119990629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7780c06b0 msgr2=0x7fc7780c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:55.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.081+0000 7fc77d1ff700 1 --2- 172.21.15.72:0/1119990629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7780c06b0 0x7fc7780c3220 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7fc7780c8900 tx=0x7fc768017000).stop 2023-08-31T19:07:55.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.082+0000 7fc77d1ff700 1 -- 172.21.15.72:0/1119990629 shutdown_connections 2023-08-31T19:07:55.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.082+0000 7fc77d1ff700 1 --2- 172.21.15.72:0/1119990629 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc778154030 0x7fc7780c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.082+0000 7fc77d1ff700 1 --2- 172.21.15.72:0/1119990629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7780c06b0 0x7fc7780c3220 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.082+0000 7fc77d1ff700 1 --2- 172.21.15.72:0/1119990629 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc76405ef30 0x7fc7640613f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.082+0000 7fc77d1ff700 1 --2- 172.21.15.72:0/1119990629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7780c7360 0x7fc778150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.082+0000 7fc77d1ff700 1 -- 172.21.15.72:0/1119990629 >> 172.21.15.72:0/1119990629 conn(0x7fc77805eb60 msgr2=0x7fc7780ad240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:55.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.082+0000 7fc77d1ff700 1 -- 172.21.15.72:0/1119990629 shutdown_connections 2023-08-31T19:07:55.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.082+0000 7fc77d1ff700 1 -- 172.21.15.72:0/1119990629 wait complete. 2023-08-31T19:07:55.099 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:07:55.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.290+0000 7f20fafff700 1 Processor -- start 2023-08-31T19:07:55.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.290+0000 7f20fafff700 1 -- start start 2023-08-31T19:07:55.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.291+0000 7f20fafff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20f4153e30 0x7f20f4154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:55.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.291+0000 7f20fafff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f20f40c5cb0 0x7f20f40c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:55.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.291+0000 7f20fafff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f40bfd40 con 0x7f20f40630b0 2023-08-31T19:07:55.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.291+0000 7f20fafff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f40c6730 con 0x7f20f4153e30 2023-08-31T19:07:55.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.291+0000 7f20fafff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f40bffe0 con 0x7f20f40c5cb0 2023-08-31T19:07:55.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.291+0000 7f20f8d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20f4153e30 0x7f20f4154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:55.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.291+0000 7f20f8d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20f4153e30 0x7f20f4154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60400/0 (socket says 172.21.15.72:60400) 2023-08-31T19:07:55.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.292+0000 7f20f8d9b700 1 -- 172.21.15.72:0/2161176300 learned_addr learned my addr 172.21.15.72:0/2161176300 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:55.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.292+0000 7f20f3fff700 1 --2- 172.21.15.72:0/2161176300 >> v2:172.21.15.146:3300/0 conn(0x7f20f40c5cb0 0x7f20f40c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:55.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.292+0000 7f20f8d9b700 1 -- 172.21.15.72:0/2161176300 >> v2:172.21.15.146:3300/0 conn(0x7f20f40c5cb0 msgr2=0x7f20f40c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:55.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.292+0000 7f20f8d9b700 1 --2- 172.21.15.72:0/2161176300 >> v2:172.21.15.146:3300/0 conn(0x7f20f40c5cb0 0x7f20f40c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.292+0000 7f20f8d9b700 1 -- 172.21.15.72:0/2161176300 >> v1:172.21.15.146:6789/0 conn(0x7f20f40630b0 legacy=0x7f20f4157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:55.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.292+0000 7f20f8d9b700 1 -- 172.21.15.72:0/2161176300 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f40c02c0 con 0x7f20f4153e30 2023-08-31T19:07:55.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.292+0000 7f20f3fff700 1 --2- 172.21.15.72:0/2161176300 >> v2:172.21.15.146:3300/0 conn(0x7f20f40c5cb0 0x7f20f40c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:55.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.292+0000 7f20f8d9b700 1 --2- 172.21.15.72:0/2161176300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f4153e30 0x7f20f4154210 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f20f4063d10 tx=0x7f20e80090f0).ready entity=mon.0 client_cookie=b98f0e7c57c6b104 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:55.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.292+0000 7f20f37fe700 1 -- 172.21.15.72:0/2161176300 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e800b5a0 con 0x7f20f4153e30 2023-08-31T19:07:55.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.292+0000 7f20f37fe700 1 -- 172.21.15.72:0/2161176300 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e800b700 con 0x7f20f4153e30 2023-08-31T19:07:55.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.292+0000 7f20f37fe700 1 -- 172.21.15.72:0/2161176300 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e800baa0 con 0x7f20f4153e30 2023-08-31T19:07:55.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.293+0000 7f20fafff700 1 -- 172.21.15.72:0/2161176300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f4153e30 msgr2=0x7f20f4154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:55.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.293+0000 7f20fafff700 1 --2- 172.21.15.72:0/2161176300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f4153e30 0x7f20f4154210 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f20f4063d10 tx=0x7f20e80090f0).stop 2023-08-31T19:07:55.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.293+0000 7f20fafff700 1 -- 172.21.15.72:0/2161176300 shutdown_connections 2023-08-31T19:07:55.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.293+0000 7f20fafff700 1 --2- 172.21.15.72:0/2161176300 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f4153e30 0x7f20f4154210 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.293+0000 7f20fafff700 1 --2- 172.21.15.72:0/2161176300 >> v2:172.21.15.146:3300/0 conn(0x7f20f40c5cb0 0x7f20f40c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.293+0000 7f20fafff700 1 -- 172.21.15.72:0/2161176300 >> 172.21.15.72:0/2161176300 conn(0x7f20f405eb20 msgr2=0x7f20f40cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:55.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.293+0000 7f20fafff700 1 -- 172.21.15.72:0/2161176300 shutdown_connections 2023-08-31T19:07:55.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.293+0000 7f20fafff700 1 -- 172.21.15.72:0/2161176300 wait complete. 2023-08-31T19:07:55.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.295+0000 7f20fafff700 1 Processor -- start 2023-08-31T19:07:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.295+0000 7f20fafff700 1 -- start start 2023-08-31T19:07:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20fafff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f40630b0 0x7f20f414b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20fafff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f40c5cb0 0x7f20f41641a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20fafff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f4153e30 0x7f20f40c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20fafff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f40a2a40 con 0x7f20f4153e30 2023-08-31T19:07:55.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20fafff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f40a1e30 con 0x7f20f40c5cb0 2023-08-31T19:07:55.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20fafff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f40a2110 con 0x7f20f40630b0 2023-08-31T19:07:55.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20f959c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f4153e30 0x7f20f40c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:55.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20f959c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f4153e30 0x7f20f40c4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60416/0 (socket says 172.21.15.72:60416) 2023-08-31T19:07:55.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20f959c700 1 -- 172.21.15.72:0/3144365498 learned_addr learned my addr 172.21.15.72:0/3144365498 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20f8d9b700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f40630b0 0x7f20f414b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20f3fff700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f40c5cb0 0x7f20f41641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20f959c700 1 -- 172.21.15.72:0/3144365498 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f40630b0 msgr2=0x7f20f414b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20f959c700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f40630b0 0x7f20f414b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20f959c700 1 -- 172.21.15.72:0/3144365498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f40c5cb0 msgr2=0x7f20f41641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20f959c700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f40c5cb0 0x7f20f41641a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20f959c700 1 -- 172.21.15.72:0/3144365498 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e8009370 con 0x7f20f4153e30 2023-08-31T19:07:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20f8d9b700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f40630b0 0x7f20f414b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20f3fff700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f40c5cb0 0x7f20f41641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.296+0000 7f20f959c700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f4153e30 0x7f20f40c4010 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f20ec00c810 tx=0x7f20ec002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:55.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.297+0000 7f20f0ff9700 1 -- 172.21.15.72:0/3144365498 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec010510 con 0x7f20f4153e30 2023-08-31T19:07:55.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.297+0000 7f20f0ff9700 1 -- 172.21.15.72:0/3144365498 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec010690 con 0x7f20f4153e30 2023-08-31T19:07:55.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.297+0000 7f20f0ff9700 1 -- 172.21.15.72:0/3144365498 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec010a50 con 0x7f20f4153e30 2023-08-31T19:07:55.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.297+0000 7f20fafff700 1 -- 172.21.15.72:0/3144365498 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f40a23f0 con 0x7f20f4153e30 2023-08-31T19:07:55.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.297+0000 7f20fafff700 1 -- 172.21.15.72:0/3144365498 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f414be60 con 0x7f20f4153e30 2023-08-31T19:07:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.298+0000 7f20fafff700 1 -- 172.21.15.72:0/3144365498 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f40a2bf0 con 0x7f20f4153e30 2023-08-31T19:07:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.299+0000 7f20f0ff9700 1 -- 172.21.15.72:0/3144365498 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f20ec01b400 con 0x7f20f4153e30 2023-08-31T19:07:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.300+0000 7f20f0ff9700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f20d805ef30 0x7f20d80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.300+0000 7f20f0ff9700 1 -- 172.21.15.72:0/3144365498 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5897+0+0 (secure 0 0 0) 0x7f20ec079ec0 con 0x7f20f4153e30 2023-08-31T19:07:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.300+0000 7f20f8d9b700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f20d805ef30 0x7f20d80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.300+0000 7f20f8d9b700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f20d805ef30 0x7f20d80613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f20e8009130 tx=0x7f20e8015000).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.303+0000 7f20f0ff9700 1 -- 172.21.15.72:0/3144365498 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f20f40a2bf0 con 0x7f20f4153e30 2023-08-31T19:07:55.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.477+0000 7f20fafff700 1 -- 172.21.15.72:0/3144365498 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f20f406c6b0 con 0x7f20f4153e30 2023-08-31T19:07:55.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.477+0000 7f20f0ff9700 1 -- 172.21.15.72:0/3144365498 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v153) v1 ==== 92+0+10 (secure 0 0 0) 0x7f20ec04b290 con 0x7f20f4153e30 2023-08-31T19:07:55.478 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:07:55.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.479+0000 7f20fafff700 1 -- 172.21.15.72:0/3144365498 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f20d805ef30 msgr2=0x7f20d80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:55.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.479+0000 7f20fafff700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f20d805ef30 0x7f20d80613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f20e8009130 tx=0x7f20e8015000).stop 2023-08-31T19:07:55.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.479+0000 7f20fafff700 1 -- 172.21.15.72:0/3144365498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f4153e30 msgr2=0x7f20f40c4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:55.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.479+0000 7f20fafff700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f4153e30 0x7f20f40c4010 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f20ec00c810 tx=0x7f20ec002560).stop 2023-08-31T19:07:55.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.479+0000 7f20fafff700 1 -- 172.21.15.72:0/3144365498 shutdown_connections 2023-08-31T19:07:55.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.479+0000 7f20fafff700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f4153e30 0x7f20f40c4010 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.479+0000 7f20fafff700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f40630b0 0x7f20f414b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.479+0000 7f20fafff700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f20d805ef30 0x7f20d80613f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.479+0000 7f20fafff700 1 --2- 172.21.15.72:0/3144365498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f40c5cb0 0x7f20f41641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.479+0000 7f20fafff700 1 -- 172.21.15.72:0/3144365498 >> 172.21.15.72:0/3144365498 conn(0x7f20f405eb20 msgr2=0x7f20f40ab5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:55.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.479+0000 7f20fafff700 1 -- 172.21.15.72:0/3144365498 shutdown_connections 2023-08-31T19:07:55.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.479+0000 7f20fafff700 1 -- 172.21.15.72:0/3144365498 wait complete. 2023-08-31T19:07:55.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T19:07:55.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:07:55.505 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:07:55.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.688+0000 7fd52c5ff700 1 Processor -- start 2023-08-31T19:07:55.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.689+0000 7fd52c5ff700 1 -- start start 2023-08-31T19:07:55.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.690+0000 7fd52c5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd5241510a0 0x7fd52415b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:55.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.690+0000 7fd52c5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5240641e0 con 0x7fd5240c2450 2023-08-31T19:07:55.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.690+0000 7fd52c5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd524068b90 con 0x7fd5241505b0 2023-08-31T19:07:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.690+0000 7fd52c5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd524151580 con 0x7fd5241510a0 2023-08-31T19:07:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.690+0000 7fd52ab9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd5241510a0 0x7fd52415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.690+0000 7fd52ab9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd5241510a0 0x7fd52415b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60426/0 (socket says 172.21.15.72:60426) 2023-08-31T19:07:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.690+0000 7fd52ab9c700 1 -- 172.21.15.72:0/654912403 learned_addr learned my addr 172.21.15.72:0/654912403 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.690+0000 7fd529b9a700 1 --1- 172.21.15.72:0/654912403 >> v1:172.21.15.72:6789/0 conn(0x7fd5240c2450 0x7fd524150990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52766/0 (socket says 172.21.15.72:52766) 2023-08-31T19:07:55.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.691+0000 7fd52ab9c700 1 -- 172.21.15.72:0/654912403 >> v1:172.21.15.146:6789/0 conn(0x7fd5241505b0 legacy=0x7fd5240c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:55.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.691+0000 7fd52ab9c700 1 -- 172.21.15.72:0/654912403 >> v1:172.21.15.72:6789/0 conn(0x7fd5240c2450 legacy=0x7fd524150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:55.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.691+0000 7fd52ab9c700 1 -- 172.21.15.72:0/654912403 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd524151860 con 0x7fd5241510a0 2023-08-31T19:07:55.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.691+0000 7fd52ab9c700 1 --2- 172.21.15.72:0/654912403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5241510a0 0x7fd52415b630 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7fd51c00d1a0 tx=0x7fd51c00ba50).ready entity=mon.0 client_cookie=e52ff4ab4a13f7a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:55.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.691+0000 7fd529399700 1 -- 172.21.15.72:0/654912403 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c010070 con 0x7fd5241510a0 2023-08-31T19:07:55.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.691+0000 7fd529399700 1 -- 172.21.15.72:0/654912403 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c015470 con 0x7fd5241510a0 2023-08-31T19:07:55.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.691+0000 7fd529399700 1 -- 172.21.15.72:0/654912403 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0157f0 con 0x7fd5241510a0 2023-08-31T19:07:55.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.692+0000 7fd52c5ff700 1 -- 172.21.15.72:0/654912403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5241510a0 msgr2=0x7fd52415b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:55.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.692+0000 7fd52c5ff700 1 --2- 172.21.15.72:0/654912403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5241510a0 0x7fd52415b630 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7fd51c00d1a0 tx=0x7fd51c00ba50).stop 2023-08-31T19:07:55.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.692+0000 7fd52c5ff700 1 -- 172.21.15.72:0/654912403 shutdown_connections 2023-08-31T19:07:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.692+0000 7fd52c5ff700 1 --2- 172.21.15.72:0/654912403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5241510a0 0x7fd52415b630 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.692+0000 7fd52c5ff700 1 -- 172.21.15.72:0/654912403 >> 172.21.15.72:0/654912403 conn(0x7fd5240c6b10 msgr2=0x7fd5240c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.692+0000 7fd52c5ff700 1 -- 172.21.15.72:0/654912403 shutdown_connections 2023-08-31T19:07:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.692+0000 7fd52c5ff700 1 -- 172.21.15.72:0/654912403 wait complete. 2023-08-31T19:07:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.694+0000 7fd52c5ff700 1 Processor -- start 2023-08-31T19:07:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.694+0000 7fd52c5ff700 1 -- start start 2023-08-31T19:07:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.695+0000 7fd52c5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5240c2450 0x7fd52413d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.695+0000 7fd52c5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5241505b0 0x7fd5240be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.695+0000 7fd52c5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5241510a0 0x7fd52413dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.695+0000 7fd52c5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240bf510 con 0x7fd5241505b0 2023-08-31T19:07:55.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.695+0000 7fd52c5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240a86f0 con 0x7fd5240c2450 2023-08-31T19:07:55.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.695+0000 7fd52c5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52413dad0 con 0x7fd5241510a0 2023-08-31T19:07:55.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.695+0000 7fd529b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5241505b0 0x7fd5240be9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:55.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd529b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5241505b0 0x7fd5240be9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60434/0 (socket says 172.21.15.72:60434) 2023-08-31T19:07:55.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd529b9a700 1 -- 172.21.15.72:0/3795250347 learned_addr learned my addr 172.21.15.72:0/3795250347 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:55.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd52ab9c700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5241510a0 0x7fd52413dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd52a39b700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5240c2450 0x7fd52413d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd529b9a700 1 -- 172.21.15.72:0/3795250347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5241510a0 msgr2=0x7fd52413dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd529b9a700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5241510a0 0x7fd52413dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd529b9a700 1 -- 172.21.15.72:0/3795250347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5240c2450 msgr2=0x7fd52413d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd529b9a700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5240c2450 0x7fd52413d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd529b9a700 1 -- 172.21.15.72:0/3795250347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c00bcf0 con 0x7fd5241505b0 2023-08-31T19:07:55.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd52a39b700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5240c2450 0x7fd52413d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:55.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd52ab9c700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5241510a0 0x7fd52413dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:55.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd529b9a700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5241505b0 0x7fd5240be9e0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7fd51400c4c0 tx=0x7fd514007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:55.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd51a7fc700 1 -- 172.21.15.72:0/3795250347 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140072e0 con 0x7fd5241505b0 2023-08-31T19:07:55.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd51a7fc700 1 -- 172.21.15.72:0/3795250347 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd514007440 con 0x7fd5241505b0 2023-08-31T19:07:55.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd51a7fc700 1 -- 172.21.15.72:0/3795250347 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140058f0 con 0x7fd5241505b0 2023-08-31T19:07:55.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.696+0000 7fd52c5ff700 1 -- 172.21.15.72:0/3795250347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5240bf230 con 0x7fd5241505b0 2023-08-31T19:07:55.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.697+0000 7fd52c5ff700 1 -- 172.21.15.72:0/3795250347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5240a8380 con 0x7fd5241505b0 2023-08-31T19:07:55.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.698+0000 7fd52c5ff700 1 -- 172.21.15.72:0/3795250347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52406c6b0 con 0x7fd5241505b0 2023-08-31T19:07:55.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.698+0000 7fd51a7fc700 1 -- 172.21.15.72:0/3795250347 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd514005d20 con 0x7fd5241505b0 2023-08-31T19:07:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.699+0000 7fd51a7fc700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd50805ef30 0x7fd5080613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.699+0000 7fd51a7fc700 1 -- 172.21.15.72:0/3795250347 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5897+0+0 (secure 0 0 0) 0x7fd5140795a0 con 0x7fd5241505b0 2023-08-31T19:07:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.700+0000 7fd52a39b700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd50805ef30 0x7fd5080613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.700+0000 7fd52a39b700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd50805ef30 0x7fd5080613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd5240be910 tx=0x7fd520009040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.703+0000 7fd51a7fc700 1 -- 172.21.15.72:0/3795250347 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd51404a8f0 con 0x7fd5241505b0 2023-08-31T19:07:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.874+0000 7fd52c5ff700 1 -- 172.21.15.72:0/3795250347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd5240c2880 con 0x7fd5241505b0 2023-08-31T19:07:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.875+0000 7fd51a7fc700 1 -- 172.21.15.72:0/3795250347 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v153) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd514018020 con 0x7fd5241505b0 2023-08-31T19:07:55.875 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:55.876 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:07:55.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:55.876 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-08-31T19:07:55.876 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "device_health_metrics" 2023-08-31T19:07:55.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:07:55.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:07:55.877 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-08-31T19:07:55.877 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-08-31T19:07:55.877 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:07:55.877 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:07:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.877+0000 7fd52c5ff700 1 -- 172.21.15.72:0/3795250347 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd50805ef30 msgr2=0x7fd5080613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.877+0000 7fd52c5ff700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd50805ef30 0x7fd5080613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd5240be910 tx=0x7fd520009040).stop 2023-08-31T19:07:55.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.877+0000 7fd52c5ff700 1 -- 172.21.15.72:0/3795250347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5241505b0 msgr2=0x7fd5240be9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:55.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.877+0000 7fd52c5ff700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5241505b0 0x7fd5240be9e0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7fd51400c4c0 tx=0x7fd514007dc0).stop 2023-08-31T19:07:55.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.877+0000 7fd52c5ff700 1 -- 172.21.15.72:0/3795250347 shutdown_connections 2023-08-31T19:07:55.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.877+0000 7fd52c5ff700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd5241510a0 0x7fd52413dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.877+0000 7fd52c5ff700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fd50805ef30 0x7fd5080613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.877+0000 7fd52c5ff700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5240c2450 0x7fd52413d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.877+0000 7fd52c5ff700 1 --2- 172.21.15.72:0/3795250347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5241505b0 0x7fd5240be9e0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:55.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.877+0000 7fd52c5ff700 1 -- 172.21.15.72:0/3795250347 >> 172.21.15.72:0/3795250347 conn(0x7fd5240c6b10 msgr2=0x7fd5240c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:55.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.877+0000 7fd52c5ff700 1 -- 172.21.15.72:0/3795250347 shutdown_connections 2023-08-31T19:07:55.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:55.877+0000 7fd52c5ff700 1 -- 172.21.15.72:0/3795250347 wait complete. 2023-08-31T19:07:55.894 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T19:07:55.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-31T19:07:56.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.088+0000 7f4597dff700 1 Processor -- start 2023-08-31T19:07:56.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.088+0000 7f4597dff700 1 -- start start 2023-08-31T19:07:56.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.089+0000 7f4597dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45900c5aa0 0x7f45900653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:56.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.089+0000 7f4597dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45900c4f90 con 0x7f45900c4bb0 2023-08-31T19:07:56.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.089+0000 7f4597dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45900c6020 con 0x7f459013d960 2023-08-31T19:07:56.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.089+0000 7f4597dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45901587f0 con 0x7f45900c5aa0 2023-08-31T19:07:56.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.090+0000 7f4595b9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f45900c4bb0 0x7f45900c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52774/0 (socket says 172.21.15.72:52774) 2023-08-31T19:07:56.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.090+0000 7f4595b9b700 1 -- 172.21.15.72:0/2507912551 learned_addr learned my addr 172.21.15.72:0/2507912551 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:56.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.090+0000 7f459539a700 1 --2- 172.21.15.72:0/2507912551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45900c5aa0 0x7f45900653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:56.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.090+0000 7f4594b99700 1 -- 172.21.15.72:0/2507912551 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389251474 0 0) 0x7f45900c4f90 con 0x7f45900c4bb0 2023-08-31T19:07:56.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.090+0000 7f4594b99700 1 -- 172.21.15.72:0/2507912551 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f457c0033f0 con 0x7f45900c4bb0 2023-08-31T19:07:56.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.090+0000 7f4594b99700 1 -- 172.21.15.72:0/2507912551 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1765835534 0 0) 0x7f457c0033f0 con 0x7f45900c4bb0 2023-08-31T19:07:56.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.090+0000 7f4594b99700 1 -- 172.21.15.72:0/2507912551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45900c5aa0 msgr2=0x7f45900653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:56.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.090+0000 7f4594b99700 1 --2- 172.21.15.72:0/2507912551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45900c5aa0 0x7f45900653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:56.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.090+0000 7f4594b99700 1 -- 172.21.15.72:0/2507912551 >> v1:172.21.15.146:6789/0 conn(0x7f459013d960 legacy=0x7f4590067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:56.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.090+0000 7f4594b99700 1 -- 172.21.15.72:0/2507912551 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4590158ad0 con 0x7f45900c4bb0 2023-08-31T19:07:56.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.090+0000 7f4594b99700 1 -- 172.21.15.72:0/2507912551 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f458c001470 con 0x7f45900c4bb0 2023-08-31T19:07:56.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.090+0000 7f4594b99700 1 -- 172.21.15.72:0/2507912551 >> v1:172.21.15.72:6789/0 conn(0x7f45900c4bb0 legacy=0x7f45900c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:56.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.090+0000 7f4594b99700 1 --2- 172.21.15.72:0/2507912551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f457c003910 0x7f457c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:56.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.090+0000 7f4594b99700 1 --2- 172.21.15.72:0/2507912551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f457c004690 0x7f457c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:56.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.091+0000 7f4594b99700 1 --2- 172.21.15.72:0/2507912551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45900c5aa0 0x7f457c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:56.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.091+0000 7f4594b99700 1 -- 172.21.15.72:0/2507912551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45901587f0 con 0x7f457c004690 2023-08-31T19:07:56.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.091+0000 7f4594b99700 1 -- 172.21.15.72:0/2507912551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c00b910 con 0x7f457c003910 2023-08-31T19:07:56.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.091+0000 7f4594b99700 1 -- 172.21.15.72:0/2507912551 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457c00bad0 con 0x7f45900c5aa0 2023-08-31T19:07:56.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.091+0000 7f459539a700 1 --2- 172.21.15.72:0/2507912551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f457c004690 0x7f457c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:56.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.091+0000 7f4595b9b700 1 --2- 172.21.15.72:0/2507912551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f457c003910 0x7f457c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:56.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.091+0000 7f459639c700 1 --2- 172.21.15.72:0/2507912551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45900c5aa0 0x7f457c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:56.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.091+0000 7f459539a700 1 -- 172.21.15.72:0/2507912551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45900c5aa0 msgr2=0x7f457c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:56.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.091+0000 7f459539a700 1 --2- 172.21.15.72:0/2507912551 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45900c5aa0 0x7f457c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:56.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.091+0000 7f459539a700 1 -- 172.21.15.72:0/2507912551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f457c003910 msgr2=0x7f457c003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:56.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.091+0000 7f459539a700 1 --2- 172.21.15.72:0/2507912551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f457c003910 0x7f457c003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:56.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.091+0000 7f459539a700 1 -- 172.21.15.72:0/2507912551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c0033f0 con 0x7f457c004690 2023-08-31T19:07:56.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.091+0000 7f459539a700 1 --2- 172.21.15.72:0/2507912551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f457c004690 0x7f457c004b10 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f45900c5ea0 tx=0x7f4580009060).ready entity=mon.0 client_cookie=b9bfafe0486b841e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:56.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.091+0000 7f4594b99700 1 -- 172.21.15.72:0/2507912551 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580009e90 con 0x7f457c004690 2023-08-31T19:07:56.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.092+0000 7f4594b99700 1 -- 172.21.15.72:0/2507912551 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4580009430 con 0x7f457c004690 2023-08-31T19:07:56.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.092+0000 7f4594b99700 1 -- 172.21.15.72:0/2507912551 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458000e850 con 0x7f457c004690 2023-08-31T19:07:56.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.092+0000 7f4597dff700 1 -- 172.21.15.72:0/2507912551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f457c004690 msgr2=0x7f457c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:56.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.092+0000 7f4597dff700 1 --2- 172.21.15.72:0/2507912551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f457c004690 0x7f457c004b10 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f45900c5ea0 tx=0x7f4580009060).stop 2023-08-31T19:07:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.092+0000 7f459639c700 1 -- 172.21.15.72:0/2507912551 reap_dead start 2023-08-31T19:07:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.092+0000 7f4597dff700 1 -- 172.21.15.72:0/2507912551 shutdown_connections 2023-08-31T19:07:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.092+0000 7f4597dff700 1 -- 172.21.15.72:0/2507912551 >> 172.21.15.72:0/2507912551 conn(0x7f4590066350 msgr2=0x7f4590066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.092+0000 7f4597dff700 1 -- 172.21.15.72:0/2507912551 shutdown_connections 2023-08-31T19:07:56.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.092+0000 7f4597dff700 1 -- 172.21.15.72:0/2507912551 wait complete. 2023-08-31T19:07:56.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.094+0000 7f4597dff700 1 Processor -- start 2023-08-31T19:07:56.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.094+0000 7f4597dff700 1 -- start start 2023-08-31T19:07:56.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f4597dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f457c004690 0x7f45900a8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:56.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f4597dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45901569d0 0x7f4590156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:56.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f4597dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4590138110 0x7f4590138590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:56.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f4597dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45900c0660 con 0x7f4590138110 2023-08-31T19:07:56.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f4597dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459013bef0 con 0x7f457c004690 2023-08-31T19:07:56.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f4597dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4590138a80 con 0x7f45901569d0 2023-08-31T19:07:56.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f459639c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4590138110 0x7f4590138590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:56.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f459639c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4590138110 0x7f4590138590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60448/0 (socket says 172.21.15.72:60448) 2023-08-31T19:07:56.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f459639c700 1 -- 172.21.15.72:0/3487754095 learned_addr learned my addr 172.21.15.72:0/3487754095 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:56.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f4595b9b700 1 --2- 172.21.15.72:0/3487754095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f457c004690 0x7f45900a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:56.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f459539a700 1 --2- 172.21.15.72:0/3487754095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45901569d0 0x7f4590156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:56.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f459639c700 1 -- 172.21.15.72:0/3487754095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45901569d0 msgr2=0x7f4590156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:56.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f459639c700 1 --2- 172.21.15.72:0/3487754095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45901569d0 0x7f4590156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:56.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f459639c700 1 -- 172.21.15.72:0/3487754095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f457c004690 msgr2=0x7f45900a8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:56.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f459639c700 1 --2- 172.21.15.72:0/3487754095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f457c004690 0x7f45900a8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:56.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.095+0000 7f459639c700 1 -- 172.21.15.72:0/3487754095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45900bfd70 con 0x7f4590138110 2023-08-31T19:07:56.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.096+0000 7f459639c700 1 --2- 172.21.15.72:0/3487754095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4590138110 0x7f4590138590 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f4590066040 tx=0x7f4588009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:56.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.096+0000 7f4585ffb700 1 -- 172.21.15.72:0/3487754095 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458800eeb0 con 0x7f4590138110 2023-08-31T19:07:56.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.096+0000 7f4585ffb700 1 -- 172.21.15.72:0/3487754095 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4588003030 con 0x7f4590138110 2023-08-31T19:07:56.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.096+0000 7f4585ffb700 1 -- 172.21.15.72:0/3487754095 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45880033d0 con 0x7f4590138110 2023-08-31T19:07:56.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.096+0000 7f4597dff700 1 -- 172.21.15.72:0/3487754095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45900c0010 con 0x7f4590138110 2023-08-31T19:07:56.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.096+0000 7f4597dff700 1 -- 172.21.15.72:0/3487754095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459013b1c0 con 0x7f4590138110 2023-08-31T19:07:56.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.097+0000 7f4597dff700 1 -- 172.21.15.72:0/3487754095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45900c0810 con 0x7f4590138110 2023-08-31T19:07:56.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.098+0000 7f4585ffb700 1 -- 172.21.15.72:0/3487754095 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f45880019a0 con 0x7f4590138110 2023-08-31T19:07:56.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.098+0000 7f4585ffb700 1 --2- 172.21.15.72:0/3487754095 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f457405ef30 0x7f45740613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:56.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.098+0000 7f4585ffb700 1 -- 172.21.15.72:0/3487754095 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5897+0+0 (secure 0 0 0) 0x7f4588079290 con 0x7f4590138110 2023-08-31T19:07:56.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.099+0000 7f4595b9b700 1 --2- 172.21.15.72:0/3487754095 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f457405ef30 0x7f45740613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:56.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.099+0000 7f4595b9b700 1 --2- 172.21.15.72:0/3487754095 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f457405ef30 0x7f45740613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f458c000c00 tx=0x7f458c007040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:56.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.102+0000 7f4585ffb700 1 -- 172.21.15.72:0/3487754095 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f45900c0810 con 0x7f4590138110 2023-08-31T19:07:56.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.272+0000 7f4597dff700 1 -- 172.21.15.72:0/3487754095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f459006c6b0 con 0x7f4590138110 2023-08-31T19:07:56.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.410+0000 7f4585ffb700 1 -- 172.21.15.72:0/3487754095 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v154) v1 ==== 152+0+0 (secure 0 0 0) 0x7f458801c0c0 con 0x7f4590138110 2023-08-31T19:07:56.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.413+0000 7f4597dff700 1 -- 172.21.15.72:0/3487754095 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f457405ef30 msgr2=0x7f45740613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:56.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.413+0000 7f4597dff700 1 --2- 172.21.15.72:0/3487754095 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f457405ef30 0x7f45740613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f458c000c00 tx=0x7f458c007040).stop 2023-08-31T19:07:56.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.413+0000 7f4597dff700 1 -- 172.21.15.72:0/3487754095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4590138110 msgr2=0x7f4590138590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:56.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.413+0000 7f4597dff700 1 --2- 172.21.15.72:0/3487754095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4590138110 0x7f4590138590 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f4590066040 tx=0x7f4588009040).stop 2023-08-31T19:07:56.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.414+0000 7f4597dff700 1 -- 172.21.15.72:0/3487754095 shutdown_connections 2023-08-31T19:07:56.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.414+0000 7f4597dff700 1 --2- 172.21.15.72:0/3487754095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4590138110 0x7f4590138590 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:56.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.414+0000 7f4597dff700 1 --2- 172.21.15.72:0/3487754095 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f457405ef30 0x7f45740613f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:56.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.414+0000 7f4597dff700 1 --2- 172.21.15.72:0/3487754095 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f457c004690 0x7f45900a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:56.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.414+0000 7f4597dff700 1 --2- 172.21.15.72:0/3487754095 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f45901569d0 0x7f4590156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:56.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.414+0000 7f4597dff700 1 -- 172.21.15.72:0/3487754095 >> 172.21.15.72:0/3487754095 conn(0x7f4590066350 msgr2=0x7f4590157c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:56.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.415+0000 7f4597dff700 1 -- 172.21.15.72:0/3487754095 shutdown_connections 2023-08-31T19:07:56.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.416+0000 7f4597dff700 1 -- 172.21.15.72:0/3487754095 wait complete. 2023-08-31T19:07:56.421 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-08-31T19:07:56.438 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T19:07:56.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.634+0000 7f7ed45ff700 1 Processor -- start 2023-08-31T19:07:56.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.634+0000 7f7ed45ff700 1 -- start start 2023-08-31T19:07:56.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.635+0000 7f7ed45ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7ecc154030 0x7f7ecc154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:56.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.635+0000 7f7ed45ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ecc0c7360 0x7f7ecc063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:56.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.635+0000 7f7ed45ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ecc0c6ed0 con 0x7f7ecc0c06b0 2023-08-31T19:07:56.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.635+0000 7f7ed45ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ecc0c66e0 con 0x7f7ecc0c7360 2023-08-31T19:07:56.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.635+0000 7f7ed45ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ecc0c68c0 con 0x7f7ecc154030 2023-08-31T19:07:56.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.635+0000 7f7ed2b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ecc0c7360 0x7f7ecc063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:56.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.636+0000 7f7ed2b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ecc0c7360 0x7f7ecc063120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60450/0 (socket says 172.21.15.72:60450) 2023-08-31T19:07:56.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.636+0000 7f7ed2b9c700 1 -- 172.21.15.72:0/3052300477 learned_addr learned my addr 172.21.15.72:0/3052300477 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:56.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.636+0000 7f7ed1b9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7ecc0c06b0 0x7f7ecc0aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52782/0 (socket says 172.21.15.72:52782) 2023-08-31T19:07:56.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.636+0000 7f7ed239b700 1 --2- 172.21.15.72:0/3052300477 >> v2:172.21.15.146:3300/0 conn(0x7f7ecc154030 0x7f7ecc154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:56.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.636+0000 7f7ed2b9c700 1 -- 172.21.15.72:0/3052300477 >> v2:172.21.15.146:3300/0 conn(0x7f7ecc154030 msgr2=0x7f7ecc154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:56.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.636+0000 7f7ed2b9c700 1 --2- 172.21.15.72:0/3052300477 >> v2:172.21.15.146:3300/0 conn(0x7f7ecc154030 0x7f7ecc154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:56.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.636+0000 7f7ed2b9c700 1 -- 172.21.15.72:0/3052300477 >> v1:172.21.15.72:6789/0 conn(0x7f7ecc0c06b0 legacy=0x7f7ecc0aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:56.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.636+0000 7f7ed1399700 1 -- 172.21.15.72:0/3052300477 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026863386 0 0) 0x7f7ecc0c6ed0 con 0x7f7ecc0c06b0 2023-08-31T19:07:56.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.636+0000 7f7ed2b9c700 1 -- 172.21.15.72:0/3052300477 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc0c0f30 con 0x7f7ecc0c7360 2023-08-31T19:07:56.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.636+0000 7f7ed239b700 1 --2- 172.21.15.72:0/3052300477 >> v2:172.21.15.146:3300/0 conn(0x7f7ecc154030 0x7f7ecc154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:56.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.636+0000 7f7ed2b9c700 1 --2- 172.21.15.72:0/3052300477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ecc0c7360 0x7f7ecc063120 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f7ecc0c8bc0 tx=0x7f7ec4009840).ready entity=mon.0 client_cookie=af871f466212df1e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:56.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.636+0000 7f7ed1399700 1 -- 172.21.15.72:0/3052300477 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec400e070 con 0x7f7ecc0c7360 2023-08-31T19:07:56.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.636+0000 7f7ed1399700 1 -- 172.21.15.72:0/3052300477 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec400ba50 con 0x7f7ecc0c7360 2023-08-31T19:07:56.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.636+0000 7f7ed1399700 1 -- 172.21.15.72:0/3052300477 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec400bdd0 con 0x7f7ecc0c7360 2023-08-31T19:07:56.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.637+0000 7f7ed45ff700 1 -- 172.21.15.72:0/3052300477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ecc0c7360 msgr2=0x7f7ecc063120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:56.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.637+0000 7f7ed45ff700 1 --2- 172.21.15.72:0/3052300477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ecc0c7360 0x7f7ecc063120 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f7ecc0c8bc0 tx=0x7f7ec4009840).stop 2023-08-31T19:07:56.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.637+0000 7f7ed45ff700 1 -- 172.21.15.72:0/3052300477 shutdown_connections 2023-08-31T19:07:56.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.637+0000 7f7ed45ff700 1 --2- 172.21.15.72:0/3052300477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ecc0c7360 0x7f7ecc063120 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:56.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.637+0000 7f7ed45ff700 1 --2- 172.21.15.72:0/3052300477 >> v2:172.21.15.146:3300/0 conn(0x7f7ecc154030 0x7f7ecc154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:56.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.637+0000 7f7ed45ff700 1 -- 172.21.15.72:0/3052300477 >> 172.21.15.72:0/3052300477 conn(0x7f7ecc05eb60 msgr2=0x7f7ecc0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:56.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.637+0000 7f7ed45ff700 1 -- 172.21.15.72:0/3052300477 shutdown_connections 2023-08-31T19:07:56.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.637+0000 7f7ed45ff700 1 -- 172.21.15.72:0/3052300477 wait complete. 2023-08-31T19:07:56.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.638+0000 7f7ed45ff700 1 Processor -- start 2023-08-31T19:07:56.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.639+0000 7f7ed45ff700 1 -- start start 2023-08-31T19:07:56.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed45ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ecc0c06b0 0x7f7ecc13c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:56.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed45ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ecc0c7360 0x7f7ecc064670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:56.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed45ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ecc154030 0x7f7ecc064b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:56.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed45ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc065050 con 0x7f7ecc0c06b0 2023-08-31T19:07:56.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed45ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0aedf0 con 0x7f7ecc0c7360 2023-08-31T19:07:56.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed45ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc153770 con 0x7f7ecc154030 2023-08-31T19:07:56.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed239b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ecc0c06b0 0x7f7ecc13c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:56.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed239b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ecc0c06b0 0x7f7ecc13c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60464/0 (socket says 172.21.15.72:60464) 2023-08-31T19:07:56.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed239b700 1 -- 172.21.15.72:0/3969468829 learned_addr learned my addr 172.21.15.72:0/3969468829 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:56.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed1b9a700 1 --2- 172.21.15.72:0/3969468829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ecc0c7360 0x7f7ecc064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:56.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed2b9c700 1 --2- 172.21.15.72:0/3969468829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ecc154030 0x7f7ecc064b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:56.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed239b700 1 -- 172.21.15.72:0/3969468829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ecc154030 msgr2=0x7f7ecc064b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:56.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed239b700 1 --2- 172.21.15.72:0/3969468829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ecc154030 0x7f7ecc064b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:56.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed239b700 1 -- 172.21.15.72:0/3969468829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ecc0c7360 msgr2=0x7f7ecc064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:56.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed239b700 1 --2- 172.21.15.72:0/3969468829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ecc0c7360 0x7f7ecc064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:56.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.640+0000 7f7ed239b700 1 -- 172.21.15.72:0/3969468829 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec4009ae0 con 0x7f7ecc0c06b0 2023-08-31T19:07:56.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.641+0000 7f7ed239b700 1 --2- 172.21.15.72:0/3969468829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ecc0c06b0 0x7f7ecc13c180 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f7ec800c880 tx=0x7f7ec8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:56.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.641+0000 7f7ec27fc700 1 -- 172.21.15.72:0/3969468829 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8010580 con 0x7f7ecc0c06b0 2023-08-31T19:07:56.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.641+0000 7f7ec27fc700 1 -- 172.21.15.72:0/3969468829 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec80106e0 con 0x7f7ecc0c06b0 2023-08-31T19:07:56.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.641+0000 7f7ed45ff700 1 -- 172.21.15.72:0/3969468829 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ecc153490 con 0x7f7ecc0c06b0 2023-08-31T19:07:56.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.641+0000 7f7ec27fc700 1 -- 172.21.15.72:0/3969468829 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8010a60 con 0x7f7ecc0c06b0 2023-08-31T19:07:56.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.641+0000 7f7ed45ff700 1 -- 172.21.15.72:0/3969468829 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ecc0aea80 con 0x7f7ecc0c06b0 2023-08-31T19:07:56.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.642+0000 7f7ed45ff700 1 -- 172.21.15.72:0/3969468829 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ecc06c6b0 con 0x7f7ecc0c06b0 2023-08-31T19:07:56.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.643+0000 7f7ec27fc700 1 -- 172.21.15.72:0/3969468829 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7ec801b460 con 0x7f7ecc0c06b0 2023-08-31T19:07:56.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.644+0000 7f7ec27fc700 1 --2- 172.21.15.72:0/3969468829 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7eb005ef30 0x7f7eb00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:56.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.644+0000 7f7ec27fc700 1 -- 172.21.15.72:0/3969468829 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6267+0+0 (secure 0 0 0) 0x7f7ec8079ff0 con 0x7f7ecc0c06b0 2023-08-31T19:07:56.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.644+0000 7f7ed1b9a700 1 --2- 172.21.15.72:0/3969468829 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7eb005ef30 0x7f7eb00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:56.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.644+0000 7f7ed1b9a700 1 --2- 172.21.15.72:0/3969468829 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7eb005ef30 0x7f7eb00613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7ecc159bc0 tx=0x7f7ebc007bd0).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:56.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.648+0000 7f7ec27fc700 1 -- 172.21.15.72:0/3969468829 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ec804b130 con 0x7f7ecc0c06b0 2023-08-31T19:07:56.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:56.817+0000 7f7ed45ff700 1 -- 172.21.15.72:0/3969468829 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7ecc0c0c50 con 0x7f7ecc0c06b0 2023-08-31T19:07:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.419+0000 7f7ec27fc700 1 -- 172.21.15.72:0/3969468829 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v155) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7ec804e750 con 0x7f7ecc0c06b0 2023-08-31T19:07:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.423+0000 7f7ed45ff700 1 -- 172.21.15.72:0/3969468829 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7eb005ef30 msgr2=0x7f7eb00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.423+0000 7f7ed45ff700 1 --2- 172.21.15.72:0/3969468829 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7eb005ef30 0x7f7eb00613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7ecc159bc0 tx=0x7f7ebc007bd0).stop 2023-08-31T19:07:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.423+0000 7f7ed45ff700 1 -- 172.21.15.72:0/3969468829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ecc0c06b0 msgr2=0x7f7ecc13c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.423+0000 7f7ed45ff700 1 --2- 172.21.15.72:0/3969468829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ecc0c06b0 0x7f7ecc13c180 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f7ec800c880 tx=0x7f7ec8008040).stop 2023-08-31T19:07:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.423+0000 7f7ed45ff700 1 -- 172.21.15.72:0/3969468829 shutdown_connections 2023-08-31T19:07:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.423+0000 7f7ed45ff700 1 --2- 172.21.15.72:0/3969468829 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7ecc154030 0x7f7ecc064b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.423+0000 7f7ed45ff700 1 --2- 172.21.15.72:0/3969468829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ecc0c06b0 0x7f7ecc13c180 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.423+0000 7f7ed45ff700 1 --2- 172.21.15.72:0/3969468829 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f7eb005ef30 0x7f7eb00613f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.423+0000 7f7ed45ff700 1 --2- 172.21.15.72:0/3969468829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ecc0c7360 0x7f7ecc064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.423+0000 7f7ed45ff700 1 -- 172.21.15.72:0/3969468829 >> 172.21.15.72:0/3969468829 conn(0x7f7ecc05eb60 msgr2=0x7f7ecc0ac3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.424+0000 7f7ed45ff700 1 -- 172.21.15.72:0/3969468829 shutdown_connections 2023-08-31T19:07:57.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.424+0000 7f7ed45ff700 1 -- 172.21.15.72:0/3969468829 wait complete. 2023-08-31T19:07:57.429 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-08-31T19:07:57.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T19:07:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.646+0000 7fb63b7ff700 1 Processor -- start 2023-08-31T19:07:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.647+0000 7fb63b7ff700 1 -- start start 2023-08-31T19:07:57.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.648+0000 7fb63b7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb634154410 0x7fb6340c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:57.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.648+0000 7fb63b7ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6340c7360 0x7fb634063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:57.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.648+0000 7fb63b7ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6340c6ed0 con 0x7fb634154030 2023-08-31T19:07:57.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.648+0000 7fb63b7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6340c66e0 con 0x7fb634154410 2023-08-31T19:07:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.648+0000 7fb63b7ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6340c68c0 con 0x7fb6340c7360 2023-08-31T19:07:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.648+0000 7fb638d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb634154410 0x7fb6340c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.648+0000 7fb638d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb634154410 0x7fb6340c06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60472/0 (socket says 172.21.15.72:60472) 2023-08-31T19:07:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.648+0000 7fb638d9a700 1 -- 172.21.15.72:0/2584739004 learned_addr learned my addr 172.21.15.72:0/2584739004 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.648+0000 7fb639d9c700 1 --2- 172.21.15.72:0/2584739004 >> v2:172.21.15.146:3300/0 conn(0x7fb6340c7360 0x7fb634063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:57.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.649+0000 7fb638d9a700 1 -- 172.21.15.72:0/2584739004 >> v2:172.21.15.146:3300/0 conn(0x7fb6340c7360 msgr2=0x7fb634063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:57.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.649+0000 7fb638d9a700 1 --2- 172.21.15.72:0/2584739004 >> v2:172.21.15.146:3300/0 conn(0x7fb6340c7360 0x7fb634063120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:57.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.649+0000 7fb638d9a700 1 -- 172.21.15.72:0/2584739004 >> v1:172.21.15.146:6789/0 conn(0x7fb634154030 legacy=0x7fb6340aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:57.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.649+0000 7fb638d9a700 1 -- 172.21.15.72:0/2584739004 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6340c0f30 con 0x7fb634154410 2023-08-31T19:07:57.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.649+0000 7fb638d9a700 1 --2- 172.21.15.72:0/2584739004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb634154410 0x7fb6340c06b0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7fb6340aad30 tx=0x7fb6240090f0).ready entity=mon.0 client_cookie=16d5271e2ca24364 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.649+0000 7fb62bfff700 1 -- 172.21.15.72:0/2584739004 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62400b5a0 con 0x7fb634154410 2023-08-31T19:07:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.649+0000 7fb62bfff700 1 -- 172.21.15.72:0/2584739004 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62400b700 con 0x7fb634154410 2023-08-31T19:07:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.649+0000 7fb62bfff700 1 -- 172.21.15.72:0/2584739004 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62400baa0 con 0x7fb634154410 2023-08-31T19:07:57.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.649+0000 7fb63b7ff700 1 -- 172.21.15.72:0/2584739004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb634154410 msgr2=0x7fb6340c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:57.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.649+0000 7fb63b7ff700 1 --2- 172.21.15.72:0/2584739004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb634154410 0x7fb6340c06b0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7fb6340aad30 tx=0x7fb6240090f0).stop 2023-08-31T19:07:57.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.650+0000 7fb63b7ff700 1 -- 172.21.15.72:0/2584739004 shutdown_connections 2023-08-31T19:07:57.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.650+0000 7fb63b7ff700 1 --2- 172.21.15.72:0/2584739004 >> v2:172.21.15.146:3300/0 conn(0x7fb6340c7360 0x7fb634063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:57.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.650+0000 7fb63b7ff700 1 --2- 172.21.15.72:0/2584739004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb634154410 0x7fb6340c06b0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:57.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.650+0000 7fb63b7ff700 1 -- 172.21.15.72:0/2584739004 >> 172.21.15.72:0/2584739004 conn(0x7fb63405eb60 msgr2=0x7fb6340cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:57.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.650+0000 7fb63b7ff700 1 -- 172.21.15.72:0/2584739004 shutdown_connections 2023-08-31T19:07:57.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.650+0000 7fb63b7ff700 1 -- 172.21.15.72:0/2584739004 wait complete. 2023-08-31T19:07:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.651+0000 7fb63b7ff700 1 Processor -- start 2023-08-31T19:07:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.651+0000 7fb63b7ff700 1 -- start start 2023-08-31T19:07:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.652+0000 7fb63b7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6340c7360 0x7fb63414d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.652+0000 7fb63b7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb634154030 0x7fb634151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.652+0000 7fb63b7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb634154410 0x7fb634157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.652+0000 7fb63b7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb634156b80 con 0x7fb634154410 2023-08-31T19:07:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.652+0000 7fb63b7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb634156e60 con 0x7fb634154030 2023-08-31T19:07:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.652+0000 7fb63b7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb634157140 con 0x7fb6340c7360 2023-08-31T19:07:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb639d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb634154410 0x7fb634157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb639d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb634154410 0x7fb634157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60488/0 (socket says 172.21.15.72:60488) 2023-08-31T19:07:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb639d9c700 1 -- 172.21.15.72:0/1375835460 learned_addr learned my addr 172.21.15.72:0/1375835460 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb638d9a700 1 --2- 172.21.15.72:0/1375835460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb634154030 0x7fb634151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb63959b700 1 --2- 172.21.15.72:0/1375835460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6340c7360 0x7fb63414d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb639d9c700 1 -- 172.21.15.72:0/1375835460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6340c7360 msgr2=0x7fb63414d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb639d9c700 1 --2- 172.21.15.72:0/1375835460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6340c7360 0x7fb63414d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb639d9c700 1 -- 172.21.15.72:0/1375835460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb634154030 msgr2=0x7fb634151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb639d9c700 1 --2- 172.21.15.72:0/1375835460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb634154030 0x7fb634151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb639d9c700 1 -- 172.21.15.72:0/1375835460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624009370 con 0x7fb634154410 2023-08-31T19:07:57.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb63959b700 1 --2- 172.21.15.72:0/1375835460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6340c7360 0x7fb63414d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:07:57.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb639d9c700 1 --2- 172.21.15.72:0/1375835460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb634154410 0x7fb634157c20 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7fb62c009fa0 tx=0x7fb62c009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:57.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb6297fa700 1 -- 172.21.15.72:0/1375835460 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c00ec70 con 0x7fb634154410 2023-08-31T19:07:57.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb6297fa700 1 -- 172.21.15.72:0/1375835460 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c00edd0 con 0x7fb634154410 2023-08-31T19:07:57.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb6297fa700 1 -- 172.21.15.72:0/1375835460 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c014610 con 0x7fb634154410 2023-08-31T19:07:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.653+0000 7fb63b7ff700 1 -- 172.21.15.72:0/1375835460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb634157420 con 0x7fb634154410 2023-08-31T19:07:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.654+0000 7fb63b7ff700 1 -- 172.21.15.72:0/1375835460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63414dda0 con 0x7fb634154410 2023-08-31T19:07:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.655+0000 7fb63b7ff700 1 -- 172.21.15.72:0/1375835460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63406c6b0 con 0x7fb634154410 2023-08-31T19:07:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.656+0000 7fb6297fa700 1 -- 172.21.15.72:0/1375835460 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb62c01d3b0 con 0x7fb634154410 2023-08-31T19:07:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.657+0000 7fb6297fa700 1 --2- 172.21.15.72:0/1375835460 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb61805ef30 0x7fb6180613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.657+0000 7fb6297fa700 1 -- 172.21.15.72:0/1375835460 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6649+0+0 (secure 0 0 0) 0x7fb62c07a730 con 0x7fb634154410 2023-08-31T19:07:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.657+0000 7fb63959b700 1 --2- 172.21.15.72:0/1375835460 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb61805ef30 0x7fb6180613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.657+0000 7fb63959b700 1 --2- 172.21.15.72:0/1375835460 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb61805ef30 0x7fb6180613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb630002780 tx=0x7fb630009040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.661+0000 7fb6297fa700 1 -- 172.21.15.72:0/1375835460 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb62c04b7b0 con 0x7fb634154410 2023-08-31T19:07:57.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.872+0000 7fb63b7ff700 1 -- 172.21.15.72:0/1375835460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb6340c0c50 con 0x7fb634154410 2023-08-31T19:07:57.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.882+0000 7fb6297fa700 1 -- 172.21.15.72:0/1375835460 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v68) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb62c04edd0 con 0x7fb634154410 2023-08-31T19:07:57.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.886+0000 7fb63b7ff700 1 -- 172.21.15.72:0/1375835460 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb61805ef30 msgr2=0x7fb6180613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:57.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.886+0000 7fb63b7ff700 1 --2- 172.21.15.72:0/1375835460 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb61805ef30 0x7fb6180613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb630002780 tx=0x7fb630009040).stop 2023-08-31T19:07:57.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.886+0000 7fb63b7ff700 1 -- 172.21.15.72:0/1375835460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb634154410 msgr2=0x7fb634157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:57.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.886+0000 7fb63b7ff700 1 --2- 172.21.15.72:0/1375835460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb634154410 0x7fb634157c20 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7fb62c009fa0 tx=0x7fb62c009900).stop 2023-08-31T19:07:57.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.888+0000 7fb63b7ff700 1 -- 172.21.15.72:0/1375835460 shutdown_connections 2023-08-31T19:07:57.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.888+0000 7fb63b7ff700 1 --2- 172.21.15.72:0/1375835460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb634154410 0x7fb634157c20 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:57.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.888+0000 7fb63b7ff700 1 --2- 172.21.15.72:0/1375835460 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6340c7360 0x7fb63414d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:57.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.888+0000 7fb63b7ff700 1 --2- 172.21.15.72:0/1375835460 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb61805ef30 0x7fb6180613f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:57.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.888+0000 7fb63b7ff700 1 --2- 172.21.15.72:0/1375835460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb634154030 0x7fb634151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:57.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.888+0000 7fb63b7ff700 1 -- 172.21.15.72:0/1375835460 >> 172.21.15.72:0/1375835460 conn(0x7fb63405eb60 msgr2=0x7fb6340aa0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:57.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.893+0000 7fb63b7ff700 1 -- 172.21.15.72:0/1375835460 shutdown_connections 2023-08-31T19:07:57.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:57.894+0000 7fb63b7ff700 1 -- 172.21.15.72:0/1375835460 wait complete. 2023-08-31T19:07:57.903 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 19 and data pool 20 2023-08-31T19:07:57.923 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:07:58.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.113+0000 7fa2d43ff700 1 Processor -- start 2023-08-31T19:07:58.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.114+0000 7fa2d43ff700 1 -- start start 2023-08-31T19:07:58.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.115+0000 7fa2d43ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa2cc0c4740 0x7fa2cc157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.115+0000 7fa2d43ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa2cc1581d0 0x7fa2cc0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.115+0000 7fa2d43ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2cc063be0 con 0x7fa2cc0c6c30 2023-08-31T19:07:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.115+0000 7fa2d43ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2cc0bca10 con 0x7fa2cc0c4740 2023-08-31T19:07:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.115+0000 7fa2d43ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2cc158640 con 0x7fa2cc1581d0 2023-08-31T19:07:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.115+0000 7fa2d199a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa2cc0c4740 0x7fa2cc157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.115+0000 7fa2d199a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa2cc0c4740 0x7fa2cc157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60490/0 (socket says 172.21.15.72:60490) 2023-08-31T19:07:58.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.115+0000 7fa2d199a700 1 -- 172.21.15.72:0/1533474137 learned_addr learned my addr 172.21.15.72:0/1533474137 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:58.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.116+0000 7fa2d299c700 1 --2- 172.21.15.72:0/1533474137 >> v2:172.21.15.146:3300/0 conn(0x7fa2cc1581d0 0x7fa2cc0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.116+0000 7fa2d199a700 1 -- 172.21.15.72:0/1533474137 >> v2:172.21.15.146:3300/0 conn(0x7fa2cc1581d0 msgr2=0x7fa2cc0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:58.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.116+0000 7fa2d199a700 1 --2- 172.21.15.72:0/1533474137 >> v2:172.21.15.146:3300/0 conn(0x7fa2cc1581d0 0x7fa2cc0c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.116+0000 7fa2d199a700 1 -- 172.21.15.72:0/1533474137 >> v1:172.21.15.146:6789/0 conn(0x7fa2cc0c6c30 legacy=0x7fa2cc0bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:58.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.116+0000 7fa2d199a700 1 -- 172.21.15.72:0/1533474137 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc063010 con 0x7fa2cc0c4740 2023-08-31T19:07:58.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.116+0000 7fa2d199a700 1 --2- 172.21.15.72:0/1533474137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2cc0c4740 0x7fa2cc157ce0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fa2cc158cc0 tx=0x7fa2bc0090f0).ready entity=mon.0 client_cookie=6617ab561f8639d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:58.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.116+0000 7fa2d1199700 1 -- 172.21.15.72:0/1533474137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc00b5a0 con 0x7fa2cc0c4740 2023-08-31T19:07:58.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.116+0000 7fa2d1199700 1 -- 172.21.15.72:0/1533474137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc00b700 con 0x7fa2cc0c4740 2023-08-31T19:07:58.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.116+0000 7fa2d1199700 1 -- 172.21.15.72:0/1533474137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc00ba80 con 0x7fa2cc0c4740 2023-08-31T19:07:58.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.117+0000 7fa2d43ff700 1 -- 172.21.15.72:0/1533474137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2cc0c4740 msgr2=0x7fa2cc157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.117+0000 7fa2d43ff700 1 --2- 172.21.15.72:0/1533474137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2cc0c4740 0x7fa2cc157ce0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fa2cc158cc0 tx=0x7fa2bc0090f0).stop 2023-08-31T19:07:58.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.117+0000 7fa2d43ff700 1 -- 172.21.15.72:0/1533474137 shutdown_connections 2023-08-31T19:07:58.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.117+0000 7fa2d43ff700 1 --2- 172.21.15.72:0/1533474137 >> v2:172.21.15.146:3300/0 conn(0x7fa2cc1581d0 0x7fa2cc0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.117+0000 7fa2d43ff700 1 --2- 172.21.15.72:0/1533474137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2cc0c4740 0x7fa2cc157ce0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.117+0000 7fa2d43ff700 1 -- 172.21.15.72:0/1533474137 >> 172.21.15.72:0/1533474137 conn(0x7fa2cc0c7e70 msgr2=0x7fa2cc0c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:58.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.117+0000 7fa2d43ff700 1 -- 172.21.15.72:0/1533474137 shutdown_connections 2023-08-31T19:07:58.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.117+0000 7fa2d43ff700 1 -- 172.21.15.72:0/1533474137 wait complete. 2023-08-31T19:07:58.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.118+0000 7fa2d43ff700 1 Processor -- start 2023-08-31T19:07:58.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.118+0000 7fa2d43ff700 1 -- start start 2023-08-31T19:07:58.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.119+0000 7fa2d43ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2cc0c4740 0x7fa2cc0a9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.119+0000 7fa2d43ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2cc0c6c30 0x7fa2cc0aa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.119+0000 7fa2d43ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2cc1581d0 0x7fa2cc136cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.119+0000 7fa2d43ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc0aa820 con 0x7fa2cc0c6c30 2023-08-31T19:07:58.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.119+0000 7fa2d43ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc0ab640 con 0x7fa2cc1581d0 2023-08-31T19:07:58.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.119+0000 7fa2d43ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc0aaa30 con 0x7fa2cc0c4740 2023-08-31T19:07:58.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.120+0000 7fa2d199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2cc0c6c30 0x7fa2cc0aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.120+0000 7fa2d199a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2cc0c6c30 0x7fa2cc0aa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60492/0 (socket says 172.21.15.72:60492) 2023-08-31T19:07:58.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.120+0000 7fa2d199a700 1 -- 172.21.15.72:0/1738564760 learned_addr learned my addr 172.21.15.72:0/1738564760 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:58.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.120+0000 7fa2d219b700 1 --2- 172.21.15.72:0/1738564760 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2cc0c4740 0x7fa2cc0a9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.120+0000 7fa2d299c700 1 --2- 172.21.15.72:0/1738564760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2cc1581d0 0x7fa2cc136cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.120+0000 7fa2d199a700 1 -- 172.21.15.72:0/1738564760 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2cc0c4740 msgr2=0x7fa2cc0a9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.120+0000 7fa2d199a700 1 --2- 172.21.15.72:0/1738564760 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2cc0c4740 0x7fa2cc0a9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.120+0000 7fa2d199a700 1 -- 172.21.15.72:0/1738564760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2cc1581d0 msgr2=0x7fa2cc136cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.120+0000 7fa2d199a700 1 --2- 172.21.15.72:0/1738564760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2cc1581d0 0x7fa2cc136cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.120+0000 7fa2d199a700 1 -- 172.21.15.72:0/1738564760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc009370 con 0x7fa2cc0c6c30 2023-08-31T19:07:58.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.120+0000 7fa2d199a700 1 --2- 172.21.15.72:0/1738564760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2cc0c6c30 0x7fa2cc0aa330 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7fa2cc064200 tx=0x7fa2bc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:58.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.121+0000 7fa2c27fc700 1 -- 172.21.15.72:0/1738564760 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc00b870 con 0x7fa2cc0c6c30 2023-08-31T19:07:58.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.121+0000 7fa2c27fc700 1 -- 172.21.15.72:0/1738564760 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc00b9d0 con 0x7fa2cc0c6c30 2023-08-31T19:07:58.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.121+0000 7fa2d43ff700 1 -- 172.21.15.72:0/1738564760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2cc0aad10 con 0x7fa2cc0c6c30 2023-08-31T19:07:58.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.121+0000 7fa2c27fc700 1 -- 172.21.15.72:0/1738564760 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc01c670 con 0x7fa2cc0c6c30 2023-08-31T19:07:58.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.121+0000 7fa2d43ff700 1 -- 172.21.15.72:0/1738564760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2cc0ab2d0 con 0x7fa2cc0c6c30 2023-08-31T19:07:58.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.122+0000 7fa2d43ff700 1 -- 172.21.15.72:0/1738564760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2cc0ab7d0 con 0x7fa2cc0c6c30 2023-08-31T19:07:58.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.123+0000 7fa2c27fc700 1 -- 172.21.15.72:0/1738564760 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa2bc01c9e0 con 0x7fa2cc0c6c30 2023-08-31T19:07:58.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.124+0000 7fa2c27fc700 1 --2- 172.21.15.72:0/1738564760 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa2b005ef30 0x7fa2b00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.124+0000 7fa2c27fc700 1 -- 172.21.15.72:0/1738564760 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fa2bc07bf60 con 0x7fa2cc0c6c30 2023-08-31T19:07:58.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.124+0000 7fa2d219b700 1 --2- 172.21.15.72:0/1738564760 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa2b005ef30 0x7fa2b00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.124+0000 7fa2d219b700 1 --2- 172.21.15.72:0/1738564760 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa2b005ef30 0x7fa2b00613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa2c80038b0 tx=0x7fa2c8007d20).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:58.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.128+0000 7fa2c27fc700 1 -- 172.21.15.72:0/1738564760 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa2bc04cfa0 con 0x7fa2cc0c6c30 2023-08-31T19:07:58.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.298+0000 7fa2d43ff700 1 -- 172.21.15.72:0/1738564760 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2cc06c6b0 con 0x7fa2cc0c6c30 2023-08-31T19:07:58.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.299+0000 7fa2c27fc700 1 -- 172.21.15.72:0/1738564760 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+18004 (secure 0 0 0) 0x7fa2bc020020 con 0x7fa2cc0c6c30 2023-08-31T19:07:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:58.299 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":156,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:07:57.873365+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:07:56.316526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-31T19:07:56.862239+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:07:58.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.301+0000 7fa2d43ff700 1 -- 172.21.15.72:0/1738564760 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa2b005ef30 msgr2=0x7fa2b00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.301+0000 7fa2d43ff700 1 --2- 172.21.15.72:0/1738564760 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa2b005ef30 0x7fa2b00613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fa2c80038b0 tx=0x7fa2c8007d20).stop 2023-08-31T19:07:58.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.301+0000 7fa2d43ff700 1 -- 172.21.15.72:0/1738564760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2cc0c6c30 msgr2=0x7fa2cc0aa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.301+0000 7fa2d43ff700 1 --2- 172.21.15.72:0/1738564760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2cc0c6c30 0x7fa2cc0aa330 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7fa2cc064200 tx=0x7fa2bc015000).stop 2023-08-31T19:07:58.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.301+0000 7fa2d43ff700 1 -- 172.21.15.72:0/1738564760 shutdown_connections 2023-08-31T19:07:58.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.301+0000 7fa2d43ff700 1 --2- 172.21.15.72:0/1738564760 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa2b005ef30 0x7fa2b00613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.301+0000 7fa2d43ff700 1 --2- 172.21.15.72:0/1738564760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2cc1581d0 0x7fa2cc136cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.301+0000 7fa2d43ff700 1 --2- 172.21.15.72:0/1738564760 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2cc0c4740 0x7fa2cc0a9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.301+0000 7fa2d43ff700 1 --2- 172.21.15.72:0/1738564760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2cc0c6c30 0x7fa2cc0aa330 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.302+0000 7fa2d43ff700 1 -- 172.21.15.72:0/1738564760 >> 172.21.15.72:0/1738564760 conn(0x7fa2cc0c7e70 msgr2=0x7fa2cc0689d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:58.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.302+0000 7fa2d43ff700 1 -- 172.21.15.72:0/1738564760 shutdown_connections 2023-08-31T19:07:58.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.302+0000 7fa2d43ff700 1 -- 172.21.15.72:0/1738564760 wait complete. 2023-08-31T19:07:58.319 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:07:58.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.511+0000 7f18ea5ff700 1 Processor -- start 2023-08-31T19:07:58.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.511+0000 7f18ea5ff700 1 -- start start 2023-08-31T19:07:58.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.512+0000 7f18ea5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18e406a260 0x7f18e4069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.512+0000 7f18ea5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e4064270 con 0x7f18e4069170 2023-08-31T19:07:58.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.512+0000 7f18ea5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e40bcc20 con 0x7f18e4065710 2023-08-31T19:07:58.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.512+0000 7f18ea5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e40bca40 con 0x7f18e406a260 2023-08-31T19:07:58.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.513+0000 7f18e3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f18e4069170 0x7f18e40c2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52796/0 (socket says 172.21.15.72:52796) 2023-08-31T19:07:58.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.513+0000 7f18e3fff700 1 -- 172.21.15.72:0/4218847937 learned_addr learned my addr 172.21.15.72:0/4218847937 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:58.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.513+0000 7f18e37fe700 1 --2- 172.21.15.72:0/4218847937 >> v2:172.21.15.146:3300/0 conn(0x7f18e406a260 0x7f18e4069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.513+0000 7f18e2ffd700 1 -- 172.21.15.72:0/4218847937 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838421320 0 0) 0x7f18e4064270 con 0x7f18e4069170 2023-08-31T19:07:58.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.513+0000 7f18e2ffd700 1 -- 172.21.15.72:0/4218847937 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18cc0033f0 con 0x7f18e4069170 2023-08-31T19:07:58.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.513+0000 7f18e2ffd700 1 -- 172.21.15.72:0/4218847937 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3116575859 0 0) 0x7f18cc0033f0 con 0x7f18e4069170 2023-08-31T19:07:58.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.513+0000 7f18e2ffd700 1 -- 172.21.15.72:0/4218847937 >> v2:172.21.15.146:3300/0 conn(0x7f18e406a260 msgr2=0x7f18e4069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:58.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.513+0000 7f18e2ffd700 1 --2- 172.21.15.72:0/4218847937 >> v2:172.21.15.146:3300/0 conn(0x7f18e406a260 0x7f18e4069550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.513+0000 7f18e2ffd700 1 -- 172.21.15.72:0/4218847937 >> v1:172.21.15.146:6789/0 conn(0x7f18e4065710 legacy=0x7f18e4069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.513+0000 7f18e2ffd700 1 -- 172.21.15.72:0/4218847937 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e4154890 con 0x7f18e4069170 2023-08-31T19:07:58.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.513+0000 7f18e2ffd700 1 -- 172.21.15.72:0/4218847937 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f18d4001470 con 0x7f18e4069170 2023-08-31T19:07:58.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e2ffd700 1 -- 172.21.15.72:0/4218847937 >> v1:172.21.15.72:6789/0 conn(0x7f18e4069170 legacy=0x7f18e40c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e2ffd700 1 --2- 172.21.15.72:0/4218847937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18cc0038e0 0x7f18cc003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e2ffd700 1 --2- 172.21.15.72:0/4218847937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18cc004690 0x7f18cc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e2ffd700 1 --2- 172.21.15.72:0/4218847937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18cc005000 0x7f18cc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e2ffd700 1 -- 172.21.15.72:0/4218847937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e40bca40 con 0x7f18cc004690 2023-08-31T19:07:58.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e2ffd700 1 -- 172.21.15.72:0/4218847937 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc00bf60 con 0x7f18cc0038e0 2023-08-31T19:07:58.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e2ffd700 1 -- 172.21.15.72:0/4218847937 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc00c120 con 0x7f18cc005000 2023-08-31T19:07:58.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e37fe700 1 --2- 172.21.15.72:0/4218847937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18cc004690 0x7f18cc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e3fff700 1 --2- 172.21.15.72:0/4218847937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18cc0038e0 0x7f18cc003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e8b9c700 1 --2- 172.21.15.72:0/4218847937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18cc005000 0x7f18cc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e37fe700 1 -- 172.21.15.72:0/4218847937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18cc005000 msgr2=0x7f18cc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:58.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e37fe700 1 --2- 172.21.15.72:0/4218847937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18cc005000 0x7f18cc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e37fe700 1 -- 172.21.15.72:0/4218847937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18cc0038e0 msgr2=0x7f18cc003d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:07:58.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e37fe700 1 --2- 172.21.15.72:0/4218847937 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18cc0038e0 0x7f18cc003d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e37fe700 1 -- 172.21.15.72:0/4218847937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc0033f0 con 0x7f18cc004690 2023-08-31T19:07:58.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e8b9c700 1 --2- 172.21.15.72:0/4218847937 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18cc005000 0x7f18cc00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:58.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e8b9c700 1 -- 172.21.15.72:0/4218847937 reap_dead start 2023-08-31T19:07:58.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.514+0000 7f18e37fe700 1 --2- 172.21.15.72:0/4218847937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18cc004690 0x7f18cc004b10 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f18e406a6c0 tx=0x7f18d8009060).ready entity=mon.0 client_cookie=2945860e01b297ae server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:58.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.515+0000 7f18e2ffd700 1 -- 172.21.15.72:0/4218847937 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8009e90 con 0x7f18cc004690 2023-08-31T19:07:58.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.515+0000 7f18e2ffd700 1 -- 172.21.15.72:0/4218847937 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d8009430 con 0x7f18cc004690 2023-08-31T19:07:58.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.515+0000 7f18e2ffd700 1 -- 172.21.15.72:0/4218847937 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800e850 con 0x7f18cc004690 2023-08-31T19:07:58.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.515+0000 7f18ea5ff700 1 -- 172.21.15.72:0/4218847937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18cc004690 msgr2=0x7f18cc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.515+0000 7f18ea5ff700 1 --2- 172.21.15.72:0/4218847937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18cc004690 0x7f18cc004b10 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f18e406a6c0 tx=0x7f18d8009060).stop 2023-08-31T19:07:58.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.515+0000 7f18ea5ff700 1 -- 172.21.15.72:0/4218847937 shutdown_connections 2023-08-31T19:07:58.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.515+0000 7f18ea5ff700 1 --2- 172.21.15.72:0/4218847937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18cc004690 0x7f18cc004b10 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.515+0000 7f18ea5ff700 1 -- 172.21.15.72:0/4218847937 >> 172.21.15.72:0/4218847937 conn(0x7f18e40c6b10 msgr2=0x7f18e40c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:58.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.515+0000 7f18ea5ff700 1 -- 172.21.15.72:0/4218847937 shutdown_connections 2023-08-31T19:07:58.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.515+0000 7f18ea5ff700 1 -- 172.21.15.72:0/4218847937 wait complete. 2023-08-31T19:07:58.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.517+0000 7f18ea5ff700 1 Processor -- start 2023-08-31T19:07:58.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.517+0000 7f18ea5ff700 1 -- start start 2023-08-31T19:07:58.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18ea5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18cc004690 0x7f18e41503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18ea5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e40a92e0 0x7f18e40bf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18ea5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e4167c70 0x7f18e41680f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18ea5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e4151cb0 con 0x7f18e4167c70 2023-08-31T19:07:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18ea5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e41685e0 con 0x7f18cc004690 2023-08-31T19:07:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18ea5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e40bf930 con 0x7f18e40a92e0 2023-08-31T19:07:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18e8b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e4167c70 0x7f18e41680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18e8b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e4167c70 0x7f18e41680f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60514/0 (socket says 172.21.15.72:60514) 2023-08-31T19:07:58.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18e8b9c700 1 -- 172.21.15.72:0/1516799827 learned_addr learned my addr 172.21.15.72:0/1516799827 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:58.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18e3fff700 1 --2- 172.21.15.72:0/1516799827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18cc004690 0x7f18e41503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18e8b9c700 1 -- 172.21.15.72:0/1516799827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e40a92e0 msgr2=0x7f18e40bf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18e8b9c700 1 --2- 172.21.15.72:0/1516799827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e40a92e0 0x7f18e40bf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:58.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18e8b9c700 1 -- 172.21.15.72:0/1516799827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18cc004690 msgr2=0x7f18e41503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18e8b9c700 1 --2- 172.21.15.72:0/1516799827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18cc004690 0x7f18e41503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18e8b9c700 1 -- 172.21.15.72:0/1516799827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e40bfbf0 con 0x7f18e4167c70 2023-08-31T19:07:58.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.518+0000 7f18e3fff700 1 --2- 172.21.15.72:0/1516799827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18cc004690 0x7f18e41503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:07:58.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.519+0000 7f18e8b9c700 1 --2- 172.21.15.72:0/1516799827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e4167c70 0x7f18e41680f0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f18e4066270 tx=0x7f18dc009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:58.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.519+0000 7f18cbfff700 1 -- 172.21.15.72:0/1516799827 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc002490 con 0x7f18e4167c70 2023-08-31T19:07:58.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.519+0000 7f18cbfff700 1 -- 172.21.15.72:0/1516799827 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc0025f0 con 0x7f18e4167c70 2023-08-31T19:07:58.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.519+0000 7f18cbfff700 1 -- 172.21.15.72:0/1516799827 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc002970 con 0x7f18e4167c70 2023-08-31T19:07:58.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.519+0000 7f18ea5ff700 1 -- 172.21.15.72:0/1516799827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e40bfed0 con 0x7f18e4167c70 2023-08-31T19:07:58.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.519+0000 7f18ea5ff700 1 -- 172.21.15.72:0/1516799827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e4151f10 con 0x7f18e4167c70 2023-08-31T19:07:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.520+0000 7f18ea5ff700 1 -- 172.21.15.72:0/1516799827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e40c03d0 con 0x7f18e4167c70 2023-08-31T19:07:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.521+0000 7f18cbfff700 1 -- 172.21.15.72:0/1516799827 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f18dc003030 con 0x7f18e4167c70 2023-08-31T19:07:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.522+0000 7f18cbfff700 1 --2- 172.21.15.72:0/1516799827 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f18d005ef60 0x7f18d0061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.522+0000 7f18cbfff700 1 -- 172.21.15.72:0/1516799827 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f18dc079b90 con 0x7f18e4167c70 2023-08-31T19:07:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.522+0000 7f18e3fff700 1 --2- 172.21.15.72:0/1516799827 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f18d005ef60 0x7f18d0061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.522+0000 7f18e3fff700 1 --2- 172.21.15.72:0/1516799827 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f18d005ef60 0x7f18d0061420 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f18d4000e10 tx=0x7f18d4009040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:58.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.526+0000 7f18cbfff700 1 -- 172.21.15.72:0/1516799827 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f18dc0488f0 con 0x7f18e4167c70 2023-08-31T19:07:58.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.701+0000 7f18ea5ff700 1 -- 172.21.15.72:0/1516799827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18e4069ca0 con 0x7f18e4167c70 2023-08-31T19:07:58.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.702+0000 7f18cbfff700 1 -- 172.21.15.72:0/1516799827 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+18004 (secure 0 0 0) 0x7f18dc04ab50 con 0x7f18e4167c70 2023-08-31T19:07:58.701 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:07:58.702 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":156,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:07:57.873365+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:07:56.316526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-31T19:07:56.862239+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:07:58.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.704+0000 7f18ea5ff700 1 -- 172.21.15.72:0/1516799827 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f18d005ef60 msgr2=0x7f18d0061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.704+0000 7f18ea5ff700 1 --2- 172.21.15.72:0/1516799827 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f18d005ef60 0x7f18d0061420 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f18d4000e10 tx=0x7f18d4009040).stop 2023-08-31T19:07:58.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.704+0000 7f18ea5ff700 1 -- 172.21.15.72:0/1516799827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e4167c70 msgr2=0x7f18e41680f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.704+0000 7f18ea5ff700 1 --2- 172.21.15.72:0/1516799827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e4167c70 0x7f18e41680f0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f18e4066270 tx=0x7f18dc009040).stop 2023-08-31T19:07:58.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.704+0000 7f18ea5ff700 1 -- 172.21.15.72:0/1516799827 shutdown_connections 2023-08-31T19:07:58.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.704+0000 7f18ea5ff700 1 --2- 172.21.15.72:0/1516799827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e4167c70 0x7f18e41680f0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.704+0000 7f18ea5ff700 1 --2- 172.21.15.72:0/1516799827 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f18d005ef60 0x7f18d0061420 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.704+0000 7f18ea5ff700 1 --2- 172.21.15.72:0/1516799827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18cc004690 0x7f18e41503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.704+0000 7f18ea5ff700 1 --2- 172.21.15.72:0/1516799827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f18e40a92e0 0x7f18e40bf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:07:58.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.704+0000 7f18ea5ff700 1 -- 172.21.15.72:0/1516799827 >> 172.21.15.72:0/1516799827 conn(0x7f18e40c6b10 msgr2=0x7f18e40c26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:58.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.704+0000 7f18ea5ff700 1 -- 172.21.15.72:0/1516799827 shutdown_connections 2023-08-31T19:07:58.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.704+0000 7f18ea5ff700 1 -- 172.21.15.72:0/1516799827 wait complete. 2023-08-31T19:07:58.721 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T19:07:58.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.914+0000 7fa5177ff700 1 Processor -- start 2023-08-31T19:07:58.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.914+0000 7fa5177ff700 1 -- start start 2023-08-31T19:07:58.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.915+0000 7fa5177ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa510063980 0x7fa510154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.915+0000 7fa5177ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa510158a90 con 0x7fa510153e20 2023-08-31T19:07:58.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.915+0000 7fa5177ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa510157e80 con 0x7fa5100a9d40 2023-08-31T19:07:58.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.915+0000 7fa5177ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa510157c70 con 0x7fa510063980 2023-08-31T19:07:58.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.916+0000 7fa514d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa510063980 0x7fa510154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.916+0000 7fa51559b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa510153e20 0x7fa510063270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52802/0 (socket says 172.21.15.72:52802) 2023-08-31T19:07:58.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.916+0000 7fa51559b700 1 -- 172.21.15.72:0/871217913 learned_addr learned my addr 172.21.15.72:0/871217913 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:07:58.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.916+0000 7fa514d9a700 1 -- 172.21.15.72:0/871217913 >> v1:172.21.15.146:6789/0 conn(0x7fa5100a9d40 legacy=0x7fa5100c0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.916+0000 7fa514d9a700 1 -- 172.21.15.72:0/871217913 >> v1:172.21.15.72:6789/0 conn(0x7fa510153e20 legacy=0x7fa510063270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.916+0000 7fa514d9a700 1 -- 172.21.15.72:0/871217913 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa510158160 con 0x7fa510063980 2023-08-31T19:07:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.916+0000 7fa507fff700 1 -- 172.21.15.72:0/871217913 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147915184 0 0) 0x7fa510158a90 con 0x7fa510153e20 2023-08-31T19:07:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.916+0000 7fa514d9a700 1 --2- 172.21.15.72:0/871217913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa510063980 0x7fa510154200 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7fa500009760 tx=0x7fa500009060).ready entity=mon.0 client_cookie=10725c95466f963d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.917+0000 7fa507fff700 1 -- 172.21.15.72:0/871217913 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50000b580 con 0x7fa510063980 2023-08-31T19:07:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.917+0000 7fa507fff700 1 -- 172.21.15.72:0/871217913 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50000b6e0 con 0x7fa510063980 2023-08-31T19:07:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.917+0000 7fa507fff700 1 -- 172.21.15.72:0/871217913 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50000ba60 con 0x7fa510063980 2023-08-31T19:07:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.917+0000 7fa5177ff700 1 -- 172.21.15.72:0/871217913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa510063980 msgr2=0x7fa510154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.917+0000 7fa5177ff700 1 --2- 172.21.15.72:0/871217913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa510063980 0x7fa510154200 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7fa500009760 tx=0x7fa500009060).stop 2023-08-31T19:07:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.917+0000 7fa5177ff700 1 -- 172.21.15.72:0/871217913 shutdown_connections 2023-08-31T19:07:58.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.917+0000 7fa5177ff700 1 --2- 172.21.15.72:0/871217913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa510063980 0x7fa510154200 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.917+0000 7fa5177ff700 1 -- 172.21.15.72:0/871217913 >> 172.21.15.72:0/871217913 conn(0x7fa51005eb60 msgr2=0x7fa5100cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:58.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.917+0000 7fa5177ff700 1 -- 172.21.15.72:0/871217913 shutdown_connections 2023-08-31T19:07:58.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.917+0000 7fa5177ff700 1 -- 172.21.15.72:0/871217913 wait complete. 2023-08-31T19:07:58.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.919+0000 7fa5177ff700 1 Processor -- start 2023-08-31T19:07:58.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.919+0000 7fa5177ff700 1 -- start start 2023-08-31T19:07:58.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa5177ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa510063980 0x7fa5100c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa5177ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5100a9d40 0x7fa5100ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa5177ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa510153e20 0x7fa5100ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa5177ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100cad30 con 0x7fa5100a9d40 2023-08-31T19:07:58.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa5177ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100b0c40 con 0x7fa510063980 2023-08-31T19:07:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa5177ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5100b0680 con 0x7fa510153e20 2023-08-31T19:07:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa514d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5100a9d40 0x7fa5100ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa514d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5100a9d40 0x7fa5100ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60532/0 (socket says 172.21.15.72:60532) 2023-08-31T19:07:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa514d9a700 1 -- 172.21.15.72:0/115967403 learned_addr learned my addr 172.21.15.72:0/115967403 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:07:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa51559b700 1 --2- 172.21.15.72:0/115967403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa510063980 0x7fa5100c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa515d9c700 1 --2- 172.21.15.72:0/115967403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa510153e20 0x7fa5100ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa514d9a700 1 -- 172.21.15.72:0/115967403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa510153e20 msgr2=0x7fa5100ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa514d9a700 1 --2- 172.21.15.72:0/115967403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa510153e20 0x7fa5100ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa514d9a700 1 -- 172.21.15.72:0/115967403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa510063980 msgr2=0x7fa5100c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa514d9a700 1 --2- 172.21.15.72:0/115967403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa510063980 0x7fa5100c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.920+0000 7fa514d9a700 1 -- 172.21.15.72:0/115967403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5000092a0 con 0x7fa5100a9d40 2023-08-31T19:07:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.921+0000 7fa514d9a700 1 --2- 172.21.15.72:0/115967403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5100a9d40 0x7fa5100ca350 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fa5100c56d0 tx=0x7fa500017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.921+0000 7fa5057fa700 1 -- 172.21.15.72:0/115967403 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50000ba60 con 0x7fa5100a9d40 2023-08-31T19:07:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.921+0000 7fa5057fa700 1 -- 172.21.15.72:0/115967403 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa500000c90 con 0x7fa5100a9d40 2023-08-31T19:07:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.921+0000 7fa5177ff700 1 -- 172.21.15.72:0/115967403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5100b0960 con 0x7fa5100a9d40 2023-08-31T19:07:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.921+0000 7fa5057fa700 1 -- 172.21.15.72:0/115967403 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50001b640 con 0x7fa5100a9d40 2023-08-31T19:07:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.921+0000 7fa5177ff700 1 -- 172.21.15.72:0/115967403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5100c2890 con 0x7fa5100a9d40 2023-08-31T19:07:58.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.922+0000 7fa5177ff700 1 -- 172.21.15.72:0/115967403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa510063ea0 con 0x7fa5100a9d40 2023-08-31T19:07:58.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.923+0000 7fa5057fa700 1 -- 172.21.15.72:0/115967403 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa50001ba30 con 0x7fa5100a9d40 2023-08-31T19:07:58.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.924+0000 7fa5057fa700 1 --2- 172.21.15.72:0/115967403 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa4f405ef30 0x7fa4f40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:07:58.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.924+0000 7fa5057fa700 1 -- 172.21.15.72:0/115967403 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fa50007bf00 con 0x7fa5100a9d40 2023-08-31T19:07:58.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.925+0000 7fa51559b700 1 --2- 172.21.15.72:0/115967403 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa4f405ef30 0x7fa4f40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:07:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.925+0000 7fa51559b700 1 --2- 172.21.15.72:0/115967403 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa4f405ef30 0x7fa4f40613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa50c000c00 tx=0x7fa50c009040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:07:58.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:58.929+0000 7fa5057fa700 1 -- 172.21.15.72:0/115967403 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa50004cec0 con 0x7fa5100a9d40 2023-08-31T19:07:59.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:59.137+0000 7fa5177ff700 1 -- 172.21.15.72:0/115967403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa5100c2ab0 con 0x7fa5100a9d40 2023-08-31T19:07:59.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:59.884+0000 7fa5057fa700 1 -- 172.21.15.72:0/115967403 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v70) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa5000504e0 con 0x7fa5100a9d40 2023-08-31T19:07:59.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:59.887+0000 7fa5177ff700 1 -- 172.21.15.72:0/115967403 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa4f405ef30 msgr2=0x7fa4f40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:59.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:59.887+0000 7fa5177ff700 1 --2- 172.21.15.72:0/115967403 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa4f405ef30 0x7fa4f40613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa50c000c00 tx=0x7fa50c009040).stop 2023-08-31T19:07:59.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:59.887+0000 7fa5177ff700 1 -- 172.21.15.72:0/115967403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5100a9d40 msgr2=0x7fa5100ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:07:59.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:59.887+0000 7fa5177ff700 1 --2- 172.21.15.72:0/115967403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5100a9d40 0x7fa5100ca350 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fa5100c56d0 tx=0x7fa500017000).stop 2023-08-31T19:07:59.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:59.887+0000 7fa5177ff700 1 -- 172.21.15.72:0/115967403 shutdown_connections 2023-08-31T19:07:59.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:59.887+0000 7fa5177ff700 1 --2- 172.21.15.72:0/115967403 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa510153e20 0x7fa5100ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:59.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:59.887+0000 7fa5177ff700 1 --2- 172.21.15.72:0/115967403 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fa4f405ef30 0x7fa4f40613f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:59.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:59.887+0000 7fa5177ff700 1 --2- 172.21.15.72:0/115967403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa510063980 0x7fa5100c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:59.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:59.887+0000 7fa5177ff700 1 --2- 172.21.15.72:0/115967403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5100a9d40 0x7fa5100ca350 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:07:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:59.887+0000 7fa5177ff700 1 -- 172.21.15.72:0/115967403 >> 172.21.15.72:0/115967403 conn(0x7fa51005eb60 msgr2=0x7fa5100c95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:07:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:59.887+0000 7fa5177ff700 1 -- 172.21.15.72:0/115967403 shutdown_connections 2023-08-31T19:07:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:07:59.887+0000 7fa5177ff700 1 -- 172.21.15.72:0/115967403 wait complete. 2023-08-31T19:07:59.908 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-31T19:07:59.908 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T19:08:00.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.103+0000 7f33d8dff700 1 Processor -- start 2023-08-31T19:08:00.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.104+0000 7f33d8dff700 1 -- start start 2023-08-31T19:08:00.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.105+0000 7f33d8dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4068ba0 0x7f33d415d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:00.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.105+0000 7f33d8dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d40a9660 con 0x7f33d41524c0 2023-08-31T19:08:00.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.105+0000 7f33d8dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d4064340 con 0x7f33d41520e0 2023-08-31T19:08:00.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.105+0000 7f33d8dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d40bcd00 con 0x7f33d4068ba0 2023-08-31T19:08:00.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.105+0000 7f33d1d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f33d41524c0 0x7f33d4068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52806/0 (socket says 172.21.15.72:52806) 2023-08-31T19:08:00.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.105+0000 7f33d1d9b700 1 -- 172.21.15.72:0/1921530009 learned_addr learned my addr 172.21.15.72:0/1921530009 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:08:00.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d2d9d700 1 --2- 172.21.15.72:0/1921530009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4068ba0 0x7f33d415d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d159a700 1 -- 172.21.15.72:0/1921530009 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226507221 0 0) 0x7f33d40a9660 con 0x7f33d41524c0 2023-08-31T19:08:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d159a700 1 -- 172.21.15.72:0/1921530009 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33bc0033f0 con 0x7f33d41524c0 2023-08-31T19:08:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d159a700 1 -- 172.21.15.72:0/1921530009 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3543012253 0 0) 0x7f33bc0033f0 con 0x7f33d41524c0 2023-08-31T19:08:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d159a700 1 -- 172.21.15.72:0/1921530009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4068ba0 msgr2=0x7f33d415d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d159a700 1 --2- 172.21.15.72:0/1921530009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4068ba0 0x7f33d415d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d159a700 1 -- 172.21.15.72:0/1921530009 >> v1:172.21.15.146:6789/0 conn(0x7f33d41520e0 legacy=0x7f33d40a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d159a700 1 -- 172.21.15.72:0/1921530009 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d40bcfe0 con 0x7f33d41524c0 2023-08-31T19:08:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d159a700 1 -- 172.21.15.72:0/1921530009 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f33c8001470 con 0x7f33d41524c0 2023-08-31T19:08:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d159a700 1 -- 172.21.15.72:0/1921530009 >> v1:172.21.15.72:6789/0 conn(0x7f33d41524c0 legacy=0x7f33d4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d159a700 1 --2- 172.21.15.72:0/1921530009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc003910 0x7f33bc003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:00.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d159a700 1 --2- 172.21.15.72:0/1921530009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33bc004690 0x7f33bc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:00.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d159a700 1 --2- 172.21.15.72:0/1921530009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4068ba0 0x7f33bc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:00.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d159a700 1 -- 172.21.15.72:0/1921530009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d40bcd00 con 0x7f33bc004690 2023-08-31T19:08:00.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d159a700 1 -- 172.21.15.72:0/1921530009 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc00b8e0 con 0x7f33bc003910 2023-08-31T19:08:00.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d159a700 1 -- 172.21.15.72:0/1921530009 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc00ba50 con 0x7f33d4068ba0 2023-08-31T19:08:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.106+0000 7f33d1d9b700 1 --2- 172.21.15.72:0/1921530009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33bc004690 0x7f33bc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.107+0000 7f33d2d9d700 1 --2- 172.21.15.72:0/1921530009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4068ba0 0x7f33bc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.107+0000 7f33d259c700 1 --2- 172.21.15.72:0/1921530009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc003910 0x7f33bc003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.107+0000 7f33d1d9b700 1 -- 172.21.15.72:0/1921530009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4068ba0 msgr2=0x7f33bc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.107+0000 7f33d1d9b700 1 --2- 172.21.15.72:0/1921530009 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4068ba0 0x7f33bc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.107+0000 7f33d1d9b700 1 -- 172.21.15.72:0/1921530009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc003910 msgr2=0x7f33bc003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.107+0000 7f33d1d9b700 1 --2- 172.21.15.72:0/1921530009 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc003910 0x7f33bc003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.107+0000 7f33d1d9b700 1 -- 172.21.15.72:0/1921530009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc0033f0 con 0x7f33bc004690 2023-08-31T19:08:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.107+0000 7f33d1d9b700 1 --2- 172.21.15.72:0/1921530009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33bc004690 0x7f33bc004b10 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f33d41528f0 tx=0x7f33d40bbe30).ready entity=mon.0 client_cookie=1cca1c943f0c9f9c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.107+0000 7f33d159a700 1 -- 172.21.15.72:0/1921530009 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c8007a60 con 0x7f33bc004690 2023-08-31T19:08:00.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.107+0000 7f33d159a700 1 -- 172.21.15.72:0/1921530009 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c800c9f0 con 0x7f33bc004690 2023-08-31T19:08:00.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.107+0000 7f33d159a700 1 -- 172.21.15.72:0/1921530009 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c800cdb0 con 0x7f33bc004690 2023-08-31T19:08:00.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.108+0000 7f33d8dff700 1 -- 172.21.15.72:0/1921530009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33bc004690 msgr2=0x7f33bc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:00.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.108+0000 7f33d8dff700 1 --2- 172.21.15.72:0/1921530009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33bc004690 0x7f33bc004b10 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f33d41528f0 tx=0x7f33d40bbe30).stop 2023-08-31T19:08:00.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.108+0000 7f33d2d9d700 1 -- 172.21.15.72:0/1921530009 reap_dead start 2023-08-31T19:08:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.108+0000 7f33d8dff700 1 -- 172.21.15.72:0/1921530009 shutdown_connections 2023-08-31T19:08:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.108+0000 7f33d8dff700 1 -- 172.21.15.72:0/1921530009 >> 172.21.15.72:0/1921530009 conn(0x7f33d40630c0 msgr2=0x7f33d40c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.108+0000 7f33d8dff700 1 -- 172.21.15.72:0/1921530009 shutdown_connections 2023-08-31T19:08:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.108+0000 7f33d8dff700 1 -- 172.21.15.72:0/1921530009 wait complete. 2023-08-31T19:08:00.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.109+0000 7f33d8dff700 1 Processor -- start 2023-08-31T19:08:00.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.109+0000 7f33d8dff700 1 -- start start 2023-08-31T19:08:00.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.110+0000 7f33d8dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc004690 0x7f33d40ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:00.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.110+0000 7f33d8dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d4148930 0x7f33d4065070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:00.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.110+0000 7f33d8dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4065560 0x7f33d40a9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:00.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.110+0000 7f33d8dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d40ab9e0 con 0x7f33d4148930 2023-08-31T19:08:00.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.110+0000 7f33d8dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d40beb90 con 0x7f33bc004690 2023-08-31T19:08:00.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.110+0000 7f33d8dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d40659e0 con 0x7f33d4065560 2023-08-31T19:08:00.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.111+0000 7f33d1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d4148930 0x7f33d4065070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:00.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.111+0000 7f33d1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d4148930 0x7f33d4065070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60550/0 (socket says 172.21.15.72:60550) 2023-08-31T19:08:00.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.111+0000 7f33d1d9b700 1 -- 172.21.15.72:0/52051074 learned_addr learned my addr 172.21.15.72:0/52051074 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:00.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.111+0000 7f33d259c700 1 --2- 172.21.15.72:0/52051074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc004690 0x7f33d40ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:00.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.111+0000 7f33d2d9d700 1 --2- 172.21.15.72:0/52051074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4065560 0x7f33d40a9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:00.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.111+0000 7f33d1d9b700 1 -- 172.21.15.72:0/52051074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4065560 msgr2=0x7f33d40a9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:00.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.111+0000 7f33d1d9b700 1 --2- 172.21.15.72:0/52051074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4065560 0x7f33d40a9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:00.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.111+0000 7f33d1d9b700 1 -- 172.21.15.72:0/52051074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc004690 msgr2=0x7f33d40ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:00.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.111+0000 7f33d1d9b700 1 --2- 172.21.15.72:0/52051074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc004690 0x7f33d40ab4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:00.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.111+0000 7f33d1d9b700 1 -- 172.21.15.72:0/52051074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d40bdf80 con 0x7f33d4148930 2023-08-31T19:08:00.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.111+0000 7f33d1d9b700 1 --2- 172.21.15.72:0/52051074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d4148930 0x7f33d4065070 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f33d40c1090 tx=0x7f33c8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:00.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.112+0000 7f33c27fc700 1 -- 172.21.15.72:0/52051074 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c8001430 con 0x7f33d4148930 2023-08-31T19:08:00.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.112+0000 7f33c27fc700 1 -- 172.21.15.72:0/52051074 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c8001650 con 0x7f33d4148930 2023-08-31T19:08:00.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.112+0000 7f33c27fc700 1 -- 172.21.15.72:0/52051074 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c80048c0 con 0x7f33d4148930 2023-08-31T19:08:00.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.112+0000 7f33d8dff700 1 -- 172.21.15.72:0/52051074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d40be260 con 0x7f33d4148930 2023-08-31T19:08:00.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.112+0000 7f33d8dff700 1 -- 172.21.15.72:0/52051074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d40be820 con 0x7f33d4148930 2023-08-31T19:08:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.113+0000 7f33d8dff700 1 -- 172.21.15.72:0/52051074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d40be9e0 con 0x7f33d4148930 2023-08-31T19:08:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.113+0000 7f33c27fc700 1 -- 172.21.15.72:0/52051074 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f33c8004c30 con 0x7f33d4148930 2023-08-31T19:08:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.114+0000 7f33c27fc700 1 --2- 172.21.15.72:0/52051074 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f33b405ef30 0x7f33b40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.114+0000 7f33c27fc700 1 -- 172.21.15.72:0/52051074 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f33c807ad60 con 0x7f33d4148930 2023-08-31T19:08:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.114+0000 7f33d259c700 1 --2- 172.21.15.72:0/52051074 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f33b405ef30 0x7f33b40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:00.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.115+0000 7f33d259c700 1 --2- 172.21.15.72:0/52051074 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f33b405ef30 0x7f33b40613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f33c40010e0 tx=0x7f33c4007b90).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:00.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.118+0000 7f33c27fc700 1 -- 172.21.15.72:0/52051074 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f33c804bd20 con 0x7f33d4148930 2023-08-31T19:08:00.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.330+0000 7f33d8dff700 1 -- 172.21.15.72:0/52051074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f33d406c6b0 con 0x7f33d4148930 2023-08-31T19:08:00.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.885+0000 7f33c27fc700 1 -- 172.21.15.72:0/52051074 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v71) v1 ==== 122+0+0 (secure 0 0 0) 0x7f33c801a0c0 con 0x7f33d4148930 2023-08-31T19:08:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.888+0000 7f33d8dff700 1 -- 172.21.15.72:0/52051074 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f33b405ef30 msgr2=0x7f33b40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.888+0000 7f33d8dff700 1 --2- 172.21.15.72:0/52051074 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f33b405ef30 0x7f33b40613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f33c40010e0 tx=0x7f33c4007b90).stop 2023-08-31T19:08:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.888+0000 7f33d8dff700 1 -- 172.21.15.72:0/52051074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d4148930 msgr2=0x7f33d4065070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.888+0000 7f33d8dff700 1 --2- 172.21.15.72:0/52051074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d4148930 0x7f33d4065070 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f33d40c1090 tx=0x7f33c8015000).stop 2023-08-31T19:08:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.888+0000 7f33d8dff700 1 -- 172.21.15.72:0/52051074 shutdown_connections 2023-08-31T19:08:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.888+0000 7f33d8dff700 1 --2- 172.21.15.72:0/52051074 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f33d4065560 0x7f33d40a9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:00.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.888+0000 7f33d8dff700 1 --2- 172.21.15.72:0/52051074 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f33b405ef30 0x7f33b40613f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:00.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.888+0000 7f33d8dff700 1 --2- 172.21.15.72:0/52051074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33bc004690 0x7f33d40ab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:00.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.888+0000 7f33d8dff700 1 --2- 172.21.15.72:0/52051074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d4148930 0x7f33d4065070 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:00.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.888+0000 7f33d8dff700 1 -- 172.21.15.72:0/52051074 >> 172.21.15.72:0/52051074 conn(0x7f33d40630c0 msgr2=0x7f33d414baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:00.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.888+0000 7f33d8dff700 1 -- 172.21.15.72:0/52051074 shutdown_connections 2023-08-31T19:08:00.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:00.888+0000 7f33d8dff700 1 -- 172.21.15.72:0/52051074 wait complete. 2023-08-31T19:08:00.906 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T19:08:00.907 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:08:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.096+0000 7f9d17bff700 1 Processor -- start 2023-08-31T19:08:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.096+0000 7f9d17bff700 1 -- start start 2023-08-31T19:08:01.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.098+0000 7f9d17bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d100cb9b0 0x7f9d101583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.098+0000 7f9d17bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9d101588d0 0x7f9d10154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.098+0000 7f9d17bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d100c6120 con 0x7f9d10154060 2023-08-31T19:08:01.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.098+0000 7f9d17bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d100c1380 con 0x7f9d100cb9b0 2023-08-31T19:08:01.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.098+0000 7f9d17bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d100c5e10 con 0x7f9d101588d0 2023-08-31T19:08:01.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.098+0000 7f9d1519a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d100cb9b0 0x7f9d101583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.098+0000 7f9d1519a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d100cb9b0 0x7f9d101583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60552/0 (socket says 172.21.15.72:60552) 2023-08-31T19:08:01.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.098+0000 7f9d1519a700 1 -- 172.21.15.72:0/1416452007 learned_addr learned my addr 172.21.15.72:0/1416452007 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:01.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.098+0000 7f9d1619c700 1 --2- 172.21.15.72:0/1416452007 >> v2:172.21.15.146:3300/0 conn(0x7f9d101588d0 0x7f9d10154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.098+0000 7f9d1519a700 1 -- 172.21.15.72:0/1416452007 >> v2:172.21.15.146:3300/0 conn(0x7f9d101588d0 msgr2=0x7f9d10154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:01.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.098+0000 7f9d1519a700 1 --2- 172.21.15.72:0/1416452007 >> v2:172.21.15.146:3300/0 conn(0x7f9d101588d0 0x7f9d10154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.098+0000 7f9d1519a700 1 -- 172.21.15.72:0/1416452007 >> v1:172.21.15.146:6789/0 conn(0x7f9d10154060 legacy=0x7f9d10157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.098+0000 7f9d1519a700 1 -- 172.21.15.72:0/1416452007 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d100c0ae0 con 0x7f9d100cb9b0 2023-08-31T19:08:01.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.099+0000 7f9d1619c700 1 --2- 172.21.15.72:0/1416452007 >> v2:172.21.15.146:3300/0 conn(0x7f9d101588d0 0x7f9d10154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:08:01.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.099+0000 7f9d1519a700 1 --2- 172.21.15.72:0/1416452007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d100cb9b0 0x7f9d101583e0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f9d100844d0 tx=0x7f9d000090f0).ready entity=mon.0 client_cookie=4b98d66e0fe999f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:01.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.099+0000 7f9d14999700 1 -- 172.21.15.72:0/1416452007 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0000b600 con 0x7f9d100cb9b0 2023-08-31T19:08:01.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.099+0000 7f9d14999700 1 -- 172.21.15.72:0/1416452007 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0000b760 con 0x7f9d100cb9b0 2023-08-31T19:08:01.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.099+0000 7f9d14999700 1 -- 172.21.15.72:0/1416452007 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0000bae0 con 0x7f9d100cb9b0 2023-08-31T19:08:01.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.099+0000 7f9d17bff700 1 -- 172.21.15.72:0/1416452007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d100cb9b0 msgr2=0x7f9d101583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.099+0000 7f9d17bff700 1 --2- 172.21.15.72:0/1416452007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d100cb9b0 0x7f9d101583e0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f9d100844d0 tx=0x7f9d000090f0).stop 2023-08-31T19:08:01.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.100+0000 7f9d17bff700 1 -- 172.21.15.72:0/1416452007 shutdown_connections 2023-08-31T19:08:01.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.100+0000 7f9d17bff700 1 --2- 172.21.15.72:0/1416452007 >> v2:172.21.15.146:3300/0 conn(0x7f9d101588d0 0x7f9d10154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.100+0000 7f9d17bff700 1 --2- 172.21.15.72:0/1416452007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d100cb9b0 0x7f9d101583e0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.100+0000 7f9d17bff700 1 -- 172.21.15.72:0/1416452007 >> 172.21.15.72:0/1416452007 conn(0x7f9d1005e870 msgr2=0x7f9d100cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:01.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.100+0000 7f9d17bff700 1 -- 172.21.15.72:0/1416452007 shutdown_connections 2023-08-31T19:08:01.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.100+0000 7f9d17bff700 1 -- 172.21.15.72:0/1416452007 wait complete. 2023-08-31T19:08:01.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.101+0000 7f9d17bff700 1 Processor -- start 2023-08-31T19:08:01.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.101+0000 7f9d17bff700 1 -- start start 2023-08-31T19:08:01.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.102+0000 7f9d17bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d100cb9b0 0x7f9d101509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.102+0000 7f9d17bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d10154060 0x7f9d101533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.102+0000 7f9d17bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d101588d0 0x7f9d10153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.102+0000 7f9d17bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100ae390 con 0x7f9d10154060 2023-08-31T19:08:01.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.102+0000 7f9d17bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d10153d80 con 0x7f9d100cb9b0 2023-08-31T19:08:01.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.102+0000 7f9d17bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100ab830 con 0x7f9d101588d0 2023-08-31T19:08:01.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.102+0000 7f9d1519a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d10154060 0x7f9d101533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.102+0000 7f9d1519a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d10154060 0x7f9d101533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60554/0 (socket says 172.21.15.72:60554) 2023-08-31T19:08:01.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.102+0000 7f9d1519a700 1 -- 172.21.15.72:0/1217587242 learned_addr learned my addr 172.21.15.72:0/1217587242 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:01.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.102+0000 7f9d1599b700 1 --2- 172.21.15.72:0/1217587242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d100cb9b0 0x7f9d101509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.103+0000 7f9d1619c700 1 --2- 172.21.15.72:0/1217587242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d101588d0 0x7f9d10153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.103+0000 7f9d1519a700 1 -- 172.21.15.72:0/1217587242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d101588d0 msgr2=0x7f9d10153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.103+0000 7f9d1519a700 1 --2- 172.21.15.72:0/1217587242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d101588d0 0x7f9d10153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.103+0000 7f9d1519a700 1 -- 172.21.15.72:0/1217587242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d100cb9b0 msgr2=0x7f9d101509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.103+0000 7f9d1519a700 1 --2- 172.21.15.72:0/1217587242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d100cb9b0 0x7f9d101509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.103+0000 7f9d1519a700 1 -- 172.21.15.72:0/1217587242 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d00009370 con 0x7f9d10154060 2023-08-31T19:08:01.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.103+0000 7f9d1519a700 1 --2- 172.21.15.72:0/1217587242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d10154060 0x7f9d101533a0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f9d00009fd0 tx=0x7f9d00017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:01.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.103+0000 7f9d05ffb700 1 -- 172.21.15.72:0/1217587242 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0000b8d0 con 0x7f9d10154060 2023-08-31T19:08:01.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.103+0000 7f9d05ffb700 1 -- 172.21.15.72:0/1217587242 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0000ba30 con 0x7f9d10154060 2023-08-31T19:08:01.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.103+0000 7f9d17bff700 1 -- 172.21.15.72:0/1217587242 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d100aac20 con 0x7f9d10154060 2023-08-31T19:08:01.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.103+0000 7f9d05ffb700 1 -- 172.21.15.72:0/1217587242 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0001b690 con 0x7f9d10154060 2023-08-31T19:08:01.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.103+0000 7f9d17bff700 1 -- 172.21.15.72:0/1217587242 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d100ab1e0 con 0x7f9d10154060 2023-08-31T19:08:01.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.104+0000 7f9d17bff700 1 -- 172.21.15.72:0/1217587242 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d100a7b20 con 0x7f9d10154060 2023-08-31T19:08:01.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.105+0000 7f9d05ffb700 1 -- 172.21.15.72:0/1217587242 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9d0001ba00 con 0x7f9d10154060 2023-08-31T19:08:01.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.106+0000 7f9d05ffb700 1 --2- 172.21.15.72:0/1217587242 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cf405ef60 0x7f9cf4061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.106+0000 7f9d05ffb700 1 -- 172.21.15.72:0/1217587242 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f9d0007b950 con 0x7f9d10154060 2023-08-31T19:08:01.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.106+0000 7f9d1599b700 1 --2- 172.21.15.72:0/1217587242 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cf405ef60 0x7f9cf4061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.106+0000 7f9d1599b700 1 --2- 172.21.15.72:0/1217587242 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cf405ef60 0x7f9cf4061420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f9d0c003710 tx=0x7f9d0c009040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:01.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.110+0000 7f9d05ffb700 1 -- 172.21.15.72:0/1217587242 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9d0004c9d0 con 0x7f9d10154060 2023-08-31T19:08:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.319+0000 7f9d17bff700 1 -- 172.21.15.72:0/1217587242 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d1006c6b0 con 0x7f9d10154060 2023-08-31T19:08:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.320+0000 7f9d05ffb700 1 -- 172.21.15.72:0/1217587242 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f9d0004fff0 con 0x7f9d10154060 2023-08-31T19:08:01.320 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:08:01.321 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6926,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2210268438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2210268438},{"type":"v1","addr":"172.21.15.72:6836","nonce":2210268438}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3842453419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3842453419},{"type":"v1","addr":"172.21.15.146:6834","nonce":3842453419}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/282510582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":282510582},{"type":"v1","addr":"172.21.15.146:6835","nonce":282510582}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:07:57.873694+0000","modified":"2023-08-31T19:08:00.883204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8487":{"gid":8487,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3274545863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3274545863},{"type":"v1","addr":"172.21.15.72:6837","nonce":3274545863}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-31T19:08:01.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.322+0000 7f9d17bff700 1 -- 172.21.15.72:0/1217587242 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cf405ef60 msgr2=0x7f9cf4061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.322+0000 7f9d17bff700 1 --2- 172.21.15.72:0/1217587242 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cf405ef60 0x7f9cf4061420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f9d0c003710 tx=0x7f9d0c009040).stop 2023-08-31T19:08:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.322+0000 7f9d17bff700 1 -- 172.21.15.72:0/1217587242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d10154060 msgr2=0x7f9d101533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.322+0000 7f9d17bff700 1 --2- 172.21.15.72:0/1217587242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d10154060 0x7f9d101533a0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f9d00009fd0 tx=0x7f9d00017000).stop 2023-08-31T19:08:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.322+0000 7f9d17bff700 1 -- 172.21.15.72:0/1217587242 shutdown_connections 2023-08-31T19:08:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.322+0000 7f9d17bff700 1 --2- 172.21.15.72:0/1217587242 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d101588d0 0x7f9d10153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.322+0000 7f9d17bff700 1 --2- 172.21.15.72:0/1217587242 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f9cf405ef60 0x7f9cf4061420 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.322+0000 7f9d17bff700 1 --2- 172.21.15.72:0/1217587242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d100cb9b0 0x7f9d101509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.322+0000 7f9d17bff700 1 --2- 172.21.15.72:0/1217587242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d10154060 0x7f9d101533a0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.322+0000 7f9d17bff700 1 -- 172.21.15.72:0/1217587242 >> 172.21.15.72:0/1217587242 conn(0x7f9d1005e870 msgr2=0x7f9d10064400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.322+0000 7f9d17bff700 1 -- 172.21.15.72:0/1217587242 shutdown_connections 2023-08-31T19:08:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.322+0000 7f9d17bff700 1 -- 172.21.15.72:0/1217587242 wait complete. 2023-08-31T19:08:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 71 2023-08-31T19:08:01.341 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:08:01.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.529+0000 7f61a2dff700 1 Processor -- start 2023-08-31T19:08:01.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.529+0000 7f61a2dff700 1 -- start start 2023-08-31T19:08:01.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.530+0000 7f61a2dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f619c1523a0 0x7f619c0bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.530+0000 7f61a2dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619c0c5c70 con 0x7f619c0631e0 2023-08-31T19:08:01.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.530+0000 7f61a2dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619c0bc7f0 con 0x7f619c062650 2023-08-31T19:08:01.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.530+0000 7f61a2dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619c0be1c0 con 0x7f619c1523a0 2023-08-31T19:08:01.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.531+0000 7f61a139c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f619c0631e0 0x7f619c15bd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52808/0 (socket says 172.21.15.72:52808) 2023-08-31T19:08:01.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.531+0000 7f61a139c700 1 -- 172.21.15.72:0/2828844641 learned_addr learned my addr 172.21.15.72:0/2828844641 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:08:01.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.531+0000 7f61a0b9b700 1 --2- 172.21.15.72:0/2828844641 >> v2:172.21.15.146:3300/0 conn(0x7f619c1523a0 0x7f619c0bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.531+0000 7f619b7fe700 1 -- 172.21.15.72:0/2828844641 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683904295 0 0) 0x7f619c0c5c70 con 0x7f619c0631e0 2023-08-31T19:08:01.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.531+0000 7f619b7fe700 1 -- 172.21.15.72:0/2828844641 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f618c0033f0 con 0x7f619c0631e0 2023-08-31T19:08:01.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.531+0000 7f619b7fe700 1 -- 172.21.15.72:0/2828844641 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2873002608 0 0) 0x7f618c0033f0 con 0x7f619c0631e0 2023-08-31T19:08:01.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.531+0000 7f619b7fe700 1 -- 172.21.15.72:0/2828844641 >> v2:172.21.15.146:3300/0 conn(0x7f619c1523a0 msgr2=0x7f619c0bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:01.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.531+0000 7f619b7fe700 1 --2- 172.21.15.72:0/2828844641 >> v2:172.21.15.146:3300/0 conn(0x7f619c1523a0 0x7f619c0bc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.531+0000 7f619b7fe700 1 -- 172.21.15.72:0/2828844641 >> v1:172.21.15.146:6789/0 conn(0x7f619c062650 legacy=0x7f619c062ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.531+0000 7f619b7fe700 1 -- 172.21.15.72:0/2828844641 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c0c7110 con 0x7f619c0631e0 2023-08-31T19:08:01.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f619b7fe700 1 -- 172.21.15.72:0/2828844641 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f61940017f0 con 0x7f619c0631e0 2023-08-31T19:08:01.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f619b7fe700 1 -- 172.21.15.72:0/2828844641 >> v1:172.21.15.72:6789/0 conn(0x7f619c0631e0 legacy=0x7f619c15bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f619b7fe700 1 --2- 172.21.15.72:0/2828844641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f618c0038e0 0x7f618c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f619b7fe700 1 --2- 172.21.15.72:0/2828844641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f618c004690 0x7f618c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f619b7fe700 1 --2- 172.21.15.72:0/2828844641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f618c005000 0x7f618c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f619b7fe700 1 -- 172.21.15.72:0/2828844641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0be1c0 con 0x7f618c004690 2023-08-31T19:08:01.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f619b7fe700 1 -- 172.21.15.72:0/2828844641 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618c00beb0 con 0x7f618c0038e0 2023-08-31T19:08:01.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f619b7fe700 1 -- 172.21.15.72:0/2828844641 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618c00c070 con 0x7f618c005000 2023-08-31T19:08:01.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f619bfff700 1 --2- 172.21.15.72:0/2828844641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f618c004690 0x7f618c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f61a0b9b700 1 --2- 172.21.15.72:0/2828844641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f618c0038e0 0x7f618c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f61a139c700 1 --2- 172.21.15.72:0/2828844641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f618c005000 0x7f618c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f619bfff700 1 -- 172.21.15.72:0/2828844641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f618c005000 msgr2=0x7f618c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:01.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f619bfff700 1 --2- 172.21.15.72:0/2828844641 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f618c005000 0x7f618c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f619bfff700 1 -- 172.21.15.72:0/2828844641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f618c0038e0 msgr2=0x7f618c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:01.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f619bfff700 1 --2- 172.21.15.72:0/2828844641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f618c0038e0 0x7f618c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f619bfff700 1 -- 172.21.15.72:0/2828844641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c0033f0 con 0x7f618c004690 2023-08-31T19:08:01.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f61a139c700 1 -- 172.21.15.72:0/2828844641 reap_dead start 2023-08-31T19:08:01.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.532+0000 7f619bfff700 1 --2- 172.21.15.72:0/2828844641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f618c004690 0x7f618c004b10 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f6188001730 tx=0x7f6188007bb0).ready entity=mon.0 client_cookie=8f42248dc1d557e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:01.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.533+0000 7f619b7fe700 1 -- 172.21.15.72:0/2828844641 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188007020 con 0x7f618c004690 2023-08-31T19:08:01.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.533+0000 7f619b7fe700 1 -- 172.21.15.72:0/2828844641 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6188007180 con 0x7f618c004690 2023-08-31T19:08:01.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.533+0000 7f619b7fe700 1 -- 172.21.15.72:0/2828844641 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188007520 con 0x7f618c004690 2023-08-31T19:08:01.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.533+0000 7f61a2dff700 1 -- 172.21.15.72:0/2828844641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f618c004690 msgr2=0x7f618c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.533+0000 7f61a2dff700 1 --2- 172.21.15.72:0/2828844641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f618c004690 0x7f618c004b10 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f6188001730 tx=0x7f6188007bb0).stop 2023-08-31T19:08:01.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.533+0000 7f61a2dff700 1 -- 172.21.15.72:0/2828844641 shutdown_connections 2023-08-31T19:08:01.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.533+0000 7f61a2dff700 1 --2- 172.21.15.72:0/2828844641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f618c004690 0x7f618c004b10 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.533+0000 7f61a2dff700 1 -- 172.21.15.72:0/2828844641 >> 172.21.15.72:0/2828844641 conn(0x7f619c0c7e70 msgr2=0x7f619c0c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:01.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.533+0000 7f61a2dff700 1 -- 172.21.15.72:0/2828844641 shutdown_connections 2023-08-31T19:08:01.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.533+0000 7f61a2dff700 1 -- 172.21.15.72:0/2828844641 wait complete. 2023-08-31T19:08:01.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.535+0000 7f61a2dff700 1 Processor -- start 2023-08-31T19:08:01.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.535+0000 7f61a2dff700 1 -- start start 2023-08-31T19:08:01.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.536+0000 7f61a2dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f618c004690 0x7f619c0c0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.536+0000 7f61a2dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f619c0bee50 0x7f619c150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.536+0000 7f61a2dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619c0c2790 0x7f619c0c2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.536+0000 7f61a2dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0c2300 con 0x7f619c0c2790 2023-08-31T19:08:01.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.536+0000 7f61a2dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0c19d0 con 0x7f618c004690 2023-08-31T19:08:01.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.536+0000 7f61a2dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0c1cb0 con 0x7f619c0bee50 2023-08-31T19:08:01.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.536+0000 7f61a139c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619c0c2790 0x7f619c0c2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.536+0000 7f61a139c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619c0c2790 0x7f619c0c2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60562/0 (socket says 172.21.15.72:60562) 2023-08-31T19:08:01.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.536+0000 7f61a139c700 1 -- 172.21.15.72:0/3421693075 learned_addr learned my addr 172.21.15.72:0/3421693075 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:01.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.537+0000 7f619bfff700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f619c0bee50 0x7f619c150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.537+0000 7f61a0b9b700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f618c004690 0x7f619c0c0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.537+0000 7f61a139c700 1 -- 172.21.15.72:0/3421693075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f619c0bee50 msgr2=0x7f619c150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.537+0000 7f61a139c700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f619c0bee50 0x7f619c150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.537+0000 7f61a139c700 1 -- 172.21.15.72:0/3421693075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f618c004690 msgr2=0x7f619c0c0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.537+0000 7f61a139c700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f618c004690 0x7f619c0c0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.537+0000 7f61a139c700 1 -- 172.21.15.72:0/3421693075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c0c1f90 con 0x7f619c0c2790 2023-08-31T19:08:01.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.537+0000 7f61a0b9b700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f618c004690 0x7f619c0c0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:08:01.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.537+0000 7f619bfff700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f619c0bee50 0x7f619c150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:08:01.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.537+0000 7f61a139c700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619c0c2790 0x7f619c0c2bf0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f61940012e0 tx=0x7f619c0c72a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:01.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.537+0000 7f6198ff9700 1 -- 172.21.15.72:0/3421693075 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619400e830 con 0x7f619c0c2790 2023-08-31T19:08:01.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.537+0000 7f6198ff9700 1 -- 172.21.15.72:0/3421693075 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619400e990 con 0x7f619c0c2790 2023-08-31T19:08:01.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.537+0000 7f61a2dff700 1 -- 172.21.15.72:0/3421693075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619c0bf610 con 0x7f619c0c2790 2023-08-31T19:08:01.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.537+0000 7f6198ff9700 1 -- 172.21.15.72:0/3421693075 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619400ed10 con 0x7f619c0c2790 2023-08-31T19:08:01.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.537+0000 7f61a2dff700 1 -- 172.21.15.72:0/3421693075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619c1513c0 con 0x7f619c0c2790 2023-08-31T19:08:01.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.538+0000 7f61a2dff700 1 -- 172.21.15.72:0/3421693075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619c151550 con 0x7f619c0c2790 2023-08-31T19:08:01.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.539+0000 7f6198ff9700 1 -- 172.21.15.72:0/3421693075 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f61940133e0 con 0x7f619c0c2790 2023-08-31T19:08:01.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.540+0000 7f6198ff9700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f618005ef00 0x7f61800613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.540+0000 7f6198ff9700 1 -- 172.21.15.72:0/3421693075 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f6194079ff0 con 0x7f619c0c2790 2023-08-31T19:08:01.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.540+0000 7f61a0b9b700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f618005ef00 0x7f61800613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.541+0000 7f61a0b9b700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f618005ef00 0x7f61800613c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6190009270 tx=0x7f6190008040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:01.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.543+0000 7f6198ff9700 1 -- 172.21.15.72:0/3421693075 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f619404afb0 con 0x7f619c0c2790 2023-08-31T19:08:01.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.714+0000 7f61a2dff700 1 -- 172.21.15.72:0/3421693075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f619c0bca70 con 0x7f619c0c2790 2023-08-31T19:08:01.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.715+0000 7f6198ff9700 1 -- 172.21.15.72:0/3421693075 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+17991 (secure 0 0 0) 0x7f619404e5d0 con 0x7f619c0c2790 2023-08-31T19:08:01.715 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:08:01.716 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":157,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:07:58.876183+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:07:56.316526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-31T19:07:56.862239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:08:01.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.717+0000 7f61a2dff700 1 -- 172.21.15.72:0/3421693075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f618005ef00 msgr2=0x7f61800613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.717+0000 7f61a2dff700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f618005ef00 0x7f61800613c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6190009270 tx=0x7f6190008040).stop 2023-08-31T19:08:01.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.717+0000 7f61a2dff700 1 -- 172.21.15.72:0/3421693075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619c0c2790 msgr2=0x7f619c0c2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.717+0000 7f61a2dff700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619c0c2790 0x7f619c0c2bf0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f61940012e0 tx=0x7f619c0c72a0).stop 2023-08-31T19:08:01.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.717+0000 7f61a2dff700 1 -- 172.21.15.72:0/3421693075 shutdown_connections 2023-08-31T19:08:01.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.717+0000 7f61a2dff700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f619c0c2790 0x7f619c0c2bf0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.717+0000 7f61a2dff700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f618005ef00 0x7f61800613c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.717+0000 7f61a2dff700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f618c004690 0x7f619c0c0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.717+0000 7f61a2dff700 1 --2- 172.21.15.72:0/3421693075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f619c0bee50 0x7f619c150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.717+0000 7f61a2dff700 1 -- 172.21.15.72:0/3421693075 >> 172.21.15.72:0/3421693075 conn(0x7f619c0c7e70 msgr2=0x7f619c066220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.717+0000 7f61a2dff700 1 -- 172.21.15.72:0/3421693075 shutdown_connections 2023-08-31T19:08:01.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.717+0000 7f61a2dff700 1 -- 172.21.15.72:0/3421693075 wait complete. 2023-08-31T19:08:01.735 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T19:08:01.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:08:01.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.925+0000 7faf15bff700 1 Processor -- start 2023-08-31T19:08:01.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.925+0000 7faf15bff700 1 -- start start 2023-08-31T19:08:01.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.927+0000 7faf15bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faf100cb9b0 0x7faf101583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.927+0000 7faf15bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf101588d0 0x7faf10154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.927+0000 7faf15bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf100c6120 con 0x7faf10154060 2023-08-31T19:08:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.927+0000 7faf15bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf100c1380 con 0x7faf100cb9b0 2023-08-31T19:08:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.927+0000 7faf15bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf100c5e10 con 0x7faf101588d0 2023-08-31T19:08:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.927+0000 7faf0f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faf10154060 0x7faf10157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52812/0 (socket says 172.21.15.72:52812) 2023-08-31T19:08:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.927+0000 7faf0f7fe700 1 -- 172.21.15.72:0/950966553 learned_addr learned my addr 172.21.15.72:0/950966553 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:08:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.927+0000 7faf0e7fc700 1 -- 172.21.15.72:0/950966553 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103437834 0 0) 0x7faf100c6120 con 0x7faf10154060 2023-08-31T19:08:01.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.927+0000 7faf0ffff700 1 --2- 172.21.15.72:0/950966553 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf101588d0 0x7faf10154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.927+0000 7faf0e7fc700 1 -- 172.21.15.72:0/950966553 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef80033f0 con 0x7faf10154060 2023-08-31T19:08:01.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.927+0000 7faf0effd700 1 --2- 172.21.15.72:0/950966553 >> v2:172.21.15.146:3300/0 conn(0x7faf100cb9b0 0x7faf101583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0e7fc700 1 -- 172.21.15.72:0/950966553 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4252990737 0 0) 0x7faef80033f0 con 0x7faf10154060 2023-08-31T19:08:01.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0e7fc700 1 -- 172.21.15.72:0/950966553 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf101588d0 msgr2=0x7faf10154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0e7fc700 1 --2- 172.21.15.72:0/950966553 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf101588d0 0x7faf10154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0e7fc700 1 -- 172.21.15.72:0/950966553 >> v2:172.21.15.146:3300/0 conn(0x7faf100cb9b0 msgr2=0x7faf101583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0e7fc700 1 --2- 172.21.15.72:0/950966553 >> v2:172.21.15.146:3300/0 conn(0x7faf100cb9b0 0x7faf101583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0e7fc700 1 -- 172.21.15.72:0/950966553 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf100c0ae0 con 0x7faf10154060 2023-08-31T19:08:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0e7fc700 1 -- 172.21.15.72:0/950966553 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7faf000015f0 con 0x7faf10154060 2023-08-31T19:08:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0e7fc700 1 -- 172.21.15.72:0/950966553 >> v1:172.21.15.72:6789/0 conn(0x7faf10154060 legacy=0x7faf10157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0e7fc700 1 --2- 172.21.15.72:0/950966553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef80038e0 0x7faef8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0e7fc700 1 --2- 172.21.15.72:0/950966553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faef8004690 0x7faef8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0e7fc700 1 --2- 172.21.15.72:0/950966553 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf101588d0 0x7faef8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0e7fc700 1 -- 172.21.15.72:0/950966553 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf100c1380 con 0x7faef8004690 2023-08-31T19:08:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0e7fc700 1 -- 172.21.15.72:0/950966553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf100c5e10 con 0x7faef80038e0 2023-08-31T19:08:01.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0e7fc700 1 -- 172.21.15.72:0/950966553 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef800b8e0 con 0x7faf101588d0 2023-08-31T19:08:01.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0effd700 1 --2- 172.21.15.72:0/950966553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faef8004690 0x7faef8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0f7fe700 1 --2- 172.21.15.72:0/950966553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef80038e0 0x7faef8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0ffff700 1 --2- 172.21.15.72:0/950966553 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf101588d0 0x7faef8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0effd700 1 -- 172.21.15.72:0/950966553 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf101588d0 msgr2=0x7faef8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:01.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.928+0000 7faf0effd700 1 --2- 172.21.15.72:0/950966553 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf101588d0 0x7faef8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.929+0000 7faf0effd700 1 -- 172.21.15.72:0/950966553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef80038e0 msgr2=0x7faef8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:01.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.929+0000 7faf0effd700 1 --2- 172.21.15.72:0/950966553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef80038e0 0x7faef8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.929+0000 7faf0effd700 1 -- 172.21.15.72:0/950966553 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef80033f0 con 0x7faef8004690 2023-08-31T19:08:01.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.929+0000 7faf0effd700 1 --2- 172.21.15.72:0/950966553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faef8004690 0x7faef8004b10 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7faf04009a80 tx=0x7faf04009060).ready entity=mon.0 client_cookie=36626306911dae76 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:01.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.929+0000 7faf0e7fc700 1 -- 172.21.15.72:0/950966553 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04009430 con 0x7faef8004690 2023-08-31T19:08:01.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.929+0000 7faf0e7fc700 1 -- 172.21.15.72:0/950966553 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0400e640 con 0x7faef8004690 2023-08-31T19:08:01.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.929+0000 7faf0e7fc700 1 -- 172.21.15.72:0/950966553 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0400e9c0 con 0x7faef8004690 2023-08-31T19:08:01.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.929+0000 7faf15bff700 1 -- 172.21.15.72:0/950966553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faef8004690 msgr2=0x7faef8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.929+0000 7faf15bff700 1 --2- 172.21.15.72:0/950966553 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faef8004690 0x7faef8004b10 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7faf04009a80 tx=0x7faf04009060).stop 2023-08-31T19:08:01.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.929+0000 7faf0ffff700 1 -- 172.21.15.72:0/950966553 reap_dead start 2023-08-31T19:08:01.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.929+0000 7faf15bff700 1 -- 172.21.15.72:0/950966553 shutdown_connections 2023-08-31T19:08:01.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.929+0000 7faf15bff700 1 -- 172.21.15.72:0/950966553 >> 172.21.15.72:0/950966553 conn(0x7faf1005e870 msgr2=0x7faf100cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:01.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.930+0000 7faf15bff700 1 -- 172.21.15.72:0/950966553 shutdown_connections 2023-08-31T19:08:01.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.930+0000 7faf15bff700 1 -- 172.21.15.72:0/950966553 wait complete. 2023-08-31T19:08:01.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.932+0000 7faf15bff700 1 Processor -- start 2023-08-31T19:08:01.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.932+0000 7faf15bff700 1 -- start start 2023-08-31T19:08:01.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.933+0000 7faf15bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef8004690 0x7faf10064630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.933+0000 7faf15bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf10063100 0x7faf100a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.933+0000 7faf15bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf100c1e30 0x7faf100c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.933+0000 7faf15bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf101559d0 con 0x7faf100c1e30 2023-08-31T19:08:01.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.933+0000 7faf15bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf10064b20 con 0x7faef8004690 2023-08-31T19:08:01.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.933+0000 7faf15bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf10063590 con 0x7faf10063100 2023-08-31T19:08:01.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.933+0000 7faf0ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf100c1e30 0x7faf100c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.933+0000 7faf0ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf100c1e30 0x7faf100c22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60584/0 (socket says 172.21.15.72:60584) 2023-08-31T19:08:01.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.933+0000 7faf0ffff700 1 -- 172.21.15.72:0/734837356 learned_addr learned my addr 172.21.15.72:0/734837356 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:01.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.933+0000 7faf0f7fe700 1 --2- 172.21.15.72:0/734837356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef8004690 0x7faf10064630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.933+0000 7faf0effd700 1 --2- 172.21.15.72:0/734837356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf10063100 0x7faf100a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.934+0000 7faf0ffff700 1 -- 172.21.15.72:0/734837356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf10063100 msgr2=0x7faf100a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.934+0000 7faf0ffff700 1 --2- 172.21.15.72:0/734837356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf10063100 0x7faf100a9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.934+0000 7faf0ffff700 1 -- 172.21.15.72:0/734837356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef8004690 msgr2=0x7faf10064630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:01.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.934+0000 7faf0ffff700 1 --2- 172.21.15.72:0/734837356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef8004690 0x7faf10064630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:01.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.934+0000 7faf0ffff700 1 -- 172.21.15.72:0/734837356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf10063870 con 0x7faf100c1e30 2023-08-31T19:08:01.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.934+0000 7faf0ffff700 1 --2- 172.21.15.72:0/734837356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf100c1e30 0x7faf100c22b0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7faf100844f0 tx=0x7faf0800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:01.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.934+0000 7faef77fe700 1 -- 172.21.15.72:0/734837356 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800e070 con 0x7faf100c1e30 2023-08-31T19:08:01.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.934+0000 7faef77fe700 1 -- 172.21.15.72:0/734837356 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf08011b80 con 0x7faf100c1e30 2023-08-31T19:08:01.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.934+0000 7faf15bff700 1 -- 172.21.15.72:0/734837356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf10063b50 con 0x7faf100c1e30 2023-08-31T19:08:01.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.934+0000 7faef77fe700 1 -- 172.21.15.72:0/734837356 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf08016450 con 0x7faf100c1e30 2023-08-31T19:08:01.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.934+0000 7faf15bff700 1 -- 172.21.15.72:0/734837356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf10064110 con 0x7faf100c1e30 2023-08-31T19:08:01.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.936+0000 7faf15bff700 1 -- 172.21.15.72:0/734837356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1006c6b0 con 0x7faf100c1e30 2023-08-31T19:08:01.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.936+0000 7faef77fe700 1 -- 172.21.15.72:0/734837356 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7faf08016840 con 0x7faf100c1e30 2023-08-31T19:08:01.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.937+0000 7faef77fe700 1 --2- 172.21.15.72:0/734837356 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faefc05ef30 0x7faefc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:01.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.937+0000 7faef77fe700 1 -- 172.21.15.72:0/734837356 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7faf0807a5b0 con 0x7faf100c1e30 2023-08-31T19:08:01.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.937+0000 7faf0f7fe700 1 --2- 172.21.15.72:0/734837356 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faefc05ef30 0x7faefc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:01.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.938+0000 7faf0f7fe700 1 --2- 172.21.15.72:0/734837356 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faefc05ef30 0x7faefc0613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7faf00000e10 tx=0x7faf00009040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:01.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:01.941+0000 7faef77fe700 1 -- 172.21.15.72:0/734837356 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faf0804b6e0 con 0x7faf100c1e30 2023-08-31T19:08:02.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.106+0000 7faf15bff700 1 -- 172.21.15.72:0/734837356 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf100c0dc0 con 0x7faefc05ef30 2023-08-31T19:08:02.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.117+0000 7faef77fe700 1 -- 172.21.15.72:0/734837356 <== mgr.8313 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353719 (secure 0 0 0) 0x7faf100c0dc0 con 0x7faefc05ef30 2023-08-31T19:08:02.122 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:08:02.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.122+0000 7faf15bff700 1 -- 172.21.15.72:0/734837356 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faefc05ef30 msgr2=0x7faefc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:02.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.122+0000 7faf15bff700 1 --2- 172.21.15.72:0/734837356 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faefc05ef30 0x7faefc0613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7faf00000e10 tx=0x7faf00009040).stop 2023-08-31T19:08:02.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.122+0000 7faf15bff700 1 -- 172.21.15.72:0/734837356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf100c1e30 msgr2=0x7faf100c22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.122+0000 7faf15bff700 1 --2- 172.21.15.72:0/734837356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf100c1e30 0x7faf100c22b0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7faf100844f0 tx=0x7faf0800b040).stop 2023-08-31T19:08:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.122+0000 7faf15bff700 1 -- 172.21.15.72:0/734837356 shutdown_connections 2023-08-31T19:08:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.122+0000 7faf15bff700 1 --2- 172.21.15.72:0/734837356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf100c1e30 0x7faf100c22b0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.122+0000 7faf15bff700 1 --2- 172.21.15.72:0/734837356 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7faefc05ef30 0x7faefc0613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.122+0000 7faf15bff700 1 --2- 172.21.15.72:0/734837356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faef8004690 0x7faf10064630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.122+0000 7faf15bff700 1 --2- 172.21.15.72:0/734837356 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faf10063100 0x7faf100a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.122+0000 7faf15bff700 1 -- 172.21.15.72:0/734837356 >> 172.21.15.72:0/734837356 conn(0x7faf1005e870 msgr2=0x7faf100c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.122+0000 7faf15bff700 1 -- 172.21.15.72:0/734837356 shutdown_connections 2023-08-31T19:08:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.122+0000 7faf15bff700 1 -- 172.21.15.72:0/734837356 wait complete. 2023-08-31T19:08:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:08:02.141 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-31T19:08:00.377953+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":984,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2424564,"kb_used_data":15028,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752550156,"statfs":{"total":773094113280,"available":770611359744,"internally_reserved":0,"allocated":15388672,"data_stored":8236191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11954,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-66,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.996721"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.882725+0000","last_change":"2023-08-31T19:07:57.439376+0000","last_active":"2023-08-31T19:07:57.882725+0000","last_peered":"2023-08-31T19:07:57.882725+0000","last_clean":"2023-08-31T19:07:57.882725+0000","last_became_active":"2023-08-31T19:07:57.439103+0000","last_became_peered":"2023-08-31T19:07:57.439103+0000","last_unstale":"2023-08-31T19:07:57.882725+0000","last_undegraded":"2023-08-31T19:07:57.882725+0000","last_fullsized":"2023-08-31T19:07:57.882725+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908329+0000","last_change":"2023-08-31T19:07:57.896119+0000","last_active":"2023-08-31T19:07:57.908329+0000","last_peered":"2023-08-31T19:07:57.908329+0000","last_clean":"2023-08-31T19:07:57.908329+0000","last_became_active":"2023-08-31T19:07:57.895775+0000","last_became_peered":"2023-08-31T19:07:57.895775+0000","last_unstale":"2023-08-31T19:07:57.908329+0000","last_undegraded":"2023-08-31T19:07:57.908329+0000","last_fullsized":"2023-08-31T19:07:57.908329+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908064+0000","last_change":"2023-08-31T19:07:57.898740+0000","last_active":"2023-08-31T19:07:57.908064+0000","last_peered":"2023-08-31T19:07:57.908064+0000","last_clean":"2023-08-31T19:07:57.908064+0000","last_became_active":"2023-08-31T19:07:57.898473+0000","last_became_peered":"2023-08-31T19:07:57.898473+0000","last_unstale":"2023-08-31T19:07:57.908064+0000","last_undegraded":"2023-08-31T19:07:57.908064+0000","last_fullsized":"2023-08-31T19:07:57.908064+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910456+0000","last_change":"2023-08-31T19:07:57.902929+0000","last_active":"2023-08-31T19:07:57.910456+0000","last_peered":"2023-08-31T19:07:57.910456+0000","last_clean":"2023-08-31T19:07:57.910456+0000","last_became_active":"2023-08-31T19:07:57.902641+0000","last_became_peered":"2023-08-31T19:07:57.902641+0000","last_unstale":"2023-08-31T19:07:57.910456+0000","last_undegraded":"2023-08-31T19:07:57.910456+0000","last_fullsized":"2023-08-31T19:07:57.910456+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.881581+0000","last_change":"2023-08-31T19:07:57.448928+0000","last_active":"2023-08-31T19:07:57.881581+0000","last_peered":"2023-08-31T19:07:57.881581+0000","last_clean":"2023-08-31T19:07:57.881581+0000","last_became_active":"2023-08-31T19:07:57.447313+0000","last_became_peered":"2023-08-31T19:07:57.447313+0000","last_unstale":"2023-08-31T19:07:57.881581+0000","last_undegraded":"2023-08-31T19:07:57.881581+0000","last_fullsized":"2023-08-31T19:07:57.881581+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.884448+0000","last_change":"2023-08-31T19:07:57.446366+0000","last_active":"2023-08-31T19:07:57.884448+0000","last_peered":"2023-08-31T19:07:57.884448+0000","last_clean":"2023-08-31T19:07:57.884448+0000","last_became_active":"2023-08-31T19:07:57.445898+0000","last_became_peered":"2023-08-31T19:07:57.445898+0000","last_unstale":"2023-08-31T19:07:57.884448+0000","last_undegraded":"2023-08-31T19:07:57.884448+0000","last_fullsized":"2023-08-31T19:07:57.884448+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.885701+0000","last_change":"2023-08-31T19:07:57.439955+0000","last_active":"2023-08-31T19:07:57.885701+0000","last_peered":"2023-08-31T19:07:57.885701+0000","last_clean":"2023-08-31T19:07:57.885701+0000","last_became_active":"2023-08-31T19:07:57.439563+0000","last_became_peered":"2023-08-31T19:07:57.439563+0000","last_unstale":"2023-08-31T19:07:57.885701+0000","last_undegraded":"2023-08-31T19:07:57.885701+0000","last_fullsized":"2023-08-31T19:07:57.885701+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"156'4","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.913738+0000","last_change":"2023-08-31T19:07:57.437291+0000","last_active":"2023-08-31T19:07:57.913738+0000","last_peered":"2023-08-31T19:07:57.913738+0000","last_clean":"2023-08-31T19:07:57.913738+0000","last_became_active":"2023-08-31T19:07:57.436999+0000","last_became_peered":"2023-08-31T19:07:57.436999+0000","last_unstale":"2023-08-31T19:07:57.913738+0000","last_undegraded":"2023-08-31T19:07:57.913738+0000","last_fullsized":"2023-08-31T19:07:57.913738+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910164+0000","last_change":"2023-08-31T19:07:57.902995+0000","last_active":"2023-08-31T19:07:57.910164+0000","last_peered":"2023-08-31T19:07:57.910164+0000","last_clean":"2023-08-31T19:07:57.910164+0000","last_became_active":"2023-08-31T19:07:57.902676+0000","last_became_peered":"2023-08-31T19:07:57.902676+0000","last_unstale":"2023-08-31T19:07:57.910164+0000","last_undegraded":"2023-08-31T19:07:57.910164+0000","last_fullsized":"2023-08-31T19:07:57.910164+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.904101+0000","last_change":"2023-08-31T19:07:57.898484+0000","last_active":"2023-08-31T19:07:57.904101+0000","last_peered":"2023-08-31T19:07:57.904101+0000","last_clean":"2023-08-31T19:07:57.904101+0000","last_became_active":"2023-08-31T19:07:57.897995+0000","last_became_peered":"2023-08-31T19:07:57.897995+0000","last_unstale":"2023-08-31T19:07:57.904101+0000","last_undegraded":"2023-08-31T19:07:57.904101+0000","last_fullsized":"2023-08-31T19:07:57.904101+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.913475+0000","last_change":"2023-08-31T19:07:57.912273+0000","last_active":"2023-08-31T19:07:57.913475+0000","last_peered":"2023-08-31T19:07:57.913475+0000","last_clean":"2023-08-31T19:07:57.913475+0000","last_became_active":"2023-08-31T19:07:57.911972+0000","last_became_peered":"2023-08-31T19:07:57.911972+0000","last_unstale":"2023-08-31T19:07:57.913475+0000","last_undegraded":"2023-08-31T19:07:57.913475+0000","last_fullsized":"2023-08-31T19:07:57.913475+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"156'1","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.896522+0000","last_change":"2023-08-31T19:07:57.435424+0000","last_active":"2023-08-31T19:07:57.896522+0000","last_peered":"2023-08-31T19:07:57.896522+0000","last_clean":"2023-08-31T19:07:57.896522+0000","last_became_active":"2023-08-31T19:07:57.435091+0000","last_became_peered":"2023-08-31T19:07:57.435091+0000","last_unstale":"2023-08-31T19:07:57.896522+0000","last_undegraded":"2023-08-31T19:07:57.896522+0000","last_fullsized":"2023-08-31T19:07:57.896522+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910192+0000","last_change":"2023-08-31T19:07:57.904013+0000","last_active":"2023-08-31T19:07:57.910192+0000","last_peered":"2023-08-31T19:07:57.910192+0000","last_clean":"2023-08-31T19:07:57.910192+0000","last_became_active":"2023-08-31T19:07:57.903721+0000","last_became_peered":"2023-08-31T19:07:57.903721+0000","last_unstale":"2023-08-31T19:07:57.910192+0000","last_undegraded":"2023-08-31T19:07:57.910192+0000","last_fullsized":"2023-08-31T19:07:57.910192+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.884882+0000","last_change":"2023-08-31T19:07:57.439814+0000","last_active":"2023-08-31T19:07:57.884882+0000","last_peered":"2023-08-31T19:07:57.884882+0000","last_clean":"2023-08-31T19:07:57.884882+0000","last_became_active":"2023-08-31T19:07:57.439388+0000","last_became_peered":"2023-08-31T19:07:57.439388+0000","last_unstale":"2023-08-31T19:07:57.884882+0000","last_undegraded":"2023-08-31T19:07:57.884882+0000","last_fullsized":"2023-08-31T19:07:57.884882+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.882311+0000","last_change":"2023-08-31T19:07:57.446904+0000","last_active":"2023-08-31T19:07:57.882311+0000","last_peered":"2023-08-31T19:07:57.882311+0000","last_clean":"2023-08-31T19:07:57.882311+0000","last_became_active":"2023-08-31T19:07:57.446553+0000","last_became_peered":"2023-08-31T19:07:57.446553+0000","last_unstale":"2023-08-31T19:07:57.882311+0000","last_undegraded":"2023-08-31T19:07:57.882311+0000","last_fullsized":"2023-08-31T19:07:57.882311+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.885114+0000","last_change":"2023-08-31T19:07:57.446596+0000","last_active":"2023-08-31T19:07:57.885114+0000","last_peered":"2023-08-31T19:07:57.885114+0000","last_clean":"2023-08-31T19:07:57.885114+0000","last_became_active":"2023-08-31T19:07:57.446336+0000","last_became_peered":"2023-08-31T19:07:57.446336+0000","last_unstale":"2023-08-31T19:07:57.885114+0000","last_undegraded":"2023-08-31T19:07:57.885114+0000","last_fullsized":"2023-08-31T19:07:57.885114+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.906117+0000","last_change":"2023-08-31T19:07:57.903528+0000","last_active":"2023-08-31T19:07:57.906117+0000","last_peered":"2023-08-31T19:07:57.906117+0000","last_clean":"2023-08-31T19:07:57.906117+0000","last_became_active":"2023-08-31T19:07:57.903246+0000","last_became_peered":"2023-08-31T19:07:57.903246+0000","last_unstale":"2023-08-31T19:07:57.906117+0000","last_undegraded":"2023-08-31T19:07:57.906117+0000","last_fullsized":"2023-08-31T19:07:57.906117+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908485+0000","last_change":"2023-08-31T19:07:57.897457+0000","last_active":"2023-08-31T19:07:57.908485+0000","last_peered":"2023-08-31T19:07:57.908485+0000","last_clean":"2023-08-31T19:07:57.908485+0000","last_became_active":"2023-08-31T19:07:57.897174+0000","last_became_peered":"2023-08-31T19:07:57.897174+0000","last_unstale":"2023-08-31T19:07:57.908485+0000","last_undegraded":"2023-08-31T19:07:57.908485+0000","last_fullsized":"2023-08-31T19:07:57.908485+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908086+0000","last_change":"2023-08-31T19:07:57.901472+0000","last_active":"2023-08-31T19:07:57.908086+0000","last_peered":"2023-08-31T19:07:57.908086+0000","last_clean":"2023-08-31T19:07:57.908086+0000","last_became_active":"2023-08-31T19:07:57.900872+0000","last_became_peered":"2023-08-31T19:07:57.900872+0000","last_unstale":"2023-08-31T19:07:57.908086+0000","last_undegraded":"2023-08-31T19:07:57.908086+0000","last_fullsized":"2023-08-31T19:07:57.908086+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.888471+0000","last_change":"2023-08-31T19:07:57.447647+0000","last_active":"2023-08-31T19:07:57.888471+0000","last_peered":"2023-08-31T19:07:57.888471+0000","last_clean":"2023-08-31T19:07:57.888471+0000","last_became_active":"2023-08-31T19:07:57.447354+0000","last_became_peered":"2023-08-31T19:07:57.447354+0000","last_unstale":"2023-08-31T19:07:57.888471+0000","last_undegraded":"2023-08-31T19:07:57.888471+0000","last_fullsized":"2023-08-31T19:07:57.888471+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.904928+0000","last_change":"2023-08-31T19:07:57.898610+0000","last_active":"2023-08-31T19:07:57.904928+0000","last_peered":"2023-08-31T19:07:57.904928+0000","last_clean":"2023-08-31T19:07:57.904928+0000","last_became_active":"2023-08-31T19:07:57.898187+0000","last_became_peered":"2023-08-31T19:07:57.898187+0000","last_unstale":"2023-08-31T19:07:57.904928+0000","last_undegraded":"2023-08-31T19:07:57.904928+0000","last_fullsized":"2023-08-31T19:07:57.904928+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.904723+0000","last_change":"2023-08-31T19:07:57.893544+0000","last_active":"2023-08-31T19:07:57.904723+0000","last_peered":"2023-08-31T19:07:57.904723+0000","last_clean":"2023-08-31T19:07:57.904723+0000","last_became_active":"2023-08-31T19:07:57.893227+0000","last_became_peered":"2023-08-31T19:07:57.893227+0000","last_unstale":"2023-08-31T19:07:57.904723+0000","last_undegraded":"2023-08-31T19:07:57.904723+0000","last_fullsized":"2023-08-31T19:07:57.904723+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.907926+0000","last_change":"2023-08-31T19:07:57.902213+0000","last_active":"2023-08-31T19:07:57.907926+0000","last_peered":"2023-08-31T19:07:57.907926+0000","last_clean":"2023-08-31T19:07:57.907926+0000","last_became_active":"2023-08-31T19:07:57.901902+0000","last_became_peered":"2023-08-31T19:07:57.901902+0000","last_unstale":"2023-08-31T19:07:57.907926+0000","last_undegraded":"2023-08-31T19:07:57.907926+0000","last_fullsized":"2023-08-31T19:07:57.907926+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"156'1","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.905224+0000","last_change":"2023-08-31T19:07:57.442675+0000","last_active":"2023-08-31T19:07:57.905224+0000","last_peered":"2023-08-31T19:07:57.905224+0000","last_clean":"2023-08-31T19:07:57.905224+0000","last_became_active":"2023-08-31T19:07:57.442312+0000","last_became_peered":"2023-08-31T19:07:57.442312+0000","last_unstale":"2023-08-31T19:07:57.905224+0000","last_undegraded":"2023-08-31T19:07:57.905224+0000","last_fullsized":"2023-08-31T19:07:57.905224+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.914650+0000","last_change":"2023-08-31T19:07:57.912495+0000","last_active":"2023-08-31T19:07:57.914650+0000","last_peered":"2023-08-31T19:07:57.914650+0000","last_clean":"2023-08-31T19:07:57.914650+0000","last_became_active":"2023-08-31T19:07:57.912064+0000","last_became_peered":"2023-08-31T19:07:57.912064+0000","last_unstale":"2023-08-31T19:07:57.914650+0000","last_undegraded":"2023-08-31T19:07:57.914650+0000","last_fullsized":"2023-08-31T19:07:57.914650+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.881856+0000","last_change":"2023-08-31T19:07:57.447110+0000","last_active":"2023-08-31T19:07:57.881856+0000","last_peered":"2023-08-31T19:07:57.881856+0000","last_clean":"2023-08-31T19:07:57.881856+0000","last_became_active":"2023-08-31T19:07:57.446724+0000","last_became_peered":"2023-08-31T19:07:57.446724+0000","last_unstale":"2023-08-31T19:07:57.881856+0000","last_undegraded":"2023-08-31T19:07:57.881856+0000","last_fullsized":"2023-08-31T19:07:57.881856+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.904836+0000","last_change":"2023-08-31T19:07:57.895524+0000","last_active":"2023-08-31T19:07:57.904836+0000","last_peered":"2023-08-31T19:07:57.904836+0000","last_clean":"2023-08-31T19:07:57.904836+0000","last_became_active":"2023-08-31T19:07:57.895234+0000","last_became_peered":"2023-08-31T19:07:57.895234+0000","last_unstale":"2023-08-31T19:07:57.904836+0000","last_undegraded":"2023-08-31T19:07:57.904836+0000","last_fullsized":"2023-08-31T19:07:57.904836+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"156'1","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.902693+0000","last_change":"2023-08-31T19:07:57.449973+0000","last_active":"2023-08-31T19:07:57.902693+0000","last_peered":"2023-08-31T19:07:57.902693+0000","last_clean":"2023-08-31T19:07:57.902693+0000","last_became_active":"2023-08-31T19:07:57.449478+0000","last_became_peered":"2023-08-31T19:07:57.449478+0000","last_unstale":"2023-08-31T19:07:57.902693+0000","last_undegraded":"2023-08-31T19:07:57.902693+0000","last_fullsized":"2023-08-31T19:07:57.902693+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"156'2","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.905205+0000","last_change":"2023-08-31T19:07:57.435251+0000","last_active":"2023-08-31T19:07:57.905205+0000","last_peered":"2023-08-31T19:07:57.905205+0000","last_clean":"2023-08-31T19:07:57.905205+0000","last_became_active":"2023-08-31T19:07:57.434969+0000","last_became_peered":"2023-08-31T19:07:57.434969+0000","last_unstale":"2023-08-31T19:07:57.905205+0000","last_undegraded":"2023-08-31T19:07:57.905205+0000","last_fullsized":"2023-08-31T19:07:57.905205+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.903388+0000","last_change":"2023-08-31T19:07:57.896324+0000","last_active":"2023-08-31T19:07:57.903388+0000","last_peered":"2023-08-31T19:07:57.903388+0000","last_clean":"2023-08-31T19:07:57.903388+0000","last_became_active":"2023-08-31T19:07:57.896069+0000","last_became_peered":"2023-08-31T19:07:57.896069+0000","last_unstale":"2023-08-31T19:07:57.903388+0000","last_undegraded":"2023-08-31T19:07:57.903388+0000","last_fullsized":"2023-08-31T19:07:57.903388+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910132+0000","last_change":"2023-08-31T19:07:57.903221+0000","last_active":"2023-08-31T19:07:57.910132+0000","last_peered":"2023-08-31T19:07:57.910132+0000","last_clean":"2023-08-31T19:07:57.910132+0000","last_became_active":"2023-08-31T19:07:57.902959+0000","last_became_peered":"2023-08-31T19:07:57.902959+0000","last_unstale":"2023-08-31T19:07:57.910132+0000","last_undegraded":"2023-08-31T19:07:57.910132+0000","last_fullsized":"2023-08-31T19:07:57.910132+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.907828+0000","last_change":"2023-08-31T19:07:57.898212+0000","last_active":"2023-08-31T19:07:57.907828+0000","last_peered":"2023-08-31T19:07:57.907828+0000","last_clean":"2023-08-31T19:07:57.907828+0000","last_became_active":"2023-08-31T19:07:57.897888+0000","last_became_peered":"2023-08-31T19:07:57.897888+0000","last_unstale":"2023-08-31T19:07:57.907828+0000","last_undegraded":"2023-08-31T19:07:57.907828+0000","last_fullsized":"2023-08-31T19:07:57.907828+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.906422+0000","last_change":"2023-08-31T19:07:57.899213+0000","last_active":"2023-08-31T19:07:57.906422+0000","last_peered":"2023-08-31T19:07:57.906422+0000","last_clean":"2023-08-31T19:07:57.906422+0000","last_became_active":"2023-08-31T19:07:57.898870+0000","last_became_peered":"2023-08-31T19:07:57.898870+0000","last_unstale":"2023-08-31T19:07:57.906422+0000","last_undegraded":"2023-08-31T19:07:57.906422+0000","last_fullsized":"2023-08-31T19:07:57.906422+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.889135+0000","last_change":"2023-08-31T19:07:57.454470+0000","last_active":"2023-08-31T19:07:57.889135+0000","last_peered":"2023-08-31T19:07:57.889135+0000","last_clean":"2023-08-31T19:07:57.889135+0000","last_became_active":"2023-08-31T19:07:57.454077+0000","last_became_peered":"2023-08-31T19:07:57.454077+0000","last_unstale":"2023-08-31T19:07:57.889135+0000","last_undegraded":"2023-08-31T19:07:57.889135+0000","last_fullsized":"2023-08-31T19:07:57.889135+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908465+0000","last_change":"2023-08-31T19:07:57.896520+0000","last_active":"2023-08-31T19:07:57.908465+0000","last_peered":"2023-08-31T19:07:57.908465+0000","last_clean":"2023-08-31T19:07:57.908465+0000","last_became_active":"2023-08-31T19:07:57.896159+0000","last_became_peered":"2023-08-31T19:07:57.896159+0000","last_unstale":"2023-08-31T19:07:57.908465+0000","last_undegraded":"2023-08-31T19:07:57.908465+0000","last_fullsized":"2023-08-31T19:07:57.908465+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":136,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-31T19:07:52.709449+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:07:52.709449+0000","last_peered":"2023-08-31T19:07:52.709449+0000","last_clean":"2023-08-31T19:07:52.709449+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:07:52.709449+0000","last_undegraded":"2023-08-31T19:07:52.709449+0000","last_fullsized":"2023-08-31T19:07:52.709449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.904909+0000","last_change":"2023-08-31T19:07:57.897045+0000","last_active":"2023-08-31T19:07:57.904909+0000","last_peered":"2023-08-31T19:07:57.904909+0000","last_clean":"2023-08-31T19:07:57.904909+0000","last_became_active":"2023-08-31T19:07:57.896589+0000","last_became_peered":"2023-08-31T19:07:57.896589+0000","last_unstale":"2023-08-31T19:07:57.904909+0000","last_undegraded":"2023-08-31T19:07:57.904909+0000","last_fullsized":"2023-08-31T19:07:57.904909+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":132,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.888254+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:07:57.888254+0000","last_peered":"2023-08-31T19:07:57.888254+0000","last_clean":"2023-08-31T19:07:57.888254+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:07:57.888254+0000","last_undegraded":"2023-08-31T19:07:57.888254+0000","last_fullsized":"2023-08-31T19:07:57.888254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":131,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-31T19:07:53.171075+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:07:53.171075+0000","last_peered":"2023-08-31T19:07:53.171075+0000","last_clean":"2023-08-31T19:07:53.171075+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:07:53.171075+0000","last_undegraded":"2023-08-31T19:07:53.171075+0000","last_fullsized":"2023-08-31T19:07:53.171075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908160+0000","last_change":"2023-08-31T19:07:57.904747+0000","last_active":"2023-08-31T19:07:57.908160+0000","last_peered":"2023-08-31T19:07:57.908160+0000","last_clean":"2023-08-31T19:07:57.908160+0000","last_became_active":"2023-08-31T19:07:57.904474+0000","last_became_peered":"2023-08-31T19:07:57.904474+0000","last_unstale":"2023-08-31T19:07:57.908160+0000","last_undegraded":"2023-08-31T19:07:57.908160+0000","last_fullsized":"2023-08-31T19:07:57.908160+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.889227+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:07:57.889227+0000","last_peered":"2023-08-31T19:07:57.889227+0000","last_clean":"2023-08-31T19:07:57.889227+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:07:57.889227+0000","last_undegraded":"2023-08-31T19:07:57.889227+0000","last_fullsized":"2023-08-31T19:07:57.889227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":127,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-31T19:07:52.925238+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:07:52.925238+0000","last_peered":"2023-08-31T19:07:52.925238+0000","last_clean":"2023-08-31T19:07:52.925238+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:07:52.925238+0000","last_undegraded":"2023-08-31T19:07:52.925238+0000","last_fullsized":"2023-08-31T19:07:52.925238+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.882432+0000","last_change":"2023-08-31T19:07:57.437246+0000","last_active":"2023-08-31T19:07:57.882432+0000","last_peered":"2023-08-31T19:07:57.882432+0000","last_clean":"2023-08-31T19:07:57.882432+0000","last_became_active":"2023-08-31T19:07:57.436918+0000","last_became_peered":"2023-08-31T19:07:57.436918+0000","last_unstale":"2023-08-31T19:07:57.882432+0000","last_undegraded":"2023-08-31T19:07:57.882432+0000","last_fullsized":"2023-08-31T19:07:57.882432+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":126,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-31T19:07:52.925198+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:07:52.925198+0000","last_peered":"2023-08-31T19:07:52.925198+0000","last_clean":"2023-08-31T19:07:52.925198+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:07:52.925198+0000","last_undegraded":"2023-08-31T19:07:52.925198+0000","last_fullsized":"2023-08-31T19:07:52.925198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908017+0000","last_change":"2023-08-31T19:07:57.898211+0000","last_active":"2023-08-31T19:07:57.908017+0000","last_peered":"2023-08-31T19:07:57.908017+0000","last_clean":"2023-08-31T19:07:57.908017+0000","last_became_active":"2023-08-31T19:07:57.897760+0000","last_became_peered":"2023-08-31T19:07:57.897760+0000","last_unstale":"2023-08-31T19:07:57.908017+0000","last_undegraded":"2023-08-31T19:07:57.908017+0000","last_fullsized":"2023-08-31T19:07:57.908017+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":126,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-08-31T19:07:52.925239+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:07:52.925239+0000","last_peered":"2023-08-31T19:07:52.925239+0000","last_clean":"2023-08-31T19:07:52.925239+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:07:52.925239+0000","last_undegraded":"2023-08-31T19:07:52.925239+0000","last_fullsized":"2023-08-31T19:07:52.925239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.888829+0000","last_change":"2023-08-31T19:07:57.449766+0000","last_active":"2023-08-31T19:07:57.888829+0000","last_peered":"2023-08-31T19:07:57.888829+0000","last_clean":"2023-08-31T19:07:57.888829+0000","last_became_active":"2023-08-31T19:07:57.448701+0000","last_became_peered":"2023-08-31T19:07:57.448701+0000","last_unstale":"2023-08-31T19:07:57.888829+0000","last_undegraded":"2023-08-31T19:07:57.888829+0000","last_fullsized":"2023-08-31T19:07:57.888829+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":136,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-31T19:07:52.709382+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:07:52.709382+0000","last_peered":"2023-08-31T19:07:52.709382+0000","last_clean":"2023-08-31T19:07:52.709382+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:07:52.709382+0000","last_undegraded":"2023-08-31T19:07:52.709382+0000","last_fullsized":"2023-08-31T19:07:52.709382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:57.409845+0000","last_change":"2023-08-31T19:07:57.409845+0000","last_active":"2023-08-31T19:07:57.409845+0000","last_peered":"2023-08-31T19:07:57.409845+0000","last_clean":"2023-08-31T19:07:57.409845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:57.409845+0000","last_undegraded":"2023-08-31T19:07:57.409845+0000","last_fullsized":"2023-08-31T19:07:57.409845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:07:56.403451+0000","last_change":"2023-08-31T19:07:56.403451+0000","last_active":"2023-08-31T19:07:56.403451+0000","last_peered":"2023-08-31T19:07:56.403451+0000","last_clean":"2023-08-31T19:07:56.403451+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:07:56.403451+0000","last_undegraded":"2023-08-31T19:07:56.403451+0000","last_fullsized":"2023-08-31T19:07:56.403451+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.884547+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:07:57.884547+0000","last_peered":"2023-08-31T19:07:57.884547+0000","last_clean":"2023-08-31T19:07:57.884547+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:07:57.884547+0000","last_undegraded":"2023-08-31T19:07:57.884547+0000","last_fullsized":"2023-08-31T19:07:57.884547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":984,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":34,"acting":34,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575085,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303052,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1904640,"data_stored":1020020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69899999999999995,"15min":0.72999999999999998},"min":{"1min":0.41799999999999998,"5min":0.38500000000000001,"15min":0.32100000000000001},"max":{"1min":0.89900000000000002,"5min":1.175,"15min":1.175},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.51300000000000001,"5min":0.439,"15min":0.39800000000000002},"max":{"1min":0.80900000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.51000000000000001,"5min":0.42499999999999999,"15min":0.40000000000000002},"max":{"1min":0.90100000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.67200000000000004,"15min":0.68200000000000005},"min":{"1min":0.47899999999999998,"5min":0.41999999999999998,"15min":0.36199999999999999},"max":{"1min":0.82699999999999996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.47699999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90800000000000003,"5min":1.163,"15min":1.163},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0309999999999999,"15min":1.054},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70899999999999996,"15min":0.71499999999999997},"min":{"1min":0.55500000000000005,"5min":0.498,"15min":0.432},"max":{"1min":0.84499999999999997,"5min":1.107,"15min":1.107},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.74399999999999999,"15min":0.74299999999999999},"min":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.92000000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.35199999999999998,"15min":0.33900000000000002},"max":{"1min":0.81799999999999995,"5min":0.84499999999999997,"15min":0.97899999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.55600000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95899999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.46400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93200000000000005,"5min":1.0229999999999999,"15min":1.139},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.70699999999999996},"min":{"1min":0.45000000000000001,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.048},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.45600000000000002},"max":{"1min":0.89800000000000002,"5min":0.92400000000000004,"15min":1.0740000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.48699999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95399999999999996,"5min":1.069,"15min":1.069},"last":0.624}]}]},{"osd":6,"up_from":13,"seq":55834575085,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303108,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068732,"statfs":{"total":96636764160,"available":96326381568,"internally_reserved":0,"allocated":1961984,"data_stored":1050297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.69999999999999996},"min":{"1min":0.48699999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83099999999999996,"5min":0.94799999999999995,"15min":1.0189999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.69499999999999995},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.371},"max":{"1min":0.93799999999999994,"5min":1.069,"15min":1.069},"last":0.81200000000000006}]},{"osd":1,"last update":"Thu Aug 31 19:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.69499999999999995},"min":{"1min":0.498,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.90300000000000002,"5min":1.014,"15min":1.014},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.52200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.87,"5min":1.216,"15min":1.216},"last":0.621}]},{"osd":2,"last update":"Thu Aug 31 19:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.53400000000000003,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.129},"last":0.752},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.73899999999999999},"min":{"1min":0.626,"5min":0.498,"15min":0.46600000000000003},"max":{"1min":0.92200000000000004,"5min":0.95299999999999996,"15min":1.3260000000000001},"last":0.73799999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70799999999999996,"15min":0.70899999999999996},"min":{"1min":0.54300000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.57699999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.92600000000000005,"5min":1.087,"15min":1.087},"last":0.91900000000000004}]},{"osd":4,"last update":"Thu Aug 31 19:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64200000000000002,"15min":0.61799999999999999},"min":{"1min":0.45000000000000001,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90900000000000003,"15min":0.96599999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64300000000000002,"15min":0.63400000000000001},"min":{"1min":0.502,"5min":0.432,"15min":0.39000000000000001},"max":{"1min":0.90900000000000003,"5min":0.95999999999999996,"15min":1.0880000000000001},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69299999999999995,"15min":0.67300000000000004},"min":{"1min":0.48999999999999999,"5min":0.42499999999999999,"15min":0.39800000000000002},"max":{"1min":0.98799999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.52500000000000002,"5min":0.47499999999999998,"15min":0.435},"max":{"1min":0.95499999999999996,"5min":1.0669999999999999,"15min":1.0700000000000001},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.41899999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.012},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76200000000000001,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.032,"5min":1.161,"15min":1.161},"last":1.014}]}]},{"osd":1,"up_from":13,"seq":55834575085,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303052,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1904640,"data_stored":1020020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41699999999999998,"15min":0.441},"min":{"1min":0.308,"5min":0.28000000000000003,"15min":0.26100000000000001},"max":{"1min":0.64600000000000002,"5min":0.69499999999999995,"15min":0.81000000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.35099999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64200000000000002,"5min":0.66600000000000004,"15min":0.752},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48799999999999999,"15min":0.50800000000000001},"min":{"1min":0.34499999999999997,"5min":0.33200000000000002,"15min":0.29099999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.82699999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54700000000000004,"15min":0.57299999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.752,"5min":0.754,"15min":0.81899999999999995},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.55100000000000005},"min":{"1min":0.44,"5min":0.39100000000000001,"15min":0.35599999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.82199999999999995},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.498,"15min":0.50800000000000001},"min":{"1min":0.38500000000000001,"5min":0.33400000000000002,"15min":0.32800000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.99199999999999999,"5min":1.0780000000000001,"15min":1.2110000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78300000000000003,"15min":0.80900000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0029999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.0860000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.497},"max":{"1min":0.98899999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.46999999999999997},"max":{"1min":1.0229999999999999,"5min":1.153,"15min":1.2310000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.56200000000000006,"5min":0.501,"15min":0.501},"max":{"1min":0.99199999999999999,"5min":1.117,"15min":1.1990000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.51500000000000001},"max":{"1min":1,"5min":1.167,"15min":1.2},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0569999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":1.117},{"interface":"front","average":{"1min":0.754,"5min":0.76200000000000001,"15min":0.78700000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.51400000000000001},"max":{"1min":0.94599999999999995,"5min":1.234,"15min":1.234},"last":0.64600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575085,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1953792,"data_stored":1042109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.436,"15min":0.439},"min":{"1min":0.30399999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63500000000000001,"5min":0.73399999999999999,"15min":0.78400000000000003},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47999999999999998,"15min":0.49099999999999999},"min":{"1min":0.33300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67700000000000005,"5min":0.72499999999999998,"15min":0.876},"last":0.434}]},{"osd":2,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48099999999999998,"15min":0.498},"min":{"1min":0.35099999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65100000000000002,"5min":0.71899999999999997,"15min":0.74299999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.49299999999999999,"15min":0.52200000000000002},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59899999999999998,"5min":0.82499999999999996,"15min":1.018},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.498,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.64600000000000002,"5min":0.69099999999999995,"15min":0.82799999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.36599999999999999},"max":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.91400000000000003},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77800000000000002,"15min":0.81399999999999995},"min":{"1min":0.54900000000000004,"5min":0.5,"15min":0.5},"max":{"1min":0.95199999999999996,"5min":1.103,"15min":1.2370000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77200000000000002,"15min":0.80900000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94299999999999995,"5min":1.1579999999999999,"15min":1.276},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72699999999999998,"15min":0.748},"min":{"1min":0.53600000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.83699999999999997,"5min":1.155,"15min":1.155},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.51200000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.92200000000000004,"5min":1.123,"15min":1.1950000000000001},"last":0.86199999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77700000000000002,"15min":0.80300000000000005},"min":{"1min":0.48999999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97399999999999998,"5min":1.3080000000000001,"15min":1.3280000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.82899999999999996},"min":{"1min":0.57299999999999995,"5min":0.55400000000000005,"15min":0.53500000000000003},"max":{"1min":0.96699999999999997,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.58399999999999996,"5min":0.53700000000000003,"15min":0.51800000000000002},"max":{"1min":0.95099999999999996,"5min":1.1359999999999999,"15min":1.5820000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.79300000000000004,"15min":0.82699999999999996},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.997,"5min":1.127,"15min":1.548},"last":0.74099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575084,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303052,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1904640,"data_stored":1020020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.57299999999999995,"15min":0.48699999999999999},"min":{"1min":0.37,"5min":0.27800000000000002,"15min":0.27000000000000002},"max":{"1min":0.72999999999999998,"5min":14.09,"15min":14.09},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69599999999999995,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54500000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.65600000000000003,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64900000000000002,"5min":4.375,"15min":4.375},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.55500000000000005,"15min":0.52500000000000002},"min":{"1min":0.42199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.70799999999999996,"5min":5.7649999999999997,"15min":5.7649999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.36399999999999999},"max":{"1min":0.70699999999999996,"5min":5.9729999999999999,"15min":5.9729999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.52500000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86599999999999999,"5min":4.9960000000000004,"15min":4.9960000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.59099999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88600000000000001,"5min":4.4119999999999999,"15min":4.4119999999999999},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.752,"15min":0.78100000000000003},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91200000000000003,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.77700000000000002,"15min":0.79100000000000004},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.876,"5min":5.0449999999999999,"15min":5.0449999999999999},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.60899999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97299999999999998,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.63},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.78200000000000003,"15min":0.80100000000000005},"min":{"1min":0.57599999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.89500000000000002,"5min":2.383,"15min":2.383},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76700000000000002,"15min":0.79700000000000004},"min":{"1min":0.56699999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0569999999999999,"5min":1.869,"15min":1.869},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":0.81200000000000006},"min":{"1min":0.60099999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.96499999999999997,"5min":2.403,"15min":2.403},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575084,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303052,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":1904640,"data_stored":1020020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41599999999999998,"15min":0.47999999999999998},"min":{"1min":0.27900000000000003,"5min":0.223,"15min":0.223},"max":{"1min":0.54700000000000004,"5min":0.88300000000000001,"15min":14.099},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.55500000000000005},"min":{"1min":0.33400000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63300000000000001,"5min":0.72299999999999998,"15min":24.879999999999999},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.35899999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63700000000000001,"5min":0.76200000000000001,"15min":0.79600000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48099999999999998,"15min":0.54100000000000004},"min":{"1min":0.31900000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60899999999999999,"5min":0.80700000000000005,"15min":14.143000000000001},"last":0.437}]},{"osd":2,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.74099999999999999,"5min":0.76200000000000001,"15min":1.0640000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.64600000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.32000000000000001},"max":{"1min":0.68899999999999995,"5min":0.78400000000000003,"15min":12.464},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73299999999999998,"15min":0.81699999999999995},"min":{"1min":0.47699999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.04,"5min":1.298,"15min":21.475999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74299999999999999,"15min":0.76200000000000001},"min":{"1min":0.57499999999999996,"5min":0.52100000000000002,"15min":0.47699999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.8149999999999999},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.751,"15min":0.76000000000000001},"min":{"1min":0.60899999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1120000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.752,"15min":0.80800000000000005},"min":{"1min":0.59199999999999997,"5min":0.52700000000000002,"15min":0.50600000000000001},"max":{"1min":1.101,"5min":1.2809999999999999,"15min":12.509},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76900000000000002,"15min":0.82099999999999995},"min":{"1min":0.61299999999999999,"5min":0.53400000000000003,"15min":0.52000000000000002},"max":{"1min":1.0980000000000001,"5min":1.3320000000000001,"15min":12.426},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76400000000000001,"15min":0.85799999999999998},"min":{"1min":0.66200000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.98999999999999999,"5min":1.2010000000000001,"15min":24.920000000000002},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.77900000000000003,"15min":0.86599999999999999},"min":{"1min":0.65200000000000002,"5min":0.52300000000000002,"15min":0.495},"max":{"1min":1.0860000000000001,"5min":1.347,"15min":21.521000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.59399999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2929999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.78800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303040,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068800,"statfs":{"total":96636764160,"available":96326451200,"internally_reserved":0,"allocated":1892352,"data_stored":1013476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66400000000000003,"15min":0.68799999999999994},"min":{"1min":0.434,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64100000000000001,"15min":0.68700000000000006},"min":{"1min":0.502,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Aug 31 19:07:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67600000000000005,"15min":0.70899999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.3140000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.498}]},{"osd":2,"last update":"Thu Aug 31 19:07:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69299999999999995,"15min":0.70799999999999996},"min":{"1min":0.56999999999999995,"5min":0.46300000000000002,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":1.0089999999999999,"15min":1.044},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.86699999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:07:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67500000000000004,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70999999999999996,"15min":0.73499999999999999},"min":{"1min":0.60199999999999998,"5min":0.52900000000000003,"15min":0.439},"max":{"1min":0.93400000000000005,"5min":1.0469999999999999,"15min":1.081},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:07:26 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":1.0029999999999999,"5min":1.425,"15min":1.425},"last":0.442},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93500000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:07:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.48899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90900000000000003,"5min":1.1240000000000001,"15min":1.163},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.54100000000000004,"5min":0.44800000000000001,"15min":0.441},"max":{"1min":1.0629999999999999,"5min":1.514,"15min":1.514},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Aug 31 19:07:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.433},"max":{"1min":1.0780000000000001,"5min":1.359,"15min":1.359},"last":0.627},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.56799999999999995,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":1.014,"5min":1.165,"15min":1.165},"last":0.69999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575085,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303108,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068732,"statfs":{"total":96636764160,"available":96326381568,"internally_reserved":0,"allocated":1961984,"data_stored":1050229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67000000000000004,"15min":0.71599999999999997},"min":{"1min":0.47399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":4.2119999999999997},"last":1.194},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68700000000000006,"15min":0.71699999999999997},"min":{"1min":0.60099999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.874,"5min":0.94899999999999995,"15min":3.548},"last":4.0979999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68700000000000006,"15min":0.75700000000000001},"min":{"1min":0.56399999999999995,"5min":0.46100000000000002,"15min":0.45000000000000001},"max":{"1min":0.84399999999999997,"5min":1.2170000000000001,"15min":16.744},"last":7.1639999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69999999999999996,"15min":0.73499999999999999},"min":{"1min":0.53700000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":1.196,"15min":3.6299999999999999},"last":6.7750000000000004}]},{"osd":2,"last update":"Thu Aug 31 19:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67700000000000005,"15min":0.70899999999999996},"min":{"1min":0.57199999999999995,"5min":0.44400000000000001,"15min":0.41899999999999998},"max":{"1min":0.93000000000000005,"5min":1.0289999999999999,"15min":3.4430000000000001},"last":1.496},{"interface":"front","average":{"1min":0.748,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.01,"5min":1.01,"15min":4.1740000000000004},"last":6.7960000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70399999999999996,"15min":0.73399999999999999},"min":{"1min":0.56799999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98499999999999999,"5min":0.996,"15min":1.327},"last":4.0309999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68200000000000005,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.48999999999999999,"15min":0.47699999999999998},"max":{"1min":0.96299999999999997,"5min":0.96799999999999997,"15min":2.823},"last":2.4060000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63200000000000001,"15min":0.64400000000000002},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.34999999999999998},"max":{"1min":0.94199999999999995,"5min":1.0169999999999999,"15min":7.3739999999999997},"last":1.01},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":3.6680000000000001},"last":6.5910000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.39100000000000001},"max":{"1min":1.0329999999999999,"5min":1.0860000000000001,"15min":3.4780000000000002},"last":5.4029999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.46200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.1639999999999999,"5min":1.2909999999999999,"15min":7.4139999999999997},"last":6.5380000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.52700000000000002,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":3.5960000000000001},"last":7.6859999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.52400000000000002,"5min":0.47399999999999998,"15min":0.45300000000000001},"max":{"1min":1.079,"5min":1.1419999999999999,"15min":2.786},"last":3.9049999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:08:02.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:08:02.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.370+0000 7f6cfafff700 1 Processor -- start 2023-08-31T19:08:02.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.370+0000 7f6cfafff700 1 -- start start 2023-08-31T19:08:02.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.371+0000 7f6cfafff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6cf40c5fb0 0x7f6cf40be370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:02.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.372+0000 7f6cfafff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf40bece0 con 0x7f6cf40c46c0 2023-08-31T19:08:02.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.372+0000 7f6cfafff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf40bef10 con 0x7f6cf40be860 2023-08-31T19:08:02.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.372+0000 7f6cfafff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf4154690 con 0x7f6cf40c5fb0 2023-08-31T19:08:02.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.372+0000 7f6cf959c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6cf40c46c0 0x7f6cf4063a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52828/0 (socket says 172.21.15.72:52828) 2023-08-31T19:08:02.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.372+0000 7f6cf959c700 1 -- 172.21.15.72:0/2009862258 learned_addr learned my addr 172.21.15.72:0/2009862258 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:08:02.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.372+0000 7f6cf37fe700 1 -- 172.21.15.72:0/2009862258 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693136601 0 0) 0x7f6cf40bece0 con 0x7f6cf40c46c0 2023-08-31T19:08:02.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.372+0000 7f6cf8d9b700 1 --2- 172.21.15.72:0/2009862258 >> v2:172.21.15.146:3300/0 conn(0x7f6cf40c5fb0 0x7f6cf40be370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:02.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.372+0000 7f6cf37fe700 1 -- 172.21.15.72:0/2009862258 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ce40033f0 con 0x7f6cf40c46c0 2023-08-31T19:08:02.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf37fe700 1 -- 172.21.15.72:0/2009862258 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3832156874 0 0) 0x7f6ce40033f0 con 0x7f6cf40c46c0 2023-08-31T19:08:02.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf37fe700 1 -- 172.21.15.72:0/2009862258 >> v2:172.21.15.146:3300/0 conn(0x7f6cf40c5fb0 msgr2=0x7f6cf40be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:02.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf37fe700 1 --2- 172.21.15.72:0/2009862258 >> v2:172.21.15.146:3300/0 conn(0x7f6cf40c5fb0 0x7f6cf40be370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf37fe700 1 -- 172.21.15.72:0/2009862258 >> v1:172.21.15.146:6789/0 conn(0x7f6cf40be860 legacy=0x7f6cf40c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:02.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf37fe700 1 -- 172.21.15.72:0/2009862258 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf40bf1f0 con 0x7f6cf40c46c0 2023-08-31T19:08:02.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf37fe700 1 -- 172.21.15.72:0/2009862258 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f6cec0017f0 con 0x7f6cf40c46c0 2023-08-31T19:08:02.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf37fe700 1 -- 172.21.15.72:0/2009862258 >> v1:172.21.15.72:6789/0 conn(0x7f6cf40c46c0 legacy=0x7f6cf4063a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:02.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf37fe700 1 --2- 172.21.15.72:0/2009862258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce40038e0 0x7f6ce4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:02.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf37fe700 1 --2- 172.21.15.72:0/2009862258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ce4004690 0x7f6ce4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:02.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf37fe700 1 --2- 172.21.15.72:0/2009862258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce4005000 0x7f6ce400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:02.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf37fe700 1 -- 172.21.15.72:0/2009862258 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf4154690 con 0x7f6ce4004690 2023-08-31T19:08:02.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf37fe700 1 -- 172.21.15.72:0/2009862258 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce400bf60 con 0x7f6ce40038e0 2023-08-31T19:08:02.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf37fe700 1 -- 172.21.15.72:0/2009862258 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce400c0f0 con 0x7f6ce4005000 2023-08-31T19:08:02.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf3fff700 1 --2- 172.21.15.72:0/2009862258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ce4004690 0x7f6ce4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:02.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf8d9b700 1 --2- 172.21.15.72:0/2009862258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce40038e0 0x7f6ce4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:02.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf959c700 1 --2- 172.21.15.72:0/2009862258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce4005000 0x7f6ce400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:02.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf3fff700 1 -- 172.21.15.72:0/2009862258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce4005000 msgr2=0x7f6ce400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:02.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf3fff700 1 --2- 172.21.15.72:0/2009862258 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6ce4005000 0x7f6ce400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf3fff700 1 -- 172.21.15.72:0/2009862258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce40038e0 msgr2=0x7f6ce4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:02.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf3fff700 1 --2- 172.21.15.72:0/2009862258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce40038e0 0x7f6ce4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.373+0000 7f6cf3fff700 1 -- 172.21.15.72:0/2009862258 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce40033f0 con 0x7f6ce4004690 2023-08-31T19:08:02.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.374+0000 7f6cf959c700 1 -- 172.21.15.72:0/2009862258 reap_dead start 2023-08-31T19:08:02.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.374+0000 7f6cf3fff700 1 --2- 172.21.15.72:0/2009862258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ce4004690 0x7f6ce4004b10 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f6ce0001730 tx=0x7f6ce0007bb0).ready entity=mon.0 client_cookie=809ac6f1e08d65c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:02.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.374+0000 7f6cf37fe700 1 -- 172.21.15.72:0/2009862258 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0007020 con 0x7f6ce4004690 2023-08-31T19:08:02.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.374+0000 7f6cf37fe700 1 -- 172.21.15.72:0/2009862258 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce0007180 con 0x7f6ce4004690 2023-08-31T19:08:02.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.374+0000 7f6cf37fe700 1 -- 172.21.15.72:0/2009862258 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0007520 con 0x7f6ce4004690 2023-08-31T19:08:02.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.374+0000 7f6cfafff700 1 -- 172.21.15.72:0/2009862258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ce4004690 msgr2=0x7f6ce4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:02.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.374+0000 7f6cfafff700 1 --2- 172.21.15.72:0/2009862258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ce4004690 0x7f6ce4004b10 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f6ce0001730 tx=0x7f6ce0007bb0).stop 2023-08-31T19:08:02.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.374+0000 7f6cfafff700 1 -- 172.21.15.72:0/2009862258 shutdown_connections 2023-08-31T19:08:02.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.374+0000 7f6cfafff700 1 --2- 172.21.15.72:0/2009862258 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ce4004690 0x7f6ce4004b10 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.374+0000 7f6cfafff700 1 -- 172.21.15.72:0/2009862258 >> 172.21.15.72:0/2009862258 conn(0x7f6cf4082f60 msgr2=0x7f6cf405e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:02.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.375+0000 7f6cfafff700 1 -- 172.21.15.72:0/2009862258 shutdown_connections 2023-08-31T19:08:02.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.375+0000 7f6cfafff700 1 -- 172.21.15.72:0/2009862258 wait complete. 2023-08-31T19:08:02.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.376+0000 7f6cfafff700 1 Processor -- start 2023-08-31T19:08:02.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.376+0000 7f6cfafff700 1 -- start start 2023-08-31T19:08:02.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.377+0000 7f6cfafff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004690 0x7f6cf4145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.377+0000 7f6cfafff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cf4145e00 0x7f6cf4157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.377+0000 7f6cfafff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf4157f60 0x7f6cf41583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.377+0000 7f6cfafff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf41588b0 con 0x7f6cf4145e00 2023-08-31T19:08:02.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.377+0000 7f6cfafff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf4159410 con 0x7f6ce4004690 2023-08-31T19:08:02.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.377+0000 7f6cfafff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf40c2950 con 0x7f6cf4157f60 2023-08-31T19:08:02.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.377+0000 7f6cf3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cf4145e00 0x7f6cf4157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:02.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.377+0000 7f6cf3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cf4145e00 0x7f6cf4157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60604/0 (socket says 172.21.15.72:60604) 2023-08-31T19:08:02.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.377+0000 7f6cf3fff700 1 -- 172.21.15.72:0/1100620499 learned_addr learned my addr 172.21.15.72:0/1100620499 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:02.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.377+0000 7f6cf8d9b700 1 --2- 172.21.15.72:0/1100620499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004690 0x7f6cf4145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:02.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.377+0000 7f6cf959c700 1 --2- 172.21.15.72:0/1100620499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf4157f60 0x7f6cf41583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:02.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.378+0000 7f6cf3fff700 1 -- 172.21.15.72:0/1100620499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf4157f60 msgr2=0x7f6cf41583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:02.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.378+0000 7f6cf3fff700 1 --2- 172.21.15.72:0/1100620499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf4157f60 0x7f6cf41583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.378+0000 7f6cf3fff700 1 -- 172.21.15.72:0/1100620499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004690 msgr2=0x7f6cf4145910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:02.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.378+0000 7f6cf3fff700 1 --2- 172.21.15.72:0/1100620499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004690 0x7f6cf4145910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.378+0000 7f6cf3fff700 1 -- 172.21.15.72:0/1100620499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf41596b0 con 0x7f6cf4145e00 2023-08-31T19:08:02.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.378+0000 7f6cf959c700 1 --2- 172.21.15.72:0/1100620499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf4157f60 0x7f6cf41583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:08:02.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.378+0000 7f6cf3fff700 1 --2- 172.21.15.72:0/1100620499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cf4145e00 0x7f6cf4157a70 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f6ce4005640 tx=0x7f6ce0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:02.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.378+0000 7f6cf0ff9700 1 -- 172.21.15.72:0/1100620499 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0006ff0 con 0x7f6cf4145e00 2023-08-31T19:08:02.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.378+0000 7f6cf0ff9700 1 -- 172.21.15.72:0/1100620499 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce0013670 con 0x7f6cf4145e00 2023-08-31T19:08:02.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.378+0000 7f6cfafff700 1 -- 172.21.15.72:0/1100620499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf4159990 con 0x7f6cf4145e00 2023-08-31T19:08:02.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.378+0000 7f6cf0ff9700 1 -- 172.21.15.72:0/1100620499 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0013a30 con 0x7f6cf4145e00 2023-08-31T19:08:02.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.378+0000 7f6cfafff700 1 -- 172.21.15.72:0/1100620499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf4068260 con 0x7f6cf4145e00 2023-08-31T19:08:02.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.379+0000 7f6cfafff700 1 -- 172.21.15.72:0/1100620499 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf406c6b0 con 0x7f6cf4145e00 2023-08-31T19:08:02.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.380+0000 7f6cf0ff9700 1 -- 172.21.15.72:0/1100620499 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6ce001f430 con 0x7f6cf4145e00 2023-08-31T19:08:02.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.381+0000 7f6cf0ff9700 1 --2- 172.21.15.72:0/1100620499 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cd805ef30 0x7f6cd80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:02.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.381+0000 7f6cf0ff9700 1 -- 172.21.15.72:0/1100620499 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f6ce007acc0 con 0x7f6cf4145e00 2023-08-31T19:08:02.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.381+0000 7f6cf8d9b700 1 --2- 172.21.15.72:0/1100620499 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cd805ef30 0x7f6cd80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:02.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.382+0000 7f6cf8d9b700 1 --2- 172.21.15.72:0/1100620499 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cd805ef30 0x7f6cd80613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6cf405dc40 tx=0x7f6ce8006f40).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:02.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.385+0000 7f6cf0ff9700 1 -- 172.21.15.72:0/1100620499 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6ce004bd90 con 0x7f6cf4145e00 2023-08-31T19:08:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.550+0000 7f6cfafff700 1 -- 172.21.15.72:0/1100620499 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6cf41588b0 con 0x7f6cd805ef30 2023-08-31T19:08:02.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.561+0000 7f6cf0ff9700 1 -- 172.21.15.72:0/1100620499 <== mgr.8313 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361536 (secure 0 0 0) 0x7f6cf41588b0 con 0x7f6cd805ef30 2023-08-31T19:08:02.568 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:08:02.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.566+0000 7f6cfafff700 1 -- 172.21.15.72:0/1100620499 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cd805ef30 msgr2=0x7f6cd80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:02.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.566+0000 7f6cfafff700 1 --2- 172.21.15.72:0/1100620499 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cd805ef30 0x7f6cd80613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6cf405dc40 tx=0x7f6ce8006f40).stop 2023-08-31T19:08:02.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.566+0000 7f6cfafff700 1 -- 172.21.15.72:0/1100620499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cf4145e00 msgr2=0x7f6cf4157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:02.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.566+0000 7f6cfafff700 1 --2- 172.21.15.72:0/1100620499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cf4145e00 0x7f6cf4157a70 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f6ce4005640 tx=0x7f6ce0015000).stop 2023-08-31T19:08:02.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.566+0000 7f6cfafff700 1 -- 172.21.15.72:0/1100620499 shutdown_connections 2023-08-31T19:08:02.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.566+0000 7f6cfafff700 1 --2- 172.21.15.72:0/1100620499 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6cf4157f60 0x7f6cf41583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.566+0000 7f6cfafff700 1 --2- 172.21.15.72:0/1100620499 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f6cd805ef30 0x7f6cd80613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.566+0000 7f6cfafff700 1 --2- 172.21.15.72:0/1100620499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004690 0x7f6cf4145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.566+0000 7f6cfafff700 1 --2- 172.21.15.72:0/1100620499 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cf4145e00 0x7f6cf4157a70 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.566+0000 7f6cfafff700 1 -- 172.21.15.72:0/1100620499 >> 172.21.15.72:0/1100620499 conn(0x7f6cf4082f60 msgr2=0x7f6cf4156930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:02.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.566+0000 7f6cfafff700 1 -- 172.21.15.72:0/1100620499 shutdown_connections 2023-08-31T19:08:02.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.566+0000 7f6cfafff700 1 -- 172.21.15.72:0/1100620499 wait complete. 2023-08-31T19:08:02.574 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:08:02.584 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-31T19:08:02.378289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":204,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2424840,"kb_used_data":15304,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752549880,"statfs":{"total":773094113280,"available":770611077120,"internally_reserved":0,"allocated":15671296,"data_stored":8384468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10632,"num_objects":-8,"num_object_clones":0,"num_object_copies":-16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-31,"num_write_kb":-25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.997058"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.904706+0000","last_change":"2023-08-31T19:07:57.898957+0000","last_active":"2023-08-31T19:07:57.904706+0000","last_peered":"2023-08-31T19:07:57.904706+0000","last_clean":"2023-08-31T19:07:57.904706+0000","last_became_active":"2023-08-31T19:07:57.898617+0000","last_became_peered":"2023-08-31T19:07:57.898617+0000","last_unstale":"2023-08-31T19:07:57.904706+0000","last_undegraded":"2023-08-31T19:07:57.904706+0000","last_fullsized":"2023-08-31T19:07:57.904706+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"156'3","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.905708+0000","last_change":"2023-08-31T19:07:57.445685+0000","last_active":"2023-08-31T19:07:57.905708+0000","last_peered":"2023-08-31T19:07:57.905708+0000","last_clean":"2023-08-31T19:07:57.905708+0000","last_became_active":"2023-08-31T19:07:57.441050+0000","last_became_peered":"2023-08-31T19:07:57.441050+0000","last_unstale":"2023-08-31T19:07:57.905708+0000","last_undegraded":"2023-08-31T19:07:57.905708+0000","last_fullsized":"2023-08-31T19:07:57.905708+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.899349+0000","last_change":"2023-08-31T19:07:57.886929+0000","last_active":"2023-08-31T19:07:57.899349+0000","last_peered":"2023-08-31T19:07:57.899349+0000","last_clean":"2023-08-31T19:07:57.899349+0000","last_became_active":"2023-08-31T19:07:57.886625+0000","last_became_peered":"2023-08-31T19:07:57.886625+0000","last_unstale":"2023-08-31T19:07:57.899349+0000","last_undegraded":"2023-08-31T19:07:57.899349+0000","last_fullsized":"2023-08-31T19:07:57.899349+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.880489+0000","last_change":"2023-08-31T19:07:57.443543+0000","last_active":"2023-08-31T19:07:57.880489+0000","last_peered":"2023-08-31T19:07:57.880489+0000","last_clean":"2023-08-31T19:07:57.880489+0000","last_became_active":"2023-08-31T19:07:57.443181+0000","last_became_peered":"2023-08-31T19:07:57.443181+0000","last_unstale":"2023-08-31T19:07:57.880489+0000","last_undegraded":"2023-08-31T19:07:57.880489+0000","last_fullsized":"2023-08-31T19:07:57.880489+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.901446+0000","last_change":"2023-08-31T19:07:57.893984+0000","last_active":"2023-08-31T19:07:57.901446+0000","last_peered":"2023-08-31T19:07:57.901446+0000","last_clean":"2023-08-31T19:07:57.901446+0000","last_became_active":"2023-08-31T19:07:57.893712+0000","last_became_peered":"2023-08-31T19:07:57.893712+0000","last_unstale":"2023-08-31T19:07:57.901446+0000","last_undegraded":"2023-08-31T19:07:57.901446+0000","last_fullsized":"2023-08-31T19:07:57.901446+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.882725+0000","last_change":"2023-08-31T19:07:57.439376+0000","last_active":"2023-08-31T19:07:57.882725+0000","last_peered":"2023-08-31T19:07:57.882725+0000","last_clean":"2023-08-31T19:07:57.882725+0000","last_became_active":"2023-08-31T19:07:57.439103+0000","last_became_peered":"2023-08-31T19:07:57.439103+0000","last_unstale":"2023-08-31T19:07:57.882725+0000","last_undegraded":"2023-08-31T19:07:57.882725+0000","last_fullsized":"2023-08-31T19:07:57.882725+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.907712+0000","last_change":"2023-08-31T19:07:57.905386+0000","last_active":"2023-08-31T19:07:57.907712+0000","last_peered":"2023-08-31T19:07:57.907712+0000","last_clean":"2023-08-31T19:07:57.907712+0000","last_became_active":"2023-08-31T19:07:57.905068+0000","last_became_peered":"2023-08-31T19:07:57.905068+0000","last_unstale":"2023-08-31T19:07:57.907712+0000","last_undegraded":"2023-08-31T19:07:57.907712+0000","last_fullsized":"2023-08-31T19:07:57.907712+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"156'2","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.911595+0000","last_change":"2023-08-31T19:07:57.447074+0000","last_active":"2023-08-31T19:07:57.911595+0000","last_peered":"2023-08-31T19:07:57.911595+0000","last_clean":"2023-08-31T19:07:57.911595+0000","last_became_active":"2023-08-31T19:07:57.446778+0000","last_became_peered":"2023-08-31T19:07:57.446778+0000","last_unstale":"2023-08-31T19:07:57.911595+0000","last_undegraded":"2023-08-31T19:07:57.911595+0000","last_fullsized":"2023-08-31T19:07:57.911595+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908329+0000","last_change":"2023-08-31T19:07:57.896119+0000","last_active":"2023-08-31T19:07:57.908329+0000","last_peered":"2023-08-31T19:07:57.908329+0000","last_clean":"2023-08-31T19:07:57.908329+0000","last_became_active":"2023-08-31T19:07:57.895775+0000","last_became_peered":"2023-08-31T19:07:57.895775+0000","last_unstale":"2023-08-31T19:07:57.908329+0000","last_undegraded":"2023-08-31T19:07:57.908329+0000","last_fullsized":"2023-08-31T19:07:57.908329+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"156'1","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908864+0000","last_change":"2023-08-31T19:07:57.456279+0000","last_active":"2023-08-31T19:07:57.908864+0000","last_peered":"2023-08-31T19:07:57.908864+0000","last_clean":"2023-08-31T19:07:57.908864+0000","last_became_active":"2023-08-31T19:07:57.456005+0000","last_became_peered":"2023-08-31T19:07:57.456005+0000","last_unstale":"2023-08-31T19:07:57.908864+0000","last_undegraded":"2023-08-31T19:07:57.908864+0000","last_fullsized":"2023-08-31T19:07:57.908864+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908064+0000","last_change":"2023-08-31T19:07:57.898740+0000","last_active":"2023-08-31T19:07:57.908064+0000","last_peered":"2023-08-31T19:07:57.908064+0000","last_clean":"2023-08-31T19:07:57.908064+0000","last_became_active":"2023-08-31T19:07:57.898473+0000","last_became_peered":"2023-08-31T19:07:57.898473+0000","last_unstale":"2023-08-31T19:07:57.908064+0000","last_undegraded":"2023-08-31T19:07:57.908064+0000","last_fullsized":"2023-08-31T19:07:57.908064+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"156'1","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908625+0000","last_change":"2023-08-31T19:07:57.452134+0000","last_active":"2023-08-31T19:07:57.908625+0000","last_peered":"2023-08-31T19:07:57.908625+0000","last_clean":"2023-08-31T19:07:57.908625+0000","last_became_active":"2023-08-31T19:07:57.451728+0000","last_became_peered":"2023-08-31T19:07:57.451728+0000","last_unstale":"2023-08-31T19:07:57.908625+0000","last_undegraded":"2023-08-31T19:07:57.908625+0000","last_fullsized":"2023-08-31T19:07:57.908625+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910456+0000","last_change":"2023-08-31T19:07:57.902929+0000","last_active":"2023-08-31T19:07:57.910456+0000","last_peered":"2023-08-31T19:07:57.910456+0000","last_clean":"2023-08-31T19:07:57.910456+0000","last_became_active":"2023-08-31T19:07:57.902641+0000","last_became_peered":"2023-08-31T19:07:57.902641+0000","last_unstale":"2023-08-31T19:07:57.910456+0000","last_undegraded":"2023-08-31T19:07:57.910456+0000","last_fullsized":"2023-08-31T19:07:57.910456+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.890787+0000","last_change":"2023-08-31T19:07:57.449022+0000","last_active":"2023-08-31T19:07:57.890787+0000","last_peered":"2023-08-31T19:07:57.890787+0000","last_clean":"2023-08-31T19:07:57.890787+0000","last_became_active":"2023-08-31T19:07:57.448702+0000","last_became_peered":"2023-08-31T19:07:57.448702+0000","last_unstale":"2023-08-31T19:07:57.890787+0000","last_undegraded":"2023-08-31T19:07:57.890787+0000","last_fullsized":"2023-08-31T19:07:57.890787+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.906552+0000","last_change":"2023-08-31T19:07:57.902519+0000","last_active":"2023-08-31T19:07:57.906552+0000","last_peered":"2023-08-31T19:07:57.906552+0000","last_clean":"2023-08-31T19:07:57.906552+0000","last_became_active":"2023-08-31T19:07:57.902245+0000","last_became_peered":"2023-08-31T19:07:57.902245+0000","last_unstale":"2023-08-31T19:07:57.906552+0000","last_undegraded":"2023-08-31T19:07:57.906552+0000","last_fullsized":"2023-08-31T19:07:57.906552+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.881581+0000","last_change":"2023-08-31T19:07:57.448928+0000","last_active":"2023-08-31T19:07:57.881581+0000","last_peered":"2023-08-31T19:07:57.881581+0000","last_clean":"2023-08-31T19:07:57.881581+0000","last_became_active":"2023-08-31T19:07:57.447313+0000","last_became_peered":"2023-08-31T19:07:57.447313+0000","last_unstale":"2023-08-31T19:07:57.881581+0000","last_undegraded":"2023-08-31T19:07:57.881581+0000","last_fullsized":"2023-08-31T19:07:57.881581+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.901554+0000","last_change":"2023-08-31T19:07:57.895004+0000","last_active":"2023-08-31T19:07:57.901554+0000","last_peered":"2023-08-31T19:07:57.901554+0000","last_clean":"2023-08-31T19:07:57.901554+0000","last_became_active":"2023-08-31T19:07:57.894725+0000","last_became_peered":"2023-08-31T19:07:57.894725+0000","last_unstale":"2023-08-31T19:07:57.901554+0000","last_undegraded":"2023-08-31T19:07:57.901554+0000","last_fullsized":"2023-08-31T19:07:57.901554+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.884448+0000","last_change":"2023-08-31T19:07:57.446366+0000","last_active":"2023-08-31T19:07:57.884448+0000","last_peered":"2023-08-31T19:07:57.884448+0000","last_clean":"2023-08-31T19:07:57.884448+0000","last_became_active":"2023-08-31T19:07:57.445898+0000","last_became_peered":"2023-08-31T19:07:57.445898+0000","last_unstale":"2023-08-31T19:07:57.884448+0000","last_undegraded":"2023-08-31T19:07:57.884448+0000","last_fullsized":"2023-08-31T19:07:57.884448+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.915427+0000","last_change":"2023-08-31T19:07:57.911413+0000","last_active":"2023-08-31T19:07:57.915427+0000","last_peered":"2023-08-31T19:07:57.915427+0000","last_clean":"2023-08-31T19:07:57.915427+0000","last_became_active":"2023-08-31T19:07:57.911126+0000","last_became_peered":"2023-08-31T19:07:57.911126+0000","last_unstale":"2023-08-31T19:07:57.915427+0000","last_undegraded":"2023-08-31T19:07:57.915427+0000","last_fullsized":"2023-08-31T19:07:57.915427+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.880578+0000","last_change":"2023-08-31T19:07:57.443719+0000","last_active":"2023-08-31T19:07:57.880578+0000","last_peered":"2023-08-31T19:07:57.880578+0000","last_clean":"2023-08-31T19:07:57.880578+0000","last_became_active":"2023-08-31T19:07:57.443466+0000","last_became_peered":"2023-08-31T19:07:57.443466+0000","last_unstale":"2023-08-31T19:07:57.880578+0000","last_undegraded":"2023-08-31T19:07:57.880578+0000","last_fullsized":"2023-08-31T19:07:57.880578+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.915530+0000","last_change":"2023-08-31T19:07:57.911610+0000","last_active":"2023-08-31T19:07:57.915530+0000","last_peered":"2023-08-31T19:07:57.915530+0000","last_clean":"2023-08-31T19:07:57.915530+0000","last_became_active":"2023-08-31T19:07:57.911208+0000","last_became_peered":"2023-08-31T19:07:57.911208+0000","last_unstale":"2023-08-31T19:07:57.915530+0000","last_undegraded":"2023-08-31T19:07:57.915530+0000","last_fullsized":"2023-08-31T19:07:57.915530+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.885701+0000","last_change":"2023-08-31T19:07:57.439955+0000","last_active":"2023-08-31T19:07:57.885701+0000","last_peered":"2023-08-31T19:07:57.885701+0000","last_clean":"2023-08-31T19:07:57.885701+0000","last_became_active":"2023-08-31T19:07:57.439563+0000","last_became_peered":"2023-08-31T19:07:57.439563+0000","last_unstale":"2023-08-31T19:07:57.885701+0000","last_undegraded":"2023-08-31T19:07:57.885701+0000","last_fullsized":"2023-08-31T19:07:57.885701+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.901481+0000","last_change":"2023-08-31T19:07:57.894055+0000","last_active":"2023-08-31T19:07:57.901481+0000","last_peered":"2023-08-31T19:07:57.901481+0000","last_clean":"2023-08-31T19:07:57.901481+0000","last_became_active":"2023-08-31T19:07:57.893725+0000","last_became_peered":"2023-08-31T19:07:57.893725+0000","last_unstale":"2023-08-31T19:07:57.901481+0000","last_undegraded":"2023-08-31T19:07:57.901481+0000","last_fullsized":"2023-08-31T19:07:57.901481+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"156'4","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.913738+0000","last_change":"2023-08-31T19:07:57.437291+0000","last_active":"2023-08-31T19:07:57.913738+0000","last_peered":"2023-08-31T19:07:57.913738+0000","last_clean":"2023-08-31T19:07:57.913738+0000","last_became_active":"2023-08-31T19:07:57.436999+0000","last_became_peered":"2023-08-31T19:07:57.436999+0000","last_unstale":"2023-08-31T19:07:57.913738+0000","last_undegraded":"2023-08-31T19:07:57.913738+0000","last_fullsized":"2023-08-31T19:07:57.913738+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.907083+0000","last_change":"2023-08-31T19:07:57.903388+0000","last_active":"2023-08-31T19:07:57.907083+0000","last_peered":"2023-08-31T19:07:57.907083+0000","last_clean":"2023-08-31T19:07:57.907083+0000","last_became_active":"2023-08-31T19:07:57.903077+0000","last_became_peered":"2023-08-31T19:07:57.903077+0000","last_unstale":"2023-08-31T19:07:57.907083+0000","last_undegraded":"2023-08-31T19:07:57.907083+0000","last_fullsized":"2023-08-31T19:07:57.907083+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.33","version":"156'1","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.906153+0000","last_change":"2023-08-31T19:07:57.439267+0000","last_active":"2023-08-31T19:07:57.906153+0000","last_peered":"2023-08-31T19:07:57.906153+0000","last_clean":"2023-08-31T19:07:57.906153+0000","last_became_active":"2023-08-31T19:07:57.438936+0000","last_became_peered":"2023-08-31T19:07:57.438936+0000","last_unstale":"2023-08-31T19:07:57.906153+0000","last_undegraded":"2023-08-31T19:07:57.906153+0000","last_fullsized":"2023-08-31T19:07:57.906153+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910164+0000","last_change":"2023-08-31T19:07:57.902995+0000","last_active":"2023-08-31T19:07:57.910164+0000","last_peered":"2023-08-31T19:07:57.910164+0000","last_clean":"2023-08-31T19:07:57.910164+0000","last_became_active":"2023-08-31T19:07:57.902676+0000","last_became_peered":"2023-08-31T19:07:57.902676+0000","last_unstale":"2023-08-31T19:07:57.910164+0000","last_undegraded":"2023-08-31T19:07:57.910164+0000","last_fullsized":"2023-08-31T19:07:57.910164+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.880861+0000","last_change":"2023-08-31T19:07:57.443392+0000","last_active":"2023-08-31T19:07:57.880861+0000","last_peered":"2023-08-31T19:07:57.880861+0000","last_clean":"2023-08-31T19:07:57.880861+0000","last_became_active":"2023-08-31T19:07:57.443011+0000","last_became_peered":"2023-08-31T19:07:57.443011+0000","last_unstale":"2023-08-31T19:07:57.880861+0000","last_undegraded":"2023-08-31T19:07:57.880861+0000","last_fullsized":"2023-08-31T19:07:57.880861+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.904101+0000","last_change":"2023-08-31T19:07:57.898484+0000","last_active":"2023-08-31T19:07:57.904101+0000","last_peered":"2023-08-31T19:07:57.904101+0000","last_clean":"2023-08-31T19:07:57.904101+0000","last_became_active":"2023-08-31T19:07:57.897995+0000","last_became_peered":"2023-08-31T19:07:57.897995+0000","last_unstale":"2023-08-31T19:07:57.904101+0000","last_undegraded":"2023-08-31T19:07:57.904101+0000","last_fullsized":"2023-08-31T19:07:57.904101+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.889941+0000","last_change":"2023-08-31T19:07:57.448540+0000","last_active":"2023-08-31T19:07:57.889941+0000","last_peered":"2023-08-31T19:07:57.889941+0000","last_clean":"2023-08-31T19:07:57.889941+0000","last_became_active":"2023-08-31T19:07:57.448280+0000","last_became_peered":"2023-08-31T19:07:57.448280+0000","last_unstale":"2023-08-31T19:07:57.889941+0000","last_undegraded":"2023-08-31T19:07:57.889941+0000","last_fullsized":"2023-08-31T19:07:57.889941+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908785+0000","last_change":"2023-08-31T19:07:57.904139+0000","last_active":"2023-08-31T19:07:57.908785+0000","last_peered":"2023-08-31T19:07:57.908785+0000","last_clean":"2023-08-31T19:07:57.908785+0000","last_became_active":"2023-08-31T19:07:57.903841+0000","last_became_peered":"2023-08-31T19:07:57.903841+0000","last_unstale":"2023-08-31T19:07:57.908785+0000","last_undegraded":"2023-08-31T19:07:57.908785+0000","last_fullsized":"2023-08-31T19:07:57.908785+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.30","version":"156'4","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.904761+0000","last_change":"2023-08-31T19:07:57.452220+0000","last_active":"2023-08-31T19:07:57.904761+0000","last_peered":"2023-08-31T19:07:57.904761+0000","last_clean":"2023-08-31T19:07:57.904761+0000","last_became_active":"2023-08-31T19:07:57.451902+0000","last_became_peered":"2023-08-31T19:07:57.451902+0000","last_unstale":"2023-08-31T19:07:57.904761+0000","last_undegraded":"2023-08-31T19:07:57.904761+0000","last_fullsized":"2023-08-31T19:07:57.904761+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.902631+0000","last_change":"2023-08-31T19:07:57.898125+0000","last_active":"2023-08-31T19:07:57.902631+0000","last_peered":"2023-08-31T19:07:57.902631+0000","last_clean":"2023-08-31T19:07:57.902631+0000","last_became_active":"2023-08-31T19:07:57.897806+0000","last_became_peered":"2023-08-31T19:07:57.897806+0000","last_unstale":"2023-08-31T19:07:57.902631+0000","last_undegraded":"2023-08-31T19:07:57.902631+0000","last_fullsized":"2023-08-31T19:07:57.902631+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.892226+0000","last_change":"2023-08-31T19:07:57.447098+0000","last_active":"2023-08-31T19:07:57.892226+0000","last_peered":"2023-08-31T19:07:57.892226+0000","last_clean":"2023-08-31T19:07:57.892226+0000","last_became_active":"2023-08-31T19:07:57.446782+0000","last_became_peered":"2023-08-31T19:07:57.446782+0000","last_unstale":"2023-08-31T19:07:57.892226+0000","last_undegraded":"2023-08-31T19:07:57.892226+0000","last_fullsized":"2023-08-31T19:07:57.892226+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.913475+0000","last_change":"2023-08-31T19:07:57.912273+0000","last_active":"2023-08-31T19:07:57.913475+0000","last_peered":"2023-08-31T19:07:57.913475+0000","last_clean":"2023-08-31T19:07:57.913475+0000","last_became_active":"2023-08-31T19:07:57.911972+0000","last_became_peered":"2023-08-31T19:07:57.911972+0000","last_unstale":"2023-08-31T19:07:57.913475+0000","last_undegraded":"2023-08-31T19:07:57.913475+0000","last_fullsized":"2023-08-31T19:07:57.913475+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.890867+0000","last_change":"2023-08-31T19:07:57.455119+0000","last_active":"2023-08-31T19:07:57.890867+0000","last_peered":"2023-08-31T19:07:57.890867+0000","last_clean":"2023-08-31T19:07:57.890867+0000","last_became_active":"2023-08-31T19:07:57.454818+0000","last_became_peered":"2023-08-31T19:07:57.454818+0000","last_unstale":"2023-08-31T19:07:57.890867+0000","last_undegraded":"2023-08-31T19:07:57.890867+0000","last_fullsized":"2023-08-31T19:07:57.890867+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.912868+0000","last_change":"2023-08-31T19:07:57.909171+0000","last_active":"2023-08-31T19:07:57.912868+0000","last_peered":"2023-08-31T19:07:57.912868+0000","last_clean":"2023-08-31T19:07:57.912868+0000","last_became_active":"2023-08-31T19:07:57.908922+0000","last_became_peered":"2023-08-31T19:07:57.908922+0000","last_unstale":"2023-08-31T19:07:57.912868+0000","last_undegraded":"2023-08-31T19:07:57.912868+0000","last_fullsized":"2023-08-31T19:07:57.912868+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2d","version":"156'1","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.896522+0000","last_change":"2023-08-31T19:07:57.435424+0000","last_active":"2023-08-31T19:07:57.896522+0000","last_peered":"2023-08-31T19:07:57.896522+0000","last_clean":"2023-08-31T19:07:57.896522+0000","last_became_active":"2023-08-31T19:07:57.435091+0000","last_became_peered":"2023-08-31T19:07:57.435091+0000","last_unstale":"2023-08-31T19:07:57.896522+0000","last_undegraded":"2023-08-31T19:07:57.896522+0000","last_fullsized":"2023-08-31T19:07:57.896522+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910192+0000","last_change":"2023-08-31T19:07:57.904013+0000","last_active":"2023-08-31T19:07:57.910192+0000","last_peered":"2023-08-31T19:07:57.910192+0000","last_clean":"2023-08-31T19:07:57.910192+0000","last_became_active":"2023-08-31T19:07:57.903721+0000","last_became_peered":"2023-08-31T19:07:57.903721+0000","last_unstale":"2023-08-31T19:07:57.910192+0000","last_undegraded":"2023-08-31T19:07:57.910192+0000","last_fullsized":"2023-08-31T19:07:57.910192+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.890988+0000","last_change":"2023-08-31T19:07:57.448261+0000","last_active":"2023-08-31T19:07:57.890988+0000","last_peered":"2023-08-31T19:07:57.890988+0000","last_clean":"2023-08-31T19:07:57.890988+0000","last_became_active":"2023-08-31T19:07:57.447573+0000","last_became_peered":"2023-08-31T19:07:57.447573+0000","last_unstale":"2023-08-31T19:07:57.890988+0000","last_undegraded":"2023-08-31T19:07:57.890988+0000","last_fullsized":"2023-08-31T19:07:57.890988+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.915512+0000","last_change":"2023-08-31T19:07:57.910925+0000","last_active":"2023-08-31T19:07:57.915512+0000","last_peered":"2023-08-31T19:07:57.915512+0000","last_clean":"2023-08-31T19:07:57.915512+0000","last_became_active":"2023-08-31T19:07:57.910597+0000","last_became_peered":"2023-08-31T19:07:57.910597+0000","last_unstale":"2023-08-31T19:07:57.915512+0000","last_undegraded":"2023-08-31T19:07:57.915512+0000","last_fullsized":"2023-08-31T19:07:57.915512+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"156'1","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908991+0000","last_change":"2023-08-31T19:07:57.456398+0000","last_active":"2023-08-31T19:07:57.908991+0000","last_peered":"2023-08-31T19:07:57.908991+0000","last_clean":"2023-08-31T19:07:57.908991+0000","last_became_active":"2023-08-31T19:07:57.456121+0000","last_became_peered":"2023-08-31T19:07:57.456121+0000","last_unstale":"2023-08-31T19:07:57.908991+0000","last_undegraded":"2023-08-31T19:07:57.908991+0000","last_fullsized":"2023-08-31T19:07:57.908991+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910753+0000","last_change":"2023-08-31T19:07:57.902744+0000","last_active":"2023-08-31T19:07:57.910753+0000","last_peered":"2023-08-31T19:07:57.910753+0000","last_clean":"2023-08-31T19:07:57.910753+0000","last_became_active":"2023-08-31T19:07:57.902424+0000","last_became_peered":"2023-08-31T19:07:57.902424+0000","last_unstale":"2023-08-31T19:07:57.910753+0000","last_undegraded":"2023-08-31T19:07:57.910753+0000","last_fullsized":"2023-08-31T19:07:57.910753+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.884882+0000","last_change":"2023-08-31T19:07:57.439814+0000","last_active":"2023-08-31T19:07:57.884882+0000","last_peered":"2023-08-31T19:07:57.884882+0000","last_clean":"2023-08-31T19:07:57.884882+0000","last_became_active":"2023-08-31T19:07:57.439388+0000","last_became_peered":"2023-08-31T19:07:57.439388+0000","last_unstale":"2023-08-31T19:07:57.884882+0000","last_undegraded":"2023-08-31T19:07:57.884882+0000","last_fullsized":"2023-08-31T19:07:57.884882+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.904382+0000","last_change":"2023-08-31T19:07:57.899945+0000","last_active":"2023-08-31T19:07:57.904382+0000","last_peered":"2023-08-31T19:07:57.904382+0000","last_clean":"2023-08-31T19:07:57.904382+0000","last_became_active":"2023-08-31T19:07:57.899702+0000","last_became_peered":"2023-08-31T19:07:57.899702+0000","last_unstale":"2023-08-31T19:07:57.904382+0000","last_undegraded":"2023-08-31T19:07:57.904382+0000","last_fullsized":"2023-08-31T19:07:57.904382+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.882311+0000","last_change":"2023-08-31T19:07:57.446904+0000","last_active":"2023-08-31T19:07:57.882311+0000","last_peered":"2023-08-31T19:07:57.882311+0000","last_clean":"2023-08-31T19:07:57.882311+0000","last_became_active":"2023-08-31T19:07:57.446553+0000","last_became_peered":"2023-08-31T19:07:57.446553+0000","last_unstale":"2023-08-31T19:07:57.882311+0000","last_undegraded":"2023-08-31T19:07:57.882311+0000","last_fullsized":"2023-08-31T19:07:57.882311+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.902611+0000","last_change":"2023-08-31T19:07:57.897645+0000","last_active":"2023-08-31T19:07:57.902611+0000","last_peered":"2023-08-31T19:07:57.902611+0000","last_clean":"2023-08-31T19:07:57.902611+0000","last_became_active":"2023-08-31T19:07:57.897341+0000","last_became_peered":"2023-08-31T19:07:57.897341+0000","last_unstale":"2023-08-31T19:07:57.902611+0000","last_undegraded":"2023-08-31T19:07:57.902611+0000","last_fullsized":"2023-08-31T19:07:57.902611+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.885114+0000","last_change":"2023-08-31T19:07:57.446596+0000","last_active":"2023-08-31T19:07:57.885114+0000","last_peered":"2023-08-31T19:07:57.885114+0000","last_clean":"2023-08-31T19:07:57.885114+0000","last_became_active":"2023-08-31T19:07:57.446336+0000","last_became_peered":"2023-08-31T19:07:57.446336+0000","last_unstale":"2023-08-31T19:07:57.885114+0000","last_undegraded":"2023-08-31T19:07:57.885114+0000","last_fullsized":"2023-08-31T19:07:57.885114+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.906117+0000","last_change":"2023-08-31T19:07:57.903528+0000","last_active":"2023-08-31T19:07:57.906117+0000","last_peered":"2023-08-31T19:07:57.906117+0000","last_clean":"2023-08-31T19:07:57.906117+0000","last_became_active":"2023-08-31T19:07:57.903246+0000","last_became_peered":"2023-08-31T19:07:57.903246+0000","last_unstale":"2023-08-31T19:07:57.906117+0000","last_undegraded":"2023-08-31T19:07:57.906117+0000","last_fullsized":"2023-08-31T19:07:57.906117+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.881434+0000","last_change":"2023-08-31T19:07:57.446368+0000","last_active":"2023-08-31T19:07:57.881434+0000","last_peered":"2023-08-31T19:07:57.881434+0000","last_clean":"2023-08-31T19:07:57.881434+0000","last_became_active":"2023-08-31T19:07:57.446106+0000","last_became_peered":"2023-08-31T19:07:57.446106+0000","last_unstale":"2023-08-31T19:07:57.881434+0000","last_undegraded":"2023-08-31T19:07:57.881434+0000","last_fullsized":"2023-08-31T19:07:57.881434+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.907760+0000","last_change":"2023-08-31T19:07:57.902751+0000","last_active":"2023-08-31T19:07:57.907760+0000","last_peered":"2023-08-31T19:07:57.907760+0000","last_clean":"2023-08-31T19:07:57.907760+0000","last_became_active":"2023-08-31T19:07:57.902468+0000","last_became_peered":"2023-08-31T19:07:57.902468+0000","last_unstale":"2023-08-31T19:07:57.907760+0000","last_undegraded":"2023-08-31T19:07:57.907760+0000","last_fullsized":"2023-08-31T19:07:57.907760+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.890963+0000","last_change":"2023-08-31T19:07:57.452355+0000","last_active":"2023-08-31T19:07:57.890963+0000","last_peered":"2023-08-31T19:07:57.890963+0000","last_clean":"2023-08-31T19:07:57.890963+0000","last_became_active":"2023-08-31T19:07:57.451917+0000","last_became_peered":"2023-08-31T19:07:57.451917+0000","last_unstale":"2023-08-31T19:07:57.890963+0000","last_undegraded":"2023-08-31T19:07:57.890963+0000","last_fullsized":"2023-08-31T19:07:57.890963+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908485+0000","last_change":"2023-08-31T19:07:57.897457+0000","last_active":"2023-08-31T19:07:57.908485+0000","last_peered":"2023-08-31T19:07:57.908485+0000","last_clean":"2023-08-31T19:07:57.908485+0000","last_became_active":"2023-08-31T19:07:57.897174+0000","last_became_peered":"2023-08-31T19:07:57.897174+0000","last_unstale":"2023-08-31T19:07:57.908485+0000","last_undegraded":"2023-08-31T19:07:57.908485+0000","last_fullsized":"2023-08-31T19:07:57.908485+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.889675+0000","last_change":"2023-08-31T19:07:57.441367+0000","last_active":"2023-08-31T19:07:57.889675+0000","last_peered":"2023-08-31T19:07:57.889675+0000","last_clean":"2023-08-31T19:07:57.889675+0000","last_became_active":"2023-08-31T19:07:57.441073+0000","last_became_peered":"2023-08-31T19:07:57.441073+0000","last_unstale":"2023-08-31T19:07:57.889675+0000","last_undegraded":"2023-08-31T19:07:57.889675+0000","last_fullsized":"2023-08-31T19:07:57.889675+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908086+0000","last_change":"2023-08-31T19:07:57.901472+0000","last_active":"2023-08-31T19:07:57.908086+0000","last_peered":"2023-08-31T19:07:57.908086+0000","last_clean":"2023-08-31T19:07:57.908086+0000","last_became_active":"2023-08-31T19:07:57.900872+0000","last_became_peered":"2023-08-31T19:07:57.900872+0000","last_unstale":"2023-08-31T19:07:57.908086+0000","last_undegraded":"2023-08-31T19:07:57.908086+0000","last_fullsized":"2023-08-31T19:07:57.908086+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.888471+0000","last_change":"2023-08-31T19:07:57.447647+0000","last_active":"2023-08-31T19:07:57.888471+0000","last_peered":"2023-08-31T19:07:57.888471+0000","last_clean":"2023-08-31T19:07:57.888471+0000","last_became_active":"2023-08-31T19:07:57.447354+0000","last_became_peered":"2023-08-31T19:07:57.447354+0000","last_unstale":"2023-08-31T19:07:57.888471+0000","last_undegraded":"2023-08-31T19:07:57.888471+0000","last_fullsized":"2023-08-31T19:07:57.888471+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.904928+0000","last_change":"2023-08-31T19:07:57.898610+0000","last_active":"2023-08-31T19:07:57.904928+0000","last_peered":"2023-08-31T19:07:57.904928+0000","last_clean":"2023-08-31T19:07:57.904928+0000","last_became_active":"2023-08-31T19:07:57.898187+0000","last_became_peered":"2023-08-31T19:07:57.898187+0000","last_unstale":"2023-08-31T19:07:57.904928+0000","last_undegraded":"2023-08-31T19:07:57.904928+0000","last_fullsized":"2023-08-31T19:07:57.904928+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.893533+0000","last_change":"2023-08-31T19:07:57.443069+0000","last_active":"2023-08-31T19:07:57.893533+0000","last_peered":"2023-08-31T19:07:57.893533+0000","last_clean":"2023-08-31T19:07:57.893533+0000","last_became_active":"2023-08-31T19:07:57.442811+0000","last_became_peered":"2023-08-31T19:07:57.442811+0000","last_unstale":"2023-08-31T19:07:57.893533+0000","last_undegraded":"2023-08-31T19:07:57.893533+0000","last_fullsized":"2023-08-31T19:07:57.893533+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910643+0000","last_change":"2023-08-31T19:07:57.899811+0000","last_active":"2023-08-31T19:07:57.910643+0000","last_peered":"2023-08-31T19:07:57.910643+0000","last_clean":"2023-08-31T19:07:57.910643+0000","last_became_active":"2023-08-31T19:07:57.899531+0000","last_became_peered":"2023-08-31T19:07:57.899531+0000","last_unstale":"2023-08-31T19:07:57.910643+0000","last_undegraded":"2023-08-31T19:07:57.910643+0000","last_fullsized":"2023-08-31T19:07:57.910643+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.892636+0000","last_change":"2023-08-31T19:07:57.442572+0000","last_active":"2023-08-31T19:07:57.892636+0000","last_peered":"2023-08-31T19:07:57.892636+0000","last_clean":"2023-08-31T19:07:57.892636+0000","last_became_active":"2023-08-31T19:07:57.441845+0000","last_became_peered":"2023-08-31T19:07:57.441845+0000","last_unstale":"2023-08-31T19:07:57.892636+0000","last_undegraded":"2023-08-31T19:07:57.892636+0000","last_fullsized":"2023-08-31T19:07:57.892636+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.904723+0000","last_change":"2023-08-31T19:07:57.893544+0000","last_active":"2023-08-31T19:07:57.904723+0000","last_peered":"2023-08-31T19:07:57.904723+0000","last_clean":"2023-08-31T19:07:57.904723+0000","last_became_active":"2023-08-31T19:07:57.893227+0000","last_became_peered":"2023-08-31T19:07:57.893227+0000","last_unstale":"2023-08-31T19:07:57.904723+0000","last_undegraded":"2023-08-31T19:07:57.904723+0000","last_fullsized":"2023-08-31T19:07:57.904723+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.880656+0000","last_change":"2023-08-31T19:07:57.452414+0000","last_active":"2023-08-31T19:07:57.880656+0000","last_peered":"2023-08-31T19:07:57.880656+0000","last_clean":"2023-08-31T19:07:57.880656+0000","last_became_active":"2023-08-31T19:07:57.451870+0000","last_became_peered":"2023-08-31T19:07:57.451870+0000","last_unstale":"2023-08-31T19:07:57.880656+0000","last_undegraded":"2023-08-31T19:07:57.880656+0000","last_fullsized":"2023-08-31T19:07:57.880656+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.907926+0000","last_change":"2023-08-31T19:07:57.902213+0000","last_active":"2023-08-31T19:07:57.907926+0000","last_peered":"2023-08-31T19:07:57.907926+0000","last_clean":"2023-08-31T19:07:57.907926+0000","last_became_active":"2023-08-31T19:07:57.901902+0000","last_became_peered":"2023-08-31T19:07:57.901902+0000","last_unstale":"2023-08-31T19:07:57.907926+0000","last_undegraded":"2023-08-31T19:07:57.907926+0000","last_fullsized":"2023-08-31T19:07:57.907926+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.891750+0000","last_change":"2023-08-31T19:07:57.444748+0000","last_active":"2023-08-31T19:07:57.891750+0000","last_peered":"2023-08-31T19:07:57.891750+0000","last_clean":"2023-08-31T19:07:57.891750+0000","last_became_active":"2023-08-31T19:07:57.444456+0000","last_became_peered":"2023-08-31T19:07:57.444456+0000","last_unstale":"2023-08-31T19:07:57.891750+0000","last_undegraded":"2023-08-31T19:07:57.891750+0000","last_fullsized":"2023-08-31T19:07:57.891750+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.912743+0000","last_change":"2023-08-31T19:07:57.911591+0000","last_active":"2023-08-31T19:07:57.912743+0000","last_peered":"2023-08-31T19:07:57.912743+0000","last_clean":"2023-08-31T19:07:57.912743+0000","last_became_active":"2023-08-31T19:07:57.911275+0000","last_became_peered":"2023-08-31T19:07:57.911275+0000","last_unstale":"2023-08-31T19:07:57.912743+0000","last_undegraded":"2023-08-31T19:07:57.912743+0000","last_fullsized":"2023-08-31T19:07:57.912743+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"156'1","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.905224+0000","last_change":"2023-08-31T19:07:57.442675+0000","last_active":"2023-08-31T19:07:57.905224+0000","last_peered":"2023-08-31T19:07:57.905224+0000","last_clean":"2023-08-31T19:07:57.905224+0000","last_became_active":"2023-08-31T19:07:57.442312+0000","last_became_peered":"2023-08-31T19:07:57.442312+0000","last_unstale":"2023-08-31T19:07:57.905224+0000","last_undegraded":"2023-08-31T19:07:57.905224+0000","last_fullsized":"2023-08-31T19:07:57.905224+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.912871+0000","last_change":"2023-08-31T19:07:57.909083+0000","last_active":"2023-08-31T19:07:57.912871+0000","last_peered":"2023-08-31T19:07:57.912871+0000","last_clean":"2023-08-31T19:07:57.912871+0000","last_became_active":"2023-08-31T19:07:57.908675+0000","last_became_peered":"2023-08-31T19:07:57.908675+0000","last_unstale":"2023-08-31T19:07:57.912871+0000","last_undegraded":"2023-08-31T19:07:57.912871+0000","last_fullsized":"2023-08-31T19:07:57.912871+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"156'1","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.904296+0000","last_change":"2023-08-31T19:07:57.447411+0000","last_active":"2023-08-31T19:07:57.904296+0000","last_peered":"2023-08-31T19:07:57.904296+0000","last_clean":"2023-08-31T19:07:57.904296+0000","last_became_active":"2023-08-31T19:07:57.447083+0000","last_became_peered":"2023-08-31T19:07:57.447083+0000","last_unstale":"2023-08-31T19:07:57.904296+0000","last_undegraded":"2023-08-31T19:07:57.904296+0000","last_fullsized":"2023-08-31T19:07:57.904296+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.914650+0000","last_change":"2023-08-31T19:07:57.912495+0000","last_active":"2023-08-31T19:07:57.914650+0000","last_peered":"2023-08-31T19:07:57.914650+0000","last_clean":"2023-08-31T19:07:57.914650+0000","last_became_active":"2023-08-31T19:07:57.912064+0000","last_became_peered":"2023-08-31T19:07:57.912064+0000","last_unstale":"2023-08-31T19:07:57.914650+0000","last_undegraded":"2023-08-31T19:07:57.914650+0000","last_fullsized":"2023-08-31T19:07:57.914650+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"156'2","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910588+0000","last_change":"2023-08-31T19:07:57.451135+0000","last_active":"2023-08-31T19:07:57.910588+0000","last_peered":"2023-08-31T19:07:57.910588+0000","last_clean":"2023-08-31T19:07:57.910588+0000","last_became_active":"2023-08-31T19:07:57.450828+0000","last_became_peered":"2023-08-31T19:07:57.450828+0000","last_unstale":"2023-08-31T19:07:57.910588+0000","last_undegraded":"2023-08-31T19:07:57.910588+0000","last_fullsized":"2023-08-31T19:07:57.910588+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.915442+0000","last_change":"2023-08-31T19:07:57.911500+0000","last_active":"2023-08-31T19:07:57.915442+0000","last_peered":"2023-08-31T19:07:57.915442+0000","last_clean":"2023-08-31T19:07:57.915442+0000","last_became_active":"2023-08-31T19:07:57.911197+0000","last_became_peered":"2023-08-31T19:07:57.911197+0000","last_unstale":"2023-08-31T19:07:57.915442+0000","last_undegraded":"2023-08-31T19:07:57.915442+0000","last_fullsized":"2023-08-31T19:07:57.915442+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.880698+0000","last_change":"2023-08-31T19:07:57.454163+0000","last_active":"2023-08-31T19:07:57.880698+0000","last_peered":"2023-08-31T19:07:57.880698+0000","last_clean":"2023-08-31T19:07:57.880698+0000","last_became_active":"2023-08-31T19:07:57.453873+0000","last_became_peered":"2023-08-31T19:07:57.453873+0000","last_unstale":"2023-08-31T19:07:57.880698+0000","last_undegraded":"2023-08-31T19:07:57.880698+0000","last_fullsized":"2023-08-31T19:07:57.880698+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.909353+0000","last_change":"2023-08-31T19:07:57.904064+0000","last_active":"2023-08-31T19:07:57.909353+0000","last_peered":"2023-08-31T19:07:57.909353+0000","last_clean":"2023-08-31T19:07:57.909353+0000","last_became_active":"2023-08-31T19:07:57.903788+0000","last_became_peered":"2023-08-31T19:07:57.903788+0000","last_unstale":"2023-08-31T19:07:57.909353+0000","last_undegraded":"2023-08-31T19:07:57.909353+0000","last_fullsized":"2023-08-31T19:07:57.909353+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.894633+0000","last_change":"2023-08-31T19:07:57.448048+0000","last_active":"2023-08-31T19:07:57.894633+0000","last_peered":"2023-08-31T19:07:57.894633+0000","last_clean":"2023-08-31T19:07:57.894633+0000","last_became_active":"2023-08-31T19:07:57.447774+0000","last_became_peered":"2023-08-31T19:07:57.447774+0000","last_unstale":"2023-08-31T19:07:57.894633+0000","last_undegraded":"2023-08-31T19:07:57.894633+0000","last_fullsized":"2023-08-31T19:07:57.894633+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.904480+0000","last_change":"2023-08-31T19:07:57.898883+0000","last_active":"2023-08-31T19:07:57.904480+0000","last_peered":"2023-08-31T19:07:57.904480+0000","last_clean":"2023-08-31T19:07:57.904480+0000","last_became_active":"2023-08-31T19:07:57.898539+0000","last_became_peered":"2023-08-31T19:07:57.898539+0000","last_unstale":"2023-08-31T19:07:57.904480+0000","last_undegraded":"2023-08-31T19:07:57.904480+0000","last_fullsized":"2023-08-31T19:07:57.904480+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.890088+0000","last_change":"2023-08-31T19:07:57.455057+0000","last_active":"2023-08-31T19:07:57.890088+0000","last_peered":"2023-08-31T19:07:57.890088+0000","last_clean":"2023-08-31T19:07:57.890088+0000","last_became_active":"2023-08-31T19:07:57.454769+0000","last_became_peered":"2023-08-31T19:07:57.454769+0000","last_unstale":"2023-08-31T19:07:57.890088+0000","last_undegraded":"2023-08-31T19:07:57.890088+0000","last_fullsized":"2023-08-31T19:07:57.890088+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.915485+0000","last_change":"2023-08-31T19:07:57.910819+0000","last_active":"2023-08-31T19:07:57.915485+0000","last_peered":"2023-08-31T19:07:57.915485+0000","last_clean":"2023-08-31T19:07:57.915485+0000","last_became_active":"2023-08-31T19:07:57.910489+0000","last_became_peered":"2023-08-31T19:07:57.910489+0000","last_unstale":"2023-08-31T19:07:57.915485+0000","last_undegraded":"2023-08-31T19:07:57.915485+0000","last_fullsized":"2023-08-31T19:07:57.915485+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.880052+0000","last_change":"2023-08-31T19:07:57.450388+0000","last_active":"2023-08-31T19:07:57.880052+0000","last_peered":"2023-08-31T19:07:57.880052+0000","last_clean":"2023-08-31T19:07:57.880052+0000","last_became_active":"2023-08-31T19:07:57.450088+0000","last_became_peered":"2023-08-31T19:07:57.450088+0000","last_unstale":"2023-08-31T19:07:57.880052+0000","last_undegraded":"2023-08-31T19:07:57.880052+0000","last_fullsized":"2023-08-31T19:07:57.880052+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.907934+0000","last_change":"2023-08-31T19:07:57.890765+0000","last_active":"2023-08-31T19:07:57.907934+0000","last_peered":"2023-08-31T19:07:57.907934+0000","last_clean":"2023-08-31T19:07:57.907934+0000","last_became_active":"2023-08-31T19:07:57.890446+0000","last_became_peered":"2023-08-31T19:07:57.890446+0000","last_unstale":"2023-08-31T19:07:57.907934+0000","last_undegraded":"2023-08-31T19:07:57.907934+0000","last_fullsized":"2023-08-31T19:07:57.907934+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.881856+0000","last_change":"2023-08-31T19:07:57.447110+0000","last_active":"2023-08-31T19:07:57.881856+0000","last_peered":"2023-08-31T19:07:57.881856+0000","last_clean":"2023-08-31T19:07:57.881856+0000","last_became_active":"2023-08-31T19:07:57.446724+0000","last_became_peered":"2023-08-31T19:07:57.446724+0000","last_unstale":"2023-08-31T19:07:57.881856+0000","last_undegraded":"2023-08-31T19:07:57.881856+0000","last_fullsized":"2023-08-31T19:07:57.881856+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.904836+0000","last_change":"2023-08-31T19:07:57.895524+0000","last_active":"2023-08-31T19:07:57.904836+0000","last_peered":"2023-08-31T19:07:57.904836+0000","last_clean":"2023-08-31T19:07:57.904836+0000","last_became_active":"2023-08-31T19:07:57.895234+0000","last_became_peered":"2023-08-31T19:07:57.895234+0000","last_unstale":"2023-08-31T19:07:57.904836+0000","last_undegraded":"2023-08-31T19:07:57.904836+0000","last_fullsized":"2023-08-31T19:07:57.904836+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"156'1","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.902693+0000","last_change":"2023-08-31T19:07:57.449973+0000","last_active":"2023-08-31T19:07:57.902693+0000","last_peered":"2023-08-31T19:07:57.902693+0000","last_clean":"2023-08-31T19:07:57.902693+0000","last_became_active":"2023-08-31T19:07:57.449478+0000","last_became_peered":"2023-08-31T19:07:57.449478+0000","last_unstale":"2023-08-31T19:07:57.902693+0000","last_undegraded":"2023-08-31T19:07:57.902693+0000","last_fullsized":"2023-08-31T19:07:57.902693+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910611+0000","last_change":"2023-08-31T19:07:57.906553+0000","last_active":"2023-08-31T19:07:57.910611+0000","last_peered":"2023-08-31T19:07:57.910611+0000","last_clean":"2023-08-31T19:07:57.910611+0000","last_became_active":"2023-08-31T19:07:57.903214+0000","last_became_peered":"2023-08-31T19:07:57.903214+0000","last_unstale":"2023-08-31T19:07:57.910611+0000","last_undegraded":"2023-08-31T19:07:57.910611+0000","last_fullsized":"2023-08-31T19:07:57.910611+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"156'2","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.905205+0000","last_change":"2023-08-31T19:07:57.435251+0000","last_active":"2023-08-31T19:07:57.905205+0000","last_peered":"2023-08-31T19:07:57.905205+0000","last_clean":"2023-08-31T19:07:57.905205+0000","last_became_active":"2023-08-31T19:07:57.434969+0000","last_became_peered":"2023-08-31T19:07:57.434969+0000","last_unstale":"2023-08-31T19:07:57.905205+0000","last_undegraded":"2023-08-31T19:07:57.905205+0000","last_fullsized":"2023-08-31T19:07:57.905205+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910276+0000","last_change":"2023-08-31T19:07:57.893074+0000","last_active":"2023-08-31T19:07:57.910276+0000","last_peered":"2023-08-31T19:07:57.910276+0000","last_clean":"2023-08-31T19:07:57.910276+0000","last_became_active":"2023-08-31T19:07:57.891121+0000","last_became_peered":"2023-08-31T19:07:57.891121+0000","last_unstale":"2023-08-31T19:07:57.910276+0000","last_undegraded":"2023-08-31T19:07:57.910276+0000","last_fullsized":"2023-08-31T19:07:57.910276+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.880201+0000","last_change":"2023-08-31T19:07:57.445541+0000","last_active":"2023-08-31T19:07:57.880201+0000","last_peered":"2023-08-31T19:07:57.880201+0000","last_clean":"2023-08-31T19:07:57.880201+0000","last_became_active":"2023-08-31T19:07:57.444796+0000","last_became_peered":"2023-08-31T19:07:57.444796+0000","last_unstale":"2023-08-31T19:07:57.880201+0000","last_undegraded":"2023-08-31T19:07:57.880201+0000","last_fullsized":"2023-08-31T19:07:57.880201+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.903388+0000","last_change":"2023-08-31T19:07:57.896324+0000","last_active":"2023-08-31T19:07:57.903388+0000","last_peered":"2023-08-31T19:07:57.903388+0000","last_clean":"2023-08-31T19:07:57.903388+0000","last_became_active":"2023-08-31T19:07:57.896069+0000","last_became_peered":"2023-08-31T19:07:57.896069+0000","last_unstale":"2023-08-31T19:07:57.903388+0000","last_undegraded":"2023-08-31T19:07:57.903388+0000","last_fullsized":"2023-08-31T19:07:57.903388+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.891074+0000","last_change":"2023-08-31T19:07:57.453989+0000","last_active":"2023-08-31T19:07:57.891074+0000","last_peered":"2023-08-31T19:07:57.891074+0000","last_clean":"2023-08-31T19:07:57.891074+0000","last_became_active":"2023-08-31T19:07:57.451946+0000","last_became_peered":"2023-08-31T19:07:57.451946+0000","last_unstale":"2023-08-31T19:07:57.891074+0000","last_undegraded":"2023-08-31T19:07:57.891074+0000","last_fullsized":"2023-08-31T19:07:57.891074+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.906210+0000","last_change":"2023-08-31T19:07:57.902275+0000","last_active":"2023-08-31T19:07:57.906210+0000","last_peered":"2023-08-31T19:07:57.906210+0000","last_clean":"2023-08-31T19:07:57.906210+0000","last_became_active":"2023-08-31T19:07:57.901968+0000","last_became_peered":"2023-08-31T19:07:57.901968+0000","last_unstale":"2023-08-31T19:07:57.906210+0000","last_undegraded":"2023-08-31T19:07:57.906210+0000","last_fullsized":"2023-08-31T19:07:57.906210+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"156'1","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.909647+0000","last_change":"2023-08-31T19:07:57.447914+0000","last_active":"2023-08-31T19:07:57.909647+0000","last_peered":"2023-08-31T19:07:57.909647+0000","last_clean":"2023-08-31T19:07:57.909647+0000","last_became_active":"2023-08-31T19:07:57.447361+0000","last_became_peered":"2023-08-31T19:07:57.447361+0000","last_unstale":"2023-08-31T19:07:57.909647+0000","last_undegraded":"2023-08-31T19:07:57.909647+0000","last_fullsized":"2023-08-31T19:07:57.909647+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.912908+0000","last_change":"2023-08-31T19:07:57.909515+0000","last_active":"2023-08-31T19:07:57.912908+0000","last_peered":"2023-08-31T19:07:57.912908+0000","last_clean":"2023-08-31T19:07:57.912908+0000","last_became_active":"2023-08-31T19:07:57.909228+0000","last_became_peered":"2023-08-31T19:07:57.909228+0000","last_unstale":"2023-08-31T19:07:57.912908+0000","last_undegraded":"2023-08-31T19:07:57.912908+0000","last_fullsized":"2023-08-31T19:07:57.912908+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.891739+0000","last_change":"2023-08-31T19:07:57.440546+0000","last_active":"2023-08-31T19:07:57.891739+0000","last_peered":"2023-08-31T19:07:57.891739+0000","last_clean":"2023-08-31T19:07:57.891739+0000","last_became_active":"2023-08-31T19:07:57.440288+0000","last_became_peered":"2023-08-31T19:07:57.440288+0000","last_unstale":"2023-08-31T19:07:57.891739+0000","last_undegraded":"2023-08-31T19:07:57.891739+0000","last_fullsized":"2023-08-31T19:07:57.891739+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.905567+0000","last_change":"2023-08-31T19:07:57.900461+0000","last_active":"2023-08-31T19:07:57.905567+0000","last_peered":"2023-08-31T19:07:57.905567+0000","last_clean":"2023-08-31T19:07:57.905567+0000","last_became_active":"2023-08-31T19:07:57.900211+0000","last_became_peered":"2023-08-31T19:07:57.900211+0000","last_unstale":"2023-08-31T19:07:57.905567+0000","last_undegraded":"2023-08-31T19:07:57.905567+0000","last_fullsized":"2023-08-31T19:07:57.905567+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.880803+0000","last_change":"2023-08-31T19:07:57.452592+0000","last_active":"2023-08-31T19:07:57.880803+0000","last_peered":"2023-08-31T19:07:57.880803+0000","last_clean":"2023-08-31T19:07:57.880803+0000","last_became_active":"2023-08-31T19:07:57.452306+0000","last_became_peered":"2023-08-31T19:07:57.452306+0000","last_unstale":"2023-08-31T19:07:57.880803+0000","last_undegraded":"2023-08-31T19:07:57.880803+0000","last_fullsized":"2023-08-31T19:07:57.880803+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910132+0000","last_change":"2023-08-31T19:07:57.903221+0000","last_active":"2023-08-31T19:07:57.910132+0000","last_peered":"2023-08-31T19:07:57.910132+0000","last_clean":"2023-08-31T19:07:57.910132+0000","last_became_active":"2023-08-31T19:07:57.902959+0000","last_became_peered":"2023-08-31T19:07:57.902959+0000","last_unstale":"2023-08-31T19:07:57.910132+0000","last_undegraded":"2023-08-31T19:07:57.910132+0000","last_fullsized":"2023-08-31T19:07:57.910132+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.880801+0000","last_change":"2023-08-31T19:07:57.438945+0000","last_active":"2023-08-31T19:07:57.880801+0000","last_peered":"2023-08-31T19:07:57.880801+0000","last_clean":"2023-08-31T19:07:57.880801+0000","last_became_active":"2023-08-31T19:07:57.438473+0000","last_became_peered":"2023-08-31T19:07:57.438473+0000","last_unstale":"2023-08-31T19:07:57.880801+0000","last_undegraded":"2023-08-31T19:07:57.880801+0000","last_fullsized":"2023-08-31T19:07:57.880801+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.915525+0000","last_change":"2023-08-31T19:07:57.910985+0000","last_active":"2023-08-31T19:07:57.915525+0000","last_peered":"2023-08-31T19:07:57.915525+0000","last_clean":"2023-08-31T19:07:57.915525+0000","last_became_active":"2023-08-31T19:07:57.910484+0000","last_became_peered":"2023-08-31T19:07:57.910484+0000","last_unstale":"2023-08-31T19:07:57.915525+0000","last_undegraded":"2023-08-31T19:07:57.915525+0000","last_fullsized":"2023-08-31T19:07:57.915525+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"156'2","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908252+0000","last_change":"2023-08-31T19:07:57.446340+0000","last_active":"2023-08-31T19:07:57.908252+0000","last_peered":"2023-08-31T19:07:57.908252+0000","last_clean":"2023-08-31T19:07:57.908252+0000","last_became_active":"2023-08-31T19:07:57.445912+0000","last_became_peered":"2023-08-31T19:07:57.445912+0000","last_unstale":"2023-08-31T19:07:57.908252+0000","last_undegraded":"2023-08-31T19:07:57.908252+0000","last_fullsized":"2023-08-31T19:07:57.908252+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.907828+0000","last_change":"2023-08-31T19:07:57.898212+0000","last_active":"2023-08-31T19:07:57.907828+0000","last_peered":"2023-08-31T19:07:57.907828+0000","last_clean":"2023-08-31T19:07:57.907828+0000","last_became_active":"2023-08-31T19:07:57.897888+0000","last_became_peered":"2023-08-31T19:07:57.897888+0000","last_unstale":"2023-08-31T19:07:57.907828+0000","last_undegraded":"2023-08-31T19:07:57.907828+0000","last_fullsized":"2023-08-31T19:07:57.907828+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.894662+0000","last_change":"2023-08-31T19:07:57.451988+0000","last_active":"2023-08-31T19:07:57.894662+0000","last_peered":"2023-08-31T19:07:57.894662+0000","last_clean":"2023-08-31T19:07:57.894662+0000","last_became_active":"2023-08-31T19:07:57.451621+0000","last_became_peered":"2023-08-31T19:07:57.451621+0000","last_unstale":"2023-08-31T19:07:57.894662+0000","last_undegraded":"2023-08-31T19:07:57.894662+0000","last_fullsized":"2023-08-31T19:07:57.894662+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.893222+0000","last_change":"2023-08-31T19:07:57.889391+0000","last_active":"2023-08-31T19:07:57.893222+0000","last_peered":"2023-08-31T19:07:57.893222+0000","last_clean":"2023-08-31T19:07:57.893222+0000","last_became_active":"2023-08-31T19:07:57.889085+0000","last_became_peered":"2023-08-31T19:07:57.889085+0000","last_unstale":"2023-08-31T19:07:57.893222+0000","last_undegraded":"2023-08-31T19:07:57.893222+0000","last_fullsized":"2023-08-31T19:07:57.893222+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.895748+0000","last_change":"2023-08-31T19:07:57.452322+0000","last_active":"2023-08-31T19:07:57.895748+0000","last_peered":"2023-08-31T19:07:57.895748+0000","last_clean":"2023-08-31T19:07:57.895748+0000","last_became_active":"2023-08-31T19:07:57.451971+0000","last_became_peered":"2023-08-31T19:07:57.451971+0000","last_unstale":"2023-08-31T19:07:57.895748+0000","last_undegraded":"2023-08-31T19:07:57.895748+0000","last_fullsized":"2023-08-31T19:07:57.895748+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.906422+0000","last_change":"2023-08-31T19:07:57.899213+0000","last_active":"2023-08-31T19:07:57.906422+0000","last_peered":"2023-08-31T19:07:57.906422+0000","last_clean":"2023-08-31T19:07:57.906422+0000","last_became_active":"2023-08-31T19:07:57.898870+0000","last_became_peered":"2023-08-31T19:07:57.898870+0000","last_unstale":"2023-08-31T19:07:57.906422+0000","last_undegraded":"2023-08-31T19:07:57.906422+0000","last_fullsized":"2023-08-31T19:07:57.906422+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.881018+0000","last_change":"2023-08-31T19:07:57.445269+0000","last_active":"2023-08-31T19:07:57.881018+0000","last_peered":"2023-08-31T19:07:57.881018+0000","last_clean":"2023-08-31T19:07:57.881018+0000","last_became_active":"2023-08-31T19:07:57.444992+0000","last_became_peered":"2023-08-31T19:07:57.444992+0000","last_unstale":"2023-08-31T19:07:57.881018+0000","last_undegraded":"2023-08-31T19:07:57.881018+0000","last_fullsized":"2023-08-31T19:07:57.881018+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.902606+0000","last_change":"2023-08-31T19:07:57.899146+0000","last_active":"2023-08-31T19:07:57.902606+0000","last_peered":"2023-08-31T19:07:57.902606+0000","last_clean":"2023-08-31T19:07:57.902606+0000","last_became_active":"2023-08-31T19:07:57.898862+0000","last_became_peered":"2023-08-31T19:07:57.898862+0000","last_unstale":"2023-08-31T19:07:57.902606+0000","last_undegraded":"2023-08-31T19:07:57.902606+0000","last_fullsized":"2023-08-31T19:07:57.902606+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.889135+0000","last_change":"2023-08-31T19:07:57.454470+0000","last_active":"2023-08-31T19:07:57.889135+0000","last_peered":"2023-08-31T19:07:57.889135+0000","last_clean":"2023-08-31T19:07:57.889135+0000","last_became_active":"2023-08-31T19:07:57.454077+0000","last_became_peered":"2023-08-31T19:07:57.454077+0000","last_unstale":"2023-08-31T19:07:57.889135+0000","last_undegraded":"2023-08-31T19:07:57.889135+0000","last_fullsized":"2023-08-31T19:07:57.889135+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.902339+0000","last_change":"2023-08-31T19:07:57.895602+0000","last_active":"2023-08-31T19:07:57.902339+0000","last_peered":"2023-08-31T19:07:57.902339+0000","last_clean":"2023-08-31T19:07:57.902339+0000","last_became_active":"2023-08-31T19:07:57.895317+0000","last_became_peered":"2023-08-31T19:07:57.895317+0000","last_unstale":"2023-08-31T19:07:57.902339+0000","last_undegraded":"2023-08-31T19:07:57.902339+0000","last_fullsized":"2023-08-31T19:07:57.902339+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.881127+0000","last_change":"2023-08-31T19:07:57.454163+0000","last_active":"2023-08-31T19:07:57.881127+0000","last_peered":"2023-08-31T19:07:57.881127+0000","last_clean":"2023-08-31T19:07:57.881127+0000","last_became_active":"2023-08-31T19:07:57.453861+0000","last_became_peered":"2023-08-31T19:07:57.453861+0000","last_unstale":"2023-08-31T19:07:57.881127+0000","last_undegraded":"2023-08-31T19:07:57.881127+0000","last_fullsized":"2023-08-31T19:07:57.881127+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.901485+0000","last_change":"2023-08-31T19:07:57.893041+0000","last_active":"2023-08-31T19:07:57.901485+0000","last_peered":"2023-08-31T19:07:57.901485+0000","last_clean":"2023-08-31T19:07:57.901485+0000","last_became_active":"2023-08-31T19:07:57.892760+0000","last_became_peered":"2023-08-31T19:07:57.892760+0000","last_unstale":"2023-08-31T19:07:57.901485+0000","last_undegraded":"2023-08-31T19:07:57.901485+0000","last_fullsized":"2023-08-31T19:07:57.901485+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.880158+0000","last_change":"2023-08-31T19:07:57.449509+0000","last_active":"2023-08-31T19:07:57.880158+0000","last_peered":"2023-08-31T19:07:57.880158+0000","last_clean":"2023-08-31T19:07:57.880158+0000","last_became_active":"2023-08-31T19:07:57.449163+0000","last_became_peered":"2023-08-31T19:07:57.449163+0000","last_unstale":"2023-08-31T19:07:57.880158+0000","last_undegraded":"2023-08-31T19:07:57.880158+0000","last_fullsized":"2023-08-31T19:07:57.880158+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910570+0000","last_change":"2023-08-31T19:07:57.893952+0000","last_active":"2023-08-31T19:07:57.910570+0000","last_peered":"2023-08-31T19:07:57.910570+0000","last_clean":"2023-08-31T19:07:57.910570+0000","last_became_active":"2023-08-31T19:07:57.893623+0000","last_became_peered":"2023-08-31T19:07:57.893623+0000","last_unstale":"2023-08-31T19:07:57.910570+0000","last_undegraded":"2023-08-31T19:07:57.910570+0000","last_fullsized":"2023-08-31T19:07:57.910570+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.890191+0000","last_change":"2023-08-31T19:07:57.446562+0000","last_active":"2023-08-31T19:07:57.890191+0000","last_peered":"2023-08-31T19:07:57.890191+0000","last_clean":"2023-08-31T19:07:57.890191+0000","last_became_active":"2023-08-31T19:07:57.446223+0000","last_became_peered":"2023-08-31T19:07:57.446223+0000","last_unstale":"2023-08-31T19:07:57.890191+0000","last_undegraded":"2023-08-31T19:07:57.890191+0000","last_fullsized":"2023-08-31T19:07:57.890191+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908465+0000","last_change":"2023-08-31T19:07:57.896520+0000","last_active":"2023-08-31T19:07:57.908465+0000","last_peered":"2023-08-31T19:07:57.908465+0000","last_clean":"2023-08-31T19:07:57.908465+0000","last_became_active":"2023-08-31T19:07:57.896159+0000","last_became_peered":"2023-08-31T19:07:57.896159+0000","last_unstale":"2023-08-31T19:07:57.908465+0000","last_undegraded":"2023-08-31T19:07:57.908465+0000","last_fullsized":"2023-08-31T19:07:57.908465+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"156'3","reported_seq":13,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910703+0000","last_change":"2023-08-31T19:07:57.453208+0000","last_active":"2023-08-31T19:07:57.910703+0000","last_peered":"2023-08-31T19:07:57.910703+0000","last_clean":"2023-08-31T19:07:57.910703+0000","last_became_active":"2023-08-31T19:07:57.452827+0000","last_became_peered":"2023-08-31T19:07:57.452827+0000","last_unstale":"2023-08-31T19:07:57.910703+0000","last_undegraded":"2023-08-31T19:07:57.910703+0000","last_fullsized":"2023-08-31T19:07:57.910703+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":140,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.881102+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:07:57.881102+0000","last_peered":"2023-08-31T19:07:57.881102+0000","last_clean":"2023-08-31T19:07:57.881102+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:07:57.881102+0000","last_undegraded":"2023-08-31T19:07:57.881102+0000","last_fullsized":"2023-08-31T19:07:57.881102+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.904909+0000","last_change":"2023-08-31T19:07:57.897045+0000","last_active":"2023-08-31T19:07:57.904909+0000","last_peered":"2023-08-31T19:07:57.904909+0000","last_clean":"2023-08-31T19:07:57.904909+0000","last_became_active":"2023-08-31T19:07:57.896589+0000","last_became_peered":"2023-08-31T19:07:57.896589+0000","last_unstale":"2023-08-31T19:07:57.904909+0000","last_undegraded":"2023-08-31T19:07:57.904909+0000","last_fullsized":"2023-08-31T19:07:57.904909+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"156'1","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.907880+0000","last_change":"2023-08-31T19:07:57.439804+0000","last_active":"2023-08-31T19:07:57.907880+0000","last_peered":"2023-08-31T19:07:57.907880+0000","last_clean":"2023-08-31T19:07:57.907880+0000","last_became_active":"2023-08-31T19:07:57.439492+0000","last_became_peered":"2023-08-31T19:07:57.439492+0000","last_unstale":"2023-08-31T19:07:57.907880+0000","last_undegraded":"2023-08-31T19:07:57.907880+0000","last_fullsized":"2023-08-31T19:07:57.907880+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":132,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.888254+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:07:57.888254+0000","last_peered":"2023-08-31T19:07:57.888254+0000","last_clean":"2023-08-31T19:07:57.888254+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:07:57.888254+0000","last_undegraded":"2023-08-31T19:07:57.888254+0000","last_fullsized":"2023-08-31T19:07:57.888254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.906744+0000","last_change":"2023-08-31T19:07:57.903987+0000","last_active":"2023-08-31T19:07:57.906744+0000","last_peered":"2023-08-31T19:07:57.906744+0000","last_clean":"2023-08-31T19:07:57.906744+0000","last_became_active":"2023-08-31T19:07:57.903677+0000","last_became_peered":"2023-08-31T19:07:57.903677+0000","last_unstale":"2023-08-31T19:07:57.906744+0000","last_undegraded":"2023-08-31T19:07:57.906744+0000","last_fullsized":"2023-08-31T19:07:57.906744+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"156'4","reported_seq":14,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.906011+0000","last_change":"2023-08-31T19:07:57.448260+0000","last_active":"2023-08-31T19:07:57.906011+0000","last_peered":"2023-08-31T19:07:57.906011+0000","last_clean":"2023-08-31T19:07:57.906011+0000","last_became_active":"2023-08-31T19:07:57.447804+0000","last_became_peered":"2023-08-31T19:07:57.447804+0000","last_unstale":"2023-08-31T19:07:57.906011+0000","last_undegraded":"2023-08-31T19:07:57.906011+0000","last_fullsized":"2023-08-31T19:07:57.906011+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":135,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.890037+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:07:57.890037+0000","last_peered":"2023-08-31T19:07:57.890037+0000","last_clean":"2023-08-31T19:07:57.890037+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:07:57.890037+0000","last_undegraded":"2023-08-31T19:07:57.890037+0000","last_fullsized":"2023-08-31T19:07:57.890037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908160+0000","last_change":"2023-08-31T19:07:57.904747+0000","last_active":"2023-08-31T19:07:57.908160+0000","last_peered":"2023-08-31T19:07:57.908160+0000","last_clean":"2023-08-31T19:07:57.908160+0000","last_became_active":"2023-08-31T19:07:57.904474+0000","last_became_peered":"2023-08-31T19:07:57.904474+0000","last_unstale":"2023-08-31T19:07:57.908160+0000","last_undegraded":"2023-08-31T19:07:57.908160+0000","last_fullsized":"2023-08-31T19:07:57.908160+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.880903+0000","last_change":"2023-08-31T19:07:57.453261+0000","last_active":"2023-08-31T19:07:57.880903+0000","last_peered":"2023-08-31T19:07:57.880903+0000","last_clean":"2023-08-31T19:07:57.880903+0000","last_became_active":"2023-08-31T19:07:57.452955+0000","last_became_peered":"2023-08-31T19:07:57.452955+0000","last_unstale":"2023-08-31T19:07:57.880903+0000","last_undegraded":"2023-08-31T19:07:57.880903+0000","last_fullsized":"2023-08-31T19:07:57.880903+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.889227+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:07:57.889227+0000","last_peered":"2023-08-31T19:07:57.889227+0000","last_clean":"2023-08-31T19:07:57.889227+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:07:57.889227+0000","last_undegraded":"2023-08-31T19:07:57.889227+0000","last_fullsized":"2023-08-31T19:07:57.889227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":131,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.880073+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:07:57.880073+0000","last_peered":"2023-08-31T19:07:57.880073+0000","last_clean":"2023-08-31T19:07:57.880073+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:07:57.880073+0000","last_undegraded":"2023-08-31T19:07:57.880073+0000","last_fullsized":"2023-08-31T19:07:57.880073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.910855+0000","last_change":"2023-08-31T19:07:57.907214+0000","last_active":"2023-08-31T19:07:57.910855+0000","last_peered":"2023-08-31T19:07:57.910855+0000","last_clean":"2023-08-31T19:07:57.910855+0000","last_became_active":"2023-08-31T19:07:57.906555+0000","last_became_peered":"2023-08-31T19:07:57.906555+0000","last_unstale":"2023-08-31T19:07:57.910855+0000","last_undegraded":"2023-08-31T19:07:57.910855+0000","last_fullsized":"2023-08-31T19:07:57.910855+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.882432+0000","last_change":"2023-08-31T19:07:57.437246+0000","last_active":"2023-08-31T19:07:57.882432+0000","last_peered":"2023-08-31T19:07:57.882432+0000","last_clean":"2023-08-31T19:07:57.882432+0000","last_became_active":"2023-08-31T19:07:57.436918+0000","last_became_peered":"2023-08-31T19:07:57.436918+0000","last_unstale":"2023-08-31T19:07:57.882432+0000","last_undegraded":"2023-08-31T19:07:57.882432+0000","last_fullsized":"2023-08-31T19:07:57.882432+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.880082+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:07:57.880082+0000","last_peered":"2023-08-31T19:07:57.880082+0000","last_clean":"2023-08-31T19:07:57.880082+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:07:57.880082+0000","last_undegraded":"2023-08-31T19:07:57.880082+0000","last_fullsized":"2023-08-31T19:07:57.880082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908017+0000","last_change":"2023-08-31T19:07:57.898211+0000","last_active":"2023-08-31T19:07:57.908017+0000","last_peered":"2023-08-31T19:07:57.908017+0000","last_clean":"2023-08-31T19:07:57.908017+0000","last_became_active":"2023-08-31T19:07:57.897760+0000","last_became_peered":"2023-08-31T19:07:57.897760+0000","last_unstale":"2023-08-31T19:07:57.908017+0000","last_undegraded":"2023-08-31T19:07:57.908017+0000","last_fullsized":"2023-08-31T19:07:57.908017+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"156'2","reported_seq":12,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.908497+0000","last_change":"2023-08-31T19:07:57.456584+0000","last_active":"2023-08-31T19:07:57.908497+0000","last_peered":"2023-08-31T19:07:57.908497+0000","last_clean":"2023-08-31T19:07:57.908497+0000","last_became_active":"2023-08-31T19:07:57.456289+0000","last_became_peered":"2023-08-31T19:07:57.456289+0000","last_unstale":"2023-08-31T19:07:57.908497+0000","last_undegraded":"2023-08-31T19:07:57.908497+0000","last_fullsized":"2023-08-31T19:07:57.908497+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.881373+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:07:57.881373+0000","last_peered":"2023-08-31T19:07:57.881373+0000","last_clean":"2023-08-31T19:07:57.881373+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:07:57.881373+0000","last_undegraded":"2023-08-31T19:07:57.881373+0000","last_fullsized":"2023-08-31T19:07:57.881373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.907871+0000","last_change":"2023-08-31T19:07:57.906759+0000","last_active":"2023-08-31T19:07:57.907871+0000","last_peered":"2023-08-31T19:07:57.907871+0000","last_clean":"2023-08-31T19:07:57.907871+0000","last_became_active":"2023-08-31T19:07:57.906511+0000","last_became_peered":"2023-08-31T19:07:57.906511+0000","last_unstale":"2023-08-31T19:07:57.907871+0000","last_undegraded":"2023-08-31T19:07:57.907871+0000","last_fullsized":"2023-08-31T19:07:57.907871+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.888829+0000","last_change":"2023-08-31T19:07:57.449766+0000","last_active":"2023-08-31T19:07:57.888829+0000","last_peered":"2023-08-31T19:07:57.888829+0000","last_clean":"2023-08-31T19:07:57.888829+0000","last_became_active":"2023-08-31T19:07:57.448701+0000","last_became_peered":"2023-08-31T19:07:57.448701+0000","last_unstale":"2023-08-31T19:07:57.888829+0000","last_undegraded":"2023-08-31T19:07:57.888829+0000","last_fullsized":"2023-08-31T19:07:57.888829+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.880655+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:07:57.880655+0000","last_peered":"2023-08-31T19:07:57.880655+0000","last_clean":"2023-08-31T19:07:57.880655+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:07:57.880655+0000","last_undegraded":"2023-08-31T19:07:57.880655+0000","last_fullsized":"2023-08-31T19:07:57.880655+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.905808+0000","last_change":"2023-08-31T19:07:57.900564+0000","last_active":"2023-08-31T19:07:57.905808+0000","last_peered":"2023-08-31T19:07:57.905808+0000","last_clean":"2023-08-31T19:07:57.905808+0000","last_became_active":"2023-08-31T19:07:57.900236+0000","last_became_peered":"2023-08-31T19:07:57.900236+0000","last_unstale":"2023-08-31T19:07:57.905808+0000","last_undegraded":"2023-08-31T19:07:57.905808+0000","last_fullsized":"2023-08-31T19:07:57.905808+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:57.409845+0000","last_clean_scrub_stamp":"2023-08-31T19:07:57.409845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.889975+0000","last_change":"2023-08-31T19:07:57.444134+0000","last_active":"2023-08-31T19:07:57.889975+0000","last_peered":"2023-08-31T19:07:57.889975+0000","last_clean":"2023-08-31T19:07:57.889975+0000","last_became_active":"2023-08-31T19:07:57.441856+0000","last_became_peered":"2023-08-31T19:07:57.441856+0000","last_unstale":"2023-08-31T19:07:57.889975+0000","last_undegraded":"2023-08-31T19:07:57.889975+0000","last_fullsized":"2023-08-31T19:07:57.889975+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:07:56.403451+0000","last_clean_scrub_stamp":"2023-08-31T19:07:56.403451+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-08-31T19:07:57.884547+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:07:57.884547+0000","last_peered":"2023-08-31T19:07:57.884547+0000","last_clean":"2023-08-31T19:07:57.884547+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:07:57.884547+0000","last_undegraded":"2023-08-31T19:07:57.884547+0000","last_fullsized":"2023-08-31T19:07:57.884547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575086,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1966080,"data_stored":1050049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69899999999999995,"15min":0.72999999999999998},"min":{"1min":0.41799999999999998,"5min":0.38500000000000001,"15min":0.32100000000000001},"max":{"1min":0.89900000000000002,"5min":1.175,"15min":1.175},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.51300000000000001,"5min":0.439,"15min":0.39800000000000002},"max":{"1min":0.80900000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.51000000000000001,"5min":0.42499999999999999,"15min":0.40000000000000002},"max":{"1min":0.90100000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.67200000000000004,"15min":0.68200000000000005},"min":{"1min":0.47899999999999998,"5min":0.41999999999999998,"15min":0.36199999999999999},"max":{"1min":0.82699999999999996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.629}]},{"osd":2,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.47699999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.90800000000000003,"5min":1.163,"15min":1.163},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91600000000000004,"5min":1.0309999999999999,"15min":1.054},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70899999999999996,"15min":0.71499999999999997},"min":{"1min":0.55500000000000005,"5min":0.498,"15min":0.432},"max":{"1min":0.84499999999999997,"5min":1.107,"15min":1.107},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.74399999999999999,"15min":0.74299999999999999},"min":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.92000000000000004,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.35199999999999998,"15min":0.33900000000000002},"max":{"1min":0.81799999999999995,"5min":0.84499999999999997,"15min":0.97899999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.55600000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95899999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.46400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93200000000000005,"5min":1.0229999999999999,"15min":1.139},"last":0.498},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.70699999999999996},"min":{"1min":0.45000000000000001,"5min":0.44400000000000001,"15min":0.38500000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.048},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67600000000000005,"15min":0.67500000000000004},"min":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.45600000000000002},"max":{"1min":0.89800000000000002,"5min":0.92400000000000004,"15min":1.0740000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.48699999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95399999999999996,"5min":1.069,"15min":1.069},"last":0.67000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575085,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303108,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068732,"statfs":{"total":96636764160,"available":96326381568,"internally_reserved":0,"allocated":1961984,"data_stored":1050297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68600000000000005,"15min":0.69999999999999996},"min":{"1min":0.48699999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.83099999999999996,"5min":0.94799999999999995,"15min":1.0189999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.69499999999999995},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.371},"max":{"1min":0.93799999999999994,"5min":1.069,"15min":1.069},"last":0.81200000000000006}]},{"osd":1,"last update":"Thu Aug 31 19:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.69499999999999995},"min":{"1min":0.498,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.90300000000000002,"5min":1.014,"15min":1.014},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.52200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.87,"5min":1.216,"15min":1.216},"last":0.621}]},{"osd":2,"last update":"Thu Aug 31 19:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.53400000000000003,"5min":0.442,"15min":0.42099999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.129},"last":0.752},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72099999999999997,"15min":0.73899999999999999},"min":{"1min":0.626,"5min":0.498,"15min":0.46600000000000003},"max":{"1min":0.92200000000000004,"5min":0.95299999999999996,"15min":1.3260000000000001},"last":0.73799999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70799999999999996,"15min":0.70899999999999996},"min":{"1min":0.54300000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.57699999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.92600000000000005,"5min":1.087,"15min":1.087},"last":0.91900000000000004}]},{"osd":4,"last update":"Thu Aug 31 19:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64200000000000002,"15min":0.61799999999999999},"min":{"1min":0.45000000000000001,"5min":0.434,"15min":0.40999999999999998},"max":{"1min":0.90400000000000003,"5min":0.90900000000000003,"15min":0.96599999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64300000000000002,"15min":0.63400000000000001},"min":{"1min":0.502,"5min":0.432,"15min":0.39000000000000001},"max":{"1min":0.90900000000000003,"5min":0.95999999999999996,"15min":1.0880000000000001},"last":0.85599999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69299999999999995,"15min":0.67300000000000004},"min":{"1min":0.48999999999999999,"5min":0.42499999999999999,"15min":0.39800000000000002},"max":{"1min":0.98799999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.52500000000000002,"5min":0.47499999999999998,"15min":0.435},"max":{"1min":0.95499999999999996,"5min":1.0669999999999999,"15min":1.0700000000000001},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:07:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.41899999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.012},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76200000000000001,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.032,"5min":1.161,"15min":1.161},"last":1.014}]}]},{"osd":1,"up_from":13,"seq":55834575086,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1953792,"data_stored":1049315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41699999999999998,"15min":0.441},"min":{"1min":0.308,"5min":0.28000000000000003,"15min":0.26100000000000001},"max":{"1min":0.64600000000000002,"5min":0.69499999999999995,"15min":0.81000000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46300000000000002,"15min":0.47299999999999998},"min":{"1min":0.35099999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64200000000000002,"5min":0.66600000000000004,"15min":0.752},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48799999999999999,"15min":0.50800000000000001},"min":{"1min":0.34499999999999997,"5min":0.33200000000000002,"15min":0.29099999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.82699999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54700000000000004,"15min":0.57299999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.752,"5min":0.754,"15min":0.81899999999999995},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Aug 31 19:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.55100000000000005},"min":{"1min":0.44,"5min":0.39100000000000001,"15min":0.35599999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.82199999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.498,"15min":0.50800000000000001},"min":{"1min":0.38500000000000001,"5min":0.33400000000000002,"15min":0.32800000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.99199999999999999,"5min":1.0780000000000001,"15min":1.2110000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78300000000000003,"15min":0.80900000000000005},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0029999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.497},"max":{"1min":0.98899999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77100000000000002,"15min":0.77700000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.46999999999999997},"max":{"1min":1.0229999999999999,"5min":1.153,"15min":1.2310000000000001},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Aug 31 19:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.56200000000000006,"5min":0.501,"15min":0.501},"max":{"1min":0.99199999999999999,"5min":1.117,"15min":1.1990000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77500000000000002,"15min":0.79500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.51500000000000001},"max":{"1min":1,"5min":1.167,"15min":1.2},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Aug 31 19:07:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76000000000000001,"15min":0.78100000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0569999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.76200000000000001,"15min":0.78700000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.51400000000000001},"max":{"1min":0.94599999999999995,"5min":1.234,"15min":1.234},"last":0.86599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575085,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303100,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068740,"statfs":{"total":96636764160,"available":96326389760,"internally_reserved":0,"allocated":1953792,"data_stored":1042109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.436,"15min":0.439},"min":{"1min":0.30399999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63500000000000001,"5min":0.73399999999999999,"15min":0.78400000000000003},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47999999999999998,"15min":0.49099999999999999},"min":{"1min":0.33300000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67700000000000005,"5min":0.72499999999999998,"15min":0.876},"last":0.434}]},{"osd":2,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48099999999999998,"15min":0.498},"min":{"1min":0.35099999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65100000000000002,"5min":0.71899999999999997,"15min":0.74299999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.49299999999999999,"15min":0.52200000000000002},"min":{"1min":0.377,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.59899999999999998,"5min":0.82499999999999996,"15min":1.018},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.498,"15min":0.51200000000000001},"min":{"1min":0.33400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.64600000000000002,"5min":0.69099999999999995,"15min":0.82799999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.56200000000000006},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.36599999999999999},"max":{"1min":0.70799999999999996,"5min":0.76400000000000001,"15min":0.91400000000000003},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77800000000000002,"15min":0.81399999999999995},"min":{"1min":0.54900000000000004,"5min":0.5,"15min":0.5},"max":{"1min":0.95199999999999996,"5min":1.103,"15min":1.2370000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77200000000000002,"15min":0.80900000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94299999999999995,"5min":1.1579999999999999,"15min":1.276},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72699999999999998,"15min":0.748},"min":{"1min":0.53600000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.83699999999999997,"5min":1.155,"15min":1.155},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.51200000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.92200000000000004,"5min":1.123,"15min":1.1950000000000001},"last":0.86199999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77700000000000002,"15min":0.80300000000000005},"min":{"1min":0.48999999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97399999999999998,"5min":1.3080000000000001,"15min":1.3280000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.82899999999999996},"min":{"1min":0.57299999999999995,"5min":0.55400000000000005,"15min":0.53500000000000003},"max":{"1min":0.96699999999999997,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Aug 31 19:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.58399999999999996,"5min":0.53700000000000003,"15min":0.51800000000000002},"max":{"1min":0.95099999999999996,"5min":1.1359999999999999,"15min":1.5820000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.79300000000000004,"15min":0.82699999999999996},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.997,"5min":1.127,"15min":1.548},"last":0.74099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575085,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303108,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068732,"statfs":{"total":96636764160,"available":96326381568,"internally_reserved":0,"allocated":1961984,"data_stored":1049903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.57299999999999995,"15min":0.48699999999999999},"min":{"1min":0.37,"5min":0.27800000000000002,"15min":0.27000000000000002},"max":{"1min":0.72999999999999998,"5min":14.09,"15min":14.09},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69599999999999995,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54500000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.65600000000000003,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":0.379},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.54300000000000004},"min":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64900000000000002,"5min":4.375,"15min":4.375},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.55500000000000005,"15min":0.52500000000000002},"min":{"1min":0.42199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.70799999999999996,"5min":5.7649999999999997,"15min":5.7649999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.39300000000000002,"15min":0.36399999999999999},"max":{"1min":0.70699999999999996,"5min":5.9729999999999999,"15min":5.9729999999999999},"last":0.495}]},{"osd":4,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.52500000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86599999999999999,"5min":4.9960000000000004,"15min":4.9960000000000004},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78100000000000003,"15min":0.79000000000000004},"min":{"1min":0.59099999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88600000000000001,"5min":4.4119999999999999,"15min":4.4119999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.752,"15min":0.78100000000000003},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.91200000000000003,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.77700000000000002,"15min":0.79100000000000004},"min":{"1min":0.56000000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.876,"5min":5.0449999999999999,"15min":5.0449999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.60899999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97299999999999998,"5min":4.2649999999999997,"15min":4.2649999999999997},"last":0.627},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.78200000000000003,"15min":0.80100000000000005},"min":{"1min":0.57599999999999996,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.89500000000000002,"5min":2.383,"15min":2.383},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Aug 31 19:07:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76700000000000002,"15min":0.79700000000000004},"min":{"1min":0.56699999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0569999999999999,"5min":1.869,"15min":1.869},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78700000000000003,"15min":0.81200000000000006},"min":{"1min":0.60099999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.96499999999999997,"5min":2.403,"15min":2.403},"last":0.623}]}]},{"osd":3,"up_from":13,"seq":55834575085,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303108,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068732,"statfs":{"total":96636764160,"available":96326381568,"internally_reserved":0,"allocated":1961984,"data_stored":1049959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41599999999999998,"15min":0.47999999999999998},"min":{"1min":0.27900000000000003,"5min":0.223,"15min":0.223},"max":{"1min":0.54700000000000004,"5min":0.88300000000000001,"15min":14.099},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.44400000000000001,"15min":0.55500000000000005},"min":{"1min":0.33400000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63300000000000001,"5min":0.72299999999999998,"15min":24.879999999999999},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.35899999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.63700000000000001,"5min":0.76200000000000001,"15min":0.79600000000000004},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48099999999999998,"15min":0.54100000000000004},"min":{"1min":0.31900000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60899999999999999,"5min":0.80700000000000005,"15min":14.143000000000001},"last":0.313}]},{"osd":2,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55200000000000005,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.74099999999999999,"5min":0.76200000000000001,"15min":1.0640000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.64600000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.32000000000000001},"max":{"1min":0.68899999999999995,"5min":0.78400000000000003,"15min":12.464},"last":0.379}]},{"osd":4,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73299999999999998,"15min":0.81699999999999995},"min":{"1min":0.47699999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.04,"5min":1.298,"15min":21.475999999999999},"last":0.877},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74299999999999999,"15min":0.76200000000000001},"min":{"1min":0.57499999999999996,"5min":0.52100000000000002,"15min":0.47699999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.8149999999999999},"last":1.0600000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.751,"15min":0.76000000000000001},"min":{"1min":0.60899999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1120000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.752,"15min":0.80800000000000005},"min":{"1min":0.59199999999999997,"5min":0.52700000000000002,"15min":0.50600000000000001},"max":{"1min":1.101,"5min":1.2809999999999999,"15min":12.509},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76900000000000002,"15min":0.82099999999999995},"min":{"1min":0.61299999999999999,"5min":0.53400000000000003,"15min":0.52000000000000002},"max":{"1min":1.0980000000000001,"5min":1.3320000000000001,"15min":12.426},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.76400000000000001,"15min":0.85799999999999998},"min":{"1min":0.66200000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.98999999999999999,"5min":1.2010000000000001,"15min":24.920000000000002},"last":1.036}]},{"osd":7,"last update":"Thu Aug 31 19:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.77900000000000003,"15min":0.86599999999999999},"min":{"1min":0.65200000000000002,"5min":0.52300000000000002,"15min":0.495},"max":{"1min":1.0860000000000001,"5min":1.347,"15min":21.521000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.59399999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2929999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.93300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575085,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303096,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068744,"statfs":{"total":96636764160,"available":96326393856,"internally_reserved":0,"allocated":1949696,"data_stored":1042607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66400000000000003,"15min":0.68799999999999994},"min":{"1min":0.434,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64100000000000001,"15min":0.68700000000000006},"min":{"1min":0.502,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:07:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67600000000000005,"15min":0.70899999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68500000000000005,"15min":0.70699999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.3140000000000001,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:07:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69299999999999995,"15min":0.70799999999999996},"min":{"1min":0.56999999999999995,"5min":0.46300000000000002,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":1.0089999999999999,"15min":1.044},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:07:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67500000000000004,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70999999999999996,"15min":0.73499999999999999},"min":{"1min":0.60199999999999998,"5min":0.52900000000000003,"15min":0.439},"max":{"1min":0.93400000000000005,"5min":1.0469999999999999,"15min":1.081},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:07:26 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":1.0029999999999999,"5min":1.425,"15min":1.425},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.41199999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93500000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Aug 31 19:07:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.48899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90900000000000003,"5min":1.1240000000000001,"15min":1.163},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.54100000000000004,"5min":0.44800000000000001,"15min":0.441},"max":{"1min":1.0629999999999999,"5min":1.514,"15min":1.514},"last":0.94499999999999995}]},{"osd":7,"last update":"Thu Aug 31 19:07:26 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.433},"max":{"1min":1.0780000000000001,"5min":1.359,"15min":1.359},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.56799999999999995,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":1.014,"5min":1.165,"15min":1.165},"last":0.96299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575085,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303108,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068732,"statfs":{"total":96636764160,"available":96326381568,"internally_reserved":0,"allocated":1961984,"data_stored":1050229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67000000000000004,"15min":0.71599999999999997},"min":{"1min":0.47399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":4.2119999999999997},"last":1.194},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68700000000000006,"15min":0.71699999999999997},"min":{"1min":0.60099999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.874,"5min":0.94899999999999995,"15min":3.548},"last":4.0979999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68700000000000006,"15min":0.75700000000000001},"min":{"1min":0.56399999999999995,"5min":0.46100000000000002,"15min":0.45000000000000001},"max":{"1min":0.84399999999999997,"5min":1.2170000000000001,"15min":16.744},"last":7.1639999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69999999999999996,"15min":0.73499999999999999},"min":{"1min":0.53700000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":1.196,"15min":3.6299999999999999},"last":6.7750000000000004}]},{"osd":2,"last update":"Thu Aug 31 19:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67700000000000005,"15min":0.70899999999999996},"min":{"1min":0.57199999999999995,"5min":0.44400000000000001,"15min":0.41899999999999998},"max":{"1min":0.93000000000000005,"5min":1.0289999999999999,"15min":3.4430000000000001},"last":1.496},{"interface":"front","average":{"1min":0.748,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.52900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.01,"5min":1.01,"15min":4.1740000000000004},"last":6.7960000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70399999999999996,"15min":0.73399999999999999},"min":{"1min":0.56799999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98499999999999999,"5min":0.996,"15min":1.327},"last":4.0309999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68200000000000005,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.48999999999999999,"15min":0.47699999999999998},"max":{"1min":0.96299999999999997,"5min":0.96799999999999997,"15min":2.823},"last":2.4060000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63200000000000001,"15min":0.64400000000000002},"min":{"1min":0.46200000000000002,"5min":0.435,"15min":0.34999999999999998},"max":{"1min":0.94199999999999995,"5min":1.0169999999999999,"15min":7.3739999999999997},"last":1.01},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":3.6680000000000001},"last":6.5910000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.39100000000000001},"max":{"1min":1.0329999999999999,"5min":1.0860000000000001,"15min":3.4780000000000002},"last":5.4029999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.46200000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.1639999999999999,"5min":1.2909999999999999,"15min":7.4139999999999997},"last":6.5380000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.52700000000000002,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":3.5960000000000001},"last":7.6859999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.52400000000000002,"5min":0.47399999999999998,"15min":0.45300000000000001},"max":{"1min":1.079,"5min":1.1419999999999999,"15min":2.786},"last":3.9049999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:08:02.627 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T19:08:02.627 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-31T19:08:02.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.823+0000 7f4b88fff700 1 Processor -- start 2023-08-31T19:08:02.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.823+0000 7f4b88fff700 1 -- start start 2023-08-31T19:08:02.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.824+0000 7f4b88fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b84154030 0x7f4b84154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:02.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.824+0000 7f4b88fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4b840c06b0 0x7f4b840c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:02.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.824+0000 7f4b88fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b840c6ed0 con 0x7f4b840aa140 2023-08-31T19:08:02.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.824+0000 7f4b88fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b840c66e0 con 0x7f4b84154030 2023-08-31T19:08:02.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.824+0000 7f4b88fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b840c68c0 con 0x7f4b840c06b0 2023-08-31T19:08:02.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.825+0000 7f4b8259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b84154030 0x7f4b84154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:02.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.825+0000 7f4b8259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b84154030 0x7f4b84154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60612/0 (socket says 172.21.15.72:60612) 2023-08-31T19:08:02.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.825+0000 7f4b8259c700 1 -- 172.21.15.72:0/2618746227 learned_addr learned my addr 172.21.15.72:0/2618746227 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:02.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.825+0000 7f4b82d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4b840aa140 0x7f4b84063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52842/0 (socket says 172.21.15.72:52842) 2023-08-31T19:08:02.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.825+0000 7f4b81d9b700 1 --2- 172.21.15.72:0/2618746227 >> v2:172.21.15.146:3300/0 conn(0x7f4b840c06b0 0x7f4b840c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:02.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.825+0000 7f4b8259c700 1 -- 172.21.15.72:0/2618746227 >> v2:172.21.15.146:3300/0 conn(0x7f4b840c06b0 msgr2=0x7f4b840c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:02.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.825+0000 7f4b8259c700 1 --2- 172.21.15.72:0/2618746227 >> v2:172.21.15.146:3300/0 conn(0x7f4b840c06b0 0x7f4b840c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.825+0000 7f4b8259c700 1 -- 172.21.15.72:0/2618746227 >> v1:172.21.15.72:6789/0 conn(0x7f4b840aa140 legacy=0x7f4b84063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:02.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.825+0000 7f4b8259c700 1 -- 172.21.15.72:0/2618746227 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b840c0f30 con 0x7f4b84154030 2023-08-31T19:08:02.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.825+0000 7f4b8159a700 1 -- 172.21.15.72:0/2618746227 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226755286 0 0) 0x7f4b840c6ed0 con 0x7f4b840aa140 2023-08-31T19:08:02.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.825+0000 7f4b8259c700 1 --2- 172.21.15.72:0/2618746227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b84154030 0x7f4b84154410 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f4b840cb6d0 tx=0x7f4b740090f0).ready entity=mon.0 client_cookie=d665b4e104f8d872 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:02.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.826+0000 7f4b8159a700 1 -- 172.21.15.72:0/2618746227 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7400b600 con 0x7f4b84154030 2023-08-31T19:08:02.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.826+0000 7f4b8159a700 1 -- 172.21.15.72:0/2618746227 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7400b760 con 0x7f4b84154030 2023-08-31T19:08:02.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.826+0000 7f4b8159a700 1 -- 172.21.15.72:0/2618746227 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7400bae0 con 0x7f4b84154030 2023-08-31T19:08:02.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.826+0000 7f4b88fff700 1 -- 172.21.15.72:0/2618746227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b84154030 msgr2=0x7f4b84154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:02.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.826+0000 7f4b88fff700 1 --2- 172.21.15.72:0/2618746227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b84154030 0x7f4b84154410 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f4b840cb6d0 tx=0x7f4b740090f0).stop 2023-08-31T19:08:02.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.826+0000 7f4b88fff700 1 -- 172.21.15.72:0/2618746227 shutdown_connections 2023-08-31T19:08:02.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.826+0000 7f4b88fff700 1 --2- 172.21.15.72:0/2618746227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b84154030 0x7f4b84154410 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.826+0000 7f4b88fff700 1 --2- 172.21.15.72:0/2618746227 >> v2:172.21.15.146:3300/0 conn(0x7f4b840c06b0 0x7f4b840c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:02.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.826+0000 7f4b88fff700 1 -- 172.21.15.72:0/2618746227 >> 172.21.15.72:0/2618746227 conn(0x7f4b8405eb60 msgr2=0x7f4b840cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:02.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.826+0000 7f4b88fff700 1 -- 172.21.15.72:0/2618746227 shutdown_connections 2023-08-31T19:08:02.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.826+0000 7f4b88fff700 1 -- 172.21.15.72:0/2618746227 wait complete. 2023-08-31T19:08:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.828+0000 7f4b88fff700 1 Processor -- start 2023-08-31T19:08:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.829+0000 7f4b88fff700 1 -- start start 2023-08-31T19:08:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.830+0000 7f4b88fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b840aa140 0x7f4b8414dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.830+0000 7f4b88fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b840c06b0 0x7f4b8414f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.830+0000 7f4b88fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b84154030 0x7f4b8414f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:02.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.830+0000 7f4b88fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8414fc90 con 0x7f4b840aa140 2023-08-31T19:08:02.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.830+0000 7f4b88fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b840add80 con 0x7f4b840c06b0 2023-08-31T19:08:02.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.830+0000 7f4b88fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8414dfa0 con 0x7f4b84154030 2023-08-31T19:08:02.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.830+0000 7f4b8259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b840aa140 0x7f4b8414dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:02.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.830+0000 7f4b8259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b840aa140 0x7f4b8414dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60616/0 (socket says 172.21.15.72:60616) 2023-08-31T19:08:02.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.830+0000 7f4b8259c700 1 -- 172.21.15.72:0/2861622163 learned_addr learned my addr 172.21.15.72:0/2861622163 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:02.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.830+0000 7f4b8259c700 1 -- 172.21.15.72:0/2861622163 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b84154030 msgr2=0x7f4b8414f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:02.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.830+0000 7f4b8259c700 1 --2- 172.21.15.72:0/2861622163 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b84154030 0x7f4b8414f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:08:02.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.830+0000 7f4b8259c700 1 -- 172.21.15.72:0/2861622163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b840c06b0 msgr2=0x7f4b8414f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:02.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.830+0000 7f4b8259c700 1 --2- 172.21.15.72:0/2861622163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b840c06b0 0x7f4b8414f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:08:02.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.830+0000 7f4b8259c700 1 -- 172.21.15.72:0/2861622163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74009370 con 0x7f4b840aa140 2023-08-31T19:08:02.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.831+0000 7f4b8259c700 1 --2- 172.21.15.72:0/2861622163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b840aa140 0x7f4b8414dab0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f4b74009130 tx=0x7f4b74017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:02.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.831+0000 7f4b727fc700 1 -- 172.21.15.72:0/2861622163 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7400b8d0 con 0x7f4b840aa140 2023-08-31T19:08:02.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.831+0000 7f4b727fc700 1 -- 172.21.15.72:0/2861622163 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7400ba30 con 0x7f4b840aa140 2023-08-31T19:08:02.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.831+0000 7f4b88fff700 1 -- 172.21.15.72:0/2861622163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b84155b50 con 0x7f4b840aa140 2023-08-31T19:08:02.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.831+0000 7f4b727fc700 1 -- 172.21.15.72:0/2861622163 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7401c670 con 0x7f4b840aa140 2023-08-31T19:08:02.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.831+0000 7f4b88fff700 1 -- 172.21.15.72:0/2861622163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b84156110 con 0x7f4b840aa140 2023-08-31T19:08:02.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.832+0000 7f4b88fff700 1 -- 172.21.15.72:0/2861622163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8406c6b0 con 0x7f4b840aa140 2023-08-31T19:08:02.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.833+0000 7f4b727fc700 1 -- 172.21.15.72:0/2861622163 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4b7401c9e0 con 0x7f4b840aa140 2023-08-31T19:08:02.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.834+0000 7f4b727fc700 1 --2- 172.21.15.72:0/2861622163 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4b6405ef30 0x7f4b640613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:02.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.834+0000 7f4b727fc700 1 -- 172.21.15.72:0/2861622163 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f4b7407bd40 con 0x7f4b840aa140 2023-08-31T19:08:02.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.834+0000 7f4b81d9b700 1 --2- 172.21.15.72:0/2861622163 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4b6405ef30 0x7f4b640613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:02.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.835+0000 7f4b81d9b700 1 --2- 172.21.15.72:0/2861622163 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4b6405ef30 0x7f4b640613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f4b840c4f00 tx=0x7f4b78008040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:02.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:02.838+0000 7f4b727fc700 1 -- 172.21.15.72:0/2861622163 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4b7407f030 con 0x7f4b840aa140 2023-08-31T19:08:03.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.072+0000 7f4b88fff700 1 -- 172.21.15.72:0/2861622163 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4b8406aac0 con 0x7f4b840aa140 2023-08-31T19:08:03.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.076+0000 7f4b727fc700 1 -- 172.21.15.72:0/2861622163 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4b740508a0 con 0x7f4b840aa140 2023-08-31T19:08:03.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.078+0000 7f4b88fff700 1 -- 172.21.15.72:0/2861622163 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4b6405ef30 msgr2=0x7f4b640613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:03.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.078+0000 7f4b88fff700 1 --2- 172.21.15.72:0/2861622163 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4b6405ef30 0x7f4b640613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f4b840c4f00 tx=0x7f4b78008040).stop 2023-08-31T19:08:03.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.078+0000 7f4b88fff700 1 -- 172.21.15.72:0/2861622163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b840aa140 msgr2=0x7f4b8414dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:03.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.078+0000 7f4b88fff700 1 --2- 172.21.15.72:0/2861622163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b840aa140 0x7f4b8414dab0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f4b74009130 tx=0x7f4b74017000).stop 2023-08-31T19:08:03.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.079+0000 7f4b88fff700 1 -- 172.21.15.72:0/2861622163 shutdown_connections 2023-08-31T19:08:03.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.079+0000 7f4b88fff700 1 --2- 172.21.15.72:0/2861622163 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4b84154030 0x7f4b8414f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:08:03.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.079+0000 7f4b88fff700 1 --2- 172.21.15.72:0/2861622163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b840aa140 0x7f4b8414dab0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:03.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.079+0000 7f4b88fff700 1 --2- 172.21.15.72:0/2861622163 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f4b6405ef30 0x7f4b640613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:03.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.079+0000 7f4b88fff700 1 --2- 172.21.15.72:0/2861622163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b840c06b0 0x7f4b8414f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:08:03.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.079+0000 7f4b88fff700 1 -- 172.21.15.72:0/2861622163 >> 172.21.15.72:0/2861622163 conn(0x7f4b8405eb60 msgr2=0x7f4b8415a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:03.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.079+0000 7f4b88fff700 1 -- 172.21.15.72:0/2861622163 shutdown_connections 2023-08-31T19:08:03.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.079+0000 7f4b88fff700 1 -- 172.21.15.72:0/2861622163 wait complete. 2023-08-31T19:08:03.084 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-08-31T19:08:03.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:08:03.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.285+0000 7efca25ff700 1 Processor -- start 2023-08-31T19:08:03.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.285+0000 7efca25ff700 1 -- start start 2023-08-31T19:08:03.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.286+0000 7efca25ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efc9c154060 0x7efc9c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:03.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.286+0000 7efca25ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc9c1588d0 0x7efc9c154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:03.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.286+0000 7efca25ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9c0c6120 con 0x7efc9c0cb9b0 2023-08-31T19:08:03.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.286+0000 7efca25ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9c0c1380 con 0x7efc9c154060 2023-08-31T19:08:03.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.286+0000 7efca25ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0c5e10 con 0x7efc9c1588d0 2023-08-31T19:08:03.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efc9c0cb9b0 0x7efc9c1581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54478/0 (socket says 172.21.15.72:54478) 2023-08-31T19:08:03.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9b7fe700 1 -- 172.21.15.72:0/678524930 learned_addr learned my addr 172.21.15.72:0/678524930 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:08:03.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9bfff700 1 --2- 172.21.15.72:0/678524930 >> v2:172.21.15.146:3300/0 conn(0x7efc9c154060 0x7efc9c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:03.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efca0b9c700 1 --2- 172.21.15.72:0/678524930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc9c1588d0 0x7efc9c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:03.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9affd700 1 -- 172.21.15.72:0/678524930 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807978509 0 0) 0x7efc9c0c6120 con 0x7efc9c0cb9b0 2023-08-31T19:08:03.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9affd700 1 -- 172.21.15.72:0/678524930 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc840033f0 con 0x7efc9c0cb9b0 2023-08-31T19:08:03.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9affd700 1 -- 172.21.15.72:0/678524930 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2285244929 0 0) 0x7efc840033f0 con 0x7efc9c0cb9b0 2023-08-31T19:08:03.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9affd700 1 -- 172.21.15.72:0/678524930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc9c1588d0 msgr2=0x7efc9c154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:03.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9affd700 1 --2- 172.21.15.72:0/678524930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc9c1588d0 0x7efc9c154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:03.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9affd700 1 -- 172.21.15.72:0/678524930 >> v2:172.21.15.146:3300/0 conn(0x7efc9c154060 msgr2=0x7efc9c157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:03.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9affd700 1 --2- 172.21.15.72:0/678524930 >> v2:172.21.15.146:3300/0 conn(0x7efc9c154060 0x7efc9c157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:03.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9affd700 1 -- 172.21.15.72:0/678524930 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c0c0ae0 con 0x7efc9c0cb9b0 2023-08-31T19:08:03.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9affd700 1 -- 172.21.15.72:0/678524930 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7efc90001470 con 0x7efc9c0cb9b0 2023-08-31T19:08:03.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9affd700 1 -- 172.21.15.72:0/678524930 >> v1:172.21.15.72:6789/0 conn(0x7efc9c0cb9b0 legacy=0x7efc9c1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:03.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9affd700 1 --2- 172.21.15.72:0/678524930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc9c1588d0 0x7efc840038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:03.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9affd700 1 --2- 172.21.15.72:0/678524930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc84003e10 0x7efc84004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:03.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.287+0000 7efc9affd700 1 --2- 172.21.15.72:0/678524930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc84004b80 0x7efc84005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:03.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.288+0000 7efc9affd700 1 -- 172.21.15.72:0/678524930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0c1380 con 0x7efc84004b80 2023-08-31T19:08:03.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.288+0000 7efc9affd700 1 -- 172.21.15.72:0/678524930 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0c5e10 con 0x7efc84003e10 2023-08-31T19:08:03.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.288+0000 7efc9affd700 1 -- 172.21.15.72:0/678524930 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8400b8e0 con 0x7efc9c1588d0 2023-08-31T19:08:03.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.288+0000 7efca0b9c700 1 --2- 172.21.15.72:0/678524930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc84004b80 0x7efc84005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:03.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.288+0000 7efc9bfff700 1 --2- 172.21.15.72:0/678524930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc9c1588d0 0x7efc840038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:03.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.288+0000 7efc9b7fe700 1 --2- 172.21.15.72:0/678524930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc84003e10 0x7efc84004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:03.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.288+0000 7efca0b9c700 1 -- 172.21.15.72:0/678524930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc9c1588d0 msgr2=0x7efc840038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:03.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.288+0000 7efca0b9c700 1 --2- 172.21.15.72:0/678524930 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc9c1588d0 0x7efc840038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:03.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.288+0000 7efca0b9c700 1 -- 172.21.15.72:0/678524930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc84003e10 msgr2=0x7efc84004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:03.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.288+0000 7efca0b9c700 1 --2- 172.21.15.72:0/678524930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc84003e10 0x7efc84004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:03.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.288+0000 7efca0b9c700 1 -- 172.21.15.72:0/678524930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc840033f0 con 0x7efc84004b80 2023-08-31T19:08:03.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.288+0000 7efca0b9c700 1 --2- 172.21.15.72:0/678524930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc84004b80 0x7efc84005000 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7efc9c0c8b90 tx=0x7efc9400b040).ready entity=mon.0 client_cookie=1c71681a410e05fd server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:03.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.289+0000 7efc9affd700 1 -- 172.21.15.72:0/678524930 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94009ac0 con 0x7efc84004b80 2023-08-31T19:08:03.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.289+0000 7efc9affd700 1 -- 172.21.15.72:0/678524930 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9400f040 con 0x7efc84004b80 2023-08-31T19:08:03.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.289+0000 7efc9affd700 1 -- 172.21.15.72:0/678524930 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9400eca0 con 0x7efc84004b80 2023-08-31T19:08:03.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.289+0000 7efca25ff700 1 -- 172.21.15.72:0/678524930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc84004b80 msgr2=0x7efc84005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:03.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.289+0000 7efca25ff700 1 --2- 172.21.15.72:0/678524930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc84004b80 0x7efc84005000 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7efc9c0c8b90 tx=0x7efc9400b040).stop 2023-08-31T19:08:03.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.289+0000 7efca0b9c700 1 -- 172.21.15.72:0/678524930 reap_dead start 2023-08-31T19:08:03.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.289+0000 7efca25ff700 1 -- 172.21.15.72:0/678524930 shutdown_connections 2023-08-31T19:08:03.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.289+0000 7efca25ff700 1 -- 172.21.15.72:0/678524930 >> 172.21.15.72:0/678524930 conn(0x7efc9c05e870 msgr2=0x7efc9c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:03.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.289+0000 7efca25ff700 1 -- 172.21.15.72:0/678524930 shutdown_connections 2023-08-31T19:08:03.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.289+0000 7efca25ff700 1 -- 172.21.15.72:0/678524930 wait complete. 2023-08-31T19:08:03.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.291+0000 7efca25ff700 1 Processor -- start 2023-08-31T19:08:03.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.291+0000 7efca25ff700 1 -- start start 2023-08-31T19:08:03.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efca25ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc84004b80 0x7efc9c1648b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:03.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efca25ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc9c152660 0x7efc9c0aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:03.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efca25ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc9c0add40 0x7efc9c0ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:03.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efca25ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0ac3c0 con 0x7efc9c152660 2023-08-31T19:08:03.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efca25ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c152ae0 con 0x7efc84004b80 2023-08-31T19:08:03.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efca25ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0ae6b0 con 0x7efc9c0add40 2023-08-31T19:08:03.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efc9b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc9c152660 0x7efc9c0aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:03.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efc9b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc9c152660 0x7efc9c0aaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43176/0 (socket says 172.21.15.72:43176) 2023-08-31T19:08:03.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efc9b7fe700 1 -- 172.21.15.72:0/82364217 learned_addr learned my addr 172.21.15.72:0/82364217 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:03.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efc9bfff700 1 --2- 172.21.15.72:0/82364217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc84004b80 0x7efc9c1648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:03.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efca0b9c700 1 --2- 172.21.15.72:0/82364217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc9c0add40 0x7efc9c0ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:03.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efc9b7fe700 1 -- 172.21.15.72:0/82364217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc9c0add40 msgr2=0x7efc9c0ae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:03.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efc9b7fe700 1 --2- 172.21.15.72:0/82364217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc9c0add40 0x7efc9c0ae1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:03.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efc9b7fe700 1 -- 172.21.15.72:0/82364217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc84004b80 msgr2=0x7efc9c1648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:03.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efc9b7fe700 1 --2- 172.21.15.72:0/82364217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc84004b80 0x7efc9c1648b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:03.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efc9b7fe700 1 -- 172.21.15.72:0/82364217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c0ab7b0 con 0x7efc9c152660 2023-08-31T19:08:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.292+0000 7efc9bfff700 1 --2- 172.21.15.72:0/82364217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc84004b80 0x7efc9c1648b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:08:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.293+0000 7efc9b7fe700 1 --2- 172.21.15.72:0/82364217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc9c152660 0x7efc9c0aaf60 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7efc900049f0 tx=0x7efc90001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.293+0000 7efc83fff700 1 -- 172.21.15.72:0/82364217 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90000c40 con 0x7efc9c152660 2023-08-31T19:08:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.293+0000 7efc83fff700 1 -- 172.21.15.72:0/82364217 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9000f870 con 0x7efc9c152660 2023-08-31T19:08:03.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.293+0000 7efc83fff700 1 -- 172.21.15.72:0/82364217 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9000fc10 con 0x7efc9c152660 2023-08-31T19:08:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.293+0000 7efca25ff700 1 -- 172.21.15.72:0/82364217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9c0aba90 con 0x7efc9c152660 2023-08-31T19:08:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.293+0000 7efca25ff700 1 -- 172.21.15.72:0/82364217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9c0ac050 con 0x7efc9c152660 2023-08-31T19:08:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.294+0000 7efca25ff700 1 -- 172.21.15.72:0/82364217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9c0ac570 con 0x7efc9c152660 2023-08-31T19:08:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.295+0000 7efc83fff700 1 -- 172.21.15.72:0/82364217 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7efc90015410 con 0x7efc9c152660 2023-08-31T19:08:03.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.296+0000 7efc83fff700 1 --2- 172.21.15.72:0/82364217 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efc8805ef30 0x7efc880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:03.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.296+0000 7efc83fff700 1 -- 172.21.15.72:0/82364217 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7efc9007a530 con 0x7efc9c152660 2023-08-31T19:08:03.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.296+0000 7efc9bfff700 1 --2- 172.21.15.72:0/82364217 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efc8805ef30 0x7efc880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:03.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.296+0000 7efc9bfff700 1 --2- 172.21.15.72:0/82364217 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efc8805ef30 0x7efc880613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7efc8c006f10 tx=0x7efc8c008040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:03.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.300+0000 7efc83fff700 1 -- 172.21.15.72:0/82364217 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efc9c0ac570 con 0x7efc9c152660 2023-08-31T19:08:03.405 INFO:tasks.ceph.mds.c.smithi072.stderr:2023-08-31T19:08:03.405+0000 7f18dc9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:08:03.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.511+0000 7efca25ff700 1 -- 172.21.15.72:0/82364217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc9c0ac750 con 0x7efc9c152660 2023-08-31T19:08:03.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.511+0000 7efc83fff700 1 -- 172.21.15.72:0/82364217 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4494 (secure 0 0 0) 0x7efc9c0ac750 con 0x7efc9c152660 2023-08-31T19:08:03.512 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:08:03.512 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6926,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2210268438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2210268438},{"type":"v1","addr":"172.21.15.72:6836","nonce":2210268438}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3842453419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3842453419},{"type":"v1","addr":"172.21.15.146:6834","nonce":3842453419}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/282510582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":282510582},{"type":"v1","addr":"172.21.15.146:6835","nonce":282510582}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:07:57.873694+0000","modified":"2023-08-31T19:08:00.883204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8487":{"gid":8487,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3274545863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3274545863},{"type":"v1","addr":"172.21.15.72:6837","nonce":3274545863}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-31T19:08:03.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.513+0000 7efca25ff700 1 -- 172.21.15.72:0/82364217 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efc8805ef30 msgr2=0x7efc880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:03.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.513+0000 7efca25ff700 1 --2- 172.21.15.72:0/82364217 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efc8805ef30 0x7efc880613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7efc8c006f10 tx=0x7efc8c008040).stop 2023-08-31T19:08:03.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.513+0000 7efca25ff700 1 -- 172.21.15.72:0/82364217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc9c152660 msgr2=0x7efc9c0aaf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:03.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.513+0000 7efca25ff700 1 --2- 172.21.15.72:0/82364217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc9c152660 0x7efc9c0aaf60 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7efc900049f0 tx=0x7efc90001e90).stop 2023-08-31T19:08:03.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.513+0000 7efca25ff700 1 -- 172.21.15.72:0/82364217 shutdown_connections 2023-08-31T19:08:03.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.513+0000 7efca25ff700 1 --2- 172.21.15.72:0/82364217 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc9c0add40 0x7efc9c0ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:03.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.513+0000 7efca25ff700 1 --2- 172.21.15.72:0/82364217 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7efc8805ef30 0x7efc880613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:03.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.513+0000 7efca25ff700 1 --2- 172.21.15.72:0/82364217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc84004b80 0x7efc9c1648b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:03.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.513+0000 7efca25ff700 1 --2- 172.21.15.72:0/82364217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc9c152660 0x7efc9c0aaf60 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:03.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.513+0000 7efca25ff700 1 -- 172.21.15.72:0/82364217 >> 172.21.15.72:0/82364217 conn(0x7efc9c05e870 msgr2=0x7efc9c063090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:03.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.514+0000 7efca25ff700 1 -- 172.21.15.72:0/82364217 shutdown_connections 2023-08-31T19:08:03.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:03.514+0000 7efca25ff700 1 -- 172.21.15.72:0/82364217 wait complete. 2023-08-31T19:08:03.517 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 71 2023-08-31T19:08:03.933 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T19:07:57.873694+0000', 'modified': '2023-08-31T19:08:00.883204+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8487}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8487': {'gid': 8487, 'name': 'c', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6837/3274545863', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6835', 'nonce': 3274545863}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 3274545863}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-31T19:08:03.934 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T19:08:03.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-31T19:08:04.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.128+0000 7f5830dff700 1 Processor -- start 2023-08-31T19:08:04.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.128+0000 7f5830dff700 1 -- start start 2023-08-31T19:08:04.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.130+0000 7f5830dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f582c0c8ee0 0x7f582c154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.130+0000 7f5830dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c0c9450 con 0x7f582c0ca4f0 2023-08-31T19:08:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.130+0000 7f5830dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c0c9730 con 0x7f582c153ca0 2023-08-31T19:08:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.130+0000 7f5830dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c0c9a10 con 0x7f582c0c8ee0 2023-08-31T19:08:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.130+0000 7f5829d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f582c0c8ee0 0x7f582c154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.130+0000 7f582ad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f582c0ca4f0 0x7f582c063100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54482/0 (socket says 172.21.15.72:54482) 2023-08-31T19:08:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.130+0000 7f582ad9d700 1 -- 172.21.15.72:0/2248671434 learned_addr learned my addr 172.21.15.72:0/2248671434 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:08:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.130+0000 7f5829d9b700 1 -- 172.21.15.72:0/2248671434 >> v1:172.21.15.146:6789/0 conn(0x7f582c153ca0 legacy=0x7f582c158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.130+0000 7f5829d9b700 1 -- 172.21.15.72:0/2248671434 >> v1:172.21.15.72:6789/0 conn(0x7f582c0ca4f0 legacy=0x7f582c063100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.131+0000 7f5829d9b700 1 -- 172.21.15.72:0/2248671434 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0c9cf0 con 0x7f582c0c8ee0 2023-08-31T19:08:04.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.130+0000 7f582959a700 1 -- 172.21.15.72:0/2248671434 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289488282 0 0) 0x7f582c0c9450 con 0x7f582c0ca4f0 2023-08-31T19:08:04.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.131+0000 7f5829d9b700 1 --2- 172.21.15.72:0/2248671434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582c0c8ee0 0x7f582c154080 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f5820009760 tx=0x7f5820009060).ready entity=mon.0 client_cookie=f3fdb30ad9f82e97 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:04.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.131+0000 7f582959a700 1 -- 172.21.15.72:0/2248671434 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000b520 con 0x7f582c0c8ee0 2023-08-31T19:08:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.131+0000 7f582959a700 1 -- 172.21.15.72:0/2248671434 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582000b680 con 0x7f582c0c8ee0 2023-08-31T19:08:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.131+0000 7f582959a700 1 -- 172.21.15.72:0/2248671434 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000ba00 con 0x7f582c0c8ee0 2023-08-31T19:08:04.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.131+0000 7f5830dff700 1 -- 172.21.15.72:0/2248671434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582c0c8ee0 msgr2=0x7f582c154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:04.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.131+0000 7f5830dff700 1 --2- 172.21.15.72:0/2248671434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582c0c8ee0 0x7f582c154080 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f5820009760 tx=0x7f5820009060).stop 2023-08-31T19:08:04.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.131+0000 7f5830dff700 1 -- 172.21.15.72:0/2248671434 shutdown_connections 2023-08-31T19:08:04.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.131+0000 7f5830dff700 1 --2- 172.21.15.72:0/2248671434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582c0c8ee0 0x7f582c154080 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.131+0000 7f5830dff700 1 -- 172.21.15.72:0/2248671434 >> 172.21.15.72:0/2248671434 conn(0x7f582c0cadb0 msgr2=0x7f582c0cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:04.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.132+0000 7f5830dff700 1 -- 172.21.15.72:0/2248671434 shutdown_connections 2023-08-31T19:08:04.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.132+0000 7f5830dff700 1 -- 172.21.15.72:0/2248671434 wait complete. 2023-08-31T19:08:04.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.133+0000 7f5830dff700 1 Processor -- start 2023-08-31T19:08:04.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.133+0000 7f5830dff700 1 -- start start 2023-08-31T19:08:04.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.134+0000 7f5830dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f582c0c8ee0 0x7f582c142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.134+0000 7f5830dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f582c0ca4f0 0x7f582c0b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.134+0000 7f5830dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582c153ca0 0x7f582c0acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.134+0000 7f5830dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c142f40 con 0x7f582c153ca0 2023-08-31T19:08:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.134+0000 7f5830dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c165270 con 0x7f582c0c8ee0 2023-08-31T19:08:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.134+0000 7f5830dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c164660 con 0x7f582c0ca4f0 2023-08-31T19:08:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.134+0000 7f582ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582c153ca0 0x7f582c0acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.134+0000 7f582ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582c153ca0 0x7f582c0acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43192/0 (socket says 172.21.15.72:43192) 2023-08-31T19:08:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.134+0000 7f582ad9d700 1 -- 172.21.15.72:0/2739535989 learned_addr learned my addr 172.21.15.72:0/2739535989 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.135+0000 7f582a59c700 1 --2- 172.21.15.72:0/2739535989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f582c0c8ee0 0x7f582c142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.135+0000 7f5829d9b700 1 --2- 172.21.15.72:0/2739535989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f582c0ca4f0 0x7f582c0b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.135+0000 7f582ad9d700 1 -- 172.21.15.72:0/2739535989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f582c0ca4f0 msgr2=0x7f582c0b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.135+0000 7f582ad9d700 1 --2- 172.21.15.72:0/2739535989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f582c0ca4f0 0x7f582c0b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.135+0000 7f582ad9d700 1 -- 172.21.15.72:0/2739535989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f582c0c8ee0 msgr2=0x7f582c142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.135+0000 7f582ad9d700 1 --2- 172.21.15.72:0/2739535989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f582c0c8ee0 0x7f582c142a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.135+0000 7f582ad9d700 1 -- 172.21.15.72:0/2739535989 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58200092a0 con 0x7f582c153ca0 2023-08-31T19:08:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.135+0000 7f582ad9d700 1 --2- 172.21.15.72:0/2739535989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582c153ca0 0x7f582c0acbf0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f582400c7e0 tx=0x7f5824007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.135+0000 7f581a7fc700 1 -- 172.21.15.72:0/2739535989 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824005d30 con 0x7f582c153ca0 2023-08-31T19:08:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.135+0000 7f581a7fc700 1 -- 172.21.15.72:0/2739535989 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5824005e90 con 0x7f582c153ca0 2023-08-31T19:08:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.135+0000 7f5830dff700 1 -- 172.21.15.72:0/2739535989 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c164940 con 0x7f582c153ca0 2023-08-31T19:08:04.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.135+0000 7f581a7fc700 1 -- 172.21.15.72:0/2739535989 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824007320 con 0x7f582c153ca0 2023-08-31T19:08:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.135+0000 7f5830dff700 1 -- 172.21.15.72:0/2739535989 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c164f00 con 0x7f582c153ca0 2023-08-31T19:08:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.137+0000 7f581a7fc700 1 -- 172.21.15.72:0/2739535989 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f5824007710 con 0x7f582c153ca0 2023-08-31T19:08:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.138+0000 7f581a7fc700 1 --2- 172.21.15.72:0/2739535989 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f580c05ef30 0x7f580c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.138+0000 7f581a7fc700 1 -- 172.21.15.72:0/2739535989 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f582407a210 con 0x7f582c153ca0 2023-08-31T19:08:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.138+0000 7f582a59c700 1 --2- 172.21.15.72:0/2739535989 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f580c05ef30 0x7f580c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.139+0000 7f582a59c700 1 --2- 172.21.15.72:0/2739535989 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f580c05ef30 0x7f580c0613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f581c00b9b0 tx=0x7f581c008040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.140+0000 7f584810fb80 1 Processor -- start 2023-08-31T19:08:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.140+0000 7f584810fb80 1 -- start start 2023-08-31T19:08:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.141+0000 7f584810fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a27f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.141+0000 7f584810fb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a27a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.141+0000 7f584810fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 0x561f0a27af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.141+0000 7f584810fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f0a1bbdb0 con 0x561f0a27f2c0 2023-08-31T19:08:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.141+0000 7f584810fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f0a1d1030 con 0x561f0a27aaf0 2023-08-31T19:08:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.141+0000 7f584810fb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f0a1d1170 con 0x561f0a2c7f60 2023-08-31T19:08:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.141+0000 7f582a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a27f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.141+0000 7f582a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a27f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43204/0 (socket says 172.21.15.72:43204) 2023-08-31T19:08:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.141+0000 7f582a59c700 1 -- 172.21.15.72:0/3516906125 learned_addr learned my addr 172.21.15.72:0/3516906125 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.142+0000 7f5829d9b700 1 --2- 172.21.15.72:0/3516906125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a27a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.142+0000 7f582ad9d700 1 --2- 172.21.15.72:0/3516906125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 0x561f0a27af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.142+0000 7f582a59c700 1 -- 172.21.15.72:0/3516906125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 msgr2=0x561f0a27a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:04.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.142+0000 7f582a59c700 1 --2- 172.21.15.72:0/3516906125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a27a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.142+0000 7f582a59c700 1 -- 172.21.15.72:0/3516906125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 msgr2=0x561f0a27af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:04.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.142+0000 7f582a59c700 1 --2- 172.21.15.72:0/3516906125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 0x561f0a27af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.142+0000 7f582a59c700 1 -- 172.21.15.72:0/3516906125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f0a1a3b00 con 0x561f0a27f2c0 2023-08-31T19:08:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.142+0000 7f5829d9b700 1 --2- 172.21.15.72:0/3516906125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a27a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:08:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.142+0000 7f582ad9d700 1 --2- 172.21.15.72:0/3516906125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 0x561f0a27af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:08:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.142+0000 7f582a59c700 1 --2- 172.21.15.72:0/3516906125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a27f6a0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f581c00e980 tx=0x7f581c013000).ready entity=mon.0 client_cookie=63178aa0b0bfe1c8 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.142+0000 7f580b7fe700 1 -- 172.21.15.72:0/3516906125 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c00b240 con 0x561f0a27f2c0 2023-08-31T19:08:04.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.142+0000 7f580b7fe700 1 -- 172.21.15.72:0/3516906125 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c0126d0 con 0x561f0a27f2c0 2023-08-31T19:08:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.142+0000 7f580b7fe700 1 -- 172.21.15.72:0/3516906125 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c012a70 con 0x561f0a27f2c0 2023-08-31T19:08:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.143+0000 7f584810fb80 1 -- 172.21.15.72:0/3516906125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 msgr2=0x561f0a27f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.143+0000 7f584810fb80 1 --2- 172.21.15.72:0/3516906125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a27f6a0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f581c00e980 tx=0x7f581c013000).stop 2023-08-31T19:08:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.143+0000 7f584810fb80 1 -- 172.21.15.72:0/3516906125 shutdown_connections 2023-08-31T19:08:04.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.143+0000 7f584810fb80 1 --2- 172.21.15.72:0/3516906125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 0x561f0a27af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.143+0000 7f584810fb80 1 --2- 172.21.15.72:0/3516906125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a27f6a0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.143+0000 7f584810fb80 1 --2- 172.21.15.72:0/3516906125 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a27a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.143+0000 7f584810fb80 1 -- 172.21.15.72:0/3516906125 >> 172.21.15.72:0/3516906125 conn(0x561f0a0e9940 msgr2=0x561f0a2c83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:04.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.143+0000 7f584810fb80 1 -- 172.21.15.72:0/3516906125 shutdown_connections 2023-08-31T19:08:04.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.143+0000 7f584810fb80 1 -- 172.21.15.72:0/3516906125 wait complete. 2023-08-31T19:08:04.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.144+0000 7f584810fb80 1 -- start start 2023-08-31T19:08:04.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.144+0000 7f584810fb80 1 Processor -- start 2023-08-31T19:08:04.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.145+0000 7f584810fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 0x561f0a2a8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.145+0000 7f584810fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a2aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.145+0000 7f584810fb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a2aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.145+0000 7f584810fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f0a1d13f0 con 0x561f0a27f2c0 2023-08-31T19:08:04.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.145+0000 7f584810fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f0a19c920 con 0x561f0a27aaf0 2023-08-31T19:08:04.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.145+0000 7f584810fb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f0a2c6780 con 0x561f0a2c7f60 2023-08-31T19:08:04.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.145+0000 7f584810fb80 10 client.0 ll_register_callbacks cb 0x561f0a171ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:08:04.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.145+0000 7f5829d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a2aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.145+0000 7f5829d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a2aa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43214/0 (socket says 172.21.15.72:43214) 2023-08-31T19:08:04.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.145+0000 7f5829d9b700 1 -- 172.21.15.72:0/1429082133 learned_addr learned my addr 172.21.15.72:0/1429082133 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:04.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f582a59c700 1 --2- 172.21.15.72:0/1429082133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 0x561f0a2a8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f5829d9b700 1 -- 172.21.15.72:0/1429082133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 msgr2=0x561f0a2aaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:04.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f582ad9d700 1 --2- 172.21.15.72:0/1429082133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a2aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f5829d9b700 1 --2- 172.21.15.72:0/1429082133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a2aaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f5829d9b700 1 -- 172.21.15.72:0/1429082133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 msgr2=0x561f0a2a8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:04.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f5829d9b700 1 --2- 172.21.15.72:0/1429082133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 0x561f0a2a8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f5829d9b700 1 -- 172.21.15.72:0/1429082133 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581c00e670 con 0x561f0a27f2c0 2023-08-31T19:08:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f582a59c700 1 --2- 172.21.15.72:0/1429082133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 0x561f0a2a8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:08:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f582ad9d700 1 --2- 172.21.15.72:0/1429082133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a2aaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:08:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f5829d9b700 1 --2- 172.21.15.72:0/1429082133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a2aa5a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f582c0c1de0 tx=0x7f5820017000).ready entity=mon.0 client_cookie=98ad66d5ddc1a403 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f5808ff9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:08:04.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f5808ff9700 1 -- 172.21.15.72:0/1429082133 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820021070 con 0x561f0a27f2c0 2023-08-31T19:08:04.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f584810fb80 1 -- 172.21.15.72:0/1429082133 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f0a279aa0 con 0x561f0a27f2c0 2023-08-31T19:08:04.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f5808ff9700 1 -- 172.21.15.72:0/1429082133 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f582001b770 con 0x561f0a27f2c0 2023-08-31T19:08:04.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f5808ff9700 1 -- 172.21.15.72:0/1429082133 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f582001bb40 con 0x561f0a27f2c0 2023-08-31T19:08:04.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f584810fb80 10 client.8655 fetch_fsmap learned FSMap version 71 2023-08-31T19:08:04.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.146+0000 7f584810fb80 1 -- 172.21.15.72:0/1429082133 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x561f0a1c9f70 con 0x561f0a27f2c0 2023-08-31T19:08:04.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.147+0000 7f5808ff9700 1 -- 172.21.15.72:0/1429082133 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561f0a279aa0 con 0x561f0a27f2c0 2023-08-31T19:08:04.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.147+0000 7f5808ff9700 1 -- 172.21.15.72:0/1429082133 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 71) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5820009840 con 0x561f0a27f2c0 2023-08-31T19:08:04.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.147+0000 7f584810fb80 10 client.8655 fetch_fsmap finished waiting for FSMap version 71 2023-08-31T19:08:04.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.147+0000 7f584810fb80 10 client.8655 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-31T19:08:04.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.147+0000 7f584810fb80 20 client.8655 populate_metadata read hostname 'smithi072' 2023-08-31T19:08:04.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.147+0000 7f584810fb80 1 --2- 172.21.15.72:0/1429082133 >> [v2:172.21.15.72:6835/3274545863,v1:172.21.15.72:6837/3274545863] conn(0x561f0a2a4b90 0x561f0a2d7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.147+0000 7f584810fb80 4 client.8655 mds_command: new command op to 8487 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T19:08:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.147+0000 7f584810fb80 1 -- 172.21.15.72:0/1429082133 --> [v2:172.21.15.72:6835/3274545863,v1:172.21.15.72:6837/3274545863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f0a039ef0 con 0x561f0a2a4b90 2023-08-31T19:08:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.147+0000 7f582a59c700 1 --2- 172.21.15.72:0/1429082133 >> [v2:172.21.15.72:6835/3274545863,v1:172.21.15.72:6837/3274545863] conn(0x561f0a2a4b90 0x561f0a2d7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.148+0000 7f582a59c700 1 --2- 172.21.15.72:0/1429082133 >> [v2:172.21.15.72:6835/3274545863,v1:172.21.15.72:6837/3274545863] conn(0x561f0a2a4b90 0x561f0a2d7720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b69bcb83022fa55e server_cookie=e2f7ed677a2a515e in_seq=0 out_seq=0 2023-08-31T19:08:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.148+0000 7f5808ff9700 10 client.8655 ms_handle_connect on v2:172.21.15.72:6835/3274545863 2023-08-31T19:08:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.148+0000 7f5808ff9700 1 -- 172.21.15.72:0/1429082133 <== mds.0 v2:172.21.15.72:6835/3274545863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x561f0a039ef0 con 0x561f0a2a4b90 2023-08-31T19:08:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.148+0000 7f5808ff9700 10 client.8655 handle_command_reply: tid=0 2023-08-31T19:08:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.148+0000 7f584810fb80 1 client.8655 shutdown 2023-08-31T19:08:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.148+0000 7f584810fb80 1 -- 172.21.15.72:0/1429082133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 msgr2=0x561f0a2aa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.148+0000 7f584810fb80 1 --2- 172.21.15.72:0/1429082133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a2aa5a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f582c0c1de0 tx=0x7f5820017000).stop 2023-08-31T19:08:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.149+0000 7f584810fb80 1 -- 172.21.15.72:0/1429082133 shutdown_connections 2023-08-31T19:08:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.149+0000 7f584810fb80 1 --2- 172.21.15.72:0/1429082133 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a2aaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.149+0000 7f584810fb80 1 --2- 172.21.15.72:0/1429082133 >> [v2:172.21.15.72:6835/3274545863,v1:172.21.15.72:6837/3274545863] conn(0x561f0a2a4b90 0x561f0a2d7720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.149+0000 7f584810fb80 1 --2- 172.21.15.72:0/1429082133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 0x561f0a2a8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.149+0000 7f584810fb80 1 --2- 172.21.15.72:0/1429082133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a2aa5a0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.149+0000 7f5808ff9700 0 client.8655 ms_handle_reset on v2:172.21.15.72:6835/3274545863 2023-08-31T19:08:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.149+0000 7f584810fb80 1 -- 172.21.15.72:0/1429082133 >> 172.21.15.72:0/1429082133 conn(0x561f0a0e9940 msgr2=0x561f0a27af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.149+0000 7f584810fb80 1 -- 172.21.15.72:0/1429082133 shutdown_connections 2023-08-31T19:08:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.149+0000 7f584810fb80 1 -- 172.21.15.72:0/1429082133 wait complete. 2023-08-31T19:08:04.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.149+0000 7f584810fb80 20 client.8655 trim_cache size 0 max 16384 2023-08-31T19:08:04.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.165+0000 7f584810fb80 1 Processor -- start 2023-08-31T19:08:04.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.166+0000 7f584810fb80 1 -- start start 2023-08-31T19:08:04.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.166+0000 7f584810fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27aaf0 0x561f0a2a7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.166+0000 7f584810fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27f2c0 0x561f0a2c3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.166+0000 7f584810fb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a2cca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.166+0000 7f584810fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f0a27f740 con 0x561f0a27aaf0 2023-08-31T19:08:04.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.166+0000 7f584810fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f0a2a4940 con 0x561f0a27f2c0 2023-08-31T19:08:04.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.166+0000 7f584810fb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f0a2a8850 con 0x561f0a2c7f60 2023-08-31T19:08:04.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.167+0000 7f582a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27aaf0 0x561f0a2a7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.167+0000 7f582a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27aaf0 0x561f0a2a7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43216/0 (socket says 172.21.15.72:43216) 2023-08-31T19:08:04.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.167+0000 7f582a59c700 1 -- 172.21.15.72:0/1654858886 learned_addr learned my addr 172.21.15.72:0/1654858886 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:04.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.167+0000 7f5829d9b700 1 --2- 172.21.15.72:0/1654858886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27f2c0 0x561f0a2c3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.167+0000 7f582ad9d700 1 --2- 172.21.15.72:0/1654858886 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a2cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.167+0000 7f582a59c700 1 -- 172.21.15.72:0/1654858886 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 msgr2=0x561f0a2cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:04.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.167+0000 7f582a59c700 1 --2- 172.21.15.72:0/1654858886 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a2cca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.167+0000 7f582a59c700 1 -- 172.21.15.72:0/1654858886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27f2c0 msgr2=0x561f0a2c3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:04.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.167+0000 7f582a59c700 1 --2- 172.21.15.72:0/1654858886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27f2c0 0x561f0a2c3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.167+0000 7f582a59c700 1 -- 172.21.15.72:0/1654858886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f0a1c5580 con 0x561f0a27aaf0 2023-08-31T19:08:04.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.167+0000 7f582a59c700 1 --2- 172.21.15.72:0/1654858886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27aaf0 0x561f0a2a7150 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f581c01c000 tx=0x7f581c014040).ready entity=mon.0 client_cookie=62dd369bc6e60fc server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:04.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.168+0000 7f580bfff700 1 -- 172.21.15.72:0/1654858886 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c02d070 con 0x561f0a27aaf0 2023-08-31T19:08:04.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.168+0000 7f580bfff700 1 -- 172.21.15.72:0/1654858886 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c012840 con 0x561f0a27aaf0 2023-08-31T19:08:04.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.168+0000 7f580bfff700 1 -- 172.21.15.72:0/1654858886 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c012ea0 con 0x561f0a27aaf0 2023-08-31T19:08:04.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.168+0000 7f584810fb80 1 -- 172.21.15.72:0/1654858886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27aaf0 msgr2=0x561f0a2a7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:04.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.168+0000 7f584810fb80 1 --2- 172.21.15.72:0/1654858886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27aaf0 0x561f0a2a7150 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f581c01c000 tx=0x7f581c014040).stop 2023-08-31T19:08:04.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.168+0000 7f584810fb80 1 -- 172.21.15.72:0/1654858886 shutdown_connections 2023-08-31T19:08:04.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.168+0000 7f584810fb80 1 --2- 172.21.15.72:0/1654858886 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a2cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.168+0000 7f584810fb80 1 --2- 172.21.15.72:0/1654858886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27aaf0 0x561f0a2a7150 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.168+0000 7f584810fb80 1 --2- 172.21.15.72:0/1654858886 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27f2c0 0x561f0a2c3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.168+0000 7f584810fb80 1 -- 172.21.15.72:0/1654858886 >> 172.21.15.72:0/1654858886 conn(0x561f0a0e9940 msgr2=0x561f0a27aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:04.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.168+0000 7f584810fb80 1 -- 172.21.15.72:0/1654858886 shutdown_connections 2023-08-31T19:08:04.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.168+0000 7f584810fb80 1 -- 172.21.15.72:0/1654858886 wait complete. 2023-08-31T19:08:04.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.169+0000 7f584810fb80 1 -- start start 2023-08-31T19:08:04.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.169+0000 7f584810fb80 1 Processor -- start 2023-08-31T19:08:04.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.170+0000 7f584810fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 0x561f0a329210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.170+0000 7f584810fb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a2a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.170+0000 7f584810fb80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a2cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.170+0000 7f584810fb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f0a32ae10 con 0x561f0a27f2c0 2023-08-31T19:08:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.170+0000 7f584810fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f0a2d6120 con 0x561f0a27aaf0 2023-08-31T19:08:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.170+0000 7f584810fb80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f0a2aa2f0 con 0x561f0a2c7f60 2023-08-31T19:08:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.170+0000 7f584810fb80 10 client.0 ll_register_callbacks cb 0x561f0a171ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:08:04.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.170+0000 7f5829d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a2a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.171+0000 7f5829d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a2a9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43224/0 (socket says 172.21.15.72:43224) 2023-08-31T19:08:04.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.171+0000 7f5829d9b700 1 -- 172.21.15.72:0/2024853453 learned_addr learned my addr 172.21.15.72:0/2024853453 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:04.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.171+0000 7f582a59c700 1 --2- 172.21.15.72:0/2024853453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 0x561f0a329210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.171+0000 7f582ad9d700 1 --2- 172.21.15.72:0/2024853453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a2cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.171+0000 7f5829d9b700 1 -- 172.21.15.72:0/2024853453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 msgr2=0x561f0a2cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:04.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.171+0000 7f5829d9b700 1 --2- 172.21.15.72:0/2024853453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a2cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.171+0000 7f5829d9b700 1 -- 172.21.15.72:0/2024853453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 msgr2=0x561f0a329210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:04.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.171+0000 7f5829d9b700 1 --2- 172.21.15.72:0/2024853453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 0x561f0a329210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.171+0000 7f5829d9b700 1 -- 172.21.15.72:0/2024853453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f0a1a3b00 con 0x561f0a27f2c0 2023-08-31T19:08:04.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.171+0000 7f5829d9b700 1 --2- 172.21.15.72:0/2024853453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a2a9e00 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f5820009ed0 tx=0x7f5820021000).ready entity=mon.0 client_cookie=594ac823140aaf4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:04.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.171+0000 7f5808ff9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:08:04.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.171+0000 7f5808ff9700 1 -- 172.21.15.72:0/2024853453 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582001b770 con 0x561f0a27f2c0 2023-08-31T19:08:04.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.171+0000 7f5808ff9700 1 -- 172.21.15.72:0/2024853453 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f582002f5b0 con 0x561f0a27f2c0 2023-08-31T19:08:04.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.171+0000 7f584810fb80 1 -- 172.21.15.72:0/2024853453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f581c0126d0 con 0x561f0a27f2c0 2023-08-31T19:08:04.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.172+0000 7f5808ff9700 1 -- 172.21.15.72:0/2024853453 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f582002f980 con 0x561f0a27f2c0 2023-08-31T19:08:04.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.172+0000 7f584810fb80 10 client.8661 fetch_fsmap learned FSMap version 71 2023-08-31T19:08:04.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.172+0000 7f584810fb80 1 -- 172.21.15.72:0/2024853453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x561f0a1c52d0 con 0x561f0a27f2c0 2023-08-31T19:08:04.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.172+0000 7f5808ff9700 1 -- 172.21.15.72:0/2024853453 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c0126d0 con 0x561f0a27f2c0 2023-08-31T19:08:04.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.172+0000 7f5808ff9700 1 -- 172.21.15.72:0/2024853453 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 71) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5820018040 con 0x561f0a27f2c0 2023-08-31T19:08:04.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.172+0000 7f584810fb80 10 client.8661 fetch_fsmap finished waiting for FSMap version 71 2023-08-31T19:08:04.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.172+0000 7f584810fb80 10 client.8661 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-31T19:08:04.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.172+0000 7f584810fb80 20 client.8661 populate_metadata read hostname 'smithi072' 2023-08-31T19:08:04.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.172+0000 7f584810fb80 1 --2- 172.21.15.72:0/2024853453 >> [v2:172.21.15.72:6835/3274545863,v1:172.21.15.72:6837/3274545863] conn(0x561f0a2c4c00 0x561f0a2c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.172+0000 7f584810fb80 4 client.8661 mds_command: new command op to 8487 tid=0[{"prefix": "status"}] 2023-08-31T19:08:04.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.172+0000 7f584810fb80 1 -- 172.21.15.72:0/2024853453 --> [v2:172.21.15.72:6835/3274545863,v1:172.21.15.72:6837/3274545863] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561f0a06f040 con 0x561f0a2c4c00 2023-08-31T19:08:04.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.172+0000 7f582a59c700 1 --2- 172.21.15.72:0/2024853453 >> [v2:172.21.15.72:6835/3274545863,v1:172.21.15.72:6837/3274545863] conn(0x561f0a2c4c00 0x561f0a2c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f5808ff9700 10 client.8661 ms_handle_connect on v2:172.21.15.72:6835/3274545863 2023-08-31T19:08:04.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f582a59c700 1 --2- 172.21.15.72:0/2024853453 >> [v2:172.21.15.72:6835/3274545863,v1:172.21.15.72:6837/3274545863] conn(0x561f0a2c4c00 0x561f0a2c4fe0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=27abc9c3dfe80900 server_cookie=5b685ac7d29ffa2c in_seq=0 out_seq=0 2023-08-31T19:08:04.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f5808ff9700 1 -- 172.21.15.72:0/2024853453 <== mds.0 v2:172.21.15.72:6835/3274545863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x561f0a06f040 con 0x561f0a2c4c00 2023-08-31T19:08:04.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f5808ff9700 10 client.8661 handle_command_reply: tid=0 2023-08-31T19:08:04.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f584810fb80 1 client.8661 shutdown 2023-08-31T19:08:04.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f584810fb80 1 -- 172.21.15.72:0/2024853453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 msgr2=0x561f0a2a9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:04.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f584810fb80 1 --2- 172.21.15.72:0/2024853453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a2a9e00 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f5820009ed0 tx=0x7f5820021000).stop 2023-08-31T19:08:04.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f584810fb80 1 -- 172.21.15.72:0/2024853453 shutdown_connections 2023-08-31T19:08:04.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f584810fb80 1 --2- 172.21.15.72:0/2024853453 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x561f0a2c7f60 0x561f0a2cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f584810fb80 1 --2- 172.21.15.72:0/2024853453 >> [v2:172.21.15.72:6835/3274545863,v1:172.21.15.72:6837/3274545863] conn(0x561f0a2c4c00 0x561f0a2c4fe0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f584810fb80 1 --2- 172.21.15.72:0/2024853453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561f0a27aaf0 0x561f0a329210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f584810fb80 1 --2- 172.21.15.72:0/2024853453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f0a27f2c0 0x561f0a2a9e00 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f584810fb80 1 -- 172.21.15.72:0/2024853453 >> 172.21.15.72:0/2024853453 conn(0x561f0a0e9940 msgr2=0x561f0a2c3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:04.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f5808ff9700 0 client.8661 ms_handle_reset on v2:172.21.15.72:6835/3274545863 2023-08-31T19:08:04.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f584810fb80 1 -- 172.21.15.72:0/2024853453 shutdown_connections 2023-08-31T19:08:04.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.173+0000 7f584810fb80 1 -- 172.21.15.72:0/2024853453 wait complete. 2023-08-31T19:08:04.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.174+0000 7f584810fb80 20 client.8661 trim_cache size 0 max 16384 2023-08-31T19:08:04.217 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:08:04.217 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "acadb8ca-1685-49e1-a73f-5e9d14d95be9", 2023-08-31T19:08:04.217 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-08-31T19:08:04.218 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 8487, 2023-08-31T19:08:04.218 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-08-31T19:08:04.218 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-08-31T19:08:04.218 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-08-31T19:08:04.219 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 6.2979215630000001, 2023-08-31T19:08:04.219 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 71, 2023-08-31T19:08:04.219 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 157, 2023-08-31T19:08:04.219 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 157, 2023-08-31T19:08:04.219 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 11.504923663 2023-08-31T19:08:04.220 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:08:04.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.174+0000 7f5830dff700 1 -- 172.21.15.72:0/2739535989 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f580c05ef30 msgr2=0x7f580c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:04.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.174+0000 7f5830dff700 1 --2- 172.21.15.72:0/2739535989 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f580c05ef30 0x7f580c0613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f581c00b9b0 tx=0x7f581c008040).stop 2023-08-31T19:08:04.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.174+0000 7f5830dff700 1 -- 172.21.15.72:0/2739535989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582c153ca0 msgr2=0x7f582c0acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:04.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.174+0000 7f5830dff700 1 --2- 172.21.15.72:0/2739535989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582c153ca0 0x7f582c0acbf0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f582400c7e0 tx=0x7f5824007f90).stop 2023-08-31T19:08:04.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.174+0000 7f5830dff700 1 -- 172.21.15.72:0/2739535989 shutdown_connections 2023-08-31T19:08:04.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.174+0000 7f5830dff700 1 --2- 172.21.15.72:0/2739535989 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582c153ca0 0x7f582c0acbf0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.174+0000 7f5830dff700 1 --2- 172.21.15.72:0/2739535989 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f580c05ef30 0x7f580c0613f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.174+0000 7f5830dff700 1 --2- 172.21.15.72:0/2739535989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f582c0c8ee0 0x7f582c142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.174+0000 7f5830dff700 1 --2- 172.21.15.72:0/2739535989 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f582c0ca4f0 0x7f582c0b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.174+0000 7f5830dff700 1 -- 172.21.15.72:0/2739535989 >> 172.21.15.72:0/2739535989 conn(0x7f582c0cadb0 msgr2=0x7f582c14e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:04.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.174+0000 7f5830dff700 1 -- 172.21.15.72:0/2739535989 shutdown_connections 2023-08-31T19:08:04.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.174+0000 7f5830dff700 1 -- 172.21.15.72:0/2739535989 wait complete. 2023-08-31T19:08:04.224 DEBUG:teuthology.orchestra.run.smithi072:> ceph fs ls 2023-08-31T19:08:04.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.381+0000 7f81fc5ff700 1 Processor -- start 2023-08-31T19:08:04.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.382+0000 7f81fc5ff700 1 -- start start 2023-08-31T19:08:04.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.383+0000 7f81fc5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f4154460 0x7f81f40c1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.383+0000 7f81fc5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81f40ca510 0x7f81f40a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.383+0000 7f81fc5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81f40a7fe0 0x7f81f40bff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.383+0000 7f81fc5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f40ca080 con 0x7f81f40ca510 2023-08-31T19:08:04.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.383+0000 7f81fc5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f40c72d0 con 0x7f81f40a7fe0 2023-08-31T19:08:04.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.383+0000 7f81fc5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40c9750 con 0x7f81f4154460 2023-08-31T19:08:04.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.383+0000 7f81f9b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81f40ca510 0x7f81f40a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.383+0000 7f81f9b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81f40ca510 0x7f81f40a7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43232/0 (socket says 172.21.15.72:43232) 2023-08-31T19:08:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.383+0000 7f81f9b9a700 1 -- 172.21.15.72:0/2407084391 learned_addr learned my addr 172.21.15.72:0/2407084391 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.383+0000 7f81fab9c700 1 --2- 172.21.15.72:0/2407084391 >> v2:172.21.15.146:3300/0 conn(0x7f81f40a7fe0 0x7f81f40bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.383+0000 7f81fa39b700 1 --2- 172.21.15.72:0/2407084391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f4154460 0x7f81f40c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.384+0000 7f81f9b9a700 1 -- 172.21.15.72:0/2407084391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f4154460 msgr2=0x7f81f40c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:04.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.384+0000 7f81f9b9a700 1 --2- 172.21.15.72:0/2407084391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f4154460 0x7f81f40c1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.384+0000 7f81f9b9a700 1 -- 172.21.15.72:0/2407084391 >> v2:172.21.15.146:3300/0 conn(0x7f81f40a7fe0 msgr2=0x7f81f40bff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.384+0000 7f81f9b9a700 1 --2- 172.21.15.72:0/2407084391 >> v2:172.21.15.146:3300/0 conn(0x7f81f40a7fe0 0x7f81f40bff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.384+0000 7f81f9b9a700 1 -- 172.21.15.72:0/2407084391 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f40c9a30 con 0x7f81f40ca510 2023-08-31T19:08:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.384+0000 7f81fab9c700 1 --2- 172.21.15.72:0/2407084391 >> v2:172.21.15.146:3300/0 conn(0x7f81f40a7fe0 0x7f81f40bff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:08:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.384+0000 7f81f9b9a700 1 --2- 172.21.15.72:0/2407084391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f40ca510 0x7f81f40a7af0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f81f4083f50 tx=0x7f81e40090f0).ready entity=mon.0 client_cookie=d23779dfa76a0139 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.384+0000 7f81f9399700 1 -- 172.21.15.72:0/2407084391 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e400b600 con 0x7f81f40ca510 2023-08-31T19:08:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.384+0000 7f81f9399700 1 -- 172.21.15.72:0/2407084391 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e400b760 con 0x7f81f40ca510 2023-08-31T19:08:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.384+0000 7f81f9399700 1 -- 172.21.15.72:0/2407084391 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e400bae0 con 0x7f81f40ca510 2023-08-31T19:08:04.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.384+0000 7f81fc5ff700 1 -- 172.21.15.72:0/2407084391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f40ca510 msgr2=0x7f81f40a7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:04.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.384+0000 7f81fc5ff700 1 --2- 172.21.15.72:0/2407084391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f40ca510 0x7f81f40a7af0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f81f4083f50 tx=0x7f81e40090f0).stop 2023-08-31T19:08:04.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.385+0000 7f81fc5ff700 1 -- 172.21.15.72:0/2407084391 shutdown_connections 2023-08-31T19:08:04.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.385+0000 7f81fc5ff700 1 --2- 172.21.15.72:0/2407084391 >> v2:172.21.15.146:3300/0 conn(0x7f81f40a7fe0 0x7f81f40bff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.385+0000 7f81fc5ff700 1 --2- 172.21.15.72:0/2407084391 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f4154460 0x7f81f40c1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.385+0000 7f81fc5ff700 1 --2- 172.21.15.72:0/2407084391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f40ca510 0x7f81f40a7af0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.385+0000 7f81fc5ff700 1 -- 172.21.15.72:0/2407084391 >> 172.21.15.72:0/2407084391 conn(0x7f81f406a560 msgr2=0x7f81f40cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:04.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.385+0000 7f81fc5ff700 1 -- 172.21.15.72:0/2407084391 shutdown_connections 2023-08-31T19:08:04.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.385+0000 7f81fc5ff700 1 -- 172.21.15.72:0/2407084391 wait complete. 2023-08-31T19:08:04.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.387+0000 7f81fc5ff700 1 Processor -- start 2023-08-31T19:08:04.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.387+0000 7f81fc5ff700 1 -- start start 2023-08-31T19:08:04.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.388+0000 7f81fc5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f40a7fe0 0x7f81f4156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.388+0000 7f81fc5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f40ca510 0x7f81f40c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.388+0000 7f81fc5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4154460 0x7f81f4151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.388+0000 7f81fc5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40ab160 con 0x7f81f40ca510 2023-08-31T19:08:04.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.388+0000 7f81fc5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40c3b60 con 0x7f81f4154460 2023-08-31T19:08:04.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.388+0000 7f81fc5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f4157990 con 0x7f81f40a7fe0 2023-08-31T19:08:04.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.388+0000 7f81f9b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f40ca510 0x7f81f40c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.388+0000 7f81f9b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f40ca510 0x7f81f40c3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43248/0 (socket says 172.21.15.72:43248) 2023-08-31T19:08:04.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.388+0000 7f81f9b9a700 1 -- 172.21.15.72:0/1123033198 learned_addr learned my addr 172.21.15.72:0/1123033198 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:04.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.389+0000 7f81fa39b700 1 --2- 172.21.15.72:0/1123033198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f40a7fe0 0x7f81f4156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.389+0000 7f81fab9c700 1 --2- 172.21.15.72:0/1123033198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4154460 0x7f81f4151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.389+0000 7f81f9b9a700 1 -- 172.21.15.72:0/1123033198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f40a7fe0 msgr2=0x7f81f4156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:04.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.389+0000 7f81f9b9a700 1 --2- 172.21.15.72:0/1123033198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f40a7fe0 0x7f81f4156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.389+0000 7f81f9b9a700 1 -- 172.21.15.72:0/1123033198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4154460 msgr2=0x7f81f4151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:04.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.389+0000 7f81f9b9a700 1 --2- 172.21.15.72:0/1123033198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4154460 0x7f81f4151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.389+0000 7f81f9b9a700 1 -- 172.21.15.72:0/1123033198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e4009370 con 0x7f81f40ca510 2023-08-31T19:08:04.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.389+0000 7f81f9b9a700 1 --2- 172.21.15.72:0/1123033198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f40ca510 0x7f81f40c3fc0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f81e4006fd0 tx=0x7f81e4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:04.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.389+0000 7f81ea7fc700 1 -- 172.21.15.72:0/1123033198 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e400b8d0 con 0x7f81f40ca510 2023-08-31T19:08:04.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.389+0000 7f81ea7fc700 1 -- 172.21.15.72:0/1123033198 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e400ba30 con 0x7f81f40ca510 2023-08-31T19:08:04.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.389+0000 7f81fc5ff700 1 -- 172.21.15.72:0/1123033198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f4157150 con 0x7f81f40ca510 2023-08-31T19:08:04.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.389+0000 7f81ea7fc700 1 -- 172.21.15.72:0/1123033198 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e401b690 con 0x7f81f40ca510 2023-08-31T19:08:04.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.389+0000 7f81fc5ff700 1 -- 172.21.15.72:0/1123033198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f4157730 con 0x7f81f40ca510 2023-08-31T19:08:04.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.390+0000 7f81fc5ff700 1 -- 172.21.15.72:0/1123033198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f4047480 con 0x7f81f40ca510 2023-08-31T19:08:04.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.391+0000 7f81ea7fc700 1 -- 172.21.15.72:0/1123033198 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f81e401ba00 con 0x7f81f40ca510 2023-08-31T19:08:04.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.392+0000 7f81ea7fc700 1 --2- 172.21.15.72:0/1123033198 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f81d805ef30 0x7f81d80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:04.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.392+0000 7f81ea7fc700 1 -- 172.21.15.72:0/1123033198 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f81e407b920 con 0x7f81f40ca510 2023-08-31T19:08:04.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.392+0000 7f81fa39b700 1 --2- 172.21.15.72:0/1123033198 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f81d805ef30 0x7f81d80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:04.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.393+0000 7f81fa39b700 1 --2- 172.21.15.72:0/1123033198 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f81d805ef30 0x7f81d80613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f81f0006fd0 tx=0x7f81f0008040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:04.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.396+0000 7f81ea7fc700 1 -- 172.21.15.72:0/1123033198 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f81e404ca10 con 0x7f81f40ca510 2023-08-31T19:08:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.607+0000 7f81fc5ff700 1 -- 172.21.15.72:0/1123033198 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f81f40ab490 con 0x7f81f40ca510 2023-08-31T19:08:04.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.607+0000 7f81ea7fc700 1 -- 172.21.15.72:0/1123033198 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v71) v1 ==== 53+0+73 (secure 0 0 0) 0x7f81e401bcb0 con 0x7f81f40ca510 2023-08-31T19:08:04.608 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T19:08:04.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.609+0000 7f81fc5ff700 1 -- 172.21.15.72:0/1123033198 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f81d805ef30 msgr2=0x7f81d80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:04.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.609+0000 7f81fc5ff700 1 --2- 172.21.15.72:0/1123033198 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f81d805ef30 0x7f81d80613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f81f0006fd0 tx=0x7f81f0008040).stop 2023-08-31T19:08:04.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.609+0000 7f81fc5ff700 1 -- 172.21.15.72:0/1123033198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f40ca510 msgr2=0x7f81f40c3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:04.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.609+0000 7f81fc5ff700 1 --2- 172.21.15.72:0/1123033198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f40ca510 0x7f81f40c3fc0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f81e4006fd0 tx=0x7f81e4017000).stop 2023-08-31T19:08:04.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.609+0000 7f81fc5ff700 1 -- 172.21.15.72:0/1123033198 shutdown_connections 2023-08-31T19:08:04.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.609+0000 7f81fc5ff700 1 --2- 172.21.15.72:0/1123033198 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f81d805ef30 0x7f81d80613f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.609+0000 7f81fc5ff700 1 --2- 172.21.15.72:0/1123033198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f4154460 0x7f81f4151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.609+0000 7f81fc5ff700 1 --2- 172.21.15.72:0/1123033198 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f40a7fe0 0x7f81f4156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.609+0000 7f81fc5ff700 1 --2- 172.21.15.72:0/1123033198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f40ca510 0x7f81f40c3fc0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:04.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.609+0000 7f81fc5ff700 1 -- 172.21.15.72:0/1123033198 >> 172.21.15.72:0/1123033198 conn(0x7f81f406a560 msgr2=0x7f81f4153750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:04.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.609+0000 7f81fc5ff700 1 -- 172.21.15.72:0/1123033198 shutdown_connections 2023-08-31T19:08:04.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:04.609+0000 7f81fc5ff700 1 -- 172.21.15.72:0/1123033198 wait complete. 2023-08-31T19:08:04.624 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-31T19:08:04.624 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:08:04.624 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-31T19:08:04.625 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T19:08:04.625 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T19:08:04.626 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-31T19:08:04.626 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-31T19:08:04.626 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:08:04.627 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:08:04.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:08:04.628 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-31T19:08:04.675 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:08:04.676 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:08:04.676 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:08:04.676 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:08:04.676 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-31T19:08:04.677 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:08:04.677 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:08:04.678 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:08:04.678 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-31T19:08:04.678 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:08:04.679 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:08:04.679 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-31T19:08:04.679 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:08:04.679 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:08:04.679 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:08:04.680 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:08:04.680 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:08:04.680 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 36792sec preferred_lft 36792sec 2023-08-31T19:08:04.680 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-31T19:08:04.680 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:08:04.681 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:08:04.681 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff 2023-08-31T19:08:04.681 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T19:08:04.681 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:08:04.681 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::7c68:c9ff:fe82:9771/64 scope link 2023-08-31T19:08:04.682 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:08:04.682 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:08:04.682 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e2:e1:71:f6:f6:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T19:08:04.682 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e0e1:71ff:fef6:f6fa/64 scope link 2023-08-31T19:08:04.682 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:08:04.683 INFO:teuthology.orchestra.run.smithi072.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:08:04.683 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T19:08:04.683 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::38f6:6ff:fe3c:1ef/64 scope link 2023-08-31T19:08:04.683 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:08:04.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:08:04.684 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:08:04.752 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-31T19:08:04.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:08:04.755 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-31T19:08:04.804 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-31T19:08:04.804 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:08:04.804 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:08:04.805 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:08:04.805 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:08:04.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:08:04.806 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T19:08:04.807 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T19:08:04.807 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:08:04.807 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:08:04.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:08:04.808 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T19:08:04.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:08:04.979 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T19:08:05.027 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T19:08:05.027 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T19:08:05.028 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:08:05.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:08:05.029 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-08-31T19:08:05.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:08:05.140 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-31T19:08:05.187 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-31T19:08:05.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:08:05.325 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:08:05.325 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:08:05.351 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:08:05.351 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:08:05.356 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-31T19:08:05.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:08:05.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T19:08:05.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-31T19:08:05.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.627+0000 7f31ea9ff700 1 Processor -- start 2023-08-31T19:08:05.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.627+0000 7f31ea9ff700 1 -- start start 2023-08-31T19:08:05.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.628+0000 7f31ea9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31e41508b0 0x7f31e40bc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.628+0000 7f31ea9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f31e40c2460 0x7f31e4069090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.628+0000 7f31ea9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e40bcbc0 con 0x7f31e40bc760 2023-08-31T19:08:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.628+0000 7f31ea9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e4151340 con 0x7f31e41508b0 2023-08-31T19:08:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.628+0000 7f31ea9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e40c29d0 con 0x7f31e40c2460 2023-08-31T19:08:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.628+0000 7f31e3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31e41508b0 0x7f31e40bc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.629+0000 7f31e3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31e41508b0 0x7f31e40bc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43260/0 (socket says 172.21.15.72:43260) 2023-08-31T19:08:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.629+0000 7f31e3fff700 1 -- 172.21.15.72:0/3094506249 learned_addr learned my addr 172.21.15.72:0/3094506249 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.629+0000 7f31e8f9c700 1 --2- 172.21.15.72:0/3094506249 >> v2:172.21.15.146:3300/0 conn(0x7f31e40c2460 0x7f31e4069090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.629+0000 7f31e3fff700 1 -- 172.21.15.72:0/3094506249 >> v2:172.21.15.146:3300/0 conn(0x7f31e40c2460 msgr2=0x7f31e4069090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.629+0000 7f31e3fff700 1 --2- 172.21.15.72:0/3094506249 >> v2:172.21.15.146:3300/0 conn(0x7f31e40c2460 0x7f31e4069090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.629+0000 7f31e3fff700 1 -- 172.21.15.72:0/3094506249 >> v1:172.21.15.146:6789/0 conn(0x7f31e40bc760 legacy=0x7f31e40c1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.629+0000 7f31e3fff700 1 -- 172.21.15.72:0/3094506249 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e40c2cb0 con 0x7f31e41508b0 2023-08-31T19:08:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.629+0000 7f31e3fff700 1 --2- 172.21.15.72:0/3094506249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e41508b0 0x7f31e40bc270 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f31e406a6c0 tx=0x7f31d40090f0).ready entity=mon.0 client_cookie=5eaaafe13558a363 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.629+0000 7f31e2ffd700 1 -- 172.21.15.72:0/3094506249 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400b5a0 con 0x7f31e41508b0 2023-08-31T19:08:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.629+0000 7f31e2ffd700 1 -- 172.21.15.72:0/3094506249 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d400b700 con 0x7f31e41508b0 2023-08-31T19:08:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.629+0000 7f31e2ffd700 1 -- 172.21.15.72:0/3094506249 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400ba80 con 0x7f31e41508b0 2023-08-31T19:08:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.630+0000 7f31ea9ff700 1 -- 172.21.15.72:0/3094506249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e41508b0 msgr2=0x7f31e40bc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.630+0000 7f31ea9ff700 1 --2- 172.21.15.72:0/3094506249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e41508b0 0x7f31e40bc270 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f31e406a6c0 tx=0x7f31d40090f0).stop 2023-08-31T19:08:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.630+0000 7f31ea9ff700 1 -- 172.21.15.72:0/3094506249 shutdown_connections 2023-08-31T19:08:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.630+0000 7f31ea9ff700 1 --2- 172.21.15.72:0/3094506249 >> v2:172.21.15.146:3300/0 conn(0x7f31e40c2460 0x7f31e4069090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.630+0000 7f31ea9ff700 1 --2- 172.21.15.72:0/3094506249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e41508b0 0x7f31e40bc270 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.630+0000 7f31ea9ff700 1 -- 172.21.15.72:0/3094506249 >> 172.21.15.72:0/3094506249 conn(0x7f31e4063120 msgr2=0x7f31e40c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.630+0000 7f31ea9ff700 1 -- 172.21.15.72:0/3094506249 shutdown_connections 2023-08-31T19:08:05.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.630+0000 7f31ea9ff700 1 -- 172.21.15.72:0/3094506249 wait complete. 2023-08-31T19:08:05.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.632+0000 7f31ea9ff700 1 Processor -- start 2023-08-31T19:08:05.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.632+0000 7f31ea9ff700 1 -- start start 2023-08-31T19:08:05.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31ea9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31e40bc760 0x7f31e4153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:05.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31ea9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31e40c2460 0x7f31e41645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:05.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31ea9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e41508b0 0x7f31e414f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:05.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31ea9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e40a6820 con 0x7f31e41508b0 2023-08-31T19:08:05.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31ea9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e4065310 con 0x7f31e40c2460 2023-08-31T19:08:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31ea9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e4153500 con 0x7f31e40bc760 2023-08-31T19:08:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31e8f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e41508b0 0x7f31e414f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31e8f9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e41508b0 0x7f31e414f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43276/0 (socket says 172.21.15.72:43276) 2023-08-31T19:08:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31e8f9c700 1 -- 172.21.15.72:0/2096177872 learned_addr learned my addr 172.21.15.72:0/2096177872 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:05.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31e3fff700 1 --2- 172.21.15.72:0/2096177872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31e40bc760 0x7f31e4153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:05.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31e37fe700 1 --2- 172.21.15.72:0/2096177872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31e40c2460 0x7f31e41645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:05.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31e8f9c700 1 -- 172.21.15.72:0/2096177872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31e40bc760 msgr2=0x7f31e4153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:05.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31e8f9c700 1 --2- 172.21.15.72:0/2096177872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31e40bc760 0x7f31e4153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:05.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31e8f9c700 1 -- 172.21.15.72:0/2096177872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31e40c2460 msgr2=0x7f31e41645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:05.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31e8f9c700 1 --2- 172.21.15.72:0/2096177872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31e40c2460 0x7f31e41645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:05.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.633+0000 7f31e8f9c700 1 -- 172.21.15.72:0/2096177872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d4009370 con 0x7f31e41508b0 2023-08-31T19:08:05.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.634+0000 7f31e8f9c700 1 --2- 172.21.15.72:0/2096177872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e41508b0 0x7f31e414f690 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f31dc009fa0 tx=0x7f31dc009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:05.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.634+0000 7f31cbfff700 1 -- 172.21.15.72:0/2096177872 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc00ed20 con 0x7f31e41508b0 2023-08-31T19:08:05.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.634+0000 7f31cbfff700 1 -- 172.21.15.72:0/2096177872 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31dc00ee80 con 0x7f31e41508b0 2023-08-31T19:08:05.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.634+0000 7f31cbfff700 1 -- 172.21.15.72:0/2096177872 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc014610 con 0x7f31e41508b0 2023-08-31T19:08:05.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.634+0000 7f31ea9ff700 1 -- 172.21.15.72:0/2096177872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e4164a90 con 0x7f31e41508b0 2023-08-31T19:08:05.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.634+0000 7f31ea9ff700 1 -- 172.21.15.72:0/2096177872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e4165030 con 0x7f31e41508b0 2023-08-31T19:08:05.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.635+0000 7f31ea9ff700 1 -- 172.21.15.72:0/2096177872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e406c6b0 con 0x7f31e41508b0 2023-08-31T19:08:05.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.636+0000 7f31cbfff700 1 -- 172.21.15.72:0/2096177872 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f31dc01d3b0 con 0x7f31e41508b0 2023-08-31T19:08:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.637+0000 7f31cbfff700 1 --2- 172.21.15.72:0/2096177872 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f31d005ef30 0x7f31d00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.637+0000 7f31cbfff700 1 -- 172.21.15.72:0/2096177872 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f31dc07a900 con 0x7f31e41508b0 2023-08-31T19:08:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.637+0000 7f31e3fff700 1 --2- 172.21.15.72:0/2096177872 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f31d005ef30 0x7f31d00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.638+0000 7f31e3fff700 1 --2- 172.21.15.72:0/2096177872 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f31d005ef30 0x7f31d00613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f31d4009130 tx=0x7f31d4015000).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.641+0000 7f31cbfff700 1 -- 172.21.15.72:0/2096177872 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31dc04b860 con 0x7f31e41508b0 2023-08-31T19:08:05.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.837+0000 7f31ea9ff700 1 -- 172.21.15.72:0/2096177872 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f31e40a6610 con 0x7f31d005ef30 2023-08-31T19:08:05.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.838+0000 7f31cbfff700 1 -- 172.21.15.72:0/2096177872 <== mgr.8313 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f31d4000c90 con 0x7f31d005ef30 2023-08-31T19:08:05.838 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:08:05.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:08:05.839 INFO:teuthology.orchestra.run.smithi072.stdout: "name": "cephfs" 2023-08-31T19:08:05.839 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:08:05.839 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:08:05.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.840+0000 7f31ea9ff700 1 -- 172.21.15.72:0/2096177872 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f31d005ef30 msgr2=0x7f31d00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:05.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.840+0000 7f31ea9ff700 1 --2- 172.21.15.72:0/2096177872 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f31d005ef30 0x7f31d00613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f31d4009130 tx=0x7f31d4015000).stop 2023-08-31T19:08:05.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.840+0000 7f31ea9ff700 1 -- 172.21.15.72:0/2096177872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e41508b0 msgr2=0x7f31e414f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:05.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.840+0000 7f31ea9ff700 1 --2- 172.21.15.72:0/2096177872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e41508b0 0x7f31e414f690 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f31dc009fa0 tx=0x7f31dc009900).stop 2023-08-31T19:08:05.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.840+0000 7f31ea9ff700 1 -- 172.21.15.72:0/2096177872 shutdown_connections 2023-08-31T19:08:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.840+0000 7f31ea9ff700 1 --2- 172.21.15.72:0/2096177872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31e41508b0 0x7f31e414f690 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.840+0000 7f31ea9ff700 1 --2- 172.21.15.72:0/2096177872 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31e40bc760 0x7f31e4153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.840+0000 7f31ea9ff700 1 --2- 172.21.15.72:0/2096177872 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f31d005ef30 0x7f31d00613f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.840+0000 7f31ea9ff700 1 --2- 172.21.15.72:0/2096177872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31e40c2460 0x7f31e41645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.840+0000 7f31ea9ff700 1 -- 172.21.15.72:0/2096177872 >> 172.21.15.72:0/2096177872 conn(0x7f31e4063120 msgr2=0x7f31e40bbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:05.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.840+0000 7f31ea9ff700 1 -- 172.21.15.72:0/2096177872 shutdown_connections 2023-08-31T19:08:05.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:05.840+0000 7f31ea9ff700 1 -- 172.21.15.72:0/2096177872 wait complete. 2023-08-31T19:08:05.857 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-31T19:08:06.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.052+0000 7fc750dff700 1 Processor -- start 2023-08-31T19:08:06.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.052+0000 7fc750dff700 1 -- start start 2023-08-31T19:08:06.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.053+0000 7fc750dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc74c153e30 0x7fc74c154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:06.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.053+0000 7fc750dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc74c0c5cb0 0x7fc74c0c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:06.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.053+0000 7fc750dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74c0bfd40 con 0x7fc74c0630b0 2023-08-31T19:08:06.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.053+0000 7fc750dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74c0c6730 con 0x7fc74c153e30 2023-08-31T19:08:06.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.053+0000 7fc750dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0bffe0 con 0x7fc74c0c5cb0 2023-08-31T19:08:06.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.053+0000 7fc74a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc74c153e30 0x7fc74c154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:06.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.053+0000 7fc74a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc74c153e30 0x7fc74c154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43288/0 (socket says 172.21.15.72:43288) 2023-08-31T19:08:06.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.053+0000 7fc74a59c700 1 -- 172.21.15.72:0/843748174 learned_addr learned my addr 172.21.15.72:0/843748174 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:06.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.054+0000 7fc749d9b700 1 --2- 172.21.15.72:0/843748174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc74c0c5cb0 0x7fc74c0c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:06.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.054+0000 7fc74a59c700 1 -- 172.21.15.72:0/843748174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc74c0c5cb0 msgr2=0x7fc74c0c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:06.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.054+0000 7fc74a59c700 1 --2- 172.21.15.72:0/843748174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc74c0c5cb0 0x7fc74c0c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:06.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.054+0000 7fc74a59c700 1 -- 172.21.15.72:0/843748174 >> v1:172.21.15.146:6789/0 conn(0x7fc74c0630b0 legacy=0x7fc74c157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:06.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.054+0000 7fc74a59c700 1 -- 172.21.15.72:0/843748174 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c0c02c0 con 0x7fc74c153e30 2023-08-31T19:08:06.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.054+0000 7fc749d9b700 1 --2- 172.21.15.72:0/843748174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc74c0c5cb0 0x7fc74c0c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:08:06.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.054+0000 7fc74a59c700 1 --2- 172.21.15.72:0/843748174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74c153e30 0x7fc74c154210 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7fc73c006fd0 tx=0x7fc73c0090f0).ready entity=mon.0 client_cookie=29b67b71efebb30a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:06.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.054+0000 7fc74959a700 1 -- 172.21.15.72:0/843748174 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00b600 con 0x7fc74c153e30 2023-08-31T19:08:06.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.054+0000 7fc74959a700 1 -- 172.21.15.72:0/843748174 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c00b760 con 0x7fc74c153e30 2023-08-31T19:08:06.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.054+0000 7fc74959a700 1 -- 172.21.15.72:0/843748174 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00bb00 con 0x7fc74c153e30 2023-08-31T19:08:06.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.055+0000 7fc750dff700 1 -- 172.21.15.72:0/843748174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74c153e30 msgr2=0x7fc74c154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:06.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.055+0000 7fc750dff700 1 --2- 172.21.15.72:0/843748174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74c153e30 0x7fc74c154210 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7fc73c006fd0 tx=0x7fc73c0090f0).stop 2023-08-31T19:08:06.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.055+0000 7fc750dff700 1 -- 172.21.15.72:0/843748174 shutdown_connections 2023-08-31T19:08:06.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.055+0000 7fc750dff700 1 --2- 172.21.15.72:0/843748174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74c153e30 0x7fc74c154210 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:06.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.055+0000 7fc750dff700 1 --2- 172.21.15.72:0/843748174 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc74c0c5cb0 0x7fc74c0c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:06.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.055+0000 7fc750dff700 1 -- 172.21.15.72:0/843748174 >> 172.21.15.72:0/843748174 conn(0x7fc74c05eb20 msgr2=0x7fc74c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:06.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.055+0000 7fc750dff700 1 -- 172.21.15.72:0/843748174 shutdown_connections 2023-08-31T19:08:06.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.055+0000 7fc750dff700 1 -- 172.21.15.72:0/843748174 wait complete. 2023-08-31T19:08:06.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.056+0000 7fc750dff700 1 Processor -- start 2023-08-31T19:08:06.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.057+0000 7fc750dff700 1 -- start start 2023-08-31T19:08:06.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc750dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74c0630b0 0x7fc74c0c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:06.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc750dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc74c0c5cb0 0x7fc74c1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:06.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc750dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc74c153e30 0x7fc74c15a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:06.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc750dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0c2d40 con 0x7fc74c0630b0 2023-08-31T19:08:06.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc750dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c1535d0 con 0x7fc74c0c5cb0 2023-08-31T19:08:06.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc750dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0c37c0 con 0x7fc74c153e30 2023-08-31T19:08:06.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc74a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74c0630b0 0x7fc74c0c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:06.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc74a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74c0630b0 0x7fc74c0c2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43304/0 (socket says 172.21.15.72:43304) 2023-08-31T19:08:06.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc74a59c700 1 -- 172.21.15.72:0/238661973 learned_addr learned my addr 172.21.15.72:0/238661973 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:06.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc749d9b700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc74c0c5cb0 0x7fc74c1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc74ad9d700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc74c153e30 0x7fc74c15a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc74a59c700 1 -- 172.21.15.72:0/238661973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc74c153e30 msgr2=0x7fc74c15a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc74a59c700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc74c153e30 0x7fc74c15a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc74a59c700 1 -- 172.21.15.72:0/238661973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc74c0c5cb0 msgr2=0x7fc74c1530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:06.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc74a59c700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc74c0c5cb0 0x7fc74c1530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:06.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc74a59c700 1 -- 172.21.15.72:0/238661973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c009370 con 0x7fc74c0630b0 2023-08-31T19:08:06.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc749d9b700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc74c0c5cb0 0x7fc74c1530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:08:06.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc74ad9d700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc74c153e30 0x7fc74c15a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:08:06.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.058+0000 7fc74a59c700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74c0630b0 0x7fc74c0c2850 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7fc73c009f50 tx=0x7fc73c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:06.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.059+0000 7fc73a7fc700 1 -- 172.21.15.72:0/238661973 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0069b0 con 0x7fc74c0630b0 2023-08-31T19:08:06.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.059+0000 7fc73a7fc700 1 -- 172.21.15.72:0/238661973 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c00b8d0 con 0x7fc74c0630b0 2023-08-31T19:08:06.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.059+0000 7fc73a7fc700 1 -- 172.21.15.72:0/238661973 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00ba40 con 0x7fc74c0630b0 2023-08-31T19:08:06.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.059+0000 7fc750dff700 1 -- 172.21.15.72:0/238661973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74c142230 con 0x7fc74c0630b0 2023-08-31T19:08:06.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.059+0000 7fc750dff700 1 -- 172.21.15.72:0/238661973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74c0c3200 con 0x7fc74c0630b0 2023-08-31T19:08:06.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.060+0000 7fc750dff700 1 -- 172.21.15.72:0/238661973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74c06c6b0 con 0x7fc74c0630b0 2023-08-31T19:08:06.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.060+0000 7fc73a7fc700 1 -- 172.21.15.72:0/238661973 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 64) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fc73c022020 con 0x7fc74c0630b0 2023-08-31T19:08:06.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.061+0000 7fc73a7fc700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc72c05ef30 0x7fc72c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:06.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.061+0000 7fc73a7fc700 1 -- 172.21.15.72:0/238661973 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fc73c07bfa0 con 0x7fc74c0630b0 2023-08-31T19:08:06.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.062+0000 7fc749d9b700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc72c05ef30 0x7fc72c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:06.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.062+0000 7fc749d9b700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc72c05ef30 0x7fc72c0613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc74c145200 tx=0x7fc740008040).ready entity=mgr.8313 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:06.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.066+0000 7fc73a7fc700 1 -- 172.21.15.72:0/238661973 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc73c04cf60 con 0x7fc74c0630b0 2023-08-31T19:08:06.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.277+0000 7fc750dff700 1 -- 172.21.15.72:0/238661973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fc74c064000 con 0x7fc74c0630b0 2023-08-31T19:08:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.909+0000 7fc73a7fc700 1 -- 172.21.15.72:0/238661973 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 65) v1 ==== 75391+0+0 (secure 0 0 0) 0x7fc73c07d070 con 0x7fc74c0630b0 2023-08-31T19:08:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.911+0000 7fc73a7fc700 1 -- 172.21.15.72:0/238661973 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v65) v1 ==== 92+0+0 (secure 0 0 0) 0x7fc73c042a90 con 0x7fc74c0630b0 2023-08-31T19:08:06.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.914+0000 7fc750dff700 1 -- 172.21.15.72:0/238661973 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc72c05ef30 msgr2=0x7fc72c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.914+0000 7fc750dff700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc72c05ef30 0x7fc72c0613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc74c145200 tx=0x7fc740008040).stop 2023-08-31T19:08:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.914+0000 7fc750dff700 1 -- 172.21.15.72:0/238661973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74c0630b0 msgr2=0x7fc74c0c2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.914+0000 7fc750dff700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74c0630b0 0x7fc74c0c2850 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7fc73c009f50 tx=0x7fc73c017000).stop 2023-08-31T19:08:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.914+0000 7fc750dff700 1 -- 172.21.15.72:0/238661973 shutdown_connections 2023-08-31T19:08:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.914+0000 7fc750dff700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc74c153e30 0x7fc74c15a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.914+0000 7fc750dff700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74c0630b0 0x7fc74c0c2850 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.914+0000 7fc750dff700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fc72c05ef30 0x7fc72c0613f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.914+0000 7fc750dff700 1 --2- 172.21.15.72:0/238661973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc74c0c5cb0 0x7fc74c1530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.914+0000 7fc750dff700 1 -- 172.21.15.72:0/238661973 >> 172.21.15.72:0/238661973 conn(0x7fc74c05eb20 msgr2=0x7fc74c0ac990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.914+0000 7fc750dff700 1 -- 172.21.15.72:0/238661973 shutdown_connections 2023-08-31T19:08:06.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:06.914+0000 7fc750dff700 1 -- 172.21.15.72:0/238661973 wait complete. 2023-08-31T19:08:06.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-31T19:08:07.123 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:07.123+0000 7fe31f34d680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:08:07.132 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:07.132+0000 7ff5f5b15680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:08:07.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.135+0000 7fcbb55ff700 1 Processor -- start 2023-08-31T19:08:07.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.135+0000 7fcbb55ff700 1 -- start start 2023-08-31T19:08:07.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.136+0000 7fcbb55ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbb01520e0 0x7fcbb00a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:07.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.136+0000 7fcbb55ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcbb00a9440 0x7fcbb0068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:07.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.136+0000 7fcbb55ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb0064340 con 0x7fcbb01524c0 2023-08-31T19:08:07.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.136+0000 7fcbb55ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb00bcd00 con 0x7fcbb00a9440 2023-08-31T19:08:07.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.136+0000 7fcbb55ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb00bcfe0 con 0x7fcbb01520e0 2023-08-31T19:08:07.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.137+0000 7fcbaf7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcbb01524c0 0x7fcbb0155e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54490/0 (socket says 172.21.15.72:54490) 2023-08-31T19:08:07.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.137+0000 7fcbaf7fe700 1 -- 172.21.15.72:0/394610469 learned_addr learned my addr 172.21.15.72:0/394610469 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:08:07.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.137+0000 7fcbae7fc700 1 --2- 172.21.15.72:0/394610469 >> v2:172.21.15.146:3300/0 conn(0x7fcbb00a9440 0x7fcbb0068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:07.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.137+0000 7fcbaeffd700 1 --2- 172.21.15.72:0/394610469 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbb01520e0 0x7fcbb00a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:07.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.137+0000 7fcbaeffd700 1 -- 172.21.15.72:0/394610469 >> v2:172.21.15.146:3300/0 conn(0x7fcbb00a9440 msgr2=0x7fcbb0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:07.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.137+0000 7fcbaeffd700 1 --2- 172.21.15.72:0/394610469 >> v2:172.21.15.146:3300/0 conn(0x7fcbb00a9440 0x7fcbb0068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:07.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.137+0000 7fcbadffb700 1 -- 172.21.15.72:0/394610469 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494230213 0 0) 0x7fcbb0064340 con 0x7fcbb01524c0 2023-08-31T19:08:07.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.137+0000 7fcbaeffd700 1 -- 172.21.15.72:0/394610469 >> v1:172.21.15.72:6789/0 conn(0x7fcbb01524c0 legacy=0x7fcbb0155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:07.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.137+0000 7fcbaeffd700 1 -- 172.21.15.72:0/394610469 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb00bd2c0 con 0x7fcbb01520e0 2023-08-31T19:08:07.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.137+0000 7fcbaeffd700 1 --2- 172.21.15.72:0/394610469 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbb01520e0 0x7fcbb00a8f50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fcba0009760 tx=0x7fcba0009060).ready entity=mon.2 client_cookie=cce8f1fe6f2e91be server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:07.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.138+0000 7fcbadffb700 1 -- 172.21.15.72:0/394610469 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba000f510 con 0x7fcbb01520e0 2023-08-31T19:08:07.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.138+0000 7fcbadffb700 1 -- 172.21.15.72:0/394610469 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba000f670 con 0x7fcbb01520e0 2023-08-31T19:08:07.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.138+0000 7fcbadffb700 1 -- 172.21.15.72:0/394610469 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba000f9f0 con 0x7fcbb01520e0 2023-08-31T19:08:07.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.138+0000 7fcbb55ff700 1 -- 172.21.15.72:0/394610469 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbb01520e0 msgr2=0x7fcbb00a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:07.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.138+0000 7fcbb55ff700 1 --2- 172.21.15.72:0/394610469 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbb01520e0 0x7fcbb00a8f50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fcba0009760 tx=0x7fcba0009060).stop 2023-08-31T19:08:07.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.138+0000 7fcbb55ff700 1 -- 172.21.15.72:0/394610469 shutdown_connections 2023-08-31T19:08:07.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.138+0000 7fcbb55ff700 1 --2- 172.21.15.72:0/394610469 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbb01520e0 0x7fcbb00a8f50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:07.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.138+0000 7fcbb55ff700 1 --2- 172.21.15.72:0/394610469 >> v2:172.21.15.146:3300/0 conn(0x7fcbb00a9440 0x7fcbb0068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:07.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.138+0000 7fcbb55ff700 1 -- 172.21.15.72:0/394610469 >> 172.21.15.72:0/394610469 conn(0x7fcbb00630c0 msgr2=0x7fcbb00c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:07.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.138+0000 7fcbb55ff700 1 -- 172.21.15.72:0/394610469 shutdown_connections 2023-08-31T19:08:07.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.138+0000 7fcbb55ff700 1 -- 172.21.15.72:0/394610469 wait complete. 2023-08-31T19:08:07.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.140+0000 7fcbb55ff700 1 Processor -- start 2023-08-31T19:08:07.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.140+0000 7fcbb55ff700 1 -- start start 2023-08-31T19:08:07.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.141+0000 7fcbb55ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbb00a9440 0x7fcbb014db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:07.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.141+0000 7fcbb55ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb01520e0 0x7fcbb0152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:07.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.141+0000 7fcbb55ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbb01524c0 0x7fcbb0152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:07.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.141+0000 7fcbb55ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb0153300 con 0x7fcbb01524c0 2023-08-31T19:08:07.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.141+0000 7fcbb55ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb01537e0 con 0x7fcbb01520e0 2023-08-31T19:08:07.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.141+0000 7fcbb55ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb0154570 con 0x7fcbb00a9440 2023-08-31T19:08:07.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.141+0000 7fcbaf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbb01524c0 0x7fcbb0152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:07.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.141+0000 7fcbaf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbb01524c0 0x7fcbb0152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43316/0 (socket says 172.21.15.72:43316) 2023-08-31T19:08:07.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.141+0000 7fcbaf7fe700 1 -- 172.21.15.72:0/4218321726 learned_addr learned my addr 172.21.15.72:0/4218321726 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:07.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.141+0000 7fcbae7fc700 1 --2- 172.21.15.72:0/4218321726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb01520e0 0x7fcbb0152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:07.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.141+0000 7fcbaeffd700 1 --2- 172.21.15.72:0/4218321726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbb00a9440 0x7fcbb014db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:07.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.142+0000 7fcbaf7fe700 1 -- 172.21.15.72:0/4218321726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbb00a9440 msgr2=0x7fcbb014db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:07.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.142+0000 7fcbaf7fe700 1 --2- 172.21.15.72:0/4218321726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbb00a9440 0x7fcbb014db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:07.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.142+0000 7fcbaf7fe700 1 -- 172.21.15.72:0/4218321726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb01520e0 msgr2=0x7fcbb0152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:07.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.142+0000 7fcbaf7fe700 1 --2- 172.21.15.72:0/4218321726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb01520e0 0x7fcbb0152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:07.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.142+0000 7fcbaf7fe700 1 -- 172.21.15.72:0/4218321726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba00092a0 con 0x7fcbb01524c0 2023-08-31T19:08:07.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.142+0000 7fcbaeffd700 1 --2- 172.21.15.72:0/4218321726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbb00a9440 0x7fcbb014db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:08:07.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.142+0000 7fcbaf7fe700 1 --2- 172.21.15.72:0/4218321726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbb01524c0 0x7fcbb0152e10 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7fcba800c730 tx=0x7fcba8001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:07.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.142+0000 7fcb96ffd700 1 -- 172.21.15.72:0/4218321726 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba8005d30 con 0x7fcbb01524c0 2023-08-31T19:08:07.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.142+0000 7fcb96ffd700 1 -- 172.21.15.72:0/4218321726 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba8005e90 con 0x7fcbb01524c0 2023-08-31T19:08:07.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.142+0000 7fcb96ffd700 1 -- 172.21.15.72:0/4218321726 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba8007320 con 0x7fcbb01524c0 2023-08-31T19:08:07.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.142+0000 7fcbb55ff700 1 -- 172.21.15.72:0/4218321726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb0153500 con 0x7fcbb01524c0 2023-08-31T19:08:07.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.142+0000 7fcbb55ff700 1 -- 172.21.15.72:0/4218321726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb00a9e10 con 0x7fcbb01524c0 2023-08-31T19:08:07.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.144+0000 7fcbb55ff700 1 -- 172.21.15.72:0/4218321726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb006c6b0 con 0x7fcbb01524c0 2023-08-31T19:08:07.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.144+0000 7fcb96ffd700 1 -- 172.21.15.72:0/4218321726 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 65) v1 ==== 75391+0+0 (secure 0 0 0) 0x7fcba80076d0 con 0x7fcbb01524c0 2023-08-31T19:08:07.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.145+0000 7fcb96ffd700 1 --2- 172.21.15.72:0/4218321726 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb9c05efb0 0x7fcb9c061470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:07.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.146+0000 7fcbaeffd700 1 -- 172.21.15.72:0/4218321726 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb9c05efb0 msgr2=0x7fcb9c061470 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:08:07.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.146+0000 7fcb96ffd700 1 -- 172.21.15.72:0/4218321726 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fcba807a1f0 con 0x7fcbb01524c0 2023-08-31T19:08:07.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.146+0000 7fcbaeffd700 1 --2- 172.21.15.72:0/4218321726 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb9c05efb0 0x7fcb9c061470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:08:07.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.150+0000 7fcb96ffd700 1 -- 172.21.15.72:0/4218321726 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcba804b270 con 0x7fcbb01524c0 2023-08-31T19:08:07.202 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:07.202+0000 7fe31f34d680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:08:07.214 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:07.214+0000 7ff5f5b15680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:08:07.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.327+0000 7fcbb55ff700 1 -- 172.21.15.72:0/4218321726 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fcbb00bd5a0 con 0x7fcbb01524c0 2023-08-31T19:08:07.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.331+0000 7fcb96ffd700 1 -- 172.21.15.72:0/4218321726 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcba804e890 con 0x7fcbb01524c0 2023-08-31T19:08:07.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.334+0000 7fcbb55ff700 1 -- 172.21.15.72:0/4218321726 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb9c05efb0 msgr2=0x7fcb9c061470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:08:07.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.334+0000 7fcbb55ff700 1 --2- 172.21.15.72:0/4218321726 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb9c05efb0 0x7fcb9c061470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:08:07.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.334+0000 7fcbb55ff700 1 -- 172.21.15.72:0/4218321726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbb01524c0 msgr2=0x7fcbb0152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:07.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.334+0000 7fcbb55ff700 1 --2- 172.21.15.72:0/4218321726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbb01524c0 0x7fcbb0152e10 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7fcba800c730 tx=0x7fcba8001520).stop 2023-08-31T19:08:07.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.334+0000 7fcbb55ff700 1 -- 172.21.15.72:0/4218321726 shutdown_connections 2023-08-31T19:08:07.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.334+0000 7fcbb55ff700 1 --2- 172.21.15.72:0/4218321726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbb01524c0 0x7fcbb0152e10 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:07.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.334+0000 7fcbb55ff700 1 --2- 172.21.15.72:0/4218321726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcbb00a9440 0x7fcbb014db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:07.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.334+0000 7fcbb55ff700 1 --2- 172.21.15.72:0/4218321726 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fcb9c05efb0 0x7fcb9c061470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:08:07.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.334+0000 7fcbb55ff700 1 --2- 172.21.15.72:0/4218321726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb01520e0 0x7fcbb0152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:07.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.334+0000 7fcbb55ff700 1 -- 172.21.15.72:0/4218321726 >> 172.21.15.72:0/4218321726 conn(0x7fcbb00630c0 msgr2=0x7fcbb00c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:07.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.334+0000 7fcbb55ff700 1 -- 172.21.15.72:0/4218321726 shutdown_connections 2023-08-31T19:08:07.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.334+0000 7fcbb55ff700 1 -- 172.21.15.72:0/4218321726 wait complete. 2023-08-31T19:08:07.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:08:07.353 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-31T19:08:07.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:08:07.415 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-08-31T19:08:07.473 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-31T19:08:07.530 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:07.530+0000 7fe31f34d680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:08:07.570 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:07.570+0000 7ff5f5b15680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:08:07.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.672+0000 7f47e2bff700 1 Processor -- start 2023-08-31T19:08:07.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.672+0000 7f47e2bff700 1 -- start start 2023-08-31T19:08:07.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.674+0000 7f47e2bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47dc153220 0x7f47dc1537e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:07.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.674+0000 7f47e2bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47dc0c3410 0x7f47dc0c3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:07.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.674+0000 7f47e2bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47dc065b60 con 0x7f47dc155630 2023-08-31T19:08:07.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.674+0000 7f47e2bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47dc155a10 con 0x7f47dc153220 2023-08-31T19:08:07.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.674+0000 7f47e2bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc0bc0b0 con 0x7f47dc0c3410 2023-08-31T19:08:07.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.674+0000 7f47dbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47dc153220 0x7f47dc1537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:07.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.674+0000 7f47dbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47dc153220 0x7f47dc1537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43318/0 (socket says 172.21.15.72:43318) 2023-08-31T19:08:07.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.674+0000 7f47dbfff700 1 -- 172.21.15.72:0/2957872753 learned_addr learned my addr 172.21.15.72:0/2957872753 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:07.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.674+0000 7f47e119c700 1 --2- 172.21.15.72:0/2957872753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47dc0c3410 0x7f47dc0c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:07.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.675+0000 7f47dbfff700 1 -- 172.21.15.72:0/2957872753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47dc0c3410 msgr2=0x7f47dc0c3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:07.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.675+0000 7f47dbfff700 1 --2- 172.21.15.72:0/2957872753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47dc0c3410 0x7f47dc0c3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:07.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.675+0000 7f47dbfff700 1 -- 172.21.15.72:0/2957872753 >> v1:172.21.15.72:6789/0 conn(0x7f47dc155630 legacy=0x7f47dc0bb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:07.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.675+0000 7f47dbfff700 1 -- 172.21.15.72:0/2957872753 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc0c1880 con 0x7f47dc153220 2023-08-31T19:08:07.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.675+0000 7f47e119c700 1 --2- 172.21.15.72:0/2957872753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47dc0c3410 0x7f47dc0c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:08:07.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.675+0000 7f47dbfff700 1 --2- 172.21.15.72:0/2957872753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47dc153220 0x7f47dc1537e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f47c8006fd0 tx=0x7f47c80090f0).ready entity=mon.0 client_cookie=f557d5de5dd87b9d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:07.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.675+0000 7f47db7fe700 1 -- 172.21.15.72:0/2957872753 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c800b600 con 0x7f47dc153220 2023-08-31T19:08:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.675+0000 7f47db7fe700 1 -- 172.21.15.72:0/2957872753 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c800b760 con 0x7f47dc153220 2023-08-31T19:08:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.675+0000 7f47db7fe700 1 -- 172.21.15.72:0/2957872753 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c800bae0 con 0x7f47dc153220 2023-08-31T19:08:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.676+0000 7f47e2bff700 1 -- 172.21.15.72:0/2957872753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47dc153220 msgr2=0x7f47dc1537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.676+0000 7f47e2bff700 1 --2- 172.21.15.72:0/2957872753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47dc153220 0x7f47dc1537e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f47c8006fd0 tx=0x7f47c80090f0).stop 2023-08-31T19:08:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.676+0000 7f47e2bff700 1 -- 172.21.15.72:0/2957872753 shutdown_connections 2023-08-31T19:08:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.676+0000 7f47e2bff700 1 --2- 172.21.15.72:0/2957872753 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47dc0c3410 0x7f47dc0c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.676+0000 7f47e2bff700 1 --2- 172.21.15.72:0/2957872753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47dc153220 0x7f47dc1537e0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.676+0000 7f47e2bff700 1 -- 172.21.15.72:0/2957872753 >> 172.21.15.72:0/2957872753 conn(0x7f47dc062650 msgr2=0x7f47dc062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.676+0000 7f47e2bff700 1 -- 172.21.15.72:0/2957872753 shutdown_connections 2023-08-31T19:08:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.676+0000 7f47e2bff700 1 -- 172.21.15.72:0/2957872753 wait complete. 2023-08-31T19:08:07.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.678+0000 7f47e2bff700 1 Processor -- start 2023-08-31T19:08:07.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.678+0000 7f47e2bff700 1 -- start start 2023-08-31T19:08:07.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47e2bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47dc0c3410 0x7f47dc0ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:07.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47e2bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47dc153220 0x7f47dc0c06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:07.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47e2bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47dc155630 0x7f47dc0aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47e2bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc0bf280 con 0x7f47dc155630 2023-08-31T19:08:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47e2bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc0ab6d0 con 0x7f47dc0c3410 2023-08-31T19:08:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47e2bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc0ab400 con 0x7f47dc153220 2023-08-31T19:08:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47e119c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47dc155630 0x7f47dc0aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47e119c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47dc155630 0x7f47dc0aaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43320/0 (socket says 172.21.15.72:43320) 2023-08-31T19:08:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47e119c700 1 -- 172.21.15.72:0/591973137 learned_addr learned my addr 172.21.15.72:0/591973137 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47dbfff700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47dc153220 0x7f47dc0c06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47e099b700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47dc0c3410 0x7f47dc0ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47e119c700 1 -- 172.21.15.72:0/591973137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47dc153220 msgr2=0x7f47dc0c06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47e119c700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47dc153220 0x7f47dc0c06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47e119c700 1 -- 172.21.15.72:0/591973137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47dc0c3410 msgr2=0x7f47dc0ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47e119c700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47dc0c3410 0x7f47dc0ac790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.679+0000 7f47e119c700 1 -- 172.21.15.72:0/591973137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c8009370 con 0x7f47dc155630 2023-08-31T19:08:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.680+0000 7f47e119c700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47dc155630 0x7f47dc0aaf10 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f47d4009fc0 tx=0x7f47d40099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.680+0000 7f47d8ff9700 1 -- 172.21.15.72:0/591973137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d400dbe0 con 0x7f47dc155630 2023-08-31T19:08:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.680+0000 7f47d8ff9700 1 -- 172.21.15.72:0/591973137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d400f040 con 0x7f47dc155630 2023-08-31T19:08:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.680+0000 7f47d8ff9700 1 -- 172.21.15.72:0/591973137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d40133f0 con 0x7f47dc155630 2023-08-31T19:08:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.680+0000 7f47e2bff700 1 -- 172.21.15.72:0/591973137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47dc0ab9d0 con 0x7f47dc155630 2023-08-31T19:08:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.680+0000 7f47e2bff700 1 -- 172.21.15.72:0/591973137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47dc0abf90 con 0x7f47dc155630 2023-08-31T19:08:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.681+0000 7f47e2bff700 1 -- 172.21.15.72:0/591973137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47dc06a760 con 0x7f47dc155630 2023-08-31T19:08:07.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.682+0000 7f47d8ff9700 1 -- 172.21.15.72:0/591973137 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 65) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f47d40137e0 con 0x7f47dc155630 2023-08-31T19:08:07.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.683+0000 7f47d8ff9700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 0x7f47c0061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:07.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.684+0000 7f47d8ff9700 1 -- 172.21.15.72:0/591973137 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f47d407a7b0 con 0x7f47dc155630 2023-08-31T19:08:07.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.684+0000 7f47e099b700 1 -- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 msgr2=0x7f47c0061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:08:07.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.684+0000 7f47e099b700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 0x7f47c0061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:08:07.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.687+0000 7f47d8ff9700 1 -- 172.21.15.72:0/591973137 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f47d404b770 con 0x7f47dc155630 2023-08-31T19:08:07.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.885+0000 7f47e099b700 1 -- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 msgr2=0x7f47c0061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:08:07.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.885+0000 7f47e099b700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 0x7f47c0061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:08:07.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:07.890+0000 7f47e2bff700 1 -- 172.21.15.72:0/591973137 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f47dc05f0a0 con 0x7f47c005ef80 2023-08-31T19:08:08.277 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:08.277+0000 7fe31f34d680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:08:08.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:08.286+0000 7f47e099b700 1 -- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 msgr2=0x7f47c0061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:08:08.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:08.286+0000 7f47e099b700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 0x7f47c0061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-31T19:08:08.320 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:08.320+0000 7ff5f5b15680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:08:08.360 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:08.360+0000 7fe31f34d680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:08:08.403 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:08.403+0000 7ff5f5b15680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:08:08.593 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:08.593+0000 7fe31f34d680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:08:08.632 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:08.631+0000 7ff5f5b15680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:08:09.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:09.087+0000 7f47e099b700 1 -- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 msgr2=0x7f47c0061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:08:09.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:09.087+0000 7f47e099b700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 0x7f47c0061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-31T19:08:09.109 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:09.109+0000 7fe31f34d680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:08:09.141 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:09.140+0000 7ff5f5b15680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:08:09.233 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:09.233+0000 7fe31f34d680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:08:09.265 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:09.264+0000 7ff5f5b15680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:08:09.415 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:09.415+0000 7fe31f34d680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:08:09.447 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:09.447+0000 7ff5f5b15680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:08:09.507 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:09.507+0000 7fe31f34d680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:08:09.540 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:09.540+0000 7ff5f5b15680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:08:09.591 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:09.591+0000 7fe31f34d680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:08:09.625 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:09.624+0000 7ff5f5b15680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:08:09.899 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:09.899+0000 7fe31f34d680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:08:09.934 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:09.934+0000 7ff5f5b15680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:08:10.121 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:10.121+0000 7fe31f34d680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:08:10.156 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:10.156+0000 7ff5f5b15680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:08:10.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:10.689+0000 7f47e099b700 1 -- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 msgr2=0x7f47c0061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/143463 2023-08-31T19:08:10.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:10.689+0000 7f47e099b700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 0x7f47c0061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-31T19:08:10.918 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:10.917+0000 7fe31f34d680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:08:10.955 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:10.955+0000 7ff5f5b15680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:08:11.005 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:11.005+0000 7fe31f34d680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:08:11.042 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:11.042+0000 7ff5f5b15680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:08:11.098 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:11.098+0000 7fe31f34d680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:08:11.136 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:11.135+0000 7ff5f5b15680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:08:11.282 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:11.282+0000 7fe31f34d680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:08:11.318 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:11.318+0000 7ff5f5b15680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:08:11.371 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:11.371+0000 7fe31f34d680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:08:11.407 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:11.407+0000 7ff5f5b15680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:08:11.512 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:11.512+0000 7fe31f34d680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:08:11.546 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:11.546+0000 7ff5f5b15680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:08:11.643 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:11.643+0000 7fe31f34d680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:08:11.675 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:11.675+0000 7ff5f5b15680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:08:11.992 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:11.992+0000 7fe31f34d680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:08:12.018 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:12.018+0000 7ff5f5b15680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:08:12.081 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:08:12.081+0000 7fe31f34d680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:08:12.107 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:12.107+0000 7ff5f5b15680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:08:12.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:12.118+0000 7f47d8ff9700 1 -- 172.21.15.72:0/591973137 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 66) v1 ==== 75113+0+0 (secure 0 0 0) 0x7f47d40780d0 con 0x7f47dc155630 2023-08-31T19:08:12.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:12.118+0000 7f47d8ff9700 1 -- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 msgr2=0x7f47c0061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:08:12.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:12.118+0000 7f47d8ff9700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 0x7f47c0061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:08:12.190 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:12.188+0000 7ff5675bf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:08:12.191 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:12.188+0000 7ff5675bf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:08:12.191 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:12.188+0000 7ff5675bf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:08:12.192 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:12.188+0000 7ff5675bf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:08:12.192 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:12.188+0000 7ff5675bf700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:08:12.192 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:12.188+0000 7ff569dc4700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:08:12.193 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:12.188+0000 7ff569dc4700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:08:12.193 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:12.188+0000 7ff569dc4700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:08:12.193 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:12.188+0000 7ff569dc4700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:08:12.193 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:08:12.188+0000 7ff569dc4700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:08:13.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.120+0000 7f47d8ff9700 1 -- 172.21.15.72:0/591973137 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mgrmap(e 67) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f47d4078450 con 0x7f47dc155630 2023-08-31T19:08:13.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.121+0000 7f47d8ff9700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 0x7f47c00613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:13.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.121+0000 7f47d8ff9700 1 -- 172.21.15.72:0/591973137 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f47dc05f0a0 con 0x7f47c005ef80 2023-08-31T19:08:13.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.122+0000 7f47e099b700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 0x7f47c00613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:13.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.124+0000 7f47e099b700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 0x7f47c00613c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f47d0001120 tx=0x7f47d0007d40).ready entity=mgr.8694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:13.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.133+0000 7f47d8ff9700 1 -- 172.21.15.72:0/591973137 <== mgr.8694 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f47dc05f0a0 con 0x7f47c005ef80 2023-08-31T19:08:13.133 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-08-31T19:08:13.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.135+0000 7f47e2bff700 1 -- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 msgr2=0x7f47c00613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:13.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.135+0000 7f47e2bff700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 0x7f47c00613c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f47d0001120 tx=0x7f47d0007d40).stop 2023-08-31T19:08:13.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.135+0000 7f47e2bff700 1 -- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47dc155630 msgr2=0x7f47dc0aaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:13.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.135+0000 7f47e2bff700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47dc155630 0x7f47dc0aaf10 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f47d4009fc0 tx=0x7f47d40099b0).stop 2023-08-31T19:08:13.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.135+0000 7f47e2bff700 1 -- 172.21.15.72:0/591973137 shutdown_connections 2023-08-31T19:08:13.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.135+0000 7f47e2bff700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47dc155630 0x7f47dc0aaf10 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:13.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.135+0000 7f47e2bff700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f47c005ef80 0x7f47c00613c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:13.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.135+0000 7f47e2bff700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f47dc0c3410 0x7f47dc0ac790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:13.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.135+0000 7f47e2bff700 1 --2- 172.21.15.72:0/591973137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47dc153220 0x7f47dc0c06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:13.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.135+0000 7f47e2bff700 1 -- 172.21.15.72:0/591973137 >> 172.21.15.72:0/591973137 conn(0x7f47dc062650 msgr2=0x7f47dc151700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:13.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.135+0000 7f47e2bff700 1 -- 172.21.15.72:0/591973137 shutdown_connections 2023-08-31T19:08:13.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.136+0000 7f47e2bff700 1 -- 172.21.15.72:0/591973137 wait complete. 2023-08-31T19:08:13.155 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-08-31T19:08:13.155 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-31T19:08:13.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.349+0000 7f908e5ff700 1 Processor -- start 2023-08-31T19:08:13.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.350+0000 7f908e5ff700 1 -- start start 2023-08-31T19:08:13.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.351+0000 7f908e5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9088062650 0x7f9088069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:13.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.351+0000 7f908e5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9088063c20 0x7f9088157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:13.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.351+0000 7f908e5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90880c2260 con 0x7f9088068c20 2023-08-31T19:08:13.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.351+0000 7f908e5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9088062b80 con 0x7f9088062650 2023-08-31T19:08:13.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.351+0000 7f908e5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9088062e60 con 0x7f9088063c20 2023-08-31T19:08:13.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.352+0000 7f90877fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9088062650 0x7f9088069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:13.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.352+0000 7f908cb9c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9088063c20 0x7f9088157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:13.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.352+0000 7f90877fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9088062650 0x7f9088069000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:35578/0 (socket says 172.21.15.72:35578) 2023-08-31T19:08:13.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.352+0000 7f90877fe700 1 -- 172.21.15.72:0/1659236742 learned_addr learned my addr 172.21.15.72:0/1659236742 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:13.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.352+0000 7f9086ffd700 1 -- 172.21.15.72:0/1659236742 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941284234 0 0) 0x7f90880c2260 con 0x7f9088068c20 2023-08-31T19:08:13.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.352+0000 7f9086ffd700 1 -- 172.21.15.72:0/1659236742 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90700033f0 con 0x7f9088068c20 2023-08-31T19:08:13.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.352+0000 7f908cb9c700 1 -- 172.21.15.72:0/1659236742 >> v2:172.21.15.146:3300/0 conn(0x7f9088062650 msgr2=0x7f9088069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:08:13.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.352+0000 7f908cb9c700 1 --2- 172.21.15.72:0/1659236742 >> v2:172.21.15.146:3300/0 conn(0x7f9088062650 0x7f9088069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:13.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.352+0000 7f908cb9c700 1 -- 172.21.15.72:0/1659236742 >> v1:172.21.15.146:6789/0 conn(0x7f9088068c20 legacy=0x7f90880c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:13.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.352+0000 7f908cb9c700 1 -- 172.21.15.72:0/1659236742 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9088063140 con 0x7f9088063c20 2023-08-31T19:08:13.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.352+0000 7f90877fe700 1 --2- 172.21.15.72:0/1659236742 >> v2:172.21.15.146:3300/0 conn(0x7f9088062650 0x7f9088069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:08:13.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.352+0000 7f908cb9c700 1 --2- 172.21.15.72:0/1659236742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9088063c20 0x7f9088157000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f9080009e60 tx=0x7f9080009780).ready entity=mon.2 client_cookie=1d4982a5151ad409 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:13.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.353+0000 7f9086ffd700 1 -- 172.21.15.72:0/1659236742 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908000e070 con 0x7f9088063c20 2023-08-31T19:08:13.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.353+0000 7f9086ffd700 1 -- 172.21.15.72:0/1659236742 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908000bab0 con 0x7f9088063c20 2023-08-31T19:08:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.353+0000 7f9086ffd700 1 -- 172.21.15.72:0/1659236742 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908000be30 con 0x7f9088063c20 2023-08-31T19:08:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.353+0000 7f908e5ff700 1 -- 172.21.15.72:0/1659236742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9088063c20 msgr2=0x7f9088157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.353+0000 7f908e5ff700 1 --2- 172.21.15.72:0/1659236742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9088063c20 0x7f9088157000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f9080009e60 tx=0x7f9080009780).stop 2023-08-31T19:08:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.353+0000 7f908e5ff700 1 -- 172.21.15.72:0/1659236742 shutdown_connections 2023-08-31T19:08:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.353+0000 7f908e5ff700 1 --2- 172.21.15.72:0/1659236742 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9088063c20 0x7f9088157000 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:13.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.353+0000 7f908e5ff700 1 --2- 172.21.15.72:0/1659236742 >> v2:172.21.15.146:3300/0 conn(0x7f9088062650 0x7f9088069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:13.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.353+0000 7f908e5ff700 1 -- 172.21.15.72:0/1659236742 >> 172.21.15.72:0/1659236742 conn(0x7f90880c72f0 msgr2=0x7f90880c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:13.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.353+0000 7f908e5ff700 1 -- 172.21.15.72:0/1659236742 shutdown_connections 2023-08-31T19:08:13.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.353+0000 7f908e5ff700 1 -- 172.21.15.72:0/1659236742 wait complete. 2023-08-31T19:08:13.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.355+0000 7f908e5ff700 1 Processor -- start 2023-08-31T19:08:13.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.355+0000 7f908e5ff700 1 -- start start 2023-08-31T19:08:13.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.356+0000 7f908e5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9088062650 0x7f90880ba770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:13.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.356+0000 7f908e5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9088063c20 0x7f908814e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:13.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.356+0000 7f908e5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9088068c20 0x7f9088151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:13.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.356+0000 7f908e5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908814e6b0 con 0x7f9088068c20 2023-08-31T19:08:13.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.356+0000 7f908e5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90880b96d0 con 0x7f9088062650 2023-08-31T19:08:13.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.356+0000 7f908e5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90880b99b0 con 0x7f9088063c20 2023-08-31T19:08:13.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.356+0000 7f908cb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9088068c20 0x7f9088151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:13.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.356+0000 7f908cb9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9088068c20 0x7f9088151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39486/0 (socket says 172.21.15.72:39486) 2023-08-31T19:08:13.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.356+0000 7f908cb9c700 1 -- 172.21.15.72:0/110605609 learned_addr learned my addr 172.21.15.72:0/110605609 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:08:13.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.356+0000 7f90877fe700 1 --2- 172.21.15.72:0/110605609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9088063c20 0x7f908814e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:13.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.356+0000 7f9087fff700 1 --2- 172.21.15.72:0/110605609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9088062650 0x7f90880ba770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:13.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.357+0000 7f908cb9c700 1 -- 172.21.15.72:0/110605609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9088063c20 msgr2=0x7f908814e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:13.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.357+0000 7f908cb9c700 1 --2- 172.21.15.72:0/110605609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9088063c20 0x7f908814e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:13.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.357+0000 7f908cb9c700 1 -- 172.21.15.72:0/110605609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9088062650 msgr2=0x7f90880ba770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:13.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.357+0000 7f908cb9c700 1 --2- 172.21.15.72:0/110605609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9088062650 0x7f90880ba770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:13.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.357+0000 7f908cb9c700 1 -- 172.21.15.72:0/110605609 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907c009370 con 0x7f9088068c20 2023-08-31T19:08:13.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.357+0000 7f9087fff700 1 --2- 172.21.15.72:0/110605609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9088062650 0x7f90880ba770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:08:13.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.357+0000 7f908cb9c700 1 --2- 172.21.15.72:0/110605609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9088068c20 0x7f9088151080 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f90880c7f40 tx=0x7f9088069c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:13.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.357+0000 7f906ffff700 1 -- 172.21.15.72:0/110605609 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908001d630 con 0x7f9088068c20 2023-08-31T19:08:13.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.357+0000 7f906ffff700 1 -- 172.21.15.72:0/110605609 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908001d790 con 0x7f9088068c20 2023-08-31T19:08:13.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.357+0000 7f908e5ff700 1 -- 172.21.15.72:0/110605609 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9080009a20 con 0x7f9088068c20 2023-08-31T19:08:13.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.357+0000 7f906ffff700 1 -- 172.21.15.72:0/110605609 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908001db50 con 0x7f9088068c20 2023-08-31T19:08:13.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.357+0000 7f908e5ff700 1 -- 172.21.15.72:0/110605609 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90880b9f70 con 0x7f9088068c20 2023-08-31T19:08:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.358+0000 7f908e5ff700 1 -- 172.21.15.72:0/110605609 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908806c6b0 con 0x7f9088068c20 2023-08-31T19:08:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.359+0000 7f906ffff700 1 -- 172.21.15.72:0/110605609 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 67) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f9080003040 con 0x7f9088068c20 2023-08-31T19:08:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.360+0000 7f906ffff700 1 --2- 172.21.15.72:0/110605609 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f907405ed10 0x7f90740611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:08:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.360+0000 7f906ffff700 1 -- 172.21.15.72:0/110605609 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f908007bd70 con 0x7f9088068c20 2023-08-31T19:08:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.360+0000 7f9087fff700 1 --2- 172.21.15.72:0/110605609 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f907405ed10 0x7f90740611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:08:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.360+0000 7f9087fff700 1 --2- 172.21.15.72:0/110605609 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f907405ed10 0x7f90740611d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9088156910 tx=0x7f9078009040).ready entity=mgr.8694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:08:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.364+0000 7f906ffff700 1 -- 172.21.15.72:0/110605609 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f908004d040 con 0x7f9088068c20 2023-08-31T19:08:13.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.564+0000 7f908e5ff700 1 -- 172.21.15.72:0/110605609 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f908806c070 con 0x7f907405ed10 2023-08-31T19:08:13.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.570+0000 7f906ffff700 1 -- 172.21.15.72:0/110605609 <== mgr.8694 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f908806c070 con 0x7f907405ed10 2023-08-31T19:08:13.571 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-08-31T19:08:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.572+0000 7f908e5ff700 1 -- 172.21.15.72:0/110605609 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f907405ed10 msgr2=0x7f90740611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.572+0000 7f908e5ff700 1 --2- 172.21.15.72:0/110605609 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f907405ed10 0x7f90740611d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9088156910 tx=0x7f9078009040).stop 2023-08-31T19:08:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.572+0000 7f908e5ff700 1 -- 172.21.15.72:0/110605609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9088068c20 msgr2=0x7f9088151080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:08:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.572+0000 7f908e5ff700 1 --2- 172.21.15.72:0/110605609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9088068c20 0x7f9088151080 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f90880c7f40 tx=0x7f9088069c30).stop 2023-08-31T19:08:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.573+0000 7f908e5ff700 1 -- 172.21.15.72:0/110605609 shutdown_connections 2023-08-31T19:08:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.573+0000 7f908e5ff700 1 --2- 172.21.15.72:0/110605609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9088068c20 0x7f9088151080 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.573+0000 7f908e5ff700 1 --2- 172.21.15.72:0/110605609 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f907405ed10 0x7f90740611d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.573+0000 7f908e5ff700 1 --2- 172.21.15.72:0/110605609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9088062650 0x7f90880ba770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.573+0000 7f908e5ff700 1 --2- 172.21.15.72:0/110605609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9088063c20 0x7f908814e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:08:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.573+0000 7f908e5ff700 1 -- 172.21.15.72:0/110605609 >> 172.21.15.72:0/110605609 conn(0x7f90880c72f0 msgr2=0x7f90881547e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:08:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.573+0000 7f908e5ff700 1 -- 172.21.15.72:0/110605609 shutdown_connections 2023-08-31T19:08:13.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:08:13.573+0000 7f908e5ff700 1 -- 172.21.15.72:0/110605609 wait complete. 2023-08-31T19:08:13.590 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-08-31T19:08:25.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:08:25.704 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:08:55.825 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:08:55.831 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:09:00.577 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:09:00.576+0000 7ff55a5a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:09:00.577 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:09:00.576+0000 7ff55a5a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:09:00.577 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:09:00.576+0000 7ff55a5a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:09:00.577 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:09:00.576+0000 7ff55a5a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:09:00.578 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:09:00.576+0000 7ff55a5a5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:09:25.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:09:25.995 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:09:56.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:09:56.190 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:10:26.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:10:26.379 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:10:56.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:10:56.551 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:11:26.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:11:26.664 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:11:56.788 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:11:56.795 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:12:26.901 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:12:26.907 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:12:57.014 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:12:57.046 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:13:27.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:13:27.169 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:13:57.273 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:13:57.279 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:14:27.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:14:27.389 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:14:57.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:14:57.506 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:15:27.673 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:15:27.679 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:15:57.860 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:15:57.866 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:16:27.973 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:16:27.979 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:16:58.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:16:58.159 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:17:28.266 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:17:28.272 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:17:58.446 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:17:58.454 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:18:28.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:18:28.590 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:18:58.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:18:58.796 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:19:15.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:19:15.592 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-08-31T19:19:15.646 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_09_00_UTC 2023-08-31T19:19:15.647 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_10_00_UTC 2023-08-31T19:19:15.647 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_11_00_UTC 2023-08-31T19:19:15.647 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_12_00_UTC 2023-08-31T19:19:15.647 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_13_00_UTC 2023-08-31T19:19:15.648 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_14_00_UTC 2023-08-31T19:19:15.648 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_15_00_UTC 2023-08-31T19:19:15.648 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_16_00_UTC 2023-08-31T19:19:15.648 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_17_00_UTC 2023-08-31T19:19:15.648 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_18_00_UTC 2023-08-31T19:19:15.648 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_19_00_UTC 2023-08-31T19:19:15.649 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-31-19_09_00_UTC', 'scheduled-2023-08-31-19_10_00_UTC', 'scheduled-2023-08-31-19_11_00_UTC', 'scheduled-2023-08-31-19_12_00_UTC', 'scheduled-2023-08-31-19_13_00_UTC', 'scheduled-2023-08-31-19_14_00_UTC', 'scheduled-2023-08-31-19_15_00_UTC', 'scheduled-2023-08-31-19_16_00_UTC', 'scheduled-2023-08-31-19_17_00_UTC', 'scheduled-2023-08-31-19_18_00_UTC', 'scheduled-2023-08-31-19_19_00_UTC'] 2023-08-31T19:19:15.650 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-08-31T19:19:15.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.848+0000 7fb8481ff700 1 Processor -- start 2023-08-31T19:19:15.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.848+0000 7fb8481ff700 1 -- start start 2023-08-31T19:19:15.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.849+0000 7fb8481ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb840151da0 0x7fb8401553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:19:15.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.849+0000 7fb8481ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8400c5370 0x7fb840064660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:19:15.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.850+0000 7fb8481ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb840064b50 0x7fb8400bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:19:15.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.850+0000 7fb8481ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb840154f40 con 0x7fb840151da0 2023-08-31T19:19:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.850+0000 7fb8481ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb840154960 con 0x7fb8400c5370 2023-08-31T19:19:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.850+0000 7fb8481ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb840064fc0 con 0x7fb840064b50 2023-08-31T19:19:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.850+0000 7fb845f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb840151da0 0x7fb8401553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:19:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.850+0000 7fb845f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb840151da0 0x7fb8401553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59796/0 (socket says 172.21.15.72:59796) 2023-08-31T19:19:15.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.850+0000 7fb845f9b700 1 -- 172.21.15.72:0/3043754146 learned_addr learned my addr 172.21.15.72:0/3043754146 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:19:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.850+0000 7fb84579a700 1 --2- 172.21.15.72:0/3043754146 >> v2:172.21.15.146:3300/0 conn(0x7fb8400c5370 0x7fb840064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:19:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.850+0000 7fb84679c700 1 --2- 172.21.15.72:0/3043754146 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb840064b50 0x7fb8400bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:19:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.850+0000 7fb845f9b700 1 -- 172.21.15.72:0/3043754146 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb840064b50 msgr2=0x7fb8400bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:19:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.850+0000 7fb845f9b700 1 --2- 172.21.15.72:0/3043754146 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb840064b50 0x7fb8400bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:15.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.850+0000 7fb845f9b700 1 -- 172.21.15.72:0/3043754146 >> v2:172.21.15.146:3300/0 conn(0x7fb8400c5370 msgr2=0x7fb840064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:19:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.850+0000 7fb845f9b700 1 --2- 172.21.15.72:0/3043754146 >> v2:172.21.15.146:3300/0 conn(0x7fb8400c5370 0x7fb840064660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.850+0000 7fb845f9b700 1 -- 172.21.15.72:0/3043754146 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400aa2c0 con 0x7fb840151da0 2023-08-31T19:19:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.851+0000 7fb845f9b700 1 --2- 172.21.15.72:0/3043754146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb840151da0 0x7fb8401553d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7fb840083520 tx=0x7fb83c0090f0).ready entity=mon.0 client_cookie=8afac517ff5a9b0a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:19:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.851+0000 7fb844f99700 1 -- 172.21.15.72:0/3043754146 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00b600 con 0x7fb840151da0 2023-08-31T19:19:15.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.851+0000 7fb844f99700 1 -- 172.21.15.72:0/3043754146 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c00b760 con 0x7fb840151da0 2023-08-31T19:19:15.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.851+0000 7fb844f99700 1 -- 172.21.15.72:0/3043754146 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00bae0 con 0x7fb840151da0 2023-08-31T19:19:15.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.851+0000 7fb8481ff700 1 -- 172.21.15.72:0/3043754146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb840151da0 msgr2=0x7fb8401553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:19:15.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.851+0000 7fb8481ff700 1 --2- 172.21.15.72:0/3043754146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb840151da0 0x7fb8401553d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7fb840083520 tx=0x7fb83c0090f0).stop 2023-08-31T19:19:15.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.851+0000 7fb8481ff700 1 -- 172.21.15.72:0/3043754146 shutdown_connections 2023-08-31T19:19:15.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.851+0000 7fb8481ff700 1 --2- 172.21.15.72:0/3043754146 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb840064b50 0x7fb8400bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:15.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.851+0000 7fb8481ff700 1 --2- 172.21.15.72:0/3043754146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb840151da0 0x7fb8401553d0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:15.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.851+0000 7fb8481ff700 1 --2- 172.21.15.72:0/3043754146 >> v2:172.21.15.146:3300/0 conn(0x7fb8400c5370 0x7fb840064660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:15.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.851+0000 7fb8481ff700 1 -- 172.21.15.72:0/3043754146 >> 172.21.15.72:0/3043754146 conn(0x7fb840063a90 msgr2=0x7fb8400cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:19:15.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.851+0000 7fb8481ff700 1 -- 172.21.15.72:0/3043754146 shutdown_connections 2023-08-31T19:19:15.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.852+0000 7fb8481ff700 1 -- 172.21.15.72:0/3043754146 wait complete. 2023-08-31T19:19:15.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.853+0000 7fb8481ff700 1 Processor -- start 2023-08-31T19:19:15.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.853+0000 7fb8481ff700 1 -- start start 2023-08-31T19:19:15.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.854+0000 7fb8481ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb840064b50 0x7fb84014cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:19:15.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.854+0000 7fb8481ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8400c5370 0x7fb8400aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:19:15.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.854+0000 7fb8481ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb840151da0 0x7fb8400c0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:19:15.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.854+0000 7fb8481ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400aeab0 con 0x7fb8400c5370 2023-08-31T19:19:15.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.854+0000 7fb8481ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84014d3b0 con 0x7fb840064b50 2023-08-31T19:19:15.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.854+0000 7fb8481ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb840168760 con 0x7fb840151da0 2023-08-31T19:19:15.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.854+0000 7fb84579a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8400c5370 0x7fb8400aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:19:15.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.854+0000 7fb84579a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8400c5370 0x7fb8400aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59810/0 (socket says 172.21.15.72:59810) 2023-08-31T19:19:15.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.854+0000 7fb84579a700 1 -- 172.21.15.72:0/4088770727 learned_addr learned my addr 172.21.15.72:0/4088770727 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:19:15.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.854+0000 7fb845f9b700 1 --2- 172.21.15.72:0/4088770727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb840064b50 0x7fb84014cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:19:15.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.854+0000 7fb84679c700 1 --2- 172.21.15.72:0/4088770727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb840151da0 0x7fb8400c0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:19:15.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.855+0000 7fb84579a700 1 -- 172.21.15.72:0/4088770727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb840151da0 msgr2=0x7fb8400c0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:19:15.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.855+0000 7fb84579a700 1 --2- 172.21.15.72:0/4088770727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb840151da0 0x7fb8400c0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:15.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.855+0000 7fb84579a700 1 -- 172.21.15.72:0/4088770727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb840064b50 msgr2=0x7fb84014cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:19:15.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.855+0000 7fb84579a700 1 --2- 172.21.15.72:0/4088770727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb840064b50 0x7fb84014cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:15.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.855+0000 7fb84579a700 1 -- 172.21.15.72:0/4088770727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c009370 con 0x7fb8400c5370 2023-08-31T19:19:15.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.855+0000 7fb84579a700 1 --2- 172.21.15.72:0/4088770727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8400c5370 0x7fb8400aef40 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7fb83000d8c0 tx=0x7fb830008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:19:15.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.855+0000 7fb835ffb700 1 -- 172.21.15.72:0/4088770727 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830011590 con 0x7fb8400c5370 2023-08-31T19:19:15.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.855+0000 7fb835ffb700 1 -- 172.21.15.72:0/4088770727 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8300116f0 con 0x7fb8400c5370 2023-08-31T19:19:15.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.855+0000 7fb8481ff700 1 -- 172.21.15.72:0/4088770727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8400ae460 con 0x7fb8400c5370 2023-08-31T19:19:15.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.855+0000 7fb835ffb700 1 -- 172.21.15.72:0/4088770727 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830011a70 con 0x7fb8400c5370 2023-08-31T19:19:15.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.855+0000 7fb8481ff700 1 -- 172.21.15.72:0/4088770727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8400af430 con 0x7fb8400c5370 2023-08-31T19:19:15.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.856+0000 7fb8481ff700 1 -- 172.21.15.72:0/4088770727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84006a7e0 con 0x7fb8400c5370 2023-08-31T19:19:15.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.857+0000 7fb835ffb700 1 -- 172.21.15.72:0/4088770727 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 70) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fb83001c460 con 0x7fb8400c5370 2023-08-31T19:19:15.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.858+0000 7fb835ffb700 1 --2- 172.21.15.72:0/4088770727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb82405ef80 0x7fb824061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:19:15.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.858+0000 7fb835ffb700 1 -- 172.21.15.72:0/4088770727 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 7065+0+0 (secure 0 0 0) 0x7fb83007a220 con 0x7fb8400c5370 2023-08-31T19:19:15.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.858+0000 7fb845f9b700 1 --2- 172.21.15.72:0/4088770727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb82405ef80 0x7fb824061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:19:15.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.859+0000 7fb845f9b700 1 --2- 172.21.15.72:0/4088770727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb82405ef80 0x7fb824061440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fb83c009130 tx=0x7fb83c017000).ready entity=mgr.8694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:19:15.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:15.863+0000 7fb835ffb700 1 -- 172.21.15.72:0/4088770727 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb83004b040 con 0x7fb8400c5370 2023-08-31T19:19:16.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.054+0000 7fb8481ff700 1 -- 172.21.15.72:0/4088770727 --> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8400ae2a0 con 0x7fb82405ef80 2023-08-31T19:19:16.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.056+0000 7fb835ffb700 1 -- 172.21.15.72:0/4088770727 <== mgr.8694 v2:172.21.15.72:6832/143463 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fb8400ae2a0 con 0x7fb82405ef80 2023-08-31T19:19:16.057 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:19:16.057 INFO:teuthology.orchestra.run.smithi072.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T19:08:13", "first": "2023-08-31T19:09:00", "last": "2023-08-31T19:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-08-31T19:19:16.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.058+0000 7fb8481ff700 1 -- 172.21.15.72:0/4088770727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb82405ef80 msgr2=0x7fb824061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:19:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.058+0000 7fb8481ff700 1 --2- 172.21.15.72:0/4088770727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb82405ef80 0x7fb824061440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fb83c009130 tx=0x7fb83c017000).stop 2023-08-31T19:19:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.058+0000 7fb8481ff700 1 -- 172.21.15.72:0/4088770727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8400c5370 msgr2=0x7fb8400aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:19:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.058+0000 7fb8481ff700 1 --2- 172.21.15.72:0/4088770727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8400c5370 0x7fb8400aef40 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7fb83000d8c0 tx=0x7fb830008040).stop 2023-08-31T19:19:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.058+0000 7fb8481ff700 1 -- 172.21.15.72:0/4088770727 shutdown_connections 2023-08-31T19:19:16.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.058+0000 7fb8481ff700 1 --2- 172.21.15.72:0/4088770727 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb840151da0 0x7fb8400c0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:16.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.058+0000 7fb8481ff700 1 --2- 172.21.15.72:0/4088770727 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7fb82405ef80 0x7fb824061440 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:16.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.058+0000 7fb8481ff700 1 --2- 172.21.15.72:0/4088770727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb840064b50 0x7fb84014cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:16.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.058+0000 7fb8481ff700 1 --2- 172.21.15.72:0/4088770727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb8400c5370 0x7fb8400aef40 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:16.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.058+0000 7fb8481ff700 1 -- 172.21.15.72:0/4088770727 >> 172.21.15.72:0/4088770727 conn(0x7fb840063a90 msgr2=0x7fb8400bfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:19:16.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.058+0000 7fb8481ff700 1 -- 172.21.15.72:0/4088770727 shutdown_connections 2023-08-31T19:19:16.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.058+0000 7fb8481ff700 1 -- 172.21.15.72:0/4088770727 wait complete. 2023-08-31T19:19:16.075 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T19:08:13", "first": "2023-08-31T19:09:00", "last": "2023-08-31T19:19:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-08-31T19:19:16.076 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-08-31T00:00:00', 'created': '2023-08-31T19:08:13', 'first': '2023-08-31T19:09:00', 'last': '2023-08-31T19:19:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-08-31T19:19:16.076 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-31T19:19:16.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.263+0000 7f3073fff700 1 Processor -- start 2023-08-31T19:19:16.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.263+0000 7f3073fff700 1 -- start start 2023-08-31T19:19:16.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.264+0000 7f3073fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f306c0c6c30 0x7f306c0bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:19:16.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.264+0000 7f3073fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f306c0c4740 0x7f306c157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:19:16.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.264+0000 7f3073fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c063be0 con 0x7f306c1581d0 2023-08-31T19:19:16.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.264+0000 7f3073fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c063010 con 0x7f306c0c6c30 2023-08-31T19:19:16.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.264+0000 7f3073fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c158600 con 0x7f306c0c4740 2023-08-31T19:19:16.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.264+0000 7f3071d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f306c0c6c30 0x7f306c0bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:19:16.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.265+0000 7f3071d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f306c0c6c30 0x7f306c0bc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59812/0 (socket says 172.21.15.72:59812) 2023-08-31T19:19:16.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.265+0000 7f3071d9b700 1 -- 172.21.15.72:0/2805801822 learned_addr learned my addr 172.21.15.72:0/2805801822 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:19:16.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.265+0000 7f307259c700 1 --1- 172.21.15.72:0/2805801822 >> v1:172.21.15.72:6789/0 conn(0x7f306c1581d0 0x7f306c154710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55626/0 (socket says 172.21.15.72:55626) 2023-08-31T19:19:16.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.265+0000 7f307159a700 1 --2- 172.21.15.72:0/2805801822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f306c0c4740 0x7f306c157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:19:16.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.265+0000 7f3071d9b700 1 -- 172.21.15.72:0/2805801822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f306c0c4740 msgr2=0x7f306c157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:19:16.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.265+0000 7f3071d9b700 1 --2- 172.21.15.72:0/2805801822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f306c0c4740 0x7f306c157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:16.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.265+0000 7f3071d9b700 1 -- 172.21.15.72:0/2805801822 >> v1:172.21.15.72:6789/0 conn(0x7f306c1581d0 legacy=0x7f306c154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:19:16.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.265+0000 7f3070d99700 1 -- 172.21.15.72:0/2805801822 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328636282 0 0) 0x7f306c063be0 con 0x7f306c1581d0 2023-08-31T19:19:16.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.265+0000 7f3071d9b700 1 -- 172.21.15.72:0/2805801822 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c0632b0 con 0x7f306c0c6c30 2023-08-31T19:19:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.265+0000 7f3071d9b700 1 --2- 172.21.15.72:0/2805801822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306c0c6c30 0x7f306c0bc300 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f3068006fd0 tx=0x7f30680090f0).ready entity=mon.0 client_cookie=abb4c43d22aeadf3 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:19:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.265+0000 7f3070d99700 1 -- 172.21.15.72:0/2805801822 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800b580 con 0x7f306c0c6c30 2023-08-31T19:19:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.265+0000 7f3070d99700 1 -- 172.21.15.72:0/2805801822 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800b6e0 con 0x7f306c0c6c30 2023-08-31T19:19:16.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.265+0000 7f3070d99700 1 -- 172.21.15.72:0/2805801822 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800ba60 con 0x7f306c0c6c30 2023-08-31T19:19:16.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.266+0000 7f3073fff700 1 -- 172.21.15.72:0/2805801822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306c0c6c30 msgr2=0x7f306c0bc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:19:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.266+0000 7f3073fff700 1 --2- 172.21.15.72:0/2805801822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306c0c6c30 0x7f306c0bc300 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f3068006fd0 tx=0x7f30680090f0).stop 2023-08-31T19:19:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.266+0000 7f3073fff700 1 -- 172.21.15.72:0/2805801822 shutdown_connections 2023-08-31T19:19:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.266+0000 7f3073fff700 1 --2- 172.21.15.72:0/2805801822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306c0c6c30 0x7f306c0bc300 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.266+0000 7f3073fff700 1 --2- 172.21.15.72:0/2805801822 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f306c0c4740 0x7f306c157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:16.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.266+0000 7f3073fff700 1 -- 172.21.15.72:0/2805801822 >> 172.21.15.72:0/2805801822 conn(0x7f306c0c7e70 msgr2=0x7f306c0c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:19:16.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.266+0000 7f3073fff700 1 -- 172.21.15.72:0/2805801822 shutdown_connections 2023-08-31T19:19:16.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.266+0000 7f3073fff700 1 -- 172.21.15.72:0/2805801822 wait complete. 2023-08-31T19:19:16.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.267+0000 7f3073fff700 1 Processor -- start 2023-08-31T19:19:16.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.268+0000 7f3073fff700 1 -- start start 2023-08-31T19:19:16.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.268+0000 7f3073fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f306c0c4740 0x7f306c0a6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:19:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f3073fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306c0c6c30 0x7f306c136cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:19:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f3073fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f306c1581d0 0x7f306c065f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:19:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f3073fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0aa8a0 con 0x7f306c0c6c30 2023-08-31T19:19:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f3073fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0aab80 con 0x7f306c0c4740 2023-08-31T19:19:16.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f3073fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c0aae60 con 0x7f306c1581d0 2023-08-31T19:19:16.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f307159a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306c0c6c30 0x7f306c136cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:19:16.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f307159a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306c0c6c30 0x7f306c136cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59820/0 (socket says 172.21.15.72:59820) 2023-08-31T19:19:16.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f307159a700 1 -- 172.21.15.72:0/3517655782 learned_addr learned my addr 172.21.15.72:0/3517655782 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:19:16.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f3071d9b700 1 --2- 172.21.15.72:0/3517655782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f306c0c4740 0x7f306c0a6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:19:16.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f307259c700 1 --2- 172.21.15.72:0/3517655782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f306c1581d0 0x7f306c065f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:19:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f307159a700 1 -- 172.21.15.72:0/3517655782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f306c1581d0 msgr2=0x7f306c065f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:19:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f307159a700 1 --2- 172.21.15.72:0/3517655782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f306c1581d0 0x7f306c065f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f307159a700 1 -- 172.21.15.72:0/3517655782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f306c0c4740 msgr2=0x7f306c0a6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:19:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f307159a700 1 --2- 172.21.15.72:0/3517655782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f306c0c4740 0x7f306c0a6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f307159a700 1 -- 172.21.15.72:0/3517655782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068009370 con 0x7f306c0c6c30 2023-08-31T19:19:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.269+0000 7f307159a700 1 --2- 172.21.15.72:0/3517655782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306c0c6c30 0x7f306c136cc0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f305c00e900 tx=0x7f305c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:19:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.270+0000 7f3061ffb700 1 -- 172.21.15.72:0/3517655782 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00c640 con 0x7f306c0c6c30 2023-08-31T19:19:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.270+0000 7f3061ffb700 1 -- 172.21.15.72:0/3517655782 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c00c7a0 con 0x7f306c0c6c30 2023-08-31T19:19:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.270+0000 7f3061ffb700 1 -- 172.21.15.72:0/3517655782 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c00cb20 con 0x7f306c0c6c30 2023-08-31T19:19:16.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.270+0000 7f3073fff700 1 -- 172.21.15.72:0/3517655782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306c0ab140 con 0x7f306c0c6c30 2023-08-31T19:19:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.270+0000 7f3073fff700 1 -- 172.21.15.72:0/3517655782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c0a7420 con 0x7f306c0c6c30 2023-08-31T19:19:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.271+0000 7f3073fff700 1 -- 172.21.15.72:0/3517655782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c0ab790 con 0x7f306c0c6c30 2023-08-31T19:19:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.272+0000 7f3061ffb700 1 -- 172.21.15.72:0/3517655782 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 70) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f305c01b400 con 0x7f306c0c6c30 2023-08-31T19:19:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.272+0000 7f3061ffb700 1 --2- 172.21.15.72:0/3517655782 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f305005ef80 0x7f3050061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:19:16.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.272+0000 7f3061ffb700 1 -- 172.21.15.72:0/3517655782 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 7065+0+0 (secure 0 0 0) 0x7f305c07a8c0 con 0x7f306c0c6c30 2023-08-31T19:19:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.273+0000 7f3071d9b700 1 --2- 172.21.15.72:0/3517655782 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f305005ef80 0x7f3050061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:19:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.273+0000 7f3071d9b700 1 --2- 172.21.15.72:0/3517655782 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f305005ef80 0x7f3050061440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3068009fd0 tx=0x7f3068017000).ready entity=mgr.8694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:19:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.277+0000 7f3061ffb700 1 -- 172.21.15.72:0/3517655782 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f305c04b6e0 con 0x7f306c0c6c30 2023-08-31T19:19:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.488+0000 7f3073fff700 1 -- 172.21.15.72:0/3517655782 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f306c06c6b0 con 0x7f306c0c6c30 2023-08-31T19:19:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.491+0000 7f3061ffb700 1 -- 172.21.15.72:0/3517655782 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v70) v1 ==== 74+0+148765 (secure 0 0 0) 0x7f305c016070 con 0x7f306c0c6c30 2023-08-31T19:19:16.493 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:19:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.494+0000 7f3073fff700 1 -- 172.21.15.72:0/3517655782 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f305005ef80 msgr2=0x7f3050061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:19:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.494+0000 7f3073fff700 1 --2- 172.21.15.72:0/3517655782 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f305005ef80 0x7f3050061440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3068009fd0 tx=0x7f3068017000).stop 2023-08-31T19:19:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.494+0000 7f3073fff700 1 -- 172.21.15.72:0/3517655782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306c0c6c30 msgr2=0x7f306c136cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:19:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.494+0000 7f3073fff700 1 --2- 172.21.15.72:0/3517655782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306c0c6c30 0x7f306c136cc0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f305c00e900 tx=0x7f305c009060).stop 2023-08-31T19:19:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.494+0000 7f3073fff700 1 -- 172.21.15.72:0/3517655782 shutdown_connections 2023-08-31T19:19:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.494+0000 7f3073fff700 1 --2- 172.21.15.72:0/3517655782 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f306c1581d0 0x7f306c065f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.494+0000 7f3073fff700 1 --2- 172.21.15.72:0/3517655782 >> [v2:172.21.15.72:6832/143463,v1:172.21.15.72:6833/143463] conn(0x7f305005ef80 0x7f3050061440 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.494+0000 7f3073fff700 1 --2- 172.21.15.72:0/3517655782 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f306c0c4740 0x7f306c0a6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.494+0000 7f3073fff700 1 --2- 172.21.15.72:0/3517655782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306c0c6c30 0x7f306c136cc0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:19:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.494+0000 7f3073fff700 1 -- 172.21.15.72:0/3517655782 >> 172.21.15.72:0/3517655782 conn(0x7f306c0c7e70 msgr2=0x7f306c0a4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:19:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.494+0000 7f3073fff700 1 -- 172.21.15.72:0/3517655782 shutdown_connections 2023-08-31T19:19:16.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:19:16.494+0000 7f3073fff700 1 -- 172.21.15.72:0/3517655782 wait complete. 2023-08-31T19:19:16.511 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":70,"active_gid":8694,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":143463},{"type":"v1","addr":"172.21.15.72:6833","nonce":143463}]},"active_addr":"172.21.15.72:6833/143463","active_change":"2023-08-31T19:08:12.110489+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":7924,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":158,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1709110334}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1373642977}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1362138661}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":239009245}]}]} 2023-08-31T19:19:16.515 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: y 2023-08-31T19:19:16.515 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-31T19:19:16.516 INFO:tasks.ceph.mgr.y:Stopping old one... 2023-08-31T19:19:16.516 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-08-31T19:19:16.516 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:19:16.577 INFO:tasks.ceph.mgr.y:Stopped 2023-08-31T19:19:16.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-31T19:19:16.585 INFO:tasks.ceph.mgr.y:Started 2023-08-31T19:19:16.852 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:16.852+0000 7f95801c3680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:19:16.930 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:16.930+0000 7f95801c3680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:19:17.257 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:17.257+0000 7f95801c3680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:19:17.995 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:17.995+0000 7f95801c3680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:19:18.077 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:18.077+0000 7f95801c3680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:19:18.305 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:18.305+0000 7f95801c3680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:19:18.814 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:18.814+0000 7f95801c3680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:19:18.940 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:18.940+0000 7f95801c3680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:19:19.122 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:19.122+0000 7f95801c3680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:19:19.214 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:19.213+0000 7f95801c3680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:19:19.298 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:19.298+0000 7f95801c3680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:19:19.606 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:19.606+0000 7f95801c3680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:19:19.826 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:19.826+0000 7f95801c3680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:19:20.626 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:20.626+0000 7f95801c3680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:19:20.713 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:20.713+0000 7f95801c3680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:19:20.808 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:20.807+0000 7f95801c3680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:19:20.992 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:20.992+0000 7f95801c3680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:19:21.083 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:21.083+0000 7f95801c3680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:19:21.224 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:21.224+0000 7f95801c3680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:19:21.354 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:21.354+0000 7f95801c3680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:19:21.698 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:21.698+0000 7f95801c3680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:19:21.787 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:21.787+0000 7f95801c3680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:19:21.875 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:21.874+0000 7f94f5486700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:19:21.875 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:21.874+0000 7f94f5486700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:19:21.875 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:21.874+0000 7f94f5486700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:19:21.875 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:21.874+0000 7f94f5486700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:19:21.876 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:21.874+0000 7f94f5486700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:19:21.876 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:21.874+0000 7f94f2480700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:19:21.876 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:21.874+0000 7f94f2480700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:19:21.876 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:21.874+0000 7f94f2480700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:19:21.876 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:21.874+0000 7f94f2480700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:19:21.876 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:19:21.874+0000 7f94f2480700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:19:28.945 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:19:28.951 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:19:59.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:19:59.131 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:20:00.863 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:20:00.862+0000 7f94fd496700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:20:00.863 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:20:00.862+0000 7f94fd496700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:20:00.863 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:20:00.862+0000 7f94fd496700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:20:00.864 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:20:00.862+0000 7f94fd496700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:20:00.864 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:20:00.862+0000 7f94fd496700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:20:29.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:20:29.312 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:20:59.494 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:20:59.500 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:21:29.648 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:21:29.654 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:21:59.829 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:21:59.836 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:22:29.975 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:22:29.981 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:23:00.163 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:23:00.169 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:23:30.285 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:23:30.294 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:24:00.398 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:24:00.404 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:24:16.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-31T19:24:16.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.790+0000 7f5837dff700 1 Processor -- start 2023-08-31T19:24:16.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.790+0000 7f5837dff700 1 -- start start 2023-08-31T19:24:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.791+0000 7f5837dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f58301377c0 0x7f5830069460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.791+0000 7f5837dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58300c13e0 con 0x7f58300c3ac0 2023-08-31T19:24:16.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.791+0000 7f5837dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58300c19a0 con 0x7f58301373e0 2023-08-31T19:24:16.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.791+0000 7f5837dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583006a1d0 con 0x7f58301377c0 2023-08-31T19:24:16.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.792+0000 7f583539a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f58301377c0 0x7f5830069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:16.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.792+0000 7f583539a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f58301377c0 0x7f5830069460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57348/0 (socket says 172.21.15.72:57348) 2023-08-31T19:24:16.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.792+0000 7f583539a700 1 -- 172.21.15.72:0/3059616705 learned_addr learned my addr 172.21.15.72:0/3059616705 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.792+0000 7f583539a700 1 -- 172.21.15.72:0/3059616705 >> v1:172.21.15.146:6789/0 conn(0x7f58301373e0 legacy=0x7f58300c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.792+0000 7f583539a700 1 -- 172.21.15.72:0/3059616705 >> v1:172.21.15.72:6789/0 conn(0x7f58300c3ac0 legacy=0x7f5830069950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:16.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.792+0000 7f583539a700 1 -- 172.21.15.72:0/3059616705 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583006a4b0 con 0x7f58301377c0 2023-08-31T19:24:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.792+0000 7f583539a700 1 --2- 172.21.15.72:0/3059616705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58301377c0 0x7f5830069460 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f5820006fd0 tx=0x7f58200090f0).ready entity=mon.0 client_cookie=a92b8af62eb4c7d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.793+0000 7f5834b99700 1 -- 172.21.15.72:0/3059616705 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000b600 con 0x7f58301377c0 2023-08-31T19:24:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.793+0000 7f5834b99700 1 -- 172.21.15.72:0/3059616705 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582000b760 con 0x7f58301377c0 2023-08-31T19:24:16.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.793+0000 7f5834b99700 1 -- 172.21.15.72:0/3059616705 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000bae0 con 0x7f58301377c0 2023-08-31T19:24:16.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.793+0000 7f5837dff700 1 -- 172.21.15.72:0/3059616705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58301377c0 msgr2=0x7f5830069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:16.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.793+0000 7f5837dff700 1 --2- 172.21.15.72:0/3059616705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58301377c0 0x7f5830069460 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f5820006fd0 tx=0x7f58200090f0).stop 2023-08-31T19:24:16.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.793+0000 7f5837dff700 1 -- 172.21.15.72:0/3059616705 shutdown_connections 2023-08-31T19:24:16.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.793+0000 7f5837dff700 1 --2- 172.21.15.72:0/3059616705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58301377c0 0x7f5830069460 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:16.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.793+0000 7f5837dff700 1 -- 172.21.15.72:0/3059616705 >> 172.21.15.72:0/3059616705 conn(0x7f5830062650 msgr2=0x7f5830062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.793+0000 7f5837dff700 1 -- 172.21.15.72:0/3059616705 shutdown_connections 2023-08-31T19:24:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.793+0000 7f5837dff700 1 -- 172.21.15.72:0/3059616705 wait complete. 2023-08-31T19:24:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.795+0000 7f5837dff700 1 Processor -- start 2023-08-31T19:24:16.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.795+0000 7f5837dff700 1 -- start start 2023-08-31T19:24:16.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.796+0000 7f5837dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58300c3ac0 0x7f5830167b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:16.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.796+0000 7f5837dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58301373e0 0x7f5830168060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:16.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.796+0000 7f5837dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58301377c0 0x7f58300c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:16.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.796+0000 7f5837dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5830168550 con 0x7f58301377c0 2023-08-31T19:24:16.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.796+0000 7f5837dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58300a99f0 con 0x7f58301373e0 2023-08-31T19:24:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.796+0000 7f5837dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58300aa290 con 0x7f58300c3ac0 2023-08-31T19:24:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.796+0000 7f583639c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58301377c0 0x7f58300c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.796+0000 7f583639c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58301377c0 0x7f58300c51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57352/0 (socket says 172.21.15.72:57352) 2023-08-31T19:24:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.796+0000 7f583639c700 1 -- 172.21.15.72:0/4001132241 learned_addr learned my addr 172.21.15.72:0/4001132241 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:16.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.796+0000 7f583639c700 1 -- 172.21.15.72:0/4001132241 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58300c3ac0 msgr2=0x7f5830167b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.796+0000 7f583639c700 1 --2- 172.21.15.72:0/4001132241 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58300c3ac0 0x7f5830167b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.797+0000 7f583639c700 1 -- 172.21.15.72:0/4001132241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58301373e0 msgr2=0x7f5830168060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.797+0000 7f583639c700 1 --2- 172.21.15.72:0/4001132241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58301373e0 0x7f5830168060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:16.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.797+0000 7f583639c700 1 -- 172.21.15.72:0/4001132241 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5820009370 con 0x7f58301377c0 2023-08-31T19:24:16.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.797+0000 7f583639c700 1 --2- 172.21.15.72:0/4001132241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58301377c0 0x7f58300c51f0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f582800c7f0 tx=0x7f5828001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:16.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.797+0000 7f5825ffb700 1 -- 172.21.15.72:0/4001132241 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5828010510 con 0x7f58301377c0 2023-08-31T19:24:16.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.797+0000 7f5825ffb700 1 -- 172.21.15.72:0/4001132241 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5828010670 con 0x7f58301377c0 2023-08-31T19:24:16.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.797+0000 7f5825ffb700 1 -- 172.21.15.72:0/4001132241 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280109f0 con 0x7f58301377c0 2023-08-31T19:24:16.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.797+0000 7f5837dff700 1 -- 172.21.15.72:0/4001132241 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58300c5f80 con 0x7f58301377c0 2023-08-31T19:24:16.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.797+0000 7f5837dff700 1 -- 172.21.15.72:0/4001132241 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58300a9f20 con 0x7f58301377c0 2023-08-31T19:24:16.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.798+0000 7f5837dff700 1 -- 172.21.15.72:0/4001132241 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583006c6b0 con 0x7f58301377c0 2023-08-31T19:24:16.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.799+0000 7f5825ffb700 1 -- 172.21.15.72:0/4001132241 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 75) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f582801b400 con 0x7f58301377c0 2023-08-31T19:24:16.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.800+0000 7f5825ffb700 1 --2- 172.21.15.72:0/4001132241 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f581405ef80 0x7f5814061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:16.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.800+0000 7f5825ffb700 1 -- 172.21.15.72:0/4001132241 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7237+0+0 (secure 0 0 0) 0x7f582807a460 con 0x7f58301377c0 2023-08-31T19:24:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.800+0000 7f5835b9b700 1 --2- 172.21.15.72:0/4001132241 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f581405ef80 0x7f5814061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.800+0000 7f5835b9b700 1 --2- 172.21.15.72:0/4001132241 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f581405ef80 0x7f5814061440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f582c001510 tx=0x7f582c0079c0).ready entity=mgr.8769 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:16.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:16.805+0000 7f5825ffb700 1 -- 172.21.15.72:0/4001132241 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f582804b1d0 con 0x7f58301377c0 2023-08-31T19:24:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.002+0000 7f5837dff700 1 -- 172.21.15.72:0/4001132241 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f58300c1630 con 0x7f581405ef80 2023-08-31T19:24:17.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.007+0000 7f5825ffb700 1 -- 172.21.15.72:0/4001132241 <== mgr.8769 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7f58300c1630 con 0x7f581405ef80 2023-08-31T19:24:17.007 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-08-31T19:24:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.009+0000 7f5837dff700 1 -- 172.21.15.72:0/4001132241 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f581405ef80 msgr2=0x7f5814061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.009+0000 7f5837dff700 1 --2- 172.21.15.72:0/4001132241 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f581405ef80 0x7f5814061440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f582c001510 tx=0x7f582c0079c0).stop 2023-08-31T19:24:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.009+0000 7f5837dff700 1 -- 172.21.15.72:0/4001132241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58301377c0 msgr2=0x7f58300c51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.009+0000 7f5837dff700 1 --2- 172.21.15.72:0/4001132241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58301377c0 0x7f58300c51f0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f582800c7f0 tx=0x7f5828001560).stop 2023-08-31T19:24:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.009+0000 7f5837dff700 1 -- 172.21.15.72:0/4001132241 shutdown_connections 2023-08-31T19:24:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.009+0000 7f5837dff700 1 --2- 172.21.15.72:0/4001132241 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f581405ef80 0x7f5814061440 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.009+0000 7f5837dff700 1 --2- 172.21.15.72:0/4001132241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58301377c0 0x7f58300c51f0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.009+0000 7f5837dff700 1 --2- 172.21.15.72:0/4001132241 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58300c3ac0 0x7f5830167b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.009+0000 7f5837dff700 1 --2- 172.21.15.72:0/4001132241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58301373e0 0x7f5830168060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.009+0000 7f5837dff700 1 -- 172.21.15.72:0/4001132241 >> 172.21.15.72:0/4001132241 conn(0x7f5830062650 msgr2=0x7f58300bccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.009+0000 7f5837dff700 1 -- 172.21.15.72:0/4001132241 shutdown_connections 2023-08-31T19:24:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.009+0000 7f5837dff700 1 -- 172.21.15.72:0/4001132241 wait complete. 2023-08-31T19:24:17.026 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-08-31T19:24:17.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:17.028 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-08-31T19:24:17.075 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_09_00_UTC 2023-08-31T19:24:17.075 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_10_00_UTC 2023-08-31T19:24:17.075 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_11_00_UTC 2023-08-31T19:24:17.075 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_12_00_UTC 2023-08-31T19:24:17.076 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_13_00_UTC 2023-08-31T19:24:17.076 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_14_00_UTC 2023-08-31T19:24:17.076 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_15_00_UTC 2023-08-31T19:24:17.076 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_16_00_UTC 2023-08-31T19:24:17.076 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_17_00_UTC 2023-08-31T19:24:17.077 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_18_00_UTC 2023-08-31T19:24:17.077 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_19_00_UTC 2023-08-31T19:24:17.077 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_20_00_UTC 2023-08-31T19:24:17.077 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_21_00_UTC 2023-08-31T19:24:17.077 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_22_00_UTC 2023-08-31T19:24:17.078 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_23_00_UTC 2023-08-31T19:24:17.078 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_24_00_UTC 2023-08-31T19:24:17.079 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-31-19_09_00_UTC', 'scheduled-2023-08-31-19_10_00_UTC', 'scheduled-2023-08-31-19_11_00_UTC', 'scheduled-2023-08-31-19_12_00_UTC', 'scheduled-2023-08-31-19_13_00_UTC', 'scheduled-2023-08-31-19_14_00_UTC', 'scheduled-2023-08-31-19_15_00_UTC', 'scheduled-2023-08-31-19_16_00_UTC', 'scheduled-2023-08-31-19_17_00_UTC', 'scheduled-2023-08-31-19_18_00_UTC', 'scheduled-2023-08-31-19_19_00_UTC', 'scheduled-2023-08-31-19_20_00_UTC', 'scheduled-2023-08-31-19_21_00_UTC', 'scheduled-2023-08-31-19_22_00_UTC', 'scheduled-2023-08-31-19_23_00_UTC', 'scheduled-2023-08-31-19_24_00_UTC'] 2023-08-31T19:24:17.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-08-31T19:24:17.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.272+0000 7f3fb65ff700 1 Processor -- start 2023-08-31T19:24:17.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.272+0000 7f3fb65ff700 1 -- start start 2023-08-31T19:24:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.273+0000 7f3fb65ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3fb0154120 0x7f3fb00a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.273+0000 7f3fb65ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb0154500 0x7f3fb00646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:17.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.273+0000 7f3fb65ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb00aa620 con 0x7f3fb0064b90 2023-08-31T19:24:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.273+0000 7f3fb65ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb00aa3a0 con 0x7f3fb0154120 2023-08-31T19:24:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.273+0000 7f3fb65ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb0064ff0 con 0x7f3fb0154500 2023-08-31T19:24:17.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.273+0000 7f3faffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3fb0154120 0x7f3fb00a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:17.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.273+0000 7f3faf7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb0154500 0x7f3fb00646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:17.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.274+0000 7f3fb4b9c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3fb0064b90 0x7f3fb00c0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:58810/0 (socket says 172.21.15.72:58810) 2023-08-31T19:24:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.274+0000 7f3fb4b9c700 1 -- 172.21.15.72:0/2001618981 learned_addr learned my addr 172.21.15.72:0/2001618981 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.274+0000 7f3faeffd700 1 -- 172.21.15.72:0/2001618981 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238822782 0 0) 0x7f3fb00aa620 con 0x7f3fb0064b90 2023-08-31T19:24:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.274+0000 7f3faeffd700 1 -- 172.21.15.72:0/2001618981 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f980033f0 con 0x7f3fb0064b90 2023-08-31T19:24:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.274+0000 7f3faf7fe700 1 -- 172.21.15.72:0/2001618981 >> v2:172.21.15.146:3300/0 conn(0x7f3fb0154120 msgr2=0x7f3fb00a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.274+0000 7f3faf7fe700 1 --2- 172.21.15.72:0/2001618981 >> v2:172.21.15.146:3300/0 conn(0x7f3fb0154120 0x7f3fb00a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.274+0000 7f3faf7fe700 1 -- 172.21.15.72:0/2001618981 >> v1:172.21.15.146:6789/0 conn(0x7f3fb0064b90 legacy=0x7f3fb00c0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.274+0000 7f3faf7fe700 1 -- 172.21.15.72:0/2001618981 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb00c5450 con 0x7f3fb0154500 2023-08-31T19:24:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.274+0000 7f3faffff700 1 --2- 172.21.15.72:0/2001618981 >> v2:172.21.15.146:3300/0 conn(0x7f3fb0154120 0x7f3fb00a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.274+0000 7f3faf7fe700 1 --2- 172.21.15.72:0/2001618981 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb0154500 0x7f3fb00646a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f3fa4009760 tx=0x7f3fa4009060).ready entity=mon.2 client_cookie=8d5246d074078646 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.275+0000 7f3faeffd700 1 -- 172.21.15.72:0/2001618981 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa400d4a0 con 0x7f3fb0154500 2023-08-31T19:24:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.275+0000 7f3faeffd700 1 -- 172.21.15.72:0/2001618981 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa400d600 con 0x7f3fb0154500 2023-08-31T19:24:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.275+0000 7f3faeffd700 1 -- 172.21.15.72:0/2001618981 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa400d980 con 0x7f3fb0154500 2023-08-31T19:24:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.275+0000 7f3fb65ff700 1 -- 172.21.15.72:0/2001618981 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb0154500 msgr2=0x7f3fb00646a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.275+0000 7f3fb65ff700 1 --2- 172.21.15.72:0/2001618981 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb0154500 0x7f3fb00646a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f3fa4009760 tx=0x7f3fa4009060).stop 2023-08-31T19:24:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.275+0000 7f3fb65ff700 1 -- 172.21.15.72:0/2001618981 shutdown_connections 2023-08-31T19:24:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.275+0000 7f3fb65ff700 1 --2- 172.21.15.72:0/2001618981 >> v2:172.21.15.146:3300/0 conn(0x7f3fb0154120 0x7f3fb00a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.275+0000 7f3fb65ff700 1 --2- 172.21.15.72:0/2001618981 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb0154500 0x7f3fb00646a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.275+0000 7f3fb65ff700 1 -- 172.21.15.72:0/2001618981 >> 172.21.15.72:0/2001618981 conn(0x7f3fb00cb7e0 msgr2=0x7f3fb00c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.275+0000 7f3fb65ff700 1 -- 172.21.15.72:0/2001618981 shutdown_connections 2023-08-31T19:24:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.275+0000 7f3fb65ff700 1 -- 172.21.15.72:0/2001618981 wait complete. 2023-08-31T19:24:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.277+0000 7f3fb65ff700 1 Processor -- start 2023-08-31T19:24:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.277+0000 7f3fb65ff700 1 -- start start 2023-08-31T19:24:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.278+0000 7f3fb65ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb0064b90 0x7f3fb01407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:17.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.278+0000 7f3fb65ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb0154120 0x7f3fb00c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:17.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.278+0000 7f3fb65ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb0154500 0x7f3fb00c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:17.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.278+0000 7f3fb65ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00c9ba0 con 0x7f3fb0064b90 2023-08-31T19:24:17.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.278+0000 7f3fb65ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00ad290 con 0x7f3fb0154500 2023-08-31T19:24:17.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.278+0000 7f3fb65ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb00ac680 con 0x7f3fb0154120 2023-08-31T19:24:17.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.278+0000 7f3faffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb0064b90 0x7f3fb01407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:17.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.278+0000 7f3faffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb0064b90 0x7f3fb01407a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57362/0 (socket says 172.21.15.72:57362) 2023-08-31T19:24:17.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.278+0000 7f3faffff700 1 -- 172.21.15.72:0/1634153104 learned_addr learned my addr 172.21.15.72:0/1634153104 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:17.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.279+0000 7f3faffff700 1 -- 172.21.15.72:0/1634153104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb0154120 msgr2=0x7f3fb00c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:17.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.279+0000 7f3faffff700 1 --2- 172.21.15.72:0/1634153104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb0154120 0x7f3fb00c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:17.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.279+0000 7f3faffff700 1 -- 172.21.15.72:0/1634153104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb0154500 msgr2=0x7f3fb00c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:17.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.279+0000 7f3fb4b9c700 1 --2- 172.21.15.72:0/1634153104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb0154500 0x7f3fb00c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:17.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.279+0000 7f3faffff700 1 --2- 172.21.15.72:0/1634153104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb0154500 0x7f3fb00c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.279+0000 7f3faffff700 1 -- 172.21.15.72:0/1634153104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa00092a0 con 0x7f3fb0064b90 2023-08-31T19:24:17.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.279+0000 7f3fb4b9c700 1 --2- 172.21.15.72:0/1634153104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb0154500 0x7f3fb00c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:24:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.279+0000 7f3faffff700 1 --2- 172.21.15.72:0/1634153104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb0064b90 0x7f3fb01407a0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f3fa000ea20 tx=0x7f3fa0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.279+0000 7f3f97fff700 1 -- 172.21.15.72:0/1634153104 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000c850 con 0x7f3fb0064b90 2023-08-31T19:24:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.279+0000 7f3f97fff700 1 -- 172.21.15.72:0/1634153104 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa000c9b0 con 0x7f3fb0064b90 2023-08-31T19:24:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.279+0000 7f3f97fff700 1 -- 172.21.15.72:0/1634153104 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000cd30 con 0x7f3fb0064b90 2023-08-31T19:24:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.279+0000 7f3fb65ff700 1 -- 172.21.15.72:0/1634153104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa40092a0 con 0x7f3fb0064b90 2023-08-31T19:24:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.279+0000 7f3fb65ff700 1 -- 172.21.15.72:0/1634153104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb00acc40 con 0x7f3fb0064b90 2023-08-31T19:24:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.280+0000 7f3fb65ff700 1 -- 172.21.15.72:0/1634153104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb006a7e0 con 0x7f3fb0064b90 2023-08-31T19:24:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.281+0000 7f3f97fff700 1 -- 172.21.15.72:0/1634153104 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 75) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f3fa0012600 con 0x7f3fb0064b90 2023-08-31T19:24:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.282+0000 7f3f97fff700 1 --2- 172.21.15.72:0/1634153104 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3f9c05ef80 0x7f3f9c061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:17.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.282+0000 7f3f97fff700 1 -- 172.21.15.72:0/1634153104 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7237+0+0 (secure 0 0 0) 0x7f3fa007aba0 con 0x7f3fb0064b90 2023-08-31T19:24:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.282+0000 7f3faf7fe700 1 --2- 172.21.15.72:0/1634153104 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3f9c05ef80 0x7f3f9c061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.282+0000 7f3faf7fe700 1 --2- 172.21.15.72:0/1634153104 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3f9c05ef80 0x7f3f9c061440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3fb0154900 tx=0x7f3fa4016000).ready entity=mgr.8769 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:17.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.286+0000 7f3f97fff700 1 -- 172.21.15.72:0/1634153104 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3fa004b970 con 0x7f3fb0064b90 2023-08-31T19:24:17.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.476+0000 7f3fb65ff700 1 -- 172.21.15.72:0/1634153104 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fb006c6b0 con 0x7f3f9c05ef80 2023-08-31T19:24:17.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.477+0000 7f3f97fff700 1 -- 172.21.15.72:0/1634153104 <== mgr.8769 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7f3fb006c6b0 con 0x7f3f9c05ef80 2023-08-31T19:24:17.477 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:17.477 INFO:teuthology.orchestra.run.smithi072.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T19:08:13", "first": "2023-08-31T19:09:00", "last": "2023-08-31T19:24:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-08-31T19:24:17.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.479+0000 7f3fb65ff700 1 -- 172.21.15.72:0/1634153104 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3f9c05ef80 msgr2=0x7f3f9c061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:17.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.479+0000 7f3fb65ff700 1 --2- 172.21.15.72:0/1634153104 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3f9c05ef80 0x7f3f9c061440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f3fb0154900 tx=0x7f3fa4016000).stop 2023-08-31T19:24:17.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.479+0000 7f3fb65ff700 1 -- 172.21.15.72:0/1634153104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb0064b90 msgr2=0x7f3fb01407a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:17.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.479+0000 7f3fb65ff700 1 --2- 172.21.15.72:0/1634153104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb0064b90 0x7f3fb01407a0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f3fa000ea20 tx=0x7f3fa0009060).stop 2023-08-31T19:24:17.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.479+0000 7f3fb65ff700 1 -- 172.21.15.72:0/1634153104 shutdown_connections 2023-08-31T19:24:17.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.479+0000 7f3fb65ff700 1 --2- 172.21.15.72:0/1634153104 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3f9c05ef80 0x7f3f9c061440 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.479+0000 7f3fb65ff700 1 --2- 172.21.15.72:0/1634153104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fb0154500 0x7f3fb00c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.480+0000 7f3fb65ff700 1 --2- 172.21.15.72:0/1634153104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb0064b90 0x7f3fb01407a0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.480+0000 7f3fb65ff700 1 --2- 172.21.15.72:0/1634153104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3fb0154120 0x7f3fb00c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:17.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.480+0000 7f3fb65ff700 1 -- 172.21.15.72:0/1634153104 >> 172.21.15.72:0/1634153104 conn(0x7f3fb00cb7e0 msgr2=0x7f3fb0062b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:17.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.480+0000 7f3fb65ff700 1 -- 172.21.15.72:0/1634153104 shutdown_connections 2023-08-31T19:24:17.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.480+0000 7f3fb65ff700 1 -- 172.21.15.72:0/1634153104 wait complete. 2023-08-31T19:24:17.496 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-31T00:00:00", "created": "2023-08-31T19:08:13", "first": "2023-08-31T19:09:00", "last": "2023-08-31T19:24:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-08-31T19:24:17.496 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-08-31T00:00:00', 'created': '2023-08-31T19:08:13', 'first': '2023-08-31T19:09:00', 'last': '2023-08-31T19:24:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-08-31T19:24:17.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-31T19:24:17.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.690+0000 7fbd1d1ff700 1 Processor -- start 2023-08-31T19:24:17.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.690+0000 7fbd1d1ff700 1 -- start start 2023-08-31T19:24:17.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.691+0000 7fbd1d1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbd18154120 0x7fbd180a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:17.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.691+0000 7fbd1d1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd18154500 0x7fbd180646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:17.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.691+0000 7fbd1d1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd18064b90 0x7fbd180c0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:17.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.691+0000 7fbd1d1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd180aa620 con 0x7fbd18154120 2023-08-31T19:24:17.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.691+0000 7fbd1d1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd18065020 con 0x7fbd18154500 2023-08-31T19:24:17.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.691+0000 7fbd1d1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180aa3a0 con 0x7fbd18064b90 2023-08-31T19:24:17.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.692+0000 7fbd16d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbd18154120 0x7fbd180a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:17.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.692+0000 7fbd16d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbd18154120 0x7fbd180a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57372/0 (socket says 172.21.15.72:57372) 2023-08-31T19:24:17.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.692+0000 7fbd16d9d700 1 -- 172.21.15.72:0/818981070 learned_addr learned my addr 172.21.15.72:0/818981070 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:17.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.692+0000 7fbd1659c700 1 --2- 172.21.15.72:0/818981070 >> v2:172.21.15.146:3300/0 conn(0x7fbd18154500 0x7fbd180646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:17.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.692+0000 7fbd1759e700 1 --2- 172.21.15.72:0/818981070 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd18064b90 0x7fbd180c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:17.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.692+0000 7fbd16d9d700 1 -- 172.21.15.72:0/818981070 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd18064b90 msgr2=0x7fbd180c0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:17.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.692+0000 7fbd16d9d700 1 --2- 172.21.15.72:0/818981070 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd18064b90 0x7fbd180c0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.692+0000 7fbd16d9d700 1 -- 172.21.15.72:0/818981070 >> v2:172.21.15.146:3300/0 conn(0x7fbd18154500 msgr2=0x7fbd180646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:17.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.692+0000 7fbd16d9d700 1 --2- 172.21.15.72:0/818981070 >> v2:172.21.15.146:3300/0 conn(0x7fbd18154500 0x7fbd180646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.692+0000 7fbd16d9d700 1 -- 172.21.15.72:0/818981070 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd180c5450 con 0x7fbd18154120 2023-08-31T19:24:17.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.692+0000 7fbd1659c700 1 --2- 172.21.15.72:0/818981070 >> v2:172.21.15.146:3300/0 conn(0x7fbd18154500 0x7fbd180646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:17.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.692+0000 7fbd16d9d700 1 --2- 172.21.15.72:0/818981070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd18154120 0x7fbd180a9eb0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fbd18061290 tx=0x7fbd080090f0).ready entity=mon.0 client_cookie=2c1852f7b17d5292 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:17.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.692+0000 7fbd15d9b700 1 -- 172.21.15.72:0/818981070 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0800f510 con 0x7fbd18154120 2023-08-31T19:24:17.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.692+0000 7fbd15d9b700 1 -- 172.21.15.72:0/818981070 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0800f670 con 0x7fbd18154120 2023-08-31T19:24:17.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.693+0000 7fbd15d9b700 1 -- 172.21.15.72:0/818981070 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0800fa10 con 0x7fbd18154120 2023-08-31T19:24:17.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.693+0000 7fbd1d1ff700 1 -- 172.21.15.72:0/818981070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd18154120 msgr2=0x7fbd180a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:17.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.693+0000 7fbd1d1ff700 1 --2- 172.21.15.72:0/818981070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd18154120 0x7fbd180a9eb0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fbd18061290 tx=0x7fbd080090f0).stop 2023-08-31T19:24:17.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.693+0000 7fbd1d1ff700 1 -- 172.21.15.72:0/818981070 shutdown_connections 2023-08-31T19:24:17.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.693+0000 7fbd1d1ff700 1 --2- 172.21.15.72:0/818981070 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd18064b90 0x7fbd180c0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.693+0000 7fbd1d1ff700 1 --2- 172.21.15.72:0/818981070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd18154120 0x7fbd180a9eb0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.693+0000 7fbd1d1ff700 1 --2- 172.21.15.72:0/818981070 >> v2:172.21.15.146:3300/0 conn(0x7fbd18154500 0x7fbd180646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.693+0000 7fbd1d1ff700 1 -- 172.21.15.72:0/818981070 >> 172.21.15.72:0/818981070 conn(0x7fbd180cb7e0 msgr2=0x7fbd180c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:17.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.693+0000 7fbd1d1ff700 1 -- 172.21.15.72:0/818981070 shutdown_connections 2023-08-31T19:24:17.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.693+0000 7fbd1d1ff700 1 -- 172.21.15.72:0/818981070 wait complete. 2023-08-31T19:24:17.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.695+0000 7fbd1d1ff700 1 Processor -- start 2023-08-31T19:24:17.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.695+0000 7fbd1d1ff700 1 -- start start 2023-08-31T19:24:17.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd1d1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd18064b90 0x7fbd18156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:17.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd1d1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd18154120 0x7fbd18158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:17.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd1d1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd18154500 0x7fbd18158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:17.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd1d1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180aec70 con 0x7fbd18064b90 2023-08-31T19:24:17.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd1d1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180c46f0 con 0x7fbd18154500 2023-08-31T19:24:17.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd1d1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180ae340 con 0x7fbd18154120 2023-08-31T19:24:17.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd16d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd18064b90 0x7fbd18156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:17.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd16d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd18064b90 0x7fbd18156e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57382/0 (socket says 172.21.15.72:57382) 2023-08-31T19:24:17.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd16d9d700 1 -- 172.21.15.72:0/2061925664 learned_addr learned my addr 172.21.15.72:0/2061925664 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:17.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd1659c700 1 --2- 172.21.15.72:0/2061925664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd18154120 0x7fbd18158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:17.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd1759e700 1 --2- 172.21.15.72:0/2061925664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd18154500 0x7fbd18158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:17.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd16d9d700 1 -- 172.21.15.72:0/2061925664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd18154120 msgr2=0x7fbd18158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:17.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd16d9d700 1 --2- 172.21.15.72:0/2061925664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd18154120 0x7fbd18158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd16d9d700 1 -- 172.21.15.72:0/2061925664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd18154500 msgr2=0x7fbd18158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:17.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd16d9d700 1 --2- 172.21.15.72:0/2061925664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd18154500 0x7fbd18158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.696+0000 7fbd16d9d700 1 -- 172.21.15.72:0/2061925664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c0092a0 con 0x7fbd18064b90 2023-08-31T19:24:17.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.697+0000 7fbd16d9d700 1 --2- 172.21.15.72:0/2061925664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd18064b90 0x7fbd18156e40 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7fbd08006fd0 tx=0x7fbd08017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:17.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.697+0000 7fbcfeffd700 1 -- 172.21.15.72:0/2061925664 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0800fea0 con 0x7fbd18064b90 2023-08-31T19:24:17.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.697+0000 7fbcfeffd700 1 -- 172.21.15.72:0/2061925664 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0800f7e0 con 0x7fbd18064b90 2023-08-31T19:24:17.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.697+0000 7fbd1d1ff700 1 -- 172.21.15.72:0/2061925664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd08009370 con 0x7fbd18064b90 2023-08-31T19:24:17.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.697+0000 7fbcfeffd700 1 -- 172.21.15.72:0/2061925664 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08024470 con 0x7fbd18064b90 2023-08-31T19:24:17.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.697+0000 7fbd1d1ff700 1 -- 172.21.15.72:0/2061925664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd180ae980 con 0x7fbd18064b90 2023-08-31T19:24:17.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.698+0000 7fbd1d1ff700 1 -- 172.21.15.72:0/2061925664 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd180aef50 con 0x7fbd18064b90 2023-08-31T19:24:17.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.699+0000 7fbcfeffd700 1 -- 172.21.15.72:0/2061925664 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 75) v1 ==== 75403+0+0 (secure 0 0 0) 0x7fbd08021070 con 0x7fbd18064b90 2023-08-31T19:24:17.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.700+0000 7fbcfeffd700 1 --2- 172.21.15.72:0/2061925664 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fbd0405ef80 0x7fbd04061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:17.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.700+0000 7fbcfeffd700 1 -- 172.21.15.72:0/2061925664 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7237+0+0 (secure 0 0 0) 0x7fbd0807bf20 con 0x7fbd18064b90 2023-08-31T19:24:17.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.700+0000 7fbd1659c700 1 --2- 172.21.15.72:0/2061925664 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fbd0405ef80 0x7fbd04061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:17.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.700+0000 7fbd1659c700 1 --2- 172.21.15.72:0/2061925664 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fbd0405ef80 0x7fbd04061440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fbd0c009270 tx=0x7fbd0c008040).ready entity=mgr.8769 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:17.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.704+0000 7fbcfeffd700 1 -- 172.21.15.72:0/2061925664 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbd0804ccf0 con 0x7fbd18064b90 2023-08-31T19:24:17.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.899+0000 7fbd1d1ff700 1 -- 172.21.15.72:0/2061925664 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd180aedb0 con 0x7fbd0405ef80 2023-08-31T19:24:17.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.903+0000 7fbcfeffd700 1 -- 172.21.15.72:0/2061925664 <== mgr.8769 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7fbd0c009900 con 0x7fbd0405ef80 2023-08-31T19:24:17.902 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-08-31T19:24:17.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.905+0000 7fbd1d1ff700 1 -- 172.21.15.72:0/2061925664 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fbd0405ef80 msgr2=0x7fbd04061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:17.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.905+0000 7fbd1d1ff700 1 --2- 172.21.15.72:0/2061925664 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fbd0405ef80 0x7fbd04061440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fbd0c009270 tx=0x7fbd0c008040).stop 2023-08-31T19:24:17.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.905+0000 7fbd1d1ff700 1 -- 172.21.15.72:0/2061925664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd18064b90 msgr2=0x7fbd18156e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:17.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.905+0000 7fbd1d1ff700 1 --2- 172.21.15.72:0/2061925664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd18064b90 0x7fbd18156e40 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7fbd08006fd0 tx=0x7fbd08017000).stop 2023-08-31T19:24:17.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.905+0000 7fbd1d1ff700 1 -- 172.21.15.72:0/2061925664 shutdown_connections 2023-08-31T19:24:17.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.905+0000 7fbd1d1ff700 1 --2- 172.21.15.72:0/2061925664 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fbd0405ef80 0x7fbd04061440 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.905+0000 7fbd1d1ff700 1 --2- 172.21.15.72:0/2061925664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd18154500 0x7fbd18158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.905+0000 7fbd1d1ff700 1 --2- 172.21.15.72:0/2061925664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd18064b90 0x7fbd18156e40 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.905+0000 7fbd1d1ff700 1 --2- 172.21.15.72:0/2061925664 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fbd18154120 0x7fbd18158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:17.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.905+0000 7fbd1d1ff700 1 -- 172.21.15.72:0/2061925664 >> 172.21.15.72:0/2061925664 conn(0x7fbd180cb7e0 msgr2=0x7fbd180ac720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:17.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.905+0000 7fbd1d1ff700 1 -- 172.21.15.72:0/2061925664 shutdown_connections 2023-08-31T19:24:17.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:17.905+0000 7fbd1d1ff700 1 -- 172.21.15.72:0/2061925664 wait complete. 2023-08-31T19:24:17.921 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-08-31T19:24:17.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:17.922 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-08-31T19:24:17.970 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_09_00_UTC 2023-08-31T19:24:17.970 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_10_00_UTC 2023-08-31T19:24:17.970 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_11_00_UTC 2023-08-31T19:24:17.971 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_12_00_UTC 2023-08-31T19:24:17.971 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_13_00_UTC 2023-08-31T19:24:17.971 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_14_00_UTC 2023-08-31T19:24:17.971 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_15_00_UTC 2023-08-31T19:24:17.971 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_16_00_UTC 2023-08-31T19:24:17.972 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_17_00_UTC 2023-08-31T19:24:17.972 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_18_00_UTC 2023-08-31T19:24:17.972 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_19_00_UTC 2023-08-31T19:24:17.972 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_20_00_UTC 2023-08-31T19:24:17.972 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_21_00_UTC 2023-08-31T19:24:17.972 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_22_00_UTC 2023-08-31T19:24:17.973 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_23_00_UTC 2023-08-31T19:24:17.973 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_24_00_UTC 2023-08-31T19:24:17.974 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_09_00_UTC 2023-08-31T19:24:17.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:17.975 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_09_00_UTC) 2023-08-31T19:24:18.028 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_10_00_UTC 2023-08-31T19:24:18.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.029 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_10_00_UTC) 2023-08-31T19:24:18.082 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_11_00_UTC 2023-08-31T19:24:18.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.083 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_11_00_UTC) 2023-08-31T19:24:18.136 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_12_00_UTC 2023-08-31T19:24:18.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.137 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_12_00_UTC) 2023-08-31T19:24:18.191 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_13_00_UTC 2023-08-31T19:24:18.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.191 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_13_00_UTC) 2023-08-31T19:24:18.245 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_14_00_UTC 2023-08-31T19:24:18.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.246 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_14_00_UTC) 2023-08-31T19:24:18.299 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_15_00_UTC 2023-08-31T19:24:18.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.300 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_15_00_UTC) 2023-08-31T19:24:18.353 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_16_00_UTC 2023-08-31T19:24:18.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.354 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_16_00_UTC) 2023-08-31T19:24:18.406 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_17_00_UTC 2023-08-31T19:24:18.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.407 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_17_00_UTC) 2023-08-31T19:24:18.462 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_18_00_UTC 2023-08-31T19:24:18.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.463 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_18_00_UTC) 2023-08-31T19:24:18.516 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_19_00_UTC 2023-08-31T19:24:18.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.517 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_19_00_UTC) 2023-08-31T19:24:18.572 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_20_00_UTC 2023-08-31T19:24:18.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.573 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_20_00_UTC) 2023-08-31T19:24:18.625 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_21_00_UTC 2023-08-31T19:24:18.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.626 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_21_00_UTC) 2023-08-31T19:24:18.678 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_22_00_UTC 2023-08-31T19:24:18.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.679 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_22_00_UTC) 2023-08-31T19:24:18.732 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_23_00_UTC 2023-08-31T19:24:18.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.747 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_23_00_UTC) 2023-08-31T19:24:18.800 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_24_00_UTC 2023-08-31T19:24:18.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.800 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-31-19_24_00_UTC) 2023-08-31T19:24:18.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:18.854 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-08-31T19:24:18.903 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-31T19:24:19.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.094+0000 7f274b1ff700 1 Processor -- start 2023-08-31T19:24:19.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.094+0000 7f274b1ff700 1 -- start start 2023-08-31T19:24:19.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.096+0000 7f274b1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2744154030 0x7f2744154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:19.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.096+0000 7f274b1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27440c6ed0 con 0x7f27440c06b0 2023-08-31T19:24:19.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.096+0000 7f274b1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27440c68c0 con 0x7f27440c7360 2023-08-31T19:24:19.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.096+0000 7f274b1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27440c66e0 con 0x7f2744154030 2023-08-31T19:24:19.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.096+0000 7f2748f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2744154030 0x7f2744154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:19.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.096+0000 7f2748f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2744154030 0x7f2744154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57384/0 (socket says 172.21.15.72:57384) 2023-08-31T19:24:19.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.096+0000 7f2748f9b700 1 -- 172.21.15.72:0/3060093199 learned_addr learned my addr 172.21.15.72:0/3060093199 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:19.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.096+0000 7f2743fff700 1 --1- 172.21.15.72:0/3060093199 >> v1:172.21.15.72:6789/0 conn(0x7f27440c06b0 0x7f27440aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36792/0 (socket says 172.21.15.72:36792) 2023-08-31T19:24:19.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.097+0000 7f2748f9b700 1 -- 172.21.15.72:0/3060093199 >> v1:172.21.15.146:6789/0 conn(0x7f27440c7360 legacy=0x7f2744063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:19.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.097+0000 7f2748f9b700 1 -- 172.21.15.72:0/3060093199 >> v1:172.21.15.72:6789/0 conn(0x7f27440c06b0 legacy=0x7f27440aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:19.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.097+0000 7f2748f9b700 1 -- 172.21.15.72:0/3060093199 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27440c0f30 con 0x7f2744154030 2023-08-31T19:24:19.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.097+0000 7f2748f9b700 1 --2- 172.21.15.72:0/3060093199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2744154030 0x7f2744154410 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f2738006fd0 tx=0x7f27380090f0).ready entity=mon.0 client_cookie=7a65323529f3a9d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:19.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.097+0000 7f27437fe700 1 -- 172.21.15.72:0/3060093199 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800b600 con 0x7f2744154030 2023-08-31T19:24:19.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.097+0000 7f27437fe700 1 -- 172.21.15.72:0/3060093199 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273800b760 con 0x7f2744154030 2023-08-31T19:24:19.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.097+0000 7f27437fe700 1 -- 172.21.15.72:0/3060093199 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800bb00 con 0x7f2744154030 2023-08-31T19:24:19.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.098+0000 7f274b1ff700 1 -- 172.21.15.72:0/3060093199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2744154030 msgr2=0x7f2744154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:19.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.098+0000 7f274b1ff700 1 --2- 172.21.15.72:0/3060093199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2744154030 0x7f2744154410 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f2738006fd0 tx=0x7f27380090f0).stop 2023-08-31T19:24:19.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.098+0000 7f274b1ff700 1 -- 172.21.15.72:0/3060093199 shutdown_connections 2023-08-31T19:24:19.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.098+0000 7f274b1ff700 1 --2- 172.21.15.72:0/3060093199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2744154030 0x7f2744154410 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:19.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.098+0000 7f274b1ff700 1 -- 172.21.15.72:0/3060093199 >> 172.21.15.72:0/3060093199 conn(0x7f274405eb60 msgr2=0x7f27440cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:19.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.098+0000 7f274b1ff700 1 -- 172.21.15.72:0/3060093199 shutdown_connections 2023-08-31T19:24:19.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.098+0000 7f274b1ff700 1 -- 172.21.15.72:0/3060093199 wait complete. 2023-08-31T19:24:19.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.099+0000 7f274b1ff700 1 Processor -- start 2023-08-31T19:24:19.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.099+0000 7f274b1ff700 1 -- start start 2023-08-31T19:24:19.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.100+0000 7f274b1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27440c06b0 0x7f27440a23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:19.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.100+0000 7f274b1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27440c7360 0x7f2744164720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:19.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.100+0000 7f274b1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2744154030 0x7f274414fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:19.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.100+0000 7f274b1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2744164c10 con 0x7f27440c06b0 2023-08-31T19:24:19.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.100+0000 7f274b1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27440afc60 con 0x7f2744154030 2023-08-31T19:24:19.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.100+0000 7f274b1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27440af370 con 0x7f27440c7360 2023-08-31T19:24:19.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.101+0000 7f2748f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27440c06b0 0x7f27440a23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:19.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.101+0000 7f2748f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27440c06b0 0x7f27440a23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57386/0 (socket says 172.21.15.72:57386) 2023-08-31T19:24:19.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.101+0000 7f2748f9b700 1 -- 172.21.15.72:0/3356471263 learned_addr learned my addr 172.21.15.72:0/3356471263 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:19.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.101+0000 7f2748f9b700 1 -- 172.21.15.72:0/3356471263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27440c7360 msgr2=0x7f2744164720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:19.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.101+0000 7f2748f9b700 1 --2- 172.21.15.72:0/3356471263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27440c7360 0x7f2744164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:19.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.101+0000 7f2748f9b700 1 -- 172.21.15.72:0/3356471263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2744154030 msgr2=0x7f274414fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:19.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.101+0000 7f2748f9b700 1 --2- 172.21.15.72:0/3356471263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2744154030 0x7f274414fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:19.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.101+0000 7f2748f9b700 1 -- 172.21.15.72:0/3356471263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2738009370 con 0x7f27440c06b0 2023-08-31T19:24:19.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.101+0000 7f2748f9b700 1 --2- 172.21.15.72:0/3356471263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27440c06b0 0x7f27440a23d0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f2738009f50 tx=0x7f2738017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:19.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.101+0000 7f2740ff9700 1 -- 172.21.15.72:0/3356471263 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800b8d0 con 0x7f27440c06b0 2023-08-31T19:24:19.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.101+0000 7f2740ff9700 1 -- 172.21.15.72:0/3356471263 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273800ba30 con 0x7f27440c06b0 2023-08-31T19:24:19.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.102+0000 7f274b1ff700 1 -- 172.21.15.72:0/3356471263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27440a2970 con 0x7f27440c06b0 2023-08-31T19:24:19.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.102+0000 7f2740ff9700 1 -- 172.21.15.72:0/3356471263 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738025420 con 0x7f27440c06b0 2023-08-31T19:24:19.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.102+0000 7f274b1ff700 1 -- 172.21.15.72:0/3356471263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27440af8f0 con 0x7f27440c06b0 2023-08-31T19:24:19.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.103+0000 7f274b1ff700 1 -- 172.21.15.72:0/3356471263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274406c6b0 con 0x7f27440c06b0 2023-08-31T19:24:19.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.103+0000 7f2740ff9700 1 -- 172.21.15.72:0/3356471263 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 75) v1 ==== 75403+0+0 (secure 0 0 0) 0x7f2738022020 con 0x7f27440c06b0 2023-08-31T19:24:19.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.104+0000 7f2740ff9700 1 --2- 172.21.15.72:0/3356471263 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f272805ef80 0x7f2728061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:19.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.104+0000 7f2740ff9700 1 -- 172.21.15.72:0/3356471263 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7237+0+0 (secure 0 0 0) 0x7f273807be70 con 0x7f27440c06b0 2023-08-31T19:24:19.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.105+0000 7f2743fff700 1 --2- 172.21.15.72:0/3356471263 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f272805ef80 0x7f2728061440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:19.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.105+0000 7f2743fff700 1 --2- 172.21.15.72:0/3356471263 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f272805ef80 0x7f2728061440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f27440af320 tx=0x7f27300079b0).ready entity=mgr.8769 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:19.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.108+0000 7f2740ff9700 1 -- 172.21.15.72:0/3356471263 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f273804cc40 con 0x7f27440c06b0 2023-08-31T19:24:19.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.320+0000 7f274b1ff700 1 -- 172.21.15.72:0/3356471263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f27440c0c50 con 0x7f27440c06b0 2023-08-31T19:24:19.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.963+0000 7f2740ff9700 1 -- 172.21.15.72:0/3356471263 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 76) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f27380795a0 con 0x7f27440c06b0 2023-08-31T19:24:19.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.964+0000 7f2740ff9700 1 -- 172.21.15.72:0/3356471263 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v76) v1 ==== 93+0+0 (secure 0 0 0) 0x7f2738041a40 con 0x7f27440c06b0 2023-08-31T19:24:19.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.967+0000 7f274b1ff700 1 -- 172.21.15.72:0/3356471263 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f272805ef80 msgr2=0x7f2728061440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:19.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.967+0000 7f274b1ff700 1 --2- 172.21.15.72:0/3356471263 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f272805ef80 0x7f2728061440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f27440af320 tx=0x7f27300079b0).stop 2023-08-31T19:24:19.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.967+0000 7f274b1ff700 1 -- 172.21.15.72:0/3356471263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27440c06b0 msgr2=0x7f27440a23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:19.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.967+0000 7f274b1ff700 1 --2- 172.21.15.72:0/3356471263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27440c06b0 0x7f27440a23d0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f2738009f50 tx=0x7f2738017000).stop 2023-08-31T19:24:19.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.967+0000 7f274b1ff700 1 -- 172.21.15.72:0/3356471263 shutdown_connections 2023-08-31T19:24:19.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.967+0000 7f274b1ff700 1 --2- 172.21.15.72:0/3356471263 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f272805ef80 0x7f2728061440 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:19.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.967+0000 7f274b1ff700 1 --2- 172.21.15.72:0/3356471263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2744154030 0x7f274414fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:19.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.967+0000 7f274b1ff700 1 --2- 172.21.15.72:0/3356471263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27440c06b0 0x7f27440a23d0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:19.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.967+0000 7f274b1ff700 1 --2- 172.21.15.72:0/3356471263 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27440c7360 0x7f2744164720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:19.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.967+0000 7f274b1ff700 1 -- 172.21.15.72:0/3356471263 >> 172.21.15.72:0/3356471263 conn(0x7f274405eb60 msgr2=0x7f2744153240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:19.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.967+0000 7f274b1ff700 1 -- 172.21.15.72:0/3356471263 shutdown_connections 2023-08-31T19:24:19.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:19.967+0000 7f274b1ff700 1 -- 172.21.15.72:0/3356471263 wait complete. 2023-08-31T19:24:19.985 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:24:19.986 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:24:20.100 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:24:20.179 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:20.178+0000 7ff1a326c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:24:20.181 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:20.181+0000 7ff03a3bf680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:24:20.203 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:24:20.204 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-31T19:24:20.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:20.205 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-31T19:24:20.260 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:20.259+0000 7ff1a326c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:24:20.262 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:20.262+0000 7ff03a3bf680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:24:20.295 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T19:24:20.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:24:20.296 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T19:24:20.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:24:20.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.537+0000 7fc6cd9ff700 1 Processor -- start 2023-08-31T19:24:20.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.537+0000 7fc6cd9ff700 1 -- start start 2023-08-31T19:24:20.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.538+0000 7fc6cd9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6c80c6c30 0x7fc6c80bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:20.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.538+0000 7fc6cd9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6c81583f0 0x7fc6c80c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:20.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.538+0000 7fc6cd9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c8063be0 con 0x7fc6c80c4740 2023-08-31T19:24:20.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.538+0000 7fc6cd9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c8063010 con 0x7fc6c80c6c30 2023-08-31T19:24:20.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.538+0000 7fc6cd9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80632b0 con 0x7fc6c81583f0 2023-08-31T19:24:20.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.539+0000 7fc6c6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6c80c6c30 0x7fc6c80bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:20.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.539+0000 7fc6c6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6c80c6c30 0x7fc6c80bc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57404/0 (socket says 172.21.15.72:57404) 2023-08-31T19:24:20.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.539+0000 7fc6c6ffd700 1 -- 172.21.15.72:0/2405813690 learned_addr learned my addr 172.21.15.72:0/2405813690 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:20.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.539+0000 7fc6c77fe700 1 --2- 172.21.15.72:0/2405813690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6c81583f0 0x7fc6c80c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:20.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.539+0000 7fc6c6ffd700 1 -- 172.21.15.72:0/2405813690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6c81583f0 msgr2=0x7fc6c80c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:20.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.539+0000 7fc6c6ffd700 1 --2- 172.21.15.72:0/2405813690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6c81583f0 0x7fc6c80c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:20.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.539+0000 7fc6c6ffd700 1 -- 172.21.15.72:0/2405813690 >> v1:172.21.15.146:6789/0 conn(0x7fc6c80c4740 legacy=0x7fc6c8157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:20.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.539+0000 7fc6c6ffd700 1 -- 172.21.15.72:0/2405813690 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c8063590 con 0x7fc6c80c6c30 2023-08-31T19:24:20.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.539+0000 7fc6c5ffb700 1 -- 172.21.15.72:0/2405813690 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297386019 0 0) 0x7fc6c8063be0 con 0x7fc6c80c4740 2023-08-31T19:24:20.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.539+0000 7fc6c6ffd700 1 --2- 172.21.15.72:0/2405813690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c80c6c30 0x7fc6c80bc300 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7fc6b8006fd0 tx=0x7fc6b80090f0).ready entity=mon.0 client_cookie=71c5a32805a05e82 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:20.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.540+0000 7fc6c5ffb700 1 -- 172.21.15.72:0/2405813690 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b800b580 con 0x7fc6c80c6c30 2023-08-31T19:24:20.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.540+0000 7fc6c5ffb700 1 -- 172.21.15.72:0/2405813690 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b800b6e0 con 0x7fc6c80c6c30 2023-08-31T19:24:20.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.540+0000 7fc6c5ffb700 1 -- 172.21.15.72:0/2405813690 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b800ba60 con 0x7fc6c80c6c30 2023-08-31T19:24:20.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.540+0000 7fc6cd9ff700 1 -- 172.21.15.72:0/2405813690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c80c6c30 msgr2=0x7fc6c80bc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:20.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.540+0000 7fc6cd9ff700 1 --2- 172.21.15.72:0/2405813690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c80c6c30 0x7fc6c80bc300 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7fc6b8006fd0 tx=0x7fc6b80090f0).stop 2023-08-31T19:24:20.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.540+0000 7fc6cd9ff700 1 -- 172.21.15.72:0/2405813690 shutdown_connections 2023-08-31T19:24:20.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.540+0000 7fc6cd9ff700 1 --2- 172.21.15.72:0/2405813690 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6c81583f0 0x7fc6c80c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:20.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.540+0000 7fc6cd9ff700 1 --2- 172.21.15.72:0/2405813690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c80c6c30 0x7fc6c80bc300 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:20.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.540+0000 7fc6cd9ff700 1 -- 172.21.15.72:0/2405813690 >> 172.21.15.72:0/2405813690 conn(0x7fc6c80c7e70 msgr2=0x7fc6c80c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:20.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.540+0000 7fc6cd9ff700 1 -- 172.21.15.72:0/2405813690 shutdown_connections 2023-08-31T19:24:20.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.541+0000 7fc6cd9ff700 1 -- 172.21.15.72:0/2405813690 wait complete. 2023-08-31T19:24:20.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.542+0000 7fc6cd9ff700 1 Processor -- start 2023-08-31T19:24:20.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.542+0000 7fc6cd9ff700 1 -- start start 2023-08-31T19:24:20.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.543+0000 7fc6cd9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c80c4740 0x7fc6c81379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:20.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.543+0000 7fc6cd9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c80c6c30 0x7fc6c8136d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:20.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.543+0000 7fc6cd9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6c81583f0 0x7fc6c8153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:20.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.543+0000 7fc6cd9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8137e90 con 0x7fc6c80c4740 2023-08-31T19:24:20.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.543+0000 7fc6cd9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80ac100 con 0x7fc6c80c6c30 2023-08-31T19:24:20.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.543+0000 7fc6cd9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80ab840 con 0x7fc6c81583f0 2023-08-31T19:24:20.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.543+0000 7fc6c6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c80c4740 0x7fc6c81379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:20.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.543+0000 7fc6c6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c80c4740 0x7fc6c81379a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57414/0 (socket says 172.21.15.72:57414) 2023-08-31T19:24:20.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.543+0000 7fc6c6ffd700 1 -- 172.21.15.72:0/3903306155 learned_addr learned my addr 172.21.15.72:0/3903306155 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:20.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.543+0000 7fc6c67fc700 1 --2- 172.21.15.72:0/3903306155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c80c6c30 0x7fc6c8136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:20.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.543+0000 7fc6c77fe700 1 --2- 172.21.15.72:0/3903306155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6c81583f0 0x7fc6c8153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:20.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.544+0000 7fc6c6ffd700 1 -- 172.21.15.72:0/3903306155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6c81583f0 msgr2=0x7fc6c8153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:20.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.544+0000 7fc6c6ffd700 1 --2- 172.21.15.72:0/3903306155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6c81583f0 0x7fc6c8153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:20.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.544+0000 7fc6c6ffd700 1 -- 172.21.15.72:0/3903306155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c80c6c30 msgr2=0x7fc6c8136d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:20.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.544+0000 7fc6c6ffd700 1 --2- 172.21.15.72:0/3903306155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c80c6c30 0x7fc6c8136d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:20.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.544+0000 7fc6c6ffd700 1 -- 172.21.15.72:0/3903306155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b8009370 con 0x7fc6c80c4740 2023-08-31T19:24:20.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.544+0000 7fc6c77fe700 1 --2- 172.21.15.72:0/3903306155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6c81583f0 0x7fc6c8153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:20.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.544+0000 7fc6c6ffd700 1 --2- 172.21.15.72:0/3903306155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c80c4740 0x7fc6c81379a0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7fc6b8002f90 tx=0x7fc6b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:20.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.544+0000 7fc6aeffd700 1 -- 172.21.15.72:0/3903306155 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8000bc0 con 0x7fc6c80c4740 2023-08-31T19:24:20.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.544+0000 7fc6aeffd700 1 -- 172.21.15.72:0/3903306155 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b800b850 con 0x7fc6c80c4740 2023-08-31T19:24:20.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.544+0000 7fc6cd9ff700 1 -- 172.21.15.72:0/3903306155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c80abab0 con 0x7fc6c80c4740 2023-08-31T19:24:20.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.544+0000 7fc6aeffd700 1 -- 172.21.15.72:0/3903306155 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8000d20 con 0x7fc6c80c4740 2023-08-31T19:24:20.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.545+0000 7fc6cd9ff700 1 -- 172.21.15.72:0/3903306155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c80ab220 con 0x7fc6c80c4740 2023-08-31T19:24:20.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.546+0000 7fc6cd9ff700 1 -- 172.21.15.72:0/3903306155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c806c6b0 con 0x7fc6c80c4740 2023-08-31T19:24:20.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.546+0000 7fc6aeffd700 1 -- 172.21.15.72:0/3903306155 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 76) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fc6b801c880 con 0x7fc6c80c4740 2023-08-31T19:24:20.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.548+0000 7fc6aeffd700 1 --2- 172.21.15.72:0/3903306155 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc6b405ef30 0x7fc6b40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:20.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.548+0000 7fc6c67fc700 1 -- 172.21.15.72:0/3903306155 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc6b405ef30 msgr2=0x7fc6b40613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:20.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.548+0000 7fc6aeffd700 1 -- 172.21.15.72:0/3903306155 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7237+0+0 (secure 0 0 0) 0x7fc6b807bff0 con 0x7fc6c80c4740 2023-08-31T19:24:20.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.548+0000 7fc6c67fc700 1 --2- 172.21.15.72:0/3903306155 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc6b405ef30 0x7fc6b40613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:24:20.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.552+0000 7fc6aeffd700 1 -- 172.21.15.72:0/3903306155 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc6b804ce20 con 0x7fc6c80c4740 2023-08-31T19:24:20.588 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:20.587+0000 7ff1a326c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:24:20.611 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:20.611+0000 7ff03a3bf680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:24:20.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.749+0000 7fc6c67fc700 1 -- 172.21.15.72:0/3903306155 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc6b405ef30 msgr2=0x7fc6b40613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:20.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.749+0000 7fc6c67fc700 1 --2- 172.21.15.72:0/3903306155 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc6b405ef30 0x7fc6b40613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:24:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.770+0000 7fc6cd9ff700 1 -- 172.21.15.72:0/3903306155 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6c8154120 con 0x7fc6c80c4740 2023-08-31T19:24:20.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.771+0000 7fc6aeffd700 1 -- 172.21.15.72:0/3903306155 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fc6b802a020 con 0x7fc6c80c4740 2023-08-31T19:24:20.771 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:20.771 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6926,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2210268438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2210268438},{"type":"v1","addr":"172.21.15.72:6836","nonce":2210268438}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3842453419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3842453419},{"type":"v1","addr":"172.21.15.146:6834","nonce":3842453419}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/282510582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":282510582},{"type":"v1","addr":"172.21.15.146:6835","nonce":282510582}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:07:57.873694+0000","modified":"2023-08-31T19:08:00.883204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8487":{"gid":8487,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3274545863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3274545863},{"type":"v1","addr":"172.21.15.72:6837","nonce":3274545863}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-31T19:24:20.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.773+0000 7fc6cd9ff700 1 -- 172.21.15.72:0/3903306155 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc6b405ef30 msgr2=0x7fc6b40613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:24:20.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.773+0000 7fc6cd9ff700 1 --2- 172.21.15.72:0/3903306155 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc6b405ef30 0x7fc6b40613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:20.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.773+0000 7fc6cd9ff700 1 -- 172.21.15.72:0/3903306155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c80c4740 msgr2=0x7fc6c81379a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:20.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.773+0000 7fc6cd9ff700 1 --2- 172.21.15.72:0/3903306155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c80c4740 0x7fc6c81379a0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7fc6b8002f90 tx=0x7fc6b8017000).stop 2023-08-31T19:24:20.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.773+0000 7fc6cd9ff700 1 -- 172.21.15.72:0/3903306155 shutdown_connections 2023-08-31T19:24:20.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.773+0000 7fc6cd9ff700 1 --2- 172.21.15.72:0/3903306155 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc6b405ef30 0x7fc6b40613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:20.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.773+0000 7fc6cd9ff700 1 --2- 172.21.15.72:0/3903306155 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6c81583f0 0x7fc6c8153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.773+0000 7fc6cd9ff700 1 --2- 172.21.15.72:0/3903306155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c80c4740 0x7fc6c81379a0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.773+0000 7fc6cd9ff700 1 --2- 172.21.15.72:0/3903306155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6c80c6c30 0x7fc6c8136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.773+0000 7fc6cd9ff700 1 -- 172.21.15.72:0/3903306155 >> 172.21.15.72:0/3903306155 conn(0x7fc6c80c7e70 msgr2=0x7fc6c80689d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.773+0000 7fc6cd9ff700 1 -- 172.21.15.72:0/3903306155 shutdown_connections 2023-08-31T19:24:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.773+0000 7fc6cd9ff700 1 -- 172.21.15.72:0/3903306155 wait complete. 2023-08-31T19:24:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 71 2023-08-31T19:24:20.791 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:24:20.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.984+0000 7fe1b2fff700 1 Processor -- start 2023-08-31T19:24:20.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.984+0000 7fe1b2fff700 1 -- start start 2023-08-31T19:24:20.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.985+0000 7fe1b2fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1ac0c1a40 0x7fe1ac15efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:20.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.985+0000 7fe1b2fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac0bfd00 con 0x7fe1ac0aa290 2023-08-31T19:24:20.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.985+0000 7fe1b2fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac0c05a0 con 0x7fe1ac0a9eb0 2023-08-31T19:24:20.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.985+0000 7fe1b2fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0aaea0 con 0x7fe1ac0c1a40 2023-08-31T19:24:20.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.986+0000 7fe1abfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe1ac0aa290 0x7fe1ac156fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36810/0 (socket says 172.21.15.72:36810) 2023-08-31T19:24:20.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.986+0000 7fe1abfff700 1 -- 172.21.15.72:0/3146600801 learned_addr learned my addr 172.21.15.72:0/3146600801 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:20.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.986+0000 7fe1b159c700 1 --2- 172.21.15.72:0/3146600801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1ac0c1a40 0x7fe1ac15efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:20.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.986+0000 7fe1ab7fe700 1 -- 172.21.15.72:0/3146600801 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195309811 0 0) 0x7fe1ac0bfd00 con 0x7fe1ac0aa290 2023-08-31T19:24:20.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.986+0000 7fe1ab7fe700 1 -- 172.21.15.72:0/3146600801 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe19c0033f0 con 0x7fe1ac0aa290 2023-08-31T19:24:20.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.986+0000 7fe1ab7fe700 1 -- 172.21.15.72:0/3146600801 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989169177 0 0) 0x7fe1ac0c05a0 con 0x7fe1ac0a9eb0 2023-08-31T19:24:20.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.986+0000 7fe1b159c700 1 -- 172.21.15.72:0/3146600801 >> v1:172.21.15.146:6789/0 conn(0x7fe1ac0a9eb0 legacy=0x7fe1ac0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:20.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.986+0000 7fe1b159c700 1 -- 172.21.15.72:0/3146600801 >> v1:172.21.15.72:6789/0 conn(0x7fe1ac0aa290 legacy=0x7fe1ac156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:20.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.986+0000 7fe1b159c700 1 -- 172.21.15.72:0/3146600801 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac0c6670 con 0x7fe1ac0c1a40 2023-08-31T19:24:20.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.986+0000 7fe1b159c700 1 --2- 172.21.15.72:0/3146600801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1ac0c1a40 0x7fe1ac15efb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fe1a4009e90 tx=0x7fe1a4009780).ready entity=mon.2 client_cookie=e0b86dcdd5839e8b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:20.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.987+0000 7fe1ab7fe700 1 -- 172.21.15.72:0/3146600801 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400e070 con 0x7fe1ac0c1a40 2023-08-31T19:24:20.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.987+0000 7fe1ab7fe700 1 -- 172.21.15.72:0/3146600801 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a400bb60 con 0x7fe1ac0c1a40 2023-08-31T19:24:20.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.987+0000 7fe1ab7fe700 1 -- 172.21.15.72:0/3146600801 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400bee0 con 0x7fe1ac0c1a40 2023-08-31T19:24:20.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.987+0000 7fe1b2fff700 1 -- 172.21.15.72:0/3146600801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1ac0c1a40 msgr2=0x7fe1ac15efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:20.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.987+0000 7fe1b2fff700 1 --2- 172.21.15.72:0/3146600801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1ac0c1a40 0x7fe1ac15efb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fe1a4009e90 tx=0x7fe1a4009780).stop 2023-08-31T19:24:20.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.987+0000 7fe1b2fff700 1 -- 172.21.15.72:0/3146600801 shutdown_connections 2023-08-31T19:24:20.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.987+0000 7fe1b2fff700 1 --2- 172.21.15.72:0/3146600801 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1ac0c1a40 0x7fe1ac15efb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:20.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.987+0000 7fe1b2fff700 1 -- 172.21.15.72:0/3146600801 >> 172.21.15.72:0/3146600801 conn(0x7fe1ac0c82e0 msgr2=0x7fe1ac05e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:20.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.987+0000 7fe1b2fff700 1 -- 172.21.15.72:0/3146600801 shutdown_connections 2023-08-31T19:24:20.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.987+0000 7fe1b2fff700 1 -- 172.21.15.72:0/3146600801 wait complete. 2023-08-31T19:24:20.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.989+0000 7fe1b2fff700 1 Processor -- start 2023-08-31T19:24:20.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.989+0000 7fe1b2fff700 1 -- start start 2023-08-31T19:24:20.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.990+0000 7fe1b2fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1ac0a9eb0 0x7fe1ac1577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:20.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.990+0000 7fe1b2fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac0aa290 0x7fe1ac164960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:20.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.990+0000 7fe1b2fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1ac0c1a40 0x7fe1ac167600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:20.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.990+0000 7fe1b2fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac164e50 con 0x7fe1ac0a9eb0 2023-08-31T19:24:20.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.990+0000 7fe1b2fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac165900 con 0x7fe1ac0aa290 2023-08-31T19:24:20.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.990+0000 7fe1b2fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac165060 con 0x7fe1ac0c1a40 2023-08-31T19:24:20.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.990+0000 7fe1b0d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1ac0a9eb0 0x7fe1ac1577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:20.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.990+0000 7fe1b0d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1ac0a9eb0 0x7fe1ac1577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57422/0 (socket says 172.21.15.72:57422) 2023-08-31T19:24:20.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.990+0000 7fe1b0d9b700 1 -- 172.21.15.72:0/3703710941 learned_addr learned my addr 172.21.15.72:0/3703710941 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:20.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.990+0000 7fe1b159c700 1 --2- 172.21.15.72:0/3703710941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1ac0c1a40 0x7fe1ac167600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:20.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.990+0000 7fe1abfff700 1 --2- 172.21.15.72:0/3703710941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac0aa290 0x7fe1ac164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:20.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.991+0000 7fe1b0d9b700 1 -- 172.21.15.72:0/3703710941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1ac0c1a40 msgr2=0x7fe1ac167600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:20.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.991+0000 7fe1b0d9b700 1 --2- 172.21.15.72:0/3703710941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1ac0c1a40 0x7fe1ac167600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:20.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.991+0000 7fe1b0d9b700 1 -- 172.21.15.72:0/3703710941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac0aa290 msgr2=0x7fe1ac164960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:20.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.991+0000 7fe1b0d9b700 1 --2- 172.21.15.72:0/3703710941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac0aa290 0x7fe1ac164960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:20.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.991+0000 7fe1b0d9b700 1 -- 172.21.15.72:0/3703710941 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a4009a20 con 0x7fe1ac0a9eb0 2023-08-31T19:24:20.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.991+0000 7fe1b0d9b700 1 --2- 172.21.15.72:0/3703710941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1ac0a9eb0 0x7fe1ac1577a0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7fe1a0001eb0 tx=0x7fe1a0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:20.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.991+0000 7fe1a8ff9700 1 -- 172.21.15.72:0/3703710941 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a000ce60 con 0x7fe1ac0a9eb0 2023-08-31T19:24:20.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.991+0000 7fe1b2fff700 1 -- 172.21.15.72:0/3703710941 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac165340 con 0x7fe1ac0a9eb0 2023-08-31T19:24:20.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.991+0000 7fe1a8ff9700 1 -- 172.21.15.72:0/3703710941 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a000f470 con 0x7fe1ac0a9eb0 2023-08-31T19:24:20.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.991+0000 7fe1a8ff9700 1 -- 172.21.15.72:0/3703710941 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a000f810 con 0x7fe1ac0a9eb0 2023-08-31T19:24:20.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.991+0000 7fe1b2fff700 1 -- 172.21.15.72:0/3703710941 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac158cc0 con 0x7fe1ac0a9eb0 2023-08-31T19:24:20.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.993+0000 7fe1b2fff700 1 -- 172.21.15.72:0/3703710941 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac159030 con 0x7fe1ac0a9eb0 2023-08-31T19:24:20.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.993+0000 7fe1a8ff9700 1 -- 172.21.15.72:0/3703710941 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 76) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fe1a000fbc0 con 0x7fe1ac0a9eb0 2023-08-31T19:24:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.994+0000 7fe1a8ff9700 1 --2- 172.21.15.72:0/3703710941 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe19005ef30 0x7fe1900613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.994+0000 7fe1a8ff9700 1 -- 172.21.15.72:0/3703710941 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7237+0+0 (secure 0 0 0) 0x7fe1a00798e0 con 0x7fe1ac0a9eb0 2023-08-31T19:24:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.994+0000 7fe1abfff700 1 -- 172.21.15.72:0/3703710941 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe19005ef30 msgr2=0x7fe1900613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:21.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:20.995+0000 7fe1abfff700 1 --2- 172.21.15.72:0/3703710941 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe19005ef30 0x7fe1900613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:24:21.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.002+0000 7fe1a8ff9700 1 -- 172.21.15.72:0/3703710941 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1a00488f0 con 0x7fe1ac0a9eb0 2023-08-31T19:24:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.179+0000 7fe1b2fff700 1 -- 172.21.15.72:0/3703710941 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1ac06c6b0 con 0x7fe1ac0a9eb0 2023-08-31T19:24:21.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.180+0000 7fe1a8ff9700 1 -- 172.21.15.72:0/3703710941 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+18705 (secure 0 0 0) 0x7fe1a004a760 con 0x7fe1ac0a9eb0 2023-08-31T19:24:21.181 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:21.181 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":161,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:19:21.790199+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:07:56.316526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-31T19:07:56.862239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.13","mappings":[{"from":2,"to":5}]},{"pgid":"19.21","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/239009245":"2023-09-01T19:19:21.790169+0000","172.21.15.72:0/1709110334":"2023-09-01T19:19:21.790169+0000","172.21.15.72:0/1362138661":"2023-09-01T19:19:21.790169+0000","172.21.15.72:0/1373642977":"2023-09-01T19:19:21.790169+0000","172.21.15.72:0/1566749110":"2023-09-01T19:08:12.110328+0000","172.21.15.72:0/3516462257":"2023-09-01T19:08:12.110328+0000","172.21.15.72:0/2378011275":"2023-09-01T19:08:12.110328+0000","172.21.15.72:6833/143463":"2023-09-01T19:08:12.110328+0000","172.21.15.72:6832/143463":"2023-09-01T19:08:12.110328+0000","172.21.15.72:0/3869446728":"2023-09-01T19:08:12.110328+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:24:21.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.182+0000 7fe1b2fff700 1 -- 172.21.15.72:0/3703710941 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe19005ef30 msgr2=0x7fe1900613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:24:21.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.182+0000 7fe1b2fff700 1 --2- 172.21.15.72:0/3703710941 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe19005ef30 0x7fe1900613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:21.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.182+0000 7fe1b2fff700 1 -- 172.21.15.72:0/3703710941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1ac0a9eb0 msgr2=0x7fe1ac1577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:21.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.182+0000 7fe1b2fff700 1 --2- 172.21.15.72:0/3703710941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1ac0a9eb0 0x7fe1ac1577a0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7fe1a0001eb0 tx=0x7fe1a0007c70).stop 2023-08-31T19:24:21.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.183+0000 7fe1b2fff700 1 -- 172.21.15.72:0/3703710941 shutdown_connections 2023-08-31T19:24:21.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.183+0000 7fe1b2fff700 1 --2- 172.21.15.72:0/3703710941 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe19005ef30 0x7fe1900613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:21.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.183+0000 7fe1b2fff700 1 --2- 172.21.15.72:0/3703710941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1ac0c1a40 0x7fe1ac167600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:21.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.183+0000 7fe1b2fff700 1 --2- 172.21.15.72:0/3703710941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1ac0a9eb0 0x7fe1ac1577a0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:21.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.183+0000 7fe1b2fff700 1 --2- 172.21.15.72:0/3703710941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac0aa290 0x7fe1ac164960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:21.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.183+0000 7fe1b2fff700 1 -- 172.21.15.72:0/3703710941 >> 172.21.15.72:0/3703710941 conn(0x7fe1ac0c82e0 msgr2=0x7fe1ac0c5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:21.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.183+0000 7fe1b2fff700 1 -- 172.21.15.72:0/3703710941 shutdown_connections 2023-08-31T19:24:21.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.183+0000 7fe1b2fff700 1 -- 172.21.15.72:0/3703710941 wait complete. 2023-08-31T19:24:21.201 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:07:56.316526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '156', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:07:56.862239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:24:21.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:24:21.332 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:21.330+0000 7ff1a326c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:24:21.388 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:21.387+0000 7ff03a3bf680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:24:21.413 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:21.413+0000 7ff1a326c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:24:21.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.425+0000 7fce6cdff700 1 Processor -- start 2023-08-31T19:24:21.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.425+0000 7fce6cdff700 1 -- start start 2023-08-31T19:24:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.426+0000 7fce6cdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fce68154410 0x7fce680c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.426+0000 7fce6cdff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce680c6ed0 con 0x7fce680c7360 2023-08-31T19:24:21.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.426+0000 7fce6cdff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce680c68c0 con 0x7fce68154030 2023-08-31T19:24:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.426+0000 7fce6cdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce680c66e0 con 0x7fce68154410 2023-08-31T19:24:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.427+0000 7fce65d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fce68154410 0x7fce680c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.427+0000 7fce6659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fce68154030 0x7fce680aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:58862/0 (socket says 172.21.15.72:58862) 2023-08-31T19:24:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.427+0000 7fce65d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fce68154410 0x7fce680c06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57426/0 (socket says 172.21.15.72:57426) 2023-08-31T19:24:21.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.427+0000 7fce6659c700 1 -- 172.21.15.72:0/1977123434 learned_addr learned my addr 172.21.15.72:0/1977123434 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:21.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.427+0000 7fce66d9d700 1 --1- 172.21.15.72:0/1977123434 >> v1:172.21.15.72:6789/0 conn(0x7fce680c7360 0x7fce68063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36816/0 (socket says 172.21.15.72:36816) 2023-08-31T19:24:21.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.427+0000 7fce65d9b700 1 -- 172.21.15.72:0/1977123434 >> v1:172.21.15.146:6789/0 conn(0x7fce68154030 legacy=0x7fce680aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:21.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.427+0000 7fce65d9b700 1 -- 172.21.15.72:0/1977123434 >> v1:172.21.15.72:6789/0 conn(0x7fce680c7360 legacy=0x7fce68063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:21.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.427+0000 7fce65d9b700 1 -- 172.21.15.72:0/1977123434 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce680c0f30 con 0x7fce68154410 2023-08-31T19:24:21.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.427+0000 7fce65d9b700 1 --2- 172.21.15.72:0/1977123434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce68154410 0x7fce680c06b0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7fce5c009760 tx=0x7fce5c009060).ready entity=mon.0 client_cookie=8f15542f4641028b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:21.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.428+0000 7fce6559a700 1 -- 172.21.15.72:0/1977123434 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c009120 con 0x7fce68154410 2023-08-31T19:24:21.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.428+0000 7fce6559a700 1 -- 172.21.15.72:0/1977123434 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c00b580 con 0x7fce68154410 2023-08-31T19:24:21.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.428+0000 7fce6559a700 1 -- 172.21.15.72:0/1977123434 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c00b900 con 0x7fce68154410 2023-08-31T19:24:21.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.428+0000 7fce6cdff700 1 -- 172.21.15.72:0/1977123434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce68154410 msgr2=0x7fce680c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:21.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.428+0000 7fce6cdff700 1 --2- 172.21.15.72:0/1977123434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce68154410 0x7fce680c06b0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7fce5c009760 tx=0x7fce5c009060).stop 2023-08-31T19:24:21.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.428+0000 7fce6cdff700 1 -- 172.21.15.72:0/1977123434 shutdown_connections 2023-08-31T19:24:21.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.428+0000 7fce6cdff700 1 --2- 172.21.15.72:0/1977123434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce68154410 0x7fce680c06b0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:21.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.428+0000 7fce6cdff700 1 -- 172.21.15.72:0/1977123434 >> 172.21.15.72:0/1977123434 conn(0x7fce6805eb60 msgr2=0x7fce680cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:21.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.428+0000 7fce6cdff700 1 -- 172.21.15.72:0/1977123434 shutdown_connections 2023-08-31T19:24:21.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.428+0000 7fce6cdff700 1 -- 172.21.15.72:0/1977123434 wait complete. 2023-08-31T19:24:21.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.430+0000 7fce6cdff700 1 Processor -- start 2023-08-31T19:24:21.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.430+0000 7fce6cdff700 1 -- start start 2023-08-31T19:24:21.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.431+0000 7fce6cdff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce680c7360 0x7fce680ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:21.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.431+0000 7fce6cdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce68154030 0x7fce68168490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:21.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.431+0000 7fce6cdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce68154410 0x7fce6814eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:21.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.431+0000 7fce6cdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce680ae5c0 con 0x7fce68154410 2023-08-31T19:24:21.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.431+0000 7fce6cdff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce68168000 con 0x7fce680c7360 2023-08-31T19:24:21.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.431+0000 7fce6cdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce680c4d10 con 0x7fce68154030 2023-08-31T19:24:21.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.431+0000 7fce6659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce680c7360 0x7fce680ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:21.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.431+0000 7fce66d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce68154410 0x7fce6814eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:21.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.431+0000 7fce65d9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce68154030 0x7fce68168490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:21.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.431+0000 7fce6659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce680c7360 0x7fce680ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:45142/0 (socket says 172.21.15.72:45142) 2023-08-31T19:24:21.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.431+0000 7fce6659c700 1 -- 172.21.15.72:0/3494748126 learned_addr learned my addr 172.21.15.72:0/3494748126 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:21.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.432+0000 7fce66d9d700 1 -- 172.21.15.72:0/3494748126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce68154030 msgr2=0x7fce68168490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:21.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.432+0000 7fce66d9d700 1 --2- 172.21.15.72:0/3494748126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce68154030 0x7fce68168490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:21.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.432+0000 7fce66d9d700 1 -- 172.21.15.72:0/3494748126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce680c7360 msgr2=0x7fce680ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:21.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.432+0000 7fce66d9d700 1 --2- 172.21.15.72:0/3494748126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce680c7360 0x7fce680ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:21.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.432+0000 7fce66d9d700 1 -- 172.21.15.72:0/3494748126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c0092a0 con 0x7fce68154410 2023-08-31T19:24:21.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.432+0000 7fce65d9b700 1 --2- 172.21.15.72:0/3494748126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce68154030 0x7fce68168490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:21.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.432+0000 7fce6659c700 1 --2- 172.21.15.72:0/3494748126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce680c7360 0x7fce680ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.432+0000 7fce66d9d700 1 --2- 172.21.15.72:0/3494748126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce68154410 0x7fce6814eee0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7fce6000c7c0 tx=0x7fce60001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.432+0000 7fce567fc700 1 -- 172.21.15.72:0/3494748126 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60005c70 con 0x7fce68154410 2023-08-31T19:24:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.432+0000 7fce567fc700 1 -- 172.21.15.72:0/3494748126 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce60005dd0 con 0x7fce68154410 2023-08-31T19:24:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.432+0000 7fce6cdff700 1 -- 172.21.15.72:0/3494748126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce680c4a30 con 0x7fce68154410 2023-08-31T19:24:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.432+0000 7fce567fc700 1 -- 172.21.15.72:0/3494748126 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce600072e0 con 0x7fce68154410 2023-08-31T19:24:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.432+0000 7fce6cdff700 1 -- 172.21.15.72:0/3494748126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce68168980 con 0x7fce68154410 2023-08-31T19:24:21.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.434+0000 7fce6cdff700 1 -- 172.21.15.72:0/3494748126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce68168190 con 0x7fce68154410 2023-08-31T19:24:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.434+0000 7fce567fc700 1 -- 172.21.15.72:0/3494748126 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 76) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fce60007690 con 0x7fce68154410 2023-08-31T19:24:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.435+0000 7fce567fc700 1 --2- 172.21.15.72:0/3494748126 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fce4805ef30 0x7fce480613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.435+0000 7fce567fc700 1 -- 172.21.15.72:0/3494748126 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7237+0+0 (secure 0 0 0) 0x7fce60079e80 con 0x7fce68154410 2023-08-31T19:24:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.435+0000 7fce6659c700 1 -- 172.21.15.72:0/3494748126 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fce4805ef30 msgr2=0x7fce480613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.435+0000 7fce6659c700 1 --2- 172.21.15.72:0/3494748126 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fce4805ef30 0x7fce480613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:24:21.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.439+0000 7fce567fc700 1 -- 172.21.15.72:0/3494748126 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fce6004ac50 con 0x7fce68154410 2023-08-31T19:24:21.475 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:21.475+0000 7ff03a3bf680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:24:21.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.616+0000 7fce6cdff700 1 -- 172.21.15.72:0/3494748126 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fce6806c6b0 con 0x7fce68154410 2023-08-31T19:24:21.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.617+0000 7fce567fc700 1 -- 172.21.15.72:0/3494748126 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v161) v1 ==== 110+0+10 (secure 0 0 0) 0x7fce60018070 con 0x7fce68154410 2023-08-31T19:24:21.617 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:24:21.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.620+0000 7fce6cdff700 1 -- 172.21.15.72:0/3494748126 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fce4805ef30 msgr2=0x7fce480613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:24:21.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.620+0000 7fce6cdff700 1 --2- 172.21.15.72:0/3494748126 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fce4805ef30 0x7fce480613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:21.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.620+0000 7fce6cdff700 1 -- 172.21.15.72:0/3494748126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce68154410 msgr2=0x7fce6814eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:21.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.620+0000 7fce6cdff700 1 --2- 172.21.15.72:0/3494748126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce68154410 0x7fce6814eee0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7fce6000c7c0 tx=0x7fce60001530).stop 2023-08-31T19:24:21.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.620+0000 7fce6cdff700 1 -- 172.21.15.72:0/3494748126 shutdown_connections 2023-08-31T19:24:21.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.620+0000 7fce6cdff700 1 --2- 172.21.15.72:0/3494748126 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fce4805ef30 0x7fce480613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:21.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.620+0000 7fce6cdff700 1 --2- 172.21.15.72:0/3494748126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce68154410 0x7fce6814eee0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:21.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.620+0000 7fce6cdff700 1 --2- 172.21.15.72:0/3494748126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce680c7360 0x7fce680ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:21.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.620+0000 7fce6cdff700 1 --2- 172.21.15.72:0/3494748126 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fce68154030 0x7fce68168490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:21.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.620+0000 7fce6cdff700 1 -- 172.21.15.72:0/3494748126 >> 172.21.15.72:0/3494748126 conn(0x7fce6805eb60 msgr2=0x7fce6814f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:21.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.620+0000 7fce6cdff700 1 -- 172.21.15.72:0/3494748126 shutdown_connections 2023-08-31T19:24:21.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.620+0000 7fce6cdff700 1 -- 172.21.15.72:0/3494748126 wait complete. 2023-08-31T19:24:21.640 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:24:21.646 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:21.645+0000 7ff1a326c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:24:21.719 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:21.718+0000 7ff03a3bf680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:24:21.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.835+0000 7f24651ff700 1 Processor -- start 2023-08-31T19:24:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.835+0000 7f24651ff700 1 -- start start 2023-08-31T19:24:21.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.836+0000 7f24651ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2460138f30 0x7f2460066970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:21.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.836+0000 7f24651ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24600c3570 con 0x7f2460066590 2023-08-31T19:24:21.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.836+0000 7f24651ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24600c3850 con 0x7f2460156710 2023-08-31T19:24:21.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.836+0000 7f24651ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24600c9380 con 0x7f2460138f30 2023-08-31T19:24:21.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.837+0000 7f245ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2460066590 0x7f24600bdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36824/0 (socket says 172.21.15.72:36824) 2023-08-31T19:24:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.837+0000 7f245ed9d700 1 -- 172.21.15.72:0/685267032 learned_addr learned my addr 172.21.15.72:0/685267032 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:21.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.837+0000 7f245e59c700 1 --2- 172.21.15.72:0/685267032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2460138f30 0x7f2460066970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:21.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.837+0000 7f245dd9b700 1 -- 172.21.15.72:0/685267032 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043505833 0 0) 0x7f24600c3570 con 0x7f2460066590 2023-08-31T19:24:21.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.837+0000 7f245dd9b700 1 -- 172.21.15.72:0/685267032 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24480033f0 con 0x7f2460066590 2023-08-31T19:24:21.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.837+0000 7f245dd9b700 1 -- 172.21.15.72:0/685267032 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097455821 0 0) 0x7f24600c3850 con 0x7f2460156710 2023-08-31T19:24:21.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.837+0000 7f245dd9b700 1 -- 172.21.15.72:0/685267032 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24600c3570 con 0x7f2460156710 2023-08-31T19:24:21.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.837+0000 7f245e59c700 1 -- 172.21.15.72:0/685267032 >> v1:172.21.15.146:6789/0 conn(0x7f2460156710 legacy=0x7f24601381d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:21.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.837+0000 7f245e59c700 1 -- 172.21.15.72:0/685267032 >> v1:172.21.15.72:6789/0 conn(0x7f2460066590 legacy=0x7f24600bdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.837+0000 7f245e59c700 1 -- 172.21.15.72:0/685267032 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24600c9660 con 0x7f2460138f30 2023-08-31T19:24:21.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.838+0000 7f245e59c700 1 --2- 172.21.15.72:0/685267032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2460138f30 0x7f2460066970 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f2454009790 tx=0x7f2454009060).ready entity=mon.2 client_cookie=c7553de43d52ecdc server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:21.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.838+0000 7f245dd9b700 1 -- 172.21.15.72:0/685267032 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400f510 con 0x7f2460138f30 2023-08-31T19:24:21.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.838+0000 7f245dd9b700 1 -- 172.21.15.72:0/685267032 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245400f670 con 0x7f2460138f30 2023-08-31T19:24:21.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.838+0000 7f245dd9b700 1 -- 172.21.15.72:0/685267032 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400f9f0 con 0x7f2460138f30 2023-08-31T19:24:21.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.838+0000 7f24651ff700 1 -- 172.21.15.72:0/685267032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2460138f30 msgr2=0x7f2460066970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:21.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.838+0000 7f24651ff700 1 --2- 172.21.15.72:0/685267032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2460138f30 0x7f2460066970 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f2454009790 tx=0x7f2454009060).stop 2023-08-31T19:24:21.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.839+0000 7f24651ff700 1 -- 172.21.15.72:0/685267032 shutdown_connections 2023-08-31T19:24:21.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.839+0000 7f24651ff700 1 --2- 172.21.15.72:0/685267032 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2460138f30 0x7f2460066970 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:21.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.839+0000 7f24651ff700 1 -- 172.21.15.72:0/685267032 >> 172.21.15.72:0/685267032 conn(0x7f246005eb60 msgr2=0x7f24600c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:21.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.839+0000 7f24651ff700 1 -- 172.21.15.72:0/685267032 shutdown_connections 2023-08-31T19:24:21.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.839+0000 7f24651ff700 1 -- 172.21.15.72:0/685267032 wait complete. 2023-08-31T19:24:21.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.840+0000 7f24651ff700 1 Processor -- start 2023-08-31T19:24:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.840+0000 7f24651ff700 1 -- start start 2023-08-31T19:24:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.841+0000 7f24651ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2460066590 0x7f24600c2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:21.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.841+0000 7f24651ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460138f30 0x7f2460147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.841+0000 7f24651ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2460156710 0x7f2460162290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.841+0000 7f24651ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2460152d50 con 0x7f2460138f30 2023-08-31T19:24:21.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.841+0000 7f24651ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24601484d0 con 0x7f2460156710 2023-08-31T19:24:21.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.841+0000 7f24651ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24601377e0 con 0x7f2460066590 2023-08-31T19:24:21.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.842+0000 7f245e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460138f30 0x7f2460147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:21.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.842+0000 7f245ed9d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2460066590 0x7f24600c2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:21.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.842+0000 7f245e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460138f30 0x7f2460147fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57442/0 (socket says 172.21.15.72:57442) 2023-08-31T19:24:21.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.842+0000 7f245e59c700 1 -- 172.21.15.72:0/1462704719 learned_addr learned my addr 172.21.15.72:0/1462704719 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.842+0000 7f245f59e700 1 --2- 172.21.15.72:0/1462704719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2460156710 0x7f2460162290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.842+0000 7f245ed9d700 1 -- 172.21.15.72:0/1462704719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2460156710 msgr2=0x7f2460162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:21.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.842+0000 7f245ed9d700 1 --2- 172.21.15.72:0/1462704719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2460156710 0x7f2460162290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.842+0000 7f245ed9d700 1 -- 172.21.15.72:0/1462704719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460138f30 msgr2=0x7f2460147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.842+0000 7f245ed9d700 1 --2- 172.21.15.72:0/1462704719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460138f30 0x7f2460147fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:21.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.842+0000 7f245ed9d700 1 -- 172.21.15.72:0/1462704719 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24540092a0 con 0x7f2460066590 2023-08-31T19:24:21.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.842+0000 7f245e59c700 1 --2- 172.21.15.72:0/1462704719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460138f30 0x7f2460147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:21.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.843+0000 7f245ed9d700 1 --2- 172.21.15.72:0/1462704719 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2460066590 0x7f24600c2020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f2450001750 tx=0x7f2450007c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:21.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.843+0000 7f2446ffd700 1 -- 172.21.15.72:0/1462704719 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450013070 con 0x7f2460066590 2023-08-31T19:24:21.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.843+0000 7f2446ffd700 1 -- 172.21.15.72:0/1462704719 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245000e2e0 con 0x7f2460066590 2023-08-31T19:24:21.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.843+0000 7f24651ff700 1 -- 172.21.15.72:0/1462704719 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24600c25e0 con 0x7f2460066590 2023-08-31T19:24:21.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.843+0000 7f2446ffd700 1 -- 172.21.15.72:0/1462704719 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24500072e0 con 0x7f2460066590 2023-08-31T19:24:21.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.843+0000 7f24651ff700 1 -- 172.21.15.72:0/1462704719 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24600c2ba0 con 0x7f2460066590 2023-08-31T19:24:21.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.844+0000 7f24651ff700 1 -- 172.21.15.72:0/1462704719 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246006c6b0 con 0x7f2460066590 2023-08-31T19:24:21.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.845+0000 7f2446ffd700 1 -- 172.21.15.72:0/1462704719 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 76) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f24500057a0 con 0x7f2460066590 2023-08-31T19:24:21.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.846+0000 7f2446ffd700 1 --2- 172.21.15.72:0/1462704719 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f244c05ef00 0x7f244c0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:21.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.846+0000 7f2446ffd700 1 -- 172.21.15.72:0/1462704719 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7237+0+0 (secure 0 0 0) 0x7f245007dd00 con 0x7f2460066590 2023-08-31T19:24:21.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.846+0000 7f245e59c700 1 -- 172.21.15.72:0/1462704719 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f244c05ef00 msgr2=0x7f244c0613c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:21.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.846+0000 7f245e59c700 1 --2- 172.21.15.72:0/1462704719 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f244c05ef00 0x7f244c0613c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:24:21.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:21.850+0000 7f2446ffd700 1 -- 172.21.15.72:0/1462704719 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f245004ead0 con 0x7f2460066590 2023-08-31T19:24:22.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.029+0000 7f24651ff700 1 -- 172.21.15.72:0/1462704719 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2460067360 con 0x7f2460066590 2023-08-31T19:24:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.030+0000 7f2446ffd700 1 -- 172.21.15.72:0/1462704719 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v161) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2450007dc0 con 0x7f2460066590 2023-08-31T19:24:22.031 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:24:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.032+0000 7f24651ff700 1 -- 172.21.15.72:0/1462704719 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f244c05ef00 msgr2=0x7f244c0613c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:24:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.032+0000 7f24651ff700 1 --2- 172.21.15.72:0/1462704719 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f244c05ef00 0x7f244c0613c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.032+0000 7f24651ff700 1 -- 172.21.15.72:0/1462704719 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2460066590 msgr2=0x7f24600c2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.032+0000 7f24651ff700 1 --2- 172.21.15.72:0/1462704719 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2460066590 0x7f24600c2020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f2450001750 tx=0x7f2450007c80).stop 2023-08-31T19:24:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.032+0000 7f24651ff700 1 -- 172.21.15.72:0/1462704719 shutdown_connections 2023-08-31T19:24:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.032+0000 7f24651ff700 1 --2- 172.21.15.72:0/1462704719 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f244c05ef00 0x7f244c0613c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.032+0000 7f24651ff700 1 --2- 172.21.15.72:0/1462704719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2460156710 0x7f2460162290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.032+0000 7f24651ff700 1 --2- 172.21.15.72:0/1462704719 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2460066590 0x7f24600c2020 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.032+0000 7f24651ff700 1 --2- 172.21.15.72:0/1462704719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460138f30 0x7f2460147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.032+0000 7f24651ff700 1 -- 172.21.15.72:0/1462704719 >> 172.21.15.72:0/1462704719 conn(0x7f246005eb60 msgr2=0x7f246014f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.032+0000 7f24651ff700 1 -- 172.21.15.72:0/1462704719 shutdown_connections 2023-08-31T19:24:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.032+0000 7f24651ff700 1 -- 172.21.15.72:0/1462704719 wait complete. 2023-08-31T19:24:22.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:24:22.162 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:22.161+0000 7ff1a326c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:24:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.252+0000 7f0d6e3ff700 1 Processor -- start 2023-08-31T19:24:22.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.253+0000 7f0d6e3ff700 1 -- start start 2023-08-31T19:24:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.254+0000 7f0d6e3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d68154410 0x7f0d680c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.254+0000 7f0d6e3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d680c6ed0 con 0x7f0d680c7360 2023-08-31T19:24:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.254+0000 7f0d6e3ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d680c68c0 con 0x7f0d68154030 2023-08-31T19:24:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.254+0000 7f0d6e3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d680c66e0 con 0x7f0d68154410 2023-08-31T19:24:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.254+0000 7f0d677fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d68154410 0x7f0d680c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.254+0000 7f0d6c99c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0d680c7360 0x7f0d68063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36840/0 (socket says 172.21.15.72:36840) 2023-08-31T19:24:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.254+0000 7f0d677fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d68154410 0x7f0d680c06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57454/0 (socket says 172.21.15.72:57454) 2023-08-31T19:24:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.254+0000 7f0d6c99c700 1 -- 172.21.15.72:0/3430044587 learned_addr learned my addr 172.21.15.72:0/3430044587 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:22.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.255+0000 7f0d677fe700 1 -- 172.21.15.72:0/3430044587 >> v1:172.21.15.146:6789/0 conn(0x7f0d68154030 legacy=0x7f0d680aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:22.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.255+0000 7f0d677fe700 1 -- 172.21.15.72:0/3430044587 >> v1:172.21.15.72:6789/0 conn(0x7f0d680c7360 legacy=0x7f0d68063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:22.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.255+0000 7f0d677fe700 1 -- 172.21.15.72:0/3430044587 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d680c0f30 con 0x7f0d68154410 2023-08-31T19:24:22.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.255+0000 7f0d66ffd700 1 -- 172.21.15.72:0/3430044587 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806661724 0 0) 0x7f0d680c68c0 con 0x7f0d68154030 2023-08-31T19:24:22.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.255+0000 7f0d677fe700 1 --2- 172.21.15.72:0/3430044587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d68154410 0x7f0d680c06b0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f0d5c009760 tx=0x7f0d5c009060).ready entity=mon.0 client_cookie=54b929dcbdf38e63 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:22.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.255+0000 7f0d66ffd700 1 -- 172.21.15.72:0/3430044587 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c009120 con 0x7f0d68154410 2023-08-31T19:24:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.255+0000 7f0d66ffd700 1 -- 172.21.15.72:0/3430044587 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5c00b580 con 0x7f0d68154410 2023-08-31T19:24:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.255+0000 7f0d66ffd700 1 -- 172.21.15.72:0/3430044587 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c00b900 con 0x7f0d68154410 2023-08-31T19:24:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.256+0000 7f0d6e3ff700 1 -- 172.21.15.72:0/3430044587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d68154410 msgr2=0x7f0d680c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.256+0000 7f0d6e3ff700 1 --2- 172.21.15.72:0/3430044587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d68154410 0x7f0d680c06b0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f0d5c009760 tx=0x7f0d5c009060).stop 2023-08-31T19:24:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.256+0000 7f0d6e3ff700 1 -- 172.21.15.72:0/3430044587 shutdown_connections 2023-08-31T19:24:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.256+0000 7f0d6e3ff700 1 --2- 172.21.15.72:0/3430044587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d68154410 0x7f0d680c06b0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.256+0000 7f0d6e3ff700 1 -- 172.21.15.72:0/3430044587 >> 172.21.15.72:0/3430044587 conn(0x7f0d6805eb60 msgr2=0x7f0d680cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.256+0000 7f0d6e3ff700 1 -- 172.21.15.72:0/3430044587 shutdown_connections 2023-08-31T19:24:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.256+0000 7f0d6e3ff700 1 -- 172.21.15.72:0/3430044587 wait complete. 2023-08-31T19:24:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.258+0000 7f0d6e3ff700 1 Processor -- start 2023-08-31T19:24:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.258+0000 7f0d6e3ff700 1 -- start start 2023-08-31T19:24:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.259+0000 7f0d6e3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d680c7360 0x7f0d681416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.259+0000 7f0d6e3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d68154030 0x7f0d680afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:22.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.259+0000 7f0d6e3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d68154410 0x7f0d680b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.259+0000 7f0d6e3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d680c3400 con 0x7f0d680c7360 2023-08-31T19:24:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.259+0000 7f0d6e3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d680b0860 con 0x7f0d68154410 2023-08-31T19:24:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.259+0000 7f0d6e3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d680c2a60 con 0x7f0d68154030 2023-08-31T19:24:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.259+0000 7f0d67fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d680c7360 0x7f0d681416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.259+0000 7f0d67fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d680c7360 0x7f0d681416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57470/0 (socket says 172.21.15.72:57470) 2023-08-31T19:24:22.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.259+0000 7f0d67fff700 1 -- 172.21.15.72:0/2129887470 learned_addr learned my addr 172.21.15.72:0/2129887470 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:22.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.259+0000 7f0d6c99c700 1 --2- 172.21.15.72:0/2129887470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d68154410 0x7f0d680b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:22.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.259+0000 7f0d677fe700 1 --2- 172.21.15.72:0/2129887470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d68154030 0x7f0d680afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:22.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.260+0000 7f0d67fff700 1 -- 172.21.15.72:0/2129887470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d68154030 msgr2=0x7f0d680afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:22.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.260+0000 7f0d67fff700 1 --2- 172.21.15.72:0/2129887470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d68154030 0x7f0d680afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.260+0000 7f0d67fff700 1 -- 172.21.15.72:0/2129887470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d68154410 msgr2=0x7f0d680b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.260+0000 7f0d67fff700 1 --2- 172.21.15.72:0/2129887470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d68154410 0x7f0d680b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.260+0000 7f0d67fff700 1 -- 172.21.15.72:0/2129887470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c0092a0 con 0x7f0d680c7360 2023-08-31T19:24:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.260+0000 7f0d6c99c700 1 --2- 172.21.15.72:0/2129887470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d68154410 0x7f0d680b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.260+0000 7f0d67fff700 1 --2- 172.21.15.72:0/2129887470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d680c7360 0x7f0d681416f0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f0d58001eb0 tx=0x7f0d58007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:22.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.260+0000 7f0d4ffff700 1 -- 172.21.15.72:0/2129887470 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800f470 con 0x7f0d680c7360 2023-08-31T19:24:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.260+0000 7f0d4ffff700 1 -- 172.21.15.72:0/2129887470 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5800f5f0 con 0x7f0d680c7360 2023-08-31T19:24:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.260+0000 7f0d6e3ff700 1 -- 172.21.15.72:0/2129887470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d680c2d40 con 0x7f0d680c7360 2023-08-31T19:24:22.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.260+0000 7f0d4ffff700 1 -- 172.21.15.72:0/2129887470 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800f9b0 con 0x7f0d680c7360 2023-08-31T19:24:22.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.260+0000 7f0d6e3ff700 1 -- 172.21.15.72:0/2129887470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d68141be0 con 0x7f0d680c7360 2023-08-31T19:24:22.271 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:22.261+0000 7ff03a3bf680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:24:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.262+0000 7f0d6e3ff700 1 -- 172.21.15.72:0/2129887470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d680c3670 con 0x7f0d680c7360 2023-08-31T19:24:22.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.262+0000 7f0d4ffff700 1 -- 172.21.15.72:0/2129887470 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 76) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f0d5800fd20 con 0x7f0d680c7360 2023-08-31T19:24:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.263+0000 7f0d4ffff700 1 --2- 172.21.15.72:0/2129887470 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0d5405ef30 0x7f0d540613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.263+0000 7f0d4ffff700 1 -- 172.21.15.72:0/2129887470 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7237+0+0 (secure 0 0 0) 0x7f0d58079a50 con 0x7f0d680c7360 2023-08-31T19:24:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.263+0000 7f0d677fe700 1 -- 172.21.15.72:0/2129887470 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0d5405ef30 msgr2=0x7f0d540613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:22.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.263+0000 7f0d677fe700 1 --2- 172.21.15.72:0/2129887470 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0d5405ef30 0x7f0d540613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:24:22.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.267+0000 7f0d4ffff700 1 -- 172.21.15.72:0/2129887470 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0d5804a8e0 con 0x7f0d680c7360 2023-08-31T19:24:22.288 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:22.287+0000 7ff1a326c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:24:22.419 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:22.418+0000 7ff03a3bf680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:24:22.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.464+0000 7f0d677fe700 1 -- 172.21.15.72:0/2129887470 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0d5405ef30 msgr2=0x7f0d540613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:22.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.464+0000 7f0d677fe700 1 --2- 172.21.15.72:0/2129887470 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0d5405ef30 0x7f0d540613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:24:22.471 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:22.470+0000 7ff1a326c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:24:22.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.479+0000 7f0d6e3ff700 1 -- 172.21.15.72:0/2129887470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0d68141e90 con 0x7f0d680c7360 2023-08-31T19:24:22.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.480+0000 7f0d4ffff700 1 -- 172.21.15.72:0/2129887470 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v161) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0d5804df00 con 0x7f0d680c7360 2023-08-31T19:24:22.481 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:24:22.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.482+0000 7f0d6e3ff700 1 -- 172.21.15.72:0/2129887470 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0d5405ef30 msgr2=0x7f0d540613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:24:22.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.482+0000 7f0d6e3ff700 1 --2- 172.21.15.72:0/2129887470 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0d5405ef30 0x7f0d540613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.482+0000 7f0d6e3ff700 1 -- 172.21.15.72:0/2129887470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d680c7360 msgr2=0x7f0d681416f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:22.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.482+0000 7f0d6e3ff700 1 --2- 172.21.15.72:0/2129887470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d680c7360 0x7f0d681416f0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f0d58001eb0 tx=0x7f0d58007c70).stop 2023-08-31T19:24:22.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.482+0000 7f0d6e3ff700 1 -- 172.21.15.72:0/2129887470 shutdown_connections 2023-08-31T19:24:22.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.482+0000 7f0d6e3ff700 1 --2- 172.21.15.72:0/2129887470 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0d5405ef30 0x7f0d540613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:22.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.482+0000 7f0d6e3ff700 1 --2- 172.21.15.72:0/2129887470 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d68154410 0x7f0d680b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.482+0000 7f0d6e3ff700 1 --2- 172.21.15.72:0/2129887470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d680c7360 0x7f0d681416f0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.482+0000 7f0d6e3ff700 1 --2- 172.21.15.72:0/2129887470 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0d68154030 0x7f0d680afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.482+0000 7f0d6e3ff700 1 -- 172.21.15.72:0/2129887470 >> 172.21.15.72:0/2129887470 conn(0x7f0d6805eb60 msgr2=0x7f0d680ac2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.482+0000 7f0d6e3ff700 1 -- 172.21.15.72:0/2129887470 shutdown_connections 2023-08-31T19:24:22.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.482+0000 7f0d6e3ff700 1 -- 172.21.15.72:0/2129887470 wait complete. 2023-08-31T19:24:22.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:24:22.563 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:22.563+0000 7ff1a326c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:24:22.609 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:22.609+0000 7ff03a3bf680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:24:22.647 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:22.646+0000 7ff1a326c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:24:22.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.699+0000 7f0b18fff700 1 Processor -- start 2023-08-31T19:24:22.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.699+0000 7f0b18fff700 1 -- start start 2023-08-31T19:24:22.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.700+0000 7f0b18fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b14153e30 0x7f0b14154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:22.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.700+0000 7f0b18fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b140c5cb0 0x7f0b140c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:22.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.701+0000 7f0b18fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b140bfd40 con 0x7f0b140630b0 2023-08-31T19:24:22.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.701+0000 7f0b18fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b140c6730 con 0x7f0b140c5cb0 2023-08-31T19:24:22.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.701+0000 7f0b18fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140bffe0 con 0x7f0b14153e30 2023-08-31T19:24:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.701+0000 7f0b11d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b140c5cb0 0x7f0b140c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.701+0000 7f0b1259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b14153e30 0x7f0b14154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.701+0000 7f0b11d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b140c5cb0 0x7f0b140c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:45156/0 (socket says 172.21.15.72:45156) 2023-08-31T19:24:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.701+0000 7f0b11d9b700 1 -- 172.21.15.72:0/3823465677 learned_addr learned my addr 172.21.15.72:0/3823465677 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.701+0000 7f0b12d9d700 1 --1- 172.21.15.72:0/3823465677 >> v1:172.21.15.146:6789/0 conn(0x7f0b140630b0 0x7f0b14157d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:58902/0 (socket says 172.21.15.72:58902) 2023-08-31T19:24:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.701+0000 7f0b11d9b700 1 -- 172.21.15.72:0/3823465677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b14153e30 msgr2=0x7f0b14154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.701+0000 7f0b11d9b700 1 --2- 172.21.15.72:0/3823465677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b14153e30 0x7f0b14154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.701+0000 7f0b11d9b700 1 -- 172.21.15.72:0/3823465677 >> v1:172.21.15.146:6789/0 conn(0x7f0b140630b0 legacy=0x7f0b14157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.701+0000 7f0b11d9b700 1 -- 172.21.15.72:0/3823465677 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b140c02c0 con 0x7f0b140c5cb0 2023-08-31T19:24:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.701+0000 7f0b1159a700 1 -- 172.21.15.72:0/3823465677 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983846973 0 0) 0x7f0b140bfd40 con 0x7f0b140630b0 2023-08-31T19:24:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.702+0000 7f0b11d9b700 1 --2- 172.21.15.72:0/3823465677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b140c5cb0 0x7f0b140c6130 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f0b08006fd0 tx=0x7f0b080090f0).ready entity=mon.1 client_cookie=186719db500926a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.702+0000 7f0b1159a700 1 -- 172.21.15.72:0/3823465677 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0800b580 con 0x7f0b140c5cb0 2023-08-31T19:24:22.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.702+0000 7f0b1159a700 1 -- 172.21.15.72:0/3823465677 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0800b6e0 con 0x7f0b140c5cb0 2023-08-31T19:24:22.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.702+0000 7f0b1159a700 1 -- 172.21.15.72:0/3823465677 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0800ba80 con 0x7f0b140c5cb0 2023-08-31T19:24:22.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.702+0000 7f0b18fff700 1 -- 172.21.15.72:0/3823465677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b140c5cb0 msgr2=0x7f0b140c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:22.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.702+0000 7f0b18fff700 1 --2- 172.21.15.72:0/3823465677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b140c5cb0 0x7f0b140c6130 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f0b08006fd0 tx=0x7f0b080090f0).stop 2023-08-31T19:24:22.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.703+0000 7f0b18fff700 1 -- 172.21.15.72:0/3823465677 shutdown_connections 2023-08-31T19:24:22.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.703+0000 7f0b18fff700 1 --2- 172.21.15.72:0/3823465677 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b14153e30 0x7f0b14154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.703+0000 7f0b18fff700 1 --2- 172.21.15.72:0/3823465677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b140c5cb0 0x7f0b140c6130 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.703+0000 7f0b18fff700 1 -- 172.21.15.72:0/3823465677 >> 172.21.15.72:0/3823465677 conn(0x7f0b1405eb20 msgr2=0x7f0b140cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:22.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.703+0000 7f0b18fff700 1 -- 172.21.15.72:0/3823465677 shutdown_connections 2023-08-31T19:24:22.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.703+0000 7f0b18fff700 1 -- 172.21.15.72:0/3823465677 wait complete. 2023-08-31T19:24:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.704+0000 7f0b18fff700 1 Processor -- start 2023-08-31T19:24:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.704+0000 7f0b18fff700 1 -- start start 2023-08-31T19:24:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.705+0000 7f0b18fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b140630b0 0x7f0b14141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.705+0000 7f0b18fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b140c5cb0 0x7f0b141681f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.705+0000 7f0b18fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b14153e30 0x7f0b14152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.705+0000 7f0b18fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b141654c0 con 0x7f0b14153e30 2023-08-31T19:24:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.705+0000 7f0b18fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b141648b0 con 0x7f0b140c5cb0 2023-08-31T19:24:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.705+0000 7f0b18fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14164b90 con 0x7f0b140630b0 2023-08-31T19:24:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.706+0000 7f0b1259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b140630b0 0x7f0b14141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.706+0000 7f0b12d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b14153e30 0x7f0b14152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.706+0000 7f0b1259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b140630b0 0x7f0b14141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:48688/0 (socket says 172.21.15.72:48688) 2023-08-31T19:24:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.706+0000 7f0b11d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b140c5cb0 0x7f0b141681f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.706+0000 7f0b1259c700 1 -- 172.21.15.72:0/1511768320 learned_addr learned my addr 172.21.15.72:0/1511768320 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.706+0000 7f0b1259c700 1 -- 172.21.15.72:0/1511768320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b140c5cb0 msgr2=0x7f0b141681f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.706+0000 7f0b1259c700 1 --2- 172.21.15.72:0/1511768320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b140c5cb0 0x7f0b141681f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.706+0000 7f0b1259c700 1 -- 172.21.15.72:0/1511768320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b14153e30 msgr2=0x7f0b14152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.706+0000 7f0b1259c700 1 --2- 172.21.15.72:0/1511768320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b14153e30 0x7f0b14152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.706+0000 7f0b1259c700 1 -- 172.21.15.72:0/1511768320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b08009370 con 0x7f0b140630b0 2023-08-31T19:24:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.706+0000 7f0b1259c700 1 --2- 172.21.15.72:0/1511768320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b140630b0 0x7f0b14141fa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f0b0400e960 tx=0x7f0b04009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.706+0000 7f0b027fc700 1 -- 172.21.15.72:0/1511768320 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0400c6a0 con 0x7f0b140630b0 2023-08-31T19:24:22.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.707+0000 7f0b027fc700 1 -- 172.21.15.72:0/1511768320 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0400c800 con 0x7f0b140630b0 2023-08-31T19:24:22.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.707+0000 7f0b027fc700 1 -- 172.21.15.72:0/1511768320 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0400cb80 con 0x7f0b140630b0 2023-08-31T19:24:22.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.707+0000 7f0b18fff700 1 -- 172.21.15.72:0/1511768320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b14164e70 con 0x7f0b140630b0 2023-08-31T19:24:22.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.707+0000 7f0b18fff700 1 -- 172.21.15.72:0/1511768320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b140c2940 con 0x7f0b140630b0 2023-08-31T19:24:22.715 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:22.708+0000 7ff03a3bf680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:24:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.708+0000 7f0b18fff700 1 -- 172.21.15.72:0/1511768320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1406c6b0 con 0x7f0b140630b0 2023-08-31T19:24:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.709+0000 7f0b027fc700 1 -- 172.21.15.72:0/1511768320 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 76) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f0b0401b400 con 0x7f0b140630b0 2023-08-31T19:24:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.709+0000 7f0b027fc700 1 --2- 172.21.15.72:0/1511768320 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0af405ef30 0x7f0af40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.710+0000 7f0b11d9b700 1 -- 172.21.15.72:0/1511768320 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0af405ef30 msgr2=0x7f0af40613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.710+0000 7f0b027fc700 1 -- 172.21.15.72:0/1511768320 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7237+0+0 (secure 0 0 0) 0x7f0b0407a910 con 0x7f0b140630b0 2023-08-31T19:24:22.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.710+0000 7f0b11d9b700 1 --2- 172.21.15.72:0/1511768320 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0af405ef30 0x7f0af40613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:24:22.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.717+0000 7f0b027fc700 1 -- 172.21.15.72:0/1511768320 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b0404b7f0 con 0x7f0b140630b0 2023-08-31T19:24:22.817 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:22.817+0000 7ff03a3bf680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:24:22.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.911+0000 7f0b11d9b700 1 -- 172.21.15.72:0/1511768320 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0af405ef30 msgr2=0x7f0af40613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:22.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.911+0000 7f0b11d9b700 1 --2- 172.21.15.72:0/1511768320 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0af405ef30 0x7f0af40613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:24:22.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.920+0000 7f0b18fff700 1 -- 172.21.15.72:0/1511768320 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b14064000 con 0x7f0b140630b0 2023-08-31T19:24:22.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.921+0000 7f0b027fc700 1 -- 172.21.15.72:0/1511768320 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v161) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b0404ee10 con 0x7f0b140630b0 2023-08-31T19:24:22.921 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:24:22.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.923+0000 7f0b18fff700 1 -- 172.21.15.72:0/1511768320 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0af405ef30 msgr2=0x7f0af40613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:24:22.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.923+0000 7f0b18fff700 1 --2- 172.21.15.72:0/1511768320 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0af405ef30 0x7f0af40613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:22.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.923+0000 7f0b18fff700 1 -- 172.21.15.72:0/1511768320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b140630b0 msgr2=0x7f0b14141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:22.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.923+0000 7f0b18fff700 1 --2- 172.21.15.72:0/1511768320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b140630b0 0x7f0b14141fa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f0b0400e960 tx=0x7f0b04009060).stop 2023-08-31T19:24:22.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.923+0000 7f0b18fff700 1 -- 172.21.15.72:0/1511768320 shutdown_connections 2023-08-31T19:24:22.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.923+0000 7f0b18fff700 1 --2- 172.21.15.72:0/1511768320 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0af405ef30 0x7f0af40613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:22.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.923+0000 7f0b18fff700 1 --2- 172.21.15.72:0/1511768320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b14153e30 0x7f0b14152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.923+0000 7f0b18fff700 1 --2- 172.21.15.72:0/1511768320 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b140630b0 0x7f0b14141fa0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.923+0000 7f0b18fff700 1 --2- 172.21.15.72:0/1511768320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b140c5cb0 0x7f0b141681f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:22.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.923+0000 7f0b18fff700 1 -- 172.21.15.72:0/1511768320 >> 172.21.15.72:0/1511768320 conn(0x7f0b1405eb20 msgr2=0x7f0b140c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:22.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.923+0000 7f0b18fff700 1 -- 172.21.15.72:0/1511768320 shutdown_connections 2023-08-31T19:24:22.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:22.923+0000 7f0b18fff700 1 -- 172.21.15.72:0/1511768320 wait complete. 2023-08-31T19:24:22.942 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:24:22.960 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:22.959+0000 7ff1a326c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:24:23.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.165+0000 7f1f415ff700 1 Processor -- start 2023-08-31T19:24:23.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.165+0000 7f1f415ff700 1 -- start start 2023-08-31T19:24:23.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.166+0000 7f1f415ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f3c1541a0 0x7f1f3c0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:23.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.166+0000 7f1f415ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1f3c0bf460 0x7f1f3c0c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:23.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.166+0000 7f1f415ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3c0c4790 con 0x7f1f3c0c4300 2023-08-31T19:24:23.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.166+0000 7f1f415ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c0c5950 con 0x7f1f3c1541a0 2023-08-31T19:24:23.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.166+0000 7f1f415ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c0c5c30 con 0x7f1f3c0bf460 2023-08-31T19:24:23.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.166+0000 7f1f3affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f3c1541a0 0x7f1f3c0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:23.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.166+0000 7f1f3affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f3c1541a0 0x7f1f3c0c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38296/0 (socket says 172.21.15.72:38296) 2023-08-31T19:24:23.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.166+0000 7f1f3affd700 1 -- 172.21.15.72:0/1500733619 learned_addr learned my addr 172.21.15.72:0/1500733619 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:23.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.167+0000 7f1f3a7fc700 1 --2- 172.21.15.72:0/1500733619 >> v2:172.21.15.146:3300/0 conn(0x7f1f3c0bf460 0x7f1f3c0c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.167+0000 7f1f3affd700 1 -- 172.21.15.72:0/1500733619 >> v2:172.21.15.146:3300/0 conn(0x7f1f3c0bf460 msgr2=0x7f1f3c0c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.167+0000 7f1f3affd700 1 --2- 172.21.15.72:0/1500733619 >> v2:172.21.15.146:3300/0 conn(0x7f1f3c0bf460 0x7f1f3c0c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:23.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.167+0000 7f1f3affd700 1 -- 172.21.15.72:0/1500733619 >> v1:172.21.15.146:6789/0 conn(0x7f1f3c0c4300 legacy=0x7f1f3c0be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:23.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.167+0000 7f1f3affd700 1 -- 172.21.15.72:0/1500733619 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c0c5f10 con 0x7f1f3c1541a0 2023-08-31T19:24:23.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.167+0000 7f1f3affd700 1 --2- 172.21.15.72:0/1500733619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f3c1541a0 0x7f1f3c0c5300 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f1f3c0c34a0 tx=0x7f1f2c0090f0).ready entity=mon.0 client_cookie=8b031d5346ea4d20 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:23.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.167+0000 7f1f39ffb700 1 -- 172.21.15.72:0/1500733619 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00b520 con 0x7f1f3c1541a0 2023-08-31T19:24:23.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.167+0000 7f1f39ffb700 1 -- 172.21.15.72:0/1500733619 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c00b680 con 0x7f1f3c1541a0 2023-08-31T19:24:23.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.167+0000 7f1f39ffb700 1 -- 172.21.15.72:0/1500733619 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00ba00 con 0x7f1f3c1541a0 2023-08-31T19:24:23.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.168+0000 7f1f415ff700 1 -- 172.21.15.72:0/1500733619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f3c1541a0 msgr2=0x7f1f3c0c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:23.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.168+0000 7f1f415ff700 1 --2- 172.21.15.72:0/1500733619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f3c1541a0 0x7f1f3c0c5300 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f1f3c0c34a0 tx=0x7f1f2c0090f0).stop 2023-08-31T19:24:23.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.168+0000 7f1f415ff700 1 -- 172.21.15.72:0/1500733619 shutdown_connections 2023-08-31T19:24:23.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.168+0000 7f1f415ff700 1 --2- 172.21.15.72:0/1500733619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f3c1541a0 0x7f1f3c0c5300 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:23.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.168+0000 7f1f415ff700 1 --2- 172.21.15.72:0/1500733619 >> v2:172.21.15.146:3300/0 conn(0x7f1f3c0bf460 0x7f1f3c0c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:23.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.168+0000 7f1f415ff700 1 -- 172.21.15.72:0/1500733619 >> 172.21.15.72:0/1500733619 conn(0x7f1f3c082f60 msgr2=0x7f1f3c05e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:23.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.168+0000 7f1f415ff700 1 -- 172.21.15.72:0/1500733619 shutdown_connections 2023-08-31T19:24:23.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.168+0000 7f1f415ff700 1 -- 172.21.15.72:0/1500733619 wait complete. 2023-08-31T19:24:23.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.169+0000 7f1f415ff700 1 Processor -- start 2023-08-31T19:24:23.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.170+0000 7f1f415ff700 1 -- start start 2023-08-31T19:24:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f415ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f3c0bf460 0x7f1f3c145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f415ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f3c0c4300 0x7f1f3c1677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f415ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3c1541a0 0x7f1f3c167cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:23.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f415ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0ae820 con 0x7f1f3c0c4300 2023-08-31T19:24:23.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f415ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c1681c0 con 0x7f1f3c1541a0 2023-08-31T19:24:23.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f415ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0c0710 con 0x7f1f3c0bf460 2023-08-31T19:24:23.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f3a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f3c0c4300 0x7f1f3c1677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:23.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f3a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f3c0c4300 0x7f1f3c1677e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38308/0 (socket says 172.21.15.72:38308) 2023-08-31T19:24:23.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f3a7fc700 1 -- 172.21.15.72:0/289778721 learned_addr learned my addr 172.21.15.72:0/289778721 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:23.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f3b7fe700 1 --2- 172.21.15.72:0/289778721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3c1541a0 0x7f1f3c167cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:23.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f3affd700 1 --2- 172.21.15.72:0/289778721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f3c0bf460 0x7f1f3c145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:23.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f3a7fc700 1 -- 172.21.15.72:0/289778721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f3c0bf460 msgr2=0x7f1f3c145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:23.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f3a7fc700 1 --2- 172.21.15.72:0/289778721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f3c0bf460 0x7f1f3c145780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:23.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f3a7fc700 1 -- 172.21.15.72:0/289778721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3c1541a0 msgr2=0x7f1f3c167cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:23.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f3a7fc700 1 --2- 172.21.15.72:0/289778721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3c1541a0 0x7f1f3c167cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:23.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f3a7fc700 1 -- 172.21.15.72:0/289778721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c009370 con 0x7f1f3c0c4300 2023-08-31T19:24:23.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f3affd700 1 --2- 172.21.15.72:0/289778721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f3c0bf460 0x7f1f3c145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:23.178 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:23.171+0000 7ff03a3bf680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:24:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.171+0000 7f1f3a7fc700 1 --2- 172.21.15.72:0/289778721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f3c0c4300 0x7f1f3c1677e0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f1f3000e930 tx=0x7f1f30009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.172+0000 7f1f22ffd700 1 -- 172.21.15.72:0/289778721 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3000c610 con 0x7f1f3c0c4300 2023-08-31T19:24:23.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.172+0000 7f1f22ffd700 1 -- 172.21.15.72:0/289778721 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3000c770 con 0x7f1f3c0c4300 2023-08-31T19:24:23.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.172+0000 7f1f22ffd700 1 -- 172.21.15.72:0/289778721 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3000caf0 con 0x7f1f3c0c4300 2023-08-31T19:24:23.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.172+0000 7f1f415ff700 1 -- 172.21.15.72:0/289778721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3c0ae260 con 0x7f1f3c0c4300 2023-08-31T19:24:23.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.172+0000 7f1f415ff700 1 -- 172.21.15.72:0/289778721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c0c03a0 con 0x7f1f3c0c4300 2023-08-31T19:24:23.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.173+0000 7f1f415ff700 1 -- 172.21.15.72:0/289778721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3c0c0200 con 0x7f1f3c0c4300 2023-08-31T19:24:23.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.175+0000 7f1f22ffd700 1 -- 172.21.15.72:0/289778721 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 76) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f1f3001b400 con 0x7f1f3c0c4300 2023-08-31T19:24:23.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.176+0000 7f1f22ffd700 1 --2- 172.21.15.72:0/289778721 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1f2805ef30 0x7f1f280613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:23.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.176+0000 7f1f22ffd700 1 -- 172.21.15.72:0/289778721 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 7293+0+0 (secure 0 0 0) 0x7f1f3007a940 con 0x7f1f3c0c4300 2023-08-31T19:24:23.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.176+0000 7f1f3affd700 1 -- 172.21.15.72:0/289778721 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1f2805ef30 msgr2=0x7f1f280613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:23.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.176+0000 7f1f3affd700 1 --2- 172.21.15.72:0/289778721 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1f2805ef30 0x7f1f280613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:24:23.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.180+0000 7f1f22ffd700 1 -- 172.21.15.72:0/289778721 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1f3c0c0200 con 0x7f1f3c0c4300 2023-08-31T19:24:23.212 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:23.211+0000 7ff1a326c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:24:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.377+0000 7f1f3affd700 1 -- 172.21.15.72:0/289778721 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1f2805ef30 msgr2=0x7f1f280613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.377+0000 7f1f3affd700 1 --2- 172.21.15.72:0/289778721 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1f2805ef30 0x7f1f280613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:24:23.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.399+0000 7f1f415ff700 1 -- 172.21.15.72:0/289778721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f3c0c0200 con 0x7f1f3c0c4300 2023-08-31T19:24:23.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.399+0000 7f1f22ffd700 1 -- 172.21.15.72:0/289778721 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f1f3c0c0200 con 0x7f1f3c0c4300 2023-08-31T19:24:23.400 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:23.400 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6926,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2210268438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2210268438},{"type":"v1","addr":"172.21.15.72:6836","nonce":2210268438}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3842453419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3842453419},{"type":"v1","addr":"172.21.15.146:6834","nonce":3842453419}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/282510582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":282510582},{"type":"v1","addr":"172.21.15.146:6835","nonce":282510582}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:07:57.873694+0000","modified":"2023-08-31T19:08:00.883204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8487":{"gid":8487,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3274545863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3274545863},{"type":"v1","addr":"172.21.15.72:6837","nonce":3274545863}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-31T19:24:23.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.402+0000 7f1f415ff700 1 -- 172.21.15.72:0/289778721 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1f2805ef30 msgr2=0x7f1f280613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:24:23.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.402+0000 7f1f415ff700 1 --2- 172.21.15.72:0/289778721 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1f2805ef30 0x7f1f280613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:23.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.402+0000 7f1f415ff700 1 -- 172.21.15.72:0/289778721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f3c0c4300 msgr2=0x7f1f3c1677e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:23.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.402+0000 7f1f415ff700 1 --2- 172.21.15.72:0/289778721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f3c0c4300 0x7f1f3c1677e0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f1f3000e930 tx=0x7f1f30009060).stop 2023-08-31T19:24:23.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.402+0000 7f1f415ff700 1 -- 172.21.15.72:0/289778721 shutdown_connections 2023-08-31T19:24:23.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.402+0000 7f1f415ff700 1 --2- 172.21.15.72:0/289778721 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1f2805ef30 0x7f1f280613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:23.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.402+0000 7f1f415ff700 1 --2- 172.21.15.72:0/289778721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1f3c1541a0 0x7f1f3c167cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:23.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.402+0000 7f1f415ff700 1 --2- 172.21.15.72:0/289778721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1f3c0bf460 0x7f1f3c145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:23.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.402+0000 7f1f415ff700 1 --2- 172.21.15.72:0/289778721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f3c0c4300 0x7f1f3c1677e0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:23.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.402+0000 7f1f415ff700 1 -- 172.21.15.72:0/289778721 >> 172.21.15.72:0/289778721 conn(0x7f1f3c082f60 msgr2=0x7f1f3c0c76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:23.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.402+0000 7f1f415ff700 1 -- 172.21.15.72:0/289778721 shutdown_connections 2023-08-31T19:24:23.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.402+0000 7f1f415ff700 1 -- 172.21.15.72:0/289778721 wait complete. 2023-08-31T19:24:23.405 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 71 2023-08-31T19:24:23.405 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:23.404+0000 7ff03a3bf680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:24:23.420 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:24:23.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.653+0000 7f2727dff700 1 Processor -- start 2023-08-31T19:24:23.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.653+0000 7f2727dff700 1 -- start start 2023-08-31T19:24:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.655+0000 7f2727dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27200bba70 0x7f27200c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.655+0000 7f2727dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27200c26b0 con 0x7f2720156310 2023-08-31T19:24:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.655+0000 7f2727dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27200bc250 con 0x7f2720135030 2023-08-31T19:24:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.655+0000 7f2727dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27200c1e80 con 0x7f27200bba70 2023-08-31T19:24:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.655+0000 7f272539a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2720156310 0x7f27200641e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35156/0 (socket says 172.21.15.72:35156) 2023-08-31T19:24:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.655+0000 7f272539a700 1 -- 172.21.15.72:0/1086577719 learned_addr learned my addr 172.21.15.72:0/1086577719 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.655+0000 7f272639c700 1 --2- 172.21.15.72:0/1086577719 >> v2:172.21.15.72:3300/0 conn(0x7f27200bba70 0x7f27200c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:23.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.655+0000 7f2724b99700 1 -- 172.21.15.72:0/1086577719 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278423535 0 0) 0x7f27200c26b0 con 0x7f2720156310 2023-08-31T19:24:23.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.655+0000 7f2724b99700 1 -- 172.21.15.72:0/1086577719 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f270c0033f0 con 0x7f2720156310 2023-08-31T19:24:23.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.655+0000 7f272639c700 1 -- 172.21.15.72:0/1086577719 >> v1:172.21.15.146:6789/0 conn(0x7f2720135030 legacy=0x7f2720155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:23.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.655+0000 7f2724b99700 1 -- 172.21.15.72:0/1086577719 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939878882 0 0) 0x7f271c001110 con 0x7f2720135030 2023-08-31T19:24:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.655+0000 7f272639c700 1 -- 172.21.15.72:0/1086577719 >> v1:172.21.15.72:6789/0 conn(0x7f2720156310 legacy=0x7f27200641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.655+0000 7f272639c700 1 -- 172.21.15.72:0/1086577719 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27200bbf70 con 0x7f27200bba70 2023-08-31T19:24:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.656+0000 7f272639c700 1 --2- 172.21.15.72:0/1086577719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27200bba70 0x7f27200c7630 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f2718009e60 tx=0x7f2718009780).ready entity=mon.0 client_cookie=ecc77278813e8558 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.656+0000 7f2724b99700 1 -- 172.21.15.72:0/1086577719 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271800e070 con 0x7f27200bba70 2023-08-31T19:24:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.656+0000 7f2724b99700 1 -- 172.21.15.72:0/1086577719 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271800bb60 con 0x7f27200bba70 2023-08-31T19:24:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.656+0000 7f2724b99700 1 -- 172.21.15.72:0/1086577719 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271800bee0 con 0x7f27200bba70 2023-08-31T19:24:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.657+0000 7f2727dff700 1 -- 172.21.15.72:0/1086577719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27200bba70 msgr2=0x7f27200c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.657+0000 7f2727dff700 1 --2- 172.21.15.72:0/1086577719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27200bba70 0x7f27200c7630 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f2718009e60 tx=0x7f2718009780).stop 2023-08-31T19:24:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.657+0000 7f2727dff700 1 -- 172.21.15.72:0/1086577719 shutdown_connections 2023-08-31T19:24:23.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.657+0000 7f2727dff700 1 --2- 172.21.15.72:0/1086577719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27200bba70 0x7f27200c7630 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:23.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.657+0000 7f2727dff700 1 -- 172.21.15.72:0/1086577719 >> 172.21.15.72:0/1086577719 conn(0x7f27200c6b10 msgr2=0x7f27200c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:23.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.657+0000 7f2727dff700 1 -- 172.21.15.72:0/1086577719 shutdown_connections 2023-08-31T19:24:23.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.657+0000 7f2727dff700 1 -- 172.21.15.72:0/1086577719 wait complete. 2023-08-31T19:24:23.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.658+0000 7f2727dff700 1 Processor -- start 2023-08-31T19:24:23.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.658+0000 7f2727dff700 1 -- start start 2023-08-31T19:24:23.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.659+0000 7f2727dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27200bba70 0x7f27200bddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:23.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.659+0000 7f2727dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2720135030 0x7f2720165070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:23.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.659+0000 7f2727dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2720156310 0x7f2720165560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:23.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.659+0000 7f2727dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27200a80e0 con 0x7f2720135030 2023-08-31T19:24:23.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.659+0000 7f2727dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2720165a50 con 0x7f2720156310 2023-08-31T19:24:23.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.659+0000 7f2727dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27200ac2d0 con 0x7f27200bba70 2023-08-31T19:24:23.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.660+0000 7f272539a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2720135030 0x7f2720165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:23.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.660+0000 7f272539a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2720135030 0x7f2720165070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38312/0 (socket says 172.21.15.72:38312) 2023-08-31T19:24:23.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.660+0000 7f272539a700 1 -- 172.21.15.72:0/259543686 learned_addr learned my addr 172.21.15.72:0/259543686 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:23.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.660+0000 7f2725b9b700 1 --2- 172.21.15.72:0/259543686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27200bba70 0x7f27200bddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:23.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.660+0000 7f272639c700 1 --2- 172.21.15.72:0/259543686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2720156310 0x7f2720165560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:23.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.660+0000 7f272539a700 1 -- 172.21.15.72:0/259543686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27200bba70 msgr2=0x7f27200bddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:23.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.660+0000 7f272539a700 1 --2- 172.21.15.72:0/259543686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27200bba70 0x7f27200bddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:23.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.660+0000 7f272539a700 1 -- 172.21.15.72:0/259543686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2720156310 msgr2=0x7f2720165560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:23.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.660+0000 7f272539a700 1 --2- 172.21.15.72:0/259543686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2720156310 0x7f2720165560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:23.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.660+0000 7f272539a700 1 -- 172.21.15.72:0/259543686 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2718009a20 con 0x7f2720135030 2023-08-31T19:24:23.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.660+0000 7f272539a700 1 --2- 172.21.15.72:0/259543686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2720135030 0x7f2720165070 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f271000c420 tx=0x7f2710007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:23.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.660+0000 7f2715ffb700 1 -- 172.21.15.72:0/259543686 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100070d0 con 0x7f2720135030 2023-08-31T19:24:23.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.660+0000 7f2715ffb700 1 -- 172.21.15.72:0/259543686 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2710007230 con 0x7f2720135030 2023-08-31T19:24:23.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.660+0000 7f2715ffb700 1 -- 172.21.15.72:0/259543686 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100075d0 con 0x7f2720135030 2023-08-31T19:24:23.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.661+0000 7f2727dff700 1 -- 172.21.15.72:0/259543686 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27200a77b0 con 0x7f2720135030 2023-08-31T19:24:23.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.661+0000 7f2727dff700 1 -- 172.21.15.72:0/259543686 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27200a7d70 con 0x7f2720135030 2023-08-31T19:24:23.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.662+0000 7f2727dff700 1 -- 172.21.15.72:0/259543686 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27200a8250 con 0x7f2720135030 2023-08-31T19:24:23.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.663+0000 7f2715ffb700 1 -- 172.21.15.72:0/259543686 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 76) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f27100059b0 con 0x7f2720135030 2023-08-31T19:24:23.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.663+0000 7f2715ffb700 1 --2- 172.21.15.72:0/259543686 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f270405ef30 0x7f27040613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:23.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.664+0000 7f2715ffb700 1 -- 172.21.15.72:0/259543686 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 7293+0+0 (secure 0 0 0) 0x7f2710079ac0 con 0x7f2720135030 2023-08-31T19:24:23.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.664+0000 7f2725b9b700 1 -- 172.21.15.72:0/259543686 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f270405ef30 msgr2=0x7f27040613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:23.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.664+0000 7f2725b9b700 1 --2- 172.21.15.72:0/259543686 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f270405ef30 0x7f27040613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:24:23.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.667+0000 7f2715ffb700 1 -- 172.21.15.72:0/259543686 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f271004a860 con 0x7f2720135030 2023-08-31T19:24:23.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.865+0000 7f2725b9b700 1 -- 172.21.15.72:0/259543686 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f270405ef30 msgr2=0x7f27040613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:23.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.865+0000 7f2725b9b700 1 --2- 172.21.15.72:0/259543686 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f270405ef30 0x7f27040613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:24:23.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.867+0000 7f2727dff700 1 -- 172.21.15.72:0/259543686 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27200ac410 con 0x7f2720135030 2023-08-31T19:24:23.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.868+0000 7f2715ffb700 1 -- 172.21.15.72:0/259543686 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+18820 (secure 0 0 0) 0x7f2710018070 con 0x7f2720135030 2023-08-31T19:24:23.869 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:23.869 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":162,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:24:22.963735+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:07:56.316526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-31T19:07:56.862239+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":162,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.13","mappings":[{"from":2,"to":5}]},{"pgid":"19.21","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/239009245":"2023-09-01T19:19:21.790169+0000","172.21.15.72:0/1709110334":"2023-09-01T19:19:21.790169+0000","172.21.15.72:0/1362138661":"2023-09-01T19:19:21.790169+0000","172.21.15.72:0/1373642977":"2023-09-01T19:19:21.790169+0000","172.21.15.72:0/1566749110":"2023-09-01T19:08:12.110328+0000","172.21.15.72:0/3516462257":"2023-09-01T19:08:12.110328+0000","172.21.15.72:0/2378011275":"2023-09-01T19:08:12.110328+0000","172.21.15.72:6833/143463":"2023-09-01T19:08:12.110328+0000","172.21.15.72:6832/143463":"2023-09-01T19:08:12.110328+0000","172.21.15.72:0/3869446728":"2023-09-01T19:08:12.110328+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:24:23.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.870+0000 7f2727dff700 1 -- 172.21.15.72:0/259543686 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f270405ef30 msgr2=0x7f27040613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:24:23.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.870+0000 7f2727dff700 1 --2- 172.21.15.72:0/259543686 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f270405ef30 0x7f27040613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:23.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.870+0000 7f2727dff700 1 -- 172.21.15.72:0/259543686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2720135030 msgr2=0x7f2720165070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:23.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.870+0000 7f2727dff700 1 --2- 172.21.15.72:0/259543686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2720135030 0x7f2720165070 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f271000c420 tx=0x7f2710007c10).stop 2023-08-31T19:24:23.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.870+0000 7f2727dff700 1 -- 172.21.15.72:0/259543686 shutdown_connections 2023-08-31T19:24:23.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.870+0000 7f2727dff700 1 --2- 172.21.15.72:0/259543686 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f270405ef30 0x7f27040613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:23.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.870+0000 7f2727dff700 1 --2- 172.21.15.72:0/259543686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2720156310 0x7f2720165560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:23.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.870+0000 7f2727dff700 1 --2- 172.21.15.72:0/259543686 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f27200bba70 0x7f27200bddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:23.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.870+0000 7f2727dff700 1 --2- 172.21.15.72:0/259543686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2720135030 0x7f2720165070 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:23.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.870+0000 7f2727dff700 1 -- 172.21.15.72:0/259543686 >> 172.21.15.72:0/259543686 conn(0x7f27200c6b10 msgr2=0x7f2720152460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:23.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.871+0000 7f2727dff700 1 -- 172.21.15.72:0/259543686 shutdown_connections 2023-08-31T19:24:23.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:23.871+0000 7f2727dff700 1 -- 172.21.15.72:0/259543686 wait complete. 2023-08-31T19:24:23.889 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T19:24:23.889 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:24:24.073 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:24.073+0000 7ff1a326c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:24:24.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.082+0000 7fc81efff700 1 Processor -- start 2023-08-31T19:24:24.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.082+0000 7fc81efff700 1 -- start start 2023-08-31T19:24:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.083+0000 7fc81efff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8180c6c30 0x7fc8180bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.084+0000 7fc81efff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8181583f0 0x7fc8180c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.084+0000 7fc81efff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc818063be0 con 0x7fc8180c4740 2023-08-31T19:24:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.084+0000 7fc81efff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc818063010 con 0x7fc8181583f0 2023-08-31T19:24:24.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.084+0000 7fc81efff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8180632b0 con 0x7fc8180c6c30 2023-08-31T19:24:24.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.084+0000 7fc81cd9b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8180c6c30 0x7fc8180bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:24.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.084+0000 7fc81d59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8181583f0 0x7fc8180c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:24.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.084+0000 7fc817fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc8180c4740 0x7fc818157ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:43550/0 (socket says 172.21.15.72:43550) 2023-08-31T19:24:24.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.084+0000 7fc817fff700 1 -- 172.21.15.72:0/3796781199 learned_addr learned my addr 172.21.15.72:0/3796781199 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:24.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.084+0000 7fc8177fe700 1 -- 172.21.15.72:0/3796781199 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374449600 0 0) 0x7fc818063be0 con 0x7fc8180c4740 2023-08-31T19:24:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.084+0000 7fc8177fe700 1 -- 172.21.15.72:0/3796781199 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8080033f0 con 0x7fc8180c4740 2023-08-31T19:24:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.085+0000 7fc81cd9b700 1 -- 172.21.15.72:0/3796781199 >> v2:172.21.15.146:3300/0 conn(0x7fc8181583f0 msgr2=0x7fc8180c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.085+0000 7fc81cd9b700 1 --2- 172.21.15.72:0/3796781199 >> v2:172.21.15.146:3300/0 conn(0x7fc8181583f0 0x7fc8180c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.085+0000 7fc81cd9b700 1 -- 172.21.15.72:0/3796781199 >> v1:172.21.15.146:6789/0 conn(0x7fc8180c4740 legacy=0x7fc818157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.085+0000 7fc81cd9b700 1 -- 172.21.15.72:0/3796781199 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc818063590 con 0x7fc8180c6c30 2023-08-31T19:24:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.085+0000 7fc81d59c700 1 --2- 172.21.15.72:0/3796781199 >> v2:172.21.15.146:3300/0 conn(0x7fc8181583f0 0x7fc8180c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:24.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.085+0000 7fc81cd9b700 1 --2- 172.21.15.72:0/3796781199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8180c6c30 0x7fc8180bc300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fc80c009760 tx=0x7fc80c009060).ready entity=mon.2 client_cookie=79509194cbcb18c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:24.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.085+0000 7fc8177fe700 1 -- 172.21.15.72:0/3796781199 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c00d4a0 con 0x7fc8180c6c30 2023-08-31T19:24:24.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.085+0000 7fc8177fe700 1 -- 172.21.15.72:0/3796781199 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80c00d600 con 0x7fc8180c6c30 2023-08-31T19:24:24.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.085+0000 7fc8177fe700 1 -- 172.21.15.72:0/3796781199 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c00d980 con 0x7fc8180c6c30 2023-08-31T19:24:24.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.086+0000 7fc81efff700 1 -- 172.21.15.72:0/3796781199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8180c6c30 msgr2=0x7fc8180bc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:24.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.086+0000 7fc81efff700 1 --2- 172.21.15.72:0/3796781199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8180c6c30 0x7fc8180bc300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fc80c009760 tx=0x7fc80c009060).stop 2023-08-31T19:24:24.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.086+0000 7fc81efff700 1 -- 172.21.15.72:0/3796781199 shutdown_connections 2023-08-31T19:24:24.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.086+0000 7fc81efff700 1 --2- 172.21.15.72:0/3796781199 >> v2:172.21.15.146:3300/0 conn(0x7fc8181583f0 0x7fc8180c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.086+0000 7fc81efff700 1 --2- 172.21.15.72:0/3796781199 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8180c6c30 0x7fc8180bc300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.086+0000 7fc81efff700 1 -- 172.21.15.72:0/3796781199 >> 172.21.15.72:0/3796781199 conn(0x7fc8180c7e70 msgr2=0x7fc8180c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:24.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.086+0000 7fc81efff700 1 -- 172.21.15.72:0/3796781199 shutdown_connections 2023-08-31T19:24:24.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.086+0000 7fc81efff700 1 -- 172.21.15.72:0/3796781199 wait complete. 2023-08-31T19:24:24.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.087+0000 7fc81efff700 1 Processor -- start 2023-08-31T19:24:24.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.088+0000 7fc81efff700 1 -- start start 2023-08-31T19:24:24.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.088+0000 7fc81efff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180c4740 0x7fc8181507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.088+0000 7fc81efff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180c6c30 0x7fc81815a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.088+0000 7fc81efff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8181583f0 0x7fc8180a6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.088+0000 7fc81efff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc818138950 con 0x7fc8180c6c30 2023-08-31T19:24:24.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.088+0000 7fc81efff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc818137d40 con 0x7fc8180c4740 2023-08-31T19:24:24.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.088+0000 7fc81efff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc818138020 con 0x7fc8181583f0 2023-08-31T19:24:24.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.089+0000 7fc81cd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180c4740 0x7fc8181507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:24.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.089+0000 7fc817fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180c6c30 0x7fc81815a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:24.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.089+0000 7fc81cd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180c4740 0x7fc8181507f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:54848/0 (socket says 172.21.15.72:54848) 2023-08-31T19:24:24.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.089+0000 7fc81cd9b700 1 -- 172.21.15.72:0/3131428340 learned_addr learned my addr 172.21.15.72:0/3131428340 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:24.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.089+0000 7fc81d59c700 1 --2- 172.21.15.72:0/3131428340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8181583f0 0x7fc8180a6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:24.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.089+0000 7fc81cd9b700 1 -- 172.21.15.72:0/3131428340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8181583f0 msgr2=0x7fc8180a6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:24.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.089+0000 7fc81cd9b700 1 --2- 172.21.15.72:0/3131428340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8181583f0 0x7fc8180a6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.089+0000 7fc81cd9b700 1 -- 172.21.15.72:0/3131428340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180c6c30 msgr2=0x7fc81815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:24.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.089+0000 7fc81cd9b700 1 --2- 172.21.15.72:0/3131428340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180c6c30 0x7fc81815a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.089+0000 7fc81cd9b700 1 -- 172.21.15.72:0/3131428340 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc810009a20 con 0x7fc8180c4740 2023-08-31T19:24:24.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.089+0000 7fc81d59c700 1 --2- 172.21.15.72:0/3131428340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8181583f0 0x7fc8180a6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:24.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.089+0000 7fc81cd9b700 1 --2- 172.21.15.72:0/3131428340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180c4740 0x7fc8181507f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fc80c009d50 tx=0x7fc80c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:24.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.090+0000 7fc814ff9700 1 -- 172.21.15.72:0/3131428340 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c00dd30 con 0x7fc8180c4740 2023-08-31T19:24:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.090+0000 7fc814ff9700 1 -- 172.21.15.72:0/3131428340 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80c00de90 con 0x7fc8180c4740 2023-08-31T19:24:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.090+0000 7fc81efff700 1 -- 172.21.15.72:0/3131428340 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80c0092a0 con 0x7fc8180c4740 2023-08-31T19:24:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.090+0000 7fc814ff9700 1 -- 172.21.15.72:0/3131428340 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c00d980 con 0x7fc8180c4740 2023-08-31T19:24:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.090+0000 7fc81efff700 1 -- 172.21.15.72:0/3131428340 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8181385e0 con 0x7fc8180c4740 2023-08-31T19:24:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.091+0000 7fc81efff700 1 -- 172.21.15.72:0/3131428340 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc818138c30 con 0x7fc8180c4740 2023-08-31T19:24:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.092+0000 7fc814ff9700 1 -- 172.21.15.72:0/3131428340 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 76) v1 ==== 75386+0+0 (secure 0 0 0) 0x7fc80c01d640 con 0x7fc8180c4740 2023-08-31T19:24:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.093+0000 7fc814ff9700 1 --2- 172.21.15.72:0/3131428340 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc7fc05ef30 0x7fc7fc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.093+0000 7fc817fff700 1 -- 172.21.15.72:0/3131428340 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc7fc05ef30 msgr2=0x7fc7fc0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.093+0000 7fc814ff9700 1 -- 172.21.15.72:0/3131428340 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 7293+0+0 (secure 0 0 0) 0x7fc80c07bcc0 con 0x7fc8180c4740 2023-08-31T19:24:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.093+0000 7fc817fff700 1 --2- 172.21.15.72:0/3131428340 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc7fc05ef30 0x7fc7fc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:24:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.097+0000 7fc814ff9700 1 -- 172.21.15.72:0/3131428340 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc80c082080 con 0x7fc8180c4740 2023-08-31T19:24:24.162 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:24.162+0000 7ff1a326c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:24:24.256 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:24.255+0000 7ff1a326c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:24:24.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.294+0000 7fc817fff700 1 -- 172.21.15.72:0/3131428340 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc7fc05ef30 msgr2=0x7fc7fc0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:24.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.294+0000 7fc817fff700 1 --2- 172.21.15.72:0/3131428340 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc7fc05ef30 0x7fc7fc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:24:24.306 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:24.306+0000 7ff03a3bf680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:24:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.311+0000 7fc81efff700 1 -- 172.21.15.72:0/3131428340 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc81806c6b0 con 0x7fc8180c4740 2023-08-31T19:24:24.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.312+0000 7fc814ff9700 1 -- 172.21.15.72:0/3131428340 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fc80c04ca60 con 0x7fc8180c4740 2023-08-31T19:24:24.312 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:24.313 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6926,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2210268438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2210268438},{"type":"v1","addr":"172.21.15.72:6836","nonce":2210268438}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3842453419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3842453419},{"type":"v1","addr":"172.21.15.146:6834","nonce":3842453419}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/282510582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":282510582},{"type":"v1","addr":"172.21.15.146:6835","nonce":282510582}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:07:57.873694+0000","modified":"2023-08-31T19:08:00.883204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8487":{"gid":8487,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3274545863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3274545863},{"type":"v1","addr":"172.21.15.72:6837","nonce":3274545863}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-31T19:24:24.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.314+0000 7fc81efff700 1 -- 172.21.15.72:0/3131428340 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc7fc05ef30 msgr2=0x7fc7fc0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:24:24.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.314+0000 7fc81efff700 1 --2- 172.21.15.72:0/3131428340 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc7fc05ef30 0x7fc7fc0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:24.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.314+0000 7fc81efff700 1 -- 172.21.15.72:0/3131428340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180c4740 msgr2=0x7fc8181507f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:24.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.314+0000 7fc81efff700 1 --2- 172.21.15.72:0/3131428340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180c4740 0x7fc8181507f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fc80c009d50 tx=0x7fc80c016000).stop 2023-08-31T19:24:24.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.314+0000 7fc81efff700 1 -- 172.21.15.72:0/3131428340 shutdown_connections 2023-08-31T19:24:24.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.314+0000 7fc81efff700 1 --2- 172.21.15.72:0/3131428340 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc7fc05ef30 0x7fc7fc0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:24.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.314+0000 7fc81efff700 1 --2- 172.21.15.72:0/3131428340 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8181583f0 0x7fc8180a6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.314+0000 7fc81efff700 1 --2- 172.21.15.72:0/3131428340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8180c4740 0x7fc8181507f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.314+0000 7fc81efff700 1 --2- 172.21.15.72:0/3131428340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180c6c30 0x7fc81815a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.314+0000 7fc81efff700 1 -- 172.21.15.72:0/3131428340 >> 172.21.15.72:0/3131428340 conn(0x7fc8180c7e70 msgr2=0x7fc818152270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.314+0000 7fc81efff700 1 -- 172.21.15.72:0/3131428340 shutdown_connections 2023-08-31T19:24:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.314+0000 7fc81efff700 1 -- 172.21.15.72:0/3131428340 wait complete. 2023-08-31T19:24:24.317 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 71 2023-08-31T19:24:24.332 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:24:24.399 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:24.399+0000 7ff03a3bf680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:24:24.439 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:24.439+0000 7ff1a326c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:24:24.497 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:24.497+0000 7ff03a3bf680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:24:24.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.526+0000 7ffaa6bff700 1 Processor -- start 2023-08-31T19:24:24.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.526+0000 7ffaa6bff700 1 -- start start 2023-08-31T19:24:24.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.527+0000 7ffaa6bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa0151eb0 0x7ffaa00bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.527+0000 7ffaa6bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffaa00a7bc0 0x7ffaa00a8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.527+0000 7ffaa6bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffaa00c5330 0x7ffaa00c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.527+0000 7ffaa6bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa00be610 con 0x7ffaa00a7bc0 2023-08-31T19:24:24.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.527+0000 7ffaa6bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa00be8f0 con 0x7ffaa00c5330 2023-08-31T19:24:24.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.527+0000 7ffaa6bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa00bebd0 con 0x7ffaa0151eb0 2023-08-31T19:24:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.527+0000 7ffa9ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffaa00a7bc0 0x7ffaa00a8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.527+0000 7ffa9ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffaa00a7bc0 0x7ffaa00a8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38320/0 (socket says 172.21.15.72:38320) 2023-08-31T19:24:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.527+0000 7ffa9ffff700 1 -- 172.21.15.72:0/1794314399 learned_addr learned my addr 172.21.15.72:0/1794314399 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.527+0000 7ffaa519c700 1 --2- 172.21.15.72:0/1794314399 >> v2:172.21.15.146:3300/0 conn(0x7ffaa00c5330 0x7ffaa00c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.527+0000 7ffaa499b700 1 --2- 172.21.15.72:0/1794314399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa0151eb0 0x7ffaa00bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:24.530 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:24.528+0000 7ff1a326c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:24:24.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.528+0000 7ffa9ffff700 1 -- 172.21.15.72:0/1794314399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa0151eb0 msgr2=0x7ffaa00bf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:24.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.528+0000 7ffa9ffff700 1 --2- 172.21.15.72:0/1794314399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa0151eb0 0x7ffaa00bf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.528+0000 7ffa9ffff700 1 -- 172.21.15.72:0/1794314399 >> v2:172.21.15.146:3300/0 conn(0x7ffaa00c5330 msgr2=0x7ffaa00c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:24.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.528+0000 7ffa9ffff700 1 --2- 172.21.15.72:0/1794314399 >> v2:172.21.15.146:3300/0 conn(0x7ffaa00c5330 0x7ffaa00c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.528+0000 7ffa9ffff700 1 -- 172.21.15.72:0/1794314399 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa00beeb0 con 0x7ffaa00a7bc0 2023-08-31T19:24:24.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.528+0000 7ffa9ffff700 1 --2- 172.21.15.72:0/1794314399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa00a7bc0 0x7ffaa00a8040 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7ffaa00c3190 tx=0x7ffa8c0090f0).ready entity=mon.0 client_cookie=a9d9abf2fbebc8a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:24.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.528+0000 7ffa9f7fe700 1 -- 172.21.15.72:0/1794314399 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c00f510 con 0x7ffaa00a7bc0 2023-08-31T19:24:24.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.528+0000 7ffa9f7fe700 1 -- 172.21.15.72:0/1794314399 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c00f670 con 0x7ffaa00a7bc0 2023-08-31T19:24:24.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.528+0000 7ffa9f7fe700 1 -- 172.21.15.72:0/1794314399 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c00f9f0 con 0x7ffaa00a7bc0 2023-08-31T19:24:24.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.529+0000 7ffaa6bff700 1 -- 172.21.15.72:0/1794314399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa00a7bc0 msgr2=0x7ffaa00a8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:24.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.529+0000 7ffaa6bff700 1 --2- 172.21.15.72:0/1794314399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa00a7bc0 0x7ffaa00a8040 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7ffaa00c3190 tx=0x7ffa8c0090f0).stop 2023-08-31T19:24:24.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.529+0000 7ffaa6bff700 1 -- 172.21.15.72:0/1794314399 shutdown_connections 2023-08-31T19:24:24.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.529+0000 7ffaa6bff700 1 --2- 172.21.15.72:0/1794314399 >> v2:172.21.15.146:3300/0 conn(0x7ffaa00c5330 0x7ffaa00c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.529+0000 7ffaa6bff700 1 --2- 172.21.15.72:0/1794314399 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa0151eb0 0x7ffaa00bf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.529+0000 7ffaa6bff700 1 --2- 172.21.15.72:0/1794314399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa00a7bc0 0x7ffaa00a8040 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.529+0000 7ffaa6bff700 1 -- 172.21.15.72:0/1794314399 >> 172.21.15.72:0/1794314399 conn(0x7ffaa0082f60 msgr2=0x7ffaa005e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:24.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.529+0000 7ffaa6bff700 1 -- 172.21.15.72:0/1794314399 shutdown_connections 2023-08-31T19:24:24.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.529+0000 7ffaa6bff700 1 -- 172.21.15.72:0/1794314399 wait complete. 2023-08-31T19:24:24.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.531+0000 7ffaa6bff700 1 Processor -- start 2023-08-31T19:24:24.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.531+0000 7ffaa6bff700 1 -- start start 2023-08-31T19:24:24.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffaa6bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa00a7bc0 0x7ffaa014cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffaa6bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa00c5330 0x7ffaa00bfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffaa6bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0151eb0 0x7ffaa0150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffaa6bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa014fa50 con 0x7ffaa0151eb0 2023-08-31T19:24:24.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffaa6bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa014bef0 con 0x7ffaa00a7bc0 2023-08-31T19:24:24.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffaa6bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa014fc60 con 0x7ffaa00c5330 2023-08-31T19:24:24.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffaa519c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0151eb0 0x7ffaa0150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:24.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffaa519c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0151eb0 0x7ffaa0150a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38332/0 (socket says 172.21.15.72:38332) 2023-08-31T19:24:24.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffaa519c700 1 -- 172.21.15.72:0/2666106483 learned_addr learned my addr 172.21.15.72:0/2666106483 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffa9ffff700 1 --2- 172.21.15.72:0/2666106483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa00c5330 0x7ffaa00bfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffaa499b700 1 --2- 172.21.15.72:0/2666106483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa00a7bc0 0x7ffaa014cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffaa519c700 1 -- 172.21.15.72:0/2666106483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa00c5330 msgr2=0x7ffaa00bfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffaa519c700 1 --2- 172.21.15.72:0/2666106483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa00c5330 0x7ffaa00bfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffaa519c700 1 -- 172.21.15.72:0/2666106483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa00a7bc0 msgr2=0x7ffaa014cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:24.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffaa519c700 1 --2- 172.21.15.72:0/2666106483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa00a7bc0 0x7ffaa014cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.532+0000 7ffaa519c700 1 -- 172.21.15.72:0/2666106483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c009370 con 0x7ffaa0151eb0 2023-08-31T19:24:24.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.533+0000 7ffaa519c700 1 --2- 172.21.15.72:0/2666106483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0151eb0 0x7ffaa0150a20 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7ffa98009ec0 tx=0x7ffa9800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:24.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.533+0000 7ffa9cff9700 1 -- 172.21.15.72:0/2666106483 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9800cb70 con 0x7ffaa0151eb0 2023-08-31T19:24:24.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.533+0000 7ffa9cff9700 1 -- 172.21.15.72:0/2666106483 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9800f040 con 0x7ffaa0151eb0 2023-08-31T19:24:24.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.533+0000 7ffaa6bff700 1 -- 172.21.15.72:0/2666106483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa014ff40 con 0x7ffaa0151eb0 2023-08-31T19:24:24.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.533+0000 7ffa9cff9700 1 -- 172.21.15.72:0/2666106483 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9800cee0 con 0x7ffaa0151eb0 2023-08-31T19:24:24.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.533+0000 7ffaa6bff700 1 -- 172.21.15.72:0/2666106483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa0150500 con 0x7ffaa0151eb0 2023-08-31T19:24:24.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.534+0000 7ffaa6bff700 1 -- 172.21.15.72:0/2666106483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa01506f0 con 0x7ffaa0151eb0 2023-08-31T19:24:24.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.535+0000 7ffa9cff9700 1 -- 172.21.15.72:0/2666106483 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 76) v1 ==== 75386+0+0 (secure 0 0 0) 0x7ffa98036970 con 0x7ffaa0151eb0 2023-08-31T19:24:24.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.536+0000 7ffa9cff9700 1 --2- 172.21.15.72:0/2666106483 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ffa8405ef30 0x7ffa840613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.537+0000 7ffaa499b700 1 -- 172.21.15.72:0/2666106483 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ffa8405ef30 msgr2=0x7ffa840613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:24.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.537+0000 7ffa9cff9700 1 -- 172.21.15.72:0/2666106483 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 7293+0+0 (secure 0 0 0) 0x7ffa9807aea0 con 0x7ffaa0151eb0 2023-08-31T19:24:24.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.537+0000 7ffaa499b700 1 --2- 172.21.15.72:0/2666106483 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ffa8405ef30 0x7ffa840613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:24:24.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.540+0000 7ffa9cff9700 1 -- 172.21.15.72:0/2666106483 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffa9804bcc0 con 0x7ffaa0151eb0 2023-08-31T19:24:24.669 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:24.669+0000 7ff1a326c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:24:24.690 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:24.690+0000 7ff03a3bf680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:24:24.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.738+0000 7ffaa499b700 1 -- 172.21.15.72:0/2666106483 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ffa8405ef30 msgr2=0x7ffa840613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:24.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.738+0000 7ffaa499b700 1 --2- 172.21.15.72:0/2666106483 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ffa8405ef30 0x7ffa840613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:24:24.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.757+0000 7ffaa6bff700 1 -- 172.21.15.72:0/2666106483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffaa006c6b0 con 0x7ffaa0151eb0 2023-08-31T19:24:24.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.758+0000 7ffa9cff9700 1 -- 172.21.15.72:0/2666106483 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4494 (secure 0 0 0) 0x7ffa98078e60 con 0x7ffaa0151eb0 2023-08-31T19:24:24.758 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:24.759 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":71,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6926,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2210268438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2210268438},{"type":"v1","addr":"172.21.15.72:6836","nonce":2210268438}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3842453419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3842453419},{"type":"v1","addr":"172.21.15.146:6834","nonce":3842453419}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/282510582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":282510582},{"type":"v1","addr":"172.21.15.146:6835","nonce":282510582}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:07:57.873694+0000","modified":"2023-08-31T19:08:00.883204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8487":{"gid":8487,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3274545863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3274545863},{"type":"v1","addr":"172.21.15.72:6837","nonce":3274545863}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-31T19:24:24.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.760+0000 7ffaa6bff700 1 -- 172.21.15.72:0/2666106483 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ffa8405ef30 msgr2=0x7ffa840613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:24:24.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.760+0000 7ffaa6bff700 1 --2- 172.21.15.72:0/2666106483 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ffa8405ef30 0x7ffa840613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:24.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.760+0000 7ffaa6bff700 1 -- 172.21.15.72:0/2666106483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0151eb0 msgr2=0x7ffaa0150a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:24.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.760+0000 7ffaa6bff700 1 --2- 172.21.15.72:0/2666106483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0151eb0 0x7ffaa0150a20 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7ffa98009ec0 tx=0x7ffa9800b040).stop 2023-08-31T19:24:24.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.760+0000 7ffaa6bff700 1 -- 172.21.15.72:0/2666106483 shutdown_connections 2023-08-31T19:24:24.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.760+0000 7ffaa6bff700 1 --2- 172.21.15.72:0/2666106483 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ffa8405ef30 0x7ffa840613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:24.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.760+0000 7ffaa6bff700 1 --2- 172.21.15.72:0/2666106483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa0151eb0 0x7ffaa0150a20 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.760+0000 7ffaa6bff700 1 --2- 172.21.15.72:0/2666106483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa00a7bc0 0x7ffaa014cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.760+0000 7ffaa6bff700 1 --2- 172.21.15.72:0/2666106483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ffaa00c5330 0x7ffaa00bfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.760+0000 7ffaa6bff700 1 -- 172.21.15.72:0/2666106483 >> 172.21.15.72:0/2666106483 conn(0x7ffaa0082f60 msgr2=0x7ffaa00c6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:24.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.761+0000 7ffaa6bff700 1 -- 172.21.15.72:0/2666106483 shutdown_connections 2023-08-31T19:24:24.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.761+0000 7ffaa6bff700 1 -- 172.21.15.72:0/2666106483 wait complete. 2023-08-31T19:24:24.763 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 71 2023-08-31T19:24:24.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:24:24.784 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:24.784+0000 7ff03a3bf680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:24:24.800 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:24.800+0000 7ff1a326c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:24:24.942 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:24.942+0000 7ff03a3bf680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:24:24.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.982+0000 7f12a2dff700 1 Processor -- start 2023-08-31T19:24:24.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.982+0000 7f12a2dff700 1 -- start start 2023-08-31T19:24:24.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.983+0000 7f12a2dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f129c0c5fb0 0x7f129c0be370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.983+0000 7f12a2dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f129c0be860 0x7f129c0c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.983+0000 7f12a2dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c0bece0 con 0x7f129c0c44a0 2023-08-31T19:24:24.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.983+0000 7f12a2dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129c154690 con 0x7f129c0be860 2023-08-31T19:24:24.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.983+0000 7f12a2dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0bfb20 con 0x7f129c0c5fb0 2023-08-31T19:24:24.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.984+0000 7f129bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f129c0be860 0x7f129c0c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:24.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.984+0000 7f12a139c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f129c0c44a0 0x7f129c157d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35158/0 (socket says 172.21.15.72:35158) 2023-08-31T19:24:24.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.984+0000 7f12a139c700 1 -- 172.21.15.72:0/495364395 learned_addr learned my addr 172.21.15.72:0/495364395 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:24.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.984+0000 7f12a0b9b700 1 --2- 172.21.15.72:0/495364395 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f129c0c5fb0 0x7f129c0be370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:24.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.984+0000 7f129bfff700 1 -- 172.21.15.72:0/495364395 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f129c0c5fb0 msgr2=0x7f129c0be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:24.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.984+0000 7f129bfff700 1 --2- 172.21.15.72:0/495364395 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f129c0c5fb0 0x7f129c0be370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.984+0000 7f129bfff700 1 -- 172.21.15.72:0/495364395 >> v1:172.21.15.72:6789/0 conn(0x7f129c0c44a0 legacy=0x7f129c157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:24.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.984+0000 7f129bfff700 1 -- 172.21.15.72:0/495364395 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c0c4950 con 0x7f129c0be860 2023-08-31T19:24:24.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.984+0000 7f129b7fe700 1 -- 172.21.15.72:0/495364395 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270691668 0 0) 0x7f129c0bece0 con 0x7f129c0c44a0 2023-08-31T19:24:24.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.984+0000 7f129bfff700 1 --2- 172.21.15.72:0/495364395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0be860 0x7f129c0c3fb0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f1288009760 tx=0x7f1288009060).ready entity=mon.0 client_cookie=7ccd07b6fe38a828 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:24.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.984+0000 7f129b7fe700 1 -- 172.21.15.72:0/495364395 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128800f510 con 0x7f129c0be860 2023-08-31T19:24:24.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.985+0000 7f129b7fe700 1 -- 172.21.15.72:0/495364395 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128800f670 con 0x7f129c0be860 2023-08-31T19:24:24.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.985+0000 7f129b7fe700 1 -- 172.21.15.72:0/495364395 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128800f9f0 con 0x7f129c0be860 2023-08-31T19:24:24.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.985+0000 7f12a2dff700 1 -- 172.21.15.72:0/495364395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0be860 msgr2=0x7f129c0c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:24.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.985+0000 7f12a2dff700 1 --2- 172.21.15.72:0/495364395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0be860 0x7f129c0c3fb0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f1288009760 tx=0x7f1288009060).stop 2023-08-31T19:24:24.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.985+0000 7f12a2dff700 1 -- 172.21.15.72:0/495364395 shutdown_connections 2023-08-31T19:24:24.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.985+0000 7f12a2dff700 1 --2- 172.21.15.72:0/495364395 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f129c0c5fb0 0x7f129c0be370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.985+0000 7f12a2dff700 1 --2- 172.21.15.72:0/495364395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0be860 0x7f129c0c3fb0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:24.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.985+0000 7f12a2dff700 1 -- 172.21.15.72:0/495364395 >> 172.21.15.72:0/495364395 conn(0x7f129c082f60 msgr2=0x7f129c05e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:24.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.985+0000 7f12a2dff700 1 -- 172.21.15.72:0/495364395 shutdown_connections 2023-08-31T19:24:24.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.985+0000 7f12a2dff700 1 -- 172.21.15.72:0/495364395 wait complete. 2023-08-31T19:24:24.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.988+0000 7f12a2dff700 1 Processor -- start 2023-08-31T19:24:24.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.988+0000 7f12a2dff700 1 -- start start 2023-08-31T19:24:24.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.989+0000 7f12a2dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f129c0be860 0x7f129c166790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.989+0000 7f12a2dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0c44a0 0x7f129c156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:24.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.989+0000 7f12a2dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f129c0c5fb0 0x7f129c0ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:25.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.989+0000 7f12a2dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0ab530 con 0x7f129c0c44a0 2023-08-31T19:24:25.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.989+0000 7f12a2dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0ace30 con 0x7f129c0be860 2023-08-31T19:24:25.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.989+0000 7f12a2dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0aea20 con 0x7f129c0c5fb0 2023-08-31T19:24:25.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.990+0000 7f129bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0c44a0 0x7f129c156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.990+0000 7f129bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0c44a0 0x7f129c156ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38340/0 (socket says 172.21.15.72:38340) 2023-08-31T19:24:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.990+0000 7f129bfff700 1 -- 172.21.15.72:0/1619827112 learned_addr learned my addr 172.21.15.72:0/1619827112 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.990+0000 7f12a0b9b700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f129c0be860 0x7f129c166790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.990+0000 7f12a139c700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f129c0c5fb0 0x7f129c0ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.990+0000 7f129bfff700 1 -- 172.21.15.72:0/1619827112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f129c0c5fb0 msgr2=0x7f129c0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.990+0000 7f129bfff700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f129c0c5fb0 0x7f129c0ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:25.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.990+0000 7f129bfff700 1 -- 172.21.15.72:0/1619827112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f129c0be860 msgr2=0x7f129c166790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:25.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.990+0000 7f129bfff700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f129c0be860 0x7f129c166790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:25.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.990+0000 7f129bfff700 1 -- 172.21.15.72:0/1619827112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12880092a0 con 0x7f129c0c44a0 2023-08-31T19:24:25.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.990+0000 7f12a0b9b700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f129c0be860 0x7f129c166790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.990+0000 7f12a139c700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f129c0c5fb0 0x7f129c0ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.990+0000 7f129bfff700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0c44a0 0x7f129c156ae0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f1288011000 tx=0x7f1288017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.991+0000 7f1298ff9700 1 -- 172.21.15.72:0/1619827112 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12880117e0 con 0x7f129c0c44a0 2023-08-31T19:24:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.991+0000 7f1298ff9700 1 -- 172.21.15.72:0/1619827112 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1288011960 con 0x7f129c0c44a0 2023-08-31T19:24:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.991+0000 7f1298ff9700 1 -- 172.21.15.72:0/1619827112 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288011d20 con 0x7f129c0c44a0 2023-08-31T19:24:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.991+0000 7f12a2dff700 1 -- 172.21.15.72:0/1619827112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c166d30 con 0x7f129c0c44a0 2023-08-31T19:24:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.991+0000 7f12a2dff700 1 -- 172.21.15.72:0/1619827112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c1672f0 con 0x7f129c0c44a0 2023-08-31T19:24:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.992+0000 7f12a2dff700 1 -- 172.21.15.72:0/1619827112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129c06c6b0 con 0x7f129c0c44a0 2023-08-31T19:24:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.993+0000 7f1298ff9700 1 -- 172.21.15.72:0/1619827112 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 76) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f1288020070 con 0x7f129c0c44a0 2023-08-31T19:24:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.994+0000 7f1298ff9700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f128005ef30 0x7f12800613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.994+0000 7f1298ff9700 1 -- 172.21.15.72:0/1619827112 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 7293+0+0 (secure 0 0 0) 0x7f128807b230 con 0x7f129c0c44a0 2023-08-31T19:24:25.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.994+0000 7f12a0b9b700 1 -- 172.21.15.72:0/1619827112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f128005ef30 msgr2=0x7f12800613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:25.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.994+0000 7f12a0b9b700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f128005ef30 0x7f12800613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:24:25.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:24.997+0000 7f1298ff9700 1 -- 172.21.15.72:0/1619827112 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f128804c090 con 0x7f129c0c44a0 2023-08-31T19:24:25.127 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:25.127+0000 7ff03a3bf680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:24:25.148 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:25.148+0000 7ff1a326c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:24:25.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.195+0000 7f12a0b9b700 1 -- 172.21.15.72:0/1619827112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f128005ef30 msgr2=0x7f12800613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:25.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.195+0000 7f12a0b9b700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f128005ef30 0x7f12800613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:24:25.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.230+0000 7f12a2dff700 1 -- 172.21.15.72:0/1619827112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f129c0c4950 con 0x7f129c0c44a0 2023-08-31T19:24:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.231+0000 7f1298ff9700 1 -- 172.21.15.72:0/1619827112 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+18820 (secure 0 0 0) 0x7f129c0c4950 con 0x7f129c0c44a0 2023-08-31T19:24:25.232 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:25.232 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":162,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:24:22.963735+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:07:56.316526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-31T19:07:56.862239+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":162,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.13","mappings":[{"from":2,"to":5}]},{"pgid":"19.21","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/239009245":"2023-09-01T19:19:21.790169+0000","172.21.15.72:0/1709110334":"2023-09-01T19:19:21.790169+0000","172.21.15.72:0/1362138661":"2023-09-01T19:19:21.790169+0000","172.21.15.72:0/1373642977":"2023-09-01T19:19:21.790169+0000","172.21.15.72:0/1566749110":"2023-09-01T19:08:12.110328+0000","172.21.15.72:0/3516462257":"2023-09-01T19:08:12.110328+0000","172.21.15.72:0/2378011275":"2023-09-01T19:08:12.110328+0000","172.21.15.72:6833/143463":"2023-09-01T19:08:12.110328+0000","172.21.15.72:6832/143463":"2023-09-01T19:08:12.110328+0000","172.21.15.72:0/3869446728":"2023-09-01T19:08:12.110328+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:24:25.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.233+0000 7f12a2dff700 1 -- 172.21.15.72:0/1619827112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f128005ef30 msgr2=0x7f12800613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:24:25.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.233+0000 7f12a2dff700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f128005ef30 0x7f12800613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:25.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.233+0000 7f12a2dff700 1 -- 172.21.15.72:0/1619827112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0c44a0 msgr2=0x7f129c156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:25.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.233+0000 7f12a2dff700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0c44a0 0x7f129c156ae0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f1288011000 tx=0x7f1288017000).stop 2023-08-31T19:24:25.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.233+0000 7f12a2dff700 1 -- 172.21.15.72:0/1619827112 shutdown_connections 2023-08-31T19:24:25.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.233+0000 7f12a2dff700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f128005ef30 0x7f12800613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:25.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.233+0000 7f12a2dff700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f129c0c5fb0 0x7f129c0ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:25.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.233+0000 7f12a2dff700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f129c0be860 0x7f129c166790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:25.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.233+0000 7f12a2dff700 1 --2- 172.21.15.72:0/1619827112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0c44a0 0x7f129c156ae0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:25.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.233+0000 7f12a2dff700 1 -- 172.21.15.72:0/1619827112 >> 172.21.15.72:0/1619827112 conn(0x7f129c082f60 msgr2=0x7f129c0c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:25.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.233+0000 7f12a2dff700 1 -- 172.21.15.72:0/1619827112 shutdown_connections 2023-08-31T19:24:25.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.233+0000 7f12a2dff700 1 -- 172.21.15.72:0/1619827112 wait complete. 2023-08-31T19:24:25.237 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:25.237+0000 7ff1a326c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:24:25.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T19:24:25.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.486+0000 7f14351ff700 1 Processor -- start 2023-08-31T19:24:25.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.487+0000 7f14351ff700 1 -- start start 2023-08-31T19:24:25.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.488+0000 7f14351ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f14300c25e0 0x7f14300c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:25.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.488+0000 7f14351ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1430066d30 0x7f1430065470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:25.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.488+0000 7f14351ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14301588b0 con 0x7f1430154370 2023-08-31T19:24:25.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.488+0000 7f14351ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14300c2d50 con 0x7f14300c25e0 2023-08-31T19:24:25.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.488+0000 7f14351ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14300c2a70 con 0x7f1430066d30 2023-08-31T19:24:25.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.488+0000 7f142ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1430154370 0x7f1430062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35164/0 (socket says 172.21.15.72:35164) 2023-08-31T19:24:25.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.488+0000 7f142ed9d700 1 -- 172.21.15.72:0/3866918800 learned_addr learned my addr 172.21.15.72:0/3866918800 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:25.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.488+0000 7f142e59c700 1 --2- 172.21.15.72:0/3866918800 >> v2:172.21.15.146:3300/0 conn(0x7f14300c25e0 0x7f14300c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:25.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.488+0000 7f142f59e700 1 --2- 172.21.15.72:0/3866918800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1430066d30 0x7f1430065470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:25.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.489+0000 7f142dd9b700 1 -- 172.21.15.72:0/3866918800 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746747285 0 0) 0x7f14301588b0 con 0x7f1430154370 2023-08-31T19:24:25.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.489+0000 7f142dd9b700 1 -- 172.21.15.72:0/3866918800 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14180033f0 con 0x7f1430154370 2023-08-31T19:24:25.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.489+0000 7f142dd9b700 1 -- 172.21.15.72:0/3866918800 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3994099076 0 0) 0x7f14180033f0 con 0x7f1430154370 2023-08-31T19:24:25.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.489+0000 7f142e59c700 1 -- 172.21.15.72:0/3866918800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1430066d30 msgr2=0x7f1430065470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:25.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.489+0000 7f142e59c700 1 --2- 172.21.15.72:0/3866918800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1430066d30 0x7f1430065470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.489+0000 7f142e59c700 1 -- 172.21.15.72:0/3866918800 >> v1:172.21.15.72:6789/0 conn(0x7f1430154370 legacy=0x7f1430062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.489+0000 7f142e59c700 1 -- 172.21.15.72:0/3866918800 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430158260 con 0x7f14300c25e0 2023-08-31T19:24:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.489+0000 7f142f59e700 1 --2- 172.21.15.72:0/3866918800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1430066d30 0x7f1430065470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.489+0000 7f142e59c700 1 --2- 172.21.15.72:0/3866918800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14300c25e0 0x7f14300c8350 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f1424009760 tx=0x7f1424009060).ready entity=mon.1 client_cookie=cd81d1e7d5f3c85a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.489+0000 7f142dd9b700 1 -- 172.21.15.72:0/3866918800 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420001470 con 0x7f14300c25e0 2023-08-31T19:24:25.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.490+0000 7f142dd9b700 1 -- 172.21.15.72:0/3866918800 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1424011400 con 0x7f14300c25e0 2023-08-31T19:24:25.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.490+0000 7f142dd9b700 1 -- 172.21.15.72:0/3866918800 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424011780 con 0x7f14300c25e0 2023-08-31T19:24:25.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.490+0000 7f14351ff700 1 -- 172.21.15.72:0/3866918800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14300c25e0 msgr2=0x7f14300c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:25.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.490+0000 7f14351ff700 1 --2- 172.21.15.72:0/3866918800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14300c25e0 0x7f14300c8350 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f1424009760 tx=0x7f1424009060).stop 2023-08-31T19:24:25.495 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:25.490+0000 7ff03a3bf680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:24:25.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.490+0000 7f14351ff700 1 -- 172.21.15.72:0/3866918800 shutdown_connections 2023-08-31T19:24:25.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.490+0000 7f14351ff700 1 --2- 172.21.15.72:0/3866918800 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1430066d30 0x7f1430065470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:25.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.490+0000 7f14351ff700 1 --2- 172.21.15.72:0/3866918800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14300c25e0 0x7f14300c8350 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:25.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.490+0000 7f14351ff700 1 -- 172.21.15.72:0/3866918800 >> 172.21.15.72:0/3866918800 conn(0x7f1430064230 msgr2=0x7f14300c7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:25.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.490+0000 7f14351ff700 1 -- 172.21.15.72:0/3866918800 shutdown_connections 2023-08-31T19:24:25.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.490+0000 7f14351ff700 1 -- 172.21.15.72:0/3866918800 wait complete. 2023-08-31T19:24:25.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.492+0000 7f14351ff700 1 Processor -- start 2023-08-31T19:24:25.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.493+0000 7f14351ff700 1 -- start start 2023-08-31T19:24:25.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.494+0000 7f14351ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1430066d30 0x7f14300c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:25.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.494+0000 7f14351ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1430154370 0x7f14300c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:25.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.494+0000 7f14351ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1430164c50 0x7f14301650d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:25.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.494+0000 7f14351ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14300c5a10 con 0x7f1430066d30 2023-08-31T19:24:25.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.494+0000 7f14351ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1430153640 con 0x7f1430164c50 2023-08-31T19:24:25.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.494+0000 7f14351ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14300ac5a0 con 0x7f1430154370 2023-08-31T19:24:25.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.494+0000 7f142ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1430066d30 0x7f14300c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:25.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.494+0000 7f142ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1430066d30 0x7f14300c5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38356/0 (socket says 172.21.15.72:38356) 2023-08-31T19:24:25.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.494+0000 7f142ed9d700 1 -- 172.21.15.72:0/3765848724 learned_addr learned my addr 172.21.15.72:0/3765848724 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:25.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.494+0000 7f142e59c700 1 --2- 172.21.15.72:0/3765848724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1430154370 0x7f14300c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:25.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.494+0000 7f142f59e700 1 --2- 172.21.15.72:0/3765848724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1430164c50 0x7f14301650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:25.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.495+0000 7f142ed9d700 1 -- 172.21.15.72:0/3765848724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1430154370 msgr2=0x7f14300c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:25.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.495+0000 7f142ed9d700 1 --2- 172.21.15.72:0/3765848724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1430154370 0x7f14300c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:25.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.495+0000 7f142ed9d700 1 -- 172.21.15.72:0/3765848724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1430164c50 msgr2=0x7f14301650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:25.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.495+0000 7f142ed9d700 1 --2- 172.21.15.72:0/3765848724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1430164c50 0x7f14301650d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:25.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.495+0000 7f142ed9d700 1 -- 172.21.15.72:0/3765848724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1428009a20 con 0x7f1430066d30 2023-08-31T19:24:25.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.495+0000 7f142ed9d700 1 --2- 172.21.15.72:0/3765848724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1430066d30 0x7f14300c5030 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f142000c810 tx=0x7f1420001a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:25.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.495+0000 7f1416ffd700 1 -- 172.21.15.72:0/3765848724 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420007170 con 0x7f1430066d30 2023-08-31T19:24:25.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.495+0000 7f1416ffd700 1 -- 172.21.15.72:0/3765848724 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14200072d0 con 0x7f1430066d30 2023-08-31T19:24:25.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.495+0000 7f14351ff700 1 -- 172.21.15.72:0/3765848724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14240092a0 con 0x7f1430066d30 2023-08-31T19:24:25.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.495+0000 7f1416ffd700 1 -- 172.21.15.72:0/3765848724 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14200048c0 con 0x7f1430066d30 2023-08-31T19:24:25.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.495+0000 7f14351ff700 1 -- 172.21.15.72:0/3765848724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14300c5ed0 con 0x7f1430066d30 2023-08-31T19:24:25.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.496+0000 7f14351ff700 1 -- 172.21.15.72:0/3765848724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143006c6b0 con 0x7f1430066d30 2023-08-31T19:24:25.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.497+0000 7f1416ffd700 1 -- 172.21.15.72:0/3765848724 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 76) v1 ==== 75386+0+0 (secure 0 0 0) 0x7f1420004cb0 con 0x7f1430066d30 2023-08-31T19:24:25.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.498+0000 7f1416ffd700 1 --2- 172.21.15.72:0/3765848724 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f141c05ef30 0x7f141c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:25.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.498+0000 7f1416ffd700 1 -- 172.21.15.72:0/3765848724 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 7293+0+0 (secure 0 0 0) 0x7f1420079ea0 con 0x7f1430066d30 2023-08-31T19:24:25.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.498+0000 7f142e59c700 1 -- 172.21.15.72:0/3765848724 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f141c05ef30 msgr2=0x7f141c0613f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:25.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.498+0000 7f142e59c700 1 --2- 172.21.15.72:0/3765848724 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f141c05ef30 0x7f141c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:24:25.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.502+0000 7f1416ffd700 1 -- 172.21.15.72:0/3765848724 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f142004ad00 con 0x7f1430066d30 2023-08-31T19:24:25.583 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:25.583+0000 7ff03a3bf680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:24:25.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.593+0000 7f1416ffd700 1 -- 172.21.15.72:0/3765848724 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 77) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f1420077660 con 0x7f1430066d30 2023-08-31T19:24:25.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.594+0000 7f1416ffd700 1 -- 172.21.15.72:0/3765848724 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f141c05ef30 msgr2=0x7f141c0613f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:24:25.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.594+0000 7f1416ffd700 1 --2- 172.21.15.72:0/3765848724 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f141c05ef30 0x7f141c0613f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:25.656 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:25.655+0000 7fefb0e89700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:25.656 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:25.655+0000 7fefb0e89700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:25.656 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:25.655+0000 7fefb0e89700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:25.656 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:25.655+0000 7fefb0e89700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:25.657 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:25.655+0000 7fefb0e89700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:25.657 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:25.656+0000 7fefb368e700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:25.657 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:25.656+0000 7fefb368e700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:25.657 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:25.656+0000 7fefb368e700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:25.658 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:25.656+0000 7fefb368e700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:25.658 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:25.656+0000 7fefb368e700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:25.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:25.744+0000 7f14351ff700 1 -- 172.21.15.72:0/3765848724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1430158540 con 0x7f1430066d30 2023-08-31T19:24:26.588 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-08-31T19:24:26.588+0000 7f89d2ff7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T19:24:26.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.592+0000 7f1416ffd700 1 -- 172.21.15.72:0/3765848724 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v72) v1 ==== 161+0+0 (secure 0 0 0) 0x7f142006e4b0 con 0x7f1430066d30 2023-08-31T19:24:26.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.594+0000 7f14351ff700 1 -- 172.21.15.72:0/3765848724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1430066d30 msgr2=0x7f14300c5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:26.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.594+0000 7f14351ff700 1 --2- 172.21.15.72:0/3765848724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1430066d30 0x7f14300c5030 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f142000c810 tx=0x7f1420001a00).stop 2023-08-31T19:24:26.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.594+0000 7f14351ff700 1 -- 172.21.15.72:0/3765848724 shutdown_connections 2023-08-31T19:24:26.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.594+0000 7f14351ff700 1 --2- 172.21.15.72:0/3765848724 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f141c05ef30 0x7f141c0613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:26.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.594+0000 7f14351ff700 1 --2- 172.21.15.72:0/3765848724 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1430164c50 0x7f14301650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.594+0000 7f14351ff700 1 --2- 172.21.15.72:0/3765848724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1430066d30 0x7f14300c5030 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.594+0000 7f14351ff700 1 --2- 172.21.15.72:0/3765848724 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1430154370 0x7f14300c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.594+0000 7f14351ff700 1 -- 172.21.15.72:0/3765848724 >> 172.21.15.72:0/3765848724 conn(0x7f1430064230 msgr2=0x7f1430065470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.594+0000 7f14351ff700 1 -- 172.21.15.72:0/3765848724 shutdown_connections 2023-08-31T19:24:26.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.595+0000 7f14351ff700 1 -- 172.21.15.72:0/3765848724 wait complete. 2023-08-31T19:24:26.597 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T19:24:26.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T19:24:26.660 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-31T19:24:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.819+0000 7f1c057ff700 1 Processor -- start 2023-08-31T19:24:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.819+0000 7f1c057ff700 1 -- start start 2023-08-31T19:24:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.821+0000 7f1c057ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1c000c2320 0x7f1c000c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.821+0000 7f1c057ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c000c2cc0 con 0x7f1c0014ecd0 2023-08-31T19:24:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.821+0000 7f1c057ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c00152720 con 0x7f1c000696a0 2023-08-31T19:24:26.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.821+0000 7f1c057ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c00151b10 con 0x7f1c000c2320 2023-08-31T19:24:26.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.821+0000 7f1bfe7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1c000c2320 0x7f1c000c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:26.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.821+0000 7f1bfeffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1c0014ecd0 0x7f1c001556d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35186/0 (socket says 172.21.15.72:35186) 2023-08-31T19:24:26.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.821+0000 7f1bfeffd700 1 -- 172.21.15.72:0/4039105244 learned_addr learned my addr 172.21.15.72:0/4039105244 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:26.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.821+0000 7f1bfe7fc700 1 -- 172.21.15.72:0/4039105244 >> v1:172.21.15.146:6789/0 conn(0x7f1c000696a0 legacy=0x7f1c00069af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:26.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.822+0000 7f1bfe7fc700 1 -- 172.21.15.72:0/4039105244 >> v1:172.21.15.72:6789/0 conn(0x7f1c0014ecd0 legacy=0x7f1c001556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:26.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.822+0000 7f1bfdffb700 1 -- 172.21.15.72:0/4039105244 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437477733 0 0) 0x7f1bf0001110 con 0x7f1c0014ecd0 2023-08-31T19:24:26.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.822+0000 7f1bfe7fc700 1 -- 172.21.15.72:0/4039105244 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c00151df0 con 0x7f1c000c2320 2023-08-31T19:24:26.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.822+0000 7f1bfe7fc700 1 --2- 172.21.15.72:0/4039105244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c000c2320 0x7f1c000c27d0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f1bf4009760 tx=0x7f1bf4009060).ready entity=mon.0 client_cookie=c2164c16036497ef server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:26.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.822+0000 7f1bfdffb700 1 -- 172.21.15.72:0/4039105244 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf400b520 con 0x7f1c000c2320 2023-08-31T19:24:26.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.822+0000 7f1bfdffb700 1 -- 172.21.15.72:0/4039105244 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf400b680 con 0x7f1c000c2320 2023-08-31T19:24:26.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.822+0000 7f1bfdffb700 1 -- 172.21.15.72:0/4039105244 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf400ba00 con 0x7f1c000c2320 2023-08-31T19:24:26.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.822+0000 7f1c057ff700 1 -- 172.21.15.72:0/4039105244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c000c2320 msgr2=0x7f1c000c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:26.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.822+0000 7f1c057ff700 1 --2- 172.21.15.72:0/4039105244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c000c2320 0x7f1c000c27d0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f1bf4009760 tx=0x7f1bf4009060).stop 2023-08-31T19:24:26.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.823+0000 7f1c057ff700 1 -- 172.21.15.72:0/4039105244 shutdown_connections 2023-08-31T19:24:26.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.823+0000 7f1c057ff700 1 --2- 172.21.15.72:0/4039105244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c000c2320 0x7f1c000c27d0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:26.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.823+0000 7f1c057ff700 1 -- 172.21.15.72:0/4039105244 >> 172.21.15.72:0/4039105244 conn(0x7f1c000630c0 msgr2=0x7f1c000c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:26.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.823+0000 7f1c057ff700 1 -- 172.21.15.72:0/4039105244 shutdown_connections 2023-08-31T19:24:26.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.823+0000 7f1c057ff700 1 -- 172.21.15.72:0/4039105244 wait complete. 2023-08-31T19:24:26.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.825+0000 7f1c057ff700 1 Processor -- start 2023-08-31T19:24:26.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.825+0000 7f1c057ff700 1 -- start start 2023-08-31T19:24:26.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.826+0000 7f1c057ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c000696a0 0x7f1c000bed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:26.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.826+0000 7f1c057ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c000c2320 0x7f1c0014db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:26.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.826+0000 7f1c057ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0014ecd0 0x7f1c00157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:26.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.826+0000 7f1c057ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c000c0310 con 0x7f1c0014ecd0 2023-08-31T19:24:26.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.826+0000 7f1c057ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c000bf700 con 0x7f1c000696a0 2023-08-31T19:24:26.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.826+0000 7f1c057ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c000bf9e0 con 0x7f1c000c2320 2023-08-31T19:24:26.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.826+0000 7f1bff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0014ecd0 0x7f1c00157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:26.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.826+0000 7f1bff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0014ecd0 0x7f1c00157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38484/0 (socket says 172.21.15.72:38484) 2023-08-31T19:24:26.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.826+0000 7f1bff7fe700 1 -- 172.21.15.72:0/4258526752 learned_addr learned my addr 172.21.15.72:0/4258526752 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:26.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.826+0000 7f1bfeffd700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c000696a0 0x7f1c000bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:26.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.826+0000 7f1bfe7fc700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c000c2320 0x7f1c0014db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:26.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.827+0000 7f1bff7fe700 1 -- 172.21.15.72:0/4258526752 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c000c2320 msgr2=0x7f1c0014db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:26.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.827+0000 7f1bff7fe700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c000c2320 0x7f1c0014db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:26.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.827+0000 7f1bff7fe700 1 -- 172.21.15.72:0/4258526752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c000696a0 msgr2=0x7f1c000bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:26.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.827+0000 7f1bff7fe700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c000696a0 0x7f1c000bed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:26.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.827+0000 7f1bff7fe700 1 -- 172.21.15.72:0/4258526752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf40092a0 con 0x7f1c0014ecd0 2023-08-31T19:24:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.827+0000 7f1bfe7fc700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c000c2320 0x7f1c0014db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.827+0000 7f1bfeffd700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c000696a0 0x7f1c000bed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.827+0000 7f1bff7fe700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0014ecd0 0x7f1c00157670 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f1bf800c810 tx=0x7f1bf8002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.827+0000 7f1be6ffd700 1 -- 172.21.15.72:0/4258526752 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8010510 con 0x7f1c0014ecd0 2023-08-31T19:24:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.827+0000 7f1be6ffd700 1 -- 172.21.15.72:0/4258526752 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf80106b0 con 0x7f1c0014ecd0 2023-08-31T19:24:26.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.827+0000 7f1c057ff700 1 -- 172.21.15.72:0/4258526752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c000bfcc0 con 0x7f1c0014ecd0 2023-08-31T19:24:26.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.827+0000 7f1be6ffd700 1 -- 172.21.15.72:0/4258526752 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8010a70 con 0x7f1c0014ecd0 2023-08-31T19:24:26.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.827+0000 7f1c057ff700 1 -- 172.21.15.72:0/4258526752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c000a9230 con 0x7f1c0014ecd0 2023-08-31T19:24:26.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.828+0000 7f1c057ff700 1 -- 172.21.15.72:0/4258526752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0006c6b0 con 0x7f1c0014ecd0 2023-08-31T19:24:26.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.829+0000 7f1be6ffd700 1 -- 172.21.15.72:0/4258526752 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 78) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f1bf801b400 con 0x7f1c0014ecd0 2023-08-31T19:24:26.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.830+0000 7f1be6ffd700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1bec05ecf0 0x7f1bec0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:26.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.830+0000 7f1be6ffd700 1 -- 172.21.15.72:0/4258526752 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 7609+0+0 (secure 0 0 0) 0x7f1bf807a0d0 con 0x7f1c0014ecd0 2023-08-31T19:24:26.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.830+0000 7f1bfeffd700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1bec05ecf0 0x7f1bec0611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:26.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.831+0000 7f1bfeffd700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1bec05ecf0 0x7f1bec0611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f1bf0001710 tx=0x7f1bf0009040).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:26.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:26.835+0000 7f1be6ffd700 1 -- 172.21.15.72:0/4258526752 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1bf804afd0 con 0x7f1c0014ecd0 2023-08-31T19:24:27.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.049+0000 7f1c057ff700 1 -- 172.21.15.72:0/4258526752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1c001520d0 con 0x7f1c0014ecd0 2023-08-31T19:24:27.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.600+0000 7f1be6ffd700 1 -- 172.21.15.72:0/4258526752 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v73) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1bf8010e60 con 0x7f1c0014ecd0 2023-08-31T19:24:27.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.602+0000 7f1c057ff700 1 -- 172.21.15.72:0/4258526752 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1bec05ecf0 msgr2=0x7f1bec0611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:27.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.602+0000 7f1c057ff700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1bec05ecf0 0x7f1bec0611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f1bf0001710 tx=0x7f1bf0009040).stop 2023-08-31T19:24:27.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.603+0000 7f1c057ff700 1 -- 172.21.15.72:0/4258526752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0014ecd0 msgr2=0x7f1c00157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:27.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.603+0000 7f1c057ff700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0014ecd0 0x7f1c00157670 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f1bf800c810 tx=0x7f1bf8002560).stop 2023-08-31T19:24:27.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.603+0000 7f1c057ff700 1 -- 172.21.15.72:0/4258526752 shutdown_connections 2023-08-31T19:24:27.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.603+0000 7f1c057ff700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1bec05ecf0 0x7f1bec0611b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:27.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.603+0000 7f1c057ff700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0014ecd0 0x7f1c00157670 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:27.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.603+0000 7f1c057ff700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c000696a0 0x7f1c000bed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:27.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.603+0000 7f1c057ff700 1 --2- 172.21.15.72:0/4258526752 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1c000c2320 0x7f1c0014db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:27.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.603+0000 7f1c057ff700 1 -- 172.21.15.72:0/4258526752 >> 172.21.15.72:0/4258526752 conn(0x7f1c000630c0 msgr2=0x7f1c00069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:27.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.603+0000 7f1c057ff700 1 -- 172.21.15.72:0/4258526752 shutdown_connections 2023-08-31T19:24:27.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.603+0000 7f1c057ff700 1 -- 172.21.15.72:0/4258526752 wait complete. 2023-08-31T19:24:27.624 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T19:24:27.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.860+0000 7f76b6bff700 1 Processor -- start 2023-08-31T19:24:27.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.860+0000 7f76b6bff700 1 -- start start 2023-08-31T19:24:27.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.861+0000 7f76b6bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76b00c7f20 0x7f76b00646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:27.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.861+0000 7f76b6bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f76b00c83d0 0x7f76b0064b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:27.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.861+0000 7f76b6bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b0154c80 con 0x7f76b0151da0 2023-08-31T19:24:27.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.861+0000 7f76b6bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b0065080 con 0x7f76b00c7f20 2023-08-31T19:24:27.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.861+0000 7f76b6bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b0155820 con 0x7f76b00c83d0 2023-08-31T19:24:27.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.862+0000 7f76affff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76b00c7f20 0x7f76b00646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:27.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.862+0000 7f76affff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76b00c7f20 0x7f76b00646a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38488/0 (socket says 172.21.15.72:38488) 2023-08-31T19:24:27.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.862+0000 7f76affff700 1 -- 172.21.15.72:0/3058025281 learned_addr learned my addr 172.21.15.72:0/3058025281 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:27.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.862+0000 7f76b519c700 1 --2- 172.21.15.72:0/3058025281 >> v2:172.21.15.146:3300/0 conn(0x7f76b00c83d0 0x7f76b0064b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:27.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.862+0000 7f76affff700 1 -- 172.21.15.72:0/3058025281 >> v2:172.21.15.146:3300/0 conn(0x7f76b00c83d0 msgr2=0x7f76b0064b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:27.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.862+0000 7f76affff700 1 --2- 172.21.15.72:0/3058025281 >> v2:172.21.15.146:3300/0 conn(0x7f76b00c83d0 0x7f76b0064b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:27.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.862+0000 7f76affff700 1 -- 172.21.15.72:0/3058025281 >> v1:172.21.15.146:6789/0 conn(0x7f76b0151da0 legacy=0x7f76b0155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:27.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.862+0000 7f76affff700 1 -- 172.21.15.72:0/3058025281 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b00a9f10 con 0x7f76b00c7f20 2023-08-31T19:24:27.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.862+0000 7f76affff700 1 --2- 172.21.15.72:0/3058025281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00c7f20 0x7f76b00646a0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f76b0047630 tx=0x7f769c0090f0).ready entity=mon.0 client_cookie=e2e16828ed789010 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:27.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.863+0000 7f76af7fe700 1 -- 172.21.15.72:0/3058025281 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c00b600 con 0x7f76b00c7f20 2023-08-31T19:24:27.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.863+0000 7f76af7fe700 1 -- 172.21.15.72:0/3058025281 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c00b760 con 0x7f76b00c7f20 2023-08-31T19:24:27.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.863+0000 7f76af7fe700 1 -- 172.21.15.72:0/3058025281 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c00bae0 con 0x7f76b00c7f20 2023-08-31T19:24:27.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.863+0000 7f76b6bff700 1 -- 172.21.15.72:0/3058025281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00c7f20 msgr2=0x7f76b00646a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:27.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.863+0000 7f76b6bff700 1 --2- 172.21.15.72:0/3058025281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00c7f20 0x7f76b00646a0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f76b0047630 tx=0x7f769c0090f0).stop 2023-08-31T19:24:27.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.863+0000 7f76b6bff700 1 -- 172.21.15.72:0/3058025281 shutdown_connections 2023-08-31T19:24:27.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.863+0000 7f76b6bff700 1 --2- 172.21.15.72:0/3058025281 >> v2:172.21.15.146:3300/0 conn(0x7f76b00c83d0 0x7f76b0064b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:27.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.863+0000 7f76b6bff700 1 --2- 172.21.15.72:0/3058025281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00c7f20 0x7f76b00646a0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:27.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.863+0000 7f76b6bff700 1 -- 172.21.15.72:0/3058025281 >> 172.21.15.72:0/3058025281 conn(0x7f76b00cb840 msgr2=0x7f76b00c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:27.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.863+0000 7f76b6bff700 1 -- 172.21.15.72:0/3058025281 shutdown_connections 2023-08-31T19:24:27.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.864+0000 7f76b6bff700 1 -- 172.21.15.72:0/3058025281 wait complete. 2023-08-31T19:24:27.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.865+0000 7f76b6bff700 1 Processor -- start 2023-08-31T19:24:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.865+0000 7f76b6bff700 1 -- start start 2023-08-31T19:24:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.866+0000 7f76b6bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00c7f20 0x7f76b014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.866+0000 7f76b6bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76b00c83d0 0x7f76b014dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.866+0000 7f76b6bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76b0151da0 0x7f76b014e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.866+0000 7f76b6bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b0150df0 con 0x7f76b00c7f20 2023-08-31T19:24:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.866+0000 7f76b6bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b014ff40 con 0x7f76b00c83d0 2023-08-31T19:24:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.866+0000 7f76b6bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b014e5c0 con 0x7f76b0151da0 2023-08-31T19:24:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.866+0000 7f76b499b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00c7f20 0x7f76b014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.866+0000 7f76b499b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00c7f20 0x7f76b014fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38494/0 (socket says 172.21.15.72:38494) 2023-08-31T19:24:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.866+0000 7f76b499b700 1 -- 172.21.15.72:0/326605444 learned_addr learned my addr 172.21.15.72:0/326605444 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.867+0000 7f76affff700 1 --2- 172.21.15.72:0/326605444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76b00c83d0 0x7f76b014dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.867+0000 7f76b519c700 1 --2- 172.21.15.72:0/326605444 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76b0151da0 0x7f76b014e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.867+0000 7f76b499b700 1 -- 172.21.15.72:0/326605444 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76b0151da0 msgr2=0x7f76b014e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.867+0000 7f76b499b700 1 --2- 172.21.15.72:0/326605444 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76b0151da0 0x7f76b014e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.867+0000 7f76b499b700 1 -- 172.21.15.72:0/326605444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76b00c83d0 msgr2=0x7f76b014dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.867+0000 7f76b499b700 1 --2- 172.21.15.72:0/326605444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76b00c83d0 0x7f76b014dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.867+0000 7f76b499b700 1 -- 172.21.15.72:0/326605444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c009370 con 0x7f76b00c7f20 2023-08-31T19:24:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.867+0000 7f76b499b700 1 --2- 172.21.15.72:0/326605444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00c7f20 0x7f76b014fa50 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f76a400c440 tx=0x7f76a4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.867+0000 7f76acff9700 1 -- 172.21.15.72:0/326605444 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4007020 con 0x7f76b00c7f20 2023-08-31T19:24:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.867+0000 7f76acff9700 1 -- 172.21.15.72:0/326605444 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a4007180 con 0x7f76b00c7f20 2023-08-31T19:24:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.867+0000 7f76acff9700 1 -- 172.21.15.72:0/326605444 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4007520 con 0x7f76b00c7f20 2023-08-31T19:24:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.867+0000 7f76b6bff700 1 -- 172.21.15.72:0/326605444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b01501e0 con 0x7f76b00c7f20 2023-08-31T19:24:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.867+0000 7f76b6bff700 1 -- 172.21.15.72:0/326605444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b01507a0 con 0x7f76b00c7f20 2023-08-31T19:24:27.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.869+0000 7f76b6bff700 1 -- 172.21.15.72:0/326605444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b006ac80 con 0x7f76b00c7f20 2023-08-31T19:24:27.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.869+0000 7f76acff9700 1 -- 172.21.15.72:0/326605444 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 78) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f76a40068b0 con 0x7f76b00c7f20 2023-08-31T19:24:27.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.870+0000 7f76acff9700 1 --2- 172.21.15.72:0/326605444 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f769405ecf0 0x7f76940611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:27.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.870+0000 7f76acff9700 1 -- 172.21.15.72:0/326605444 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 7609+0+0 (secure 0 0 0) 0x7f76a40795e0 con 0x7f76b00c7f20 2023-08-31T19:24:27.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.870+0000 7f76affff700 1 --2- 172.21.15.72:0/326605444 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f769405ecf0 0x7f76940611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:27.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.871+0000 7f76affff700 1 --2- 172.21.15.72:0/326605444 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f769405ecf0 0x7f76940611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f769c009130 tx=0x7f769c017000).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:27.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.874+0000 7f76acff9700 1 -- 172.21.15.72:0/326605444 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f76a40478f0 con 0x7f76b00c7f20 2023-08-31T19:24:27.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:27.988+0000 7f76acff9700 1 -- 172.21.15.72:0/326605444 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f76a4076f30 con 0x7f76b00c7f20 2023-08-31T19:24:28.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:28.047+0000 7f76b6bff700 1 -- 172.21.15.72:0/326605444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f76b006ac80 con 0x7f76b00c7f20 2023-08-31T19:24:28.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:28.827+0000 7f76acff9700 1 -- 172.21.15.72:0/326605444 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v166) v1 ==== 181+0+0 (secure 0 0 0) 0x7f76b006ac80 con 0x7f76b00c7f20 2023-08-31T19:24:28.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:28.834+0000 7f76b6bff700 1 -- 172.21.15.72:0/326605444 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f769405ecf0 msgr2=0x7f76940611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:28.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:28.834+0000 7f76b6bff700 1 --2- 172.21.15.72:0/326605444 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f769405ecf0 0x7f76940611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f769c009130 tx=0x7f769c017000).stop 2023-08-31T19:24:28.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:28.835+0000 7f76b6bff700 1 -- 172.21.15.72:0/326605444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00c7f20 msgr2=0x7f76b014fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:28.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:28.835+0000 7f76b6bff700 1 --2- 172.21.15.72:0/326605444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00c7f20 0x7f76b014fa50 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f76a400c440 tx=0x7f76a4007e00).stop 2023-08-31T19:24:28.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:28.835+0000 7f76b6bff700 1 -- 172.21.15.72:0/326605444 shutdown_connections 2023-08-31T19:24:28.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:28.835+0000 7f76b6bff700 1 --2- 172.21.15.72:0/326605444 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f769405ecf0 0x7f76940611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:28.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:28.835+0000 7f76b6bff700 1 --2- 172.21.15.72:0/326605444 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76b0151da0 0x7f76b014e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:28.835+0000 7f76b6bff700 1 --2- 172.21.15.72:0/326605444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00c7f20 0x7f76b014fa50 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:28.835+0000 7f76b6bff700 1 --2- 172.21.15.72:0/326605444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f76b00c83d0 0x7f76b014dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:28.835+0000 7f76b6bff700 1 -- 172.21.15.72:0/326605444 >> 172.21.15.72:0/326605444 conn(0x7f76b00cb840 msgr2=0x7f76b00c5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:28.836+0000 7f76b6bff700 1 -- 172.21.15.72:0/326605444 shutdown_connections 2023-08-31T19:24:28.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:28.836+0000 7f76b6bff700 1 -- 172.21.15.72:0/326605444 wait complete. 2023-08-31T19:24:28.840 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-08-31T19:24:28.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T19:24:29.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.058+0000 7fcb25dff700 1 Processor -- start 2023-08-31T19:24:29.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.058+0000 7fcb25dff700 1 -- start start 2023-08-31T19:24:29.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.059+0000 7fcb25dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb20151da0 0x7fcb201553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.059+0000 7fcb25dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20064d70 0x7fcb200bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.059+0000 7fcb25dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb20154f40 con 0x7fcb200c5370 2023-08-31T19:24:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.059+0000 7fcb25dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb20154960 con 0x7fcb20151da0 2023-08-31T19:24:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.059+0000 7fcb25dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb200aa2c0 con 0x7fcb20064d70 2023-08-31T19:24:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.060+0000 7fcb1f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb20151da0 0x7fcb201553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.060+0000 7fcb1f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb20151da0 0x7fcb201553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38498/0 (socket says 172.21.15.72:38498) 2023-08-31T19:24:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.060+0000 7fcb1f7fe700 1 -- 172.21.15.72:0/2262109754 learned_addr learned my addr 172.21.15.72:0/2262109754 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.060+0000 7fcb1effd700 1 --1- 172.21.15.72:0/2262109754 >> v1:172.21.15.72:6789/0 conn(0x7fcb200c5370 0x7fcb20064660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35202/0 (socket says 172.21.15.72:35202) 2023-08-31T19:24:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.060+0000 7fcb1ffff700 1 --2- 172.21.15.72:0/2262109754 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20064d70 0x7fcb200bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:29.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.060+0000 7fcb1f7fe700 1 -- 172.21.15.72:0/2262109754 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20064d70 msgr2=0x7fcb200bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:29.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.060+0000 7fcb1e7fc700 1 -- 172.21.15.72:0/2262109754 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116472184 0 0) 0x7fcb20154f40 con 0x7fcb200c5370 2023-08-31T19:24:29.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.060+0000 7fcb1f7fe700 1 --2- 172.21.15.72:0/2262109754 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20064d70 0x7fcb200bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:29.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.060+0000 7fcb1f7fe700 1 -- 172.21.15.72:0/2262109754 >> v1:172.21.15.72:6789/0 conn(0x7fcb200c5370 legacy=0x7fcb20064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:29.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.060+0000 7fcb1f7fe700 1 -- 172.21.15.72:0/2262109754 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb20154bd0 con 0x7fcb20151da0 2023-08-31T19:24:29.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.060+0000 7fcb1f7fe700 1 --2- 172.21.15.72:0/2262109754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb20151da0 0x7fcb201553d0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7fcb10006fd0 tx=0x7fcb100090f0).ready entity=mon.0 client_cookie=986f20a1edd4bcbb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:29.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.060+0000 7fcb1e7fc700 1 -- 172.21.15.72:0/2262109754 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1000b600 con 0x7fcb20151da0 2023-08-31T19:24:29.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.061+0000 7fcb1e7fc700 1 -- 172.21.15.72:0/2262109754 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1000b760 con 0x7fcb20151da0 2023-08-31T19:24:29.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.061+0000 7fcb1e7fc700 1 -- 172.21.15.72:0/2262109754 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1000bae0 con 0x7fcb20151da0 2023-08-31T19:24:29.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.061+0000 7fcb25dff700 1 -- 172.21.15.72:0/2262109754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb20151da0 msgr2=0x7fcb201553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:29.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.061+0000 7fcb25dff700 1 --2- 172.21.15.72:0/2262109754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb20151da0 0x7fcb201553d0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7fcb10006fd0 tx=0x7fcb100090f0).stop 2023-08-31T19:24:29.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.061+0000 7fcb25dff700 1 -- 172.21.15.72:0/2262109754 shutdown_connections 2023-08-31T19:24:29.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.061+0000 7fcb25dff700 1 --2- 172.21.15.72:0/2262109754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb20151da0 0x7fcb201553d0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:29.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.061+0000 7fcb25dff700 1 --2- 172.21.15.72:0/2262109754 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20064d70 0x7fcb200bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:29.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.061+0000 7fcb25dff700 1 -- 172.21.15.72:0/2262109754 >> 172.21.15.72:0/2262109754 conn(0x7fcb20063a90 msgr2=0x7fcb200cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:29.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.061+0000 7fcb25dff700 1 -- 172.21.15.72:0/2262109754 shutdown_connections 2023-08-31T19:24:29.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.061+0000 7fcb25dff700 1 -- 172.21.15.72:0/2262109754 wait complete. 2023-08-31T19:24:29.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.063+0000 7fcb25dff700 1 Processor -- start 2023-08-31T19:24:29.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.063+0000 7fcb25dff700 1 -- start start 2023-08-31T19:24:29.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb25dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20064d70 0x7fcb2013f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:29.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb25dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200c5370 0x7fcb20164960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:29.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb25dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb20151da0 0x7fcb20168870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:29.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb25dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb20150120 con 0x7fcb20151da0 2023-08-31T19:24:29.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb25dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2014fe10 con 0x7fcb200c5370 2023-08-31T19:24:29.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb25dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb20165160 con 0x7fcb20064d70 2023-08-31T19:24:29.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb1ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb20151da0 0x7fcb20168870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:29.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb1f7fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20064d70 0x7fcb2013f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:29.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb1ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb20151da0 0x7fcb20168870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38502/0 (socket says 172.21.15.72:38502) 2023-08-31T19:24:29.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb1ffff700 1 -- 172.21.15.72:0/3786872665 learned_addr learned my addr 172.21.15.72:0/3786872665 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:29.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb1effd700 1 --2- 172.21.15.72:0/3786872665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200c5370 0x7fcb20164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:29.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb1ffff700 1 -- 172.21.15.72:0/3786872665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20064d70 msgr2=0x7fcb2013f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:29.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb1ffff700 1 --2- 172.21.15.72:0/3786872665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20064d70 0x7fcb2013f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:29.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb1ffff700 1 -- 172.21.15.72:0/3786872665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200c5370 msgr2=0x7fcb20164960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:29.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb1ffff700 1 --2- 172.21.15.72:0/3786872665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200c5370 0x7fcb20164960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:29.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.064+0000 7fcb1ffff700 1 -- 172.21.15.72:0/3786872665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb10009370 con 0x7fcb20151da0 2023-08-31T19:24:29.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.065+0000 7fcb1ffff700 1 --2- 172.21.15.72:0/3786872665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb20151da0 0x7fcb20168870 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7fcb18007ef0 tx=0x7fcb18009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:29.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.065+0000 7fcb077fe700 1 -- 172.21.15.72:0/3786872665 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800eb30 con 0x7fcb20151da0 2023-08-31T19:24:29.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.065+0000 7fcb077fe700 1 -- 172.21.15.72:0/3786872665 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1800ec90 con 0x7fcb20151da0 2023-08-31T19:24:29.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.065+0000 7fcb077fe700 1 -- 172.21.15.72:0/3786872665 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18014610 con 0x7fcb20151da0 2023-08-31T19:24:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.065+0000 7fcb25dff700 1 -- 172.21.15.72:0/3786872665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb20165440 con 0x7fcb20151da0 2023-08-31T19:24:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.065+0000 7fcb25dff700 1 -- 172.21.15.72:0/3786872665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb20164e50 con 0x7fcb20151da0 2023-08-31T19:24:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.066+0000 7fcb25dff700 1 -- 172.21.15.72:0/3786872665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2006a7e0 con 0x7fcb20151da0 2023-08-31T19:24:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.067+0000 7fcb077fe700 1 -- 172.21.15.72:0/3786872665 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fcb18014a40 con 0x7fcb20151da0 2023-08-31T19:24:29.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.067+0000 7fcb077fe700 1 --2- 172.21.15.72:0/3786872665 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcb0c05ef30 0x7fcb0c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:29.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.068+0000 7fcb077fe700 1 -- 172.21.15.72:0/3786872665 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 7113+0+0 (secure 0 0 0) 0x7fcb1807a860 con 0x7fcb20151da0 2023-08-31T19:24:29.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.068+0000 7fcb1f7fe700 1 --2- 172.21.15.72:0/3786872665 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcb0c05ef30 0x7fcb0c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:29.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.068+0000 7fcb1f7fe700 1 --2- 172.21.15.72:0/3786872665 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcb0c05ef30 0x7fcb0c0613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fcb10009130 tx=0x7fcb10017000).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:29.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.072+0000 7fcb077fe700 1 -- 172.21.15.72:0/3786872665 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcb1804b6b0 con 0x7fcb20151da0 2023-08-31T19:24:29.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:29.248+0000 7fcb25dff700 1 -- 172.21.15.72:0/3786872665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcb2006c6b0 con 0x7fcb20151da0 2023-08-31T19:24:30.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.005+0000 7fcb077fe700 1 -- 172.21.15.72:0/3786872665 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v167) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcb1804ecd0 con 0x7fcb20151da0 2023-08-31T19:24:30.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.009+0000 7fcb25dff700 1 -- 172.21.15.72:0/3786872665 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcb0c05ef30 msgr2=0x7fcb0c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:30.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.009+0000 7fcb25dff700 1 --2- 172.21.15.72:0/3786872665 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcb0c05ef30 0x7fcb0c0613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fcb10009130 tx=0x7fcb10017000).stop 2023-08-31T19:24:30.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.009+0000 7fcb25dff700 1 -- 172.21.15.72:0/3786872665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb20151da0 msgr2=0x7fcb20168870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:30.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.009+0000 7fcb25dff700 1 --2- 172.21.15.72:0/3786872665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb20151da0 0x7fcb20168870 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7fcb18007ef0 tx=0x7fcb18009840).stop 2023-08-31T19:24:30.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.009+0000 7fcb25dff700 1 -- 172.21.15.72:0/3786872665 shutdown_connections 2023-08-31T19:24:30.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.009+0000 7fcb25dff700 1 --2- 172.21.15.72:0/3786872665 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcb0c05ef30 0x7fcb0c0613f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.009+0000 7fcb25dff700 1 --2- 172.21.15.72:0/3786872665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb20151da0 0x7fcb20168870 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.009+0000 7fcb25dff700 1 --2- 172.21.15.72:0/3786872665 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcb20064d70 0x7fcb2013f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.009+0000 7fcb25dff700 1 --2- 172.21.15.72:0/3786872665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb200c5370 0x7fcb20164960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.009+0000 7fcb25dff700 1 -- 172.21.15.72:0/3786872665 >> 172.21.15.72:0/3786872665 conn(0x7fcb20063a90 msgr2=0x7fcb200cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:30.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.010+0000 7fcb25dff700 1 -- 172.21.15.72:0/3786872665 shutdown_connections 2023-08-31T19:24:30.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.010+0000 7fcb25dff700 1 -- 172.21.15.72:0/3786872665 wait complete. 2023-08-31T19:24:30.013 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-08-31T19:24:30.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-31T19:24:30.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.222+0000 7fe6ec1ff700 1 Processor -- start 2023-08-31T19:24:30.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.222+0000 7fe6ec1ff700 1 -- start start 2023-08-31T19:24:30.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.223+0000 7fe6ec1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6e4154030 0x7fe6e4154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:30.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.223+0000 7fe6ec1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe6e40c7360 0x7fe6e4063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:30.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.223+0000 7fe6ec1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e40c6ed0 con 0x7fe6e40c06b0 2023-08-31T19:24:30.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.223+0000 7fe6ec1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e40c66e0 con 0x7fe6e4154030 2023-08-31T19:24:30.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.223+0000 7fe6ec1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e40c68c0 con 0x7fe6e40c7360 2023-08-31T19:24:30.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.224+0000 7fe6e9f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6e4154030 0x7fe6e4154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:30.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.224+0000 7fe6e9f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6e4154030 0x7fe6e4154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38504/0 (socket says 172.21.15.72:38504) 2023-08-31T19:24:30.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.224+0000 7fe6e9f9b700 1 -- 172.21.15.72:0/942803605 learned_addr learned my addr 172.21.15.72:0/942803605 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:30.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.224+0000 7fe6ea79c700 1 --2- 172.21.15.72:0/942803605 >> v2:172.21.15.146:3300/0 conn(0x7fe6e40c7360 0x7fe6e4063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:30.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.224+0000 7fe6e9f9b700 1 -- 172.21.15.72:0/942803605 >> v2:172.21.15.146:3300/0 conn(0x7fe6e40c7360 msgr2=0x7fe6e4063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:30.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.224+0000 7fe6e9f9b700 1 --2- 172.21.15.72:0/942803605 >> v2:172.21.15.146:3300/0 conn(0x7fe6e40c7360 0x7fe6e4063120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.224+0000 7fe6e9f9b700 1 -- 172.21.15.72:0/942803605 >> v1:172.21.15.72:6789/0 conn(0x7fe6e40c06b0 legacy=0x7fe6e40aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:30.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.224+0000 7fe6e8f99700 1 -- 172.21.15.72:0/942803605 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759949160 0 0) 0x7fe6e40c6ed0 con 0x7fe6e40c06b0 2023-08-31T19:24:30.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.224+0000 7fe6e9f9b700 1 -- 172.21.15.72:0/942803605 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e40c0f30 con 0x7fe6e4154030 2023-08-31T19:24:30.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.224+0000 7fe6ea79c700 1 --2- 172.21.15.72:0/942803605 >> v2:172.21.15.146:3300/0 conn(0x7fe6e40c7360 0x7fe6e4063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:24:30.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.224+0000 7fe6e9f9b700 1 --2- 172.21.15.72:0/942803605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e4154030 0x7fe6e4154410 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7fe6e40aad30 tx=0x7fe6e00090f0).ready entity=mon.0 client_cookie=9e6465dca927f6e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:30.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.224+0000 7fe6e8f99700 1 -- 172.21.15.72:0/942803605 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e000b600 con 0x7fe6e4154030 2023-08-31T19:24:30.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.225+0000 7fe6e8f99700 1 -- 172.21.15.72:0/942803605 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e000b760 con 0x7fe6e4154030 2023-08-31T19:24:30.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.225+0000 7fe6e8f99700 1 -- 172.21.15.72:0/942803605 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e000bb00 con 0x7fe6e4154030 2023-08-31T19:24:30.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.225+0000 7fe6ec1ff700 1 -- 172.21.15.72:0/942803605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e4154030 msgr2=0x7fe6e4154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:30.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.225+0000 7fe6ec1ff700 1 --2- 172.21.15.72:0/942803605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e4154030 0x7fe6e4154410 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7fe6e40aad30 tx=0x7fe6e00090f0).stop 2023-08-31T19:24:30.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.225+0000 7fe6ec1ff700 1 -- 172.21.15.72:0/942803605 shutdown_connections 2023-08-31T19:24:30.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.225+0000 7fe6ec1ff700 1 --2- 172.21.15.72:0/942803605 >> v2:172.21.15.146:3300/0 conn(0x7fe6e40c7360 0x7fe6e4063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.225+0000 7fe6ec1ff700 1 --2- 172.21.15.72:0/942803605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e4154030 0x7fe6e4154410 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.225+0000 7fe6ec1ff700 1 -- 172.21.15.72:0/942803605 >> 172.21.15.72:0/942803605 conn(0x7fe6e405eb60 msgr2=0x7fe6e40cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:30.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.225+0000 7fe6ec1ff700 1 -- 172.21.15.72:0/942803605 shutdown_connections 2023-08-31T19:24:30.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.225+0000 7fe6ec1ff700 1 -- 172.21.15.72:0/942803605 wait complete. 2023-08-31T19:24:30.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.227+0000 7fe6ec1ff700 1 Processor -- start 2023-08-31T19:24:30.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.227+0000 7fe6ec1ff700 1 -- start start 2023-08-31T19:24:30.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6ec1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6e40c06b0 0x7fe6e414d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:30.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6ec1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e40c7360 0x7fe6e40c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:30.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6ec1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e4154030 0x7fe6e40c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:30.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6ec1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40c8270 con 0x7fe6e40c7360 2023-08-31T19:24:30.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6ec1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40af890 con 0x7fe6e4154030 2023-08-31T19:24:30.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6ec1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e40afb70 con 0x7fe6e40c06b0 2023-08-31T19:24:30.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6e979a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e40c7360 0x7fe6e40c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:30.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6e979a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e40c7360 0x7fe6e40c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38512/0 (socket says 172.21.15.72:38512) 2023-08-31T19:24:30.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6e979a700 1 -- 172.21.15.72:0/2505277235 learned_addr learned my addr 172.21.15.72:0/2505277235 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:30.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6ea79c700 1 --2- 172.21.15.72:0/2505277235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e4154030 0x7fe6e40c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:30.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6e9f9b700 1 --2- 172.21.15.72:0/2505277235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6e40c06b0 0x7fe6e414d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:30.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6e979a700 1 -- 172.21.15.72:0/2505277235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6e40c06b0 msgr2=0x7fe6e414d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:30.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6e979a700 1 --2- 172.21.15.72:0/2505277235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6e40c06b0 0x7fe6e414d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6e979a700 1 -- 172.21.15.72:0/2505277235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e4154030 msgr2=0x7fe6e40c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:30.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6e979a700 1 --2- 172.21.15.72:0/2505277235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e4154030 0x7fe6e40c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.228+0000 7fe6e979a700 1 -- 172.21.15.72:0/2505277235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e0009370 con 0x7fe6e40c7360 2023-08-31T19:24:30.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.229+0000 7fe6e979a700 1 --2- 172.21.15.72:0/2505277235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e40c7360 0x7fe6e40c7890 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7fe6d4001eb0 tx=0x7fe6d4007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:30.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.229+0000 7fe6d9ffb700 1 -- 172.21.15.72:0/2505277235 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d400ce60 con 0x7fe6e40c7360 2023-08-31T19:24:30.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.229+0000 7fe6d9ffb700 1 -- 172.21.15.72:0/2505277235 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d400f470 con 0x7fe6e40c7360 2023-08-31T19:24:30.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.229+0000 7fe6ec1ff700 1 -- 172.21.15.72:0/2505277235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e40afe50 con 0x7fe6e40c7360 2023-08-31T19:24:30.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.229+0000 7fe6d9ffb700 1 -- 172.21.15.72:0/2505277235 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d400f810 con 0x7fe6e40c7360 2023-08-31T19:24:30.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.229+0000 7fe6ec1ff700 1 -- 172.21.15.72:0/2505277235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e40b0410 con 0x7fe6e40c7360 2023-08-31T19:24:30.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.230+0000 7fe6ec1ff700 1 -- 172.21.15.72:0/2505277235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e406c6b0 con 0x7fe6e40c7360 2023-08-31T19:24:30.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.231+0000 7fe6d9ffb700 1 -- 172.21.15.72:0/2505277235 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe6d400fb80 con 0x7fe6e40c7360 2023-08-31T19:24:30.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.231+0000 7fe6d9ffb700 1 --2- 172.21.15.72:0/2505277235 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe6c805ef30 0x7fe6c80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:30.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.232+0000 7fe6d9ffb700 1 -- 172.21.15.72:0/2505277235 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fe6d40797e0 con 0x7fe6e40c7360 2023-08-31T19:24:30.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.232+0000 7fe6e9f9b700 1 --2- 172.21.15.72:0/2505277235 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe6c805ef30 0x7fe6c80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:30.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.232+0000 7fe6e9f9b700 1 --2- 172.21.15.72:0/2505277235 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe6c805ef30 0x7fe6c80613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe6e0009fd0 tx=0x7fe6e0017000).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:30.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.236+0000 7fe6d9ffb700 1 -- 172.21.15.72:0/2505277235 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe6d404a7f0 con 0x7fe6e40c7360 2023-08-31T19:24:30.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.406+0000 7fe6ec1ff700 1 -- 172.21.15.72:0/2505277235 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fe6e406aac0 con 0x7fe6e40c7360 2023-08-31T19:24:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.410+0000 7fe6d9ffb700 1 -- 172.21.15.72:0/2505277235 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v32) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe6d404de10 con 0x7fe6e40c7360 2023-08-31T19:24:30.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.413+0000 7fe6ec1ff700 1 -- 172.21.15.72:0/2505277235 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe6c805ef30 msgr2=0x7fe6c80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:30.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.413+0000 7fe6ec1ff700 1 --2- 172.21.15.72:0/2505277235 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe6c805ef30 0x7fe6c80613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe6e0009fd0 tx=0x7fe6e0017000).stop 2023-08-31T19:24:30.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.413+0000 7fe6ec1ff700 1 -- 172.21.15.72:0/2505277235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e40c7360 msgr2=0x7fe6e40c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:30.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.413+0000 7fe6ec1ff700 1 --2- 172.21.15.72:0/2505277235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e40c7360 0x7fe6e40c7890 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7fe6d4001eb0 tx=0x7fe6d4007c70).stop 2023-08-31T19:24:30.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.413+0000 7fe6ec1ff700 1 -- 172.21.15.72:0/2505277235 shutdown_connections 2023-08-31T19:24:30.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.413+0000 7fe6ec1ff700 1 --2- 172.21.15.72:0/2505277235 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe6c805ef30 0x7fe6c80613f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.413+0000 7fe6ec1ff700 1 --2- 172.21.15.72:0/2505277235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6e4154030 0x7fe6e40c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.413+0000 7fe6ec1ff700 1 --2- 172.21.15.72:0/2505277235 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6e40c06b0 0x7fe6e414d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.413+0000 7fe6ec1ff700 1 --2- 172.21.15.72:0/2505277235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e40c7360 0x7fe6e40c7890 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.413+0000 7fe6ec1ff700 1 -- 172.21.15.72:0/2505277235 >> 172.21.15.72:0/2505277235 conn(0x7fe6e405eb60 msgr2=0x7fe6e40acf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:30.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.413+0000 7fe6ec1ff700 1 -- 172.21.15.72:0/2505277235 shutdown_connections 2023-08-31T19:24:30.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.413+0000 7fe6ec1ff700 1 -- 172.21.15.72:0/2505277235 wait complete. 2023-08-31T19:24:30.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-31T19:24:30.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:24:30.607 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:24:30.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.623+0000 7f26febff700 1 Processor -- start 2023-08-31T19:24:30.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.623+0000 7f26febff700 1 -- start start 2023-08-31T19:24:30.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.624+0000 7f26febff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26f8153e30 0x7f26f8154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:30.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.624+0000 7f26febff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f80bfd40 con 0x7f26f80637c0 2023-08-31T19:24:30.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.624+0000 7f26febff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f80c6730 con 0x7f26f80c5cb0 2023-08-31T19:24:30.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.624+0000 7f26febff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f80bffe0 con 0x7f26f8153e30 2023-08-31T19:24:30.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.625+0000 7f26fd19c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f26f80637c0 0x7f26f80c0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35220/0 (socket says 172.21.15.72:35220) 2023-08-31T19:24:30.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.625+0000 7f26fd19c700 1 -- 172.21.15.72:0/39190647 learned_addr learned my addr 172.21.15.72:0/39190647 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:30.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.625+0000 7f26fc99b700 1 --2- 172.21.15.72:0/39190647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26f8153e30 0x7f26f8154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:30.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.625+0000 7f26f77fe700 1 -- 172.21.15.72:0/39190647 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051642145 0 0) 0x7f26f80bfd40 con 0x7f26f80637c0 2023-08-31T19:24:30.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.625+0000 7f26f77fe700 1 -- 172.21.15.72:0/39190647 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26e80033f0 con 0x7f26f80637c0 2023-08-31T19:24:30.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.625+0000 7f26f77fe700 1 -- 172.21.15.72:0/39190647 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828603402 0 0) 0x7f26f80c6730 con 0x7f26f80c5cb0 2023-08-31T19:24:30.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.625+0000 7f26f77fe700 1 -- 172.21.15.72:0/39190647 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26f80bfd40 con 0x7f26f80c5cb0 2023-08-31T19:24:30.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.625+0000 7f26fc99b700 1 -- 172.21.15.72:0/39190647 >> v1:172.21.15.146:6789/0 conn(0x7f26f80c5cb0 legacy=0x7f26f80630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:30.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.625+0000 7f26fc99b700 1 -- 172.21.15.72:0/39190647 >> v1:172.21.15.72:6789/0 conn(0x7f26f80637c0 legacy=0x7f26f80c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:30.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.625+0000 7f26fc99b700 1 -- 172.21.15.72:0/39190647 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f80c02c0 con 0x7f26f8153e30 2023-08-31T19:24:30.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.626+0000 7f26fc99b700 1 --2- 172.21.15.72:0/39190647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26f8153e30 0x7f26f8154210 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f26ec009790 tx=0x7f26ec009060).ready entity=mon.2 client_cookie=30a6b45cde7c6f16 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:30.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.626+0000 7f26f77fe700 1 -- 172.21.15.72:0/39190647 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec00f510 con 0x7f26f8153e30 2023-08-31T19:24:30.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.626+0000 7f26f77fe700 1 -- 172.21.15.72:0/39190647 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ec00f670 con 0x7f26f8153e30 2023-08-31T19:24:30.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.626+0000 7f26f77fe700 1 -- 172.21.15.72:0/39190647 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec00f9f0 con 0x7f26f8153e30 2023-08-31T19:24:30.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.627+0000 7f26febff700 1 -- 172.21.15.72:0/39190647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26f8153e30 msgr2=0x7f26f8154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.627+0000 7f26febff700 1 --2- 172.21.15.72:0/39190647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26f8153e30 0x7f26f8154210 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f26ec009790 tx=0x7f26ec009060).stop 2023-08-31T19:24:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.627+0000 7f26febff700 1 -- 172.21.15.72:0/39190647 shutdown_connections 2023-08-31T19:24:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.627+0000 7f26febff700 1 --2- 172.21.15.72:0/39190647 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26f8153e30 0x7f26f8154210 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.627+0000 7f26febff700 1 -- 172.21.15.72:0/39190647 >> 172.21.15.72:0/39190647 conn(0x7f26f805eb20 msgr2=0x7f26f80cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:30.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.627+0000 7f26febff700 1 -- 172.21.15.72:0/39190647 shutdown_connections 2023-08-31T19:24:30.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.627+0000 7f26febff700 1 -- 172.21.15.72:0/39190647 wait complete. 2023-08-31T19:24:30.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.628+0000 7f26febff700 1 Processor -- start 2023-08-31T19:24:30.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.628+0000 7f26febff700 1 -- start start 2023-08-31T19:24:30.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.629+0000 7f26febff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26f80637c0 0x7f26f8145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:30.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.629+0000 7f26febff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26f80c5cb0 0x7f26f80a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:30.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.629+0000 7f26febff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26f8153e30 0x7f26f80a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:30.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.629+0000 7f26febff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f80a4aa0 con 0x7f26f80637c0 2023-08-31T19:24:30.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.629+0000 7f26febff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f80c4990 con 0x7f26f80c5cb0 2023-08-31T19:24:30.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.629+0000 7f26febff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f80c3d80 con 0x7f26f8153e30 2023-08-31T19:24:30.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.630+0000 7f26fc99b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26f80637c0 0x7f26f8145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:30.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.630+0000 7f26fc99b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26f80637c0 0x7f26f8145190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38516/0 (socket says 172.21.15.72:38516) 2023-08-31T19:24:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.630+0000 7f26fc99b700 1 -- 172.21.15.72:0/1975330371 learned_addr learned my addr 172.21.15.72:0/1975330371 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.630+0000 7f26fd19c700 1 --2- 172.21.15.72:0/1975330371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26f8153e30 0x7f26f80a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.630+0000 7f26f7fff700 1 --2- 172.21.15.72:0/1975330371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26f80c5cb0 0x7f26f80a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.630+0000 7f26fc99b700 1 -- 172.21.15.72:0/1975330371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26f8153e30 msgr2=0x7f26f80a45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.630+0000 7f26fc99b700 1 --2- 172.21.15.72:0/1975330371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26f8153e30 0x7f26f80a45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.630+0000 7f26fc99b700 1 -- 172.21.15.72:0/1975330371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26f80c5cb0 msgr2=0x7f26f80a40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:30.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.630+0000 7f26fc99b700 1 --2- 172.21.15.72:0/1975330371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26f80c5cb0 0x7f26f80a40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.630+0000 7f26fc99b700 1 -- 172.21.15.72:0/1975330371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec0092a0 con 0x7f26f80637c0 2023-08-31T19:24:30.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.630+0000 7f26fc99b700 1 --2- 172.21.15.72:0/1975330371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26f80637c0 0x7f26f8145190 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f26f8065940 tx=0x7f26ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:30.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.631+0000 7f26f4ff9700 1 -- 172.21.15.72:0/1975330371 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec00fe80 con 0x7f26f80637c0 2023-08-31T19:24:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.631+0000 7f26f4ff9700 1 -- 172.21.15.72:0/1975330371 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ec00f7e0 con 0x7f26f80637c0 2023-08-31T19:24:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.631+0000 7f26f4ff9700 1 -- 172.21.15.72:0/1975330371 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec01c650 con 0x7f26f80637c0 2023-08-31T19:24:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.631+0000 7f26febff700 1 -- 172.21.15.72:0/1975330371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f80c4060 con 0x7f26f80637c0 2023-08-31T19:24:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.631+0000 7f26febff700 1 -- 172.21.15.72:0/1975330371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f80c4620 con 0x7f26f80637c0 2023-08-31T19:24:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.632+0000 7f26febff700 1 -- 172.21.15.72:0/1975330371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f806c6b0 con 0x7f26f80637c0 2023-08-31T19:24:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.633+0000 7f26f4ff9700 1 -- 172.21.15.72:0/1975330371 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f26ec01c9c0 con 0x7f26f80637c0 2023-08-31T19:24:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.634+0000 7f26f4ff9700 1 --2- 172.21.15.72:0/1975330371 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f26dc05ef00 0x7f26dc0613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.634+0000 7f26f4ff9700 1 -- 172.21.15.72:0/1975330371 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f26ec07bdb0 con 0x7f26f80637c0 2023-08-31T19:24:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.634+0000 7f26f7fff700 1 --2- 172.21.15.72:0/1975330371 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f26dc05ef00 0x7f26dc0613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.635+0000 7f26f7fff700 1 --2- 172.21.15.72:0/1975330371 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f26dc05ef00 0x7f26dc0613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f26f8152e60 tx=0x7f26e4007bd0).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:30.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.638+0000 7f26f4ff9700 1 -- 172.21.15.72:0/1975330371 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f26ec080070 con 0x7f26f80637c0 2023-08-31T19:24:30.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.813+0000 7f26febff700 1 -- 172.21.15.72:0/1975330371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f26f8064000 con 0x7f26f80637c0 2023-08-31T19:24:30.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.819+0000 7f26f4ff9700 1 -- 172.21.15.72:0/1975330371 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f26ec0200a0 con 0x7f26f80637c0 2023-08-31T19:24:30.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.821+0000 7f26febff700 1 -- 172.21.15.72:0/1975330371 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f26dc05ef00 msgr2=0x7f26dc0613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:30.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.821+0000 7f26febff700 1 --2- 172.21.15.72:0/1975330371 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f26dc05ef00 0x7f26dc0613c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f26f8152e60 tx=0x7f26e4007bd0).stop 2023-08-31T19:24:30.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.821+0000 7f26febff700 1 -- 172.21.15.72:0/1975330371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26f80637c0 msgr2=0x7f26f8145190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:30.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.821+0000 7f26febff700 1 --2- 172.21.15.72:0/1975330371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26f80637c0 0x7f26f8145190 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f26f8065940 tx=0x7f26ec017000).stop 2023-08-31T19:24:30.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.821+0000 7f26febff700 1 -- 172.21.15.72:0/1975330371 shutdown_connections 2023-08-31T19:24:30.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.821+0000 7f26febff700 1 --2- 172.21.15.72:0/1975330371 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f26dc05ef00 0x7f26dc0613c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.821+0000 7f26febff700 1 --2- 172.21.15.72:0/1975330371 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f26f8153e30 0x7f26f80a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.821+0000 7f26febff700 1 --2- 172.21.15.72:0/1975330371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26f80637c0 0x7f26f8145190 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.821+0000 7f26febff700 1 --2- 172.21.15.72:0/1975330371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f26f80c5cb0 0x7f26f80a40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:30.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.821+0000 7f26febff700 1 -- 172.21.15.72:0/1975330371 >> 172.21.15.72:0/1975330371 conn(0x7f26f805eb20 msgr2=0x7f26f80ac990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:30.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.821+0000 7f26febff700 1 -- 172.21.15.72:0/1975330371 shutdown_connections 2023-08-31T19:24:30.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:30.821+0000 7f26febff700 1 -- 172.21.15.72:0/1975330371 wait complete. 2023-08-31T19:24:30.838 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-08-31T19:24:31.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.027+0000 7fb68e1ff700 1 Processor -- start 2023-08-31T19:24:31.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.027+0000 7fb68e1ff700 1 -- start start 2023-08-31T19:24:31.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.028+0000 7fb68e1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6880c6c30 0x7fb6880bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:31.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.028+0000 7fb68e1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6881583f0 0x7fb6880c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:31.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.028+0000 7fb68e1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb688063be0 con 0x7fb6880c4740 2023-08-31T19:24:31.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.028+0000 7fb68e1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb688063010 con 0x7fb6881583f0 2023-08-31T19:24:31.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.028+0000 7fb68e1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6880632b0 con 0x7fb6880c6c30 2023-08-31T19:24:31.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.028+0000 7fb6877fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6880c6c30 0x7fb6880bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:31.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.028+0000 7fb687fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6881583f0 0x7fb6880c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:31.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.029+0000 7fb687fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6881583f0 0x7fb6880c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:55052/0 (socket says 172.21.15.72:55052) 2023-08-31T19:24:31.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.029+0000 7fb687fff700 1 -- 172.21.15.72:0/1069385495 learned_addr learned my addr 172.21.15.72:0/1069385495 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:31.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.029+0000 7fb6877fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6880c6c30 0x7fb6880bc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:44080/0 (socket says 172.21.15.72:44080) 2023-08-31T19:24:31.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.029+0000 7fb687fff700 1 -- 172.21.15.72:0/1069385495 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6880c6c30 msgr2=0x7fb6880bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:31.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.029+0000 7fb687fff700 1 --2- 172.21.15.72:0/1069385495 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6880c6c30 0x7fb6880bc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:31.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.029+0000 7fb687fff700 1 -- 172.21.15.72:0/1069385495 >> v1:172.21.15.146:6789/0 conn(0x7fb6880c4740 legacy=0x7fb688157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:31.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.029+0000 7fb6867fc700 1 -- 172.21.15.72:0/1069385495 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104283500 0 0) 0x7fb688063be0 con 0x7fb6880c4740 2023-08-31T19:24:31.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.029+0000 7fb687fff700 1 -- 172.21.15.72:0/1069385495 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb688063590 con 0x7fb6881583f0 2023-08-31T19:24:31.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.029+0000 7fb6877fe700 1 --2- 172.21.15.72:0/1069385495 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6880c6c30 0x7fb6880bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:31.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.029+0000 7fb687fff700 1 --2- 172.21.15.72:0/1069385495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6881583f0 0x7fb6880c52a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fb680009f20 tx=0x7fb680009840).ready entity=mon.1 client_cookie=99de83cdd7c6ecec server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:31.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.030+0000 7fb6867fc700 1 -- 172.21.15.72:0/1069385495 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68000e070 con 0x7fb6881583f0 2023-08-31T19:24:31.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.030+0000 7fb6867fc700 1 -- 172.21.15.72:0/1069385495 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68000b9d0 con 0x7fb6881583f0 2023-08-31T19:24:31.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.030+0000 7fb6867fc700 1 -- 172.21.15.72:0/1069385495 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68000bd50 con 0x7fb6881583f0 2023-08-31T19:24:31.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.030+0000 7fb68e1ff700 1 -- 172.21.15.72:0/1069385495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6881583f0 msgr2=0x7fb6880c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:31.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.030+0000 7fb68e1ff700 1 --2- 172.21.15.72:0/1069385495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6881583f0 0x7fb6880c52a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fb680009f20 tx=0x7fb680009840).stop 2023-08-31T19:24:31.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.030+0000 7fb68e1ff700 1 -- 172.21.15.72:0/1069385495 shutdown_connections 2023-08-31T19:24:31.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.030+0000 7fb68e1ff700 1 --2- 172.21.15.72:0/1069385495 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6881583f0 0x7fb6880c52a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:31.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.030+0000 7fb68e1ff700 1 --2- 172.21.15.72:0/1069385495 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6880c6c30 0x7fb6880bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:31.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.030+0000 7fb68e1ff700 1 -- 172.21.15.72:0/1069385495 >> 172.21.15.72:0/1069385495 conn(0x7fb6880c7e70 msgr2=0x7fb6880c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:31.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.030+0000 7fb68e1ff700 1 -- 172.21.15.72:0/1069385495 shutdown_connections 2023-08-31T19:24:31.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.030+0000 7fb68e1ff700 1 -- 172.21.15.72:0/1069385495 wait complete. 2023-08-31T19:24:31.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.032+0000 7fb68e1ff700 1 Processor -- start 2023-08-31T19:24:31.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.032+0000 7fb68e1ff700 1 -- start start 2023-08-31T19:24:31.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb68e1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6880c4740 0x7fb68813a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:31.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb68e1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6880c6c30 0x7fb68812bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:31.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb68e1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6881583f0 0x7fb688138700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:31.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb68e1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6881511a0 con 0x7fb6880c4740 2023-08-31T19:24:31.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb68e1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68813a070 con 0x7fb6880c6c30 2023-08-31T19:24:31.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb68e1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68812c1d0 con 0x7fb6881583f0 2023-08-31T19:24:31.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb6877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6880c4740 0x7fb68813a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:31.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb6877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6880c4740 0x7fb68813a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38518/0 (socket says 172.21.15.72:38518) 2023-08-31T19:24:31.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb6877fe700 1 -- 172.21.15.72:0/2123774249 learned_addr learned my addr 172.21.15.72:0/2123774249 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:31.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb686ffd700 1 --2- 172.21.15.72:0/2123774249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6880c6c30 0x7fb68812bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:31.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb687fff700 1 --2- 172.21.15.72:0/2123774249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6881583f0 0x7fb688138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:31.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb6877fe700 1 -- 172.21.15.72:0/2123774249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6881583f0 msgr2=0x7fb688138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:31.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb6877fe700 1 --2- 172.21.15.72:0/2123774249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6881583f0 0x7fb688138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:31.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb6877fe700 1 -- 172.21.15.72:0/2123774249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6880c6c30 msgr2=0x7fb68812bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:31.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb6877fe700 1 --2- 172.21.15.72:0/2123774249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6880c6c30 0x7fb68812bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:31.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb6877fe700 1 -- 172.21.15.72:0/2123774249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6780092a0 con 0x7fb6880c4740 2023-08-31T19:24:31.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.033+0000 7fb686ffd700 1 --2- 172.21.15.72:0/2123774249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6880c6c30 0x7fb68812bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:31.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.034+0000 7fb6877fe700 1 --2- 172.21.15.72:0/2123774249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6880c4740 0x7fb68813a500 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7fb67800ea50 tx=0x7fb678009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:31.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.034+0000 7fb66f7fe700 1 -- 172.21.15.72:0/2123774249 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67800c850 con 0x7fb6880c4740 2023-08-31T19:24:31.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.034+0000 7fb66f7fe700 1 -- 172.21.15.72:0/2123774249 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67800c9b0 con 0x7fb6880c4740 2023-08-31T19:24:31.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.034+0000 7fb66f7fe700 1 -- 172.21.15.72:0/2123774249 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67800cd30 con 0x7fb6880c4740 2023-08-31T19:24:31.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.034+0000 7fb68e1ff700 1 -- 172.21.15.72:0/2123774249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb680009ae0 con 0x7fb6880c4740 2023-08-31T19:24:31.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.034+0000 7fb68e1ff700 1 -- 172.21.15.72:0/2123774249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb688139740 con 0x7fb6880c4740 2023-08-31T19:24:31.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.035+0000 7fb68e1ff700 1 -- 172.21.15.72:0/2123774249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68813a350 con 0x7fb6880c4740 2023-08-31T19:24:31.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.036+0000 7fb66f7fe700 1 -- 172.21.15.72:0/2123774249 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb678012600 con 0x7fb6880c4740 2023-08-31T19:24:31.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.036+0000 7fb66f7fe700 1 --2- 172.21.15.72:0/2123774249 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb67405ef30 0x7fb6740613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:31.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.037+0000 7fb66f7fe700 1 -- 172.21.15.72:0/2123774249 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fb67807a930 con 0x7fb6880c4740 2023-08-31T19:24:31.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.037+0000 7fb686ffd700 1 --2- 172.21.15.72:0/2123774249 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb67405ef30 0x7fb6740613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:31.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.037+0000 7fb686ffd700 1 --2- 172.21.15.72:0/2123774249 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb67405ef30 0x7fb6740613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb67c007fd0 tx=0x7fb67c009040).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:31.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.042+0000 7fb66f7fe700 1 -- 172.21.15.72:0/2123774249 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb67804f430 con 0x7fb6880c4740 2023-08-31T19:24:31.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:31.277+0000 7fb68e1ff700 1 -- 172.21.15.72:0/2123774249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7fb6880c66b0 con 0x7fb6880c4740 2023-08-31T19:24:32.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.020+0000 7fb66f7fe700 1 -- 172.21.15.72:0/2123774249 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v1275) v1 ==== 165+0+0 (secure 0 0 0) 0x7fb67804f020 con 0x7fb6880c4740 2023-08-31T19:24:32.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.024+0000 7fb68e1ff700 1 -- 172.21.15.72:0/2123774249 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb67405ef30 msgr2=0x7fb6740613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:32.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.024+0000 7fb68e1ff700 1 --2- 172.21.15.72:0/2123774249 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb67405ef30 0x7fb6740613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb67c007fd0 tx=0x7fb67c009040).stop 2023-08-31T19:24:32.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.024+0000 7fb68e1ff700 1 -- 172.21.15.72:0/2123774249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6880c4740 msgr2=0x7fb68813a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.024+0000 7fb68e1ff700 1 --2- 172.21.15.72:0/2123774249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6880c4740 0x7fb68813a500 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7fb67800ea50 tx=0x7fb678009060).stop 2023-08-31T19:24:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.025+0000 7fb68e1ff700 1 -- 172.21.15.72:0/2123774249 shutdown_connections 2023-08-31T19:24:32.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.025+0000 7fb68e1ff700 1 --2- 172.21.15.72:0/2123774249 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb67405ef30 0x7fb6740613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:32.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.025+0000 7fb68e1ff700 1 --2- 172.21.15.72:0/2123774249 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6881583f0 0x7fb688138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:32.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.025+0000 7fb68e1ff700 1 --2- 172.21.15.72:0/2123774249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6880c4740 0x7fb68813a500 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:32.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.025+0000 7fb68e1ff700 1 --2- 172.21.15.72:0/2123774249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6880c6c30 0x7fb68812bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:32.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.025+0000 7fb68e1ff700 1 -- 172.21.15.72:0/2123774249 >> 172.21.15.72:0/2123774249 conn(0x7fb6880c7e70 msgr2=0x7fb688157490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:32.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.025+0000 7fb68e1ff700 1 -- 172.21.15.72:0/2123774249 shutdown_connections 2023-08-31T19:24:32.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.025+0000 7fb68e1ff700 1 -- 172.21.15.72:0/2123774249 wait complete. 2023-08-31T19:24:32.046 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-08-31T19:24:32.046 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-08-31T19:24:32.047 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-31T19:24:32.047 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-08-31T19:24:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.239+0000 7f08e1dff700 1 Processor -- start 2023-08-31T19:24:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.239+0000 7f08e1dff700 1 -- start start 2023-08-31T19:24:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.241+0000 7f08e1dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f08dc06a260 0x7f08dc069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.241+0000 7f08e1dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08dc065710 0x7f08dc069a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:32.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.241+0000 7f08e1dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08dc064270 con 0x7f08dc069170 2023-08-31T19:24:32.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.241+0000 7f08e1dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08dc0bca40 con 0x7f08dc06a260 2023-08-31T19:24:32.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.241+0000 7f08e1dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0bcc20 con 0x7f08dc065710 2023-08-31T19:24:32.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.241+0000 7f08daffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f08dc06a260 0x7f08dc069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:32.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.241+0000 7f08daffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f08dc06a260 0x7f08dc069550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:55068/0 (socket says 172.21.15.72:55068) 2023-08-31T19:24:32.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.241+0000 7f08dbfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08dc065710 0x7f08dc069a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:32.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.241+0000 7f08daffd700 1 -- 172.21.15.72:0/3269558188 learned_addr learned my addr 172.21.15.72:0/3269558188 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:32.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.242+0000 7f08da7fc700 1 -- 172.21.15.72:0/3269558188 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015330831 0 0) 0x7f08dc064270 con 0x7f08dc069170 2023-08-31T19:24:32.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.242+0000 7f08da7fc700 1 -- 172.21.15.72:0/3269558188 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08c40033f0 con 0x7f08dc069170 2023-08-31T19:24:32.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.242+0000 7f08dbfff700 1 -- 172.21.15.72:0/3269558188 >> v2:172.21.15.146:3300/0 conn(0x7f08dc06a260 msgr2=0x7f08dc069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:32.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.242+0000 7f08dbfff700 1 --2- 172.21.15.72:0/3269558188 >> v2:172.21.15.146:3300/0 conn(0x7f08dc06a260 0x7f08dc069550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.242+0000 7f08dbfff700 1 -- 172.21.15.72:0/3269558188 >> v1:172.21.15.146:6789/0 conn(0x7f08dc069170 legacy=0x7f08dc0c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.242+0000 7f08dbfff700 1 -- 172.21.15.72:0/3269558188 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc154890 con 0x7f08dc065710 2023-08-31T19:24:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.242+0000 7f08dbfff700 1 --2- 172.21.15.72:0/3269558188 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08dc065710 0x7f08dc069a40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f08d4009e60 tx=0x7f08d4009780).ready entity=mon.2 client_cookie=b1ad36b0ff11259b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.242+0000 7f08da7fc700 1 -- 172.21.15.72:0/3269558188 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d400e070 con 0x7f08dc065710 2023-08-31T19:24:32.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.242+0000 7f08da7fc700 1 -- 172.21.15.72:0/3269558188 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d400bab0 con 0x7f08dc065710 2023-08-31T19:24:32.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.242+0000 7f08da7fc700 1 -- 172.21.15.72:0/3269558188 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d400be30 con 0x7f08dc065710 2023-08-31T19:24:32.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.243+0000 7f08e1dff700 1 -- 172.21.15.72:0/3269558188 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08dc065710 msgr2=0x7f08dc069a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:32.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.243+0000 7f08e1dff700 1 --2- 172.21.15.72:0/3269558188 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08dc065710 0x7f08dc069a40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f08d4009e60 tx=0x7f08d4009780).stop 2023-08-31T19:24:32.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.243+0000 7f08e1dff700 1 -- 172.21.15.72:0/3269558188 shutdown_connections 2023-08-31T19:24:32.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.243+0000 7f08e1dff700 1 --2- 172.21.15.72:0/3269558188 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08dc065710 0x7f08dc069a40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:32.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.243+0000 7f08e1dff700 1 --2- 172.21.15.72:0/3269558188 >> v2:172.21.15.146:3300/0 conn(0x7f08dc06a260 0x7f08dc069550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.243+0000 7f08e1dff700 1 -- 172.21.15.72:0/3269558188 >> 172.21.15.72:0/3269558188 conn(0x7f08dc0c6b10 msgr2=0x7f08dc0c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.243+0000 7f08e1dff700 1 -- 172.21.15.72:0/3269558188 shutdown_connections 2023-08-31T19:24:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.243+0000 7f08e1dff700 1 -- 172.21.15.72:0/3269558188 wait complete. 2023-08-31T19:24:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.244+0000 7f08e1dff700 1 Processor -- start 2023-08-31T19:24:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.244+0000 7f08e1dff700 1 -- start start 2023-08-31T19:24:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.245+0000 7f08e1dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08dc065710 0x7f08dc0a7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.245+0000 7f08e1dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08dc069170 0x7f08dc143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.245+0000 7f08e1dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08dc06a260 0x7f08dc0aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:32.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.245+0000 7f08e1dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0bdcd0 con 0x7f08dc065710 2023-08-31T19:24:32.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.245+0000 7f08e1dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc1443e0 con 0x7f08dc069170 2023-08-31T19:24:32.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.245+0000 7f08e1dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0ab370 con 0x7f08dc06a260 2023-08-31T19:24:32.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08db7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08dc065710 0x7f08dc0a7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:32.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08db7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08dc065710 0x7f08dc0a7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38524/0 (socket says 172.21.15.72:38524) 2023-08-31T19:24:32.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08db7fe700 1 -- 172.21.15.72:0/1648173251 learned_addr learned my addr 172.21.15.72:0/1648173251 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:32.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08daffd700 1 --2- 172.21.15.72:0/1648173251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08dc069170 0x7f08dc143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:32.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08dbfff700 1 --2- 172.21.15.72:0/1648173251 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08dc06a260 0x7f08dc0aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:32.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08db7fe700 1 -- 172.21.15.72:0/1648173251 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08dc06a260 msgr2=0x7f08dc0aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:32.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08db7fe700 1 --2- 172.21.15.72:0/1648173251 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08dc06a260 0x7f08dc0aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:32.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08db7fe700 1 -- 172.21.15.72:0/1648173251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08dc069170 msgr2=0x7f08dc143ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:32.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08db7fe700 1 --2- 172.21.15.72:0/1648173251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08dc069170 0x7f08dc143ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:32.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08db7fe700 1 -- 172.21.15.72:0/1648173251 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d4009a20 con 0x7f08dc065710 2023-08-31T19:24:32.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08dbfff700 1 --2- 172.21.15.72:0/1648173251 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08dc06a260 0x7f08dc0aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:32.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08db7fe700 1 --2- 172.21.15.72:0/1648173251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08dc065710 0x7f08dc0a7a10 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f08cc00c490 tx=0x7f08cc007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:32.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08c37fe700 1 -- 172.21.15.72:0/1648173251 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00f470 con 0x7f08dc065710 2023-08-31T19:24:32.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08c37fe700 1 -- 172.21.15.72:0/1648173251 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc00f5d0 con 0x7f08dc065710 2023-08-31T19:24:32.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08e1dff700 1 -- 172.21.15.72:0/1648173251 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08dc0ab650 con 0x7f08dc065710 2023-08-31T19:24:32.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.246+0000 7f08c37fe700 1 -- 172.21.15.72:0/1648173251 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00f990 con 0x7f08dc065710 2023-08-31T19:24:32.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.247+0000 7f08e1dff700 1 -- 172.21.15.72:0/1648173251 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08dc0aaf60 con 0x7f08dc065710 2023-08-31T19:24:32.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.248+0000 7f08e1dff700 1 -- 172.21.15.72:0/1648173251 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08dc06c6b0 con 0x7f08dc065710 2023-08-31T19:24:32.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.248+0000 7f08c37fe700 1 -- 172.21.15.72:0/1648173251 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f08cc01b3b0 con 0x7f08dc065710 2023-08-31T19:24:32.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.249+0000 7f08c37fe700 1 --2- 172.21.15.72:0/1648173251 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f08c805ef30 0x7f08c80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:32.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.249+0000 7f08c37fe700 1 -- 172.21.15.72:0/1648173251 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f08cc079640 con 0x7f08dc065710 2023-08-31T19:24:32.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.249+0000 7f08daffd700 1 --2- 172.21.15.72:0/1648173251 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f08c805ef30 0x7f08c80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:32.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.250+0000 7f08daffd700 1 --2- 172.21.15.72:0/1648173251 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f08c805ef30 0x7f08c80613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f08dc14eee0 tx=0x7f08d000b3b0).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:32.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.253+0000 7f08c37fe700 1 -- 172.21.15.72:0/1648173251 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f08cc0488f0 con 0x7f08dc065710 2023-08-31T19:24:32.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:32.486+0000 7f08e1dff700 1 -- 172.21.15.72:0/1648173251 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f08dc0bdaa0 con 0x7f08dc065710 2023-08-31T19:24:33.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.021+0000 7f08c37fe700 1 -- 172.21.15.72:0/1648173251 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1276) v1 ==== 166+0+0 (secure 0 0 0) 0x7f08cc04a760 con 0x7f08dc065710 2023-08-31T19:24:33.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.024+0000 7f08e1dff700 1 -- 172.21.15.72:0/1648173251 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f08c805ef30 msgr2=0x7f08c80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:33.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.024+0000 7f08e1dff700 1 --2- 172.21.15.72:0/1648173251 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f08c805ef30 0x7f08c80613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f08dc14eee0 tx=0x7f08d000b3b0).stop 2023-08-31T19:24:33.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.024+0000 7f08e1dff700 1 -- 172.21.15.72:0/1648173251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08dc065710 msgr2=0x7f08dc0a7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:33.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.024+0000 7f08e1dff700 1 --2- 172.21.15.72:0/1648173251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08dc065710 0x7f08dc0a7a10 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f08cc00c490 tx=0x7f08cc007c40).stop 2023-08-31T19:24:33.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.024+0000 7f08e1dff700 1 -- 172.21.15.72:0/1648173251 shutdown_connections 2023-08-31T19:24:33.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.024+0000 7f08e1dff700 1 --2- 172.21.15.72:0/1648173251 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f08c805ef30 0x7f08c80613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.024+0000 7f08e1dff700 1 --2- 172.21.15.72:0/1648173251 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f08dc06a260 0x7f08dc0aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.024+0000 7f08e1dff700 1 --2- 172.21.15.72:0/1648173251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08dc065710 0x7f08dc0a7a10 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.024+0000 7f08e1dff700 1 --2- 172.21.15.72:0/1648173251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08dc069170 0x7f08dc143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.024+0000 7f08e1dff700 1 -- 172.21.15.72:0/1648173251 >> 172.21.15.72:0/1648173251 conn(0x7f08dc0c6b10 msgr2=0x7f08dc064ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:33.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.024+0000 7f08e1dff700 1 -- 172.21.15.72:0/1648173251 shutdown_connections 2023-08-31T19:24:33.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.024+0000 7f08e1dff700 1 -- 172.21.15.72:0/1648173251 wait complete. 2023-08-31T19:24:33.043 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-31T19:24:33.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.234+0000 7f27a2bff700 1 Processor -- start 2023-08-31T19:24:33.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.234+0000 7f27a2bff700 1 -- start start 2023-08-31T19:24:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.235+0000 7f27a2bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f279c154140 0x7f279c0a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.235+0000 7f27a2bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c065fe0 0x7f279c154520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:33.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.235+0000 7f27a2bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f279c158720 con 0x7f279c0a4d30 2023-08-31T19:24:33.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.235+0000 7f27a2bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279c0a51b0 con 0x7f279c154140 2023-08-31T19:24:33.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.235+0000 7f27a2bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c157e30 con 0x7f279c065fe0 2023-08-31T19:24:33.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.236+0000 7f279bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f279c0a4d30 0x7f279c0658d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53298/0 (socket says 172.21.15.72:53298) 2023-08-31T19:24:33.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.236+0000 7f279bfff700 1 -- 172.21.15.72:0/3753046669 learned_addr learned my addr 172.21.15.72:0/3753046669 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:33.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.236+0000 7f27a119c700 1 --2- 172.21.15.72:0/3753046669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c065fe0 0x7f279c154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:33.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.236+0000 7f27a099b700 1 --2- 172.21.15.72:0/3753046669 >> v2:172.21.15.146:3300/0 conn(0x7f279c154140 0x7f279c0a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:33.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.236+0000 7f279b7fe700 1 -- 172.21.15.72:0/3753046669 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380452460 0 0) 0x7f279c158720 con 0x7f279c0a4d30 2023-08-31T19:24:33.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.236+0000 7f279b7fe700 1 -- 172.21.15.72:0/3753046669 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f278c0033f0 con 0x7f279c0a4d30 2023-08-31T19:24:33.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.236+0000 7f279b7fe700 1 -- 172.21.15.72:0/3753046669 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3014982042 0 0) 0x7f278c0033f0 con 0x7f279c0a4d30 2023-08-31T19:24:33.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.236+0000 7f279b7fe700 1 -- 172.21.15.72:0/3753046669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c065fe0 msgr2=0x7f279c154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:33.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.236+0000 7f279b7fe700 1 --2- 172.21.15.72:0/3753046669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c065fe0 0x7f279c154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.236+0000 7f279b7fe700 1 -- 172.21.15.72:0/3753046669 >> v2:172.21.15.146:3300/0 conn(0x7f279c154140 msgr2=0x7f279c0a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:33.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.236+0000 7f279b7fe700 1 --2- 172.21.15.72:0/3753046669 >> v2:172.21.15.146:3300/0 conn(0x7f279c154140 0x7f279c0a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.236+0000 7f279b7fe700 1 -- 172.21.15.72:0/3753046669 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c0c45f0 con 0x7f279c0a4d30 2023-08-31T19:24:33.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.236+0000 7f279b7fe700 1 -- 172.21.15.72:0/3753046669 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f2788001470 con 0x7f279c0a4d30 2023-08-31T19:24:33.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.237+0000 7f279b7fe700 1 -- 172.21.15.72:0/3753046669 >> v1:172.21.15.72:6789/0 conn(0x7f279c0a4d30 legacy=0x7f279c0658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:33.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.237+0000 7f279b7fe700 1 --2- 172.21.15.72:0/3753046669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c0038e0 0x7f278c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:33.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.237+0000 7f279b7fe700 1 --2- 172.21.15.72:0/3753046669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c065fe0 0x7f278c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:33.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.237+0000 7f279b7fe700 1 --2- 172.21.15.72:0/3753046669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f278c004b80 0x7f278c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:33.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.237+0000 7f279b7fe700 1 -- 172.21.15.72:0/3753046669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0a51b0 con 0x7f278c004b80 2023-08-31T19:24:33.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.237+0000 7f279b7fe700 1 -- 172.21.15.72:0/3753046669 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c157e30 con 0x7f278c0038e0 2023-08-31T19:24:33.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.237+0000 7f279b7fe700 1 -- 172.21.15.72:0/3753046669 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c00b8e0 con 0x7f279c065fe0 2023-08-31T19:24:33.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.237+0000 7f27a119c700 1 --2- 172.21.15.72:0/3753046669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f278c004b80 0x7f278c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:33.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.237+0000 7f27a099b700 1 --2- 172.21.15.72:0/3753046669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c0038e0 0x7f278c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:33.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.237+0000 7f279bfff700 1 --2- 172.21.15.72:0/3753046669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c065fe0 0x7f278c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:33.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.237+0000 7f27a119c700 1 -- 172.21.15.72:0/3753046669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c065fe0 msgr2=0x7f278c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:33.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.237+0000 7f27a119c700 1 --2- 172.21.15.72:0/3753046669 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c065fe0 0x7f278c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.237+0000 7f27a119c700 1 -- 172.21.15.72:0/3753046669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c0038e0 msgr2=0x7f278c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:33.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.237+0000 7f27a119c700 1 --2- 172.21.15.72:0/3753046669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c0038e0 0x7f278c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.237+0000 7f27a119c700 1 -- 172.21.15.72:0/3753046669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c0033f0 con 0x7f278c004b80 2023-08-31T19:24:33.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.238+0000 7f27a119c700 1 --2- 172.21.15.72:0/3753046669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f278c004b80 0x7f278c005000 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f279400e210 tx=0x7f279400b040).ready entity=mon.0 client_cookie=1cca0db3b76b7137 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:33.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.238+0000 7f279b7fe700 1 -- 172.21.15.72:0/3753046669 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794009ac0 con 0x7f278c004b80 2023-08-31T19:24:33.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.238+0000 7f279b7fe700 1 -- 172.21.15.72:0/3753046669 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279400f040 con 0x7f278c004b80 2023-08-31T19:24:33.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.238+0000 7f279b7fe700 1 -- 172.21.15.72:0/3753046669 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279400ecd0 con 0x7f278c004b80 2023-08-31T19:24:33.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.238+0000 7f27a2bff700 1 -- 172.21.15.72:0/3753046669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f278c004b80 msgr2=0x7f278c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:33.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.238+0000 7f27a2bff700 1 --2- 172.21.15.72:0/3753046669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f278c004b80 0x7f278c005000 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f279400e210 tx=0x7f279400b040).stop 2023-08-31T19:24:33.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.238+0000 7f27a119c700 1 -- 172.21.15.72:0/3753046669 reap_dead start 2023-08-31T19:24:33.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.238+0000 7f27a2bff700 1 -- 172.21.15.72:0/3753046669 shutdown_connections 2023-08-31T19:24:33.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.238+0000 7f27a2bff700 1 -- 172.21.15.72:0/3753046669 >> 172.21.15.72:0/3753046669 conn(0x7f279c0c7910 msgr2=0x7f279c0c38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:33.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.238+0000 7f27a2bff700 1 -- 172.21.15.72:0/3753046669 shutdown_connections 2023-08-31T19:24:33.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.238+0000 7f27a2bff700 1 -- 172.21.15.72:0/3753046669 wait complete. 2023-08-31T19:24:33.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.240+0000 7f27a2bff700 1 Processor -- start 2023-08-31T19:24:33.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.240+0000 7f27a2bff700 1 -- start start 2023-08-31T19:24:33.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.241+0000 7f27a2bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c004b80 0x7f279c0c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.241+0000 7f27a2bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c154520 0x7f279c1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.241+0000 7f27a2bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c156610 0x7f279c156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.241+0000 7f27a2bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c157380 con 0x7f279c156610 2023-08-31T19:24:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.241+0000 7f27a2bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279c154e90 con 0x7f278c004b80 2023-08-31T19:24:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.241+0000 7f27a2bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279c0be0e0 con 0x7f279c154520 2023-08-31T19:24:33.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.241+0000 7f27a119c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c156610 0x7f279c156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:33.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.241+0000 7f27a119c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c156610 0x7f279c156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60966/0 (socket says 172.21.15.72:60966) 2023-08-31T19:24:33.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.241+0000 7f27a119c700 1 -- 172.21.15.72:0/3135188638 learned_addr learned my addr 172.21.15.72:0/3135188638 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:33.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.241+0000 7f279bfff700 1 --2- 172.21.15.72:0/3135188638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c154520 0x7f279c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:33.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.241+0000 7f27a099b700 1 --2- 172.21.15.72:0/3135188638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c004b80 0x7f279c0c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:33.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.242+0000 7f27a119c700 1 -- 172.21.15.72:0/3135188638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c154520 msgr2=0x7f279c1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:33.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.242+0000 7f27a119c700 1 --2- 172.21.15.72:0/3135188638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c154520 0x7f279c1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.242+0000 7f27a119c700 1 -- 172.21.15.72:0/3135188638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c004b80 msgr2=0x7f279c0c2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:33.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.242+0000 7f27a119c700 1 --2- 172.21.15.72:0/3135188638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c004b80 0x7f279c0c2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.242+0000 7f27a119c700 1 -- 172.21.15.72:0/3135188638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c0be3c0 con 0x7f279c156610 2023-08-31T19:24:33.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.242+0000 7f27a119c700 1 --2- 172.21.15.72:0/3135188638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c156610 0x7f279c156a90 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f2794014000 tx=0x7f279401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:33.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.243+0000 7f2798ff9700 1 -- 172.21.15.72:0/3135188638 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794021030 con 0x7f279c156610 2023-08-31T19:24:33.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.243+0000 7f2798ff9700 1 -- 172.21.15.72:0/3135188638 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2794009ac0 con 0x7f279c156610 2023-08-31T19:24:33.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.243+0000 7f27a2bff700 1 -- 172.21.15.72:0/3135188638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279c0be6a0 con 0x7f279c156610 2023-08-31T19:24:33.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.243+0000 7f2798ff9700 1 -- 172.21.15.72:0/3135188638 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794013d10 con 0x7f279c156610 2023-08-31T19:24:33.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.243+0000 7f27a2bff700 1 -- 172.21.15.72:0/3135188638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279c0c3050 con 0x7f279c156610 2023-08-31T19:24:33.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.244+0000 7f27a2bff700 1 -- 172.21.15.72:0/3135188638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279c06c6b0 con 0x7f279c156610 2023-08-31T19:24:33.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.244+0000 7f2798ff9700 1 -- 172.21.15.72:0/3135188638 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2794024070 con 0x7f279c156610 2023-08-31T19:24:33.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.245+0000 7f2798ff9700 1 --2- 172.21.15.72:0/3135188638 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f278005ef30 0x7f27800613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:33.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.246+0000 7f2798ff9700 1 -- 172.21.15.72:0/3135188638 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f2794022070 con 0x7f279c156610 2023-08-31T19:24:33.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.246+0000 7f27a099b700 1 --2- 172.21.15.72:0/3135188638 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f278005ef30 0x7f27800613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:33.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.246+0000 7f27a099b700 1 --2- 172.21.15.72:0/3135188638 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f278005ef30 0x7f27800613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f2790006d80 tx=0x7f2790009060).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:33.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.249+0000 7f2798ff9700 1 -- 172.21.15.72:0/3135188638 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f279404ca10 con 0x7f279c156610 2023-08-31T19:24:33.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.418+0000 7f27a2bff700 1 -- 172.21.15.72:0/3135188638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f279c1580d0 con 0x7f279c156610 2023-08-31T19:24:33.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.422+0000 7f2798ff9700 1 -- 172.21.15.72:0/3135188638 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2794050030 con 0x7f279c156610 2023-08-31T19:24:33.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.424+0000 7f27a2bff700 1 -- 172.21.15.72:0/3135188638 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f278005ef30 msgr2=0x7f27800613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:33.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.424+0000 7f27a2bff700 1 --2- 172.21.15.72:0/3135188638 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f278005ef30 0x7f27800613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f2790006d80 tx=0x7f2790009060).stop 2023-08-31T19:24:33.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.424+0000 7f27a2bff700 1 -- 172.21.15.72:0/3135188638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c156610 msgr2=0x7f279c156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:33.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.424+0000 7f27a2bff700 1 --2- 172.21.15.72:0/3135188638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c156610 0x7f279c156a90 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f2794014000 tx=0x7f279401a000).stop 2023-08-31T19:24:33.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.424+0000 7f27a2bff700 1 -- 172.21.15.72:0/3135188638 shutdown_connections 2023-08-31T19:24:33.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.425+0000 7f27a2bff700 1 --2- 172.21.15.72:0/3135188638 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f278005ef30 0x7f27800613f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.425+0000 7f27a2bff700 1 --2- 172.21.15.72:0/3135188638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f279c156610 0x7f279c156a90 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.425+0000 7f27a2bff700 1 --2- 172.21.15.72:0/3135188638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c004b80 0x7f279c0c2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.425+0000 7f27a2bff700 1 --2- 172.21.15.72:0/3135188638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f279c154520 0x7f279c1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.425+0000 7f27a2bff700 1 -- 172.21.15.72:0/3135188638 >> 172.21.15.72:0/3135188638 conn(0x7f279c0c7910 msgr2=0x7f279c14e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:33.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.425+0000 7f27a2bff700 1 -- 172.21.15.72:0/3135188638 shutdown_connections 2023-08-31T19:24:33.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.425+0000 7f27a2bff700 1 -- 172.21.15.72:0/3135188638 wait complete. 2023-08-31T19:24:33.443 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:24:33.443 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:24:33.546 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:24:33.660 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:24:33.661 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-31T19:24:33.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:24:33.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.852+0000 7f46371ff700 1 Processor -- start 2023-08-31T19:24:33.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.852+0000 7f46371ff700 1 -- start start 2023-08-31T19:24:33.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.853+0000 7f46371ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4630154060 0x7f4630157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:33.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.853+0000 7f46371ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46301588d0 0x7f4630154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:33.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.853+0000 7f46371ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46300c6120 con 0x7f46300cb9b0 2023-08-31T19:24:33.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.853+0000 7f46371ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46300c1380 con 0x7f4630154060 2023-08-31T19:24:33.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.853+0000 7f46371ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46300c5e10 con 0x7f46301588d0 2023-08-31T19:24:33.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.853+0000 7f4634f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4630154060 0x7f4630157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:33.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.854+0000 7f4634f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4630154060 0x7f4630157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60982/0 (socket says 172.21.15.72:60982) 2023-08-31T19:24:33.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.854+0000 7f4634f9b700 1 -- 172.21.15.72:0/2411953781 learned_addr learned my addr 172.21.15.72:0/2411953781 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:33.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.854+0000 7f463579c700 1 --2- 172.21.15.72:0/2411953781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46301588d0 0x7f4630154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:33.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.854+0000 7f4634f9b700 1 -- 172.21.15.72:0/2411953781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46301588d0 msgr2=0x7f4630154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:33.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.854+0000 7f4634f9b700 1 --2- 172.21.15.72:0/2411953781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46301588d0 0x7f4630154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.854+0000 7f4634f9b700 1 -- 172.21.15.72:0/2411953781 >> v1:172.21.15.146:6789/0 conn(0x7f46300cb9b0 legacy=0x7f46301581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:33.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.854+0000 7f4634f9b700 1 -- 172.21.15.72:0/2411953781 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46300c0ae0 con 0x7f4630154060 2023-08-31T19:24:33.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.854+0000 7f4634f9b700 1 --2- 172.21.15.72:0/2411953781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4630154060 0x7f4630157cd0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f4624009810 tx=0x7f4624009060).ready entity=mon.0 client_cookie=fd6df3d885941c2c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:33.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.854+0000 7f462f7fe700 1 -- 172.21.15.72:0/2411953781 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624005880 con 0x7f4630154060 2023-08-31T19:24:33.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.854+0000 7f462f7fe700 1 -- 172.21.15.72:0/2411953781 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46240059e0 con 0x7f4630154060 2023-08-31T19:24:33.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.854+0000 7f462f7fe700 1 -- 172.21.15.72:0/2411953781 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624005d60 con 0x7f4630154060 2023-08-31T19:24:33.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.855+0000 7f46371ff700 1 -- 172.21.15.72:0/2411953781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4630154060 msgr2=0x7f4630157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:33.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.855+0000 7f46371ff700 1 --2- 172.21.15.72:0/2411953781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4630154060 0x7f4630157cd0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f4624009810 tx=0x7f4624009060).stop 2023-08-31T19:24:33.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.855+0000 7f46371ff700 1 -- 172.21.15.72:0/2411953781 shutdown_connections 2023-08-31T19:24:33.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.855+0000 7f46371ff700 1 --2- 172.21.15.72:0/2411953781 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46301588d0 0x7f4630154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.855+0000 7f46371ff700 1 --2- 172.21.15.72:0/2411953781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4630154060 0x7f4630157cd0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.855+0000 7f46371ff700 1 -- 172.21.15.72:0/2411953781 >> 172.21.15.72:0/2411953781 conn(0x7f463005e870 msgr2=0x7f46300cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:33.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.855+0000 7f46371ff700 1 -- 172.21.15.72:0/2411953781 shutdown_connections 2023-08-31T19:24:33.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.855+0000 7f46371ff700 1 -- 172.21.15.72:0/2411953781 wait complete. 2023-08-31T19:24:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.857+0000 7f46371ff700 1 Processor -- start 2023-08-31T19:24:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.857+0000 7f46371ff700 1 -- start start 2023-08-31T19:24:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.858+0000 7f46371ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46300cb9b0 0x7f46300ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:33.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.858+0000 7f46371ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4630154060 0x7f4630153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.858+0000 7f46371ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46301588d0 0x7f4630153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.858+0000 7f46371ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4630153d30 con 0x7f46301588d0 2023-08-31T19:24:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.858+0000 7f46371ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4630164520 con 0x7f4630154060 2023-08-31T19:24:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.858+0000 7f46371ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4630165340 con 0x7f46300cb9b0 2023-08-31T19:24:33.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.858+0000 7f463579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46301588d0 0x7f4630153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.858+0000 7f463579c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46301588d0 0x7f4630153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60998/0 (socket says 172.21.15.72:60998) 2023-08-31T19:24:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.858+0000 7f463579c700 1 -- 172.21.15.72:0/1026397927 learned_addr learned my addr 172.21.15.72:0/1026397927 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.859+0000 7f4634f9b700 1 --2- 172.21.15.72:0/1026397927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46300cb9b0 0x7f46300ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.859+0000 7f462ffff700 1 --2- 172.21.15.72:0/1026397927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4630154060 0x7f4630153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:33.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.859+0000 7f463579c700 1 -- 172.21.15.72:0/1026397927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46300cb9b0 msgr2=0x7f46300ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:33.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.859+0000 7f463579c700 1 --2- 172.21.15.72:0/1026397927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46300cb9b0 0x7f46300ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.859+0000 7f463579c700 1 -- 172.21.15.72:0/1026397927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4630154060 msgr2=0x7f4630153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:33.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.859+0000 7f463579c700 1 --2- 172.21.15.72:0/1026397927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4630154060 0x7f4630153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:33.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.859+0000 7f463579c700 1 -- 172.21.15.72:0/1026397927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4624009300 con 0x7f46301588d0 2023-08-31T19:24:33.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.859+0000 7f462ffff700 1 --2- 172.21.15.72:0/1026397927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4630154060 0x7f4630153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:24:33.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.859+0000 7f463579c700 1 --2- 172.21.15.72:0/1026397927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46301588d0 0x7f4630153840 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f4628007f20 tx=0x7f4628009800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:33.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.859+0000 7f462cff9700 1 -- 172.21.15.72:0/1026397927 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462800ec40 con 0x7f46301588d0 2023-08-31T19:24:33.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.859+0000 7f462cff9700 1 -- 172.21.15.72:0/1026397927 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462800eda0 con 0x7f46301588d0 2023-08-31T19:24:33.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.859+0000 7f46371ff700 1 -- 172.21.15.72:0/1026397927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4630164730 con 0x7f46301588d0 2023-08-31T19:24:33.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.859+0000 7f462cff9700 1 -- 172.21.15.72:0/1026397927 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628014610 con 0x7f46301588d0 2023-08-31T19:24:33.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.859+0000 7f46371ff700 1 -- 172.21.15.72:0/1026397927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4630164cf0 con 0x7f46301588d0 2023-08-31T19:24:33.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.860+0000 7f46371ff700 1 -- 172.21.15.72:0/1026397927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46301654b0 con 0x7f46301588d0 2023-08-31T19:24:33.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.861+0000 7f462cff9700 1 -- 172.21.15.72:0/1026397927 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f462801d3b0 con 0x7f46301588d0 2023-08-31T19:24:33.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.862+0000 7f462cff9700 1 --2- 172.21.15.72:0/1026397927 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f461405ef30 0x7f46140613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:33.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.863+0000 7f462cff9700 1 -- 172.21.15.72:0/1026397927 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6671+0+0 (secure 0 0 0) 0x7f462807a720 con 0x7f46301588d0 2023-08-31T19:24:33.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.863+0000 7f4634f9b700 1 --2- 172.21.15.72:0/1026397927 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f461405ef30 0x7f46140613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:33.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.863+0000 7f4634f9b700 1 --2- 172.21.15.72:0/1026397927 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f461405ef30 0x7f46140613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4624009fd0 tx=0x7f4624016000).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:33.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:33.867+0000 7f462cff9700 1 -- 172.21.15.72:0/1026397927 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f462804b790 con 0x7f46301588d0 2023-08-31T19:24:34.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.075+0000 7f46371ff700 1 -- 172.21.15.72:0/1026397927 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f463006c6b0 con 0x7f46301588d0 2023-08-31T19:24:34.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.075+0000 7f462cff9700 1 -- 172.21.15.72:0/1026397927 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f462804edb0 con 0x7f46301588d0 2023-08-31T19:24:34.109 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:34.109 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":73,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6926,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2210268438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2210268438},{"type":"v1","addr":"172.21.15.72:6836","nonce":2210268438}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/3842453419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3842453419},{"type":"v1","addr":"172.21.15.146:6834","nonce":3842453419}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/282510582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":282510582},{"type":"v1","addr":"172.21.15.146:6835","nonce":282510582}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":8952,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2267833498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2267833498},{"type":"v1","addr":"172.21.15.72:6837","nonce":2267833498}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[]} 2023-08-31T19:24:34.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.077+0000 7f46371ff700 1 -- 172.21.15.72:0/1026397927 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f461405ef30 msgr2=0x7f46140613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:34.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.077+0000 7f46371ff700 1 --2- 172.21.15.72:0/1026397927 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f461405ef30 0x7f46140613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4624009fd0 tx=0x7f4624016000).stop 2023-08-31T19:24:34.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.077+0000 7f46371ff700 1 -- 172.21.15.72:0/1026397927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46301588d0 msgr2=0x7f4630153840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.077+0000 7f46371ff700 1 --2- 172.21.15.72:0/1026397927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46301588d0 0x7f4630153840 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f4628007f20 tx=0x7f4628009800).stop 2023-08-31T19:24:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.077+0000 7f46371ff700 1 -- 172.21.15.72:0/1026397927 shutdown_connections 2023-08-31T19:24:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.077+0000 7f46371ff700 1 --2- 172.21.15.72:0/1026397927 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f461405ef30 0x7f46140613f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.077+0000 7f46371ff700 1 --2- 172.21.15.72:0/1026397927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46301588d0 0x7f4630153840 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.077+0000 7f46371ff700 1 --2- 172.21.15.72:0/1026397927 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46300cb9b0 0x7f46300ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.077+0000 7f46371ff700 1 --2- 172.21.15.72:0/1026397927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4630154060 0x7f4630153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.077+0000 7f46371ff700 1 -- 172.21.15.72:0/1026397927 >> 172.21.15.72:0/1026397927 conn(0x7f463005e870 msgr2=0x7f46300c77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.078+0000 7f46371ff700 1 -- 172.21.15.72:0/1026397927 shutdown_connections 2023-08-31T19:24:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.078+0000 7f46371ff700 1 -- 172.21.15.72:0/1026397927 wait complete. 2023-08-31T19:24:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 73 2023-08-31T19:24:34.114 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T19:24:34.114 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-31T19:24:34.115 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T19:24:34.115 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:24:34.115 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T19:24:34.115 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-31T19:24:34.116 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T19:24:34.116 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:24:34.116 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T19:24:34.117 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-31T19:24:34.117 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T19:24:34.117 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:24:34.117 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T19:24:34.118 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-31T19:24:34.118 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T19:24:34.118 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:24:34.129 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T19:24:34.129 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T19:24:34.130 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T19:24:34.130 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T19:24:34.137 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T19:24:34.137 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T19:24:34.139 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T19:24:34.139 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T19:24:34.174 INFO:tasks.ceph.mds.c:Started 2023-08-31T19:24:34.174 DEBUG:teuthology.parallel:result is None 2023-08-31T19:24:34.176 INFO:tasks.ceph.mds.a:Started 2023-08-31T19:24:34.177 DEBUG:teuthology.parallel:result is None 2023-08-31T19:24:34.182 INFO:tasks.ceph.mds.b:Started 2023-08-31T19:24:34.183 DEBUG:teuthology.parallel:result is None 2023-08-31T19:24:34.185 INFO:tasks.ceph.mds.d:Started 2023-08-31T19:24:34.186 DEBUG:teuthology.parallel:result is None 2023-08-31T19:24:34.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-31T19:24:34.317 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T19:24:34.318 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-31T19:24:34.333 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-08-31T19:24:34.336 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-08-31T19:24:34.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-08-31T19:24:34.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-08-31T19:24:34.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-08-31T19:24:34.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.392+0000 7fe6085ff700 1 Processor -- start 2023-08-31T19:24:34.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.393+0000 7fe6085ff700 1 -- start start 2023-08-31T19:24:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.394+0000 7fe6085ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe600157c10 0x7fe6000ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.394+0000 7fe6085ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6000637c0 0x7fe600155070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.394+0000 7fe6085ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6000c6130 con 0x7fe6000ad1b0 2023-08-31T19:24:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.394+0000 7fe6085ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6000c0350 con 0x7fe600157c10 2023-08-31T19:24:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.394+0000 7fe6085ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6001580b0 con 0x7fe6000637c0 2023-08-31T19:24:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.394+0000 7fe60639b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe6000ad1b0 0x7fe6000630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53318/0 (socket says 172.21.15.72:53318) 2023-08-31T19:24:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.394+0000 7fe60639b700 1 -- 172.21.15.72:0/223377961 learned_addr learned my addr 172.21.15.72:0/223377961 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.394+0000 7fe605b9a700 1 --2- 172.21.15.72:0/223377961 >> v2:172.21.15.146:3300/0 conn(0x7fe600157c10 0x7fe6000ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.394+0000 7fe606b9c700 1 --2- 172.21.15.72:0/223377961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6000637c0 0x7fe600155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:34.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.395+0000 7fe605399700 1 -- 172.21.15.72:0/223377961 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850211242 0 0) 0x7fe6000c6130 con 0x7fe6000ad1b0 2023-08-31T19:24:34.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.395+0000 7fe605399700 1 -- 172.21.15.72:0/223377961 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5ec0033f0 con 0x7fe6000ad1b0 2023-08-31T19:24:34.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.395+0000 7fe606b9c700 1 -- 172.21.15.72:0/223377961 >> v2:172.21.15.146:3300/0 conn(0x7fe600157c10 msgr2=0x7fe6000ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:34.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.395+0000 7fe606b9c700 1 --2- 172.21.15.72:0/223377961 >> v2:172.21.15.146:3300/0 conn(0x7fe600157c10 0x7fe6000ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:34.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.395+0000 7fe606b9c700 1 -- 172.21.15.72:0/223377961 >> v1:172.21.15.72:6789/0 conn(0x7fe6000ad1b0 legacy=0x7fe6000630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:34.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.395+0000 7fe606b9c700 1 -- 172.21.15.72:0/223377961 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600155560 con 0x7fe6000637c0 2023-08-31T19:24:34.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.395+0000 7fe605b9a700 1 --2- 172.21.15.72:0/223377961 >> v2:172.21.15.146:3300/0 conn(0x7fe600157c10 0x7fe6000ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:34.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.395+0000 7fe606b9c700 1 --2- 172.21.15.72:0/223377961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6000637c0 0x7fe600155070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fe5f8009e60 tx=0x7fe5f8009780).ready entity=mon.2 client_cookie=547b0acbe218e039 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:34.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.395+0000 7fe605399700 1 -- 172.21.15.72:0/223377961 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800e070 con 0x7fe6000637c0 2023-08-31T19:24:34.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.395+0000 7fe605399700 1 -- 172.21.15.72:0/223377961 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f800bab0 con 0x7fe6000637c0 2023-08-31T19:24:34.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.395+0000 7fe605399700 1 -- 172.21.15.72:0/223377961 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800be30 con 0x7fe6000637c0 2023-08-31T19:24:34.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.396+0000 7fe6085ff700 1 -- 172.21.15.72:0/223377961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6000637c0 msgr2=0x7fe600155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:34.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.396+0000 7fe6085ff700 1 --2- 172.21.15.72:0/223377961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6000637c0 0x7fe600155070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fe5f8009e60 tx=0x7fe5f8009780).stop 2023-08-31T19:24:34.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.396+0000 7fe6085ff700 1 -- 172.21.15.72:0/223377961 shutdown_connections 2023-08-31T19:24:34.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.396+0000 7fe6085ff700 1 --2- 172.21.15.72:0/223377961 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6000637c0 0x7fe600155070 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:34.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.396+0000 7fe6085ff700 1 --2- 172.21.15.72:0/223377961 >> v2:172.21.15.146:3300/0 conn(0x7fe600157c10 0x7fe6000ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:34.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.396+0000 7fe6085ff700 1 -- 172.21.15.72:0/223377961 >> 172.21.15.72:0/223377961 conn(0x7fe60005eb60 msgr2=0x7fe6000cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:34.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.396+0000 7fe6085ff700 1 -- 172.21.15.72:0/223377961 shutdown_connections 2023-08-31T19:24:34.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.396+0000 7fe6085ff700 1 -- 172.21.15.72:0/223377961 wait complete. 2023-08-31T19:24:34.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.397+0000 7fe6085ff700 1 Processor -- start 2023-08-31T19:24:34.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.398+0000 7fe6085ff700 1 -- start start 2023-08-31T19:24:34.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.398+0000 7fe6085ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6000637c0 0x7fe60014a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:34.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.398+0000 7fe6085ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6000ad1b0 0x7fe6001514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.399+0000 7fe6085ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600157c10 0x7fe6000c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.399+0000 7fe6085ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60014f680 con 0x7fe6000637c0 2023-08-31T19:24:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.399+0000 7fe6085ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000b0780 con 0x7fe600157c10 2023-08-31T19:24:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.399+0000 7fe6085ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000b0a60 con 0x7fe6000ad1b0 2023-08-31T19:24:34.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.399+0000 7fe60639b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6000637c0 0x7fe60014a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:34.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.399+0000 7fe60639b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6000637c0 0x7fe60014a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32800/0 (socket says 172.21.15.72:32800) 2023-08-31T19:24:34.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.399+0000 7fe60639b700 1 -- 172.21.15.72:0/890449710 learned_addr learned my addr 172.21.15.72:0/890449710 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:34.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.399+0000 7fe605b9a700 1 --2- 172.21.15.72:0/890449710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6000ad1b0 0x7fe6001514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:34.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.399+0000 7fe606b9c700 1 --2- 172.21.15.72:0/890449710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600157c10 0x7fe6000c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:34.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.399+0000 7fe60639b700 1 -- 172.21.15.72:0/890449710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6000ad1b0 msgr2=0x7fe6001514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:34.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.399+0000 7fe60639b700 1 --2- 172.21.15.72:0/890449710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6000ad1b0 0x7fe6001514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:34.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.399+0000 7fe60639b700 1 -- 172.21.15.72:0/890449710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600157c10 msgr2=0x7fe6000c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:34.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.399+0000 7fe60639b700 1 --2- 172.21.15.72:0/890449710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600157c10 0x7fe6000c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:34.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.399+0000 7fe60639b700 1 -- 172.21.15.72:0/890449710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f00092a0 con 0x7fe6000637c0 2023-08-31T19:24:34.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.399+0000 7fe60639b700 1 --2- 172.21.15.72:0/890449710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6000637c0 0x7fe60014a8a0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7fe5fc00c590 tx=0x7fe5fc007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:34.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.400+0000 7fe5f67fc700 1 -- 172.21.15.72:0/890449710 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc0072e0 con 0x7fe6000637c0 2023-08-31T19:24:34.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.400+0000 7fe5f67fc700 1 -- 172.21.15.72:0/890449710 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc007440 con 0x7fe6000637c0 2023-08-31T19:24:34.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.400+0000 7fe5f67fc700 1 -- 172.21.15.72:0/890449710 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc0057a0 con 0x7fe6000637c0 2023-08-31T19:24:34.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.400+0000 7fe6085ff700 1 -- 172.21.15.72:0/890449710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f8009a20 con 0x7fe6000637c0 2023-08-31T19:24:34.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.400+0000 7fe6085ff700 1 -- 172.21.15.72:0/890449710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60014ad90 con 0x7fe6000637c0 2023-08-31T19:24:34.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.401+0000 7fe6085ff700 1 -- 172.21.15.72:0/890449710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60006c6b0 con 0x7fe6000637c0 2023-08-31T19:24:34.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.402+0000 7fe5f67fc700 1 -- 172.21.15.72:0/890449710 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe5fc005bd0 con 0x7fe6000637c0 2023-08-31T19:24:34.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.402+0000 7fe5f67fc700 1 --2- 172.21.15.72:0/890449710 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe5e405ef60 0x7fe5e4061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:34.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.402+0000 7fe5f67fc700 1 -- 172.21.15.72:0/890449710 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6671+0+0 (secure 0 0 0) 0x7fe5fc079ab0 con 0x7fe6000637c0 2023-08-31T19:24:34.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.403+0000 7fe605b9a700 1 --2- 172.21.15.72:0/890449710 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe5e405ef60 0x7fe5e4061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:34.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.403+0000 7fe605b9a700 1 --2- 172.21.15.72:0/890449710 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe5e405ef60 0x7fe5e4061420 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe5f0009270 tx=0x7fe5f0008040).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:34.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.406+0000 7fe5f67fc700 1 -- 172.21.15.72:0/890449710 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe5fc04ab80 con 0x7fe6000637c0 2023-08-31T19:24:34.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:34.591+0000 7fe6085ff700 1 -- 172.21.15.72:0/890449710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe600158350 con 0x7fe6000637c0 2023-08-31T19:24:35.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.426+0000 7fe5f67fc700 1 -- 172.21.15.72:0/890449710 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v172) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe5fc079e60 con 0x7fe6000637c0 2023-08-31T19:24:35.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.429+0000 7fe6085ff700 1 -- 172.21.15.72:0/890449710 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe5e405ef60 msgr2=0x7fe5e4061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:35.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.429+0000 7fe6085ff700 1 --2- 172.21.15.72:0/890449710 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe5e405ef60 0x7fe5e4061420 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe5f0009270 tx=0x7fe5f0008040).stop 2023-08-31T19:24:35.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.429+0000 7fe6085ff700 1 -- 172.21.15.72:0/890449710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6000637c0 msgr2=0x7fe60014a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:35.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.429+0000 7fe6085ff700 1 --2- 172.21.15.72:0/890449710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6000637c0 0x7fe60014a8a0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7fe5fc00c590 tx=0x7fe5fc007c80).stop 2023-08-31T19:24:35.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.429+0000 7fe6085ff700 1 -- 172.21.15.72:0/890449710 shutdown_connections 2023-08-31T19:24:35.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.429+0000 7fe6085ff700 1 --2- 172.21.15.72:0/890449710 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe5e405ef60 0x7fe5e4061420 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:35.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.429+0000 7fe6085ff700 1 --2- 172.21.15.72:0/890449710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600157c10 0x7fe6000c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:35.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.429+0000 7fe6085ff700 1 --2- 172.21.15.72:0/890449710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6000637c0 0x7fe60014a8a0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:35.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.430+0000 7fe6085ff700 1 --2- 172.21.15.72:0/890449710 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe6000ad1b0 0x7fe6001514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:35.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.430+0000 7fe6085ff700 1 -- 172.21.15.72:0/890449710 >> 172.21.15.72:0/890449710 conn(0x7fe60005eb60 msgr2=0x7fe600152ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:35.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.430+0000 7fe6085ff700 1 -- 172.21.15.72:0/890449710 shutdown_connections 2023-08-31T19:24:35.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.430+0000 7fe6085ff700 1 -- 172.21.15.72:0/890449710 wait complete. 2023-08-31T19:24:35.433 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-08-31T19:24:35.448 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-31T19:24:35.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.638+0000 7fa6fe1ff700 1 Processor -- start 2023-08-31T19:24:35.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.638+0000 7fa6fe1ff700 1 -- start start 2023-08-31T19:24:35.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.640+0000 7fa6fe1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6f815ce50 0x7fa6f815f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:35.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.640+0000 7fa6fe1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f80c8c90 con 0x7fa6f80cb940 2023-08-31T19:24:35.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.640+0000 7fa6fe1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f8158af0 con 0x7fa6f8154220 2023-08-31T19:24:35.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.640+0000 7fa6fe1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f80aa700 con 0x7fa6f815ce50 2023-08-31T19:24:35.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.640+0000 7fa6f7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6f815ce50 0x7fa6f815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:35.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.640+0000 7fa6f6ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa6f80cb940 0x7fa6f81583e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53334/0 (socket says 172.21.15.72:53334) 2023-08-31T19:24:35.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.640+0000 7fa6f6ffd700 1 -- 172.21.15.72:0/1328444756 learned_addr learned my addr 172.21.15.72:0/1328444756 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:35.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.640+0000 7fa6f7fff700 1 -- 172.21.15.72:0/1328444756 >> v1:172.21.15.146:6789/0 conn(0x7fa6f8154220 legacy=0x7fa6f8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:35.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.640+0000 7fa6f7fff700 1 -- 172.21.15.72:0/1328444756 >> v1:172.21.15.72:6789/0 conn(0x7fa6f80cb940 legacy=0x7fa6f81583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:35.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.640+0000 7fa6f67fc700 1 -- 172.21.15.72:0/1328444756 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115129364 0 0) 0x7fa6f80c8c90 con 0x7fa6f80cb940 2023-08-31T19:24:35.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.640+0000 7fa6f7fff700 1 -- 172.21.15.72:0/1328444756 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f8155610 con 0x7fa6f815ce50 2023-08-31T19:24:35.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.641+0000 7fa6f7fff700 1 --2- 172.21.15.72:0/1328444756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815ce50 0x7fa6f815f240 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7fa6f0009e60 tx=0x7fa6f0009780).ready entity=mon.0 client_cookie=ba43f7c91f748900 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:35.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.641+0000 7fa6f67fc700 1 -- 172.21.15.72:0/1328444756 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f000e070 con 0x7fa6f815ce50 2023-08-31T19:24:35.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.641+0000 7fa6f67fc700 1 -- 172.21.15.72:0/1328444756 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f000bc30 con 0x7fa6f815ce50 2023-08-31T19:24:35.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.641+0000 7fa6f67fc700 1 -- 172.21.15.72:0/1328444756 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0012410 con 0x7fa6f815ce50 2023-08-31T19:24:35.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.641+0000 7fa6fe1ff700 1 -- 172.21.15.72:0/1328444756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815ce50 msgr2=0x7fa6f815f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:35.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.641+0000 7fa6fe1ff700 1 --2- 172.21.15.72:0/1328444756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815ce50 0x7fa6f815f240 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7fa6f0009e60 tx=0x7fa6f0009780).stop 2023-08-31T19:24:35.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.642+0000 7fa6fe1ff700 1 -- 172.21.15.72:0/1328444756 shutdown_connections 2023-08-31T19:24:35.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.642+0000 7fa6fe1ff700 1 --2- 172.21.15.72:0/1328444756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815ce50 0x7fa6f815f240 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:35.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.642+0000 7fa6fe1ff700 1 -- 172.21.15.72:0/1328444756 >> 172.21.15.72:0/1328444756 conn(0x7fa6f805e870 msgr2=0x7fa6f80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:35.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.642+0000 7fa6fe1ff700 1 -- 172.21.15.72:0/1328444756 shutdown_connections 2023-08-31T19:24:35.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.642+0000 7fa6fe1ff700 1 -- 172.21.15.72:0/1328444756 wait complete. 2023-08-31T19:24:35.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.643+0000 7fa6fe1ff700 1 Processor -- start 2023-08-31T19:24:35.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.643+0000 7fa6fe1ff700 1 -- start start 2023-08-31T19:24:35.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.644+0000 7fa6fe1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6f80cb940 0x7fa6f8147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:35.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.644+0000 7fa6fe1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6f8154220 0x7fa6f8149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:35.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.644+0000 7fa6fe1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815ce50 0x7fa6f814d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:35.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.644+0000 7fa6fe1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f8153c50 con 0x7fa6f815ce50 2023-08-31T19:24:35.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.644+0000 7fa6fe1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80c6440 con 0x7fa6f80cb940 2023-08-31T19:24:35.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.644+0000 7fa6fe1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f8151d40 con 0x7fa6f8154220 2023-08-31T19:24:35.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.644+0000 7fa6f7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815ce50 0x7fa6f814d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:35.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.645+0000 7fa6f7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815ce50 0x7fa6f814d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32828/0 (socket says 172.21.15.72:32828) 2023-08-31T19:24:35.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.645+0000 7fa6f7fff700 1 -- 172.21.15.72:0/2684487477 learned_addr learned my addr 172.21.15.72:0/2684487477 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:35.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.645+0000 7fa6f77fe700 1 --2- 172.21.15.72:0/2684487477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6f80cb940 0x7fa6f8147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:35.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.645+0000 7fa6f6ffd700 1 --2- 172.21.15.72:0/2684487477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6f8154220 0x7fa6f8149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:35.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.645+0000 7fa6f7fff700 1 -- 172.21.15.72:0/2684487477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6f8154220 msgr2=0x7fa6f8149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:35.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.645+0000 7fa6f7fff700 1 --2- 172.21.15.72:0/2684487477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6f8154220 0x7fa6f8149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:35.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.645+0000 7fa6f7fff700 1 -- 172.21.15.72:0/2684487477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6f80cb940 msgr2=0x7fa6f8147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:35.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.645+0000 7fa6f7fff700 1 --2- 172.21.15.72:0/2684487477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6f80cb940 0x7fa6f8147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:35.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.645+0000 7fa6f7fff700 1 -- 172.21.15.72:0/2684487477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f0009a20 con 0x7fa6f815ce50 2023-08-31T19:24:35.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.645+0000 7fa6f77fe700 1 --2- 172.21.15.72:0/2684487477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6f80cb940 0x7fa6f8147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:35.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.645+0000 7fa6f7fff700 1 --2- 172.21.15.72:0/2684487477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815ce50 0x7fa6f814d3f0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7fa6f8083570 tx=0x7fa6f0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:35.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.645+0000 7fa6df7fe700 1 -- 172.21.15.72:0/2684487477 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00064a0 con 0x7fa6f815ce50 2023-08-31T19:24:35.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.645+0000 7fa6df7fe700 1 -- 172.21.15.72:0/2684487477 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f0006600 con 0x7fa6f815ce50 2023-08-31T19:24:35.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.645+0000 7fa6df7fe700 1 -- 172.21.15.72:0/2684487477 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00069a0 con 0x7fa6f815ce50 2023-08-31T19:24:35.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.645+0000 7fa6fe1ff700 1 -- 172.21.15.72:0/2684487477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f8152020 con 0x7fa6f815ce50 2023-08-31T19:24:35.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.646+0000 7fa6fe1ff700 1 -- 172.21.15.72:0/2684487477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f81525e0 con 0x7fa6f815ce50 2023-08-31T19:24:35.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.646+0000 7fa6fe1ff700 1 -- 172.21.15.72:0/2684487477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f80c65b0 con 0x7fa6f815ce50 2023-08-31T19:24:35.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.647+0000 7fa6df7fe700 1 -- 172.21.15.72:0/2684487477 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa6f001d630 con 0x7fa6f815ce50 2023-08-31T19:24:35.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.648+0000 7fa6df7fe700 1 --2- 172.21.15.72:0/2684487477 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa6e405ef60 0x7fa6e4061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:35.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.648+0000 7fa6df7fe700 1 -- 172.21.15.72:0/2684487477 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5897+0+0 (secure 0 0 0) 0x7fa6f007c440 con 0x7fa6f815ce50 2023-08-31T19:24:35.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.648+0000 7fa6f77fe700 1 --2- 172.21.15.72:0/2684487477 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa6e405ef60 0x7fa6e4061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:35.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.649+0000 7fa6f77fe700 1 --2- 172.21.15.72:0/2684487477 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa6e405ef60 0x7fa6e4061420 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa6e8001780 tx=0x7fa6e8009040).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:35.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.652+0000 7fa6df7fe700 1 -- 172.21.15.72:0/2684487477 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa6f004d810 con 0x7fa6f815ce50 2023-08-31T19:24:35.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.885+0000 7fa6fe1ff700 1 -- 172.21.15.72:0/2684487477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa6f806c6b0 con 0x7fa6f815ce50 2023-08-31T19:24:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.885+0000 7fa6df7fe700 1 -- 172.21.15.72:0/2684487477 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v32) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa6f0050e30 con 0x7fa6f815ce50 2023-08-31T19:24:35.886 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:35.886 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:24:35.887 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-08-31T19:24:35.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.887 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-08-31T19:24:35.887 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkPeqvDBAAA2eEr6xr7iF5PPNT9eehSg==", 2023-08-31T19:24:35.888 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.889 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:24:35.889 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:24:35.889 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:24:35.889 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:24:35.889 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.890 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-08-31T19:24:35.890 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkctxUIxAAufSVXMwPzPA7Gq1s4ukXiQ==", 2023-08-31T19:24:35.891 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.891 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:24:35.891 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:24:35.891 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:24:35.891 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:24:35.892 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.892 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-08-31T19:24:35.892 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkcpLfFxAASIB//h8whjuh6s3YKBVffQ==", 2023-08-31T19:24:35.893 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.893 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:24:35.893 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:24:35.893 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:24:35.893 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:24:35.893 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.894 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-08-31T19:24:35.894 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkC1bbLhAAg/0wct2P0+cyWbZyI2bP/g==", 2023-08-31T19:24:35.894 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.895 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:24:35.895 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:24:35.895 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:24:35.895 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:24:35.895 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.896 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-08-31T19:24:35.896 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAi4PBkvfRJEBAAYQqPldOXrJxXAXnmZhXaBQ==", 2023-08-31T19:24:35.896 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.897 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:24:35.897 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:24:35.897 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:24:35.897 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.898 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-08-31T19:24:35.898 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAl4PBkYysSIhAA4nCmskcGV+i4vpH2k/gDBg==", 2023-08-31T19:24:35.898 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.899 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:24:35.899 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:24:35.899 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:24:35.900 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.900 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-08-31T19:24:35.900 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAp4PBkyDgJFxAAPynEKk15yN7+OxQxpzL0UQ==", 2023-08-31T19:24:35.901 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.901 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:24:35.901 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:24:35.901 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:24:35.901 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.902 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-08-31T19:24:35.902 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAs4PBkZMD2KBAAoJrO4YjJ4/8MjcPAtgEn1g==", 2023-08-31T19:24:35.903 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.903 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:24:35.903 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:24:35.903 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:24:35.903 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.904 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-08-31T19:24:35.904 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAz4PBkSgAoExAAJ95kdHV47jDTXSj/WSCiLw==", 2023-08-31T19:24:35.904 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.905 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:24:35.905 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:24:35.905 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:24:35.905 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.906 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-08-31T19:24:35.906 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA24PBkUxpLKBAAAu8d6iKME6wW+Q/6hhFIRQ==", 2023-08-31T19:24:35.906 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.907 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:24:35.907 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:24:35.907 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:24:35.907 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.908 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-08-31T19:24:35.908 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA54PBkURHJOhAA3HaPfENVQ4hLIjc/esF0bQ==", 2023-08-31T19:24:35.908 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.908 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:24:35.908 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:24:35.909 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:24:35.909 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.909 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-08-31T19:24:35.910 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA94PBkfoqTEBAAQHENgrp5tv1X47Br/dUksQ==", 2023-08-31T19:24:35.910 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.910 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:24:35.910 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:24:35.910 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:24:35.911 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.911 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-08-31T19:24:35.911 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkucWuOBAABLowlGxpCR3GgoOCRmC0FQ==", 2023-08-31T19:24:35.912 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.912 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:24:35.912 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow r", 2023-08-31T19:24:35.912 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-31T19:24:35.912 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.913 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-08-31T19:24:35.913 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkVGBPCxAAO4M9u24/yH0xwtV6oSz+JQ==", 2023-08-31T19:24:35.913 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.914 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:24:35.914 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:24:35.914 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:24:35.914 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:24:35.915 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.915 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.2", 2023-08-31T19:24:35.915 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkYeIoBBAAjoIzJJ9McIx3rLBSaorTKA==", 2023-08-31T19:24:35.915 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.916 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:24:35.916 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:24:35.916 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:24:35.917 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:24:35.917 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.917 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.3", 2023-08-31T19:24:35.918 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkX/V9EhAAqWuBMMhikN/JUQp3v5/ABQ==", 2023-08-31T19:24:35.918 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.918 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:24:35.918 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:24:35.919 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:24:35.919 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:24:35.919 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.920 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-08-31T19:24:35.920 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkCRlhDhAAxvcGr+KTvLoJmtuZC89Iuw==", 2023-08-31T19:24:35.920 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.920 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:24:35.920 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:24:35.920 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:24:35.921 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:24:35.921 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.921 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-08-31T19:24:35.922 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkiGBUBRAAwWTFqrz+ELBSwb0Z2T9yhQ==", 2023-08-31T19:24:35.922 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.922 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:24:35.922 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:24:35.922 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:24:35.923 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:35.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:35.923 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-08-31T19:24:35.923 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkSWszNRAAdBxrfMEuBRgePfaiPx6kpQ==", 2023-08-31T19:24:35.924 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:24:35.924 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:24:35.924 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:24:35.924 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:24:35.924 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.925 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:35.925 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-08-31T19:24:35.925 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:24:35.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.887+0000 7fa6fe1ff700 1 -- 172.21.15.72:0/2684487477 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa6e405ef60 msgr2=0x7fa6e4061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:35.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.887+0000 7fa6fe1ff700 1 --2- 172.21.15.72:0/2684487477 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa6e405ef60 0x7fa6e4061420 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa6e8001780 tx=0x7fa6e8009040).stop 2023-08-31T19:24:35.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.887+0000 7fa6fe1ff700 1 -- 172.21.15.72:0/2684487477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815ce50 msgr2=0x7fa6f814d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:35.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.887+0000 7fa6fe1ff700 1 --2- 172.21.15.72:0/2684487477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815ce50 0x7fa6f814d3f0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7fa6f8083570 tx=0x7fa6f0009780).stop 2023-08-31T19:24:35.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.887+0000 7fa6fe1ff700 1 -- 172.21.15.72:0/2684487477 shutdown_connections 2023-08-31T19:24:35.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.887+0000 7fa6fe1ff700 1 --2- 172.21.15.72:0/2684487477 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa6e405ef60 0x7fa6e4061420 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:35.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.887+0000 7fa6fe1ff700 1 --2- 172.21.15.72:0/2684487477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6f815ce50 0x7fa6f814d3f0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:35.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.887+0000 7fa6fe1ff700 1 --2- 172.21.15.72:0/2684487477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6f80cb940 0x7fa6f8147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:35.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.887+0000 7fa6fe1ff700 1 --2- 172.21.15.72:0/2684487477 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6f8154220 0x7fa6f8149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:35.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.887+0000 7fa6fe1ff700 1 -- 172.21.15.72:0/2684487477 >> 172.21.15.72:0/2684487477 conn(0x7fa6f805e870 msgr2=0x7fa6f8150950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:35.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.888+0000 7fa6fe1ff700 1 -- 172.21.15.72:0/2684487477 shutdown_connections 2023-08-31T19:24:35.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:35.888+0000 7fa6fe1ff700 1 -- 172.21.15.72:0/2684487477 wait complete. 2023-08-31T19:24:35.930 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:24:36.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.118+0000 7f7af2dff700 1 Processor -- start 2023-08-31T19:24:36.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.119+0000 7f7af2dff700 1 -- start start 2023-08-31T19:24:36.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.120+0000 7f7af2dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7aec0cb9b0 0x7f7aec1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.120+0000 7f7af2dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec0c6120 con 0x7f7aec1588d0 2023-08-31T19:24:36.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.120+0000 7f7af2dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec0c5e10 con 0x7f7aec154060 2023-08-31T19:24:36.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.120+0000 7f7af2dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aec0c1380 con 0x7f7aec0cb9b0 2023-08-31T19:24:36.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.120+0000 7f7aebfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7aec0cb9b0 0x7f7aec1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:36.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.120+0000 7f7af139c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7aec1588d0 0x7f7aec154440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53348/0 (socket says 172.21.15.72:53348) 2023-08-31T19:24:36.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.120+0000 7f7af139c700 1 -- 172.21.15.72:0/2329336015 learned_addr learned my addr 172.21.15.72:0/2329336015 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:36.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.120+0000 7f7aebfff700 1 -- 172.21.15.72:0/2329336015 >> v1:172.21.15.146:6789/0 conn(0x7f7aec154060 legacy=0x7f7aec157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.120+0000 7f7aebfff700 1 -- 172.21.15.72:0/2329336015 >> v1:172.21.15.72:6789/0 conn(0x7f7aec1588d0 legacy=0x7f7aec154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.120+0000 7f7aebfff700 1 -- 172.21.15.72:0/2329336015 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec0c0ae0 con 0x7f7aec0cb9b0 2023-08-31T19:24:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.120+0000 7f7aeb7fe700 1 -- 172.21.15.72:0/2329336015 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079422656 0 0) 0x7f7aec0c6120 con 0x7f7aec1588d0 2023-08-31T19:24:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.121+0000 7f7aebfff700 1 --2- 172.21.15.72:0/2329336015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec0cb9b0 0x7f7aec1583e0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f7ad8009760 tx=0x7f7ad8009060).ready entity=mon.0 client_cookie=d02d5c4b635ab65a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.121+0000 7f7aeb7fe700 1 -- 172.21.15.72:0/2329336015 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad800b580 con 0x7f7aec0cb9b0 2023-08-31T19:24:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.121+0000 7f7aeb7fe700 1 -- 172.21.15.72:0/2329336015 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad800b6e0 con 0x7f7aec0cb9b0 2023-08-31T19:24:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.121+0000 7f7aeb7fe700 1 -- 172.21.15.72:0/2329336015 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad800ba60 con 0x7f7aec0cb9b0 2023-08-31T19:24:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.121+0000 7f7af2dff700 1 -- 172.21.15.72:0/2329336015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec0cb9b0 msgr2=0x7f7aec1583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.121+0000 7f7af2dff700 1 --2- 172.21.15.72:0/2329336015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec0cb9b0 0x7f7aec1583e0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f7ad8009760 tx=0x7f7ad8009060).stop 2023-08-31T19:24:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.122+0000 7f7af2dff700 1 -- 172.21.15.72:0/2329336015 shutdown_connections 2023-08-31T19:24:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.122+0000 7f7af2dff700 1 --2- 172.21.15.72:0/2329336015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec0cb9b0 0x7f7aec1583e0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.122+0000 7f7af2dff700 1 -- 172.21.15.72:0/2329336015 >> 172.21.15.72:0/2329336015 conn(0x7f7aec05e870 msgr2=0x7f7aec0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.122+0000 7f7af2dff700 1 -- 172.21.15.72:0/2329336015 shutdown_connections 2023-08-31T19:24:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.122+0000 7f7af2dff700 1 -- 172.21.15.72:0/2329336015 wait complete. 2023-08-31T19:24:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.123+0000 7f7af2dff700 1 Processor -- start 2023-08-31T19:24:36.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.123+0000 7f7af2dff700 1 -- start start 2023-08-31T19:24:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.124+0000 7f7af2dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aec0cb9b0 0x7f7aec152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.124+0000 7f7af2dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec154060 0x7f7aec063f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.124+0000 7f7af2dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7aec1588d0 0x7f7aec064480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.124+0000 7f7af2dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec064970 con 0x7f7aec154060 2023-08-31T19:24:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.124+0000 7f7af2dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0ae930 con 0x7f7aec0cb9b0 2023-08-31T19:24:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.124+0000 7f7af2dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0add20 con 0x7f7aec1588d0 2023-08-31T19:24:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.124+0000 7f7aebfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec154060 0x7f7aec063f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.124+0000 7f7aebfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec154060 0x7f7aec063f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32842/0 (socket says 172.21.15.72:32842) 2023-08-31T19:24:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.124+0000 7f7aebfff700 1 -- 172.21.15.72:0/1295703815 learned_addr learned my addr 172.21.15.72:0/1295703815 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.125+0000 7f7aebfff700 1 -- 172.21.15.72:0/1295703815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7aec1588d0 msgr2=0x7f7aec064480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.125+0000 7f7aebfff700 1 --2- 172.21.15.72:0/1295703815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7aec1588d0 0x7f7aec064480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.125+0000 7f7af0b9b700 1 --2- 172.21.15.72:0/1295703815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aec0cb9b0 0x7f7aec152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.125+0000 7f7aebfff700 1 -- 172.21.15.72:0/1295703815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aec0cb9b0 msgr2=0x7f7aec152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.125+0000 7f7aebfff700 1 --2- 172.21.15.72:0/1295703815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aec0cb9b0 0x7f7aec152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.125+0000 7f7aebfff700 1 -- 172.21.15.72:0/1295703815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad80092a0 con 0x7f7aec154060 2023-08-31T19:24:36.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.125+0000 7f7af0b9b700 1 --2- 172.21.15.72:0/1295703815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aec0cb9b0 0x7f7aec152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:24:36.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.125+0000 7f7aebfff700 1 --2- 172.21.15.72:0/1295703815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec154060 0x7f7aec063f90 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f7ad8009eb0 tx=0x7f7ad8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:36.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.125+0000 7f7ae8ff9700 1 -- 172.21.15.72:0/1295703815 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad800ba60 con 0x7f7aec154060 2023-08-31T19:24:36.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.125+0000 7f7ae8ff9700 1 -- 172.21.15.72:0/1295703815 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad8000c90 con 0x7f7aec154060 2023-08-31T19:24:36.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.125+0000 7f7af2dff700 1 -- 172.21.15.72:0/1295703815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aec0ae000 con 0x7f7aec154060 2023-08-31T19:24:36.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.125+0000 7f7ae8ff9700 1 -- 172.21.15.72:0/1295703815 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad801b660 con 0x7f7aec154060 2023-08-31T19:24:36.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.125+0000 7f7af2dff700 1 -- 172.21.15.72:0/1295703815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aec0ae5c0 con 0x7f7aec154060 2023-08-31T19:24:36.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.127+0000 7f7af2dff700 1 -- 172.21.15.72:0/1295703815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aec0aeac0 con 0x7f7aec154060 2023-08-31T19:24:36.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.127+0000 7f7ae8ff9700 1 -- 172.21.15.72:0/1295703815 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7ad801ba50 con 0x7f7aec154060 2023-08-31T19:24:36.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.128+0000 7f7ae8ff9700 1 --2- 172.21.15.72:0/1295703815 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7ad005ef30 0x7f7ad00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.128+0000 7f7ae8ff9700 1 -- 172.21.15.72:0/1295703815 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5897+0+0 (secure 0 0 0) 0x7f7ad807bd20 con 0x7f7aec154060 2023-08-31T19:24:36.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.128+0000 7f7af0b9b700 1 --2- 172.21.15.72:0/1295703815 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7ad005ef30 0x7f7ad00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:36.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.129+0000 7f7af0b9b700 1 --2- 172.21.15.72:0/1295703815 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7ad005ef30 0x7f7ad00613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f7ae0007fd0 tx=0x7f7ae0009040).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:36.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.132+0000 7f7ae8ff9700 1 -- 172.21.15.72:0/1295703815 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ad804d030 con 0x7f7aec154060 2023-08-31T19:24:36.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.305+0000 7f7af2dff700 1 -- 172.21.15.72:0/1295703815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7aec06c6b0 con 0x7f7aec154060 2023-08-31T19:24:36.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.306+0000 7f7ae8ff9700 1 -- 172.21.15.72:0/1295703815 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+14771 (secure 0 0 0) 0x7f7ad8050650 con 0x7f7aec154060 2023-08-31T19:24:36.306 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:36.306 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":172,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:24:35.423176+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:24:36.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.308+0000 7f7af2dff700 1 -- 172.21.15.72:0/1295703815 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7ad005ef30 msgr2=0x7f7ad00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.308+0000 7f7af2dff700 1 --2- 172.21.15.72:0/1295703815 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7ad005ef30 0x7f7ad00613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f7ae0007fd0 tx=0x7f7ae0009040).stop 2023-08-31T19:24:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.308+0000 7f7af2dff700 1 -- 172.21.15.72:0/1295703815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec154060 msgr2=0x7f7aec063f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.308+0000 7f7af2dff700 1 --2- 172.21.15.72:0/1295703815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec154060 0x7f7aec063f90 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f7ad8009eb0 tx=0x7f7ad8017000).stop 2023-08-31T19:24:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.308+0000 7f7af2dff700 1 -- 172.21.15.72:0/1295703815 shutdown_connections 2023-08-31T19:24:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.308+0000 7f7af2dff700 1 --2- 172.21.15.72:0/1295703815 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7ad005ef30 0x7f7ad00613f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.308+0000 7f7af2dff700 1 --2- 172.21.15.72:0/1295703815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7aec1588d0 0x7f7aec064480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:36.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.308+0000 7f7af2dff700 1 --2- 172.21.15.72:0/1295703815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7aec0cb9b0 0x7f7aec152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.308+0000 7f7af2dff700 1 --2- 172.21.15.72:0/1295703815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec154060 0x7f7aec063f90 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.308+0000 7f7af2dff700 1 -- 172.21.15.72:0/1295703815 >> 172.21.15.72:0/1295703815 conn(0x7f7aec05e870 msgr2=0x7f7aec157c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:36.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.308+0000 7f7af2dff700 1 -- 172.21.15.72:0/1295703815 shutdown_connections 2023-08-31T19:24:36.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.308+0000 7f7af2dff700 1 -- 172.21.15.72:0/1295703815 wait complete. 2023-08-31T19:24:36.326 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-31T19:24:36.327 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:24:36.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.518+0000 7f04a0bff700 1 Processor -- start 2023-08-31T19:24:36.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.518+0000 7f04a0bff700 1 -- start start 2023-08-31T19:24:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.520+0000 7f04a0bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f049c154030 0x7f049c154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.520+0000 7f04a0bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f049c0c06b0 0x7f049c0c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.520+0000 7f04a0bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c0c6ed0 con 0x7f049c0aa140 2023-08-31T19:24:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.520+0000 7f04a0bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c0c66e0 con 0x7f049c0c06b0 2023-08-31T19:24:36.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.520+0000 7f04a0bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0c68c0 con 0x7f049c154030 2023-08-31T19:24:36.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.520+0000 7f0499d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f049c0c06b0 0x7f049c0c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:36.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.520+0000 7f049ad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f049c0aa140 0x7f049c063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53356/0 (socket says 172.21.15.72:53356) 2023-08-31T19:24:36.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.520+0000 7f049ad9d700 1 -- 172.21.15.72:0/2806818293 learned_addr learned my addr 172.21.15.72:0/2806818293 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:36.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.520+0000 7f049a59c700 1 --2- 172.21.15.72:0/2806818293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f049c154030 0x7f049c154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:36.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.520+0000 7f0499d9b700 1 -- 172.21.15.72:0/2806818293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f049c154030 msgr2=0x7f049c154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:36.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.520+0000 7f0499d9b700 1 --2- 172.21.15.72:0/2806818293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f049c154030 0x7f049c154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.520+0000 7f0499d9b700 1 -- 172.21.15.72:0/2806818293 >> v1:172.21.15.72:6789/0 conn(0x7f049c0aa140 legacy=0x7f049c063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.520+0000 7f0499d9b700 1 -- 172.21.15.72:0/2806818293 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c0c0f30 con 0x7f049c0c06b0 2023-08-31T19:24:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.520+0000 7f049959a700 1 -- 172.21.15.72:0/2806818293 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591452221 0 0) 0x7f049c0c6ed0 con 0x7f049c0aa140 2023-08-31T19:24:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.521+0000 7f0499d9b700 1 --2- 172.21.15.72:0/2806818293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f049c0c06b0 0x7f049c0c7360 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f0490009760 tx=0x7f0490009060).ready entity=mon.0 client_cookie=48b871e8679c37e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.521+0000 7f049959a700 1 -- 172.21.15.72:0/2806818293 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049000b580 con 0x7f049c0c06b0 2023-08-31T19:24:36.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.521+0000 7f049959a700 1 -- 172.21.15.72:0/2806818293 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049000b6e0 con 0x7f049c0c06b0 2023-08-31T19:24:36.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.521+0000 7f049959a700 1 -- 172.21.15.72:0/2806818293 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049000ba60 con 0x7f049c0c06b0 2023-08-31T19:24:36.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.521+0000 7f04a0bff700 1 -- 172.21.15.72:0/2806818293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f049c0c06b0 msgr2=0x7f049c0c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.521+0000 7f04a0bff700 1 --2- 172.21.15.72:0/2806818293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f049c0c06b0 0x7f049c0c7360 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f0490009760 tx=0x7f0490009060).stop 2023-08-31T19:24:36.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.521+0000 7f04a0bff700 1 -- 172.21.15.72:0/2806818293 shutdown_connections 2023-08-31T19:24:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.521+0000 7f04a0bff700 1 --2- 172.21.15.72:0/2806818293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f049c154030 0x7f049c154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.521+0000 7f04a0bff700 1 --2- 172.21.15.72:0/2806818293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f049c0c06b0 0x7f049c0c7360 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.521+0000 7f04a0bff700 1 -- 172.21.15.72:0/2806818293 >> 172.21.15.72:0/2806818293 conn(0x7f049c05eb60 msgr2=0x7f049c0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.521+0000 7f04a0bff700 1 -- 172.21.15.72:0/2806818293 shutdown_connections 2023-08-31T19:24:36.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.522+0000 7f04a0bff700 1 -- 172.21.15.72:0/2806818293 wait complete. 2023-08-31T19:24:36.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.523+0000 7f04a0bff700 1 Processor -- start 2023-08-31T19:24:36.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.523+0000 7f04a0bff700 1 -- start start 2023-08-31T19:24:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.524+0000 7f04a0bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f049c0aa140 0x7f049c14d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.524+0000 7f04a0bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f049c0c06b0 0x7f049c14f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.524+0000 7f04a0bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f049c154030 0x7f049c14f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.524+0000 7f04a0bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c14fc20 con 0x7f049c154030 2023-08-31T19:24:36.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.524+0000 7f04a0bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c1564f0 con 0x7f049c0aa140 2023-08-31T19:24:36.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.524+0000 7f04a0bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0c4640 con 0x7f049c0c06b0 2023-08-31T19:24:36.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.524+0000 7f049ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f049c154030 0x7f049c14f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:36.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.524+0000 7f049ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f049c154030 0x7f049c14f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32862/0 (socket says 172.21.15.72:32862) 2023-08-31T19:24:36.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.524+0000 7f049ad9d700 1 -- 172.21.15.72:0/2344077721 learned_addr learned my addr 172.21.15.72:0/2344077721 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:36.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.524+0000 7f049a59c700 1 --2- 172.21.15.72:0/2344077721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f049c0aa140 0x7f049c14d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:36.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.524+0000 7f0499d9b700 1 --2- 172.21.15.72:0/2344077721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f049c0c06b0 0x7f049c14f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:36.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.525+0000 7f049ad9d700 1 -- 172.21.15.72:0/2344077721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f049c0c06b0 msgr2=0x7f049c14f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.525+0000 7f049ad9d700 1 --2- 172.21.15.72:0/2344077721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f049c0c06b0 0x7f049c14f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.525+0000 7f049ad9d700 1 -- 172.21.15.72:0/2344077721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f049c0aa140 msgr2=0x7f049c14d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.525+0000 7f049ad9d700 1 --2- 172.21.15.72:0/2344077721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f049c0aa140 0x7f049c14d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.525+0000 7f049ad9d700 1 -- 172.21.15.72:0/2344077721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04900092a0 con 0x7f049c154030 2023-08-31T19:24:36.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.525+0000 7f049a59c700 1 --2- 172.21.15.72:0/2344077721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f049c0aa140 0x7f049c14d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:36.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.525+0000 7f049ad9d700 1 --2- 172.21.15.72:0/2344077721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f049c154030 0x7f049c14f730 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f049400c7e0 tx=0x7f0494007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:36.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.525+0000 7f048a7fc700 1 -- 172.21.15.72:0/2344077721 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494005d30 con 0x7f049c154030 2023-08-31T19:24:36.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.525+0000 7f048a7fc700 1 -- 172.21.15.72:0/2344077721 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0494005e90 con 0x7f049c154030 2023-08-31T19:24:36.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.525+0000 7f048a7fc700 1 -- 172.21.15.72:0/2344077721 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494007320 con 0x7f049c154030 2023-08-31T19:24:36.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.525+0000 7f04a0bff700 1 -- 172.21.15.72:0/2344077721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049c0c4920 con 0x7f049c154030 2023-08-31T19:24:36.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.525+0000 7f04a0bff700 1 -- 172.21.15.72:0/2344077721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049c156180 con 0x7f049c154030 2023-08-31T19:24:36.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.526+0000 7f04a0bff700 1 -- 172.21.15.72:0/2344077721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049c156660 con 0x7f049c154030 2023-08-31T19:24:36.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.527+0000 7f048a7fc700 1 -- 172.21.15.72:0/2344077721 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0494007710 con 0x7f049c154030 2023-08-31T19:24:36.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.528+0000 7f048a7fc700 1 --2- 172.21.15.72:0/2344077721 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f047c05ef30 0x7f047c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.528+0000 7f048a7fc700 1 -- 172.21.15.72:0/2344077721 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5897+0+0 (secure 0 0 0) 0x7f049407a080 con 0x7f049c154030 2023-08-31T19:24:36.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.528+0000 7f049a59c700 1 --2- 172.21.15.72:0/2344077721 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f047c05ef30 0x7f047c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:36.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.528+0000 7f049a59c700 1 --2- 172.21.15.72:0/2344077721 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f047c05ef30 0x7f047c0613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f048c006fd0 tx=0x7f048c008040).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:36.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.532+0000 7f048a7fc700 1 -- 172.21.15.72:0/2344077721 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f049404b390 con 0x7f049c154030 2023-08-31T19:24:36.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.702+0000 7f04a0bff700 1 -- 172.21.15.72:0/2344077721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f049c0c0c50 con 0x7f049c154030 2023-08-31T19:24:36.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.703+0000 7f048a7fc700 1 -- 172.21.15.72:0/2344077721 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v172) v1 ==== 110+0+10 (secure 0 0 0) 0x7f049404e9b0 con 0x7f049c154030 2023-08-31T19:24:36.704 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:24:36.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.705+0000 7f04a0bff700 1 -- 172.21.15.72:0/2344077721 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f047c05ef30 msgr2=0x7f047c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.705+0000 7f04a0bff700 1 --2- 172.21.15.72:0/2344077721 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f047c05ef30 0x7f047c0613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f048c006fd0 tx=0x7f048c008040).stop 2023-08-31T19:24:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.705+0000 7f04a0bff700 1 -- 172.21.15.72:0/2344077721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f049c154030 msgr2=0x7f049c14f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.705+0000 7f04a0bff700 1 --2- 172.21.15.72:0/2344077721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f049c154030 0x7f049c14f730 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f049400c7e0 tx=0x7f0494007f90).stop 2023-08-31T19:24:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.705+0000 7f04a0bff700 1 -- 172.21.15.72:0/2344077721 shutdown_connections 2023-08-31T19:24:36.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.705+0000 7f04a0bff700 1 --2- 172.21.15.72:0/2344077721 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f047c05ef30 0x7f047c0613f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.705+0000 7f04a0bff700 1 --2- 172.21.15.72:0/2344077721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f049c154030 0x7f049c14f730 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.705+0000 7f04a0bff700 1 --2- 172.21.15.72:0/2344077721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f049c0aa140 0x7f049c14d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.705+0000 7f04a0bff700 1 --2- 172.21.15.72:0/2344077721 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f049c0c06b0 0x7f049c14f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.705+0000 7f04a0bff700 1 -- 172.21.15.72:0/2344077721 >> 172.21.15.72:0/2344077721 conn(0x7f049c05eb60 msgr2=0x7f049c152a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:36.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.705+0000 7f04a0bff700 1 -- 172.21.15.72:0/2344077721 shutdown_connections 2023-08-31T19:24:36.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.705+0000 7f04a0bff700 1 -- 172.21.15.72:0/2344077721 wait complete. 2023-08-31T19:24:36.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:24:36.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.914+0000 7f01cf3ff700 1 Processor -- start 2023-08-31T19:24:36.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.914+0000 7f01cf3ff700 1 -- start start 2023-08-31T19:24:36.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.915+0000 7f01cf3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c8154030 0x7f01c8154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.915+0000 7f01cf3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01c80c06b0 0x7f01c80c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.915+0000 7f01cf3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c80c6ed0 con 0x7f01c80aa140 2023-08-31T19:24:36.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.915+0000 7f01cf3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c80c66e0 con 0x7f01c80c06b0 2023-08-31T19:24:36.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.915+0000 7f01cf3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c80c68c0 con 0x7f01c8154030 2023-08-31T19:24:36.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.916+0000 7f01cc99a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01c80c06b0 0x7f01c80c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:36.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.916+0000 7f01cd99c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f01c80aa140 0x7f01c8063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53362/0 (socket says 172.21.15.72:53362) 2023-08-31T19:24:36.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.916+0000 7f01cd99c700 1 -- 172.21.15.72:0/1143914360 learned_addr learned my addr 172.21.15.72:0/1143914360 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:36.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.916+0000 7f01cd19b700 1 --2- 172.21.15.72:0/1143914360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c8154030 0x7f01c8154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:36.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.916+0000 7f01cc99a700 1 -- 172.21.15.72:0/1143914360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c8154030 msgr2=0x7f01c8154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:36.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.916+0000 7f01cc99a700 1 --2- 172.21.15.72:0/1143914360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c8154030 0x7f01c8154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.916+0000 7f01cc99a700 1 -- 172.21.15.72:0/1143914360 >> v1:172.21.15.72:6789/0 conn(0x7f01c80aa140 legacy=0x7f01c8063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.916+0000 7f01cc99a700 1 -- 172.21.15.72:0/1143914360 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c80c0f30 con 0x7f01c80c06b0 2023-08-31T19:24:36.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.916+0000 7f01bffff700 1 -- 172.21.15.72:0/1143914360 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953203703 0 0) 0x7f01c80c6ed0 con 0x7f01c80aa140 2023-08-31T19:24:36.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.916+0000 7f01cc99a700 1 --2- 172.21.15.72:0/1143914360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c80c06b0 0x7f01c80c7360 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f01b8009760 tx=0x7f01b8009060).ready entity=mon.0 client_cookie=62b96a946b24384a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:36.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.916+0000 7f01bffff700 1 -- 172.21.15.72:0/1143914360 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b800b580 con 0x7f01c80c06b0 2023-08-31T19:24:36.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.916+0000 7f01bffff700 1 -- 172.21.15.72:0/1143914360 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b800b6e0 con 0x7f01c80c06b0 2023-08-31T19:24:36.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.916+0000 7f01bffff700 1 -- 172.21.15.72:0/1143914360 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b800ba60 con 0x7f01c80c06b0 2023-08-31T19:24:36.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.917+0000 7f01cf3ff700 1 -- 172.21.15.72:0/1143914360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c80c06b0 msgr2=0x7f01c80c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.917+0000 7f01cf3ff700 1 --2- 172.21.15.72:0/1143914360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c80c06b0 0x7f01c80c7360 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f01b8009760 tx=0x7f01b8009060).stop 2023-08-31T19:24:36.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.917+0000 7f01cf3ff700 1 -- 172.21.15.72:0/1143914360 shutdown_connections 2023-08-31T19:24:36.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.917+0000 7f01cf3ff700 1 --2- 172.21.15.72:0/1143914360 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c8154030 0x7f01c8154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.917+0000 7f01cf3ff700 1 --2- 172.21.15.72:0/1143914360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c80c06b0 0x7f01c80c7360 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:36.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.917+0000 7f01cf3ff700 1 -- 172.21.15.72:0/1143914360 >> 172.21.15.72:0/1143914360 conn(0x7f01c805eb60 msgr2=0x7f01c80cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:36.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.917+0000 7f01cf3ff700 1 -- 172.21.15.72:0/1143914360 shutdown_connections 2023-08-31T19:24:36.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.917+0000 7f01cf3ff700 1 -- 172.21.15.72:0/1143914360 wait complete. 2023-08-31T19:24:36.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.919+0000 7f01cf3ff700 1 Processor -- start 2023-08-31T19:24:36.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.919+0000 7f01cf3ff700 1 -- start start 2023-08-31T19:24:36.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.920+0000 7f01cf3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c80aa140 0x7f01c814d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.920+0000 7f01cf3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c80c06b0 0x7f01c814f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.920+0000 7f01cf3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c8154030 0x7f01c814f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.920+0000 7f01cf3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c814fc20 con 0x7f01c80c06b0 2023-08-31T19:24:36.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.920+0000 7f01cf3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c81564f0 con 0x7f01c80aa140 2023-08-31T19:24:36.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.920+0000 7f01cf3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c80c4640 con 0x7f01c8154030 2023-08-31T19:24:36.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.920+0000 7f01cc99a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c80c06b0 0x7f01c814f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:36.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.920+0000 7f01cc99a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c80c06b0 0x7f01c814f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32878/0 (socket says 172.21.15.72:32878) 2023-08-31T19:24:36.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.920+0000 7f01cc99a700 1 -- 172.21.15.72:0/2185479713 learned_addr learned my addr 172.21.15.72:0/2185479713 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:36.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.920+0000 7f01cc99a700 1 -- 172.21.15.72:0/2185479713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c8154030 msgr2=0x7f01c814f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.920+0000 7f01cc99a700 1 --2- 172.21.15.72:0/2185479713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c8154030 0x7f01c814f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:36.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.920+0000 7f01cc99a700 1 -- 172.21.15.72:0/2185479713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c80aa140 msgr2=0x7f01c814d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:36.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.920+0000 7f01cc99a700 1 --2- 172.21.15.72:0/2185479713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c80aa140 0x7f01c814d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:36.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.920+0000 7f01cc99a700 1 -- 172.21.15.72:0/2185479713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b80092a0 con 0x7f01c80c06b0 2023-08-31T19:24:36.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.920+0000 7f01cc99a700 1 --2- 172.21.15.72:0/2185479713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c80c06b0 0x7f01c814f240 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f01c80c8900 tx=0x7f01b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:36.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.921+0000 7f01bd7fa700 1 -- 172.21.15.72:0/2185479713 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b800b850 con 0x7f01c80c06b0 2023-08-31T19:24:36.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.921+0000 7f01bd7fa700 1 -- 172.21.15.72:0/2185479713 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b800b9b0 con 0x7f01c80c06b0 2023-08-31T19:24:36.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.921+0000 7f01cf3ff700 1 -- 172.21.15.72:0/2185479713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c80c4920 con 0x7f01c80c06b0 2023-08-31T19:24:36.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.921+0000 7f01bd7fa700 1 -- 172.21.15.72:0/2185479713 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b801b640 con 0x7f01c80c06b0 2023-08-31T19:24:36.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.921+0000 7f01cf3ff700 1 -- 172.21.15.72:0/2185479713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c8156180 con 0x7f01c80c06b0 2023-08-31T19:24:36.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.922+0000 7f01cf3ff700 1 -- 172.21.15.72:0/2185479713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c806c6b0 con 0x7f01c80c06b0 2023-08-31T19:24:36.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.922+0000 7f01bd7fa700 1 -- 172.21.15.72:0/2185479713 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f01b801b9f0 con 0x7f01c80c06b0 2023-08-31T19:24:36.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.923+0000 7f01bd7fa700 1 --2- 172.21.15.72:0/2185479713 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f01ac05ef30 0x7f01ac0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:36.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.923+0000 7f01bd7fa700 1 -- 172.21.15.72:0/2185479713 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5897+0+0 (secure 0 0 0) 0x7f01b807bcb0 con 0x7f01c80c06b0 2023-08-31T19:24:36.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.924+0000 7f01cd19b700 1 --2- 172.21.15.72:0/2185479713 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f01ac05ef30 0x7f01ac0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:36.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.924+0000 7f01cd19b700 1 --2- 172.21.15.72:0/2185479713 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f01ac05ef30 0x7f01ac0613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f01c400b850 tx=0x7f01c4008040).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:36.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:36.928+0000 7f01bd7fa700 1 -- 172.21.15.72:0/2185479713 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f01b804cfc0 con 0x7f01c80c06b0 2023-08-31T19:24:37.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.095+0000 7f01cf3ff700 1 -- 172.21.15.72:0/2185479713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f01c80c0c50 con 0x7f01c80c06b0 2023-08-31T19:24:37.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.096+0000 7f01bd7fa700 1 -- 172.21.15.72:0/2185479713 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v172) v1 ==== 92+0+10 (secure 0 0 0) 0x7f01b80505e0 con 0x7f01c80c06b0 2023-08-31T19:24:37.096 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:24:37.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.098+0000 7f01cf3ff700 1 -- 172.21.15.72:0/2185479713 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f01ac05ef30 msgr2=0x7f01ac0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:37.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.098+0000 7f01cf3ff700 1 --2- 172.21.15.72:0/2185479713 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f01ac05ef30 0x7f01ac0613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f01c400b850 tx=0x7f01c4008040).stop 2023-08-31T19:24:37.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.098+0000 7f01cf3ff700 1 -- 172.21.15.72:0/2185479713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c80c06b0 msgr2=0x7f01c814f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:37.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.098+0000 7f01cf3ff700 1 --2- 172.21.15.72:0/2185479713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c80c06b0 0x7f01c814f240 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f01c80c8900 tx=0x7f01b8017000).stop 2023-08-31T19:24:37.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.098+0000 7f01cf3ff700 1 -- 172.21.15.72:0/2185479713 shutdown_connections 2023-08-31T19:24:37.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.098+0000 7f01cf3ff700 1 --2- 172.21.15.72:0/2185479713 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f01ac05ef30 0x7f01ac0613f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.098+0000 7f01cf3ff700 1 --2- 172.21.15.72:0/2185479713 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01c8154030 0x7f01c814f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:37.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.098+0000 7f01cf3ff700 1 --2- 172.21.15.72:0/2185479713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01c80aa140 0x7f01c814d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:37.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.098+0000 7f01cf3ff700 1 --2- 172.21.15.72:0/2185479713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c80c06b0 0x7f01c814f240 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.098+0000 7f01cf3ff700 1 -- 172.21.15.72:0/2185479713 >> 172.21.15.72:0/2185479713 conn(0x7f01c805eb60 msgr2=0x7f01c8152a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:37.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.098+0000 7f01cf3ff700 1 -- 172.21.15.72:0/2185479713 shutdown_connections 2023-08-31T19:24:37.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.098+0000 7f01cf3ff700 1 -- 172.21.15.72:0/2185479713 wait complete. 2023-08-31T19:24:37.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T19:24:37.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.303+0000 7f94901ff700 1 Processor -- start 2023-08-31T19:24:37.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.304+0000 7f94901ff700 1 -- start start 2023-08-31T19:24:37.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.305+0000 7f94901ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f948815ce50 0x7f948815f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:37.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.305+0000 7f94901ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94880c6120 con 0x7f9488154060 2023-08-31T19:24:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.305+0000 7f94901ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94880c5e10 con 0x7f94880cb9b0 2023-08-31T19:24:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.305+0000 7f94901ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94880c1380 con 0x7f948815ce50 2023-08-31T19:24:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.305+0000 7f948df9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9488154060 0x7f9488157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53374/0 (socket says 172.21.15.72:53374) 2023-08-31T19:24:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.305+0000 7f948df9b700 1 -- 172.21.15.72:0/1557326463 learned_addr learned my addr 172.21.15.72:0/1557326463 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:37.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.305+0000 7f948e79c700 1 --2- 172.21.15.72:0/1557326463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f948815ce50 0x7f948815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:37.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191045457 0 0) 0x7f94880c6120 con 0x7f9488154060 2023-08-31T19:24:37.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94740033f0 con 0x7f9488154060 2023-08-31T19:24:37.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028445479 0 0) 0x7f94880c5e10 con 0x7f94880cb9b0 2023-08-31T19:24:37.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94880c6120 con 0x7f94880cb9b0 2023-08-31T19:24:37.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1926245472 0 0) 0x7f94740033f0 con 0x7f9488154060 2023-08-31T19:24:37.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f948815ce50 msgr2=0x7f948815f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:37.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 --2- 172.21.15.72:0/1557326463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f948815ce50 0x7f948815f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 >> v1:172.21.15.146:6789/0 conn(0x7f94880cb9b0 legacy=0x7f94881583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:37.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9488158af0 con 0x7f9488154060 2023-08-31T19:24:37.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f94840015f0 con 0x7f9488154060 2023-08-31T19:24:37.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 >> v1:172.21.15.72:6789/0 conn(0x7f9488154060 legacy=0x7f9488157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:37.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 --2- 172.21.15.72:0/1557326463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f948815ce50 0x7f9474003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:37.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 --2- 172.21.15.72:0/1557326463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9474003fb0 0x7f9474004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:37.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 --2- 172.21.15.72:0/1557326463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9474004b80 0x7f9474005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:37.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94880c1380 con 0x7f9474003fb0 2023-08-31T19:24:37.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947400b990 con 0x7f9474004b80 2023-08-31T19:24:37.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947400bb50 con 0x7f948815ce50 2023-08-31T19:24:37.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.306+0000 7f948d79a700 1 --2- 172.21.15.72:0/1557326463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9474003fb0 0x7f9474004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:37.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.307+0000 7f948e79c700 1 --2- 172.21.15.72:0/1557326463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9474004b80 0x7f9474005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:37.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.307+0000 7f948df9b700 1 --2- 172.21.15.72:0/1557326463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f948815ce50 0x7f9474003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:37.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.307+0000 7f948d79a700 1 -- 172.21.15.72:0/1557326463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f948815ce50 msgr2=0x7f9474003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:37.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.307+0000 7f948d79a700 1 --2- 172.21.15.72:0/1557326463 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f948815ce50 0x7f9474003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.307+0000 7f948d79a700 1 -- 172.21.15.72:0/1557326463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9474004b80 msgr2=0x7f9474005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:37.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.307+0000 7f948d79a700 1 --2- 172.21.15.72:0/1557326463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9474004b80 0x7f9474005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.307+0000 7f948d79a700 1 -- 172.21.15.72:0/1557326463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94740033f0 con 0x7f9474003fb0 2023-08-31T19:24:37.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.307+0000 7f948d79a700 1 --2- 172.21.15.72:0/1557326463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9474003fb0 0x7f9474004690 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7f94780018d0 tx=0x7f9478007bb0).ready entity=mon.0 client_cookie=d8dd25705a18d2f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:37.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.307+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478007020 con 0x7f9474003fb0 2023-08-31T19:24:37.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.307+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9478007180 con 0x7f9474003fb0 2023-08-31T19:24:37.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.307+0000 7f948cf99700 1 -- 172.21.15.72:0/1557326463 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478007500 con 0x7f9474003fb0 2023-08-31T19:24:37.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.308+0000 7f94901ff700 1 -- 172.21.15.72:0/1557326463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9474003fb0 msgr2=0x7f9474004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:37.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.308+0000 7f94901ff700 1 --2- 172.21.15.72:0/1557326463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9474003fb0 0x7f9474004690 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7f94780018d0 tx=0x7f9478007bb0).stop 2023-08-31T19:24:37.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.308+0000 7f948e79c700 1 -- 172.21.15.72:0/1557326463 reap_dead start 2023-08-31T19:24:37.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.308+0000 7f94901ff700 1 -- 172.21.15.72:0/1557326463 shutdown_connections 2023-08-31T19:24:37.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.308+0000 7f94901ff700 1 -- 172.21.15.72:0/1557326463 >> 172.21.15.72:0/1557326463 conn(0x7f948805e870 msgr2=0x7f94880cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:37.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.308+0000 7f94901ff700 1 -- 172.21.15.72:0/1557326463 shutdown_connections 2023-08-31T19:24:37.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.308+0000 7f94901ff700 1 -- 172.21.15.72:0/1557326463 wait complete. 2023-08-31T19:24:37.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.309+0000 7f94901ff700 1 Processor -- start 2023-08-31T19:24:37.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.310+0000 7f94901ff700 1 -- start start 2023-08-31T19:24:37.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.310+0000 7f94901ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9474003fb0 0x7f94881488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:37.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.310+0000 7f94901ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94880c64b0 0x7f948814b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:37.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f94901ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f948814bc40 0x7f94880c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:37.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f94901ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948814a380 con 0x7f9474003fb0 2023-08-31T19:24:37.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f94901ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948814a5f0 con 0x7f94880c64b0 2023-08-31T19:24:37.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f94901ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94880c8250 con 0x7f948814bc40 2023-08-31T19:24:37.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f948df9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9474003fb0 0x7f94881488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:37.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f948df9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9474003fb0 0x7f94881488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32894/0 (socket says 172.21.15.72:32894) 2023-08-31T19:24:37.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f948df9b700 1 -- 172.21.15.72:0/3229572018 learned_addr learned my addr 172.21.15.72:0/3229572018 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:37.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f948e79c700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f948814bc40 0x7f94880c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:37.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f948d79a700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94880c64b0 0x7f948814b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:37.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f948df9b700 1 -- 172.21.15.72:0/3229572018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f948814bc40 msgr2=0x7f94880c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:37.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f948df9b700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f948814bc40 0x7f94880c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f948df9b700 1 -- 172.21.15.72:0/3229572018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94880c64b0 msgr2=0x7f948814b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:37.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f948df9b700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94880c64b0 0x7f948814b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f948df9b700 1 -- 172.21.15.72:0/3229572018 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94880c8530 con 0x7f9474003fb0 2023-08-31T19:24:37.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f948e79c700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f948814bc40 0x7f94880c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:24:37.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f948d79a700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94880c64b0 0x7f948814b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:24:37.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.311+0000 7f948df9b700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9474003fb0 0x7f94881488c0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f948400f830 tx=0x7f9484009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:37.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.312+0000 7f947dffb700 1 -- 172.21.15.72:0/3229572018 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94840070d0 con 0x7f9474003fb0 2023-08-31T19:24:37.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.312+0000 7f947dffb700 1 -- 172.21.15.72:0/3229572018 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9484007230 con 0x7f9474003fb0 2023-08-31T19:24:37.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.312+0000 7f947dffb700 1 -- 172.21.15.72:0/3229572018 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484005880 con 0x7f9474003fb0 2023-08-31T19:24:37.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.312+0000 7f94901ff700 1 -- 172.21.15.72:0/3229572018 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948814b230 con 0x7f9474003fb0 2023-08-31T19:24:37.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.312+0000 7f94901ff700 1 -- 172.21.15.72:0/3229572018 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9488153b40 con 0x7f9474003fb0 2023-08-31T19:24:37.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.313+0000 7f94901ff700 1 -- 172.21.15.72:0/3229572018 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948814b420 con 0x7f9474003fb0 2023-08-31T19:24:37.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.313+0000 7f947dffb700 1 -- 172.21.15.72:0/3229572018 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f9484005cb0 con 0x7f9474003fb0 2023-08-31T19:24:37.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.314+0000 7f947dffb700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f946c05ef30 0x7f946c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:37.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.314+0000 7f947dffb700 1 -- 172.21.15.72:0/3229572018 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5897+0+0 (secure 0 0 0) 0x7f94840796e0 con 0x7f9474003fb0 2023-08-31T19:24:37.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.314+0000 7f948d79a700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f946c05ef30 0x7f946c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:37.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.315+0000 7f948d79a700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f946c05ef30 0x7f946c0613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f94880aa1e0 tx=0x7f9478016000).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:37.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.318+0000 7f947dffb700 1 -- 172.21.15.72:0/3229572018 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f94840498f0 con 0x7f9474003fb0 2023-08-31T19:24:37.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.489+0000 7f94901ff700 1 -- 172.21.15.72:0/3229572018 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f948806c6b0 con 0x7f9474003fb0 2023-08-31T19:24:37.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.489+0000 7f947dffb700 1 -- 172.21.15.72:0/3229572018 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v172) v1 ==== 84+0+143 (secure 0 0 0) 0x7f948404ab00 con 0x7f9474003fb0 2023-08-31T19:24:37.490 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:37.490 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:24:37.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:37.491 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-08-31T19:24:37.491 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "device_health_metrics" 2023-08-31T19:24:37.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:24:37.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:37.492 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-08-31T19:24:37.492 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-08-31T19:24:37.492 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:37.492 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:24:37.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.491+0000 7f94901ff700 1 -- 172.21.15.72:0/3229572018 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f946c05ef30 msgr2=0x7f946c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:37.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.491+0000 7f94901ff700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f946c05ef30 0x7f946c0613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f94880aa1e0 tx=0x7f9478016000).stop 2023-08-31T19:24:37.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.491+0000 7f94901ff700 1 -- 172.21.15.72:0/3229572018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9474003fb0 msgr2=0x7f94881488c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:37.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.491+0000 7f94901ff700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9474003fb0 0x7f94881488c0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7f948400f830 tx=0x7f9484009040).stop 2023-08-31T19:24:37.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.491+0000 7f94901ff700 1 -- 172.21.15.72:0/3229572018 shutdown_connections 2023-08-31T19:24:37.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.491+0000 7f94901ff700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f946c05ef30 0x7f946c0613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.491+0000 7f94901ff700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f948814bc40 0x7f94880c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.491+0000 7f94901ff700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9474003fb0 0x7f94881488c0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.491+0000 7f94901ff700 1 --2- 172.21.15.72:0/3229572018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f94880c64b0 0x7f948814b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.491+0000 7f94901ff700 1 -- 172.21.15.72:0/3229572018 >> 172.21.15.72:0/3229572018 conn(0x7f948805e870 msgr2=0x7f948814df30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:37.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.491+0000 7f94901ff700 1 -- 172.21.15.72:0/3229572018 shutdown_connections 2023-08-31T19:24:37.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.491+0000 7f94901ff700 1 -- 172.21.15.72:0/3229572018 wait complete. 2023-08-31T19:24:37.509 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T19:24:37.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-31T19:24:37.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.703+0000 7f20f7dff700 1 Processor -- start 2023-08-31T19:24:37.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.703+0000 7f20f7dff700 1 -- start start 2023-08-31T19:24:37.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.704+0000 7f20f7dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f20f0062650 0x7f20f0069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:37.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.704+0000 7f20f7dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20f0063c20 0x7f20f0157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:37.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.704+0000 7f20f7dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f00c2260 con 0x7f20f0068c20 2023-08-31T19:24:37.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.705+0000 7f20f7dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f0062b80 con 0x7f20f0063c20 2023-08-31T19:24:37.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.705+0000 7f20f7dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f0062e60 con 0x7f20f0062650 2023-08-31T19:24:37.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.705+0000 7f20f639c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20f0063c20 0x7f20f0157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:37.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.705+0000 7f20f639c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20f0063c20 0x7f20f0157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32896/0 (socket says 172.21.15.72:32896) 2023-08-31T19:24:37.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.705+0000 7f20f639c700 1 -- 172.21.15.72:0/615763562 learned_addr learned my addr 172.21.15.72:0/615763562 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:37.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.705+0000 7f20f539a700 1 --2- 172.21.15.72:0/615763562 >> v2:172.21.15.146:3300/0 conn(0x7f20f0062650 0x7f20f0069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.705+0000 7f20f639c700 1 -- 172.21.15.72:0/615763562 >> v2:172.21.15.146:3300/0 conn(0x7f20f0062650 msgr2=0x7f20f0069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.705+0000 7f20f639c700 1 --2- 172.21.15.72:0/615763562 >> v2:172.21.15.146:3300/0 conn(0x7f20f0062650 0x7f20f0069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.705+0000 7f20f639c700 1 -- 172.21.15.72:0/615763562 >> v1:172.21.15.146:6789/0 conn(0x7f20f0068c20 legacy=0x7f20f00c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.705+0000 7f20f639c700 1 -- 172.21.15.72:0/615763562 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f0063140 con 0x7f20f0063c20 2023-08-31T19:24:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.705+0000 7f20f639c700 1 --2- 172.21.15.72:0/615763562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f0063c20 0x7f20f0157000 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7f20f005e8f0 tx=0x7f20e8009840).ready entity=mon.0 client_cookie=3904bdd76884e494 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.706+0000 7f20f4b99700 1 -- 172.21.15.72:0/615763562 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e800e070 con 0x7f20f0063c20 2023-08-31T19:24:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.706+0000 7f20f4b99700 1 -- 172.21.15.72:0/615763562 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e800ba50 con 0x7f20f0063c20 2023-08-31T19:24:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.706+0000 7f20f4b99700 1 -- 172.21.15.72:0/615763562 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e800bdd0 con 0x7f20f0063c20 2023-08-31T19:24:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.706+0000 7f20f7dff700 1 -- 172.21.15.72:0/615763562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f0063c20 msgr2=0x7f20f0157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.706+0000 7f20f7dff700 1 --2- 172.21.15.72:0/615763562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f0063c20 0x7f20f0157000 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7f20f005e8f0 tx=0x7f20e8009840).stop 2023-08-31T19:24:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.706+0000 7f20f7dff700 1 -- 172.21.15.72:0/615763562 shutdown_connections 2023-08-31T19:24:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.706+0000 7f20f7dff700 1 --2- 172.21.15.72:0/615763562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f0063c20 0x7f20f0157000 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.706+0000 7f20f7dff700 1 --2- 172.21.15.72:0/615763562 >> v2:172.21.15.146:3300/0 conn(0x7f20f0062650 0x7f20f0069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.706+0000 7f20f7dff700 1 -- 172.21.15.72:0/615763562 >> 172.21.15.72:0/615763562 conn(0x7f20f00c72f0 msgr2=0x7f20f00c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.706+0000 7f20f7dff700 1 -- 172.21.15.72:0/615763562 shutdown_connections 2023-08-31T19:24:37.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.706+0000 7f20f7dff700 1 -- 172.21.15.72:0/615763562 wait complete. 2023-08-31T19:24:37.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.708+0000 7f20f7dff700 1 Processor -- start 2023-08-31T19:24:37.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.708+0000 7f20f7dff700 1 -- start start 2023-08-31T19:24:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.709+0000 7f20f7dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f0062650 0x7f20f00a7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.709+0000 7f20f7dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f0063c20 0x7f20f00baeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.709+0000 7f20f7dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f0068c20 0x7f20f00bb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.709+0000 7f20f7dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0158d10 con 0x7f20f0068c20 2023-08-31T19:24:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.709+0000 7f20f7dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0153c80 con 0x7f20f0063c20 2023-08-31T19:24:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.709+0000 7f20f7dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f0158100 con 0x7f20f0062650 2023-08-31T19:24:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.709+0000 7f20f639c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f0068c20 0x7f20f00bb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.709+0000 7f20f639c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f0068c20 0x7f20f00bb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32910/0 (socket says 172.21.15.72:32910) 2023-08-31T19:24:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.709+0000 7f20f639c700 1 -- 172.21.15.72:0/273459257 learned_addr learned my addr 172.21.15.72:0/273459257 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.709+0000 7f20f539a700 1 --2- 172.21.15.72:0/273459257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f0063c20 0x7f20f00baeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:37.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.709+0000 7f20f5b9b700 1 --2- 172.21.15.72:0/273459257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f0062650 0x7f20f00a7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:37.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.710+0000 7f20f639c700 1 -- 172.21.15.72:0/273459257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f0062650 msgr2=0x7f20f00a7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:37.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.710+0000 7f20f639c700 1 --2- 172.21.15.72:0/273459257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f0062650 0x7f20f00a7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.710+0000 7f20f639c700 1 -- 172.21.15.72:0/273459257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f0063c20 msgr2=0x7f20f00baeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:37.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.710+0000 7f20f639c700 1 --2- 172.21.15.72:0/273459257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f0063c20 0x7f20f00baeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:37.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.710+0000 7f20f639c700 1 -- 172.21.15.72:0/273459257 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e8009ae0 con 0x7f20f0068c20 2023-08-31T19:24:37.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.710+0000 7f20f539a700 1 --2- 172.21.15.72:0/273459257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f0063c20 0x7f20f00baeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:37.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.710+0000 7f20f639c700 1 --2- 172.21.15.72:0/273459257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f0068c20 0x7f20f00bb3a0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7f20e800bef0 tx=0x7f20e8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:37.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.710+0000 7f20e5ffb700 1 -- 172.21.15.72:0/273459257 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e80092e0 con 0x7f20f0068c20 2023-08-31T19:24:37.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.710+0000 7f20e5ffb700 1 -- 172.21.15.72:0/273459257 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e801d410 con 0x7f20f0068c20 2023-08-31T19:24:37.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.710+0000 7f20f7dff700 1 -- 172.21.15.72:0/273459257 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f01583e0 con 0x7f20f0068c20 2023-08-31T19:24:37.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.710+0000 7f20e5ffb700 1 -- 172.21.15.72:0/273459257 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e801d790 con 0x7f20f0068c20 2023-08-31T19:24:37.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.710+0000 7f20f7dff700 1 -- 172.21.15.72:0/273459257 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f01589a0 con 0x7f20f0068c20 2023-08-31T19:24:37.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.711+0000 7f20f7dff700 1 -- 172.21.15.72:0/273459257 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f0158ec0 con 0x7f20f0068c20 2023-08-31T19:24:37.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.712+0000 7f20e5ffb700 1 -- 172.21.15.72:0/273459257 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f20e801dbc0 con 0x7f20f0068c20 2023-08-31T19:24:37.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.713+0000 7f20e5ffb700 1 --2- 172.21.15.72:0/273459257 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f20d405ef30 0x7f20d40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:37.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.713+0000 7f20e5ffb700 1 -- 172.21.15.72:0/273459257 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5897+0+0 (secure 0 0 0) 0x7f20e807bcf0 con 0x7f20f0068c20 2023-08-31T19:24:37.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.713+0000 7f20f5b9b700 1 --2- 172.21.15.72:0/273459257 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f20d405ef30 0x7f20d40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:37.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.713+0000 7f20f5b9b700 1 --2- 172.21.15.72:0/273459257 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f20d405ef30 0x7f20d40613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f20ec003630 tx=0x7f20ec009040).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:37.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.717+0000 7f20e5ffb700 1 -- 172.21.15.72:0/273459257 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f20f0158ec0 con 0x7f20f0068c20 2023-08-31T19:24:37.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:37.887+0000 7f20f7dff700 1 -- 172.21.15.72:0/273459257 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f20f0158ec0 con 0x7f20f0068c20 2023-08-31T19:24:38.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.040+0000 7f20e5ffb700 1 -- 172.21.15.72:0/273459257 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v173) v1 ==== 152+0+0 (secure 0 0 0) 0x7f20f0158ec0 con 0x7f20f0068c20 2023-08-31T19:24:38.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.044+0000 7f20f7dff700 1 -- 172.21.15.72:0/273459257 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f20d405ef30 msgr2=0x7f20d40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:38.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.044+0000 7f20f7dff700 1 --2- 172.21.15.72:0/273459257 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f20d405ef30 0x7f20d40613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f20ec003630 tx=0x7f20ec009040).stop 2023-08-31T19:24:38.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.044+0000 7f20f7dff700 1 -- 172.21.15.72:0/273459257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f0068c20 msgr2=0x7f20f00bb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:38.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.044+0000 7f20f7dff700 1 --2- 172.21.15.72:0/273459257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f0068c20 0x7f20f00bb3a0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7f20e800bef0 tx=0x7f20e8009840).stop 2023-08-31T19:24:38.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.044+0000 7f20f7dff700 1 -- 172.21.15.72:0/273459257 shutdown_connections 2023-08-31T19:24:38.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.044+0000 7f20f7dff700 1 --2- 172.21.15.72:0/273459257 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f20d405ef30 0x7f20d40613f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:38.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.044+0000 7f20f7dff700 1 --2- 172.21.15.72:0/273459257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20f0068c20 0x7f20f00bb3a0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:38.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.044+0000 7f20f7dff700 1 --2- 172.21.15.72:0/273459257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20f0062650 0x7f20f00a7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:38.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.044+0000 7f20f7dff700 1 --2- 172.21.15.72:0/273459257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20f0063c20 0x7f20f00baeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:38.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.044+0000 7f20f7dff700 1 -- 172.21.15.72:0/273459257 >> 172.21.15.72:0/273459257 conn(0x7f20f00c72f0 msgr2=0x7f20f01554c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:38.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.045+0000 7f20f7dff700 1 -- 172.21.15.72:0/273459257 shutdown_connections 2023-08-31T19:24:38.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.046+0000 7f20f7dff700 1 -- 172.21.15.72:0/273459257 wait complete. 2023-08-31T19:24:38.049 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-08-31T19:24:38.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T19:24:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.261+0000 7fca7e3ff700 1 Processor -- start 2023-08-31T19:24:38.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.261+0000 7fca7e3ff700 1 -- start start 2023-08-31T19:24:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.262+0000 7fca7e3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca78154030 0x7fca78154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.262+0000 7fca7e3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca780c06b0 0x7fca780c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca7e3ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca780aa140 0x7fca78063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca7e3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca780c66e0 con 0x7fca78154030 2023-08-31T19:24:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca7e3ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca780c6ed0 con 0x7fca780aa140 2023-08-31T19:24:38.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca7e3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca780c68c0 con 0x7fca780c06b0 2023-08-31T19:24:38.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca77fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca78154030 0x7fca78154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:38.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca77fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca78154030 0x7fca78154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32912/0 (socket says 172.21.15.72:32912) 2023-08-31T19:24:38.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca77fff700 1 -- 172.21.15.72:0/2786178833 learned_addr learned my addr 172.21.15.72:0/2786178833 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:38.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca777fe700 1 --2- 172.21.15.72:0/2786178833 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca780c06b0 0x7fca780c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:38.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca77fff700 1 -- 172.21.15.72:0/2786178833 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca780c06b0 msgr2=0x7fca780c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:38.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca7c99c700 1 --2- 172.21.15.72:0/2786178833 >> v2:172.21.15.146:3300/0 conn(0x7fca780aa140 0x7fca78063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:38.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca77fff700 1 --2- 172.21.15.72:0/2786178833 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca780c06b0 0x7fca780c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:38.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca77fff700 1 -- 172.21.15.72:0/2786178833 >> v2:172.21.15.146:3300/0 conn(0x7fca780aa140 msgr2=0x7fca78063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:38.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca77fff700 1 --2- 172.21.15.72:0/2786178833 >> v2:172.21.15.146:3300/0 conn(0x7fca780aa140 0x7fca78063120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:38.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca77fff700 1 -- 172.21.15.72:0/2786178833 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca780c0f30 con 0x7fca78154030 2023-08-31T19:24:38.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca7c99c700 1 --2- 172.21.15.72:0/2786178833 >> v2:172.21.15.146:3300/0 conn(0x7fca780aa140 0x7fca78063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:24:38.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca777fe700 1 --2- 172.21.15.72:0/2786178833 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca780c06b0 0x7fca780c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:24:38.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.263+0000 7fca77fff700 1 --2- 172.21.15.72:0/2786178833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca78154030 0x7fca78154410 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7fca780c6e40 tx=0x7fca680090f0).ready entity=mon.0 client_cookie=5a2d6255ca71d1f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:38.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.264+0000 7fca76ffd700 1 -- 172.21.15.72:0/2786178833 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6800b600 con 0x7fca78154030 2023-08-31T19:24:38.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.264+0000 7fca76ffd700 1 -- 172.21.15.72:0/2786178833 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6800b760 con 0x7fca78154030 2023-08-31T19:24:38.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.264+0000 7fca76ffd700 1 -- 172.21.15.72:0/2786178833 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6800bae0 con 0x7fca78154030 2023-08-31T19:24:38.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.264+0000 7fca7e3ff700 1 -- 172.21.15.72:0/2786178833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca78154030 msgr2=0x7fca78154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:38.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.264+0000 7fca7e3ff700 1 --2- 172.21.15.72:0/2786178833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca78154030 0x7fca78154410 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7fca780c6e40 tx=0x7fca680090f0).stop 2023-08-31T19:24:38.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.264+0000 7fca7e3ff700 1 -- 172.21.15.72:0/2786178833 shutdown_connections 2023-08-31T19:24:38.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.264+0000 7fca7e3ff700 1 --2- 172.21.15.72:0/2786178833 >> v2:172.21.15.146:3300/0 conn(0x7fca780aa140 0x7fca78063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:38.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.264+0000 7fca7e3ff700 1 --2- 172.21.15.72:0/2786178833 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca78154030 0x7fca78154410 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:38.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.264+0000 7fca7e3ff700 1 --2- 172.21.15.72:0/2786178833 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca780c06b0 0x7fca780c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:38.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.264+0000 7fca7e3ff700 1 -- 172.21.15.72:0/2786178833 >> 172.21.15.72:0/2786178833 conn(0x7fca7805eb60 msgr2=0x7fca780cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:38.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.264+0000 7fca7e3ff700 1 -- 172.21.15.72:0/2786178833 shutdown_connections 2023-08-31T19:24:38.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.264+0000 7fca7e3ff700 1 -- 172.21.15.72:0/2786178833 wait complete. 2023-08-31T19:24:38.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.266+0000 7fca7e3ff700 1 Processor -- start 2023-08-31T19:24:38.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.266+0000 7fca7e3ff700 1 -- start start 2023-08-31T19:24:38.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.267+0000 7fca7e3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca780aa140 0x7fca780c2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:38.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.267+0000 7fca7e3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca780c06b0 0x7fca780aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:38.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.267+0000 7fca7e3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca78154030 0x7fca78144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:38.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.267+0000 7fca7e3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca780b0460 con 0x7fca78154030 2023-08-31T19:24:38.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.267+0000 7fca7e3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca78154eb0 con 0x7fca780c06b0 2023-08-31T19:24:38.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.267+0000 7fca7e3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca780c37d0 con 0x7fca780aa140 2023-08-31T19:24:38.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.267+0000 7fca7c99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca78154030 0x7fca78144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:38.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.267+0000 7fca7c99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca78154030 0x7fca78144910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32920/0 (socket says 172.21.15.72:32920) 2023-08-31T19:24:38.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.267+0000 7fca7c99c700 1 -- 172.21.15.72:0/828754863 learned_addr learned my addr 172.21.15.72:0/828754863 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:38.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.268+0000 7fca777fe700 1 --2- 172.21.15.72:0/828754863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca780c06b0 0x7fca780aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:38.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.268+0000 7fca77fff700 1 --2- 172.21.15.72:0/828754863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca780aa140 0x7fca780c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:38.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.268+0000 7fca7c99c700 1 -- 172.21.15.72:0/828754863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca780aa140 msgr2=0x7fca780c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:38.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.268+0000 7fca7c99c700 1 --2- 172.21.15.72:0/828754863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca780aa140 0x7fca780c2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:38.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.268+0000 7fca7c99c700 1 -- 172.21.15.72:0/828754863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca780c06b0 msgr2=0x7fca780aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:38.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.268+0000 7fca7c99c700 1 --2- 172.21.15.72:0/828754863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca780c06b0 0x7fca780aff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:38.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.268+0000 7fca7c99c700 1 -- 172.21.15.72:0/828754863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68009370 con 0x7fca78154030 2023-08-31T19:24:38.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.268+0000 7fca777fe700 1 --2- 172.21.15.72:0/828754863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca780c06b0 0x7fca780aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:38.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.268+0000 7fca7c99c700 1 --2- 172.21.15.72:0/828754863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca78154030 0x7fca78144910 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7fca7000a380 tx=0x7fca70007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:38.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.268+0000 7fca5ffff700 1 -- 172.21.15.72:0/828754863 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7000ae10 con 0x7fca78154030 2023-08-31T19:24:38.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.268+0000 7fca5ffff700 1 -- 172.21.15.72:0/828754863 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7000d650 con 0x7fca78154030 2023-08-31T19:24:38.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.268+0000 7fca7e3ff700 1 -- 172.21.15.72:0/828754863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca78155170 con 0x7fca78154030 2023-08-31T19:24:38.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.268+0000 7fca5ffff700 1 -- 172.21.15.72:0/828754863 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7000d9d0 con 0x7fca78154030 2023-08-31T19:24:38.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.268+0000 7fca7e3ff700 1 -- 172.21.15.72:0/828754863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca780c2f30 con 0x7fca78154030 2023-08-31T19:24:38.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.269+0000 7fca7e3ff700 1 -- 172.21.15.72:0/828754863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7806c6b0 con 0x7fca78154030 2023-08-31T19:24:38.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.270+0000 7fca5ffff700 1 -- 172.21.15.72:0/828754863 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fca70013070 con 0x7fca78154030 2023-08-31T19:24:38.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.271+0000 7fca5ffff700 1 --2- 172.21.15.72:0/828754863 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fca6405ef30 0x7fca640613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:38.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.271+0000 7fca5ffff700 1 -- 172.21.15.72:0/828754863 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6267+0+0 (secure 0 0 0) 0x7fca7007abb0 con 0x7fca78154030 2023-08-31T19:24:38.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.271+0000 7fca77fff700 1 --2- 172.21.15.72:0/828754863 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fca6405ef30 0x7fca640613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:38.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.272+0000 7fca77fff700 1 --2- 172.21.15.72:0/828754863 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fca6405ef30 0x7fca640613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fca68009130 tx=0x7fca68017000).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:38.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.276+0000 7fca5ffff700 1 -- 172.21.15.72:0/828754863 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fca7004bd50 con 0x7fca78154030 2023-08-31T19:24:38.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:38.446+0000 7fca7e3ff700 1 -- 172.21.15.72:0/828754863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fca780c3630 con 0x7fca78154030 2023-08-31T19:24:39.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.052+0000 7fca5ffff700 1 -- 172.21.15.72:0/828754863 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v174) v1 ==== 170+0+0 (secure 0 0 0) 0x7fca780c3630 con 0x7fca78154030 2023-08-31T19:24:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.056+0000 7fca7e3ff700 1 -- 172.21.15.72:0/828754863 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fca6405ef30 msgr2=0x7fca640613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.056+0000 7fca7e3ff700 1 --2- 172.21.15.72:0/828754863 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fca6405ef30 0x7fca640613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fca68009130 tx=0x7fca68017000).stop 2023-08-31T19:24:39.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.056+0000 7fca7e3ff700 1 -- 172.21.15.72:0/828754863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca78154030 msgr2=0x7fca78144910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:39.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.056+0000 7fca7e3ff700 1 --2- 172.21.15.72:0/828754863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca78154030 0x7fca78144910 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7fca7000a380 tx=0x7fca70007900).stop 2023-08-31T19:24:39.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.057+0000 7fca7e3ff700 1 -- 172.21.15.72:0/828754863 shutdown_connections 2023-08-31T19:24:39.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.057+0000 7fca7e3ff700 1 --2- 172.21.15.72:0/828754863 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fca6405ef30 0x7fca640613f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:39.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.057+0000 7fca7e3ff700 1 --2- 172.21.15.72:0/828754863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca78154030 0x7fca78144910 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:39.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.057+0000 7fca7e3ff700 1 --2- 172.21.15.72:0/828754863 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fca780aa140 0x7fca780c2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:39.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.057+0000 7fca7e3ff700 1 --2- 172.21.15.72:0/828754863 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca780c06b0 0x7fca780aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:39.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.057+0000 7fca7e3ff700 1 -- 172.21.15.72:0/828754863 >> 172.21.15.72:0/828754863 conn(0x7fca7805eb60 msgr2=0x7fca780acf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:39.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.064+0000 7fca7e3ff700 1 -- 172.21.15.72:0/828754863 shutdown_connections 2023-08-31T19:24:39.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.064+0000 7fca7e3ff700 1 -- 172.21.15.72:0/828754863 wait complete. 2023-08-31T19:24:39.073 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-08-31T19:24:39.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T19:24:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.285+0000 7f0b8e9ff700 1 Processor -- start 2023-08-31T19:24:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.285+0000 7f0b8e9ff700 1 -- start start 2023-08-31T19:24:39.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.286+0000 7f0b8e9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b88063830 0x7f0b880c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:39.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.287+0000 7f0b8e9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b880c6ed0 con 0x7f0b88154410 2023-08-31T19:24:39.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.287+0000 7f0b8e9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b880c68c0 con 0x7f0b88154030 2023-08-31T19:24:39.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.287+0000 7f0b8e9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b880c66e0 con 0x7f0b88063830 2023-08-31T19:24:39.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.287+0000 7f0b8cf9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b88063830 0x7f0b880c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:39.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.287+0000 7f0b877fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0b88154410 0x7f0b88063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53388/0 (socket says 172.21.15.72:53388) 2023-08-31T19:24:39.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.287+0000 7f0b877fe700 1 -- 172.21.15.72:0/3341900224 learned_addr learned my addr 172.21.15.72:0/3341900224 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:39.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.287+0000 7f0b86ffd700 1 -- 172.21.15.72:0/3341900224 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037348536 0 0) 0x7f0b880c6ed0 con 0x7f0b88154410 2023-08-31T19:24:39.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.287+0000 7f0b8cf9c700 1 -- 172.21.15.72:0/3341900224 >> v1:172.21.15.146:6789/0 conn(0x7f0b88154030 legacy=0x7f0b880aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:39.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.287+0000 7f0b8cf9c700 1 -- 172.21.15.72:0/3341900224 >> v1:172.21.15.72:6789/0 conn(0x7f0b88154410 legacy=0x7f0b88063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:39.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.287+0000 7f0b8cf9c700 1 -- 172.21.15.72:0/3341900224 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b880c0f30 con 0x7f0b88063830 2023-08-31T19:24:39.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.287+0000 7f0b8cf9c700 1 --2- 172.21.15.72:0/3341900224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b88063830 0x7f0b880c06b0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f0b80009e60 tx=0x7f0b80009780).ready entity=mon.0 client_cookie=35947431745fa511 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:39.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.288+0000 7f0b86ffd700 1 -- 172.21.15.72:0/3341900224 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8000e070 con 0x7f0b88063830 2023-08-31T19:24:39.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.288+0000 7f0b86ffd700 1 -- 172.21.15.72:0/3341900224 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8000bc30 con 0x7f0b88063830 2023-08-31T19:24:39.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.288+0000 7f0b86ffd700 1 -- 172.21.15.72:0/3341900224 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80012410 con 0x7f0b88063830 2023-08-31T19:24:39.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.288+0000 7f0b8e9ff700 1 -- 172.21.15.72:0/3341900224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b88063830 msgr2=0x7f0b880c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:39.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.288+0000 7f0b8e9ff700 1 --2- 172.21.15.72:0/3341900224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b88063830 0x7f0b880c06b0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f0b80009e60 tx=0x7f0b80009780).stop 2023-08-31T19:24:39.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.288+0000 7f0b8e9ff700 1 -- 172.21.15.72:0/3341900224 shutdown_connections 2023-08-31T19:24:39.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.288+0000 7f0b8e9ff700 1 --2- 172.21.15.72:0/3341900224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b88063830 0x7f0b880c06b0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:39.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.288+0000 7f0b8e9ff700 1 -- 172.21.15.72:0/3341900224 >> 172.21.15.72:0/3341900224 conn(0x7f0b8805eb60 msgr2=0x7f0b880cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:39.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.288+0000 7f0b8e9ff700 1 -- 172.21.15.72:0/3341900224 shutdown_connections 2023-08-31T19:24:39.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.288+0000 7f0b8e9ff700 1 -- 172.21.15.72:0/3341900224 wait complete. 2023-08-31T19:24:39.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.290+0000 7f0b8e9ff700 1 Processor -- start 2023-08-31T19:24:39.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.290+0000 7f0b8e9ff700 1 -- start start 2023-08-31T19:24:39.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.291+0000 7f0b8e9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b88063830 0x7f0b8814e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:39.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.291+0000 7f0b8e9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b88154030 0x7f0b88141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.291+0000 7f0b8e9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b88154410 0x7f0b88167da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.291+0000 7f0b8e9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880c4cc0 con 0x7f0b88154410 2023-08-31T19:24:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.291+0000 7f0b8e9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b88167910 con 0x7f0b88063830 2023-08-31T19:24:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.291+0000 7f0b8e9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b880c4420 con 0x7f0b88154030 2023-08-31T19:24:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.291+0000 7f0b8cf9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b88154410 0x7f0b88167da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.291+0000 7f0b8cf9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b88154410 0x7f0b88167da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32934/0 (socket says 172.21.15.72:32934) 2023-08-31T19:24:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.291+0000 7f0b8cf9c700 1 -- 172.21.15.72:0/498984471 learned_addr learned my addr 172.21.15.72:0/498984471 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.292+0000 7f0b8cf9c700 1 -- 172.21.15.72:0/498984471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b88154030 msgr2=0x7f0b88141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.292+0000 7f0b8cf9c700 1 --2- 172.21.15.72:0/498984471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b88154030 0x7f0b88141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.292+0000 7f0b8cf9c700 1 -- 172.21.15.72:0/498984471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b88063830 msgr2=0x7f0b8814e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:39.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.292+0000 7f0b8cf9c700 1 --2- 172.21.15.72:0/498984471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b88063830 0x7f0b8814e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:39.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.292+0000 7f0b8cf9c700 1 -- 172.21.15.72:0/498984471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b80009a20 con 0x7f0b88154410 2023-08-31T19:24:39.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.292+0000 7f0b8cf9c700 1 --2- 172.21.15.72:0/498984471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b88154410 0x7f0b88167da0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f0b880c8900 tx=0x7f0b880c6a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:39.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.292+0000 7f0b6ffff700 1 -- 172.21.15.72:0/498984471 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b800117d0 con 0x7f0b88154410 2023-08-31T19:24:39.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.292+0000 7f0b6ffff700 1 -- 172.21.15.72:0/498984471 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b80011930 con 0x7f0b88154410 2023-08-31T19:24:39.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.292+0000 7f0b6ffff700 1 -- 172.21.15.72:0/498984471 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80011cd0 con 0x7f0b88154410 2023-08-31T19:24:39.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.292+0000 7f0b8e9ff700 1 -- 172.21.15.72:0/498984471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b880c4700 con 0x7f0b88154410 2023-08-31T19:24:39.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.292+0000 7f0b8e9ff700 1 -- 172.21.15.72:0/498984471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8814ee20 con 0x7f0b88154410 2023-08-31T19:24:39.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.293+0000 7f0b8e9ff700 1 -- 172.21.15.72:0/498984471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b881676e0 con 0x7f0b88154410 2023-08-31T19:24:39.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.294+0000 7f0b6ffff700 1 -- 172.21.15.72:0/498984471 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f0b8001d630 con 0x7f0b88154410 2023-08-31T19:24:39.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.295+0000 7f0b6ffff700 1 --2- 172.21.15.72:0/498984471 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0b7405ef30 0x7f0b740613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:39.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.295+0000 7f0b6ffff700 1 -- 172.21.15.72:0/498984471 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6649+0+0 (secure 0 0 0) 0x7f0b8007cdd0 con 0x7f0b88154410 2023-08-31T19:24:39.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.295+0000 7f0b87fff700 1 --2- 172.21.15.72:0/498984471 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0b7405ef30 0x7f0b740613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:39.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.296+0000 7f0b87fff700 1 --2- 172.21.15.72:0/498984471 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0b7405ef30 0x7f0b740613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0b78001510 tx=0x7f0b780079c0).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:39.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.299+0000 7f0b6ffff700 1 -- 172.21.15.72:0/498984471 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b8004ddf0 con 0x7f0b88154410 2023-08-31T19:24:39.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.507+0000 7f0b8e9ff700 1 -- 172.21.15.72:0/498984471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0b881676e0 con 0x7f0b88154410 2023-08-31T19:24:39.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.514+0000 7f0b6ffff700 1 -- 172.21.15.72:0/498984471 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v75) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0b881676e0 con 0x7f0b88154410 2023-08-31T19:24:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.519+0000 7f0b8e9ff700 1 -- 172.21.15.72:0/498984471 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0b7405ef30 msgr2=0x7f0b740613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.519+0000 7f0b8e9ff700 1 --2- 172.21.15.72:0/498984471 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0b7405ef30 0x7f0b740613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0b78001510 tx=0x7f0b780079c0).stop 2023-08-31T19:24:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.519+0000 7f0b8e9ff700 1 -- 172.21.15.72:0/498984471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b88154410 msgr2=0x7f0b88167da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.519+0000 7f0b8e9ff700 1 --2- 172.21.15.72:0/498984471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b88154410 0x7f0b88167da0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f0b880c8900 tx=0x7f0b880c6a50).stop 2023-08-31T19:24:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.519+0000 7f0b8e9ff700 1 -- 172.21.15.72:0/498984471 shutdown_connections 2023-08-31T19:24:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.519+0000 7f0b8e9ff700 1 --2- 172.21.15.72:0/498984471 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0b7405ef30 0x7f0b740613f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.519+0000 7f0b8e9ff700 1 --2- 172.21.15.72:0/498984471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b88154410 0x7f0b88167da0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.519+0000 7f0b8e9ff700 1 --2- 172.21.15.72:0/498984471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b88063830 0x7f0b8814e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.519+0000 7f0b8e9ff700 1 --2- 172.21.15.72:0/498984471 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0b88154030 0x7f0b88141fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.519+0000 7f0b8e9ff700 1 -- 172.21.15.72:0/498984471 >> 172.21.15.72:0/498984471 conn(0x7f0b8805eb60 msgr2=0x7f0b880ad410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.520+0000 7f0b8e9ff700 1 -- 172.21.15.72:0/498984471 shutdown_connections 2023-08-31T19:24:39.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.523+0000 7f0b8e9ff700 1 -- 172.21.15.72:0/498984471 wait complete. 2023-08-31T19:24:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 21 and data pool 22 2023-08-31T19:24:39.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:24:39.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.743+0000 7f20a63ff700 1 Processor -- start 2023-08-31T19:24:39.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.743+0000 7f20a63ff700 1 -- start start 2023-08-31T19:24:39.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.745+0000 7f20a63ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20a0154220 0x7f20a0157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:39.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.745+0000 7f20a63ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20a00cb940 0x7f20a01581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:39.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.745+0000 7f20a63ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a0158b40 con 0x7f20a01586b0 2023-08-31T19:24:39.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.745+0000 7f20a63ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a00aa700 con 0x7f20a0154220 2023-08-31T19:24:39.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.745+0000 7f20a63ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00c5e10 con 0x7f20a00cb940 2023-08-31T19:24:39.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.745+0000 7f209ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20a0154220 0x7f20a0157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:39.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.745+0000 7f20a499c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f20a01586b0 0x7f20a0154600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53400/0 (socket says 172.21.15.72:53400) 2023-08-31T19:24:39.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.745+0000 7f20a499c700 1 -- 172.21.15.72:0/2121101954 learned_addr learned my addr 172.21.15.72:0/2121101954 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:39.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.745+0000 7f209f7fe700 1 --2- 172.21.15.72:0/2121101954 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20a00cb940 0x7f20a01581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:39.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.746+0000 7f209ffff700 1 -- 172.21.15.72:0/2121101954 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20a00cb940 msgr2=0x7f20a01581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:39.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.746+0000 7f209ffff700 1 --2- 172.21.15.72:0/2121101954 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20a00cb940 0x7f20a01581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:39.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.746+0000 7f209ffff700 1 -- 172.21.15.72:0/2121101954 >> v1:172.21.15.72:6789/0 conn(0x7f20a01586b0 legacy=0x7f20a0154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:39.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.746+0000 7f209ffff700 1 -- 172.21.15.72:0/2121101954 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a00c8c90 con 0x7f20a0154220 2023-08-31T19:24:39.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.746+0000 7f209effd700 1 -- 172.21.15.72:0/2121101954 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598163363 0 0) 0x7f2098001490 con 0x7f20a01586b0 2023-08-31T19:24:39.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.746+0000 7f209ffff700 1 --2- 172.21.15.72:0/2121101954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a0154220 0x7f20a0157cd0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f2090009760 tx=0x7f2090006f40).ready entity=mon.0 client_cookie=816dd20f9c3ef749 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:39.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.746+0000 7f209effd700 1 -- 172.21.15.72:0/2121101954 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2090005880 con 0x7f20a0154220 2023-08-31T19:24:39.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.746+0000 7f209effd700 1 -- 172.21.15.72:0/2121101954 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20900059e0 con 0x7f20a0154220 2023-08-31T19:24:39.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.746+0000 7f209effd700 1 -- 172.21.15.72:0/2121101954 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2090005d60 con 0x7f20a0154220 2023-08-31T19:24:39.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.747+0000 7f20a63ff700 1 -- 172.21.15.72:0/2121101954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a0154220 msgr2=0x7f20a0157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:39.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.747+0000 7f20a63ff700 1 --2- 172.21.15.72:0/2121101954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a0154220 0x7f20a0157cd0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f2090009760 tx=0x7f2090006f40).stop 2023-08-31T19:24:39.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.747+0000 7f20a63ff700 1 -- 172.21.15.72:0/2121101954 shutdown_connections 2023-08-31T19:24:39.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.747+0000 7f20a63ff700 1 --2- 172.21.15.72:0/2121101954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a0154220 0x7f20a0157cd0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:39.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.747+0000 7f20a63ff700 1 --2- 172.21.15.72:0/2121101954 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20a00cb940 0x7f20a01581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:39.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.747+0000 7f20a63ff700 1 -- 172.21.15.72:0/2121101954 >> 172.21.15.72:0/2121101954 conn(0x7f20a005e870 msgr2=0x7f20a00cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.747+0000 7f20a63ff700 1 -- 172.21.15.72:0/2121101954 shutdown_connections 2023-08-31T19:24:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.747+0000 7f20a63ff700 1 -- 172.21.15.72:0/2121101954 wait complete. 2023-08-31T19:24:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.748+0000 7f20a63ff700 1 Processor -- start 2023-08-31T19:24:39.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.748+0000 7f20a63ff700 1 -- start start 2023-08-31T19:24:39.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.749+0000 7f20a63ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a00cb940 0x7f20a00af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:39.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.749+0000 7f20a63ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20a0154220 0x7f20a00addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:39.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.749+0000 7f20a63ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20a01586b0 0x7f20a0159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:39.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.749+0000 7f20a63ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00af2f0 con 0x7f20a00cb940 2023-08-31T19:24:39.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.749+0000 7f20a63ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00ae6e0 con 0x7f20a0154220 2023-08-31T19:24:39.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.749+0000 7f20a63ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00ae9c0 con 0x7f20a01586b0 2023-08-31T19:24:39.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.749+0000 7f209ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a00cb940 0x7f20a00af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:39.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.749+0000 7f209ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a00cb940 0x7f20a00af780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32960/0 (socket says 172.21.15.72:32960) 2023-08-31T19:24:39.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.749+0000 7f209ffff700 1 -- 172.21.15.72:0/2814546785 learned_addr learned my addr 172.21.15.72:0/2814546785 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:39.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.750+0000 7f209ffff700 1 -- 172.21.15.72:0/2814546785 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20a01586b0 msgr2=0x7f20a0159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:39.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.750+0000 7f209ffff700 1 --2- 172.21.15.72:0/2814546785 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20a01586b0 0x7f20a0159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:39.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.750+0000 7f209ffff700 1 -- 172.21.15.72:0/2814546785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20a0154220 msgr2=0x7f20a00addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:39.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.750+0000 7f209ffff700 1 --2- 172.21.15.72:0/2814546785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20a0154220 0x7f20a00addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:39.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.750+0000 7f209ffff700 1 -- 172.21.15.72:0/2814546785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2090009250 con 0x7f20a00cb940 2023-08-31T19:24:39.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.750+0000 7f209ffff700 1 --2- 172.21.15.72:0/2814546785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a00cb940 0x7f20a00af780 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7f20a0083570 tx=0x7f2090016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:39.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.750+0000 7f2087fff700 1 -- 172.21.15.72:0/2814546785 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209000f7f0 con 0x7f20a00cb940 2023-08-31T19:24:39.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.750+0000 7f2087fff700 1 -- 172.21.15.72:0/2814546785 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209000f950 con 0x7f20a00cb940 2023-08-31T19:24:39.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.750+0000 7f20a63ff700 1 -- 172.21.15.72:0/2814546785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a00aeca0 con 0x7f20a00cb940 2023-08-31T19:24:39.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.750+0000 7f2087fff700 1 -- 172.21.15.72:0/2814546785 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209000fd10 con 0x7f20a00cb940 2023-08-31T19:24:39.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.750+0000 7f20a63ff700 1 -- 172.21.15.72:0/2814546785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a00afc70 con 0x7f20a00cb940 2023-08-31T19:24:39.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.752+0000 7f20a63ff700 1 -- 172.21.15.72:0/2814546785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a00af5d0 con 0x7f20a00cb940 2023-08-31T19:24:39.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.752+0000 7f2087fff700 1 -- 172.21.15.72:0/2814546785 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2090011650 con 0x7f20a00cb940 2023-08-31T19:24:39.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.753+0000 7f2087fff700 1 --2- 172.21.15.72:0/2814546785 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f208c05ef30 0x7f208c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:39.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.753+0000 7f2087fff700 1 -- 172.21.15.72:0/2814546785 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f209007ae20 con 0x7f20a00cb940 2023-08-31T19:24:39.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.754+0000 7f209f7fe700 1 --2- 172.21.15.72:0/2814546785 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f208c05ef30 0x7f208c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:39.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.754+0000 7f209f7fe700 1 --2- 172.21.15.72:0/2814546785 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f208c05ef30 0x7f208c0613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f20a00cb550 tx=0x7f2094009060).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:39.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.758+0000 7f2087fff700 1 -- 172.21.15.72:0/2814546785 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f209004bea0 con 0x7f20a00cb940 2023-08-31T19:24:39.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.928+0000 7f20a63ff700 1 -- 172.21.15.72:0/2814546785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20a006c6b0 con 0x7f20a00cb940 2023-08-31T19:24:39.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.929+0000 7f2087fff700 1 -- 172.21.15.72:0/2814546785 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+18004 (secure 0 0 0) 0x7f2090021070 con 0x7f20a00cb940 2023-08-31T19:24:39.929 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:39.930 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":175,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:24:39.509165+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:24:37.934358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-31T19:24:38.492537+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:24:39.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.931+0000 7f20a63ff700 1 -- 172.21.15.72:0/2814546785 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f208c05ef30 msgr2=0x7f208c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.931+0000 7f20a63ff700 1 --2- 172.21.15.72:0/2814546785 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f208c05ef30 0x7f208c0613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f20a00cb550 tx=0x7f2094009060).stop 2023-08-31T19:24:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.931+0000 7f20a63ff700 1 -- 172.21.15.72:0/2814546785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a00cb940 msgr2=0x7f20a00af780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.931+0000 7f20a63ff700 1 --2- 172.21.15.72:0/2814546785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a00cb940 0x7f20a00af780 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7f20a0083570 tx=0x7f2090016000).stop 2023-08-31T19:24:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.931+0000 7f20a63ff700 1 -- 172.21.15.72:0/2814546785 shutdown_connections 2023-08-31T19:24:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.931+0000 7f20a63ff700 1 --2- 172.21.15.72:0/2814546785 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f208c05ef30 0x7f208c0613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.931+0000 7f20a63ff700 1 --2- 172.21.15.72:0/2814546785 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f20a01586b0 0x7f20a0159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.931+0000 7f20a63ff700 1 --2- 172.21.15.72:0/2814546785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a00cb940 0x7f20a00af780 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.931+0000 7f20a63ff700 1 --2- 172.21.15.72:0/2814546785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20a0154220 0x7f20a00addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.931+0000 7f20a63ff700 1 -- 172.21.15.72:0/2814546785 >> 172.21.15.72:0/2814546785 conn(0x7f20a005e870 msgr2=0x7f20a0064940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.931+0000 7f20a63ff700 1 -- 172.21.15.72:0/2814546785 shutdown_connections 2023-08-31T19:24:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:39.931+0000 7f20a63ff700 1 -- 172.21.15.72:0/2814546785 wait complete. 2023-08-31T19:24:39.949 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:24:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.139+0000 7fe0615ff700 1 Processor -- start 2023-08-31T19:24:40.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.140+0000 7fe0615ff700 1 -- start start 2023-08-31T19:24:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.141+0000 7fe0615ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe05c0cb9b0 0x7fe05c1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.141+0000 7fe0615ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe05c1588d0 0x7fe05c154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:40.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.141+0000 7fe0615ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05c0c6120 con 0x7fe05c154060 2023-08-31T19:24:40.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.141+0000 7fe0615ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05c0c1380 con 0x7fe05c1588d0 2023-08-31T19:24:40.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.141+0000 7fe0615ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0c5e10 con 0x7fe05c0cb9b0 2023-08-31T19:24:40.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.141+0000 7fe05affd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe05c154060 0x7fe05c157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53412/0 (socket says 172.21.15.72:53412) 2023-08-31T19:24:40.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.141+0000 7fe05affd700 1 -- 172.21.15.72:0/125468287 learned_addr learned my addr 172.21.15.72:0/125468287 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.141+0000 7fe05b7fe700 1 --2- 172.21.15.72:0/125468287 >> v2:172.21.15.72:3300/0 conn(0x7fe05c1588d0 0x7fe05c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.141+0000 7fe05a7fc700 1 --2- 172.21.15.72:0/125468287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe05c0cb9b0 0x7fe05c1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.142+0000 7fe059ffb700 1 -- 172.21.15.72:0/125468287 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993180559 0 0) 0x7fe05c0c6120 con 0x7fe05c154060 2023-08-31T19:24:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.142+0000 7fe059ffb700 1 -- 172.21.15.72:0/125468287 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0440033f0 con 0x7fe05c154060 2023-08-31T19:24:40.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.142+0000 7fe05b7fe700 1 -- 172.21.15.72:0/125468287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe05c0cb9b0 msgr2=0x7fe05c1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:40.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.142+0000 7fe05b7fe700 1 --2- 172.21.15.72:0/125468287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe05c0cb9b0 0x7fe05c1583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:40.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.142+0000 7fe05b7fe700 1 -- 172.21.15.72:0/125468287 >> v1:172.21.15.72:6789/0 conn(0x7fe05c154060 legacy=0x7fe05c157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:40.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.142+0000 7fe05b7fe700 1 -- 172.21.15.72:0/125468287 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c0c0ae0 con 0x7fe05c1588d0 2023-08-31T19:24:40.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.142+0000 7fe05b7fe700 1 --2- 172.21.15.72:0/125468287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c1588d0 0x7fe05c154440 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7fe054009e60 tx=0x7fe054009780).ready entity=mon.0 client_cookie=f2642a40d297448f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:40.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.142+0000 7fe059ffb700 1 -- 172.21.15.72:0/125468287 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05400e070 con 0x7fe05c1588d0 2023-08-31T19:24:40.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.142+0000 7fe059ffb700 1 -- 172.21.15.72:0/125468287 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05400bab0 con 0x7fe05c1588d0 2023-08-31T19:24:40.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.142+0000 7fe059ffb700 1 -- 172.21.15.72:0/125468287 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05400be30 con 0x7fe05c1588d0 2023-08-31T19:24:40.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.143+0000 7fe0615ff700 1 -- 172.21.15.72:0/125468287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c1588d0 msgr2=0x7fe05c154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:40.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.143+0000 7fe0615ff700 1 --2- 172.21.15.72:0/125468287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c1588d0 0x7fe05c154440 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7fe054009e60 tx=0x7fe054009780).stop 2023-08-31T19:24:40.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.143+0000 7fe0615ff700 1 -- 172.21.15.72:0/125468287 shutdown_connections 2023-08-31T19:24:40.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.143+0000 7fe0615ff700 1 --2- 172.21.15.72:0/125468287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c1588d0 0x7fe05c154440 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:40.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.143+0000 7fe0615ff700 1 --2- 172.21.15.72:0/125468287 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe05c0cb9b0 0x7fe05c1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:40.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.143+0000 7fe0615ff700 1 -- 172.21.15.72:0/125468287 >> 172.21.15.72:0/125468287 conn(0x7fe05c05e870 msgr2=0x7fe05c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.143+0000 7fe0615ff700 1 -- 172.21.15.72:0/125468287 shutdown_connections 2023-08-31T19:24:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.143+0000 7fe0615ff700 1 -- 172.21.15.72:0/125468287 wait complete. 2023-08-31T19:24:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.145+0000 7fe0615ff700 1 Processor -- start 2023-08-31T19:24:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.145+0000 7fe0615ff700 1 -- start start 2023-08-31T19:24:40.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.146+0000 7fe0615ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe05c0cb9b0 0x7fe05c14c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:40.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.146+0000 7fe0615ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe05c154060 0x7fe05c156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:40.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.146+0000 7fe0615ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c1588d0 0x7fe05c0aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:40.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.146+0000 7fe0615ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0c1e30 con 0x7fe05c1588d0 2023-08-31T19:24:40.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.146+0000 7fe0615ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c1572e0 con 0x7fe05c154060 2023-08-31T19:24:40.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.146+0000 7fe0615ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c1575c0 con 0x7fe05c0cb9b0 2023-08-31T19:24:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.146+0000 7fe05b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c1588d0 0x7fe05c0aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.146+0000 7fe05affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe05c0cb9b0 0x7fe05c14c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.146+0000 7fe05a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe05c154060 0x7fe05c156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.146+0000 7fe05affd700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe05c0cb9b0 0x7fe05c14c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:33478/0 (socket says 172.21.15.72:33478) 2023-08-31T19:24:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.146+0000 7fe05b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c1588d0 0x7fe05c0aaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32972/0 (socket says 172.21.15.72:32972) 2023-08-31T19:24:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.146+0000 7fe05affd700 1 -- 172.21.15.72:0/247089369 learned_addr learned my addr 172.21.15.72:0/247089369 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.147+0000 7fe05b7fe700 1 -- 172.21.15.72:0/247089369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe05c0cb9b0 msgr2=0x7fe05c14c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.147+0000 7fe05b7fe700 1 --2- 172.21.15.72:0/247089369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe05c0cb9b0 0x7fe05c14c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.147+0000 7fe05b7fe700 1 -- 172.21.15.72:0/247089369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe05c154060 msgr2=0x7fe05c156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.147+0000 7fe05b7fe700 1 --2- 172.21.15.72:0/247089369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe05c154060 0x7fe05c156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.147+0000 7fe05b7fe700 1 -- 172.21.15.72:0/247089369 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe054009a20 con 0x7fe05c1588d0 2023-08-31T19:24:40.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.147+0000 7fe05b7fe700 1 --2- 172.21.15.72:0/247089369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c1588d0 0x7fe05c0aaf80 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7fe054014000 tx=0x7fe054009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:40.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.147+0000 7fe042ffd700 1 -- 172.21.15.72:0/247089369 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054012e30 con 0x7fe05c1588d0 2023-08-31T19:24:40.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.147+0000 7fe042ffd700 1 -- 172.21.15.72:0/247089369 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05401d630 con 0x7fe05c1588d0 2023-08-31T19:24:40.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.147+0000 7fe0615ff700 1 -- 172.21.15.72:0/247089369 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05c150790 con 0x7fe05c1588d0 2023-08-31T19:24:40.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.147+0000 7fe042ffd700 1 -- 172.21.15.72:0/247089369 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05401d9f0 con 0x7fe05c1588d0 2023-08-31T19:24:40.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.147+0000 7fe0615ff700 1 -- 172.21.15.72:0/247089369 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c14cd20 con 0x7fe05c1588d0 2023-08-31T19:24:40.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.148+0000 7fe0615ff700 1 -- 172.21.15.72:0/247089369 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05c150c30 con 0x7fe05c1588d0 2023-08-31T19:24:40.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.149+0000 7fe042ffd700 1 -- 172.21.15.72:0/247089369 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe054026410 con 0x7fe05c1588d0 2023-08-31T19:24:40.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.150+0000 7fe042ffd700 1 --2- 172.21.15.72:0/247089369 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe04805ef30 0x7fe0480613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:40.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.150+0000 7fe042ffd700 1 -- 172.21.15.72:0/247089369 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fe05407bf60 con 0x7fe05c1588d0 2023-08-31T19:24:40.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.150+0000 7fe05affd700 1 --2- 172.21.15.72:0/247089369 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe04805ef30 0x7fe0480613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:40.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.151+0000 7fe05affd700 1 --2- 172.21.15.72:0/247089369 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe04805ef30 0x7fe0480613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe04c0010e0 tx=0x7fe04c009040).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:40.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.154+0000 7fe042ffd700 1 -- 172.21.15.72:0/247089369 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe05404cec0 con 0x7fe05c1588d0 2023-08-31T19:24:40.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.322+0000 7fe0615ff700 1 -- 172.21.15.72:0/247089369 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe05c150de0 con 0x7fe05c1588d0 2023-08-31T19:24:40.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.323+0000 7fe042ffd700 1 -- 172.21.15.72:0/247089369 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+18004 (secure 0 0 0) 0x7fe0540504e0 con 0x7fe05c1588d0 2023-08-31T19:24:40.324 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:40.324 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":175,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:24:39.509165+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:24:37.934358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-31T19:24:38.492537+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:24:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.325+0000 7fe0615ff700 1 -- 172.21.15.72:0/247089369 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe04805ef30 msgr2=0x7fe0480613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.325+0000 7fe0615ff700 1 --2- 172.21.15.72:0/247089369 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe04805ef30 0x7fe0480613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe04c0010e0 tx=0x7fe04c009040).stop 2023-08-31T19:24:40.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.325+0000 7fe0615ff700 1 -- 172.21.15.72:0/247089369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c1588d0 msgr2=0x7fe05c0aaf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.325+0000 7fe0615ff700 1 --2- 172.21.15.72:0/247089369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c1588d0 0x7fe05c0aaf80 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7fe054014000 tx=0x7fe054009780).stop 2023-08-31T19:24:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.326+0000 7fe0615ff700 1 -- 172.21.15.72:0/247089369 shutdown_connections 2023-08-31T19:24:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.326+0000 7fe0615ff700 1 --2- 172.21.15.72:0/247089369 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe04805ef30 0x7fe0480613f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.326+0000 7fe0615ff700 1 --2- 172.21.15.72:0/247089369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c1588d0 0x7fe05c0aaf80 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:40.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.326+0000 7fe0615ff700 1 --2- 172.21.15.72:0/247089369 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe05c0cb9b0 0x7fe05c14c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.326+0000 7fe0615ff700 1 --2- 172.21.15.72:0/247089369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe05c154060 0x7fe05c156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.326+0000 7fe0615ff700 1 -- 172.21.15.72:0/247089369 >> 172.21.15.72:0/247089369 conn(0x7fe05c05e870 msgr2=0x7fe05c0bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.326+0000 7fe0615ff700 1 -- 172.21.15.72:0/247089369 shutdown_connections 2023-08-31T19:24:40.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.326+0000 7fe0615ff700 1 -- 172.21.15.72:0/247089369 wait complete. 2023-08-31T19:24:40.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T19:24:40.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.538+0000 7f42abfff700 1 Processor -- start 2023-08-31T19:24:40.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.538+0000 7f42abfff700 1 -- start start 2023-08-31T19:24:40.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.540+0000 7f42abfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f42a40c2320 0x7f42a40c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.540+0000 7f42abfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a40c2cc0 con 0x7f42a40696a0 2023-08-31T19:24:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.540+0000 7f42abfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a4152720 con 0x7f42a414ecd0 2023-08-31T19:24:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.540+0000 7f42abfff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a4151b10 con 0x7f42a40c2320 2023-08-31T19:24:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.540+0000 7f42aa59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f42a40696a0 0x7f42a4069af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53418/0 (socket says 172.21.15.72:53418) 2023-08-31T19:24:40.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.540+0000 7f42aa59c700 1 -- 172.21.15.72:0/1755643104 learned_addr learned my addr 172.21.15.72:0/1755643104 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.540+0000 7f42a959a700 1 --2- 172.21.15.72:0/1755643104 >> v2:172.21.15.146:3300/0 conn(0x7f42a40c2320 0x7f42a40c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.540+0000 7f42a8d99700 1 -- 172.21.15.72:0/1755643104 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908250030 0 0) 0x7f429c001490 con 0x7f42a40696a0 2023-08-31T19:24:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.540+0000 7f42a8d99700 1 -- 172.21.15.72:0/1755643104 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42900033f0 con 0x7f42a40696a0 2023-08-31T19:24:40.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.540+0000 7f42a8d99700 1 -- 172.21.15.72:0/1755643104 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1660235027 0 0) 0x7f42900033f0 con 0x7f42a40696a0 2023-08-31T19:24:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a8d99700 1 -- 172.21.15.72:0/1755643104 >> v2:172.21.15.146:3300/0 conn(0x7f42a40c2320 msgr2=0x7f42a40c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a8d99700 1 --2- 172.21.15.72:0/1755643104 >> v2:172.21.15.146:3300/0 conn(0x7f42a40c2320 0x7f42a40c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a8d99700 1 -- 172.21.15.72:0/1755643104 >> v1:172.21.15.146:6789/0 conn(0x7f42a414ecd0 legacy=0x7f42a41556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a8d99700 1 -- 172.21.15.72:0/1755643104 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a4151df0 con 0x7f42a40696a0 2023-08-31T19:24:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a8d99700 1 -- 172.21.15.72:0/1755643104 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f429c001980 con 0x7f42a40696a0 2023-08-31T19:24:40.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a8d99700 1 -- 172.21.15.72:0/1755643104 >> v1:172.21.15.72:6789/0 conn(0x7f42a40696a0 legacy=0x7f42a4069af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:40.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a8d99700 1 --2- 172.21.15.72:0/1755643104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42900038e0 0x7f4290003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:40.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a8d99700 1 --2- 172.21.15.72:0/1755643104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4290004690 0x7f4290004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:40.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a8d99700 1 --2- 172.21.15.72:0/1755643104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4290005000 0x7f429000daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:40.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a8d99700 1 -- 172.21.15.72:0/1755643104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a4151b10 con 0x7f42900038e0 2023-08-31T19:24:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a8d99700 1 -- 172.21.15.72:0/1755643104 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429000e0c0 con 0x7f4290005000 2023-08-31T19:24:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a8d99700 1 -- 172.21.15.72:0/1755643104 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429000e280 con 0x7f4290004690 2023-08-31T19:24:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a9d9b700 1 --2- 172.21.15.72:0/1755643104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42900038e0 0x7f4290003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42aa59c700 1 --2- 172.21.15.72:0/1755643104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4290005000 0x7f429000daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a959a700 1 --2- 172.21.15.72:0/1755643104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4290004690 0x7f4290004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:40.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a9d9b700 1 -- 172.21.15.72:0/1755643104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4290004690 msgr2=0x7f4290004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:40.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a9d9b700 1 --2- 172.21.15.72:0/1755643104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4290004690 0x7f4290004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:40.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a9d9b700 1 -- 172.21.15.72:0/1755643104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4290005000 msgr2=0x7f429000daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:40.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a9d9b700 1 --2- 172.21.15.72:0/1755643104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4290005000 0x7f429000daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:40.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a9d9b700 1 -- 172.21.15.72:0/1755643104 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42900033f0 con 0x7f42900038e0 2023-08-31T19:24:40.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42aa59c700 1 -- 172.21.15.72:0/1755643104 reap_dead start 2023-08-31T19:24:40.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.541+0000 7f42a959a700 1 --2- 172.21.15.72:0/1755643104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4290004690 0x7f4290004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:40.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.542+0000 7f42a9d9b700 1 --2- 172.21.15.72:0/1755643104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42900038e0 0x7f4290003cc0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f42a0001820 tx=0x7f42a0007b90).ready entity=mon.0 client_cookie=648006159020720c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:40.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.542+0000 7f42a8d99700 1 -- 172.21.15.72:0/1755643104 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a0007ea0 con 0x7f42900038e0 2023-08-31T19:24:40.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.542+0000 7f42a8d99700 1 -- 172.21.15.72:0/1755643104 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a0012400 con 0x7f42900038e0 2023-08-31T19:24:40.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.542+0000 7f42a8d99700 1 -- 172.21.15.72:0/1755643104 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a00127a0 con 0x7f42900038e0 2023-08-31T19:24:40.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.542+0000 7f42abfff700 1 -- 172.21.15.72:0/1755643104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42900038e0 msgr2=0x7f4290003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:40.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.542+0000 7f42abfff700 1 --2- 172.21.15.72:0/1755643104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42900038e0 0x7f4290003cc0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f42a0001820 tx=0x7f42a0007b90).stop 2023-08-31T19:24:40.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.542+0000 7f42abfff700 1 -- 172.21.15.72:0/1755643104 shutdown_connections 2023-08-31T19:24:40.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.542+0000 7f42abfff700 1 --2- 172.21.15.72:0/1755643104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42900038e0 0x7f4290003cc0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:40.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.542+0000 7f42abfff700 1 -- 172.21.15.72:0/1755643104 >> 172.21.15.72:0/1755643104 conn(0x7f42a40630c0 msgr2=0x7f42a40c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:40.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.542+0000 7f42abfff700 1 -- 172.21.15.72:0/1755643104 shutdown_connections 2023-08-31T19:24:40.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.542+0000 7f42abfff700 1 -- 172.21.15.72:0/1755643104 wait complete. 2023-08-31T19:24:40.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.544+0000 7f42abfff700 1 Processor -- start 2023-08-31T19:24:40.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.544+0000 7f42abfff700 1 -- start start 2023-08-31T19:24:40.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.545+0000 7f42abfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42900038e0 0x7f42a41502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:40.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.545+0000 7f42abfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a414fac0 0x7f42a4163910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:40.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.545+0000 7f42abfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42a4165190 0x7f42a41645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:40.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.545+0000 7f42abfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a4164160 con 0x7f42a4165190 2023-08-31T19:24:40.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.545+0000 7f42abfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a414ff40 con 0x7f42a414fac0 2023-08-31T19:24:40.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.545+0000 7f42abfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40ab670 con 0x7f42900038e0 2023-08-31T19:24:40.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.545+0000 7f42aa59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42a4165190 0x7f42a41645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:40.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.545+0000 7f42aa59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42a4165190 0x7f42a41645f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32982/0 (socket says 172.21.15.72:32982) 2023-08-31T19:24:40.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.545+0000 7f42aa59c700 1 -- 172.21.15.72:0/4130316292 learned_addr learned my addr 172.21.15.72:0/4130316292 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:40.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.545+0000 7f42a9d9b700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42900038e0 0x7f42a41502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:40.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.545+0000 7f42a959a700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a414fac0 0x7f42a4163910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:40.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.546+0000 7f42aa59c700 1 -- 172.21.15.72:0/4130316292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42900038e0 msgr2=0x7f42a41502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:40.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.546+0000 7f42aa59c700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42900038e0 0x7f42a41502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:40.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.546+0000 7f42aa59c700 1 -- 172.21.15.72:0/4130316292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a414fac0 msgr2=0x7f42a4163910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:40.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.546+0000 7f42aa59c700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a414fac0 0x7f42a4163910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:40.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.546+0000 7f42aa59c700 1 -- 172.21.15.72:0/4130316292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a4151170 con 0x7f42a4165190 2023-08-31T19:24:40.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.546+0000 7f42a9d9b700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42900038e0 0x7f42a41502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:40.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.546+0000 7f42a959a700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a414fac0 0x7f42a4163910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:40.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.546+0000 7f42aa59c700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42a4165190 0x7f42a41645f0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f42a40c6aa0 tx=0x7f429c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:40.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.546+0000 7f4299ffb700 1 -- 172.21.15.72:0/4130316292 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c00f8d0 con 0x7f42a4165190 2023-08-31T19:24:40.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.546+0000 7f4299ffb700 1 -- 172.21.15.72:0/4130316292 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c00fa30 con 0x7f42a4165190 2023-08-31T19:24:40.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.546+0000 7f42abfff700 1 -- 172.21.15.72:0/4130316292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a4163e00 con 0x7f42a4165190 2023-08-31T19:24:40.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.546+0000 7f4299ffb700 1 -- 172.21.15.72:0/4130316292 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c00fdd0 con 0x7f42a4165190 2023-08-31T19:24:40.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.546+0000 7f42abfff700 1 -- 172.21.15.72:0/4130316292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a4150bb0 con 0x7f42a4165190 2023-08-31T19:24:40.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.547+0000 7f42abfff700 1 -- 172.21.15.72:0/4130316292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a4164310 con 0x7f42a4165190 2023-08-31T19:24:40.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.548+0000 7f4299ffb700 1 -- 172.21.15.72:0/4130316292 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f429c015620 con 0x7f42a4165190 2023-08-31T19:24:40.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.549+0000 7f4299ffb700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f428805ef30 0x7f42880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:40.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.549+0000 7f4299ffb700 1 -- 172.21.15.72:0/4130316292 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f429c079fa0 con 0x7f42a4165190 2023-08-31T19:24:40.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.549+0000 7f42a9d9b700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f428805ef30 0x7f42880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:40.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.550+0000 7f42a9d9b700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f428805ef30 0x7f42880613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f42a40c6a70 tx=0x7f42a0016000).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:40.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.553+0000 7f4299ffb700 1 -- 172.21.15.72:0/4130316292 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f42a4164310 con 0x7f42a4165190 2023-08-31T19:24:40.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:40.762+0000 7f42abfff700 1 -- 172.21.15.72:0/4130316292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f42a40c2cc0 con 0x7f42a4165190 2023-08-31T19:24:41.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-08-31T19:24:41.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-08-31T19:24:41.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-08-31T19:24:41.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.529+0000 7f4299ffb700 1 -- 172.21.15.72:0/4130316292 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v78) v1 ==== 118+0+0 (secure 0 0 0) 0x7f42a40c2cc0 con 0x7f42a4165190 2023-08-31T19:24:41.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.532+0000 7f42abfff700 1 -- 172.21.15.72:0/4130316292 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f428805ef30 msgr2=0x7f42880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:41.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.532+0000 7f42abfff700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f428805ef30 0x7f42880613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f42a40c6a70 tx=0x7f42a0016000).stop 2023-08-31T19:24:41.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.532+0000 7f42abfff700 1 -- 172.21.15.72:0/4130316292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42a4165190 msgr2=0x7f42a41645f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:41.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.532+0000 7f42abfff700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42a4165190 0x7f42a41645f0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f42a40c6aa0 tx=0x7f429c007c50).stop 2023-08-31T19:24:41.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.532+0000 7f42abfff700 1 -- 172.21.15.72:0/4130316292 shutdown_connections 2023-08-31T19:24:41.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.532+0000 7f42abfff700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f428805ef30 0x7f42880613f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:41.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.532+0000 7f42abfff700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42a4165190 0x7f42a41645f0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:41.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.532+0000 7f42abfff700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f42900038e0 0x7f42a41502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:41.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.532+0000 7f42abfff700 1 --2- 172.21.15.72:0/4130316292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a414fac0 0x7f42a4163910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:41.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.532+0000 7f42abfff700 1 -- 172.21.15.72:0/4130316292 >> 172.21.15.72:0/4130316292 conn(0x7f42a40630c0 msgr2=0x7f42a40bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:41.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.532+0000 7f42abfff700 1 -- 172.21.15.72:0/4130316292 shutdown_connections 2023-08-31T19:24:41.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.532+0000 7f42abfff700 1 -- 172.21.15.72:0/4130316292 wait complete. 2023-08-31T19:24:41.550 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-31T19:24:41.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T19:24:41.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.743+0000 7fcedf3ff700 1 Processor -- start 2023-08-31T19:24:41.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.744+0000 7fcedf3ff700 1 -- start start 2023-08-31T19:24:41.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.745+0000 7fcedf3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fced8153ed0 0x7fced81542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:41.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.745+0000 7fcedf3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced80a84b0 con 0x7fced80663d0 2023-08-31T19:24:41.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.745+0000 7fcedf3ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced80c9410 con 0x7fced80bdb30 2023-08-31T19:24:41.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.745+0000 7fcedf3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced80c5310 con 0x7fced8153ed0 2023-08-31T19:24:41.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.745+0000 7fcedd99c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fced80663d0 0x7fced8157d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53428/0 (socket says 172.21.15.72:53428) 2023-08-31T19:24:41.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.745+0000 7fcedd99c700 1 -- 172.21.15.72:0/528123952 learned_addr learned my addr 172.21.15.72:0/528123952 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:41.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcedd19b700 1 --2- 172.21.15.72:0/528123952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fced8153ed0 0x7fced81542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:41.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcecffff700 1 -- 172.21.15.72:0/528123952 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198412022 0 0) 0x7fced80a84b0 con 0x7fced80663d0 2023-08-31T19:24:41.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcecffff700 1 -- 172.21.15.72:0/528123952 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec40033f0 con 0x7fced80663d0 2023-08-31T19:24:41.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcecffff700 1 -- 172.21.15.72:0/528123952 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3164252240 0 0) 0x7fcec40033f0 con 0x7fced80663d0 2023-08-31T19:24:41.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcecffff700 1 -- 172.21.15.72:0/528123952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fced8153ed0 msgr2=0x7fced81542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:41.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcecffff700 1 --2- 172.21.15.72:0/528123952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fced8153ed0 0x7fced81542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:41.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcecffff700 1 -- 172.21.15.72:0/528123952 >> v1:172.21.15.146:6789/0 conn(0x7fced80bdb30 legacy=0x7fced8155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:41.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcecffff700 1 -- 172.21.15.72:0/528123952 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced80a7ef0 con 0x7fced80663d0 2023-08-31T19:24:41.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcecffff700 1 -- 172.21.15.72:0/528123952 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fced0001840 con 0x7fced80663d0 2023-08-31T19:24:41.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcecffff700 1 -- 172.21.15.72:0/528123952 >> v1:172.21.15.72:6789/0 conn(0x7fced80663d0 legacy=0x7fced8157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:41.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcecffff700 1 --2- 172.21.15.72:0/528123952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fced8153ed0 0x7fcec4003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:41.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcecffff700 1 --2- 172.21.15.72:0/528123952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec4003e40 0x7fcec4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:41.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcecffff700 1 --2- 172.21.15.72:0/528123952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcec4004b80 0x7fcec4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcecffff700 1 -- 172.21.15.72:0/528123952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced80c5310 con 0x7fcec4004b80 2023-08-31T19:24:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcecffff700 1 -- 172.21.15.72:0/528123952 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec400ba10 con 0x7fcec4003e40 2023-08-31T19:24:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcecffff700 1 -- 172.21.15.72:0/528123952 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec400bbd0 con 0x7fced8153ed0 2023-08-31T19:24:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcedd99c700 1 --2- 172.21.15.72:0/528123952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcec4004b80 0x7fcec4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:41.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcedd19b700 1 --2- 172.21.15.72:0/528123952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fced8153ed0 0x7fcec4003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:41.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.746+0000 7fcedc99a700 1 --2- 172.21.15.72:0/528123952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec4003e40 0x7fcec4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:41.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.747+0000 7fcedd99c700 1 -- 172.21.15.72:0/528123952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fced8153ed0 msgr2=0x7fcec4003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:41.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.747+0000 7fcedd99c700 1 --2- 172.21.15.72:0/528123952 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fced8153ed0 0x7fcec4003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:41.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.747+0000 7fcedd99c700 1 -- 172.21.15.72:0/528123952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec4003e40 msgr2=0x7fcec4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:41.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.747+0000 7fcedd99c700 1 --2- 172.21.15.72:0/528123952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec4003e40 0x7fcec4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:41.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.747+0000 7fcedd99c700 1 -- 172.21.15.72:0/528123952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec40033f0 con 0x7fcec4004b80 2023-08-31T19:24:41.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.747+0000 7fcedd99c700 1 --2- 172.21.15.72:0/528123952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcec4004b80 0x7fcec4005000 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7fced000c5c0 tx=0x7fced0001de0).ready entity=mon.0 client_cookie=69ba704a775c49bb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:41.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.747+0000 7fcecffff700 1 -- 172.21.15.72:0/528123952 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced000ce90 con 0x7fcec4004b80 2023-08-31T19:24:41.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.747+0000 7fcecffff700 1 -- 172.21.15.72:0/528123952 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced0002010 con 0x7fcec4004b80 2023-08-31T19:24:41.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.747+0000 7fcecffff700 1 -- 172.21.15.72:0/528123952 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0005d80 con 0x7fcec4004b80 2023-08-31T19:24:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.748+0000 7fcedf3ff700 1 -- 172.21.15.72:0/528123952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcec4004b80 msgr2=0x7fcec4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.748+0000 7fcedf3ff700 1 --2- 172.21.15.72:0/528123952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcec4004b80 0x7fcec4005000 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7fced000c5c0 tx=0x7fced0001de0).stop 2023-08-31T19:24:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.748+0000 7fcedd99c700 1 -- 172.21.15.72:0/528123952 reap_dead start 2023-08-31T19:24:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.748+0000 7fcedf3ff700 1 -- 172.21.15.72:0/528123952 shutdown_connections 2023-08-31T19:24:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.748+0000 7fcedf3ff700 1 -- 172.21.15.72:0/528123952 >> 172.21.15.72:0/528123952 conn(0x7fced805eb60 msgr2=0x7fced80c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:41.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.748+0000 7fcedf3ff700 1 -- 172.21.15.72:0/528123952 shutdown_connections 2023-08-31T19:24:41.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.748+0000 7fcedf3ff700 1 -- 172.21.15.72:0/528123952 wait complete. 2023-08-31T19:24:41.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.749+0000 7fcedf3ff700 1 Processor -- start 2023-08-31T19:24:41.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.750+0000 7fcedf3ff700 1 -- start start 2023-08-31T19:24:41.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.750+0000 7fcedf3ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec4004b80 0x7fced80c06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:41.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.750+0000 7fcedf3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced80a5650 0x7fced80a7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:41.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedf3ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fced80a7770 0x7fced80c2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:41.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedf3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced80aa200 con 0x7fced80a5650 2023-08-31T19:24:41.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedf3ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced80a5d50 con 0x7fcec4004b80 2023-08-31T19:24:41.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedf3ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced80a5ad0 con 0x7fced80a7770 2023-08-31T19:24:41.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedd19b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec4004b80 0x7fced80c06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedc99a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced80a5650 0x7fced80a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedd19b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec4004b80 0x7fced80c06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:39602/0 (socket says 172.21.15.72:39602) 2023-08-31T19:24:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedd19b700 1 -- 172.21.15.72:0/2955457903 learned_addr learned my addr 172.21.15.72:0/2955457903 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedd99c700 1 --2- 172.21.15.72:0/2955457903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fced80a7770 0x7fced80c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedc99a700 1 -- 172.21.15.72:0/2955457903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fced80a7770 msgr2=0x7fced80c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedc99a700 1 --2- 172.21.15.72:0/2955457903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fced80a7770 0x7fced80c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedc99a700 1 -- 172.21.15.72:0/2955457903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec4004b80 msgr2=0x7fced80c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedc99a700 1 --2- 172.21.15.72:0/2955457903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec4004b80 0x7fced80c06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedc99a700 1 -- 172.21.15.72:0/2955457903 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced80aa3e0 con 0x7fced80a5650 2023-08-31T19:24:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedd19b700 1 --2- 172.21.15.72:0/2955457903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec4004b80 0x7fced80c06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:41.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.751+0000 7fcedc99a700 1 --2- 172.21.15.72:0/2955457903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced80a5650 0x7fced80a7280 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7fced8065f00 tx=0x7fcec8007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:41.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.752+0000 7fcecd7fa700 1 -- 172.21.15.72:0/2955457903 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8007240 con 0x7fced80a5650 2023-08-31T19:24:41.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.752+0000 7fcecd7fa700 1 -- 172.21.15.72:0/2955457903 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec80073a0 con 0x7fced80a5650 2023-08-31T19:24:41.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.752+0000 7fcecd7fa700 1 -- 172.21.15.72:0/2955457903 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec80066a0 con 0x7fced80a5650 2023-08-31T19:24:41.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.752+0000 7fcedf3ff700 1 -- 172.21.15.72:0/2955457903 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced80aa6c0 con 0x7fced80a5650 2023-08-31T19:24:41.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.752+0000 7fcedf3ff700 1 -- 172.21.15.72:0/2955457903 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced80aac80 con 0x7fced80a5650 2023-08-31T19:24:41.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.753+0000 7fcedf3ff700 1 -- 172.21.15.72:0/2955457903 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced806c6b0 con 0x7fced80a5650 2023-08-31T19:24:41.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.753+0000 7fcecd7fa700 1 -- 172.21.15.72:0/2955457903 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fcec8006a10 con 0x7fced80a5650 2023-08-31T19:24:41.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.755+0000 7fcecd7fa700 1 --2- 172.21.15.72:0/2955457903 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcebc05ef30 0x7fcebc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:41.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.755+0000 7fcecd7fa700 1 -- 172.21.15.72:0/2955457903 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fcec807a350 con 0x7fced80a5650 2023-08-31T19:24:41.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.755+0000 7fcedd19b700 1 --2- 172.21.15.72:0/2955457903 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcebc05ef30 0x7fcebc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:41.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.756+0000 7fcedd19b700 1 --2- 172.21.15.72:0/2955457903 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcebc05ef30 0x7fcebc0613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fced4006d30 tx=0x7fced4009060).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:41.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.759+0000 7fcecd7fa700 1 -- 172.21.15.72:0/2955457903 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcec804b310 con 0x7fced80a5650 2023-08-31T19:24:41.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:41.969+0000 7fcedf3ff700 1 -- 172.21.15.72:0/2955457903 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fced80a81d0 con 0x7fced80a5650 2023-08-31T19:24:42.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.535+0000 7fcecd7fa700 1 -- 172.21.15.72:0/2955457903 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v79) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcec804e930 con 0x7fced80a5650 2023-08-31T19:24:42.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.537+0000 7fcedf3ff700 1 -- 172.21.15.72:0/2955457903 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcebc05ef30 msgr2=0x7fcebc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:42.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.537+0000 7fcedf3ff700 1 --2- 172.21.15.72:0/2955457903 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcebc05ef30 0x7fcebc0613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fced4006d30 tx=0x7fced4009060).stop 2023-08-31T19:24:42.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.537+0000 7fcedf3ff700 1 -- 172.21.15.72:0/2955457903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced80a5650 msgr2=0x7fced80a7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:42.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.537+0000 7fcedf3ff700 1 --2- 172.21.15.72:0/2955457903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced80a5650 0x7fced80a7280 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7fced8065f00 tx=0x7fcec8007bb0).stop 2023-08-31T19:24:42.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.537+0000 7fcedf3ff700 1 -- 172.21.15.72:0/2955457903 shutdown_connections 2023-08-31T19:24:42.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.537+0000 7fcedf3ff700 1 --2- 172.21.15.72:0/2955457903 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcebc05ef30 0x7fcebc0613f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:42.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.537+0000 7fcedf3ff700 1 --2- 172.21.15.72:0/2955457903 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fced80a7770 0x7fced80c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:42.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.537+0000 7fcedf3ff700 1 --2- 172.21.15.72:0/2955457903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcec4004b80 0x7fced80c06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:42.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.537+0000 7fcedf3ff700 1 --2- 172.21.15.72:0/2955457903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fced80a5650 0x7fced80a7280 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:42.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.537+0000 7fcedf3ff700 1 -- 172.21.15.72:0/2955457903 >> 172.21.15.72:0/2955457903 conn(0x7fced805eb60 msgr2=0x7fced8153620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:42.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.537+0000 7fcedf3ff700 1 -- 172.21.15.72:0/2955457903 shutdown_connections 2023-08-31T19:24:42.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.537+0000 7fcedf3ff700 1 -- 172.21.15.72:0/2955457903 wait complete. 2023-08-31T19:24:42.555 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T19:24:42.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:24:42.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.744+0000 7f1da8dff700 1 Processor -- start 2023-08-31T19:24:42.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.744+0000 7f1da8dff700 1 -- start start 2023-08-31T19:24:42.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.746+0000 7f1da8dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1da40bea80 0x7f1da40c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.746+0000 7f1da8dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da40c48f0 con 0x7f1da40c5fb0 2023-08-31T19:24:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.746+0000 7f1da8dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da40bef10 con 0x7f1da40c44a0 2023-08-31T19:24:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.746+0000 7f1da8dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da4154690 con 0x7f1da40bea80 2023-08-31T19:24:42.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.746+0000 7f1da1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1da40bea80 0x7f1da40c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:42.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.746+0000 7f1da259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1da40c5fb0 0x7f1da40be370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53430/0 (socket says 172.21.15.72:53430) 2023-08-31T19:24:42.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.746+0000 7f1da259c700 1 -- 172.21.15.72:0/3671177262 learned_addr learned my addr 172.21.15.72:0/3671177262 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:42.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.746+0000 7f1da1d9b700 1 -- 172.21.15.72:0/3671177262 >> v1:172.21.15.146:6789/0 conn(0x7f1da40c44a0 legacy=0x7f1da4063a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:42.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.746+0000 7f1da1d9b700 1 -- 172.21.15.72:0/3671177262 >> v1:172.21.15.72:6789/0 conn(0x7f1da40c5fb0 legacy=0x7f1da40be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:42.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.747+0000 7f1da1d9b700 1 -- 172.21.15.72:0/3671177262 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40bf1f0 con 0x7f1da40bea80 2023-08-31T19:24:42.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.747+0000 7f1da1d9b700 1 --2- 172.21.15.72:0/3671177262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da40bea80 0x7f1da40c3fb0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7f1d98009760 tx=0x7f1d98009060).ready entity=mon.0 client_cookie=541792d7def6574b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:42.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.747+0000 7f1da159a700 1 -- 172.21.15.72:0/3671177262 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9800b580 con 0x7f1da40bea80 2023-08-31T19:24:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.747+0000 7f1da159a700 1 -- 172.21.15.72:0/3671177262 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9800b6e0 con 0x7f1da40bea80 2023-08-31T19:24:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.747+0000 7f1da159a700 1 -- 172.21.15.72:0/3671177262 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9800ba60 con 0x7f1da40bea80 2023-08-31T19:24:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.747+0000 7f1da8dff700 1 -- 172.21.15.72:0/3671177262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da40bea80 msgr2=0x7f1da40c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.747+0000 7f1da8dff700 1 --2- 172.21.15.72:0/3671177262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da40bea80 0x7f1da40c3fb0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7f1d98009760 tx=0x7f1d98009060).stop 2023-08-31T19:24:42.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.748+0000 7f1da8dff700 1 -- 172.21.15.72:0/3671177262 shutdown_connections 2023-08-31T19:24:42.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.748+0000 7f1da8dff700 1 --2- 172.21.15.72:0/3671177262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da40bea80 0x7f1da40c3fb0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:42.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.748+0000 7f1da8dff700 1 -- 172.21.15.72:0/3671177262 >> 172.21.15.72:0/3671177262 conn(0x7f1da4082f60 msgr2=0x7f1da405e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:42.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.748+0000 7f1da8dff700 1 -- 172.21.15.72:0/3671177262 shutdown_connections 2023-08-31T19:24:42.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.748+0000 7f1da8dff700 1 -- 172.21.15.72:0/3671177262 wait complete. 2023-08-31T19:24:42.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.749+0000 7f1da8dff700 1 Processor -- start 2023-08-31T19:24:42.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.749+0000 7f1da8dff700 1 -- start start 2023-08-31T19:24:42.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.750+0000 7f1da8dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da40c44a0 0x7f1da4159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:42.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.750+0000 7f1da8dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1da40c5fb0 0x7f1da4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:42.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.750+0000 7f1da8dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da4145a20 0x7f1da4156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:42.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.750+0000 7f1da8dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da41584b0 con 0x7f1da4145a20 2023-08-31T19:24:42.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.750+0000 7f1da8dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da4158790 con 0x7f1da40c44a0 2023-08-31T19:24:42.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.750+0000 7f1da8dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da4158a70 con 0x7f1da40c5fb0 2023-08-31T19:24:42.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.750+0000 7f1da2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da4145a20 0x7f1da4156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:42.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.750+0000 7f1da2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da4145a20 0x7f1da4156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33018/0 (socket says 172.21.15.72:33018) 2023-08-31T19:24:42.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.750+0000 7f1da2d9d700 1 -- 172.21.15.72:0/1287100045 learned_addr learned my addr 172.21.15.72:0/1287100045 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:42.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.751+0000 7f1da259c700 1 --2- 172.21.15.72:0/1287100045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da40c44a0 0x7f1da4159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:42.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.751+0000 7f1da1d9b700 1 --2- 172.21.15.72:0/1287100045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1da40c5fb0 0x7f1da4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:42.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.751+0000 7f1da2d9d700 1 -- 172.21.15.72:0/1287100045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1da40c5fb0 msgr2=0x7f1da4157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:42.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.751+0000 7f1da2d9d700 1 --2- 172.21.15.72:0/1287100045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1da40c5fb0 0x7f1da4157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:42.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.751+0000 7f1da2d9d700 1 -- 172.21.15.72:0/1287100045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da40c44a0 msgr2=0x7f1da4159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:42.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.751+0000 7f1da2d9d700 1 --2- 172.21.15.72:0/1287100045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da40c44a0 0x7f1da4159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:42.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.751+0000 7f1da2d9d700 1 -- 172.21.15.72:0/1287100045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d980092a0 con 0x7f1da4145a20 2023-08-31T19:24:42.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.751+0000 7f1da259c700 1 --2- 172.21.15.72:0/1287100045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da40c44a0 0x7f1da4159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:42.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.751+0000 7f1da2d9d700 1 --2- 172.21.15.72:0/1287100045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da4145a20 0x7f1da4156c30 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7f1d9c002230 tx=0x7f1d9c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:42.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.751+0000 7f1d927fc700 1 -- 172.21.15.72:0/1287100045 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c010510 con 0x7f1da4145a20 2023-08-31T19:24:42.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.751+0000 7f1d927fc700 1 -- 172.21.15.72:0/1287100045 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c010670 con 0x7f1da4145a20 2023-08-31T19:24:42.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.751+0000 7f1da8dff700 1 -- 172.21.15.72:0/1287100045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da4158d50 con 0x7f1da4145a20 2023-08-31T19:24:42.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.751+0000 7f1d927fc700 1 -- 172.21.15.72:0/1287100045 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c0109f0 con 0x7f1da4145a20 2023-08-31T19:24:42.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.751+0000 7f1da8dff700 1 -- 172.21.15.72:0/1287100045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da40ad480 con 0x7f1da4145a20 2023-08-31T19:24:42.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.752+0000 7f1da8dff700 1 -- 172.21.15.72:0/1287100045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da40ad700 con 0x7f1da4145a20 2023-08-31T19:24:42.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.753+0000 7f1d927fc700 1 -- 172.21.15.72:0/1287100045 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f1d9c01b400 con 0x7f1da4145a20 2023-08-31T19:24:42.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.754+0000 7f1d927fc700 1 --2- 172.21.15.72:0/1287100045 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1d8405ef30 0x7f1d840613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:42.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.754+0000 7f1d927fc700 1 -- 172.21.15.72:0/1287100045 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f1d9c07a160 con 0x7f1da4145a20 2023-08-31T19:24:42.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.754+0000 7f1da259c700 1 --2- 172.21.15.72:0/1287100045 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1d8405ef30 0x7f1d840613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:42.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.755+0000 7f1da259c700 1 --2- 172.21.15.72:0/1287100045 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1d8405ef30 0x7f1d840613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1d94001690 tx=0x7f1d94009040).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:42.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.758+0000 7f1d927fc700 1 -- 172.21.15.72:0/1287100045 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d9c04b0c0 con 0x7f1da4145a20 2023-08-31T19:24:42.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.971+0000 7f1da8dff700 1 -- 172.21.15.72:0/1287100045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1da406c6b0 con 0x7f1da4145a20 2023-08-31T19:24:42.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.972+0000 7f1d927fc700 1 -- 172.21.15.72:0/1287100045 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f1d9c04e6e0 con 0x7f1da4145a20 2023-08-31T19:24:42.972 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:42.973 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3355816598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3355816598},{"type":"v1","addr":"172.21.15.146:6833","nonce":3355816598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/197878546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":197878546},{"type":"v1","addr":"172.21.15.146:6835","nonce":197878546}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2229531329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2229531329},{"type":"v1","addr":"172.21.15.72:6836","nonce":2229531329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:24:39.509515+0000","modified":"2023-08-31T19:24:42.529652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9024":{"gid":9024,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/1822141039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1822141039},{"type":"v1","addr":"172.21.15.72:6837","nonce":1822141039}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-31T19:24:42.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.974+0000 7f1da8dff700 1 -- 172.21.15.72:0/1287100045 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1d8405ef30 msgr2=0x7f1d840613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:42.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.974+0000 7f1da8dff700 1 --2- 172.21.15.72:0/1287100045 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1d8405ef30 0x7f1d840613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1d94001690 tx=0x7f1d94009040).stop 2023-08-31T19:24:42.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.974+0000 7f1da8dff700 1 -- 172.21.15.72:0/1287100045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da4145a20 msgr2=0x7f1da4156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:42.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.974+0000 7f1da8dff700 1 --2- 172.21.15.72:0/1287100045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da4145a20 0x7f1da4156c30 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7f1d9c002230 tx=0x7f1d9c0015e0).stop 2023-08-31T19:24:42.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.974+0000 7f1da8dff700 1 -- 172.21.15.72:0/1287100045 shutdown_connections 2023-08-31T19:24:42.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.974+0000 7f1da8dff700 1 --2- 172.21.15.72:0/1287100045 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1d8405ef30 0x7f1d840613f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:42.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.974+0000 7f1da8dff700 1 --2- 172.21.15.72:0/1287100045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da4145a20 0x7f1da4156c30 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:42.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.974+0000 7f1da8dff700 1 --2- 172.21.15.72:0/1287100045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1da40c44a0 0x7f1da4159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:42.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.974+0000 7f1da8dff700 1 --2- 172.21.15.72:0/1287100045 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1da40c5fb0 0x7f1da4157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:42.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.974+0000 7f1da8dff700 1 -- 172.21.15.72:0/1287100045 >> 172.21.15.72:0/1287100045 conn(0x7f1da4082f60 msgr2=0x7f1da40c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:42.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.974+0000 7f1da8dff700 1 -- 172.21.15.72:0/1287100045 shutdown_connections 2023-08-31T19:24:42.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:42.974+0000 7f1da8dff700 1 -- 172.21.15.72:0/1287100045 wait complete. 2023-08-31T19:24:42.977 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 79 2023-08-31T19:24:42.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:24:43.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.180+0000 7f5cbc9ff700 1 Processor -- start 2023-08-31T19:24:43.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.180+0000 7f5cbc9ff700 1 -- start start 2023-08-31T19:24:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.181+0000 7f5cbc9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5cb80c5fb0 0x7f5cb80be370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.182+0000 7f5cbc9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5cb80c46c0 0x7f5cb8063a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.182+0000 7f5cbc9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb80bece0 con 0x7f5cb80be860 2023-08-31T19:24:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.182+0000 7f5cbc9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb8154690 con 0x7f5cb80c46c0 2023-08-31T19:24:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.182+0000 7f5cbc9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb80bfb20 con 0x7f5cb80c5fb0 2023-08-31T19:24:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.182+0000 7f5cb6d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5cb80c46c0 0x7f5cb8063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:43.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.182+0000 7f5cb6d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5cb80c46c0 0x7f5cb8063a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44260/0 (socket says 172.21.15.72:44260) 2023-08-31T19:24:43.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.182+0000 7f5cb6d9d700 1 -- 172.21.15.72:0/2657983012 learned_addr learned my addr 172.21.15.72:0/2657983012 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:43.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.182+0000 7f5cb659c700 1 --2- 172.21.15.72:0/2657983012 >> v2:172.21.15.146:3300/0 conn(0x7f5cb80c5fb0 0x7f5cb80be370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:43.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.182+0000 7f5cb6d9d700 1 -- 172.21.15.72:0/2657983012 >> v2:172.21.15.146:3300/0 conn(0x7f5cb80c5fb0 msgr2=0x7f5cb80be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:43.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.182+0000 7f5cb6d9d700 1 --2- 172.21.15.72:0/2657983012 >> v2:172.21.15.146:3300/0 conn(0x7f5cb80c5fb0 0x7f5cb80be370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.182+0000 7f5cb6d9d700 1 -- 172.21.15.72:0/2657983012 >> v1:172.21.15.146:6789/0 conn(0x7f5cb80be860 legacy=0x7f5cb80c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.182+0000 7f5cb6d9d700 1 -- 172.21.15.72:0/2657983012 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb80bef10 con 0x7f5cb80c46c0 2023-08-31T19:24:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.183+0000 7f5cb6d9d700 1 --2- 172.21.15.72:0/2657983012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cb80c46c0 0x7f5cb8063a90 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f5cb80c37a0 tx=0x7f5cb0009840).ready entity=mon.0 client_cookie=72e904dc74d9fb5a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.183+0000 7f5cb559a700 1 -- 172.21.15.72:0/2657983012 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb000e070 con 0x7f5cb80c46c0 2023-08-31T19:24:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.183+0000 7f5cb559a700 1 -- 172.21.15.72:0/2657983012 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb000ba20 con 0x7f5cb80c46c0 2023-08-31T19:24:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.183+0000 7f5cb559a700 1 -- 172.21.15.72:0/2657983012 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb000bda0 con 0x7f5cb80c46c0 2023-08-31T19:24:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.183+0000 7f5cbc9ff700 1 -- 172.21.15.72:0/2657983012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cb80c46c0 msgr2=0x7f5cb8063a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.183+0000 7f5cbc9ff700 1 --2- 172.21.15.72:0/2657983012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cb80c46c0 0x7f5cb8063a90 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f5cb80c37a0 tx=0x7f5cb0009840).stop 2023-08-31T19:24:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.183+0000 7f5cbc9ff700 1 -- 172.21.15.72:0/2657983012 shutdown_connections 2023-08-31T19:24:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.183+0000 7f5cbc9ff700 1 --2- 172.21.15.72:0/2657983012 >> v2:172.21.15.146:3300/0 conn(0x7f5cb80c5fb0 0x7f5cb80be370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.183+0000 7f5cbc9ff700 1 --2- 172.21.15.72:0/2657983012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cb80c46c0 0x7f5cb8063a90 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.183+0000 7f5cbc9ff700 1 -- 172.21.15.72:0/2657983012 >> 172.21.15.72:0/2657983012 conn(0x7f5cb8082f60 msgr2=0x7f5cb805e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:43.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.183+0000 7f5cbc9ff700 1 -- 172.21.15.72:0/2657983012 shutdown_connections 2023-08-31T19:24:43.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.184+0000 7f5cbc9ff700 1 -- 172.21.15.72:0/2657983012 wait complete. 2023-08-31T19:24:43.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.185+0000 7f5cbc9ff700 1 Processor -- start 2023-08-31T19:24:43.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.185+0000 7f5cbc9ff700 1 -- start start 2023-08-31T19:24:43.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.186+0000 7f5cbc9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cb80be860 0x7f5cb80ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:43.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.186+0000 7f5cbc9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cb80c46c0 0x7f5cb8152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:43.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.186+0000 7f5cbc9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cb80c5fb0 0x7f5cb80c2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:43.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.186+0000 7f5cbc9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80a9040 con 0x7f5cb80be860 2023-08-31T19:24:43.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.186+0000 7f5cbc9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80a8780 con 0x7f5cb80c46c0 2023-08-31T19:24:43.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.186+0000 7f5cbc9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80a75e0 con 0x7f5cb80c5fb0 2023-08-31T19:24:43.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.186+0000 7f5cb659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cb80be860 0x7f5cb80ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:43.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.186+0000 7f5cb659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cb80be860 0x7f5cb80ab0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44270/0 (socket says 172.21.15.72:44270) 2023-08-31T19:24:43.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.186+0000 7f5cb659c700 1 -- 172.21.15.72:0/1417283856 learned_addr learned my addr 172.21.15.72:0/1417283856 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:43.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.187+0000 7f5cb5d9b700 1 --2- 172.21.15.72:0/1417283856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cb80c46c0 0x7f5cb8152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:43.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.187+0000 7f5cb6d9d700 1 --2- 172.21.15.72:0/1417283856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cb80c5fb0 0x7f5cb80c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:43.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.187+0000 7f5cb659c700 1 -- 172.21.15.72:0/1417283856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cb80c5fb0 msgr2=0x7f5cb80c2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:43.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.187+0000 7f5cb659c700 1 --2- 172.21.15.72:0/1417283856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cb80c5fb0 0x7f5cb80c2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.187+0000 7f5cb659c700 1 -- 172.21.15.72:0/1417283856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cb80c46c0 msgr2=0x7f5cb8152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:43.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.187+0000 7f5cb659c700 1 --2- 172.21.15.72:0/1417283856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cb80c46c0 0x7f5cb8152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.187+0000 7f5cb659c700 1 -- 172.21.15.72:0/1417283856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb0009ae0 con 0x7f5cb80be860 2023-08-31T19:24:43.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.187+0000 7f5cb6d9d700 1 --2- 172.21.15.72:0/1417283856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cb80c5fb0 0x7f5cb80c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:43.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.187+0000 7f5cb659c700 1 --2- 172.21.15.72:0/1417283856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cb80be860 0x7f5cb80ab0f0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f5ca800e8d0 tx=0x7f5ca8006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:43.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.187+0000 7f5ca67fc700 1 -- 172.21.15.72:0/1417283856 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8012600 con 0x7f5cb80be860 2023-08-31T19:24:43.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.187+0000 7f5ca67fc700 1 -- 172.21.15.72:0/1417283856 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca8012760 con 0x7f5cb80be860 2023-08-31T19:24:43.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.187+0000 7f5cbc9ff700 1 -- 172.21.15.72:0/1417283856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb80a89f0 con 0x7f5cb80be860 2023-08-31T19:24:43.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.187+0000 7f5ca67fc700 1 -- 172.21.15.72:0/1417283856 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8012ae0 con 0x7f5cb80be860 2023-08-31T19:24:43.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.187+0000 7f5cbc9ff700 1 -- 172.21.15.72:0/1417283856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb80ab6d0 con 0x7f5cb80be860 2023-08-31T19:24:43.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.189+0000 7f5cbc9ff700 1 -- 172.21.15.72:0/1417283856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb80a9320 con 0x7f5cb80be860 2023-08-31T19:24:43.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.189+0000 7f5ca67fc700 1 -- 172.21.15.72:0/1417283856 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f5ca801b400 con 0x7f5cb80be860 2023-08-31T19:24:43.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.190+0000 7f5ca67fc700 1 --2- 172.21.15.72:0/1417283856 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5c9805ef30 0x7f5c980613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:43.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.190+0000 7f5ca67fc700 1 -- 172.21.15.72:0/1417283856 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f5ca807a640 con 0x7f5cb80be860 2023-08-31T19:24:43.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.190+0000 7f5cb5d9b700 1 --2- 172.21.15.72:0/1417283856 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5c9805ef30 0x7f5c980613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:43.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.191+0000 7f5cb5d9b700 1 --2- 172.21.15.72:0/1417283856 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5c9805ef30 0x7f5c980613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5cb80a7da0 tx=0x7f5cac007d40).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:43.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.194+0000 7f5ca67fc700 1 -- 172.21.15.72:0/1417283856 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5ca804b5a0 con 0x7f5cb80be860 2023-08-31T19:24:43.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.365+0000 7f5cbc9ff700 1 -- 172.21.15.72:0/1417283856 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cb80a8e90 con 0x7f5cb80be860 2023-08-31T19:24:43.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.366+0000 7f5ca67fc700 1 -- 172.21.15.72:0/1417283856 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+17991 (secure 0 0 0) 0x7f5ca8016090 con 0x7f5cb80be860 2023-08-31T19:24:43.366 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:43.367 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":176,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:24:40.512099+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:24:37.934358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-31T19:24:38.492537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:24:43.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.368+0000 7f5cbc9ff700 1 -- 172.21.15.72:0/1417283856 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5c9805ef30 msgr2=0x7f5c980613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:43.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.368+0000 7f5cbc9ff700 1 --2- 172.21.15.72:0/1417283856 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5c9805ef30 0x7f5c980613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5cb80a7da0 tx=0x7f5cac007d40).stop 2023-08-31T19:24:43.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.368+0000 7f5cbc9ff700 1 -- 172.21.15.72:0/1417283856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cb80be860 msgr2=0x7f5cb80ab0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:43.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.368+0000 7f5cbc9ff700 1 --2- 172.21.15.72:0/1417283856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cb80be860 0x7f5cb80ab0f0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f5ca800e8d0 tx=0x7f5ca8006f40).stop 2023-08-31T19:24:43.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.368+0000 7f5cbc9ff700 1 -- 172.21.15.72:0/1417283856 shutdown_connections 2023-08-31T19:24:43.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.368+0000 7f5cbc9ff700 1 --2- 172.21.15.72:0/1417283856 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5c9805ef30 0x7f5c980613f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.368+0000 7f5cbc9ff700 1 --2- 172.21.15.72:0/1417283856 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5cb80c5fb0 0x7f5cb80c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.368+0000 7f5cbc9ff700 1 --2- 172.21.15.72:0/1417283856 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cb80be860 0x7f5cb80ab0f0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.368+0000 7f5cbc9ff700 1 --2- 172.21.15.72:0/1417283856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cb80c46c0 0x7f5cb8152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.368+0000 7f5cbc9ff700 1 -- 172.21.15.72:0/1417283856 >> 172.21.15.72:0/1417283856 conn(0x7f5cb8082f60 msgr2=0x7f5cb81535b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:43.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.368+0000 7f5cbc9ff700 1 -- 172.21.15.72:0/1417283856 shutdown_connections 2023-08-31T19:24:43.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.368+0000 7f5cbc9ff700 1 -- 172.21.15.72:0/1417283856 wait complete. 2023-08-31T19:24:43.385 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T19:24:43.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:24:43.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.577+0000 7f412ebff700 1 Processor -- start 2023-08-31T19:24:43.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.577+0000 7f412ebff700 1 -- start start 2023-08-31T19:24:43.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.578+0000 7f412ebff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41280c6c30 0x7f41280bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:43.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.578+0000 7f412ebff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41281583f0 0x7f41280c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:43.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.578+0000 7f412ebff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4128063be0 con 0x7f41280c4740 2023-08-31T19:24:43.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.578+0000 7f412ebff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4128063010 con 0x7f41281583f0 2023-08-31T19:24:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.578+0000 7f412ebff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41280632b0 con 0x7f41280c6c30 2023-08-31T19:24:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.579+0000 7f412d19c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41281583f0 0x7f41280c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.579+0000 7f412d19c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41281583f0 0x7f41280c52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44280/0 (socket says 172.21.15.72:44280) 2023-08-31T19:24:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.579+0000 7f412d19c700 1 -- 172.21.15.72:0/2242839815 learned_addr learned my addr 172.21.15.72:0/2242839815 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.579+0000 7f412c99b700 1 --2- 172.21.15.72:0/2242839815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41280c6c30 0x7f41280bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.579+0000 7f41277fe700 1 -- 172.21.15.72:0/2242839815 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791690962 0 0) 0x7f4128063be0 con 0x7f41280c4740 2023-08-31T19:24:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.579+0000 7f412d19c700 1 -- 172.21.15.72:0/2242839815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41280c6c30 msgr2=0x7f41280bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.579+0000 7f412d19c700 1 --2- 172.21.15.72:0/2242839815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41280c6c30 0x7f41280bc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.579+0000 7f412d19c700 1 -- 172.21.15.72:0/2242839815 >> v1:172.21.15.146:6789/0 conn(0x7f41280c4740 legacy=0x7f4128157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:43.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.579+0000 7f412d19c700 1 -- 172.21.15.72:0/2242839815 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4128063590 con 0x7f41281583f0 2023-08-31T19:24:43.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.580+0000 7f412d19c700 1 --2- 172.21.15.72:0/2242839815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41281583f0 0x7f41280c52a0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f4120009f20 tx=0x7f4120009840).ready entity=mon.0 client_cookie=4740026f59c0d0c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:43.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.580+0000 7f41277fe700 1 -- 172.21.15.72:0/2242839815 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412000e070 con 0x7f41281583f0 2023-08-31T19:24:43.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.580+0000 7f41277fe700 1 -- 172.21.15.72:0/2242839815 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412000b9d0 con 0x7f41281583f0 2023-08-31T19:24:43.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.580+0000 7f41277fe700 1 -- 172.21.15.72:0/2242839815 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412000bd50 con 0x7f41281583f0 2023-08-31T19:24:43.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.580+0000 7f412ebff700 1 -- 172.21.15.72:0/2242839815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41281583f0 msgr2=0x7f41280c52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:43.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.580+0000 7f412ebff700 1 --2- 172.21.15.72:0/2242839815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41281583f0 0x7f41280c52a0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f4120009f20 tx=0x7f4120009840).stop 2023-08-31T19:24:43.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.580+0000 7f412ebff700 1 -- 172.21.15.72:0/2242839815 shutdown_connections 2023-08-31T19:24:43.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.580+0000 7f412ebff700 1 --2- 172.21.15.72:0/2242839815 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41280c6c30 0x7f41280bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.580+0000 7f412ebff700 1 --2- 172.21.15.72:0/2242839815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41281583f0 0x7f41280c52a0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.580+0000 7f412ebff700 1 -- 172.21.15.72:0/2242839815 >> 172.21.15.72:0/2242839815 conn(0x7f41280c7e70 msgr2=0x7f41280c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:43.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.580+0000 7f412ebff700 1 -- 172.21.15.72:0/2242839815 shutdown_connections 2023-08-31T19:24:43.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.580+0000 7f412ebff700 1 -- 172.21.15.72:0/2242839815 wait complete. 2023-08-31T19:24:43.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.582+0000 7f412ebff700 1 Processor -- start 2023-08-31T19:24:43.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.582+0000 7f412ebff700 1 -- start start 2023-08-31T19:24:43.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.583+0000 7f412ebff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41280c4740 0x7f412813a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:43.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.583+0000 7f412ebff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41280c6c30 0x7f412812bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:43.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.583+0000 7f412ebff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41281583f0 0x7f4128138700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:43.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.583+0000 7f412ebff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41281511a0 con 0x7f41280c6c30 2023-08-31T19:24:43.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.583+0000 7f412ebff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412813a070 con 0x7f41281583f0 2023-08-31T19:24:43.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.583+0000 7f412ebff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412812c1d0 con 0x7f41280c4740 2023-08-31T19:24:43.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.583+0000 7f4127fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41280c6c30 0x7f412812bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.583+0000 7f4127fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41280c6c30 0x7f412812bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44290/0 (socket says 172.21.15.72:44290) 2023-08-31T19:24:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.583+0000 7f4127fff700 1 -- 172.21.15.72:0/1282625380 learned_addr learned my addr 172.21.15.72:0/1282625380 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.583+0000 7f412c99b700 1 --2- 172.21.15.72:0/1282625380 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41280c4740 0x7f412813a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.583+0000 7f412d19c700 1 --2- 172.21.15.72:0/1282625380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41281583f0 0x7f4128138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.584+0000 7f4127fff700 1 -- 172.21.15.72:0/1282625380 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41280c4740 msgr2=0x7f412813a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:43.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.584+0000 7f4127fff700 1 --2- 172.21.15.72:0/1282625380 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41280c4740 0x7f412813a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.584+0000 7f4127fff700 1 -- 172.21.15.72:0/1282625380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41281583f0 msgr2=0x7f4128138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:43.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.584+0000 7f4127fff700 1 --2- 172.21.15.72:0/1282625380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41281583f0 0x7f4128138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.584+0000 7f4127fff700 1 -- 172.21.15.72:0/1282625380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4120009ae0 con 0x7f41280c6c30 2023-08-31T19:24:43.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.584+0000 7f4127fff700 1 --2- 172.21.15.72:0/1282625380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41280c6c30 0x7f412812bce0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f4114007fd0 tx=0x7f4114007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:43.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.584+0000 7f4124ff9700 1 -- 172.21.15.72:0/1282625380 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411400ce20 con 0x7f41280c6c30 2023-08-31T19:24:43.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.584+0000 7f4124ff9700 1 -- 172.21.15.72:0/1282625380 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411400f470 con 0x7f41280c6c30 2023-08-31T19:24:43.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.584+0000 7f412ebff700 1 -- 172.21.15.72:0/1282625380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4128139460 con 0x7f41280c6c30 2023-08-31T19:24:43.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.584+0000 7f4124ff9700 1 -- 172.21.15.72:0/1282625380 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411400f830 con 0x7f41280c6c30 2023-08-31T19:24:43.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.584+0000 7f412ebff700 1 -- 172.21.15.72:0/1282625380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4128139a20 con 0x7f41280c6c30 2023-08-31T19:24:43.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.585+0000 7f412ebff700 1 -- 172.21.15.72:0/1282625380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f412806c6b0 con 0x7f41280c6c30 2023-08-31T19:24:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.586+0000 7f4124ff9700 1 -- 172.21.15.72:0/1282625380 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f411400fba0 con 0x7f41280c6c30 2023-08-31T19:24:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.587+0000 7f4124ff9700 1 --2- 172.21.15.72:0/1282625380 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f410c05ef30 0x7f410c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.587+0000 7f4124ff9700 1 -- 172.21.15.72:0/1282625380 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f4114079850 con 0x7f41280c6c30 2023-08-31T19:24:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.587+0000 7f412c99b700 1 --2- 172.21.15.72:0/1282625380 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f410c05ef30 0x7f410c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.588+0000 7f412c99b700 1 --2- 172.21.15.72:0/1282625380 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f410c05ef30 0x7f410c0613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f411c009c30 tx=0x7f411c009060).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:43.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.591+0000 7f4124ff9700 1 -- 172.21.15.72:0/1282625380 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f411404a810 con 0x7f41280c6c30 2023-08-31T19:24:43.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.758+0000 7f412ebff700 1 -- 172.21.15.72:0/1282625380 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41280c63d0 con 0x7f410c05ef30 2023-08-31T19:24:43.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.771+0000 7f4124ff9700 1 -- 172.21.15.72:0/1282625380 <== mgr.8844 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361634 (secure 0 0 0) 0x7f41280c63d0 con 0x7f410c05ef30 2023-08-31T19:24:43.775 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:43.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.775+0000 7f412ebff700 1 -- 172.21.15.72:0/1282625380 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f410c05ef30 msgr2=0x7f410c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:43.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.775+0000 7f412ebff700 1 --2- 172.21.15.72:0/1282625380 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f410c05ef30 0x7f410c0613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f411c009c30 tx=0x7f411c009060).stop 2023-08-31T19:24:43.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.775+0000 7f412ebff700 1 -- 172.21.15.72:0/1282625380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41280c6c30 msgr2=0x7f412812bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:43.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.775+0000 7f412ebff700 1 --2- 172.21.15.72:0/1282625380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41280c6c30 0x7f412812bce0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f4114007fd0 tx=0x7f4114007c40).stop 2023-08-31T19:24:43.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.775+0000 7f412ebff700 1 -- 172.21.15.72:0/1282625380 shutdown_connections 2023-08-31T19:24:43.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.775+0000 7f412ebff700 1 --2- 172.21.15.72:0/1282625380 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f410c05ef30 0x7f410c0613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.775+0000 7f412ebff700 1 --2- 172.21.15.72:0/1282625380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41281583f0 0x7f4128138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.775+0000 7f412ebff700 1 --2- 172.21.15.72:0/1282625380 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f41280c4740 0x7f412813a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.775+0000 7f412ebff700 1 --2- 172.21.15.72:0/1282625380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41280c6c30 0x7f412812bce0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:43.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.776+0000 7f412ebff700 1 -- 172.21.15.72:0/1282625380 >> 172.21.15.72:0/1282625380 conn(0x7f41280c7e70 msgr2=0x7f4128157490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:43.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.776+0000 7f412ebff700 1 -- 172.21.15.72:0/1282625380 shutdown_connections 2023-08-31T19:24:43.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:43.776+0000 7f412ebff700 1 -- 172.21.15.72:0/1282625380 wait complete. 2023-08-31T19:24:43.781 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:24:43.793 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-31T19:24:43.607853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":244,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430812,"kb_used_data":17180,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752543908,"statfs":{"total":773094113280,"available":770604961792,"internally_reserved":0,"allocated":17592320,"data_stored":9502152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-592772,"num_objects":-6,"num_object_clones":0,"num_object_copies":-12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-170,"num_write_kb":-711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-34,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.215819"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.542558+0000","last_change":"2023-08-31T19:24:39.534134+0000","last_active":"2023-08-31T19:24:39.542558+0000","last_peered":"2023-08-31T19:24:39.542558+0000","last_clean":"2023-08-31T19:24:39.542558+0000","last_became_active":"2023-08-31T19:24:39.533837+0000","last_became_peered":"2023-08-31T19:24:39.533837+0000","last_unstale":"2023-08-31T19:24:39.542558+0000","last_undegraded":"2023-08-31T19:24:39.542558+0000","last_fullsized":"2023-08-31T19:24:39.542558+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"175'3","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.546739+0000","last_change":"2023-08-31T19:24:39.078488+0000","last_active":"2023-08-31T19:24:39.546739+0000","last_peered":"2023-08-31T19:24:39.546739+0000","last_clean":"2023-08-31T19:24:39.546739+0000","last_became_active":"2023-08-31T19:24:39.078143+0000","last_became_peered":"2023-08-31T19:24:39.078143+0000","last_unstale":"2023-08-31T19:24:39.546739+0000","last_undegraded":"2023-08-31T19:24:39.546739+0000","last_fullsized":"2023-08-31T19:24:39.546739+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.553109+0000","last_change":"2023-08-31T19:24:39.548508+0000","last_active":"2023-08-31T19:24:39.553109+0000","last_peered":"2023-08-31T19:24:39.553109+0000","last_clean":"2023-08-31T19:24:39.553109+0000","last_became_active":"2023-08-31T19:24:39.548208+0000","last_became_peered":"2023-08-31T19:24:39.548208+0000","last_unstale":"2023-08-31T19:24:39.553109+0000","last_undegraded":"2023-08-31T19:24:39.553109+0000","last_fullsized":"2023-08-31T19:24:39.553109+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.525036+0000","last_change":"2023-08-31T19:24:39.070804+0000","last_active":"2023-08-31T19:24:39.525036+0000","last_peered":"2023-08-31T19:24:39.525036+0000","last_clean":"2023-08-31T19:24:39.525036+0000","last_became_active":"2023-08-31T19:24:39.070524+0000","last_became_peered":"2023-08-31T19:24:39.070524+0000","last_unstale":"2023-08-31T19:24:39.525036+0000","last_undegraded":"2023-08-31T19:24:39.525036+0000","last_fullsized":"2023-08-31T19:24:39.525036+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.536926+0000","last_change":"2023-08-31T19:24:39.533979+0000","last_active":"2023-08-31T19:24:39.536926+0000","last_peered":"2023-08-31T19:24:39.536926+0000","last_clean":"2023-08-31T19:24:39.536926+0000","last_became_active":"2023-08-31T19:24:39.533685+0000","last_became_peered":"2023-08-31T19:24:39.533685+0000","last_unstale":"2023-08-31T19:24:39.536926+0000","last_undegraded":"2023-08-31T19:24:39.536926+0000","last_fullsized":"2023-08-31T19:24:39.536926+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.519790+0000","last_change":"2023-08-31T19:24:39.072722+0000","last_active":"2023-08-31T19:24:39.519790+0000","last_peered":"2023-08-31T19:24:39.519790+0000","last_clean":"2023-08-31T19:24:39.519790+0000","last_became_active":"2023-08-31T19:24:39.072324+0000","last_became_peered":"2023-08-31T19:24:39.072324+0000","last_unstale":"2023-08-31T19:24:39.519790+0000","last_undegraded":"2023-08-31T19:24:39.519790+0000","last_fullsized":"2023-08-31T19:24:39.519790+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545956+0000","last_change":"2023-08-31T19:24:39.536583+0000","last_active":"2023-08-31T19:24:39.545956+0000","last_peered":"2023-08-31T19:24:39.545956+0000","last_clean":"2023-08-31T19:24:39.545956+0000","last_became_active":"2023-08-31T19:24:39.535711+0000","last_became_peered":"2023-08-31T19:24:39.535711+0000","last_unstale":"2023-08-31T19:24:39.545956+0000","last_undegraded":"2023-08-31T19:24:39.545956+0000","last_fullsized":"2023-08-31T19:24:39.545956+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544442+0000","last_change":"2023-08-31T19:24:39.077060+0000","last_active":"2023-08-31T19:24:39.544442+0000","last_peered":"2023-08-31T19:24:39.544442+0000","last_clean":"2023-08-31T19:24:39.544442+0000","last_became_active":"2023-08-31T19:24:39.076769+0000","last_became_peered":"2023-08-31T19:24:39.076769+0000","last_unstale":"2023-08-31T19:24:39.544442+0000","last_undegraded":"2023-08-31T19:24:39.544442+0000","last_fullsized":"2023-08-31T19:24:39.544442+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.532753+0000","last_change":"2023-08-31T19:24:39.524331+0000","last_active":"2023-08-31T19:24:39.532753+0000","last_peered":"2023-08-31T19:24:39.532753+0000","last_clean":"2023-08-31T19:24:39.532753+0000","last_became_active":"2023-08-31T19:24:39.524011+0000","last_became_peered":"2023-08-31T19:24:39.524011+0000","last_unstale":"2023-08-31T19:24:39.532753+0000","last_undegraded":"2023-08-31T19:24:39.532753+0000","last_fullsized":"2023-08-31T19:24:39.532753+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544153+0000","last_change":"2023-08-31T19:24:39.081027+0000","last_active":"2023-08-31T19:24:39.544153+0000","last_peered":"2023-08-31T19:24:39.544153+0000","last_clean":"2023-08-31T19:24:39.544153+0000","last_became_active":"2023-08-31T19:24:39.080420+0000","last_became_peered":"2023-08-31T19:24:39.080420+0000","last_unstale":"2023-08-31T19:24:39.544153+0000","last_undegraded":"2023-08-31T19:24:39.544153+0000","last_fullsized":"2023-08-31T19:24:39.544153+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547417+0000","last_change":"2023-08-31T19:24:39.544372+0000","last_active":"2023-08-31T19:24:39.547417+0000","last_peered":"2023-08-31T19:24:39.547417+0000","last_clean":"2023-08-31T19:24:39.547417+0000","last_became_active":"2023-08-31T19:24:39.544058+0000","last_became_peered":"2023-08-31T19:24:39.544058+0000","last_unstale":"2023-08-31T19:24:39.547417+0000","last_undegraded":"2023-08-31T19:24:39.547417+0000","last_fullsized":"2023-08-31T19:24:39.547417+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.542952+0000","last_change":"2023-08-31T19:24:39.077455+0000","last_active":"2023-08-31T19:24:39.542952+0000","last_peered":"2023-08-31T19:24:39.542952+0000","last_clean":"2023-08-31T19:24:39.542952+0000","last_became_active":"2023-08-31T19:24:39.077187+0000","last_became_peered":"2023-08-31T19:24:39.077187+0000","last_unstale":"2023-08-31T19:24:39.542952+0000","last_undegraded":"2023-08-31T19:24:39.542952+0000","last_fullsized":"2023-08-31T19:24:39.542952+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.540388+0000","last_change":"2023-08-31T19:24:39.537388+0000","last_active":"2023-08-31T19:24:39.540388+0000","last_peered":"2023-08-31T19:24:39.540388+0000","last_clean":"2023-08-31T19:24:39.540388+0000","last_became_active":"2023-08-31T19:24:39.537119+0000","last_became_peered":"2023-08-31T19:24:39.537119+0000","last_unstale":"2023-08-31T19:24:39.540388+0000","last_undegraded":"2023-08-31T19:24:39.540388+0000","last_fullsized":"2023-08-31T19:24:39.540388+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.514763+0000","last_change":"2023-08-31T19:24:39.077851+0000","last_active":"2023-08-31T19:24:39.514763+0000","last_peered":"2023-08-31T19:24:39.514763+0000","last_clean":"2023-08-31T19:24:39.514763+0000","last_became_active":"2023-08-31T19:24:39.077515+0000","last_became_peered":"2023-08-31T19:24:39.077515+0000","last_unstale":"2023-08-31T19:24:39.514763+0000","last_undegraded":"2023-08-31T19:24:39.514763+0000","last_fullsized":"2023-08-31T19:24:39.514763+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545696+0000","last_change":"2023-08-31T19:24:39.540801+0000","last_active":"2023-08-31T19:24:39.545696+0000","last_peered":"2023-08-31T19:24:39.545696+0000","last_clean":"2023-08-31T19:24:39.545696+0000","last_became_active":"2023-08-31T19:24:39.540524+0000","last_became_peered":"2023-08-31T19:24:39.540524+0000","last_unstale":"2023-08-31T19:24:39.545696+0000","last_undegraded":"2023-08-31T19:24:39.545696+0000","last_fullsized":"2023-08-31T19:24:39.545696+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.526507+0000","last_change":"2023-08-31T19:24:39.080368+0000","last_active":"2023-08-31T19:24:39.526507+0000","last_peered":"2023-08-31T19:24:39.526507+0000","last_clean":"2023-08-31T19:24:39.526507+0000","last_became_active":"2023-08-31T19:24:39.080122+0000","last_became_peered":"2023-08-31T19:24:39.080122+0000","last_unstale":"2023-08-31T19:24:39.526507+0000","last_undegraded":"2023-08-31T19:24:39.526507+0000","last_fullsized":"2023-08-31T19:24:39.526507+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.542535+0000","last_change":"2023-08-31T19:24:39.532902+0000","last_active":"2023-08-31T19:24:39.542535+0000","last_peered":"2023-08-31T19:24:39.542535+0000","last_clean":"2023-08-31T19:24:39.542535+0000","last_became_active":"2023-08-31T19:24:39.532618+0000","last_became_peered":"2023-08-31T19:24:39.532618+0000","last_unstale":"2023-08-31T19:24:39.542535+0000","last_undegraded":"2023-08-31T19:24:39.542535+0000","last_fullsized":"2023-08-31T19:24:39.542535+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.525038+0000","last_change":"2023-08-31T19:24:39.077060+0000","last_active":"2023-08-31T19:24:39.525038+0000","last_peered":"2023-08-31T19:24:39.525038+0000","last_clean":"2023-08-31T19:24:39.525038+0000","last_became_active":"2023-08-31T19:24:39.076718+0000","last_became_peered":"2023-08-31T19:24:39.076718+0000","last_unstale":"2023-08-31T19:24:39.525038+0000","last_undegraded":"2023-08-31T19:24:39.525038+0000","last_fullsized":"2023-08-31T19:24:39.525038+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.548063+0000","last_change":"2023-08-31T19:24:39.545225+0000","last_active":"2023-08-31T19:24:39.548063+0000","last_peered":"2023-08-31T19:24:39.548063+0000","last_clean":"2023-08-31T19:24:39.548063+0000","last_became_active":"2023-08-31T19:24:39.544837+0000","last_became_peered":"2023-08-31T19:24:39.544837+0000","last_unstale":"2023-08-31T19:24:39.548063+0000","last_undegraded":"2023-08-31T19:24:39.548063+0000","last_fullsized":"2023-08-31T19:24:39.548063+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.527995+0000","last_change":"2023-08-31T19:24:39.079681+0000","last_active":"2023-08-31T19:24:39.527995+0000","last_peered":"2023-08-31T19:24:39.527995+0000","last_clean":"2023-08-31T19:24:39.527995+0000","last_became_active":"2023-08-31T19:24:39.079382+0000","last_became_peered":"2023-08-31T19:24:39.079382+0000","last_unstale":"2023-08-31T19:24:39.527995+0000","last_undegraded":"2023-08-31T19:24:39.527995+0000","last_fullsized":"2023-08-31T19:24:39.527995+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547092+0000","last_change":"2023-08-31T19:24:39.542074+0000","last_active":"2023-08-31T19:24:39.547092+0000","last_peered":"2023-08-31T19:24:39.547092+0000","last_clean":"2023-08-31T19:24:39.547092+0000","last_became_active":"2023-08-31T19:24:39.538188+0000","last_became_peered":"2023-08-31T19:24:39.538188+0000","last_unstale":"2023-08-31T19:24:39.547092+0000","last_undegraded":"2023-08-31T19:24:39.547092+0000","last_fullsized":"2023-08-31T19:24:39.547092+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.528513+0000","last_change":"2023-08-31T19:24:39.081923+0000","last_active":"2023-08-31T19:24:39.528513+0000","last_peered":"2023-08-31T19:24:39.528513+0000","last_clean":"2023-08-31T19:24:39.528513+0000","last_became_active":"2023-08-31T19:24:39.081646+0000","last_became_peered":"2023-08-31T19:24:39.081646+0000","last_unstale":"2023-08-31T19:24:39.528513+0000","last_undegraded":"2023-08-31T19:24:39.528513+0000","last_fullsized":"2023-08-31T19:24:39.528513+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547304+0000","last_change":"2023-08-31T19:24:39.545608+0000","last_active":"2023-08-31T19:24:39.547304+0000","last_peered":"2023-08-31T19:24:39.547304+0000","last_clean":"2023-08-31T19:24:39.547304+0000","last_became_active":"2023-08-31T19:24:39.545243+0000","last_became_peered":"2023-08-31T19:24:39.545243+0000","last_unstale":"2023-08-31T19:24:39.547304+0000","last_undegraded":"2023-08-31T19:24:39.547304+0000","last_fullsized":"2023-08-31T19:24:39.547304+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"175'4","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.552622+0000","last_change":"2023-08-31T19:24:39.080877+0000","last_active":"2023-08-31T19:24:39.552622+0000","last_peered":"2023-08-31T19:24:39.552622+0000","last_clean":"2023-08-31T19:24:39.552622+0000","last_became_active":"2023-08-31T19:24:39.080576+0000","last_became_peered":"2023-08-31T19:24:39.080576+0000","last_unstale":"2023-08-31T19:24:39.552622+0000","last_undegraded":"2023-08-31T19:24:39.552622+0000","last_fullsized":"2023-08-31T19:24:39.552622+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547169+0000","last_change":"2023-08-31T19:24:39.544789+0000","last_active":"2023-08-31T19:24:39.547169+0000","last_peered":"2023-08-31T19:24:39.547169+0000","last_clean":"2023-08-31T19:24:39.547169+0000","last_became_active":"2023-08-31T19:24:39.544478+0000","last_became_peered":"2023-08-31T19:24:39.544478+0000","last_unstale":"2023-08-31T19:24:39.547169+0000","last_undegraded":"2023-08-31T19:24:39.547169+0000","last_fullsized":"2023-08-31T19:24:39.547169+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544050+0000","last_change":"2023-08-31T19:24:39.081256+0000","last_active":"2023-08-31T19:24:39.544050+0000","last_peered":"2023-08-31T19:24:39.544050+0000","last_clean":"2023-08-31T19:24:39.544050+0000","last_became_active":"2023-08-31T19:24:39.080750+0000","last_became_peered":"2023-08-31T19:24:39.080750+0000","last_unstale":"2023-08-31T19:24:39.544050+0000","last_undegraded":"2023-08-31T19:24:39.544050+0000","last_fullsized":"2023-08-31T19:24:39.544050+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.540876+0000","last_change":"2023-08-31T19:24:39.536469+0000","last_active":"2023-08-31T19:24:39.540876+0000","last_peered":"2023-08-31T19:24:39.540876+0000","last_clean":"2023-08-31T19:24:39.540876+0000","last_became_active":"2023-08-31T19:24:39.535675+0000","last_became_peered":"2023-08-31T19:24:39.535675+0000","last_unstale":"2023-08-31T19:24:39.540876+0000","last_undegraded":"2023-08-31T19:24:39.540876+0000","last_fullsized":"2023-08-31T19:24:39.540876+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.517711+0000","last_change":"2023-08-31T19:24:39.078195+0000","last_active":"2023-08-31T19:24:39.517711+0000","last_peered":"2023-08-31T19:24:39.517711+0000","last_clean":"2023-08-31T19:24:39.517711+0000","last_became_active":"2023-08-31T19:24:39.077750+0000","last_became_peered":"2023-08-31T19:24:39.077750+0000","last_unstale":"2023-08-31T19:24:39.517711+0000","last_undegraded":"2023-08-31T19:24:39.517711+0000","last_fullsized":"2023-08-31T19:24:39.517711+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541301+0000","last_change":"2023-08-31T19:24:39.531487+0000","last_active":"2023-08-31T19:24:39.541301+0000","last_peered":"2023-08-31T19:24:39.541301+0000","last_clean":"2023-08-31T19:24:39.541301+0000","last_became_active":"2023-08-31T19:24:39.531196+0000","last_became_peered":"2023-08-31T19:24:39.531196+0000","last_unstale":"2023-08-31T19:24:39.541301+0000","last_undegraded":"2023-08-31T19:24:39.541301+0000","last_fullsized":"2023-08-31T19:24:39.541301+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.522059+0000","last_change":"2023-08-31T19:24:39.075542+0000","last_active":"2023-08-31T19:24:39.522059+0000","last_peered":"2023-08-31T19:24:39.522059+0000","last_clean":"2023-08-31T19:24:39.522059+0000","last_became_active":"2023-08-31T19:24:39.075220+0000","last_became_peered":"2023-08-31T19:24:39.075220+0000","last_unstale":"2023-08-31T19:24:39.522059+0000","last_undegraded":"2023-08-31T19:24:39.522059+0000","last_fullsized":"2023-08-31T19:24:39.522059+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.540886+0000","last_change":"2023-08-31T19:24:39.535814+0000","last_active":"2023-08-31T19:24:39.540886+0000","last_peered":"2023-08-31T19:24:39.540886+0000","last_clean":"2023-08-31T19:24:39.540886+0000","last_became_active":"2023-08-31T19:24:39.535565+0000","last_became_peered":"2023-08-31T19:24:39.535565+0000","last_unstale":"2023-08-31T19:24:39.540886+0000","last_undegraded":"2023-08-31T19:24:39.540886+0000","last_fullsized":"2023-08-31T19:24:39.540886+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"175'4","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.537204+0000","last_change":"2023-08-31T19:24:39.080104+0000","last_active":"2023-08-31T19:24:39.537204+0000","last_peered":"2023-08-31T19:24:39.537204+0000","last_clean":"2023-08-31T19:24:39.537204+0000","last_became_active":"2023-08-31T19:24:39.079817+0000","last_became_peered":"2023-08-31T19:24:39.079817+0000","last_unstale":"2023-08-31T19:24:39.537204+0000","last_undegraded":"2023-08-31T19:24:39.537204+0000","last_fullsized":"2023-08-31T19:24:39.537204+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.542817+0000","last_change":"2023-08-31T19:24:39.536923+0000","last_active":"2023-08-31T19:24:39.542817+0000","last_peered":"2023-08-31T19:24:39.542817+0000","last_clean":"2023-08-31T19:24:39.542817+0000","last_became_active":"2023-08-31T19:24:39.536655+0000","last_became_peered":"2023-08-31T19:24:39.536655+0000","last_unstale":"2023-08-31T19:24:39.542817+0000","last_undegraded":"2023-08-31T19:24:39.542817+0000","last_fullsized":"2023-08-31T19:24:39.542817+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.527425+0000","last_change":"2023-08-31T19:24:39.078857+0000","last_active":"2023-08-31T19:24:39.527425+0000","last_peered":"2023-08-31T19:24:39.527425+0000","last_clean":"2023-08-31T19:24:39.527425+0000","last_became_active":"2023-08-31T19:24:39.078234+0000","last_became_peered":"2023-08-31T19:24:39.078234+0000","last_unstale":"2023-08-31T19:24:39.527425+0000","last_undegraded":"2023-08-31T19:24:39.527425+0000","last_fullsized":"2023-08-31T19:24:39.527425+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.550249+0000","last_change":"2023-08-31T19:24:39.547632+0000","last_active":"2023-08-31T19:24:39.550249+0000","last_peered":"2023-08-31T19:24:39.550249+0000","last_clean":"2023-08-31T19:24:39.550249+0000","last_became_active":"2023-08-31T19:24:39.546985+0000","last_became_peered":"2023-08-31T19:24:39.546985+0000","last_unstale":"2023-08-31T19:24:39.550249+0000","last_undegraded":"2023-08-31T19:24:39.550249+0000","last_fullsized":"2023-08-31T19:24:39.550249+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.520005+0000","last_change":"2023-08-31T19:24:39.072194+0000","last_active":"2023-08-31T19:24:39.520005+0000","last_peered":"2023-08-31T19:24:39.520005+0000","last_clean":"2023-08-31T19:24:39.520005+0000","last_became_active":"2023-08-31T19:24:39.071852+0000","last_became_peered":"2023-08-31T19:24:39.071852+0000","last_unstale":"2023-08-31T19:24:39.520005+0000","last_undegraded":"2023-08-31T19:24:39.520005+0000","last_fullsized":"2023-08-31T19:24:39.520005+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544256+0000","last_change":"2023-08-31T19:24:39.538512+0000","last_active":"2023-08-31T19:24:39.544256+0000","last_peered":"2023-08-31T19:24:39.544256+0000","last_clean":"2023-08-31T19:24:39.544256+0000","last_became_active":"2023-08-31T19:24:39.538070+0000","last_became_peered":"2023-08-31T19:24:39.538070+0000","last_unstale":"2023-08-31T19:24:39.544256+0000","last_undegraded":"2023-08-31T19:24:39.544256+0000","last_fullsized":"2023-08-31T19:24:39.544256+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.538099+0000","last_change":"2023-08-31T19:24:39.074512+0000","last_active":"2023-08-31T19:24:39.538099+0000","last_peered":"2023-08-31T19:24:39.538099+0000","last_clean":"2023-08-31T19:24:39.538099+0000","last_became_active":"2023-08-31T19:24:39.074214+0000","last_became_peered":"2023-08-31T19:24:39.074214+0000","last_unstale":"2023-08-31T19:24:39.538099+0000","last_undegraded":"2023-08-31T19:24:39.538099+0000","last_fullsized":"2023-08-31T19:24:39.538099+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.540763+0000","last_change":"2023-08-31T19:24:39.528653+0000","last_active":"2023-08-31T19:24:39.540763+0000","last_peered":"2023-08-31T19:24:39.540763+0000","last_clean":"2023-08-31T19:24:39.540763+0000","last_became_active":"2023-08-31T19:24:39.528361+0000","last_became_peered":"2023-08-31T19:24:39.528361+0000","last_unstale":"2023-08-31T19:24:39.540763+0000","last_undegraded":"2023-08-31T19:24:39.540763+0000","last_fullsized":"2023-08-31T19:24:39.540763+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.518566+0000","last_change":"2023-08-31T19:24:39.071523+0000","last_active":"2023-08-31T19:24:39.518566+0000","last_peered":"2023-08-31T19:24:39.518566+0000","last_clean":"2023-08-31T19:24:39.518566+0000","last_became_active":"2023-08-31T19:24:39.071267+0000","last_became_peered":"2023-08-31T19:24:39.071267+0000","last_unstale":"2023-08-31T19:24:39.518566+0000","last_undegraded":"2023-08-31T19:24:39.518566+0000","last_fullsized":"2023-08-31T19:24:39.518566+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.537716+0000","last_change":"2023-08-31T19:24:39.532454+0000","last_active":"2023-08-31T19:24:39.537716+0000","last_peered":"2023-08-31T19:24:39.537716+0000","last_clean":"2023-08-31T19:24:39.537716+0000","last_became_active":"2023-08-31T19:24:39.532199+0000","last_became_peered":"2023-08-31T19:24:39.532199+0000","last_unstale":"2023-08-31T19:24:39.537716+0000","last_undegraded":"2023-08-31T19:24:39.537716+0000","last_fullsized":"2023-08-31T19:24:39.537716+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545281+0000","last_change":"2023-08-31T19:24:39.079711+0000","last_active":"2023-08-31T19:24:39.545281+0000","last_peered":"2023-08-31T19:24:39.545281+0000","last_clean":"2023-08-31T19:24:39.545281+0000","last_became_active":"2023-08-31T19:24:39.079431+0000","last_became_peered":"2023-08-31T19:24:39.079431+0000","last_unstale":"2023-08-31T19:24:39.545281+0000","last_undegraded":"2023-08-31T19:24:39.545281+0000","last_fullsized":"2023-08-31T19:24:39.545281+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.543255+0000","last_change":"2023-08-31T19:24:39.537784+0000","last_active":"2023-08-31T19:24:39.543255+0000","last_peered":"2023-08-31T19:24:39.543255+0000","last_clean":"2023-08-31T19:24:39.543255+0000","last_became_active":"2023-08-31T19:24:39.537444+0000","last_became_peered":"2023-08-31T19:24:39.537444+0000","last_unstale":"2023-08-31T19:24:39.543255+0000","last_undegraded":"2023-08-31T19:24:39.543255+0000","last_fullsized":"2023-08-31T19:24:39.543255+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.517758+0000","last_change":"2023-08-31T19:24:39.078027+0000","last_active":"2023-08-31T19:24:39.517758+0000","last_peered":"2023-08-31T19:24:39.517758+0000","last_clean":"2023-08-31T19:24:39.517758+0000","last_became_active":"2023-08-31T19:24:39.077361+0000","last_became_peered":"2023-08-31T19:24:39.077361+0000","last_unstale":"2023-08-31T19:24:39.517758+0000","last_undegraded":"2023-08-31T19:24:39.517758+0000","last_fullsized":"2023-08-31T19:24:39.517758+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545717+0000","last_change":"2023-08-31T19:24:39.539022+0000","last_active":"2023-08-31T19:24:39.545717+0000","last_peered":"2023-08-31T19:24:39.545717+0000","last_clean":"2023-08-31T19:24:39.545717+0000","last_became_active":"2023-08-31T19:24:39.538738+0000","last_became_peered":"2023-08-31T19:24:39.538738+0000","last_unstale":"2023-08-31T19:24:39.545717+0000","last_undegraded":"2023-08-31T19:24:39.545717+0000","last_fullsized":"2023-08-31T19:24:39.545717+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.517329+0000","last_change":"2023-08-31T19:24:39.070708+0000","last_active":"2023-08-31T19:24:39.517329+0000","last_peered":"2023-08-31T19:24:39.517329+0000","last_clean":"2023-08-31T19:24:39.517329+0000","last_became_active":"2023-08-31T19:24:39.070224+0000","last_became_peered":"2023-08-31T19:24:39.070224+0000","last_unstale":"2023-08-31T19:24:39.517329+0000","last_undegraded":"2023-08-31T19:24:39.517329+0000","last_fullsized":"2023-08-31T19:24:39.517329+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547110+0000","last_change":"2023-08-31T19:24:39.544113+0000","last_active":"2023-08-31T19:24:39.547110+0000","last_peered":"2023-08-31T19:24:39.547110+0000","last_clean":"2023-08-31T19:24:39.547110+0000","last_became_active":"2023-08-31T19:24:39.543812+0000","last_became_peered":"2023-08-31T19:24:39.543812+0000","last_unstale":"2023-08-31T19:24:39.547110+0000","last_undegraded":"2023-08-31T19:24:39.547110+0000","last_fullsized":"2023-08-31T19:24:39.547110+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.522210+0000","last_change":"2023-08-31T19:24:39.080460+0000","last_active":"2023-08-31T19:24:39.522210+0000","last_peered":"2023-08-31T19:24:39.522210+0000","last_clean":"2023-08-31T19:24:39.522210+0000","last_became_active":"2023-08-31T19:24:39.080103+0000","last_became_peered":"2023-08-31T19:24:39.080103+0000","last_unstale":"2023-08-31T19:24:39.522210+0000","last_undegraded":"2023-08-31T19:24:39.522210+0000","last_fullsized":"2023-08-31T19:24:39.522210+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.532151+0000","last_change":"2023-08-31T19:24:39.527860+0000","last_active":"2023-08-31T19:24:39.532151+0000","last_peered":"2023-08-31T19:24:39.532151+0000","last_clean":"2023-08-31T19:24:39.532151+0000","last_became_active":"2023-08-31T19:24:39.527587+0000","last_became_peered":"2023-08-31T19:24:39.527587+0000","last_unstale":"2023-08-31T19:24:39.532151+0000","last_undegraded":"2023-08-31T19:24:39.532151+0000","last_fullsized":"2023-08-31T19:24:39.532151+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.520246+0000","last_change":"2023-08-31T19:24:39.076682+0000","last_active":"2023-08-31T19:24:39.520246+0000","last_peered":"2023-08-31T19:24:39.520246+0000","last_clean":"2023-08-31T19:24:39.520246+0000","last_became_active":"2023-08-31T19:24:39.076411+0000","last_became_peered":"2023-08-31T19:24:39.076411+0000","last_unstale":"2023-08-31T19:24:39.520246+0000","last_undegraded":"2023-08-31T19:24:39.520246+0000","last_fullsized":"2023-08-31T19:24:39.520246+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547159+0000","last_change":"2023-08-31T19:24:39.544480+0000","last_active":"2023-08-31T19:24:39.547159+0000","last_peered":"2023-08-31T19:24:39.547159+0000","last_clean":"2023-08-31T19:24:39.547159+0000","last_became_active":"2023-08-31T19:24:39.544184+0000","last_became_peered":"2023-08-31T19:24:39.544184+0000","last_unstale":"2023-08-31T19:24:39.547159+0000","last_undegraded":"2023-08-31T19:24:39.547159+0000","last_fullsized":"2023-08-31T19:24:39.547159+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.525305+0000","last_change":"2023-08-31T19:24:39.073478+0000","last_active":"2023-08-31T19:24:39.525305+0000","last_peered":"2023-08-31T19:24:39.525305+0000","last_clean":"2023-08-31T19:24:39.525305+0000","last_became_active":"2023-08-31T19:24:39.073192+0000","last_became_peered":"2023-08-31T19:24:39.073192+0000","last_unstale":"2023-08-31T19:24:39.525305+0000","last_undegraded":"2023-08-31T19:24:39.525305+0000","last_fullsized":"2023-08-31T19:24:39.525305+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545598+0000","last_change":"2023-08-31T19:24:39.535344+0000","last_active":"2023-08-31T19:24:39.545598+0000","last_peered":"2023-08-31T19:24:39.545598+0000","last_clean":"2023-08-31T19:24:39.545598+0000","last_became_active":"2023-08-31T19:24:39.534535+0000","last_became_peered":"2023-08-31T19:24:39.534535+0000","last_unstale":"2023-08-31T19:24:39.545598+0000","last_undegraded":"2023-08-31T19:24:39.545598+0000","last_fullsized":"2023-08-31T19:24:39.545598+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.518938+0000","last_change":"2023-08-31T19:24:39.069662+0000","last_active":"2023-08-31T19:24:39.518938+0000","last_peered":"2023-08-31T19:24:39.518938+0000","last_clean":"2023-08-31T19:24:39.518938+0000","last_became_active":"2023-08-31T19:24:39.069381+0000","last_became_peered":"2023-08-31T19:24:39.069381+0000","last_unstale":"2023-08-31T19:24:39.518938+0000","last_undegraded":"2023-08-31T19:24:39.518938+0000","last_fullsized":"2023-08-31T19:24:39.518938+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545925+0000","last_change":"2023-08-31T19:24:39.537282+0000","last_active":"2023-08-31T19:24:39.545925+0000","last_peered":"2023-08-31T19:24:39.545925+0000","last_clean":"2023-08-31T19:24:39.545925+0000","last_became_active":"2023-08-31T19:24:39.536968+0000","last_became_peered":"2023-08-31T19:24:39.536968+0000","last_unstale":"2023-08-31T19:24:39.545925+0000","last_undegraded":"2023-08-31T19:24:39.545925+0000","last_fullsized":"2023-08-31T19:24:39.545925+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.515777+0000","last_change":"2023-08-31T19:24:39.064255+0000","last_active":"2023-08-31T19:24:39.515777+0000","last_peered":"2023-08-31T19:24:39.515777+0000","last_clean":"2023-08-31T19:24:39.515777+0000","last_became_active":"2023-08-31T19:24:39.063912+0000","last_became_peered":"2023-08-31T19:24:39.063912+0000","last_unstale":"2023-08-31T19:24:39.515777+0000","last_undegraded":"2023-08-31T19:24:39.515777+0000","last_fullsized":"2023-08-31T19:24:39.515777+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541834+0000","last_change":"2023-08-31T19:24:39.531912+0000","last_active":"2023-08-31T19:24:39.541834+0000","last_peered":"2023-08-31T19:24:39.541834+0000","last_clean":"2023-08-31T19:24:39.541834+0000","last_became_active":"2023-08-31T19:24:39.531579+0000","last_became_peered":"2023-08-31T19:24:39.531579+0000","last_unstale":"2023-08-31T19:24:39.541834+0000","last_undegraded":"2023-08-31T19:24:39.541834+0000","last_fullsized":"2023-08-31T19:24:39.541834+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.526547+0000","last_change":"2023-08-31T19:24:39.079204+0000","last_active":"2023-08-31T19:24:39.526547+0000","last_peered":"2023-08-31T19:24:39.526547+0000","last_clean":"2023-08-31T19:24:39.526547+0000","last_became_active":"2023-08-31T19:24:39.078874+0000","last_became_peered":"2023-08-31T19:24:39.078874+0000","last_unstale":"2023-08-31T19:24:39.526547+0000","last_undegraded":"2023-08-31T19:24:39.526547+0000","last_fullsized":"2023-08-31T19:24:39.526547+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547045+0000","last_change":"2023-08-31T19:24:39.544457+0000","last_active":"2023-08-31T19:24:39.547045+0000","last_peered":"2023-08-31T19:24:39.547045+0000","last_clean":"2023-08-31T19:24:39.547045+0000","last_became_active":"2023-08-31T19:24:39.544053+0000","last_became_peered":"2023-08-31T19:24:39.544053+0000","last_unstale":"2023-08-31T19:24:39.547045+0000","last_undegraded":"2023-08-31T19:24:39.547045+0000","last_fullsized":"2023-08-31T19:24:39.547045+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.517828+0000","last_change":"2023-08-31T19:24:39.079722+0000","last_active":"2023-08-31T19:24:39.517828+0000","last_peered":"2023-08-31T19:24:39.517828+0000","last_clean":"2023-08-31T19:24:39.517828+0000","last_became_active":"2023-08-31T19:24:39.079278+0000","last_became_peered":"2023-08-31T19:24:39.079278+0000","last_unstale":"2023-08-31T19:24:39.517828+0000","last_undegraded":"2023-08-31T19:24:39.517828+0000","last_fullsized":"2023-08-31T19:24:39.517828+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.537534+0000","last_change":"2023-08-31T19:24:39.531728+0000","last_active":"2023-08-31T19:24:39.537534+0000","last_peered":"2023-08-31T19:24:39.537534+0000","last_clean":"2023-08-31T19:24:39.537534+0000","last_became_active":"2023-08-31T19:24:39.531437+0000","last_became_peered":"2023-08-31T19:24:39.531437+0000","last_unstale":"2023-08-31T19:24:39.537534+0000","last_undegraded":"2023-08-31T19:24:39.537534+0000","last_fullsized":"2023-08-31T19:24:39.537534+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.523592+0000","last_change":"2023-08-31T19:24:39.078227+0000","last_active":"2023-08-31T19:24:39.523592+0000","last_peered":"2023-08-31T19:24:39.523592+0000","last_clean":"2023-08-31T19:24:39.523592+0000","last_became_active":"2023-08-31T19:24:39.077943+0000","last_became_peered":"2023-08-31T19:24:39.077943+0000","last_unstale":"2023-08-31T19:24:39.523592+0000","last_undegraded":"2023-08-31T19:24:39.523592+0000","last_fullsized":"2023-08-31T19:24:39.523592+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.543218+0000","last_change":"2023-08-31T19:24:39.534824+0000","last_active":"2023-08-31T19:24:39.543218+0000","last_peered":"2023-08-31T19:24:39.543218+0000","last_clean":"2023-08-31T19:24:39.543218+0000","last_became_active":"2023-08-31T19:24:39.533894+0000","last_became_peered":"2023-08-31T19:24:39.533894+0000","last_unstale":"2023-08-31T19:24:39.543218+0000","last_undegraded":"2023-08-31T19:24:39.543218+0000","last_fullsized":"2023-08-31T19:24:39.543218+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.518219+0000","last_change":"2023-08-31T19:24:39.083110+0000","last_active":"2023-08-31T19:24:39.518219+0000","last_peered":"2023-08-31T19:24:39.518219+0000","last_clean":"2023-08-31T19:24:39.518219+0000","last_became_active":"2023-08-31T19:24:39.082824+0000","last_became_peered":"2023-08-31T19:24:39.082824+0000","last_unstale":"2023-08-31T19:24:39.518219+0000","last_undegraded":"2023-08-31T19:24:39.518219+0000","last_fullsized":"2023-08-31T19:24:39.518219+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547923+0000","last_change":"2023-08-31T19:24:39.543278+0000","last_active":"2023-08-31T19:24:39.547923+0000","last_peered":"2023-08-31T19:24:39.547923+0000","last_clean":"2023-08-31T19:24:39.547923+0000","last_became_active":"2023-08-31T19:24:39.542978+0000","last_became_peered":"2023-08-31T19:24:39.542978+0000","last_unstale":"2023-08-31T19:24:39.547923+0000","last_undegraded":"2023-08-31T19:24:39.547923+0000","last_fullsized":"2023-08-31T19:24:39.547923+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.536274+0000","last_change":"2023-08-31T19:24:39.071451+0000","last_active":"2023-08-31T19:24:39.536274+0000","last_peered":"2023-08-31T19:24:39.536274+0000","last_clean":"2023-08-31T19:24:39.536274+0000","last_became_active":"2023-08-31T19:24:39.070810+0000","last_became_peered":"2023-08-31T19:24:39.070810+0000","last_unstale":"2023-08-31T19:24:39.536274+0000","last_undegraded":"2023-08-31T19:24:39.536274+0000","last_fullsized":"2023-08-31T19:24:39.536274+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.548394+0000","last_change":"2023-08-31T19:24:39.543626+0000","last_active":"2023-08-31T19:24:39.548394+0000","last_peered":"2023-08-31T19:24:39.548394+0000","last_clean":"2023-08-31T19:24:39.548394+0000","last_became_active":"2023-08-31T19:24:39.543253+0000","last_became_peered":"2023-08-31T19:24:39.543253+0000","last_unstale":"2023-08-31T19:24:39.548394+0000","last_undegraded":"2023-08-31T19:24:39.548394+0000","last_fullsized":"2023-08-31T19:24:39.548394+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.542919+0000","last_change":"2023-08-31T19:24:39.084146+0000","last_active":"2023-08-31T19:24:39.542919+0000","last_peered":"2023-08-31T19:24:39.542919+0000","last_clean":"2023-08-31T19:24:39.542919+0000","last_became_active":"2023-08-31T19:24:39.083799+0000","last_became_peered":"2023-08-31T19:24:39.083799+0000","last_unstale":"2023-08-31T19:24:39.542919+0000","last_undegraded":"2023-08-31T19:24:39.542919+0000","last_fullsized":"2023-08-31T19:24:39.542919+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.542671+0000","last_change":"2023-08-31T19:24:39.530176+0000","last_active":"2023-08-31T19:24:39.542671+0000","last_peered":"2023-08-31T19:24:39.542671+0000","last_clean":"2023-08-31T19:24:39.542671+0000","last_became_active":"2023-08-31T19:24:39.529875+0000","last_became_peered":"2023-08-31T19:24:39.529875+0000","last_unstale":"2023-08-31T19:24:39.542671+0000","last_undegraded":"2023-08-31T19:24:39.542671+0000","last_fullsized":"2023-08-31T19:24:39.542671+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.548627+0000","last_change":"2023-08-31T19:24:39.084630+0000","last_active":"2023-08-31T19:24:39.548627+0000","last_peered":"2023-08-31T19:24:39.548627+0000","last_clean":"2023-08-31T19:24:39.548627+0000","last_became_active":"2023-08-31T19:24:39.084328+0000","last_became_peered":"2023-08-31T19:24:39.084328+0000","last_unstale":"2023-08-31T19:24:39.548627+0000","last_undegraded":"2023-08-31T19:24:39.548627+0000","last_fullsized":"2023-08-31T19:24:39.548627+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.546526+0000","last_change":"2023-08-31T19:24:39.544190+0000","last_active":"2023-08-31T19:24:39.546526+0000","last_peered":"2023-08-31T19:24:39.546526+0000","last_clean":"2023-08-31T19:24:39.546526+0000","last_became_active":"2023-08-31T19:24:39.543529+0000","last_became_peered":"2023-08-31T19:24:39.543529+0000","last_unstale":"2023-08-31T19:24:39.546526+0000","last_undegraded":"2023-08-31T19:24:39.546526+0000","last_fullsized":"2023-08-31T19:24:39.546526+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.528261+0000","last_change":"2023-08-31T19:24:39.079588+0000","last_active":"2023-08-31T19:24:39.528261+0000","last_peered":"2023-08-31T19:24:39.528261+0000","last_clean":"2023-08-31T19:24:39.528261+0000","last_became_active":"2023-08-31T19:24:39.079305+0000","last_became_peered":"2023-08-31T19:24:39.079305+0000","last_unstale":"2023-08-31T19:24:39.528261+0000","last_undegraded":"2023-08-31T19:24:39.528261+0000","last_fullsized":"2023-08-31T19:24:39.528261+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.531562+0000","last_change":"2023-08-31T19:24:39.522594+0000","last_active":"2023-08-31T19:24:39.531562+0000","last_peered":"2023-08-31T19:24:39.531562+0000","last_clean":"2023-08-31T19:24:39.531562+0000","last_became_active":"2023-08-31T19:24:39.522310+0000","last_became_peered":"2023-08-31T19:24:39.522310+0000","last_unstale":"2023-08-31T19:24:39.531562+0000","last_undegraded":"2023-08-31T19:24:39.531562+0000","last_fullsized":"2023-08-31T19:24:39.531562+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.517653+0000","last_change":"2023-08-31T19:24:39.077713+0000","last_active":"2023-08-31T19:24:39.517653+0000","last_peered":"2023-08-31T19:24:39.517653+0000","last_clean":"2023-08-31T19:24:39.517653+0000","last_became_active":"2023-08-31T19:24:39.077338+0000","last_became_peered":"2023-08-31T19:24:39.077338+0000","last_unstale":"2023-08-31T19:24:39.517653+0000","last_undegraded":"2023-08-31T19:24:39.517653+0000","last_fullsized":"2023-08-31T19:24:39.517653+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.542601+0000","last_change":"2023-08-31T19:24:39.539204+0000","last_active":"2023-08-31T19:24:39.542601+0000","last_peered":"2023-08-31T19:24:39.542601+0000","last_clean":"2023-08-31T19:24:39.542601+0000","last_became_active":"2023-08-31T19:24:39.538461+0000","last_became_peered":"2023-08-31T19:24:39.538461+0000","last_unstale":"2023-08-31T19:24:39.542601+0000","last_undegraded":"2023-08-31T19:24:39.542601+0000","last_fullsized":"2023-08-31T19:24:39.542601+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.525356+0000","last_change":"2023-08-31T19:24:39.081932+0000","last_active":"2023-08-31T19:24:39.525356+0000","last_peered":"2023-08-31T19:24:39.525356+0000","last_clean":"2023-08-31T19:24:39.525356+0000","last_became_active":"2023-08-31T19:24:39.081648+0000","last_became_peered":"2023-08-31T19:24:39.081648+0000","last_unstale":"2023-08-31T19:24:39.525356+0000","last_undegraded":"2023-08-31T19:24:39.525356+0000","last_fullsized":"2023-08-31T19:24:39.525356+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.540843+0000","last_change":"2023-08-31T19:24:39.536305+0000","last_active":"2023-08-31T19:24:39.540843+0000","last_peered":"2023-08-31T19:24:39.540843+0000","last_clean":"2023-08-31T19:24:39.540843+0000","last_became_active":"2023-08-31T19:24:39.536046+0000","last_became_peered":"2023-08-31T19:24:39.536046+0000","last_unstale":"2023-08-31T19:24:39.540843+0000","last_undegraded":"2023-08-31T19:24:39.540843+0000","last_fullsized":"2023-08-31T19:24:39.540843+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.521763+0000","last_change":"2023-08-31T19:24:39.078602+0000","last_active":"2023-08-31T19:24:39.521763+0000","last_peered":"2023-08-31T19:24:39.521763+0000","last_clean":"2023-08-31T19:24:39.521763+0000","last_became_active":"2023-08-31T19:24:39.078237+0000","last_became_peered":"2023-08-31T19:24:39.078237+0000","last_unstale":"2023-08-31T19:24:39.521763+0000","last_undegraded":"2023-08-31T19:24:39.521763+0000","last_fullsized":"2023-08-31T19:24:39.521763+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545735+0000","last_change":"2023-08-31T19:24:39.537274+0000","last_active":"2023-08-31T19:24:39.545735+0000","last_peered":"2023-08-31T19:24:39.545735+0000","last_clean":"2023-08-31T19:24:39.545735+0000","last_became_active":"2023-08-31T19:24:39.536961+0000","last_became_peered":"2023-08-31T19:24:39.536961+0000","last_unstale":"2023-08-31T19:24:39.545735+0000","last_undegraded":"2023-08-31T19:24:39.545735+0000","last_fullsized":"2023-08-31T19:24:39.545735+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.523830+0000","last_change":"2023-08-31T19:24:39.084396+0000","last_active":"2023-08-31T19:24:39.523830+0000","last_peered":"2023-08-31T19:24:39.523830+0000","last_clean":"2023-08-31T19:24:39.523830+0000","last_became_active":"2023-08-31T19:24:39.084041+0000","last_became_peered":"2023-08-31T19:24:39.084041+0000","last_unstale":"2023-08-31T19:24:39.523830+0000","last_undegraded":"2023-08-31T19:24:39.523830+0000","last_fullsized":"2023-08-31T19:24:39.523830+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.546249+0000","last_change":"2023-08-31T19:24:39.542749+0000","last_active":"2023-08-31T19:24:39.546249+0000","last_peered":"2023-08-31T19:24:39.546249+0000","last_clean":"2023-08-31T19:24:39.546249+0000","last_became_active":"2023-08-31T19:24:39.542457+0000","last_became_peered":"2023-08-31T19:24:39.542457+0000","last_unstale":"2023-08-31T19:24:39.546249+0000","last_undegraded":"2023-08-31T19:24:39.546249+0000","last_fullsized":"2023-08-31T19:24:39.546249+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544797+0000","last_change":"2023-08-31T19:24:39.079220+0000","last_active":"2023-08-31T19:24:39.544797+0000","last_peered":"2023-08-31T19:24:39.544797+0000","last_clean":"2023-08-31T19:24:39.544797+0000","last_became_active":"2023-08-31T19:24:39.078945+0000","last_became_peered":"2023-08-31T19:24:39.078945+0000","last_unstale":"2023-08-31T19:24:39.544797+0000","last_undegraded":"2023-08-31T19:24:39.544797+0000","last_fullsized":"2023-08-31T19:24:39.544797+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.550227+0000","last_change":"2023-08-31T19:24:39.547295+0000","last_active":"2023-08-31T19:24:39.550227+0000","last_peered":"2023-08-31T19:24:39.550227+0000","last_clean":"2023-08-31T19:24:39.550227+0000","last_became_active":"2023-08-31T19:24:39.546518+0000","last_became_peered":"2023-08-31T19:24:39.546518+0000","last_unstale":"2023-08-31T19:24:39.550227+0000","last_undegraded":"2023-08-31T19:24:39.550227+0000","last_fullsized":"2023-08-31T19:24:39.550227+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544015+0000","last_change":"2023-08-31T19:24:39.075401+0000","last_active":"2023-08-31T19:24:39.544015+0000","last_peered":"2023-08-31T19:24:39.544015+0000","last_clean":"2023-08-31T19:24:39.544015+0000","last_became_active":"2023-08-31T19:24:39.075097+0000","last_became_peered":"2023-08-31T19:24:39.075097+0000","last_unstale":"2023-08-31T19:24:39.544015+0000","last_undegraded":"2023-08-31T19:24:39.544015+0000","last_fullsized":"2023-08-31T19:24:39.544015+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545617+0000","last_change":"2023-08-31T19:24:39.536322+0000","last_active":"2023-08-31T19:24:39.545617+0000","last_peered":"2023-08-31T19:24:39.545617+0000","last_clean":"2023-08-31T19:24:39.545617+0000","last_became_active":"2023-08-31T19:24:39.534924+0000","last_became_peered":"2023-08-31T19:24:39.534924+0000","last_unstale":"2023-08-31T19:24:39.545617+0000","last_undegraded":"2023-08-31T19:24:39.545617+0000","last_fullsized":"2023-08-31T19:24:39.545617+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.528730+0000","last_change":"2023-08-31T19:24:39.079450+0000","last_active":"2023-08-31T19:24:39.528730+0000","last_peered":"2023-08-31T19:24:39.528730+0000","last_clean":"2023-08-31T19:24:39.528730+0000","last_became_active":"2023-08-31T19:24:39.078855+0000","last_became_peered":"2023-08-31T19:24:39.078855+0000","last_unstale":"2023-08-31T19:24:39.528730+0000","last_undegraded":"2023-08-31T19:24:39.528730+0000","last_fullsized":"2023-08-31T19:24:39.528730+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545905+0000","last_change":"2023-08-31T19:24:39.536356+0000","last_active":"2023-08-31T19:24:39.545905+0000","last_peered":"2023-08-31T19:24:39.545905+0000","last_clean":"2023-08-31T19:24:39.545905+0000","last_became_active":"2023-08-31T19:24:39.535392+0000","last_became_peered":"2023-08-31T19:24:39.535392+0000","last_unstale":"2023-08-31T19:24:39.545905+0000","last_undegraded":"2023-08-31T19:24:39.545905+0000","last_fullsized":"2023-08-31T19:24:39.545905+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.519549+0000","last_change":"2023-08-31T19:24:39.077349+0000","last_active":"2023-08-31T19:24:39.519549+0000","last_peered":"2023-08-31T19:24:39.519549+0000","last_clean":"2023-08-31T19:24:39.519549+0000","last_became_active":"2023-08-31T19:24:39.077046+0000","last_became_peered":"2023-08-31T19:24:39.077046+0000","last_unstale":"2023-08-31T19:24:39.519549+0000","last_undegraded":"2023-08-31T19:24:39.519549+0000","last_fullsized":"2023-08-31T19:24:39.519549+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544822+0000","last_change":"2023-08-31T19:24:39.537611+0000","last_active":"2023-08-31T19:24:39.544822+0000","last_peered":"2023-08-31T19:24:39.544822+0000","last_clean":"2023-08-31T19:24:39.544822+0000","last_became_active":"2023-08-31T19:24:39.537306+0000","last_became_peered":"2023-08-31T19:24:39.537306+0000","last_unstale":"2023-08-31T19:24:39.544822+0000","last_undegraded":"2023-08-31T19:24:39.544822+0000","last_fullsized":"2023-08-31T19:24:39.544822+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.535211+0000","last_change":"2023-08-31T19:24:39.078200+0000","last_active":"2023-08-31T19:24:39.535211+0000","last_peered":"2023-08-31T19:24:39.535211+0000","last_clean":"2023-08-31T19:24:39.535211+0000","last_became_active":"2023-08-31T19:24:39.077905+0000","last_became_peered":"2023-08-31T19:24:39.077905+0000","last_unstale":"2023-08-31T19:24:39.535211+0000","last_undegraded":"2023-08-31T19:24:39.535211+0000","last_fullsized":"2023-08-31T19:24:39.535211+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.543525+0000","last_change":"2023-08-31T19:24:39.539629+0000","last_active":"2023-08-31T19:24:39.543525+0000","last_peered":"2023-08-31T19:24:39.543525+0000","last_clean":"2023-08-31T19:24:39.543525+0000","last_became_active":"2023-08-31T19:24:39.539354+0000","last_became_peered":"2023-08-31T19:24:39.539354+0000","last_unstale":"2023-08-31T19:24:39.543525+0000","last_undegraded":"2023-08-31T19:24:39.543525+0000","last_fullsized":"2023-08-31T19:24:39.543525+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.517856+0000","last_change":"2023-08-31T19:24:39.079547+0000","last_active":"2023-08-31T19:24:39.517856+0000","last_peered":"2023-08-31T19:24:39.517856+0000","last_clean":"2023-08-31T19:24:39.517856+0000","last_became_active":"2023-08-31T19:24:39.078919+0000","last_became_peered":"2023-08-31T19:24:39.078919+0000","last_unstale":"2023-08-31T19:24:39.517856+0000","last_undegraded":"2023-08-31T19:24:39.517856+0000","last_fullsized":"2023-08-31T19:24:39.517856+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.546247+0000","last_change":"2023-08-31T19:24:39.542793+0000","last_active":"2023-08-31T19:24:39.546247+0000","last_peered":"2023-08-31T19:24:39.546247+0000","last_clean":"2023-08-31T19:24:39.546247+0000","last_became_active":"2023-08-31T19:24:39.542490+0000","last_became_peered":"2023-08-31T19:24:39.542490+0000","last_unstale":"2023-08-31T19:24:39.546247+0000","last_undegraded":"2023-08-31T19:24:39.546247+0000","last_fullsized":"2023-08-31T19:24:39.546247+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.514858+0000","last_change":"2023-08-31T19:24:39.066792+0000","last_active":"2023-08-31T19:24:39.514858+0000","last_peered":"2023-08-31T19:24:39.514858+0000","last_clean":"2023-08-31T19:24:39.514858+0000","last_became_active":"2023-08-31T19:24:39.066482+0000","last_became_peered":"2023-08-31T19:24:39.066482+0000","last_unstale":"2023-08-31T19:24:39.514858+0000","last_undegraded":"2023-08-31T19:24:39.514858+0000","last_fullsized":"2023-08-31T19:24:39.514858+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547886+0000","last_change":"2023-08-31T19:24:39.543306+0000","last_active":"2023-08-31T19:24:39.547886+0000","last_peered":"2023-08-31T19:24:39.547886+0000","last_clean":"2023-08-31T19:24:39.547886+0000","last_became_active":"2023-08-31T19:24:39.543080+0000","last_became_peered":"2023-08-31T19:24:39.543080+0000","last_unstale":"2023-08-31T19:24:39.547886+0000","last_undegraded":"2023-08-31T19:24:39.547886+0000","last_fullsized":"2023-08-31T19:24:39.547886+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.517329+0000","last_change":"2023-08-31T19:24:39.071323+0000","last_active":"2023-08-31T19:24:39.517329+0000","last_peered":"2023-08-31T19:24:39.517329+0000","last_clean":"2023-08-31T19:24:39.517329+0000","last_became_active":"2023-08-31T19:24:39.071001+0000","last_became_peered":"2023-08-31T19:24:39.071001+0000","last_unstale":"2023-08-31T19:24:39.517329+0000","last_undegraded":"2023-08-31T19:24:39.517329+0000","last_fullsized":"2023-08-31T19:24:39.517329+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541474+0000","last_change":"2023-08-31T19:24:39.538487+0000","last_active":"2023-08-31T19:24:39.541474+0000","last_peered":"2023-08-31T19:24:39.541474+0000","last_clean":"2023-08-31T19:24:39.541474+0000","last_became_active":"2023-08-31T19:24:39.538196+0000","last_became_peered":"2023-08-31T19:24:39.538196+0000","last_unstale":"2023-08-31T19:24:39.541474+0000","last_undegraded":"2023-08-31T19:24:39.541474+0000","last_fullsized":"2023-08-31T19:24:39.541474+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.546674+0000","last_change":"2023-08-31T19:24:39.077833+0000","last_active":"2023-08-31T19:24:39.546674+0000","last_peered":"2023-08-31T19:24:39.546674+0000","last_clean":"2023-08-31T19:24:39.546674+0000","last_became_active":"2023-08-31T19:24:39.077536+0000","last_became_peered":"2023-08-31T19:24:39.077536+0000","last_unstale":"2023-08-31T19:24:39.546674+0000","last_undegraded":"2023-08-31T19:24:39.546674+0000","last_fullsized":"2023-08-31T19:24:39.546674+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541431+0000","last_change":"2023-08-31T19:24:39.532165+0000","last_active":"2023-08-31T19:24:39.541431+0000","last_peered":"2023-08-31T19:24:39.541431+0000","last_clean":"2023-08-31T19:24:39.541431+0000","last_became_active":"2023-08-31T19:24:39.531818+0000","last_became_peered":"2023-08-31T19:24:39.531818+0000","last_unstale":"2023-08-31T19:24:39.541431+0000","last_undegraded":"2023-08-31T19:24:39.541431+0000","last_fullsized":"2023-08-31T19:24:39.541431+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.525271+0000","last_change":"2023-08-31T19:24:39.079047+0000","last_active":"2023-08-31T19:24:39.525271+0000","last_peered":"2023-08-31T19:24:39.525271+0000","last_clean":"2023-08-31T19:24:39.525271+0000","last_became_active":"2023-08-31T19:24:39.078728+0000","last_became_peered":"2023-08-31T19:24:39.078728+0000","last_unstale":"2023-08-31T19:24:39.525271+0000","last_undegraded":"2023-08-31T19:24:39.525271+0000","last_fullsized":"2023-08-31T19:24:39.525271+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547373+0000","last_change":"2023-08-31T19:24:39.543503+0000","last_active":"2023-08-31T19:24:39.547373+0000","last_peered":"2023-08-31T19:24:39.547373+0000","last_clean":"2023-08-31T19:24:39.547373+0000","last_became_active":"2023-08-31T19:24:39.543228+0000","last_became_peered":"2023-08-31T19:24:39.543228+0000","last_unstale":"2023-08-31T19:24:39.547373+0000","last_undegraded":"2023-08-31T19:24:39.547373+0000","last_fullsized":"2023-08-31T19:24:39.547373+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.528819+0000","last_change":"2023-08-31T19:24:39.079622+0000","last_active":"2023-08-31T19:24:39.528819+0000","last_peered":"2023-08-31T19:24:39.528819+0000","last_clean":"2023-08-31T19:24:39.528819+0000","last_became_active":"2023-08-31T19:24:39.079218+0000","last_became_peered":"2023-08-31T19:24:39.079218+0000","last_unstale":"2023-08-31T19:24:39.528819+0000","last_undegraded":"2023-08-31T19:24:39.528819+0000","last_fullsized":"2023-08-31T19:24:39.528819+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547084+0000","last_change":"2023-08-31T19:24:39.541672+0000","last_active":"2023-08-31T19:24:39.547084+0000","last_peered":"2023-08-31T19:24:39.547084+0000","last_clean":"2023-08-31T19:24:39.547084+0000","last_became_active":"2023-08-31T19:24:39.541403+0000","last_became_peered":"2023-08-31T19:24:39.541403+0000","last_unstale":"2023-08-31T19:24:39.547084+0000","last_undegraded":"2023-08-31T19:24:39.547084+0000","last_fullsized":"2023-08-31T19:24:39.547084+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.526510+0000","last_change":"2023-08-31T19:24:39.077360+0000","last_active":"2023-08-31T19:24:39.526510+0000","last_peered":"2023-08-31T19:24:39.526510+0000","last_clean":"2023-08-31T19:24:39.526510+0000","last_became_active":"2023-08-31T19:24:39.076992+0000","last_became_peered":"2023-08-31T19:24:39.076992+0000","last_unstale":"2023-08-31T19:24:39.526510+0000","last_undegraded":"2023-08-31T19:24:39.526510+0000","last_fullsized":"2023-08-31T19:24:39.526510+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.527756+0000","last_change":"2023-08-31T19:24:39.523097+0000","last_active":"2023-08-31T19:24:39.527756+0000","last_peered":"2023-08-31T19:24:39.527756+0000","last_clean":"2023-08-31T19:24:39.527756+0000","last_became_active":"2023-08-31T19:24:39.522780+0000","last_became_peered":"2023-08-31T19:24:39.522780+0000","last_unstale":"2023-08-31T19:24:39.527756+0000","last_undegraded":"2023-08-31T19:24:39.527756+0000","last_fullsized":"2023-08-31T19:24:39.527756+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.521352+0000","last_change":"2023-08-31T19:24:39.087523+0000","last_active":"2023-08-31T19:24:39.521352+0000","last_peered":"2023-08-31T19:24:39.521352+0000","last_clean":"2023-08-31T19:24:39.521352+0000","last_became_active":"2023-08-31T19:24:39.087214+0000","last_became_peered":"2023-08-31T19:24:39.087214+0000","last_unstale":"2023-08-31T19:24:39.521352+0000","last_undegraded":"2023-08-31T19:24:39.521352+0000","last_fullsized":"2023-08-31T19:24:39.521352+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541403+0000","last_change":"2023-08-31T19:24:39.531528+0000","last_active":"2023-08-31T19:24:39.541403+0000","last_peered":"2023-08-31T19:24:39.541403+0000","last_clean":"2023-08-31T19:24:39.541403+0000","last_became_active":"2023-08-31T19:24:39.531145+0000","last_became_peered":"2023-08-31T19:24:39.531145+0000","last_unstale":"2023-08-31T19:24:39.541403+0000","last_undegraded":"2023-08-31T19:24:39.541403+0000","last_fullsized":"2023-08-31T19:24:39.541403+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.518521+0000","last_change":"2023-08-31T19:24:39.065193+0000","last_active":"2023-08-31T19:24:39.518521+0000","last_peered":"2023-08-31T19:24:39.518521+0000","last_clean":"2023-08-31T19:24:39.518521+0000","last_became_active":"2023-08-31T19:24:39.064908+0000","last_became_peered":"2023-08-31T19:24:39.064908+0000","last_unstale":"2023-08-31T19:24:39.518521+0000","last_undegraded":"2023-08-31T19:24:39.518521+0000","last_fullsized":"2023-08-31T19:24:39.518521+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.537913+0000","last_change":"2023-08-31T19:24:39.535456+0000","last_active":"2023-08-31T19:24:39.537913+0000","last_peered":"2023-08-31T19:24:39.537913+0000","last_clean":"2023-08-31T19:24:39.537913+0000","last_became_active":"2023-08-31T19:24:39.535186+0000","last_became_peered":"2023-08-31T19:24:39.535186+0000","last_unstale":"2023-08-31T19:24:39.537913+0000","last_undegraded":"2023-08-31T19:24:39.537913+0000","last_fullsized":"2023-08-31T19:24:39.537913+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.521648+0000","last_change":"2023-08-31T19:24:39.083850+0000","last_active":"2023-08-31T19:24:39.521648+0000","last_peered":"2023-08-31T19:24:39.521648+0000","last_clean":"2023-08-31T19:24:39.521648+0000","last_became_active":"2023-08-31T19:24:39.083474+0000","last_became_peered":"2023-08-31T19:24:39.083474+0000","last_unstale":"2023-08-31T19:24:39.521648+0000","last_undegraded":"2023-08-31T19:24:39.521648+0000","last_fullsized":"2023-08-31T19:24:39.521648+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.543197+0000","last_change":"2023-08-31T19:24:39.534021+0000","last_active":"2023-08-31T19:24:39.543197+0000","last_peered":"2023-08-31T19:24:39.543197+0000","last_clean":"2023-08-31T19:24:39.543197+0000","last_became_active":"2023-08-31T19:24:39.533702+0000","last_became_peered":"2023-08-31T19:24:39.533702+0000","last_unstale":"2023-08-31T19:24:39.543197+0000","last_undegraded":"2023-08-31T19:24:39.543197+0000","last_fullsized":"2023-08-31T19:24:39.543197+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.522348+0000","last_change":"2023-08-31T19:24:39.083312+0000","last_active":"2023-08-31T19:24:39.522348+0000","last_peered":"2023-08-31T19:24:39.522348+0000","last_clean":"2023-08-31T19:24:39.522348+0000","last_became_active":"2023-08-31T19:24:39.083034+0000","last_became_peered":"2023-08-31T19:24:39.083034+0000","last_unstale":"2023-08-31T19:24:39.522348+0000","last_undegraded":"2023-08-31T19:24:39.522348+0000","last_fullsized":"2023-08-31T19:24:39.522348+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544415+0000","last_change":"2023-08-31T19:24:39.539506+0000","last_active":"2023-08-31T19:24:39.544415+0000","last_peered":"2023-08-31T19:24:39.544415+0000","last_clean":"2023-08-31T19:24:39.544415+0000","last_became_active":"2023-08-31T19:24:39.539127+0000","last_became_peered":"2023-08-31T19:24:39.539127+0000","last_unstale":"2023-08-31T19:24:39.544415+0000","last_undegraded":"2023-08-31T19:24:39.544415+0000","last_fullsized":"2023-08-31T19:24:39.544415+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541830+0000","last_change":"2023-08-31T19:24:39.070666+0000","last_active":"2023-08-31T19:24:39.541830+0000","last_peered":"2023-08-31T19:24:39.541830+0000","last_clean":"2023-08-31T19:24:39.541830+0000","last_became_active":"2023-08-31T19:24:39.070396+0000","last_became_peered":"2023-08-31T19:24:39.070396+0000","last_unstale":"2023-08-31T19:24:39.541830+0000","last_undegraded":"2023-08-31T19:24:39.541830+0000","last_fullsized":"2023-08-31T19:24:39.541830+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":158,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.528117+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:24:39.528117+0000","last_peered":"2023-08-31T19:24:39.528117+0000","last_clean":"2023-08-31T19:24:39.528117+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:24:39.528117+0000","last_undegraded":"2023-08-31T19:24:39.528117+0000","last_fullsized":"2023-08-31T19:24:39.528117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544234+0000","last_change":"2023-08-31T19:24:39.538334+0000","last_active":"2023-08-31T19:24:39.544234+0000","last_peered":"2023-08-31T19:24:39.544234+0000","last_clean":"2023-08-31T19:24:39.544234+0000","last_became_active":"2023-08-31T19:24:39.537566+0000","last_became_peered":"2023-08-31T19:24:39.537566+0000","last_unstale":"2023-08-31T19:24:39.544234+0000","last_undegraded":"2023-08-31T19:24:39.544234+0000","last_fullsized":"2023-08-31T19:24:39.544234+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"175'3","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541876+0000","last_change":"2023-08-31T19:24:39.069602+0000","last_active":"2023-08-31T19:24:39.541876+0000","last_peered":"2023-08-31T19:24:39.541876+0000","last_clean":"2023-08-31T19:24:39.541876+0000","last_became_active":"2023-08-31T19:24:39.068773+0000","last_became_peered":"2023-08-31T19:24:39.068773+0000","last_unstale":"2023-08-31T19:24:39.541876+0000","last_undegraded":"2023-08-31T19:24:39.541876+0000","last_fullsized":"2023-08-31T19:24:39.541876+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":148,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.521115+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:24:39.521115+0000","last_peered":"2023-08-31T19:24:39.521115+0000","last_clean":"2023-08-31T19:24:39.521115+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:24:39.521115+0000","last_undegraded":"2023-08-31T19:24:39.521115+0000","last_fullsized":"2023-08-31T19:24:39.521115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541948+0000","last_change":"2023-08-31T19:24:39.538606+0000","last_active":"2023-08-31T19:24:39.541948+0000","last_peered":"2023-08-31T19:24:39.541948+0000","last_clean":"2023-08-31T19:24:39.541948+0000","last_became_active":"2023-08-31T19:24:39.538317+0000","last_became_peered":"2023-08-31T19:24:39.538317+0000","last_unstale":"2023-08-31T19:24:39.541948+0000","last_undegraded":"2023-08-31T19:24:39.541948+0000","last_fullsized":"2023-08-31T19:24:39.541948+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.525399+0000","last_change":"2023-08-31T19:24:39.078465+0000","last_active":"2023-08-31T19:24:39.525399+0000","last_peered":"2023-08-31T19:24:39.525399+0000","last_clean":"2023-08-31T19:24:39.525399+0000","last_became_active":"2023-08-31T19:24:39.078114+0000","last_became_peered":"2023-08-31T19:24:39.078114+0000","last_unstale":"2023-08-31T19:24:39.525399+0000","last_undegraded":"2023-08-31T19:24:39.525399+0000","last_fullsized":"2023-08-31T19:24:39.525399+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.518784+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:24:39.518784+0000","last_peered":"2023-08-31T19:24:39.518784+0000","last_clean":"2023-08-31T19:24:39.518784+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:24:39.518784+0000","last_undegraded":"2023-08-31T19:24:39.518784+0000","last_fullsized":"2023-08-31T19:24:39.518784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.543927+0000","last_change":"2023-08-31T19:24:39.538826+0000","last_active":"2023-08-31T19:24:39.543927+0000","last_peered":"2023-08-31T19:24:39.543927+0000","last_clean":"2023-08-31T19:24:39.543927+0000","last_became_active":"2023-08-31T19:24:39.538457+0000","last_became_peered":"2023-08-31T19:24:39.538457+0000","last_unstale":"2023-08-31T19:24:39.543927+0000","last_undegraded":"2023-08-31T19:24:39.543927+0000","last_fullsized":"2023-08-31T19:24:39.543927+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544818+0000","last_change":"2023-08-31T19:24:39.067922+0000","last_active":"2023-08-31T19:24:39.544818+0000","last_peered":"2023-08-31T19:24:39.544818+0000","last_clean":"2023-08-31T19:24:39.544818+0000","last_became_active":"2023-08-31T19:24:39.067612+0000","last_became_peered":"2023-08-31T19:24:39.067612+0000","last_unstale":"2023-08-31T19:24:39.544818+0000","last_undegraded":"2023-08-31T19:24:39.544818+0000","last_fullsized":"2023-08-31T19:24:39.544818+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":148,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.521563+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:24:39.521563+0000","last_peered":"2023-08-31T19:24:39.521563+0000","last_clean":"2023-08-31T19:24:39.521563+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:24:39.521563+0000","last_undegraded":"2023-08-31T19:24:39.521563+0000","last_fullsized":"2023-08-31T19:24:39.521563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":147,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.522379+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:24:39.522379+0000","last_peered":"2023-08-31T19:24:39.522379+0000","last_clean":"2023-08-31T19:24:39.522379+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:24:39.522379+0000","last_undegraded":"2023-08-31T19:24:39.522379+0000","last_fullsized":"2023-08-31T19:24:39.522379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.548627+0000","last_change":"2023-08-31T19:24:39.544270+0000","last_active":"2023-08-31T19:24:39.548627+0000","last_peered":"2023-08-31T19:24:39.548627+0000","last_clean":"2023-08-31T19:24:39.548627+0000","last_became_active":"2023-08-31T19:24:39.543898+0000","last_became_peered":"2023-08-31T19:24:39.543898+0000","last_unstale":"2023-08-31T19:24:39.548627+0000","last_undegraded":"2023-08-31T19:24:39.548627+0000","last_fullsized":"2023-08-31T19:24:39.548627+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.527537+0000","last_change":"2023-08-31T19:24:39.079197+0000","last_active":"2023-08-31T19:24:39.527537+0000","last_peered":"2023-08-31T19:24:39.527537+0000","last_clean":"2023-08-31T19:24:39.527537+0000","last_became_active":"2023-08-31T19:24:39.078594+0000","last_became_peered":"2023-08-31T19:24:39.078594+0000","last_unstale":"2023-08-31T19:24:39.527537+0000","last_undegraded":"2023-08-31T19:24:39.527537+0000","last_fullsized":"2023-08-31T19:24:39.527537+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.527851+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:24:39.527851+0000","last_peered":"2023-08-31T19:24:39.527851+0000","last_clean":"2023-08-31T19:24:39.527851+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:24:39.527851+0000","last_undegraded":"2023-08-31T19:24:39.527851+0000","last_fullsized":"2023-08-31T19:24:39.527851+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.538501+0000","last_change":"2023-08-31T19:24:39.535629+0000","last_active":"2023-08-31T19:24:39.538501+0000","last_peered":"2023-08-31T19:24:39.538501+0000","last_clean":"2023-08-31T19:24:39.538501+0000","last_became_active":"2023-08-31T19:24:39.535308+0000","last_became_peered":"2023-08-31T19:24:39.535308+0000","last_unstale":"2023-08-31T19:24:39.538501+0000","last_undegraded":"2023-08-31T19:24:39.538501+0000","last_fullsized":"2023-08-31T19:24:39.538501+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.519855+0000","last_change":"2023-08-31T19:24:39.082293+0000","last_active":"2023-08-31T19:24:39.519855+0000","last_peered":"2023-08-31T19:24:39.519855+0000","last_clean":"2023-08-31T19:24:39.519855+0000","last_became_active":"2023-08-31T19:24:39.082016+0000","last_became_peered":"2023-08-31T19:24:39.082016+0000","last_unstale":"2023-08-31T19:24:39.519855+0000","last_undegraded":"2023-08-31T19:24:39.519855+0000","last_fullsized":"2023-08-31T19:24:39.519855+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":146,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.530223+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:24:39.530223+0000","last_peered":"2023-08-31T19:24:39.530223+0000","last_clean":"2023-08-31T19:24:39.530223+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:24:39.530223+0000","last_undegraded":"2023-08-31T19:24:39.530223+0000","last_fullsized":"2023-08-31T19:24:39.530223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.539667+0000","last_change":"2023-08-31T19:24:39.534120+0000","last_active":"2023-08-31T19:24:39.539667+0000","last_peered":"2023-08-31T19:24:39.539667+0000","last_clean":"2023-08-31T19:24:39.539667+0000","last_became_active":"2023-08-31T19:24:39.533845+0000","last_became_peered":"2023-08-31T19:24:39.533845+0000","last_unstale":"2023-08-31T19:24:39.539667+0000","last_undegraded":"2023-08-31T19:24:39.539667+0000","last_fullsized":"2023-08-31T19:24:39.539667+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.519984+0000","last_change":"2023-08-31T19:24:39.063870+0000","last_active":"2023-08-31T19:24:39.519984+0000","last_peered":"2023-08-31T19:24:39.519984+0000","last_clean":"2023-08-31T19:24:39.519984+0000","last_became_active":"2023-08-31T19:24:39.063585+0000","last_became_peered":"2023-08-31T19:24:39.063585+0000","last_unstale":"2023-08-31T19:24:39.519984+0000","last_undegraded":"2023-08-31T19:24:39.519984+0000","last_fullsized":"2023-08-31T19:24:39.519984+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":158,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.525379+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:24:39.525379+0000","last_peered":"2023-08-31T19:24:39.525379+0000","last_clean":"2023-08-31T19:24:39.525379+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:24:39.525379+0000","last_undegraded":"2023-08-31T19:24:39.525379+0000","last_fullsized":"2023-08-31T19:24:39.525379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.537891+0000","last_change":"2023-08-31T19:24:39.535171+0000","last_active":"2023-08-31T19:24:39.537891+0000","last_peered":"2023-08-31T19:24:39.537891+0000","last_clean":"2023-08-31T19:24:39.537891+0000","last_became_active":"2023-08-31T19:24:39.534871+0000","last_became_peered":"2023-08-31T19:24:39.534871+0000","last_unstale":"2023-08-31T19:24:39.537891+0000","last_undegraded":"2023-08-31T19:24:39.537891+0000","last_fullsized":"2023-08-31T19:24:39.537891+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"175'4","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544435+0000","last_change":"2023-08-31T19:24:39.078263+0000","last_active":"2023-08-31T19:24:39.544435+0000","last_peered":"2023-08-31T19:24:39.544435+0000","last_clean":"2023-08-31T19:24:39.544435+0000","last_became_active":"2023-08-31T19:24:39.077977+0000","last_became_peered":"2023-08-31T19:24:39.077977+0000","last_unstale":"2023-08-31T19:24:39.544435+0000","last_undegraded":"2023-08-31T19:24:39.544435+0000","last_fullsized":"2023-08-31T19:24:39.544435+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":164,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.519706+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:24:39.519706+0000","last_peered":"2023-08-31T19:24:39.519706+0000","last_clean":"2023-08-31T19:24:39.519706+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:24:39.519706+0000","last_undegraded":"2023-08-31T19:24:39.519706+0000","last_fullsized":"2023-08-31T19:24:39.519706+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575284,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303348,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068492,"statfs":{"total":96636764160,"available":96326135808,"internally_reserved":0,"allocated":2207744,"data_stored":1191410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.48699999999999999,"5min":0.46700000000000003,"15min":0.38200000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.98799999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.54300000000000004},"max":{"1min":0.93899999999999995,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.81000000000000005}]},{"osd":1,"last update":"Thu Aug 31 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.74099999999999999,"15min":0.71799999999999997},"min":{"1min":0.61099999999999999,"5min":0.5,"15min":0.42499999999999999},"max":{"1min":0.91400000000000003,"5min":0.97299999999999998,"15min":0.99399999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69899999999999995,"15min":0.69799999999999995},"min":{"1min":0.502,"5min":0.49299999999999999,"15min":0.41199999999999998},"max":{"1min":0.875,"5min":0.93700000000000006,"15min":0.999},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72199999999999998,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93500000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71299999999999997,"15min":0.71899999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.45200000000000001},"max":{"1min":0.83499999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69099999999999995,"15min":0.70899999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.006},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.747},"min":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.48599999999999999},"max":{"1min":0.91200000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.628}]},{"osd":4,"last update":"Thu Aug 31 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.58899999999999997},"min":{"1min":0.42599999999999999,"5min":0.39000000000000001,"15min":0.34200000000000003},"max":{"1min":0.83499999999999996,"5min":0.92500000000000004,"15min":0.96499999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.69299999999999995},"min":{"1min":0.47599999999999998,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.89300000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67400000000000004,"15min":0.65800000000000003},"min":{"1min":0.435,"5min":0.42799999999999999,"15min":0.41599999999999998},"max":{"1min":0.74299999999999999,"5min":1.006,"15min":1.042},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69099999999999995,"15min":0.70599999999999996},"min":{"1min":0.51100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.875,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.442},"max":{"1min":0.77700000000000002,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.42999999999999999,"15min":0.41899999999999998},"max":{"1min":0.91700000000000004,"5min":0.93600000000000005,"15min":0.98099999999999998},"last":0.749}]}]},{"osd":6,"up_from":13,"seq":55834575283,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303336,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068504,"statfs":{"total":96636764160,"available":96326148096,"internally_reserved":0,"allocated":2195456,"data_stored":1189942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.433,"15min":0.33800000000000002},"max":{"1min":0.84599999999999997,"5min":1.05,"15min":1.0600000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.51800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94399999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Aug 31 19:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.41999999999999998},"max":{"1min":0.92300000000000004,"5min":1.028,"15min":1.0669999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.754,"15min":0.747},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.45500000000000002},"max":{"1min":0.97199999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Aug 31 19:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"max":{"1min":0.94799999999999995,"5min":1.198,"15min":1.198},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77700000000000002,"15min":0.76800000000000002},"min":{"1min":0.63300000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94399999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.56899999999999995,"5min":0.54300000000000004,"15min":0.51700000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.0189999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":0.78000000000000003},"min":{"1min":0.66000000000000003,"5min":0.54100000000000004,"15min":0.495},"max":{"1min":1.026,"5min":1.296,"15min":1.296},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.92100000000000004},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":0.92700000000000005,"5min":0.995,"15min":0.995},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.67800000000000005,"15min":0.67000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.42799999999999999},"max":{"1min":0.88500000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72099999999999997,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.40899999999999997},"max":{"1min":0.96399999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.71699999999999997,"15min":0.69999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.46200000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76900000000000002,"15min":0.753},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.48499999999999999},"max":{"1min":0.98099999999999998,"5min":1.24,"15min":1.24},"last":0.80100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575284,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303344,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068496,"statfs":{"total":96636764160,"available":96326139904,"internally_reserved":0,"allocated":2203648,"data_stored":1190566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.34100000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64400000000000002,"5min":0.66500000000000004,"15min":0.68100000000000005},"last":0.379},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.317,"15min":0.31},"max":{"1min":0.60099999999999998,"5min":0.73599999999999999,"15min":0.76400000000000001},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51100000000000001,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58699999999999997,"15min":0.58399999999999996},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.35199999999999998},"max":{"1min":0.70599999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.47299999999999998,"5min":0.438,"15min":0.40300000000000002},"max":{"1min":0.68400000000000005,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66300000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.442}]},{"osd":4,"last update":"Thu Aug 31 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.59799999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.1839999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.82099999999999995,"15min":0.83599999999999997},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.62},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1499999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76100000000000001,"15min":0.78000000000000003},"min":{"1min":0.56599999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.137},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.53100000000000003},"max":{"1min":1.127,"5min":1.127,"15min":1.262},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.79600000000000004},"min":{"1min":0.58499999999999996,"5min":0.54200000000000004,"15min":0.47799999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0569999999999999,"5min":1.222,"15min":1.2849999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.56899999999999995},"max":{"1min":1.097,"5min":1.127,"15min":1.224},"last":0.626},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80200000000000005,"15min":0.80500000000000005},"min":{"1min":0.627,"5min":0.56299999999999994,"15min":0.51000000000000001},"max":{"1min":1.1579999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.71499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575283,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303340,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068500,"statfs":{"total":96636764160,"available":96326144000,"internally_reserved":0,"allocated":2199552,"data_stored":1183378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46600000000000003,"15min":0.46300000000000002},"min":{"1min":0.33400000000000002,"5min":0.317,"15min":0.28799999999999998},"max":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.505},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.309},"max":{"1min":0.68400000000000005,"5min":0.84599999999999997,"15min":1.097},"last":0.311}]},{"osd":2,"last update":"Thu Aug 31 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.51600000000000001},"min":{"1min":0.41599999999999998,"5min":0.36799999999999999,"15min":0.32800000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.77000000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54900000000000004,"15min":0.55400000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.372},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":1.165},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.38300000000000001,"5min":0.378,"15min":0.36399999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.376},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.2609999999999999},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.81399999999999995,"15min":0.82599999999999996},"min":{"1min":0.65900000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.097,"5min":1.097,"15min":1.3169999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80100000000000005,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.57699999999999996,"15min":0.56699999999999995},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.347},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76100000000000001,"15min":0.77500000000000002},"min":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.54500000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.3220000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.75700000000000001,"15min":0.77700000000000002},"min":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.024,"5min":1.135,"15min":1.242},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.80600000000000005},"min":{"1min":0.61399999999999999,"5min":0.54700000000000004,"15min":0.53000000000000003},"max":{"1min":1.0880000000000001,"5min":1.113,"15min":1.21},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.61099999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.3660000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.83899999999999997,"15min":0.84799999999999998},"min":{"1min":0.64300000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.032,"5min":1.093,"15min":1.24},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81499999999999995,"15min":0.84199999999999997},"min":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.3340000000000001},"last":0.80300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575283,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303336,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068504,"statfs":{"total":96636764160,"available":96326148096,"internally_reserved":0,"allocated":2195456,"data_stored":1182792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:23:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45600000000000002,"15min":0.45100000000000001},"min":{"1min":0.311,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66500000000000004,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51500000000000001,"15min":0.50600000000000001},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.66900000000000004,"5min":0.73299999999999998,"15min":0.77600000000000002},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:23:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51500000000000001,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.35899999999999999,"15min":0.33600000000000002},"max":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":0.81899999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.46300000000000002,"5min":0.38100000000000001,"15min":0.36399999999999999},"max":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:23:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.372,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65300000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.39900000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:23:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79400000000000004,"15min":0.79700000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97999999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.629},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80100000000000005,"15min":0.80200000000000005},"min":{"1min":0.61499999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.034,"5min":1.1040000000000001,"15min":1.304},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:23:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81399999999999995,"15min":0.80700000000000005},"min":{"1min":0.67800000000000005,"5min":0.54500000000000004,"15min":0.51300000000000001},"max":{"1min":1.036,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81899999999999995,"15min":0.81299999999999994},"min":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58299999999999996},"max":{"1min":1.054,"5min":1.256,"15min":1.256},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:23:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83299999999999996,"15min":0.82499999999999996},"min":{"1min":0.60999999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.054,"5min":1.1970000000000001,"15min":1.2150000000000001},"last":0.621},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.63600000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0289999999999999,"5min":1.2310000000000001,"15min":1.27},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Aug 31 19:23:42 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.84899999999999998,"15min":0.83399999999999996},"min":{"1min":0.70999999999999996,"5min":0.57999999999999996,"15min":0.54400000000000004},"max":{"1min":1.083,"5min":1.302,"15min":1.302},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.83999999999999997},"min":{"1min":0.65200000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0009999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.76500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575283,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307436,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064404,"statfs":{"total":96636764160,"available":96321949696,"internally_reserved":0,"allocated":2199552,"data_stored":1189976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.443},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.71899999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.39400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69299999999999995,"5min":0.72099999999999997,"15min":0.77600000000000002},"last":0.432}]},{"osd":1,"last update":"Thu Aug 31 19:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47499999999999998,"15min":0.46700000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.30599999999999999},"max":{"1min":0.64600000000000002,"5min":0.66800000000000004,"15min":0.77600000000000002},"last":0.502},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.51700000000000002},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.35599999999999998},"max":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.78600000000000003},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.52700000000000002,"5min":0.41699999999999998,"15min":0.379},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.90400000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63400000000000001,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.38200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.95399999999999996},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Aug 31 19:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77400000000000002,"15min":0.76000000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.46500000000000002},"max":{"1min":0.92100000000000004,"5min":1.012,"15min":1.1739999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.59499999999999997,"5min":0.56499999999999995,"15min":0.47899999999999998},"max":{"1min":0.94299999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79700000000000004,"15min":0.79400000000000004},"min":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.52400000000000002},"max":{"1min":0.98599999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.75},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79300000000000004,"15min":0.78500000000000003},"min":{"1min":0.57199999999999995,"5min":0.55200000000000005,"15min":0.505},"max":{"1min":1.018,"5min":1.1819999999999999,"15min":1.2430000000000001},"last":0.82099999999999995}]},{"osd":6,"last update":"Thu Aug 31 19:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81100000000000005,"15min":0.79900000000000004},"min":{"1min":0.64100000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0960000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80100000000000005,"15min":0.80000000000000004},"min":{"1min":0.60799999999999998,"5min":0.55100000000000005,"15min":0.54900000000000004},"max":{"1min":0.95299999999999996,"5min":1.121,"15min":1.2849999999999999},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.497},"max":{"1min":0.93300000000000005,"5min":1.1579999999999999,"15min":1.381},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81100000000000005,"15min":0.80800000000000005},"min":{"1min":0.627,"5min":0.60299999999999998,"15min":0.55700000000000005},"max":{"1min":1.0249999999999999,"5min":1.244,"15min":1.3420000000000001},"last":0.80300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575283,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303344,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068496,"statfs":{"total":96636764160,"available":96326139904,"internally_reserved":0,"allocated":2203648,"data_stored":1190586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71799999999999997,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95899999999999996,"5min":1.048,"15min":1.048},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.71699999999999997,"15min":0.71599999999999997},"min":{"1min":0.59999999999999998,"5min":0.45500000000000002,"15min":0.376},"max":{"1min":0.92600000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.61199999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73899999999999999,"15min":0.73299999999999998},"min":{"1min":0.54800000000000004,"5min":0.49099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96499999999999997,"5min":0.98699999999999999,"15min":1.0289999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73699999999999999,"15min":0.73299999999999998},"min":{"1min":0.50800000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.97199999999999998,"5min":1,"15min":1},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.65200000000000002,"5min":0.504,"15min":0.48999999999999999},"max":{"1min":0.91500000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.755,"15min":0.754},"min":{"1min":0.60299999999999998,"5min":0.54300000000000004,"15min":0.51300000000000001},"max":{"1min":0.93000000000000005,"5min":0.93999999999999995,"15min":0.996},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.50900000000000001},"max":{"1min":0.90700000000000003,"5min":0.95699999999999996,"15min":0.97699999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76300000000000001,"15min":0.75900000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.49399999999999999},"max":{"1min":1.0089999999999999,"5min":1.056,"15min":1.056},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.39600000000000002},"max":{"1min":0.83999999999999997,"5min":0.90600000000000003,"15min":0.95799999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45000000000000001,"5min":0.41899999999999998,"15min":0.41099999999999998},"max":{"1min":0.86499999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.48299999999999998,"5min":0.47199999999999998,"15min":0.42299999999999999},"max":{"1min":0.98799999999999999,"5min":1.01,"15min":1.0649999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.69599999999999995},"min":{"1min":0.498,"5min":0.46500000000000002,"15min":0.46100000000000002},"max":{"1min":0.89500000000000002,"5min":0.98499999999999999,"15min":1.069},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69799999999999995,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.45300000000000001},"max":{"1min":0.92800000000000005,"5min":0.94299999999999995,"15min":1.0049999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.0369999999999999,"15min":1.115},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575283,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303328,"kb_used_data":2136,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068512,"statfs":{"total":96636764160,"available":96326156288,"internally_reserved":0,"allocated":2187264,"data_stored":1183502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.72499999999999998},"min":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.873,"5min":1.026,"15min":1.026},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.59099999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92200000000000004,"5min":0.995,"15min":1.5369999999999999},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Aug 31 19:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.499},"max":{"1min":0.92900000000000005,"5min":1.103,"15min":1.103},"last":0.625},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.746,"15min":0.747},"min":{"1min":0.55400000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89500000000000002,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85299999999999998,"5min":1.004,"15min":1.004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.76400000000000001,"15min":0.75600000000000001},"min":{"1min":0.53800000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.97599999999999998,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.749,"15min":0.746},"min":{"1min":0.59199999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.873,"5min":1.141,"15min":1.4990000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.74099999999999999},"min":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90100000000000002,"5min":0.98299999999999998,"15min":1.6060000000000001},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.627,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.379},"max":{"1min":0.93799999999999994,"5min":0.997,"15min":0.997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.46000000000000002,"5min":0.42499999999999999,"15min":0.41299999999999998},"max":{"1min":0.95499999999999996,"5min":1.069,"15min":1.069},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65300000000000002,"15min":0.65000000000000002},"min":{"1min":0.44900000000000001,"5min":0.441,"15min":0.40000000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71199999999999997,"15min":0.69499999999999995},"min":{"1min":0.42899999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93999999999999995,"5min":1.2,"15min":1.2},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Aug 31 19:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.70899999999999996},"min":{"1min":0.503,"5min":0.47799999999999998,"15min":0.46800000000000003},"max":{"1min":0.92700000000000005,"5min":1.034,"15min":1.034},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.47099999999999997},"max":{"1min":0.92600000000000005,"5min":0.995,"15min":0.995},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:24:43.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:24:44.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.022+0000 7f60867ff700 1 Processor -- start 2023-08-31T19:24:44.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.022+0000 7f60867ff700 1 -- start start 2023-08-31T19:24:44.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.024+0000 7f60867ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6080069170 0x7f60800c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.024+0000 7f60867ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f608006a260 0x7f6080069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.024+0000 7f60867ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6080064270 con 0x7f6080069a40 2023-08-31T19:24:44.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.024+0000 7f60867ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60800bca40 con 0x7f608006a260 2023-08-31T19:24:44.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.024+0000 7f60867ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60800bcc20 con 0x7f6080069170 2023-08-31T19:24:44.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.024+0000 7f6084d9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6080069a40 0x7f6080064700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33666/0 (socket says 172.21.15.72:33666) 2023-08-31T19:24:44.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.024+0000 7f6084d9c700 1 -- 172.21.15.72:0/1565419321 learned_addr learned my addr 172.21.15.72:0/1565419321 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:44.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.024+0000 7f607f7fe700 1 --2- 172.21.15.72:0/1565419321 >> v2:172.21.15.72:3300/0 conn(0x7f608006a260 0x7f6080069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.024+0000 7f607ffff700 1 --2- 172.21.15.72:0/1565419321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6080069170 0x7f60800c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.024+0000 7f607effd700 1 -- 172.21.15.72:0/1565419321 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563445372 0 0) 0x7f6080064270 con 0x7f6080069a40 2023-08-31T19:24:44.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.024+0000 7f607f7fe700 1 -- 172.21.15.72:0/1565419321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6080069170 msgr2=0x7f60800c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:44.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.024+0000 7f607f7fe700 1 --2- 172.21.15.72:0/1565419321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6080069170 0x7f60800c2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.024+0000 7f607f7fe700 1 -- 172.21.15.72:0/1565419321 >> v1:172.21.15.72:6789/0 conn(0x7f6080069a40 legacy=0x7f6080064700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.024+0000 7f607f7fe700 1 -- 172.21.15.72:0/1565419321 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6080154890 con 0x7f608006a260 2023-08-31T19:24:44.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.025+0000 7f607f7fe700 1 --2- 172.21.15.72:0/1565419321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608006a260 0x7f6080069550 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f6074009760 tx=0x7f6074009060).ready entity=mon.0 client_cookie=ce1479388bf657b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:44.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.025+0000 7f607effd700 1 -- 172.21.15.72:0/1565419321 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607400b580 con 0x7f608006a260 2023-08-31T19:24:44.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.025+0000 7f607effd700 1 -- 172.21.15.72:0/1565419321 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607400b6e0 con 0x7f608006a260 2023-08-31T19:24:44.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.025+0000 7f607effd700 1 -- 172.21.15.72:0/1565419321 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607400ba60 con 0x7f608006a260 2023-08-31T19:24:44.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.025+0000 7f60867ff700 1 -- 172.21.15.72:0/1565419321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608006a260 msgr2=0x7f6080069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.025+0000 7f60867ff700 1 --2- 172.21.15.72:0/1565419321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608006a260 0x7f6080069550 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f6074009760 tx=0x7f6074009060).stop 2023-08-31T19:24:44.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.026+0000 7f60867ff700 1 -- 172.21.15.72:0/1565419321 shutdown_connections 2023-08-31T19:24:44.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.026+0000 7f60867ff700 1 --2- 172.21.15.72:0/1565419321 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6080069170 0x7f60800c2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.026+0000 7f60867ff700 1 --2- 172.21.15.72:0/1565419321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608006a260 0x7f6080069550 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.026+0000 7f60867ff700 1 -- 172.21.15.72:0/1565419321 >> 172.21.15.72:0/1565419321 conn(0x7f60800c6b10 msgr2=0x7f60800c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:44.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.026+0000 7f60867ff700 1 -- 172.21.15.72:0/1565419321 shutdown_connections 2023-08-31T19:24:44.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.026+0000 7f60867ff700 1 -- 172.21.15.72:0/1565419321 wait complete. 2023-08-31T19:24:44.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.027+0000 7f60867ff700 1 Processor -- start 2023-08-31T19:24:44.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.027+0000 7f60867ff700 1 -- start start 2023-08-31T19:24:44.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.028+0000 7f60867ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6080069170 0x7f60800bdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.028+0000 7f60867ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6080069a40 0x7f60801485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.028+0000 7f60867ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608006a260 0x7f6080148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.028+0000 7f60867ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60800a9270 con 0x7f608006a260 2023-08-31T19:24:44.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.028+0000 7f60867ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60800aca10 con 0x7f6080069a40 2023-08-31T19:24:44.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.028+0000 7f60867ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60800a6920 con 0x7f6080069170 2023-08-31T19:24:44.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.028+0000 7f6084d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608006a260 0x7f6080148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.028+0000 7f6084d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608006a260 0x7f6080148ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44302/0 (socket says 172.21.15.72:44302) 2023-08-31T19:24:44.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.028+0000 7f6084d9c700 1 -- 172.21.15.72:0/1795426540 learned_addr learned my addr 172.21.15.72:0/1795426540 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:44.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.029+0000 7f607ffff700 1 --2- 172.21.15.72:0/1795426540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6080069170 0x7f60800bdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.029+0000 7f607f7fe700 1 --2- 172.21.15.72:0/1795426540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6080069a40 0x7f60801485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.029+0000 7f6084d9c700 1 -- 172.21.15.72:0/1795426540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6080069170 msgr2=0x7f60800bdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.029+0000 7f6084d9c700 1 --2- 172.21.15.72:0/1795426540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6080069170 0x7f60800bdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.029+0000 7f6084d9c700 1 -- 172.21.15.72:0/1795426540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6080069a40 msgr2=0x7f60801485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.029+0000 7f6084d9c700 1 --2- 172.21.15.72:0/1795426540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6080069a40 0x7f60801485d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.029+0000 7f6084d9c700 1 -- 172.21.15.72:0/1795426540 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60740092a0 con 0x7f608006a260 2023-08-31T19:24:44.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.029+0000 7f607f7fe700 1 --2- 172.21.15.72:0/1795426540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6080069a40 0x7f60801485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:24:44.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.029+0000 7f6084d9c700 1 --2- 172.21.15.72:0/1795426540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608006a260 0x7f6080148ac0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f607800c810 tx=0x7f6078007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:44.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.029+0000 7f6067fff700 1 -- 172.21.15.72:0/1795426540 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6078005d30 con 0x7f608006a260 2023-08-31T19:24:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.029+0000 7f6067fff700 1 -- 172.21.15.72:0/1795426540 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6078005e90 con 0x7f608006a260 2023-08-31T19:24:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.029+0000 7f60867ff700 1 -- 172.21.15.72:0/1795426540 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60800a65f0 con 0x7f608006a260 2023-08-31T19:24:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.029+0000 7f6067fff700 1 -- 172.21.15.72:0/1795426540 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6078007320 con 0x7f608006a260 2023-08-31T19:24:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.029+0000 7f60867ff700 1 -- 172.21.15.72:0/1795426540 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6080149460 con 0x7f608006a260 2023-08-31T19:24:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.030+0000 7f60867ff700 1 -- 172.21.15.72:0/1795426540 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608006c6b0 con 0x7f608006a260 2023-08-31T19:24:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.031+0000 7f6067fff700 1 -- 172.21.15.72:0/1795426540 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6078007710 con 0x7f608006a260 2023-08-31T19:24:44.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.032+0000 7f6067fff700 1 --2- 172.21.15.72:0/1795426540 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f606c05ef30 0x7f606c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.032+0000 7f6067fff700 1 -- 172.21.15.72:0/1795426540 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f607807a390 con 0x7f608006a260 2023-08-31T19:24:44.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.032+0000 7f607ffff700 1 --2- 172.21.15.72:0/1795426540 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f606c05ef30 0x7f606c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.033+0000 7f607ffff700 1 --2- 172.21.15.72:0/1795426540 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f606c05ef30 0x7f606c0613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f607000bb20 tx=0x7f6070008040).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:44.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.036+0000 7f6067fff700 1 -- 172.21.15.72:0/1795426540 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f607804b2f0 con 0x7f608006a260 2023-08-31T19:24:44.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.203+0000 7f60867ff700 1 -- 172.21.15.72:0/1795426540 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60800bcec0 con 0x7f606c05ef30 2023-08-31T19:24:44.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.213+0000 7f6067fff700 1 -- 172.21.15.72:0/1795426540 <== mgr.8844 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361634 (secure 0 0 0) 0x7f60800bcec0 con 0x7f606c05ef30 2023-08-31T19:24:44.217 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.217+0000 7f60867ff700 1 -- 172.21.15.72:0/1795426540 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f606c05ef30 msgr2=0x7f606c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.217+0000 7f60867ff700 1 --2- 172.21.15.72:0/1795426540 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f606c05ef30 0x7f606c0613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f607000bb20 tx=0x7f6070008040).stop 2023-08-31T19:24:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.217+0000 7f60867ff700 1 -- 172.21.15.72:0/1795426540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608006a260 msgr2=0x7f6080148ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.217+0000 7f60867ff700 1 --2- 172.21.15.72:0/1795426540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608006a260 0x7f6080148ac0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f607800c810 tx=0x7f6078007f90).stop 2023-08-31T19:24:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.217+0000 7f60867ff700 1 -- 172.21.15.72:0/1795426540 shutdown_connections 2023-08-31T19:24:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.217+0000 7f60867ff700 1 --2- 172.21.15.72:0/1795426540 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f606c05ef30 0x7f606c0613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.217+0000 7f60867ff700 1 --2- 172.21.15.72:0/1795426540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608006a260 0x7f6080148ac0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.217+0000 7f60867ff700 1 --2- 172.21.15.72:0/1795426540 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6080069170 0x7f60800bdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.217+0000 7f60867ff700 1 --2- 172.21.15.72:0/1795426540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6080069a40 0x7f60801485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.217+0000 7f60867ff700 1 -- 172.21.15.72:0/1795426540 >> 172.21.15.72:0/1795426540 conn(0x7f60800c6b10 msgr2=0x7f60800c4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:44.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.218+0000 7f60867ff700 1 -- 172.21.15.72:0/1795426540 shutdown_connections 2023-08-31T19:24:44.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.218+0000 7f60867ff700 1 -- 172.21.15.72:0/1795426540 wait complete. 2023-08-31T19:24:44.223 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:24:44.235 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-31T19:24:43.607853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":244,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430812,"kb_used_data":17180,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752543908,"statfs":{"total":773094113280,"available":770604961792,"internally_reserved":0,"allocated":17592320,"data_stored":9502152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-592772,"num_objects":-6,"num_object_clones":0,"num_object_copies":-12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-170,"num_write_kb":-711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-34,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.215819"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.542558+0000","last_change":"2023-08-31T19:24:39.534134+0000","last_active":"2023-08-31T19:24:39.542558+0000","last_peered":"2023-08-31T19:24:39.542558+0000","last_clean":"2023-08-31T19:24:39.542558+0000","last_became_active":"2023-08-31T19:24:39.533837+0000","last_became_peered":"2023-08-31T19:24:39.533837+0000","last_unstale":"2023-08-31T19:24:39.542558+0000","last_undegraded":"2023-08-31T19:24:39.542558+0000","last_fullsized":"2023-08-31T19:24:39.542558+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"175'3","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.546739+0000","last_change":"2023-08-31T19:24:39.078488+0000","last_active":"2023-08-31T19:24:39.546739+0000","last_peered":"2023-08-31T19:24:39.546739+0000","last_clean":"2023-08-31T19:24:39.546739+0000","last_became_active":"2023-08-31T19:24:39.078143+0000","last_became_peered":"2023-08-31T19:24:39.078143+0000","last_unstale":"2023-08-31T19:24:39.546739+0000","last_undegraded":"2023-08-31T19:24:39.546739+0000","last_fullsized":"2023-08-31T19:24:39.546739+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.553109+0000","last_change":"2023-08-31T19:24:39.548508+0000","last_active":"2023-08-31T19:24:39.553109+0000","last_peered":"2023-08-31T19:24:39.553109+0000","last_clean":"2023-08-31T19:24:39.553109+0000","last_became_active":"2023-08-31T19:24:39.548208+0000","last_became_peered":"2023-08-31T19:24:39.548208+0000","last_unstale":"2023-08-31T19:24:39.553109+0000","last_undegraded":"2023-08-31T19:24:39.553109+0000","last_fullsized":"2023-08-31T19:24:39.553109+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.525036+0000","last_change":"2023-08-31T19:24:39.070804+0000","last_active":"2023-08-31T19:24:39.525036+0000","last_peered":"2023-08-31T19:24:39.525036+0000","last_clean":"2023-08-31T19:24:39.525036+0000","last_became_active":"2023-08-31T19:24:39.070524+0000","last_became_peered":"2023-08-31T19:24:39.070524+0000","last_unstale":"2023-08-31T19:24:39.525036+0000","last_undegraded":"2023-08-31T19:24:39.525036+0000","last_fullsized":"2023-08-31T19:24:39.525036+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.536926+0000","last_change":"2023-08-31T19:24:39.533979+0000","last_active":"2023-08-31T19:24:39.536926+0000","last_peered":"2023-08-31T19:24:39.536926+0000","last_clean":"2023-08-31T19:24:39.536926+0000","last_became_active":"2023-08-31T19:24:39.533685+0000","last_became_peered":"2023-08-31T19:24:39.533685+0000","last_unstale":"2023-08-31T19:24:39.536926+0000","last_undegraded":"2023-08-31T19:24:39.536926+0000","last_fullsized":"2023-08-31T19:24:39.536926+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.519790+0000","last_change":"2023-08-31T19:24:39.072722+0000","last_active":"2023-08-31T19:24:39.519790+0000","last_peered":"2023-08-31T19:24:39.519790+0000","last_clean":"2023-08-31T19:24:39.519790+0000","last_became_active":"2023-08-31T19:24:39.072324+0000","last_became_peered":"2023-08-31T19:24:39.072324+0000","last_unstale":"2023-08-31T19:24:39.519790+0000","last_undegraded":"2023-08-31T19:24:39.519790+0000","last_fullsized":"2023-08-31T19:24:39.519790+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545956+0000","last_change":"2023-08-31T19:24:39.536583+0000","last_active":"2023-08-31T19:24:39.545956+0000","last_peered":"2023-08-31T19:24:39.545956+0000","last_clean":"2023-08-31T19:24:39.545956+0000","last_became_active":"2023-08-31T19:24:39.535711+0000","last_became_peered":"2023-08-31T19:24:39.535711+0000","last_unstale":"2023-08-31T19:24:39.545956+0000","last_undegraded":"2023-08-31T19:24:39.545956+0000","last_fullsized":"2023-08-31T19:24:39.545956+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544442+0000","last_change":"2023-08-31T19:24:39.077060+0000","last_active":"2023-08-31T19:24:39.544442+0000","last_peered":"2023-08-31T19:24:39.544442+0000","last_clean":"2023-08-31T19:24:39.544442+0000","last_became_active":"2023-08-31T19:24:39.076769+0000","last_became_peered":"2023-08-31T19:24:39.076769+0000","last_unstale":"2023-08-31T19:24:39.544442+0000","last_undegraded":"2023-08-31T19:24:39.544442+0000","last_fullsized":"2023-08-31T19:24:39.544442+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.532753+0000","last_change":"2023-08-31T19:24:39.524331+0000","last_active":"2023-08-31T19:24:39.532753+0000","last_peered":"2023-08-31T19:24:39.532753+0000","last_clean":"2023-08-31T19:24:39.532753+0000","last_became_active":"2023-08-31T19:24:39.524011+0000","last_became_peered":"2023-08-31T19:24:39.524011+0000","last_unstale":"2023-08-31T19:24:39.532753+0000","last_undegraded":"2023-08-31T19:24:39.532753+0000","last_fullsized":"2023-08-31T19:24:39.532753+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544153+0000","last_change":"2023-08-31T19:24:39.081027+0000","last_active":"2023-08-31T19:24:39.544153+0000","last_peered":"2023-08-31T19:24:39.544153+0000","last_clean":"2023-08-31T19:24:39.544153+0000","last_became_active":"2023-08-31T19:24:39.080420+0000","last_became_peered":"2023-08-31T19:24:39.080420+0000","last_unstale":"2023-08-31T19:24:39.544153+0000","last_undegraded":"2023-08-31T19:24:39.544153+0000","last_fullsized":"2023-08-31T19:24:39.544153+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547417+0000","last_change":"2023-08-31T19:24:39.544372+0000","last_active":"2023-08-31T19:24:39.547417+0000","last_peered":"2023-08-31T19:24:39.547417+0000","last_clean":"2023-08-31T19:24:39.547417+0000","last_became_active":"2023-08-31T19:24:39.544058+0000","last_became_peered":"2023-08-31T19:24:39.544058+0000","last_unstale":"2023-08-31T19:24:39.547417+0000","last_undegraded":"2023-08-31T19:24:39.547417+0000","last_fullsized":"2023-08-31T19:24:39.547417+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.542952+0000","last_change":"2023-08-31T19:24:39.077455+0000","last_active":"2023-08-31T19:24:39.542952+0000","last_peered":"2023-08-31T19:24:39.542952+0000","last_clean":"2023-08-31T19:24:39.542952+0000","last_became_active":"2023-08-31T19:24:39.077187+0000","last_became_peered":"2023-08-31T19:24:39.077187+0000","last_unstale":"2023-08-31T19:24:39.542952+0000","last_undegraded":"2023-08-31T19:24:39.542952+0000","last_fullsized":"2023-08-31T19:24:39.542952+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.540388+0000","last_change":"2023-08-31T19:24:39.537388+0000","last_active":"2023-08-31T19:24:39.540388+0000","last_peered":"2023-08-31T19:24:39.540388+0000","last_clean":"2023-08-31T19:24:39.540388+0000","last_became_active":"2023-08-31T19:24:39.537119+0000","last_became_peered":"2023-08-31T19:24:39.537119+0000","last_unstale":"2023-08-31T19:24:39.540388+0000","last_undegraded":"2023-08-31T19:24:39.540388+0000","last_fullsized":"2023-08-31T19:24:39.540388+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.514763+0000","last_change":"2023-08-31T19:24:39.077851+0000","last_active":"2023-08-31T19:24:39.514763+0000","last_peered":"2023-08-31T19:24:39.514763+0000","last_clean":"2023-08-31T19:24:39.514763+0000","last_became_active":"2023-08-31T19:24:39.077515+0000","last_became_peered":"2023-08-31T19:24:39.077515+0000","last_unstale":"2023-08-31T19:24:39.514763+0000","last_undegraded":"2023-08-31T19:24:39.514763+0000","last_fullsized":"2023-08-31T19:24:39.514763+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545696+0000","last_change":"2023-08-31T19:24:39.540801+0000","last_active":"2023-08-31T19:24:39.545696+0000","last_peered":"2023-08-31T19:24:39.545696+0000","last_clean":"2023-08-31T19:24:39.545696+0000","last_became_active":"2023-08-31T19:24:39.540524+0000","last_became_peered":"2023-08-31T19:24:39.540524+0000","last_unstale":"2023-08-31T19:24:39.545696+0000","last_undegraded":"2023-08-31T19:24:39.545696+0000","last_fullsized":"2023-08-31T19:24:39.545696+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.526507+0000","last_change":"2023-08-31T19:24:39.080368+0000","last_active":"2023-08-31T19:24:39.526507+0000","last_peered":"2023-08-31T19:24:39.526507+0000","last_clean":"2023-08-31T19:24:39.526507+0000","last_became_active":"2023-08-31T19:24:39.080122+0000","last_became_peered":"2023-08-31T19:24:39.080122+0000","last_unstale":"2023-08-31T19:24:39.526507+0000","last_undegraded":"2023-08-31T19:24:39.526507+0000","last_fullsized":"2023-08-31T19:24:39.526507+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.542535+0000","last_change":"2023-08-31T19:24:39.532902+0000","last_active":"2023-08-31T19:24:39.542535+0000","last_peered":"2023-08-31T19:24:39.542535+0000","last_clean":"2023-08-31T19:24:39.542535+0000","last_became_active":"2023-08-31T19:24:39.532618+0000","last_became_peered":"2023-08-31T19:24:39.532618+0000","last_unstale":"2023-08-31T19:24:39.542535+0000","last_undegraded":"2023-08-31T19:24:39.542535+0000","last_fullsized":"2023-08-31T19:24:39.542535+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.525038+0000","last_change":"2023-08-31T19:24:39.077060+0000","last_active":"2023-08-31T19:24:39.525038+0000","last_peered":"2023-08-31T19:24:39.525038+0000","last_clean":"2023-08-31T19:24:39.525038+0000","last_became_active":"2023-08-31T19:24:39.076718+0000","last_became_peered":"2023-08-31T19:24:39.076718+0000","last_unstale":"2023-08-31T19:24:39.525038+0000","last_undegraded":"2023-08-31T19:24:39.525038+0000","last_fullsized":"2023-08-31T19:24:39.525038+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.548063+0000","last_change":"2023-08-31T19:24:39.545225+0000","last_active":"2023-08-31T19:24:39.548063+0000","last_peered":"2023-08-31T19:24:39.548063+0000","last_clean":"2023-08-31T19:24:39.548063+0000","last_became_active":"2023-08-31T19:24:39.544837+0000","last_became_peered":"2023-08-31T19:24:39.544837+0000","last_unstale":"2023-08-31T19:24:39.548063+0000","last_undegraded":"2023-08-31T19:24:39.548063+0000","last_fullsized":"2023-08-31T19:24:39.548063+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.527995+0000","last_change":"2023-08-31T19:24:39.079681+0000","last_active":"2023-08-31T19:24:39.527995+0000","last_peered":"2023-08-31T19:24:39.527995+0000","last_clean":"2023-08-31T19:24:39.527995+0000","last_became_active":"2023-08-31T19:24:39.079382+0000","last_became_peered":"2023-08-31T19:24:39.079382+0000","last_unstale":"2023-08-31T19:24:39.527995+0000","last_undegraded":"2023-08-31T19:24:39.527995+0000","last_fullsized":"2023-08-31T19:24:39.527995+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547092+0000","last_change":"2023-08-31T19:24:39.542074+0000","last_active":"2023-08-31T19:24:39.547092+0000","last_peered":"2023-08-31T19:24:39.547092+0000","last_clean":"2023-08-31T19:24:39.547092+0000","last_became_active":"2023-08-31T19:24:39.538188+0000","last_became_peered":"2023-08-31T19:24:39.538188+0000","last_unstale":"2023-08-31T19:24:39.547092+0000","last_undegraded":"2023-08-31T19:24:39.547092+0000","last_fullsized":"2023-08-31T19:24:39.547092+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.528513+0000","last_change":"2023-08-31T19:24:39.081923+0000","last_active":"2023-08-31T19:24:39.528513+0000","last_peered":"2023-08-31T19:24:39.528513+0000","last_clean":"2023-08-31T19:24:39.528513+0000","last_became_active":"2023-08-31T19:24:39.081646+0000","last_became_peered":"2023-08-31T19:24:39.081646+0000","last_unstale":"2023-08-31T19:24:39.528513+0000","last_undegraded":"2023-08-31T19:24:39.528513+0000","last_fullsized":"2023-08-31T19:24:39.528513+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547304+0000","last_change":"2023-08-31T19:24:39.545608+0000","last_active":"2023-08-31T19:24:39.547304+0000","last_peered":"2023-08-31T19:24:39.547304+0000","last_clean":"2023-08-31T19:24:39.547304+0000","last_became_active":"2023-08-31T19:24:39.545243+0000","last_became_peered":"2023-08-31T19:24:39.545243+0000","last_unstale":"2023-08-31T19:24:39.547304+0000","last_undegraded":"2023-08-31T19:24:39.547304+0000","last_fullsized":"2023-08-31T19:24:39.547304+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"175'4","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.552622+0000","last_change":"2023-08-31T19:24:39.080877+0000","last_active":"2023-08-31T19:24:39.552622+0000","last_peered":"2023-08-31T19:24:39.552622+0000","last_clean":"2023-08-31T19:24:39.552622+0000","last_became_active":"2023-08-31T19:24:39.080576+0000","last_became_peered":"2023-08-31T19:24:39.080576+0000","last_unstale":"2023-08-31T19:24:39.552622+0000","last_undegraded":"2023-08-31T19:24:39.552622+0000","last_fullsized":"2023-08-31T19:24:39.552622+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547169+0000","last_change":"2023-08-31T19:24:39.544789+0000","last_active":"2023-08-31T19:24:39.547169+0000","last_peered":"2023-08-31T19:24:39.547169+0000","last_clean":"2023-08-31T19:24:39.547169+0000","last_became_active":"2023-08-31T19:24:39.544478+0000","last_became_peered":"2023-08-31T19:24:39.544478+0000","last_unstale":"2023-08-31T19:24:39.547169+0000","last_undegraded":"2023-08-31T19:24:39.547169+0000","last_fullsized":"2023-08-31T19:24:39.547169+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544050+0000","last_change":"2023-08-31T19:24:39.081256+0000","last_active":"2023-08-31T19:24:39.544050+0000","last_peered":"2023-08-31T19:24:39.544050+0000","last_clean":"2023-08-31T19:24:39.544050+0000","last_became_active":"2023-08-31T19:24:39.080750+0000","last_became_peered":"2023-08-31T19:24:39.080750+0000","last_unstale":"2023-08-31T19:24:39.544050+0000","last_undegraded":"2023-08-31T19:24:39.544050+0000","last_fullsized":"2023-08-31T19:24:39.544050+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.540876+0000","last_change":"2023-08-31T19:24:39.536469+0000","last_active":"2023-08-31T19:24:39.540876+0000","last_peered":"2023-08-31T19:24:39.540876+0000","last_clean":"2023-08-31T19:24:39.540876+0000","last_became_active":"2023-08-31T19:24:39.535675+0000","last_became_peered":"2023-08-31T19:24:39.535675+0000","last_unstale":"2023-08-31T19:24:39.540876+0000","last_undegraded":"2023-08-31T19:24:39.540876+0000","last_fullsized":"2023-08-31T19:24:39.540876+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.517711+0000","last_change":"2023-08-31T19:24:39.078195+0000","last_active":"2023-08-31T19:24:39.517711+0000","last_peered":"2023-08-31T19:24:39.517711+0000","last_clean":"2023-08-31T19:24:39.517711+0000","last_became_active":"2023-08-31T19:24:39.077750+0000","last_became_peered":"2023-08-31T19:24:39.077750+0000","last_unstale":"2023-08-31T19:24:39.517711+0000","last_undegraded":"2023-08-31T19:24:39.517711+0000","last_fullsized":"2023-08-31T19:24:39.517711+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541301+0000","last_change":"2023-08-31T19:24:39.531487+0000","last_active":"2023-08-31T19:24:39.541301+0000","last_peered":"2023-08-31T19:24:39.541301+0000","last_clean":"2023-08-31T19:24:39.541301+0000","last_became_active":"2023-08-31T19:24:39.531196+0000","last_became_peered":"2023-08-31T19:24:39.531196+0000","last_unstale":"2023-08-31T19:24:39.541301+0000","last_undegraded":"2023-08-31T19:24:39.541301+0000","last_fullsized":"2023-08-31T19:24:39.541301+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.522059+0000","last_change":"2023-08-31T19:24:39.075542+0000","last_active":"2023-08-31T19:24:39.522059+0000","last_peered":"2023-08-31T19:24:39.522059+0000","last_clean":"2023-08-31T19:24:39.522059+0000","last_became_active":"2023-08-31T19:24:39.075220+0000","last_became_peered":"2023-08-31T19:24:39.075220+0000","last_unstale":"2023-08-31T19:24:39.522059+0000","last_undegraded":"2023-08-31T19:24:39.522059+0000","last_fullsized":"2023-08-31T19:24:39.522059+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.540886+0000","last_change":"2023-08-31T19:24:39.535814+0000","last_active":"2023-08-31T19:24:39.540886+0000","last_peered":"2023-08-31T19:24:39.540886+0000","last_clean":"2023-08-31T19:24:39.540886+0000","last_became_active":"2023-08-31T19:24:39.535565+0000","last_became_peered":"2023-08-31T19:24:39.535565+0000","last_unstale":"2023-08-31T19:24:39.540886+0000","last_undegraded":"2023-08-31T19:24:39.540886+0000","last_fullsized":"2023-08-31T19:24:39.540886+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"175'4","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.537204+0000","last_change":"2023-08-31T19:24:39.080104+0000","last_active":"2023-08-31T19:24:39.537204+0000","last_peered":"2023-08-31T19:24:39.537204+0000","last_clean":"2023-08-31T19:24:39.537204+0000","last_became_active":"2023-08-31T19:24:39.079817+0000","last_became_peered":"2023-08-31T19:24:39.079817+0000","last_unstale":"2023-08-31T19:24:39.537204+0000","last_undegraded":"2023-08-31T19:24:39.537204+0000","last_fullsized":"2023-08-31T19:24:39.537204+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.542817+0000","last_change":"2023-08-31T19:24:39.536923+0000","last_active":"2023-08-31T19:24:39.542817+0000","last_peered":"2023-08-31T19:24:39.542817+0000","last_clean":"2023-08-31T19:24:39.542817+0000","last_became_active":"2023-08-31T19:24:39.536655+0000","last_became_peered":"2023-08-31T19:24:39.536655+0000","last_unstale":"2023-08-31T19:24:39.542817+0000","last_undegraded":"2023-08-31T19:24:39.542817+0000","last_fullsized":"2023-08-31T19:24:39.542817+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.527425+0000","last_change":"2023-08-31T19:24:39.078857+0000","last_active":"2023-08-31T19:24:39.527425+0000","last_peered":"2023-08-31T19:24:39.527425+0000","last_clean":"2023-08-31T19:24:39.527425+0000","last_became_active":"2023-08-31T19:24:39.078234+0000","last_became_peered":"2023-08-31T19:24:39.078234+0000","last_unstale":"2023-08-31T19:24:39.527425+0000","last_undegraded":"2023-08-31T19:24:39.527425+0000","last_fullsized":"2023-08-31T19:24:39.527425+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.550249+0000","last_change":"2023-08-31T19:24:39.547632+0000","last_active":"2023-08-31T19:24:39.550249+0000","last_peered":"2023-08-31T19:24:39.550249+0000","last_clean":"2023-08-31T19:24:39.550249+0000","last_became_active":"2023-08-31T19:24:39.546985+0000","last_became_peered":"2023-08-31T19:24:39.546985+0000","last_unstale":"2023-08-31T19:24:39.550249+0000","last_undegraded":"2023-08-31T19:24:39.550249+0000","last_fullsized":"2023-08-31T19:24:39.550249+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.520005+0000","last_change":"2023-08-31T19:24:39.072194+0000","last_active":"2023-08-31T19:24:39.520005+0000","last_peered":"2023-08-31T19:24:39.520005+0000","last_clean":"2023-08-31T19:24:39.520005+0000","last_became_active":"2023-08-31T19:24:39.071852+0000","last_became_peered":"2023-08-31T19:24:39.071852+0000","last_unstale":"2023-08-31T19:24:39.520005+0000","last_undegraded":"2023-08-31T19:24:39.520005+0000","last_fullsized":"2023-08-31T19:24:39.520005+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544256+0000","last_change":"2023-08-31T19:24:39.538512+0000","last_active":"2023-08-31T19:24:39.544256+0000","last_peered":"2023-08-31T19:24:39.544256+0000","last_clean":"2023-08-31T19:24:39.544256+0000","last_became_active":"2023-08-31T19:24:39.538070+0000","last_became_peered":"2023-08-31T19:24:39.538070+0000","last_unstale":"2023-08-31T19:24:39.544256+0000","last_undegraded":"2023-08-31T19:24:39.544256+0000","last_fullsized":"2023-08-31T19:24:39.544256+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.538099+0000","last_change":"2023-08-31T19:24:39.074512+0000","last_active":"2023-08-31T19:24:39.538099+0000","last_peered":"2023-08-31T19:24:39.538099+0000","last_clean":"2023-08-31T19:24:39.538099+0000","last_became_active":"2023-08-31T19:24:39.074214+0000","last_became_peered":"2023-08-31T19:24:39.074214+0000","last_unstale":"2023-08-31T19:24:39.538099+0000","last_undegraded":"2023-08-31T19:24:39.538099+0000","last_fullsized":"2023-08-31T19:24:39.538099+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.540763+0000","last_change":"2023-08-31T19:24:39.528653+0000","last_active":"2023-08-31T19:24:39.540763+0000","last_peered":"2023-08-31T19:24:39.540763+0000","last_clean":"2023-08-31T19:24:39.540763+0000","last_became_active":"2023-08-31T19:24:39.528361+0000","last_became_peered":"2023-08-31T19:24:39.528361+0000","last_unstale":"2023-08-31T19:24:39.540763+0000","last_undegraded":"2023-08-31T19:24:39.540763+0000","last_fullsized":"2023-08-31T19:24:39.540763+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.518566+0000","last_change":"2023-08-31T19:24:39.071523+0000","last_active":"2023-08-31T19:24:39.518566+0000","last_peered":"2023-08-31T19:24:39.518566+0000","last_clean":"2023-08-31T19:24:39.518566+0000","last_became_active":"2023-08-31T19:24:39.071267+0000","last_became_peered":"2023-08-31T19:24:39.071267+0000","last_unstale":"2023-08-31T19:24:39.518566+0000","last_undegraded":"2023-08-31T19:24:39.518566+0000","last_fullsized":"2023-08-31T19:24:39.518566+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.537716+0000","last_change":"2023-08-31T19:24:39.532454+0000","last_active":"2023-08-31T19:24:39.537716+0000","last_peered":"2023-08-31T19:24:39.537716+0000","last_clean":"2023-08-31T19:24:39.537716+0000","last_became_active":"2023-08-31T19:24:39.532199+0000","last_became_peered":"2023-08-31T19:24:39.532199+0000","last_unstale":"2023-08-31T19:24:39.537716+0000","last_undegraded":"2023-08-31T19:24:39.537716+0000","last_fullsized":"2023-08-31T19:24:39.537716+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545281+0000","last_change":"2023-08-31T19:24:39.079711+0000","last_active":"2023-08-31T19:24:39.545281+0000","last_peered":"2023-08-31T19:24:39.545281+0000","last_clean":"2023-08-31T19:24:39.545281+0000","last_became_active":"2023-08-31T19:24:39.079431+0000","last_became_peered":"2023-08-31T19:24:39.079431+0000","last_unstale":"2023-08-31T19:24:39.545281+0000","last_undegraded":"2023-08-31T19:24:39.545281+0000","last_fullsized":"2023-08-31T19:24:39.545281+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.543255+0000","last_change":"2023-08-31T19:24:39.537784+0000","last_active":"2023-08-31T19:24:39.543255+0000","last_peered":"2023-08-31T19:24:39.543255+0000","last_clean":"2023-08-31T19:24:39.543255+0000","last_became_active":"2023-08-31T19:24:39.537444+0000","last_became_peered":"2023-08-31T19:24:39.537444+0000","last_unstale":"2023-08-31T19:24:39.543255+0000","last_undegraded":"2023-08-31T19:24:39.543255+0000","last_fullsized":"2023-08-31T19:24:39.543255+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.517758+0000","last_change":"2023-08-31T19:24:39.078027+0000","last_active":"2023-08-31T19:24:39.517758+0000","last_peered":"2023-08-31T19:24:39.517758+0000","last_clean":"2023-08-31T19:24:39.517758+0000","last_became_active":"2023-08-31T19:24:39.077361+0000","last_became_peered":"2023-08-31T19:24:39.077361+0000","last_unstale":"2023-08-31T19:24:39.517758+0000","last_undegraded":"2023-08-31T19:24:39.517758+0000","last_fullsized":"2023-08-31T19:24:39.517758+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545717+0000","last_change":"2023-08-31T19:24:39.539022+0000","last_active":"2023-08-31T19:24:39.545717+0000","last_peered":"2023-08-31T19:24:39.545717+0000","last_clean":"2023-08-31T19:24:39.545717+0000","last_became_active":"2023-08-31T19:24:39.538738+0000","last_became_peered":"2023-08-31T19:24:39.538738+0000","last_unstale":"2023-08-31T19:24:39.545717+0000","last_undegraded":"2023-08-31T19:24:39.545717+0000","last_fullsized":"2023-08-31T19:24:39.545717+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.517329+0000","last_change":"2023-08-31T19:24:39.070708+0000","last_active":"2023-08-31T19:24:39.517329+0000","last_peered":"2023-08-31T19:24:39.517329+0000","last_clean":"2023-08-31T19:24:39.517329+0000","last_became_active":"2023-08-31T19:24:39.070224+0000","last_became_peered":"2023-08-31T19:24:39.070224+0000","last_unstale":"2023-08-31T19:24:39.517329+0000","last_undegraded":"2023-08-31T19:24:39.517329+0000","last_fullsized":"2023-08-31T19:24:39.517329+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547110+0000","last_change":"2023-08-31T19:24:39.544113+0000","last_active":"2023-08-31T19:24:39.547110+0000","last_peered":"2023-08-31T19:24:39.547110+0000","last_clean":"2023-08-31T19:24:39.547110+0000","last_became_active":"2023-08-31T19:24:39.543812+0000","last_became_peered":"2023-08-31T19:24:39.543812+0000","last_unstale":"2023-08-31T19:24:39.547110+0000","last_undegraded":"2023-08-31T19:24:39.547110+0000","last_fullsized":"2023-08-31T19:24:39.547110+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.522210+0000","last_change":"2023-08-31T19:24:39.080460+0000","last_active":"2023-08-31T19:24:39.522210+0000","last_peered":"2023-08-31T19:24:39.522210+0000","last_clean":"2023-08-31T19:24:39.522210+0000","last_became_active":"2023-08-31T19:24:39.080103+0000","last_became_peered":"2023-08-31T19:24:39.080103+0000","last_unstale":"2023-08-31T19:24:39.522210+0000","last_undegraded":"2023-08-31T19:24:39.522210+0000","last_fullsized":"2023-08-31T19:24:39.522210+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.532151+0000","last_change":"2023-08-31T19:24:39.527860+0000","last_active":"2023-08-31T19:24:39.532151+0000","last_peered":"2023-08-31T19:24:39.532151+0000","last_clean":"2023-08-31T19:24:39.532151+0000","last_became_active":"2023-08-31T19:24:39.527587+0000","last_became_peered":"2023-08-31T19:24:39.527587+0000","last_unstale":"2023-08-31T19:24:39.532151+0000","last_undegraded":"2023-08-31T19:24:39.532151+0000","last_fullsized":"2023-08-31T19:24:39.532151+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.520246+0000","last_change":"2023-08-31T19:24:39.076682+0000","last_active":"2023-08-31T19:24:39.520246+0000","last_peered":"2023-08-31T19:24:39.520246+0000","last_clean":"2023-08-31T19:24:39.520246+0000","last_became_active":"2023-08-31T19:24:39.076411+0000","last_became_peered":"2023-08-31T19:24:39.076411+0000","last_unstale":"2023-08-31T19:24:39.520246+0000","last_undegraded":"2023-08-31T19:24:39.520246+0000","last_fullsized":"2023-08-31T19:24:39.520246+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547159+0000","last_change":"2023-08-31T19:24:39.544480+0000","last_active":"2023-08-31T19:24:39.547159+0000","last_peered":"2023-08-31T19:24:39.547159+0000","last_clean":"2023-08-31T19:24:39.547159+0000","last_became_active":"2023-08-31T19:24:39.544184+0000","last_became_peered":"2023-08-31T19:24:39.544184+0000","last_unstale":"2023-08-31T19:24:39.547159+0000","last_undegraded":"2023-08-31T19:24:39.547159+0000","last_fullsized":"2023-08-31T19:24:39.547159+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.525305+0000","last_change":"2023-08-31T19:24:39.073478+0000","last_active":"2023-08-31T19:24:39.525305+0000","last_peered":"2023-08-31T19:24:39.525305+0000","last_clean":"2023-08-31T19:24:39.525305+0000","last_became_active":"2023-08-31T19:24:39.073192+0000","last_became_peered":"2023-08-31T19:24:39.073192+0000","last_unstale":"2023-08-31T19:24:39.525305+0000","last_undegraded":"2023-08-31T19:24:39.525305+0000","last_fullsized":"2023-08-31T19:24:39.525305+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545598+0000","last_change":"2023-08-31T19:24:39.535344+0000","last_active":"2023-08-31T19:24:39.545598+0000","last_peered":"2023-08-31T19:24:39.545598+0000","last_clean":"2023-08-31T19:24:39.545598+0000","last_became_active":"2023-08-31T19:24:39.534535+0000","last_became_peered":"2023-08-31T19:24:39.534535+0000","last_unstale":"2023-08-31T19:24:39.545598+0000","last_undegraded":"2023-08-31T19:24:39.545598+0000","last_fullsized":"2023-08-31T19:24:39.545598+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.518938+0000","last_change":"2023-08-31T19:24:39.069662+0000","last_active":"2023-08-31T19:24:39.518938+0000","last_peered":"2023-08-31T19:24:39.518938+0000","last_clean":"2023-08-31T19:24:39.518938+0000","last_became_active":"2023-08-31T19:24:39.069381+0000","last_became_peered":"2023-08-31T19:24:39.069381+0000","last_unstale":"2023-08-31T19:24:39.518938+0000","last_undegraded":"2023-08-31T19:24:39.518938+0000","last_fullsized":"2023-08-31T19:24:39.518938+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545925+0000","last_change":"2023-08-31T19:24:39.537282+0000","last_active":"2023-08-31T19:24:39.545925+0000","last_peered":"2023-08-31T19:24:39.545925+0000","last_clean":"2023-08-31T19:24:39.545925+0000","last_became_active":"2023-08-31T19:24:39.536968+0000","last_became_peered":"2023-08-31T19:24:39.536968+0000","last_unstale":"2023-08-31T19:24:39.545925+0000","last_undegraded":"2023-08-31T19:24:39.545925+0000","last_fullsized":"2023-08-31T19:24:39.545925+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.515777+0000","last_change":"2023-08-31T19:24:39.064255+0000","last_active":"2023-08-31T19:24:39.515777+0000","last_peered":"2023-08-31T19:24:39.515777+0000","last_clean":"2023-08-31T19:24:39.515777+0000","last_became_active":"2023-08-31T19:24:39.063912+0000","last_became_peered":"2023-08-31T19:24:39.063912+0000","last_unstale":"2023-08-31T19:24:39.515777+0000","last_undegraded":"2023-08-31T19:24:39.515777+0000","last_fullsized":"2023-08-31T19:24:39.515777+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541834+0000","last_change":"2023-08-31T19:24:39.531912+0000","last_active":"2023-08-31T19:24:39.541834+0000","last_peered":"2023-08-31T19:24:39.541834+0000","last_clean":"2023-08-31T19:24:39.541834+0000","last_became_active":"2023-08-31T19:24:39.531579+0000","last_became_peered":"2023-08-31T19:24:39.531579+0000","last_unstale":"2023-08-31T19:24:39.541834+0000","last_undegraded":"2023-08-31T19:24:39.541834+0000","last_fullsized":"2023-08-31T19:24:39.541834+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.526547+0000","last_change":"2023-08-31T19:24:39.079204+0000","last_active":"2023-08-31T19:24:39.526547+0000","last_peered":"2023-08-31T19:24:39.526547+0000","last_clean":"2023-08-31T19:24:39.526547+0000","last_became_active":"2023-08-31T19:24:39.078874+0000","last_became_peered":"2023-08-31T19:24:39.078874+0000","last_unstale":"2023-08-31T19:24:39.526547+0000","last_undegraded":"2023-08-31T19:24:39.526547+0000","last_fullsized":"2023-08-31T19:24:39.526547+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547045+0000","last_change":"2023-08-31T19:24:39.544457+0000","last_active":"2023-08-31T19:24:39.547045+0000","last_peered":"2023-08-31T19:24:39.547045+0000","last_clean":"2023-08-31T19:24:39.547045+0000","last_became_active":"2023-08-31T19:24:39.544053+0000","last_became_peered":"2023-08-31T19:24:39.544053+0000","last_unstale":"2023-08-31T19:24:39.547045+0000","last_undegraded":"2023-08-31T19:24:39.547045+0000","last_fullsized":"2023-08-31T19:24:39.547045+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.517828+0000","last_change":"2023-08-31T19:24:39.079722+0000","last_active":"2023-08-31T19:24:39.517828+0000","last_peered":"2023-08-31T19:24:39.517828+0000","last_clean":"2023-08-31T19:24:39.517828+0000","last_became_active":"2023-08-31T19:24:39.079278+0000","last_became_peered":"2023-08-31T19:24:39.079278+0000","last_unstale":"2023-08-31T19:24:39.517828+0000","last_undegraded":"2023-08-31T19:24:39.517828+0000","last_fullsized":"2023-08-31T19:24:39.517828+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.537534+0000","last_change":"2023-08-31T19:24:39.531728+0000","last_active":"2023-08-31T19:24:39.537534+0000","last_peered":"2023-08-31T19:24:39.537534+0000","last_clean":"2023-08-31T19:24:39.537534+0000","last_became_active":"2023-08-31T19:24:39.531437+0000","last_became_peered":"2023-08-31T19:24:39.531437+0000","last_unstale":"2023-08-31T19:24:39.537534+0000","last_undegraded":"2023-08-31T19:24:39.537534+0000","last_fullsized":"2023-08-31T19:24:39.537534+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.523592+0000","last_change":"2023-08-31T19:24:39.078227+0000","last_active":"2023-08-31T19:24:39.523592+0000","last_peered":"2023-08-31T19:24:39.523592+0000","last_clean":"2023-08-31T19:24:39.523592+0000","last_became_active":"2023-08-31T19:24:39.077943+0000","last_became_peered":"2023-08-31T19:24:39.077943+0000","last_unstale":"2023-08-31T19:24:39.523592+0000","last_undegraded":"2023-08-31T19:24:39.523592+0000","last_fullsized":"2023-08-31T19:24:39.523592+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.543218+0000","last_change":"2023-08-31T19:24:39.534824+0000","last_active":"2023-08-31T19:24:39.543218+0000","last_peered":"2023-08-31T19:24:39.543218+0000","last_clean":"2023-08-31T19:24:39.543218+0000","last_became_active":"2023-08-31T19:24:39.533894+0000","last_became_peered":"2023-08-31T19:24:39.533894+0000","last_unstale":"2023-08-31T19:24:39.543218+0000","last_undegraded":"2023-08-31T19:24:39.543218+0000","last_fullsized":"2023-08-31T19:24:39.543218+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.518219+0000","last_change":"2023-08-31T19:24:39.083110+0000","last_active":"2023-08-31T19:24:39.518219+0000","last_peered":"2023-08-31T19:24:39.518219+0000","last_clean":"2023-08-31T19:24:39.518219+0000","last_became_active":"2023-08-31T19:24:39.082824+0000","last_became_peered":"2023-08-31T19:24:39.082824+0000","last_unstale":"2023-08-31T19:24:39.518219+0000","last_undegraded":"2023-08-31T19:24:39.518219+0000","last_fullsized":"2023-08-31T19:24:39.518219+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547923+0000","last_change":"2023-08-31T19:24:39.543278+0000","last_active":"2023-08-31T19:24:39.547923+0000","last_peered":"2023-08-31T19:24:39.547923+0000","last_clean":"2023-08-31T19:24:39.547923+0000","last_became_active":"2023-08-31T19:24:39.542978+0000","last_became_peered":"2023-08-31T19:24:39.542978+0000","last_unstale":"2023-08-31T19:24:39.547923+0000","last_undegraded":"2023-08-31T19:24:39.547923+0000","last_fullsized":"2023-08-31T19:24:39.547923+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.536274+0000","last_change":"2023-08-31T19:24:39.071451+0000","last_active":"2023-08-31T19:24:39.536274+0000","last_peered":"2023-08-31T19:24:39.536274+0000","last_clean":"2023-08-31T19:24:39.536274+0000","last_became_active":"2023-08-31T19:24:39.070810+0000","last_became_peered":"2023-08-31T19:24:39.070810+0000","last_unstale":"2023-08-31T19:24:39.536274+0000","last_undegraded":"2023-08-31T19:24:39.536274+0000","last_fullsized":"2023-08-31T19:24:39.536274+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.548394+0000","last_change":"2023-08-31T19:24:39.543626+0000","last_active":"2023-08-31T19:24:39.548394+0000","last_peered":"2023-08-31T19:24:39.548394+0000","last_clean":"2023-08-31T19:24:39.548394+0000","last_became_active":"2023-08-31T19:24:39.543253+0000","last_became_peered":"2023-08-31T19:24:39.543253+0000","last_unstale":"2023-08-31T19:24:39.548394+0000","last_undegraded":"2023-08-31T19:24:39.548394+0000","last_fullsized":"2023-08-31T19:24:39.548394+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.542919+0000","last_change":"2023-08-31T19:24:39.084146+0000","last_active":"2023-08-31T19:24:39.542919+0000","last_peered":"2023-08-31T19:24:39.542919+0000","last_clean":"2023-08-31T19:24:39.542919+0000","last_became_active":"2023-08-31T19:24:39.083799+0000","last_became_peered":"2023-08-31T19:24:39.083799+0000","last_unstale":"2023-08-31T19:24:39.542919+0000","last_undegraded":"2023-08-31T19:24:39.542919+0000","last_fullsized":"2023-08-31T19:24:39.542919+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.542671+0000","last_change":"2023-08-31T19:24:39.530176+0000","last_active":"2023-08-31T19:24:39.542671+0000","last_peered":"2023-08-31T19:24:39.542671+0000","last_clean":"2023-08-31T19:24:39.542671+0000","last_became_active":"2023-08-31T19:24:39.529875+0000","last_became_peered":"2023-08-31T19:24:39.529875+0000","last_unstale":"2023-08-31T19:24:39.542671+0000","last_undegraded":"2023-08-31T19:24:39.542671+0000","last_fullsized":"2023-08-31T19:24:39.542671+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.548627+0000","last_change":"2023-08-31T19:24:39.084630+0000","last_active":"2023-08-31T19:24:39.548627+0000","last_peered":"2023-08-31T19:24:39.548627+0000","last_clean":"2023-08-31T19:24:39.548627+0000","last_became_active":"2023-08-31T19:24:39.084328+0000","last_became_peered":"2023-08-31T19:24:39.084328+0000","last_unstale":"2023-08-31T19:24:39.548627+0000","last_undegraded":"2023-08-31T19:24:39.548627+0000","last_fullsized":"2023-08-31T19:24:39.548627+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.546526+0000","last_change":"2023-08-31T19:24:39.544190+0000","last_active":"2023-08-31T19:24:39.546526+0000","last_peered":"2023-08-31T19:24:39.546526+0000","last_clean":"2023-08-31T19:24:39.546526+0000","last_became_active":"2023-08-31T19:24:39.543529+0000","last_became_peered":"2023-08-31T19:24:39.543529+0000","last_unstale":"2023-08-31T19:24:39.546526+0000","last_undegraded":"2023-08-31T19:24:39.546526+0000","last_fullsized":"2023-08-31T19:24:39.546526+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.528261+0000","last_change":"2023-08-31T19:24:39.079588+0000","last_active":"2023-08-31T19:24:39.528261+0000","last_peered":"2023-08-31T19:24:39.528261+0000","last_clean":"2023-08-31T19:24:39.528261+0000","last_became_active":"2023-08-31T19:24:39.079305+0000","last_became_peered":"2023-08-31T19:24:39.079305+0000","last_unstale":"2023-08-31T19:24:39.528261+0000","last_undegraded":"2023-08-31T19:24:39.528261+0000","last_fullsized":"2023-08-31T19:24:39.528261+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.531562+0000","last_change":"2023-08-31T19:24:39.522594+0000","last_active":"2023-08-31T19:24:39.531562+0000","last_peered":"2023-08-31T19:24:39.531562+0000","last_clean":"2023-08-31T19:24:39.531562+0000","last_became_active":"2023-08-31T19:24:39.522310+0000","last_became_peered":"2023-08-31T19:24:39.522310+0000","last_unstale":"2023-08-31T19:24:39.531562+0000","last_undegraded":"2023-08-31T19:24:39.531562+0000","last_fullsized":"2023-08-31T19:24:39.531562+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.517653+0000","last_change":"2023-08-31T19:24:39.077713+0000","last_active":"2023-08-31T19:24:39.517653+0000","last_peered":"2023-08-31T19:24:39.517653+0000","last_clean":"2023-08-31T19:24:39.517653+0000","last_became_active":"2023-08-31T19:24:39.077338+0000","last_became_peered":"2023-08-31T19:24:39.077338+0000","last_unstale":"2023-08-31T19:24:39.517653+0000","last_undegraded":"2023-08-31T19:24:39.517653+0000","last_fullsized":"2023-08-31T19:24:39.517653+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.542601+0000","last_change":"2023-08-31T19:24:39.539204+0000","last_active":"2023-08-31T19:24:39.542601+0000","last_peered":"2023-08-31T19:24:39.542601+0000","last_clean":"2023-08-31T19:24:39.542601+0000","last_became_active":"2023-08-31T19:24:39.538461+0000","last_became_peered":"2023-08-31T19:24:39.538461+0000","last_unstale":"2023-08-31T19:24:39.542601+0000","last_undegraded":"2023-08-31T19:24:39.542601+0000","last_fullsized":"2023-08-31T19:24:39.542601+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.525356+0000","last_change":"2023-08-31T19:24:39.081932+0000","last_active":"2023-08-31T19:24:39.525356+0000","last_peered":"2023-08-31T19:24:39.525356+0000","last_clean":"2023-08-31T19:24:39.525356+0000","last_became_active":"2023-08-31T19:24:39.081648+0000","last_became_peered":"2023-08-31T19:24:39.081648+0000","last_unstale":"2023-08-31T19:24:39.525356+0000","last_undegraded":"2023-08-31T19:24:39.525356+0000","last_fullsized":"2023-08-31T19:24:39.525356+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.540843+0000","last_change":"2023-08-31T19:24:39.536305+0000","last_active":"2023-08-31T19:24:39.540843+0000","last_peered":"2023-08-31T19:24:39.540843+0000","last_clean":"2023-08-31T19:24:39.540843+0000","last_became_active":"2023-08-31T19:24:39.536046+0000","last_became_peered":"2023-08-31T19:24:39.536046+0000","last_unstale":"2023-08-31T19:24:39.540843+0000","last_undegraded":"2023-08-31T19:24:39.540843+0000","last_fullsized":"2023-08-31T19:24:39.540843+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.521763+0000","last_change":"2023-08-31T19:24:39.078602+0000","last_active":"2023-08-31T19:24:39.521763+0000","last_peered":"2023-08-31T19:24:39.521763+0000","last_clean":"2023-08-31T19:24:39.521763+0000","last_became_active":"2023-08-31T19:24:39.078237+0000","last_became_peered":"2023-08-31T19:24:39.078237+0000","last_unstale":"2023-08-31T19:24:39.521763+0000","last_undegraded":"2023-08-31T19:24:39.521763+0000","last_fullsized":"2023-08-31T19:24:39.521763+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545735+0000","last_change":"2023-08-31T19:24:39.537274+0000","last_active":"2023-08-31T19:24:39.545735+0000","last_peered":"2023-08-31T19:24:39.545735+0000","last_clean":"2023-08-31T19:24:39.545735+0000","last_became_active":"2023-08-31T19:24:39.536961+0000","last_became_peered":"2023-08-31T19:24:39.536961+0000","last_unstale":"2023-08-31T19:24:39.545735+0000","last_undegraded":"2023-08-31T19:24:39.545735+0000","last_fullsized":"2023-08-31T19:24:39.545735+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.523830+0000","last_change":"2023-08-31T19:24:39.084396+0000","last_active":"2023-08-31T19:24:39.523830+0000","last_peered":"2023-08-31T19:24:39.523830+0000","last_clean":"2023-08-31T19:24:39.523830+0000","last_became_active":"2023-08-31T19:24:39.084041+0000","last_became_peered":"2023-08-31T19:24:39.084041+0000","last_unstale":"2023-08-31T19:24:39.523830+0000","last_undegraded":"2023-08-31T19:24:39.523830+0000","last_fullsized":"2023-08-31T19:24:39.523830+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.546249+0000","last_change":"2023-08-31T19:24:39.542749+0000","last_active":"2023-08-31T19:24:39.546249+0000","last_peered":"2023-08-31T19:24:39.546249+0000","last_clean":"2023-08-31T19:24:39.546249+0000","last_became_active":"2023-08-31T19:24:39.542457+0000","last_became_peered":"2023-08-31T19:24:39.542457+0000","last_unstale":"2023-08-31T19:24:39.546249+0000","last_undegraded":"2023-08-31T19:24:39.546249+0000","last_fullsized":"2023-08-31T19:24:39.546249+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544797+0000","last_change":"2023-08-31T19:24:39.079220+0000","last_active":"2023-08-31T19:24:39.544797+0000","last_peered":"2023-08-31T19:24:39.544797+0000","last_clean":"2023-08-31T19:24:39.544797+0000","last_became_active":"2023-08-31T19:24:39.078945+0000","last_became_peered":"2023-08-31T19:24:39.078945+0000","last_unstale":"2023-08-31T19:24:39.544797+0000","last_undegraded":"2023-08-31T19:24:39.544797+0000","last_fullsized":"2023-08-31T19:24:39.544797+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.550227+0000","last_change":"2023-08-31T19:24:39.547295+0000","last_active":"2023-08-31T19:24:39.550227+0000","last_peered":"2023-08-31T19:24:39.550227+0000","last_clean":"2023-08-31T19:24:39.550227+0000","last_became_active":"2023-08-31T19:24:39.546518+0000","last_became_peered":"2023-08-31T19:24:39.546518+0000","last_unstale":"2023-08-31T19:24:39.550227+0000","last_undegraded":"2023-08-31T19:24:39.550227+0000","last_fullsized":"2023-08-31T19:24:39.550227+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544015+0000","last_change":"2023-08-31T19:24:39.075401+0000","last_active":"2023-08-31T19:24:39.544015+0000","last_peered":"2023-08-31T19:24:39.544015+0000","last_clean":"2023-08-31T19:24:39.544015+0000","last_became_active":"2023-08-31T19:24:39.075097+0000","last_became_peered":"2023-08-31T19:24:39.075097+0000","last_unstale":"2023-08-31T19:24:39.544015+0000","last_undegraded":"2023-08-31T19:24:39.544015+0000","last_fullsized":"2023-08-31T19:24:39.544015+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545617+0000","last_change":"2023-08-31T19:24:39.536322+0000","last_active":"2023-08-31T19:24:39.545617+0000","last_peered":"2023-08-31T19:24:39.545617+0000","last_clean":"2023-08-31T19:24:39.545617+0000","last_became_active":"2023-08-31T19:24:39.534924+0000","last_became_peered":"2023-08-31T19:24:39.534924+0000","last_unstale":"2023-08-31T19:24:39.545617+0000","last_undegraded":"2023-08-31T19:24:39.545617+0000","last_fullsized":"2023-08-31T19:24:39.545617+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.528730+0000","last_change":"2023-08-31T19:24:39.079450+0000","last_active":"2023-08-31T19:24:39.528730+0000","last_peered":"2023-08-31T19:24:39.528730+0000","last_clean":"2023-08-31T19:24:39.528730+0000","last_became_active":"2023-08-31T19:24:39.078855+0000","last_became_peered":"2023-08-31T19:24:39.078855+0000","last_unstale":"2023-08-31T19:24:39.528730+0000","last_undegraded":"2023-08-31T19:24:39.528730+0000","last_fullsized":"2023-08-31T19:24:39.528730+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.545905+0000","last_change":"2023-08-31T19:24:39.536356+0000","last_active":"2023-08-31T19:24:39.545905+0000","last_peered":"2023-08-31T19:24:39.545905+0000","last_clean":"2023-08-31T19:24:39.545905+0000","last_became_active":"2023-08-31T19:24:39.535392+0000","last_became_peered":"2023-08-31T19:24:39.535392+0000","last_unstale":"2023-08-31T19:24:39.545905+0000","last_undegraded":"2023-08-31T19:24:39.545905+0000","last_fullsized":"2023-08-31T19:24:39.545905+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.519549+0000","last_change":"2023-08-31T19:24:39.077349+0000","last_active":"2023-08-31T19:24:39.519549+0000","last_peered":"2023-08-31T19:24:39.519549+0000","last_clean":"2023-08-31T19:24:39.519549+0000","last_became_active":"2023-08-31T19:24:39.077046+0000","last_became_peered":"2023-08-31T19:24:39.077046+0000","last_unstale":"2023-08-31T19:24:39.519549+0000","last_undegraded":"2023-08-31T19:24:39.519549+0000","last_fullsized":"2023-08-31T19:24:39.519549+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544822+0000","last_change":"2023-08-31T19:24:39.537611+0000","last_active":"2023-08-31T19:24:39.544822+0000","last_peered":"2023-08-31T19:24:39.544822+0000","last_clean":"2023-08-31T19:24:39.544822+0000","last_became_active":"2023-08-31T19:24:39.537306+0000","last_became_peered":"2023-08-31T19:24:39.537306+0000","last_unstale":"2023-08-31T19:24:39.544822+0000","last_undegraded":"2023-08-31T19:24:39.544822+0000","last_fullsized":"2023-08-31T19:24:39.544822+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.535211+0000","last_change":"2023-08-31T19:24:39.078200+0000","last_active":"2023-08-31T19:24:39.535211+0000","last_peered":"2023-08-31T19:24:39.535211+0000","last_clean":"2023-08-31T19:24:39.535211+0000","last_became_active":"2023-08-31T19:24:39.077905+0000","last_became_peered":"2023-08-31T19:24:39.077905+0000","last_unstale":"2023-08-31T19:24:39.535211+0000","last_undegraded":"2023-08-31T19:24:39.535211+0000","last_fullsized":"2023-08-31T19:24:39.535211+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.543525+0000","last_change":"2023-08-31T19:24:39.539629+0000","last_active":"2023-08-31T19:24:39.543525+0000","last_peered":"2023-08-31T19:24:39.543525+0000","last_clean":"2023-08-31T19:24:39.543525+0000","last_became_active":"2023-08-31T19:24:39.539354+0000","last_became_peered":"2023-08-31T19:24:39.539354+0000","last_unstale":"2023-08-31T19:24:39.543525+0000","last_undegraded":"2023-08-31T19:24:39.543525+0000","last_fullsized":"2023-08-31T19:24:39.543525+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.517856+0000","last_change":"2023-08-31T19:24:39.079547+0000","last_active":"2023-08-31T19:24:39.517856+0000","last_peered":"2023-08-31T19:24:39.517856+0000","last_clean":"2023-08-31T19:24:39.517856+0000","last_became_active":"2023-08-31T19:24:39.078919+0000","last_became_peered":"2023-08-31T19:24:39.078919+0000","last_unstale":"2023-08-31T19:24:39.517856+0000","last_undegraded":"2023-08-31T19:24:39.517856+0000","last_fullsized":"2023-08-31T19:24:39.517856+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.546247+0000","last_change":"2023-08-31T19:24:39.542793+0000","last_active":"2023-08-31T19:24:39.546247+0000","last_peered":"2023-08-31T19:24:39.546247+0000","last_clean":"2023-08-31T19:24:39.546247+0000","last_became_active":"2023-08-31T19:24:39.542490+0000","last_became_peered":"2023-08-31T19:24:39.542490+0000","last_unstale":"2023-08-31T19:24:39.546247+0000","last_undegraded":"2023-08-31T19:24:39.546247+0000","last_fullsized":"2023-08-31T19:24:39.546247+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.514858+0000","last_change":"2023-08-31T19:24:39.066792+0000","last_active":"2023-08-31T19:24:39.514858+0000","last_peered":"2023-08-31T19:24:39.514858+0000","last_clean":"2023-08-31T19:24:39.514858+0000","last_became_active":"2023-08-31T19:24:39.066482+0000","last_became_peered":"2023-08-31T19:24:39.066482+0000","last_unstale":"2023-08-31T19:24:39.514858+0000","last_undegraded":"2023-08-31T19:24:39.514858+0000","last_fullsized":"2023-08-31T19:24:39.514858+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547886+0000","last_change":"2023-08-31T19:24:39.543306+0000","last_active":"2023-08-31T19:24:39.547886+0000","last_peered":"2023-08-31T19:24:39.547886+0000","last_clean":"2023-08-31T19:24:39.547886+0000","last_became_active":"2023-08-31T19:24:39.543080+0000","last_became_peered":"2023-08-31T19:24:39.543080+0000","last_unstale":"2023-08-31T19:24:39.547886+0000","last_undegraded":"2023-08-31T19:24:39.547886+0000","last_fullsized":"2023-08-31T19:24:39.547886+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.517329+0000","last_change":"2023-08-31T19:24:39.071323+0000","last_active":"2023-08-31T19:24:39.517329+0000","last_peered":"2023-08-31T19:24:39.517329+0000","last_clean":"2023-08-31T19:24:39.517329+0000","last_became_active":"2023-08-31T19:24:39.071001+0000","last_became_peered":"2023-08-31T19:24:39.071001+0000","last_unstale":"2023-08-31T19:24:39.517329+0000","last_undegraded":"2023-08-31T19:24:39.517329+0000","last_fullsized":"2023-08-31T19:24:39.517329+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541474+0000","last_change":"2023-08-31T19:24:39.538487+0000","last_active":"2023-08-31T19:24:39.541474+0000","last_peered":"2023-08-31T19:24:39.541474+0000","last_clean":"2023-08-31T19:24:39.541474+0000","last_became_active":"2023-08-31T19:24:39.538196+0000","last_became_peered":"2023-08-31T19:24:39.538196+0000","last_unstale":"2023-08-31T19:24:39.541474+0000","last_undegraded":"2023-08-31T19:24:39.541474+0000","last_fullsized":"2023-08-31T19:24:39.541474+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.546674+0000","last_change":"2023-08-31T19:24:39.077833+0000","last_active":"2023-08-31T19:24:39.546674+0000","last_peered":"2023-08-31T19:24:39.546674+0000","last_clean":"2023-08-31T19:24:39.546674+0000","last_became_active":"2023-08-31T19:24:39.077536+0000","last_became_peered":"2023-08-31T19:24:39.077536+0000","last_unstale":"2023-08-31T19:24:39.546674+0000","last_undegraded":"2023-08-31T19:24:39.546674+0000","last_fullsized":"2023-08-31T19:24:39.546674+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541431+0000","last_change":"2023-08-31T19:24:39.532165+0000","last_active":"2023-08-31T19:24:39.541431+0000","last_peered":"2023-08-31T19:24:39.541431+0000","last_clean":"2023-08-31T19:24:39.541431+0000","last_became_active":"2023-08-31T19:24:39.531818+0000","last_became_peered":"2023-08-31T19:24:39.531818+0000","last_unstale":"2023-08-31T19:24:39.541431+0000","last_undegraded":"2023-08-31T19:24:39.541431+0000","last_fullsized":"2023-08-31T19:24:39.541431+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.525271+0000","last_change":"2023-08-31T19:24:39.079047+0000","last_active":"2023-08-31T19:24:39.525271+0000","last_peered":"2023-08-31T19:24:39.525271+0000","last_clean":"2023-08-31T19:24:39.525271+0000","last_became_active":"2023-08-31T19:24:39.078728+0000","last_became_peered":"2023-08-31T19:24:39.078728+0000","last_unstale":"2023-08-31T19:24:39.525271+0000","last_undegraded":"2023-08-31T19:24:39.525271+0000","last_fullsized":"2023-08-31T19:24:39.525271+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547373+0000","last_change":"2023-08-31T19:24:39.543503+0000","last_active":"2023-08-31T19:24:39.547373+0000","last_peered":"2023-08-31T19:24:39.547373+0000","last_clean":"2023-08-31T19:24:39.547373+0000","last_became_active":"2023-08-31T19:24:39.543228+0000","last_became_peered":"2023-08-31T19:24:39.543228+0000","last_unstale":"2023-08-31T19:24:39.547373+0000","last_undegraded":"2023-08-31T19:24:39.547373+0000","last_fullsized":"2023-08-31T19:24:39.547373+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.528819+0000","last_change":"2023-08-31T19:24:39.079622+0000","last_active":"2023-08-31T19:24:39.528819+0000","last_peered":"2023-08-31T19:24:39.528819+0000","last_clean":"2023-08-31T19:24:39.528819+0000","last_became_active":"2023-08-31T19:24:39.079218+0000","last_became_peered":"2023-08-31T19:24:39.079218+0000","last_unstale":"2023-08-31T19:24:39.528819+0000","last_undegraded":"2023-08-31T19:24:39.528819+0000","last_fullsized":"2023-08-31T19:24:39.528819+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.547084+0000","last_change":"2023-08-31T19:24:39.541672+0000","last_active":"2023-08-31T19:24:39.547084+0000","last_peered":"2023-08-31T19:24:39.547084+0000","last_clean":"2023-08-31T19:24:39.547084+0000","last_became_active":"2023-08-31T19:24:39.541403+0000","last_became_peered":"2023-08-31T19:24:39.541403+0000","last_unstale":"2023-08-31T19:24:39.547084+0000","last_undegraded":"2023-08-31T19:24:39.547084+0000","last_fullsized":"2023-08-31T19:24:39.547084+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.526510+0000","last_change":"2023-08-31T19:24:39.077360+0000","last_active":"2023-08-31T19:24:39.526510+0000","last_peered":"2023-08-31T19:24:39.526510+0000","last_clean":"2023-08-31T19:24:39.526510+0000","last_became_active":"2023-08-31T19:24:39.076992+0000","last_became_peered":"2023-08-31T19:24:39.076992+0000","last_unstale":"2023-08-31T19:24:39.526510+0000","last_undegraded":"2023-08-31T19:24:39.526510+0000","last_fullsized":"2023-08-31T19:24:39.526510+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.527756+0000","last_change":"2023-08-31T19:24:39.523097+0000","last_active":"2023-08-31T19:24:39.527756+0000","last_peered":"2023-08-31T19:24:39.527756+0000","last_clean":"2023-08-31T19:24:39.527756+0000","last_became_active":"2023-08-31T19:24:39.522780+0000","last_became_peered":"2023-08-31T19:24:39.522780+0000","last_unstale":"2023-08-31T19:24:39.527756+0000","last_undegraded":"2023-08-31T19:24:39.527756+0000","last_fullsized":"2023-08-31T19:24:39.527756+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.521352+0000","last_change":"2023-08-31T19:24:39.087523+0000","last_active":"2023-08-31T19:24:39.521352+0000","last_peered":"2023-08-31T19:24:39.521352+0000","last_clean":"2023-08-31T19:24:39.521352+0000","last_became_active":"2023-08-31T19:24:39.087214+0000","last_became_peered":"2023-08-31T19:24:39.087214+0000","last_unstale":"2023-08-31T19:24:39.521352+0000","last_undegraded":"2023-08-31T19:24:39.521352+0000","last_fullsized":"2023-08-31T19:24:39.521352+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541403+0000","last_change":"2023-08-31T19:24:39.531528+0000","last_active":"2023-08-31T19:24:39.541403+0000","last_peered":"2023-08-31T19:24:39.541403+0000","last_clean":"2023-08-31T19:24:39.541403+0000","last_became_active":"2023-08-31T19:24:39.531145+0000","last_became_peered":"2023-08-31T19:24:39.531145+0000","last_unstale":"2023-08-31T19:24:39.541403+0000","last_undegraded":"2023-08-31T19:24:39.541403+0000","last_fullsized":"2023-08-31T19:24:39.541403+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.518521+0000","last_change":"2023-08-31T19:24:39.065193+0000","last_active":"2023-08-31T19:24:39.518521+0000","last_peered":"2023-08-31T19:24:39.518521+0000","last_clean":"2023-08-31T19:24:39.518521+0000","last_became_active":"2023-08-31T19:24:39.064908+0000","last_became_peered":"2023-08-31T19:24:39.064908+0000","last_unstale":"2023-08-31T19:24:39.518521+0000","last_undegraded":"2023-08-31T19:24:39.518521+0000","last_fullsized":"2023-08-31T19:24:39.518521+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.537913+0000","last_change":"2023-08-31T19:24:39.535456+0000","last_active":"2023-08-31T19:24:39.537913+0000","last_peered":"2023-08-31T19:24:39.537913+0000","last_clean":"2023-08-31T19:24:39.537913+0000","last_became_active":"2023-08-31T19:24:39.535186+0000","last_became_peered":"2023-08-31T19:24:39.535186+0000","last_unstale":"2023-08-31T19:24:39.537913+0000","last_undegraded":"2023-08-31T19:24:39.537913+0000","last_fullsized":"2023-08-31T19:24:39.537913+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.521648+0000","last_change":"2023-08-31T19:24:39.083850+0000","last_active":"2023-08-31T19:24:39.521648+0000","last_peered":"2023-08-31T19:24:39.521648+0000","last_clean":"2023-08-31T19:24:39.521648+0000","last_became_active":"2023-08-31T19:24:39.083474+0000","last_became_peered":"2023-08-31T19:24:39.083474+0000","last_unstale":"2023-08-31T19:24:39.521648+0000","last_undegraded":"2023-08-31T19:24:39.521648+0000","last_fullsized":"2023-08-31T19:24:39.521648+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.543197+0000","last_change":"2023-08-31T19:24:39.534021+0000","last_active":"2023-08-31T19:24:39.543197+0000","last_peered":"2023-08-31T19:24:39.543197+0000","last_clean":"2023-08-31T19:24:39.543197+0000","last_became_active":"2023-08-31T19:24:39.533702+0000","last_became_peered":"2023-08-31T19:24:39.533702+0000","last_unstale":"2023-08-31T19:24:39.543197+0000","last_undegraded":"2023-08-31T19:24:39.543197+0000","last_fullsized":"2023-08-31T19:24:39.543197+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.522348+0000","last_change":"2023-08-31T19:24:39.083312+0000","last_active":"2023-08-31T19:24:39.522348+0000","last_peered":"2023-08-31T19:24:39.522348+0000","last_clean":"2023-08-31T19:24:39.522348+0000","last_became_active":"2023-08-31T19:24:39.083034+0000","last_became_peered":"2023-08-31T19:24:39.083034+0000","last_unstale":"2023-08-31T19:24:39.522348+0000","last_undegraded":"2023-08-31T19:24:39.522348+0000","last_fullsized":"2023-08-31T19:24:39.522348+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544415+0000","last_change":"2023-08-31T19:24:39.539506+0000","last_active":"2023-08-31T19:24:39.544415+0000","last_peered":"2023-08-31T19:24:39.544415+0000","last_clean":"2023-08-31T19:24:39.544415+0000","last_became_active":"2023-08-31T19:24:39.539127+0000","last_became_peered":"2023-08-31T19:24:39.539127+0000","last_unstale":"2023-08-31T19:24:39.544415+0000","last_undegraded":"2023-08-31T19:24:39.544415+0000","last_fullsized":"2023-08-31T19:24:39.544415+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"175'1","reported_seq":11,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541830+0000","last_change":"2023-08-31T19:24:39.070666+0000","last_active":"2023-08-31T19:24:39.541830+0000","last_peered":"2023-08-31T19:24:39.541830+0000","last_clean":"2023-08-31T19:24:39.541830+0000","last_became_active":"2023-08-31T19:24:39.070396+0000","last_became_peered":"2023-08-31T19:24:39.070396+0000","last_unstale":"2023-08-31T19:24:39.541830+0000","last_undegraded":"2023-08-31T19:24:39.541830+0000","last_fullsized":"2023-08-31T19:24:39.541830+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":158,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.528117+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:24:39.528117+0000","last_peered":"2023-08-31T19:24:39.528117+0000","last_clean":"2023-08-31T19:24:39.528117+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:24:39.528117+0000","last_undegraded":"2023-08-31T19:24:39.528117+0000","last_fullsized":"2023-08-31T19:24:39.528117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544234+0000","last_change":"2023-08-31T19:24:39.538334+0000","last_active":"2023-08-31T19:24:39.544234+0000","last_peered":"2023-08-31T19:24:39.544234+0000","last_clean":"2023-08-31T19:24:39.544234+0000","last_became_active":"2023-08-31T19:24:39.537566+0000","last_became_peered":"2023-08-31T19:24:39.537566+0000","last_unstale":"2023-08-31T19:24:39.544234+0000","last_undegraded":"2023-08-31T19:24:39.544234+0000","last_fullsized":"2023-08-31T19:24:39.544234+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"175'3","reported_seq":13,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541876+0000","last_change":"2023-08-31T19:24:39.069602+0000","last_active":"2023-08-31T19:24:39.541876+0000","last_peered":"2023-08-31T19:24:39.541876+0000","last_clean":"2023-08-31T19:24:39.541876+0000","last_became_active":"2023-08-31T19:24:39.068773+0000","last_became_peered":"2023-08-31T19:24:39.068773+0000","last_unstale":"2023-08-31T19:24:39.541876+0000","last_undegraded":"2023-08-31T19:24:39.541876+0000","last_fullsized":"2023-08-31T19:24:39.541876+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":148,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.521115+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:24:39.521115+0000","last_peered":"2023-08-31T19:24:39.521115+0000","last_clean":"2023-08-31T19:24:39.521115+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:24:39.521115+0000","last_undegraded":"2023-08-31T19:24:39.521115+0000","last_fullsized":"2023-08-31T19:24:39.521115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.541948+0000","last_change":"2023-08-31T19:24:39.538606+0000","last_active":"2023-08-31T19:24:39.541948+0000","last_peered":"2023-08-31T19:24:39.541948+0000","last_clean":"2023-08-31T19:24:39.541948+0000","last_became_active":"2023-08-31T19:24:39.538317+0000","last_became_peered":"2023-08-31T19:24:39.538317+0000","last_unstale":"2023-08-31T19:24:39.541948+0000","last_undegraded":"2023-08-31T19:24:39.541948+0000","last_fullsized":"2023-08-31T19:24:39.541948+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.525399+0000","last_change":"2023-08-31T19:24:39.078465+0000","last_active":"2023-08-31T19:24:39.525399+0000","last_peered":"2023-08-31T19:24:39.525399+0000","last_clean":"2023-08-31T19:24:39.525399+0000","last_became_active":"2023-08-31T19:24:39.078114+0000","last_became_peered":"2023-08-31T19:24:39.078114+0000","last_unstale":"2023-08-31T19:24:39.525399+0000","last_undegraded":"2023-08-31T19:24:39.525399+0000","last_fullsized":"2023-08-31T19:24:39.525399+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.518784+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:24:39.518784+0000","last_peered":"2023-08-31T19:24:39.518784+0000","last_clean":"2023-08-31T19:24:39.518784+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:24:39.518784+0000","last_undegraded":"2023-08-31T19:24:39.518784+0000","last_fullsized":"2023-08-31T19:24:39.518784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.543927+0000","last_change":"2023-08-31T19:24:39.538826+0000","last_active":"2023-08-31T19:24:39.543927+0000","last_peered":"2023-08-31T19:24:39.543927+0000","last_clean":"2023-08-31T19:24:39.543927+0000","last_became_active":"2023-08-31T19:24:39.538457+0000","last_became_peered":"2023-08-31T19:24:39.538457+0000","last_unstale":"2023-08-31T19:24:39.543927+0000","last_undegraded":"2023-08-31T19:24:39.543927+0000","last_fullsized":"2023-08-31T19:24:39.543927+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"175'2","reported_seq":12,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544818+0000","last_change":"2023-08-31T19:24:39.067922+0000","last_active":"2023-08-31T19:24:39.544818+0000","last_peered":"2023-08-31T19:24:39.544818+0000","last_clean":"2023-08-31T19:24:39.544818+0000","last_became_active":"2023-08-31T19:24:39.067612+0000","last_became_peered":"2023-08-31T19:24:39.067612+0000","last_unstale":"2023-08-31T19:24:39.544818+0000","last_undegraded":"2023-08-31T19:24:39.544818+0000","last_fullsized":"2023-08-31T19:24:39.544818+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":148,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.521563+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:24:39.521563+0000","last_peered":"2023-08-31T19:24:39.521563+0000","last_clean":"2023-08-31T19:24:39.521563+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:24:39.521563+0000","last_undegraded":"2023-08-31T19:24:39.521563+0000","last_fullsized":"2023-08-31T19:24:39.521563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":147,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.522379+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:24:39.522379+0000","last_peered":"2023-08-31T19:24:39.522379+0000","last_clean":"2023-08-31T19:24:39.522379+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:24:39.522379+0000","last_undegraded":"2023-08-31T19:24:39.522379+0000","last_fullsized":"2023-08-31T19:24:39.522379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.548627+0000","last_change":"2023-08-31T19:24:39.544270+0000","last_active":"2023-08-31T19:24:39.548627+0000","last_peered":"2023-08-31T19:24:39.548627+0000","last_clean":"2023-08-31T19:24:39.548627+0000","last_became_active":"2023-08-31T19:24:39.543898+0000","last_became_peered":"2023-08-31T19:24:39.543898+0000","last_unstale":"2023-08-31T19:24:39.548627+0000","last_undegraded":"2023-08-31T19:24:39.548627+0000","last_fullsized":"2023-08-31T19:24:39.548627+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.527537+0000","last_change":"2023-08-31T19:24:39.079197+0000","last_active":"2023-08-31T19:24:39.527537+0000","last_peered":"2023-08-31T19:24:39.527537+0000","last_clean":"2023-08-31T19:24:39.527537+0000","last_became_active":"2023-08-31T19:24:39.078594+0000","last_became_peered":"2023-08-31T19:24:39.078594+0000","last_unstale":"2023-08-31T19:24:39.527537+0000","last_undegraded":"2023-08-31T19:24:39.527537+0000","last_fullsized":"2023-08-31T19:24:39.527537+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.527851+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:24:39.527851+0000","last_peered":"2023-08-31T19:24:39.527851+0000","last_clean":"2023-08-31T19:24:39.527851+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:24:39.527851+0000","last_undegraded":"2023-08-31T19:24:39.527851+0000","last_fullsized":"2023-08-31T19:24:39.527851+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.538501+0000","last_change":"2023-08-31T19:24:39.535629+0000","last_active":"2023-08-31T19:24:39.538501+0000","last_peered":"2023-08-31T19:24:39.538501+0000","last_clean":"2023-08-31T19:24:39.538501+0000","last_became_active":"2023-08-31T19:24:39.535308+0000","last_became_peered":"2023-08-31T19:24:39.535308+0000","last_unstale":"2023-08-31T19:24:39.538501+0000","last_undegraded":"2023-08-31T19:24:39.538501+0000","last_fullsized":"2023-08-31T19:24:39.538501+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.519855+0000","last_change":"2023-08-31T19:24:39.082293+0000","last_active":"2023-08-31T19:24:39.519855+0000","last_peered":"2023-08-31T19:24:39.519855+0000","last_clean":"2023-08-31T19:24:39.519855+0000","last_became_active":"2023-08-31T19:24:39.082016+0000","last_became_peered":"2023-08-31T19:24:39.082016+0000","last_unstale":"2023-08-31T19:24:39.519855+0000","last_undegraded":"2023-08-31T19:24:39.519855+0000","last_fullsized":"2023-08-31T19:24:39.519855+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":146,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.530223+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:24:39.530223+0000","last_peered":"2023-08-31T19:24:39.530223+0000","last_clean":"2023-08-31T19:24:39.530223+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:24:39.530223+0000","last_undegraded":"2023-08-31T19:24:39.530223+0000","last_fullsized":"2023-08-31T19:24:39.530223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.539667+0000","last_change":"2023-08-31T19:24:39.534120+0000","last_active":"2023-08-31T19:24:39.539667+0000","last_peered":"2023-08-31T19:24:39.539667+0000","last_clean":"2023-08-31T19:24:39.539667+0000","last_became_active":"2023-08-31T19:24:39.533845+0000","last_became_peered":"2023-08-31T19:24:39.533845+0000","last_unstale":"2023-08-31T19:24:39.539667+0000","last_undegraded":"2023-08-31T19:24:39.539667+0000","last_fullsized":"2023-08-31T19:24:39.539667+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.519984+0000","last_change":"2023-08-31T19:24:39.063870+0000","last_active":"2023-08-31T19:24:39.519984+0000","last_peered":"2023-08-31T19:24:39.519984+0000","last_clean":"2023-08-31T19:24:39.519984+0000","last_became_active":"2023-08-31T19:24:39.063585+0000","last_became_peered":"2023-08-31T19:24:39.063585+0000","last_unstale":"2023-08-31T19:24:39.519984+0000","last_undegraded":"2023-08-31T19:24:39.519984+0000","last_fullsized":"2023-08-31T19:24:39.519984+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":158,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.525379+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:24:39.525379+0000","last_peered":"2023-08-31T19:24:39.525379+0000","last_clean":"2023-08-31T19:24:39.525379+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:24:39.525379+0000","last_undegraded":"2023-08-31T19:24:39.525379+0000","last_fullsized":"2023-08-31T19:24:39.525379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.537891+0000","last_change":"2023-08-31T19:24:39.535171+0000","last_active":"2023-08-31T19:24:39.537891+0000","last_peered":"2023-08-31T19:24:39.537891+0000","last_clean":"2023-08-31T19:24:39.537891+0000","last_became_active":"2023-08-31T19:24:39.534871+0000","last_became_peered":"2023-08-31T19:24:39.534871+0000","last_unstale":"2023-08-31T19:24:39.537891+0000","last_undegraded":"2023-08-31T19:24:39.537891+0000","last_fullsized":"2023-08-31T19:24:39.537891+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:39.039071+0000","last_clean_scrub_stamp":"2023-08-31T19:24:39.039071+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"175'4","reported_seq":14,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.544435+0000","last_change":"2023-08-31T19:24:39.078263+0000","last_active":"2023-08-31T19:24:39.544435+0000","last_peered":"2023-08-31T19:24:39.544435+0000","last_clean":"2023-08-31T19:24:39.544435+0000","last_became_active":"2023-08-31T19:24:39.077977+0000","last_became_peered":"2023-08-31T19:24:39.077977+0000","last_unstale":"2023-08-31T19:24:39.544435+0000","last_undegraded":"2023-08-31T19:24:39.544435+0000","last_fullsized":"2023-08-31T19:24:39.544435+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:24:38.032716+0000","last_clean_scrub_stamp":"2023-08-31T19:24:38.032716+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":164,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-08-31T19:24:39.519706+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:24:39.519706+0000","last_peered":"2023-08-31T19:24:39.519706+0000","last_clean":"2023-08-31T19:24:39.519706+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:24:39.519706+0000","last_undegraded":"2023-08-31T19:24:39.519706+0000","last_fullsized":"2023-08-31T19:24:39.519706+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575284,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303348,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068492,"statfs":{"total":96636764160,"available":96326135808,"internally_reserved":0,"allocated":2207744,"data_stored":1191410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72099999999999997,"15min":0.73499999999999999},"min":{"1min":0.48699999999999999,"5min":0.46700000000000003,"15min":0.38200000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.98799999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.54300000000000004},"max":{"1min":0.93899999999999995,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.81000000000000005}]},{"osd":1,"last update":"Thu Aug 31 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.74099999999999999,"15min":0.71799999999999997},"min":{"1min":0.61099999999999999,"5min":0.5,"15min":0.42499999999999999},"max":{"1min":0.91400000000000003,"5min":0.97299999999999998,"15min":0.99399999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69899999999999995,"15min":0.69799999999999995},"min":{"1min":0.502,"5min":0.49299999999999999,"15min":0.41199999999999998},"max":{"1min":0.875,"5min":0.93700000000000006,"15min":0.999},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72199999999999998,"15min":0.71099999999999997},"min":{"1min":0.54800000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93500000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71299999999999997,"15min":0.71899999999999997},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.45200000000000001},"max":{"1min":0.83499999999999996,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69099999999999995,"15min":0.70899999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":1.006},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.747},"min":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.48599999999999999},"max":{"1min":0.91200000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.628}]},{"osd":4,"last update":"Thu Aug 31 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57599999999999996,"15min":0.58899999999999997},"min":{"1min":0.42599999999999999,"5min":0.39000000000000001,"15min":0.34200000000000003},"max":{"1min":0.83499999999999996,"5min":0.92500000000000004,"15min":0.96499999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.69299999999999995},"min":{"1min":0.47599999999999998,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.89300000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67400000000000004,"15min":0.65800000000000003},"min":{"1min":0.435,"5min":0.42799999999999999,"15min":0.41599999999999998},"max":{"1min":0.74299999999999999,"5min":1.006,"15min":1.042},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69099999999999995,"15min":0.70599999999999996},"min":{"1min":0.51100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.875,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.53500000000000003,"5min":0.45200000000000001,"15min":0.442},"max":{"1min":0.77700000000000002,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.42999999999999999,"15min":0.41899999999999998},"max":{"1min":0.91700000000000004,"5min":0.93600000000000005,"15min":0.98099999999999998},"last":0.749}]}]},{"osd":6,"up_from":13,"seq":55834575283,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303336,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068504,"statfs":{"total":96636764160,"available":96326148096,"internally_reserved":0,"allocated":2195456,"data_stored":1189942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.53200000000000003,"5min":0.433,"15min":0.33800000000000002},"max":{"1min":0.84599999999999997,"5min":1.05,"15min":1.0600000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.51800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94399999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Aug 31 19:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.41999999999999998},"max":{"1min":0.92300000000000004,"5min":1.028,"15min":1.0669999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.754,"15min":0.747},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.45500000000000002},"max":{"1min":0.97199999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Aug 31 19:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"max":{"1min":0.94799999999999995,"5min":1.198,"15min":1.198},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77700000000000002,"15min":0.76800000000000002},"min":{"1min":0.63300000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94399999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.56899999999999995,"5min":0.54300000000000004,"15min":0.51700000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.0189999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78800000000000003,"15min":0.78000000000000003},"min":{"1min":0.66000000000000003,"5min":0.54100000000000004,"15min":0.495},"max":{"1min":1.026,"5min":1.296,"15min":1.296},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.92100000000000004},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.65900000000000003,"15min":0.65800000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":0.92700000000000005,"5min":0.995,"15min":0.995},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.67800000000000005,"15min":0.67000000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.42799999999999999},"max":{"1min":0.88500000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72099999999999997,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.40899999999999997},"max":{"1min":0.96399999999999997,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:24:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.71699999999999997,"15min":0.69999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.46200000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76900000000000002,"15min":0.753},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.48499999999999999},"max":{"1min":0.98099999999999998,"5min":1.24,"15min":1.24},"last":0.80100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575284,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303344,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068496,"statfs":{"total":96636764160,"available":96326139904,"internally_reserved":0,"allocated":2203648,"data_stored":1190566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.34100000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64400000000000002,"5min":0.66500000000000004,"15min":0.68100000000000005},"last":0.379},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.317,"15min":0.31},"max":{"1min":0.60099999999999998,"5min":0.73599999999999999,"15min":0.76400000000000001},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51100000000000001,"15min":0.52000000000000002},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58699999999999997,"15min":0.58399999999999996},"min":{"1min":0.47699999999999998,"5min":0.44600000000000001,"15min":0.35199999999999998},"max":{"1min":0.70599999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.47299999999999998,"5min":0.438,"15min":0.40300000000000002},"max":{"1min":0.68400000000000005,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66300000000000003,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.442}]},{"osd":4,"last update":"Thu Aug 31 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79100000000000004,"15min":0.80200000000000005},"min":{"1min":0.59799999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.169,"5min":1.169,"15min":1.1839999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.82099999999999995,"15min":0.83599999999999997},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.62},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1499999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76100000000000001,"15min":0.78000000000000003},"min":{"1min":0.56599999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.137},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.53100000000000003},"max":{"1min":1.127,"5min":1.127,"15min":1.262},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.79600000000000004},"min":{"1min":0.58499999999999996,"5min":0.54200000000000004,"15min":0.47799999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.61499999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0569999999999999,"5min":1.222,"15min":1.2849999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.56899999999999995},"max":{"1min":1.097,"5min":1.127,"15min":1.224},"last":0.626},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80200000000000005,"15min":0.80500000000000005},"min":{"1min":0.627,"5min":0.56299999999999994,"15min":0.51000000000000001},"max":{"1min":1.1579999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.71499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575283,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303340,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068500,"statfs":{"total":96636764160,"available":96326144000,"internally_reserved":0,"allocated":2199552,"data_stored":1183378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46600000000000003,"15min":0.46300000000000002},"min":{"1min":0.33400000000000002,"5min":0.317,"15min":0.28799999999999998},"max":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.505},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.309},"max":{"1min":0.68400000000000005,"5min":0.84599999999999997,"15min":1.097},"last":0.311}]},{"osd":2,"last update":"Thu Aug 31 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.51600000000000001},"min":{"1min":0.41599999999999998,"5min":0.36799999999999999,"15min":0.32800000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.77000000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54900000000000004,"15min":0.55400000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.372},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":1.165},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.38300000000000001,"5min":0.378,"15min":0.36399999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58699999999999997,"15min":0.58399999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.376},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.2609999999999999},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.81399999999999995,"15min":0.82599999999999996},"min":{"1min":0.65900000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.097,"5min":1.097,"15min":1.3169999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.80100000000000005,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.57699999999999996,"15min":0.56699999999999995},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.347},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76100000000000001,"15min":0.77500000000000002},"min":{"1min":0.58399999999999996,"5min":0.55900000000000005,"15min":0.54500000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.3220000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.75700000000000001,"15min":0.77700000000000002},"min":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.024,"5min":1.135,"15min":1.242},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.80600000000000005},"min":{"1min":0.61399999999999999,"5min":0.54700000000000004,"15min":0.53000000000000003},"max":{"1min":1.0880000000000001,"5min":1.113,"15min":1.21},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.61099999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.3660000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.83899999999999997,"15min":0.84799999999999998},"min":{"1min":0.64300000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.032,"5min":1.093,"15min":1.24},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81499999999999995,"15min":0.84199999999999997},"min":{"1min":0.56000000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.3340000000000001},"last":0.80300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575283,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303336,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068504,"statfs":{"total":96636764160,"available":96326148096,"internally_reserved":0,"allocated":2195456,"data_stored":1182792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:23:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45600000000000002,"15min":0.45100000000000001},"min":{"1min":0.311,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66500000000000004,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51500000000000001,"15min":0.50600000000000001},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.66900000000000004,"5min":0.73299999999999998,"15min":0.77600000000000002},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:23:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51500000000000001,"15min":0.50700000000000001},"min":{"1min":0.36199999999999999,"5min":0.35899999999999999,"15min":0.33600000000000002},"max":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":0.81899999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.46300000000000002,"5min":0.38100000000000001,"15min":0.36399999999999999},"max":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:23:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.372,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65300000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.39900000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:23:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79400000000000004,"15min":0.79700000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97999999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.629},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80100000000000005,"15min":0.80200000000000005},"min":{"1min":0.61499999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.034,"5min":1.1040000000000001,"15min":1.304},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:23:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81399999999999995,"15min":0.80700000000000005},"min":{"1min":0.67800000000000005,"5min":0.54500000000000004,"15min":0.51300000000000001},"max":{"1min":1.036,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81899999999999995,"15min":0.81299999999999994},"min":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.58299999999999996},"max":{"1min":1.054,"5min":1.256,"15min":1.256},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:23:42 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83299999999999996,"15min":0.82499999999999996},"min":{"1min":0.60999999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.054,"5min":1.1970000000000001,"15min":1.2150000000000001},"last":0.621},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82299999999999995,"15min":0.81799999999999995},"min":{"1min":0.63600000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0289999999999999,"5min":1.2310000000000001,"15min":1.27},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Aug 31 19:23:42 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.84899999999999998,"15min":0.83399999999999996},"min":{"1min":0.70999999999999996,"5min":0.57999999999999996,"15min":0.54400000000000004},"max":{"1min":1.083,"5min":1.302,"15min":1.302},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.83999999999999997},"min":{"1min":0.65200000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0009999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.76500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575283,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307436,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064404,"statfs":{"total":96636764160,"available":96321949696,"internally_reserved":0,"allocated":2199552,"data_stored":1189976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44500000000000001,"15min":0.443},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.71899999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.39400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69299999999999995,"5min":0.72099999999999997,"15min":0.77600000000000002},"last":0.432}]},{"osd":1,"last update":"Thu Aug 31 19:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47499999999999998,"15min":0.46700000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.30599999999999999},"max":{"1min":0.64600000000000002,"5min":0.66800000000000004,"15min":0.77600000000000002},"last":0.502},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.51700000000000002},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.35599999999999998},"max":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.78600000000000003},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.52700000000000002,"5min":0.41699999999999998,"15min":0.379},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.90400000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63400000000000001,"15min":0.625},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.38200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.95399999999999996},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Aug 31 19:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77400000000000002,"15min":0.76000000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.46500000000000002},"max":{"1min":0.92100000000000004,"5min":1.012,"15min":1.1739999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.59499999999999997,"5min":0.56499999999999995,"15min":0.47899999999999998},"max":{"1min":0.94299999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79700000000000004,"15min":0.79400000000000004},"min":{"1min":0.64900000000000002,"5min":0.58999999999999997,"15min":0.52400000000000002},"max":{"1min":0.98599999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.75},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79300000000000004,"15min":0.78500000000000003},"min":{"1min":0.57199999999999995,"5min":0.55200000000000005,"15min":0.505},"max":{"1min":1.018,"5min":1.1819999999999999,"15min":1.2430000000000001},"last":0.82099999999999995}]},{"osd":6,"last update":"Thu Aug 31 19:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81100000000000005,"15min":0.79900000000000004},"min":{"1min":0.64100000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0960000000000001,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80100000000000005,"15min":0.80000000000000004},"min":{"1min":0.60799999999999998,"5min":0.55100000000000005,"15min":0.54900000000000004},"max":{"1min":0.95299999999999996,"5min":1.121,"15min":1.2849999999999999},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.497},"max":{"1min":0.93300000000000005,"5min":1.1579999999999999,"15min":1.381},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81100000000000005,"15min":0.80800000000000005},"min":{"1min":0.627,"5min":0.60299999999999998,"15min":0.55700000000000005},"max":{"1min":1.0249999999999999,"5min":1.244,"15min":1.3420000000000001},"last":0.80300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575283,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303344,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068496,"statfs":{"total":96636764160,"available":96326139904,"internally_reserved":0,"allocated":2203648,"data_stored":1190586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71799999999999997,"15min":0.72499999999999998},"min":{"1min":0.51900000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95899999999999996,"5min":1.048,"15min":1.048},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.71699999999999997,"15min":0.71599999999999997},"min":{"1min":0.59999999999999998,"5min":0.45500000000000002,"15min":0.376},"max":{"1min":0.92600000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.61199999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.73899999999999999,"15min":0.73299999999999998},"min":{"1min":0.54800000000000004,"5min":0.49099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96499999999999997,"5min":0.98699999999999999,"15min":1.0289999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73699999999999999,"15min":0.73299999999999998},"min":{"1min":0.50800000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.97199999999999998,"5min":1,"15min":1},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.65200000000000002,"5min":0.504,"15min":0.48999999999999999},"max":{"1min":0.91500000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.755,"15min":0.754},"min":{"1min":0.60299999999999998,"5min":0.54300000000000004,"15min":0.51300000000000001},"max":{"1min":0.93000000000000005,"5min":0.93999999999999995,"15min":0.996},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.50900000000000001},"max":{"1min":0.90700000000000003,"5min":0.95699999999999996,"15min":0.97699999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76300000000000001,"15min":0.75900000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.49399999999999999},"max":{"1min":1.0089999999999999,"5min":1.056,"15min":1.056},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.39600000000000002},"max":{"1min":0.83999999999999997,"5min":0.90600000000000003,"15min":0.95799999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45000000000000001,"5min":0.41899999999999998,"15min":0.41099999999999998},"max":{"1min":0.86499999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66500000000000004,"15min":0.65700000000000003},"min":{"1min":0.48299999999999998,"5min":0.47199999999999998,"15min":0.42299999999999999},"max":{"1min":0.98799999999999999,"5min":1.01,"15min":1.0649999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.69599999999999995},"min":{"1min":0.498,"5min":0.46500000000000002,"15min":0.46100000000000002},"max":{"1min":0.89500000000000002,"5min":0.98499999999999999,"15min":1.069},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69799999999999995,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.45300000000000001},"max":{"1min":0.92800000000000005,"5min":0.94299999999999995,"15min":1.0049999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.0369999999999999,"15min":1.115},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575283,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303328,"kb_used_data":2136,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068512,"statfs":{"total":96636764160,"available":96326156288,"internally_reserved":0,"allocated":2187264,"data_stored":1183502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.72499999999999998},"min":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.873,"5min":1.026,"15min":1.026},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.59099999999999997,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92200000000000004,"5min":0.995,"15min":1.5369999999999999},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Aug 31 19:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.499},"max":{"1min":0.92900000000000005,"5min":1.103,"15min":1.103},"last":0.625},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.746,"15min":0.747},"min":{"1min":0.55400000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89500000000000002,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85299999999999998,"5min":1.004,"15min":1.004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.76400000000000001,"15min":0.75600000000000001},"min":{"1min":0.53800000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.97599999999999998,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.749,"15min":0.746},"min":{"1min":0.59199999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.873,"5min":1.141,"15min":1.4990000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.74099999999999999},"min":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90100000000000002,"5min":0.98299999999999998,"15min":1.6060000000000001},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.627,"15min":0.60499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.379},"max":{"1min":0.93799999999999994,"5min":0.997,"15min":0.997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.46000000000000002,"5min":0.42499999999999999,"15min":0.41299999999999998},"max":{"1min":0.95499999999999996,"5min":1.069,"15min":1.069},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65300000000000002,"15min":0.65000000000000002},"min":{"1min":0.44900000000000001,"5min":0.441,"15min":0.40000000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71199999999999997,"15min":0.69499999999999995},"min":{"1min":0.42899999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93999999999999995,"5min":1.2,"15min":1.2},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Aug 31 19:23:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.70899999999999996},"min":{"1min":0.503,"5min":0.47799999999999998,"15min":0.46800000000000003},"max":{"1min":0.92700000000000005,"5min":1.034,"15min":1.034},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.47099999999999997},"max":{"1min":0.92600000000000005,"5min":0.995,"15min":0.995},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:24:44.242 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T19:24:44.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-31T19:24:44.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.472+0000 7f43251ff700 1 Processor -- start 2023-08-31T19:24:44.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.472+0000 7f43251ff700 1 -- start start 2023-08-31T19:24:44.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.473+0000 7f43251ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43200637c0 0x7f432015f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.473+0000 7f43251ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43200bfd40 con 0x7f4320153e30 2023-08-31T19:24:44.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.473+0000 7f43251ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43200c6730 con 0x7f4320154210 2023-08-31T19:24:44.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.473+0000 7f43251ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43201546c0 con 0x7f43200637c0 2023-08-31T19:24:44.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.474+0000 7f431ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4320153e30 0x7f43200c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33674/0 (socket says 172.21.15.72:33674) 2023-08-31T19:24:44.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.474+0000 7f431ed9d700 1 -- 172.21.15.72:0/130311465 learned_addr learned my addr 172.21.15.72:0/130311465 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:44.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.474+0000 7f431f59e700 1 --2- 172.21.15.72:0/130311465 >> v2:172.21.15.146:3300/0 conn(0x7f43200637c0 0x7f432015f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.474+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718230295 0 0) 0x7f43200bfd40 con 0x7f4320153e30 2023-08-31T19:24:44.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.474+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43080033f0 con 0x7f4320153e30 2023-08-31T19:24:44.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.474+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802664021 0 0) 0x7f43200c6730 con 0x7f4320154210 2023-08-31T19:24:44.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.474+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43200bfd40 con 0x7f4320154210 2023-08-31T19:24:44.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.474+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1695120609 0 0) 0x7f43080033f0 con 0x7f4320153e30 2023-08-31T19:24:44.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.474+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 >> v2:172.21.15.146:3300/0 conn(0x7f43200637c0 msgr2=0x7f432015f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:44.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.474+0000 7f431dd9b700 1 --2- 172.21.15.72:0/130311465 >> v2:172.21.15.146:3300/0 conn(0x7f43200637c0 0x7f432015f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.474+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 >> v1:172.21.15.146:6789/0 conn(0x7f4320154210 legacy=0x7f43200630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43200bffe0 con 0x7f4320153e30 2023-08-31T19:24:44.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f4310001470 con 0x7f4320153e30 2023-08-31T19:24:44.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431f59e700 1 --2- 172.21.15.72:0/130311465 >> v2:172.21.15.146:3300/0 conn(0x7f43200637c0 0x7f432015f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:44.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 >> v1:172.21.15.72:6789/0 conn(0x7f4320153e30 legacy=0x7f43200c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431dd9b700 1 --2- 172.21.15.72:0/130311465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a70 0x7f4308003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431dd9b700 1 --2- 172.21.15.72:0/130311465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4308004690 0x7f4308004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431dd9b700 1 --2- 172.21.15.72:0/130311465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4308005000 0x7f430800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430800bf60 con 0x7f4308003a70 2023-08-31T19:24:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430800c0a0 con 0x7f4308004690 2023-08-31T19:24:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430800c210 con 0x7f4308005000 2023-08-31T19:24:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431ed9d700 1 --2- 172.21.15.72:0/130311465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a70 0x7f4308003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431e59c700 1 --2- 172.21.15.72:0/130311465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4308004690 0x7f4308004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431f59e700 1 --2- 172.21.15.72:0/130311465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4308005000 0x7f430800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431ed9d700 1 -- 172.21.15.72:0/130311465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4308005000 msgr2=0x7f430800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431ed9d700 1 --2- 172.21.15.72:0/130311465 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4308005000 0x7f430800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431ed9d700 1 -- 172.21.15.72:0/130311465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4308004690 msgr2=0x7f4308004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431ed9d700 1 --2- 172.21.15.72:0/130311465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4308004690 0x7f4308004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431ed9d700 1 -- 172.21.15.72:0/130311465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43080033f0 con 0x7f4308003a70 2023-08-31T19:24:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431f59e700 1 -- 172.21.15.72:0/130311465 reap_dead start 2023-08-31T19:24:44.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.475+0000 7f431ed9d700 1 --2- 172.21.15.72:0/130311465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a70 0x7f4308003e70 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f431000c190 tx=0x7f4310001e10).ready entity=mon.0 client_cookie=56ac4bc43894d3ce server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:44.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.476+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000ca00 con 0x7f4308003a70 2023-08-31T19:24:44.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.476+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431000cb80 con 0x7f4308003a70 2023-08-31T19:24:44.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.476+0000 7f431dd9b700 1 -- 172.21.15.72:0/130311465 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43100070d0 con 0x7f4308003a70 2023-08-31T19:24:44.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.476+0000 7f43251ff700 1 -- 172.21.15.72:0/130311465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a70 msgr2=0x7f4308003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.476+0000 7f43251ff700 1 --2- 172.21.15.72:0/130311465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a70 0x7f4308003e70 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f431000c190 tx=0x7f4310001e10).stop 2023-08-31T19:24:44.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.476+0000 7f43251ff700 1 -- 172.21.15.72:0/130311465 shutdown_connections 2023-08-31T19:24:44.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.476+0000 7f43251ff700 1 --2- 172.21.15.72:0/130311465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a70 0x7f4308003e70 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.476+0000 7f43251ff700 1 -- 172.21.15.72:0/130311465 >> 172.21.15.72:0/130311465 conn(0x7f432005eb20 msgr2=0x7f43200cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:44.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.476+0000 7f43251ff700 1 -- 172.21.15.72:0/130311465 shutdown_connections 2023-08-31T19:24:44.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.476+0000 7f43251ff700 1 -- 172.21.15.72:0/130311465 wait complete. 2023-08-31T19:24:44.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.478+0000 7f43251ff700 1 Processor -- start 2023-08-31T19:24:44.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.479+0000 7f43251ff700 1 -- start start 2023-08-31T19:24:44.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f43251ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4308003a70 0x7f43201459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f43251ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4320168190 0x7f4320142f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f43251ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320152460 0x7f43201528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f43251ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43201433f0 con 0x7f4320152460 2023-08-31T19:24:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f43251ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4320144240 con 0x7f4308003a70 2023-08-31T19:24:44.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f43251ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4320168610 con 0x7f4320168190 2023-08-31T19:24:44.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f431f59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320152460 0x7f43201528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f431f59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320152460 0x7f43201528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44306/0 (socket says 172.21.15.72:44306) 2023-08-31T19:24:44.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f431f59e700 1 -- 172.21.15.72:0/4168219758 learned_addr learned my addr 172.21.15.72:0/4168219758 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:44.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f431e59c700 1 --2- 172.21.15.72:0/4168219758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4320168190 0x7f4320142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f431ed9d700 1 --2- 172.21.15.72:0/4168219758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4308003a70 0x7f43201459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f431f59e700 1 -- 172.21.15.72:0/4168219758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4320168190 msgr2=0x7f4320142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f431f59e700 1 --2- 172.21.15.72:0/4168219758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4320168190 0x7f4320142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f431f59e700 1 -- 172.21.15.72:0/4168219758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4308003a70 msgr2=0x7f43201459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f431f59e700 1 --2- 172.21.15.72:0/4168219758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4308003a70 0x7f43201459c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.480+0000 7f431f59e700 1 -- 172.21.15.72:0/4168219758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320143630 con 0x7f4320152460 2023-08-31T19:24:44.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.481+0000 7f431f59e700 1 --2- 172.21.15.72:0/4168219758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320152460 0x7f43201528e0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f43200831d0 tx=0x7f431800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:44.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.481+0000 7f4306ffd700 1 -- 172.21.15.72:0/4168219758 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431800e070 con 0x7f4320152460 2023-08-31T19:24:44.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.481+0000 7f4306ffd700 1 -- 172.21.15.72:0/4168219758 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4318011de0 con 0x7f4320152460 2023-08-31T19:24:44.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.481+0000 7f4306ffd700 1 -- 172.21.15.72:0/4168219758 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43180166a0 con 0x7f4320152460 2023-08-31T19:24:44.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.481+0000 7f43251ff700 1 -- 172.21.15.72:0/4168219758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4320143910 con 0x7f4320152460 2023-08-31T19:24:44.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.481+0000 7f43251ff700 1 -- 172.21.15.72:0/4168219758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4320143ed0 con 0x7f4320152460 2023-08-31T19:24:44.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.482+0000 7f43251ff700 1 -- 172.21.15.72:0/4168219758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43201443d0 con 0x7f4320152460 2023-08-31T19:24:44.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.483+0000 7f4306ffd700 1 -- 172.21.15.72:0/4168219758 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f431801f3b0 con 0x7f4320152460 2023-08-31T19:24:44.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.484+0000 7f4306ffd700 1 --2- 172.21.15.72:0/4168219758 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f430c05ef30 0x7f430c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.484+0000 7f4306ffd700 1 -- 172.21.15.72:0/4168219758 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f431807a950 con 0x7f4320152460 2023-08-31T19:24:44.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.484+0000 7f431ed9d700 1 --2- 172.21.15.72:0/4168219758 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f430c05ef30 0x7f430c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.484+0000 7f431ed9d700 1 --2- 172.21.15.72:0/4168219758 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f430c05ef30 0x7f430c0613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f4310001e70 tx=0x7f4310015000).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:44.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.488+0000 7f4306ffd700 1 -- 172.21.15.72:0/4168219758 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f431804b970 con 0x7f4320152460 2023-08-31T19:24:44.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.721+0000 7f43251ff700 1 -- 172.21.15.72:0/4168219758 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f432006c6b0 con 0x7f4320152460 2023-08-31T19:24:44.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.725+0000 7f4306ffd700 1 -- 172.21.15.72:0/4168219758 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v33) v1 ==== 190+0+0 (secure 0 0 0) 0x7f431804ef90 con 0x7f4320152460 2023-08-31T19:24:44.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.728+0000 7f43251ff700 1 -- 172.21.15.72:0/4168219758 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f430c05ef30 msgr2=0x7f430c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.728+0000 7f43251ff700 1 --2- 172.21.15.72:0/4168219758 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f430c05ef30 0x7f430c0613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f4310001e70 tx=0x7f4310015000).stop 2023-08-31T19:24:44.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.728+0000 7f43251ff700 1 -- 172.21.15.72:0/4168219758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320152460 msgr2=0x7f43201528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.728+0000 7f43251ff700 1 --2- 172.21.15.72:0/4168219758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320152460 0x7f43201528e0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f43200831d0 tx=0x7f431800b040).stop 2023-08-31T19:24:44.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.728+0000 7f43251ff700 1 -- 172.21.15.72:0/4168219758 shutdown_connections 2023-08-31T19:24:44.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.728+0000 7f43251ff700 1 --2- 172.21.15.72:0/4168219758 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f430c05ef30 0x7f430c0613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.728+0000 7f43251ff700 1 --2- 172.21.15.72:0/4168219758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4320152460 0x7f43201528e0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.728+0000 7f43251ff700 1 --2- 172.21.15.72:0/4168219758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4308003a70 0x7f43201459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.728+0000 7f43251ff700 1 --2- 172.21.15.72:0/4168219758 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4320168190 0x7f4320142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.728+0000 7f43251ff700 1 -- 172.21.15.72:0/4168219758 >> 172.21.15.72:0/4168219758 conn(0x7f432005eb20 msgr2=0x7f43200ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:44.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.728+0000 7f43251ff700 1 -- 172.21.15.72:0/4168219758 shutdown_connections 2023-08-31T19:24:44.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.728+0000 7f43251ff700 1 -- 172.21.15.72:0/4168219758 wait complete. 2023-08-31T19:24:44.731 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-08-31T19:24:44.746 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:24:44.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.936+0000 7f8dabbff700 1 Processor -- start 2023-08-31T19:24:44.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.937+0000 7f8dabbff700 1 -- start start 2023-08-31T19:24:44.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.938+0000 7f8dabbff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8da40aa290 0x7f8da4156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.938+0000 7f8dabbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da41574b0 0x7f8da40c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.938+0000 7f8dabbff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da40bfd00 con 0x7f8da40a9eb0 2023-08-31T19:24:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.938+0000 7f8dabbff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da40c05a0 con 0x7f8da40aa290 2023-08-31T19:24:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.938+0000 7f8dabbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da40aaea0 con 0x7f8da41574b0 2023-08-31T19:24:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.938+0000 7f8da919a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8da40aa290 0x7f8da4156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.938+0000 7f8da919a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8da40aa290 0x7f8da4156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44322/0 (socket says 172.21.15.72:44322) 2023-08-31T19:24:44.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.938+0000 7f8da919a700 1 -- 172.21.15.72:0/1629257417 learned_addr learned my addr 172.21.15.72:0/1629257417 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:44.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.938+0000 7f8daa19c700 1 --2- 172.21.15.72:0/1629257417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da41574b0 0x7f8da40c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.939+0000 7f8da919a700 1 -- 172.21.15.72:0/1629257417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da41574b0 msgr2=0x7f8da40c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:44.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.939+0000 7f8da919a700 1 --2- 172.21.15.72:0/1629257417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da41574b0 0x7f8da40c0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.939+0000 7f8da919a700 1 -- 172.21.15.72:0/1629257417 >> v1:172.21.15.146:6789/0 conn(0x7f8da40a9eb0 legacy=0x7f8da40c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.939+0000 7f8da919a700 1 -- 172.21.15.72:0/1629257417 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da40c6670 con 0x7f8da40aa290 2023-08-31T19:24:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.939+0000 7f8daa19c700 1 --2- 172.21.15.72:0/1629257417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da41574b0 0x7f8da40c0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:24:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.939+0000 7f8da919a700 1 --2- 172.21.15.72:0/1629257417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da40aa290 0x7f8da4156fc0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7f8d94006fd0 tx=0x7f8d940090f0).ready entity=mon.0 client_cookie=76de5d0da5e6d239 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.939+0000 7f8da8999700 1 -- 172.21.15.72:0/1629257417 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9400b600 con 0x7f8da40aa290 2023-08-31T19:24:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.939+0000 7f8da8999700 1 -- 172.21.15.72:0/1629257417 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9400b760 con 0x7f8da40aa290 2023-08-31T19:24:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.939+0000 7f8da8999700 1 -- 172.21.15.72:0/1629257417 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9400bae0 con 0x7f8da40aa290 2023-08-31T19:24:44.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.939+0000 7f8dabbff700 1 -- 172.21.15.72:0/1629257417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da40aa290 msgr2=0x7f8da4156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.939+0000 7f8dabbff700 1 --2- 172.21.15.72:0/1629257417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da40aa290 0x7f8da4156fc0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7f8d94006fd0 tx=0x7f8d940090f0).stop 2023-08-31T19:24:44.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.940+0000 7f8dabbff700 1 -- 172.21.15.72:0/1629257417 shutdown_connections 2023-08-31T19:24:44.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.940+0000 7f8dabbff700 1 --2- 172.21.15.72:0/1629257417 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da41574b0 0x7f8da40c0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.940+0000 7f8dabbff700 1 --2- 172.21.15.72:0/1629257417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da40aa290 0x7f8da4156fc0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.940+0000 7f8dabbff700 1 -- 172.21.15.72:0/1629257417 >> 172.21.15.72:0/1629257417 conn(0x7f8da40c82e0 msgr2=0x7f8da405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:44.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.940+0000 7f8dabbff700 1 -- 172.21.15.72:0/1629257417 shutdown_connections 2023-08-31T19:24:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.940+0000 7f8dabbff700 1 -- 172.21.15.72:0/1629257417 wait complete. 2023-08-31T19:24:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.941+0000 7f8dabbff700 1 Processor -- start 2023-08-31T19:24:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.941+0000 7f8dabbff700 1 -- start start 2023-08-31T19:24:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.942+0000 7f8dabbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da40a9eb0 0x7f8da4167680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.942+0000 7f8dabbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da40aa290 0x7f8da4165870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.942+0000 7f8dabbff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da41574b0 0x7f8da41499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.942+0000 7f8dabbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da40c3850 con 0x7f8da40a9eb0 2023-08-31T19:24:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.942+0000 7f8dabbff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da414cd30 con 0x7f8da41574b0 2023-08-31T19:24:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.942+0000 7f8dabbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da40c2f20 con 0x7f8da40aa290 2023-08-31T19:24:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.942+0000 7f8da999b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da40a9eb0 0x7f8da4167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.942+0000 7f8da999b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da40a9eb0 0x7f8da4167680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44326/0 (socket says 172.21.15.72:44326) 2023-08-31T19:24:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.942+0000 7f8da999b700 1 -- 172.21.15.72:0/2146886567 learned_addr learned my addr 172.21.15.72:0/2146886567 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.943+0000 7f8da919a700 1 --2- 172.21.15.72:0/2146886567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da40aa290 0x7f8da4165870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.943+0000 7f8daa19c700 1 --2- 172.21.15.72:0/2146886567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da41574b0 0x7f8da41499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.943+0000 7f8da999b700 1 -- 172.21.15.72:0/2146886567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da40aa290 msgr2=0x7f8da4165870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.943+0000 7f8da999b700 1 --2- 172.21.15.72:0/2146886567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da40aa290 0x7f8da4165870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.943+0000 7f8da999b700 1 -- 172.21.15.72:0/2146886567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da41574b0 msgr2=0x7f8da41499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.943+0000 7f8da999b700 1 --2- 172.21.15.72:0/2146886567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da41574b0 0x7f8da41499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.943+0000 7f8da999b700 1 -- 172.21.15.72:0/2146886567 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d94009370 con 0x7f8da40a9eb0 2023-08-31T19:24:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.943+0000 7f8da999b700 1 --2- 172.21.15.72:0/2146886567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da40a9eb0 0x7f8da4167680 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f8da000c4c0 tx=0x7f8da0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.943+0000 7f8d99ffb700 1 -- 172.21.15.72:0/2146886567 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da0007020 con 0x7f8da40a9eb0 2023-08-31T19:24:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.943+0000 7f8d99ffb700 1 -- 172.21.15.72:0/2146886567 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da0001e90 con 0x7f8da40a9eb0 2023-08-31T19:24:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.943+0000 7f8dabbff700 1 -- 172.21.15.72:0/2146886567 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da40c3200 con 0x7f8da40a9eb0 2023-08-31T19:24:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.943+0000 7f8d99ffb700 1 -- 172.21.15.72:0/2146886567 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da00073b0 con 0x7f8da40a9eb0 2023-08-31T19:24:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.943+0000 7f8dabbff700 1 -- 172.21.15.72:0/2146886567 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da4165d60 con 0x7f8da40a9eb0 2023-08-31T19:24:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.944+0000 7f8dabbff700 1 -- 172.21.15.72:0/2146886567 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da406c6b0 con 0x7f8da40a9eb0 2023-08-31T19:24:44.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.945+0000 7f8d99ffb700 1 -- 172.21.15.72:0/2146886567 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8da00068b0 con 0x7f8da40a9eb0 2023-08-31T19:24:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.946+0000 7f8d99ffb700 1 --2- 172.21.15.72:0/2146886567 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8d8805ef30 0x7f8d880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.946+0000 7f8d99ffb700 1 -- 172.21.15.72:0/2146886567 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f8da0079c80 con 0x7f8da40a9eb0 2023-08-31T19:24:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.946+0000 7f8da919a700 1 --2- 172.21.15.72:0/2146886567 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8d8805ef30 0x7f8d880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.947+0000 7f8da919a700 1 --2- 172.21.15.72:0/2146886567 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8d8805ef30 0x7f8d880613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f8d94009130 tx=0x7f8d94017000).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:44.950+0000 7f8d99ffb700 1 -- 172.21.15.72:0/2146886567 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8da004ac40 con 0x7f8da40a9eb0 2023-08-31T19:24:45.034 INFO:tasks.ceph.mds.c.smithi072.stderr:2023-08-31T19:24:45.034+0000 7f90965f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:24:45.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.160+0000 7f8dabbff700 1 -- 172.21.15.72:0/2146886567 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8da40655b0 con 0x7f8da40a9eb0 2023-08-31T19:24:45.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.161+0000 7f8d99ffb700 1 -- 172.21.15.72:0/2146886567 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f8da004e260 con 0x7f8da40a9eb0 2023-08-31T19:24:45.161 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:45.162 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3355816598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3355816598},{"type":"v1","addr":"172.21.15.146:6833","nonce":3355816598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/197878546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":197878546},{"type":"v1","addr":"172.21.15.146:6835","nonce":197878546}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2229531329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2229531329},{"type":"v1","addr":"172.21.15.72:6836","nonce":2229531329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:24:39.509515+0000","modified":"2023-08-31T19:24:42.529652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9024":{"gid":9024,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/1822141039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1822141039},{"type":"v1","addr":"172.21.15.72:6837","nonce":1822141039}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-31T19:24:45.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.163+0000 7f8dabbff700 1 -- 172.21.15.72:0/2146886567 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8d8805ef30 msgr2=0x7f8d880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:45.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.163+0000 7f8dabbff700 1 --2- 172.21.15.72:0/2146886567 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8d8805ef30 0x7f8d880613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f8d94009130 tx=0x7f8d94017000).stop 2023-08-31T19:24:45.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.163+0000 7f8dabbff700 1 -- 172.21.15.72:0/2146886567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da40a9eb0 msgr2=0x7f8da4167680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:45.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.163+0000 7f8dabbff700 1 --2- 172.21.15.72:0/2146886567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da40a9eb0 0x7f8da4167680 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f8da000c4c0 tx=0x7f8da0007e00).stop 2023-08-31T19:24:45.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.163+0000 7f8dabbff700 1 -- 172.21.15.72:0/2146886567 shutdown_connections 2023-08-31T19:24:45.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.163+0000 7f8dabbff700 1 --2- 172.21.15.72:0/2146886567 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8d8805ef30 0x7f8d880613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.163+0000 7f8dabbff700 1 --2- 172.21.15.72:0/2146886567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8da41574b0 0x7f8da41499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.163+0000 7f8dabbff700 1 --2- 172.21.15.72:0/2146886567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da40a9eb0 0x7f8da4167680 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.163+0000 7f8dabbff700 1 --2- 172.21.15.72:0/2146886567 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8da40aa290 0x7f8da4165870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.163+0000 7f8dabbff700 1 -- 172.21.15.72:0/2146886567 >> 172.21.15.72:0/2146886567 conn(0x7f8da40c82e0 msgr2=0x7f8da40c8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:45.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.163+0000 7f8dabbff700 1 -- 172.21.15.72:0/2146886567 shutdown_connections 2023-08-31T19:24:45.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.163+0000 7f8dabbff700 1 -- 172.21.15.72:0/2146886567 wait complete. 2023-08-31T19:24:45.166 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 79 2023-08-31T19:24:45.583 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T19:24:39.509515+0000', 'modified': '2023-08-31T19:24:42.529652+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9024}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9024': {'gid': 9024, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6837/1822141039', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6835', 'nonce': 1822141039}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 1822141039}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-31T19:24:45.584 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T19:24:45.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-31T19:24:45.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.775+0000 7f1dc59ff700 1 Processor -- start 2023-08-31T19:24:45.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.775+0000 7f1dc59ff700 1 -- start start 2023-08-31T19:24:45.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.776+0000 7f1dc59ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1dc0067b30 0x7f1dc0067f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.776+0000 7f1dc59ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc00a81b0 con 0x7f1dc0151f20 2023-08-31T19:24:45.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.776+0000 7f1dc59ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc0068750 con 0x7f1dc00c5090 2023-08-31T19:24:45.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.776+0000 7f1dc59ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc00a7e80 con 0x7f1dc0067b30 2023-08-31T19:24:45.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.777+0000 7f1dbeffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1dc0067b30 0x7f1dc0067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.777+0000 7f1dbf7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1dc0151f20 0x7f1dc0157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33684/0 (socket says 172.21.15.72:33684) 2023-08-31T19:24:45.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.777+0000 7f1dbf7fe700 1 -- 172.21.15.72:0/1578775683 learned_addr learned my addr 172.21.15.72:0/1578775683 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:45.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.777+0000 7f1dbeffd700 1 -- 172.21.15.72:0/1578775683 >> v1:172.21.15.146:6789/0 conn(0x7f1dc00c5090 legacy=0x7f1dc0151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:45.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.777+0000 7f1dbeffd700 1 -- 172.21.15.72:0/1578775683 >> v1:172.21.15.72:6789/0 conn(0x7f1dc0151f20 legacy=0x7f1dc0157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:45.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.777+0000 7f1dbeffd700 1 -- 172.21.15.72:0/1578775683 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc00bdb80 con 0x7f1dc0067b30 2023-08-31T19:24:45.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.777+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/1578775683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc0067b30 0x7f1dc0067f10 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f1db0006fd0 tx=0x7f1db0006f40).ready entity=mon.0 client_cookie=65981575b0f304eb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:45.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.778+0000 7f1dbdffb700 1 -- 172.21.15.72:0/1578775683 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0005880 con 0x7f1dc0067b30 2023-08-31T19:24:45.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.778+0000 7f1dbdffb700 1 -- 172.21.15.72:0/1578775683 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db00059e0 con 0x7f1dc0067b30 2023-08-31T19:24:45.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.778+0000 7f1dbdffb700 1 -- 172.21.15.72:0/1578775683 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0005d60 con 0x7f1dc0067b30 2023-08-31T19:24:45.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.778+0000 7f1dc59ff700 1 -- 172.21.15.72:0/1578775683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc0067b30 msgr2=0x7f1dc0067f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:45.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.778+0000 7f1dc59ff700 1 --2- 172.21.15.72:0/1578775683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc0067b30 0x7f1dc0067f10 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f1db0006fd0 tx=0x7f1db0006f40).stop 2023-08-31T19:24:45.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.778+0000 7f1dc59ff700 1 -- 172.21.15.72:0/1578775683 shutdown_connections 2023-08-31T19:24:45.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.778+0000 7f1dc59ff700 1 --2- 172.21.15.72:0/1578775683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc0067b30 0x7f1dc0067f10 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.778+0000 7f1dc59ff700 1 -- 172.21.15.72:0/1578775683 >> 172.21.15.72:0/1578775683 conn(0x7f1dc00c8c20 msgr2=0x7f1dc00c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:45.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.778+0000 7f1dc59ff700 1 -- 172.21.15.72:0/1578775683 shutdown_connections 2023-08-31T19:24:45.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.778+0000 7f1dc59ff700 1 -- 172.21.15.72:0/1578775683 wait complete. 2023-08-31T19:24:45.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.780+0000 7f1dc59ff700 1 Processor -- start 2023-08-31T19:24:45.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.780+0000 7f1dc59ff700 1 -- start start 2023-08-31T19:24:45.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.781+0000 7f1dc59ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1dc0067b30 0x7f1dc00a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.781+0000 7f1dc59ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc00c5090 0x7f1dc00ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.781+0000 7f1dc59ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc0151f20 0x7f1dc014b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.781+0000 7f1dc59ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc00ad340 con 0x7f1dc00c5090 2023-08-31T19:24:45.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.781+0000 7f1dc59ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc00a6600 con 0x7f1dc0151f20 2023-08-31T19:24:45.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.781+0000 7f1dc59ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc014c1a0 con 0x7f1dc0067b30 2023-08-31T19:24:45.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.781+0000 7f1dbe7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc00c5090 0x7f1dc00ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.781+0000 7f1dbe7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc00c5090 0x7f1dc00ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44334/0 (socket says 172.21.15.72:44334) 2023-08-31T19:24:45.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.781+0000 7f1dbe7fc700 1 -- 172.21.15.72:0/2251473689 learned_addr learned my addr 172.21.15.72:0/2251473689 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:45.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.781+0000 7f1dbe7fc700 1 -- 172.21.15.72:0/2251473689 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1dc0067b30 msgr2=0x7f1dc00a95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:45.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.781+0000 7f1dbe7fc700 1 --2- 172.21.15.72:0/2251473689 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1dc0067b30 0x7f1dc00a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:45.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.781+0000 7f1dbf7fe700 1 --2- 172.21.15.72:0/2251473689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc0151f20 0x7f1dc014b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.781+0000 7f1dbe7fc700 1 -- 172.21.15.72:0/2251473689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc0151f20 msgr2=0x7f1dc014b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:45.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.781+0000 7f1dbe7fc700 1 --2- 172.21.15.72:0/2251473689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc0151f20 0x7f1dc014b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.782+0000 7f1dbe7fc700 1 -- 172.21.15.72:0/2251473689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db0009250 con 0x7f1dc00c5090 2023-08-31T19:24:45.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.782+0000 7f1dbe7fc700 1 --2- 172.21.15.72:0/2251473689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc00c5090 0x7f1dc00ace50 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7f1db400c4c0 tx=0x7f1db4007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:45.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.782+0000 7f1da6ffd700 1 -- 172.21.15.72:0/2251473689 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4007020 con 0x7f1dc00c5090 2023-08-31T19:24:45.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.782+0000 7f1da6ffd700 1 -- 172.21.15.72:0/2251473689 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db4007180 con 0x7f1dc00c5090 2023-08-31T19:24:45.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.782+0000 7f1dc59ff700 1 -- 172.21.15.72:0/2251473689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc00a5d10 con 0x7f1dc00c5090 2023-08-31T19:24:45.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.782+0000 7f1da6ffd700 1 -- 172.21.15.72:0/2251473689 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4007520 con 0x7f1dc00c5090 2023-08-31T19:24:45.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.782+0000 7f1dc59ff700 1 -- 172.21.15.72:0/2251473689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc00a5fb0 con 0x7f1dc00c5090 2023-08-31T19:24:45.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.784+0000 7f1da6ffd700 1 -- 172.21.15.72:0/2251473689 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f1db40068b0 con 0x7f1dc00c5090 2023-08-31T19:24:45.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.785+0000 7f1da6ffd700 1 --2- 172.21.15.72:0/2251473689 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1dac05ef60 0x7f1dac061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.785+0000 7f1da6ffd700 1 -- 172.21.15.72:0/2251473689 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f1db40797b0 con 0x7f1dc00c5090 2023-08-31T19:24:45.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.785+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/2251473689 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1dac05ef60 0x7f1dac061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.786+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/2251473689 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1dac05ef60 0x7f1dac061420 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1db0006fa0 tx=0x7f1db0016000).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:45.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.787+0000 7f1ddcd6ab80 1 Processor -- start 2023-08-31T19:24:45.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.787+0000 7f1ddcd6ab80 1 -- start start 2023-08-31T19:24:45.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.788+0000 7f1ddcd6ab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1722c0 0x5610fd1726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1ddcd6ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1baf60 0x5610fd16d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1ddcd6ab80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd16daf0 0x5610fd16df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1ddcd6ab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610fd0aedb0 con 0x5610fd1722c0 2023-08-31T19:24:45.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1ddcd6ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610fd0c4030 con 0x5610fd1baf60 2023-08-31T19:24:45.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1ddcd6ab80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610fd0c4170 con 0x5610fd16daf0 2023-08-31T19:24:45.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1dbeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1722c0 0x5610fd1726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1dbeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1722c0 0x5610fd1726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44344/0 (socket says 172.21.15.72:44344) 2023-08-31T19:24:45.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1dbeffd700 1 -- 172.21.15.72:0/2612968427 learned_addr learned my addr 172.21.15.72:0/2612968427 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:45.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1dbe7fc700 1 --2- 172.21.15.72:0/2612968427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1baf60 0x5610fd16d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1dbeffd700 1 -- 172.21.15.72:0/2612968427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd16daf0 msgr2=0x5610fd16df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:45.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/2612968427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd16daf0 0x5610fd16df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:45.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1dbeffd700 1 -- 172.21.15.72:0/2612968427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1baf60 msgr2=0x5610fd16d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:45.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/2612968427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1baf60 0x5610fd16d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1dbeffd700 1 -- 172.21.15.72:0/2612968427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610fd096b00 con 0x5610fd1722c0 2023-08-31T19:24:45.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1dbe7fc700 1 --2- 172.21.15.72:0/2612968427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1baf60 0x5610fd16d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:24:45.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.789+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/2612968427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1722c0 0x5610fd1726a0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7f1db0006b80 tx=0x7f1db001c000).ready entity=mon.0 client_cookie=1827ab384815c243 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:45.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.790+0000 7f1d9ffff700 1 -- 172.21.15.72:0/2612968427 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db000b580 con 0x5610fd1722c0 2023-08-31T19:24:45.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.790+0000 7f1d9ffff700 1 -- 172.21.15.72:0/2612968427 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db000b6e0 con 0x5610fd1722c0 2023-08-31T19:24:45.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.790+0000 7f1d9ffff700 1 -- 172.21.15.72:0/2612968427 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db000ba80 con 0x5610fd1722c0 2023-08-31T19:24:45.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.790+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/2612968427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1722c0 msgr2=0x5610fd1726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:45.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.790+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/2612968427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1722c0 0x5610fd1726a0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7f1db0006b80 tx=0x7f1db001c000).stop 2023-08-31T19:24:45.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.790+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/2612968427 shutdown_connections 2023-08-31T19:24:45.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.790+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/2612968427 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd16daf0 0x5610fd16df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:45.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.790+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/2612968427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1722c0 0x5610fd1726a0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.790+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/2612968427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1baf60 0x5610fd16d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.790+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/2612968427 >> 172.21.15.72:0/2612968427 conn(0x5610fcfdc940 msgr2=0x5610fd1bb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:45.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.790+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/2612968427 shutdown_connections 2023-08-31T19:24:45.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.790+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/2612968427 wait complete. 2023-08-31T19:24:45.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.791+0000 7f1ddcd6ab80 1 -- start start 2023-08-31T19:24:45.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.791+0000 7f1ddcd6ab80 1 Processor -- start 2023-08-31T19:24:45.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.792+0000 7f1ddcd6ab80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd16daf0 0x5610fd19f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.792+0000 7f1ddcd6ab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1722c0 0x5610fd1b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.792+0000 7f1ddcd6ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1baf60 0x5610fd1b7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.792+0000 7f1ddcd6ab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610fd0c43f0 con 0x5610fd1722c0 2023-08-31T19:24:45.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.792+0000 7f1ddcd6ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610fd08f920 con 0x5610fd1baf60 2023-08-31T19:24:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.792+0000 7f1ddcd6ab80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610fd1b7650 con 0x5610fd16daf0 2023-08-31T19:24:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.792+0000 7f1ddcd6ab80 10 client.0 ll_register_callbacks cb 0x5610fd064ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:24:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1dbe7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1722c0 0x5610fd1b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1dbe7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1722c0 0x5610fd1b6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44352/0 (socket says 172.21.15.72:44352) 2023-08-31T19:24:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1dbe7fc700 1 -- 172.21.15.72:0/4036296243 learned_addr learned my addr 172.21.15.72:0/4036296243 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1dbf7fe700 1 --2- 172.21.15.72:0/4036296243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1baf60 0x5610fd1b7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/4036296243 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd16daf0 0x5610fd19f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1dbe7fc700 1 -- 172.21.15.72:0/4036296243 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd16daf0 msgr2=0x5610fd19f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1dbe7fc700 1 --2- 172.21.15.72:0/4036296243 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd16daf0 0x5610fd19f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1dbe7fc700 1 -- 172.21.15.72:0/4036296243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1baf60 msgr2=0x5610fd1b7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1dbe7fc700 1 --2- 172.21.15.72:0/4036296243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1baf60 0x5610fd1b7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1dbe7fc700 1 -- 172.21.15.72:0/4036296243 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc00bdb80 con 0x5610fd1722c0 2023-08-31T19:24:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1dbf7fe700 1 --2- 172.21.15.72:0/4036296243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1baf60 0x5610fd1b7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1dbe7fc700 1 --2- 172.21.15.72:0/4036296243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1722c0 0x5610fd1b6c70 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7f1db4077890 tx=0x7f1db4003040).ready entity=mon.0 client_cookie=b0705b937f59b54f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1d9d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:24:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1d9d7fa700 1 -- 172.21.15.72:0/4036296243 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4053070 con 0x5610fd1722c0 2023-08-31T19:24:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/4036296243 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610fd16caa0 con 0x5610fd1722c0 2023-08-31T19:24:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.793+0000 7f1d9d7fa700 1 -- 172.21.15.72:0/4036296243 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f1db4006b60 con 0x5610fd1722c0 2023-08-31T19:24:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.794+0000 7f1d9d7fa700 1 -- 172.21.15.72:0/4036296243 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1db404dbb0 con 0x5610fd1722c0 2023-08-31T19:24:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.794+0000 7f1ddcd6ab80 10 client.9192 fetch_fsmap learned FSMap version 79 2023-08-31T19:24:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.794+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/4036296243 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x5610fd0bcf70 con 0x5610fd1722c0 2023-08-31T19:24:45.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.794+0000 7f1d9d7fa700 1 -- 172.21.15.72:0/4036296243 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610fd16caa0 con 0x5610fd1722c0 2023-08-31T19:24:45.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.794+0000 7f1d9d7fa700 1 -- 172.21.15.72:0/4036296243 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 79) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1db405b070 con 0x5610fd1722c0 2023-08-31T19:24:45.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.794+0000 7f1ddcd6ab80 10 client.9192 fetch_fsmap finished waiting for FSMap version 79 2023-08-31T19:24:45.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.794+0000 7f1ddcd6ab80 10 client.9192 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-31T19:24:45.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.794+0000 7f1ddcd6ab80 20 client.9192 populate_metadata read hostname 'smithi072' 2023-08-31T19:24:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.794+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/4036296243 >> [v2:172.21.15.72:6835/1822141039,v1:172.21.15.72:6837/1822141039] conn(0x5610fd1cab80 0x5610fd1caf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.794+0000 7f1ddcd6ab80 4 client.9192 mds_command: new command op to 9024 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T19:24:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.794+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/4036296243 --> [v2:172.21.15.72:6835/1822141039,v1:172.21.15.72:6837/1822141039] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610fcf2cef0 con 0x5610fd1cab80 2023-08-31T19:24:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.794+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/4036296243 >> [v2:172.21.15.72:6835/1822141039,v1:172.21.15.72:6837/1822141039] conn(0x5610fd1cab80 0x5610fd1caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.795+0000 7f1d9d7fa700 10 client.9192 ms_handle_connect on v2:172.21.15.72:6835/1822141039 2023-08-31T19:24:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.795+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/4036296243 >> [v2:172.21.15.72:6835/1822141039,v1:172.21.15.72:6837/1822141039] conn(0x5610fd1cab80 0x5610fd1caf60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f8a9d9094b2c6a73 server_cookie=593ee802fce9fc02 in_seq=0 out_seq=0 2023-08-31T19:24:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.795+0000 7f1d9d7fa700 1 -- 172.21.15.72:0/4036296243 <== mds.0 v2:172.21.15.72:6835/1822141039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5610fcf2cef0 con 0x5610fd1cab80 2023-08-31T19:24:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.795+0000 7f1d9d7fa700 10 client.9192 handle_command_reply: tid=0 2023-08-31T19:24:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.795+0000 7f1ddcd6ab80 1 client.9192 shutdown 2023-08-31T19:24:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.796+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/4036296243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1722c0 msgr2=0x5610fd1b6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.796+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/4036296243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1722c0 0x5610fd1b6c70 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7f1db4077890 tx=0x7f1db4003040).stop 2023-08-31T19:24:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.796+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/4036296243 shutdown_connections 2023-08-31T19:24:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.796+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/4036296243 >> [v2:172.21.15.72:6835/1822141039,v1:172.21.15.72:6837/1822141039] conn(0x5610fd1cab80 0x5610fd1caf60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.796+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/4036296243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1baf60 0x5610fd1b7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.796+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/4036296243 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd16daf0 0x5610fd19f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.796+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/4036296243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1722c0 0x5610fd1b6c70 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.796+0000 7f1d9d7fa700 0 client.9192 ms_handle_reset on v2:172.21.15.72:6835/1822141039 2023-08-31T19:24:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.796+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/4036296243 >> 172.21.15.72:0/4036296243 conn(0x5610fcfdc940 msgr2=0x5610fd172980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.796+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/4036296243 shutdown_connections 2023-08-31T19:24:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.796+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/4036296243 wait complete. 2023-08-31T19:24:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.796+0000 7f1ddcd6ab80 20 client.9192 trim_cache size 0 max 16384 2023-08-31T19:24:45.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.813+0000 7f1ddcd6ab80 1 Processor -- start 2023-08-31T19:24:45.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.813+0000 7f1ddcd6ab80 1 -- start start 2023-08-31T19:24:45.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.814+0000 7f1ddcd6ab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd16daf0 0x5610fd16dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.814+0000 7f1ddcd6ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1722c0 0x5610fd1bb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.814+0000 7f1ddcd6ab80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd1baf60 0x5610fd168cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.814+0000 7f1ddcd6ab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610fd186bd0 con 0x5610fd16daf0 2023-08-31T19:24:45.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.814+0000 7f1ddcd6ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610fd1d1020 con 0x5610fd1722c0 2023-08-31T19:24:45.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.814+0000 7f1ddcd6ab80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610fd16f2f0 con 0x5610fd1baf60 2023-08-31T19:24:45.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.814+0000 7f1dbeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd16daf0 0x5610fd16dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.814+0000 7f1dbeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd16daf0 0x5610fd16dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44356/0 (socket says 172.21.15.72:44356) 2023-08-31T19:24:45.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.814+0000 7f1dbeffd700 1 -- 172.21.15.72:0/2457141868 learned_addr learned my addr 172.21.15.72:0/2457141868 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:45.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.814+0000 7f1dbf7fe700 1 --2- 172.21.15.72:0/2457141868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd1baf60 0x5610fd168cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.814+0000 7f1dbe7fc700 1 --2- 172.21.15.72:0/2457141868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1722c0 0x5610fd1bb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.814+0000 7f1dbeffd700 1 -- 172.21.15.72:0/2457141868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd1baf60 msgr2=0x5610fd168cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:45.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.814+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/2457141868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd1baf60 0x5610fd168cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.814+0000 7f1dbeffd700 1 -- 172.21.15.72:0/2457141868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1722c0 msgr2=0x5610fd1bb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:45.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.814+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/2457141868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1722c0 0x5610fd1bb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.815+0000 7f1dbeffd700 1 -- 172.21.15.72:0/2457141868 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610fd0b8580 con 0x5610fd16daf0 2023-08-31T19:24:45.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.815+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/2457141868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd16daf0 0x5610fd16dfc0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7f1db0007fe0 tx=0x7f1db0014000).ready entity=mon.0 client_cookie=ce60f4fac5666417 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:45.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.815+0000 7f1da4ff9700 1 -- 172.21.15.72:0/2457141868 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db000bec0 con 0x5610fd16daf0 2023-08-31T19:24:45.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.815+0000 7f1da4ff9700 1 -- 172.21.15.72:0/2457141868 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db0005f60 con 0x5610fd16daf0 2023-08-31T19:24:45.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.815+0000 7f1da4ff9700 1 -- 172.21.15.72:0/2457141868 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00060d0 con 0x5610fd16daf0 2023-08-31T19:24:45.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.815+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/2457141868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd16daf0 msgr2=0x5610fd16dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:45.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.815+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/2457141868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd16daf0 0x5610fd16dfc0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7f1db0007fe0 tx=0x7f1db0014000).stop 2023-08-31T19:24:45.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.815+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/2457141868 shutdown_connections 2023-08-31T19:24:45.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.815+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/2457141868 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd1baf60 0x5610fd168cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.815+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/2457141868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd16daf0 0x5610fd16dfc0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.815+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/2457141868 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1722c0 0x5610fd1bb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.815+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/2457141868 >> 172.21.15.72:0/2457141868 conn(0x5610fcfdc940 msgr2=0x5610fd16f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:45.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.816+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/2457141868 shutdown_connections 2023-08-31T19:24:45.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.816+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/2457141868 wait complete. 2023-08-31T19:24:45.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.816+0000 7f1ddcd6ab80 1 -- start start 2023-08-31T19:24:45.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.816+0000 7f1ddcd6ab80 1 Processor -- start 2023-08-31T19:24:45.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.817+0000 7f1ddcd6ab80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd16daf0 0x5610fd216340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.817+0000 7f1ddcd6ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1722c0 0x5610fd16e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.817+0000 7f1ddcd6ab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1baf60 0x5610fd16e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.817+0000 7f1ddcd6ab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610fd1b5090 con 0x5610fd1baf60 2023-08-31T19:24:45.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.817+0000 7f1ddcd6ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610fd1b40c0 con 0x5610fd1722c0 2023-08-31T19:24:45.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.817+0000 7f1ddcd6ab80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610fd16eae0 con 0x5610fd16daf0 2023-08-31T19:24:45.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.817+0000 7f1ddcd6ab80 10 client.0 ll_register_callbacks cb 0x5610fd064ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:24:45.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.818+0000 7f1dbf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1baf60 0x5610fd16e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.818+0000 7f1dbf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1baf60 0x5610fd16e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44358/0 (socket says 172.21.15.72:44358) 2023-08-31T19:24:45.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.818+0000 7f1dbf7fe700 1 -- 172.21.15.72:0/581047430 learned_addr learned my addr 172.21.15.72:0/581047430 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:45.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.818+0000 7f1dbe7fc700 1 --2- 172.21.15.72:0/581047430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1722c0 0x5610fd16e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.818+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/581047430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd16daf0 0x5610fd216340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.818+0000 7f1dbf7fe700 1 -- 172.21.15.72:0/581047430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd16daf0 msgr2=0x5610fd216340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:45.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.818+0000 7f1dbf7fe700 1 --2- 172.21.15.72:0/581047430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd16daf0 0x5610fd216340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.818+0000 7f1dbf7fe700 1 -- 172.21.15.72:0/581047430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1722c0 msgr2=0x5610fd16e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:45.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.818+0000 7f1dbf7fe700 1 --2- 172.21.15.72:0/581047430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1722c0 0x5610fd16e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.818+0000 7f1dbf7fe700 1 -- 172.21.15.72:0/581047430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610fd096b00 con 0x5610fd1baf60 2023-08-31T19:24:45.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.818+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/581047430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd16daf0 0x5610fd216340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:45.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.818+0000 7f1dbf7fe700 1 --2- 172.21.15.72:0/581047430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1baf60 0x5610fd16e5f0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x5610fd1713e0 tx=0x7f1db8009040).ready entity=mon.0 client_cookie=592b83cf8b08aa8b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:45.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.818+0000 7f1d9d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:24:45.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.818+0000 7f1d9d7fa700 1 -- 172.21.15.72:0/581047430 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db8011d80 con 0x5610fd1baf60 2023-08-31T19:24:45.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.818+0000 7f1d9d7fa700 1 -- 172.21.15.72:0/581047430 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f1db8015430 con 0x5610fd1baf60 2023-08-31T19:24:45.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.819+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/581047430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1db000b6e0 con 0x5610fd1baf60 2023-08-31T19:24:45.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.819+0000 7f1d9d7fa700 1 -- 172.21.15.72:0/581047430 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1db8011ee0 con 0x5610fd1baf60 2023-08-31T19:24:45.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.819+0000 7f1ddcd6ab80 10 client.9198 fetch_fsmap learned FSMap version 79 2023-08-31T19:24:45.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.819+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/581047430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) v3 -- 0x5610fd0b82d0 con 0x5610fd1baf60 2023-08-31T19:24:45.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.819+0000 7f1d9d7fa700 1 -- 172.21.15.72:0/581047430 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db000b6e0 con 0x5610fd1baf60 2023-08-31T19:24:45.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.819+0000 7f1d9d7fa700 1 -- 172.21.15.72:0/581047430 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 79) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1db8015800 con 0x5610fd1baf60 2023-08-31T19:24:45.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.819+0000 7f1ddcd6ab80 10 client.9198 fetch_fsmap finished waiting for FSMap version 79 2023-08-31T19:24:45.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.819+0000 7f1ddcd6ab80 10 client.9198 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-31T19:24:45.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.819+0000 7f1ddcd6ab80 20 client.9198 populate_metadata read hostname 'smithi072' 2023-08-31T19:24:45.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.819+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/581047430 >> [v2:172.21.15.72:6835/1822141039,v1:172.21.15.72:6837/1822141039] conn(0x5610fd21c850 0x5610fd21cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:45.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.819+0000 7f1ddcd6ab80 4 client.9198 mds_command: new command op to 9024 tid=0[{"prefix": "status"}] 2023-08-31T19:24:45.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.819+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/581047430 --> [v2:172.21.15.72:6835/1822141039,v1:172.21.15.72:6837/1822141039] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5610fcf62040 con 0x5610fd21c850 2023-08-31T19:24:45.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.819+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/581047430 >> [v2:172.21.15.72:6835/1822141039,v1:172.21.15.72:6837/1822141039] conn(0x5610fd21c850 0x5610fd21cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:45.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1d9d7fa700 10 client.9198 ms_handle_connect on v2:172.21.15.72:6835/1822141039 2023-08-31T19:24:45.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1dbeffd700 1 --2- 172.21.15.72:0/581047430 >> [v2:172.21.15.72:6835/1822141039,v1:172.21.15.72:6837/1822141039] conn(0x5610fd21c850 0x5610fd21cc30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a360b39db5e038cd server_cookie=693846b1b672f7fb in_seq=0 out_seq=0 2023-08-31T19:24:45.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1d9d7fa700 1 -- 172.21.15.72:0/581047430 <== mds.0 v2:172.21.15.72:6835/1822141039 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5610fcf62040 con 0x5610fd21c850 2023-08-31T19:24:45.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1d9d7fa700 10 client.9198 handle_command_reply: tid=0 2023-08-31T19:24:45.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1ddcd6ab80 1 client.9198 shutdown 2023-08-31T19:24:45.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/581047430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1baf60 msgr2=0x5610fd16e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:45.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/581047430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1baf60 0x5610fd16e5f0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x5610fd1713e0 tx=0x7f1db8009040).stop 2023-08-31T19:24:45.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/581047430 shutdown_connections 2023-08-31T19:24:45.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/581047430 >> [v2:172.21.15.72:6835/1822141039,v1:172.21.15.72:6837/1822141039] conn(0x5610fd21c850 0x5610fd21cc30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/581047430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5610fd1baf60 0x5610fd16e5f0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/581047430 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x5610fd16daf0 0x5610fd216340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1ddcd6ab80 1 --2- 172.21.15.72:0/581047430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5610fd1722c0 0x5610fd16e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/581047430 >> 172.21.15.72:0/581047430 conn(0x5610fcfdc940 msgr2=0x5610fd1bb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:45.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1d9d7fa700 0 client.9198 ms_handle_reset on v2:172.21.15.72:6835/1822141039 2023-08-31T19:24:45.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/581047430 shutdown_connections 2023-08-31T19:24:45.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.820+0000 7f1ddcd6ab80 1 -- 172.21.15.72:0/581047430 wait complete. 2023-08-31T19:24:45.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.821+0000 7f1ddcd6ab80 20 client.9198 trim_cache size 0 max 16384 2023-08-31T19:24:45.834 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:24:45.834 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "acadb8ca-1685-49e1-a73f-5e9d14d95be9", 2023-08-31T19:24:45.835 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-08-31T19:24:45.835 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 9024, 2023-08-31T19:24:45.835 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-08-31T19:24:45.835 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-08-31T19:24:45.835 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-08-31T19:24:45.835 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 6.3089474470000004, 2023-08-31T19:24:45.836 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 79, 2023-08-31T19:24:45.836 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 176, 2023-08-31T19:24:45.836 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 176, 2023-08-31T19:24:45.836 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 11.498762363000001 2023-08-31T19:24:45.836 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:24:45.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.821+0000 7f1dc59ff700 1 -- 172.21.15.72:0/2251473689 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1dac05ef60 msgr2=0x7f1dac061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:45.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.821+0000 7f1dc59ff700 1 --2- 172.21.15.72:0/2251473689 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1dac05ef60 0x7f1dac061420 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1db0006fa0 tx=0x7f1db0016000).stop 2023-08-31T19:24:45.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.821+0000 7f1dc59ff700 1 -- 172.21.15.72:0/2251473689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc00c5090 msgr2=0x7f1dc00ace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:45.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.821+0000 7f1dc59ff700 1 --2- 172.21.15.72:0/2251473689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc00c5090 0x7f1dc00ace50 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7f1db400c4c0 tx=0x7f1db4007dd0).stop 2023-08-31T19:24:45.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.821+0000 7f1dc59ff700 1 -- 172.21.15.72:0/2251473689 shutdown_connections 2023-08-31T19:24:45.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.821+0000 7f1dc59ff700 1 --2- 172.21.15.72:0/2251473689 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1dac05ef60 0x7f1dac061420 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.821+0000 7f1dc59ff700 1 --2- 172.21.15.72:0/2251473689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1dc0151f20 0x7f1dc014b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.821+0000 7f1dc59ff700 1 --2- 172.21.15.72:0/2251473689 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1dc0067b30 0x7f1dc00a95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:45.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.821+0000 7f1dc59ff700 1 --2- 172.21.15.72:0/2251473689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc00c5090 0x7f1dc00ace50 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:45.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.821+0000 7f1dc59ff700 1 -- 172.21.15.72:0/2251473689 >> 172.21.15.72:0/2251473689 conn(0x7f1dc00c8c20 msgr2=0x7f1dc014cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:45.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.821+0000 7f1dc59ff700 1 -- 172.21.15.72:0/2251473689 shutdown_connections 2023-08-31T19:24:45.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.821+0000 7f1dc59ff700 1 -- 172.21.15.72:0/2251473689 wait complete. 2023-08-31T19:24:45.841 DEBUG:teuthology.orchestra.run.smithi072:> ceph fs ls 2023-08-31T19:24:45.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.999+0000 7f15cc1ff700 1 Processor -- start 2023-08-31T19:24:46.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:45.999+0000 7f15cc1ff700 1 -- start start 2023-08-31T19:24:46.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.000+0000 7f15cc1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f15c4137070 0x7f15c405e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:46.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.000+0000 7f15cc1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15c40c6ae0 0x7f15c4157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:46.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.000+0000 7f15cc1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15c4157fb0 0x7f15c4062650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:46.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.000+0000 7f15cc1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c4158960 con 0x7f15c40c6ae0 2023-08-31T19:24:46.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.000+0000 7f15cc1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c40a4be0 con 0x7f15c4137070 2023-08-31T19:24:46.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.000+0000 7f15cc1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4158440 con 0x7f15c4157fb0 2023-08-31T19:24:46.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.001+0000 7f15c979a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15c40c6ae0 0x7f15c4157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:46.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.001+0000 7f15c979a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15c40c6ae0 0x7f15c4157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44370/0 (socket says 172.21.15.72:44370) 2023-08-31T19:24:46.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.001+0000 7f15c979a700 1 -- 172.21.15.72:0/385104511 learned_addr learned my addr 172.21.15.72:0/385104511 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:46.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.001+0000 7f15c9f9b700 1 --2- 172.21.15.72:0/385104511 >> v2:172.21.15.146:3300/0 conn(0x7f15c4137070 0x7f15c405e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:46.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.001+0000 7f15ca79c700 1 --2- 172.21.15.72:0/385104511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15c4157fb0 0x7f15c4062650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:46.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.001+0000 7f15c979a700 1 -- 172.21.15.72:0/385104511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15c4157fb0 msgr2=0x7f15c4062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:46.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.001+0000 7f15c979a700 1 --2- 172.21.15.72:0/385104511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15c4157fb0 0x7f15c4062650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:46.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.001+0000 7f15c979a700 1 -- 172.21.15.72:0/385104511 >> v2:172.21.15.146:3300/0 conn(0x7f15c4137070 msgr2=0x7f15c405e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:46.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.001+0000 7f15c979a700 1 --2- 172.21.15.72:0/385104511 >> v2:172.21.15.146:3300/0 conn(0x7f15c4137070 0x7f15c405e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:46.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.001+0000 7f15c979a700 1 -- 172.21.15.72:0/385104511 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40c4ec0 con 0x7f15c40c6ae0 2023-08-31T19:24:46.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.001+0000 7f15c979a700 1 --2- 172.21.15.72:0/385104511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c40c6ae0 0x7f15c4157ac0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7f15c40686a0 tx=0x7f15b40090f0).ready entity=mon.0 client_cookie=3f982f9b425b19fb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:46.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.002+0000 7f15c8f99700 1 -- 172.21.15.72:0/385104511 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b400b600 con 0x7f15c40c6ae0 2023-08-31T19:24:46.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.002+0000 7f15c8f99700 1 -- 172.21.15.72:0/385104511 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b400b760 con 0x7f15c40c6ae0 2023-08-31T19:24:46.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.002+0000 7f15c8f99700 1 -- 172.21.15.72:0/385104511 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b400bae0 con 0x7f15c40c6ae0 2023-08-31T19:24:46.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.002+0000 7f15cc1ff700 1 -- 172.21.15.72:0/385104511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c40c6ae0 msgr2=0x7f15c4157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:46.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.002+0000 7f15cc1ff700 1 --2- 172.21.15.72:0/385104511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c40c6ae0 0x7f15c4157ac0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7f15c40686a0 tx=0x7f15b40090f0).stop 2023-08-31T19:24:46.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.002+0000 7f15cc1ff700 1 -- 172.21.15.72:0/385104511 shutdown_connections 2023-08-31T19:24:46.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.002+0000 7f15cc1ff700 1 --2- 172.21.15.72:0/385104511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15c4157fb0 0x7f15c4062650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:46.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.002+0000 7f15cc1ff700 1 --2- 172.21.15.72:0/385104511 >> v2:172.21.15.146:3300/0 conn(0x7f15c4137070 0x7f15c405e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:46.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.002+0000 7f15cc1ff700 1 --2- 172.21.15.72:0/385104511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c40c6ae0 0x7f15c4157ac0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:46.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.002+0000 7f15cc1ff700 1 -- 172.21.15.72:0/385104511 >> 172.21.15.72:0/385104511 conn(0x7f15c40c3cc0 msgr2=0x7f15c40c40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:46.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.002+0000 7f15cc1ff700 1 -- 172.21.15.72:0/385104511 shutdown_connections 2023-08-31T19:24:46.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.002+0000 7f15cc1ff700 1 -- 172.21.15.72:0/385104511 wait complete. 2023-08-31T19:24:46.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.004+0000 7f15cc1ff700 1 Processor -- start 2023-08-31T19:24:46.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.004+0000 7f15cc1ff700 1 -- start start 2023-08-31T19:24:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.005+0000 7f15cc1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15c40c6ae0 0x7f15c4153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.005+0000 7f15cc1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c4137070 0x7f15c4138230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.005+0000 7f15cc1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15c4157fb0 0x7f15c4139d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:46.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.005+0000 7f15cc1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4135fb0 con 0x7f15c4137070 2023-08-31T19:24:46.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.005+0000 7f15cc1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40ab650 con 0x7f15c4157fb0 2023-08-31T19:24:46.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.005+0000 7f15cc1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c41361c0 con 0x7f15c40c6ae0 2023-08-31T19:24:46.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.005+0000 7f15c979a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c4137070 0x7f15c4138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:46.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.005+0000 7f15c979a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c4137070 0x7f15c4138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44384/0 (socket says 172.21.15.72:44384) 2023-08-31T19:24:46.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.005+0000 7f15c979a700 1 -- 172.21.15.72:0/1071724922 learned_addr learned my addr 172.21.15.72:0/1071724922 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:46.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.005+0000 7f15c9f9b700 1 --2- 172.21.15.72:0/1071724922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15c40c6ae0 0x7f15c4153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:46.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.006+0000 7f15ca79c700 1 --2- 172.21.15.72:0/1071724922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15c4157fb0 0x7f15c4139d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:46.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.006+0000 7f15c979a700 1 -- 172.21.15.72:0/1071724922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15c40c6ae0 msgr2=0x7f15c4153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:46.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.006+0000 7f15c979a700 1 --2- 172.21.15.72:0/1071724922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15c40c6ae0 0x7f15c4153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:46.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.006+0000 7f15c979a700 1 -- 172.21.15.72:0/1071724922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15c4157fb0 msgr2=0x7f15c4139d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:46.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.006+0000 7f15c979a700 1 --2- 172.21.15.72:0/1071724922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15c4157fb0 0x7f15c4139d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:46.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.006+0000 7f15c979a700 1 -- 172.21.15.72:0/1071724922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b4009370 con 0x7f15c4137070 2023-08-31T19:24:46.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.006+0000 7f15c979a700 1 --2- 172.21.15.72:0/1071724922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c4137070 0x7f15c4138230 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7f15b4009130 tx=0x7f15b4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:46.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.006+0000 7f15b9ffb700 1 -- 172.21.15.72:0/1071724922 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b400b8d0 con 0x7f15c4137070 2023-08-31T19:24:46.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.006+0000 7f15b9ffb700 1 -- 172.21.15.72:0/1071724922 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b400ba30 con 0x7f15c4137070 2023-08-31T19:24:46.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.006+0000 7f15cc1ff700 1 -- 172.21.15.72:0/1071724922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c41364a0 con 0x7f15c4137070 2023-08-31T19:24:46.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.006+0000 7f15b9ffb700 1 -- 172.21.15.72:0/1071724922 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b401c670 con 0x7f15c4137070 2023-08-31T19:24:46.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.006+0000 7f15cc1ff700 1 -- 172.21.15.72:0/1071724922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c40ab2e0 con 0x7f15c4137070 2023-08-31T19:24:46.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.007+0000 7f15cc1ff700 1 -- 172.21.15.72:0/1071724922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c4047480 con 0x7f15c4137070 2023-08-31T19:24:46.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.008+0000 7f15b9ffb700 1 -- 172.21.15.72:0/1071724922 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f15b401ca20 con 0x7f15c4137070 2023-08-31T19:24:46.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.009+0000 7f15b9ffb700 1 --2- 172.21.15.72:0/1071724922 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f15a805ef30 0x7f15a80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:46.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.009+0000 7f15b9ffb700 1 -- 172.21.15.72:0/1071724922 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f15b407c0f0 con 0x7f15c4137070 2023-08-31T19:24:46.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.009+0000 7f15c9f9b700 1 --2- 172.21.15.72:0/1071724922 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f15a805ef30 0x7f15a80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:46.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.010+0000 7f15c9f9b700 1 --2- 172.21.15.72:0/1071724922 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f15a805ef30 0x7f15a80613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f15c000bbc0 tx=0x7f15c0008040).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:46.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.013+0000 7f15b9ffb700 1 -- 172.21.15.72:0/1071724922 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f15b404d0b0 con 0x7f15c4137070 2023-08-31T19:24:46.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.223+0000 7f15cc1ff700 1 -- 172.21.15.72:0/1071724922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f15c40c51a0 con 0x7f15c4137070 2023-08-31T19:24:46.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.224+0000 7f15b9ffb700 1 -- 172.21.15.72:0/1071724922 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v79) v1 ==== 53+0+73 (secure 0 0 0) 0x7f15b402a020 con 0x7f15c4137070 2023-08-31T19:24:46.224 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T19:24:46.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.226+0000 7f15cc1ff700 1 -- 172.21.15.72:0/1071724922 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f15a805ef30 msgr2=0x7f15a80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:46.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.226+0000 7f15cc1ff700 1 --2- 172.21.15.72:0/1071724922 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f15a805ef30 0x7f15a80613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f15c000bbc0 tx=0x7f15c0008040).stop 2023-08-31T19:24:46.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.226+0000 7f15cc1ff700 1 -- 172.21.15.72:0/1071724922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c4137070 msgr2=0x7f15c4138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:46.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.226+0000 7f15cc1ff700 1 --2- 172.21.15.72:0/1071724922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c4137070 0x7f15c4138230 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7f15b4009130 tx=0x7f15b4017000).stop 2023-08-31T19:24:46.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.226+0000 7f15cc1ff700 1 -- 172.21.15.72:0/1071724922 shutdown_connections 2023-08-31T19:24:46.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.226+0000 7f15cc1ff700 1 --2- 172.21.15.72:0/1071724922 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f15a805ef30 0x7f15a80613f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:46.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.226+0000 7f15cc1ff700 1 --2- 172.21.15.72:0/1071724922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15c4157fb0 0x7f15c4139d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:46.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.226+0000 7f15cc1ff700 1 --2- 172.21.15.72:0/1071724922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f15c40c6ae0 0x7f15c4153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:46.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.226+0000 7f15cc1ff700 1 --2- 172.21.15.72:0/1071724922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c4137070 0x7f15c4138230 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:46.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.226+0000 7f15cc1ff700 1 -- 172.21.15.72:0/1071724922 >> 172.21.15.72:0/1071724922 conn(0x7f15c40c3cc0 msgr2=0x7f15c4062650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:46.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.226+0000 7f15cc1ff700 1 -- 172.21.15.72:0/1071724922 shutdown_connections 2023-08-31T19:24:46.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:46.226+0000 7f15cc1ff700 1 -- 172.21.15.72:0/1071724922 wait complete. 2023-08-31T19:24:46.241 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-31T19:24:46.241 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:24:46.241 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-31T19:24:46.242 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T19:24:46.242 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T19:24:46.242 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-31T19:24:46.243 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-31T19:24:46.243 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:24:46.243 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:24:46.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:24:46.244 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-31T19:24:46.291 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:24:46.292 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:24:46.292 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:24:46.292 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:24:46.292 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-31T19:24:46.292 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:24:46.293 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:24:46.293 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:24:46.293 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-31T19:24:46.293 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:24:46.293 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:24:46.294 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-31T19:24:46.294 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:24:46.294 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:24:46.294 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:24:46.294 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:24:46.295 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:24:46.295 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 35790sec preferred_lft 35790sec 2023-08-31T19:24:46.295 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-31T19:24:46.295 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:24:46.295 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:24:46.296 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff 2023-08-31T19:24:46.296 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T19:24:46.296 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:24:46.296 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::7c68:c9ff:fe82:9771/64 scope link 2023-08-31T19:24:46.296 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:24:46.297 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:24:46.297 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e2:e1:71:f6:f6:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T19:24:46.297 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e0e1:71ff:fef6:f6fa/64 scope link 2023-08-31T19:24:46.297 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:24:46.297 INFO:teuthology.orchestra.run.smithi072.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:24:46.297 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T19:24:46.298 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::38f6:6ff:fe3c:1ef/64 scope link 2023-08-31T19:24:46.298 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:24:46.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:24:46.299 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:24:46.366 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-31T19:24:46.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:24:46.370 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-31T19:24:46.420 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-31T19:24:46.420 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:24:46.421 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:24:46.421 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:24:46.421 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:24:46.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:24:46.422 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T19:24:46.422 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T19:24:46.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:24:46.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:24:46.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:24:46.424 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T19:24:46.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:24:46.593 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T19:24:46.640 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T19:24:46.640 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T19:24:46.641 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:24:46.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:24:46.642 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-08-31T19:24:46.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:24:46.713 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-31T19:24:46.759 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-31T19:24:46.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:24:46.898 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:24:46.898 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:24:46.924 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:24:46.924 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:24:46.929 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-31T19:24:46.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:24:46.929 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T19:24:47.000 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-31T19:24:47.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.192+0000 7f583abff700 1 Processor -- start 2023-08-31T19:24:47.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.192+0000 7f583abff700 1 -- start start 2023-08-31T19:24:47.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.193+0000 7f583abff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834154370 0x7f58340c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.193+0000 7f583abff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58341588b0 con 0x7f58340c25e0 2023-08-31T19:24:47.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.193+0000 7f583abff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58340c2a70 con 0x7f5834066d30 2023-08-31T19:24:47.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.193+0000 7f583abff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58340c2d50 con 0x7f5834154370 2023-08-31T19:24:47.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.194+0000 7f5833fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f58340c25e0 0x7f5834062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33688/0 (socket says 172.21.15.72:33688) 2023-08-31T19:24:47.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.194+0000 7f5833fff700 1 -- 172.21.15.72:0/4146700876 learned_addr learned my addr 172.21.15.72:0/4146700876 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:47.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.194+0000 7f583899b700 1 --2- 172.21.15.72:0/4146700876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834154370 0x7f58340c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.194+0000 7f58337fe700 1 -- 172.21.15.72:0/4146700876 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576882513 0 0) 0x7f58341588b0 con 0x7f58340c25e0 2023-08-31T19:24:47.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.194+0000 7f58337fe700 1 -- 172.21.15.72:0/4146700876 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58240033f0 con 0x7f58340c25e0 2023-08-31T19:24:47.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.194+0000 7f58337fe700 1 -- 172.21.15.72:0/4146700876 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2273939972 0 0) 0x7f58240033f0 con 0x7f58340c25e0 2023-08-31T19:24:47.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.194+0000 7f58337fe700 1 -- 172.21.15.72:0/4146700876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834154370 msgr2=0x7f58340c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:47.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.194+0000 7f58337fe700 1 --2- 172.21.15.72:0/4146700876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834154370 0x7f58340c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.194+0000 7f58337fe700 1 -- 172.21.15.72:0/4146700876 >> v1:172.21.15.146:6789/0 conn(0x7f5834066d30 legacy=0x7f5834065470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:47.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.194+0000 7f58337fe700 1 -- 172.21.15.72:0/4146700876 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834158260 con 0x7f58340c25e0 2023-08-31T19:24:47.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f58337fe700 1 -- 172.21.15.72:0/4146700876 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f5820001470 con 0x7f58340c25e0 2023-08-31T19:24:47.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f58337fe700 1 -- 172.21.15.72:0/4146700876 >> v1:172.21.15.72:6789/0 conn(0x7f58340c25e0 legacy=0x7f5834062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:47.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f58337fe700 1 --2- 172.21.15.72:0/4146700876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824003910 0x7f5824003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f58337fe700 1 --2- 172.21.15.72:0/4146700876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834154370 0x7f5824004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f58337fe700 1 --2- 172.21.15.72:0/4146700876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5824004b80 0x7f5824005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f58337fe700 1 -- 172.21.15.72:0/4146700876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58340c2d50 con 0x7f5824004b80 2023-08-31T19:24:47.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f58337fe700 1 -- 172.21.15.72:0/4146700876 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582400b910 con 0x7f5824003910 2023-08-31T19:24:47.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f58337fe700 1 -- 172.21.15.72:0/4146700876 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582400bad0 con 0x7f5834154370 2023-08-31T19:24:47.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f583919c700 1 --2- 172.21.15.72:0/4146700876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5824004b80 0x7f5824005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f583899b700 1 --2- 172.21.15.72:0/4146700876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824003910 0x7f5824003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f5833fff700 1 --2- 172.21.15.72:0/4146700876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834154370 0x7f5824004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f583919c700 1 -- 172.21.15.72:0/4146700876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834154370 msgr2=0x7f5824004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:47.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f583919c700 1 --2- 172.21.15.72:0/4146700876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5834154370 0x7f5824004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f583919c700 1 -- 172.21.15.72:0/4146700876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824003910 msgr2=0x7f5824003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:47.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f583919c700 1 --2- 172.21.15.72:0/4146700876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824003910 0x7f5824003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f583919c700 1 -- 172.21.15.72:0/4146700876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58240033f0 con 0x7f5824004b80 2023-08-31T19:24:47.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.195+0000 7f583919c700 1 --2- 172.21.15.72:0/4146700876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5824004b80 0x7f5824005000 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f582c001e00 tx=0x7f582c007f30).ready entity=mon.0 client_cookie=e415e0e6a06cb239 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:47.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.196+0000 7f58337fe700 1 -- 172.21.15.72:0/4146700876 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c006a20 con 0x7f5824004b80 2023-08-31T19:24:47.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.196+0000 7f58337fe700 1 -- 172.21.15.72:0/4146700876 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c006b80 con 0x7f5824004b80 2023-08-31T19:24:47.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.196+0000 7f58337fe700 1 -- 172.21.15.72:0/4146700876 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c00c5d0 con 0x7f5824004b80 2023-08-31T19:24:47.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.196+0000 7f583abff700 1 -- 172.21.15.72:0/4146700876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5824004b80 msgr2=0x7f5824005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:47.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.196+0000 7f583abff700 1 --2- 172.21.15.72:0/4146700876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5824004b80 0x7f5824005000 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7f582c001e00 tx=0x7f582c007f30).stop 2023-08-31T19:24:47.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.196+0000 7f583919c700 1 -- 172.21.15.72:0/4146700876 reap_dead start 2023-08-31T19:24:47.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.196+0000 7f583abff700 1 -- 172.21.15.72:0/4146700876 shutdown_connections 2023-08-31T19:24:47.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.196+0000 7f583abff700 1 -- 172.21.15.72:0/4146700876 >> 172.21.15.72:0/4146700876 conn(0x7f5834064230 msgr2=0x7f58340c7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:47.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.196+0000 7f583abff700 1 -- 172.21.15.72:0/4146700876 shutdown_connections 2023-08-31T19:24:47.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.196+0000 7f583abff700 1 -- 172.21.15.72:0/4146700876 wait complete. 2023-08-31T19:24:47.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.198+0000 7f583abff700 1 Processor -- start 2023-08-31T19:24:47.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.198+0000 7f583abff700 1 -- start start 2023-08-31T19:24:47.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f583abff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824004b80 0x7f58341650b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f583abff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58340a7720 0x7f58340a7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f583abff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58340c6470 0x7f58340c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f583abff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58340c6050 con 0x7f58340a7720 2023-08-31T19:24:47.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f583abff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58340c6de0 con 0x7f5824004b80 2023-08-31T19:24:47.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f583abff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58341655a0 con 0x7f58340c6470 2023-08-31T19:24:47.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f5833fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58340a7720 0x7f58340a7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f5833fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58340a7720 0x7f58340a7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44402/0 (socket says 172.21.15.72:44402) 2023-08-31T19:24:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f5833fff700 1 -- 172.21.15.72:0/3031310511 learned_addr learned my addr 172.21.15.72:0/3031310511 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f583899b700 1 --2- 172.21.15.72:0/3031310511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824004b80 0x7f58341650b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f583919c700 1 --2- 172.21.15.72:0/3031310511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58340c6470 0x7f58340c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f5833fff700 1 -- 172.21.15.72:0/3031310511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58340c6470 msgr2=0x7f58340c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f5833fff700 1 --2- 172.21.15.72:0/3031310511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58340c6470 0x7f58340c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f5833fff700 1 -- 172.21.15.72:0/3031310511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824004b80 msgr2=0x7f58341650b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f5833fff700 1 --2- 172.21.15.72:0/3031310511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824004b80 0x7f58341650b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f5833fff700 1 -- 172.21.15.72:0/3031310511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58340c75e0 con 0x7f58340a7720 2023-08-31T19:24:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.199+0000 7f583919c700 1 --2- 172.21.15.72:0/3031310511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58340c6470 0x7f58340c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.200+0000 7f5833fff700 1 --2- 172.21.15.72:0/3031310511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58340a7720 0x7f58340a7ba0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f5820004a10 tx=0x7f58340c4580).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:47.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.200+0000 7f5830ff9700 1 -- 172.21.15.72:0/3031310511 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820000f50 con 0x7f58340a7720 2023-08-31T19:24:47.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.200+0000 7f5830ff9700 1 -- 172.21.15.72:0/3031310511 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582000f660 con 0x7f58340a7720 2023-08-31T19:24:47.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.200+0000 7f5830ff9700 1 -- 172.21.15.72:0/3031310511 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000f9e0 con 0x7f58340a7720 2023-08-31T19:24:47.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.200+0000 7f583abff700 1 -- 172.21.15.72:0/3031310511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58340c78c0 con 0x7f58340a7720 2023-08-31T19:24:47.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.200+0000 7f583abff700 1 -- 172.21.15.72:0/3031310511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58340c1ac0 con 0x7f58340a7720 2023-08-31T19:24:47.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.201+0000 7f583abff700 1 -- 172.21.15.72:0/3031310511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583405e4f0 con 0x7f58340a7720 2023-08-31T19:24:47.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.202+0000 7f5830ff9700 1 -- 172.21.15.72:0/3031310511 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f582000fd50 con 0x7f58340a7720 2023-08-31T19:24:47.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.203+0000 7f5830ff9700 1 --2- 172.21.15.72:0/3031310511 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f581805ef30 0x7f58180613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.203+0000 7f5830ff9700 1 -- 172.21.15.72:0/3031310511 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f5820079840 con 0x7f58340a7720 2023-08-31T19:24:47.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.203+0000 7f583899b700 1 --2- 172.21.15.72:0/3031310511 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f581805ef30 0x7f58180613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.204+0000 7f583899b700 1 --2- 172.21.15.72:0/3031310511 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f581805ef30 0x7f58180613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f5828006d80 tx=0x7f5828009060).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:47.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.207+0000 7f5830ff9700 1 -- 172.21.15.72:0/3031310511 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f582004a800 con 0x7f58340a7720 2023-08-31T19:24:47.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.400+0000 7f583abff700 1 -- 172.21.15.72:0/3031310511 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f583406c6b0 con 0x7f581805ef30 2023-08-31T19:24:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.402+0000 7f5830ff9700 1 -- 172.21.15.72:0/3031310511 <== mgr.8844 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f583406c6b0 con 0x7f581805ef30 2023-08-31T19:24:47.402 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:24:47.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:24:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: "name": "cephfs" 2023-08-31T19:24:47.403 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:24:47.403 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:24:47.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.404+0000 7f583abff700 1 -- 172.21.15.72:0/3031310511 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f581805ef30 msgr2=0x7f58180613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:47.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.404+0000 7f583abff700 1 --2- 172.21.15.72:0/3031310511 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f581805ef30 0x7f58180613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f5828006d80 tx=0x7f5828009060).stop 2023-08-31T19:24:47.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.404+0000 7f583abff700 1 -- 172.21.15.72:0/3031310511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58340a7720 msgr2=0x7f58340a7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:47.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.404+0000 7f583abff700 1 --2- 172.21.15.72:0/3031310511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58340a7720 0x7f58340a7ba0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f5820004a10 tx=0x7f58340c4580).stop 2023-08-31T19:24:47.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.404+0000 7f583abff700 1 -- 172.21.15.72:0/3031310511 shutdown_connections 2023-08-31T19:24:47.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.404+0000 7f583abff700 1 --2- 172.21.15.72:0/3031310511 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f581805ef30 0x7f58180613f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.404+0000 7f583abff700 1 --2- 172.21.15.72:0/3031310511 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58340c6470 0x7f58340c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.404+0000 7f583abff700 1 --2- 172.21.15.72:0/3031310511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5824004b80 0x7f58341650b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.404+0000 7f583abff700 1 --2- 172.21.15.72:0/3031310511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58340a7720 0x7f58340a7ba0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.404+0000 7f583abff700 1 -- 172.21.15.72:0/3031310511 >> 172.21.15.72:0/3031310511 conn(0x7f5834064230 msgr2=0x7f58340a4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:47.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.404+0000 7f583abff700 1 -- 172.21.15.72:0/3031310511 shutdown_connections 2023-08-31T19:24:47.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.404+0000 7f583abff700 1 -- 172.21.15.72:0/3031310511 wait complete. 2023-08-31T19:24:47.421 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-31T19:24:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.616+0000 7f78353ff700 1 Processor -- start 2023-08-31T19:24:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.616+0000 7f78353ff700 1 -- start start 2023-08-31T19:24:47.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.617+0000 7f78353ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7830153e30 0x7f7830154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.617+0000 7f78353ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78300637c0 0x7f78300c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.617+0000 7f78353ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78300bfd40 con 0x7f78300c5cb0 2023-08-31T19:24:47.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.617+0000 7f78353ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78300c6730 con 0x7f7830153e30 2023-08-31T19:24:47.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.617+0000 7f78353ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78300bffe0 con 0x7f78300637c0 2023-08-31T19:24:47.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.617+0000 7f782e7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f78300c5cb0 0x7f78300630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33696/0 (socket says 172.21.15.72:33696) 2023-08-31T19:24:47.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.617+0000 7f782e7fc700 1 -- 172.21.15.72:0/3192633640 learned_addr learned my addr 172.21.15.72:0/3192633640 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:47.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782effd700 1 --2- 172.21.15.72:0/3192633640 >> v2:172.21.15.146:3300/0 conn(0x7f7830153e30 0x7f7830154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782f7fe700 1 --2- 172.21.15.72:0/3192633640 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78300637c0 0x7f78300c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 -- 172.21.15.72:0/3192633640 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529659422 0 0) 0x7f78300bfd40 con 0x7f78300c5cb0 2023-08-31T19:24:47.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 -- 172.21.15.72:0/3192633640 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78180033f0 con 0x7f78300c5cb0 2023-08-31T19:24:47.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 -- 172.21.15.72:0/3192633640 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1272343101 0 0) 0x7f78180033f0 con 0x7f78300c5cb0 2023-08-31T19:24:47.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 -- 172.21.15.72:0/3192633640 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78300637c0 msgr2=0x7f78300c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:47.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 --2- 172.21.15.72:0/3192633640 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78300637c0 0x7f78300c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 -- 172.21.15.72:0/3192633640 >> v2:172.21.15.146:3300/0 conn(0x7f7830153e30 msgr2=0x7f7830154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:47.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 --2- 172.21.15.72:0/3192633640 >> v2:172.21.15.146:3300/0 conn(0x7f7830153e30 0x7f7830154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 -- 172.21.15.72:0/3192633640 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78300c02c0 con 0x7f78300c5cb0 2023-08-31T19:24:47.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 -- 172.21.15.72:0/3192633640 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f7824001470 con 0x7f78300c5cb0 2023-08-31T19:24:47.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 -- 172.21.15.72:0/3192633640 >> v1:172.21.15.72:6789/0 conn(0x7f78300c5cb0 legacy=0x7f78300630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:47.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 --2- 172.21.15.72:0/3192633640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78180038e0 0x7f7818003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 --2- 172.21.15.72:0/3192633640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7818004690 0x7f7818004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 --2- 172.21.15.72:0/3192633640 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78300637c0 0x7f7818005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 -- 172.21.15.72:0/3192633640 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78300c6730 con 0x7f78180038e0 2023-08-31T19:24:47.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 -- 172.21.15.72:0/3192633640 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78300bffe0 con 0x7f7818004690 2023-08-31T19:24:47.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.618+0000 7f782dffb700 1 -- 172.21.15.72:0/3192633640 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781800b8e0 con 0x7f78300637c0 2023-08-31T19:24:47.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.619+0000 7f782effd700 1 --2- 172.21.15.72:0/3192633640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78180038e0 0x7f7818003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.619+0000 7f782e7fc700 1 --2- 172.21.15.72:0/3192633640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7818004690 0x7f7818004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.619+0000 7f782f7fe700 1 --2- 172.21.15.72:0/3192633640 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78300637c0 0x7f7818005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.619+0000 7f782effd700 1 -- 172.21.15.72:0/3192633640 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78300637c0 msgr2=0x7f7818005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:47.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.619+0000 7f782effd700 1 --2- 172.21.15.72:0/3192633640 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78300637c0 0x7f7818005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.619+0000 7f782effd700 1 -- 172.21.15.72:0/3192633640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7818004690 msgr2=0x7f7818004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:47.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.619+0000 7f782effd700 1 --2- 172.21.15.72:0/3192633640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7818004690 0x7f7818004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.619+0000 7f782effd700 1 -- 172.21.15.72:0/3192633640 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78180033f0 con 0x7f78180038e0 2023-08-31T19:24:47.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.619+0000 7f782effd700 1 --2- 172.21.15.72:0/3192633640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78180038e0 0x7f7818003d00 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f7820009ab0 tx=0x7f7820009060).ready entity=mon.0 client_cookie=ff7c427feff69133 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:47.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.619+0000 7f782dffb700 1 -- 172.21.15.72:0/3192633640 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820009430 con 0x7f78180038e0 2023-08-31T19:24:47.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.619+0000 7f782dffb700 1 -- 172.21.15.72:0/3192633640 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782000e640 con 0x7f78180038e0 2023-08-31T19:24:47.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.619+0000 7f782dffb700 1 -- 172.21.15.72:0/3192633640 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782000e9c0 con 0x7f78180038e0 2023-08-31T19:24:47.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.620+0000 7f78353ff700 1 -- 172.21.15.72:0/3192633640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78180038e0 msgr2=0x7f7818003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:47.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.620+0000 7f78353ff700 1 --2- 172.21.15.72:0/3192633640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78180038e0 0x7f7818003d00 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f7820009ab0 tx=0x7f7820009060).stop 2023-08-31T19:24:47.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.620+0000 7f782f7fe700 1 -- 172.21.15.72:0/3192633640 reap_dead start 2023-08-31T19:24:47.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.620+0000 7f78353ff700 1 -- 172.21.15.72:0/3192633640 shutdown_connections 2023-08-31T19:24:47.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.620+0000 7f78353ff700 1 -- 172.21.15.72:0/3192633640 >> 172.21.15.72:0/3192633640 conn(0x7f783005eb20 msgr2=0x7f78300cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:47.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.620+0000 7f78353ff700 1 -- 172.21.15.72:0/3192633640 shutdown_connections 2023-08-31T19:24:47.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.620+0000 7f78353ff700 1 -- 172.21.15.72:0/3192633640 wait complete. 2023-08-31T19:24:47.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.621+0000 7f78353ff700 1 Processor -- start 2023-08-31T19:24:47.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.622+0000 7f78353ff700 1 -- start start 2023-08-31T19:24:47.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.622+0000 7f78353ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78180038e0 0x7f7830156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.622+0000 7f78353ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f783014f0e0 0x7f78301574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.622+0000 7f78353ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78301579c0 0x7f78301589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.623+0000 7f78353ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78300ae160 con 0x7f78180038e0 2023-08-31T19:24:47.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.623+0000 7f78353ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7830157e40 con 0x7f783014f0e0 2023-08-31T19:24:47.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.623+0000 7f78353ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78300c4280 con 0x7f78301579c0 2023-08-31T19:24:47.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.623+0000 7f782effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78180038e0 0x7f7830156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.623+0000 7f782effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78180038e0 0x7f7830156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44418/0 (socket says 172.21.15.72:44418) 2023-08-31T19:24:47.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.623+0000 7f782effd700 1 -- 172.21.15.72:0/4109563164 learned_addr learned my addr 172.21.15.72:0/4109563164 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:47.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.623+0000 7f782f7fe700 1 --2- 172.21.15.72:0/4109563164 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78301579c0 0x7f78301589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.623+0000 7f782e7fc700 1 --2- 172.21.15.72:0/4109563164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f783014f0e0 0x7f78301574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.623+0000 7f782effd700 1 -- 172.21.15.72:0/4109563164 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78301579c0 msgr2=0x7f78301589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:47.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.623+0000 7f782effd700 1 --2- 172.21.15.72:0/4109563164 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78301579c0 0x7f78301589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.623+0000 7f782effd700 1 -- 172.21.15.72:0/4109563164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f783014f0e0 msgr2=0x7f78301574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:47.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.623+0000 7f782effd700 1 --2- 172.21.15.72:0/4109563164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f783014f0e0 0x7f78301574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.623+0000 7f782effd700 1 -- 172.21.15.72:0/4109563164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78300c4560 con 0x7f78180038e0 2023-08-31T19:24:47.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.623+0000 7f782effd700 1 --2- 172.21.15.72:0/4109563164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78180038e0 0x7f7830156c10 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f782000e4b0 tx=0x7f782001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:47.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.624+0000 7f7816ffd700 1 -- 172.21.15.72:0/4109563164 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782000ed30 con 0x7f78180038e0 2023-08-31T19:24:47.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.624+0000 7f7816ffd700 1 -- 172.21.15.72:0/4109563164 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782000ee90 con 0x7f78180038e0 2023-08-31T19:24:47.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.624+0000 7f78353ff700 1 -- 172.21.15.72:0/4109563164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78300c4840 con 0x7f78180038e0 2023-08-31T19:24:47.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.624+0000 7f7816ffd700 1 -- 172.21.15.72:0/4109563164 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782001b450 con 0x7f78180038e0 2023-08-31T19:24:47.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.624+0000 7f78353ff700 1 -- 172.21.15.72:0/4109563164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7830159c80 con 0x7f78180038e0 2023-08-31T19:24:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.625+0000 7f78353ff700 1 -- 172.21.15.72:0/4109563164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783006c6b0 con 0x7f78180038e0 2023-08-31T19:24:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.626+0000 7f7816ffd700 1 -- 172.21.15.72:0/4109563164 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 79) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f782001b800 con 0x7f78180038e0 2023-08-31T19:24:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.626+0000 7f7816ffd700 1 --2- 172.21.15.72:0/4109563164 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f781c05ef30 0x7f781c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.626+0000 7f7816ffd700 1 -- 172.21.15.72:0/4109563164 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f782007bc10 con 0x7f78180038e0 2023-08-31T19:24:47.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.627+0000 7f782e7fc700 1 --2- 172.21.15.72:0/4109563164 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f781c05ef30 0x7f781c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:47.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.627+0000 7f782e7fc700 1 --2- 172.21.15.72:0/4109563164 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f781c05ef30 0x7f781c0613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f78300c3280 tx=0x7f7824001e90).ready entity=mgr.8844 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:47.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.630+0000 7f7816ffd700 1 -- 172.21.15.72:0/4109563164 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f782004cbd0 con 0x7f78180038e0 2023-08-31T19:24:47.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.842+0000 7f78353ff700 1 -- 172.21.15.72:0/4109563164 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f783014f540 con 0x7f78180038e0 2023-08-31T19:24:47.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.900+0000 7f7816ffd700 1 -- 172.21.15.72:0/4109563164 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 80) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f7820079530 con 0x7f78180038e0 2023-08-31T19:24:47.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.900+0000 7f7816ffd700 1 -- 172.21.15.72:0/4109563164 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v80) v1 ==== 92+0+0 (secure 0 0 0) 0x7f7820042680 con 0x7f78180038e0 2023-08-31T19:24:47.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.903+0000 7f78353ff700 1 -- 172.21.15.72:0/4109563164 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f781c05ef30 msgr2=0x7f781c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:47.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.903+0000 7f78353ff700 1 --2- 172.21.15.72:0/4109563164 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f781c05ef30 0x7f781c0613f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f78300c3280 tx=0x7f7824001e90).stop 2023-08-31T19:24:47.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.903+0000 7f78353ff700 1 -- 172.21.15.72:0/4109563164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78180038e0 msgr2=0x7f7830156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:47.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.903+0000 7f78353ff700 1 --2- 172.21.15.72:0/4109563164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78180038e0 0x7f7830156c10 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f782000e4b0 tx=0x7f782001a000).stop 2023-08-31T19:24:47.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.903+0000 7f78353ff700 1 -- 172.21.15.72:0/4109563164 shutdown_connections 2023-08-31T19:24:47.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.903+0000 7f78353ff700 1 --2- 172.21.15.72:0/4109563164 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f781c05ef30 0x7f781c0613f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.903+0000 7f78353ff700 1 --2- 172.21.15.72:0/4109563164 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f78301579c0 0x7f78301589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.903+0000 7f78353ff700 1 --2- 172.21.15.72:0/4109563164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78180038e0 0x7f7830156c10 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.903+0000 7f78353ff700 1 --2- 172.21.15.72:0/4109563164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f783014f0e0 0x7f78301574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:47.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.903+0000 7f78353ff700 1 -- 172.21.15.72:0/4109563164 >> 172.21.15.72:0/4109563164 conn(0x7f783005eb20 msgr2=0x7f783014f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:47.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.903+0000 7f78353ff700 1 -- 172.21.15.72:0/4109563164 shutdown_connections 2023-08-31T19:24:47.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:47.903+0000 7f78353ff700 1 -- 172.21.15.72:0/4109563164 wait complete. 2023-08-31T19:24:47.922 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-31T19:24:48.112 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:48.111+0000 7fc9d9dcd680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:24:48.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.124+0000 7f555e9ff700 1 Processor -- start 2023-08-31T19:24:48.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.124+0000 7f555e9ff700 1 -- start start 2023-08-31T19:24:48.125 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:48.125+0000 7f23f745c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:24:48.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.126+0000 7f555e9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555814ecd0 0x7f55581556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:48.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.126+0000 7f555e9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f55580c2320 0x7f55580c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:48.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.126+0000 7f555e9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5558152720 con 0x7f55580c1100 2023-08-31T19:24:48.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.126+0000 7f555e9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55580c2c90 con 0x7f55580c2320 2023-08-31T19:24:48.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.126+0000 7f555e9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555806a6b0 con 0x7f555814ecd0 2023-08-31T19:24:48.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.126+0000 7f55577fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f55580c2320 0x7f55580c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:48.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.126+0000 7f555cf9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f55580c1100 0x7f55580c15b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33708/0 (socket says 172.21.15.72:33708) 2023-08-31T19:24:48.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.126+0000 7f555cf9c700 1 -- 172.21.15.72:0/3083430383 learned_addr learned my addr 172.21.15.72:0/3083430383 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:48.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.126+0000 7f55577fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f55580c2320 0x7f55580c27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44440/0 (socket says 172.21.15.72:44440) 2023-08-31T19:24:48.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.126+0000 7f5557fff700 1 --2- 172.21.15.72:0/3083430383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555814ecd0 0x7f55581556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:48.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.127+0000 7f55577fe700 1 -- 172.21.15.72:0/3083430383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555814ecd0 msgr2=0x7f55581556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:48.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.127+0000 7f55577fe700 1 --2- 172.21.15.72:0/3083430383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555814ecd0 0x7f55581556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:48.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.127+0000 7f55577fe700 1 -- 172.21.15.72:0/3083430383 >> v1:172.21.15.72:6789/0 conn(0x7f55580c1100 legacy=0x7f55580c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:48.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.127+0000 7f55577fe700 1 -- 172.21.15.72:0/3083430383 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5558155bc0 con 0x7f55580c2320 2023-08-31T19:24:48.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.127+0000 7f5556ffd700 1 -- 172.21.15.72:0/3083430383 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198810036 0 0) 0x7f5558152720 con 0x7f55580c1100 2023-08-31T19:24:48.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.127+0000 7f55577fe700 1 --2- 172.21.15.72:0/3083430383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55580c2320 0x7f55580c27a0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f554c009760 tx=0x7f554c009060).ready entity=mon.0 client_cookie=170289b1f3323cb5 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:48.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.127+0000 7f5556ffd700 1 -- 172.21.15.72:0/3083430383 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c00f510 con 0x7f55580c2320 2023-08-31T19:24:48.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.127+0000 7f5556ffd700 1 -- 172.21.15.72:0/3083430383 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c00f670 con 0x7f55580c2320 2023-08-31T19:24:48.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.127+0000 7f5556ffd700 1 -- 172.21.15.72:0/3083430383 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c00f9f0 con 0x7f55580c2320 2023-08-31T19:24:48.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.128+0000 7f555e9ff700 1 -- 172.21.15.72:0/3083430383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55580c2320 msgr2=0x7f55580c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:48.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.128+0000 7f555e9ff700 1 --2- 172.21.15.72:0/3083430383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55580c2320 0x7f55580c27a0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f554c009760 tx=0x7f554c009060).stop 2023-08-31T19:24:48.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.128+0000 7f555e9ff700 1 -- 172.21.15.72:0/3083430383 shutdown_connections 2023-08-31T19:24:48.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.128+0000 7f555e9ff700 1 --2- 172.21.15.72:0/3083430383 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f555814ecd0 0x7f55581556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:48.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.128+0000 7f555e9ff700 1 --2- 172.21.15.72:0/3083430383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55580c2320 0x7f55580c27a0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:48.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.128+0000 7f555e9ff700 1 -- 172.21.15.72:0/3083430383 >> 172.21.15.72:0/3083430383 conn(0x7f55580630c0 msgr2=0x7f55580c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:48.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.128+0000 7f555e9ff700 1 -- 172.21.15.72:0/3083430383 shutdown_connections 2023-08-31T19:24:48.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.128+0000 7f555e9ff700 1 -- 172.21.15.72:0/3083430383 wait complete. 2023-08-31T19:24:48.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.130+0000 7f555e9ff700 1 Processor -- start 2023-08-31T19:24:48.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.130+0000 7f555e9ff700 1 -- start start 2023-08-31T19:24:48.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f555e9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55580c1100 0x7f5558153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:48.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f555e9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55580c2320 0x7f55581641f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:48.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f555e9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f555814ecd0 0x7f55581646e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:48.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f555e9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55580c4bb0 con 0x7f55580c1100 2023-08-31T19:24:48.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f555e9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5558153f50 con 0x7f555814ecd0 2023-08-31T19:24:48.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f555e9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5558154230 con 0x7f55580c2320 2023-08-31T19:24:48.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f5557fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55580c1100 0x7f5558153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:48.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f5557fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55580c1100 0x7f5558153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44456/0 (socket says 172.21.15.72:44456) 2023-08-31T19:24:48.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f5557fff700 1 -- 172.21.15.72:0/1505410004 learned_addr learned my addr 172.21.15.72:0/1505410004 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:48.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f55577fe700 1 --2- 172.21.15.72:0/1505410004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55580c2320 0x7f55581641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:48.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f555cf9c700 1 --2- 172.21.15.72:0/1505410004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f555814ecd0 0x7f55581646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:48.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f5557fff700 1 -- 172.21.15.72:0/1505410004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55580c2320 msgr2=0x7f55581641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:48.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f5557fff700 1 --2- 172.21.15.72:0/1505410004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55580c2320 0x7f55581641f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:48.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f5557fff700 1 -- 172.21.15.72:0/1505410004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f555814ecd0 msgr2=0x7f55581646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:48.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f5557fff700 1 --2- 172.21.15.72:0/1505410004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f555814ecd0 0x7f55581646e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:48.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.131+0000 7f5557fff700 1 -- 172.21.15.72:0/1505410004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0092a0 con 0x7f55580c1100 2023-08-31T19:24:48.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.132+0000 7f5557fff700 1 --2- 172.21.15.72:0/1505410004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55580c1100 0x7f5558153590 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f554800e900 tx=0x7f5548009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:48.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.132+0000 7f553ffff700 1 -- 172.21.15.72:0/1505410004 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548012600 con 0x7f55580c1100 2023-08-31T19:24:48.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.132+0000 7f553ffff700 1 -- 172.21.15.72:0/1505410004 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5548012760 con 0x7f55580c1100 2023-08-31T19:24:48.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.132+0000 7f553ffff700 1 -- 172.21.15.72:0/1505410004 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548012ae0 con 0x7f55580c1100 2023-08-31T19:24:48.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.132+0000 7f555e9ff700 1 -- 172.21.15.72:0/1505410004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5558154510 con 0x7f55580c1100 2023-08-31T19:24:48.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.132+0000 7f555e9ff700 1 -- 172.21.15.72:0/1505410004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5558153c40 con 0x7f55580c1100 2023-08-31T19:24:48.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.133+0000 7f555e9ff700 1 -- 172.21.15.72:0/1505410004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55580c4e20 con 0x7f55580c1100 2023-08-31T19:24:48.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.134+0000 7f553ffff700 1 -- 172.21.15.72:0/1505410004 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 80) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f554801b400 con 0x7f55580c1100 2023-08-31T19:24:48.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.134+0000 7f553ffff700 1 --2- 172.21.15.72:0/1505410004 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f554405ef80 0x7f5544061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:48.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.135+0000 7f553ffff700 1 -- 172.21.15.72:0/1505410004 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f554807a660 con 0x7f55580c1100 2023-08-31T19:24:48.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.135+0000 7f55577fe700 1 -- 172.21.15.72:0/1505410004 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f554405ef80 msgr2=0x7f5544061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:48.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.135+0000 7f55577fe700 1 --2- 172.21.15.72:0/1505410004 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f554405ef80 0x7f5544061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:24:48.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.138+0000 7f553ffff700 1 -- 172.21.15.72:0/1505410004 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f554804b5c0 con 0x7f55580c1100 2023-08-31T19:24:48.190 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:48.190+0000 7fc9d9dcd680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:24:48.206 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:48.206+0000 7f23f745c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:24:48.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.316+0000 7f555e9ff700 1 -- 172.21.15.72:0/1505410004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f555806c6b0 con 0x7f55580c1100 2023-08-31T19:24:48.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.320+0000 7f553ffff700 1 -- 172.21.15.72:0/1505410004 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f554804ebe0 con 0x7f55580c1100 2023-08-31T19:24:48.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.322+0000 7f555e9ff700 1 -- 172.21.15.72:0/1505410004 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f554405ef80 msgr2=0x7f5544061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:24:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.322+0000 7f555e9ff700 1 --2- 172.21.15.72:0/1505410004 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f554405ef80 0x7f5544061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.322+0000 7f555e9ff700 1 -- 172.21.15.72:0/1505410004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55580c1100 msgr2=0x7f5558153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.322+0000 7f555e9ff700 1 --2- 172.21.15.72:0/1505410004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55580c1100 0x7f5558153590 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f554800e900 tx=0x7f5548009060).stop 2023-08-31T19:24:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.322+0000 7f555e9ff700 1 -- 172.21.15.72:0/1505410004 shutdown_connections 2023-08-31T19:24:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.322+0000 7f555e9ff700 1 --2- 172.21.15.72:0/1505410004 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f554405ef80 0x7f5544061440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.322+0000 7f555e9ff700 1 --2- 172.21.15.72:0/1505410004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f555814ecd0 0x7f55581646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.322+0000 7f555e9ff700 1 --2- 172.21.15.72:0/1505410004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55580c1100 0x7f5558153590 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.322+0000 7f555e9ff700 1 --2- 172.21.15.72:0/1505410004 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f55580c2320 0x7f55581641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.322+0000 7f555e9ff700 1 -- 172.21.15.72:0/1505410004 >> 172.21.15.72:0/1505410004 conn(0x7f55580630c0 msgr2=0x7f55580bca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.322+0000 7f555e9ff700 1 -- 172.21.15.72:0/1505410004 shutdown_connections 2023-08-31T19:24:48.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.322+0000 7f555e9ff700 1 -- 172.21.15.72:0/1505410004 wait complete. 2023-08-31T19:24:48.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:48.342 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-31T19:24:48.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-31T19:24:48.518 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:48.518+0000 7fc9d9dcd680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:24:48.552 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:48.551+0000 7f23f745c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:24:48.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.593+0000 7f4a077ff700 1 Processor -- start 2023-08-31T19:24:48.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.593+0000 7f4a077ff700 1 -- start start 2023-08-31T19:24:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.594+0000 7f4a077ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a00151da0 0x7f4a001553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.594+0000 7f4a077ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000c5370 0x7f4a00064660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.594+0000 7f4a077ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a00154f40 con 0x7f4a00064b50 2023-08-31T19:24:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.594+0000 7f4a077ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a000c57f0 con 0x7f4a00151da0 2023-08-31T19:24:48.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.594+0000 7f4a077ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a00154960 con 0x7f4a000c5370 2023-08-31T19:24:48.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.595+0000 7f4a04d9a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000c5370 0x7f4a00064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:48.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.595+0000 7f4a0559b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a00151da0 0x7f4a001553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:48.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.595+0000 7f4a05d9c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4a00064b50 0x7f4a000bfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:53208/0 (socket says 172.21.15.72:53208) 2023-08-31T19:24:48.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.595+0000 7f4a05d9c700 1 -- 172.21.15.72:0/3448492726 learned_addr learned my addr 172.21.15.72:0/3448492726 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:48.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.595+0000 7f4a0559b700 1 -- 172.21.15.72:0/3448492726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000c5370 msgr2=0x7f4a00064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.595+0000 7f4a0559b700 1 --2- 172.21.15.72:0/3448492726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000c5370 0x7f4a00064660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.595+0000 7f4a0559b700 1 -- 172.21.15.72:0/3448492726 >> v1:172.21.15.146:6789/0 conn(0x7f4a00064b50 legacy=0x7f4a000bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.595+0000 7f4a0559b700 1 -- 172.21.15.72:0/3448492726 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a00064fc0 con 0x7f4a00151da0 2023-08-31T19:24:48.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.595+0000 7f4a04d9a700 1 --2- 172.21.15.72:0/3448492726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000c5370 0x7f4a00064660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:48.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.596+0000 7f4a0559b700 1 --2- 172.21.15.72:0/3448492726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a00151da0 0x7f4a001553d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f49fc009760 tx=0x7f49fc009060).ready entity=mon.1 client_cookie=6a828c0417643aa7 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:48.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.596+0000 7f49f7fff700 1 -- 172.21.15.72:0/3448492726 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00f510 con 0x7f4a00151da0 2023-08-31T19:24:48.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.596+0000 7f49f7fff700 1 -- 172.21.15.72:0/3448492726 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc00f670 con 0x7f4a00151da0 2023-08-31T19:24:48.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.596+0000 7f49f7fff700 1 -- 172.21.15.72:0/3448492726 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00f9f0 con 0x7f4a00151da0 2023-08-31T19:24:48.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.596+0000 7f4a077ff700 1 -- 172.21.15.72:0/3448492726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a00151da0 msgr2=0x7f4a001553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:48.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.596+0000 7f4a077ff700 1 --2- 172.21.15.72:0/3448492726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a00151da0 0x7f4a001553d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f49fc009760 tx=0x7f49fc009060).stop 2023-08-31T19:24:48.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.596+0000 7f4a077ff700 1 -- 172.21.15.72:0/3448492726 shutdown_connections 2023-08-31T19:24:48.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.596+0000 7f4a077ff700 1 --2- 172.21.15.72:0/3448492726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a00151da0 0x7f4a001553d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:48.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.596+0000 7f4a077ff700 1 --2- 172.21.15.72:0/3448492726 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000c5370 0x7f4a00064660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:48.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.596+0000 7f4a077ff700 1 -- 172.21.15.72:0/3448492726 >> 172.21.15.72:0/3448492726 conn(0x7f4a00063a90 msgr2=0x7f4a000cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:48.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.597+0000 7f4a077ff700 1 -- 172.21.15.72:0/3448492726 shutdown_connections 2023-08-31T19:24:48.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.597+0000 7f4a077ff700 1 -- 172.21.15.72:0/3448492726 wait complete. 2023-08-31T19:24:48.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.598+0000 7f4a077ff700 1 Processor -- start 2023-08-31T19:24:48.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.598+0000 7f4a077ff700 1 -- start start 2023-08-31T19:24:48.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.599+0000 7f4a077ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a00064b50 0x7f4a000ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:48.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.599+0000 7f4a077ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000c5370 0x7f4a00150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:48.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.599+0000 7f4a077ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a00151da0 0x7f4a00150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:48.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.599+0000 7f4a077ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a00151490 con 0x7f4a00151da0 2023-08-31T19:24:48.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.599+0000 7f4a077ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a000c2a40 con 0x7f4a00064b50 2023-08-31T19:24:48.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.599+0000 7f4a077ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a000afe00 con 0x7f4a000c5370 2023-08-31T19:24:48.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.599+0000 7f4a05d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a00151da0 0x7f4a00150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:48.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.599+0000 7f4a04d9a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000c5370 0x7f4a00150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:48.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.600+0000 7f4a0559b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a00064b50 0x7f4a000ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:48.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.600+0000 7f4a04d9a700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000c5370 0x7f4a00150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:55602/0 (socket says 172.21.15.72:55602) 2023-08-31T19:24:48.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.600+0000 7f4a04d9a700 1 -- 172.21.15.72:0/58457053 learned_addr learned my addr 172.21.15.72:0/58457053 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:48.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.600+0000 7f4a05d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a00151da0 0x7f4a00150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44460/0 (socket says 172.21.15.72:44460) 2023-08-31T19:24:48.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.600+0000 7f4a04d9a700 1 -- 172.21.15.72:0/58457053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a00064b50 msgr2=0x7f4a000ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:48.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.600+0000 7f4a04d9a700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a00064b50 0x7f4a000ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:48.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.600+0000 7f4a04d9a700 1 -- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a00151da0 msgr2=0x7f4a00150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:48.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.600+0000 7f4a04d9a700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a00151da0 0x7f4a00150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:48.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.600+0000 7f4a04d9a700 1 -- 172.21.15.72:0/58457053 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f00092a0 con 0x7f4a000c5370 2023-08-31T19:24:48.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.600+0000 7f4a04d9a700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000c5370 0x7f4a00150600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f49f000ea50 tx=0x7f49f0009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:48.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.600+0000 7f49f57fa700 1 -- 172.21.15.72:0/58457053 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f000ee90 con 0x7f4a000c5370 2023-08-31T19:24:48.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.600+0000 7f49f57fa700 1 -- 172.21.15.72:0/58457053 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f000c850 con 0x7f4a000c5370 2023-08-31T19:24:48.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.600+0000 7f4a077ff700 1 -- 172.21.15.72:0/58457053 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49fc0092a0 con 0x7f4a000c5370 2023-08-31T19:24:48.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.600+0000 7f49f57fa700 1 -- 172.21.15.72:0/58457053 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f000cbd0 con 0x7f4a000c5370 2023-08-31T19:24:48.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.601+0000 7f4a077ff700 1 -- 172.21.15.72:0/58457053 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a001511b0 con 0x7f4a000c5370 2023-08-31T19:24:48.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.602+0000 7f4a077ff700 1 -- 172.21.15.72:0/58457053 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0006a7e0 con 0x7f4a000c5370 2023-08-31T19:24:48.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.602+0000 7f49f57fa700 1 -- 172.21.15.72:0/58457053 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 80) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f49f001b400 con 0x7f4a000c5370 2023-08-31T19:24:48.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.603+0000 7f49f57fa700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 0x7f49e4061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:48.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.603+0000 7f49f57fa700 1 -- 172.21.15.72:0/58457053 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f49f007a820 con 0x7f4a000c5370 2023-08-31T19:24:48.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.603+0000 7f4a0559b700 1 -- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 msgr2=0x7f49e4061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:48.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.604+0000 7f4a0559b700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 0x7f49e4061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:24:48.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.608+0000 7f49f57fa700 1 -- 172.21.15.72:0/58457053 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f49f004b780 con 0x7f4a000c5370 2023-08-31T19:24:48.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.805+0000 7f4a0559b700 1 -- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 msgr2=0x7f49e4061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:48.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.805+0000 7f4a0559b700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 0x7f49e4061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:24:48.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:48.806+0000 7f4a077ff700 1 -- 172.21.15.72:0/58457053 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a0006c6b0 con 0x7f49e405ef80 2023-08-31T19:24:49.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:49.206+0000 7f4a0559b700 1 -- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 msgr2=0x7f49e4061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:49.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:49.206+0000 7f4a0559b700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 0x7f49e4061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-31T19:24:49.261 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:49.261+0000 7fc9d9dcd680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:24:49.297 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:49.296+0000 7f23f745c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:24:49.345 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:49.344+0000 7fc9d9dcd680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:24:49.380 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:49.380+0000 7f23f745c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:24:49.576 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:49.576+0000 7fc9d9dcd680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:24:49.610 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:49.609+0000 7f23f745c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:24:50.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:50.007+0000 7f4a0559b700 1 -- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 msgr2=0x7f49e4061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:50.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:50.007+0000 7f4a0559b700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 0x7f49e4061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-31T19:24:50.091 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:50.091+0000 7fc9d9dcd680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:24:50.120 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:50.120+0000 7f23f745c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:24:50.215 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:50.215+0000 7fc9d9dcd680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:24:50.243 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:50.243+0000 7f23f745c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:24:50.400 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:50.400+0000 7fc9d9dcd680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:24:50.429 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:50.426+0000 7f23f745c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:24:50.492 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:50.492+0000 7fc9d9dcd680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:24:50.519 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:50.519+0000 7f23f745c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:24:50.576 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:50.576+0000 7fc9d9dcd680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:24:50.604 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:50.604+0000 7f23f745c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:24:50.885 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:50.885+0000 7fc9d9dcd680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:24:50.912 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:50.912+0000 7f23f745c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:24:51.107 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:51.107+0000 7fc9d9dcd680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:24:51.132 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:51.132+0000 7f23f745c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:24:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:51.609+0000 7f4a0559b700 1 -- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 msgr2=0x7f49e4061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:24:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:51.609+0000 7f4a0559b700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 0x7f49e4061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-31T19:24:51.910 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:51.910+0000 7fc9d9dcd680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:24:51.930 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:51.930+0000 7f23f745c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:24:51.998 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:51.998+0000 7fc9d9dcd680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:24:52.020 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:52.019+0000 7f23f745c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:24:52.092 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:52.092+0000 7fc9d9dcd680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:24:52.113 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:52.113+0000 7f23f745c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:24:52.276 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:52.275+0000 7fc9d9dcd680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:24:52.297 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:52.297+0000 7f23f745c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:24:52.365 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:52.365+0000 7fc9d9dcd680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:24:52.387 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:52.386+0000 7f23f745c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:24:52.506 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:52.506+0000 7fc9d9dcd680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:24:52.527 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:52.527+0000 7f23f745c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:24:52.637 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:52.637+0000 7fc9d9dcd680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:24:52.656 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:52.656+0000 7f23f745c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:24:52.981 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:52.981+0000 7fc9d9dcd680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:24:53.000 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:53.000+0000 7f23f745c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:24:53.070 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:24:53.070+0000 7fc9d9dcd680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:24:53.090 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:53.090+0000 7f23f745c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:24:53.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:53.102+0000 7f49f57fa700 1 -- 172.21.15.72:0/58457053 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mgrmap(e 81) v1 ==== 75113+0+0 (secure 0 0 0) 0x7f49f0078140 con 0x7f4a000c5370 2023-08-31T19:24:53.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:53.102+0000 7f49f57fa700 1 -- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 msgr2=0x7f49e4061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:24:53.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:53.102+0000 7f49f57fa700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 0x7f49e4061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:53.171 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:53.171+0000 7f2369f01700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:53.172 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:53.171+0000 7f2369f01700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:53.172 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:53.171+0000 7f2369f01700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:53.172 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:53.171+0000 7f2369f01700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:53.172 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:53.171+0000 7f2369f01700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:53.172 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:53.171+0000 7f236cf07700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:53.173 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:53.171+0000 7f236cf07700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:53.173 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:53.171+0000 7f236cf07700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:53.173 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:53.171+0000 7f236cf07700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:53.173 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:24:53.171+0000 7f236cf07700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:24:54.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.109+0000 7f49f57fa700 1 -- 172.21.15.72:0/58457053 <== mon.2 v2:172.21.15.146:3301/0 8 ==== mgrmap(e 82) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f49f00784c0 con 0x7f4a000c5370 2023-08-31T19:24:54.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.110+0000 7f49f57fa700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 0x7f49e40613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:54.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.110+0000 7f49f57fa700 1 -- 172.21.15.72:0/58457053 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a0006c6b0 con 0x7f49e405ef80 2023-08-31T19:24:54.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.111+0000 7f4a0559b700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 0x7f49e40613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:54.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.113+0000 7f4a0559b700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 0x7f49e40613c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f49fc009fd0 tx=0x7f49fc017000).ready entity=mgr.9228 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:54.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.122+0000 7f49f57fa700 1 -- 172.21.15.72:0/58457053 <== mgr.9228 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4a0006c6b0 con 0x7f49e405ef80 2023-08-31T19:24:54.122 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path snap_test_dir1 2023-08-31T19:24:54.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.124+0000 7f4a077ff700 1 -- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 msgr2=0x7f49e40613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:54.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.124+0000 7f4a077ff700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 0x7f49e40613c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f49fc009fd0 tx=0x7f49fc017000).stop 2023-08-31T19:24:54.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.124+0000 7f4a077ff700 1 -- 172.21.15.72:0/58457053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000c5370 msgr2=0x7f4a00150600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:54.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.124+0000 7f4a077ff700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000c5370 0x7f4a00150600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f49f000ea50 tx=0x7f49f0009060).stop 2023-08-31T19:24:54.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.124+0000 7f4a077ff700 1 -- 172.21.15.72:0/58457053 shutdown_connections 2023-08-31T19:24:54.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.124+0000 7f4a077ff700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f49e405ef80 0x7f49e40613c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.124+0000 7f4a077ff700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a00151da0 0x7f4a00150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.124+0000 7f4a077ff700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a00064b50 0x7f4a000ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.124+0000 7f4a077ff700 1 --2- 172.21.15.72:0/58457053 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a000c5370 0x7f4a00150600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.124+0000 7f4a077ff700 1 -- 172.21.15.72:0/58457053 >> 172.21.15.72:0/58457053 conn(0x7f4a00063a90 msgr2=0x7f4a000cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.124+0000 7f4a077ff700 1 -- 172.21.15.72:0/58457053 shutdown_connections 2023-08-31T19:24:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.124+0000 7f4a077ff700 1 -- 172.21.15.72:0/58457053 wait complete. 2023-08-31T19:24:54.146 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-31T19:24:54.147 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-08-31T19:24:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.342+0000 7f74743ff700 1 Processor -- start 2023-08-31T19:24:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.342+0000 7f74743ff700 1 -- start start 2023-08-31T19:24:54.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.343+0000 7f74743ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f746c154030 0x7f746c154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:54.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.343+0000 7f74743ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f746c0c06b0 0x7f746c0c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.343+0000 7f74743ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746c0c6ed0 con 0x7f746c0aa140 2023-08-31T19:24:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.343+0000 7f74743ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746c0c66e0 con 0x7f746c154030 2023-08-31T19:24:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.343+0000 7f74743ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746c0c68c0 con 0x7f746c0c06b0 2023-08-31T19:24:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.344+0000 7f747299c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f746c0aa140 0x7f746c063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35448/0 (socket says 172.21.15.72:35448) 2023-08-31T19:24:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.344+0000 7f747299c700 1 -- 172.21.15.72:0/1623471517 learned_addr learned my addr 172.21.15.72:0/1623471517 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:24:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.344+0000 7f747219b700 1 --2- 172.21.15.72:0/1623471517 >> v2:172.21.15.146:3300/0 conn(0x7f746c154030 0x7f746c154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.344+0000 7f747199a700 1 --2- 172.21.15.72:0/1623471517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f746c0c06b0 0x7f746c0c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:54.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.344+0000 7f7471199700 1 -- 172.21.15.72:0/1623471517 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2867984820 0 0) 0x7f746c0c6ed0 con 0x7f746c0aa140 2023-08-31T19:24:54.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.344+0000 7f7471199700 1 -- 172.21.15.72:0/1623471517 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74580033f0 con 0x7f746c0aa140 2023-08-31T19:24:54.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.344+0000 7f7471199700 1 -- 172.21.15.72:0/1623471517 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 935200426 0 0) 0x7f74580033f0 con 0x7f746c0aa140 2023-08-31T19:24:54.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.344+0000 7f7471199700 1 -- 172.21.15.72:0/1623471517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f746c0c06b0 msgr2=0x7f746c0c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:54.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.344+0000 7f7471199700 1 --2- 172.21.15.72:0/1623471517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f746c0c06b0 0x7f746c0c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.344+0000 7f7471199700 1 -- 172.21.15.72:0/1623471517 >> v2:172.21.15.146:3300/0 conn(0x7f746c154030 msgr2=0x7f746c154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:54.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.344+0000 7f7471199700 1 --2- 172.21.15.72:0/1623471517 >> v2:172.21.15.146:3300/0 conn(0x7f746c154030 0x7f746c154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.344+0000 7f7471199700 1 -- 172.21.15.72:0/1623471517 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c0c0f30 con 0x7f746c0aa140 2023-08-31T19:24:54.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.344+0000 7f7471199700 1 -- 172.21.15.72:0/1623471517 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f74640017f0 con 0x7f746c0aa140 2023-08-31T19:24:54.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.344+0000 7f747219b700 1 --2- 172.21.15.72:0/1623471517 >> v2:172.21.15.146:3300/0 conn(0x7f746c154030 0x7f746c154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:24:54.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f7471199700 1 -- 172.21.15.72:0/1623471517 >> v1:172.21.15.72:6789/0 conn(0x7f746c0aa140 legacy=0x7f746c063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:54.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f7471199700 1 --2- 172.21.15.72:0/1623471517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f746c0c06b0 0x7f74580038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:54.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f7471199700 1 --2- 172.21.15.72:0/1623471517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7458003e10 0x7f7458004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:54.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f7471199700 1 --2- 172.21.15.72:0/1623471517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7458004b80 0x7f7458005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:54.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f7471199700 1 -- 172.21.15.72:0/1623471517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c0c66e0 con 0x7f7458003e10 2023-08-31T19:24:54.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f7471199700 1 -- 172.21.15.72:0/1623471517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c0c68c0 con 0x7f7458004b80 2023-08-31T19:24:54.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f7471199700 1 -- 172.21.15.72:0/1623471517 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745800b8e0 con 0x7f746c0c06b0 2023-08-31T19:24:54.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f747199a700 1 --2- 172.21.15.72:0/1623471517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7458003e10 0x7f7458004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:54.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f747219b700 1 --2- 172.21.15.72:0/1623471517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f746c0c06b0 0x7f74580038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:54.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f747299c700 1 --2- 172.21.15.72:0/1623471517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7458004b80 0x7f7458005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:54.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f747199a700 1 -- 172.21.15.72:0/1623471517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f746c0c06b0 msgr2=0x7f74580038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:54.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f747199a700 1 --2- 172.21.15.72:0/1623471517 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f746c0c06b0 0x7f74580038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f747199a700 1 -- 172.21.15.72:0/1623471517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7458004b80 msgr2=0x7f7458005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:54.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f747199a700 1 --2- 172.21.15.72:0/1623471517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7458004b80 0x7f7458005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f747199a700 1 -- 172.21.15.72:0/1623471517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74580033f0 con 0x7f7458003e10 2023-08-31T19:24:54.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.345+0000 7f747199a700 1 --2- 172.21.15.72:0/1623471517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7458003e10 0x7f7458004690 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f745c009a90 tx=0x7f745c009060).ready entity=mon.0 client_cookie=3f981fa43a2b1795 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:54.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.346+0000 7f7471199700 1 -- 172.21.15.72:0/1623471517 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c009430 con 0x7f7458003e10 2023-08-31T19:24:54.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.346+0000 7f7471199700 1 -- 172.21.15.72:0/1623471517 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c00e640 con 0x7f7458003e10 2023-08-31T19:24:54.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.346+0000 7f7471199700 1 -- 172.21.15.72:0/1623471517 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c00e9c0 con 0x7f7458003e10 2023-08-31T19:24:54.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.346+0000 7f74743ff700 1 -- 172.21.15.72:0/1623471517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7458003e10 msgr2=0x7f7458004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:54.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.346+0000 7f74743ff700 1 --2- 172.21.15.72:0/1623471517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7458003e10 0x7f7458004690 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f745c009a90 tx=0x7f745c009060).stop 2023-08-31T19:24:54.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.346+0000 7f747299c700 1 -- 172.21.15.72:0/1623471517 reap_dead start 2023-08-31T19:24:54.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.346+0000 7f74743ff700 1 -- 172.21.15.72:0/1623471517 shutdown_connections 2023-08-31T19:24:54.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.346+0000 7f74743ff700 1 -- 172.21.15.72:0/1623471517 >> 172.21.15.72:0/1623471517 conn(0x7f746c05eb60 msgr2=0x7f746c0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:54.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.346+0000 7f74743ff700 1 -- 172.21.15.72:0/1623471517 shutdown_connections 2023-08-31T19:24:54.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.346+0000 7f74743ff700 1 -- 172.21.15.72:0/1623471517 wait complete. 2023-08-31T19:24:54.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.348+0000 7f74743ff700 1 Processor -- start 2023-08-31T19:24:54.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.349+0000 7f74743ff700 1 -- start start 2023-08-31T19:24:54.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f74743ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7458003e10 0x7f746c0ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:54.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f74743ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f746c0c4830 0x7f746c0acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:54.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f74743ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f746c1516f0 0x7f746c151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:54.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f74743ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c0ac2b0 con 0x7f7458003e10 2023-08-31T19:24:54.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f74743ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c0c4cb0 con 0x7f746c1516f0 2023-08-31T19:24:54.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f74743ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746c0c2680 con 0x7f746c0c4830 2023-08-31T19:24:54.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f747219b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7458003e10 0x7f746c0ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:54.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f747219b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7458003e10 0x7f746c0ab9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42328/0 (socket says 172.21.15.72:42328) 2023-08-31T19:24:54.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f747219b700 1 -- 172.21.15.72:0/736940222 learned_addr learned my addr 172.21.15.72:0/736940222 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:54.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f747219b700 1 -- 172.21.15.72:0/736940222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f746c0c4830 msgr2=0x7f746c0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:54.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f747219b700 1 --2- 172.21.15.72:0/736940222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f746c0c4830 0x7f746c0acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:54.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f747219b700 1 -- 172.21.15.72:0/736940222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f746c1516f0 msgr2=0x7f746c151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:54.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f747299c700 1 --2- 172.21.15.72:0/736940222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f746c1516f0 0x7f746c151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:54.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f747219b700 1 --2- 172.21.15.72:0/736940222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f746c1516f0 0x7f746c151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f747219b700 1 -- 172.21.15.72:0/736940222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c152060 con 0x7f7458003e10 2023-08-31T19:24:54.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.350+0000 7f747299c700 1 --2- 172.21.15.72:0/736940222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f746c1516f0 0x7f746c151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:24:54.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.351+0000 7f747219b700 1 --2- 172.21.15.72:0/736940222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7458003e10 0x7f746c0ab9e0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7f74680119c0 tx=0x7f7468008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:54.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.351+0000 7f74627fc700 1 -- 172.21.15.72:0/736940222 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746800f670 con 0x7f7458003e10 2023-08-31T19:24:54.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.351+0000 7f74627fc700 1 -- 172.21.15.72:0/736940222 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746800f7d0 con 0x7f7458003e10 2023-08-31T19:24:54.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.351+0000 7f74627fc700 1 -- 172.21.15.72:0/736940222 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746800fb50 con 0x7f7458003e10 2023-08-31T19:24:54.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.351+0000 7f74743ff700 1 -- 172.21.15.72:0/736940222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746c0abfd0 con 0x7f7458003e10 2023-08-31T19:24:54.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.351+0000 7f74743ff700 1 -- 172.21.15.72:0/736940222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746c0c2310 con 0x7f7458003e10 2023-08-31T19:24:54.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.352+0000 7f74743ff700 1 -- 172.21.15.72:0/736940222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746c0c50d0 con 0x7f7458003e10 2023-08-31T19:24:54.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.353+0000 7f74627fc700 1 -- 172.21.15.72:0/736940222 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 82) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f7468015480 con 0x7f7458003e10 2023-08-31T19:24:54.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.354+0000 7f74627fc700 1 --2- 172.21.15.72:0/736940222 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f745005ed40 0x7f7450061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:54.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.354+0000 7f74627fc700 1 -- 172.21.15.72:0/736940222 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f746807aac0 con 0x7f7458003e10 2023-08-31T19:24:54.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.354+0000 7f747199a700 1 --2- 172.21.15.72:0/736940222 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f745005ed40 0x7f7450061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:54.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.355+0000 7f747199a700 1 --2- 172.21.15.72:0/736940222 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f745005ed40 0x7f7450061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f746c149130 tx=0x7f745c01a000).ready entity=mgr.9228 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:54.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.358+0000 7f74627fc700 1 -- 172.21.15.72:0/736940222 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f746804bc80 con 0x7f7458003e10 2023-08-31T19:24:54.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.553+0000 7f74743ff700 1 -- 172.21.15.72:0/736940222 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f746c06c6b0 con 0x7f745005ed40 2023-08-31T19:24:54.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.559+0000 7f74627fc700 1 -- 172.21.15.72:0/736940222 <== mgr.9228 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f746c06c6b0 con 0x7f745005ed40 2023-08-31T19:24:54.559 INFO:teuthology.orchestra.run.smithi072.stdout:Retention added to path snap_test_dir1 2023-08-31T19:24:54.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.561+0000 7f74743ff700 1 -- 172.21.15.72:0/736940222 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f745005ed40 msgr2=0x7f7450061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:54.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.561+0000 7f74743ff700 1 --2- 172.21.15.72:0/736940222 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f745005ed40 0x7f7450061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f746c149130 tx=0x7f745c01a000).stop 2023-08-31T19:24:54.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.561+0000 7f74743ff700 1 -- 172.21.15.72:0/736940222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7458003e10 msgr2=0x7f746c0ab9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:54.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.561+0000 7f74743ff700 1 --2- 172.21.15.72:0/736940222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7458003e10 0x7f746c0ab9e0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7f74680119c0 tx=0x7f7468008040).stop 2023-08-31T19:24:54.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.561+0000 7f74743ff700 1 -- 172.21.15.72:0/736940222 shutdown_connections 2023-08-31T19:24:54.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.561+0000 7f74743ff700 1 --2- 172.21.15.72:0/736940222 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f745005ed40 0x7f7450061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.561+0000 7f74743ff700 1 --2- 172.21.15.72:0/736940222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f746c1516f0 0x7f746c151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.561+0000 7f74743ff700 1 --2- 172.21.15.72:0/736940222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7458003e10 0x7f746c0ab9e0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.561+0000 7f74743ff700 1 --2- 172.21.15.72:0/736940222 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f746c0c4830 0x7f746c0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:24:54.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.561+0000 7f74743ff700 1 -- 172.21.15.72:0/736940222 >> 172.21.15.72:0/736940222 conn(0x7f746c05eb60 msgr2=0x7f746c0c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:54.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.561+0000 7f74743ff700 1 -- 172.21.15.72:0/736940222 shutdown_connections 2023-08-31T19:24:54.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.561+0000 7f74743ff700 1 -- 172.21.15.72:0/736940222 wait complete. 2023-08-31T19:24:54.579 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-08-31T19:24:54.579 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-31-19_25_00 in ~6s... 2023-08-31T19:24:54.579 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-08-31T19:24:54.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-31T19:24:54.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.773+0000 7f58a83ff700 1 Processor -- start 2023-08-31T19:24:54.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.773+0000 7f58a83ff700 1 -- start start 2023-08-31T19:24:54.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.774+0000 7f58a83ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f58a00c7f20 0x7f58a00646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:54.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.774+0000 7f58a83ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a0154c80 con 0x7f58a00c83d0 2023-08-31T19:24:54.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.774+0000 7f58a83ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a0155820 con 0x7f58a0151da0 2023-08-31T19:24:54.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.774+0000 7f58a83ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a00a9f10 con 0x7f58a00c7f20 2023-08-31T19:24:54.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.774+0000 7f58a599a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f58a00c7f20 0x7f58a00646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:54.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.774+0000 7f58a599a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f58a00c7f20 0x7f58a00646a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42332/0 (socket says 172.21.15.72:42332) 2023-08-31T19:24:54.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.774+0000 7f58a599a700 1 -- 172.21.15.72:0/4172895426 learned_addr learned my addr 172.21.15.72:0/4172895426 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:54.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.774+0000 7f58a699c700 1 --1- 172.21.15.72:0/4172895426 >> v1:172.21.15.72:6789/0 conn(0x7f58a00c83d0 0x7f58a00bfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35462/0 (socket says 172.21.15.72:35462) 2023-08-31T19:24:54.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.775+0000 7f58a599a700 1 -- 172.21.15.72:0/4172895426 >> v1:172.21.15.146:6789/0 conn(0x7f58a0151da0 legacy=0x7f58a0155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:24:54.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.775+0000 7f58a599a700 1 -- 172.21.15.72:0/4172895426 >> v1:172.21.15.72:6789/0 conn(0x7f58a00c83d0 legacy=0x7f58a00bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:54.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.775+0000 7f58a5199700 1 -- 172.21.15.72:0/4172895426 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377718650 0 0) 0x7f58a0154c80 con 0x7f58a00c83d0 2023-08-31T19:24:54.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.775+0000 7f58a599a700 1 -- 172.21.15.72:0/4172895426 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a00aa1f0 con 0x7f58a00c7f20 2023-08-31T19:24:54.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.775+0000 7f58a599a700 1 --2- 172.21.15.72:0/4172895426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a00c7f20 0x7f58a00646a0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f5890006fd0 tx=0x7f58900090f0).ready entity=mon.0 client_cookie=2f0d26b8549e4e65 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:54.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.775+0000 7f58a5199700 1 -- 172.21.15.72:0/4172895426 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589000b600 con 0x7f58a00c7f20 2023-08-31T19:24:54.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.775+0000 7f58a5199700 1 -- 172.21.15.72:0/4172895426 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589000b760 con 0x7f58a00c7f20 2023-08-31T19:24:54.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.775+0000 7f58a5199700 1 -- 172.21.15.72:0/4172895426 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589000bae0 con 0x7f58a00c7f20 2023-08-31T19:24:54.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.776+0000 7f58a83ff700 1 -- 172.21.15.72:0/4172895426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a00c7f20 msgr2=0x7f58a00646a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:54.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.776+0000 7f58a83ff700 1 --2- 172.21.15.72:0/4172895426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a00c7f20 0x7f58a00646a0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f5890006fd0 tx=0x7f58900090f0).stop 2023-08-31T19:24:54.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.776+0000 7f58a83ff700 1 -- 172.21.15.72:0/4172895426 shutdown_connections 2023-08-31T19:24:54.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.776+0000 7f58a83ff700 1 --2- 172.21.15.72:0/4172895426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a00c7f20 0x7f58a00646a0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.776+0000 7f58a83ff700 1 -- 172.21.15.72:0/4172895426 >> 172.21.15.72:0/4172895426 conn(0x7f58a00cb840 msgr2=0x7f58a00c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:54.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.776+0000 7f58a83ff700 1 -- 172.21.15.72:0/4172895426 shutdown_connections 2023-08-31T19:24:54.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.776+0000 7f58a83ff700 1 -- 172.21.15.72:0/4172895426 wait complete. 2023-08-31T19:24:54.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.777+0000 7f58a83ff700 1 Processor -- start 2023-08-31T19:24:54.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.778+0000 7f58a83ff700 1 -- start start 2023-08-31T19:24:54.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.778+0000 7f58a83ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58a00c7f20 0x7f58a0141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:54.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.778+0000 7f58a83ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58a00c83d0 0x7f58a00c09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:54.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a83ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a0151da0 0x7f58a00c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:54.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a83ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a00c1390 con 0x7f58a0151da0 2023-08-31T19:24:54.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a83ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a0141e50 con 0x7f58a00c83d0 2023-08-31T19:24:54.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a83ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a01510f0 con 0x7f58a00c7f20 2023-08-31T19:24:54.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a0151da0 0x7f58a00c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:54.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a0151da0 0x7f58a00c0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42346/0 (socket says 172.21.15.72:42346) 2023-08-31T19:24:54.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a699c700 1 -- 172.21.15.72:0/1120117397 learned_addr learned my addr 172.21.15.72:0/1120117397 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:24:54.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a599a700 1 --2- 172.21.15.72:0/1120117397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58a00c83d0 0x7f58a00c09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:54.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a619b700 1 --2- 172.21.15.72:0/1120117397 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58a00c7f20 0x7f58a0141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:54.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a699c700 1 -- 172.21.15.72:0/1120117397 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58a00c7f20 msgr2=0x7f58a0141960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:54.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a699c700 1 --2- 172.21.15.72:0/1120117397 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58a00c7f20 0x7f58a0141960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a699c700 1 -- 172.21.15.72:0/1120117397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58a00c83d0 msgr2=0x7f58a00c09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:54.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a699c700 1 --2- 172.21.15.72:0/1120117397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58a00c83d0 0x7f58a00c09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a699c700 1 -- 172.21.15.72:0/1120117397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890009370 con 0x7f58a0151da0 2023-08-31T19:24:54.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a619b700 1 --2- 172.21.15.72:0/1120117397 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58a00c7f20 0x7f58a0141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:24:54.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.779+0000 7f58a699c700 1 --2- 172.21.15.72:0/1120117397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a0151da0 0x7f58a00c0ea0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f589800c810 tx=0x7f5898007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:54.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.780+0000 7f58967fc700 1 -- 172.21.15.72:0/1120117397 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898005c70 con 0x7f58a0151da0 2023-08-31T19:24:54.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.780+0000 7f58967fc700 1 -- 172.21.15.72:0/1120117397 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5898005dd0 con 0x7f58a0151da0 2023-08-31T19:24:54.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.780+0000 7f58a83ff700 1 -- 172.21.15.72:0/1120117397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a0142ae0 con 0x7f58a0151da0 2023-08-31T19:24:54.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.780+0000 7f58967fc700 1 -- 172.21.15.72:0/1120117397 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898007340 con 0x7f58a0151da0 2023-08-31T19:24:54.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.780+0000 7f58a83ff700 1 -- 172.21.15.72:0/1120117397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a0142490 con 0x7f58a0151da0 2023-08-31T19:24:54.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.781+0000 7f58a83ff700 1 -- 172.21.15.72:0/1120117397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a006a7e0 con 0x7f58a0151da0 2023-08-31T19:24:54.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.782+0000 7f58967fc700 1 -- 172.21.15.72:0/1120117397 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 82) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f58980076f0 con 0x7f58a0151da0 2023-08-31T19:24:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.782+0000 7f58967fc700 1 --2- 172.21.15.72:0/1120117397 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f588405ed40 0x7f5884061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:24:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.783+0000 7f58967fc700 1 -- 172.21.15.72:0/1120117397 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f5898079ff0 con 0x7f58a0151da0 2023-08-31T19:24:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.783+0000 7f58a619b700 1 --2- 172.21.15.72:0/1120117397 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f588405ed40 0x7f5884061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:24:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.783+0000 7f58a619b700 1 --2- 172.21.15.72:0/1120117397 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f588405ed40 0x7f5884061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f589c00b8b0 tx=0x7f589c008040).ready entity=mgr.9228 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:24:54.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.786+0000 7f58967fc700 1 -- 172.21.15.72:0/1120117397 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f589804b230 con 0x7f58a0151da0 2023-08-31T19:24:54.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.979+0000 7f58a83ff700 1 -- 172.21.15.72:0/1120117397 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58a0142c70 con 0x7f588405ed40 2023-08-31T19:24:54.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.981+0000 7f58967fc700 1 -- 172.21.15.72:0/1120117397 <== mgr.9228 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f58a0142c70 con 0x7f588405ed40 2023-08-31T19:24:54.982 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:24:54.982 INFO:teuthology.orchestra.run.smithi072.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-31T19:24:54.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.983+0000 7f58a83ff700 1 -- 172.21.15.72:0/1120117397 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f588405ed40 msgr2=0x7f5884061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:54.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.983+0000 7f58a83ff700 1 --2- 172.21.15.72:0/1120117397 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f588405ed40 0x7f5884061200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f589c00b8b0 tx=0x7f589c008040).stop 2023-08-31T19:24:54.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.983+0000 7f58a83ff700 1 -- 172.21.15.72:0/1120117397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a0151da0 msgr2=0x7f58a00c0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:24:54.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.983+0000 7f58a83ff700 1 --2- 172.21.15.72:0/1120117397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a0151da0 0x7f58a00c0ea0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f589800c810 tx=0x7f5898007f10).stop 2023-08-31T19:24:54.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.983+0000 7f58a83ff700 1 -- 172.21.15.72:0/1120117397 shutdown_connections 2023-08-31T19:24:54.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.983+0000 7f58a83ff700 1 --2- 172.21.15.72:0/1120117397 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f588405ed40 0x7f5884061200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.983+0000 7f58a83ff700 1 --2- 172.21.15.72:0/1120117397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58a0151da0 0x7f58a00c0ea0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.983+0000 7f58a83ff700 1 --2- 172.21.15.72:0/1120117397 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58a00c7f20 0x7f58a0141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.983+0000 7f58a83ff700 1 --2- 172.21.15.72:0/1120117397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58a00c83d0 0x7f58a00c09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:24:54.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.983+0000 7f58a83ff700 1 -- 172.21.15.72:0/1120117397 >> 172.21.15.72:0/1120117397 conn(0x7f58a00cb840 msgr2=0x7f58a00ad1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:24:54.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.984+0000 7f58a83ff700 1 -- 172.21.15.72:0/1120117397 shutdown_connections 2023-08-31T19:24:54.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:24:54.984+0000 7f58a83ff700 1 -- 172.21.15.72:0/1120117397 wait complete. 2023-08-31T19:24:55.001 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-31T19:24:55.001 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-08-31T19:24:55.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:55.002 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:24:56.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:56.052 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:24:57.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:57.105 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:24:58.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:58.161 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:24:59.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:24:59.216 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:00.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:00.271 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:00.565 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:25:00.564+0000 7f235bee5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:25:00.565 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:25:00.564+0000 7f235bee5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:25:00.566 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:25:00.565+0000 7f235bee5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:25:00.566 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:25:00.565+0000 7f235bee5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:25:00.566 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:25:00.565+0000 7f235bee5700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:25:00.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:25:00.781 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:25:01.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:01.327 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:01.379 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:01.381 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-31-19_25_00_UTC'] 2023-08-31T19:25:01.381 DEBUG:tasks.cephfs.test_snap_schedules:exec=1693509894.579537, now = 1693509901.3815334, timo = 6 2023-08-31T19:25:02.382 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-08-31-19_25_00 in ~66s... 2023-08-31T19:25:02.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:02.383 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:02.435 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:03.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:03.438 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:03.490 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:04.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:04.492 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:04.545 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:05.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:05.548 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:05.600 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:06.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:06.603 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:06.656 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:07.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:07.658 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:07.711 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:08.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:08.714 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:08.766 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:09.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:09.769 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:09.822 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:10.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:10.824 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:10.877 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:11.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:11.881 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:11.934 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:12.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:12.936 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:12.988 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:13.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:13.990 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:14.042 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:15.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:15.045 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:15.098 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:16.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:16.101 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:16.153 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:17.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:17.156 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:17.208 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:18.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:18.210 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:18.263 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:19.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:19.265 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:19.318 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:20.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:20.320 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:20.372 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:21.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:21.375 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:21.427 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:22.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:22.430 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:22.483 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:23.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:23.486 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:23.538 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:24.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:24.541 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:24.594 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:25.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:25.596 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:25.648 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:26.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:26.651 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:26.704 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:27.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:27.706 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:27.759 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:28.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:28.761 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:28.814 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:29.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:29.816 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:29.869 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:30.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:30.871 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:30.925 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:30.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:25:30.943 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:25:31.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:31.928 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:31.980 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:32.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:32.984 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:33.036 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:34.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:34.039 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:34.092 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:35.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:35.094 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:35.149 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:36.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:36.151 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:36.204 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:37.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:37.207 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:37.260 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:38.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:38.263 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:38.316 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:39.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:39.318 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:39.371 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:40.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:40.373 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:40.425 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:41.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:41.428 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:41.481 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:42.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:42.483 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:42.535 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:43.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:43.538 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:43.590 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:44.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:44.592 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:44.645 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:45.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:45.648 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:45.700 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:46.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:46.703 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:46.756 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:47.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:47.759 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:47.812 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:48.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:48.814 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:48.867 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:49.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:49.870 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:49.923 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:50.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:50.977 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:51.029 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:52.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:52.032 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:52.085 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:53.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:53.088 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:53.141 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:54.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:54.143 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:54.196 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:55.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:55.199 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:55.251 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:56.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:56.254 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:56.306 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:57.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:57.310 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:57.363 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:58.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:58.366 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:58.418 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:25:59.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:25:59.420 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:25:59.472 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:26:00.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:26:00.474 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:26:00.525 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_25_00_UTC 2023-08-31T19:26:01.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:26:01.057 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:26:01.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:26:01.527 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:26:01.580 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_26_00_UTC 2023-08-31T19:26:01.581 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-08-31-19_25_00_UTC'] 2023-08-31T19:26:01.581 DEBUG:tasks.cephfs.test_snap_schedules:exec=1693509894.579537, now = 1693509961.581797, timo = 66 2023-08-31T19:26:02.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-31T19:26:02.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.786+0000 7fe3e1bff700 1 Processor -- start 2023-08-31T19:26:02.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.786+0000 7fe3e1bff700 1 -- start start 2023-08-31T19:26:02.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.787+0000 7fe3e1bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3dc151da0 0x7fe3dc1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:02.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.787+0000 7fe3e1bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3dc0c5370 0x7fe3dc064660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:02.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.787+0000 7fe3e1bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe3dc064b50 0x7fe3dc0bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:02.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.787+0000 7fe3e1bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc0c57f0 con 0x7fe3dc064b50 2023-08-31T19:26:02.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.787+0000 7fe3e1bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc154f40 con 0x7fe3dc151da0 2023-08-31T19:26:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.787+0000 7fe3e1bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc154960 con 0x7fe3dc0c5370 2023-08-31T19:26:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.787+0000 7fe3dbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe3dc064b50 0x7fe3dc0bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.787+0000 7fe3dbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe3dc064b50 0x7fe3dc0bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42984/0 (socket says 172.21.15.72:42984) 2023-08-31T19:26:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.787+0000 7fe3dbfff700 1 -- 172.21.15.72:0/627812172 learned_addr learned my addr 172.21.15.72:0/627812172 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:02.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.788+0000 7fe3daffd700 1 --2- 172.21.15.72:0/627812172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3dc0c5370 0x7fe3dc064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:02.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.788+0000 7fe3db7fe700 1 --2- 172.21.15.72:0/627812172 >> v2:172.21.15.146:3300/0 conn(0x7fe3dc151da0 0x7fe3dc1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:02.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.788+0000 7fe3dbfff700 1 -- 172.21.15.72:0/627812172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3dc0c5370 msgr2=0x7fe3dc064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.788+0000 7fe3dbfff700 1 --2- 172.21.15.72:0/627812172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3dc0c5370 0x7fe3dc064660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.788+0000 7fe3dbfff700 1 -- 172.21.15.72:0/627812172 >> v2:172.21.15.146:3300/0 conn(0x7fe3dc151da0 msgr2=0x7fe3dc1553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.788+0000 7fe3dbfff700 1 --2- 172.21.15.72:0/627812172 >> v2:172.21.15.146:3300/0 conn(0x7fe3dc151da0 0x7fe3dc1553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.788+0000 7fe3dbfff700 1 -- 172.21.15.72:0/627812172 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc064fc0 con 0x7fe3dc064b50 2023-08-31T19:26:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.788+0000 7fe3dbfff700 1 --2- 172.21.15.72:0/627812172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3dc064b50 0x7fe3dc0bfcd0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7fe3dc061630 tx=0x7fe3d4009840).ready entity=mon.0 client_cookie=4ab28716f2c0bc0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:02.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.788+0000 7fe3da7fc700 1 -- 172.21.15.72:0/627812172 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d400e070 con 0x7fe3dc064b50 2023-08-31T19:26:02.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.788+0000 7fe3da7fc700 1 -- 172.21.15.72:0/627812172 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d400ba50 con 0x7fe3dc064b50 2023-08-31T19:26:02.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.788+0000 7fe3da7fc700 1 -- 172.21.15.72:0/627812172 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d400bdd0 con 0x7fe3dc064b50 2023-08-31T19:26:02.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.789+0000 7fe3e1bff700 1 -- 172.21.15.72:0/627812172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3dc064b50 msgr2=0x7fe3dc0bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:02.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.789+0000 7fe3e1bff700 1 --2- 172.21.15.72:0/627812172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3dc064b50 0x7fe3dc0bfcd0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7fe3dc061630 tx=0x7fe3d4009840).stop 2023-08-31T19:26:02.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.789+0000 7fe3e1bff700 1 -- 172.21.15.72:0/627812172 shutdown_connections 2023-08-31T19:26:02.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.789+0000 7fe3e1bff700 1 --2- 172.21.15.72:0/627812172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3dc064b50 0x7fe3dc0bfcd0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:02.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.789+0000 7fe3e1bff700 1 --2- 172.21.15.72:0/627812172 >> v2:172.21.15.146:3300/0 conn(0x7fe3dc151da0 0x7fe3dc1553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:02.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.789+0000 7fe3e1bff700 1 --2- 172.21.15.72:0/627812172 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3dc0c5370 0x7fe3dc064660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:02.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.789+0000 7fe3e1bff700 1 -- 172.21.15.72:0/627812172 >> 172.21.15.72:0/627812172 conn(0x7fe3dc063a90 msgr2=0x7fe3dc0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.789+0000 7fe3e1bff700 1 -- 172.21.15.72:0/627812172 shutdown_connections 2023-08-31T19:26:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.789+0000 7fe3e1bff700 1 -- 172.21.15.72:0/627812172 wait complete. 2023-08-31T19:26:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.790+0000 7fe3e1bff700 1 Processor -- start 2023-08-31T19:26:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.791+0000 7fe3e1bff700 1 -- start start 2023-08-31T19:26:02.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.791+0000 7fe3e1bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3dc064b50 0x7fe3dc0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.791+0000 7fe3e1bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3dc0c5370 0x7fe3dc0c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.791+0000 7fe3e1bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3dc151da0 0x7fe3dc0c1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.791+0000 7fe3e1bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0c24d0 con 0x7fe3dc151da0 2023-08-31T19:26:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.791+0000 7fe3e1bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0c4c30 con 0x7fe3dc0c5370 2023-08-31T19:26:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.791+0000 7fe3e1bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0b0800 con 0x7fe3dc064b50 2023-08-31T19:26:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.792+0000 7fe3dbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3dc151da0 0x7fe3dc0c1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.792+0000 7fe3dbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3dc151da0 0x7fe3dc0c1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42996/0 (socket says 172.21.15.72:42996) 2023-08-31T19:26:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.792+0000 7fe3dbfff700 1 -- 172.21.15.72:0/4130790266 learned_addr learned my addr 172.21.15.72:0/4130790266 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.792+0000 7fe3daffd700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3dc0c5370 0x7fe3dc0c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.792+0000 7fe3db7fe700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3dc064b50 0x7fe3dc0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.792+0000 7fe3dbfff700 1 -- 172.21.15.72:0/4130790266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3dc064b50 msgr2=0x7fe3dc0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.792+0000 7fe3dbfff700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3dc064b50 0x7fe3dc0b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.792+0000 7fe3dbfff700 1 -- 172.21.15.72:0/4130790266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3dc0c5370 msgr2=0x7fe3dc0c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.792+0000 7fe3dbfff700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3dc0c5370 0x7fe3dc0c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.792+0000 7fe3dbfff700 1 -- 172.21.15.72:0/4130790266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d4009ae0 con 0x7fe3dc151da0 2023-08-31T19:26:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.792+0000 7fe3daffd700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3dc0c5370 0x7fe3dc0c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.792+0000 7fe3db7fe700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3dc064b50 0x7fe3dc0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.792+0000 7fe3dbfff700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3dc151da0 0x7fe3dc0c1010 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7fe3d4009fd0 tx=0x7fe3d4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.792+0000 7fe3c37fe700 1 -- 172.21.15.72:0/4130790266 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d400bdd0 con 0x7fe3dc151da0 2023-08-31T19:26:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.793+0000 7fe3c37fe700 1 -- 172.21.15.72:0/4130790266 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d401d460 con 0x7fe3dc151da0 2023-08-31T19:26:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.793+0000 7fe3e1bff700 1 -- 172.21.15.72:0/4130790266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3dc0b0ae0 con 0x7fe3dc151da0 2023-08-31T19:26:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.793+0000 7fe3c37fe700 1 -- 172.21.15.72:0/4130790266 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d401d820 con 0x7fe3dc151da0 2023-08-31T19:26:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.793+0000 7fe3e1bff700 1 -- 172.21.15.72:0/4130790266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3dc0c2160 con 0x7fe3dc151da0 2023-08-31T19:26:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.794+0000 7fe3e1bff700 1 -- 172.21.15.72:0/4130790266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3dc06a7e0 con 0x7fe3dc151da0 2023-08-31T19:26:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.794+0000 7fe3c37fe700 1 -- 172.21.15.72:0/4130790266 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 84) v1 ==== 75505+0+0 (secure 0 0 0) 0x7fe3d4003040 con 0x7fe3dc151da0 2023-08-31T19:26:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.796+0000 7fe3c37fe700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe3c805f0a0 0x7fe3c8061560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.796+0000 7fe3c37fe700 1 -- 172.21.15.72:0/4130790266 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7123+0+0 (secure 0 0 0) 0x7fe3d407bc00 con 0x7fe3dc151da0 2023-08-31T19:26:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.796+0000 7fe3db7fe700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe3c805f0a0 0x7fe3c8061560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.796+0000 7fe3db7fe700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe3c805f0a0 0x7fe3c8061560 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe3cc0098c0 tx=0x7fe3cc008040).ready entity=mgr.9228 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:02.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.800+0000 7fe3c37fe700 1 -- 172.21.15.72:0/4130790266 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe3d404c870 con 0x7fe3dc151da0 2023-08-31T19:26:02.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.994+0000 7fe3e1bff700 1 -- 172.21.15.72:0/4130790266 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3dc06c6b0 con 0x7fe3c805f0a0 2023-08-31T19:26:02.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:02.999+0000 7fe3c37fe700 1 -- 172.21.15.72:0/4130790266 <== mgr.9228 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe3dc06c6b0 con 0x7fe3c805f0a0 2023-08-31T19:26:02.999 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path snap_test_dir1 2023-08-31T19:26:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.001+0000 7fe3e1bff700 1 -- 172.21.15.72:0/4130790266 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe3c805f0a0 msgr2=0x7fe3c8061560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.001+0000 7fe3e1bff700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe3c805f0a0 0x7fe3c8061560 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe3cc0098c0 tx=0x7fe3cc008040).stop 2023-08-31T19:26:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.001+0000 7fe3e1bff700 1 -- 172.21.15.72:0/4130790266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3dc151da0 msgr2=0x7fe3dc0c1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.001+0000 7fe3e1bff700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3dc151da0 0x7fe3dc0c1010 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7fe3d4009fd0 tx=0x7fe3d4009840).stop 2023-08-31T19:26:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.001+0000 7fe3e1bff700 1 -- 172.21.15.72:0/4130790266 shutdown_connections 2023-08-31T19:26:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.001+0000 7fe3e1bff700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe3c805f0a0 0x7fe3c8061560 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.001+0000 7fe3e1bff700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3dc151da0 0x7fe3dc0c1010 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.001+0000 7fe3e1bff700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe3dc064b50 0x7fe3dc0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.001+0000 7fe3e1bff700 1 --2- 172.21.15.72:0/4130790266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3dc0c5370 0x7fe3dc0c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.001+0000 7fe3e1bff700 1 -- 172.21.15.72:0/4130790266 >> 172.21.15.72:0/4130790266 conn(0x7fe3dc063a90 msgr2=0x7fe3dc0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.001+0000 7fe3e1bff700 1 -- 172.21.15.72:0/4130790266 shutdown_connections 2023-08-31T19:26:03.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.001+0000 7fe3e1bff700 1 -- 172.21.15.72:0/4130790266 wait complete. 2023-08-31T19:26:03.018 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-31T19:26:03.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:26:03.019 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:26:03.065 INFO:teuthology.orchestra.run.smithi072.stdout:scheduled-2023-08-31-19_26_00_UTC 2023-08-31T19:26:03.066 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-31-19_26_00_UTC 2023-08-31T19:26:03.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:26:03.067 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-31-19_26_00_UTC) 2023-08-31T19:26:03.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:26:03.158 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-31T19:26:03.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-31T19:26:03.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.400+0000 7fac237ff700 1 Processor -- start 2023-08-31T19:26:03.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.400+0000 7fac237ff700 1 -- start start 2023-08-31T19:26:03.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.401+0000 7fac237ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac1c154030 0x7fac1c154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:03.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.401+0000 7fac237ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac1c0c06b0 0x7fac1c0c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:03.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.402+0000 7fac237ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1c0c6ed0 con 0x7fac1c0aa140 2023-08-31T19:26:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.402+0000 7fac237ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1c0c66e0 con 0x7fac1c0c06b0 2023-08-31T19:26:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.402+0000 7fac237ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1c0c68c0 con 0x7fac1c154030 2023-08-31T19:26:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.402+0000 7fac20d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac1c0c06b0 0x7fac1c0c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.402+0000 7fac20d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac1c0c06b0 0x7fac1c0c7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36170/0 (socket says 172.21.15.72:36170) 2023-08-31T19:26:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.402+0000 7fac20d9a700 1 -- 172.21.15.72:0/2035867868 learned_addr learned my addr 172.21.15.72:0/2035867868 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:03.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.402+0000 7fac2159b700 1 --2- 172.21.15.72:0/2035867868 >> v2:172.21.15.146:3300/0 conn(0x7fac1c154030 0x7fac1c154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:03.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.402+0000 7fac20d9a700 1 -- 172.21.15.72:0/2035867868 >> v2:172.21.15.146:3300/0 conn(0x7fac1c154030 msgr2=0x7fac1c154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:03.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.402+0000 7fac20d9a700 1 --2- 172.21.15.72:0/2035867868 >> v2:172.21.15.146:3300/0 conn(0x7fac1c154030 0x7fac1c154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:03.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.402+0000 7fac20d9a700 1 -- 172.21.15.72:0/2035867868 >> v1:172.21.15.146:6789/0 conn(0x7fac1c0aa140 legacy=0x7fac1c063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:03.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.402+0000 7fac20d9a700 1 -- 172.21.15.72:0/2035867868 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c0c0f30 con 0x7fac1c0c06b0 2023-08-31T19:26:03.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.402+0000 7fac2159b700 1 --2- 172.21.15.72:0/2035867868 >> v2:172.21.15.146:3300/0 conn(0x7fac1c154030 0x7fac1c154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:03.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.403+0000 7fac20d9a700 1 --2- 172.21.15.72:0/2035867868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac1c0c06b0 0x7fac1c0c7360 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fac1c0c8bc0 tx=0x7fac0c0090f0).ready entity=mon.0 client_cookie=eb3a568dd92b7278 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:03.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.403+0000 7fac13fff700 1 -- 172.21.15.72:0/2035867868 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c00b5a0 con 0x7fac1c0c06b0 2023-08-31T19:26:03.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.403+0000 7fac13fff700 1 -- 172.21.15.72:0/2035867868 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c00b700 con 0x7fac1c0c06b0 2023-08-31T19:26:03.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.403+0000 7fac13fff700 1 -- 172.21.15.72:0/2035867868 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c00ba80 con 0x7fac1c0c06b0 2023-08-31T19:26:03.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.403+0000 7fac237ff700 1 -- 172.21.15.72:0/2035867868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac1c0c06b0 msgr2=0x7fac1c0c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:03.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.403+0000 7fac237ff700 1 --2- 172.21.15.72:0/2035867868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac1c0c06b0 0x7fac1c0c7360 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fac1c0c8bc0 tx=0x7fac0c0090f0).stop 2023-08-31T19:26:03.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.403+0000 7fac237ff700 1 -- 172.21.15.72:0/2035867868 shutdown_connections 2023-08-31T19:26:03.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.403+0000 7fac237ff700 1 --2- 172.21.15.72:0/2035867868 >> v2:172.21.15.146:3300/0 conn(0x7fac1c154030 0x7fac1c154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:03.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.403+0000 7fac237ff700 1 --2- 172.21.15.72:0/2035867868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac1c0c06b0 0x7fac1c0c7360 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:03.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.403+0000 7fac237ff700 1 -- 172.21.15.72:0/2035867868 >> 172.21.15.72:0/2035867868 conn(0x7fac1c05eb60 msgr2=0x7fac1c0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:03.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.403+0000 7fac237ff700 1 -- 172.21.15.72:0/2035867868 shutdown_connections 2023-08-31T19:26:03.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.403+0000 7fac237ff700 1 -- 172.21.15.72:0/2035867868 wait complete. 2023-08-31T19:26:03.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.405+0000 7fac237ff700 1 Processor -- start 2023-08-31T19:26:03.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.406+0000 7fac237ff700 1 -- start start 2023-08-31T19:26:03.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.407+0000 7fac237ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac1c0aa140 0x7fac1c152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:03.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.407+0000 7fac237ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac1c0c06b0 0x7fac1c150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:03.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.407+0000 7fac237ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac1c154030 0x7fac1c13ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.407+0000 7fac237ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c0af680 con 0x7fac1c154030 2023-08-31T19:26:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.407+0000 7fac237ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c153760 con 0x7fac1c0c06b0 2023-08-31T19:26:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.407+0000 7fac237ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c0aed50 con 0x7fac1c0aa140 2023-08-31T19:26:03.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.407+0000 7fac21d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac1c154030 0x7fac1c13ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:03.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.407+0000 7fac21d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac1c154030 0x7fac1c13ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36174/0 (socket says 172.21.15.72:36174) 2023-08-31T19:26:03.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.407+0000 7fac21d9c700 1 -- 172.21.15.72:0/3882209899 learned_addr learned my addr 172.21.15.72:0/3882209899 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:03.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.407+0000 7fac20d9a700 1 --2- 172.21.15.72:0/3882209899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac1c0c06b0 0x7fac1c150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:03.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.407+0000 7fac2159b700 1 --2- 172.21.15.72:0/3882209899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac1c0aa140 0x7fac1c152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:03.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.408+0000 7fac21d9c700 1 -- 172.21.15.72:0/3882209899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac1c0aa140 msgr2=0x7fac1c152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:03.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.408+0000 7fac21d9c700 1 --2- 172.21.15.72:0/3882209899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac1c0aa140 0x7fac1c152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:03.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.408+0000 7fac21d9c700 1 -- 172.21.15.72:0/3882209899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac1c0c06b0 msgr2=0x7fac1c150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:03.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.408+0000 7fac21d9c700 1 --2- 172.21.15.72:0/3882209899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac1c0c06b0 0x7fac1c150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:03.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.408+0000 7fac21d9c700 1 -- 172.21.15.72:0/3882209899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c009370 con 0x7fac1c154030 2023-08-31T19:26:03.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.408+0000 7fac21d9c700 1 --2- 172.21.15.72:0/3882209899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac1c154030 0x7fac1c13ef80 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7fac1400c810 tx=0x7fac14002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:03.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.408+0000 7fac117fa700 1 -- 172.21.15.72:0/3882209899 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14010510 con 0x7fac1c154030 2023-08-31T19:26:03.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.408+0000 7fac117fa700 1 -- 172.21.15.72:0/3882209899 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14010670 con 0x7fac1c154030 2023-08-31T19:26:03.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.408+0000 7fac117fa700 1 -- 172.21.15.72:0/3882209899 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14010a30 con 0x7fac1c154030 2023-08-31T19:26:03.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.408+0000 7fac237ff700 1 -- 172.21.15.72:0/3882209899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1c0af030 con 0x7fac1c154030 2023-08-31T19:26:03.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.408+0000 7fac237ff700 1 -- 172.21.15.72:0/3882209899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1c153400 con 0x7fac1c154030 2023-08-31T19:26:03.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.409+0000 7fac237ff700 1 -- 172.21.15.72:0/3882209899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1c0af7f0 con 0x7fac1c154030 2023-08-31T19:26:03.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.410+0000 7fac117fa700 1 -- 172.21.15.72:0/3882209899 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 84) v1 ==== 75505+0+0 (secure 0 0 0) 0x7fac14012440 con 0x7fac1c154030 2023-08-31T19:26:03.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.411+0000 7fac117fa700 1 --2- 172.21.15.72:0/3882209899 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fac0005f0a0 0x7fac00061560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:03.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.411+0000 7fac117fa700 1 -- 172.21.15.72:0/3882209899 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7123+0+0 (secure 0 0 0) 0x7fac1407a0b0 con 0x7fac1c154030 2023-08-31T19:26:03.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.411+0000 7fac2159b700 1 --2- 172.21.15.72:0/3882209899 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fac0005f0a0 0x7fac00061560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:03.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.412+0000 7fac2159b700 1 --2- 172.21.15.72:0/3882209899 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fac0005f0a0 0x7fac00061560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fac1800ab40 tx=0x7fac18008040).ready entity=mgr.9228 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:03.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.415+0000 7fac117fa700 1 -- 172.21.15.72:0/3882209899 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fac140488f0 con 0x7fac1c154030 2023-08-31T19:26:03.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:03.626+0000 7fac237ff700 1 -- 172.21.15.72:0/3882209899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fac1c0c0c50 con 0x7fac1c154030 2023-08-31T19:26:04.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.203+0000 7fac117fa700 1 -- 172.21.15.72:0/3882209899 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 85) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fac140776d0 con 0x7fac1c154030 2023-08-31T19:26:04.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.204+0000 7fac117fa700 1 -- 172.21.15.72:0/3882209899 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v85) v1 ==== 93+0+0 (secure 0 0 0) 0x7fac140740a0 con 0x7fac1c154030 2023-08-31T19:26:04.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.207+0000 7fac237ff700 1 -- 172.21.15.72:0/3882209899 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fac0005f0a0 msgr2=0x7fac00061560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:04.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.207+0000 7fac237ff700 1 --2- 172.21.15.72:0/3882209899 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fac0005f0a0 0x7fac00061560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fac1800ab40 tx=0x7fac18008040).stop 2023-08-31T19:26:04.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.207+0000 7fac237ff700 1 -- 172.21.15.72:0/3882209899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac1c154030 msgr2=0x7fac1c13ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:04.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.207+0000 7fac237ff700 1 --2- 172.21.15.72:0/3882209899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac1c154030 0x7fac1c13ef80 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7fac1400c810 tx=0x7fac14002560).stop 2023-08-31T19:26:04.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.207+0000 7fac237ff700 1 -- 172.21.15.72:0/3882209899 shutdown_connections 2023-08-31T19:26:04.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.207+0000 7fac237ff700 1 --2- 172.21.15.72:0/3882209899 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fac0005f0a0 0x7fac00061560 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:04.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.207+0000 7fac237ff700 1 --2- 172.21.15.72:0/3882209899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac1c154030 0x7fac1c13ef80 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:04.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.207+0000 7fac237ff700 1 --2- 172.21.15.72:0/3882209899 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fac1c0aa140 0x7fac1c152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:04.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.207+0000 7fac237ff700 1 --2- 172.21.15.72:0/3882209899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac1c0c06b0 0x7fac1c150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:04.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.207+0000 7fac237ff700 1 -- 172.21.15.72:0/3882209899 >> 172.21.15.72:0/3882209899 conn(0x7fac1c05eb60 msgr2=0x7fac1c0ca240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:04.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.207+0000 7fac237ff700 1 -- 172.21.15.72:0/3882209899 shutdown_connections 2023-08-31T19:26:04.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.207+0000 7fac237ff700 1 -- 172.21.15.72:0/3882209899 wait complete. 2023-08-31T19:26:04.227 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:26:04.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:26:04.332 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:26:04.425 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:04.424+0000 7f79c3eba680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:26:04.431 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:04.431+0000 7f2daddaf680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:26:04.442 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:26:04.443 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-31T19:26:04.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:26:04.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-31T19:26:04.509 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:04.509+0000 7f79c3eba680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:26:04.511 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:04.511+0000 7f2daddaf680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:26:04.532 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T19:26:04.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:04.533 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T19:26:04.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:26:04.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.773+0000 7f03f4dff700 1 Processor -- start 2023-08-31T19:26:04.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.774+0000 7f03f4dff700 1 -- start start 2023-08-31T19:26:04.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.775+0000 7f03f4dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f03f01541a0 0x7f03f00c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:04.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.775+0000 7f03f4dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f00c5950 con 0x7f03f00bf460 2023-08-31T19:26:04.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.775+0000 7f03f4dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f00c5c30 con 0x7f03f00c4520 2023-08-31T19:26:04.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.775+0000 7f03f4dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f00c5f10 con 0x7f03f01541a0 2023-08-31T19:26:04.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.775+0000 7f03ee59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f03f01541a0 0x7f03f00c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:04.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.775+0000 7f03ee59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f03f01541a0 0x7f03f00c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36206/0 (socket says 172.21.15.72:36206) 2023-08-31T19:26:04.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.775+0000 7f03ee59c700 1 -- 172.21.15.72:0/3683013284 learned_addr learned my addr 172.21.15.72:0/3683013284 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:04.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.776+0000 7f03ee59c700 1 -- 172.21.15.72:0/3683013284 >> v1:172.21.15.146:6789/0 conn(0x7f03f00c4520 legacy=0x7f03f00a6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:04.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.776+0000 7f03ee59c700 1 -- 172.21.15.72:0/3683013284 >> v1:172.21.15.72:6789/0 conn(0x7f03f00bf460 legacy=0x7f03f00c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:04.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.776+0000 7f03ee59c700 1 -- 172.21.15.72:0/3683013284 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00a5a30 con 0x7f03f01541a0 2023-08-31T19:26:04.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.776+0000 7f03ee59c700 1 --2- 172.21.15.72:0/3683013284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03f01541a0 0x7f03f00c5300 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f03e0006fd0 tx=0x7f03e00090f0).ready entity=mon.0 client_cookie=42b8ffdb74685157 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:04.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.776+0000 7f03ed59a700 1 -- 172.21.15.72:0/3683013284 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e000b600 con 0x7f03f01541a0 2023-08-31T19:26:04.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.776+0000 7f03ed59a700 1 -- 172.21.15.72:0/3683013284 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e000b760 con 0x7f03f01541a0 2023-08-31T19:26:04.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.776+0000 7f03ed59a700 1 -- 172.21.15.72:0/3683013284 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e000bae0 con 0x7f03f01541a0 2023-08-31T19:26:04.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.777+0000 7f03f4dff700 1 -- 172.21.15.72:0/3683013284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03f01541a0 msgr2=0x7f03f00c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:04.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.777+0000 7f03f4dff700 1 --2- 172.21.15.72:0/3683013284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03f01541a0 0x7f03f00c5300 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f03e0006fd0 tx=0x7f03e00090f0).stop 2023-08-31T19:26:04.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.777+0000 7f03f4dff700 1 -- 172.21.15.72:0/3683013284 shutdown_connections 2023-08-31T19:26:04.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.777+0000 7f03f4dff700 1 --2- 172.21.15.72:0/3683013284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03f01541a0 0x7f03f00c5300 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:04.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.777+0000 7f03f4dff700 1 -- 172.21.15.72:0/3683013284 >> 172.21.15.72:0/3683013284 conn(0x7f03f0082f60 msgr2=0x7f03f005e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:04.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.777+0000 7f03f4dff700 1 -- 172.21.15.72:0/3683013284 shutdown_connections 2023-08-31T19:26:04.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.777+0000 7f03f4dff700 1 -- 172.21.15.72:0/3683013284 wait complete. 2023-08-31T19:26:04.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.778+0000 7f03f4dff700 1 Processor -- start 2023-08-31T19:26:04.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.778+0000 7f03f4dff700 1 -- start start 2023-08-31T19:26:04.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.779+0000 7f03f4dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03f00bf460 0x7f03f00aaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:04.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.779+0000 7f03f4dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03f00c4520 0x7f03f0154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:04.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.779+0000 7f03f4dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03f01541a0 0x7f03f0154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:04.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.779+0000 7f03f4dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00aa5d0 con 0x7f03f01541a0 2023-08-31T19:26:04.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.779+0000 7f03f4dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00a99c0 con 0x7f03f00bf460 2023-08-31T19:26:04.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.779+0000 7f03f4dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00a9ca0 con 0x7f03f00c4520 2023-08-31T19:26:04.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.780+0000 7f03eed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03f01541a0 0x7f03f0154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:04.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.780+0000 7f03ee59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03f00bf460 0x7f03f00aaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:04.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.780+0000 7f03ee59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03f00bf460 0x7f03f00aaa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:53002/0 (socket says 172.21.15.72:53002) 2023-08-31T19:26:04.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.780+0000 7f03ee59c700 1 -- 172.21.15.72:0/1920062560 learned_addr learned my addr 172.21.15.72:0/1920062560 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:04.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.780+0000 7f03edd9b700 1 --2- 172.21.15.72:0/1920062560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03f00c4520 0x7f03f0154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:04.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.780+0000 7f03eed9d700 1 -- 172.21.15.72:0/1920062560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03f00c4520 msgr2=0x7f03f0154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:04.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.780+0000 7f03eed9d700 1 --2- 172.21.15.72:0/1920062560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03f00c4520 0x7f03f0154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:04.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.780+0000 7f03eed9d700 1 -- 172.21.15.72:0/1920062560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03f00bf460 msgr2=0x7f03f00aaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:04.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.780+0000 7f03eed9d700 1 --2- 172.21.15.72:0/1920062560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03f00bf460 0x7f03f00aaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:04.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.780+0000 7f03eed9d700 1 -- 172.21.15.72:0/1920062560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e0009370 con 0x7f03f01541a0 2023-08-31T19:26:04.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.780+0000 7f03ee59c700 1 --2- 172.21.15.72:0/1920062560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03f00bf460 0x7f03f00aaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:04.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.780+0000 7f03eed9d700 1 --2- 172.21.15.72:0/1920062560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03f01541a0 0x7f03f0154a70 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7f03e80013d0 tx=0x7f03e8001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:04.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.781+0000 7f03de7fc700 1 -- 172.21.15.72:0/1920062560 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e800e4a0 con 0x7f03f01541a0 2023-08-31T19:26:04.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.781+0000 7f03de7fc700 1 -- 172.21.15.72:0/1920062560 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e800e600 con 0x7f03f01541a0 2023-08-31T19:26:04.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.781+0000 7f03f4dff700 1 -- 172.21.15.72:0/1920062560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f00a9f80 con 0x7f03f01541a0 2023-08-31T19:26:04.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.781+0000 7f03de7fc700 1 -- 172.21.15.72:0/1920062560 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e800e980 con 0x7f03f01541a0 2023-08-31T19:26:04.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.781+0000 7f03f4dff700 1 -- 172.21.15.72:0/1920062560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f0154f60 con 0x7f03f01541a0 2023-08-31T19:26:04.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.782+0000 7f03f4dff700 1 -- 172.21.15.72:0/1920062560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f00aa780 con 0x7f03f01541a0 2023-08-31T19:26:04.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.784+0000 7f03de7fc700 1 -- 172.21.15.72:0/1920062560 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 85) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f03e80123f0 con 0x7f03f01541a0 2023-08-31T19:26:04.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.784+0000 7f03de7fc700 1 --2- 172.21.15.72:0/1920062560 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f03d005f050 0x7f03d0061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:04.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.784+0000 7f03de7fc700 1 -- 172.21.15.72:0/1920062560 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7123+0+0 (secure 0 0 0) 0x7f03e8079d60 con 0x7f03f01541a0 2023-08-31T19:26:04.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.785+0000 7f03ee59c700 1 -- 172.21.15.72:0/1920062560 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f03d005f050 msgr2=0x7f03d0061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:04.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.785+0000 7f03ee59c700 1 --2- 172.21.15.72:0/1920062560 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f03d005f050 0x7f03d0061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:04.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.789+0000 7f03de7fc700 1 -- 172.21.15.72:0/1920062560 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f03e80478f0 con 0x7f03f01541a0 2023-08-31T19:26:04.840 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:04.840+0000 7f2daddaf680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:26:04.868 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:04.867+0000 7f79c3eba680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:26:04.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.986+0000 7f03ee59c700 1 -- 172.21.15.72:0/1920062560 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f03d005f050 msgr2=0x7f03d0061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:04.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:04.986+0000 7f03ee59c700 1 --2- 172.21.15.72:0/1920062560 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f03d005f050 0x7f03d0061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:26:05.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.008+0000 7f03f4dff700 1 -- 172.21.15.72:0/1920062560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03f006c6b0 con 0x7f03f01541a0 2023-08-31T19:26:05.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.008+0000 7f03de7fc700 1 -- 172.21.15.72:0/1920062560 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f03f00aa780 con 0x7f03f01541a0 2023-08-31T19:26:05.009 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:05.009 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3355816598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3355816598},{"type":"v1","addr":"172.21.15.146:6833","nonce":3355816598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/197878546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":197878546},{"type":"v1","addr":"172.21.15.146:6835","nonce":197878546}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2229531329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2229531329},{"type":"v1","addr":"172.21.15.72:6836","nonce":2229531329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:24:39.509515+0000","modified":"2023-08-31T19:24:42.529652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9024":{"gid":9024,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/1822141039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1822141039},{"type":"v1","addr":"172.21.15.72:6837","nonce":1822141039}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-31T19:26:05.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.010+0000 7f03f4dff700 1 -- 172.21.15.72:0/1920062560 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f03d005f050 msgr2=0x7f03d0061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:05.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.010+0000 7f03f4dff700 1 --2- 172.21.15.72:0/1920062560 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f03d005f050 0x7f03d0061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:05.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.010+0000 7f03f4dff700 1 -- 172.21.15.72:0/1920062560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03f01541a0 msgr2=0x7f03f0154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:05.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.010+0000 7f03f4dff700 1 --2- 172.21.15.72:0/1920062560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03f01541a0 0x7f03f0154a70 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7f03e80013d0 tx=0x7f03e8001530).stop 2023-08-31T19:26:05.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.011+0000 7f03f4dff700 1 -- 172.21.15.72:0/1920062560 shutdown_connections 2023-08-31T19:26:05.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.011+0000 7f03f4dff700 1 --2- 172.21.15.72:0/1920062560 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f03d005f050 0x7f03d0061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:05.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.011+0000 7f03f4dff700 1 --2- 172.21.15.72:0/1920062560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03f01541a0 0x7f03f0154a70 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.011+0000 7f03f4dff700 1 --2- 172.21.15.72:0/1920062560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03f00bf460 0x7f03f00aaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.011+0000 7f03f4dff700 1 --2- 172.21.15.72:0/1920062560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03f00c4520 0x7f03f0154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.011+0000 7f03f4dff700 1 -- 172.21.15.72:0/1920062560 >> 172.21.15.72:0/1920062560 conn(0x7f03f0082f60 msgr2=0x7f03f0152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:05.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.011+0000 7f03f4dff700 1 -- 172.21.15.72:0/1920062560 shutdown_connections 2023-08-31T19:26:05.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.011+0000 7f03f4dff700 1 -- 172.21.15.72:0/1920062560 wait complete. 2023-08-31T19:26:05.014 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 79 2023-08-31T19:26:05.029 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:26:05.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.247+0000 7f3bd17ff700 1 Processor -- start 2023-08-31T19:26:05.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.247+0000 7f3bd17ff700 1 -- start start 2023-08-31T19:26:05.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.249+0000 7f3bd17ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bcc0c4740 0x7f3bcc157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:05.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.249+0000 7f3bd17ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3bcc1581d0 0x7f3bcc0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:05.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.249+0000 7f3bd17ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc063be0 con 0x7f3bcc0c6c30 2023-08-31T19:26:05.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.249+0000 7f3bd17ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc0bca10 con 0x7f3bcc0c4740 2023-08-31T19:26:05.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.249+0000 7f3bd17ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc158640 con 0x7f3bcc1581d0 2023-08-31T19:26:05.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.249+0000 7f3bca7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bcc0c4740 0x7f3bcc157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:05.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.249+0000 7f3bca7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bcc0c4740 0x7f3bcc157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36220/0 (socket says 172.21.15.72:36220) 2023-08-31T19:26:05.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.249+0000 7f3bca7fc700 1 -- 172.21.15.72:0/1032989652 learned_addr learned my addr 172.21.15.72:0/1032989652 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:05.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.249+0000 7f3bcb7fe700 1 --2- 172.21.15.72:0/1032989652 >> v2:172.21.15.146:3300/0 conn(0x7f3bcc1581d0 0x7f3bcc0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:05.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.249+0000 7f3bca7fc700 1 -- 172.21.15.72:0/1032989652 >> v2:172.21.15.146:3300/0 conn(0x7f3bcc1581d0 msgr2=0x7f3bcc0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:05.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.249+0000 7f3bca7fc700 1 --2- 172.21.15.72:0/1032989652 >> v2:172.21.15.146:3300/0 conn(0x7f3bcc1581d0 0x7f3bcc0c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.249+0000 7f3bca7fc700 1 -- 172.21.15.72:0/1032989652 >> v1:172.21.15.72:6789/0 conn(0x7f3bcc0c6c30 legacy=0x7f3bcc0bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:05.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.249+0000 7f3bca7fc700 1 -- 172.21.15.72:0/1032989652 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc063010 con 0x7f3bcc0c4740 2023-08-31T19:26:05.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.249+0000 7f3bcb7fe700 1 --2- 172.21.15.72:0/1032989652 >> v2:172.21.15.146:3300/0 conn(0x7f3bcc1581d0 0x7f3bcc0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:05.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.250+0000 7f3bca7fc700 1 --2- 172.21.15.72:0/1032989652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bcc0c4740 0x7f3bcc157ce0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f3bcc158cc0 tx=0x7f3bc00090f0).ready entity=mon.0 client_cookie=61363a4ad982a4fe server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:05.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.250+0000 7f3bc9ffb700 1 -- 172.21.15.72:0/1032989652 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000b600 con 0x7f3bcc0c4740 2023-08-31T19:26:05.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.250+0000 7f3bc9ffb700 1 -- 172.21.15.72:0/1032989652 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc000b760 con 0x7f3bcc0c4740 2023-08-31T19:26:05.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.250+0000 7f3bc9ffb700 1 -- 172.21.15.72:0/1032989652 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000bae0 con 0x7f3bcc0c4740 2023-08-31T19:26:05.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.250+0000 7f3bd17ff700 1 -- 172.21.15.72:0/1032989652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bcc0c4740 msgr2=0x7f3bcc157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:05.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.250+0000 7f3bd17ff700 1 --2- 172.21.15.72:0/1032989652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bcc0c4740 0x7f3bcc157ce0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f3bcc158cc0 tx=0x7f3bc00090f0).stop 2023-08-31T19:26:05.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.250+0000 7f3bd17ff700 1 -- 172.21.15.72:0/1032989652 shutdown_connections 2023-08-31T19:26:05.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.250+0000 7f3bd17ff700 1 --2- 172.21.15.72:0/1032989652 >> v2:172.21.15.146:3300/0 conn(0x7f3bcc1581d0 0x7f3bcc0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.250+0000 7f3bd17ff700 1 --2- 172.21.15.72:0/1032989652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bcc0c4740 0x7f3bcc157ce0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.250+0000 7f3bd17ff700 1 -- 172.21.15.72:0/1032989652 >> 172.21.15.72:0/1032989652 conn(0x7f3bcc0c7e70 msgr2=0x7f3bcc0c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:05.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.251+0000 7f3bd17ff700 1 -- 172.21.15.72:0/1032989652 shutdown_connections 2023-08-31T19:26:05.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.251+0000 7f3bd17ff700 1 -- 172.21.15.72:0/1032989652 wait complete. 2023-08-31T19:26:05.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.252+0000 7f3bd17ff700 1 Processor -- start 2023-08-31T19:26:05.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.252+0000 7f3bd17ff700 1 -- start start 2023-08-31T19:26:05.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.253+0000 7f3bd17ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc0c4740 0x7f3bcc0aa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:05.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.253+0000 7f3bd17ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bcc0c6c30 0x7f3bcc0a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:05.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.253+0000 7f3bd17ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bcc1581d0 0x7f3bcc150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:05.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.253+0000 7f3bd17ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0a9ef0 con 0x7f3bcc0c6c30 2023-08-31T19:26:05.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.253+0000 7f3bd17ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0a8960 con 0x7f3bcc1581d0 2023-08-31T19:26:05.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.253+0000 7f3bd17ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0a8c40 con 0x7f3bcc0c4740 2023-08-31T19:26:05.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.253+0000 7f3bca7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bcc0c6c30 0x7f3bcc0a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:05.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.253+0000 7f3bca7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bcc0c6c30 0x7f3bcc0a9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36234/0 (socket says 172.21.15.72:36234) 2023-08-31T19:26:05.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.254+0000 7f3bca7fc700 1 -- 172.21.15.72:0/1089980839 learned_addr learned my addr 172.21.15.72:0/1089980839 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.254+0000 7f3bcb7fe700 1 --2- 172.21.15.72:0/1089980839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bcc1581d0 0x7f3bcc150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.254+0000 7f3bcaffd700 1 --2- 172.21.15.72:0/1089980839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc0c4740 0x7f3bcc0aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.254+0000 7f3bca7fc700 1 -- 172.21.15.72:0/1089980839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc0c4740 msgr2=0x7f3bcc0aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.254+0000 7f3bca7fc700 1 --2- 172.21.15.72:0/1089980839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc0c4740 0x7f3bcc0aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.254+0000 7f3bca7fc700 1 -- 172.21.15.72:0/1089980839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bcc1581d0 msgr2=0x7f3bcc150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:05.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.254+0000 7f3bca7fc700 1 --2- 172.21.15.72:0/1089980839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bcc1581d0 0x7f3bcc150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.254+0000 7f3bca7fc700 1 -- 172.21.15.72:0/1089980839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc0009370 con 0x7f3bcc0c6c30 2023-08-31T19:26:05.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.254+0000 7f3bca7fc700 1 --2- 172.21.15.72:0/1089980839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bcc0c6c30 0x7f3bcc0a9a00 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f3bc0009fd0 tx=0x7f3bc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:05.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.254+0000 7f3bb2ffd700 1 -- 172.21.15.72:0/1089980839 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000b8d0 con 0x7f3bcc0c6c30 2023-08-31T19:26:05.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.254+0000 7f3bb2ffd700 1 -- 172.21.15.72:0/1089980839 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc000ba30 con 0x7f3bcc0c6c30 2023-08-31T19:26:05.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.254+0000 7f3bb2ffd700 1 -- 172.21.15.72:0/1089980839 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc001b660 con 0x7f3bcc0c6c30 2023-08-31T19:26:05.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.254+0000 7f3bd17ff700 1 -- 172.21.15.72:0/1089980839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bcc0a8f20 con 0x7f3bcc0c6c30 2023-08-31T19:26:05.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.255+0000 7f3bd17ff700 1 -- 172.21.15.72:0/1089980839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bcc0a94e0 con 0x7f3bcc0c6c30 2023-08-31T19:26:05.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.256+0000 7f3bd17ff700 1 -- 172.21.15.72:0/1089980839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bcc06c6b0 con 0x7f3bcc0c6c30 2023-08-31T19:26:05.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.257+0000 7f3bb2ffd700 1 -- 172.21.15.72:0/1089980839 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 85) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f3bc001ba10 con 0x7f3bcc0c6c30 2023-08-31T19:26:05.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.258+0000 7f3bb2ffd700 1 --2- 172.21.15.72:0/1089980839 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3bb805f050 0x7f3bb8061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:05.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.258+0000 7f3bb2ffd700 1 -- 172.21.15.72:0/1089980839 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 7211+0+0 (secure 0 0 0) 0x7f3bc007bf90 con 0x7f3bcc0c6c30 2023-08-31T19:26:05.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.258+0000 7f3bcaffd700 1 -- 172.21.15.72:0/1089980839 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3bb805f050 msgr2=0x7f3bb8061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:05.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.258+0000 7f3bcaffd700 1 --2- 172.21.15.72:0/1089980839 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3bb805f050 0x7f3bb8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:05.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.262+0000 7f3bb2ffd700 1 -- 172.21.15.72:0/1089980839 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3bc004ccc0 con 0x7f3bcc0c6c30 2023-08-31T19:26:05.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.440+0000 7f3bd17ff700 1 -- 172.21.15.72:0/1089980839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bcc152ec0 con 0x7f3bcc0c6c30 2023-08-31T19:26:05.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.441+0000 7f3bb2ffd700 1 -- 172.21.15.72:0/1089980839 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+18709 (secure 0 0 0) 0x7f3bc001f020 con 0x7f3bcc0c6c30 2023-08-31T19:26:05.441 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:05.442 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":180,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:26:05.199222+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:24:37.934358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-31T19:24:38.492537+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":180,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.8","mappings":[{"from":4,"to":3}]},{"pgid":"22.3","mappings":[{"from":3,"to":1}]},{"pgid":"22.e","mappings":[{"from":3,"to":0}]},{"pgid":"22.2b","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/2024622836":"2023-09-01T19:24:53.092924+0000","172.21.15.72:6833/189426":"2023-09-01T19:24:53.092924+0000","172.21.15.72:6832/189426":"2023-09-01T19:24:53.092924+0000","172.21.15.72:0/1986676910":"2023-09-01T19:24:53.092924+0000","172.21.15.72:0/2275285377":"2023-09-01T19:24:53.092924+0000","172.21.15.72:0/2727550229":"2023-09-01T19:24:53.092924+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:26:05.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.443+0000 7f3bd17ff700 1 -- 172.21.15.72:0/1089980839 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3bb805f050 msgr2=0x7f3bb8061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:05.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.443+0000 7f3bd17ff700 1 --2- 172.21.15.72:0/1089980839 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3bb805f050 0x7f3bb8061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:05.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.443+0000 7f3bd17ff700 1 -- 172.21.15.72:0/1089980839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bcc0c6c30 msgr2=0x7f3bcc0a9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:05.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.443+0000 7f3bd17ff700 1 --2- 172.21.15.72:0/1089980839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bcc0c6c30 0x7f3bcc0a9a00 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 rx=0x7f3bc0009fd0 tx=0x7f3bc0017000).stop 2023-08-31T19:26:05.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.443+0000 7f3bd17ff700 1 -- 172.21.15.72:0/1089980839 shutdown_connections 2023-08-31T19:26:05.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.443+0000 7f3bd17ff700 1 --2- 172.21.15.72:0/1089980839 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3bb805f050 0x7f3bb8061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:05.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.443+0000 7f3bd17ff700 1 --2- 172.21.15.72:0/1089980839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bcc1581d0 0x7f3bcc150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.443+0000 7f3bd17ff700 1 --2- 172.21.15.72:0/1089980839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3bcc0c4740 0x7f3bcc0aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.443+0000 7f3bd17ff700 1 --2- 172.21.15.72:0/1089980839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bcc0c6c30 0x7f3bcc0a9a00 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.443+0000 7f3bd17ff700 1 -- 172.21.15.72:0/1089980839 >> 172.21.15.72:0/1089980839 conn(0x7f3bcc0c7e70 msgr2=0x7f3bcc157a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:05.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.443+0000 7f3bd17ff700 1 -- 172.21.15.72:0/1089980839 shutdown_connections 2023-08-31T19:26:05.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.444+0000 7f3bd17ff700 1 -- 172.21.15.72:0/1089980839 wait complete. 2023-08-31T19:26:05.462 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:24:37.934358+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '175', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:24:38.492537+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 4, 'snap_epoch': 180, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:26:05.462 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:26:05.596 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:05.596+0000 7f2daddaf680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:26:05.681 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:05.681+0000 7f2daddaf680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:26:05.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.692+0000 7fe83fbff700 1 Processor -- start 2023-08-31T19:26:05.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.692+0000 7fe83fbff700 1 -- start start 2023-08-31T19:26:05.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.693+0000 7fe83fbff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe838154210 0x7fe8380630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:05.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.693+0000 7fe83fbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8380635a0 0x7fe8380c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:05.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.693+0000 7fe83fbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe838063a00 con 0x7fe838153e30 2023-08-31T19:26:05.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.693+0000 7fe83fbff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8381546c0 con 0x7fe838154210 2023-08-31T19:26:05.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.693+0000 7fe83fbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8380bfd40 con 0x7fe8380635a0 2023-08-31T19:26:05.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.694+0000 7fe83d99b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe838153e30 0x7fe8380c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33722/0 (socket says 172.21.15.72:33722) 2023-08-31T19:26:05.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.694+0000 7fe83d99b700 1 -- 172.21.15.72:0/834377802 learned_addr learned my addr 172.21.15.72:0/834377802 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:05.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.694+0000 7fe83e19c700 1 --2- 172.21.15.72:0/834377802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8380635a0 0x7fe8380c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:05.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.694+0000 7fe83d19a700 1 --2- 172.21.15.72:0/834377802 >> v2:172.21.15.146:3300/0 conn(0x7fe838154210 0x7fe8380630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.694+0000 7fe83c999700 1 -- 172.21.15.72:0/834377802 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694686652 0 0) 0x7fe838063a00 con 0x7fe838153e30 2023-08-31T19:26:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.694+0000 7fe83c999700 1 -- 172.21.15.72:0/834377802 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8240033f0 con 0x7fe838153e30 2023-08-31T19:26:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.694+0000 7fe83d19a700 1 -- 172.21.15.72:0/834377802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8380635a0 msgr2=0x7fe8380c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.694+0000 7fe83d19a700 1 --2- 172.21.15.72:0/834377802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8380635a0 0x7fe8380c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.694+0000 7fe83d19a700 1 -- 172.21.15.72:0/834377802 >> v1:172.21.15.72:6789/0 conn(0x7fe838153e30 legacy=0x7fe8380c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.694+0000 7fe83d19a700 1 -- 172.21.15.72:0/834377802 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8380c6730 con 0x7fe838154210 2023-08-31T19:26:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.694+0000 7fe83e19c700 1 --2- 172.21.15.72:0/834377802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8380635a0 0x7fe8380c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.695+0000 7fe83d19a700 1 --2- 172.21.15.72:0/834377802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe838154210 0x7fe8380630b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fe828009760 tx=0x7fe828009060).ready entity=mon.1 client_cookie=67168f965800f558 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.695+0000 7fe83c999700 1 -- 172.21.15.72:0/834377802 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828009120 con 0x7fe838154210 2023-08-31T19:26:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.695+0000 7fe83c999700 1 -- 172.21.15.72:0/834377802 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82800d4a0 con 0x7fe838154210 2023-08-31T19:26:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.695+0000 7fe83c999700 1 -- 172.21.15.72:0/834377802 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82800d820 con 0x7fe838154210 2023-08-31T19:26:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.695+0000 7fe83fbff700 1 -- 172.21.15.72:0/834377802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe838154210 msgr2=0x7fe8380630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.695+0000 7fe83fbff700 1 --2- 172.21.15.72:0/834377802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe838154210 0x7fe8380630b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fe828009760 tx=0x7fe828009060).stop 2023-08-31T19:26:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.696+0000 7fe83fbff700 1 -- 172.21.15.72:0/834377802 shutdown_connections 2023-08-31T19:26:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.696+0000 7fe83fbff700 1 --2- 172.21.15.72:0/834377802 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8380635a0 0x7fe8380c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.696+0000 7fe83fbff700 1 --2- 172.21.15.72:0/834377802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe838154210 0x7fe8380630b0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.696+0000 7fe83fbff700 1 -- 172.21.15.72:0/834377802 >> 172.21.15.72:0/834377802 conn(0x7fe83805eb20 msgr2=0x7fe8380cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.696+0000 7fe83fbff700 1 -- 172.21.15.72:0/834377802 shutdown_connections 2023-08-31T19:26:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.696+0000 7fe83fbff700 1 -- 172.21.15.72:0/834377802 wait complete. 2023-08-31T19:26:05.701 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:05.696+0000 7f79c3eba680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:26:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.697+0000 7fe83fbff700 1 Processor -- start 2023-08-31T19:26:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.697+0000 7fe83fbff700 1 -- start start 2023-08-31T19:26:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.698+0000 7fe83fbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8380635a0 0x7fe838164220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.698+0000 7fe83fbff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe838153e30 0x7fe8380a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.698+0000 7fe83fbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe838154210 0x7fe8380a2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.698+0000 7fe83fbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8380a1dc0 con 0x7fe838154210 2023-08-31T19:26:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.698+0000 7fe83fbff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8380a20a0 con 0x7fe838153e30 2023-08-31T19:26:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.698+0000 7fe83fbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8380a2380 con 0x7fe8380635a0 2023-08-31T19:26:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.699+0000 7fe83d99b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8380635a0 0x7fe838164220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.699+0000 7fe83e19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe838154210 0x7fe8380a2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.699+0000 7fe83d99b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8380635a0 0x7fe838164220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:59610/0 (socket says 172.21.15.72:59610) 2023-08-31T19:26:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.699+0000 7fe83d99b700 1 -- 172.21.15.72:0/192681794 learned_addr learned my addr 172.21.15.72:0/192681794 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.699+0000 7fe83d19a700 1 --2- 172.21.15.72:0/192681794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe838153e30 0x7fe8380a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.699+0000 7fe83d99b700 1 -- 172.21.15.72:0/192681794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe838153e30 msgr2=0x7fe8380a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.699+0000 7fe83d99b700 1 --2- 172.21.15.72:0/192681794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe838153e30 0x7fe8380a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.699+0000 7fe83d99b700 1 -- 172.21.15.72:0/192681794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe838154210 msgr2=0x7fe8380a2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:05.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.699+0000 7fe83d99b700 1 --2- 172.21.15.72:0/192681794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe838154210 0x7fe8380a2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.699+0000 7fe83d99b700 1 -- 172.21.15.72:0/192681794 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe830009a20 con 0x7fe8380635a0 2023-08-31T19:26:05.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.699+0000 7fe83e19c700 1 --2- 172.21.15.72:0/192681794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe838154210 0x7fe8380a2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:05.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.699+0000 7fe83d99b700 1 --2- 172.21.15.72:0/192681794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8380635a0 0x7fe838164220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fe83400c590 tx=0x7fe834007c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:05.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.700+0000 7fe82dffb700 1 -- 172.21.15.72:0/192681794 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340072e0 con 0x7fe8380635a0 2023-08-31T19:26:05.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.700+0000 7fe82dffb700 1 -- 172.21.15.72:0/192681794 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe834007440 con 0x7fe8380635a0 2023-08-31T19:26:05.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.700+0000 7fe82dffb700 1 -- 172.21.15.72:0/192681794 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340057a0 con 0x7fe8380635a0 2023-08-31T19:26:05.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.700+0000 7fe83fbff700 1 -- 172.21.15.72:0/192681794 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8280092a0 con 0x7fe8380635a0 2023-08-31T19:26:05.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.700+0000 7fe83fbff700 1 -- 172.21.15.72:0/192681794 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8380a2940 con 0x7fe8380635a0 2023-08-31T19:26:05.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.701+0000 7fe83fbff700 1 -- 172.21.15.72:0/192681794 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83806c6b0 con 0x7fe8380635a0 2023-08-31T19:26:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.702+0000 7fe82dffb700 1 -- 172.21.15.72:0/192681794 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 85) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fe834005bd0 con 0x7fe8380635a0 2023-08-31T19:26:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.702+0000 7fe82dffb700 1 --2- 172.21.15.72:0/192681794 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe81c05f050 0x7fe81c061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.703+0000 7fe82dffb700 1 -- 172.21.15.72:0/192681794 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 7211+0+0 (secure 0 0 0) 0x7fe834079f30 con 0x7fe8380635a0 2023-08-31T19:26:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.703+0000 7fe83d19a700 1 -- 172.21.15.72:0/192681794 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe81c05f050 msgr2=0x7fe81c061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:05.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.703+0000 7fe83d19a700 1 --2- 172.21.15.72:0/192681794 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe81c05f050 0x7fe81c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:05.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.711+0000 7fe82dffb700 1 -- 172.21.15.72:0/192681794 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe83404aba0 con 0x7fe8380635a0 2023-08-31T19:26:05.785 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:05.785+0000 7f79c3eba680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:26:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.888+0000 7fe83fbff700 1 -- 172.21.15.72:0/192681794 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe8380bffe0 con 0x7fe8380635a0 2023-08-31T19:26:05.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.888+0000 7fe82dffb700 1 -- 172.21.15.72:0/192681794 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v180) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe83404e1c0 con 0x7fe8380635a0 2023-08-31T19:26:05.889 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:26:05.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.891+0000 7fe83fbff700 1 -- 172.21.15.72:0/192681794 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe81c05f050 msgr2=0x7fe81c061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:05.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.891+0000 7fe83fbff700 1 --2- 172.21.15.72:0/192681794 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe81c05f050 0x7fe81c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:05.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.891+0000 7fe83fbff700 1 -- 172.21.15.72:0/192681794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8380635a0 msgr2=0x7fe838164220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:05.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.891+0000 7fe83fbff700 1 --2- 172.21.15.72:0/192681794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8380635a0 0x7fe838164220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fe83400c590 tx=0x7fe834007c80).stop 2023-08-31T19:26:05.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.891+0000 7fe83fbff700 1 -- 172.21.15.72:0/192681794 shutdown_connections 2023-08-31T19:26:05.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.891+0000 7fe83fbff700 1 --2- 172.21.15.72:0/192681794 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe81c05f050 0x7fe81c061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:05.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.891+0000 7fe83fbff700 1 --2- 172.21.15.72:0/192681794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe838154210 0x7fe8380a2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.891+0000 7fe83fbff700 1 --2- 172.21.15.72:0/192681794 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe8380635a0 0x7fe838164220 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.891+0000 7fe83fbff700 1 --2- 172.21.15.72:0/192681794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe838153e30 0x7fe8380a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:05.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.891+0000 7fe83fbff700 1 -- 172.21.15.72:0/192681794 >> 172.21.15.72:0/192681794 conn(0x7fe83805eb20 msgr2=0x7fe8380ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:05.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.891+0000 7fe83fbff700 1 -- 172.21.15.72:0/192681794 shutdown_connections 2023-08-31T19:26:05.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:05.891+0000 7fe83fbff700 1 -- 172.21.15.72:0/192681794 wait complete. 2023-08-31T19:26:05.909 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:26:05.918 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:05.919+0000 7f2daddaf680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:26:06.026 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:06.026+0000 7f79c3eba680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:26:06.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.103+0000 7fc8c35ff700 1 Processor -- start 2023-08-31T19:26:06.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.103+0000 7fc8c35ff700 1 -- start start 2023-08-31T19:26:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.105+0000 7fc8c35ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8bc154210 0x7fc8bc0630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.105+0000 7fc8c35ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8bc0635a0 0x7fc8bc0c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.105+0000 7fc8c35ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc063a30 con 0x7fc8bc153e30 2023-08-31T19:26:06.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.105+0000 7fc8c35ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc1546c0 con 0x7fc8bc154210 2023-08-31T19:26:06.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.105+0000 7fc8c35ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc0bfd40 con 0x7fc8bc0635a0 2023-08-31T19:26:06.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.105+0000 7fc8c0b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8bc154210 0x7fc8bc0630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:06.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.105+0000 7fc8c0b9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8bc154210 0x7fc8bc0630b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36258/0 (socket says 172.21.15.72:36258) 2023-08-31T19:26:06.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.105+0000 7fc8c0b9a700 1 -- 172.21.15.72:0/1185195160 learned_addr learned my addr 172.21.15.72:0/1185195160 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:06.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.105+0000 7fc8c1b9c700 1 --2- 172.21.15.72:0/1185195160 >> v2:172.21.15.146:3300/0 conn(0x7fc8bc0635a0 0x7fc8bc0c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:06.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.105+0000 7fc8c0b9a700 1 -- 172.21.15.72:0/1185195160 >> v2:172.21.15.146:3300/0 conn(0x7fc8bc0635a0 msgr2=0x7fc8bc0c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:06.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.105+0000 7fc8c0b9a700 1 --2- 172.21.15.72:0/1185195160 >> v2:172.21.15.146:3300/0 conn(0x7fc8bc0635a0 0x7fc8bc0c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.105+0000 7fc8c0b9a700 1 -- 172.21.15.72:0/1185195160 >> v1:172.21.15.146:6789/0 conn(0x7fc8bc153e30 legacy=0x7fc8bc0c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:06.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.105+0000 7fc8c0b9a700 1 -- 172.21.15.72:0/1185195160 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc0c6730 con 0x7fc8bc154210 2023-08-31T19:26:06.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.105+0000 7fc8c1b9c700 1 --2- 172.21.15.72:0/1185195160 >> v2:172.21.15.146:3300/0 conn(0x7fc8bc0635a0 0x7fc8bc0c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:06.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.106+0000 7fc8c0b9a700 1 --2- 172.21.15.72:0/1185195160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc154210 0x7fc8bc0630b0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7fc8bc084380 tx=0x7fc8ac0090f0).ready entity=mon.0 client_cookie=afbabb7259e8880b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:06.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.106+0000 7fc8b3fff700 1 -- 172.21.15.72:0/1185195160 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac00b600 con 0x7fc8bc154210 2023-08-31T19:26:06.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.106+0000 7fc8b3fff700 1 -- 172.21.15.72:0/1185195160 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac00b760 con 0x7fc8bc154210 2023-08-31T19:26:06.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.106+0000 7fc8b3fff700 1 -- 172.21.15.72:0/1185195160 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac00bae0 con 0x7fc8bc154210 2023-08-31T19:26:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.106+0000 7fc8c35ff700 1 -- 172.21.15.72:0/1185195160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc154210 msgr2=0x7fc8bc0630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.106+0000 7fc8c35ff700 1 --2- 172.21.15.72:0/1185195160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc154210 0x7fc8bc0630b0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7fc8bc084380 tx=0x7fc8ac0090f0).stop 2023-08-31T19:26:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.107+0000 7fc8c35ff700 1 -- 172.21.15.72:0/1185195160 shutdown_connections 2023-08-31T19:26:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.107+0000 7fc8c35ff700 1 --2- 172.21.15.72:0/1185195160 >> v2:172.21.15.146:3300/0 conn(0x7fc8bc0635a0 0x7fc8bc0c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.107+0000 7fc8c35ff700 1 --2- 172.21.15.72:0/1185195160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc154210 0x7fc8bc0630b0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.107+0000 7fc8c35ff700 1 -- 172.21.15.72:0/1185195160 >> 172.21.15.72:0/1185195160 conn(0x7fc8bc05eb20 msgr2=0x7fc8bc0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.107+0000 7fc8c35ff700 1 -- 172.21.15.72:0/1185195160 shutdown_connections 2023-08-31T19:26:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.107+0000 7fc8c35ff700 1 -- 172.21.15.72:0/1185195160 wait complete. 2023-08-31T19:26:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.108+0000 7fc8c35ff700 1 Processor -- start 2023-08-31T19:26:06.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.108+0000 7fc8c35ff700 1 -- start start 2023-08-31T19:26:06.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.109+0000 7fc8c35ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc0635a0 0x7fc8bc151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.109+0000 7fc8c35ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc153e30 0x7fc8bc152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.109+0000 7fc8c35ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc154210 0x7fc8bc164740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.109+0000 7fc8c35ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc152700 con 0x7fc8bc0635a0 2023-08-31T19:26:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.109+0000 7fc8c35ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc166000 con 0x7fc8bc153e30 2023-08-31T19:26:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.109+0000 7fc8c35ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc152c10 con 0x7fc8bc154210 2023-08-31T19:26:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.109+0000 7fc8c139b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc0635a0 0x7fc8bc151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.110+0000 7fc8c139b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc0635a0 0x7fc8bc151d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36274/0 (socket says 172.21.15.72:36274) 2023-08-31T19:26:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.110+0000 7fc8c139b700 1 -- 172.21.15.72:0/2485324600 learned_addr learned my addr 172.21.15.72:0/2485324600 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.110+0000 7fc8c0b9a700 1 --2- 172.21.15.72:0/2485324600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc153e30 0x7fc8bc152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.110+0000 7fc8c1b9c700 1 --2- 172.21.15.72:0/2485324600 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc154210 0x7fc8bc164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.110+0000 7fc8c139b700 1 -- 172.21.15.72:0/2485324600 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc154210 msgr2=0x7fc8bc164740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.110+0000 7fc8c139b700 1 --2- 172.21.15.72:0/2485324600 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc154210 0x7fc8bc164740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.110+0000 7fc8c139b700 1 -- 172.21.15.72:0/2485324600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc153e30 msgr2=0x7fc8bc152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.110+0000 7fc8c139b700 1 --2- 172.21.15.72:0/2485324600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc153e30 0x7fc8bc152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.110+0000 7fc8c139b700 1 -- 172.21.15.72:0/2485324600 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac009370 con 0x7fc8bc0635a0 2023-08-31T19:26:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.110+0000 7fc8c139b700 1 --2- 172.21.15.72:0/2485324600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc0635a0 0x7fc8bc151d20 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7fc8b800c4c0 tx=0x7fc8b8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:06.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.110+0000 7fc8b17fa700 1 -- 172.21.15.72:0/2485324600 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b800ce70 con 0x7fc8bc0635a0 2023-08-31T19:26:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.110+0000 7fc8b17fa700 1 -- 172.21.15.72:0/2485324600 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b8001e90 con 0x7fc8bc0635a0 2023-08-31T19:26:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.110+0000 7fc8b17fa700 1 -- 172.21.15.72:0/2485324600 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8007250 con 0x7fc8bc0635a0 2023-08-31T19:26:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.110+0000 7fc8c35ff700 1 -- 172.21.15.72:0/2485324600 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc152930 con 0x7fc8bc0635a0 2023-08-31T19:26:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.111+0000 7fc8c35ff700 1 -- 172.21.15.72:0/2485324600 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc165c90 con 0x7fc8bc0635a0 2023-08-31T19:26:06.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.112+0000 7fc8c35ff700 1 -- 172.21.15.72:0/2485324600 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8bc06c6b0 con 0x7fc8bc0635a0 2023-08-31T19:26:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.112+0000 7fc8b17fa700 1 -- 172.21.15.72:0/2485324600 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 85) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fc8b80066a0 con 0x7fc8bc0635a0 2023-08-31T19:26:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.113+0000 7fc8b17fa700 1 --2- 172.21.15.72:0/2485324600 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc8a005f050 0x7fc8a0061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.113+0000 7fc8b17fa700 1 -- 172.21.15.72:0/2485324600 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 7211+0+0 (secure 0 0 0) 0x7fc8b8079e60 con 0x7fc8bc0635a0 2023-08-31T19:26:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.113+0000 7fc8c0b9a700 1 -- 172.21.15.72:0/2485324600 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc8a005f050 msgr2=0x7fc8a0061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:06.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.114+0000 7fc8c0b9a700 1 --2- 172.21.15.72:0/2485324600 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc8a005f050 0x7fc8a0061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:06.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.117+0000 7fc8b17fa700 1 -- 172.21.15.72:0/2485324600 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc8b804ab90 con 0x7fc8bc0635a0 2023-08-31T19:26:06.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.299+0000 7fc8c35ff700 1 -- 172.21.15.72:0/2485324600 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc8bc150120 con 0x7fc8bc0635a0 2023-08-31T19:26:06.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.299+0000 7fc8b17fa700 1 -- 172.21.15.72:0/2485324600 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v181) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc8b804e1b0 con 0x7fc8bc0635a0 2023-08-31T19:26:06.300 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:26:06.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.301+0000 7fc8c35ff700 1 -- 172.21.15.72:0/2485324600 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc8a005f050 msgr2=0x7fc8a0061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:06.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.301+0000 7fc8c35ff700 1 --2- 172.21.15.72:0/2485324600 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc8a005f050 0x7fc8a0061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:06.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.301+0000 7fc8c35ff700 1 -- 172.21.15.72:0/2485324600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc0635a0 msgr2=0x7fc8bc151d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:06.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.301+0000 7fc8c35ff700 1 --2- 172.21.15.72:0/2485324600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc0635a0 0x7fc8bc151d20 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7fc8b800c4c0 tx=0x7fc8b8007e00).stop 2023-08-31T19:26:06.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.301+0000 7fc8c35ff700 1 -- 172.21.15.72:0/2485324600 shutdown_connections 2023-08-31T19:26:06.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.301+0000 7fc8c35ff700 1 --2- 172.21.15.72:0/2485324600 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc8a005f050 0x7fc8a0061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:06.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.301+0000 7fc8c35ff700 1 --2- 172.21.15.72:0/2485324600 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc8bc154210 0x7fc8bc164740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.301+0000 7fc8c35ff700 1 --2- 172.21.15.72:0/2485324600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8bc0635a0 0x7fc8bc151d20 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.301+0000 7fc8c35ff700 1 --2- 172.21.15.72:0/2485324600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc153e30 0x7fc8bc152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.301+0000 7fc8c35ff700 1 -- 172.21.15.72:0/2485324600 >> 172.21.15.72:0/2485324600 conn(0x7fc8bc05eb20 msgr2=0x7fc8bc0ab790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:06.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.301+0000 7fc8c35ff700 1 -- 172.21.15.72:0/2485324600 shutdown_connections 2023-08-31T19:26:06.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.301+0000 7fc8c35ff700 1 -- 172.21.15.72:0/2485324600 wait complete. 2023-08-31T19:26:06.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:26:06.432 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:06.432+0000 7f2daddaf680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:26:06.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.521+0000 7f31d6fff700 1 Processor -- start 2023-08-31T19:26:06.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.522+0000 7f31d6fff700 1 -- start start 2023-08-31T19:26:06.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.523+0000 7f31d6fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f31d01545d0 0x7f31d00c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.523+0000 7f31d6fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31d0158020 0x7f31d0158420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.523+0000 7f31d6fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d00bc470 con 0x7f31d01541f0 2023-08-31T19:26:06.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.523+0000 7f31d6fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d00651f0 con 0x7f31d0158020 2023-08-31T19:26:06.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.523+0000 7f31d6fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d00bc6c0 con 0x7f31d01545d0 2023-08-31T19:26:06.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.523+0000 7f31d559c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31d0158020 0x7f31d0158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:06.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.524+0000 7f31d559c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31d0158020 0x7f31d0158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36286/0 (socket says 172.21.15.72:36286) 2023-08-31T19:26:06.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.524+0000 7f31d559c700 1 -- 172.21.15.72:0/1714439122 learned_addr learned my addr 172.21.15.72:0/1714439122 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:06.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.524+0000 7f31cffff700 1 --2- 172.21.15.72:0/1714439122 >> v2:172.21.15.146:3300/0 conn(0x7f31d01545d0 0x7f31d00c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:06.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.524+0000 7f31d559c700 1 -- 172.21.15.72:0/1714439122 >> v2:172.21.15.146:3300/0 conn(0x7f31d01545d0 msgr2=0x7f31d00c26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:06.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.524+0000 7f31d559c700 1 --2- 172.21.15.72:0/1714439122 >> v2:172.21.15.146:3300/0 conn(0x7f31d01545d0 0x7f31d00c26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.524+0000 7f31d559c700 1 -- 172.21.15.72:0/1714439122 >> v1:172.21.15.146:6789/0 conn(0x7f31d01541f0 legacy=0x7f31d0065680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:06.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.524+0000 7f31cf7fe700 1 -- 172.21.15.72:0/1714439122 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554312381 0 0) 0x7f31d00bc470 con 0x7f31d01541f0 2023-08-31T19:26:06.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.524+0000 7f31d559c700 1 -- 172.21.15.72:0/1714439122 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d00bc9a0 con 0x7f31d0158020 2023-08-31T19:26:06.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.524+0000 7f31cffff700 1 --2- 172.21.15.72:0/1714439122 >> v2:172.21.15.146:3300/0 conn(0x7f31d01545d0 0x7f31d00c26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:06.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.524+0000 7f31d559c700 1 --2- 172.21.15.72:0/1714439122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d0158020 0x7f31d0158420 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f31d0067d50 tx=0x7f31c8009840).ready entity=mon.0 client_cookie=7cac7b1accdc2eef server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:06.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.524+0000 7f31cf7fe700 1 -- 172.21.15.72:0/1714439122 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c800e070 con 0x7f31d0158020 2023-08-31T19:26:06.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.525+0000 7f31cf7fe700 1 -- 172.21.15.72:0/1714439122 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c800ba20 con 0x7f31d0158020 2023-08-31T19:26:06.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.525+0000 7f31cf7fe700 1 -- 172.21.15.72:0/1714439122 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c800bda0 con 0x7f31d0158020 2023-08-31T19:26:06.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.525+0000 7f31d6fff700 1 -- 172.21.15.72:0/1714439122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d0158020 msgr2=0x7f31d0158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:06.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.525+0000 7f31d6fff700 1 --2- 172.21.15.72:0/1714439122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d0158020 0x7f31d0158420 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f31d0067d50 tx=0x7f31c8009840).stop 2023-08-31T19:26:06.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.525+0000 7f31d6fff700 1 -- 172.21.15.72:0/1714439122 shutdown_connections 2023-08-31T19:26:06.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.525+0000 7f31d6fff700 1 --2- 172.21.15.72:0/1714439122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d0158020 0x7f31d0158420 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.525+0000 7f31d6fff700 1 --2- 172.21.15.72:0/1714439122 >> v2:172.21.15.146:3300/0 conn(0x7f31d01545d0 0x7f31d00c26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.525+0000 7f31d6fff700 1 -- 172.21.15.72:0/1714439122 >> 172.21.15.72:0/1714439122 conn(0x7f31d00630c0 msgr2=0x7f31d00c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:06.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.525+0000 7f31d6fff700 1 -- 172.21.15.72:0/1714439122 shutdown_connections 2023-08-31T19:26:06.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.525+0000 7f31d6fff700 1 -- 172.21.15.72:0/1714439122 wait complete. 2023-08-31T19:26:06.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.527+0000 7f31d6fff700 1 Processor -- start 2023-08-31T19:26:06.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.527+0000 7f31d6fff700 1 -- start start 2023-08-31T19:26:06.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.528+0000 7f31d6fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d01541f0 0x7f31d014f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.528+0000 7f31d6fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31d01545d0 0x7f31d00bf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.528+0000 7f31d6fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31d0158020 0x7f31d01517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.528+0000 7f31d6fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d00be850 con 0x7f31d01541f0 2023-08-31T19:26:06.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.528+0000 7f31d6fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d00bdc40 con 0x7f31d0158020 2023-08-31T19:26:06.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.528+0000 7f31d6fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d00bdf20 con 0x7f31d01545d0 2023-08-31T19:26:06.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.528+0000 7f31d4d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d01541f0 0x7f31d014f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:06.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.528+0000 7f31d4d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d01541f0 0x7f31d014f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36292/0 (socket says 172.21.15.72:36292) 2023-08-31T19:26:06.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.528+0000 7f31d4d9b700 1 -- 172.21.15.72:0/1350655435 learned_addr learned my addr 172.21.15.72:0/1350655435 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:06.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.528+0000 7f31d559c700 1 --2- 172.21.15.72:0/1350655435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31d0158020 0x7f31d01517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:06.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.528+0000 7f31cffff700 1 --2- 172.21.15.72:0/1350655435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31d01545d0 0x7f31d00bf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:06.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.528+0000 7f31d4d9b700 1 -- 172.21.15.72:0/1350655435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31d01545d0 msgr2=0x7f31d00bf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:06.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.528+0000 7f31d4d9b700 1 --2- 172.21.15.72:0/1350655435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31d01545d0 0x7f31d00bf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.529+0000 7f31d4d9b700 1 -- 172.21.15.72:0/1350655435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31d0158020 msgr2=0x7f31d01517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:06.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.529+0000 7f31d4d9b700 1 --2- 172.21.15.72:0/1350655435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31d0158020 0x7f31d01517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.529+0000 7f31d4d9b700 1 -- 172.21.15.72:0/1350655435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc0092a0 con 0x7f31d01541f0 2023-08-31T19:26:06.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.529+0000 7f31cffff700 1 --2- 172.21.15.72:0/1350655435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31d01545d0 0x7f31d00bf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:06.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.529+0000 7f31d4d9b700 1 --2- 172.21.15.72:0/1350655435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d01541f0 0x7f31d014f6d0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f31c4001eb0 tx=0x7f31c4007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:06.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.529+0000 7f31ccff9700 1 -- 172.21.15.72:0/1350655435 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c400f470 con 0x7f31d01541f0 2023-08-31T19:26:06.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.529+0000 7f31ccff9700 1 -- 172.21.15.72:0/1350655435 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c400f5f0 con 0x7f31d01541f0 2023-08-31T19:26:06.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.529+0000 7f31d6fff700 1 -- 172.21.15.72:0/1350655435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c8009ae0 con 0x7f31d01541f0 2023-08-31T19:26:06.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.529+0000 7f31ccff9700 1 -- 172.21.15.72:0/1350655435 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c400f9b0 con 0x7f31d01541f0 2023-08-31T19:26:06.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.529+0000 7f31d6fff700 1 -- 172.21.15.72:0/1350655435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d00be4e0 con 0x7f31d01541f0 2023-08-31T19:26:06.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.530+0000 7f31d6fff700 1 -- 172.21.15.72:0/1350655435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d00beb30 con 0x7f31d01541f0 2023-08-31T19:26:06.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.531+0000 7f31ccff9700 1 -- 172.21.15.72:0/1350655435 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 85) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f31c400fd20 con 0x7f31d01541f0 2023-08-31T19:26:06.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.533+0000 7f31ccff9700 1 --2- 172.21.15.72:0/1350655435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f31b405f050 0x7f31b4061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.533+0000 7f31ccff9700 1 -- 172.21.15.72:0/1350655435 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7195+0+0 (secure 0 0 0) 0x7f31c4079c30 con 0x7f31d01541f0 2023-08-31T19:26:06.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.534+0000 7f31cffff700 1 -- 172.21.15.72:0/1350655435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f31b405f050 msgr2=0x7f31b4061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:06.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.534+0000 7f31cffff700 1 --2- 172.21.15.72:0/1350655435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f31b405f050 0x7f31b4061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:06.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.538+0000 7f31ccff9700 1 -- 172.21.15.72:0/1350655435 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31c404a970 con 0x7f31d01541f0 2023-08-31T19:26:06.564 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:06.564+0000 7f2daddaf680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:26:06.582 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:06.581+0000 7f79c3eba680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:26:06.712 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:06.711+0000 7f79c3eba680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:26:06.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.721+0000 7f31d6fff700 1 -- 172.21.15.72:0/1350655435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31d0064e80 con 0x7f31d01541f0 2023-08-31T19:26:06.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.722+0000 7f31ccff9700 1 -- 172.21.15.72:0/1350655435 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v181) v1 ==== 104+0+11 (secure 0 0 0) 0x7f31c404df90 con 0x7f31d01541f0 2023-08-31T19:26:06.722 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:26:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.724+0000 7f31d6fff700 1 -- 172.21.15.72:0/1350655435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f31b405f050 msgr2=0x7f31b4061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.724+0000 7f31d6fff700 1 --2- 172.21.15.72:0/1350655435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f31b405f050 0x7f31b4061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.724+0000 7f31d6fff700 1 -- 172.21.15.72:0/1350655435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d01541f0 msgr2=0x7f31d014f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.724+0000 7f31d6fff700 1 --2- 172.21.15.72:0/1350655435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d01541f0 0x7f31d014f6d0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f31c4001eb0 tx=0x7f31c4007c70).stop 2023-08-31T19:26:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.724+0000 7f31d6fff700 1 -- 172.21.15.72:0/1350655435 shutdown_connections 2023-08-31T19:26:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.724+0000 7f31d6fff700 1 --2- 172.21.15.72:0/1350655435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f31b405f050 0x7f31b4061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.724+0000 7f31d6fff700 1 --2- 172.21.15.72:0/1350655435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31d0158020 0x7f31d01517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.724+0000 7f31d6fff700 1 --2- 172.21.15.72:0/1350655435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d01541f0 0x7f31d014f6d0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.724+0000 7f31d6fff700 1 --2- 172.21.15.72:0/1350655435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f31d01545d0 0x7f31d00bf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.724+0000 7f31d6fff700 1 -- 172.21.15.72:0/1350655435 >> 172.21.15.72:0/1350655435 conn(0x7f31d00630c0 msgr2=0x7f31d00c5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.724+0000 7f31d6fff700 1 -- 172.21.15.72:0/1350655435 shutdown_connections 2023-08-31T19:26:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.724+0000 7f31d6fff700 1 -- 172.21.15.72:0/1350655435 wait complete. 2023-08-31T19:26:06.743 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:26:06.749 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:06.749+0000 7f2daddaf680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:26:06.842 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:06.842+0000 7f2daddaf680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:26:06.905 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:06.905+0000 7f79c3eba680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:26:06.928 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:06.928+0000 7f2daddaf680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:26:06.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.942+0000 7f1b7a5ff700 1 Processor -- start 2023-08-31T19:26:06.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.942+0000 7f1b7a5ff700 1 -- start start 2023-08-31T19:26:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.944+0000 7f1b7a5ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b74154030 0x7f1b74154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.944+0000 7f1b7a5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b740c06b0 0x7f1b740c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.944+0000 7f1b7a5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b740c6ed0 con 0x7f1b740aa140 2023-08-31T19:26:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.944+0000 7f1b7a5ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b740c66e0 con 0x7f1b74154030 2023-08-31T19:26:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.944+0000 7f1b7a5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b740c68c0 con 0x7f1b740c06b0 2023-08-31T19:26:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.944+0000 7f1b73fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b74154030 0x7f1b74154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.944+0000 7f1b737fe700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b740c06b0 0x7f1b740c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.944+0000 7f1b78b9c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1b740aa140 0x7f1b74063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:50538/0 (socket says 172.21.15.72:50538) 2023-08-31T19:26:06.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.944+0000 7f1b73fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b74154030 0x7f1b74154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:53080/0 (socket says 172.21.15.72:53080) 2023-08-31T19:26:06.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.944+0000 7f1b78b9c700 1 -- 172.21.15.72:0/2098052574 learned_addr learned my addr 172.21.15.72:0/2098052574 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:06.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.945+0000 7f1b737fe700 1 -- 172.21.15.72:0/2098052574 >> v2:172.21.15.146:3300/0 conn(0x7f1b74154030 msgr2=0x7f1b74154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.945+0000 7f1b737fe700 1 --2- 172.21.15.72:0/2098052574 >> v2:172.21.15.146:3300/0 conn(0x7f1b74154030 0x7f1b74154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.945+0000 7f1b737fe700 1 -- 172.21.15.72:0/2098052574 >> v1:172.21.15.146:6789/0 conn(0x7f1b740aa140 legacy=0x7f1b74063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.945+0000 7f1b72ffd700 1 -- 172.21.15.72:0/2098052574 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919370234 0 0) 0x7f1b740c6ed0 con 0x7f1b740aa140 2023-08-31T19:26:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.945+0000 7f1b737fe700 1 -- 172.21.15.72:0/2098052574 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b740c0f30 con 0x7f1b740c06b0 2023-08-31T19:26:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.945+0000 7f1b73fff700 1 --2- 172.21.15.72:0/2098052574 >> v2:172.21.15.146:3300/0 conn(0x7f1b74154030 0x7f1b74154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.945+0000 7f1b737fe700 1 --2- 172.21.15.72:0/2098052574 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b740c06b0 0x7f1b740c7360 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f1b68009760 tx=0x7f1b68009060).ready entity=mon.2 client_cookie=b0dd28654b9c6073 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.945+0000 7f1b72ffd700 1 -- 172.21.15.72:0/2098052574 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6800f510 con 0x7f1b740c06b0 2023-08-31T19:26:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.945+0000 7f1b72ffd700 1 -- 172.21.15.72:0/2098052574 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6800f670 con 0x7f1b740c06b0 2023-08-31T19:26:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.945+0000 7f1b72ffd700 1 -- 172.21.15.72:0/2098052574 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6800f9f0 con 0x7f1b740c06b0 2023-08-31T19:26:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.946+0000 7f1b7a5ff700 1 -- 172.21.15.72:0/2098052574 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b740c06b0 msgr2=0x7f1b740c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.946+0000 7f1b7a5ff700 1 --2- 172.21.15.72:0/2098052574 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b740c06b0 0x7f1b740c7360 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f1b68009760 tx=0x7f1b68009060).stop 2023-08-31T19:26:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.946+0000 7f1b7a5ff700 1 -- 172.21.15.72:0/2098052574 shutdown_connections 2023-08-31T19:26:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.946+0000 7f1b7a5ff700 1 --2- 172.21.15.72:0/2098052574 >> v2:172.21.15.146:3300/0 conn(0x7f1b74154030 0x7f1b74154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.946+0000 7f1b7a5ff700 1 --2- 172.21.15.72:0/2098052574 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b740c06b0 0x7f1b740c7360 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.946+0000 7f1b7a5ff700 1 -- 172.21.15.72:0/2098052574 >> 172.21.15.72:0/2098052574 conn(0x7f1b7405eb60 msgr2=0x7f1b740cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.946+0000 7f1b7a5ff700 1 -- 172.21.15.72:0/2098052574 shutdown_connections 2023-08-31T19:26:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.946+0000 7f1b7a5ff700 1 -- 172.21.15.72:0/2098052574 wait complete. 2023-08-31T19:26:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.949+0000 7f1b7a5ff700 1 Processor -- start 2023-08-31T19:26:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.949+0000 7f1b7a5ff700 1 -- start start 2023-08-31T19:26:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.950+0000 7f1b7a5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b740aa140 0x7f1b740c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.950+0000 7f1b7a5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b740c06b0 0x7f1b74157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.950+0000 7f1b7a5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b74154030 0x7f1b74167760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.950+0000 7f1b7a5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b74168690 con 0x7f1b740c06b0 2023-08-31T19:26:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.950+0000 7f1b7a5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b741680d0 con 0x7f1b740aa140 2023-08-31T19:26:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.950+0000 7f1b7a5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b741683b0 con 0x7f1b74154030 2023-08-31T19:26:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.951+0000 7f1b737fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b740c06b0 0x7f1b74157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.951+0000 7f1b73fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b740aa140 0x7f1b740c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.951+0000 7f1b737fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b740c06b0 0x7f1b74157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36308/0 (socket says 172.21.15.72:36308) 2023-08-31T19:26:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.951+0000 7f1b737fe700 1 -- 172.21.15.72:0/2570900904 learned_addr learned my addr 172.21.15.72:0/2570900904 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.951+0000 7f1b78b9c700 1 --2- 172.21.15.72:0/2570900904 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b74154030 0x7f1b74167760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.951+0000 7f1b73fff700 1 -- 172.21.15.72:0/2570900904 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b74154030 msgr2=0x7f1b74167760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.951+0000 7f1b73fff700 1 --2- 172.21.15.72:0/2570900904 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b74154030 0x7f1b74167760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.951+0000 7f1b73fff700 1 -- 172.21.15.72:0/2570900904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b740c06b0 msgr2=0x7f1b74157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.951+0000 7f1b73fff700 1 --2- 172.21.15.72:0/2570900904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b740c06b0 0x7f1b74157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.951+0000 7f1b73fff700 1 -- 172.21.15.72:0/2570900904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640092a0 con 0x7f1b740aa140 2023-08-31T19:26:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.951+0000 7f1b73fff700 1 --2- 172.21.15.72:0/2570900904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b740aa140 0x7f1b740c3ea0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f1b6400e880 tx=0x7f1b64009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.952+0000 7f1b5bfff700 1 -- 172.21.15.72:0/2570900904 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b64012600 con 0x7f1b740aa140 2023-08-31T19:26:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.952+0000 7f1b5bfff700 1 -- 172.21.15.72:0/2570900904 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b64012760 con 0x7f1b740aa140 2023-08-31T19:26:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.952+0000 7f1b5bfff700 1 -- 172.21.15.72:0/2570900904 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b64012ae0 con 0x7f1b740aa140 2023-08-31T19:26:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.952+0000 7f1b7a5ff700 1 -- 172.21.15.72:0/2570900904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b680092a0 con 0x7f1b740aa140 2023-08-31T19:26:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.952+0000 7f1b7a5ff700 1 -- 172.21.15.72:0/2570900904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b74156be0 con 0x7f1b740aa140 2023-08-31T19:26:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.953+0000 7f1b7a5ff700 1 -- 172.21.15.72:0/2570900904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b74156f50 con 0x7f1b740aa140 2023-08-31T19:26:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.954+0000 7f1b5bfff700 1 -- 172.21.15.72:0/2570900904 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 85) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f1b6401b400 con 0x7f1b740aa140 2023-08-31T19:26:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.955+0000 7f1b5bfff700 1 --2- 172.21.15.72:0/2570900904 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1b6005f050 0x7f1b60061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.955+0000 7f1b5bfff700 1 -- 172.21.15.72:0/2570900904 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7195+0+0 (secure 0 0 0) 0x7f1b6407aa00 con 0x7f1b740aa140 2023-08-31T19:26:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.955+0000 7f1b737fe700 1 -- 172.21.15.72:0/2570900904 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1b6005f050 msgr2=0x7f1b60061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.955+0000 7f1b737fe700 1 --2- 172.21.15.72:0/2570900904 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1b6005f050 0x7f1b60061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:06.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:06.960+0000 7f1b5bfff700 1 -- 172.21.15.72:0/2570900904 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1b6404b620 con 0x7f1b740aa140 2023-08-31T19:26:07.005 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:07.005+0000 7f79c3eba680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:26:07.096 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:07.095+0000 7f79c3eba680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:26:07.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.139+0000 7f1b7a5ff700 1 -- 172.21.15.72:0/2570900904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1b740c0c50 con 0x7f1b740aa140 2023-08-31T19:26:07.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.140+0000 7f1b5bfff700 1 -- 172.21.15.72:0/2570900904 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v181) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1b64016020 con 0x7f1b740aa140 2023-08-31T19:26:07.140 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:26:07.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.142+0000 7f1b7a5ff700 1 -- 172.21.15.72:0/2570900904 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1b6005f050 msgr2=0x7f1b60061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:07.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.142+0000 7f1b7a5ff700 1 --2- 172.21.15.72:0/2570900904 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1b6005f050 0x7f1b60061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:07.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.142+0000 7f1b7a5ff700 1 -- 172.21.15.72:0/2570900904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b740aa140 msgr2=0x7f1b740c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:07.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.142+0000 7f1b7a5ff700 1 --2- 172.21.15.72:0/2570900904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b740aa140 0x7f1b740c3ea0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f1b6400e880 tx=0x7f1b64009060).stop 2023-08-31T19:26:07.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.142+0000 7f1b7a5ff700 1 -- 172.21.15.72:0/2570900904 shutdown_connections 2023-08-31T19:26:07.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.142+0000 7f1b7a5ff700 1 --2- 172.21.15.72:0/2570900904 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1b6005f050 0x7f1b60061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:07.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.142+0000 7f1b7a5ff700 1 --2- 172.21.15.72:0/2570900904 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b74154030 0x7f1b74167760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:07.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.142+0000 7f1b7a5ff700 1 --2- 172.21.15.72:0/2570900904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b740aa140 0x7f1b740c3ea0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:07.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.142+0000 7f1b7a5ff700 1 --2- 172.21.15.72:0/2570900904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b740c06b0 0x7f1b74157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:07.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.142+0000 7f1b7a5ff700 1 -- 172.21.15.72:0/2570900904 >> 172.21.15.72:0/2570900904 conn(0x7f1b7405eb60 msgr2=0x7f1b74151940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:07.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.142+0000 7f1b7a5ff700 1 -- 172.21.15.72:0/2570900904 shutdown_connections 2023-08-31T19:26:07.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.142+0000 7f1b7a5ff700 1 -- 172.21.15.72:0/2570900904 wait complete. 2023-08-31T19:26:07.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:26:07.243 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:07.243+0000 7f2daddaf680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:26:07.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.355+0000 7f5685bff700 1 Processor -- start 2023-08-31T19:26:07.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.355+0000 7f5685bff700 1 -- start start 2023-08-31T19:26:07.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.357+0000 7f5685bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56800cb9b0 0x7f56801583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:07.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.357+0000 7f5685bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56800c6120 con 0x7f56801588d0 2023-08-31T19:26:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.357+0000 7f5685bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56800c5e10 con 0x7f5680154060 2023-08-31T19:26:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.357+0000 7f5685bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56800c1380 con 0x7f56800cb9b0 2023-08-31T19:26:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.357+0000 7f567effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56800cb9b0 0x7f56801583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.357+0000 7f567effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56800cb9b0 0x7f56801583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36320/0 (socket says 172.21.15.72:36320) 2023-08-31T19:26:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.357+0000 7f567effd700 1 -- 172.21.15.72:0/2315986806 learned_addr learned my addr 172.21.15.72:0/2315986806 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:07.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.357+0000 7f567effd700 1 -- 172.21.15.72:0/2315986806 >> v1:172.21.15.146:6789/0 conn(0x7f5680154060 legacy=0x7f5680157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:07.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.357+0000 7f567effd700 1 -- 172.21.15.72:0/2315986806 >> v1:172.21.15.72:6789/0 conn(0x7f56801588d0 legacy=0x7f5680154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:07.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.357+0000 7f567e7fc700 1 -- 172.21.15.72:0/2315986806 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831253900 0 0) 0x7f56800c5e10 con 0x7f5680154060 2023-08-31T19:26:07.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.358+0000 7f567effd700 1 -- 172.21.15.72:0/2315986806 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56800c0ae0 con 0x7f56800cb9b0 2023-08-31T19:26:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.358+0000 7f567effd700 1 --2- 172.21.15.72:0/2315986806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56800cb9b0 0x7f56801583e0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f5674006fd0 tx=0x7f56740090f0).ready entity=mon.0 client_cookie=29dce4f123022ee7 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.358+0000 7f567e7fc700 1 -- 172.21.15.72:0/2315986806 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567400f510 con 0x7f56800cb9b0 2023-08-31T19:26:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.358+0000 7f567e7fc700 1 -- 172.21.15.72:0/2315986806 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567400f670 con 0x7f56800cb9b0 2023-08-31T19:26:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.358+0000 7f567e7fc700 1 -- 172.21.15.72:0/2315986806 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567400f9f0 con 0x7f56800cb9b0 2023-08-31T19:26:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.358+0000 7f5685bff700 1 -- 172.21.15.72:0/2315986806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56800cb9b0 msgr2=0x7f56801583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:07.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.358+0000 7f5685bff700 1 --2- 172.21.15.72:0/2315986806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56800cb9b0 0x7f56801583e0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f5674006fd0 tx=0x7f56740090f0).stop 2023-08-31T19:26:07.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.359+0000 7f5685bff700 1 -- 172.21.15.72:0/2315986806 shutdown_connections 2023-08-31T19:26:07.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.359+0000 7f5685bff700 1 --2- 172.21.15.72:0/2315986806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56800cb9b0 0x7f56801583e0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:07.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.359+0000 7f5685bff700 1 -- 172.21.15.72:0/2315986806 >> 172.21.15.72:0/2315986806 conn(0x7f568005e870 msgr2=0x7f56800cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:07.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.359+0000 7f5685bff700 1 -- 172.21.15.72:0/2315986806 shutdown_connections 2023-08-31T19:26:07.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.359+0000 7f5685bff700 1 -- 172.21.15.72:0/2315986806 wait complete. 2023-08-31T19:26:07.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.361+0000 7f5685bff700 1 Processor -- start 2023-08-31T19:26:07.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.361+0000 7f5685bff700 1 -- start start 2023-08-31T19:26:07.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.362+0000 7f5685bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56800cb9b0 0x7f56800c2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:07.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.362+0000 7f5685bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5680154060 0x7f568014bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:07.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.362+0000 7f5685bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56801588d0 0x7f56800add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.362+0000 7f5685bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56801565a0 con 0x7f5680154060 2023-08-31T19:26:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.362+0000 7f5685bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5680156880 con 0x7f56800cb9b0 2023-08-31T19:26:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.362+0000 7f5685bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56800c2500 con 0x7f56801588d0 2023-08-31T19:26:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.363+0000 7f567effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5680154060 0x7f568014bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:07.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.363+0000 7f567f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56800cb9b0 0x7f56800c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:07.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.363+0000 7f567effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5680154060 0x7f568014bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36334/0 (socket says 172.21.15.72:36334) 2023-08-31T19:26:07.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.363+0000 7f567effd700 1 -- 172.21.15.72:0/3082535342 learned_addr learned my addr 172.21.15.72:0/3082535342 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:07.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.363+0000 7f567ffff700 1 --2- 172.21.15.72:0/3082535342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56801588d0 0x7f56800add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:07.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.363+0000 7f567effd700 1 -- 172.21.15.72:0/3082535342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56801588d0 msgr2=0x7f56800add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:07.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.363+0000 7f567effd700 1 --2- 172.21.15.72:0/3082535342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56801588d0 0x7f56800add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:07.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.363+0000 7f567effd700 1 -- 172.21.15.72:0/3082535342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56800cb9b0 msgr2=0x7f56800c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:07.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.363+0000 7f567effd700 1 --2- 172.21.15.72:0/3082535342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56800cb9b0 0x7f56800c2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:07.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.363+0000 7f567effd700 1 -- 172.21.15.72:0/3082535342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5674009370 con 0x7f5680154060 2023-08-31T19:26:07.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.363+0000 7f567f7fe700 1 --2- 172.21.15.72:0/3082535342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56800cb9b0 0x7f56800c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:07.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.363+0000 7f567effd700 1 --2- 172.21.15.72:0/3082535342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5680154060 0x7f568014bfe0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f5674009f50 tx=0x7f5674017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:07.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.364+0000 7f56677fe700 1 -- 172.21.15.72:0/3082535342 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567400fe80 con 0x7f5680154060 2023-08-31T19:26:07.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.364+0000 7f56677fe700 1 -- 172.21.15.72:0/3082535342 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567400f7e0 con 0x7f5680154060 2023-08-31T19:26:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.364+0000 7f56677fe700 1 -- 172.21.15.72:0/3082535342 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567401c650 con 0x7f5680154060 2023-08-31T19:26:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.364+0000 7f5685bff700 1 -- 172.21.15.72:0/3082535342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56800ae620 con 0x7f5680154060 2023-08-31T19:26:07.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.364+0000 7f5685bff700 1 -- 172.21.15.72:0/3082535342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56800aebe0 con 0x7f5680154060 2023-08-31T19:26:07.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.365+0000 7f5685bff700 1 -- 172.21.15.72:0/3082535342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5680156a10 con 0x7f5680154060 2023-08-31T19:26:07.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.366+0000 7f56677fe700 1 -- 172.21.15.72:0/3082535342 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 85) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f567401c9c0 con 0x7f5680154060 2023-08-31T19:26:07.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.366+0000 7f56677fe700 1 --2- 172.21.15.72:0/3082535342 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f566c05f080 0x7f566c061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:07.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.366+0000 7f56677fe700 1 -- 172.21.15.72:0/3082535342 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7195+0+0 (secure 0 0 0) 0x7f567407c190 con 0x7f5680154060 2023-08-31T19:26:07.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.367+0000 7f567f7fe700 1 -- 172.21.15.72:0/3082535342 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f566c05f080 msgr2=0x7f566c061540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:07.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.367+0000 7f567f7fe700 1 --2- 172.21.15.72:0/3082535342 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f566c05f080 0x7f566c061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:07.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.370+0000 7f56677fe700 1 -- 172.21.15.72:0/3082535342 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f567404ce90 con 0x7f5680154060 2023-08-31T19:26:07.426 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:07.425+0000 7f79c3eba680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:26:07.468 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:07.468+0000 7f2daddaf680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:26:07.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.568+0000 7f567f7fe700 1 -- 172.21.15.72:0/3082535342 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f566c05f080 msgr2=0x7f566c061540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:07.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.568+0000 7f567f7fe700 1 --2- 172.21.15.72:0/3082535342 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f566c05f080 0x7f566c061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:26:07.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.592+0000 7f5685bff700 1 -- 172.21.15.72:0/3082535342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f568006c6b0 con 0x7f5680154060 2023-08-31T19:26:07.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.593+0000 7f56677fe700 1 -- 172.21.15.72:0/3082535342 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f56740504b0 con 0x7f5680154060 2023-08-31T19:26:07.593 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:07.594 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3355816598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3355816598},{"type":"v1","addr":"172.21.15.146:6833","nonce":3355816598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/197878546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":197878546},{"type":"v1","addr":"172.21.15.146:6835","nonce":197878546}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2229531329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2229531329},{"type":"v1","addr":"172.21.15.72:6836","nonce":2229531329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:24:39.509515+0000","modified":"2023-08-31T19:24:42.529652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9024":{"gid":9024,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/1822141039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1822141039},{"type":"v1","addr":"172.21.15.72:6837","nonce":1822141039}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-31T19:26:07.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.595+0000 7f5685bff700 1 -- 172.21.15.72:0/3082535342 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f566c05f080 msgr2=0x7f566c061540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:07.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.595+0000 7f5685bff700 1 --2- 172.21.15.72:0/3082535342 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f566c05f080 0x7f566c061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:07.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.595+0000 7f5685bff700 1 -- 172.21.15.72:0/3082535342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5680154060 msgr2=0x7f568014bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:07.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.595+0000 7f5685bff700 1 --2- 172.21.15.72:0/3082535342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5680154060 0x7f568014bfe0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f5674009f50 tx=0x7f5674017000).stop 2023-08-31T19:26:07.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.595+0000 7f5685bff700 1 -- 172.21.15.72:0/3082535342 shutdown_connections 2023-08-31T19:26:07.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.595+0000 7f5685bff700 1 --2- 172.21.15.72:0/3082535342 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f566c05f080 0x7f566c061540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:07.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.595+0000 7f5685bff700 1 --2- 172.21.15.72:0/3082535342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f56801588d0 0x7f56800add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.595+0000 7f5685bff700 1 --2- 172.21.15.72:0/3082535342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56800cb9b0 0x7f56800c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.595+0000 7f5685bff700 1 --2- 172.21.15.72:0/3082535342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5680154060 0x7f568014bfe0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.595+0000 7f5685bff700 1 -- 172.21.15.72:0/3082535342 >> 172.21.15.72:0/3082535342 conn(0x7f568005e870 msgr2=0x7f56800c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.595+0000 7f5685bff700 1 -- 172.21.15.72:0/3082535342 shutdown_connections 2023-08-31T19:26:07.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.595+0000 7f5685bff700 1 -- 172.21.15.72:0/3082535342 wait complete. 2023-08-31T19:26:07.598 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 79 2023-08-31T19:26:07.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:26:07.655 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:07.654+0000 7f79c3eba680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:26:07.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.806+0000 7efc665ff700 1 Processor -- start 2023-08-31T19:26:07.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.806+0000 7efc665ff700 1 -- start start 2023-08-31T19:26:07.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.809+0000 7efc665ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efc600c2450 0x7efc60150990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:07.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.809+0000 7efc665ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc600c2b10 0x7efc60150e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:07.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.809+0000 7efc665ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc600641e0 con 0x7efc601505b0 2023-08-31T19:26:07.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.809+0000 7efc665ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc60151370 con 0x7efc600c2450 2023-08-31T19:26:07.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.809+0000 7efc665ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc60068b90 con 0x7efc600c2b10 2023-08-31T19:26:07.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.809+0000 7efc5f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efc600c2450 0x7efc60150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:07.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.810+0000 7efc5f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efc600c2450 0x7efc60150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36350/0 (socket says 172.21.15.72:36350) 2023-08-31T19:26:07.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.810+0000 7efc5f7fe700 1 -- 172.21.15.72:0/1462495913 learned_addr learned my addr 172.21.15.72:0/1462495913 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:07.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.810+0000 7efc64b9c700 1 --2- 172.21.15.72:0/1462495913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc600c2b10 0x7efc60150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:07.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.810+0000 7efc5f7fe700 1 -- 172.21.15.72:0/1462495913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc600c2b10 msgr2=0x7efc60150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:07.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.810+0000 7efc5f7fe700 1 --2- 172.21.15.72:0/1462495913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc600c2b10 0x7efc60150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:07.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.810+0000 7efc5f7fe700 1 -- 172.21.15.72:0/1462495913 >> v1:172.21.15.146:6789/0 conn(0x7efc601505b0 legacy=0x7efc600c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:07.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.810+0000 7efc5effd700 1 -- 172.21.15.72:0/1462495913 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475995307 0 0) 0x7efc600641e0 con 0x7efc601505b0 2023-08-31T19:26:07.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.810+0000 7efc5f7fe700 1 -- 172.21.15.72:0/1462495913 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc60151580 con 0x7efc600c2450 2023-08-31T19:26:07.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.810+0000 7efc64b9c700 1 --2- 172.21.15.72:0/1462495913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc600c2b10 0x7efc60150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:07.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.810+0000 7efc5f7fe700 1 --2- 172.21.15.72:0/1462495913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600c2450 0x7efc60150990 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7efc54006fd0 tx=0x7efc5400b3b0).ready entity=mon.0 client_cookie=bcaedbf9851f115a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:07.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.810+0000 7efc5effd700 1 -- 172.21.15.72:0/1462495913 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5400db40 con 0x7efc600c2450 2023-08-31T19:26:07.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.810+0000 7efc5effd700 1 -- 172.21.15.72:0/1462495913 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5400dca0 con 0x7efc600c2450 2023-08-31T19:26:07.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.811+0000 7efc5effd700 1 -- 172.21.15.72:0/1462495913 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc54010680 con 0x7efc600c2450 2023-08-31T19:26:07.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.811+0000 7efc665ff700 1 -- 172.21.15.72:0/1462495913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600c2450 msgr2=0x7efc60150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:07.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.811+0000 7efc665ff700 1 --2- 172.21.15.72:0/1462495913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600c2450 0x7efc60150990 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7efc54006fd0 tx=0x7efc5400b3b0).stop 2023-08-31T19:26:07.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.811+0000 7efc665ff700 1 -- 172.21.15.72:0/1462495913 shutdown_connections 2023-08-31T19:26:07.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.811+0000 7efc665ff700 1 --2- 172.21.15.72:0/1462495913 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc600c2b10 0x7efc60150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:07.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.811+0000 7efc665ff700 1 --2- 172.21.15.72:0/1462495913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600c2450 0x7efc60150990 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:07.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.811+0000 7efc665ff700 1 -- 172.21.15.72:0/1462495913 >> 172.21.15.72:0/1462495913 conn(0x7efc600c6b10 msgr2=0x7efc600c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:07.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.811+0000 7efc665ff700 1 -- 172.21.15.72:0/1462495913 shutdown_connections 2023-08-31T19:26:07.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.811+0000 7efc665ff700 1 -- 172.21.15.72:0/1462495913 wait complete. 2023-08-31T19:26:07.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.813+0000 7efc665ff700 1 Processor -- start 2023-08-31T19:26:07.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.813+0000 7efc665ff700 1 -- start start 2023-08-31T19:26:07.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.814+0000 7efc665ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc600c2450 0x7efc600a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:07.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.814+0000 7efc665ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600c2b10 0x7efc600bdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:07.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.814+0000 7efc665ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc601505b0 0x7efc60143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:07.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.814+0000 7efc665ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc600bf090 con 0x7efc600c2b10 2023-08-31T19:26:07.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.814+0000 7efc665ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc600be480 con 0x7efc601505b0 2023-08-31T19:26:07.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.814+0000 7efc665ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc600be760 con 0x7efc600c2450 2023-08-31T19:26:07.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.814+0000 7efc5f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600c2b10 0x7efc600bdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:07.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.814+0000 7efc5f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600c2b10 0x7efc600bdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36356/0 (socket says 172.21.15.72:36356) 2023-08-31T19:26:07.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.814+0000 7efc5f7fe700 1 -- 172.21.15.72:0/1708707568 learned_addr learned my addr 172.21.15.72:0/1708707568 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:07.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.814+0000 7efc5ffff700 1 --2- 172.21.15.72:0/1708707568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc600c2450 0x7efc600a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.814+0000 7efc64b9c700 1 --2- 172.21.15.72:0/1708707568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc601505b0 0x7efc60143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.815+0000 7efc5f7fe700 1 -- 172.21.15.72:0/1708707568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc600c2450 msgr2=0x7efc600a8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.815+0000 7efc5f7fe700 1 --2- 172.21.15.72:0/1708707568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc600c2450 0x7efc600a8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.815+0000 7efc5f7fe700 1 -- 172.21.15.72:0/1708707568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc601505b0 msgr2=0x7efc60143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:07.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.815+0000 7efc5f7fe700 1 --2- 172.21.15.72:0/1708707568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc601505b0 0x7efc60143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.815+0000 7efc5f7fe700 1 -- 172.21.15.72:0/1708707568 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5400b610 con 0x7efc600c2b10 2023-08-31T19:26:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.815+0000 7efc5f7fe700 1 --2- 172.21.15.72:0/1708707568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600c2b10 0x7efc600bdc30 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7efc54013000 tx=0x7efc5400b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.815+0000 7efc47fff700 1 -- 172.21.15.72:0/1708707568 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc54019450 con 0x7efc600c2b10 2023-08-31T19:26:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.815+0000 7efc47fff700 1 -- 172.21.15.72:0/1708707568 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc540195b0 con 0x7efc600c2b10 2023-08-31T19:26:07.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.815+0000 7efc47fff700 1 -- 172.21.15.72:0/1708707568 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc54019930 con 0x7efc600c2b10 2023-08-31T19:26:07.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.815+0000 7efc665ff700 1 -- 172.21.15.72:0/1708707568 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc600bea40 con 0x7efc600c2b10 2023-08-31T19:26:07.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.815+0000 7efc665ff700 1 -- 172.21.15.72:0/1708707568 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc600be120 con 0x7efc600c2b10 2023-08-31T19:26:07.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.816+0000 7efc665ff700 1 -- 172.21.15.72:0/1708707568 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6006c6b0 con 0x7efc600c2b10 2023-08-31T19:26:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.817+0000 7efc47fff700 1 -- 172.21.15.72:0/1708707568 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 85) v1 ==== 75488+0+0 (secure 0 0 0) 0x7efc54019d20 con 0x7efc600c2b10 2023-08-31T19:26:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.818+0000 7efc47fff700 1 --2- 172.21.15.72:0/1708707568 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7efc4c05f050 0x7efc4c061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:07.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.818+0000 7efc47fff700 1 -- 172.21.15.72:0/1708707568 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7195+0+0 (secure 0 0 0) 0x7efc5407bef0 con 0x7efc600c2b10 2023-08-31T19:26:07.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.818+0000 7efc5ffff700 1 -- 172.21.15.72:0/1708707568 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7efc4c05f050 msgr2=0x7efc4c061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:07.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.818+0000 7efc5ffff700 1 --2- 172.21.15.72:0/1708707568 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7efc4c05f050 0x7efc4c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:07.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.822+0000 7efc47fff700 1 -- 172.21.15.72:0/1708707568 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efc5404ca60 con 0x7efc600c2b10 2023-08-31T19:26:07.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.998+0000 7efc665ff700 1 -- 172.21.15.72:0/1708707568 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc60151860 con 0x7efc600c2b10 2023-08-31T19:26:07.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:07.999+0000 7efc47fff700 1 -- 172.21.15.72:0/1708707568 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+18686 (secure 0 0 0) 0x7efc54028070 con 0x7efc600c2b10 2023-08-31T19:26:08.000 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:08.001 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":181,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:26:06.201013+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:24:37.934358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-31T19:24:38.492537+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":181,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.8","mappings":[{"from":4,"to":3}]},{"pgid":"22.3","mappings":[{"from":3,"to":1}]},{"pgid":"22.e","mappings":[{"from":3,"to":0}]},{"pgid":"22.2b","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/2024622836":"2023-09-01T19:24:53.092924+0000","172.21.15.72:6833/189426":"2023-09-01T19:24:53.092924+0000","172.21.15.72:6832/189426":"2023-09-01T19:24:53.092924+0000","172.21.15.72:0/1986676910":"2023-09-01T19:24:53.092924+0000","172.21.15.72:0/2275285377":"2023-09-01T19:24:53.092924+0000","172.21.15.72:0/2727550229":"2023-09-01T19:24:53.092924+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:26:08.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.001+0000 7efc665ff700 1 -- 172.21.15.72:0/1708707568 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7efc4c05f050 msgr2=0x7efc4c061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:08.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.001+0000 7efc665ff700 1 --2- 172.21.15.72:0/1708707568 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7efc4c05f050 0x7efc4c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:08.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.001+0000 7efc665ff700 1 -- 172.21.15.72:0/1708707568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600c2b10 msgr2=0x7efc600bdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:08.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.001+0000 7efc665ff700 1 --2- 172.21.15.72:0/1708707568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600c2b10 0x7efc600bdc30 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7efc54013000 tx=0x7efc5400b3b0).stop 2023-08-31T19:26:08.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.001+0000 7efc665ff700 1 -- 172.21.15.72:0/1708707568 shutdown_connections 2023-08-31T19:26:08.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.001+0000 7efc665ff700 1 --2- 172.21.15.72:0/1708707568 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7efc4c05f050 0x7efc4c061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:08.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.001+0000 7efc665ff700 1 --2- 172.21.15.72:0/1708707568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc601505b0 0x7efc60143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.001+0000 7efc665ff700 1 --2- 172.21.15.72:0/1708707568 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efc600c2450 0x7efc600a8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.001+0000 7efc665ff700 1 --2- 172.21.15.72:0/1708707568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600c2b10 0x7efc600bdc30 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.001+0000 7efc665ff700 1 -- 172.21.15.72:0/1708707568 >> 172.21.15.72:0/1708707568 conn(0x7efc600c6b10 msgr2=0x7efc60064070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.002+0000 7efc665ff700 1 -- 172.21.15.72:0/1708707568 shutdown_connections 2023-08-31T19:26:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.002+0000 7efc665ff700 1 -- 172.21.15.72:0/1708707568 wait complete. 2023-08-31T19:26:08.020 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T19:26:08.021 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:26:08.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.254+0000 7f0c609ff700 1 Processor -- start 2023-08-31T19:26:08.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.254+0000 7f0c609ff700 1 -- start start 2023-08-31T19:26:08.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.255+0000 7f0c609ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c5c152090 0x7f0c5c155460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:08.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.255+0000 7f0c609ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5c062d60 0x7f0c5c069390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:08.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.255+0000 7f0c609ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5c065940 con 0x7f0c5c0c25d0 2023-08-31T19:26:08.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.255+0000 7f0c609ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5c155950 con 0x7f0c5c152090 2023-08-31T19:26:08.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.255+0000 7f0c609ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c152470 con 0x7f0c5c062d60 2023-08-31T19:26:08.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.256+0000 7f0c59d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0c5c0c25d0 0x7f0c5c062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33736/0 (socket says 172.21.15.72:33736) 2023-08-31T19:26:08.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.256+0000 7f0c59d9b700 1 -- 172.21.15.72:0/589989034 learned_addr learned my addr 172.21.15.72:0/589989034 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:08.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.256+0000 7f0c5a59c700 1 --2- 172.21.15.72:0/589989034 >> v2:172.21.15.146:3300/0 conn(0x7f0c5c152090 0x7f0c5c155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:08.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.256+0000 7f0c5ad9d700 1 --2- 172.21.15.72:0/589989034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5c062d60 0x7f0c5c069390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:08.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.256+0000 7f0c5959a700 1 -- 172.21.15.72:0/589989034 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653640559 0 0) 0x7f0c5c065940 con 0x7f0c5c0c25d0 2023-08-31T19:26:08.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.256+0000 7f0c5959a700 1 -- 172.21.15.72:0/589989034 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c440033f0 con 0x7f0c5c0c25d0 2023-08-31T19:26:08.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.256+0000 7f0c5a59c700 1 -- 172.21.15.72:0/589989034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5c062d60 msgr2=0x7f0c5c069390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:08.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.256+0000 7f0c5a59c700 1 --2- 172.21.15.72:0/589989034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5c062d60 0x7f0c5c069390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.256+0000 7f0c5a59c700 1 -- 172.21.15.72:0/589989034 >> v1:172.21.15.72:6789/0 conn(0x7f0c5c0c25d0 legacy=0x7f0c5c062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:08.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.256+0000 7f0c5a59c700 1 -- 172.21.15.72:0/589989034 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c0a6e40 con 0x7f0c5c152090 2023-08-31T19:26:08.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.256+0000 7f0c5ad9d700 1 --2- 172.21.15.72:0/589989034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5c062d60 0x7f0c5c069390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.257+0000 7f0c5a59c700 1 --2- 172.21.15.72:0/589989034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c5c152090 0x7f0c5c155460 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f0c4c009760 tx=0x7f0c4c009060).ready entity=mon.1 client_cookie=588f37f5e30a708c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.257+0000 7f0c5959a700 1 -- 172.21.15.72:0/589989034 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c00d4a0 con 0x7f0c5c152090 2023-08-31T19:26:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.257+0000 7f0c5959a700 1 -- 172.21.15.72:0/589989034 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c00d600 con 0x7f0c5c152090 2023-08-31T19:26:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.257+0000 7f0c5959a700 1 -- 172.21.15.72:0/589989034 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c00d980 con 0x7f0c5c152090 2023-08-31T19:26:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.257+0000 7f0c609ff700 1 -- 172.21.15.72:0/589989034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c5c152090 msgr2=0x7f0c5c155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:08.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.257+0000 7f0c609ff700 1 --2- 172.21.15.72:0/589989034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c5c152090 0x7f0c5c155460 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f0c4c009760 tx=0x7f0c4c009060).stop 2023-08-31T19:26:08.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.257+0000 7f0c609ff700 1 -- 172.21.15.72:0/589989034 shutdown_connections 2023-08-31T19:26:08.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.257+0000 7f0c609ff700 1 --2- 172.21.15.72:0/589989034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c5c152090 0x7f0c5c155460 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.258+0000 7f0c609ff700 1 --2- 172.21.15.72:0/589989034 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5c062d60 0x7f0c5c069390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.258+0000 7f0c609ff700 1 -- 172.21.15.72:0/589989034 >> 172.21.15.72:0/589989034 conn(0x7f0c5c0c7c30 msgr2=0x7f0c5c0c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:08.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.258+0000 7f0c609ff700 1 -- 172.21.15.72:0/589989034 shutdown_connections 2023-08-31T19:26:08.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.258+0000 7f0c609ff700 1 -- 172.21.15.72:0/589989034 wait complete. 2023-08-31T19:26:08.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.259+0000 7f0c609ff700 1 Processor -- start 2023-08-31T19:26:08.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.259+0000 7f0c609ff700 1 -- start start 2023-08-31T19:26:08.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.260+0000 7f0c609ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c5c062d60 0x7f0c5c0abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:08.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.260+0000 7f0c609ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5c0c25d0 0x7f0c5c14b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:08.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.260+0000 7f0c609ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c5c152090 0x7f0c5c158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:08.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.260+0000 7f0c609ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c155e50 con 0x7f0c5c062d60 2023-08-31T19:26:08.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.260+0000 7f0c609ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c0ac0e0 con 0x7f0c5c152090 2023-08-31T19:26:08.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.260+0000 7f0c609ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c157440 con 0x7f0c5c0c25d0 2023-08-31T19:26:08.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.260+0000 7f0c5a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c5c062d60 0x7f0c5c0abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:08.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.261+0000 7f0c5a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c5c062d60 0x7f0c5c0abae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36372/0 (socket says 172.21.15.72:36372) 2023-08-31T19:26:08.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.261+0000 7f0c5a59c700 1 -- 172.21.15.72:0/461466634 learned_addr learned my addr 172.21.15.72:0/461466634 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:08.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.261+0000 7f0c5ad9d700 1 --2- 172.21.15.72:0/461466634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c5c152090 0x7f0c5c158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.261+0000 7f0c59d9b700 1 --2- 172.21.15.72:0/461466634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5c0c25d0 0x7f0c5c14b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.261+0000 7f0c5a59c700 1 -- 172.21.15.72:0/461466634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5c0c25d0 msgr2=0x7f0c5c14b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.261+0000 7f0c5a59c700 1 --2- 172.21.15.72:0/461466634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5c0c25d0 0x7f0c5c14b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.261+0000 7f0c5a59c700 1 -- 172.21.15.72:0/461466634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c5c152090 msgr2=0x7f0c5c158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:08.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.261+0000 7f0c5a59c700 1 --2- 172.21.15.72:0/461466634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c5c152090 0x7f0c5c158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.261+0000 7f0c5a59c700 1 -- 172.21.15.72:0/461466634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c54009a20 con 0x7f0c5c062d60 2023-08-31T19:26:08.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.261+0000 7f0c5a59c700 1 --2- 172.21.15.72:0/461466634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c5c062d60 0x7f0c5c0abae0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f0c4c009d50 tx=0x7f0c4c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:08.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.261+0000 7f0c4a7fc700 1 -- 172.21.15.72:0/461466634 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c000c90 con 0x7f0c5c062d60 2023-08-31T19:26:08.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.262+0000 7f0c4a7fc700 1 -- 172.21.15.72:0/461466634 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c00d770 con 0x7f0c5c062d60 2023-08-31T19:26:08.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.262+0000 7f0c609ff700 1 -- 172.21.15.72:0/461466634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4c0092a0 con 0x7f0c5c062d60 2023-08-31T19:26:08.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.262+0000 7f0c4a7fc700 1 -- 172.21.15.72:0/461466634 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c01d430 con 0x7f0c5c062d60 2023-08-31T19:26:08.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.262+0000 7f0c609ff700 1 -- 172.21.15.72:0/461466634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5c157a00 con 0x7f0c5c062d60 2023-08-31T19:26:08.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.263+0000 7f0c609ff700 1 -- 172.21.15.72:0/461466634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5c06c6b0 con 0x7f0c5c062d60 2023-08-31T19:26:08.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.264+0000 7f0c4a7fc700 1 -- 172.21.15.72:0/461466634 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 85) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f0c4c01d820 con 0x7f0c5c062d60 2023-08-31T19:26:08.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.265+0000 7f0c4a7fc700 1 --2- 172.21.15.72:0/461466634 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0c3c05f050 0x7f0c3c061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:08.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.265+0000 7f0c4a7fc700 1 -- 172.21.15.72:0/461466634 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7195+0+0 (secure 0 0 0) 0x7f0c4c07bf40 con 0x7f0c5c062d60 2023-08-31T19:26:08.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.265+0000 7f0c59d9b700 1 -- 172.21.15.72:0/461466634 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0c3c05f050 msgr2=0x7f0c3c061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:08.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.265+0000 7f0c59d9b700 1 --2- 172.21.15.72:0/461466634 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0c3c05f050 0x7f0c3c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:08.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.269+0000 7f0c4a7fc700 1 -- 172.21.15.72:0/461466634 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0c4c04cbc0 con 0x7f0c5c062d60 2023-08-31T19:26:08.275 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:08.275+0000 7f2daddaf680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:26:08.363 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:08.363+0000 7f2daddaf680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:26:08.457 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:08.457+0000 7f2daddaf680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:26:08.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.466+0000 7f0c59d9b700 1 -- 172.21.15.72:0/461466634 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0c3c05f050 msgr2=0x7f0c3c061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:08.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.466+0000 7f0c59d9b700 1 --2- 172.21.15.72:0/461466634 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0c3c05f050 0x7f0c3c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:26:08.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.487+0000 7f0c609ff700 1 -- 172.21.15.72:0/461466634 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c5c06a5d0 con 0x7f0c5c062d60 2023-08-31T19:26:08.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.488+0000 7f0c4a7fc700 1 -- 172.21.15.72:0/461466634 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f0c4c0501e0 con 0x7f0c5c062d60 2023-08-31T19:26:08.489 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:08.489 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3355816598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3355816598},{"type":"v1","addr":"172.21.15.146:6833","nonce":3355816598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/197878546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":197878546},{"type":"v1","addr":"172.21.15.146:6835","nonce":197878546}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2229531329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2229531329},{"type":"v1","addr":"172.21.15.72:6836","nonce":2229531329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:24:39.509515+0000","modified":"2023-08-31T19:24:42.529652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9024":{"gid":9024,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/1822141039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1822141039},{"type":"v1","addr":"172.21.15.72:6837","nonce":1822141039}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-31T19:26:08.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.490+0000 7f0c609ff700 1 -- 172.21.15.72:0/461466634 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0c3c05f050 msgr2=0x7f0c3c061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:08.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.490+0000 7f0c609ff700 1 --2- 172.21.15.72:0/461466634 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0c3c05f050 0x7f0c3c061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:08.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.490+0000 7f0c609ff700 1 -- 172.21.15.72:0/461466634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c5c062d60 msgr2=0x7f0c5c0abae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:08.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.490+0000 7f0c609ff700 1 --2- 172.21.15.72:0/461466634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c5c062d60 0x7f0c5c0abae0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f0c4c009d50 tx=0x7f0c4c016000).stop 2023-08-31T19:26:08.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.490+0000 7f0c609ff700 1 -- 172.21.15.72:0/461466634 shutdown_connections 2023-08-31T19:26:08.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.490+0000 7f0c609ff700 1 --2- 172.21.15.72:0/461466634 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f0c3c05f050 0x7f0c3c061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:08.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.490+0000 7f0c609ff700 1 --2- 172.21.15.72:0/461466634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c5c152090 0x7f0c5c158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.490+0000 7f0c609ff700 1 --2- 172.21.15.72:0/461466634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c5c062d60 0x7f0c5c0abae0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.490+0000 7f0c609ff700 1 --2- 172.21.15.72:0/461466634 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0c5c0c25d0 0x7f0c5c14b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.490+0000 7f0c609ff700 1 -- 172.21.15.72:0/461466634 >> 172.21.15.72:0/461466634 conn(0x7f0c5c0c7c30 msgr2=0x7f0c5c0c5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:08.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.491+0000 7f0c609ff700 1 -- 172.21.15.72:0/461466634 shutdown_connections 2023-08-31T19:26:08.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.491+0000 7f0c609ff700 1 -- 172.21.15.72:0/461466634 wait complete. 2023-08-31T19:26:08.494 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 79 2023-08-31T19:26:08.498 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:08.498+0000 7f79c3eba680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:26:08.508 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:26:08.600 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:08.599+0000 7f79c3eba680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:26:08.642 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:08.642+0000 7f2daddaf680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:26:08.699 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:08.698+0000 7f79c3eba680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:26:08.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.707+0000 7f34b27ff700 1 Processor -- start 2023-08-31T19:26:08.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.707+0000 7f34b27ff700 1 -- start start 2023-08-31T19:26:08.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.709+0000 7f34b27ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34ac0aa290 0x7f34ac156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:08.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.709+0000 7f34b27ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac0bfd00 con 0x7f34ac1574b0 2023-08-31T19:26:08.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.709+0000 7f34b27ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac0c05a0 con 0x7f34ac0a9eb0 2023-08-31T19:26:08.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.709+0000 7f34b27ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac0aaea0 con 0x7f34ac0aa290 2023-08-31T19:26:08.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.709+0000 7f34ab7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34ac0aa290 0x7f34ac156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:08.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.709+0000 7f34ab7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34ac0aa290 0x7f34ac156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36374/0 (socket says 172.21.15.72:36374) 2023-08-31T19:26:08.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.709+0000 7f34ab7fe700 1 -- 172.21.15.72:0/3732756341 learned_addr learned my addr 172.21.15.72:0/3732756341 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:08.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.710+0000 7f34ab7fe700 1 -- 172.21.15.72:0/3732756341 >> v1:172.21.15.146:6789/0 conn(0x7f34ac0a9eb0 legacy=0x7f34ac0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:08.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.710+0000 7f34ab7fe700 1 -- 172.21.15.72:0/3732756341 >> v1:172.21.15.72:6789/0 conn(0x7f34ac1574b0 legacy=0x7f34ac0c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:08.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.710+0000 7f34ab7fe700 1 -- 172.21.15.72:0/3732756341 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac0c6670 con 0x7f34ac0aa290 2023-08-31T19:26:08.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.710+0000 7f34ab7fe700 1 --2- 172.21.15.72:0/3732756341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac0aa290 0x7f34ac156fc0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f34a0006fd0 tx=0x7f34a00090f0).ready entity=mon.0 client_cookie=54f7bb86d493a7c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:08.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.710+0000 7f34aaffd700 1 -- 172.21.15.72:0/3732756341 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000b600 con 0x7f34ac0aa290 2023-08-31T19:26:08.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.710+0000 7f34aaffd700 1 -- 172.21.15.72:0/3732756341 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a000b760 con 0x7f34ac0aa290 2023-08-31T19:26:08.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.710+0000 7f34aaffd700 1 -- 172.21.15.72:0/3732756341 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000bae0 con 0x7f34ac0aa290 2023-08-31T19:26:08.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.711+0000 7f34b27ff700 1 -- 172.21.15.72:0/3732756341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac0aa290 msgr2=0x7f34ac156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:08.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.711+0000 7f34b27ff700 1 --2- 172.21.15.72:0/3732756341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac0aa290 0x7f34ac156fc0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f34a0006fd0 tx=0x7f34a00090f0).stop 2023-08-31T19:26:08.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.711+0000 7f34b27ff700 1 -- 172.21.15.72:0/3732756341 shutdown_connections 2023-08-31T19:26:08.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.711+0000 7f34b27ff700 1 --2- 172.21.15.72:0/3732756341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac0aa290 0x7f34ac156fc0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.711+0000 7f34b27ff700 1 -- 172.21.15.72:0/3732756341 >> 172.21.15.72:0/3732756341 conn(0x7f34ac0c82e0 msgr2=0x7f34ac05e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:08.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.711+0000 7f34b27ff700 1 -- 172.21.15.72:0/3732756341 shutdown_connections 2023-08-31T19:26:08.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.711+0000 7f34b27ff700 1 -- 172.21.15.72:0/3732756341 wait complete. 2023-08-31T19:26:08.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.712+0000 7f34b27ff700 1 Processor -- start 2023-08-31T19:26:08.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.713+0000 7f34b27ff700 1 -- start start 2023-08-31T19:26:08.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34b27ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac0a9eb0 0x7f34ac0b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:08.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34b27ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34ac0aa290 0x7f34ac14bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:08.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34b27ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34ac1574b0 0x7f34ac0c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:08.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34b27ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0add50 con 0x7f34ac0a9eb0 2023-08-31T19:26:08.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34b27ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac14c720 con 0x7f34ac1574b0 2023-08-31T19:26:08.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34b27ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac14ca00 con 0x7f34ac0aa290 2023-08-31T19:26:08.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34abfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac0a9eb0 0x7f34ac0b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:08.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34abfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac0a9eb0 0x7f34ac0b0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36382/0 (socket says 172.21.15.72:36382) 2023-08-31T19:26:08.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34abfff700 1 -- 172.21.15.72:0/1346844113 learned_addr learned my addr 172.21.15.72:0/1346844113 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:08.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34ab7fe700 1 --2- 172.21.15.72:0/1346844113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34ac0aa290 0x7f34ac14bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:08.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34b0d9c700 1 --2- 172.21.15.72:0/1346844113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34ac1574b0 0x7f34ac0c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:08.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34abfff700 1 -- 172.21.15.72:0/1346844113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34ac0aa290 msgr2=0x7f34ac14bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:08.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34abfff700 1 --2- 172.21.15.72:0/1346844113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34ac0aa290 0x7f34ac14bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34abfff700 1 -- 172.21.15.72:0/1346844113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34ac1574b0 msgr2=0x7f34ac0c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:08.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34abfff700 1 --2- 172.21.15.72:0/1346844113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34ac1574b0 0x7f34ac0c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.714+0000 7f34abfff700 1 -- 172.21.15.72:0/1346844113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a0009370 con 0x7f34ac0a9eb0 2023-08-31T19:26:08.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.715+0000 7f34abfff700 1 --2- 172.21.15.72:0/1346844113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac0a9eb0 0x7f34ac0b0b60 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f349c00c4c0 tx=0x7f349c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:08.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.715+0000 7f3493fff700 1 -- 172.21.15.72:0/1346844113 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c007020 con 0x7f34ac0a9eb0 2023-08-31T19:26:08.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.715+0000 7f3493fff700 1 -- 172.21.15.72:0/1346844113 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c001e90 con 0x7f34ac0a9eb0 2023-08-31T19:26:08.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.715+0000 7f3493fff700 1 -- 172.21.15.72:0/1346844113 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0073b0 con 0x7f34ac0a9eb0 2023-08-31T19:26:08.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.715+0000 7f34b27ff700 1 -- 172.21.15.72:0/1346844113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac14cce0 con 0x7f34ac0a9eb0 2023-08-31T19:26:08.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.715+0000 7f34b27ff700 1 -- 172.21.15.72:0/1346844113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac14c3c0 con 0x7f34ac0a9eb0 2023-08-31T19:26:08.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.716+0000 7f34b27ff700 1 -- 172.21.15.72:0/1346844113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac14ced0 con 0x7f34ac0a9eb0 2023-08-31T19:26:08.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.717+0000 7f3493fff700 1 -- 172.21.15.72:0/1346844113 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 85) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f349c0068b0 con 0x7f34ac0a9eb0 2023-08-31T19:26:08.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.718+0000 7f3493fff700 1 --2- 172.21.15.72:0/1346844113 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f349805f050 0x7f3498061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:08.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.718+0000 7f3493fff700 1 -- 172.21.15.72:0/1346844113 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7195+0+0 (secure 0 0 0) 0x7f349c079f60 con 0x7f34ac0a9eb0 2023-08-31T19:26:08.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.718+0000 7f34ab7fe700 1 -- 172.21.15.72:0/1346844113 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f349805f050 msgr2=0x7f3498061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:08.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.718+0000 7f34ab7fe700 1 --2- 172.21.15.72:0/1346844113 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f349805f050 0x7f3498061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:08.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.722+0000 7f3493fff700 1 -- 172.21.15.72:0/1346844113 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f349c04abe0 con 0x7f34ac0a9eb0 2023-08-31T19:26:08.731 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:08.731+0000 7f2daddaf680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:26:08.873 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:08.872+0000 7f2daddaf680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:26:08.891 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:08.891+0000 7f79c3eba680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:26:08.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.919+0000 7f34ab7fe700 1 -- 172.21.15.72:0/1346844113 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f349805f050 msgr2=0x7f3498061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:08.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.919+0000 7f34ab7fe700 1 --2- 172.21.15.72:0/1346844113 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f349805f050 0x7f3498061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:26:08.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.940+0000 7f34b27ff700 1 -- 172.21.15.72:0/1346844113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34ac06c6b0 con 0x7f34ac0a9eb0 2023-08-31T19:26:08.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.940+0000 7f3493fff700 1 -- 172.21.15.72:0/1346844113 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f349c04e200 con 0x7f34ac0a9eb0 2023-08-31T19:26:08.941 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:08.941 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":79,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3355816598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3355816598},{"type":"v1","addr":"172.21.15.146:6833","nonce":3355816598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/197878546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":197878546},{"type":"v1","addr":"172.21.15.146:6835","nonce":197878546}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2229531329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2229531329},{"type":"v1","addr":"172.21.15.72:6836","nonce":2229531329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:24:39.509515+0000","modified":"2023-08-31T19:24:42.529652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9024":{"gid":9024,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/1822141039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1822141039},{"type":"v1","addr":"172.21.15.72:6837","nonce":1822141039}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-31T19:26:08.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.942+0000 7f34b27ff700 1 -- 172.21.15.72:0/1346844113 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f349805f050 msgr2=0x7f3498061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:08.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.942+0000 7f34b27ff700 1 --2- 172.21.15.72:0/1346844113 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f349805f050 0x7f3498061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:08.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.942+0000 7f34b27ff700 1 -- 172.21.15.72:0/1346844113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac0a9eb0 msgr2=0x7f34ac0b0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:08.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.942+0000 7f34b27ff700 1 --2- 172.21.15.72:0/1346844113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac0a9eb0 0x7f34ac0b0b60 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f349c00c4c0 tx=0x7f349c007e00).stop 2023-08-31T19:26:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.942+0000 7f34b27ff700 1 -- 172.21.15.72:0/1346844113 shutdown_connections 2023-08-31T19:26:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.942+0000 7f34b27ff700 1 --2- 172.21.15.72:0/1346844113 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f349805f050 0x7f3498061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.942+0000 7f34b27ff700 1 --2- 172.21.15.72:0/1346844113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34ac1574b0 0x7f34ac0c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.942+0000 7f34b27ff700 1 --2- 172.21.15.72:0/1346844113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac0a9eb0 0x7f34ac0b0b60 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.942+0000 7f34b27ff700 1 --2- 172.21.15.72:0/1346844113 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f34ac0aa290 0x7f34ac14bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.942+0000 7f34b27ff700 1 -- 172.21.15.72:0/1346844113 >> 172.21.15.72:0/1346844113 conn(0x7f34ac0c82e0 msgr2=0x7f34ac0ab9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.943+0000 7f34b27ff700 1 -- 172.21.15.72:0/1346844113 shutdown_connections 2023-08-31T19:26:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:08.943+0000 7f34b27ff700 1 -- 172.21.15.72:0/1346844113 wait complete. 2023-08-31T19:26:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 79 2023-08-31T19:26:08.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:26:08.986 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:08.985+0000 7f79c3eba680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:26:09.004 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:09.003+0000 7f2daddaf680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:26:09.133 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:09.133+0000 7f79c3eba680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:26:09.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.153+0000 7fa8ea1ff700 1 Processor -- start 2023-08-31T19:26:09.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.153+0000 7fa8ea1ff700 1 -- start start 2023-08-31T19:26:09.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.154+0000 7fa8ea1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa8e4154220 0x7fa8e4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:09.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.154+0000 7fa8ea1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8e40cb940 0x7fa8e41581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:09.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.154+0000 7fa8ea1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e4158b40 con 0x7fa8e41586b0 2023-08-31T19:26:09.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.154+0000 7fa8ea1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e40aa700 con 0x7fa8e4154220 2023-08-31T19:26:09.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.154+0000 7fa8ea1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40c5e10 con 0x7fa8e40cb940 2023-08-31T19:26:09.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.155+0000 7fa8e3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa8e41586b0 0x7fa8e4154600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33752/0 (socket says 172.21.15.72:33752) 2023-08-31T19:26:09.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.155+0000 7fa8e3fff700 1 -- 172.21.15.72:0/2356710129 learned_addr learned my addr 172.21.15.72:0/2356710129 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:09.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.155+0000 7fa8e2ffd700 1 --2- 172.21.15.72:0/2356710129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8e40cb940 0x7fa8e41581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:09.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.155+0000 7fa8e37fe700 1 --2- 172.21.15.72:0/2356710129 >> v2:172.21.15.146:3300/0 conn(0x7fa8e4154220 0x7fa8e4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:09.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.155+0000 7fa8e27fc700 1 -- 172.21.15.72:0/2356710129 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439997133 0 0) 0x7fa8dc001490 con 0x7fa8e41586b0 2023-08-31T19:26:09.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.155+0000 7fa8e27fc700 1 -- 172.21.15.72:0/2356710129 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8cc0033f0 con 0x7fa8e41586b0 2023-08-31T19:26:09.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.155+0000 7fa8e2ffd700 1 -- 172.21.15.72:0/2356710129 >> v2:172.21.15.146:3300/0 conn(0x7fa8e4154220 msgr2=0x7fa8e4157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:09.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.155+0000 7fa8e2ffd700 1 --2- 172.21.15.72:0/2356710129 >> v2:172.21.15.146:3300/0 conn(0x7fa8e4154220 0x7fa8e4157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:09.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.155+0000 7fa8e2ffd700 1 -- 172.21.15.72:0/2356710129 >> v1:172.21.15.72:6789/0 conn(0x7fa8e41586b0 legacy=0x7fa8e4154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:09.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.155+0000 7fa8e2ffd700 1 -- 172.21.15.72:0/2356710129 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40c8c90 con 0x7fa8e40cb940 2023-08-31T19:26:09.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.155+0000 7fa8e37fe700 1 --2- 172.21.15.72:0/2356710129 >> v2:172.21.15.146:3300/0 conn(0x7fa8e4154220 0x7fa8e4157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:09.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.156+0000 7fa8e2ffd700 1 --2- 172.21.15.72:0/2356710129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8e40cb940 0x7fa8e41581c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fa8d8009790 tx=0x7fa8d8009060).ready entity=mon.2 client_cookie=6120fe72f5bfd078 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:09.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.156+0000 7fa8e27fc700 1 -- 172.21.15.72:0/2356710129 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d800d4a0 con 0x7fa8e40cb940 2023-08-31T19:26:09.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.156+0000 7fa8e27fc700 1 -- 172.21.15.72:0/2356710129 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d800d600 con 0x7fa8e40cb940 2023-08-31T19:26:09.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.156+0000 7fa8e27fc700 1 -- 172.21.15.72:0/2356710129 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d800d980 con 0x7fa8e40cb940 2023-08-31T19:26:09.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.156+0000 7fa8ea1ff700 1 -- 172.21.15.72:0/2356710129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8e40cb940 msgr2=0x7fa8e41581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:09.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.156+0000 7fa8ea1ff700 1 --2- 172.21.15.72:0/2356710129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8e40cb940 0x7fa8e41581c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fa8d8009790 tx=0x7fa8d8009060).stop 2023-08-31T19:26:09.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.156+0000 7fa8ea1ff700 1 -- 172.21.15.72:0/2356710129 shutdown_connections 2023-08-31T19:26:09.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.156+0000 7fa8ea1ff700 1 --2- 172.21.15.72:0/2356710129 >> v2:172.21.15.146:3300/0 conn(0x7fa8e4154220 0x7fa8e4157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:09.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.156+0000 7fa8ea1ff700 1 --2- 172.21.15.72:0/2356710129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8e40cb940 0x7fa8e41581c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:09.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.156+0000 7fa8ea1ff700 1 -- 172.21.15.72:0/2356710129 >> 172.21.15.72:0/2356710129 conn(0x7fa8e405e870 msgr2=0x7fa8e40cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:09.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.156+0000 7fa8ea1ff700 1 -- 172.21.15.72:0/2356710129 shutdown_connections 2023-08-31T19:26:09.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.157+0000 7fa8ea1ff700 1 -- 172.21.15.72:0/2356710129 wait complete. 2023-08-31T19:26:09.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.158+0000 7fa8ea1ff700 1 Processor -- start 2023-08-31T19:26:09.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.158+0000 7fa8ea1ff700 1 -- start start 2023-08-31T19:26:09.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.159+0000 7fa8ea1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8e40cb940 0x7fa8e40ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:09.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.159+0000 7fa8ea1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8e4154220 0x7fa8e4167a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:09.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.159+0000 7fa8ea1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8e41586b0 0x7fa8e413f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:09.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.159+0000 7fa8ea1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e4150330 con 0x7fa8e40cb940 2023-08-31T19:26:09.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.159+0000 7fa8ea1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e41680f0 con 0x7fa8e4154220 2023-08-31T19:26:09.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.159+0000 7fa8ea1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e41683d0 con 0x7fa8e41586b0 2023-08-31T19:26:09.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.159+0000 7fa8e37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8e40cb940 0x7fa8e40ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:09.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.159+0000 7fa8e37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8e40cb940 0x7fa8e40ae700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36398/0 (socket says 172.21.15.72:36398) 2023-08-31T19:26:09.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.159+0000 7fa8e37fe700 1 -- 172.21.15.72:0/4183657512 learned_addr learned my addr 172.21.15.72:0/4183657512 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:09.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.159+0000 7fa8e2ffd700 1 --2- 172.21.15.72:0/4183657512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8e4154220 0x7fa8e4167a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:09.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.159+0000 7fa8e3fff700 1 --2- 172.21.15.72:0/4183657512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8e41586b0 0x7fa8e413f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:09.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.160+0000 7fa8e37fe700 1 -- 172.21.15.72:0/4183657512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8e41586b0 msgr2=0x7fa8e413f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:09.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.160+0000 7fa8e37fe700 1 --2- 172.21.15.72:0/4183657512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8e41586b0 0x7fa8e413f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:09.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.160+0000 7fa8e37fe700 1 -- 172.21.15.72:0/4183657512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8e4154220 msgr2=0x7fa8e4167a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:09.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.160+0000 7fa8e37fe700 1 --2- 172.21.15.72:0/4183657512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8e4154220 0x7fa8e4167a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:09.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.160+0000 7fa8e37fe700 1 -- 172.21.15.72:0/4183657512 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d4009250 con 0x7fa8e40cb940 2023-08-31T19:26:09.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.160+0000 7fa8e3fff700 1 --2- 172.21.15.72:0/4183657512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8e41586b0 0x7fa8e413f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:09.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.160+0000 7fa8e2ffd700 1 --2- 172.21.15.72:0/4183657512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8e4154220 0x7fa8e4167a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:09.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.160+0000 7fa8e37fe700 1 --2- 172.21.15.72:0/4183657512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8e40cb940 0x7fa8e40ae700 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7fa8d400ec80 tx=0x7fa8d4006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:09.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.160+0000 7fa8cb7fe700 1 -- 172.21.15.72:0/4183657512 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40096a0 con 0x7fa8e40cb940 2023-08-31T19:26:09.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.160+0000 7fa8cb7fe700 1 -- 172.21.15.72:0/4183657512 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d400c9d0 con 0x7fa8e40cb940 2023-08-31T19:26:09.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.160+0000 7fa8cb7fe700 1 -- 172.21.15.72:0/4183657512 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d400cd50 con 0x7fa8e40cb940 2023-08-31T19:26:09.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.160+0000 7fa8ea1ff700 1 -- 172.21.15.72:0/4183657512 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d80092a0 con 0x7fa8e40cb940 2023-08-31T19:26:09.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.160+0000 7fa8ea1ff700 1 -- 172.21.15.72:0/4183657512 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e40c6570 con 0x7fa8e40cb940 2023-08-31T19:26:09.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.162+0000 7fa8ea1ff700 1 -- 172.21.15.72:0/4183657512 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e40c6790 con 0x7fa8e40cb940 2023-08-31T19:26:09.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.162+0000 7fa8cb7fe700 1 -- 172.21.15.72:0/4183657512 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 85) v1 ==== 75488+0+0 (secure 0 0 0) 0x7fa8d4005a90 con 0x7fa8e40cb940 2023-08-31T19:26:09.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.163+0000 7fa8cb7fe700 1 --2- 172.21.15.72:0/4183657512 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa8d005f080 0x7fa8d0061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:09.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.163+0000 7fa8cb7fe700 1 -- 172.21.15.72:0/4183657512 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7195+0+0 (secure 0 0 0) 0x7fa8d407a7b0 con 0x7fa8e40cb940 2023-08-31T19:26:09.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.163+0000 7fa8e2ffd700 1 -- 172.21.15.72:0/4183657512 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa8d005f080 msgr2=0x7fa8d0061540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:09.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.163+0000 7fa8e2ffd700 1 --2- 172.21.15.72:0/4183657512 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa8d005f080 0x7fa8d0061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:09.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.167+0000 7fa8cb7fe700 1 -- 172.21.15.72:0/4183657512 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa8d404b4f0 con 0x7fa8e40cb940 2023-08-31T19:26:09.274 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:09.274+0000 7f79c3eba680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:26:09.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.347+0000 7fa8ea1ff700 1 -- 172.21.15.72:0/4183657512 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8e406c6b0 con 0x7fa8e40cb940 2023-08-31T19:26:09.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.348+0000 7fa8cb7fe700 1 -- 172.21.15.72:0/4183657512 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+18686 (secure 0 0 0) 0x7fa8d4016090 con 0x7fa8e40cb940 2023-08-31T19:26:09.349 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:09.349 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":181,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:26:06.201013+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:24:37.934358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-31T19:24:38.492537+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":181,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.8","mappings":[{"from":4,"to":3}]},{"pgid":"22.3","mappings":[{"from":3,"to":1}]},{"pgid":"22.e","mappings":[{"from":3,"to":0}]},{"pgid":"22.2b","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/2024622836":"2023-09-01T19:24:53.092924+0000","172.21.15.72:6833/189426":"2023-09-01T19:24:53.092924+0000","172.21.15.72:6832/189426":"2023-09-01T19:24:53.092924+0000","172.21.15.72:0/1986676910":"2023-09-01T19:24:53.092924+0000","172.21.15.72:0/2275285377":"2023-09-01T19:24:53.092924+0000","172.21.15.72:0/2727550229":"2023-09-01T19:24:53.092924+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:26:09.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.350+0000 7fa8ea1ff700 1 -- 172.21.15.72:0/4183657512 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa8d005f080 msgr2=0x7fa8d0061540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:09.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.350+0000 7fa8ea1ff700 1 --2- 172.21.15.72:0/4183657512 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa8d005f080 0x7fa8d0061540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:09.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.350+0000 7fa8ea1ff700 1 -- 172.21.15.72:0/4183657512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8e40cb940 msgr2=0x7fa8e40ae700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:09.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.350+0000 7fa8ea1ff700 1 --2- 172.21.15.72:0/4183657512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8e40cb940 0x7fa8e40ae700 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7fa8d400ec80 tx=0x7fa8d4006f40).stop 2023-08-31T19:26:09.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.351+0000 7fa8ea1ff700 1 -- 172.21.15.72:0/4183657512 shutdown_connections 2023-08-31T19:26:09.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.351+0000 7fa8ea1ff700 1 --2- 172.21.15.72:0/4183657512 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa8d005f080 0x7fa8d0061540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:09.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.351+0000 7fa8ea1ff700 1 --2- 172.21.15.72:0/4183657512 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa8e41586b0 0x7fa8e413f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:09.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.351+0000 7fa8ea1ff700 1 --2- 172.21.15.72:0/4183657512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8e40cb940 0x7fa8e40ae700 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:09.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.351+0000 7fa8ea1ff700 1 --2- 172.21.15.72:0/4183657512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8e4154220 0x7fa8e4167a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:09.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.351+0000 7fa8ea1ff700 1 -- 172.21.15.72:0/4183657512 >> 172.21.15.72:0/4183657512 conn(0x7fa8e405e870 msgr2=0x7fa8e41533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:09.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.351+0000 7fa8ea1ff700 1 -- 172.21.15.72:0/4183657512 shutdown_connections 2023-08-31T19:26:09.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.351+0000 7fa8ea1ff700 1 -- 172.21.15.72:0/4183657512 wait complete. 2023-08-31T19:26:09.354 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:09.353+0000 7f2daddaf680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:26:09.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T19:26:09.441 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:09.441+0000 7f2daddaf680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:26:09.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.606+0000 7f4a84bff700 1 Processor -- start 2023-08-31T19:26:09.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.607+0000 7f4a84bff700 1 -- start start 2023-08-31T19:26:09.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.608+0000 7f4a84bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4a801580c0 0x7f4a800bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:09.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.608+0000 7f4a84bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a80069410 0x7f4a801584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:09.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.608+0000 7f4a84bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a80069890 con 0x7f4a80158990 2023-08-31T19:26:09.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.608+0000 7f4a84bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a80069ae0 con 0x7f4a801580c0 2023-08-31T19:26:09.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.608+0000 7f4a84bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a80062880 con 0x7f4a80069410 2023-08-31T19:26:09.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.608+0000 7f4a7e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4a801580c0 0x7f4a800bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:09.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.608+0000 7f4a7e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4a801580c0 0x7f4a800bc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36414/0 (socket says 172.21.15.72:36414) 2023-08-31T19:26:09.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.608+0000 7f4a7e59c700 1 -- 172.21.15.72:0/1253247091 learned_addr learned my addr 172.21.15.72:0/1253247091 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:09.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.609+0000 7f4a7dd9b700 1 --2- 172.21.15.72:0/1253247091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a80069410 0x7f4a801584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:09.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.609+0000 7f4a7e59c700 1 -- 172.21.15.72:0/1253247091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a80069410 msgr2=0x7f4a801584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:09.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.609+0000 7f4a7e59c700 1 --2- 172.21.15.72:0/1253247091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a80069410 0x7f4a801584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:09.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.609+0000 7f4a7e59c700 1 -- 172.21.15.72:0/1253247091 >> v1:172.21.15.72:6789/0 conn(0x7f4a80158990 legacy=0x7f4a80153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:09.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.609+0000 7f4a7e59c700 1 -- 172.21.15.72:0/1253247091 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a80063f50 con 0x7f4a801580c0 2023-08-31T19:26:09.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.609+0000 7f4a7e59c700 1 --2- 172.21.15.72:0/1253247091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a801580c0 0x7f4a800bc300 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7f4a70006fd0 tx=0x7f4a700090f0).ready entity=mon.0 client_cookie=aab0910db14692ad server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:09.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.609+0000 7f4a7d59a700 1 -- 172.21.15.72:0/1253247091 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70009160 con 0x7f4a801580c0 2023-08-31T19:26:09.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.609+0000 7f4a7d59a700 1 -- 172.21.15.72:0/1253247091 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7000b600 con 0x7f4a801580c0 2023-08-31T19:26:09.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.609+0000 7f4a7d59a700 1 -- 172.21.15.72:0/1253247091 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7000b9a0 con 0x7f4a801580c0 2023-08-31T19:26:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.610+0000 7f4a84bff700 1 -- 172.21.15.72:0/1253247091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a801580c0 msgr2=0x7f4a800bc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.610+0000 7f4a84bff700 1 --2- 172.21.15.72:0/1253247091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a801580c0 0x7f4a800bc300 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7f4a70006fd0 tx=0x7f4a700090f0).stop 2023-08-31T19:26:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.610+0000 7f4a84bff700 1 -- 172.21.15.72:0/1253247091 shutdown_connections 2023-08-31T19:26:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.610+0000 7f4a84bff700 1 --2- 172.21.15.72:0/1253247091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a801580c0 0x7f4a800bc300 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.610+0000 7f4a84bff700 1 --2- 172.21.15.72:0/1253247091 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a80069410 0x7f4a801584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.610+0000 7f4a84bff700 1 -- 172.21.15.72:0/1253247091 >> 172.21.15.72:0/1253247091 conn(0x7f4a800c73a0 msgr2=0x7f4a800c77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.610+0000 7f4a84bff700 1 -- 172.21.15.72:0/1253247091 shutdown_connections 2023-08-31T19:26:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.610+0000 7f4a84bff700 1 -- 172.21.15.72:0/1253247091 wait complete. 2023-08-31T19:26:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.611+0000 7f4a84bff700 1 Processor -- start 2023-08-31T19:26:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.612+0000 7f4a84bff700 1 -- start start 2023-08-31T19:26:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.612+0000 7f4a84bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a80069410 0x7f4a800c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a84bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a801580c0 0x7f4a80154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a84bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a80158990 0x7f4a801554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a84bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a80168b50 con 0x7f4a80158990 2023-08-31T19:26:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a84bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a80168260 con 0x7f4a801580c0 2023-08-31T19:26:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a84bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a800c0110 con 0x7f4a80069410 2023-08-31T19:26:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a7ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a80158990 0x7f4a801554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a7ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a80158990 0x7f4a801554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36430/0 (socket says 172.21.15.72:36430) 2023-08-31T19:26:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a7e59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a80069410 0x7f4a800c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a7ed9d700 1 -- 172.21.15.72:0/3116881817 learned_addr learned my addr 172.21.15.72:0/3116881817 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:09.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a7dd9b700 1 --2- 172.21.15.72:0/3116881817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a801580c0 0x7f4a80154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:09.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a7ed9d700 1 -- 172.21.15.72:0/3116881817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a80069410 msgr2=0x7f4a800c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:09.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a7ed9d700 1 --2- 172.21.15.72:0/3116881817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a80069410 0x7f4a800c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:09.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a7ed9d700 1 -- 172.21.15.72:0/3116881817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a801580c0 msgr2=0x7f4a80154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:09.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a7ed9d700 1 --2- 172.21.15.72:0/3116881817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a801580c0 0x7f4a80154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:09.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a7ed9d700 1 -- 172.21.15.72:0/3116881817 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a70009310 con 0x7f4a80158990 2023-08-31T19:26:09.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.613+0000 7f4a7ed9d700 1 --2- 172.21.15.72:0/3116881817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a80158990 0x7f4a801554a0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f4a78002230 tx=0x7f4a780015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:09.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.614+0000 7f4a6e7fc700 1 -- 172.21.15.72:0/3116881817 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7800e4a0 con 0x7f4a80158990 2023-08-31T19:26:09.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.614+0000 7f4a6e7fc700 1 -- 172.21.15.72:0/3116881817 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7800e600 con 0x7f4a80158990 2023-08-31T19:26:09.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.614+0000 7f4a6e7fc700 1 -- 172.21.15.72:0/3116881817 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7800e980 con 0x7f4a80158990 2023-08-31T19:26:09.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.614+0000 7f4a84bff700 1 -- 172.21.15.72:0/3116881817 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a80168500 con 0x7f4a80158990 2023-08-31T19:26:09.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.614+0000 7f4a84bff700 1 -- 172.21.15.72:0/3116881817 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a80168fe0 con 0x7f4a80158990 2023-08-31T19:26:09.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.615+0000 7f4a84bff700 1 -- 172.21.15.72:0/3116881817 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a800640e0 con 0x7f4a80158990 2023-08-31T19:26:09.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.616+0000 7f4a6e7fc700 1 -- 172.21.15.72:0/3116881817 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 85) v1 ==== 75488+0+0 (secure 0 0 0) 0x7f4a7801b3b0 con 0x7f4a80158990 2023-08-31T19:26:09.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.617+0000 7f4a6e7fc700 1 --2- 172.21.15.72:0/3116881817 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4a6005f050 0x7f4a60061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:09.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.617+0000 7f4a7e59c700 1 -- 172.21.15.72:0/3116881817 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4a6005f050 msgr2=0x7f4a60061510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:09.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.617+0000 7f4a6e7fc700 1 -- 172.21.15.72:0/3116881817 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7195+0+0 (secure 0 0 0) 0x7f4a78079c90 con 0x7f4a80158990 2023-08-31T19:26:09.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.617+0000 7f4a7e59c700 1 --2- 172.21.15.72:0/3116881817 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4a6005f050 0x7f4a60061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:09.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.621+0000 7f4a6e7fc700 1 -- 172.21.15.72:0/3116881817 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4a780488f0 con 0x7f4a80158990 2023-08-31T19:26:09.642 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:09.642+0000 7f79c3eba680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:26:09.733 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:09.732+0000 7f79c3eba680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:26:09.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.741+0000 7f4a6e7fc700 1 -- 172.21.15.72:0/3116881817 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 86) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f4a78077330 con 0x7f4a80158990 2023-08-31T19:26:09.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.741+0000 7f4a6e7fc700 1 -- 172.21.15.72:0/3116881817 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4a6005f050 msgr2=0x7f4a60061510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:09.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.741+0000 7f4a6e7fc700 1 --2- 172.21.15.72:0/3116881817 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4a6005f050 0x7f4a60061510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:09.818 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:09.817+0000 7f793e991700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:09.818 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:09.817+0000 7f793e991700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:09.818 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:09.817+0000 7f793e991700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:09.819 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:09.817+0000 7f793e991700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:09.819 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:09.817+0000 7f793e991700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:09.819 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:09.817+0000 7f793b98b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:09.819 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:09.817+0000 7f793b98b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:09.819 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:09.817+0000 7f793b98b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:09.820 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:09.817+0000 7f793b98b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:09.820 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:09.817+0000 7f793b98b700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:09.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:09.859+0000 7f4a84bff700 1 -- 172.21.15.72:0/3116881817 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4a800640e0 con 0x7f4a80158990 2023-08-31T19:26:10.738 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-08-31T19:26:10.738+0000 7f89d2ff7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T19:26:10.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.742+0000 7f4a6e7fc700 1 -- 172.21.15.72:0/3116881817 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v80) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4a800640e0 con 0x7f4a80158990 2023-08-31T19:26:10.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.746+0000 7f4a84bff700 1 -- 172.21.15.72:0/3116881817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a80158990 msgr2=0x7f4a801554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:10.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.746+0000 7f4a84bff700 1 --2- 172.21.15.72:0/3116881817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a80158990 0x7f4a801554a0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f4a78002230 tx=0x7f4a780015e0).stop 2023-08-31T19:26:10.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.746+0000 7f4a84bff700 1 -- 172.21.15.72:0/3116881817 shutdown_connections 2023-08-31T19:26:10.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.746+0000 7f4a84bff700 1 --2- 172.21.15.72:0/3116881817 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4a6005f050 0x7f4a60061510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:10.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.746+0000 7f4a84bff700 1 --2- 172.21.15.72:0/3116881817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a80158990 0x7f4a801554a0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:10.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.746+0000 7f4a84bff700 1 --2- 172.21.15.72:0/3116881817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a80069410 0x7f4a800c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:10.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.746+0000 7f4a84bff700 1 --2- 172.21.15.72:0/3116881817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a801580c0 0x7f4a80154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:10.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.746+0000 7f4a84bff700 1 -- 172.21.15.72:0/3116881817 >> 172.21.15.72:0/3116881817 conn(0x7f4a800c73a0 msgr2=0x7f4a800c4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:10.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.746+0000 7f4a84bff700 1 -- 172.21.15.72:0/3116881817 shutdown_connections 2023-08-31T19:26:10.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.746+0000 7f4a84bff700 1 -- 172.21.15.72:0/3116881817 wait complete. 2023-08-31T19:26:10.748 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T19:26:10.774 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T19:26:10.812 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-31T19:26:10.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.972+0000 7f471ddff700 1 Processor -- start 2023-08-31T19:26:10.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.972+0000 7f471ddff700 1 -- start start 2023-08-31T19:26:10.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.973+0000 7f471ddff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4718154030 0x7f4718154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:10.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.973+0000 7f471ddff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f47180c06b0 0x7f47180c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:10.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.973+0000 7f471ddff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47180aa140 0x7f4718063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:10.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.973+0000 7f471ddff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47180c66e0 con 0x7f4718154030 2023-08-31T19:26:10.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.973+0000 7f471ddff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47180c6ed0 con 0x7f47180c06b0 2023-08-31T19:26:10.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.973+0000 7f471ddff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47180c68c0 con 0x7f47180aa140 2023-08-31T19:26:10.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.973+0000 7f47177fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4718154030 0x7f4718154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:10.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.973+0000 7f47177fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4718154030 0x7f4718154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36548/0 (socket says 172.21.15.72:36548) 2023-08-31T19:26:10.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.973+0000 7f47177fe700 1 -- 172.21.15.72:0/288804770 learned_addr learned my addr 172.21.15.72:0/288804770 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:10.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.974+0000 7f4716ffd700 1 --2- 172.21.15.72:0/288804770 >> v2:172.21.15.146:3300/0 conn(0x7f47180c06b0 0x7f47180c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:10.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.974+0000 7f4717fff700 1 --2- 172.21.15.72:0/288804770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47180aa140 0x7f4718063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:10.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.974+0000 7f47177fe700 1 -- 172.21.15.72:0/288804770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47180aa140 msgr2=0x7f4718063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:10.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.974+0000 7f47177fe700 1 --2- 172.21.15.72:0/288804770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47180aa140 0x7f4718063120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:10.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.974+0000 7f47177fe700 1 -- 172.21.15.72:0/288804770 >> v2:172.21.15.146:3300/0 conn(0x7f47180c06b0 msgr2=0x7f47180c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:10.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.974+0000 7f47177fe700 1 --2- 172.21.15.72:0/288804770 >> v2:172.21.15.146:3300/0 conn(0x7f47180c06b0 0x7f47180c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:10.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.974+0000 7f47177fe700 1 -- 172.21.15.72:0/288804770 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47180c0f30 con 0x7f4718154030 2023-08-31T19:26:10.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.974+0000 7f4716ffd700 1 --2- 172.21.15.72:0/288804770 >> v2:172.21.15.146:3300/0 conn(0x7f47180c06b0 0x7f47180c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:10.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.974+0000 7f47177fe700 1 --2- 172.21.15.72:0/288804770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4718154030 0x7f4718154410 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f47180cb6d0 tx=0x7f47080090f0).ready entity=mon.0 client_cookie=a9b8cbce9fb85079 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:10.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.974+0000 7f47167fc700 1 -- 172.21.15.72:0/288804770 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470800b600 con 0x7f4718154030 2023-08-31T19:26:10.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.974+0000 7f47167fc700 1 -- 172.21.15.72:0/288804770 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470800b760 con 0x7f4718154030 2023-08-31T19:26:10.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.974+0000 7f47167fc700 1 -- 172.21.15.72:0/288804770 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470800bae0 con 0x7f4718154030 2023-08-31T19:26:10.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.975+0000 7f471ddff700 1 -- 172.21.15.72:0/288804770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4718154030 msgr2=0x7f4718154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:10.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.975+0000 7f471ddff700 1 --2- 172.21.15.72:0/288804770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4718154030 0x7f4718154410 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f47180cb6d0 tx=0x7f47080090f0).stop 2023-08-31T19:26:10.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.975+0000 7f471ddff700 1 -- 172.21.15.72:0/288804770 shutdown_connections 2023-08-31T19:26:10.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.975+0000 7f471ddff700 1 --2- 172.21.15.72:0/288804770 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47180aa140 0x7f4718063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:10.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.975+0000 7f471ddff700 1 --2- 172.21.15.72:0/288804770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4718154030 0x7f4718154410 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:10.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.975+0000 7f471ddff700 1 --2- 172.21.15.72:0/288804770 >> v2:172.21.15.146:3300/0 conn(0x7f47180c06b0 0x7f47180c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:10.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.975+0000 7f471ddff700 1 -- 172.21.15.72:0/288804770 >> 172.21.15.72:0/288804770 conn(0x7f471805eb60 msgr2=0x7f47180cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:10.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.975+0000 7f471ddff700 1 -- 172.21.15.72:0/288804770 shutdown_connections 2023-08-31T19:26:10.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.975+0000 7f471ddff700 1 -- 172.21.15.72:0/288804770 wait complete. 2023-08-31T19:26:10.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.977+0000 7f471ddff700 1 Processor -- start 2023-08-31T19:26:10.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.977+0000 7f471ddff700 1 -- start start 2023-08-31T19:26:10.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.978+0000 7f471ddff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47180aa140 0x7f47180c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:10.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.978+0000 7f471ddff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47180c06b0 0x7f47181514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:10.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.978+0000 7f471ddff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4718154030 0x7f4718156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:10.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.978+0000 7f471ddff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47180aed70 con 0x7f47180c06b0 2023-08-31T19:26:10.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.978+0000 7f471ddff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47180ae160 con 0x7f4718154030 2023-08-31T19:26:10.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.978+0000 7f471ddff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47180ae440 con 0x7f47180aa140 2023-08-31T19:26:10.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.979+0000 7f4716ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47180c06b0 0x7f47181514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:10.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.979+0000 7f4716ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47180c06b0 0x7f47181514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36552/0 (socket says 172.21.15.72:36552) 2023-08-31T19:26:10.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.979+0000 7f4716ffd700 1 -- 172.21.15.72:0/997384347 learned_addr learned my addr 172.21.15.72:0/997384347 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:10.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.979+0000 7f47177fe700 1 --2- 172.21.15.72:0/997384347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47180aa140 0x7f47180c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:10.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.979+0000 7f4717fff700 1 --2- 172.21.15.72:0/997384347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4718154030 0x7f4718156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:10.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.979+0000 7f4716ffd700 1 -- 172.21.15.72:0/997384347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47180aa140 msgr2=0x7f47180c2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:10.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.979+0000 7f4716ffd700 1 --2- 172.21.15.72:0/997384347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47180aa140 0x7f47180c2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:10.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.979+0000 7f4716ffd700 1 -- 172.21.15.72:0/997384347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4718154030 msgr2=0x7f4718156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:10.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.979+0000 7f4716ffd700 1 --2- 172.21.15.72:0/997384347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4718154030 0x7f4718156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:10.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.979+0000 7f4716ffd700 1 -- 172.21.15.72:0/997384347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4708009370 con 0x7f47180c06b0 2023-08-31T19:26:10.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.979+0000 7f4717fff700 1 --2- 172.21.15.72:0/997384347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4718154030 0x7f4718156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:10.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.979+0000 7f4716ffd700 1 --2- 172.21.15.72:0/997384347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47180c06b0 0x7f47181514b0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f470c00d860 tx=0x7f470c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:10.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.979+0000 7f46ff7fe700 1 -- 172.21.15.72:0/997384347 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c011590 con 0x7f47180c06b0 2023-08-31T19:26:10.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.979+0000 7f46ff7fe700 1 -- 172.21.15.72:0/997384347 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470c0116f0 con 0x7f47180c06b0 2023-08-31T19:26:10.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.979+0000 7f46ff7fe700 1 -- 172.21.15.72:0/997384347 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c011a70 con 0x7f47180c06b0 2023-08-31T19:26:10.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.980+0000 7f471ddff700 1 -- 172.21.15.72:0/997384347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47180ae720 con 0x7f47180c06b0 2023-08-31T19:26:10.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.980+0000 7f471ddff700 1 -- 172.21.15.72:0/997384347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47180c2d40 con 0x7f47180c06b0 2023-08-31T19:26:10.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.981+0000 7f471ddff700 1 -- 172.21.15.72:0/997384347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471806c6b0 con 0x7f47180c06b0 2023-08-31T19:26:10.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.982+0000 7f46ff7fe700 1 -- 172.21.15.72:0/997384347 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 87) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f470c01c460 con 0x7f47180c06b0 2023-08-31T19:26:10.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.982+0000 7f46ff7fe700 1 --2- 172.21.15.72:0/997384347 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f470405ecf0 0x7f47040611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:10.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.983+0000 7f46ff7fe700 1 -- 172.21.15.72:0/997384347 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 7495+0+0 (secure 0 0 0) 0x7f470c079fd0 con 0x7f47180c06b0 2023-08-31T19:26:10.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.983+0000 7f47177fe700 1 --2- 172.21.15.72:0/997384347 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f470405ecf0 0x7f47040611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:10.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.983+0000 7f47177fe700 1 --2- 172.21.15.72:0/997384347 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f470405ecf0 0x7f47040611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4708009130 tx=0x7f4708017000).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:10.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:10.987+0000 7f46ff7fe700 1 -- 172.21.15.72:0/997384347 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f470c04b050 con 0x7f47180c06b0 2023-08-31T19:26:11.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:11.197+0000 7f471ddff700 1 -- 172.21.15.72:0/997384347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f471806aac0 con 0x7f47180c06b0 2023-08-31T19:26:11.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:11.750+0000 7f46ff7fe700 1 -- 172.21.15.72:0/997384347 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v81) v1 ==== 104+0+0 (secure 0 0 0) 0x7f470c04e670 con 0x7f47180c06b0 2023-08-31T19:26:11.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:11.752+0000 7f471ddff700 1 -- 172.21.15.72:0/997384347 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f470405ecf0 msgr2=0x7f47040611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:11.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:11.752+0000 7f471ddff700 1 --2- 172.21.15.72:0/997384347 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f470405ecf0 0x7f47040611b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4708009130 tx=0x7f4708017000).stop 2023-08-31T19:26:11.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:11.752+0000 7f471ddff700 1 -- 172.21.15.72:0/997384347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47180c06b0 msgr2=0x7f47181514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:11.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:11.752+0000 7f471ddff700 1 --2- 172.21.15.72:0/997384347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47180c06b0 0x7f47181514b0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f470c00d860 tx=0x7f470c008040).stop 2023-08-31T19:26:11.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:11.752+0000 7f471ddff700 1 -- 172.21.15.72:0/997384347 shutdown_connections 2023-08-31T19:26:11.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:11.752+0000 7f471ddff700 1 --2- 172.21.15.72:0/997384347 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f470405ecf0 0x7f47040611b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:11.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:11.752+0000 7f471ddff700 1 --2- 172.21.15.72:0/997384347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4718154030 0x7f4718156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:11.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:11.752+0000 7f471ddff700 1 --2- 172.21.15.72:0/997384347 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f47180aa140 0x7f47180c2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:11.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:11.752+0000 7f471ddff700 1 --2- 172.21.15.72:0/997384347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47180c06b0 0x7f47181514b0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:11.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:11.752+0000 7f471ddff700 1 -- 172.21.15.72:0/997384347 >> 172.21.15.72:0/997384347 conn(0x7f471805eb60 msgr2=0x7f4718151c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:11.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:11.753+0000 7f471ddff700 1 -- 172.21.15.72:0/997384347 shutdown_connections 2023-08-31T19:26:11.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:11.753+0000 7f471ddff700 1 -- 172.21.15.72:0/997384347 wait complete. 2023-08-31T19:26:11.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T19:26:12.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.003+0000 7fdbd83ff700 1 Processor -- start 2023-08-31T19:26:12.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.003+0000 7fdbd83ff700 1 -- start start 2023-08-31T19:26:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.005+0000 7fdbd83ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbd01373e0 0x7fdbd00c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.005+0000 7fdbd83ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdbd01377c0 0x7fdbd00c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.005+0000 7fdbd83ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdbd00bb9a0 0x7fdbd0069460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.005+0000 7fdbd83ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd00c3d90 con 0x7fdbd01377c0 2023-08-31T19:26:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.005+0000 7fdbd83ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd00c13e0 con 0x7fdbd00bb9a0 2023-08-31T19:26:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.005+0000 7fdbd83ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00c19a0 con 0x7fdbd01373e0 2023-08-31T19:26:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.005+0000 7fdbd599a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdbd01377c0 0x7fdbd00c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.005+0000 7fdbd599a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdbd01377c0 0x7fdbd00c38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36562/0 (socket says 172.21.15.72:36562) 2023-08-31T19:26:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.005+0000 7fdbd599a700 1 -- 172.21.15.72:0/2863096257 learned_addr learned my addr 172.21.15.72:0/2863096257 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.005+0000 7fdbd619b700 1 --2- 172.21.15.72:0/2863096257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbd01373e0 0x7fdbd00c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:12.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.005+0000 7fdbd699c700 1 --2- 172.21.15.72:0/2863096257 >> v2:172.21.15.146:3300/0 conn(0x7fdbd00bb9a0 0x7fdbd0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:12.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.005+0000 7fdbd599a700 1 -- 172.21.15.72:0/2863096257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbd01373e0 msgr2=0x7fdbd00c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:12.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.005+0000 7fdbd599a700 1 --2- 172.21.15.72:0/2863096257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbd01373e0 0x7fdbd00c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.005+0000 7fdbd599a700 1 -- 172.21.15.72:0/2863096257 >> v2:172.21.15.146:3300/0 conn(0x7fdbd00bb9a0 msgr2=0x7fdbd0069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:12.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.005+0000 7fdbd599a700 1 --2- 172.21.15.72:0/2863096257 >> v2:172.21.15.146:3300/0 conn(0x7fdbd00bb9a0 0x7fdbd0069460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.006+0000 7fdbd599a700 1 -- 172.21.15.72:0/2863096257 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd006a1d0 con 0x7fdbd01377c0 2023-08-31T19:26:12.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.006+0000 7fdbd599a700 1 --2- 172.21.15.72:0/2863096257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbd01377c0 0x7fdbd00c38a0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7fdbd0067f70 tx=0x7fdbc00090f0).ready entity=mon.0 client_cookie=d7beb915f5db3026 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:12.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.006+0000 7fdbd5199700 1 -- 172.21.15.72:0/2863096257 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000f6b0 con 0x7fdbd01377c0 2023-08-31T19:26:12.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.006+0000 7fdbd5199700 1 -- 172.21.15.72:0/2863096257 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc000f810 con 0x7fdbd01377c0 2023-08-31T19:26:12.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.006+0000 7fdbd5199700 1 -- 172.21.15.72:0/2863096257 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000fb90 con 0x7fdbd01377c0 2023-08-31T19:26:12.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.006+0000 7fdbd83ff700 1 -- 172.21.15.72:0/2863096257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbd01377c0 msgr2=0x7fdbd00c38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:12.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.006+0000 7fdbd83ff700 1 --2- 172.21.15.72:0/2863096257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbd01377c0 0x7fdbd00c38a0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7fdbd0067f70 tx=0x7fdbc00090f0).stop 2023-08-31T19:26:12.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.007+0000 7fdbd83ff700 1 -- 172.21.15.72:0/2863096257 shutdown_connections 2023-08-31T19:26:12.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.007+0000 7fdbd83ff700 1 --2- 172.21.15.72:0/2863096257 >> v2:172.21.15.146:3300/0 conn(0x7fdbd00bb9a0 0x7fdbd0069460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.007+0000 7fdbd83ff700 1 --2- 172.21.15.72:0/2863096257 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbd01373e0 0x7fdbd00c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.007+0000 7fdbd83ff700 1 --2- 172.21.15.72:0/2863096257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbd01377c0 0x7fdbd00c38a0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.007+0000 7fdbd83ff700 1 -- 172.21.15.72:0/2863096257 >> 172.21.15.72:0/2863096257 conn(0x7fdbd0062650 msgr2=0x7fdbd0062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.007+0000 7fdbd83ff700 1 -- 172.21.15.72:0/2863096257 shutdown_connections 2023-08-31T19:26:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.007+0000 7fdbd83ff700 1 -- 172.21.15.72:0/2863096257 wait complete. 2023-08-31T19:26:12.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.008+0000 7fdbd83ff700 1 Processor -- start 2023-08-31T19:26:12.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.008+0000 7fdbd83ff700 1 -- start start 2023-08-31T19:26:12.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.009+0000 7fdbd83ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbd00bb9a0 0x7fdbd014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:12.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.009+0000 7fdbd83ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbd01373e0 0x7fdbd00c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:12.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.009+0000 7fdbd83ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbd01377c0 0x7fdbd01644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:12.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.009+0000 7fdbd83ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00c66c0 con 0x7fdbd01377c0 2023-08-31T19:26:12.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.009+0000 7fdbd83ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00c5b50 con 0x7fdbd00bb9a0 2023-08-31T19:26:12.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.009+0000 7fdbd83ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00c5e20 con 0x7fdbd01373e0 2023-08-31T19:26:12.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.009+0000 7fdbd699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbd01377c0 0x7fdbd01644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:12.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.009+0000 7fdbd699c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbd01377c0 0x7fdbd01644b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36574/0 (socket says 172.21.15.72:36574) 2023-08-31T19:26:12.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.009+0000 7fdbd699c700 1 -- 172.21.15.72:0/1478994228 learned_addr learned my addr 172.21.15.72:0/1478994228 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:12.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.010+0000 7fdbd619b700 1 --2- 172.21.15.72:0/1478994228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbd00bb9a0 0x7fdbd014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:12.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.010+0000 7fdbd599a700 1 --2- 172.21.15.72:0/1478994228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbd01373e0 0x7fdbd00c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:12.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.010+0000 7fdbd699c700 1 -- 172.21.15.72:0/1478994228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbd01373e0 msgr2=0x7fdbd00c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:12.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.010+0000 7fdbd699c700 1 --2- 172.21.15.72:0/1478994228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbd01373e0 0x7fdbd00c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.010+0000 7fdbd699c700 1 -- 172.21.15.72:0/1478994228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbd00bb9a0 msgr2=0x7fdbd014fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:12.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.010+0000 7fdbd699c700 1 --2- 172.21.15.72:0/1478994228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbd00bb9a0 0x7fdbd014fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.010+0000 7fdbd699c700 1 -- 172.21.15.72:0/1478994228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc0009370 con 0x7fdbd01377c0 2023-08-31T19:26:12.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.010+0000 7fdbd699c700 1 --2- 172.21.15.72:0/1478994228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbd01377c0 0x7fdbd01644b0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7fdbc8007f30 tx=0x7fdbc80098e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:12.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.010+0000 7fdbc67fc700 1 -- 172.21.15.72:0/1478994228 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800eb90 con 0x7fdbd01377c0 2023-08-31T19:26:12.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.010+0000 7fdbc67fc700 1 -- 172.21.15.72:0/1478994228 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc800ecf0 con 0x7fdbd01377c0 2023-08-31T19:26:12.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.010+0000 7fdbd83ff700 1 -- 172.21.15.72:0/1478994228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd00c6100 con 0x7fdbd01377c0 2023-08-31T19:26:12.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.010+0000 7fdbc67fc700 1 -- 172.21.15.72:0/1478994228 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8014610 con 0x7fdbd01377c0 2023-08-31T19:26:12.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.011+0000 7fdbd83ff700 1 -- 172.21.15.72:0/1478994228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd014cbc0 con 0x7fdbd01377c0 2023-08-31T19:26:12.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.012+0000 7fdbd83ff700 1 -- 172.21.15.72:0/1478994228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd006c6b0 con 0x7fdbd01377c0 2023-08-31T19:26:12.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.012+0000 7fdbc67fc700 1 -- 172.21.15.72:0/1478994228 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 87) v1 ==== 75166+0+0 (secure 0 0 0) 0x7fdbc8014a00 con 0x7fdbd01377c0 2023-08-31T19:26:12.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.013+0000 7fdbc67fc700 1 --2- 172.21.15.72:0/1478994228 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fdbb405ecf0 0x7fdbb40611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:12.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.013+0000 7fdbc67fc700 1 -- 172.21.15.72:0/1478994228 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 7495+0+0 (secure 0 0 0) 0x7fdbc807a690 con 0x7fdbd01377c0 2023-08-31T19:26:12.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.013+0000 7fdbd619b700 1 --2- 172.21.15.72:0/1478994228 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fdbb405ecf0 0x7fdbb40611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:12.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.014+0000 7fdbd619b700 1 --2- 172.21.15.72:0/1478994228 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fdbb405ecf0 0x7fdbb40611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fdbcc00bbc0 tx=0x7fdbcc008040).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:12.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.017+0000 7fdbc67fc700 1 -- 172.21.15.72:0/1478994228 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdbc804b660 con 0x7fdbd01377c0 2023-08-31T19:26:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.184+0000 7fdbd83ff700 1 -- 172.21.15.72:0/1478994228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdbd014cdb0 con 0x7fdbd01377c0 2023-08-31T19:26:12.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.234+0000 7fdbc67fc700 1 -- 172.21.15.72:0/1478994228 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fdbc8077fc0 con 0x7fdbd01377c0 2023-08-31T19:26:12.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.767+0000 7fdbc67fc700 1 -- 172.21.15.72:0/1478994228 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v185) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdbc8072540 con 0x7fdbd01377c0 2023-08-31T19:26:12.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.770+0000 7fdbd83ff700 1 -- 172.21.15.72:0/1478994228 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fdbb405ecf0 msgr2=0x7fdbb40611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:12.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.770+0000 7fdbd83ff700 1 --2- 172.21.15.72:0/1478994228 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fdbb405ecf0 0x7fdbb40611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fdbcc00bbc0 tx=0x7fdbcc008040).stop 2023-08-31T19:26:12.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.770+0000 7fdbd83ff700 1 -- 172.21.15.72:0/1478994228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbd01377c0 msgr2=0x7fdbd01644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:12.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.770+0000 7fdbd83ff700 1 --2- 172.21.15.72:0/1478994228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbd01377c0 0x7fdbd01644b0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7fdbc8007f30 tx=0x7fdbc80098e0).stop 2023-08-31T19:26:12.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.770+0000 7fdbd83ff700 1 -- 172.21.15.72:0/1478994228 shutdown_connections 2023-08-31T19:26:12.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.770+0000 7fdbd83ff700 1 --2- 172.21.15.72:0/1478994228 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fdbb405ecf0 0x7fdbb40611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.770+0000 7fdbd83ff700 1 --2- 172.21.15.72:0/1478994228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbd01377c0 0x7fdbd01644b0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.770+0000 7fdbd83ff700 1 --2- 172.21.15.72:0/1478994228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbd00bb9a0 0x7fdbd014fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.770+0000 7fdbd83ff700 1 --2- 172.21.15.72:0/1478994228 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdbd01373e0 0x7fdbd00c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.770+0000 7fdbd83ff700 1 -- 172.21.15.72:0/1478994228 >> 172.21.15.72:0/1478994228 conn(0x7fdbd0062650 msgr2=0x7fdbd0064270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:12.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.770+0000 7fdbd83ff700 1 -- 172.21.15.72:0/1478994228 shutdown_connections 2023-08-31T19:26:12.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.771+0000 7fdbd83ff700 1 -- 172.21.15.72:0/1478994228 wait complete. 2023-08-31T19:26:12.774 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-08-31T19:26:12.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T19:26:12.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.983+0000 7fcd92bff700 1 Processor -- start 2023-08-31T19:26:12.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.984+0000 7fcd92bff700 1 -- start start 2023-08-31T19:26:12.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.985+0000 7fcd92bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd8c151da0 0x7fcd8c1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:12.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.985+0000 7fcd92bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c064d70 0x7fcd8c0bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:12.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.985+0000 7fcd92bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8c154f40 con 0x7fcd8c0c5370 2023-08-31T19:26:12.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.985+0000 7fcd92bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8c154960 con 0x7fcd8c151da0 2023-08-31T19:26:12.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.985+0000 7fcd92bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c0aa2c0 con 0x7fcd8c064d70 2023-08-31T19:26:12.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.985+0000 7fcd9099b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd8c151da0 0x7fcd8c1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:12.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.985+0000 7fcd9099b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd8c151da0 0x7fcd8c1553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51336/0 (socket says 172.21.15.72:51336) 2023-08-31T19:26:12.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.985+0000 7fcd8bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcd8c0c5370 0x7fcd8c064660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36032/0 (socket says 172.21.15.72:36032) 2023-08-31T19:26:12.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.985+0000 7fcd9099b700 1 -- 172.21.15.72:0/300557014 learned_addr learned my addr 172.21.15.72:0/300557014 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:12.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.985+0000 7fcd9119c700 1 --2- 172.21.15.72:0/300557014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c064d70 0x7fcd8c0bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:12.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.986+0000 7fcd9099b700 1 -- 172.21.15.72:0/300557014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c064d70 msgr2=0x7fcd8c0bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:12.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.986+0000 7fcd9099b700 1 --2- 172.21.15.72:0/300557014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c064d70 0x7fcd8c0bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.986+0000 7fcd9099b700 1 -- 172.21.15.72:0/300557014 >> v1:172.21.15.72:6789/0 conn(0x7fcd8c0c5370 legacy=0x7fcd8c064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:12.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.986+0000 7fcd9099b700 1 -- 172.21.15.72:0/300557014 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c154bd0 con 0x7fcd8c151da0 2023-08-31T19:26:12.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.986+0000 7fcd9099b700 1 --2- 172.21.15.72:0/300557014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd8c151da0 0x7fcd8c1553d0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7fcd80006fd0 tx=0x7fcd800090f0).ready entity=mon.0 client_cookie=c79d9483568f541c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:12.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.986+0000 7fcd8b7fe700 1 -- 172.21.15.72:0/300557014 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8000b600 con 0x7fcd8c151da0 2023-08-31T19:26:12.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.986+0000 7fcd8b7fe700 1 -- 172.21.15.72:0/300557014 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8000b760 con 0x7fcd8c151da0 2023-08-31T19:26:12.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.986+0000 7fcd8b7fe700 1 -- 172.21.15.72:0/300557014 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8000bae0 con 0x7fcd8c151da0 2023-08-31T19:26:12.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.986+0000 7fcd92bff700 1 -- 172.21.15.72:0/300557014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd8c151da0 msgr2=0x7fcd8c1553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:12.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.986+0000 7fcd92bff700 1 --2- 172.21.15.72:0/300557014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd8c151da0 0x7fcd8c1553d0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7fcd80006fd0 tx=0x7fcd800090f0).stop 2023-08-31T19:26:12.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.987+0000 7fcd92bff700 1 -- 172.21.15.72:0/300557014 shutdown_connections 2023-08-31T19:26:12.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.987+0000 7fcd92bff700 1 --2- 172.21.15.72:0/300557014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd8c151da0 0x7fcd8c1553d0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.987+0000 7fcd92bff700 1 --2- 172.21.15.72:0/300557014 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c064d70 0x7fcd8c0bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.987+0000 7fcd92bff700 1 -- 172.21.15.72:0/300557014 >> 172.21.15.72:0/300557014 conn(0x7fcd8c063a90 msgr2=0x7fcd8c0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:12.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.987+0000 7fcd92bff700 1 -- 172.21.15.72:0/300557014 shutdown_connections 2023-08-31T19:26:12.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.987+0000 7fcd92bff700 1 -- 172.21.15.72:0/300557014 wait complete. 2023-08-31T19:26:12.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.988+0000 7fcd92bff700 1 Processor -- start 2023-08-31T19:26:12.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.988+0000 7fcd92bff700 1 -- start start 2023-08-31T19:26:12.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.989+0000 7fcd92bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd8c064d70 0x7fcd8c0b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:12.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.989+0000 7fcd92bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c0c5370 0x7fcd8c0c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:12.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.989+0000 7fcd92bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd8c151da0 0x7fcd8c14d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:12.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.989+0000 7fcd92bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c14f2b0 con 0x7fcd8c151da0 2023-08-31T19:26:12.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.989+0000 7fcd92bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c0adec0 con 0x7fcd8c064d70 2023-08-31T19:26:12.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.989+0000 7fcd92bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c14ed30 con 0x7fcd8c0c5370 2023-08-31T19:26:12.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.989+0000 7fcd9119c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd8c151da0 0x7fcd8c14d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:12.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.989+0000 7fcd9119c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd8c151da0 0x7fcd8c14d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51346/0 (socket says 172.21.15.72:51346) 2023-08-31T19:26:12.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.989+0000 7fcd9119c700 1 -- 172.21.15.72:0/1516033902 learned_addr learned my addr 172.21.15.72:0/1516033902 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:12.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.990+0000 7fcd9099b700 1 --2- 172.21.15.72:0/1516033902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd8c064d70 0x7fcd8c0b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:12.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.990+0000 7fcd8bfff700 1 --2- 172.21.15.72:0/1516033902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c0c5370 0x7fcd8c0c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:12.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.990+0000 7fcd9119c700 1 -- 172.21.15.72:0/1516033902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c0c5370 msgr2=0x7fcd8c0c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:12.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.990+0000 7fcd9119c700 1 --2- 172.21.15.72:0/1516033902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c0c5370 0x7fcd8c0c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.990+0000 7fcd9119c700 1 -- 172.21.15.72:0/1516033902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd8c064d70 msgr2=0x7fcd8c0b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:12.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.990+0000 7fcd9119c700 1 --2- 172.21.15.72:0/1516033902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd8c064d70 0x7fcd8c0b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:12.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.990+0000 7fcd9119c700 1 -- 172.21.15.72:0/1516033902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd80009370 con 0x7fcd8c151da0 2023-08-31T19:26:12.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.990+0000 7fcd9119c700 1 --2- 172.21.15.72:0/1516033902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd8c151da0 0x7fcd8c14d1c0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7fcd84007f20 tx=0x7fcd84009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:12.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.990+0000 7fcd88ff9700 1 -- 172.21.15.72:0/1516033902 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8400ec40 con 0x7fcd8c151da0 2023-08-31T19:26:12.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.990+0000 7fcd88ff9700 1 -- 172.21.15.72:0/1516033902 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8400eda0 con 0x7fcd8c151da0 2023-08-31T19:26:12.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.990+0000 7fcd88ff9700 1 -- 172.21.15.72:0/1516033902 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84014610 con 0x7fcd8c151da0 2023-08-31T19:26:12.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.990+0000 7fcd92bff700 1 -- 172.21.15.72:0/1516033902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8c1512c0 con 0x7fcd8c151da0 2023-08-31T19:26:12.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.990+0000 7fcd92bff700 1 -- 172.21.15.72:0/1516033902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c151580 con 0x7fcd8c151da0 2023-08-31T19:26:12.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.991+0000 7fcd92bff700 1 -- 172.21.15.72:0/1516033902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8c0657e0 con 0x7fcd8c151da0 2023-08-31T19:26:12.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.992+0000 7fcd88ff9700 1 -- 172.21.15.72:0/1516033902 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fcd84014a40 con 0x7fcd8c151da0 2023-08-31T19:26:12.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.993+0000 7fcd88ff9700 1 --2- 172.21.15.72:0/1516033902 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcd7005ef30 0x7fcd700613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:12.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.993+0000 7fcd88ff9700 1 -- 172.21.15.72:0/1516033902 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 7028+0+0 (secure 0 0 0) 0x7fcd8407a950 con 0x7fcd8c151da0 2023-08-31T19:26:12.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.993+0000 7fcd9099b700 1 --2- 172.21.15.72:0/1516033902 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcd7005ef30 0x7fcd700613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:12.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.994+0000 7fcd9099b700 1 --2- 172.21.15.72:0/1516033902 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcd7005ef30 0x7fcd700613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fcd80009130 tx=0x7fcd80017000).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:13.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:12.997+0000 7fcd88ff9700 1 -- 172.21.15.72:0/1516033902 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcd8404b7f0 con 0x7fcd8c151da0 2023-08-31T19:26:13.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.173+0000 7fcd92bff700 1 -- 172.21.15.72:0/1516033902 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcd8c0ae050 con 0x7fcd8c151da0 2023-08-31T19:26:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.768+0000 7fcd88ff9700 1 -- 172.21.15.72:0/1516033902 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v186) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcd8404ee10 con 0x7fcd8c151da0 2023-08-31T19:26:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.772+0000 7fcd92bff700 1 -- 172.21.15.72:0/1516033902 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcd7005ef30 msgr2=0x7fcd700613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.772+0000 7fcd92bff700 1 --2- 172.21.15.72:0/1516033902 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcd7005ef30 0x7fcd700613f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fcd80009130 tx=0x7fcd80017000).stop 2023-08-31T19:26:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.772+0000 7fcd92bff700 1 -- 172.21.15.72:0/1516033902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd8c151da0 msgr2=0x7fcd8c14d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.772+0000 7fcd92bff700 1 --2- 172.21.15.72:0/1516033902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd8c151da0 0x7fcd8c14d1c0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7fcd84007f20 tx=0x7fcd84009840).stop 2023-08-31T19:26:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.773+0000 7fcd92bff700 1 -- 172.21.15.72:0/1516033902 shutdown_connections 2023-08-31T19:26:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.773+0000 7fcd92bff700 1 --2- 172.21.15.72:0/1516033902 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcd7005ef30 0x7fcd700613f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.773+0000 7fcd92bff700 1 --2- 172.21.15.72:0/1516033902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd8c151da0 0x7fcd8c14d1c0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.773+0000 7fcd92bff700 1 --2- 172.21.15.72:0/1516033902 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd8c064d70 0x7fcd8c0b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.773+0000 7fcd92bff700 1 --2- 172.21.15.72:0/1516033902 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd8c0c5370 0x7fcd8c0c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:13.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.773+0000 7fcd92bff700 1 -- 172.21.15.72:0/1516033902 >> 172.21.15.72:0/1516033902 conn(0x7fcd8c063a90 msgr2=0x7fcd8c0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:13.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.773+0000 7fcd92bff700 1 -- 172.21.15.72:0/1516033902 shutdown_connections 2023-08-31T19:26:13.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.773+0000 7fcd92bff700 1 -- 172.21.15.72:0/1516033902 wait complete. 2023-08-31T19:26:13.775 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-08-31T19:26:13.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-31T19:26:13.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.986+0000 7face0bff700 1 Processor -- start 2023-08-31T19:26:13.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.986+0000 7face0bff700 1 -- start start 2023-08-31T19:26:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.987+0000 7face0bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7facdc154030 0x7facdc154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.987+0000 7face0bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7facdc0c06b0 0x7facdc0c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:13.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.987+0000 7face0bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facdc0aa140 0x7facdc063120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.987+0000 7face0bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facdc0c66e0 con 0x7facdc154030 2023-08-31T19:26:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.987+0000 7face0bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facdc0c6ed0 con 0x7facdc0c06b0 2023-08-31T19:26:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.987+0000 7face0bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc0c68c0 con 0x7facdc0aa140 2023-08-31T19:26:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.987+0000 7facda59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7facdc154030 0x7facdc154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:13.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.987+0000 7facda59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7facdc154030 0x7facdc154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51348/0 (socket says 172.21.15.72:51348) 2023-08-31T19:26:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.987+0000 7facda59c700 1 -- 172.21.15.72:0/402943131 learned_addr learned my addr 172.21.15.72:0/402943131 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.988+0000 7facda59c700 1 -- 172.21.15.72:0/402943131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facdc0aa140 msgr2=0x7facdc063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.988+0000 7facdad9d700 1 --2- 172.21.15.72:0/402943131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facdc0aa140 0x7facdc063120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.988+0000 7facd9d9b700 1 --2- 172.21.15.72:0/402943131 >> v2:172.21.15.146:3300/0 conn(0x7facdc0c06b0 0x7facdc0c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:13.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.988+0000 7facda59c700 1 --2- 172.21.15.72:0/402943131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facdc0aa140 0x7facdc063120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:13.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.988+0000 7facda59c700 1 -- 172.21.15.72:0/402943131 >> v2:172.21.15.146:3300/0 conn(0x7facdc0c06b0 msgr2=0x7facdc0c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:13.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.988+0000 7facda59c700 1 --2- 172.21.15.72:0/402943131 >> v2:172.21.15.146:3300/0 conn(0x7facdc0c06b0 0x7facdc0c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:13.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.988+0000 7facda59c700 1 -- 172.21.15.72:0/402943131 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc0c0f30 con 0x7facdc154030 2023-08-31T19:26:13.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.988+0000 7facdad9d700 1 --2- 172.21.15.72:0/402943131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facdc0aa140 0x7facdc063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:13.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.988+0000 7facd9d9b700 1 --2- 172.21.15.72:0/402943131 >> v2:172.21.15.146:3300/0 conn(0x7facdc0c06b0 0x7facdc0c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:13.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.988+0000 7facda59c700 1 --2- 172.21.15.72:0/402943131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc154030 0x7facdc154410 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7facdc0cb6d0 tx=0x7faccc0090f0).ready entity=mon.0 client_cookie=87c3cbb66fd99d0f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:13.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.988+0000 7facd959a700 1 -- 172.21.15.72:0/402943131 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc00b600 con 0x7facdc154030 2023-08-31T19:26:13.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.988+0000 7facd959a700 1 -- 172.21.15.72:0/402943131 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc00b760 con 0x7facdc154030 2023-08-31T19:26:13.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.988+0000 7facd959a700 1 -- 172.21.15.72:0/402943131 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc00bae0 con 0x7facdc154030 2023-08-31T19:26:13.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.989+0000 7face0bff700 1 -- 172.21.15.72:0/402943131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc154030 msgr2=0x7facdc154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:13.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.989+0000 7face0bff700 1 --2- 172.21.15.72:0/402943131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc154030 0x7facdc154410 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7facdc0cb6d0 tx=0x7faccc0090f0).stop 2023-08-31T19:26:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.989+0000 7face0bff700 1 -- 172.21.15.72:0/402943131 shutdown_connections 2023-08-31T19:26:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.989+0000 7face0bff700 1 --2- 172.21.15.72:0/402943131 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facdc0aa140 0x7facdc063120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.989+0000 7face0bff700 1 --2- 172.21.15.72:0/402943131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc154030 0x7facdc154410 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.989+0000 7face0bff700 1 --2- 172.21.15.72:0/402943131 >> v2:172.21.15.146:3300/0 conn(0x7facdc0c06b0 0x7facdc0c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:13.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.989+0000 7face0bff700 1 -- 172.21.15.72:0/402943131 >> 172.21.15.72:0/402943131 conn(0x7facdc05eb60 msgr2=0x7facdc0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:13.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.989+0000 7face0bff700 1 -- 172.21.15.72:0/402943131 shutdown_connections 2023-08-31T19:26:13.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.989+0000 7face0bff700 1 -- 172.21.15.72:0/402943131 wait complete. 2023-08-31T19:26:13.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.990+0000 7face0bff700 1 Processor -- start 2023-08-31T19:26:13.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.991+0000 7face0bff700 1 -- start start 2023-08-31T19:26:13.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.991+0000 7face0bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facdc0aa140 0x7facdc14e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:13.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.991+0000 7face0bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc0c06b0 0x7facdc14dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:13.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.992+0000 7face0bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facdc154030 0x7facdc0ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:14.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.992+0000 7face0bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc0ae750 con 0x7facdc0c06b0 2023-08-31T19:26:14.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.992+0000 7face0bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc168630 con 0x7facdc0aa140 2023-08-31T19:26:14.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.992+0000 7face0bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc0ade20 con 0x7facdc154030 2023-08-31T19:26:14.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.992+0000 7facd9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc0c06b0 0x7facdc14dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:14.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.992+0000 7facd9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc0c06b0 0x7facdc14dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51360/0 (socket says 172.21.15.72:51360) 2023-08-31T19:26:14.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.992+0000 7facd9d9b700 1 -- 172.21.15.72:0/3799923493 learned_addr learned my addr 172.21.15.72:0/3799923493 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:14.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.992+0000 7facda59c700 1 --2- 172.21.15.72:0/3799923493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facdc0aa140 0x7facdc14e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:14.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.992+0000 7facdad9d700 1 --2- 172.21.15.72:0/3799923493 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facdc154030 0x7facdc0ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:14.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.992+0000 7facd9d9b700 1 -- 172.21.15.72:0/3799923493 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facdc154030 msgr2=0x7facdc0ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:14.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.992+0000 7facd9d9b700 1 --2- 172.21.15.72:0/3799923493 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facdc154030 0x7facdc0ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.992+0000 7facd9d9b700 1 -- 172.21.15.72:0/3799923493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facdc0aa140 msgr2=0x7facdc14e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:14.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.992+0000 7facd9d9b700 1 --2- 172.21.15.72:0/3799923493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facdc0aa140 0x7facdc14e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.992+0000 7facd9d9b700 1 -- 172.21.15.72:0/3799923493 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc009370 con 0x7facdc0c06b0 2023-08-31T19:26:14.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.992+0000 7facd9d9b700 1 --2- 172.21.15.72:0/3799923493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc0c06b0 0x7facdc14dd70 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7facd000c880 tx=0x7facd0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:14.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.993+0000 7facca7fc700 1 -- 172.21.15.72:0/3799923493 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0010580 con 0x7facdc0c06b0 2023-08-31T19:26:14.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.993+0000 7facca7fc700 1 -- 172.21.15.72:0/3799923493 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd00106e0 con 0x7facdc0c06b0 2023-08-31T19:26:14.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.993+0000 7facca7fc700 1 -- 172.21.15.72:0/3799923493 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0010a60 con 0x7facdc0c06b0 2023-08-31T19:26:14.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.993+0000 7face0bff700 1 -- 172.21.15.72:0/3799923493 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facdc0ae100 con 0x7facdc0c06b0 2023-08-31T19:26:14.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.993+0000 7face0bff700 1 -- 172.21.15.72:0/3799923493 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc14e260 con 0x7facdc0c06b0 2023-08-31T19:26:14.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.994+0000 7face0bff700 1 -- 172.21.15.72:0/3799923493 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facdc14e480 con 0x7facdc0c06b0 2023-08-31T19:26:14.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.995+0000 7facca7fc700 1 -- 172.21.15.72:0/3799923493 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7facd001b460 con 0x7facdc0c06b0 2023-08-31T19:26:14.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.995+0000 7facca7fc700 1 --2- 172.21.15.72:0/3799923493 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7facbc05ef30 0x7facbc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:14.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.995+0000 7facca7fc700 1 -- 172.21.15.72:0/3799923493 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6527+0+0 (secure 0 0 0) 0x7facd007a140 con 0x7facdc0c06b0 2023-08-31T19:26:14.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.996+0000 7facda59c700 1 --2- 172.21.15.72:0/3799923493 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7facbc05ef30 0x7facbc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:14.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:13.996+0000 7facda59c700 1 --2- 172.21.15.72:0/3799923493 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7facbc05ef30 0x7facbc0613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7faccc009130 tx=0x7faccc017000).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:14.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.000+0000 7facca7fc700 1 -- 172.21.15.72:0/3799923493 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7facd004b180 con 0x7facdc0c06b0 2023-08-31T19:26:14.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.169+0000 7face0bff700 1 -- 172.21.15.72:0/3799923493 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7facdc0c0c50 con 0x7facdc0c06b0 2023-08-31T19:26:14.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.176+0000 7facca7fc700 1 -- 172.21.15.72:0/3799923493 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v36) v1 ==== 120+0+0 (secure 0 0 0) 0x7facd004e7a0 con 0x7facdc0c06b0 2023-08-31T19:26:14.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.178+0000 7face0bff700 1 -- 172.21.15.72:0/3799923493 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7facbc05ef30 msgr2=0x7facbc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:14.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.178+0000 7face0bff700 1 --2- 172.21.15.72:0/3799923493 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7facbc05ef30 0x7facbc0613f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7faccc009130 tx=0x7faccc017000).stop 2023-08-31T19:26:14.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.178+0000 7face0bff700 1 -- 172.21.15.72:0/3799923493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc0c06b0 msgr2=0x7facdc14dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:14.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.178+0000 7face0bff700 1 --2- 172.21.15.72:0/3799923493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc0c06b0 0x7facdc14dd70 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7facd000c880 tx=0x7facd0008040).stop 2023-08-31T19:26:14.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.178+0000 7face0bff700 1 -- 172.21.15.72:0/3799923493 shutdown_connections 2023-08-31T19:26:14.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.178+0000 7face0bff700 1 --2- 172.21.15.72:0/3799923493 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7facbc05ef30 0x7facbc0613f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.178+0000 7face0bff700 1 --2- 172.21.15.72:0/3799923493 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7facdc154030 0x7facdc0ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.178+0000 7face0bff700 1 --2- 172.21.15.72:0/3799923493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facdc0aa140 0x7facdc14e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.178+0000 7face0bff700 1 --2- 172.21.15.72:0/3799923493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facdc0c06b0 0x7facdc14dd70 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.178+0000 7face0bff700 1 -- 172.21.15.72:0/3799923493 >> 172.21.15.72:0/3799923493 conn(0x7facdc05eb60 msgr2=0x7facdc151b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:14.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.179+0000 7face0bff700 1 -- 172.21.15.72:0/3799923493 shutdown_connections 2023-08-31T19:26:14.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.179+0000 7face0bff700 1 -- 172.21.15.72:0/3799923493 wait complete. 2023-08-31T19:26:14.198 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-31T19:26:14.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.395+0000 7fa26ffff700 1 Processor -- start 2023-08-31T19:26:14.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.395+0000 7fa26ffff700 1 -- start start 2023-08-31T19:26:14.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa268153e30 0x7fa268154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:14.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2680c5cb0 0x7fa2680c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:14.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa2680630b0 0x7fa268063510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:14.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26ffff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa268063a00 con 0x7fa268153e30 2023-08-31T19:26:14.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26ffff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2680bfd40 con 0x7fa2680630b0 2023-08-31T19:26:14.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26ffff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680c6730 con 0x7fa2680c5cb0 2023-08-31T19:26:14.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa268153e30 0x7fa268154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:14.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa268153e30 0x7fa268154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51364/0 (socket says 172.21.15.72:51364) 2023-08-31T19:26:14.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26dd9b700 1 -- 172.21.15.72:0/967971420 learned_addr learned my addr 172.21.15.72:0/967971420 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:14.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26d59a700 1 --2- 172.21.15.72:0/967971420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2680c5cb0 0x7fa2680c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:14.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26e59c700 1 --2- 172.21.15.72:0/967971420 >> v2:172.21.15.146:3300/0 conn(0x7fa2680630b0 0x7fa268063510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:14.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26dd9b700 1 -- 172.21.15.72:0/967971420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2680c5cb0 msgr2=0x7fa2680c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:14.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26dd9b700 1 --2- 172.21.15.72:0/967971420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2680c5cb0 0x7fa2680c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26dd9b700 1 -- 172.21.15.72:0/967971420 >> v2:172.21.15.146:3300/0 conn(0x7fa2680630b0 msgr2=0x7fa268063510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:14.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26dd9b700 1 --2- 172.21.15.72:0/967971420 >> v2:172.21.15.146:3300/0 conn(0x7fa2680630b0 0x7fa268063510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.397+0000 7fa26dd9b700 1 -- 172.21.15.72:0/967971420 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2680bffe0 con 0x7fa268153e30 2023-08-31T19:26:14.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.398+0000 7fa26dd9b700 1 --2- 172.21.15.72:0/967971420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa268153e30 0x7fa268154210 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7fa268062910 tx=0x7fa2640090f0).ready entity=mon.0 client_cookie=22ca40a58d8c0753 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:14.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.398+0000 7fa26cd99700 1 -- 172.21.15.72:0/967971420 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26400b600 con 0x7fa268153e30 2023-08-31T19:26:14.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.398+0000 7fa26cd99700 1 -- 172.21.15.72:0/967971420 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26400b760 con 0x7fa268153e30 2023-08-31T19:26:14.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.398+0000 7fa26cd99700 1 -- 172.21.15.72:0/967971420 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26400bb00 con 0x7fa268153e30 2023-08-31T19:26:14.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.398+0000 7fa26ffff700 1 -- 172.21.15.72:0/967971420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa268153e30 msgr2=0x7fa268154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:14.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.398+0000 7fa26ffff700 1 --2- 172.21.15.72:0/967971420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa268153e30 0x7fa268154210 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7fa268062910 tx=0x7fa2640090f0).stop 2023-08-31T19:26:14.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.398+0000 7fa26ffff700 1 -- 172.21.15.72:0/967971420 shutdown_connections 2023-08-31T19:26:14.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.398+0000 7fa26ffff700 1 --2- 172.21.15.72:0/967971420 >> v2:172.21.15.146:3300/0 conn(0x7fa2680630b0 0x7fa268063510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.398+0000 7fa26ffff700 1 --2- 172.21.15.72:0/967971420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa268153e30 0x7fa268154210 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.398+0000 7fa26ffff700 1 --2- 172.21.15.72:0/967971420 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2680c5cb0 0x7fa2680c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.398+0000 7fa26ffff700 1 -- 172.21.15.72:0/967971420 >> 172.21.15.72:0/967971420 conn(0x7fa26805eb20 msgr2=0x7fa2680cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:14.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.398+0000 7fa26ffff700 1 -- 172.21.15.72:0/967971420 shutdown_connections 2023-08-31T19:26:14.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.399+0000 7fa26ffff700 1 -- 172.21.15.72:0/967971420 wait complete. 2023-08-31T19:26:14.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.400+0000 7fa26ffff700 1 Processor -- start 2023-08-31T19:26:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.401+0000 7fa26ffff700 1 -- start start 2023-08-31T19:26:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.402+0000 7fa26ffff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2680630b0 0x7fa268140830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.402+0000 7fa26ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2680c5cb0 0x7fa268157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.402+0000 7fa26ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268153e30 0x7fa268157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.402+0000 7fa26ffff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa268157a20 con 0x7fa2680c5cb0 2023-08-31T19:26:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.402+0000 7fa26ffff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa268165540 con 0x7fa268153e30 2023-08-31T19:26:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.402+0000 7fa26ffff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680c3d80 con 0x7fa2680630b0 2023-08-31T19:26:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.402+0000 7fa26d59a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2680c5cb0 0x7fa268157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.402+0000 7fa26d59a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2680c5cb0 0x7fa268157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51374/0 (socket says 172.21.15.72:51374) 2023-08-31T19:26:14.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.402+0000 7fa26d59a700 1 -- 172.21.15.72:0/1850732860 learned_addr learned my addr 172.21.15.72:0/1850732860 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:14.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.403+0000 7fa26dd9b700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2680630b0 0x7fa268140830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:14.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.403+0000 7fa26e59c700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268153e30 0x7fa268157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:14.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.403+0000 7fa26d59a700 1 -- 172.21.15.72:0/1850732860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2680630b0 msgr2=0x7fa268140830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:14.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.403+0000 7fa26d59a700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2680630b0 0x7fa268140830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.403+0000 7fa26d59a700 1 -- 172.21.15.72:0/1850732860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268153e30 msgr2=0x7fa268157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:14.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.403+0000 7fa26d59a700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268153e30 0x7fa268157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.403+0000 7fa26d59a700 1 -- 172.21.15.72:0/1850732860 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa264009370 con 0x7fa2680c5cb0 2023-08-31T19:26:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.403+0000 7fa26e59c700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268153e30 0x7fa268157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.403+0000 7fa26dd9b700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2680630b0 0x7fa268140830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.403+0000 7fa26d59a700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2680c5cb0 0x7fa268157040 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7fa25800d890 tx=0x7fa258008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.403+0000 7fa25dffb700 1 -- 172.21.15.72:0/1850732860 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2580125f0 con 0x7fa2680c5cb0 2023-08-31T19:26:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.403+0000 7fa25dffb700 1 -- 172.21.15.72:0/1850732860 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa258012750 con 0x7fa2680c5cb0 2023-08-31T19:26:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.403+0000 7fa26ffff700 1 -- 172.21.15.72:0/1850732860 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2680c4060 con 0x7fa2680c5cb0 2023-08-31T19:26:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.403+0000 7fa25dffb700 1 -- 172.21.15.72:0/1850732860 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258012ad0 con 0x7fa2680c5cb0 2023-08-31T19:26:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.403+0000 7fa26ffff700 1 -- 172.21.15.72:0/1850732860 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2680c4620 con 0x7fa2680c5cb0 2023-08-31T19:26:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.405+0000 7fa26ffff700 1 -- 172.21.15.72:0/1850732860 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa268165710 con 0x7fa2680c5cb0 2023-08-31T19:26:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.405+0000 7fa25dffb700 1 -- 172.21.15.72:0/1850732860 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa258013480 con 0x7fa2680c5cb0 2023-08-31T19:26:14.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.406+0000 7fa25dffb700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa24c05ef30 0x7fa24c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:14.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.406+0000 7fa25dffb700 1 -- 172.21.15.72:0/1850732860 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6527+0+0 (secure 0 0 0) 0x7fa25807a300 con 0x7fa2680c5cb0 2023-08-31T19:26:14.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.406+0000 7fa26dd9b700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa24c05ef30 0x7fa24c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:14.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.407+0000 7fa26dd9b700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa24c05ef30 0x7fa24c0613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa264009fd0 tx=0x7fa264017000).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:14.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.410+0000 7fa25dffb700 1 -- 172.21.15.72:0/1850732860 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa25804b400 con 0x7fa2680c5cb0 2023-08-31T19:26:14.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.577+0000 7fa26ffff700 1 -- 172.21.15.72:0/1850732860 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa2680c0590 con 0x7fa2680c5cb0 2023-08-31T19:26:14.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.581+0000 7fa25dffb700 1 -- 172.21.15.72:0/1850732860 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa25804ea20 con 0x7fa2680c5cb0 2023-08-31T19:26:14.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.583+0000 7fa26ffff700 1 -- 172.21.15.72:0/1850732860 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa24c05ef30 msgr2=0x7fa24c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:14.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.583+0000 7fa26ffff700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa24c05ef30 0x7fa24c0613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa264009fd0 tx=0x7fa264017000).stop 2023-08-31T19:26:14.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.584+0000 7fa26ffff700 1 -- 172.21.15.72:0/1850732860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2680c5cb0 msgr2=0x7fa268157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:14.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.584+0000 7fa26ffff700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2680c5cb0 0x7fa268157040 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7fa25800d890 tx=0x7fa258008040).stop 2023-08-31T19:26:14.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.584+0000 7fa26ffff700 1 -- 172.21.15.72:0/1850732860 shutdown_connections 2023-08-31T19:26:14.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.584+0000 7fa26ffff700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa24c05ef30 0x7fa24c0613f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.584+0000 7fa26ffff700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa268153e30 0x7fa268157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.584+0000 7fa26ffff700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa2680630b0 0x7fa268140830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.584+0000 7fa26ffff700 1 --2- 172.21.15.72:0/1850732860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2680c5cb0 0x7fa268157040 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.584+0000 7fa26ffff700 1 -- 172.21.15.72:0/1850732860 >> 172.21.15.72:0/1850732860 conn(0x7fa26805eb20 msgr2=0x7fa2680ab440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:14.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.584+0000 7fa26ffff700 1 -- 172.21.15.72:0/1850732860 shutdown_connections 2023-08-31T19:26:14.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.584+0000 7fa26ffff700 1 -- 172.21.15.72:0/1850732860 wait complete. 2023-08-31T19:26:14.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-08-31T19:26:14.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.790+0000 7faa0b1ff700 1 Processor -- start 2023-08-31T19:26:14.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.790+0000 7faa0b1ff700 1 -- start start 2023-08-31T19:26:14.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.792+0000 7faa0b1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faa04154220 0x7faa04157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:14.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.792+0000 7faa0b1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa041588d0 0x7faa040c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:14.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.792+0000 7faa0b1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa040c8c90 con 0x7faa040cb940 2023-08-31T19:26:14.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.792+0000 7faa0b1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa040aa700 con 0x7faa04154220 2023-08-31T19:26:14.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.792+0000 7faa0b1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa040c5e10 con 0x7faa041588d0 2023-08-31T19:26:14.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.792+0000 7faa08f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faa04154220 0x7faa04157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:14.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.792+0000 7faa08f9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faa04154220 0x7faa04157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51382/0 (socket says 172.21.15.72:51382) 2023-08-31T19:26:14.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.792+0000 7faa08f9b700 1 -- 172.21.15.72:0/2058657537 learned_addr learned my addr 172.21.15.72:0/2058657537 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:14.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.793+0000 7faa0979c700 1 --2- 172.21.15.72:0/2058657537 >> v2:172.21.15.146:3300/0 conn(0x7faa041588d0 0x7faa040c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:14.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.793+0000 7faa08f9b700 1 -- 172.21.15.72:0/2058657537 >> v2:172.21.15.146:3300/0 conn(0x7faa041588d0 msgr2=0x7faa040c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:14.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.793+0000 7faa08f9b700 1 --2- 172.21.15.72:0/2058657537 >> v2:172.21.15.146:3300/0 conn(0x7faa041588d0 0x7faa040c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.793+0000 7faa08f9b700 1 -- 172.21.15.72:0/2058657537 >> v1:172.21.15.146:6789/0 conn(0x7faa040cb940 legacy=0x7faa041581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:14.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.793+0000 7faa08f9b700 1 -- 172.21.15.72:0/2058657537 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa04155610 con 0x7faa04154220 2023-08-31T19:26:14.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.793+0000 7faa08f9b700 1 --2- 172.21.15.72:0/2058657537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa04154220 0x7faa04157cd0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7faa04098e50 tx=0x7fa9f80090f0).ready entity=mon.0 client_cookie=8a5f6d9c54aedc92 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:14.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.793+0000 7faa037fe700 1 -- 172.21.15.72:0/2058657537 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f800b600 con 0x7faa04154220 2023-08-31T19:26:14.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.793+0000 7faa037fe700 1 -- 172.21.15.72:0/2058657537 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f800b760 con 0x7faa04154220 2023-08-31T19:26:14.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.793+0000 7faa037fe700 1 -- 172.21.15.72:0/2058657537 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f800bae0 con 0x7faa04154220 2023-08-31T19:26:14.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.794+0000 7faa0b1ff700 1 -- 172.21.15.72:0/2058657537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa04154220 msgr2=0x7faa04157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:14.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.794+0000 7faa0b1ff700 1 --2- 172.21.15.72:0/2058657537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa04154220 0x7faa04157cd0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7faa04098e50 tx=0x7fa9f80090f0).stop 2023-08-31T19:26:14.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.794+0000 7faa0b1ff700 1 -- 172.21.15.72:0/2058657537 shutdown_connections 2023-08-31T19:26:14.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.794+0000 7faa0b1ff700 1 --2- 172.21.15.72:0/2058657537 >> v2:172.21.15.146:3300/0 conn(0x7faa041588d0 0x7faa040c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.794+0000 7faa0b1ff700 1 --2- 172.21.15.72:0/2058657537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa04154220 0x7faa04157cd0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:14.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.794+0000 7faa0b1ff700 1 -- 172.21.15.72:0/2058657537 >> 172.21.15.72:0/2058657537 conn(0x7faa0405e870 msgr2=0x7faa040cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:14.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.794+0000 7faa0b1ff700 1 -- 172.21.15.72:0/2058657537 shutdown_connections 2023-08-31T19:26:14.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.794+0000 7faa0b1ff700 1 -- 172.21.15.72:0/2058657537 wait complete. 2023-08-31T19:26:14.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.795+0000 7faa0b1ff700 1 Processor -- start 2023-08-31T19:26:14.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.796+0000 7faa0b1ff700 1 -- start start 2023-08-31T19:26:14.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.797+0000 7faa0b1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa040cb940 0x7faa040aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:14.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.797+0000 7faa0b1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa04154220 0x7faa040c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:14.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.797+0000 7faa0b1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa041588d0 0x7faa0414bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:14.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.797+0000 7faa0b1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa040c7300 con 0x7faa040cb940 2023-08-31T19:26:14.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.797+0000 7faa0b1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa040c8000 con 0x7faa04154220 2023-08-31T19:26:14.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.797+0000 7faa0b1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa040acc30 con 0x7faa041588d0 2023-08-31T19:26:14.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.797+0000 7faa08f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa040cb940 0x7faa040aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:14.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.797+0000 7faa08f9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa040cb940 0x7faa040aba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51394/0 (socket says 172.21.15.72:51394) 2023-08-31T19:26:14.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.797+0000 7faa08f9b700 1 -- 172.21.15.72:0/2577063507 learned_addr learned my addr 172.21.15.72:0/2577063507 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:14.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.797+0000 7faa08f9b700 1 -- 172.21.15.72:0/2577063507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa041588d0 msgr2=0x7faa0414bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:14.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.797+0000 7faa08f9b700 1 --2- 172.21.15.72:0/2577063507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa041588d0 0x7faa0414bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:14.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.797+0000 7faa08f9b700 1 -- 172.21.15.72:0/2577063507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa04154220 msgr2=0x7faa040c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.797+0000 7faa08f9b700 1 --2- 172.21.15.72:0/2577063507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa04154220 0x7faa040c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.797+0000 7faa08f9b700 1 -- 172.21.15.72:0/2577063507 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f8009310 con 0x7faa040cb940 2023-08-31T19:26:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.797+0000 7faa08f9b700 1 --2- 172.21.15.72:0/2577063507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa040cb940 0x7faa040aba60 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7fa9f8006fd0 tx=0x7fa9f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.798+0000 7faa00ff9700 1 -- 172.21.15.72:0/2577063507 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f800b8d0 con 0x7faa040cb940 2023-08-31T19:26:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.798+0000 7faa00ff9700 1 -- 172.21.15.72:0/2577063507 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f800ba30 con 0x7faa040cb940 2023-08-31T19:26:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.798+0000 7faa0b1ff700 1 -- 172.21.15.72:0/2577063507 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa040ac020 con 0x7faa040cb940 2023-08-31T19:26:14.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.798+0000 7faa00ff9700 1 -- 172.21.15.72:0/2577063507 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f801c670 con 0x7faa040cb940 2023-08-31T19:26:14.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.798+0000 7faa0b1ff700 1 -- 172.21.15.72:0/2577063507 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa040ac5e0 con 0x7faa040cb940 2023-08-31T19:26:14.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.799+0000 7faa0b1ff700 1 -- 172.21.15.72:0/2577063507 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0406c6b0 con 0x7faa040cb940 2023-08-31T19:26:14.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.800+0000 7faa00ff9700 1 -- 172.21.15.72:0/2577063507 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa9f801c9e0 con 0x7faa040cb940 2023-08-31T19:26:14.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.800+0000 7faa00ff9700 1 --2- 172.21.15.72:0/2577063507 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa9e805ef30 0x7fa9e80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:14.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.801+0000 7faa00ff9700 1 -- 172.21.15.72:0/2577063507 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6527+0+0 (secure 0 0 0) 0x7fa9f807bf00 con 0x7faa040cb940 2023-08-31T19:26:14.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.801+0000 7faa03fff700 1 --2- 172.21.15.72:0/2577063507 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa9e805ef30 0x7fa9e80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:14.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.801+0000 7faa03fff700 1 --2- 172.21.15.72:0/2577063507 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa9e805ef30 0x7fa9e80613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7faa040abf50 tx=0x7fa9f00079c0).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:14.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:14.805+0000 7faa00ff9700 1 -- 172.21.15.72:0/2577063507 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa9f804d060 con 0x7faa040cb940 2023-08-31T19:26:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.040+0000 7faa0b1ff700 1 -- 172.21.15.72:0/2577063507 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7faa040c0a50 con 0x7faa040cb940 2023-08-31T19:26:15.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.773+0000 7faa00ff9700 1 -- 172.21.15.72:0/2577063507 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1343) v1 ==== 163+0+0 (secure 0 0 0) 0x7fa9f802a070 con 0x7faa040cb940 2023-08-31T19:26:15.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.776+0000 7faa0b1ff700 1 -- 172.21.15.72:0/2577063507 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa9e805ef30 msgr2=0x7fa9e80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:15.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.776+0000 7faa0b1ff700 1 --2- 172.21.15.72:0/2577063507 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa9e805ef30 0x7fa9e80613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7faa040abf50 tx=0x7fa9f00079c0).stop 2023-08-31T19:26:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.776+0000 7faa0b1ff700 1 -- 172.21.15.72:0/2577063507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa040cb940 msgr2=0x7faa040aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.776+0000 7faa0b1ff700 1 --2- 172.21.15.72:0/2577063507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa040cb940 0x7faa040aba60 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7fa9f8006fd0 tx=0x7fa9f8017000).stop 2023-08-31T19:26:15.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.776+0000 7faa0b1ff700 1 -- 172.21.15.72:0/2577063507 shutdown_connections 2023-08-31T19:26:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.776+0000 7faa0b1ff700 1 --2- 172.21.15.72:0/2577063507 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa9e805ef30 0x7fa9e80613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.776+0000 7faa0b1ff700 1 --2- 172.21.15.72:0/2577063507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7faa041588d0 0x7faa0414bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.776+0000 7faa0b1ff700 1 --2- 172.21.15.72:0/2577063507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa040cb940 0x7faa040aba60 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:15.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.776+0000 7faa0b1ff700 1 --2- 172.21.15.72:0/2577063507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa04154220 0x7faa040c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.776+0000 7faa0b1ff700 1 -- 172.21.15.72:0/2577063507 >> 172.21.15.72:0/2577063507 conn(0x7faa0405e870 msgr2=0x7faa040a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.776+0000 7faa0b1ff700 1 -- 172.21.15.72:0/2577063507 shutdown_connections 2023-08-31T19:26:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.776+0000 7faa0b1ff700 1 -- 172.21.15.72:0/2577063507 wait complete. 2023-08-31T19:26:15.794 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-08-31T19:26:15.795 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-08-31T19:26:15.795 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-08-31T19:26:15.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-08-31T19:26:15.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.987+0000 7f12153ff700 1 Processor -- start 2023-08-31T19:26:15.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.987+0000 7f12153ff700 1 -- start start 2023-08-31T19:26:15.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.988+0000 7f12153ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f121015ce50 0x7f121015f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.988+0000 7f12153ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12100c8c90 con 0x7f1210154220 2023-08-31T19:26:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.988+0000 7f12153ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1210158af0 con 0x7f12100cb940 2023-08-31T19:26:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.988+0000 7f12153ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12100aa700 con 0x7f121015ce50 2023-08-31T19:26:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1210154220 0x7f1210157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36038/0 (socket says 172.21.15.72:36038) 2023-08-31T19:26:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120effd700 1 -- 172.21.15.72:0/1132758922 learned_addr learned my addr 172.21.15.72:0/1132758922 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120f7fe700 1 --2- 172.21.15.72:0/1132758922 >> v2:172.21.15.146:3300/0 conn(0x7f121015ce50 0x7f121015f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782432486 0 0) 0x7f12100c8c90 con 0x7f1210154220 2023-08-31T19:26:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f80033f0 con 0x7f1210154220 2023-08-31T19:26:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751760717 0 0) 0x7f1210158af0 con 0x7f12100cb940 2023-08-31T19:26:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12100c8c90 con 0x7f12100cb940 2023-08-31T19:26:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3329527191 0 0) 0x7f11f80033f0 con 0x7f1210154220 2023-08-31T19:26:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 >> v2:172.21.15.146:3300/0 conn(0x7f121015ce50 msgr2=0x7f121015f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:15.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120dffb700 1 --2- 172.21.15.72:0/1132758922 >> v2:172.21.15.146:3300/0 conn(0x7f121015ce50 0x7f121015f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 >> v1:172.21.15.146:6789/0 conn(0x7f12100cb940 legacy=0x7f12101583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1210155610 con 0x7f1210154220 2023-08-31T19:26:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f12000015f0 con 0x7f1210154220 2023-08-31T19:26:15.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 >> v1:172.21.15.72:6789/0 conn(0x7f1210154220 legacy=0x7f1210157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120dffb700 1 --2- 172.21.15.72:0/1132758922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11f8003a70 0x7f11f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.989+0000 7f120dffb700 1 --2- 172.21.15.72:0/1132758922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11f8004690 0x7f11f8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.990+0000 7f120dffb700 1 --2- 172.21.15.72:0/1132758922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f8005000 0x7f11f800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.990+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12100aa700 con 0x7f11f8004690 2023-08-31T19:26:15.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.990+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f800be80 con 0x7f11f8005000 2023-08-31T19:26:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.990+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f800c040 con 0x7f11f8003a70 2023-08-31T19:26:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.990+0000 7f120e7fc700 1 --2- 172.21.15.72:0/1132758922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11f8004690 0x7f11f8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.990+0000 7f120effd700 1 --2- 172.21.15.72:0/1132758922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11f8003a70 0x7f11f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:15.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.990+0000 7f120f7fe700 1 --2- 172.21.15.72:0/1132758922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f8005000 0x7f11f800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.990+0000 7f120e7fc700 1 -- 172.21.15.72:0/1132758922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11f8003a70 msgr2=0x7f11f8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.990+0000 7f120e7fc700 1 --2- 172.21.15.72:0/1132758922 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f11f8003a70 0x7f11f8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.990+0000 7f120e7fc700 1 -- 172.21.15.72:0/1132758922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f8005000 msgr2=0x7f11f800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:15.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.990+0000 7f120e7fc700 1 --2- 172.21.15.72:0/1132758922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f8005000 0x7f11f800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:16.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.990+0000 7f120e7fc700 1 -- 172.21.15.72:0/1132758922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80033f0 con 0x7f11f8004690 2023-08-31T19:26:16.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.990+0000 7f120f7fe700 1 -- 172.21.15.72:0/1132758922 reap_dead start 2023-08-31T19:26:16.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.990+0000 7f120e7fc700 1 --2- 172.21.15.72:0/1132758922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11f8004690 0x7f11f8004b10 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f1204001860 tx=0x7f1204007bb0).ready entity=mon.0 client_cookie=7bcb3334c3f2b38c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:16.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.991+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204007020 con 0x7f11f8004690 2023-08-31T19:26:16.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.991+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1204007180 con 0x7f11f8004690 2023-08-31T19:26:16.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.991+0000 7f120dffb700 1 -- 172.21.15.72:0/1132758922 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204007500 con 0x7f11f8004690 2023-08-31T19:26:16.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.991+0000 7f12153ff700 1 -- 172.21.15.72:0/1132758922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11f8004690 msgr2=0x7f11f8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:16.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.991+0000 7f12153ff700 1 --2- 172.21.15.72:0/1132758922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11f8004690 0x7f11f8004b10 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f1204001860 tx=0x7f1204007bb0).stop 2023-08-31T19:26:16.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.991+0000 7f12153ff700 1 -- 172.21.15.72:0/1132758922 shutdown_connections 2023-08-31T19:26:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.991+0000 7f12153ff700 1 --2- 172.21.15.72:0/1132758922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11f8004690 0x7f11f8004b10 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.991+0000 7f12153ff700 1 -- 172.21.15.72:0/1132758922 >> 172.21.15.72:0/1132758922 conn(0x7f121005e870 msgr2=0x7f12100cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.991+0000 7f12153ff700 1 -- 172.21.15.72:0/1132758922 shutdown_connections 2023-08-31T19:26:16.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.991+0000 7f12153ff700 1 -- 172.21.15.72:0/1132758922 wait complete. 2023-08-31T19:26:16.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.993+0000 7f12153ff700 1 Processor -- start 2023-08-31T19:26:16.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.993+0000 7f12153ff700 1 -- start start 2023-08-31T19:26:16.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f12153ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f8004690 0x7f12101478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:16.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f12153ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12100c6260 0x7f12100c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:16.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f12153ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12100c6bd0 0x7f1210156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:16.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f12153ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12101564e0 con 0x7f12100c6260 2023-08-31T19:26:16.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f12153ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1210147dc0 con 0x7f11f8004690 2023-08-31T19:26:16.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f12153ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12101558d0 con 0x7f12100c6bd0 2023-08-31T19:26:16.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f120e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12100c6260 0x7f12100c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:16.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f120e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12100c6260 0x7f12100c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51410/0 (socket says 172.21.15.72:51410) 2023-08-31T19:26:16.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f120e7fc700 1 -- 172.21.15.72:0/1392930918 learned_addr learned my addr 172.21.15.72:0/1392930918 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:16.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f120effd700 1 --2- 172.21.15.72:0/1392930918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f8004690 0x7f12101478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:16.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f120f7fe700 1 --2- 172.21.15.72:0/1392930918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12100c6bd0 0x7f1210156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f120e7fc700 1 -- 172.21.15.72:0/1392930918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12100c6bd0 msgr2=0x7f1210156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f120e7fc700 1 --2- 172.21.15.72:0/1392930918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12100c6bd0 0x7f1210156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f120e7fc700 1 -- 172.21.15.72:0/1392930918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f8004690 msgr2=0x7f12101478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f120e7fc700 1 --2- 172.21.15.72:0/1392930918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f8004690 0x7f12101478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.995+0000 7f120e7fc700 1 -- 172.21.15.72:0/1392930918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1210155bb0 con 0x7f12100c6260 2023-08-31T19:26:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.996+0000 7f120e7fc700 1 --2- 172.21.15.72:0/1392930918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12100c6260 0x7f12100c66e0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f1204001e50 tx=0x7f1204015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.996+0000 7f11f6ffd700 1 -- 172.21.15.72:0/1392930918 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204012610 con 0x7f12100c6260 2023-08-31T19:26:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.996+0000 7f11f6ffd700 1 -- 172.21.15.72:0/1392930918 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1204012770 con 0x7f12100c6260 2023-08-31T19:26:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.996+0000 7f12153ff700 1 -- 172.21.15.72:0/1392930918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1210155e90 con 0x7f12100c6260 2023-08-31T19:26:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.996+0000 7f11f6ffd700 1 -- 172.21.15.72:0/1392930918 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204012920 con 0x7f12100c6260 2023-08-31T19:26:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.996+0000 7f12153ff700 1 -- 172.21.15.72:0/1392930918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12100c7030 con 0x7f12100c6260 2023-08-31T19:26:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.997+0000 7f12153ff700 1 -- 172.21.15.72:0/1392930918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1210158ac0 con 0x7f12100c6260 2023-08-31T19:26:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.998+0000 7f11f6ffd700 1 -- 172.21.15.72:0/1392930918 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f1204018020 con 0x7f12100c6260 2023-08-31T19:26:16.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.998+0000 7f11f6ffd700 1 --2- 172.21.15.72:0/1392930918 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f11fc05ef30 0x7f11fc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:16.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.999+0000 7f11f6ffd700 1 -- 172.21.15.72:0/1392930918 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f120407a530 con 0x7f12100c6260 2023-08-31T19:26:16.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.999+0000 7f120effd700 1 --2- 172.21.15.72:0/1392930918 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f11fc05ef30 0x7f11fc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:16.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:15.999+0000 7f120effd700 1 --2- 172.21.15.72:0/1392930918 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f11fc05ef30 0x7f11fc0613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f1200000ef0 tx=0x7f1200009040).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:16.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.003+0000 7f11f6ffd700 1 -- 172.21.15.72:0/1392930918 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f120404b740 con 0x7f12100c6260 2023-08-31T19:26:16.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.236+0000 7f12153ff700 1 -- 172.21.15.72:0/1392930918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f121006c6b0 con 0x7f12100c6260 2023-08-31T19:26:16.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.776+0000 7f11f6ffd700 1 -- 172.21.15.72:0/1392930918 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1344) v1 ==== 158+0+0 (secure 0 0 0) 0x7f1204022020 con 0x7f12100c6260 2023-08-31T19:26:16.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.779+0000 7f12153ff700 1 -- 172.21.15.72:0/1392930918 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f11fc05ef30 msgr2=0x7f11fc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:16.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.779+0000 7f12153ff700 1 --2- 172.21.15.72:0/1392930918 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f11fc05ef30 0x7f11fc0613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f1200000ef0 tx=0x7f1200009040).stop 2023-08-31T19:26:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.779+0000 7f12153ff700 1 -- 172.21.15.72:0/1392930918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12100c6260 msgr2=0x7f12100c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.779+0000 7f12153ff700 1 --2- 172.21.15.72:0/1392930918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12100c6260 0x7f12100c66e0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7f1204001e50 tx=0x7f1204015000).stop 2023-08-31T19:26:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.779+0000 7f12153ff700 1 -- 172.21.15.72:0/1392930918 shutdown_connections 2023-08-31T19:26:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.779+0000 7f12153ff700 1 --2- 172.21.15.72:0/1392930918 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f11fc05ef30 0x7f11fc0613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.779+0000 7f12153ff700 1 --2- 172.21.15.72:0/1392930918 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12100c6bd0 0x7f1210156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.779+0000 7f12153ff700 1 --2- 172.21.15.72:0/1392930918 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f8004690 0x7f12101478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.779+0000 7f12153ff700 1 --2- 172.21.15.72:0/1392930918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12100c6260 0x7f12100c66e0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.779+0000 7f12153ff700 1 -- 172.21.15.72:0/1392930918 >> 172.21.15.72:0/1392930918 conn(0x7f121005e870 msgr2=0x7f121014c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.779+0000 7f12153ff700 1 -- 172.21.15.72:0/1392930918 shutdown_connections 2023-08-31T19:26:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.779+0000 7f12153ff700 1 -- 172.21.15.72:0/1392930918 wait complete. 2023-08-31T19:26:16.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-31T19:26:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.993+0000 7f1334dff700 1 Processor -- start 2023-08-31T19:26:16.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.993+0000 7f1334dff700 1 -- start start 2023-08-31T19:26:16.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.994+0000 7f1334dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13301544e0 0x7f133005e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:16.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.994+0000 7f1334dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13300bc4a0 con 0x7f13300c38d0 2023-08-31T19:26:16.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.994+0000 7f1334dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1330069c40 con 0x7f13300690e0 2023-08-31T19:26:16.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.994+0000 7f1334dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133005e840 con 0x7f13301544e0 2023-08-31T19:26:16.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.994+0000 7f132dd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f13300c38d0 0x7f13300689d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36046/0 (socket says 172.21.15.72:36046) 2023-08-31T19:26:16.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.994+0000 7f132dd9b700 1 -- 172.21.15.72:0/961553364 learned_addr learned my addr 172.21.15.72:0/961553364 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:16.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132e59c700 1 --2- 172.21.15.72:0/961553364 >> v2:172.21.15.146:3300/0 conn(0x7f13301544e0 0x7f133005e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:16.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132d59a700 1 -- 172.21.15.72:0/961553364 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786297023 0 0) 0x7f13300bc4a0 con 0x7f13300c38d0 2023-08-31T19:26:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132d59a700 1 -- 172.21.15.72:0/961553364 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13180033f0 con 0x7f13300c38d0 2023-08-31T19:26:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132d59a700 1 -- 172.21.15.72:0/961553364 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3740747735 0 0) 0x7f13180033f0 con 0x7f13300c38d0 2023-08-31T19:26:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132d59a700 1 -- 172.21.15.72:0/961553364 >> v2:172.21.15.146:3300/0 conn(0x7f13301544e0 msgr2=0x7f133005e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:16.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132d59a700 1 --2- 172.21.15.72:0/961553364 >> v2:172.21.15.146:3300/0 conn(0x7f13301544e0 0x7f133005e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132d59a700 1 -- 172.21.15.72:0/961553364 >> v1:172.21.15.146:6789/0 conn(0x7f13300690e0 legacy=0x7f13300bc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132d59a700 1 -- 172.21.15.72:0/961553364 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13300c1c30 con 0x7f13300c38d0 2023-08-31T19:26:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132d59a700 1 -- 172.21.15.72:0/961553364 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f1324001470 con 0x7f13300c38d0 2023-08-31T19:26:17.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132d59a700 1 -- 172.21.15.72:0/961553364 >> v1:172.21.15.72:6789/0 conn(0x7f13300c38d0 legacy=0x7f13300689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132d59a700 1 --2- 172.21.15.72:0/961553364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13180038e0 0x7f1318003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132d59a700 1 --2- 172.21.15.72:0/961553364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1318004690 0x7f1318004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132d59a700 1 --2- 172.21.15.72:0/961553364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1318005000 0x7f131800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132d59a700 1 -- 172.21.15.72:0/961553364 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131800bf00 con 0x7f1318005000 2023-08-31T19:26:17.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132d59a700 1 -- 172.21.15.72:0/961553364 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131800c070 con 0x7f1318004690 2023-08-31T19:26:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.995+0000 7f132d59a700 1 -- 172.21.15.72:0/961553364 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131800c230 con 0x7f13180038e0 2023-08-31T19:26:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.996+0000 7f132ed9d700 1 --2- 172.21.15.72:0/961553364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1318005000 0x7f131800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.996+0000 7f132e59c700 1 --2- 172.21.15.72:0/961553364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13180038e0 0x7f1318003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.996+0000 7f132dd9b700 1 --2- 172.21.15.72:0/961553364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1318004690 0x7f1318004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:17.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.996+0000 7f132ed9d700 1 -- 172.21.15.72:0/961553364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13180038e0 msgr2=0x7f1318003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.996+0000 7f132ed9d700 1 --2- 172.21.15.72:0/961553364 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f13180038e0 0x7f1318003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.996+0000 7f132ed9d700 1 -- 172.21.15.72:0/961553364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1318004690 msgr2=0x7f1318004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.996+0000 7f132ed9d700 1 --2- 172.21.15.72:0/961553364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1318004690 0x7f1318004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.996+0000 7f132ed9d700 1 -- 172.21.15.72:0/961553364 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13180033f0 con 0x7f1318005000 2023-08-31T19:26:17.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.996+0000 7f132ed9d700 1 -- 172.21.15.72:0/961553364 reap_dead start 2023-08-31T19:26:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.996+0000 7f132ed9d700 1 --2- 172.21.15.72:0/961553364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1318005000 0x7f131800b8e0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f1328001f20 tx=0x7f1328007f10).ready entity=mon.0 client_cookie=3144f6ac882a4933 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.996+0000 7f132d59a700 1 -- 172.21.15.72:0/961553364 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13280017e0 con 0x7f1318005000 2023-08-31T19:26:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.996+0000 7f132d59a700 1 -- 172.21.15.72:0/961553364 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132800c6d0 con 0x7f1318005000 2023-08-31T19:26:17.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.997+0000 7f132d59a700 1 -- 172.21.15.72:0/961553364 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132800ca70 con 0x7f1318005000 2023-08-31T19:26:17.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.997+0000 7f1334dff700 1 -- 172.21.15.72:0/961553364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1318005000 msgr2=0x7f131800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:17.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.997+0000 7f1334dff700 1 --2- 172.21.15.72:0/961553364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1318005000 0x7f131800b8e0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f1328001f20 tx=0x7f1328007f10).stop 2023-08-31T19:26:17.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.997+0000 7f1334dff700 1 -- 172.21.15.72:0/961553364 shutdown_connections 2023-08-31T19:26:17.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.997+0000 7f1334dff700 1 --2- 172.21.15.72:0/961553364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1318005000 0x7f131800b8e0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.997+0000 7f1334dff700 1 -- 172.21.15.72:0/961553364 >> 172.21.15.72:0/961553364 conn(0x7f13300c7e00 msgr2=0x7f13300c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:17.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.997+0000 7f1334dff700 1 -- 172.21.15.72:0/961553364 shutdown_connections 2023-08-31T19:26:17.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.997+0000 7f1334dff700 1 -- 172.21.15.72:0/961553364 wait complete. 2023-08-31T19:26:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.999+0000 7f1334dff700 1 Processor -- start 2023-08-31T19:26:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:16.999+0000 7f1334dff700 1 -- start start 2023-08-31T19:26:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f1334dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1318005000 0x7f1330150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:17.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f1334dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330151070 0x7f13300ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f1334dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13300aca20 0x7f13301553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f1334dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330157330 con 0x7f13300aca20 2023-08-31T19:26:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f1334dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330156710 con 0x7f1330151070 2023-08-31T19:26:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f1334dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13300aced0 con 0x7f1318005000 2023-08-31T19:26:17.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f132ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13300aca20 0x7f13301553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f132ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13300aca20 0x7f13301553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51430/0 (socket says 172.21.15.72:51430) 2023-08-31T19:26:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f132ed9d700 1 -- 172.21.15.72:0/1791996845 learned_addr learned my addr 172.21.15.72:0/1791996845 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f132e59c700 1 --2- 172.21.15.72:0/1791996845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1318005000 0x7f1330150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f132dd9b700 1 --2- 172.21.15.72:0/1791996845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330151070 0x7f13300ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:17.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f132ed9d700 1 -- 172.21.15.72:0/1791996845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1318005000 msgr2=0x7f1330150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f132ed9d700 1 --2- 172.21.15.72:0/1791996845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1318005000 0x7f1330150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f132ed9d700 1 -- 172.21.15.72:0/1791996845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330151070 msgr2=0x7f13300ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f132ed9d700 1 --2- 172.21.15.72:0/1791996845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330151070 0x7f13300ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f132ed9d700 1 -- 172.21.15.72:0/1791996845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13300be700 con 0x7f13300aca20 2023-08-31T19:26:17.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.000+0000 7f132ed9d700 1 --2- 172.21.15.72:0/1791996845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13300aca20 0x7f13301553b0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f13280016c0 tx=0x7f1328017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.001+0000 7f131e7fc700 1 -- 172.21.15.72:0/1791996845 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328007250 con 0x7f13300aca20 2023-08-31T19:26:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.001+0000 7f131e7fc700 1 -- 172.21.15.72:0/1791996845 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13280073b0 con 0x7f13300aca20 2023-08-31T19:26:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.001+0000 7f131e7fc700 1 -- 172.21.15.72:0/1791996845 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13280077b0 con 0x7f13300aca20 2023-08-31T19:26:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.001+0000 7f1334dff700 1 -- 172.21.15.72:0/1791996845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1330156180 con 0x7f13300aca20 2023-08-31T19:26:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.001+0000 7f1334dff700 1 -- 172.21.15.72:0/1791996845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13300be990 con 0x7f13300aca20 2023-08-31T19:26:17.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.002+0000 7f1334dff700 1 -- 172.21.15.72:0/1791996845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133006c6b0 con 0x7f13300aca20 2023-08-31T19:26:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.002+0000 7f131e7fc700 1 -- 172.21.15.72:0/1791996845 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f1328019030 con 0x7f13300aca20 2023-08-31T19:26:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.003+0000 7f131e7fc700 1 --2- 172.21.15.72:0/1791996845 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f131005ef30 0x7f13100613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.003+0000 7f131e7fc700 1 -- 172.21.15.72:0/1791996845 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f132807acc0 con 0x7f13300aca20 2023-08-31T19:26:17.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.003+0000 7f132e59c700 1 --2- 172.21.15.72:0/1791996845 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f131005ef30 0x7f13100613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:17.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.004+0000 7f132e59c700 1 --2- 172.21.15.72:0/1791996845 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f131005ef30 0x7f13100613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f1320006d50 tx=0x7f1320008040).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:17.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.007+0000 7f131e7fc700 1 -- 172.21.15.72:0/1791996845 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f132804be20 con 0x7f13300aca20 2023-08-31T19:26:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.177+0000 7f1334dff700 1 -- 172.21.15.72:0/1791996845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f133005ece0 con 0x7f13300aca20 2023-08-31T19:26:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.181+0000 7f131e7fc700 1 -- 172.21.15.72:0/1791996845 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1328007910 con 0x7f13300aca20 2023-08-31T19:26:17.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.183+0000 7f1334dff700 1 -- 172.21.15.72:0/1791996845 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f131005ef30 msgr2=0x7f13100613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:17.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.183+0000 7f1334dff700 1 --2- 172.21.15.72:0/1791996845 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f131005ef30 0x7f13100613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f1320006d50 tx=0x7f1320008040).stop 2023-08-31T19:26:17.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.183+0000 7f1334dff700 1 -- 172.21.15.72:0/1791996845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13300aca20 msgr2=0x7f13301553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:17.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.183+0000 7f1334dff700 1 --2- 172.21.15.72:0/1791996845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13300aca20 0x7f13301553b0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f13280016c0 tx=0x7f1328017000).stop 2023-08-31T19:26:17.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.184+0000 7f1334dff700 1 -- 172.21.15.72:0/1791996845 shutdown_connections 2023-08-31T19:26:17.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.184+0000 7f1334dff700 1 --2- 172.21.15.72:0/1791996845 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f131005ef30 0x7f13100613f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.184+0000 7f1334dff700 1 --2- 172.21.15.72:0/1791996845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13300aca20 0x7f13301553b0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.184+0000 7f1334dff700 1 --2- 172.21.15.72:0/1791996845 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1318005000 0x7f1330150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.184+0000 7f1334dff700 1 --2- 172.21.15.72:0/1791996845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1330151070 0x7f13300ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.184+0000 7f1334dff700 1 -- 172.21.15.72:0/1791996845 >> 172.21.15.72:0/1791996845 conn(0x7f13300c7e00 msgr2=0x7f13300689d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:17.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.184+0000 7f1334dff700 1 -- 172.21.15.72:0/1791996845 shutdown_connections 2023-08-31T19:26:17.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.184+0000 7f1334dff700 1 -- 172.21.15.72:0/1791996845 wait complete. 2023-08-31T19:26:17.201 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:26:17.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:26:17.300 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:26:17.411 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:26:17.412 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-31T19:26:17.412 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:26:17.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.601+0000 7f7db51ff700 1 Processor -- start 2023-08-31T19:26:17.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.601+0000 7f7db51ff700 1 -- start start 2023-08-31T19:26:17.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.602+0000 7f7db51ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7db0135030 0x7f7db00c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:17.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.602+0000 7f7db51ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db00bba70 0x7f7db00c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:17.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.602+0000 7f7db51ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7db0155c00 0x7f7db01560b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:17.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.602+0000 7f7db51ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db00c1e80 con 0x7f7db0135030 2023-08-31T19:26:17.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.602+0000 7f7db51ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db00c26b0 con 0x7f7db0155c00 2023-08-31T19:26:17.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.602+0000 7f7db51ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00bc250 con 0x7f7db00bba70 2023-08-31T19:26:17.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.603+0000 7f7daed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7db0135030 0x7f7db00c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:17.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.603+0000 7f7daed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7db0135030 0x7f7db00c7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51442/0 (socket says 172.21.15.72:51442) 2023-08-31T19:26:17.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.603+0000 7f7daed9d700 1 -- 172.21.15.72:0/1594324950 learned_addr learned my addr 172.21.15.72:0/1594324950 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:17.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.603+0000 7f7dae59c700 1 --2- 172.21.15.72:0/1594324950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db00bba70 0x7f7db00c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:17.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.603+0000 7f7daed9d700 1 -- 172.21.15.72:0/1594324950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db00bba70 msgr2=0x7f7db00c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:17.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.603+0000 7f7daed9d700 1 --2- 172.21.15.72:0/1594324950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db00bba70 0x7f7db00c2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.603+0000 7f7daf59e700 1 --2- 172.21.15.72:0/1594324950 >> v2:172.21.15.146:3300/0 conn(0x7f7db0155c00 0x7f7db01560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:17.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.603+0000 7f7daed9d700 1 -- 172.21.15.72:0/1594324950 >> v2:172.21.15.146:3300/0 conn(0x7f7db0155c00 msgr2=0x7f7db01560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:17.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.603+0000 7f7daed9d700 1 --2- 172.21.15.72:0/1594324950 >> v2:172.21.15.146:3300/0 conn(0x7f7db0155c00 0x7f7db01560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.603+0000 7f7daed9d700 1 -- 172.21.15.72:0/1594324950 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db01565a0 con 0x7f7db0135030 2023-08-31T19:26:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.603+0000 7f7dae59c700 1 --2- 172.21.15.72:0/1594324950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db00bba70 0x7f7db00c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.603+0000 7f7daf59e700 1 --2- 172.21.15.72:0/1594324950 >> v2:172.21.15.146:3300/0 conn(0x7f7db0155c00 0x7f7db01560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.603+0000 7f7daed9d700 1 --2- 172.21.15.72:0/1594324950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7db0135030 0x7f7db00c7630 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f7db00c3560 tx=0x7f7da00090f0).ready entity=mon.0 client_cookie=c65489ba16ed59b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.604+0000 7f7dadd9b700 1 -- 172.21.15.72:0/1594324950 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da000b600 con 0x7f7db0135030 2023-08-31T19:26:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.604+0000 7f7dadd9b700 1 -- 172.21.15.72:0/1594324950 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da000b760 con 0x7f7db0135030 2023-08-31T19:26:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.604+0000 7f7dadd9b700 1 -- 172.21.15.72:0/1594324950 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da000bae0 con 0x7f7db0135030 2023-08-31T19:26:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.604+0000 7f7db51ff700 1 -- 172.21.15.72:0/1594324950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7db0135030 msgr2=0x7f7db00c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.604+0000 7f7db51ff700 1 --2- 172.21.15.72:0/1594324950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7db0135030 0x7f7db00c7630 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f7db00c3560 tx=0x7f7da00090f0).stop 2023-08-31T19:26:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.604+0000 7f7db51ff700 1 -- 172.21.15.72:0/1594324950 shutdown_connections 2023-08-31T19:26:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.604+0000 7f7db51ff700 1 --2- 172.21.15.72:0/1594324950 >> v2:172.21.15.146:3300/0 conn(0x7f7db0155c00 0x7f7db01560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.604+0000 7f7db51ff700 1 --2- 172.21.15.72:0/1594324950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7db0135030 0x7f7db00c7630 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.604+0000 7f7db51ff700 1 --2- 172.21.15.72:0/1594324950 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db00bba70 0x7f7db00c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.604+0000 7f7db51ff700 1 -- 172.21.15.72:0/1594324950 >> 172.21.15.72:0/1594324950 conn(0x7f7db00c6b10 msgr2=0x7f7db00c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.604+0000 7f7db51ff700 1 -- 172.21.15.72:0/1594324950 shutdown_connections 2023-08-31T19:26:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.604+0000 7f7db51ff700 1 -- 172.21.15.72:0/1594324950 wait complete. 2023-08-31T19:26:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.606+0000 7f7db51ff700 1 Processor -- start 2023-08-31T19:26:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.606+0000 7f7db51ff700 1 -- start start 2023-08-31T19:26:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.607+0000 7f7db51ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db00bba70 0x7f7db00bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.607+0000 7f7db51ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db0135030 0x7f7db01547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.607+0000 7f7db51ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7db0155c00 0x7f7db00aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.607+0000 7f7db51ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00a9aa0 con 0x7f7db0155c00 2023-08-31T19:26:17.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.607+0000 7f7db51ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00aa900 con 0x7f7db00bba70 2023-08-31T19:26:17.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.607+0000 7f7db51ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00a9cf0 con 0x7f7db0135030 2023-08-31T19:26:17.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.607+0000 7f7daf59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7db0155c00 0x7f7db00aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:17.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.607+0000 7f7daf59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7db0155c00 0x7f7db00aad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51446/0 (socket says 172.21.15.72:51446) 2023-08-31T19:26:17.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.607+0000 7f7daf59e700 1 -- 172.21.15.72:0/1182174958 learned_addr learned my addr 172.21.15.72:0/1182174958 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:17.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.608+0000 7f7dae59c700 1 --2- 172.21.15.72:0/1182174958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db0135030 0x7f7db01547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:17.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.608+0000 7f7daed9d700 1 --2- 172.21.15.72:0/1182174958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db00bba70 0x7f7db00bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:17.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.608+0000 7f7daf59e700 1 -- 172.21.15.72:0/1182174958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db0135030 msgr2=0x7f7db01547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:17.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.608+0000 7f7daf59e700 1 --2- 172.21.15.72:0/1182174958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db0135030 0x7f7db01547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.608+0000 7f7daf59e700 1 -- 172.21.15.72:0/1182174958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db00bba70 msgr2=0x7f7db00bfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:17.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.608+0000 7f7daf59e700 1 --2- 172.21.15.72:0/1182174958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db00bba70 0x7f7db00bfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.608+0000 7f7daf59e700 1 -- 172.21.15.72:0/1182174958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da0009370 con 0x7f7db0155c00 2023-08-31T19:26:17.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.608+0000 7f7daf59e700 1 --2- 172.21.15.72:0/1182174958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7db0155c00 0x7f7db00aad90 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f7da800a380 tx=0x7f7da8007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:17.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.608+0000 7f7d96ffd700 1 -- 172.21.15.72:0/1182174958 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da800ae10 con 0x7f7db0155c00 2023-08-31T19:26:17.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.608+0000 7f7d96ffd700 1 -- 172.21.15.72:0/1182174958 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da800d650 con 0x7f7db0155c00 2023-08-31T19:26:17.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.608+0000 7f7db51ff700 1 -- 172.21.15.72:0/1182174958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db00a9fd0 con 0x7f7db0155c00 2023-08-31T19:26:17.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.608+0000 7f7d96ffd700 1 -- 172.21.15.72:0/1182174958 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da800d9d0 con 0x7f7db0155c00 2023-08-31T19:26:17.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.608+0000 7f7db51ff700 1 -- 172.21.15.72:0/1182174958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db00aa590 con 0x7f7db0155c00 2023-08-31T19:26:17.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.609+0000 7f7db51ff700 1 -- 172.21.15.72:0/1182174958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db00aaa70 con 0x7f7db0155c00 2023-08-31T19:26:17.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.610+0000 7f7d96ffd700 1 -- 172.21.15.72:0/1182174958 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7da8013070 con 0x7f7db0155c00 2023-08-31T19:26:17.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.611+0000 7f7d96ffd700 1 --2- 172.21.15.72:0/1182174958 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7d9c05ef30 0x7f7d9c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:17.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.611+0000 7f7d96ffd700 1 -- 172.21.15.72:0/1182174958 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6527+0+0 (secure 0 0 0) 0x7f7da807a990 con 0x7f7db0155c00 2023-08-31T19:26:17.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.611+0000 7f7daed9d700 1 --2- 172.21.15.72:0/1182174958 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7d9c05ef30 0x7f7d9c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:17.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.612+0000 7f7daed9d700 1 --2- 172.21.15.72:0/1182174958 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7d9c05ef30 0x7f7d9c0613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7da0009130 tx=0x7f7da0017000).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:17.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.615+0000 7f7d96ffd700 1 -- 172.21.15.72:0/1182174958 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7da804ba30 con 0x7f7db0155c00 2023-08-31T19:26:17.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.827+0000 7f7db51ff700 1 -- 172.21.15.72:0/1182174958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7db00bbf70 con 0x7f7db0155c00 2023-08-31T19:26:17.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.827+0000 7f7d96ffd700 1 -- 172.21.15.72:0/1182174958 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f7da801b020 con 0x7f7db0155c00 2023-08-31T19:26:17.828 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:17.828 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":81,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7283,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6833/3355816598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":3355816598},{"type":"v1","addr":"172.21.15.146:6833","nonce":3355816598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/197878546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":197878546},{"type":"v1","addr":"172.21.15.146:6835","nonce":197878546}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2229531329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2229531329},{"type":"v1","addr":"172.21.15.72:6836","nonce":2229531329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":74},{"gid":9426,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2500448932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2500448932},{"type":"v1","addr":"172.21.15.72:6837","nonce":2500448932}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[]} 2023-08-31T19:26:17.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.829+0000 7f7db51ff700 1 -- 172.21.15.72:0/1182174958 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7d9c05ef30 msgr2=0x7f7d9c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:17.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.829+0000 7f7db51ff700 1 --2- 172.21.15.72:0/1182174958 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7d9c05ef30 0x7f7d9c0613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f7da0009130 tx=0x7f7da0017000).stop 2023-08-31T19:26:17.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.829+0000 7f7db51ff700 1 -- 172.21.15.72:0/1182174958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7db0155c00 msgr2=0x7f7db00aad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:17.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.829+0000 7f7db51ff700 1 --2- 172.21.15.72:0/1182174958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7db0155c00 0x7f7db00aad90 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f7da800a380 tx=0x7f7da8007900).stop 2023-08-31T19:26:17.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.829+0000 7f7db51ff700 1 -- 172.21.15.72:0/1182174958 shutdown_connections 2023-08-31T19:26:17.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.829+0000 7f7db51ff700 1 --2- 172.21.15.72:0/1182174958 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7d9c05ef30 0x7f7d9c0613f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.829+0000 7f7db51ff700 1 --2- 172.21.15.72:0/1182174958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7db0155c00 0x7f7db00aad90 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.829+0000 7f7db51ff700 1 --2- 172.21.15.72:0/1182174958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7db00bba70 0x7f7db00bfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.829+0000 7f7db51ff700 1 --2- 172.21.15.72:0/1182174958 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7db0135030 0x7f7db01547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.829+0000 7f7db51ff700 1 -- 172.21.15.72:0/1182174958 >> 172.21.15.72:0/1182174958 conn(0x7f7db00c6b10 msgr2=0x7f7db00c49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.829+0000 7f7db51ff700 1 -- 172.21.15.72:0/1182174958 shutdown_connections 2023-08-31T19:26:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:17.829+0000 7f7db51ff700 1 -- 172.21.15.72:0/1182174958 wait complete. 2023-08-31T19:26:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 81 2023-08-31T19:26:17.847 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T19:26:17.848 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-31T19:26:17.848 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T19:26:17.848 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:26:17.849 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T19:26:17.849 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-31T19:26:17.849 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T19:26:17.849 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:26:17.850 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T19:26:17.850 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-31T19:26:17.850 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T19:26:17.850 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:26:17.851 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T19:26:17.851 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-31T19:26:17.851 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T19:26:17.852 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:26:17.861 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T19:26:17.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T19:26:17.863 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T19:26:17.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T19:26:17.867 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T19:26:17.867 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T19:26:17.868 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T19:26:17.868 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T19:26:17.907 INFO:tasks.ceph.mds.a:Started 2023-08-31T19:26:17.907 DEBUG:teuthology.parallel:result is None 2023-08-31T19:26:17.910 INFO:tasks.ceph.mds.c:Started 2023-08-31T19:26:17.911 DEBUG:teuthology.parallel:result is None 2023-08-31T19:26:17.912 INFO:tasks.ceph.mds.d:Started 2023-08-31T19:26:17.912 DEBUG:teuthology.parallel:result is None 2023-08-31T19:26:17.915 INFO:tasks.ceph.mds.b:Started 2023-08-31T19:26:17.915 DEBUG:teuthology.parallel:result is None 2023-08-31T19:26:17.915 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-31T19:26:18.053 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-08-31T19:26:18.053 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-08-31T19:26:18.061 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-08-31T19:26:18.061 INFO:tasks.ceph.mds.d.smithi146.stdout:starting mds.d at 2023-08-31T19:26:18.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.122+0000 7efdb01ff700 1 Processor -- start 2023-08-31T19:26:18.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.122+0000 7efdb01ff700 1 -- start start 2023-08-31T19:26:18.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.123+0000 7efdb01ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efda81378e0 0x7efda8152230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:18.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.123+0000 7efdb01ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80bd3c0 0x7efda80c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:18.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.123+0000 7efdb01ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda806a390 con 0x7efda8065720 2023-08-31T19:26:18.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.123+0000 7efdb01ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda8137cc0 con 0x7efda81378e0 2023-08-31T19:26:18.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.123+0000 7efdb01ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda8069780 con 0x7efda80bd3c0 2023-08-31T19:26:18.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.124+0000 7efdadf9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efda81378e0 0x7efda8152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:18.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.124+0000 7efdae79c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80bd3c0 0x7efda80c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:18.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.124+0000 7efdadf9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efda81378e0 0x7efda8152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:56928/0 (socket says 172.21.15.72:56928) 2023-08-31T19:26:18.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.124+0000 7efdae79c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80bd3c0 0x7efda80c14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:52936/0 (socket says 172.21.15.72:52936) 2023-08-31T19:26:18.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.124+0000 7efdadf9b700 1 -- 172.21.15.72:0/854938354 learned_addr learned my addr 172.21.15.72:0/854938354 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:18.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.124+0000 7efdadf9b700 1 -- 172.21.15.72:0/854938354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80bd3c0 msgr2=0x7efda80c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:18.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.124+0000 7efdadf9b700 1 --2- 172.21.15.72:0/854938354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80bd3c0 0x7efda80c14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:18.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.124+0000 7efdadf9b700 1 -- 172.21.15.72:0/854938354 >> v1:172.21.15.146:6789/0 conn(0x7efda8065720 legacy=0x7efda80bccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:18.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.124+0000 7efdadf9b700 1 -- 172.21.15.72:0/854938354 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda8069a60 con 0x7efda81378e0 2023-08-31T19:26:18.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.124+0000 7efdae79c700 1 --2- 172.21.15.72:0/854938354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80bd3c0 0x7efda80c14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:18.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.124+0000 7efdacf99700 1 -- 172.21.15.72:0/854938354 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019265387 0 0) 0x7efda806a390 con 0x7efda8065720 2023-08-31T19:26:18.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.124+0000 7efdadf9b700 1 --2- 172.21.15.72:0/854938354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efda81378e0 0x7efda8152230 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7efda4006fd0 tx=0x7efda40090f0).ready entity=mon.1 client_cookie=9851dbcceb25d80b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:18.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.125+0000 7efdacf99700 1 -- 172.21.15.72:0/854938354 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda400b580 con 0x7efda81378e0 2023-08-31T19:26:18.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.125+0000 7efdacf99700 1 -- 172.21.15.72:0/854938354 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda400b6e0 con 0x7efda81378e0 2023-08-31T19:26:18.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.125+0000 7efdacf99700 1 -- 172.21.15.72:0/854938354 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda400ba60 con 0x7efda81378e0 2023-08-31T19:26:18.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.125+0000 7efdb01ff700 1 -- 172.21.15.72:0/854938354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efda81378e0 msgr2=0x7efda8152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:18.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.125+0000 7efdb01ff700 1 --2- 172.21.15.72:0/854938354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efda81378e0 0x7efda8152230 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7efda4006fd0 tx=0x7efda40090f0).stop 2023-08-31T19:26:18.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.125+0000 7efdb01ff700 1 -- 172.21.15.72:0/854938354 shutdown_connections 2023-08-31T19:26:18.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.125+0000 7efdb01ff700 1 --2- 172.21.15.72:0/854938354 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80bd3c0 0x7efda80c14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:18.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.125+0000 7efdb01ff700 1 --2- 172.21.15.72:0/854938354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efda81378e0 0x7efda8152230 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:18.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.125+0000 7efdb01ff700 1 -- 172.21.15.72:0/854938354 >> 172.21.15.72:0/854938354 conn(0x7efda8063120 msgr2=0x7efda80c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:18.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.125+0000 7efdb01ff700 1 -- 172.21.15.72:0/854938354 shutdown_connections 2023-08-31T19:26:18.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.125+0000 7efdb01ff700 1 -- 172.21.15.72:0/854938354 wait complete. 2023-08-31T19:26:18.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.127+0000 7efdb01ff700 1 Processor -- start 2023-08-31T19:26:18.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.127+0000 7efdb01ff700 1 -- start start 2023-08-31T19:26:18.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.128+0000 7efdb01ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efda8065720 0x7efda8140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:18.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.128+0000 7efdb01ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80bd3c0 0x7efda80ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:18.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.128+0000 7efdb01ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efda81378e0 0x7efda80bc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:18.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.128+0000 7efdb01ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda80a5f20 con 0x7efda81378e0 2023-08-31T19:26:18.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.128+0000 7efdb01ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda8150270 con 0x7efda8065720 2023-08-31T19:26:18.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.128+0000 7efdb01ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda80a6170 con 0x7efda80bd3c0 2023-08-31T19:26:18.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.128+0000 7efdae79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efda81378e0 0x7efda80bc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:18.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.128+0000 7efdae79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efda81378e0 0x7efda80bc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51480/0 (socket says 172.21.15.72:51480) 2023-08-31T19:26:18.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.128+0000 7efdae79c700 1 -- 172.21.15.72:0/304564982 learned_addr learned my addr 172.21.15.72:0/304564982 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:18.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.128+0000 7efdadf9b700 1 --2- 172.21.15.72:0/304564982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efda8065720 0x7efda8140130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:18.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.128+0000 7efdad79a700 1 --2- 172.21.15.72:0/304564982 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80bd3c0 0x7efda80ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:18.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.129+0000 7efdae79c700 1 -- 172.21.15.72:0/304564982 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80bd3c0 msgr2=0x7efda80ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:18.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.129+0000 7efdae79c700 1 --2- 172.21.15.72:0/304564982 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80bd3c0 0x7efda80ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:18.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.129+0000 7efdae79c700 1 -- 172.21.15.72:0/304564982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efda8065720 msgr2=0x7efda8140130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:18.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.129+0000 7efdae79c700 1 --2- 172.21.15.72:0/304564982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efda8065720 0x7efda8140130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:18.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.129+0000 7efdae79c700 1 -- 172.21.15.72:0/304564982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda0009a20 con 0x7efda81378e0 2023-08-31T19:26:18.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.129+0000 7efdae79c700 1 --2- 172.21.15.72:0/304564982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efda81378e0 0x7efda80bc200 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7efda0009f50 tx=0x7efda000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:18.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.129+0000 7efd9dffb700 1 -- 172.21.15.72:0/304564982 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda000cb80 con 0x7efda81378e0 2023-08-31T19:26:18.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.129+0000 7efd9dffb700 1 -- 172.21.15.72:0/304564982 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda000f040 con 0x7efda81378e0 2023-08-31T19:26:18.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.129+0000 7efdb01ff700 1 -- 172.21.15.72:0/304564982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda4009370 con 0x7efda81378e0 2023-08-31T19:26:18.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.129+0000 7efd9dffb700 1 -- 172.21.15.72:0/304564982 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda0013400 con 0x7efda81378e0 2023-08-31T19:26:18.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.129+0000 7efdb01ff700 1 -- 172.21.15.72:0/304564982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda80a6730 con 0x7efda81378e0 2023-08-31T19:26:18.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.130+0000 7efdb01ff700 1 -- 172.21.15.72:0/304564982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda806c6b0 con 0x7efda81378e0 2023-08-31T19:26:18.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.131+0000 7efd9dffb700 1 -- 172.21.15.72:0/304564982 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7efda00137f0 con 0x7efda81378e0 2023-08-31T19:26:18.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.132+0000 7efd9dffb700 1 --2- 172.21.15.72:0/304564982 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7efd8c05ef30 0x7efd8c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:18.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.132+0000 7efd9dffb700 1 -- 172.21.15.72:0/304564982 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6527+0+0 (secure 0 0 0) 0x7efda007aa30 con 0x7efda81378e0 2023-08-31T19:26:18.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.132+0000 7efdadf9b700 1 --2- 172.21.15.72:0/304564982 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7efd8c05ef30 0x7efd8c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:18.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.132+0000 7efdadf9b700 1 --2- 172.21.15.72:0/304564982 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7efd8c05ef30 0x7efd8c0613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7efda4009130 tx=0x7efda4017000).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:18.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.135+0000 7efd9dffb700 1 -- 172.21.15.72:0/304564982 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efda007ce60 con 0x7efda81378e0 2023-08-31T19:26:18.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:18.321+0000 7efdb01ff700 1 -- 172.21.15.72:0/304564982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7efda80653f0 con 0x7efda81378e0 2023-08-31T19:26:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.185+0000 7efd9dffb700 1 -- 172.21.15.72:0/304564982 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v191) v1 ==== 97+0+0 (secure 0 0 0) 0x7efda004bb90 con 0x7efda81378e0 2023-08-31T19:26:19.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.188+0000 7efdb01ff700 1 -- 172.21.15.72:0/304564982 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7efd8c05ef30 msgr2=0x7efd8c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.188+0000 7efdb01ff700 1 --2- 172.21.15.72:0/304564982 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7efd8c05ef30 0x7efd8c0613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7efda4009130 tx=0x7efda4017000).stop 2023-08-31T19:26:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.188+0000 7efdb01ff700 1 -- 172.21.15.72:0/304564982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efda81378e0 msgr2=0x7efda80bc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.188+0000 7efdb01ff700 1 --2- 172.21.15.72:0/304564982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efda81378e0 0x7efda80bc200 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7efda0009f50 tx=0x7efda000b040).stop 2023-08-31T19:26:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.188+0000 7efdb01ff700 1 -- 172.21.15.72:0/304564982 shutdown_connections 2023-08-31T19:26:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.188+0000 7efdb01ff700 1 --2- 172.21.15.72:0/304564982 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7efd8c05ef30 0x7efd8c0613f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.188+0000 7efdb01ff700 1 --2- 172.21.15.72:0/304564982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efda81378e0 0x7efda80bc200 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.188+0000 7efdb01ff700 1 --2- 172.21.15.72:0/304564982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efda8065720 0x7efda8140130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.188+0000 7efdb01ff700 1 --2- 172.21.15.72:0/304564982 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7efda80bd3c0 0x7efda80ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.188+0000 7efdb01ff700 1 -- 172.21.15.72:0/304564982 >> 172.21.15.72:0/304564982 conn(0x7efda8063120 msgr2=0x7efda80a5620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.188+0000 7efdb01ff700 1 -- 172.21.15.72:0/304564982 shutdown_connections 2023-08-31T19:26:19.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.188+0000 7efdb01ff700 1 -- 172.21.15.72:0/304564982 wait complete. 2023-08-31T19:26:19.191 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-08-31T19:26:19.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-31T19:26:19.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.401+0000 7f030a1ff700 1 Processor -- start 2023-08-31T19:26:19.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.401+0000 7f030a1ff700 1 -- start start 2023-08-31T19:26:19.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.402+0000 7f030a1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03040c5fb0 0x7f03040be370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:19.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.402+0000 7f030a1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03040c46c0 0x7f0304063a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:19.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.402+0000 7f030a1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03040bece0 con 0x7f03040be860 2023-08-31T19:26:19.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.402+0000 7f030a1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0304154690 con 0x7f03040c5fb0 2023-08-31T19:26:19.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.402+0000 7f030a1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03040bfb20 con 0x7f03040c46c0 2023-08-31T19:26:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.403+0000 7f03037fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03040c5fb0 0x7f03040be370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.403+0000 7f0303fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03040c46c0 0x7f0304063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.403+0000 7f0303fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03040c46c0 0x7f0304063a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:52948/0 (socket says 172.21.15.72:52948) 2023-08-31T19:26:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.403+0000 7f0303fff700 1 -- 172.21.15.72:0/3543696718 learned_addr learned my addr 172.21.15.72:0/3543696718 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.403+0000 7f03037fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03040c5fb0 0x7f03040be370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:56952/0 (socket says 172.21.15.72:56952) 2023-08-31T19:26:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.403+0000 7f0303fff700 1 -- 172.21.15.72:0/3543696718 >> v2:172.21.15.146:3300/0 conn(0x7f03040c5fb0 msgr2=0x7f03040be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.403+0000 7f0303fff700 1 --2- 172.21.15.72:0/3543696718 >> v2:172.21.15.146:3300/0 conn(0x7f03040c5fb0 0x7f03040be370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.403+0000 7f0303fff700 1 -- 172.21.15.72:0/3543696718 >> v1:172.21.15.146:6789/0 conn(0x7f03040be860 legacy=0x7f03040c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.403+0000 7f0303fff700 1 -- 172.21.15.72:0/3543696718 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03040bef10 con 0x7f03040c46c0 2023-08-31T19:26:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.403+0000 7f03027fc700 1 -- 172.21.15.72:0/3543696718 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886718038 0 0) 0x7f03040bece0 con 0x7f03040be860 2023-08-31T19:26:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.403+0000 7f03037fe700 1 --2- 172.21.15.72:0/3543696718 >> v2:172.21.15.146:3300/0 conn(0x7f03040c5fb0 0x7f03040be370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.404+0000 7f0303fff700 1 --2- 172.21.15.72:0/3543696718 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03040c46c0 0x7f0304063a90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f02fc009f20 tx=0x7f02fc009840).ready entity=mon.2 client_cookie=fa43339bbad991f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.404+0000 7f03027fc700 1 -- 172.21.15.72:0/3543696718 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc00e070 con 0x7f03040c46c0 2023-08-31T19:26:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.404+0000 7f03027fc700 1 -- 172.21.15.72:0/3543696718 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02fc00b9d0 con 0x7f03040c46c0 2023-08-31T19:26:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.404+0000 7f03027fc700 1 -- 172.21.15.72:0/3543696718 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc00bd50 con 0x7f03040c46c0 2023-08-31T19:26:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.404+0000 7f030a1ff700 1 -- 172.21.15.72:0/3543696718 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03040c46c0 msgr2=0x7f0304063a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.404+0000 7f030a1ff700 1 --2- 172.21.15.72:0/3543696718 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03040c46c0 0x7f0304063a90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f02fc009f20 tx=0x7f02fc009840).stop 2023-08-31T19:26:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.404+0000 7f030a1ff700 1 -- 172.21.15.72:0/3543696718 shutdown_connections 2023-08-31T19:26:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.404+0000 7f030a1ff700 1 --2- 172.21.15.72:0/3543696718 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03040c46c0 0x7f0304063a90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.404+0000 7f030a1ff700 1 --2- 172.21.15.72:0/3543696718 >> v2:172.21.15.146:3300/0 conn(0x7f03040c5fb0 0x7f03040be370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.405+0000 7f030a1ff700 1 -- 172.21.15.72:0/3543696718 >> 172.21.15.72:0/3543696718 conn(0x7f0304082f60 msgr2=0x7f030405e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.405+0000 7f030a1ff700 1 -- 172.21.15.72:0/3543696718 shutdown_connections 2023-08-31T19:26:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.405+0000 7f030a1ff700 1 -- 172.21.15.72:0/3543696718 wait complete. 2023-08-31T19:26:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.406+0000 7f030a1ff700 1 Processor -- start 2023-08-31T19:26:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.406+0000 7f030a1ff700 1 -- start start 2023-08-31T19:26:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.407+0000 7f030a1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03040be860 0x7f030414bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.407+0000 7f030a1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03040c46c0 0x7f03040ac560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.407+0000 7f030a1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040c5fb0 0x7f0304152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.407+0000 7f030a1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03040acdf0 con 0x7f03040c46c0 2023-08-31T19:26:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.407+0000 7f030a1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030414c060 con 0x7f03040c5fb0 2023-08-31T19:26:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.407+0000 7f030a1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0304151cf0 con 0x7f03040be860 2023-08-31T19:26:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.407+0000 7f0302ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03040c46c0 0x7f03040ac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.407+0000 7f0302ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03040c46c0 0x7f03040ac560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51494/0 (socket says 172.21.15.72:51494) 2023-08-31T19:26:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.407+0000 7f0302ffd700 1 -- 172.21.15.72:0/1750180424 learned_addr learned my addr 172.21.15.72:0/1750180424 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.408+0000 7f0303fff700 1 --2- 172.21.15.72:0/1750180424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040c5fb0 0x7f0304152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.408+0000 7f03037fe700 1 --2- 172.21.15.72:0/1750180424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03040be860 0x7f030414bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:19.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.408+0000 7f0302ffd700 1 -- 172.21.15.72:0/1750180424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03040be860 msgr2=0x7f030414bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:19.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.408+0000 7f0302ffd700 1 --2- 172.21.15.72:0/1750180424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03040be860 0x7f030414bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.408+0000 7f0302ffd700 1 -- 172.21.15.72:0/1750180424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040c5fb0 msgr2=0x7f0304152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:19.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.408+0000 7f0302ffd700 1 --2- 172.21.15.72:0/1750180424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040c5fb0 0x7f0304152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.408+0000 7f0302ffd700 1 -- 172.21.15.72:0/1750180424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f4009250 con 0x7f03040c46c0 2023-08-31T19:26:19.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.408+0000 7f03037fe700 1 --2- 172.21.15.72:0/1750180424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03040be860 0x7f030414bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:19.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.408+0000 7f0302ffd700 1 --2- 172.21.15.72:0/1750180424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03040c46c0 0x7f03040ac560 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f02f800c4e0 tx=0x7f02f8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:19.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.408+0000 7f02eb7fe700 1 -- 172.21.15.72:0/1750180424 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f800f470 con 0x7f03040c46c0 2023-08-31T19:26:19.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.408+0000 7f02eb7fe700 1 -- 172.21.15.72:0/1750180424 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f800f5f0 con 0x7f03040c46c0 2023-08-31T19:26:19.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.408+0000 7f030a1ff700 1 -- 172.21.15.72:0/1750180424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02fc009ae0 con 0x7f03040c46c0 2023-08-31T19:26:19.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.408+0000 7f02eb7fe700 1 -- 172.21.15.72:0/1750180424 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f800f9b0 con 0x7f03040c46c0 2023-08-31T19:26:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.408+0000 7f030a1ff700 1 -- 172.21.15.72:0/1750180424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03041516a0 con 0x7f03040c46c0 2023-08-31T19:26:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.410+0000 7f030a1ff700 1 -- 172.21.15.72:0/1750180424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030406c6b0 con 0x7f03040c46c0 2023-08-31T19:26:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.410+0000 7f02eb7fe700 1 -- 172.21.15.72:0/1750180424 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f02f800fd20 con 0x7f03040c46c0 2023-08-31T19:26:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.411+0000 7f02eb7fe700 1 --2- 172.21.15.72:0/1750180424 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f02f005ef30 0x7f02f00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.411+0000 7f02eb7fe700 1 -- 172.21.15.72:0/1750180424 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f02f8079540 con 0x7f03040c46c0 2023-08-31T19:26:19.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.411+0000 7f03037fe700 1 --2- 172.21.15.72:0/1750180424 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f02f005ef30 0x7f02f00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:19.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.412+0000 7f03037fe700 1 --2- 172.21.15.72:0/1750180424 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f02f005ef30 0x7f02f00613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0304152f30 tx=0x7f02f4008040).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:19.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.415+0000 7f02eb7fe700 1 -- 172.21.15.72:0/1750180424 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f02f804a830 con 0x7f03040c46c0 2023-08-31T19:26:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.647+0000 7f030a1ff700 1 -- 172.21.15.72:0/1750180424 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f03040bf1f0 con 0x7f03040c46c0 2023-08-31T19:26:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.647+0000 7f02eb7fe700 1 -- 172.21.15.72:0/1750180424 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v33) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f02f804de50 con 0x7f03040c46c0 2023-08-31T19:26:19.648 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:19.648 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:26:19.649 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-08-31T19:26:19.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.649 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-08-31T19:26:19.649 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkPeqvDBAAA2eEr6xr7iF5PPNT9eehSg==", 2023-08-31T19:26:19.650 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.650 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:26:19.650 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:26:19.650 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:26:19.650 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:26:19.650 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.651 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-08-31T19:26:19.651 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkctxUIxAAufSVXMwPzPA7Gq1s4ukXiQ==", 2023-08-31T19:26:19.651 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.652 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:26:19.652 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:26:19.652 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:26:19.652 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:26:19.652 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.653 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-08-31T19:26:19.653 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkcpLfFxAASIB//h8whjuh6s3YKBVffQ==", 2023-08-31T19:26:19.653 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.653 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:26:19.653 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:26:19.654 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:26:19.654 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:26:19.654 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.655 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-08-31T19:26:19.655 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkC1bbLhAAg/0wct2P0+cyWbZyI2bP/g==", 2023-08-31T19:26:19.655 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.655 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:26:19.655 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:26:19.656 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:26:19.656 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:26:19.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.657 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-08-31T19:26:19.657 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAi4PBkvfRJEBAAYQqPldOXrJxXAXnmZhXaBQ==", 2023-08-31T19:26:19.657 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.657 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:26:19.657 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:26:19.658 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:26:19.658 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.658 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-08-31T19:26:19.659 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAl4PBkYysSIhAA4nCmskcGV+i4vpH2k/gDBg==", 2023-08-31T19:26:19.659 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.659 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:26:19.659 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:26:19.659 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:26:19.659 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.660 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-08-31T19:26:19.660 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAp4PBkyDgJFxAAPynEKk15yN7+OxQxpzL0UQ==", 2023-08-31T19:26:19.660 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.661 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:26:19.661 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:26:19.661 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:26:19.661 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.662 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-08-31T19:26:19.662 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAs4PBkZMD2KBAAoJrO4YjJ4/8MjcPAtgEn1g==", 2023-08-31T19:26:19.662 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.662 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:26:19.663 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:26:19.663 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:26:19.663 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.664 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-08-31T19:26:19.664 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAz4PBkSgAoExAAJ95kdHV47jDTXSj/WSCiLw==", 2023-08-31T19:26:19.664 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.664 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:26:19.664 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:26:19.665 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:26:19.665 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.665 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-08-31T19:26:19.665 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA24PBkUxpLKBAAAu8d6iKME6wW+Q/6hhFIRQ==", 2023-08-31T19:26:19.666 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.666 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:26:19.666 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:26:19.666 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:26:19.666 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.667 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-08-31T19:26:19.667 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA54PBkURHJOhAA3HaPfENVQ4hLIjc/esF0bQ==", 2023-08-31T19:26:19.667 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.668 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:26:19.668 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:26:19.668 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:26:19.668 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.669 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-08-31T19:26:19.669 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQA94PBkfoqTEBAAQHENgrp5tv1X47Br/dUksQ==", 2023-08-31T19:26:19.669 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.669 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-08-31T19:26:19.669 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-08-31T19:26:19.669 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:26:19.670 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.670 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-08-31T19:26:19.670 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkucWuOBAABLowlGxpCR3GgoOCRmC0FQ==", 2023-08-31T19:26:19.671 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.671 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:26:19.671 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow r", 2023-08-31T19:26:19.671 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-31T19:26:19.671 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.672 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-08-31T19:26:19.672 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkVGBPCxAAO4M9u24/yH0xwtV6oSz+JQ==", 2023-08-31T19:26:19.672 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.673 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:26:19.673 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:26:19.673 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:26:19.673 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:26:19.673 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.674 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.2", 2023-08-31T19:26:19.674 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkYeIoBBAAjoIzJJ9McIx3rLBSaorTKA==", 2023-08-31T19:26:19.674 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.674 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:26:19.675 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:26:19.675 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:26:19.675 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:26:19.675 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.676 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.3", 2023-08-31T19:26:19.676 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAe4PBkX/V9EhAAqWuBMMhikN/JUQp3v5/ABQ==", 2023-08-31T19:26:19.676 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.676 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-08-31T19:26:19.677 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-08-31T19:26:19.677 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-08-31T19:26:19.677 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-08-31T19:26:19.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.678 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-08-31T19:26:19.678 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkCRlhDhAAxvcGr+KTvLoJmtuZC89Iuw==", 2023-08-31T19:26:19.678 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.678 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:26:19.678 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-08-31T19:26:19.679 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-08-31T19:26:19.679 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:26:19.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.680 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-08-31T19:26:19.680 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAd4PBkiGBUBRAAwWTFqrz+ELBSwb0Z2T9yhQ==", 2023-08-31T19:26:19.680 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.680 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:26:19.680 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:26:19.681 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:26:19.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:19.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:19.681 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-08-31T19:26:19.681 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAc4PBkSWszNRAAdBxrfMEuBRgePfaiPx6kpQ==", 2023-08-31T19:26:19.682 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-08-31T19:26:19.682 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-08-31T19:26:19.682 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-08-31T19:26:19.682 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-08-31T19:26:19.682 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.683 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:19.683 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-08-31T19:26:19.683 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:26:19.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.650+0000 7f030a1ff700 1 -- 172.21.15.72:0/1750180424 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f02f005ef30 msgr2=0x7f02f00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:19.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.650+0000 7f030a1ff700 1 --2- 172.21.15.72:0/1750180424 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f02f005ef30 0x7f02f00613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0304152f30 tx=0x7f02f4008040).stop 2023-08-31T19:26:19.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.650+0000 7f030a1ff700 1 -- 172.21.15.72:0/1750180424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03040c46c0 msgr2=0x7f03040ac560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:19.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.650+0000 7f030a1ff700 1 --2- 172.21.15.72:0/1750180424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03040c46c0 0x7f03040ac560 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f02f800c4e0 tx=0x7f02f8007c70).stop 2023-08-31T19:26:19.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.650+0000 7f030a1ff700 1 -- 172.21.15.72:0/1750180424 shutdown_connections 2023-08-31T19:26:19.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.650+0000 7f030a1ff700 1 --2- 172.21.15.72:0/1750180424 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f02f005ef30 0x7f02f00613f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.650+0000 7f030a1ff700 1 --2- 172.21.15.72:0/1750180424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040c5fb0 0x7f0304152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.650+0000 7f030a1ff700 1 --2- 172.21.15.72:0/1750180424 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f03040be860 0x7f030414bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.650+0000 7f030a1ff700 1 --2- 172.21.15.72:0/1750180424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03040c46c0 0x7f03040ac560 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.650+0000 7f030a1ff700 1 -- 172.21.15.72:0/1750180424 >> 172.21.15.72:0/1750180424 conn(0x7f0304082f60 msgr2=0x7f0304067ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:19.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.650+0000 7f030a1ff700 1 -- 172.21.15.72:0/1750180424 shutdown_connections 2023-08-31T19:26:19.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.650+0000 7f030a1ff700 1 -- 172.21.15.72:0/1750180424 wait complete. 2023-08-31T19:26:19.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:26:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.877+0000 7f3ba09ff700 1 Processor -- start 2023-08-31T19:26:19.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.877+0000 7f3ba09ff700 1 -- start start 2023-08-31T19:26:19.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.878+0000 7f3ba09ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c154220 0x7f3b9c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:19.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.878+0000 7f3ba09ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b9c0cb940 0x7f3b9c1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:19.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.878+0000 7f3ba09ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c0c8c90 con 0x7f3b9c1586b0 2023-08-31T19:26:19.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.878+0000 7f3ba09ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9c0aa700 con 0x7f3b9c0cb940 2023-08-31T19:26:19.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.878+0000 7f3ba09ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0c5e10 con 0x7f3b9c154220 2023-08-31T19:26:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.879+0000 7f3b99d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b9c0cb940 0x7f3b9c1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.879+0000 7f3b9a59c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c154220 0x7f3b9c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.879+0000 7f3b99d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b9c0cb940 0x7f3b9c1581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:56966/0 (socket says 172.21.15.72:56966) 2023-08-31T19:26:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.879+0000 7f3b99d9b700 1 -- 172.21.15.72:0/872144813 learned_addr learned my addr 172.21.15.72:0/872144813 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.879+0000 7f3b9a59c700 1 --2- 172.21.15.72:0/872144813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c154220 0x7f3b9c157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:52952/0 (socket says 172.21.15.72:52952) 2023-08-31T19:26:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.879+0000 7f3b9a59c700 1 -- 172.21.15.72:0/872144813 >> v2:172.21.15.146:3300/0 conn(0x7f3b9c0cb940 msgr2=0x7f3b9c1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.879+0000 7f3b9a59c700 1 --2- 172.21.15.72:0/872144813 >> v2:172.21.15.146:3300/0 conn(0x7f3b9c0cb940 0x7f3b9c1581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.880+0000 7f3b9a59c700 1 -- 172.21.15.72:0/872144813 >> v1:172.21.15.146:6789/0 conn(0x7f3b9c1586b0 legacy=0x7f3b9c154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:19.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.880+0000 7f3b9a59c700 1 -- 172.21.15.72:0/872144813 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c0c0a50 con 0x7f3b9c154220 2023-08-31T19:26:19.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.880+0000 7f3b99d9b700 1 --2- 172.21.15.72:0/872144813 >> v2:172.21.15.146:3300/0 conn(0x7f3b9c0cb940 0x7f3b9c1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:19.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.880+0000 7f3b9959a700 1 -- 172.21.15.72:0/872144813 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673441809 0 0) 0x7f3b9c0c8c90 con 0x7f3b9c1586b0 2023-08-31T19:26:19.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.880+0000 7f3b9a59c700 1 --2- 172.21.15.72:0/872144813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c154220 0x7f3b9c157cd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f3b8c009760 tx=0x7f3b8c006f40).ready entity=mon.2 client_cookie=b7805f393bd8bc8a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:19.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.880+0000 7f3b9959a700 1 -- 172.21.15.72:0/872144813 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c005880 con 0x7f3b9c154220 2023-08-31T19:26:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.880+0000 7f3b9959a700 1 -- 172.21.15.72:0/872144813 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c0059e0 con 0x7f3b9c154220 2023-08-31T19:26:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.880+0000 7f3b9959a700 1 -- 172.21.15.72:0/872144813 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c005d60 con 0x7f3b9c154220 2023-08-31T19:26:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.880+0000 7f3ba09ff700 1 -- 172.21.15.72:0/872144813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c154220 msgr2=0x7f3b9c157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.881+0000 7f3ba09ff700 1 --2- 172.21.15.72:0/872144813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c154220 0x7f3b9c157cd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f3b8c009760 tx=0x7f3b8c006f40).stop 2023-08-31T19:26:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.881+0000 7f3ba09ff700 1 -- 172.21.15.72:0/872144813 shutdown_connections 2023-08-31T19:26:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.881+0000 7f3ba09ff700 1 --2- 172.21.15.72:0/872144813 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c154220 0x7f3b9c157cd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.881+0000 7f3ba09ff700 1 --2- 172.21.15.72:0/872144813 >> v2:172.21.15.146:3300/0 conn(0x7f3b9c0cb940 0x7f3b9c1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.881+0000 7f3ba09ff700 1 -- 172.21.15.72:0/872144813 >> 172.21.15.72:0/872144813 conn(0x7f3b9c05e870 msgr2=0x7f3b9c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.881+0000 7f3ba09ff700 1 -- 172.21.15.72:0/872144813 shutdown_connections 2023-08-31T19:26:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.881+0000 7f3ba09ff700 1 -- 172.21.15.72:0/872144813 wait complete. 2023-08-31T19:26:19.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.882+0000 7f3ba09ff700 1 Processor -- start 2023-08-31T19:26:19.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.882+0000 7f3ba09ff700 1 -- start start 2023-08-31T19:26:19.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.883+0000 7f3ba09ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c0cb940 0x7f3b9c0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:19.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.883+0000 7f3ba09ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b9c154220 0x7f3b9c148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:19.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.883+0000 7f3ba09ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b9c1586b0 0x7f3b9c0c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:19.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.883+0000 7f3ba09ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0c2320 con 0x7f3b9c1586b0 2023-08-31T19:26:19.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.883+0000 7f3ba09ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0c2530 con 0x7f3b9c154220 2023-08-31T19:26:19.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.883+0000 7f3ba09ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0c2810 con 0x7f3b9c0cb940 2023-08-31T19:26:19.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.883+0000 7f3b9ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b9c1586b0 0x7f3b9c0c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:19.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.884+0000 7f3b9ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b9c1586b0 0x7f3b9c0c1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51510/0 (socket says 172.21.15.72:51510) 2023-08-31T19:26:19.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.884+0000 7f3b9ad9d700 1 -- 172.21.15.72:0/3590564072 learned_addr learned my addr 172.21.15.72:0/3590564072 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:19.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.884+0000 7f3b99d9b700 1 --2- 172.21.15.72:0/3590564072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b9c154220 0x7f3b9c148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:19.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.884+0000 7f3b9a59c700 1 --2- 172.21.15.72:0/3590564072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c0cb940 0x7f3b9c0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:19.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.884+0000 7f3b9ad9d700 1 -- 172.21.15.72:0/3590564072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c0cb940 msgr2=0x7f3b9c0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:19.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.884+0000 7f3b9ad9d700 1 --2- 172.21.15.72:0/3590564072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c0cb940 0x7f3b9c0c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.884+0000 7f3b9ad9d700 1 -- 172.21.15.72:0/3590564072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b9c154220 msgr2=0x7f3b9c148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:19.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.884+0000 7f3b9ad9d700 1 --2- 172.21.15.72:0/3590564072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b9c154220 0x7f3b9c148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:19.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.884+0000 7f3b9ad9d700 1 -- 172.21.15.72:0/3590564072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90009370 con 0x7f3b9c1586b0 2023-08-31T19:26:19.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.884+0000 7f3b9ad9d700 1 --2- 172.21.15.72:0/3590564072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b9c1586b0 0x7f3b9c0c1e30 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f3b94002230 tx=0x7f3b94007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:19.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.884+0000 7f3b8a7fc700 1 -- 172.21.15.72:0/3590564072 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9400a580 con 0x7f3b9c1586b0 2023-08-31T19:26:19.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.884+0000 7f3b8a7fc700 1 -- 172.21.15.72:0/3590564072 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9400a6e0 con 0x7f3b9c1586b0 2023-08-31T19:26:19.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.884+0000 7f3b8a7fc700 1 -- 172.21.15.72:0/3590564072 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9400aa80 con 0x7f3b9c1586b0 2023-08-31T19:26:19.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.884+0000 7f3ba09ff700 1 -- 172.21.15.72:0/3590564072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8c009250 con 0x7f3b9c1586b0 2023-08-31T19:26:19.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.885+0000 7f3ba09ff700 1 -- 172.21.15.72:0/3590564072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c149470 con 0x7f3b9c1586b0 2023-08-31T19:26:19.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.886+0000 7f3ba09ff700 1 -- 172.21.15.72:0/3590564072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c06a1f0 con 0x7f3b9c1586b0 2023-08-31T19:26:19.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.886+0000 7f3b8a7fc700 1 -- 172.21.15.72:0/3590564072 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f3b9401b400 con 0x7f3b9c1586b0 2023-08-31T19:26:19.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.887+0000 7f3b8a7fc700 1 --2- 172.21.15.72:0/3590564072 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3b7c05ef30 0x7f3b7c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:19.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.887+0000 7f3b8a7fc700 1 -- 172.21.15.72:0/3590564072 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f3b94079f40 con 0x7f3b9c1586b0 2023-08-31T19:26:19.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.887+0000 7f3b9a59c700 1 --2- 172.21.15.72:0/3590564072 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3b7c05ef30 0x7f3b7c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:19.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.888+0000 7f3b9a59c700 1 --2- 172.21.15.72:0/3590564072 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3b7c05ef30 0x7f3b7c0613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3b8c006f80 tx=0x7f3b8c016000).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:19.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:19.891+0000 7f3b8a7fc700 1 -- 172.21.15.72:0/3590564072 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b9404b1d0 con 0x7f3b9c1586b0 2023-08-31T19:26:20.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.062+0000 7f3ba09ff700 1 -- 172.21.15.72:0/3590564072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b9c149690 con 0x7f3b9c1586b0 2023-08-31T19:26:20.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.063+0000 7f3b8a7fc700 1 -- 172.21.15.72:0/3590564072 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+14816 (secure 0 0 0) 0x7f3b9404e7f0 con 0x7f3b9c1586b0 2023-08-31T19:26:20.064 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:20.064 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":191,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:26:19.181868+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:26:20.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.065+0000 7f3ba09ff700 1 -- 172.21.15.72:0/3590564072 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3b7c05ef30 msgr2=0x7f3b7c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:20.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.065+0000 7f3ba09ff700 1 --2- 172.21.15.72:0/3590564072 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3b7c05ef30 0x7f3b7c0613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3b8c006f80 tx=0x7f3b8c016000).stop 2023-08-31T19:26:20.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.065+0000 7f3ba09ff700 1 -- 172.21.15.72:0/3590564072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b9c1586b0 msgr2=0x7f3b9c0c1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:20.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.065+0000 7f3ba09ff700 1 --2- 172.21.15.72:0/3590564072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b9c1586b0 0x7f3b9c0c1e30 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f3b94002230 tx=0x7f3b94007f70).stop 2023-08-31T19:26:20.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.065+0000 7f3ba09ff700 1 -- 172.21.15.72:0/3590564072 shutdown_connections 2023-08-31T19:26:20.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.065+0000 7f3ba09ff700 1 --2- 172.21.15.72:0/3590564072 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3b7c05ef30 0x7f3b7c0613f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.065+0000 7f3ba09ff700 1 --2- 172.21.15.72:0/3590564072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b9c1586b0 0x7f3b9c0c1e30 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.065+0000 7f3ba09ff700 1 --2- 172.21.15.72:0/3590564072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b9c0cb940 0x7f3b9c0c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.065+0000 7f3ba09ff700 1 --2- 172.21.15.72:0/3590564072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b9c154220 0x7f3b9c148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.065+0000 7f3ba09ff700 1 -- 172.21.15.72:0/3590564072 >> 172.21.15.72:0/3590564072 conn(0x7f3b9c05e870 msgr2=0x7f3b9c0a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:20.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.065+0000 7f3ba09ff700 1 -- 172.21.15.72:0/3590564072 shutdown_connections 2023-08-31T19:26:20.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.065+0000 7f3ba09ff700 1 -- 172.21.15.72:0/3590564072 wait complete. 2023-08-31T19:26:20.084 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '184', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-31T19:26:20.085 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:26:20.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.277+0000 7f07211ff700 1 Processor -- start 2023-08-31T19:26:20.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.277+0000 7f07211ff700 1 -- start start 2023-08-31T19:26:20.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.278+0000 7f07211ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f071c0c38d0 0x7f071c05e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:20.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.278+0000 7f07211ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071c0bc4a0 con 0x7f071c1544e0 2023-08-31T19:26:20.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.278+0000 7f07211ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071c069c40 con 0x7f071c0690e0 2023-08-31T19:26:20.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.278+0000 7f07211ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071c05e840 con 0x7f071c0c38d0 2023-08-31T19:26:20.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.279+0000 7f071ad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f071c1544e0 0x7f071c0689d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36054/0 (socket says 172.21.15.72:36054) 2023-08-31T19:26:20.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.279+0000 7f071ad9d700 1 -- 172.21.15.72:0/222174026 learned_addr learned my addr 172.21.15.72:0/222174026 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:20.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.279+0000 7f071b59e700 1 --2- 172.21.15.72:0/222174026 >> v2:172.21.15.146:3300/0 conn(0x7f071c0c38d0 0x7f071c05e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:20.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.279+0000 7f0719d9b700 1 -- 172.21.15.72:0/222174026 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930672100 0 0) 0x7f071c0bc4a0 con 0x7f071c1544e0 2023-08-31T19:26:20.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.279+0000 7f0719d9b700 1 -- 172.21.15.72:0/222174026 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07040033f0 con 0x7f071c1544e0 2023-08-31T19:26:20.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.279+0000 7f0719d9b700 1 -- 172.21.15.72:0/222174026 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2181608322 0 0) 0x7f07040033f0 con 0x7f071c1544e0 2023-08-31T19:26:20.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.279+0000 7f0719d9b700 1 -- 172.21.15.72:0/222174026 >> v2:172.21.15.146:3300/0 conn(0x7f071c0c38d0 msgr2=0x7f071c05e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:20.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.279+0000 7f0719d9b700 1 --2- 172.21.15.72:0/222174026 >> v2:172.21.15.146:3300/0 conn(0x7f071c0c38d0 0x7f071c05e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.279+0000 7f0719d9b700 1 -- 172.21.15.72:0/222174026 >> v1:172.21.15.146:6789/0 conn(0x7f071c0690e0 legacy=0x7f071c0bc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:20.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f0719d9b700 1 -- 172.21.15.72:0/222174026 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c0c1c30 con 0x7f071c1544e0 2023-08-31T19:26:20.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f0719d9b700 1 -- 172.21.15.72:0/222174026 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f070c001470 con 0x7f071c1544e0 2023-08-31T19:26:20.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f0719d9b700 1 -- 172.21.15.72:0/222174026 >> v1:172.21.15.72:6789/0 conn(0x7f071c1544e0 legacy=0x7f071c0689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:20.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f0719d9b700 1 --2- 172.21.15.72:0/222174026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07040038e0 0x7f0704003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:20.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f0719d9b700 1 --2- 172.21.15.72:0/222174026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0704004690 0x7f0704004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:20.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f0719d9b700 1 --2- 172.21.15.72:0/222174026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0704005000 0x7f070400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:20.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f0719d9b700 1 -- 172.21.15.72:0/222174026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070400bf00 con 0x7f0704004690 2023-08-31T19:26:20.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f0719d9b700 1 -- 172.21.15.72:0/222174026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070400c070 con 0x7f0704005000 2023-08-31T19:26:20.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f0719d9b700 1 -- 172.21.15.72:0/222174026 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070400c230 con 0x7f07040038e0 2023-08-31T19:26:20.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f071a59c700 1 --2- 172.21.15.72:0/222174026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0704004690 0x7f0704004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:20.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f071ad9d700 1 --2- 172.21.15.72:0/222174026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07040038e0 0x7f0704003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:20.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f071b59e700 1 --2- 172.21.15.72:0/222174026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0704005000 0x7f070400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:20.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f071a59c700 1 -- 172.21.15.72:0/222174026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07040038e0 msgr2=0x7f0704003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f071a59c700 1 --2- 172.21.15.72:0/222174026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f07040038e0 0x7f0704003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f071a59c700 1 -- 172.21.15.72:0/222174026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0704005000 msgr2=0x7f070400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f071a59c700 1 --2- 172.21.15.72:0/222174026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0704005000 0x7f070400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f071b59e700 1 -- 172.21.15.72:0/222174026 reap_dead start 2023-08-31T19:26:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.280+0000 7f071a59c700 1 -- 172.21.15.72:0/222174026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040033f0 con 0x7f0704004690 2023-08-31T19:26:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.281+0000 7f071a59c700 1 --2- 172.21.15.72:0/222174026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0704004690 0x7f0704004b10 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7f071c05f060 tx=0x7f0710007bb0).ready entity=mon.0 client_cookie=f750ca1ed4cc19c8 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.281+0000 7f0719d9b700 1 -- 172.21.15.72:0/222174026 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0710012400 con 0x7f0704004690 2023-08-31T19:26:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.281+0000 7f0719d9b700 1 -- 172.21.15.72:0/222174026 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0710012560 con 0x7f0704004690 2023-08-31T19:26:20.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.281+0000 7f0719d9b700 1 -- 172.21.15.72:0/222174026 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0710012920 con 0x7f0704004690 2023-08-31T19:26:20.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.281+0000 7f07211ff700 1 -- 172.21.15.72:0/222174026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0704004690 msgr2=0x7f0704004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:20.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.281+0000 7f07211ff700 1 --2- 172.21.15.72:0/222174026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0704004690 0x7f0704004b10 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7f071c05f060 tx=0x7f0710007bb0).stop 2023-08-31T19:26:20.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.281+0000 7f07211ff700 1 -- 172.21.15.72:0/222174026 shutdown_connections 2023-08-31T19:26:20.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.281+0000 7f07211ff700 1 --2- 172.21.15.72:0/222174026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0704004690 0x7f0704004b10 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.281+0000 7f07211ff700 1 -- 172.21.15.72:0/222174026 >> 172.21.15.72:0/222174026 conn(0x7f071c0c7e00 msgr2=0x7f071c0c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:20.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.282+0000 7f07211ff700 1 -- 172.21.15.72:0/222174026 shutdown_connections 2023-08-31T19:26:20.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.282+0000 7f07211ff700 1 -- 172.21.15.72:0/222174026 wait complete. 2023-08-31T19:26:20.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.283+0000 7f07211ff700 1 Processor -- start 2023-08-31T19:26:20.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.283+0000 7f07211ff700 1 -- start start 2023-08-31T19:26:20.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.284+0000 7f07211ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0704004690 0x7f071c150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:20.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.284+0000 7f07211ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f071c167050 0x7f071c1674d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:20.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.284+0000 7f07211ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071c15a110 0x7f071c15a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:20.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.284+0000 7f07211ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c0abf50 con 0x7f071c167050 2023-08-31T19:26:20.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.284+0000 7f07211ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c0bed80 con 0x7f071c15a110 2023-08-31T19:26:20.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.284+0000 7f07211ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071c1679c0 con 0x7f0704004690 2023-08-31T19:26:20.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.284+0000 7f071a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f071c167050 0x7f071c1674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:20.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.284+0000 7f071a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f071c167050 0x7f071c1674d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51526/0 (socket says 172.21.15.72:51526) 2023-08-31T19:26:20.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.284+0000 7f071a59c700 1 -- 172.21.15.72:0/1500339001 learned_addr learned my addr 172.21.15.72:0/1500339001 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:20.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.285+0000 7f071a59c700 1 -- 172.21.15.72:0/1500339001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0704004690 msgr2=0x7f071c150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.285+0000 7f071a59c700 1 --2- 172.21.15.72:0/1500339001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0704004690 0x7f071c150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.285+0000 7f071a59c700 1 -- 172.21.15.72:0/1500339001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071c15a110 msgr2=0x7f071c15a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.285+0000 7f071a59c700 1 --2- 172.21.15.72:0/1500339001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071c15a110 0x7f071c15a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.285+0000 7f071a59c700 1 -- 172.21.15.72:0/1500339001 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c15aa80 con 0x7f071c167050 2023-08-31T19:26:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.285+0000 7f071a59c700 1 --2- 172.21.15.72:0/1500339001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f071c167050 0x7f071c1674d0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f071000ccd0 tx=0x7f0710017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.285+0000 7f0702ffd700 1 -- 172.21.15.72:0/1500339001 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0710012400 con 0x7f071c167050 2023-08-31T19:26:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.285+0000 7f0702ffd700 1 -- 172.21.15.72:0/1500339001 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07100128e0 con 0x7f071c167050 2023-08-31T19:26:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.285+0000 7f07211ff700 1 -- 172.21.15.72:0/1500339001 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071c0be770 con 0x7f071c167050 2023-08-31T19:26:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.285+0000 7f0702ffd700 1 -- 172.21.15.72:0/1500339001 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071001d670 con 0x7f071c167050 2023-08-31T19:26:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.285+0000 7f07211ff700 1 -- 172.21.15.72:0/1500339001 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071c167c30 con 0x7f071c167050 2023-08-31T19:26:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.286+0000 7f0700ff9700 1 -- 172.21.15.72:0/1500339001 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f4005120 con 0x7f071c167050 2023-08-31T19:26:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.287+0000 7f0702ffd700 1 -- 172.21.15.72:0/1500339001 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f071001da60 con 0x7f071c167050 2023-08-31T19:26:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.288+0000 7f0702ffd700 1 --2- 172.21.15.72:0/1500339001 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f070805ef30 0x7f07080613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.288+0000 7f0702ffd700 1 -- 172.21.15.72:0/1500339001 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f071007b4d0 con 0x7f071c167050 2023-08-31T19:26:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.288+0000 7f071ad9d700 1 --2- 172.21.15.72:0/1500339001 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f070805ef30 0x7f07080613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:20.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.289+0000 7f071ad9d700 1 --2- 172.21.15.72:0/1500339001 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f070805ef30 0x7f07080613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f070c0011e0 tx=0x7f070c001df0).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.292+0000 7f0702ffd700 1 -- 172.21.15.72:0/1500339001 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f071004c880 con 0x7f071c167050 2023-08-31T19:26:20.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.459+0000 7f0700ff9700 1 -- 172.21.15.72:0/1500339001 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f06f4005880 con 0x7f071c167050 2023-08-31T19:26:20.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.459+0000 7f0702ffd700 1 -- 172.21.15.72:0/1500339001 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v191) v1 ==== 110+0+10 (secure 0 0 0) 0x7f071004fea0 con 0x7f071c167050 2023-08-31T19:26:20.460 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:26:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.461+0000 7f0700ff9700 1 -- 172.21.15.72:0/1500339001 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f070805ef30 msgr2=0x7f07080613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.461+0000 7f0700ff9700 1 --2- 172.21.15.72:0/1500339001 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f070805ef30 0x7f07080613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f070c0011e0 tx=0x7f070c001df0).stop 2023-08-31T19:26:20.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.461+0000 7f0700ff9700 1 -- 172.21.15.72:0/1500339001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f071c167050 msgr2=0x7f071c1674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.461+0000 7f0700ff9700 1 --2- 172.21.15.72:0/1500339001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f071c167050 0x7f071c1674d0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f071000ccd0 tx=0x7f0710017000).stop 2023-08-31T19:26:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.461+0000 7f0700ff9700 1 -- 172.21.15.72:0/1500339001 shutdown_connections 2023-08-31T19:26:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.461+0000 7f0700ff9700 1 --2- 172.21.15.72:0/1500339001 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f070805ef30 0x7f07080613f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.462+0000 7f0700ff9700 1 --2- 172.21.15.72:0/1500339001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071c15a110 0x7f071c15a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:20.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.462+0000 7f0700ff9700 1 --2- 172.21.15.72:0/1500339001 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0704004690 0x7f071c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.462+0000 7f0700ff9700 1 --2- 172.21.15.72:0/1500339001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f071c167050 0x7f071c1674d0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.462+0000 7f0700ff9700 1 -- 172.21.15.72:0/1500339001 >> 172.21.15.72:0/1500339001 conn(0x7f071c0c7e00 msgr2=0x7f071c0c59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.462+0000 7f0700ff9700 1 -- 172.21.15.72:0/1500339001 shutdown_connections 2023-08-31T19:26:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.462+0000 7f0700ff9700 1 -- 172.21.15.72:0/1500339001 wait complete. 2023-08-31T19:26:20.479 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:26:20.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.670+0000 7f6e3c7ff700 1 Processor -- start 2023-08-31T19:26:20.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.670+0000 7f6e3c7ff700 1 -- start start 2023-08-31T19:26:20.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.672+0000 7f6e3c7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e34154210 0x7f6e340630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:20.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.672+0000 7f6e3c7ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6e340635a0 0x7f6e340c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:20.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.672+0000 7f6e3c7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e34063a30 con 0x7f6e34153e30 2023-08-31T19:26:20.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.672+0000 7f6e3c7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e341546c0 con 0x7f6e34154210 2023-08-31T19:26:20.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.672+0000 7f6e3c7ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e340bfd40 con 0x7f6e340635a0 2023-08-31T19:26:20.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.672+0000 7f6e39d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e34154210 0x7f6e340630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:20.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.672+0000 7f6e3a59b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6e34153e30 0x7f6e340c5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36060/0 (socket says 172.21.15.72:36060) 2023-08-31T19:26:20.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.672+0000 7f6e39d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e34154210 0x7f6e340630b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51536/0 (socket says 172.21.15.72:51536) 2023-08-31T19:26:20.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.672+0000 7f6e3a59b700 1 -- 172.21.15.72:0/334228262 learned_addr learned my addr 172.21.15.72:0/334228262 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:20.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.672+0000 7f6e3ad9c700 1 --2- 172.21.15.72:0/334228262 >> v2:172.21.15.146:3300/0 conn(0x7f6e340635a0 0x7f6e340c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.672+0000 7f6e39d9a700 1 -- 172.21.15.72:0/334228262 >> v2:172.21.15.146:3300/0 conn(0x7f6e340635a0 msgr2=0x7f6e340c0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.672+0000 7f6e39d9a700 1 --2- 172.21.15.72:0/334228262 >> v2:172.21.15.146:3300/0 conn(0x7f6e340635a0 0x7f6e340c0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.672+0000 7f6e39d9a700 1 -- 172.21.15.72:0/334228262 >> v1:172.21.15.72:6789/0 conn(0x7f6e34153e30 legacy=0x7f6e340c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:20.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.672+0000 7f6e39d9a700 1 -- 172.21.15.72:0/334228262 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e340c6730 con 0x7f6e34154210 2023-08-31T19:26:20.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.673+0000 7f6e39d9a700 1 --2- 172.21.15.72:0/334228262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e34154210 0x7f6e340630b0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f6e34084380 tx=0x7f6e24009060).ready entity=mon.0 client_cookie=8136b317d7771b60 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:20.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.673+0000 7f6e39599700 1 -- 172.21.15.72:0/334228262 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2400b580 con 0x7f6e34154210 2023-08-31T19:26:20.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.673+0000 7f6e39599700 1 -- 172.21.15.72:0/334228262 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2400b6e0 con 0x7f6e34154210 2023-08-31T19:26:20.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.673+0000 7f6e39599700 1 -- 172.21.15.72:0/334228262 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2400ba60 con 0x7f6e34154210 2023-08-31T19:26:20.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.673+0000 7f6e3c7ff700 1 -- 172.21.15.72:0/334228262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e34154210 msgr2=0x7f6e340630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:20.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.673+0000 7f6e3c7ff700 1 --2- 172.21.15.72:0/334228262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e34154210 0x7f6e340630b0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f6e34084380 tx=0x7f6e24009060).stop 2023-08-31T19:26:20.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.673+0000 7f6e3c7ff700 1 -- 172.21.15.72:0/334228262 shutdown_connections 2023-08-31T19:26:20.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.673+0000 7f6e3c7ff700 1 --2- 172.21.15.72:0/334228262 >> v2:172.21.15.146:3300/0 conn(0x7f6e340635a0 0x7f6e340c0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.673+0000 7f6e3c7ff700 1 --2- 172.21.15.72:0/334228262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e34154210 0x7f6e340630b0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.673+0000 7f6e3c7ff700 1 -- 172.21.15.72:0/334228262 >> 172.21.15.72:0/334228262 conn(0x7f6e3405eb20 msgr2=0x7f6e340cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:20.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.674+0000 7f6e3c7ff700 1 -- 172.21.15.72:0/334228262 shutdown_connections 2023-08-31T19:26:20.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.674+0000 7f6e3c7ff700 1 -- 172.21.15.72:0/334228262 wait complete. 2023-08-31T19:26:20.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.675+0000 7f6e3c7ff700 1 Processor -- start 2023-08-31T19:26:20.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.675+0000 7f6e3c7ff700 1 -- start start 2023-08-31T19:26:20.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.676+0000 7f6e3c7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e340635a0 0x7f6e34165770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:20.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.676+0000 7f6e3c7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e34153e30 0x7f6e34164fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:20.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.676+0000 7f6e3c7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e34154210 0x7f6e34163ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:20.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.676+0000 7f6e3c7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e34166940 con 0x7f6e34154210 2023-08-31T19:26:20.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.676+0000 7f6e3c7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e341654c0 con 0x7f6e34153e30 2023-08-31T19:26:20.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.676+0000 7f6e3c7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e34165d30 con 0x7f6e340635a0 2023-08-31T19:26:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.676+0000 7f6e3ad9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e34154210 0x7f6e34163ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.676+0000 7f6e3ad9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e34154210 0x7f6e34163ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51540/0 (socket says 172.21.15.72:51540) 2023-08-31T19:26:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.676+0000 7f6e3ad9c700 1 -- 172.21.15.72:0/84058435 learned_addr learned my addr 172.21.15.72:0/84058435 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.677+0000 7f6e39d9a700 1 --2- 172.21.15.72:0/84058435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e34153e30 0x7f6e34164fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.677+0000 7f6e3a59b700 1 --2- 172.21.15.72:0/84058435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e340635a0 0x7f6e34165770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:20.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.677+0000 7f6e3ad9c700 1 -- 172.21.15.72:0/84058435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e340635a0 msgr2=0x7f6e34165770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.677+0000 7f6e3ad9c700 1 --2- 172.21.15.72:0/84058435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e340635a0 0x7f6e34165770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.677+0000 7f6e3ad9c700 1 -- 172.21.15.72:0/84058435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e34153e30 msgr2=0x7f6e34164fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.677+0000 7f6e3ad9c700 1 --2- 172.21.15.72:0/84058435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e34153e30 0x7f6e34164fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.677+0000 7f6e3ad9c700 1 -- 172.21.15.72:0/84058435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e240092a0 con 0x7f6e34154210 2023-08-31T19:26:20.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.677+0000 7f6e39d9a700 1 --2- 172.21.15.72:0/84058435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e34153e30 0x7f6e34164fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.677+0000 7f6e3ad9c700 1 --2- 172.21.15.72:0/84058435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e34154210 0x7f6e34163ea0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f6e2c009fa0 tx=0x7f6e2c009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.677+0000 7f6e2a7fc700 1 -- 172.21.15.72:0/84058435 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c00ed20 con 0x7f6e34154210 2023-08-31T19:26:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.677+0000 7f6e2a7fc700 1 -- 172.21.15.72:0/84058435 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2c00ee80 con 0x7f6e34154210 2023-08-31T19:26:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.677+0000 7f6e3c7ff700 1 -- 172.21.15.72:0/84058435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e34166010 con 0x7f6e34154210 2023-08-31T19:26:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.677+0000 7f6e2a7fc700 1 -- 172.21.15.72:0/84058435 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c014610 con 0x7f6e34154210 2023-08-31T19:26:20.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.677+0000 7f6e3c7ff700 1 -- 172.21.15.72:0/84058435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e341665d0 con 0x7f6e34154210 2023-08-31T19:26:20.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.678+0000 7f6e3c7ff700 1 -- 172.21.15.72:0/84058435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e3406c6b0 con 0x7f6e34154210 2023-08-31T19:26:20.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.679+0000 7f6e2a7fc700 1 -- 172.21.15.72:0/84058435 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6e2c01d3b0 con 0x7f6e34154210 2023-08-31T19:26:20.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.680+0000 7f6e2a7fc700 1 --2- 172.21.15.72:0/84058435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f6e1805ef30 0x7f6e180613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:20.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.680+0000 7f6e2a7fc700 1 -- 172.21.15.72:0/84058435 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f6e2c07a510 con 0x7f6e34154210 2023-08-31T19:26:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.680+0000 7f6e3a59b700 1 --2- 172.21.15.72:0/84058435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f6e1805ef30 0x7f6e180613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.681+0000 7f6e3a59b700 1 --2- 172.21.15.72:0/84058435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f6e1805ef30 0x7f6e180613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6e3414fc70 tx=0x7f6e30009040).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.684+0000 7f6e2a7fc700 1 -- 172.21.15.72:0/84058435 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6e2c04b860 con 0x7f6e34154210 2023-08-31T19:26:20.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.854+0000 7f6e3c7ff700 1 -- 172.21.15.72:0/84058435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6e34062970 con 0x7f6e34154210 2023-08-31T19:26:20.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.855+0000 7f6e2a7fc700 1 -- 172.21.15.72:0/84058435 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v191) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6e2c04ee80 con 0x7f6e34154210 2023-08-31T19:26:20.856 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:26:20.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.857+0000 7f6e3c7ff700 1 -- 172.21.15.72:0/84058435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f6e1805ef30 msgr2=0x7f6e180613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:20.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.857+0000 7f6e3c7ff700 1 --2- 172.21.15.72:0/84058435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f6e1805ef30 0x7f6e180613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6e3414fc70 tx=0x7f6e30009040).stop 2023-08-31T19:26:20.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.857+0000 7f6e3c7ff700 1 -- 172.21.15.72:0/84058435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e34154210 msgr2=0x7f6e34163ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:20.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.857+0000 7f6e3c7ff700 1 --2- 172.21.15.72:0/84058435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e34154210 0x7f6e34163ea0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f6e2c009fa0 tx=0x7f6e2c009900).stop 2023-08-31T19:26:20.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.857+0000 7f6e3c7ff700 1 -- 172.21.15.72:0/84058435 shutdown_connections 2023-08-31T19:26:20.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.857+0000 7f6e3c7ff700 1 --2- 172.21.15.72:0/84058435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f6e1805ef30 0x7f6e180613f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.857+0000 7f6e3c7ff700 1 --2- 172.21.15.72:0/84058435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e34154210 0x7f6e34163ea0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.857+0000 7f6e3c7ff700 1 --2- 172.21.15.72:0/84058435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6e340635a0 0x7f6e34165770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.857+0000 7f6e3c7ff700 1 --2- 172.21.15.72:0/84058435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e34153e30 0x7f6e34164fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.857+0000 7f6e3c7ff700 1 -- 172.21.15.72:0/84058435 >> 172.21.15.72:0/84058435 conn(0x7f6e3405eb20 msgr2=0x7f6e34151e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.857+0000 7f6e3c7ff700 1 -- 172.21.15.72:0/84058435 shutdown_connections 2023-08-31T19:26:20.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:20.857+0000 7f6e3c7ff700 1 -- 172.21.15.72:0/84058435 wait complete. 2023-08-31T19:26:20.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T19:26:21.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.062+0000 7f4a7abff700 1 Processor -- start 2023-08-31T19:26:21.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.062+0000 7f4a7abff700 1 -- start start 2023-08-31T19:26:21.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.064+0000 7f4a7abff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4a740bea80 0x7f4a740c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:21.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.064+0000 7f4a7abff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a740c44a0 0x7f4a74063a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:21.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.064+0000 7f4a7abff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a740c48f0 con 0x7f4a740c5fb0 2023-08-31T19:26:21.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.064+0000 7f4a7abff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a74154690 con 0x7f4a740bea80 2023-08-31T19:26:21.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.064+0000 7f4a7abff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a740bfb20 con 0x7f4a740c44a0 2023-08-31T19:26:21.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.064+0000 7f4a73fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4a740bea80 0x7f4a740c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:21.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.064+0000 7f4a73fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4a740bea80 0x7f4a740c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51550/0 (socket says 172.21.15.72:51550) 2023-08-31T19:26:21.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.064+0000 7f4a73fff700 1 -- 172.21.15.72:0/580471864 learned_addr learned my addr 172.21.15.72:0/580471864 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:21.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.064+0000 7f4a7919c700 1 --2- 172.21.15.72:0/580471864 >> v2:172.21.15.146:3300/0 conn(0x7f4a740c44a0 0x7f4a74063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:21.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.064+0000 7f4a73fff700 1 -- 172.21.15.72:0/580471864 >> v2:172.21.15.146:3300/0 conn(0x7f4a740c44a0 msgr2=0x7f4a74063a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:21.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.064+0000 7f4a73fff700 1 --2- 172.21.15.72:0/580471864 >> v2:172.21.15.146:3300/0 conn(0x7f4a740c44a0 0x7f4a74063a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.064+0000 7f4a73fff700 1 -- 172.21.15.72:0/580471864 >> v1:172.21.15.72:6789/0 conn(0x7f4a740c5fb0 legacy=0x7f4a740be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:21.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.064+0000 7f4a737fe700 1 -- 172.21.15.72:0/580471864 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875942669 0 0) 0x7f4a740c48f0 con 0x7f4a740c5fb0 2023-08-31T19:26:21.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.064+0000 7f4a73fff700 1 -- 172.21.15.72:0/580471864 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a740bef10 con 0x7f4a740bea80 2023-08-31T19:26:21.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.064+0000 7f4a73fff700 1 --2- 172.21.15.72:0/580471864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a740bea80 0x7f4a740c3fb0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7f4a7406a330 tx=0x7f4a600090f0).ready entity=mon.0 client_cookie=8f238a571012e084 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:21.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.065+0000 7f4a737fe700 1 -- 172.21.15.72:0/580471864 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6000b600 con 0x7f4a740bea80 2023-08-31T19:26:21.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.065+0000 7f4a737fe700 1 -- 172.21.15.72:0/580471864 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6000b760 con 0x7f4a740bea80 2023-08-31T19:26:21.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.065+0000 7f4a737fe700 1 -- 172.21.15.72:0/580471864 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6000bae0 con 0x7f4a740bea80 2023-08-31T19:26:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.065+0000 7f4a7abff700 1 -- 172.21.15.72:0/580471864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a740bea80 msgr2=0x7f4a740c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.065+0000 7f4a7abff700 1 --2- 172.21.15.72:0/580471864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a740bea80 0x7f4a740c3fb0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7f4a7406a330 tx=0x7f4a600090f0).stop 2023-08-31T19:26:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.065+0000 7f4a7abff700 1 -- 172.21.15.72:0/580471864 shutdown_connections 2023-08-31T19:26:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.065+0000 7f4a7abff700 1 --2- 172.21.15.72:0/580471864 >> v2:172.21.15.146:3300/0 conn(0x7f4a740c44a0 0x7f4a74063a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.065+0000 7f4a7abff700 1 --2- 172.21.15.72:0/580471864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a740bea80 0x7f4a740c3fb0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.065+0000 7f4a7abff700 1 -- 172.21.15.72:0/580471864 >> 172.21.15.72:0/580471864 conn(0x7f4a74082f60 msgr2=0x7f4a7405e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.065+0000 7f4a7abff700 1 -- 172.21.15.72:0/580471864 shutdown_connections 2023-08-31T19:26:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.065+0000 7f4a7abff700 1 -- 172.21.15.72:0/580471864 wait complete. 2023-08-31T19:26:21.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.067+0000 7f4a7abff700 1 Processor -- start 2023-08-31T19:26:21.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.067+0000 7f4a7abff700 1 -- start start 2023-08-31T19:26:21.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.068+0000 7f4a7abff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a740c44a0 0x7f4a74152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:21.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.068+0000 7f4a7abff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a740c5fb0 0x7f4a740a6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:21.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.068+0000 7f4a7abff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a74152ef0 0x7f4a740a6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:21.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.068+0000 7f4a7abff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740ab640 con 0x7f4a740c44a0 2023-08-31T19:26:21.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.068+0000 7f4a7abff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740a7340 con 0x7f4a740c5fb0 2023-08-31T19:26:21.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.068+0000 7f4a7abff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740ae590 con 0x7f4a74152ef0 2023-08-31T19:26:21.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.068+0000 7f4a7899b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a740c44a0 0x7f4a74152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:21.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.068+0000 7f4a7899b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a740c44a0 0x7f4a74152a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51562/0 (socket says 172.21.15.72:51562) 2023-08-31T19:26:21.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.068+0000 7f4a7899b700 1 -- 172.21.15.72:0/2243787342 learned_addr learned my addr 172.21.15.72:0/2243787342 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:21.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.068+0000 7f4a73fff700 1 --2- 172.21.15.72:0/2243787342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a740c5fb0 0x7f4a740a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:21.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.068+0000 7f4a7919c700 1 --2- 172.21.15.72:0/2243787342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a74152ef0 0x7f4a740a6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:21.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.069+0000 7f4a7899b700 1 -- 172.21.15.72:0/2243787342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a74152ef0 msgr2=0x7f4a740a6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:21.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.069+0000 7f4a7899b700 1 --2- 172.21.15.72:0/2243787342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a74152ef0 0x7f4a740a6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.069+0000 7f4a7899b700 1 -- 172.21.15.72:0/2243787342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a740c5fb0 msgr2=0x7f4a740a6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:21.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.069+0000 7f4a7899b700 1 --2- 172.21.15.72:0/2243787342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a740c5fb0 0x7f4a740a6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.069+0000 7f4a7899b700 1 -- 172.21.15.72:0/2243787342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a60009370 con 0x7f4a740c44a0 2023-08-31T19:26:21.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.069+0000 7f4a73fff700 1 --2- 172.21.15.72:0/2243787342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a740c5fb0 0x7f4a740a6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:21.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.069+0000 7f4a7899b700 1 --2- 172.21.15.72:0/2243787342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a740c44a0 0x7f4a74152a00 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f4a6800c3c0 tx=0x7f4a68007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:21.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.069+0000 7f4a70ff9700 1 -- 172.21.15.72:0/2243787342 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68013450 con 0x7f4a740c44a0 2023-08-31T19:26:21.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.069+0000 7f4a70ff9700 1 -- 172.21.15.72:0/2243787342 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a680135b0 con 0x7f4a740c44a0 2023-08-31T19:26:21.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.069+0000 7f4a7abff700 1 -- 172.21.15.72:0/2243787342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a740ad980 con 0x7f4a740c44a0 2023-08-31T19:26:21.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.069+0000 7f4a70ff9700 1 -- 172.21.15.72:0/2243787342 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68013970 con 0x7f4a740c44a0 2023-08-31T19:26:21.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.069+0000 7f4a7abff700 1 -- 172.21.15.72:0/2243787342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a740adf40 con 0x7f4a740c44a0 2023-08-31T19:26:21.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.070+0000 7f4a7abff700 1 -- 172.21.15.72:0/2243787342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a740ae900 con 0x7f4a740c44a0 2023-08-31T19:26:21.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.071+0000 7f4a70ff9700 1 -- 172.21.15.72:0/2243787342 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4a68013ce0 con 0x7f4a740c44a0 2023-08-31T19:26:21.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.072+0000 7f4a70ff9700 1 --2- 172.21.15.72:0/2243787342 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4a5805ef30 0x7f4a580613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:21.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.072+0000 7f4a70ff9700 1 -- 172.21.15.72:0/2243787342 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f4a68079800 con 0x7f4a740c44a0 2023-08-31T19:26:21.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.072+0000 7f4a73fff700 1 --2- 172.21.15.72:0/2243787342 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4a5805ef30 0x7f4a580613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:21.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.072+0000 7f4a73fff700 1 --2- 172.21.15.72:0/2243787342 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4a5805ef30 0x7f4a580613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4a60009130 tx=0x7f4a60017000).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:21.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.076+0000 7f4a70ff9700 1 -- 172.21.15.72:0/2243787342 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4a6804ab50 con 0x7f4a740c44a0 2023-08-31T19:26:21.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.247+0000 7f4a7abff700 1 -- 172.21.15.72:0/2243787342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4a7406c6b0 con 0x7f4a740c44a0 2023-08-31T19:26:21.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.248+0000 7f4a70ff9700 1 -- 172.21.15.72:0/2243787342 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v191) v1 ==== 84+0+143 (secure 0 0 0) 0x7f4a68018030 con 0x7f4a740c44a0 2023-08-31T19:26:21.249 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:21.249 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:26:21.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:21.249 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-08-31T19:26:21.250 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "device_health_metrics" 2023-08-31T19:26:21.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-08-31T19:26:21.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:21.250 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-08-31T19:26:21.250 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-08-31T19:26:21.251 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:21.251 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:26:21.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.250+0000 7f4a7abff700 1 -- 172.21.15.72:0/2243787342 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4a5805ef30 msgr2=0x7f4a580613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:21.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.250+0000 7f4a7abff700 1 --2- 172.21.15.72:0/2243787342 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4a5805ef30 0x7f4a580613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4a60009130 tx=0x7f4a60017000).stop 2023-08-31T19:26:21.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.250+0000 7f4a7abff700 1 -- 172.21.15.72:0/2243787342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a740c44a0 msgr2=0x7f4a74152a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:21.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.250+0000 7f4a7abff700 1 --2- 172.21.15.72:0/2243787342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a740c44a0 0x7f4a74152a00 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f4a6800c3c0 tx=0x7f4a68007e20).stop 2023-08-31T19:26:21.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.250+0000 7f4a7abff700 1 -- 172.21.15.72:0/2243787342 shutdown_connections 2023-08-31T19:26:21.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.250+0000 7f4a7abff700 1 --2- 172.21.15.72:0/2243787342 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4a5805ef30 0x7f4a580613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.250+0000 7f4a7abff700 1 --2- 172.21.15.72:0/2243787342 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4a74152ef0 0x7f4a740a6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.250+0000 7f4a7abff700 1 --2- 172.21.15.72:0/2243787342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a740c44a0 0x7f4a74152a00 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.250+0000 7f4a7abff700 1 --2- 172.21.15.72:0/2243787342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a740c5fb0 0x7f4a740a6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.250+0000 7f4a7abff700 1 -- 172.21.15.72:0/2243787342 >> 172.21.15.72:0/2243787342 conn(0x7f4a74082f60 msgr2=0x7f4a740c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:21.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.250+0000 7f4a7abff700 1 -- 172.21.15.72:0/2243787342 shutdown_connections 2023-08-31T19:26:21.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.250+0000 7f4a7abff700 1 -- 172.21.15.72:0/2243787342 wait complete. 2023-08-31T19:26:21.267 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T19:26:21.268 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-31T19:26:21.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.460+0000 7f883fdff700 1 Processor -- start 2023-08-31T19:26:21.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.460+0000 7f883fdff700 1 -- start start 2023-08-31T19:26:21.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.462+0000 7f883fdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8838068c20 0x7f8838069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:21.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.462+0000 7f883fdff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88380c2260 con 0x7f8838063c20 2023-08-31T19:26:21.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.462+0000 7f883fdff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8838062b80 con 0x7f8838062650 2023-08-31T19:26:21.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.462+0000 7f883fdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8838062e60 con 0x7f8838068c20 2023-08-31T19:26:21.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.462+0000 7f883e39c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8838063c20 0x7f8838157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36068/0 (socket says 172.21.15.72:36068) 2023-08-31T19:26:21.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.462+0000 7f883e39c700 1 -- 172.21.15.72:0/2352395274 learned_addr learned my addr 172.21.15.72:0/2352395274 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:21.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.462+0000 7f883db9b700 1 --2- 172.21.15.72:0/2352395274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8838068c20 0x7f8838069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:21.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.462+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177272346 0 0) 0x7f88380c2260 con 0x7f8838063c20 2023-08-31T19:26:21.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.462+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88240033f0 con 0x7f8838063c20 2023-08-31T19:26:21.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838877265 0 0) 0x7f8838062b80 con 0x7f8838062650 2023-08-31T19:26:21.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88380c2260 con 0x7f8838062650 2023-08-31T19:26:21.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1773480523 0 0) 0x7f88240033f0 con 0x7f8838063c20 2023-08-31T19:26:21.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8838068c20 msgr2=0x7f8838069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:21.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883cb99700 1 --2- 172.21.15.72:0/2352395274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8838068c20 0x7f8838069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 >> v1:172.21.15.146:6789/0 conn(0x7f8838062650 legacy=0x7f88380c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:21.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8838063140 con 0x7f8838063c20 2023-08-31T19:26:21.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f88300017f0 con 0x7f8838063c20 2023-08-31T19:26:21.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 >> v1:172.21.15.72:6789/0 conn(0x7f8838063c20 legacy=0x7f8838157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:21.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883cb99700 1 --2- 172.21.15.72:0/2352395274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8824003aa0 0x7f8824003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:21.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883cb99700 1 --2- 172.21.15.72:0/2352395274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8838068c20 0x7f8824004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:21.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883cb99700 1 --2- 172.21.15.72:0/2352395274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8824004b80 0x7f8824005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:21.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8838062e60 con 0x7f8824003aa0 2023-08-31T19:26:21.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882400b990 con 0x7f8824004b80 2023-08-31T19:26:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882400bb00 con 0x7f8838068c20 2023-08-31T19:26:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883db9b700 1 --2- 172.21.15.72:0/2352395274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8824003aa0 0x7f8824003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883e39c700 1 --2- 172.21.15.72:0/2352395274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8824004b80 0x7f8824005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883d39a700 1 --2- 172.21.15.72:0/2352395274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8838068c20 0x7f8824004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883db9b700 1 -- 172.21.15.72:0/2352395274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8838068c20 msgr2=0x7f8824004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883db9b700 1 --2- 172.21.15.72:0/2352395274 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8838068c20 0x7f8824004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883db9b700 1 -- 172.21.15.72:0/2352395274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8824004b80 msgr2=0x7f8824005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883db9b700 1 --2- 172.21.15.72:0/2352395274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8824004b80 0x7f8824005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.463+0000 7f883db9b700 1 -- 172.21.15.72:0/2352395274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88240033f0 con 0x7f8824003aa0 2023-08-31T19:26:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.464+0000 7f883db9b700 1 --2- 172.21.15.72:0/2352395274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8824003aa0 0x7f8824003ea0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f8834009a80 tx=0x7f8834009060).ready entity=mon.0 client_cookie=f2d204fc2946300d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:21.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.464+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834009430 con 0x7f8824003aa0 2023-08-31T19:26:21.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.464+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883400e640 con 0x7f8824003aa0 2023-08-31T19:26:21.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.464+0000 7f883cb99700 1 -- 172.21.15.72:0/2352395274 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883400e9c0 con 0x7f8824003aa0 2023-08-31T19:26:21.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.464+0000 7f883fdff700 1 -- 172.21.15.72:0/2352395274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8824003aa0 msgr2=0x7f8824003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:21.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.464+0000 7f883fdff700 1 --2- 172.21.15.72:0/2352395274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8824003aa0 0x7f8824003ea0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f8834009a80 tx=0x7f8834009060).stop 2023-08-31T19:26:21.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.464+0000 7f883e39c700 1 -- 172.21.15.72:0/2352395274 reap_dead start 2023-08-31T19:26:21.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.464+0000 7f883fdff700 1 -- 172.21.15.72:0/2352395274 shutdown_connections 2023-08-31T19:26:21.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.464+0000 7f883fdff700 1 -- 172.21.15.72:0/2352395274 >> 172.21.15.72:0/2352395274 conn(0x7f88380c72f0 msgr2=0x7f88380c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:21.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.464+0000 7f883fdff700 1 -- 172.21.15.72:0/2352395274 shutdown_connections 2023-08-31T19:26:21.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.465+0000 7f883fdff700 1 -- 172.21.15.72:0/2352395274 wait complete. 2023-08-31T19:26:21.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.466+0000 7f883fdff700 1 Processor -- start 2023-08-31T19:26:21.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.466+0000 7f883fdff700 1 -- start start 2023-08-31T19:26:21.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.467+0000 7f883fdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8824003aa0 0x7f883814b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:21.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.467+0000 7f883fdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f883814f930 0x7f883814fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:21.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.467+0000 7f883fdff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f883814c110 0x7f883814c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:21.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.467+0000 7f883fdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88381502a0 con 0x7f883814f930 2023-08-31T19:26:21.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.467+0000 7f883fdff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883814ca80 con 0x7f883814c110 2023-08-31T19:26:21.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.467+0000 7f883fdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883814cf60 con 0x7f8824003aa0 2023-08-31T19:26:21.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.467+0000 7f883d39a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f883814f930 0x7f883814fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.467+0000 7f883d39a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f883814f930 0x7f883814fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51574/0 (socket says 172.21.15.72:51574) 2023-08-31T19:26:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.467+0000 7f883d39a700 1 -- 172.21.15.72:0/2973814418 learned_addr learned my addr 172.21.15.72:0/2973814418 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.468+0000 7f883db9b700 1 --2- 172.21.15.72:0/2973814418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8824003aa0 0x7f883814b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.468+0000 7f883e39c700 1 --2- 172.21.15.72:0/2973814418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f883814c110 0x7f883814c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:21.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.468+0000 7f883d39a700 1 -- 172.21.15.72:0/2973814418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8824003aa0 msgr2=0x7f883814b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.468+0000 7f883d39a700 1 --2- 172.21.15.72:0/2973814418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8824003aa0 0x7f883814b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.468+0000 7f883d39a700 1 -- 172.21.15.72:0/2973814418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f883814c110 msgr2=0x7f883814c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.468+0000 7f883d39a700 1 --2- 172.21.15.72:0/2973814418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f883814c110 0x7f883814c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.468+0000 7f883d39a700 1 -- 172.21.15.72:0/2973814418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88381504a0 con 0x7f883814f930 2023-08-31T19:26:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.468+0000 7f883d39a700 1 --2- 172.21.15.72:0/2973814418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f883814f930 0x7f883814fdb0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7f882800e560 tx=0x7f8828009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:21.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.468+0000 7f882dffb700 1 -- 172.21.15.72:0/2973814418 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828001570 con 0x7f883814f930 2023-08-31T19:26:21.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.468+0000 7f882dffb700 1 -- 172.21.15.72:0/2973814418 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88280016d0 con 0x7f883814f930 2023-08-31T19:26:21.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.468+0000 7f883fdff700 1 -- 172.21.15.72:0/2973814418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8838150780 con 0x7f883814f930 2023-08-31T19:26:21.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.468+0000 7f882dffb700 1 -- 172.21.15.72:0/2973814418 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828001a70 con 0x7f883814f930 2023-08-31T19:26:21.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.468+0000 7f883fdff700 1 -- 172.21.15.72:0/2973814418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8838150d40 con 0x7f883814f930 2023-08-31T19:26:21.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.469+0000 7f883fdff700 1 -- 172.21.15.72:0/2973814418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883806c6b0 con 0x7f883814f930 2023-08-31T19:26:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.470+0000 7f882dffb700 1 -- 172.21.15.72:0/2973814418 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8828014430 con 0x7f883814f930 2023-08-31T19:26:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.471+0000 7f882dffb700 1 --2- 172.21.15.72:0/2973814418 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f881c05ef30 0x7f881c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.471+0000 7f882dffb700 1 -- 172.21.15.72:0/2973814418 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f8828079c40 con 0x7f883814f930 2023-08-31T19:26:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.471+0000 7f883db9b700 1 --2- 172.21.15.72:0/2973814418 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f881c05ef30 0x7f881c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.472+0000 7f883db9b700 1 --2- 172.21.15.72:0/2973814418 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f881c05ef30 0x7f881c0613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8834009a80 tx=0x7f883401a000).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:21.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.475+0000 7f882dffb700 1 -- 172.21.15.72:0/2973814418 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f88280498f0 con 0x7f883814f930 2023-08-31T19:26:21.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.646+0000 7f883fdff700 1 -- 172.21.15.72:0/2973814418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f8838151380 con 0x7f883814f930 2023-08-31T19:26:21.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.795+0000 7f882dffb700 1 -- 172.21.15.72:0/2973814418 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v192) v1 ==== 152+0+0 (secure 0 0 0) 0x7f8838151380 con 0x7f883814f930 2023-08-31T19:26:21.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.799+0000 7f883fdff700 1 -- 172.21.15.72:0/2973814418 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f881c05ef30 msgr2=0x7f881c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:21.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.799+0000 7f883fdff700 1 --2- 172.21.15.72:0/2973814418 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f881c05ef30 0x7f881c0613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8834009a80 tx=0x7f883401a000).stop 2023-08-31T19:26:21.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.799+0000 7f883fdff700 1 -- 172.21.15.72:0/2973814418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f883814f930 msgr2=0x7f883814fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:21.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.799+0000 7f883fdff700 1 --2- 172.21.15.72:0/2973814418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f883814f930 0x7f883814fdb0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7f882800e560 tx=0x7f8828009040).stop 2023-08-31T19:26:21.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.800+0000 7f883fdff700 1 -- 172.21.15.72:0/2973814418 shutdown_connections 2023-08-31T19:26:21.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.800+0000 7f883fdff700 1 --2- 172.21.15.72:0/2973814418 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f881c05ef30 0x7f881c0613f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.800+0000 7f883fdff700 1 --2- 172.21.15.72:0/2973814418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f883814c110 0x7f883814c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.800+0000 7f883fdff700 1 --2- 172.21.15.72:0/2973814418 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8824003aa0 0x7f883814b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.800+0000 7f883fdff700 1 --2- 172.21.15.72:0/2973814418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f883814f930 0x7f883814fdb0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:21.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.800+0000 7f883fdff700 1 -- 172.21.15.72:0/2973814418 >> 172.21.15.72:0/2973814418 conn(0x7f88380c72f0 msgr2=0x7f88380c6690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:21.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.800+0000 7f883fdff700 1 -- 172.21.15.72:0/2973814418 shutdown_connections 2023-08-31T19:26:21.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:21.800+0000 7f883fdff700 1 -- 172.21.15.72:0/2973814418 wait complete. 2023-08-31T19:26:21.806 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-08-31T19:26:21.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T19:26:22.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.018+0000 7f5aab9ff700 1 Processor -- start 2023-08-31T19:26:22.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.019+0000 7f5aab9ff700 1 -- start start 2023-08-31T19:26:22.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.020+0000 7f5aab9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5aa4154210 0x7f5aa40630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:22.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.020+0000 7f5aab9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5aa40635a0 0x7f5aa40c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:22.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.020+0000 7f5aab9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa4063a00 con 0x7f5aa4153e30 2023-08-31T19:26:22.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.020+0000 7f5aab9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa4154690 con 0x7f5aa40635a0 2023-08-31T19:26:22.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.020+0000 7f5aab9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa40bfd40 con 0x7f5aa4154210 2023-08-31T19:26:22.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.020+0000 7f5aa9f9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5aa40635a0 0x7f5aa40c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:22.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.020+0000 7f5aa9f9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5aa40635a0 0x7f5aa40c0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51576/0 (socket says 172.21.15.72:51576) 2023-08-31T19:26:22.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.020+0000 7f5aa9f9c700 1 -- 172.21.15.72:0/661200289 learned_addr learned my addr 172.21.15.72:0/661200289 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.021+0000 7f5aa8f9a700 1 --2- 172.21.15.72:0/661200289 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5aa4154210 0x7f5aa40630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:22.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.021+0000 7f5aa9f9c700 1 -- 172.21.15.72:0/661200289 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5aa4154210 msgr2=0x7f5aa40630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.021+0000 7f5aa9f9c700 1 --2- 172.21.15.72:0/661200289 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5aa4154210 0x7f5aa40630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.021+0000 7f5aa9f9c700 1 -- 172.21.15.72:0/661200289 >> v1:172.21.15.146:6789/0 conn(0x7f5aa4153e30 legacy=0x7f5aa40c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.021+0000 7f5aa9f9c700 1 -- 172.21.15.72:0/661200289 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa40c6730 con 0x7f5aa40635a0 2023-08-31T19:26:22.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.021+0000 7f5aa9f9c700 1 --2- 172.21.15.72:0/661200289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5aa40635a0 0x7f5aa40c0ac0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7f5a9c009f20 tx=0x7f5a9c009840).ready entity=mon.0 client_cookie=cbad6dfe9f6e687a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:22.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.021+0000 7f5a9bfff700 1 -- 172.21.15.72:0/661200289 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c00e070 con 0x7f5aa40635a0 2023-08-31T19:26:22.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.021+0000 7f5a9bfff700 1 -- 172.21.15.72:0/661200289 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c00ba80 con 0x7f5aa40635a0 2023-08-31T19:26:22.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.021+0000 7f5a9bfff700 1 -- 172.21.15.72:0/661200289 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c00be00 con 0x7f5aa40635a0 2023-08-31T19:26:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.022+0000 7f5aab9ff700 1 -- 172.21.15.72:0/661200289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5aa40635a0 msgr2=0x7f5aa40c0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.022+0000 7f5aab9ff700 1 --2- 172.21.15.72:0/661200289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5aa40635a0 0x7f5aa40c0ac0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7f5a9c009f20 tx=0x7f5a9c009840).stop 2023-08-31T19:26:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.022+0000 7f5aab9ff700 1 -- 172.21.15.72:0/661200289 shutdown_connections 2023-08-31T19:26:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.022+0000 7f5aab9ff700 1 --2- 172.21.15.72:0/661200289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5aa40635a0 0x7f5aa40c0ac0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.022+0000 7f5aab9ff700 1 --2- 172.21.15.72:0/661200289 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5aa4154210 0x7f5aa40630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.022+0000 7f5aab9ff700 1 -- 172.21.15.72:0/661200289 >> 172.21.15.72:0/661200289 conn(0x7f5aa405eb20 msgr2=0x7f5aa40cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.022+0000 7f5aab9ff700 1 -- 172.21.15.72:0/661200289 shutdown_connections 2023-08-31T19:26:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.022+0000 7f5aab9ff700 1 -- 172.21.15.72:0/661200289 wait complete. 2023-08-31T19:26:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.023+0000 7f5aab9ff700 1 Processor -- start 2023-08-31T19:26:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.024+0000 7f5aab9ff700 1 -- start start 2023-08-31T19:26:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.024+0000 7f5aab9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5aa40635a0 0x7f5aa4167980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.024+0000 7f5aab9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5aa4153e30 0x7f5aa4167e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.024+0000 7f5aab9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5aa4154210 0x7f5aa41643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.024+0000 7f5aab9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa4168360 con 0x7f5aa40635a0 2023-08-31T19:26:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.024+0000 7f5aab9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa4166190 con 0x7f5aa4153e30 2023-08-31T19:26:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.024+0000 7f5aab9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa40c26a0 con 0x7f5aa4154210 2023-08-31T19:26:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.025+0000 7f5aa979b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5aa40635a0 0x7f5aa4167980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.025+0000 7f5aa979b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5aa40635a0 0x7f5aa4167980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51586/0 (socket says 172.21.15.72:51586) 2023-08-31T19:26:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.025+0000 7f5aa979b700 1 -- 172.21.15.72:0/1347046655 learned_addr learned my addr 172.21.15.72:0/1347046655 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.025+0000 7f5aa8f9a700 1 --2- 172.21.15.72:0/1347046655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5aa4153e30 0x7f5aa4167e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.025+0000 7f5aa9f9c700 1 --2- 172.21.15.72:0/1347046655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5aa4154210 0x7f5aa41643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.025+0000 7f5aa979b700 1 -- 172.21.15.72:0/1347046655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5aa4154210 msgr2=0x7f5aa41643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.025+0000 7f5aa979b700 1 --2- 172.21.15.72:0/1347046655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5aa4154210 0x7f5aa41643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.025+0000 7f5aa979b700 1 -- 172.21.15.72:0/1347046655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5aa4153e30 msgr2=0x7f5aa4167e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.025+0000 7f5aa979b700 1 --2- 172.21.15.72:0/1347046655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5aa4153e30 0x7f5aa4167e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.025+0000 7f5aa979b700 1 -- 172.21.15.72:0/1347046655 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c009ae0 con 0x7f5aa40635a0 2023-08-31T19:26:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.025+0000 7f5aa979b700 1 --2- 172.21.15.72:0/1347046655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5aa40635a0 0x7f5aa4167980 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7f5aa000c4f0 tx=0x7f5aa0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.026+0000 7f5a997fa700 1 -- 172.21.15.72:0/1347046655 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa000ce60 con 0x7f5aa40635a0 2023-08-31T19:26:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.026+0000 7f5a997fa700 1 -- 172.21.15.72:0/1347046655 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa0001e90 con 0x7f5aa40635a0 2023-08-31T19:26:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.026+0000 7f5a997fa700 1 -- 172.21.15.72:0/1347046655 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0007250 con 0x7f5aa40635a0 2023-08-31T19:26:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.026+0000 7f5aab9ff700 1 -- 172.21.15.72:0/1347046655 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa4165580 con 0x7f5aa40635a0 2023-08-31T19:26:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.026+0000 7f5aab9ff700 1 -- 172.21.15.72:0/1347046655 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa4165b40 con 0x7f5aa40635a0 2023-08-31T19:26:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.027+0000 7f5aab9ff700 1 -- 172.21.15.72:0/1347046655 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa406c6b0 con 0x7f5aa40635a0 2023-08-31T19:26:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.028+0000 7f5a997fa700 1 -- 172.21.15.72:0/1347046655 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f5aa00066a0 con 0x7f5aa40635a0 2023-08-31T19:26:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.029+0000 7f5a997fa700 1 --2- 172.21.15.72:0/1347046655 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5a8805ef30 0x7f5a880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.029+0000 7f5a997fa700 1 -- 172.21.15.72:0/1347046655 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f5aa00798c0 con 0x7f5aa40635a0 2023-08-31T19:26:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.029+0000 7f5aa8f9a700 1 --2- 172.21.15.72:0/1347046655 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5a8805ef30 0x7f5a880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.030+0000 7f5aa8f9a700 1 --2- 172.21.15.72:0/1347046655 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5a8805ef30 0x7f5a880613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5aa4165530 tx=0x7f5a94008040).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.034+0000 7f5a997fa700 1 -- 172.21.15.72:0/1347046655 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5aa004ab00 con 0x7f5aa40635a0 2023-08-31T19:26:22.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.202+0000 7f5aab9ff700 1 -- 172.21.15.72:0/1347046655 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5aa40bffe0 con 0x7f5aa40635a0 2023-08-31T19:26:22.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.800+0000 7f5a997fa700 1 -- 172.21.15.72:0/1347046655 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v193) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5aa004e120 con 0x7f5aa40635a0 2023-08-31T19:26:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.807+0000 7f5aab9ff700 1 -- 172.21.15.72:0/1347046655 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5a8805ef30 msgr2=0x7f5a880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.807+0000 7f5aab9ff700 1 --2- 172.21.15.72:0/1347046655 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5a8805ef30 0x7f5a880613f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5aa4165530 tx=0x7f5a94008040).stop 2023-08-31T19:26:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.807+0000 7f5aab9ff700 1 -- 172.21.15.72:0/1347046655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5aa40635a0 msgr2=0x7f5aa4167980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.807+0000 7f5aab9ff700 1 --2- 172.21.15.72:0/1347046655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5aa40635a0 0x7f5aa4167980 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 rx=0x7f5aa000c4f0 tx=0x7f5aa0007e00).stop 2023-08-31T19:26:22.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.809+0000 7f5aab9ff700 1 -- 172.21.15.72:0/1347046655 shutdown_connections 2023-08-31T19:26:22.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.809+0000 7f5aab9ff700 1 --2- 172.21.15.72:0/1347046655 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5a8805ef30 0x7f5a880613f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:22.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.809+0000 7f5aab9ff700 1 --2- 172.21.15.72:0/1347046655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5aa4154210 0x7f5aa41643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.809+0000 7f5aab9ff700 1 --2- 172.21.15.72:0/1347046655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5aa40635a0 0x7f5aa4167980 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.809+0000 7f5aab9ff700 1 --2- 172.21.15.72:0/1347046655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5aa4153e30 0x7f5aa4167e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.809+0000 7f5aab9ff700 1 -- 172.21.15.72:0/1347046655 >> 172.21.15.72:0/1347046655 conn(0x7f5aa405eb20 msgr2=0x7f5aa40c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:22.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.816+0000 7f5aab9ff700 1 -- 172.21.15.72:0/1347046655 shutdown_connections 2023-08-31T19:26:22.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:22.820+0000 7f5aab9ff700 1 -- 172.21.15.72:0/1347046655 wait complete. 2023-08-31T19:26:22.834 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-08-31T19:26:22.852 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T19:26:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.046+0000 7fb70f1ff700 1 Processor -- start 2023-08-31T19:26:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.046+0000 7fb70f1ff700 1 -- start start 2023-08-31T19:26:23.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.047+0000 7fb70f1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb708154030 0x7fb708154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.047+0000 7fb70f1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7080c06b0 0x7fb7080c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.047+0000 7fb70f1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7080c6ed0 con 0x7fb7080aa140 2023-08-31T19:26:23.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.047+0000 7fb70f1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7080c66e0 con 0x7fb7080c06b0 2023-08-31T19:26:23.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.047+0000 7fb70f1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7080c68c0 con 0x7fb708154030 2023-08-31T19:26:23.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.048+0000 7fb707fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7080c06b0 0x7fb7080c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.048+0000 7fb707fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7080c06b0 0x7fb7080c7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59036/0 (socket says 172.21.15.72:59036) 2023-08-31T19:26:23.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.048+0000 7fb707fff700 1 -- 172.21.15.72:0/3434906571 learned_addr learned my addr 172.21.15.72:0/3434906571 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:23.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.048+0000 7fb70cf9b700 1 --2- 172.21.15.72:0/3434906571 >> v2:172.21.15.146:3300/0 conn(0x7fb708154030 0x7fb708154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.048+0000 7fb707fff700 1 -- 172.21.15.72:0/3434906571 >> v2:172.21.15.146:3300/0 conn(0x7fb708154030 msgr2=0x7fb708154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.048+0000 7fb707fff700 1 --2- 172.21.15.72:0/3434906571 >> v2:172.21.15.146:3300/0 conn(0x7fb708154030 0x7fb708154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.048+0000 7fb707fff700 1 -- 172.21.15.72:0/3434906571 >> v1:172.21.15.146:6789/0 conn(0x7fb7080aa140 legacy=0x7fb708063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.048+0000 7fb707fff700 1 -- 172.21.15.72:0/3434906571 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7080c0f30 con 0x7fb7080c06b0 2023-08-31T19:26:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.048+0000 7fb70cf9b700 1 --2- 172.21.15.72:0/3434906571 >> v2:172.21.15.146:3300/0 conn(0x7fb708154030 0x7fb708154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:23.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.048+0000 7fb707fff700 1 --2- 172.21.15.72:0/3434906571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7080c06b0 0x7fb7080c7360 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7fb7080c8bc0 tx=0x7fb6f40090f0).ready entity=mon.0 client_cookie=dcad458cf4b0b49b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:23.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.049+0000 7fb7077fe700 1 -- 172.21.15.72:0/3434906571 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f400b5a0 con 0x7fb7080c06b0 2023-08-31T19:26:23.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.049+0000 7fb7077fe700 1 -- 172.21.15.72:0/3434906571 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f400b700 con 0x7fb7080c06b0 2023-08-31T19:26:23.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.049+0000 7fb7077fe700 1 -- 172.21.15.72:0/3434906571 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f400ba80 con 0x7fb7080c06b0 2023-08-31T19:26:23.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.049+0000 7fb70f1ff700 1 -- 172.21.15.72:0/3434906571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7080c06b0 msgr2=0x7fb7080c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.049+0000 7fb70f1ff700 1 --2- 172.21.15.72:0/3434906571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7080c06b0 0x7fb7080c7360 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7fb7080c8bc0 tx=0x7fb6f40090f0).stop 2023-08-31T19:26:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.049+0000 7fb70f1ff700 1 -- 172.21.15.72:0/3434906571 shutdown_connections 2023-08-31T19:26:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.049+0000 7fb70f1ff700 1 --2- 172.21.15.72:0/3434906571 >> v2:172.21.15.146:3300/0 conn(0x7fb708154030 0x7fb708154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.049+0000 7fb70f1ff700 1 --2- 172.21.15.72:0/3434906571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7080c06b0 0x7fb7080c7360 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.049+0000 7fb70f1ff700 1 -- 172.21.15.72:0/3434906571 >> 172.21.15.72:0/3434906571 conn(0x7fb70805eb60 msgr2=0x7fb7080cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.049+0000 7fb70f1ff700 1 -- 172.21.15.72:0/3434906571 shutdown_connections 2023-08-31T19:26:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.049+0000 7fb70f1ff700 1 -- 172.21.15.72:0/3434906571 wait complete. 2023-08-31T19:26:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.051+0000 7fb70f1ff700 1 Processor -- start 2023-08-31T19:26:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.051+0000 7fb70f1ff700 1 -- start start 2023-08-31T19:26:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.052+0000 7fb70f1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7080aa140 0x7fb708152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.052+0000 7fb70f1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7080c06b0 0x7fb708150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.052+0000 7fb70f1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb708154030 0x7fb70813ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.052+0000 7fb70f1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080af680 con 0x7fb708154030 2023-08-31T19:26:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.052+0000 7fb70f1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb708153760 con 0x7fb7080c06b0 2023-08-31T19:26:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.052+0000 7fb70f1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080aed50 con 0x7fb7080aa140 2023-08-31T19:26:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.052+0000 7fb70d79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb708154030 0x7fb70813ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.052+0000 7fb70d79c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb708154030 0x7fb70813ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59046/0 (socket says 172.21.15.72:59046) 2023-08-31T19:26:23.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.052+0000 7fb70d79c700 1 -- 172.21.15.72:0/478948797 learned_addr learned my addr 172.21.15.72:0/478948797 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:23.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.052+0000 7fb707fff700 1 --2- 172.21.15.72:0/478948797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7080c06b0 0x7fb708150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.052+0000 7fb70cf9b700 1 --2- 172.21.15.72:0/478948797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7080aa140 0x7fb708152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.053+0000 7fb70d79c700 1 -- 172.21.15.72:0/478948797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7080aa140 msgr2=0x7fb708152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.053+0000 7fb70d79c700 1 --2- 172.21.15.72:0/478948797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7080aa140 0x7fb708152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.053+0000 7fb70d79c700 1 -- 172.21.15.72:0/478948797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7080c06b0 msgr2=0x7fb708150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.053+0000 7fb70d79c700 1 --2- 172.21.15.72:0/478948797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7080c06b0 0x7fb708150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.053+0000 7fb70d79c700 1 -- 172.21.15.72:0/478948797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f4009370 con 0x7fb708154030 2023-08-31T19:26:23.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.053+0000 7fb70d79c700 1 --2- 172.21.15.72:0/478948797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb708154030 0x7fb70813ef80 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7fb70000c810 tx=0x7fb700002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:23.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.053+0000 7fb704ff9700 1 -- 172.21.15.72:0/478948797 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700010510 con 0x7fb708154030 2023-08-31T19:26:23.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.053+0000 7fb704ff9700 1 -- 172.21.15.72:0/478948797 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb700010670 con 0x7fb708154030 2023-08-31T19:26:23.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.053+0000 7fb70f1ff700 1 -- 172.21.15.72:0/478948797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7080af030 con 0x7fb708154030 2023-08-31T19:26:23.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.053+0000 7fb704ff9700 1 -- 172.21.15.72:0/478948797 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700010a30 con 0x7fb708154030 2023-08-31T19:26:23.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.053+0000 7fb70f1ff700 1 -- 172.21.15.72:0/478948797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb708153400 con 0x7fb708154030 2023-08-31T19:26:23.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.054+0000 7fb70f1ff700 1 -- 172.21.15.72:0/478948797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7080af7f0 con 0x7fb708154030 2023-08-31T19:26:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.056+0000 7fb704ff9700 1 -- 172.21.15.72:0/478948797 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb700012440 con 0x7fb708154030 2023-08-31T19:26:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.056+0000 7fb704ff9700 1 --2- 172.21.15.72:0/478948797 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb6ec05ef30 0x7fb6ec0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.057+0000 7fb704ff9700 1 -- 172.21.15.72:0/478948797 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6677+0+0 (secure 0 0 0) 0x7fb70007a3d0 con 0x7fb708154030 2023-08-31T19:26:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.057+0000 7fb70cf9b700 1 --2- 172.21.15.72:0/478948797 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb6ec05ef30 0x7fb6ec0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.057+0000 7fb70cf9b700 1 --2- 172.21.15.72:0/478948797 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb6ec05ef30 0x7fb6ec0613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb6fc00ab40 tx=0x7fb6fc008040).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:23.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.060+0000 7fb704ff9700 1 -- 172.21.15.72:0/478948797 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb70004b4e0 con 0x7fb708154030 2023-08-31T19:26:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.266+0000 7fb70f1ff700 1 -- 172.21.15.72:0/478948797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb70806c6b0 con 0x7fb708154030 2023-08-31T19:26:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.273+0000 7fb704ff9700 1 -- 172.21.15.72:0/478948797 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v83) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb700021070 con 0x7fb708154030 2023-08-31T19:26:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.277+0000 7fb70f1ff700 1 -- 172.21.15.72:0/478948797 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb6ec05ef30 msgr2=0x7fb6ec0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.277+0000 7fb70f1ff700 1 --2- 172.21.15.72:0/478948797 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb6ec05ef30 0x7fb6ec0613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb6fc00ab40 tx=0x7fb6fc008040).stop 2023-08-31T19:26:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.277+0000 7fb70f1ff700 1 -- 172.21.15.72:0/478948797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb708154030 msgr2=0x7fb70813ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.277+0000 7fb70f1ff700 1 --2- 172.21.15.72:0/478948797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb708154030 0x7fb70813ef80 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7fb70000c810 tx=0x7fb700002560).stop 2023-08-31T19:26:23.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.281+0000 7fb70f1ff700 1 -- 172.21.15.72:0/478948797 shutdown_connections 2023-08-31T19:26:23.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.281+0000 7fb70f1ff700 1 --2- 172.21.15.72:0/478948797 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb6ec05ef30 0x7fb6ec0613f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.281+0000 7fb70f1ff700 1 --2- 172.21.15.72:0/478948797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb708154030 0x7fb70813ef80 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.281+0000 7fb70f1ff700 1 --2- 172.21.15.72:0/478948797 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7080aa140 0x7fb708152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.281+0000 7fb70f1ff700 1 --2- 172.21.15.72:0/478948797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7080c06b0 0x7fb708150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.281+0000 7fb70f1ff700 1 -- 172.21.15.72:0/478948797 >> 172.21.15.72:0/478948797 conn(0x7fb70805eb60 msgr2=0x7fb7080ca240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:23.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.282+0000 7fb70f1ff700 1 -- 172.21.15.72:0/478948797 shutdown_connections 2023-08-31T19:26:23.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.282+0000 7fb70f1ff700 1 -- 172.21.15.72:0/478948797 wait complete. 2023-08-31T19:26:23.288 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 23 and data pool 24 2023-08-31T19:26:23.313 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:26:23.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.501+0000 7f4771bff700 1 Processor -- start 2023-08-31T19:26:23.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.502+0000 7f4771bff700 1 -- start start 2023-08-31T19:26:23.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.503+0000 7f4771bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f476c0c4520 0x7f476c15ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.503+0000 7f4771bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476c0c5950 con 0x7f476c0c5300 2023-08-31T19:26:23.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.503+0000 7f4771bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476c0c5c30 con 0x7f476c1541a0 2023-08-31T19:26:23.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.503+0000 7f4771bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476c0c5f10 con 0x7f476c0c4520 2023-08-31T19:26:23.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.503+0000 7f476affd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f476c0c5300 0x7f476c0c3e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38864/0 (socket says 172.21.15.72:38864) 2023-08-31T19:26:23.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.503+0000 7f476affd700 1 -- 172.21.15.72:0/3379641909 learned_addr learned my addr 172.21.15.72:0/3379641909 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:23.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.503+0000 7f476bfff700 1 --2- 172.21.15.72:0/3379641909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f476c0c4520 0x7f476c15ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305778871 0 0) 0x7f476c0c5950 con 0x7f476c0c5300 2023-08-31T19:26:23.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47540033f0 con 0x7f476c0c5300 2023-08-31T19:26:23.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401728155 0 0) 0x7f476c0c5c30 con 0x7f476c1541a0 2023-08-31T19:26:23.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f476c0c5950 con 0x7f476c1541a0 2023-08-31T19:26:23.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3044082938 0 0) 0x7f47540033f0 con 0x7f476c0c5300 2023-08-31T19:26:23.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f476c0c4520 msgr2=0x7f476c15ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:23.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 --2- 172.21.15.72:0/3379641909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f476c0c4520 0x7f476c15ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 >> v1:172.21.15.146:6789/0 conn(0x7f476c1541a0 legacy=0x7f476c0bf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c0a5a30 con 0x7f476c0c5300 2023-08-31T19:26:23.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f4760001470 con 0x7f476c0c5300 2023-08-31T19:26:23.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 >> v1:172.21.15.72:6789/0 conn(0x7f476c0c5300 legacy=0x7f476c0c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 --2- 172.21.15.72:0/3379641909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f476c0c4520 0x7f4754003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 --2- 172.21.15.72:0/3379641909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4754003fb0 0x7f4754004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 --2- 172.21.15.72:0/3379641909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4754004b80 0x7f4754005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c0c5f10 con 0x7f4754003fb0 2023-08-31T19:26:23.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475400b990 con 0x7f4754004b80 2023-08-31T19:26:23.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475400bb50 con 0x7f476c0c4520 2023-08-31T19:26:23.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476affd700 1 --2- 172.21.15.72:0/3379641909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4754003fb0 0x7f4754004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476bfff700 1 --2- 172.21.15.72:0/3379641909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4754004b80 0x7f4754005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.504+0000 7f476b7fe700 1 --2- 172.21.15.72:0/3379641909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f476c0c4520 0x7f4754003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.505+0000 7f476affd700 1 -- 172.21.15.72:0/3379641909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f476c0c4520 msgr2=0x7f4754003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:23.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.505+0000 7f476affd700 1 --2- 172.21.15.72:0/3379641909 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f476c0c4520 0x7f4754003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.505+0000 7f476affd700 1 -- 172.21.15.72:0/3379641909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4754004b80 msgr2=0x7f4754005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:23.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.505+0000 7f476affd700 1 --2- 172.21.15.72:0/3379641909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4754004b80 0x7f4754005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.505+0000 7f476affd700 1 -- 172.21.15.72:0/3379641909 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47540033f0 con 0x7f4754003fb0 2023-08-31T19:26:23.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.505+0000 7f476bfff700 1 --2- 172.21.15.72:0/3379641909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4754004b80 0x7f4754005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:23.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.505+0000 7f476affd700 1 --2- 172.21.15.72:0/3379641909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4754003fb0 0x7f4754004690 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7f476000c190 tx=0x7f4760001e10).ready entity=mon.0 client_cookie=d53e557c89c6d6b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:23.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.505+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4760007960 con 0x7f4754003fb0 2023-08-31T19:26:23.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.505+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476000ca00 con 0x7f4754003fb0 2023-08-31T19:26:23.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.505+0000 7f476a7fc700 1 -- 172.21.15.72:0/3379641909 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476000cd80 con 0x7f4754003fb0 2023-08-31T19:26:23.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.505+0000 7f4771bff700 1 -- 172.21.15.72:0/3379641909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4754003fb0 msgr2=0x7f4754004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.506+0000 7f4771bff700 1 --2- 172.21.15.72:0/3379641909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4754003fb0 0x7f4754004690 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7f476000c190 tx=0x7f4760001e10).stop 2023-08-31T19:26:23.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.506+0000 7f476bfff700 1 -- 172.21.15.72:0/3379641909 reap_dead start 2023-08-31T19:26:23.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.506+0000 7f4771bff700 1 -- 172.21.15.72:0/3379641909 shutdown_connections 2023-08-31T19:26:23.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.506+0000 7f4771bff700 1 -- 172.21.15.72:0/3379641909 >> 172.21.15.72:0/3379641909 conn(0x7f476c082f60 msgr2=0x7f476c05e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:23.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.506+0000 7f4771bff700 1 -- 172.21.15.72:0/3379641909 shutdown_connections 2023-08-31T19:26:23.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.506+0000 7f4771bff700 1 -- 172.21.15.72:0/3379641909 wait complete. 2023-08-31T19:26:23.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.507+0000 7f4771bff700 1 Processor -- start 2023-08-31T19:26:23.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.507+0000 7f4771bff700 1 -- start start 2023-08-31T19:26:23.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.508+0000 7f4771bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4754003fb0 0x7f476c154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.508+0000 7f4771bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f476c0adcb0 0x7f476c0ab100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.508+0000 7f4771bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f476c0a90c0 0x7f476c0a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.508+0000 7f4771bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c156000 con 0x7f476c0a90c0 2023-08-31T19:26:23.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.508+0000 7f4771bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c0a9a10 con 0x7f4754003fb0 2023-08-31T19:26:23.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.508+0000 7f4771bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476c155400 con 0x7f476c0adcb0 2023-08-31T19:26:23.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.508+0000 7f476bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f476c0a90c0 0x7f476c0a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.508+0000 7f476bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f476c0a90c0 0x7f476c0a9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59056/0 (socket says 172.21.15.72:59056) 2023-08-31T19:26:23.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.508+0000 7f476bfff700 1 -- 172.21.15.72:0/1666541821 learned_addr learned my addr 172.21.15.72:0/1666541821 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:23.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.509+0000 7f476bfff700 1 -- 172.21.15.72:0/1666541821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f476c0adcb0 msgr2=0x7f476c0ab100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.509+0000 7f476bfff700 1 --2- 172.21.15.72:0/1666541821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f476c0adcb0 0x7f476c0ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:23.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.509+0000 7f476bfff700 1 -- 172.21.15.72:0/1666541821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4754003fb0 msgr2=0x7f476c154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.509+0000 7f476bfff700 1 --2- 172.21.15.72:0/1666541821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4754003fb0 0x7f476c154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:23.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.509+0000 7f476bfff700 1 -- 172.21.15.72:0/1666541821 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c0ae130 con 0x7f476c0a90c0 2023-08-31T19:26:23.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.509+0000 7f476bfff700 1 --2- 172.21.15.72:0/1666541821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f476c0a90c0 0x7f476c0a9520 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7f476c068b70 tx=0x7f476400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:23.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.509+0000 7f47537fe700 1 -- 172.21.15.72:0/1666541821 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476400e030 con 0x7f476c0a90c0 2023-08-31T19:26:23.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.509+0000 7f47537fe700 1 -- 172.21.15.72:0/1666541821 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476400f040 con 0x7f476c0a90c0 2023-08-31T19:26:23.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.509+0000 7f4771bff700 1 -- 172.21.15.72:0/1666541821 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476c154b60 con 0x7f476c0a90c0 2023-08-31T19:26:23.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.509+0000 7f47537fe700 1 -- 172.21.15.72:0/1666541821 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764010e80 con 0x7f476c0a90c0 2023-08-31T19:26:23.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.509+0000 7f4771bff700 1 -- 172.21.15.72:0/1666541821 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476c155120 con 0x7f476c0a90c0 2023-08-31T19:26:23.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.510+0000 7f4771bff700 1 -- 172.21.15.72:0/1666541821 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476c06c6b0 con 0x7f476c0a90c0 2023-08-31T19:26:23.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.511+0000 7f47537fe700 1 -- 172.21.15.72:0/1666541821 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4764015690 con 0x7f476c0a90c0 2023-08-31T19:26:23.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.512+0000 7f47537fe700 1 --2- 172.21.15.72:0/1666541821 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f475805ef30 0x7f47580613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.512+0000 7f47537fe700 1 -- 172.21.15.72:0/1666541821 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f476407aae0 con 0x7f476c0a90c0 2023-08-31T19:26:23.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.512+0000 7f476b7fe700 1 --2- 172.21.15.72:0/1666541821 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f475805ef30 0x7f47580613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.513+0000 7f476b7fe700 1 --2- 172.21.15.72:0/1666541821 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f475805ef30 0x7f47580613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f476c1670b0 tx=0x7f475c007bb0).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:23.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.516+0000 7f47537fe700 1 -- 172.21.15.72:0/1666541821 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f476404bb40 con 0x7f476c0a90c0 2023-08-31T19:26:23.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.686+0000 7f4771bff700 1 -- 172.21.15.72:0/1666541821 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f476c06bda0 con 0x7f476c0a90c0 2023-08-31T19:26:23.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.687+0000 7f47537fe700 1 -- 172.21.15.72:0/1666541821 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+18049 (secure 0 0 0) 0x7f476404f160 con 0x7f476c0a90c0 2023-08-31T19:26:23.687 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:23.688 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":194,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:26:23.268323+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:26:21.693921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-31T19:26:22.249227+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:26:23.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.689+0000 7f4771bff700 1 -- 172.21.15.72:0/1666541821 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f475805ef30 msgr2=0x7f47580613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.689+0000 7f4771bff700 1 --2- 172.21.15.72:0/1666541821 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f475805ef30 0x7f47580613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f476c1670b0 tx=0x7f475c007bb0).stop 2023-08-31T19:26:23.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.689+0000 7f4771bff700 1 -- 172.21.15.72:0/1666541821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f476c0a90c0 msgr2=0x7f476c0a9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.689+0000 7f4771bff700 1 --2- 172.21.15.72:0/1666541821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f476c0a90c0 0x7f476c0a9520 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7f476c068b70 tx=0x7f476400b040).stop 2023-08-31T19:26:23.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.689+0000 7f4771bff700 1 -- 172.21.15.72:0/1666541821 shutdown_connections 2023-08-31T19:26:23.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.689+0000 7f4771bff700 1 --2- 172.21.15.72:0/1666541821 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f475805ef30 0x7f47580613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.689+0000 7f4771bff700 1 --2- 172.21.15.72:0/1666541821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f476c0a90c0 0x7f476c0a9520 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.689+0000 7f4771bff700 1 --2- 172.21.15.72:0/1666541821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4754003fb0 0x7f476c154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:23.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.689+0000 7f4771bff700 1 --2- 172.21.15.72:0/1666541821 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f476c0adcb0 0x7f476c0ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:23.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.689+0000 7f4771bff700 1 -- 172.21.15.72:0/1666541821 >> 172.21.15.72:0/1666541821 conn(0x7f476c082f60 msgr2=0x7f476c152c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:23.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.689+0000 7f4771bff700 1 -- 172.21.15.72:0/1666541821 shutdown_connections 2023-08-31T19:26:23.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.689+0000 7f4771bff700 1 -- 172.21.15.72:0/1666541821 wait complete. 2023-08-31T19:26:23.707 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:26:23.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.900+0000 7f75c3dff700 1 Processor -- start 2023-08-31T19:26:23.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.900+0000 7f75c3dff700 1 -- start start 2023-08-31T19:26:23.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.901+0000 7f75c3dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f75bc0c5fb0 0x7f75bc0be370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.901+0000 7f75c3dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75bc0be860 0x7f75bc0c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.901+0000 7f75c3dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc0bece0 con 0x7f75bc0c44a0 2023-08-31T19:26:23.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.901+0000 7f75c3dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc154690 con 0x7f75bc0be860 2023-08-31T19:26:23.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.901+0000 7f75c3dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc0bfb20 con 0x7f75bc0c5fb0 2023-08-31T19:26:23.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.902+0000 7f75c139a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75bc0be860 0x7f75bc0c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.902+0000 7f75c139a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75bc0be860 0x7f75bc0c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59072/0 (socket says 172.21.15.72:59072) 2023-08-31T19:26:23.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.902+0000 7f75c139a700 1 -- 172.21.15.72:0/2079531422 learned_addr learned my addr 172.21.15.72:0/2079531422 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:23.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.902+0000 7f75c1b9b700 1 --2- 172.21.15.72:0/2079531422 >> v2:172.21.15.146:3300/0 conn(0x7f75bc0c5fb0 0x7f75bc0be370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.902+0000 7f75c139a700 1 -- 172.21.15.72:0/2079531422 >> v2:172.21.15.146:3300/0 conn(0x7f75bc0c5fb0 msgr2=0x7f75bc0be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:23.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.902+0000 7f75c139a700 1 --2- 172.21.15.72:0/2079531422 >> v2:172.21.15.146:3300/0 conn(0x7f75bc0c5fb0 0x7f75bc0be370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.902+0000 7f75c139a700 1 -- 172.21.15.72:0/2079531422 >> v1:172.21.15.72:6789/0 conn(0x7f75bc0c44a0 legacy=0x7f75bc157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.902+0000 7f75c139a700 1 -- 172.21.15.72:0/2079531422 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc0c4910 con 0x7f75bc0be860 2023-08-31T19:26:23.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.902+0000 7f75c139a700 1 --2- 172.21.15.72:0/2079531422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc0be860 0x7f75bc0c3fb0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f75bc0c37a0 tx=0x7f75ac0090f0).ready entity=mon.0 client_cookie=1af9d5822479dc8c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:23.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.902+0000 7f75c0b99700 1 -- 172.21.15.72:0/2079531422 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00b600 con 0x7f75bc0be860 2023-08-31T19:26:23.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.903+0000 7f75c0b99700 1 -- 172.21.15.72:0/2079531422 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac00b760 con 0x7f75bc0be860 2023-08-31T19:26:23.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.903+0000 7f75c0b99700 1 -- 172.21.15.72:0/2079531422 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00bae0 con 0x7f75bc0be860 2023-08-31T19:26:23.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.903+0000 7f75c3dff700 1 -- 172.21.15.72:0/2079531422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc0be860 msgr2=0x7f75bc0c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.903+0000 7f75c3dff700 1 --2- 172.21.15.72:0/2079531422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc0be860 0x7f75bc0c3fb0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f75bc0c37a0 tx=0x7f75ac0090f0).stop 2023-08-31T19:26:23.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.903+0000 7f75c3dff700 1 -- 172.21.15.72:0/2079531422 shutdown_connections 2023-08-31T19:26:23.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.903+0000 7f75c3dff700 1 --2- 172.21.15.72:0/2079531422 >> v2:172.21.15.146:3300/0 conn(0x7f75bc0c5fb0 0x7f75bc0be370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.903+0000 7f75c3dff700 1 --2- 172.21.15.72:0/2079531422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc0be860 0x7f75bc0c3fb0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.903+0000 7f75c3dff700 1 -- 172.21.15.72:0/2079531422 >> 172.21.15.72:0/2079531422 conn(0x7f75bc082f60 msgr2=0x7f75bc05e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:23.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.903+0000 7f75c3dff700 1 -- 172.21.15.72:0/2079531422 shutdown_connections 2023-08-31T19:26:23.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.903+0000 7f75c3dff700 1 -- 172.21.15.72:0/2079531422 wait complete. 2023-08-31T19:26:23.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.905+0000 7f75c3dff700 1 Processor -- start 2023-08-31T19:26:23.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.905+0000 7f75c3dff700 1 -- start start 2023-08-31T19:26:23.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.906+0000 7f75c3dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75bc0be860 0x7f75bc0ae670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.906+0000 7f75c3dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75bc0c44a0 0x7f75bc0a86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.906+0000 7f75c3dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc0c5fb0 0x7f75bc1458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.906+0000 7f75c3dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0ac1c0 con 0x7f75bc0c5fb0 2023-08-31T19:26:23.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.906+0000 7f75c3dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0a6360 con 0x7f75bc0c44a0 2023-08-31T19:26:23.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.906+0000 7f75c3dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0a5a30 con 0x7f75bc0be860 2023-08-31T19:26:23.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.906+0000 7f75c239c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc0c5fb0 0x7f75bc1458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.906+0000 7f75c239c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc0c5fb0 0x7f75bc1458c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59082/0 (socket says 172.21.15.72:59082) 2023-08-31T19:26:23.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.906+0000 7f75c239c700 1 -- 172.21.15.72:0/1195141437 learned_addr learned my addr 172.21.15.72:0/1195141437 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:23.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.906+0000 7f75c139a700 1 --2- 172.21.15.72:0/1195141437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75bc0c44a0 0x7f75bc0a86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.906+0000 7f75c1b9b700 1 --2- 172.21.15.72:0/1195141437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75bc0be860 0x7f75bc0ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.906+0000 7f75c239c700 1 -- 172.21.15.72:0/1195141437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75bc0be860 msgr2=0x7f75bc0ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.906+0000 7f75c239c700 1 --2- 172.21.15.72:0/1195141437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75bc0be860 0x7f75bc0ae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.907+0000 7f75c239c700 1 -- 172.21.15.72:0/1195141437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75bc0c44a0 msgr2=0x7f75bc0a86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:23.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.907+0000 7f75c239c700 1 --2- 172.21.15.72:0/1195141437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75bc0c44a0 0x7f75bc0a86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:23.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.907+0000 7f75c239c700 1 -- 172.21.15.72:0/1195141437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac009370 con 0x7f75bc0c5fb0 2023-08-31T19:26:23.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.907+0000 7f75c1b9b700 1 --2- 172.21.15.72:0/1195141437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75bc0be860 0x7f75bc0ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:23.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.907+0000 7f75c239c700 1 --2- 172.21.15.72:0/1195141437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc0c5fb0 0x7f75bc1458c0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f75b4002230 tx=0x7f75b40015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:23.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.907+0000 7f75b1ffb700 1 -- 172.21.15.72:0/1195141437 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4010510 con 0x7f75bc0c5fb0 2023-08-31T19:26:23.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.907+0000 7f75b1ffb700 1 -- 172.21.15.72:0/1195141437 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b4010670 con 0x7f75bc0c5fb0 2023-08-31T19:26:23.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.907+0000 7f75b1ffb700 1 -- 172.21.15.72:0/1195141437 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b40109f0 con 0x7f75bc0c5fb0 2023-08-31T19:26:23.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.907+0000 7f75c3dff700 1 -- 172.21.15.72:0/1195141437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc0a5d10 con 0x7f75bc0c5fb0 2023-08-31T19:26:23.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.907+0000 7f75c3dff700 1 -- 172.21.15.72:0/1195141437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc0c0210 con 0x7f75bc0c5fb0 2023-08-31T19:26:23.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.908+0000 7f75c3dff700 1 -- 172.21.15.72:0/1195141437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc0a64d0 con 0x7f75bc0c5fb0 2023-08-31T19:26:23.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.909+0000 7f75b1ffb700 1 -- 172.21.15.72:0/1195141437 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f75b401b400 con 0x7f75bc0c5fb0 2023-08-31T19:26:23.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.910+0000 7f75b1ffb700 1 --2- 172.21.15.72:0/1195141437 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f75a005ef30 0x7f75a00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:23.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.910+0000 7f75b1ffb700 1 -- 172.21.15.72:0/1195141437 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f75b4079fa0 con 0x7f75bc0c5fb0 2023-08-31T19:26:23.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.910+0000 7f75c1b9b700 1 --2- 172.21.15.72:0/1195141437 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f75a005ef30 0x7f75a00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:23.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.911+0000 7f75c1b9b700 1 --2- 172.21.15.72:0/1195141437 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f75a005ef30 0x7f75a00613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f75b800baa0 tx=0x7f75b8008040).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:23.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:23.914+0000 7f75b1ffb700 1 -- 172.21.15.72:0/1195141437 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f75b40a88f0 con 0x7f75bc0c5fb0 2023-08-31T19:26:24.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.083+0000 7f75c3dff700 1 -- 172.21.15.72:0/1195141437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75bc06c6b0 con 0x7f75bc0c5fb0 2023-08-31T19:26:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.084+0000 7f75b1ffb700 1 -- 172.21.15.72:0/1195141437 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+18049 (secure 0 0 0) 0x7f75b404afa0 con 0x7f75bc0c5fb0 2023-08-31T19:26:24.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:24.085 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":194,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:26:23.268323+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:26:21.693921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-31T19:26:22.249227+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:26:24.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.086+0000 7f75c3dff700 1 -- 172.21.15.72:0/1195141437 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f75a005ef30 msgr2=0x7f75a00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:24.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.086+0000 7f75c3dff700 1 --2- 172.21.15.72:0/1195141437 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f75a005ef30 0x7f75a00613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f75b800baa0 tx=0x7f75b8008040).stop 2023-08-31T19:26:24.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.086+0000 7f75c3dff700 1 -- 172.21.15.72:0/1195141437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc0c5fb0 msgr2=0x7f75bc1458c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:24.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.086+0000 7f75c3dff700 1 --2- 172.21.15.72:0/1195141437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc0c5fb0 0x7f75bc1458c0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f75b4002230 tx=0x7f75b40015e0).stop 2023-08-31T19:26:24.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.086+0000 7f75c3dff700 1 -- 172.21.15.72:0/1195141437 shutdown_connections 2023-08-31T19:26:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.086+0000 7f75c3dff700 1 --2- 172.21.15.72:0/1195141437 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f75a005ef30 0x7f75a00613f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.086+0000 7f75c3dff700 1 --2- 172.21.15.72:0/1195141437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc0c5fb0 0x7f75bc1458c0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.086+0000 7f75c3dff700 1 --2- 172.21.15.72:0/1195141437 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f75bc0be860 0x7f75bc0ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.086+0000 7f75c3dff700 1 --2- 172.21.15.72:0/1195141437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75bc0c44a0 0x7f75bc0a86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:24.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.086+0000 7f75c3dff700 1 -- 172.21.15.72:0/1195141437 >> 172.21.15.72:0/1195141437 conn(0x7f75bc082f60 msgr2=0x7f75bc0c8190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:24.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.086+0000 7f75c3dff700 1 -- 172.21.15.72:0/1195141437 shutdown_connections 2023-08-31T19:26:24.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.086+0000 7f75c3dff700 1 -- 172.21.15.72:0/1195141437 wait complete. 2023-08-31T19:26:24.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T19:26:24.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.298+0000 7f62a13ff700 1 Processor -- start 2023-08-31T19:26:24.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.298+0000 7f62a13ff700 1 -- start start 2023-08-31T19:26:24.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.299+0000 7f62a13ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f629c153ed0 0x7f629c1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:24.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.299+0000 7f62a13ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f629c0bdb30 0x7f629c155200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:24.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.299+0000 7f62a13ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629c0a84b0 con 0x7f629c0663d0 2023-08-31T19:26:24.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.299+0000 7f62a13ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629c0c9410 con 0x7f629c0bdb30 2023-08-31T19:26:24.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.299+0000 7f62a13ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629c0c5310 con 0x7f629c153ed0 2023-08-31T19:26:24.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.300+0000 7f629a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f629c0bdb30 0x7f629c155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:24.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.300+0000 7f629a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f629c0bdb30 0x7f629c155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59084/0 (socket says 172.21.15.72:59084) 2023-08-31T19:26:24.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.300+0000 7f629a7fc700 1 -- 172.21.15.72:0/1462307838 learned_addr learned my addr 172.21.15.72:0/1462307838 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:24.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.300+0000 7f629affd700 1 --2- 172.21.15.72:0/1462307838 >> v2:172.21.15.146:3300/0 conn(0x7f629c153ed0 0x7f629c1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:24.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.300+0000 7f629a7fc700 1 -- 172.21.15.72:0/1462307838 >> v2:172.21.15.146:3300/0 conn(0x7f629c153ed0 msgr2=0x7f629c1542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:24.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.300+0000 7f629a7fc700 1 --2- 172.21.15.72:0/1462307838 >> v2:172.21.15.146:3300/0 conn(0x7f629c153ed0 0x7f629c1542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:24.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.300+0000 7f629a7fc700 1 -- 172.21.15.72:0/1462307838 >> v1:172.21.15.146:6789/0 conn(0x7f629c0663d0 legacy=0x7f629c067900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:24.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.300+0000 7f629a7fc700 1 -- 172.21.15.72:0/1462307838 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c1556f0 con 0x7f629c0bdb30 2023-08-31T19:26:24.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.300+0000 7f629a7fc700 1 --2- 172.21.15.72:0/1462307838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f629c0bdb30 0x7f629c155200 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f629c0c66e0 tx=0x7f62900090f0).ready entity=mon.0 client_cookie=b42877b948f94e1c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:24.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.300+0000 7f6299ffb700 1 -- 172.21.15.72:0/1462307838 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629000b520 con 0x7f629c0bdb30 2023-08-31T19:26:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.301+0000 7f6299ffb700 1 -- 172.21.15.72:0/1462307838 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629000b680 con 0x7f629c0bdb30 2023-08-31T19:26:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.301+0000 7f6299ffb700 1 -- 172.21.15.72:0/1462307838 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629000ba20 con 0x7f629c0bdb30 2023-08-31T19:26:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.301+0000 7f62a13ff700 1 -- 172.21.15.72:0/1462307838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f629c0bdb30 msgr2=0x7f629c155200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.301+0000 7f62a13ff700 1 --2- 172.21.15.72:0/1462307838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f629c0bdb30 0x7f629c155200 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f629c0c66e0 tx=0x7f62900090f0).stop 2023-08-31T19:26:24.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.301+0000 7f62a13ff700 1 -- 172.21.15.72:0/1462307838 shutdown_connections 2023-08-31T19:26:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.301+0000 7f62a13ff700 1 --2- 172.21.15.72:0/1462307838 >> v2:172.21.15.146:3300/0 conn(0x7f629c153ed0 0x7f629c1542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.301+0000 7f62a13ff700 1 --2- 172.21.15.72:0/1462307838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f629c0bdb30 0x7f629c155200 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.301+0000 7f62a13ff700 1 -- 172.21.15.72:0/1462307838 >> 172.21.15.72:0/1462307838 conn(0x7f629c05eb60 msgr2=0x7f629c0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.301+0000 7f62a13ff700 1 -- 172.21.15.72:0/1462307838 shutdown_connections 2023-08-31T19:26:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.301+0000 7f62a13ff700 1 -- 172.21.15.72:0/1462307838 wait complete. 2023-08-31T19:26:24.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.303+0000 7f62a13ff700 1 Processor -- start 2023-08-31T19:26:24.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.303+0000 7f62a13ff700 1 -- start start 2023-08-31T19:26:24.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.304+0000 7f62a13ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f629c0663d0 0x7f629c0c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:24.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.304+0000 7f62a13ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f629c153ed0 0x7f629c0c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:24.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.304+0000 7f62a13ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f629c0a5250 0x7f629c0a5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.304+0000 7f62a13ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c0c80c0 con 0x7f629c0663d0 2023-08-31T19:26:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.304+0000 7f62a13ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c0a6b50 con 0x7f629c0a5250 2023-08-31T19:26:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.304+0000 7f62a13ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c0a5f40 con 0x7f629c153ed0 2023-08-31T19:26:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.304+0000 7f629affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f629c0663d0 0x7f629c0c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.304+0000 7f629affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f629c0663d0 0x7f629c0c76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59100/0 (socket says 172.21.15.72:59100) 2023-08-31T19:26:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.304+0000 7f629affd700 1 -- 172.21.15.72:0/1602522358 learned_addr learned my addr 172.21.15.72:0/1602522358 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.304+0000 7f629affd700 1 -- 172.21.15.72:0/1602522358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f629c153ed0 msgr2=0x7f629c0c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.304+0000 7f629affd700 1 --2- 172.21.15.72:0/1602522358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f629c153ed0 0x7f629c0c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.304+0000 7f629affd700 1 -- 172.21.15.72:0/1602522358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f629c0a5250 msgr2=0x7f629c0a5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.304+0000 7f629affd700 1 --2- 172.21.15.72:0/1602522358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f629c0a5250 0x7f629c0a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.304+0000 7f629affd700 1 -- 172.21.15.72:0/1602522358 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290009370 con 0x7f629c0663d0 2023-08-31T19:26:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.304+0000 7f629affd700 1 --2- 172.21.15.72:0/1602522358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f629c0663d0 0x7f629c0c76e0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7f628c00e900 tx=0x7f628c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.305+0000 7f6282ffd700 1 -- 172.21.15.72:0/1602522358 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c00c640 con 0x7f629c0663d0 2023-08-31T19:26:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.305+0000 7f6282ffd700 1 -- 172.21.15.72:0/1602522358 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c00c7a0 con 0x7f629c0663d0 2023-08-31T19:26:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.305+0000 7f62a13ff700 1 -- 172.21.15.72:0/1602522358 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629c0a6220 con 0x7f629c0663d0 2023-08-31T19:26:24.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.305+0000 7f6282ffd700 1 -- 172.21.15.72:0/1602522358 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c00cb20 con 0x7f629c0663d0 2023-08-31T19:26:24.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.305+0000 7f62a13ff700 1 -- 172.21.15.72:0/1602522358 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629c0a67e0 con 0x7f629c0663d0 2023-08-31T19:26:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.306+0000 7f62a13ff700 1 -- 172.21.15.72:0/1602522358 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629c06c6b0 con 0x7f629c0663d0 2023-08-31T19:26:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.306+0000 7f6282ffd700 1 -- 172.21.15.72:0/1602522358 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f628c01b400 con 0x7f629c0663d0 2023-08-31T19:26:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.307+0000 7f6282ffd700 1 --2- 172.21.15.72:0/1602522358 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f628805ef30 0x7f62880613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:24.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.307+0000 7f6282ffd700 1 -- 172.21.15.72:0/1602522358 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f628c07a6d0 con 0x7f629c0663d0 2023-08-31T19:26:24.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.308+0000 7f629a7fc700 1 --2- 172.21.15.72:0/1602522358 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f628805ef30 0x7f62880613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:24.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.308+0000 7f629a7fc700 1 --2- 172.21.15.72:0/1602522358 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f628805ef30 0x7f62880613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f629c0c66e0 tx=0x7f6290017000).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:24.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.311+0000 7f6282ffd700 1 -- 172.21.15.72:0/1602522358 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f628c04b780 con 0x7f629c0663d0 2023-08-31T19:26:24.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:24.521+0000 7f62a13ff700 1 -- 172.21.15.72:0/1602522358 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f629c0a7ef0 con 0x7f629c0663d0 2023-08-31T19:26:25.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.278+0000 7f6282ffd700 1 -- 172.21.15.72:0/1602522358 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v85) v1 ==== 118+0+0 (secure 0 0 0) 0x7f628c016020 con 0x7f629c0663d0 2023-08-31T19:26:25.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.281+0000 7f62a13ff700 1 -- 172.21.15.72:0/1602522358 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f628805ef30 msgr2=0x7f62880613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:25.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.281+0000 7f62a13ff700 1 --2- 172.21.15.72:0/1602522358 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f628805ef30 0x7f62880613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f629c0c66e0 tx=0x7f6290017000).stop 2023-08-31T19:26:25.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.281+0000 7f62a13ff700 1 -- 172.21.15.72:0/1602522358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f629c0663d0 msgr2=0x7f629c0c76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:25.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.281+0000 7f62a13ff700 1 --2- 172.21.15.72:0/1602522358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f629c0663d0 0x7f629c0c76e0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7f628c00e900 tx=0x7f628c009060).stop 2023-08-31T19:26:25.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.281+0000 7f62a13ff700 1 -- 172.21.15.72:0/1602522358 shutdown_connections 2023-08-31T19:26:25.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.281+0000 7f62a13ff700 1 --2- 172.21.15.72:0/1602522358 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f628805ef30 0x7f62880613f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:25.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.281+0000 7f62a13ff700 1 --2- 172.21.15.72:0/1602522358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f629c0a5250 0x7f629c0a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:25.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.281+0000 7f62a13ff700 1 --2- 172.21.15.72:0/1602522358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f629c0663d0 0x7f629c0c76e0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:25.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.281+0000 7f62a13ff700 1 --2- 172.21.15.72:0/1602522358 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f629c153ed0 0x7f629c0c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:25.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.281+0000 7f62a13ff700 1 -- 172.21.15.72:0/1602522358 >> 172.21.15.72:0/1602522358 conn(0x7f629c05eb60 msgr2=0x7f629c0c8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:25.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.281+0000 7f62a13ff700 1 -- 172.21.15.72:0/1602522358 shutdown_connections 2023-08-31T19:26:25.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.281+0000 7f62a13ff700 1 -- 172.21.15.72:0/1602522358 wait complete. 2023-08-31T19:26:25.302 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-31T19:26:25.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T19:26:25.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.498+0000 7f7f2d1ff700 1 Processor -- start 2023-08-31T19:26:25.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.498+0000 7f7f2d1ff700 1 -- start start 2023-08-31T19:26:25.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.499+0000 7f7f2d1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f28062810 0x7f7f28062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:25.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.499+0000 7f7f2d1ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f281582d0 0x7f7f280a7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:25.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.499+0000 7f7f2d1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f280692b0 0x7f7f28069740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:25.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.499+0000 7f7f2d1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f28158760 con 0x7f7f28062810 2023-08-31T19:26:25.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.499+0000 7f7f2d1ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f281591f0 con 0x7f7f281582d0 2023-08-31T19:26:25.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.499+0000 7f7f2d1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f28065610 con 0x7f7f280692b0 2023-08-31T19:26:25.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.500+0000 7f7f26d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f28062810 0x7f7f28062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:25.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.500+0000 7f7f26d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f28062810 0x7f7f28062bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59108/0 (socket says 172.21.15.72:59108) 2023-08-31T19:26:25.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.500+0000 7f7f26d9d700 1 -- 172.21.15.72:0/996638456 learned_addr learned my addr 172.21.15.72:0/996638456 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:25.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.500+0000 7f7f26d9d700 1 -- 172.21.15.72:0/996638456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f280692b0 msgr2=0x7f7f28069740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:25.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.500+0000 7f7f26d9d700 1 --2- 172.21.15.72:0/996638456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f280692b0 0x7f7f28069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:25.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.500+0000 7f7f26d9d700 1 -- 172.21.15.72:0/996638456 >> v2:172.21.15.146:3300/0 conn(0x7f7f281582d0 msgr2=0x7f7f280a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:25.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.500+0000 7f7f2659c700 1 --2- 172.21.15.72:0/996638456 >> v2:172.21.15.146:3300/0 conn(0x7f7f281582d0 0x7f7f280a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:25.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.500+0000 7f7f26d9d700 1 --2- 172.21.15.72:0/996638456 >> v2:172.21.15.146:3300/0 conn(0x7f7f281582d0 0x7f7f280a7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:25.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.500+0000 7f7f26d9d700 1 -- 172.21.15.72:0/996638456 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f280a7540 con 0x7f7f28062810 2023-08-31T19:26:25.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.500+0000 7f7f2659c700 1 --2- 172.21.15.72:0/996638456 >> v2:172.21.15.146:3300/0 conn(0x7f7f281582d0 0x7f7f280a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:25.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.500+0000 7f7f26d9d700 1 --2- 172.21.15.72:0/996638456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f28062810 0x7f7f28062bf0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f7f280c8c90 tx=0x7f7f180090f0).ready entity=mon.0 client_cookie=af5b0a11467a9e9f server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:25.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.501+0000 7f7f25d9b700 1 -- 172.21.15.72:0/996638456 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800b600 con 0x7f7f28062810 2023-08-31T19:26:25.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.501+0000 7f7f25d9b700 1 -- 172.21.15.72:0/996638456 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1800b760 con 0x7f7f28062810 2023-08-31T19:26:25.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.501+0000 7f7f25d9b700 1 -- 172.21.15.72:0/996638456 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800bb00 con 0x7f7f28062810 2023-08-31T19:26:25.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.501+0000 7f7f2d1ff700 1 -- 172.21.15.72:0/996638456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f28062810 msgr2=0x7f7f28062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:25.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.501+0000 7f7f2d1ff700 1 --2- 172.21.15.72:0/996638456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f28062810 0x7f7f28062bf0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7f7f280c8c90 tx=0x7f7f180090f0).stop 2023-08-31T19:26:25.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.501+0000 7f7f2d1ff700 1 -- 172.21.15.72:0/996638456 shutdown_connections 2023-08-31T19:26:25.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.501+0000 7f7f2d1ff700 1 --2- 172.21.15.72:0/996638456 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f280692b0 0x7f7f28069740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:25.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.501+0000 7f7f2d1ff700 1 --2- 172.21.15.72:0/996638456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f28062810 0x7f7f28062bf0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:25.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.501+0000 7f7f2d1ff700 1 --2- 172.21.15.72:0/996638456 >> v2:172.21.15.146:3300/0 conn(0x7f7f281582d0 0x7f7f280a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:25.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.501+0000 7f7f2d1ff700 1 -- 172.21.15.72:0/996638456 >> 172.21.15.72:0/996638456 conn(0x7f7f280c7c20 msgr2=0x7f7f280c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:25.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.501+0000 7f7f2d1ff700 1 -- 172.21.15.72:0/996638456 shutdown_connections 2023-08-31T19:26:25.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.501+0000 7f7f2d1ff700 1 -- 172.21.15.72:0/996638456 wait complete. 2023-08-31T19:26:25.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.503+0000 7f7f2d1ff700 1 Processor -- start 2023-08-31T19:26:25.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.503+0000 7f7f2d1ff700 1 -- start start 2023-08-31T19:26:25.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.504+0000 7f7f2d1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f28062810 0x7f7f2813c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:25.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.504+0000 7f7f2d1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280692b0 0x7f7f280c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:25.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.504+0000 7f7f2d1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f281582d0 0x7f7f280c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:25.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.504+0000 7f7f2d1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280c7770 con 0x7f7f280692b0 2023-08-31T19:26:25.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.504+0000 7f7f2d1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2814de20 con 0x7f7f28062810 2023-08-31T19:26:25.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.504+0000 7f7f2d1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f28165150 con 0x7f7f281582d0 2023-08-31T19:26:25.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.504+0000 7f7f2659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280692b0 0x7f7f280c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:25.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.504+0000 7f7f2659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280692b0 0x7f7f280c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59112/0 (socket says 172.21.15.72:59112) 2023-08-31T19:26:25.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.504+0000 7f7f2659c700 1 -- 172.21.15.72:0/2799348134 learned_addr learned my addr 172.21.15.72:0/2799348134 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:25.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.505+0000 7f7f26d9d700 1 --2- 172.21.15.72:0/2799348134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f28062810 0x7f7f2813c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:25.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.505+0000 7f7f2759e700 1 --2- 172.21.15.72:0/2799348134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f281582d0 0x7f7f280c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:25.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.505+0000 7f7f2659c700 1 -- 172.21.15.72:0/2799348134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f281582d0 msgr2=0x7f7f280c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:25.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.505+0000 7f7f2659c700 1 --2- 172.21.15.72:0/2799348134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f281582d0 0x7f7f280c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:25.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.505+0000 7f7f2659c700 1 -- 172.21.15.72:0/2799348134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f28062810 msgr2=0x7f7f2813c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:25.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.505+0000 7f7f2659c700 1 --2- 172.21.15.72:0/2799348134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f28062810 0x7f7f2813c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:25.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.505+0000 7f7f2659c700 1 -- 172.21.15.72:0/2799348134 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f18009370 con 0x7f7f280692b0 2023-08-31T19:26:25.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.505+0000 7f7f26d9d700 1 --2- 172.21.15.72:0/2799348134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f28062810 0x7f7f2813c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:25.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.505+0000 7f7f2659c700 1 --2- 172.21.15.72:0/2799348134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280692b0 0x7f7f280c6d90 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f7f1c00c880 tx=0x7f7f1c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:25.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.505+0000 7f7f0effd700 1 -- 172.21.15.72:0/2799348134 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c010580 con 0x7f7f280692b0 2023-08-31T19:26:25.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.505+0000 7f7f0effd700 1 -- 172.21.15.72:0/2799348134 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c0106e0 con 0x7f7f280692b0 2023-08-31T19:26:25.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.505+0000 7f7f2d1ff700 1 -- 172.21.15.72:0/2799348134 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f28164840 con 0x7f7f280692b0 2023-08-31T19:26:25.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.505+0000 7f7f0effd700 1 -- 172.21.15.72:0/2799348134 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c010a60 con 0x7f7f280692b0 2023-08-31T19:26:25.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.505+0000 7f7f2d1ff700 1 -- 172.21.15.72:0/2799348134 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f28164b00 con 0x7f7f280692b0 2023-08-31T19:26:25.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.507+0000 7f7f2d1ff700 1 -- 172.21.15.72:0/2799348134 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2806c6b0 con 0x7f7f280692b0 2023-08-31T19:26:25.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.507+0000 7f7f0effd700 1 -- 172.21.15.72:0/2799348134 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7f1c01b460 con 0x7f7f280692b0 2023-08-31T19:26:25.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.508+0000 7f7f0effd700 1 --2- 172.21.15.72:0/2799348134 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7f1405ef30 0x7f7f140613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:25.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.508+0000 7f7f0effd700 1 -- 172.21.15.72:0/2799348134 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f7f1c07a2f0 con 0x7f7f280692b0 2023-08-31T19:26:25.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.508+0000 7f7f26d9d700 1 --2- 172.21.15.72:0/2799348134 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7f1405ef30 0x7f7f140613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:25.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.509+0000 7f7f26d9d700 1 --2- 172.21.15.72:0/2799348134 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7f1405ef30 0x7f7f140613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7f28167d70 tx=0x7f7f18017000).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:25.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.512+0000 7f7f0effd700 1 -- 172.21.15.72:0/2799348134 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f1c04b2f0 con 0x7f7f280692b0 2023-08-31T19:26:25.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:25.722+0000 7f7f2d1ff700 1 -- 172.21.15.72:0/2799348134 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7f28158950 con 0x7f7f280692b0 2023-08-31T19:26:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.284+0000 7f7f0effd700 1 -- 172.21.15.72:0/2799348134 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v86) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7f1c04e910 con 0x7f7f280692b0 2023-08-31T19:26:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.286+0000 7f7f2d1ff700 1 -- 172.21.15.72:0/2799348134 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7f1405ef30 msgr2=0x7f7f140613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.286+0000 7f7f2d1ff700 1 --2- 172.21.15.72:0/2799348134 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7f1405ef30 0x7f7f140613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7f28167d70 tx=0x7f7f18017000).stop 2023-08-31T19:26:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.286+0000 7f7f2d1ff700 1 -- 172.21.15.72:0/2799348134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280692b0 msgr2=0x7f7f280c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.286+0000 7f7f2d1ff700 1 --2- 172.21.15.72:0/2799348134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280692b0 0x7f7f280c6d90 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f7f1c00c880 tx=0x7f7f1c008040).stop 2023-08-31T19:26:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.287+0000 7f7f2d1ff700 1 -- 172.21.15.72:0/2799348134 shutdown_connections 2023-08-31T19:26:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.287+0000 7f7f2d1ff700 1 --2- 172.21.15.72:0/2799348134 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7f1405ef30 0x7f7f140613f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.287+0000 7f7f2d1ff700 1 --2- 172.21.15.72:0/2799348134 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f281582d0 0x7f7f280c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.287+0000 7f7f2d1ff700 1 --2- 172.21.15.72:0/2799348134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f28062810 0x7f7f2813c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.287+0000 7f7f2d1ff700 1 --2- 172.21.15.72:0/2799348134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280692b0 0x7f7f280c6d90 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.287+0000 7f7f2d1ff700 1 -- 172.21.15.72:0/2799348134 >> 172.21.15.72:0/2799348134 conn(0x7f7f280c7c20 msgr2=0x7f7f280bcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.287+0000 7f7f2d1ff700 1 -- 172.21.15.72:0/2799348134 shutdown_connections 2023-08-31T19:26:26.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.287+0000 7f7f2d1ff700 1 -- 172.21.15.72:0/2799348134 wait complete. 2023-08-31T19:26:26.306 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T19:26:26.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:26:26.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.497+0000 7f36859ff700 1 Processor -- start 2023-08-31T19:26:26.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.497+0000 7f36859ff700 1 -- start start 2023-08-31T19:26:26.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.498+0000 7f36859ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36800bc180 0x7f3680163220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:26.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.498+0000 7f36859ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36800c29d0 con 0x7f3680158d50 2023-08-31T19:26:26.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.498+0000 7f36859ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36800c2e60 con 0x7f368013b430 2023-08-31T19:26:26.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.498+0000 7f36859ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36800c1bc0 con 0x7f36800bc180 2023-08-31T19:26:26.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.498+0000 7f367e7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3680158d50 0x7f36800bba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38874/0 (socket says 172.21.15.72:38874) 2023-08-31T19:26:26.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.498+0000 7f367e7fc700 1 -- 172.21.15.72:0/2274599761 learned_addr learned my addr 172.21.15.72:0/2274599761 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:26.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367f7fe700 1 --2- 172.21.15.72:0/2274599761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36800bc180 0x7f3680163220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:26.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367dffb700 1 -- 172.21.15.72:0/2274599761 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855708029 0 0) 0x7f36800c29d0 con 0x7f3680158d50 2023-08-31T19:26:26.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367dffb700 1 -- 172.21.15.72:0/2274599761 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36680033f0 con 0x7f3680158d50 2023-08-31T19:26:26.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367dffb700 1 -- 172.21.15.72:0/2274599761 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2281502681 0 0) 0x7f36680033f0 con 0x7f3680158d50 2023-08-31T19:26:26.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367dffb700 1 -- 172.21.15.72:0/2274599761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36800bc180 msgr2=0x7f3680163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:26.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367dffb700 1 --2- 172.21.15.72:0/2274599761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36800bc180 0x7f3680163220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367dffb700 1 -- 172.21.15.72:0/2274599761 >> v1:172.21.15.146:6789/0 conn(0x7f368013b430 legacy=0x7f36800c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:26.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367dffb700 1 -- 172.21.15.72:0/2274599761 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36800c1dc0 con 0x7f3680158d50 2023-08-31T19:26:26.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367dffb700 1 -- 172.21.15.72:0/2274599761 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f3674001470 con 0x7f3680158d50 2023-08-31T19:26:26.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367dffb700 1 -- 172.21.15.72:0/2274599761 >> v1:172.21.15.72:6789/0 conn(0x7f3680158d50 legacy=0x7f36800bba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:26.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367dffb700 1 --2- 172.21.15.72:0/2274599761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3668003910 0x7f3668003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:26.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367dffb700 1 --2- 172.21.15.72:0/2274599761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36800bc180 0x7f3668004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:26.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367dffb700 1 --2- 172.21.15.72:0/2274599761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3668004b80 0x7f3668005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:26.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367dffb700 1 -- 172.21.15.72:0/2274599761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36800c1bc0 con 0x7f3668003910 2023-08-31T19:26:26.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367dffb700 1 -- 172.21.15.72:0/2274599761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366800b8e0 con 0x7f3668004b80 2023-08-31T19:26:26.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.499+0000 7f367dffb700 1 -- 172.21.15.72:0/2274599761 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366800ba70 con 0x7f36800bc180 2023-08-31T19:26:26.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.500+0000 7f367effd700 1 --2- 172.21.15.72:0/2274599761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3668003910 0x7f3668003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:26.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.500+0000 7f367e7fc700 1 --2- 172.21.15.72:0/2274599761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36800bc180 0x7f3668004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:26.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.500+0000 7f367f7fe700 1 --2- 172.21.15.72:0/2274599761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3668004b80 0x7f3668005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:26.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.500+0000 7f367effd700 1 -- 172.21.15.72:0/2274599761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36800bc180 msgr2=0x7f3668004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:26.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.500+0000 7f367effd700 1 --2- 172.21.15.72:0/2274599761 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f36800bc180 0x7f3668004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.500+0000 7f367effd700 1 -- 172.21.15.72:0/2274599761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3668004b80 msgr2=0x7f3668005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:26.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.500+0000 7f367effd700 1 --2- 172.21.15.72:0/2274599761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3668004b80 0x7f3668005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.500+0000 7f367effd700 1 -- 172.21.15.72:0/2274599761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36680033f0 con 0x7f3668003910 2023-08-31T19:26:26.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.500+0000 7f367effd700 1 --2- 172.21.15.72:0/2274599761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3668003910 0x7f3668003cf0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f3670001820 tx=0x7f3670007b90).ready entity=mon.0 client_cookie=418453a2a70d9e46 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:26.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.500+0000 7f367dffb700 1 -- 172.21.15.72:0/2274599761 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3670007ea0 con 0x7f3668003910 2023-08-31T19:26:26.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.500+0000 7f367dffb700 1 -- 172.21.15.72:0/2274599761 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3670012400 con 0x7f3668003910 2023-08-31T19:26:26.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.500+0000 7f367dffb700 1 -- 172.21.15.72:0/2274599761 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36700127c0 con 0x7f3668003910 2023-08-31T19:26:26.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.501+0000 7f36859ff700 1 -- 172.21.15.72:0/2274599761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3668003910 msgr2=0x7f3668003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:26.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.501+0000 7f36859ff700 1 --2- 172.21.15.72:0/2274599761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3668003910 0x7f3668003cf0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f3670001820 tx=0x7f3670007b90).stop 2023-08-31T19:26:26.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.501+0000 7f367f7fe700 1 -- 172.21.15.72:0/2274599761 reap_dead start 2023-08-31T19:26:26.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.501+0000 7f36859ff700 1 -- 172.21.15.72:0/2274599761 shutdown_connections 2023-08-31T19:26:26.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.501+0000 7f36859ff700 1 -- 172.21.15.72:0/2274599761 >> 172.21.15.72:0/2274599761 conn(0x7f36800c6b10 msgr2=0x7f36800c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:26.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.501+0000 7f36859ff700 1 -- 172.21.15.72:0/2274599761 shutdown_connections 2023-08-31T19:26:26.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.501+0000 7f36859ff700 1 -- 172.21.15.72:0/2274599761 wait complete. 2023-08-31T19:26:26.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.503+0000 7f36859ff700 1 Processor -- start 2023-08-31T19:26:26.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.503+0000 7f36859ff700 1 -- start start 2023-08-31T19:26:26.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.503+0000 7f36859ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3668003910 0x7f368013ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:26.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f36859ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36800abd40 0x7f36800ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:26.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f36859ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36800aa530 0x7f36800aa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:26.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f36859ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368013bcf0 con 0x7f36800aa530 2023-08-31T19:26:26.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f36859ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368013c590 con 0x7f36800abd40 2023-08-31T19:26:26.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f36859ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36800ac6b0 con 0x7f3668003910 2023-08-31T19:26:26.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f367f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36800aa530 0x7f36800aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:26.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f367f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36800aa530 0x7f36800aa990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59128/0 (socket says 172.21.15.72:59128) 2023-08-31T19:26:26.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f367f7fe700 1 -- 172.21.15.72:0/17898447 learned_addr learned my addr 172.21.15.72:0/17898447 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:26.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f367effd700 1 --2- 172.21.15.72:0/17898447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3668003910 0x7f368013ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:26.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f367e7fc700 1 --2- 172.21.15.72:0/17898447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36800abd40 0x7f36800ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:26.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f367f7fe700 1 -- 172.21.15.72:0/17898447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3668003910 msgr2=0x7f368013ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:26.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f367f7fe700 1 --2- 172.21.15.72:0/17898447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3668003910 0x7f368013ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f367f7fe700 1 -- 172.21.15.72:0/17898447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36800abd40 msgr2=0x7f36800ac1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:26.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f367f7fe700 1 --2- 172.21.15.72:0/17898447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36800abd40 0x7f36800ac1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f367f7fe700 1 -- 172.21.15.72:0/17898447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368013b230 con 0x7f36800aa530 2023-08-31T19:26:26.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.504+0000 7f367f7fe700 1 --2- 172.21.15.72:0/17898447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36800aa530 0x7f36800aa990 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f36780094d0 tx=0x7f367800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:26.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.505+0000 7f3666ffd700 1 -- 172.21.15.72:0/17898447 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367800e040 con 0x7f36800aa530 2023-08-31T19:26:26.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.505+0000 7f3666ffd700 1 -- 172.21.15.72:0/17898447 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367800f040 con 0x7f36800aa530 2023-08-31T19:26:26.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.505+0000 7f36859ff700 1 -- 172.21.15.72:0/17898447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36800ab2c0 con 0x7f36800aa530 2023-08-31T19:26:26.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.505+0000 7f3666ffd700 1 -- 172.21.15.72:0/17898447 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367800fda0 con 0x7f36800aa530 2023-08-31T19:26:26.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.505+0000 7f36859ff700 1 -- 172.21.15.72:0/17898447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368013c220 con 0x7f36800aa530 2023-08-31T19:26:26.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.506+0000 7f36859ff700 1 -- 172.21.15.72:0/17898447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368013c700 con 0x7f36800aa530 2023-08-31T19:26:26.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.507+0000 7f3666ffd700 1 -- 172.21.15.72:0/17898447 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f3678015660 con 0x7f36800aa530 2023-08-31T19:26:26.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.508+0000 7f3666ffd700 1 --2- 172.21.15.72:0/17898447 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f366c05ef30 0x7f366c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:26.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.508+0000 7f3666ffd700 1 -- 172.21.15.72:0/17898447 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f367807ac50 con 0x7f36800aa530 2023-08-31T19:26:26.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.508+0000 7f367effd700 1 --2- 172.21.15.72:0/17898447 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f366c05ef30 0x7f366c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:26.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.508+0000 7f367effd700 1 --2- 172.21.15.72:0/17898447 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f366c05ef30 0x7f366c0613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3670000fd0 tx=0x7f3670016000).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:26.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.512+0000 7f3666ffd700 1 -- 172.21.15.72:0/17898447 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f367804bbf0 con 0x7f36800aa530 2023-08-31T19:26:26.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.721+0000 7f36859ff700 1 -- 172.21.15.72:0/17898447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36800c79d0 con 0x7f36800aa530 2023-08-31T19:26:26.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.722+0000 7f3666ffd700 1 -- 172.21.15.72:0/17898447 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f367804f210 con 0x7f36800aa530 2023-08-31T19:26:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:26.723 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2772120291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2772120291},{"type":"v1","addr":"172.21.15.146:6834","nonce":2772120291}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4204264962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4204264962},{"type":"v1","addr":"172.21.15.72:6836","nonce":4204264962}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9501,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2736058565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2736058565},{"type":"v1","addr":"172.21.15.72:6837","nonce":2736058565}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:26:23.268664+0000","modified":"2023-08-31T19:26:26.278490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9507":{"gid":9507,"name":"b","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3040541253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3040541253},{"type":"v1","addr":"172.21.15.146:6835","nonce":3040541253}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-31T19:26:26.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.724+0000 7f36859ff700 1 -- 172.21.15.72:0/17898447 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f366c05ef30 msgr2=0x7f366c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:26.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.724+0000 7f36859ff700 1 --2- 172.21.15.72:0/17898447 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f366c05ef30 0x7f366c0613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3670000fd0 tx=0x7f3670016000).stop 2023-08-31T19:26:26.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.724+0000 7f36859ff700 1 -- 172.21.15.72:0/17898447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36800aa530 msgr2=0x7f36800aa990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:26.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.724+0000 7f36859ff700 1 --2- 172.21.15.72:0/17898447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36800aa530 0x7f36800aa990 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f36780094d0 tx=0x7f367800b040).stop 2023-08-31T19:26:26.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.724+0000 7f36859ff700 1 -- 172.21.15.72:0/17898447 shutdown_connections 2023-08-31T19:26:26.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.724+0000 7f36859ff700 1 --2- 172.21.15.72:0/17898447 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f366c05ef30 0x7f366c0613f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.724+0000 7f36859ff700 1 --2- 172.21.15.72:0/17898447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36800aa530 0x7f36800aa990 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.724+0000 7f36859ff700 1 --2- 172.21.15.72:0/17898447 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3668003910 0x7f368013ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.724+0000 7f36859ff700 1 --2- 172.21.15.72:0/17898447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f36800abd40 0x7f36800ac1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.724+0000 7f36859ff700 1 -- 172.21.15.72:0/17898447 >> 172.21.15.72:0/17898447 conn(0x7f36800c6b10 msgr2=0x7f3680151f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:26.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.724+0000 7f36859ff700 1 -- 172.21.15.72:0/17898447 shutdown_connections 2023-08-31T19:26:26.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.724+0000 7f36859ff700 1 -- 172.21.15.72:0/17898447 wait complete. 2023-08-31T19:26:26.728 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 86 2023-08-31T19:26:26.742 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:26:26.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.935+0000 7fb7defff700 1 Processor -- start 2023-08-31T19:26:26.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.935+0000 7fb7defff700 1 -- start start 2023-08-31T19:26:26.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.937+0000 7fb7defff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7d80bea80 0x7fb7d80c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:26.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.937+0000 7fb7defff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d80c4950 con 0x7fb7d80c44a0 2023-08-31T19:26:26.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.937+0000 7fb7defff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d80bef10 con 0x7fb7d80c5fb0 2023-08-31T19:26:26.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.937+0000 7fb7defff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d8154690 con 0x7fb7d80bea80 2023-08-31T19:26:26.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.937+0000 7fb7dd59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb7d80c44a0 0x7fb7d8063a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38886/0 (socket says 172.21.15.72:38886) 2023-08-31T19:26:26.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.937+0000 7fb7dd59c700 1 -- 172.21.15.72:0/1358580717 learned_addr learned my addr 172.21.15.72:0/1358580717 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:26.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.937+0000 7fb7d7fff700 1 --2- 172.21.15.72:0/1358580717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7d80bea80 0x7fb7d80c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:26.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.937+0000 7fb7d77fe700 1 -- 172.21.15.72:0/1358580717 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559286090 0 0) 0x7fb7d0001490 con 0x7fb7d80c44a0 2023-08-31T19:26:26.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.937+0000 7fb7d77fe700 1 -- 172.21.15.72:0/1358580717 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7c80033f0 con 0x7fb7d80c44a0 2023-08-31T19:26:26.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.938+0000 7fb7d77fe700 1 -- 172.21.15.72:0/1358580717 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791730735 0 0) 0x7fb7d80bef10 con 0x7fb7d80c5fb0 2023-08-31T19:26:26.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.938+0000 7fb7d77fe700 1 -- 172.21.15.72:0/1358580717 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7d0001490 con 0x7fb7d80c5fb0 2023-08-31T19:26:26.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.938+0000 7fb7d7fff700 1 -- 172.21.15.72:0/1358580717 >> v1:172.21.15.146:6789/0 conn(0x7fb7d80c5fb0 legacy=0x7fb7d80be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:26.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.938+0000 7fb7d7fff700 1 -- 172.21.15.72:0/1358580717 >> v1:172.21.15.72:6789/0 conn(0x7fb7d80c44a0 legacy=0x7fb7d8063a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:26.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.938+0000 7fb7d77fe700 1 -- 172.21.15.72:0/1358580717 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2908743351 0 0) 0x7fb7c80033f0 con 0x7fb7d80c44a0 2023-08-31T19:26:26.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.938+0000 7fb7d7fff700 1 -- 172.21.15.72:0/1358580717 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d80bf1f0 con 0x7fb7d80bea80 2023-08-31T19:26:26.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.938+0000 7fb7d7fff700 1 --2- 172.21.15.72:0/1358580717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7d80bea80 0x7fb7d80c3fb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fb7c4009790 tx=0x7fb7c4009060).ready entity=mon.2 client_cookie=4da672f19ef0248e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:26.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.938+0000 7fb7d77fe700 1 -- 172.21.15.72:0/1358580717 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c400f510 con 0x7fb7d80bea80 2023-08-31T19:26:26.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.938+0000 7fb7d77fe700 1 -- 172.21.15.72:0/1358580717 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c400f670 con 0x7fb7d80bea80 2023-08-31T19:26:26.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.938+0000 7fb7d77fe700 1 -- 172.21.15.72:0/1358580717 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c400f9f0 con 0x7fb7d80bea80 2023-08-31T19:26:26.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.939+0000 7fb7defff700 1 -- 172.21.15.72:0/1358580717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7d80bea80 msgr2=0x7fb7d80c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:26.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.939+0000 7fb7defff700 1 --2- 172.21.15.72:0/1358580717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7d80bea80 0x7fb7d80c3fb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fb7c4009790 tx=0x7fb7c4009060).stop 2023-08-31T19:26:26.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.939+0000 7fb7defff700 1 -- 172.21.15.72:0/1358580717 shutdown_connections 2023-08-31T19:26:26.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.939+0000 7fb7defff700 1 --2- 172.21.15.72:0/1358580717 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7d80bea80 0x7fb7d80c3fb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.939+0000 7fb7defff700 1 -- 172.21.15.72:0/1358580717 >> 172.21.15.72:0/1358580717 conn(0x7fb7d8082f60 msgr2=0x7fb7d805e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:26.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.939+0000 7fb7defff700 1 -- 172.21.15.72:0/1358580717 shutdown_connections 2023-08-31T19:26:26.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.939+0000 7fb7defff700 1 -- 172.21.15.72:0/1358580717 wait complete. 2023-08-31T19:26:26.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.940+0000 7fb7defff700 1 Processor -- start 2023-08-31T19:26:26.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.940+0000 7fb7defff700 1 -- start start 2023-08-31T19:26:26.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.941+0000 7fb7defff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7d80c44a0 0x7fb7d80c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:26.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.941+0000 7fb7defff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7d80c5fb0 0x7fb7d8150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:26.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.941+0000 7fb7defff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d80c0370 0x7fb7d80c07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:26.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.941+0000 7fb7defff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d81551e0 con 0x7fb7d80c0370 2023-08-31T19:26:26.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.941+0000 7fb7defff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80c0cc0 con 0x7fb7d80c44a0 2023-08-31T19:26:26.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.941+0000 7fb7defff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d8155430 con 0x7fb7d80c5fb0 2023-08-31T19:26:26.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.942+0000 7fb7dd59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d80c0370 0x7fb7d80c07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:26.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.942+0000 7fb7dd59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d80c0370 0x7fb7d80c07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59144/0 (socket says 172.21.15.72:59144) 2023-08-31T19:26:26.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.942+0000 7fb7dd59c700 1 -- 172.21.15.72:0/4001003256 learned_addr learned my addr 172.21.15.72:0/4001003256 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:26.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.942+0000 7fb7d7fff700 1 --2- 172.21.15.72:0/4001003256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7d80c5fb0 0x7fb7d8150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:26.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.942+0000 7fb7dcd9b700 1 --2- 172.21.15.72:0/4001003256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7d80c44a0 0x7fb7d80c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:26.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.942+0000 7fb7dd59c700 1 -- 172.21.15.72:0/4001003256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7d80c5fb0 msgr2=0x7fb7d8150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:26.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.942+0000 7fb7dd59c700 1 --2- 172.21.15.72:0/4001003256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7d80c5fb0 0x7fb7d8150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.942+0000 7fb7dd59c700 1 -- 172.21.15.72:0/4001003256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7d80c44a0 msgr2=0x7fb7d80c27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:26.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.942+0000 7fb7dd59c700 1 --2- 172.21.15.72:0/4001003256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7d80c44a0 0x7fb7d80c27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:26.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.942+0000 7fb7dd59c700 1 -- 172.21.15.72:0/4001003256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c40092a0 con 0x7fb7d80c0370 2023-08-31T19:26:26.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.942+0000 7fb7dd59c700 1 --2- 172.21.15.72:0/4001003256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d80c0370 0x7fb7d80c07d0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7fb7d000c930 tx=0x7fb7d0007d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:26.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.942+0000 7fb7d4ff9700 1 -- 172.21.15.72:0/4001003256 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0004c40 con 0x7fb7d80c0370 2023-08-31T19:26:26.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.942+0000 7fb7d4ff9700 1 -- 172.21.15.72:0/4001003256 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d0004da0 con 0x7fb7d80c0370 2023-08-31T19:26:26.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.942+0000 7fb7defff700 1 -- 172.21.15.72:0/4001003256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d8155710 con 0x7fb7d80c0370 2023-08-31T19:26:26.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.943+0000 7fb7d4ff9700 1 -- 172.21.15.72:0/4001003256 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d00073a0 con 0x7fb7d80c0370 2023-08-31T19:26:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.943+0000 7fb7defff700 1 -- 172.21.15.72:0/4001003256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d8155cd0 con 0x7fb7d80c0370 2023-08-31T19:26:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.944+0000 7fb7defff700 1 -- 172.21.15.72:0/4001003256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d8155ec0 con 0x7fb7d80c0370 2023-08-31T19:26:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.944+0000 7fb7d4ff9700 1 -- 172.21.15.72:0/4001003256 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb7d0007790 con 0x7fb7d80c0370 2023-08-31T19:26:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.946+0000 7fb7d4ff9700 1 --2- 172.21.15.72:0/4001003256 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb7bc05ef30 0x7fb7bc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.946+0000 7fb7d4ff9700 1 -- 172.21.15.72:0/4001003256 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fb7d0079dd0 con 0x7fb7d80c0370 2023-08-31T19:26:26.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.946+0000 7fb7dcd9b700 1 --2- 172.21.15.72:0/4001003256 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb7bc05ef30 0x7fb7bc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:26.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.947+0000 7fb7dcd9b700 1 --2- 172.21.15.72:0/4001003256 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb7bc05ef30 0x7fb7bc0613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb7cc0038c0 tx=0x7fb7cc007bc0).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:26.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:26.950+0000 7fb7d4ff9700 1 -- 172.21.15.72:0/4001003256 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb7d004ae30 con 0x7fb7d80c0370 2023-08-31T19:26:27.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.121+0000 7fb7defff700 1 -- 172.21.15.72:0/4001003256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7d80c4950 con 0x7fb7d80c0370 2023-08-31T19:26:27.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.122+0000 7fb7d4ff9700 1 -- 172.21.15.72:0/4001003256 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+18036 (secure 0 0 0) 0x7fb7d80c4950 con 0x7fb7d80c0370 2023-08-31T19:26:27.123 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:27.123 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":195,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:26:24.271164+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:26:21.693921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-31T19:26:22.249227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:26:27.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.124+0000 7fb7defff700 1 -- 172.21.15.72:0/4001003256 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb7bc05ef30 msgr2=0x7fb7bc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:27.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.124+0000 7fb7defff700 1 --2- 172.21.15.72:0/4001003256 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb7bc05ef30 0x7fb7bc0613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb7cc0038c0 tx=0x7fb7cc007bc0).stop 2023-08-31T19:26:27.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.124+0000 7fb7defff700 1 -- 172.21.15.72:0/4001003256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d80c0370 msgr2=0x7fb7d80c07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:27.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.124+0000 7fb7defff700 1 --2- 172.21.15.72:0/4001003256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d80c0370 0x7fb7d80c07d0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7fb7d000c930 tx=0x7fb7d0007d10).stop 2023-08-31T19:26:27.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.124+0000 7fb7defff700 1 -- 172.21.15.72:0/4001003256 shutdown_connections 2023-08-31T19:26:27.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.124+0000 7fb7defff700 1 --2- 172.21.15.72:0/4001003256 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb7bc05ef30 0x7fb7bc0613f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.124+0000 7fb7defff700 1 --2- 172.21.15.72:0/4001003256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7d80c0370 0x7fb7d80c07d0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.124+0000 7fb7defff700 1 --2- 172.21.15.72:0/4001003256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7d80c44a0 0x7fb7d80c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.124+0000 7fb7defff700 1 --2- 172.21.15.72:0/4001003256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7d80c5fb0 0x7fb7d8150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.124+0000 7fb7defff700 1 -- 172.21.15.72:0/4001003256 >> 172.21.15.72:0/4001003256 conn(0x7fb7d8082f60 msgr2=0x7fb7d806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:27.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.124+0000 7fb7defff700 1 -- 172.21.15.72:0/4001003256 shutdown_connections 2023-08-31T19:26:27.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.124+0000 7fb7defff700 1 -- 172.21.15.72:0/4001003256 wait complete. 2023-08-31T19:26:27.142 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T19:26:27.143 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:26:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.332+0000 7f8dc11ff700 1 Processor -- start 2023-08-31T19:26:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.332+0000 7f8dc11ff700 1 -- start start 2023-08-31T19:26:27.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.334+0000 7f8dc11ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8dbc0bda40 0x7f8dbc0a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:27.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.334+0000 7f8dc11ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8dbc1574f0 0x7f8dbc157940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.334+0000 7f8dc11ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc0bcb50 con 0x7f8dbc0a4a00 2023-08-31T19:26:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.334+0000 7f8dc11ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dbc0c27f0 con 0x7f8dbc1574f0 2023-08-31T19:26:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.334+0000 7f8dc11ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dbc0653b0 con 0x7f8dbc0bda40 2023-08-31T19:26:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.334+0000 7f8dbb59e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8dbc1574f0 0x7f8dbc157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.334+0000 7f8dbad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8dbc0a4a00 0x7f8dbc064ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38902/0 (socket says 172.21.15.72:38902) 2023-08-31T19:26:27.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.334+0000 7f8dbad9d700 1 -- 172.21.15.72:0/2568221752 learned_addr learned my addr 172.21.15.72:0/2568221752 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:27.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.334+0000 7f8dba59c700 1 --2- 172.21.15.72:0/2568221752 >> v2:172.21.15.146:3300/0 conn(0x7f8dbc0bda40 0x7f8dbc0a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:27.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.334+0000 7f8dbb59e700 1 -- 172.21.15.72:0/2568221752 >> v2:172.21.15.146:3300/0 conn(0x7f8dbc0bda40 msgr2=0x7f8dbc0a4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.334+0000 7f8dbb59e700 1 --2- 172.21.15.72:0/2568221752 >> v2:172.21.15.146:3300/0 conn(0x7f8dbc0bda40 0x7f8dbc0a4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.334+0000 7f8dbb59e700 1 -- 172.21.15.72:0/2568221752 >> v1:172.21.15.72:6789/0 conn(0x7f8dbc0a4a00 legacy=0x7f8dbc064ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.335+0000 7f8dbb59e700 1 -- 172.21.15.72:0/2568221752 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc0bbf40 con 0x7f8dbc1574f0 2023-08-31T19:26:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.335+0000 7f8dbb59e700 1 --2- 172.21.15.72:0/2568221752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dbc1574f0 0x7f8dbc157940 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f8dbc0c7850 tx=0x7f8db4009780).ready entity=mon.0 client_cookie=980fc3b085b44a0a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.335+0000 7f8db9d9b700 1 -- 172.21.15.72:0/2568221752 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db400e070 con 0x7f8dbc1574f0 2023-08-31T19:26:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.335+0000 7f8db9d9b700 1 -- 172.21.15.72:0/2568221752 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db400bb30 con 0x7f8dbc1574f0 2023-08-31T19:26:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.335+0000 7f8db9d9b700 1 -- 172.21.15.72:0/2568221752 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db400beb0 con 0x7f8dbc1574f0 2023-08-31T19:26:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.335+0000 7f8dc11ff700 1 -- 172.21.15.72:0/2568221752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dbc1574f0 msgr2=0x7f8dbc157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:27.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.335+0000 7f8dc11ff700 1 --2- 172.21.15.72:0/2568221752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dbc1574f0 0x7f8dbc157940 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f8dbc0c7850 tx=0x7f8db4009780).stop 2023-08-31T19:26:27.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.336+0000 7f8dc11ff700 1 -- 172.21.15.72:0/2568221752 shutdown_connections 2023-08-31T19:26:27.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.336+0000 7f8dc11ff700 1 --2- 172.21.15.72:0/2568221752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dbc1574f0 0x7f8dbc157940 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.336+0000 7f8dc11ff700 1 --2- 172.21.15.72:0/2568221752 >> v2:172.21.15.146:3300/0 conn(0x7f8dbc0bda40 0x7f8dbc0a4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.336+0000 7f8dc11ff700 1 -- 172.21.15.72:0/2568221752 >> 172.21.15.72:0/2568221752 conn(0x7f8dbc063120 msgr2=0x7f8dbc0c6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:27.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.336+0000 7f8dc11ff700 1 -- 172.21.15.72:0/2568221752 shutdown_connections 2023-08-31T19:26:27.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.336+0000 7f8dc11ff700 1 -- 172.21.15.72:0/2568221752 wait complete. 2023-08-31T19:26:27.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.337+0000 7f8dc11ff700 1 Processor -- start 2023-08-31T19:26:27.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.337+0000 7f8dc11ff700 1 -- start start 2023-08-31T19:26:27.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.338+0000 7f8dc11ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dbc0a4a00 0x7f8dbc14d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:27.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.338+0000 7f8dc11ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8dbc0bda40 0x7f8dbc164450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.338+0000 7f8dc11ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8dbc1574f0 0x7f8dbc164940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.338+0000 7f8dc11ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc14d9d0 con 0x7f8dbc0a4a00 2023-08-31T19:26:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.338+0000 7f8dc11ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc0c49e0 con 0x7f8dbc1574f0 2023-08-31T19:26:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.338+0000 7f8dc11ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc0bfe60 con 0x7f8dbc0bda40 2023-08-31T19:26:27.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.338+0000 7f8dbad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dbc0a4a00 0x7f8dbc14d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.338+0000 7f8dbad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dbc0a4a00 0x7f8dbc14d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59168/0 (socket says 172.21.15.72:59168) 2023-08-31T19:26:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.338+0000 7f8dbad9d700 1 -- 172.21.15.72:0/1787134817 learned_addr learned my addr 172.21.15.72:0/1787134817 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.339+0000 7f8dba59c700 1 --2- 172.21.15.72:0/1787134817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8dbc0bda40 0x7f8dbc164450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.339+0000 7f8dbb59e700 1 --2- 172.21.15.72:0/1787134817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8dbc1574f0 0x7f8dbc164940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.339+0000 7f8dbad9d700 1 -- 172.21.15.72:0/1787134817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8dbc0bda40 msgr2=0x7f8dbc164450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.339+0000 7f8dbad9d700 1 --2- 172.21.15.72:0/1787134817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8dbc0bda40 0x7f8dbc164450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.339+0000 7f8dbad9d700 1 -- 172.21.15.72:0/1787134817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8dbc1574f0 msgr2=0x7f8dbc164940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.339+0000 7f8dbad9d700 1 --2- 172.21.15.72:0/1787134817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8dbc1574f0 0x7f8dbc164940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.339+0000 7f8dbad9d700 1 -- 172.21.15.72:0/1787134817 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db4009a20 con 0x7f8dbc0a4a00 2023-08-31T19:26:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.339+0000 7f8dbad9d700 1 --2- 172.21.15.72:0/1787134817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dbc0a4a00 0x7f8dbc14d4e0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f8dac00c810 tx=0x7f8dac007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:27.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.339+0000 7f8da2ffd700 1 -- 172.21.15.72:0/1787134817 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0072e0 con 0x7f8dbc0a4a00 2023-08-31T19:26:27.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.339+0000 7f8da2ffd700 1 -- 172.21.15.72:0/1787134817 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac007440 con 0x7f8dbc0a4a00 2023-08-31T19:26:27.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.339+0000 7f8da2ffd700 1 -- 172.21.15.72:0/1787134817 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0057a0 con 0x7f8dbc0a4a00 2023-08-31T19:26:27.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.339+0000 7f8dc11ff700 1 -- 172.21.15.72:0/1787134817 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dbc0c0140 con 0x7f8dbc0a4a00 2023-08-31T19:26:27.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.339+0000 7f8dc11ff700 1 -- 172.21.15.72:0/1787134817 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dbc0c0700 con 0x7f8dbc0a4a00 2023-08-31T19:26:27.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.341+0000 7f8dc11ff700 1 -- 172.21.15.72:0/1787134817 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dbc0c0920 con 0x7f8dbc0a4a00 2023-08-31T19:26:27.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.341+0000 7f8da2ffd700 1 -- 172.21.15.72:0/1787134817 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8dac005b90 con 0x7f8dbc0a4a00 2023-08-31T19:26:27.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.342+0000 7f8da2ffd700 1 --2- 172.21.15.72:0/1787134817 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8da805ef60 0x7f8da8061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:27.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.342+0000 7f8da2ffd700 1 -- 172.21.15.72:0/1787134817 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f8dac079b80 con 0x7f8dbc0a4a00 2023-08-31T19:26:27.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.342+0000 7f8dba59c700 1 --2- 172.21.15.72:0/1787134817 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8da805ef60 0x7f8da8061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.343+0000 7f8dba59c700 1 --2- 172.21.15.72:0/1787134817 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8da805ef60 0x7f8da8061420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8dbc0aaa20 tx=0x7f8db0008040).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.346+0000 7f8da2ffd700 1 -- 172.21.15.72:0/1787134817 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8dac04abe0 con 0x7f8dbc0a4a00 2023-08-31T19:26:27.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.512+0000 7f8dc11ff700 1 -- 172.21.15.72:0/1787134817 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8dbc0bc220 con 0x7f8da805ef60 2023-08-31T19:26:27.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.524+0000 7f8da2ffd700 1 -- 172.21.15.72:0/1787134817 <== mgr.7463 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360491 (secure 0 0 0) 0x7f8dbc0bc220 con 0x7f8da805ef60 2023-08-31T19:26:27.529 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:27.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.529+0000 7f8dc11ff700 1 -- 172.21.15.72:0/1787134817 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8da805ef60 msgr2=0x7f8da8061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:27.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.529+0000 7f8dc11ff700 1 --2- 172.21.15.72:0/1787134817 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8da805ef60 0x7f8da8061420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f8dbc0aaa20 tx=0x7f8db0008040).stop 2023-08-31T19:26:27.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.529+0000 7f8dc11ff700 1 -- 172.21.15.72:0/1787134817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dbc0a4a00 msgr2=0x7f8dbc14d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:27.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.529+0000 7f8dc11ff700 1 --2- 172.21.15.72:0/1787134817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dbc0a4a00 0x7f8dbc14d4e0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f8dac00c810 tx=0x7f8dac007db0).stop 2023-08-31T19:26:27.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.529+0000 7f8dc11ff700 1 -- 172.21.15.72:0/1787134817 shutdown_connections 2023-08-31T19:26:27.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.529+0000 7f8dc11ff700 1 --2- 172.21.15.72:0/1787134817 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8da805ef60 0x7f8da8061420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.529+0000 7f8dc11ff700 1 --2- 172.21.15.72:0/1787134817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8dbc1574f0 0x7f8dbc164940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.529+0000 7f8dc11ff700 1 --2- 172.21.15.72:0/1787134817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dbc0a4a00 0x7f8dbc14d4e0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.529+0000 7f8dc11ff700 1 --2- 172.21.15.72:0/1787134817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8dbc0bda40 0x7f8dbc164450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.529+0000 7f8dc11ff700 1 -- 172.21.15.72:0/1787134817 >> 172.21.15.72:0/1787134817 conn(0x7f8dbc063120 msgr2=0x7f8dbc1544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.529+0000 7f8dc11ff700 1 -- 172.21.15.72:0/1787134817 shutdown_connections 2023-08-31T19:26:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.529+0000 7f8dc11ff700 1 -- 172.21.15.72:0/1787134817 wait complete. 2023-08-31T19:26:27.535 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:26:27.547 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-31T19:26:25.763812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1752,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":244,"acting":244,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2436740,"kb_used_data":19012,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752537980,"statfs":{"total":773094113280,"available":770598891520,"internally_reserved":0,"allocated":19468288,"data_stored":10589863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-31450,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-84,"num_write_kb":-67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.001289"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312061+0000","last_change":"2023-08-31T19:26:23.302480+0000","last_active":"2023-08-31T19:26:23.312061+0000","last_peered":"2023-08-31T19:26:23.312061+0000","last_clean":"2023-08-31T19:26:23.312061+0000","last_became_active":"2023-08-31T19:26:23.302128+0000","last_became_peered":"2023-08-31T19:26:23.302128+0000","last_unstale":"2023-08-31T19:26:23.312061+0000","last_undegraded":"2023-08-31T19:26:23.312061+0000","last_fullsized":"2023-08-31T19:26:23.312061+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:26:21.786879+0000","last_change":"2023-08-31T19:26:21.786879+0000","last_active":"2023-08-31T19:26:21.786879+0000","last_peered":"2023-08-31T19:26:21.786879+0000","last_clean":"2023-08-31T19:26:21.786879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:26:21.786879+0000","last_undegraded":"2023-08-31T19:26:21.786879+0000","last_fullsized":"2023-08-31T19:26:21.786879+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.293457+0000","last_change":"2023-08-31T19:26:23.293457+0000","last_active":"2023-08-31T19:26:23.293457+0000","last_peered":"2023-08-31T19:26:23.293457+0000","last_clean":"2023-08-31T19:26:23.293457+0000","last_became_active":"2023-08-31T19:26:23.293147+0000","last_became_peered":"2023-08-31T19:26:23.293147+0000","last_unstale":"2023-08-31T19:26:23.293457+0000","last_undegraded":"2023-08-31T19:26:23.293457+0000","last_fullsized":"2023-08-31T19:26:23.293457+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.281685+0000","last_change":"2023-08-31T19:26:22.816543+0000","last_active":"2023-08-31T19:26:23.281685+0000","last_peered":"2023-08-31T19:26:23.281685+0000","last_clean":"2023-08-31T19:26:23.281685+0000","last_became_active":"2023-08-31T19:26:22.816211+0000","last_became_peered":"2023-08-31T19:26:22.816211+0000","last_unstale":"2023-08-31T19:26:23.281685+0000","last_undegraded":"2023-08-31T19:26:23.281685+0000","last_fullsized":"2023-08-31T19:26:23.281685+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.290365+0000","last_change":"2023-08-31T19:26:23.290365+0000","last_active":"2023-08-31T19:26:23.290365+0000","last_peered":"2023-08-31T19:26:23.290365+0000","last_clean":"2023-08-31T19:26:23.290365+0000","last_became_active":"2023-08-31T19:26:23.289939+0000","last_became_peered":"2023-08-31T19:26:23.289939+0000","last_unstale":"2023-08-31T19:26:23.290365+0000","last_undegraded":"2023-08-31T19:26:23.290365+0000","last_fullsized":"2023-08-31T19:26:23.290365+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.836561+0000","last_change":"2023-08-31T19:26:22.830105+0000","last_active":"2023-08-31T19:26:22.836561+0000","last_peered":"2023-08-31T19:26:22.836561+0000","last_clean":"2023-08-31T19:26:22.836561+0000","last_became_active":"2023-08-31T19:26:22.829726+0000","last_became_peered":"2023-08-31T19:26:22.829726+0000","last_unstale":"2023-08-31T19:26:22.836561+0000","last_undegraded":"2023-08-31T19:26:22.836561+0000","last_fullsized":"2023-08-31T19:26:22.836561+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.304965+0000","last_change":"2023-08-31T19:26:23.299337+0000","last_active":"2023-08-31T19:26:23.304965+0000","last_peered":"2023-08-31T19:26:23.304965+0000","last_clean":"2023-08-31T19:26:23.304965+0000","last_became_active":"2023-08-31T19:26:23.299064+0000","last_became_peered":"2023-08-31T19:26:23.299064+0000","last_unstale":"2023-08-31T19:26:23.304965+0000","last_undegraded":"2023-08-31T19:26:23.304965+0000","last_fullsized":"2023-08-31T19:26:23.304965+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"194'2","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.299899+0000","last_change":"2023-08-31T19:26:22.833076+0000","last_active":"2023-08-31T19:26:23.299899+0000","last_peered":"2023-08-31T19:26:23.299899+0000","last_clean":"2023-08-31T19:26:23.299899+0000","last_became_active":"2023-08-31T19:26:22.832747+0000","last_became_peered":"2023-08-31T19:26:22.832747+0000","last_unstale":"2023-08-31T19:26:23.299899+0000","last_undegraded":"2023-08-31T19:26:23.299899+0000","last_fullsized":"2023-08-31T19:26:23.299899+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:26:22.794300+0000","last_change":"2023-08-31T19:26:22.794300+0000","last_active":"2023-08-31T19:26:22.794300+0000","last_peered":"2023-08-31T19:26:22.794300+0000","last_clean":"2023-08-31T19:26:22.794300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:26:22.794300+0000","last_undegraded":"2023-08-31T19:26:22.794300+0000","last_fullsized":"2023-08-31T19:26:22.794300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"194'1","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.309726+0000","last_change":"2023-08-31T19:26:22.824485+0000","last_active":"2023-08-31T19:26:23.309726+0000","last_peered":"2023-08-31T19:26:23.309726+0000","last_clean":"2023-08-31T19:26:23.309726+0000","last_became_active":"2023-08-31T19:26:22.823688+0000","last_became_peered":"2023-08-31T19:26:22.823688+0000","last_unstale":"2023-08-31T19:26:23.309726+0000","last_undegraded":"2023-08-31T19:26:23.309726+0000","last_fullsized":"2023-08-31T19:26:23.309726+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.287393+0000","last_change":"2023-08-31T19:26:23.287393+0000","last_active":"2023-08-31T19:26:23.287393+0000","last_peered":"2023-08-31T19:26:23.287393+0000","last_clean":"2023-08-31T19:26:23.287393+0000","last_became_active":"2023-08-31T19:26:23.287086+0000","last_became_peered":"2023-08-31T19:26:23.287086+0000","last_unstale":"2023-08-31T19:26:23.287393+0000","last_undegraded":"2023-08-31T19:26:23.287393+0000","last_fullsized":"2023-08-31T19:26:23.287393+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"194'1","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.296172+0000","last_change":"2023-08-31T19:26:22.818406+0000","last_active":"2023-08-31T19:26:23.296172+0000","last_peered":"2023-08-31T19:26:23.296172+0000","last_clean":"2023-08-31T19:26:23.296172+0000","last_became_active":"2023-08-31T19:26:22.818117+0000","last_became_peered":"2023-08-31T19:26:22.818117+0000","last_unstale":"2023-08-31T19:26:23.296172+0000","last_undegraded":"2023-08-31T19:26:23.296172+0000","last_fullsized":"2023-08-31T19:26:23.296172+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.305640+0000","last_change":"2023-08-31T19:26:23.303892+0000","last_active":"2023-08-31T19:26:23.305640+0000","last_peered":"2023-08-31T19:26:23.305640+0000","last_clean":"2023-08-31T19:26:23.305640+0000","last_became_active":"2023-08-31T19:26:23.303639+0000","last_became_peered":"2023-08-31T19:26:23.303639+0000","last_unstale":"2023-08-31T19:26:23.305640+0000","last_undegraded":"2023-08-31T19:26:23.305640+0000","last_fullsized":"2023-08-31T19:26:23.305640+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.829884+0000","last_change":"2023-08-31T19:26:22.824629+0000","last_active":"2023-08-31T19:26:22.829884+0000","last_peered":"2023-08-31T19:26:22.829884+0000","last_clean":"2023-08-31T19:26:22.829884+0000","last_became_active":"2023-08-31T19:26:22.824359+0000","last_became_peered":"2023-08-31T19:26:22.824359+0000","last_unstale":"2023-08-31T19:26:22.829884+0000","last_undegraded":"2023-08-31T19:26:22.829884+0000","last_fullsized":"2023-08-31T19:26:22.829884+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300967+0000","last_change":"2023-08-31T19:26:23.292844+0000","last_active":"2023-08-31T19:26:23.300967+0000","last_peered":"2023-08-31T19:26:23.300967+0000","last_clean":"2023-08-31T19:26:23.300967+0000","last_became_active":"2023-08-31T19:26:23.292583+0000","last_became_peered":"2023-08-31T19:26:23.292583+0000","last_unstale":"2023-08-31T19:26:23.300967+0000","last_undegraded":"2023-08-31T19:26:23.300967+0000","last_fullsized":"2023-08-31T19:26:23.300967+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280760+0000","last_change":"2023-08-31T19:26:22.824062+0000","last_active":"2023-08-31T19:26:23.280760+0000","last_peered":"2023-08-31T19:26:23.280760+0000","last_clean":"2023-08-31T19:26:23.280760+0000","last_became_active":"2023-08-31T19:26:22.823666+0000","last_became_peered":"2023-08-31T19:26:22.823666+0000","last_unstale":"2023-08-31T19:26:23.280760+0000","last_undegraded":"2023-08-31T19:26:23.280760+0000","last_fullsized":"2023-08-31T19:26:23.280760+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.305721+0000","last_change":"2023-08-31T19:26:23.304451+0000","last_active":"2023-08-31T19:26:23.305721+0000","last_peered":"2023-08-31T19:26:23.305721+0000","last_clean":"2023-08-31T19:26:23.305721+0000","last_became_active":"2023-08-31T19:26:23.304177+0000","last_became_peered":"2023-08-31T19:26:23.304177+0000","last_unstale":"2023-08-31T19:26:23.305721+0000","last_undegraded":"2023-08-31T19:26:23.305721+0000","last_fullsized":"2023-08-31T19:26:23.305721+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280118+0000","last_change":"2023-08-31T19:26:22.826411+0000","last_active":"2023-08-31T19:26:23.280118+0000","last_peered":"2023-08-31T19:26:23.280118+0000","last_clean":"2023-08-31T19:26:23.280118+0000","last_became_active":"2023-08-31T19:26:22.825867+0000","last_became_peered":"2023-08-31T19:26:22.825867+0000","last_unstale":"2023-08-31T19:26:23.280118+0000","last_undegraded":"2023-08-31T19:26:23.280118+0000","last_fullsized":"2023-08-31T19:26:23.280118+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300885+0000","last_change":"2023-08-31T19:26:23.293605+0000","last_active":"2023-08-31T19:26:23.300885+0000","last_peered":"2023-08-31T19:26:23.300885+0000","last_clean":"2023-08-31T19:26:23.300885+0000","last_became_active":"2023-08-31T19:26:23.293345+0000","last_became_peered":"2023-08-31T19:26:23.293345+0000","last_unstale":"2023-08-31T19:26:23.300885+0000","last_undegraded":"2023-08-31T19:26:23.300885+0000","last_fullsized":"2023-08-31T19:26:23.300885+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.281704+0000","last_change":"2023-08-31T19:26:22.826984+0000","last_active":"2023-08-31T19:26:23.281704+0000","last_peered":"2023-08-31T19:26:23.281704+0000","last_clean":"2023-08-31T19:26:23.281704+0000","last_became_active":"2023-08-31T19:26:22.826674+0000","last_became_peered":"2023-08-31T19:26:22.826674+0000","last_unstale":"2023-08-31T19:26:23.281704+0000","last_undegraded":"2023-08-31T19:26:23.281704+0000","last_fullsized":"2023-08-31T19:26:23.281704+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:26:22.794300+0000","last_change":"2023-08-31T19:26:22.794300+0000","last_active":"2023-08-31T19:26:22.794300+0000","last_peered":"2023-08-31T19:26:22.794300+0000","last_clean":"2023-08-31T19:26:22.794300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:26:22.794300+0000","last_undegraded":"2023-08-31T19:26:22.794300+0000","last_fullsized":"2023-08-31T19:26:22.794300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.279872+0000","last_change":"2023-08-31T19:26:22.823720+0000","last_active":"2023-08-31T19:26:23.279872+0000","last_peered":"2023-08-31T19:26:23.279872+0000","last_clean":"2023-08-31T19:26:23.279872+0000","last_became_active":"2023-08-31T19:26:22.823426+0000","last_became_peered":"2023-08-31T19:26:22.823426+0000","last_unstale":"2023-08-31T19:26:23.279872+0000","last_undegraded":"2023-08-31T19:26:23.279872+0000","last_fullsized":"2023-08-31T19:26:23.279872+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.310101+0000","last_change":"2023-08-31T19:26:23.310101+0000","last_active":"2023-08-31T19:26:23.310101+0000","last_peered":"2023-08-31T19:26:23.310101+0000","last_clean":"2023-08-31T19:26:23.310101+0000","last_became_active":"2023-08-31T19:26:23.309778+0000","last_became_peered":"2023-08-31T19:26:23.309778+0000","last_unstale":"2023-08-31T19:26:23.310101+0000","last_undegraded":"2023-08-31T19:26:23.310101+0000","last_fullsized":"2023-08-31T19:26:23.310101+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"194'4","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312994+0000","last_change":"2023-08-31T19:26:22.811861+0000","last_active":"2023-08-31T19:26:23.312994+0000","last_peered":"2023-08-31T19:26:23.312994+0000","last_clean":"2023-08-31T19:26:23.312994+0000","last_became_active":"2023-08-31T19:26:22.811556+0000","last_became_peered":"2023-08-31T19:26:22.811556+0000","last_unstale":"2023-08-31T19:26:23.312994+0000","last_undegraded":"2023-08-31T19:26:23.312994+0000","last_fullsized":"2023-08-31T19:26:23.312994+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312283+0000","last_change":"2023-08-31T19:26:23.305209+0000","last_active":"2023-08-31T19:26:23.312283+0000","last_peered":"2023-08-31T19:26:23.312283+0000","last_clean":"2023-08-31T19:26:23.312283+0000","last_became_active":"2023-08-31T19:26:23.304903+0000","last_became_peered":"2023-08-31T19:26:23.304903+0000","last_unstale":"2023-08-31T19:26:23.312283+0000","last_undegraded":"2023-08-31T19:26:23.312283+0000","last_fullsized":"2023-08-31T19:26:23.312283+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"194'1","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.277979+0000","last_change":"2023-08-31T19:26:22.830700+0000","last_active":"2023-08-31T19:26:23.277979+0000","last_peered":"2023-08-31T19:26:23.277979+0000","last_clean":"2023-08-31T19:26:23.277979+0000","last_became_active":"2023-08-31T19:26:22.830373+0000","last_became_peered":"2023-08-31T19:26:22.830373+0000","last_unstale":"2023-08-31T19:26:23.277979+0000","last_undegraded":"2023-08-31T19:26:23.277979+0000","last_fullsized":"2023-08-31T19:26:23.277979+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.311902+0000","last_change":"2023-08-31T19:26:23.302033+0000","last_active":"2023-08-31T19:26:23.311902+0000","last_peered":"2023-08-31T19:26:23.311902+0000","last_clean":"2023-08-31T19:26:23.311902+0000","last_became_active":"2023-08-31T19:26:23.301737+0000","last_became_peered":"2023-08-31T19:26:23.301737+0000","last_unstale":"2023-08-31T19:26:23.311902+0000","last_undegraded":"2023-08-31T19:26:23.311902+0000","last_fullsized":"2023-08-31T19:26:23.311902+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.832776+0000","last_change":"2023-08-31T19:26:22.826806+0000","last_active":"2023-08-31T19:26:22.832776+0000","last_peered":"2023-08-31T19:26:22.832776+0000","last_clean":"2023-08-31T19:26:22.832776+0000","last_became_active":"2023-08-31T19:26:22.826536+0000","last_became_peered":"2023-08-31T19:26:22.826536+0000","last_unstale":"2023-08-31T19:26:22.832776+0000","last_undegraded":"2023-08-31T19:26:22.832776+0000","last_fullsized":"2023-08-31T19:26:22.832776+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:26:22.794300+0000","last_change":"2023-08-31T19:26:22.794300+0000","last_active":"2023-08-31T19:26:22.794300+0000","last_peered":"2023-08-31T19:26:22.794300+0000","last_clean":"2023-08-31T19:26:22.794300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:26:22.794300+0000","last_undegraded":"2023-08-31T19:26:22.794300+0000","last_fullsized":"2023-08-31T19:26:22.794300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:26:21.786879+0000","last_change":"2023-08-31T19:26:21.786879+0000","last_active":"2023-08-31T19:26:21.786879+0000","last_peered":"2023-08-31T19:26:21.786879+0000","last_clean":"2023-08-31T19:26:21.786879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:26:21.786879+0000","last_undegraded":"2023-08-31T19:26:21.786879+0000","last_fullsized":"2023-08-31T19:26:21.786879+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312111+0000","last_change":"2023-08-31T19:26:23.302596+0000","last_active":"2023-08-31T19:26:23.312111+0000","last_peered":"2023-08-31T19:26:23.312111+0000","last_clean":"2023-08-31T19:26:23.312111+0000","last_became_active":"2023-08-31T19:26:23.302303+0000","last_became_peered":"2023-08-31T19:26:23.302303+0000","last_unstale":"2023-08-31T19:26:23.312111+0000","last_undegraded":"2023-08-31T19:26:23.312111+0000","last_fullsized":"2023-08-31T19:26:23.312111+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"194'4","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.296375+0000","last_change":"2023-08-31T19:26:22.827645+0000","last_active":"2023-08-31T19:26:23.296375+0000","last_peered":"2023-08-31T19:26:23.296375+0000","last_clean":"2023-08-31T19:26:23.296375+0000","last_became_active":"2023-08-31T19:26:22.827203+0000","last_became_peered":"2023-08-31T19:26:22.827203+0000","last_unstale":"2023-08-31T19:26:23.296375+0000","last_undegraded":"2023-08-31T19:26:23.296375+0000","last_fullsized":"2023-08-31T19:26:23.296375+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.304986+0000","last_change":"2023-08-31T19:26:23.299764+0000","last_active":"2023-08-31T19:26:23.304986+0000","last_peered":"2023-08-31T19:26:23.304986+0000","last_clean":"2023-08-31T19:26:23.304986+0000","last_became_active":"2023-08-31T19:26:23.299356+0000","last_became_peered":"2023-08-31T19:26:23.299356+0000","last_unstale":"2023-08-31T19:26:23.304986+0000","last_undegraded":"2023-08-31T19:26:23.304986+0000","last_fullsized":"2023-08-31T19:26:23.304986+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.276605+0000","last_change":"2023-08-31T19:26:22.822994+0000","last_active":"2023-08-31T19:26:23.276605+0000","last_peered":"2023-08-31T19:26:23.276605+0000","last_clean":"2023-08-31T19:26:23.276605+0000","last_became_active":"2023-08-31T19:26:22.822676+0000","last_became_peered":"2023-08-31T19:26:22.822676+0000","last_unstale":"2023-08-31T19:26:23.276605+0000","last_undegraded":"2023-08-31T19:26:23.276605+0000","last_fullsized":"2023-08-31T19:26:23.276605+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.290686+0000","last_change":"2023-08-31T19:26:23.290686+0000","last_active":"2023-08-31T19:26:23.290686+0000","last_peered":"2023-08-31T19:26:23.290686+0000","last_clean":"2023-08-31T19:26:23.290686+0000","last_became_active":"2023-08-31T19:26:23.290387+0000","last_became_peered":"2023-08-31T19:26:23.290387+0000","last_unstale":"2023-08-31T19:26:23.290686+0000","last_undegraded":"2023-08-31T19:26:23.290686+0000","last_fullsized":"2023-08-31T19:26:23.290686+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.279486+0000","last_change":"2023-08-31T19:26:22.826359+0000","last_active":"2023-08-31T19:26:23.279486+0000","last_peered":"2023-08-31T19:26:23.279486+0000","last_clean":"2023-08-31T19:26:23.279486+0000","last_became_active":"2023-08-31T19:26:22.826059+0000","last_became_peered":"2023-08-31T19:26:22.826059+0000","last_unstale":"2023-08-31T19:26:23.279486+0000","last_undegraded":"2023-08-31T19:26:23.279486+0000","last_fullsized":"2023-08-31T19:26:23.279486+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.295134+0000","last_change":"2023-08-31T19:26:23.291022+0000","last_active":"2023-08-31T19:26:23.295134+0000","last_peered":"2023-08-31T19:26:23.295134+0000","last_clean":"2023-08-31T19:26:23.295134+0000","last_became_active":"2023-08-31T19:26:23.290590+0000","last_became_peered":"2023-08-31T19:26:23.290590+0000","last_unstale":"2023-08-31T19:26:23.295134+0000","last_undegraded":"2023-08-31T19:26:23.295134+0000","last_fullsized":"2023-08-31T19:26:23.295134+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"194'1","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300130+0000","last_change":"2023-08-31T19:26:22.823915+0000","last_active":"2023-08-31T19:26:23.300130+0000","last_peered":"2023-08-31T19:26:23.300130+0000","last_clean":"2023-08-31T19:26:23.300130+0000","last_became_active":"2023-08-31T19:26:22.823618+0000","last_became_peered":"2023-08-31T19:26:22.823618+0000","last_unstale":"2023-08-31T19:26:23.300130+0000","last_undegraded":"2023-08-31T19:26:23.300130+0000","last_fullsized":"2023-08-31T19:26:23.300130+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:26:22.794300+0000","last_change":"2023-08-31T19:26:22.794300+0000","last_active":"2023-08-31T19:26:22.794300+0000","last_peered":"2023-08-31T19:26:22.794300+0000","last_clean":"2023-08-31T19:26:22.794300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:26:22.794300+0000","last_undegraded":"2023-08-31T19:26:22.794300+0000","last_fullsized":"2023-08-31T19:26:22.794300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.836407+0000","last_change":"2023-08-31T19:26:22.829047+0000","last_active":"2023-08-31T19:26:22.836407+0000","last_peered":"2023-08-31T19:26:22.836407+0000","last_clean":"2023-08-31T19:26:22.836407+0000","last_became_active":"2023-08-31T19:26:22.827473+0000","last_became_peered":"2023-08-31T19:26:22.827473+0000","last_unstale":"2023-08-31T19:26:22.836407+0000","last_undegraded":"2023-08-31T19:26:22.836407+0000","last_fullsized":"2023-08-31T19:26:22.836407+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312378+0000","last_change":"2023-08-31T19:26:23.311139+0000","last_active":"2023-08-31T19:26:23.312378+0000","last_peered":"2023-08-31T19:26:23.312378+0000","last_clean":"2023-08-31T19:26:23.312378+0000","last_became_active":"2023-08-31T19:26:23.310852+0000","last_became_peered":"2023-08-31T19:26:23.310852+0000","last_unstale":"2023-08-31T19:26:23.312378+0000","last_undegraded":"2023-08-31T19:26:23.312378+0000","last_fullsized":"2023-08-31T19:26:23.312378+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"194'1","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300774+0000","last_change":"2023-08-31T19:26:22.823024+0000","last_active":"2023-08-31T19:26:23.300774+0000","last_peered":"2023-08-31T19:26:23.300774+0000","last_clean":"2023-08-31T19:26:23.300774+0000","last_became_active":"2023-08-31T19:26:22.822664+0000","last_became_peered":"2023-08-31T19:26:22.822664+0000","last_unstale":"2023-08-31T19:26:23.300774+0000","last_undegraded":"2023-08-31T19:26:23.300774+0000","last_fullsized":"2023-08-31T19:26:23.300774+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:26:22.794300+0000","last_change":"2023-08-31T19:26:22.794300+0000","last_active":"2023-08-31T19:26:22.794300+0000","last_peered":"2023-08-31T19:26:22.794300+0000","last_clean":"2023-08-31T19:26:22.794300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:26:22.794300+0000","last_undegraded":"2023-08-31T19:26:22.794300+0000","last_fullsized":"2023-08-31T19:26:22.794300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.281000+0000","last_change":"2023-08-31T19:26:22.820189+0000","last_active":"2023-08-31T19:26:23.281000+0000","last_peered":"2023-08-31T19:26:23.281000+0000","last_clean":"2023-08-31T19:26:23.281000+0000","last_became_active":"2023-08-31T19:26:22.819465+0000","last_became_peered":"2023-08-31T19:26:22.819465+0000","last_unstale":"2023-08-31T19:26:23.281000+0000","last_undegraded":"2023-08-31T19:26:23.281000+0000","last_fullsized":"2023-08-31T19:26:23.281000+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.305579+0000","last_change":"2023-08-31T19:26:23.304134+0000","last_active":"2023-08-31T19:26:23.305579+0000","last_peered":"2023-08-31T19:26:23.305579+0000","last_clean":"2023-08-31T19:26:23.305579+0000","last_became_active":"2023-08-31T19:26:23.303569+0000","last_became_peered":"2023-08-31T19:26:23.303569+0000","last_unstale":"2023-08-31T19:26:23.305579+0000","last_undegraded":"2023-08-31T19:26:23.305579+0000","last_fullsized":"2023-08-31T19:26:23.305579+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.275898+0000","last_change":"2023-08-31T19:26:22.821108+0000","last_active":"2023-08-31T19:26:23.275898+0000","last_peered":"2023-08-31T19:26:23.275898+0000","last_clean":"2023-08-31T19:26:23.275898+0000","last_became_active":"2023-08-31T19:26:22.820612+0000","last_became_peered":"2023-08-31T19:26:22.820612+0000","last_unstale":"2023-08-31T19:26:23.275898+0000","last_undegraded":"2023-08-31T19:26:23.275898+0000","last_fullsized":"2023-08-31T19:26:23.275898+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.305199+0000","last_change":"2023-08-31T19:26:23.300443+0000","last_active":"2023-08-31T19:26:23.305199+0000","last_peered":"2023-08-31T19:26:23.305199+0000","last_clean":"2023-08-31T19:26:23.305199+0000","last_became_active":"2023-08-31T19:26:23.300118+0000","last_became_peered":"2023-08-31T19:26:23.300118+0000","last_unstale":"2023-08-31T19:26:23.305199+0000","last_undegraded":"2023-08-31T19:26:23.305199+0000","last_fullsized":"2023-08-31T19:26:23.305199+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280878+0000","last_change":"2023-08-31T19:26:22.825898+0000","last_active":"2023-08-31T19:26:23.280878+0000","last_peered":"2023-08-31T19:26:23.280878+0000","last_clean":"2023-08-31T19:26:23.280878+0000","last_became_active":"2023-08-31T19:26:22.825629+0000","last_became_peered":"2023-08-31T19:26:22.825629+0000","last_unstale":"2023-08-31T19:26:23.280878+0000","last_undegraded":"2023-08-31T19:26:23.280878+0000","last_fullsized":"2023-08-31T19:26:23.280878+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312098+0000","last_change":"2023-08-31T19:26:23.302652+0000","last_active":"2023-08-31T19:26:23.312098+0000","last_peered":"2023-08-31T19:26:23.312098+0000","last_clean":"2023-08-31T19:26:23.312098+0000","last_became_active":"2023-08-31T19:26:23.301836+0000","last_became_peered":"2023-08-31T19:26:23.301836+0000","last_unstale":"2023-08-31T19:26:23.312098+0000","last_undegraded":"2023-08-31T19:26:23.312098+0000","last_fullsized":"2023-08-31T19:26:23.312098+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.836574+0000","last_change":"2023-08-31T19:26:22.830171+0000","last_active":"2023-08-31T19:26:22.836574+0000","last_peered":"2023-08-31T19:26:22.836574+0000","last_clean":"2023-08-31T19:26:22.836574+0000","last_became_active":"2023-08-31T19:26:22.829870+0000","last_became_peered":"2023-08-31T19:26:22.829870+0000","last_unstale":"2023-08-31T19:26:22.836574+0000","last_undegraded":"2023-08-31T19:26:22.836574+0000","last_fullsized":"2023-08-31T19:26:22.836574+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.290843+0000","last_change":"2023-08-31T19:26:23.290843+0000","last_active":"2023-08-31T19:26:23.290843+0000","last_peered":"2023-08-31T19:26:23.290843+0000","last_clean":"2023-08-31T19:26:23.290843+0000","last_became_active":"2023-08-31T19:26:23.290591+0000","last_became_peered":"2023-08-31T19:26:23.290591+0000","last_unstale":"2023-08-31T19:26:23.290843+0000","last_undegraded":"2023-08-31T19:26:23.290843+0000","last_fullsized":"2023-08-31T19:26:23.290843+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.830017+0000","last_change":"2023-08-31T19:26:22.824187+0000","last_active":"2023-08-31T19:26:22.830017+0000","last_peered":"2023-08-31T19:26:22.830017+0000","last_clean":"2023-08-31T19:26:22.830017+0000","last_became_active":"2023-08-31T19:26:22.823666+0000","last_became_peered":"2023-08-31T19:26:22.823666+0000","last_unstale":"2023-08-31T19:26:22.830017+0000","last_undegraded":"2023-08-31T19:26:22.830017+0000","last_fullsized":"2023-08-31T19:26:22.830017+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:26:22.794300+0000","last_change":"2023-08-31T19:26:22.794300+0000","last_active":"2023-08-31T19:26:22.794300+0000","last_peered":"2023-08-31T19:26:22.794300+0000","last_clean":"2023-08-31T19:26:22.794300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:26:22.794300+0000","last_undegraded":"2023-08-31T19:26:22.794300+0000","last_fullsized":"2023-08-31T19:26:22.794300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.836540+0000","last_change":"2023-08-31T19:26:22.828820+0000","last_active":"2023-08-31T19:26:22.836540+0000","last_peered":"2023-08-31T19:26:22.836540+0000","last_clean":"2023-08-31T19:26:22.836540+0000","last_became_active":"2023-08-31T19:26:22.828383+0000","last_became_peered":"2023-08-31T19:26:22.828383+0000","last_unstale":"2023-08-31T19:26:22.836540+0000","last_undegraded":"2023-08-31T19:26:22.836540+0000","last_fullsized":"2023-08-31T19:26:22.836540+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.311649+0000","last_change":"2023-08-31T19:26:23.310144+0000","last_active":"2023-08-31T19:26:23.311649+0000","last_peered":"2023-08-31T19:26:23.311649+0000","last_clean":"2023-08-31T19:26:23.311649+0000","last_became_active":"2023-08-31T19:26:23.309819+0000","last_became_peered":"2023-08-31T19:26:23.309819+0000","last_unstale":"2023-08-31T19:26:23.311649+0000","last_undegraded":"2023-08-31T19:26:23.311649+0000","last_fullsized":"2023-08-31T19:26:23.311649+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280361+0000","last_change":"2023-08-31T19:26:22.833656+0000","last_active":"2023-08-31T19:26:23.280361+0000","last_peered":"2023-08-31T19:26:23.280361+0000","last_clean":"2023-08-31T19:26:23.280361+0000","last_became_active":"2023-08-31T19:26:22.833399+0000","last_became_peered":"2023-08-31T19:26:22.833399+0000","last_unstale":"2023-08-31T19:26:23.280361+0000","last_undegraded":"2023-08-31T19:26:23.280361+0000","last_fullsized":"2023-08-31T19:26:23.280361+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.292804+0000","last_change":"2023-08-31T19:26:23.286386+0000","last_active":"2023-08-31T19:26:23.292804+0000","last_peered":"2023-08-31T19:26:23.292804+0000","last_clean":"2023-08-31T19:26:23.292804+0000","last_became_active":"2023-08-31T19:26:23.286109+0000","last_became_peered":"2023-08-31T19:26:23.286109+0000","last_unstale":"2023-08-31T19:26:23.292804+0000","last_undegraded":"2023-08-31T19:26:23.292804+0000","last_fullsized":"2023-08-31T19:26:23.292804+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.836509+0000","last_change":"2023-08-31T19:26:22.829102+0000","last_active":"2023-08-31T19:26:22.836509+0000","last_peered":"2023-08-31T19:26:22.836509+0000","last_clean":"2023-08-31T19:26:22.836509+0000","last_became_active":"2023-08-31T19:26:22.828778+0000","last_became_peered":"2023-08-31T19:26:22.828778+0000","last_unstale":"2023-08-31T19:26:22.836509+0000","last_undegraded":"2023-08-31T19:26:22.836509+0000","last_fullsized":"2023-08-31T19:26:22.836509+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.295927+0000","last_change":"2023-08-31T19:26:23.295927+0000","last_active":"2023-08-31T19:26:23.295927+0000","last_peered":"2023-08-31T19:26:23.295927+0000","last_clean":"2023-08-31T19:26:23.295927+0000","last_became_active":"2023-08-31T19:26:23.294861+0000","last_became_peered":"2023-08-31T19:26:23.294861+0000","last_unstale":"2023-08-31T19:26:23.295927+0000","last_undegraded":"2023-08-31T19:26:23.295927+0000","last_fullsized":"2023-08-31T19:26:23.295927+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.293239+0000","last_change":"2023-08-31T19:26:22.827568+0000","last_active":"2023-08-31T19:26:23.293239+0000","last_peered":"2023-08-31T19:26:23.293239+0000","last_clean":"2023-08-31T19:26:23.293239+0000","last_became_active":"2023-08-31T19:26:22.827299+0000","last_became_peered":"2023-08-31T19:26:22.827299+0000","last_unstale":"2023-08-31T19:26:23.293239+0000","last_undegraded":"2023-08-31T19:26:23.293239+0000","last_fullsized":"2023-08-31T19:26:23.293239+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.306189+0000","last_change":"2023-08-31T19:26:23.301378+0000","last_active":"2023-08-31T19:26:23.306189+0000","last_peered":"2023-08-31T19:26:23.306189+0000","last_clean":"2023-08-31T19:26:23.306189+0000","last_became_active":"2023-08-31T19:26:23.301038+0000","last_became_peered":"2023-08-31T19:26:23.301038+0000","last_unstale":"2023-08-31T19:26:23.306189+0000","last_undegraded":"2023-08-31T19:26:23.306189+0000","last_fullsized":"2023-08-31T19:26:23.306189+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.288336+0000","last_change":"2023-08-31T19:26:22.831958+0000","last_active":"2023-08-31T19:26:23.288336+0000","last_peered":"2023-08-31T19:26:23.288336+0000","last_clean":"2023-08-31T19:26:23.288336+0000","last_became_active":"2023-08-31T19:26:22.831650+0000","last_became_peered":"2023-08-31T19:26:22.831650+0000","last_unstale":"2023-08-31T19:26:23.288336+0000","last_undegraded":"2023-08-31T19:26:23.288336+0000","last_fullsized":"2023-08-31T19:26:23.288336+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300985+0000","last_change":"2023-08-31T19:26:23.297351+0000","last_active":"2023-08-31T19:26:23.300985+0000","last_peered":"2023-08-31T19:26:23.300985+0000","last_clean":"2023-08-31T19:26:23.300985+0000","last_became_active":"2023-08-31T19:26:23.297045+0000","last_became_peered":"2023-08-31T19:26:23.297045+0000","last_unstale":"2023-08-31T19:26:23.300985+0000","last_undegraded":"2023-08-31T19:26:23.300985+0000","last_fullsized":"2023-08-31T19:26:23.300985+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.279022+0000","last_change":"2023-08-31T19:26:22.828946+0000","last_active":"2023-08-31T19:26:23.279022+0000","last_peered":"2023-08-31T19:26:23.279022+0000","last_clean":"2023-08-31T19:26:23.279022+0000","last_became_active":"2023-08-31T19:26:22.828620+0000","last_became_peered":"2023-08-31T19:26:22.828620+0000","last_unstale":"2023-08-31T19:26:23.279022+0000","last_undegraded":"2023-08-31T19:26:23.279022+0000","last_fullsized":"2023-08-31T19:26:23.279022+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:26:22.794300+0000","last_change":"2023-08-31T19:26:22.794300+0000","last_active":"2023-08-31T19:26:22.794300+0000","last_peered":"2023-08-31T19:26:22.794300+0000","last_clean":"2023-08-31T19:26:22.794300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:26:22.794300+0000","last_undegraded":"2023-08-31T19:26:22.794300+0000","last_fullsized":"2023-08-31T19:26:22.794300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"194'1","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.309453+0000","last_change":"2023-08-31T19:26:22.827665+0000","last_active":"2023-08-31T19:26:23.309453+0000","last_peered":"2023-08-31T19:26:23.309453+0000","last_clean":"2023-08-31T19:26:23.309453+0000","last_became_active":"2023-08-31T19:26:22.826903+0000","last_became_peered":"2023-08-31T19:26:22.826903+0000","last_unstale":"2023-08-31T19:26:23.309453+0000","last_undegraded":"2023-08-31T19:26:23.309453+0000","last_fullsized":"2023-08-31T19:26:23.309453+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.299443+0000","last_change":"2023-08-31T19:26:23.296455+0000","last_active":"2023-08-31T19:26:23.299443+0000","last_peered":"2023-08-31T19:26:23.299443+0000","last_clean":"2023-08-31T19:26:23.299443+0000","last_became_active":"2023-08-31T19:26:23.296157+0000","last_became_peered":"2023-08-31T19:26:23.296157+0000","last_unstale":"2023-08-31T19:26:23.299443+0000","last_undegraded":"2023-08-31T19:26:23.299443+0000","last_fullsized":"2023-08-31T19:26:23.299443+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"194'1","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.274317+0000","last_change":"2023-08-31T19:26:22.823989+0000","last_active":"2023-08-31T19:26:23.274317+0000","last_peered":"2023-08-31T19:26:23.274317+0000","last_clean":"2023-08-31T19:26:23.274317+0000","last_became_active":"2023-08-31T19:26:22.823292+0000","last_became_peered":"2023-08-31T19:26:22.823292+0000","last_unstale":"2023-08-31T19:26:23.274317+0000","last_undegraded":"2023-08-31T19:26:23.274317+0000","last_fullsized":"2023-08-31T19:26:23.274317+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.290206+0000","last_change":"2023-08-31T19:26:23.290206+0000","last_active":"2023-08-31T19:26:23.290206+0000","last_peered":"2023-08-31T19:26:23.290206+0000","last_clean":"2023-08-31T19:26:23.290206+0000","last_became_active":"2023-08-31T19:26:23.289585+0000","last_became_peered":"2023-08-31T19:26:23.289585+0000","last_unstale":"2023-08-31T19:26:23.290206+0000","last_undegraded":"2023-08-31T19:26:23.290206+0000","last_fullsized":"2023-08-31T19:26:23.290206+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"194'2","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.293087+0000","last_change":"2023-08-31T19:26:22.823160+0000","last_active":"2023-08-31T19:26:23.293087+0000","last_peered":"2023-08-31T19:26:23.293087+0000","last_clean":"2023-08-31T19:26:23.293087+0000","last_became_active":"2023-08-31T19:26:22.822743+0000","last_became_peered":"2023-08-31T19:26:22.822743+0000","last_unstale":"2023-08-31T19:26:23.293087+0000","last_undegraded":"2023-08-31T19:26:23.293087+0000","last_fullsized":"2023-08-31T19:26:23.293087+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:26:22.794300+0000","last_change":"2023-08-31T19:26:22.794300+0000","last_active":"2023-08-31T19:26:22.794300+0000","last_peered":"2023-08-31T19:26:22.794300+0000","last_clean":"2023-08-31T19:26:22.794300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:26:22.794300+0000","last_undegraded":"2023-08-31T19:26:22.794300+0000","last_fullsized":"2023-08-31T19:26:22.794300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.275969+0000","last_change":"2023-08-31T19:26:22.825889+0000","last_active":"2023-08-31T19:26:23.275969+0000","last_peered":"2023-08-31T19:26:23.275969+0000","last_clean":"2023-08-31T19:26:23.275969+0000","last_became_active":"2023-08-31T19:26:22.825576+0000","last_became_peered":"2023-08-31T19:26:22.825576+0000","last_unstale":"2023-08-31T19:26:23.275969+0000","last_undegraded":"2023-08-31T19:26:23.275969+0000","last_fullsized":"2023-08-31T19:26:23.275969+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312115+0000","last_change":"2023-08-31T19:26:23.310503+0000","last_active":"2023-08-31T19:26:23.312115+0000","last_peered":"2023-08-31T19:26:23.312115+0000","last_clean":"2023-08-31T19:26:23.312115+0000","last_became_active":"2023-08-31T19:26:23.310184+0000","last_became_peered":"2023-08-31T19:26:23.310184+0000","last_unstale":"2023-08-31T19:26:23.312115+0000","last_undegraded":"2023-08-31T19:26:23.312115+0000","last_fullsized":"2023-08-31T19:26:23.312115+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280653+0000","last_change":"2023-08-31T19:26:22.829143+0000","last_active":"2023-08-31T19:26:23.280653+0000","last_peered":"2023-08-31T19:26:23.280653+0000","last_clean":"2023-08-31T19:26:23.280653+0000","last_became_active":"2023-08-31T19:26:22.828859+0000","last_became_peered":"2023-08-31T19:26:22.828859+0000","last_unstale":"2023-08-31T19:26:23.280653+0000","last_undegraded":"2023-08-31T19:26:23.280653+0000","last_fullsized":"2023-08-31T19:26:23.280653+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.298066+0000","last_change":"2023-08-31T19:26:23.291815+0000","last_active":"2023-08-31T19:26:23.298066+0000","last_peered":"2023-08-31T19:26:23.298066+0000","last_clean":"2023-08-31T19:26:23.298066+0000","last_became_active":"2023-08-31T19:26:23.291544+0000","last_became_peered":"2023-08-31T19:26:23.291544+0000","last_unstale":"2023-08-31T19:26:23.298066+0000","last_undegraded":"2023-08-31T19:26:23.298066+0000","last_fullsized":"2023-08-31T19:26:23.298066+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.837834+0000","last_change":"2023-08-31T19:26:22.831198+0000","last_active":"2023-08-31T19:26:22.837834+0000","last_peered":"2023-08-31T19:26:22.837834+0000","last_clean":"2023-08-31T19:26:22.837834+0000","last_became_active":"2023-08-31T19:26:22.830861+0000","last_became_peered":"2023-08-31T19:26:22.830861+0000","last_unstale":"2023-08-31T19:26:22.837834+0000","last_undegraded":"2023-08-31T19:26:22.837834+0000","last_fullsized":"2023-08-31T19:26:22.837834+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.293997+0000","last_change":"2023-08-31T19:26:23.289516+0000","last_active":"2023-08-31T19:26:23.293997+0000","last_peered":"2023-08-31T19:26:23.293997+0000","last_clean":"2023-08-31T19:26:23.293997+0000","last_became_active":"2023-08-31T19:26:23.289253+0000","last_became_peered":"2023-08-31T19:26:23.289253+0000","last_unstale":"2023-08-31T19:26:23.293997+0000","last_undegraded":"2023-08-31T19:26:23.293997+0000","last_fullsized":"2023-08-31T19:26:23.293997+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.275785+0000","last_change":"2023-08-31T19:26:22.817810+0000","last_active":"2023-08-31T19:26:23.275785+0000","last_peered":"2023-08-31T19:26:23.275785+0000","last_clean":"2023-08-31T19:26:23.275785+0000","last_became_active":"2023-08-31T19:26:22.817509+0000","last_became_peered":"2023-08-31T19:26:22.817509+0000","last_unstale":"2023-08-31T19:26:23.275785+0000","last_undegraded":"2023-08-31T19:26:23.275785+0000","last_fullsized":"2023-08-31T19:26:23.275785+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312134+0000","last_change":"2023-08-31T19:26:23.303785+0000","last_active":"2023-08-31T19:26:23.312134+0000","last_peered":"2023-08-31T19:26:23.312134+0000","last_clean":"2023-08-31T19:26:23.312134+0000","last_became_active":"2023-08-31T19:26:23.303510+0000","last_became_peered":"2023-08-31T19:26:23.303510+0000","last_unstale":"2023-08-31T19:26:23.312134+0000","last_undegraded":"2023-08-31T19:26:23.312134+0000","last_fullsized":"2023-08-31T19:26:23.312134+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.279464+0000","last_change":"2023-08-31T19:26:22.828347+0000","last_active":"2023-08-31T19:26:23.279464+0000","last_peered":"2023-08-31T19:26:23.279464+0000","last_clean":"2023-08-31T19:26:23.279464+0000","last_became_active":"2023-08-31T19:26:22.828047+0000","last_became_peered":"2023-08-31T19:26:22.828047+0000","last_unstale":"2023-08-31T19:26:23.279464+0000","last_undegraded":"2023-08-31T19:26:23.279464+0000","last_fullsized":"2023-08-31T19:26:23.279464+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300040+0000","last_change":"2023-08-31T19:26:23.292428+0000","last_active":"2023-08-31T19:26:23.300040+0000","last_peered":"2023-08-31T19:26:23.300040+0000","last_clean":"2023-08-31T19:26:23.300040+0000","last_became_active":"2023-08-31T19:26:23.292111+0000","last_became_peered":"2023-08-31T19:26:23.292111+0000","last_unstale":"2023-08-31T19:26:23.300040+0000","last_undegraded":"2023-08-31T19:26:23.300040+0000","last_fullsized":"2023-08-31T19:26:23.300040+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"194'1","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.310471+0000","last_change":"2023-08-31T19:26:22.830002+0000","last_active":"2023-08-31T19:26:23.310471+0000","last_peered":"2023-08-31T19:26:23.310471+0000","last_clean":"2023-08-31T19:26:23.310471+0000","last_became_active":"2023-08-31T19:26:22.829716+0000","last_became_peered":"2023-08-31T19:26:22.829716+0000","last_unstale":"2023-08-31T19:26:23.310471+0000","last_undegraded":"2023-08-31T19:26:23.310471+0000","last_fullsized":"2023-08-31T19:26:23.310471+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.304996+0000","last_change":"2023-08-31T19:26:23.298526+0000","last_active":"2023-08-31T19:26:23.304996+0000","last_peered":"2023-08-31T19:26:23.304996+0000","last_clean":"2023-08-31T19:26:23.304996+0000","last_became_active":"2023-08-31T19:26:23.298247+0000","last_became_peered":"2023-08-31T19:26:23.298247+0000","last_unstale":"2023-08-31T19:26:23.304996+0000","last_undegraded":"2023-08-31T19:26:23.304996+0000","last_fullsized":"2023-08-31T19:26:23.304996+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"194'2","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300232+0000","last_change":"2023-08-31T19:26:22.826772+0000","last_active":"2023-08-31T19:26:23.300232+0000","last_peered":"2023-08-31T19:26:23.300232+0000","last_clean":"2023-08-31T19:26:23.300232+0000","last_became_active":"2023-08-31T19:26:22.826396+0000","last_became_peered":"2023-08-31T19:26:22.826396+0000","last_unstale":"2023-08-31T19:26:23.300232+0000","last_undegraded":"2023-08-31T19:26:23.300232+0000","last_fullsized":"2023-08-31T19:26:23.300232+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.310466+0000","last_change":"2023-08-31T19:26:23.310466+0000","last_active":"2023-08-31T19:26:23.310466+0000","last_peered":"2023-08-31T19:26:23.310466+0000","last_clean":"2023-08-31T19:26:23.310466+0000","last_became_active":"2023-08-31T19:26:23.310164+0000","last_became_peered":"2023-08-31T19:26:23.310164+0000","last_unstale":"2023-08-31T19:26:23.310466+0000","last_undegraded":"2023-08-31T19:26:23.310466+0000","last_fullsized":"2023-08-31T19:26:23.310466+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.829825+0000","last_change":"2023-08-31T19:26:22.823991+0000","last_active":"2023-08-31T19:26:22.829825+0000","last_peered":"2023-08-31T19:26:22.829825+0000","last_clean":"2023-08-31T19:26:22.829825+0000","last_became_active":"2023-08-31T19:26:22.823709+0000","last_became_peered":"2023-08-31T19:26:22.823709+0000","last_unstale":"2023-08-31T19:26:22.829825+0000","last_undegraded":"2023-08-31T19:26:22.829825+0000","last_fullsized":"2023-08-31T19:26:22.829825+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.288039+0000","last_change":"2023-08-31T19:26:23.288039+0000","last_active":"2023-08-31T19:26:23.288039+0000","last_peered":"2023-08-31T19:26:23.288039+0000","last_clean":"2023-08-31T19:26:23.288039+0000","last_became_active":"2023-08-31T19:26:23.287669+0000","last_became_peered":"2023-08-31T19:26:23.287669+0000","last_unstale":"2023-08-31T19:26:23.288039+0000","last_undegraded":"2023-08-31T19:26:23.288039+0000","last_fullsized":"2023-08-31T19:26:23.288039+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280457+0000","last_change":"2023-08-31T19:26:22.828513+0000","last_active":"2023-08-31T19:26:23.280457+0000","last_peered":"2023-08-31T19:26:23.280457+0000","last_clean":"2023-08-31T19:26:23.280457+0000","last_became_active":"2023-08-31T19:26:22.828203+0000","last_became_peered":"2023-08-31T19:26:22.828203+0000","last_unstale":"2023-08-31T19:26:23.280457+0000","last_undegraded":"2023-08-31T19:26:23.280457+0000","last_fullsized":"2023-08-31T19:26:23.280457+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312363+0000","last_change":"2023-08-31T19:26:23.310972+0000","last_active":"2023-08-31T19:26:23.312363+0000","last_peered":"2023-08-31T19:26:23.312363+0000","last_clean":"2023-08-31T19:26:23.312363+0000","last_became_active":"2023-08-31T19:26:23.310711+0000","last_became_peered":"2023-08-31T19:26:23.310711+0000","last_unstale":"2023-08-31T19:26:23.312363+0000","last_undegraded":"2023-08-31T19:26:23.312363+0000","last_fullsized":"2023-08-31T19:26:23.312363+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"194'1","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.273808+0000","last_change":"2023-08-31T19:26:22.832571+0000","last_active":"2023-08-31T19:26:23.273808+0000","last_peered":"2023-08-31T19:26:23.273808+0000","last_clean":"2023-08-31T19:26:23.273808+0000","last_became_active":"2023-08-31T19:26:22.832024+0000","last_became_peered":"2023-08-31T19:26:22.832024+0000","last_unstale":"2023-08-31T19:26:23.273808+0000","last_undegraded":"2023-08-31T19:26:23.273808+0000","last_fullsized":"2023-08-31T19:26:23.273808+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.296632+0000","last_change":"2023-08-31T19:26:23.296632+0000","last_active":"2023-08-31T19:26:23.296632+0000","last_peered":"2023-08-31T19:26:23.296632+0000","last_clean":"2023-08-31T19:26:23.296632+0000","last_became_active":"2023-08-31T19:26:23.296228+0000","last_became_peered":"2023-08-31T19:26:23.296228+0000","last_unstale":"2023-08-31T19:26:23.296632+0000","last_undegraded":"2023-08-31T19:26:23.296632+0000","last_fullsized":"2023-08-31T19:26:23.296632+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.836654+0000","last_change":"2023-08-31T19:26:22.831088+0000","last_active":"2023-08-31T19:26:22.836654+0000","last_peered":"2023-08-31T19:26:22.836654+0000","last_clean":"2023-08-31T19:26:22.836654+0000","last_became_active":"2023-08-31T19:26:22.830806+0000","last_became_peered":"2023-08-31T19:26:22.830806+0000","last_unstale":"2023-08-31T19:26:22.836654+0000","last_undegraded":"2023-08-31T19:26:22.836654+0000","last_fullsized":"2023-08-31T19:26:22.836654+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.293563+0000","last_change":"2023-08-31T19:26:23.293563+0000","last_active":"2023-08-31T19:26:23.293563+0000","last_peered":"2023-08-31T19:26:23.293563+0000","last_clean":"2023-08-31T19:26:23.293563+0000","last_became_active":"2023-08-31T19:26:23.293269+0000","last_became_peered":"2023-08-31T19:26:23.293269+0000","last_unstale":"2023-08-31T19:26:23.293563+0000","last_undegraded":"2023-08-31T19:26:23.293563+0000","last_fullsized":"2023-08-31T19:26:23.293563+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.275688+0000","last_change":"2023-08-31T19:26:22.820874+0000","last_active":"2023-08-31T19:26:23.275688+0000","last_peered":"2023-08-31T19:26:23.275688+0000","last_clean":"2023-08-31T19:26:23.275688+0000","last_became_active":"2023-08-31T19:26:22.820248+0000","last_became_peered":"2023-08-31T19:26:22.820248+0000","last_unstale":"2023-08-31T19:26:23.275688+0000","last_undegraded":"2023-08-31T19:26:23.275688+0000","last_fullsized":"2023-08-31T19:26:23.275688+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:26:22.794300+0000","last_change":"2023-08-31T19:26:22.794300+0000","last_active":"2023-08-31T19:26:22.794300+0000","last_peered":"2023-08-31T19:26:22.794300+0000","last_clean":"2023-08-31T19:26:22.794300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:26:22.794300+0000","last_undegraded":"2023-08-31T19:26:22.794300+0000","last_fullsized":"2023-08-31T19:26:22.794300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:26:21.786879+0000","last_change":"2023-08-31T19:26:21.786879+0000","last_active":"2023-08-31T19:26:21.786879+0000","last_peered":"2023-08-31T19:26:21.786879+0000","last_clean":"2023-08-31T19:26:21.786879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:26:21.786879+0000","last_undegraded":"2023-08-31T19:26:21.786879+0000","last_fullsized":"2023-08-31T19:26:21.786879+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.289846+0000","last_change":"2023-08-31T19:26:23.289846+0000","last_active":"2023-08-31T19:26:23.289846+0000","last_peered":"2023-08-31T19:26:23.289846+0000","last_clean":"2023-08-31T19:26:23.289846+0000","last_became_active":"2023-08-31T19:26:23.289561+0000","last_became_peered":"2023-08-31T19:26:23.289561+0000","last_unstale":"2023-08-31T19:26:23.289846+0000","last_undegraded":"2023-08-31T19:26:23.289846+0000","last_fullsized":"2023-08-31T19:26:23.289846+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"194'2","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.302481+0000","last_change":"2023-08-31T19:26:22.824982+0000","last_active":"2023-08-31T19:26:23.302481+0000","last_peered":"2023-08-31T19:26:23.302481+0000","last_clean":"2023-08-31T19:26:23.302481+0000","last_became_active":"2023-08-31T19:26:22.824690+0000","last_became_peered":"2023-08-31T19:26:22.824690+0000","last_unstale":"2023-08-31T19:26:23.302481+0000","last_undegraded":"2023-08-31T19:26:23.302481+0000","last_fullsized":"2023-08-31T19:26:23.302481+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300861+0000","last_change":"2023-08-31T19:26:23.292667+0000","last_active":"2023-08-31T19:26:23.300861+0000","last_peered":"2023-08-31T19:26:23.300861+0000","last_clean":"2023-08-31T19:26:23.300861+0000","last_became_active":"2023-08-31T19:26:23.292257+0000","last_became_peered":"2023-08-31T19:26:23.292257+0000","last_unstale":"2023-08-31T19:26:23.300861+0000","last_undegraded":"2023-08-31T19:26:23.300861+0000","last_fullsized":"2023-08-31T19:26:23.300861+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.279801+0000","last_change":"2023-08-31T19:26:22.827685+0000","last_active":"2023-08-31T19:26:23.279801+0000","last_peered":"2023-08-31T19:26:23.279801+0000","last_clean":"2023-08-31T19:26:23.279801+0000","last_became_active":"2023-08-31T19:26:22.827129+0000","last_became_peered":"2023-08-31T19:26:22.827129+0000","last_unstale":"2023-08-31T19:26:23.279801+0000","last_undegraded":"2023-08-31T19:26:23.279801+0000","last_fullsized":"2023-08-31T19:26:23.279801+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.292760+0000","last_change":"2023-08-31T19:26:23.289471+0000","last_active":"2023-08-31T19:26:23.292760+0000","last_peered":"2023-08-31T19:26:23.292760+0000","last_clean":"2023-08-31T19:26:23.292760+0000","last_became_active":"2023-08-31T19:26:23.289200+0000","last_became_peered":"2023-08-31T19:26:23.289200+0000","last_unstale":"2023-08-31T19:26:23.292760+0000","last_undegraded":"2023-08-31T19:26:23.292760+0000","last_fullsized":"2023-08-31T19:26:23.292760+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.283127+0000","last_change":"2023-08-31T19:26:22.828005+0000","last_active":"2023-08-31T19:26:23.283127+0000","last_peered":"2023-08-31T19:26:23.283127+0000","last_clean":"2023-08-31T19:26:23.283127+0000","last_became_active":"2023-08-31T19:26:22.827702+0000","last_became_peered":"2023-08-31T19:26:22.827702+0000","last_unstale":"2023-08-31T19:26:23.283127+0000","last_undegraded":"2023-08-31T19:26:23.283127+0000","last_fullsized":"2023-08-31T19:26:23.283127+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300381+0000","last_change":"2023-08-31T19:26:23.292505+0000","last_active":"2023-08-31T19:26:23.300381+0000","last_peered":"2023-08-31T19:26:23.300381+0000","last_clean":"2023-08-31T19:26:23.300381+0000","last_became_active":"2023-08-31T19:26:23.292227+0000","last_became_peered":"2023-08-31T19:26:23.292227+0000","last_unstale":"2023-08-31T19:26:23.300381+0000","last_undegraded":"2023-08-31T19:26:23.300381+0000","last_fullsized":"2023-08-31T19:26:23.300381+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.276080+0000","last_change":"2023-08-31T19:26:22.834437+0000","last_active":"2023-08-31T19:26:23.276080+0000","last_peered":"2023-08-31T19:26:23.276080+0000","last_clean":"2023-08-31T19:26:23.276080+0000","last_became_active":"2023-08-31T19:26:22.834114+0000","last_became_peered":"2023-08-31T19:26:22.834114+0000","last_unstale":"2023-08-31T19:26:23.276080+0000","last_undegraded":"2023-08-31T19:26:23.276080+0000","last_fullsized":"2023-08-31T19:26:23.276080+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312389+0000","last_change":"2023-08-31T19:26:23.306688+0000","last_active":"2023-08-31T19:26:23.312389+0000","last_peered":"2023-08-31T19:26:23.312389+0000","last_clean":"2023-08-31T19:26:23.312389+0000","last_became_active":"2023-08-31T19:26:23.306262+0000","last_became_peered":"2023-08-31T19:26:23.306262+0000","last_unstale":"2023-08-31T19:26:23.312389+0000","last_undegraded":"2023-08-31T19:26:23.312389+0000","last_fullsized":"2023-08-31T19:26:23.312389+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.293044+0000","last_change":"2023-08-31T19:26:22.833476+0000","last_active":"2023-08-31T19:26:23.293044+0000","last_peered":"2023-08-31T19:26:23.293044+0000","last_clean":"2023-08-31T19:26:23.293044+0000","last_became_active":"2023-08-31T19:26:22.833186+0000","last_became_peered":"2023-08-31T19:26:22.833186+0000","last_unstale":"2023-08-31T19:26:23.293044+0000","last_undegraded":"2023-08-31T19:26:23.293044+0000","last_fullsized":"2023-08-31T19:26:23.293044+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:26:22.794300+0000","last_change":"2023-08-31T19:26:22.794300+0000","last_active":"2023-08-31T19:26:22.794300+0000","last_peered":"2023-08-31T19:26:22.794300+0000","last_clean":"2023-08-31T19:26:22.794300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:26:22.794300+0000","last_undegraded":"2023-08-31T19:26:22.794300+0000","last_fullsized":"2023-08-31T19:26:22.794300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280499+0000","last_change":"2023-08-31T19:26:22.829586+0000","last_active":"2023-08-31T19:26:23.280499+0000","last_peered":"2023-08-31T19:26:23.280499+0000","last_clean":"2023-08-31T19:26:23.280499+0000","last_became_active":"2023-08-31T19:26:22.828746+0000","last_became_peered":"2023-08-31T19:26:22.828746+0000","last_unstale":"2023-08-31T19:26:23.280499+0000","last_undegraded":"2023-08-31T19:26:23.280499+0000","last_fullsized":"2023-08-31T19:26:23.280499+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.305475+0000","last_change":"2023-08-31T19:26:23.303619+0000","last_active":"2023-08-31T19:26:23.305475+0000","last_peered":"2023-08-31T19:26:23.305475+0000","last_clean":"2023-08-31T19:26:23.305475+0000","last_became_active":"2023-08-31T19:26:23.303323+0000","last_became_peered":"2023-08-31T19:26:23.303323+0000","last_unstale":"2023-08-31T19:26:23.305475+0000","last_undegraded":"2023-08-31T19:26:23.305475+0000","last_fullsized":"2023-08-31T19:26:23.305475+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.822497+0000","last_change":"2023-08-31T19:26:22.820586+0000","last_active":"2023-08-31T19:26:22.822497+0000","last_peered":"2023-08-31T19:26:22.822497+0000","last_clean":"2023-08-31T19:26:22.822497+0000","last_became_active":"2023-08-31T19:26:22.820305+0000","last_became_peered":"2023-08-31T19:26:22.820305+0000","last_unstale":"2023-08-31T19:26:22.822497+0000","last_undegraded":"2023-08-31T19:26:22.822497+0000","last_fullsized":"2023-08-31T19:26:22.822497+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.292237+0000","last_change":"2023-08-31T19:26:23.288674+0000","last_active":"2023-08-31T19:26:23.292237+0000","last_peered":"2023-08-31T19:26:23.292237+0000","last_clean":"2023-08-31T19:26:23.292237+0000","last_became_active":"2023-08-31T19:26:23.288403+0000","last_became_peered":"2023-08-31T19:26:23.288403+0000","last_unstale":"2023-08-31T19:26:23.292237+0000","last_undegraded":"2023-08-31T19:26:23.292237+0000","last_fullsized":"2023-08-31T19:26:23.292237+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.831369+0000","last_change":"2023-08-31T19:26:22.827474+0000","last_active":"2023-08-31T19:26:22.831369+0000","last_peered":"2023-08-31T19:26:22.831369+0000","last_clean":"2023-08-31T19:26:22.831369+0000","last_became_active":"2023-08-31T19:26:22.826814+0000","last_became_peered":"2023-08-31T19:26:22.826814+0000","last_unstale":"2023-08-31T19:26:22.831369+0000","last_undegraded":"2023-08-31T19:26:22.831369+0000","last_fullsized":"2023-08-31T19:26:22.831369+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.288423+0000","last_change":"2023-08-31T19:26:23.288423+0000","last_active":"2023-08-31T19:26:23.288423+0000","last_peered":"2023-08-31T19:26:23.288423+0000","last_clean":"2023-08-31T19:26:23.288423+0000","last_became_active":"2023-08-31T19:26:23.288114+0000","last_became_peered":"2023-08-31T19:26:23.288114+0000","last_unstale":"2023-08-31T19:26:23.288423+0000","last_undegraded":"2023-08-31T19:26:23.288423+0000","last_fullsized":"2023-08-31T19:26:23.288423+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.836259+0000","last_change":"2023-08-31T19:26:22.828056+0000","last_active":"2023-08-31T19:26:22.836259+0000","last_peered":"2023-08-31T19:26:22.836259+0000","last_clean":"2023-08-31T19:26:22.836259+0000","last_became_active":"2023-08-31T19:26:22.827759+0000","last_became_peered":"2023-08-31T19:26:22.827759+0000","last_unstale":"2023-08-31T19:26:22.836259+0000","last_undegraded":"2023-08-31T19:26:22.836259+0000","last_fullsized":"2023-08-31T19:26:22.836259+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":176,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.281461+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:26:23.281461+0000","last_peered":"2023-08-31T19:26:23.281461+0000","last_clean":"2023-08-31T19:26:23.281461+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:26:23.281461+0000","last_undegraded":"2023-08-31T19:26:23.281461+0000","last_fullsized":"2023-08-31T19:26:23.281461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:26:22.794300+0000","last_change":"2023-08-31T19:26:22.794300+0000","last_active":"2023-08-31T19:26:22.794300+0000","last_peered":"2023-08-31T19:26:22.794300+0000","last_clean":"2023-08-31T19:26:22.794300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:26:22.794300+0000","last_undegraded":"2023-08-31T19:26:22.794300+0000","last_fullsized":"2023-08-31T19:26:22.794300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.279768+0000","last_change":"2023-08-31T19:26:22.826969+0000","last_active":"2023-08-31T19:26:23.279768+0000","last_peered":"2023-08-31T19:26:23.279768+0000","last_clean":"2023-08-31T19:26:23.279768+0000","last_became_active":"2023-08-31T19:26:22.826658+0000","last_became_peered":"2023-08-31T19:26:22.826658+0000","last_unstale":"2023-08-31T19:26:23.279768+0000","last_undegraded":"2023-08-31T19:26:23.279768+0000","last_fullsized":"2023-08-31T19:26:23.279768+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":164,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.815474+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:26:22.815474+0000","last_peered":"2023-08-31T19:26:22.815474+0000","last_clean":"2023-08-31T19:26:22.815474+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:26:22.815474+0000","last_undegraded":"2023-08-31T19:26:22.815474+0000","last_fullsized":"2023-08-31T19:26:22.815474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.296756+0000","last_change":"2023-08-31T19:26:23.294412+0000","last_active":"2023-08-31T19:26:23.296756+0000","last_peered":"2023-08-31T19:26:23.296756+0000","last_clean":"2023-08-31T19:26:23.296756+0000","last_became_active":"2023-08-31T19:26:23.294119+0000","last_became_peered":"2023-08-31T19:26:23.294119+0000","last_unstale":"2023-08-31T19:26:23.296756+0000","last_undegraded":"2023-08-31T19:26:23.296756+0000","last_fullsized":"2023-08-31T19:26:23.296756+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"194'2","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.301785+0000","last_change":"2023-08-31T19:26:22.828582+0000","last_active":"2023-08-31T19:26:23.301785+0000","last_peered":"2023-08-31T19:26:23.301785+0000","last_clean":"2023-08-31T19:26:23.301785+0000","last_became_active":"2023-08-31T19:26:22.828315+0000","last_became_peered":"2023-08-31T19:26:22.828315+0000","last_unstale":"2023-08-31T19:26:23.301785+0000","last_undegraded":"2023-08-31T19:26:23.301785+0000","last_fullsized":"2023-08-31T19:26:23.301785+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.275588+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:26:23.275588+0000","last_peered":"2023-08-31T19:26:23.275588+0000","last_clean":"2023-08-31T19:26:23.275588+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:26:23.275588+0000","last_undegraded":"2023-08-31T19:26:23.275588+0000","last_fullsized":"2023-08-31T19:26:23.275588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:26:22.794300+0000","last_change":"2023-08-31T19:26:22.794300+0000","last_active":"2023-08-31T19:26:22.794300+0000","last_peered":"2023-08-31T19:26:22.794300+0000","last_clean":"2023-08-31T19:26:22.794300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:26:22.794300+0000","last_undegraded":"2023-08-31T19:26:22.794300+0000","last_fullsized":"2023-08-31T19:26:22.794300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.279689+0000","last_change":"2023-08-31T19:26:22.827396+0000","last_active":"2023-08-31T19:26:23.279689+0000","last_peered":"2023-08-31T19:26:23.279689+0000","last_clean":"2023-08-31T19:26:23.279689+0000","last_became_active":"2023-08-31T19:26:22.826820+0000","last_became_peered":"2023-08-31T19:26:22.826820+0000","last_unstale":"2023-08-31T19:26:23.279689+0000","last_undegraded":"2023-08-31T19:26:23.279689+0000","last_fullsized":"2023-08-31T19:26:23.279689+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":164,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.814467+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:26:22.814467+0000","last_peered":"2023-08-31T19:26:22.814467+0000","last_clean":"2023-08-31T19:26:22.814467+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:26:22.814467+0000","last_undegraded":"2023-08-31T19:26:22.814467+0000","last_fullsized":"2023-08-31T19:26:22.814467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":160,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-31T19:26:18.261609+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:26:18.261609+0000","last_peered":"2023-08-31T19:26:18.261609+0000","last_clean":"2023-08-31T19:26:18.261609+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:26:18.261609+0000","last_undegraded":"2023-08-31T19:26:18.261609+0000","last_fullsized":"2023-08-31T19:26:18.261609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.305377+0000","last_change":"2023-08-31T19:26:23.301959+0000","last_active":"2023-08-31T19:26:23.305377+0000","last_peered":"2023-08-31T19:26:23.305377+0000","last_clean":"2023-08-31T19:26:23.305377+0000","last_became_active":"2023-08-31T19:26:23.301665+0000","last_became_peered":"2023-08-31T19:26:23.301665+0000","last_unstale":"2023-08-31T19:26:23.305377+0000","last_undegraded":"2023-08-31T19:26:23.305377+0000","last_fullsized":"2023-08-31T19:26:23.305377+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"194'3","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.309734+0000","last_change":"2023-08-31T19:26:22.824836+0000","last_active":"2023-08-31T19:26:23.309734+0000","last_peered":"2023-08-31T19:26:23.309734+0000","last_clean":"2023-08-31T19:26:23.309734+0000","last_became_active":"2023-08-31T19:26:22.824502+0000","last_became_peered":"2023-08-31T19:26:22.824502+0000","last_unstale":"2023-08-31T19:26:23.309734+0000","last_undegraded":"2023-08-31T19:26:23.309734+0000","last_fullsized":"2023-08-31T19:26:23.309734+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":159,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-31T19:26:18.261621+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:26:18.261621+0000","last_peered":"2023-08-31T19:26:18.261621+0000","last_clean":"2023-08-31T19:26:18.261621+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:26:18.261621+0000","last_undegraded":"2023-08-31T19:26:18.261621+0000","last_fullsized":"2023-08-31T19:26:18.261621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.305615+0000","last_change":"2023-08-31T19:26:23.303892+0000","last_active":"2023-08-31T19:26:23.305615+0000","last_peered":"2023-08-31T19:26:23.305615+0000","last_clean":"2023-08-31T19:26:23.305615+0000","last_became_active":"2023-08-31T19:26:23.303610+0000","last_became_peered":"2023-08-31T19:26:23.303610+0000","last_unstale":"2023-08-31T19:26:23.305615+0000","last_undegraded":"2023-08-31T19:26:23.305615+0000","last_fullsized":"2023-08-31T19:26:23.305615+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"194'4","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.302553+0000","last_change":"2023-08-31T19:26:22.826221+0000","last_active":"2023-08-31T19:26:23.302553+0000","last_peered":"2023-08-31T19:26:23.302553+0000","last_clean":"2023-08-31T19:26:23.302553+0000","last_became_active":"2023-08-31T19:26:22.825941+0000","last_became_peered":"2023-08-31T19:26:22.825941+0000","last_unstale":"2023-08-31T19:26:23.302553+0000","last_undegraded":"2023-08-31T19:26:23.302553+0000","last_fullsized":"2023-08-31T19:26:23.302553+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":159,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-31T19:26:18.261632+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:26:18.261632+0000","last_peered":"2023-08-31T19:26:18.261632+0000","last_clean":"2023-08-31T19:26:18.261632+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:26:18.261632+0000","last_undegraded":"2023-08-31T19:26:18.261632+0000","last_fullsized":"2023-08-31T19:26:18.261632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.304933+0000","last_change":"2023-08-31T19:26:23.299676+0000","last_active":"2023-08-31T19:26:23.304933+0000","last_peered":"2023-08-31T19:26:23.304933+0000","last_clean":"2023-08-31T19:26:23.304933+0000","last_became_active":"2023-08-31T19:26:23.299345+0000","last_became_peered":"2023-08-31T19:26:23.299345+0000","last_unstale":"2023-08-31T19:26:23.304933+0000","last_undegraded":"2023-08-31T19:26:23.304933+0000","last_fullsized":"2023-08-31T19:26:23.304933+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"194'1","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.273707+0000","last_change":"2023-08-31T19:26:22.825210+0000","last_active":"2023-08-31T19:26:23.273707+0000","last_peered":"2023-08-31T19:26:23.273707+0000","last_clean":"2023-08-31T19:26:23.273707+0000","last_became_active":"2023-08-31T19:26:22.824900+0000","last_became_peered":"2023-08-31T19:26:22.824900+0000","last_unstale":"2023-08-31T19:26:23.273707+0000","last_undegraded":"2023-08-31T19:26:23.273707+0000","last_fullsized":"2023-08-31T19:26:23.273707+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":176,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280414+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:26:23.280414+0000","last_peered":"2023-08-31T19:26:23.280414+0000","last_clean":"2023-08-31T19:26:23.280414+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:26:23.280414+0000","last_undegraded":"2023-08-31T19:26:23.280414+0000","last_fullsized":"2023-08-31T19:26:23.280414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.301011+0000","last_change":"2023-08-31T19:26:23.293108+0000","last_active":"2023-08-31T19:26:23.301011+0000","last_peered":"2023-08-31T19:26:23.301011+0000","last_clean":"2023-08-31T19:26:23.301011+0000","last_became_active":"2023-08-31T19:26:23.292694+0000","last_became_peered":"2023-08-31T19:26:23.292694+0000","last_unstale":"2023-08-31T19:26:23.301011+0000","last_undegraded":"2023-08-31T19:26:23.301011+0000","last_fullsized":"2023-08-31T19:26:23.301011+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280408+0000","last_change":"2023-08-31T19:26:22.829772+0000","last_active":"2023-08-31T19:26:23.280408+0000","last_peered":"2023-08-31T19:26:23.280408+0000","last_clean":"2023-08-31T19:26:23.280408+0000","last_became_active":"2023-08-31T19:26:22.829138+0000","last_became_peered":"2023-08-31T19:26:22.829138+0000","last_unstale":"2023-08-31T19:26:23.280408+0000","last_undegraded":"2023-08-31T19:26:23.280408+0000","last_fullsized":"2023-08-31T19:26:23.280408+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":182,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280210+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:26:23.280210+0000","last_peered":"2023-08-31T19:26:23.280210+0000","last_clean":"2023-08-31T19:26:23.280210+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:26:23.280210+0000","last_undegraded":"2023-08-31T19:26:23.280210+0000","last_fullsized":"2023-08-31T19:26:23.280210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":1752,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":122,"acting":122,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575303,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303524,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068316,"statfs":{"total":96636764160,"available":96325955584,"internally_reserved":0,"allocated":2387968,"data_stored":1300366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.38200000000000001},"max":{"1min":0.90200000000000002,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.54700000000000004},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.98599999999999999},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41199999999999998},"max":{"1min":0.84799999999999998,"5min":0.92000000000000004,"15min":0.999},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.55300000000000005,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.45200000000000001},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68100000000000005,"15min":0.70399999999999996},"min":{"1min":0.55700000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.006},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73399999999999999,"15min":0.746},"min":{"1min":0.56000000000000005,"5min":0.48899999999999999,"15min":0.48599999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.89100000000000001,"15min":0.96499999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.52500000000000002,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"max":{"1min":0.85799999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.748},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90100000000000002,"5min":1.0109999999999999,"15min":1.0449999999999999},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45200000000000001,"15min":0.442},"max":{"1min":0.90200000000000002,"5min":0.96799999999999997,"15min":0.98999999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.47199999999999998,"5min":0.45500000000000002,"15min":0.42999999999999999},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.81599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575303,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307672,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064168,"statfs":{"total":96636764160,"available":96321708032,"internally_reserved":0,"allocated":2441216,"data_stored":1330665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.33800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.05},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0669999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.54200000000000004,"5min":0.502,"15min":0.45500000000000002},"max":{"1min":0.96299999999999997,"5min":1.0149999999999999,"15min":1.1579999999999999},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.745,"15min":0.746},"min":{"1min":0.53600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.198},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.1060000000000001},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90000000000000002,"5min":0.97399999999999998,"15min":1.0089999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77900000000000003,"15min":0.77700000000000002},"min":{"1min":0.57299999999999995,"5min":0.54100000000000004,"15min":0.495},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.296},"last":0.501}]},{"osd":4,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90600000000000003,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.66000000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.43099999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68000000000000005,"15min":0.67800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97899999999999998,"5min":1.032,"15min":1.3280000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.71299999999999997},"min":{"1min":0.54300000000000004,"5min":0.48699999999999999,"15min":0.47299999999999998},"max":{"1min":1.2649999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.73199999999999998,"15min":0.71099999999999997},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.46200000000000002},"max":{"1min":1.1639999999999999,"5min":1.165,"15min":1.165},"last":0.753},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77300000000000002,"15min":0.76200000000000001},"min":{"1min":0.52700000000000002,"5min":0.505,"15min":0.48499999999999999},"max":{"1min":1.117,"5min":1.2270000000000001,"15min":1.24},"last":0.71999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575304,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303580,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068260,"statfs":{"total":96636764160,"available":96325898240,"internally_reserved":0,"allocated":2445312,"data_stored":1330417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.45000000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.66100000000000003,"15min":0.68100000000000005},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.35099999999999998,"5min":0.317,"15min":0.31},"max":{"1min":0.61699999999999999,"5min":0.71799999999999997,"15min":0.76400000000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.496,"15min":0.51800000000000002},"min":{"1min":0.39800000000000002,"5min":0.36399999999999999,"15min":0.31},"max":{"1min":0.752,"5min":0.752,"15min":0.75800000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.35199999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.83799999999999997},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68600000000000005,"5min":0.77100000000000002,"15min":0.79200000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.96699999999999997},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.55700000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.169,"15min":1.1839999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.80400000000000005,"15min":0.82799999999999996},"min":{"1min":0.622,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78800000000000003},"min":{"1min":0.57299999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.262},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.75700000000000001,"15min":0.78800000000000003},"min":{"1min":0.621,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.165,"5min":1.198,"15min":1.198},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.58299999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.115,"5min":1.115,"15min":1.2849999999999999},"last":0.747}]},{"osd":7,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.77500000000000002,"15min":0.80000000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.085,"5min":1.097,"15min":1.224},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.59499999999999997,"5min":0.53300000000000003,"15min":0.51000000000000001},"max":{"1min":1.0569999999999999,"5min":1.1579999999999999,"15min":1.1859999999999999},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575303,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303564,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068276,"statfs":{"total":96636764160,"available":96325914624,"internally_reserved":0,"allocated":2428928,"data_stored":1322447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67000000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73299999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":0.72899999999999998,"15min":0.77000000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.751,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.442}]},{"osd":3,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.373,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64400000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.376},"max":{"1min":0.71899999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.63500000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.872,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.60999999999999999,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.347},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.75700000000000001,"15min":0.76900000000000002},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79900000000000004,"15min":0.80500000000000005},"min":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.21},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.83499999999999996,"15min":0.83999999999999997},"min":{"1min":0.67100000000000004,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.87}]},{"osd":7,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.24},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.65700000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.3340000000000001},"last":0.88600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575303,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303564,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068276,"statfs":{"total":96636764160,"available":96325914624,"internally_reserved":0,"allocated":2428928,"data_stored":1322483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.502,"15min":0.501},"min":{"1min":0.35499999999999998,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.77600000000000002},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Aug 31 19:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35099999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.81899999999999995},"last":0.432},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.38900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73299999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51600000000000001,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68799999999999994,"5min":0.72799999999999998,"15min":0.73099999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.433,"5min":0.42299999999999999,"15min":0.39900000000000002},"max":{"1min":0.71599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80600000000000005,"15min":0.79400000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0940000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.745},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79600000000000004,"15min":0.79500000000000004},"min":{"1min":0.63600000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.079,"5min":1.1040000000000001,"15min":1.304},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51300000000000001},"max":{"1min":1.1659999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81999999999999995,"15min":0.81000000000000005},"min":{"1min":0.67300000000000004,"5min":0.58499999999999996,"15min":0.58299999999999996},"max":{"1min":1.0489999999999999,"5min":1.2030000000000001,"15min":1.256},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.82699999999999996,"15min":0.81799999999999995},"min":{"1min":0.625,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1240000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81399999999999995,"15min":0.81499999999999995},"min":{"1min":0.57199999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1240000000000001,"5min":1.2310000000000001,"15min":1.27},"last":0.874}]},{"osd":7,"last update":"Thu Aug 31 19:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.83499999999999996,"15min":0.82499999999999996},"min":{"1min":0.63500000000000001,"5min":0.56299999999999994,"15min":0.54400000000000004},"max":{"1min":1.111,"5min":1.302,"15min":1.302},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83099999999999996,"15min":0.83199999999999996},"min":{"1min":0.60399999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.097,"5min":1.3280000000000001,"15min":1.3740000000000001},"last":0.80500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575303,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307680,"kb_used_data":2392,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064160,"statfs":{"total":96636764160,"available":96321699840,"internally_reserved":0,"allocated":2449408,"data_stored":1330439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.437,"15min":0.443},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59799999999999998,"5min":0.69099999999999995,"15min":0.71899999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.65800000000000003,"5min":0.72099999999999997,"15min":0.77600000000000002},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.35599999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65500000000000003,"5min":0.66800000000000004,"15min":0.77600000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.46700000000000003,"5min":0.41699999999999998,"15min":0.379},"max":{"1min":0.73099999999999998,"5min":0.82499999999999996,"15min":0.90400000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.88300000000000001,"15min":0.95399999999999996},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78200000000000003,"15min":0.76400000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1739999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.78200000000000003,"15min":0.77300000000000002},"min":{"1min":0.61899999999999999,"5min":0.56399999999999995,"15min":0.47899999999999998},"max":{"1min":1.1120000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63}]},{"osd":5,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.67000000000000004,"5min":0.53800000000000003,"15min":0.52400000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.6839999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.505},"max":{"1min":1.008,"5min":1.149,"15min":1.1819999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80800000000000005,"15min":0.80100000000000005},"min":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.153,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.79700000000000004,"15min":0.79900000000000004},"min":{"1min":0.61199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.2849999999999999},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81000000000000005,"15min":0.80900000000000005},"min":{"1min":0.64900000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.381},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81599999999999995,"15min":0.80900000000000005},"min":{"1min":0.70699999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2410000000000001,"5min":1.244,"15min":1.244},"last":0.72299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575303,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303584,"kb_used_data":2392,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068256,"statfs":{"total":96636764160,"available":96325894144,"internally_reserved":0,"allocated":2449408,"data_stored":1329955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88100000000000001,"5min":0.95899999999999996,"15min":1.048},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.51800000000000002,"5min":0.45500000000000002,"15min":0.38500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.98199999999999998},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.495,"5min":0.49099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90100000000000002,"5min":0.98699999999999999,"15min":1.0289999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71899999999999997,"15min":0.72799999999999998},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.93100000000000005,"5min":0.995,"15min":1},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98199999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.51600000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.996},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.72499999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91200000000000003,"5min":0.95699999999999996,"15min":0.97699999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.753,"15min":0.755},"min":{"1min":0.56899999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94899999999999995,"5min":1.056,"15min":1.056},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.40699999999999997,"15min":0.39600000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95799999999999996},"last":0.624},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.442,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":0.82199999999999995,"5min":0.91900000000000004,"15min":0.98799999999999999},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.45700000000000002,"5min":0.44700000000000001,"15min":0.42299999999999999},"max":{"1min":0.80900000000000005,"5min":1.01,"15min":1.0649999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.498,"5min":0.46500000000000002,"15min":0.46300000000000002},"max":{"1min":0.91500000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.94899999999999995,"15min":1.0049999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.46300000000000002},"max":{"1min":0.94599999999999995,"5min":1.0369999999999999,"15min":1.115},"last":0.73699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575303,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303572,"kb_used_data":2380,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068268,"statfs":{"total":96636764160,"available":96325906432,"internally_reserved":0,"allocated":2437120,"data_stored":1323091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.72499999999999998},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.41099999999999998},"max":{"1min":0.89000000000000001,"5min":1.141,"15min":1.141},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89700000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86899999999999999,"5min":1.103,"15min":1.103},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92800000000000005,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":0.72499999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86699999999999999,"5min":1.026,"15min":1.026},"last":0.442},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":0.91100000000000003,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.747,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51400000000000001},"max":{"1min":0.89900000000000002,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96299999999999997,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.627,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.379},"max":{"1min":0.78100000000000003,"5min":0.997,"15min":0.997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.64700000000000002,"15min":0.63200000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.41299999999999998},"max":{"1min":0.84999999999999998,"5min":1.117,"15min":1.117},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.48399999999999999,"5min":0.44700000000000001,"15min":0.40000000000000002},"max":{"1min":0.81699999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70499999999999996,"15min":0.69499999999999995},"min":{"1min":0.52500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93500000000000005,"5min":1.2,"15min":1.2},"last":0.62}]},{"osd":7,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70899999999999996,"15min":0.70799999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47799999999999998},"max":{"1min":0.82399999999999995,"5min":1.202,"15min":1.202},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.48699999999999999},"max":{"1min":0.878,"5min":1.004,"15min":1.004},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:26:27.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:26:27.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.775+0000 7f7bca9ff700 1 Processor -- start 2023-08-31T19:26:27.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.775+0000 7f7bca9ff700 1 -- start start 2023-08-31T19:26:27.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.777+0000 7f7bca9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7bc4154060 0x7f7bc4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:27.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.777+0000 7f7bca9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7bc41588d0 0x7f7bc4154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:27.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.777+0000 7f7bca9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc40c6120 con 0x7f7bc40cb9b0 2023-08-31T19:26:27.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.777+0000 7f7bca9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc40c1380 con 0x7f7bc4154060 2023-08-31T19:26:27.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.777+0000 7f7bca9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc40c5e10 con 0x7f7bc41588d0 2023-08-31T19:26:27.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.777+0000 7f7bc3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7bc4154060 0x7f7bc4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:27.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.777+0000 7f7bc3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7bc4154060 0x7f7bc4157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59176/0 (socket says 172.21.15.72:59176) 2023-08-31T19:26:27.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.777+0000 7f7bc3fff700 1 -- 172.21.15.72:0/778932005 learned_addr learned my addr 172.21.15.72:0/778932005 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:27.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.777+0000 7f7bc8f9c700 1 --2- 172.21.15.72:0/778932005 >> v2:172.21.15.146:3300/0 conn(0x7f7bc41588d0 0x7f7bc4154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.778+0000 7f7bc3fff700 1 -- 172.21.15.72:0/778932005 >> v2:172.21.15.146:3300/0 conn(0x7f7bc41588d0 msgr2=0x7f7bc4154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.778+0000 7f7bc3fff700 1 --2- 172.21.15.72:0/778932005 >> v2:172.21.15.146:3300/0 conn(0x7f7bc41588d0 0x7f7bc4154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.778+0000 7f7bc3fff700 1 -- 172.21.15.72:0/778932005 >> v1:172.21.15.146:6789/0 conn(0x7f7bc40cb9b0 legacy=0x7f7bc41581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.778+0000 7f7bc3fff700 1 -- 172.21.15.72:0/778932005 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc40c0ae0 con 0x7f7bc4154060 2023-08-31T19:26:27.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.778+0000 7f7bc3fff700 1 --2- 172.21.15.72:0/778932005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc4154060 0x7f7bc4157cd0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f7bc40844d0 tx=0x7f7bb4009060).ready entity=mon.0 client_cookie=5b06443a84bb0c60 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:27.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.778+0000 7f7bc2ffd700 1 -- 172.21.15.72:0/778932005 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4005880 con 0x7f7bc4154060 2023-08-31T19:26:27.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.778+0000 7f7bc2ffd700 1 -- 172.21.15.72:0/778932005 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb40059e0 con 0x7f7bc4154060 2023-08-31T19:26:27.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.778+0000 7f7bc2ffd700 1 -- 172.21.15.72:0/778932005 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4005d60 con 0x7f7bc4154060 2023-08-31T19:26:27.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.779+0000 7f7bca9ff700 1 -- 172.21.15.72:0/778932005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc4154060 msgr2=0x7f7bc4157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:27.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.779+0000 7f7bca9ff700 1 --2- 172.21.15.72:0/778932005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc4154060 0x7f7bc4157cd0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f7bc40844d0 tx=0x7f7bb4009060).stop 2023-08-31T19:26:27.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.779+0000 7f7bca9ff700 1 -- 172.21.15.72:0/778932005 shutdown_connections 2023-08-31T19:26:27.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.779+0000 7f7bca9ff700 1 --2- 172.21.15.72:0/778932005 >> v2:172.21.15.146:3300/0 conn(0x7f7bc41588d0 0x7f7bc4154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.779+0000 7f7bca9ff700 1 --2- 172.21.15.72:0/778932005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc4154060 0x7f7bc4157cd0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.779+0000 7f7bca9ff700 1 -- 172.21.15.72:0/778932005 >> 172.21.15.72:0/778932005 conn(0x7f7bc405e870 msgr2=0x7f7bc40cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:27.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.779+0000 7f7bca9ff700 1 -- 172.21.15.72:0/778932005 shutdown_connections 2023-08-31T19:26:27.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.779+0000 7f7bca9ff700 1 -- 172.21.15.72:0/778932005 wait complete. 2023-08-31T19:26:27.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.780+0000 7f7bca9ff700 1 Processor -- start 2023-08-31T19:26:27.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.780+0000 7f7bca9ff700 1 -- start start 2023-08-31T19:26:27.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.781+0000 7f7bca9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc40cb9b0 0x7f7bc40ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:27.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.781+0000 7f7bca9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc4154060 0x7f7bc4150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:27.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.781+0000 7f7bca9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bc41588d0 0x7f7bc4155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:27.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.781+0000 7f7bca9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc41567d0 con 0x7f7bc40cb9b0 2023-08-31T19:26:27.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.781+0000 7f7bca9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40ae250 con 0x7f7bc41588d0 2023-08-31T19:26:27.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.781+0000 7f7bca9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc4156210 con 0x7f7bc4154060 2023-08-31T19:26:27.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.782+0000 7f7bc3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc40cb9b0 0x7f7bc40ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:27.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.782+0000 7f7bc3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc40cb9b0 0x7f7bc40ae6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59180/0 (socket says 172.21.15.72:59180) 2023-08-31T19:26:27.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.782+0000 7f7bc3fff700 1 -- 172.21.15.72:0/2254847129 learned_addr learned my addr 172.21.15.72:0/2254847129 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:27.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.782+0000 7f7bc8f9c700 1 --2- 172.21.15.72:0/2254847129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bc41588d0 0x7f7bc4155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:27.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.782+0000 7f7bc37fe700 1 --2- 172.21.15.72:0/2254847129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc4154060 0x7f7bc4150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:27.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.782+0000 7f7bc3fff700 1 -- 172.21.15.72:0/2254847129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc4154060 msgr2=0x7f7bc4150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:27.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.782+0000 7f7bc3fff700 1 --2- 172.21.15.72:0/2254847129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc4154060 0x7f7bc4150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.782+0000 7f7bc3fff700 1 -- 172.21.15.72:0/2254847129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bc41588d0 msgr2=0x7f7bc4155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:27.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.782+0000 7f7bc3fff700 1 --2- 172.21.15.72:0/2254847129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bc41588d0 0x7f7bc4155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.782+0000 7f7bc3fff700 1 -- 172.21.15.72:0/2254847129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb4009300 con 0x7f7bc40cb9b0 2023-08-31T19:26:27.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.782+0000 7f7bc3fff700 1 --2- 172.21.15.72:0/2254847129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc40cb9b0 0x7f7bc40ae6e0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7f7bc4083570 tx=0x7f7bb4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:27.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.782+0000 7f7babfff700 1 -- 172.21.15.72:0/2254847129 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb400b600 con 0x7f7bc40cb9b0 2023-08-31T19:26:27.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.783+0000 7f7babfff700 1 -- 172.21.15.72:0/2254847129 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb400b760 con 0x7f7bc40cb9b0 2023-08-31T19:26:27.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.783+0000 7f7bca9ff700 1 -- 172.21.15.72:0/2254847129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc41564f0 con 0x7f7bc40cb9b0 2023-08-31T19:26:27.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.783+0000 7f7babfff700 1 -- 172.21.15.72:0/2254847129 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb400bae0 con 0x7f7bc40cb9b0 2023-08-31T19:26:27.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.783+0000 7f7bca9ff700 1 -- 172.21.15.72:0/2254847129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc40aebd0 con 0x7f7bc40cb9b0 2023-08-31T19:26:27.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.784+0000 7f7bca9ff700 1 -- 172.21.15.72:0/2254847129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc40add40 con 0x7f7bc40cb9b0 2023-08-31T19:26:27.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.785+0000 7f7babfff700 1 -- 172.21.15.72:0/2254847129 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7bb4018070 con 0x7f7bc40cb9b0 2023-08-31T19:26:27.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.785+0000 7f7babfff700 1 --2- 172.21.15.72:0/2254847129 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7bb005ef30 0x7f7bb00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:27.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.785+0000 7f7babfff700 1 -- 172.21.15.72:0/2254847129 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f7bb407b370 con 0x7f7bc40cb9b0 2023-08-31T19:26:27.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.786+0000 7f7bc37fe700 1 --2- 172.21.15.72:0/2254847129 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7bb005ef30 0x7f7bb00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:27.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.786+0000 7f7bc37fe700 1 --2- 172.21.15.72:0/2254847129 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7bb005ef30 0x7f7bb00613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7bc40adae0 tx=0x7f7bb8007d40).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:27.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.789+0000 7f7babfff700 1 -- 172.21.15.72:0/2254847129 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7bc40add40 con 0x7f7bc40cb9b0 2023-08-31T19:26:27.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.956+0000 7f7bca9ff700 1 -- 172.21.15.72:0/2254847129 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7bc40add40 con 0x7f7bb005ef30 2023-08-31T19:26:27.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.966+0000 7f7babfff700 1 -- 172.21.15.72:0/2254847129 <== mgr.7463 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361887 (secure 0 0 0) 0x7f7bc40add40 con 0x7f7bb005ef30 2023-08-31T19:26:27.971 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:27.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.970+0000 7f7bca9ff700 1 -- 172.21.15.72:0/2254847129 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7bb005ef30 msgr2=0x7f7bb00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:27.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.970+0000 7f7bca9ff700 1 --2- 172.21.15.72:0/2254847129 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7bb005ef30 0x7f7bb00613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7bc40adae0 tx=0x7f7bb8007d40).stop 2023-08-31T19:26:27.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.970+0000 7f7bca9ff700 1 -- 172.21.15.72:0/2254847129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc40cb9b0 msgr2=0x7f7bc40ae6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:27.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.970+0000 7f7bca9ff700 1 --2- 172.21.15.72:0/2254847129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc40cb9b0 0x7f7bc40ae6e0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7f7bc4083570 tx=0x7f7bb4016000).stop 2023-08-31T19:26:27.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.971+0000 7f7bca9ff700 1 -- 172.21.15.72:0/2254847129 shutdown_connections 2023-08-31T19:26:27.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.971+0000 7f7bca9ff700 1 --2- 172.21.15.72:0/2254847129 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7bb005ef30 0x7f7bb00613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.971+0000 7f7bca9ff700 1 --2- 172.21.15.72:0/2254847129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bc41588d0 0x7f7bc4155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.971+0000 7f7bca9ff700 1 --2- 172.21.15.72:0/2254847129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc40cb9b0 0x7f7bc40ae6e0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.971+0000 7f7bca9ff700 1 --2- 172.21.15.72:0/2254847129 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc4154060 0x7f7bc4150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:27.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.971+0000 7f7bca9ff700 1 -- 172.21.15.72:0/2254847129 >> 172.21.15.72:0/2254847129 conn(0x7f7bc405e870 msgr2=0x7f7bc41535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:27.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.971+0000 7f7bca9ff700 1 -- 172.21.15.72:0/2254847129 shutdown_connections 2023-08-31T19:26:27.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:27.971+0000 7f7bca9ff700 1 -- 172.21.15.72:0/2254847129 wait complete. 2023-08-31T19:26:27.976 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:26:27.988 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-31T19:26:27.764473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2436784,"kb_used_data":19056,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752537936,"statfs":{"total":773094113280,"available":770598846464,"internally_reserved":0,"allocated":19513344,"data_stored":10613356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-30896,"num_objects":-21,"num_object_clones":0,"num_object_copies":-42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-80,"num_write_kb":-66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001950"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312061+0000","last_change":"2023-08-31T19:26:23.302480+0000","last_active":"2023-08-31T19:26:23.312061+0000","last_peered":"2023-08-31T19:26:23.312061+0000","last_clean":"2023-08-31T19:26:23.312061+0000","last_became_active":"2023-08-31T19:26:23.302128+0000","last_became_peered":"2023-08-31T19:26:23.302128+0000","last_unstale":"2023-08-31T19:26:23.312061+0000","last_undegraded":"2023-08-31T19:26:23.312061+0000","last_fullsized":"2023-08-31T19:26:23.312061+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"194'3","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.302785+0000","last_change":"2023-08-31T19:26:22.827829+0000","last_active":"2023-08-31T19:26:23.302785+0000","last_peered":"2023-08-31T19:26:23.302785+0000","last_clean":"2023-08-31T19:26:23.302785+0000","last_became_active":"2023-08-31T19:26:22.826376+0000","last_became_peered":"2023-08-31T19:26:22.826376+0000","last_unstale":"2023-08-31T19:26:23.302785+0000","last_undegraded":"2023-08-31T19:26:23.302785+0000","last_fullsized":"2023-08-31T19:26:23.302785+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.293457+0000","last_change":"2023-08-31T19:26:23.293457+0000","last_active":"2023-08-31T19:26:23.293457+0000","last_peered":"2023-08-31T19:26:23.293457+0000","last_clean":"2023-08-31T19:26:23.293457+0000","last_became_active":"2023-08-31T19:26:23.293147+0000","last_became_peered":"2023-08-31T19:26:23.293147+0000","last_unstale":"2023-08-31T19:26:23.293457+0000","last_undegraded":"2023-08-31T19:26:23.293457+0000","last_fullsized":"2023-08-31T19:26:23.293457+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.281685+0000","last_change":"2023-08-31T19:26:22.816543+0000","last_active":"2023-08-31T19:26:23.281685+0000","last_peered":"2023-08-31T19:26:23.281685+0000","last_clean":"2023-08-31T19:26:23.281685+0000","last_became_active":"2023-08-31T19:26:22.816211+0000","last_became_peered":"2023-08-31T19:26:22.816211+0000","last_unstale":"2023-08-31T19:26:23.281685+0000","last_undegraded":"2023-08-31T19:26:23.281685+0000","last_fullsized":"2023-08-31T19:26:23.281685+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.290365+0000","last_change":"2023-08-31T19:26:23.290365+0000","last_active":"2023-08-31T19:26:23.290365+0000","last_peered":"2023-08-31T19:26:23.290365+0000","last_clean":"2023-08-31T19:26:23.290365+0000","last_became_active":"2023-08-31T19:26:23.289939+0000","last_became_peered":"2023-08-31T19:26:23.289939+0000","last_unstale":"2023-08-31T19:26:23.290365+0000","last_undegraded":"2023-08-31T19:26:23.290365+0000","last_fullsized":"2023-08-31T19:26:23.290365+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.836561+0000","last_change":"2023-08-31T19:26:22.830105+0000","last_active":"2023-08-31T19:26:22.836561+0000","last_peered":"2023-08-31T19:26:22.836561+0000","last_clean":"2023-08-31T19:26:22.836561+0000","last_became_active":"2023-08-31T19:26:22.829726+0000","last_became_peered":"2023-08-31T19:26:22.829726+0000","last_unstale":"2023-08-31T19:26:22.836561+0000","last_undegraded":"2023-08-31T19:26:22.836561+0000","last_fullsized":"2023-08-31T19:26:22.836561+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.304965+0000","last_change":"2023-08-31T19:26:23.299337+0000","last_active":"2023-08-31T19:26:23.304965+0000","last_peered":"2023-08-31T19:26:23.304965+0000","last_clean":"2023-08-31T19:26:23.304965+0000","last_became_active":"2023-08-31T19:26:23.299064+0000","last_became_peered":"2023-08-31T19:26:23.299064+0000","last_unstale":"2023-08-31T19:26:23.304965+0000","last_undegraded":"2023-08-31T19:26:23.304965+0000","last_fullsized":"2023-08-31T19:26:23.304965+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"194'2","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.299899+0000","last_change":"2023-08-31T19:26:22.833076+0000","last_active":"2023-08-31T19:26:23.299899+0000","last_peered":"2023-08-31T19:26:23.299899+0000","last_clean":"2023-08-31T19:26:23.299899+0000","last_became_active":"2023-08-31T19:26:22.832747+0000","last_became_peered":"2023-08-31T19:26:22.832747+0000","last_unstale":"2023-08-31T19:26:23.299899+0000","last_undegraded":"2023-08-31T19:26:23.299899+0000","last_fullsized":"2023-08-31T19:26:23.299899+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.310586+0000","last_change":"2023-08-31T19:26:23.310586+0000","last_active":"2023-08-31T19:26:23.310586+0000","last_peered":"2023-08-31T19:26:23.310586+0000","last_clean":"2023-08-31T19:26:23.310586+0000","last_became_active":"2023-08-31T19:26:23.310099+0000","last_became_peered":"2023-08-31T19:26:23.310099+0000","last_unstale":"2023-08-31T19:26:23.310586+0000","last_undegraded":"2023-08-31T19:26:23.310586+0000","last_fullsized":"2023-08-31T19:26:23.310586+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"194'1","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.309726+0000","last_change":"2023-08-31T19:26:22.824485+0000","last_active":"2023-08-31T19:26:23.309726+0000","last_peered":"2023-08-31T19:26:23.309726+0000","last_clean":"2023-08-31T19:26:23.309726+0000","last_became_active":"2023-08-31T19:26:22.823688+0000","last_became_peered":"2023-08-31T19:26:22.823688+0000","last_unstale":"2023-08-31T19:26:23.309726+0000","last_undegraded":"2023-08-31T19:26:23.309726+0000","last_fullsized":"2023-08-31T19:26:23.309726+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.287393+0000","last_change":"2023-08-31T19:26:23.287393+0000","last_active":"2023-08-31T19:26:23.287393+0000","last_peered":"2023-08-31T19:26:23.287393+0000","last_clean":"2023-08-31T19:26:23.287393+0000","last_became_active":"2023-08-31T19:26:23.287086+0000","last_became_peered":"2023-08-31T19:26:23.287086+0000","last_unstale":"2023-08-31T19:26:23.287393+0000","last_undegraded":"2023-08-31T19:26:23.287393+0000","last_fullsized":"2023-08-31T19:26:23.287393+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"194'1","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.296172+0000","last_change":"2023-08-31T19:26:22.818406+0000","last_active":"2023-08-31T19:26:23.296172+0000","last_peered":"2023-08-31T19:26:23.296172+0000","last_clean":"2023-08-31T19:26:23.296172+0000","last_became_active":"2023-08-31T19:26:22.818117+0000","last_became_peered":"2023-08-31T19:26:22.818117+0000","last_unstale":"2023-08-31T19:26:23.296172+0000","last_undegraded":"2023-08-31T19:26:23.296172+0000","last_fullsized":"2023-08-31T19:26:23.296172+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.305640+0000","last_change":"2023-08-31T19:26:23.303892+0000","last_active":"2023-08-31T19:26:23.305640+0000","last_peered":"2023-08-31T19:26:23.305640+0000","last_clean":"2023-08-31T19:26:23.305640+0000","last_became_active":"2023-08-31T19:26:23.303639+0000","last_became_peered":"2023-08-31T19:26:23.303639+0000","last_unstale":"2023-08-31T19:26:23.305640+0000","last_undegraded":"2023-08-31T19:26:23.305640+0000","last_fullsized":"2023-08-31T19:26:23.305640+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.829884+0000","last_change":"2023-08-31T19:26:22.824629+0000","last_active":"2023-08-31T19:26:22.829884+0000","last_peered":"2023-08-31T19:26:22.829884+0000","last_clean":"2023-08-31T19:26:22.829884+0000","last_became_active":"2023-08-31T19:26:22.824359+0000","last_became_peered":"2023-08-31T19:26:22.824359+0000","last_unstale":"2023-08-31T19:26:22.829884+0000","last_undegraded":"2023-08-31T19:26:22.829884+0000","last_fullsized":"2023-08-31T19:26:22.829884+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300967+0000","last_change":"2023-08-31T19:26:23.292844+0000","last_active":"2023-08-31T19:26:23.300967+0000","last_peered":"2023-08-31T19:26:23.300967+0000","last_clean":"2023-08-31T19:26:23.300967+0000","last_became_active":"2023-08-31T19:26:23.292583+0000","last_became_peered":"2023-08-31T19:26:23.292583+0000","last_unstale":"2023-08-31T19:26:23.300967+0000","last_undegraded":"2023-08-31T19:26:23.300967+0000","last_fullsized":"2023-08-31T19:26:23.300967+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280760+0000","last_change":"2023-08-31T19:26:22.824062+0000","last_active":"2023-08-31T19:26:23.280760+0000","last_peered":"2023-08-31T19:26:23.280760+0000","last_clean":"2023-08-31T19:26:23.280760+0000","last_became_active":"2023-08-31T19:26:22.823666+0000","last_became_peered":"2023-08-31T19:26:22.823666+0000","last_unstale":"2023-08-31T19:26:23.280760+0000","last_undegraded":"2023-08-31T19:26:23.280760+0000","last_fullsized":"2023-08-31T19:26:23.280760+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.305721+0000","last_change":"2023-08-31T19:26:23.304451+0000","last_active":"2023-08-31T19:26:23.305721+0000","last_peered":"2023-08-31T19:26:23.305721+0000","last_clean":"2023-08-31T19:26:23.305721+0000","last_became_active":"2023-08-31T19:26:23.304177+0000","last_became_peered":"2023-08-31T19:26:23.304177+0000","last_unstale":"2023-08-31T19:26:23.305721+0000","last_undegraded":"2023-08-31T19:26:23.305721+0000","last_fullsized":"2023-08-31T19:26:23.305721+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280118+0000","last_change":"2023-08-31T19:26:22.826411+0000","last_active":"2023-08-31T19:26:23.280118+0000","last_peered":"2023-08-31T19:26:23.280118+0000","last_clean":"2023-08-31T19:26:23.280118+0000","last_became_active":"2023-08-31T19:26:22.825867+0000","last_became_peered":"2023-08-31T19:26:22.825867+0000","last_unstale":"2023-08-31T19:26:23.280118+0000","last_undegraded":"2023-08-31T19:26:23.280118+0000","last_fullsized":"2023-08-31T19:26:23.280118+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300885+0000","last_change":"2023-08-31T19:26:23.293605+0000","last_active":"2023-08-31T19:26:23.300885+0000","last_peered":"2023-08-31T19:26:23.300885+0000","last_clean":"2023-08-31T19:26:23.300885+0000","last_became_active":"2023-08-31T19:26:23.293345+0000","last_became_peered":"2023-08-31T19:26:23.293345+0000","last_unstale":"2023-08-31T19:26:23.300885+0000","last_undegraded":"2023-08-31T19:26:23.300885+0000","last_fullsized":"2023-08-31T19:26:23.300885+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.281704+0000","last_change":"2023-08-31T19:26:22.826984+0000","last_active":"2023-08-31T19:26:23.281704+0000","last_peered":"2023-08-31T19:26:23.281704+0000","last_clean":"2023-08-31T19:26:23.281704+0000","last_became_active":"2023-08-31T19:26:22.826674+0000","last_became_peered":"2023-08-31T19:26:22.826674+0000","last_unstale":"2023-08-31T19:26:23.281704+0000","last_undegraded":"2023-08-31T19:26:23.281704+0000","last_fullsized":"2023-08-31T19:26:23.281704+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.304630+0000","last_change":"2023-08-31T19:26:23.304630+0000","last_active":"2023-08-31T19:26:23.304630+0000","last_peered":"2023-08-31T19:26:23.304630+0000","last_clean":"2023-08-31T19:26:23.304630+0000","last_became_active":"2023-08-31T19:26:23.304345+0000","last_became_peered":"2023-08-31T19:26:23.304345+0000","last_unstale":"2023-08-31T19:26:23.304630+0000","last_undegraded":"2023-08-31T19:26:23.304630+0000","last_fullsized":"2023-08-31T19:26:23.304630+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.279872+0000","last_change":"2023-08-31T19:26:22.823720+0000","last_active":"2023-08-31T19:26:23.279872+0000","last_peered":"2023-08-31T19:26:23.279872+0000","last_clean":"2023-08-31T19:26:23.279872+0000","last_became_active":"2023-08-31T19:26:22.823426+0000","last_became_peered":"2023-08-31T19:26:22.823426+0000","last_unstale":"2023-08-31T19:26:23.279872+0000","last_undegraded":"2023-08-31T19:26:23.279872+0000","last_fullsized":"2023-08-31T19:26:23.279872+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.310101+0000","last_change":"2023-08-31T19:26:23.310101+0000","last_active":"2023-08-31T19:26:23.310101+0000","last_peered":"2023-08-31T19:26:23.310101+0000","last_clean":"2023-08-31T19:26:23.310101+0000","last_became_active":"2023-08-31T19:26:23.309778+0000","last_became_peered":"2023-08-31T19:26:23.309778+0000","last_unstale":"2023-08-31T19:26:23.310101+0000","last_undegraded":"2023-08-31T19:26:23.310101+0000","last_fullsized":"2023-08-31T19:26:23.310101+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"194'4","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312994+0000","last_change":"2023-08-31T19:26:22.811861+0000","last_active":"2023-08-31T19:26:23.312994+0000","last_peered":"2023-08-31T19:26:23.312994+0000","last_clean":"2023-08-31T19:26:23.312994+0000","last_became_active":"2023-08-31T19:26:22.811556+0000","last_became_peered":"2023-08-31T19:26:22.811556+0000","last_unstale":"2023-08-31T19:26:23.312994+0000","last_undegraded":"2023-08-31T19:26:23.312994+0000","last_fullsized":"2023-08-31T19:26:23.312994+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312283+0000","last_change":"2023-08-31T19:26:23.305209+0000","last_active":"2023-08-31T19:26:23.312283+0000","last_peered":"2023-08-31T19:26:23.312283+0000","last_clean":"2023-08-31T19:26:23.312283+0000","last_became_active":"2023-08-31T19:26:23.304903+0000","last_became_peered":"2023-08-31T19:26:23.304903+0000","last_unstale":"2023-08-31T19:26:23.312283+0000","last_undegraded":"2023-08-31T19:26:23.312283+0000","last_fullsized":"2023-08-31T19:26:23.312283+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"194'1","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.277979+0000","last_change":"2023-08-31T19:26:22.830700+0000","last_active":"2023-08-31T19:26:23.277979+0000","last_peered":"2023-08-31T19:26:23.277979+0000","last_clean":"2023-08-31T19:26:23.277979+0000","last_became_active":"2023-08-31T19:26:22.830373+0000","last_became_peered":"2023-08-31T19:26:22.830373+0000","last_unstale":"2023-08-31T19:26:23.277979+0000","last_undegraded":"2023-08-31T19:26:23.277979+0000","last_fullsized":"2023-08-31T19:26:23.277979+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.311902+0000","last_change":"2023-08-31T19:26:23.302033+0000","last_active":"2023-08-31T19:26:23.311902+0000","last_peered":"2023-08-31T19:26:23.311902+0000","last_clean":"2023-08-31T19:26:23.311902+0000","last_became_active":"2023-08-31T19:26:23.301737+0000","last_became_peered":"2023-08-31T19:26:23.301737+0000","last_unstale":"2023-08-31T19:26:23.311902+0000","last_undegraded":"2023-08-31T19:26:23.311902+0000","last_fullsized":"2023-08-31T19:26:23.311902+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.832776+0000","last_change":"2023-08-31T19:26:22.826806+0000","last_active":"2023-08-31T19:26:22.832776+0000","last_peered":"2023-08-31T19:26:22.832776+0000","last_clean":"2023-08-31T19:26:22.832776+0000","last_became_active":"2023-08-31T19:26:22.826536+0000","last_became_peered":"2023-08-31T19:26:22.826536+0000","last_unstale":"2023-08-31T19:26:22.832776+0000","last_undegraded":"2023-08-31T19:26:22.832776+0000","last_fullsized":"2023-08-31T19:26:22.832776+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.302111+0000","last_change":"2023-08-31T19:26:23.302111+0000","last_active":"2023-08-31T19:26:23.302111+0000","last_peered":"2023-08-31T19:26:23.302111+0000","last_clean":"2023-08-31T19:26:23.302111+0000","last_became_active":"2023-08-31T19:26:23.301784+0000","last_became_peered":"2023-08-31T19:26:23.301784+0000","last_unstale":"2023-08-31T19:26:23.302111+0000","last_undegraded":"2023-08-31T19:26:23.302111+0000","last_fullsized":"2023-08-31T19:26:23.302111+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.833358+0000","last_change":"2023-08-31T19:26:22.825853+0000","last_active":"2023-08-31T19:26:22.833358+0000","last_peered":"2023-08-31T19:26:22.833358+0000","last_clean":"2023-08-31T19:26:22.833358+0000","last_became_active":"2023-08-31T19:26:22.825569+0000","last_became_peered":"2023-08-31T19:26:22.825569+0000","last_unstale":"2023-08-31T19:26:22.833358+0000","last_undegraded":"2023-08-31T19:26:22.833358+0000","last_fullsized":"2023-08-31T19:26:22.833358+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312111+0000","last_change":"2023-08-31T19:26:23.302596+0000","last_active":"2023-08-31T19:26:23.312111+0000","last_peered":"2023-08-31T19:26:23.312111+0000","last_clean":"2023-08-31T19:26:23.312111+0000","last_became_active":"2023-08-31T19:26:23.302303+0000","last_became_peered":"2023-08-31T19:26:23.302303+0000","last_unstale":"2023-08-31T19:26:23.312111+0000","last_undegraded":"2023-08-31T19:26:23.312111+0000","last_fullsized":"2023-08-31T19:26:23.312111+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"194'4","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.296375+0000","last_change":"2023-08-31T19:26:22.827645+0000","last_active":"2023-08-31T19:26:23.296375+0000","last_peered":"2023-08-31T19:26:23.296375+0000","last_clean":"2023-08-31T19:26:23.296375+0000","last_became_active":"2023-08-31T19:26:22.827203+0000","last_became_peered":"2023-08-31T19:26:22.827203+0000","last_unstale":"2023-08-31T19:26:23.296375+0000","last_undegraded":"2023-08-31T19:26:23.296375+0000","last_fullsized":"2023-08-31T19:26:23.296375+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.304986+0000","last_change":"2023-08-31T19:26:23.299764+0000","last_active":"2023-08-31T19:26:23.304986+0000","last_peered":"2023-08-31T19:26:23.304986+0000","last_clean":"2023-08-31T19:26:23.304986+0000","last_became_active":"2023-08-31T19:26:23.299356+0000","last_became_peered":"2023-08-31T19:26:23.299356+0000","last_unstale":"2023-08-31T19:26:23.304986+0000","last_undegraded":"2023-08-31T19:26:23.304986+0000","last_fullsized":"2023-08-31T19:26:23.304986+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.276605+0000","last_change":"2023-08-31T19:26:22.822994+0000","last_active":"2023-08-31T19:26:23.276605+0000","last_peered":"2023-08-31T19:26:23.276605+0000","last_clean":"2023-08-31T19:26:23.276605+0000","last_became_active":"2023-08-31T19:26:22.822676+0000","last_became_peered":"2023-08-31T19:26:22.822676+0000","last_unstale":"2023-08-31T19:26:23.276605+0000","last_undegraded":"2023-08-31T19:26:23.276605+0000","last_fullsized":"2023-08-31T19:26:23.276605+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.290686+0000","last_change":"2023-08-31T19:26:23.290686+0000","last_active":"2023-08-31T19:26:23.290686+0000","last_peered":"2023-08-31T19:26:23.290686+0000","last_clean":"2023-08-31T19:26:23.290686+0000","last_became_active":"2023-08-31T19:26:23.290387+0000","last_became_peered":"2023-08-31T19:26:23.290387+0000","last_unstale":"2023-08-31T19:26:23.290686+0000","last_undegraded":"2023-08-31T19:26:23.290686+0000","last_fullsized":"2023-08-31T19:26:23.290686+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.279486+0000","last_change":"2023-08-31T19:26:22.826359+0000","last_active":"2023-08-31T19:26:23.279486+0000","last_peered":"2023-08-31T19:26:23.279486+0000","last_clean":"2023-08-31T19:26:23.279486+0000","last_became_active":"2023-08-31T19:26:22.826059+0000","last_became_peered":"2023-08-31T19:26:22.826059+0000","last_unstale":"2023-08-31T19:26:23.279486+0000","last_undegraded":"2023-08-31T19:26:23.279486+0000","last_fullsized":"2023-08-31T19:26:23.279486+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.295134+0000","last_change":"2023-08-31T19:26:23.291022+0000","last_active":"2023-08-31T19:26:23.295134+0000","last_peered":"2023-08-31T19:26:23.295134+0000","last_clean":"2023-08-31T19:26:23.295134+0000","last_became_active":"2023-08-31T19:26:23.290590+0000","last_became_peered":"2023-08-31T19:26:23.290590+0000","last_unstale":"2023-08-31T19:26:23.295134+0000","last_undegraded":"2023-08-31T19:26:23.295134+0000","last_fullsized":"2023-08-31T19:26:23.295134+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"194'1","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300130+0000","last_change":"2023-08-31T19:26:22.823915+0000","last_active":"2023-08-31T19:26:23.300130+0000","last_peered":"2023-08-31T19:26:23.300130+0000","last_clean":"2023-08-31T19:26:23.300130+0000","last_became_active":"2023-08-31T19:26:22.823618+0000","last_became_peered":"2023-08-31T19:26:22.823618+0000","last_unstale":"2023-08-31T19:26:23.300130+0000","last_undegraded":"2023-08-31T19:26:23.300130+0000","last_fullsized":"2023-08-31T19:26:23.300130+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.304057+0000","last_change":"2023-08-31T19:26:23.304057+0000","last_active":"2023-08-31T19:26:23.304057+0000","last_peered":"2023-08-31T19:26:23.304057+0000","last_clean":"2023-08-31T19:26:23.304057+0000","last_became_active":"2023-08-31T19:26:23.303719+0000","last_became_peered":"2023-08-31T19:26:23.303719+0000","last_unstale":"2023-08-31T19:26:23.304057+0000","last_undegraded":"2023-08-31T19:26:23.304057+0000","last_fullsized":"2023-08-31T19:26:23.304057+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.836407+0000","last_change":"2023-08-31T19:26:22.829047+0000","last_active":"2023-08-31T19:26:22.836407+0000","last_peered":"2023-08-31T19:26:22.836407+0000","last_clean":"2023-08-31T19:26:22.836407+0000","last_became_active":"2023-08-31T19:26:22.827473+0000","last_became_peered":"2023-08-31T19:26:22.827473+0000","last_unstale":"2023-08-31T19:26:22.836407+0000","last_undegraded":"2023-08-31T19:26:22.836407+0000","last_fullsized":"2023-08-31T19:26:22.836407+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312378+0000","last_change":"2023-08-31T19:26:23.311139+0000","last_active":"2023-08-31T19:26:23.312378+0000","last_peered":"2023-08-31T19:26:23.312378+0000","last_clean":"2023-08-31T19:26:23.312378+0000","last_became_active":"2023-08-31T19:26:23.310852+0000","last_became_peered":"2023-08-31T19:26:23.310852+0000","last_unstale":"2023-08-31T19:26:23.312378+0000","last_undegraded":"2023-08-31T19:26:23.312378+0000","last_fullsized":"2023-08-31T19:26:23.312378+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"194'1","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300774+0000","last_change":"2023-08-31T19:26:22.823024+0000","last_active":"2023-08-31T19:26:23.300774+0000","last_peered":"2023-08-31T19:26:23.300774+0000","last_clean":"2023-08-31T19:26:23.300774+0000","last_became_active":"2023-08-31T19:26:22.822664+0000","last_became_peered":"2023-08-31T19:26:22.822664+0000","last_unstale":"2023-08-31T19:26:23.300774+0000","last_undegraded":"2023-08-31T19:26:23.300774+0000","last_fullsized":"2023-08-31T19:26:23.300774+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.292920+0000","last_change":"2023-08-31T19:26:23.292920+0000","last_active":"2023-08-31T19:26:23.292920+0000","last_peered":"2023-08-31T19:26:23.292920+0000","last_clean":"2023-08-31T19:26:23.292920+0000","last_became_active":"2023-08-31T19:26:23.292633+0000","last_became_peered":"2023-08-31T19:26:23.292633+0000","last_unstale":"2023-08-31T19:26:23.292920+0000","last_undegraded":"2023-08-31T19:26:23.292920+0000","last_fullsized":"2023-08-31T19:26:23.292920+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.281000+0000","last_change":"2023-08-31T19:26:22.820189+0000","last_active":"2023-08-31T19:26:23.281000+0000","last_peered":"2023-08-31T19:26:23.281000+0000","last_clean":"2023-08-31T19:26:23.281000+0000","last_became_active":"2023-08-31T19:26:22.819465+0000","last_became_peered":"2023-08-31T19:26:22.819465+0000","last_unstale":"2023-08-31T19:26:23.281000+0000","last_undegraded":"2023-08-31T19:26:23.281000+0000","last_fullsized":"2023-08-31T19:26:23.281000+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.305579+0000","last_change":"2023-08-31T19:26:23.304134+0000","last_active":"2023-08-31T19:26:23.305579+0000","last_peered":"2023-08-31T19:26:23.305579+0000","last_clean":"2023-08-31T19:26:23.305579+0000","last_became_active":"2023-08-31T19:26:23.303569+0000","last_became_peered":"2023-08-31T19:26:23.303569+0000","last_unstale":"2023-08-31T19:26:23.305579+0000","last_undegraded":"2023-08-31T19:26:23.305579+0000","last_fullsized":"2023-08-31T19:26:23.305579+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.275898+0000","last_change":"2023-08-31T19:26:22.821108+0000","last_active":"2023-08-31T19:26:23.275898+0000","last_peered":"2023-08-31T19:26:23.275898+0000","last_clean":"2023-08-31T19:26:23.275898+0000","last_became_active":"2023-08-31T19:26:22.820612+0000","last_became_peered":"2023-08-31T19:26:22.820612+0000","last_unstale":"2023-08-31T19:26:23.275898+0000","last_undegraded":"2023-08-31T19:26:23.275898+0000","last_fullsized":"2023-08-31T19:26:23.275898+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.305199+0000","last_change":"2023-08-31T19:26:23.300443+0000","last_active":"2023-08-31T19:26:23.305199+0000","last_peered":"2023-08-31T19:26:23.305199+0000","last_clean":"2023-08-31T19:26:23.305199+0000","last_became_active":"2023-08-31T19:26:23.300118+0000","last_became_peered":"2023-08-31T19:26:23.300118+0000","last_unstale":"2023-08-31T19:26:23.305199+0000","last_undegraded":"2023-08-31T19:26:23.305199+0000","last_fullsized":"2023-08-31T19:26:23.305199+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280878+0000","last_change":"2023-08-31T19:26:22.825898+0000","last_active":"2023-08-31T19:26:23.280878+0000","last_peered":"2023-08-31T19:26:23.280878+0000","last_clean":"2023-08-31T19:26:23.280878+0000","last_became_active":"2023-08-31T19:26:22.825629+0000","last_became_peered":"2023-08-31T19:26:22.825629+0000","last_unstale":"2023-08-31T19:26:23.280878+0000","last_undegraded":"2023-08-31T19:26:23.280878+0000","last_fullsized":"2023-08-31T19:26:23.280878+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312098+0000","last_change":"2023-08-31T19:26:23.302652+0000","last_active":"2023-08-31T19:26:23.312098+0000","last_peered":"2023-08-31T19:26:23.312098+0000","last_clean":"2023-08-31T19:26:23.312098+0000","last_became_active":"2023-08-31T19:26:23.301836+0000","last_became_peered":"2023-08-31T19:26:23.301836+0000","last_unstale":"2023-08-31T19:26:23.312098+0000","last_undegraded":"2023-08-31T19:26:23.312098+0000","last_fullsized":"2023-08-31T19:26:23.312098+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.836574+0000","last_change":"2023-08-31T19:26:22.830171+0000","last_active":"2023-08-31T19:26:22.836574+0000","last_peered":"2023-08-31T19:26:22.836574+0000","last_clean":"2023-08-31T19:26:22.836574+0000","last_became_active":"2023-08-31T19:26:22.829870+0000","last_became_peered":"2023-08-31T19:26:22.829870+0000","last_unstale":"2023-08-31T19:26:22.836574+0000","last_undegraded":"2023-08-31T19:26:22.836574+0000","last_fullsized":"2023-08-31T19:26:22.836574+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.290843+0000","last_change":"2023-08-31T19:26:23.290843+0000","last_active":"2023-08-31T19:26:23.290843+0000","last_peered":"2023-08-31T19:26:23.290843+0000","last_clean":"2023-08-31T19:26:23.290843+0000","last_became_active":"2023-08-31T19:26:23.290591+0000","last_became_peered":"2023-08-31T19:26:23.290591+0000","last_unstale":"2023-08-31T19:26:23.290843+0000","last_undegraded":"2023-08-31T19:26:23.290843+0000","last_fullsized":"2023-08-31T19:26:23.290843+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.830017+0000","last_change":"2023-08-31T19:26:22.824187+0000","last_active":"2023-08-31T19:26:22.830017+0000","last_peered":"2023-08-31T19:26:22.830017+0000","last_clean":"2023-08-31T19:26:22.830017+0000","last_became_active":"2023-08-31T19:26:22.823666+0000","last_became_peered":"2023-08-31T19:26:22.823666+0000","last_unstale":"2023-08-31T19:26:22.830017+0000","last_undegraded":"2023-08-31T19:26:22.830017+0000","last_fullsized":"2023-08-31T19:26:22.830017+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.294296+0000","last_change":"2023-08-31T19:26:23.294296+0000","last_active":"2023-08-31T19:26:23.294296+0000","last_peered":"2023-08-31T19:26:23.294296+0000","last_clean":"2023-08-31T19:26:23.294296+0000","last_became_active":"2023-08-31T19:26:23.293991+0000","last_became_peered":"2023-08-31T19:26:23.293991+0000","last_unstale":"2023-08-31T19:26:23.294296+0000","last_undegraded":"2023-08-31T19:26:23.294296+0000","last_fullsized":"2023-08-31T19:26:23.294296+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.836540+0000","last_change":"2023-08-31T19:26:22.828820+0000","last_active":"2023-08-31T19:26:22.836540+0000","last_peered":"2023-08-31T19:26:22.836540+0000","last_clean":"2023-08-31T19:26:22.836540+0000","last_became_active":"2023-08-31T19:26:22.828383+0000","last_became_peered":"2023-08-31T19:26:22.828383+0000","last_unstale":"2023-08-31T19:26:22.836540+0000","last_undegraded":"2023-08-31T19:26:22.836540+0000","last_fullsized":"2023-08-31T19:26:22.836540+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.311649+0000","last_change":"2023-08-31T19:26:23.310144+0000","last_active":"2023-08-31T19:26:23.311649+0000","last_peered":"2023-08-31T19:26:23.311649+0000","last_clean":"2023-08-31T19:26:23.311649+0000","last_became_active":"2023-08-31T19:26:23.309819+0000","last_became_peered":"2023-08-31T19:26:23.309819+0000","last_unstale":"2023-08-31T19:26:23.311649+0000","last_undegraded":"2023-08-31T19:26:23.311649+0000","last_fullsized":"2023-08-31T19:26:23.311649+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280361+0000","last_change":"2023-08-31T19:26:22.833656+0000","last_active":"2023-08-31T19:26:23.280361+0000","last_peered":"2023-08-31T19:26:23.280361+0000","last_clean":"2023-08-31T19:26:23.280361+0000","last_became_active":"2023-08-31T19:26:22.833399+0000","last_became_peered":"2023-08-31T19:26:22.833399+0000","last_unstale":"2023-08-31T19:26:23.280361+0000","last_undegraded":"2023-08-31T19:26:23.280361+0000","last_fullsized":"2023-08-31T19:26:23.280361+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.292804+0000","last_change":"2023-08-31T19:26:23.286386+0000","last_active":"2023-08-31T19:26:23.292804+0000","last_peered":"2023-08-31T19:26:23.292804+0000","last_clean":"2023-08-31T19:26:23.292804+0000","last_became_active":"2023-08-31T19:26:23.286109+0000","last_became_peered":"2023-08-31T19:26:23.286109+0000","last_unstale":"2023-08-31T19:26:23.292804+0000","last_undegraded":"2023-08-31T19:26:23.292804+0000","last_fullsized":"2023-08-31T19:26:23.292804+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.836509+0000","last_change":"2023-08-31T19:26:22.829102+0000","last_active":"2023-08-31T19:26:22.836509+0000","last_peered":"2023-08-31T19:26:22.836509+0000","last_clean":"2023-08-31T19:26:22.836509+0000","last_became_active":"2023-08-31T19:26:22.828778+0000","last_became_peered":"2023-08-31T19:26:22.828778+0000","last_unstale":"2023-08-31T19:26:22.836509+0000","last_undegraded":"2023-08-31T19:26:22.836509+0000","last_fullsized":"2023-08-31T19:26:22.836509+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.295927+0000","last_change":"2023-08-31T19:26:23.295927+0000","last_active":"2023-08-31T19:26:23.295927+0000","last_peered":"2023-08-31T19:26:23.295927+0000","last_clean":"2023-08-31T19:26:23.295927+0000","last_became_active":"2023-08-31T19:26:23.294861+0000","last_became_peered":"2023-08-31T19:26:23.294861+0000","last_unstale":"2023-08-31T19:26:23.295927+0000","last_undegraded":"2023-08-31T19:26:23.295927+0000","last_fullsized":"2023-08-31T19:26:23.295927+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.293239+0000","last_change":"2023-08-31T19:26:22.827568+0000","last_active":"2023-08-31T19:26:23.293239+0000","last_peered":"2023-08-31T19:26:23.293239+0000","last_clean":"2023-08-31T19:26:23.293239+0000","last_became_active":"2023-08-31T19:26:22.827299+0000","last_became_peered":"2023-08-31T19:26:22.827299+0000","last_unstale":"2023-08-31T19:26:23.293239+0000","last_undegraded":"2023-08-31T19:26:23.293239+0000","last_fullsized":"2023-08-31T19:26:23.293239+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.306189+0000","last_change":"2023-08-31T19:26:23.301378+0000","last_active":"2023-08-31T19:26:23.306189+0000","last_peered":"2023-08-31T19:26:23.306189+0000","last_clean":"2023-08-31T19:26:23.306189+0000","last_became_active":"2023-08-31T19:26:23.301038+0000","last_became_peered":"2023-08-31T19:26:23.301038+0000","last_unstale":"2023-08-31T19:26:23.306189+0000","last_undegraded":"2023-08-31T19:26:23.306189+0000","last_fullsized":"2023-08-31T19:26:23.306189+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.288336+0000","last_change":"2023-08-31T19:26:22.831958+0000","last_active":"2023-08-31T19:26:23.288336+0000","last_peered":"2023-08-31T19:26:23.288336+0000","last_clean":"2023-08-31T19:26:23.288336+0000","last_became_active":"2023-08-31T19:26:22.831650+0000","last_became_peered":"2023-08-31T19:26:22.831650+0000","last_unstale":"2023-08-31T19:26:23.288336+0000","last_undegraded":"2023-08-31T19:26:23.288336+0000","last_fullsized":"2023-08-31T19:26:23.288336+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300985+0000","last_change":"2023-08-31T19:26:23.297351+0000","last_active":"2023-08-31T19:26:23.300985+0000","last_peered":"2023-08-31T19:26:23.300985+0000","last_clean":"2023-08-31T19:26:23.300985+0000","last_became_active":"2023-08-31T19:26:23.297045+0000","last_became_peered":"2023-08-31T19:26:23.297045+0000","last_unstale":"2023-08-31T19:26:23.300985+0000","last_undegraded":"2023-08-31T19:26:23.300985+0000","last_fullsized":"2023-08-31T19:26:23.300985+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.279022+0000","last_change":"2023-08-31T19:26:22.828946+0000","last_active":"2023-08-31T19:26:23.279022+0000","last_peered":"2023-08-31T19:26:23.279022+0000","last_clean":"2023-08-31T19:26:23.279022+0000","last_became_active":"2023-08-31T19:26:22.828620+0000","last_became_peered":"2023-08-31T19:26:22.828620+0000","last_unstale":"2023-08-31T19:26:23.279022+0000","last_undegraded":"2023-08-31T19:26:23.279022+0000","last_fullsized":"2023-08-31T19:26:23.279022+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.296975+0000","last_change":"2023-08-31T19:26:23.296975+0000","last_active":"2023-08-31T19:26:23.296975+0000","last_peered":"2023-08-31T19:26:23.296975+0000","last_clean":"2023-08-31T19:26:23.296975+0000","last_became_active":"2023-08-31T19:26:23.296682+0000","last_became_peered":"2023-08-31T19:26:23.296682+0000","last_unstale":"2023-08-31T19:26:23.296975+0000","last_undegraded":"2023-08-31T19:26:23.296975+0000","last_fullsized":"2023-08-31T19:26:23.296975+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"194'1","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.309453+0000","last_change":"2023-08-31T19:26:22.827665+0000","last_active":"2023-08-31T19:26:23.309453+0000","last_peered":"2023-08-31T19:26:23.309453+0000","last_clean":"2023-08-31T19:26:23.309453+0000","last_became_active":"2023-08-31T19:26:22.826903+0000","last_became_peered":"2023-08-31T19:26:22.826903+0000","last_unstale":"2023-08-31T19:26:23.309453+0000","last_undegraded":"2023-08-31T19:26:23.309453+0000","last_fullsized":"2023-08-31T19:26:23.309453+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.299443+0000","last_change":"2023-08-31T19:26:23.296455+0000","last_active":"2023-08-31T19:26:23.299443+0000","last_peered":"2023-08-31T19:26:23.299443+0000","last_clean":"2023-08-31T19:26:23.299443+0000","last_became_active":"2023-08-31T19:26:23.296157+0000","last_became_peered":"2023-08-31T19:26:23.296157+0000","last_unstale":"2023-08-31T19:26:23.299443+0000","last_undegraded":"2023-08-31T19:26:23.299443+0000","last_fullsized":"2023-08-31T19:26:23.299443+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"194'1","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.274317+0000","last_change":"2023-08-31T19:26:22.823989+0000","last_active":"2023-08-31T19:26:23.274317+0000","last_peered":"2023-08-31T19:26:23.274317+0000","last_clean":"2023-08-31T19:26:23.274317+0000","last_became_active":"2023-08-31T19:26:22.823292+0000","last_became_peered":"2023-08-31T19:26:22.823292+0000","last_unstale":"2023-08-31T19:26:23.274317+0000","last_undegraded":"2023-08-31T19:26:23.274317+0000","last_fullsized":"2023-08-31T19:26:23.274317+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.290206+0000","last_change":"2023-08-31T19:26:23.290206+0000","last_active":"2023-08-31T19:26:23.290206+0000","last_peered":"2023-08-31T19:26:23.290206+0000","last_clean":"2023-08-31T19:26:23.290206+0000","last_became_active":"2023-08-31T19:26:23.289585+0000","last_became_peered":"2023-08-31T19:26:23.289585+0000","last_unstale":"2023-08-31T19:26:23.290206+0000","last_undegraded":"2023-08-31T19:26:23.290206+0000","last_fullsized":"2023-08-31T19:26:23.290206+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"194'2","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.293087+0000","last_change":"2023-08-31T19:26:22.823160+0000","last_active":"2023-08-31T19:26:23.293087+0000","last_peered":"2023-08-31T19:26:23.293087+0000","last_clean":"2023-08-31T19:26:23.293087+0000","last_became_active":"2023-08-31T19:26:22.822743+0000","last_became_peered":"2023-08-31T19:26:22.822743+0000","last_unstale":"2023-08-31T19:26:23.293087+0000","last_undegraded":"2023-08-31T19:26:23.293087+0000","last_fullsized":"2023-08-31T19:26:23.293087+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.296535+0000","last_change":"2023-08-31T19:26:23.296535+0000","last_active":"2023-08-31T19:26:23.296535+0000","last_peered":"2023-08-31T19:26:23.296535+0000","last_clean":"2023-08-31T19:26:23.296535+0000","last_became_active":"2023-08-31T19:26:23.296175+0000","last_became_peered":"2023-08-31T19:26:23.296175+0000","last_unstale":"2023-08-31T19:26:23.296535+0000","last_undegraded":"2023-08-31T19:26:23.296535+0000","last_fullsized":"2023-08-31T19:26:23.296535+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.275969+0000","last_change":"2023-08-31T19:26:22.825889+0000","last_active":"2023-08-31T19:26:23.275969+0000","last_peered":"2023-08-31T19:26:23.275969+0000","last_clean":"2023-08-31T19:26:23.275969+0000","last_became_active":"2023-08-31T19:26:22.825576+0000","last_became_peered":"2023-08-31T19:26:22.825576+0000","last_unstale":"2023-08-31T19:26:23.275969+0000","last_undegraded":"2023-08-31T19:26:23.275969+0000","last_fullsized":"2023-08-31T19:26:23.275969+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312115+0000","last_change":"2023-08-31T19:26:23.310503+0000","last_active":"2023-08-31T19:26:23.312115+0000","last_peered":"2023-08-31T19:26:23.312115+0000","last_clean":"2023-08-31T19:26:23.312115+0000","last_became_active":"2023-08-31T19:26:23.310184+0000","last_became_peered":"2023-08-31T19:26:23.310184+0000","last_unstale":"2023-08-31T19:26:23.312115+0000","last_undegraded":"2023-08-31T19:26:23.312115+0000","last_fullsized":"2023-08-31T19:26:23.312115+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280653+0000","last_change":"2023-08-31T19:26:22.829143+0000","last_active":"2023-08-31T19:26:23.280653+0000","last_peered":"2023-08-31T19:26:23.280653+0000","last_clean":"2023-08-31T19:26:23.280653+0000","last_became_active":"2023-08-31T19:26:22.828859+0000","last_became_peered":"2023-08-31T19:26:22.828859+0000","last_unstale":"2023-08-31T19:26:23.280653+0000","last_undegraded":"2023-08-31T19:26:23.280653+0000","last_fullsized":"2023-08-31T19:26:23.280653+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.298066+0000","last_change":"2023-08-31T19:26:23.291815+0000","last_active":"2023-08-31T19:26:23.298066+0000","last_peered":"2023-08-31T19:26:23.298066+0000","last_clean":"2023-08-31T19:26:23.298066+0000","last_became_active":"2023-08-31T19:26:23.291544+0000","last_became_peered":"2023-08-31T19:26:23.291544+0000","last_unstale":"2023-08-31T19:26:23.298066+0000","last_undegraded":"2023-08-31T19:26:23.298066+0000","last_fullsized":"2023-08-31T19:26:23.298066+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.837834+0000","last_change":"2023-08-31T19:26:22.831198+0000","last_active":"2023-08-31T19:26:22.837834+0000","last_peered":"2023-08-31T19:26:22.837834+0000","last_clean":"2023-08-31T19:26:22.837834+0000","last_became_active":"2023-08-31T19:26:22.830861+0000","last_became_peered":"2023-08-31T19:26:22.830861+0000","last_unstale":"2023-08-31T19:26:22.837834+0000","last_undegraded":"2023-08-31T19:26:22.837834+0000","last_fullsized":"2023-08-31T19:26:22.837834+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.293997+0000","last_change":"2023-08-31T19:26:23.289516+0000","last_active":"2023-08-31T19:26:23.293997+0000","last_peered":"2023-08-31T19:26:23.293997+0000","last_clean":"2023-08-31T19:26:23.293997+0000","last_became_active":"2023-08-31T19:26:23.289253+0000","last_became_peered":"2023-08-31T19:26:23.289253+0000","last_unstale":"2023-08-31T19:26:23.293997+0000","last_undegraded":"2023-08-31T19:26:23.293997+0000","last_fullsized":"2023-08-31T19:26:23.293997+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.275785+0000","last_change":"2023-08-31T19:26:22.817810+0000","last_active":"2023-08-31T19:26:23.275785+0000","last_peered":"2023-08-31T19:26:23.275785+0000","last_clean":"2023-08-31T19:26:23.275785+0000","last_became_active":"2023-08-31T19:26:22.817509+0000","last_became_peered":"2023-08-31T19:26:22.817509+0000","last_unstale":"2023-08-31T19:26:23.275785+0000","last_undegraded":"2023-08-31T19:26:23.275785+0000","last_fullsized":"2023-08-31T19:26:23.275785+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312134+0000","last_change":"2023-08-31T19:26:23.303785+0000","last_active":"2023-08-31T19:26:23.312134+0000","last_peered":"2023-08-31T19:26:23.312134+0000","last_clean":"2023-08-31T19:26:23.312134+0000","last_became_active":"2023-08-31T19:26:23.303510+0000","last_became_peered":"2023-08-31T19:26:23.303510+0000","last_unstale":"2023-08-31T19:26:23.312134+0000","last_undegraded":"2023-08-31T19:26:23.312134+0000","last_fullsized":"2023-08-31T19:26:23.312134+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.279464+0000","last_change":"2023-08-31T19:26:22.828347+0000","last_active":"2023-08-31T19:26:23.279464+0000","last_peered":"2023-08-31T19:26:23.279464+0000","last_clean":"2023-08-31T19:26:23.279464+0000","last_became_active":"2023-08-31T19:26:22.828047+0000","last_became_peered":"2023-08-31T19:26:22.828047+0000","last_unstale":"2023-08-31T19:26:23.279464+0000","last_undegraded":"2023-08-31T19:26:23.279464+0000","last_fullsized":"2023-08-31T19:26:23.279464+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300040+0000","last_change":"2023-08-31T19:26:23.292428+0000","last_active":"2023-08-31T19:26:23.300040+0000","last_peered":"2023-08-31T19:26:23.300040+0000","last_clean":"2023-08-31T19:26:23.300040+0000","last_became_active":"2023-08-31T19:26:23.292111+0000","last_became_peered":"2023-08-31T19:26:23.292111+0000","last_unstale":"2023-08-31T19:26:23.300040+0000","last_undegraded":"2023-08-31T19:26:23.300040+0000","last_fullsized":"2023-08-31T19:26:23.300040+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"194'1","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.310471+0000","last_change":"2023-08-31T19:26:22.830002+0000","last_active":"2023-08-31T19:26:23.310471+0000","last_peered":"2023-08-31T19:26:23.310471+0000","last_clean":"2023-08-31T19:26:23.310471+0000","last_became_active":"2023-08-31T19:26:22.829716+0000","last_became_peered":"2023-08-31T19:26:22.829716+0000","last_unstale":"2023-08-31T19:26:23.310471+0000","last_undegraded":"2023-08-31T19:26:23.310471+0000","last_fullsized":"2023-08-31T19:26:23.310471+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.304996+0000","last_change":"2023-08-31T19:26:23.298526+0000","last_active":"2023-08-31T19:26:23.304996+0000","last_peered":"2023-08-31T19:26:23.304996+0000","last_clean":"2023-08-31T19:26:23.304996+0000","last_became_active":"2023-08-31T19:26:23.298247+0000","last_became_peered":"2023-08-31T19:26:23.298247+0000","last_unstale":"2023-08-31T19:26:23.304996+0000","last_undegraded":"2023-08-31T19:26:23.304996+0000","last_fullsized":"2023-08-31T19:26:23.304996+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"194'2","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300232+0000","last_change":"2023-08-31T19:26:22.826772+0000","last_active":"2023-08-31T19:26:23.300232+0000","last_peered":"2023-08-31T19:26:23.300232+0000","last_clean":"2023-08-31T19:26:23.300232+0000","last_became_active":"2023-08-31T19:26:22.826396+0000","last_became_peered":"2023-08-31T19:26:22.826396+0000","last_unstale":"2023-08-31T19:26:23.300232+0000","last_undegraded":"2023-08-31T19:26:23.300232+0000","last_fullsized":"2023-08-31T19:26:23.300232+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.310466+0000","last_change":"2023-08-31T19:26:23.310466+0000","last_active":"2023-08-31T19:26:23.310466+0000","last_peered":"2023-08-31T19:26:23.310466+0000","last_clean":"2023-08-31T19:26:23.310466+0000","last_became_active":"2023-08-31T19:26:23.310164+0000","last_became_peered":"2023-08-31T19:26:23.310164+0000","last_unstale":"2023-08-31T19:26:23.310466+0000","last_undegraded":"2023-08-31T19:26:23.310466+0000","last_fullsized":"2023-08-31T19:26:23.310466+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.829825+0000","last_change":"2023-08-31T19:26:22.823991+0000","last_active":"2023-08-31T19:26:22.829825+0000","last_peered":"2023-08-31T19:26:22.829825+0000","last_clean":"2023-08-31T19:26:22.829825+0000","last_became_active":"2023-08-31T19:26:22.823709+0000","last_became_peered":"2023-08-31T19:26:22.823709+0000","last_unstale":"2023-08-31T19:26:22.829825+0000","last_undegraded":"2023-08-31T19:26:22.829825+0000","last_fullsized":"2023-08-31T19:26:22.829825+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.288039+0000","last_change":"2023-08-31T19:26:23.288039+0000","last_active":"2023-08-31T19:26:23.288039+0000","last_peered":"2023-08-31T19:26:23.288039+0000","last_clean":"2023-08-31T19:26:23.288039+0000","last_became_active":"2023-08-31T19:26:23.287669+0000","last_became_peered":"2023-08-31T19:26:23.287669+0000","last_unstale":"2023-08-31T19:26:23.288039+0000","last_undegraded":"2023-08-31T19:26:23.288039+0000","last_fullsized":"2023-08-31T19:26:23.288039+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280457+0000","last_change":"2023-08-31T19:26:22.828513+0000","last_active":"2023-08-31T19:26:23.280457+0000","last_peered":"2023-08-31T19:26:23.280457+0000","last_clean":"2023-08-31T19:26:23.280457+0000","last_became_active":"2023-08-31T19:26:22.828203+0000","last_became_peered":"2023-08-31T19:26:22.828203+0000","last_unstale":"2023-08-31T19:26:23.280457+0000","last_undegraded":"2023-08-31T19:26:23.280457+0000","last_fullsized":"2023-08-31T19:26:23.280457+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312363+0000","last_change":"2023-08-31T19:26:23.310972+0000","last_active":"2023-08-31T19:26:23.312363+0000","last_peered":"2023-08-31T19:26:23.312363+0000","last_clean":"2023-08-31T19:26:23.312363+0000","last_became_active":"2023-08-31T19:26:23.310711+0000","last_became_peered":"2023-08-31T19:26:23.310711+0000","last_unstale":"2023-08-31T19:26:23.312363+0000","last_undegraded":"2023-08-31T19:26:23.312363+0000","last_fullsized":"2023-08-31T19:26:23.312363+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"194'1","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.273808+0000","last_change":"2023-08-31T19:26:22.832571+0000","last_active":"2023-08-31T19:26:23.273808+0000","last_peered":"2023-08-31T19:26:23.273808+0000","last_clean":"2023-08-31T19:26:23.273808+0000","last_became_active":"2023-08-31T19:26:22.832024+0000","last_became_peered":"2023-08-31T19:26:22.832024+0000","last_unstale":"2023-08-31T19:26:23.273808+0000","last_undegraded":"2023-08-31T19:26:23.273808+0000","last_fullsized":"2023-08-31T19:26:23.273808+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.296632+0000","last_change":"2023-08-31T19:26:23.296632+0000","last_active":"2023-08-31T19:26:23.296632+0000","last_peered":"2023-08-31T19:26:23.296632+0000","last_clean":"2023-08-31T19:26:23.296632+0000","last_became_active":"2023-08-31T19:26:23.296228+0000","last_became_peered":"2023-08-31T19:26:23.296228+0000","last_unstale":"2023-08-31T19:26:23.296632+0000","last_undegraded":"2023-08-31T19:26:23.296632+0000","last_fullsized":"2023-08-31T19:26:23.296632+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.836654+0000","last_change":"2023-08-31T19:26:22.831088+0000","last_active":"2023-08-31T19:26:22.836654+0000","last_peered":"2023-08-31T19:26:22.836654+0000","last_clean":"2023-08-31T19:26:22.836654+0000","last_became_active":"2023-08-31T19:26:22.830806+0000","last_became_peered":"2023-08-31T19:26:22.830806+0000","last_unstale":"2023-08-31T19:26:22.836654+0000","last_undegraded":"2023-08-31T19:26:22.836654+0000","last_fullsized":"2023-08-31T19:26:22.836654+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.293563+0000","last_change":"2023-08-31T19:26:23.293563+0000","last_active":"2023-08-31T19:26:23.293563+0000","last_peered":"2023-08-31T19:26:23.293563+0000","last_clean":"2023-08-31T19:26:23.293563+0000","last_became_active":"2023-08-31T19:26:23.293269+0000","last_became_peered":"2023-08-31T19:26:23.293269+0000","last_unstale":"2023-08-31T19:26:23.293563+0000","last_undegraded":"2023-08-31T19:26:23.293563+0000","last_fullsized":"2023-08-31T19:26:23.293563+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.275688+0000","last_change":"2023-08-31T19:26:22.820874+0000","last_active":"2023-08-31T19:26:23.275688+0000","last_peered":"2023-08-31T19:26:23.275688+0000","last_clean":"2023-08-31T19:26:23.275688+0000","last_became_active":"2023-08-31T19:26:22.820248+0000","last_became_peered":"2023-08-31T19:26:22.820248+0000","last_unstale":"2023-08-31T19:26:23.275688+0000","last_undegraded":"2023-08-31T19:26:23.275688+0000","last_fullsized":"2023-08-31T19:26:23.275688+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.298111+0000","last_change":"2023-08-31T19:26:23.298111+0000","last_active":"2023-08-31T19:26:23.298111+0000","last_peered":"2023-08-31T19:26:23.298111+0000","last_clean":"2023-08-31T19:26:23.298111+0000","last_became_active":"2023-08-31T19:26:23.297780+0000","last_became_peered":"2023-08-31T19:26:23.297780+0000","last_unstale":"2023-08-31T19:26:23.298111+0000","last_undegraded":"2023-08-31T19:26:23.298111+0000","last_fullsized":"2023-08-31T19:26:23.298111+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.833398+0000","last_change":"2023-08-31T19:26:22.826260+0000","last_active":"2023-08-31T19:26:22.833398+0000","last_peered":"2023-08-31T19:26:22.833398+0000","last_clean":"2023-08-31T19:26:22.833398+0000","last_became_active":"2023-08-31T19:26:22.825787+0000","last_became_peered":"2023-08-31T19:26:22.825787+0000","last_unstale":"2023-08-31T19:26:22.833398+0000","last_undegraded":"2023-08-31T19:26:22.833398+0000","last_fullsized":"2023-08-31T19:26:22.833398+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.289846+0000","last_change":"2023-08-31T19:26:23.289846+0000","last_active":"2023-08-31T19:26:23.289846+0000","last_peered":"2023-08-31T19:26:23.289846+0000","last_clean":"2023-08-31T19:26:23.289846+0000","last_became_active":"2023-08-31T19:26:23.289561+0000","last_became_peered":"2023-08-31T19:26:23.289561+0000","last_unstale":"2023-08-31T19:26:23.289846+0000","last_undegraded":"2023-08-31T19:26:23.289846+0000","last_fullsized":"2023-08-31T19:26:23.289846+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"194'2","reported_seq":11,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.302481+0000","last_change":"2023-08-31T19:26:22.824982+0000","last_active":"2023-08-31T19:26:23.302481+0000","last_peered":"2023-08-31T19:26:23.302481+0000","last_clean":"2023-08-31T19:26:23.302481+0000","last_became_active":"2023-08-31T19:26:22.824690+0000","last_became_peered":"2023-08-31T19:26:22.824690+0000","last_unstale":"2023-08-31T19:26:23.302481+0000","last_undegraded":"2023-08-31T19:26:23.302481+0000","last_fullsized":"2023-08-31T19:26:23.302481+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300861+0000","last_change":"2023-08-31T19:26:23.292667+0000","last_active":"2023-08-31T19:26:23.300861+0000","last_peered":"2023-08-31T19:26:23.300861+0000","last_clean":"2023-08-31T19:26:23.300861+0000","last_became_active":"2023-08-31T19:26:23.292257+0000","last_became_peered":"2023-08-31T19:26:23.292257+0000","last_unstale":"2023-08-31T19:26:23.300861+0000","last_undegraded":"2023-08-31T19:26:23.300861+0000","last_fullsized":"2023-08-31T19:26:23.300861+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.279801+0000","last_change":"2023-08-31T19:26:22.827685+0000","last_active":"2023-08-31T19:26:23.279801+0000","last_peered":"2023-08-31T19:26:23.279801+0000","last_clean":"2023-08-31T19:26:23.279801+0000","last_became_active":"2023-08-31T19:26:22.827129+0000","last_became_peered":"2023-08-31T19:26:22.827129+0000","last_unstale":"2023-08-31T19:26:23.279801+0000","last_undegraded":"2023-08-31T19:26:23.279801+0000","last_fullsized":"2023-08-31T19:26:23.279801+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.292760+0000","last_change":"2023-08-31T19:26:23.289471+0000","last_active":"2023-08-31T19:26:23.292760+0000","last_peered":"2023-08-31T19:26:23.292760+0000","last_clean":"2023-08-31T19:26:23.292760+0000","last_became_active":"2023-08-31T19:26:23.289200+0000","last_became_peered":"2023-08-31T19:26:23.289200+0000","last_unstale":"2023-08-31T19:26:23.292760+0000","last_undegraded":"2023-08-31T19:26:23.292760+0000","last_fullsized":"2023-08-31T19:26:23.292760+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.283127+0000","last_change":"2023-08-31T19:26:22.828005+0000","last_active":"2023-08-31T19:26:23.283127+0000","last_peered":"2023-08-31T19:26:23.283127+0000","last_clean":"2023-08-31T19:26:23.283127+0000","last_became_active":"2023-08-31T19:26:22.827702+0000","last_became_peered":"2023-08-31T19:26:22.827702+0000","last_unstale":"2023-08-31T19:26:23.283127+0000","last_undegraded":"2023-08-31T19:26:23.283127+0000","last_fullsized":"2023-08-31T19:26:23.283127+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.300381+0000","last_change":"2023-08-31T19:26:23.292505+0000","last_active":"2023-08-31T19:26:23.300381+0000","last_peered":"2023-08-31T19:26:23.300381+0000","last_clean":"2023-08-31T19:26:23.300381+0000","last_became_active":"2023-08-31T19:26:23.292227+0000","last_became_peered":"2023-08-31T19:26:23.292227+0000","last_unstale":"2023-08-31T19:26:23.300381+0000","last_undegraded":"2023-08-31T19:26:23.300381+0000","last_fullsized":"2023-08-31T19:26:23.300381+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.276080+0000","last_change":"2023-08-31T19:26:22.834437+0000","last_active":"2023-08-31T19:26:23.276080+0000","last_peered":"2023-08-31T19:26:23.276080+0000","last_clean":"2023-08-31T19:26:23.276080+0000","last_became_active":"2023-08-31T19:26:22.834114+0000","last_became_peered":"2023-08-31T19:26:22.834114+0000","last_unstale":"2023-08-31T19:26:23.276080+0000","last_undegraded":"2023-08-31T19:26:23.276080+0000","last_fullsized":"2023-08-31T19:26:23.276080+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.312389+0000","last_change":"2023-08-31T19:26:23.306688+0000","last_active":"2023-08-31T19:26:23.312389+0000","last_peered":"2023-08-31T19:26:23.312389+0000","last_clean":"2023-08-31T19:26:23.312389+0000","last_became_active":"2023-08-31T19:26:23.306262+0000","last_became_peered":"2023-08-31T19:26:23.306262+0000","last_unstale":"2023-08-31T19:26:23.312389+0000","last_undegraded":"2023-08-31T19:26:23.312389+0000","last_fullsized":"2023-08-31T19:26:23.312389+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.293044+0000","last_change":"2023-08-31T19:26:22.833476+0000","last_active":"2023-08-31T19:26:23.293044+0000","last_peered":"2023-08-31T19:26:23.293044+0000","last_clean":"2023-08-31T19:26:23.293044+0000","last_became_active":"2023-08-31T19:26:22.833186+0000","last_became_peered":"2023-08-31T19:26:22.833186+0000","last_unstale":"2023-08-31T19:26:23.293044+0000","last_undegraded":"2023-08-31T19:26:23.293044+0000","last_fullsized":"2023-08-31T19:26:23.293044+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.296441+0000","last_change":"2023-08-31T19:26:23.296441+0000","last_active":"2023-08-31T19:26:23.296441+0000","last_peered":"2023-08-31T19:26:23.296441+0000","last_clean":"2023-08-31T19:26:23.296441+0000","last_became_active":"2023-08-31T19:26:23.296118+0000","last_became_peered":"2023-08-31T19:26:23.296118+0000","last_unstale":"2023-08-31T19:26:23.296441+0000","last_undegraded":"2023-08-31T19:26:23.296441+0000","last_fullsized":"2023-08-31T19:26:23.296441+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280499+0000","last_change":"2023-08-31T19:26:22.829586+0000","last_active":"2023-08-31T19:26:23.280499+0000","last_peered":"2023-08-31T19:26:23.280499+0000","last_clean":"2023-08-31T19:26:23.280499+0000","last_became_active":"2023-08-31T19:26:22.828746+0000","last_became_peered":"2023-08-31T19:26:22.828746+0000","last_unstale":"2023-08-31T19:26:23.280499+0000","last_undegraded":"2023-08-31T19:26:23.280499+0000","last_fullsized":"2023-08-31T19:26:23.280499+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.305475+0000","last_change":"2023-08-31T19:26:23.303619+0000","last_active":"2023-08-31T19:26:23.305475+0000","last_peered":"2023-08-31T19:26:23.305475+0000","last_clean":"2023-08-31T19:26:23.305475+0000","last_became_active":"2023-08-31T19:26:23.303323+0000","last_became_peered":"2023-08-31T19:26:23.303323+0000","last_unstale":"2023-08-31T19:26:23.305475+0000","last_undegraded":"2023-08-31T19:26:23.305475+0000","last_fullsized":"2023-08-31T19:26:23.305475+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.822497+0000","last_change":"2023-08-31T19:26:22.820586+0000","last_active":"2023-08-31T19:26:22.822497+0000","last_peered":"2023-08-31T19:26:22.822497+0000","last_clean":"2023-08-31T19:26:22.822497+0000","last_became_active":"2023-08-31T19:26:22.820305+0000","last_became_peered":"2023-08-31T19:26:22.820305+0000","last_unstale":"2023-08-31T19:26:22.822497+0000","last_undegraded":"2023-08-31T19:26:22.822497+0000","last_fullsized":"2023-08-31T19:26:22.822497+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.292237+0000","last_change":"2023-08-31T19:26:23.288674+0000","last_active":"2023-08-31T19:26:23.292237+0000","last_peered":"2023-08-31T19:26:23.292237+0000","last_clean":"2023-08-31T19:26:23.292237+0000","last_became_active":"2023-08-31T19:26:23.288403+0000","last_became_peered":"2023-08-31T19:26:23.288403+0000","last_unstale":"2023-08-31T19:26:23.292237+0000","last_undegraded":"2023-08-31T19:26:23.292237+0000","last_fullsized":"2023-08-31T19:26:23.292237+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.831369+0000","last_change":"2023-08-31T19:26:22.827474+0000","last_active":"2023-08-31T19:26:22.831369+0000","last_peered":"2023-08-31T19:26:22.831369+0000","last_clean":"2023-08-31T19:26:22.831369+0000","last_became_active":"2023-08-31T19:26:22.826814+0000","last_became_peered":"2023-08-31T19:26:22.826814+0000","last_unstale":"2023-08-31T19:26:22.831369+0000","last_undegraded":"2023-08-31T19:26:22.831369+0000","last_fullsized":"2023-08-31T19:26:22.831369+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.288423+0000","last_change":"2023-08-31T19:26:23.288423+0000","last_active":"2023-08-31T19:26:23.288423+0000","last_peered":"2023-08-31T19:26:23.288423+0000","last_clean":"2023-08-31T19:26:23.288423+0000","last_became_active":"2023-08-31T19:26:23.288114+0000","last_became_peered":"2023-08-31T19:26:23.288114+0000","last_unstale":"2023-08-31T19:26:23.288423+0000","last_undegraded":"2023-08-31T19:26:23.288423+0000","last_fullsized":"2023-08-31T19:26:23.288423+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.836259+0000","last_change":"2023-08-31T19:26:22.828056+0000","last_active":"2023-08-31T19:26:22.836259+0000","last_peered":"2023-08-31T19:26:22.836259+0000","last_clean":"2023-08-31T19:26:22.836259+0000","last_became_active":"2023-08-31T19:26:22.827759+0000","last_became_peered":"2023-08-31T19:26:22.827759+0000","last_unstale":"2023-08-31T19:26:22.836259+0000","last_undegraded":"2023-08-31T19:26:22.836259+0000","last_fullsized":"2023-08-31T19:26:22.836259+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":176,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.281461+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:26:23.281461+0000","last_peered":"2023-08-31T19:26:23.281461+0000","last_clean":"2023-08-31T19:26:23.281461+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:26:23.281461+0000","last_undegraded":"2023-08-31T19:26:23.281461+0000","last_fullsized":"2023-08-31T19:26:23.281461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.297395+0000","last_change":"2023-08-31T19:26:23.297395+0000","last_active":"2023-08-31T19:26:23.297395+0000","last_peered":"2023-08-31T19:26:23.297395+0000","last_clean":"2023-08-31T19:26:23.297395+0000","last_became_active":"2023-08-31T19:26:23.296366+0000","last_became_peered":"2023-08-31T19:26:23.296366+0000","last_unstale":"2023-08-31T19:26:23.297395+0000","last_undegraded":"2023-08-31T19:26:23.297395+0000","last_fullsized":"2023-08-31T19:26:23.297395+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.279768+0000","last_change":"2023-08-31T19:26:22.826969+0000","last_active":"2023-08-31T19:26:23.279768+0000","last_peered":"2023-08-31T19:26:23.279768+0000","last_clean":"2023-08-31T19:26:23.279768+0000","last_became_active":"2023-08-31T19:26:22.826658+0000","last_became_peered":"2023-08-31T19:26:22.826658+0000","last_unstale":"2023-08-31T19:26:23.279768+0000","last_undegraded":"2023-08-31T19:26:23.279768+0000","last_fullsized":"2023-08-31T19:26:23.279768+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":164,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.815474+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:26:22.815474+0000","last_peered":"2023-08-31T19:26:22.815474+0000","last_clean":"2023-08-31T19:26:22.815474+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:26:22.815474+0000","last_undegraded":"2023-08-31T19:26:22.815474+0000","last_fullsized":"2023-08-31T19:26:22.815474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.296756+0000","last_change":"2023-08-31T19:26:23.294412+0000","last_active":"2023-08-31T19:26:23.296756+0000","last_peered":"2023-08-31T19:26:23.296756+0000","last_clean":"2023-08-31T19:26:23.296756+0000","last_became_active":"2023-08-31T19:26:23.294119+0000","last_became_peered":"2023-08-31T19:26:23.294119+0000","last_unstale":"2023-08-31T19:26:23.296756+0000","last_undegraded":"2023-08-31T19:26:23.296756+0000","last_fullsized":"2023-08-31T19:26:23.296756+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"194'2","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.301785+0000","last_change":"2023-08-31T19:26:22.828582+0000","last_active":"2023-08-31T19:26:23.301785+0000","last_peered":"2023-08-31T19:26:23.301785+0000","last_clean":"2023-08-31T19:26:23.301785+0000","last_became_active":"2023-08-31T19:26:22.828315+0000","last_became_peered":"2023-08-31T19:26:22.828315+0000","last_unstale":"2023-08-31T19:26:23.301785+0000","last_undegraded":"2023-08-31T19:26:23.301785+0000","last_fullsized":"2023-08-31T19:26:23.301785+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.275588+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:26:23.275588+0000","last_peered":"2023-08-31T19:26:23.275588+0000","last_clean":"2023-08-31T19:26:23.275588+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:26:23.275588+0000","last_undegraded":"2023-08-31T19:26:23.275588+0000","last_fullsized":"2023-08-31T19:26:23.275588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":8,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.298232+0000","last_change":"2023-08-31T19:26:23.298232+0000","last_active":"2023-08-31T19:26:23.298232+0000","last_peered":"2023-08-31T19:26:23.298232+0000","last_clean":"2023-08-31T19:26:23.298232+0000","last_became_active":"2023-08-31T19:26:23.297915+0000","last_became_peered":"2023-08-31T19:26:23.297915+0000","last_unstale":"2023-08-31T19:26:23.298232+0000","last_undegraded":"2023-08-31T19:26:23.298232+0000","last_fullsized":"2023-08-31T19:26:23.298232+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.279689+0000","last_change":"2023-08-31T19:26:22.827396+0000","last_active":"2023-08-31T19:26:23.279689+0000","last_peered":"2023-08-31T19:26:23.279689+0000","last_clean":"2023-08-31T19:26:23.279689+0000","last_became_active":"2023-08-31T19:26:22.826820+0000","last_became_peered":"2023-08-31T19:26:22.826820+0000","last_unstale":"2023-08-31T19:26:23.279689+0000","last_undegraded":"2023-08-31T19:26:23.279689+0000","last_fullsized":"2023-08-31T19:26:23.279689+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":164,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.814467+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:26:22.814467+0000","last_peered":"2023-08-31T19:26:22.814467+0000","last_clean":"2023-08-31T19:26:22.814467+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:26:22.814467+0000","last_undegraded":"2023-08-31T19:26:22.814467+0000","last_fullsized":"2023-08-31T19:26:22.814467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":163,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.809887+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:26:22.809887+0000","last_peered":"2023-08-31T19:26:22.809887+0000","last_clean":"2023-08-31T19:26:22.809887+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:26:22.809887+0000","last_undegraded":"2023-08-31T19:26:22.809887+0000","last_fullsized":"2023-08-31T19:26:22.809887+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.305377+0000","last_change":"2023-08-31T19:26:23.301959+0000","last_active":"2023-08-31T19:26:23.305377+0000","last_peered":"2023-08-31T19:26:23.305377+0000","last_clean":"2023-08-31T19:26:23.305377+0000","last_became_active":"2023-08-31T19:26:23.301665+0000","last_became_peered":"2023-08-31T19:26:23.301665+0000","last_unstale":"2023-08-31T19:26:23.305377+0000","last_undegraded":"2023-08-31T19:26:23.305377+0000","last_fullsized":"2023-08-31T19:26:23.305377+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"194'3","reported_seq":13,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.309734+0000","last_change":"2023-08-31T19:26:22.824836+0000","last_active":"2023-08-31T19:26:23.309734+0000","last_peered":"2023-08-31T19:26:23.309734+0000","last_clean":"2023-08-31T19:26:23.309734+0000","last_became_active":"2023-08-31T19:26:22.824502+0000","last_became_peered":"2023-08-31T19:26:22.824502+0000","last_unstale":"2023-08-31T19:26:23.309734+0000","last_undegraded":"2023-08-31T19:26:23.309734+0000","last_fullsized":"2023-08-31T19:26:23.309734+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":162,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.809978+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:26:22.809978+0000","last_peered":"2023-08-31T19:26:22.809978+0000","last_clean":"2023-08-31T19:26:22.809978+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:26:22.809978+0000","last_undegraded":"2023-08-31T19:26:22.809978+0000","last_fullsized":"2023-08-31T19:26:22.809978+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.305615+0000","last_change":"2023-08-31T19:26:23.303892+0000","last_active":"2023-08-31T19:26:23.305615+0000","last_peered":"2023-08-31T19:26:23.305615+0000","last_clean":"2023-08-31T19:26:23.305615+0000","last_became_active":"2023-08-31T19:26:23.303610+0000","last_became_peered":"2023-08-31T19:26:23.303610+0000","last_unstale":"2023-08-31T19:26:23.305615+0000","last_undegraded":"2023-08-31T19:26:23.305615+0000","last_fullsized":"2023-08-31T19:26:23.305615+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"194'4","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.302553+0000","last_change":"2023-08-31T19:26:22.826221+0000","last_active":"2023-08-31T19:26:23.302553+0000","last_peered":"2023-08-31T19:26:23.302553+0000","last_clean":"2023-08-31T19:26:23.302553+0000","last_became_active":"2023-08-31T19:26:22.825941+0000","last_became_peered":"2023-08-31T19:26:22.825941+0000","last_unstale":"2023-08-31T19:26:23.302553+0000","last_undegraded":"2023-08-31T19:26:23.302553+0000","last_fullsized":"2023-08-31T19:26:23.302553+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-08-31T19:26:22.811316+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:26:22.811316+0000","last_peered":"2023-08-31T19:26:22.811316+0000","last_clean":"2023-08-31T19:26:22.811316+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:26:22.811316+0000","last_undegraded":"2023-08-31T19:26:22.811316+0000","last_fullsized":"2023-08-31T19:26:22.811316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.304933+0000","last_change":"2023-08-31T19:26:23.299676+0000","last_active":"2023-08-31T19:26:23.304933+0000","last_peered":"2023-08-31T19:26:23.304933+0000","last_clean":"2023-08-31T19:26:23.304933+0000","last_became_active":"2023-08-31T19:26:23.299345+0000","last_became_peered":"2023-08-31T19:26:23.299345+0000","last_unstale":"2023-08-31T19:26:23.304933+0000","last_undegraded":"2023-08-31T19:26:23.304933+0000","last_fullsized":"2023-08-31T19:26:23.304933+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"194'1","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.273707+0000","last_change":"2023-08-31T19:26:22.825210+0000","last_active":"2023-08-31T19:26:23.273707+0000","last_peered":"2023-08-31T19:26:23.273707+0000","last_clean":"2023-08-31T19:26:23.273707+0000","last_became_active":"2023-08-31T19:26:22.824900+0000","last_became_peered":"2023-08-31T19:26:22.824900+0000","last_unstale":"2023-08-31T19:26:23.273707+0000","last_undegraded":"2023-08-31T19:26:23.273707+0000","last_fullsized":"2023-08-31T19:26:23.273707+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":176,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280414+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:26:23.280414+0000","last_peered":"2023-08-31T19:26:23.280414+0000","last_clean":"2023-08-31T19:26:23.280414+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:26:23.280414+0000","last_undegraded":"2023-08-31T19:26:23.280414+0000","last_fullsized":"2023-08-31T19:26:23.280414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.301011+0000","last_change":"2023-08-31T19:26:23.293108+0000","last_active":"2023-08-31T19:26:23.301011+0000","last_peered":"2023-08-31T19:26:23.301011+0000","last_clean":"2023-08-31T19:26:23.301011+0000","last_became_active":"2023-08-31T19:26:23.292694+0000","last_became_peered":"2023-08-31T19:26:23.292694+0000","last_unstale":"2023-08-31T19:26:23.301011+0000","last_undegraded":"2023-08-31T19:26:23.301011+0000","last_fullsized":"2023-08-31T19:26:23.301011+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:22.794300+0000","last_clean_scrub_stamp":"2023-08-31T19:26:22.794300+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280408+0000","last_change":"2023-08-31T19:26:22.829772+0000","last_active":"2023-08-31T19:26:23.280408+0000","last_peered":"2023-08-31T19:26:23.280408+0000","last_clean":"2023-08-31T19:26:23.280408+0000","last_became_active":"2023-08-31T19:26:22.829138+0000","last_became_peered":"2023-08-31T19:26:22.829138+0000","last_unstale":"2023-08-31T19:26:23.280408+0000","last_undegraded":"2023-08-31T19:26:23.280408+0000","last_fullsized":"2023-08-31T19:26:23.280408+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:21.786879+0000","last_clean_scrub_stamp":"2023-08-31T19:26:21.786879+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":182,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-08-31T19:26:23.280210+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:26:23.280210+0000","last_peered":"2023-08-31T19:26:23.280210+0000","last_clean":"2023-08-31T19:26:23.280210+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:26:23.280210+0000","last_undegraded":"2023-08-31T19:26:23.280210+0000","last_fullsized":"2023-08-31T19:26:23.280210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575304,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303568,"kb_used_data":2376,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068272,"statfs":{"total":96636764160,"available":96325910528,"internally_reserved":0,"allocated":2433024,"data_stored":1323859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.38200000000000001},"max":{"1min":0.90200000000000002,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.54700000000000004},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.98599999999999999},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41199999999999998},"max":{"1min":0.84799999999999998,"5min":0.92000000000000004,"15min":0.999},"last":0.56000000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.55300000000000005,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.45200000000000001},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68100000000000005,"15min":0.70399999999999996},"min":{"1min":0.55700000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.006},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73399999999999999,"15min":0.746},"min":{"1min":0.56000000000000005,"5min":0.48899999999999999,"15min":0.48599999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.89100000000000001,"15min":0.96499999999999997},"last":0.624},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.52500000000000002,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"max":{"1min":0.85799999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90100000000000002,"5min":1.0109999999999999,"15min":1.0449999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45200000000000001,"15min":0.442},"max":{"1min":0.90200000000000002,"5min":0.96799999999999997,"15min":0.98999999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.47199999999999998,"5min":0.45500000000000002,"15min":0.42999999999999999},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.73999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575303,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307672,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064168,"statfs":{"total":96636764160,"available":96321708032,"internally_reserved":0,"allocated":2441216,"data_stored":1330665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.33800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.05},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0669999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.54200000000000004,"5min":0.502,"15min":0.45500000000000002},"max":{"1min":0.96299999999999997,"5min":1.0149999999999999,"15min":1.1579999999999999},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.745,"15min":0.746},"min":{"1min":0.53600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.198},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.1060000000000001},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90000000000000002,"5min":0.97399999999999998,"15min":1.0089999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77900000000000003,"15min":0.77700000000000002},"min":{"1min":0.57299999999999995,"5min":0.54100000000000004,"15min":0.495},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.296},"last":0.501}]},{"osd":4,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90600000000000003,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.66000000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.43099999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68000000000000005,"15min":0.67800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97899999999999998,"5min":1.032,"15min":1.3280000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.71299999999999997},"min":{"1min":0.54300000000000004,"5min":0.48699999999999999,"15min":0.47299999999999998},"max":{"1min":1.2649999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.73199999999999998,"15min":0.71099999999999997},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.46200000000000002},"max":{"1min":1.1639999999999999,"5min":1.165,"15min":1.165},"last":0.753},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77300000000000002,"15min":0.76200000000000001},"min":{"1min":0.52700000000000002,"5min":0.505,"15min":0.48499999999999999},"max":{"1min":1.117,"5min":1.2270000000000001,"15min":1.24},"last":0.71999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575304,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303580,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068260,"statfs":{"total":96636764160,"available":96325898240,"internally_reserved":0,"allocated":2445312,"data_stored":1330417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.45000000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.66100000000000003,"15min":0.68100000000000005},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.35099999999999998,"5min":0.317,"15min":0.31},"max":{"1min":0.61699999999999999,"5min":0.71799999999999997,"15min":0.76400000000000001},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.496,"15min":0.51800000000000002},"min":{"1min":0.39800000000000002,"5min":0.36399999999999999,"15min":0.31},"max":{"1min":0.752,"5min":0.752,"15min":0.75800000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.35199999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.83799999999999997},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68600000000000005,"5min":0.77100000000000002,"15min":0.79200000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.96699999999999997},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.55700000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.169,"15min":1.1839999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.80400000000000005,"15min":0.82799999999999996},"min":{"1min":0.622,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78800000000000003},"min":{"1min":0.57299999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.262},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.75700000000000001,"15min":0.78800000000000003},"min":{"1min":0.621,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.165,"5min":1.198,"15min":1.198},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.58299999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.115,"5min":1.115,"15min":1.2849999999999999},"last":0.747}]},{"osd":7,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.77500000000000002,"15min":0.80000000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.085,"5min":1.097,"15min":1.224},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.59499999999999997,"5min":0.53300000000000003,"15min":0.51000000000000001},"max":{"1min":1.0569999999999999,"5min":1.1579999999999999,"15min":1.1859999999999999},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575303,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303564,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068276,"statfs":{"total":96636764160,"available":96325914624,"internally_reserved":0,"allocated":2428928,"data_stored":1322447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67000000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73299999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":0.72899999999999998,"15min":0.77000000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.751,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.442}]},{"osd":3,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.373,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64400000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.376},"max":{"1min":0.71899999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.63500000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.872,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.60999999999999999,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.347},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.75700000000000001,"15min":0.76900000000000002},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79900000000000004,"15min":0.80500000000000005},"min":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.21},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.83499999999999996,"15min":0.83999999999999997},"min":{"1min":0.67100000000000004,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.87}]},{"osd":7,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.24},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.65700000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.3340000000000001},"last":0.88600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575303,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303564,"kb_used_data":2372,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068276,"statfs":{"total":96636764160,"available":96325914624,"internally_reserved":0,"allocated":2428928,"data_stored":1322483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.502,"15min":0.501},"min":{"1min":0.35499999999999998,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.77600000000000002},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Aug 31 19:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35099999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.81899999999999995},"last":0.432},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.38900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73299999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51600000000000001,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68799999999999994,"5min":0.72799999999999998,"15min":0.73099999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57399999999999995,"15min":0.57899999999999996},"min":{"1min":0.433,"5min":0.42299999999999999,"15min":0.39900000000000002},"max":{"1min":0.71599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80600000000000005,"15min":0.79400000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0940000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.745},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79600000000000004,"15min":0.79500000000000004},"min":{"1min":0.63600000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.079,"5min":1.1040000000000001,"15min":1.304},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51300000000000001},"max":{"1min":1.1659999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81999999999999995,"15min":0.81000000000000005},"min":{"1min":0.67300000000000004,"5min":0.58499999999999996,"15min":0.58299999999999996},"max":{"1min":1.0489999999999999,"5min":1.2030000000000001,"15min":1.256},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.82699999999999996,"15min":0.81799999999999995},"min":{"1min":0.625,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1240000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81399999999999995,"15min":0.81499999999999995},"min":{"1min":0.57199999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1240000000000001,"5min":1.2310000000000001,"15min":1.27},"last":0.874}]},{"osd":7,"last update":"Thu Aug 31 19:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.83499999999999996,"15min":0.82499999999999996},"min":{"1min":0.63500000000000001,"5min":0.56299999999999994,"15min":0.54400000000000004},"max":{"1min":1.111,"5min":1.302,"15min":1.302},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83099999999999996,"15min":0.83199999999999996},"min":{"1min":0.60399999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.097,"5min":1.3280000000000001,"15min":1.3740000000000001},"last":0.80500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575303,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307680,"kb_used_data":2392,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064160,"statfs":{"total":96636764160,"available":96321699840,"internally_reserved":0,"allocated":2449408,"data_stored":1330439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.437,"15min":0.443},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59799999999999998,"5min":0.69099999999999995,"15min":0.71899999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.65800000000000003,"5min":0.72099999999999997,"15min":0.77600000000000002},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.35599999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65500000000000003,"5min":0.66800000000000004,"15min":0.77600000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.46700000000000003,"5min":0.41699999999999998,"15min":0.379},"max":{"1min":0.73099999999999998,"5min":0.82499999999999996,"15min":0.90400000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.88300000000000001,"15min":0.95399999999999996},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78200000000000003,"15min":0.76400000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1739999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.78200000000000003,"15min":0.77300000000000002},"min":{"1min":0.61899999999999999,"5min":0.56399999999999995,"15min":0.47899999999999998},"max":{"1min":1.1120000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63}]},{"osd":5,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.67000000000000004,"5min":0.53800000000000003,"15min":0.52400000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.6839999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.505},"max":{"1min":1.008,"5min":1.149,"15min":1.1819999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80800000000000005,"15min":0.80100000000000005},"min":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.153,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.79700000000000004,"15min":0.79900000000000004},"min":{"1min":0.61199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.2849999999999999},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81000000000000005,"15min":0.80900000000000005},"min":{"1min":0.64900000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.381},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81599999999999995,"15min":0.80900000000000005},"min":{"1min":0.70699999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2410000000000001,"5min":1.244,"15min":1.244},"last":0.72299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575303,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303584,"kb_used_data":2392,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068256,"statfs":{"total":96636764160,"available":96325894144,"internally_reserved":0,"allocated":2449408,"data_stored":1329955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88100000000000001,"5min":0.95899999999999996,"15min":1.048},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.51800000000000002,"5min":0.45500000000000002,"15min":0.38500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.98199999999999998},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.495,"5min":0.49099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90100000000000002,"5min":0.98699999999999999,"15min":1.0289999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71899999999999997,"15min":0.72799999999999998},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.93100000000000005,"5min":0.995,"15min":1},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98199999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.51600000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.996},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.72499999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91200000000000003,"5min":0.95699999999999996,"15min":0.97699999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.753,"15min":0.755},"min":{"1min":0.56899999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94899999999999995,"5min":1.056,"15min":1.056},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.40699999999999997,"15min":0.39600000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95799999999999996},"last":0.624},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.442,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":0.82199999999999995,"5min":0.91900000000000004,"15min":0.98799999999999999},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.45700000000000002,"5min":0.44700000000000001,"15min":0.42299999999999999},"max":{"1min":0.80900000000000005,"5min":1.01,"15min":1.0649999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.498,"5min":0.46500000000000002,"15min":0.46300000000000002},"max":{"1min":0.91500000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.94899999999999995,"15min":1.0049999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.46300000000000002},"max":{"1min":0.94599999999999995,"5min":1.0369999999999999,"15min":1.115},"last":0.73699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575303,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303572,"kb_used_data":2380,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068268,"statfs":{"total":96636764160,"available":96325906432,"internally_reserved":0,"allocated":2437120,"data_stored":1323091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.72499999999999998},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.41099999999999998},"max":{"1min":0.89000000000000001,"5min":1.141,"15min":1.141},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89700000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86899999999999999,"5min":1.103,"15min":1.103},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92800000000000005,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":0.72499999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86699999999999999,"5min":1.026,"15min":1.026},"last":0.442},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":0.91100000000000003,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.747,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51400000000000001},"max":{"1min":0.89900000000000002,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96299999999999997,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.627,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.379},"max":{"1min":0.78100000000000003,"5min":0.997,"15min":0.997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.64700000000000002,"15min":0.63200000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.41299999999999998},"max":{"1min":0.84999999999999998,"5min":1.117,"15min":1.117},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.48399999999999999,"5min":0.44700000000000001,"15min":0.40000000000000002},"max":{"1min":0.81699999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70499999999999996,"15min":0.69499999999999995},"min":{"1min":0.52500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93500000000000005,"5min":1.2,"15min":1.2},"last":0.62}]},{"osd":7,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70899999999999996,"15min":0.70799999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47799999999999998},"max":{"1min":0.82399999999999995,"5min":1.202,"15min":1.202},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.48699999999999999},"max":{"1min":0.878,"5min":1.004,"15min":1.004},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:26:27.996 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T19:26:27.996 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-31T19:26:28.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.224+0000 7f7bc83ff700 1 Processor -- start 2023-08-31T19:26:28.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.224+0000 7f7bc83ff700 1 -- start start 2023-08-31T19:26:28.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.225+0000 7f7bc83ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7bc0153e30 0x7f7bc0154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:28.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.225+0000 7f7bc83ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc00c5cb0 0x7f7bc00c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:28.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.225+0000 7f7bc83ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc00bfd40 con 0x7f7bc00630b0 2023-08-31T19:26:28.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.225+0000 7f7bc83ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc00c6730 con 0x7f7bc0153e30 2023-08-31T19:26:28.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.225+0000 7f7bc83ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00bffe0 con 0x7f7bc00c5cb0 2023-08-31T19:26:28.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.225+0000 7f7bc699c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7bc00630b0 0x7f7bc0157d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38904/0 (socket says 172.21.15.72:38904) 2023-08-31T19:26:28.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.225+0000 7f7bc699c700 1 -- 172.21.15.72:0/2583231293 learned_addr learned my addr 172.21.15.72:0/2583231293 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:28.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.225+0000 7f7bc619b700 1 --2- 172.21.15.72:0/2583231293 >> v2:172.21.15.146:3300/0 conn(0x7f7bc0153e30 0x7f7bc0154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:28.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.225+0000 7f7bc599a700 1 --2- 172.21.15.72:0/2583231293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc00c5cb0 0x7f7bc00c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:28.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.226+0000 7f7bc5199700 1 -- 172.21.15.72:0/2583231293 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048887296 0 0) 0x7f7bc00bfd40 con 0x7f7bc00630b0 2023-08-31T19:26:28.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.226+0000 7f7bc5199700 1 -- 172.21.15.72:0/2583231293 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bac0033f0 con 0x7f7bc00630b0 2023-08-31T19:26:28.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.226+0000 7f7bc619b700 1 -- 172.21.15.72:0/2583231293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc00c5cb0 msgr2=0x7f7bc00c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:28.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.226+0000 7f7bc619b700 1 --2- 172.21.15.72:0/2583231293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc00c5cb0 0x7f7bc00c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.226+0000 7f7bc619b700 1 -- 172.21.15.72:0/2583231293 >> v1:172.21.15.72:6789/0 conn(0x7f7bc00630b0 legacy=0x7f7bc0157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.226+0000 7f7bc619b700 1 -- 172.21.15.72:0/2583231293 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc00c02c0 con 0x7f7bc0153e30 2023-08-31T19:26:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.226+0000 7f7bc599a700 1 --2- 172.21.15.72:0/2583231293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc00c5cb0 0x7f7bc00c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.226+0000 7f7bc619b700 1 --2- 172.21.15.72:0/2583231293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bc0153e30 0x7f7bc0154210 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f7bbc009760 tx=0x7f7bbc009060).ready entity=mon.1 client_cookie=8b2051ffc14fcc9b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.226+0000 7f7bc5199700 1 -- 172.21.15.72:0/2583231293 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc0090d0 con 0x7f7bc0153e30 2023-08-31T19:26:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.226+0000 7f7bc5199700 1 -- 172.21.15.72:0/2583231293 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc00d4a0 con 0x7f7bc0153e30 2023-08-31T19:26:28.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.226+0000 7f7bc5199700 1 -- 172.21.15.72:0/2583231293 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00d820 con 0x7f7bc0153e30 2023-08-31T19:26:28.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.227+0000 7f7bc83ff700 1 -- 172.21.15.72:0/2583231293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bc0153e30 msgr2=0x7f7bc0154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:28.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.227+0000 7f7bc83ff700 1 --2- 172.21.15.72:0/2583231293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bc0153e30 0x7f7bc0154210 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f7bbc009760 tx=0x7f7bbc009060).stop 2023-08-31T19:26:28.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.227+0000 7f7bc83ff700 1 -- 172.21.15.72:0/2583231293 shutdown_connections 2023-08-31T19:26:28.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.227+0000 7f7bc83ff700 1 --2- 172.21.15.72:0/2583231293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bc0153e30 0x7f7bc0154210 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.227+0000 7f7bc83ff700 1 --2- 172.21.15.72:0/2583231293 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc00c5cb0 0x7f7bc00c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.227+0000 7f7bc83ff700 1 -- 172.21.15.72:0/2583231293 >> 172.21.15.72:0/2583231293 conn(0x7f7bc005eb20 msgr2=0x7f7bc00cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:28.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.227+0000 7f7bc83ff700 1 -- 172.21.15.72:0/2583231293 shutdown_connections 2023-08-31T19:26:28.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.227+0000 7f7bc83ff700 1 -- 172.21.15.72:0/2583231293 wait complete. 2023-08-31T19:26:28.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.229+0000 7f7bc83ff700 1 Processor -- start 2023-08-31T19:26:28.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.229+0000 7f7bc83ff700 1 -- start start 2023-08-31T19:26:28.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc83ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc00630b0 0x7f7bc00b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:28.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc83ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc00c5cb0 0x7f7bc01591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:28.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc83ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bc0153e30 0x7f7bc01656b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:28.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc83ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc014f4d0 con 0x7f7bc00630b0 2023-08-31T19:26:28.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc83ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00b0560 con 0x7f7bc0153e30 2023-08-31T19:26:28.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc83ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00c2240 con 0x7f7bc00c5cb0 2023-08-31T19:26:28.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc619b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc00630b0 0x7f7bc00b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:28.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc619b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc00630b0 0x7f7bc00b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59188/0 (socket says 172.21.15.72:59188) 2023-08-31T19:26:28.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc619b700 1 -- 172.21.15.72:0/1520066791 learned_addr learned my addr 172.21.15.72:0/1520066791 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:28.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc599a700 1 --2- 172.21.15.72:0/1520066791 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc00c5cb0 0x7f7bc01591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:28.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc699c700 1 --2- 172.21.15.72:0/1520066791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bc0153e30 0x7f7bc01656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:28.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc619b700 1 -- 172.21.15.72:0/1520066791 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc00c5cb0 msgr2=0x7f7bc01591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:28.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc619b700 1 --2- 172.21.15.72:0/1520066791 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc00c5cb0 0x7f7bc01591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc619b700 1 -- 172.21.15.72:0/1520066791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bc0153e30 msgr2=0x7f7bc01656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:28.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc619b700 1 --2- 172.21.15.72:0/1520066791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bc0153e30 0x7f7bc01656b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.230+0000 7f7bc619b700 1 -- 172.21.15.72:0/1520066791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb00092a0 con 0x7f7bc00630b0 2023-08-31T19:26:28.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.231+0000 7f7bc619b700 1 --2- 172.21.15.72:0/1520066791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc00630b0 0x7f7bc00b0070 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7f7bbc009d50 tx=0x7f7bbc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:28.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.231+0000 7f7bb67fc700 1 -- 172.21.15.72:0/1520066791 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc011910 con 0x7f7bc00630b0 2023-08-31T19:26:28.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.231+0000 7f7bb67fc700 1 -- 172.21.15.72:0/1520066791 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc011a70 con 0x7f7bc00630b0 2023-08-31T19:26:28.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.231+0000 7f7bb67fc700 1 -- 172.21.15.72:0/1520066791 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc011df0 con 0x7f7bc00630b0 2023-08-31T19:26:28.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.231+0000 7f7bc83ff700 1 -- 172.21.15.72:0/1520066791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bbc0092a0 con 0x7f7bc00630b0 2023-08-31T19:26:28.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.231+0000 7f7bc83ff700 1 -- 172.21.15.72:0/1520066791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc00c2800 con 0x7f7bc00630b0 2023-08-31T19:26:28.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.232+0000 7f7bc83ff700 1 -- 172.21.15.72:0/1520066791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc006c6b0 con 0x7f7bc00630b0 2023-08-31T19:26:28.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.233+0000 7f7bb67fc700 1 -- 172.21.15.72:0/1520066791 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7bbc01d640 con 0x7f7bc00630b0 2023-08-31T19:26:28.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.234+0000 7f7bb67fc700 1 --2- 172.21.15.72:0/1520066791 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7ba405ef30 0x7f7ba40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:28.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.234+0000 7f7bb67fc700 1 -- 172.21.15.72:0/1520066791 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f7bbc07b220 con 0x7f7bc00630b0 2023-08-31T19:26:28.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.234+0000 7f7bc599a700 1 --2- 172.21.15.72:0/1520066791 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7ba405ef30 0x7f7ba40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:28.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.234+0000 7f7bc599a700 1 --2- 172.21.15.72:0/1520066791 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7ba405ef30 0x7f7ba40613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7bc00c4e80 tx=0x7f7bb0009060).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:28.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.238+0000 7f7bb67fc700 1 -- 172.21.15.72:0/1520066791 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7bbc04c330 con 0x7f7bc00630b0 2023-08-31T19:26:28.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.469+0000 7f7bc83ff700 1 -- 172.21.15.72:0/1520066791 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7bc0062970 con 0x7f7bc00630b0 2023-08-31T19:26:28.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.475+0000 7f7bb67fc700 1 -- 172.21.15.72:0/1520066791 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v34) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7bbc0220e0 con 0x7f7bc00630b0 2023-08-31T19:26:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.477+0000 7f7bc83ff700 1 -- 172.21.15.72:0/1520066791 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7ba405ef30 msgr2=0x7f7ba40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.477+0000 7f7bc83ff700 1 --2- 172.21.15.72:0/1520066791 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7ba405ef30 0x7f7ba40613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7bc00c4e80 tx=0x7f7bb0009060).stop 2023-08-31T19:26:28.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.477+0000 7f7bc83ff700 1 -- 172.21.15.72:0/1520066791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc00630b0 msgr2=0x7f7bc00b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:28.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.477+0000 7f7bc83ff700 1 --2- 172.21.15.72:0/1520066791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc00630b0 0x7f7bc00b0070 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7f7bbc009d50 tx=0x7f7bbc016000).stop 2023-08-31T19:26:28.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.477+0000 7f7bc83ff700 1 -- 172.21.15.72:0/1520066791 shutdown_connections 2023-08-31T19:26:28.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.477+0000 7f7bc83ff700 1 --2- 172.21.15.72:0/1520066791 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7ba405ef30 0x7f7ba40613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.477+0000 7f7bc83ff700 1 --2- 172.21.15.72:0/1520066791 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bc0153e30 0x7f7bc01656b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.478+0000 7f7bc83ff700 1 --2- 172.21.15.72:0/1520066791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bc00630b0 0x7f7bc00b0070 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.478+0000 7f7bc83ff700 1 --2- 172.21.15.72:0/1520066791 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7bc00c5cb0 0x7f7bc01591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.478+0000 7f7bc83ff700 1 -- 172.21.15.72:0/1520066791 >> 172.21.15.72:0/1520066791 conn(0x7f7bc005eb20 msgr2=0x7f7bc00ab9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.478+0000 7f7bc83ff700 1 -- 172.21.15.72:0/1520066791 shutdown_connections 2023-08-31T19:26:28.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.478+0000 7f7bc83ff700 1 -- 172.21.15.72:0/1520066791 wait complete. 2023-08-31T19:26:28.481 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-08-31T19:26:28.495 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:26:28.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.684+0000 7f2af0bff700 1 Processor -- start 2023-08-31T19:26:28.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.684+0000 7f2af0bff700 1 -- start start 2023-08-31T19:26:28.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.685+0000 7f2af0bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2aec0cb9b0 0x7f2aec1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:28.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.685+0000 7f2af0bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2aec1588d0 0x7f2aec154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:28.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.685+0000 7f2af0bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec0c6120 con 0x7f2aec154060 2023-08-31T19:26:28.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.685+0000 7f2af0bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec0c1380 con 0x7f2aec1588d0 2023-08-31T19:26:28.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.685+0000 7f2af0bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec0c5e10 con 0x7f2aec0cb9b0 2023-08-31T19:26:28.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.686+0000 7f2aead9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2aec1588d0 0x7f2aec154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:28.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.686+0000 7f2aea59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2aec154060 0x7f2aec157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38908/0 (socket says 172.21.15.72:38908) 2023-08-31T19:26:28.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.686+0000 7f2aead9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2aec1588d0 0x7f2aec154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59196/0 (socket says 172.21.15.72:59196) 2023-08-31T19:26:28.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.686+0000 7f2aea59c700 1 -- 172.21.15.72:0/1907236447 learned_addr learned my addr 172.21.15.72:0/1907236447 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:28.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.686+0000 7f2ae9d9b700 1 --2- 172.21.15.72:0/1907236447 >> v2:172.21.15.146:3300/0 conn(0x7f2aec0cb9b0 0x7f2aec1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:28.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.686+0000 7f2aead9d700 1 -- 172.21.15.72:0/1907236447 >> v2:172.21.15.146:3300/0 conn(0x7f2aec0cb9b0 msgr2=0x7f2aec1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.686+0000 7f2aead9d700 1 --2- 172.21.15.72:0/1907236447 >> v2:172.21.15.146:3300/0 conn(0x7f2aec0cb9b0 0x7f2aec1583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.686+0000 7f2aead9d700 1 -- 172.21.15.72:0/1907236447 >> v1:172.21.15.72:6789/0 conn(0x7f2aec154060 legacy=0x7f2aec157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.686+0000 7f2ae959a700 1 -- 172.21.15.72:0/1907236447 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569360650 0 0) 0x7f2aec0c6120 con 0x7f2aec154060 2023-08-31T19:26:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.686+0000 7f2aead9d700 1 -- 172.21.15.72:0/1907236447 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec0c0ae0 con 0x7f2aec1588d0 2023-08-31T19:26:28.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.687+0000 7f2aead9d700 1 --2- 172.21.15.72:0/1907236447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aec1588d0 0x7f2aec154440 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f2aec083190 tx=0x7f2ae4009780).ready entity=mon.0 client_cookie=87d42efd57636300 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:28.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.687+0000 7f2ae959a700 1 -- 172.21.15.72:0/1907236447 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400e070 con 0x7f2aec1588d0 2023-08-31T19:26:28.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.687+0000 7f2ae959a700 1 -- 172.21.15.72:0/1907236447 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae400bc30 con 0x7f2aec1588d0 2023-08-31T19:26:28.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.687+0000 7f2ae959a700 1 -- 172.21.15.72:0/1907236447 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4012410 con 0x7f2aec1588d0 2023-08-31T19:26:28.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.687+0000 7f2af0bff700 1 -- 172.21.15.72:0/1907236447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aec1588d0 msgr2=0x7f2aec154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.687+0000 7f2af0bff700 1 --2- 172.21.15.72:0/1907236447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aec1588d0 0x7f2aec154440 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f2aec083190 tx=0x7f2ae4009780).stop 2023-08-31T19:26:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.687+0000 7f2af0bff700 1 -- 172.21.15.72:0/1907236447 shutdown_connections 2023-08-31T19:26:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.687+0000 7f2af0bff700 1 --2- 172.21.15.72:0/1907236447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aec1588d0 0x7f2aec154440 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.687+0000 7f2af0bff700 1 --2- 172.21.15.72:0/1907236447 >> v2:172.21.15.146:3300/0 conn(0x7f2aec0cb9b0 0x7f2aec1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.687+0000 7f2af0bff700 1 -- 172.21.15.72:0/1907236447 >> 172.21.15.72:0/1907236447 conn(0x7f2aec05e870 msgr2=0x7f2aec0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:28.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.687+0000 7f2af0bff700 1 -- 172.21.15.72:0/1907236447 shutdown_connections 2023-08-31T19:26:28.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.687+0000 7f2af0bff700 1 -- 172.21.15.72:0/1907236447 wait complete. 2023-08-31T19:26:28.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.689+0000 7f2af0bff700 1 Processor -- start 2023-08-31T19:26:28.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.689+0000 7f2af0bff700 1 -- start start 2023-08-31T19:26:28.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.690+0000 7f2af0bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aec0cb9b0 0x7f2aec0b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:28.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.690+0000 7f2af0bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aec154060 0x7f2aec0a8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:28.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.690+0000 7f2af0bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2aec1588d0 0x7f2aec0a9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:28.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.690+0000 7f2af0bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0add20 con 0x7f2aec0cb9b0 2023-08-31T19:26:28.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.690+0000 7f2af0bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec155f20 con 0x7f2aec154060 2023-08-31T19:26:28.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.690+0000 7f2af0bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0a9760 con 0x7f2aec1588d0 2023-08-31T19:26:28.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.690+0000 7f2aea59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aec0cb9b0 0x7f2aec0b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:28.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.690+0000 7f2aea59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aec0cb9b0 0x7f2aec0b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59206/0 (socket says 172.21.15.72:59206) 2023-08-31T19:26:28.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.690+0000 7f2aea59c700 1 -- 172.21.15.72:0/1558830196 learned_addr learned my addr 172.21.15.72:0/1558830196 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:28.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.690+0000 7f2ae9d9b700 1 --2- 172.21.15.72:0/1558830196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aec154060 0x7f2aec0a8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:28.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.691+0000 7f2aead9d700 1 --2- 172.21.15.72:0/1558830196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2aec1588d0 0x7f2aec0a9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:28.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.691+0000 7f2aea59c700 1 -- 172.21.15.72:0/1558830196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2aec1588d0 msgr2=0x7f2aec0a9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:28.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.691+0000 7f2aea59c700 1 --2- 172.21.15.72:0/1558830196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2aec1588d0 0x7f2aec0a9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.691+0000 7f2aea59c700 1 -- 172.21.15.72:0/1558830196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aec154060 msgr2=0x7f2aec0a8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:28.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.691+0000 7f2aea59c700 1 --2- 172.21.15.72:0/1558830196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aec154060 0x7f2aec0a8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.691+0000 7f2aea59c700 1 -- 172.21.15.72:0/1558830196 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae4009a20 con 0x7f2aec0cb9b0 2023-08-31T19:26:28.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.691+0000 7f2ae9d9b700 1 --2- 172.21.15.72:0/1558830196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aec154060 0x7f2aec0a8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:28.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.691+0000 7f2aea59c700 1 --2- 172.21.15.72:0/1558830196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aec0cb9b0 0x7f2aec0b06f0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7f2adc001360 tx=0x7f2adc007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:28.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.691+0000 7f2ada7fc700 1 -- 172.21.15.72:0/1558830196 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc0072e0 con 0x7f2aec0cb9b0 2023-08-31T19:26:28.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.691+0000 7f2ada7fc700 1 -- 172.21.15.72:0/1558830196 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc007440 con 0x7f2aec0cb9b0 2023-08-31T19:26:28.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.691+0000 7f2ada7fc700 1 -- 172.21.15.72:0/1558830196 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc0058a0 con 0x7f2aec0cb9b0 2023-08-31T19:26:28.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.691+0000 7f2af0bff700 1 -- 172.21.15.72:0/1558830196 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec0a9a40 con 0x7f2aec0cb9b0 2023-08-31T19:26:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.691+0000 7f2af0bff700 1 -- 172.21.15.72:0/1558830196 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec155bb0 con 0x7f2aec0cb9b0 2023-08-31T19:26:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.692+0000 7f2af0bff700 1 -- 172.21.15.72:0/1558830196 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aec06c6b0 con 0x7f2aec0cb9b0 2023-08-31T19:26:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.693+0000 7f2ada7fc700 1 -- 172.21.15.72:0/1558830196 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f2adc005c50 con 0x7f2aec0cb9b0 2023-08-31T19:26:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.694+0000 7f2ada7fc700 1 --2- 172.21.15.72:0/1558830196 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f2acc05ef30 0x7f2acc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.694+0000 7f2ada7fc700 1 -- 172.21.15.72:0/1558830196 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f2adc079a70 con 0x7f2aec0cb9b0 2023-08-31T19:26:28.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.694+0000 7f2ae9d9b700 1 --2- 172.21.15.72:0/1558830196 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f2acc05ef30 0x7f2acc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:28.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.695+0000 7f2ae9d9b700 1 --2- 172.21.15.72:0/1558830196 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f2acc05ef30 0x7f2acc0613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2ae0006fd0 tx=0x7f2ae0008040).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:28.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.698+0000 7f2ada7fc700 1 -- 172.21.15.72:0/1558830196 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2adc04aad0 con 0x7f2aec0cb9b0 2023-08-31T19:26:28.789 INFO:tasks.ceph.mds.b.smithi146.stderr:2023-08-31T19:26:28.789+0000 7fed391f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:26:28.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.909+0000 7f2af0bff700 1 -- 172.21.15.72:0/1558830196 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2aec0c0dc0 con 0x7f2aec0cb9b0 2023-08-31T19:26:28.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.909+0000 7f2ada7fc700 1 -- 172.21.15.72:0/1558830196 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f2adc04e0f0 con 0x7f2aec0cb9b0 2023-08-31T19:26:28.910 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:28.910 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2772120291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2772120291},{"type":"v1","addr":"172.21.15.146:6834","nonce":2772120291}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4204264962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4204264962},{"type":"v1","addr":"172.21.15.72:6836","nonce":4204264962}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9501,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2736058565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2736058565},{"type":"v1","addr":"172.21.15.72:6837","nonce":2736058565}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:26:23.268664+0000","modified":"2023-08-31T19:26:26.278490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9507":{"gid":9507,"name":"b","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3040541253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3040541253},{"type":"v1","addr":"172.21.15.146:6835","nonce":3040541253}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-31T19:26:28.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.911+0000 7f2af0bff700 1 -- 172.21.15.72:0/1558830196 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f2acc05ef30 msgr2=0x7f2acc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:28.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.911+0000 7f2af0bff700 1 --2- 172.21.15.72:0/1558830196 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f2acc05ef30 0x7f2acc0613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2ae0006fd0 tx=0x7f2ae0008040).stop 2023-08-31T19:26:28.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.911+0000 7f2af0bff700 1 -- 172.21.15.72:0/1558830196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aec0cb9b0 msgr2=0x7f2aec0b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.911+0000 7f2af0bff700 1 --2- 172.21.15.72:0/1558830196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aec0cb9b0 0x7f2aec0b06f0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7f2adc001360 tx=0x7f2adc007b00).stop 2023-08-31T19:26:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.911+0000 7f2af0bff700 1 -- 172.21.15.72:0/1558830196 shutdown_connections 2023-08-31T19:26:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.911+0000 7f2af0bff700 1 --2- 172.21.15.72:0/1558830196 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f2acc05ef30 0x7f2acc0613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.911+0000 7f2af0bff700 1 --2- 172.21.15.72:0/1558830196 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2aec1588d0 0x7f2aec0a9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.911+0000 7f2af0bff700 1 --2- 172.21.15.72:0/1558830196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aec0cb9b0 0x7f2aec0b06f0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.911+0000 7f2af0bff700 1 --2- 172.21.15.72:0/1558830196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2aec154060 0x7f2aec0a8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:28.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.911+0000 7f2af0bff700 1 -- 172.21.15.72:0/1558830196 >> 172.21.15.72:0/1558830196 conn(0x7f2aec05e870 msgr2=0x7f2aec0647e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:28.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.912+0000 7f2af0bff700 1 -- 172.21.15.72:0/1558830196 shutdown_connections 2023-08-31T19:26:28.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:28.912+0000 7f2af0bff700 1 -- 172.21.15.72:0/1558830196 wait complete. 2023-08-31T19:26:28.915 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 86 2023-08-31T19:26:29.332 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T19:26:23.268664+0000', 'modified': '2023-08-31T19:26:26.278490+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9507}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9507': {'gid': 9507, 'name': 'b', 'rank': 0, 'incarnation': 83, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6835/3040541253', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6833', 'nonce': 3040541253}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3040541253}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-31T19:26:29.332 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T19:26:29.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-31T19:26:29.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.524+0000 7f06f3fff700 1 Processor -- start 2023-08-31T19:26:29.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.525+0000 7f06f3fff700 1 -- start start 2023-08-31T19:26:29.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.526+0000 7f06f3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f06ec154370 0x7f06ec0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.526+0000 7f06f3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06ec066d30 0x7f06ec065470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.526+0000 7f06f3fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ec1588b0 con 0x7f06ec0c25e0 2023-08-31T19:26:29.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.526+0000 7f06f3fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ec0c2d50 con 0x7f06ec154370 2023-08-31T19:26:29.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.526+0000 7f06f3fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec0c2a70 con 0x7f06ec066d30 2023-08-31T19:26:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.527+0000 7f06f1d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f06ec154370 0x7f06ec0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.527+0000 7f06f259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06ec066d30 0x7f06ec065470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.527+0000 7f06f259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06ec066d30 0x7f06ec065470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:55184/0 (socket says 172.21.15.72:55184) 2023-08-31T19:26:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.527+0000 7f06f259c700 1 -- 172.21.15.72:0/359073999 learned_addr learned my addr 172.21.15.72:0/359073999 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.527+0000 7f06f259c700 1 -- 172.21.15.72:0/359073999 >> v2:172.21.15.146:3300/0 conn(0x7f06ec154370 msgr2=0x7f06ec0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.527+0000 7f06f259c700 1 --2- 172.21.15.72:0/359073999 >> v2:172.21.15.146:3300/0 conn(0x7f06ec154370 0x7f06ec0c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.527+0000 7f06f259c700 1 -- 172.21.15.72:0/359073999 >> v1:172.21.15.146:6789/0 conn(0x7f06ec0c25e0 legacy=0x7f06ec062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.527+0000 7f06f259c700 1 -- 172.21.15.72:0/359073999 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec158260 con 0x7f06ec066d30 2023-08-31T19:26:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.527+0000 7f06f1d9b700 1 --2- 172.21.15.72:0/359073999 >> v2:172.21.15.146:3300/0 conn(0x7f06ec154370 0x7f06ec0c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:29.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.527+0000 7f06f259c700 1 --2- 172.21.15.72:0/359073999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06ec066d30 0x7f06ec065470 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f06e4009f20 tx=0x7f06e4009840).ready entity=mon.2 client_cookie=9ff3655c493c11da server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:29.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.528+0000 7f06f0d99700 1 -- 172.21.15.72:0/359073999 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e400e070 con 0x7f06ec066d30 2023-08-31T19:26:29.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.528+0000 7f06f0d99700 1 -- 172.21.15.72:0/359073999 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e400b9d0 con 0x7f06ec066d30 2023-08-31T19:26:29.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.528+0000 7f06f0d99700 1 -- 172.21.15.72:0/359073999 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e400bd50 con 0x7f06ec066d30 2023-08-31T19:26:29.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.528+0000 7f06f3fff700 1 -- 172.21.15.72:0/359073999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06ec066d30 msgr2=0x7f06ec065470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.528+0000 7f06f3fff700 1 --2- 172.21.15.72:0/359073999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06ec066d30 0x7f06ec065470 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f06e4009f20 tx=0x7f06e4009840).stop 2023-08-31T19:26:29.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.528+0000 7f06f3fff700 1 -- 172.21.15.72:0/359073999 shutdown_connections 2023-08-31T19:26:29.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.528+0000 7f06f3fff700 1 --2- 172.21.15.72:0/359073999 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06ec066d30 0x7f06ec065470 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.528+0000 7f06f3fff700 1 --2- 172.21.15.72:0/359073999 >> v2:172.21.15.146:3300/0 conn(0x7f06ec154370 0x7f06ec0c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.528+0000 7f06f3fff700 1 -- 172.21.15.72:0/359073999 >> 172.21.15.72:0/359073999 conn(0x7f06ec064230 msgr2=0x7f06ec0c7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:29.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.528+0000 7f06f3fff700 1 -- 172.21.15.72:0/359073999 shutdown_connections 2023-08-31T19:26:29.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.528+0000 7f06f3fff700 1 -- 172.21.15.72:0/359073999 wait complete. 2023-08-31T19:26:29.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.530+0000 7f06f3fff700 1 Processor -- start 2023-08-31T19:26:29.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.530+0000 7f06f3fff700 1 -- start start 2023-08-31T19:26:29.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06ec066d30 0x7f06ec0c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06ec154370 0x7f06ec0a9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06ec0ac500 0x7f06ec164920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f3fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec0bf330 con 0x7f06ec0ac500 2023-08-31T19:26:29.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f3fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec0aca40 con 0x7f06ec066d30 2023-08-31T19:26:29.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f3fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec0acd20 con 0x7f06ec154370 2023-08-31T19:26:29.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06ec0ac500 0x7f06ec164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06ec0ac500 0x7f06ec164920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59216/0 (socket says 172.21.15.72:59216) 2023-08-31T19:26:29.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f259c700 1 -- 172.21.15.72:0/1855373827 learned_addr learned my addr 172.21.15.72:0/1855373827 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:29.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f1d9b700 1 --2- 172.21.15.72:0/1855373827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06ec066d30 0x7f06ec0c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f159a700 1 --2- 172.21.15.72:0/1855373827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06ec154370 0x7f06ec0a9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f259c700 1 -- 172.21.15.72:0/1855373827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06ec154370 msgr2=0x7f06ec0a9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f259c700 1 --2- 172.21.15.72:0/1855373827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06ec154370 0x7f06ec0a9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f259c700 1 -- 172.21.15.72:0/1855373827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06ec066d30 msgr2=0x7f06ec0c13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f259c700 1 --2- 172.21.15.72:0/1855373827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06ec066d30 0x7f06ec0c13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.531+0000 7f06f259c700 1 -- 172.21.15.72:0/1855373827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e80092a0 con 0x7f06ec0ac500 2023-08-31T19:26:29.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.532+0000 7f06f259c700 1 --2- 172.21.15.72:0/1855373827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06ec0ac500 0x7f06ec164920 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7f06e400b610 tx=0x7f06e4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:29.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.532+0000 7f06e1ffb700 1 -- 172.21.15.72:0/1855373827 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e40092e0 con 0x7f06ec0ac500 2023-08-31T19:26:29.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.532+0000 7f06e1ffb700 1 -- 172.21.15.72:0/1855373827 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e401e470 con 0x7f06ec0ac500 2023-08-31T19:26:29.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.532+0000 7f06f3fff700 1 -- 172.21.15.72:0/1855373827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e4009ae0 con 0x7f06ec0ac500 2023-08-31T19:26:29.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.532+0000 7f06e1ffb700 1 -- 172.21.15.72:0/1855373827 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e401e830 con 0x7f06ec0ac500 2023-08-31T19:26:29.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.532+0000 7f06f3fff700 1 -- 172.21.15.72:0/1855373827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec0befc0 con 0x7f06ec0ac500 2023-08-31T19:26:29.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.534+0000 7f06e1ffb700 1 -- 172.21.15.72:0/1855373827 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f06e4003040 con 0x7f06ec0ac500 2023-08-31T19:26:29.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.535+0000 7f06e1ffb700 1 --2- 172.21.15.72:0/1855373827 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f06d005ef30 0x7f06d00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.535+0000 7f06e1ffb700 1 -- 172.21.15.72:0/1855373827 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f06e407b6f0 con 0x7f06ec0ac500 2023-08-31T19:26:29.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.535+0000 7f06f1d9b700 1 --2- 172.21.15.72:0/1855373827 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f06d005ef30 0x7f06d00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.535+0000 7f06f1d9b700 1 --2- 172.21.15.72:0/1855373827 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f06d005ef30 0x7f06d00613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f06e8009d20 tx=0x7f06e8009060).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:29.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.537+0000 7f070b326b80 1 Processor -- start 2023-08-31T19:26:29.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.537+0000 7f070b326b80 1 -- start start 2023-08-31T19:26:29.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.538+0000 7f070b326b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa184712c0 0x55fa184716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.538+0000 7f070b326b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184b9f60 0x55fa1846c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.538+0000 7f070b326b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa1846caf0 0x55fa1846cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.538+0000 7f070b326b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa183addb0 con 0x55fa1846caf0 2023-08-31T19:26:29.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.538+0000 7f070b326b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa183c3030 con 0x55fa184b9f60 2023-08-31T19:26:29.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.538+0000 7f070b326b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa183c3170 con 0x55fa184712c0 2023-08-31T19:26:29.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.538+0000 7f06f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa1846caf0 0x55fa1846cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.538+0000 7f06f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa1846caf0 0x55fa1846cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59224/0 (socket says 172.21.15.72:59224) 2023-08-31T19:26:29.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.538+0000 7f06f259c700 1 -- 172.21.15.72:0/676176105 learned_addr learned my addr 172.21.15.72:0/676176105 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:29.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.538+0000 7f06f1d9b700 1 --2- 172.21.15.72:0/676176105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa184712c0 0x55fa184716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.538+0000 7f06f159a700 1 --2- 172.21.15.72:0/676176105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184b9f60 0x55fa1846c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.539+0000 7f06f259c700 1 -- 172.21.15.72:0/676176105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa184712c0 msgr2=0x55fa184716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:29.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.539+0000 7f06f259c700 1 --2- 172.21.15.72:0/676176105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa184712c0 0x55fa184716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.539+0000 7f06f259c700 1 -- 172.21.15.72:0/676176105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184b9f60 msgr2=0x55fa1846c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:29.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.539+0000 7f06f259c700 1 --2- 172.21.15.72:0/676176105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184b9f60 0x55fa1846c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.539+0000 7f06f259c700 1 -- 172.21.15.72:0/676176105 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa18395b00 con 0x55fa1846caf0 2023-08-31T19:26:29.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.539+0000 7f06f259c700 1 --2- 172.21.15.72:0/676176105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa1846caf0 0x55fa1846cf70 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7f06e40796f0 tx=0x7f06e400e000).ready entity=mon.0 client_cookie=6f060e7631284a3c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:29.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.539+0000 7f06d6ffd700 1 -- 172.21.15.72:0/676176105 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e404fd60 con 0x55fa1846caf0 2023-08-31T19:26:29.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.539+0000 7f06d6ffd700 1 -- 172.21.15.72:0/676176105 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e404e540 con 0x55fa1846caf0 2023-08-31T19:26:29.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.539+0000 7f06d6ffd700 1 -- 172.21.15.72:0/676176105 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e404cb10 con 0x55fa1846caf0 2023-08-31T19:26:29.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.540+0000 7f070b326b80 1 -- 172.21.15.72:0/676176105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa1846caf0 msgr2=0x55fa1846cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.540+0000 7f070b326b80 1 --2- 172.21.15.72:0/676176105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa1846caf0 0x55fa1846cf70 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7f06e40796f0 tx=0x7f06e400e000).stop 2023-08-31T19:26:29.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.540+0000 7f070b326b80 1 -- 172.21.15.72:0/676176105 shutdown_connections 2023-08-31T19:26:29.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.540+0000 7f070b326b80 1 --2- 172.21.15.72:0/676176105 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa1846caf0 0x55fa1846cf70 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.540+0000 7f070b326b80 1 --2- 172.21.15.72:0/676176105 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa184712c0 0x55fa184716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.540+0000 7f070b326b80 1 --2- 172.21.15.72:0/676176105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184b9f60 0x55fa1846c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.540+0000 7f070b326b80 1 -- 172.21.15.72:0/676176105 >> 172.21.15.72:0/676176105 conn(0x55fa182db940 msgr2=0x55fa184ba3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:29.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.540+0000 7f070b326b80 1 -- 172.21.15.72:0/676176105 shutdown_connections 2023-08-31T19:26:29.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.540+0000 7f070b326b80 1 -- 172.21.15.72:0/676176105 wait complete. 2023-08-31T19:26:29.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.541+0000 7f070b326b80 1 -- start start 2023-08-31T19:26:29.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.541+0000 7f070b326b80 1 Processor -- start 2023-08-31T19:26:29.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.542+0000 7f070b326b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa1846caf0 0x55fa18490880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.542+0000 7f070b326b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa184712c0 0x55fa18499e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.542+0000 7f070b326b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184b9f60 0x55fa1846cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.542+0000 7f070b326b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa183c33f0 con 0x55fa184712c0 2023-08-31T19:26:29.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.542+0000 7f070b326b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa1838e920 con 0x55fa184b9f60 2023-08-31T19:26:29.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.542+0000 7f070b326b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa1849c690 con 0x55fa1846caf0 2023-08-31T19:26:29.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.542+0000 7f070b326b80 10 client.0 ll_register_callbacks cb 0x55fa18363ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:26:29.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.542+0000 7f06f159a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa184712c0 0x55fa18499e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.542+0000 7f06f159a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa184712c0 0x55fa18499e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59228/0 (socket says 172.21.15.72:59228) 2023-08-31T19:26:29.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.542+0000 7f06f159a700 1 -- 172.21.15.72:0/1983206089 learned_addr learned my addr 172.21.15.72:0/1983206089 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:29.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.542+0000 7f06f1d9b700 1 --2- 172.21.15.72:0/1983206089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa1846caf0 0x55fa18490880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.542+0000 7f06f159a700 1 -- 172.21.15.72:0/1983206089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa1846caf0 msgr2=0x55fa18490880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:29.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.542+0000 7f06f259c700 1 --2- 172.21.15.72:0/1983206089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184b9f60 0x55fa1846cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.543+0000 7f06f159a700 1 --2- 172.21.15.72:0/1983206089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa1846caf0 0x55fa18490880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.543+0000 7f06f159a700 1 -- 172.21.15.72:0/1983206089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184b9f60 msgr2=0x55fa1846cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:29.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.543+0000 7f06f159a700 1 --2- 172.21.15.72:0/1983206089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184b9f60 0x55fa1846cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.543+0000 7f06f159a700 1 -- 172.21.15.72:0/1983206089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec0befc0 con 0x55fa184712c0 2023-08-31T19:26:29.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.543+0000 7f06f259c700 1 --2- 172.21.15.72:0/1983206089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184b9f60 0x55fa1846cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:29.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.543+0000 7f06f159a700 1 --2- 172.21.15.72:0/1983206089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa184712c0 0x55fa18499e40 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f06dc012650 tx=0x7f06dc007d40).ready entity=mon.0 client_cookie=6991b34f12e0f65e server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:29.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.543+0000 7f06cbfff700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:26:29.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.543+0000 7f06cbfff700 1 -- 172.21.15.72:0/1983206089 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc003040 con 0x55fa184712c0 2023-08-31T19:26:29.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.543+0000 7f06cbfff700 1 -- 172.21.15.72:0/1983206089 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f06dc007240 con 0x55fa184712c0 2023-08-31T19:26:29.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.543+0000 7f070b326b80 1 -- 172.21.15.72:0/1983206089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa1846baa0 con 0x55fa184712c0 2023-08-31T19:26:29.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.543+0000 7f06cbfff700 1 -- 172.21.15.72:0/1983206089 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06dc003430 con 0x55fa184712c0 2023-08-31T19:26:29.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.543+0000 7f070b326b80 10 client.9636 fetch_fsmap learned FSMap version 86 2023-08-31T19:26:29.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.543+0000 7f070b326b80 1 -- 172.21.15.72:0/1983206089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x55fa183bbf70 con 0x55fa184712c0 2023-08-31T19:26:29.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.543+0000 7f06cbfff700 1 -- 172.21.15.72:0/1983206089 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa1846baa0 con 0x55fa184712c0 2023-08-31T19:26:29.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.543+0000 7f06cbfff700 1 -- 172.21.15.72:0/1983206089 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 86) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f06dc0066a0 con 0x55fa184712c0 2023-08-31T19:26:29.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.544+0000 7f070b326b80 10 client.9636 fetch_fsmap finished waiting for FSMap version 86 2023-08-31T19:26:29.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.544+0000 7f070b326b80 10 client.9636 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-31T19:26:29.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.544+0000 7f070b326b80 20 client.9636 populate_metadata read hostname 'smithi072' 2023-08-31T19:26:29.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.544+0000 7f070b326b80 1 --2- 172.21.15.72:0/1983206089 >> [v2:172.21.15.146:6833/3040541253,v1:172.21.15.146:6835/3040541253] conn(0x55fa1849ae60 0x55fa1849b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.544+0000 7f070b326b80 4 client.9636 mds_command: new command op to 9507 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T19:26:29.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.544+0000 7f070b326b80 1 -- 172.21.15.72:0/1983206089 --> [v2:172.21.15.146:6833/3040541253,v1:172.21.15.146:6835/3040541253] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa1822bef0 con 0x55fa1849ae60 2023-08-31T19:26:29.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.544+0000 7f06f1d9b700 1 --2- 172.21.15.72:0/1983206089 >> [v2:172.21.15.146:6833/3040541253,v1:172.21.15.146:6835/3040541253] conn(0x55fa1849ae60 0x55fa1849b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.545+0000 7f06f1d9b700 1 --2- 172.21.15.72:0/1983206089 >> [v2:172.21.15.146:6833/3040541253,v1:172.21.15.146:6835/3040541253] conn(0x55fa1849ae60 0x55fa1849b240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d338952782b1bd11 server_cookie=d7505278d76f2f53 in_seq=0 out_seq=0 2023-08-31T19:26:29.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.545+0000 7f06cbfff700 10 client.9636 ms_handle_connect on v2:172.21.15.146:6833/3040541253 2023-08-31T19:26:29.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.546+0000 7f06cbfff700 1 -- 172.21.15.72:0/1983206089 <== mds.0 v2:172.21.15.146:6833/3040541253 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55fa1822bef0 con 0x55fa1849ae60 2023-08-31T19:26:29.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.546+0000 7f06cbfff700 10 client.9636 handle_command_reply: tid=0 2023-08-31T19:26:29.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.546+0000 7f070b326b80 1 client.9636 shutdown 2023-08-31T19:26:29.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.546+0000 7f070b326b80 1 -- 172.21.15.72:0/1983206089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa184712c0 msgr2=0x55fa18499e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.546+0000 7f070b326b80 1 --2- 172.21.15.72:0/1983206089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa184712c0 0x55fa18499e40 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f06dc012650 tx=0x7f06dc007d40).stop 2023-08-31T19:26:29.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.546+0000 7f070b326b80 1 -- 172.21.15.72:0/1983206089 shutdown_connections 2023-08-31T19:26:29.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.546+0000 7f070b326b80 1 --2- 172.21.15.72:0/1983206089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184b9f60 0x55fa1846cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.546+0000 7f070b326b80 1 --2- 172.21.15.72:0/1983206089 >> [v2:172.21.15.146:6833/3040541253,v1:172.21.15.146:6835/3040541253] conn(0x55fa1849ae60 0x55fa1849b240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.546+0000 7f070b326b80 1 --2- 172.21.15.72:0/1983206089 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa1846caf0 0x55fa18490880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.546+0000 7f070b326b80 1 --2- 172.21.15.72:0/1983206089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa184712c0 0x55fa18499e40 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.546+0000 7f070b326b80 1 -- 172.21.15.72:0/1983206089 >> 172.21.15.72:0/1983206089 conn(0x55fa182db940 msgr2=0x55fa184716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.546+0000 7f06cbfff700 0 client.9636 ms_handle_reset on v2:172.21.15.146:6833/3040541253 2023-08-31T19:26:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.546+0000 7f070b326b80 1 -- 172.21.15.72:0/1983206089 shutdown_connections 2023-08-31T19:26:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.547+0000 7f070b326b80 1 -- 172.21.15.72:0/1983206089 wait complete. 2023-08-31T19:26:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.547+0000 7f070b326b80 20 client.9636 trim_cache size 0 max 16384 2023-08-31T19:26:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.563+0000 7f070b326b80 1 Processor -- start 2023-08-31T19:26:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.563+0000 7f070b326b80 1 -- start start 2023-08-31T19:26:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.564+0000 7f070b326b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa1846caf0 0x55fa18470540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.564+0000 7f070b326b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184712c0 0x55fa184c5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.564+0000 7f070b326b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa184b9f60 0x55fa184c5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.564+0000 7f070b326b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa184ca1d0 con 0x55fa1846caf0 2023-08-31T19:26:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.564+0000 7f070b326b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa184c5d70 con 0x55fa184712c0 2023-08-31T19:26:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.564+0000 7f070b326b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa184c9340 con 0x55fa184b9f60 2023-08-31T19:26:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.565+0000 7f06f1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa1846caf0 0x55fa18470540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.565+0000 7f06f1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa1846caf0 0x55fa18470540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59230/0 (socket says 172.21.15.72:59230) 2023-08-31T19:26:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.565+0000 7f06f1d9b700 1 -- 172.21.15.72:0/1173252346 learned_addr learned my addr 172.21.15.72:0/1173252346 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.565+0000 7f06f159a700 1 --2- 172.21.15.72:0/1173252346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184712c0 0x55fa184c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.565+0000 7f06f259c700 1 --2- 172.21.15.72:0/1173252346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa184b9f60 0x55fa184c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.565+0000 7f06f1d9b700 1 -- 172.21.15.72:0/1173252346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa184b9f60 msgr2=0x55fa184c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.565+0000 7f06f1d9b700 1 --2- 172.21.15.72:0/1173252346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa184b9f60 0x55fa184c5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.565+0000 7f06f1d9b700 1 -- 172.21.15.72:0/1173252346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184712c0 msgr2=0x55fa184c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.565+0000 7f06f1d9b700 1 --2- 172.21.15.72:0/1173252346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184712c0 0x55fa184c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.565+0000 7f06f1d9b700 1 -- 172.21.15.72:0/1173252346 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa183b7580 con 0x55fa1846caf0 2023-08-31T19:26:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.565+0000 7f06f1d9b700 1 --2- 172.21.15.72:0/1173252346 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa1846caf0 0x55fa18470540 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x55fa1849cbf0 tx=0x7f06e8027280).ready entity=mon.0 client_cookie=3e872011b8793ea4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.565+0000 7f06d77fe700 1 -- 172.21.15.72:0/1173252346 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e8021b10 con 0x55fa1846caf0 2023-08-31T19:26:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.565+0000 7f06d77fe700 1 -- 172.21.15.72:0/1173252346 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e8027040 con 0x55fa1846caf0 2023-08-31T19:26:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.565+0000 7f06d77fe700 1 -- 172.21.15.72:0/1173252346 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e8021c70 con 0x55fa1846caf0 2023-08-31T19:26:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.566+0000 7f070b326b80 1 -- 172.21.15.72:0/1173252346 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa1846caf0 msgr2=0x55fa18470540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.566+0000 7f070b326b80 1 --2- 172.21.15.72:0/1173252346 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa1846caf0 0x55fa18470540 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x55fa1849cbf0 tx=0x7f06e8027280).stop 2023-08-31T19:26:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.566+0000 7f070b326b80 1 -- 172.21.15.72:0/1173252346 shutdown_connections 2023-08-31T19:26:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.566+0000 7f070b326b80 1 --2- 172.21.15.72:0/1173252346 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa184b9f60 0x55fa184c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.566+0000 7f070b326b80 1 --2- 172.21.15.72:0/1173252346 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa1846caf0 0x55fa18470540 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.566+0000 7f070b326b80 1 --2- 172.21.15.72:0/1173252346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa184712c0 0x55fa184c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.566+0000 7f070b326b80 1 -- 172.21.15.72:0/1173252346 >> 172.21.15.72:0/1173252346 conn(0x55fa182db940 msgr2=0x55fa184ba3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:29.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.566+0000 7f070b326b80 1 -- 172.21.15.72:0/1173252346 shutdown_connections 2023-08-31T19:26:29.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.566+0000 7f070b326b80 1 -- 172.21.15.72:0/1173252346 wait complete. 2023-08-31T19:26:29.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.567+0000 7f070b326b80 1 -- start start 2023-08-31T19:26:29.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.567+0000 7f070b326b80 1 Processor -- start 2023-08-31T19:26:29.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.568+0000 7f070b326b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa1846caf0 0x55fa184716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.568+0000 7f070b326b80 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa184712c0 0x55fa18471b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.568+0000 7f070b326b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa184b9f60 0x55fa184b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.568+0000 7f070b326b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa18472080 con 0x55fa184b9f60 2023-08-31T19:26:29.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.568+0000 7f070b326b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa184b8480 con 0x55fa1846caf0 2023-08-31T19:26:29.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.568+0000 7f070b326b80 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa1851cd70 con 0x55fa184712c0 2023-08-31T19:26:29.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.568+0000 7f070b326b80 10 client.0 ll_register_callbacks cb 0x55fa18363ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:26:29.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.568+0000 7f06f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa184b9f60 0x55fa184b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.568+0000 7f06f259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa184b9f60 0x55fa184b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59246/0 (socket says 172.21.15.72:59246) 2023-08-31T19:26:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.568+0000 7f06f259c700 1 -- 172.21.15.72:0/343174947 learned_addr learned my addr 172.21.15.72:0/343174947 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.568+0000 7f06f1d9b700 1 --2- 172.21.15.72:0/343174947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa1846caf0 0x55fa184716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.568+0000 7f06f159a700 1 --2- 172.21.15.72:0/343174947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa184712c0 0x55fa18471b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f06f259c700 1 -- 172.21.15.72:0/343174947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa184712c0 msgr2=0x55fa18471b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f06f259c700 1 --2- 172.21.15.72:0/343174947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa184712c0 0x55fa18471b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f06f259c700 1 -- 172.21.15.72:0/343174947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa1846caf0 msgr2=0x55fa184716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:29.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f06f259c700 1 --2- 172.21.15.72:0/343174947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa1846caf0 0x55fa184716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f06f259c700 1 -- 172.21.15.72:0/343174947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e8011e70 con 0x55fa184b9f60 2023-08-31T19:26:29.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f06f1d9b700 1 --2- 172.21.15.72:0/343174947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa1846caf0 0x55fa184716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:29.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f06f259c700 1 --2- 172.21.15.72:0/343174947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa184b9f60 0x55fa184b49d0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7f06e400c010 tx=0x7f06e402d000).ready entity=mon.0 client_cookie=fd9f0e743463a177 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:29.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f06cbfff700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-08-31T19:26:29.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f06cbfff700 1 -- 172.21.15.72:0/343174947 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4038070 con 0x55fa184b9f60 2023-08-31T19:26:29.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f06cbfff700 1 -- 172.21.15.72:0/343174947 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f06e404fb00 con 0x55fa184b9f60 2023-08-31T19:26:29.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f070b326b80 1 -- 172.21.15.72:0/343174947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06e404e540 con 0x55fa184b9f60 2023-08-31T19:26:29.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f06cbfff700 1 -- 172.21.15.72:0/343174947 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06e400e040 con 0x55fa184b9f60 2023-08-31T19:26:29.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f070b326b80 10 client.9642 fetch_fsmap learned FSMap version 86 2023-08-31T19:26:29.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f070b326b80 1 -- 172.21.15.72:0/343174947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x55fa183b72d0 con 0x55fa184b9f60 2023-08-31T19:26:29.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f06cbfff700 1 -- 172.21.15.72:0/343174947 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e404e540 con 0x55fa184b9f60 2023-08-31T19:26:29.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.569+0000 7f06cbfff700 1 -- 172.21.15.72:0/343174947 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 86) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f06e404c1f0 con 0x55fa184b9f60 2023-08-31T19:26:29.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.570+0000 7f070b326b80 10 client.9642 fetch_fsmap finished waiting for FSMap version 86 2023-08-31T19:26:29.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.570+0000 7f070b326b80 10 client.9642 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-31T19:26:29.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.570+0000 7f070b326b80 20 client.9642 populate_metadata read hostname 'smithi072' 2023-08-31T19:26:29.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.570+0000 7f070b326b80 1 --2- 172.21.15.72:0/343174947 >> [v2:172.21.15.146:6833/3040541253,v1:172.21.15.146:6835/3040541253] conn(0x55fa184b5120 0x55fa1851b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.570+0000 7f070b326b80 4 client.9642 mds_command: new command op to 9507 tid=0[{"prefix": "status"}] 2023-08-31T19:26:29.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.570+0000 7f070b326b80 1 -- 172.21.15.72:0/343174947 --> [v2:172.21.15.146:6833/3040541253,v1:172.21.15.146:6835/3040541253] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fa18261040 con 0x55fa184b5120 2023-08-31T19:26:29.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.570+0000 7f06f1d9b700 1 --2- 172.21.15.72:0/343174947 >> [v2:172.21.15.146:6833/3040541253,v1:172.21.15.146:6835/3040541253] conn(0x55fa184b5120 0x55fa1851b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.570+0000 7f06f1d9b700 1 --2- 172.21.15.72:0/343174947 >> [v2:172.21.15.146:6833/3040541253,v1:172.21.15.146:6835/3040541253] conn(0x55fa184b5120 0x55fa1851b2c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6eb05c8c3e58e34 server_cookie=5545ca41dcad9b25 in_seq=0 out_seq=0 2023-08-31T19:26:29.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.570+0000 7f06cbfff700 10 client.9642 ms_handle_connect on v2:172.21.15.146:6833/3040541253 2023-08-31T19:26:29.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.571+0000 7f06cbfff700 1 -- 172.21.15.72:0/343174947 <== mds.0 v2:172.21.15.146:6833/3040541253 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55fa18261040 con 0x55fa184b5120 2023-08-31T19:26:29.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.571+0000 7f06cbfff700 10 client.9642 handle_command_reply: tid=0 2023-08-31T19:26:29.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.571+0000 7f070b326b80 1 client.9642 shutdown 2023-08-31T19:26:29.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.571+0000 7f070b326b80 1 -- 172.21.15.72:0/343174947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa184b9f60 msgr2=0x55fa184b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.571+0000 7f070b326b80 1 --2- 172.21.15.72:0/343174947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa184b9f60 0x55fa184b49d0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7f06e400c010 tx=0x7f06e402d000).stop 2023-08-31T19:26:29.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.571+0000 7f070b326b80 1 -- 172.21.15.72:0/343174947 shutdown_connections 2023-08-31T19:26:29.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.571+0000 7f070b326b80 1 --2- 172.21.15.72:0/343174947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55fa184b9f60 0x55fa184b49d0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.571+0000 7f070b326b80 1 --2- 172.21.15.72:0/343174947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fa1846caf0 0x55fa184716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.571+0000 7f070b326b80 1 --2- 172.21.15.72:0/343174947 >> [v2:172.21.15.146:6833/3040541253,v1:172.21.15.146:6835/3040541253] conn(0x55fa184b5120 0x55fa1851b2c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.571+0000 7f070b326b80 1 --2- 172.21.15.72:0/343174947 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x55fa184712c0 0x55fa18471b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.571+0000 7f070b326b80 1 -- 172.21.15.72:0/343174947 >> 172.21.15.72:0/343174947 conn(0x55fa182db940 msgr2=0x55fa184ba6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:29.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.571+0000 7f06cbfff700 0 client.9642 ms_handle_reset on v2:172.21.15.146:6833/3040541253 2023-08-31T19:26:29.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.571+0000 7f070b326b80 1 -- 172.21.15.72:0/343174947 shutdown_connections 2023-08-31T19:26:29.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.571+0000 7f070b326b80 1 -- 172.21.15.72:0/343174947 wait complete. 2023-08-31T19:26:29.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.571+0000 7f070b326b80 20 client.9642 trim_cache size 0 max 16384 2023-08-31T19:26:29.586 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:26:29.586 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "acadb8ca-1685-49e1-a73f-5e9d14d95be9", 2023-08-31T19:26:29.586 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-08-31T19:26:29.587 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 9507, 2023-08-31T19:26:29.587 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-08-31T19:26:29.587 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-08-31T19:26:29.587 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-08-31T19:26:29.587 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 6.3006061940000002, 2023-08-31T19:26:29.589 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 86, 2023-08-31T19:26:29.589 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 195, 2023-08-31T19:26:29.589 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 195, 2023-08-31T19:26:29.589 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 11.504392922999999 2023-08-31T19:26:29.590 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:26:29.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.572+0000 7f06f3fff700 1 -- 172.21.15.72:0/1855373827 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f06d005ef30 msgr2=0x7f06d00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.572+0000 7f06f3fff700 1 --2- 172.21.15.72:0/1855373827 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f06d005ef30 0x7f06d00613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f06e8009d20 tx=0x7f06e8009060).stop 2023-08-31T19:26:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.572+0000 7f06f3fff700 1 -- 172.21.15.72:0/1855373827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06ec0ac500 msgr2=0x7f06ec164920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.572+0000 7f06f3fff700 1 --2- 172.21.15.72:0/1855373827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06ec0ac500 0x7f06ec164920 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7f06e400b610 tx=0x7f06e4009840).stop 2023-08-31T19:26:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.572+0000 7f06f3fff700 1 -- 172.21.15.72:0/1855373827 shutdown_connections 2023-08-31T19:26:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.572+0000 7f06f3fff700 1 --2- 172.21.15.72:0/1855373827 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f06d005ef30 0x7f06d00613f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.572+0000 7f06f3fff700 1 --2- 172.21.15.72:0/1855373827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06ec0ac500 0x7f06ec164920 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.572+0000 7f06f3fff700 1 --2- 172.21.15.72:0/1855373827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06ec066d30 0x7f06ec0c13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.572+0000 7f06f3fff700 1 --2- 172.21.15.72:0/1855373827 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f06ec154370 0x7f06ec0a9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.572+0000 7f06f3fff700 1 -- 172.21.15.72:0/1855373827 >> 172.21.15.72:0/1855373827 conn(0x7f06ec064230 msgr2=0x7f06ec0a69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.572+0000 7f06f3fff700 1 -- 172.21.15.72:0/1855373827 shutdown_connections 2023-08-31T19:26:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.572+0000 7f06f3fff700 1 -- 172.21.15.72:0/1855373827 wait complete. 2023-08-31T19:26:29.594 DEBUG:teuthology.orchestra.run.smithi072:> ceph fs ls 2023-08-31T19:26:29.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.752+0000 7fe5f63ff700 1 Processor -- start 2023-08-31T19:26:29.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.752+0000 7fe5f63ff700 1 -- start start 2023-08-31T19:26:29.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.753+0000 7fe5f63ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe5f00ca510 0x7fe5f00a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.753+0000 7fe5f63ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe5f00a7fe0 0x7fe5f00c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.753+0000 7fe5f63ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f00ca080 con 0x7fe5f0154460 2023-08-31T19:26:29.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.754+0000 7fe5f63ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f00c72d0 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.754+0000 7fe5f63ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f00c9750 con 0x7fe5f00ca510 2023-08-31T19:26:29.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.754+0000 7fe5effff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe5f0154460 0x7fe5f00c1070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38910/0 (socket says 172.21.15.72:38910) 2023-08-31T19:26:29.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.754+0000 7fe5effff700 1 -- 172.21.15.72:0/3179056965 learned_addr learned my addr 172.21.15.72:0/3179056965 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:29.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.754+0000 7fe5f499c700 1 --2- 172.21.15.72:0/3179056965 >> v2:172.21.15.72:3300/0 conn(0x7fe5f00a7fe0 0x7fe5f00c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.754+0000 7fe5ef7fe700 1 --2- 172.21.15.72:0/3179056965 >> v2:172.21.15.146:3300/0 conn(0x7fe5f00ca510 0x7fe5f00a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.754+0000 7fe5eeffd700 1 -- 172.21.15.72:0/3179056965 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201615153 0 0) 0x7fe5f00ca080 con 0x7fe5f0154460 2023-08-31T19:26:29.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.754+0000 7fe5eeffd700 1 -- 172.21.15.72:0/3179056965 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5d80033f0 con 0x7fe5f0154460 2023-08-31T19:26:29.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.754+0000 7fe5f499c700 1 -- 172.21.15.72:0/3179056965 >> v2:172.21.15.146:3300/0 conn(0x7fe5f00ca510 msgr2=0x7fe5f00a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:29.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.754+0000 7fe5f499c700 1 --2- 172.21.15.72:0/3179056965 >> v2:172.21.15.146:3300/0 conn(0x7fe5f00ca510 0x7fe5f00a7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.754+0000 7fe5f499c700 1 -- 172.21.15.72:0/3179056965 >> v1:172.21.15.72:6789/0 conn(0x7fe5f0154460 legacy=0x7fe5f00c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.754+0000 7fe5f499c700 1 -- 172.21.15.72:0/3179056965 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f00c9a30 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.755+0000 7fe5f499c700 1 --2- 172.21.15.72:0/3179056965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00a7fe0 0x7fe5f00c5f90 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7fe5f00c1780 tx=0x7fe5e8009780).ready entity=mon.0 client_cookie=2d225fdc22fdfb30 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:29.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.755+0000 7fe5eeffd700 1 -- 172.21.15.72:0/3179056965 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e800e070 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.755+0000 7fe5eeffd700 1 -- 172.21.15.72:0/3179056965 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e800bb60 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.755+0000 7fe5eeffd700 1 -- 172.21.15.72:0/3179056965 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8012410 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.755+0000 7fe5f63ff700 1 -- 172.21.15.72:0/3179056965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00a7fe0 msgr2=0x7fe5f00c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.755+0000 7fe5f63ff700 1 --2- 172.21.15.72:0/3179056965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00a7fe0 0x7fe5f00c5f90 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7fe5f00c1780 tx=0x7fe5e8009780).stop 2023-08-31T19:26:29.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.755+0000 7fe5f63ff700 1 -- 172.21.15.72:0/3179056965 shutdown_connections 2023-08-31T19:26:29.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.755+0000 7fe5f63ff700 1 --2- 172.21.15.72:0/3179056965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00a7fe0 0x7fe5f00c5f90 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.755+0000 7fe5f63ff700 1 --2- 172.21.15.72:0/3179056965 >> v2:172.21.15.146:3300/0 conn(0x7fe5f00ca510 0x7fe5f00a7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.755+0000 7fe5f63ff700 1 -- 172.21.15.72:0/3179056965 >> 172.21.15.72:0/3179056965 conn(0x7fe5f006a560 msgr2=0x7fe5f00cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:29.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.755+0000 7fe5f63ff700 1 -- 172.21.15.72:0/3179056965 shutdown_connections 2023-08-31T19:26:29.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.755+0000 7fe5f63ff700 1 -- 172.21.15.72:0/3179056965 wait complete. 2023-08-31T19:26:29.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.757+0000 7fe5f63ff700 1 Processor -- start 2023-08-31T19:26:29.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.757+0000 7fe5f63ff700 1 -- start start 2023-08-31T19:26:29.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.758+0000 7fe5f63ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00a7fe0 0x7fe5f0150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.758+0000 7fe5f63ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5f00ca510 0x7fe5f0151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.758+0000 7fe5f63ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5f0154460 0x7fe5f0152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.758+0000 7fe5f63ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00c3070 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.758+0000 7fe5f63ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f0152610 con 0x7fe5f0154460 2023-08-31T19:26:29.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.758+0000 7fe5f63ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00ae520 con 0x7fe5f00ca510 2023-08-31T19:26:29.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.758+0000 7fe5effff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00a7fe0 0x7fe5f0150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.758+0000 7fe5effff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00a7fe0 0x7fe5f0150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59268/0 (socket says 172.21.15.72:59268) 2023-08-31T19:26:29.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.758+0000 7fe5effff700 1 -- 172.21.15.72:0/2679899839 learned_addr learned my addr 172.21.15.72:0/2679899839 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:29.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.758+0000 7fe5ef7fe700 1 --2- 172.21.15.72:0/2679899839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5f00ca510 0x7fe5f0151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.758+0000 7fe5f499c700 1 --2- 172.21.15.72:0/2679899839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5f0154460 0x7fe5f0152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.759+0000 7fe5effff700 1 -- 172.21.15.72:0/2679899839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5f00ca510 msgr2=0x7fe5f0151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.759+0000 7fe5effff700 1 --2- 172.21.15.72:0/2679899839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5f00ca510 0x7fe5f0151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.759+0000 7fe5effff700 1 -- 172.21.15.72:0/2679899839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5f0154460 msgr2=0x7fe5f0152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.759+0000 7fe5effff700 1 --2- 172.21.15.72:0/2679899839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5f0154460 0x7fe5f0152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.759+0000 7fe5effff700 1 -- 172.21.15.72:0/2679899839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e8009a20 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.759+0000 7fe5effff700 1 --2- 172.21.15.72:0/2679899839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00a7fe0 0x7fe5f0150af0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7fe5e000c4b0 tx=0x7fe5e0007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:29.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.759+0000 7fe5d7fff700 1 -- 172.21.15.72:0/2679899839 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e00072e0 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.759+0000 7fe5d7fff700 1 -- 172.21.15.72:0/2679899839 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e0007440 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.759+0000 7fe5d7fff700 1 -- 172.21.15.72:0/2679899839 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0005880 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.759+0000 7fe5f63ff700 1 -- 172.21.15.72:0/2679899839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f0150fe0 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.759+0000 7fe5f63ff700 1 -- 172.21.15.72:0/2679899839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f00aded0 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.760+0000 7fe5f63ff700 1 -- 172.21.15.72:0/2679899839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f00add30 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.761+0000 7fe5d7fff700 1 -- 172.21.15.72:0/2679899839 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe5e0005c30 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.762+0000 7fe5d7fff700 1 --2- 172.21.15.72:0/2679899839 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe5dc05ef30 0x7fe5dc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:29.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.762+0000 7fe5d7fff700 1 -- 172.21.15.72:0/2679899839 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fe5e0079b50 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.762+0000 7fe5ef7fe700 1 --2- 172.21.15.72:0/2679899839 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe5dc05ef30 0x7fe5dc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:29.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.762+0000 7fe5ef7fe700 1 --2- 172.21.15.72:0/2679899839 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe5dc05ef30 0x7fe5dc0613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe5f00b0ac0 tx=0x7fe5e4008040).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:29.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.766+0000 7fe5d7fff700 1 -- 172.21.15.72:0/2679899839 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe5f00add30 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.977+0000 7fe5f63ff700 1 -- 172.21.15.72:0/2679899839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe5f00add30 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.978+0000 7fe5d7fff700 1 -- 172.21.15.72:0/2679899839 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe5f00add30 con 0x7fe5f00a7fe0 2023-08-31T19:26:29.979 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T19:26:29.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.980+0000 7fe5f63ff700 1 -- 172.21.15.72:0/2679899839 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe5dc05ef30 msgr2=0x7fe5dc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.980+0000 7fe5f63ff700 1 --2- 172.21.15.72:0/2679899839 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe5dc05ef30 0x7fe5dc0613f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe5f00b0ac0 tx=0x7fe5e4008040).stop 2023-08-31T19:26:29.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.980+0000 7fe5f63ff700 1 -- 172.21.15.72:0/2679899839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00a7fe0 msgr2=0x7fe5f0150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:29.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.980+0000 7fe5f63ff700 1 --2- 172.21.15.72:0/2679899839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00a7fe0 0x7fe5f0150af0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7fe5e000c4b0 tx=0x7fe5e0007b00).stop 2023-08-31T19:26:29.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.980+0000 7fe5f63ff700 1 -- 172.21.15.72:0/2679899839 shutdown_connections 2023-08-31T19:26:29.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.980+0000 7fe5f63ff700 1 --2- 172.21.15.72:0/2679899839 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe5dc05ef30 0x7fe5dc0613f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.980+0000 7fe5f63ff700 1 --2- 172.21.15.72:0/2679899839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5f0154460 0x7fe5f0152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.980+0000 7fe5f63ff700 1 --2- 172.21.15.72:0/2679899839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5f00a7fe0 0x7fe5f0150af0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.980+0000 7fe5f63ff700 1 --2- 172.21.15.72:0/2679899839 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe5f00ca510 0x7fe5f0151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:29.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.980+0000 7fe5f63ff700 1 -- 172.21.15.72:0/2679899839 >> 172.21.15.72:0/2679899839 conn(0x7fe5f006a560 msgr2=0x7fe5f00a8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.980+0000 7fe5f63ff700 1 -- 172.21.15.72:0/2679899839 shutdown_connections 2023-08-31T19:26:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:29.980+0000 7fe5f63ff700 1 -- 172.21.15.72:0/2679899839 wait complete. 2023-08-31T19:26:29.996 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-31T19:26:29.997 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:26:29.998 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-08-31T19:26:29.998 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T19:26:29.999 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T19:26:30.000 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-31T19:26:30.000 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-31T19:26:30.001 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:26:30.001 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:26:30.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:30.003 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-08-31T19:26:30.051 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:26:30.052 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:26:30.052 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:26:30.052 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:26:30.052 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-08-31T19:26:30.053 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:26:30.053 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:26:30.053 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:26:30.053 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-08-31T19:26:30.053 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:26:30.054 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:26:30.054 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-08-31T19:26:30.054 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:26:30.054 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:26:30.054 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:26:30.055 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:26:30.055 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:26:30.055 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 35686sec preferred_lft 35686sec 2023-08-31T19:26:30.055 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-08-31T19:26:30.055 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:26:30.056 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:26:30.056 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff 2023-08-31T19:26:30.056 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T19:26:30.056 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:26:30.056 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::7c68:c9ff:fe82:9771/64 scope link 2023-08-31T19:26:30.057 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:26:30.057 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:26:30.057 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e2:e1:71:f6:f6:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T19:26:30.057 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e0e1:71ff:fef6:f6fa/64 scope link 2023-08-31T19:26:30.057 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:26:30.058 INFO:teuthology.orchestra.run.smithi072.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:26:30.058 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 3a:f6:06:3c:01:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T19:26:30.058 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::38f6:6ff:fe3c:1ef/64 scope link 2023-08-31T19:26:30.058 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:26:30.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:30.059 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:26:30.126 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-08-31T19:26:30.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:30.130 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-08-31T19:26:30.179 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-08-31T19:26:30.180 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:26:30.180 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:26:30.180 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:26:30.180 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:26:30.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:30.181 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-08-31T19:26:30.182 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-08-31T19:26:30.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:26:30.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:26:30.183 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:26:30.183 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-08-31T19:26:30.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:30.353 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T19:26:30.400 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T19:26:30.400 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T19:26:30.401 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:26:30.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:30.401 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-08-31T19:26:30.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:30.512 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-31T19:26:30.558 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-31T19:26:30.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:26:30.696 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:26:30.697 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:26:30.723 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-31T19:26:30.723 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-31T19:26:30.729 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-31T19:26:30.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:30.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T19:26:30.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-31T19:26:30.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.994+0000 7fe3419ff700 1 Processor -- start 2023-08-31T19:26:30.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.994+0000 7fe3419ff700 1 -- start start 2023-08-31T19:26:30.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.995+0000 7fe3419ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe33c1580c0 0x7fe33c0bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:30.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.995+0000 7fe3419ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe33c069410 0x7fe33c1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:30.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.995+0000 7fe3419ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe33c158990 0x7fe33c153e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:30.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.995+0000 7fe3419ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33c069ae0 con 0x7fe33c069410 2023-08-31T19:26:30.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.995+0000 7fe3419ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33c158df0 con 0x7fe33c1580c0 2023-08-31T19:26:30.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.995+0000 7fe3419ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c062880 con 0x7fe33c158990 2023-08-31T19:26:30.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.996+0000 7fe33a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe33c069410 0x7fe33c1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:30.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.996+0000 7fe33a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe33c069410 0x7fe33c1584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59274/0 (socket says 172.21.15.72:59274) 2023-08-31T19:26:30.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.996+0000 7fe33a7fc700 1 -- 172.21.15.72:0/1402668895 learned_addr learned my addr 172.21.15.72:0/1402668895 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:30.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.996+0000 7fe33b7fe700 1 --2- 172.21.15.72:0/1402668895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe33c158990 0x7fe33c153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:30.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.996+0000 7fe33affd700 1 --2- 172.21.15.72:0/1402668895 >> v2:172.21.15.146:3300/0 conn(0x7fe33c1580c0 0x7fe33c0bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:31.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.996+0000 7fe33a7fc700 1 -- 172.21.15.72:0/1402668895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe33c158990 msgr2=0x7fe33c153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:31.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.996+0000 7fe33a7fc700 1 --2- 172.21.15.72:0/1402668895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe33c158990 0x7fe33c153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:31.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.996+0000 7fe33a7fc700 1 -- 172.21.15.72:0/1402668895 >> v2:172.21.15.146:3300/0 conn(0x7fe33c1580c0 msgr2=0x7fe33c0bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:31.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.996+0000 7fe33a7fc700 1 --2- 172.21.15.72:0/1402668895 >> v2:172.21.15.146:3300/0 conn(0x7fe33c1580c0 0x7fe33c0bc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:31.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.996+0000 7fe33a7fc700 1 -- 172.21.15.72:0/1402668895 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c069890 con 0x7fe33c069410 2023-08-31T19:26:31.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.996+0000 7fe33b7fe700 1 --2- 172.21.15.72:0/1402668895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe33c158990 0x7fe33c153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:31.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.996+0000 7fe33affd700 1 --2- 172.21.15.72:0/1402668895 >> v2:172.21.15.146:3300/0 conn(0x7fe33c1580c0 0x7fe33c0bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:31.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.996+0000 7fe33a7fc700 1 --2- 172.21.15.72:0/1402668895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c069410 0x7fe33c1584a0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7fe33c066a10 tx=0x7fe3300090f0).ready entity=mon.0 client_cookie=6507025c4a3d7277 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:31.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.997+0000 7fe339ffb700 1 -- 172.21.15.72:0/1402668895 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33000b600 con 0x7fe33c069410 2023-08-31T19:26:31.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.997+0000 7fe339ffb700 1 -- 172.21.15.72:0/1402668895 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33000b760 con 0x7fe33c069410 2023-08-31T19:26:31.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.997+0000 7fe339ffb700 1 -- 172.21.15.72:0/1402668895 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33000bb00 con 0x7fe33c069410 2023-08-31T19:26:31.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.997+0000 7fe3419ff700 1 -- 172.21.15.72:0/1402668895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c069410 msgr2=0x7fe33c1584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:31.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.997+0000 7fe3419ff700 1 --2- 172.21.15.72:0/1402668895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c069410 0x7fe33c1584a0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7fe33c066a10 tx=0x7fe3300090f0).stop 2023-08-31T19:26:31.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.997+0000 7fe3419ff700 1 -- 172.21.15.72:0/1402668895 shutdown_connections 2023-08-31T19:26:31.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.997+0000 7fe3419ff700 1 --2- 172.21.15.72:0/1402668895 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe33c158990 0x7fe33c153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:31.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.997+0000 7fe3419ff700 1 --2- 172.21.15.72:0/1402668895 >> v2:172.21.15.146:3300/0 conn(0x7fe33c1580c0 0x7fe33c0bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:31.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.997+0000 7fe3419ff700 1 --2- 172.21.15.72:0/1402668895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c069410 0x7fe33c1584a0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:31.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.997+0000 7fe3419ff700 1 -- 172.21.15.72:0/1402668895 >> 172.21.15.72:0/1402668895 conn(0x7fe33c0c73a0 msgr2=0x7fe33c0c77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:31.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.997+0000 7fe3419ff700 1 -- 172.21.15.72:0/1402668895 shutdown_connections 2023-08-31T19:26:31.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.997+0000 7fe3419ff700 1 -- 172.21.15.72:0/1402668895 wait complete. 2023-08-31T19:26:31.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.999+0000 7fe3419ff700 1 Processor -- start 2023-08-31T19:26:31.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:30.999+0000 7fe3419ff700 1 -- start start 2023-08-31T19:26:31.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.000+0000 7fe3419ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe33c069410 0x7fe33c150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:31.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.000+0000 7fe3419ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe33c1580c0 0x7fe33c154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:31.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.000+0000 7fe3419ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c158990 0x7fe33c0c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:31.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.000+0000 7fe3419ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c157550 con 0x7fe33c158990 2023-08-31T19:26:31.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.000+0000 7fe3419ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c150850 con 0x7fe33c1580c0 2023-08-31T19:26:31.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.000+0000 7fe3419ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c1579e0 con 0x7fe33c069410 2023-08-31T19:26:31.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.000+0000 7fe33b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c158990 0x7fe33c0c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:31.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.000+0000 7fe33b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c158990 0x7fe33c0c4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59288/0 (socket says 172.21.15.72:59288) 2023-08-31T19:26:31.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.000+0000 7fe33b7fe700 1 -- 172.21.15.72:0/3781615026 learned_addr learned my addr 172.21.15.72:0/3781615026 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:31.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.000+0000 7fe33affd700 1 --2- 172.21.15.72:0/3781615026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe33c069410 0x7fe33c150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:31.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.000+0000 7fe33a7fc700 1 --2- 172.21.15.72:0/3781615026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe33c1580c0 0x7fe33c154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:31.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.001+0000 7fe33b7fe700 1 -- 172.21.15.72:0/3781615026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe33c069410 msgr2=0x7fe33c150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:31.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.001+0000 7fe33b7fe700 1 --2- 172.21.15.72:0/3781615026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe33c069410 0x7fe33c150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:31.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.001+0000 7fe33b7fe700 1 -- 172.21.15.72:0/3781615026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe33c1580c0 msgr2=0x7fe33c154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:31.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.001+0000 7fe33b7fe700 1 --2- 172.21.15.72:0/3781615026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe33c1580c0 0x7fe33c154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:31.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.001+0000 7fe33b7fe700 1 -- 172.21.15.72:0/3781615026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe330009370 con 0x7fe33c158990 2023-08-31T19:26:31.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.001+0000 7fe33b7fe700 1 --2- 172.21.15.72:0/3781615026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c158990 0x7fe33c0c4260 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7fe334007f60 tx=0x7fe334009930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:31.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.001+0000 7fe322ffd700 1 -- 172.21.15.72:0/3781615026 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33400db80 con 0x7fe33c158990 2023-08-31T19:26:31.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.001+0000 7fe322ffd700 1 -- 172.21.15.72:0/3781615026 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33400f040 con 0x7fe33c158990 2023-08-31T19:26:31.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.001+0000 7fe3419ff700 1 -- 172.21.15.72:0/3781615026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33c1554a0 con 0x7fe33c158990 2023-08-31T19:26:31.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.001+0000 7fe322ffd700 1 -- 172.21.15.72:0/3781615026 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3340133f0 con 0x7fe33c158990 2023-08-31T19:26:31.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.001+0000 7fe3419ff700 1 -- 172.21.15.72:0/3781615026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33c156f00 con 0x7fe33c158990 2023-08-31T19:26:31.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.002+0000 7fe3419ff700 1 -- 172.21.15.72:0/3781615026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33c157700 con 0x7fe33c158990 2023-08-31T19:26:31.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.003+0000 7fe322ffd700 1 -- 172.21.15.72:0/3781615026 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe3340137e0 con 0x7fe33c158990 2023-08-31T19:26:31.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.004+0000 7fe322ffd700 1 --2- 172.21.15.72:0/3781615026 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe32805ef30 0x7fe3280613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:31.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.004+0000 7fe322ffd700 1 -- 172.21.15.72:0/3781615026 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fe33407a7d0 con 0x7fe33c158990 2023-08-31T19:26:31.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.004+0000 7fe33affd700 1 --2- 172.21.15.72:0/3781615026 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe32805ef30 0x7fe3280613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:31.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.005+0000 7fe33affd700 1 --2- 172.21.15.72:0/3781615026 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe32805ef30 0x7fe3280613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe32c006d20 tx=0x7fe32c008040).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:31.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.008+0000 7fe322ffd700 1 -- 172.21.15.72:0/3781615026 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe33c157700 con 0x7fe33c158990 2023-08-31T19:26:31.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.203+0000 7fe3419ff700 1 -- 172.21.15.72:0/3781615026 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe33c157700 con 0x7fe32805ef30 2023-08-31T19:26:31.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.204+0000 7fe322ffd700 1 -- 172.21.15.72:0/3781615026 <== mgr.7463 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe33c157700 con 0x7fe32805ef30 2023-08-31T19:26:31.205 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-08-31T19:26:31.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-08-31T19:26:31.206 INFO:teuthology.orchestra.run.smithi072.stdout: "name": "cephfs" 2023-08-31T19:26:31.206 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-08-31T19:26:31.207 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-08-31T19:26:31.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.206+0000 7fe3419ff700 1 -- 172.21.15.72:0/3781615026 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe32805ef30 msgr2=0x7fe3280613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:31.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.206+0000 7fe3419ff700 1 --2- 172.21.15.72:0/3781615026 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe32805ef30 0x7fe3280613f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe32c006d20 tx=0x7fe32c008040).stop 2023-08-31T19:26:31.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.206+0000 7fe3419ff700 1 -- 172.21.15.72:0/3781615026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c158990 msgr2=0x7fe33c0c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:31.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.206+0000 7fe3419ff700 1 --2- 172.21.15.72:0/3781615026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c158990 0x7fe33c0c4260 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7fe334007f60 tx=0x7fe334009930).stop 2023-08-31T19:26:31.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.206+0000 7fe3419ff700 1 -- 172.21.15.72:0/3781615026 shutdown_connections 2023-08-31T19:26:31.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.206+0000 7fe3419ff700 1 --2- 172.21.15.72:0/3781615026 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe32805ef30 0x7fe3280613f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:31.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.206+0000 7fe3419ff700 1 --2- 172.21.15.72:0/3781615026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe33c158990 0x7fe33c0c4260 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:31.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.206+0000 7fe3419ff700 1 --2- 172.21.15.72:0/3781615026 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe33c069410 0x7fe33c150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:31.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.206+0000 7fe3419ff700 1 --2- 172.21.15.72:0/3781615026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe33c1580c0 0x7fe33c154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:31.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.206+0000 7fe3419ff700 1 -- 172.21.15.72:0/3781615026 >> 172.21.15.72:0/3781615026 conn(0x7fe33c0c73a0 msgr2=0x7fe33c151010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:31.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.207+0000 7fe3419ff700 1 -- 172.21.15.72:0/3781615026 shutdown_connections 2023-08-31T19:26:31.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.207+0000 7fe3419ff700 1 -- 172.21.15.72:0/3781615026 wait complete. 2023-08-31T19:26:31.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:26:31.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-31T19:26:31.270 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:26:31.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.465+0000 7fe108dff700 1 Processor -- start 2023-08-31T19:26:31.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.465+0000 7fe108dff700 1 -- start start 2023-08-31T19:26:31.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.466+0000 7fe108dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1040658d0 0x7fe104065d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.466+0000 7fe108dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe104158720 con 0x7fe104154520 2023-08-31T19:26:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.466+0000 7fe108dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe104066240 con 0x7fe104154140 2023-08-31T19:26:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.466+0000 7fe108dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe104157e30 con 0x7fe1040658d0 2023-08-31T19:26:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.466+0000 7fe101d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1040658d0 0x7fe104065d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.466+0000 7fe102d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe104154520 0x7fe104154990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38916/0 (socket says 172.21.15.72:38916) 2023-08-31T19:26:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.466+0000 7fe101d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1040658d0 0x7fe104065d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59292/0 (socket says 172.21.15.72:59292) 2023-08-31T19:26:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.467+0000 7fe102d9d700 1 -- 172.21.15.72:0/4184049338 learned_addr learned my addr 172.21.15.72:0/4184049338 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.467+0000 7fe101d9b700 1 -- 172.21.15.72:0/4184049338 >> v1:172.21.15.146:6789/0 conn(0x7fe104154140 legacy=0x7fe1040a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.467+0000 7fe101d9b700 1 -- 172.21.15.72:0/4184049338 >> v1:172.21.15.72:6789/0 conn(0x7fe104154520 legacy=0x7fe104154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:31.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.467+0000 7fe101d9b700 1 -- 172.21.15.72:0/4184049338 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1040c45f0 con 0x7fe1040658d0 2023-08-31T19:26:31.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.467+0000 7fe10159a700 1 -- 172.21.15.72:0/4184049338 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091592177 0 0) 0x7fe104158720 con 0x7fe104154520 2023-08-31T19:26:31.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.467+0000 7fe101d9b700 1 --2- 172.21.15.72:0/4184049338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1040658d0 0x7fe104065d50 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7fe0f8009760 tx=0x7fe0f8009060).ready entity=mon.0 client_cookie=eba4f364063e4ac1 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:31.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.467+0000 7fe10159a700 1 -- 172.21.15.72:0/4184049338 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f800b580 con 0x7fe1040658d0 2023-08-31T19:26:31.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.467+0000 7fe10159a700 1 -- 172.21.15.72:0/4184049338 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f800b6e0 con 0x7fe1040658d0 2023-08-31T19:26:31.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.467+0000 7fe10159a700 1 -- 172.21.15.72:0/4184049338 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f800ba60 con 0x7fe1040658d0 2023-08-31T19:26:31.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.468+0000 7fe108dff700 1 -- 172.21.15.72:0/4184049338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1040658d0 msgr2=0x7fe104065d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:31.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.468+0000 7fe108dff700 1 --2- 172.21.15.72:0/4184049338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1040658d0 0x7fe104065d50 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7fe0f8009760 tx=0x7fe0f8009060).stop 2023-08-31T19:26:31.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.468+0000 7fe108dff700 1 -- 172.21.15.72:0/4184049338 shutdown_connections 2023-08-31T19:26:31.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.468+0000 7fe108dff700 1 --2- 172.21.15.72:0/4184049338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1040658d0 0x7fe104065d50 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:31.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.468+0000 7fe108dff700 1 -- 172.21.15.72:0/4184049338 >> 172.21.15.72:0/4184049338 conn(0x7fe1040c7910 msgr2=0x7fe1040c38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:31.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.468+0000 7fe108dff700 1 -- 172.21.15.72:0/4184049338 shutdown_connections 2023-08-31T19:26:31.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.468+0000 7fe108dff700 1 -- 172.21.15.72:0/4184049338 wait complete. 2023-08-31T19:26:31.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.469+0000 7fe108dff700 1 Processor -- start 2023-08-31T19:26:31.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.470+0000 7fe108dff700 1 -- start start 2023-08-31T19:26:31.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.470+0000 7fe108dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1040658d0 0x7fe1040a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:31.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe108dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe104154140 0x7fe1040be980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:31.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe108dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe104154520 0x7fe104068f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe108dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040bfc30 con 0x7fe104154520 2023-08-31T19:26:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe108dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040bf020 con 0x7fe104154140 2023-08-31T19:26:31.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe108dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040bf300 con 0x7fe1040658d0 2023-08-31T19:26:31.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe102d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe104154520 0x7fe104068f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:31.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe102d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe104154520 0x7fe104068f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59306/0 (socket says 172.21.15.72:59306) 2023-08-31T19:26:31.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe102d9d700 1 -- 172.21.15.72:0/1167660169 learned_addr learned my addr 172.21.15.72:0/1167660169 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:31.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe10259c700 1 --2- 172.21.15.72:0/1167660169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1040658d0 0x7fe1040a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:31.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe101d9b700 1 --2- 172.21.15.72:0/1167660169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe104154140 0x7fe1040be980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:31.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe102d9d700 1 -- 172.21.15.72:0/1167660169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1040658d0 msgr2=0x7fe1040a9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:31.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe102d9d700 1 --2- 172.21.15.72:0/1167660169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1040658d0 0x7fe1040a9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:31.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe102d9d700 1 -- 172.21.15.72:0/1167660169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe104154140 msgr2=0x7fe1040be980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:31.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe102d9d700 1 --2- 172.21.15.72:0/1167660169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe104154140 0x7fe1040be980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:31.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe102d9d700 1 -- 172.21.15.72:0/1167660169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f80092a0 con 0x7fe104154520 2023-08-31T19:26:31.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.471+0000 7fe102d9d700 1 --2- 172.21.15.72:0/1167660169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe104154520 0x7fe104068f70 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7fe0fc00c730 tx=0x7fe0fc001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:31.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.472+0000 7fe0f27fc700 1 -- 172.21.15.72:0/1167660169 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc005d30 con 0x7fe104154520 2023-08-31T19:26:31.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.472+0000 7fe0f27fc700 1 -- 172.21.15.72:0/1167660169 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc005e90 con 0x7fe104154520 2023-08-31T19:26:31.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.472+0000 7fe0f27fc700 1 -- 172.21.15.72:0/1167660169 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc007300 con 0x7fe104154520 2023-08-31T19:26:31.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.472+0000 7fe108dff700 1 -- 172.21.15.72:0/1167660169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1040bf5e0 con 0x7fe104154520 2023-08-31T19:26:31.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.472+0000 7fe108dff700 1 -- 172.21.15.72:0/1167660169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe104069460 con 0x7fe104154520 2023-08-31T19:26:31.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.473+0000 7fe108dff700 1 -- 172.21.15.72:0/1167660169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10406c6b0 con 0x7fe104154520 2023-08-31T19:26:31.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.474+0000 7fe0f27fc700 1 -- 172.21.15.72:0/1167660169 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 88) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fe0fc0076b0 con 0x7fe104154520 2023-08-31T19:26:31.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.475+0000 7fe0f27fc700 1 --2- 172.21.15.72:0/1167660169 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe0e405ef00 0x7fe0e40613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:31.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.475+0000 7fe0f27fc700 1 -- 172.21.15.72:0/1167660169 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fe0fc079be0 con 0x7fe104154520 2023-08-31T19:26:31.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.475+0000 7fe10259c700 1 --2- 172.21.15.72:0/1167660169 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe0e405ef00 0x7fe0e40613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.475+0000 7fe10259c700 1 --2- 172.21.15.72:0/1167660169 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe0e405ef00 0x7fe0e40613c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe0f4003900 tx=0x7fe0f4007d40).ready entity=mgr.7463 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.479+0000 7fe0f27fc700 1 -- 172.21.15.72:0/1167660169 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe0fc04ac40 con 0x7fe104154520 2023-08-31T19:26:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:31.695+0000 7fe108dff700 1 -- 172.21.15.72:0/1167660169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fe1041580d0 con 0x7fe104154520 2023-08-31T19:26:32.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.313+0000 7fe0f27fc700 1 -- 172.21.15.72:0/1167660169 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 89) v1 ==== 75391+0+0 (secure 0 0 0) 0x7fe0fc0775a0 con 0x7fe104154520 2023-08-31T19:26:32.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.314+0000 7fe0f27fc700 1 -- 172.21.15.72:0/1167660169 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v89) v1 ==== 92+0+0 (secure 0 0 0) 0x7fe0fc074410 con 0x7fe104154520 2023-08-31T19:26:32.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.317+0000 7fe108dff700 1 -- 172.21.15.72:0/1167660169 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe0e405ef00 msgr2=0x7fe0e40613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:32.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.317+0000 7fe108dff700 1 --2- 172.21.15.72:0/1167660169 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe0e405ef00 0x7fe0e40613c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe0f4003900 tx=0x7fe0f4007d40).stop 2023-08-31T19:26:32.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.317+0000 7fe108dff700 1 -- 172.21.15.72:0/1167660169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe104154520 msgr2=0x7fe104068f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:32.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.317+0000 7fe108dff700 1 --2- 172.21.15.72:0/1167660169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe104154520 0x7fe104068f70 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7fe0fc00c730 tx=0x7fe0fc001520).stop 2023-08-31T19:26:32.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.317+0000 7fe108dff700 1 -- 172.21.15.72:0/1167660169 shutdown_connections 2023-08-31T19:26:32.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.317+0000 7fe108dff700 1 --2- 172.21.15.72:0/1167660169 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fe0e405ef00 0x7fe0e40613c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:32.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.317+0000 7fe108dff700 1 --2- 172.21.15.72:0/1167660169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe104154520 0x7fe104068f70 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:32.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.317+0000 7fe108dff700 1 --2- 172.21.15.72:0/1167660169 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fe1040658d0 0x7fe1040a9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:32.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.317+0000 7fe108dff700 1 --2- 172.21.15.72:0/1167660169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe104154140 0x7fe1040be980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:32.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.317+0000 7fe108dff700 1 -- 172.21.15.72:0/1167660169 >> 172.21.15.72:0/1167660169 conn(0x7fe1040c7910 msgr2=0x7fe1040c5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:32.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.317+0000 7fe108dff700 1 -- 172.21.15.72:0/1167660169 shutdown_connections 2023-08-31T19:26:32.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.317+0000 7fe108dff700 1 -- 172.21.15.72:0/1167660169 wait complete. 2023-08-31T19:26:32.338 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-31T19:26:32.524 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:32.524+0000 7feb0e50f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:26:32.537 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:32.537+0000 7f8823428680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:26:32.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.540+0000 7f0a0e5ff700 1 Processor -- start 2023-08-31T19:26:32.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.540+0000 7f0a0e5ff700 1 -- start start 2023-08-31T19:26:32.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.541+0000 7f0a0e5ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a08063830 0x7f0a080c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:32.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.541+0000 7f0a0e5ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a080c6ed0 con 0x7f0a08154030 2023-08-31T19:26:32.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.541+0000 7f0a0e5ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a080c68c0 con 0x7f0a08154410 2023-08-31T19:26:32.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.541+0000 7f0a0e5ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a080c66e0 con 0x7f0a08063830 2023-08-31T19:26:32.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.542+0000 7f0a07fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0a08154030 0x7f0a080aa140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38924/0 (socket says 172.21.15.72:38924) 2023-08-31T19:26:32.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.542+0000 7f0a07fff700 1 -- 172.21.15.72:0/2964095673 learned_addr learned my addr 172.21.15.72:0/2964095673 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:32.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.542+0000 7f0a0cb9c700 1 --2- 172.21.15.72:0/2964095673 >> v2:172.21.15.72:3300/0 conn(0x7f0a08063830 0x7f0a080c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:32.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.542+0000 7f0a0cb9c700 1 -- 172.21.15.72:0/2964095673 >> v1:172.21.15.146:6789/0 conn(0x7f0a08154410 legacy=0x7f0a08063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:32.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.542+0000 7f0a0cb9c700 1 -- 172.21.15.72:0/2964095673 >> v1:172.21.15.72:6789/0 conn(0x7f0a08154030 legacy=0x7f0a080aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:32.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.542+0000 7f0a0cb9c700 1 -- 172.21.15.72:0/2964095673 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a080c0f30 con 0x7f0a08063830 2023-08-31T19:26:32.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.542+0000 7f0a0cb9c700 1 --2- 172.21.15.72:0/2964095673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a08063830 0x7f0a080c06b0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f0a00009e60 tx=0x7f0a00009780).ready entity=mon.0 client_cookie=6b2d2bc49875ea7b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:32.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.543+0000 7f0a06ffd700 1 -- 172.21.15.72:0/2964095673 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0000e070 con 0x7f0a08063830 2023-08-31T19:26:32.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.543+0000 7f0a06ffd700 1 -- 172.21.15.72:0/2964095673 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0000bc30 con 0x7f0a08063830 2023-08-31T19:26:32.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.543+0000 7f0a06ffd700 1 -- 172.21.15.72:0/2964095673 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00012410 con 0x7f0a08063830 2023-08-31T19:26:32.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.543+0000 7f0a0e5ff700 1 -- 172.21.15.72:0/2964095673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a08063830 msgr2=0x7f0a080c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:32.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.543+0000 7f0a0e5ff700 1 --2- 172.21.15.72:0/2964095673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a08063830 0x7f0a080c06b0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f0a00009e60 tx=0x7f0a00009780).stop 2023-08-31T19:26:32.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.543+0000 7f0a0e5ff700 1 -- 172.21.15.72:0/2964095673 shutdown_connections 2023-08-31T19:26:32.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.543+0000 7f0a0e5ff700 1 --2- 172.21.15.72:0/2964095673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a08063830 0x7f0a080c06b0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:32.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.543+0000 7f0a0e5ff700 1 -- 172.21.15.72:0/2964095673 >> 172.21.15.72:0/2964095673 conn(0x7f0a0805eb60 msgr2=0x7f0a080cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:32.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.543+0000 7f0a0e5ff700 1 -- 172.21.15.72:0/2964095673 shutdown_connections 2023-08-31T19:26:32.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.544+0000 7f0a0e5ff700 1 -- 172.21.15.72:0/2964095673 wait complete. 2023-08-31T19:26:32.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.546+0000 7f0a0e5ff700 1 Processor -- start 2023-08-31T19:26:32.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.546+0000 7f0a0e5ff700 1 -- start start 2023-08-31T19:26:32.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.547+0000 7f0a0e5ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a08063830 0x7f0a081515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:32.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.547+0000 7f0a0e5ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a08154030 0x7f0a0814e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:32.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.547+0000 7f0a0e5ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a08154410 0x7f0a080c2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:32.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.547+0000 7f0a0e5ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a08152600 con 0x7f0a08154030 2023-08-31T19:26:32.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.547+0000 7f0a0e5ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a08151ae0 con 0x7f0a08063830 2023-08-31T19:26:32.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.547+0000 7f0a0e5ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a08151d60 con 0x7f0a08154410 2023-08-31T19:26:32.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.547+0000 7f0a077fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a08154030 0x7f0a0814e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:32.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.547+0000 7f0a07fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a08063830 0x7f0a081515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:32.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.547+0000 7f0a077fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a08154030 0x7f0a0814e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59352/0 (socket says 172.21.15.72:59352) 2023-08-31T19:26:32.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.547+0000 7f0a077fe700 1 -- 172.21.15.72:0/4180731876 learned_addr learned my addr 172.21.15.72:0/4180731876 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:32.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.548+0000 7f0a0cb9c700 1 --2- 172.21.15.72:0/4180731876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a08154410 0x7f0a080c2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:32.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.548+0000 7f0a07fff700 1 -- 172.21.15.72:0/4180731876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a08154410 msgr2=0x7f0a080c2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:32.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.548+0000 7f0a07fff700 1 --2- 172.21.15.72:0/4180731876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a08154410 0x7f0a080c2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:32.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.548+0000 7f0a07fff700 1 -- 172.21.15.72:0/4180731876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a08154030 msgr2=0x7f0a0814e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:32.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.548+0000 7f0a07fff700 1 --2- 172.21.15.72:0/4180731876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a08154030 0x7f0a0814e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:32.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.548+0000 7f0a07fff700 1 -- 172.21.15.72:0/4180731876 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a00009a20 con 0x7f0a08063830 2023-08-31T19:26:32.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.548+0000 7f0a077fe700 1 --2- 172.21.15.72:0/4180731876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a08154030 0x7f0a0814e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:32.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.548+0000 7f0a07fff700 1 --2- 172.21.15.72:0/4180731876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a08063830 0x7f0a081515f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f09f800c410 tx=0x7f09f8007d30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:32.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.548+0000 7f09effff700 1 -- 172.21.15.72:0/4180731876 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f80070d0 con 0x7f0a08063830 2023-08-31T19:26:32.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.548+0000 7f09effff700 1 -- 172.21.15.72:0/4180731876 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f8007230 con 0x7f0a08063830 2023-08-31T19:26:32.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.548+0000 7f0a0e5ff700 1 -- 172.21.15.72:0/4180731876 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a08152040 con 0x7f0a08063830 2023-08-31T19:26:32.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.548+0000 7f09effff700 1 -- 172.21.15.72:0/4180731876 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f80075b0 con 0x7f0a08063830 2023-08-31T19:26:32.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.549+0000 7f0a0e5ff700 1 -- 172.21.15.72:0/4180731876 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a080c2030 con 0x7f0a08063830 2023-08-31T19:26:32.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.550+0000 7f0a0e5ff700 1 -- 172.21.15.72:0/4180731876 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a080c1e70 con 0x7f0a08063830 2023-08-31T19:26:32.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.551+0000 7f09effff700 1 -- 172.21.15.72:0/4180731876 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 89) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f09f80059b0 con 0x7f0a08063830 2023-08-31T19:26:32.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.551+0000 7f09effff700 1 --2- 172.21.15.72:0/4180731876 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f09f405ef80 0x7f09f4061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:32.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.551+0000 7f09effff700 1 -- 172.21.15.72:0/4180731876 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f09f8079920 con 0x7f0a08063830 2023-08-31T19:26:32.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.551+0000 7f0a077fe700 1 -- 172.21.15.72:0/4180731876 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f09f405ef80 msgr2=0x7f09f4061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:32.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.551+0000 7f0a077fe700 1 --2- 172.21.15.72:0/4180731876 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f09f405ef80 0x7f09f4061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:32.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.556+0000 7f09effff700 1 -- 172.21.15.72:0/4180731876 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f09f804a8c0 con 0x7f0a08063830 2023-08-31T19:26:32.604 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:32.604+0000 7feb0e50f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:26:32.639 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:32.638+0000 7f8823428680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:26:32.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.752+0000 7f0a077fe700 1 -- 172.21.15.72:0/4180731876 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f09f405ef80 msgr2=0x7f09f4061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:32.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.752+0000 7f0a077fe700 1 --2- 172.21.15.72:0/4180731876 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f09f405ef80 0x7f09f4061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:26:32.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.757+0000 7f0a0e5ff700 1 -- 172.21.15.72:0/4180731876 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f0a080c0c50 con 0x7f0a08063830 2023-08-31T19:26:32.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.761+0000 7f09effff700 1 -- 172.21.15.72:0/4180731876 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v39)=0 v39) v1 ==== 138+0+0 (secure 0 0 0) 0x7f09f804dee0 con 0x7f0a08063830 2023-08-31T19:26:32.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.763+0000 7f0a0e5ff700 1 -- 172.21.15.72:0/4180731876 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f09f405ef80 msgr2=0x7f09f4061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:32.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.763+0000 7f0a0e5ff700 1 --2- 172.21.15.72:0/4180731876 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f09f405ef80 0x7f09f4061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:32.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.763+0000 7f0a0e5ff700 1 -- 172.21.15.72:0/4180731876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a08063830 msgr2=0x7f0a081515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:32.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.763+0000 7f0a0e5ff700 1 --2- 172.21.15.72:0/4180731876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a08063830 0x7f0a081515f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f09f800c410 tx=0x7f09f8007d30).stop 2023-08-31T19:26:32.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.764+0000 7f0a0e5ff700 1 -- 172.21.15.72:0/4180731876 shutdown_connections 2023-08-31T19:26:32.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.764+0000 7f0a0e5ff700 1 --2- 172.21.15.72:0/4180731876 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f09f405ef80 0x7f09f4061440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.764+0000 7f0a0e5ff700 1 --2- 172.21.15.72:0/4180731876 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f0a08154410 0x7f0a080c2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.764+0000 7f0a0e5ff700 1 --2- 172.21.15.72:0/4180731876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a08063830 0x7f0a081515f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.764+0000 7f0a0e5ff700 1 --2- 172.21.15.72:0/4180731876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a08154030 0x7f0a0814e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.764+0000 7f0a0e5ff700 1 -- 172.21.15.72:0/4180731876 >> 172.21.15.72:0/4180731876 conn(0x7f0a0805eb60 msgr2=0x7f0a080aaf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:32.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.764+0000 7f0a0e5ff700 1 -- 172.21.15.72:0/4180731876 shutdown_connections 2023-08-31T19:26:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:32.764+0000 7f0a0e5ff700 1 -- 172.21.15.72:0/4180731876 wait complete. 2023-08-31T19:26:32.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:26:32.784 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-31T19:26:32.839 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-31T19:26:32.936 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:32.936+0000 7feb0e50f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:26:32.982 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:32.981+0000 7f8823428680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:26:33.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.036+0000 7f3eb39ff700 1 Processor -- start 2023-08-31T19:26:33.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.037+0000 7f3eb39ff700 1 -- start start 2023-08-31T19:26:33.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.038+0000 7f3eb39ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3eac0c4d10 0x7f3eac158720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:33.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.038+0000 7f3eb39ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3eac0636e0 0x7f3eac0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:33.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.038+0000 7f3eb39ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac0682a0 con 0x7f3eac0c58f0 2023-08-31T19:26:33.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.038+0000 7f3eb39ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac0679e0 con 0x7f3eac0636e0 2023-08-31T19:26:33.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.038+0000 7f3eb39ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac0c5d20 con 0x7f3eac0c4d10 2023-08-31T19:26:33.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.038+0000 7f3eb0f9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3eac0636e0 0x7f3eac0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:33.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.038+0000 7f3eb0f9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3eac0636e0 0x7f3eac0c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38500/0 (socket says 172.21.15.72:38500) 2023-08-31T19:26:33.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.038+0000 7f3eb0f9a700 1 -- 172.21.15.72:0/3600934224 learned_addr learned my addr 172.21.15.72:0/3600934224 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:33.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.038+0000 7f3eb179b700 1 --2- 172.21.15.72:0/3600934224 >> v2:172.21.15.146:3300/0 conn(0x7f3eac0c4d10 0x7f3eac158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:33.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.039+0000 7f3eb0f9a700 1 -- 172.21.15.72:0/3600934224 >> v2:172.21.15.146:3300/0 conn(0x7f3eac0c4d10 msgr2=0x7f3eac158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:33.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.039+0000 7f3eb0f9a700 1 --2- 172.21.15.72:0/3600934224 >> v2:172.21.15.146:3300/0 conn(0x7f3eac0c4d10 0x7f3eac158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:33.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.039+0000 7f3eb0f9a700 1 -- 172.21.15.72:0/3600934224 >> v1:172.21.15.146:6789/0 conn(0x7f3eac0c58f0 legacy=0x7f3eac1546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:33.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.039+0000 7f3eb0f9a700 1 -- 172.21.15.72:0/3600934224 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac067c50 con 0x7f3eac0636e0 2023-08-31T19:26:33.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.039+0000 7f3eb0f9a700 1 --2- 172.21.15.72:0/3600934224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0636e0 0x7f3eac0c5400 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f3eac065940 tx=0x7f3e9c0090f0).ready entity=mon.0 client_cookie=ef3f8ad7ac6e3056 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:33.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.039+0000 7f3ea3fff700 1 -- 172.21.15.72:0/3600934224 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c00b520 con 0x7f3eac0636e0 2023-08-31T19:26:33.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.039+0000 7f3ea3fff700 1 -- 172.21.15.72:0/3600934224 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c00b680 con 0x7f3eac0636e0 2023-08-31T19:26:33.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.039+0000 7f3ea3fff700 1 -- 172.21.15.72:0/3600934224 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c00ba00 con 0x7f3eac0636e0 2023-08-31T19:26:33.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.040+0000 7f3eb39ff700 1 -- 172.21.15.72:0/3600934224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0636e0 msgr2=0x7f3eac0c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:33.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.040+0000 7f3eb39ff700 1 --2- 172.21.15.72:0/3600934224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0636e0 0x7f3eac0c5400 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f3eac065940 tx=0x7f3e9c0090f0).stop 2023-08-31T19:26:33.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.040+0000 7f3eb39ff700 1 -- 172.21.15.72:0/3600934224 shutdown_connections 2023-08-31T19:26:33.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.040+0000 7f3eb39ff700 1 --2- 172.21.15.72:0/3600934224 >> v2:172.21.15.146:3300/0 conn(0x7f3eac0c4d10 0x7f3eac158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:33.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.040+0000 7f3eb39ff700 1 --2- 172.21.15.72:0/3600934224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0636e0 0x7f3eac0c5400 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:33.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.040+0000 7f3eb39ff700 1 -- 172.21.15.72:0/3600934224 >> 172.21.15.72:0/3600934224 conn(0x7f3eac066350 msgr2=0x7f3eac066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:33.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.040+0000 7f3eb39ff700 1 -- 172.21.15.72:0/3600934224 shutdown_connections 2023-08-31T19:26:33.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.040+0000 7f3eb39ff700 1 -- 172.21.15.72:0/3600934224 wait complete. 2023-08-31T19:26:33.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.042+0000 7f3eb39ff700 1 Processor -- start 2023-08-31T19:26:33.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.043+0000 7f3eb39ff700 1 -- start start 2023-08-31T19:26:33.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb39ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3eac0636e0 0x7f3eac0a9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:33.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb39ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0c4d10 0x7f3eac13a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:33.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb39ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eac0c58f0 0x7f3eac0ad480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:33.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb39ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac13abd0 con 0x7f3eac0c4d10 2023-08-31T19:26:33.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb39ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0aa9e0 con 0x7f3eac0c58f0 2023-08-31T19:26:33.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb39ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0ad970 con 0x7f3eac0636e0 2023-08-31T19:26:33.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb0f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0c4d10 0x7f3eac13a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:33.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb0f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0c4d10 0x7f3eac13a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38508/0 (socket says 172.21.15.72:38508) 2023-08-31T19:26:33.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb0f9a700 1 -- 172.21.15.72:0/1638473609 learned_addr learned my addr 172.21.15.72:0/1638473609 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:33.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb1f9c700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eac0c58f0 0x7f3eac0ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:33.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb179b700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3eac0636e0 0x7f3eac0a9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:33.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb0f9a700 1 -- 172.21.15.72:0/1638473609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3eac0636e0 msgr2=0x7f3eac0a9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:33.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb0f9a700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3eac0636e0 0x7f3eac0a9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:33.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb0f9a700 1 -- 172.21.15.72:0/1638473609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eac0c58f0 msgr2=0x7f3eac0ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:33.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb0f9a700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eac0c58f0 0x7f3eac0ad480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:33.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.044+0000 7f3eb0f9a700 1 -- 172.21.15.72:0/1638473609 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c009370 con 0x7f3eac0c4d10 2023-08-31T19:26:33.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.045+0000 7f3eb0f9a700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0c4d10 0x7f3eac13a6e0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f3e9c009130 tx=0x7f3e9c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:33.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.045+0000 7f3ea17fa700 1 -- 172.21.15.72:0/1638473609 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c000bc0 con 0x7f3eac0c4d10 2023-08-31T19:26:33.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.045+0000 7f3ea17fa700 1 -- 172.21.15.72:0/1638473609 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c00b7f0 con 0x7f3eac0c4d10 2023-08-31T19:26:33.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.045+0000 7f3ea17fa700 1 -- 172.21.15.72:0/1638473609 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c000d20 con 0x7f3eac0c4d10 2023-08-31T19:26:33.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.045+0000 7f3eb39ff700 1 -- 172.21.15.72:0/1638473609 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac0a9dd0 con 0x7f3eac0c4d10 2023-08-31T19:26:33.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.045+0000 7f3eb39ff700 1 -- 172.21.15.72:0/1638473609 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac0aa390 con 0x7f3eac0c4d10 2023-08-31T19:26:33.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.046+0000 7f3eb39ff700 1 -- 172.21.15.72:0/1638473609 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eac064100 con 0x7f3eac0c4d10 2023-08-31T19:26:33.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.047+0000 7f3ea17fa700 1 -- 172.21.15.72:0/1638473609 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 89) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f3e9c01c880 con 0x7f3eac0c4d10 2023-08-31T19:26:33.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.048+0000 7f3ea17fa700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 0x7f3e90061440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:33.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.048+0000 7f3ea17fa700 1 -- 172.21.15.72:0/1638473609 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f3e9c07be80 con 0x7f3eac0c4d10 2023-08-31T19:26:33.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.048+0000 7f3eb179b700 1 -- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 msgr2=0x7f3e90061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:33.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.048+0000 7f3eb179b700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 0x7f3e90061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:33.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.053+0000 7f3ea17fa700 1 -- 172.21.15.72:0/1638473609 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3e9c04cee0 con 0x7f3eac0c4d10 2023-08-31T19:26:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.249+0000 7f3eb179b700 1 -- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 msgr2=0x7f3e90061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:33.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.249+0000 7f3eb179b700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 0x7f3e90061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:26:33.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.253+0000 7f3eb39ff700 1 -- 172.21.15.72:0/1638473609 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3eac0aab70 con 0x7f3e9005ef80 2023-08-31T19:26:33.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.650+0000 7f3eb179b700 1 -- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 msgr2=0x7f3e90061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:33.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:33.650+0000 7f3eb179b700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 0x7f3e90061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2023-08-31T19:26:33.684 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:33.683+0000 7feb0e50f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:26:33.730 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:33.730+0000 7f8823428680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:26:33.766 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:33.766+0000 7feb0e50f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:26:33.813 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:33.813+0000 7f8823428680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:26:33.998 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:33.998+0000 7feb0e50f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:26:34.043 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:34.043+0000 7f8823428680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:26:34.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:34.451+0000 7f3eb179b700 1 -- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 msgr2=0x7f3e90061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:34.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:34.451+0000 7f3eb179b700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 0x7f3e90061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2023-08-31T19:26:34.509 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:34.508+0000 7feb0e50f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:26:34.550 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:34.550+0000 7f8823428680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:26:34.633 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:34.633+0000 7feb0e50f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:26:34.675 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:34.675+0000 7f8823428680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:26:34.817 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:34.817+0000 7feb0e50f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:26:34.856 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:34.856+0000 7f8823428680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:26:34.909 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:34.909+0000 7feb0e50f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:26:34.949 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:34.949+0000 7f8823428680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:26:34.993 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:34.993+0000 7feb0e50f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:26:35.033 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:35.033+0000 7f8823428680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:26:35.300 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:35.300+0000 7feb0e50f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:26:35.342 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:35.342+0000 7f8823428680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:26:35.522 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:35.521+0000 7feb0e50f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:26:35.563 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:35.563+0000 7f8823428680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:26:36.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:36.053+0000 7f3eb179b700 1 -- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 msgr2=0x7f3e90061440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:36.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:36.053+0000 7f3eb179b700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 0x7f3e90061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2023-08-31T19:26:36.320 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:36.320+0000 7feb0e50f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:26:36.365 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:36.364+0000 7f8823428680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:26:36.407 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:36.407+0000 7feb0e50f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:26:36.452 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:36.452+0000 7f8823428680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:26:36.500 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:36.500+0000 7feb0e50f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:26:36.546 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:36.545+0000 7f8823428680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:26:36.682 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:36.682+0000 7feb0e50f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:26:36.730 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:36.730+0000 7f8823428680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:26:36.771 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:36.770+0000 7feb0e50f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:26:36.819 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:36.819+0000 7f8823428680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:26:36.910 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:36.910+0000 7feb0e50f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:26:36.961 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:36.961+0000 7f8823428680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:26:37.040 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:37.039+0000 7feb0e50f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:26:37.092 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:37.092+0000 7f8823428680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:26:37.385 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:37.384+0000 7feb0e50f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:26:37.434 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:37.434+0000 7f8823428680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:26:37.473 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:37.473+0000 7feb0e50f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:26:37.524 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:37.524+0000 7f8823428680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:26:37.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:37.531+0000 7f3ea17fa700 1 -- 172.21.15.72:0/1638473609 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 90) v1 ==== 75391+0+0 (secure 0 0 0) 0x7f3e9c079840 con 0x7f3eac0c4d10 2023-08-31T19:26:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:37.541+0000 7f3ea17fa700 1 -- 172.21.15.72:0/1638473609 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mgrmap(e 91) v1 ==== 75113+0+0 (secure 0 0 0) 0x7f3e9c079bc0 con 0x7f3eac0c4d10 2023-08-31T19:26:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:37.542+0000 7f3ea17fa700 1 -- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 msgr2=0x7f3e90061440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:37.542+0000 7f3ea17fa700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 0x7f3e90061440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:37.619 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:37.618+0000 7f8798f07700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:37.619 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:37.618+0000 7f8798f07700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:37.619 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:37.618+0000 7f8798f07700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:37.619 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:37.618+0000 7f8798f07700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:37.619 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:37.618+0000 7f8798f07700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:37.620 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:37.618+0000 7f8795f01700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:37.620 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:37.618+0000 7f8795f01700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:37.620 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:37.618+0000 7f8795f01700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:37.620 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:37.618+0000 7f8795f01700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:37.620 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:37.618+0000 7f8795f01700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:38.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.553+0000 7f3ea17fa700 1 -- 172.21.15.72:0/1638473609 <== mon.0 v2:172.21.15.72:3300/0 9 ==== mgrmap(e 92) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f3e9c07a050 con 0x7f3eac0c4d10 2023-08-31T19:26:38.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.554+0000 7f3ea17fa700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 0x7f3e900613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:38.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.554+0000 7f3ea17fa700 1 -- 172.21.15.72:0/1638473609 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3eac0aab70 con 0x7f3e9005ef80 2023-08-31T19:26:38.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.557+0000 7f3eb179b700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 0x7f3e900613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:38.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.560+0000 7f3eb179b700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 0x7f3e900613c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f3ea8009690 tx=0x7f3ea8009060).ready entity=mgr.7712 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:38.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.568+0000 7f3ea17fa700 1 -- 172.21.15.72:0/1638473609 <== mgr.7712 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3eac0aab70 con 0x7f3e9005ef80 2023-08-31T19:26:38.569 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule set for path snap_test_dir1 2023-08-31T19:26:38.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.571+0000 7f3eb39ff700 1 -- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 msgr2=0x7f3e900613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:38.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.571+0000 7f3eb39ff700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 0x7f3e900613c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f3ea8009690 tx=0x7f3ea8009060).stop 2023-08-31T19:26:38.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.571+0000 7f3eb39ff700 1 -- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0c4d10 msgr2=0x7f3eac13a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:38.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.571+0000 7f3eb39ff700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0c4d10 0x7f3eac13a6e0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f3e9c009130 tx=0x7f3e9c017000).stop 2023-08-31T19:26:38.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.571+0000 7f3eb39ff700 1 -- 172.21.15.72:0/1638473609 shutdown_connections 2023-08-31T19:26:38.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.571+0000 7f3eb39ff700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3e9005ef80 0x7f3e900613c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:38.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.571+0000 7f3eb39ff700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3eac0c58f0 0x7f3eac0ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:38.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.571+0000 7f3eb39ff700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3eac0636e0 0x7f3eac0a9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:38.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.571+0000 7f3eb39ff700 1 --2- 172.21.15.72:0/1638473609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eac0c4d10 0x7f3eac13a6e0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:38.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.571+0000 7f3eb39ff700 1 -- 172.21.15.72:0/1638473609 >> 172.21.15.72:0/1638473609 conn(0x7f3eac066350 msgr2=0x7f3eac0be150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:38.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.571+0000 7f3eb39ff700 1 -- 172.21.15.72:0/1638473609 shutdown_connections 2023-08-31T19:26:38.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.571+0000 7f3eb39ff700 1 -- 172.21.15.72:0/1638473609 wait complete. 2023-08-31T19:26:38.591 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-31T19:26:38.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-08-31T19:26:38.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.787+0000 7ff9b27ff700 1 Processor -- start 2023-08-31T19:26:38.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.787+0000 7ff9b27ff700 1 -- start start 2023-08-31T19:26:38.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.788+0000 7ff9b27ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9ac063830 0x7ff9ac0c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:38.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.788+0000 7ff9b27ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac0c6ed0 con 0x7ff9ac154410 2023-08-31T19:26:38.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.788+0000 7ff9b27ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac0c68c0 con 0x7ff9ac154030 2023-08-31T19:26:38.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.788+0000 7ff9b27ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ac0c66e0 con 0x7ff9ac063830 2023-08-31T19:26:38.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.789+0000 7ff9b0d9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9ac063830 0x7ff9ac0c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:38.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.789+0000 7ff9ab7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff9ac154410 0x7ff9ac063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38732/0 (socket says 172.21.15.72:38732) 2023-08-31T19:26:38.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.789+0000 7ff9ab7fe700 1 -- 172.21.15.72:0/3970984770 learned_addr learned my addr 172.21.15.72:0/3970984770 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:38.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.789+0000 7ff9b0d9c700 1 -- 172.21.15.72:0/3970984770 >> v1:172.21.15.146:6789/0 conn(0x7ff9ac154030 legacy=0x7ff9ac0aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:38.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.789+0000 7ff9b0d9c700 1 -- 172.21.15.72:0/3970984770 >> v1:172.21.15.72:6789/0 conn(0x7ff9ac154410 legacy=0x7ff9ac063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:38.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.789+0000 7ff9b0d9c700 1 -- 172.21.15.72:0/3970984770 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac0c0f30 con 0x7ff9ac063830 2023-08-31T19:26:38.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.789+0000 7ff9aaffd700 1 -- 172.21.15.72:0/3970984770 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135590813 0 0) 0x7ff9ac0c6ed0 con 0x7ff9ac154410 2023-08-31T19:26:38.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.789+0000 7ff9b0d9c700 1 --2- 172.21.15.72:0/3970984770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ac063830 0x7ff9ac0c06b0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7ff9a4009e60 tx=0x7ff9a4009780).ready entity=mon.0 client_cookie=6c6bfb2d98c09b1c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:38.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.790+0000 7ff9aaffd700 1 -- 172.21.15.72:0/3970984770 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a400e070 con 0x7ff9ac063830 2023-08-31T19:26:38.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.790+0000 7ff9aaffd700 1 -- 172.21.15.72:0/3970984770 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a400bbf0 con 0x7ff9ac063830 2023-08-31T19:26:38.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.790+0000 7ff9aaffd700 1 -- 172.21.15.72:0/3970984770 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4012410 con 0x7ff9ac063830 2023-08-31T19:26:38.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.790+0000 7ff9b27ff700 1 -- 172.21.15.72:0/3970984770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ac063830 msgr2=0x7ff9ac0c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:38.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.790+0000 7ff9b27ff700 1 --2- 172.21.15.72:0/3970984770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ac063830 0x7ff9ac0c06b0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7ff9a4009e60 tx=0x7ff9a4009780).stop 2023-08-31T19:26:38.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.790+0000 7ff9b27ff700 1 -- 172.21.15.72:0/3970984770 shutdown_connections 2023-08-31T19:26:38.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.790+0000 7ff9b27ff700 1 --2- 172.21.15.72:0/3970984770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ac063830 0x7ff9ac0c06b0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:38.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.790+0000 7ff9b27ff700 1 -- 172.21.15.72:0/3970984770 >> 172.21.15.72:0/3970984770 conn(0x7ff9ac05eb60 msgr2=0x7ff9ac0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:38.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.790+0000 7ff9b27ff700 1 -- 172.21.15.72:0/3970984770 shutdown_connections 2023-08-31T19:26:38.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.790+0000 7ff9b27ff700 1 -- 172.21.15.72:0/3970984770 wait complete. 2023-08-31T19:26:38.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.792+0000 7ff9b27ff700 1 Processor -- start 2023-08-31T19:26:38.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.792+0000 7ff9b27ff700 1 -- start start 2023-08-31T19:26:38.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.793+0000 7ff9b27ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ac063830 0x7ff9ac0c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:38.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.793+0000 7ff9b27ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9ac154030 0x7ff9ac141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:38.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.793+0000 7ff9b27ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9ac154410 0x7ff9ac1525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:38.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.793+0000 7ff9b27ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0af6c0 con 0x7ff9ac063830 2023-08-31T19:26:38.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.793+0000 7ff9b27ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0af0b0 con 0x7ff9ac154030 2023-08-31T19:26:38.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.793+0000 7ff9b27ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0c31c0 con 0x7ff9ac154410 2023-08-31T19:26:38.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.793+0000 7ff9abfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ac063830 0x7ff9ac0c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:38.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.793+0000 7ff9abfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ac063830 0x7ff9ac0c28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38608/0 (socket says 172.21.15.72:38608) 2023-08-31T19:26:38.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.793+0000 7ff9abfff700 1 -- 172.21.15.72:0/2648577672 learned_addr learned my addr 172.21.15.72:0/2648577672 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:38.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.793+0000 7ff9abfff700 1 -- 172.21.15.72:0/2648577672 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9ac154410 msgr2=0x7ff9ac1525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:38.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.793+0000 7ff9abfff700 1 --2- 172.21.15.72:0/2648577672 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9ac154410 0x7ff9ac1525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:38.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.793+0000 7ff9abfff700 1 -- 172.21.15.72:0/2648577672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9ac154030 msgr2=0x7ff9ac141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:38.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.793+0000 7ff9abfff700 1 --2- 172.21.15.72:0/2648577672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9ac154030 0x7ff9ac141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:38.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.793+0000 7ff9abfff700 1 -- 172.21.15.72:0/2648577672 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a4009a20 con 0x7ff9ac063830 2023-08-31T19:26:38.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.794+0000 7ff9abfff700 1 --2- 172.21.15.72:0/2648577672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ac063830 0x7ff9ac0c28e0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7ff99c00c440 tx=0x7ff99c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:38.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.794+0000 7ff993fff700 1 -- 172.21.15.72:0/2648577672 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00f470 con 0x7ff9ac063830 2023-08-31T19:26:38.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.794+0000 7ff993fff700 1 -- 172.21.15.72:0/2648577672 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c00f5f0 con 0x7ff9ac063830 2023-08-31T19:26:38.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.794+0000 7ff993fff700 1 -- 172.21.15.72:0/2648577672 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00f9b0 con 0x7ff9ac063830 2023-08-31T19:26:38.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.794+0000 7ff9b27ff700 1 -- 172.21.15.72:0/2648577672 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac0af350 con 0x7ff9ac063830 2023-08-31T19:26:38.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.794+0000 7ff9b27ff700 1 -- 172.21.15.72:0/2648577672 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac0c34a0 con 0x7ff9ac063830 2023-08-31T19:26:38.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.795+0000 7ff9b27ff700 1 -- 172.21.15.72:0/2648577672 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ac0cb700 con 0x7ff9ac063830 2023-08-31T19:26:38.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.796+0000 7ff993fff700 1 -- 172.21.15.72:0/2648577672 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 92) v1 ==== 75183+0+0 (secure 0 0 0) 0x7ff99c012400 con 0x7ff9ac063830 2023-08-31T19:26:38.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.796+0000 7ff993fff700 1 --2- 172.21.15.72:0/2648577672 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ff99805ed40 0x7ff998061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:38.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.796+0000 7ff993fff700 1 -- 172.21.15.72:0/2648577672 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7ff99c0794a0 con 0x7ff9ac063830 2023-08-31T19:26:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.797+0000 7ff9ab7fe700 1 --2- 172.21.15.72:0/2648577672 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ff99805ed40 0x7ff998061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.797+0000 7ff9ab7fe700 1 --2- 172.21.15.72:0/2648577672 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ff99805ed40 0x7ff998061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff9ac0c2830 tx=0x7ff9a0007a50).ready entity=mgr.7712 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:38.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:38.800+0000 7ff993fff700 1 -- 172.21.15.72:0/2648577672 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff99c0488f0 con 0x7ff9ac063830 2023-08-31T19:26:39.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.000+0000 7ff9b27ff700 1 -- 172.21.15.72:0/2648577672 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9ac0af800 con 0x7ff99805ed40 2023-08-31T19:26:39.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.004+0000 7ff993fff700 1 -- 172.21.15.72:0/2648577672 <== mgr.7712 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7ff9a0001100 con 0x7ff99805ed40 2023-08-31T19:26:39.005 INFO:teuthology.orchestra.run.smithi072.stdout:Retention added to path snap_test_dir1 2023-08-31T19:26:39.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.006+0000 7ff9b27ff700 1 -- 172.21.15.72:0/2648577672 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ff99805ed40 msgr2=0x7ff998061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:39.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.006+0000 7ff9b27ff700 1 --2- 172.21.15.72:0/2648577672 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ff99805ed40 0x7ff998061200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff9ac0c2830 tx=0x7ff9a0007a50).stop 2023-08-31T19:26:39.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.006+0000 7ff9b27ff700 1 -- 172.21.15.72:0/2648577672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ac063830 msgr2=0x7ff9ac0c28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:39.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.006+0000 7ff9b27ff700 1 --2- 172.21.15.72:0/2648577672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ac063830 0x7ff9ac0c28e0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7ff99c00c440 tx=0x7ff99c007de0).stop 2023-08-31T19:26:39.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.007+0000 7ff9b27ff700 1 -- 172.21.15.72:0/2648577672 shutdown_connections 2023-08-31T19:26:39.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.007+0000 7ff9b27ff700 1 --2- 172.21.15.72:0/2648577672 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ff99805ed40 0x7ff998061200 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:39.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.007+0000 7ff9b27ff700 1 --2- 172.21.15.72:0/2648577672 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff9ac154410 0x7ff9ac1525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:39.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.007+0000 7ff9b27ff700 1 --2- 172.21.15.72:0/2648577672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9ac063830 0x7ff9ac0c28e0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:39.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.007+0000 7ff9b27ff700 1 --2- 172.21.15.72:0/2648577672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9ac154030 0x7ff9ac141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:39.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.007+0000 7ff9b27ff700 1 -- 172.21.15.72:0/2648577672 >> 172.21.15.72:0/2648577672 conn(0x7ff9ac05eb60 msgr2=0x7ff9ac14f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:39.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.007+0000 7ff9b27ff700 1 -- 172.21.15.72:0/2648577672 shutdown_connections 2023-08-31T19:26:39.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.007+0000 7ff9b27ff700 1 -- 172.21.15.72:0/2648577672 wait complete. 2023-08-31T19:26:39.024 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-08-31T19:26:39.028 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-31-19_27_00 in ~21s... 2023-08-31T19:26:39.028 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-08-31T19:26:39.029 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-31T19:26:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.221+0000 7f761f1ff700 1 Processor -- start 2023-08-31T19:26:39.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.221+0000 7f761f1ff700 1 -- start start 2023-08-31T19:26:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.222+0000 7f761f1ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7618064d70 0x7f76181553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.222+0000 7f761f1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7618154f40 con 0x7f76180c5370 2023-08-31T19:26:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.223+0000 7f761f1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76180c5780 con 0x7f7618151da0 2023-08-31T19:26:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.223+0000 7f761f1ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7618154960 con 0x7f7618064d70 2023-08-31T19:26:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.223+0000 7f7617fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7618064d70 0x7f76181553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.223+0000 7f761d79c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f76180c5370 0x7f76180bfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38740/0 (socket says 172.21.15.72:38740) 2023-08-31T19:26:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.223+0000 7f761d79c700 1 -- 172.21.15.72:0/534103491 learned_addr learned my addr 172.21.15.72:0/534103491 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:39.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.223+0000 7f7617fff700 1 -- 172.21.15.72:0/534103491 >> v1:172.21.15.146:6789/0 conn(0x7f7618151da0 legacy=0x7f7618064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:39.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.223+0000 7f7617fff700 1 -- 172.21.15.72:0/534103491 >> v1:172.21.15.72:6789/0 conn(0x7f76180c5370 legacy=0x7f76180bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:39.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.223+0000 7f7617fff700 1 -- 172.21.15.72:0/534103491 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76180aa2c0 con 0x7f7618064d70 2023-08-31T19:26:39.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.223+0000 7f7617fff700 1 --2- 172.21.15.72:0/534103491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7618064d70 0x7f76181553d0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 rx=0x7f7604009760 tx=0x7f7604009060).ready entity=mon.0 client_cookie=12ad8bb0b4a60754 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:39.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.224+0000 7f76177fe700 1 -- 172.21.15.72:0/534103491 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400f510 con 0x7f7618064d70 2023-08-31T19:26:39.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.224+0000 7f76177fe700 1 -- 172.21.15.72:0/534103491 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760400f670 con 0x7f7618064d70 2023-08-31T19:26:39.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.224+0000 7f76177fe700 1 -- 172.21.15.72:0/534103491 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400f9f0 con 0x7f7618064d70 2023-08-31T19:26:39.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.224+0000 7f761f1ff700 1 -- 172.21.15.72:0/534103491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7618064d70 msgr2=0x7f76181553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:39.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.224+0000 7f761f1ff700 1 --2- 172.21.15.72:0/534103491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7618064d70 0x7f76181553d0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 rx=0x7f7604009760 tx=0x7f7604009060).stop 2023-08-31T19:26:39.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.224+0000 7f761f1ff700 1 -- 172.21.15.72:0/534103491 shutdown_connections 2023-08-31T19:26:39.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.224+0000 7f761f1ff700 1 --2- 172.21.15.72:0/534103491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7618064d70 0x7f76181553d0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:39.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.224+0000 7f761f1ff700 1 -- 172.21.15.72:0/534103491 >> 172.21.15.72:0/534103491 conn(0x7f7618063a90 msgr2=0x7f76180cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:39.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.224+0000 7f761f1ff700 1 -- 172.21.15.72:0/534103491 shutdown_connections 2023-08-31T19:26:39.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.224+0000 7f761f1ff700 1 -- 172.21.15.72:0/534103491 wait complete. 2023-08-31T19:26:39.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.226+0000 7f761f1ff700 1 Processor -- start 2023-08-31T19:26:39.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.226+0000 7f761f1ff700 1 -- start start 2023-08-31T19:26:39.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f761f1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7618064d70 0x7f761814ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:39.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f761f1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76180c5370 0x7f761814d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:39.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f761f1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7618151da0 0x7f76180ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:39.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f761f1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76180c4460 con 0x7f7618064d70 2023-08-31T19:26:39.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f761f1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76180c3890 con 0x7f7618151da0 2023-08-31T19:26:39.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f761f1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76180c3b30 con 0x7f76180c5370 2023-08-31T19:26:39.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f761cf9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7618064d70 0x7f761814ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:39.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f761cf9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7618064d70 0x7f761814ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38634/0 (socket says 172.21.15.72:38634) 2023-08-31T19:26:39.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f761cf9b700 1 -- 172.21.15.72:0/1341147400 learned_addr learned my addr 172.21.15.72:0/1341147400 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:39.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f7617fff700 1 --2- 172.21.15.72:0/1341147400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76180c5370 0x7f761814d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:39.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f761d79c700 1 --2- 172.21.15.72:0/1341147400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7618151da0 0x7f76180ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f761cf9b700 1 -- 172.21.15.72:0/1341147400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76180c5370 msgr2=0x7f761814d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f761cf9b700 1 --2- 172.21.15.72:0/1341147400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76180c5370 0x7f761814d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f761cf9b700 1 -- 172.21.15.72:0/1341147400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7618151da0 msgr2=0x7f76180ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f761cf9b700 1 --2- 172.21.15.72:0/1341147400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7618151da0 0x7f76180ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.227+0000 7f761cf9b700 1 -- 172.21.15.72:0/1341147400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76040092a0 con 0x7f7618064d70 2023-08-31T19:26:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.228+0000 7f761cf9b700 1 --2- 172.21.15.72:0/1341147400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7618064d70 0x7f761814ede0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f760c00c440 tx=0x7f760c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.228+0000 7f7614ff9700 1 -- 172.21.15.72:0/1341147400 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c007020 con 0x7f7618064d70 2023-08-31T19:26:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.228+0000 7f7614ff9700 1 -- 172.21.15.72:0/1341147400 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c007180 con 0x7f7618064d70 2023-08-31T19:26:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.228+0000 7f7614ff9700 1 -- 172.21.15.72:0/1341147400 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c007520 con 0x7f7618064d70 2023-08-31T19:26:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.228+0000 7f761f1ff700 1 -- 172.21.15.72:0/1341147400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76180c3e10 con 0x7f7618064d70 2023-08-31T19:26:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.228+0000 7f761f1ff700 1 -- 172.21.15.72:0/1341147400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761814db50 con 0x7f7618064d70 2023-08-31T19:26:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.229+0000 7f761f1ff700 1 -- 172.21.15.72:0/1341147400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761806a7e0 con 0x7f7618064d70 2023-08-31T19:26:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.230+0000 7f7614ff9700 1 -- 172.21.15.72:0/1341147400 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 92) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f760c0068b0 con 0x7f7618064d70 2023-08-31T19:26:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.231+0000 7f7614ff9700 1 --2- 172.21.15.72:0/1341147400 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f75fc05ed10 0x7f75fc0611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.231+0000 7f7614ff9700 1 -- 172.21.15.72:0/1341147400 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f760c079330 con 0x7f7618064d70 2023-08-31T19:26:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.231+0000 7f7617fff700 1 --2- 172.21.15.72:0/1341147400 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f75fc05ed10 0x7f75fc0611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.231+0000 7f7617fff700 1 --2- 172.21.15.72:0/1341147400 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f75fc05ed10 0x7f75fc0611d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7604009760 tx=0x7f7604017000).ready entity=mgr.7712 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.235+0000 7f7614ff9700 1 -- 172.21.15.72:0/1341147400 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f760c0478f0 con 0x7f7618064d70 2023-08-31T19:26:39.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.432+0000 7f761f1ff700 1 -- 172.21.15.72:0/1341147400 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76180c45a0 con 0x7f75fc05ed10 2023-08-31T19:26:39.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.435+0000 7f7614ff9700 1 -- 172.21.15.72:0/1341147400 <== mgr.7712 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f760400f7e0 con 0x7f75fc05ed10 2023-08-31T19:26:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:39.435 INFO:teuthology.orchestra.run.smithi072.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-31T19:26:39.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.436+0000 7f761f1ff700 1 -- 172.21.15.72:0/1341147400 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f75fc05ed10 msgr2=0x7f75fc0611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:39.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.436+0000 7f761f1ff700 1 --2- 172.21.15.72:0/1341147400 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f75fc05ed10 0x7f75fc0611d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7604009760 tx=0x7f7604017000).stop 2023-08-31T19:26:39.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.436+0000 7f761f1ff700 1 -- 172.21.15.72:0/1341147400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7618064d70 msgr2=0x7f761814ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:39.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.436+0000 7f761f1ff700 1 --2- 172.21.15.72:0/1341147400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7618064d70 0x7f761814ede0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f760c00c440 tx=0x7f760c007e00).stop 2023-08-31T19:26:39.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.437+0000 7f761f1ff700 1 -- 172.21.15.72:0/1341147400 shutdown_connections 2023-08-31T19:26:39.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.437+0000 7f761f1ff700 1 --2- 172.21.15.72:0/1341147400 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f75fc05ed10 0x7f75fc0611d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:39.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.437+0000 7f761f1ff700 1 --2- 172.21.15.72:0/1341147400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7618151da0 0x7f76180ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:39.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.437+0000 7f761f1ff700 1 --2- 172.21.15.72:0/1341147400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7618064d70 0x7f761814ede0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:39.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.437+0000 7f761f1ff700 1 --2- 172.21.15.72:0/1341147400 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f76180c5370 0x7f761814d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:39.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.437+0000 7f761f1ff700 1 -- 172.21.15.72:0/1341147400 >> 172.21.15.72:0/1341147400 conn(0x7f7618063a90 msgr2=0x7f7618064660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:39.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.437+0000 7f761f1ff700 1 -- 172.21.15.72:0/1341147400 shutdown_connections 2023-08-31T19:26:39.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.437+0000 7f761f1ff700 1 -- 172.21.15.72:0/1341147400 wait complete. 2023-08-31T19:26:39.454 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-31T19:26:39.455 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-08-31T19:26:39.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-31T19:26:39.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.650+0000 7f4ca15ff700 1 Processor -- start 2023-08-31T19:26:39.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.650+0000 7f4ca15ff700 1 -- start start 2023-08-31T19:26:39.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.651+0000 7f4ca15ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c9c068c20 0x7f4c9c069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:39.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.651+0000 7f4ca15ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4c9c062650 0x7f4c9c063c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:39.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.651+0000 7f4ca15ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c9c064110 con 0x7f4c9c0c1b50 2023-08-31T19:26:39.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.651+0000 7f4ca15ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9c062b80 con 0x7f4c9c062650 2023-08-31T19:26:39.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.651+0000 7f4ca15ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c062e60 con 0x7f4c9c068c20 2023-08-31T19:26:39.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.651+0000 7f4c9b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4c9c0c1b50 0x7f4c9c157000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38752/0 (socket says 172.21.15.72:38752) 2023-08-31T19:26:39.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.651+0000 7f4c9b7fe700 1 -- 172.21.15.72:0/2147466701 learned_addr learned my addr 172.21.15.72:0/2147466701 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:39.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.652+0000 7f4c9a7fc700 1 --2- 172.21.15.72:0/2147466701 >> v2:172.21.15.146:3300/0 conn(0x7f4c9c062650 0x7f4c9c063c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:39.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.652+0000 7f4c9affd700 1 --2- 172.21.15.72:0/2147466701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c9c068c20 0x7f4c9c069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:39.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.652+0000 7f4c99ffb700 1 -- 172.21.15.72:0/2147466701 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511561670 0 0) 0x7f4c9c064110 con 0x7f4c9c0c1b50 2023-08-31T19:26:39.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.652+0000 7f4c99ffb700 1 -- 172.21.15.72:0/2147466701 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c840033f0 con 0x7f4c9c0c1b50 2023-08-31T19:26:39.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.652+0000 7f4c9a7fc700 1 -- 172.21.15.72:0/2147466701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c9c068c20 msgr2=0x7f4c9c069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:39.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.652+0000 7f4c9a7fc700 1 --2- 172.21.15.72:0/2147466701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c9c068c20 0x7f4c9c069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:39.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.652+0000 7f4c9a7fc700 1 -- 172.21.15.72:0/2147466701 >> v1:172.21.15.72:6789/0 conn(0x7f4c9c0c1b50 legacy=0x7f4c9c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:39.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.652+0000 7f4c9a7fc700 1 -- 172.21.15.72:0/2147466701 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c063140 con 0x7f4c9c062650 2023-08-31T19:26:39.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.652+0000 7f4c9affd700 1 --2- 172.21.15.72:0/2147466701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c9c068c20 0x7f4c9c069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:39.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.652+0000 7f4c9a7fc700 1 --2- 172.21.15.72:0/2147466701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c062650 0x7f4c9c063c20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f4c90009760 tx=0x7f4c90009060).ready entity=mon.1 client_cookie=9151638aa7790623 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:39.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.653+0000 7f4c99ffb700 1 -- 172.21.15.72:0/2147466701 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000d4a0 con 0x7f4c9c062650 2023-08-31T19:26:39.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.653+0000 7f4c99ffb700 1 -- 172.21.15.72:0/2147466701 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9000d600 con 0x7f4c9c062650 2023-08-31T19:26:39.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.653+0000 7f4c99ffb700 1 -- 172.21.15.72:0/2147466701 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000d980 con 0x7f4c9c062650 2023-08-31T19:26:39.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.653+0000 7f4ca15ff700 1 -- 172.21.15.72:0/2147466701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c062650 msgr2=0x7f4c9c063c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:39.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.653+0000 7f4ca15ff700 1 --2- 172.21.15.72:0/2147466701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c062650 0x7f4c9c063c20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f4c90009760 tx=0x7f4c90009060).stop 2023-08-31T19:26:39.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.653+0000 7f4ca15ff700 1 -- 172.21.15.72:0/2147466701 shutdown_connections 2023-08-31T19:26:39.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.653+0000 7f4ca15ff700 1 --2- 172.21.15.72:0/2147466701 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c9c068c20 0x7f4c9c069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:39.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.653+0000 7f4ca15ff700 1 --2- 172.21.15.72:0/2147466701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c062650 0x7f4c9c063c20 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:39.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.653+0000 7f4ca15ff700 1 -- 172.21.15.72:0/2147466701 >> 172.21.15.72:0/2147466701 conn(0x7f4c9c0c72f0 msgr2=0x7f4c9c0c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:39.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.653+0000 7f4ca15ff700 1 -- 172.21.15.72:0/2147466701 shutdown_connections 2023-08-31T19:26:39.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.653+0000 7f4ca15ff700 1 -- 172.21.15.72:0/2147466701 wait complete. 2023-08-31T19:26:39.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.655+0000 7f4ca15ff700 1 Processor -- start 2023-08-31T19:26:39.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.655+0000 7f4ca15ff700 1 -- start start 2023-08-31T19:26:39.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.656+0000 7f4ca15ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c9c062650 0x7f4c9c0a6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:39.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.656+0000 7f4ca15ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9c068c20 0x7f4c9c15a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:39.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.656+0000 7f4ca15ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c0c1b50 0x7f4c9c15a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:39.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.656+0000 7f4ca15ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c15aab0 con 0x7f4c9c068c20 2023-08-31T19:26:39.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.656+0000 7f4ca15ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c159030 con 0x7f4c9c0c1b50 2023-08-31T19:26:39.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.656+0000 7f4ca15ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c159310 con 0x7f4c9c062650 2023-08-31T19:26:39.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.656+0000 7f4c9a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9c068c20 0x7f4c9c15a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:39.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.656+0000 7f4c9a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9c068c20 0x7f4c9c15a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38644/0 (socket says 172.21.15.72:38644) 2023-08-31T19:26:39.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.656+0000 7f4c9a7fc700 1 -- 172.21.15.72:0/2053331226 learned_addr learned my addr 172.21.15.72:0/2053331226 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:39.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.656+0000 7f4c9a7fc700 1 -- 172.21.15.72:0/2053331226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c9c062650 msgr2=0x7f4c9c0a6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:39.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.656+0000 7f4c9a7fc700 1 --2- 172.21.15.72:0/2053331226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c9c062650 0x7f4c9c0a6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:39.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.656+0000 7f4c9a7fc700 1 -- 172.21.15.72:0/2053331226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c0c1b50 msgr2=0x7f4c9c15a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:39.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.656+0000 7f4c9a7fc700 1 --2- 172.21.15.72:0/2053331226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c0c1b50 0x7f4c9c15a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:39.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.656+0000 7f4c9a7fc700 1 -- 172.21.15.72:0/2053331226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c0092a0 con 0x7f4c9c068c20 2023-08-31T19:26:39.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.657+0000 7f4c9a7fc700 1 --2- 172.21.15.72:0/2053331226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9c068c20 0x7f4c9c15a0d0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 rx=0x7f4c9c0c7f40 tx=0x7f4c90016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:39.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.657+0000 7f4c82ffd700 1 -- 172.21.15.72:0/2053331226 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90000c90 con 0x7f4c9c068c20 2023-08-31T19:26:39.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.657+0000 7f4c82ffd700 1 -- 172.21.15.72:0/2053331226 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9000d770 con 0x7f4c9c068c20 2023-08-31T19:26:39.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.657+0000 7f4ca15ff700 1 -- 172.21.15.72:0/2053331226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c900092a0 con 0x7f4c9c068c20 2023-08-31T19:26:39.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.657+0000 7f4c82ffd700 1 -- 172.21.15.72:0/2053331226 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9001d430 con 0x7f4c9c068c20 2023-08-31T19:26:39.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.657+0000 7f4ca15ff700 1 -- 172.21.15.72:0/2053331226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9c1598d0 con 0x7f4c9c068c20 2023-08-31T19:26:39.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.658+0000 7f4ca15ff700 1 -- 172.21.15.72:0/2053331226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9c06c6b0 con 0x7f4c9c068c20 2023-08-31T19:26:39.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.659+0000 7f4c82ffd700 1 -- 172.21.15.72:0/2053331226 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 92) v1 ==== 75183+0+0 (secure 0 0 0) 0x7f4c9001d860 con 0x7f4c9c068c20 2023-08-31T19:26:39.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.659+0000 7f4c82ffd700 1 --2- 172.21.15.72:0/2053331226 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4c8805ed40 0x7f4c88061200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:39.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.659+0000 7f4c82ffd700 1 -- 172.21.15.72:0/2053331226 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f4c9007b930 con 0x7f4c9c068c20 2023-08-31T19:26:39.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.660+0000 7f4c9affd700 1 --2- 172.21.15.72:0/2053331226 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4c8805ed40 0x7f4c88061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:39.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.660+0000 7f4c9affd700 1 --2- 172.21.15.72:0/2053331226 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4c8805ed40 0x7f4c88061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4c8c009be0 tx=0x7f4c8c009060).ready entity=mgr.7712 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:39.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.664+0000 7f4c82ffd700 1 -- 172.21.15.72:0/2053331226 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4c9004cad0 con 0x7f4c9c068c20 2023-08-31T19:26:39.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.854+0000 7f4ca15ff700 1 -- 172.21.15.72:0/2053331226 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c9c06c070 con 0x7f4c8805ed40 2023-08-31T19:26:39.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.858+0000 7f4c82ffd700 1 -- 172.21.15.72:0/2053331226 <== mgr.7712 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f4c9c06c070 con 0x7f4c8805ed40 2023-08-31T19:26:39.858 INFO:teuthology.orchestra.run.smithi072.stdout:Schedule removed for path snap_test_dir1 2023-08-31T19:26:39.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.860+0000 7f4ca15ff700 1 -- 172.21.15.72:0/2053331226 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4c8805ed40 msgr2=0x7f4c88061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:39.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.860+0000 7f4ca15ff700 1 --2- 172.21.15.72:0/2053331226 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4c8805ed40 0x7f4c88061200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4c8c009be0 tx=0x7f4c8c009060).stop 2023-08-31T19:26:39.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.860+0000 7f4ca15ff700 1 -- 172.21.15.72:0/2053331226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9c068c20 msgr2=0x7f4c9c15a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:39.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.860+0000 7f4ca15ff700 1 --2- 172.21.15.72:0/2053331226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9c068c20 0x7f4c9c15a0d0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 rx=0x7f4c9c0c7f40 tx=0x7f4c90016000).stop 2023-08-31T19:26:39.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.860+0000 7f4ca15ff700 1 -- 172.21.15.72:0/2053331226 shutdown_connections 2023-08-31T19:26:39.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.860+0000 7f4ca15ff700 1 --2- 172.21.15.72:0/2053331226 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4c8805ed40 0x7f4c88061200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:39.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.860+0000 7f4ca15ff700 1 --2- 172.21.15.72:0/2053331226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c9c0c1b50 0x7f4c9c15a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:39.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.860+0000 7f4ca15ff700 1 --2- 172.21.15.72:0/2053331226 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4c9c062650 0x7f4c9c0a6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:39.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.860+0000 7f4ca15ff700 1 --2- 172.21.15.72:0/2053331226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9c068c20 0x7f4c9c15a0d0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:39.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.860+0000 7f4ca15ff700 1 -- 172.21.15.72:0/2053331226 >> 172.21.15.72:0/2053331226 conn(0x7f4c9c0c72f0 msgr2=0x7f4c9c0c64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:39.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.860+0000 7f4ca15ff700 1 -- 172.21.15.72:0/2053331226 shutdown_connections 2023-08-31T19:26:39.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:39.860+0000 7f4ca15ff700 1 -- 172.21.15.72:0/2053331226 wait complete. 2023-08-31T19:26:39.881 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-31T19:26:39.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:26:39.882 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-31T19:26:39.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:26:39.932 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-31T19:26:39.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-31T19:26:40.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.170+0000 7f278b9ff700 1 Processor -- start 2023-08-31T19:26:40.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.170+0000 7f278b9ff700 1 -- start start 2023-08-31T19:26:40.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.171+0000 7f278b9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2784153e30 0x7f2784154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:40.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.171+0000 7f278b9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27840c5cb0 0x7f27840c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:40.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.171+0000 7f278b9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f27840630b0 0x7f2784063530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:40.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.171+0000 7f278b9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2784063a20 con 0x7f27840c5cb0 2023-08-31T19:26:40.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.171+0000 7f278b9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27840bfd40 con 0x7f27840630b0 2023-08-31T19:26:40.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.171+0000 7f278b9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27840c6730 con 0x7f2784153e30 2023-08-31T19:26:40.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.171+0000 7f2788f9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27840c5cb0 0x7f27840c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:40.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.171+0000 7f2788f9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27840c5cb0 0x7f27840c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38658/0 (socket says 172.21.15.72:38658) 2023-08-31T19:26:40.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.171+0000 7f2788f9a700 1 -- 172.21.15.72:0/1009878564 learned_addr learned my addr 172.21.15.72:0/1009878564 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:40.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.172+0000 7f278979b700 1 --2- 172.21.15.72:0/1009878564 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2784153e30 0x7f2784154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:40.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.172+0000 7f2789f9c700 1 --2- 172.21.15.72:0/1009878564 >> v2:172.21.15.146:3300/0 conn(0x7f27840630b0 0x7f2784063530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:40.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.172+0000 7f2788f9a700 1 -- 172.21.15.72:0/1009878564 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2784153e30 msgr2=0x7f2784154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:40.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.172+0000 7f2788f9a700 1 --2- 172.21.15.72:0/1009878564 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2784153e30 0x7f2784154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:40.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.172+0000 7f2788f9a700 1 -- 172.21.15.72:0/1009878564 >> v2:172.21.15.146:3300/0 conn(0x7f27840630b0 msgr2=0x7f2784063530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:40.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.172+0000 7f2788f9a700 1 --2- 172.21.15.72:0/1009878564 >> v2:172.21.15.146:3300/0 conn(0x7f27840630b0 0x7f2784063530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:40.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.172+0000 7f2788f9a700 1 -- 172.21.15.72:0/1009878564 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27840bffe0 con 0x7f27840c5cb0 2023-08-31T19:26:40.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.172+0000 7f2788f9a700 1 --2- 172.21.15.72:0/1009878564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840c5cb0 0x7f27840c6130 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f2784062910 tx=0x7f27740090f0).ready entity=mon.0 client_cookie=dcb531de04e8770d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:40.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.172+0000 7f277bfff700 1 -- 172.21.15.72:0/1009878564 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400b600 con 0x7f27840c5cb0 2023-08-31T19:26:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.172+0000 7f277bfff700 1 -- 172.21.15.72:0/1009878564 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277400b760 con 0x7f27840c5cb0 2023-08-31T19:26:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.172+0000 7f277bfff700 1 -- 172.21.15.72:0/1009878564 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400bb00 con 0x7f27840c5cb0 2023-08-31T19:26:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.173+0000 7f278b9ff700 1 -- 172.21.15.72:0/1009878564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840c5cb0 msgr2=0x7f27840c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.173+0000 7f278b9ff700 1 --2- 172.21.15.72:0/1009878564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840c5cb0 0x7f27840c6130 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f2784062910 tx=0x7f27740090f0).stop 2023-08-31T19:26:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.173+0000 7f278b9ff700 1 -- 172.21.15.72:0/1009878564 shutdown_connections 2023-08-31T19:26:40.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.173+0000 7f278b9ff700 1 --2- 172.21.15.72:0/1009878564 >> v2:172.21.15.146:3300/0 conn(0x7f27840630b0 0x7f2784063530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:40.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.173+0000 7f278b9ff700 1 --2- 172.21.15.72:0/1009878564 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2784153e30 0x7f2784154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:40.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.173+0000 7f278b9ff700 1 --2- 172.21.15.72:0/1009878564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840c5cb0 0x7f27840c6130 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:40.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.173+0000 7f278b9ff700 1 -- 172.21.15.72:0/1009878564 >> 172.21.15.72:0/1009878564 conn(0x7f278405eb20 msgr2=0x7f27840cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:40.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.173+0000 7f278b9ff700 1 -- 172.21.15.72:0/1009878564 shutdown_connections 2023-08-31T19:26:40.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.173+0000 7f278b9ff700 1 -- 172.21.15.72:0/1009878564 wait complete. 2023-08-31T19:26:40.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.174+0000 7f278b9ff700 1 Processor -- start 2023-08-31T19:26:40.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.175+0000 7f278b9ff700 1 -- start start 2023-08-31T19:26:40.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.175+0000 7f278b9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840630b0 0x7f2784142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:40.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.175+0000 7f278b9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27840c5cb0 0x7f27840afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:40.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.175+0000 7f278b9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2784153e30 0x7f27840aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:40.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.175+0000 7f278b9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784165330 con 0x7f27840630b0 2023-08-31T19:26:40.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.175+0000 7f278b9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784164720 con 0x7f27840c5cb0 2023-08-31T19:26:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.175+0000 7f278b9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2784164a00 con 0x7f2784153e30 2023-08-31T19:26:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.176+0000 7f278979b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840630b0 0x7f2784142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:40.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.176+0000 7f278979b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840630b0 0x7f2784142780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38666/0 (socket says 172.21.15.72:38666) 2023-08-31T19:26:40.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.176+0000 7f278979b700 1 -- 172.21.15.72:0/467865483 learned_addr learned my addr 172.21.15.72:0/467865483 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:40.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.176+0000 7f2788f9a700 1 --2- 172.21.15.72:0/467865483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27840c5cb0 0x7f27840afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.176+0000 7f2789f9c700 1 --2- 172.21.15.72:0/467865483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2784153e30 0x7f27840aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.176+0000 7f278979b700 1 -- 172.21.15.72:0/467865483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2784153e30 msgr2=0x7f27840aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.176+0000 7f278979b700 1 --2- 172.21.15.72:0/467865483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2784153e30 0x7f27840aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.176+0000 7f278979b700 1 -- 172.21.15.72:0/467865483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27840c5cb0 msgr2=0x7f27840afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.176+0000 7f278979b700 1 --2- 172.21.15.72:0/467865483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27840c5cb0 0x7f27840afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.176+0000 7f278979b700 1 -- 172.21.15.72:0/467865483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2774009370 con 0x7f27840630b0 2023-08-31T19:26:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.176+0000 7f278979b700 1 --2- 172.21.15.72:0/467865483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840630b0 0x7f2784142780 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7f278000d890 tx=0x7f2780008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.177+0000 7f27797fa700 1 -- 172.21.15.72:0/467865483 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27800125f0 con 0x7f27840630b0 2023-08-31T19:26:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.177+0000 7f27797fa700 1 -- 172.21.15.72:0/467865483 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2780012750 con 0x7f27840630b0 2023-08-31T19:26:40.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.177+0000 7f27797fa700 1 -- 172.21.15.72:0/467865483 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780012ad0 con 0x7f27840630b0 2023-08-31T19:26:40.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.177+0000 7f278b9ff700 1 -- 172.21.15.72:0/467865483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2784164ce0 con 0x7f27840630b0 2023-08-31T19:26:40.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.177+0000 7f278b9ff700 1 -- 172.21.15.72:0/467865483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2784142c70 con 0x7f27840630b0 2023-08-31T19:26:40.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.178+0000 7f278b9ff700 1 -- 172.21.15.72:0/467865483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278406c6b0 con 0x7f27840630b0 2023-08-31T19:26:40.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.178+0000 7f27797fa700 1 -- 172.21.15.72:0/467865483 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 93) v1 ==== 75448+0+0 (secure 0 0 0) 0x7f2780013480 con 0x7f27840630b0 2023-08-31T19:26:40.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.179+0000 7f27797fa700 1 --2- 172.21.15.72:0/467865483 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f276805f010 0x7f27680614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:40.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.179+0000 7f27797fa700 1 -- 172.21.15.72:0/467865483 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f278007a1d0 con 0x7f27840630b0 2023-08-31T19:26:40.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.180+0000 7f2788f9a700 1 --2- 172.21.15.72:0/467865483 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f276805f010 0x7f27680614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:40.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.180+0000 7f2788f9a700 1 --2- 172.21.15.72:0/467865483 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f276805f010 0x7f27680614d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f2784062910 tx=0x7f2774017000).ready entity=mgr.7712 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:40.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.183+0000 7f27797fa700 1 -- 172.21.15.72:0/467865483 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f278004b050 con 0x7f27840630b0 2023-08-31T19:26:40.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.393+0000 7f278b9ff700 1 -- 172.21.15.72:0/467865483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f2784065470 con 0x7f27840630b0 2023-08-31T19:26:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.874+0000 7f27797fa700 1 -- 172.21.15.72:0/467865483 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 94) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f2780077a10 con 0x7f27840630b0 2023-08-31T19:26:40.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.874+0000 7f27797fa700 1 -- 172.21.15.72:0/467865483 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v94) v1 ==== 93+0+0 (secure 0 0 0) 0x7f27800723e0 con 0x7f27840630b0 2023-08-31T19:26:40.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.877+0000 7f278b9ff700 1 -- 172.21.15.72:0/467865483 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f276805f010 msgr2=0x7f27680614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:40.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.877+0000 7f278b9ff700 1 --2- 172.21.15.72:0/467865483 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f276805f010 0x7f27680614d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f2784062910 tx=0x7f2774017000).stop 2023-08-31T19:26:40.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.878+0000 7f278b9ff700 1 -- 172.21.15.72:0/467865483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840630b0 msgr2=0x7f2784142780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:40.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.878+0000 7f278b9ff700 1 --2- 172.21.15.72:0/467865483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840630b0 0x7f2784142780 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7f278000d890 tx=0x7f2780008040).stop 2023-08-31T19:26:40.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.878+0000 7f278b9ff700 1 -- 172.21.15.72:0/467865483 shutdown_connections 2023-08-31T19:26:40.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.878+0000 7f278b9ff700 1 --2- 172.21.15.72:0/467865483 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f276805f010 0x7f27680614d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:40.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.878+0000 7f278b9ff700 1 --2- 172.21.15.72:0/467865483 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2784153e30 0x7f27840aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:40.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.878+0000 7f278b9ff700 1 --2- 172.21.15.72:0/467865483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27840630b0 0x7f2784142780 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:40.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.878+0000 7f278b9ff700 1 --2- 172.21.15.72:0/467865483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27840c5cb0 0x7f27840afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:40.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.878+0000 7f278b9ff700 1 -- 172.21.15.72:0/467865483 >> 172.21.15.72:0/467865483 conn(0x7f278405eb20 msgr2=0x7f27840ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:40.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.878+0000 7f278b9ff700 1 -- 172.21.15.72:0/467865483 shutdown_connections 2023-08-31T19:26:40.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:40.878+0000 7f278b9ff700 1 -- 172.21.15.72:0/467865483 wait complete. 2023-08-31T19:26:40.897 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:26:40.897 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:26:41.016 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:26:41.090 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:41.089+0000 7f2f5cdf7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:26:41.092 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:41.093+0000 7ff15d058680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:26:41.117 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:26:41.118 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-31T19:26:41.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-31T19:26:41.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-31T19:26:41.172 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:41.172+0000 7f2f5cdf7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:26:41.173 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:41.174+0000 7ff15d058680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:26:41.206 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T19:26:41.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:41.207 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T19:26:41.254 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:26:41.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.450+0000 7f58f87ff700 1 Processor -- start 2023-08-31T19:26:41.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.450+0000 7f58f87ff700 1 -- start start 2023-08-31T19:26:41.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.451+0000 7f58f87ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f58f00bea80 0x7f58f00c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:41.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.451+0000 7f58f87ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f00c48f0 con 0x7f58f00c5fb0 2023-08-31T19:26:41.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.451+0000 7f58f87ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f00bef10 con 0x7f58f00c44a0 2023-08-31T19:26:41.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.451+0000 7f58f87ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f0154690 con 0x7f58f00bea80 2023-08-31T19:26:41.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.451+0000 7f58f659b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f58f00c5fb0 0x7f58f00be370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38770/0 (socket says 172.21.15.72:38770) 2023-08-31T19:26:41.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.451+0000 7f58f659b700 1 -- 172.21.15.72:0/2715658019 learned_addr learned my addr 172.21.15.72:0/2715658019 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:41.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.452+0000 7f58f5d9a700 1 --2- 172.21.15.72:0/2715658019 >> v2:172.21.15.146:3300/0 conn(0x7f58f00bea80 0x7f58f00c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:41.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.452+0000 7f58f5599700 1 -- 172.21.15.72:0/2715658019 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780757915 0 0) 0x7f58f00c48f0 con 0x7f58f00c5fb0 2023-08-31T19:26:41.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.452+0000 7f58f5599700 1 -- 172.21.15.72:0/2715658019 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58dc0033f0 con 0x7f58f00c5fb0 2023-08-31T19:26:41.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.452+0000 7f58f5d9a700 1 -- 172.21.15.72:0/2715658019 >> v1:172.21.15.146:6789/0 conn(0x7f58f00c44a0 legacy=0x7f58f0063a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:41.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.452+0000 7f58f5d9a700 1 -- 172.21.15.72:0/2715658019 >> v1:172.21.15.72:6789/0 conn(0x7f58f00c5fb0 legacy=0x7f58f00be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:41.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.452+0000 7f58f5d9a700 1 -- 172.21.15.72:0/2715658019 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f00bf1f0 con 0x7f58f00bea80 2023-08-31T19:26:41.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.452+0000 7f58f5d9a700 1 --2- 172.21.15.72:0/2715658019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f00bea80 0x7f58f00c3fb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f58e0009760 tx=0x7f58e0009060).ready entity=mon.1 client_cookie=1d814a5bb06cf283 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:41.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.452+0000 7f58f5599700 1 -- 172.21.15.72:0/2715658019 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e000f510 con 0x7f58f00bea80 2023-08-31T19:26:41.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.453+0000 7f58f5599700 1 -- 172.21.15.72:0/2715658019 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e000f670 con 0x7f58f00bea80 2023-08-31T19:26:41.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.453+0000 7f58f5599700 1 -- 172.21.15.72:0/2715658019 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e000f9f0 con 0x7f58f00bea80 2023-08-31T19:26:41.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.453+0000 7f58f87ff700 1 -- 172.21.15.72:0/2715658019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f00bea80 msgr2=0x7f58f00c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:41.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.453+0000 7f58f87ff700 1 --2- 172.21.15.72:0/2715658019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f00bea80 0x7f58f00c3fb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f58e0009760 tx=0x7f58e0009060).stop 2023-08-31T19:26:41.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.453+0000 7f58f87ff700 1 -- 172.21.15.72:0/2715658019 shutdown_connections 2023-08-31T19:26:41.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.453+0000 7f58f87ff700 1 --2- 172.21.15.72:0/2715658019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f00bea80 0x7f58f00c3fb0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:41.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.453+0000 7f58f87ff700 1 -- 172.21.15.72:0/2715658019 >> 172.21.15.72:0/2715658019 conn(0x7f58f0082f60 msgr2=0x7f58f005e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:41.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.453+0000 7f58f87ff700 1 -- 172.21.15.72:0/2715658019 shutdown_connections 2023-08-31T19:26:41.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.453+0000 7f58f87ff700 1 -- 172.21.15.72:0/2715658019 wait complete. 2023-08-31T19:26:41.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.455+0000 7f58f87ff700 1 Processor -- start 2023-08-31T19:26:41.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.455+0000 7f58f87ff700 1 -- start start 2023-08-31T19:26:41.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.457+0000 7f58f87ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58f00c44a0 0x7f58f00c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:41.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.457+0000 7f58f87ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f00c5fb0 0x7f58f00ac770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:41.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.457+0000 7f58f87ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f00c2570 0x7f58f0067740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:41.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.457+0000 7f58f87ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f00ad530 con 0x7f58f00c2570 2023-08-31T19:26:41.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.457+0000 7f58f87ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f0151b90 con 0x7f58f00c5fb0 2023-08-31T19:26:41.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.457+0000 7f58f87ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f00acf70 con 0x7f58f00c44a0 2023-08-31T19:26:41.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.457+0000 7f58f6d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f00c2570 0x7f58f0067740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:41.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.457+0000 7f58f5d9a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f00c5fb0 0x7f58f00ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:41.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.457+0000 7f58f659b700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58f00c44a0 0x7f58f00c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:41.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.457+0000 7f58f5d9a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f00c5fb0 0x7f58f00ac770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:43766/0 (socket says 172.21.15.72:43766) 2023-08-31T19:26:41.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.457+0000 7f58f6d9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f00c2570 0x7f58f0067740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38702/0 (socket says 172.21.15.72:38702) 2023-08-31T19:26:41.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.457+0000 7f58f5d9a700 1 -- 172.21.15.72:0/276560276 learned_addr learned my addr 172.21.15.72:0/276560276 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:41.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.457+0000 7f58f5d9a700 1 -- 172.21.15.72:0/276560276 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58f00c44a0 msgr2=0x7f58f00c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:41.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.458+0000 7f58f5d9a700 1 --2- 172.21.15.72:0/276560276 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58f00c44a0 0x7f58f00c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:41.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.458+0000 7f58f5d9a700 1 -- 172.21.15.72:0/276560276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f00c2570 msgr2=0x7f58f0067740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:41.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.458+0000 7f58f5d9a700 1 --2- 172.21.15.72:0/276560276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f00c2570 0x7f58f0067740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:41.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.458+0000 7f58f5d9a700 1 -- 172.21.15.72:0/276560276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e00092a0 con 0x7f58f00c5fb0 2023-08-31T19:26:41.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.458+0000 7f58f6d9c700 1 --2- 172.21.15.72:0/276560276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f00c2570 0x7f58f0067740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:41.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.458+0000 7f58f5d9a700 1 --2- 172.21.15.72:0/276560276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f00c5fb0 0x7f58f00ac770 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f58e0009e00 tx=0x7f58e0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:41.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.458+0000 7f58e67fc700 1 -- 172.21.15.72:0/276560276 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e000f7e0 con 0x7f58f00c5fb0 2023-08-31T19:26:41.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.458+0000 7f58e67fc700 1 -- 172.21.15.72:0/276560276 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e000f940 con 0x7f58f00c5fb0 2023-08-31T19:26:41.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.458+0000 7f58e67fc700 1 -- 172.21.15.72:0/276560276 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e001b660 con 0x7f58f00c5fb0 2023-08-31T19:26:41.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.458+0000 7f58f87ff700 1 -- 172.21.15.72:0/276560276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f00ad250 con 0x7f58f00c5fb0 2023-08-31T19:26:41.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.458+0000 7f58f87ff700 1 -- 172.21.15.72:0/276560276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f00acc60 con 0x7f58f00c5fb0 2023-08-31T19:26:41.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.459+0000 7f58f87ff700 1 -- 172.21.15.72:0/276560276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f0151d00 con 0x7f58f00c5fb0 2023-08-31T19:26:41.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.460+0000 7f58e67fc700 1 -- 172.21.15.72:0/276560276 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 94) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f58e001ba10 con 0x7f58f00c5fb0 2023-08-31T19:26:41.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.461+0000 7f58e67fc700 1 --2- 172.21.15.72:0/276560276 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f58d405efc0 0x7f58d4061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:41.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.461+0000 7f58e67fc700 1 -- 172.21.15.72:0/276560276 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f58e007bbd0 con 0x7f58f00c5fb0 2023-08-31T19:26:41.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.461+0000 7f58f659b700 1 -- 172.21.15.72:0/276560276 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f58d405efc0 msgr2=0x7f58d4061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:41.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.461+0000 7f58f659b700 1 --2- 172.21.15.72:0/276560276 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f58d405efc0 0x7f58d4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:41.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.465+0000 7f58e67fc700 1 -- 172.21.15.72:0/276560276 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f58e004cab0 con 0x7f58f00c5fb0 2023-08-31T19:26:41.508 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:41.508+0000 7f2f5cdf7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:26:41.523 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:41.524+0000 7ff15d058680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:26:41.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.662+0000 7f58f659b700 1 -- 172.21.15.72:0/276560276 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f58d405efc0 msgr2=0x7f58d4061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:41.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.662+0000 7f58f659b700 1 --2- 172.21.15.72:0/276560276 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f58d405efc0 0x7f58d4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:26:41.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.685+0000 7f58f87ff700 1 -- 172.21.15.72:0/276560276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58f006c6b0 con 0x7f58f00c5fb0 2023-08-31T19:26:41.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.685+0000 7f58e67fc700 1 -- 172.21.15.72:0/276560276 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f58e0029070 con 0x7f58f00c5fb0 2023-08-31T19:26:41.685 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:41.685 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2772120291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2772120291},{"type":"v1","addr":"172.21.15.146:6834","nonce":2772120291}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4204264962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4204264962},{"type":"v1","addr":"172.21.15.72:6836","nonce":4204264962}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9501,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2736058565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2736058565},{"type":"v1","addr":"172.21.15.72:6837","nonce":2736058565}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:26:23.268664+0000","modified":"2023-08-31T19:26:26.278490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9507":{"gid":9507,"name":"b","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3040541253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3040541253},{"type":"v1","addr":"172.21.15.146:6835","nonce":3040541253}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-31T19:26:41.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.687+0000 7f58f87ff700 1 -- 172.21.15.72:0/276560276 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f58d405efc0 msgr2=0x7f58d4061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:41.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.687+0000 7f58f87ff700 1 --2- 172.21.15.72:0/276560276 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f58d405efc0 0x7f58d4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:41.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.688+0000 7f58f87ff700 1 -- 172.21.15.72:0/276560276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f00c5fb0 msgr2=0x7f58f00ac770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:41.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.688+0000 7f58f87ff700 1 --2- 172.21.15.72:0/276560276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f00c5fb0 0x7f58f00ac770 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f58e0009e00 tx=0x7f58e0017000).stop 2023-08-31T19:26:41.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.688+0000 7f58f87ff700 1 -- 172.21.15.72:0/276560276 shutdown_connections 2023-08-31T19:26:41.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.688+0000 7f58f87ff700 1 --2- 172.21.15.72:0/276560276 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f58d405efc0 0x7f58d4061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:41.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.688+0000 7f58f87ff700 1 --2- 172.21.15.72:0/276560276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58f00c2570 0x7f58f0067740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:41.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.688+0000 7f58f87ff700 1 --2- 172.21.15.72:0/276560276 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f58f00c44a0 0x7f58f00c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:41.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.688+0000 7f58f87ff700 1 --2- 172.21.15.72:0/276560276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58f00c5fb0 0x7f58f00ac770 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:41.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.688+0000 7f58f87ff700 1 -- 172.21.15.72:0/276560276 >> 172.21.15.72:0/276560276 conn(0x7f58f0082f60 msgr2=0x7f58f0066960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:41.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.688+0000 7f58f87ff700 1 -- 172.21.15.72:0/276560276 shutdown_connections 2023-08-31T19:26:41.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.688+0000 7f58f87ff700 1 -- 172.21.15.72:0/276560276 wait complete. 2023-08-31T19:26:41.691 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 86 2023-08-31T19:26:41.705 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:26:41.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.899+0000 7f2e845ff700 1 Processor -- start 2023-08-31T19:26:41.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.899+0000 7f2e845ff700 1 -- start start 2023-08-31T19:26:41.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.900+0000 7f2e845ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e7c153d20 0x7f2e7c0c0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:41.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e845ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2e7c154100 0x7f2e7c0a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:41.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e845ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e7c154580 0x7f2e7c0c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:41.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e845ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c0c0b80 con 0x7f2e7c154580 2023-08-31T19:26:41.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e845ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c154a00 con 0x7f2e7c154100 2023-08-31T19:26:41.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e845ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c154ce0 con 0x7f2e7c153d20 2023-08-31T19:26:41.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e82b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e7c154580 0x7f2e7c0c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:41.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e82b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e7c154580 0x7f2e7c0c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38714/0 (socket says 172.21.15.72:38714) 2023-08-31T19:26:41.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e82b9c700 1 -- 172.21.15.72:0/269336817 learned_addr learned my addr 172.21.15.72:0/269336817 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:41.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e8239b700 1 --2- 172.21.15.72:0/269336817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e7c153d20 0x7f2e7c0c0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:41.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e81b9a700 1 --2- 172.21.15.72:0/269336817 >> v2:172.21.15.146:3300/0 conn(0x7f2e7c154100 0x7f2e7c0a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:41.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e82b9c700 1 -- 172.21.15.72:0/269336817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e7c153d20 msgr2=0x7f2e7c0c0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:41.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e82b9c700 1 --2- 172.21.15.72:0/269336817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e7c153d20 0x7f2e7c0c0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:41.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e82b9c700 1 -- 172.21.15.72:0/269336817 >> v2:172.21.15.146:3300/0 conn(0x7f2e7c154100 msgr2=0x7f2e7c0a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:41.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e82b9c700 1 --2- 172.21.15.72:0/269336817 >> v2:172.21.15.146:3300/0 conn(0x7f2e7c154100 0x7f2e7c0a9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:41.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e82b9c700 1 -- 172.21.15.72:0/269336817 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c154fc0 con 0x7f2e7c154580 2023-08-31T19:26:41.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.901+0000 7f2e82b9c700 1 --2- 172.21.15.72:0/269336817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7c154580 0x7f2e7c0c5de0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7f2e7c0c8910 tx=0x7f2e74009840).ready entity=mon.0 client_cookie=d81354b7d9f41351 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:41.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.902+0000 7f2e81399700 1 -- 172.21.15.72:0/269336817 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400e070 con 0x7f2e7c154580 2023-08-31T19:26:41.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.902+0000 7f2e81399700 1 -- 172.21.15.72:0/269336817 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7400b970 con 0x7f2e7c154580 2023-08-31T19:26:41.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.902+0000 7f2e81399700 1 -- 172.21.15.72:0/269336817 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400bcf0 con 0x7f2e7c154580 2023-08-31T19:26:41.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.902+0000 7f2e845ff700 1 -- 172.21.15.72:0/269336817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7c154580 msgr2=0x7f2e7c0c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:41.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.902+0000 7f2e845ff700 1 --2- 172.21.15.72:0/269336817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7c154580 0x7f2e7c0c5de0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7f2e7c0c8910 tx=0x7f2e74009840).stop 2023-08-31T19:26:41.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.902+0000 7f2e845ff700 1 -- 172.21.15.72:0/269336817 shutdown_connections 2023-08-31T19:26:41.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.902+0000 7f2e845ff700 1 --2- 172.21.15.72:0/269336817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7c154580 0x7f2e7c0c5de0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:41.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.902+0000 7f2e845ff700 1 --2- 172.21.15.72:0/269336817 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e7c153d20 0x7f2e7c0c0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:41.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.902+0000 7f2e845ff700 1 --2- 172.21.15.72:0/269336817 >> v2:172.21.15.146:3300/0 conn(0x7f2e7c154100 0x7f2e7c0a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:41.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.902+0000 7f2e845ff700 1 -- 172.21.15.72:0/269336817 >> 172.21.15.72:0/269336817 conn(0x7f2e7c05e090 msgr2=0x7f2e7c05e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:41.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.903+0000 7f2e845ff700 1 -- 172.21.15.72:0/269336817 shutdown_connections 2023-08-31T19:26:41.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.903+0000 7f2e845ff700 1 -- 172.21.15.72:0/269336817 wait complete. 2023-08-31T19:26:41.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.904+0000 7f2e845ff700 1 Processor -- start 2023-08-31T19:26:41.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.904+0000 7f2e845ff700 1 -- start start 2023-08-31T19:26:41.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.905+0000 7f2e845ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e7c153d20 0x7f2e7c148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:41.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.905+0000 7f2e845ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7c154100 0x7f2e7c1676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:41.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.905+0000 7f2e845ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e7c154580 0x7f2e7c0af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:41.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.905+0000 7f2e845ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c0add10 con 0x7f2e7c154100 2023-08-31T19:26:41.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.905+0000 7f2e845ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c167bc0 con 0x7f2e7c154580 2023-08-31T19:26:41.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.905+0000 7f2e845ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c167e40 con 0x7f2e7c153d20 2023-08-31T19:26:41.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.905+0000 7f2e81b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7c154100 0x7f2e7c1676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:41.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.905+0000 7f2e81b9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7c154100 0x7f2e7c1676d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38728/0 (socket says 172.21.15.72:38728) 2023-08-31T19:26:41.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.905+0000 7f2e81b9a700 1 -- 172.21.15.72:0/3506120068 learned_addr learned my addr 172.21.15.72:0/3506120068 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:41.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.905+0000 7f2e82b9c700 1 --2- 172.21.15.72:0/3506120068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e7c154580 0x7f2e7c0af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:41.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.905+0000 7f2e8239b700 1 --2- 172.21.15.72:0/3506120068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e7c153d20 0x7f2e7c148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:41.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.906+0000 7f2e81b9a700 1 -- 172.21.15.72:0/3506120068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e7c153d20 msgr2=0x7f2e7c148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:41.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.906+0000 7f2e81b9a700 1 --2- 172.21.15.72:0/3506120068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e7c153d20 0x7f2e7c148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:41.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.906+0000 7f2e81b9a700 1 -- 172.21.15.72:0/3506120068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e7c154580 msgr2=0x7f2e7c0af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:41.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.906+0000 7f2e81b9a700 1 --2- 172.21.15.72:0/3506120068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e7c154580 0x7f2e7c0af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:41.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.906+0000 7f2e81b9a700 1 -- 172.21.15.72:0/3506120068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e74009ae0 con 0x7f2e7c154100 2023-08-31T19:26:41.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.906+0000 7f2e81b9a700 1 --2- 172.21.15.72:0/3506120068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7c154100 0x7f2e7c1676d0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7f2e6c00e930 tx=0x7f2e6c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:41.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.906+0000 7f2e727fc700 1 -- 172.21.15.72:0/3506120068 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c00c680 con 0x7f2e7c154100 2023-08-31T19:26:41.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.906+0000 7f2e727fc700 1 -- 172.21.15.72:0/3506120068 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c00c7e0 con 0x7f2e7c154100 2023-08-31T19:26:41.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.906+0000 7f2e845ff700 1 -- 172.21.15.72:0/3506120068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7c168120 con 0x7f2e7c154100 2023-08-31T19:26:41.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.906+0000 7f2e727fc700 1 -- 172.21.15.72:0/3506120068 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c00cb60 con 0x7f2e7c154100 2023-08-31T19:26:41.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.906+0000 7f2e845ff700 1 -- 172.21.15.72:0/3506120068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7c0adfe0 con 0x7f2e7c154100 2023-08-31T19:26:41.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.908+0000 7f2e845ff700 1 -- 172.21.15.72:0/3506120068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7c0ae170 con 0x7f2e7c154100 2023-08-31T19:26:41.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.908+0000 7f2e727fc700 1 -- 172.21.15.72:0/3506120068 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 94) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f2e6c01b400 con 0x7f2e7c154100 2023-08-31T19:26:41.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.909+0000 7f2e727fc700 1 --2- 172.21.15.72:0/3506120068 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f2e6005efc0 0x7f2e60061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:41.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.909+0000 7f2e727fc700 1 -- 172.21.15.72:0/3506120068 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f2e6c07a9e0 con 0x7f2e7c154100 2023-08-31T19:26:41.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.909+0000 7f2e8239b700 1 -- 172.21.15.72:0/3506120068 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f2e6005efc0 msgr2=0x7f2e60061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:41.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.909+0000 7f2e8239b700 1 --2- 172.21.15.72:0/3506120068 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f2e6005efc0 0x7f2e60061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:41.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:41.917+0000 7f2e727fc700 1 -- 172.21.15.72:0/3506120068 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2e6c04b760 con 0x7f2e7c154100 2023-08-31T19:26:42.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.102+0000 7f2e845ff700 1 -- 172.21.15.72:0/3506120068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e7c06c6b0 con 0x7f2e7c154100 2023-08-31T19:26:42.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.103+0000 7f2e727fc700 1 -- 172.21.15.72:0/3506120068 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+18405 (secure 0 0 0) 0x7f2e6c04ed80 con 0x7f2e7c154100 2023-08-31T19:26:42.103 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:42.103 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":196,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:26:37.533844+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:26:21.693921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-31T19:26:22.249227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/3780867317":"2023-09-01T19:26:37.533809+0000","172.21.15.72:6833/189426":"2023-09-01T19:26:37.533809+0000","172.21.15.72:6832/189426":"2023-09-01T19:26:37.533809+0000","172.21.15.72:0/1369089719":"2023-09-01T19:26:37.533809+0000","172.21.15.72:0/3101987496":"2023-09-01T19:26:37.533809+0000","172.21.15.72:0/2121781009":"2023-09-01T19:26:37.533809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:26:42.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.106+0000 7f2e845ff700 1 -- 172.21.15.72:0/3506120068 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f2e6005efc0 msgr2=0x7f2e60061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:42.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.106+0000 7f2e845ff700 1 --2- 172.21.15.72:0/3506120068 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f2e6005efc0 0x7f2e60061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.106+0000 7f2e845ff700 1 -- 172.21.15.72:0/3506120068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7c154100 msgr2=0x7f2e7c1676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.106+0000 7f2e845ff700 1 --2- 172.21.15.72:0/3506120068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7c154100 0x7f2e7c1676d0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7f2e6c00e930 tx=0x7f2e6c009060).stop 2023-08-31T19:26:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.106+0000 7f2e845ff700 1 -- 172.21.15.72:0/3506120068 shutdown_connections 2023-08-31T19:26:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.106+0000 7f2e845ff700 1 --2- 172.21.15.72:0/3506120068 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f2e6005efc0 0x7f2e60061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:42.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.106+0000 7f2e845ff700 1 --2- 172.21.15.72:0/3506120068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e7c154580 0x7f2e7c0af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.106+0000 7f2e845ff700 1 --2- 172.21.15.72:0/3506120068 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f2e7c153d20 0x7f2e7c148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.106+0000 7f2e845ff700 1 --2- 172.21.15.72:0/3506120068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e7c154100 0x7f2e7c1676d0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.106+0000 7f2e845ff700 1 -- 172.21.15.72:0/3506120068 >> 172.21.15.72:0/3506120068 conn(0x7f2e7c05e090 msgr2=0x7f2e7c0c9820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:42.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.106+0000 7f2e845ff700 1 -- 172.21.15.72:0/3506120068 shutdown_connections 2023-08-31T19:26:42.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.106+0000 7f2e845ff700 1 -- 172.21.15.72:0/3506120068 wait complete. 2023-08-31T19:26:42.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-31T18:47:44.329868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '184', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-31T18:47:45.969774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:26:21.693921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '194', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:26:22.249227+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:26:42.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-31T19:26:42.259 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:42.259+0000 7f2f5cdf7680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:26:42.330 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:42.330+0000 7ff15d058680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:26:42.344 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:42.344+0000 7f2f5cdf7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:26:42.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.348+0000 7f46757ff700 1 Processor -- start 2023-08-31T19:26:42.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.348+0000 7f46757ff700 1 -- start start 2023-08-31T19:26:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.349+0000 7f46757ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4670153e30 0x7f4670154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.349+0000 7f46757ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46700c5cb0 0x7f46700c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.349+0000 7f46757ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46700bfd40 con 0x7f46700630b0 2023-08-31T19:26:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.349+0000 7f46757ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46700c6730 con 0x7f4670153e30 2023-08-31T19:26:42.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.349+0000 7f46757ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46700bffe0 con 0x7f46700c5cb0 2023-08-31T19:26:42.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.349+0000 7f466effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4670153e30 0x7f4670154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:42.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.349+0000 7f466f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f46700630b0 0x7f4670157d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38774/0 (socket says 172.21.15.72:38774) 2023-08-31T19:26:42.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.350+0000 7f466f7fe700 1 -- 172.21.15.72:0/2212270919 learned_addr learned my addr 172.21.15.72:0/2212270919 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:42.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.350+0000 7f466e7fc700 1 --2- 172.21.15.72:0/2212270919 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46700c5cb0 0x7f46700c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:42.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.350+0000 7f466effd700 1 -- 172.21.15.72:0/2212270919 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46700c5cb0 msgr2=0x7f46700c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:42.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.350+0000 7f466effd700 1 --2- 172.21.15.72:0/2212270919 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46700c5cb0 0x7f46700c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.350+0000 7f466effd700 1 -- 172.21.15.72:0/2212270919 >> v1:172.21.15.72:6789/0 conn(0x7f46700630b0 legacy=0x7f4670157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:42.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.350+0000 7f466effd700 1 -- 172.21.15.72:0/2212270919 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46700c02c0 con 0x7f4670153e30 2023-08-31T19:26:42.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.350+0000 7f466dffb700 1 -- 172.21.15.72:0/2212270919 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264487999 0 0) 0x7f46700bfd40 con 0x7f46700630b0 2023-08-31T19:26:42.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.350+0000 7f466effd700 1 --2- 172.21.15.72:0/2212270919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4670153e30 0x7f4670154210 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7f4660009760 tx=0x7f4660009060).ready entity=mon.0 client_cookie=160757faa024f628 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:42.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.350+0000 7f466dffb700 1 -- 172.21.15.72:0/2212270919 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46600090d0 con 0x7f4670153e30 2023-08-31T19:26:42.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.350+0000 7f466dffb700 1 -- 172.21.15.72:0/2212270919 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466000f510 con 0x7f4670153e30 2023-08-31T19:26:42.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.351+0000 7f466dffb700 1 -- 172.21.15.72:0/2212270919 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000f890 con 0x7f4670153e30 2023-08-31T19:26:42.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.351+0000 7f46757ff700 1 -- 172.21.15.72:0/2212270919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4670153e30 msgr2=0x7f4670154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:42.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.351+0000 7f46757ff700 1 --2- 172.21.15.72:0/2212270919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4670153e30 0x7f4670154210 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7f4660009760 tx=0x7f4660009060).stop 2023-08-31T19:26:42.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.351+0000 7f46757ff700 1 -- 172.21.15.72:0/2212270919 shutdown_connections 2023-08-31T19:26:42.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.351+0000 7f46757ff700 1 --2- 172.21.15.72:0/2212270919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4670153e30 0x7f4670154210 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.351+0000 7f46757ff700 1 --2- 172.21.15.72:0/2212270919 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f46700c5cb0 0x7f46700c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.351+0000 7f46757ff700 1 -- 172.21.15.72:0/2212270919 >> 172.21.15.72:0/2212270919 conn(0x7f467005eb20 msgr2=0x7f46700cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.351+0000 7f46757ff700 1 -- 172.21.15.72:0/2212270919 shutdown_connections 2023-08-31T19:26:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.351+0000 7f46757ff700 1 -- 172.21.15.72:0/2212270919 wait complete. 2023-08-31T19:26:42.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.353+0000 7f46757ff700 1 Processor -- start 2023-08-31T19:26:42.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.354+0000 7f46757ff700 1 -- start start 2023-08-31T19:26:42.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.355+0000 7f46757ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46700630b0 0x7f4670167240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:42.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.355+0000 7f46757ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46700c5cb0 0x7f4670164390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:42.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.355+0000 7f46757ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4670153e30 0x7f4670152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:42.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.355+0000 7f46757ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46700c3a60 con 0x7f46700630b0 2023-08-31T19:26:42.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.355+0000 7f46757ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4670167730 con 0x7f46700c5cb0 2023-08-31T19:26:42.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.355+0000 7f46757ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46700c2e50 con 0x7f4670153e30 2023-08-31T19:26:42.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.355+0000 7f466effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46700630b0 0x7f4670167240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:42.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.355+0000 7f466effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46700630b0 0x7f4670167240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38754/0 (socket says 172.21.15.72:38754) 2023-08-31T19:26:42.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.355+0000 7f466effd700 1 -- 172.21.15.72:0/573123203 learned_addr learned my addr 172.21.15.72:0/573123203 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:42.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.355+0000 7f466e7fc700 1 --2- 172.21.15.72:0/573123203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46700c5cb0 0x7f4670164390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:42.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.355+0000 7f466f7fe700 1 --2- 172.21.15.72:0/573123203 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4670153e30 0x7f4670152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:42.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.355+0000 7f466effd700 1 -- 172.21.15.72:0/573123203 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4670153e30 msgr2=0x7f4670152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:42.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.356+0000 7f466effd700 1 --2- 172.21.15.72:0/573123203 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4670153e30 0x7f4670152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.356+0000 7f466effd700 1 -- 172.21.15.72:0/573123203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46700c5cb0 msgr2=0x7f4670164390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:42.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.356+0000 7f466effd700 1 --2- 172.21.15.72:0/573123203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46700c5cb0 0x7f4670164390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.356+0000 7f466effd700 1 -- 172.21.15.72:0/573123203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46600092a0 con 0x7f46700630b0 2023-08-31T19:26:42.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.356+0000 7f466effd700 1 --2- 172.21.15.72:0/573123203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46700630b0 0x7f4670167240 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f4660009e00 tx=0x7f4660017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:42.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.356+0000 7f4656ffd700 1 -- 172.21.15.72:0/573123203 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000f890 con 0x7f46700630b0 2023-08-31T19:26:42.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.356+0000 7f46757ff700 1 -- 172.21.15.72:0/573123203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46700c3130 con 0x7f46700630b0 2023-08-31T19:26:42.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.356+0000 7f4656ffd700 1 -- 172.21.15.72:0/573123203 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4660009e30 con 0x7f46700630b0 2023-08-31T19:26:42.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.356+0000 7f4656ffd700 1 -- 172.21.15.72:0/573123203 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000fea0 con 0x7f46700630b0 2023-08-31T19:26:42.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.356+0000 7f46757ff700 1 -- 172.21.15.72:0/573123203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46700c36f0 con 0x7f46700630b0 2023-08-31T19:26:42.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.357+0000 7f46757ff700 1 -- 172.21.15.72:0/573123203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467006c6b0 con 0x7f46700630b0 2023-08-31T19:26:42.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.358+0000 7f4656ffd700 1 -- 172.21.15.72:0/573123203 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 94) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f466001c630 con 0x7f46700630b0 2023-08-31T19:26:42.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.359+0000 7f4656ffd700 1 --2- 172.21.15.72:0/573123203 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f465c05efc0 0x7f465c061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:42.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.359+0000 7f4656ffd700 1 -- 172.21.15.72:0/573123203 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f466007c0b0 con 0x7f46700630b0 2023-08-31T19:26:42.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.359+0000 7f466e7fc700 1 -- 172.21.15.72:0/573123203 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f465c05efc0 msgr2=0x7f465c061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:42.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.359+0000 7f466e7fc700 1 --2- 172.21.15.72:0/573123203 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f465c05efc0 0x7f465c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:42.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.367+0000 7f4656ffd700 1 -- 172.21.15.72:0/573123203 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f466004ce90 con 0x7f46700630b0 2023-08-31T19:26:42.421 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:42.421+0000 7ff15d058680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:26:42.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.542+0000 7f46757ff700 1 -- 172.21.15.72:0/573123203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4670062970 con 0x7f46700630b0 2023-08-31T19:26:42.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.542+0000 7f4656ffd700 1 -- 172.21.15.72:0/573123203 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v196) v1 ==== 110+0+10 (secure 0 0 0) 0x7f466002a020 con 0x7f46700630b0 2023-08-31T19:26:42.543 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-08-31T19:26:42.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.544+0000 7f46757ff700 1 -- 172.21.15.72:0/573123203 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f465c05efc0 msgr2=0x7f465c061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:42.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.544+0000 7f46757ff700 1 --2- 172.21.15.72:0/573123203 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f465c05efc0 0x7f465c061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:42.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.544+0000 7f46757ff700 1 -- 172.21.15.72:0/573123203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46700630b0 msgr2=0x7f4670167240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:42.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.544+0000 7f46757ff700 1 --2- 172.21.15.72:0/573123203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46700630b0 0x7f4670167240 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f4660009e00 tx=0x7f4660017000).stop 2023-08-31T19:26:42.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.545+0000 7f46757ff700 1 -- 172.21.15.72:0/573123203 shutdown_connections 2023-08-31T19:26:42.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.545+0000 7f46757ff700 1 --2- 172.21.15.72:0/573123203 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f465c05efc0 0x7f465c061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:42.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.545+0000 7f46757ff700 1 --2- 172.21.15.72:0/573123203 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4670153e30 0x7f4670152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.545+0000 7f46757ff700 1 --2- 172.21.15.72:0/573123203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46700630b0 0x7f4670167240 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.545+0000 7f46757ff700 1 --2- 172.21.15.72:0/573123203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46700c5cb0 0x7f4670164390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.545+0000 7f46757ff700 1 -- 172.21.15.72:0/573123203 >> 172.21.15.72:0/573123203 conn(0x7f467005eb20 msgr2=0x7f46700aaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:42.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.545+0000 7f46757ff700 1 -- 172.21.15.72:0/573123203 shutdown_connections 2023-08-31T19:26:42.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.545+0000 7f46757ff700 1 -- 172.21.15.72:0/573123203 wait complete. 2023-08-31T19:26:42.563 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-31T19:26:42.575 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:42.575+0000 7f2f5cdf7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:26:42.664 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:42.664+0000 7ff15d058680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:26:42.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.758+0000 7f93b8dff700 1 Processor -- start 2023-08-31T19:26:42.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.758+0000 7f93b8dff700 1 -- start start 2023-08-31T19:26:42.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.759+0000 7f93b8dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b414ca00 0x7f93b4065450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:42.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.759+0000 7f93b8dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f93b4062d60 0x7f93b40aa400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:42.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.759+0000 7f93b8dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b4153900 con 0x7f93b40a9f80 2023-08-31T19:26:42.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.759+0000 7f93b8dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b406a910 con 0x7f93b4062d60 2023-08-31T19:26:42.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.759+0000 7f93b8dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4152cf0 con 0x7f93b414ca00 2023-08-31T19:26:42.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.760+0000 7f93b259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b414ca00 0x7f93b4065450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:42.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.760+0000 7f93b2d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f93b4062d60 0x7f93b40aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:42.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.760+0000 7f93b259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b414ca00 0x7f93b4065450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3301/0 says I am v2:172.21.15.72:33962/0 (socket says 172.21.15.72:33962) 2023-08-31T19:26:42.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.760+0000 7f93b259c700 1 -- 172.21.15.72:0/3824913941 learned_addr learned my addr 172.21.15.72:0/3824913941 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:42.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.760+0000 7f93b1d9b700 1 --1- 172.21.15.72:0/3824913941 >> v1:172.21.15.146:6789/0 conn(0x7f93b40a9f80 0x7f93b4062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:44610/0 (socket says 172.21.15.72:44610) 2023-08-31T19:26:42.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.760+0000 7f93b259c700 1 -- 172.21.15.72:0/3824913941 >> v2:172.21.15.146:3300/0 conn(0x7f93b4062d60 msgr2=0x7f93b40aa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:42.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.760+0000 7f93b259c700 1 --2- 172.21.15.72:0/3824913941 >> v2:172.21.15.146:3300/0 conn(0x7f93b4062d60 0x7f93b40aa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.760+0000 7f93b259c700 1 -- 172.21.15.72:0/3824913941 >> v1:172.21.15.146:6789/0 conn(0x7f93b40a9f80 legacy=0x7f93b4062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:42.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.760+0000 7f93b259c700 1 -- 172.21.15.72:0/3824913941 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b4152fd0 con 0x7f93b414ca00 2023-08-31T19:26:42.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.760+0000 7f93b259c700 1 --2- 172.21.15.72:0/3824913941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b414ca00 0x7f93b4065450 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f93a4006fd0 tx=0x7f93a40090f0).ready entity=mon.2 client_cookie=7bfc30fde3f9a94 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:42.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.760+0000 7f93b159a700 1 -- 172.21.15.72:0/3824913941 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400b580 con 0x7f93b414ca00 2023-08-31T19:26:42.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.761+0000 7f93b159a700 1 -- 172.21.15.72:0/3824913941 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a400b6e0 con 0x7f93b414ca00 2023-08-31T19:26:42.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.761+0000 7f93b159a700 1 -- 172.21.15.72:0/3824913941 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400ba80 con 0x7f93b414ca00 2023-08-31T19:26:42.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.761+0000 7f93b8dff700 1 -- 172.21.15.72:0/3824913941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b414ca00 msgr2=0x7f93b4065450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.761+0000 7f93b8dff700 1 --2- 172.21.15.72:0/3824913941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b414ca00 0x7f93b4065450 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f93a4006fd0 tx=0x7f93a40090f0).stop 2023-08-31T19:26:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.761+0000 7f93b8dff700 1 -- 172.21.15.72:0/3824913941 shutdown_connections 2023-08-31T19:26:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.761+0000 7f93b8dff700 1 --2- 172.21.15.72:0/3824913941 >> v2:172.21.15.146:3300/0 conn(0x7f93b4062d60 0x7f93b40aa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.761+0000 7f93b8dff700 1 --2- 172.21.15.72:0/3824913941 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b414ca00 0x7f93b4065450 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.761+0000 7f93b8dff700 1 -- 172.21.15.72:0/3824913941 >> 172.21.15.72:0/3824913941 conn(0x7f93b40c7c20 msgr2=0x7f93b40c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:42.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.761+0000 7f93b8dff700 1 -- 172.21.15.72:0/3824913941 shutdown_connections 2023-08-31T19:26:42.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.761+0000 7f93b8dff700 1 -- 172.21.15.72:0/3824913941 wait complete. 2023-08-31T19:26:42.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.763+0000 7f93b8dff700 1 Processor -- start 2023-08-31T19:26:42.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.763+0000 7f93b8dff700 1 -- start start 2023-08-31T19:26:42.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.764+0000 7f93b8dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b4062d60 0x7f93b4155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:42.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.764+0000 7f93b8dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93b40a9f80 0x7f93b40c1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:42.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.764+0000 7f93b8dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b414ca00 0x7f93b414acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:42.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.764+0000 7f93b8dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b40c1ea0 con 0x7f93b414ca00 2023-08-31T19:26:42.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.764+0000 7f93b8dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4155270 con 0x7f93b40a9f80 2023-08-31T19:26:42.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.764+0000 7f93b8dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b414b1b0 con 0x7f93b4062d60 2023-08-31T19:26:42.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.764+0000 7f93b2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b414ca00 0x7f93b414acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:42.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.764+0000 7f93b2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b414ca00 0x7f93b414acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38758/0 (socket says 172.21.15.72:38758) 2023-08-31T19:26:42.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.764+0000 7f93b2d9d700 1 -- 172.21.15.72:0/4201534912 learned_addr learned my addr 172.21.15.72:0/4201534912 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:42.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.764+0000 7f93b259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b4062d60 0x7f93b4155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:42.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.764+0000 7f93b1d9b700 1 --2- 172.21.15.72:0/4201534912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93b40a9f80 0x7f93b40c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:42.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.765+0000 7f93b2d9d700 1 -- 172.21.15.72:0/4201534912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b4062d60 msgr2=0x7f93b4155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:42.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.765+0000 7f93b2d9d700 1 --2- 172.21.15.72:0/4201534912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b4062d60 0x7f93b4155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.765+0000 7f93b2d9d700 1 -- 172.21.15.72:0/4201534912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93b40a9f80 msgr2=0x7f93b40c1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:42.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.765+0000 7f93b2d9d700 1 --2- 172.21.15.72:0/4201534912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93b40a9f80 0x7f93b40c1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.765+0000 7f93b2d9d700 1 -- 172.21.15.72:0/4201534912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a4009370 con 0x7f93b414ca00 2023-08-31T19:26:42.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.765+0000 7f93b259c700 1 --2- 172.21.15.72:0/4201534912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b4062d60 0x7f93b4155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:42.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.765+0000 7f93b2d9d700 1 --2- 172.21.15.72:0/4201534912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b414ca00 0x7f93b414acc0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f93ac009df0 tx=0x7f93ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:42.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.765+0000 7f93a27fc700 1 -- 172.21.15.72:0/4201534912 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac00ca40 con 0x7f93b414ca00 2023-08-31T19:26:42.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.765+0000 7f93a27fc700 1 -- 172.21.15.72:0/4201534912 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ac00f040 con 0x7f93b414ca00 2023-08-31T19:26:42.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.765+0000 7f93a27fc700 1 -- 172.21.15.72:0/4201534912 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac00cdb0 con 0x7f93b414ca00 2023-08-31T19:26:42.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.765+0000 7f93b8dff700 1 -- 172.21.15.72:0/4201534912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b40c18e0 con 0x7f93b414ca00 2023-08-31T19:26:42.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.765+0000 7f93b8dff700 1 -- 172.21.15.72:0/4201534912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b4154f00 con 0x7f93b414ca00 2023-08-31T19:26:42.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.767+0000 7f93b8dff700 1 -- 172.21.15.72:0/4201534912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b4154d40 con 0x7f93b414ca00 2023-08-31T19:26:42.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.767+0000 7f93a27fc700 1 -- 172.21.15.72:0/4201534912 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 94) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f93ac013610 con 0x7f93b414ca00 2023-08-31T19:26:42.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.768+0000 7f93a27fc700 1 --2- 172.21.15.72:0/4201534912 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f939405efc0 0x7f9394061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:42.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.769+0000 7f93a27fc700 1 -- 172.21.15.72:0/4201534912 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f93ac07abc0 con 0x7f93b414ca00 2023-08-31T19:26:42.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.769+0000 7f93b259c700 1 -- 172.21.15.72:0/4201534912 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f939405efc0 msgr2=0x7f9394061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:42.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.769+0000 7f93b259c700 1 --2- 172.21.15.72:0/4201534912 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f939405efc0 0x7f9394061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:42.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.773+0000 7f93a27fc700 1 -- 172.21.15.72:0/4201534912 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f93ac04b990 con 0x7f93b414ca00 2023-08-31T19:26:42.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.949+0000 7f93b8dff700 1 -- 172.21.15.72:0/4201534912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f93b41553b0 con 0x7f93b414ca00 2023-08-31T19:26:42.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.949+0000 7f93a27fc700 1 -- 172.21.15.72:0/4201534912 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v196) v1 ==== 92+0+10 (secure 0 0 0) 0x7f93ac04efb0 con 0x7f93b414ca00 2023-08-31T19:26:42.950 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-08-31T19:26:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.951+0000 7f93b8dff700 1 -- 172.21.15.72:0/4201534912 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f939405efc0 msgr2=0x7f9394061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.951+0000 7f93b8dff700 1 --2- 172.21.15.72:0/4201534912 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f939405efc0 0x7f9394061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.951+0000 7f93b8dff700 1 -- 172.21.15.72:0/4201534912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b414ca00 msgr2=0x7f93b414acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:42.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.951+0000 7f93b8dff700 1 --2- 172.21.15.72:0/4201534912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b414ca00 0x7f93b414acc0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f93ac009df0 tx=0x7f93ac00b040).stop 2023-08-31T19:26:42.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.951+0000 7f93b8dff700 1 -- 172.21.15.72:0/4201534912 shutdown_connections 2023-08-31T19:26:42.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.951+0000 7f93b8dff700 1 --2- 172.21.15.72:0/4201534912 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f939405efc0 0x7f9394061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:42.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.951+0000 7f93b8dff700 1 --2- 172.21.15.72:0/4201534912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b414ca00 0x7f93b414acc0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.951+0000 7f93b8dff700 1 --2- 172.21.15.72:0/4201534912 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f93b4062d60 0x7f93b4155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.951+0000 7f93b8dff700 1 --2- 172.21.15.72:0/4201534912 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93b40a9f80 0x7f93b40c1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:42.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.951+0000 7f93b8dff700 1 -- 172.21.15.72:0/4201534912 >> 172.21.15.72:0/4201534912 conn(0x7f93b40c7c20 msgr2=0x7f93b40a8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:42.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.952+0000 7f93b8dff700 1 -- 172.21.15.72:0/4201534912 shutdown_connections 2023-08-31T19:26:42.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:42.952+0000 7f93b8dff700 1 -- 172.21.15.72:0/4201534912 wait complete. 2023-08-31T19:26:42.970 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:26:43.094 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:43.094+0000 7f2f5cdf7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:26:43.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.167+0000 7f5a0cdff700 1 Processor -- start 2023-08-31T19:26:43.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.167+0000 7f5a0cdff700 1 -- start start 2023-08-31T19:26:43.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.168+0000 7f5a0cdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a081541f0 0x7f5a081545d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:43.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.168+0000 7f5a0cdff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5a08158730 0x7f5a080c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:43.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.168+0000 7f5a0cdff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a080bc470 con 0x7f5a08065680 2023-08-31T19:26:43.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.168+0000 7f5a0cdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a080651f0 con 0x7f5a081541f0 2023-08-31T19:26:43.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.168+0000 7f5a0cdff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a080bc6c0 con 0x7f5a08158730 2023-08-31T19:26:43.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.168+0000 7f5a0659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a081541f0 0x7f5a081545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:43.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.169+0000 7f5a0659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a081541f0 0x7f5a081545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43796/0 (socket says 172.21.15.72:43796) 2023-08-31T19:26:43.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.169+0000 7f5a0659c700 1 -- 172.21.15.72:0/853559988 learned_addr learned my addr 172.21.15.72:0/853559988 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:43.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.169+0000 7f5a06d9d700 1 --2- 172.21.15.72:0/853559988 >> v2:172.21.15.146:3300/0 conn(0x7f5a08158730 0x7f5a080c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:43.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.169+0000 7f5a0659c700 1 -- 172.21.15.72:0/853559988 >> v2:172.21.15.146:3300/0 conn(0x7f5a08158730 msgr2=0x7f5a080c26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:43.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.169+0000 7f5a0659c700 1 --2- 172.21.15.72:0/853559988 >> v2:172.21.15.146:3300/0 conn(0x7f5a08158730 0x7f5a080c26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.169+0000 7f5a0659c700 1 -- 172.21.15.72:0/853559988 >> v1:172.21.15.146:6789/0 conn(0x7f5a08065680 legacy=0x7f5a08158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:43.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.169+0000 7f5a0659c700 1 -- 172.21.15.72:0/853559988 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a080bc9a0 con 0x7f5a081541f0 2023-08-31T19:26:43.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.169+0000 7f5a0659c700 1 --2- 172.21.15.72:0/853559988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a081541f0 0x7f5a081545d0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7f5a080a9800 tx=0x7f59f80090f0).ready entity=mon.0 client_cookie=ef4af6ed880ab0be server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:43.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.169+0000 7f5a0559a700 1 -- 172.21.15.72:0/853559988 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f800b520 con 0x7f5a081541f0 2023-08-31T19:26:43.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.169+0000 7f5a0559a700 1 -- 172.21.15.72:0/853559988 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f800b680 con 0x7f5a081541f0 2023-08-31T19:26:43.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.169+0000 7f5a0559a700 1 -- 172.21.15.72:0/853559988 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f800ba20 con 0x7f5a081541f0 2023-08-31T19:26:43.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.170+0000 7f5a0cdff700 1 -- 172.21.15.72:0/853559988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a081541f0 msgr2=0x7f5a081545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:43.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.170+0000 7f5a0cdff700 1 --2- 172.21.15.72:0/853559988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a081541f0 0x7f5a081545d0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7f5a080a9800 tx=0x7f59f80090f0).stop 2023-08-31T19:26:43.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.170+0000 7f5a0cdff700 1 -- 172.21.15.72:0/853559988 shutdown_connections 2023-08-31T19:26:43.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.170+0000 7f5a0cdff700 1 --2- 172.21.15.72:0/853559988 >> v2:172.21.15.146:3300/0 conn(0x7f5a08158730 0x7f5a080c26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.170+0000 7f5a0cdff700 1 --2- 172.21.15.72:0/853559988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a081541f0 0x7f5a081545d0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.170+0000 7f5a0cdff700 1 -- 172.21.15.72:0/853559988 >> 172.21.15.72:0/853559988 conn(0x7f5a080630c0 msgr2=0x7f5a080c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:43.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.170+0000 7f5a0cdff700 1 -- 172.21.15.72:0/853559988 shutdown_connections 2023-08-31T19:26:43.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.170+0000 7f5a0cdff700 1 -- 172.21.15.72:0/853559988 wait complete. 2023-08-31T19:26:43.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.172+0000 7f5a0cdff700 1 Processor -- start 2023-08-31T19:26:43.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.172+0000 7f5a0cdff700 1 -- start start 2023-08-31T19:26:43.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.173+0000 7f5a0cdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a08065680 0x7f5a08165ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.173+0000 7f5a0cdff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a081541f0 0x7f5a08167720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.173+0000 7f5a0cdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a08158730 0x7f5a080bf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.173+0000 7f5a0cdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a08164ce0 con 0x7f5a08065680 2023-08-31T19:26:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.173+0000 7f5a0cdff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a08164fc0 con 0x7f5a081541f0 2023-08-31T19:26:43.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.173+0000 7f5a0cdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a081652a0 con 0x7f5a08158730 2023-08-31T19:26:43.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.173+0000 7f5a0659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a08065680 0x7f5a08165ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:43.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.173+0000 7f5a0659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a08065680 0x7f5a08165ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43806/0 (socket says 172.21.15.72:43806) 2023-08-31T19:26:43.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.173+0000 7f5a0659c700 1 -- 172.21.15.72:0/3383834844 learned_addr learned my addr 172.21.15.72:0/3383834844 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:43.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.173+0000 7f5a05d9b700 1 --2- 172.21.15.72:0/3383834844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a081541f0 0x7f5a08167720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:43.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.173+0000 7f5a06d9d700 1 --2- 172.21.15.72:0/3383834844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a08158730 0x7f5a080bf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:43.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.173+0000 7f5a0659c700 1 -- 172.21.15.72:0/3383834844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a08158730 msgr2=0x7f5a080bf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:43.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.173+0000 7f5a0659c700 1 --2- 172.21.15.72:0/3383834844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a08158730 0x7f5a080bf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.174+0000 7f5a0659c700 1 -- 172.21.15.72:0/3383834844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a081541f0 msgr2=0x7f5a08167720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.174+0000 7f5a0659c700 1 --2- 172.21.15.72:0/3383834844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a081541f0 0x7f5a08167720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.174+0000 7f5a0659c700 1 -- 172.21.15.72:0/3383834844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f8009370 con 0x7f5a08065680 2023-08-31T19:26:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.174+0000 7f5a0659c700 1 --2- 172.21.15.72:0/3383834844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a08065680 0x7f5a08165ac0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7f5a08067f90 tx=0x7f59f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.174+0000 7f59f67fc700 1 -- 172.21.15.72:0/3383834844 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8006d90 con 0x7f5a08065680 2023-08-31T19:26:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.174+0000 7f59f67fc700 1 -- 172.21.15.72:0/3383834844 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f8006990 con 0x7f5a08065680 2023-08-31T19:26:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.174+0000 7f5a0cdff700 1 -- 172.21.15.72:0/3383834844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a08165580 con 0x7f5a08065680 2023-08-31T19:26:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.174+0000 7f59f67fc700 1 -- 172.21.15.72:0/3383834844 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f800b7f0 con 0x7f5a08065680 2023-08-31T19:26:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.174+0000 7f5a0cdff700 1 -- 172.21.15.72:0/3383834844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a08167c10 con 0x7f5a08065680 2023-08-31T19:26:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.175+0000 7f5a0cdff700 1 -- 172.21.15.72:0/3383834844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0806c6b0 con 0x7f5a08065680 2023-08-31T19:26:43.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.176+0000 7f59f67fc700 1 -- 172.21.15.72:0/3383834844 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 94) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f59f801c630 con 0x7f5a08065680 2023-08-31T19:26:43.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.177+0000 7f59f67fc700 1 --2- 172.21.15.72:0/3383834844 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f59e805efc0 0x7f59e8061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:43.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.177+0000 7f59f67fc700 1 -- 172.21.15.72:0/3383834844 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f59f807bf20 con 0x7f5a08065680 2023-08-31T19:26:43.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.177+0000 7f5a05d9b700 1 -- 172.21.15.72:0/3383834844 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f59e805efc0 msgr2=0x7f59e8061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:43.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.177+0000 7f5a05d9b700 1 --2- 172.21.15.72:0/3383834844 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f59e805efc0 0x7f59e8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.181+0000 7f59f67fc700 1 -- 172.21.15.72:0/3383834844 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f59f804cd00 con 0x7f5a08065680 2023-08-31T19:26:43.206 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:43.205+0000 7ff15d058680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:26:43.222 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:43.221+0000 7f2f5cdf7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:26:43.337 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:43.335+0000 7ff15d058680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:26:43.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.356+0000 7f5a0cdff700 1 -- 172.21.15.72:0/3383834844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a08064e80 con 0x7f5a08065680 2023-08-31T19:26:43.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.357+0000 7f59f67fc700 1 -- 172.21.15.72:0/3383834844 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v196) v1 ==== 104+0+11 (secure 0 0 0) 0x7f59f802a020 con 0x7f5a08065680 2023-08-31T19:26:43.357 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:26:43.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.359+0000 7f5a0cdff700 1 -- 172.21.15.72:0/3383834844 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f59e805efc0 msgr2=0x7f59e8061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:43.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.359+0000 7f5a0cdff700 1 --2- 172.21.15.72:0/3383834844 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f59e805efc0 0x7f59e8061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:43.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.359+0000 7f5a0cdff700 1 -- 172.21.15.72:0/3383834844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a08065680 msgr2=0x7f5a08165ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:43.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.359+0000 7f5a0cdff700 1 --2- 172.21.15.72:0/3383834844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a08065680 0x7f5a08165ac0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7f5a08067f90 tx=0x7f59f8017000).stop 2023-08-31T19:26:43.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.359+0000 7f5a0cdff700 1 -- 172.21.15.72:0/3383834844 shutdown_connections 2023-08-31T19:26:43.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.359+0000 7f5a0cdff700 1 --2- 172.21.15.72:0/3383834844 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f59e805efc0 0x7f59e8061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:43.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.359+0000 7f5a0cdff700 1 --2- 172.21.15.72:0/3383834844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5a08158730 0x7f5a080bf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.359+0000 7f5a0cdff700 1 --2- 172.21.15.72:0/3383834844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a08065680 0x7f5a08165ac0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.359+0000 7f5a0cdff700 1 --2- 172.21.15.72:0/3383834844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a081541f0 0x7f5a08167720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.359+0000 7f5a0cdff700 1 -- 172.21.15.72:0/3383834844 >> 172.21.15.72:0/3383834844 conn(0x7f5a080630c0 msgr2=0x7f5a080a55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:43.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.359+0000 7f5a0cdff700 1 -- 172.21.15.72:0/3383834844 shutdown_connections 2023-08-31T19:26:43.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.359+0000 7f5a0cdff700 1 -- 172.21.15.72:0/3383834844 wait complete. 2023-08-31T19:26:43.377 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:26:43.408 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:43.408+0000 7f2f5cdf7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:26:43.502 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:43.502+0000 7f2f5cdf7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:26:43.529 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:43.529+0000 7ff15d058680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:26:43.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.575+0000 7f83477ff700 1 Processor -- start 2023-08-31T19:26:43.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.575+0000 7f83477ff700 1 -- start start 2023-08-31T19:26:43.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.578+0000 7f83477ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83401520e0 0x7f83400a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:43.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.578+0000 7f83477ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8340064340 con 0x7f83400a9440 2023-08-31T19:26:43.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.578+0000 7f83477ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83400bcd00 con 0x7f8340068ba0 2023-08-31T19:26:43.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.578+0000 7f83477ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83400bcfe0 con 0x7f83401520e0 2023-08-31T19:26:43.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.578+0000 7f8344d9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f83400a9440 0x7f8340068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55396/0 (socket says 172.21.15.72:55396) 2023-08-31T19:26:43.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.578+0000 7f8344d9a700 1 -- 172.21.15.72:0/2236124072 learned_addr learned my addr 172.21.15.72:0/2236124072 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:43.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.578+0000 7f834559b700 1 --2- 172.21.15.72:0/2236124072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83401520e0 0x7f83400a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.579+0000 7f8337fff700 1 -- 172.21.15.72:0/2236124072 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250741477 0 0) 0x7f8340064340 con 0x7f83400a9440 2023-08-31T19:26:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.579+0000 7f8337fff700 1 -- 172.21.15.72:0/2236124072 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f832c0033f0 con 0x7f83400a9440 2023-08-31T19:26:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.579+0000 7f8337fff700 1 -- 172.21.15.72:0/2236124072 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737552078 0 0) 0x7f83400bcd00 con 0x7f8340068ba0 2023-08-31T19:26:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.579+0000 7f834559b700 1 -- 172.21.15.72:0/2236124072 >> v1:172.21.15.146:6789/0 conn(0x7f8340068ba0 legacy=0x7f8340064840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.579+0000 7f834559b700 1 -- 172.21.15.72:0/2236124072 >> v1:172.21.15.72:6789/0 conn(0x7f83400a9440 legacy=0x7f8340068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.579+0000 7f834559b700 1 -- 172.21.15.72:0/2236124072 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83400bd2c0 con 0x7f83401520e0 2023-08-31T19:26:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.579+0000 7f834559b700 1 --2- 172.21.15.72:0/2236124072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83401520e0 0x7f83400a8f50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f833c009790 tx=0x7f833c009060).ready entity=mon.2 client_cookie=a348f00085e85653 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:43.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.579+0000 7f8337fff700 1 -- 172.21.15.72:0/2236124072 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c00f510 con 0x7f83401520e0 2023-08-31T19:26:43.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.579+0000 7f8337fff700 1 -- 172.21.15.72:0/2236124072 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c00f670 con 0x7f83401520e0 2023-08-31T19:26:43.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.579+0000 7f8337fff700 1 -- 172.21.15.72:0/2236124072 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c00f9f0 con 0x7f83401520e0 2023-08-31T19:26:43.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.580+0000 7f83477ff700 1 -- 172.21.15.72:0/2236124072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83401520e0 msgr2=0x7f83400a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:43.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.580+0000 7f83477ff700 1 --2- 172.21.15.72:0/2236124072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83401520e0 0x7f83400a8f50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f833c009790 tx=0x7f833c009060).stop 2023-08-31T19:26:43.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.580+0000 7f83477ff700 1 -- 172.21.15.72:0/2236124072 shutdown_connections 2023-08-31T19:26:43.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.580+0000 7f83477ff700 1 --2- 172.21.15.72:0/2236124072 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83401520e0 0x7f83400a8f50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.580+0000 7f83477ff700 1 -- 172.21.15.72:0/2236124072 >> 172.21.15.72:0/2236124072 conn(0x7f83400630c0 msgr2=0x7f83400c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:43.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.580+0000 7f83477ff700 1 -- 172.21.15.72:0/2236124072 shutdown_connections 2023-08-31T19:26:43.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.580+0000 7f83477ff700 1 -- 172.21.15.72:0/2236124072 wait complete. 2023-08-31T19:26:43.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.583+0000 7f83477ff700 1 Processor -- start 2023-08-31T19:26:43.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.583+0000 7f83477ff700 1 -- start start 2023-08-31T19:26:43.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.584+0000 7f83477ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8340068ba0 0x7f8340143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:43.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.584+0000 7f83477ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83400a9440 0x7f83400abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:43.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.584+0000 7f83477ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83401520e0 0x7f83400ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:43.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.584+0000 7f83477ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400ac5c0 con 0x7f83400a9440 2023-08-31T19:26:43.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.584+0000 7f83477ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834014ecb0 con 0x7f8340068ba0 2023-08-31T19:26:43.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.584+0000 7f83477ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83400c2800 con 0x7f83401520e0 2023-08-31T19:26:43.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.585+0000 7f834559b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8340068ba0 0x7f8340143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:43.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.585+0000 7f834559b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8340068ba0 0x7f8340143840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:54888/0 (socket says 172.21.15.72:54888) 2023-08-31T19:26:43.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.585+0000 7f8344d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83400a9440 0x7f83400abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:43.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.585+0000 7f834559b700 1 -- 172.21.15.72:0/3489260878 learned_addr learned my addr 172.21.15.72:0/3489260878 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:43.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.585+0000 7f8345d9c700 1 --2- 172.21.15.72:0/3489260878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83401520e0 0x7f83400ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:43.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.585+0000 7f834559b700 1 -- 172.21.15.72:0/3489260878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83401520e0 msgr2=0x7f83400ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:43.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.585+0000 7f834559b700 1 --2- 172.21.15.72:0/3489260878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83401520e0 0x7f83400ac0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.585+0000 7f834559b700 1 -- 172.21.15.72:0/3489260878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83400a9440 msgr2=0x7f83400abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.585+0000 7f834559b700 1 --2- 172.21.15.72:0/3489260878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83400a9440 0x7f83400abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.585+0000 7f834559b700 1 -- 172.21.15.72:0/3489260878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c0092a0 con 0x7f8340068ba0 2023-08-31T19:26:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.585+0000 7f8345d9c700 1 --2- 172.21.15.72:0/3489260878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83401520e0 0x7f83400ac0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.585+0000 7f8344d9a700 1 --2- 172.21.15.72:0/3489260878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83400a9440 0x7f83400abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:43.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.585+0000 7f834559b700 1 --2- 172.21.15.72:0/3489260878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8340068ba0 0x7f8340143840 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f8340067cb0 tx=0x7f833c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:43.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.586+0000 7f83357fa700 1 -- 172.21.15.72:0/3489260878 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c00fe80 con 0x7f8340068ba0 2023-08-31T19:26:43.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.586+0000 7f83357fa700 1 -- 172.21.15.72:0/3489260878 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c00f7e0 con 0x7f8340068ba0 2023-08-31T19:26:43.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.586+0000 7f83357fa700 1 -- 172.21.15.72:0/3489260878 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c01b660 con 0x7f8340068ba0 2023-08-31T19:26:43.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.586+0000 7f83477ff700 1 -- 172.21.15.72:0/3489260878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83400c2ae0 con 0x7f8340068ba0 2023-08-31T19:26:43.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.586+0000 7f83477ff700 1 -- 172.21.15.72:0/3489260878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834014e940 con 0x7f8340068ba0 2023-08-31T19:26:43.592 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:43.588+0000 7f2f5cdf7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:26:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.587+0000 7f83477ff700 1 -- 172.21.15.72:0/3489260878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834006c6b0 con 0x7f8340068ba0 2023-08-31T19:26:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.587+0000 7f83357fa700 1 -- 172.21.15.72:0/3489260878 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 94) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f833c01b9d0 con 0x7f8340068ba0 2023-08-31T19:26:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.588+0000 7f83357fa700 1 --2- 172.21.15.72:0/3489260878 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f832405efc0 0x7f8324061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:43.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.588+0000 7f83357fa700 1 -- 172.21.15.72:0/3489260878 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f833c07be90 con 0x7f8340068ba0 2023-08-31T19:26:43.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.588+0000 7f8344d9a700 1 -- 172.21.15.72:0/3489260878 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f832405efc0 msgr2=0x7f8324061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:43.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.588+0000 7f8344d9a700 1 --2- 172.21.15.72:0/3489260878 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f832405efc0 0x7f8324061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:43.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.592+0000 7f83357fa700 1 -- 172.21.15.72:0/3489260878 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f833c04cc70 con 0x7f8340068ba0 2023-08-31T19:26:43.630 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:43.630+0000 7ff15d058680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:26:43.718 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:43.718+0000 7ff15d058680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:26:43.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.767+0000 7f83477ff700 1 -- 172.21.15.72:0/3489260878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83400a7d90 con 0x7f8340068ba0 2023-08-31T19:26:43.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.767+0000 7f83357fa700 1 -- 172.21.15.72:0/3489260878 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v196) v1 ==== 100+0+11 (secure 0 0 0) 0x7f833c07d020 con 0x7f8340068ba0 2023-08-31T19:26:43.768 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-08-31T19:26:43.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.771+0000 7f83477ff700 1 -- 172.21.15.72:0/3489260878 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f832405efc0 msgr2=0x7f8324061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:43.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.771+0000 7f83477ff700 1 --2- 172.21.15.72:0/3489260878 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f832405efc0 0x7f8324061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:43.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.771+0000 7f83477ff700 1 -- 172.21.15.72:0/3489260878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8340068ba0 msgr2=0x7f8340143840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:43.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.771+0000 7f83477ff700 1 --2- 172.21.15.72:0/3489260878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8340068ba0 0x7f8340143840 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f8340067cb0 tx=0x7f833c017000).stop 2023-08-31T19:26:43.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.771+0000 7f83477ff700 1 -- 172.21.15.72:0/3489260878 shutdown_connections 2023-08-31T19:26:43.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.771+0000 7f83477ff700 1 --2- 172.21.15.72:0/3489260878 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f832405efc0 0x7f8324061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:43.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.771+0000 7f83477ff700 1 --2- 172.21.15.72:0/3489260878 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83401520e0 0x7f83400ac0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.771+0000 7f83477ff700 1 --2- 172.21.15.72:0/3489260878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8340068ba0 0x7f8340143840 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.771+0000 7f83477ff700 1 --2- 172.21.15.72:0/3489260878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83400a9440 0x7f83400abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.771+0000 7f83477ff700 1 -- 172.21.15.72:0/3489260878 >> 172.21.15.72:0/3489260878 conn(0x7f83400630c0 msgr2=0x7f8340157590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:43.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.771+0000 7f83477ff700 1 -- 172.21.15.72:0/3489260878 shutdown_connections 2023-08-31T19:26:43.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.771+0000 7f83477ff700 1 -- 172.21.15.72:0/3489260878 wait complete. 2023-08-31T19:26:43.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:26:43.903 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:43.903+0000 7f2f5cdf7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:26:43.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.990+0000 7fcd499ff700 1 Processor -- start 2023-08-31T19:26:43.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.991+0000 7fcd499ff700 1 -- start start 2023-08-31T19:26:43.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.992+0000 7fcd499ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd44154220 0x7fcd44157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:43.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.992+0000 7fcd499ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd440cb940 0x7fcd441581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:43.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.992+0000 7fcd499ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd440c8c90 con 0x7fcd441586b0 2023-08-31T19:26:43.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.992+0000 7fcd499ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd440aa700 con 0x7fcd440cb940 2023-08-31T19:26:43.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.992+0000 7fcd499ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440c5e10 con 0x7fcd44154220 2023-08-31T19:26:43.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.992+0000 7fcd427fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd440cb940 0x7fcd441581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:43.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.992+0000 7fcd427fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd440cb940 0x7fcd441581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43834/0 (socket says 172.21.15.72:43834) 2023-08-31T19:26:43.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.992+0000 7fcd427fc700 1 -- 172.21.15.72:0/916818625 learned_addr learned my addr 172.21.15.72:0/916818625 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:43.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.992+0000 7fcd42ffd700 1 --2- 172.21.15.72:0/916818625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd44154220 0x7fcd44157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:43.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.993+0000 7fcd427fc700 1 -- 172.21.15.72:0/916818625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd44154220 msgr2=0x7fcd44157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:43.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.993+0000 7fcd427fc700 1 --2- 172.21.15.72:0/916818625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd44154220 0x7fcd44157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.993+0000 7fcd427fc700 1 -- 172.21.15.72:0/916818625 >> v1:172.21.15.146:6789/0 conn(0x7fcd441586b0 legacy=0x7fcd44154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:43.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.993+0000 7fcd41ffb700 1 -- 172.21.15.72:0/916818625 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849961107 0 0) 0x7fcd440c8c90 con 0x7fcd441586b0 2023-08-31T19:26:43.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.993+0000 7fcd427fc700 1 -- 172.21.15.72:0/916818625 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd440c0a50 con 0x7fcd440cb940 2023-08-31T19:26:43.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.993+0000 7fcd427fc700 1 --2- 172.21.15.72:0/916818625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd440cb940 0x7fcd441581c0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 rx=0x7fcd38009830 tx=0x7fcd380090f0).ready entity=mon.0 client_cookie=32cfcced05ef3aed server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:43.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.993+0000 7fcd41ffb700 1 -- 172.21.15.72:0/916818625 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800b580 con 0x7fcd440cb940 2023-08-31T19:26:43.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.993+0000 7fcd41ffb700 1 -- 172.21.15.72:0/916818625 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3800b6e0 con 0x7fcd440cb940 2023-08-31T19:26:43.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.993+0000 7fcd41ffb700 1 -- 172.21.15.72:0/916818625 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800ba60 con 0x7fcd440cb940 2023-08-31T19:26:43.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.994+0000 7fcd499ff700 1 -- 172.21.15.72:0/916818625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd440cb940 msgr2=0x7fcd441581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:43.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.994+0000 7fcd499ff700 1 --2- 172.21.15.72:0/916818625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd440cb940 0x7fcd441581c0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 rx=0x7fcd38009830 tx=0x7fcd380090f0).stop 2023-08-31T19:26:43.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.994+0000 7fcd499ff700 1 -- 172.21.15.72:0/916818625 shutdown_connections 2023-08-31T19:26:43.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.994+0000 7fcd499ff700 1 --2- 172.21.15.72:0/916818625 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd44154220 0x7fcd44157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.994+0000 7fcd499ff700 1 --2- 172.21.15.72:0/916818625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd440cb940 0x7fcd441581c0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:43.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.994+0000 7fcd499ff700 1 -- 172.21.15.72:0/916818625 >> 172.21.15.72:0/916818625 conn(0x7fcd4405e870 msgr2=0x7fcd440cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:43.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.994+0000 7fcd499ff700 1 -- 172.21.15.72:0/916818625 shutdown_connections 2023-08-31T19:26:43.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.994+0000 7fcd499ff700 1 -- 172.21.15.72:0/916818625 wait complete. 2023-08-31T19:26:44.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.996+0000 7fcd499ff700 1 Processor -- start 2023-08-31T19:26:44.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.996+0000 7fcd499ff700 1 -- start start 2023-08-31T19:26:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.997+0000 7fcd499ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd440cb940 0x7fcd440aa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.998+0000 7fcd499ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd44154220 0x7fcd4414ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.998+0000 7fcd499ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd441586b0 0x7fcd440adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.998+0000 7fcd499ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440c64e0 con 0x7fcd441586b0 2023-08-31T19:26:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.998+0000 7fcd499ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440c4790 con 0x7fcd440cb940 2023-08-31T19:26:44.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.998+0000 7fcd499ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440c6750 con 0x7fcd44154220 2023-08-31T19:26:44.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.998+0000 7fcd437fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd441586b0 0x7fcd440adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:44.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.998+0000 7fcd427fc700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd44154220 0x7fcd4414ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:44.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.998+0000 7fcd437fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd441586b0 0x7fcd440adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43838/0 (socket says 172.21.15.72:43838) 2023-08-31T19:26:44.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.998+0000 7fcd437fe700 1 -- 172.21.15.72:0/2632543955 learned_addr learned my addr 172.21.15.72:0/2632543955 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:44.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.998+0000 7fcd42ffd700 1 --2- 172.21.15.72:0/2632543955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd440cb940 0x7fcd440aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:44.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.998+0000 7fcd427fc700 1 -- 172.21.15.72:0/2632543955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd440cb940 msgr2=0x7fcd440aa840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:44.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.998+0000 7fcd427fc700 1 --2- 172.21.15.72:0/2632543955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd440cb940 0x7fcd440aa840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.998+0000 7fcd427fc700 1 -- 172.21.15.72:0/2632543955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd441586b0 msgr2=0x7fcd440adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:44.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.998+0000 7fcd427fc700 1 --2- 172.21.15.72:0/2632543955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd441586b0 0x7fcd440adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.998+0000 7fcd427fc700 1 -- 172.21.15.72:0/2632543955 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd38009370 con 0x7fcd44154220 2023-08-31T19:26:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.999+0000 7fcd427fc700 1 --2- 172.21.15.72:0/2632543955 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd44154220 0x7fcd4414ada0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fcd38014000 tx=0x7fcd38017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.999+0000 7fcd2affd700 1 -- 172.21.15.72:0/2632543955 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38006d90 con 0x7fcd44154220 2023-08-31T19:26:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.999+0000 7fcd2affd700 1 -- 172.21.15.72:0/2632543955 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd38000bc0 con 0x7fcd44154220 2023-08-31T19:26:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.999+0000 7fcd2affd700 1 -- 172.21.15.72:0/2632543955 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800ba60 con 0x7fcd44154220 2023-08-31T19:26:44.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.999+0000 7fcd499ff700 1 -- 172.21.15.72:0/2632543955 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd440c6a30 con 0x7fcd44154220 2023-08-31T19:26:44.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:43.999+0000 7fcd499ff700 1 -- 172.21.15.72:0/2632543955 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd440aad30 con 0x7fcd44154220 2023-08-31T19:26:44.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.000+0000 7fcd499ff700 1 -- 172.21.15.72:0/2632543955 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4406c6b0 con 0x7fcd44154220 2023-08-31T19:26:44.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.001+0000 7fcd2affd700 1 -- 172.21.15.72:0/2632543955 <== mon.2 v2:172.21.15.146:3301/0 4 ==== mgrmap(e 94) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fcd3801b830 con 0x7fcd44154220 2023-08-31T19:26:44.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.001+0000 7fcd2affd700 1 --2- 172.21.15.72:0/2632543955 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcd3005efc0 0x7fcd30061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.002+0000 7fcd42ffd700 1 -- 172.21.15.72:0/2632543955 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcd3005efc0 msgr2=0x7fcd30061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:44.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.002+0000 7fcd2affd700 1 -- 172.21.15.72:0/2632543955 <== mon.2 v2:172.21.15.146:3301/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7fcd3807bec0 con 0x7fcd44154220 2023-08-31T19:26:44.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.002+0000 7fcd42ffd700 1 --2- 172.21.15.72:0/2632543955 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcd3005efc0 0x7fcd30061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:44.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.006+0000 7fcd2affd700 1 -- 172.21.15.72:0/2632543955 <== mon.2 v2:172.21.15.146:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcd3804cca0 con 0x7fcd44154220 2023-08-31T19:26:44.057 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:44.056+0000 7ff15d058680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:26:44.130 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:44.129+0000 7f2f5cdf7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:26:44.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.203+0000 7fcd42ffd700 1 -- 172.21.15.72:0/2632543955 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcd3005efc0 msgr2=0x7fcd30061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:44.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.203+0000 7fcd42ffd700 1 --2- 172.21.15.72:0/2632543955 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcd3005efc0 0x7fcd30061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:26:44.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.225+0000 7fcd499ff700 1 -- 172.21.15.72:0/2632543955 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd440c6ed0 con 0x7fcd44154220 2023-08-31T19:26:44.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.226+0000 7fcd2affd700 1 -- 172.21.15.72:0/2632543955 <== mon.2 v2:172.21.15.146:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4499 (secure 0 0 0) 0x7fcd380502c0 con 0x7fcd44154220 2023-08-31T19:26:44.227 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:44.227 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2772120291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2772120291},{"type":"v1","addr":"172.21.15.146:6834","nonce":2772120291}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4204264962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4204264962},{"type":"v1","addr":"172.21.15.72:6836","nonce":4204264962}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9501,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2736058565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2736058565},{"type":"v1","addr":"172.21.15.72:6837","nonce":2736058565}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:26:23.268664+0000","modified":"2023-08-31T19:26:26.278490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9507":{"gid":9507,"name":"b","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3040541253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3040541253},{"type":"v1","addr":"172.21.15.146:6835","nonce":3040541253}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-31T19:26:44.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.228+0000 7fcd499ff700 1 -- 172.21.15.72:0/2632543955 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcd3005efc0 msgr2=0x7fcd30061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:44.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.228+0000 7fcd499ff700 1 --2- 172.21.15.72:0/2632543955 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcd3005efc0 0x7fcd30061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:44.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.229+0000 7fcd499ff700 1 -- 172.21.15.72:0/2632543955 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd44154220 msgr2=0x7fcd4414ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:44.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.229+0000 7fcd499ff700 1 --2- 172.21.15.72:0/2632543955 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd44154220 0x7fcd4414ada0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fcd38014000 tx=0x7fcd38017000).stop 2023-08-31T19:26:44.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.229+0000 7fcd499ff700 1 -- 172.21.15.72:0/2632543955 shutdown_connections 2023-08-31T19:26:44.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.229+0000 7fcd499ff700 1 --2- 172.21.15.72:0/2632543955 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fcd3005efc0 0x7fcd30061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:44.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.229+0000 7fcd499ff700 1 --2- 172.21.15.72:0/2632543955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd441586b0 0x7fcd440adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.229+0000 7fcd499ff700 1 --2- 172.21.15.72:0/2632543955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd440cb940 0x7fcd440aa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.229+0000 7fcd499ff700 1 --2- 172.21.15.72:0/2632543955 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fcd44154220 0x7fcd4414ada0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.229+0000 7fcd499ff700 1 -- 172.21.15.72:0/2632543955 >> 172.21.15.72:0/2632543955 conn(0x7fcd4405e870 msgr2=0x7fcd440a8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:44.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.229+0000 7fcd499ff700 1 -- 172.21.15.72:0/2632543955 shutdown_connections 2023-08-31T19:26:44.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.229+0000 7fcd499ff700 1 -- 172.21.15.72:0/2632543955 wait complete. 2023-08-31T19:26:44.232 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 86 2023-08-31T19:26:44.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:26:44.286 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:44.285+0000 7ff15d058680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:26:44.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.442+0000 7f7f2d9ff700 1 Processor -- start 2023-08-31T19:26:44.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.442+0000 7f7f2d9ff700 1 -- start start 2023-08-31T19:26:44.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.443+0000 7f7f2d9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f280a9eb0 0x7f7f280aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.443+0000 7f7f2d9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f281576d0 0x7f7f280c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.443+0000 7f7f2d9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f280bfd00 con 0x7f7f280c5bf0 2023-08-31T19:26:44.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.443+0000 7f7f2d9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f280c05a0 con 0x7f7f280a9eb0 2023-08-31T19:26:44.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.443+0000 7f7f2d9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280aaea0 con 0x7f7f281576d0 2023-08-31T19:26:44.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.444+0000 7f7f26ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f280a9eb0 0x7f7f280aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:44.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.444+0000 7f7f26ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f280a9eb0 0x7f7f280aa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43854/0 (socket says 172.21.15.72:43854) 2023-08-31T19:26:44.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.444+0000 7f7f26ffd700 1 -- 172.21.15.72:0/110241457 learned_addr learned my addr 172.21.15.72:0/110241457 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:44.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.444+0000 7f7f277fe700 1 --2- 172.21.15.72:0/110241457 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f281576d0 0x7f7f280c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:44.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.444+0000 7f7f26ffd700 1 -- 172.21.15.72:0/110241457 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f281576d0 msgr2=0x7f7f280c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:44.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.444+0000 7f7f26ffd700 1 --2- 172.21.15.72:0/110241457 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f281576d0 0x7f7f280c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.444+0000 7f7f26ffd700 1 -- 172.21.15.72:0/110241457 >> v1:172.21.15.146:6789/0 conn(0x7f7f280c5bf0 legacy=0x7f7f28156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:44.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.444+0000 7f7f26ffd700 1 -- 172.21.15.72:0/110241457 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f280c6670 con 0x7f7f280a9eb0 2023-08-31T19:26:44.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.444+0000 7f7f25ffb700 1 -- 172.21.15.72:0/110241457 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790786112 0 0) 0x7f7f280bfd00 con 0x7f7f280c5bf0 2023-08-31T19:26:44.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.444+0000 7f7f26ffd700 1 --2- 172.21.15.72:0/110241457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280a9eb0 0x7f7f280aa290 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7f7f18006fd0 tx=0x7f7f180090f0).ready entity=mon.0 client_cookie=cae2e994c321e306 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:44.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.445+0000 7f7f25ffb700 1 -- 172.21.15.72:0/110241457 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800b580 con 0x7f7f280a9eb0 2023-08-31T19:26:44.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.445+0000 7f7f25ffb700 1 -- 172.21.15.72:0/110241457 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1800b6e0 con 0x7f7f280a9eb0 2023-08-31T19:26:44.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.445+0000 7f7f25ffb700 1 -- 172.21.15.72:0/110241457 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800ba60 con 0x7f7f280a9eb0 2023-08-31T19:26:44.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.445+0000 7f7f2d9ff700 1 -- 172.21.15.72:0/110241457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280a9eb0 msgr2=0x7f7f280aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:44.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.445+0000 7f7f2d9ff700 1 --2- 172.21.15.72:0/110241457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280a9eb0 0x7f7f280aa290 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7f7f18006fd0 tx=0x7f7f180090f0).stop 2023-08-31T19:26:44.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.445+0000 7f7f2d9ff700 1 -- 172.21.15.72:0/110241457 shutdown_connections 2023-08-31T19:26:44.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.445+0000 7f7f2d9ff700 1 --2- 172.21.15.72:0/110241457 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f281576d0 0x7f7f280c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.445+0000 7f7f2d9ff700 1 --2- 172.21.15.72:0/110241457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280a9eb0 0x7f7f280aa290 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.445+0000 7f7f2d9ff700 1 -- 172.21.15.72:0/110241457 >> 172.21.15.72:0/110241457 conn(0x7f7f280c82e0 msgr2=0x7f7f2805e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:44.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.446+0000 7f7f2d9ff700 1 -- 172.21.15.72:0/110241457 shutdown_connections 2023-08-31T19:26:44.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.446+0000 7f7f2d9ff700 1 -- 172.21.15.72:0/110241457 wait complete. 2023-08-31T19:26:44.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.447+0000 7f7f2d9ff700 1 Processor -- start 2023-08-31T19:26:44.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.447+0000 7f7f2d9ff700 1 -- start start 2023-08-31T19:26:44.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.448+0000 7f7f2d9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280a9eb0 0x7f7f280c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.448+0000 7f7f2d9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f280c5bf0 0x7f7f2814c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.448+0000 7f7f2d9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f281576d0 0x7f7f2814c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.448+0000 7f7f2d9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280aee40 con 0x7f7f280a9eb0 2023-08-31T19:26:44.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.448+0000 7f7f2d9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280c47a0 con 0x7f7f280c5bf0 2023-08-31T19:26:44.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.448+0000 7f7f2d9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2814cb10 con 0x7f7f281576d0 2023-08-31T19:26:44.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.448+0000 7f7f26ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280a9eb0 0x7f7f280c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:44.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.448+0000 7f7f26ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280a9eb0 0x7f7f280c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43856/0 (socket says 172.21.15.72:43856) 2023-08-31T19:26:44.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.448+0000 7f7f26ffd700 1 -- 172.21.15.72:0/910341435 learned_addr learned my addr 172.21.15.72:0/910341435 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:44.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.449+0000 7f7f277fe700 1 --2- 172.21.15.72:0/910341435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f281576d0 0x7f7f2814c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:44.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.448+0000 7f7f267fc700 1 --2- 172.21.15.72:0/910341435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f280c5bf0 0x7f7f2814c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:44.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.449+0000 7f7f26ffd700 1 -- 172.21.15.72:0/910341435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f281576d0 msgr2=0x7f7f2814c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:44.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.449+0000 7f7f26ffd700 1 --2- 172.21.15.72:0/910341435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f281576d0 0x7f7f2814c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.449+0000 7f7f26ffd700 1 -- 172.21.15.72:0/910341435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f280c5bf0 msgr2=0x7f7f2814c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:44.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.449+0000 7f7f26ffd700 1 --2- 172.21.15.72:0/910341435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f280c5bf0 0x7f7f2814c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.449+0000 7f7f26ffd700 1 -- 172.21.15.72:0/910341435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f18009370 con 0x7f7f280a9eb0 2023-08-31T19:26:44.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.449+0000 7f7f267fc700 1 --2- 172.21.15.72:0/910341435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f280c5bf0 0x7f7f2814c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:44.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.449+0000 7f7f26ffd700 1 --2- 172.21.15.72:0/910341435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280a9eb0 0x7f7f280c42b0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f7f18009130 tx=0x7f7f18017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:44.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.449+0000 7f7f0effd700 1 -- 172.21.15.72:0/910341435 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800b850 con 0x7f7f280a9eb0 2023-08-31T19:26:44.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.449+0000 7f7f0effd700 1 -- 172.21.15.72:0/910341435 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1800b9b0 con 0x7f7f280a9eb0 2023-08-31T19:26:44.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.449+0000 7f7f2d9ff700 1 -- 172.21.15.72:0/910341435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f280ae250 con 0x7f7f280a9eb0 2023-08-31T19:26:44.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.449+0000 7f7f0effd700 1 -- 172.21.15.72:0/910341435 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1801b660 con 0x7f7f280a9eb0 2023-08-31T19:26:44.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.449+0000 7f7f2d9ff700 1 -- 172.21.15.72:0/910341435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f280ae7f0 con 0x7f7f280a9eb0 2023-08-31T19:26:44.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.451+0000 7f7f2d9ff700 1 -- 172.21.15.72:0/910341435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2806c6b0 con 0x7f7f280a9eb0 2023-08-31T19:26:44.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.451+0000 7f7f0effd700 1 -- 172.21.15.72:0/910341435 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 94) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f7f1801ba10 con 0x7f7f280a9eb0 2023-08-31T19:26:44.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.452+0000 7f7f0effd700 1 --2- 172.21.15.72:0/910341435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7f1405efc0 0x7f7f14061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.452+0000 7f7f0effd700 1 -- 172.21.15.72:0/910341435 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f7f1807bda0 con 0x7f7f280a9eb0 2023-08-31T19:26:44.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.452+0000 7f7f267fc700 1 -- 172.21.15.72:0/910341435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7f1405efc0 msgr2=0x7f7f14061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:44.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.452+0000 7f7f267fc700 1 --2- 172.21.15.72:0/910341435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7f1405efc0 0x7f7f14061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:44.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.457+0000 7f7f0effd700 1 -- 172.21.15.72:0/910341435 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f1804cb80 con 0x7f7f280a9eb0 2023-08-31T19:26:44.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.635+0000 7f7f2d9ff700 1 -- 172.21.15.72:0/910341435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f280655b0 con 0x7f7f280a9eb0 2023-08-31T19:26:44.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.636+0000 7f7f0effd700 1 -- 172.21.15.72:0/910341435 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+18405 (secure 0 0 0) 0x7f7f180501a0 con 0x7f7f280a9eb0 2023-08-31T19:26:44.637 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:44.637 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":196,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:26:37.533844+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:26:21.693921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-31T19:26:22.249227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/3780867317":"2023-09-01T19:26:37.533809+0000","172.21.15.72:6833/189426":"2023-09-01T19:26:37.533809+0000","172.21.15.72:6832/189426":"2023-09-01T19:26:37.533809+0000","172.21.15.72:0/1369089719":"2023-09-01T19:26:37.533809+0000","172.21.15.72:0/3101987496":"2023-09-01T19:26:37.533809+0000","172.21.15.72:0/2121781009":"2023-09-01T19:26:37.533809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:26:44.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.638+0000 7f7f2d9ff700 1 -- 172.21.15.72:0/910341435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7f1405efc0 msgr2=0x7f7f14061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:44.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.638+0000 7f7f2d9ff700 1 --2- 172.21.15.72:0/910341435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7f1405efc0 0x7f7f14061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:44.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.638+0000 7f7f2d9ff700 1 -- 172.21.15.72:0/910341435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280a9eb0 msgr2=0x7f7f280c42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:44.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.638+0000 7f7f2d9ff700 1 --2- 172.21.15.72:0/910341435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280a9eb0 0x7f7f280c42b0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f7f18009130 tx=0x7f7f18017000).stop 2023-08-31T19:26:44.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.638+0000 7f7f2d9ff700 1 -- 172.21.15.72:0/910341435 shutdown_connections 2023-08-31T19:26:44.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.638+0000 7f7f2d9ff700 1 --2- 172.21.15.72:0/910341435 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7f1405efc0 0x7f7f14061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:44.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.638+0000 7f7f2d9ff700 1 --2- 172.21.15.72:0/910341435 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7f281576d0 0x7f7f2814c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.638+0000 7f7f2d9ff700 1 --2- 172.21.15.72:0/910341435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f280a9eb0 0x7f7f280c42b0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.638+0000 7f7f2d9ff700 1 --2- 172.21.15.72:0/910341435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f280c5bf0 0x7f7f2814c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.638+0000 7f7f2d9ff700 1 -- 172.21.15.72:0/910341435 >> 172.21.15.72:0/910341435 conn(0x7f7f280c82e0 msgr2=0x7f7f280ab220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:44.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.639+0000 7f7f2d9ff700 1 -- 172.21.15.72:0/910341435 shutdown_connections 2023-08-31T19:26:44.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.639+0000 7f7f2d9ff700 1 -- 172.21.15.72:0/910341435 wait complete. 2023-08-31T19:26:44.657 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T19:26:44.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:26:44.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.893+0000 7fc68359e700 1 Processor -- start 2023-08-31T19:26:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.893+0000 7fc68359e700 1 -- start start 2023-08-31T19:26:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.894+0000 7fc68359e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6840bfd50 0x7fc6841582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.894+0000 7fc68359e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6840c5bc0 0x7fc6840c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.894+0000 7fc68359e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6840aa520 con 0x7fc68414b000 2023-08-31T19:26:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.894+0000 7fc68359e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc684154b80 con 0x7fc6840c5bc0 2023-08-31T19:26:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.894+0000 7fc68359e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc684157e30 con 0x7fc6840bfd50 2023-08-31T19:26:44.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.895+0000 7fc682d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6840c5bc0 0x7fc6840c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:44.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.895+0000 7fc682d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6840c5bc0 0x7fc6840c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:54916/0 (socket says 172.21.15.72:54916) 2023-08-31T19:26:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.895+0000 7fc682d9d700 1 -- 172.21.15.72:0/2575182288 learned_addr learned my addr 172.21.15.72:0/2575182288 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.895+0000 7fc68259c700 1 --1- 172.21.15.72:0/2575182288 >> v1:172.21.15.146:6789/0 conn(0x7fc68414b000 0x7fc684154470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:36382/0 (socket says 172.21.15.72:36382) 2023-08-31T19:26:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.895+0000 7fc681d9b700 1 --2- 172.21.15.72:0/2575182288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6840bfd50 0x7fc6841582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.895+0000 7fc682d9d700 1 -- 172.21.15.72:0/2575182288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6840bfd50 msgr2=0x7fc6841582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.895+0000 7fc682d9d700 1 --2- 172.21.15.72:0/2575182288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6840bfd50 0x7fc6841582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.895+0000 7fc682d9d700 1 -- 172.21.15.72:0/2575182288 >> v1:172.21.15.146:6789/0 conn(0x7fc68414b000 legacy=0x7fc684154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.895+0000 7fc68159a700 1 -- 172.21.15.72:0/2575182288 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257069822 0 0) 0x7fc6840aa520 con 0x7fc68414b000 2023-08-31T19:26:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.895+0000 7fc682d9d700 1 -- 172.21.15.72:0/2575182288 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6840c6540 con 0x7fc6840c5bc0 2023-08-31T19:26:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.896+0000 7fc682d9d700 1 --2- 172.21.15.72:0/2575182288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6840c5bc0 0x7fc6840c6050 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fc67c009f20 tx=0x7fc67c009840).ready entity=mon.1 client_cookie=df3f22f1572523cb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.896+0000 7fc68159a700 1 -- 172.21.15.72:0/2575182288 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c00e070 con 0x7fc6840c5bc0 2023-08-31T19:26:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.896+0000 7fc68159a700 1 -- 172.21.15.72:0/2575182288 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c00b9d0 con 0x7fc6840c5bc0 2023-08-31T19:26:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.896+0000 7fc68159a700 1 -- 172.21.15.72:0/2575182288 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c00bd50 con 0x7fc6840c5bc0 2023-08-31T19:26:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.896+0000 7fc68359e700 1 -- 172.21.15.72:0/2575182288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6840c5bc0 msgr2=0x7fc6840c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.896+0000 7fc68359e700 1 --2- 172.21.15.72:0/2575182288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6840c5bc0 0x7fc6840c6050 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fc67c009f20 tx=0x7fc67c009840).stop 2023-08-31T19:26:44.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.896+0000 7fc68359e700 1 -- 172.21.15.72:0/2575182288 shutdown_connections 2023-08-31T19:26:44.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.896+0000 7fc68359e700 1 --2- 172.21.15.72:0/2575182288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6840c5bc0 0x7fc6840c6050 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.896+0000 7fc68359e700 1 --2- 172.21.15.72:0/2575182288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6840bfd50 0x7fc6841582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.896+0000 7fc68359e700 1 -- 172.21.15.72:0/2575182288 >> 172.21.15.72:0/2575182288 conn(0x7fc6840cabf0 msgr2=0x7fc6840cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.897+0000 7fc68359e700 1 -- 172.21.15.72:0/2575182288 shutdown_connections 2023-08-31T19:26:44.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.897+0000 7fc68359e700 1 -- 172.21.15.72:0/2575182288 wait complete. 2023-08-31T19:26:44.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.898+0000 7fc68359e700 1 Processor -- start 2023-08-31T19:26:44.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.898+0000 7fc68359e700 1 -- start start 2023-08-31T19:26:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.899+0000 7fc68359e700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6840bfd50 0x7fc684155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.899+0000 7fc68359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6840c5bc0 0x7fc6841489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.899+0000 7fc68359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc68414b000 0x7fc68414bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.899+0000 7fc68359e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68414cb80 con 0x7fc6840c5bc0 2023-08-31T19:26:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.899+0000 7fc68359e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68414d420 con 0x7fc68414b000 2023-08-31T19:26:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.899+0000 7fc68359e700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc684148eb0 con 0x7fc6840bfd50 2023-08-31T19:26:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.899+0000 7fc681d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6840c5bc0 0x7fc6841489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:44.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.899+0000 7fc681d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6840c5bc0 0x7fc6841489c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43866/0 (socket says 172.21.15.72:43866) 2023-08-31T19:26:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.899+0000 7fc681d9b700 1 -- 172.21.15.72:0/4088404076 learned_addr learned my addr 172.21.15.72:0/4088404076 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.899+0000 7fc68259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6840bfd50 0x7fc684155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.899+0000 7fc682d9d700 1 --2- 172.21.15.72:0/4088404076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc68414b000 0x7fc68414bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.900+0000 7fc681d9b700 1 -- 172.21.15.72:0/4088404076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6840bfd50 msgr2=0x7fc684155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.900+0000 7fc681d9b700 1 --2- 172.21.15.72:0/4088404076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6840bfd50 0x7fc684155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.900+0000 7fc681d9b700 1 -- 172.21.15.72:0/4088404076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc68414b000 msgr2=0x7fc68414bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.900+0000 7fc681d9b700 1 --2- 172.21.15.72:0/4088404076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc68414b000 0x7fc68414bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.900+0000 7fc681d9b700 1 -- 172.21.15.72:0/4088404076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c009ae0 con 0x7fc6840c5bc0 2023-08-31T19:26:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.900+0000 7fc681d9b700 1 --2- 172.21.15.72:0/4088404076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6840c5bc0 0x7fc6841489c0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 rx=0x7fc67800e900 tx=0x7fc678009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:44.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.900+0000 7fc6727fc700 1 -- 172.21.15.72:0/4088404076 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678009390 con 0x7fc6840c5bc0 2023-08-31T19:26:44.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.900+0000 7fc6727fc700 1 -- 172.21.15.72:0/4088404076 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc678012600 con 0x7fc6840c5bc0 2023-08-31T19:26:44.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.900+0000 7fc6727fc700 1 -- 172.21.15.72:0/4088404076 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678012980 con 0x7fc6840c5bc0 2023-08-31T19:26:44.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.900+0000 7fc68359e700 1 -- 172.21.15.72:0/4088404076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68414c7e0 con 0x7fc6840c5bc0 2023-08-31T19:26:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.900+0000 7fc68359e700 1 -- 172.21.15.72:0/4088404076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68414d0b0 con 0x7fc6840c5bc0 2023-08-31T19:26:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.902+0000 7fc68359e700 1 -- 172.21.15.72:0/4088404076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc684157a70 con 0x7fc6840c5bc0 2023-08-31T19:26:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.902+0000 7fc6727fc700 1 -- 172.21.15.72:0/4088404076 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 94) v1 ==== 75431+0+0 (secure 0 0 0) 0x7fc678012d30 con 0x7fc6840c5bc0 2023-08-31T19:26:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.903+0000 7fc6727fc700 1 --2- 172.21.15.72:0/4088404076 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc66405ef90 0x7fc664061450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.903+0000 7fc6727fc700 1 -- 172.21.15.72:0/4088404076 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7fc67807a640 con 0x7fc6840c5bc0 2023-08-31T19:26:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.903+0000 7fc68259c700 1 -- 172.21.15.72:0/4088404076 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc66405ef90 msgr2=0x7fc664061450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:44.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.903+0000 7fc68259c700 1 --2- 172.21.15.72:0/4088404076 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc66405ef90 0x7fc664061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:44.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:44.907+0000 7fc6727fc700 1 -- 172.21.15.72:0/4088404076 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc67804b520 con 0x7fc6840c5bc0 2023-08-31T19:26:44.947 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:44.946+0000 7f2f5cdf7680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:26:45.036 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:45.035+0000 7f2f5cdf7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:26:45.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.104+0000 7fc68259c700 1 -- 172.21.15.72:0/4088404076 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc66405ef90 msgr2=0x7fc664061450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:45.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.104+0000 7fc68259c700 1 --2- 172.21.15.72:0/4088404076 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc66405ef90 0x7fc664061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:26:45.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.124+0000 7fc68359e700 1 -- 172.21.15.72:0/4088404076 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc684047480 con 0x7fc6840c5bc0 2023-08-31T19:26:45.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.125+0000 7fc6727fc700 1 -- 172.21.15.72:0/4088404076 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4499 (secure 0 0 0) 0x7fc67804eb40 con 0x7fc6840c5bc0 2023-08-31T19:26:45.125 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:45.125 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2772120291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2772120291},{"type":"v1","addr":"172.21.15.146:6834","nonce":2772120291}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4204264962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4204264962},{"type":"v1","addr":"172.21.15.72:6836","nonce":4204264962}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9501,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2736058565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2736058565},{"type":"v1","addr":"172.21.15.72:6837","nonce":2736058565}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:26:23.268664+0000","modified":"2023-08-31T19:26:26.278490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9507":{"gid":9507,"name":"b","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3040541253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3040541253},{"type":"v1","addr":"172.21.15.146:6835","nonce":3040541253}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-31T19:26:45.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.127+0000 7fc68359e700 1 -- 172.21.15.72:0/4088404076 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc66405ef90 msgr2=0x7fc664061450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:45.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.127+0000 7fc68359e700 1 --2- 172.21.15.72:0/4088404076 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc66405ef90 0x7fc664061450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:45.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.127+0000 7fc68359e700 1 -- 172.21.15.72:0/4088404076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6840c5bc0 msgr2=0x7fc6841489c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:45.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.127+0000 7fc68359e700 1 --2- 172.21.15.72:0/4088404076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6840c5bc0 0x7fc6841489c0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 rx=0x7fc67800e900 tx=0x7fc678009060).stop 2023-08-31T19:26:45.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.127+0000 7fc68359e700 1 -- 172.21.15.72:0/4088404076 shutdown_connections 2023-08-31T19:26:45.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.127+0000 7fc68359e700 1 --2- 172.21.15.72:0/4088404076 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fc66405ef90 0x7fc664061450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:45.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.127+0000 7fc68359e700 1 --2- 172.21.15.72:0/4088404076 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc68414b000 0x7fc68414bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.127+0000 7fc68359e700 1 --2- 172.21.15.72:0/4088404076 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fc6840bfd50 0x7fc684155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.127+0000 7fc68359e700 1 --2- 172.21.15.72:0/4088404076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6840c5bc0 0x7fc6841489c0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.127+0000 7fc68359e700 1 -- 172.21.15.72:0/4088404076 >> 172.21.15.72:0/4088404076 conn(0x7fc6840cabf0 msgr2=0x7fc684063670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:45.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.127+0000 7fc68359e700 1 -- 172.21.15.72:0/4088404076 shutdown_connections 2023-08-31T19:26:45.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.127+0000 7fc68359e700 1 -- 172.21.15.72:0/4088404076 wait complete. 2023-08-31T19:26:45.130 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 86 2023-08-31T19:26:45.131 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:45.131+0000 7f2f5cdf7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:26:45.133 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:45.133+0000 7ff15d058680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:26:45.145 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:26:45.232 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:45.232+0000 7ff15d058680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:26:45.319 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:45.319+0000 7f2f5cdf7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:26:45.330 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:45.330+0000 7ff15d058680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:26:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.337+0000 7f1b04bff700 1 Processor -- start 2023-08-31T19:26:45.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.337+0000 7f1b04bff700 1 -- start start 2023-08-31T19:26:45.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.338+0000 7f1b04bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b000cb9b0 0x7f1b001583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:45.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.338+0000 7f1b04bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b001588d0 0x7f1b00154440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:45.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.338+0000 7f1b04bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b000c6120 con 0x7f1b00154060 2023-08-31T19:26:45.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.338+0000 7f1b04bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b000c1380 con 0x7f1b000cb9b0 2023-08-31T19:26:45.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.338+0000 7f1b04bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b000c5e10 con 0x7f1b001588d0 2023-08-31T19:26:45.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.339+0000 7f1afdd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b000cb9b0 0x7f1b001583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:45.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.339+0000 7f1afdd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b000cb9b0 0x7f1b001583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43874/0 (socket says 172.21.15.72:43874) 2023-08-31T19:26:45.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.339+0000 7f1afdd9b700 1 -- 172.21.15.72:0/515413055 learned_addr learned my addr 172.21.15.72:0/515413055 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:45.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.339+0000 7f1afed9d700 1 --2- 172.21.15.72:0/515413055 >> v2:172.21.15.146:3300/0 conn(0x7f1b001588d0 0x7f1b00154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:45.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.339+0000 7f1afdd9b700 1 -- 172.21.15.72:0/515413055 >> v2:172.21.15.146:3300/0 conn(0x7f1b001588d0 msgr2=0x7f1b00154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:45.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.339+0000 7f1afdd9b700 1 --2- 172.21.15.72:0/515413055 >> v2:172.21.15.146:3300/0 conn(0x7f1b001588d0 0x7f1b00154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.339+0000 7f1afdd9b700 1 -- 172.21.15.72:0/515413055 >> v1:172.21.15.146:6789/0 conn(0x7f1b00154060 legacy=0x7f1b00157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:45.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.339+0000 7f1afdd9b700 1 -- 172.21.15.72:0/515413055 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b000c0ae0 con 0x7f1b000cb9b0 2023-08-31T19:26:45.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.339+0000 7f1afdd9b700 1 --2- 172.21.15.72:0/515413055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b000cb9b0 0x7f1b001583e0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7f1b000844d0 tx=0x7f1af40090f0).ready entity=mon.0 client_cookie=2d96f518ed0f564a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:45.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.340+0000 7f1afd59a700 1 -- 172.21.15.72:0/515413055 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af400b520 con 0x7f1b000cb9b0 2023-08-31T19:26:45.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.340+0000 7f1afd59a700 1 -- 172.21.15.72:0/515413055 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af400b680 con 0x7f1b000cb9b0 2023-08-31T19:26:45.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.340+0000 7f1afd59a700 1 -- 172.21.15.72:0/515413055 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af400ba00 con 0x7f1b000cb9b0 2023-08-31T19:26:45.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.340+0000 7f1b04bff700 1 -- 172.21.15.72:0/515413055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b000cb9b0 msgr2=0x7f1b001583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:45.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.340+0000 7f1b04bff700 1 --2- 172.21.15.72:0/515413055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b000cb9b0 0x7f1b001583e0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7f1b000844d0 tx=0x7f1af40090f0).stop 2023-08-31T19:26:45.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.340+0000 7f1b04bff700 1 -- 172.21.15.72:0/515413055 shutdown_connections 2023-08-31T19:26:45.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.340+0000 7f1b04bff700 1 --2- 172.21.15.72:0/515413055 >> v2:172.21.15.146:3300/0 conn(0x7f1b001588d0 0x7f1b00154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.340+0000 7f1b04bff700 1 --2- 172.21.15.72:0/515413055 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b000cb9b0 0x7f1b001583e0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.340+0000 7f1b04bff700 1 -- 172.21.15.72:0/515413055 >> 172.21.15.72:0/515413055 conn(0x7f1b0005e870 msgr2=0x7f1b000cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:45.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.340+0000 7f1b04bff700 1 -- 172.21.15.72:0/515413055 shutdown_connections 2023-08-31T19:26:45.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.341+0000 7f1b04bff700 1 -- 172.21.15.72:0/515413055 wait complete. 2023-08-31T19:26:45.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.342+0000 7f1b04bff700 1 Processor -- start 2023-08-31T19:26:45.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.342+0000 7f1b04bff700 1 -- start start 2023-08-31T19:26:45.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.343+0000 7f1b04bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b000cb9b0 0x7f1b001517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:45.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.343+0000 7f1b04bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b00154060 0x7f1b0014b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:45.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.343+0000 7f1b04bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b001588d0 0x7f1b0014fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:45.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.343+0000 7f1b04bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000b0d00 con 0x7f1b001588d0 2023-08-31T19:26:45.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.343+0000 7f1b04bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b00150200 con 0x7f1b00154060 2023-08-31T19:26:45.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.343+0000 7f1b04bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b00150d80 con 0x7f1b000cb9b0 2023-08-31T19:26:45.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.343+0000 7f1afed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b001588d0 0x7f1b0014fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:45.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.343+0000 7f1afed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b001588d0 0x7f1b0014fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43880/0 (socket says 172.21.15.72:43880) 2023-08-31T19:26:45.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.343+0000 7f1afed9d700 1 -- 172.21.15.72:0/1998766459 learned_addr learned my addr 172.21.15.72:0/1998766459 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:45.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.343+0000 7f1afe59c700 1 --2- 172.21.15.72:0/1998766459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b000cb9b0 0x7f1b001517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:45.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.344+0000 7f1afdd9b700 1 --2- 172.21.15.72:0/1998766459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b00154060 0x7f1b0014b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:45.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.344+0000 7f1afdd9b700 1 -- 172.21.15.72:0/1998766459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b000cb9b0 msgr2=0x7f1b001517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:45.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.344+0000 7f1afdd9b700 1 --2- 172.21.15.72:0/1998766459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b000cb9b0 0x7f1b001517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.344+0000 7f1afdd9b700 1 -- 172.21.15.72:0/1998766459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b001588d0 msgr2=0x7f1b0014fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:45.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.344+0000 7f1afdd9b700 1 --2- 172.21.15.72:0/1998766459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b001588d0 0x7f1b0014fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.344+0000 7f1afdd9b700 1 -- 172.21.15.72:0/1998766459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af4009370 con 0x7f1b00154060 2023-08-31T19:26:45.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.344+0000 7f1afed9d700 1 --2- 172.21.15.72:0/1998766459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b001588d0 0x7f1b0014fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:45.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.344+0000 7f1afdd9b700 1 --2- 172.21.15.72:0/1998766459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b00154060 0x7f1b0014b190 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f1af4014000 tx=0x7f1af4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:45.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.344+0000 7f1aee7fc700 1 -- 172.21.15.72:0/1998766459 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4006d90 con 0x7f1b00154060 2023-08-31T19:26:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.344+0000 7f1aee7fc700 1 -- 172.21.15.72:0/1998766459 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af4000bc0 con 0x7f1b00154060 2023-08-31T19:26:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.345+0000 7f1b04bff700 1 -- 172.21.15.72:0/1998766459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0014bfc0 con 0x7f1b00154060 2023-08-31T19:26:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.345+0000 7f1aee7fc700 1 -- 172.21.15.72:0/1998766459 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af401b410 con 0x7f1b00154060 2023-08-31T19:26:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.345+0000 7f1b04bff700 1 -- 172.21.15.72:0/1998766459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b00150730 con 0x7f1b00154060 2023-08-31T19:26:45.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.346+0000 7f1b04bff700 1 -- 172.21.15.72:0/1998766459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0006c6b0 con 0x7f1b00154060 2023-08-31T19:26:45.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.346+0000 7f1aee7fc700 1 -- 172.21.15.72:0/1998766459 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 94) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f1af401b780 con 0x7f1b00154060 2023-08-31T19:26:45.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.347+0000 7f1aee7fc700 1 --2- 172.21.15.72:0/1998766459 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1ae005efc0 0x7f1ae0061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:45.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.347+0000 7f1aee7fc700 1 -- 172.21.15.72:0/1998766459 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f1af407be30 con 0x7f1b00154060 2023-08-31T19:26:45.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.347+0000 7f1afe59c700 1 -- 172.21.15.72:0/1998766459 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1ae005efc0 msgr2=0x7f1ae0061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:45.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.347+0000 7f1afe59c700 1 --2- 172.21.15.72:0/1998766459 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1ae005efc0 0x7f1ae0061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:45.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.351+0000 7f1aee7fc700 1 -- 172.21.15.72:0/1998766459 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1af404cbb0 con 0x7f1b00154060 2023-08-31T19:26:45.410 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:45.410+0000 7f2f5cdf7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:26:45.526 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:45.526+0000 7ff15d058680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:26:45.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.548+0000 7f1afe59c700 1 -- 172.21.15.72:0/1998766459 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1ae005efc0 msgr2=0x7f1ae0061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:45.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.548+0000 7f1afe59c700 1 --2- 172.21.15.72:0/1998766459 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1ae005efc0 0x7f1ae0061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2023-08-31T19:26:45.555 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:45.555+0000 7f2f5cdf7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:26:45.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.570+0000 7f1b04bff700 1 -- 172.21.15.72:0/1998766459 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b001512e0 con 0x7f1b00154060 2023-08-31T19:26:45.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.570+0000 7f1aee7fc700 1 -- 172.21.15.72:0/1998766459 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f1b001512e0 con 0x7f1b00154060 2023-08-31T19:26:45.571 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:45.571 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2772120291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2772120291},{"type":"v1","addr":"172.21.15.146:6834","nonce":2772120291}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4204264962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4204264962},{"type":"v1","addr":"172.21.15.72:6836","nonce":4204264962}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9501,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2736058565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2736058565},{"type":"v1","addr":"172.21.15.72:6837","nonce":2736058565}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:26:23.268664+0000","modified":"2023-08-31T19:26:26.278490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9507":{"gid":9507,"name":"b","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/3040541253","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":3040541253},{"type":"v1","addr":"172.21.15.146:6835","nonce":3040541253}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-31T19:26:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.573+0000 7f1b04bff700 1 -- 172.21.15.72:0/1998766459 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1ae005efc0 msgr2=0x7f1ae0061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:45.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.573+0000 7f1b04bff700 1 --2- 172.21.15.72:0/1998766459 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1ae005efc0 0x7f1ae0061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:45.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.573+0000 7f1b04bff700 1 -- 172.21.15.72:0/1998766459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b00154060 msgr2=0x7f1b0014b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:45.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.573+0000 7f1b04bff700 1 --2- 172.21.15.72:0/1998766459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b00154060 0x7f1b0014b190 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f1af4014000 tx=0x7f1af4017000).stop 2023-08-31T19:26:45.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.573+0000 7f1b04bff700 1 -- 172.21.15.72:0/1998766459 shutdown_connections 2023-08-31T19:26:45.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.573+0000 7f1b04bff700 1 --2- 172.21.15.72:0/1998766459 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f1ae005efc0 0x7f1ae0061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:45.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.573+0000 7f1b04bff700 1 --2- 172.21.15.72:0/1998766459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b001588d0 0x7f1b0014fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.573+0000 7f1b04bff700 1 --2- 172.21.15.72:0/1998766459 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f1b000cb9b0 0x7f1b001517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.573+0000 7f1b04bff700 1 --2- 172.21.15.72:0/1998766459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b00154060 0x7f1b0014b190 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.573+0000 7f1b04bff700 1 -- 172.21.15.72:0/1998766459 >> 172.21.15.72:0/1998766459 conn(0x7f1b0005e870 msgr2=0x7f1b000c6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:45.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.573+0000 7f1b04bff700 1 -- 172.21.15.72:0/1998766459 shutdown_connections 2023-08-31T19:26:45.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.573+0000 7f1b04bff700 1 -- 172.21.15.72:0/1998766459 wait complete. 2023-08-31T19:26:45.576 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 86 2023-08-31T19:26:45.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:26:45.624 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:45.623+0000 7ff15d058680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:26:45.688 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:45.688+0000 7f2f5cdf7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:26:45.775 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:45.775+0000 7ff15d058680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:26:45.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.783+0000 7f860d9ff700 1 Processor -- start 2023-08-31T19:26:45.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.784+0000 7f860d9ff700 1 -- start start 2023-08-31T19:26:45.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.785+0000 7f860d9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8608154220 0x7f8608157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:45.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.785+0000 7f860d9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86080cb940 0x7f86081581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:45.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.785+0000 7f860d9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86080c8c90 con 0x7f86081586b0 2023-08-31T19:26:45.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.785+0000 7f860d9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86080aa700 con 0x7f86080cb940 2023-08-31T19:26:45.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.785+0000 7f860d9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86080c5e10 con 0x7f8608154220 2023-08-31T19:26:45.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.785+0000 7f86067fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86080cb940 0x7f86081581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:45.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.785+0000 7f86067fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86080cb940 0x7f86081581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43882/0 (socket says 172.21.15.72:43882) 2023-08-31T19:26:45.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.785+0000 7f86067fc700 1 -- 172.21.15.72:0/116442518 learned_addr learned my addr 172.21.15.72:0/116442518 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:45.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.785+0000 7f8606ffd700 1 --2- 172.21.15.72:0/116442518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8608154220 0x7f8608157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:45.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.786+0000 7f86067fc700 1 -- 172.21.15.72:0/116442518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8608154220 msgr2=0x7f8608157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:45.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.786+0000 7f86067fc700 1 --2- 172.21.15.72:0/116442518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8608154220 0x7f8608157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.786+0000 7f86067fc700 1 -- 172.21.15.72:0/116442518 >> v1:172.21.15.146:6789/0 conn(0x7f86081586b0 legacy=0x7f8608154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:45.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.786+0000 7f86067fc700 1 -- 172.21.15.72:0/116442518 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86080c0a50 con 0x7f86080cb940 2023-08-31T19:26:45.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.786+0000 7f8605ffb700 1 -- 172.21.15.72:0/116442518 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428561921 0 0) 0x7f86080c8c90 con 0x7f86081586b0 2023-08-31T19:26:45.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.786+0000 7f86067fc700 1 --2- 172.21.15.72:0/116442518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080cb940 0x7f86081581c0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7f85fc009830 tx=0x7f85fc0090f0).ready entity=mon.0 client_cookie=322cae8f5e3e9abf server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:45.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.786+0000 7f8605ffb700 1 -- 172.21.15.72:0/116442518 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc00b580 con 0x7f86080cb940 2023-08-31T19:26:45.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.786+0000 7f8605ffb700 1 -- 172.21.15.72:0/116442518 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc00b6e0 con 0x7f86080cb940 2023-08-31T19:26:45.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.786+0000 7f8605ffb700 1 -- 172.21.15.72:0/116442518 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc00ba60 con 0x7f86080cb940 2023-08-31T19:26:45.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.787+0000 7f860d9ff700 1 -- 172.21.15.72:0/116442518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080cb940 msgr2=0x7f86081581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:45.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.787+0000 7f860d9ff700 1 --2- 172.21.15.72:0/116442518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080cb940 0x7f86081581c0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7f85fc009830 tx=0x7f85fc0090f0).stop 2023-08-31T19:26:45.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.787+0000 7f860d9ff700 1 -- 172.21.15.72:0/116442518 shutdown_connections 2023-08-31T19:26:45.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.787+0000 7f860d9ff700 1 --2- 172.21.15.72:0/116442518 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8608154220 0x7f8608157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.787+0000 7f860d9ff700 1 --2- 172.21.15.72:0/116442518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080cb940 0x7f86081581c0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.787+0000 7f860d9ff700 1 -- 172.21.15.72:0/116442518 >> 172.21.15.72:0/116442518 conn(0x7f860805e870 msgr2=0x7f86080cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:45.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.787+0000 7f860d9ff700 1 -- 172.21.15.72:0/116442518 shutdown_connections 2023-08-31T19:26:45.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.787+0000 7f860d9ff700 1 -- 172.21.15.72:0/116442518 wait complete. 2023-08-31T19:26:45.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.788+0000 7f860d9ff700 1 Processor -- start 2023-08-31T19:26:45.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.788+0000 7f860d9ff700 1 -- start start 2023-08-31T19:26:45.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.789+0000 7f860d9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080cb940 0x7f860813c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:45.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.789+0000 7f860d9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8608154220 0x7f86080aa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:45.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.789+0000 7f860d9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081586b0 0x7f86080aad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:45.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.789+0000 7f860d9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86080ab220 con 0x7f86080cb940 2023-08-31T19:26:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.789+0000 7f860d9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86080c22d0 con 0x7f8608154220 2023-08-31T19:26:45.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.789+0000 7f860d9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86080c2e50 con 0x7f86081586b0 2023-08-31T19:26:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.790+0000 7f8606ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080cb940 0x7f860813c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.790+0000 7f8606ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080cb940 0x7f860813c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43894/0 (socket says 172.21.15.72:43894) 2023-08-31T19:26:45.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.790+0000 7f8606ffd700 1 -- 172.21.15.72:0/3237807847 learned_addr learned my addr 172.21.15.72:0/3237807847 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.790+0000 7f86067fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8608154220 0x7f86080aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.790+0000 7f86077fe700 1 --2- 172.21.15.72:0/3237807847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081586b0 0x7f86080aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:45.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.790+0000 7f8606ffd700 1 -- 172.21.15.72:0/3237807847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081586b0 msgr2=0x7f86080aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.790+0000 7f8606ffd700 1 --2- 172.21.15.72:0/3237807847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081586b0 0x7f86080aad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.790+0000 7f8606ffd700 1 -- 172.21.15.72:0/3237807847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8608154220 msgr2=0x7f86080aa840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:45.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.790+0000 7f8606ffd700 1 --2- 172.21.15.72:0/3237807847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8608154220 0x7f86080aa840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.790+0000 7f8606ffd700 1 -- 172.21.15.72:0/3237807847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc009370 con 0x7f86080cb940 2023-08-31T19:26:45.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.790+0000 7f8606ffd700 1 --2- 172.21.15.72:0/3237807847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080cb940 0x7f860813c780 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f85f800e8d0 tx=0x7f85f8006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.791+0000 7f85eeffd700 1 -- 172.21.15.72:0/3237807847 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8009450 con 0x7f86080cb940 2023-08-31T19:26:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.791+0000 7f85eeffd700 1 -- 172.21.15.72:0/3237807847 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f8012600 con 0x7f86080cb940 2023-08-31T19:26:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.791+0000 7f860d9ff700 1 -- 172.21.15.72:0/3237807847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86080c2520 con 0x7f86080cb940 2023-08-31T19:26:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.791+0000 7f85eeffd700 1 -- 172.21.15.72:0/3237807847 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8012980 con 0x7f86080cb940 2023-08-31T19:26:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.791+0000 7f860d9ff700 1 -- 172.21.15.72:0/3237807847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86080c2ae0 con 0x7f86080cb940 2023-08-31T19:26:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.792+0000 7f860d9ff700 1 -- 172.21.15.72:0/3237807847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86080c3130 con 0x7f86080cb940 2023-08-31T19:26:45.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.793+0000 7f85eeffd700 1 -- 172.21.15.72:0/3237807847 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 94) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f85f801b400 con 0x7f86080cb940 2023-08-31T19:26:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.793+0000 7f85eeffd700 1 --2- 172.21.15.72:0/3237807847 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f85f405efc0 0x7f85f4061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.793+0000 7f85eeffd700 1 -- 172.21.15.72:0/3237807847 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f85f807a7e0 con 0x7f86080cb940 2023-08-31T19:26:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.793+0000 7f86067fc700 1 -- 172.21.15.72:0/3237807847 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f85f405efc0 msgr2=0x7f85f4061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.794+0000 7f86067fc700 1 --2- 172.21.15.72:0/3237807847 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f85f405efc0 0x7f85f4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.797+0000 7f85eeffd700 1 -- 172.21.15.72:0/3237807847 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f85f804b6c0 con 0x7f86080cb940 2023-08-31T19:26:45.917 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:45.916+0000 7ff15d058680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:26:45.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.979+0000 7f860d9ff700 1 -- 172.21.15.72:0/3237807847 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86080c1250 con 0x7f86080cb940 2023-08-31T19:26:45.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.980+0000 7f85eeffd700 1 -- 172.21.15.72:0/3237807847 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+18405 (secure 0 0 0) 0x7f85f8016030 con 0x7f86080cb940 2023-08-31T19:26:45.981 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:45.981 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":196,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:26:37.533844+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:26:21.693921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-31T19:26:22.249227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/3780867317":"2023-09-01T19:26:37.533809+0000","172.21.15.72:6833/189426":"2023-09-01T19:26:37.533809+0000","172.21.15.72:6832/189426":"2023-09-01T19:26:37.533809+0000","172.21.15.72:0/1369089719":"2023-09-01T19:26:37.533809+0000","172.21.15.72:0/3101987496":"2023-09-01T19:26:37.533809+0000","172.21.15.72:0/2121781009":"2023-09-01T19:26:37.533809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:26:45.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.982+0000 7f860d9ff700 1 -- 172.21.15.72:0/3237807847 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f85f405efc0 msgr2=0x7f85f4061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:45.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.982+0000 7f860d9ff700 1 --2- 172.21.15.72:0/3237807847 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f85f405efc0 0x7f85f4061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:45.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.982+0000 7f860d9ff700 1 -- 172.21.15.72:0/3237807847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080cb940 msgr2=0x7f860813c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:45.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.982+0000 7f860d9ff700 1 --2- 172.21.15.72:0/3237807847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080cb940 0x7f860813c780 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 rx=0x7f85f800e8d0 tx=0x7f85f8006f40).stop 2023-08-31T19:26:45.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.982+0000 7f860d9ff700 1 -- 172.21.15.72:0/3237807847 shutdown_connections 2023-08-31T19:26:45.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.982+0000 7f860d9ff700 1 --2- 172.21.15.72:0/3237807847 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f85f405efc0 0x7f85f4061480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:45.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.982+0000 7f860d9ff700 1 --2- 172.21.15.72:0/3237807847 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f86081586b0 0x7f86080aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.982+0000 7f860d9ff700 1 --2- 172.21.15.72:0/3237807847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86080cb940 0x7f860813c780 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.982+0000 7f860d9ff700 1 --2- 172.21.15.72:0/3237807847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8608154220 0x7f86080aa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:45.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.982+0000 7f860d9ff700 1 -- 172.21.15.72:0/3237807847 >> 172.21.15.72:0/3237807847 conn(0x7f860805e870 msgr2=0x7f86080a8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:45.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.983+0000 7f860d9ff700 1 -- 172.21.15.72:0/3237807847 shutdown_connections 2023-08-31T19:26:45.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:45.983+0000 7f860d9ff700 1 -- 172.21.15.72:0/3237807847 wait complete. 2023-08-31T19:26:46.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T19:26:46.038 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:46.037+0000 7f2f5cdf7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:26:46.128 INFO:tasks.ceph.mgr.x.smithi146.stderr:2023-08-31T19:26:46.128+0000 7f2f5cdf7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:26:46.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.240+0000 7f9d5dfff700 1 Processor -- start 2023-08-31T19:26:46.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.240+0000 7f9d5dfff700 1 -- start start 2023-08-31T19:26:46.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.242+0000 7f9d5dfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9d581580c0 0x7f9d580bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:46.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.242+0000 7f9d5dfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d58069410 0x7f9d581584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:46.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.242+0000 7f9d5dfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d58069890 con 0x7f9d58158990 2023-08-31T19:26:46.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.242+0000 7f9d5dfff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d58069ae0 con 0x7f9d581580c0 2023-08-31T19:26:46.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.242+0000 7f9d5dfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58062880 con 0x7f9d58069410 2023-08-31T19:26:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.242+0000 7f9d57fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9d58158990 0x7f9d58153e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55400/0 (socket says 172.21.15.72:55400) 2023-08-31T19:26:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.243+0000 7f9d57fff700 1 -- 172.21.15.72:0/1317196678 learned_addr learned my addr 172.21.15.72:0/1317196678 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.243+0000 7f9d4ffff700 1 --2- 172.21.15.72:0/1317196678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d58069410 0x7f9d581584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.243+0000 7f9d577fe700 1 --2- 172.21.15.72:0/1317196678 >> v2:172.21.15.146:3300/0 conn(0x7f9d581580c0 0x7f9d580bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.243+0000 7f9d56ffd700 1 -- 172.21.15.72:0/1317196678 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940273161 0 0) 0x7f9d58069890 con 0x7f9d58158990 2023-08-31T19:26:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.243+0000 7f9d56ffd700 1 -- 172.21.15.72:0/1317196678 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d440033f0 con 0x7f9d58158990 2023-08-31T19:26:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.243+0000 7f9d4ffff700 1 -- 172.21.15.72:0/1317196678 >> v2:172.21.15.146:3300/0 conn(0x7f9d581580c0 msgr2=0x7f9d580bc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:46.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.243+0000 7f9d4ffff700 1 --2- 172.21.15.72:0/1317196678 >> v2:172.21.15.146:3300/0 conn(0x7f9d581580c0 0x7f9d580bc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:46.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.243+0000 7f9d4ffff700 1 -- 172.21.15.72:0/1317196678 >> v1:172.21.15.72:6789/0 conn(0x7f9d58158990 legacy=0x7f9d58153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:46.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.243+0000 7f9d4ffff700 1 -- 172.21.15.72:0/1317196678 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d58063f50 con 0x7f9d58069410 2023-08-31T19:26:46.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.243+0000 7f9d577fe700 1 --2- 172.21.15.72:0/1317196678 >> v2:172.21.15.146:3300/0 conn(0x7f9d581580c0 0x7f9d580bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:46.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.243+0000 7f9d4ffff700 1 --2- 172.21.15.72:0/1317196678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d58069410 0x7f9d581584a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f9d40009760 tx=0x7f9d40009060).ready entity=mon.2 client_cookie=fb5fef01c10cf090 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.244+0000 7f9d56ffd700 1 -- 172.21.15.72:0/1317196678 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d400090d0 con 0x7f9d58069410 2023-08-31T19:26:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.244+0000 7f9d56ffd700 1 -- 172.21.15.72:0/1317196678 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4000d4a0 con 0x7f9d58069410 2023-08-31T19:26:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.244+0000 7f9d56ffd700 1 -- 172.21.15.72:0/1317196678 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4000d820 con 0x7f9d58069410 2023-08-31T19:26:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.244+0000 7f9d5dfff700 1 -- 172.21.15.72:0/1317196678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d58069410 msgr2=0x7f9d581584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.244+0000 7f9d5dfff700 1 --2- 172.21.15.72:0/1317196678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d58069410 0x7f9d581584a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f9d40009760 tx=0x7f9d40009060).stop 2023-08-31T19:26:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.244+0000 7f9d5dfff700 1 -- 172.21.15.72:0/1317196678 shutdown_connections 2023-08-31T19:26:46.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.244+0000 7f9d5dfff700 1 --2- 172.21.15.72:0/1317196678 >> v2:172.21.15.146:3300/0 conn(0x7f9d581580c0 0x7f9d580bc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:46.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.244+0000 7f9d5dfff700 1 --2- 172.21.15.72:0/1317196678 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d58069410 0x7f9d581584a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:46.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.244+0000 7f9d5dfff700 1 -- 172.21.15.72:0/1317196678 >> 172.21.15.72:0/1317196678 conn(0x7f9d580c73a0 msgr2=0x7f9d580c77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:46.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.244+0000 7f9d5dfff700 1 -- 172.21.15.72:0/1317196678 shutdown_connections 2023-08-31T19:26:46.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.244+0000 7f9d5dfff700 1 -- 172.21.15.72:0/1317196678 wait complete. 2023-08-31T19:26:46.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.246+0000 7f9d5dfff700 1 Processor -- start 2023-08-31T19:26:46.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.246+0000 7f9d5dfff700 1 -- start start 2023-08-31T19:26:46.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.247+0000 7f9d5dfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d58069410 0x7f9d58153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:46.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.247+0000 7f9d5dfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d581580c0 0x7f9d581655e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:46.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.247+0000 7f9d5dfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d58158990 0x7f9d580c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:46.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.247+0000 7f9d5dfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58165ad0 con 0x7f9d581580c0 2023-08-31T19:26:46.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.247+0000 7f9d5dfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580c13d0 con 0x7f9d58069410 2023-08-31T19:26:46.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.247+0000 7f9d5dfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580bebc0 con 0x7f9d58158990 2023-08-31T19:26:46.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.247+0000 7f9d4ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d581580c0 0x7f9d581655e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:46.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.247+0000 7f9d4ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d581580c0 0x7f9d581655e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43908/0 (socket says 172.21.15.72:43908) 2023-08-31T19:26:46.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.247+0000 7f9d4ffff700 1 -- 172.21.15.72:0/1638974112 learned_addr learned my addr 172.21.15.72:0/1638974112 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:46.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.248+0000 7f9d577fe700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d58069410 0x7f9d58153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:46.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.248+0000 7f9d57fff700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d58158990 0x7f9d580c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:46.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.248+0000 7f9d4ffff700 1 -- 172.21.15.72:0/1638974112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d58158990 msgr2=0x7f9d580c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:46.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.248+0000 7f9d4ffff700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d58158990 0x7f9d580c09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:46.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.248+0000 7f9d4ffff700 1 -- 172.21.15.72:0/1638974112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d58069410 msgr2=0x7f9d58153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:46.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.248+0000 7f9d4ffff700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d58069410 0x7f9d58153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:46.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.248+0000 7f9d4ffff700 1 -- 172.21.15.72:0/1638974112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d48009250 con 0x7f9d581580c0 2023-08-31T19:26:46.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.248+0000 7f9d57fff700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d58158990 0x7f9d580c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:46.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.248+0000 7f9d4ffff700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d581580c0 0x7f9d581655e0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7f9d40009d50 tx=0x7f9d40016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:46.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.248+0000 7f9d4f7fe700 1 -- 172.21.15.72:0/1638974112 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40006990 con 0x7f9d581580c0 2023-08-31T19:26:46.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.248+0000 7f9d4f7fe700 1 -- 172.21.15.72:0/1638974112 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d40012a00 con 0x7f9d581580c0 2023-08-31T19:26:46.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.248+0000 7f9d5dfff700 1 -- 172.21.15.72:0/1638974112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d400092a0 con 0x7f9d581580c0 2023-08-31T19:26:46.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.248+0000 7f9d4f7fe700 1 -- 172.21.15.72:0/1638974112 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40012d80 con 0x7f9d581580c0 2023-08-31T19:26:46.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.248+0000 7f9d5dfff700 1 -- 172.21.15.72:0/1638974112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d580c10f0 con 0x7f9d581580c0 2023-08-31T19:26:46.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.250+0000 7f9d5dfff700 1 -- 172.21.15.72:0/1638974112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d580640e0 con 0x7f9d581580c0 2023-08-31T19:26:46.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.250+0000 7f9d4f7fe700 1 -- 172.21.15.72:0/1638974112 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 94) v1 ==== 75431+0+0 (secure 0 0 0) 0x7f9d4001c630 con 0x7f9d581580c0 2023-08-31T19:26:46.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.251+0000 7f9d4f7fe700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f9d3805efc0 0x7f9d38061480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:46.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.251+0000 7f9d4f7fe700 1 -- 172.21.15.72:0/1638974112 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7035+0+0 (secure 0 0 0) 0x7f9d4007b840 con 0x7f9d581580c0 2023-08-31T19:26:46.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.251+0000 7f9d577fe700 1 -- 172.21.15.72:0/1638974112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f9d3805efc0 msgr2=0x7f9d38061480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.72:6832/189426 2023-08-31T19:26:46.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.251+0000 7f9d577fe700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f9d3805efc0 0x7f9d38061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2023-08-31T19:26:46.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.255+0000 7f9d4f7fe700 1 -- 172.21.15.72:0/1638974112 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9d580640e0 con 0x7f9d581580c0 2023-08-31T19:26:46.279 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:46.278+0000 7ff15d058680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:26:46.372 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:46.371+0000 7ff15d058680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:26:46.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.381+0000 7f9d4f7fe700 1 -- 172.21.15.72:0/1638974112 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 95) v1 ==== 75096+0+0 (secure 0 0 0) 0x7f9d40079080 con 0x7f9d581580c0 2023-08-31T19:26:46.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.381+0000 7f9d4f7fe700 1 -- 172.21.15.72:0/1638974112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f9d3805efc0 msgr2=0x7f9d38061480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:26:46.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.381+0000 7f9d4f7fe700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f9d3805efc0 0x7f9d38061480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:46.448 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:46.447+0000 7ff0d8312700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:46.448 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:46.447+0000 7ff0d8312700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:46.448 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:46.447+0000 7ff0d8312700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:46.448 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:46.447+0000 7ff0d8312700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:46.449 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:46.447+0000 7ff0d8312700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:46.449 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:46.449+0000 7ff0d530c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:46.449 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:46.449+0000 7ff0d530c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:46.450 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:46.449+0000 7ff0d530c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:46.450 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:46.449+0000 7ff0d530c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:46.450 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-08-31T19:26:46.449+0000 7ff0d530c700 -1 client.0 error registering admin socket command: (17) File exists 2023-08-31T19:26:46.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:46.491+0000 7f9d5dfff700 1 -- 172.21.15.72:0/1638974112 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9d580640e0 con 0x7f9d581580c0 2023-08-31T19:26:47.378 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-08-31T19:26:47.378+0000 7f89d2ff7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T19:26:47.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.384+0000 7f9d4f7fe700 1 -- 172.21.15.72:0/1638974112 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mgrmap(e 96) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f9d40079400 con 0x7f9d581580c0 2023-08-31T19:26:47.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.384+0000 7f9d4f7fe700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f9d3805efc0 0x7f9d38061400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:47.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.386+0000 7f9d577fe700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f9d3805efc0 0x7f9d38061400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:47.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.387+0000 7f9d577fe700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f9d3805efc0 0x7f9d38061400 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f9d48006fd0 tx=0x7f9d48008040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:47.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.395+0000 7f9d4f7fe700 1 -- 172.21.15.72:0/1638974112 <== mon.0 v2:172.21.15.72:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9d4004d6d0 con 0x7f9d581580c0 2023-08-31T19:26:47.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.398+0000 7f9d5dfff700 1 -- 172.21.15.72:0/1638974112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f9d3805efc0 msgr2=0x7f9d38061400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:47.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.398+0000 7f9d5dfff700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f9d3805efc0 0x7f9d38061400 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f9d48006fd0 tx=0x7f9d48008040).stop 2023-08-31T19:26:47.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.398+0000 7f9d5dfff700 1 -- 172.21.15.72:0/1638974112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d581580c0 msgr2=0x7f9d581655e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:47.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.398+0000 7f9d5dfff700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d581580c0 0x7f9d581655e0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7f9d40009d50 tx=0x7f9d40016000).stop 2023-08-31T19:26:47.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.398+0000 7f9d5dfff700 1 -- 172.21.15.72:0/1638974112 shutdown_connections 2023-08-31T19:26:47.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.398+0000 7f9d5dfff700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f9d3805efc0 0x7f9d38061400 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:47.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.398+0000 7f9d5dfff700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f9d58158990 0x7f9d580c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:47.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.398+0000 7f9d5dfff700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d58069410 0x7f9d58153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:47.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.398+0000 7f9d5dfff700 1 --2- 172.21.15.72:0/1638974112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d581580c0 0x7f9d581655e0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:47.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.398+0000 7f9d5dfff700 1 -- 172.21.15.72:0/1638974112 >> 172.21.15.72:0/1638974112 conn(0x7f9d580c73a0 msgr2=0x7f9d58064a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.398+0000 7f9d5dfff700 1 -- 172.21.15.72:0/1638974112 shutdown_connections 2023-08-31T19:26:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.398+0000 7f9d5dfff700 1 -- 172.21.15.72:0/1638974112 wait complete. 2023-08-31T19:26:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T19:26:47.402 INFO:tasks.ceph.mds.b.smithi146.stderr: -2830> 2023-08-31T19:26:28.789+0000 7fed391f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:26:47.417 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T19:26:47.444 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2023-08-31T19:26:47.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.609+0000 7ff4d2dff700 1 Processor -- start 2023-08-31T19:26:47.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.609+0000 7ff4d2dff700 1 -- start start 2023-08-31T19:26:47.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.610+0000 7ff4d2dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4cc154410 0x7ff4cc0c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:47.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.611+0000 7ff4d2dff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4cc0c6ed0 con 0x7ff4cc0c7360 2023-08-31T19:26:47.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.611+0000 7ff4d2dff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4cc0c68c0 con 0x7ff4cc154030 2023-08-31T19:26:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.611+0000 7ff4d2dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4cc0c66e0 con 0x7ff4cc154410 2023-08-31T19:26:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.611+0000 7ff4d139c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff4cc0c7360 0x7ff4cc063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55410/0 (socket says 172.21.15.72:55410) 2023-08-31T19:26:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.611+0000 7ff4c3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4cc154410 0x7ff4cc0c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.611+0000 7ff4d139c700 1 -- 172.21.15.72:0/2888407825 learned_addr learned my addr 172.21.15.72:0/2888407825 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.611+0000 7ff4c37fe700 1 -- 172.21.15.72:0/2888407825 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280822293 0 0) 0x7ff4cc0c6ed0 con 0x7ff4cc0c7360 2023-08-31T19:26:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.611+0000 7ff4c37fe700 1 -- 172.21.15.72:0/2888407825 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b40033f0 con 0x7ff4cc0c7360 2023-08-31T19:26:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.611+0000 7ff4c3fff700 1 -- 172.21.15.72:0/2888407825 >> v1:172.21.15.146:6789/0 conn(0x7ff4cc154030 legacy=0x7ff4cc0aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.611+0000 7ff4c37fe700 1 -- 172.21.15.72:0/2888407825 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414063244 0 0) 0x7ff4cc0c68c0 con 0x7ff4cc154030 2023-08-31T19:26:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.611+0000 7ff4c3fff700 1 -- 172.21.15.72:0/2888407825 >> v1:172.21.15.72:6789/0 conn(0x7ff4cc0c7360 legacy=0x7ff4cc063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.611+0000 7ff4c3fff700 1 -- 172.21.15.72:0/2888407825 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc0c0f30 con 0x7ff4cc154410 2023-08-31T19:26:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.612+0000 7ff4c3fff700 1 --2- 172.21.15.72:0/2888407825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4cc154410 0x7ff4cc0c06b0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7ff4bc009760 tx=0x7ff4bc009060).ready entity=mon.0 client_cookie=34d4c59d26a12fdf server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.612+0000 7ff4c37fe700 1 -- 172.21.15.72:0/2888407825 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc0090d0 con 0x7ff4cc154410 2023-08-31T19:26:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.612+0000 7ff4c37fe700 1 -- 172.21.15.72:0/2888407825 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc00f510 con 0x7ff4cc154410 2023-08-31T19:26:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.612+0000 7ff4c37fe700 1 -- 172.21.15.72:0/2888407825 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc00f890 con 0x7ff4cc154410 2023-08-31T19:26:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.612+0000 7ff4d2dff700 1 -- 172.21.15.72:0/2888407825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4cc154410 msgr2=0x7ff4cc0c06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.612+0000 7ff4d2dff700 1 --2- 172.21.15.72:0/2888407825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4cc154410 0x7ff4cc0c06b0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7ff4bc009760 tx=0x7ff4bc009060).stop 2023-08-31T19:26:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.612+0000 7ff4d2dff700 1 -- 172.21.15.72:0/2888407825 shutdown_connections 2023-08-31T19:26:47.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.612+0000 7ff4d2dff700 1 --2- 172.21.15.72:0/2888407825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4cc154410 0x7ff4cc0c06b0 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:47.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.612+0000 7ff4d2dff700 1 -- 172.21.15.72:0/2888407825 >> 172.21.15.72:0/2888407825 conn(0x7ff4cc05eb60 msgr2=0x7ff4cc0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:47.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.612+0000 7ff4d2dff700 1 -- 172.21.15.72:0/2888407825 shutdown_connections 2023-08-31T19:26:47.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.612+0000 7ff4d2dff700 1 -- 172.21.15.72:0/2888407825 wait complete. 2023-08-31T19:26:47.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.614+0000 7ff4d2dff700 1 Processor -- start 2023-08-31T19:26:47.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.615+0000 7ff4d2dff700 1 -- start start 2023-08-31T19:26:47.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.616+0000 7ff4d2dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4cc0c7360 0x7ff4cc0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:47.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.616+0000 7ff4d2dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4cc154030 0x7ff4cc0b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:47.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.616+0000 7ff4d2dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4cc154410 0x7ff4cc0b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:47.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.616+0000 7ff4d2dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc0af7c0 con 0x7ff4cc0c7360 2023-08-31T19:26:47.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.616+0000 7ff4d2dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc14dd30 con 0x7ff4cc154410 2023-08-31T19:26:47.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.616+0000 7ff4d2dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc0c3b80 con 0x7ff4cc154030 2023-08-31T19:26:47.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.616+0000 7ff4d0b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4cc0c7360 0x7ff4cc0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:47.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.616+0000 7ff4d0b9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4cc0c7360 0x7ff4cc0add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43990/0 (socket says 172.21.15.72:43990) 2023-08-31T19:26:47.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.616+0000 7ff4d0b9b700 1 -- 172.21.15.72:0/4188758980 learned_addr learned my addr 172.21.15.72:0/4188758980 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:47.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.616+0000 7ff4c3fff700 1 --2- 172.21.15.72:0/4188758980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4cc154030 0x7ff4cc0b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:47.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.616+0000 7ff4d139c700 1 --2- 172.21.15.72:0/4188758980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4cc154410 0x7ff4cc0b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:47.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.617+0000 7ff4d0b9b700 1 -- 172.21.15.72:0/4188758980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4cc154030 msgr2=0x7ff4cc0b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:47.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.617+0000 7ff4d0b9b700 1 --2- 172.21.15.72:0/4188758980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4cc154030 0x7ff4cc0b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:47.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.617+0000 7ff4d0b9b700 1 -- 172.21.15.72:0/4188758980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4cc154410 msgr2=0x7ff4cc0b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:47.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.617+0000 7ff4d0b9b700 1 --2- 172.21.15.72:0/4188758980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4cc154410 0x7ff4cc0b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:47.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.617+0000 7ff4d0b9b700 1 -- 172.21.15.72:0/4188758980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc0092a0 con 0x7ff4cc0c7360 2023-08-31T19:26:47.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.617+0000 7ff4d0b9b700 1 --2- 172.21.15.72:0/4188758980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4cc0c7360 0x7ff4cc0add80 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7ff4c800c4e0 tx=0x7ff4c8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:47.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.617+0000 7ff4c0ff9700 1 -- 172.21.15.72:0/4188758980 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c800ce50 con 0x7ff4cc0c7360 2023-08-31T19:26:47.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.617+0000 7ff4c0ff9700 1 -- 172.21.15.72:0/4188758980 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c800f470 con 0x7ff4cc0c7360 2023-08-31T19:26:47.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.617+0000 7ff4c0ff9700 1 -- 172.21.15.72:0/4188758980 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c800f830 con 0x7ff4cc0c7360 2023-08-31T19:26:47.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.617+0000 7ff4d2dff700 1 -- 172.21.15.72:0/4188758980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4cc0c4010 con 0x7ff4cc0c7360 2023-08-31T19:26:47.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.617+0000 7ff4d2dff700 1 -- 172.21.15.72:0/4188758980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4cc0aece0 con 0x7ff4cc0c7360 2023-08-31T19:26:47.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.618+0000 7ff4d2dff700 1 -- 172.21.15.72:0/4188758980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4cc0c3e60 con 0x7ff4cc0c7360 2023-08-31T19:26:47.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.619+0000 7ff4c0ff9700 1 -- 172.21.15.72:0/4188758980 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 96) v1 ==== 75166+0+0 (secure 0 0 0) 0x7ff4c800fba0 con 0x7ff4cc0c7360 2023-08-31T19:26:47.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.620+0000 7ff4c0ff9700 1 --2- 172.21.15.72:0/4188758980 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ff4b805ecf0 0x7ff4b80611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:47.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.620+0000 7ff4c0ff9700 1 -- 172.21.15.72:0/4188758980 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 7336+0+0 (secure 0 0 0) 0x7ff4c8079470 con 0x7ff4cc0c7360 2023-08-31T19:26:47.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.620+0000 7ff4c3fff700 1 --2- 172.21.15.72:0/4188758980 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ff4b805ecf0 0x7ff4b80611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:47.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.621+0000 7ff4c3fff700 1 --2- 172.21.15.72:0/4188758980 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ff4b805ecf0 0x7ff4b80611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff4cc153a90 tx=0x7ff4bc017000).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:47.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.624+0000 7ff4c0ff9700 1 -- 172.21.15.72:0/4188758980 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff4c80488f0 con 0x7ff4cc0c7360 2023-08-31T19:26:47.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:47.833+0000 7ff4d2dff700 1 -- 172.21.15.72:0/4188758980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff4cc06c6b0 con 0x7ff4cc0c7360 2023-08-31T19:26:48.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.401+0000 7ff4c0ff9700 1 -- 172.21.15.72:0/4188758980 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v88) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff4c804a6a0 con 0x7ff4cc0c7360 2023-08-31T19:26:48.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.404+0000 7ff4d2dff700 1 -- 172.21.15.72:0/4188758980 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ff4b805ecf0 msgr2=0x7ff4b80611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.404+0000 7ff4d2dff700 1 --2- 172.21.15.72:0/4188758980 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ff4b805ecf0 0x7ff4b80611b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff4cc153a90 tx=0x7ff4bc017000).stop 2023-08-31T19:26:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.404+0000 7ff4d2dff700 1 -- 172.21.15.72:0/4188758980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4cc0c7360 msgr2=0x7ff4cc0add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.404+0000 7ff4d2dff700 1 --2- 172.21.15.72:0/4188758980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4cc0c7360 0x7ff4cc0add80 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7ff4c800c4e0 tx=0x7ff4c8007c70).stop 2023-08-31T19:26:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.404+0000 7ff4d2dff700 1 -- 172.21.15.72:0/4188758980 shutdown_connections 2023-08-31T19:26:48.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.404+0000 7ff4d2dff700 1 --2- 172.21.15.72:0/4188758980 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7ff4b805ecf0 0x7ff4b80611b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:48.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.404+0000 7ff4d2dff700 1 --2- 172.21.15.72:0/4188758980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4cc154410 0x7ff4cc0b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:48.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.404+0000 7ff4d2dff700 1 --2- 172.21.15.72:0/4188758980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4cc0c7360 0x7ff4cc0add80 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:48.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.404+0000 7ff4d2dff700 1 --2- 172.21.15.72:0/4188758980 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7ff4cc154030 0x7ff4cc0b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:48.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.404+0000 7ff4d2dff700 1 -- 172.21.15.72:0/4188758980 >> 172.21.15.72:0/4188758980 conn(0x7ff4cc05eb60 msgr2=0x7ff4cc14f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:48.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.404+0000 7ff4d2dff700 1 -- 172.21.15.72:0/4188758980 shutdown_connections 2023-08-31T19:26:48.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.404+0000 7ff4d2dff700 1 -- 172.21.15.72:0/4188758980 wait complete. 2023-08-31T19:26:48.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T19:26:48.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.616+0000 7f5c4bfff700 1 Processor -- start 2023-08-31T19:26:48.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.617+0000 7f5c4bfff700 1 -- start start 2023-08-31T19:26:48.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.619+0000 7f5c4bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5c4c0634d0 0x7f5c4c0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:48.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.619+0000 7f5c4bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4c0a9f80 0x7f5c4c0aac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:48.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.619+0000 7f5c4bfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4c0aa3d0 con 0x7f5c4c153de0 2023-08-31T19:26:48.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.619+0000 7f5c4bfff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c9a10 con 0x7f5c4c0634d0 2023-08-31T19:26:48.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.619+0000 7f5c4bfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c9cf0 con 0x7f5c4c0a9f80 2023-08-31T19:26:48.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.619+0000 7f5c4affd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5c4c153de0 0x7f5c4c062dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55420/0 (socket says 172.21.15.72:55420) 2023-08-31T19:26:48.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.619+0000 7f5c4affd700 1 -- 172.21.15.72:0/811910506 learned_addr learned my addr 172.21.15.72:0/811910506 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:48.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.619+0000 7f5c4a7fc700 1 --2- 172.21.15.72:0/811910506 >> v2:172.21.15.146:3300/0 conn(0x7f5c4c0634d0 0x7f5c4c0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:48.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.619+0000 7f5c49ffb700 1 -- 172.21.15.72:0/811910506 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108379376 0 0) 0x7f5c4c0aa3d0 con 0x7f5c4c153de0 2023-08-31T19:26:48.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.619+0000 7f5c4b7fe700 1 --2- 172.21.15.72:0/811910506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4c0a9f80 0x7f5c4c0aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:48.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.619+0000 7f5c49ffb700 1 -- 172.21.15.72:0/811910506 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c340033f0 con 0x7f5c4c153de0 2023-08-31T19:26:48.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c49ffb700 1 -- 172.21.15.72:0/811910506 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2276099582 0 0) 0x7f5c340033f0 con 0x7f5c4c153de0 2023-08-31T19:26:48.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c49ffb700 1 -- 172.21.15.72:0/811910506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4c0a9f80 msgr2=0x7f5c4c0aac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:48.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c49ffb700 1 --2- 172.21.15.72:0/811910506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4c0a9f80 0x7f5c4c0aac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:48.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c49ffb700 1 -- 172.21.15.72:0/811910506 >> v2:172.21.15.146:3300/0 conn(0x7f5c4c0634d0 msgr2=0x7f5c4c0c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:48.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c49ffb700 1 --2- 172.21.15.72:0/811910506 >> v2:172.21.15.146:3300/0 conn(0x7f5c4c0634d0 0x7f5c4c0c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:48.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c49ffb700 1 -- 172.21.15.72:0/811910506 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c0c9fd0 con 0x7f5c4c153de0 2023-08-31T19:26:48.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c49ffb700 1 -- 172.21.15.72:0/811910506 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f5c3c001470 con 0x7f5c4c153de0 2023-08-31T19:26:48.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c49ffb700 1 -- 172.21.15.72:0/811910506 >> v1:172.21.15.72:6789/0 conn(0x7f5c4c153de0 legacy=0x7f5c4c062dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:48.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c49ffb700 1 --2- 172.21.15.72:0/811910506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4c0a9f80 0x7f5c340038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:48.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c49ffb700 1 --2- 172.21.15.72:0/811910506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c34003e10 0x7f5c34004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:48.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c49ffb700 1 --2- 172.21.15.72:0/811910506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c34004b80 0x7f5c34005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:48.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c49ffb700 1 -- 172.21.15.72:0/811910506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c9a10 con 0x7f5c34003e10 2023-08-31T19:26:48.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c49ffb700 1 -- 172.21.15.72:0/811910506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c9cf0 con 0x7f5c34004b80 2023-08-31T19:26:48.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c49ffb700 1 -- 172.21.15.72:0/811910506 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3400b8e0 con 0x7f5c4c0a9f80 2023-08-31T19:26:48.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c4a7fc700 1 --2- 172.21.15.72:0/811910506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c34003e10 0x7f5c34004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:48.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c4affd700 1 --2- 172.21.15.72:0/811910506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4c0a9f80 0x7f5c340038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:48.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c4b7fe700 1 --2- 172.21.15.72:0/811910506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c34004b80 0x7f5c34005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:48.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c4a7fc700 1 -- 172.21.15.72:0/811910506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4c0a9f80 msgr2=0x7f5c340038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:48.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c4a7fc700 1 --2- 172.21.15.72:0/811910506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4c0a9f80 0x7f5c340038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:48.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c4a7fc700 1 -- 172.21.15.72:0/811910506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c34004b80 msgr2=0x7f5c34005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:48.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c4a7fc700 1 --2- 172.21.15.72:0/811910506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c34004b80 0x7f5c34005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:48.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c4a7fc700 1 -- 172.21.15.72:0/811910506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c340033f0 con 0x7f5c34003e10 2023-08-31T19:26:48.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.620+0000 7f5c4affd700 1 --2- 172.21.15.72:0/811910506 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4c0a9f80 0x7f5c340038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:48.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.621+0000 7f5c4a7fc700 1 --2- 172.21.15.72:0/811910506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c34003e10 0x7f5c34004690 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f5c40009a80 tx=0x7f5c40009060).ready entity=mon.0 client_cookie=5108f10f002aa4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:48.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.621+0000 7f5c49ffb700 1 -- 172.21.15.72:0/811910506 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c40009430 con 0x7f5c34003e10 2023-08-31T19:26:48.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.621+0000 7f5c49ffb700 1 -- 172.21.15.72:0/811910506 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4000e640 con 0x7f5c34003e10 2023-08-31T19:26:48.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.621+0000 7f5c49ffb700 1 -- 172.21.15.72:0/811910506 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000e9c0 con 0x7f5c34003e10 2023-08-31T19:26:48.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.621+0000 7f5c4bfff700 1 -- 172.21.15.72:0/811910506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c34003e10 msgr2=0x7f5c34004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:48.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.621+0000 7f5c4bfff700 1 --2- 172.21.15.72:0/811910506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c34003e10 0x7f5c34004690 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f5c40009a80 tx=0x7f5c40009060).stop 2023-08-31T19:26:48.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.621+0000 7f5c4b7fe700 1 -- 172.21.15.72:0/811910506 reap_dead start 2023-08-31T19:26:48.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.621+0000 7f5c4bfff700 1 -- 172.21.15.72:0/811910506 shutdown_connections 2023-08-31T19:26:48.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.621+0000 7f5c4bfff700 1 -- 172.21.15.72:0/811910506 >> 172.21.15.72:0/811910506 conn(0x7f5c4c05eb60 msgr2=0x7f5c4c0cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:48.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.621+0000 7f5c4bfff700 1 -- 172.21.15.72:0/811910506 shutdown_connections 2023-08-31T19:26:48.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.621+0000 7f5c4bfff700 1 -- 172.21.15.72:0/811910506 wait complete. 2023-08-31T19:26:48.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.623+0000 7f5c4bfff700 1 Processor -- start 2023-08-31T19:26:48.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.623+0000 7f5c4bfff700 1 -- start start 2023-08-31T19:26:48.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.624+0000 7f5c4bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c34003e10 0x7f5c4c13f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:48.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.624+0000 7f5c4bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c4c0abb90 0x7f5c4c0ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:48.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.624+0000 7f5c4bfff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4c0afb80 0x7f5c4c0affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:48.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.624+0000 7f5c4bfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0ad240 con 0x7f5c4c0abb90 2023-08-31T19:26:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.624+0000 7f5c4bfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0c2cb0 con 0x7f5c34003e10 2023-08-31T19:26:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.624+0000 7f5c4bfff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0ac500 con 0x7f5c4c0afb80 2023-08-31T19:26:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.624+0000 7f5c4a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c4c0abb90 0x7f5c4c0ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.624+0000 7f5c4a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c4c0abb90 0x7f5c4c0ac010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44000/0 (socket says 172.21.15.72:44000) 2023-08-31T19:26:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.624+0000 7f5c4a7fc700 1 -- 172.21.15.72:0/4130919381 learned_addr learned my addr 172.21.15.72:0/4130919381 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:48.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.624+0000 7f5c4affd700 1 --2- 172.21.15.72:0/4130919381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c34003e10 0x7f5c4c13f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:48.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.624+0000 7f5c4b7fe700 1 --2- 172.21.15.72:0/4130919381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4c0afb80 0x7f5c4c0affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:48.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.625+0000 7f5c4a7fc700 1 -- 172.21.15.72:0/4130919381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4c0afb80 msgr2=0x7f5c4c0affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:48.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.625+0000 7f5c4a7fc700 1 --2- 172.21.15.72:0/4130919381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4c0afb80 0x7f5c4c0affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:48.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.625+0000 7f5c4a7fc700 1 -- 172.21.15.72:0/4130919381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c34003e10 msgr2=0x7f5c4c13f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:48.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.625+0000 7f5c4a7fc700 1 --2- 172.21.15.72:0/4130919381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c34003e10 0x7f5c4c13f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:48.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.625+0000 7f5c4a7fc700 1 -- 172.21.15.72:0/4130919381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c0b0800 con 0x7f5c4c0abb90 2023-08-31T19:26:48.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.625+0000 7f5c4a7fc700 1 --2- 172.21.15.72:0/4130919381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c4c0abb90 0x7f5c4c0ac010 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7f5c4000e4b0 tx=0x7f5c4001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:48.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.625+0000 7f5c32ffd700 1 -- 172.21.15.72:0/4130919381 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c40000be0 con 0x7f5c4c0abb90 2023-08-31T19:26:48.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.625+0000 7f5c32ffd700 1 -- 172.21.15.72:0/4130919381 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4000ed70 con 0x7f5c4c0abb90 2023-08-31T19:26:48.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.625+0000 7f5c32ffd700 1 -- 172.21.15.72:0/4130919381 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000eee0 con 0x7f5c4c0abb90 2023-08-31T19:26:48.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.625+0000 7f5c4bfff700 1 -- 172.21.15.72:0/4130919381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c0b0ae0 con 0x7f5c4c0abb90 2023-08-31T19:26:48.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.625+0000 7f5c4bfff700 1 -- 172.21.15.72:0/4130919381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c0c31e0 con 0x7f5c4c0abb90 2023-08-31T19:26:48.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.626+0000 7f5c4bfff700 1 -- 172.21.15.72:0/4130919381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c0c3550 con 0x7f5c4c0abb90 2023-08-31T19:26:48.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.627+0000 7f5c32ffd700 1 -- 172.21.15.72:0/4130919381 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 96) v1 ==== 75166+0+0 (secure 0 0 0) 0x7f5c4002f440 con 0x7f5c4c0abb90 2023-08-31T19:26:48.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.628+0000 7f5c32ffd700 1 --2- 172.21.15.72:0/4130919381 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5c3805ecc0 0x7f5c38061180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:48.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.628+0000 7f5c32ffd700 1 -- 172.21.15.72:0/4130919381 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 7336+0+0 (secure 0 0 0) 0x7f5c4007bb90 con 0x7f5c4c0abb90 2023-08-31T19:26:48.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.628+0000 7f5c4affd700 1 --2- 172.21.15.72:0/4130919381 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5c3805ecc0 0x7f5c38061180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:48.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.629+0000 7f5c4affd700 1 --2- 172.21.15.72:0/4130919381 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5c3805ecc0 0x7f5c38061180 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5c3c000c40 tx=0x7f5c3c007040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:48.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.633+0000 7f5c32ffd700 1 -- 172.21.15.72:0/4130919381 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5c4004ccb0 con 0x7f5c4c0abb90 2023-08-31T19:26:48.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.803+0000 7f5c4bfff700 1 -- 172.21.15.72:0/4130919381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5c4c047480 con 0x7f5c4c0abb90 2023-08-31T19:26:48.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:48.903+0000 7f5c32ffd700 1 -- 172.21.15.72:0/4130919381 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f5c40079670 con 0x7f5c4c0abb90 2023-08-31T19:26:49.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.404+0000 7f5c32ffd700 1 -- 172.21.15.72:0/4130919381 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v200) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5c40042f10 con 0x7f5c4c0abb90 2023-08-31T19:26:49.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.411+0000 7f5c4bfff700 1 -- 172.21.15.72:0/4130919381 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5c3805ecc0 msgr2=0x7f5c38061180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.411+0000 7f5c4bfff700 1 --2- 172.21.15.72:0/4130919381 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5c3805ecc0 0x7f5c38061180 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5c3c000c40 tx=0x7f5c3c007040).stop 2023-08-31T19:26:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.411+0000 7f5c4bfff700 1 -- 172.21.15.72:0/4130919381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c4c0abb90 msgr2=0x7f5c4c0ac010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.411+0000 7f5c4bfff700 1 --2- 172.21.15.72:0/4130919381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c4c0abb90 0x7f5c4c0ac010 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7f5c4000e4b0 tx=0x7f5c4001a000).stop 2023-08-31T19:26:49.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.411+0000 7f5c4bfff700 1 -- 172.21.15.72:0/4130919381 shutdown_connections 2023-08-31T19:26:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.411+0000 7f5c4bfff700 1 --2- 172.21.15.72:0/4130919381 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f5c3805ecc0 0x7f5c38061180 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0x7f5c3c000c40 tx=0x7f5c3c007040).stop 2023-08-31T19:26:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.411+0000 7f5c4bfff700 1 --2- 172.21.15.72:0/4130919381 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5c4c0afb80 0x7f5c4c0affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.411+0000 7f5c4bfff700 1 --2- 172.21.15.72:0/4130919381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5c34003e10 0x7f5c4c13f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.411+0000 7f5c4bfff700 1 --2- 172.21.15.72:0/4130919381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c4c0abb90 0x7f5c4c0ac010 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.411+0000 7f5c4bfff700 1 -- 172.21.15.72:0/4130919381 >> 172.21.15.72:0/4130919381 conn(0x7f5c4c05eb60 msgr2=0x7f5c4c14d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:49.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.413+0000 7f5c4bfff700 1 -- 172.21.15.72:0/4130919381 shutdown_connections 2023-08-31T19:26:49.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.413+0000 7f5c4bfff700 1 -- 172.21.15.72:0/4130919381 wait complete. 2023-08-31T19:26:49.418 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-08-31T19:26:49.437 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T19:26:49.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.631+0000 7f8af17ff700 1 Processor -- start 2023-08-31T19:26:49.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.631+0000 7f8af17ff700 1 -- start start 2023-08-31T19:26:49.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.633+0000 7f8af17ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8aec157710 0x7f8aec069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:49.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.633+0000 7f8af17ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aec0c2260 con 0x7f8aec068c20 2023-08-31T19:26:49.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.633+0000 7f8af17ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aec062b80 con 0x7f8aec062650 2023-08-31T19:26:49.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.633+0000 7f8af17ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aec062e60 con 0x7f8aec157710 2023-08-31T19:26:49.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.633+0000 7f8aeaffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8aec068c20 0x7f8aec0c1b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55432/0 (socket says 172.21.15.72:55432) 2023-08-31T19:26:49.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.633+0000 7f8aeaffd700 1 -- 172.21.15.72:0/2539338487 learned_addr learned my addr 172.21.15.72:0/2539338487 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:49.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.633+0000 7f8aeb7fe700 1 --2- 172.21.15.72:0/2539338487 >> v2:172.21.15.146:3300/0 conn(0x7f8aec157710 0x7f8aec069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:49.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.633+0000 7f8ae9ffb700 1 -- 172.21.15.72:0/2539338487 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497320952 0 0) 0x7f8aec0c2260 con 0x7f8aec068c20 2023-08-31T19:26:49.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.633+0000 7f8ae9ffb700 1 -- 172.21.15.72:0/2539338487 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ad40033f0 con 0x7f8aec068c20 2023-08-31T19:26:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.633+0000 7f8ae9ffb700 1 -- 172.21.15.72:0/2539338487 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2406268646 0 0) 0x7f8ad40033f0 con 0x7f8aec068c20 2023-08-31T19:26:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.633+0000 7f8ae9ffb700 1 -- 172.21.15.72:0/2539338487 >> v2:172.21.15.146:3300/0 conn(0x7f8aec157710 msgr2=0x7f8aec069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.633+0000 7f8ae9ffb700 1 --2- 172.21.15.72:0/2539338487 >> v2:172.21.15.146:3300/0 conn(0x7f8aec157710 0x7f8aec069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:49.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.633+0000 7f8ae9ffb700 1 -- 172.21.15.72:0/2539338487 >> v1:172.21.15.146:6789/0 conn(0x7f8aec062650 legacy=0x7f8aec157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8ae9ffb700 1 -- 172.21.15.72:0/2539338487 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec063140 con 0x7f8aec068c20 2023-08-31T19:26:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8ae9ffb700 1 -- 172.21.15.72:0/2539338487 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f8adc001470 con 0x7f8aec068c20 2023-08-31T19:26:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8ae9ffb700 1 -- 172.21.15.72:0/2539338487 >> v1:172.21.15.72:6789/0 conn(0x7f8aec068c20 legacy=0x7f8aec0c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8ae9ffb700 1 --2- 172.21.15.72:0/2539338487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad40038e0 0x7f8ad4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8ae9ffb700 1 --2- 172.21.15.72:0/2539338487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ad4004690 0x7f8ad4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:49.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8ae9ffb700 1 --2- 172.21.15.72:0/2539338487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad4005000 0x7f8ad400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:49.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8ae9ffb700 1 -- 172.21.15.72:0/2539338487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec062e60 con 0x7f8ad4004690 2023-08-31T19:26:49.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8ae9ffb700 1 -- 172.21.15.72:0/2539338487 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad400beb0 con 0x7f8ad4005000 2023-08-31T19:26:49.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8ae9ffb700 1 -- 172.21.15.72:0/2539338487 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad400c070 con 0x7f8ad40038e0 2023-08-31T19:26:49.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8aea7fc700 1 --2- 172.21.15.72:0/2539338487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ad4004690 0x7f8ad4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:49.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8aeaffd700 1 --2- 172.21.15.72:0/2539338487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad40038e0 0x7f8ad4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:49.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8aeb7fe700 1 --2- 172.21.15.72:0/2539338487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad4005000 0x7f8ad400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:49.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8aea7fc700 1 -- 172.21.15.72:0/2539338487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad40038e0 msgr2=0x7f8ad4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:49.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8aea7fc700 1 --2- 172.21.15.72:0/2539338487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad40038e0 0x7f8ad4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:49.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8aea7fc700 1 -- 172.21.15.72:0/2539338487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad4005000 msgr2=0x7f8ad400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:49.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8aea7fc700 1 --2- 172.21.15.72:0/2539338487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ad4005000 0x7f8ad400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:49.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8aea7fc700 1 -- 172.21.15.72:0/2539338487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad40033f0 con 0x7f8ad4004690 2023-08-31T19:26:49.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8aeb7fe700 1 -- 172.21.15.72:0/2539338487 reap_dead start 2023-08-31T19:26:49.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.634+0000 7f8aeaffd700 1 --2- 172.21.15.72:0/2539338487 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad40038e0 0x7f8ad4003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:49.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.635+0000 7f8aea7fc700 1 --2- 172.21.15.72:0/2539338487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ad4004690 0x7f8ad4004b10 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f8ae0001730 tx=0x7f8ae0007bb0).ready entity=mon.0 client_cookie=9ac01d3c8a80d344 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:49.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.635+0000 7f8ae9ffb700 1 -- 172.21.15.72:0/2539338487 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0007020 con 0x7f8ad4004690 2023-08-31T19:26:49.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.635+0000 7f8ae9ffb700 1 -- 172.21.15.72:0/2539338487 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae0007180 con 0x7f8ad4004690 2023-08-31T19:26:49.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.635+0000 7f8ae9ffb700 1 -- 172.21.15.72:0/2539338487 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0007520 con 0x7f8ad4004690 2023-08-31T19:26:49.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.635+0000 7f8af17ff700 1 -- 172.21.15.72:0/2539338487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ad4004690 msgr2=0x7f8ad4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:49.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.635+0000 7f8af17ff700 1 --2- 172.21.15.72:0/2539338487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ad4004690 0x7f8ad4004b10 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f8ae0001730 tx=0x7f8ae0007bb0).stop 2023-08-31T19:26:49.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.635+0000 7f8af17ff700 1 -- 172.21.15.72:0/2539338487 shutdown_connections 2023-08-31T19:26:49.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.635+0000 7f8af17ff700 1 --2- 172.21.15.72:0/2539338487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ad4004690 0x7f8ad4004b10 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:49.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.635+0000 7f8af17ff700 1 -- 172.21.15.72:0/2539338487 >> 172.21.15.72:0/2539338487 conn(0x7f8aec0c72f0 msgr2=0x7f8aec0c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:49.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.635+0000 7f8af17ff700 1 -- 172.21.15.72:0/2539338487 shutdown_connections 2023-08-31T19:26:49.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.635+0000 7f8af17ff700 1 -- 172.21.15.72:0/2539338487 wait complete. 2023-08-31T19:26:49.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.637+0000 7f8af17ff700 1 Processor -- start 2023-08-31T19:26:49.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.637+0000 7f8af17ff700 1 -- start start 2023-08-31T19:26:49.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.638+0000 7f8af17ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad4004690 0x7f8aec1688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:49.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.638+0000 7f8af17ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aec0c04f0 0x7f8aec0a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:49.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.638+0000 7f8af17ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aec167cb0 0x7f8aec168130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:49.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.638+0000 7f8af17ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec168620 con 0x7f8aec0c04f0 2023-08-31T19:26:49.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.638+0000 7f8af17ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec0a50f0 con 0x7f8aec167cb0 2023-08-31T19:26:49.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.638+0000 7f8af17ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec0a53d0 con 0x7f8ad4004690 2023-08-31T19:26:49.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.638+0000 7f8aea7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aec0c04f0 0x7f8aec0a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:49.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.638+0000 7f8aea7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aec0c04f0 0x7f8aec0a48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44014/0 (socket says 172.21.15.72:44014) 2023-08-31T19:26:49.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.638+0000 7f8aea7fc700 1 -- 172.21.15.72:0/114694288 learned_addr learned my addr 172.21.15.72:0/114694288 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:49.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.638+0000 7f8aeb7fe700 1 --2- 172.21.15.72:0/114694288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aec167cb0 0x7f8aec168130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:49.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.638+0000 7f8aeaffd700 1 --2- 172.21.15.72:0/114694288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad4004690 0x7f8aec1688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:49.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.638+0000 7f8aea7fc700 1 -- 172.21.15.72:0/114694288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad4004690 msgr2=0x7f8aec1688d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:49.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.638+0000 7f8aea7fc700 1 --2- 172.21.15.72:0/114694288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad4004690 0x7f8aec1688d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:49.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.638+0000 7f8aea7fc700 1 -- 172.21.15.72:0/114694288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aec167cb0 msgr2=0x7f8aec168130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:49.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.638+0000 7f8aea7fc700 1 --2- 172.21.15.72:0/114694288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aec167cb0 0x7f8aec168130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:49.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.639+0000 7f8aea7fc700 1 -- 172.21.15.72:0/114694288 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec0a56b0 con 0x7f8aec0c04f0 2023-08-31T19:26:49.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.639+0000 7f8aea7fc700 1 --2- 172.21.15.72:0/114694288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aec0c04f0 0x7f8aec0a48e0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7f8ad400be80 tx=0x7f8ae0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:49.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.639+0000 7f8ad2ffd700 1 -- 172.21.15.72:0/114694288 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0006fb0 con 0x7f8aec0c04f0 2023-08-31T19:26:49.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.639+0000 7f8ad2ffd700 1 -- 172.21.15.72:0/114694288 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae0013670 con 0x7f8aec0c04f0 2023-08-31T19:26:49.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.639+0000 7f8ad2ffd700 1 -- 172.21.15.72:0/114694288 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0013a30 con 0x7f8aec0c04f0 2023-08-31T19:26:49.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.639+0000 7f8af17ff700 1 -- 172.21.15.72:0/114694288 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aec0a5990 con 0x7f8aec0c04f0 2023-08-31T19:26:49.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.639+0000 7f8af17ff700 1 -- 172.21.15.72:0/114694288 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aec0c0970 con 0x7f8aec0c04f0 2023-08-31T19:26:49.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.640+0000 7f8af17ff700 1 -- 172.21.15.72:0/114694288 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aec0c1120 con 0x7f8aec0c04f0 2023-08-31T19:26:49.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.641+0000 7f8ad2ffd700 1 -- 172.21.15.72:0/114694288 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f8ae001f430 con 0x7f8aec0c04f0 2023-08-31T19:26:49.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.642+0000 7f8ad2ffd700 1 --2- 172.21.15.72:0/114694288 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8ad805ef30 0x7f8ad80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:49.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.642+0000 7f8ad2ffd700 1 -- 172.21.15.72:0/114694288 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6898+0+0 (secure 0 0 0) 0x7f8ae007ad00 con 0x7f8aec0c04f0 2023-08-31T19:26:49.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.642+0000 7f8aeaffd700 1 --2- 172.21.15.72:0/114694288 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8ad805ef30 0x7f8ad80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:49.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.642+0000 7f8aeaffd700 1 --2- 172.21.15.72:0/114694288 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8ad805ef30 0x7f8ad80613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8aec061c20 tx=0x7f8adc009040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:49.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.646+0000 7f8ad2ffd700 1 -- 172.21.15.72:0/114694288 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ae004bd30 con 0x7f8aec0c04f0 2023-08-31T19:26:49.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:49.813+0000 7f8af17ff700 1 -- 172.21.15.72:0/114694288 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8aec168620 con 0x7f8aec0c04f0 2023-08-31T19:26:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.411+0000 7f8ad2ffd700 1 -- 172.21.15.72:0/114694288 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v201) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8ae0024020 con 0x7f8aec0c04f0 2023-08-31T19:26:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.415+0000 7f8af17ff700 1 -- 172.21.15.72:0/114694288 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8ad805ef30 msgr2=0x7f8ad80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.415+0000 7f8af17ff700 1 --2- 172.21.15.72:0/114694288 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8ad805ef30 0x7f8ad80613f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8aec061c20 tx=0x7f8adc009040).stop 2023-08-31T19:26:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.415+0000 7f8af17ff700 1 -- 172.21.15.72:0/114694288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aec0c04f0 msgr2=0x7f8aec0a48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.415+0000 7f8af17ff700 1 --2- 172.21.15.72:0/114694288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aec0c04f0 0x7f8aec0a48e0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7f8ad400be80 tx=0x7f8ae0015000).stop 2023-08-31T19:26:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.415+0000 7f8af17ff700 1 -- 172.21.15.72:0/114694288 shutdown_connections 2023-08-31T19:26:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.415+0000 7f8af17ff700 1 --2- 172.21.15.72:0/114694288 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f8ad805ef30 0x7f8ad80613f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.415+0000 7f8af17ff700 1 --2- 172.21.15.72:0/114694288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aec167cb0 0x7f8aec168130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.415+0000 7f8af17ff700 1 --2- 172.21.15.72:0/114694288 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f8ad4004690 0x7f8aec1688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.415+0000 7f8af17ff700 1 --2- 172.21.15.72:0/114694288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8aec0c04f0 0x7f8aec0a48e0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.415+0000 7f8af17ff700 1 -- 172.21.15.72:0/114694288 >> 172.21.15.72:0/114694288 conn(0x7f8aec0c72f0 msgr2=0x7f8aec1529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.415+0000 7f8af17ff700 1 -- 172.21.15.72:0/114694288 shutdown_connections 2023-08-31T19:26:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.416+0000 7f8af17ff700 1 -- 172.21.15.72:0/114694288 wait complete. 2023-08-31T19:26:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-08-31T19:26:50.435 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-31T19:26:50.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.626+0000 7f42231ff700 1 Processor -- start 2023-08-31T19:26:50.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.626+0000 7f42231ff700 1 -- start start 2023-08-31T19:26:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.627+0000 7f42231ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f421c153e20 0x7f421c154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.627+0000 7f42231ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f421c063270 0x7f421c0636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.627+0000 7f42231ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f421c0a9d40 0x7f421c0aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.627+0000 7f42231ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f421c157c70 con 0x7f421c063270 2023-08-31T19:26:50.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.627+0000 7f42231ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f421c158a90 con 0x7f421c153e20 2023-08-31T19:26:50.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.627+0000 7f42231ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c0aa6c0 con 0x7f421c0a9d40 2023-08-31T19:26:50.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.628+0000 7f421bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f421c063270 0x7f421c0636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:50.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.628+0000 7f421bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f421c063270 0x7f421c0636d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44026/0 (socket says 172.21.15.72:44026) 2023-08-31T19:26:50.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.628+0000 7f421bfff700 1 -- 172.21.15.72:0/749543626 learned_addr learned my addr 172.21.15.72:0/749543626 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:50.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.628+0000 7f4220f9b700 1 --2- 172.21.15.72:0/749543626 >> v2:172.21.15.146:3300/0 conn(0x7f421c153e20 0x7f421c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:50.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.628+0000 7f422179c700 1 --2- 172.21.15.72:0/749543626 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f421c0a9d40 0x7f421c0aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:50.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.628+0000 7f421bfff700 1 -- 172.21.15.72:0/749543626 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f421c0a9d40 msgr2=0x7f421c0aa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:50.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.628+0000 7f421bfff700 1 --2- 172.21.15.72:0/749543626 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f421c0a9d40 0x7f421c0aa1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:50.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.628+0000 7f421bfff700 1 -- 172.21.15.72:0/749543626 >> v2:172.21.15.146:3300/0 conn(0x7f421c153e20 msgr2=0x7f421c154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:50.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.628+0000 7f421bfff700 1 --2- 172.21.15.72:0/749543626 >> v2:172.21.15.146:3300/0 conn(0x7f421c153e20 0x7f421c154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:50.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.628+0000 7f421bfff700 1 -- 172.21.15.72:0/749543626 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c063bc0 con 0x7f421c063270 2023-08-31T19:26:50.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.628+0000 7f422179c700 1 --2- 172.21.15.72:0/749543626 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f421c0a9d40 0x7f421c0aa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:50.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.628+0000 7f421bfff700 1 --2- 172.21.15.72:0/749543626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f421c063270 0x7f421c0636d0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f421c084400 tx=0x7f42080090f0).ready entity=mon.0 client_cookie=f898207134974671 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:50.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.629+0000 7f421b7fe700 1 -- 172.21.15.72:0/749543626 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800b600 con 0x7f421c063270 2023-08-31T19:26:50.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.629+0000 7f421b7fe700 1 -- 172.21.15.72:0/749543626 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420800b760 con 0x7f421c063270 2023-08-31T19:26:50.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.629+0000 7f421b7fe700 1 -- 172.21.15.72:0/749543626 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800bae0 con 0x7f421c063270 2023-08-31T19:26:50.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.629+0000 7f42231ff700 1 -- 172.21.15.72:0/749543626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f421c063270 msgr2=0x7f421c0636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:50.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.629+0000 7f42231ff700 1 --2- 172.21.15.72:0/749543626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f421c063270 0x7f421c0636d0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f421c084400 tx=0x7f42080090f0).stop 2023-08-31T19:26:50.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.629+0000 7f42231ff700 1 -- 172.21.15.72:0/749543626 shutdown_connections 2023-08-31T19:26:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.629+0000 7f42231ff700 1 --2- 172.21.15.72:0/749543626 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f421c0a9d40 0x7f421c0aa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.629+0000 7f42231ff700 1 --2- 172.21.15.72:0/749543626 >> v2:172.21.15.146:3300/0 conn(0x7f421c153e20 0x7f421c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.629+0000 7f42231ff700 1 --2- 172.21.15.72:0/749543626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f421c063270 0x7f421c0636d0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.629+0000 7f42231ff700 1 -- 172.21.15.72:0/749543626 >> 172.21.15.72:0/749543626 conn(0x7f421c05eb60 msgr2=0x7f421c0cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.629+0000 7f42231ff700 1 -- 172.21.15.72:0/749543626 shutdown_connections 2023-08-31T19:26:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.629+0000 7f42231ff700 1 -- 172.21.15.72:0/749543626 wait complete. 2023-08-31T19:26:50.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.631+0000 7f42231ff700 1 Processor -- start 2023-08-31T19:26:50.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.631+0000 7f42231ff700 1 -- start start 2023-08-31T19:26:50.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.632+0000 7f42231ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f421c063270 0x7f421c14da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:50.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.632+0000 7f42231ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421c0a9d40 0x7f421c154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:50.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.632+0000 7f42231ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f421c153e20 0x7f421c14ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:50.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.632+0000 7f42231ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c155a50 con 0x7f421c153e20 2023-08-31T19:26:50.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.632+0000 7f42231ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c154c00 con 0x7f421c0a9d40 2023-08-31T19:26:50.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.632+0000 7f42231ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421c154ed0 con 0x7f421c063270 2023-08-31T19:26:50.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.632+0000 7f422179c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f421c153e20 0x7f421c14ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:50.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.632+0000 7f422179c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f421c153e20 0x7f421c14ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44030/0 (socket says 172.21.15.72:44030) 2023-08-31T19:26:50.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.632+0000 7f422179c700 1 -- 172.21.15.72:0/574147291 learned_addr learned my addr 172.21.15.72:0/574147291 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:50.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.633+0000 7f4220f9b700 1 --2- 172.21.15.72:0/574147291 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f421c063270 0x7f421c14da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:50.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.633+0000 7f421bfff700 1 --2- 172.21.15.72:0/574147291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421c0a9d40 0x7f421c154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:50.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.633+0000 7f422179c700 1 -- 172.21.15.72:0/574147291 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f421c063270 msgr2=0x7f421c14da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:50.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.633+0000 7f422179c700 1 --2- 172.21.15.72:0/574147291 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f421c063270 0x7f421c14da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:50.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.633+0000 7f422179c700 1 -- 172.21.15.72:0/574147291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421c0a9d40 msgr2=0x7f421c154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:50.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.633+0000 7f422179c700 1 --2- 172.21.15.72:0/574147291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421c0a9d40 0x7f421c154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:50.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.633+0000 7f422179c700 1 -- 172.21.15.72:0/574147291 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4208009370 con 0x7f421c153e20 2023-08-31T19:26:50.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.633+0000 7f422179c700 1 --2- 172.21.15.72:0/574147291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f421c153e20 0x7f421c14ce10 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f421400a380 tx=0x7f4214007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:50.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.633+0000 7f4218ff9700 1 -- 172.21.15.72:0/574147291 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421400ae10 con 0x7f421c153e20 2023-08-31T19:26:50.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.633+0000 7f4218ff9700 1 -- 172.21.15.72:0/574147291 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421400d650 con 0x7f421c153e20 2023-08-31T19:26:50.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.633+0000 7f4218ff9700 1 -- 172.21.15.72:0/574147291 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421400d9d0 con 0x7f421c153e20 2023-08-31T19:26:50.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.633+0000 7f42231ff700 1 -- 172.21.15.72:0/574147291 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421c1551b0 con 0x7f421c153e20 2023-08-31T19:26:50.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.633+0000 7f42231ff700 1 -- 172.21.15.72:0/574147291 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421c155770 con 0x7f421c153e20 2023-08-31T19:26:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.634+0000 7f42231ff700 1 -- 172.21.15.72:0/574147291 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f421c06c6b0 con 0x7f421c153e20 2023-08-31T19:26:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.635+0000 7f4218ff9700 1 -- 172.21.15.72:0/574147291 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4214013070 con 0x7f421c153e20 2023-08-31T19:26:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.637+0000 7f4218ff9700 1 --2- 172.21.15.72:0/574147291 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f420005ef30 0x7f42000613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.637+0000 7f4218ff9700 1 -- 172.21.15.72:0/574147291 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f421407ace0 con 0x7f421c153e20 2023-08-31T19:26:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.637+0000 7f4220f9b700 1 --2- 172.21.15.72:0/574147291 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f420005ef30 0x7f42000613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.638+0000 7f4220f9b700 1 --2- 172.21.15.72:0/574147291 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f420005ef30 0x7f42000613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4210006fd0 tx=0x7f4210008040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:50.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.641+0000 7f4218ff9700 1 -- 172.21.15.72:0/574147291 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f421404bda0 con 0x7f421c153e20 2023-08-31T19:26:50.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.815+0000 7f42231ff700 1 -- 172.21.15.72:0/574147291 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f421c157e80 con 0x7f421c153e20 2023-08-31T19:26:50.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.819+0000 7f4218ff9700 1 -- 172.21.15.72:0/574147291 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v40) v1 ==== 120+0+0 (secure 0 0 0) 0x7f421404f3c0 con 0x7f421c153e20 2023-08-31T19:26:50.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.821+0000 7f42231ff700 1 -- 172.21.15.72:0/574147291 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f420005ef30 msgr2=0x7f42000613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:50.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.821+0000 7f42231ff700 1 --2- 172.21.15.72:0/574147291 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f420005ef30 0x7f42000613f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4210006fd0 tx=0x7f4210008040).stop 2023-08-31T19:26:50.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.821+0000 7f42231ff700 1 -- 172.21.15.72:0/574147291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f421c153e20 msgr2=0x7f421c14ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:50.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.821+0000 7f42231ff700 1 --2- 172.21.15.72:0/574147291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f421c153e20 0x7f421c14ce10 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f421400a380 tx=0x7f4214007900).stop 2023-08-31T19:26:50.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.821+0000 7f42231ff700 1 -- 172.21.15.72:0/574147291 shutdown_connections 2023-08-31T19:26:50.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.821+0000 7f42231ff700 1 --2- 172.21.15.72:0/574147291 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f420005ef30 0x7f42000613f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:50.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.821+0000 7f42231ff700 1 --2- 172.21.15.72:0/574147291 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f421c153e20 0x7f421c14ce10 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:50.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.821+0000 7f42231ff700 1 --2- 172.21.15.72:0/574147291 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f421c063270 0x7f421c14da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.821+0000 7f42231ff700 1 --2- 172.21.15.72:0/574147291 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f421c0a9d40 0x7f421c154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.821+0000 7f42231ff700 1 -- 172.21.15.72:0/574147291 >> 172.21.15.72:0/574147291 conn(0x7f421c05eb60 msgr2=0x7f421c0c7870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.821+0000 7f42231ff700 1 -- 172.21.15.72:0/574147291 shutdown_connections 2023-08-31T19:26:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:50.821+0000 7f42231ff700 1 -- 172.21.15.72:0/574147291 wait complete. 2023-08-31T19:26:50.840 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-31T19:26:51.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.033+0000 7f84d2bff700 1 Processor -- start 2023-08-31T19:26:51.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.033+0000 7f84d2bff700 1 -- start start 2023-08-31T19:26:51.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.034+0000 7f84d2bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84cc1544e0 0x7f84cc05e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:51.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.034+0000 7f84d2bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84cc0c38d0 0x7f84cc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:51.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.034+0000 7f84d2bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84cc0bc4a0 con 0x7f84cc068ec0 2023-08-31T19:26:51.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.034+0000 7f84d2bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84cc05e840 con 0x7f84cc0c38d0 2023-08-31T19:26:51.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.034+0000 7f84d2bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc069310 con 0x7f84cc1544e0 2023-08-31T19:26:51.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.035+0000 7f84cbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84cc0c38d0 0x7f84cc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:51.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.035+0000 7f84d119c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f84cc068ec0 0x7f84cc062650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55446/0 (socket says 172.21.15.72:55446) 2023-08-31T19:26:51.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.035+0000 7f84d119c700 1 -- 172.21.15.72:0/1824830891 learned_addr learned my addr 172.21.15.72:0/1824830891 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:51.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.035+0000 7f84d099b700 1 --2- 172.21.15.72:0/1824830891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84cc1544e0 0x7f84cc05e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:51.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.035+0000 7f84cbfff700 1 -- 172.21.15.72:0/1824830891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84cc1544e0 msgr2=0x7f84cc05e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:51.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.035+0000 7f84cbfff700 1 --2- 172.21.15.72:0/1824830891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84cc1544e0 0x7f84cc05e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:51.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.035+0000 7f84cbfff700 1 -- 172.21.15.72:0/1824830891 >> v1:172.21.15.72:6789/0 conn(0x7f84cc068ec0 legacy=0x7f84cc062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:51.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.035+0000 7f84cbfff700 1 -- 172.21.15.72:0/1824830891 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc069c40 con 0x7f84cc0c38d0 2023-08-31T19:26:51.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.035+0000 7f84cb7fe700 1 -- 172.21.15.72:0/1824830891 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894686759 0 0) 0x7f84cc0bc4a0 con 0x7f84cc068ec0 2023-08-31T19:26:51.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.035+0000 7f84cbfff700 1 --2- 172.21.15.72:0/1824830891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84cc0c38d0 0x7f84cc0689d0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7f84b8009760 tx=0x7f84b8009060).ready entity=mon.0 client_cookie=77b3d18f1e38835d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:51.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.035+0000 7f84cb7fe700 1 -- 172.21.15.72:0/1824830891 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b80090d0 con 0x7f84cc0c38d0 2023-08-31T19:26:51.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.035+0000 7f84cb7fe700 1 -- 172.21.15.72:0/1824830891 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b800b580 con 0x7f84cc0c38d0 2023-08-31T19:26:51.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.035+0000 7f84cb7fe700 1 -- 172.21.15.72:0/1824830891 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b800b900 con 0x7f84cc0c38d0 2023-08-31T19:26:51.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.036+0000 7f84d2bff700 1 -- 172.21.15.72:0/1824830891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84cc0c38d0 msgr2=0x7f84cc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.036+0000 7f84d2bff700 1 --2- 172.21.15.72:0/1824830891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84cc0c38d0 0x7f84cc0689d0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7f84b8009760 tx=0x7f84b8009060).stop 2023-08-31T19:26:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.036+0000 7f84d2bff700 1 -- 172.21.15.72:0/1824830891 shutdown_connections 2023-08-31T19:26:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.036+0000 7f84d2bff700 1 --2- 172.21.15.72:0/1824830891 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84cc1544e0 0x7f84cc05e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.036+0000 7f84d2bff700 1 --2- 172.21.15.72:0/1824830891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84cc0c38d0 0x7f84cc0689d0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.036+0000 7f84d2bff700 1 -- 172.21.15.72:0/1824830891 >> 172.21.15.72:0/1824830891 conn(0x7f84cc0c7e00 msgr2=0x7f84cc0c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.036+0000 7f84d2bff700 1 -- 172.21.15.72:0/1824830891 shutdown_connections 2023-08-31T19:26:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.036+0000 7f84d2bff700 1 -- 172.21.15.72:0/1824830891 wait complete. 2023-08-31T19:26:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.037+0000 7f84d2bff700 1 Processor -- start 2023-08-31T19:26:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.038+0000 7f84d2bff700 1 -- start start 2023-08-31T19:26:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.038+0000 7f84d2bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84cc068ec0 0x7f84cc0bfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84d2bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84cc0c38d0 0x7f84cc158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84d2bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84cc1544e0 0x7f84cc0637e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84d2bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc0c0e70 con 0x7f84cc1544e0 2023-08-31T19:26:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84d2bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc0c0260 con 0x7f84cc0c38d0 2023-08-31T19:26:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84d2bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc0c0540 con 0x7f84cc068ec0 2023-08-31T19:26:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84d119c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84cc1544e0 0x7f84cc0637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84d119c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84cc1544e0 0x7f84cc0637e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44048/0 (socket says 172.21.15.72:44048) 2023-08-31T19:26:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84d119c700 1 -- 172.21.15.72:0/871755929 learned_addr learned my addr 172.21.15.72:0/871755929 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84d099b700 1 --2- 172.21.15.72:0/871755929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84cc068ec0 0x7f84cc0bfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84cbfff700 1 --2- 172.21.15.72:0/871755929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84cc0c38d0 0x7f84cc158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84d119c700 1 -- 172.21.15.72:0/871755929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84cc068ec0 msgr2=0x7f84cc0bfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84d119c700 1 --2- 172.21.15.72:0/871755929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84cc068ec0 0x7f84cc0bfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84d119c700 1 -- 172.21.15.72:0/871755929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84cc0c38d0 msgr2=0x7f84cc158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84d119c700 1 --2- 172.21.15.72:0/871755929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84cc0c38d0 0x7f84cc158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84d119c700 1 -- 172.21.15.72:0/871755929 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b80092a0 con 0x7f84cc1544e0 2023-08-31T19:26:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.039+0000 7f84d119c700 1 --2- 172.21.15.72:0/871755929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84cc1544e0 0x7f84cc0637e0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7f84c400c7e0 tx=0x7f84c4007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.040+0000 7f84c8ff9700 1 -- 172.21.15.72:0/871755929 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4005d30 con 0x7f84cc1544e0 2023-08-31T19:26:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.040+0000 7f84c8ff9700 1 -- 172.21.15.72:0/871755929 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c4005e90 con 0x7f84cc1544e0 2023-08-31T19:26:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.040+0000 7f84d2bff700 1 -- 172.21.15.72:0/871755929 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84cc0c0820 con 0x7f84cc1544e0 2023-08-31T19:26:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.040+0000 7f84c8ff9700 1 -- 172.21.15.72:0/871755929 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4007320 con 0x7f84cc1544e0 2023-08-31T19:26:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.040+0000 7f84d2bff700 1 -- 172.21.15.72:0/871755929 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84cc158fa0 con 0x7f84cc1544e0 2023-08-31T19:26:51.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.041+0000 7f84d2bff700 1 -- 172.21.15.72:0/871755929 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84cc06c6b0 con 0x7f84cc1544e0 2023-08-31T19:26:51.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.042+0000 7f84c8ff9700 1 -- 172.21.15.72:0/871755929 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f84c4007710 con 0x7f84cc1544e0 2023-08-31T19:26:51.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.043+0000 7f84c8ff9700 1 --2- 172.21.15.72:0/871755929 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f84b005ef30 0x7f84b00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:51.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.043+0000 7f84c8ff9700 1 -- 172.21.15.72:0/871755929 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f84c407a0c0 con 0x7f84cc1544e0 2023-08-31T19:26:51.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.043+0000 7f84d099b700 1 --2- 172.21.15.72:0/871755929 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f84b005ef30 0x7f84b00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:51.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.043+0000 7f84d099b700 1 --2- 172.21.15.72:0/871755929 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f84b005ef30 0x7f84b00613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f84c000bb10 tx=0x7f84c0008040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:51.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.046+0000 7f84c8ff9700 1 -- 172.21.15.72:0/871755929 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f84c404b1e0 con 0x7f84cc1544e0 2023-08-31T19:26:51.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.217+0000 7f84d2bff700 1 -- 172.21.15.72:0/871755929 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f84cc0c1c30 con 0x7f84cc1544e0 2023-08-31T19:26:51.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.223+0000 7f84c8ff9700 1 -- 172.21.15.72:0/871755929 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7f84c404e800 con 0x7f84cc1544e0 2023-08-31T19:26:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.225+0000 7f84d2bff700 1 -- 172.21.15.72:0/871755929 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f84b005ef30 msgr2=0x7f84b00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.225+0000 7f84d2bff700 1 --2- 172.21.15.72:0/871755929 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f84b005ef30 0x7f84b00613f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f84c000bb10 tx=0x7f84c0008040).stop 2023-08-31T19:26:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.225+0000 7f84d2bff700 1 -- 172.21.15.72:0/871755929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84cc1544e0 msgr2=0x7f84cc0637e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:51.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.225+0000 7f84d2bff700 1 --2- 172.21.15.72:0/871755929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84cc1544e0 0x7f84cc0637e0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7f84c400c7e0 tx=0x7f84c4007f90).stop 2023-08-31T19:26:51.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.225+0000 7f84d2bff700 1 -- 172.21.15.72:0/871755929 shutdown_connections 2023-08-31T19:26:51.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.225+0000 7f84d2bff700 1 --2- 172.21.15.72:0/871755929 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f84b005ef30 0x7f84b00613f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:51.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.225+0000 7f84d2bff700 1 --2- 172.21.15.72:0/871755929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84cc1544e0 0x7f84cc0637e0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:51.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.225+0000 7f84d2bff700 1 --2- 172.21.15.72:0/871755929 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f84cc068ec0 0x7f84cc0bfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:51.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.225+0000 7f84d2bff700 1 --2- 172.21.15.72:0/871755929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84cc0c38d0 0x7f84cc158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:51.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.225+0000 7f84d2bff700 1 -- 172.21.15.72:0/871755929 >> 172.21.15.72:0/871755929 conn(0x7f84cc0c7e00 msgr2=0x7f84cc0c5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:51.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.225+0000 7f84d2bff700 1 -- 172.21.15.72:0/871755929 shutdown_connections 2023-08-31T19:26:51.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.225+0000 7f84d2bff700 1 -- 172.21.15.72:0/871755929 wait complete. 2023-08-31T19:26:51.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-08-31T19:26:51.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.433+0000 7fa967fff700 1 Processor -- start 2023-08-31T19:26:51.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.433+0000 7fa967fff700 1 -- start start 2023-08-31T19:26:51.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.434+0000 7fa967fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9600bea80 0x7fa9600c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:51.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.434+0000 7fa967fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa9600c44a0 0x7fa960063a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:51.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.434+0000 7fa967fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9600c4950 con 0x7fa9600c5fb0 2023-08-31T19:26:51.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.434+0000 7fa967fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa960154690 con 0x7fa9600c44a0 2023-08-31T19:26:51.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.434+0000 7fa967fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600bfb20 con 0x7fa9600bea80 2023-08-31T19:26:51.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.435+0000 7fa965d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa9600c5fb0 0x7fa9600be370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55462/0 (socket says 172.21.15.72:55462) 2023-08-31T19:26:51.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.435+0000 7fa965d9b700 1 -- 172.21.15.72:0/4281405874 learned_addr learned my addr 172.21.15.72:0/4281405874 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:51.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.435+0000 7fa96659c700 1 --2- 172.21.15.72:0/4281405874 >> v2:172.21.15.146:3300/0 conn(0x7fa9600c44a0 0x7fa960063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:51.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.435+0000 7fa96559a700 1 --2- 172.21.15.72:0/4281405874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9600bea80 0x7fa9600c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:51.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.435+0000 7fa964d99700 1 -- 172.21.15.72:0/4281405874 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678749050 0 0) 0x7fa95c001290 con 0x7fa9600c5fb0 2023-08-31T19:26:51.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.435+0000 7fa964d99700 1 -- 172.21.15.72:0/4281405874 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa94c0033f0 con 0x7fa9600c5fb0 2023-08-31T19:26:51.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.435+0000 7fa964d99700 1 -- 172.21.15.72:0/4281405874 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3783326641 0 0) 0x7fa94c0033f0 con 0x7fa9600c5fb0 2023-08-31T19:26:51.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.435+0000 7fa96659c700 1 -- 172.21.15.72:0/4281405874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9600bea80 msgr2=0x7fa9600c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:51.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.435+0000 7fa96659c700 1 --2- 172.21.15.72:0/4281405874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9600bea80 0x7fa9600c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:51.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.435+0000 7fa96659c700 1 -- 172.21.15.72:0/4281405874 >> v1:172.21.15.72:6789/0 conn(0x7fa9600c5fb0 legacy=0x7fa9600be370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:51.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.435+0000 7fa96659c700 1 -- 172.21.15.72:0/4281405874 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9600bef10 con 0x7fa9600c44a0 2023-08-31T19:26:51.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.435+0000 7fa96559a700 1 --2- 172.21.15.72:0/4281405874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9600bea80 0x7fa9600c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:26:51.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.436+0000 7fa96659c700 1 --2- 172.21.15.72:0/4281405874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9600c44a0 0x7fa960063a90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fa958009e60 tx=0x7fa958009780).ready entity=mon.1 client_cookie=6ba217710edb5050 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.436+0000 7fa964d99700 1 -- 172.21.15.72:0/4281405874 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95800e070 con 0x7fa9600c44a0 2023-08-31T19:26:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.436+0000 7fa964d99700 1 -- 172.21.15.72:0/4281405874 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95800b7a0 con 0x7fa9600c44a0 2023-08-31T19:26:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.436+0000 7fa964d99700 1 -- 172.21.15.72:0/4281405874 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c001780 con 0x7fa9600c44a0 2023-08-31T19:26:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.436+0000 7fa967fff700 1 -- 172.21.15.72:0/4281405874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9600c44a0 msgr2=0x7fa960063a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.436+0000 7fa967fff700 1 --2- 172.21.15.72:0/4281405874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9600c44a0 0x7fa960063a90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fa958009e60 tx=0x7fa958009780).stop 2023-08-31T19:26:51.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.436+0000 7fa967fff700 1 -- 172.21.15.72:0/4281405874 shutdown_connections 2023-08-31T19:26:51.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.436+0000 7fa967fff700 1 --2- 172.21.15.72:0/4281405874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9600c44a0 0x7fa960063a90 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:51.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.436+0000 7fa967fff700 1 --2- 172.21.15.72:0/4281405874 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa9600bea80 0x7fa9600c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:51.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.436+0000 7fa967fff700 1 -- 172.21.15.72:0/4281405874 >> 172.21.15.72:0/4281405874 conn(0x7fa960082f60 msgr2=0x7fa96005e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:51.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.437+0000 7fa967fff700 1 -- 172.21.15.72:0/4281405874 shutdown_connections 2023-08-31T19:26:51.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.437+0000 7fa967fff700 1 -- 172.21.15.72:0/4281405874 wait complete. 2023-08-31T19:26:51.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.439+0000 7fa967fff700 1 Processor -- start 2023-08-31T19:26:51.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.439+0000 7fa967fff700 1 -- start start 2023-08-31T19:26:51.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.440+0000 7fa967fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9600c44a0 0x7fa960164de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:51.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.440+0000 7fa967fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9600c5fb0 0x7fa9601669e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:51.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.440+0000 7fa967fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa960163d20 0x7fa960164180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:51.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.440+0000 7fa967fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9601652d0 con 0x7fa9600c44a0 2023-08-31T19:26:51.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.440+0000 7fa967fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600aa550 con 0x7fa9600c5fb0 2023-08-31T19:26:51.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.440+0000 7fa967fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa960159620 con 0x7fa960163d20 2023-08-31T19:26:51.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.440+0000 7fa965d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9600c44a0 0x7fa960164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:51.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.440+0000 7fa965d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9600c44a0 0x7fa960164de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44058/0 (socket says 172.21.15.72:44058) 2023-08-31T19:26:51.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.440+0000 7fa965d9b700 1 -- 172.21.15.72:0/1727036348 learned_addr learned my addr 172.21.15.72:0/1727036348 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:51.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.441+0000 7fa96659c700 1 --2- 172.21.15.72:0/1727036348 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa960163d20 0x7fa960164180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:51.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.441+0000 7fa96559a700 1 --2- 172.21.15.72:0/1727036348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9600c5fb0 0x7fa9601669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:51.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.441+0000 7fa965d9b700 1 -- 172.21.15.72:0/1727036348 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa960163d20 msgr2=0x7fa960164180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:51.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.441+0000 7fa965d9b700 1 --2- 172.21.15.72:0/1727036348 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa960163d20 0x7fa960164180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:51.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.441+0000 7fa965d9b700 1 -- 172.21.15.72:0/1727036348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9600c5fb0 msgr2=0x7fa9601669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:51.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.441+0000 7fa965d9b700 1 --2- 172.21.15.72:0/1727036348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9600c5fb0 0x7fa9601669e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:51.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.441+0000 7fa965d9b700 1 -- 172.21.15.72:0/1727036348 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9500092a0 con 0x7fa9600c44a0 2023-08-31T19:26:51.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.441+0000 7fa96559a700 1 --2- 172.21.15.72:0/1727036348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9600c5fb0 0x7fa9601669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:51.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.441+0000 7fa965d9b700 1 --2- 172.21.15.72:0/1727036348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9600c44a0 0x7fa960164de0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7fa95c00c810 tx=0x7fa95c001000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:51.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.441+0000 7fa955ffb700 1 -- 172.21.15.72:0/1727036348 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c0072e0 con 0x7fa9600c44a0 2023-08-31T19:26:51.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.441+0000 7fa955ffb700 1 -- 172.21.15.72:0/1727036348 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95c007440 con 0x7fa9600c44a0 2023-08-31T19:26:51.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.441+0000 7fa955ffb700 1 -- 172.21.15.72:0/1727036348 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c0058c0 con 0x7fa9600c44a0 2023-08-31T19:26:51.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.441+0000 7fa967fff700 1 -- 172.21.15.72:0/1727036348 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa958009a20 con 0x7fa9600c44a0 2023-08-31T19:26:51.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.441+0000 7fa967fff700 1 -- 172.21.15.72:0/1727036348 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa960164670 con 0x7fa9600c44a0 2023-08-31T19:26:51.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.442+0000 7fa967fff700 1 -- 172.21.15.72:0/1727036348 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9600aa020 con 0x7fa9600c44a0 2023-08-31T19:26:51.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.443+0000 7fa955ffb700 1 -- 172.21.15.72:0/1727036348 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa95c005cb0 con 0x7fa9600c44a0 2023-08-31T19:26:51.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.444+0000 7fa955ffb700 1 --2- 172.21.15.72:0/1727036348 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa94405ef30 0x7fa9440613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:51.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.444+0000 7fa955ffb700 1 -- 172.21.15.72:0/1727036348 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7fa95c0798c0 con 0x7fa9600c44a0 2023-08-31T19:26:51.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.444+0000 7fa96559a700 1 --2- 172.21.15.72:0/1727036348 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa94405ef30 0x7fa9440613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:51.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.445+0000 7fa96559a700 1 --2- 172.21.15.72:0/1727036348 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa94405ef30 0x7fa9440613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa950009270 tx=0x7fa950008040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:51.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.448+0000 7fa955ffb700 1 -- 172.21.15.72:0/1727036348 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa95c04aa40 con 0x7fa9600c44a0 2023-08-31T19:26:51.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:51.683+0000 7fa967fff700 1 -- 172.21.15.72:0/1727036348 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7fa9600c4950 con 0x7fa9600c44a0 2023-08-31T19:26:52.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:52.416+0000 7fa955ffb700 1 -- 172.21.15.72:0/1727036348 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1374) v1 ==== 155+0+0 (secure 0 0 0) 0x7fa9600c4950 con 0x7fa9600c44a0 2023-08-31T19:26:52.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:52.418+0000 7fa967fff700 1 -- 172.21.15.72:0/1727036348 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa94405ef30 msgr2=0x7fa9440613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:52.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:52.418+0000 7fa967fff700 1 --2- 172.21.15.72:0/1727036348 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa94405ef30 0x7fa9440613f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa950009270 tx=0x7fa950008040).stop 2023-08-31T19:26:52.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:52.418+0000 7fa967fff700 1 -- 172.21.15.72:0/1727036348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9600c44a0 msgr2=0x7fa960164de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:52.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:52.418+0000 7fa967fff700 1 --2- 172.21.15.72:0/1727036348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9600c44a0 0x7fa960164de0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7fa95c00c810 tx=0x7fa95c001000).stop 2023-08-31T19:26:52.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:52.418+0000 7fa967fff700 1 -- 172.21.15.72:0/1727036348 shutdown_connections 2023-08-31T19:26:52.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:52.419+0000 7fa967fff700 1 --2- 172.21.15.72:0/1727036348 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa94405ef30 0x7fa9440613f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:52.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:52.419+0000 7fa967fff700 1 --2- 172.21.15.72:0/1727036348 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa960163d20 0x7fa960164180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:52.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:52.419+0000 7fa967fff700 1 --2- 172.21.15.72:0/1727036348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9600c44a0 0x7fa960164de0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:52.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:52.419+0000 7fa967fff700 1 --2- 172.21.15.72:0/1727036348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9600c5fb0 0x7fa9601669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:52.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:52.419+0000 7fa967fff700 1 -- 172.21.15.72:0/1727036348 >> 172.21.15.72:0/1727036348 conn(0x7fa960082f60 msgr2=0x7fa960153900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:52.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:52.419+0000 7fa967fff700 1 -- 172.21.15.72:0/1727036348 shutdown_connections 2023-08-31T19:26:52.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:52.419+0000 7fa967fff700 1 -- 172.21.15.72:0/1727036348 wait complete. 2023-08-31T19:26:52.439 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-08-31T19:26:52.439 INFO:tasks.cephfs_test_runner: 2023-08-31T19:26:52.440 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-31T19:26:52.440 INFO:tasks.cephfs_test_runner:Ran 10 tests in 2299.941s 2023-08-31T19:26:52.440 INFO:tasks.cephfs_test_runner: 2023-08-31T19:26:52.441 INFO:tasks.cephfs_test_runner:OK 2023-08-31T19:26:52.441 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-08-31T19:26:52.450 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-08-31T19:26:52.458 INFO:tasks.kclient:Unmounting kernel clients... 2023-08-31T19:26:52.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:52.459 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T19:26:52.507 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T19:26:52.508 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T19:26:52.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:52.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T19:26:52.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:52.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T19:26:52.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:52.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-08-31T19:26:52.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:52.808 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-08-31T19:26:52.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:52.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-08-31T19:26:52.935 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2023-08-31T19:26:52.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:26:52.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:52.939 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-08-31T19:26:52.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-31T19:26:52.992 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-31T19:26:52.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:52.993 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-31T19:26:53.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:53.068 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-31T19:26:53.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:53.142 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-08-31T19:26:53.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:53.257 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-08-31T19:26:53.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:26:53.307 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-08-31T19:26:53.384 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2023-08-31T19:26:53.387 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:26:53.387 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-08-31T19:26:53.397 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-08-31T19:26:53.398 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:26:53.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.588+0000 7f662b1ff700 1 Processor -- start 2023-08-31T19:26:53.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.588+0000 7f662b1ff700 1 -- start start 2023-08-31T19:26:53.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.589+0000 7f662b1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66240cb940 0x7f66241583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:53.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.589+0000 7f662b1ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66240c8c90 con 0x7f66241588d0 2023-08-31T19:26:53.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.589+0000 7f662b1ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6624155610 con 0x7f6624154220 2023-08-31T19:26:53.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.589+0000 7f662b1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66240aa700 con 0x7f66240cb940 2023-08-31T19:26:53.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.589+0000 7f662979c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f66241588d0 0x7f66240c6540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35102/0 (socket says 172.21.15.72:35102) 2023-08-31T19:26:53.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.589+0000 7f662979c700 1 -- 172.21.15.72:0/2805652586 learned_addr learned my addr 172.21.15.72:0/2805652586 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:53.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.590+0000 7f6623fff700 1 --2- 172.21.15.72:0/2805652586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66240cb940 0x7f66241583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:53.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.590+0000 7f66237fe700 1 -- 172.21.15.72:0/2805652586 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347337588 0 0) 0x7f66240c8c90 con 0x7f66241588d0 2023-08-31T19:26:53.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.590+0000 7f66237fe700 1 -- 172.21.15.72:0/2805652586 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66140033f0 con 0x7f66241588d0 2023-08-31T19:26:53.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.590+0000 7f66237fe700 1 -- 172.21.15.72:0/2805652586 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954432885 0 0) 0x7f6624155610 con 0x7f6624154220 2023-08-31T19:26:53.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.590+0000 7f66237fe700 1 -- 172.21.15.72:0/2805652586 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66240c8c90 con 0x7f6624154220 2023-08-31T19:26:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.590+0000 7f6623fff700 1 -- 172.21.15.72:0/2805652586 >> v1:172.21.15.146:6789/0 conn(0x7f6624154220 legacy=0x7f6624157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.590+0000 7f6623fff700 1 -- 172.21.15.72:0/2805652586 >> v1:172.21.15.72:6789/0 conn(0x7f66241588d0 legacy=0x7f66240c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.590+0000 7f6623fff700 1 -- 172.21.15.72:0/2805652586 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66240c0a50 con 0x7f66240cb940 2023-08-31T19:26:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.590+0000 7f6623fff700 1 --2- 172.21.15.72:0/2805652586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66240cb940 0x7f66241583e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f6610009790 tx=0x7f6610009060).ready entity=mon.2 client_cookie=b7a319770b300af4 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.591+0000 7f66237fe700 1 -- 172.21.15.72:0/2805652586 <== mon.2 v2:172.21.15.146:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661000f510 con 0x7f66240cb940 2023-08-31T19:26:53.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.591+0000 7f66237fe700 1 -- 172.21.15.72:0/2805652586 <== mon.2 v2:172.21.15.146:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661000f670 con 0x7f66240cb940 2023-08-31T19:26:53.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.591+0000 7f66237fe700 1 -- 172.21.15.72:0/2805652586 <== mon.2 v2:172.21.15.146:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661000f9f0 con 0x7f66240cb940 2023-08-31T19:26:53.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.591+0000 7f662b1ff700 1 -- 172.21.15.72:0/2805652586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66240cb940 msgr2=0x7f66241583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:53.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.591+0000 7f662b1ff700 1 --2- 172.21.15.72:0/2805652586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66240cb940 0x7f66241583e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f6610009790 tx=0x7f6610009060).stop 2023-08-31T19:26:53.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.591+0000 7f662b1ff700 1 -- 172.21.15.72:0/2805652586 shutdown_connections 2023-08-31T19:26:53.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.591+0000 7f662b1ff700 1 --2- 172.21.15.72:0/2805652586 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66240cb940 0x7f66241583e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.591+0000 7f662b1ff700 1 -- 172.21.15.72:0/2805652586 >> 172.21.15.72:0/2805652586 conn(0x7f662405e870 msgr2=0x7f66240cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.591+0000 7f662b1ff700 1 -- 172.21.15.72:0/2805652586 shutdown_connections 2023-08-31T19:26:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.591+0000 7f662b1ff700 1 -- 172.21.15.72:0/2805652586 wait complete. 2023-08-31T19:26:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.593+0000 7f662b1ff700 1 Processor -- start 2023-08-31T19:26:53.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.593+0000 7f662b1ff700 1 -- start start 2023-08-31T19:26:53.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.594+0000 7f662b1ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66240cb940 0x7f662414f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:53.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.594+0000 7f662b1ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6624154220 0x7f66240c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:53.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.594+0000 7f662b1ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66241588d0 0x7f66240ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:53.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.594+0000 7f662b1ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66240ab010 con 0x7f66241588d0 2023-08-31T19:26:53.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.594+0000 7f662b1ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662414fa90 con 0x7f66240cb940 2023-08-31T19:26:53.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.594+0000 7f662b1ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66240c8450 con 0x7f6624154220 2023-08-31T19:26:53.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.594+0000 7f662979c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66241588d0 0x7f66240ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:53.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.594+0000 7f662979c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66241588d0 0x7f66240ab4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47236/0 (socket says 172.21.15.72:47236) 2023-08-31T19:26:53.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.594+0000 7f662979c700 1 -- 172.21.15.72:0/4129154075 learned_addr learned my addr 172.21.15.72:0/4129154075 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:53.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.594+0000 7f6623fff700 1 --2- 172.21.15.72:0/4129154075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6624154220 0x7f66240c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:53.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.594+0000 7f6628f9b700 1 --2- 172.21.15.72:0/4129154075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66240cb940 0x7f662414f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:53.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.595+0000 7f662979c700 1 -- 172.21.15.72:0/4129154075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6624154220 msgr2=0x7f66240c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:53.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.595+0000 7f662979c700 1 --2- 172.21.15.72:0/4129154075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6624154220 0x7f66240c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.595+0000 7f662979c700 1 -- 172.21.15.72:0/4129154075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66240cb940 msgr2=0x7f662414f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.595+0000 7f662979c700 1 --2- 172.21.15.72:0/4129154075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66240cb940 0x7f662414f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.595+0000 7f662979c700 1 -- 172.21.15.72:0/4129154075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66100092a0 con 0x7f66241588d0 2023-08-31T19:26:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.595+0000 7f6623fff700 1 --2- 172.21.15.72:0/4129154075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6624154220 0x7f66240c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.595+0000 7f662979c700 1 --2- 172.21.15.72:0/4129154075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66241588d0 0x7f66240ab4a0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7f661c001560 tx=0x7f661c001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.595+0000 7f6620ff9700 1 -- 172.21.15.72:0/4129154075 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c005d30 con 0x7f66241588d0 2023-08-31T19:26:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.595+0000 7f6620ff9700 1 -- 172.21.15.72:0/4129154075 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c005e90 con 0x7f66241588d0 2023-08-31T19:26:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.595+0000 7f662b1ff700 1 -- 172.21.15.72:0/4129154075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66240aa9c0 con 0x7f66241588d0 2023-08-31T19:26:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.595+0000 7f6620ff9700 1 -- 172.21.15.72:0/4129154075 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c007360 con 0x7f66241588d0 2023-08-31T19:26:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.595+0000 7f662b1ff700 1 -- 172.21.15.72:0/4129154075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66240c7250 con 0x7f66241588d0 2023-08-31T19:26:53.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.596+0000 7f662b1ff700 1 -- 172.21.15.72:0/4129154075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662406c6b0 con 0x7f66241588d0 2023-08-31T19:26:53.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.597+0000 7f6620ff9700 1 -- 172.21.15.72:0/4129154075 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f661c007710 con 0x7f66241588d0 2023-08-31T19:26:53.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.599+0000 7f6620ff9700 1 --2- 172.21.15.72:0/4129154075 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f660805ef30 0x7f66080613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:53.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.599+0000 7f6620ff9700 1 -- 172.21.15.72:0/4129154075 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f661c07a180 con 0x7f66241588d0 2023-08-31T19:26:53.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.599+0000 7f6628f9b700 1 --2- 172.21.15.72:0/4129154075 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f660805ef30 0x7f66080613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:53.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.599+0000 7f6628f9b700 1 --2- 172.21.15.72:0/4129154075 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f660805ef30 0x7f66080613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f66241587a0 tx=0x7f6618009040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:53.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.602+0000 7f6620ff9700 1 -- 172.21.15.72:0/4129154075 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f661c04b280 con 0x7f66241588d0 2023-08-31T19:26:53.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.773+0000 7f662b1ff700 1 -- 172.21.15.72:0/4129154075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66240ca400 con 0x7f66241588d0 2023-08-31T19:26:53.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.774+0000 7f6620ff9700 1 -- 172.21.15.72:0/4129154075 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+15625 (secure 0 0 0) 0x7f661c053d20 con 0x7f66241588d0 2023-08-31T19:26:53.775 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:53.775 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":201,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:26:50.403357+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6833/3040541253":"2023-09-01T19:26:46.492646+0000","172.21.15.72:0/995116102":"2023-09-01T19:26:46.374413+0000","172.21.15.72:0/3028708533":"2023-09-01T19:26:46.374413+0000","172.21.15.72:0/2943655478":"2023-09-01T19:26:46.374413+0000","172.21.15.72:0/290144061":"2023-09-01T19:26:46.374413+0000","172.21.15.72:0/1464897052":"2023-09-01T19:26:46.374413+0000","172.21.15.72:0/3780867317":"2023-09-01T19:26:37.533809+0000","172.21.15.72:6833/189426":"2023-09-01T19:26:37.533809+0000","172.21.15.146:6835/3040541253":"2023-09-01T19:26:46.492646+0000","172.21.15.72:6832/189426":"2023-09-01T19:26:37.533809+0000","172.21.15.72:0/1369089719":"2023-09-01T19:26:37.533809+0000","172.21.15.72:0/3101987496":"2023-09-01T19:26:37.533809+0000","172.21.15.72:0/2121781009":"2023-09-01T19:26:37.533809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:26:53.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.776+0000 7f662b1ff700 1 -- 172.21.15.72:0/4129154075 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f660805ef30 msgr2=0x7f66080613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:53.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.776+0000 7f662b1ff700 1 --2- 172.21.15.72:0/4129154075 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f660805ef30 0x7f66080613f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f66241587a0 tx=0x7f6618009040).stop 2023-08-31T19:26:53.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.776+0000 7f662b1ff700 1 -- 172.21.15.72:0/4129154075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66241588d0 msgr2=0x7f66240ab4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:53.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.776+0000 7f662b1ff700 1 --2- 172.21.15.72:0/4129154075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66241588d0 0x7f66240ab4a0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7f661c001560 tx=0x7f661c001650).stop 2023-08-31T19:26:53.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.777+0000 7f662b1ff700 1 -- 172.21.15.72:0/4129154075 shutdown_connections 2023-08-31T19:26:53.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.777+0000 7f662b1ff700 1 --2- 172.21.15.72:0/4129154075 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f660805ef30 0x7f66080613f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:53.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.777+0000 7f662b1ff700 1 --2- 172.21.15.72:0/4129154075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66241588d0 0x7f66240ab4a0 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:53.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.777+0000 7f662b1ff700 1 --2- 172.21.15.72:0/4129154075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66240cb940 0x7f662414f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:53.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.777+0000 7f662b1ff700 1 --2- 172.21.15.72:0/4129154075 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6624154220 0x7f66240c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:53.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.777+0000 7f662b1ff700 1 -- 172.21.15.72:0/4129154075 >> 172.21.15.72:0/4129154075 conn(0x7f662405e870 msgr2=0x7f66240a7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:53.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.777+0000 7f662b1ff700 1 -- 172.21.15.72:0/4129154075 shutdown_connections 2023-08-31T19:26:53.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.777+0000 7f662b1ff700 1 -- 172.21.15.72:0/4129154075 wait complete. 2023-08-31T19:26:53.795 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-31T19:26:53.795 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:26:53.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.984+0000 7f4ede7ff700 1 Processor -- start 2023-08-31T19:26:53.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.984+0000 7f4ede7ff700 1 -- start start 2023-08-31T19:26:53.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.986+0000 7f4ede7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed8154220 0x7f4ed8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:53.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.986+0000 7f4ede7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4ed81588d0 0x7f4ed80c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:53.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.986+0000 7f4ede7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed80c8c90 con 0x7f4ed80cb940 2023-08-31T19:26:53.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.986+0000 7f4ede7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed80aa700 con 0x7f4ed81588d0 2023-08-31T19:26:53.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.986+0000 7f4ede7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80c5e10 con 0x7f4ed8154220 2023-08-31T19:26:53.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.986+0000 7f4ed77fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4ed80cb940 0x7f4ed81581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35118/0 (socket says 172.21.15.72:35118) 2023-08-31T19:26:53.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.986+0000 7f4ed77fe700 1 -- 172.21.15.72:0/1390533731 learned_addr learned my addr 172.21.15.72:0/1390533731 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:53.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.986+0000 7f4edcd9c700 1 --2- 172.21.15.72:0/1390533731 >> v2:172.21.15.72:3300/0 conn(0x7f4ed81588d0 0x7f4ed80c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:53.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.986+0000 7f4ed7fff700 1 --2- 172.21.15.72:0/1390533731 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed8154220 0x7f4ed8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:53.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.986+0000 7f4ed6ffd700 1 -- 172.21.15.72:0/1390533731 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071442296 0 0) 0x7f4ed80c8c90 con 0x7f4ed80cb940 2023-08-31T19:26:53.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.986+0000 7f4ed6ffd700 1 -- 172.21.15.72:0/1390533731 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ec00033f0 con 0x7f4ed80cb940 2023-08-31T19:26:53.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.986+0000 7f4edcd9c700 1 -- 172.21.15.72:0/1390533731 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed8154220 msgr2=0x7f4ed8157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:53.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.986+0000 7f4edcd9c700 1 --2- 172.21.15.72:0/1390533731 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed8154220 0x7f4ed8157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:53.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.987+0000 7f4edcd9c700 1 -- 172.21.15.72:0/1390533731 >> v1:172.21.15.72:6789/0 conn(0x7f4ed80cb940 legacy=0x7f4ed81581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:53.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.987+0000 7f4edcd9c700 1 -- 172.21.15.72:0/1390533731 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8155610 con 0x7f4ed81588d0 2023-08-31T19:26:53.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.987+0000 7f4edcd9c700 1 --2- 172.21.15.72:0/1390533731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed81588d0 0x7f4ed80c6540 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7f4ed0009e60 tx=0x7f4ed0009780).ready entity=mon.0 client_cookie=3a4c0a1e4329476a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:53.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.987+0000 7f4ed6ffd700 1 -- 172.21.15.72:0/1390533731 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed000e070 con 0x7f4ed81588d0 2023-08-31T19:26:53.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.987+0000 7f4ed6ffd700 1 -- 172.21.15.72:0/1390533731 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed000bab0 con 0x7f4ed81588d0 2023-08-31T19:26:53.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.987+0000 7f4ed6ffd700 1 -- 172.21.15.72:0/1390533731 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed000be30 con 0x7f4ed81588d0 2023-08-31T19:26:53.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.987+0000 7f4ede7ff700 1 -- 172.21.15.72:0/1390533731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed81588d0 msgr2=0x7f4ed80c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:53.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.987+0000 7f4ede7ff700 1 --2- 172.21.15.72:0/1390533731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed81588d0 0x7f4ed80c6540 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7f4ed0009e60 tx=0x7f4ed0009780).stop 2023-08-31T19:26:53.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.988+0000 7f4ede7ff700 1 -- 172.21.15.72:0/1390533731 shutdown_connections 2023-08-31T19:26:53.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.988+0000 7f4ede7ff700 1 --2- 172.21.15.72:0/1390533731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed81588d0 0x7f4ed80c6540 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:53.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.988+0000 7f4ede7ff700 1 --2- 172.21.15.72:0/1390533731 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed8154220 0x7f4ed8157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:53.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.988+0000 7f4ede7ff700 1 -- 172.21.15.72:0/1390533731 >> 172.21.15.72:0/1390533731 conn(0x7f4ed805e870 msgr2=0x7f4ed80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:53.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.988+0000 7f4ede7ff700 1 -- 172.21.15.72:0/1390533731 shutdown_connections 2023-08-31T19:26:53.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.988+0000 7f4ede7ff700 1 -- 172.21.15.72:0/1390533731 wait complete. 2023-08-31T19:26:53.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.989+0000 7f4ede7ff700 1 Processor -- start 2023-08-31T19:26:53.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.989+0000 7f4ede7ff700 1 -- start start 2023-08-31T19:26:53.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.990+0000 7f4ede7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed80cb940 0x7f4ed8164470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:53.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.990+0000 7f4ede7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed8154220 0x7f4ed81632e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:53.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.990+0000 7f4ede7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ed81588d0 0x7f4ed80aa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:53.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.990+0000 7f4ede7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80acdb0 con 0x7f4ed8154220 2023-08-31T19:26:53.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.990+0000 7f4ede7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80abec0 con 0x7f4ed81588d0 2023-08-31T19:26:53.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.990+0000 7f4ede7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80ac1a0 con 0x7f4ed80cb940 2023-08-31T19:26:53.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.990+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed8154220 0x7f4ed81632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:53.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.990+0000 7f4ed77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed8154220 0x7f4ed81632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47246/0 (socket says 172.21.15.72:47246) 2023-08-31T19:26:53.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.990+0000 7f4ed77fe700 1 -- 172.21.15.72:0/3432540694 learned_addr learned my addr 172.21.15.72:0/3432540694 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:53.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.991+0000 7f4ed7fff700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed80cb940 0x7f4ed8164470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:53.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.991+0000 7f4edcd9c700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ed81588d0 0x7f4ed80aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:53.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.991+0000 7f4ed77fe700 1 -- 172.21.15.72:0/3432540694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed80cb940 msgr2=0x7f4ed8164470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:53.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.991+0000 7f4ed77fe700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed80cb940 0x7f4ed8164470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:53.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.991+0000 7f4ed77fe700 1 -- 172.21.15.72:0/3432540694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ed81588d0 msgr2=0x7f4ed80aa840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:53.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.991+0000 7f4ed77fe700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ed81588d0 0x7f4ed80aa840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:53.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.991+0000 7f4ed77fe700 1 -- 172.21.15.72:0/3432540694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed0009a20 con 0x7f4ed8154220 2023-08-31T19:26:53.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.991+0000 7f4ed7fff700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed80cb940 0x7f4ed8164470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:53.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.991+0000 7f4edcd9c700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ed81588d0 0x7f4ed80aa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:53.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.991+0000 7f4ed77fe700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed8154220 0x7f4ed81632e0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7f4ecc00c4c0 tx=0x7f4ecc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:54.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.991+0000 7f4ebffff700 1 -- 172.21.15.72:0/3432540694 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc0072e0 con 0x7f4ed8154220 2023-08-31T19:26:54.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.991+0000 7f4ebffff700 1 -- 172.21.15.72:0/3432540694 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc007440 con 0x7f4ed8154220 2023-08-31T19:26:54.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.991+0000 7f4ede7ff700 1 -- 172.21.15.72:0/3432540694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed80ac480 con 0x7f4ed8154220 2023-08-31T19:26:54.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.991+0000 7f4ebffff700 1 -- 172.21.15.72:0/3432540694 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc0057a0 con 0x7f4ed8154220 2023-08-31T19:26:54.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.991+0000 7f4ede7ff700 1 -- 172.21.15.72:0/3432540694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed80aca40 con 0x7f4ed8154220 2023-08-31T19:26:54.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.992+0000 7f4ede7ff700 1 -- 172.21.15.72:0/3432540694 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed80acbd0 con 0x7f4ed8154220 2023-08-31T19:26:54.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.993+0000 7f4ebffff700 1 -- 172.21.15.72:0/3432540694 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f4ecc005bd0 con 0x7f4ed8154220 2023-08-31T19:26:54.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.994+0000 7f4ebffff700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4ec405ef30 0x7f4ec40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:54.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.994+0000 7f4ebffff700 1 -- 172.21.15.72:0/3432540694 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f4ecc079960 con 0x7f4ed8154220 2023-08-31T19:26:54.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.994+0000 7f4ed7fff700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4ec405ef30 0x7f4ec40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:54.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.995+0000 7f4ed7fff700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4ec405ef30 0x7f4ec40613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4ec8006d20 tx=0x7f4ec8008040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:54.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:53.998+0000 7f4ebffff700 1 -- 172.21.15.72:0/3432540694 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ecc04aae0 con 0x7f4ed8154220 2023-08-31T19:26:54.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.165+0000 7f4ede7ff700 1 -- 172.21.15.72:0/3432540694 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ed80acef0 con 0x7f4ec405ef30 2023-08-31T19:26:54.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.168+0000 7f4ebffff700 1 -- 172.21.15.72:0/3432540694 <== mgr.9771 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71061 (secure 0 0 0) 0x7f4ec8009870 con 0x7f4ec405ef30 2023-08-31T19:26:54.169 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:54.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.170+0000 7f4ede7ff700 1 -- 172.21.15.72:0/3432540694 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4ec405ef30 msgr2=0x7f4ec40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:54.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.170+0000 7f4ede7ff700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4ec405ef30 0x7f4ec40613f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4ec8006d20 tx=0x7f4ec8008040).stop 2023-08-31T19:26:54.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.170+0000 7f4ede7ff700 1 -- 172.21.15.72:0/3432540694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed8154220 msgr2=0x7f4ed81632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:54.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.170+0000 7f4ede7ff700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed8154220 0x7f4ed81632e0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7f4ecc00c4c0 tx=0x7f4ecc007c50).stop 2023-08-31T19:26:54.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.170+0000 7f4ede7ff700 1 -- 172.21.15.72:0/3432540694 shutdown_connections 2023-08-31T19:26:54.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.170+0000 7f4ede7ff700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f4ec405ef30 0x7f4ec40613f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.170+0000 7f4ede7ff700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ed81588d0 0x7f4ed80aa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.170+0000 7f4ede7ff700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f4ed80cb940 0x7f4ed8164470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.170+0000 7f4ede7ff700 1 --2- 172.21.15.72:0/3432540694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed8154220 0x7f4ed81632e0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.170+0000 7f4ede7ff700 1 -- 172.21.15.72:0/3432540694 >> 172.21.15.72:0/3432540694 conn(0x7f4ed805e870 msgr2=0x7f4ed8063ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:54.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.170+0000 7f4ede7ff700 1 -- 172.21.15.72:0/3432540694 shutdown_connections 2023-08-31T19:26:54.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.170+0000 7f4ede7ff700 1 -- 172.21.15.72:0/3432540694 wait complete. 2023-08-31T19:26:54.174 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:26:54.188 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-08-31T19:26:52.394296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":218,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437256,"kb_used_data":19528,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752537464,"statfs":{"total":773094113280,"available":770598363136,"internally_reserved":0,"allocated":19996672,"data_stored":10901832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13037,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-67,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.008730"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":182,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.071545+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:26:50.071545+0000","last_peered":"2023-08-31T19:26:50.071545+0000","last_clean":"2023-08-31T19:26:50.071545+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:26:50.071545+0000","last_undegraded":"2023-08-31T19:26:50.071545+0000","last_fullsized":"2023-08-31T19:26:50.071545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":168,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-31T19:26:46.428525+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:26:46.428525+0000","last_peered":"2023-08-31T19:26:46.428525+0000","last_clean":"2023-08-31T19:26:46.428525+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:26:46.428525+0000","last_undegraded":"2023-08-31T19:26:46.428525+0000","last_fullsized":"2023-08-31T19:26:46.428525+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":175,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:49.410498+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:26:49.410498+0000","last_peered":"2023-08-31T19:26:49.410498+0000","last_clean":"2023-08-31T19:26:49.410498+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:26:49.410498+0000","last_undegraded":"2023-08-31T19:26:49.410498+0000","last_fullsized":"2023-08-31T19:26:49.410498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":168,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-31T19:26:46.428691+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:26:46.428691+0000","last_peered":"2023-08-31T19:26:46.428691+0000","last_clean":"2023-08-31T19:26:46.428691+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:26:46.428691+0000","last_undegraded":"2023-08-31T19:26:46.428691+0000","last_fullsized":"2023-08-31T19:26:46.428691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":167,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-31T19:26:46.387646+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:26:46.387646+0000","last_peered":"2023-08-31T19:26:46.387646+0000","last_clean":"2023-08-31T19:26:46.387646+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:26:46.387646+0000","last_undegraded":"2023-08-31T19:26:46.387646+0000","last_fullsized":"2023-08-31T19:26:46.387646+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":166,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-31T19:26:46.387684+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:26:46.387684+0000","last_peered":"2023-08-31T19:26:46.387684+0000","last_clean":"2023-08-31T19:26:46.387684+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:26:46.387684+0000","last_undegraded":"2023-08-31T19:26:46.387684+0000","last_fullsized":"2023-08-31T19:26:46.387684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-31T19:26:46.387411+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:26:46.387411+0000","last_peered":"2023-08-31T19:26:46.387411+0000","last_clean":"2023-08-31T19:26:46.387411+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:26:46.387411+0000","last_undegraded":"2023-08-31T19:26:46.387411+0000","last_fullsized":"2023-08-31T19:26:46.387411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":182,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.072743+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:26:50.072743+0000","last_peered":"2023-08-31T19:26:50.072743+0000","last_clean":"2023-08-31T19:26:50.072743+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:26:50.072743+0000","last_undegraded":"2023-08-31T19:26:50.072743+0000","last_fullsized":"2023-08-31T19:26:50.072743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":188,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.070187+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:26:50.070187+0000","last_peered":"2023-08-31T19:26:50.070187+0000","last_clean":"2023-08-31T19:26:50.070187+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:26:50.070187+0000","last_undegraded":"2023-08-31T19:26:50.070187+0000","last_fullsized":"2023-08-31T19:26:50.070187+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575307,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303612,"kb_used_data":2420,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068228,"statfs":{"total":96636764160,"available":96325865472,"internally_reserved":0,"allocated":2478080,"data_stored":1356354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.38200000000000001},"max":{"1min":0.90200000000000002,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.54700000000000004},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.98599999999999999},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41199999999999998},"max":{"1min":0.84799999999999998,"5min":0.92000000000000004,"15min":0.999},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.55300000000000005,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.45200000000000001},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.5}]},{"osd":3,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68100000000000005,"15min":0.70399999999999996},"min":{"1min":0.55700000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.006},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73399999999999999,"15min":0.746},"min":{"1min":0.56000000000000005,"5min":0.48899999999999999,"15min":0.48599999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.89100000000000001,"15min":0.96499999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.52500000000000002,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"max":{"1min":0.85799999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90100000000000002,"5min":1.0109999999999999,"15min":1.0449999999999999},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45200000000000001,"15min":0.442},"max":{"1min":0.90200000000000002,"5min":0.96799999999999997,"15min":0.98999999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.47199999999999998,"5min":0.45500000000000002,"15min":0.42999999999999999},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.437}]}]},{"osd":6,"up_from":13,"seq":55834575307,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.33800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.05},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.82299999999999995}]},{"osd":1,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0669999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.54200000000000004,"5min":0.502,"15min":0.45500000000000002},"max":{"1min":0.96299999999999997,"5min":1.0149999999999999,"15min":1.1579999999999999},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.745,"15min":0.746},"min":{"1min":0.53600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.198},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.1060000000000001},"last":0.88200000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90000000000000002,"5min":0.97399999999999998,"15min":1.0089999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77900000000000003,"15min":0.77700000000000002},"min":{"1min":0.57299999999999995,"5min":0.54100000000000004,"15min":0.495},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.296},"last":0.746}]},{"osd":4,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90600000000000003,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.66000000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.43099999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68000000000000005,"15min":0.67800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97899999999999998,"5min":1.032,"15min":1.3280000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.71299999999999997},"min":{"1min":0.54300000000000004,"5min":0.48699999999999999,"15min":0.47299999999999998},"max":{"1min":1.2649999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.73199999999999998,"15min":0.71099999999999997},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.46200000000000002},"max":{"1min":1.1639999999999999,"5min":1.165,"15min":1.165},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77300000000000002,"15min":0.76200000000000001},"min":{"1min":0.52700000000000002,"5min":0.505,"15min":0.48499999999999999},"max":{"1min":1.117,"5min":1.2270000000000001,"15min":1.24},"last":0.90900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575308,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.45000000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.66100000000000003,"15min":0.68100000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.35099999999999998,"5min":0.317,"15min":0.31},"max":{"1min":0.61699999999999999,"5min":0.71799999999999997,"15min":0.76400000000000001},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.496,"15min":0.51800000000000002},"min":{"1min":0.39800000000000002,"5min":0.36399999999999999,"15min":0.31},"max":{"1min":0.752,"5min":0.752,"15min":0.75800000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.35199999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.83799999999999997},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68600000000000005,"5min":0.77100000000000002,"15min":0.79200000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.96699999999999997},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.55700000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.169,"15min":1.1839999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.80400000000000005,"15min":0.82799999999999996},"min":{"1min":0.622,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.623},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78800000000000003},"min":{"1min":0.57299999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.262},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.75700000000000001,"15min":0.78800000000000003},"min":{"1min":0.621,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.165,"5min":1.198,"15min":1.198},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.58299999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.115,"5min":1.115,"15min":1.2849999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.77500000000000002,"15min":0.80000000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.085,"5min":1.097,"15min":1.224},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.59499999999999997,"5min":0.53300000000000003,"15min":0.51000000000000001},"max":{"1min":1.0569999999999999,"5min":1.1579999999999999,"15min":1.1859999999999999},"last":0.68000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575307,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67000000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73299999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.376}]},{"osd":2,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":0.72899999999999998,"15min":0.77000000000000002},"last":0.432},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.751,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.373,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64400000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.376},"max":{"1min":0.71899999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.63500000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.60999999999999999,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.347},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.75700000000000001,"15min":0.76900000000000002},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79900000000000004,"15min":0.80500000000000005},"min":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.21},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.83499999999999996,"15min":0.83999999999999997},"min":{"1min":0.67100000000000004,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.87}]},{"osd":7,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.24},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.872,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.65700000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.3340000000000001},"last":0.80200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575307,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.623,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.501},"min":{"1min":0.378,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.77600000000000002},"last":0.376}]},{"osd":1,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.81899999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.80900000000000005},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.33900000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.73099999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78800000000000003,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97599999999999998,"5min":1.105,"15min":1.2629999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54800000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.304},"last":0.93400000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.57299999999999995,"5min":0.51500000000000001,"15min":0.51300000000000001},"max":{"1min":1.014,"5min":1.1659999999999999,"15min":1.4019999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0660000000000001,"5min":1.0940000000000001,"15min":1.256},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.81000000000000005,"15min":0.81499999999999995},"min":{"1min":0.57399999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0449999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80000000000000004,"15min":0.81100000000000005},"min":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.27},"last":0.877}]},{"osd":7,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.82199999999999995,"15min":0.82299999999999995},"min":{"1min":0.59299999999999997,"5min":0.56299999999999994,"15min":0.54400000000000004},"max":{"1min":0.98399999999999999,"5min":1.232,"15min":1.302},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80500000000000005,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.103,"5min":1.115,"15min":1.3740000000000001},"last":0.79100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575306,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064120,"statfs":{"total":96636764160,"available":96321658880,"internally_reserved":0,"allocated":2490368,"data_stored":1354004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.437,"15min":0.443},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59799999999999998,"5min":0.69099999999999995,"15min":0.71899999999999997},"last":0.442},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.65800000000000003,"5min":0.72099999999999997,"15min":0.77600000000000002},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.35599999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65500000000000003,"5min":0.66800000000000004,"15min":0.77600000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.497}]},{"osd":2,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.46700000000000003,"5min":0.41699999999999998,"15min":0.379},"max":{"1min":0.73099999999999998,"5min":0.82499999999999996,"15min":0.90400000000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.88300000000000001,"15min":0.95399999999999996},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78200000000000003,"15min":0.76400000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1739999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.78200000000000003,"15min":0.77300000000000002},"min":{"1min":0.61899999999999999,"5min":0.56399999999999995,"15min":0.47899999999999998},"max":{"1min":1.1120000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.67000000000000004,"5min":0.53800000000000003,"15min":0.52400000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.6839999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.505},"max":{"1min":1.008,"5min":1.149,"15min":1.1819999999999999},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80800000000000005,"15min":0.80100000000000005},"min":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.153,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.79700000000000004,"15min":0.79900000000000004},"min":{"1min":0.61199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.2849999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81000000000000005,"15min":0.80900000000000005},"min":{"1min":0.64900000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.381},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81599999999999995,"15min":0.80900000000000005},"min":{"1min":0.70699999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2410000000000001,"5min":1.244,"15min":1.244},"last":0.75900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575306,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303600,"kb_used_data":2408,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068240,"statfs":{"total":96636764160,"available":96325877760,"internally_reserved":0,"allocated":2465792,"data_stored":1337541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88100000000000001,"5min":0.95899999999999996,"15min":1.048},"last":0.629},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.51800000000000002,"5min":0.45500000000000002,"15min":0.38500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.98199999999999998},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.495,"5min":0.49099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90100000000000002,"5min":0.98699999999999999,"15min":1.0289999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71899999999999997,"15min":0.72799999999999998},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.93100000000000005,"5min":0.995,"15min":1},"last":0.497}]},{"osd":2,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98199999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.51600000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.996},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.72499999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91200000000000003,"5min":0.95699999999999996,"15min":0.97699999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.753,"15min":0.755},"min":{"1min":0.56899999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94899999999999995,"5min":1.056,"15min":1.056},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.40699999999999997,"15min":0.39600000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95799999999999996},"last":0.44},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.442,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":0.82199999999999995,"5min":0.91900000000000004,"15min":0.98799999999999999},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.45700000000000002,"5min":0.44700000000000001,"15min":0.42299999999999999},"max":{"1min":0.80900000000000005,"5min":1.01,"15min":1.0649999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.498,"5min":0.46500000000000002,"15min":0.46300000000000002},"max":{"1min":0.91500000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.94899999999999995,"15min":1.0049999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.46300000000000002},"max":{"1min":0.94599999999999995,"5min":1.0369999999999999,"15min":1.115},"last":0.64900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575306,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303620,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068220,"statfs":{"total":96636764160,"available":96325857280,"internally_reserved":0,"allocated":2486272,"data_stored":1353293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.72499999999999998},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.41099999999999998},"max":{"1min":0.89000000000000001,"5min":1.141,"15min":1.141},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89700000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86899999999999999,"5min":1.103,"15min":1.103},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92800000000000005,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":0.72499999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86699999999999999,"5min":1.026,"15min":1.026},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":0.91100000000000003,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.747,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51400000000000001},"max":{"1min":0.89900000000000002,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.753},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96299999999999997,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.627,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.379},"max":{"1min":0.78100000000000003,"5min":0.997,"15min":0.997},"last":0.623},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.64700000000000002,"15min":0.63200000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.41299999999999998},"max":{"1min":0.84999999999999998,"5min":1.117,"15min":1.117},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.48399999999999999,"5min":0.44700000000000001,"15min":0.40000000000000002},"max":{"1min":0.81699999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70499999999999996,"15min":0.69499999999999995},"min":{"1min":0.52500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93500000000000005,"5min":1.2,"15min":1.2},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70899999999999996,"15min":0.70799999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47799999999999998},"max":{"1min":0.82399999999999995,"5min":1.202,"15min":1.202},"last":0.874},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.48699999999999999},"max":{"1min":0.878,"5min":1.004,"15min":1.004},"last":0.77000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:26:54.190 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:26:54.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.379+0000 7f12b03ff700 1 Processor -- start 2023-08-31T19:26:54.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.379+0000 7f12b03ff700 1 -- start start 2023-08-31T19:26:54.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.381+0000 7f12b03ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f12a8154060 0x7f12a8157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:54.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.381+0000 7f12b03ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a80c6120 con 0x7f12a80cb9b0 2023-08-31T19:26:54.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.381+0000 7f12b03ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a80c5e10 con 0x7f12a81588d0 2023-08-31T19:26:54.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.381+0000 7f12b03ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a80c1380 con 0x7f12a8154060 2023-08-31T19:26:54.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.381+0000 7f12ad99a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f12a80cb9b0 0x7f12a81581c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35132/0 (socket says 172.21.15.72:35132) 2023-08-31T19:26:54.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.381+0000 7f12ad99a700 1 -- 172.21.15.72:0/4224423483 learned_addr learned my addr 172.21.15.72:0/4224423483 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:54.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.381+0000 7f12ae19b700 1 --2- 172.21.15.72:0/4224423483 >> v2:172.21.15.146:3300/0 conn(0x7f12a8154060 0x7f12a8157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:54.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.381+0000 7f12ad199700 1 -- 172.21.15.72:0/4224423483 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585468055 0 0) 0x7f12a80c6120 con 0x7f12a80cb9b0 2023-08-31T19:26:54.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.381+0000 7f12ad199700 1 -- 172.21.15.72:0/4224423483 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12940033f0 con 0x7f12a80cb9b0 2023-08-31T19:26:54.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.381+0000 7f12ad199700 1 -- 172.21.15.72:0/4224423483 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671502550 0 0) 0x7f12a80c5e10 con 0x7f12a81588d0 2023-08-31T19:26:54.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.382+0000 7f12ad199700 1 -- 172.21.15.72:0/4224423483 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12a80c6120 con 0x7f12a81588d0 2023-08-31T19:26:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.382+0000 7f12ad199700 1 -- 172.21.15.72:0/4224423483 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3199669567 0 0) 0x7f12940033f0 con 0x7f12a80cb9b0 2023-08-31T19:26:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.382+0000 7f12ae19b700 1 -- 172.21.15.72:0/4224423483 >> v1:172.21.15.146:6789/0 conn(0x7f12a81588d0 legacy=0x7f12a8154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.382+0000 7f12ae19b700 1 -- 172.21.15.72:0/4224423483 >> v1:172.21.15.72:6789/0 conn(0x7f12a80cb9b0 legacy=0x7f12a81581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.382+0000 7f12ae19b700 1 -- 172.21.15.72:0/4224423483 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a80c0ae0 con 0x7f12a8154060 2023-08-31T19:26:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.382+0000 7f12ae19b700 1 --2- 172.21.15.72:0/4224423483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a8154060 0x7f12a8157cd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f12a4006fd0 tx=0x7f12a4006f40).ready entity=mon.1 client_cookie=46241f37c26bbb16 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:54.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.382+0000 7f12ad199700 1 -- 172.21.15.72:0/4224423483 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298001470 con 0x7f12a8154060 2023-08-31T19:26:54.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.382+0000 7f12ad199700 1 -- 172.21.15.72:0/4224423483 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a4005880 con 0x7f12a8154060 2023-08-31T19:26:54.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.382+0000 7f12ad199700 1 -- 172.21.15.72:0/4224423483 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4005c00 con 0x7f12a8154060 2023-08-31T19:26:54.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.383+0000 7f12b03ff700 1 -- 172.21.15.72:0/4224423483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a8154060 msgr2=0x7f12a8157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:54.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.383+0000 7f12b03ff700 1 --2- 172.21.15.72:0/4224423483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a8154060 0x7f12a8157cd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f12a4006fd0 tx=0x7f12a4006f40).stop 2023-08-31T19:26:54.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.383+0000 7f12b03ff700 1 -- 172.21.15.72:0/4224423483 shutdown_connections 2023-08-31T19:26:54.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.383+0000 7f12b03ff700 1 --2- 172.21.15.72:0/4224423483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a8154060 0x7f12a8157cd0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.383+0000 7f12b03ff700 1 -- 172.21.15.72:0/4224423483 >> 172.21.15.72:0/4224423483 conn(0x7f12a805e870 msgr2=0x7f12a80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:54.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.383+0000 7f12b03ff700 1 -- 172.21.15.72:0/4224423483 shutdown_connections 2023-08-31T19:26:54.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.383+0000 7f12b03ff700 1 -- 172.21.15.72:0/4224423483 wait complete. 2023-08-31T19:26:54.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.384+0000 7f12b03ff700 1 Processor -- start 2023-08-31T19:26:54.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.385+0000 7f12b03ff700 1 -- start start 2023-08-31T19:26:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.385+0000 7f12b03ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12a80cb9b0 0x7f12a80ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.385+0000 7f12b03ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a8154060 0x7f12a80af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.385+0000 7f12b03ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a81588d0 0x7f12a8163d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.385+0000 7f12b03ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a81568e0 con 0x7f12a80cb9b0 2023-08-31T19:26:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.385+0000 7f12b03ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a80ae410 con 0x7f12a81588d0 2023-08-31T19:26:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.385+0000 7f12b03ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a80aed90 con 0x7f12a8154060 2023-08-31T19:26:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.386+0000 7f12ae19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12a80cb9b0 0x7f12a80ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.386+0000 7f12ae19b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12a80cb9b0 0x7f12a80ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47254/0 (socket says 172.21.15.72:47254) 2023-08-31T19:26:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.386+0000 7f12ae19b700 1 -- 172.21.15.72:0/4017500215 learned_addr learned my addr 172.21.15.72:0/4017500215 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:54.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.386+0000 7f12ad99a700 1 --2- 172.21.15.72:0/4017500215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a8154060 0x7f12a80af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:54.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.386+0000 7f12ae99c700 1 --2- 172.21.15.72:0/4017500215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a81588d0 0x7f12a8163d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:54.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.386+0000 7f12ae19b700 1 -- 172.21.15.72:0/4017500215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a8154060 msgr2=0x7f12a80af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:54.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.386+0000 7f12ae19b700 1 --2- 172.21.15.72:0/4017500215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a8154060 0x7f12a80af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.386+0000 7f12ae19b700 1 -- 172.21.15.72:0/4017500215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a81588d0 msgr2=0x7f12a8163d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:54.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.386+0000 7f12ae19b700 1 --2- 172.21.15.72:0/4017500215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a81588d0 0x7f12a8163d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.386+0000 7f12ae19b700 1 -- 172.21.15.72:0/4017500215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a4009250 con 0x7f12a80cb9b0 2023-08-31T19:26:54.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.386+0000 7f12ae19b700 1 --2- 172.21.15.72:0/4017500215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12a80cb9b0 0x7f12a80ae8a0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7f12a4006d10 tx=0x7f12a4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:54.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.387+0000 7f129e7fc700 1 -- 172.21.15.72:0/4017500215 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4011600 con 0x7f12a80cb9b0 2023-08-31T19:26:54.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.387+0000 7f129e7fc700 1 -- 172.21.15.72:0/4017500215 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a4011760 con 0x7f12a80cb9b0 2023-08-31T19:26:54.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.387+0000 7f12b03ff700 1 -- 172.21.15.72:0/4017500215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a8164990 con 0x7f12a80cb9b0 2023-08-31T19:26:54.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.387+0000 7f129e7fc700 1 -- 172.21.15.72:0/4017500215 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4011b00 con 0x7f12a80cb9b0 2023-08-31T19:26:54.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.387+0000 7f12b03ff700 1 -- 172.21.15.72:0/4017500215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a80addc0 con 0x7f12a80cb9b0 2023-08-31T19:26:54.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.388+0000 7f12b03ff700 1 -- 172.21.15.72:0/4017500215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a806c6b0 con 0x7f12a80cb9b0 2023-08-31T19:26:54.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.389+0000 7f129e7fc700 1 -- 172.21.15.72:0/4017500215 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f12a401d3c0 con 0x7f12a80cb9b0 2023-08-31T19:26:54.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.390+0000 7f129e7fc700 1 --2- 172.21.15.72:0/4017500215 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f128c05ef30 0x7f128c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:54.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.390+0000 7f129e7fc700 1 -- 172.21.15.72:0/4017500215 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f12a407b400 con 0x7f12a80cb9b0 2023-08-31T19:26:54.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.390+0000 7f12ad99a700 1 --2- 172.21.15.72:0/4017500215 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f128c05ef30 0x7f128c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:54.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.391+0000 7f12ad99a700 1 --2- 172.21.15.72:0/4017500215 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f128c05ef30 0x7f128c0613f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f1298001ed0 tx=0x7f1298001a80).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:54.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.394+0000 7f129e7fc700 1 -- 172.21.15.72:0/4017500215 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f12a404c460 con 0x7f12a80cb9b0 2023-08-31T19:26:54.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.561+0000 7f12b03ff700 1 -- 172.21.15.72:0/4017500215 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12a80ae160 con 0x7f128c05ef30 2023-08-31T19:26:54.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.564+0000 7f129e7fc700 1 -- 172.21.15.72:0/4017500215 <== mgr.9771 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71147 (secure 0 0 0) 0x7f12a80ae160 con 0x7f128c05ef30 2023-08-31T19:26:54.565 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:54.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.566+0000 7f12b03ff700 1 -- 172.21.15.72:0/4017500215 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f128c05ef30 msgr2=0x7f128c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:54.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.566+0000 7f12b03ff700 1 --2- 172.21.15.72:0/4017500215 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f128c05ef30 0x7f128c0613f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f1298001ed0 tx=0x7f1298001a80).stop 2023-08-31T19:26:54.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.566+0000 7f12b03ff700 1 -- 172.21.15.72:0/4017500215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12a80cb9b0 msgr2=0x7f12a80ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:54.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.566+0000 7f12b03ff700 1 --2- 172.21.15.72:0/4017500215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12a80cb9b0 0x7f12a80ae8a0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7f12a4006d10 tx=0x7f12a4015000).stop 2023-08-31T19:26:54.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.566+0000 7f12b03ff700 1 -- 172.21.15.72:0/4017500215 shutdown_connections 2023-08-31T19:26:54.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.566+0000 7f12b03ff700 1 --2- 172.21.15.72:0/4017500215 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f128c05ef30 0x7f128c0613f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.566+0000 7f12b03ff700 1 --2- 172.21.15.72:0/4017500215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12a81588d0 0x7f12a8163d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.566+0000 7f12b03ff700 1 --2- 172.21.15.72:0/4017500215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12a80cb9b0 0x7f12a80ae8a0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.566+0000 7f12b03ff700 1 --2- 172.21.15.72:0/4017500215 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f12a8154060 0x7f12a80af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.566+0000 7f12b03ff700 1 -- 172.21.15.72:0/4017500215 >> 172.21.15.72:0/4017500215 conn(0x7f12a805e870 msgr2=0x7f12a8063090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:54.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.567+0000 7f12b03ff700 1 -- 172.21.15.72:0/4017500215 shutdown_connections 2023-08-31T19:26:54.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.567+0000 7f12b03ff700 1 -- 172.21.15.72:0/4017500215 wait complete. 2023-08-31T19:26:54.569 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:26:54.584 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-08-31T19:26:54.394606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2437408,"kb_used_data":19680,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752537312,"statfs":{"total":773094113280,"available":770598207488,"internally_reserved":0,"allocated":20152320,"data_stored":11001280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13037,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-67,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.008730"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":182,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.071545+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:26:50.071545+0000","last_peered":"2023-08-31T19:26:50.071545+0000","last_clean":"2023-08-31T19:26:50.071545+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:26:50.071545+0000","last_undegraded":"2023-08-31T19:26:50.071545+0000","last_fullsized":"2023-08-31T19:26:50.071545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":171,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.076925+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:26:50.076925+0000","last_peered":"2023-08-31T19:26:50.076925+0000","last_clean":"2023-08-31T19:26:50.076925+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:26:50.076925+0000","last_undegraded":"2023-08-31T19:26:50.076925+0000","last_fullsized":"2023-08-31T19:26:50.076925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":175,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:49.410498+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:26:49.410498+0000","last_peered":"2023-08-31T19:26:49.410498+0000","last_clean":"2023-08-31T19:26:49.410498+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:26:49.410498+0000","last_undegraded":"2023-08-31T19:26:49.410498+0000","last_fullsized":"2023-08-31T19:26:49.410498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":171,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.078996+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:26:50.078996+0000","last_peered":"2023-08-31T19:26:50.078996+0000","last_clean":"2023-08-31T19:26:50.078996+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:26:50.078996+0000","last_undegraded":"2023-08-31T19:26:50.078996+0000","last_fullsized":"2023-08-31T19:26:50.078996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":170,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.075663+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:26:50.075663+0000","last_peered":"2023-08-31T19:26:50.075663+0000","last_clean":"2023-08-31T19:26:50.075663+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:26:50.075663+0000","last_undegraded":"2023-08-31T19:26:50.075663+0000","last_fullsized":"2023-08-31T19:26:50.075663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.075751+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:26:50.075751+0000","last_peered":"2023-08-31T19:26:50.075751+0000","last_clean":"2023-08-31T19:26:50.075751+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:26:50.075751+0000","last_undegraded":"2023-08-31T19:26:50.075751+0000","last_fullsized":"2023-08-31T19:26:50.075751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.071617+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:26:50.071617+0000","last_peered":"2023-08-31T19:26:50.071617+0000","last_clean":"2023-08-31T19:26:50.071617+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:26:50.071617+0000","last_undegraded":"2023-08-31T19:26:50.071617+0000","last_fullsized":"2023-08-31T19:26:50.071617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":182,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.072743+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:26:50.072743+0000","last_peered":"2023-08-31T19:26:50.072743+0000","last_clean":"2023-08-31T19:26:50.072743+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:26:50.072743+0000","last_undegraded":"2023-08-31T19:26:50.072743+0000","last_fullsized":"2023-08-31T19:26:50.072743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":188,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.070187+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:26:50.070187+0000","last_peered":"2023-08-31T19:26:50.070187+0000","last_clean":"2023-08-31T19:26:50.070187+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:26:50.070187+0000","last_undegraded":"2023-08-31T19:26:50.070187+0000","last_fullsized":"2023-08-31T19:26:50.070187+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575308,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.38200000000000001},"max":{"1min":0.90200000000000002,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.54700000000000004},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.98599999999999999},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41199999999999998},"max":{"1min":0.84799999999999998,"5min":0.92000000000000004,"15min":0.999},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.55300000000000005,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.45200000000000001},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68100000000000005,"15min":0.70399999999999996},"min":{"1min":0.55700000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.006},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73399999999999999,"15min":0.746},"min":{"1min":0.56000000000000005,"5min":0.48899999999999999,"15min":0.48599999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.89100000000000001,"15min":0.96499999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.52500000000000002,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"max":{"1min":0.85799999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90100000000000002,"5min":1.0109999999999999,"15min":1.0449999999999999},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45200000000000001,"15min":0.442},"max":{"1min":0.90200000000000002,"5min":0.96799999999999997,"15min":0.98999999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.47199999999999998,"5min":0.45500000000000002,"15min":0.42999999999999999},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.84299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575307,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.33800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.05},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.82299999999999995}]},{"osd":1,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0669999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.54200000000000004,"5min":0.502,"15min":0.45500000000000002},"max":{"1min":0.96299999999999997,"5min":1.0149999999999999,"15min":1.1579999999999999},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.745,"15min":0.746},"min":{"1min":0.53600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.198},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.1060000000000001},"last":0.88200000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90000000000000002,"5min":0.97399999999999998,"15min":1.0089999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77900000000000003,"15min":0.77700000000000002},"min":{"1min":0.57299999999999995,"5min":0.54100000000000004,"15min":0.495},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.296},"last":0.746}]},{"osd":4,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90600000000000003,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.66000000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.43099999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68000000000000005,"15min":0.67800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97899999999999998,"5min":1.032,"15min":1.3280000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.71299999999999997},"min":{"1min":0.54300000000000004,"5min":0.48699999999999999,"15min":0.47299999999999998},"max":{"1min":1.2649999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.73199999999999998,"15min":0.71099999999999997},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.46200000000000002},"max":{"1min":1.1639999999999999,"5min":1.165,"15min":1.165},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77300000000000002,"15min":0.76200000000000001},"min":{"1min":0.52700000000000002,"5min":0.505,"15min":0.48499999999999999},"max":{"1min":1.117,"5min":1.2270000000000001,"15min":1.24},"last":0.90900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575308,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.45000000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.66100000000000003,"15min":0.68100000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.35099999999999998,"5min":0.317,"15min":0.31},"max":{"1min":0.61699999999999999,"5min":0.71799999999999997,"15min":0.76400000000000001},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.496,"15min":0.51800000000000002},"min":{"1min":0.39800000000000002,"5min":0.36399999999999999,"15min":0.31},"max":{"1min":0.752,"5min":0.752,"15min":0.75800000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.35199999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.83799999999999997},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68600000000000005,"5min":0.77100000000000002,"15min":0.79200000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.96699999999999997},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.55700000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.169,"15min":1.1839999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.80400000000000005,"15min":0.82799999999999996},"min":{"1min":0.622,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.623},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78800000000000003},"min":{"1min":0.57299999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.262},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.75700000000000001,"15min":0.78800000000000003},"min":{"1min":0.621,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.165,"5min":1.198,"15min":1.198},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.58299999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.115,"5min":1.115,"15min":1.2849999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.77500000000000002,"15min":0.80000000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.085,"5min":1.097,"15min":1.224},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.59499999999999997,"5min":0.53300000000000003,"15min":0.51000000000000001},"max":{"1min":1.0569999999999999,"5min":1.1579999999999999,"15min":1.1859999999999999},"last":0.68000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575307,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67000000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73299999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.376}]},{"osd":2,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":0.72899999999999998,"15min":0.77000000000000002},"last":0.432},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.751,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.373,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64400000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.376},"max":{"1min":0.71899999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.63500000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.60999999999999999,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.347},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.75700000000000001,"15min":0.76900000000000002},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79900000000000004,"15min":0.80500000000000005},"min":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.21},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.83499999999999996,"15min":0.83999999999999997},"min":{"1min":0.67100000000000004,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.87}]},{"osd":7,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.24},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.872,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.65700000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.3340000000000001},"last":0.80200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575307,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.623,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.501},"min":{"1min":0.378,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.77600000000000002},"last":0.376}]},{"osd":1,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.81899999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.80900000000000005},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.33900000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.73099999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78800000000000003,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97599999999999998,"5min":1.105,"15min":1.2629999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54800000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.304},"last":0.93400000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.57299999999999995,"5min":0.51500000000000001,"15min":0.51300000000000001},"max":{"1min":1.014,"5min":1.1659999999999999,"15min":1.4019999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0660000000000001,"5min":1.0940000000000001,"15min":1.256},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.81000000000000005,"15min":0.81499999999999995},"min":{"1min":0.57399999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0449999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80000000000000004,"15min":0.81100000000000005},"min":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.27},"last":0.877}]},{"osd":7,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.82199999999999995,"15min":0.82299999999999995},"min":{"1min":0.59299999999999997,"5min":0.56299999999999994,"15min":0.54400000000000004},"max":{"1min":0.98399999999999999,"5min":1.232,"15min":1.302},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80500000000000005,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.103,"5min":1.115,"15min":1.3740000000000001},"last":0.79100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575307,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.437,"15min":0.443},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59799999999999998,"5min":0.69099999999999995,"15min":0.71899999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.65800000000000003,"5min":0.72099999999999997,"15min":0.77600000000000002},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.35599999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65500000000000003,"5min":0.66800000000000004,"15min":0.77600000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.46700000000000003,"5min":0.41699999999999998,"15min":0.379},"max":{"1min":0.73099999999999998,"5min":0.82499999999999996,"15min":0.90400000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.88300000000000001,"15min":0.95399999999999996},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78200000000000003,"15min":0.76400000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1739999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.78200000000000003,"15min":0.77300000000000002},"min":{"1min":0.61899999999999999,"5min":0.56399999999999995,"15min":0.47899999999999998},"max":{"1min":1.1120000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.90700000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.67000000000000004,"5min":0.53800000000000003,"15min":0.52400000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.6839999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.505},"max":{"1min":1.008,"5min":1.149,"15min":1.1819999999999999},"last":0.96399999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80800000000000005,"15min":0.80100000000000005},"min":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.153,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.79700000000000004,"15min":0.79900000000000004},"min":{"1min":0.61199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.2849999999999999},"last":0.97499999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81000000000000005,"15min":0.80900000000000005},"min":{"1min":0.64900000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.381},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81599999999999995,"15min":0.80900000000000005},"min":{"1min":0.70699999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2410000000000001,"5min":1.244,"15min":1.244},"last":0.98799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575307,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88100000000000001,"5min":0.95899999999999996,"15min":1.048},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.51800000000000002,"5min":0.45500000000000002,"15min":0.38500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.98199999999999998},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.495,"5min":0.49099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90100000000000002,"5min":0.98699999999999999,"15min":1.0289999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71899999999999997,"15min":0.72799999999999998},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.93100000000000005,"5min":0.995,"15min":1},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98199999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.51600000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.996},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.72499999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91200000000000003,"5min":0.95699999999999996,"15min":0.97699999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.753,"15min":0.755},"min":{"1min":0.56899999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94899999999999995,"5min":1.056,"15min":1.056},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.40699999999999997,"15min":0.39600000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95799999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.442,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":0.82199999999999995,"5min":0.91900000000000004,"15min":0.98799999999999999},"last":0.754}]},{"osd":6,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.45700000000000002,"5min":0.44700000000000001,"15min":0.42299999999999999},"max":{"1min":0.80900000000000005,"5min":1.01,"15min":1.0649999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.498,"5min":0.46500000000000002,"15min":0.46300000000000002},"max":{"1min":0.91500000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.94899999999999995,"15min":1.0049999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.46300000000000002},"max":{"1min":0.94599999999999995,"5min":1.0369999999999999,"15min":1.115},"last":0.76300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575307,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.72499999999999998},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.41099999999999998},"max":{"1min":0.89000000000000001,"5min":1.141,"15min":1.141},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89700000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86899999999999999,"5min":1.103,"15min":1.103},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92800000000000005,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":0.72499999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86699999999999999,"5min":1.026,"15min":1.026},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":0.91100000000000003,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.747,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51400000000000001},"max":{"1min":0.89900000000000002,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.753},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96299999999999997,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.627,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.379},"max":{"1min":0.78100000000000003,"5min":0.997,"15min":0.997},"last":0.623},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.64700000000000002,"15min":0.63200000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.41299999999999998},"max":{"1min":0.84999999999999998,"5min":1.117,"15min":1.117},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.48399999999999999,"5min":0.44700000000000001,"15min":0.40000000000000002},"max":{"1min":0.81699999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70499999999999996,"15min":0.69499999999999995},"min":{"1min":0.52500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93500000000000005,"5min":1.2,"15min":1.2},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70899999999999996,"15min":0.70799999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47799999999999998},"max":{"1min":0.82399999999999995,"5min":1.202,"15min":1.202},"last":0.874},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.48699999999999999},"max":{"1min":0.878,"5min":1.004,"15min":1.004},"last":0.77000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:26:54.587 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-31T19:26:54.587 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:26:54.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.777+0000 7f7932bff700 1 Processor -- start 2023-08-31T19:26:54.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.777+0000 7f7932bff700 1 -- start start 2023-08-31T19:26:54.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.779+0000 7f7932bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c1505b0 0x7f792c0c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:54.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.779+0000 7f7932bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f792c0c2b10 0x7f792c0c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:54.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.779+0000 7f7932bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f792c0641e0 con 0x7f792c150990 2023-08-31T19:26:54.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.779+0000 7f7932bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792c0c2720 con 0x7f792c0c2b10 2023-08-31T19:26:54.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.779+0000 7f7932bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c068b90 con 0x7f792c1505b0 2023-08-31T19:26:54.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.779+0000 7f793119c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f792c150990 0x7f792c154290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35136/0 (socket says 172.21.15.72:35136) 2023-08-31T19:26:54.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.779+0000 7f793119c700 1 -- 172.21.15.72:0/209889462 learned_addr learned my addr 172.21.15.72:0/209889462 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:54.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.779+0000 7f792bfff700 1 --2- 172.21.15.72:0/209889462 >> v2:172.21.15.72:3300/0 conn(0x7f792c0c2b10 0x7f792c0c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:54.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.780+0000 7f793099b700 1 --2- 172.21.15.72:0/209889462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c1505b0 0x7f792c0c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:54.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.780+0000 7f792b7fe700 1 -- 172.21.15.72:0/209889462 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211914287 0 0) 0x7f792c0641e0 con 0x7f792c150990 2023-08-31T19:26:54.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.780+0000 7f792b7fe700 1 -- 172.21.15.72:0/209889462 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f791c0033f0 con 0x7f792c150990 2023-08-31T19:26:54.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.780+0000 7f792bfff700 1 -- 172.21.15.72:0/209889462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c1505b0 msgr2=0x7f792c0c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:54.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.780+0000 7f792bfff700 1 --2- 172.21.15.72:0/209889462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c1505b0 0x7f792c0c1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.780+0000 7f792bfff700 1 -- 172.21.15.72:0/209889462 >> v1:172.21.15.72:6789/0 conn(0x7f792c150990 legacy=0x7f792c154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:54.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.780+0000 7f792bfff700 1 -- 172.21.15.72:0/209889462 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c151580 con 0x7f792c0c2b10 2023-08-31T19:26:54.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.780+0000 7f792bfff700 1 --2- 172.21.15.72:0/209889462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c0c2b10 0x7f792c0c2230 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7f791800a900 tx=0x7f791800a200).ready entity=mon.0 client_cookie=4e10ba032006a48a server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:54.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.780+0000 7f792b7fe700 1 -- 172.21.15.72:0/209889462 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791800c790 con 0x7f792c0c2b10 2023-08-31T19:26:54.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.780+0000 7f792b7fe700 1 -- 172.21.15.72:0/209889462 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791800c8f0 con 0x7f792c0c2b10 2023-08-31T19:26:54.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.780+0000 7f792b7fe700 1 -- 172.21.15.72:0/209889462 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791800cc70 con 0x7f792c0c2b10 2023-08-31T19:26:54.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.781+0000 7f7932bff700 1 -- 172.21.15.72:0/209889462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c0c2b10 msgr2=0x7f792c0c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:54.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.781+0000 7f7932bff700 1 --2- 172.21.15.72:0/209889462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c0c2b10 0x7f792c0c2230 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 rx=0x7f791800a900 tx=0x7f791800a200).stop 2023-08-31T19:26:54.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.781+0000 7f7932bff700 1 -- 172.21.15.72:0/209889462 shutdown_connections 2023-08-31T19:26:54.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.781+0000 7f7932bff700 1 --2- 172.21.15.72:0/209889462 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c1505b0 0x7f792c0c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.781+0000 7f7932bff700 1 --2- 172.21.15.72:0/209889462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c0c2b10 0x7f792c0c2230 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.781+0000 7f7932bff700 1 -- 172.21.15.72:0/209889462 >> 172.21.15.72:0/209889462 conn(0x7f792c0c6b10 msgr2=0x7f792c0c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:54.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.781+0000 7f7932bff700 1 -- 172.21.15.72:0/209889462 shutdown_connections 2023-08-31T19:26:54.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.781+0000 7f7932bff700 1 -- 172.21.15.72:0/209889462 wait complete. 2023-08-31T19:26:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.782+0000 7f7932bff700 1 Processor -- start 2023-08-31T19:26:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.783+0000 7f7932bff700 1 -- start start 2023-08-31T19:26:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.783+0000 7f7932bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c0c2b10 0x7f792c14b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.783+0000 7f7932bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c1505b0 0x7f792c14bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.783+0000 7f7932bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792c150990 0x7f792c1445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:54.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.783+0000 7f7932bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c168c70 con 0x7f792c1505b0 2023-08-31T19:26:54.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.783+0000 7f7932bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c14c440 con 0x7f792c150990 2023-08-31T19:26:54.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.783+0000 7f7932bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c14c6e0 con 0x7f792c0c2b10 2023-08-31T19:26:54.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f792bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c1505b0 0x7f792c14bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:54.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f792bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c1505b0 0x7f792c14bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47262/0 (socket says 172.21.15.72:47262) 2023-08-31T19:26:54.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f792bfff700 1 -- 172.21.15.72:0/56307560 learned_addr learned my addr 172.21.15.72:0/56307560 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:54.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f793119c700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792c150990 0x7f792c1445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:54.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f793099b700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c0c2b10 0x7f792c14b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:54.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f792bfff700 1 -- 172.21.15.72:0/56307560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c0c2b10 msgr2=0x7f792c14b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:54.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f792bfff700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c0c2b10 0x7f792c14b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f792bfff700 1 -- 172.21.15.72:0/56307560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792c150990 msgr2=0x7f792c1445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:54.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f792bfff700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792c150990 0x7f792c1445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f792bfff700 1 -- 172.21.15.72:0/56307560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791800a440 con 0x7f792c1505b0 2023-08-31T19:26:54.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f793099b700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c0c2b10 0x7f792c14b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:54.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f793119c700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792c150990 0x7f792c1445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:54.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f792bfff700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c1505b0 0x7f792c14bf50 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7f792c0c4680 tx=0x7f791800a200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:54.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f7928ff9700 1 -- 172.21.15.72:0/56307560 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7918006cd0 con 0x7f792c1505b0 2023-08-31T19:26:54.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f7928ff9700 1 -- 172.21.15.72:0/56307560 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791800ca60 con 0x7f792c1505b0 2023-08-31T19:26:54.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.784+0000 7f7932bff700 1 -- 172.21.15.72:0/56307560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792c14c9c0 con 0x7f792c1505b0 2023-08-31T19:26:54.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.785+0000 7f7928ff9700 1 -- 172.21.15.72:0/56307560 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7918019650 con 0x7f792c1505b0 2023-08-31T19:26:54.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.785+0000 7f7932bff700 1 -- 172.21.15.72:0/56307560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792c14cf80 con 0x7f792c1505b0 2023-08-31T19:26:54.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.786+0000 7f7932bff700 1 -- 172.21.15.72:0/56307560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792c06c6b0 con 0x7f792c1505b0 2023-08-31T19:26:54.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.786+0000 7f7928ff9700 1 -- 172.21.15.72:0/56307560 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7918019a40 con 0x7f792c1505b0 2023-08-31T19:26:54.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.787+0000 7f7928ff9700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f791005ef30 0x7f79100613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:54.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.788+0000 7f7928ff9700 1 -- 172.21.15.72:0/56307560 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f791807b270 con 0x7f792c1505b0 2023-08-31T19:26:54.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.788+0000 7f793099b700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f791005ef30 0x7f79100613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:54.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.788+0000 7f793099b700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f791005ef30 0x7f79100613f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f79200098c0 tx=0x7f7920008040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:54.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.791+0000 7f7928ff9700 1 -- 172.21.15.72:0/56307560 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f791804c3f0 con 0x7f792c1505b0 2023-08-31T19:26:54.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.959+0000 7f7932bff700 1 -- 172.21.15.72:0/56307560 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f792c0c2880 con 0x7f791005ef30 2023-08-31T19:26:54.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.962+0000 7f7928ff9700 1 -- 172.21.15.72:0/56307560 <== mgr.9771 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71147 (secure 0 0 0) 0x7f792c0c2880 con 0x7f791005ef30 2023-08-31T19:26:54.963 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:54.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.964+0000 7f7932bff700 1 -- 172.21.15.72:0/56307560 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f791005ef30 msgr2=0x7f79100613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:54.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.964+0000 7f7932bff700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f791005ef30 0x7f79100613f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f79200098c0 tx=0x7f7920008040).stop 2023-08-31T19:26:54.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.964+0000 7f7932bff700 1 -- 172.21.15.72:0/56307560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c1505b0 msgr2=0x7f792c14bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:54.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.964+0000 7f7932bff700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c1505b0 0x7f792c14bf50 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7f792c0c4680 tx=0x7f791800a200).stop 2023-08-31T19:26:54.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.964+0000 7f7932bff700 1 -- 172.21.15.72:0/56307560 shutdown_connections 2023-08-31T19:26:54.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.964+0000 7f7932bff700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f791005ef30 0x7f79100613f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.964+0000 7f7932bff700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f792c150990 0x7f792c1445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.964+0000 7f7932bff700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f792c0c2b10 0x7f792c14b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.964+0000 7f7932bff700 1 --2- 172.21.15.72:0/56307560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f792c1505b0 0x7f792c14bf50 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:54.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.964+0000 7f7932bff700 1 -- 172.21.15.72:0/56307560 >> 172.21.15.72:0/56307560 conn(0x7f792c0c6b10 msgr2=0x7f792c069020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:54.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.965+0000 7f7932bff700 1 -- 172.21.15.72:0/56307560 shutdown_connections 2023-08-31T19:26:54.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:54.965+0000 7f7932bff700 1 -- 172.21.15.72:0/56307560 wait complete. 2023-08-31T19:26:54.967 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:26:54.982 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-08-31T19:26:54.394606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2437408,"kb_used_data":19680,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752537312,"statfs":{"total":773094113280,"available":770598207488,"internally_reserved":0,"allocated":20152320,"data_stored":11001280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13037,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-67,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.008730"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":182,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.071545+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:26:50.071545+0000","last_peered":"2023-08-31T19:26:50.071545+0000","last_clean":"2023-08-31T19:26:50.071545+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:26:50.071545+0000","last_undegraded":"2023-08-31T19:26:50.071545+0000","last_fullsized":"2023-08-31T19:26:50.071545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":171,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.076925+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:26:50.076925+0000","last_peered":"2023-08-31T19:26:50.076925+0000","last_clean":"2023-08-31T19:26:50.076925+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:26:50.076925+0000","last_undegraded":"2023-08-31T19:26:50.076925+0000","last_fullsized":"2023-08-31T19:26:50.076925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":175,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:49.410498+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:26:49.410498+0000","last_peered":"2023-08-31T19:26:49.410498+0000","last_clean":"2023-08-31T19:26:49.410498+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:26:49.410498+0000","last_undegraded":"2023-08-31T19:26:49.410498+0000","last_fullsized":"2023-08-31T19:26:49.410498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":171,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.078996+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:26:50.078996+0000","last_peered":"2023-08-31T19:26:50.078996+0000","last_clean":"2023-08-31T19:26:50.078996+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:26:50.078996+0000","last_undegraded":"2023-08-31T19:26:50.078996+0000","last_fullsized":"2023-08-31T19:26:50.078996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":170,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.075663+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:26:50.075663+0000","last_peered":"2023-08-31T19:26:50.075663+0000","last_clean":"2023-08-31T19:26:50.075663+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:26:50.075663+0000","last_undegraded":"2023-08-31T19:26:50.075663+0000","last_fullsized":"2023-08-31T19:26:50.075663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.075751+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:26:50.075751+0000","last_peered":"2023-08-31T19:26:50.075751+0000","last_clean":"2023-08-31T19:26:50.075751+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:26:50.075751+0000","last_undegraded":"2023-08-31T19:26:50.075751+0000","last_fullsized":"2023-08-31T19:26:50.075751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.071617+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:26:50.071617+0000","last_peered":"2023-08-31T19:26:50.071617+0000","last_clean":"2023-08-31T19:26:50.071617+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:26:50.071617+0000","last_undegraded":"2023-08-31T19:26:50.071617+0000","last_fullsized":"2023-08-31T19:26:50.071617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":182,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.072743+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:26:50.072743+0000","last_peered":"2023-08-31T19:26:50.072743+0000","last_clean":"2023-08-31T19:26:50.072743+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:26:50.072743+0000","last_undegraded":"2023-08-31T19:26:50.072743+0000","last_fullsized":"2023-08-31T19:26:50.072743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":188,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.070187+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:26:50.070187+0000","last_peered":"2023-08-31T19:26:50.070187+0000","last_clean":"2023-08-31T19:26:50.070187+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:26:50.070187+0000","last_undegraded":"2023-08-31T19:26:50.070187+0000","last_fullsized":"2023-08-31T19:26:50.070187+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575308,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.38200000000000001},"max":{"1min":0.90200000000000002,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.54700000000000004},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.98599999999999999},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41199999999999998},"max":{"1min":0.84799999999999998,"5min":0.92000000000000004,"15min":0.999},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.55300000000000005,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.45200000000000001},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68100000000000005,"15min":0.70399999999999996},"min":{"1min":0.55700000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.006},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73399999999999999,"15min":0.746},"min":{"1min":0.56000000000000005,"5min":0.48899999999999999,"15min":0.48599999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.89100000000000001,"15min":0.96499999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.52500000000000002,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"max":{"1min":0.85799999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90100000000000002,"5min":1.0109999999999999,"15min":1.0449999999999999},"last":0.86299999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45200000000000001,"15min":0.442},"max":{"1min":0.90200000000000002,"5min":0.96799999999999997,"15min":0.98999999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.47199999999999998,"5min":0.45500000000000002,"15min":0.42999999999999999},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.84299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575307,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.33800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.05},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.82299999999999995}]},{"osd":1,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0669999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.54200000000000004,"5min":0.502,"15min":0.45500000000000002},"max":{"1min":0.96299999999999997,"5min":1.0149999999999999,"15min":1.1579999999999999},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.745,"15min":0.746},"min":{"1min":0.53600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.198},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.1060000000000001},"last":0.88200000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90000000000000002,"5min":0.97399999999999998,"15min":1.0089999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77900000000000003,"15min":0.77700000000000002},"min":{"1min":0.57299999999999995,"5min":0.54100000000000004,"15min":0.495},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.296},"last":0.746}]},{"osd":4,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90600000000000003,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.66000000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.43099999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68000000000000005,"15min":0.67800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97899999999999998,"5min":1.032,"15min":1.3280000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.71299999999999997},"min":{"1min":0.54300000000000004,"5min":0.48699999999999999,"15min":0.47299999999999998},"max":{"1min":1.2649999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.73199999999999998,"15min":0.71099999999999997},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.46200000000000002},"max":{"1min":1.1639999999999999,"5min":1.165,"15min":1.165},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77300000000000002,"15min":0.76200000000000001},"min":{"1min":0.52700000000000002,"5min":0.505,"15min":0.48499999999999999},"max":{"1min":1.117,"5min":1.2270000000000001,"15min":1.24},"last":0.90900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575308,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.45000000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.66100000000000003,"15min":0.68100000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.35099999999999998,"5min":0.317,"15min":0.31},"max":{"1min":0.61699999999999999,"5min":0.71799999999999997,"15min":0.76400000000000001},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.496,"15min":0.51800000000000002},"min":{"1min":0.39800000000000002,"5min":0.36399999999999999,"15min":0.31},"max":{"1min":0.752,"5min":0.752,"15min":0.75800000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.35199999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.83799999999999997},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68600000000000005,"5min":0.77100000000000002,"15min":0.79200000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.96699999999999997},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.55700000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.169,"15min":1.1839999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.80400000000000005,"15min":0.82799999999999996},"min":{"1min":0.622,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.623},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78800000000000003},"min":{"1min":0.57299999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.262},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.75700000000000001,"15min":0.78800000000000003},"min":{"1min":0.621,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.165,"5min":1.198,"15min":1.198},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.58299999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.115,"5min":1.115,"15min":1.2849999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.77500000000000002,"15min":0.80000000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.085,"5min":1.097,"15min":1.224},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.59499999999999997,"5min":0.53300000000000003,"15min":0.51000000000000001},"max":{"1min":1.0569999999999999,"5min":1.1579999999999999,"15min":1.1859999999999999},"last":0.68000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575307,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67000000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73299999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.376}]},{"osd":2,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":0.72899999999999998,"15min":0.77000000000000002},"last":0.432},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.751,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.373,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64400000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.376},"max":{"1min":0.71899999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.63500000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.60999999999999999,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.347},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.75700000000000001,"15min":0.76900000000000002},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79900000000000004,"15min":0.80500000000000005},"min":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.21},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.83499999999999996,"15min":0.83999999999999997},"min":{"1min":0.67100000000000004,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.87}]},{"osd":7,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.24},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.872,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.65700000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.3340000000000001},"last":0.80200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575307,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.623,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.501},"min":{"1min":0.378,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.77600000000000002},"last":0.376}]},{"osd":1,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.81899999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.80900000000000005},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.33900000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.73099999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78800000000000003,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97599999999999998,"5min":1.105,"15min":1.2629999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54800000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.304},"last":0.93400000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.57299999999999995,"5min":0.51500000000000001,"15min":0.51300000000000001},"max":{"1min":1.014,"5min":1.1659999999999999,"15min":1.4019999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0660000000000001,"5min":1.0940000000000001,"15min":1.256},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.81000000000000005,"15min":0.81499999999999995},"min":{"1min":0.57399999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0449999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80000000000000004,"15min":0.81100000000000005},"min":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.27},"last":0.877}]},{"osd":7,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.82199999999999995,"15min":0.82299999999999995},"min":{"1min":0.59299999999999997,"5min":0.56299999999999994,"15min":0.54400000000000004},"max":{"1min":0.98399999999999999,"5min":1.232,"15min":1.302},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80500000000000005,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.103,"5min":1.115,"15min":1.3740000000000001},"last":0.79100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575307,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.437,"15min":0.443},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59799999999999998,"5min":0.69099999999999995,"15min":0.71899999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.65800000000000003,"5min":0.72099999999999997,"15min":0.77600000000000002},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.35599999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65500000000000003,"5min":0.66800000000000004,"15min":0.77600000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.46700000000000003,"5min":0.41699999999999998,"15min":0.379},"max":{"1min":0.73099999999999998,"5min":0.82499999999999996,"15min":0.90400000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.88300000000000001,"15min":0.95399999999999996},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78200000000000003,"15min":0.76400000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1739999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.78200000000000003,"15min":0.77300000000000002},"min":{"1min":0.61899999999999999,"5min":0.56399999999999995,"15min":0.47899999999999998},"max":{"1min":1.1120000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.90700000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.67000000000000004,"5min":0.53800000000000003,"15min":0.52400000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.6839999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.505},"max":{"1min":1.008,"5min":1.149,"15min":1.1819999999999999},"last":0.96399999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80800000000000005,"15min":0.80100000000000005},"min":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.153,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.79700000000000004,"15min":0.79900000000000004},"min":{"1min":0.61199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.2849999999999999},"last":0.97499999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81000000000000005,"15min":0.80900000000000005},"min":{"1min":0.64900000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.381},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81599999999999995,"15min":0.80900000000000005},"min":{"1min":0.70699999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2410000000000001,"5min":1.244,"15min":1.244},"last":0.98799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575307,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88100000000000001,"5min":0.95899999999999996,"15min":1.048},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.51800000000000002,"5min":0.45500000000000002,"15min":0.38500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.98199999999999998},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.495,"5min":0.49099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90100000000000002,"5min":0.98699999999999999,"15min":1.0289999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71899999999999997,"15min":0.72799999999999998},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.93100000000000005,"5min":0.995,"15min":1},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98199999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.51600000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.996},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.72499999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91200000000000003,"5min":0.95699999999999996,"15min":0.97699999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.753,"15min":0.755},"min":{"1min":0.56899999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94899999999999995,"5min":1.056,"15min":1.056},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.40699999999999997,"15min":0.39600000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95799999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.442,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":0.82199999999999995,"5min":0.91900000000000004,"15min":0.98799999999999999},"last":0.754}]},{"osd":6,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.45700000000000002,"5min":0.44700000000000001,"15min":0.42299999999999999},"max":{"1min":0.80900000000000005,"5min":1.01,"15min":1.0649999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.498,"5min":0.46500000000000002,"15min":0.46300000000000002},"max":{"1min":0.91500000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.94899999999999995,"15min":1.0049999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.46300000000000002},"max":{"1min":0.94599999999999995,"5min":1.0369999999999999,"15min":1.115},"last":0.76300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575307,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.72499999999999998},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.41099999999999998},"max":{"1min":0.89000000000000001,"5min":1.141,"15min":1.141},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89700000000000002,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.86899999999999999,"5min":1.103,"15min":1.103},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92800000000000005,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":0.72499999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.86699999999999999,"5min":1.026,"15min":1.026},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.53900000000000003,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":0.91100000000000003,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.747,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51400000000000001},"max":{"1min":0.89900000000000002,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.753},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96299999999999997,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.627,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.379},"max":{"1min":0.78100000000000003,"5min":0.997,"15min":0.997},"last":0.623},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.64700000000000002,"15min":0.63200000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.41299999999999998},"max":{"1min":0.84999999999999998,"5min":1.117,"15min":1.117},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.48399999999999999,"5min":0.44700000000000001,"15min":0.40000000000000002},"max":{"1min":0.81699999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.70499999999999996,"15min":0.69499999999999995},"min":{"1min":0.52500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93500000000000005,"5min":1.2,"15min":1.2},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.70899999999999996,"15min":0.70799999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47799999999999998},"max":{"1min":0.82399999999999995,"5min":1.202,"15min":1.202},"last":0.874},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.72299999999999998,"15min":0.71799999999999997},"min":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.48699999999999999},"max":{"1min":0.878,"5min":1.004,"15min":1.004},"last":0.77000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:26:54.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:26:55.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.171+0000 7f162fdff700 1 Processor -- start 2023-08-31T19:26:55.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.172+0000 7f162fdff700 1 -- start start 2023-08-31T19:26:55.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.173+0000 7f162fdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1628154060 0x7f1628157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:55.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.173+0000 7f162fdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16280cb9b0 0x7f16281581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:55.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.173+0000 7f162fdff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16280c6120 con 0x7f16281586b0 2023-08-31T19:26:55.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.173+0000 7f162fdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16280c1380 con 0x7f1628154060 2023-08-31T19:26:55.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.173+0000 7f162fdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1628158b60 con 0x7f16280cb9b0 2023-08-31T19:26:55.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.173+0000 7f162db9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1628154060 0x7f1628157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:55.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.173+0000 7f162db9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1628154060 0x7f1628157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47276/0 (socket says 172.21.15.72:47276) 2023-08-31T19:26:55.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.173+0000 7f162db9b700 1 -- 172.21.15.72:0/1076191655 learned_addr learned my addr 172.21.15.72:0/1076191655 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:55.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.173+0000 7f162d39a700 1 --2- 172.21.15.72:0/1076191655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16280cb9b0 0x7f16281581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:55.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.174+0000 7f162db9b700 1 -- 172.21.15.72:0/1076191655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16280cb9b0 msgr2=0x7f16281581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:55.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.174+0000 7f162db9b700 1 --2- 172.21.15.72:0/1076191655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16280cb9b0 0x7f16281581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:55.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.174+0000 7f162db9b700 1 -- 172.21.15.72:0/1076191655 >> v1:172.21.15.146:6789/0 conn(0x7f16281586b0 legacy=0x7f16280c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:55.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.174+0000 7f162db9b700 1 -- 172.21.15.72:0/1076191655 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16280c5e10 con 0x7f1628154060 2023-08-31T19:26:55.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.174+0000 7f162db9b700 1 --2- 172.21.15.72:0/1076191655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1628154060 0x7f1628157cd0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7f1624009840 tx=0x7f1624009060).ready entity=mon.0 client_cookie=ab538df147cc1797 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:55.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.174+0000 7f162cb99700 1 -- 172.21.15.72:0/1076191655 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624005880 con 0x7f1628154060 2023-08-31T19:26:55.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.174+0000 7f162cb99700 1 -- 172.21.15.72:0/1076191655 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16240059e0 con 0x7f1628154060 2023-08-31T19:26:55.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.174+0000 7f162cb99700 1 -- 172.21.15.72:0/1076191655 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624005d60 con 0x7f1628154060 2023-08-31T19:26:55.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.175+0000 7f162fdff700 1 -- 172.21.15.72:0/1076191655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1628154060 msgr2=0x7f1628157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:55.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.175+0000 7f162fdff700 1 --2- 172.21.15.72:0/1076191655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1628154060 0x7f1628157cd0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7f1624009840 tx=0x7f1624009060).stop 2023-08-31T19:26:55.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.175+0000 7f162fdff700 1 -- 172.21.15.72:0/1076191655 shutdown_connections 2023-08-31T19:26:55.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.175+0000 7f162fdff700 1 --2- 172.21.15.72:0/1076191655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1628154060 0x7f1628157cd0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:55.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.175+0000 7f162fdff700 1 --2- 172.21.15.72:0/1076191655 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16280cb9b0 0x7f16281581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:55.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.175+0000 7f162fdff700 1 -- 172.21.15.72:0/1076191655 >> 172.21.15.72:0/1076191655 conn(0x7f162805e870 msgr2=0x7f16280cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:55.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.175+0000 7f162fdff700 1 -- 172.21.15.72:0/1076191655 shutdown_connections 2023-08-31T19:26:55.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.175+0000 7f162fdff700 1 -- 172.21.15.72:0/1076191655 wait complete. 2023-08-31T19:26:55.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.176+0000 7f162fdff700 1 Processor -- start 2023-08-31T19:26:55.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.176+0000 7f162fdff700 1 -- start start 2023-08-31T19:26:55.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.177+0000 7f162fdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16280cb9b0 0x7f1628157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:55.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.177+0000 7f162fdff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1628154060 0x7f16281565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:55.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.177+0000 7f162fdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16281586b0 0x7f16281505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:55.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.177+0000 7f162fdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1628156120 con 0x7f16281586b0 2023-08-31T19:26:55.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.177+0000 7f162fdff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1628155830 con 0x7f1628154060 2023-08-31T19:26:55.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.177+0000 7f162fdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16280c2c00 con 0x7f16280cb9b0 2023-08-31T19:26:55.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.177+0000 7f162e39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16281586b0 0x7f16281505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:55.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.178+0000 7f162e39c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16281586b0 0x7f16281505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47286/0 (socket says 172.21.15.72:47286) 2023-08-31T19:26:55.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.178+0000 7f162e39c700 1 -- 172.21.15.72:0/900725824 learned_addr learned my addr 172.21.15.72:0/900725824 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:55.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.178+0000 7f162db9b700 1 --2- 172.21.15.72:0/900725824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16280cb9b0 0x7f1628157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:55.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.178+0000 7f162d39a700 1 --2- 172.21.15.72:0/900725824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1628154060 0x7f16281565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:55.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.178+0000 7f162e39c700 1 -- 172.21.15.72:0/900725824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16280cb9b0 msgr2=0x7f1628157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:55.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.178+0000 7f162e39c700 1 --2- 172.21.15.72:0/900725824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16280cb9b0 0x7f1628157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:55.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.178+0000 7f162e39c700 1 -- 172.21.15.72:0/900725824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1628154060 msgr2=0x7f16281565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:55.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.178+0000 7f162e39c700 1 --2- 172.21.15.72:0/900725824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1628154060 0x7f16281565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:55.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.178+0000 7f162e39c700 1 -- 172.21.15.72:0/900725824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1624009300 con 0x7f16281586b0 2023-08-31T19:26:55.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.178+0000 7f162e39c700 1 --2- 172.21.15.72:0/900725824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16281586b0 0x7f16281505d0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7f162000c7c0 tx=0x7f1620001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:55.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.178+0000 7f161dffb700 1 -- 172.21.15.72:0/900725824 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162000e4a0 con 0x7f16281586b0 2023-08-31T19:26:55.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.178+0000 7f161dffb700 1 -- 172.21.15.72:0/900725824 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162000e600 con 0x7f16281586b0 2023-08-31T19:26:55.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.178+0000 7f162fdff700 1 -- 172.21.15.72:0/900725824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1628155ad0 con 0x7f16281586b0 2023-08-31T19:26:55.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.178+0000 7f161dffb700 1 -- 172.21.15.72:0/900725824 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162000e980 con 0x7f16281586b0 2023-08-31T19:26:55.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.179+0000 7f162fdff700 1 -- 172.21.15.72:0/900725824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16280c2800 con 0x7f16281586b0 2023-08-31T19:26:55.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.180+0000 7f162fdff700 1 -- 172.21.15.72:0/900725824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1628155f70 con 0x7f16281586b0 2023-08-31T19:26:55.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.180+0000 7f161dffb700 1 -- 172.21.15.72:0/900725824 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f16200123f0 con 0x7f16281586b0 2023-08-31T19:26:55.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.181+0000 7f161dffb700 1 --2- 172.21.15.72:0/900725824 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f160c05ef30 0x7f160c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:55.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.181+0000 7f161dffb700 1 -- 172.21.15.72:0/900725824 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f1620079910 con 0x7f16281586b0 2023-08-31T19:26:55.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.182+0000 7f162db9b700 1 --2- 172.21.15.72:0/900725824 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f160c05ef30 0x7f160c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:55.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.182+0000 7f162db9b700 1 --2- 172.21.15.72:0/900725824 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f160c05ef30 0x7f160c0613f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1624009790 tx=0x7f1624016000).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:55.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.185+0000 7f161dffb700 1 -- 172.21.15.72:0/900725824 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f16200478f0 con 0x7f16281586b0 2023-08-31T19:26:55.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.356+0000 7f162fdff700 1 -- 172.21.15.72:0/900725824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f162806c6b0 con 0x7f16281586b0 2023-08-31T19:26:55.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.357+0000 7f161dffb700 1 -- 172.21.15.72:0/900725824 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+15625 (secure 0 0 0) 0x7f162004aa30 con 0x7f16281586b0 2023-08-31T19:26:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:26:55.358 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":201,"fsid":"acadb8ca-1685-49e1-a73f-5e9d14d95be9","created":"2023-08-31T18:47:33.476196+0000","modified":"2023-08-31T19:26:50.403357+0000","last_up_change":"2023-08-31T18:47:44.267948+0000","last_in_change":"2023-08-31T18:47:36.874120+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-31T18:47:44.329868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-31T18:47:45.969774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4012ab96-960c-462d-8153-cf60cd005a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":143801},{"type":"v1","addr":"172.21.15.72:6801","nonce":143801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":143801},{"type":"v1","addr":"172.21.15.72:6803","nonce":143801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":143801},{"type":"v1","addr":"172.21.15.72:6807","nonce":143801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":143801},{"type":"v1","addr":"172.21.15.72:6805","nonce":143801}]},"public_addr":"172.21.15.72:6801/143801","cluster_addr":"172.21.15.72:6803/143801","heartbeat_back_addr":"172.21.15.72:6807/143801","heartbeat_front_addr":"172.21.15.72:6805/143801","state":["exists","up"]},{"osd":1,"uuid":"74e4e488-1a88-4f4f-9b83-0c3ea61475d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":143815},{"type":"v1","addr":"172.21.15.72:6810","nonce":143815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":143815},{"type":"v1","addr":"172.21.15.72:6813","nonce":143815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":143815},{"type":"v1","addr":"172.21.15.72:6820","nonce":143815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":143815},{"type":"v1","addr":"172.21.15.72:6816","nonce":143815}]},"public_addr":"172.21.15.72:6810/143815","cluster_addr":"172.21.15.72:6813/143815","heartbeat_back_addr":"172.21.15.72:6820/143815","heartbeat_front_addr":"172.21.15.72:6816/143815","state":["exists","up"]},{"osd":2,"uuid":"bb0b0fb5-f185-4015-a8f6-240575cc8200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":143814},{"type":"v1","addr":"172.21.15.72:6823","nonce":143814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":143814},{"type":"v1","addr":"172.21.15.72:6826","nonce":143814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":143814},{"type":"v1","addr":"172.21.15.72:6831","nonce":143814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":143814},{"type":"v1","addr":"172.21.15.72:6829","nonce":143814}]},"public_addr":"172.21.15.72:6823/143814","cluster_addr":"172.21.15.72:6826/143814","heartbeat_back_addr":"172.21.15.72:6831/143814","heartbeat_front_addr":"172.21.15.72:6829/143814","state":["exists","up"]},{"osd":3,"uuid":"4dc9e815-0401-4f87-8fe9-f72ba6cff7a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6809","nonce":143821},{"type":"v1","addr":"172.21.15.72:6812","nonce":143821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":143821},{"type":"v1","addr":"172.21.15.72:6817","nonce":143821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":143821},{"type":"v1","addr":"172.21.15.72:6827","nonce":143821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":143821},{"type":"v1","addr":"172.21.15.72:6822","nonce":143821}]},"public_addr":"172.21.15.72:6812/143821","cluster_addr":"172.21.15.72:6817/143821","heartbeat_back_addr":"172.21.15.72:6827/143821","heartbeat_front_addr":"172.21.15.72:6822/143821","state":["exists","up"]},{"osd":4,"uuid":"ad5e37e5-b3ee-4cf4-bea1-e6515c979e25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":143461},{"type":"v1","addr":"172.21.15.146:6820","nonce":143461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6823","nonce":143461},{"type":"v1","addr":"172.21.15.146:6825","nonce":143461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":143461},{"type":"v1","addr":"172.21.15.146:6831","nonce":143461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":143461},{"type":"v1","addr":"172.21.15.146:6829","nonce":143461}]},"public_addr":"172.21.15.146:6820/143461","cluster_addr":"172.21.15.146:6825/143461","heartbeat_back_addr":"172.21.15.146:6831/143461","heartbeat_front_addr":"172.21.15.146:6829/143461","state":["exists","up"]},{"osd":5,"uuid":"b6d6e926-5670-4b55-a29e-fd323238eea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":143459},{"type":"v1","addr":"172.21.15.146:6801","nonce":143459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6803","nonce":143459},{"type":"v1","addr":"172.21.15.146:6805","nonce":143459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6811","nonce":143459},{"type":"v1","addr":"172.21.15.146:6813","nonce":143459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6807","nonce":143459},{"type":"v1","addr":"172.21.15.146:6809","nonce":143459}]},"public_addr":"172.21.15.146:6801/143459","cluster_addr":"172.21.15.146:6805/143459","heartbeat_back_addr":"172.21.15.146:6813/143459","heartbeat_front_addr":"172.21.15.146:6809/143459","state":["exists","up"]},{"osd":6,"uuid":"a02b3abf-114e-4270-9871-df7ddd7a83c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":143472},{"type":"v1","addr":"172.21.15.146:6818","nonce":143472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6819","nonce":143472},{"type":"v1","addr":"172.21.15.146:6821","nonce":143472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":143472},{"type":"v1","addr":"172.21.15.146:6827","nonce":143472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":143472},{"type":"v1","addr":"172.21.15.146:6824","nonce":143472}]},"public_addr":"172.21.15.146:6818/143472","cluster_addr":"172.21.15.146:6821/143472","heartbeat_back_addr":"172.21.15.146:6827/143472","heartbeat_front_addr":"172.21.15.146:6824/143472","state":["exists","up"]},{"osd":7,"uuid":"9d50c917-8daa-4801-aae0-8abed146e18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":143460},{"type":"v1","addr":"172.21.15.146:6804","nonce":143460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":143460},{"type":"v1","addr":"172.21.15.146:6808","nonce":143460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":143460},{"type":"v1","addr":"172.21.15.146:6815","nonce":143460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":143460},{"type":"v1","addr":"172.21.15.146:6812","nonce":143460}]},"public_addr":"172.21.15.146:6804/143460","cluster_addr":"172.21.15.146:6808/143460","heartbeat_back_addr":"172.21.15.146:6815/143460","heartbeat_front_addr":"172.21.15.146:6812/143460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.346286+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.423961+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.528825+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.437656+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.507411+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.381085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.518234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T18:47:42.484457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6833/3040541253":"2023-09-01T19:26:46.492646+0000","172.21.15.72:0/995116102":"2023-09-01T19:26:46.374413+0000","172.21.15.72:0/3028708533":"2023-09-01T19:26:46.374413+0000","172.21.15.72:0/2943655478":"2023-09-01T19:26:46.374413+0000","172.21.15.72:0/290144061":"2023-09-01T19:26:46.374413+0000","172.21.15.72:0/1464897052":"2023-09-01T19:26:46.374413+0000","172.21.15.72:0/3780867317":"2023-09-01T19:26:37.533809+0000","172.21.15.72:6833/189426":"2023-09-01T19:26:37.533809+0000","172.21.15.146:6835/3040541253":"2023-09-01T19:26:46.492646+0000","172.21.15.72:6832/189426":"2023-09-01T19:26:37.533809+0000","172.21.15.72:0/1369089719":"2023-09-01T19:26:37.533809+0000","172.21.15.72:0/3101987496":"2023-09-01T19:26:37.533809+0000","172.21.15.72:0/2121781009":"2023-09-01T19:26:37.533809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":2},{"begin":9,"length":2},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":2},{"begin":20,"length":3},{"begin":24,"length":1},{"begin":26,"length":2},{"begin":30,"length":3},{"begin":34,"length":1},{"begin":36,"length":2},{"begin":40,"length":3},{"begin":44,"length":1},{"begin":46,"length":2},{"begin":50,"length":3},{"begin":54,"length":1},{"begin":56,"length":2},{"begin":60,"length":3},{"begin":64,"length":1},{"begin":66,"length":2},{"begin":70,"length":3},{"begin":74,"length":1},{"begin":76,"length":2},{"begin":80,"length":3},{"begin":84,"length":1},{"begin":86,"length":2},{"begin":90,"length":3},{"begin":94,"length":1},{"begin":96,"length":2},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":157,"length":65}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:26:55.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.360+0000 7f162fdff700 1 -- 172.21.15.72:0/900725824 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f160c05ef30 msgr2=0x7f160c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:55.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.360+0000 7f162fdff700 1 --2- 172.21.15.72:0/900725824 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f160c05ef30 0x7f160c0613f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1624009790 tx=0x7f1624016000).stop 2023-08-31T19:26:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.360+0000 7f162fdff700 1 -- 172.21.15.72:0/900725824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16281586b0 msgr2=0x7f16281505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.360+0000 7f162fdff700 1 --2- 172.21.15.72:0/900725824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16281586b0 0x7f16281505d0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7f162000c7c0 tx=0x7f1620001510).stop 2023-08-31T19:26:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.360+0000 7f162fdff700 1 -- 172.21.15.72:0/900725824 shutdown_connections 2023-08-31T19:26:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.360+0000 7f162fdff700 1 --2- 172.21.15.72:0/900725824 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f160c05ef30 0x7f160c0613f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.360+0000 7f162fdff700 1 --2- 172.21.15.72:0/900725824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16281586b0 0x7f16281505d0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.360+0000 7f162fdff700 1 --2- 172.21.15.72:0/900725824 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f16280cb9b0 0x7f1628157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.360+0000 7f162fdff700 1 --2- 172.21.15.72:0/900725824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1628154060 0x7f16281565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.360+0000 7f162fdff700 1 -- 172.21.15.72:0/900725824 >> 172.21.15.72:0/900725824 conn(0x7f162805e870 msgr2=0x7f16281532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.360+0000 7f162fdff700 1 -- 172.21.15.72:0/900725824 shutdown_connections 2023-08-31T19:26:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:55.360+0000 7f162fdff700 1 -- 172.21.15.72:0/900725824 wait complete. 2023-08-31T19:26:56.378 INFO:tasks.ceph:Scrubbing osd.0 2023-08-31T19:26:56.379 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:26:56.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.579+0000 7f504ebff700 1 Processor -- start 2023-08-31T19:26:56.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.579+0000 7f504ebff700 1 -- start start 2023-08-31T19:26:56.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.581+0000 7f504ebff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f50480c3b20 0x7f50481537e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:56.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.581+0000 7f504ebff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5048065b60 con 0x7f5048153220 2023-08-31T19:26:56.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.581+0000 7f504ebff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50480c1880 con 0x7f5048155630 2023-08-31T19:26:56.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.581+0000 7f504ebff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5048155a10 con 0x7f50480c3b20 2023-08-31T19:26:56.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.581+0000 7f5047fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5048153220 0x7f50480c3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35146/0 (socket says 172.21.15.72:35146) 2023-08-31T19:26:56.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.581+0000 7f5047fff700 1 -- 172.21.15.72:0/997909409 learned_addr learned my addr 172.21.15.72:0/997909409 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:56.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.581+0000 7f504d19c700 1 --2- 172.21.15.72:0/997909409 >> v2:172.21.15.72:3300/0 conn(0x7f50480c3b20 0x7f50481537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:56.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.581+0000 7f50477fe700 1 -- 172.21.15.72:0/997909409 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303429694 0 0) 0x7f5048065b60 con 0x7f5048153220 2023-08-31T19:26:56.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.581+0000 7f50477fe700 1 -- 172.21.15.72:0/997909409 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50380033f0 con 0x7f5048153220 2023-08-31T19:26:56.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.581+0000 7f504d19c700 1 -- 172.21.15.72:0/997909409 >> v1:172.21.15.146:6789/0 conn(0x7f5048155630 legacy=0x7f50480bb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:56.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.581+0000 7f504d19c700 1 -- 172.21.15.72:0/997909409 >> v1:172.21.15.72:6789/0 conn(0x7f5048153220 legacy=0x7f50480c3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:56.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.582+0000 7f504d19c700 1 -- 172.21.15.72:0/997909409 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50480655c0 con 0x7f50480c3b20 2023-08-31T19:26:56.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.582+0000 7f504d19c700 1 --2- 172.21.15.72:0/997909409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50480c3b20 0x7f50481537e0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7f5040009e60 tx=0x7f5040009780).ready entity=mon.0 client_cookie=4e5034c52e3166df server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:56.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.582+0000 7f50477fe700 1 -- 172.21.15.72:0/997909409 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000e070 con 0x7f50480c3b20 2023-08-31T19:26:56.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.582+0000 7f50477fe700 1 -- 172.21.15.72:0/997909409 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504000bb20 con 0x7f50480c3b20 2023-08-31T19:26:56.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.582+0000 7f50477fe700 1 -- 172.21.15.72:0/997909409 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000bea0 con 0x7f50480c3b20 2023-08-31T19:26:56.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.582+0000 7f504ebff700 1 -- 172.21.15.72:0/997909409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50480c3b20 msgr2=0x7f50481537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:56.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.582+0000 7f504ebff700 1 --2- 172.21.15.72:0/997909409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50480c3b20 0x7f50481537e0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7f5040009e60 tx=0x7f5040009780).stop 2023-08-31T19:26:56.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.582+0000 7f504ebff700 1 -- 172.21.15.72:0/997909409 shutdown_connections 2023-08-31T19:26:56.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.582+0000 7f504ebff700 1 --2- 172.21.15.72:0/997909409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50480c3b20 0x7f50481537e0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:56.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.582+0000 7f504ebff700 1 -- 172.21.15.72:0/997909409 >> 172.21.15.72:0/997909409 conn(0x7f5048062650 msgr2=0x7f5048062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:56.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.583+0000 7f504ebff700 1 -- 172.21.15.72:0/997909409 shutdown_connections 2023-08-31T19:26:56.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.583+0000 7f504ebff700 1 -- 172.21.15.72:0/997909409 wait complete. 2023-08-31T19:26:56.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.584+0000 7f504ebff700 1 Processor -- start 2023-08-31T19:26:56.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.584+0000 7f504ebff700 1 -- start start 2023-08-31T19:26:56.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.585+0000 7f504ebff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50480c3b20 0x7f50480ac690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:56.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.585+0000 7f504ebff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5048153220 0x7f504814f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:56.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.585+0000 7f504ebff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5048155630 0x7f5048143340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:56.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.585+0000 7f504ebff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480ab1b0 con 0x7f5048155630 2023-08-31T19:26:56.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.585+0000 7f504ebff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504814fb00 con 0x7f50480c3b20 2023-08-31T19:26:56.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.585+0000 7f504ebff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50480aabf0 con 0x7f5048153220 2023-08-31T19:26:56.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.585+0000 7f504d19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5048155630 0x7f5048143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:56.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.585+0000 7f504d19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5048155630 0x7f5048143340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47306/0 (socket says 172.21.15.72:47306) 2023-08-31T19:26:56.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.585+0000 7f504d19c700 1 -- 172.21.15.72:0/203079785 learned_addr learned my addr 172.21.15.72:0/203079785 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:56.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.585+0000 7f5047fff700 1 --2- 172.21.15.72:0/203079785 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5048153220 0x7f504814f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:56.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.585+0000 7f504c99b700 1 --2- 172.21.15.72:0/203079785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50480c3b20 0x7f50480ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:56.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.586+0000 7f504d19c700 1 -- 172.21.15.72:0/203079785 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5048153220 msgr2=0x7f504814f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:56.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.586+0000 7f504d19c700 1 --2- 172.21.15.72:0/203079785 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f5048153220 0x7f504814f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:56.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.586+0000 7f504d19c700 1 -- 172.21.15.72:0/203079785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50480c3b20 msgr2=0x7f50480ac690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:56.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.586+0000 7f504d19c700 1 --2- 172.21.15.72:0/203079785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50480c3b20 0x7f50480ac690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:56.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.586+0000 7f504d19c700 1 -- 172.21.15.72:0/203079785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040009a20 con 0x7f5048155630 2023-08-31T19:26:56.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.586+0000 7f504d19c700 1 --2- 172.21.15.72:0/203079785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5048155630 0x7f5048143340 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7f504000bfc0 tx=0x7f5040009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:56.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.586+0000 7f5044ff9700 1 -- 172.21.15.72:0/203079785 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504001d630 con 0x7f5048155630 2023-08-31T19:26:56.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.586+0000 7f5044ff9700 1 -- 172.21.15.72:0/203079785 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504001d790 con 0x7f5048155630 2023-08-31T19:26:56.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.586+0000 7f5044ff9700 1 -- 172.21.15.72:0/203079785 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504001db30 con 0x7f5048155630 2023-08-31T19:26:56.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.586+0000 7f504ebff700 1 -- 172.21.15.72:0/203079785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50480aaed0 con 0x7f5048155630 2023-08-31T19:26:56.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.586+0000 7f504ebff700 1 -- 172.21.15.72:0/203079785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504814f0f0 con 0x7f5048155630 2023-08-31T19:26:56.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.587+0000 7f504ebff700 1 -- 172.21.15.72:0/203079785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f504806c6b0 con 0x7f5048155630 2023-08-31T19:26:56.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.588+0000 7f5044ff9700 1 -- 172.21.15.72:0/203079785 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f5040030430 con 0x7f5048155630 2023-08-31T19:26:56.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.589+0000 7f5044ff9700 1 --2- 172.21.15.72:0/203079785 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f502c05ef30 0x7f502c0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:56.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.589+0000 7f5044ff9700 1 -- 172.21.15.72:0/203079785 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f504007cca0 con 0x7f5048155630 2023-08-31T19:26:56.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.589+0000 7f504c99b700 1 --2- 172.21.15.72:0/203079785 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f502c05ef30 0x7f502c0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:56.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.589+0000 7f5044ff9700 1 --2- 172.21.15.72:0/203079785 >> [v2:172.21.15.72:6800/143801,v1:172.21.15.72:6801/143801] conn(0x7f502c065e00 0x7f502c068270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:56.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.589+0000 7f5044ff9700 1 -- 172.21.15.72:0/203079785 --> [v2:172.21.15.72:6800/143801,v1:172.21.15.72:6801/143801] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f502c068850 con 0x7f502c065e00 2023-08-31T19:26:56.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.589+0000 7f5044ff9700 1 -- 172.21.15.72:0/203079785 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7f504007cf90 con 0x7f5048155630 2023-08-31T19:26:56.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.590+0000 7f5047fff700 1 --2- 172.21.15.72:0/203079785 >> [v2:172.21.15.72:6800/143801,v1:172.21.15.72:6801/143801] conn(0x7f502c065e00 0x7f502c068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:56.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.590+0000 7f504c99b700 1 --2- 172.21.15.72:0/203079785 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f502c05ef30 0x7f502c0613f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f503c0036e0 tx=0x7f503c009040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:56.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.590+0000 7f5047fff700 1 --2- 172.21.15.72:0/203079785 >> [v2:172.21.15.72:6800/143801,v1:172.21.15.72:6801/143801] conn(0x7f502c065e00 0x7f502c068270 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:56.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.591+0000 7f5044ff9700 1 -- 172.21.15.72:0/203079785 <== osd.0 v2:172.21.15.72:6800/143801 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f502c068850 con 0x7f502c065e00 2023-08-31T19:26:56.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.604+0000 7f504ebff700 1 -- 172.21.15.72:0/203079785 --> [v2:172.21.15.72:6800/143801,v1:172.21.15.72:6801/143801] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f504805f0a0 con 0x7f502c065e00 2023-08-31T19:26:56.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.605+0000 7f5044ff9700 1 -- 172.21.15.72:0/203079785 <== osd.0 v2:172.21.15.72:6800/143801 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f504805f0a0 con 0x7f502c065e00 2023-08-31T19:26:56.605 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:26:56.606 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:26:56.606 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:26:56.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.605+0000 7f504ebff700 1 -- 172.21.15.72:0/203079785 >> [v2:172.21.15.72:6800/143801,v1:172.21.15.72:6801/143801] conn(0x7f502c065e00 msgr2=0x7f502c068270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:56.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.605+0000 7f504ebff700 1 --2- 172.21.15.72:0/203079785 >> [v2:172.21.15.72:6800/143801,v1:172.21.15.72:6801/143801] conn(0x7f502c065e00 0x7f502c068270 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:56.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.605+0000 7f504ebff700 1 -- 172.21.15.72:0/203079785 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f502c05ef30 msgr2=0x7f502c0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:56.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.605+0000 7f504ebff700 1 --2- 172.21.15.72:0/203079785 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f502c05ef30 0x7f502c0613f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f503c0036e0 tx=0x7f503c009040).stop 2023-08-31T19:26:56.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.605+0000 7f504ebff700 1 -- 172.21.15.72:0/203079785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5048155630 msgr2=0x7f5048143340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:56.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.605+0000 7f504ebff700 1 --2- 172.21.15.72:0/203079785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5048155630 0x7f5048143340 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7f504000bfc0 tx=0x7f5040009780).stop 2023-08-31T19:26:56.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.605+0000 7f504d19c700 1 -- 172.21.15.72:0/203079785 reap_dead start 2023-08-31T19:26:56.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.605+0000 7f504ebff700 1 -- 172.21.15.72:0/203079785 shutdown_connections 2023-08-31T19:26:56.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.605+0000 7f504ebff700 1 -- 172.21.15.72:0/203079785 >> 172.21.15.72:0/203079785 conn(0x7f5048062650 msgr2=0x7f5048153de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:56.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.605+0000 7f504ebff700 1 -- 172.21.15.72:0/203079785 shutdown_connections 2023-08-31T19:26:56.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.605+0000 7f504ebff700 1 -- 172.21.15.72:0/203079785 wait complete. 2023-08-31T19:26:56.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-08-31T19:26:56.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.811+0000 7f81fc7ff700 1 Processor -- start 2023-08-31T19:26:56.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.811+0000 7f81fc7ff700 1 -- start start 2023-08-31T19:26:56.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.812+0000 7f81fc7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f4067b30 0x7f81f4067f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:56.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.812+0000 7f81fc7ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f81f40c5090 0x7f81f41551f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:56.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.812+0000 7f81fc7ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81f4151810 0x7f81f4151c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:56.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.812+0000 7f81fc7ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f40a81b0 con 0x7f81f4151810 2023-08-31T19:26:56.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.812+0000 7f81fc7ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f41556e0 con 0x7f81f40c5090 2023-08-31T19:26:56.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.812+0000 7f81fc7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f4068750 con 0x7f81f4067b30 2023-08-31T19:26:56.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.813+0000 7f81fad9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81f4151810 0x7f81f4151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:56.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.813+0000 7f81fad9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81f4151810 0x7f81f4151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47320/0 (socket says 172.21.15.72:47320) 2023-08-31T19:26:56.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.813+0000 7f81fad9c700 1 -- 172.21.15.72:0/3325755908 learned_addr learned my addr 172.21.15.72:0/3325755908 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:56.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.813+0000 7f81fa59b700 1 --2- 172.21.15.72:0/3325755908 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f4067b30 0x7f81f4067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:56.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.813+0000 7f81f9d9a700 1 --2- 172.21.15.72:0/3325755908 >> v2:172.21.15.146:3300/0 conn(0x7f81f40c5090 0x7f81f41551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:56.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.813+0000 7f81fad9c700 1 -- 172.21.15.72:0/3325755908 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f4067b30 msgr2=0x7f81f4067f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:56.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.813+0000 7f81fad9c700 1 --2- 172.21.15.72:0/3325755908 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f4067b30 0x7f81f4067f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:56.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.813+0000 7f81fad9c700 1 -- 172.21.15.72:0/3325755908 >> v2:172.21.15.146:3300/0 conn(0x7f81f40c5090 msgr2=0x7f81f41551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:56.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.813+0000 7f81fad9c700 1 --2- 172.21.15.72:0/3325755908 >> v2:172.21.15.146:3300/0 conn(0x7f81f40c5090 0x7f81f41551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:56.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.813+0000 7f81fad9c700 1 -- 172.21.15.72:0/3325755908 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f40a7e80 con 0x7f81f4151810 2023-08-31T19:26:56.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.813+0000 7f81fad9c700 1 --2- 172.21.15.72:0/3325755908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f4151810 0x7f81f4151c50 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7f81f4065a60 tx=0x7f81ec009840).ready entity=mon.0 client_cookie=7f945c814c3acd0b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:56.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.813+0000 7f81f9599700 1 -- 172.21.15.72:0/3325755908 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec00e070 con 0x7f81f4151810 2023-08-31T19:26:56.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.813+0000 7f81f9599700 1 -- 172.21.15.72:0/3325755908 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec00b970 con 0x7f81f4151810 2023-08-31T19:26:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.814+0000 7f81f9599700 1 -- 172.21.15.72:0/3325755908 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec00bcf0 con 0x7f81f4151810 2023-08-31T19:26:56.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.814+0000 7f81fc7ff700 1 -- 172.21.15.72:0/3325755908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f4151810 msgr2=0x7f81f4151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:56.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.814+0000 7f81fc7ff700 1 --2- 172.21.15.72:0/3325755908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f4151810 0x7f81f4151c50 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 rx=0x7f81f4065a60 tx=0x7f81ec009840).stop 2023-08-31T19:26:56.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.814+0000 7f81fc7ff700 1 -- 172.21.15.72:0/3325755908 shutdown_connections 2023-08-31T19:26:56.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.814+0000 7f81fc7ff700 1 --2- 172.21.15.72:0/3325755908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f4151810 0x7f81f4151c50 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:56.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.814+0000 7f81fc7ff700 1 --2- 172.21.15.72:0/3325755908 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f4067b30 0x7f81f4067f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:56.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.814+0000 7f81fc7ff700 1 --2- 172.21.15.72:0/3325755908 >> v2:172.21.15.146:3300/0 conn(0x7f81f40c5090 0x7f81f41551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:56.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.814+0000 7f81fc7ff700 1 -- 172.21.15.72:0/3325755908 >> 172.21.15.72:0/3325755908 conn(0x7f81f40c8c20 msgr2=0x7f81f40c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:56.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.814+0000 7f81fc7ff700 1 -- 172.21.15.72:0/3325755908 shutdown_connections 2023-08-31T19:26:56.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.814+0000 7f81fc7ff700 1 -- 172.21.15.72:0/3325755908 wait complete. 2023-08-31T19:26:56.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.816+0000 7f81fc7ff700 1 Processor -- start 2023-08-31T19:26:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.816+0000 7f81fc7ff700 1 -- start start 2023-08-31T19:26:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fc7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f4067b30 0x7f81f4148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fc7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f40c5090 0x7f81f414c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fc7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f4151810 0x7f81f4159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fc7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40ad4a0 con 0x7f81f4067b30 2023-08-31T19:26:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fc7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f414dbf0 con 0x7f81f40c5090 2023-08-31T19:26:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fc7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f414c7e0 con 0x7f81f4151810 2023-08-31T19:26:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fa59b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f4067b30 0x7f81f4148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fa59b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f4067b30 0x7f81f4148f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47332/0 (socket says 172.21.15.72:47332) 2023-08-31T19:26:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fa59b700 1 -- 172.21.15.72:0/3895661416 learned_addr learned my addr 172.21.15.72:0/3895661416 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81f9d9a700 1 --2- 172.21.15.72:0/3895661416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f40c5090 0x7f81f414c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fad9c700 1 --2- 172.21.15.72:0/3895661416 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f4151810 0x7f81f4159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fa59b700 1 -- 172.21.15.72:0/3895661416 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f4151810 msgr2=0x7f81f4159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fa59b700 1 --2- 172.21.15.72:0/3895661416 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f4151810 0x7f81f4159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fa59b700 1 -- 172.21.15.72:0/3895661416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f40c5090 msgr2=0x7f81f414c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:56.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fa59b700 1 --2- 172.21.15.72:0/3895661416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f40c5090 0x7f81f414c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:56.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fa59b700 1 -- 172.21.15.72:0/3895661416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec009ae0 con 0x7f81f4067b30 2023-08-31T19:26:56.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.817+0000 7f81fa59b700 1 --2- 172.21.15.72:0/3895661416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f4067b30 0x7f81f4148f40 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f81f000e8d0 tx=0x7f81f0006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:56.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.818+0000 7f81ea7fc700 1 -- 172.21.15.72:0/3895661416 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0009450 con 0x7f81f4067b30 2023-08-31T19:26:56.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.818+0000 7f81ea7fc700 1 -- 172.21.15.72:0/3895661416 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f000c640 con 0x7f81f4067b30 2023-08-31T19:26:56.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.818+0000 7f81fc7ff700 1 -- 172.21.15.72:0/3895661416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f414cfe0 con 0x7f81f4067b30 2023-08-31T19:26:56.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.818+0000 7f81ea7fc700 1 -- 172.21.15.72:0/3895661416 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f000c9c0 con 0x7f81f4067b30 2023-08-31T19:26:56.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.818+0000 7f81fc7ff700 1 -- 172.21.15.72:0/3895661416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f414d5a0 con 0x7f81f4067b30 2023-08-31T19:26:56.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.819+0000 7f81fc7ff700 1 -- 172.21.15.72:0/3895661416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f406c6b0 con 0x7f81f4067b30 2023-08-31T19:26:56.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.820+0000 7f81ea7fc700 1 -- 172.21.15.72:0/3895661416 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f81f000cd30 con 0x7f81f4067b30 2023-08-31T19:26:56.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.820+0000 7f81ea7fc700 1 --2- 172.21.15.72:0/3895661416 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f81d805ef30 0x7f81d80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:56.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.820+0000 7f81ea7fc700 1 -- 172.21.15.72:0/3895661416 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f81f007a560 con 0x7f81f4067b30 2023-08-31T19:26:56.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.821+0000 7f81f9d9a700 1 --2- 172.21.15.72:0/3895661416 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f81d805ef30 0x7f81d80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:56.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.821+0000 7f81f9d9a700 1 --2- 172.21.15.72:0/3895661416 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f81d805ef30 0x7f81d80613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f81f4151210 tx=0x7f81e4008040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:56.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.825+0000 7f81ea7fc700 1 -- 172.21.15.72:0/3895661416 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f81f004f110 con 0x7f81f4067b30 2023-08-31T19:26:56.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.994+0000 7f81fc7ff700 1 -- 172.21.15.72:0/3895661416 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f81f40a4f40 con 0x7f81d805ef30 2023-08-31T19:26:56.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.995+0000 7f81ea7fc700 1 -- 172.21.15.72:0/3895661416 <== mgr.9771 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f81f40a4f40 con 0x7f81d805ef30 2023-08-31T19:26:56.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.997+0000 7f81fc7ff700 1 -- 172.21.15.72:0/3895661416 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f81d805ef30 msgr2=0x7f81d80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:56.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.997+0000 7f81fc7ff700 1 --2- 172.21.15.72:0/3895661416 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f81d805ef30 0x7f81d80613f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f81f4151210 tx=0x7f81e4008040).stop 2023-08-31T19:26:56.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.997+0000 7f81fc7ff700 1 -- 172.21.15.72:0/3895661416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f4067b30 msgr2=0x7f81f4148f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:56.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.997+0000 7f81fc7ff700 1 --2- 172.21.15.72:0/3895661416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f4067b30 0x7f81f4148f40 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f81f000e8d0 tx=0x7f81f0006f40).stop 2023-08-31T19:26:56.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.997+0000 7f81fc7ff700 1 -- 172.21.15.72:0/3895661416 shutdown_connections 2023-08-31T19:26:56.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.997+0000 7f81fc7ff700 1 --2- 172.21.15.72:0/3895661416 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f81d805ef30 0x7f81d80613f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:56.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.997+0000 7f81fc7ff700 1 --2- 172.21.15.72:0/3895661416 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f81f4151810 0x7f81f4159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:56.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.997+0000 7f81fc7ff700 1 --2- 172.21.15.72:0/3895661416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f4067b30 0x7f81f4148f40 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:56.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.997+0000 7f81fc7ff700 1 --2- 172.21.15.72:0/3895661416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81f40c5090 0x7f81f414c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:56.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.997+0000 7f81fc7ff700 1 -- 172.21.15.72:0/3895661416 >> 172.21.15.72:0/3895661416 conn(0x7f81f40c8c20 msgr2=0x7f81f4064100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:56.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.997+0000 7f81fc7ff700 1 -- 172.21.15.72:0/3895661416 shutdown_connections 2023-08-31T19:26:57.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:56.997+0000 7f81fc7ff700 1 -- 172.21.15.72:0/3895661416 wait complete. 2023-08-31T19:26:57.000 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 0 to deep-scrub 2023-08-31T19:26:57.014 INFO:tasks.ceph:Scrubbing osd.1 2023-08-31T19:26:57.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:26:57.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.206+0000 7f23d3fff700 1 Processor -- start 2023-08-31T19:26:57.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.206+0000 7f23d3fff700 1 -- start start 2023-08-31T19:26:57.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.208+0000 7f23d3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f23cc153db0 0x7f23cc154190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.208+0000 7f23d3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23cc0aa330 0x7f23cc0c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.208+0000 7f23d3fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23cc0c0650 con 0x7f23cc0c5d40 2023-08-31T19:26:57.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.208+0000 7f23d3fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23cc0bfd60 con 0x7f23cc153db0 2023-08-31T19:26:57.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.208+0000 7f23d3fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc0c0000 con 0x7f23cc0aa330 2023-08-31T19:26:57.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.208+0000 7f23d1d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f23cc153db0 0x7f23cc154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.208+0000 7f23d259c700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23cc0aa330 0x7f23cc0c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.208+0000 7f23d1d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f23cc153db0 0x7f23cc154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.72:59138/0 (socket says 172.21.15.72:59138) 2023-08-31T19:26:57.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.208+0000 7f23d1d9b700 1 -- 172.21.15.72:0/1766308426 learned_addr learned my addr 172.21.15.72:0/1766308426 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:57.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.208+0000 7f23d159a700 1 --1- 172.21.15.72:0/1766308426 >> v1:172.21.15.146:6789/0 conn(0x7f23cc0c5d40 0x7f23cc0a9c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.72:51540/0 (socket says 172.21.15.72:51540) 2023-08-31T19:26:57.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.209+0000 7f23d1d9b700 1 -- 172.21.15.72:0/1766308426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23cc0aa330 msgr2=0x7f23cc0c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:57.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.209+0000 7f23d1d9b700 1 --2- 172.21.15.72:0/1766308426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23cc0aa330 0x7f23cc0c61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.209+0000 7f23d1d9b700 1 -- 172.21.15.72:0/1766308426 >> v1:172.21.15.146:6789/0 conn(0x7f23cc0c5d40 legacy=0x7f23cc0a9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.209+0000 7f23d1d9b700 1 -- 172.21.15.72:0/1766308426 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc0c02e0 con 0x7f23cc153db0 2023-08-31T19:26:57.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.209+0000 7f23d1d9b700 1 --2- 172.21.15.72:0/1766308426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23cc153db0 0x7f23cc154190 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f23c8006fd0 tx=0x7f23c80090f0).ready entity=mon.1 client_cookie=84e8358cbe88b3fc server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:57.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.209+0000 7f23d0d99700 1 -- 172.21.15.72:0/1766308426 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c800b580 con 0x7f23cc153db0 2023-08-31T19:26:57.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.209+0000 7f23d0d99700 1 -- 172.21.15.72:0/1766308426 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c800b6e0 con 0x7f23cc153db0 2023-08-31T19:26:57.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.209+0000 7f23d0d99700 1 -- 172.21.15.72:0/1766308426 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c800ba80 con 0x7f23cc153db0 2023-08-31T19:26:57.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.210+0000 7f23d3fff700 1 -- 172.21.15.72:0/1766308426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23cc153db0 msgr2=0x7f23cc154190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.210+0000 7f23d3fff700 1 --2- 172.21.15.72:0/1766308426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23cc153db0 0x7f23cc154190 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f23c8006fd0 tx=0x7f23c80090f0).stop 2023-08-31T19:26:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.210+0000 7f23d3fff700 1 -- 172.21.15.72:0/1766308426 shutdown_connections 2023-08-31T19:26:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.210+0000 7f23d3fff700 1 --2- 172.21.15.72:0/1766308426 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23cc0aa330 0x7f23cc0c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.210+0000 7f23d3fff700 1 --2- 172.21.15.72:0/1766308426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23cc153db0 0x7f23cc154190 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.210+0000 7f23d3fff700 1 -- 172.21.15.72:0/1766308426 >> 172.21.15.72:0/1766308426 conn(0x7f23cc0cb7c0 msgr2=0x7f23cc0c7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.210+0000 7f23d3fff700 1 -- 172.21.15.72:0/1766308426 shutdown_connections 2023-08-31T19:26:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.210+0000 7f23d3fff700 1 -- 172.21.15.72:0/1766308426 wait complete. 2023-08-31T19:26:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.211+0000 7f23d3fff700 1 Processor -- start 2023-08-31T19:26:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.212+0000 7f23d3fff700 1 -- start start 2023-08-31T19:26:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.212+0000 7f23d3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23cc0aa330 0x7f23cc0c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.212+0000 7f23d3fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23cc0c5d40 0x7f23cc14d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.212+0000 7f23d3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23cc153db0 0x7f23cc0afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.212+0000 7f23d3fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc14fb90 con 0x7f23cc0aa330 2023-08-31T19:26:57.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.212+0000 7f23d3fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc0c4840 con 0x7f23cc153db0 2023-08-31T19:26:57.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.212+0000 7f23d3fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc0c4b20 con 0x7f23cc0c5d40 2023-08-31T19:26:57.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.213+0000 7f23d1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23cc0aa330 0x7f23cc0c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.213+0000 7f23d1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23cc0aa330 0x7f23cc0c2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47338/0 (socket says 172.21.15.72:47338) 2023-08-31T19:26:57.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.213+0000 7f23d1d9b700 1 -- 172.21.15.72:0/1648148137 learned_addr learned my addr 172.21.15.72:0/1648148137 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:57.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.213+0000 7f23d159a700 1 --2- 172.21.15.72:0/1648148137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23cc0c5d40 0x7f23cc14d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.213+0000 7f23d259c700 1 --2- 172.21.15.72:0/1648148137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23cc153db0 0x7f23cc0afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.213+0000 7f23d1d9b700 1 -- 172.21.15.72:0/1648148137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23cc0c5d40 msgr2=0x7f23cc14d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.213+0000 7f23d1d9b700 1 --2- 172.21.15.72:0/1648148137 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f23cc0c5d40 0x7f23cc14d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.213+0000 7f23d1d9b700 1 -- 172.21.15.72:0/1648148137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23cc153db0 msgr2=0x7f23cc0afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.213+0000 7f23d1d9b700 1 --2- 172.21.15.72:0/1648148137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23cc153db0 0x7f23cc0afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.213+0000 7f23d1d9b700 1 -- 172.21.15.72:0/1648148137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c8009370 con 0x7f23cc0aa330 2023-08-31T19:26:57.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.213+0000 7f23d1d9b700 1 --2- 172.21.15.72:0/1648148137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23cc0aa330 0x7f23cc0c2810 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7f23c8009ea0 tx=0x7f23c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:57.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.214+0000 7f23c1ffb700 1 -- 172.21.15.72:0/1648148137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8006d90 con 0x7f23cc0aa330 2023-08-31T19:26:57.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.214+0000 7f23c1ffb700 1 -- 172.21.15.72:0/1648148137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c800be40 con 0x7f23cc0aa330 2023-08-31T19:26:57.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.214+0000 7f23d3fff700 1 -- 172.21.15.72:0/1648148137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23cc0c4e00 con 0x7f23cc0aa330 2023-08-31T19:26:57.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.214+0000 7f23c1ffb700 1 -- 172.21.15.72:0/1648148137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8006970 con 0x7f23cc0aa330 2023-08-31T19:26:57.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.214+0000 7f23d3fff700 1 -- 172.21.15.72:0/1648148137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23cc1500c0 con 0x7f23cc0aa330 2023-08-31T19:26:57.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.214+0000 7f23d3fff700 1 -- 172.21.15.72:0/1648148137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f23cc06c6b0 con 0x7f23cc0aa330 2023-08-31T19:26:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.215+0000 7f23c1ffb700 1 -- 172.21.15.72:0/1648148137 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f23c801c630 con 0x7f23cc0aa330 2023-08-31T19:26:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.216+0000 7f23c1ffb700 1 --2- 172.21.15.72:0/1648148137 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f23b005ef30 0x7f23b00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.216+0000 7f23c1ffb700 1 -- 172.21.15.72:0/1648148137 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f23c807c1b0 con 0x7f23cc0aa330 2023-08-31T19:26:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.216+0000 7f23d159a700 1 --2- 172.21.15.72:0/1648148137 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f23b005ef30 0x7f23b00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.217+0000 7f23c1ffb700 1 --2- 172.21.15.72:0/1648148137 >> [v2:172.21.15.72:6808/143815,v1:172.21.15.72:6810/143815] conn(0x7f23b0065e00 0x7f23b0068270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.217+0000 7f23c1ffb700 1 -- 172.21.15.72:0/1648148137 --> [v2:172.21.15.72:6808/143815,v1:172.21.15.72:6810/143815] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f23b0068850 con 0x7f23b0065e00 2023-08-31T19:26:57.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.217+0000 7f23c1ffb700 1 -- 172.21.15.72:0/1648148137 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23c807c590 con 0x7f23cc0aa330 2023-08-31T19:26:57.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.217+0000 7f23d259c700 1 --2- 172.21.15.72:0/1648148137 >> [v2:172.21.15.72:6808/143815,v1:172.21.15.72:6810/143815] conn(0x7f23b0065e00 0x7f23b0068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.217+0000 7f23d159a700 1 --2- 172.21.15.72:0/1648148137 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f23b005ef30 0x7f23b00613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f23cc157c20 tx=0x7f23bc007d30).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:57.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.217+0000 7f23d259c700 1 --2- 172.21.15.72:0/1648148137 >> [v2:172.21.15.72:6808/143815,v1:172.21.15.72:6810/143815] conn(0x7f23b0065e00 0x7f23b0068270 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:57.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.218+0000 7f23c1ffb700 1 -- 172.21.15.72:0/1648148137 <== osd.1 v2:172.21.15.72:6808/143815 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f23b0068850 con 0x7f23b0065e00 2023-08-31T19:26:57.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.231+0000 7f23d3fff700 1 -- 172.21.15.72:0/1648148137 --> [v2:172.21.15.72:6808/143815,v1:172.21.15.72:6810/143815] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f23cc0c8570 con 0x7f23b0065e00 2023-08-31T19:26:57.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.232+0000 7f23c1ffb700 1 -- 172.21.15.72:0/1648148137 <== osd.1 v2:172.21.15.72:6808/143815 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f23cc0c8570 con 0x7f23b0065e00 2023-08-31T19:26:57.233 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:26:57.233 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:26:57.233 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:26:57.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.232+0000 7f23d3fff700 1 -- 172.21.15.72:0/1648148137 >> [v2:172.21.15.72:6808/143815,v1:172.21.15.72:6810/143815] conn(0x7f23b0065e00 msgr2=0x7f23b0068270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.232+0000 7f23d3fff700 1 --2- 172.21.15.72:0/1648148137 >> [v2:172.21.15.72:6808/143815,v1:172.21.15.72:6810/143815] conn(0x7f23b0065e00 0x7f23b0068270 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.232+0000 7f23d3fff700 1 -- 172.21.15.72:0/1648148137 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f23b005ef30 msgr2=0x7f23b00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.232+0000 7f23d3fff700 1 --2- 172.21.15.72:0/1648148137 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f23b005ef30 0x7f23b00613f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f23cc157c20 tx=0x7f23bc007d30).stop 2023-08-31T19:26:57.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.232+0000 7f23d3fff700 1 -- 172.21.15.72:0/1648148137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23cc0aa330 msgr2=0x7f23cc0c2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.232+0000 7f23d3fff700 1 --2- 172.21.15.72:0/1648148137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23cc0aa330 0x7f23cc0c2810 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7f23c8009ea0 tx=0x7f23c8017000).stop 2023-08-31T19:26:57.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.232+0000 7f23d259c700 1 -- 172.21.15.72:0/1648148137 reap_dead start 2023-08-31T19:26:57.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.232+0000 7f23d3fff700 1 -- 172.21.15.72:0/1648148137 shutdown_connections 2023-08-31T19:26:57.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.232+0000 7f23d3fff700 1 -- 172.21.15.72:0/1648148137 >> 172.21.15.72:0/1648148137 conn(0x7f23cc0cb7c0 msgr2=0x7f23cc0ac020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:57.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.233+0000 7f23d3fff700 1 -- 172.21.15.72:0/1648148137 shutdown_connections 2023-08-31T19:26:57.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.233+0000 7f23d3fff700 1 -- 172.21.15.72:0/1648148137 wait complete. 2023-08-31T19:26:57.249 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-08-31T19:26:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.439+0000 7fb5eb9ff700 1 Processor -- start 2023-08-31T19:26:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.440+0000 7fb5eb9ff700 1 -- start start 2023-08-31T19:26:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.441+0000 7fb5eb9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb5e4067b30 0x7fb5e4067f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.441+0000 7fb5eb9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e40a81b0 con 0x7fb5e4151f20 2023-08-31T19:26:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.441+0000 7fb5eb9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e4068750 con 0x7fb5e40c5090 2023-08-31T19:26:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.441+0000 7fb5eb9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e40a7e80 con 0x7fb5e4067b30 2023-08-31T19:26:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.442+0000 7fb5e9f9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb5e4151f20 0x7fb5e4157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35162/0 (socket says 172.21.15.72:35162) 2023-08-31T19:26:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.442+0000 7fb5e9f9c700 1 -- 172.21.15.72:0/4150025720 learned_addr learned my addr 172.21.15.72:0/4150025720 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.442+0000 7fb5e979b700 1 --2- 172.21.15.72:0/4150025720 >> v2:172.21.15.146:3300/0 conn(0x7fb5e4067b30 0x7fb5e4067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.442+0000 7fb5dbfff700 1 -- 172.21.15.72:0/4150025720 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734605272 0 0) 0x7fb5e40a81b0 con 0x7fb5e4151f20 2023-08-31T19:26:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.442+0000 7fb5dbfff700 1 -- 172.21.15.72:0/4150025720 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5d00033f0 con 0x7fb5e4151f20 2023-08-31T19:26:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.442+0000 7fb5e979b700 1 -- 172.21.15.72:0/4150025720 >> v1:172.21.15.146:6789/0 conn(0x7fb5e40c5090 legacy=0x7fb5e4151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.442+0000 7fb5e979b700 1 -- 172.21.15.72:0/4150025720 >> v1:172.21.15.72:6789/0 conn(0x7fb5e4151f20 legacy=0x7fb5e4157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.442+0000 7fb5e979b700 1 -- 172.21.15.72:0/4150025720 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e40bdb80 con 0x7fb5e4067b30 2023-08-31T19:26:57.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.443+0000 7fb5e979b700 1 --2- 172.21.15.72:0/4150025720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e4067b30 0x7fb5e4067f10 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fb5e0006fd0 tx=0x7fb5e0006f40).ready entity=mon.1 client_cookie=9d7806676ffb3d7c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:57.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.443+0000 7fb5dbfff700 1 -- 172.21.15.72:0/4150025720 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0005880 con 0x7fb5e4067b30 2023-08-31T19:26:57.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.443+0000 7fb5dbfff700 1 -- 172.21.15.72:0/4150025720 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e00059e0 con 0x7fb5e4067b30 2023-08-31T19:26:57.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.443+0000 7fb5dbfff700 1 -- 172.21.15.72:0/4150025720 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0005d60 con 0x7fb5e4067b30 2023-08-31T19:26:57.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.443+0000 7fb5eb9ff700 1 -- 172.21.15.72:0/4150025720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e4067b30 msgr2=0x7fb5e4067f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.443+0000 7fb5eb9ff700 1 --2- 172.21.15.72:0/4150025720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e4067b30 0x7fb5e4067f10 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fb5e0006fd0 tx=0x7fb5e0006f40).stop 2023-08-31T19:26:57.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.443+0000 7fb5eb9ff700 1 -- 172.21.15.72:0/4150025720 shutdown_connections 2023-08-31T19:26:57.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.443+0000 7fb5eb9ff700 1 --2- 172.21.15.72:0/4150025720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e4067b30 0x7fb5e4067f10 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.443+0000 7fb5eb9ff700 1 -- 172.21.15.72:0/4150025720 >> 172.21.15.72:0/4150025720 conn(0x7fb5e40c8c20 msgr2=0x7fb5e40c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:57.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.443+0000 7fb5eb9ff700 1 -- 172.21.15.72:0/4150025720 shutdown_connections 2023-08-31T19:26:57.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.444+0000 7fb5eb9ff700 1 -- 172.21.15.72:0/4150025720 wait complete. 2023-08-31T19:26:57.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.445+0000 7fb5eb9ff700 1 Processor -- start 2023-08-31T19:26:57.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.446+0000 7fb5eb9ff700 1 -- start start 2023-08-31T19:26:57.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.447+0000 7fb5eb9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5e4067b30 0x7fb5e40ac580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.447+0000 7fb5eb9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e40c5090 0x7fb5e40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.447+0000 7fb5eb9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e4151f20 0x7fb5e40a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.447+0000 7fb5eb9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e40ad8d0 con 0x7fb5e40c5090 2023-08-31T19:26:57.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.447+0000 7fb5eb9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e40a6c20 con 0x7fb5e4151f20 2023-08-31T19:26:57.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.447+0000 7fb5eb9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e40aca70 con 0x7fb5e4067b30 2023-08-31T19:26:57.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.447+0000 7fb5e8f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e40c5090 0x7fb5e40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.447+0000 7fb5e8f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e40c5090 0x7fb5e40a5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47344/0 (socket says 172.21.15.72:47344) 2023-08-31T19:26:57.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.447+0000 7fb5e8f9a700 1 -- 172.21.15.72:0/935329620 learned_addr learned my addr 172.21.15.72:0/935329620 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:57.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.447+0000 7fb5e979b700 1 --2- 172.21.15.72:0/935329620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5e4067b30 0x7fb5e40ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.447+0000 7fb5e9f9c700 1 --2- 172.21.15.72:0/935329620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e4151f20 0x7fb5e40a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.448+0000 7fb5e8f9a700 1 -- 172.21.15.72:0/935329620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5e4067b30 msgr2=0x7fb5e40ac580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.448+0000 7fb5e8f9a700 1 --2- 172.21.15.72:0/935329620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5e4067b30 0x7fb5e40ac580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.448+0000 7fb5e8f9a700 1 -- 172.21.15.72:0/935329620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e4151f20 msgr2=0x7fb5e40a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.448+0000 7fb5e8f9a700 1 --2- 172.21.15.72:0/935329620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e4151f20 0x7fb5e40a5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.448+0000 7fb5e8f9a700 1 -- 172.21.15.72:0/935329620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e0009250 con 0x7fb5e40c5090 2023-08-31T19:26:57.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.448+0000 7fb5e9f9c700 1 --2- 172.21.15.72:0/935329620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e4151f20 0x7fb5e40a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:57.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.448+0000 7fb5e8f9a700 1 --2- 172.21.15.72:0/935329620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e40c5090 0x7fb5e40a5810 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7fb5d400c4c0 tx=0x7fb5d4007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:57.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.448+0000 7fb5d97fa700 1 -- 172.21.15.72:0/935329620 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4007020 con 0x7fb5e40c5090 2023-08-31T19:26:57.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.448+0000 7fb5d97fa700 1 -- 172.21.15.72:0/935329620 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d4007180 con 0x7fb5e40c5090 2023-08-31T19:26:57.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.448+0000 7fb5eb9ff700 1 -- 172.21.15.72:0/935329620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e40accc0 con 0x7fb5e40c5090 2023-08-31T19:26:57.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.448+0000 7fb5d97fa700 1 -- 172.21.15.72:0/935329620 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4007520 con 0x7fb5e40c5090 2023-08-31T19:26:57.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.448+0000 7fb5eb9ff700 1 -- 172.21.15.72:0/935329620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e40ad280 con 0x7fb5e40c5090 2023-08-31T19:26:57.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.449+0000 7fb5eb9ff700 1 -- 172.21.15.72:0/935329620 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e4155980 con 0x7fb5e40c5090 2023-08-31T19:26:57.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.450+0000 7fb5d97fa700 1 -- 172.21.15.72:0/935329620 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb5d40068b0 con 0x7fb5e40c5090 2023-08-31T19:26:57.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.451+0000 7fb5d97fa700 1 --2- 172.21.15.72:0/935329620 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb5c805ef30 0x7fb5c80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.451+0000 7fb5d97fa700 1 -- 172.21.15.72:0/935329620 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7fb5d4079530 con 0x7fb5e40c5090 2023-08-31T19:26:57.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.451+0000 7fb5e979b700 1 --2- 172.21.15.72:0/935329620 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb5c805ef30 0x7fb5c80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.452+0000 7fb5e979b700 1 --2- 172.21.15.72:0/935329620 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb5c805ef30 0x7fb5c80613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb5e0006d00 tx=0x7fb5e0016000).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.455+0000 7fb5d97fa700 1 -- 172.21.15.72:0/935329620 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb5d40478f0 con 0x7fb5e40c5090 2023-08-31T19:26:57.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.624+0000 7fb5eb9ff700 1 -- 172.21.15.72:0/935329620 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5e406c6b0 con 0x7fb5c805ef30 2023-08-31T19:26:57.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.625+0000 7fb5d97fa700 1 -- 172.21.15.72:0/935329620 <== mgr.9771 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb5e406c6b0 con 0x7fb5c805ef30 2023-08-31T19:26:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.626+0000 7fb5eb9ff700 1 -- 172.21.15.72:0/935329620 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb5c805ef30 msgr2=0x7fb5c80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.626+0000 7fb5eb9ff700 1 --2- 172.21.15.72:0/935329620 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb5c805ef30 0x7fb5c80613f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb5e0006d00 tx=0x7fb5e0016000).stop 2023-08-31T19:26:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.626+0000 7fb5eb9ff700 1 -- 172.21.15.72:0/935329620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e40c5090 msgr2=0x7fb5e40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.627+0000 7fb5eb9ff700 1 --2- 172.21.15.72:0/935329620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e40c5090 0x7fb5e40a5810 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7fb5d400c4c0 tx=0x7fb5d4007dd0).stop 2023-08-31T19:26:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.627+0000 7fb5eb9ff700 1 -- 172.21.15.72:0/935329620 shutdown_connections 2023-08-31T19:26:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.627+0000 7fb5eb9ff700 1 --2- 172.21.15.72:0/935329620 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb5c805ef30 0x7fb5c80613f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.627+0000 7fb5eb9ff700 1 --2- 172.21.15.72:0/935329620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e4151f20 0x7fb5e40a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.627+0000 7fb5eb9ff700 1 --2- 172.21.15.72:0/935329620 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb5e4067b30 0x7fb5e40ac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.627+0000 7fb5eb9ff700 1 --2- 172.21.15.72:0/935329620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e40c5090 0x7fb5e40a5810 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.627+0000 7fb5eb9ff700 1 -- 172.21.15.72:0/935329620 >> 172.21.15.72:0/935329620 conn(0x7fb5e40c8c20 msgr2=0x7fb5e40c7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.627+0000 7fb5eb9ff700 1 -- 172.21.15.72:0/935329620 shutdown_connections 2023-08-31T19:26:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.627+0000 7fb5eb9ff700 1 -- 172.21.15.72:0/935329620 wait complete. 2023-08-31T19:26:57.630 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 1 to deep-scrub 2023-08-31T19:26:57.644 INFO:tasks.ceph:Scrubbing osd.2 2023-08-31T19:26:57.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:26:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.836+0000 7fd4b9bff700 1 Processor -- start 2023-08-31T19:26:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.837+0000 7fd4b9bff700 1 -- start start 2023-08-31T19:26:57.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.838+0000 7fd4b9bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd4b4064d70 0x7fd4b41553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.838+0000 7fd4b9bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4b40c5370 0x7fd4b40bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.838+0000 7fd4b9bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b4154f40 con 0x7fd4b4151da0 2023-08-31T19:26:57.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.838+0000 7fd4b9bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b40c5780 con 0x7fd4b40c5370 2023-08-31T19:26:57.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.838+0000 7fd4b9bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b4154960 con 0x7fd4b4064d70 2023-08-31T19:26:57.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.838+0000 7fd4b3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4b40c5370 0x7fd4b40bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.838+0000 7fd4b3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4b40c5370 0x7fd4b40bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47354/0 (socket says 172.21.15.72:47354) 2023-08-31T19:26:57.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.838+0000 7fd4b3fff700 1 -- 172.21.15.72:0/1871536273 learned_addr learned my addr 172.21.15.72:0/1871536273 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:57.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.839+0000 7fd4b2ffd700 1 --2- 172.21.15.72:0/1871536273 >> v2:172.21.15.146:3300/0 conn(0x7fd4b4064d70 0x7fd4b41553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.839+0000 7fd4b3fff700 1 -- 172.21.15.72:0/1871536273 >> v2:172.21.15.146:3300/0 conn(0x7fd4b4064d70 msgr2=0x7fd4b41553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:57.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.839+0000 7fd4b3fff700 1 --2- 172.21.15.72:0/1871536273 >> v2:172.21.15.146:3300/0 conn(0x7fd4b4064d70 0x7fd4b41553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.839+0000 7fd4b3fff700 1 -- 172.21.15.72:0/1871536273 >> v1:172.21.15.146:6789/0 conn(0x7fd4b4151da0 legacy=0x7fd4b4064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:57.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.839+0000 7fd4b3fff700 1 -- 172.21.15.72:0/1871536273 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b40aa2c0 con 0x7fd4b40c5370 2023-08-31T19:26:57.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.839+0000 7fd4b2ffd700 1 --2- 172.21.15.72:0/1871536273 >> v2:172.21.15.146:3300/0 conn(0x7fd4b4064d70 0x7fd4b41553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:57.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.839+0000 7fd4b3fff700 1 --2- 172.21.15.72:0/1871536273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4b40c5370 0x7fd4b40bfcd0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7fd4b4083520 tx=0x7fd4ac009840).ready entity=mon.0 client_cookie=ba228652f8ba191c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:57.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.839+0000 7fd4b27fc700 1 -- 172.21.15.72:0/1871536273 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00e070 con 0x7fd4b40c5370 2023-08-31T19:26:57.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.839+0000 7fd4b27fc700 1 -- 172.21.15.72:0/1871536273 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac00ba10 con 0x7fd4b40c5370 2023-08-31T19:26:57.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.839+0000 7fd4b27fc700 1 -- 172.21.15.72:0/1871536273 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00bd90 con 0x7fd4b40c5370 2023-08-31T19:26:57.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.840+0000 7fd4b9bff700 1 -- 172.21.15.72:0/1871536273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4b40c5370 msgr2=0x7fd4b40bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.840+0000 7fd4b9bff700 1 --2- 172.21.15.72:0/1871536273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4b40c5370 0x7fd4b40bfcd0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7fd4b4083520 tx=0x7fd4ac009840).stop 2023-08-31T19:26:57.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.840+0000 7fd4b9bff700 1 -- 172.21.15.72:0/1871536273 shutdown_connections 2023-08-31T19:26:57.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.840+0000 7fd4b9bff700 1 --2- 172.21.15.72:0/1871536273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4b40c5370 0x7fd4b40bfcd0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.840+0000 7fd4b9bff700 1 --2- 172.21.15.72:0/1871536273 >> v2:172.21.15.146:3300/0 conn(0x7fd4b4064d70 0x7fd4b41553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.840+0000 7fd4b9bff700 1 -- 172.21.15.72:0/1871536273 >> 172.21.15.72:0/1871536273 conn(0x7fd4b4063a90 msgr2=0x7fd4b40cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:57.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.840+0000 7fd4b9bff700 1 -- 172.21.15.72:0/1871536273 shutdown_connections 2023-08-31T19:26:57.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.840+0000 7fd4b9bff700 1 -- 172.21.15.72:0/1871536273 wait complete. 2023-08-31T19:26:57.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.841+0000 7fd4b9bff700 1 Processor -- start 2023-08-31T19:26:57.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.842+0000 7fd4b9bff700 1 -- start start 2023-08-31T19:26:57.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.842+0000 7fd4b9bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4b4064d70 0x7fd4b40b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.842+0000 7fd4b9bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4b40c5370 0x7fd4b41503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.842+0000 7fd4b9bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4b4151da0 0x7fd4b414cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.842+0000 7fd4b9bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40b0db0 con 0x7fd4b4151da0 2023-08-31T19:26:57.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.842+0000 7fd4b9bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b41508d0 con 0x7fd4b40c5370 2023-08-31T19:26:57.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.842+0000 7fd4b9bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b4153110 con 0x7fd4b4064d70 2023-08-31T19:26:57.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.843+0000 7fd4b3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4b4151da0 0x7fd4b414cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.843+0000 7fd4b3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4b4151da0 0x7fd4b414cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47370/0 (socket says 172.21.15.72:47370) 2023-08-31T19:26:57.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.843+0000 7fd4b3fff700 1 -- 172.21.15.72:0/2477136751 learned_addr learned my addr 172.21.15.72:0/2477136751 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:57.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.843+0000 7fd4b2ffd700 1 --2- 172.21.15.72:0/2477136751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4b40c5370 0x7fd4b41503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.843+0000 7fd4b37fe700 1 --2- 172.21.15.72:0/2477136751 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4b4064d70 0x7fd4b40b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.843+0000 7fd4b3fff700 1 -- 172.21.15.72:0/2477136751 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4b4064d70 msgr2=0x7fd4b40b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.843+0000 7fd4b3fff700 1 --2- 172.21.15.72:0/2477136751 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fd4b4064d70 0x7fd4b40b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.843+0000 7fd4b3fff700 1 -- 172.21.15.72:0/2477136751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4b40c5370 msgr2=0x7fd4b41503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.843+0000 7fd4b3fff700 1 --2- 172.21.15.72:0/2477136751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4b40c5370 0x7fd4b41503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.843+0000 7fd4b3fff700 1 -- 172.21.15.72:0/2477136751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac009ae0 con 0x7fd4b4151da0 2023-08-31T19:26:57.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.843+0000 7fd4b3fff700 1 --2- 172.21.15.72:0/2477136751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4b4151da0 0x7fd4b414cc20 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7fd4b4061720 tx=0x7fd4ac009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:57.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.844+0000 7fd49b7fe700 1 -- 172.21.15.72:0/2477136751 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac013e40 con 0x7fd4b4151da0 2023-08-31T19:26:57.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.844+0000 7fd49b7fe700 1 -- 172.21.15.72:0/2477136751 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac01d410 con 0x7fd4b4151da0 2023-08-31T19:26:57.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.844+0000 7fd4b9bff700 1 -- 172.21.15.72:0/2477136751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b4151150 con 0x7fd4b4151da0 2023-08-31T19:26:57.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.844+0000 7fd49b7fe700 1 -- 172.21.15.72:0/2477136751 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac01d7b0 con 0x7fd4b4151da0 2023-08-31T19:26:57.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.844+0000 7fd4b9bff700 1 -- 172.21.15.72:0/2477136751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b414dea0 con 0x7fd4b4151da0 2023-08-31T19:26:57.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.845+0000 7fd4b9bff700 1 -- 172.21.15.72:0/2477136751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4b4150fd0 con 0x7fd4b4151da0 2023-08-31T19:26:57.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.846+0000 7fd49b7fe700 1 -- 172.21.15.72:0/2477136751 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fd4ac01dbe0 con 0x7fd4b4151da0 2023-08-31T19:26:57.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.846+0000 7fd49b7fe700 1 --2- 172.21.15.72:0/2477136751 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fd4a005ef30 0x7fd4a00613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.846+0000 7fd49b7fe700 1 -- 172.21.15.72:0/2477136751 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7fd4ac07c9e0 con 0x7fd4b4151da0 2023-08-31T19:26:57.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.847+0000 7fd4b37fe700 1 --2- 172.21.15.72:0/2477136751 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fd4a005ef30 0x7fd4a00613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.847+0000 7fd49b7fe700 1 --2- 172.21.15.72:0/2477136751 >> [v2:172.21.15.72:6821/143814,v1:172.21.15.72:6823/143814] conn(0x7fd4a0065e00 0x7fd4a0068270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:57.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.847+0000 7fd49b7fe700 1 -- 172.21.15.72:0/2477136751 --> [v2:172.21.15.72:6821/143814,v1:172.21.15.72:6823/143814] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4a0068850 con 0x7fd4a0065e00 2023-08-31T19:26:57.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.847+0000 7fd49b7fe700 1 -- 172.21.15.72:0/2477136751 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4ac07ccd0 con 0x7fd4b4151da0 2023-08-31T19:26:57.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.847+0000 7fd4b2ffd700 1 --2- 172.21.15.72:0/2477136751 >> [v2:172.21.15.72:6821/143814,v1:172.21.15.72:6823/143814] conn(0x7fd4a0065e00 0x7fd4a0068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:57.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.847+0000 7fd4b37fe700 1 --2- 172.21.15.72:0/2477136751 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fd4a005ef30 0x7fd4a00613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd4a400b9b0 tx=0x7fd4a4008040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:57.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.847+0000 7fd4b2ffd700 1 --2- 172.21.15.72:0/2477136751 >> [v2:172.21.15.72:6821/143814,v1:172.21.15.72:6823/143814] conn(0x7fd4a0065e00 0x7fd4a0068270 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:57.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.848+0000 7fd49b7fe700 1 -- 172.21.15.72:0/2477136751 <== osd.2 v2:172.21.15.72:6821/143814 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fd4a0068850 con 0x7fd4a0065e00 2023-08-31T19:26:57.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.862+0000 7fd4b9bff700 1 -- 172.21.15.72:0/2477136751 --> [v2:172.21.15.72:6821/143814,v1:172.21.15.72:6823/143814] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd4b406a7e0 con 0x7fd4a0065e00 2023-08-31T19:26:57.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.862+0000 7fd49b7fe700 1 -- 172.21.15.72:0/2477136751 <== osd.2 v2:172.21.15.72:6821/143814 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd4b406a7e0 con 0x7fd4a0065e00 2023-08-31T19:26:57.863 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:26:57.863 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:26:57.863 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:26:57.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.862+0000 7fd4b9bff700 1 -- 172.21.15.72:0/2477136751 >> [v2:172.21.15.72:6821/143814,v1:172.21.15.72:6823/143814] conn(0x7fd4a0065e00 msgr2=0x7fd4a0068270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.862+0000 7fd4b9bff700 1 --2- 172.21.15.72:0/2477136751 >> [v2:172.21.15.72:6821/143814,v1:172.21.15.72:6823/143814] conn(0x7fd4a0065e00 0x7fd4a0068270 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:57.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.863+0000 7fd4b9bff700 1 -- 172.21.15.72:0/2477136751 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fd4a005ef30 msgr2=0x7fd4a00613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.863+0000 7fd4b9bff700 1 --2- 172.21.15.72:0/2477136751 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fd4a005ef30 0x7fd4a00613f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd4a400b9b0 tx=0x7fd4a4008040).stop 2023-08-31T19:26:57.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.863+0000 7fd4b9bff700 1 -- 172.21.15.72:0/2477136751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4b4151da0 msgr2=0x7fd4b414cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:57.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.863+0000 7fd4b9bff700 1 --2- 172.21.15.72:0/2477136751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4b4151da0 0x7fd4b414cc20 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7fd4b4061720 tx=0x7fd4ac009840).stop 2023-08-31T19:26:57.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.863+0000 7fd4b3fff700 1 -- 172.21.15.72:0/2477136751 reap_dead start 2023-08-31T19:26:57.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.863+0000 7fd4b9bff700 1 -- 172.21.15.72:0/2477136751 shutdown_connections 2023-08-31T19:26:57.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.863+0000 7fd4b9bff700 1 -- 172.21.15.72:0/2477136751 >> 172.21.15.72:0/2477136751 conn(0x7fd4b4063a90 msgr2=0x7fd4b4152180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:57.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.863+0000 7fd4b9bff700 1 -- 172.21.15.72:0/2477136751 shutdown_connections 2023-08-31T19:26:57.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:57.863+0000 7fd4b9bff700 1 -- 172.21.15.72:0/2477136751 wait complete. 2023-08-31T19:26:57.879 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-08-31T19:26:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.068+0000 7f664979d700 1 Processor -- start 2023-08-31T19:26:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.068+0000 7f664979d700 1 -- start start 2023-08-31T19:26:58.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.070+0000 7f664979d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6644154160 0x7f66440c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.070+0000 7f664979d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f66440c1130 0x7f66440c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.070+0000 7f664979d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66440c6410 0x7f66440c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.070+0000 7f664979d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66440c7500 con 0x7f6644154160 2023-08-31T19:26:58.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.070+0000 7f664979d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66440c9000 con 0x7f66440c1130 2023-08-31T19:26:58.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.070+0000 7f664979d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66440c6f40 con 0x7f66440c6410 2023-08-31T19:26:58.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.070+0000 7f6643fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6644154160 0x7f66440c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.070+0000 7f6643fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6644154160 0x7f66440c0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47372/0 (socket says 172.21.15.72:47372) 2023-08-31T19:26:58.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.070+0000 7f6643fff700 1 -- 172.21.15.72:0/769287667 learned_addr learned my addr 172.21.15.72:0/769287667 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:58.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.070+0000 7f6643fff700 1 -- 172.21.15.72:0/769287667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66440c6410 msgr2=0x7f66440c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:58.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.070+0000 7f6643fff700 1 --2- 172.21.15.72:0/769287667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66440c6410 0x7f66440c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:58.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.070+0000 7f6643fff700 1 -- 172.21.15.72:0/769287667 >> v2:172.21.15.146:3300/0 conn(0x7f66440c1130 msgr2=0x7f66440c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:58.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.070+0000 7f6643fff700 1 --2- 172.21.15.72:0/769287667 >> v2:172.21.15.146:3300/0 conn(0x7f66440c1130 0x7f66440c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:58.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.070+0000 7f6643fff700 1 -- 172.21.15.72:0/769287667 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66440c7220 con 0x7f6644154160 2023-08-31T19:26:58.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.071+0000 7f6643fff700 1 --2- 172.21.15.72:0/769287667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6644154160 0x7f66440c0c40 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7f6644084950 tx=0x7f66340090f0).ready entity=mon.0 client_cookie=5fdd926d97fc06bb server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:58.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.071+0000 7f6642ffd700 1 -- 172.21.15.72:0/769287667 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663400b600 con 0x7f6644154160 2023-08-31T19:26:58.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.071+0000 7f6642ffd700 1 -- 172.21.15.72:0/769287667 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663400b760 con 0x7f6644154160 2023-08-31T19:26:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.071+0000 7f6642ffd700 1 -- 172.21.15.72:0/769287667 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663400bae0 con 0x7f6644154160 2023-08-31T19:26:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.071+0000 7f664979d700 1 -- 172.21.15.72:0/769287667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6644154160 msgr2=0x7f66440c0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.071+0000 7f664979d700 1 --2- 172.21.15.72:0/769287667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6644154160 0x7f66440c0c40 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7f6644084950 tx=0x7f66340090f0).stop 2023-08-31T19:26:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.071+0000 7f664979d700 1 -- 172.21.15.72:0/769287667 shutdown_connections 2023-08-31T19:26:58.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.071+0000 7f664979d700 1 --2- 172.21.15.72:0/769287667 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f66440c6410 0x7f66440c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.071+0000 7f664979d700 1 --2- 172.21.15.72:0/769287667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6644154160 0x7f66440c0c40 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.071+0000 7f664979d700 1 --2- 172.21.15.72:0/769287667 >> v2:172.21.15.146:3300/0 conn(0x7f66440c1130 0x7f66440c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.071+0000 7f664979d700 1 -- 172.21.15.72:0/769287667 >> 172.21.15.72:0/769287667 conn(0x7f664405e870 msgr2=0x7f66440cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.072+0000 7f664979d700 1 -- 172.21.15.72:0/769287667 shutdown_connections 2023-08-31T19:26:58.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.072+0000 7f664979d700 1 -- 172.21.15.72:0/769287667 wait complete. 2023-08-31T19:26:58.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.073+0000 7f664979d700 1 Processor -- start 2023-08-31T19:26:58.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.073+0000 7f664979d700 1 -- start start 2023-08-31T19:26:58.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.074+0000 7f664979d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66440c1130 0x7f6644144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.074+0000 7f664979d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66440c6410 0x7f6644097e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.074+0000 7f664979d700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6644154160 0x7f6644098330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.074+0000 7f664979d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6644098820 con 0x7f66440c6410 2023-08-31T19:26:58.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.074+0000 7f664979d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6644096300 con 0x7f66440c1130 2023-08-31T19:26:58.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.074+0000 7f664979d700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6644144840 con 0x7f6644154160 2023-08-31T19:26:58.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.074+0000 7f66437fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66440c6410 0x7f6644097e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.074+0000 7f66437fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66440c6410 0x7f6644097e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47386/0 (socket says 172.21.15.72:47386) 2023-08-31T19:26:58.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.074+0000 7f66437fe700 1 -- 172.21.15.72:0/2566163887 learned_addr learned my addr 172.21.15.72:0/2566163887 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:58.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.074+0000 7f6643fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66440c1130 0x7f6644144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.074+0000 7f6648f9c700 1 --2- 172.21.15.72:0/2566163887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6644154160 0x7f6644098330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.075+0000 7f66437fe700 1 -- 172.21.15.72:0/2566163887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6644154160 msgr2=0x7f6644098330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.075+0000 7f66437fe700 1 --2- 172.21.15.72:0/2566163887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6644154160 0x7f6644098330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.075+0000 7f66437fe700 1 -- 172.21.15.72:0/2566163887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66440c1130 msgr2=0x7f6644144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.075+0000 7f66437fe700 1 --2- 172.21.15.72:0/2566163887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66440c1130 0x7f6644144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.075+0000 7f66437fe700 1 -- 172.21.15.72:0/2566163887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634009370 con 0x7f66440c6410 2023-08-31T19:26:58.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.075+0000 7f66437fe700 1 --2- 172.21.15.72:0/2566163887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66440c6410 0x7f6644097e40 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 rx=0x7f663800b4c0 tx=0x7f6638009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:58.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.075+0000 7f662bfff700 1 -- 172.21.15.72:0/2566163887 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663800be30 con 0x7f66440c6410 2023-08-31T19:26:58.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.075+0000 7f662bfff700 1 -- 172.21.15.72:0/2566163887 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6638002320 con 0x7f66440c6410 2023-08-31T19:26:58.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.075+0000 7f664979d700 1 -- 172.21.15.72:0/2566163887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66440c4410 con 0x7f66440c6410 2023-08-31T19:26:58.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.075+0000 7f662bfff700 1 -- 172.21.15.72:0/2566163887 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66380026e0 con 0x7f66440c6410 2023-08-31T19:26:58.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.076+0000 7f664979d700 1 -- 172.21.15.72:0/2566163887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6644095f90 con 0x7f66440c6410 2023-08-31T19:26:58.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.077+0000 7f664979d700 1 -- 172.21.15.72:0/2566163887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66440964b0 con 0x7f66440c6410 2023-08-31T19:26:58.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.077+0000 7f662bfff700 1 -- 172.21.15.72:0/2566163887 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6638002a90 con 0x7f66440c6410 2023-08-31T19:26:58.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.078+0000 7f662bfff700 1 --2- 172.21.15.72:0/2566163887 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f663005ef30 0x7f66300613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.078+0000 7f662bfff700 1 -- 172.21.15.72:0/2566163887 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f6638079e50 con 0x7f66440c6410 2023-08-31T19:26:58.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.078+0000 7f6643fff700 1 --2- 172.21.15.72:0/2566163887 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f663005ef30 0x7f66300613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.079+0000 7f6643fff700 1 --2- 172.21.15.72:0/2566163887 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f663005ef30 0x7f66300613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6634009fd0 tx=0x7f6634017000).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:58.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.082+0000 7f662bfff700 1 -- 172.21.15.72:0/2566163887 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f663804afd0 con 0x7f66440c6410 2023-08-31T19:26:58.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.251+0000 7f664979d700 1 -- 172.21.15.72:0/2566163887 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6644047480 con 0x7f663005ef30 2023-08-31T19:26:58.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.251+0000 7f662bfff700 1 -- 172.21.15.72:0/2566163887 <== mgr.9771 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6644047480 con 0x7f663005ef30 2023-08-31T19:26:58.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.253+0000 7f664979d700 1 -- 172.21.15.72:0/2566163887 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f663005ef30 msgr2=0x7f66300613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.253+0000 7f664979d700 1 --2- 172.21.15.72:0/2566163887 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f663005ef30 0x7f66300613f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6634009fd0 tx=0x7f6634017000).stop 2023-08-31T19:26:58.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.253+0000 7f664979d700 1 -- 172.21.15.72:0/2566163887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66440c6410 msgr2=0x7f6644097e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.253+0000 7f664979d700 1 --2- 172.21.15.72:0/2566163887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66440c6410 0x7f6644097e40 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 rx=0x7f663800b4c0 tx=0x7f6638009060).stop 2023-08-31T19:26:58.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.254+0000 7f664979d700 1 -- 172.21.15.72:0/2566163887 shutdown_connections 2023-08-31T19:26:58.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.254+0000 7f664979d700 1 --2- 172.21.15.72:0/2566163887 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f663005ef30 0x7f66300613f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.254+0000 7f664979d700 1 --2- 172.21.15.72:0/2566163887 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6644154160 0x7f6644098330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.254+0000 7f664979d700 1 --2- 172.21.15.72:0/2566163887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66440c1130 0x7f6644144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.254+0000 7f664979d700 1 --2- 172.21.15.72:0/2566163887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66440c6410 0x7f6644097e40 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.254+0000 7f664979d700 1 -- 172.21.15.72:0/2566163887 >> 172.21.15.72:0/2566163887 conn(0x7f664405e870 msgr2=0x7f66441533b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:58.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.254+0000 7f664979d700 1 -- 172.21.15.72:0/2566163887 shutdown_connections 2023-08-31T19:26:58.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.254+0000 7f664979d700 1 -- 172.21.15.72:0/2566163887 wait complete. 2023-08-31T19:26:58.258 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 2 to deep-scrub 2023-08-31T19:26:58.271 INFO:tasks.ceph:Scrubbing osd.3 2023-08-31T19:26:58.272 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:26:58.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.466+0000 7fb7a9bff700 1 Processor -- start 2023-08-31T19:26:58.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.467+0000 7fb7a9bff700 1 -- start start 2023-08-31T19:26:58.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.468+0000 7fb7a9bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7a4151da0 0x7fb7a41553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.468+0000 7fb7a9bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7a4064d70 0x7fb7a40bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.468+0000 7fb7a9bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a4154f40 con 0x7fb7a40c5370 2023-08-31T19:26:58.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.468+0000 7fb7a9bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a4154960 con 0x7fb7a4064d70 2023-08-31T19:26:58.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.468+0000 7fb7a9bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a40aa2c0 con 0x7fb7a4151da0 2023-08-31T19:26:58.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.468+0000 7fb7a3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7a4064d70 0x7fb7a40bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.468+0000 7fb7a3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7a4064d70 0x7fb7a40bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47402/0 (socket says 172.21.15.72:47402) 2023-08-31T19:26:58.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.468+0000 7fb7a3fff700 1 -- 172.21.15.72:0/3817005477 learned_addr learned my addr 172.21.15.72:0/3817005477 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:58.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.468+0000 7fb7a37fe700 1 --2- 172.21.15.72:0/3817005477 >> v2:172.21.15.146:3300/0 conn(0x7fb7a4151da0 0x7fb7a41553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.469+0000 7fb7a3fff700 1 -- 172.21.15.72:0/3817005477 >> v2:172.21.15.146:3300/0 conn(0x7fb7a4151da0 msgr2=0x7fb7a41553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:58.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.469+0000 7fb7a3fff700 1 --2- 172.21.15.72:0/3817005477 >> v2:172.21.15.146:3300/0 conn(0x7fb7a4151da0 0x7fb7a41553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.469+0000 7fb7a3fff700 1 -- 172.21.15.72:0/3817005477 >> v1:172.21.15.146:6789/0 conn(0x7fb7a40c5370 legacy=0x7fb7a4064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.469+0000 7fb7a3fff700 1 -- 172.21.15.72:0/3817005477 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a4154bd0 con 0x7fb7a4064d70 2023-08-31T19:26:58.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.469+0000 7fb7a3fff700 1 --2- 172.21.15.72:0/3817005477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a4064d70 0x7fb7a40bfcd0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7fb7a4061630 tx=0x7fb79c009840).ready entity=mon.0 client_cookie=4d1545ff2af90e60 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:58.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.469+0000 7fb7a27fc700 1 -- 172.21.15.72:0/3817005477 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c00e070 con 0x7fb7a4064d70 2023-08-31T19:26:58.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.469+0000 7fb7a27fc700 1 -- 172.21.15.72:0/3817005477 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79c00ba20 con 0x7fb7a4064d70 2023-08-31T19:26:58.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.469+0000 7fb7a27fc700 1 -- 172.21.15.72:0/3817005477 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c00bda0 con 0x7fb7a4064d70 2023-08-31T19:26:58.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.469+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3817005477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a4064d70 msgr2=0x7fb7a40bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.469+0000 7fb7a9bff700 1 --2- 172.21.15.72:0/3817005477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a4064d70 0x7fb7a40bfcd0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7fb7a4061630 tx=0x7fb79c009840).stop 2023-08-31T19:26:58.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.470+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3817005477 shutdown_connections 2023-08-31T19:26:58.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.470+0000 7fb7a9bff700 1 --2- 172.21.15.72:0/3817005477 >> v2:172.21.15.146:3300/0 conn(0x7fb7a4151da0 0x7fb7a41553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.470+0000 7fb7a9bff700 1 --2- 172.21.15.72:0/3817005477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a4064d70 0x7fb7a40bfcd0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.470+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3817005477 >> 172.21.15.72:0/3817005477 conn(0x7fb7a4063a90 msgr2=0x7fb7a40cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:58.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.470+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3817005477 shutdown_connections 2023-08-31T19:26:58.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.470+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3817005477 wait complete. 2023-08-31T19:26:58.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.471+0000 7fb7a9bff700 1 Processor -- start 2023-08-31T19:26:58.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.471+0000 7fb7a9bff700 1 -- start start 2023-08-31T19:26:58.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.472+0000 7fb7a9bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a4064d70 0x7fb7a40aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.472+0000 7fb7a9bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7a40c5370 0x7fb7a41501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.472+0000 7fb7a9bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7a4151da0 0x7fb7a41506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.472+0000 7fb7a9bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a40b05a0 con 0x7fb7a4064d70 2023-08-31T19:26:58.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.472+0000 7fb7a9bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a40af990 con 0x7fb7a4151da0 2023-08-31T19:26:58.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.472+0000 7fb7a9bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a40afc70 con 0x7fb7a40c5370 2023-08-31T19:26:58.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.472+0000 7fb7a37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a4064d70 0x7fb7a40aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.472+0000 7fb7a37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a4064d70 0x7fb7a40aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47418/0 (socket says 172.21.15.72:47418) 2023-08-31T19:26:58.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.472+0000 7fb7a37fe700 1 -- 172.21.15.72:0/3671483855 learned_addr learned my addr 172.21.15.72:0/3671483855 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:58.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.473+0000 7fb7a3fff700 1 --2- 172.21.15.72:0/3671483855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7a4151da0 0x7fb7a41506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.473+0000 7fb7a2ffd700 1 --2- 172.21.15.72:0/3671483855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7a40c5370 0x7fb7a41501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.473+0000 7fb7a37fe700 1 -- 172.21.15.72:0/3671483855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7a40c5370 msgr2=0x7fb7a41501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.473+0000 7fb7a37fe700 1 --2- 172.21.15.72:0/3671483855 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb7a40c5370 0x7fb7a41501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.473+0000 7fb7a37fe700 1 -- 172.21.15.72:0/3671483855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7a4151da0 msgr2=0x7fb7a41506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.473+0000 7fb7a37fe700 1 --2- 172.21.15.72:0/3671483855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7a4151da0 0x7fb7a41506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.473+0000 7fb7a37fe700 1 -- 172.21.15.72:0/3671483855 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79c009ae0 con 0x7fb7a4064d70 2023-08-31T19:26:58.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.473+0000 7fb7a37fe700 1 --2- 172.21.15.72:0/3671483855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a4064d70 0x7fb7a40aef60 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7fb79400e930 tx=0x7fb794009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:58.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.473+0000 7fb78b7fe700 1 -- 172.21.15.72:0/3671483855 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79400eed0 con 0x7fb7a4064d70 2023-08-31T19:26:58.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.473+0000 7fb78b7fe700 1 -- 172.21.15.72:0/3671483855 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79400c850 con 0x7fb7a4064d70 2023-08-31T19:26:58.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.473+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3671483855 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a40aff50 con 0x7fb7a4064d70 2023-08-31T19:26:58.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.473+0000 7fb78b7fe700 1 -- 172.21.15.72:0/3671483855 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79400cbd0 con 0x7fb7a4064d70 2023-08-31T19:26:58.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.473+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3671483855 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a414d3d0 con 0x7fb7a4064d70 2023-08-31T19:26:58.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.474+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3671483855 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7a406a7e0 con 0x7fb7a4064d70 2023-08-31T19:26:58.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.475+0000 7fb78b7fe700 1 -- 172.21.15.72:0/3671483855 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb79401b400 con 0x7fb7a4064d70 2023-08-31T19:26:58.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.476+0000 7fb78b7fe700 1 --2- 172.21.15.72:0/3671483855 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb79005ef30 0x7fb7900613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.476+0000 7fb78b7fe700 1 -- 172.21.15.72:0/3671483855 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7fb79407a6e0 con 0x7fb7a4064d70 2023-08-31T19:26:58.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.476+0000 7fb78b7fe700 1 --2- 172.21.15.72:0/3671483855 >> [v2:172.21.15.72:6809/143821,v1:172.21.15.72:6812/143821] conn(0x7fb790065c90 0x7fb790068100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.476+0000 7fb78b7fe700 1 -- 172.21.15.72:0/3671483855 --> [v2:172.21.15.72:6809/143821,v1:172.21.15.72:6812/143821] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7900686e0 con 0x7fb790065c90 2023-08-31T19:26:58.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.476+0000 7fb7a2ffd700 1 --2- 172.21.15.72:0/3671483855 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb79005ef30 0x7fb7900613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.476+0000 7fb78b7fe700 1 -- 172.21.15.72:0/3671483855 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb79407cd30 con 0x7fb7a4064d70 2023-08-31T19:26:58.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.476+0000 7fb7a3fff700 1 --2- 172.21.15.72:0/3671483855 >> [v2:172.21.15.72:6809/143821,v1:172.21.15.72:6812/143821] conn(0x7fb790065c90 0x7fb790068100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.477+0000 7fb7a2ffd700 1 --2- 172.21.15.72:0/3671483855 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb79005ef30 0x7fb7900613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fb7a40aed50 tx=0x7fb798009040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:58.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.477+0000 7fb7a3fff700 1 --2- 172.21.15.72:0/3671483855 >> [v2:172.21.15.72:6809/143821,v1:172.21.15.72:6812/143821] conn(0x7fb790065c90 0x7fb790068100 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:58.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.478+0000 7fb78b7fe700 1 -- 172.21.15.72:0/3671483855 <== osd.3 v2:172.21.15.72:6809/143821 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fb7900686e0 con 0x7fb790065c90 2023-08-31T19:26:58.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.491+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3671483855 --> [v2:172.21.15.72:6809/143821,v1:172.21.15.72:6812/143821] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb7a40b0880 con 0x7fb790065c90 2023-08-31T19:26:58.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.492+0000 7fb78b7fe700 1 -- 172.21.15.72:0/3671483855 <== osd.3 v2:172.21.15.72:6809/143821 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb7a40b0880 con 0x7fb790065c90 2023-08-31T19:26:58.493 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:26:58.493 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:26:58.493 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:26:58.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.492+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3671483855 >> [v2:172.21.15.72:6809/143821,v1:172.21.15.72:6812/143821] conn(0x7fb790065c90 msgr2=0x7fb790068100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.492+0000 7fb7a9bff700 1 --2- 172.21.15.72:0/3671483855 >> [v2:172.21.15.72:6809/143821,v1:172.21.15.72:6812/143821] conn(0x7fb790065c90 0x7fb790068100 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.492+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3671483855 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb79005ef30 msgr2=0x7fb7900613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.492+0000 7fb7a9bff700 1 --2- 172.21.15.72:0/3671483855 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb79005ef30 0x7fb7900613f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fb7a40aed50 tx=0x7fb798009040).stop 2023-08-31T19:26:58.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.492+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3671483855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a4064d70 msgr2=0x7fb7a40aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.492+0000 7fb7a9bff700 1 --2- 172.21.15.72:0/3671483855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7a4064d70 0x7fb7a40aef60 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7fb79400e930 tx=0x7fb794009060).stop 2023-08-31T19:26:58.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.492+0000 7fb7a3fff700 1 -- 172.21.15.72:0/3671483855 reap_dead start 2023-08-31T19:26:58.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.492+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3671483855 shutdown_connections 2023-08-31T19:26:58.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.492+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3671483855 >> 172.21.15.72:0/3671483855 conn(0x7fb7a4063a90 msgr2=0x7fb7a40cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:58.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.492+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3671483855 shutdown_connections 2023-08-31T19:26:58.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.492+0000 7fb7a9bff700 1 -- 172.21.15.72:0/3671483855 wait complete. 2023-08-31T19:26:58.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-08-31T19:26:58.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.696+0000 7fdb5f7ff700 1 Processor -- start 2023-08-31T19:26:58.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.697+0000 7fdb5f7ff700 1 -- start start 2023-08-31T19:26:58.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.698+0000 7fdb5f7ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdb580637c0 0x7fdb580ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.698+0000 7fdb5f7ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb580c6130 con 0x7fdb58157c10 2023-08-31T19:26:58.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.698+0000 7fdb5f7ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb581580b0 con 0x7fdb580ad1b0 2023-08-31T19:26:58.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.698+0000 7fdb5f7ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb580c0350 con 0x7fdb580637c0 2023-08-31T19:26:58.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.698+0000 7fdb5cd9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdb58157c10 0x7fdb580a9b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35172/0 (socket says 172.21.15.72:35172) 2023-08-31T19:26:58.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.698+0000 7fdb5cd9a700 1 -- 172.21.15.72:0/2855233507 learned_addr learned my addr 172.21.15.72:0/2855233507 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:58.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb5dd9c700 1 --2- 172.21.15.72:0/2855233507 >> v2:172.21.15.146:3300/0 conn(0x7fdb580637c0 0x7fdb580ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb4ffff700 1 -- 172.21.15.72:0/2855233507 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074708914 0 0) 0x7fdb580c6130 con 0x7fdb58157c10 2023-08-31T19:26:58.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb4ffff700 1 -- 172.21.15.72:0/2855233507 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb440033f0 con 0x7fdb58157c10 2023-08-31T19:26:58.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb4ffff700 1 -- 172.21.15.72:0/2855233507 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1223878573 0 0) 0x7fdb440033f0 con 0x7fdb58157c10 2023-08-31T19:26:58.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb4ffff700 1 -- 172.21.15.72:0/2855233507 >> v2:172.21.15.146:3300/0 conn(0x7fdb580637c0 msgr2=0x7fdb580ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:58.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb4ffff700 1 --2- 172.21.15.72:0/2855233507 >> v2:172.21.15.146:3300/0 conn(0x7fdb580637c0 0x7fdb580ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb4ffff700 1 -- 172.21.15.72:0/2855233507 >> v1:172.21.15.146:6789/0 conn(0x7fdb580ad1b0 legacy=0x7fdb580630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb4ffff700 1 -- 172.21.15.72:0/2855233507 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb58158350 con 0x7fdb58157c10 2023-08-31T19:26:58.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb4ffff700 1 -- 172.21.15.72:0/2855233507 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7fdb48001470 con 0x7fdb58157c10 2023-08-31T19:26:58.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb4ffff700 1 -- 172.21.15.72:0/2855233507 >> v1:172.21.15.72:6789/0 conn(0x7fdb58157c10 legacy=0x7fdb580a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb4ffff700 1 --2- 172.21.15.72:0/2855233507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb440038e0 0x7fdb44003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb4ffff700 1 --2- 172.21.15.72:0/2855233507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb44004690 0x7fdb44004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb4ffff700 1 --2- 172.21.15.72:0/2855233507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb44005000 0x7fdb4400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb4ffff700 1 -- 172.21.15.72:0/2855233507 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580c0350 con 0x7fdb44004690 2023-08-31T19:26:58.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb4ffff700 1 -- 172.21.15.72:0/2855233507 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4400bf60 con 0x7fdb44005000 2023-08-31T19:26:58.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb4ffff700 1 -- 172.21.15.72:0/2855233507 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4400c0f0 con 0x7fdb440038e0 2023-08-31T19:26:58.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.699+0000 7fdb5cd9a700 1 --2- 172.21.15.72:0/2855233507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb44004690 0x7fdb44004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.700+0000 7fdb5dd9c700 1 --2- 172.21.15.72:0/2855233507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb44005000 0x7fdb4400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.700+0000 7fdb5d59b700 1 --2- 172.21.15.72:0/2855233507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb440038e0 0x7fdb44003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.700+0000 7fdb5cd9a700 1 -- 172.21.15.72:0/2855233507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb440038e0 msgr2=0x7fdb44003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:58.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.700+0000 7fdb5cd9a700 1 --2- 172.21.15.72:0/2855233507 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb440038e0 0x7fdb44003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.700+0000 7fdb5cd9a700 1 -- 172.21.15.72:0/2855233507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb44005000 msgr2=0x7fdb4400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:58.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.700+0000 7fdb5cd9a700 1 --2- 172.21.15.72:0/2855233507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb44005000 0x7fdb4400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.700+0000 7fdb5cd9a700 1 -- 172.21.15.72:0/2855233507 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb440033f0 con 0x7fdb44004690 2023-08-31T19:26:58.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.700+0000 7fdb5dd9c700 1 -- 172.21.15.72:0/2855233507 reap_dead start 2023-08-31T19:26:58.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.700+0000 7fdb5cd9a700 1 --2- 172.21.15.72:0/2855233507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb44004690 0x7fdb44004b10 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7fdb4800c160 tx=0x7fdb58158240).ready entity=mon.0 client_cookie=db52cb584400828b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:58.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.700+0000 7fdb4ffff700 1 -- 172.21.15.72:0/2855233507 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4800ca10 con 0x7fdb44004690 2023-08-31T19:26:58.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.700+0000 7fdb4ffff700 1 -- 172.21.15.72:0/2855233507 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4800cb70 con 0x7fdb44004690 2023-08-31T19:26:58.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.700+0000 7fdb4ffff700 1 -- 172.21.15.72:0/2855233507 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb480070d0 con 0x7fdb44004690 2023-08-31T19:26:58.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.701+0000 7fdb5f7ff700 1 -- 172.21.15.72:0/2855233507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb44004690 msgr2=0x7fdb44004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.701+0000 7fdb5f7ff700 1 --2- 172.21.15.72:0/2855233507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb44004690 0x7fdb44004b10 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7fdb4800c160 tx=0x7fdb58158240).stop 2023-08-31T19:26:58.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.701+0000 7fdb5f7ff700 1 -- 172.21.15.72:0/2855233507 shutdown_connections 2023-08-31T19:26:58.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.701+0000 7fdb5f7ff700 1 --2- 172.21.15.72:0/2855233507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb44004690 0x7fdb44004b10 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.701+0000 7fdb5f7ff700 1 -- 172.21.15.72:0/2855233507 >> 172.21.15.72:0/2855233507 conn(0x7fdb5805eb60 msgr2=0x7fdb580cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:58.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.701+0000 7fdb5f7ff700 1 -- 172.21.15.72:0/2855233507 shutdown_connections 2023-08-31T19:26:58.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.701+0000 7fdb5f7ff700 1 -- 172.21.15.72:0/2855233507 wait complete. 2023-08-31T19:26:58.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.702+0000 7fdb5f7ff700 1 Processor -- start 2023-08-31T19:26:58.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.702+0000 7fdb5f7ff700 1 -- start start 2023-08-31T19:26:58.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.703+0000 7fdb5f7ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb44004690 0x7fdb580afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.703+0000 7fdb5f7ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb5814bd00 0x7fdb58064770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.703+0000 7fdb5f7ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb58064c60 0x7fdb581680c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.703+0000 7fdb5f7ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58167950 con 0x7fdb44004690 2023-08-31T19:26:58.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.703+0000 7fdb5f7ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580b0630 con 0x7fdb5814bd00 2023-08-31T19:26:58.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.703+0000 7fdb5f7ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580b0910 con 0x7fdb58064c60 2023-08-31T19:26:58.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.704+0000 7fdb5d59b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb44004690 0x7fdb580afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.704+0000 7fdb5d59b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb44004690 0x7fdb580afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47432/0 (socket says 172.21.15.72:47432) 2023-08-31T19:26:58.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.704+0000 7fdb5d59b700 1 -- 172.21.15.72:0/1475602844 learned_addr learned my addr 172.21.15.72:0/1475602844 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:58.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.704+0000 7fdb5d59b700 1 -- 172.21.15.72:0/1475602844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb58064c60 msgr2=0x7fdb581680c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.704+0000 7fdb5d59b700 1 --2- 172.21.15.72:0/1475602844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb58064c60 0x7fdb581680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:58.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.704+0000 7fdb5d59b700 1 -- 172.21.15.72:0/1475602844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb5814bd00 msgr2=0x7fdb58064770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.704+0000 7fdb5d59b700 1 --2- 172.21.15.72:0/1475602844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb5814bd00 0x7fdb58064770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:58.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.704+0000 7fdb5d59b700 1 -- 172.21.15.72:0/1475602844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb580b0bf0 con 0x7fdb44004690 2023-08-31T19:26:58.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.704+0000 7fdb5d59b700 1 --2- 172.21.15.72:0/1475602844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb44004690 0x7fdb580afd20 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7fdb5400e4c0 tx=0x7fdb54009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:58.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.704+0000 7fdb4d7fa700 1 -- 172.21.15.72:0/1475602844 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54010450 con 0x7fdb44004690 2023-08-31T19:26:58.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.704+0000 7fdb4d7fa700 1 -- 172.21.15.72:0/1475602844 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb540105b0 con 0x7fdb44004690 2023-08-31T19:26:58.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.704+0000 7fdb5f7ff700 1 -- 172.21.15.72:0/1475602844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb58167ba0 con 0x7fdb44004690 2023-08-31T19:26:58.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.704+0000 7fdb4d7fa700 1 -- 172.21.15.72:0/1475602844 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54010930 con 0x7fdb44004690 2023-08-31T19:26:58.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.705+0000 7fdb5f7ff700 1 -- 172.21.15.72:0/1475602844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb580b03d0 con 0x7fdb44004690 2023-08-31T19:26:58.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.706+0000 7fdb5f7ff700 1 -- 172.21.15.72:0/1475602844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5806c6b0 con 0x7fdb44004690 2023-08-31T19:26:58.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.706+0000 7fdb4d7fa700 1 -- 172.21.15.72:0/1475602844 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fdb54010d20 con 0x7fdb44004690 2023-08-31T19:26:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.707+0000 7fdb4d7fa700 1 --2- 172.21.15.72:0/1475602844 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fdb3c05ef60 0x7fdb3c061420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.707+0000 7fdb4d7fa700 1 -- 172.21.15.72:0/1475602844 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7fdb54079af0 con 0x7fdb44004690 2023-08-31T19:26:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.707+0000 7fdb5cd9a700 1 --2- 172.21.15.72:0/1475602844 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fdb3c05ef60 0x7fdb3c061420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.708+0000 7fdb5cd9a700 1 --2- 172.21.15.72:0/1475602844 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fdb3c05ef60 0x7fdb3c061420 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fdb580b0f50 tx=0x7fdb48015000).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.711+0000 7fdb4d7fa700 1 -- 172.21.15.72:0/1475602844 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdb540498f0 con 0x7fdb44004690 2023-08-31T19:26:58.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.884+0000 7fdb5f7ff700 1 -- 172.21.15.72:0/1475602844 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb58158610 con 0x7fdb3c05ef60 2023-08-31T19:26:58.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.884+0000 7fdb4d7fa700 1 -- 172.21.15.72:0/1475602844 <== mgr.9771 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdb58158610 con 0x7fdb3c05ef60 2023-08-31T19:26:58.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.886+0000 7fdb5f7ff700 1 -- 172.21.15.72:0/1475602844 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fdb3c05ef60 msgr2=0x7fdb3c061420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.886+0000 7fdb5f7ff700 1 --2- 172.21.15.72:0/1475602844 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fdb3c05ef60 0x7fdb3c061420 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fdb580b0f50 tx=0x7fdb48015000).stop 2023-08-31T19:26:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.886+0000 7fdb5f7ff700 1 -- 172.21.15.72:0/1475602844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb44004690 msgr2=0x7fdb580afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.886+0000 7fdb5f7ff700 1 --2- 172.21.15.72:0/1475602844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb44004690 0x7fdb580afd20 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7fdb5400e4c0 tx=0x7fdb54009040).stop 2023-08-31T19:26:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.886+0000 7fdb5f7ff700 1 -- 172.21.15.72:0/1475602844 shutdown_connections 2023-08-31T19:26:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.886+0000 7fdb5f7ff700 1 --2- 172.21.15.72:0/1475602844 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fdb3c05ef60 0x7fdb3c061420 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.886+0000 7fdb5f7ff700 1 --2- 172.21.15.72:0/1475602844 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fdb58064c60 0x7fdb581680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.886+0000 7fdb5f7ff700 1 --2- 172.21.15.72:0/1475602844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb44004690 0x7fdb580afd20 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.886+0000 7fdb5f7ff700 1 --2- 172.21.15.72:0/1475602844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb5814bd00 0x7fdb58064770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-31T19:26:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.886+0000 7fdb5f7ff700 1 -- 172.21.15.72:0/1475602844 >> 172.21.15.72:0/1475602844 conn(0x7fdb5805eb60 msgr2=0x7fdb580aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.886+0000 7fdb5f7ff700 1 -- 172.21.15.72:0/1475602844 shutdown_connections 2023-08-31T19:26:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:58.886+0000 7fdb5f7ff700 1 -- 172.21.15.72:0/1475602844 wait complete. 2023-08-31T19:26:58.889 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 3 to deep-scrub 2023-08-31T19:26:58.904 INFO:tasks.ceph:Scrubbing osd.4 2023-08-31T19:26:58.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:26:59.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.097+0000 7f71ce9ff700 1 Processor -- start 2023-08-31T19:26:59.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.097+0000 7f71ce9ff700 1 -- start start 2023-08-31T19:26:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.098+0000 7f71ce9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71c8151da0 0x7f71c81553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.098+0000 7f71ce9ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71c8064d70 0x7f71c80bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.098+0000 7f71ce9ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c8154f40 con 0x7f71c80c5370 2023-08-31T19:26:59.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.098+0000 7f71ce9ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c80c57f0 con 0x7f71c8064d70 2023-08-31T19:26:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.098+0000 7f71ce9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8154960 con 0x7f71c8151da0 2023-08-31T19:26:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.099+0000 7f71c77fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f71c80c5370 0x7f71c8064660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35186/0 (socket says 172.21.15.72:35186) 2023-08-31T19:26:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.099+0000 7f71c77fe700 1 -- 172.21.15.72:0/314741432 learned_addr learned my addr 172.21.15.72:0/314741432 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.099+0000 7f71ccf9c700 1 --2- 172.21.15.72:0/314741432 >> v2:172.21.15.72:3300/0 conn(0x7f71c8064d70 0x7f71c80bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.099+0000 7f71c7fff700 1 --2- 172.21.15.72:0/314741432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71c8151da0 0x7f71c81553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.099+0000 7f71c6ffd700 1 -- 172.21.15.72:0/314741432 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233982865 0 0) 0x7f71c8154f40 con 0x7f71c80c5370 2023-08-31T19:26:59.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.099+0000 7f71c6ffd700 1 -- 172.21.15.72:0/314741432 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71b00033f0 con 0x7f71c80c5370 2023-08-31T19:26:59.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.099+0000 7f71ccf9c700 1 -- 172.21.15.72:0/314741432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71c8151da0 msgr2=0x7f71c81553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:59.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.099+0000 7f71ccf9c700 1 --2- 172.21.15.72:0/314741432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71c8151da0 0x7f71c81553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.099+0000 7f71ccf9c700 1 -- 172.21.15.72:0/314741432 >> v1:172.21.15.72:6789/0 conn(0x7f71c80c5370 legacy=0x7f71c8064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.099+0000 7f71ccf9c700 1 -- 172.21.15.72:0/314741432 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c80aa2c0 con 0x7f71c8064d70 2023-08-31T19:26:59.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.099+0000 7f71c7fff700 1 --2- 172.21.15.72:0/314741432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71c8151da0 0x7f71c81553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:59.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.099+0000 7f71ccf9c700 1 --2- 172.21.15.72:0/314741432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71c8064d70 0x7f71c80bfcd0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7f71c0009e60 tx=0x7f71c0009780).ready entity=mon.0 client_cookie=259e8e8102c1de2d server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:59.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.100+0000 7f71c6ffd700 1 -- 172.21.15.72:0/314741432 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c000e070 con 0x7f71c8064d70 2023-08-31T19:26:59.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.100+0000 7f71c6ffd700 1 -- 172.21.15.72:0/314741432 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c000bb60 con 0x7f71c8064d70 2023-08-31T19:26:59.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.100+0000 7f71c6ffd700 1 -- 172.21.15.72:0/314741432 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c0012410 con 0x7f71c8064d70 2023-08-31T19:26:59.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.100+0000 7f71ce9ff700 1 -- 172.21.15.72:0/314741432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71c8064d70 msgr2=0x7f71c80bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.100+0000 7f71ce9ff700 1 --2- 172.21.15.72:0/314741432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71c8064d70 0x7f71c80bfcd0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7f71c0009e60 tx=0x7f71c0009780).stop 2023-08-31T19:26:59.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.100+0000 7f71ce9ff700 1 -- 172.21.15.72:0/314741432 shutdown_connections 2023-08-31T19:26:59.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.100+0000 7f71ce9ff700 1 --2- 172.21.15.72:0/314741432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71c8064d70 0x7f71c80bfcd0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.100+0000 7f71ce9ff700 1 --2- 172.21.15.72:0/314741432 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71c8151da0 0x7f71c81553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.100+0000 7f71ce9ff700 1 -- 172.21.15.72:0/314741432 >> 172.21.15.72:0/314741432 conn(0x7f71c8063a90 msgr2=0x7f71c80cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.100+0000 7f71ce9ff700 1 -- 172.21.15.72:0/314741432 shutdown_connections 2023-08-31T19:26:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.100+0000 7f71ce9ff700 1 -- 172.21.15.72:0/314741432 wait complete. 2023-08-31T19:26:59.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.102+0000 7f71ce9ff700 1 Processor -- start 2023-08-31T19:26:59.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.102+0000 7f71ce9ff700 1 -- start start 2023-08-31T19:26:59.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.103+0000 7f71ce9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71c8064d70 0x7f71c80aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.103+0000 7f71ce9ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71c80c5370 0x7f71c80c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.103+0000 7f71ce9ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71c8151da0 0x7f71c80b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.103+0000 7f71ce9ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80c4de0 con 0x7f71c80c5370 2023-08-31T19:26:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.103+0000 7f71ce9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80c4bf0 con 0x7f71c8064d70 2023-08-31T19:26:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.103+0000 7f71ce9ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80b0960 con 0x7f71c8151da0 2023-08-31T19:26:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.103+0000 7f71c77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71c80c5370 0x7f71c80c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.103+0000 7f71c77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71c80c5370 0x7f71c80c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47448/0 (socket says 172.21.15.72:47448) 2023-08-31T19:26:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.103+0000 7f71c77fe700 1 -- 172.21.15.72:0/717341671 learned_addr learned my addr 172.21.15.72:0/717341671 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.103+0000 7f71c7fff700 1 --2- 172.21.15.72:0/717341671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71c8064d70 0x7f71c80aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.103+0000 7f71ccf9c700 1 --2- 172.21.15.72:0/717341671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71c8151da0 0x7f71c80b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.104+0000 7f71c77fe700 1 -- 172.21.15.72:0/717341671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71c8151da0 msgr2=0x7f71c80b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.104+0000 7f71c77fe700 1 --2- 172.21.15.72:0/717341671 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f71c8151da0 0x7f71c80b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.104+0000 7f71c77fe700 1 -- 172.21.15.72:0/717341671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71c8064d70 msgr2=0x7f71c80aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.104+0000 7f71c77fe700 1 --2- 172.21.15.72:0/717341671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71c8064d70 0x7f71c80aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.104+0000 7f71c77fe700 1 -- 172.21.15.72:0/717341671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c0009a20 con 0x7f71c80c5370 2023-08-31T19:26:59.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.104+0000 7f71c77fe700 1 --2- 172.21.15.72:0/717341671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71c80c5370 0x7f71c80c4700 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7f71bc00c4c0 tx=0x7f71bc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:59.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.104+0000 7f71affff700 1 -- 172.21.15.72:0/717341671 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc0072e0 con 0x7f71c80c5370 2023-08-31T19:26:59.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.104+0000 7f71affff700 1 -- 172.21.15.72:0/717341671 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc007440 con 0x7f71c80c5370 2023-08-31T19:26:59.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.104+0000 7f71ce9ff700 1 -- 172.21.15.72:0/717341671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c80adea0 con 0x7f71c80c5370 2023-08-31T19:26:59.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.104+0000 7f71affff700 1 -- 172.21.15.72:0/717341671 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc0057a0 con 0x7f71c80c5370 2023-08-31T19:26:59.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.104+0000 7f71ce9ff700 1 -- 172.21.15.72:0/717341671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c80ae460 con 0x7f71c80c5370 2023-08-31T19:26:59.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.105+0000 7f71ce9ff700 1 -- 172.21.15.72:0/717341671 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71c806a7e0 con 0x7f71c80c5370 2023-08-31T19:26:59.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.106+0000 7f71affff700 1 -- 172.21.15.72:0/717341671 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f71bc005bd0 con 0x7f71c80c5370 2023-08-31T19:26:59.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.107+0000 7f71affff700 1 --2- 172.21.15.72:0/717341671 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f71b405ef30 0x7f71b40613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.107+0000 7f71affff700 1 -- 172.21.15.72:0/717341671 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f71bc079b00 con 0x7f71c80c5370 2023-08-31T19:26:59.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.107+0000 7f71c7fff700 1 --2- 172.21.15.72:0/717341671 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f71b405ef30 0x7f71b40613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.107+0000 7f71affff700 1 --2- 172.21.15.72:0/717341671 >> [v2:172.21.15.146:6817/143461,v1:172.21.15.146:6820/143461] conn(0x7f71b4065e00 0x7f71b4068270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.107+0000 7f71affff700 1 -- 172.21.15.72:0/717341671 --> [v2:172.21.15.146:6817/143461,v1:172.21.15.146:6820/143461] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71b4068850 con 0x7f71b4065e00 2023-08-31T19:26:59.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.107+0000 7f71affff700 1 -- 172.21.15.72:0/717341671 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71bc07e220 con 0x7f71c80c5370 2023-08-31T19:26:59.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.107+0000 7f71c7fff700 1 --2- 172.21.15.72:0/717341671 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f71b405ef30 0x7f71b40613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f71b8006fd0 tx=0x7f71b8008040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:59.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.108+0000 7f71ccf9c700 1 --2- 172.21.15.72:0/717341671 >> [v2:172.21.15.146:6817/143461,v1:172.21.15.146:6820/143461] conn(0x7f71b4065e00 0x7f71b4068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.108+0000 7f71ccf9c700 1 --2- 172.21.15.72:0/717341671 >> [v2:172.21.15.146:6817/143461,v1:172.21.15.146:6820/143461] conn(0x7f71b4065e00 0x7f71b4068270 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:59.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.109+0000 7f71affff700 1 -- 172.21.15.72:0/717341671 <== osd.4 v2:172.21.15.146:6817/143461 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f71b4068850 con 0x7f71b4065e00 2023-08-31T19:26:59.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.122+0000 7f71ce9ff700 1 -- 172.21.15.72:0/717341671 --> [v2:172.21.15.146:6817/143461,v1:172.21.15.146:6820/143461] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f71c806c6b0 con 0x7f71b4065e00 2023-08-31T19:26:59.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.123+0000 7f71affff700 1 -- 172.21.15.72:0/717341671 <== osd.4 v2:172.21.15.146:6817/143461 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f71c806c6b0 con 0x7f71b4065e00 2023-08-31T19:26:59.124 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:26:59.124 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:26:59.124 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:26:59.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.124+0000 7f71ce9ff700 1 -- 172.21.15.72:0/717341671 >> [v2:172.21.15.146:6817/143461,v1:172.21.15.146:6820/143461] conn(0x7f71b4065e00 msgr2=0x7f71b4068270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.124+0000 7f71ce9ff700 1 --2- 172.21.15.72:0/717341671 >> [v2:172.21.15.146:6817/143461,v1:172.21.15.146:6820/143461] conn(0x7f71b4065e00 0x7f71b4068270 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.124+0000 7f71ce9ff700 1 -- 172.21.15.72:0/717341671 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f71b405ef30 msgr2=0x7f71b40613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.124+0000 7f71ce9ff700 1 --2- 172.21.15.72:0/717341671 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f71b405ef30 0x7f71b40613f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f71b8006fd0 tx=0x7f71b8008040).stop 2023-08-31T19:26:59.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.124+0000 7f71ce9ff700 1 -- 172.21.15.72:0/717341671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71c80c5370 msgr2=0x7f71c80c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.124+0000 7f71ce9ff700 1 --2- 172.21.15.72:0/717341671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71c80c5370 0x7f71c80c4700 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 rx=0x7f71bc00c4c0 tx=0x7f71bc007c50).stop 2023-08-31T19:26:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.124+0000 7f71ccf9c700 1 -- 172.21.15.72:0/717341671 reap_dead start 2023-08-31T19:26:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.124+0000 7f71ce9ff700 1 -- 172.21.15.72:0/717341671 shutdown_connections 2023-08-31T19:26:59.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.124+0000 7f71ce9ff700 1 -- 172.21.15.72:0/717341671 >> 172.21.15.72:0/717341671 conn(0x7f71c8063a90 msgr2=0x7f71c80c6670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:59.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.124+0000 7f71ce9ff700 1 -- 172.21.15.72:0/717341671 shutdown_connections 2023-08-31T19:26:59.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.124+0000 7f71ce9ff700 1 -- 172.21.15.72:0/717341671 wait complete. 2023-08-31T19:26:59.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-08-31T19:26:59.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.330+0000 7f83d5dff700 1 Processor -- start 2023-08-31T19:26:59.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.330+0000 7f83d5dff700 1 -- start start 2023-08-31T19:26:59.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.331+0000 7f83d5dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83d01558f0 0x7f83d00bba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.331+0000 7f83d5dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83d00bbf80 0x7f83d00a66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.331+0000 7f83d5dff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83d00a6bd0 0x7f83d00a7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.331+0000 7f83d5dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d00c2d40 con 0x7f83d00bbf80 2023-08-31T19:26:59.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.331+0000 7f83d5dff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d00bd9c0 con 0x7f83d00a6bd0 2023-08-31T19:26:59.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.331+0000 7f83d5dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00c1ea0 con 0x7f83d01558f0 2023-08-31T19:26:59.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.332+0000 7f83ceffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83d00bbf80 0x7f83d00a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.332+0000 7f83ceffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83d00bbf80 0x7f83d00a66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47452/0 (socket says 172.21.15.72:47452) 2023-08-31T19:26:59.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.332+0000 7f83ceffd700 1 -- 172.21.15.72:0/3750928313 learned_addr learned my addr 172.21.15.72:0/3750928313 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:59.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.332+0000 7f83cf7fe700 1 --2- 172.21.15.72:0/3750928313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83d01558f0 0x7f83d00bba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.332+0000 7f83cffff700 1 --2- 172.21.15.72:0/3750928313 >> v2:172.21.15.146:3300/0 conn(0x7f83d00a6bd0 0x7f83d00a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.332+0000 7f83ceffd700 1 -- 172.21.15.72:0/3750928313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83d01558f0 msgr2=0x7f83d00bba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:59.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.332+0000 7f83ceffd700 1 --2- 172.21.15.72:0/3750928313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83d01558f0 0x7f83d00bba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.332+0000 7f83ceffd700 1 -- 172.21.15.72:0/3750928313 >> v2:172.21.15.146:3300/0 conn(0x7f83d00a6bd0 msgr2=0x7f83d00a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:59.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.332+0000 7f83ceffd700 1 --2- 172.21.15.72:0/3750928313 >> v2:172.21.15.146:3300/0 conn(0x7f83d00a6bd0 0x7f83d00a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.332+0000 7f83ceffd700 1 -- 172.21.15.72:0/3750928313 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d0155cd0 con 0x7f83d00bbf80 2023-08-31T19:26:59.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.332+0000 7f83ceffd700 1 --2- 172.21.15.72:0/3750928313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d00bbf80 0x7f83d00a66e0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 rx=0x7f83c4006fd0 tx=0x7f83c40090f0).ready entity=mon.0 client_cookie=ab4b88452a936fd7 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:59.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.333+0000 7f83ce7fc700 1 -- 172.21.15.72:0/3750928313 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c400f510 con 0x7f83d00bbf80 2023-08-31T19:26:59.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.333+0000 7f83ce7fc700 1 -- 172.21.15.72:0/3750928313 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c400f670 con 0x7f83d00bbf80 2023-08-31T19:26:59.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.333+0000 7f83ce7fc700 1 -- 172.21.15.72:0/3750928313 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c400f9f0 con 0x7f83d00bbf80 2023-08-31T19:26:59.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.333+0000 7f83d5dff700 1 -- 172.21.15.72:0/3750928313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d00bbf80 msgr2=0x7f83d00a66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.333+0000 7f83d5dff700 1 --2- 172.21.15.72:0/3750928313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d00bbf80 0x7f83d00a66e0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 rx=0x7f83c4006fd0 tx=0x7f83c40090f0).stop 2023-08-31T19:26:59.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.333+0000 7f83d5dff700 1 -- 172.21.15.72:0/3750928313 shutdown_connections 2023-08-31T19:26:59.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.333+0000 7f83d5dff700 1 --2- 172.21.15.72:0/3750928313 >> v2:172.21.15.146:3300/0 conn(0x7f83d00a6bd0 0x7f83d00a7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.333+0000 7f83d5dff700 1 --2- 172.21.15.72:0/3750928313 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83d01558f0 0x7f83d00bba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.333+0000 7f83d5dff700 1 --2- 172.21.15.72:0/3750928313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d00bbf80 0x7f83d00a66e0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.333+0000 7f83d5dff700 1 -- 172.21.15.72:0/3750928313 >> 172.21.15.72:0/3750928313 conn(0x7f83d0063120 msgr2=0x7f83d00c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:59.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.333+0000 7f83d5dff700 1 -- 172.21.15.72:0/3750928313 shutdown_connections 2023-08-31T19:26:59.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.333+0000 7f83d5dff700 1 -- 172.21.15.72:0/3750928313 wait complete. 2023-08-31T19:26:59.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.335+0000 7f83d5dff700 1 Processor -- start 2023-08-31T19:26:59.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.336+0000 7f83d5dff700 1 -- start start 2023-08-31T19:26:59.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.337+0000 7f83d5dff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83d00a6bd0 0x7f83d0137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.337+0000 7f83d5dff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83d00bbf80 0x7f83d00bf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.337+0000 7f83d5dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d01558f0 0x7f83d00a7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.337+0000 7f83d5dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d0152af0 con 0x7f83d01558f0 2023-08-31T19:26:59.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.337+0000 7f83d5dff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00a8ee0 con 0x7f83d00bbf80 2023-08-31T19:26:59.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.337+0000 7f83d5dff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00a7b20 con 0x7f83d00a6bd0 2023-08-31T19:26:59.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.337+0000 7f83cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d01558f0 0x7f83d00a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.337+0000 7f83cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d01558f0 0x7f83d00a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47460/0 (socket says 172.21.15.72:47460) 2023-08-31T19:26:59.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.337+0000 7f83cffff700 1 -- 172.21.15.72:0/827108244 learned_addr learned my addr 172.21.15.72:0/827108244 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:59.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.337+0000 7f83cf7fe700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83d00a6bd0 0x7f83d0137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.337+0000 7f83ceffd700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83d00bbf80 0x7f83d00bf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.338+0000 7f83cffff700 1 -- 172.21.15.72:0/827108244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83d00a6bd0 msgr2=0x7f83d0137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.338+0000 7f83cffff700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83d00a6bd0 0x7f83d0137ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.338+0000 7f83cffff700 1 -- 172.21.15.72:0/827108244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83d00bbf80 msgr2=0x7f83d00bf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.338+0000 7f83cffff700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83d00bbf80 0x7f83d00bf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.338+0000 7f83cffff700 1 -- 172.21.15.72:0/827108244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c4009370 con 0x7f83d01558f0 2023-08-31T19:26:59.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.338+0000 7f83ceffd700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83d00bbf80 0x7f83d00bf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:59.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.338+0000 7f83cf7fe700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83d00a6bd0 0x7f83d0137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:59.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.338+0000 7f83cffff700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d01558f0 0x7f83d00a7080 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7f83c8009df0 tx=0x7f83c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:59.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.338+0000 7f83b77fe700 1 -- 172.21.15.72:0/827108244 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800cb50 con 0x7f83d01558f0 2023-08-31T19:26:59.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.338+0000 7f83b77fe700 1 -- 172.21.15.72:0/827108244 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c800f040 con 0x7f83d01558f0 2023-08-31T19:26:59.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.338+0000 7f83b77fe700 1 -- 172.21.15.72:0/827108244 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800cec0 con 0x7f83d01558f0 2023-08-31T19:26:59.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.338+0000 7f83d5dff700 1 -- 172.21.15.72:0/827108244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d00a7e00 con 0x7f83d01558f0 2023-08-31T19:26:59.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.338+0000 7f83d5dff700 1 -- 172.21.15.72:0/827108244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d0152780 con 0x7f83d01558f0 2023-08-31T19:26:59.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.339+0000 7f83d5dff700 1 -- 172.21.15.72:0/827108244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d0152c60 con 0x7f83d01558f0 2023-08-31T19:26:59.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.340+0000 7f83b77fe700 1 -- 172.21.15.72:0/827108244 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f83c8013610 con 0x7f83d01558f0 2023-08-31T19:26:59.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.341+0000 7f83b77fe700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f83bc05ef30 0x7f83bc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.341+0000 7f83b77fe700 1 -- 172.21.15.72:0/827108244 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f83c807a970 con 0x7f83d01558f0 2023-08-31T19:26:59.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.341+0000 7f83cf7fe700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f83bc05ef30 0x7f83bc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.341+0000 7f83cf7fe700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f83bc05ef30 0x7f83bc0613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f83c0009b70 tx=0x7f83c0008040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:59.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.345+0000 7f83b77fe700 1 -- 172.21.15.72:0/827108244 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f83c804baf0 con 0x7f83d01558f0 2023-08-31T19:26:59.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.516+0000 7f83d5dff700 1 -- 172.21.15.72:0/827108244 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f83d00bcef0 con 0x7f83bc05ef30 2023-08-31T19:26:59.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.516+0000 7f83b77fe700 1 -- 172.21.15.72:0/827108244 <== mgr.9771 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f83d00bcef0 con 0x7f83bc05ef30 2023-08-31T19:26:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.518+0000 7f83d5dff700 1 -- 172.21.15.72:0/827108244 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f83bc05ef30 msgr2=0x7f83bc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.518+0000 7f83d5dff700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f83bc05ef30 0x7f83bc0613f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f83c0009b70 tx=0x7f83c0008040).stop 2023-08-31T19:26:59.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.518+0000 7f83d5dff700 1 -- 172.21.15.72:0/827108244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d01558f0 msgr2=0x7f83d00a7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.518+0000 7f83d5dff700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d01558f0 0x7f83d00a7080 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7f83c8009df0 tx=0x7f83c800b040).stop 2023-08-31T19:26:59.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.518+0000 7f83d5dff700 1 -- 172.21.15.72:0/827108244 shutdown_connections 2023-08-31T19:26:59.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.518+0000 7f83d5dff700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f83bc05ef30 0x7f83bc0613f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.518+0000 7f83d5dff700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d01558f0 0x7f83d00a7080 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.518+0000 7f83d5dff700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f83d00a6bd0 0x7f83d0137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.518+0000 7f83d5dff700 1 --2- 172.21.15.72:0/827108244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83d00bbf80 0x7f83d00bf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.518+0000 7f83d5dff700 1 -- 172.21.15.72:0/827108244 >> 172.21.15.72:0/827108244 conn(0x7f83d0063120 msgr2=0x7f83d00c4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:59.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.518+0000 7f83d5dff700 1 -- 172.21.15.72:0/827108244 shutdown_connections 2023-08-31T19:26:59.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.518+0000 7f83d5dff700 1 -- 172.21.15.72:0/827108244 wait complete. 2023-08-31T19:26:59.522 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 4 to deep-scrub 2023-08-31T19:26:59.537 INFO:tasks.ceph:Scrubbing osd.5 2023-08-31T19:26:59.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:26:59.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.729+0000 7fb6f53ff700 1 Processor -- start 2023-08-31T19:26:59.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.730+0000 7fb6f53ff700 1 -- start start 2023-08-31T19:26:59.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.731+0000 7fb6f53ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6f00c4bb0 0x7fb6f00653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.731+0000 7fb6f53ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6f00c5aa0 0x7fb6f0067a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.731+0000 7fb6f53ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f00c4f90 con 0x7fb6f013d960 2023-08-31T19:26:59.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.731+0000 7fb6f53ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f00c6020 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.731+0000 7fb6f53ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f01587f0 con 0x7fb6f00c4bb0 2023-08-31T19:26:59.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.731+0000 7fb6ee7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb6f013d960 0x7fb6f00c5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35202/0 (socket says 172.21.15.72:35202) 2023-08-31T19:26:59.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.731+0000 7fb6ee7fc700 1 -- 172.21.15.72:0/2653824988 learned_addr learned my addr 172.21.15.72:0/2653824988 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:26:59.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.731+0000 7fb6ef7fe700 1 --2- 172.21.15.72:0/2653824988 >> v2:172.21.15.72:3300/0 conn(0x7fb6f00c5aa0 0x7fb6f0067a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.731+0000 7fb6eeffd700 1 --2- 172.21.15.72:0/2653824988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6f00c4bb0 0x7fb6f00653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.732+0000 7fb6ef7fe700 1 -- 172.21.15.72:0/2653824988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6f00c4bb0 msgr2=0x7fb6f00653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:59.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.732+0000 7fb6ef7fe700 1 --2- 172.21.15.72:0/2653824988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6f00c4bb0 0x7fb6f00653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.732+0000 7fb6ef7fe700 1 -- 172.21.15.72:0/2653824988 >> v1:172.21.15.72:6789/0 conn(0x7fb6f013d960 legacy=0x7fb6f00c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.732+0000 7fb6ef7fe700 1 -- 172.21.15.72:0/2653824988 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f0158ad0 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.732+0000 7fb6edffb700 1 -- 172.21.15.72:0/2653824988 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598830841 0 0) 0x7fb6f00c4f90 con 0x7fb6f013d960 2023-08-31T19:26:59.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.732+0000 7fb6eeffd700 1 --2- 172.21.15.72:0/2653824988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6f00c4bb0 0x7fb6f00653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:59.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.732+0000 7fb6ef7fe700 1 --2- 172.21.15.72:0/2653824988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f00c5aa0 0x7fb6f0067a20 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 rx=0x7fb6e8009e60 tx=0x7fb6e8009780).ready entity=mon.0 client_cookie=c6fd1dde8b76da6b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:59.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.732+0000 7fb6edffb700 1 -- 172.21.15.72:0/2653824988 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e800e070 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.732+0000 7fb6edffb700 1 -- 172.21.15.72:0/2653824988 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e800bc30 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.732+0000 7fb6edffb700 1 -- 172.21.15.72:0/2653824988 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8012410 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.733+0000 7fb6f53ff700 1 -- 172.21.15.72:0/2653824988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f00c5aa0 msgr2=0x7fb6f0067a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.733+0000 7fb6f53ff700 1 --2- 172.21.15.72:0/2653824988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f00c5aa0 0x7fb6f0067a20 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 rx=0x7fb6e8009e60 tx=0x7fb6e8009780).stop 2023-08-31T19:26:59.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.733+0000 7fb6f53ff700 1 -- 172.21.15.72:0/2653824988 shutdown_connections 2023-08-31T19:26:59.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.733+0000 7fb6f53ff700 1 --2- 172.21.15.72:0/2653824988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f00c5aa0 0x7fb6f0067a20 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.733+0000 7fb6f53ff700 1 --2- 172.21.15.72:0/2653824988 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6f00c4bb0 0x7fb6f00653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.733+0000 7fb6f53ff700 1 -- 172.21.15.72:0/2653824988 >> 172.21.15.72:0/2653824988 conn(0x7fb6f0066350 msgr2=0x7fb6f0066760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:59.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.733+0000 7fb6f53ff700 1 -- 172.21.15.72:0/2653824988 shutdown_connections 2023-08-31T19:26:59.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.733+0000 7fb6f53ff700 1 -- 172.21.15.72:0/2653824988 wait complete. 2023-08-31T19:26:59.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.734+0000 7fb6f53ff700 1 Processor -- start 2023-08-31T19:26:59.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.734+0000 7fb6f53ff700 1 -- start start 2023-08-31T19:26:59.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.735+0000 7fb6f53ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6f00c4bb0 0x7fb6f01533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.735+0000 7fb6f53ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f00c5aa0 0x7fb6f0164de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.735+0000 7fb6f53ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6f013d960 0x7fb6f01679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.735+0000 7fb6f53ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f01688b0 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.735+0000 7fb6f53ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f0164950 con 0x7fb6f00c4bb0 2023-08-31T19:26:59.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.735+0000 7fb6f53ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f0164370 con 0x7fb6f013d960 2023-08-31T19:26:59.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.736+0000 7fb6ee7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f00c5aa0 0x7fb6f0164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.736+0000 7fb6ee7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f00c5aa0 0x7fb6f0164de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47468/0 (socket says 172.21.15.72:47468) 2023-08-31T19:26:59.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.736+0000 7fb6ee7fc700 1 -- 172.21.15.72:0/3617471256 learned_addr learned my addr 172.21.15.72:0/3617471256 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:59.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.736+0000 7fb6eeffd700 1 --2- 172.21.15.72:0/3617471256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6f00c4bb0 0x7fb6f01533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.736+0000 7fb6ef7fe700 1 --2- 172.21.15.72:0/3617471256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6f013d960 0x7fb6f01679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.736+0000 7fb6ee7fc700 1 -- 172.21.15.72:0/3617471256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6f013d960 msgr2=0x7fb6f01679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.736+0000 7fb6ee7fc700 1 --2- 172.21.15.72:0/3617471256 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fb6f013d960 0x7fb6f01679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.736+0000 7fb6ee7fc700 1 -- 172.21.15.72:0/3617471256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6f00c4bb0 msgr2=0x7fb6f01533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.736+0000 7fb6ee7fc700 1 --2- 172.21.15.72:0/3617471256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6f00c4bb0 0x7fb6f01533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.736+0000 7fb6ee7fc700 1 -- 172.21.15.72:0/3617471256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e8009a20 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.736+0000 7fb6eeffd700 1 --2- 172.21.15.72:0/3617471256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6f00c4bb0 0x7fb6f01533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:59.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.736+0000 7fb6ee7fc700 1 --2- 172.21.15.72:0/3617471256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f00c5aa0 0x7fb6f0164de0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7fb6e400c4e0 tx=0x7fb6e4007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:59.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.736+0000 7fb6d6ffd700 1 -- 172.21.15.72:0/3617471256 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e40072e0 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.736+0000 7fb6d6ffd700 1 -- 172.21.15.72:0/3617471256 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e4007440 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.736+0000 7fb6d6ffd700 1 -- 172.21.15.72:0/3617471256 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e40057a0 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.737+0000 7fb6f53ff700 1 -- 172.21.15.72:0/3617471256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f01652d0 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.737+0000 7fb6f53ff700 1 -- 172.21.15.72:0/3617471256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f01685d0 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.737+0000 7fb6f53ff700 1 -- 172.21.15.72:0/3617471256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb6f006c6b0 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.738+0000 7fb6d6ffd700 1 -- 172.21.15.72:0/3617471256 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fb6e4005b90 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.739+0000 7fb6d6ffd700 1 --2- 172.21.15.72:0/3617471256 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb6dc05ef30 0x7fb6dc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.739+0000 7fb6d6ffd700 1 -- 172.21.15.72:0/3617471256 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7fb6e4079930 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.739+0000 7fb6eeffd700 1 --2- 172.21.15.72:0/3617471256 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb6dc05ef30 0x7fb6dc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.739+0000 7fb6d6ffd700 1 --2- 172.21.15.72:0/3617471256 >> [v2:172.21.15.146:6800/143459,v1:172.21.15.146:6801/143459] conn(0x7fb6dc065e00 0x7fb6dc068270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.740+0000 7fb6d6ffd700 1 -- 172.21.15.72:0/3617471256 --> [v2:172.21.15.146:6800/143459,v1:172.21.15.146:6801/143459] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb6dc068850 con 0x7fb6dc065e00 2023-08-31T19:26:59.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.740+0000 7fb6d6ffd700 1 -- 172.21.15.72:0/3617471256 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6e407e240 con 0x7fb6f00c5aa0 2023-08-31T19:26:59.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.740+0000 7fb6eeffd700 1 --2- 172.21.15.72:0/3617471256 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb6dc05ef30 0x7fb6dc0613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb6e0006d80 tx=0x7fb6e0008040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:59.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.740+0000 7fb6ef7fe700 1 --2- 172.21.15.72:0/3617471256 >> [v2:172.21.15.146:6800/143459,v1:172.21.15.146:6801/143459] conn(0x7fb6dc065e00 0x7fb6dc068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.741+0000 7fb6ef7fe700 1 --2- 172.21.15.72:0/3617471256 >> [v2:172.21.15.146:6800/143459,v1:172.21.15.146:6801/143459] conn(0x7fb6dc065e00 0x7fb6dc068270 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:59.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.741+0000 7fb6d6ffd700 1 -- 172.21.15.72:0/3617471256 <== osd.5 v2:172.21.15.146:6800/143459 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fb6dc068850 con 0x7fb6dc065e00 2023-08-31T19:26:59.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.755+0000 7fb6f53ff700 1 -- 172.21.15.72:0/3617471256 --> [v2:172.21.15.146:6800/143459,v1:172.21.15.146:6801/143459] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb6f00be2b0 con 0x7fb6dc065e00 2023-08-31T19:26:59.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.756+0000 7fb6d6ffd700 1 -- 172.21.15.72:0/3617471256 <== osd.5 v2:172.21.15.146:6800/143459 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb6f00be2b0 con 0x7fb6dc065e00 2023-08-31T19:26:59.757 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:26:59.757 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:26:59.757 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:26:59.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.756+0000 7fb6f53ff700 1 -- 172.21.15.72:0/3617471256 >> [v2:172.21.15.146:6800/143459,v1:172.21.15.146:6801/143459] conn(0x7fb6dc065e00 msgr2=0x7fb6dc068270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.756+0000 7fb6f53ff700 1 --2- 172.21.15.72:0/3617471256 >> [v2:172.21.15.146:6800/143459,v1:172.21.15.146:6801/143459] conn(0x7fb6dc065e00 0x7fb6dc068270 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.756+0000 7fb6f53ff700 1 -- 172.21.15.72:0/3617471256 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb6dc05ef30 msgr2=0x7fb6dc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.756+0000 7fb6f53ff700 1 --2- 172.21.15.72:0/3617471256 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fb6dc05ef30 0x7fb6dc0613f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fb6e0006d80 tx=0x7fb6e0008040).stop 2023-08-31T19:26:59.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.756+0000 7fb6f53ff700 1 -- 172.21.15.72:0/3617471256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f00c5aa0 msgr2=0x7fb6f0164de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.756+0000 7fb6f53ff700 1 --2- 172.21.15.72:0/3617471256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f00c5aa0 0x7fb6f0164de0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 rx=0x7fb6e400c4e0 tx=0x7fb6e4007c10).stop 2023-08-31T19:26:59.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.756+0000 7fb6ef7fe700 1 -- 172.21.15.72:0/3617471256 reap_dead start 2023-08-31T19:26:59.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.757+0000 7fb6f53ff700 1 -- 172.21.15.72:0/3617471256 shutdown_connections 2023-08-31T19:26:59.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.757+0000 7fb6f53ff700 1 -- 172.21.15.72:0/3617471256 >> 172.21.15.72:0/3617471256 conn(0x7fb6f0066350 msgr2=0x7fb6f00c2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:59.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.757+0000 7fb6f53ff700 1 -- 172.21.15.72:0/3617471256 shutdown_connections 2023-08-31T19:26:59.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.757+0000 7fb6f53ff700 1 -- 172.21.15.72:0/3617471256 wait complete. 2023-08-31T19:26:59.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-08-31T19:26:59.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.964+0000 7f6d27fff700 1 Processor -- start 2023-08-31T19:26:59.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.964+0000 7f6d27fff700 1 -- start start 2023-08-31T19:26:59.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.965+0000 7f6d27fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6d201580c0 0x7f6d200bc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.965+0000 7f6d27fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d20069410 0x7f6d201584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.965+0000 7f6d27fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d20158990 0x7f6d20153e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.965+0000 7f6d27fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d20069ae0 con 0x7f6d201580c0 2023-08-31T19:26:59.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.965+0000 7f6d27fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d20158df0 con 0x7f6d20069410 2023-08-31T19:26:59.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.965+0000 7f6d27fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d20062880 con 0x7f6d20158990 2023-08-31T19:26:59.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.966+0000 7f6d25d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6d201580c0 0x7f6d200bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.966+0000 7f6d25d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6d201580c0 0x7f6d200bc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47474/0 (socket says 172.21.15.72:47474) 2023-08-31T19:26:59.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.966+0000 7f6d25d9b700 1 -- 172.21.15.72:0/526293571 learned_addr learned my addr 172.21.15.72:0/526293571 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:59.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.966+0000 7f6d2559a700 1 --2- 172.21.15.72:0/526293571 >> v2:172.21.15.146:3300/0 conn(0x7f6d20069410 0x7f6d201584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.966+0000 7f6d2659c700 1 --2- 172.21.15.72:0/526293571 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d20158990 0x7f6d20153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.966+0000 7f6d25d9b700 1 -- 172.21.15.72:0/526293571 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d20158990 msgr2=0x7f6d20153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:59.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.966+0000 7f6d25d9b700 1 --2- 172.21.15.72:0/526293571 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d20158990 0x7f6d20153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.966+0000 7f6d25d9b700 1 -- 172.21.15.72:0/526293571 >> v2:172.21.15.146:3300/0 conn(0x7f6d20069410 msgr2=0x7f6d201584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:26:59.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.966+0000 7f6d25d9b700 1 --2- 172.21.15.72:0/526293571 >> v2:172.21.15.146:3300/0 conn(0x7f6d20069410 0x7f6d201584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.966+0000 7f6d25d9b700 1 -- 172.21.15.72:0/526293571 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d20069890 con 0x7f6d201580c0 2023-08-31T19:26:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.966+0000 7f6d2659c700 1 --2- 172.21.15.72:0/526293571 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d20158990 0x7f6d20153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.966+0000 7f6d2559a700 1 --2- 172.21.15.72:0/526293571 >> v2:172.21.15.146:3300/0 conn(0x7f6d20069410 0x7f6d201584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:26:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.966+0000 7f6d25d9b700 1 --2- 172.21.15.72:0/526293571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d201580c0 0x7f6d200bc300 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7f6d2005e5e0 tx=0x7f6d1c009060).ready entity=mon.0 client_cookie=2b456849066e2fc9 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.966+0000 7f6d24d99700 1 -- 172.21.15.72:0/526293571 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c005880 con 0x7f6d201580c0 2023-08-31T19:26:59.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.967+0000 7f6d24d99700 1 -- 172.21.15.72:0/526293571 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c0059e0 con 0x7f6d201580c0 2023-08-31T19:26:59.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.967+0000 7f6d24d99700 1 -- 172.21.15.72:0/526293571 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c005d60 con 0x7f6d201580c0 2023-08-31T19:26:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.967+0000 7f6d27fff700 1 -- 172.21.15.72:0/526293571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d201580c0 msgr2=0x7f6d200bc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.967+0000 7f6d27fff700 1 --2- 172.21.15.72:0/526293571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d201580c0 0x7f6d200bc300 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7f6d2005e5e0 tx=0x7f6d1c009060).stop 2023-08-31T19:26:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.967+0000 7f6d27fff700 1 -- 172.21.15.72:0/526293571 shutdown_connections 2023-08-31T19:26:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.967+0000 7f6d27fff700 1 --2- 172.21.15.72:0/526293571 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d20158990 0x7f6d20153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.967+0000 7f6d27fff700 1 --2- 172.21.15.72:0/526293571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d201580c0 0x7f6d200bc300 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.967+0000 7f6d27fff700 1 --2- 172.21.15.72:0/526293571 >> v2:172.21.15.146:3300/0 conn(0x7f6d20069410 0x7f6d201584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.967+0000 7f6d27fff700 1 -- 172.21.15.72:0/526293571 >> 172.21.15.72:0/526293571 conn(0x7f6d200c73a0 msgr2=0x7f6d200c77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:26:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.967+0000 7f6d27fff700 1 -- 172.21.15.72:0/526293571 shutdown_connections 2023-08-31T19:26:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.967+0000 7f6d27fff700 1 -- 172.21.15.72:0/526293571 wait complete. 2023-08-31T19:26:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.969+0000 7f6d27fff700 1 Processor -- start 2023-08-31T19:26:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.969+0000 7f6d27fff700 1 -- start start 2023-08-31T19:26:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.970+0000 7f6d27fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d20069410 0x7f6d200ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.970+0000 7f6d27fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d201580c0 0x7f6d20150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.970+0000 7f6d27fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d20158990 0x7f6d20154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.970+0000 7f6d27fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d200aabb0 con 0x7f6d20158990 2023-08-31T19:26:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.970+0000 7f6d27fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d20150870 con 0x7f6d201580c0 2023-08-31T19:26:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.970+0000 7f6d27fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d20155190 con 0x7f6d20069410 2023-08-31T19:26:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.970+0000 7f6d2659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d20158990 0x7f6d20154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.970+0000 7f6d2659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d20158990 0x7f6d20154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47486/0 (socket says 172.21.15.72:47486) 2023-08-31T19:26:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.970+0000 7f6d2659c700 1 -- 172.21.15.72:0/1087921638 learned_addr learned my addr 172.21.15.72:0/1087921638 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:26:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.971+0000 7f6d2659c700 1 -- 172.21.15.72:0/1087921638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d20069410 msgr2=0x7f6d200ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.971+0000 7f6d25d9b700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d20069410 0x7f6d200ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.971+0000 7f6d2559a700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d201580c0 0x7f6d20150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.971+0000 7f6d2659c700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d20069410 0x7f6d200ab040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.971+0000 7f6d2659c700 1 -- 172.21.15.72:0/1087921638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d201580c0 msgr2=0x7f6d20150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:26:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.971+0000 7f6d2659c700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d201580c0 0x7f6d20150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:26:59.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.971+0000 7f6d2659c700 1 -- 172.21.15.72:0/1087921638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c009300 con 0x7f6d20158990 2023-08-31T19:26:59.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.971+0000 7f6d25d9b700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d20069410 0x7f6d200ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:59.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.971+0000 7f6d2559a700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d201580c0 0x7f6d20150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:26:59.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.971+0000 7f6d2659c700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d20158990 0x7f6d20154870 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7f6d18007f30 tx=0x7f6d18009930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:59.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.971+0000 7f6d15ffb700 1 -- 172.21.15.72:0/1087921638 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1800dce0 con 0x7f6d20158990 2023-08-31T19:26:59.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.971+0000 7f6d15ffb700 1 -- 172.21.15.72:0/1087921638 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1800f040 con 0x7f6d20158990 2023-08-31T19:26:59.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.971+0000 7f6d27fff700 1 -- 172.21.15.72:0/1087921638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d200aa560 con 0x7f6d20158990 2023-08-31T19:26:59.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.971+0000 7f6d15ffb700 1 -- 172.21.15.72:0/1087921638 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18013600 con 0x7f6d20158990 2023-08-31T19:26:59.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.971+0000 7f6d27fff700 1 -- 172.21.15.72:0/1087921638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d20154d60 con 0x7f6d20158990 2023-08-31T19:26:59.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.972+0000 7f6d27fff700 1 -- 172.21.15.72:0/1087921638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2006c6b0 con 0x7f6d20158990 2023-08-31T19:26:59.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.973+0000 7f6d15ffb700 1 -- 172.21.15.72:0/1087921638 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f6d180139b0 con 0x7f6d20158990 2023-08-31T19:26:59.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.974+0000 7f6d15ffb700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f6d0405ef30 0x7f6d040613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:26:59.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.974+0000 7f6d15ffb700 1 -- 172.21.15.72:0/1087921638 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f6d1807a790 con 0x7f6d20158990 2023-08-31T19:26:59.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.974+0000 7f6d25d9b700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f6d0405ef30 0x7f6d040613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:26:59.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.975+0000 7f6d25d9b700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f6d0405ef30 0x7f6d040613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f6d200c6640 tx=0x7f6d1c016000).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:26:59.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:26:59.978+0000 7f6d15ffb700 1 -- 172.21.15.72:0/1087921638 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6d1804b8b0 con 0x7f6d20158990 2023-08-31T19:27:00.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.149+0000 7f6d27fff700 1 -- 172.21.15.72:0/1087921638 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d200aa3e0 con 0x7f6d0405ef30 2023-08-31T19:27:00.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.149+0000 7f6d15ffb700 1 -- 172.21.15.72:0/1087921638 <== mgr.9771 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6d1c000c90 con 0x7f6d0405ef30 2023-08-31T19:27:00.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.152+0000 7f6d27fff700 1 -- 172.21.15.72:0/1087921638 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f6d0405ef30 msgr2=0x7f6d040613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.152+0000 7f6d27fff700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f6d0405ef30 0x7f6d040613f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f6d200c6640 tx=0x7f6d1c016000).stop 2023-08-31T19:27:00.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.152+0000 7f6d27fff700 1 -- 172.21.15.72:0/1087921638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d20158990 msgr2=0x7f6d20154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.152+0000 7f6d27fff700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d20158990 0x7f6d20154870 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7f6d18007f30 tx=0x7f6d18009930).stop 2023-08-31T19:27:00.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.152+0000 7f6d27fff700 1 -- 172.21.15.72:0/1087921638 shutdown_connections 2023-08-31T19:27:00.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.152+0000 7f6d27fff700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f6d0405ef30 0x7f6d040613f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.152+0000 7f6d27fff700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d20158990 0x7f6d20154870 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.152+0000 7f6d27fff700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f6d20069410 0x7f6d200ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.152+0000 7f6d27fff700 1 --2- 172.21.15.72:0/1087921638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d201580c0 0x7f6d20150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.152+0000 7f6d27fff700 1 -- 172.21.15.72:0/1087921638 >> 172.21.15.72:0/1087921638 conn(0x7f6d200c73a0 msgr2=0x7f6d20151100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:00.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.152+0000 7f6d27fff700 1 -- 172.21.15.72:0/1087921638 shutdown_connections 2023-08-31T19:27:00.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.152+0000 7f6d27fff700 1 -- 172.21.15.72:0/1087921638 wait complete. 2023-08-31T19:27:00.157 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 5 to deep-scrub 2023-08-31T19:27:00.170 INFO:tasks.ceph:Scrubbing osd.6 2023-08-31T19:27:00.171 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:27:00.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.365+0000 7f3b83fff700 1 Processor -- start 2023-08-31T19:27:00.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.365+0000 7f3b83fff700 1 -- start start 2023-08-31T19:27:00.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.366+0000 7f3b83fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3b7c154500 0x7f3b7c0a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.366+0000 7f3b83fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7c0aa620 con 0x7f3b7c154120 2023-08-31T19:27:00.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.366+0000 7f3b83fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7c0aa3a0 con 0x7f3b7c064db0 2023-08-31T19:27:00.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.366+0000 7f3b83fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7c0c5450 con 0x7f3b7c154500 2023-08-31T19:27:00.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.366+0000 7f3b81d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3b7c154120 0x7f3b7c0646a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35210/0 (socket says 172.21.15.72:35210) 2023-08-31T19:27:00.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.366+0000 7f3b81d9b700 1 -- 172.21.15.72:0/740200542 learned_addr learned my addr 172.21.15.72:0/740200542 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:27:00.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b8259c700 1 --2- 172.21.15.72:0/740200542 >> v2:172.21.15.146:3300/0 conn(0x7f3b7c154500 0x7f3b7c0a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:00.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b80d99700 1 -- 172.21.15.72:0/740200542 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342926961 0 0) 0x7f3b7c0aa620 con 0x7f3b7c154120 2023-08-31T19:27:00.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b80d99700 1 -- 172.21.15.72:0/740200542 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b680033f0 con 0x7f3b7c154120 2023-08-31T19:27:00.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b80d99700 1 -- 172.21.15.72:0/740200542 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 245230938 0 0) 0x7f3b680033f0 con 0x7f3b7c154120 2023-08-31T19:27:00.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b80d99700 1 -- 172.21.15.72:0/740200542 >> v2:172.21.15.146:3300/0 conn(0x7f3b7c154500 msgr2=0x7f3b7c0a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:27:00.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b80d99700 1 --2- 172.21.15.72:0/740200542 >> v2:172.21.15.146:3300/0 conn(0x7f3b7c154500 0x7f3b7c0a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b80d99700 1 -- 172.21.15.72:0/740200542 >> v1:172.21.15.146:6789/0 conn(0x7f3b7c064db0 legacy=0x7f3b7c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b80d99700 1 -- 172.21.15.72:0/740200542 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c0c8050 con 0x7f3b7c154120 2023-08-31T19:27:00.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b80d99700 1 -- 172.21.15.72:0/740200542 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f3b78001470 con 0x7f3b7c154120 2023-08-31T19:27:00.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b80d99700 1 -- 172.21.15.72:0/740200542 >> v1:172.21.15.72:6789/0 conn(0x7f3b7c154120 legacy=0x7f3b7c0646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b80d99700 1 --2- 172.21.15.72:0/740200542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b680038e0 0x7f3b68003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b80d99700 1 --2- 172.21.15.72:0/740200542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b68004690 0x7f3b68004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b80d99700 1 --2- 172.21.15.72:0/740200542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b68005050 0x7f3b6800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b80d99700 1 -- 172.21.15.72:0/740200542 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c0c5450 con 0x7f3b680038e0 2023-08-31T19:27:00.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b80d99700 1 -- 172.21.15.72:0/740200542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6800bfe0 con 0x7f3b68004690 2023-08-31T19:27:00.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b80d99700 1 -- 172.21.15.72:0/740200542 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6800c1a0 con 0x7f3b68005050 2023-08-31T19:27:00.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.367+0000 7f3b81d9b700 1 --2- 172.21.15.72:0/740200542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b680038e0 0x7f3b68003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:00.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.368+0000 7f3b8159a700 1 --2- 172.21.15.72:0/740200542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b68004690 0x7f3b68004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:00.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.368+0000 7f3b8259c700 1 --2- 172.21.15.72:0/740200542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b68005050 0x7f3b6800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:00.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.368+0000 7f3b81d9b700 1 -- 172.21.15.72:0/740200542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b68005050 msgr2=0x7f3b6800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:27:00.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.368+0000 7f3b81d9b700 1 --2- 172.21.15.72:0/740200542 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b68005050 0x7f3b6800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.368+0000 7f3b81d9b700 1 -- 172.21.15.72:0/740200542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b68004690 msgr2=0x7f3b68004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:27:00.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.368+0000 7f3b81d9b700 1 --2- 172.21.15.72:0/740200542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b68004690 0x7f3b68004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.368+0000 7f3b81d9b700 1 -- 172.21.15.72:0/740200542 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b680033f0 con 0x7f3b680038e0 2023-08-31T19:27:00.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.368+0000 7f3b8159a700 1 --2- 172.21.15.72:0/740200542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b68004690 0x7f3b68004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:27:00.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.368+0000 7f3b8259c700 1 -- 172.21.15.72:0/740200542 reap_dead start 2023-08-31T19:27:00.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.368+0000 7f3b81d9b700 1 --2- 172.21.15.72:0/740200542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b680038e0 0x7f3b68003d00 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7f3b78001ed0 tx=0x7f3b7c0c6ba0).ready entity=mon.0 client_cookie=91221a9be77be582 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:00.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.368+0000 7f3b80d99700 1 -- 172.21.15.72:0/740200542 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7800ca60 con 0x7f3b680038e0 2023-08-31T19:27:00.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.368+0000 7f3b80d99700 1 -- 172.21.15.72:0/740200542 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7800cbc0 con 0x7f3b680038e0 2023-08-31T19:27:00.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.368+0000 7f3b80d99700 1 -- 172.21.15.72:0/740200542 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b780070d0 con 0x7f3b680038e0 2023-08-31T19:27:00.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.369+0000 7f3b83fff700 1 -- 172.21.15.72:0/740200542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b680038e0 msgr2=0x7f3b68003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.369+0000 7f3b83fff700 1 --2- 172.21.15.72:0/740200542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b680038e0 0x7f3b68003d00 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7f3b78001ed0 tx=0x7f3b7c0c6ba0).stop 2023-08-31T19:27:00.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.369+0000 7f3b83fff700 1 -- 172.21.15.72:0/740200542 shutdown_connections 2023-08-31T19:27:00.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.369+0000 7f3b83fff700 1 --2- 172.21.15.72:0/740200542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b680038e0 0x7f3b68003d00 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.369+0000 7f3b83fff700 1 -- 172.21.15.72:0/740200542 >> 172.21.15.72:0/740200542 conn(0x7f3b7c0cb7e0 msgr2=0x7f3b7c0c7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:00.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.369+0000 7f3b83fff700 1 -- 172.21.15.72:0/740200542 shutdown_connections 2023-08-31T19:27:00.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.369+0000 7f3b83fff700 1 -- 172.21.15.72:0/740200542 wait complete. 2023-08-31T19:27:00.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.370+0000 7f3b83fff700 1 Processor -- start 2023-08-31T19:27:00.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.370+0000 7f3b83fff700 1 -- start start 2023-08-31T19:27:00.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.371+0000 7f3b83fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b680038e0 0x7f3b7c0c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.371+0000 7f3b83fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b7c0afee0 0x7f3b7c0c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.371+0000 7f3b83fff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b7c0b0360 0x7f3b7c0c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.371+0000 7f3b83fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c0c4b30 con 0x7f3b680038e0 2023-08-31T19:27:00.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.371+0000 7f3b83fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c0c2300 con 0x7f3b7c0afee0 2023-08-31T19:27:00.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.371+0000 7f3b83fff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c1651f0 con 0x7f3b7c0b0360 2023-08-31T19:27:00.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b81d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b680038e0 0x7f3b7c0c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:00.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b81d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b680038e0 0x7f3b7c0c1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47510/0 (socket says 172.21.15.72:47510) 2023-08-31T19:27:00.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b81d9b700 1 -- 172.21.15.72:0/3206657570 learned_addr learned my addr 172.21.15.72:0/3206657570 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:27:00.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b8259c700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b7c0b0360 0x7f3b7c0c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:00.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b8159a700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b7c0afee0 0x7f3b7c0c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:00.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b81d9b700 1 -- 172.21.15.72:0/3206657570 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b7c0b0360 msgr2=0x7f3b7c0c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b81d9b700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b7c0b0360 0x7f3b7c0c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b81d9b700 1 -- 172.21.15.72:0/3206657570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b7c0afee0 msgr2=0x7f3b7c0c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b81d9b700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b7c0afee0 0x7f3b7c0c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b81d9b700 1 -- 172.21.15.72:0/3206657570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c0ae4a0 con 0x7f3b680038e0 2023-08-31T19:27:00.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b8259c700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3b7c0b0360 0x7f3b7c0c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:27:00.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b8159a700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3b7c0afee0 0x7f3b7c0c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:27:00.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b81d9b700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b680038e0 0x7f3b7c0c1e10 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7f3b6800bfb0 tx=0x7f3b78015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:00.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b71ffb700 1 -- 172.21.15.72:0/3206657570 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7800cd30 con 0x7f3b680038e0 2023-08-31T19:27:00.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b71ffb700 1 -- 172.21.15.72:0/3206657570 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7800ce90 con 0x7f3b680038e0 2023-08-31T19:27:00.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b83fff700 1 -- 172.21.15.72:0/3206657570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7c164f10 con 0x7f3b680038e0 2023-08-31T19:27:00.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.372+0000 7f3b71ffb700 1 -- 172.21.15.72:0/3206657570 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b780046b0 con 0x7f3b680038e0 2023-08-31T19:27:00.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.373+0000 7f3b83fff700 1 -- 172.21.15.72:0/3206657570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c0ae130 con 0x7f3b680038e0 2023-08-31T19:27:00.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.373+0000 7f3b83fff700 1 -- 172.21.15.72:0/3206657570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b7c06a7e0 con 0x7f3b680038e0 2023-08-31T19:27:00.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.374+0000 7f3b71ffb700 1 -- 172.21.15.72:0/3206657570 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f3b7801c070 con 0x7f3b680038e0 2023-08-31T19:27:00.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.375+0000 7f3b71ffb700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3b6005ef30 0x7f3b600613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.375+0000 7f3b71ffb700 1 -- 172.21.15.72:0/3206657570 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f3b7807a8c0 con 0x7f3b680038e0 2023-08-31T19:27:00.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.375+0000 7f3b8159a700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3b6005ef30 0x7f3b600613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:00.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.376+0000 7f3b71ffb700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.146:6816/143472,v1:172.21.15.146:6818/143472] conn(0x7f3b60065e00 0x7f3b60068270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.376+0000 7f3b71ffb700 1 -- 172.21.15.72:0/3206657570 --> [v2:172.21.15.146:6816/143472,v1:172.21.15.146:6818/143472] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b60068850 con 0x7f3b60065e00 2023-08-31T19:27:00.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.376+0000 7f3b71ffb700 1 -- 172.21.15.72:0/3206657570 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b7807f220 con 0x7f3b680038e0 2023-08-31T19:27:00.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.376+0000 7f3b8159a700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3b6005ef30 0x7f3b600613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3b6c000c00 tx=0x7f3b6c009040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:00.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.376+0000 7f3b8259c700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.146:6816/143472,v1:172.21.15.146:6818/143472] conn(0x7f3b60065e00 0x7f3b60068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:00.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.377+0000 7f3b8259c700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.146:6816/143472,v1:172.21.15.146:6818/143472] conn(0x7f3b60065e00 0x7f3b60068270 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:00.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.377+0000 7f3b71ffb700 1 -- 172.21.15.72:0/3206657570 <== osd.6 v2:172.21.15.146:6816/143472 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f3b60068850 con 0x7f3b60065e00 2023-08-31T19:27:00.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.391+0000 7f3b83fff700 1 -- 172.21.15.72:0/3206657570 --> [v2:172.21.15.146:6816/143472,v1:172.21.15.146:6818/143472] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3b7c06c6b0 con 0x7f3b60065e00 2023-08-31T19:27:00.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.391+0000 7f3b71ffb700 1 -- 172.21.15.72:0/3206657570 <== osd.6 v2:172.21.15.146:6816/143472 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3b7c06c6b0 con 0x7f3b60065e00 2023-08-31T19:27:00.398 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:27:00.398 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:27:00.399 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:27:00.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.392+0000 7f3b83fff700 1 -- 172.21.15.72:0/3206657570 >> [v2:172.21.15.146:6816/143472,v1:172.21.15.146:6818/143472] conn(0x7f3b60065e00 msgr2=0x7f3b60068270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.392+0000 7f3b83fff700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.146:6816/143472,v1:172.21.15.146:6818/143472] conn(0x7f3b60065e00 0x7f3b60068270 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.392+0000 7f3b83fff700 1 -- 172.21.15.72:0/3206657570 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3b6005ef30 msgr2=0x7f3b600613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.392+0000 7f3b83fff700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3b6005ef30 0x7f3b600613f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3b6c000c00 tx=0x7f3b6c009040).stop 2023-08-31T19:27:00.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.392+0000 7f3b83fff700 1 -- 172.21.15.72:0/3206657570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b680038e0 msgr2=0x7f3b7c0c1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.392+0000 7f3b83fff700 1 --2- 172.21.15.72:0/3206657570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b680038e0 0x7f3b7c0c1e10 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7f3b6800bfb0 tx=0x7f3b78015000).stop 2023-08-31T19:27:00.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.392+0000 7f3b8259c700 1 -- 172.21.15.72:0/3206657570 reap_dead start 2023-08-31T19:27:00.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.392+0000 7f3b83fff700 1 -- 172.21.15.72:0/3206657570 shutdown_connections 2023-08-31T19:27:00.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.392+0000 7f3b83fff700 1 -- 172.21.15.72:0/3206657570 >> 172.21.15.72:0/3206657570 conn(0x7f3b7c0cb7e0 msgr2=0x7f3b7c0c9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:00.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.392+0000 7f3b83fff700 1 -- 172.21.15.72:0/3206657570 shutdown_connections 2023-08-31T19:27:00.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.392+0000 7f3b83fff700 1 -- 172.21.15.72:0/3206657570 wait complete. 2023-08-31T19:27:00.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-08-31T19:27:00.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.598+0000 7f61007ff700 1 Processor -- start 2023-08-31T19:27:00.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.598+0000 7f61007ff700 1 -- start start 2023-08-31T19:27:00.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.599+0000 7f61007ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f60f80c8ee0 0x7f60f8154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.599+0000 7f61007ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f80c9450 con 0x7f60f8153ca0 2023-08-31T19:27:00.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.599+0000 7f61007ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f80c9730 con 0x7f60f80ca4f0 2023-08-31T19:27:00.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.599+0000 7f61007ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f80c9a10 con 0x7f60f80c8ee0 2023-08-31T19:27:00.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.599+0000 7f60fe59b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f60f8153ca0 0x7f60f8158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35226/0 (socket says 172.21.15.72:35226) 2023-08-31T19:27:00.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.599+0000 7f60fdd9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f60f80c8ee0 0x7f60f8154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:00.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.599+0000 7f60fe59b700 1 -- 172.21.15.72:0/874058209 learned_addr learned my addr 172.21.15.72:0/874058209 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:27:00.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.600+0000 7f60fd599700 1 -- 172.21.15.72:0/874058209 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045814567 0 0) 0x7f60f80c9450 con 0x7f60f8153ca0 2023-08-31T19:27:00.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.600+0000 7f60fdd9a700 1 -- 172.21.15.72:0/874058209 >> v1:172.21.15.146:6789/0 conn(0x7f60f80ca4f0 legacy=0x7f60f8063100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.600+0000 7f60fdd9a700 1 -- 172.21.15.72:0/874058209 >> v1:172.21.15.72:6789/0 conn(0x7f60f8153ca0 legacy=0x7f60f8158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.600+0000 7f60fdd9a700 1 -- 172.21.15.72:0/874058209 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f80c9cf0 con 0x7f60f80c8ee0 2023-08-31T19:27:00.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.600+0000 7f60fdd9a700 1 --2- 172.21.15.72:0/874058209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f80c8ee0 0x7f60f8154080 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7f60e8009760 tx=0x7f60e8009060).ready entity=mon.0 client_cookie=994981cbecad51bf server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:00.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.600+0000 7f60fd599700 1 -- 172.21.15.72:0/874058209 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e800b580 con 0x7f60f80c8ee0 2023-08-31T19:27:00.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.600+0000 7f60fd599700 1 -- 172.21.15.72:0/874058209 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e800b6e0 con 0x7f60f80c8ee0 2023-08-31T19:27:00.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.600+0000 7f60fd599700 1 -- 172.21.15.72:0/874058209 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e800ba60 con 0x7f60f80c8ee0 2023-08-31T19:27:00.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.601+0000 7f61007ff700 1 -- 172.21.15.72:0/874058209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f80c8ee0 msgr2=0x7f60f8154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.601+0000 7f61007ff700 1 --2- 172.21.15.72:0/874058209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f80c8ee0 0x7f60f8154080 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7f60e8009760 tx=0x7f60e8009060).stop 2023-08-31T19:27:00.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.601+0000 7f61007ff700 1 -- 172.21.15.72:0/874058209 shutdown_connections 2023-08-31T19:27:00.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.601+0000 7f61007ff700 1 --2- 172.21.15.72:0/874058209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f80c8ee0 0x7f60f8154080 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.601+0000 7f61007ff700 1 -- 172.21.15.72:0/874058209 >> 172.21.15.72:0/874058209 conn(0x7f60f80cadb0 msgr2=0x7f60f80cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:00.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.601+0000 7f61007ff700 1 -- 172.21.15.72:0/874058209 shutdown_connections 2023-08-31T19:27:00.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.601+0000 7f61007ff700 1 -- 172.21.15.72:0/874058209 wait complete. 2023-08-31T19:27:00.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.602+0000 7f61007ff700 1 Processor -- start 2023-08-31T19:27:00.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.603+0000 7f61007ff700 1 -- start start 2023-08-31T19:27:00.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.603+0000 7f61007ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f80c8ee0 0x7f60f80ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.603+0000 7f61007ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f80ca4f0 0x7f60f8165420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.603+0000 7f61007ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f8153ca0 0x7f60f80a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.603+0000 7f61007ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f80af3b0 con 0x7f60f80ca4f0 2023-08-31T19:27:00.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.603+0000 7f61007ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8165910 con 0x7f60f8153ca0 2023-08-31T19:27:00.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.603+0000 7f61007ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f80ae7a0 con 0x7f60f80c8ee0 2023-08-31T19:27:00.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.604+0000 7f60fdd9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f80ca4f0 0x7f60f8165420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:00.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.604+0000 7f60fdd9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f80ca4f0 0x7f60f8165420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47536/0 (socket says 172.21.15.72:47536) 2023-08-31T19:27:00.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.604+0000 7f60fdd9a700 1 -- 172.21.15.72:0/204068419 learned_addr learned my addr 172.21.15.72:0/204068419 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:27:00.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.604+0000 7f60fed9c700 1 --2- 172.21.15.72:0/204068419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f8153ca0 0x7f60f80a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:00.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.604+0000 7f60fe59b700 1 --2- 172.21.15.72:0/204068419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f80c8ee0 0x7f60f80ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:00.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.604+0000 7f60fdd9a700 1 -- 172.21.15.72:0/204068419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f80c8ee0 msgr2=0x7f60f80ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.604+0000 7f60fdd9a700 1 --2- 172.21.15.72:0/204068419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f80c8ee0 0x7f60f80ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.604+0000 7f60fdd9a700 1 -- 172.21.15.72:0/204068419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f8153ca0 msgr2=0x7f60f80a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.604+0000 7f60fdd9a700 1 --2- 172.21.15.72:0/204068419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f8153ca0 0x7f60f80a9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.604+0000 7f60fdd9a700 1 -- 172.21.15.72:0/204068419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80092a0 con 0x7f60f80ca4f0 2023-08-31T19:27:00.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.604+0000 7f60fdd9a700 1 --2- 172.21.15.72:0/204068419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f80ca4f0 0x7f60f8165420 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7f60e800b340 tx=0x7f60e8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:00.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.605+0000 7f60ee7fc700 1 -- 172.21.15.72:0/204068419 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e800b850 con 0x7f60f80ca4f0 2023-08-31T19:27:00.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.605+0000 7f60ee7fc700 1 -- 172.21.15.72:0/204068419 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e800b9d0 con 0x7f60f80ca4f0 2023-08-31T19:27:00.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.605+0000 7f60ee7fc700 1 -- 172.21.15.72:0/204068419 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e801b660 con 0x7f60f80ca4f0 2023-08-31T19:27:00.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.605+0000 7f61007ff700 1 -- 172.21.15.72:0/204068419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f80aea80 con 0x7f60f80ca4f0 2023-08-31T19:27:00.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.605+0000 7f61007ff700 1 -- 172.21.15.72:0/204068419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f80af040 con 0x7f60f80ca4f0 2023-08-31T19:27:00.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.606+0000 7f61007ff700 1 -- 172.21.15.72:0/204068419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f806c6b0 con 0x7f60f80ca4f0 2023-08-31T19:27:00.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.607+0000 7f60ee7fc700 1 -- 172.21.15.72:0/204068419 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f60e801ba50 con 0x7f60f80ca4f0 2023-08-31T19:27:00.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.607+0000 7f60ee7fc700 1 --2- 172.21.15.72:0/204068419 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f60dc05ef30 0x7f60dc0613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.607+0000 7f60ee7fc700 1 -- 172.21.15.72:0/204068419 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f60e807bbc0 con 0x7f60f80ca4f0 2023-08-31T19:27:00.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.608+0000 7f60fe59b700 1 --2- 172.21.15.72:0/204068419 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f60dc05ef30 0x7f60dc0613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:00.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.608+0000 7f60fe59b700 1 --2- 172.21.15.72:0/204068419 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f60dc05ef30 0x7f60dc0613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f60f4007fd0 tx=0x7f60f4007db0).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:00.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.611+0000 7f60ee7fc700 1 -- 172.21.15.72:0/204068419 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f60e804cd40 con 0x7f60f80ca4f0 2023-08-31T19:27:00.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.780+0000 7f61007ff700 1 -- 172.21.15.72:0/204068419 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f60f80c9fd0 con 0x7f60dc05ef30 2023-08-31T19:27:00.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.780+0000 7f60ee7fc700 1 -- 172.21.15.72:0/204068419 <== mgr.9771 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f60f80c9fd0 con 0x7f60dc05ef30 2023-08-31T19:27:00.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.782+0000 7f61007ff700 1 -- 172.21.15.72:0/204068419 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f60dc05ef30 msgr2=0x7f60dc0613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.782+0000 7f61007ff700 1 --2- 172.21.15.72:0/204068419 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f60dc05ef30 0x7f60dc0613f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f60f4007fd0 tx=0x7f60f4007db0).stop 2023-08-31T19:27:00.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.782+0000 7f61007ff700 1 -- 172.21.15.72:0/204068419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f80ca4f0 msgr2=0x7f60f8165420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.782+0000 7f61007ff700 1 --2- 172.21.15.72:0/204068419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f80ca4f0 0x7f60f8165420 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 rx=0x7f60e800b340 tx=0x7f60e8017000).stop 2023-08-31T19:27:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.782+0000 7f61007ff700 1 -- 172.21.15.72:0/204068419 shutdown_connections 2023-08-31T19:27:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.782+0000 7f61007ff700 1 --2- 172.21.15.72:0/204068419 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f60dc05ef30 0x7f60dc0613f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.782+0000 7f61007ff700 1 --2- 172.21.15.72:0/204068419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60f8153ca0 0x7f60f80a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.782+0000 7f61007ff700 1 --2- 172.21.15.72:0/204068419 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f60f80c8ee0 0x7f60f80ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.782+0000 7f61007ff700 1 --2- 172.21.15.72:0/204068419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f80ca4f0 0x7f60f8165420 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.782+0000 7f61007ff700 1 -- 172.21.15.72:0/204068419 >> 172.21.15.72:0/204068419 conn(0x7f60f80cadb0 msgr2=0x7f60f80c1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.782+0000 7f61007ff700 1 -- 172.21.15.72:0/204068419 shutdown_connections 2023-08-31T19:27:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.782+0000 7f61007ff700 1 -- 172.21.15.72:0/204068419 wait complete. 2023-08-31T19:27:00.786 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 6 to deep-scrub 2023-08-31T19:27:00.800 INFO:tasks.ceph:Scrubbing osd.7 2023-08-31T19:27:00.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:27:00.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.995+0000 7fa61abff700 1 Processor -- start 2023-08-31T19:27:00.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.995+0000 7fa61abff700 1 -- start start 2023-08-31T19:27:00.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.996+0000 7fa61abff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa6141373e0 0x7fa6140c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.996+0000 7fa61abff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6140bb9a0 0x7fa614069b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:00.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.996+0000 7fa61abff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6140c13e0 con 0x7fa6141377c0 2023-08-31T19:27:00.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.996+0000 7fa61abff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6140c19a0 con 0x7fa6140bb9a0 2023-08-31T19:27:00.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.996+0000 7fa61abff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61406a1d0 con 0x7fa6141373e0 2023-08-31T19:27:00.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.997+0000 7fa61919c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6140bb9a0 0x7fa614069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:00.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.997+0000 7fa61919c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6140bb9a0 0x7fa614069b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47538/0 (socket says 172.21.15.72:47538) 2023-08-31T19:27:00.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.997+0000 7fa61919c700 1 -- 172.21.15.72:0/2739418766 learned_addr learned my addr 172.21.15.72:0/2739418766 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:27:01.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.997+0000 7fa61899b700 1 --2- 172.21.15.72:0/2739418766 >> v2:172.21.15.146:3300/0 conn(0x7fa6141373e0 0x7fa6140c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.997+0000 7fa61919c700 1 -- 172.21.15.72:0/2739418766 >> v2:172.21.15.146:3300/0 conn(0x7fa6141373e0 msgr2=0x7fa6140c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:27:01.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.997+0000 7fa61919c700 1 --2- 172.21.15.72:0/2739418766 >> v2:172.21.15.146:3300/0 conn(0x7fa6141373e0 0x7fa6140c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.997+0000 7fa61919c700 1 -- 172.21.15.72:0/2739418766 >> v1:172.21.15.146:6789/0 conn(0x7fa6141377c0 legacy=0x7fa614069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.997+0000 7fa61919c700 1 -- 172.21.15.72:0/2739418766 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61406a4b0 con 0x7fa6140bb9a0 2023-08-31T19:27:01.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.997+0000 7fa61919c700 1 --2- 172.21.15.72:0/2739418766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140bb9a0 0x7fa614069b70 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7fa6140c7a50 tx=0x7fa60c009840).ready entity=mon.0 client_cookie=835697d946be41fd server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:01.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.997+0000 7fa6137fe700 1 -- 172.21.15.72:0/2739418766 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c00e070 con 0x7fa6140bb9a0 2023-08-31T19:27:01.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.997+0000 7fa6137fe700 1 -- 172.21.15.72:0/2739418766 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60c00ba50 con 0x7fa6140bb9a0 2023-08-31T19:27:01.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.997+0000 7fa6137fe700 1 -- 172.21.15.72:0/2739418766 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c00bdd0 con 0x7fa6140bb9a0 2023-08-31T19:27:01.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.998+0000 7fa61abff700 1 -- 172.21.15.72:0/2739418766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140bb9a0 msgr2=0x7fa614069b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.998+0000 7fa61abff700 1 --2- 172.21.15.72:0/2739418766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140bb9a0 0x7fa614069b70 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7fa6140c7a50 tx=0x7fa60c009840).stop 2023-08-31T19:27:01.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.998+0000 7fa61abff700 1 -- 172.21.15.72:0/2739418766 shutdown_connections 2023-08-31T19:27:01.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.998+0000 7fa61abff700 1 --2- 172.21.15.72:0/2739418766 >> v2:172.21.15.146:3300/0 conn(0x7fa6141373e0 0x7fa6140c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.998+0000 7fa61abff700 1 --2- 172.21.15.72:0/2739418766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140bb9a0 0x7fa614069b70 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.998+0000 7fa61abff700 1 -- 172.21.15.72:0/2739418766 >> 172.21.15.72:0/2739418766 conn(0x7fa614062650 msgr2=0x7fa614062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:01.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.998+0000 7fa61abff700 1 -- 172.21.15.72:0/2739418766 shutdown_connections 2023-08-31T19:27:01.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:00.998+0000 7fa61abff700 1 -- 172.21.15.72:0/2739418766 wait complete. 2023-08-31T19:27:01.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.000+0000 7fa61abff700 1 Processor -- start 2023-08-31T19:27:01.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.000+0000 7fa61abff700 1 -- start start 2023-08-31T19:27:01.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61abff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140bb9a0 0x7fa614130fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:01.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61abff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6141373e0 0x7fa6140a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:01.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61abff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6141377c0 0x7fa6140c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61abff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140ac520 con 0x7fa6140bb9a0 2023-08-31T19:27:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61abff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6141314b0 con 0x7fa6141377c0 2023-08-31T19:27:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61abff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140ab910 con 0x7fa6141373e0 2023-08-31T19:27:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61899b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140bb9a0 0x7fa614130fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61899b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140bb9a0 0x7fa614130fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47550/0 (socket says 172.21.15.72:47550) 2023-08-31T19:27:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61899b700 1 -- 172.21.15.72:0/3815903216 learned_addr learned my addr 172.21.15.72:0/3815903216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:27:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa613fff700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6141373e0 0x7fa6140a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61919c700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6141377c0 0x7fa6140c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61899b700 1 -- 172.21.15.72:0/3815903216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6141373e0 msgr2=0x7fa6140a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61899b700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6141373e0 0x7fa6140a9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61899b700 1 -- 172.21.15.72:0/3815903216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6141377c0 msgr2=0x7fa6140c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61899b700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6141377c0 0x7fa6140c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61899b700 1 -- 172.21.15.72:0/3815903216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c009ae0 con 0x7fa6140bb9a0 2023-08-31T19:27:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa613fff700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fa6141373e0 0x7fa6140a9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:27:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.001+0000 7fa61919c700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6141377c0 0x7fa6140c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:27:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.002+0000 7fa61899b700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140bb9a0 0x7fa614130fc0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 rx=0x7fa60800d890 tx=0x7fa608008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.002+0000 7fa610ff9700 1 -- 172.21.15.72:0/3815903216 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6080125f0 con 0x7fa6140bb9a0 2023-08-31T19:27:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.002+0000 7fa610ff9700 1 -- 172.21.15.72:0/3815903216 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa608012750 con 0x7fa6140bb9a0 2023-08-31T19:27:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.002+0000 7fa610ff9700 1 -- 172.21.15.72:0/3815903216 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608012ad0 con 0x7fa6140bb9a0 2023-08-31T19:27:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.002+0000 7fa61abff700 1 -- 172.21.15.72:0/3815903216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6140abbf0 con 0x7fa6140bb9a0 2023-08-31T19:27:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.002+0000 7fa61abff700 1 -- 172.21.15.72:0/3815903216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6140ac1b0 con 0x7fa6140bb9a0 2023-08-31T19:27:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.003+0000 7fa61abff700 1 -- 172.21.15.72:0/3815903216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa61406c6b0 con 0x7fa6140bb9a0 2023-08-31T19:27:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.004+0000 7fa610ff9700 1 -- 172.21.15.72:0/3815903216 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fa608013480 con 0x7fa6140bb9a0 2023-08-31T19:27:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.005+0000 7fa610ff9700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa5f805ef30 0x7fa5f80613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.005+0000 7fa610ff9700 1 -- 172.21.15.72:0/3815903216 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7fa60807acc0 con 0x7fa6140bb9a0 2023-08-31T19:27:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.005+0000 7fa613fff700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa5f805ef30 0x7fa5f80613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.005+0000 7fa610ff9700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.146:6802/143460,v1:172.21.15.146:6804/143460] conn(0x7fa5f8065e00 0x7fa5f8068270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.005+0000 7fa610ff9700 1 -- 172.21.15.72:0/3815903216 --> [v2:172.21.15.146:6802/143460,v1:172.21.15.146:6804/143460] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5f8068850 con 0x7fa5f8065e00 2023-08-31T19:27:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.005+0000 7fa610ff9700 1 -- 172.21.15.72:0/3815903216 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa60807b0a0 con 0x7fa6140bb9a0 2023-08-31T19:27:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.006+0000 7fa613fff700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa5f805ef30 0x7fa5f80613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa614162430 tx=0x7fa600009040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:01.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.006+0000 7fa61919c700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.146:6802/143460,v1:172.21.15.146:6804/143460] conn(0x7fa5f8065e00 0x7fa5f8068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.006+0000 7fa61919c700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.146:6802/143460,v1:172.21.15.146:6804/143460] conn(0x7fa5f8065e00 0x7fa5f8068270 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:01.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.007+0000 7fa610ff9700 1 -- 172.21.15.72:0/3815903216 <== osd.7 v2:172.21.15.146:6802/143460 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fa5f8068850 con 0x7fa5f8065e00 2023-08-31T19:27:01.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.021+0000 7fa61abff700 1 -- 172.21.15.72:0/3815903216 --> [v2:172.21.15.146:6802/143460,v1:172.21.15.146:6804/143460] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa6140ac660 con 0x7fa5f8065e00 2023-08-31T19:27:01.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.021+0000 7fa610ff9700 1 -- 172.21.15.72:0/3815903216 <== osd.7 v2:172.21.15.146:6802/143460 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa60c0092e0 con 0x7fa5f8065e00 2023-08-31T19:27:01.022 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-08-31T19:27:01.022 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:27:01.022 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-08-31T19:27:01.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.022+0000 7fa61abff700 1 -- 172.21.15.72:0/3815903216 >> [v2:172.21.15.146:6802/143460,v1:172.21.15.146:6804/143460] conn(0x7fa5f8065e00 msgr2=0x7fa5f8068270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.022+0000 7fa61abff700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.146:6802/143460,v1:172.21.15.146:6804/143460] conn(0x7fa5f8065e00 0x7fa5f8068270 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.022+0000 7fa61abff700 1 -- 172.21.15.72:0/3815903216 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa5f805ef30 msgr2=0x7fa5f80613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.022+0000 7fa61abff700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fa5f805ef30 0x7fa5f80613f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa614162430 tx=0x7fa600009040).stop 2023-08-31T19:27:01.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.022+0000 7fa61abff700 1 -- 172.21.15.72:0/3815903216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140bb9a0 msgr2=0x7fa614130fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.022+0000 7fa61abff700 1 --2- 172.21.15.72:0/3815903216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6140bb9a0 0x7fa614130fc0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 rx=0x7fa60800d890 tx=0x7fa608008040).stop 2023-08-31T19:27:01.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.022+0000 7fa61919c700 1 -- 172.21.15.72:0/3815903216 reap_dead start 2023-08-31T19:27:01.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.022+0000 7fa61abff700 1 -- 172.21.15.72:0/3815903216 shutdown_connections 2023-08-31T19:27:01.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.022+0000 7fa61abff700 1 -- 172.21.15.72:0/3815903216 >> 172.21.15.72:0/3815903216 conn(0x7fa614062650 msgr2=0x7fa6141519e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:01.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.022+0000 7fa61abff700 1 -- 172.21.15.72:0/3815903216 shutdown_connections 2023-08-31T19:27:01.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.022+0000 7fa61abff700 1 -- 172.21.15.72:0/3815903216 wait complete. 2023-08-31T19:27:01.039 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-08-31T19:27:01.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.226+0000 7f8954bff700 1 Processor -- start 2023-08-31T19:27:01.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.226+0000 7f8954bff700 1 -- start start 2023-08-31T19:27:01.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.227+0000 7f8954bff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8950064db0 0x7f8950154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:01.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.227+0000 7f8954bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89500bfd00 con 0x7f8950153d80 2023-08-31T19:27:01.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.227+0000 7f8954bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89500c02c0 con 0x7f89500c5d80 2023-08-31T19:27:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.227+0000 7f8954bff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89500c61f0 con 0x7f8950064db0 2023-08-31T19:27:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.228+0000 7f894e59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8950153d80 0x7f89500646a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35242/0 (socket says 172.21.15.72:35242) 2023-08-31T19:27:01.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.228+0000 7f894e59c700 1 -- 172.21.15.72:0/2617533783 learned_addr learned my addr 172.21.15.72:0/2617533783 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:27:01.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.228+0000 7f894dd9b700 1 --2- 172.21.15.72:0/2617533783 >> v2:172.21.15.146:3300/0 conn(0x7f8950064db0 0x7f8950154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.228+0000 7f894d59a700 1 -- 172.21.15.72:0/2617533783 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991690274 0 0) 0x7f89500bfd00 con 0x7f8950153d80 2023-08-31T19:27:01.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.228+0000 7f894d59a700 1 -- 172.21.15.72:0/2617533783 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89380033f0 con 0x7f8950153d80 2023-08-31T19:27:01.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.228+0000 7f894dd9b700 1 -- 172.21.15.72:0/2617533783 >> v1:172.21.15.146:6789/0 conn(0x7f89500c5d80 legacy=0x7f89500c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.228+0000 7f894d59a700 1 -- 172.21.15.72:0/2617533783 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65280892 0 0) 0x7f89500c02c0 con 0x7f89500c5d80 2023-08-31T19:27:01.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.228+0000 7f894dd9b700 1 -- 172.21.15.72:0/2617533783 >> v1:172.21.15.72:6789/0 conn(0x7f8950153d80 legacy=0x7f89500646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.228+0000 7f894dd9b700 1 -- 172.21.15.72:0/2617533783 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89500c6460 con 0x7f8950064db0 2023-08-31T19:27:01.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.229+0000 7f894dd9b700 1 --2- 172.21.15.72:0/2617533783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8950064db0 0x7f8950154160 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f8944009760 tx=0x7f8944009060).ready entity=mon.1 client_cookie=6c8c893ecadc5f27 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:01.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.229+0000 7f894d59a700 1 -- 172.21.15.72:0/2617533783 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8940001470 con 0x7f8950064db0 2023-08-31T19:27:01.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.229+0000 7f894d59a700 1 -- 172.21.15.72:0/2617533783 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8944009130 con 0x7f8950064db0 2023-08-31T19:27:01.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.229+0000 7f894d59a700 1 -- 172.21.15.72:0/2617533783 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944012620 con 0x7f8950064db0 2023-08-31T19:27:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.229+0000 7f8954bff700 1 -- 172.21.15.72:0/2617533783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8950064db0 msgr2=0x7f8950154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.229+0000 7f8954bff700 1 --2- 172.21.15.72:0/2617533783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8950064db0 0x7f8950154160 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f8944009760 tx=0x7f8944009060).stop 2023-08-31T19:27:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.229+0000 7f8954bff700 1 -- 172.21.15.72:0/2617533783 shutdown_connections 2023-08-31T19:27:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.230+0000 7f8954bff700 1 --2- 172.21.15.72:0/2617533783 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8950064db0 0x7f8950154160 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.230+0000 7f8954bff700 1 -- 172.21.15.72:0/2617533783 >> 172.21.15.72:0/2617533783 conn(0x7f8950063b20 msgr2=0x7f89500cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.230+0000 7f8954bff700 1 -- 172.21.15.72:0/2617533783 shutdown_connections 2023-08-31T19:27:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.230+0000 7f8954bff700 1 -- 172.21.15.72:0/2617533783 wait complete. 2023-08-31T19:27:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.231+0000 7f8954bff700 1 Processor -- start 2023-08-31T19:27:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.231+0000 7f8954bff700 1 -- start start 2023-08-31T19:27:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.232+0000 7f8954bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8950064db0 0x7f895013e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:01.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.232+0000 7f8954bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89500c5d80 0x7f89500c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:01.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.232+0000 7f8954bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8950153d80 0x7f89500c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:01.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.232+0000 7f8954bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8950165560 con 0x7f8950153d80 2023-08-31T19:27:01.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.232+0000 7f8954bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89500c44d0 con 0x7f8950064db0 2023-08-31T19:27:01.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.232+0000 7f8954bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895014de10 con 0x7f89500c5d80 2023-08-31T19:27:01.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.232+0000 7f894ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8950153d80 0x7f89500c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.232+0000 7f894ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8950153d80 0x7f89500c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47558/0 (socket says 172.21.15.72:47558) 2023-08-31T19:27:01.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.232+0000 7f894ed9d700 1 -- 172.21.15.72:0/318773858 learned_addr learned my addr 172.21.15.72:0/318773858 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:27:01.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.233+0000 7f894e59c700 1 --2- 172.21.15.72:0/318773858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8950064db0 0x7f895013e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.233+0000 7f894dd9b700 1 --2- 172.21.15.72:0/318773858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89500c5d80 0x7f89500c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.233+0000 7f894ed9d700 1 -- 172.21.15.72:0/318773858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89500c5d80 msgr2=0x7f89500c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.233+0000 7f894ed9d700 1 --2- 172.21.15.72:0/318773858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89500c5d80 0x7f89500c3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.233+0000 7f894ed9d700 1 -- 172.21.15.72:0/318773858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8950064db0 msgr2=0x7f895013e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.233+0000 7f894ed9d700 1 --2- 172.21.15.72:0/318773858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8950064db0 0x7f895013e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.233+0000 7f894ed9d700 1 -- 172.21.15.72:0/318773858 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89440092a0 con 0x7f8950153d80 2023-08-31T19:27:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.233+0000 7f894dd9b700 1 --2- 172.21.15.72:0/318773858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89500c5d80 0x7f89500c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:27:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.233+0000 7f894ed9d700 1 --2- 172.21.15.72:0/318773858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8950153d80 0x7f89500c3fe0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7f8948002230 tx=0x7f8948007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.233+0000 7f893e7fc700 1 -- 172.21.15.72:0/318773858 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894800a580 con 0x7f8950153d80 2023-08-31T19:27:01.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.233+0000 7f893e7fc700 1 -- 172.21.15.72:0/318773858 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894800a700 con 0x7f8950153d80 2023-08-31T19:27:01.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.233+0000 7f8954bff700 1 -- 172.21.15.72:0/318773858 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8950165280 con 0x7f8950153d80 2023-08-31T19:27:01.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.233+0000 7f893e7fc700 1 -- 172.21.15.72:0/318773858 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894800aac0 con 0x7f8950153d80 2023-08-31T19:27:01.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.233+0000 7f8954bff700 1 -- 172.21.15.72:0/318773858 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8950167ff0 con 0x7f8950153d80 2023-08-31T19:27:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.234+0000 7f8954bff700 1 -- 172.21.15.72:0/318773858 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89500646a0 con 0x7f8950153d80 2023-08-31T19:27:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.235+0000 7f893e7fc700 1 -- 172.21.15.72:0/318773858 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f894801b400 con 0x7f8950153d80 2023-08-31T19:27:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.236+0000 7f893e7fc700 1 --2- 172.21.15.72:0/318773858 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f893005ef30 0x7f89300613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:01.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.236+0000 7f893e7fc700 1 -- 172.21.15.72:0/318773858 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f8948079f90 con 0x7f8950153d80 2023-08-31T19:27:01.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.236+0000 7f894e59c700 1 --2- 172.21.15.72:0/318773858 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f893005ef30 0x7f89300613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.237+0000 7f894e59c700 1 --2- 172.21.15.72:0/318773858 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f893005ef30 0x7f89300613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f89400011e0 tx=0x7f8940000bc0).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:01.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.240+0000 7f893e7fc700 1 -- 172.21.15.72:0/318773858 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f89480a88f0 con 0x7f8950153d80 2023-08-31T19:27:01.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.408+0000 7f8954bff700 1 -- 172.21.15.72:0/318773858 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f895006c6b0 con 0x7f893005ef30 2023-08-31T19:27:01.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.408+0000 7f893e7fc700 1 -- 172.21.15.72:0/318773858 <== mgr.9771 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f895006c6b0 con 0x7f893005ef30 2023-08-31T19:27:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.410+0000 7f8954bff700 1 -- 172.21.15.72:0/318773858 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f893005ef30 msgr2=0x7f89300613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.410+0000 7f8954bff700 1 --2- 172.21.15.72:0/318773858 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f893005ef30 0x7f89300613f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f89400011e0 tx=0x7f8940000bc0).stop 2023-08-31T19:27:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.410+0000 7f8954bff700 1 -- 172.21.15.72:0/318773858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8950153d80 msgr2=0x7f89500c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.410+0000 7f8954bff700 1 --2- 172.21.15.72:0/318773858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8950153d80 0x7f89500c3fe0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7f8948002230 tx=0x7f8948007f70).stop 2023-08-31T19:27:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.410+0000 7f8954bff700 1 -- 172.21.15.72:0/318773858 shutdown_connections 2023-08-31T19:27:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.410+0000 7f8954bff700 1 --2- 172.21.15.72:0/318773858 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f893005ef30 0x7f89300613f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.410+0000 7f8954bff700 1 --2- 172.21.15.72:0/318773858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8950153d80 0x7f89500c3fe0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.410+0000 7f8954bff700 1 --2- 172.21.15.72:0/318773858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8950064db0 0x7f895013e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.410+0000 7f8954bff700 1 --2- 172.21.15.72:0/318773858 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f89500c5d80 0x7f89500c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.410+0000 7f8954bff700 1 -- 172.21.15.72:0/318773858 >> 172.21.15.72:0/318773858 conn(0x7f8950063b20 msgr2=0x7f89500ab010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.410+0000 7f8954bff700 1 -- 172.21.15.72:0/318773858 shutdown_connections 2023-08-31T19:27:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.411+0000 7f8954bff700 1 -- 172.21.15.72:0/318773858 wait complete. 2023-08-31T19:27:01.414 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 7 to deep-scrub 2023-08-31T19:27:01.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:27:01.454 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:27:01.478 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:27:01.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.621+0000 7f01b2bff700 1 Processor -- start 2023-08-31T19:27:01.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.621+0000 7f01b2bff700 1 -- start start 2023-08-31T19:27:01.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.622+0000 7f01b2bff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01ac06a260 0x7f01ac069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:01.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.622+0000 7f01b2bff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac064270 con 0x7f01ac069170 2023-08-31T19:27:01.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.622+0000 7f01b2bff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac0bcc20 con 0x7f01ac065710 2023-08-31T19:27:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.622+0000 7f01b2bff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac0bca40 con 0x7f01ac06a260 2023-08-31T19:27:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.622+0000 7f01abfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01ac06a260 0x7f01ac069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.623+0000 7f01b099b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f01ac069170 0x7f01ac0c2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35258/0 (socket says 172.21.15.72:35258) 2023-08-31T19:27:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.623+0000 7f01b099b700 1 -- 172.21.15.72:0/1677633834 learned_addr learned my addr 172.21.15.72:0/1677633834 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:27:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.623+0000 7f01abfff700 1 -- 172.21.15.72:0/1677633834 >> v1:172.21.15.146:6789/0 conn(0x7f01ac065710 legacy=0x7f01ac069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:27:01.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.623+0000 7f01ab7fe700 1 -- 172.21.15.72:0/1677633834 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959968202 0 0) 0x7f01ac064270 con 0x7f01ac069170 2023-08-31T19:27:01.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.623+0000 7f01abfff700 1 -- 172.21.15.72:0/1677633834 >> v1:172.21.15.72:6789/0 conn(0x7f01ac069170 legacy=0x7f01ac0c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.623+0000 7f01abfff700 1 -- 172.21.15.72:0/1677633834 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac154890 con 0x7f01ac06a260 2023-08-31T19:27:01.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.623+0000 7f01abfff700 1 --2- 172.21.15.72:0/1677633834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac06a260 0x7f01ac069550 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 rx=0x7f01ac0c7670 tx=0x7f019800b300).ready entity=mon.0 client_cookie=5f4850ef0c535c11 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.623+0000 7f01ab7fe700 1 -- 172.21.15.72:0/1677633834 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019800da30 con 0x7f01ac06a260 2023-08-31T19:27:01.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.623+0000 7f01ab7fe700 1 -- 172.21.15.72:0/1677633834 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019800db90 con 0x7f01ac06a260 2023-08-31T19:27:01.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.623+0000 7f01ab7fe700 1 -- 172.21.15.72:0/1677633834 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198010470 con 0x7f01ac06a260 2023-08-31T19:27:01.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.624+0000 7f01b2bff700 1 -- 172.21.15.72:0/1677633834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac06a260 msgr2=0x7f01ac069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.624+0000 7f01b2bff700 1 --2- 172.21.15.72:0/1677633834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac06a260 0x7f01ac069550 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 rx=0x7f01ac0c7670 tx=0x7f019800b300).stop 2023-08-31T19:27:01.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.624+0000 7f01b2bff700 1 -- 172.21.15.72:0/1677633834 shutdown_connections 2023-08-31T19:27:01.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.624+0000 7f01b2bff700 1 --2- 172.21.15.72:0/1677633834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac06a260 0x7f01ac069550 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.624+0000 7f01b2bff700 1 -- 172.21.15.72:0/1677633834 >> 172.21.15.72:0/1677633834 conn(0x7f01ac0c6b10 msgr2=0x7f01ac0c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:01.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.624+0000 7f01b2bff700 1 -- 172.21.15.72:0/1677633834 shutdown_connections 2023-08-31T19:27:01.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.624+0000 7f01b2bff700 1 -- 172.21.15.72:0/1677633834 wait complete. 2023-08-31T19:27:01.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.626+0000 7f01b2bff700 1 Processor -- start 2023-08-31T19:27:01.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.626+0000 7f01b2bff700 1 -- start start 2023-08-31T19:27:01.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.627+0000 7f01b2bff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01ac065710 0x7f01ac0ac580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:01.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.627+0000 7f01b2bff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01ac069170 0x7f01ac14f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:01.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.627+0000 7f01b2bff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac06a260 0x7f01ac168700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:01.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.627+0000 7f01b2bff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac168270 con 0x7f01ac06a260 2023-08-31T19:27:01.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.627+0000 7f01b2bff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac165150 con 0x7f01ac069170 2023-08-31T19:27:01.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.627+0000 7f01b2bff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac165430 con 0x7f01ac065710 2023-08-31T19:27:01.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.627+0000 7f01b119c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac06a260 0x7f01ac168700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.627+0000 7f01b119c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac06a260 0x7f01ac168700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47570/0 (socket says 172.21.15.72:47570) 2023-08-31T19:27:01.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.627+0000 7f01b119c700 1 -- 172.21.15.72:0/2724998013 learned_addr learned my addr 172.21.15.72:0/2724998013 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:27:01.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.627+0000 7f01abfff700 1 --2- 172.21.15.72:0/2724998013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01ac069170 0x7f01ac14f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.627+0000 7f01b099b700 1 --2- 172.21.15.72:0/2724998013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01ac065710 0x7f01ac0ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.628+0000 7f01b119c700 1 -- 172.21.15.72:0/2724998013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01ac065710 msgr2=0x7f01ac0ac580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.628+0000 7f01b119c700 1 --2- 172.21.15.72:0/2724998013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01ac065710 0x7f01ac0ac580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.628+0000 7f01b119c700 1 -- 172.21.15.72:0/2724998013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01ac069170 msgr2=0x7f01ac14f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.628+0000 7f01b119c700 1 --2- 172.21.15.72:0/2724998013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01ac069170 0x7f01ac14f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.628+0000 7f01b119c700 1 -- 172.21.15.72:0/2724998013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019800b540 con 0x7f01ac06a260 2023-08-31T19:27:01.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.628+0000 7f01b119c700 1 --2- 172.21.15.72:0/2724998013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac06a260 0x7f01ac168700 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 rx=0x7f01a400b810 tx=0x7f01a4009250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:01.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.628+0000 7f01a8ff9700 1 -- 172.21.15.72:0/2724998013 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a400d580 con 0x7f01ac06a260 2023-08-31T19:27:01.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.628+0000 7f01a8ff9700 1 -- 172.21.15.72:0/2724998013 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a400d700 con 0x7f01ac06a260 2023-08-31T19:27:01.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.628+0000 7f01a8ff9700 1 -- 172.21.15.72:0/2724998013 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a400dac0 con 0x7f01ac06a260 2023-08-31T19:27:01.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.628+0000 7f01b2bff700 1 -- 172.21.15.72:0/2724998013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ac165710 con 0x7f01ac06a260 2023-08-31T19:27:01.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.628+0000 7f01b2bff700 1 -- 172.21.15.72:0/2724998013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac14f7f0 con 0x7f01ac06a260 2023-08-31T19:27:01.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.629+0000 7f01b2bff700 1 -- 172.21.15.72:0/2724998013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ac06c6b0 con 0x7f01ac06a260 2023-08-31T19:27:01.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.630+0000 7f01a8ff9700 1 -- 172.21.15.72:0/2724998013 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f01a4010440 con 0x7f01ac06a260 2023-08-31T19:27:01.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.631+0000 7f01a8ff9700 1 --2- 172.21.15.72:0/2724998013 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f019005ef30 0x7f01900613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:01.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.631+0000 7f01a8ff9700 1 -- 172.21.15.72:0/2724998013 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f01a407a190 con 0x7f01ac06a260 2023-08-31T19:27:01.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.631+0000 7f01b099b700 1 --2- 172.21.15.72:0/2724998013 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f019005ef30 0x7f01900613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:01.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.631+0000 7f01b099b700 1 --2- 172.21.15.72:0/2724998013 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f019005ef30 0x7f01900613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f01a00011e0 tx=0x7f01a0009040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:01.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.634+0000 7f01a8ff9700 1 -- 172.21.15.72:0/2724998013 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f01a404b2b0 con 0x7f01ac06a260 2023-08-31T19:27:01.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.799+0000 7f01b2bff700 1 -- 172.21.15.72:0/2724998013 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01ac1683b0 con 0x7f019005ef30 2023-08-31T19:27:01.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.802+0000 7f01a8ff9700 1 -- 172.21.15.72:0/2724998013 <== mgr.9771 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70938 (secure 0 0 0) 0x7f01ac1683b0 con 0x7f019005ef30 2023-08-31T19:27:01.804 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:27:01.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.804+0000 7f01b2bff700 1 -- 172.21.15.72:0/2724998013 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f019005ef30 msgr2=0x7f01900613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.804+0000 7f01b2bff700 1 --2- 172.21.15.72:0/2724998013 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f019005ef30 0x7f01900613f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f01a00011e0 tx=0x7f01a0009040).stop 2023-08-31T19:27:01.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.804+0000 7f01b2bff700 1 -- 172.21.15.72:0/2724998013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac06a260 msgr2=0x7f01ac168700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:01.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.804+0000 7f01b2bff700 1 --2- 172.21.15.72:0/2724998013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac06a260 0x7f01ac168700 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 rx=0x7f01a400b810 tx=0x7f01a4009250).stop 2023-08-31T19:27:01.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.804+0000 7f01b2bff700 1 -- 172.21.15.72:0/2724998013 shutdown_connections 2023-08-31T19:27:01.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.804+0000 7f01b2bff700 1 --2- 172.21.15.72:0/2724998013 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f019005ef30 0x7f01900613f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.804+0000 7f01b2bff700 1 --2- 172.21.15.72:0/2724998013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac06a260 0x7f01ac168700 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.804+0000 7f01b2bff700 1 --2- 172.21.15.72:0/2724998013 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f01ac065710 0x7f01ac0ac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.804+0000 7f01b2bff700 1 --2- 172.21.15.72:0/2724998013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f01ac069170 0x7f01ac14f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:01.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.804+0000 7f01b2bff700 1 -- 172.21.15.72:0/2724998013 >> 172.21.15.72:0/2724998013 conn(0x7f01ac0c6b10 msgr2=0x7f01ac064f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:01.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.804+0000 7f01b2bff700 1 -- 172.21.15.72:0/2724998013 shutdown_connections 2023-08-31T19:27:01.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:01.804+0000 7f01b2bff700 1 -- 172.21.15.72:0/2724998013 wait complete. 2023-08-31T19:27:01.810 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:27:01.822 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2023-08-31T19:27:00.395525+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2437408,"kb_used_data":19680,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752537312,"statfs":{"total":773094113280,"available":770598207488,"internally_reserved":0,"allocated":20152320,"data_stored":11001280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13037,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-67,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.008730"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":182,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.071545+0000","last_change":"2023-08-31T18:47:47.309259+0000","last_active":"2023-08-31T19:26:50.071545+0000","last_peered":"2023-08-31T19:26:50.071545+0000","last_clean":"2023-08-31T19:26:50.071545+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:26:50.071545+0000","last_undegraded":"2023-08-31T19:26:50.071545+0000","last_fullsized":"2023-08-31T19:26:50.071545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":171,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.076925+0000","last_change":"2023-08-31T18:47:47.303591+0000","last_active":"2023-08-31T19:26:50.076925+0000","last_peered":"2023-08-31T19:26:50.076925+0000","last_clean":"2023-08-31T19:26:50.076925+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:26:50.076925+0000","last_undegraded":"2023-08-31T19:26:50.076925+0000","last_fullsized":"2023-08-31T19:26:50.076925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":175,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:49.410498+0000","last_change":"2023-08-31T18:47:47.299220+0000","last_active":"2023-08-31T19:26:49.410498+0000","last_peered":"2023-08-31T19:26:49.410498+0000","last_clean":"2023-08-31T19:26:49.410498+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:26:49.410498+0000","last_undegraded":"2023-08-31T19:26:49.410498+0000","last_fullsized":"2023-08-31T19:26:49.410498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":171,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.078996+0000","last_change":"2023-08-31T18:47:47.302789+0000","last_active":"2023-08-31T19:26:50.078996+0000","last_peered":"2023-08-31T19:26:50.078996+0000","last_clean":"2023-08-31T19:26:50.078996+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:26:50.078996+0000","last_undegraded":"2023-08-31T19:26:50.078996+0000","last_fullsized":"2023-08-31T19:26:50.078996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":170,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.075663+0000","last_change":"2023-08-31T18:47:46.306494+0000","last_active":"2023-08-31T19:26:50.075663+0000","last_peered":"2023-08-31T19:26:50.075663+0000","last_clean":"2023-08-31T19:26:50.075663+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:26:50.075663+0000","last_undegraded":"2023-08-31T19:26:50.075663+0000","last_fullsized":"2023-08-31T19:26:50.075663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:45.278876+0000","last_clean_scrub_stamp":"2023-08-31T18:47:45.278876+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.075751+0000","last_change":"2023-08-31T18:47:47.302439+0000","last_active":"2023-08-31T19:26:50.075751+0000","last_peered":"2023-08-31T19:26:50.075751+0000","last_clean":"2023-08-31T19:26:50.075751+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:26:50.075751+0000","last_undegraded":"2023-08-31T19:26:50.075751+0000","last_fullsized":"2023-08-31T19:26:50.075751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.071617+0000","last_change":"2023-08-31T18:47:47.309277+0000","last_active":"2023-08-31T19:26:50.071617+0000","last_peered":"2023-08-31T19:26:50.071617+0000","last_clean":"2023-08-31T19:26:50.071617+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:26:50.071617+0000","last_undegraded":"2023-08-31T19:26:50.071617+0000","last_fullsized":"2023-08-31T19:26:50.071617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":182,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.072743+0000","last_change":"2023-08-31T18:47:47.300526+0000","last_active":"2023-08-31T19:26:50.072743+0000","last_peered":"2023-08-31T19:26:50.072743+0000","last_clean":"2023-08-31T19:26:50.072743+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:26:50.072743+0000","last_undegraded":"2023-08-31T19:26:50.072743+0000","last_fullsized":"2023-08-31T19:26:50.072743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":188,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-08-31T19:26:50.070187+0000","last_change":"2023-08-31T18:47:47.303635+0000","last_active":"2023-08-31T19:26:50.070187+0000","last_peered":"2023-08-31T19:26:50.070187+0000","last_clean":"2023-08-31T19:26:50.070187+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:26:50.070187+0000","last_undegraded":"2023-08-31T19:26:50.070187+0000","last_fullsized":"2023-08-31T19:26:50.070187+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T18:47:46.283753+0000","last_clean_scrub_stamp":"2023-08-31T18:47:46.283753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575309,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.71399999999999997,"15min":0.72799999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.38200000000000001},"max":{"1min":0.90200000000000002,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.58199999999999996,"5min":0.54900000000000004,"15min":0.54700000000000004},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.98599999999999999},"last":0.65700000000000003}]},{"osd":1,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.41199999999999998},"max":{"1min":0.84799999999999998,"5min":0.92000000000000004,"15min":0.999},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.55300000000000005,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.495},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.45200000000000001},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68100000000000005,"15min":0.70399999999999996},"min":{"1min":0.55700000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.006},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73399999999999999,"15min":0.746},"min":{"1min":0.56000000000000005,"5min":0.48899999999999999,"15min":0.48599999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.34200000000000003},"max":{"1min":0.81100000000000005,"5min":0.89100000000000001,"15min":0.96499999999999997},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69099999999999995,"15min":0.69199999999999995},"min":{"1min":0.52500000000000002,"5min":0.40000000000000002,"15min":0.379},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.41599999999999998},"max":{"1min":0.85799999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.41999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90100000000000002,"5min":1.0109999999999999,"15min":1.0449999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:26:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45200000000000001,"15min":0.442},"max":{"1min":0.90200000000000002,"5min":0.96799999999999997,"15min":0.98999999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.47199999999999998,"5min":0.45500000000000002,"15min":0.42999999999999999},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575308,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.33800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.05},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0669999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.54200000000000004,"5min":0.502,"15min":0.45500000000000002},"max":{"1min":0.96299999999999997,"5min":1.0149999999999999,"15min":1.1579999999999999},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.745,"15min":0.746},"min":{"1min":0.53600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.198},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.1060000000000001},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90000000000000002,"5min":0.97399999999999998,"15min":1.0089999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77900000000000003,"15min":0.77700000000000002},"min":{"1min":0.57299999999999995,"5min":0.54100000000000004,"15min":0.495},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.296},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90600000000000003,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.66000000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.43099999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.622}]},{"osd":5,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68000000000000005,"15min":0.67800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97899999999999998,"5min":1.032,"15min":1.3280000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.71299999999999997},"min":{"1min":0.54300000000000004,"5min":0.48699999999999999,"15min":0.47299999999999998},"max":{"1min":1.2649999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.73199999999999998,"15min":0.71099999999999997},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.46200000000000002},"max":{"1min":1.1639999999999999,"5min":1.165,"15min":1.165},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77300000000000002,"15min":0.76200000000000001},"min":{"1min":0.52700000000000002,"5min":0.505,"15min":0.48499999999999999},"max":{"1min":1.117,"5min":1.2270000000000001,"15min":1.24},"last":0.80600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575309,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.45000000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.66100000000000003,"15min":0.68100000000000005},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45700000000000002,"15min":0.47399999999999998},"min":{"1min":0.35099999999999998,"5min":0.317,"15min":0.31},"max":{"1min":0.61699999999999999,"5min":0.71799999999999997,"15min":0.76400000000000001},"last":0.5}]},{"osd":2,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.496,"15min":0.51800000000000002},"min":{"1min":0.39800000000000002,"5min":0.36399999999999999,"15min":0.31},"max":{"1min":0.752,"5min":0.752,"15min":0.75800000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.35199999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.83799999999999997},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68600000000000005,"5min":0.77100000000000002,"15min":0.79200000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.96699999999999997},"last":0.437}]},{"osd":4,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.55700000000000005,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.169,"15min":1.1839999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.80400000000000005,"15min":0.82799999999999996},"min":{"1min":0.622,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78800000000000003},"min":{"1min":0.57299999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.262},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.75700000000000001,"15min":0.78800000000000003},"min":{"1min":0.621,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.165,"5min":1.198,"15min":1.198},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.58299999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.115,"5min":1.115,"15min":1.2849999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Aug 31 19:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.77500000000000002,"15min":0.80000000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.085,"5min":1.097,"15min":1.224},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.59499999999999997,"5min":0.53300000000000003,"15min":0.51000000000000001},"max":{"1min":1.0569999999999999,"5min":1.1579999999999999,"15min":1.1859999999999999},"last":0.72699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575308,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.67000000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.318},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51600000000000001,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73299999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51900000000000002,"15min":0.51300000000000001},"min":{"1min":0.38200000000000001,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.66500000000000004,"5min":0.72899999999999998,"15min":0.77000000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.751,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.373,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64400000000000002,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.376},"max":{"1min":0.71899999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.63500000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.872,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.60999999999999999,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.319,"5min":1.319,"15min":1.347},"last":0.622}]},{"osd":5,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.75700000000000001,"15min":0.76900000000000002},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79900000000000004,"15min":0.80500000000000005},"min":{"1min":0.58299999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.21},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.83499999999999996,"15min":0.83999999999999997},"min":{"1min":0.67100000000000004,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.629}]},{"osd":7,"last update":"Thu Aug 31 19:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.59699999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.24},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.872,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.65700000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.3340000000000001},"last":0.66200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575308,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.623,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.501},"min":{"1min":0.378,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.77600000000000002},"last":0.501}]},{"osd":1,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.81899999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.80900000000000005},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.33900000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.73099999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78800000000000003,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97599999999999998,"5min":1.105,"15min":1.2629999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54800000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.304},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.57299999999999995,"5min":0.51500000000000001,"15min":0.51300000000000001},"max":{"1min":1.014,"5min":1.1659999999999999,"15min":1.4019999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0660000000000001,"5min":1.0940000000000001,"15min":1.256},"last":0.95399999999999996}]},{"osd":6,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.81000000000000005,"15min":0.81499999999999995},"min":{"1min":0.57399999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0449999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.875},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80000000000000004,"15min":0.81100000000000005},"min":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.27},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.82199999999999995,"15min":0.82299999999999995},"min":{"1min":0.59299999999999997,"5min":0.56299999999999994,"15min":0.54400000000000004},"max":{"1min":0.98399999999999999,"5min":1.232,"15min":1.302},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80500000000000005,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.103,"5min":1.115,"15min":1.3740000000000001},"last":0.89700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575308,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.437,"15min":0.443},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59799999999999998,"5min":0.69099999999999995,"15min":0.71899999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.48899999999999999},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.65800000000000003,"5min":0.72099999999999997,"15min":0.77600000000000002},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46800000000000003,"15min":0.46600000000000003},"min":{"1min":0.35599999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65500000000000003,"5min":0.66800000000000004,"15min":0.77600000000000002},"last":0.499},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.46700000000000003,"5min":0.41699999999999998,"15min":0.379},"max":{"1min":0.73099999999999998,"5min":0.82499999999999996,"15min":0.90400000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.63100000000000001,"15min":0.622},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.88300000000000001,"15min":0.95399999999999996},"last":0.73299999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78200000000000003,"15min":0.76400000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1739999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.78200000000000003,"15min":0.77300000000000002},"min":{"1min":0.61899999999999999,"5min":0.56399999999999995,"15min":0.47899999999999998},"max":{"1min":1.1120000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.67000000000000004,"5min":0.53800000000000003,"15min":0.52400000000000002},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.6839999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.505},"max":{"1min":1.008,"5min":1.149,"15min":1.1819999999999999},"last":0.628}]},{"osd":6,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80800000000000005,"15min":0.80100000000000005},"min":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.153,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.79700000000000004,"15min":0.79900000000000004},"min":{"1min":0.61199999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.2849999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.81000000000000005,"15min":0.80900000000000005},"min":{"1min":0.64900000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.381},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.81599999999999995,"15min":0.80900000000000005},"min":{"1min":0.70699999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2410000000000001,"5min":1.244,"15min":1.244},"last":0.66500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575308,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.71599999999999997},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88100000000000001,"5min":0.95899999999999996,"15min":1.048},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.51800000000000002,"5min":0.45500000000000002,"15min":0.38500000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.98199999999999998},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.495,"5min":0.49099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90100000000000002,"5min":0.98699999999999999,"15min":1.0289999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71899999999999997,"15min":0.72799999999999998},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.93100000000000005,"5min":0.995,"15min":1},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98199999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.51600000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.996},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71199999999999997,"15min":0.72499999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91200000000000003,"5min":0.95699999999999996,"15min":0.97699999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.753,"15min":0.755},"min":{"1min":0.56899999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94899999999999995,"5min":1.056,"15min":1.056},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.40699999999999997,"15min":0.39600000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95799999999999996},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.442,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":0.82199999999999995,"5min":0.91900000000000004,"15min":0.98799999999999999},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.45700000000000002,"5min":0.44700000000000001,"15min":0.42299999999999999},"max":{"1min":0.80900000000000005,"5min":1.01,"15min":1.0649999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.69299999999999995},"min":{"1min":0.498,"5min":0.46500000000000002,"15min":0.46300000000000002},"max":{"1min":0.91500000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.754}]},{"osd":7,"last update":"Thu Aug 31 19:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.94899999999999995,"15min":1.0049999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.74199999999999999,"15min":0.72999999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.46300000000000002},"max":{"1min":0.94599999999999995,"5min":1.0369999999999999,"15min":1.115},"last":0.98699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575308,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.71099999999999997,"15min":0.72199999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.41099999999999998},"max":{"1min":1.085,"5min":1.141,"15min":1.141},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.70699999999999996,"15min":0.71899999999999997},"min":{"1min":0.34899999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.91700000000000004,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Aug 31 19:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.876,"5min":1.103,"15min":1.103},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.73599999999999999},"min":{"1min":0.501,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94899999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Aug 31 19:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.68100000000000005,"15min":0.71699999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84799999999999998,"5min":1.026,"15min":1.026},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.754},"min":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":0.96199999999999997,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.53800000000000003,"5min":0.51900000000000002,"15min":0.51400000000000001},"max":{"1min":0.998,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89800000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.628,"15min":0.61199999999999999},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.379},"max":{"1min":0.87,"5min":0.997,"15min":0.997},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.008,"5min":1.117,"15min":1.117},"last":0.85999999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.50700000000000001,"5min":0.44700000000000001,"15min":0.441},"max":{"1min":0.94899999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.72199999999999998,"15min":0.70299999999999996},"min":{"1min":0.47899999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0469999999999999,"5min":1.2,"15min":1.2},"last":0.753}]},{"osd":7,"last update":"Thu Aug 31 19:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71499999999999997,"15min":0.71199999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0600000000000001,"5min":1.202,"15min":1.202},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93200000000000005,"5min":1.004,"15min":1.004},"last":0.80400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:27:01.829 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-08-31T18:47:46.283753+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=18, tm_min=47, tm_sec=46, tm_wday=3, tm_yday=243, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=19, tm_min=26, tm_sec=55, tm_wday=3, tm_yday=243, tm_isdst=0) 2023-08-31T19:27:01.829 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-31T18:47:46.283753+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=18, tm_min=47, tm_sec=46, tm_wday=3, tm_yday=243, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=19, tm_min=26, tm_sec=55, tm_wday=3, tm_yday=243, tm_isdst=0) 2023-08-31T19:27:01.830 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-08-31T18:47:46.283753+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=18, tm_min=47, tm_sec=46, tm_wday=3, tm_yday=243, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=19, tm_min=26, tm_sec=55, tm_wday=3, tm_yday=243, tm_isdst=0) 2023-08-31T19:27:01.830 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-31T18:47:46.283753+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=18, tm_min=47, tm_sec=46, tm_wday=3, tm_yday=243, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=19, tm_min=26, tm_sec=55, tm_wday=3, tm_yday=243, tm_isdst=0) 2023-08-31T19:27:01.830 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-31T18:47:45.278876+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=18, tm_min=47, tm_sec=45, tm_wday=3, tm_yday=243, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=19, tm_min=26, tm_sec=55, tm_wday=3, tm_yday=243, tm_isdst=0) 2023-08-31T19:27:01.831 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-08-31T18:47:46.283753+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=18, tm_min=47, tm_sec=46, tm_wday=3, tm_yday=243, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=19, tm_min=26, tm_sec=55, tm_wday=3, tm_yday=243, tm_isdst=0) 2023-08-31T19:27:01.831 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-31T18:47:46.283753+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=18, tm_min=47, tm_sec=46, tm_wday=3, tm_yday=243, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=19, tm_min=26, tm_sec=55, tm_wday=3, tm_yday=243, tm_isdst=0) 2023-08-31T19:27:01.831 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-08-31T18:47:46.283753+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=18, tm_min=47, tm_sec=46, tm_wday=3, tm_yday=243, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=19, tm_min=26, tm_sec=55, tm_wday=3, tm_yday=243, tm_isdst=0) 2023-08-31T19:27:01.832 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-31T18:47:46.283753+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=18, tm_min=47, tm_sec=46, tm_wday=3, tm_yday=243, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=19, tm_min=26, tm_sec=55, tm_wday=3, tm_yday=243, tm_isdst=0) 2023-08-31T19:27:01.832 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-31T19:27:21.833 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:27:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.035+0000 7f7e895ff700 1 Processor -- start 2023-08-31T19:27:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.036+0000 7f7e895ff700 1 -- start start 2023-08-31T19:27:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.037+0000 7f7e895ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e84154220 0x7f7e84157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.037+0000 7f7e895ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e840cb940 0x7f7e841581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.037+0000 7f7e895ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e840c8c90 con 0x7f7e841586b0 2023-08-31T19:27:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.037+0000 7f7e895ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e840aa700 con 0x7f7e840cb940 2023-08-31T19:27:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.037+0000 7f7e895ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840c5e10 con 0x7f7e84154220 2023-08-31T19:27:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.037+0000 7f7e827fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e840cb940 0x7f7e841581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.037+0000 7f7e827fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e840cb940 0x7f7e841581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56926/0 (socket says 172.21.15.72:56926) 2023-08-31T19:27:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.037+0000 7f7e827fc700 1 -- 172.21.15.72:0/1108609104 learned_addr learned my addr 172.21.15.72:0/1108609104 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:27:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.037+0000 7f7e827fc700 1 -- 172.21.15.72:0/1108609104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e84154220 msgr2=0x7f7e84157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:27:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.037+0000 7f7e82ffd700 1 --2- 172.21.15.72:0/1108609104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e84154220 0x7f7e84157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.038+0000 7f7e827fc700 1 --2- 172.21.15.72:0/1108609104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e84154220 0x7f7e84157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.038+0000 7f7e827fc700 1 -- 172.21.15.72:0/1108609104 >> v1:172.21.15.146:6789/0 conn(0x7f7e841586b0 legacy=0x7f7e84154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:27:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.038+0000 7f7e827fc700 1 -- 172.21.15.72:0/1108609104 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e840c0a50 con 0x7f7e840cb940 2023-08-31T19:27:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.038+0000 7f7e82ffd700 1 --2- 172.21.15.72:0/1108609104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e84154220 0x7f7e84157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:27:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.038+0000 7f7e827fc700 1 --2- 172.21.15.72:0/1108609104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e840cb940 0x7f7e841581c0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7f7e78009830 tx=0x7f7e780090f0).ready entity=mon.0 client_cookie=deb602ef8420dcaa server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.038+0000 7f7e81ffb700 1 -- 172.21.15.72:0/1108609104 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7800b600 con 0x7f7e840cb940 2023-08-31T19:27:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.038+0000 7f7e81ffb700 1 -- 172.21.15.72:0/1108609104 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7800b760 con 0x7f7e840cb940 2023-08-31T19:27:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.038+0000 7f7e81ffb700 1 -- 172.21.15.72:0/1108609104 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7800bae0 con 0x7f7e840cb940 2023-08-31T19:27:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.038+0000 7f7e895ff700 1 -- 172.21.15.72:0/1108609104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e840cb940 msgr2=0x7f7e841581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.038+0000 7f7e895ff700 1 --2- 172.21.15.72:0/1108609104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e840cb940 0x7f7e841581c0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7f7e78009830 tx=0x7f7e780090f0).stop 2023-08-31T19:27:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.039+0000 7f7e895ff700 1 -- 172.21.15.72:0/1108609104 shutdown_connections 2023-08-31T19:27:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.039+0000 7f7e895ff700 1 --2- 172.21.15.72:0/1108609104 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e84154220 0x7f7e84157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.039+0000 7f7e895ff700 1 --2- 172.21.15.72:0/1108609104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e840cb940 0x7f7e841581c0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.039+0000 7f7e895ff700 1 -- 172.21.15.72:0/1108609104 >> 172.21.15.72:0/1108609104 conn(0x7f7e8405e870 msgr2=0x7f7e840cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:22.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.039+0000 7f7e895ff700 1 -- 172.21.15.72:0/1108609104 shutdown_connections 2023-08-31T19:27:22.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.039+0000 7f7e895ff700 1 -- 172.21.15.72:0/1108609104 wait complete. 2023-08-31T19:27:22.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.040+0000 7f7e895ff700 1 Processor -- start 2023-08-31T19:27:22.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.040+0000 7f7e895ff700 1 -- start start 2023-08-31T19:27:22.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.041+0000 7f7e895ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e840cb940 0x7f7e84158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.041+0000 7f7e895ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e84154220 0x7f7e84164680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.041+0000 7f7e895ff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e841586b0 0x7f7e840ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.041+0000 7f7e895ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e84159e40 con 0x7f7e840cb940 2023-08-31T19:27:22.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.041+0000 7f7e895ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e84164b70 con 0x7f7e84154220 2023-08-31T19:27:22.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.041+0000 7f7e895ff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e84159230 con 0x7f7e841586b0 2023-08-31T19:27:22.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.041+0000 7f7e82ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e840cb940 0x7f7e84158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.042+0000 7f7e82ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e840cb940 0x7f7e84158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56932/0 (socket says 172.21.15.72:56932) 2023-08-31T19:27:22.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.042+0000 7f7e82ffd700 1 -- 172.21.15.72:0/3613431510 learned_addr learned my addr 172.21.15.72:0/3613431510 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:27:22.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.042+0000 7f7e827fc700 1 --2- 172.21.15.72:0/3613431510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e84154220 0x7f7e84164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.042+0000 7f7e837fe700 1 --2- 172.21.15.72:0/3613431510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e841586b0 0x7f7e840ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.042+0000 7f7e82ffd700 1 -- 172.21.15.72:0/3613431510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e841586b0 msgr2=0x7f7e840ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.042+0000 7f7e82ffd700 1 --2- 172.21.15.72:0/3613431510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e841586b0 0x7f7e840ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.042+0000 7f7e82ffd700 1 -- 172.21.15.72:0/3613431510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e84154220 msgr2=0x7f7e84164680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.042+0000 7f7e82ffd700 1 --2- 172.21.15.72:0/3613431510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e84154220 0x7f7e84164680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.042+0000 7f7e82ffd700 1 -- 172.21.15.72:0/3613431510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e78009370 con 0x7f7e840cb940 2023-08-31T19:27:22.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.042+0000 7f7e837fe700 1 --2- 172.21.15.72:0/3613431510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e841586b0 0x7f7e840ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:27:22.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.042+0000 7f7e82ffd700 1 --2- 172.21.15.72:0/3613431510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e840cb940 0x7f7e84158c70 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7f7e7400c880 tx=0x7f7e74008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:22.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.042+0000 7f7e6affd700 1 -- 172.21.15.72:0/3613431510 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74010580 con 0x7f7e840cb940 2023-08-31T19:27:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.042+0000 7f7e6affd700 1 -- 172.21.15.72:0/3613431510 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e740106e0 con 0x7f7e840cb940 2023-08-31T19:27:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.042+0000 7f7e895ff700 1 -- 172.21.15.72:0/3613431510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e84159510 con 0x7f7e840cb940 2023-08-31T19:27:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.042+0000 7f7e6affd700 1 -- 172.21.15.72:0/3613431510 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74010a60 con 0x7f7e840cb940 2023-08-31T19:27:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.043+0000 7f7e895ff700 1 -- 172.21.15.72:0/3613431510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e84159ad0 con 0x7f7e840cb940 2023-08-31T19:27:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.043+0000 7f7e895ff700 1 -- 172.21.15.72:0/3613431510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8415a120 con 0x7f7e840cb940 2023-08-31T19:27:22.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.044+0000 7f7e6affd700 1 -- 172.21.15.72:0/3613431510 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f7e7401a410 con 0x7f7e840cb940 2023-08-31T19:27:22.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.045+0000 7f7e6affd700 1 --2- 172.21.15.72:0/3613431510 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7e7005ef30 0x7f7e700613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.045+0000 7f7e6affd700 1 -- 172.21.15.72:0/3613431510 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f7e74079ce0 con 0x7f7e840cb940 2023-08-31T19:27:22.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.045+0000 7f7e827fc700 1 --2- 172.21.15.72:0/3613431510 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7e7005ef30 0x7f7e700613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.046+0000 7f7e827fc700 1 --2- 172.21.15.72:0/3613431510 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7e7005ef30 0x7f7e700613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7e78009830 tx=0x7f7e78017000).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:22.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.049+0000 7f7e6affd700 1 -- 172.21.15.72:0/3613431510 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7e7404ad40 con 0x7f7e840cb940 2023-08-31T19:27:22.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.217+0000 7f7e895ff700 1 -- 172.21.15.72:0/3613431510 --> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e84159f80 con 0x7f7e7005ef30 2023-08-31T19:27:22.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.220+0000 7f7e6affd700 1 -- 172.21.15.72:0/3613431510 <== mgr.9771 v2:172.21.15.72:6832/189426 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70598 (secure 0 0 0) 0x7f7e7800b8d0 con 0x7f7e7005ef30 2023-08-31T19:27:22.222 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:27:22.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.222+0000 7f7e895ff700 1 -- 172.21.15.72:0/3613431510 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7e7005ef30 msgr2=0x7f7e700613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.222+0000 7f7e895ff700 1 --2- 172.21.15.72:0/3613431510 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7e7005ef30 0x7f7e700613f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7e78009830 tx=0x7f7e78017000).stop 2023-08-31T19:27:22.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.222+0000 7f7e895ff700 1 -- 172.21.15.72:0/3613431510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e840cb940 msgr2=0x7f7e84158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.222+0000 7f7e895ff700 1 --2- 172.21.15.72:0/3613431510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e840cb940 0x7f7e84158c70 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7f7e7400c880 tx=0x7f7e74008040).stop 2023-08-31T19:27:22.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.223+0000 7f7e895ff700 1 -- 172.21.15.72:0/3613431510 shutdown_connections 2023-08-31T19:27:22.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.223+0000 7f7e895ff700 1 --2- 172.21.15.72:0/3613431510 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f7e7005ef30 0x7f7e700613f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.223+0000 7f7e895ff700 1 --2- 172.21.15.72:0/3613431510 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f7e841586b0 0x7f7e840ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.223+0000 7f7e895ff700 1 --2- 172.21.15.72:0/3613431510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e840cb940 0x7f7e84158c70 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.223+0000 7f7e895ff700 1 --2- 172.21.15.72:0/3613431510 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e84154220 0x7f7e84164680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.223+0000 7f7e895ff700 1 -- 172.21.15.72:0/3613431510 >> 172.21.15.72:0/3613431510 conn(0x7f7e8405e870 msgr2=0x7f7e84063090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:22.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.223+0000 7f7e895ff700 1 -- 172.21.15.72:0/3613431510 shutdown_connections 2023-08-31T19:27:22.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.223+0000 7f7e895ff700 1 -- 172.21.15.72:0/3613431510 wait complete. 2023-08-31T19:27:22.226 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-08-31T19:27:22.240 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-31T19:27:20.399613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2437408,"kb_used_data":19680,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752537312,"statfs":{"total":773094113280,"available":770598207488,"internally_reserved":0,"allocated":20152320,"data_stored":11001280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13037,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-67,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.008730"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-08-31T19:26:57.854347+0000","last_change":"2023-08-31T19:26:57.854347+0000","last_active":"2023-08-31T19:26:57.854347+0000","last_peered":"2023-08-31T19:26:57.854347+0000","last_clean":"2023-08-31T19:26:57.854347+0000","last_became_active":"2023-08-31T18:47:47.308861+0000","last_became_peered":"2023-08-31T18:47:47.308861+0000","last_unstale":"2023-08-31T19:26:57.854347+0000","last_undegraded":"2023-08-31T19:26:57.854347+0000","last_fullsized":"2023-08-31T19:26:57.854347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:57.854257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:57.854257+0000","last_clean_scrub_stamp":"2023-08-31T19:26:57.854257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":176,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-08-31T19:27:02.240335+0000","last_change":"2023-08-31T19:27:02.240335+0000","last_active":"2023-08-31T19:27:02.240335+0000","last_peered":"2023-08-31T19:27:02.240335+0000","last_clean":"2023-08-31T19:27:02.240335+0000","last_became_active":"2023-08-31T18:47:47.302821+0000","last_became_peered":"2023-08-31T18:47:47.302821+0000","last_unstale":"2023-08-31T19:27:02.240335+0000","last_undegraded":"2023-08-31T19:27:02.240335+0000","last_fullsized":"2023-08-31T19:27:02.240335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:27:02.240226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:27:02.240226+0000","last_clean_scrub_stamp":"2023-08-31T19:27:02.240226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":180,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-08-31T19:27:00.106570+0000","last_change":"2023-08-31T19:27:00.106570+0000","last_active":"2023-08-31T19:27:00.106570+0000","last_peered":"2023-08-31T19:27:00.106570+0000","last_clean":"2023-08-31T19:27:00.106570+0000","last_became_active":"2023-08-31T18:47:47.298874+0000","last_became_peered":"2023-08-31T18:47:47.298874+0000","last_unstale":"2023-08-31T19:27:00.106570+0000","last_undegraded":"2023-08-31T19:27:00.106570+0000","last_fullsized":"2023-08-31T19:27:00.106570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:27:00.106475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:27:00.106475+0000","last_clean_scrub_stamp":"2023-08-31T19:27:00.106475+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":176,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-08-31T19:27:07.156453+0000","last_change":"2023-08-31T19:27:07.156453+0000","last_active":"2023-08-31T19:27:07.156453+0000","last_peered":"2023-08-31T19:27:07.156453+0000","last_clean":"2023-08-31T19:27:07.156453+0000","last_became_active":"2023-08-31T18:47:47.302307+0000","last_became_peered":"2023-08-31T18:47:47.302307+0000","last_unstale":"2023-08-31T19:27:07.156453+0000","last_undegraded":"2023-08-31T19:27:07.156453+0000","last_fullsized":"2023-08-31T19:27:07.156453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:27:07.156344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:27:07.156344+0000","last_clean_scrub_stamp":"2023-08-31T19:27:07.156344+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":175,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-08-31T19:27:05.078217+0000","last_change":"2023-08-31T19:27:05.078217+0000","last_active":"2023-08-31T19:27:05.078217+0000","last_peered":"2023-08-31T19:27:05.078217+0000","last_clean":"2023-08-31T19:27:05.078217+0000","last_became_active":"2023-08-31T18:47:46.306168+0000","last_became_peered":"2023-08-31T18:47:46.306168+0000","last_unstale":"2023-08-31T19:27:05.078217+0000","last_undegraded":"2023-08-31T19:27:05.078217+0000","last_fullsized":"2023-08-31T19:27:05.078217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:27:05.078107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:27:05.078107+0000","last_clean_scrub_stamp":"2023-08-31T19:27:05.078107+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":174,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-08-31T19:27:06.062400+0000","last_change":"2023-08-31T19:27:06.062400+0000","last_active":"2023-08-31T19:27:06.062400+0000","last_peered":"2023-08-31T19:27:06.062400+0000","last_clean":"2023-08-31T19:27:06.062400+0000","last_became_active":"2023-08-31T18:47:47.302006+0000","last_became_peered":"2023-08-31T18:47:47.302006+0000","last_unstale":"2023-08-31T19:27:06.062400+0000","last_undegraded":"2023-08-31T19:27:06.062400+0000","last_fullsized":"2023-08-31T19:27:06.062400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:27:06.062292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:27:06.062292+0000","last_clean_scrub_stamp":"2023-08-31T19:27:06.062292+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":174,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-08-31T19:27:08.075989+0000","last_change":"2023-08-31T19:27:08.075989+0000","last_active":"2023-08-31T19:27:08.075989+0000","last_peered":"2023-08-31T19:27:08.075989+0000","last_clean":"2023-08-31T19:27:08.075989+0000","last_became_active":"2023-08-31T18:47:47.308866+0000","last_became_peered":"2023-08-31T18:47:47.308866+0000","last_unstale":"2023-08-31T19:27:08.075989+0000","last_undegraded":"2023-08-31T19:27:08.075989+0000","last_fullsized":"2023-08-31T19:27:08.075989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:27:08.075863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:27:08.075863+0000","last_clean_scrub_stamp":"2023-08-31T19:27:08.075863+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-08-31T19:26:58.808522+0000","last_change":"2023-08-31T19:26:58.808522+0000","last_active":"2023-08-31T19:26:58.808522+0000","last_peered":"2023-08-31T19:26:58.808522+0000","last_clean":"2023-08-31T19:26:58.808522+0000","last_became_active":"2023-08-31T18:47:47.300346+0000","last_became_peered":"2023-08-31T18:47:47.300346+0000","last_unstale":"2023-08-31T19:26:58.808522+0000","last_undegraded":"2023-08-31T19:26:58.808522+0000","last_fullsized":"2023-08-31T19:26:58.808522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:26:58.808435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:26:58.808435+0000","last_clean_scrub_stamp":"2023-08-31T19:26:58.808435+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":193,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-08-31T19:27:01.668492+0000","last_change":"2023-08-31T19:27:01.668492+0000","last_active":"2023-08-31T19:27:01.668492+0000","last_peered":"2023-08-31T19:27:01.668492+0000","last_clean":"2023-08-31T19:27:01.668492+0000","last_became_active":"2023-08-31T18:47:47.303338+0000","last_became_peered":"2023-08-31T18:47:47.303338+0000","last_unstale":"2023-08-31T19:27:01.668492+0000","last_undegraded":"2023-08-31T19:27:01.668492+0000","last_fullsized":"2023-08-31T19:27:01.668492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:27:01.668393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:27:01.668393+0000","last_clean_scrub_stamp":"2023-08-31T19:27:01.668393+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575313,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.70199999999999996,"15min":0.72199999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.39000000000000001},"max":{"1min":0.83599999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.73399999999999999,"15min":0.75600000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.90300000000000002,"5min":0.97199999999999998,"15min":0.98599999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.70699999999999996,"15min":0.71499999999999997},"min":{"1min":0.46300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94499999999999995,"5min":0.94799999999999995,"15min":0.99399999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.67200000000000004,"15min":0.68899999999999995},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.41199999999999998},"max":{"1min":0.89000000000000001,"5min":0.91800000000000004,"15min":0.999},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Aug 31 19:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.68200000000000005,"15min":0.69999999999999996},"min":{"1min":0.45800000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82199999999999995,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.70499999999999996,"15min":0.71499999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45200000000000001},"max":{"1min":0.85799999999999998,"5min":1.492,"15min":1.492},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67800000000000005,"15min":0.69899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92500000000000004,"5min":0.93500000000000005,"15min":1.006},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.71599999999999997,"15min":0.73799999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.81499999999999995,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Aug 31 19:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.34200000000000003},"max":{"1min":0.80100000000000005,"5min":0.89100000000000001,"15min":0.96499999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69399999999999995,"15min":0.68799999999999994},"min":{"1min":0.52000000000000002,"5min":0.44600000000000001,"15min":0.379},"max":{"1min":0.91600000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64500000000000002,"15min":0.65500000000000003},"min":{"1min":0.434,"5min":0.42599999999999999,"15min":0.41599999999999998},"max":{"1min":0.85899999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.69699999999999995,"15min":0.70199999999999996},"min":{"1min":0.45500000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.92700000000000005,"5min":1.0109999999999999,"15min":1.0449999999999999},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Aug 31 19:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.95799999999999996,"5min":0.96799999999999997,"15min":0.98999999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.42999999999999999},"max":{"1min":0.96599999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.79600000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575312,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.33800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.05},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.39300000000000002},"max":{"1min":0.93000000000000005,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0669999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.749,"15min":0.746},"min":{"1min":0.54200000000000004,"5min":0.502,"15min":0.45500000000000002},"max":{"1min":0.96299999999999997,"5min":1.0149999999999999,"15min":1.1579999999999999},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.745,"15min":0.746},"min":{"1min":0.53600000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":1.198},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.1060000000000001},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90000000000000002,"5min":0.97399999999999998,"15min":1.0089999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.77900000000000003,"15min":0.77700000000000002},"min":{"1min":0.57299999999999995,"5min":0.54100000000000004,"15min":0.495},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.296},"last":0.88800000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90600000000000003,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.498},{"interface":"front","average":{"1min":0.621,"5min":0.64500000000000002,"15min":0.66000000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.43099999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68000000000000005,"15min":0.67800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97899999999999998,"5min":1.032,"15min":1.3280000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.71299999999999997},"min":{"1min":0.54300000000000004,"5min":0.48699999999999999,"15min":0.47299999999999998},"max":{"1min":1.2649999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.79700000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.73199999999999998,"15min":0.71099999999999997},"min":{"1min":0.52400000000000002,"5min":0.47899999999999998,"15min":0.46200000000000002},"max":{"1min":1.1639999999999999,"5min":1.165,"15min":1.165},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77300000000000002,"15min":0.76200000000000001},"min":{"1min":0.52700000000000002,"5min":0.505,"15min":0.48499999999999999},"max":{"1min":1.117,"5min":1.2270000000000001,"15min":1.24},"last":0.92100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575313,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.437,"15min":0.44700000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46200000000000002,"15min":0.47499999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.76400000000000001},"last":0.377}]},{"osd":2,"last update":"Thu Aug 31 19:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.499,"15min":0.51800000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.31},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56599999999999995,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.35199999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83799999999999997},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Aug 31 19:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54300000000000004,"15min":0.56399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.68500000000000005,"5min":0.77100000000000002,"15min":0.79200000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51100000000000001,"15min":0.52500000000000002},"min":{"1min":0.39200000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77000000000000002,"15min":0.79300000000000004},"min":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.042,"5min":1.169,"15min":1.1839999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78600000000000003,"15min":0.82099999999999995},"min":{"1min":0.55800000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.018,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.77500000000000002},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0649999999999999,"5min":1.2,"15min":1.2},"last":0.88},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.749,"15min":0.78400000000000003},"min":{"1min":0.56499999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1040000000000001,"5min":1.2070000000000001,"15min":1.2490000000000001},"last":1.006}]},{"osd":6,"last update":"Thu Aug 31 19:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.74399999999999999,"15min":0.78300000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1639999999999999,"5min":1.198,"15min":1.198},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.80800000000000005},"min":{"1min":0.55000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.141,"5min":1.141,"15min":1.2849999999999999},"last":1.0289999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76000000000000001,"15min":0.79300000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.93700000000000006,"5min":1.097,"15min":1.224},"last":0.874},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75700000000000001,"15min":0.79500000000000004},"min":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.51000000000000001},"max":{"1min":0.93100000000000005,"5min":1.1579999999999999,"15min":1.1859999999999999},"last":0.95199999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575312,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.46100000000000002,"15min":0.45600000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.502,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.50600000000000001,"15min":0.497},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.60399999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.504,"15min":0.50700000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61199999999999999,"5min":0.72899999999999998,"15min":0.77000000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.52800000000000002,"15min":0.53700000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70399999999999996,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Aug 31 19:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.51100000000000001,"15min":0.51400000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.54600000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.504},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.56200000000000006,"15min":0.56899999999999995},"min":{"1min":0.41699999999999998,"5min":0.39300000000000002,"15min":0.376},"max":{"1min":0.60599999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Aug 31 19:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81399999999999995,"15min":0.81999999999999995},"min":{"1min":0.64700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0549999999999999,"5min":1.383,"15min":1.383},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.58199999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1080000000000001,"5min":1.319,"15min":1.347},"last":0.745}]},{"osd":5,"last update":"Thu Aug 31 19:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0740000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77400000000000002,"15min":0.76900000000000002},"min":{"1min":0.55500000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1339999999999999,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.80100000000000005,"15min":0.80400000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.21},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1639999999999999,"5min":1.244,"15min":1.244},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:27:11 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.83099999999999996,"15min":0.83999999999999997},"min":{"1min":0.56499999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2050000000000001,"5min":1.2310000000000001,"15min":1.24},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83199999999999996,"15min":0.83499999999999996},"min":{"1min":0.63800000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2290000000000001,"5min":1.2569999999999999,"15min":1.3340000000000001},"last":0.84099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575312,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.29899999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.623,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.501},"min":{"1min":0.378,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.77600000000000002},"last":0.376}]},{"osd":1,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.81899999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.35599999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.80900000000000005},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.33900000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.73099999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.622}]},{"osd":4,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.78800000000000003,"15min":0.79100000000000004},"min":{"1min":0.58099999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97599999999999998,"5min":1.105,"15min":1.2629999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.54800000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.304},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.57299999999999995,"5min":0.51500000000000001,"15min":0.51300000000000001},"max":{"1min":1.014,"5min":1.1659999999999999,"15min":1.4019999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0660000000000001,"5min":1.0940000000000001,"15min":1.256},"last":0.84699999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.81000000000000005,"15min":0.81499999999999995},"min":{"1min":0.57399999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0449999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80000000000000004,"15min":0.81100000000000005},"min":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.27},"last":0.70199999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.82199999999999995,"15min":0.82299999999999995},"min":{"1min":0.59299999999999997,"5min":0.56299999999999994,"15min":0.54400000000000004},"max":{"1min":0.98399999999999999,"5min":1.232,"15min":1.302},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80500000000000005,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.103,"5min":1.115,"15min":1.3740000000000001},"last":0.80800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575312,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:27:12 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.433,"15min":0.44},"min":{"1min":0.33300000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59499999999999997,"5min":0.69099999999999995,"15min":0.71899999999999997},"last":0.499},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.33300000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Aug 31 19:27:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46500000000000002,"15min":0.46700000000000003},"min":{"1min":0.36799999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.77600000000000002},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.379,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.59299999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Aug 31 19:27:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71099999999999997,"5min":0.82499999999999996,"15min":0.90400000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.623,"15min":0.62},"min":{"1min":0.45300000000000001,"5min":0.42199999999999999,"15min":0.38200000000000001},"max":{"1min":0.73299999999999998,"5min":0.88300000000000001,"15min":0.95399999999999996},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:27:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.75800000000000001,"15min":0.76100000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.46500000000000002},"max":{"1min":0.95599999999999996,"5min":1.0229999999999999,"15min":1.1739999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77500000000000002,"15min":0.77200000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.47899999999999998},"max":{"1min":0.94199999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:27:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.58899999999999997,"5min":0.53800000000000003,"15min":0.52400000000000002},"max":{"1min":0.94099999999999995,"5min":1.1950000000000001,"15min":1.6839999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.505},"max":{"1min":0.96399999999999997,"5min":1.149,"15min":1.1819999999999999},"last":0.93700000000000006}]},{"osd":6,"last update":"Thu Aug 31 19:27:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.996,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.044,"5min":1.171,"15min":1.2849999999999999},"last":1.01}]},{"osd":7,"last update":"Thu Aug 31 19:27:12 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.79400000000000004,"15min":0.80800000000000005},"min":{"1min":0.55500000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.052,"5min":1.226,"15min":1.381},"last":1.052},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.80100000000000005,"15min":0.80500000000000005},"min":{"1min":0.57699999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.04,"5min":1.244,"15min":1.244},"last":1.04}]}]},{"osd":4,"up_from":13,"seq":55834575312,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69599999999999995,"15min":0.71299999999999997},"min":{"1min":0.48299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91300000000000003,"5min":0.95899999999999996,"15min":1.048},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.38500000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.98199999999999998},"last":0.68300000000000005}]},{"osd":1,"last update":"Thu Aug 31 19:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72799999999999998,"15min":0.72699999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.94999999999999996,"5min":0.98699999999999999,"15min":1.0289999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72499999999999998,"15min":0.72799999999999998},"min":{"1min":0.497,"5min":0.47299999999999998,"15min":0.442},"max":{"1min":0.98999999999999999,"5min":0.995,"15min":1},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Aug 31 19:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.45900000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.58399999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.72399999999999998},"min":{"1min":0.56299999999999994,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.75,"15min":0.754},"min":{"1min":0.55000000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.752}]},{"osd":5,"last update":"Thu Aug 31 19:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64400000000000002,"15min":0.625},"min":{"1min":0.44,"5min":0.40699999999999997,"15min":0.39600000000000002},"max":{"1min":0.88700000000000001,"5min":0.95599999999999996,"15min":0.95799999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.41399999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.67000000000000004,"15min":0.66100000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.42299999999999999},"max":{"1min":0.91300000000000003,"5min":1.01,"15min":1.0649999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71799999999999997,"15min":0.69799999999999995},"min":{"1min":0.501,"5min":0.46500000000000002,"15min":0.46300000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.75800000000000001,"15min":0.73299999999999998},"min":{"1min":0.52400000000000002,"5min":0.495,"15min":0.46300000000000002},"max":{"1min":1.004,"5min":1.0369999999999999,"15min":1.115},"last":0.88300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575312,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2519040,"data_stored":1375160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.71099999999999997,"15min":0.72199999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.41099999999999998},"max":{"1min":1.085,"5min":1.141,"15min":1.141},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.70699999999999996,"15min":0.71899999999999997},"min":{"1min":0.34899999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.91700000000000004,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.878}]},{"osd":1,"last update":"Thu Aug 31 19:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.876,"5min":1.103,"15min":1.103},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.73599999999999999},"min":{"1min":0.501,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94899999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92700000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.68100000000000005,"15min":0.71699999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84799999999999998,"5min":1.026,"15min":1.026},"last":0.872},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.754},"min":{"1min":0.54300000000000004,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":0.96199999999999997,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Aug 31 19:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.53800000000000003,"5min":0.51900000000000002,"15min":0.51400000000000001},"max":{"1min":0.998,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89800000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.82999999999999996}]},{"osd":4,"last update":"Thu Aug 31 19:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.628,"15min":0.61199999999999999},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.379},"max":{"1min":0.87,"5min":0.997,"15min":0.997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.008,"5min":1.117,"15min":1.117},"last":0.625}]},{"osd":6,"last update":"Thu Aug 31 19:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65800000000000003,"15min":0.65300000000000002},"min":{"1min":0.50700000000000001,"5min":0.44700000000000001,"15min":0.441},"max":{"1min":0.94899999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.72199999999999998,"15min":0.70299999999999996},"min":{"1min":0.47899999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0469999999999999,"5min":1.2,"15min":1.2},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Aug 31 19:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71499999999999997,"15min":0.71199999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0600000000000001,"5min":1.202,"15min":1.202},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93200000000000005,"5min":1.004,"15min":1.004},"last":0.78500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:27:22.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-08-31T19:27:22.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.426+0000 7fad5cdff700 1 Processor -- start 2023-08-31T19:27:22.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.426+0000 7fad5cdff700 1 -- start start 2023-08-31T19:27:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.427+0000 7fad5cdff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad58153e30 0x7fad58154210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.427+0000 7fad5cdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad580637c0 0x7fad580c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.427+0000 7fad5cdff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad580bfd40 con 0x7fad580c5cb0 2023-08-31T19:27:22.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.427+0000 7fad5cdff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad580c6730 con 0x7fad58153e30 2023-08-31T19:27:22.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.427+0000 7fad5cdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad580bffe0 con 0x7fad580637c0 2023-08-31T19:27:22.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.427+0000 7fad5659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad58153e30 0x7fad58154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.428+0000 7fad5659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad58153e30 0x7fad58154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56942/0 (socket says 172.21.15.72:56942) 2023-08-31T19:27:22.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.428+0000 7fad5659c700 1 -- 172.21.15.72:0/3169885411 learned_addr learned my addr 172.21.15.72:0/3169885411 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:27:22.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.428+0000 7fad56d9d700 1 --2- 172.21.15.72:0/3169885411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad580637c0 0x7fad580c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.428+0000 7fad5659c700 1 -- 172.21.15.72:0/3169885411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad580637c0 msgr2=0x7fad580c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:27:22.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.428+0000 7fad5659c700 1 --2- 172.21.15.72:0/3169885411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad580637c0 0x7fad580c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.428+0000 7fad5659c700 1 -- 172.21.15.72:0/3169885411 >> v1:172.21.15.146:6789/0 conn(0x7fad580c5cb0 legacy=0x7fad580630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.428+0000 7fad5659c700 1 -- 172.21.15.72:0/3169885411 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad580c02c0 con 0x7fad58153e30 2023-08-31T19:27:22.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.428+0000 7fad5659c700 1 --2- 172.21.15.72:0/3169885411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad58153e30 0x7fad58154210 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7fad48006fd0 tx=0x7fad480090f0).ready entity=mon.0 client_cookie=570e4c6d7b3fc1c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.428+0000 7fad5559a700 1 -- 172.21.15.72:0/3169885411 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4800b600 con 0x7fad58153e30 2023-08-31T19:27:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.428+0000 7fad5559a700 1 -- 172.21.15.72:0/3169885411 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4800b760 con 0x7fad58153e30 2023-08-31T19:27:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.428+0000 7fad5559a700 1 -- 172.21.15.72:0/3169885411 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4800bb00 con 0x7fad58153e30 2023-08-31T19:27:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.429+0000 7fad5cdff700 1 -- 172.21.15.72:0/3169885411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad58153e30 msgr2=0x7fad58154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.429+0000 7fad5cdff700 1 --2- 172.21.15.72:0/3169885411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad58153e30 0x7fad58154210 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7fad48006fd0 tx=0x7fad480090f0).stop 2023-08-31T19:27:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.429+0000 7fad5cdff700 1 -- 172.21.15.72:0/3169885411 shutdown_connections 2023-08-31T19:27:22.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.429+0000 7fad5cdff700 1 --2- 172.21.15.72:0/3169885411 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad580637c0 0x7fad580c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.429+0000 7fad5cdff700 1 --2- 172.21.15.72:0/3169885411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad58153e30 0x7fad58154210 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.429+0000 7fad5cdff700 1 -- 172.21.15.72:0/3169885411 >> 172.21.15.72:0/3169885411 conn(0x7fad5805eb20 msgr2=0x7fad580cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:22.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.429+0000 7fad5cdff700 1 -- 172.21.15.72:0/3169885411 shutdown_connections 2023-08-31T19:27:22.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.429+0000 7fad5cdff700 1 -- 172.21.15.72:0/3169885411 wait complete. 2023-08-31T19:27:22.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.431+0000 7fad5cdff700 1 Processor -- start 2023-08-31T19:27:22.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.431+0000 7fad5cdff700 1 -- start start 2023-08-31T19:27:22.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad5cdff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad580637c0 0x7fad58152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad5cdff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad580c5cb0 0x7fad580c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad5cdff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad58153e30 0x7fad580c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad5cdff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad580c2e50 con 0x7fad580637c0 2023-08-31T19:27:22.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad5cdff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad580c3130 con 0x7fad58153e30 2023-08-31T19:27:22.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad5cdff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad580c3410 con 0x7fad580c5cb0 2023-08-31T19:27:22.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad5659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad580637c0 0x7fad58152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad5659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad580637c0 0x7fad58152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56952/0 (socket says 172.21.15.72:56952) 2023-08-31T19:27:22.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad5659c700 1 -- 172.21.15.72:0/4021951865 learned_addr learned my addr 172.21.15.72:0/4021951865 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:27:22.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad56d9d700 1 --2- 172.21.15.72:0/4021951865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad58153e30 0x7fad580c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad55d9b700 1 --2- 172.21.15.72:0/4021951865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad580c5cb0 0x7fad580c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad5659c700 1 -- 172.21.15.72:0/4021951865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad580c5cb0 msgr2=0x7fad580c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad5659c700 1 --2- 172.21.15.72:0/4021951865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad580c5cb0 0x7fad580c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad5659c700 1 -- 172.21.15.72:0/4021951865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad58153e30 msgr2=0x7fad580c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad5659c700 1 --2- 172.21.15.72:0/4021951865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad58153e30 0x7fad580c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad5659c700 1 -- 172.21.15.72:0/4021951865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad48009370 con 0x7fad580637c0 2023-08-31T19:27:22.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.432+0000 7fad5659c700 1 --2- 172.21.15.72:0/4021951865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad580637c0 0x7fad58152640 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7fad58065940 tx=0x7fad48017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:22.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.433+0000 7fad467fc700 1 -- 172.21.15.72:0/4021951865 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4800bec0 con 0x7fad580637c0 2023-08-31T19:27:22.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.433+0000 7fad467fc700 1 -- 172.21.15.72:0/4021951865 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad48006930 con 0x7fad580637c0 2023-08-31T19:27:22.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.433+0000 7fad467fc700 1 -- 172.21.15.72:0/4021951865 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4800bb00 con 0x7fad580637c0 2023-08-31T19:27:22.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.433+0000 7fad5cdff700 1 -- 172.21.15.72:0/4021951865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad580c36f0 con 0x7fad580637c0 2023-08-31T19:27:22.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.433+0000 7fad5cdff700 1 -- 172.21.15.72:0/4021951865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad580c3cb0 con 0x7fad580637c0 2023-08-31T19:27:22.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.434+0000 7fad5cdff700 1 -- 172.21.15.72:0/4021951865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad580c3ed0 con 0x7fad580637c0 2023-08-31T19:27:22.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.435+0000 7fad467fc700 1 -- 172.21.15.72:0/4021951865 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7fad48021070 con 0x7fad580637c0 2023-08-31T19:27:22.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.436+0000 7fad467fc700 1 --2- 172.21.15.72:0/4021951865 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fad3805ef30 0x7fad380613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.436+0000 7fad467fc700 1 -- 172.21.15.72:0/4021951865 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7fad4807bbe0 con 0x7fad580637c0 2023-08-31T19:27:22.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.436+0000 7fad55d9b700 1 --2- 172.21.15.72:0/4021951865 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fad3805ef30 0x7fad380613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.436+0000 7fad55d9b700 1 --2- 172.21.15.72:0/4021951865 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fad3805ef30 0x7fad380613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fad580a28c0 tx=0x7fad4c009040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:22.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.440+0000 7fad467fc700 1 -- 172.21.15.72:0/4021951865 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fad4804cd50 con 0x7fad580637c0 2023-08-31T19:27:22.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.608+0000 7fad5cdff700 1 -- 172.21.15.72:0/4021951865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fad58062970 con 0x7fad580637c0 2023-08-31T19:27:22.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.612+0000 7fad467fc700 1 -- 172.21.15.72:0/4021951865 <== mon.0 v2:172.21.15.72:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fad480091e0 con 0x7fad580637c0 2023-08-31T19:27:22.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.612+0000 7fad467fc700 1 -- 172.21.15.72:0/4021951865 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v42)=0 v42) v1 ==== 123+0+0 (secure 0 0 0) 0x7fad48029030 con 0x7fad580637c0 2023-08-31T19:27:22.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.615+0000 7fad5cdff700 1 -- 172.21.15.72:0/4021951865 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fad3805ef30 msgr2=0x7fad380613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.615+0000 7fad5cdff700 1 --2- 172.21.15.72:0/4021951865 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fad3805ef30 0x7fad380613f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fad580a28c0 tx=0x7fad4c009040).stop 2023-08-31T19:27:22.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.615+0000 7fad5cdff700 1 -- 172.21.15.72:0/4021951865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad580637c0 msgr2=0x7fad58152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.615+0000 7fad5cdff700 1 --2- 172.21.15.72:0/4021951865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad580637c0 0x7fad58152640 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7fad58065940 tx=0x7fad48017000).stop 2023-08-31T19:27:22.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.615+0000 7fad5cdff700 1 -- 172.21.15.72:0/4021951865 shutdown_connections 2023-08-31T19:27:22.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.615+0000 7fad5cdff700 1 --2- 172.21.15.72:0/4021951865 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7fad3805ef30 0x7fad380613f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.615+0000 7fad5cdff700 1 --2- 172.21.15.72:0/4021951865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad58153e30 0x7fad580c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.615+0000 7fad5cdff700 1 --2- 172.21.15.72:0/4021951865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad580637c0 0x7fad58152640 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.615+0000 7fad5cdff700 1 --2- 172.21.15.72:0/4021951865 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7fad580c5cb0 0x7fad580c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.615+0000 7fad5cdff700 1 -- 172.21.15.72:0/4021951865 >> 172.21.15.72:0/4021951865 conn(0x7fad5805eb20 msgr2=0x7fad580ac970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:22.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.616+0000 7fad5cdff700 1 -- 172.21.15.72:0/4021951865 shutdown_connections 2023-08-31T19:27:22.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.616+0000 7fad5cdff700 1 -- 172.21.15.72:0/4021951865 wait complete. 2023-08-31T19:27:22.633 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T19:27:22.634 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:27:22.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.821+0000 7f3c5bbff700 1 Processor -- start 2023-08-31T19:27:22.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.821+0000 7f3c5bbff700 1 -- start start 2023-08-31T19:27:22.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.822+0000 7f3c5bbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c540a9eb0 0x7f3c540aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.823+0000 7f3c5bbff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c540bfd00 con 0x7f3c541576d0 2023-08-31T19:27:22.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.823+0000 7f3c5bbff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c540c05a0 con 0x7f3c540c5bf0 2023-08-31T19:27:22.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.823+0000 7f3c5bbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540aaea0 con 0x7f3c540a9eb0 2023-08-31T19:27:22.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.823+0000 7f3c5a19c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3c541576d0 0x7f3c540c0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50012/0 (socket says 172.21.15.72:50012) 2023-08-31T19:27:22.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.823+0000 7f3c5a19c700 1 -- 172.21.15.72:0/3370206208 learned_addr learned my addr 172.21.15.72:0/3370206208 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-08-31T19:27:22.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.823+0000 7f3c58999700 1 -- 172.21.15.72:0/3370206208 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112386497 0 0) 0x7f3c540bfd00 con 0x7f3c541576d0 2023-08-31T19:27:22.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.823+0000 7f3c5999b700 1 --2- 172.21.15.72:0/3370206208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c540a9eb0 0x7f3c540aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.823+0000 7f3c58999700 1 -- 172.21.15.72:0/3370206208 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c400033f0 con 0x7f3c541576d0 2023-08-31T19:27:22.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c58999700 1 -- 172.21.15.72:0/3370206208 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2224906236 0 0) 0x7f3c400033f0 con 0x7f3c541576d0 2023-08-31T19:27:22.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c58999700 1 -- 172.21.15.72:0/3370206208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c540a9eb0 msgr2=0x7f3c540aa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:27:22.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c58999700 1 --2- 172.21.15.72:0/3370206208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c540a9eb0 0x7f3c540aa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c58999700 1 -- 172.21.15.72:0/3370206208 >> v1:172.21.15.146:6789/0 conn(0x7f3c540c5bf0 legacy=0x7f3c54156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c58999700 1 -- 172.21.15.72:0/3370206208 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c540c6670 con 0x7f3c541576d0 2023-08-31T19:27:22.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c58999700 1 -- 172.21.15.72:0/3370206208 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3400498798 0 0) 0x7f3c4c0017f0 con 0x7f3c541576d0 2023-08-31T19:27:22.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c58999700 1 -- 172.21.15.72:0/3370206208 >> v1:172.21.15.72:6789/0 conn(0x7f3c541576d0 legacy=0x7f3c540c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c58999700 1 --2- 172.21.15.72:0/3370206208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c40003910 0x7f3c40003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c58999700 1 --2- 172.21.15.72:0/3370206208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c540a9eb0 0x7f3c40004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c58999700 1 --2- 172.21.15.72:0/3370206208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c40004b80 0x7f3c40005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c58999700 1 -- 172.21.15.72:0/3370206208 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540aaea0 con 0x7f3c40004b80 2023-08-31T19:27:22.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c58999700 1 -- 172.21.15.72:0/3370206208 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4000b8e0 con 0x7f3c40003910 2023-08-31T19:27:22.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c58999700 1 -- 172.21.15.72:0/3370206208 --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4000ba50 con 0x7f3c540a9eb0 2023-08-31T19:27:22.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c5a19c700 1 --2- 172.21.15.72:0/3370206208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c40004b80 0x7f3c40005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c5999b700 1 --2- 172.21.15.72:0/3370206208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c40003910 0x7f3c40003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c5919a700 1 --2- 172.21.15.72:0/3370206208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c540a9eb0 0x7f3c40004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c5a19c700 1 -- 172.21.15.72:0/3370206208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c540a9eb0 msgr2=0x7f3c40004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:27:22.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c5a19c700 1 --2- 172.21.15.72:0/3370206208 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c540a9eb0 0x7f3c40004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c5a19c700 1 -- 172.21.15.72:0/3370206208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c40003910 msgr2=0x7f3c40003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:27:22.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.824+0000 7f3c5a19c700 1 --2- 172.21.15.72:0/3370206208 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c40003910 0x7f3c40003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.825+0000 7f3c5a19c700 1 -- 172.21.15.72:0/3370206208 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c400033f0 con 0x7f3c40004b80 2023-08-31T19:27:22.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.825+0000 7f3c5a19c700 1 --2- 172.21.15.72:0/3370206208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c40004b80 0x7f3c40005000 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7f3c4c00c5f0 tx=0x7f3c4c001d90).ready entity=mon.0 client_cookie=d24d3284cb2e11a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:22.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.825+0000 7f3c58999700 1 -- 172.21.15.72:0/3370206208 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00ce60 con 0x7f3c40004b80 2023-08-31T19:27:22.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.825+0000 7f3c58999700 1 -- 172.21.15.72:0/3370206208 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3c4c001fc0 con 0x7f3c40004b80 2023-08-31T19:27:22.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.825+0000 7f3c58999700 1 -- 172.21.15.72:0/3370206208 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c005d70 con 0x7f3c40004b80 2023-08-31T19:27:22.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.825+0000 7f3c5bbff700 1 -- 172.21.15.72:0/3370206208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c40004b80 msgr2=0x7f3c40005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.825+0000 7f3c5bbff700 1 --2- 172.21.15.72:0/3370206208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c40004b80 0x7f3c40005000 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7f3c4c00c5f0 tx=0x7f3c4c001d90).stop 2023-08-31T19:27:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.825+0000 7f3c5a19c700 1 -- 172.21.15.72:0/3370206208 reap_dead start 2023-08-31T19:27:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.825+0000 7f3c5bbff700 1 -- 172.21.15.72:0/3370206208 shutdown_connections 2023-08-31T19:27:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.825+0000 7f3c5bbff700 1 -- 172.21.15.72:0/3370206208 >> 172.21.15.72:0/3370206208 conn(0x7f3c540c82e0 msgr2=0x7f3c5405e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.826+0000 7f3c5bbff700 1 -- 172.21.15.72:0/3370206208 shutdown_connections 2023-08-31T19:27:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.826+0000 7f3c5bbff700 1 -- 172.21.15.72:0/3370206208 wait complete. 2023-08-31T19:27:22.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.827+0000 7f3c5bbff700 1 Processor -- start 2023-08-31T19:27:22.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.827+0000 7f3c5bbff700 1 -- start start 2023-08-31T19:27:22.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.828+0000 7f3c5bbff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c40004b80 0x7f3c540add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.828+0000 7f3c5bbff700 1 --2- >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c540c4b50 0x7f3c54141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.828+0000 7f3c5bbff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c5414fb90 0x7f3c54150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.828+0000 7f3c5bbff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c54150500 con 0x7f3c5414fb90 2023-08-31T19:27:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.828+0000 7f3c5bbff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540ae330 con 0x7f3c40004b80 2023-08-31T19:27:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.828+0000 7f3c5bbff700 1 -- --> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540ae610 con 0x7f3c540c4b50 2023-08-31T19:27:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.828+0000 7f3c5a19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c5414fb90 0x7f3c54150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.828+0000 7f3c5a19c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c5414fb90 0x7f3c54150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56966/0 (socket says 172.21.15.72:56966) 2023-08-31T19:27:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.828+0000 7f3c5a19c700 1 -- 172.21.15.72:0/2466021025 learned_addr learned my addr 172.21.15.72:0/2466021025 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-08-31T19:27:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.829+0000 7f3c5919a700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c540c4b50 0x7f3c54141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.829+0000 7f3c5999b700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c40004b80 0x7f3c540add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.829+0000 7f3c5a19c700 1 -- 172.21.15.72:0/2466021025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c540c4b50 msgr2=0x7f3c54141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.829+0000 7f3c5a19c700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c540c4b50 0x7f3c54141730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.829+0000 7f3c5a19c700 1 -- 172.21.15.72:0/2466021025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c40004b80 msgr2=0x7f3c540add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.829+0000 7f3c5a19c700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c40004b80 0x7f3c540add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.829+0000 7f3c5a19c700 1 -- 172.21.15.72:0/2466021025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c540ae8f0 con 0x7f3c5414fb90 2023-08-31T19:27:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.829+0000 7f3c5919a700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c540c4b50 0x7f3c54141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:27:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.829+0000 7f3c5999b700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c40004b80 0x7f3c540add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:27:22.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.829+0000 7f3c5a19c700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c5414fb90 0x7f3c54150010 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7f3c4c00a000 tx=0x7f3c4c001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:22.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.829+0000 7f3c49ffb700 1 -- 172.21.15.72:0/2466021025 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c01a030 con 0x7f3c5414fb90 2023-08-31T19:27:22.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.829+0000 7f3c49ffb700 1 -- 172.21.15.72:0/2466021025 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3c4c018030 con 0x7f3c5414fb90 2023-08-31T19:27:22.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.829+0000 7f3c49ffb700 1 -- 172.21.15.72:0/2466021025 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c0077c0 con 0x7f3c5414fb90 2023-08-31T19:27:22.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.829+0000 7f3c5bbff700 1 -- 172.21.15.72:0/2466021025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c540aebd0 con 0x7f3c5414fb90 2023-08-31T19:27:22.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.829+0000 7f3c5bbff700 1 -- 172.21.15.72:0/2466021025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c54141c20 con 0x7f3c5414fb90 2023-08-31T19:27:22.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.830+0000 7f3c5bbff700 1 -- 172.21.15.72:0/2466021025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c540aed60 con 0x7f3c5414fb90 2023-08-31T19:27:22.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.831+0000 7f3c49ffb700 1 -- 172.21.15.72:0/2466021025 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 97) v1 ==== 75374+0+0 (secure 0 0 0) 0x7f3c4c013660 con 0x7f3c5414fb90 2023-08-31T19:27:22.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.832+0000 7f3c49ffb700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3c3805ef30 0x7f3c380613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-31T19:27:22.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.832+0000 7f3c49ffb700 1 -- 172.21.15.72:0/2466021025 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f3c4c07afd0 con 0x7f3c5414fb90 2023-08-31T19:27:22.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.832+0000 7f3c5999b700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3c3805ef30 0x7f3c380613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-31T19:27:22.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.832+0000 7f3c5999b700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3c3805ef30 0x7f3c380613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3c50006d80 tx=0x7f3c50008040).ready entity=mgr.9771 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:27:22.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:22.836+0000 7f3c49ffb700 1 -- 172.21.15.72:0/2466021025 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3c4c04c210 con 0x7f3c5414fb90 2023-08-31T19:27:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:23.046+0000 7f3c5bbff700 1 -- 172.21.15.72:0/2466021025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c540c5190 con 0x7f3c5414fb90 2023-08-31T19:27:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:23.046+0000 7f3c49ffb700 1 -- 172.21.15.72:0/2466021025 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f3c4c025020 con 0x7f3c5414fb90 2023-08-31T19:27:23.047 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-08-31T19:27:23.048 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":88,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7595,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6834/2772120291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":2772120291},{"type":"v1","addr":"172.21.15.146:6834","nonce":2772120291}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":8956,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2387436467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6833","nonce":2387436467},{"type":"v1","addr":"172.21.15.146:6835","nonce":2387436467}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":9492,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4204264962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4204264962},{"type":"v1","addr":"172.21.15.72:6836","nonce":4204264962}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82},{"gid":9501,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2736058565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2736058565},{"type":"v1","addr":"172.21.15.72:6837","nonce":2736058565}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":82}],"filesystems":[]} 2023-08-31T19:27:23.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:23.049+0000 7f3c5bbff700 1 -- 172.21.15.72:0/2466021025 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3c3805ef30 msgr2=0x7f3c380613f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:23.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:23.049+0000 7f3c5bbff700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3c3805ef30 0x7f3c380613f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3c50006d80 tx=0x7f3c50008040).stop 2023-08-31T19:27:23.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:23.049+0000 7f3c5bbff700 1 -- 172.21.15.72:0/2466021025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c5414fb90 msgr2=0x7f3c54150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:27:23.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:23.049+0000 7f3c5bbff700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c5414fb90 0x7f3c54150010 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7f3c4c00a000 tx=0x7f3c4c001d90).stop 2023-08-31T19:27:23.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:23.049+0000 7f3c5bbff700 1 -- 172.21.15.72:0/2466021025 shutdown_connections 2023-08-31T19:27:23.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:23.049+0000 7f3c5bbff700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.72:6832/189426,v1:172.21.15.72:6833/189426] conn(0x7f3c3805ef30 0x7f3c380613f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:23.049+0000 7f3c5bbff700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c5414fb90 0x7f3c54150010 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:23.049+0000 7f3c5bbff700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c40004b80 0x7f3c540add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:23.049+0000 7f3c5bbff700 1 --2- 172.21.15.72:0/2466021025 >> [v2:172.21.15.146:3301/0,v1:172.21.15.146:6790/0] conn(0x7f3c540c4b50 0x7f3c54141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-31T19:27:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:23.049+0000 7f3c5bbff700 1 -- 172.21.15.72:0/2466021025 >> 172.21.15.72:0/2466021025 conn(0x7f3c540c82e0 msgr2=0x7f3c54151730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:27:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:23.049+0000 7f3c5bbff700 1 -- 172.21.15.72:0/2466021025 shutdown_connections 2023-08-31T19:27:23.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-08-31T19:27:23.049+0000 7f3c5bbff700 1 -- 172.21.15.72:0/2466021025 wait complete. 2023-08-31T19:27:23.052 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 88 2023-08-31T19:27:23.066 DEBUG:tasks.cephfs.filesystem:already dead... 2023-08-31T19:27:23.067 INFO:teuthology.misc:Shutting down mds daemons... 2023-08-31T19:27:23.067 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T19:27:23.068 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.082 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T19:27:23.082 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T19:27:23.083 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.135 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T19:27:23.136 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T19:27:23.136 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.152 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T19:27:23.152 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T19:27:23.153 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.208 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T19:27:23.209 INFO:teuthology.misc:Shutting down osd daemons... 2023-08-31T19:27:23.209 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-08-31T19:27:23.209 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.253 INFO:tasks.ceph.osd.0:Stopped 2023-08-31T19:27:23.253 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-08-31T19:27:23.254 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.307 INFO:tasks.ceph.osd.1:Stopped 2023-08-31T19:27:23.307 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-08-31T19:27:23.308 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.356 INFO:tasks.ceph.osd.2:Stopped 2023-08-31T19:27:23.356 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-08-31T19:27:23.357 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.401 INFO:tasks.ceph.osd.3:Stopped 2023-08-31T19:27:23.402 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-08-31T19:27:23.402 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.455 INFO:tasks.ceph.osd.4:Stopped 2023-08-31T19:27:23.455 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-08-31T19:27:23.456 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.507 INFO:tasks.ceph.osd.5:Stopped 2023-08-31T19:27:23.507 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-08-31T19:27:23.508 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.554 INFO:tasks.ceph.osd.6:Stopped 2023-08-31T19:27:23.554 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-08-31T19:27:23.554 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.598 INFO:tasks.ceph.osd.7:Stopped 2023-08-31T19:27:23.599 INFO:teuthology.misc:Shutting down mgr daemons... 2023-08-31T19:27:23.599 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-08-31T19:27:23.600 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.662 INFO:tasks.ceph.mgr.y:Stopped 2023-08-31T19:27:23.662 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-08-31T19:27:23.663 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.719 INFO:tasks.ceph.mgr.x:Stopped 2023-08-31T19:27:23.719 INFO:teuthology.misc:Shutting down mon daemons... 2023-08-31T19:27:23.720 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-08-31T19:27:23.720 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.749 INFO:tasks.ceph.mon.a:Stopped 2023-08-31T19:27:23.750 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-08-31T19:27:23.750 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.773 INFO:tasks.ceph.mon.b:Stopped 2023-08-31T19:27:23.774 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-08-31T19:27:23.774 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:27:23.839 INFO:tasks.ceph.mon.c:Stopped 2023-08-31T19:27:23.839 INFO:tasks.ceph:Checking cluster log for badness... 2023-08-31T19:27:23.840 DEBUG:teuthology.orchestra.run.smithi072:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-31T19:27:23.921 INFO:teuthology.orchestra.run.smithi072.stdout:2023-08-31T18:50:13.305414+0000 mon.a (mon.0) 400 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-08-31T19:27:23.922 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-08-31T19:27:23.923 DEBUG:teuthology.orchestra.run.smithi072:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-31T19:27:24.003 DEBUG:teuthology.orchestra.run.smithi072:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-31T19:27:24.086 DEBUG:teuthology.orchestra.run.smithi072:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-31T19:27:24.166 INFO:teuthology.orchestra.run.smithi072.stdout:2023-08-31T18:50:13.305414+0000 mon.a (mon.0) 400 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-08-31T19:27:24.167 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T19:27:24.168 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-08-31T19:27:24.460 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T19:27:24.460 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-08-31T19:27:24.664 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T19:27:24.664 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-08-31T19:27:24.853 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T19:27:24.854 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-08-31T19:27:25.093 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi146.front.sepia.ceph.com 2023-08-31T19:27:25.093 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-08-31T19:27:25.409 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi146.front.sepia.ceph.com 2023-08-31T19:27:25.410 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-08-31T19:27:25.608 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi146.front.sepia.ceph.com 2023-08-31T19:27:25.609 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-08-31T19:27:25.813 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi146.front.sepia.ceph.com 2023-08-31T19:27:25.813 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-08-31T19:27:25.999 INFO:tasks.ceph:Archiving mon data... 2023-08-31T19:27:26.002 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686/data/mon.a.tgz 2023-08-31T19:27:26.003 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-08-31T19:27:26.054 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.HJWPlVS5bX 2023-08-31T19:27:26.055 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.HJWPlVS5bX 2023-08-31T19:27:26.594 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.HJWPlVS5bX 2023-08-31T19:27:26.712 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.HJWPlVS5bX is 2MB 2023-08-31T19:27:26.846 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.HJWPlVS5bX 2023-08-31T19:27:26.893 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686/data/mon.b.tgz 2023-08-31T19:27:26.893 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-08-31T19:27:26.942 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.HyFaPoFjhR 2023-08-31T19:27:26.943 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.HyFaPoFjhR 2023-08-31T19:27:27.538 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.HyFaPoFjhR 2023-08-31T19:27:27.657 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.HyFaPoFjhR is 3MB 2023-08-31T19:27:27.799 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.HyFaPoFjhR 2023-08-31T19:27:27.846 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686/data/mon.c.tgz 2023-08-31T19:27:27.847 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-08-31T19:27:27.893 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.GSJ3aSP76u 2023-08-31T19:27:27.894 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.GSJ3aSP76u 2023-08-31T19:27:28.499 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.GSJ3aSP76u 2023-08-31T19:27:28.618 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.GSJ3aSP76u is 3MB 2023-08-31T19:27:28.752 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.GSJ3aSP76u 2023-08-31T19:27:28.799 INFO:tasks.ceph:Cleaning ceph cluster... 2023-08-31T19:27:28.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-31T19:27:28.805 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-31T19:27:28.910 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-08-31T19:27:28.911 DEBUG:teuthology.orchestra.run.smithi072:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-31T19:27:28.917 DEBUG:teuthology.orchestra.run.smithi146:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-31T19:27:28.994 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-31T19:27:29.012 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-31T19:27:29.028 INFO:tasks.ceph:Archiving crash dumps... 2023-08-31T19:27:29.034 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686/remote/smithi072/crash 2023-08-31T19:27:29.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-31T19:27:29.103 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686/remote/smithi146/crash 2023-08-31T19:27:29.105 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-31T19:27:29.174 INFO:tasks.ceph:Shutting down logrotate 2023-08-31T19:27:29.174 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:27:29.180 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:27:29.274 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-31T19:27:29.343 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-31T19:27:29.412 INFO:tasks.ceph:Compressing logs... 2023-08-31T19:27:29.412 DEBUG:teuthology.orchestra.run.smithi072:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-31T19:27:29.417 DEBUG:teuthology.orchestra.run.smithi146:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-31T19:27:29.481 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184420.log 2023-08-31T19:27:29.482 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191091.log 2023-08-31T19:27:29.483 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184420.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.184420.log.gz 2023-08-31T19:27:29.483 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187121.log 2023-08-31T19:27:29.484 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149718.log 87.8% 2023-08-31T19:27:29.485 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.191091.log.gz 2023-08-31T19:27:29.485 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-08-31T19:27:29.486 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187121.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.187121.log.gz 2023-08-31T19:27:29.486 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165691.log 2023-08-31T19:27:29.488 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149718.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149718.log.gz 2023-08-31T19:27:29.488 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190720.log 2023-08-31T19:27:29.488 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165691.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.165691.log.gz-5 2023-08-31T19:27:29.488 INFO:teuthology.orchestra.run.smithi072.stderr:--verbose -- /var/log/ceph/ceph-client.admin.184469.log 2023-08-31T19:27:29.488 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143133.log 2023-08-31T19:27:29.489 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.148071.log 2023-08-31T19:27:29.493 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143133.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.143133.log.gz 2023-08-31T19:27:29.493 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143078.log 2023-08-31T19:27:29.493 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.3.148071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.148071.log.gz 2023-08-31T19:27:29.494 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-31T19:27:29.494 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143078.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143078.log.gz 2023-08-31T19:27:29.494 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143281.log 2023-08-31T19:27:29.494 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143029.log 2023-08-31T19:27:29.496 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190720.log: gzip 86.9%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.190720.log.gz-- /var/log/ceph/ceph-client.admin.149963.log 2023-08-31T19:27:29.496 INFO:teuthology.orchestra.run.smithi072.stderr: 2023-08-31T19:27:29.496 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184469.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.184469.log.gz 2023-08-31T19:27:29.496 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177976.log 2023-08-31T19:27:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149963.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149963.log.gz 2023-08-31T19:27:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182096.log 2023-08-31T19:27:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177976.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.177976.log.gz 2023-08-31T19:27:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201073.log 2023-08-31T19:27:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165245.log 2023-08-31T19:27:29.498 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.182096.log.gz 2023-08-31T19:27:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.201073.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.201073.log.gz 2023-08-31T19:27:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154354.log 2023-08-31T19:27:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165245.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.165245.log.gz 2023-08-31T19:27:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197139.log 2023-08-31T19:27:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154354.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.154354.log.gz 2023-08-31T19:27:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153403.log 2023-08-31T19:27:29.505 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143281.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.143281.log.gz 2023-08-31T19:27:29.505 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147038.log 2023-08-31T19:27:29.505 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143029.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143029.log.gz 2023-08-31T19:27:29.505 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143184.log 2023-08-31T19:27:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147038.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147038.log.gz 2023-08-31T19:27:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-08-31T19:27:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143184.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143184.log.gz 2023-08-31T19:27:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-08-31T19:27:29.506 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.7.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-31T19:27:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147598.log 2023-08-31T19:27:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143331.log 2023-08-31T19:27:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.147598.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.147598.log.gz 2023-08-31T19:27:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-08-31T19:27:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143331.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.143331.log.gz 2023-08-31T19:27:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142980.log 2023-08-31T19:27:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-08-31T19:27:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.142980.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.142980.log.gz 2023-08-31T19:27:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-08-31T19:27:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-08-31T19:27:29.513 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197139.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.197139.log.gz 2023-08-31T19:27:29.513 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179246.log 2023-08-31T19:27:29.513 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153403.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153403.log.gz 2023-08-31T19:27:29.513 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164783.log 2023-08-31T19:27:29.514 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179246.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.179246.log.gz 2023-08-31T19:27:29.514 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184100.log 2023-08-31T19:27:29.514 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164783.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164783.log.gz 2023-08-31T19:27:29.514 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175405.log 2023-08-31T19:27:29.514 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184100.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.184100.log.gz 2023-08-31T19:27:29.515 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174329.log 2023-08-31T19:27:29.515 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175405.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175405.log.gz 2023-08-31T19:27:29.515 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180504.log 2023-08-31T19:27:29.515 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174329.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174329.log.gz 2023-08-31T19:27:29.515 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158852.log 2023-08-31T19:27:29.516 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180504.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.180504.log.gz 2023-08-31T19:27:29.516 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147844.log 2023-08-31T19:27:29.516 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158852.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158852.log.gz 2023-08-31T19:27:29.516 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199780.log 2023-08-31T19:27:29.516 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147844.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147844.log.gz 2023-08-31T19:27:29.516 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180162.log 2023-08-31T19:27:29.517 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176524.log 2023-08-31T19:27:29.517 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.199780.log.gz 2023-08-31T19:27:29.517 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180162.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180162.log.gz 2023-08-31T19:27:29.517 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155412.log 2023-08-31T19:27:29.517 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176524.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176524.log.gz 2023-08-31T19:27:29.518 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175668.log 2023-08-31T19:27:29.518 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155412.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155412.log.gz 2023-08-31T19:27:29.518 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152766.log 2023-08-31T19:27:29.518 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175668.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175668.log.gz 2023-08-31T19:27:29.518 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192645.log 2023-08-31T19:27:29.519 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152766.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.152766.log.gz 2023-08-31T19:27:29.519 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148044.log 2023-08-31T19:27:29.522 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192645.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.192645.log.gz 2023-08-31T19:27:29.522 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187437.log 2023-08-31T19:27:29.522 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148044.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148044.log.gz 2023-08-31T19:27:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169956.log 2023-08-31T19:27:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187437.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.187437.log.gz 2023-08-31T19:27:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154599.log 2023-08-31T19:27:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169956.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169956.log.gz 2023-08-31T19:27:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171801.log 2023-08-31T19:27:29.524 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197584.log 2023-08-31T19:27:29.524 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154599.log.gz 2023-08-31T19:27:29.524 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171801.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.171801.log.gz 2023-08-31T19:27:29.524 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153354.log 2023-08-31T19:27:29.524 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196115.log 2023-08-31T19:27:29.525 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.197584.log.gz 2023-08-31T19:27:29.525 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153354.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153354.log.gz 2023-08-31T19:27:29.525 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197535.log 2023-08-31T19:27:29.525 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196115.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.196115.log.gz 2023-08-31T19:27:29.525 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170656.log 2023-08-31T19:27:29.526 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-31T19:27:29.528 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197535.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.197535.log.gz 2023-08-31T19:27:29.528 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175018.log 2023-08-31T19:27:29.528 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182248.log 2023-08-31T19:27:29.528 INFO:teuthology.orchestra.run.smithi072.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.170656.log.gz 2023-08-31T19:27:29.528 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175018.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175018.log.gz 2023-08-31T19:27:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154254.log 2023-08-31T19:27:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182248.log: gzip -5 --verbose -- 88.1%/var/log/ceph/ceph-client.admin.173167.log 2023-08-31T19:27:29.529 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.182248.log.gz 2023-08-31T19:27:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154254.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154254.log.gz 2023-08-31T19:27:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199058.log 2023-08-31T19:27:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173916.log 2023-08-31T19:27:29.530 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.173167.log.gz 2023-08-31T19:27:29.531 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-08-31T19:27:29.531 INFO:teuthology.orchestra.run.smithi146.stderr: 93.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-08-31T19:27:29.534 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199058.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.199058.log.gz 2023-08-31T19:27:29.534 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176730.log 2023-08-31T19:27:29.534 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184371.log 2023-08-31T19:27:29.534 INFO:teuthology.orchestra.run.smithi072.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.173916.log.gz 2023-08-31T19:27:29.534 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176730.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.176730.log.gz 2023-08-31T19:27:29.535 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196219.log 2023-08-31T19:27:29.535 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184371.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.184371.log.gz 2023-08-31T19:27:29.535 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163035.log 2023-08-31T19:27:29.535 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196219.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.196219.log.gz 2023-08-31T19:27:29.535 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174280.log 2023-08-31T19:27:29.536 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163035.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.163035.log.gz 2023-08-31T19:27:29.537 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156788.log 2023-08-31T19:27:29.537 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171191.log 2023-08-31T19:27:29.537 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.174280.log.gz 2023-08-31T19:27:29.538 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156788.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156788.log.gz 2023-08-31T19:27:29.538 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200877.log 2023-08-31T19:27:29.538 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198242.log 2023-08-31T19:27:29.538 INFO:teuthology.orchestra.run.smithi072.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.171191.log.gz 2023-08-31T19:27:29.539 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200877.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.200877.log.gz 2023-08-31T19:27:29.540 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171904.log 2023-08-31T19:27:29.540 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.198242.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.198242.log.gz 2023-08-31T19:27:29.540 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169521.log 2023-08-31T19:27:29.541 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171904.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.171904.log.gz 2023-08-31T19:27:29.541 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179001.log 2023-08-31T19:27:29.541 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169521.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.169521.log.gz 2023-08-31T19:27:29.542 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179755.log 2023-08-31T19:27:29.542 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179001.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179001.log.gz 2023-08-31T19:27:29.543 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184825.log 2023-08-31T19:27:29.543 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179755.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.179755.log.gz 2023-08-31T19:27:29.544 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196630.log 2023-08-31T19:27:29.544 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.184825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.184825.log.gz 2023-08-31T19:27:29.545 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175815.log 2023-08-31T19:27:29.545 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196630.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.196630.log.gz 2023-08-31T19:27:29.545 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143929.log 2023-08-31T19:27:29.546 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175815.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.175815.log.gz 2023-08-31T19:27:29.546 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173424.log 2023-08-31T19:27:29.547 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-08-31T19:27:29.547 INFO:teuthology.orchestra.run.smithi146.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-08-31T19:27:29.548 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143929.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.143929.log.gz 2023-08-31T19:27:29.548 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147697.log 2023-08-31T19:27:29.549 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173424.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.173424.log.gz 2023-08-31T19:27:29.549 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197437.log 2023-08-31T19:27:29.550 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147697.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147697.log.gz 2023-08-31T19:27:29.550 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176473.log 2023-08-31T19:27:29.550 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197437.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.197437.log.gz 2023-08-31T19:27:29.551 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182514.log 2023-08-31T19:27:29.551 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176473.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.176473.log.gz 2023-08-31T19:27:29.552 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186587.log 2023-08-31T19:27:29.553 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182514.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182514.log.gz 2023-08-31T19:27:29.553 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187731.log 2023-08-31T19:27:29.554 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186587.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.186587.log.gz 2023-08-31T19:27:29.554 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168284.log 2023-08-31T19:27:29.554 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187731.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.187731.log.gz 2023-08-31T19:27:29.555 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197780.log 2023-08-31T19:27:29.556 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168284.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.168284.log.gz 2023-08-31T19:27:29.556 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184518.log 2023-08-31T19:27:29.557 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197780.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.197780.log.gz 2023-08-31T19:27:29.557 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164538.log 2023-08-31T19:27:29.557 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.147556.log 2023-08-31T19:27:29.558 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201171.log 2023-08-31T19:27:29.558 INFO:teuthology.orchestra.run.smithi072.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.184518.log.gz 2023-08-31T19:27:29.559 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164538.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.164538.log.gz 2023-08-31T19:27:29.559 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160718.log 2023-08-31T19:27:29.560 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.201171.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.201171.log.gz 2023-08-31T19:27:29.560 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200428.log 2023-08-31T19:27:29.561 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148934.log 2023-08-31T19:27:29.561 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160718.log.gz 2023-08-31T19:27:29.562 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200428.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.200428.log.gz 2023-08-31T19:27:29.562 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182352.log 2023-08-31T19:27:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148934.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148934.log.gz 2023-08-31T19:27:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198315.log 2023-08-31T19:27:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182352.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182352.log.gz 2023-08-31T19:27:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152545.log 2023-08-31T19:27:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.198315.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.198315.log.gz 2023-08-31T19:27:29.565 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147993.log 2023-08-31T19:27:29.565 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152545.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152545.log.gz 2023-08-31T19:27:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199378.log 2023-08-31T19:27:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147993.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.147993.log.gz 2023-08-31T19:27:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169227.log 2023-08-31T19:27:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199378.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.199378.log.gz 2023-08-31T19:27:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186713.log 2023-08-31T19:27:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169227.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169227.log.gz 2023-08-31T19:27:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173867.log 2023-08-31T19:27:29.569 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.1.147556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.147556.log.gz 2023-08-31T19:27:29.569 INFO:teuthology.orchestra.run.smithi146.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143233.log 2023-08-31T19:27:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186713.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.186713.log.gz 2023-08-31T19:27:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154154.log 2023-08-31T19:27:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173867.log: gzip -5 88.8%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.173867.log.gz/var/log/ceph/ceph-client.admin.198761.log 2023-08-31T19:27:29.571 INFO:teuthology.orchestra.run.smithi072.stderr: 2023-08-31T19:27:29.572 INFO:teuthology.orchestra.run.smithi146.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-08-31T19:27:29.572 INFO:teuthology.orchestra.run.smithi146.stderr:/var/log/ceph/ceph-client.admin.143233.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.143233.log.gz 2023-08-31T19:27:29.573 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154154.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.154154.log.gz 2023-08-31T19:27:29.573 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158924.log 2023-08-31T19:27:29.573 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.198761.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.198761.log.gz 2023-08-31T19:27:29.573 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190884.log 2023-08-31T19:27:29.574 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158924.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158924.log.gz 2023-08-31T19:27:29.574 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163190.log 2023-08-31T19:27:29.575 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190884.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.190884.log.gz 2023-08-31T19:27:29.575 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191954.log 2023-08-31T19:27:29.576 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163190.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.163190.log.gz 2023-08-31T19:27:29.576 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155854.log 2023-08-31T19:27:29.577 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191954.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.191954.log.gz 2023-08-31T19:27:29.577 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147746.log 2023-08-31T19:27:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155854.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.155854.log.gz 2023-08-31T19:27:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150257.log 2023-08-31T19:27:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147746.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147746.log.gz 2023-08-31T19:27:29.579 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177437.log 2023-08-31T19:27:29.579 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150257.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.150257.log.gz 2023-08-31T19:27:29.580 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170005.log 2023-08-31T19:27:29.580 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177437.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.177437.log.gz 2023-08-31T19:27:29.581 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200673.log 2023-08-31T19:27:29.581 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170005.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.170005.log.gz 2023-08-31T19:27:29.582 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198388.log 2023-08-31T19:27:29.582 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200673.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.200673.log.gz 2023-08-31T19:27:29.583 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154501.log 2023-08-31T19:27:29.583 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.198388.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.198388.log.gz 2023-08-31T19:27:29.584 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200820.log 2023-08-31T19:27:29.585 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154501.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154501.log.gz 2023-08-31T19:27:29.585 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159669.log 2023-08-31T19:27:29.586 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200820.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.200820.log.gz 2023-08-31T19:27:29.586 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148983.log 2023-08-31T19:27:29.586 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.159669.log: gzip 88.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.159669.log.gz--verbose 2023-08-31T19:27:29.587 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.163604.log 2023-08-31T19:27:29.587 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148983.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148983.log.gz 2023-08-31T19:27:29.588 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187682.log 2023-08-31T19:27:29.588 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163604.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163604.log.gz 2023-08-31T19:27:29.589 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198463.log 2023-08-31T19:27:29.589 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187682.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187682.log.gz 2023-08-31T19:27:29.590 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148738.log 2023-08-31T19:27:29.590 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.198463.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.198463.log.gz 2023-08-31T19:27:29.591 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154090.log 2023-08-31T19:27:29.591 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148738.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.148738.log.gz 2023-08-31T19:27:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186538.log 2023-08-31T19:27:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154090.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154090.log.gz 2023-08-31T19:27:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186292.log 2023-08-31T19:27:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186538.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.186538.log.gz 2023-08-31T19:27:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148640.log 2023-08-31T19:27:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186292.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.186292.log.gz 2023-08-31T19:27:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200183.log 2023-08-31T19:27:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148640.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148640.log.gz 2023-08-31T19:27:29.596 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-08-31T19:27:29.596 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200183.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.200183.log.gz 2023-08-31T19:27:29.597 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175225.log 2023-08-31T19:27:29.597 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158492.log 2023-08-31T19:27:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175225.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.175225.log.gz 2023-08-31T19:27:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158708.log 2023-08-31T19:27:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158492.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158492.log.gzgzip 2023-08-31T19:27:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.199429.log 2023-08-31T19:27:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158708.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158708.log.gz 2023-08-31T19:27:29.601 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175122.log 2023-08-31T19:27:29.602 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199429.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.199429.log.gz 2023-08-31T19:27:29.602 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150208.log 2023-08-31T19:27:29.603 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157788.log 2023-08-31T19:27:29.603 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175122.log.gz 2023-08-31T19:27:29.604 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150208.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.150208.log.gz 2023-08-31T19:27:29.604 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143804.log 2023-08-31T19:27:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157788.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157788.log.gz 2023-08-31T19:27:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180966.log 2023-08-31T19:27:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143804.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.143804.log.gz 2023-08-31T19:27:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149277.log 2023-08-31T19:27:29.608 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180966.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.180966.log.gz 2023-08-31T19:27:29.608 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180869.log 2023-08-31T19:27:29.609 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154844.log 2023-08-31T19:27:29.609 INFO:teuthology.orchestra.run.smithi072.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.149277.log.gz 2023-08-31T19:27:29.610 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180869.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.180869.log.gz-5 2023-08-31T19:27:29.610 INFO:teuthology.orchestra.run.smithi072.stderr:--verbose -- /var/log/ceph/ceph-mgr.y.log 2023-08-31T19:27:29.611 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174854.log 2023-08-31T19:27:29.611 INFO:teuthology.orchestra.run.smithi072.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.154844.log.gz 2023-08-31T19:27:29.612 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173473.log 2023-08-31T19:27:29.613 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174854.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.174854.log.gz 2023-08-31T19:27:29.614 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172380.log 2023-08-31T19:27:29.615 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173473.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.173473.log.gz 2023-08-31T19:27:29.615 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183894.log 2023-08-31T19:27:29.616 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172380.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.172380.log.gz 2023-08-31T19:27:29.616 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180013.log 2023-08-31T19:27:29.617 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183894.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183894.log.gz 2023-08-31T19:27:29.617 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164734.log 2023-08-31T19:27:29.618 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180013.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.180013.log.gz 2023-08-31T19:27:29.619 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196804.log 2023-08-31T19:27:29.619 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164734.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.164734.log.gz 2023-08-31T19:27:29.619 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199976.log 2023-08-31T19:27:29.621 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196804.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.196804.log.gz 2023-08-31T19:27:29.621 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178528.log 2023-08-31T19:27:29.622 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199976.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.199976.log.gz 2023-08-31T19:27:29.622 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201234.log 2023-08-31T19:27:29.623 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178528.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178528.log.gz 2023-08-31T19:27:29.623 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156438.log 2023-08-31T19:27:29.624 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.201234.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.201234.log.gz 2023-08-31T19:27:29.624 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199007.log 2023-08-31T19:27:29.625 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156438.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.156438.log.gz 2023-08-31T19:27:29.625 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177927.log 2023-08-31T19:27:29.626 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199007.log: 87.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.199007.log.gz--verbose 2023-08-31T19:27:29.626 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.199585.log 2023-08-31T19:27:29.627 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177927.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177927.log.gz 2023-08-31T19:27:29.628 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163139.log 2023-08-31T19:27:29.629 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199585.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.199585.log.gz 2023-08-31T19:27:29.629 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179804.log 2023-08-31T19:27:29.630 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163139.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.163139.log.gz 2023-08-31T19:27:29.630 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192390.log 2023-08-31T19:27:29.631 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179804.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.179804.log.gz 2023-08-31T19:27:29.631 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176581.log 2023-08-31T19:27:29.632 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192390.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.192390.log.gz 2023-08-31T19:27:29.632 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153836.log 2023-08-31T19:27:29.633 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154950.log 2023-08-31T19:27:29.634 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.176581.log.gz 2023-08-31T19:27:29.634 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153836.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.153836.log.gz 2023-08-31T19:27:29.635 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169423.log 2023-08-31T19:27:29.636 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154950.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154950.log.gz 2023-08-31T19:27:29.636 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186128.log 2023-08-31T19:27:29.637 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169423.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.169423.log.gz 2023-08-31T19:27:29.637 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151712.log 2023-08-31T19:27:29.638 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186128.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.186128.log.gz 2023-08-31T19:27:29.638 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150012.log 2023-08-31T19:27:29.639 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151712.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.151712.log.gz 2023-08-31T19:27:29.640 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147338.log 2023-08-31T19:27:29.640 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150012.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150012.log.gz 2023-08-31T19:27:29.641 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200281.log 2023-08-31T19:27:29.642 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147338.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147338.log.gz 2023-08-31T19:27:29.642 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164170.log 2023-08-31T19:27:29.643 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200281.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.200281.log.gz 2023-08-31T19:27:29.643 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184151.log 2023-08-31T19:27:29.644 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164170.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164170.log.gz 2023-08-31T19:27:29.644 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148885.log 2023-08-31T19:27:29.645 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184151.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.184151.log.gz 2023-08-31T19:27:29.646 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168910.log 2023-08-31T19:27:29.646 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148885.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148885.log.gz 2023-08-31T19:27:29.647 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177380.log 2023-08-31T19:27:29.648 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168910.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168910.log.gz 2023-08-31T19:27:29.648 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176422.log 2023-08-31T19:27:29.649 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.177380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.177380.log.gz 2023-08-31T19:27:29.649 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153256.log 2023-08-31T19:27:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176422.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176422.log.gz 2023-08-31T19:27:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181978.log 2023-08-31T19:27:29.651 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153256.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.153256.log.gz 2023-08-31T19:27:29.651 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151859.log 2023-08-31T19:27:29.652 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181978.log: gzip -5 87.3%--verbose -- replaced with /var/log/ceph/ceph-client.admin.181978.log.gz-- 2023-08-31T19:27:29.652 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154403.log 2023-08-31T19:27:29.653 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151859.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.151859.log.gz 2023-08-31T19:27:29.654 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200722.log 2023-08-31T19:27:29.655 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154403.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.154403.log.gz 2023-08-31T19:27:29.655 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149228.log 2023-08-31T19:27:29.656 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200722.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.200722.log.gz 2023-08-31T19:27:29.656 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164881.log 2023-08-31T19:27:29.657 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186391.log 2023-08-31T19:27:29.657 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149228.log.gz 2023-08-31T19:27:29.658 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179099.log 2023-08-31T19:27:29.658 INFO:teuthology.orchestra.run.smithi072.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.164881.log.gz 2023-08-31T19:27:29.659 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186391.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.186391.log.gz-5 2023-08-31T19:27:29.659 INFO:teuthology.orchestra.run.smithi072.stderr:--verbose -- /var/log/ceph/ceph-client.admin.191681.log 2023-08-31T19:27:29.660 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179099.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179099.log.gz 2023-08-31T19:27:29.661 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182670.log 2023-08-31T19:27:29.661 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191681.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191681.log.gz 2023-08-31T19:27:29.662 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148191.log 2023-08-31T19:27:29.663 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182670.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.182670.log.gz 2023-08-31T19:27:29.663 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185972.log 2023-08-31T19:27:29.665 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148191.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148191.log.gz 2023-08-31T19:27:29.665 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.155355.log 2023-08-31T19:27:29.665 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185972.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.185972.log.gz 2023-08-31T19:27:29.666 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197829.log 2023-08-31T19:27:29.667 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.155355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.155355.log.gz 2023-08-31T19:27:29.667 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192694.log 2023-08-31T19:27:29.668 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197829.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.197829.log.gz 2023-08-31T19:27:29.669 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147893.log 2023-08-31T19:27:29.669 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192694.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192694.log.gz 2023-08-31T19:27:29.670 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189932.log 2023-08-31T19:27:29.671 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147893.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.147893.log.gz 2023-08-31T19:27:29.671 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171742.log 2023-08-31T19:27:29.672 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189932.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.189932.log.gz 2023-08-31T19:27:29.673 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152447.log 2023-08-31T19:27:29.673 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171742.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.171742.log.gz 2023-08-31T19:27:29.674 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147387.log 2023-08-31T19:27:29.675 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152447.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152447.log.gz 2023-08-31T19:27:29.675 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156488.log 2023-08-31T19:27:29.676 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147387.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.147387.log.gz 2023-08-31T19:27:29.676 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183285.log 2023-08-31T19:27:29.677 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156488.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156488.log.gz 2023-08-31T19:27:29.678 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191041.log 2023-08-31T19:27:29.679 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183285.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.183285.log.gz 2023-08-31T19:27:29.679 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158033.log 2023-08-31T19:27:29.680 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191041.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.191041.log.gz 2023-08-31T19:27:29.680 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172748.log 2023-08-31T19:27:29.681 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158033.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.158033.log.gz 2023-08-31T19:27:29.682 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175355.log 2023-08-31T19:27:29.682 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172748.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.172748.log.gz 2023-08-31T19:27:29.683 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183187.log 2023-08-31T19:27:29.684 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175355.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.175355.log.gz 2023-08-31T19:27:29.684 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169374.log 2023-08-31T19:27:29.685 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183187.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183187.log.gz 2023-08-31T19:27:29.685 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156219.log 2023-08-31T19:27:29.686 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169374.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.169374.log.gz 2023-08-31T19:27:29.686 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191197.log 2023-08-31T19:27:29.687 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156219.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.156219.log.gz 2023-08-31T19:27:29.688 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180260.log 2023-08-31T19:27:29.688 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191197.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.191197.log.gz 2023-08-31T19:27:29.689 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162664.log 2023-08-31T19:27:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180260.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.180260.log.gz 2023-08-31T19:27:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186342.log 2023-08-31T19:27:29.691 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162664.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.162664.log.gz 2023-08-31T19:27:29.691 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176926.log 2023-08-31T19:27:29.692 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186342.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.186342.log.gz 2023-08-31T19:27:29.693 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-31T19:27:29.693 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176926.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176926.log.gz 2023-08-31T19:27:29.694 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149571.log 2023-08-31T19:27:29.695 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161414.log 2023-08-31T19:27:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149571.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149571.log.gz 2023-08-31T19:27:29.696 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172009.log 2023-08-31T19:27:29.698 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161414.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.161414.log.gz 2023-08-31T19:27:29.698 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181240.log 2023-08-31T19:27:29.698 INFO:teuthology.orchestra.run.smithi072.stderr: 90.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-31T19:27:29.699 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172009.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172009.log.gz 2023-08-31T19:27:29.700 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172601.log 2023-08-31T19:27:29.700 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181240.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.181240.log.gz 2023-08-31T19:27:29.701 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199169.log 2023-08-31T19:27:29.702 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172601.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172601.log.gz 2023-08-31T19:27:29.702 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186440.log 2023-08-31T19:27:29.703 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199169.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.199169.log.gz 2023-08-31T19:27:29.704 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197388.log 2023-08-31T19:27:29.704 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186440.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.186440.log.gz 2023-08-31T19:27:29.705 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169325.log 2023-08-31T19:27:29.706 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197388.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.197388.log.gz 2023-08-31T19:27:29.707 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152104.log 2023-08-31T19:27:29.708 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169325.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169325.log.gz 2023-08-31T19:27:29.708 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178201.log 2023-08-31T19:27:29.708 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152104.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.152104.log.gz 2023-08-31T19:27:29.709 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149032.log 2023-08-31T19:27:29.710 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178201.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178201.log.gz 2023-08-31T19:27:29.710 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163778.log 2023-08-31T19:27:29.711 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149032.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149032.log.gz 2023-08-31T19:27:29.711 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163531.log 2023-08-31T19:27:29.712 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163778.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.163778.log.gz 2023-08-31T19:27:29.713 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171266.log 2023-08-31T19:27:29.714 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163531.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163531.log.gz 2023-08-31T19:27:29.714 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201024.log 2023-08-31T19:27:29.715 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171266.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.171266.log.gz 2023-08-31T19:27:29.716 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185399.log 2023-08-31T19:27:29.716 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.201024.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.201024.log.gz 2023-08-31T19:27:29.717 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178631.log 2023-08-31T19:27:29.718 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185399.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.185399.log.gz 2023-08-31T19:27:29.718 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188193.log 2023-08-31T19:27:29.719 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178631.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178631.log.gz 2023-08-31T19:27:29.720 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163966.log 2023-08-31T19:27:29.720 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188193.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188193.log.gz 2023-08-31T19:27:29.721 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164636.log 2023-08-31T19:27:29.721 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163966.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.163966.log.gz 2023-08-31T19:27:29.722 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169177.log 2023-08-31T19:27:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164636.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.164636.log.gz 2023-08-31T19:27:29.723 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195803.log 2023-08-31T19:27:29.724 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169177.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169177.log.gz 2023-08-31T19:27:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199534.log 2023-08-31T19:27:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195803.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.195803.log.gz 2023-08-31T19:27:29.725 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160017.log 2023-08-31T19:27:29.726 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199534.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.199534.log.gz 2023-08-31T19:27:29.727 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148436.log 2023-08-31T19:27:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160017.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.160017.log.gz 2023-08-31T19:27:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164121.log 2023-08-31T19:27:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148436.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148436.log.gz 2023-08-31T19:27:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185601.log 2023-08-31T19:27:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164121.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.164121.log.gz 2023-08-31T19:27:29.731 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180309.log 2023-08-31T19:27:29.731 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185601.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.185601.log.gz 2023-08-31T19:27:29.732 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196728.log 2023-08-31T19:27:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180309.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180309.log.gz 2023-08-31T19:27:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148387.log 2023-08-31T19:27:29.734 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196728.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.196728.log.gz 2023-08-31T19:27:29.735 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149522.log 2023-08-31T19:27:29.735 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148387.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.148387.log.gz 2023-08-31T19:27:29.736 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157886.log 2023-08-31T19:27:29.737 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149522.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.149522.log.gz 2023-08-31T19:27:29.737 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154746.log 2023-08-31T19:27:29.738 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157886.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.157886.log.gz 2023-08-31T19:27:29.738 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192447.log 2023-08-31T19:27:29.739 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154746.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154746.log.gz 2023-08-31T19:27:29.739 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153689.log 2023-08-31T19:27:29.740 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192447.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.192447.log.gz 2023-08-31T19:27:29.741 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182620.log 2023-08-31T19:27:29.741 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153689.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153689.log.gz 2023-08-31T19:27:29.742 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162827.log 2023-08-31T19:27:29.742 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182620.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182620.log.gz 2023-08-31T19:27:29.743 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160365.log 2023-08-31T19:27:29.744 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162827.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.162827.log.gz 2023-08-31T19:27:29.744 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186812.log 2023-08-31T19:27:29.745 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160365.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.160365.log.gz 2023-08-31T19:27:29.745 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200771.log 2023-08-31T19:27:29.746 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186812.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186812.log.gz 2023-08-31T19:27:29.747 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155633.log 2023-08-31T19:27:29.747 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200771.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.200771.log.gz 2023-08-31T19:27:29.748 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176828.log 2023-08-31T19:27:29.749 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155633.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.155633.log.gz 2023-08-31T19:27:29.749 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199273.log 2023-08-31T19:27:29.750 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176828.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176828.log.gz 2023-08-31T19:27:29.750 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200926.log 2023-08-31T19:27:29.751 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199273.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.199273.log.gz 2023-08-31T19:27:29.751 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176275.log 2023-08-31T19:27:29.752 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200926.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.200926.log.gz 2023-08-31T19:27:29.753 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174906.log 2023-08-31T19:27:29.753 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176275.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.176275.log.gz 2023-08-31T19:27:29.754 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187829.log 2023-08-31T19:27:29.755 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174906.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.174906.log.gz 2023-08-31T19:27:29.755 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187584.log 2023-08-31T19:27:29.756 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162983.log 2023-08-31T19:27:29.757 INFO:teuthology.orchestra.run.smithi072.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.187829.log.gz 2023-08-31T19:27:29.757 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187584.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.187584.log.gz 2023-08-31T19:27:29.758 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195692.log 2023-08-31T19:27:29.758 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162983.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.162983.log.gz 2023-08-31T19:27:29.759 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154550.log 2023-08-31T19:27:29.759 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195692.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.195692.log.gz 2023-08-31T19:27:29.760 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171638.log 2023-08-31T19:27:29.761 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154550.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154550.log.gz 2023-08-31T19:27:29.761 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157984.log 2023-08-31T19:27:29.762 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171638.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.171638.log.gz 2023-08-31T19:27:29.762 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197090.log 2023-08-31T19:27:29.763 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157984.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.157984.log.gz 2023-08-31T19:27:29.763 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179371.log 2023-08-31T19:27:29.765 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197090.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.197090.log.gz 2023-08-31T19:27:29.765 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172112.log 2023-08-31T19:27:29.766 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179371.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.179371.log.gz 2023-08-31T19:27:29.766 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161762.log 2023-08-31T19:27:29.767 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172112.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172112.log.gz 2023-08-31T19:27:29.768 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191461.log 2023-08-31T19:27:29.768 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161762.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.161762.log.gz 2023-08-31T19:27:29.769 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173367.log 2023-08-31T19:27:29.769 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191461.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191461.log.gz 2023-08-31T19:27:29.770 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-08-31T19:27:29.771 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173367.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.173367.log.gz 2023-08-31T19:27:29.771 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171957.log 2023-08-31T19:27:29.773 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191779.log 2023-08-31T19:27:29.774 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171957.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171957.log.gz 2023-08-31T19:27:29.774 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184249.log 2023-08-31T19:27:29.775 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149767.log 2023-08-31T19:27:29.776 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.191779.log.gz 2023-08-31T19:27:29.776 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184249.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.184249.log.gz 2023-08-31T19:27:29.777 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192190.log 2023-08-31T19:27:29.778 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192141.log 2023-08-31T19:27:29.778 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.149767.log.gz 2023-08-31T19:27:29.779 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192190.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.192190.log.gz 2023-08-31T19:27:29.779 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.165188.log 2023-08-31T19:27:29.780 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187272.log 2023-08-31T19:27:29.781 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192141.log.gz 2023-08-31T19:27:29.781 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.165188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.165188.log.gz 2023-08-31T19:27:29.782 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173573.log 2023-08-31T19:27:29.783 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177024.log 2023-08-31T19:27:29.783 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187272.log.gz 2023-08-31T19:27:29.784 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173573.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.173573.log.gz 2023-08-31T19:27:29.784 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156365.log 2023-08-31T19:27:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176975.log 2023-08-31T19:27:29.786 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177024.log.gz 2023-08-31T19:27:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156365.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156365.log.gz 2023-08-31T19:27:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.198185.log 2023-08-31T19:27:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168807.log 2023-08-31T19:27:29.788 INFO:teuthology.orchestra.run.smithi072.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.176975.log.gz 2023-08-31T19:27:29.789 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.198185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.198185.log.gz 2023-08-31T19:27:29.789 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191855.log 2023-08-31T19:27:29.791 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168143.log 2023-08-31T19:27:29.791 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168807.log.gz 2023-08-31T19:27:29.792 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191855.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191855.log.gz 2023-08-31T19:27:29.792 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-08-31T19:27:29.793 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168143.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168143.log.gz 2023-08-31T19:27:29.794 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199927.log 2023-08-31T19:27:29.795 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170262.log 2023-08-31T19:27:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199927.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.199927.log.gz 2023-08-31T19:27:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179964.log 2023-08-31T19:27:29.799 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170262.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.170262.log.gz-5 2023-08-31T19:27:29.799 INFO:teuthology.orchestra.run.smithi072.stderr:--verbose -- /var/log/ceph/ceph-client.admin.175174.log 2023-08-31T19:27:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179964.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179964.log.gz 2023-08-31T19:27:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149914.log 2023-08-31T19:27:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175174.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175174.log.gz 2023-08-31T19:27:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164023.log 2023-08-31T19:27:29.803 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149914.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149914.log.gz 2023-08-31T19:27:29.804 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172824.log 2023-08-31T19:27:29.804 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164023.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164023.log.gz 2023-08-31T19:27:29.805 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183410.log 2023-08-31T19:27:29.806 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172824.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.172824.log.gz 2023-08-31T19:27:29.807 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154795.log 2023-08-31T19:27:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183410.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.183410.log.gz 2023-08-31T19:27:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197731.log 2023-08-31T19:27:29.809 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154795.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154795.log.gz 2023-08-31T19:27:29.810 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195372.log 2023-08-31T19:27:29.811 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197731.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.197731.log.gz 2023-08-31T19:27:29.812 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150450.log 2023-08-31T19:27:29.813 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195372.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.195372.log.gz 2023-08-31T19:27:29.813 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173265.log 2023-08-31T19:27:29.814 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150450.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150450.log.gz 2023-08-31T19:27:29.815 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192288.log 2023-08-31T19:27:29.816 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173265.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.173265.log.gz 2023-08-31T19:27:29.816 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165294.log 2023-08-31T19:27:29.817 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192288.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192288.log.gz 2023-08-31T19:27:29.818 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161066.log 2023-08-31T19:27:29.819 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165294.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165294.log.gz 2023-08-31T19:27:29.819 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164270.log 2023-08-31T19:27:29.821 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161066.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.161066.log.gz 2023-08-31T19:27:29.821 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151908.log 2023-08-31T19:27:29.822 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164270.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164270.log.gz 2023-08-31T19:27:29.823 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187329.log 2023-08-31T19:27:29.824 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151908.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.151908.log.gz 2023-08-31T19:27:29.824 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195744.log 2023-08-31T19:27:29.826 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187329.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187329.log.gz 2023-08-31T19:27:29.826 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190988.log 2023-08-31T19:27:29.827 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195744.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.195744.log.gz 2023-08-31T19:27:29.828 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182567.log 2023-08-31T19:27:29.829 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190988.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190988.log.gz 2023-08-31T19:27:29.830 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153207.log 2023-08-31T19:27:29.830 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182567.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.182567.log.gz 2023-08-31T19:27:29.832 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168435.log 2023-08-31T19:27:29.832 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153207.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153207.log.gz 2023-08-31T19:27:29.833 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173769.log 2023-08-31T19:27:29.833 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168435.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.168435.log.gz 2023-08-31T19:27:29.834 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164438.log 2023-08-31T19:27:29.835 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173769.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.173769.log.gz 2023-08-31T19:27:29.836 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153787.log 2023-08-31T19:27:29.837 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164438.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164438.log.gz 2023-08-31T19:27:29.837 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176877.log 2023-08-31T19:27:29.838 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153787.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153787.log.gz 2023-08-31T19:27:29.839 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191143.log 2023-08-31T19:27:29.840 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176877.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.176877.log.gz 2023-08-31T19:27:29.840 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175277.log 2023-08-31T19:27:29.841 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191143.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.191143.log.gz 2023-08-31T19:27:29.842 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171486.log 2023-08-31T19:27:29.843 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175277.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175277.log.gz 2023-08-31T19:27:29.844 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196679.log 2023-08-31T19:27:29.845 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171486.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.171486.log.gz 2023-08-31T19:27:29.845 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180456.log 2023-08-31T19:27:29.846 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196679.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.196679.log.gz 2023-08-31T19:27:29.847 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151614.log 2023-08-31T19:27:29.848 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195960.log 2023-08-31T19:27:29.848 INFO:teuthology.orchestra.run.smithi072.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.180456.log.gz 2023-08-31T19:27:29.849 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151614.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151614.log.gz 2023-08-31T19:27:29.850 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178252.log 2023-08-31T19:27:29.851 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195960.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.195960.log.gz 2023-08-31T19:27:29.851 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183696.log 2023-08-31T19:27:29.852 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178252.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.178252.log.gz 2023-08-31T19:27:29.853 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195641.log 2023-08-31T19:27:29.854 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183696.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.183696.log.gz 2023-08-31T19:27:29.854 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184322.log 2023-08-31T19:27:29.855 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195641.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.195641.log.gz 2023-08-31T19:27:29.856 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156912.log 2023-08-31T19:27:29.857 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184322.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.184322.log.gz 2023-08-31T19:27:29.858 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179906.log 2023-08-31T19:27:29.858 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156912.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156912.log.gz 2023-08-31T19:27:29.859 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193699.log 2023-08-31T19:27:29.860 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179906.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179906.log.gz 2023-08-31T19:27:29.860 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151957.log 2023-08-31T19:27:29.862 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193699.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193699.log.gz 2023-08-31T19:27:29.862 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180062.log 2023-08-31T19:27:29.863 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151957.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151957.log.gz 2023-08-31T19:27:29.864 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163482.log 2023-08-31T19:27:29.865 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180062.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180062.log.gz 2023-08-31T19:27:29.865 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196903.log 2023-08-31T19:27:29.866 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163482.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163482.log.gz 2023-08-31T19:27:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179295.log 2023-08-31T19:27:29.868 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196903.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.196903.log.gz 2023-08-31T19:27:29.868 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172216.log 2023-08-31T19:27:29.870 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179295.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.179295.log.gz 2023-08-31T19:27:29.870 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187221.log 2023-08-31T19:27:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172216.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.172216.log.gz 2023-08-31T19:27:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.193246.log 2023-08-31T19:27:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187221.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.187221.log.gz 2023-08-31T19:27:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172699.log 2023-08-31T19:27:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.193246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.193246.log.gz 2023-08-31T19:27:29.876 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147623.log 2023-08-31T19:27:29.876 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172699.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.172699.log.gz 2023-08-31T19:27:29.877 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191411.log 2023-08-31T19:27:29.878 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147623.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147623.log.gz 2023-08-31T19:27:29.883 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165442.log 2023-08-31T19:27:29.883 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191411.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.191411.log.gz 2023-08-31T19:27:29.883 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190935.log 2023-08-31T19:27:29.884 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165442.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.165442.log.gz 2023-08-31T19:27:29.884 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180113.log 2023-08-31T19:27:29.884 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190935.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.190935.log.gz 2023-08-31T19:27:29.885 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192496.log 2023-08-31T19:27:29.885 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180113.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180113.log.gz 2023-08-31T19:27:29.885 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156638.log 2023-08-31T19:27:29.886 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192496.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192496.log.gz 2023-08-31T19:27:29.886 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153011.log 2023-08-31T19:27:29.887 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156638.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.156638.log.gz 2023-08-31T19:27:29.888 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187633.log 2023-08-31T19:27:29.889 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153011.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.153011.log.gz 2023-08-31T19:27:29.890 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172060.log 2023-08-31T19:27:29.891 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187633.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.187633.log.gz 2023-08-31T19:27:29.891 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196063.log 2023-08-31T19:27:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172060.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172060.log.gz 2023-08-31T19:27:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183236.log 2023-08-31T19:27:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196063.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.196063.log.gz 2023-08-31T19:27:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.188136.log 2023-08-31T19:27:29.896 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183236.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183236.log.gz 2023-08-31T19:27:29.897 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171689.log 2023-08-31T19:27:29.897 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.188136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.188136.log.gz 2023-08-31T19:27:29.898 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198662.log 2023-08-31T19:27:29.899 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171689.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171689.log.gz 2023-08-31T19:27:29.899 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168488.log 2023-08-31T19:27:29.900 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.198662.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.198662.log.gz 2023-08-31T19:27:29.900 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149816.log 2023-08-31T19:27:29.901 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168488.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.168488.log.gz 2023-08-31T19:27:29.902 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168651.log 2023-08-31T19:27:29.903 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149816.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149816.log.gz 2023-08-31T19:27:29.904 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192890.log 2023-08-31T19:27:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168651.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.168651.log.gz 2023-08-31T19:27:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192092.log 2023-08-31T19:27:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192890.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192890.log.gz 2023-08-31T19:27:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183509.log 2023-08-31T19:27:29.908 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192092.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.192092.log.gz 2023-08-31T19:27:29.908 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185080.log 2023-08-31T19:27:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183509.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183509.log.gz 2023-08-31T19:27:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150306.log 2023-08-31T19:27:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185080.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.185080.log.gz 2023-08-31T19:27:29.912 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165367.log 2023-08-31T19:27:29.913 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178363.log 2023-08-31T19:27:29.913 INFO:teuthology.orchestra.run.smithi072.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.150306.log.gz 2023-08-31T19:27:29.914 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165367.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.165367.log.gz 2023-08-31T19:27:29.915 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147795.log 2023-08-31T19:27:29.916 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178363.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178363.log.gz 2023-08-31T19:27:29.917 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199111.log 2023-08-31T19:27:29.917 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147795.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147795.log.gz 2023-08-31T19:27:29.918 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164487.log 2023-08-31T19:27:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199111.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.199111.log.gz 2023-08-31T19:27:29.920 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197041.log 2023-08-31T19:27:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164487.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164487.log.gz 2023-08-31T19:27:29.922 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199222.log 2023-08-31T19:27:29.923 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197041.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.197041.log.gz 2023-08-31T19:27:29.923 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168546.log 2023-08-31T19:27:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199222.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.199222.log.gz 2023-08-31T19:27:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152349.log 2023-08-31T19:27:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168546.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168546.log.gz 2023-08-31T19:27:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174803.log 2023-08-31T19:27:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152349.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.152349.log.gz 2023-08-31T19:27:29.928 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197633.log 2023-08-31T19:27:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174803.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174803.log.gz 2023-08-31T19:27:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172430.log 2023-08-31T19:27:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197633.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.197633.log.gz 2023-08-31T19:27:29.932 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158204.log 2023-08-31T19:27:29.932 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172430.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172430.log.gz 2023-08-31T19:27:29.933 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183843.log 2023-08-31T19:27:29.934 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158204.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.158204.log.gz 2023-08-31T19:27:29.934 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162459.log 2023-08-31T19:27:29.935 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183843.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.183843.log.gz 2023-08-31T19:27:29.936 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152594.log 2023-08-31T19:27:29.937 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162459.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162459.log.gz 2023-08-31T19:27:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191608.log 2023-08-31T19:27:29.938 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152594.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152594.log.gz 2023-08-31T19:27:29.939 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184051.log 2023-08-31T19:27:29.940 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191608.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.191608.log.gz 2023-08-31T19:27:29.941 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179197.log 2023-08-31T19:27:29.942 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184051.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.184051.log.gz 2023-08-31T19:27:29.942 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158780.log 2023-08-31T19:27:29.943 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179197.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.179197.log.gz 2023-08-31T19:27:29.944 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152055.log 2023-08-31T19:27:29.945 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158780.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158780.log.gz 2023-08-31T19:27:29.945 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183745.log 2023-08-31T19:27:29.946 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152055.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.152055.log.gz 2023-08-31T19:27:29.947 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152300.log 2023-08-31T19:27:29.948 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183745.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.183745.log.gz 2023-08-31T19:27:29.949 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158564.log 2023-08-31T19:27:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152300.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.152300.log.gz 2023-08-31T19:27:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179855.log 2023-08-31T19:27:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158564.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.158564.log.gz 2023-08-31T19:27:29.952 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176373.log 2023-08-31T19:27:29.953 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179855.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.179855.log.gz 2023-08-31T19:27:29.953 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155048.log 2023-08-31T19:27:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176373.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176373.log.gz 2023-08-31T19:27:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178304.log 2023-08-31T19:27:29.956 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149326.log 2023-08-31T19:27:29.957 INFO:teuthology.orchestra.run.smithi072.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.155048.log.gz 2023-08-31T19:27:29.958 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178304.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.178304.log.gz 2023-08-31T19:27:29.958 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168702.log 2023-08-31T19:27:29.959 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149326.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.149326.log.gz 2023-08-31T19:27:29.960 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197486.log 2023-08-31T19:27:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168702.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.168702.log.gz 2023-08-31T19:27:29.962 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185654.log 2023-08-31T19:27:29.963 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197486.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.197486.log.gz 2023-08-31T19:27:29.963 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164332.log 2023-08-31T19:27:29.964 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185654.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.185654.log.gz 2023-08-31T19:27:29.965 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169809.log 2023-08-31T19:27:29.966 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164332.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164332.log.gz 2023-08-31T19:27:29.966 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195907.log 2023-08-31T19:27:29.968 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169809.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169809.log.gz 2023-08-31T19:27:29.968 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199731.log 2023-08-31T19:27:29.969 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195907.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.195907.log.gz 2023-08-31T19:27:29.970 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157837.log 2023-08-31T19:27:29.971 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199731.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.199731.log.gz 2023-08-31T19:27:29.971 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185921.log 2023-08-31T19:27:29.973 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157837.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.157837.log.gz 2023-08-31T19:27:29.973 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165641.log 2023-08-31T19:27:29.974 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185921.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.185921.log.gz 2023-08-31T19:27:29.974 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155927.log 2023-08-31T19:27:29.976 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165641.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.165641.log.gz-5 2023-08-31T19:27:29.976 INFO:teuthology.orchestra.run.smithi072.stderr:--verbose -- /var/log/ceph/ceph-client.admin.170607.log 2023-08-31T19:27:29.977 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155927.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155927.log.gz 2023-08-31T19:27:29.977 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162111.log 2023-08-31T19:27:29.979 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170607.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170607.log.gz 2023-08-31T19:27:29.979 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173118.log 2023-08-31T19:27:29.980 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162111.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.162111.log.gz 2023-08-31T19:27:29.981 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192841.log 2023-08-31T19:27:29.982 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173118.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.173118.log.gz 2023-08-31T19:27:29.982 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174402.log 2023-08-31T19:27:29.983 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192841.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192841.log.gz 2023-08-31T19:27:29.984 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172931.log 2023-08-31T19:27:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174402.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174402.log.gz 2023-08-31T19:27:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183334.log 2023-08-31T19:27:29.987 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172931.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.172931.log.gz 2023-08-31T19:27:29.987 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151761.log 2023-08-31T19:27:29.988 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183334.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.183334.log.gz 2023-08-31T19:27:29.988 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158106.log 2023-08-31T19:27:29.990 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151761.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151761.log.gz 2023-08-31T19:27:29.990 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176630.log 2023-08-31T19:27:29.991 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158106.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.158106.log.gz 2023-08-31T19:27:29.992 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184883.log 2023-08-31T19:27:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176630.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.176630.log.gz 2023-08-31T19:27:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190053.log 2023-08-31T19:27:29.995 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184883.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184883.log.gz 2023-08-31T19:27:29.995 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155461.log 2023-08-31T19:27:29.996 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190053.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.190053.log.gz 2023-08-31T19:27:29.996 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182463.log 2023-08-31T19:27:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155461.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155461.log.gz 2023-08-31T19:27:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169597.log 2023-08-31T19:27:29.999 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182463.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.182463.log.gz 2023-08-31T19:27:30.000 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173216.log 2023-08-31T19:27:30.001 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169597.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.169597.log.gz 2023-08-31T19:27:30.001 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158348.log 2023-08-31T19:27:30.003 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173216.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173216.log.gz 2023-08-31T19:27:30.003 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184932.log 2023-08-31T19:27:30.004 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158348.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158348.log.gz 2023-08-31T19:27:30.004 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176324.log 2023-08-31T19:27:30.006 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184932.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.184932.log.gz 2023-08-31T19:27:30.006 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173069.log 2023-08-31T19:27:30.008 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176324.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176324.log.gz 2023-08-31T19:27:30.008 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170411.log 2023-08-31T19:27:30.009 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173069.log: 88.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.173069.log.gz--verbose 2023-08-31T19:27:30.009 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.149179.log 2023-08-31T19:27:30.010 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170411.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170411.log.gz 2023-08-31T19:27:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148787.log 2023-08-31T19:27:30.012 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149179.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.149179.log.gz 2023-08-31T19:27:30.013 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153934.log 2023-08-31T19:27:30.014 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148787.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.148787.log.gz 2023-08-31T19:27:30.014 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174965.log 2023-08-31T19:27:30.015 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153934.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153934.log.gz 2023-08-31T19:27:30.016 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196168.log 2023-08-31T19:27:30.018 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174965.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174965.log.gz 2023-08-31T19:27:30.018 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186024.log 2023-08-31T19:27:30.019 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196168.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.196168.log.gz 2023-08-31T19:27:30.019 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201294.log 2023-08-31T19:27:30.020 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186024.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186024.log.gz 2023-08-31T19:27:30.021 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153060.log 2023-08-31T19:27:30.022 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.201294.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.201294.log.gz 2023-08-31T19:27:30.022 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186999.log 2023-08-31T19:27:30.024 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153060.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.153060.log.gz 2023-08-31T19:27:30.024 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152815.log 2023-08-31T19:27:30.025 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186999.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.186999.log.gz 2023-08-31T19:27:30.025 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178580.log 2023-08-31T19:27:30.027 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152815.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152815.log.gz 2023-08-31T19:27:30.027 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187535.log 2023-08-31T19:27:30.028 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178580.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.178580.log.gz 2023-08-31T19:27:30.029 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158155.log 2023-08-31T19:27:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187535.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187535.log.gz 2023-08-31T19:27:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162775.log 2023-08-31T19:27:30.032 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158155.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.158155.log.gz 2023-08-31T19:27:30.032 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175069.log 2023-08-31T19:27:30.033 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162775.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.162775.log.gz 2023-08-31T19:27:30.034 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164685.log 2023-08-31T19:27:30.035 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175069.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.175069.log.gz 2023-08-31T19:27:30.036 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149130.log 2023-08-31T19:27:30.036 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164685.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164685.log.gz 2023-08-31T19:27:30.037 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156588.log 2023-08-31T19:27:30.038 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149130.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149130.log.gz 2023-08-31T19:27:30.038 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176088.log 2023-08-31T19:27:30.040 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156588.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.156588.log.gz 2023-08-31T19:27:30.040 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152251.log 2023-08-31T19:27:30.041 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176088.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.176088.log.gz 2023-08-31T19:27:30.042 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178416.log 2023-08-31T19:27:30.043 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152251.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152251.log.gz 2023-08-31T19:27:30.043 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170753.log 2023-08-31T19:27:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178416.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.178416.log.gz 2023-08-31T19:27:30.045 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199481.log 2023-08-31T19:27:30.046 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170753.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170753.log.gz 2023-08-31T19:27:30.047 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192239.log 2023-08-31T19:27:30.048 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199481.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.199481.log.gz 2023-08-31T19:27:30.048 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173818.log 2023-08-31T19:27:30.049 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192239.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.192239.log.gz 2023-08-31T19:27:30.050 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195855.log 2023-08-31T19:27:30.051 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173818.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.173818.log.gz 2023-08-31T19:27:30.051 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169907.log 2023-08-31T19:27:30.052 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195855.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.195855.log.gz 2023-08-31T19:27:30.053 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179148.log 2023-08-31T19:27:30.054 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169907.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169907.log.gz 2023-08-31T19:27:30.054 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186078.log 2023-08-31T19:27:30.056 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179148.log: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.179148.log.gz--verbose 2023-08-31T19:27:30.056 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.156146.log 2023-08-31T19:27:30.057 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186078.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.186078.log.gz 2023-08-31T19:27:30.058 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148338.log 2023-08-31T19:27:30.059 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156146.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156146.log.gz 2023-08-31T19:27:30.059 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200232.log 2023-08-31T19:27:30.060 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148338.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148338.log.gz 2023-08-31T19:27:30.061 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.151507.log 2023-08-31T19:27:30.062 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200232.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.200232.log.gz 2023-08-31T19:27:30.063 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180211.log 2023-08-31T19:27:30.064 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.2.151507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.151507.log.gz 2023-08-31T19:27:30.064 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168598.log 2023-08-31T19:27:30.066 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180211.log: gzip 88.6%-5 -- replaced with /var/log/ceph/ceph-client.admin.180211.log.gz--verbose 2023-08-31T19:27:30.066 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.185713.log 2023-08-31T19:27:30.067 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168598.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.168598.log.gz 2023-08-31T19:27:30.068 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200477.log 2023-08-31T19:27:30.068 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185713.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185713.log.gz 2023-08-31T19:27:30.069 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182301.log 2023-08-31T19:27:30.070 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200477.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.200477.log.gz 2023-08-31T19:27:30.071 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158636.log 2023-08-31T19:27:30.072 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182301.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.182301.log.gz 2023-08-31T19:27:30.072 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178467.log 2023-08-31T19:27:30.074 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158636.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158636.log.gz 2023-08-31T19:27:30.074 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158973.log 2023-08-31T19:27:30.077 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178467.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.178467.log.gz 2023-08-31T19:27:30.077 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176226.log 2023-08-31T19:27:30.078 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158973.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.158973.log.gz 2023-08-31T19:27:30.078 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186636.log 2023-08-31T19:27:30.079 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176226.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176226.log.gz 2023-08-31T19:27:30.079 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154697.log 2023-08-31T19:27:30.080 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186636.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186636.log.gz 2023-08-31T19:27:30.080 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199829.log 2023-08-31T19:27:30.081 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154697.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.154697.log.gz 2023-08-31T19:27:30.082 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164072.log 2023-08-31T19:27:30.083 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199829.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.199829.log.gz 2023-08-31T19:27:30.083 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170105.log 2023-08-31T19:27:30.084 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164072.log: gzip 88.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.164072.log.gz-- 2023-08-31T19:27:30.085 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190832.log 2023-08-31T19:27:30.086 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170105.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170105.log.gz 2023-08-31T19:27:30.086 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163384.log 2023-08-31T19:27:30.088 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190832.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.190832.log.gz 2023-08-31T19:27:30.088 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186901.log 2023-08-31T19:27:30.089 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163384.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163384.log.gz 2023-08-31T19:27:30.089 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177121.log 2023-08-31T19:27:30.091 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186901.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.186901.log.gz 2023-08-31T19:27:30.091 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175864.log 2023-08-31T19:27:30.093 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177121.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.177121.log.gz 2023-08-31T19:27:30.093 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192743.log 2023-08-31T19:27:30.094 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175864.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.175864.log.gz 2023-08-31T19:27:30.094 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192545.log 2023-08-31T19:27:30.096 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192743.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192743.log.gz 2023-08-31T19:27:30.096 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191247.log 2023-08-31T19:27:30.097 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192545.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.192545.log.gz 2023-08-31T19:27:30.097 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156073.log 2023-08-31T19:27:30.099 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191247.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.191247.log.gz 2023-08-31T19:27:30.099 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153452.log 2023-08-31T19:27:30.100 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156073.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156073.log.gz 2023-08-31T19:27:30.101 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148093.log 2023-08-31T19:27:30.102 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153452.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153452.log.gz 2023-08-31T19:27:30.102 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193500.log 2023-08-31T19:27:30.103 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148093.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148093.log.gz 2023-08-31T19:27:30.104 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157935.log 2023-08-31T19:27:30.105 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193500.log: 88.9%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.193500.log.gz--verbose 2023-08-31T19:27:30.105 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.197682.log 2023-08-31T19:27:30.107 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157935.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.157935.log.gz 2023-08-31T19:27:30.107 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150061.log 2023-08-31T19:27:30.108 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197682.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.197682.log.gz 2023-08-31T19:27:30.109 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193749.log 2023-08-31T19:27:30.110 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150061.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150061.log.gz 2023-08-31T19:27:30.111 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164929.log 2023-08-31T19:27:30.111 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193749.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.193749.log.gz 2023-08-31T19:27:30.112 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-08-31T19:27:30.113 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198856.log 2023-08-31T19:27:30.114 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164929.log.gz 2023-08-31T19:27:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-08-31T19:27:30.117 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.198856.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.198856.log.gz 2023-08-31T19:27:30.117 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179050.log 2023-08-31T19:27:30.119 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186489.log 2023-08-31T19:27:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179050.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.179050.log.gz 2023-08-31T19:27:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187378.log 2023-08-31T19:27:30.122 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186489.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.186489.log.gz 2023-08-31T19:27:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170705.log 2023-08-31T19:27:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187378.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.187378.log.gz 2023-08-31T19:27:30.125 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196012.log 2023-08-31T19:27:30.126 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170705.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.170705.log.gz 2023-08-31T19:27:30.128 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187877.log 2023-08-31T19:27:30.128 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196012.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.196012.log.gz 2023-08-31T19:27:30.129 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182411.log 2023-08-31T19:27:30.130 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187877.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.187877.log.gz 2023-08-31T19:27:30.131 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187780.log 2023-08-31T19:27:30.131 INFO:teuthology.orchestra.run.smithi072.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.182411.log.gz 2023-08-31T19:27:30.133 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173720.log 2023-08-31T19:27:30.134 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187780.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.187780.log.gz 2023-08-31T19:27:30.136 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173671.log 2023-08-31T19:27:30.136 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173720.log.gz 2023-08-31T19:27:30.138 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173671.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.173671.log.gz 2023-08-31T19:27:30.139 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168964.log 2023-08-31T19:27:30.141 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201122.log 2023-08-31T19:27:30.142 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168964.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.168964.log.gz 2023-08-31T19:27:30.143 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184566.log 2023-08-31T19:27:30.144 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.201122.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.201122.log.gz 2023-08-31T19:27:30.145 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184566.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.184566.log.gz 2023-08-31T19:27:30.146 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183647.log 2023-08-31T19:27:30.149 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149473.log 2023-08-31T19:27:30.149 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183647.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.183647.log.gz 2023-08-31T19:27:30.150 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149473.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.149473.log.gz 2023-08-31T19:27:30.151 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183040.log 2023-08-31T19:27:30.154 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183040.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183040.log.gz 2023-08-31T19:27:30.154 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200330.log 2023-08-31T19:27:30.157 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200330.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.200330.log.gz 2023-08-31T19:27:30.157 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183138.log 2023-08-31T19:27:30.160 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183138.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183138.log.gz 2023-08-31T19:27:30.161 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179657.log 2023-08-31T19:27:30.163 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179657.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179657.log.gz 2023-08-31T19:27:30.164 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179608.log 2023-08-31T19:27:30.168 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162878.log 2023-08-31T19:27:30.168 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179608.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179608.log.gz 2023-08-31T19:27:30.169 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162878.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.162878.log.gz 2023-08-31T19:27:30.169 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155534.log 2023-08-31T19:27:30.172 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168859.log 2023-08-31T19:27:30.173 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155534.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.155534.log.gz 2023-08-31T19:27:30.173 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168859.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168859.log.gz 2023-08-31T19:27:30.174 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196383.log 2023-08-31T19:27:30.177 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171069.log 2023-08-31T19:27:30.177 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174223.log 2023-08-31T19:27:30.178 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.196383.log.gz 2023-08-31T19:27:30.179 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171069.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171069.log.gz 2023-08-31T19:27:30.180 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-08-31T19:27:30.181 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.174223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.174223.log.gz 2023-08-31T19:27:30.190 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164219.log 2023-08-31T19:27:30.193 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164219.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164219.log.gz 2023-08-31T19:27:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152913.log 2023-08-31T19:27:30.198 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185550.log 2023-08-31T19:27:30.198 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152913.log.gz 2023-08-31T19:27:30.201 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201390.log 2023-08-31T19:27:30.202 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.185550.log.gz 2023-08-31T19:27:30.204 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.201390.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.201390.log.gz 2023-08-31T19:27:30.205 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173316.log 2023-08-31T19:27:30.208 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173316.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173316.log.gz 2023-08-31T19:27:30.208 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188612.log 2023-08-31T19:27:30.212 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190773.log 2023-08-31T19:27:30.212 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.188612.log.gz 2023-08-31T19:27:30.216 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192939.log 2023-08-31T19:27:30.216 INFO:teuthology.orchestra.run.smithi072.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.190773.log.gz 2023-08-31T19:27:30.220 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156000.log 2023-08-31T19:27:30.221 INFO:teuthology.orchestra.run.smithi072.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.192939.log.gz 2023-08-31T19:27:30.224 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175989.log 2023-08-31T19:27:30.225 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156000.log.gz 2023-08-31T19:27:30.226 INFO:teuthology.orchestra.run.smithi146.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-08-31T19:27:30.228 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149669.log 2023-08-31T19:27:30.228 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175989.log.gz 2023-08-31T19:27:30.232 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169014.log 2023-08-31T19:27:30.232 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149669.log.gz 2023-08-31T19:27:30.236 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200624.log 2023-08-31T19:27:30.237 INFO:teuthology.orchestra.run.smithi072.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.169014.log.gz 2023-08-31T19:27:30.240 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169276.log 2023-08-31T19:27:30.240 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.200624.log.gz 2023-08-31T19:27:30.244 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169276.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169276.log.gz 2023-08-31T19:27:30.244 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153551.log 2023-08-31T19:27:30.247 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162611.log 2023-08-31T19:27:30.248 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153551.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.153551.log.gz 2023-08-31T19:27:30.251 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170460.log 2023-08-31T19:27:30.251 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162611.log.gz 2023-08-31T19:27:30.260 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182776.log 2023-08-31T19:27:30.261 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.170460.log.gz 2023-08-31T19:27:30.264 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.150969.log 2023-08-31T19:27:30.264 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.182776.log.gz 2023-08-31T19:27:30.268 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.150969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151810.log 2023-08-31T19:27:30.268 INFO:teuthology.orchestra.run.smithi072.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.150969.log.gz 2023-08-31T19:27:30.272 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178049.log 2023-08-31T19:27:30.272 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.151810.log.gz 2023-08-31T19:27:30.275 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147574.log 2023-08-31T19:27:30.276 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.178049.log.gz 2023-08-31T19:27:30.282 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147486.log 2023-08-31T19:27:30.282 INFO:teuthology.orchestra.run.smithi072.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.147574.log.gz 2023-08-31T19:27:30.283 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158276.log 2023-08-31T19:27:30.284 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147486.log.gz 2023-08-31T19:27:30.284 INFO:teuthology.orchestra.run.smithi072.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-08-31T19:27:30.287 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158276.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158276.log.gz 2023-08-31T19:27:30.287 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170311.log 2023-08-31T19:27:30.290 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170311.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.170311.log.gz 2023-08-31T19:27:30.291 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193303.log 2023-08-31T19:27:30.294 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193303.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.193303.log.gz 2023-08-31T19:27:30.294 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149081.log 2023-08-31T19:27:30.296 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149081.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149081.log.gz 2023-08-31T19:27:30.297 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-31T19:27:30.305 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.log: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-08-31T19:27:30.305 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175619.log 2023-08-31T19:27:30.309 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156292.log 2023-08-31T19:27:30.309 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175619.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175619.log.gz 2023-08-31T19:27:30.310 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156292.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156292.log.gz 2023-08-31T19:27:30.310 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197878.log 2023-08-31T19:27:30.313 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197878.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.197878.log.gz 2023-08-31T19:27:30.314 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164587.log 2023-08-31T19:27:30.317 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164587.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.164587.log.gz 2023-08-31T19:27:30.318 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191510.log 2023-08-31T19:27:30.320 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191510.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.191510.log.gz 2023-08-31T19:27:30.320 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176679.log 2023-08-31T19:27:30.324 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163335.log 2023-08-31T19:27:30.324 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176679.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176679.log.gz 2023-08-31T19:27:30.325 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163335.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.163335.log.gz 2023-08-31T19:27:30.325 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198712.log 2023-08-31T19:27:30.327 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170054.log 2023-08-31T19:27:30.328 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.198712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164832.log 2023-08-31T19:27:30.329 INFO:teuthology.orchestra.run.smithi072.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.198712.log.gz 2023-08-31T19:27:30.330 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170054.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.170054.log.gz 2023-08-31T19:27:30.333 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164832.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164832.log.gz 2023-08-31T19:27:30.333 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156738.log 2023-08-31T19:27:30.336 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156738.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.156738.log.gz 2023-08-31T19:27:30.336 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172650.log 2023-08-31T19:27:30.340 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170156.log 2023-08-31T19:27:30.340 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172650.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172650.log.gz 2023-08-31T19:27:30.341 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170156.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.170156.log.gz 2023-08-31T19:27:30.342 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176177.log 2023-08-31T19:27:30.344 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176177.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.176177.log.gz 2023-08-31T19:27:30.344 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149424.log 2023-08-31T19:27:30.347 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149424.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.149424.log.gz 2023-08-31T19:27:30.348 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190516.log 2023-08-31T19:27:30.351 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185005.log 2023-08-31T19:27:30.351 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190516.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.190516.log.gz 2023-08-31T19:27:30.352 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185005.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.185005.log.gz 2023-08-31T19:27:30.352 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197339.log 2023-08-31T19:27:30.356 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184002.log 2023-08-31T19:27:30.356 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197339.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.197339.log.gz 2023-08-31T19:27:30.357 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184002.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.184002.log.gz 2023-08-31T19:27:30.357 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148240.log 2023-08-31T19:27:30.359 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148240.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148240.log.gz 2023-08-31T19:27:30.360 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170362.log 2023-08-31T19:27:30.363 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170362.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170362.log.gz 2023-08-31T19:27:30.363 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188242.log 2023-08-31T19:27:30.366 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188242.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.188242.log.gz 2023-08-31T19:27:30.366 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201341.log 2023-08-31T19:27:30.369 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.201341.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.201341.log.gz 2023-08-31T19:27:30.370 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174454.log 2023-08-31T19:27:30.372 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174454.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.174454.log.gz 2023-08-31T19:27:30.373 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182722.log 2023-08-31T19:27:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182722.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182722.log.gz 2023-08-31T19:27:30.376 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192339.log 2023-08-31T19:27:30.378 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192339.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.192339.log.gz 2023-08-31T19:27:30.379 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197288.log 2023-08-31T19:27:30.382 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178736.log 2023-08-31T19:27:30.383 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197288.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.197288.log.gz 2023-08-31T19:27:30.383 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197237.log 2023-08-31T19:27:30.384 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178736.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.178736.log.gz 2023-08-31T19:27:30.387 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197237.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.197237.log.gz 2023-08-31T19:27:30.387 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163877.log 2023-08-31T19:27:30.388 INFO:teuthology.orchestra.run.smithi146.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-08-31T19:27:30.389 INFO:teuthology.orchestra.run.smithi146.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-08-31T19:27:30.391 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173964.log 2023-08-31T19:27:30.391 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163877.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.163877.log.gz 2023-08-31T19:27:30.392 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173964.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.173964.log.gz 2023-08-31T19:27:30.392 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200575.log 2023-08-31T19:27:30.396 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174651.log 2023-08-31T19:27:30.396 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200575.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.200575.log.gz 2023-08-31T19:27:30.396 INFO:teuthology.orchestra.run.smithi072.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-08-31T19:27:30.397 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174651.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174651.log.gz 2023-08-31T19:27:30.397 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200975.log 2023-08-31T19:27:30.399 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192987.log 2023-08-31T19:27:30.400 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200975.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.200975.log.gz 2023-08-31T19:27:30.402 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192987.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.192987.log.gz 2023-08-31T19:27:30.402 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148836.log 2023-08-31T19:27:30.403 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180820.log 2023-08-31T19:27:30.405 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148836.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148836.log.gz 2023-08-31T19:27:30.406 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164389.log 2023-08-31T19:27:30.406 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180820.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.180820.log.gz 2023-08-31T19:27:30.407 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177073.log 2023-08-31T19:27:30.408 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164389.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.164389.log.gz 2023-08-31T19:27:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177073.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.177073.log.gz 2023-08-31T19:27:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150159.log 2023-08-31T19:27:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149375.log 2023-08-31T19:27:30.416 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150159.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150159.log.gz 2023-08-31T19:27:30.416 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156538.log 2023-08-31T19:27:30.416 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149375.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.149375.log.gz 2023-08-31T19:27:30.417 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154203.log 2023-08-31T19:27:30.419 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156538.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.156538.log.gz 2023-08-31T19:27:30.419 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170558.log 2023-08-31T19:27:30.420 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154203.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154203.log.gz 2023-08-31T19:27:30.420 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154901.log 2023-08-31T19:27:30.420 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170558.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170558.log.gz 2023-08-31T19:27:30.421 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154901.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.154901.log.gz 2023-08-31T19:27:30.422 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185279.log 2023-08-31T19:27:30.423 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171118.log 2023-08-31T19:27:30.424 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185279.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.185279.log.gz 2023-08-31T19:27:30.426 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171118.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.171118.log.gz 2023-08-31T19:27:30.426 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197188.log 2023-08-31T19:27:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152864.log 2023-08-31T19:27:30.429 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197188.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.197188.log.gz 2023-08-31T19:27:30.430 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152864.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152864.log.gz 2023-08-31T19:27:30.431 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185816.log 2023-08-31T19:27:30.433 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193352.log 2023-08-31T19:27:30.434 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185816.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185816.log.gz 2023-08-31T19:27:30.436 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193352.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.193352.log.gz 2023-08-31T19:27:30.436 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185765.log 2023-08-31T19:27:30.437 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189377.log 2023-08-31T19:27:30.439 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185765.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.185765.log.gz 2023-08-31T19:27:30.440 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189377.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189377.log.gz 2023-08-31T19:27:30.441 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199326.log 2023-08-31T19:27:30.442 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156962.log 2023-08-31T19:27:30.444 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199326.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.199326.log.gz 2023-08-31T19:27:30.445 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156962.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.156962.log.gz 2023-08-31T19:27:30.445 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152006.log 2023-08-31T19:27:30.447 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172166.log 2023-08-31T19:27:30.448 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152006.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152006.log.gz 2023-08-31T19:27:30.450 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172166.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.172166.log.gz 2023-08-31T19:27:30.450 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152962.log 2023-08-31T19:27:30.452 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175766.log 2023-08-31T19:27:30.453 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152962.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.152962.log.gz 2023-08-31T19:27:30.454 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175766.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175766.log.gz 2023-08-31T19:27:30.455 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177810.log 2023-08-31T19:27:30.456 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153885.log 2023-08-31T19:27:30.458 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177810.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177810.log.gz 2023-08-31T19:27:30.459 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153885.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.153885.log.gz 2023-08-31T19:27:30.460 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158420.log 2023-08-31T19:27:30.461 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154999.log 2023-08-31T19:27:30.462 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158420.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158420.log.gz 2023-08-31T19:27:30.464 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154999.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.154999.log.gz 2023-08-31T19:27:30.464 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186950.log 2023-08-31T19:27:30.466 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169472.log 2023-08-31T19:27:30.467 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186950.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.186950.log.gz 2023-08-31T19:27:30.468 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169472.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.169472.log.gz 2023-08-31T19:27:30.469 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143461.log 2023-08-31T19:27:30.471 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173522.log 2023-08-31T19:27:30.472 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143461.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143461.log.gz 2023-08-31T19:27:30.473 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173522.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173522.log.gz 2023-08-31T19:27:30.474 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169858.log 2023-08-31T19:27:30.475 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147269.log 2023-08-31T19:27:30.477 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169858.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.169858.log.gz 2023-08-31T19:27:30.478 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147269.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147269.log.gz 2023-08-31T19:27:30.479 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182990.log 2023-08-31T19:27:30.480 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189328.log 2023-08-31T19:27:30.481 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182990.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.182990.log.gz 2023-08-31T19:27:30.485 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189328.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.189328.log.gz 2023-08-31T19:27:30.486 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148591.log 2023-08-31T19:27:30.486 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180407.log 2023-08-31T19:27:30.486 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148591.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148591.log.gz 2023-08-31T19:27:30.488 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180407.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180407.log.gz 2023-08-31T19:27:30.488 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187486.log 2023-08-31T19:27:30.490 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168756.log 2023-08-31T19:27:30.491 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187486.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.187486.log.gz 2023-08-31T19:27:30.492 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168756.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.168756.log.gz 2023-08-31T19:27:30.493 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156688.log 2023-08-31T19:27:30.494 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179559.log 2023-08-31T19:27:30.496 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156688.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156688.log.gz 2023-08-31T19:27:30.497 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179559.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179559.log.gz 2023-08-31T19:27:30.498 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148289.log 2023-08-31T19:27:30.499 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171012.log 2023-08-31T19:27:30.500 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148289.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148289.log.gz 2023-08-31T19:27:30.501 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.171012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.171012.log.gz 2023-08-31T19:27:30.502 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152202.log 2023-08-31T19:27:30.503 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151565.log 2023-08-31T19:27:30.505 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152202.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152202.log.gz 2023-08-31T19:27:30.506 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151565.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151565.log.gz 2023-08-31T19:27:30.507 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195490.log 2023-08-31T19:27:30.508 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148485.log 2023-08-31T19:27:30.510 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195490.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.195490.log.gz 2023-08-31T19:27:30.511 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148485.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.148485.log.gz 2023-08-31T19:27:30.512 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193425.log 2023-08-31T19:27:30.513 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185869.log 2023-08-31T19:27:30.515 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193425.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.193425.log.gz 2023-08-31T19:27:30.517 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185869.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.185869.log.gz 2023-08-31T19:27:30.517 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153109.log 2023-08-31T19:27:30.518 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172552.log 2023-08-31T19:27:30.519 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153109.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153109.log.gz 2023-08-31T19:27:30.521 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172552.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172552.log.gz 2023-08-31T19:27:30.521 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153640.log 2023-08-31T19:27:30.523 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196482.log 2023-08-31T19:27:30.524 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153640.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.153640.log.gz 2023-08-31T19:27:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196482.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.196482.log.gz 2023-08-31T19:27:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183089.log 2023-08-31T19:27:30.528 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173020.log 2023-08-31T19:27:30.529 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183089.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.183089.log.gz 2023-08-31T19:27:30.530 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173020.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.173020.log.gz 2023-08-31T19:27:30.531 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182826.log 2023-08-31T19:27:30.534 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196992.log 2023-08-31T19:27:30.535 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182826.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182826.log.gz 2023-08-31T19:27:30.535 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196992.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.196992.log.gz 2023-08-31T19:27:30.536 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192596.log 2023-08-31T19:27:30.539 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177611.log 2023-08-31T19:27:30.539 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192596.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.192596.log.gz 2023-08-31T19:27:30.540 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177611.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.177611.log.gz 2023-08-31T19:27:30.541 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163433.log 2023-08-31T19:27:30.542 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170213.log 2023-08-31T19:27:30.546 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163433.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163433.log.gz 2023-08-31T19:27:30.546 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154648.log 2023-08-31T19:27:30.546 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170213.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.170213.log.gz 2023-08-31T19:27:30.546 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151663.log 2023-08-31T19:27:30.549 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154648.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154648.log.gz 2023-08-31T19:27:30.549 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191559.log 2023-08-31T19:27:30.549 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151663.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151663.log.gz 2023-08-31T19:27:30.550 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171853.log 2023-08-31T19:27:30.550 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191559.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191559.log.gz 2023-08-31T19:27:30.551 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171853.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171853.log.gz 2023-08-31T19:27:30.552 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197926.log 2023-08-31T19:27:30.553 INFO:teuthology.orchestra.run.smithi072.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-08-31T19:27:30.553 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152496.log 2023-08-31T19:27:30.554 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.197926.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.197926.log.gz 2023-08-31T19:27:30.555 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172479.log 2023-08-31T19:27:30.557 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184200.log 2023-08-31T19:27:30.557 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.152496.log.gz 2023-08-31T19:27:30.557 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172479.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172479.log.gz 2023-08-31T19:27:30.558 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175913.log 2023-08-31T19:27:30.560 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152398.log 2023-08-31T19:27:30.560 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.184200.log.gz 2023-08-31T19:27:30.560 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175913.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.175913.log.gz 2023-08-31T19:27:30.561 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157737.log 2023-08-31T19:27:30.563 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152153.log 2023-08-31T19:27:30.563 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.152398.log.gz 2023-08-31T19:27:30.563 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157737.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157737.log.gz 2023-08-31T19:27:30.564 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183598.log 2023-08-31T19:27:30.565 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181041.log 2023-08-31T19:27:30.565 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152153.log.gz 2023-08-31T19:27:30.566 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183598.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183598.log.gz 2023-08-31T19:27:30.566 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178951.log 2023-08-31T19:27:30.567 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196532.log 2023-08-31T19:27:30.568 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.181041.log.gz 2023-08-31T19:27:30.568 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178951.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178951.log.gz 2023-08-31T19:27:30.568 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162722.log 2023-08-31T19:27:30.570 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177559.log 2023-08-31T19:27:30.571 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.196532.log.gz 2023-08-31T19:27:30.571 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162722.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.162722.log.gz 2023-08-31T19:27:30.572 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150110.log 2023-08-31T19:27:30.573 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153738.log 2023-08-31T19:27:30.573 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.177559.log.gz 2023-08-31T19:27:30.574 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150110.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.150110.log.gz 2023-08-31T19:27:30.574 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163086.log 2023-08-31T19:27:30.575 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153738.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-08-31T19:27:30.575 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153738.log.gz 2023-08-31T19:27:30.576 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163086.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163086.log.gz 2023-08-31T19:27:30.577 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200526.log 2023-08-31T19:27:30.580 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191730.log 2023-08-31T19:27:30.580 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200526.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.200526.log.gz 2023-08-31T19:27:30.581 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191730.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.191730.log.gz 2023-08-31T19:27:30.582 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178683.log 2023-08-31T19:27:30.583 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159321.log 2023-08-31T19:27:30.585 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178683.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.178683.log.gz 2023-08-31T19:27:30.586 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.159321.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.159321.log.gz 2023-08-31T19:27:30.587 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154032.log 2023-08-31T19:27:30.588 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156838.log 2023-08-31T19:27:30.590 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154032.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.154032.log.gz 2023-08-31T19:27:30.591 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156838.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156838.log.gz 2023-08-31T19:27:30.591 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177486.log 2023-08-31T19:27:30.593 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187170.log 2023-08-31T19:27:30.595 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177486.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.177486.log.gz 2023-08-31T19:27:30.596 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187170.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.187170.log.gz 2023-08-31T19:27:30.597 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175717.log 2023-08-31T19:27:30.598 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154452.log 2023-08-31T19:27:30.599 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175717.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.175717.log.gz 2023-08-31T19:27:30.601 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154452.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.154452.log.gz 2023-08-31T19:27:30.601 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178787.log 2023-08-31T19:27:30.603 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154305.log 2023-08-31T19:27:30.604 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178787.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.178787.log.gz 2023-08-31T19:27:30.606 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154305.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.154305.log.gz 2023-08-31T19:27:30.606 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200379.log 2023-08-31T19:27:30.608 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179470.log 2023-08-31T19:27:30.611 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.200379.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.200379.log.gz 2023-08-31T19:27:30.611 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175569.log 2023-08-31T19:27:30.611 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179470.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.179470.log.gz 2023-08-31T19:27:30.612 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153305.log 2023-08-31T19:27:30.612 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175569.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175569.log.gz 2023-08-31T19:27:30.614 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153305.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153305.log.gz 2023-08-31T19:27:30.614 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176779.log 2023-08-31T19:27:30.616 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170509.log 2023-08-31T19:27:30.618 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176779.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176779.log.gz 2023-08-31T19:27:30.619 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170509.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170509.log.gz 2023-08-31T19:27:30.619 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180763.log 2023-08-31T19:27:30.621 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163702.log 2023-08-31T19:27:30.622 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.180763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.180763.log.gz 2023-08-31T19:27:30.624 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163702.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163702.log.gz 2023-08-31T19:27:30.624 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153158.log 2023-08-31T19:27:30.626 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190669.log 2023-08-31T19:27:30.627 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153158.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.153158.log.gz 2023-08-31T19:27:30.629 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190669.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190669.log.gz 2023-08-31T19:27:30.629 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185328.log 2023-08-31T19:27:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148689.log 2023-08-31T19:27:30.632 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185328.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.185328.log.gz 2023-08-31T19:27:30.634 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148689.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148689.log.gz 2023-08-31T19:27:30.634 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148542.log 2023-08-31T19:27:30.636 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162932.log 2023-08-31T19:27:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148542.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148542.log.gz 2023-08-31T19:27:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162932.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.162932.log.gz 2023-08-31T19:27:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188414.log 2023-08-31T19:27:30.641 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149865.log 2023-08-31T19:27:30.642 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188414.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.188414.log.gz 2023-08-31T19:27:30.644 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149865.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149865.log.gz 2023-08-31T19:27:30.644 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190004.log 2023-08-31T19:27:30.646 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148142.log 2023-08-31T19:27:30.647 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190004.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.190004.log.gz 2023-08-31T19:27:30.649 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148142.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148142.log.gz 2023-08-31T19:27:30.649 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147942.log 2023-08-31T19:27:30.651 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187048.log 2023-08-31T19:27:30.652 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147942.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.147942.log.gz 2023-08-31T19:27:30.654 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187048.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.187048.log.gz 2023-08-31T19:27:30.654 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199878.log 2023-08-31T19:27:30.655 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.136593.log 2023-08-31T19:27:30.657 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.199878.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.199878.log.gz 2023-08-31T19:27:30.658 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.tmp-client.admin.136593.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.136593.log.gz 2023-08-31T19:27:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183794.log 2023-08-31T19:27:30.660 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180358.log 2023-08-31T19:27:30.662 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183794.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.183794.log.gz 2023-08-31T19:27:30.663 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180358.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.180358.log.gz 2023-08-31T19:27:30.664 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192792.log 2023-08-31T19:27:30.665 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155096.log 2023-08-31T19:27:30.666 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192792.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.192792.log.gz 2023-08-31T19:27:30.668 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155096.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.155096.log.gz 2023-08-31T19:27:30.668 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149620.log 2023-08-31T19:27:30.670 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196433.log 2023-08-31T19:27:30.671 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149620.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149620.log.gz 2023-08-31T19:27:30.673 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196433.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.196433.log.gz 2023-08-31T19:27:30.673 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169716.log 2023-08-31T19:27:30.675 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179706.log 2023-08-31T19:27:30.678 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169716.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169716.log.gz 2023-08-31T19:27:30.678 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188315.log 2023-08-31T19:27:30.678 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179706.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179706.log.gz 2023-08-31T19:27:30.679 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163653.log 2023-08-31T19:27:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188315.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.188315.log.gz 2023-08-31T19:27:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173622.log 2023-08-31T19:27:30.682 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163653.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163653.log.gz 2023-08-31T19:27:30.682 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196581.log 2023-08-31T19:27:30.683 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173622.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173622.log.gz 2023-08-31T19:27:30.683 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183945.log 2023-08-31T19:27:30.685 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.196581.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.196581.log.gz 2023-08-31T19:27:30.686 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183945.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.183945.log.gz 2023-08-31T19:27:30.688 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153983.log 2023-08-31T19:27:30.689 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151011.log 2023-08-31T19:27:30.690 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153983.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.153983.log.gz 2023-08-31T19:27:30.691 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151011.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.151011.log.gz 2023-08-31T19:27:30.692 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192043.log 2023-08-31T19:27:30.695 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192043.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.192043.log.gz 2023-08-31T19:27:30.888 INFO:teuthology.orchestra.run.smithi146.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-08-31T19:27:30.952 INFO:teuthology.orchestra.run.smithi072.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-08-31T19:27:30.977 INFO:teuthology.orchestra.run.smithi146.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-08-31T19:27:31.046 INFO:teuthology.orchestra.run.smithi146.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-08-31T19:27:31.053 INFO:teuthology.orchestra.run.smithi146.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-08-31T19:27:31.056 INFO:teuthology.orchestra.run.smithi146.stderr: 2023-08-31T19:27:31.056 INFO:teuthology.orchestra.run.smithi146.stderr:real 0m1.596s 2023-08-31T19:27:31.057 INFO:teuthology.orchestra.run.smithi146.stderr:user 0m7.767s 2023-08-31T19:27:31.057 INFO:teuthology.orchestra.run.smithi146.stderr:sys 0m0.840s 2023-08-31T19:27:31.301 INFO:teuthology.orchestra.run.smithi072.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-08-31T19:27:31.307 INFO:teuthology.orchestra.run.smithi072.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-08-31T19:27:31.795 INFO:teuthology.orchestra.run.smithi072.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-08-31T19:27:31.881 INFO:teuthology.orchestra.run.smithi072.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-08-31T19:27:31.884 INFO:teuthology.orchestra.run.smithi072.stderr: 2023-08-31T19:27:31.884 INFO:teuthology.orchestra.run.smithi072.stderr:real 0m2.429s 2023-08-31T19:27:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:user 0m8.269s 2023-08-31T19:27:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:sys 0m2.528s 2023-08-31T19:27:31.886 INFO:tasks.ceph:Archiving logs... 2023-08-31T19:27:31.886 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686/remote/smithi072/log 2023-08-31T19:27:31.888 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-31T19:27:33.678 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686/remote/smithi146/log 2023-08-31T19:27:33.679 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-31T19:27:34.619 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-08-31T19:27:34.637 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-08-31T19:27:34.637 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-31T19:27:34.643 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-31T19:27:34.765 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-08-31T19:27:34.774 INFO:teuthology.task.clock:Checking final clock skew... 2023-08-31T19:27:34.775 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-31T19:27:34.780 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-31T19:27:34.820 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2023-08-31T19:27:34.824 INFO:teuthology.orchestra.run.smithi146.stderr:bash: ntpq: command not found 2023-08-31T19:27:34.828 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-31T19:27:34.828 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-08-31T19:27:34.829 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 47 +660us[ +660us] +/- 91ms 2023-08-31T19:27:34.829 INFO:teuthology.orchestra.run.smithi072.stdout:^* hv02.front.sepia.ceph.com 3 6 377 50 -751us[ -749us] +/- 57ms 2023-08-31T19:27:34.829 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 +445us[ +445us] +/- 63ms 2023-08-31T19:27:34.829 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T19:27:34.831 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-31T19:27:34.831 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2023-08-31T19:27:34.831 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 114 +708us[ +726us] +/- 90ms 2023-08-31T19:27:34.832 INFO:teuthology.orchestra.run.smithi146.stdout:^* hv02.front.sepia.ceph.com 3 6 377 47 -752us[ -740us] +/- 57ms 2023-08-31T19:27:34.832 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 +442us[ +442us] +/- 63ms 2023-08-31T19:27:34.832 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T19:27:34.833 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-08-31T19:27:34.843 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-08-31T19:27:34.844 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-08-31T19:27:34.858 DEBUG:teuthology.orchestra.run.smithi072:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-31T19:27:35.060 DEBUG:teuthology.orchestra.run.smithi146:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-31T19:27:35.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-31T19:27:35.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:27:35.306 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-31T19:27:35.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:27:35.384 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-08-31T19:27:35.396 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-08-31T19:27:35.474 INFO:teuthology.task.internal:Duration was 3592.518898 seconds 2023-08-31T19:27:35.475 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-08-31T19:27:35.486 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-08-31T19:27:35.487 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-31T19:27:35.492 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-31T19:27:35.605 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-31T19:27:35.609 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-31T19:27:35.941 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-08-31T19:27:35.942 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2023-08-31T19:27:35.942 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-31T19:27:36.003 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2023-08-31T19:27:36.004 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-31T19:27:36.067 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-08-31T19:27:36.068 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-31T19:27:36.073 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-31T19:27:36.158 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-08-31T19:27:36.158 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-31T19:27:36.163 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-31T19:27:36.292 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-08-31T19:27:36.302 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-08-31T19:27:36.303 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-31T19:27:36.372 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-31T19:27:36.443 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-08-31T19:27:36.456 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-31T19:27:36.462 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-31T19:27:36.525 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2023-08-31T19:27:36.532 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2023-08-31T19:27:36.566 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-31T19:27:36.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:27:36.611 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-31T19:27:36.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:27:36.656 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-08-31T19:27:36.667 INFO:teuthology.task.internal:Transferring archived files... 2023-08-31T19:27:36.667 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686/remote/smithi072 2023-08-31T19:27:36.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-31T19:27:36.752 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686/remote/smithi146 2023-08-31T19:27:36.752 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-31T19:27:36.831 INFO:teuthology.task.internal:Removing archive directory... 2023-08-31T19:27:36.831 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-31T19:27:36.836 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-31T19:27:36.883 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-08-31T19:27:36.895 INFO:teuthology.task.internal:Not uploading archives. 2023-08-31T19:27:36.895 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-08-31T19:27:36.906 INFO:teuthology.task.internal:Tidying up after the test... 2023-08-31T19:27:36.906 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-31T19:27:36.921 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-31T19:27:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 19:27 /home/ubuntu/cephtest 2023-08-31T19:27:36.970 INFO:teuthology.orchestra.run.smithi146.stdout: 524306 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 19:27 /home/ubuntu/cephtest 2023-08-31T19:27:36.973 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-08-31T19:27:36.984 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-08-31T19:27:37.052 INFO:teuthology.nuke:Checking targets against current locks 2023-08-31T19:27:37.080 DEBUG:teuthology.nuke:shortname: smithi072 2023-08-31T19:27:37.080 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T19:27:37.104 DEBUG:teuthology.nuke:shortname: smithi146 2023-08-31T19:27:37.105 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T19:27:37.108 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 17:10:57.332589', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCl7wbiq/MApWp63+vfnCy/JoQxhjHxP5MfrC/43lYiDNXYYhWVA82bohfjm4tjCiXWA0pmVQIXfUJylsmkobkagX4nnWzxHo4e0dAaYiInPF8SXIE/1qP+33VEq/FhVOqdtRGJd1s6yFwe7+1rYiABDEsQWSTRgDHSjl0nthddygDo2oj99fK8gf8238+SDhcgqo2xpnQtM+ZMZQOimdkOGC3toUbiFoCJ8X8melp3bfzFrox0m+v+JRDOYbpqlFqZ0RqH0WH2p+iM1w8XxM831v5jsNSWaJVzRnADzGdvd3LNcwBpU8dx7nbj+Zmt6UQ7DnCk8P5a1wluM9cf291KtrbMaDHMw4nWv9f47puqg7+5jOPK2JN7Eb6ffmZndPBkenrSdlQ2n2XD8hoql/7VhbbMSnvwQVqhmTXOQHEgQPDAMkAXfPXNIkSK+WhgPYashLGPqp4nIPROEnD8af6Nh9bhTYFIZ5OhRBnZYZreMviwlGv5WYXNeS/lP28AN4U='} 2023-08-31T19:27:37.130 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7385686', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 17:10:57.330574', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/LknFDYQtG86kLAEdfA2CAfYyLpnYltWNFVnnisZIRpWhAijA0KNpttVUhLn9qau+VWIu2MGSQrX0QYo4Wr/hb/9O3rptnO1NDRyX8nZKmalsQnUkfBfjbxiEWT2o9HaT718+pemLljc4je97ZgC4MUiEPwVj+JJ9gEs0eX6WNG6UQtaS/FbE+DSyH2W5cxp6g+LMHr3rkgsqrusJqSK9YTVoea/nHG7I9s2OVMaQV6HrAtdzmWlaobu78kbSPR2Gnyg4Ym4ERWZmToVxfQoL3pvxNx2lrzGEGD3cjrjKqR8iOiQElRbI6IkAkV1E27nQKtROXTe2wnaI2P3Vu3xaVYwpNTpvQFQFWEiRAZ/edpabZ3B4/TXKoX+ZnA+E/L7uJ4tNkLOst5pjKNdZkca6fq4k5YSXU75mINX0J9cpNPI2L7wV17S+u5rPrO6Bv0jpvaM1R+QEt7ZVYBa+QZMOrajruJ/OwO9AG/qAh33t8xejKgOQpR3FfvT2C6vRbRU='} 2023-08-31T19:27:37.160 INFO:teuthology.orchestra.console.smithi072:Power off 2023-08-31T19:27:37.161 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T19:27:37.186 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-08-31T19:27:37.187 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:27:37.204 INFO:teuthology.orchestra.console.smithi146:Power off 2023-08-31T19:27:37.204 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T19:27:37.213 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-08-31T19:27:37.225 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-08-31T19:27:37.226 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:27:37.249 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-08-31T19:27:41.214 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:27:41.250 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:27:41.325 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-08-31T19:27:41.360 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-08-31T19:27:45.328 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:27:45.361 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:27:45.438 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-08-31T19:27:45.472 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-08-31T19:27:45.573 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-08-31T19:27:49.441 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:27:49.552 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-08-31T19:27:49.653 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-08-31T19:27:49.761 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 1931c6efd6a83fb6675c4150c7cc812ef143433f client.1-kernel-sha1: 1931c6efd6a83fb6675c4150c7cc812ef143433f description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 3592.5188982486725 failure_reason: '"2023-08-31T18:50:13.305414+0000 mon.a (mon.0) 400 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_pdonnell@teuthology success: false 2023-08-31T19:27:49.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T19:27:49.849 INFO:teuthology.run:FAIL